Sharp large deviations for sums of bounded from above random variables
|
|
- Garry Dorsey
- 5 years ago
- Views:
Transcription
1 Noame mauscript No. will be iserted by the editor Sharp large deviatios for sums of bouded from above radom variables Xiequa Fa Received: date / Accepted: date Abstract We show large deviatio epasios for sums of idepedet ad bouded from above radom variables. Our moderate deviatio epasios are similar to those of Cramér 1938, Bahadur ad Raga Rao 196, ad Sakhaeko I particular, our results eted Talagrad s iequality from bouded radom variables to radom variables havig fiite +δth momets, where δ, 1]. As a cosequece, we obtai a improvemet of Hoeffdig s iequality. Applicatios to liear regressio, self-ormalized large deviatios ad t-statistic are also discussed. Keywords sharp large deviatios Cramér large deviatios Talagrad s iequality Hoeffdig s iequality sums of idepedet radom variables Mathematics Subject Classificatio 6F1 6F5 6E15 6G5 1 Itroductio Let ξ i i 1 be a sequece of idepedet o-degeerate radom variables r.v.s satisfyig Eξ i =. The study of sharp large deviatios has a log history. May iterestig asymptotic epasios have bee established i Cramér [8], Bahadur ad Raga Rao [1], Petrov [17, 18], Saulis ad Statulevičius [1], Sakhaeko [], Nagaev [16], Bercu ad Rouault [5], Borovkov ad Mogulskii [6], Petrov ad Robiso [19] ad [1]. See also Grama ad Haeusler [13] ad [11] for martigales. For self-ormalized sums, we refer to Shao [3] ad Jig, Shao ad Wag [15], where the authors have established Cramér type large deviatios for self-ormalized r.v.s uder fiite +δth momets, where δ,1]. I this paper, we cosider the sharp large deviatios for sums of bouded from above r.v.s ξ i A for all i, where A is a positive costat. Without loss of geerality, we take A = 1, otherwise we cosider ξ i /A istead of ξ i. Thus ξ i 1 for all i. Let S = ξ i. Deote i = Eξ i ad = i. X. Fa Ceter for Applied Mathematics, Tiaji Uiversity, 37 Tiaji, Chia; Regularity Team, INRIA Saclay, Palaiseau, 911, Frace faiequa@hotmail.com
2 Xiequa Fa The celebrated Beett iequality [] states that: If ξ i 1 for all 1 i, the for all >, + PS B, := e. 1 However, Beett s iequality is ot tight eough. Oe of the improvemets o Beett s iequality is Hoeffdig s iequality cf..8 of [14], which states that for all >, PS H, + } + := 1 + } B,, 3 where ad hereafter by covetio = 1 applied whe =. Cosiderig the followig distributio law Pη i = 1 = / 1+ / ad Pη i = / = 1 1+ /, 4 Hoeffdig showed that is the best that ca be obtaied from the followig epoetial Markov iequality PS if λ EeλS,. Ideed, it is easy to see that Eη i =,η i 1, Eη i = / ad if Eep λ λ } η i = H, for all. Notice that lim PS > = 1 Φ ad lim H, = e /, where Φ = 1 π e t dt is the stadard ormal distributio fuctio. The cetral limit theorem CLT suggests that Hoeffdig s iequality ca be substatially refied by addig a missig factor Θ as, where Θ = The factor Θ satisfies 1 Φ ep } = O 1, Θ,, 6 π1+ π1+ ad πθ is kow as Mill s ratio. For sums of bouded r.v.s B ξ i 1 for some costat B 1 ad all 1 i, Talagrad [4] proved the followig iequalities: For all C B, PS if Θ+C B Θ+C B λ EeλS 7 H,, 8
3 Sharp large deviatios for sums 3 wherec > isaabsolutecostat.seealsosakhaeko[]foraresultsimilarto7butθ isreplacedbyθα, whereα = sup λ [λ logee λs ]} 1/.By6,Talagrad siequality 1 8 improves Hoeffdig s iequality by addig a factor Θ[1 + o1] of order 1+ i the rage = o B as B. I the i.i.d. case, this rage reduces to = o,. I this paper, we eted Talagrad s iequality 7 from bouded r.v.s to r.v.s havig fiite +δth momets, δ,1]. I particular, we improve Talagrad s iequality to a equality, which will imply simple large deviatio epasios. Moreover, a improvemet of Hoeffdig s iequality uder fiite +δth momets is also give. The paper is orgaized as follows. I Sectio, we preset the etesio of Talagrad s iequality. I Sectio 3, we apply our result to liear regressio. I Sectio 4, we give two lower bouds for self-ormalized moderate deviatios ad t-statistic. I Sectio 5, we prepare some auiliary results. I Sectios 6 ad 7, we prove the mai theorems. A etesio of Talagrad s iequality Throughout the paper, we make use of the followig otatios: a b = mia,b}, a b = maa,b}, a + = a, ad θ stads for some values satisfyig θ 1. Moreover, we deote C ad C δ, probably supplied with some idices, a geeric positive absolute costat ad a geeric positive costat depedig oly o δ, respectively. Our mai result is the followig theorem, which eteds Talagrad s iequality 7 from bouded r.v.s to r.v.s havig fiite +δth momets, δ,1]. Theorem 1 Assume that ξ i 1, ad that there eist two costats B 1 ad δ,1] such that The for all C δ B, PS = E ξ i +δ B δ Eξi, i 1. 9 B δ Θ+θC if λ EeλS. 1 I particular, i the i.i.d.case, it implies that for all = o δ/, as. PS = 1+o1 11 Θif λ EeλS By ispectig the proof of Theorem 1, we ca see that Theorem 1 holds true for C δ = 3 61/δ ad C = To show the tightess of equality 1, let S = ε ε be the sums of idepedet Rademacher r.v.s, i.e. Pε i = ±1 = 1 for all i. We display the tail probabilities ad the simulatio of PS R, = Θif λ Ee = PS λs ΘH, i Figure 1, which shows that R, is very close to 1 for large s. I the followig corollary, we give a improvemet o Hoeffdig s iequality.
4 4 Xiequa Fa Approimatio for = 49 Compariso for = 49 Probabilities PS ΘH, Ratios R, Approimatio for = 1 Compariso for = 1 Probabilities PS ΘH, Ratios R, Approimatio for = 1 Compariso for = 1 Probabilities PS ΘH, Ratios Fig. 1 Tail probabilities ad ratios R, are displayed as a fuctio of ad various. Corollary 1 Assume coditio of Theorem 1. The for all C δ B, B δ PS Θ+C 1 H,. 1 It is clear that iequality 1 improves Hoeffdig s boud H, by addig a missig factor Θ+C B δ 1. By 6, this factor is of order of Θ[1+o1] i the rage = o /B δ as B/. I the i.i.d. case, this rage reduces to = o δ/ as. For r.v.s ξ i without momets of order larger tha, some improvemets of Hoeffdig s iequality ca be foud i Betkus [3] ad Betkus, Kalosha ad va Zuijle [4]. See also Pielis [] for a improvemets of Beett-Hoeffdig s iequality 3 which is larger tha
5 Sharp large deviatios for sums 5 Hoeffdig s iequality. I particular, whe ξ i 1 for all 1 i, Betkus [3] showed that PS e Po η i, 13 whereη i arei.i.d.withdistributio4adp o η i isthelog-cocavehullofp η i,i.e.p o isthemiimumlog-cocavefuctiosuchthatp o P.Applyig1toP η i with B = ma1, } ad δ = 1, we have for all 1 C mi,}, 1 P η i = Θ+O1ma, } H,. 14 By the iequalities 13 ad 14, we fid that 1 refies Betkus costat e to 1+o1 for all = o ma 1 δ, } as. Iequality 1 implies the followig Cramér type large deviatios. Corollary Assume coditio of Theorem 1. The for all where ˇ = 1+ 3 PS ad satisfies C δ B, 1 Φˇ [ B ] δ 1+C1+ ˇ, 15 ˇ = 1 6 +o as. I particular, i the i.i.d. case, it implies that for all = o δ/, [ ] PS 1 Φˇ 1+o1. 16 The iterestig feature of the boud 16 is that it closely recoversthe shape of the stadard ormal tail for all = o δ/ as. 3 Applicatio to liear regressio The liear regressio model is give by X k = θφ k +ε k, k 1, 17 where X k,φ k ad ε k are, respectively, the respose variable, the positive covariate ad the oise. Let ε k k 1 be a sequece of i.i.d. radom variables, with fiite variace Eε k = 1 >. Our iterest is to estimate the ukow parameter θ, based o the radom variables X k k 1 ad φ k k 1. The well-kow least squares estimator θ is give by θ = k=1 φ kx k. 18 k=1 φ k Cosider the self-ormalized approimatio θ θ Σk=1 φ k. I the real-world applicatios, for istace cosiderig the impact of the footprit size φ k o the height X k, it is plausible that a φ k b for two positive absolute costats a ad b. If X k, the we also have ε k = X k θϕ k θb c for a positive absolute costat c. By Theorem 1 ad Corollary 1, we have the followig result.
6 6 Xiequa Fa Theorem Assume that there eist three positive absolute costats a, b ad c such that for all k 1, a φ k b, ε k c. We also assume that E ε k +δ < for a absolute costat δ,1]. The for all = o, P θ θ Σk=1 φ k 1 = Θ+θC 1 if Eep φ k ε } k λ δ/ λ + 1 k=1 φ k Θ+C 1 δ/ Proof. From 17 ad 18, it is easy to see that Set H, a1. bc θ θ Σ k=1 φk = φ k ε k. 19 k=1 φ k ξ i = φ kε k a bc. k=1 φ k The it is easy to verify that ξ i 1, Eξi = a 1 a b c ad θ θ Σk=1 φ k bc k=1 = ξ i. By Theorem 1 ad Corollary 1, it follows that for all = o, P θ θ Σk=1 φ k 1 = Θ+θC 1 if Eep a1 } λ ξ δ/ i λ bc = Θ+θC 1 if Eep φ k ε } k λ δ/ λ + 1 k=1 φ k which completes the proof of theorem. Θ+C 1 δ/ H, a1, bc 4 Applicatios to self-ormalized deviatios ad t-statistic Limit theorems for self-ormalized sums S /V, V = ξ i, put a totally ew couteace o classical limit theorems. It is well kow that self-ormalized limit theorems require much fewer momet coditios tha that of ormalized limit theorems. For eample, uder fiite +δth momets, δ,1], Jig, Shao ad Wag [15] showed that PS /V > 1 Φ uiformly for all = omiε 1, κ 1 }, where ε δ = E ξ i / +δ = ep O 1 } 1+ +δ ε δ ad κ = ma 1 i Eξ i/.
7 Sharp large deviatios for sums 7 The proof of lower boud for self-ormalized Cramér type large deviatios is based o the followig observatio: For ay,λ >, } S /V S +λ V } = λ } ζ i λ, where ζ i λ = λξ i 1 λ ξi. Thus P S /V P ζ iλ. Notice that λξi 1 λ ξi i 1 is also a sequece of idepedet radomvariablesadsatisfiesλξ i 1 λ ξi 1.Byaargumetsimilartothe proof of Theorem 1, we have the followig lower boud o the tail probabilities of self-ormalized sums. Theorem 3 Assume that there eist two costats B > ad δ,1] such that The for all = o B, where P S /V P E ξ i +δ B δ Eξ i, i 1. = ep Ψ λ = ζ i λ +Ψ λ } B δ Θ+θC, 1 logee ζiλ ad λ is defied by the followig equatio Eζ i λe ζiλ Ee ζiλ =. Moreover, it holds for all = o B, Ψ λ = O1 +δ B δ, 3 where O1 is bouded by a absolute costat. The self-ormalized sums are closely related to Studet s t-statistic. Studet s t-statistic T is defied by the followig formula T = ξ /, where ξ = S It is kow that for all, P T ad = = P S /V ξ i ξ /. See Efro [9]. By the last equality, oce we have a estimatio for the tail probabilities of self-ormalized sums S /V, we have a similar estimatio for the tail probabilities of T. So Theorem 3 implies the followig lower boud o tail probabilities of T.
8 8 Xiequa Fa Theorem 4 Assume the coditio of Theorem 3. The for all = o B, P T ep B + +Ψ λ} Θ +θc / where Ψ λ is defied by ad λ is defied by the followig equatio Eζ i λe ζiλ Ee ζiλ = + 1. δ, 5 Auiliary Results Cosider the positive radom variable Z λ = e λξi Eeλξi, λ, so that EZ λ = 1 the Esscher trasformatio. Itroduce the cojugate probability measure P λ defied by dp λ = Z λdp. 4 Deote by E λ the epectatio with respect to P λ. Settig ad we obtai the followig decompositio: where B k λ = b i λ = E λ ξ i = Eξ ie λξi Ee λξi, i = 1,...,, η i λ = ξ i b i λ, i = 1,...,, S k = B k λ+y k λ, k = 1,...,, 5 k b i λ ad Y k λ = k η i λ. I the proof of our mai result, we shall eed a two-sided boud of B λ. To this ed, we eed some techical lemmas. For a radom variable bouded from above, the followig iequality is well-kow. Lemma 1 Assume ξ 1. Deote by the stadard variace of ξ. The for all λ, where Ee λξ Beλ,, Beλ,t = t 1+t epλ}+ 1 1+t ep λt}. A proof of the iequality ca be foud i Beett []. This iequality is sharp, ad it attais to equality whe ξ has the distributio law: Pξ = 1 = 1+ ad Pξ = = 1 1+.
9 Sharp large deviatios for sums 9 Lemma Assume E ξ +δ B δ Eξ for some costats B ad δ,1]. The Eξ B. 6 Proof. Usig Jese s iequality, we deduce that Eξ +δ/ E ξ +δ B δ Eξ, which implies 6. Lemma 3 Assume E ξ +δ B δ Eξ for some costats B ad δ,1]. The for all λ, Eξ e λξ 1 B δ λ δ Eξ. 7 Proof. Usig the followig iequality t e t t 1 t δ,t R, we deduce that for all λ, Eλξ e λξ Eλξ E λξ +δ λ Eξ λb δ Eξ, 8 which gives the desired iequality. I the followig lemma, we give a two-sided boud for B λ. Lemma 4 Assume ξ i 1 for all i. The for all λ, B λ e λ 1. If ξ i satisfies E ξ i +δ B δ Eξi for some costats B ad δ,1] for all i, the for all λ, B λ 1 Bδ λ δ λ e λ. 1+δ Proof. By Jese s iequality, we have for all λ, Ee λξi e λeξi = 1. Notice that Eξ i e λξi = Eξ i e λξi 1 for λ. The by the fact ξ i 1, we obtai the upper boud of B λ : For all λ, B λ Eξ i e λξi = λ i et dt = e λ 1. λ Eξ ie tξi dt If ξ i satisfies E ξ i +δ B δ Eξi, by Lemma 3, it follows that for all λ, λ Eξ i e λξi = Eξie tξi dt λ 1 B δ t δ dt = 1 Bδ λ δ λ. 1+δ Therefore, we get the lower boud of B λ: For all λ, Eξ i e λξi B λ = 1 Bδ λ δ λ e λ, Ee λξi 1+δ Eξ i
10 1 Xiequa Fa which completes the proof of Lemma 4. Net, we give a upper boud for the cumulat fuctio Ψ λ = logee λξi, λ. 9 Lemma 5 Assume ξ i 1 for all i. The for all λ, 1 Ψ λ log 1+ / ep λ / } + / 1+ / epλ}. Proof. Sice the fuctio fλ,t = log 1 1+t ep λt}+ t 1+t epλ}, λ,t, has a egative secod derivative i t >, the for ay fied λ, fλ,t is cove i t. Therefore, by Lemma 1 ad Jese s iequality, we get for all λ, Ψ λ fλ,i fλ, / 1 = log 1+ / ep λ / } + / 1+ / epλ}. This completes the proof of Lemma 5. Deote the variace of Y λ by λ = E λ Yλ, λ. By the relatio betwee E ad E λ, it is obvious that Eξ λ = i e λξi Eξ ie λξi Ee λξi Ee λξi, λ. The followig lemma gives some estimatios of λ. Lemma 6 Assume ξ i 1, ad that E ξ i +δ B δ Eξi i. The for all λ, for some costats B, δ,1] ad all e λ 1 B δ λ δ B e λ 1 λ eλ. 3 Moreover, if B 1, it holds λ 1 5B δ λ δ Proof. Sice Ee λξi 1,λ, ad ξ i 1, we get for all λ, λ Eξi Eξ eλξi i eλ = e λ. This gives the upper boud of λ. Net, we cosider the lower boud of λ. It is easy to see that for all λ, Eξ i e λξi = λ Eξ ie tξi dt λ e t Eξ idt = e λ 1 Eξ i, 3
11 Sharp large deviatios for sums 11 Usig Lemma 3 ad 3, we obtai for all λ, Eξi Eξ λ eλξi i e λξi e λ 1 Bδ λ δ e λ 1 Eξ i e λ e λ 1 B δ λ δ B e λ 1, which gives the first lower boud of λ. Notig that λ ad B 1, by a simple calculatio, we obtai 31. Forthe radomvariabley λ, λ,wehavethefollowigresultothe rateofcovergece to the stadard ormal law. Lemma 7 Assume that ξ i 1, ad that E ξ i +δ B δ Eξi for some costats B, δ,1] ad all i. The for all λ, sup P Y λ λ y R λ y Φy +δ Cδ e λ +δ λ E ξ i +δ. Proof. Notice that Y λ = η iλ is the sum of idepedet r.v.s η i λ ad E λ η i λ =. Usig the well-kow rate of covergece i the cetral limit theorem cf. e.g. [17], p. 115, we get for all λ, sup P λ y R Y λ λ y Φy Cδ +δ λ E λ η i +δ. 33 Usig the iequality a+b 1+q q a 1+q +b 1+q for a,b,q, we deduce that for all λ, E λ η i +δ 1+δ E λ ξ i +δ + E λ ξ i +δ +δ E λ ξ i +δ +δ E ξ i +δ e λξi +δ e λ E ξ i +δ. Therefore, we obtai for all λ, sup P Y λ λ λ y Φy +δ Cδ e λ +δ λ y R E ξ i +δ. This completes the proof of Lemma 7. We are ow ready to prove the mai techical result of this sectio. Theorem 5 Assume that ξ i 1, ad that E ξ i +δ B δ Eξi for some costats B ad δ,1] for all i. For a, if there eists a positive λ such that Ψ λ =, the PS = Θ λλ +θε if λ EeλS, 34 where ε = 3+δ Cδ e λ +δ λ E ξ i +δ.
12 1 Xiequa Fa Proof. Accordig to the defiitio of the cojugate probability measure cf. 4, we have the followig represetatio of PS : For give,λ, PS = E λ Z λ 1 1 S } = E λ e λs+ψλ 1 S } = E λ e λ+ψλ λyλ λbλ+λ 1 Yλ+B λ } = e λ+ψλ E λ e λ[yλ+bλ ] 1 Yλ+B λ }. Settig U λ = λy λ+b λ, we get PS = e λ+ψλ e t P λ < U λ tdt. 35 For a, if there eists a λ = λ such that Ψ λ =, the the epoetial fuctio e λ+ψλ i 35 attais its miimum at λ = λ. Sice B λ = Ψ λ =, we have U λ = λy λ ad Usig Lemma 7, we deduce that e λ+ψλ = if λ e λ+ψλ = if λ EeλS. 36 e t P λ < U λ tdt = = = e λyλ P λ < U λ λyλ λλdy e λyλ P < N,1 yλλdy +θε e λyλ dφy+θε = Θ λλ +θε, 37 where N,1 stads for the stadard ormal r.v. Therefore, from 35 ad 36, it follows that PS = Θ λλ +θε if λ EeλS. This completes the proof of Theorem 5. 6 Proof of Theorem 1 I the spirit of Talagrad [4], we would like to make use of Θ to approimate Θλλ i Theorem 5. The proof of Theorem 1 is a cotiuatio of the proof of Theorem 5. Proof of Theorem 1. Sice Θ 1 π, we deduce that 1 Θ λλ Θ 1 λλ π λ λ Usig Lemma 4, we have for all λ 1 B, 1 Bδ λ δ e λ λ B λ = e λ δ
13 Sharp large deviatios for sums 13 By the estimatio of λ i Lemma 6, it follows that for all λb 6 1/δ, ad [ e λλ λ 1 λ 1 5B δ λ δ e λ 1 Bδ λ δ e λ] λ 1+δ [ λ 1+ 1 λbeλb 1 4B δ λ δ 3 λb λ B e λb +λ δ B δ e λb] [ λ 4B δ λ δ + 1 e 1 6 λb 3 λb e 1 1 λb +λ δ B δ ] 4.6λB δ λ 4 λ λ λ 1 5B δ λ δ 1 5 λ 6 λ e λ 1 Bδ λ δ 1+δ e λ 1 6 λ. 41 Hece, iequality 38 implies that for all λ 1 6 1/δ B, Θ λλ Θ 7.6 B πλ 1 δ δ1λ 6} λ 1+δ B π δ1λ< 6} 7.6 π B δ. 4 Therefore, by Lemma 6 ad coditio 9, it is easy to see that for all λ 1 6 1/δ B, e λ +δ λ E ξ i +δ e 1/6 E ξ i +δ B δ. 5/6 1+δ/ +δ By 39 ad the iequality e 1 for all, it follows that ad 1 B δ λ δ λ λ 1 6 1/δ B for all B 3 6 1/δ. 44 Combiig 34, 4 ad 43 together, we have for all 3 6 1/δ B, PS = Θ+θ 7.6 B δ C δ if π λ EeλS, where C δ is the smallest costat such that 33 holds. By Theorem.1 of Che ad Shao [7], we have C δ 4.1. Thus 7.6 π C δ This completes the proof of Theorem 1.
14 14 Xiequa Fa Proof of Corollary 1. Usig 36 ad Lemma 5, we get for all, if λ EeλS = if λ Ee λ+ψλ if ep λ +log λ = H, / ep λ / } } + / 1+ / epλ} 45 Notice that if λ Ee λs Ee S = 1. Thus, the desired iequality follows from Theorem 1 ad 45. Proof of Corollary. Sice Θ is decreasig i, we deduce that Θ Θˇ where ˇ =. Notice that Hoeffdig s boud is less tha Berstei s boud, i.e H, ep ˇ } cf. Remark.1 of [1]. Therefore, from 1, we have for all PS Usig 6, we obtai for all C δ B, PS B δ Θˇ+C ep = 1 Φˇ+C ˇ } B δep ˇ }. 1 Φˇ [ B ] δ 1+C1+ ˇ. C δ B, This completes the proof of Corollary. 7 Proof of Theorem 3 Cosider the positive radom variable H λ = e ζiλ Eeζiλ, λ, so that EH λ = 1. Itroduce the followig ew cojugate probability measure P λ defied by dp λ = H λdp. 46 I this sectio, deote by E λ the epectatio with respect to P λ defied by 46. Accordig to 46, we have the followig represetatio: For all = o B, ] P ζ i λ = E λ [H λ 1 1 ζiλ } = E λ [ep ] η i λ B λ+ψ λ }1 ζiλ }
15 Sharp large deviatios for sums 15 where ad = E λ [ep = E λ [ep B λ = ] η i λ B λ+ψ λ }1 ζiλ } ] η i λ B λ+ψ λ }1 ηiλ Bλ},47 η i λ = ζ i λ E λ ζ i λ E λ ζ i λ = Eζ i λe ζiλ Ee ζiλ Let λ = λ be the smallest positive solutio of the followig equatio Recall From 47, we obtai P ζ i λ = ep = ep B λ =. Y λ = η i λ. } +Ψ λ E λ [e Yλ 1 ] Yλ } } +Ψ λ e y P λ Y λ ydy. 48 Set F y = P λ Y λ y. Recall Cδ 4.1 see Theorem.1 of Che ad Shao [7]. By a argumet similar to the proof of Lemma 7, we have for all = o B, B δ. sup F y Φy/λ C 1 y R Hece, for all = o B, e y P λ Y λ ydy e y P N,1 y/λdy B δ, 1 C where N,1 is the stadard ormal r.v. By a simple calculatio, it follows that e y P N,1 y/λdy = Θλ. From 48, we have for all = o B, P ζ i λ = ep +Ψ λ } B Θλ+θC δ. 49 Net, we would like to substitute for λ i the item Θλ. By a argumet similar to the proof of 4, we get for all = o B, B δ. Θλ Θ C 3 5
16 16 Xiequa Fa So we have for all = o B, } P ζ i λ = ep B δ +Ψ λ Θ+θC, 51 which gives the desired epasio of tail probabilities. I the sequel we shall give a estimatio for Ψ λ. To this ed, we eed the followig useful lemma cf. Lemma 6. of Jig, Shao ad Wag [15]. Lemma 8 Let X be a radom variable with EX = ad EX <. For λ >, let ζ = λx 1 λx. The for λ >, Ee ζ = 1+O1ε λ, 5 Eζe ζ = 1 λ EX +O1ε λ, 53 where ε λ = λ E[X 1 λx >1} ]+λ 3 E[ X 3 1 λx 1} ]. Notice that ε λ E λx +δ = λ +δ E X +δ. Sice E ξ i +δ B δ Eξi, by Lemmas ad 8, for ay λ = ob 1, Ψ λ = O1 λ +δ E ξ i +δ = O1λ +δ B δ 54 ad Eζ i λe ζiλ = 1 Ee ζiλ λ +O1λ +δ B δ. Recall that λ = λ > is the smallest positive solutio of the followig equatio Eζ i λe ζiλ Ee ζiλ =, we have for all = o B, Thus, from 54, it holds λ = O1. Ψ λ = O1 +δ B δ, which gives the estimatio of Ψ λ. This completes the proof of Theorem 3 Ackowledgemets We would like to thak the aoymous referee ad editor for their helpful commets ad suggestios. The work has bee partially supported by the Natioal Natural Sciece Foudatio of Chia Grat os ad
17 Sharp large deviatios for sums 17 Refereces 1. Bahadur R, Raga Rao R. O deviatios of the sample mea. A Math Statist, 196, 31: Beett G. Probability iequalities for sum of idepedet radom variables. J Amer Statist Assoc, 196, 57: Betkus V. O Hoeffdig s iequality. A Probab, 4, 3: Betkus V, Kalosha N, va Zuijle M. O domiatio of tail probabilities of supermartigales: eplicit bouds. Lithuaia Math J, 6, 46: Bercu B, Rouault A. Sharp large deviatios for the Orstei-Uhlebeck process. Theory Probab Appl, 6, 46: Borovkov A A, Mogulskii A A. O large ad superlarge deviatios of sums of idepedet radom vectors uder Cramer s coditio. Theory Probab Appl, 7, 51: Che L H Y, Shao Q M. A o-uiform BerryCEssee boud via Stei s method. Probab Theory Relat Fields, 1, 1: Cramér H. Sur u ouveau théorème-limite de la théorie des probabilités. Actualite s Sci Idust, 1938, 736: Efro B. Studet s t-test uder symmetry coditios. J Amer Statist Assoc, 1969, 6438: Fa X, Grama I, Liu Q. Hoeffdig s iequality for supermartigales. Stochastic Process Appl, 1, 1: Fa X, Grama I, Liu Q. Cramér large deviatio epasios for martigales uder Berstei s coditio. Stochastic Process Appl, 13, 13: Fa X, Grama I, Liu, Q. Sharp large deviatio results for sums of idepedet radom variables. Sci Chia Math, 15, 58: Grama I, Haeusler E. Large deviatios for martigales via Cramer s method. Stochastic Process Appl,, 85: Hoeffdig W. Probability iequalities for sums of bouded radom variables. J Amer Statist Assoc, 1963, 58: Jig B Y, Shao Q M, Wag Q. Self-ormalized Cramér-type large deviatios for idepedet radom variables. A Probab, 3, 31: Nagaev S V. Lower bouds for the probabilities of large deviatios of sums of idepedet radom variables. Theory Probab Appl,, 46: Petrov V V. Sums of Idepedet Radom Variables. Berli: Spriger-Verlag, Petrov V V. Limit Theorems of Probability Theory. Oford: Oford Uiversity Press, Petrov V V, Robiso J. Large deviatios for sums of idepedet o idetically distributed radom variables. Comm Statist Theory Methods, 8, 37: Pielis I. O the Beett-Hoeffdig iequality. A Ist H Poicaré Probab Statist, 14, 5: Saulis L, Statulevičius V A. Limit theorems for large deviatios. Netherlads: Spriger, Sakhaeko A I. Berry-Essee type bouds for large deviatio probabilities. Siberia Math J, 1991, 3: Shao Q M. A Cramér type large deviatio result for Studet s t-statistic. J Theoret Probab, 1999, 1: Talagrad M. The missig factor i Hoeffdig s iequalities. A Ist H Poicaré Probab Statist, 1995, 31: 689-7
Self-normalized deviation inequalities with application to t-statistic
Self-ormalized deviatio iequalities with applicatio to t-statistic Xiequa Fa Ceter for Applied Mathematics, Tiaji Uiversity, 30007 Tiaji, Chia Abstract Let ξ i i 1 be a sequece of idepedet ad symmetric
More informationBerry-Esseen bounds for self-normalized martingales
Berry-Essee bouds for self-ormalized martigales Xiequa Fa a, Qi-Ma Shao b a Ceter for Applied Mathematics, Tiaji Uiversity, Tiaji 30007, Chia b Departmet of Statistics, The Chiese Uiversity of Hog Kog,
More informationGamma Distribution and Gamma Approximation
Gamma Distributio ad Gamma Approimatio Xiaomig Zeg a Fuhua (Frak Cheg b a Xiame Uiversity, Xiame 365, Chia mzeg@jigia.mu.edu.c b Uiversity of Ketucky, Leigto, Ketucky 456-46, USA cheg@cs.uky.edu Abstract
More informationApproximation theorems for localized szász Mirakjan operators
Joural of Approximatio Theory 152 (2008) 125 134 www.elsevier.com/locate/jat Approximatio theorems for localized szász Miraja operators Lise Xie a,,1, Tigfa Xie b a Departmet of Mathematics, Lishui Uiversity,
More informationAsymptotic distribution of products of sums of independent random variables
Proc. Idia Acad. Sci. Math. Sci. Vol. 3, No., May 03, pp. 83 9. c Idia Academy of Scieces Asymptotic distributio of products of sums of idepedet radom variables YANLING WANG, SUXIA YAO ad HONGXIA DU ollege
More informationAn almost sure invariance principle for trimmed sums of random vectors
Proc. Idia Acad. Sci. Math. Sci. Vol. 20, No. 5, November 200, pp. 6 68. Idia Academy of Scieces A almost sure ivariace priciple for trimmed sums of radom vectors KE-ANG FU School of Statistics ad Mathematics,
More informationThe log-behavior of n p(n) and n p(n)/n
Ramauja J. 44 017, 81-99 The log-behavior of p ad p/ William Y.C. Che 1 ad Ke Y. Zheg 1 Ceter for Applied Mathematics Tiaji Uiversity Tiaji 0007, P. R. Chia Ceter for Combiatorics, LPMC Nakai Uivercity
More informationh(x i,x j ). (1.1) 1 i<j n
ESAIM: PS 15 2011 168 179 DOI: 10.1051/ps/2009014 ESAIM: Probability ad Statistics www.esaim-ps.org CRAMÉR TYPE MODERATE DEVIATIONS FOR STUDENTIZED U-STATISTICS,, Tze Leg Lai 1, Qi-Ma Shao 2 ad Qiyig Wag
More informationSelf-normalized Cramér type Moderate Deviations for the Maximum of Sums
Self-ormalized Cramér type Moderate Deviatios for the Maximum of Sums Weidog Liu 1, Qi-Ma Shao ad Qiyig Wag 3 Abstract Let X 1, X,... be idepedet radom variables with zero meas ad fiite variaces, ad let
More informationWeak Laws of Large Numbers for Sequences or Arrays of Correlated Random Variables
Iteratioal Mathematical Forum, Vol., 5, o. 4, 65-73 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/.988/imf.5.5 Weak Laws of Large Numers for Sequeces or Arrays of Correlated Radom Variales Yutig Lu School
More informationConvergence of random variables. (telegram style notes) P.J.C. Spreij
Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space
More informationCentral limit theorem and almost sure central limit theorem for the product of some partial sums
Proc. Idia Acad. Sci. Math. Sci. Vol. 8, No. 2, May 2008, pp. 289 294. Prited i Idia Cetral it theorem ad almost sure cetral it theorem for the product of some partial sums YU MIAO College of Mathematics
More informationMi-Hwa Ko and Tae-Sung Kim
J. Korea Math. Soc. 42 2005), No. 5, pp. 949 957 ALMOST SURE CONVERGENCE FOR WEIGHTED SUMS OF NEGATIVELY ORTHANT DEPENDENT RANDOM VARIABLES Mi-Hwa Ko ad Tae-Sug Kim Abstract. For weighted sum of a sequece
More informationRegression with an Evaporating Logarithmic Trend
Regressio with a Evaporatig Logarithmic Tred Peter C. B. Phillips Cowles Foudatio, Yale Uiversity, Uiversity of Aucklad & Uiversity of York ad Yixiao Su Departmet of Ecoomics Yale Uiversity October 5,
More informationThis section is optional.
4 Momet Geeratig Fuctios* This sectio is optioal. The momet geeratig fuctio g : R R of a radom variable X is defied as g(t) = E[e tx ]. Propositio 1. We have g () (0) = E[X ] for = 1, 2,... Proof. Therefore
More informationCOMPLETE CONVERGENCE AND COMPLETE MOMENT CONVERGENCE FOR ARRAYS OF ROWWISE END RANDOM VARIABLES
GLASNIK MATEMATIČKI Vol. 4969)2014), 449 468 COMPLETE CONVERGENCE AND COMPLETE MOMENT CONVERGENCE FOR ARRAYS OF ROWWISE END RANDOM VARIABLES Yogfeg Wu, Mauel Ordóñez Cabrera ad Adrei Volodi Toglig Uiversity
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationLecture 15: Learning Theory: Concentration Inequalities
STAT 425: Itroductio to Noparametric Statistics Witer 208 Lecture 5: Learig Theory: Cocetratio Iequalities Istructor: Ye-Chi Che 5. Itroductio Recall that i the lecture o classificatio, we have see that
More information<, if ε > 0 2nloglogn. =, if ε < 0.
GLASNIK MATEMATIČKI Vol. 52(72)(207), 35 360 THE DAVIS-GUT LAW FOR INDEPENDENT AND IDENTICALLY DISTRIBUTED BANACH SPACE VALUED RANDOM ELEMENTS Pigya Che, Migyag Zhag ad Adrew Rosalsky Jia Uversity, P.
More informationMAXIMAL INEQUALITIES AND STRONG LAW OF LARGE NUMBERS FOR AANA SEQUENCES
Commu Korea Math Soc 26 20, No, pp 5 6 DOI 0434/CKMS20265 MAXIMAL INEQUALITIES AND STRONG LAW OF LARGE NUMBERS FOR AANA SEQUENCES Wag Xueju, Hu Shuhe, Li Xiaoqi, ad Yag Wezhi Abstract Let {X, } be a sequece
More informationIntroduction to Extreme Value Theory Laurens de Haan, ISM Japan, Erasmus University Rotterdam, NL University of Lisbon, PT
Itroductio to Extreme Value Theory Laures de Haa, ISM Japa, 202 Itroductio to Extreme Value Theory Laures de Haa Erasmus Uiversity Rotterdam, NL Uiversity of Lisbo, PT Itroductio to Extreme Value Theory
More informationOn the convergence rates of Gladyshev s Hurst index estimator
Noliear Aalysis: Modellig ad Cotrol, 2010, Vol 15, No 4, 445 450 O the covergece rates of Gladyshev s Hurst idex estimator K Kubilius 1, D Melichov 2 1 Istitute of Mathematics ad Iformatics, Vilius Uiversity
More informationResearch Article Moment Inequality for ϕ-mixing Sequences and Its Applications
Hidawi Publishig Corporatio Joural of Iequalities ad Applicatios Volume 2009, Article ID 379743, 2 pages doi:0.55/2009/379743 Research Article Momet Iequality for ϕ-mixig Sequeces ad Its Applicatios Wag
More information32 estimating the cumulative distribution function
32 estimatig the cumulative distributio fuctio 4.6 types of cofidece itervals/bads Let F be a class of distributio fuctios F ad let θ be some quatity of iterest, such as the mea of F or the whole fuctio
More informationA note on self-normalized Dickey-Fuller test for unit root in autoregressive time series with GARCH errors
Appl. Math. J. Chiese Uiv. 008, 3(): 97-0 A ote o self-ormalized Dickey-Fuller test for uit root i autoregressive time series with GARCH errors YANG Xiao-rog ZHANG Li-xi Abstract. I this article, the uit
More informationECE 901 Lecture 12: Complexity Regularization and the Squared Loss
ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality
More informationo f P r o b a b i l i t y Vol. 10 (2005), Paper no. 38, pages Journal URL ejpecp/
E l e c t r o i c J o u r a l o f P r o b a b i l i t y Vol. 10 005, Paper o. 38, pages 160-185. Joural URL http://www.math.washigto.edu/ ejpecp/ Limit Theorems for Self-ormalized Large Deviatio 1 Qiyig
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS
MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak
More informationEFFECTIVE WLLN, SLLN, AND CLT IN STATISTICAL MODELS
EFFECTIVE WLLN, SLLN, AND CLT IN STATISTICAL MODELS Ryszard Zieliński Ist Math Polish Acad Sc POBox 21, 00-956 Warszawa 10, Polad e-mail: rziel@impagovpl ABSTRACT Weak laws of large umbers (W LLN), strog
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationREGRESSION WITH QUADRATIC LOSS
REGRESSION WITH QUADRATIC LOSS MAXIM RAGINSKY Regressio with quadratic loss is aother basic problem studied i statistical learig theory. We have a radom couple Z = X, Y ), where, as before, X is a R d
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 3 9/11/2013. Large deviations Theory. Cramér s Theorem
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/5.070J Fall 203 Lecture 3 9//203 Large deviatios Theory. Cramér s Theorem Cotet.. Cramér s Theorem. 2. Rate fuctio ad properties. 3. Chage of measure techique.
More informationNotes 19 : Martingale CLT
Notes 9 : Martigale CLT Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: [Bil95, Chapter 35], [Roc, Chapter 3]. Sice we have ot ecoutered weak covergece i some time, we first recall
More informationAn Introduction to Randomized Algorithms
A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis
More informationAppendix to Quicksort Asymptotics
Appedix to Quicksort Asymptotics James Alle Fill Departmet of Mathematical Scieces The Johs Hopkis Uiversity jimfill@jhu.edu ad http://www.mts.jhu.edu/~fill/ ad Svate Jaso Departmet of Mathematics Uppsala
More informationEstimation for Complete Data
Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of
More informationPrecise Rates in Complete Moment Convergence for Negatively Associated Sequences
Commuicatios of the Korea Statistical Society 29, Vol. 16, No. 5, 841 849 Precise Rates i Complete Momet Covergece for Negatively Associated Sequeces Dae-Hee Ryu 1,a a Departmet of Computer Sciece, ChugWoo
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More information2.2. Central limit theorem.
36.. Cetral limit theorem. The most ideal case of the CLT is that the radom variables are iid with fiite variace. Although it is a special case of the more geeral Lideberg-Feller CLT, it is most stadard
More informationAn alternative proof of a theorem of Aldous. concerning convergence in distribution for martingales.
A alterative proof of a theorem of Aldous cocerig covergece i distributio for martigales. Maurizio Pratelli Dipartimeto di Matematica, Uiversità di Pisa. Via Buoarroti 2. I-56127 Pisa, Italy e-mail: pratelli@dm.uipi.it
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 Fuctioal Law of Large Numbers. Costructio of the Wieer Measure Cotet. 1. Additioal techical results o weak covergece
More informationLecture Chapter 6: Convergence of Random Sequences
ECE5: Aalysis of Radom Sigals Fall 6 Lecture Chapter 6: Covergece of Radom Sequeces Dr Salim El Rouayheb Scribe: Abhay Ashutosh Doel, Qibo Zhag, Peiwe Tia, Pegzhe Wag, Lu Liu Radom sequece Defiitio A ifiite
More informationarxiv: v1 [math.pr] 13 Oct 2011
A tail iequality for quadratic forms of subgaussia radom vectors Daiel Hsu, Sham M. Kakade,, ad Tog Zhag 3 arxiv:0.84v math.pr] 3 Oct 0 Microsoft Research New Eglad Departmet of Statistics, Wharto School,
More informationSolutions to HW Assignment 1
Solutios to HW: 1 Course: Theory of Probability II Page: 1 of 6 Uiversity of Texas at Austi Solutios to HW Assigmet 1 Problem 1.1. Let Ω, F, {F } 0, P) be a filtered probability space ad T a stoppig time.
More informationLet us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.
Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,
More informationNotes 5 : More on the a.s. convergence of sums
Notes 5 : More o the a.s. covergece of sums Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: Dur0, Sectios.5; Wil9, Sectio 4.7, Shi96, Sectio IV.4, Dur0, Sectio.. Radom series. Three-series
More information1 Convergence in Probability and the Weak Law of Large Numbers
36-752 Advaced Probability Overview Sprig 2018 8. Covergece Cocepts: i Probability, i L p ad Almost Surely Istructor: Alessadro Rialdo Associated readig: Sec 2.4, 2.5, ad 4.11 of Ash ad Doléas-Dade; Sec
More informationUnbiased Estimation. February 7-12, 2008
Ubiased Estimatio February 7-2, 2008 We begi with a sample X = (X,..., X ) of radom variables chose accordig to oe of a family of probabilities P θ where θ is elemet from the parameter space Θ. For radom
More informationLecture 01: the Central Limit Theorem. 1 Central Limit Theorem for i.i.d. random variables
CSCI-B609: A Theorist s Toolkit, Fall 06 Aug 3 Lecture 0: the Cetral Limit Theorem Lecturer: Yua Zhou Scribe: Yua Xie & Yua Zhou Cetral Limit Theorem for iid radom variables Let us say that we wat to aalyze
More informationDiagonal approximations by martingales
Alea 7, 257 276 200 Diagoal approximatios by martigales Jaa Klicarová ad Dalibor Volý Faculty of Ecoomics, Uiversity of South Bohemia, Studetsa 3, 370 05, Cese Budejovice, Czech Republic E-mail address:
More information62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +
62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of
More informationOn forward improvement iteration for stopping problems
O forward improvemet iteratio for stoppig problems Mathematical Istitute, Uiversity of Kiel, Ludewig-Mey-Str. 4, D-24098 Kiel, Germay irle@math.ui-iel.de Albrecht Irle Abstract. We cosider the optimal
More informationASYMPTOTIC CONSTANTS FOR MINIMAL DISTANCE IN THE CEN- TRAL LIMIT THEOREM
Elect. Comm. i Probab. 1 (211), 9 13 ELECTRONIC COMMUNICATIONS i PROBABILITY ASYMPTOTIC CONSTANTS FOR MINIMAL DISTANCE IN THE CEN- TRAL LIMIT THEOREM EMMANUEL RIO UMR 81 CNRS, Uiversité de Versailles Sait
More information6.3 Testing Series With Positive Terms
6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial
More informationPeriodic solutions for a class of second-order Hamiltonian systems of prescribed energy
Electroic Joural of Qualitative Theory of Differetial Equatios 215, No. 77, 1 1; doi: 1.14232/ejqtde.215.1.77 http://www.math.u-szeged.hu/ejqtde/ Periodic solutios for a class of secod-order Hamiltoia
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013. Large Deviations for i.i.d. Random Variables
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013 Large Deviatios for i.i.d. Radom Variables Cotet. Cheroff boud usig expoetial momet geeratig fuctios. Properties of a momet
More informationEquivalent Conditions of Complete Convergence and Complete Moment Convergence for END Random Variables
Chi. A. Math. Ser. B 391, 2018, 83 96 DOI: 10.1007/s11401-018-1053-9 Chiese Aals of Mathematics, Series B c The Editorial Office of CAM ad Spriger-Verlag Berli Heidelberg 2018 Equivalet Coditios of Complete
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationApplication to Random Graphs
A Applicatio to Radom Graphs Brachig processes have a umber of iterestig ad importat applicatios. We shall cosider oe of the most famous of them, the Erdős-Réyi radom graph theory. 1 Defiitio A.1. Let
More informationA RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS
J. Japa Statist. Soc. Vol. 41 No. 1 2011 67 73 A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS Yoichi Nishiyama* We cosider k-sample ad chage poit problems for idepedet data i a
More informationProblem Set 4 Due Oct, 12
EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios
More information1 = δ2 (0, ), Y Y n nδ. , T n = Y Y n n. ( U n,k + X ) ( f U n,k + Y ) n 2n f U n,k + θ Y ) 2 E X1 2 X1
8. The cetral limit theorems 8.1. The cetral limit theorem for i.i.d. sequeces. ecall that C ( is N -separatig. Theorem 8.1. Let X 1, X,... be i.i.d. radom variables with EX 1 = ad EX 1 = σ (,. Suppose
More informationA Note on the Kolmogorov-Feller Weak Law of Large Numbers
Joural of Mathematical Research with Applicatios Mar., 015, Vol. 35, No., pp. 3 8 DOI:10.3770/j.iss:095-651.015.0.013 Http://jmre.dlut.edu.c A Note o the Kolmogorov-Feller Weak Law of Large Numbers Yachu
More informationRegression with quadratic loss
Regressio with quadratic loss Maxim Ragisky October 13, 2015 Regressio with quadratic loss is aother basic problem studied i statistical learig theory. We have a radom couple Z = X,Y, where, as before,
More informationGeneralization of Samuelson s inequality and location of eigenvalues
Proc. Idia Acad. Sci. Math. Sci.) Vol. 5, No., February 05, pp. 03. c Idia Academy of Scieces Geeralizatio of Samuelso s iequality ad locatio of eigevalues R SHARMA ad R SAINI Departmet of Mathematics,
More informationA survey on penalized empirical risk minimization Sara A. van de Geer
A survey o pealized empirical risk miimizatio Sara A. va de Geer We address the questio how to choose the pealty i empirical risk miimizatio. Roughly speakig, this pealty should be a good boud for the
More informationA central limit theorem for moving average process with negatively associated innovation
Iteratioal Mathematical Forum, 1, 2006, o. 10, 495-502 A cetral limit theorem for movig average process with egatively associated iovatio MI-HWA KO Statistical Research Ceter for Complex Systems Seoul
More informationHyun-Chull Kim and Tae-Sung Kim
Commu. Korea Math. Soc. 20 2005), No. 3, pp. 531 538 A CENTRAL LIMIT THEOREM FOR GENERAL WEIGHTED SUM OF LNQD RANDOM VARIABLES AND ITS APPLICATION Hyu-Chull Kim ad Tae-Sug Kim Abstract. I this paper we
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationLinear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d
Liear regressio Daiel Hsu (COMS 477) Maximum likelihood estimatio Oe of the simplest liear regressio models is the followig: (X, Y ),..., (X, Y ), (X, Y ) are iid radom pairs takig values i R d R, ad Y
More informationDistribution of Random Samples & Limit theorems
STAT/MATH 395 A - PROBABILITY II UW Witer Quarter 2017 Néhémy Lim Distributio of Radom Samples & Limit theorems 1 Distributio of i.i.d. Samples Motivatig example. Assume that the goal of a study is to
More informationSome Tauberian theorems for weighted means of bounded double sequences
A. Ştiiţ. Uiv. Al. I. Cuza Iaşi. Mat. N.S. Tomul LXIII, 207, f. Some Tauberia theorems for weighted meas of bouded double sequeces Cemal Bele Received: 22.XII.202 / Revised: 24.VII.203/ Accepted: 3.VII.203
More informationTopic 5 [434 marks] (i) Find the range of values of n for which. (ii) Write down the value of x dx in terms of n, when it does exist.
Topic 5 [44 marks] 1a (i) Fid the rage of values of for which eists 1 Write dow the value of i terms of 1, whe it does eist Fid the solutio to the differetial equatio 1b give that y = 1 whe = π (cos si
More informationChapter 5. Inequalities. 5.1 The Markov and Chebyshev inequalities
Chapter 5 Iequalities 5.1 The Markov ad Chebyshev iequalities As you have probably see o today s frot page: every perso i the upper teth percetile ears at least 1 times more tha the average salary. I other
More informationECE 330:541, Stochastic Signals and Systems Lecture Notes on Limit Theorems from Probability Fall 2002
ECE 330:541, Stochastic Sigals ad Systems Lecture Notes o Limit Theorems from robability Fall 00 I practice, there are two ways we ca costruct a ew sequece of radom variables from a old sequece of radom
More informationErratum to: An empirical central limit theorem for intermittent maps
Probab. Theory Relat. Fields (2013) 155:487 491 DOI 10.1007/s00440-011-0393-0 ERRATUM Erratum to: A empirical cetral limit theorem for itermittet maps J. Dedecker Published olie: 25 October 2011 Spriger-Verlag
More informationNEW FAST CONVERGENT SEQUENCES OF EULER-MASCHERONI TYPE
UPB Sci Bull, Series A, Vol 79, Iss, 207 ISSN 22-7027 NEW FAST CONVERGENT SEQUENCES OF EULER-MASCHERONI TYPE Gabriel Bercu We itroduce two ew sequeces of Euler-Mascheroi type which have fast covergece
More informationLimit distributions for products of sums
Statistics & Probability Letters 62 (23) 93 Limit distributios for products of sums Yogcheg Qi Departmet of Mathematics ad Statistics, Uiversity of Miesota-Duluth, Campus Ceter 4, 7 Uiversity Drive, Duluth,
More informationMOMENT-METHOD ESTIMATION BASED ON CENSORED SAMPLE
Vol. 8 o. Joural of Systems Sciece ad Complexity Apr., 5 MOMET-METHOD ESTIMATIO BASED O CESORED SAMPLE I Zhogxi Departmet of Mathematics, East Chia Uiversity of Sciece ad Techology, Shaghai 37, Chia. Email:
More informationarxiv: v1 [math.pr] 4 Dec 2013
Squared-Norm Empirical Process i Baach Space arxiv:32005v [mathpr] 4 Dec 203 Vicet Q Vu Departmet of Statistics The Ohio State Uiversity Columbus, OH vqv@statosuedu Abstract Jig Lei Departmet of Statistics
More informationLecture 19: Convergence
Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may
More informationThe Wasserstein distances
The Wasserstei distaces March 20, 2011 This documet presets the proof of the mai results we proved o Wasserstei distaces themselves (ad ot o curves i the Wasserstei space). I particular, triagle iequality
More informationStatistical Analysis on Uncertainty for Autocorrelated Measurements and its Applications to Key Comparisons
Statistical Aalysis o Ucertaity for Autocorrelated Measuremets ad its Applicatios to Key Comparisos Nie Fa Zhag Natioal Istitute of Stadards ad Techology Gaithersburg, MD 0899, USA Outlies. Itroductio.
More informationA Weak Law of Large Numbers Under Weak Mixing
A Weak Law of Large Numbers Uder Weak Mixig Bruce E. Hase Uiversity of Wiscosi Jauary 209 Abstract This paper presets a ew weak law of large umbers (WLLN) for heterogeous depedet processes ad arrays. The
More informationLECTURE 8: ASYMPTOTICS I
LECTURE 8: ASYMPTOTICS I We are iterested i the properties of estimators as. Cosider a sequece of radom variables {, X 1}. N. M. Kiefer, Corell Uiversity, Ecoomics 60 1 Defiitio: (Weak covergece) A sequece
More informationA Note on Matrix Rigidity
A Note o Matrix Rigidity Joel Friedma Departmet of Computer Sciece Priceto Uiversity Priceto, NJ 08544 Jue 25, 1990 Revised October 25, 1991 Abstract I this paper we give a explicit costructio of matrices
More informationON POINTWISE BINOMIAL APPROXIMATION
Iteratioal Joural of Pure ad Applied Mathematics Volume 71 No. 1 2011, 57-66 ON POINTWISE BINOMIAL APPROXIMATION BY w-functions K. Teerapabolar 1, P. Wogkasem 2 Departmet of Mathematics Faculty of Sciece
More information1 Introduction to reducing variance in Monte Carlo simulations
Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by
More informationChapter 2 Transformations and Expectations
Chapter Trasformatios a Epectatios Chapter Distributios of Fuctios of a Raom Variable Problem: Let be a raom variable with cf F ( ) If we efie ay fuctio of, say g( ) g( ) is also a raom variable whose
More informationSDS 321: Introduction to Probability and Statistics
SDS 321: Itroductio to Probability ad Statistics Lecture 23: Cotiuous radom variables- Iequalities, CLT Puramrita Sarkar Departmet of Statistics ad Data Sciece The Uiversity of Texas at Austi www.cs.cmu.edu/
More informationLaw of the sum of Bernoulli random variables
Law of the sum of Beroulli radom variables Nicolas Chevallier Uiversité de Haute Alsace, 4, rue des frères Lumière 68093 Mulhouse icolas.chevallier@uha.fr December 006 Abstract Let be the set of all possible
More informationThe central limit theorem for Student s distribution. Problem Karim M. Abadir and Jan R. Magnus. Econometric Theory, 19, 1195 (2003)
The cetral limit theorem for Studet s distributio Problem 03.6.1 Karim M. Abadir ad Ja R. Magus Ecoometric Theory, 19, 1195 (003) Z Ecoometric Theory, 19, 003, 1195 1198+ Prited i the Uited States of America+
More informationEntropy Rates and Asymptotic Equipartition
Chapter 29 Etropy Rates ad Asymptotic Equipartitio Sectio 29. itroduces the etropy rate the asymptotic etropy per time-step of a stochastic process ad shows that it is well-defied; ad similarly for iformatio,
More informationEmpirical Process Theory and Oracle Inequalities
Stat 928: Statistical Learig Theory Lecture: 10 Empirical Process Theory ad Oracle Iequalities Istructor: Sham Kakade 1 Risk vs Risk See Lecture 0 for a discussio o termiology. 2 The Uio Boud / Boferoi
More informationSequences and Series of Functions
Chapter 6 Sequeces ad Series of Fuctios 6.1. Covergece of a Sequece of Fuctios Poitwise Covergece. Defiitio 6.1. Let, for each N, fuctio f : A R be defied. If, for each x A, the sequece (f (x)) coverges
More informationDetailed proofs of Propositions 3.1 and 3.2
Detailed proofs of Propositios 3. ad 3. Proof of Propositio 3. NB: itegratio sets are geerally omitted for itegrals defied over a uit hypercube [0, s with ay s d. We first give four lemmas. The proof of
More informationStatistical Theory MT 2008 Problems 1: Solution sketches
Statistical Theory MT 008 Problems : Solutio sketches. Which of the followig desities are withi a expoetial family? Explai your reasoig. a) Let 0 < θ < ad put fx, θ) = θ)θ x ; x = 0,,,... b) c) where α
More informationMiskolc Mathematical Notes HU e-issn Uniform approximation by means of some piecewise linear functions. Zoltán Finta
Miskolc Mathematical Notes HU e-issn 787-43 Vol. 3 (00, No, pp. 0- DOI: 0.854/MMN.00.56 Uiform approimatio by meas of some piecewise liear fuctios Zoltá Fita Mathematical Notes, Miskolc, Vol. 3., No..,
More informationKernel density estimator
Jauary, 07 NONPARAMETRIC ERNEL DENSITY ESTIMATION I this lecture, we discuss kerel estimatio of probability desity fuctios PDF Noparametric desity estimatio is oe of the cetral problems i statistics I
More informationA Note on Sums of Independent Random Variables
Cotemorary Mathematics Volume 00 XXXX A Note o Sums of Ideedet Radom Variables Pawe l Hitczeko ad Stehe Motgomery-Smith Abstract I this ote a two sided boud o the tail robability of sums of ideedet ad
More information