h(x i,x j ). (1.1) 1 i<j n
|
|
- Oliver Shepherd
- 5 years ago
- Views:
Transcription
1 ESAIM: PS DOI: /ps/ ESAIM: Probability ad Statistics CRAMÉR TYPE MODERATE DEVIATIONS FOR STUDENTIZED U-STATISTICS,, Tze Leg Lai 1, Qi-Ma Shao 2 ad Qiyig Wag 3 Abstract. Let T be a Studetized U-statistic. It is proved that a Cramér type moderate deviatio P T x/1 Φx 1 holds uiformly i x [0,o 1/6 whe the kerel satisfies some regular coditios. Mathematics Subject Classificatio. 60F10, 60F05. Received September 20, Revised Jue 2, Itroductio ad mai results Let X, X 1,X 2,...,X be a sequece of idepedet ad idetically distributed i.i.d. radom variables, ad let hx 1,x 2 be a real-valued symmetric Borel measurable fuctio. Assume that θ = EhX 1,X 2. A ubiased estimator of θ is the Hoeffdig [7] U-statistic U = 2 1 1i<j hx i,x j. 1.1 The U-statistic elegatly ad usefully geeralizes the otio of a sample mea. Typical examples iclude i sample mea: hx 1,x 2 = 1 2 x 1 + x 2 ; ii sample variace: hx 1,x 2 = 1 2 x 1 x 2 2 ; iii Gii s mea differece: hx 1,x 2 = x 1 x 2 ; iv oe-sample Wilcoxo s statistic: hx 1,x 2 =1x 1 + x 2 0. The o-degeerate U-statistic shares may limitig properties with the sample mea. For example, if Eh 2 X 1, X 2 < ad σ 2 1 =VargX 1 > 0, where Keywords ad phrases. Moderate deviatio, u-statistic, studetized. gx =Ehx, X, 1.2 Research partially supported by NSF-MCS Research partially supported by Hog Kog RGC CERG ad Research partially supported by a Australia Research Coucil ARC discovery project. 1 Departmet of Statistics, Staford Uiversity Staford, CA CA , USA; lait@staford.edu 2 Departmet of Mathematics, Hog Kog Uiversity of Sciece ad Techology, Clear Water Bay, Kowloo Hog Kog, P.R. Chia; maqmshao@ust.hk 3 School of Mathematics ad Statistics, Uiversity of Sydey, NSW 2006, Australia; qiyig@maths.usyd.edu.au Article published by EDP Scieces c EDP Scieces, SMAI 2011
2 CRAMÉR TYPE MODERATE DEVIATIONS FOR STUDENTIZED U-STATISTICS 169 the the cetral limit theorem holds, i.e., sup P U θ x Φx 0, 1.3 x 2σ 1 where Φx is the stadard ormal distributio fuctio. A systematic presetatio of the theory of U-statistics was give i [10]. We refer the study o uiform Berry-Essee boud for U-statistics to Alberik ad Betkus [1, 2], Wag ad Weber [17] ad the refereces there. Oe ca also refer to Borovskich ad Weber [4,5] forlarge deviatios. However, sice σ 1 is typically ukow, it is ecessary to estimate σ 1 first ad the substitute it i 1.3. Therefore, what used i practice is actually the followig studetized U-statistic see, e.g., Arvese [3] where R 2 = T = U θ/r, 1.4 qi U 2 with q i = 1 1 hx i,x j. 1.5 Oe ca refer to Wag, Jig ad Zhao [16] o uiform Berry-Essee boud for studetized U-statistics. Also see Callaert ad Veraverbeke [6] adzhao[18]. We also refer to Vademaele ad Veraverbeke [14] ad Wag [15] for the Cramér type moderate deviatio. A special case of the studetized U-statics is the Studet t-statistic with hx 1,x 2 =x 1 + x 2 /2. Although the t-statistic has a close relatioship with the classical stadardized partial sum, it has bee foud that the t-statistic ejoys much better limitig properties. For example, Shao [11] proves that the large deviatio always holds for t-statistic without ay momet assumptio ad Shao [12] further shows that a Cramér type moderate deviatio is valid uder oly a fiite third momet. Jig, et al. [8] provedacramér type moderate deviatio result for idepedet radom variables uder a Lideberg type coditio. Jig, et al. [9] obtaied the saddlepoit approximatio without ay momet coditio. Thus, it is atural to ask whether similar results hold for the studetized U-statistics. The mai objective of this paper is to show that the studetized U-statistics share similar properties like the studet t-statistic does whe the kerel satisfies h 2 x 1,x 2 θ c 0 [σ g 2 x 1 θ + g 2 x 2 θ] 1.6 for some c 0 > 0. This coditio is satisfied by the typical examples of U-statistics listed at the begiig of this sectio. Theorem 1.1. Assume 0 <σ1 2 < ad that 1.6 holds for some c 0 > 0. The, for ay x with x ad x = o 1/2, If i additio E gx 1 3 <, the j=1 j i l P T x x 2 / P T x =1 Φx [ 1+o1 ] 1.8 holds uiformly i x [0,o 1/6. Assume θ =0. WriteS = j=1 gx jadv 2 = j=1 g2 X j. It is kow see Shao [11] that l P S /V x x 2 /2 1.9 for ay x with x ad x = o 1/2. It is also kow see Jig et al. [8] that if E gx 1 3 <, the [ P S /V x =1 Φx 1+O11 + x 3 1/2] 1.10
3 170 T.L. LAI, Q.-M. SHAO AND Q. WANG for 0 x O 1/6. The followig theorem shows that the studetized U-statistic T ca be approximated by the self-ormalized sum S /V uder the coditio 1.6. As a result, 1.7 ad1.8 follow from 1.9 ad 1.10, together with 1.11 below, respectively. Theorem 1.2. Assume that θ =0, 0 <σ1 2 = Eg2 X 1 < ad the kerel hx 1,x 2 satisfies the coditio 1.6. The there exists a costat η>0 depedig oly o σ1 2 ad c 0 such that, for all 4/ 1 ɛ < 1, 0 x /3 ad sufficietly large, P [ S /V 1 + ɛ x ] e η miɛ2, ɛ x} P T x P [ S /V 1 ɛ x ] e η miɛ2, ɛ x} This paper is orgaized as follows. I the ext sectio we will prove the mai theorems. A techical propositio will be postpoed to Sectio 3. We start with some prelimiaries. Write where R 2 = q2 i. Observe that 2. Proofs of theorems T = U /R, 2.1 q i U 2 = qi 2 2U q i + U 2 = q 2 i U 2. We have T = 1/ T 2 2 ad T x} = T x } [1 + 4x 2 1/ 2 2 ] 1/2 2.3 We ow establish a relatioship betwee T ad S /V. Todothis,furtherletψx 1,x 2 =hx 1,x 2 gx 1 gx 2, Δ = 1 ψx i,x j, W i = ψx i,x j, Λ 2 = W i 2. 1 It is easy to see that Also observe that j=1 j i 1i<j T j=1 j i hx i,x j = 2gX i +S + W i U /2 = S +Δ. 2.4 ad R 2 = j=1 j i 2 hx i,x j = 2 2 V 2 +Λ2 +3 4S gx i W i +2S W i.
4 CRAMÉR TYPE MODERATE DEVIATIONS FOR STUDENTIZED U-STATISTICS 171 Therefore, usig gx iw i V Λ, S by the Hőlder s iequality, we have W i S Λ ad Λ 2 i max W 2 1i R 2 = 4 1 V δ, 2.5 where δ [ Λ 2 V 2 Λ 2 V 2 + 3S2 V 2 + 4Λ V + 2 Λ +2 S ] Λ V + 3 S2 V 2 V By ad2.1 T S +Δ =, 2.7 d V 1 + δ 1/2 where d = / 1. Next propositio shows that Δ ad δ are egligible. Propositio 2.1. There exist costats δ 0 > 0 ad δ 1 > 0, depedig oly o σ1 2 ad c 0, such that for all y>0 P δ y exp δ 0 mi1,y,y 2 } 2.8 ad P Δ yv 2 +2exp δ 1 mi, y }. 2.9 The proof of Propositio 2.1 is postpoed to Sectio 3. We metio that the proof is based o expoetial iequalities for self-ormalized sums of martigaledifferece sequece Lems. 3.1 ad 3.4 ad for self-ormalized sums of idepedet radom variables Lems. 3.2 ad 3.3. These iequalities are iterestig i their ow rights. We are ow ready to prove our mai results. Proof of Theorem 1.2. Sice x 2 /9 ad0 ɛ < 1, it is easy to show that, for 0 x /3, τ 1 ɛ 1/2τ 4 1 ɛ /2, [ wheever is sufficietly large, where τ = 1 Propositio 2.1 that 1+ 4x ] 1/2. Hece it follows from 2.3, 2.7 ad P T x P [ S /V 1 ɛ x ] + P Δ /V x ɛ 1 + xτ 1 + δ 1/2} } Δ /V xɛ 1 + xτ P [ S /V 1 ɛ x ] + P P [ S /V 1 ɛ x ] + P + P } Δ /V xɛ /2 + P δ ɛ /4 P [ S /V 1 ɛ x ] e η miɛ2, ɛ x}, } δ ɛ /4 }
5 172 T.L. LAI, Q.-M. SHAO AND Q. WANG where η>0 is a costat depedig oly o σ1 2 ad c 0. This proves the upper boud of Similarly, for the lower boud of 1.11 P S /V 1 + ɛ x P T x+p Δ /V x 1 + ɛ xτ 1 + δ 1/2} P T x+p Δ /V x 1 + ɛ xτ 1 + ɛ /4 1/2} + P δ ɛ /4 } P T x+p Δ /V x 1 + ɛ x 1 + 1/ ɛ /8 + P δ ɛ /4 P T x+p Δ /V xɛ /2 + P δ ɛ /4 P T x e η miɛ2, ɛ x}. The proof of Theorem 1.2 is ow complete. ProofofTheorem1.1. Theorem 1.1 follows from adtheorem1.2 by a suitable choice of ɛ, together with some routie calculatios. Ideed, by the cetral limit theorem for T see, e.g., Thm.3.1,[16], the result 1.8 isobviouswhe0 x 1. I order to prove 1.8 forx [1,o 1/6, we choose ɛ = maxɛ x/, 1/8 }, where ɛ is a sequece of costats satisfyig ɛ ad ɛ x3 / 0forx [1,o 1/6. It is readily to see that ad hece uiformly i x [1,o 1/6, miɛ 2, ɛ x} ɛ x maxɛ x 2, 3/8 x}, e η miɛ2, ɛ x} = o [ 1 Φx ], 2.10 whe is sufficietly large, where we have used a well-kow fact: for x>0, 1 1 2π x 1 x 3 e x2 /2 1 Φx 1 1 /2 2π x e x2. The meaig of 2.10 is that for all sequece u with u = o 1/6 lim sup x [1,u ] O the other had, it follows from 1.10 that wherewehaveusedtheresult: P [ S /V 1 ɛ x ] e η miɛ2, ɛ x} /1 Φx = 0. 1 Φ [ 1 ɛ x ]}[ 1+O1x 3 / ] [ 1 Φx ] 1+ Φ[ 1 ɛ x ] Φx }[ 1+O1x 3 / ] 1 Φx = [ 1 Φx ][ 1+o1 ], 2.11 Φ [ 1 ɛ x ] Φx ɛ x e 1 ɛ2 x 2 /2 = o [ 1 Φx ], uiformly i [1,o 1/6, sice ɛ x 2 ɛ x 3 / = o1. By virtue of ad the upper boud of 1.11, we obtai P T x [ 1 Φx ] [1 + o1]. Similarly we have P T x [ 1 Φx ] [1 + o1]. This proves 1.8.
6 CRAMÉR TYPE MODERATE DEVIATIONS FOR STUDENTIZED U-STATISTICS 173 I a similar matter, by choosig ɛ =max 1/8,ɛ } where ɛ is a sequece of costats such that ɛ 0 so slowly that ɛ 2 /x2,wehave ad therefore which together with 1.11 ad1.9 proves1.7. The proof of Theorem 1.2 is ow complete. = o1e 0.5η miɛ2, ɛ x, x 2 = omiɛ 2, ɛ x e η miɛ2, ɛ x = o1e x2 /4, 3. Proof of propositio 2.1 I this sectio, we give the proof of Propositio 2.1. Lemma 3.1 is iterestig i itself as it provides a expoetial boud for martigale differece uder fiite momet coditios. Lemma 3.1. Let ξ i, F i,i 1} be a sequece of martigale differece with Eξi 2 < ad put d2 i = Eξ2 i F i 1. The P ξ i x 2exp x 2 /8 3.1 ξ2 i +2d2 i +3Eξ2 i 1/2 for all x>0. Proof. We first show that e x x2 1+x1 x 1/2} 3.2 for all x R. It is easy to see that 3.2 holdsforx< 1/2. For x 1/2 letfx =x x 2 l1 + x. Observe that f x = 1 2x 1 x1 + 2x = 1+x 1+x > 0 for 1/2 <x<0, =0 forx =0, < 0 for x>0. Therefore f achieves maximum at x =0,thatis,fx f0 = 0 for x> 1/2. This proves 3.2. It follows from 3.2 thatfort R E exptξ i t 2 ξi 2 +2d 2 i F i 1 = e 2t2 d 2 i E exptξ i t 2 ξi 2 F i 1 e 2t2 d 2 i 1+Etξ i 1 tξi 1/2} F i 1 = e 2t2 d 2 i 1 Etξ i 1 tξi< 1/2} F i 1 e 2t2 d 2 i 1+2Etξ i 2 F i 1 1. This shows that exp t i j=1 ξ j t 2 } i j=1 ξ2 j +2d2 j, F i,i 1 is a super-martigale ad hece E exp t ξ j t 2 j=1 j=1 ξj 2 +2d 2 j
7 174 T.L. LAI, Q.-M. SHAO AND Q. WANG By 3.3 adtheorem2.1of, E exp a ξ i 2 ξ2 i +2d2 i +3Eξ2 i 1/2 for all a>0. Lettig a = x/2 2 together with Markov s iequality yields P ξ i x ξ2 i +2d2 i +3Eξ2 i 1/2 2expa e ax/ 2 a E exp ξ i 2 ξ2 i +2d2 i +3Eξ2 i 1/2 2exp ax/ 2+a 2 = 2exp x 2 /8. This proves 3.1. Lemma 3.2. Let ξ i,i 1} be idepedet radom variables with zero meas ad fiite variaces. Put S = ξ i, V 2 = ξi 2, B 2 = Eξi 2. The P S xv 2 +5B2 1/2 2exp x 2 /8 for x>0 3.5 ad ES 2 I S xv +4B 23B 2 e x2 /4 3.6 Proof. Result 3.5 follows from 3.1 directly because Eξi 2 F i 1 =Eξi 2 by idepedece of radom variables. Whe 0 <x<3, we have 23e x2 /4 1adES 2I S xv +4B ES 2 = B2 ad hece 3.6 holds. Whe x>3, let η i, 1 i } be a idepedet copy of ξ i, 1 i }. Set By the Chebyshev iequality, Notig that P S 2B, V 2 S = η i,v 2 = ηi 2. 4B2 1 P S > 2B P V 2 > 4B2 1 1/4 1/4 =1/2. S x4b + V, S 2B,V 2 4B2 } S S x4b + ξ i η i 2 1/2 V S S x2b + ξ i η i 2 1/2 2B, S 2B } 1/2 S S x ξ i η i 2, S 2B }, 2B, S 2B,V 2 4B 2 }
8 CRAMÉR TYPE MODERATE DEVIATIONS FOR STUDENTIZED U-STATISTICS 175 we have ESI S 2 xv +4B = ES2 I S xv +4B I S 2B,V 2 4B2 P S 2B,V 2 4B2 1/2 2ESI 2 S S x ξ i η i 2, S 2B 1/2 4ES S 2 I S S x ξ i η i 2, S 2B +4ES 2 I 1/2 S S x ξ i η i 2, S 2B [by the fact that S 2 2S S 2 +2S 2 1/2 4ES S 2 I S S x ξ i η i 2 1/2 +16BP 2 S S x ξ i η i ] Let ε i, 1 i } be a Rademacher sequece idepedet of ξ i, 1 i } ad η i, 1 i }. Notig that ξ i η i, 1 i } is a sequece of idepedet symmetric radom variables, ε i ξ i η i, 1 i } ad ξ i η i, 1 i } have the same joit distributio. It is kow that P a i ε i x a 2 i 1/2 2e x2 /2 3.8 for ay real umbers a i }. Hece with Y = a iε i / 1/2 a2 i 1 2 a 2 i E a i ε i I a i ε i x a 2 i 1/2 = EY 2 IY x = x 2 P Y x+2 2x 2 e x2 /2 +4 x x tp Y tdt te t2 /2 dt = 22+x 2 e x2 /2 2.4e x2 /4 3.9 for x>3. Thus by 3.8 ad3.9 forx>3 1/2 P S S x ξ i η i 2 2e x2 /2 0.22e x2 /4 3.10
9 176 T.L. LAI, Q.-M. SHAO AND Q. WANG ad 2 ES S 2 I S S x ξ i η i 1/2I S 2 2B =E ε i ξ i η i I ε i ξ i η i x ξ i η i 2 1/2 2.4e x2 /4 E ξ i η i 2 = 4.8Be 2 x2 / This proves 3.6 by3.7, 3.10 ad3.11. I the followig two lemmas we cotiue to use the otatios give i Sectio 2. Lemma 3.3. Assume σ1 2 =1. The for all y>0, P S yv + 5 2e y2 / ad where η 0 =1/32a 2 0 ad a 0 satisfied P V 2 /2 e η EgX 1 2 I gx 1 a 0 }1/ Proof. Recall EgX 1 =0adEgX 1 2 = is a special case of 3.5. We ext prove Let Y k = gx k I gxk a 0. Sicee x 1 x + x 2 /2forx>0, we have with t =1/4a 2 0 P V 2 /2 P k=1 Y 2 k /2 e t/2 Ee t k=1 Y 2 k =e t/2 Ee ty 2 1 e t/2 1 tey1 2 + t 2 EY1 4 /2 e t/2 1 3/4t + t 2 a 2 0/2 exp t/4 t 2 a 2 0 /2 =exp 32a 2 0, as desired. Lemma 3.4. Assume σ1 2 =1.The,forally 0, P [ Λ 2 a 0 y 2 7 V ] 2 e y2 / where a 0 =2c 0 +4,ad P where a 2 1 = 46c i<j ψx i,x j a 1 y 2 V /2 2 +2e y2 /8, 3.16
10 CRAMÉR TYPE MODERATE DEVIATIONS FOR STUDENTIZED U-STATISTICS 177 Proof. First prove Note that, give X i, W i follows from 3.5 that P W i is a sum of i.i.d. radom variables with zero meas. It y [ V i2 +5 1τ 2 X i ] } 1/2 2e y2 / where V i2 = j=1 ψ 2 X i,x j adτ 2 x =Eψ 2 X 1,X j X j = x. Note that ψ 2 x 1,x 2 2c 0 +4[1+ j i g 2 x 1 +g 2 x 2 ]. We have V i2 +5 1τ 2 X i 2c 0 +4 This, together with 3.17 ad the fact that yields that [ 11 +6g 2 X i + [ 11 +6g 2 X i + ] g 2 X i. ] g 2 X i = 7 V 2 +11, [ ] P Λ 2 a 0 y 2 7 V P W i 2 e y2 /8, y [ V i2 +5 1τ 2 X i ] } 1/2 as required. We ext prove Let F j = σx i,i j adrewrite 1i<j ψx i,x j = Y j, where Y j = j 1 ψx i,x j. The Y j, F j,j 2} is a martigale differece sequece. By 3.1, we have P Y j y [ Y 2 j +3EYj 2 +2EY j 2 F j 1 ] 1/2 2e y 2 / Note that EYj 2 prove j 1Eh 2 X 1,X 2 3j 1 by 1.6 adeg 2 X 1 =1. Theresult3.16 follows if we ] P [T1 2 a 2 y 2 V e y2 /8, 3.19 where T1 2 = Y j 2 ad a 2 = 14c 0 +4,ad where T 2 2 = EY 2 j F j 1 ada 3 = 16c ] P [T2 2 a 3 y 2 V e y2 /4, 3.20
11 178 T.L. LAI, Q.-M. SHAO AND Q. WANG We oly prove The proof of 3.19 is similar to We omit the details. Without loss of geerality, assume y 1. Otherwise 3.20 isobvious. WriteV j = V ψ,j +4j 1 1/2 τx j, where Vψ,j 2 = j 1 ψ2 X i,x j. Observe that P T2 2 2y 2[ 4 y 2[ 4 y 2[ 4 τ 2 X j Eτ 2 X 1 ]} P E [ Yj 2 I Y j yv j F ] j 1 τ 2 X j Eτ 2 X 1 ]} + P E [ Yj 2 I Y j >yv j F ] j 1 τ 2 X j Eτ 2 X 1 ]} := J 1 + J Note that J 1 P y 2 E [ V j 2 ] F j 1 y 2 4 τ 2 X j Eτ 2 X 1 j 1 = P 2τ 2 X i +32 j 1Eτ 2 X 1 4 τ 2 X j Eτ 2 X 1 = ad that recall y 1 J 2 = 1 64y 2 2 Eτ 2 X y 2 2 Eτ 2 X y 2 2 Eτ 2 X 1 E [ Y 2 j I Y j >yv j ] E E [ Yj 2 I Y j >yv j ] } X j E [ jτ 2 X 1 ] e y2 /4 by 3.6 e y2 / The result 3.20 ow follows from ad the fact that 4 τ 2 X j Eτ 2 X 1 8c V 2, as τ 2 x 2c 0 +4[2+gx]. This also completes the proof of Lemma 3.4. We are ow ready to prove Propositio 2.1. Without loss of geerality, assume σ1 2 =1. Otherwise,cosider h/σ 1 i the place of h. Weolyprove2.8. The proof of 2.9 is give i a similar maer except we use 3.16 i the place of 3.15.
12 CRAMÉR TYPE MODERATE DEVIATIONS FOR STUDENTIZED U-STATISTICS 179 By 3.12 ad3.13, for ay x>0 P S 5xV P V 2 /2 + P [ S xv + 5 ] 2e x2 /8 +e η0. By 3.15 ad3.13, for ay x>0, P Λ 7a 0 +22x V [ ] P V 2 /2 + P Λ 2 a 0 x 2 7 V These facts imply that, for ay y>0, 2 e x2 /8 +e η0. P δ y 2 P S y 2 V /3 + 2P Λ y 2 V /4 + P Λ y 2 V / e δ 0 y +2 2e δ 0 y2 +5e η exp δ 0 mi1,y,y 2 }, where δ 0, δ 0 ad δ 0 are costats depedig oly o σ 2 1 ad c 0. This proves 2.8 ad hece completes the proofofpropositio2.1. Ackowledgemets. The authors thak the referee for his/her valuable commets. Refereces [1] I.B. Alberik ad V. Betkus, Berry-Essee bouds for vo-mises ad U-statistics. Lith. Math. J [2] I.B. Alberik ad V. Betkus, Lyapuov type bouds for U-statistics. Theory Probab. Appl [3] J.N. Arvese, Jackkifig U-statistics. A. Math. Statist [4] Y.V. Borovskikh ad N.C. Weber, Large deviatios of U-statistics I. Lietuvos Matematikos Rikiys [5] Y.V. Borovskikh ad N.C. Weber, Large deviatios of U-statistics I. Lietuvos Matematikos Rikiys [6] H. Callaert ad N. Veraverbeke, The order of the ormal approximatio for a studetized U-statistics. A. Statist [7] W. Hoeffdig, A class of statistics with asymptotically ormal distributio. A. Math. Statist [8] B.-Y. Jig, Q.M. Shao ad Q. Wag, Self-ormalized Cramér-type large deviatio for idepedet radom variables. A. Probab [9] B.-Y. Jig, Q.M. Shao, W. Zhou, Saddlepoit approximatio for Studet s t-statistic with o momet coditios. A. Statist [10] V.S. Koroljuk ad V. Yu. Borovskich, Theory of U-statistics. Kluwer Academic Publishers, Dordrecht [11] Q.M. Shao, Self-ormalized large deviatios. A. Probab [12] Q.M. Shao, Cramér-type large deviatio for Studet s t statistic. J. Theorect. Probab [13] V.H. De La Pea, M.J. Klass ad T.L. Lai, Self-ormalized processes: expoetial iequalities, momet boud ad iterated logarithm laws. A. Probab [14] M. Vardemaele ad N. Veraverbeke, Cramer type large deviatios for studetized U-statistics. Metrika [15] Q. Wag, Berstei type iequalities for degeerate U-statistics with applicatios. A. Math. Ser. B [16] Q. Wag, B.-Y. Jig ad L. Zhao, The Berry-Essée boud for studetized statistics. A. Probab [17] Q. Wag ad N.C. Weber, Exact covergece rate ad leadig term i the cetral limit theorem for U-statistics. Statist. Siica [18] L. Zhao, The rate of the ormal approximatio for a studetized U-statistic. Sciece Exploratio
Self-normalized deviation inequalities with application to t-statistic
Self-ormalized deviatio iequalities with applicatio to t-statistic Xiequa Fa Ceter for Applied Mathematics, Tiaji Uiversity, 30007 Tiaji, Chia Abstract Let ξ i i 1 be a sequece of idepedet ad symmetric
More informationBerry-Esseen bounds for self-normalized martingales
Berry-Essee bouds for self-ormalized martigales Xiequa Fa a, Qi-Ma Shao b a Ceter for Applied Mathematics, Tiaji Uiversity, Tiaji 30007, Chia b Departmet of Statistics, The Chiese Uiversity of Hog Kog,
More informationSelf-normalized Cramér type Moderate Deviations for the Maximum of Sums
Self-ormalized Cramér type Moderate Deviatios for the Maximum of Sums Weidog Liu 1, Qi-Ma Shao ad Qiyig Wag 3 Abstract Let X 1, X,... be idepedet radom variables with zero meas ad fiite variaces, ad let
More informationo f P r o b a b i l i t y Vol. 10 (2005), Paper no. 38, pages Journal URL ejpecp/
E l e c t r o i c J o u r a l o f P r o b a b i l i t y Vol. 10 005, Paper o. 38, pages 160-185. Joural URL http://www.math.washigto.edu/ ejpecp/ Limit Theorems for Self-ormalized Large Deviatio 1 Qiyig
More informationA UNIFIED APPROACH TO EDGEWORTH EXPANSIONS FOR A GENERAL CLASS OF STATISTICS
Statistica Siica 20 2010, 613-636 A UNIFIED APPROACH TO EDGEWORTH EXPANSIONS FOR A GENERAL CLASS OF STATISTICS Big-Yi Jig ad Qiyig Wag Hog Kog Uiversity of Sciece ad Techology ad Uiversity of Sydey Abstract:
More informationAsymptotic distribution of products of sums of independent random variables
Proc. Idia Acad. Sci. Math. Sci. Vol. 3, No., May 03, pp. 83 9. c Idia Academy of Scieces Asymptotic distributio of products of sums of idepedet radom variables YANLING WANG, SUXIA YAO ad HONGXIA DU ollege
More informationMi-Hwa Ko and Tae-Sung Kim
J. Korea Math. Soc. 42 2005), No. 5, pp. 949 957 ALMOST SURE CONVERGENCE FOR WEIGHTED SUMS OF NEGATIVELY ORTHANT DEPENDENT RANDOM VARIABLES Mi-Hwa Ko ad Tae-Sug Kim Abstract. For weighted sum of a sequece
More informationPrecise Rates in Complete Moment Convergence for Negatively Associated Sequences
Commuicatios of the Korea Statistical Society 29, Vol. 16, No. 5, 841 849 Precise Rates i Complete Momet Covergece for Negatively Associated Sequeces Dae-Hee Ryu 1,a a Departmet of Computer Sciece, ChugWoo
More informationST5215: Advanced Statistical Theory
ST525: Advaced Statistical Theory Departmet of Statistics & Applied Probability Tuesday, September 7, 2 ST525: Advaced Statistical Theory Lecture : The law of large umbers The Law of Large Numbers The
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationCentral limit theorem and almost sure central limit theorem for the product of some partial sums
Proc. Idia Acad. Sci. Math. Sci. Vol. 8, No. 2, May 2008, pp. 289 294. Prited i Idia Cetral it theorem ad almost sure cetral it theorem for the product of some partial sums YU MIAO College of Mathematics
More informationMAXIMAL INEQUALITIES AND STRONG LAW OF LARGE NUMBERS FOR AANA SEQUENCES
Commu Korea Math Soc 26 20, No, pp 5 6 DOI 0434/CKMS20265 MAXIMAL INEQUALITIES AND STRONG LAW OF LARGE NUMBERS FOR AANA SEQUENCES Wag Xueju, Hu Shuhe, Li Xiaoqi, ad Yag Wezhi Abstract Let {X, } be a sequece
More informationConvergence of random variables. (telegram style notes) P.J.C. Spreij
Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space
More informationRegression with an Evaporating Logarithmic Trend
Regressio with a Evaporatig Logarithmic Tred Peter C. B. Phillips Cowles Foudatio, Yale Uiversity, Uiversity of Aucklad & Uiversity of York ad Yixiao Su Departmet of Ecoomics Yale Uiversity October 5,
More informationLecture 19: Convergence
Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More information2.2. Central limit theorem.
36.. Cetral limit theorem. The most ideal case of the CLT is that the radom variables are iid with fiite variace. Although it is a special case of the more geeral Lideberg-Feller CLT, it is most stadard
More information1 = δ2 (0, ), Y Y n nδ. , T n = Y Y n n. ( U n,k + X ) ( f U n,k + Y ) n 2n f U n,k + θ Y ) 2 E X1 2 X1
8. The cetral limit theorems 8.1. The cetral limit theorem for i.i.d. sequeces. ecall that C ( is N -separatig. Theorem 8.1. Let X 1, X,... be i.i.d. radom variables with EX 1 = ad EX 1 = σ (,. Suppose
More informationApproximation theorems for localized szász Mirakjan operators
Joural of Approximatio Theory 152 (2008) 125 134 www.elsevier.com/locate/jat Approximatio theorems for localized szász Miraja operators Lise Xie a,,1, Tigfa Xie b a Departmet of Mathematics, Lishui Uiversity,
More informationLimit distributions for products of sums
Statistics & Probability Letters 62 (23) 93 Limit distributios for products of sums Yogcheg Qi Departmet of Mathematics ad Statistics, Uiversity of Miesota-Duluth, Campus Ceter 4, 7 Uiversity Drive, Duluth,
More informationLecture 8: Convergence of transformations and law of large numbers
Lecture 8: Covergece of trasformatios ad law of large umbers Trasformatio ad covergece Trasformatio is a importat tool i statistics. If X coverges to X i some sese, we ofte eed to check whether g(x ) coverges
More informationNotes 19 : Martingale CLT
Notes 9 : Martigale CLT Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: [Bil95, Chapter 35], [Roc, Chapter 3]. Sice we have ot ecoutered weak covergece i some time, we first recall
More informationIntroduction to Extreme Value Theory Laurens de Haan, ISM Japan, Erasmus University Rotterdam, NL University of Lisbon, PT
Itroductio to Extreme Value Theory Laures de Haa, ISM Japa, 202 Itroductio to Extreme Value Theory Laures de Haa Erasmus Uiversity Rotterdam, NL Uiversity of Lisbo, PT Itroductio to Extreme Value Theory
More informationThis section is optional.
4 Momet Geeratig Fuctios* This sectio is optioal. The momet geeratig fuctio g : R R of a radom variable X is defied as g(t) = E[e tx ]. Propositio 1. We have g () (0) = E[X ] for = 1, 2,... Proof. Therefore
More information<, if ε > 0 2nloglogn. =, if ε < 0.
GLASNIK MATEMATIČKI Vol. 52(72)(207), 35 360 THE DAVIS-GUT LAW FOR INDEPENDENT AND IDENTICALLY DISTRIBUTED BANACH SPACE VALUED RANDOM ELEMENTS Pigya Che, Migyag Zhag ad Adrew Rosalsky Jia Uversity, P.
More informationA Note on the Kolmogorov-Feller Weak Law of Large Numbers
Joural of Mathematical Research with Applicatios Mar., 015, Vol. 35, No., pp. 3 8 DOI:10.3770/j.iss:095-651.015.0.013 Http://jmre.dlut.edu.c A Note o the Kolmogorov-Feller Weak Law of Large Numbers Yachu
More information1 Convergence in Probability and the Weak Law of Large Numbers
36-752 Advaced Probability Overview Sprig 2018 8. Covergece Cocepts: i Probability, i L p ad Almost Surely Istructor: Alessadro Rialdo Associated readig: Sec 2.4, 2.5, ad 4.11 of Ash ad Doléas-Dade; Sec
More informationLecture 2: Concentration Bounds
CSE 52: Desig ad Aalysis of Algorithms I Sprig 206 Lecture 2: Cocetratio Bouds Lecturer: Shaya Oveis Ghara March 30th Scribe: Syuzaa Sargsya Disclaimer: These otes have ot bee subjected to the usual scrutiy
More informationNotes 5 : More on the a.s. convergence of sums
Notes 5 : More o the a.s. covergece of sums Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: Dur0, Sectios.5; Wil9, Sectio 4.7, Shi96, Sectio IV.4, Dur0, Sectio.. Radom series. Three-series
More informationWeak Laws of Large Numbers for Sequences or Arrays of Correlated Random Variables
Iteratioal Mathematical Forum, Vol., 5, o. 4, 65-73 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/.988/imf.5.5 Weak Laws of Large Numers for Sequeces or Arrays of Correlated Radom Variales Yutig Lu School
More informationComplete Convergence for Asymptotically Almost Negatively Associated Random Variables
Applied Mathematical Scieces, Vol. 12, 2018, o. 30, 1441-1452 HIKARI Ltd, www.m-hikari.com https://doi.org/10.12988/ams.2018.810142 Complete Covergece for Asymptotically Almost Negatively Associated Radom
More informationAn almost sure invariance principle for trimmed sums of random vectors
Proc. Idia Acad. Sci. Math. Sci. Vol. 20, No. 5, November 200, pp. 6 68. Idia Academy of Scieces A almost sure ivariace priciple for trimmed sums of radom vectors KE-ANG FU School of Statistics ad Mathematics,
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS
MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak
More informationGlivenko-Cantelli Classes
CS28B/Stat24B (Sprig 2008 Statistical Learig Theory Lecture: 4 Gliveko-Catelli Classes Lecturer: Peter Bartlett Scribe: Michelle Besi Itroductio This lecture will cover Gliveko-Catelli (GC classes ad itroduce
More informationSolutions to HW Assignment 1
Solutios to HW: 1 Course: Theory of Probability II Page: 1 of 6 Uiversity of Texas at Austi Solutios to HW Assigmet 1 Problem 1.1. Let Ω, F, {F } 0, P) be a filtered probability space ad T a stoppig time.
More informationEcon 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1.
Eco 325/327 Notes o Sample Mea, Sample Proportio, Cetral Limit Theorem, Chi-square Distributio, Studet s t distributio 1 Sample Mea By Hiro Kasahara We cosider a radom sample from a populatio. Defiitio
More informationAdvanced Stochastic Processes.
Advaced Stochastic Processes. David Gamarik LECTURE 2 Radom variables ad measurable fuctios. Strog Law of Large Numbers (SLLN). Scary stuff cotiued... Outlie of Lecture Radom variables ad measurable fuctios.
More informationRademacher Complexity
EECS 598: Statistical Learig Theory, Witer 204 Topic 0 Rademacher Complexity Lecturer: Clayto Scott Scribe: Ya Deg, Kevi Moo Disclaimer: These otes have ot bee subjected to the usual scrutiy reserved for
More informationAsymptotic Results for the Linear Regression Model
Asymptotic Results for the Liear Regressio Model C. Fli November 29, 2000 1. Asymptotic Results uder Classical Assumptios The followig results apply to the liear regressio model y = Xβ + ε, where X is
More informationEE 4TM4: Digital Communications II Probability Theory
1 EE 4TM4: Digital Commuicatios II Probability Theory I. RANDOM VARIABLES A radom variable is a real-valued fuctio defied o the sample space. Example: Suppose that our experimet cosists of tossig two fair
More informationEFFECTIVE WLLN, SLLN, AND CLT IN STATISTICAL MODELS
EFFECTIVE WLLN, SLLN, AND CLT IN STATISTICAL MODELS Ryszard Zieliński Ist Math Polish Acad Sc POBox 21, 00-956 Warszawa 10, Polad e-mail: rziel@impagovpl ABSTRACT Weak laws of large umbers (W LLN), strog
More informationCOMPLETE CONVERGENCE AND COMPLETE MOMENT CONVERGENCE FOR ARRAYS OF ROWWISE END RANDOM VARIABLES
GLASNIK MATEMATIČKI Vol. 4969)2014), 449 468 COMPLETE CONVERGENCE AND COMPLETE MOMENT CONVERGENCE FOR ARRAYS OF ROWWISE END RANDOM VARIABLES Yogfeg Wu, Mauel Ordóñez Cabrera ad Adrei Volodi Toglig Uiversity
More informationResearch Article Moment Inequality for ϕ-mixing Sequences and Its Applications
Hidawi Publishig Corporatio Joural of Iequalities ad Applicatios Volume 2009, Article ID 379743, 2 pages doi:0.55/2009/379743 Research Article Momet Iequality for ϕ-mixig Sequeces ad Its Applicatios Wag
More informationLecture 20: Multivariate convergence and the Central Limit Theorem
Lecture 20: Multivariate covergece ad the Cetral Limit Theorem Covergece i distributio for radom vectors Let Z,Z 1,Z 2,... be radom vectors o R k. If the cdf of Z is cotiuous, the we ca defie covergece
More informationMarcinkiwiecz-Zygmund Type Inequalities for all Arcs of the Circle
Marcikiwiecz-ygmud Type Iequalities for all Arcs of the Circle C.K. Kobidarajah ad D. S. Lubisky Mathematics Departmet, Easter Uiversity, Chekalady, Sri Laka; Mathematics Departmet, Georgia Istitute of
More informationEdgeworth Expansion for Studentized Statistics
Edgeworth Expasio for Studetized Statistics Big-Yi JING Hog Kog Uiversity of Sciece ad Techology Qiyig WANG Australia Natioal Uiversity ABSTRACT Edgeworth expasios are developed for a geeral class of studetized
More informationDistribution of Random Samples & Limit theorems
STAT/MATH 395 A - PROBABILITY II UW Witer Quarter 2017 Néhémy Lim Distributio of Radom Samples & Limit theorems 1 Distributio of i.i.d. Samples Motivatig example. Assume that the goal of a study is to
More informationRates of Convergence by Moduli of Continuity
Rates of Covergece by Moduli of Cotiuity Joh Duchi: Notes for Statistics 300b March, 017 1 Itroductio I this ote, we give a presetatio showig the importace, ad relatioship betwee, the modulis of cotiuity
More informationSequences and Series of Functions
Chapter 6 Sequeces ad Series of Fuctios 6.1. Covergece of a Sequece of Fuctios Poitwise Covergece. Defiitio 6.1. Let, for each N, fuctio f : A R be defied. If, for each x A, the sequece (f (x)) coverges
More informationON POINTWISE BINOMIAL APPROXIMATION
Iteratioal Joural of Pure ad Applied Mathematics Volume 71 No. 1 2011, 57-66 ON POINTWISE BINOMIAL APPROXIMATION BY w-functions K. Teerapabolar 1, P. Wogkasem 2 Departmet of Mathematics Faculty of Sciece
More informationJ. Stat. Appl. Pro. Lett. 2, No. 1, (2015) 15
J. Stat. Appl. Pro. Lett. 2, No. 1, 15-22 2015 15 Joural of Statistics Applicatios & Probability Letters A Iteratioal Joural http://dx.doi.org/10.12785/jsapl/020102 Martigale Method for Rui Probabilityi
More informationEntropy Rates and Asymptotic Equipartition
Chapter 29 Etropy Rates ad Asymptotic Equipartitio Sectio 29. itroduces the etropy rate the asymptotic etropy per time-step of a stochastic process ad shows that it is well-defied; ad similarly for iformatio,
More informationThe log-behavior of n p(n) and n p(n)/n
Ramauja J. 44 017, 81-99 The log-behavior of p ad p/ William Y.C. Che 1 ad Ke Y. Zheg 1 Ceter for Applied Mathematics Tiaji Uiversity Tiaji 0007, P. R. Chia Ceter for Combiatorics, LPMC Nakai Uivercity
More informationHyun-Chull Kim and Tae-Sung Kim
Commu. Korea Math. Soc. 20 2005), No. 3, pp. 531 538 A CENTRAL LIMIT THEOREM FOR GENERAL WEIGHTED SUM OF LNQD RANDOM VARIABLES AND ITS APPLICATION Hyu-Chull Kim ad Tae-Sug Kim Abstract. I this paper we
More informationBasics of Probability Theory (for Theory of Computation courses)
Basics of Probability Theory (for Theory of Computatio courses) Oded Goldreich Departmet of Computer Sciece Weizma Istitute of Sciece Rehovot, Israel. oded.goldreich@weizma.ac.il November 24, 2008 Preface.
More informationAda Boost, Risk Bounds, Concentration Inequalities. 1 AdaBoost and Estimates of Conditional Probabilities
CS8B/Stat4B Sprig 008) Statistical Learig Theory Lecture: Ada Boost, Risk Bouds, Cocetratio Iequalities Lecturer: Peter Bartlett Scribe: Subhrasu Maji AdaBoost ad Estimates of Coditioal Probabilities We
More informationLecture 3: August 31
36-705: Itermediate Statistics Fall 018 Lecturer: Siva Balakrisha Lecture 3: August 31 This lecture will be mostly a summary of other useful expoetial tail bouds We will ot prove ay of these i lecture,
More informationProbability 2 - Notes 10. Lemma. If X is a random variable and g(x) 0 for all x in the support of f X, then P(g(X) 1) E[g(X)].
Probability 2 - Notes 0 Some Useful Iequalities. Lemma. If X is a radom variable ad g(x 0 for all x i the support of f X, the P(g(X E[g(X]. Proof. (cotiuous case P(g(X Corollaries x:g(x f X (xdx x:g(x
More information5.1 A mutual information bound based on metric entropy
Chapter 5 Global Fao Method I this chapter, we exted the techiques of Chapter 2.4 o Fao s method the local Fao method) to a more global costructio. I particular, we show that, rather tha costructig a local
More informationSTA Object Data Analysis - A List of Projects. January 18, 2018
STA 6557 Jauary 8, 208 Object Data Aalysis - A List of Projects. Schoeberg Mea glaucomatous shape chages of the Optic Nerve Head regio i aimal models 2. Aalysis of VW- Kedall ati-mea shapes with a applicatio
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 Fuctioal Law of Large Numbers. Costructio of the Wieer Measure Cotet. 1. Additioal techical results o weak covergece
More informationECE 330:541, Stochastic Signals and Systems Lecture Notes on Limit Theorems from Probability Fall 2002
ECE 330:541, Stochastic Sigals ad Systems Lecture Notes o Limit Theorems from robability Fall 00 I practice, there are two ways we ca costruct a ew sequece of radom variables from a old sequece of radom
More informationA central limit theorem for moving average process with negatively associated innovation
Iteratioal Mathematical Forum, 1, 2006, o. 10, 495-502 A cetral limit theorem for movig average process with egatively associated iovatio MI-HWA KO Statistical Research Ceter for Complex Systems Seoul
More informationLaw of the sum of Bernoulli random variables
Law of the sum of Beroulli radom variables Nicolas Chevallier Uiversité de Haute Alsace, 4, rue des frères Lumière 68093 Mulhouse icolas.chevallier@uha.fr December 006 Abstract Let be the set of all possible
More informationChapter 5. Inequalities. 5.1 The Markov and Chebyshev inequalities
Chapter 5 Iequalities 5.1 The Markov ad Chebyshev iequalities As you have probably see o today s frot page: every perso i the upper teth percetile ears at least 1 times more tha the average salary. I other
More informationfor all x ; ;x R. A ifiite sequece fx ; g is said to be ND if every fiite subset X ; ;X is ND. The coditios (.) ad (.3) are equivalet for =, but these
sub-gaussia techiques i provig some strog it theorems Λ M. Amii A. Bozorgia Departmet of Mathematics, Faculty of Scieces Sista ad Baluchesta Uiversity, Zaheda, Ira Amii@hamoo.usb.ac.ir, Fax:054446565 Departmet
More informationECE 901 Lecture 12: Complexity Regularization and the Squared Loss
ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality
More informationGamma Distribution and Gamma Approximation
Gamma Distributio ad Gamma Approimatio Xiaomig Zeg a Fuhua (Frak Cheg b a Xiame Uiversity, Xiame 365, Chia mzeg@jigia.mu.edu.c b Uiversity of Ketucky, Leigto, Ketucky 456-46, USA cheg@cs.uky.edu Abstract
More informationResearch Article On the Strong Laws for Weighted Sums of ρ -Mixing Random Variables
Hidawi Publishig Corporatio Joural of Iequalities ad Applicatios Volume 2011, Article ID 157816, 8 pages doi:10.1155/2011/157816 Research Article O the Strog Laws for Weighted Sums of ρ -Mixig Radom Variables
More informationSDS 321: Introduction to Probability and Statistics
SDS 321: Itroductio to Probability ad Statistics Lecture 23: Cotiuous radom variables- Iequalities, CLT Puramrita Sarkar Departmet of Statistics ad Data Sciece The Uiversity of Texas at Austi www.cs.cmu.edu/
More informationA survey on penalized empirical risk minimization Sara A. van de Geer
A survey o pealized empirical risk miimizatio Sara A. va de Geer We address the questio how to choose the pealty i empirical risk miimizatio. Roughly speakig, this pealty should be a good boud for the
More information62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +
62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of
More informationEntropy and Ergodic Theory Lecture 5: Joint typicality and conditional AEP
Etropy ad Ergodic Theory Lecture 5: Joit typicality ad coditioal AEP 1 Notatio: from RVs back to distributios Let (Ω, F, P) be a probability space, ad let X ad Y be A- ad B-valued discrete RVs, respectively.
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013. Large Deviations for i.i.d. Random Variables
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013 Large Deviatios for i.i.d. Radom Variables Cotet. Cheroff boud usig expoetial momet geeratig fuctios. Properties of a momet
More informationSolution to Chapter 2 Analytical Exercises
Nov. 25, 23, Revised Dec. 27, 23 Hayashi Ecoometrics Solutio to Chapter 2 Aalytical Exercises. For ay ε >, So, plim z =. O the other had, which meas that lim E(z =. 2. As show i the hit, Prob( z > ε =
More information18.657: Mathematics of Machine Learning
8.657: Mathematics of Machie Learig Lecturer: Philippe Rigollet Lecture 4 Scribe: Cheg Mao Sep., 05 I this lecture, we cotiue to discuss the effect of oise o the rate of the excess risk E(h) = R(h) R(h
More informationA PROOF OF THE WEIERSTRASS APPROXIMATION THEOREM FOR R k USING BINOMIAL DISTRIBUTIONS
A PROOF OF THE WEIERSTRASS APPROXIMATION THEOREM FOR R k USING BINOMIAL DISTRIBUTIONS BEN KORDESH Abstract. We relate the probabilistic proof of the Weierstrass Approximatio Theorem [Lev84] to the covolutio
More information2.1. Convergence in distribution and characteristic functions.
3 Chapter 2. Cetral Limit Theorem. Cetral limit theorem, or DeMoivre-Laplace Theorem, which also implies the wea law of large umbers, is the most importat theorem i probability theory ad statistics. For
More informationREGRESSION WITH QUADRATIC LOSS
REGRESSION WITH QUADRATIC LOSS MAXIM RAGINSKY Regressio with quadratic loss is aother basic problem studied i statistical learig theory. We have a radom couple Z = X, Y ), where, as before, X is a R d
More informationMathematics 170B Selected HW Solutions.
Mathematics 17B Selected HW Solutios. F 4. Suppose X is B(,p). (a)fidthemometgeeratigfuctiom (s)of(x p)/ p(1 p). Write q = 1 p. The MGF of X is (pe s + q), sice X ca be writte as the sum of idepedet Beroulli
More informationarxiv: v1 [math.pr] 13 Oct 2011
A tail iequality for quadratic forms of subgaussia radom vectors Daiel Hsu, Sham M. Kakade,, ad Tog Zhag 3 arxiv:0.84v math.pr] 3 Oct 0 Microsoft Research New Eglad Departmet of Statistics, Wharto School,
More informationNEW FAST CONVERGENT SEQUENCES OF EULER-MASCHERONI TYPE
UPB Sci Bull, Series A, Vol 79, Iss, 207 ISSN 22-7027 NEW FAST CONVERGENT SEQUENCES OF EULER-MASCHERONI TYPE Gabriel Bercu We itroduce two ew sequeces of Euler-Mascheroi type which have fast covergece
More informationChapter 3. Strong convergence. 3.1 Definition of almost sure convergence
Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i
More informationAn Introduction to Randomized Algorithms
A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis
More information1 Introduction to reducing variance in Monte Carlo simulations
Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by
More informationOutput Analysis and Run-Length Control
IEOR E4703: Mote Carlo Simulatio Columbia Uiversity c 2017 by Marti Haugh Output Aalysis ad Ru-Legth Cotrol I these otes we describe how the Cetral Limit Theorem ca be used to costruct approximate (1 α%
More information4. Partial Sums and the Central Limit Theorem
1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems
More informationTHE LONELY RUNNER PROBLEM FOR MANY RUNNERS. Artūras Dubickas Vilnius University, Lithuania
GLASNIK MATEMATIČKI Vol. 46(66)(2011), 25 30 THE LONELY RUNNER PROBLEM FOR MANY RUNNERS Artūras Dubickas Vilius Uiversity, Lithuaia Abstract. The loely ruer cojecture asserts that for ay positive iteger
More informationResearch Article A Note on Ergodicity of Systems with the Asymptotic Average Shadowing Property
Discrete Dyamics i Nature ad Society Volume 2011, Article ID 360583, 6 pages doi:10.1155/2011/360583 Research Article A Note o Ergodicity of Systems with the Asymptotic Average Shadowig Property Risog
More informationIntroduction to Probability. Ariel Yadin
Itroductio to robability Ariel Yadi Lecture 2 *** Ja. 7 ***. Covergece of Radom Variables As i the case of sequeces of umbers, we would like to talk about covergece of radom variables. There are may ways
More informationApproximation by Superpositions of a Sigmoidal Function
Zeitschrift für Aalysis ud ihre Aweduge Joural for Aalysis ad its Applicatios Volume 22 (2003, No. 2, 463 470 Approximatio by Superpositios of a Sigmoidal Fuctio G. Lewicki ad G. Mario Abstract. We geeralize
More informationLecture 23: Minimal sufficiency
Lecture 23: Miimal sufficiecy Maximal reductio without loss of iformatio There are may sufficiet statistics for a give problem. I fact, X (the whole data set) is sufficiet. If T is a sufficiet statistic
More informationLECTURE 8: ASYMPTOTICS I
LECTURE 8: ASYMPTOTICS I We are iterested i the properties of estimators as. Cosider a sequece of radom variables {, X 1}. N. M. Kiefer, Corell Uiversity, Ecoomics 60 1 Defiitio: (Weak covergece) A sequece
More informationLearning Theory: Lecture Notes
Learig Theory: Lecture Notes Kamalika Chaudhuri October 4, 0 Cocetratio of Averages Cocetratio of measure is very useful i showig bouds o the errors of machie-learig algorithms. We will begi with a basic
More informationGeneralized Law of the Iterated Logarithm and Its Convergence Rate
Stochastic Aalysis ad Applicatios, 25: 89 03, 2007 Copyright Taylor & Fracis Group, LLC ISSN 0736-2994 prit/532-9356 olie DOI: 0.080/073629906005997 Geeralized Law of the Iterated Logarithm ad Its Covergece
More informationAppendix to Quicksort Asymptotics
Appedix to Quicksort Asymptotics James Alle Fill Departmet of Mathematical Scieces The Johs Hopkis Uiversity jimfill@jhu.edu ad http://www.mts.jhu.edu/~fill/ ad Svate Jaso Departmet of Mathematics Uppsala
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 3 9/11/2013. Large deviations Theory. Cramér s Theorem
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/5.070J Fall 203 Lecture 3 9//203 Large deviatios Theory. Cramér s Theorem Cotet.. Cramér s Theorem. 2. Rate fuctio ad properties. 3. Chage of measure techique.
More informationUnbiased Estimation. February 7-12, 2008
Ubiased Estimatio February 7-2, 2008 We begi with a sample X = (X,..., X ) of radom variables chose accordig to oe of a family of probabilities P θ where θ is elemet from the parameter space Θ. For radom
More informationExercise 4.3 Use the Continuity Theorem to prove the Cramér-Wold Theorem, Theorem. (1) φ a X(1).
Assigmet 7 Exercise 4.3 Use the Cotiuity Theorem to prove the Cramér-Wold Theorem, Theorem 4.12. Hit: a X d a X implies that φ a X (1) φ a X(1). Sketch of solutio: As we poited out i class, the oly tricky
More informationEquivalent Conditions of Complete Convergence and Complete Moment Convergence for END Random Variables
Chi. A. Math. Ser. B 391, 2018, 83 96 DOI: 10.1007/s11401-018-1053-9 Chiese Aals of Mathematics, Series B c The Editorial Office of CAM ad Spriger-Verlag Berli Heidelberg 2018 Equivalet Coditios of Complete
More information