h(x i,x j ). (1.1) 1 i<j n

Size: px
Start display at page:

Download "h(x i,x j ). (1.1) 1 i<j n"

Transcription

1 ESAIM: PS DOI: /ps/ ESAIM: Probability ad Statistics CRAMÉR TYPE MODERATE DEVIATIONS FOR STUDENTIZED U-STATISTICS,, Tze Leg Lai 1, Qi-Ma Shao 2 ad Qiyig Wag 3 Abstract. Let T be a Studetized U-statistic. It is proved that a Cramér type moderate deviatio P T x/1 Φx 1 holds uiformly i x [0,o 1/6 whe the kerel satisfies some regular coditios. Mathematics Subject Classificatio. 60F10, 60F05. Received September 20, Revised Jue 2, Itroductio ad mai results Let X, X 1,X 2,...,X be a sequece of idepedet ad idetically distributed i.i.d. radom variables, ad let hx 1,x 2 be a real-valued symmetric Borel measurable fuctio. Assume that θ = EhX 1,X 2. A ubiased estimator of θ is the Hoeffdig [7] U-statistic U = 2 1 1i<j hx i,x j. 1.1 The U-statistic elegatly ad usefully geeralizes the otio of a sample mea. Typical examples iclude i sample mea: hx 1,x 2 = 1 2 x 1 + x 2 ; ii sample variace: hx 1,x 2 = 1 2 x 1 x 2 2 ; iii Gii s mea differece: hx 1,x 2 = x 1 x 2 ; iv oe-sample Wilcoxo s statistic: hx 1,x 2 =1x 1 + x 2 0. The o-degeerate U-statistic shares may limitig properties with the sample mea. For example, if Eh 2 X 1, X 2 < ad σ 2 1 =VargX 1 > 0, where Keywords ad phrases. Moderate deviatio, u-statistic, studetized. gx =Ehx, X, 1.2 Research partially supported by NSF-MCS Research partially supported by Hog Kog RGC CERG ad Research partially supported by a Australia Research Coucil ARC discovery project. 1 Departmet of Statistics, Staford Uiversity Staford, CA CA , USA; lait@staford.edu 2 Departmet of Mathematics, Hog Kog Uiversity of Sciece ad Techology, Clear Water Bay, Kowloo Hog Kog, P.R. Chia; maqmshao@ust.hk 3 School of Mathematics ad Statistics, Uiversity of Sydey, NSW 2006, Australia; qiyig@maths.usyd.edu.au Article published by EDP Scieces c EDP Scieces, SMAI 2011

2 CRAMÉR TYPE MODERATE DEVIATIONS FOR STUDENTIZED U-STATISTICS 169 the the cetral limit theorem holds, i.e., sup P U θ x Φx 0, 1.3 x 2σ 1 where Φx is the stadard ormal distributio fuctio. A systematic presetatio of the theory of U-statistics was give i [10]. We refer the study o uiform Berry-Essee boud for U-statistics to Alberik ad Betkus [1, 2], Wag ad Weber [17] ad the refereces there. Oe ca also refer to Borovskich ad Weber [4,5] forlarge deviatios. However, sice σ 1 is typically ukow, it is ecessary to estimate σ 1 first ad the substitute it i 1.3. Therefore, what used i practice is actually the followig studetized U-statistic see, e.g., Arvese [3] where R 2 = T = U θ/r, 1.4 qi U 2 with q i = 1 1 hx i,x j. 1.5 Oe ca refer to Wag, Jig ad Zhao [16] o uiform Berry-Essee boud for studetized U-statistics. Also see Callaert ad Veraverbeke [6] adzhao[18]. We also refer to Vademaele ad Veraverbeke [14] ad Wag [15] for the Cramér type moderate deviatio. A special case of the studetized U-statics is the Studet t-statistic with hx 1,x 2 =x 1 + x 2 /2. Although the t-statistic has a close relatioship with the classical stadardized partial sum, it has bee foud that the t-statistic ejoys much better limitig properties. For example, Shao [11] proves that the large deviatio always holds for t-statistic without ay momet assumptio ad Shao [12] further shows that a Cramér type moderate deviatio is valid uder oly a fiite third momet. Jig, et al. [8] provedacramér type moderate deviatio result for idepedet radom variables uder a Lideberg type coditio. Jig, et al. [9] obtaied the saddlepoit approximatio without ay momet coditio. Thus, it is atural to ask whether similar results hold for the studetized U-statistics. The mai objective of this paper is to show that the studetized U-statistics share similar properties like the studet t-statistic does whe the kerel satisfies h 2 x 1,x 2 θ c 0 [σ g 2 x 1 θ + g 2 x 2 θ] 1.6 for some c 0 > 0. This coditio is satisfied by the typical examples of U-statistics listed at the begiig of this sectio. Theorem 1.1. Assume 0 <σ1 2 < ad that 1.6 holds for some c 0 > 0. The, for ay x with x ad x = o 1/2, If i additio E gx 1 3 <, the j=1 j i l P T x x 2 / P T x =1 Φx [ 1+o1 ] 1.8 holds uiformly i x [0,o 1/6. Assume θ =0. WriteS = j=1 gx jadv 2 = j=1 g2 X j. It is kow see Shao [11] that l P S /V x x 2 /2 1.9 for ay x with x ad x = o 1/2. It is also kow see Jig et al. [8] that if E gx 1 3 <, the [ P S /V x =1 Φx 1+O11 + x 3 1/2] 1.10

3 170 T.L. LAI, Q.-M. SHAO AND Q. WANG for 0 x O 1/6. The followig theorem shows that the studetized U-statistic T ca be approximated by the self-ormalized sum S /V uder the coditio 1.6. As a result, 1.7 ad1.8 follow from 1.9 ad 1.10, together with 1.11 below, respectively. Theorem 1.2. Assume that θ =0, 0 <σ1 2 = Eg2 X 1 < ad the kerel hx 1,x 2 satisfies the coditio 1.6. The there exists a costat η>0 depedig oly o σ1 2 ad c 0 such that, for all 4/ 1 ɛ < 1, 0 x /3 ad sufficietly large, P [ S /V 1 + ɛ x ] e η miɛ2, ɛ x} P T x P [ S /V 1 ɛ x ] e η miɛ2, ɛ x} This paper is orgaized as follows. I the ext sectio we will prove the mai theorems. A techical propositio will be postpoed to Sectio 3. We start with some prelimiaries. Write where R 2 = q2 i. Observe that 2. Proofs of theorems T = U /R, 2.1 q i U 2 = qi 2 2U q i + U 2 = q 2 i U 2. We have T = 1/ T 2 2 ad T x} = T x } [1 + 4x 2 1/ 2 2 ] 1/2 2.3 We ow establish a relatioship betwee T ad S /V. Todothis,furtherletψx 1,x 2 =hx 1,x 2 gx 1 gx 2, Δ = 1 ψx i,x j, W i = ψx i,x j, Λ 2 = W i 2. 1 It is easy to see that Also observe that j=1 j i 1i<j T j=1 j i hx i,x j = 2gX i +S + W i U /2 = S +Δ. 2.4 ad R 2 = j=1 j i 2 hx i,x j = 2 2 V 2 +Λ2 +3 4S gx i W i +2S W i.

4 CRAMÉR TYPE MODERATE DEVIATIONS FOR STUDENTIZED U-STATISTICS 171 Therefore, usig gx iw i V Λ, S by the Hőlder s iequality, we have W i S Λ ad Λ 2 i max W 2 1i R 2 = 4 1 V δ, 2.5 where δ [ Λ 2 V 2 Λ 2 V 2 + 3S2 V 2 + 4Λ V + 2 Λ +2 S ] Λ V + 3 S2 V 2 V By ad2.1 T S +Δ =, 2.7 d V 1 + δ 1/2 where d = / 1. Next propositio shows that Δ ad δ are egligible. Propositio 2.1. There exist costats δ 0 > 0 ad δ 1 > 0, depedig oly o σ1 2 ad c 0, such that for all y>0 P δ y exp δ 0 mi1,y,y 2 } 2.8 ad P Δ yv 2 +2exp δ 1 mi, y }. 2.9 The proof of Propositio 2.1 is postpoed to Sectio 3. We metio that the proof is based o expoetial iequalities for self-ormalized sums of martigaledifferece sequece Lems. 3.1 ad 3.4 ad for self-ormalized sums of idepedet radom variables Lems. 3.2 ad 3.3. These iequalities are iterestig i their ow rights. We are ow ready to prove our mai results. Proof of Theorem 1.2. Sice x 2 /9 ad0 ɛ < 1, it is easy to show that, for 0 x /3, τ 1 ɛ 1/2τ 4 1 ɛ /2, [ wheever is sufficietly large, where τ = 1 Propositio 2.1 that 1+ 4x ] 1/2. Hece it follows from 2.3, 2.7 ad P T x P [ S /V 1 ɛ x ] + P Δ /V x ɛ 1 + xτ 1 + δ 1/2} } Δ /V xɛ 1 + xτ P [ S /V 1 ɛ x ] + P P [ S /V 1 ɛ x ] + P + P } Δ /V xɛ /2 + P δ ɛ /4 P [ S /V 1 ɛ x ] e η miɛ2, ɛ x}, } δ ɛ /4 }

5 172 T.L. LAI, Q.-M. SHAO AND Q. WANG where η>0 is a costat depedig oly o σ1 2 ad c 0. This proves the upper boud of Similarly, for the lower boud of 1.11 P S /V 1 + ɛ x P T x+p Δ /V x 1 + ɛ xτ 1 + δ 1/2} P T x+p Δ /V x 1 + ɛ xτ 1 + ɛ /4 1/2} + P δ ɛ /4 } P T x+p Δ /V x 1 + ɛ x 1 + 1/ ɛ /8 + P δ ɛ /4 P T x+p Δ /V xɛ /2 + P δ ɛ /4 P T x e η miɛ2, ɛ x}. The proof of Theorem 1.2 is ow complete. ProofofTheorem1.1. Theorem 1.1 follows from adtheorem1.2 by a suitable choice of ɛ, together with some routie calculatios. Ideed, by the cetral limit theorem for T see, e.g., Thm.3.1,[16], the result 1.8 isobviouswhe0 x 1. I order to prove 1.8 forx [1,o 1/6, we choose ɛ = maxɛ x/, 1/8 }, where ɛ is a sequece of costats satisfyig ɛ ad ɛ x3 / 0forx [1,o 1/6. It is readily to see that ad hece uiformly i x [1,o 1/6, miɛ 2, ɛ x} ɛ x maxɛ x 2, 3/8 x}, e η miɛ2, ɛ x} = o [ 1 Φx ], 2.10 whe is sufficietly large, where we have used a well-kow fact: for x>0, 1 1 2π x 1 x 3 e x2 /2 1 Φx 1 1 /2 2π x e x2. The meaig of 2.10 is that for all sequece u with u = o 1/6 lim sup x [1,u ] O the other had, it follows from 1.10 that wherewehaveusedtheresult: P [ S /V 1 ɛ x ] e η miɛ2, ɛ x} /1 Φx = 0. 1 Φ [ 1 ɛ x ]}[ 1+O1x 3 / ] [ 1 Φx ] 1+ Φ[ 1 ɛ x ] Φx }[ 1+O1x 3 / ] 1 Φx = [ 1 Φx ][ 1+o1 ], 2.11 Φ [ 1 ɛ x ] Φx ɛ x e 1 ɛ2 x 2 /2 = o [ 1 Φx ], uiformly i [1,o 1/6, sice ɛ x 2 ɛ x 3 / = o1. By virtue of ad the upper boud of 1.11, we obtai P T x [ 1 Φx ] [1 + o1]. Similarly we have P T x [ 1 Φx ] [1 + o1]. This proves 1.8.

6 CRAMÉR TYPE MODERATE DEVIATIONS FOR STUDENTIZED U-STATISTICS 173 I a similar matter, by choosig ɛ =max 1/8,ɛ } where ɛ is a sequece of costats such that ɛ 0 so slowly that ɛ 2 /x2,wehave ad therefore which together with 1.11 ad1.9 proves1.7. The proof of Theorem 1.2 is ow complete. = o1e 0.5η miɛ2, ɛ x, x 2 = omiɛ 2, ɛ x e η miɛ2, ɛ x = o1e x2 /4, 3. Proof of propositio 2.1 I this sectio, we give the proof of Propositio 2.1. Lemma 3.1 is iterestig i itself as it provides a expoetial boud for martigale differece uder fiite momet coditios. Lemma 3.1. Let ξ i, F i,i 1} be a sequece of martigale differece with Eξi 2 < ad put d2 i = Eξ2 i F i 1. The P ξ i x 2exp x 2 /8 3.1 ξ2 i +2d2 i +3Eξ2 i 1/2 for all x>0. Proof. We first show that e x x2 1+x1 x 1/2} 3.2 for all x R. It is easy to see that 3.2 holdsforx< 1/2. For x 1/2 letfx =x x 2 l1 + x. Observe that f x = 1 2x 1 x1 + 2x = 1+x 1+x > 0 for 1/2 <x<0, =0 forx =0, < 0 for x>0. Therefore f achieves maximum at x =0,thatis,fx f0 = 0 for x> 1/2. This proves 3.2. It follows from 3.2 thatfort R E exptξ i t 2 ξi 2 +2d 2 i F i 1 = e 2t2 d 2 i E exptξ i t 2 ξi 2 F i 1 e 2t2 d 2 i 1+Etξ i 1 tξi 1/2} F i 1 = e 2t2 d 2 i 1 Etξ i 1 tξi< 1/2} F i 1 e 2t2 d 2 i 1+2Etξ i 2 F i 1 1. This shows that exp t i j=1 ξ j t 2 } i j=1 ξ2 j +2d2 j, F i,i 1 is a super-martigale ad hece E exp t ξ j t 2 j=1 j=1 ξj 2 +2d 2 j

7 174 T.L. LAI, Q.-M. SHAO AND Q. WANG By 3.3 adtheorem2.1of, E exp a ξ i 2 ξ2 i +2d2 i +3Eξ2 i 1/2 for all a>0. Lettig a = x/2 2 together with Markov s iequality yields P ξ i x ξ2 i +2d2 i +3Eξ2 i 1/2 2expa e ax/ 2 a E exp ξ i 2 ξ2 i +2d2 i +3Eξ2 i 1/2 2exp ax/ 2+a 2 = 2exp x 2 /8. This proves 3.1. Lemma 3.2. Let ξ i,i 1} be idepedet radom variables with zero meas ad fiite variaces. Put S = ξ i, V 2 = ξi 2, B 2 = Eξi 2. The P S xv 2 +5B2 1/2 2exp x 2 /8 for x>0 3.5 ad ES 2 I S xv +4B 23B 2 e x2 /4 3.6 Proof. Result 3.5 follows from 3.1 directly because Eξi 2 F i 1 =Eξi 2 by idepedece of radom variables. Whe 0 <x<3, we have 23e x2 /4 1adES 2I S xv +4B ES 2 = B2 ad hece 3.6 holds. Whe x>3, let η i, 1 i } be a idepedet copy of ξ i, 1 i }. Set By the Chebyshev iequality, Notig that P S 2B, V 2 S = η i,v 2 = ηi 2. 4B2 1 P S > 2B P V 2 > 4B2 1 1/4 1/4 =1/2. S x4b + V, S 2B,V 2 4B2 } S S x4b + ξ i η i 2 1/2 V S S x2b + ξ i η i 2 1/2 2B, S 2B } 1/2 S S x ξ i η i 2, S 2B }, 2B, S 2B,V 2 4B 2 }

8 CRAMÉR TYPE MODERATE DEVIATIONS FOR STUDENTIZED U-STATISTICS 175 we have ESI S 2 xv +4B = ES2 I S xv +4B I S 2B,V 2 4B2 P S 2B,V 2 4B2 1/2 2ESI 2 S S x ξ i η i 2, S 2B 1/2 4ES S 2 I S S x ξ i η i 2, S 2B +4ES 2 I 1/2 S S x ξ i η i 2, S 2B [by the fact that S 2 2S S 2 +2S 2 1/2 4ES S 2 I S S x ξ i η i 2 1/2 +16BP 2 S S x ξ i η i ] Let ε i, 1 i } be a Rademacher sequece idepedet of ξ i, 1 i } ad η i, 1 i }. Notig that ξ i η i, 1 i } is a sequece of idepedet symmetric radom variables, ε i ξ i η i, 1 i } ad ξ i η i, 1 i } have the same joit distributio. It is kow that P a i ε i x a 2 i 1/2 2e x2 /2 3.8 for ay real umbers a i }. Hece with Y = a iε i / 1/2 a2 i 1 2 a 2 i E a i ε i I a i ε i x a 2 i 1/2 = EY 2 IY x = x 2 P Y x+2 2x 2 e x2 /2 +4 x x tp Y tdt te t2 /2 dt = 22+x 2 e x2 /2 2.4e x2 /4 3.9 for x>3. Thus by 3.8 ad3.9 forx>3 1/2 P S S x ξ i η i 2 2e x2 /2 0.22e x2 /4 3.10

9 176 T.L. LAI, Q.-M. SHAO AND Q. WANG ad 2 ES S 2 I S S x ξ i η i 1/2I S 2 2B =E ε i ξ i η i I ε i ξ i η i x ξ i η i 2 1/2 2.4e x2 /4 E ξ i η i 2 = 4.8Be 2 x2 / This proves 3.6 by3.7, 3.10 ad3.11. I the followig two lemmas we cotiue to use the otatios give i Sectio 2. Lemma 3.3. Assume σ1 2 =1. The for all y>0, P S yv + 5 2e y2 / ad where η 0 =1/32a 2 0 ad a 0 satisfied P V 2 /2 e η EgX 1 2 I gx 1 a 0 }1/ Proof. Recall EgX 1 =0adEgX 1 2 = is a special case of 3.5. We ext prove Let Y k = gx k I gxk a 0. Sicee x 1 x + x 2 /2forx>0, we have with t =1/4a 2 0 P V 2 /2 P k=1 Y 2 k /2 e t/2 Ee t k=1 Y 2 k =e t/2 Ee ty 2 1 e t/2 1 tey1 2 + t 2 EY1 4 /2 e t/2 1 3/4t + t 2 a 2 0/2 exp t/4 t 2 a 2 0 /2 =exp 32a 2 0, as desired. Lemma 3.4. Assume σ1 2 =1.The,forally 0, P [ Λ 2 a 0 y 2 7 V ] 2 e y2 / where a 0 =2c 0 +4,ad P where a 2 1 = 46c i<j ψx i,x j a 1 y 2 V /2 2 +2e y2 /8, 3.16

10 CRAMÉR TYPE MODERATE DEVIATIONS FOR STUDENTIZED U-STATISTICS 177 Proof. First prove Note that, give X i, W i follows from 3.5 that P W i is a sum of i.i.d. radom variables with zero meas. It y [ V i2 +5 1τ 2 X i ] } 1/2 2e y2 / where V i2 = j=1 ψ 2 X i,x j adτ 2 x =Eψ 2 X 1,X j X j = x. Note that ψ 2 x 1,x 2 2c 0 +4[1+ j i g 2 x 1 +g 2 x 2 ]. We have V i2 +5 1τ 2 X i 2c 0 +4 This, together with 3.17 ad the fact that yields that [ 11 +6g 2 X i + [ 11 +6g 2 X i + ] g 2 X i. ] g 2 X i = 7 V 2 +11, [ ] P Λ 2 a 0 y 2 7 V P W i 2 e y2 /8, y [ V i2 +5 1τ 2 X i ] } 1/2 as required. We ext prove Let F j = σx i,i j adrewrite 1i<j ψx i,x j = Y j, where Y j = j 1 ψx i,x j. The Y j, F j,j 2} is a martigale differece sequece. By 3.1, we have P Y j y [ Y 2 j +3EYj 2 +2EY j 2 F j 1 ] 1/2 2e y 2 / Note that EYj 2 prove j 1Eh 2 X 1,X 2 3j 1 by 1.6 adeg 2 X 1 =1. Theresult3.16 follows if we ] P [T1 2 a 2 y 2 V e y2 /8, 3.19 where T1 2 = Y j 2 ad a 2 = 14c 0 +4,ad where T 2 2 = EY 2 j F j 1 ada 3 = 16c ] P [T2 2 a 3 y 2 V e y2 /4, 3.20

11 178 T.L. LAI, Q.-M. SHAO AND Q. WANG We oly prove The proof of 3.19 is similar to We omit the details. Without loss of geerality, assume y 1. Otherwise 3.20 isobvious. WriteV j = V ψ,j +4j 1 1/2 τx j, where Vψ,j 2 = j 1 ψ2 X i,x j. Observe that P T2 2 2y 2[ 4 y 2[ 4 y 2[ 4 τ 2 X j Eτ 2 X 1 ]} P E [ Yj 2 I Y j yv j F ] j 1 τ 2 X j Eτ 2 X 1 ]} + P E [ Yj 2 I Y j >yv j F ] j 1 τ 2 X j Eτ 2 X 1 ]} := J 1 + J Note that J 1 P y 2 E [ V j 2 ] F j 1 y 2 4 τ 2 X j Eτ 2 X 1 j 1 = P 2τ 2 X i +32 j 1Eτ 2 X 1 4 τ 2 X j Eτ 2 X 1 = ad that recall y 1 J 2 = 1 64y 2 2 Eτ 2 X y 2 2 Eτ 2 X y 2 2 Eτ 2 X 1 E [ Y 2 j I Y j >yv j ] E E [ Yj 2 I Y j >yv j ] } X j E [ jτ 2 X 1 ] e y2 /4 by 3.6 e y2 / The result 3.20 ow follows from ad the fact that 4 τ 2 X j Eτ 2 X 1 8c V 2, as τ 2 x 2c 0 +4[2+gx]. This also completes the proof of Lemma 3.4. We are ow ready to prove Propositio 2.1. Without loss of geerality, assume σ1 2 =1. Otherwise,cosider h/σ 1 i the place of h. Weolyprove2.8. The proof of 2.9 is give i a similar maer except we use 3.16 i the place of 3.15.

12 CRAMÉR TYPE MODERATE DEVIATIONS FOR STUDENTIZED U-STATISTICS 179 By 3.12 ad3.13, for ay x>0 P S 5xV P V 2 /2 + P [ S xv + 5 ] 2e x2 /8 +e η0. By 3.15 ad3.13, for ay x>0, P Λ 7a 0 +22x V [ ] P V 2 /2 + P Λ 2 a 0 x 2 7 V These facts imply that, for ay y>0, 2 e x2 /8 +e η0. P δ y 2 P S y 2 V /3 + 2P Λ y 2 V /4 + P Λ y 2 V / e δ 0 y +2 2e δ 0 y2 +5e η exp δ 0 mi1,y,y 2 }, where δ 0, δ 0 ad δ 0 are costats depedig oly o σ 2 1 ad c 0. This proves 2.8 ad hece completes the proofofpropositio2.1. Ackowledgemets. The authors thak the referee for his/her valuable commets. Refereces [1] I.B. Alberik ad V. Betkus, Berry-Essee bouds for vo-mises ad U-statistics. Lith. Math. J [2] I.B. Alberik ad V. Betkus, Lyapuov type bouds for U-statistics. Theory Probab. Appl [3] J.N. Arvese, Jackkifig U-statistics. A. Math. Statist [4] Y.V. Borovskikh ad N.C. Weber, Large deviatios of U-statistics I. Lietuvos Matematikos Rikiys [5] Y.V. Borovskikh ad N.C. Weber, Large deviatios of U-statistics I. Lietuvos Matematikos Rikiys [6] H. Callaert ad N. Veraverbeke, The order of the ormal approximatio for a studetized U-statistics. A. Statist [7] W. Hoeffdig, A class of statistics with asymptotically ormal distributio. A. Math. Statist [8] B.-Y. Jig, Q.M. Shao ad Q. Wag, Self-ormalized Cramér-type large deviatio for idepedet radom variables. A. Probab [9] B.-Y. Jig, Q.M. Shao, W. Zhou, Saddlepoit approximatio for Studet s t-statistic with o momet coditios. A. Statist [10] V.S. Koroljuk ad V. Yu. Borovskich, Theory of U-statistics. Kluwer Academic Publishers, Dordrecht [11] Q.M. Shao, Self-ormalized large deviatios. A. Probab [12] Q.M. Shao, Cramér-type large deviatio for Studet s t statistic. J. Theorect. Probab [13] V.H. De La Pea, M.J. Klass ad T.L. Lai, Self-ormalized processes: expoetial iequalities, momet boud ad iterated logarithm laws. A. Probab [14] M. Vardemaele ad N. Veraverbeke, Cramer type large deviatios for studetized U-statistics. Metrika [15] Q. Wag, Berstei type iequalities for degeerate U-statistics with applicatios. A. Math. Ser. B [16] Q. Wag, B.-Y. Jig ad L. Zhao, The Berry-Essée boud for studetized statistics. A. Probab [17] Q. Wag ad N.C. Weber, Exact covergece rate ad leadig term i the cetral limit theorem for U-statistics. Statist. Siica [18] L. Zhao, The rate of the ormal approximatio for a studetized U-statistic. Sciece Exploratio

Self-normalized deviation inequalities with application to t-statistic

Self-normalized deviation inequalities with application to t-statistic Self-ormalized deviatio iequalities with applicatio to t-statistic Xiequa Fa Ceter for Applied Mathematics, Tiaji Uiversity, 30007 Tiaji, Chia Abstract Let ξ i i 1 be a sequece of idepedet ad symmetric

More information

Berry-Esseen bounds for self-normalized martingales

Berry-Esseen bounds for self-normalized martingales Berry-Essee bouds for self-ormalized martigales Xiequa Fa a, Qi-Ma Shao b a Ceter for Applied Mathematics, Tiaji Uiversity, Tiaji 30007, Chia b Departmet of Statistics, The Chiese Uiversity of Hog Kog,

More information

Self-normalized Cramér type Moderate Deviations for the Maximum of Sums

Self-normalized Cramér type Moderate Deviations for the Maximum of Sums Self-ormalized Cramér type Moderate Deviatios for the Maximum of Sums Weidog Liu 1, Qi-Ma Shao ad Qiyig Wag 3 Abstract Let X 1, X,... be idepedet radom variables with zero meas ad fiite variaces, ad let

More information

o f P r o b a b i l i t y Vol. 10 (2005), Paper no. 38, pages Journal URL ejpecp/

o f P r o b a b i l i t y Vol. 10 (2005), Paper no. 38, pages Journal URL   ejpecp/ E l e c t r o i c J o u r a l o f P r o b a b i l i t y Vol. 10 005, Paper o. 38, pages 160-185. Joural URL http://www.math.washigto.edu/ ejpecp/ Limit Theorems for Self-ormalized Large Deviatio 1 Qiyig

More information

A UNIFIED APPROACH TO EDGEWORTH EXPANSIONS FOR A GENERAL CLASS OF STATISTICS

A UNIFIED APPROACH TO EDGEWORTH EXPANSIONS FOR A GENERAL CLASS OF STATISTICS Statistica Siica 20 2010, 613-636 A UNIFIED APPROACH TO EDGEWORTH EXPANSIONS FOR A GENERAL CLASS OF STATISTICS Big-Yi Jig ad Qiyig Wag Hog Kog Uiversity of Sciece ad Techology ad Uiversity of Sydey Abstract:

More information

Asymptotic distribution of products of sums of independent random variables

Asymptotic distribution of products of sums of independent random variables Proc. Idia Acad. Sci. Math. Sci. Vol. 3, No., May 03, pp. 83 9. c Idia Academy of Scieces Asymptotic distributio of products of sums of idepedet radom variables YANLING WANG, SUXIA YAO ad HONGXIA DU ollege

More information

Mi-Hwa Ko and Tae-Sung Kim

Mi-Hwa Ko and Tae-Sung Kim J. Korea Math. Soc. 42 2005), No. 5, pp. 949 957 ALMOST SURE CONVERGENCE FOR WEIGHTED SUMS OF NEGATIVELY ORTHANT DEPENDENT RANDOM VARIABLES Mi-Hwa Ko ad Tae-Sug Kim Abstract. For weighted sum of a sequece

More information

Precise Rates in Complete Moment Convergence for Negatively Associated Sequences

Precise Rates in Complete Moment Convergence for Negatively Associated Sequences Commuicatios of the Korea Statistical Society 29, Vol. 16, No. 5, 841 849 Precise Rates i Complete Momet Covergece for Negatively Associated Sequeces Dae-Hee Ryu 1,a a Departmet of Computer Sciece, ChugWoo

More information

ST5215: Advanced Statistical Theory

ST5215: Advanced Statistical Theory ST525: Advaced Statistical Theory Departmet of Statistics & Applied Probability Tuesday, September 7, 2 ST525: Advaced Statistical Theory Lecture : The law of large umbers The Law of Large Numbers The

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

Central limit theorem and almost sure central limit theorem for the product of some partial sums

Central limit theorem and almost sure central limit theorem for the product of some partial sums Proc. Idia Acad. Sci. Math. Sci. Vol. 8, No. 2, May 2008, pp. 289 294. Prited i Idia Cetral it theorem ad almost sure cetral it theorem for the product of some partial sums YU MIAO College of Mathematics

More information

MAXIMAL INEQUALITIES AND STRONG LAW OF LARGE NUMBERS FOR AANA SEQUENCES

MAXIMAL INEQUALITIES AND STRONG LAW OF LARGE NUMBERS FOR AANA SEQUENCES Commu Korea Math Soc 26 20, No, pp 5 6 DOI 0434/CKMS20265 MAXIMAL INEQUALITIES AND STRONG LAW OF LARGE NUMBERS FOR AANA SEQUENCES Wag Xueju, Hu Shuhe, Li Xiaoqi, ad Yag Wezhi Abstract Let {X, } be a sequece

More information

Convergence of random variables. (telegram style notes) P.J.C. Spreij

Convergence of random variables. (telegram style notes) P.J.C. Spreij Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space

More information

Regression with an Evaporating Logarithmic Trend

Regression with an Evaporating Logarithmic Trend Regressio with a Evaporatig Logarithmic Tred Peter C. B. Phillips Cowles Foudatio, Yale Uiversity, Uiversity of Aucklad & Uiversity of York ad Yixiao Su Departmet of Ecoomics Yale Uiversity October 5,

More information

Lecture 19: Convergence

Lecture 19: Convergence Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

2.2. Central limit theorem.

2.2. Central limit theorem. 36.. Cetral limit theorem. The most ideal case of the CLT is that the radom variables are iid with fiite variace. Although it is a special case of the more geeral Lideberg-Feller CLT, it is most stadard

More information

1 = δ2 (0, ), Y Y n nδ. , T n = Y Y n n. ( U n,k + X ) ( f U n,k + Y ) n 2n f U n,k + θ Y ) 2 E X1 2 X1

1 = δ2 (0, ), Y Y n nδ. , T n = Y Y n n. ( U n,k + X ) ( f U n,k + Y ) n 2n f U n,k + θ Y ) 2 E X1 2 X1 8. The cetral limit theorems 8.1. The cetral limit theorem for i.i.d. sequeces. ecall that C ( is N -separatig. Theorem 8.1. Let X 1, X,... be i.i.d. radom variables with EX 1 = ad EX 1 = σ (,. Suppose

More information

Approximation theorems for localized szász Mirakjan operators

Approximation theorems for localized szász Mirakjan operators Joural of Approximatio Theory 152 (2008) 125 134 www.elsevier.com/locate/jat Approximatio theorems for localized szász Miraja operators Lise Xie a,,1, Tigfa Xie b a Departmet of Mathematics, Lishui Uiversity,

More information

Limit distributions for products of sums

Limit distributions for products of sums Statistics & Probability Letters 62 (23) 93 Limit distributios for products of sums Yogcheg Qi Departmet of Mathematics ad Statistics, Uiversity of Miesota-Duluth, Campus Ceter 4, 7 Uiversity Drive, Duluth,

More information

Lecture 8: Convergence of transformations and law of large numbers

Lecture 8: Convergence of transformations and law of large numbers Lecture 8: Covergece of trasformatios ad law of large umbers Trasformatio ad covergece Trasformatio is a importat tool i statistics. If X coverges to X i some sese, we ofte eed to check whether g(x ) coverges

More information

Notes 19 : Martingale CLT

Notes 19 : Martingale CLT Notes 9 : Martigale CLT Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: [Bil95, Chapter 35], [Roc, Chapter 3]. Sice we have ot ecoutered weak covergece i some time, we first recall

More information

Introduction to Extreme Value Theory Laurens de Haan, ISM Japan, Erasmus University Rotterdam, NL University of Lisbon, PT

Introduction to Extreme Value Theory Laurens de Haan, ISM Japan, Erasmus University Rotterdam, NL University of Lisbon, PT Itroductio to Extreme Value Theory Laures de Haa, ISM Japa, 202 Itroductio to Extreme Value Theory Laures de Haa Erasmus Uiversity Rotterdam, NL Uiversity of Lisbo, PT Itroductio to Extreme Value Theory

More information

This section is optional.

This section is optional. 4 Momet Geeratig Fuctios* This sectio is optioal. The momet geeratig fuctio g : R R of a radom variable X is defied as g(t) = E[e tx ]. Propositio 1. We have g () (0) = E[X ] for = 1, 2,... Proof. Therefore

More information

<, if ε > 0 2nloglogn. =, if ε < 0.

<, if ε > 0 2nloglogn. =, if ε < 0. GLASNIK MATEMATIČKI Vol. 52(72)(207), 35 360 THE DAVIS-GUT LAW FOR INDEPENDENT AND IDENTICALLY DISTRIBUTED BANACH SPACE VALUED RANDOM ELEMENTS Pigya Che, Migyag Zhag ad Adrew Rosalsky Jia Uversity, P.

More information

A Note on the Kolmogorov-Feller Weak Law of Large Numbers

A Note on the Kolmogorov-Feller Weak Law of Large Numbers Joural of Mathematical Research with Applicatios Mar., 015, Vol. 35, No., pp. 3 8 DOI:10.3770/j.iss:095-651.015.0.013 Http://jmre.dlut.edu.c A Note o the Kolmogorov-Feller Weak Law of Large Numbers Yachu

More information

1 Convergence in Probability and the Weak Law of Large Numbers

1 Convergence in Probability and the Weak Law of Large Numbers 36-752 Advaced Probability Overview Sprig 2018 8. Covergece Cocepts: i Probability, i L p ad Almost Surely Istructor: Alessadro Rialdo Associated readig: Sec 2.4, 2.5, ad 4.11 of Ash ad Doléas-Dade; Sec

More information

Lecture 2: Concentration Bounds

Lecture 2: Concentration Bounds CSE 52: Desig ad Aalysis of Algorithms I Sprig 206 Lecture 2: Cocetratio Bouds Lecturer: Shaya Oveis Ghara March 30th Scribe: Syuzaa Sargsya Disclaimer: These otes have ot bee subjected to the usual scrutiy

More information

Notes 5 : More on the a.s. convergence of sums

Notes 5 : More on the a.s. convergence of sums Notes 5 : More o the a.s. covergece of sums Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: Dur0, Sectios.5; Wil9, Sectio 4.7, Shi96, Sectio IV.4, Dur0, Sectio.. Radom series. Three-series

More information

Weak Laws of Large Numbers for Sequences or Arrays of Correlated Random Variables

Weak Laws of Large Numbers for Sequences or Arrays of Correlated Random Variables Iteratioal Mathematical Forum, Vol., 5, o. 4, 65-73 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/.988/imf.5.5 Weak Laws of Large Numers for Sequeces or Arrays of Correlated Radom Variales Yutig Lu School

More information

Complete Convergence for Asymptotically Almost Negatively Associated Random Variables

Complete Convergence for Asymptotically Almost Negatively Associated Random Variables Applied Mathematical Scieces, Vol. 12, 2018, o. 30, 1441-1452 HIKARI Ltd, www.m-hikari.com https://doi.org/10.12988/ams.2018.810142 Complete Covergece for Asymptotically Almost Negatively Associated Radom

More information

An almost sure invariance principle for trimmed sums of random vectors

An almost sure invariance principle for trimmed sums of random vectors Proc. Idia Acad. Sci. Math. Sci. Vol. 20, No. 5, November 200, pp. 6 68. Idia Academy of Scieces A almost sure ivariace priciple for trimmed sums of radom vectors KE-ANG FU School of Statistics ad Mathematics,

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak

More information

Glivenko-Cantelli Classes

Glivenko-Cantelli Classes CS28B/Stat24B (Sprig 2008 Statistical Learig Theory Lecture: 4 Gliveko-Catelli Classes Lecturer: Peter Bartlett Scribe: Michelle Besi Itroductio This lecture will cover Gliveko-Catelli (GC classes ad itroduce

More information

Solutions to HW Assignment 1

Solutions to HW Assignment 1 Solutios to HW: 1 Course: Theory of Probability II Page: 1 of 6 Uiversity of Texas at Austi Solutios to HW Assigmet 1 Problem 1.1. Let Ω, F, {F } 0, P) be a filtered probability space ad T a stoppig time.

More information

Econ 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1.

Econ 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1. Eco 325/327 Notes o Sample Mea, Sample Proportio, Cetral Limit Theorem, Chi-square Distributio, Studet s t distributio 1 Sample Mea By Hiro Kasahara We cosider a radom sample from a populatio. Defiitio

More information

Advanced Stochastic Processes.

Advanced Stochastic Processes. Advaced Stochastic Processes. David Gamarik LECTURE 2 Radom variables ad measurable fuctios. Strog Law of Large Numbers (SLLN). Scary stuff cotiued... Outlie of Lecture Radom variables ad measurable fuctios.

More information

Rademacher Complexity

Rademacher Complexity EECS 598: Statistical Learig Theory, Witer 204 Topic 0 Rademacher Complexity Lecturer: Clayto Scott Scribe: Ya Deg, Kevi Moo Disclaimer: These otes have ot bee subjected to the usual scrutiy reserved for

More information

Asymptotic Results for the Linear Regression Model

Asymptotic Results for the Linear Regression Model Asymptotic Results for the Liear Regressio Model C. Fli November 29, 2000 1. Asymptotic Results uder Classical Assumptios The followig results apply to the liear regressio model y = Xβ + ε, where X is

More information

EE 4TM4: Digital Communications II Probability Theory

EE 4TM4: Digital Communications II Probability Theory 1 EE 4TM4: Digital Commuicatios II Probability Theory I. RANDOM VARIABLES A radom variable is a real-valued fuctio defied o the sample space. Example: Suppose that our experimet cosists of tossig two fair

More information

EFFECTIVE WLLN, SLLN, AND CLT IN STATISTICAL MODELS

EFFECTIVE WLLN, SLLN, AND CLT IN STATISTICAL MODELS EFFECTIVE WLLN, SLLN, AND CLT IN STATISTICAL MODELS Ryszard Zieliński Ist Math Polish Acad Sc POBox 21, 00-956 Warszawa 10, Polad e-mail: rziel@impagovpl ABSTRACT Weak laws of large umbers (W LLN), strog

More information

COMPLETE CONVERGENCE AND COMPLETE MOMENT CONVERGENCE FOR ARRAYS OF ROWWISE END RANDOM VARIABLES

COMPLETE CONVERGENCE AND COMPLETE MOMENT CONVERGENCE FOR ARRAYS OF ROWWISE END RANDOM VARIABLES GLASNIK MATEMATIČKI Vol. 4969)2014), 449 468 COMPLETE CONVERGENCE AND COMPLETE MOMENT CONVERGENCE FOR ARRAYS OF ROWWISE END RANDOM VARIABLES Yogfeg Wu, Mauel Ordóñez Cabrera ad Adrei Volodi Toglig Uiversity

More information

Research Article Moment Inequality for ϕ-mixing Sequences and Its Applications

Research Article Moment Inequality for ϕ-mixing Sequences and Its Applications Hidawi Publishig Corporatio Joural of Iequalities ad Applicatios Volume 2009, Article ID 379743, 2 pages doi:0.55/2009/379743 Research Article Momet Iequality for ϕ-mixig Sequeces ad Its Applicatios Wag

More information

Lecture 20: Multivariate convergence and the Central Limit Theorem

Lecture 20: Multivariate convergence and the Central Limit Theorem Lecture 20: Multivariate covergece ad the Cetral Limit Theorem Covergece i distributio for radom vectors Let Z,Z 1,Z 2,... be radom vectors o R k. If the cdf of Z is cotiuous, the we ca defie covergece

More information

Marcinkiwiecz-Zygmund Type Inequalities for all Arcs of the Circle

Marcinkiwiecz-Zygmund Type Inequalities for all Arcs of the Circle Marcikiwiecz-ygmud Type Iequalities for all Arcs of the Circle C.K. Kobidarajah ad D. S. Lubisky Mathematics Departmet, Easter Uiversity, Chekalady, Sri Laka; Mathematics Departmet, Georgia Istitute of

More information

Edgeworth Expansion for Studentized Statistics

Edgeworth Expansion for Studentized Statistics Edgeworth Expasio for Studetized Statistics Big-Yi JING Hog Kog Uiversity of Sciece ad Techology Qiyig WANG Australia Natioal Uiversity ABSTRACT Edgeworth expasios are developed for a geeral class of studetized

More information

Distribution of Random Samples & Limit theorems

Distribution of Random Samples & Limit theorems STAT/MATH 395 A - PROBABILITY II UW Witer Quarter 2017 Néhémy Lim Distributio of Radom Samples & Limit theorems 1 Distributio of i.i.d. Samples Motivatig example. Assume that the goal of a study is to

More information

Rates of Convergence by Moduli of Continuity

Rates of Convergence by Moduli of Continuity Rates of Covergece by Moduli of Cotiuity Joh Duchi: Notes for Statistics 300b March, 017 1 Itroductio I this ote, we give a presetatio showig the importace, ad relatioship betwee, the modulis of cotiuity

More information

Sequences and Series of Functions

Sequences and Series of Functions Chapter 6 Sequeces ad Series of Fuctios 6.1. Covergece of a Sequece of Fuctios Poitwise Covergece. Defiitio 6.1. Let, for each N, fuctio f : A R be defied. If, for each x A, the sequece (f (x)) coverges

More information

ON POINTWISE BINOMIAL APPROXIMATION

ON POINTWISE BINOMIAL APPROXIMATION Iteratioal Joural of Pure ad Applied Mathematics Volume 71 No. 1 2011, 57-66 ON POINTWISE BINOMIAL APPROXIMATION BY w-functions K. Teerapabolar 1, P. Wogkasem 2 Departmet of Mathematics Faculty of Sciece

More information

J. Stat. Appl. Pro. Lett. 2, No. 1, (2015) 15

J. Stat. Appl. Pro. Lett. 2, No. 1, (2015) 15 J. Stat. Appl. Pro. Lett. 2, No. 1, 15-22 2015 15 Joural of Statistics Applicatios & Probability Letters A Iteratioal Joural http://dx.doi.org/10.12785/jsapl/020102 Martigale Method for Rui Probabilityi

More information

Entropy Rates and Asymptotic Equipartition

Entropy Rates and Asymptotic Equipartition Chapter 29 Etropy Rates ad Asymptotic Equipartitio Sectio 29. itroduces the etropy rate the asymptotic etropy per time-step of a stochastic process ad shows that it is well-defied; ad similarly for iformatio,

More information

The log-behavior of n p(n) and n p(n)/n

The log-behavior of n p(n) and n p(n)/n Ramauja J. 44 017, 81-99 The log-behavior of p ad p/ William Y.C. Che 1 ad Ke Y. Zheg 1 Ceter for Applied Mathematics Tiaji Uiversity Tiaji 0007, P. R. Chia Ceter for Combiatorics, LPMC Nakai Uivercity

More information

Hyun-Chull Kim and Tae-Sung Kim

Hyun-Chull Kim and Tae-Sung Kim Commu. Korea Math. Soc. 20 2005), No. 3, pp. 531 538 A CENTRAL LIMIT THEOREM FOR GENERAL WEIGHTED SUM OF LNQD RANDOM VARIABLES AND ITS APPLICATION Hyu-Chull Kim ad Tae-Sug Kim Abstract. I this paper we

More information

Basics of Probability Theory (for Theory of Computation courses)

Basics of Probability Theory (for Theory of Computation courses) Basics of Probability Theory (for Theory of Computatio courses) Oded Goldreich Departmet of Computer Sciece Weizma Istitute of Sciece Rehovot, Israel. oded.goldreich@weizma.ac.il November 24, 2008 Preface.

More information

Ada Boost, Risk Bounds, Concentration Inequalities. 1 AdaBoost and Estimates of Conditional Probabilities

Ada Boost, Risk Bounds, Concentration Inequalities. 1 AdaBoost and Estimates of Conditional Probabilities CS8B/Stat4B Sprig 008) Statistical Learig Theory Lecture: Ada Boost, Risk Bouds, Cocetratio Iequalities Lecturer: Peter Bartlett Scribe: Subhrasu Maji AdaBoost ad Estimates of Coditioal Probabilities We

More information

Lecture 3: August 31

Lecture 3: August 31 36-705: Itermediate Statistics Fall 018 Lecturer: Siva Balakrisha Lecture 3: August 31 This lecture will be mostly a summary of other useful expoetial tail bouds We will ot prove ay of these i lecture,

More information

Probability 2 - Notes 10. Lemma. If X is a random variable and g(x) 0 for all x in the support of f X, then P(g(X) 1) E[g(X)].

Probability 2 - Notes 10. Lemma. If X is a random variable and g(x) 0 for all x in the support of f X, then P(g(X) 1) E[g(X)]. Probability 2 - Notes 0 Some Useful Iequalities. Lemma. If X is a radom variable ad g(x 0 for all x i the support of f X, the P(g(X E[g(X]. Proof. (cotiuous case P(g(X Corollaries x:g(x f X (xdx x:g(x

More information

5.1 A mutual information bound based on metric entropy

5.1 A mutual information bound based on metric entropy Chapter 5 Global Fao Method I this chapter, we exted the techiques of Chapter 2.4 o Fao s method the local Fao method) to a more global costructio. I particular, we show that, rather tha costructig a local

More information

STA Object Data Analysis - A List of Projects. January 18, 2018

STA Object Data Analysis - A List of Projects. January 18, 2018 STA 6557 Jauary 8, 208 Object Data Aalysis - A List of Projects. Schoeberg Mea glaucomatous shape chages of the Optic Nerve Head regio i aimal models 2. Aalysis of VW- Kedall ati-mea shapes with a applicatio

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 Fuctioal Law of Large Numbers. Costructio of the Wieer Measure Cotet. 1. Additioal techical results o weak covergece

More information

ECE 330:541, Stochastic Signals and Systems Lecture Notes on Limit Theorems from Probability Fall 2002

ECE 330:541, Stochastic Signals and Systems Lecture Notes on Limit Theorems from Probability Fall 2002 ECE 330:541, Stochastic Sigals ad Systems Lecture Notes o Limit Theorems from robability Fall 00 I practice, there are two ways we ca costruct a ew sequece of radom variables from a old sequece of radom

More information

A central limit theorem for moving average process with negatively associated innovation

A central limit theorem for moving average process with negatively associated innovation Iteratioal Mathematical Forum, 1, 2006, o. 10, 495-502 A cetral limit theorem for movig average process with egatively associated iovatio MI-HWA KO Statistical Research Ceter for Complex Systems Seoul

More information

Law of the sum of Bernoulli random variables

Law of the sum of Bernoulli random variables Law of the sum of Beroulli radom variables Nicolas Chevallier Uiversité de Haute Alsace, 4, rue des frères Lumière 68093 Mulhouse icolas.chevallier@uha.fr December 006 Abstract Let be the set of all possible

More information

Chapter 5. Inequalities. 5.1 The Markov and Chebyshev inequalities

Chapter 5. Inequalities. 5.1 The Markov and Chebyshev inequalities Chapter 5 Iequalities 5.1 The Markov ad Chebyshev iequalities As you have probably see o today s frot page: every perso i the upper teth percetile ears at least 1 times more tha the average salary. I other

More information

for all x ; ;x R. A ifiite sequece fx ; g is said to be ND if every fiite subset X ; ;X is ND. The coditios (.) ad (.3) are equivalet for =, but these

for all x ; ;x R. A ifiite sequece fx ; g is said to be ND if every fiite subset X ; ;X is ND. The coditios (.) ad (.3) are equivalet for =, but these sub-gaussia techiques i provig some strog it theorems Λ M. Amii A. Bozorgia Departmet of Mathematics, Faculty of Scieces Sista ad Baluchesta Uiversity, Zaheda, Ira Amii@hamoo.usb.ac.ir, Fax:054446565 Departmet

More information

ECE 901 Lecture 12: Complexity Regularization and the Squared Loss

ECE 901 Lecture 12: Complexity Regularization and the Squared Loss ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality

More information

Gamma Distribution and Gamma Approximation

Gamma Distribution and Gamma Approximation Gamma Distributio ad Gamma Approimatio Xiaomig Zeg a Fuhua (Frak Cheg b a Xiame Uiversity, Xiame 365, Chia mzeg@jigia.mu.edu.c b Uiversity of Ketucky, Leigto, Ketucky 456-46, USA cheg@cs.uky.edu Abstract

More information

Research Article On the Strong Laws for Weighted Sums of ρ -Mixing Random Variables

Research Article On the Strong Laws for Weighted Sums of ρ -Mixing Random Variables Hidawi Publishig Corporatio Joural of Iequalities ad Applicatios Volume 2011, Article ID 157816, 8 pages doi:10.1155/2011/157816 Research Article O the Strog Laws for Weighted Sums of ρ -Mixig Radom Variables

More information

SDS 321: Introduction to Probability and Statistics

SDS 321: Introduction to Probability and Statistics SDS 321: Itroductio to Probability ad Statistics Lecture 23: Cotiuous radom variables- Iequalities, CLT Puramrita Sarkar Departmet of Statistics ad Data Sciece The Uiversity of Texas at Austi www.cs.cmu.edu/

More information

A survey on penalized empirical risk minimization Sara A. van de Geer

A survey on penalized empirical risk minimization Sara A. van de Geer A survey o pealized empirical risk miimizatio Sara A. va de Geer We address the questio how to choose the pealty i empirical risk miimizatio. Roughly speakig, this pealty should be a good boud for the

More information

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + 62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of

More information

Entropy and Ergodic Theory Lecture 5: Joint typicality and conditional AEP

Entropy and Ergodic Theory Lecture 5: Joint typicality and conditional AEP Etropy ad Ergodic Theory Lecture 5: Joit typicality ad coditioal AEP 1 Notatio: from RVs back to distributios Let (Ω, F, P) be a probability space, ad let X ad Y be A- ad B-valued discrete RVs, respectively.

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013. Large Deviations for i.i.d. Random Variables

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013. Large Deviations for i.i.d. Random Variables MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013 Large Deviatios for i.i.d. Radom Variables Cotet. Cheroff boud usig expoetial momet geeratig fuctios. Properties of a momet

More information

Solution to Chapter 2 Analytical Exercises

Solution to Chapter 2 Analytical Exercises Nov. 25, 23, Revised Dec. 27, 23 Hayashi Ecoometrics Solutio to Chapter 2 Aalytical Exercises. For ay ε >, So, plim z =. O the other had, which meas that lim E(z =. 2. As show i the hit, Prob( z > ε =

More information

18.657: Mathematics of Machine Learning

18.657: Mathematics of Machine Learning 8.657: Mathematics of Machie Learig Lecturer: Philippe Rigollet Lecture 4 Scribe: Cheg Mao Sep., 05 I this lecture, we cotiue to discuss the effect of oise o the rate of the excess risk E(h) = R(h) R(h

More information

A PROOF OF THE WEIERSTRASS APPROXIMATION THEOREM FOR R k USING BINOMIAL DISTRIBUTIONS

A PROOF OF THE WEIERSTRASS APPROXIMATION THEOREM FOR R k USING BINOMIAL DISTRIBUTIONS A PROOF OF THE WEIERSTRASS APPROXIMATION THEOREM FOR R k USING BINOMIAL DISTRIBUTIONS BEN KORDESH Abstract. We relate the probabilistic proof of the Weierstrass Approximatio Theorem [Lev84] to the covolutio

More information

2.1. Convergence in distribution and characteristic functions.

2.1. Convergence in distribution and characteristic functions. 3 Chapter 2. Cetral Limit Theorem. Cetral limit theorem, or DeMoivre-Laplace Theorem, which also implies the wea law of large umbers, is the most importat theorem i probability theory ad statistics. For

More information

REGRESSION WITH QUADRATIC LOSS

REGRESSION WITH QUADRATIC LOSS REGRESSION WITH QUADRATIC LOSS MAXIM RAGINSKY Regressio with quadratic loss is aother basic problem studied i statistical learig theory. We have a radom couple Z = X, Y ), where, as before, X is a R d

More information

Mathematics 170B Selected HW Solutions.

Mathematics 170B Selected HW Solutions. Mathematics 17B Selected HW Solutios. F 4. Suppose X is B(,p). (a)fidthemometgeeratigfuctiom (s)of(x p)/ p(1 p). Write q = 1 p. The MGF of X is (pe s + q), sice X ca be writte as the sum of idepedet Beroulli

More information

arxiv: v1 [math.pr] 13 Oct 2011

arxiv: v1 [math.pr] 13 Oct 2011 A tail iequality for quadratic forms of subgaussia radom vectors Daiel Hsu, Sham M. Kakade,, ad Tog Zhag 3 arxiv:0.84v math.pr] 3 Oct 0 Microsoft Research New Eglad Departmet of Statistics, Wharto School,

More information

NEW FAST CONVERGENT SEQUENCES OF EULER-MASCHERONI TYPE

NEW FAST CONVERGENT SEQUENCES OF EULER-MASCHERONI TYPE UPB Sci Bull, Series A, Vol 79, Iss, 207 ISSN 22-7027 NEW FAST CONVERGENT SEQUENCES OF EULER-MASCHERONI TYPE Gabriel Bercu We itroduce two ew sequeces of Euler-Mascheroi type which have fast covergece

More information

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i

More information

An Introduction to Randomized Algorithms

An Introduction to Randomized Algorithms A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis

More information

1 Introduction to reducing variance in Monte Carlo simulations

1 Introduction to reducing variance in Monte Carlo simulations Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by

More information

Output Analysis and Run-Length Control

Output Analysis and Run-Length Control IEOR E4703: Mote Carlo Simulatio Columbia Uiversity c 2017 by Marti Haugh Output Aalysis ad Ru-Legth Cotrol I these otes we describe how the Cetral Limit Theorem ca be used to costruct approximate (1 α%

More information

4. Partial Sums and the Central Limit Theorem

4. Partial Sums and the Central Limit Theorem 1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems

More information

THE LONELY RUNNER PROBLEM FOR MANY RUNNERS. Artūras Dubickas Vilnius University, Lithuania

THE LONELY RUNNER PROBLEM FOR MANY RUNNERS. Artūras Dubickas Vilnius University, Lithuania GLASNIK MATEMATIČKI Vol. 46(66)(2011), 25 30 THE LONELY RUNNER PROBLEM FOR MANY RUNNERS Artūras Dubickas Vilius Uiversity, Lithuaia Abstract. The loely ruer cojecture asserts that for ay positive iteger

More information

Research Article A Note on Ergodicity of Systems with the Asymptotic Average Shadowing Property

Research Article A Note on Ergodicity of Systems with the Asymptotic Average Shadowing Property Discrete Dyamics i Nature ad Society Volume 2011, Article ID 360583, 6 pages doi:10.1155/2011/360583 Research Article A Note o Ergodicity of Systems with the Asymptotic Average Shadowig Property Risog

More information

Introduction to Probability. Ariel Yadin

Introduction to Probability. Ariel Yadin Itroductio to robability Ariel Yadi Lecture 2 *** Ja. 7 ***. Covergece of Radom Variables As i the case of sequeces of umbers, we would like to talk about covergece of radom variables. There are may ways

More information

Approximation by Superpositions of a Sigmoidal Function

Approximation by Superpositions of a Sigmoidal Function Zeitschrift für Aalysis ud ihre Aweduge Joural for Aalysis ad its Applicatios Volume 22 (2003, No. 2, 463 470 Approximatio by Superpositios of a Sigmoidal Fuctio G. Lewicki ad G. Mario Abstract. We geeralize

More information

Lecture 23: Minimal sufficiency

Lecture 23: Minimal sufficiency Lecture 23: Miimal sufficiecy Maximal reductio without loss of iformatio There are may sufficiet statistics for a give problem. I fact, X (the whole data set) is sufficiet. If T is a sufficiet statistic

More information

LECTURE 8: ASYMPTOTICS I

LECTURE 8: ASYMPTOTICS I LECTURE 8: ASYMPTOTICS I We are iterested i the properties of estimators as. Cosider a sequece of radom variables {, X 1}. N. M. Kiefer, Corell Uiversity, Ecoomics 60 1 Defiitio: (Weak covergece) A sequece

More information

Learning Theory: Lecture Notes

Learning Theory: Lecture Notes Learig Theory: Lecture Notes Kamalika Chaudhuri October 4, 0 Cocetratio of Averages Cocetratio of measure is very useful i showig bouds o the errors of machie-learig algorithms. We will begi with a basic

More information

Generalized Law of the Iterated Logarithm and Its Convergence Rate

Generalized Law of the Iterated Logarithm and Its Convergence Rate Stochastic Aalysis ad Applicatios, 25: 89 03, 2007 Copyright Taylor & Fracis Group, LLC ISSN 0736-2994 prit/532-9356 olie DOI: 0.080/073629906005997 Geeralized Law of the Iterated Logarithm ad Its Covergece

More information

Appendix to Quicksort Asymptotics

Appendix to Quicksort Asymptotics Appedix to Quicksort Asymptotics James Alle Fill Departmet of Mathematical Scieces The Johs Hopkis Uiversity jimfill@jhu.edu ad http://www.mts.jhu.edu/~fill/ ad Svate Jaso Departmet of Mathematics Uppsala

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 3 9/11/2013. Large deviations Theory. Cramér s Theorem

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 3 9/11/2013. Large deviations Theory. Cramér s Theorem MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/5.070J Fall 203 Lecture 3 9//203 Large deviatios Theory. Cramér s Theorem Cotet.. Cramér s Theorem. 2. Rate fuctio ad properties. 3. Chage of measure techique.

More information

Unbiased Estimation. February 7-12, 2008

Unbiased Estimation. February 7-12, 2008 Ubiased Estimatio February 7-2, 2008 We begi with a sample X = (X,..., X ) of radom variables chose accordig to oe of a family of probabilities P θ where θ is elemet from the parameter space Θ. For radom

More information

Exercise 4.3 Use the Continuity Theorem to prove the Cramér-Wold Theorem, Theorem. (1) φ a X(1).

Exercise 4.3 Use the Continuity Theorem to prove the Cramér-Wold Theorem, Theorem. (1) φ a X(1). Assigmet 7 Exercise 4.3 Use the Cotiuity Theorem to prove the Cramér-Wold Theorem, Theorem 4.12. Hit: a X d a X implies that φ a X (1) φ a X(1). Sketch of solutio: As we poited out i class, the oly tricky

More information

Equivalent Conditions of Complete Convergence and Complete Moment Convergence for END Random Variables

Equivalent Conditions of Complete Convergence and Complete Moment Convergence for END Random Variables Chi. A. Math. Ser. B 391, 2018, 83 96 DOI: 10.1007/s11401-018-1053-9 Chiese Aals of Mathematics, Series B c The Editorial Office of CAM ad Spriger-Verlag Berli Heidelberg 2018 Equivalet Coditios of Complete

More information