1 Introduction, definitions and assumption

Size: px
Start display at page:

Download "1 Introduction, definitions and assumption"

Transcription

1 O almost sure covergece rates for the kerel estimator of a covariace operator uder egative associatio H. Jabbari 1 ad M. Erfaiya Departmet of Statistics, Ordered ad Spatial Data Ceter of Excellece, Ferdowsi Uiversity of Mashhad, Mashhad, Ira Abstract Let {X, 1} be a strictly statioary sequece of egatively associated radom variables, with commo cotiuous ad bouded distributio fuctio F. We cosider the estimatio of the two-dimesioal distributio fuctio of (X 1, X k+1 ) based o kerel type estimators as well as the estimatio of the covariace fuctio of the limit empirical process iduced by the sequece {X, 1} where k IN 0. The, we derive uiform strog covergece rates for the kerel estimator of two-dimesioal distributio fuctio of (X 1, X k+1 ) which were ot foud already ad do ot eed ay coditios o the covariace structure of the variables. Furthermore assumig a coveiet decrease rate of the covariaces Cov(X 1, X +1 ), 1, we prove uiform strog covergece rate for covariace fuctio of the limit empirical process based o kerel type estimators. Fially, we use a simulatio study to compare the estimators of distributio fuctio of (X 1, X k+1 ). Key Words: Almost sure covergece rate, Bivariate distributio fuctio, Empirical process, Kerel estimatio. 1 Itroductio, defiitios ad assumptio Estimatio of distributio fuctios of radom pairs (two-dimesioal distributio fuctios) has bee always a subject of iterest of may statisticias. The case of idepedet uderlyig radom variables was studied by [3]. The case of oidepedet radom variables had bee studied, too (see for example [1], [2], [6], [7] ad [8]). Oe of the most applicable cocept of egative depedece i multivariate statistical aalysis ad reliability theory is egative associatio. A fiite family of radom variables {X i, 1 i } is said to be egatively associated (NA) if for every pair of disjoit subsets A ad B of {1, 2,..., }, Cov(f 1 (X i, i A), f 2 (X j, j B)) 0, wheever f 1 ad f 2 are coordiatewise icreasig ad such that the covariace exists. A ifiite family of radom variables is NA if every fiite subfamily is NA. We refer to [1], [8], [9], [10], [11], [12], [14], [15], [18], [19], [20], [21], [22], [23], [24] ad [25] for kowig some of the most importat studies have bee performed o differet aspects of NA radom variables. The metioed commets above motivated the iterest o the estimatio of the bivariate distributio fuctio uder egative associatio. A atural (histogram) estimator of F k (r, s) = P (X 1 r, X k+1 s) with k fixed, is defied by F k (r, s) = 1 {1 (,r] (X i )1 (,s] (X k+i )}. (1) k The asymptotic behavior of this estimator was studied by [6], [7] ad [10]. For depedet sequeces, uder certai coditios (see [16], Theorem 17 ad the first remark of p. 137), the 1 Jabbarih@um.ac.ir 1

2 limit of the uiform empirical process still is a cetered Gaussia process, but the covariace fuctio chages to Γ k (r, s) = ϕ k (r, s) + ϕ k (r, s) + ϕ k (s, r), (2) where ϕ k (r, s) = F k (r, s) F (r)f (s). [6], [7] ad [10] drove a uiform strog covergece rate of 1/2 for two-dimesioal empirical distributio fuctio of (X 1, X k+1 ) ad covariace fuctio of the limit empirical process assumig a coveiet decrease rate of the covariace. [2] ad [8] cosidered the kerel estimator of F k, defied by ˆF k (r, s) = 1, s X k+i ). (3) k where U is a give bivariate distributio fuctio ad {, 1} is a sequece of positive umbers covergig to zero. They foud the optimal badwidth covergece rate of order 1. I this paper usig ˆF k i (3), we defie the kerel estimator of ϕ k (r, s) ad Γ(r, s) as ˆϕ k (r, s) = ˆF k (r, s) ˆF (r) ˆF (s), ˆΓ(r, s) = ˆϕk (r, s) + ( ˆϕ k (r, s) + ˆϕ k (s, r)) (4) ad derive a uiform covergece rate of order h 2 γ for the above estimators, where ˆF (r) = 1 ) ad 0 < γ < 1/2. For this covergece rate, we eed o coditio o the covariace structure of the variables. The above rate is flexible because of icludig the term which ca be optioally chose. This flexibility makes us able to have a rate that teds to zero (as is ecessary for a covergece rate) ad o the other had, ca be a better rate tha what was foud by [10] ad [8]. It is oted that the proofs are similar to those of [10] I all sectios of this paper pose that C is a positive costat ot depedig o. Also, we use the followig geeral assumptio throughout the article: (A). {X, 1} is a NA ad strictly statioary sequece of radom variables havig bouded desity fuctio ad for ay 1 i ad fixed r, s IR. ) E ) Ch 2 h, a.s. (5) Remark 1.1 It ca be easily checked that (5) holds for ay NA sequece of radom variables metioed i (A), because ) = Y2 Y1 u(t 1, t 2 )dt 1 dt 2, a.s. where Y 1 = r X i, Y 2 = s X i+k ad u is the probability desity fuctio associated to U. By lettig z 1 = r t 1 ad z 2 = s t 2 i the above itegral, we have ) = Xi+k Xi h 2 2 u( r z 1, s z 2 )h 2 h dz 1 dz 2 u( r z 1, s z 2 )dz 1 dz 2. a.s.

3 By further replacemets w 1 = r z 1 ad w 2 = s z 2, we obtai ) = O(h 2 h ). a.s. (6) O the other had for the expected value of U, we ca write E ) = )du(x i, x i+k ). By replacig v 1 = r X i ad v 2 = s X i+k, the above itegral is equal to E ) = h 2 U(v 1, v 2 )u(r v 1, s v 2 )h 2 dv 1 dv 2 u(r v 1, s v 2 )dv 1 dv 2 = O(1). (7) The iequality of (7) holds, sice 0 U(v 1, v 2 ) 1, v 1, v 2 IR ad the last equality holds after some more replacemets. Fially, (5) satisfies by cosiderig (6) ad (7) together. I Sectio 2, we will preset some auxiliary results eeded to establish the above metioed covergece rates. The momet iequality used for the proofs is preseted i this sectio. The strog uiform covergece rates are proved i Sectios 3 ad 4. I Sectio 5, we compare the histogram ad kerel estimators graphically usig a simulatio study ad the coclude the results. 2 Auxiliary results I this sectio, we used the followig momet iequality for NA radom variables ad proved a importat iequality that are eeded for provig our covergece rates. Lemma 2.1 ([13] ad [20]) Let (X 1, X 2,..., X ) be a NA radom vector with EX j = 0 ad EX j p < for some p 2 ad all j = 1,...,. The, there exists a costat C = C(p) > 0, such that E X j p C[ EX j p + ( EXj 2 ) p/2 ]. (8) j=1 j=1 j=1 Lemma 2.2 Let k IN 0 be fixed ad ε be a sequece of positive umbers. Suppose (A) is satisfied. The, there exists a costat C such that, for r, s IR ad p > 2, P ( ˆF k (r, s) F k (r, s) > ε ) Ch 2p ε p. (9) ( k) p/2 Proof. For eac IN, 1 i ad fixed r, s IR defie ad also Z k,i = ) F k (r, s), W k,i = Z k,i E(Z k,i ). 3

4 So, we have ˆF k (r, s) E( ˆF k (r, s)) = = 1 Z k,i + F k (r, s) E( k ˆF k (r, s)) 1 W k,i + 1 E(Z k,i ) + F k (r, s) E( k k ˆF k (r, s)). Regardig 1 E(Z k,i ) = E( ˆF k (r, s)) E(F k (r, s)), we will have ˆF k (r, s) E( ˆF k (r, s)) = 1 W k,i. k Sice (A) is hold, it is clear that W k, are decreasig fuctios of the variables X. So accordig to the properties of NA radom variables (see for more iformatio [12]), {W k,, 1} is NA ad strictly statioary. Also, W k, Ch 2 ad E(W k, ) = 0 the, EW k, p <, for each 1 ad p > 2 ad so we ca apply Lemma 2.1 to the sequece {W k,, 1}. Thus for all 1, we obtai Now for fixed r, s IR, we ca write E W k,i p C[ EW k,i p + ( EWk,i) 2 p/2 ] C p/2 h 2p. (10) P ( ˆF k (r, s) F k (r, s) > ε ) P ( ˆF k (r, s) E( ˆF k (r, s)) > ε 2 ) + P (F k (r, s) E( ˆF k (r, s)) > ε ). (11) 2 Sice 0 < F k (r, s), ˆF k (r, s) < 1 for fixed k IN 0 ad r, s IR, we coclude P (F k (r, s) E( ˆF k (r, s)) > ε ) 0 as +. Now regardig this, usig the Markov iequality ad from 2 (10) ad (11) we fid, for all > k, P ( ˆF k (r, s) F k (r, s) > ε ) 2 p ε p ( k) E p Ch 2p W k,i p ε p. (12) ( k) p/2 To prove the ext results, we should defie the followig otatios as itroduced i [10]. Let t be a sequece of positive itegers such that t +. For eac IN ad each i = 1,..., t, put x,i = Q(i/t ), where Q is the quatile fuctio of F. The for IN ad k IN 0, defie ad D,k = ˆF k (r, s) F k (r, s), D,k = max i,j=1,...,t ˆF k (x,i, x,j ) F k (x,i, x,j ). Furthermore, we will eed the followig result as i Theorem 2 of [6] ad Lemma 2.3 of [10]. Lemma 2.3 If the sequece {X, 1} satisfies (A), the, for eac IN ad each k IN 0, D,k D,k + 2 t a.s.. (13) 4

5 Lemma 2.4 Let ε ad t be two sequeces of positive umbers such that t + ad ε t +, p > 2 ad k IN 0 be fixed. Suppose (A) holds. The, for ay large eoug, P ( ˆF k (r, s) F k (r, s) > ε ) Ct 2 ε p h2p ( k) p/2. (14) Proof. Followig the same steps i Lemma 2.4 of [10] ad applyig Lemma 2.2 ad Lemma 2.3 the result is cocluded. 3 Uiform strog covergece rates of ˆF k I this sectio, we summarize the previous results to get uiform strog covergece rates of ˆF k. Lemma 3.1 Let k IN 0 be fixed ad pose (A) holds. The uder the coditios of Lemma 2.4 ad for every 0 < δ < p 1, we have Proof. Put t = 1 ε h Lemma 2.4 for ε = h 2p 2 2p 2 ˆF k (r, s) F k (r, s) = O(h p 2 2δ 2() ) a.s.. (15) ad let 0 < δ < p 2. Sice t 2 ad t ε whe, from p 2 2δ 2() ad large eough, we obtai P ( ˆF k (r, s) F k (r, s) > ε ) C ε h 2 2p ( C (1+δ). (16) k)p/2 The proof is complete usig the Borel-Catelli Lemma, because for all δ > 0, the sequece o the right-had side above beig summable. If p, ε h 2 1/2. Sice h 2 0 whe, the covergece rate of Lemma 3.1 remais reasoable for a large p. I the ext theorem, we summarize the results of this sectio. Theorem 3.1 Uder the assumptios of Lemma 3.1 ad for every 0 < γ < 1/2, we have ˆF k (r, s) F k (r, s) = O(h 2 γ ) a.s.. (17) Proof. Usig Lemma 3.1 ad alog the lies of Theorem 3.1 i [10], we get the desired result. Remark 3.1 Note that Theorem 4 of [8] holds true for ˆF k defied i (3) uder some regularity assumptios. So for all x, y IR, we have ( k)mse[ ˆF (x, y)] = F (x, y) F 2 (x, y) + 2 (F j (x, y, x, y) F 2 (x, y)) j=2 + O( + h 2 ) + a, where for each positive iteger j, F j is the distributio fuctio of (X 1, X k+1, X j, X k+j ) ad a = 1 ( k) (j 1)(F j (x, y, x, y) F 2 (x, y)) 2 (F j (x, y, x, y) F 2 (x, y)). j=2 j= 1 The, a optimal covergece rate of the MSE is achieved by choosig = C 1. 5

6 If k = 0 ad s = r the estimator ˆF k (r, s) becomes to the oe-dimetioal kerel distributio fuctio ˆF (r). The results of Theorem 3.1 hold true for ˆF. So, we ca write ˆF (r) F (r) = O(h 2 γ ) a.s.. (18) r IR Remark 3.2 From the results of Theorem 3.1, we uderstad that the covergece rate h 2 γ for every 0 < γ < 1/2 ad is very faster tha those obtaied later by [10] (i.e. γ ). So, the kerel estimator of two-dimesioal ad oe-dimetioal distributio fuctio F k ad F is better tha empirical oe, respectively. Now, we ca obtai the covergece rate of the kerel estimator of ϕ k. Theorem 3.2 Uder the assumptios of Theorem 3.1 ad for every 0 < γ < 1/2, we have ˆϕ k (r, s) ϕ k (r, s) = O(h 2 γ ) a.s.. (19) Proof. The proof is similar to that of Theorem 3.2 i [10] ad the we omit it. 4 Uiform strog covergece rates of ˆΓ As [10], we will itroduce uiform strog covergece rates for the kerel estimators of the sum ϕ k (r, s) ad the covariace fuctio Γ(r, s). Regardig that the covariace structure of a sequece of NA radom variables highly determies its approximate idepedece (see [16]), it is commo to have assumptios o the covariace structure of the radom variables. For this, we use the same defiitio of [10] as v() = j=+1 Cov(X 1, X j ) 1/3. (20) I the followig lemma, we prove the uiform strog covergece rate for the sum ˆϕ k (r, s) which is sufficiet to obtai the desired result for the kerel estimator of Γ. Lemma 4.1 Let (A) holds, θ > 0 ad pose that a = p 2 2δ p 2 +3p 0 < δ < p 2. If 2 for some p > 2 ad for each v(a ) Ch 4θ(p 1) (p 2)(p+3) a θ (21) for all 1, we have ˆϕ k (r, s) 2p 2 (p 2)(p 2 2δ) ϕ k (r, s) = O( 2p() ) a.s.. (22) Proof. The idea is essetially the same as the proof of Lemma 4.1 of [10]. So, we repeat their proof usig our required otatios ad defiitios. Take ε = h 2p 2 (p 2)(p 2 2δ) 2p() for each 0 < δ < p 2 2 ad t = a ε h. Now, we ca write P ( ( ˆF k (r, s) F k (r, s)) > ε ) P ( ˆF k (r, s) F k (r, s) > ε ). (23) a Sice 0 < δ < p 2 2p() t +, ε a t + ad a 2, (p 2)(p 2 2δ) > 0 ad 0 < p 2 2δ p 2 +3p 0 as +. 6 < 1, it is easy to see ε 0, a +,

7 Usig ε a i place of ε i Lemma 2.4, we obtai for all large eough, P ( ( ˆF k (r, s) F k (r, s)) > ε ) p 2 2δ 2p+4. Isertig this o the right- 0. So, we have by Borel-Catelli 2p 2 By elemetary calculatios, we may write ε = had side of (24) leads to summable upper boud as a Lemma Now, as [10], we ca write = p+3 a Ct 2 a p ε p h2p ( k) p/2 Ct 2 a p+1 ε p ( a ) ε Ca p+3 ( a ) h2p p/2 p/2 h2p 2. (24) ( ˆF 2p 2 (p 2)(p 2 2δ) k (r, s) F k (r, s)) = O( 2p() ) a.s.. (25) ˆϕ k (r, s) ϕ k (r, s) ( ˆF k (r, s) F k (r, s)) + 2a ˆF (r) F (r) r IR + ϕ k (r, s). (26) k=a +1 For the first term o the right-had side of (26), we use (25). Sice p+3 > 1 by usig Lemma 3.1 for the secod term, we have a r IR 2p 2 ˆF (r) F (r) = O(a h p 2 2δ 2p+4 ) 2p 2 (p 2)(p 2 2δ) = O( 2p() ) a.s.. (27) For the third term o the right-had side of (26), we use Corollary of Theorem 1 i [17] ad relatio (21) i [15] as those applied i [10]. So by (21) for θ = (p 2)(p+3) > 0 ad a 2p+4 = p 2 2δ p 2 +3p, we obtai ϕ k (r, s) C Cov 1/3 (X 1, X k+1 ) k=a +1 Hece the proof is completed. k=a +1 4(p 1)(p 2)(p+3) 2()(p 2)(p+3) = Cv(a ) Ch a (p 2)(p+3) 2() 2p 2 (p 2)(p 2 2δ) = C 2p(). (28) We ow summarize the above result i the followig theorem. Theorem 4.1 Uder the assumptios of Lemma 4.1 ad coditio (21) for all 1, θ > 0 ad 0 < γ < 1/2, we have a ˆϕ k (r, s) ϕ k (r, s) = O(h 2 γ ) a.s.. (29) Proof. As i proof of Theorem 4.1 of [10], we apply the lies of proof of Theorem 3.1 ad use Lemma 4.1 istead of Lemma 3.1. So, for δ > 0 ad p > 2 we have (p 2)(p 2 2δ) > γ ad the 2p() the proof is cocluded. 7

8 Now, applyig the lies of proof of Theorem 4.2 i [10] ad usig Theorems 3.1 ad 4.1, we ca state the followig theorem which summarizes the results for ˆΓ. Theorem 4.2 Suppose (A) holds. 0 < γ < 1/2, we have Uder coditio (21) for all 1, θ > 0, p > 2 ad ˆΓ(r, s) Γ(r, s) = O(h 2 γ ) a.s.. (30) Remark 4.1 As stated i Remark 3.2, our covergece rate h 2 γ for every 0 < γ < 1/2 ad i Theorem 4.2 is very faster tha those obtaied later by [10] (i.e. γ ). So, the kerel estimator of Γ is better tha empirical oe. 5 Simulatio study I this sectio, we ited to compare the behavior of our estimator with those of [10] via a simulatio study. As oted i [4], [5] ad [12] a umber of well kow multivariate distributios such as multivariate ormal distributio witegative correlatios possess the NA property. So for geeratig the NA radom variables, pose that X 1,..., X have multivariate ormal joit distributio with zero mea vector ad the followig covariace matrix 1 ρ ρ 2 ρ 1 Σ = 1 ρ 1 ρ ρ 2 1 ρ ρ 1 ρ 2 ρ 3 1 where ρ > 0. For = 20, 100, we geerate oe sample from -dimesioal multivariate ormal distributio with zero mea vector ad covariace matrix Σ assumig ρ = 0.1, The for k = 0, 1, 2, we compute the histogram estimator F k i (1) ad the kerel estimator ˆF k i (3) usig = 1 ad = log 1 () ad U(.,.) as bivariate ormal distributio with zero mea vector ad covariace matrix [ ] 1 1 ρ. (31) 1 ρ 2 ρ 1 Results for k = 0, 1, 2 ad differet values of, ρ ad are preseted i Figures 1-3, respectively. Also for simplicity of comparig, we compute the followig mea square distaces (MSDs) betwee F k (r, s) ad ˆF k (r, s) (or F k (r, s)) for all r, s: MSD 1 = 1 N MSD 2 = 1 N ( ˆF k (r, s) F k (r, s)) 2 r,s ( F k (r, s) F k (r, s)) 2 (32) r,s where N is the product of all umbers r ad s. The results are also reported i Figures 1-3. Figure 1 shows that for k = 0 (oe-dimesioal distributio fuctio): a) Whe is small ( = 20) ad large ( = 100), kerel estimator (gree) of F (r) is better tha histogram estimator (black) for all values of ρ ad badwidth rates. b) Whe becomes large, the kerel estimator has a good fit. c) Whe is small, the badwidth rates = log 1 () is better tha = 1. d) Whe is large, the badwidth rates = 1 ad = log 1 () have the same behaviors. e) Sice the kerel estimator is smooth, the best estimator of F (r) is the kerel estimator. 8

9 f) I all graphs, MSD of kerel estimator is less tha histogram estimator. g) I all cases, the histogram estimator has a over estimate. Figure 2 shows that for k = 1 (two-dimesioal distributio fuctio with lag oe): a) Whe is small ( = 20), we have over estimate for weak depedece (ρ = 0.1) ad = log 1 (). Also, this wrog fit holds true whe is small ( = 20), ρ = 0.1 ad = 1 for some values of r ad s (that is r, s [ 2, 4], approximately). b) MSD of kerel estimator is less tha histogram estimator for all cases. c) Whe is large ( = 100), the differece betwee kerel ad histogram estimators is very small. d) Whe is small ( = 20) or large ( = 100), the badwidth rate = 1 has a better role tha = log 1 () for estimatig F 1 (r, s) i weak (ρ = 0.1) depedece case ad i strog (ρ = 0.36) depedece case, the badwidth rate = log 1 () is almost better tha = 1 for estimatig F 1 (r, s). Figure 3 shows that for k = 2 (two-dimesioal distributio fuctio with lag two): a) Whe is small ( = 20) ad ρ = 0.1, we have over estimate for large values of r ad s (that is r, s [0, 4], approximately). b) MSD of kerel estimator is less tha histogram estimator for all cases. c) Whe is large ( = 100), the differece betwee kerel ad histogram estimators is very small. d) Whe is small ( = 20) or large ( = 100), the badwidth rate = log 1 () has a better role tha = 1 for estimatig F 2 (r, s), approximately. Refereces [1] Alam, K. ad Saxea, K.M.L. (1981). Positive depedece i multivariate distributio. Comm. Stat-Theor. Meth., A 10, [2] Azevedo, C. ad Oliveira, P.E. (2000). Kerel-type estimatio of bivariate distributio fuctio for associated radom variables. New Treds i Probability ad Statistics, [3] Dosker, M.D. (1951). A ivariace priciple for certai probability limit theorems. Mem. Amer. Math. Soc., 6, [4] Dubhashi, D., Priebe, V. ad Raja, D. (1996). Negative depedece through the FKG iequality. Basic Research i Computer Sciece, RS-96-27, [5] Ebrahimi, N. ad Ghosh, M. (1981). Multivariate egative depedece. Comm. Stat-Theor. Meth., 4, [6] Heriques, C. ad Oliveira, P.E. (2003). Estimatio of a two dimesioal distributio fuctio uder associatio. J. Statist. Plaig If., 113, [7] Heriques, C. ad Oliveira, P.E. (2005). Strog covergece rates for the estimatio of a covariace operator for associated samples. Preprit, Pre-Publicacoes do Departameto de Matematica da Uiversidade de Coimbra [8] Jabbari, H. (2009). Almost sure covergece of kerel bivariate distributio fuctio estimator uder egative associatio. Joural of Statistical Research of Ira, 6, [9] Jabbari, H. (2013). O almost sure covergece for weighted sums of pairwise egatively quadrat depedet radom variables. Stat. Papers, 54(3),

10 [10] Jabbari, H. ad Azaroosh, H.A. (2006). Almost sure covergece rates for the estimatio of a covariace operator for egatively associated samples. Joural of Iraia Statistical Society, 5(1 2), [11] Jabbari Nooghabi, H. ad Azaroosh, H.A. (2009). Expoetial iequality for egatively associated radom variables. Stat. Papers, 50(2), [12] Joag-Dev, K. ad Proscha, F. (1983). Negative associatio of radom variables, with applicatio. A. Stat., 11, [13] Matula, P. (1997). Probability ad momet bouds for sums of egatively associated radom variables. Theory Probab. Math. Stat., 55, [14] Miao, Yu. Zhao, F., Wag, K. ad Che, Y. (2013). Asymptotic ormality ad strog cosistecy of LS estimators i the EV regressio model with NA errors. Stat. Papers, 54(1), [15] Newma, C.M. (1980). Normal fluctuatios ad the FKG iequalities. Comm. Math. Phys., 74, [16] Newma, C. (1984). Asymptotic idepedece ad limit theorems for positively ad egatively depedet radom variables, i: Iequalities i Statistics ad Probability, Y.L. Tog, ed, IMS Lecture Notes- Moograph Series, 5, [17] Sadikova, S.M. (1966). Two-dimesioal aalogies of a iequality of Essee with applicatios to the cetral limit theorem. Theory Probab. Appl., 11, [18] Shao, Q.M. (2000). A compariso theorem o maximal iequality betwee egatively associated ad idepedet radom variables. J. Theor. Probab., 13, [19] Su, C. ad Chi, X. (1998). Some result o CLT for ostatioary NA sequeces. Acta. Math. Appl. Siica, 21, [20] Su, C., Zhao, L.C. ad Wag, Y.B. (1997). Momet iequalities ad weak covergece for egatively associated sequeces. Sciece i Chia (series A), 40, [21] Sug, S.H. (2011). O the strog covergece for weighted sums of radom variables. Stat. Papers, 52(2), [22] Yu, M., Zhao, F., Wag, K. ad Che, Y. (2013). Asymptotic ormality ad strog cosistecy of LS estimators i the EV regressio model with NA errors. Stat. Papers, 54(1), [23] Yua, M., Su, C. ad Hu, T. (2003). A cetral limit theorem for radom fields of egatively associated process. J. Theor. Probab., 16, [24] Zarei, H. ad Jabbari, H. (2011). Complete covergece of weighted sums uder egative depedece. Stat. Papers, 52(2), [25] Zhou, Y. (1996). A ote o the TJW product-limit estimator for trucated ad cesored data. Statist. Probab. Lett., 26,

A Note on the Kolmogorov-Feller Weak Law of Large Numbers

A Note on the Kolmogorov-Feller Weak Law of Large Numbers Joural of Mathematical Research with Applicatios Mar., 015, Vol. 35, No., pp. 3 8 DOI:10.3770/j.iss:095-651.015.0.013 Http://jmre.dlut.edu.c A Note o the Kolmogorov-Feller Weak Law of Large Numbers Yachu

More information

Precise Rates in Complete Moment Convergence for Negatively Associated Sequences

Precise Rates in Complete Moment Convergence for Negatively Associated Sequences Commuicatios of the Korea Statistical Society 29, Vol. 16, No. 5, 841 849 Precise Rates i Complete Momet Covergece for Negatively Associated Sequeces Dae-Hee Ryu 1,a a Departmet of Computer Sciece, ChugWoo

More information

Complete Convergence for Asymptotically Almost Negatively Associated Random Variables

Complete Convergence for Asymptotically Almost Negatively Associated Random Variables Applied Mathematical Scieces, Vol. 12, 2018, o. 30, 1441-1452 HIKARI Ltd, www.m-hikari.com https://doi.org/10.12988/ams.2018.810142 Complete Covergece for Asymptotically Almost Negatively Associated Radom

More information

Keywords: association, empirical process, histogram estimator, stationarity. AMS Classification: 62G20, 62G05, 62G30.

Keywords: association, empirical process, histogram estimator, stationarity. AMS Classification: 62G20, 62G05, 62G30. Covergece rates for the estimatio of two-dimesioal distributio fuctios uder associatio ad estimatio of the covariace of the limit empirical process Carla Heriques Escola Superior de Tecologia de Viseu

More information

Mi-Hwa Ko and Tae-Sung Kim

Mi-Hwa Ko and Tae-Sung Kim J. Korea Math. Soc. 42 2005), No. 5, pp. 949 957 ALMOST SURE CONVERGENCE FOR WEIGHTED SUMS OF NEGATIVELY ORTHANT DEPENDENT RANDOM VARIABLES Mi-Hwa Ko ad Tae-Sug Kim Abstract. For weighted sum of a sequece

More information

Convergence of random variables. (telegram style notes) P.J.C. Spreij

Convergence of random variables. (telegram style notes) P.J.C. Spreij Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space

More information

HAJEK-RENYI-TYPE INEQUALITY FOR SOME NONMONOTONIC FUNCTIONS OF ASSOCIATED RANDOM VARIABLES

HAJEK-RENYI-TYPE INEQUALITY FOR SOME NONMONOTONIC FUNCTIONS OF ASSOCIATED RANDOM VARIABLES HAJEK-RENYI-TYPE INEQUALITY FOR SOME NONMONOTONIC FUNCTIONS OF ASSOCIATED RANDOM VARIABLES ISHA DEWAN AND B. L. S. PRAKASA RAO Received 1 April 005; Revised 6 October 005; Accepted 11 December 005 Let

More information

Advanced Stochastic Processes.

Advanced Stochastic Processes. Advaced Stochastic Processes. David Gamarik LECTURE 2 Radom variables ad measurable fuctios. Strog Law of Large Numbers (SLLN). Scary stuff cotiued... Outlie of Lecture Radom variables ad measurable fuctios.

More information

Hyun-Chull Kim and Tae-Sung Kim

Hyun-Chull Kim and Tae-Sung Kim Commu. Korea Math. Soc. 20 2005), No. 3, pp. 531 538 A CENTRAL LIMIT THEOREM FOR GENERAL WEIGHTED SUM OF LNQD RANDOM VARIABLES AND ITS APPLICATION Hyu-Chull Kim ad Tae-Sug Kim Abstract. I this paper we

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak

More information

Review Article Complete Convergence for Negatively Dependent Sequences of Random Variables

Review Article Complete Convergence for Negatively Dependent Sequences of Random Variables Hidawi Publishig Corporatio Joural of Iequalities ad Applicatios Volume 010, Article ID 50793, 10 pages doi:10.1155/010/50793 Review Article Complete Covergece for Negatively Depedet Sequeces of Radom

More information

A central limit theorem for moving average process with negatively associated innovation

A central limit theorem for moving average process with negatively associated innovation Iteratioal Mathematical Forum, 1, 2006, o. 10, 495-502 A cetral limit theorem for movig average process with egatively associated iovatio MI-HWA KO Statistical Research Ceter for Complex Systems Seoul

More information

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i

More information

Random Variables, Sampling and Estimation

Random Variables, Sampling and Estimation Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig

More information

Lecture 19: Convergence

Lecture 19: Convergence Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may

More information

EXPONENTIAL RATES FOR KERNEL DENSITY ESTIMATION UNDER ASSOCIATION

EXPONENTIAL RATES FOR KERNEL DENSITY ESTIMATION UNDER ASSOCIATION EXPONENTIAL RATES FOR KERNEL DENSITY ESTIMATION UNDER ASSOCIATION CARLA HENRIQUES AND PAULO EDUARDO OLIVEIRA Abstract. The estimatio of desity based o positive depedet samples has bee studied recetly with

More information

Berry-Esseen bounds for self-normalized martingales

Berry-Esseen bounds for self-normalized martingales Berry-Essee bouds for self-ormalized martigales Xiequa Fa a, Qi-Ma Shao b a Ceter for Applied Mathematics, Tiaji Uiversity, Tiaji 30007, Chia b Departmet of Statistics, The Chiese Uiversity of Hog Kog,

More information

Sequences and Series of Functions

Sequences and Series of Functions Chapter 6 Sequeces ad Series of Fuctios 6.1. Covergece of a Sequece of Fuctios Poitwise Covergece. Defiitio 6.1. Let, for each N, fuctio f : A R be defied. If, for each x A, the sequece (f (x)) coverges

More information

An almost sure invariance principle for trimmed sums of random vectors

An almost sure invariance principle for trimmed sums of random vectors Proc. Idia Acad. Sci. Math. Sci. Vol. 20, No. 5, November 200, pp. 6 68. Idia Academy of Scieces A almost sure ivariace priciple for trimmed sums of radom vectors KE-ANG FU School of Statistics ad Mathematics,

More information

for all x ; ;x R. A ifiite sequece fx ; g is said to be ND if every fiite subset X ; ;X is ND. The coditios (.) ad (.3) are equivalet for =, but these

for all x ; ;x R. A ifiite sequece fx ; g is said to be ND if every fiite subset X ; ;X is ND. The coditios (.) ad (.3) are equivalet for =, but these sub-gaussia techiques i provig some strog it theorems Λ M. Amii A. Bozorgia Departmet of Mathematics, Faculty of Scieces Sista ad Baluchesta Uiversity, Zaheda, Ira Amii@hamoo.usb.ac.ir, Fax:054446565 Departmet

More information

The log-behavior of n p(n) and n p(n)/n

The log-behavior of n p(n) and n p(n)/n Ramauja J. 44 017, 81-99 The log-behavior of p ad p/ William Y.C. Che 1 ad Ke Y. Zheg 1 Ceter for Applied Mathematics Tiaji Uiversity Tiaji 0007, P. R. Chia Ceter for Combiatorics, LPMC Nakai Uivercity

More information

Self-normalized deviation inequalities with application to t-statistic

Self-normalized deviation inequalities with application to t-statistic Self-ormalized deviatio iequalities with applicatio to t-statistic Xiequa Fa Ceter for Applied Mathematics, Tiaji Uiversity, 30007 Tiaji, Chia Abstract Let ξ i i 1 be a sequece of idepedet ad symmetric

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

Asymptotic distribution of products of sums of independent random variables

Asymptotic distribution of products of sums of independent random variables Proc. Idia Acad. Sci. Math. Sci. Vol. 3, No., May 03, pp. 83 9. c Idia Academy of Scieces Asymptotic distributio of products of sums of idepedet radom variables YANLING WANG, SUXIA YAO ad HONGXIA DU ollege

More information

Infinite Sequences and Series

Infinite Sequences and Series Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet

More information

1 Convergence in Probability and the Weak Law of Large Numbers

1 Convergence in Probability and the Weak Law of Large Numbers 36-752 Advaced Probability Overview Sprig 2018 8. Covergece Cocepts: i Probability, i L p ad Almost Surely Istructor: Alessadro Rialdo Associated readig: Sec 2.4, 2.5, ad 4.11 of Ash ad Doléas-Dade; Sec

More information

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + 62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of

More information

Estimation of the essential supremum of a regression function

Estimation of the essential supremum of a regression function Estimatio of the essetial supremum of a regressio fuctio Michael ohler, Adam rzyżak 2, ad Harro Walk 3 Fachbereich Mathematik, Techische Uiversität Darmstadt, Schlossgartestr. 7, 64289 Darmstadt, Germay,

More information

MAXIMAL INEQUALITIES AND STRONG LAW OF LARGE NUMBERS FOR AANA SEQUENCES

MAXIMAL INEQUALITIES AND STRONG LAW OF LARGE NUMBERS FOR AANA SEQUENCES Commu Korea Math Soc 26 20, No, pp 5 6 DOI 0434/CKMS20265 MAXIMAL INEQUALITIES AND STRONG LAW OF LARGE NUMBERS FOR AANA SEQUENCES Wag Xueju, Hu Shuhe, Li Xiaoqi, ad Yag Wezhi Abstract Let {X, } be a sequece

More information

An Introduction to Randomized Algorithms

An Introduction to Randomized Algorithms A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis

More information

Kernel density estimator

Kernel density estimator Jauary, 07 NONPARAMETRIC ERNEL DENSITY ESTIMATION I this lecture, we discuss kerel estimatio of probability desity fuctios PDF Noparametric desity estimatio is oe of the cetral problems i statistics I

More information

This section is optional.

This section is optional. 4 Momet Geeratig Fuctios* This sectio is optioal. The momet geeratig fuctio g : R R of a radom variable X is defied as g(t) = E[e tx ]. Propositio 1. We have g () (0) = E[X ] for = 1, 2,... Proof. Therefore

More information

Central limit theorem and almost sure central limit theorem for the product of some partial sums

Central limit theorem and almost sure central limit theorem for the product of some partial sums Proc. Idia Acad. Sci. Math. Sci. Vol. 8, No. 2, May 2008, pp. 289 294. Prited i Idia Cetral it theorem ad almost sure cetral it theorem for the product of some partial sums YU MIAO College of Mathematics

More information

Sequences. Notation. Convergence of a Sequence

Sequences. Notation. Convergence of a Sequence Sequeces A sequece is essetially just a list. Defiitio (Sequece of Real Numbers). A sequece of real umbers is a fuctio Z (, ) R for some real umber. Do t let the descriptio of the domai cofuse you; it

More information

Research Article Moment Inequality for ϕ-mixing Sequences and Its Applications

Research Article Moment Inequality for ϕ-mixing Sequences and Its Applications Hidawi Publishig Corporatio Joural of Iequalities ad Applicatios Volume 2009, Article ID 379743, 2 pages doi:0.55/2009/379743 Research Article Momet Iequality for ϕ-mixig Sequeces ad Its Applicatios Wag

More information

Lecture 8: Convergence of transformations and law of large numbers

Lecture 8: Convergence of transformations and law of large numbers Lecture 8: Covergece of trasformatios ad law of large umbers Trasformatio ad covergece Trasformatio is a importat tool i statistics. If X coverges to X i some sese, we ofte eed to check whether g(x ) coverges

More information

MAT1026 Calculus II Basic Convergence Tests for Series

MAT1026 Calculus II Basic Convergence Tests for Series MAT026 Calculus II Basic Covergece Tests for Series Egi MERMUT 202.03.08 Dokuz Eylül Uiversity Faculty of Sciece Departmet of Mathematics İzmir/TURKEY Cotets Mootoe Covergece Theorem 2 2 Series of Real

More information

Distribution of Random Samples & Limit theorems

Distribution of Random Samples & Limit theorems STAT/MATH 395 A - PROBABILITY II UW Witer Quarter 2017 Néhémy Lim Distributio of Radom Samples & Limit theorems 1 Distributio of i.i.d. Samples Motivatig example. Assume that the goal of a study is to

More information

ON POINTWISE BINOMIAL APPROXIMATION

ON POINTWISE BINOMIAL APPROXIMATION Iteratioal Joural of Pure ad Applied Mathematics Volume 71 No. 1 2011, 57-66 ON POINTWISE BINOMIAL APPROXIMATION BY w-functions K. Teerapabolar 1, P. Wogkasem 2 Departmet of Mathematics Faculty of Sciece

More information

COMPLETE CONVERGENCE AND COMPLETE MOMENT CONVERGENCE FOR ARRAYS OF ROWWISE END RANDOM VARIABLES

COMPLETE CONVERGENCE AND COMPLETE MOMENT CONVERGENCE FOR ARRAYS OF ROWWISE END RANDOM VARIABLES GLASNIK MATEMATIČKI Vol. 4969)2014), 449 468 COMPLETE CONVERGENCE AND COMPLETE MOMENT CONVERGENCE FOR ARRAYS OF ROWWISE END RANDOM VARIABLES Yogfeg Wu, Mauel Ordóñez Cabrera ad Adrei Volodi Toglig Uiversity

More information

1 Introduction to reducing variance in Monte Carlo simulations

1 Introduction to reducing variance in Monte Carlo simulations Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by

More information

On the convergence rates of Gladyshev s Hurst index estimator

On the convergence rates of Gladyshev s Hurst index estimator Noliear Aalysis: Modellig ad Cotrol, 2010, Vol 15, No 4, 445 450 O the covergece rates of Gladyshev s Hurst idex estimator K Kubilius 1, D Melichov 2 1 Istitute of Mathematics ad Iformatics, Vilius Uiversity

More information

Research Article On the Strong Laws for Weighted Sums of ρ -Mixing Random Variables

Research Article On the Strong Laws for Weighted Sums of ρ -Mixing Random Variables Hidawi Publishig Corporatio Joural of Iequalities ad Applicatios Volume 2011, Article ID 157816, 8 pages doi:10.1155/2011/157816 Research Article O the Strog Laws for Weighted Sums of ρ -Mixig Radom Variables

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

STA Object Data Analysis - A List of Projects. January 18, 2018

STA Object Data Analysis - A List of Projects. January 18, 2018 STA 6557 Jauary 8, 208 Object Data Aalysis - A List of Projects. Schoeberg Mea glaucomatous shape chages of the Optic Nerve Head regio i aimal models 2. Aalysis of VW- Kedall ati-mea shapes with a applicatio

More information

Notes 19 : Martingale CLT

Notes 19 : Martingale CLT Notes 9 : Martigale CLT Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: [Bil95, Chapter 35], [Roc, Chapter 3]. Sice we have ot ecoutered weak covergece i some time, we first recall

More information

Entropy Rates and Asymptotic Equipartition

Entropy Rates and Asymptotic Equipartition Chapter 29 Etropy Rates ad Asymptotic Equipartitio Sectio 29. itroduces the etropy rate the asymptotic etropy per time-step of a stochastic process ad shows that it is well-defied; ad similarly for iformatio,

More information

Beurling Integers: Part 2

Beurling Integers: Part 2 Beurlig Itegers: Part 2 Isomorphisms Devi Platt July 11, 2015 1 Prime Factorizatio Sequeces I the last article we itroduced the Beurlig geeralized itegers, which ca be represeted as a sequece of real umbers

More information

ECE 901 Lecture 12: Complexity Regularization and the Squared Loss

ECE 901 Lecture 12: Complexity Regularization and the Squared Loss ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality

More information

Lecture 20: Multivariate convergence and the Central Limit Theorem

Lecture 20: Multivariate convergence and the Central Limit Theorem Lecture 20: Multivariate covergece ad the Cetral Limit Theorem Covergece i distributio for radom vectors Let Z,Z 1,Z 2,... be radom vectors o R k. If the cdf of Z is cotiuous, the we ca defie covergece

More information

BIRKHOFF ERGODIC THEOREM

BIRKHOFF ERGODIC THEOREM BIRKHOFF ERGODIC THEOREM Abstract. We will give a proof of the poitwise ergodic theorem, which was first proved by Birkhoff. May improvemets have bee made sice Birkhoff s orgial proof. The versio we give

More information

(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3

(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3 MATH 337 Sequeces Dr. Neal, WKU Let X be a metric space with distace fuctio d. We shall defie the geeral cocept of sequece ad limit i a metric space, the apply the results i particular to some special

More information

Notes 27 : Brownian motion: path properties

Notes 27 : Brownian motion: path properties Notes 27 : Browia motio: path properties Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces:[Dur10, Sectio 8.1], [MP10, Sectio 1.1, 1.2, 1.3]. Recall: DEF 27.1 (Covariace) Let X = (X

More information

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1 EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum

More information

A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS

A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS J. Japa Statist. Soc. Vol. 41 No. 1 2011 67 73 A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS Yoichi Nishiyama* We cosider k-sample ad chage poit problems for idepedet data i a

More information

Basis for simulation techniques

Basis for simulation techniques Basis for simulatio techiques M. Veeraraghava, March 7, 004 Estimatio is based o a collectio of experimetal outcomes, x, x,, x, where each experimetal outcome is a value of a radom variable. x i. Defiitios

More information

EE 4TM4: Digital Communications II Probability Theory

EE 4TM4: Digital Communications II Probability Theory 1 EE 4TM4: Digital Commuicatios II Probability Theory I. RANDOM VARIABLES A radom variable is a real-valued fuctio defied o the sample space. Example: Suppose that our experimet cosists of tossig two fair

More information

LECTURE 8: ASYMPTOTICS I

LECTURE 8: ASYMPTOTICS I LECTURE 8: ASYMPTOTICS I We are iterested i the properties of estimators as. Cosider a sequece of radom variables {, X 1}. N. M. Kiefer, Corell Uiversity, Ecoomics 60 1 Defiitio: (Weak covergece) A sequece

More information

ST5215: Advanced Statistical Theory

ST5215: Advanced Statistical Theory ST525: Advaced Statistical Theory Departmet of Statistics & Applied Probability Tuesday, September 7, 2 ST525: Advaced Statistical Theory Lecture : The law of large umbers The Law of Large Numbers The

More information

Random Matrices with Blocks of Intermediate Scale Strongly Correlated Band Matrices

Random Matrices with Blocks of Intermediate Scale Strongly Correlated Band Matrices Radom Matrices with Blocks of Itermediate Scale Strogly Correlated Bad Matrices Jiayi Tog Advisor: Dr. Todd Kemp May 30, 07 Departmet of Mathematics Uiversity of Califoria, Sa Diego Cotets Itroductio Notatio

More information

6.3 Testing Series With Positive Terms

6.3 Testing Series With Positive Terms 6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial

More information

17. Joint distributions of extreme order statistics Lehmann 5.1; Ferguson 15

17. Joint distributions of extreme order statistics Lehmann 5.1; Ferguson 15 17. Joit distributios of extreme order statistics Lehma 5.1; Ferguso 15 I Example 10., we derived the asymptotic distributio of the maximum from a radom sample from a uiform distributio. We did this usig

More information

ECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors

ECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors ECONOMETRIC THEORY MODULE XIII Lecture - 34 Asymptotic Theory ad Stochastic Regressors Dr. Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Asymptotic theory The asymptotic

More information

32 estimating the cumulative distribution function

32 estimating the cumulative distribution function 32 estimatig the cumulative distributio fuctio 4.6 types of cofidece itervals/bads Let F be a class of distributio fuctios F ad let θ be some quatity of iterest, such as the mea of F or the whole fuctio

More information

Lesson 10: Limits and Continuity

Lesson 10: Limits and Continuity www.scimsacademy.com Lesso 10: Limits ad Cotiuity SCIMS Academy 1 Limit of a fuctio The cocept of limit of a fuctio is cetral to all other cocepts i calculus (like cotiuity, derivative, defiite itegrals

More information

Sieve Estimators: Consistency and Rates of Convergence

Sieve Estimators: Consistency and Rates of Convergence EECS 598: Statistical Learig Theory, Witer 2014 Topic 6 Sieve Estimators: Cosistecy ad Rates of Covergece Lecturer: Clayto Scott Scribe: Julia Katz-Samuels, Brado Oselio, Pi-Yu Che Disclaimer: These otes

More information

Econ 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1.

Econ 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1. Eco 325/327 Notes o Sample Mea, Sample Proportio, Cetral Limit Theorem, Chi-square Distributio, Studet s t distributio 1 Sample Mea By Hiro Kasahara We cosider a radom sample from a populatio. Defiitio

More information

Notes 5 : More on the a.s. convergence of sums

Notes 5 : More on the a.s. convergence of sums Notes 5 : More o the a.s. covergece of sums Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: Dur0, Sectios.5; Wil9, Sectio 4.7, Shi96, Sectio IV.4, Dur0, Sectio.. Radom series. Three-series

More information

4. Partial Sums and the Central Limit Theorem

4. Partial Sums and the Central Limit Theorem 1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems

More information

If a subset E of R contains no open interval, is it of zero measure? For instance, is the set of irrationals in [0, 1] is of measure zero?

If a subset E of R contains no open interval, is it of zero measure? For instance, is the set of irrationals in [0, 1] is of measure zero? 2 Lebesgue Measure I Chapter 1 we defied the cocept of a set of measure zero, ad we have observed that every coutable set is of measure zero. Here are some atural questios: If a subset E of R cotais a

More information

MOMENT-METHOD ESTIMATION BASED ON CENSORED SAMPLE

MOMENT-METHOD ESTIMATION BASED ON CENSORED SAMPLE Vol. 8 o. Joural of Systems Sciece ad Complexity Apr., 5 MOMET-METHOD ESTIMATIO BASED O CESORED SAMPLE I Zhogxi Departmet of Mathematics, East Chia Uiversity of Sciece ad Techology, Shaghai 37, Chia. Email:

More information

Comparison Study of Series Approximation. and Convergence between Chebyshev. and Legendre Series

Comparison Study of Series Approximation. and Convergence between Chebyshev. and Legendre Series Applied Mathematical Scieces, Vol. 7, 03, o. 6, 3-337 HIKARI Ltd, www.m-hikari.com http://d.doi.org/0.988/ams.03.3430 Compariso Study of Series Approimatio ad Covergece betwee Chebyshev ad Legedre Series

More information

Dimension-free PAC-Bayesian bounds for the estimation of the mean of a random vector

Dimension-free PAC-Bayesian bounds for the estimation of the mean of a random vector Dimesio-free PAC-Bayesia bouds for the estimatio of the mea of a radom vector Olivier Catoi CREST CNRS UMR 9194 Uiversité Paris Saclay olivier.catoi@esae.fr Ilaria Giulii Laboratoire de Probabilités et

More information

HÖLDER SUMMABILITY METHOD OF FUZZY NUMBERS AND A TAUBERIAN THEOREM

HÖLDER SUMMABILITY METHOD OF FUZZY NUMBERS AND A TAUBERIAN THEOREM Iraia Joural of Fuzzy Systems Vol., No. 4, (204 pp. 87-93 87 HÖLDER SUMMABILITY METHOD OF FUZZY NUMBERS AND A TAUBERIAN THEOREM İ. C. ANAK Abstract. I this paper we establish a Tauberia coditio uder which

More information

Journal of Multivariate Analysis. Superefficient estimation of the marginals by exploiting knowledge on the copula

Journal of Multivariate Analysis. Superefficient estimation of the marginals by exploiting knowledge on the copula Joural of Multivariate Aalysis 102 (2011) 1315 1319 Cotets lists available at ScieceDirect Joural of Multivariate Aalysis joural homepage: www.elsevier.com/locate/jmva Superefficiet estimatio of the margials

More information

Detailed proofs of Propositions 3.1 and 3.2

Detailed proofs of Propositions 3.1 and 3.2 Detailed proofs of Propositios 3. ad 3. Proof of Propositio 3. NB: itegratio sets are geerally omitted for itegrals defied over a uit hypercube [0, s with ay s d. We first give four lemmas. The proof of

More information

Statistical Analysis on Uncertainty for Autocorrelated Measurements and its Applications to Key Comparisons

Statistical Analysis on Uncertainty for Autocorrelated Measurements and its Applications to Key Comparisons Statistical Aalysis o Ucertaity for Autocorrelated Measuremets ad its Applicatios to Key Comparisos Nie Fa Zhag Natioal Istitute of Stadards ad Techology Gaithersburg, MD 0899, USA Outlies. Itroductio.

More information

Diagonal approximations by martingales

Diagonal approximations by martingales Alea 7, 257 276 200 Diagoal approximatios by martigales Jaa Klicarová ad Dalibor Volý Faculty of Ecoomics, Uiversity of South Bohemia, Studetsa 3, 370 05, Cese Budejovice, Czech Republic E-mail address:

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 Fuctioal Law of Large Numbers. Costructio of the Wieer Measure Cotet. 1. Additioal techical results o weak covergece

More information

Bull. Korean Math. Soc. 36 (1999), No. 3, pp. 451{457 THE STRONG CONSISTENCY OF NONLINEAR REGRESSION QUANTILES ESTIMATORS Seung Hoe Choi and Hae Kyung

Bull. Korean Math. Soc. 36 (1999), No. 3, pp. 451{457 THE STRONG CONSISTENCY OF NONLINEAR REGRESSION QUANTILES ESTIMATORS Seung Hoe Choi and Hae Kyung Bull. Korea Math. Soc. 36 (999), No. 3, pp. 45{457 THE STRONG CONSISTENCY OF NONLINEAR REGRESSION QUANTILES ESTIMATORS Abstract. This paper provides suciet coditios which esure the strog cosistecy of regressio

More information

It is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function.

It is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function. MATH 532 Measurable Fuctios Dr. Neal, WKU Throughout, let ( X, F, µ) be a measure space ad let (!, F, P ) deote the special case of a probability space. We shall ow begi to study real-valued fuctios defied

More information

Expectation and Variance of a random variable

Expectation and Variance of a random variable Chapter 11 Expectatio ad Variace of a radom variable The aim of this lecture is to defie ad itroduce mathematical Expectatio ad variace of a fuctio of discrete & cotiuous radom variables ad the distributio

More information

Lecture 7: Density Estimation: k-nearest Neighbor and Basis Approach

Lecture 7: Density Estimation: k-nearest Neighbor and Basis Approach STAT 425: Itroductio to Noparametric Statistics Witer 28 Lecture 7: Desity Estimatio: k-nearest Neighbor ad Basis Approach Istructor: Ye-Chi Che Referece: Sectio 8.4 of All of Noparametric Statistics.

More information

Math 2784 (or 2794W) University of Connecticut

Math 2784 (or 2794W) University of Connecticut ORDERS OF GROWTH PAT SMITH Math 2784 (or 2794W) Uiversity of Coecticut Date: Mar. 2, 22. ORDERS OF GROWTH. Itroductio Gaiig a ituitive feel for the relative growth of fuctios is importat if you really

More information

INFINITE SEQUENCES AND SERIES

INFINITE SEQUENCES AND SERIES 11 INFINITE SEQUENCES AND SERIES INFINITE SEQUENCES AND SERIES 11.4 The Compariso Tests I this sectio, we will lear: How to fid the value of a series by comparig it with a kow series. COMPARISON TESTS

More information

CEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering

CEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio

More information

Lecture 2. The Lovász Local Lemma

Lecture 2. The Lovász Local Lemma Staford Uiversity Sprig 208 Math 233A: No-costructive methods i combiatorics Istructor: Ja Vodrák Lecture date: Jauary 0, 208 Origial scribe: Apoorva Khare Lecture 2. The Lovász Local Lemma 2. Itroductio

More information

Chapter 6 Infinite Series

Chapter 6 Infinite Series Chapter 6 Ifiite Series I the previous chapter we cosidered itegrals which were improper i the sese that the iterval of itegratio was ubouded. I this chapter we are goig to discuss a topic which is somewhat

More information

sin(n) + 2 cos(2n) n 3/2 3 sin(n) 2cos(2n) n 3/2 a n =

sin(n) + 2 cos(2n) n 3/2 3 sin(n) 2cos(2n) n 3/2 a n = 60. Ratio ad root tests 60.1. Absolutely coverget series. Defiitio 13. (Absolute covergece) A series a is called absolutely coverget if the series of absolute values a is coverget. The absolute covergece

More information

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n. Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator

More information

Best bounds for dispersion of ratio block sequences for certain subsets of integers

Best bounds for dispersion of ratio block sequences for certain subsets of integers Aales Mathematicae et Iformaticae 49 (08 pp. 55 60 doi: 0.33039/ami.08.05.006 http://ami.ui-eszterhazy.hu Best bouds for dispersio of ratio block sequeces for certai subsets of itegers József Bukor Peter

More information

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f. Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,

More information

NEW FAST CONVERGENT SEQUENCES OF EULER-MASCHERONI TYPE

NEW FAST CONVERGENT SEQUENCES OF EULER-MASCHERONI TYPE UPB Sci Bull, Series A, Vol 79, Iss, 207 ISSN 22-7027 NEW FAST CONVERGENT SEQUENCES OF EULER-MASCHERONI TYPE Gabriel Bercu We itroduce two ew sequeces of Euler-Mascheroi type which have fast covergece

More information

Product measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014.

Product measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014. Product measures, Toelli s ad Fubii s theorems For use i MAT3400/4400, autum 2014 Nadia S. Larse Versio of 13 October 2014. 1. Costructio of the product measure The purpose of these otes is to preset the

More information

1 = δ2 (0, ), Y Y n nδ. , T n = Y Y n n. ( U n,k + X ) ( f U n,k + Y ) n 2n f U n,k + θ Y ) 2 E X1 2 X1

1 = δ2 (0, ), Y Y n nδ. , T n = Y Y n n. ( U n,k + X ) ( f U n,k + Y ) n 2n f U n,k + θ Y ) 2 E X1 2 X1 8. The cetral limit theorems 8.1. The cetral limit theorem for i.i.d. sequeces. ecall that C ( is N -separatig. Theorem 8.1. Let X 1, X,... be i.i.d. radom variables with EX 1 = ad EX 1 = σ (,. Suppose

More information

10.6 ALTERNATING SERIES

10.6 ALTERNATING SERIES 0.6 Alteratig Series Cotemporary Calculus 0.6 ALTERNATING SERIES I the last two sectios we cosidered tests for the covergece of series whose terms were all positive. I this sectio we examie series whose

More information

Introducing a Novel Bivariate Generalized Skew-Symmetric Normal Distribution

Introducing a Novel Bivariate Generalized Skew-Symmetric Normal Distribution Joural of mathematics ad computer Sciece 7 (03) 66-7 Article history: Received April 03 Accepted May 03 Available olie Jue 03 Itroducig a Novel Bivariate Geeralized Skew-Symmetric Normal Distributio Behrouz

More information

Lecture 33: Bootstrap

Lecture 33: Bootstrap Lecture 33: ootstrap Motivatio To evaluate ad compare differet estimators, we eed cosistet estimators of variaces or asymptotic variaces of estimators. This is also importat for hypothesis testig ad cofidece

More information

Stochastic Simulation

Stochastic Simulation Stochastic Simulatio 1 Itroductio Readig Assigmet: Read Chapter 1 of text. We shall itroduce may of the key issues to be discussed i this course via a couple of model problems. Model Problem 1 (Jackso

More information

Surveying the Variance Reduction Methods

Surveying the Variance Reduction Methods Iteratioal Research Joural of Applied ad Basic Scieces 2013 Available olie at www.irjabs.com ISSN 2251-838X / Vol, 7 (7): 427-432 Sciece Explorer Publicatios Surveyig the Variace Reductio Methods Arash

More information