Department of Biostatistics University of North Carolina at Chapel Bill. Institute of Statistics- Mimeo Series No

Size: px
Start display at page:

Download "Department of Biostatistics University of North Carolina at Chapel Bill. Institute of Statistics- Mimeo Series No"

Transcription

1 ON SEQUENTIAL NONPARAMETRIC ESTIMATION OF MULTIVARIATE LQCATION by Praab Kumar Se Departmet of Biostatistis Uiversity of North Carolia at Chapel Bill Istitute of Statistis- Mimeo Series No Otober 1983

2 ON SEQUENTIAL NONPAR~mTRIC ESTI~~TION OF MULTIVARIATE LOCATION Praab Kumar Se Departmet of Biostatistis Uiversity of North Carolia Chapel Hill. NC USA.e For the multivariate oe-sample loatio model (relatig to a diagoally symmetri distributio). sequetial oparametri (poit as well as iterval) estimators based o appropriate rak statistis are osidered ad their asymptoti properties studied. I this otext. asymptoti risk-effiiey of the proposed estimators ad asymptoti ormality of the assoiated stoppig times are established. These results rest o momet-overgee of the permutatio dispersio matrix to its populatio outerpart; these are studied as well. A brief review of some other robust proedures is made alog with. INTRODUCTION Let {~i;i>l} be a sequee of idepedet ad idetially distributed (i.i.d.) radom vetors (r.v.) with a otiuous distributio futio (d.f.) defied o E P for some p~l. where eee E P. It is assumed that F(.;~). F(x-e). xee P (1) where the P margial d.f.s of F. deoted by F[l].. F[p]. respetively. are all symmetri about 0; i fat. F is assumed to be diagoally symmetri about the or~gl. Thus. e = (el... e)' is the vetor of loatio parameters. ad we - p are iterested i the estimatio of e. Based o a sample (~l"" '~) of size. let! (T l.. T p ), be a estimator of e. The loss iurred due to estimatig e by! is deoted by L(.;!'~) = p(!'~) +. (>O) (2) where p: E P x E P... [0."') is a suitable metri ad is the ost of samplig. per uit observatio. Some ommoly adapted forms of p(.) are the followig: p(~.~) max{laj-bjl: l~j~jl} (~~X-orm) p(~.~) -1 P I I (MAD-orm) p Lj=l aj-b j p(~.~) (!-~) 'g(~-~) (QUAD-orm) (3)

3 where 9 is some give positive semi-defiite (p.s.d.) matrix. Correspodig to (2), the risk i estimatig ~ by! is give by AF(,;~) '" EL(,;!'~) '" EP(!'~) + (4) Note that the risk i (4) depeds o F through the distributio of! ad the metri p(.). If T is traslatio-ivariat (as will be the ase i our subsequet aalysis), the 0(F) '" EP(!'~) ad AF(,) '" AF(,;~) do ot deped o e. Suppose ow that there exists a positive iteger O' suh that 0(F) exists for every ~O ad 0(F)~O as ~. For every C>O, we may defie the (5) The, T 0 is the miimum risk estimator (MRE) of ~. Note that 0(F) geerally - depeds o F (through some other futioals of F), so that whe F is ot ompletely speified (as is the ase i pratie), o sigle O may lead to the MRE simultaeously for all F F, a lass of d.f.'s. However, suitable sequetial proedures may be iorporated to ahieve this goal i a asymptoti setup where is made to overge to O. Towards this, we assume that for some q(>o), as ireases, qo (F)... o(f): O<o(F)<oo (6) ad, further, there exists a sequee {d } of osistet estimators of o(f). [For the first two ases i (3), q is typially equal to ~, while for the last oe, it is equal to 1.] Note that for C~O, (4) may be rewritte as so that asymptotially, as C~O, we have o (8) (7) e, (9) Motivated by (8) ad the stohasti overgee of {d } (to o(f)), for every (>O), we may defie a stoppig variable N '" if{~o: l+q~-lq(d+-h)} (0) where h(>o) is a suitable ostat, to be hose later o. Based o the stoppig rule N ' TN of e, defied for every - We say that we osider the (sequetial) poit estimator >O, Ap(C) '" EP(!N'~) + EN ' is a asymptotially ~IRE of e, ad we deote the orrespodig risk by if >O (11) (12)

4 I the literature, this is referred to as the (first order) asymptoti riskeffiiey (A.R.E.) property. followig results: as ~O, where Besides this A.R.E., we shall also study the Nio... 1, i the first mea, (13) o ~ ( ) (TN -e) - N(O,r) (14) - - r - = lim ->-oo E{(T - -e)(t _ -- _el'} (IS) [! is also the dispersio matrix of the asymptoti multi-ormal d.f. of ~(T -8).] - _ - Uder some additioal regularity oditios, we will also have the asymptoti ormality of the stoppig time i.e., o -~ 0 2 ( ) (N- ) - N(O,y ), as do (16) where y(o<y<oo) is a suitable ostat (depedig o q ad F). The seod problem is to provide a ofidee set size, suh that I (E P ), based o a sample of p(e I Ie) > l-a(o<a<l) - _ - (17) maximum diameter of I ~ 2d(d>0) (18) where a ad d are preassiged. For this problem too, fixed sample size proedures may ot work out (for all F F), ad hee, oe may take reourse a sequetial sheme [viz., Chapter 10 of Se (1981)], where (17)-(18) hold i a asymptoti setup: d~o. Asymptoti properties of the stoppig times are studied here. I this paper, we speifially osider the ase of R-estimators of loatio; some geeral remarks pertaiig to some other robust (viz., ~I- loatio are made i the oludig setio. Asymptoti properties of these multivariate R-estimators are studied i Setio 2. ad L-) estimators of Setio 3 otais some asymptoti results o the permutatio dispersio matrix whih are eeded i Setio 4 i the derivatio of the asymptoti results i (12, (13), (14) ad (16). Setio 5 deals with the ofidee set problem. multivariate ase (i.e., p~2). detail i Chapter 10 of Se (1981) ad Jure~kova Throughout the paper, we osider the geuie The uivariate ase has already bee studied i ad Se (1982), amog other plaes. The last setio deals with some other robust estimators of e (e.g., M- ad L estimators), ad oly the geeral setup is disussed. MULTIVARIATE R-ESTI~~TORS: ASYMPTOTIC PROPERTIES For eah j (= 1,...,p), let epj = {epj (u),o<u<l} be a o-dereasig, o-ostat, skew-symmetri ad square-itegrable sore-futio, ad let ep. = {ep.(u) = ep~((i+u)/2),0<u<i}, l_<j< J J J -..J (19)

5 For a sample ~i = (X il,... '\p)l, l~i~, of size, we the itrodue a set of ~ by lettig a. (i) = E. (U.) or. (i/(+l)), l~i~; j = 1,...,p (20) J J l J where Ul<",<U are the ordered r.v.'s of a sample of size from the uiform (0,1) d.f. Further, for every real b, let R~ij(b) be the rak of IXij-bl amog IXlj-bl...,IXj-bl. for i= l,..., ad j = l,...,p. Let ~(~) = (S l(b ),...,S (b ))1 be defied by l p p Sj (b j ) = Ei=lsg(Xij-b.)aj (R~ij (b j )), 1.9.3' Note that for eah j (= 1,...,p), Sj(b) is \ i b, ad Sj(6 j ) has a distributio symmetri about O. Let the a j = ~(sup{b: (22) S.(b»O} + if{b: J S. (b)<o}) J for 1,2,...,p, ad let e = - ( 1'"'' p ), (23) The ~ is a traslatio-ivariat, media-ubiased, robust ad osistet esti- - mator of 6 [viz., Chapter 6 of Puri ad Se (1971)]. Let B = Diag(B,...,B l p ) be defied by lettig Further, let v = be defied by lettig for j,j' = l,,p, where F[jjl] is the bivariate d.f. of for j 'I j I 1,,po Note that the v.. do ot deped o JJ are depedet o F through the joit d.f. F[jjl]' j 'I j'. E= ((Y jj,)) = B-lVB- l = ((Vjjl/BjBjl)) The, uder quite geeral oditios [f. Puri ad Se (1971, Ch. --, (21) (24) (25) (Xij-6j,Xijl-6jl), F, but V j j I' j 'I j', Fially, let (26) 6)], we have for Note that the asymptoti ormality i (27) does ot eessarily esure (15). however, for some a>o (ot eessarily >1), Ellx.lla<oo, the, it follows from - -~ Theorem 2.1 of Se (1980b) that there exists a positive iteger (depedig o 2 a a), suh that EII ~ -611 < 00, 'If >. - a For our purpose, we assume that for every j (= 1,...,p), for some 0 (O~O<\) ad K (O<K<oo), I (d r /du r ) j(u) I -o-r ~ K(l-u),O<u<l; r = 0,1,2, ad F[j] has a absolutely otiuous desity futio f[j] (with a first derivative- fij] bouded almost everywhere), suh that (27) If, (28)

6 for 1... p. We write d = (4+2T)-1. T>O. The. by a diret multivariate extesio of Theorem 2.2 of Se (1980b), we may olude that for every (29) k < 2(1+T), lime{k/21is-ellk}<... Note that throughout the paper stads for the maxorm. The (15) holds uder (28)-(29). Atually. the followig represetatio [a oordiatewise extesio of (2.49) of Se (1980b)] is the key to the above results: (~ -e) B-ls (e) + ~ (30) _ - where. uder (28)-(29). as ~. -~I I~ II + 0 a.s. as well as i the kth mea. _ for every k < 2(1+T). Further. {S _ (8).>1} _ - is a martigale sequee [see Se ad Ghosh (1971)]. so that {lis (8)-5 (8) II: m>} is a sub-martigale. Hee -m - -usig the Kolmogorov maximal-iequality alog with the fat that for every m~. E(~m(~)-~(~))(~m(~)-~(~))'= (m-)~' where ~~ as ~. we obtai by some stadard steps that for every >0 ad >O. there exist a * ad a *(>0). suh that for every ~*. (31) (32) Cosequetly. by usig (30). (31) ad (32). we obtai that p{ I maxi <~* ~li~ -~ II > 1 < m: m- ~ _m - (33) for every ~**. r.v. 'so suh that Clearly. if {N} be ay sequee of positive iteger valued -IN +1. i probability. as ~. the by (27) ad (33), as (34) Defiig B as i (24). we let w = sup{-~ii~(~)-~(~)+~~ii: 11 II<-~lOg}. (35) The. as a diret multivariate geeralizatio of (2.37) of Se (1980b). we obtai that for 0 ~ (4+2T) -1. T>O. there exist two positive ostats l. 2 ad a iteger ~. suh that - p{w> 1(10g)I~=~}~2-l-T, ~~~ (36) This last result yields suitable estimates of B alog with their rates of overgee. Note that uder 8. = 0, 5.(0) has a ompletely speified distribu- ) ) tio, symmetri about O. ad hee. for every a(o<a<l) ad, there exists a C(j), suh that p{i.s~ (O}1 > (j)le.=o} > a > p{ls.(0)1 > (j)}. for j =,a. -,a) - ),a '1,...,p, where -~C() + T /2V'" 1<j 3'. T /2 beig the upper 50a% poit of the.a a )) - A') a (") A(") stadard ormal distributio. Let the 8E) = sup{b: s. (b»c ) }. 8 u ). ("), ).a. if{b: S. (b)<-c )} ad Jet ).a

7 B. = 2C(j) /((S(j)-S(j))} j = l... p (37) J.a U. L. The. ~ = Diag(Bl..Bp) is a traslatio-ivariat. robust ad osistet estimator of B. By (36). (37) ad some stadard maipulatios. we obtai that for - -1 every >0 ad 6 ~ (4+2t) t>o. there exist a ostat C (O<<oo) ad a iteger O' suh that for every ~O' PC! IB -BII >d < - l - t - _ - Some other properties of B are studied i the ext setio. _ RANK BASED ESTIMATORS OF r: ASYMPTOTIC PROPERTIES I (20), we replae the ~j by ~j ad deote the resultig sores by.a;j(i), l<i<. l<j<. Let the R.. be the rak of X.. amog X lj.... 'X J " for i = J 1J 1) l... ad j = 1... p. Defie ~ = ((v jj,)) by lettig The _ V is a traslatio-ivariat, robust ad osistet estimator of v, deby (37), we fied by (25) [See Puri ad Se (1971, Ch. 5)]. Defiig the B. J let the (38) E = ~~l~b~l ((Y jj,)) = ((Vjj,/BjBj')) (40) To study the asymptoti properties of r. osider first a asymptoti represe- - tatio for Y. By (28)-(29) ad Theorem of Se (1981), we obtai that for 6 < (4+2t)-1. t>o. where the W. are i.i.d. radom matries with EW V k [0.2+t), ad further II ~* II = O( -~-) _ a.s., as Atually, by the same proof it follows that for every l ad a iteger O' suh that for every ~O' = V ad Ell W. Ilk < 00, _1 ~, for some >O. (39) (41) >0, there exist a fiite PC! I~*II >d > - l - t /2 _ - 1 Also, for the i.i.d. radom matries {Wi}' by the Markov iequality, -1 II} -k II -1 Ilk -1-T/2 P{II I:i=l~i-~ > ~ E I:i=l~i-~ ~ 2 ( ) ; 2 ( )<00 (42). (43) As suh, from (38), (40), (41). (42) ad (43), we obtai that for adequately large, for every >0, p{llr -rll >d - _ C <00 3 Let us ow write _ U =. ~(V_ -v) _ ad Y _ = ~(B-l_B-l). The, by (41) ad the lassial etral limit theorem (o the W.), _1 ~ - N(~'~l) as ~ '(44) (45)

8 where ~l is the disper~io matrix of the ~i' The asymptoti ormality results o y demads some extra regularity oditios. We assume that i (28) I(d /du )!jl.(u)1 <K(l-u).O<u<l (where K<oo) ad i (29). we assume that for J - every >O. there exists a e>o. suh that 00 (46) for every j = 1... p. The. we may use the seod order liearity results of v -1 Huskova (1982). as adapted to the oe-sample ase, ad o1ude that for B a ~ represetatio similar to that i (41) holds. where the remaider term is o( ) a.s., as ~. This represetatio esures both the asymptoti multiormality of \B-l_B- l ) ad the "uiform otiuity i probability" of the \B-l_B- l ). ~ - ~ - Hee. uder these additioal regularity oditios. ~(~~l_~-l) - N(~'~2) (47) for some p s d Writig B- 1 = B ~Y ad V = \I + -~u. we obtai o. " _2' - _ usig (40). (45) ad (47) that uder the regularity oditios metioed above ~(r -r) = 2Y \lb- 1 + B-lU B (-~) - N(O.*) ; * p.s.d. (48) _ -- _p - Also, the asymptoti "uiform otiuity i probability" result: p{ max ~II r r II > } < m: Im-l ~e' _m-- e. follows from the above results. so that (48) exteds of iteger valued radom variables. where -IN +1. as well to a sequee i probability, as {N} ASYMPTOTIC PROPERTIES OF N AND an _ The asymptoti ormality of the R-estimator has already bee osidered i (27). Also. after (29). the momet-overgee result i (IS) has bee studied. ~. (49) I the sequetial ase, the study of (11), (12). (13), (14) ad (16) depeds o the form of the metri p(.) i (2); we assume that the followig holds: (a) For 0 = Ep(~.6). (6) holds with o(f) depedig o F oly through - - r (whih is a futioal of F). i.e., o(f) = o([), ad further, o([) satisfies the (Lipshitz-type) oditio that 10 ([1)-0([2) I ~ Koll[1-r211. V r l E2 (SO) where K is idepedet of the r. ad is the max-orm. 0 -J (b) With q defied as i (6), there exists a fiite. positive that wheever the expetatios exist. Kl suh E{P(~.~)}r ~ KlEII~-~112rq. (r,::l). (51).Note that (50)-(51) hold for eah of the three Metris i (3). Also. ote that i (9). we take d = o(r). The Lipshitz-type oditio (SO) alog with (44) esure. - that for adequately large, for ever~ e>o.

9 (52) Now, by virtue of (44) ad (52), we may virtually repeat the proof of the first part of Theorem 3.1 of Se (1980b) ad olude that (13) holds. Further, (13) ad (34) esure (14). To establish the A.R.E. property i (12), we require to establish some uiform itegrability properties, ad, for these, we eed to put some restrai o h i (10) ad 6 i (28). We let 6 < (4+2T)-1, T > 1 + 2h, h>o (53) so that 6<1/6. Note that by (13), ad (11), it suffies to show that lim '''OEN / o = 1. Hee, by virtue of (4) CT (54) or equivaletly, (55) By virtue of Theorem 2.2 of Se (l980b), wheever, for some a>o, EI'I~lla<oo, uder (28), (29) ad (53), Therefore, by (51) ad (56), lim E{(~ll~-~II)k} < 00, 'if k < 2(1+T) (56) lim {kqe(p(s,e))k} < 00, 'if k < l+t (57) - - With this, we may agai follow the lie of attak of the proof of Theorem 3.2 of Se (1980b), employig the Holder iequality for the two tails ad the uiform itegrability of 115 (e)ll k (k<2 +T)) for the etral part. For iteded brevity, - _ the details are therefore omitted. Fially, to prove where *... oo as (16), we ote that by (10), N ~ ~ = [(-lq)l/(l+q+h)], with probability C+O. Also, by (10), wheever, N>~, - l q6(in ) ~ N~+q, (N-l)q+l < - l q(6(fn -1) + (N-l)-h) where by (8) ad (59), takig (o) q+ 1 = [-lq6 (F)] + 1 ((NC-l)/~)q+l-l Note that for h>~,.by (8) ad (13), as (N/~)q+l_l ~ {6(fN ) - o (E)}fo (I) < {o(in -1) - o(r}}/o(r} + C-lq(N _l)-h(~)-q-l -lq(n _l)-h(o)-q-l (58) (59) (60) (61) (62) so that from (B), (60), (61) ad (62), as do,

10 (o)~{(n Io)q+l_l} - ( o )\6(r _ ) N -15(~))/15(~) pO) Further. by virtue of (49) ad (SO). uder (13), as +O. (63) (~)~{15(EN )-15(E)} - (~)~{6(~o)-15(E)} (64) Hee. wheever h>~ [i (10)] ad ~ (15(r " )-15(r)) is asymptotially ormal. by ~ 1 -- (63) ad (64), (0) {(N/~) q+ -I} is also asymptotially ormal. Fially. by the Slutsky theore~. (g)~{(n/g)q+l-l} asymptotially ormal implies that (o)~{n I -I} is also asymptotially ormal (with a differet asymptoti variae), ad this proves (16). Note that for (64), oe eeds the extra regularity oditios due to Hu~kova (1982); for other results these are ot eeded. I ay ase. her regularity oditios are ot very restritive. ad hold for the ommo types of sore futios; we shall ommet more o these i the last setio. SEQUENTIAL CONFIDENCE SETS Note that defiig v as i (25) ad ~(~) as i earlier. uder ~, while -l(~(~)),~-l(~(~)) - ~ (65) 2 Hee. if x_ stads for the upper 100a% poit of the hi-square distributio "'p.a with p degrees of freedom. we have from (65) ad (66). whe is large. Followig the steps after (36). we defie the (66) (67) for 8*(j) = sup{b: S (b» ~~ X- } L. j jj"l'.a 8~:~) = if{b: Sj(b) <--\;j~.a} 1... p. For every d (>0). osider the a stoppig time N d * = if{~o: m~x (8 *(j) -8*(j)) < 2d} 1931 U, L, - ad the proposed {sequetial) ofidee set is (68) (69) (70) (71) I f we de fie, for every d >0, * d (72) the our basi oer is to verify (17) for I Nd i (71) (whe d+o). ad to show- that. Nd:/d:" 1. i probabiiity. as d+o. These results follow diretly by usig (35) - (36) [where we let b \8 L l< -8) "ad ~(e*u -8)], alog the same _,,

11 I ie as i the uivariate ase [See Se ad Ghosh (J971)], ad hee, the details are omitted. We may also ote that supf~ll'(8 -e)l(l'l)-~: l#o} supf~lllr~r-~(e -e)1 _ (lll)-~: l#o} (73) where hi stads for the largest harateristi root. Now, by (30)-(31), ee -e)'r- l (8 -e) = -l(s (e))'v-l(s (e)) + 0(1) a.s., as ~. Hee, by (65) ad (73), for large Pf~~ (~I~)-~ll' (~-~) I ~-\h;(~)~,al~} ::: 1- a Motivated by (74) ad (44), we may defie a stoppig time N~ (for every d>o), by lettig NO = iff> : d - 0 (74) (75) I this ase, if we defie, for every d>o, O = mi{>: > h (l d- 2 } d p,a (76) the by (44), o 0 Nd/ d + 1, a.s., as d+o (77) while (17) follows from (74), (76) ad (33). The same method of proof of the asymptoti ormality of the stoppig time as i (58)-(64) works out here; we eed (48)-(49) i this otext, ad i tur, these require the more striget regularity oditios due to Hu~kova (1982). SO~ffi GENERAL RE~~RKS I this paper, oly the ase of sequetial R-estimators has bee treated i detail. I the uivariate ase, Jure~kova ad Se (1982) have osidered sequetial M- ad L- estimators. Multivariate geeralizatios of these estimators follow o parallel lies. The oordiatewise uiform itegrability of these estimators, established i Jure~kova ad Se (1982) goes to the vetor ase as well. For the ~l-estimators, based o the vetor ~ of sore futios, the sample (aliged) mea (sore-) produt matrix a be used to estimate the true mea produt matrix, ad uder the assumptio that EII~llr<"", for some r>4, results parallel to (41)-(42) hold for this ovariae matrix too. The estimator of the diagoal matrix with the elemets J~j(x)dF[j](x), l~~ is the (diagoal) matr~x with the margial estimators, osidered i Jure~kova ad Se (1982), ad hee, the overgee properties [parallel to (38) ad (47)] hold uder the same regularity oditios. I view of the fat that the sore futio ~ are take to be essetially bouded, the extra

12 regularity oditios of Hu~kova (1982) are ot eeded here. Similarly, for the L-estimators, the (uivariate) deompositio of Gardier ad Se (1979) goes through i the multivariate ase, ad this yields the asymptoti ormality as well as the rates of overgee of the estimated ovariae matries of suh L estimators. I this otext, the jakkife proedure for obtaiig this estimated ovariae matrix also work out well; we may refer to Se (1982) where the lose oetio of these estimators are disussed i detail. We have osidered oly the first order A.R.E. property. ~fuh more elaborate aalysis will be eeded to pursue higher order A.R.E. results. These are posed as ope problems. We olude this setio with a loser examiatio of the Hu~kovaoditio (46). [Note that will follow so that hex) It suffies to osider the right had tail G(a,d) =j {l-f(x)}-l+df(x-d), a G(a,-d) < G(a,O) = -l{l_f(a)} <00, by symmetry.] We write H(oo) = 00. The, we have 1 - F(x) = exp{-h (x)} is the failure rate (FR) d>o, >O, a>o '" >O, d>o, ad hex) = (d/dx)h(x) ad H(x) is ireasig i d (>0), suh that lim sup{h(x+d)/h(x)} < '(l-)-l, V O<d<d ~ - e Towards this, we ote that if (78) while the lower tail G(z,d) = f exp{(l-)h(x+d)}d(l- exp{-h(x)}) a-d Hee, to verify (46), it suffies to show that for every >O, there exists a x with (79) (80) (81) lim suph(x)/h(x) < < 00 (82) x-- - the for all x (suffiietly large), H(x+d)/H(x) ~ exp(d), for every d>o. Cosequetly, hoosig d (>0) suh that exp(-d ) > 1 -, (8l) follows from (82). Hee, we may verify (82) as well. Note that H(x)+» as x+», so that for the etire lass of d.f. 's with bouded or o-ireasig FR, (82) holds trivially (with = 0). For distributios with ireasig failure rates (I FR), ote that to verify (82), it suffies to show (by itegratio) that lim sup{x-llog(_log{l_f(x)})} < < 00 (83) JC"'OO - ad this geeral oditio holds for almost all IFR d.f.'s (iludig some of the extreme value d.f.'s). Thus, (46) [via (82)-(83)] may ot be regarded at all very restritive. Fially, ote that the oditio that I(d 2 /du 2 ).(u)1 < K(1_u)-2, J - V O<u~l, holds for all the ommoly adapted sore futios (iludig partiularly the ormal sores ad the Wiloxo sores).

13 REFERENCES [1] Gardier, J.C. ad Se, P.K., Asymptoti ormality of a variae estimator of a liear ombiatio of a futio of order statistis, Zeit. Wahrsh. Geb. 50 (1979), Verw. [2] liu~kova, M., O bouded legth sequetial ofidee iterval for parameter i regressio model based o raks, ColI. Math. So. Jaos Bolyai, 32: Noparamet. Statist. If. (1982), [3] liu~kova, M. ad Jure~kova, J., Seod order asymptoti relatios of ~I-estimators ad R-estimators i two-sample loatio model, Jour. Statist. Pla. Ifer. 5 (1981), [4] Jure~kova, M. ad Se, P.K., M-estimators ad L-estimators of loatio: Uiform itegrability ad asymptotially risk-effiiet sequetial versios, Seque. Aal. 1 (1982) [5] Puri, M.L. ad Se, P.K., Noparametri Methods i Multivariate Aalysis (Joh Wiley, New York, 1971). [6] Se, P.K., A ivariae priiple for liear ombiatios of order statistis, Zeit. Wahrsh. Verw. Geb. 42 (1978), [7] Se, P.K., O almost sure liearity theorems for siged rak order statistis, A. Statist. 8 (1980), [8] Se, P.K., O oparametri sequetial poit estimatio of loatio based o geeral rak order statistis, Sakhya, Ser. A 42 (1980), [9] Se, P.K., Sequetial Noparametris: Ivariae Priiples ad Statistial Iferee (Joh Wiley, New York, 1981). [10] Se, P.K., Jakkife L-estimators: Affie struture ad asymptotis, Istitute of Statistis, Uiversity of North Carolia, Mimeo Report No [11] Se, P.K. ad Ghosh, M., O bouded legth sequetial ofidee itervals based o oe-sample rak order statistis. A. Math. Statist. 42 (1971), r

ON NONPARAMETRIC SEQUENTIAL POINT ESTIMATION OF LOCATION BASED ON GENERAL RANK ORDER STATISTICS*

ON NONPARAMETRIC SEQUENTIAL POINT ESTIMATION OF LOCATION BASED ON GENERAL RANK ORDER STATISTICS* .t~. ON NONPARAMETRIC SEQUENTIAL POINT ESTIMATION OF LOCATION BASED ON GENERAL RANK ORDER STATISTICS* by Praab Kumar Se Departmet of Biostatistis Uiversity of North Carolia at Chapel Hill Istitute of Statistis

More information

SEQUENTIAL POINT ESTIMATION OF ESTIMABLE PAJUU~ETERS BASED ON U-STATISTICS

SEQUENTIAL POINT ESTIMATION OF ESTIMABLE PAJUU~ETERS BASED ON U-STATISTICS SEQUENTIAL POINT ESTIMATION OF ESTIMABLE PAJUU~ETERS BASED ON U-STATISTICS Praab Kumar Se Departmet of Biostatistis Uiversity of North Carolia, Chapel Hill by ad Malay Ghosh Iowa State Uiversity Istitute

More information

Chapter 8 Hypothesis Testing

Chapter 8 Hypothesis Testing Chapter 8 for BST 695: Speial Topis i Statistial Theory Kui Zhag, Chapter 8 Hypothesis Testig Setio 8 Itrodutio Defiitio 8 A hypothesis is a statemet about a populatio parameter Defiitio 8 The two omplemetary

More information

ε > 0 N N n N a n < ε. Now notice that a n = a n.

ε > 0 N N n N a n < ε. Now notice that a n = a n. 4 Sequees.5. Null sequees..5.. Defiitio. A ull sequee is a sequee (a ) N that overges to 0. Hee, by defiitio of (a ) N overges to 0, a sequee (a ) N is a ull sequee if ad oly if ( ) ε > 0 N N N a < ε..5..

More information

M-ESTIMATORS AND L-ESTIMATORS OF LOCATION; UNIFORM INTEGRABILITY AND ASYMPTOTIC RISK-EFFICIENT SEQUENTIAL VERSIONS

M-ESTIMATORS AND L-ESTIMATORS OF LOCATION; UNIFORM INTEGRABILITY AND ASYMPTOTIC RISK-EFFICIENT SEQUENTIAL VERSIONS .. M-ESTIMATORS AND L-ESTIMATORS OF LOCATION: UNIFORM INTEGRABILITY AND ASYMPTOTIC RISK-EFFICIENT SEQUENTIAL VERSIONS by JANA JURECKOVA Departmet of Probability &Statistis Charles Uiversity Prague 8, Czehoslovakia

More information

The beta density, Bayes, Laplace, and Pólya

The beta density, Bayes, Laplace, and Pólya The beta desity, Bayes, Laplae, ad Pólya Saad Meimeh The beta desity as a ojugate form Suppose that is a biomial radom variable with idex ad parameter p, i.e. ( ) P ( p) p ( p) Applyig Bayes s rule, we

More information

Observer Design with Reduced Measurement Information

Observer Design with Reduced Measurement Information Observer Desig with Redued Measuremet Iformatio I pratie all the states aot be measured so that SVF aot be used Istead oly a redued set of measuremets give by y = x + Du p is available where y( R We assume

More information

After the completion of this section the student. V.4.2. Power Series Solution. V.4.3. The Method of Frobenius. V.4.4. Taylor Series Solution

After the completion of this section the student. V.4.2. Power Series Solution. V.4.3. The Method of Frobenius. V.4.4. Taylor Series Solution Chapter V ODE V.4 Power Series Solutio Otober, 8 385 V.4 Power Series Solutio Objetives: After the ompletio of this setio the studet - should reall the power series solutio of a liear ODE with variable

More information

Nonparametric Goodness-of-Fit Tests for Discrete, Grouped or Censored Data 1

Nonparametric Goodness-of-Fit Tests for Discrete, Grouped or Censored Data 1 Noparametri Goodess-of-Fit Tests for Disrete, Grouped or Cesored Data Boris Yu. Lemeshko, Ekateria V. Chimitova ad Stepa S. Kolesikov Novosibirsk State Tehial Uiversity Departmet of Applied Mathematis

More information

Economics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator

Economics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator Ecoomics 24B Relatio to Method of Momets ad Maximum Likelihood OLSE as a Maximum Likelihood Estimator Uder Assumptio 5 we have speci ed the distributio of the error, so we ca estimate the model parameters

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak

More information

Lecture 8. Dirac and Weierstrass

Lecture 8. Dirac and Weierstrass Leture 8. Dira ad Weierstrass Audrey Terras May 5, 9 A New Kid of Produt of Futios You are familiar with the poitwise produt of futios de ed by f g(x) f(x) g(x): You just tae the produt of the real umbers

More information

32 estimating the cumulative distribution function

32 estimating the cumulative distribution function 32 estimatig the cumulative distributio fuctio 4.6 types of cofidece itervals/bads Let F be a class of distributio fuctios F ad let θ be some quatity of iterest, such as the mea of F or the whole fuctio

More information

UNIVERSITY OF NORTH CAROLINA Department of Statistics Chapel Hill, N. C. FOR MULTIVARIATE POPULATIONS. J. N. Srivastava.

UNIVERSITY OF NORTH CAROLINA Department of Statistics Chapel Hill, N. C. FOR MULTIVARIATE POPULATIONS. J. N. Srivastava. UNIVERSITY OF NORTH CAROLINA Departmet of Statistics Chapel Hill N. C. A NOTE ON THE BEST LINEAR UNBIASED ESTIMATES FOR MULTIVARIATE POPULATIONS by J. N. Srivastava November 1962 Cotract No. AF 49(638)-213

More information

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1 EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum

More information

Fluids Lecture 2 Notes

Fluids Lecture 2 Notes Fluids Leture Notes. Airfoil orte Sheet Models. Thi-Airfoil Aalysis Problem Readig: Aderso.,.7 Airfoil orte Sheet Models Surfae orte Sheet Model A aurate meas of represetig the flow about a airfoil i a

More information

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i

More information

Sx [ ] = x must yield a

Sx [ ] = x must yield a Math -b Leture #5 Notes This wee we start with a remider about oordiates of a vetor relative to a basis for a subspae ad the importat speial ase where the subspae is all of R. This freedom to desribe vetors

More information

Efficient GMM LECTURE 12 GMM II

Efficient GMM LECTURE 12 GMM II DECEMBER 1 010 LECTURE 1 II Efficiet The estimator depeds o the choice of the weight matrix A. The efficiet estimator is the oe that has the smallest asymptotic variace amog all estimators defied by differet

More information

Asymptotic distribution of products of sums of independent random variables

Asymptotic distribution of products of sums of independent random variables Proc. Idia Acad. Sci. Math. Sci. Vol. 3, No., May 03, pp. 83 9. c Idia Academy of Scieces Asymptotic distributio of products of sums of idepedet radom variables YANLING WANG, SUXIA YAO ad HONGXIA DU ollege

More information

LECTURE 8: ASYMPTOTICS I

LECTURE 8: ASYMPTOTICS I LECTURE 8: ASYMPTOTICS I We are iterested i the properties of estimators as. Cosider a sequece of radom variables {, X 1}. N. M. Kiefer, Corell Uiversity, Ecoomics 60 1 Defiitio: (Weak covergece) A sequece

More information

Axioms of Measure Theory

Axioms of Measure Theory MATH 532 Axioms of Measure Theory Dr. Neal, WKU I. The Space Throughout the course, we shall let X deote a geeric o-empty set. I geeral, we shall ot assume that ay algebraic structure exists o X so that

More information

5 Birkhoff s Ergodic Theorem

5 Birkhoff s Ergodic Theorem 5 Birkhoff s Ergodic Theorem Amog the most useful of the various geeralizatios of KolmogorovâĂŹs strog law of large umbers are the ergodic theorems of Birkhoff ad Kigma, which exted the validity of the

More information

Notes 19 : Martingale CLT

Notes 19 : Martingale CLT Notes 9 : Martigale CLT Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: [Bil95, Chapter 35], [Roc, Chapter 3]. Sice we have ot ecoutered weak covergece i some time, we first recall

More information

Bernoulli Numbers. n(n+1) = n(n+1)(2n+1) = n(n 1) 2

Bernoulli Numbers. n(n+1) = n(n+1)(2n+1) = n(n 1) 2 Beroulli Numbers Beroulli umbers are amed after the great Swiss mathematiia Jaob Beroulli5-705 who used these umbers i the power-sum problem. The power-sum problem is to fid a formula for the sum of the

More information

Certain inclusion properties of subclass of starlike and convex functions of positive order involving Hohlov operator

Certain inclusion properties of subclass of starlike and convex functions of positive order involving Hohlov operator Iteratioal Joural of Pure ad Applied Mathematial Siees. ISSN 0972-9828 Volume 0, Number (207), pp. 85-97 Researh Idia Publiatios http://www.ripubliatio.om Certai ilusio properties of sublass of starlike

More information

CONDITIONAL PROBABILITY INTEGRAL TRANSFORMATIONS FOR MULTIVARIATE NORMAL DISTRIBUTIONS

CONDITIONAL PROBABILITY INTEGRAL TRANSFORMATIONS FOR MULTIVARIATE NORMAL DISTRIBUTIONS CONDITIONAL PROBABILITY INTEGRAL TRANSFORMATIONS FOR MULTIVARIATE NORMAL DISTRIBUTIONS Satiago Rico Gallardo, C. P. Queseberry, F. J. O'Reilly Istitute of Statistics Mimeograph Series No. 1148 Raleigh,

More information

TR/46 OCTOBER THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION A. TALBOT

TR/46 OCTOBER THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION A. TALBOT TR/46 OCTOBER 974 THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION by A. TALBOT .. Itroductio. A problem i approximatio theory o which I have recetly worked [] required for its solutio a proof that the

More information

Precise Rates in Complete Moment Convergence for Negatively Associated Sequences

Precise Rates in Complete Moment Convergence for Negatively Associated Sequences Commuicatios of the Korea Statistical Society 29, Vol. 16, No. 5, 841 849 Precise Rates i Complete Momet Covergece for Negatively Associated Sequeces Dae-Hee Ryu 1,a a Departmet of Computer Sciece, ChugWoo

More information

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n. Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator

More information

Lecture 19: Convergence

Lecture 19: Convergence Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may

More information

Construction of Control Chart for Random Queue Length for (M / M / c): ( / FCFS) Queueing Model Using Skewness

Construction of Control Chart for Random Queue Length for (M / M / c): ( / FCFS) Queueing Model Using Skewness Iteratioal Joural of Sietifi ad Researh Publiatios, Volume, Issue, Deember ISSN 5-5 Costrutio of Cotrol Chart for Radom Queue Legth for (M / M / ): ( / FCFS) Queueig Model Usig Skewess Dr.(Mrs.) A.R. Sudamai

More information

Distribution of Random Samples & Limit theorems

Distribution of Random Samples & Limit theorems STAT/MATH 395 A - PROBABILITY II UW Witer Quarter 2017 Néhémy Lim Distributio of Radom Samples & Limit theorems 1 Distributio of i.i.d. Samples Motivatig example. Assume that the goal of a study is to

More information

PREDICTION INTERVALS FOR FUTURE SAMPLE MEAN FROM INVERSE GAUSSIAN DISTRIBUTION

PREDICTION INTERVALS FOR FUTURE SAMPLE MEAN FROM INVERSE GAUSSIAN DISTRIBUTION Qatar Uiv. Sci. J. (1991), 11: 19-26 PREDICTION INTERVALS FOR FUTURE SAMPLE MEAN FROM INVERSE GAUSSIAN DISTRIBUTION By MUHAMMAD S. ABU-SALIH ad RAFIQ K. AL-BAITAT Departmet of Statistics, Yarmouk Uiversity,

More information

Rank tests and regression rank scores tests in measurement error models

Rank tests and regression rank scores tests in measurement error models Rak tests ad regressio rak scores tests i measuremet error models J. Jurečková ad A.K.Md.E. Saleh Charles Uiversity i Prague ad Carleto Uiversity i Ottawa Abstract The rak ad regressio rak score tests

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

SEMIGROUPS. D. Pfeifer. Communicated by Jerome A. Goldstein Dedicated to E.S. Lyapin on his 70th Birthday

SEMIGROUPS. D. Pfeifer. Communicated by Jerome A. Goldstein Dedicated to E.S. Lyapin on his 70th Birthday A NOTE ON ~ROBABILISTIC REPRESENTATIONS OF OPERATOR SEMIGROUPS D. Pfeifer Commuicated by Jerome A. Goldstei Dedicated to E.S. Lyapi o his 70th Birthday I the theory of strogly cotiuous semigroups of bouded

More information

Exponential Families and Bayesian Inference

Exponential Families and Bayesian Inference Computer Visio Expoetial Families ad Bayesia Iferece Lecture Expoetial Families A expoetial family of distributios is a d-parameter family f(x; havig the followig form: f(x; = h(xe g(t T (x B(, (. where

More information

Random Variables, Sampling and Estimation

Random Variables, Sampling and Estimation Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig

More information

Probability 2 - Notes 10. Lemma. If X is a random variable and g(x) 0 for all x in the support of f X, then P(g(X) 1) E[g(X)].

Probability 2 - Notes 10. Lemma. If X is a random variable and g(x) 0 for all x in the support of f X, then P(g(X) 1) E[g(X)]. Probability 2 - Notes 0 Some Useful Iequalities. Lemma. If X is a radom variable ad g(x 0 for all x i the support of f X, the P(g(X E[g(X]. Proof. (cotiuous case P(g(X Corollaries x:g(x f X (xdx x:g(x

More information

Journal of Multivariate Analysis. Superefficient estimation of the marginals by exploiting knowledge on the copula

Journal of Multivariate Analysis. Superefficient estimation of the marginals by exploiting knowledge on the copula Joural of Multivariate Aalysis 102 (2011) 1315 1319 Cotets lists available at ScieceDirect Joural of Multivariate Aalysis joural homepage: www.elsevier.com/locate/jmva Superefficiet estimatio of the margials

More information

It is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function.

It is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function. MATH 532 Measurable Fuctios Dr. Neal, WKU Throughout, let ( X, F, µ) be a measure space ad let (!, F, P ) deote the special case of a probability space. We shall ow begi to study real-valued fuctios defied

More information

Supplementary Material for: Classical Testing in Functional Linear Models

Supplementary Material for: Classical Testing in Functional Linear Models To appear i the Joural of Noparametri Statistis Vol. 00, No. 00, Moth 20XX, 1 16 Supplemetary Material for: Classial Testig i utioal Liear Models Deha Kog a Aa-Maria Staiu b ad Arab Maity b a Departmet

More information

A NEW METHOD FOR CONSTRUCTING APPROXIMATE CONFIDENCE INTERVALS FOR M-ESTU1ATES. Dennis D. Boos

A NEW METHOD FOR CONSTRUCTING APPROXIMATE CONFIDENCE INTERVALS FOR M-ESTU1ATES. Dennis D. Boos .- A NEW METHOD FOR CONSTRUCTING APPROXIMATE CONFIDENCE INTERVALS FOR M-ESTU1ATES by Deis D. Boos Departmet of Statistics North Carolia State Uiversity Istitute of Statistics Mimeo Series #1198 September,

More information

A new distribution-free quantile estimator

A new distribution-free quantile estimator Biometrika (1982), 69, 3, pp. 635-40 Prited i Great Britai 635 A ew distributio-free quatile estimator BY FRANK E. HARRELL Cliical Biostatistics, Duke Uiversity Medical Ceter, Durham, North Carolia, U.S.A.

More information

Fixed Point Approximation of Weakly Commuting Mappings in Banach Space

Fixed Point Approximation of Weakly Commuting Mappings in Banach Space BULLETIN of the Bull. Malaysia Math. S. So. (Seod Series) 3 (000) 8-85 MALAYSIAN MATHEMATICAL SCIENCES SOCIETY Fied Poit Approimatio of Weakly Commutig Mappigs i Baah Spae ZAHEER AHMAD AND ABDALLA J. ASAD

More information

1 Inferential Methods for Correlation and Regression Analysis

1 Inferential Methods for Correlation and Regression Analysis 1 Iferetial Methods for Correlatio ad Regressio Aalysis I the chapter o Correlatio ad Regressio Aalysis tools for describig bivariate cotiuous data were itroduced. The sample Pearso Correlatio Coefficiet

More information

17. Joint distributions of extreme order statistics Lehmann 5.1; Ferguson 15

17. Joint distributions of extreme order statistics Lehmann 5.1; Ferguson 15 17. Joit distributios of extreme order statistics Lehma 5.1; Ferguso 15 I Example 10., we derived the asymptotic distributio of the maximum from a radom sample from a uiform distributio. We did this usig

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

Lecture 3. Properties of Summary Statistics: Sampling Distribution

Lecture 3. Properties of Summary Statistics: Sampling Distribution Lecture 3 Properties of Summary Statistics: Samplig Distributio Mai Theme How ca we use math to justify that our umerical summaries from the sample are good summaries of the populatio? Lecture Summary

More information

[412] A TEST FOR HOMOGENEITY OF THE MARGINAL DISTRIBUTIONS IN A TWO-WAY CLASSIFICATION

[412] A TEST FOR HOMOGENEITY OF THE MARGINAL DISTRIBUTIONS IN A TWO-WAY CLASSIFICATION [412] A TEST FOR HOMOGENEITY OF THE MARGINAL DISTRIBUTIONS IN A TWO-WAY CLASSIFICATION BY ALAN STUART Divisio of Research Techiques, Lodo School of Ecoomics 1. INTRODUCTION There are several circumstaces

More information

Lecture 2: Concentration Bounds

Lecture 2: Concentration Bounds CSE 52: Desig ad Aalysis of Algorithms I Sprig 206 Lecture 2: Cocetratio Bouds Lecturer: Shaya Oveis Ghara March 30th Scribe: Syuzaa Sargsya Disclaimer: These otes have ot bee subjected to the usual scrutiy

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

In this section we derive some finite-sample properties of the OLS estimator. b is an estimator of β. It is a function of the random sample data.

In this section we derive some finite-sample properties of the OLS estimator. b is an estimator of β. It is a function of the random sample data. 17 3. OLS Part III I this sectio we derive some fiite-sample properties of the OLS estimator. 3.1 The Samplig Distributio of the OLS Estimator y = Xβ + ε ; ε ~ N[0, σ 2 I ] b = (X X) 1 X y = f(y) ε is

More information

Math Third Midterm Exam November 17, 2010

Math Third Midterm Exam November 17, 2010 Math 37 1. Treibergs σιι Third Midterm Exam Name: November 17, 1 1. Suppose that the mahie fillig mii-boxes of Fruitlad Raisis fills boxes so that the weight of the boxes has a populatio mea µ x = 14.1

More information

Linear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d

Linear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d Liear regressio Daiel Hsu (COMS 477) Maximum likelihood estimatio Oe of the simplest liear regressio models is the followig: (X, Y ),..., (X, Y ), (X, Y ) are iid radom pairs takig values i R d R, ad Y

More information

Mathematical Statistics - MS

Mathematical Statistics - MS Paper Specific Istructios. The examiatio is of hours duratio. There are a total of 60 questios carryig 00 marks. The etire paper is divided ito three sectios, A, B ad C. All sectios are compulsory. Questios

More information

The value of Banach limits on a certain sequence of all rational numbers in the interval (0,1) Bao Qi Feng

The value of Banach limits on a certain sequence of all rational numbers in the interval (0,1) Bao Qi Feng The value of Baach limits o a certai sequece of all ratioal umbers i the iterval 0, Bao Qi Feg Departmet of Mathematical Scieces, Ket State Uiversity, Tuscarawas, 330 Uiversity Dr. NE, New Philadelphia,

More information

Stat 421-SP2012 Interval Estimation Section

Stat 421-SP2012 Interval Estimation Section Stat 41-SP01 Iterval Estimatio Sectio 11.1-11. We ow uderstad (Chapter 10) how to fid poit estimators of a ukow parameter. o However, a poit estimate does ot provide ay iformatio about the ucertaity (possible

More information

Entropy and Ergodic Theory Lecture 5: Joint typicality and conditional AEP

Entropy and Ergodic Theory Lecture 5: Joint typicality and conditional AEP Etropy ad Ergodic Theory Lecture 5: Joit typicality ad coditioal AEP 1 Notatio: from RVs back to distributios Let (Ω, F, P) be a probability space, ad let X ad Y be A- ad B-valued discrete RVs, respectively.

More information

1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a real-valued radom variable

More information

Integrable Functions. { f n } is called a determining sequence for f. If f is integrable with respect to, then f d does exist as a finite real number

Integrable Functions. { f n } is called a determining sequence for f. If f is integrable with respect to, then f d does exist as a finite real number MATH 532 Itegrable Fuctios Dr. Neal, WKU We ow shall defie what it meas for a measurable fuctio to be itegrable, show that all itegral properties of simple fuctios still hold, ad the give some coditios

More information

The central limit theorem for Student s distribution. Problem Karim M. Abadir and Jan R. Magnus. Econometric Theory, 19, 1195 (2003)

The central limit theorem for Student s distribution. Problem Karim M. Abadir and Jan R. Magnus. Econometric Theory, 19, 1195 (2003) The cetral limit theorem for Studet s distributio Problem 03.6.1 Karim M. Abadir ad Ja R. Magus Ecoometric Theory, 19, 1195 (003) Z Ecoometric Theory, 19, 003, 1195 1198+ Prited i the Uited States of America+

More information

lim za n n = z lim a n n.

lim za n n = z lim a n n. Lecture 6 Sequeces ad Series Defiitio 1 By a sequece i a set A, we mea a mappig f : N A. It is customary to deote a sequece f by {s } where, s := f(). A sequece {z } of (complex) umbers is said to be coverget

More information

Estimation for Complete Data

Estimation for Complete Data Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of

More information

Computer Science 188 Artificial Intelligence. Introduction to Probability. Probability Ryan Waliany

Computer Science 188 Artificial Intelligence. Introduction to Probability. Probability Ryan Waliany Computer Siee 88 Artifiial Itelligee Rya Waliay Note: this is meat to be a simple referee sheet ad help studets uder the derivatios. If there s aythig that seems shaky or iorret do t hesitate to email

More information

REGRESSION WITH QUADRATIC LOSS

REGRESSION WITH QUADRATIC LOSS REGRESSION WITH QUADRATIC LOSS MAXIM RAGINSKY Regressio with quadratic loss is aother basic problem studied i statistical learig theory. We have a radom couple Z = X, Y ), where, as before, X is a R d

More information

Statisticians use the word population to refer the total number of (potential) observations under consideration

Statisticians use the word population to refer the total number of (potential) observations under consideration 6 Samplig Distributios Statisticias use the word populatio to refer the total umber of (potetial) observatios uder cosideratio The populatio is just the set of all possible outcomes i our sample space

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 3 9/11/2013. Large deviations Theory. Cramér s Theorem

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 3 9/11/2013. Large deviations Theory. Cramér s Theorem MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/5.070J Fall 203 Lecture 3 9//203 Large deviatios Theory. Cramér s Theorem Cotet.. Cramér s Theorem. 2. Rate fuctio ad properties. 3. Chage of measure techique.

More information

This section is optional.

This section is optional. 4 Momet Geeratig Fuctios* This sectio is optioal. The momet geeratig fuctio g : R R of a radom variable X is defied as g(t) = E[e tx ]. Propositio 1. We have g () (0) = E[X ] for = 1, 2,... Proof. Therefore

More information

Summation Method for Some Special Series Exactly

Summation Method for Some Special Series Exactly The Iteratioal Joural of Mathematis, Siee, Tehology ad Maagemet (ISSN : 39-85) Vol. Issue Summatio Method for Some Speial Series Eatly D.A.Gismalla Deptt. Of Mathematis & omputer Studies Faulty of Siee

More information

Lecture 7: Properties of Random Samples

Lecture 7: Properties of Random Samples Lecture 7: Properties of Radom Samples 1 Cotiued From Last Class Theorem 1.1. Let X 1, X,...X be a radom sample from a populatio with mea µ ad variace σ

More information

Unbiased Estimation. February 7-12, 2008

Unbiased Estimation. February 7-12, 2008 Ubiased Estimatio February 7-2, 2008 We begi with a sample X = (X,..., X ) of radom variables chose accordig to oe of a family of probabilities P θ where θ is elemet from the parameter space Θ. For radom

More information

Basics of Probability Theory (for Theory of Computation courses)

Basics of Probability Theory (for Theory of Computation courses) Basics of Probability Theory (for Theory of Computatio courses) Oded Goldreich Departmet of Computer Sciece Weizma Istitute of Sciece Rehovot, Israel. oded.goldreich@weizma.ac.il November 24, 2008 Preface.

More information

Solution. 1 Solutions of Homework 1. Sangchul Lee. October 27, Problem 1.1

Solution. 1 Solutions of Homework 1. Sangchul Lee. October 27, Problem 1.1 Solutio Sagchul Lee October 7, 017 1 Solutios of Homework 1 Problem 1.1 Let Ω,F,P) be a probability space. Show that if {A : N} F such that A := lim A exists, the PA) = lim PA ). Proof. Usig the cotiuity

More information

STK4011 and STK9011 Autumn 2016

STK4011 and STK9011 Autumn 2016 STK4 ad STK9 Autum 6 ypothesis testig Covers (most of) the followig material from hapter 8: Setio 8. Setios 8.. ad 8..3 Setio 8.3. Setio 8.3. (util defiitio 8.3.6) Ørulf Borga Departmet of Mathematis Uiversity

More information

Machine Learning Brett Bernstein

Machine Learning Brett Bernstein Machie Learig Brett Berstei Week Lecture: Cocept Check Exercises Starred problems are optioal. Statistical Learig Theory. Suppose A = Y = R ad X is some other set. Furthermore, assume P X Y is a discrete

More information

ON THE RATE Of CONVERGENCE for SOME STRONG APPROXIMATION THEOREMS IN EXTREMAL STATISTICS. Dietma:r Pfe;i.fer

ON THE RATE Of CONVERGENCE for SOME STRONG APPROXIMATION THEOREMS IN EXTREMAL STATISTICS. Dietma:r Pfe;i.fer ON THE RATE Of CONVERGENCE for SOME STRONG APPROXIMATION THEOREMS IN EXTREMAL STATISTICS Dietma:r Pfe;i.fer Abstract. Strog approximatio theorems for the logarithms of record ad iter-record times of a

More information

Lecture 2: Monte Carlo Simulation

Lecture 2: Monte Carlo Simulation STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?

More information

The Boolean Ring of Intervals

The Boolean Ring of Intervals MATH 532 Lebesgue Measure Dr. Neal, WKU We ow shall apply the results obtaied about outer measure to the legth measure o the real lie. Throughout, our space X will be the set of real umbers R. Whe ecessary,

More information

Regression with quadratic loss

Regression with quadratic loss Regressio with quadratic loss Maxim Ragisky October 13, 2015 Regressio with quadratic loss is aother basic problem studied i statistical learig theory. We have a radom couple Z = X,Y, where, as before,

More information

Solutions: Homework 3

Solutions: Homework 3 Solutios: Homework 3 Suppose that the radom variables Y,...,Y satisfy Y i = x i + " i : i =,..., IID where x,...,x R are fixed values ad ",...," Normal(0, )with R + kow. Fid ˆ = MLE( ). IND Solutio: Observe

More information

STA Object Data Analysis - A List of Projects. January 18, 2018

STA Object Data Analysis - A List of Projects. January 18, 2018 STA 6557 Jauary 8, 208 Object Data Aalysis - A List of Projects. Schoeberg Mea glaucomatous shape chages of the Optic Nerve Head regio i aimal models 2. Aalysis of VW- Kedall ati-mea shapes with a applicatio

More information

Basic Probability/Statistical Theory I

Basic Probability/Statistical Theory I Basi Probability/Statistial Theory I Epetatio The epetatio or epeted values of a disrete radom variable X is the arithmeti mea of the radom variable s distributio. E[ X ] p( X ) all Epetatio by oditioig

More information

Optimally Sparse SVMs

Optimally Sparse SVMs A. Proof of Lemma 3. We here prove a lower boud o the umber of support vectors to achieve geeralizatio bouds of the form which we cosider. Importatly, this result holds ot oly for liear classifiers, but

More information

Calculus 2 TAYLOR SERIES CONVERGENCE AND TAYLOR REMAINDER

Calculus 2 TAYLOR SERIES CONVERGENCE AND TAYLOR REMAINDER Calulus TAYLO SEIES CONVEGENCE AND TAYLO EMAINDE Let the differee betwee f () ad its Taylor polyomial approimatio of order be (). f ( ) P ( ) + ( ) Cosider to be the remaider with the eat value ad the

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

ECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors

ECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors ECONOMETRIC THEORY MODULE XIII Lecture - 34 Asymptotic Theory ad Stochastic Regressors Dr. Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Asymptotic theory The asymptotic

More information

MATH/STAT 352: Lecture 15

MATH/STAT 352: Lecture 15 MATH/STAT 352: Lecture 15 Sectios 5.2 ad 5.3. Large sample CI for a proportio ad small sample CI for a mea. 1 5.2: Cofidece Iterval for a Proportio Estimatig proportio of successes i a biomial experimet

More information

OFF-DIAGONAL MULTILINEAR INTERPOLATION BETWEEN ADJOINT OPERATORS

OFF-DIAGONAL MULTILINEAR INTERPOLATION BETWEEN ADJOINT OPERATORS OFF-DIAGONAL MULTILINEAR INTERPOLATION BETWEEN ADJOINT OPERATORS LOUKAS GRAFAKOS AND RICHARD G. LYNCH 2 Abstract. We exted a theorem by Grafakos ad Tao [5] o multiliear iterpolatio betwee adjoit operators

More information

Lecture 10: Universal coding and prediction

Lecture 10: Universal coding and prediction 0-704: Iformatio Processig ad Learig Sprig 0 Lecture 0: Uiversal codig ad predictio Lecturer: Aarti Sigh Scribes: Georg M. Goerg Disclaimer: These otes have ot bee subjected to the usual scrutiy reserved

More information

STAT Homework 1 - Solutions

STAT Homework 1 - Solutions STAT-36700 Homework 1 - Solutios Fall 018 September 11, 018 This cotais solutios for Homework 1. Please ote that we have icluded several additioal commets ad approaches to the problems to give you better

More information

Kernel density estimator

Kernel density estimator Jauary, 07 NONPARAMETRIC ERNEL DENSITY ESTIMATION I this lecture, we discuss kerel estimatio of probability desity fuctios PDF Noparametric desity estimatio is oe of the cetral problems i statistics I

More information

STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. Comments:

STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. Comments: Recall: STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS Commets:. So far we have estimates of the parameters! 0 ad!, but have o idea how good these estimates are. Assumptio: E(Y x)! 0 +! x (liear coditioal

More information

Self-normalized deviation inequalities with application to t-statistic

Self-normalized deviation inequalities with application to t-statistic Self-ormalized deviatio iequalities with applicatio to t-statistic Xiequa Fa Ceter for Applied Mathematics, Tiaji Uiversity, 30007 Tiaji, Chia Abstract Let ξ i i 1 be a sequece of idepedet ad symmetric

More information

Regression with an Evaporating Logarithmic Trend

Regression with an Evaporating Logarithmic Trend Regressio with a Evaporatig Logarithmic Tred Peter C. B. Phillips Cowles Foudatio, Yale Uiversity, Uiversity of Aucklad & Uiversity of York ad Yixiao Su Departmet of Ecoomics Yale Uiversity October 5,

More information

Principal Component Analysis. Nuno Vasconcelos ECE Department, UCSD

Principal Component Analysis. Nuno Vasconcelos ECE Department, UCSD Priipal Compoet Aalysis Nuo Vasoelos ECE Departmet, UCSD Curse of dimesioality typial observatio i Bayes deisio theory: error ireases whe umber of features is large problem: eve for simple models (e.g.

More information

CS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 5

CS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 5 CS434a/54a: Patter Recogitio Prof. Olga Veksler Lecture 5 Today Itroductio to parameter estimatio Two methods for parameter estimatio Maimum Likelihood Estimatio Bayesia Estimatio Itroducto Bayesia Decisio

More information

Element sampling: Part 2

Element sampling: Part 2 Chapter 4 Elemet samplig: Part 2 4.1 Itroductio We ow cosider uequal probability samplig desigs which is very popular i practice. I the uequal probability samplig, we ca improve the efficiecy of the resultig

More information

INEQUALITIES BJORN POONEN

INEQUALITIES BJORN POONEN INEQUALITIES BJORN POONEN 1 The AM-GM iequality The most basic arithmetic mea-geometric mea (AM-GM) iequality states simply that if x ad y are oegative real umbers, the (x + y)/2 xy, with equality if ad

More information