Department of Biostatistics University of North Carolina at Chapel Bill. Institute of Statistics- Mimeo Series No
|
|
- Chester Blair
- 5 years ago
- Views:
Transcription
1 ON SEQUENTIAL NONPARAMETRIC ESTIMATION OF MULTIVARIATE LQCATION by Praab Kumar Se Departmet of Biostatistis Uiversity of North Carolia at Chapel Bill Istitute of Statistis- Mimeo Series No Otober 1983
2 ON SEQUENTIAL NONPAR~mTRIC ESTI~~TION OF MULTIVARIATE LOCATION Praab Kumar Se Departmet of Biostatistis Uiversity of North Carolia Chapel Hill. NC USA.e For the multivariate oe-sample loatio model (relatig to a diagoally symmetri distributio). sequetial oparametri (poit as well as iterval) estimators based o appropriate rak statistis are osidered ad their asymptoti properties studied. I this otext. asymptoti risk-effiiey of the proposed estimators ad asymptoti ormality of the assoiated stoppig times are established. These results rest o momet-overgee of the permutatio dispersio matrix to its populatio outerpart; these are studied as well. A brief review of some other robust proedures is made alog with. INTRODUCTION Let {~i;i>l} be a sequee of idepedet ad idetially distributed (i.i.d.) radom vetors (r.v.) with a otiuous distributio futio (d.f.) defied o E P for some p~l. where eee E P. It is assumed that F(.;~). F(x-e). xee P (1) where the P margial d.f.s of F. deoted by F[l].. F[p]. respetively. are all symmetri about 0; i fat. F is assumed to be diagoally symmetri about the or~gl. Thus. e = (el... e)' is the vetor of loatio parameters. ad we - p are iterested i the estimatio of e. Based o a sample (~l"" '~) of size. let! (T l.. T p ), be a estimator of e. The loss iurred due to estimatig e by! is deoted by L(.;!'~) = p(!'~) +. (>O) (2) where p: E P x E P... [0."') is a suitable metri ad is the ost of samplig. per uit observatio. Some ommoly adapted forms of p(.) are the followig: p(~.~) max{laj-bjl: l~j~jl} (~~X-orm) p(~.~) -1 P I I (MAD-orm) p Lj=l aj-b j p(~.~) (!-~) 'g(~-~) (QUAD-orm) (3)
3 where 9 is some give positive semi-defiite (p.s.d.) matrix. Correspodig to (2), the risk i estimatig ~ by! is give by AF(,;~) '" EL(,;!'~) '" EP(!'~) + (4) Note that the risk i (4) depeds o F through the distributio of! ad the metri p(.). If T is traslatio-ivariat (as will be the ase i our subsequet aalysis), the 0(F) '" EP(!'~) ad AF(,) '" AF(,;~) do ot deped o e. Suppose ow that there exists a positive iteger O' suh that 0(F) exists for every ~O ad 0(F)~O as ~. For every C>O, we may defie the (5) The, T 0 is the miimum risk estimator (MRE) of ~. Note that 0(F) geerally - depeds o F (through some other futioals of F), so that whe F is ot ompletely speified (as is the ase i pratie), o sigle O may lead to the MRE simultaeously for all F F, a lass of d.f.'s. However, suitable sequetial proedures may be iorporated to ahieve this goal i a asymptoti setup where is made to overge to O. Towards this, we assume that for some q(>o), as ireases, qo (F)... o(f): O<o(F)<oo (6) ad, further, there exists a sequee {d } of osistet estimators of o(f). [For the first two ases i (3), q is typially equal to ~, while for the last oe, it is equal to 1.] Note that for C~O, (4) may be rewritte as so that asymptotially, as C~O, we have o (8) (7) e, (9) Motivated by (8) ad the stohasti overgee of {d } (to o(f)), for every (>O), we may defie a stoppig variable N '" if{~o: l+q~-lq(d+-h)} (0) where h(>o) is a suitable ostat, to be hose later o. Based o the stoppig rule N ' TN of e, defied for every - We say that we osider the (sequetial) poit estimator >O, Ap(C) '" EP(!N'~) + EN ' is a asymptotially ~IRE of e, ad we deote the orrespodig risk by if >O (11) (12)
4 I the literature, this is referred to as the (first order) asymptoti riskeffiiey (A.R.E.) property. followig results: as ~O, where Besides this A.R.E., we shall also study the Nio... 1, i the first mea, (13) o ~ ( ) (TN -e) - N(O,r) (14) - - r - = lim ->-oo E{(T - -e)(t _ -- _el'} (IS) [! is also the dispersio matrix of the asymptoti multi-ormal d.f. of ~(T -8).] - _ - Uder some additioal regularity oditios, we will also have the asymptoti ormality of the stoppig time i.e., o -~ 0 2 ( ) (N- ) - N(O,y ), as do (16) where y(o<y<oo) is a suitable ostat (depedig o q ad F). The seod problem is to provide a ofidee set size, suh that I (E P ), based o a sample of p(e I Ie) > l-a(o<a<l) - _ - (17) maximum diameter of I ~ 2d(d>0) (18) where a ad d are preassiged. For this problem too, fixed sample size proedures may ot work out (for all F F), ad hee, oe may take reourse a sequetial sheme [viz., Chapter 10 of Se (1981)], where (17)-(18) hold i a asymptoti setup: d~o. Asymptoti properties of the stoppig times are studied here. I this paper, we speifially osider the ase of R-estimators of loatio; some geeral remarks pertaiig to some other robust (viz., ~I- loatio are made i the oludig setio. Asymptoti properties of these multivariate R-estimators are studied i Setio 2. ad L-) estimators of Setio 3 otais some asymptoti results o the permutatio dispersio matrix whih are eeded i Setio 4 i the derivatio of the asymptoti results i (12, (13), (14) ad (16). Setio 5 deals with the ofidee set problem. multivariate ase (i.e., p~2). detail i Chapter 10 of Se (1981) ad Jure~kova Throughout the paper, we osider the geuie The uivariate ase has already bee studied i ad Se (1982), amog other plaes. The last setio deals with some other robust estimators of e (e.g., M- ad L estimators), ad oly the geeral setup is disussed. MULTIVARIATE R-ESTI~~TORS: ASYMPTOTIC PROPERTIES For eah j (= 1,...,p), let epj = {epj (u),o<u<l} be a o-dereasig, o-ostat, skew-symmetri ad square-itegrable sore-futio, ad let ep. = {ep.(u) = ep~((i+u)/2),0<u<i}, l_<j< J J J -..J (19)
5 For a sample ~i = (X il,... '\p)l, l~i~, of size, we the itrodue a set of ~ by lettig a. (i) = E. (U.) or. (i/(+l)), l~i~; j = 1,...,p (20) J J l J where Ul<",<U are the ordered r.v.'s of a sample of size from the uiform (0,1) d.f. Further, for every real b, let R~ij(b) be the rak of IXij-bl amog IXlj-bl...,IXj-bl. for i= l,..., ad j = l,...,p. Let ~(~) = (S l(b ),...,S (b ))1 be defied by l p p Sj (b j ) = Ei=lsg(Xij-b.)aj (R~ij (b j )), 1.9.3' Note that for eah j (= 1,...,p), Sj(b) is \ i b, ad Sj(6 j ) has a distributio symmetri about O. Let the a j = ~(sup{b: (22) S.(b»O} + if{b: J S. (b)<o}) J for 1,2,...,p, ad let e = - ( 1'"'' p ), (23) The ~ is a traslatio-ivariat, media-ubiased, robust ad osistet esti- - mator of 6 [viz., Chapter 6 of Puri ad Se (1971)]. Let B = Diag(B,...,B l p ) be defied by lettig Further, let v = be defied by lettig for j,j' = l,,p, where F[jjl] is the bivariate d.f. of for j 'I j I 1,,po Note that the v.. do ot deped o JJ are depedet o F through the joit d.f. F[jjl]' j 'I j'. E= ((Y jj,)) = B-lVB- l = ((Vjjl/BjBjl)) The, uder quite geeral oditios [f. Puri ad Se (1971, Ch. --, (21) (24) (25) (Xij-6j,Xijl-6jl), F, but V j j I' j 'I j', Fially, let (26) 6)], we have for Note that the asymptoti ormality i (27) does ot eessarily esure (15). however, for some a>o (ot eessarily >1), Ellx.lla<oo, the, it follows from - -~ Theorem 2.1 of Se (1980b) that there exists a positive iteger (depedig o 2 a a), suh that EII ~ -611 < 00, 'If >. - a For our purpose, we assume that for every j (= 1,...,p), for some 0 (O~O<\) ad K (O<K<oo), I (d r /du r ) j(u) I -o-r ~ K(l-u),O<u<l; r = 0,1,2, ad F[j] has a absolutely otiuous desity futio f[j] (with a first derivative- fij] bouded almost everywhere), suh that (27) If, (28)
6 for 1... p. We write d = (4+2T)-1. T>O. The. by a diret multivariate extesio of Theorem 2.2 of Se (1980b), we may olude that for every (29) k < 2(1+T), lime{k/21is-ellk}<... Note that throughout the paper stads for the maxorm. The (15) holds uder (28)-(29). Atually. the followig represetatio [a oordiatewise extesio of (2.49) of Se (1980b)] is the key to the above results: (~ -e) B-ls (e) + ~ (30) _ - where. uder (28)-(29). as ~. -~I I~ II + 0 a.s. as well as i the kth mea. _ for every k < 2(1+T). Further. {S _ (8).>1} _ - is a martigale sequee [see Se ad Ghosh (1971)]. so that {lis (8)-5 (8) II: m>} is a sub-martigale. Hee -m - -usig the Kolmogorov maximal-iequality alog with the fat that for every m~. E(~m(~)-~(~))(~m(~)-~(~))'= (m-)~' where ~~ as ~. we obtai by some stadard steps that for every >0 ad >O. there exist a * ad a *(>0). suh that for every ~*. (31) (32) Cosequetly. by usig (30). (31) ad (32). we obtai that p{ I maxi <~* ~li~ -~ II > 1 < m: m- ~ _m - (33) for every ~**. r.v. 'so suh that Clearly. if {N} be ay sequee of positive iteger valued -IN +1. i probability. as ~. the by (27) ad (33), as (34) Defiig B as i (24). we let w = sup{-~ii~(~)-~(~)+~~ii: 11 II<-~lOg}. (35) The. as a diret multivariate geeralizatio of (2.37) of Se (1980b). we obtai that for 0 ~ (4+2T) -1. T>O. there exist two positive ostats l. 2 ad a iteger ~. suh that - p{w> 1(10g)I~=~}~2-l-T, ~~~ (36) This last result yields suitable estimates of B alog with their rates of overgee. Note that uder 8. = 0, 5.(0) has a ompletely speified distribu- ) ) tio, symmetri about O. ad hee. for every a(o<a<l) ad, there exists a C(j), suh that p{i.s~ (O}1 > (j)le.=o} > a > p{ls.(0)1 > (j)}. for j =,a. -,a) - ),a '1,...,p, where -~C() + T /2V'" 1<j 3'. T /2 beig the upper 50a% poit of the.a a )) - A') a (") A(") stadard ormal distributio. Let the 8E) = sup{b: s. (b»c ) }. 8 u ). ("), ).a. if{b: S. (b)<-c )} ad Jet ).a
7 B. = 2C(j) /((S(j)-S(j))} j = l... p (37) J.a U. L. The. ~ = Diag(Bl..Bp) is a traslatio-ivariat. robust ad osistet estimator of B. By (36). (37) ad some stadard maipulatios. we obtai that for - -1 every >0 ad 6 ~ (4+2t) t>o. there exist a ostat C (O<<oo) ad a iteger O' suh that for every ~O' PC! IB -BII >d < - l - t - _ - Some other properties of B are studied i the ext setio. _ RANK BASED ESTIMATORS OF r: ASYMPTOTIC PROPERTIES I (20), we replae the ~j by ~j ad deote the resultig sores by.a;j(i), l<i<. l<j<. Let the R.. be the rak of X.. amog X lj.... 'X J " for i = J 1J 1) l... ad j = 1... p. Defie ~ = ((v jj,)) by lettig The _ V is a traslatio-ivariat, robust ad osistet estimator of v, deby (37), we fied by (25) [See Puri ad Se (1971, Ch. 5)]. Defiig the B. J let the (38) E = ~~l~b~l ((Y jj,)) = ((Vjj,/BjBj')) (40) To study the asymptoti properties of r. osider first a asymptoti represe- - tatio for Y. By (28)-(29) ad Theorem of Se (1981), we obtai that for 6 < (4+2t)-1. t>o. where the W. are i.i.d. radom matries with EW V k [0.2+t), ad further II ~* II = O( -~-) _ a.s., as Atually, by the same proof it follows that for every l ad a iteger O' suh that for every ~O' = V ad Ell W. Ilk < 00, _1 ~, for some >O. (39) (41) >0, there exist a fiite PC! I~*II >d > - l - t /2 _ - 1 Also, for the i.i.d. radom matries {Wi}' by the Markov iequality, -1 II} -k II -1 Ilk -1-T/2 P{II I:i=l~i-~ > ~ E I:i=l~i-~ ~ 2 ( ) ; 2 ( )<00 (42). (43) As suh, from (38), (40), (41). (42) ad (43), we obtai that for adequately large, for every >0, p{llr -rll >d - _ C <00 3 Let us ow write _ U =. ~(V_ -v) _ ad Y _ = ~(B-l_B-l). The, by (41) ad the lassial etral limit theorem (o the W.), _1 ~ - N(~'~l) as ~ '(44) (45)
8 where ~l is the disper~io matrix of the ~i' The asymptoti ormality results o y demads some extra regularity oditios. We assume that i (28) I(d /du )!jl.(u)1 <K(l-u).O<u<l (where K<oo) ad i (29). we assume that for J - every >O. there exists a e>o. suh that 00 (46) for every j = 1... p. The. we may use the seod order liearity results of v -1 Huskova (1982). as adapted to the oe-sample ase, ad o1ude that for B a ~ represetatio similar to that i (41) holds. where the remaider term is o( ) a.s., as ~. This represetatio esures both the asymptoti multiormality of \B-l_B- l ) ad the "uiform otiuity i probability" of the \B-l_B- l ). ~ - ~ - Hee. uder these additioal regularity oditios. ~(~~l_~-l) - N(~'~2) (47) for some p s d Writig B- 1 = B ~Y ad V = \I + -~u. we obtai o. " _2' - _ usig (40). (45) ad (47) that uder the regularity oditios metioed above ~(r -r) = 2Y \lb- 1 + B-lU B (-~) - N(O.*) ; * p.s.d. (48) _ -- _p - Also, the asymptoti "uiform otiuity i probability" result: p{ max ~II r r II > } < m: Im-l ~e' _m-- e. follows from the above results. so that (48) exteds of iteger valued radom variables. where -IN +1. as well to a sequee i probability, as {N} ASYMPTOTIC PROPERTIES OF N AND an _ The asymptoti ormality of the R-estimator has already bee osidered i (27). Also. after (29). the momet-overgee result i (IS) has bee studied. ~. (49) I the sequetial ase, the study of (11), (12). (13), (14) ad (16) depeds o the form of the metri p(.) i (2); we assume that the followig holds: (a) For 0 = Ep(~.6). (6) holds with o(f) depedig o F oly through - - r (whih is a futioal of F). i.e., o(f) = o([), ad further, o([) satisfies the (Lipshitz-type) oditio that 10 ([1)-0([2) I ~ Koll[1-r211. V r l E2 (SO) where K is idepedet of the r. ad is the max-orm. 0 -J (b) With q defied as i (6), there exists a fiite. positive that wheever the expetatios exist. Kl suh E{P(~.~)}r ~ KlEII~-~112rq. (r,::l). (51).Note that (50)-(51) hold for eah of the three Metris i (3). Also. ote that i (9). we take d = o(r). The Lipshitz-type oditio (SO) alog with (44) esure. - that for adequately large, for ever~ e>o.
9 (52) Now, by virtue of (44) ad (52), we may virtually repeat the proof of the first part of Theorem 3.1 of Se (1980b) ad olude that (13) holds. Further, (13) ad (34) esure (14). To establish the A.R.E. property i (12), we require to establish some uiform itegrability properties, ad, for these, we eed to put some restrai o h i (10) ad 6 i (28). We let 6 < (4+2T)-1, T > 1 + 2h, h>o (53) so that 6<1/6. Note that by (13), ad (11), it suffies to show that lim '''OEN / o = 1. Hee, by virtue of (4) CT (54) or equivaletly, (55) By virtue of Theorem 2.2 of Se (l980b), wheever, for some a>o, EI'I~lla<oo, uder (28), (29) ad (53), Therefore, by (51) ad (56), lim E{(~ll~-~II)k} < 00, 'if k < 2(1+T) (56) lim {kqe(p(s,e))k} < 00, 'if k < l+t (57) - - With this, we may agai follow the lie of attak of the proof of Theorem 3.2 of Se (1980b), employig the Holder iequality for the two tails ad the uiform itegrability of 115 (e)ll k (k<2 +T)) for the etral part. For iteded brevity, - _ the details are therefore omitted. Fially, to prove where *... oo as (16), we ote that by (10), N ~ ~ = [(-lq)l/(l+q+h)], with probability C+O. Also, by (10), wheever, N>~, - l q6(in ) ~ N~+q, (N-l)q+l < - l q(6(fn -1) + (N-l)-h) where by (8) ad (59), takig (o) q+ 1 = [-lq6 (F)] + 1 ((NC-l)/~)q+l-l Note that for h>~,.by (8) ad (13), as (N/~)q+l_l ~ {6(fN ) - o (E)}fo (I) < {o(in -1) - o(r}}/o(r} + C-lq(N _l)-h(~)-q-l -lq(n _l)-h(o)-q-l (58) (59) (60) (61) (62) so that from (B), (60), (61) ad (62), as do,
10 (o)~{(n Io)q+l_l} - ( o )\6(r _ ) N -15(~))/15(~) pO) Further. by virtue of (49) ad (SO). uder (13), as +O. (63) (~)~{15(EN )-15(E)} - (~)~{6(~o)-15(E)} (64) Hee. wheever h>~ [i (10)] ad ~ (15(r " )-15(r)) is asymptotially ormal. by ~ 1 -- (63) ad (64), (0) {(N/~) q+ -I} is also asymptotially ormal. Fially. by the Slutsky theore~. (g)~{(n/g)q+l-l} asymptotially ormal implies that (o)~{n I -I} is also asymptotially ormal (with a differet asymptoti variae), ad this proves (16). Note that for (64), oe eeds the extra regularity oditios due to Hu~kova (1982); for other results these are ot eeded. I ay ase. her regularity oditios are ot very restritive. ad hold for the ommo types of sore futios; we shall ommet more o these i the last setio. SEQUENTIAL CONFIDENCE SETS Note that defiig v as i (25) ad ~(~) as i earlier. uder ~, while -l(~(~)),~-l(~(~)) - ~ (65) 2 Hee. if x_ stads for the upper 100a% poit of the hi-square distributio "'p.a with p degrees of freedom. we have from (65) ad (66). whe is large. Followig the steps after (36). we defie the (66) (67) for 8*(j) = sup{b: S (b» ~~ X- } L. j jj"l'.a 8~:~) = if{b: Sj(b) <--\;j~.a} 1... p. For every d (>0). osider the a stoppig time N d * = if{~o: m~x (8 *(j) -8*(j)) < 2d} 1931 U, L, - ad the proposed {sequetial) ofidee set is (68) (69) (70) (71) I f we de fie, for every d >0, * d (72) the our basi oer is to verify (17) for I Nd i (71) (whe d+o). ad to show- that. Nd:/d:" 1. i probabiiity. as d+o. These results follow diretly by usig (35) - (36) [where we let b \8 L l< -8) "ad ~(e*u -8)], alog the same _,,
11 I ie as i the uivariate ase [See Se ad Ghosh (J971)], ad hee, the details are omitted. We may also ote that supf~ll'(8 -e)l(l'l)-~: l#o} supf~lllr~r-~(e -e)1 _ (lll)-~: l#o} (73) where hi stads for the largest harateristi root. Now, by (30)-(31), ee -e)'r- l (8 -e) = -l(s (e))'v-l(s (e)) + 0(1) a.s., as ~. Hee, by (65) ad (73), for large Pf~~ (~I~)-~ll' (~-~) I ~-\h;(~)~,al~} ::: 1- a Motivated by (74) ad (44), we may defie a stoppig time N~ (for every d>o), by lettig NO = iff> : d - 0 (74) (75) I this ase, if we defie, for every d>o, O = mi{>: > h (l d- 2 } d p,a (76) the by (44), o 0 Nd/ d + 1, a.s., as d+o (77) while (17) follows from (74), (76) ad (33). The same method of proof of the asymptoti ormality of the stoppig time as i (58)-(64) works out here; we eed (48)-(49) i this otext, ad i tur, these require the more striget regularity oditios due to Hu~kova (1982). SO~ffi GENERAL RE~~RKS I this paper, oly the ase of sequetial R-estimators has bee treated i detail. I the uivariate ase, Jure~kova ad Se (1982) have osidered sequetial M- ad L- estimators. Multivariate geeralizatios of these estimators follow o parallel lies. The oordiatewise uiform itegrability of these estimators, established i Jure~kova ad Se (1982) goes to the vetor ase as well. For the ~l-estimators, based o the vetor ~ of sore futios, the sample (aliged) mea (sore-) produt matrix a be used to estimate the true mea produt matrix, ad uder the assumptio that EII~llr<"", for some r>4, results parallel to (41)-(42) hold for this ovariae matrix too. The estimator of the diagoal matrix with the elemets J~j(x)dF[j](x), l~~ is the (diagoal) matr~x with the margial estimators, osidered i Jure~kova ad Se (1982), ad hee, the overgee properties [parallel to (38) ad (47)] hold uder the same regularity oditios. I view of the fat that the sore futio ~ are take to be essetially bouded, the extra
12 regularity oditios of Hu~kova (1982) are ot eeded here. Similarly, for the L-estimators, the (uivariate) deompositio of Gardier ad Se (1979) goes through i the multivariate ase, ad this yields the asymptoti ormality as well as the rates of overgee of the estimated ovariae matries of suh L estimators. I this otext, the jakkife proedure for obtaiig this estimated ovariae matrix also work out well; we may refer to Se (1982) where the lose oetio of these estimators are disussed i detail. We have osidered oly the first order A.R.E. property. ~fuh more elaborate aalysis will be eeded to pursue higher order A.R.E. results. These are posed as ope problems. We olude this setio with a loser examiatio of the Hu~kovaoditio (46). [Note that will follow so that hex) It suffies to osider the right had tail G(a,d) =j {l-f(x)}-l+df(x-d), a G(a,-d) < G(a,O) = -l{l_f(a)} <00, by symmetry.] We write H(oo) = 00. The, we have 1 - F(x) = exp{-h (x)} is the failure rate (FR) d>o, >O, a>o '" >O, d>o, ad hex) = (d/dx)h(x) ad H(x) is ireasig i d (>0), suh that lim sup{h(x+d)/h(x)} < '(l-)-l, V O<d<d ~ - e Towards this, we ote that if (78) while the lower tail G(z,d) = f exp{(l-)h(x+d)}d(l- exp{-h(x)}) a-d Hee, to verify (46), it suffies to show that for every >O, there exists a x with (79) (80) (81) lim suph(x)/h(x) < < 00 (82) x-- - the for all x (suffiietly large), H(x+d)/H(x) ~ exp(d), for every d>o. Cosequetly, hoosig d (>0) suh that exp(-d ) > 1 -, (8l) follows from (82). Hee, we may verify (82) as well. Note that H(x)+» as x+», so that for the etire lass of d.f. 's with bouded or o-ireasig FR, (82) holds trivially (with = 0). For distributios with ireasig failure rates (I FR), ote that to verify (82), it suffies to show (by itegratio) that lim sup{x-llog(_log{l_f(x)})} < < 00 (83) JC"'OO - ad this geeral oditio holds for almost all IFR d.f.'s (iludig some of the extreme value d.f.'s). Thus, (46) [via (82)-(83)] may ot be regarded at all very restritive. Fially, ote that the oditio that I(d 2 /du 2 ).(u)1 < K(1_u)-2, J - V O<u~l, holds for all the ommoly adapted sore futios (iludig partiularly the ormal sores ad the Wiloxo sores).
13 REFERENCES [1] Gardier, J.C. ad Se, P.K., Asymptoti ormality of a variae estimator of a liear ombiatio of a futio of order statistis, Zeit. Wahrsh. Geb. 50 (1979), Verw. [2] liu~kova, M., O bouded legth sequetial ofidee iterval for parameter i regressio model based o raks, ColI. Math. So. Jaos Bolyai, 32: Noparamet. Statist. If. (1982), [3] liu~kova, M. ad Jure~kova, J., Seod order asymptoti relatios of ~I-estimators ad R-estimators i two-sample loatio model, Jour. Statist. Pla. Ifer. 5 (1981), [4] Jure~kova, M. ad Se, P.K., M-estimators ad L-estimators of loatio: Uiform itegrability ad asymptotially risk-effiiet sequetial versios, Seque. Aal. 1 (1982) [5] Puri, M.L. ad Se, P.K., Noparametri Methods i Multivariate Aalysis (Joh Wiley, New York, 1971). [6] Se, P.K., A ivariae priiple for liear ombiatios of order statistis, Zeit. Wahrsh. Verw. Geb. 42 (1978), [7] Se, P.K., O almost sure liearity theorems for siged rak order statistis, A. Statist. 8 (1980), [8] Se, P.K., O oparametri sequetial poit estimatio of loatio based o geeral rak order statistis, Sakhya, Ser. A 42 (1980), [9] Se, P.K., Sequetial Noparametris: Ivariae Priiples ad Statistial Iferee (Joh Wiley, New York, 1981). [10] Se, P.K., Jakkife L-estimators: Affie struture ad asymptotis, Istitute of Statistis, Uiversity of North Carolia, Mimeo Report No [11] Se, P.K. ad Ghosh, M., O bouded legth sequetial ofidee itervals based o oe-sample rak order statistis. A. Math. Statist. 42 (1971), r
ON NONPARAMETRIC SEQUENTIAL POINT ESTIMATION OF LOCATION BASED ON GENERAL RANK ORDER STATISTICS*
.t~. ON NONPARAMETRIC SEQUENTIAL POINT ESTIMATION OF LOCATION BASED ON GENERAL RANK ORDER STATISTICS* by Praab Kumar Se Departmet of Biostatistis Uiversity of North Carolia at Chapel Hill Istitute of Statistis
More informationSEQUENTIAL POINT ESTIMATION OF ESTIMABLE PAJUU~ETERS BASED ON U-STATISTICS
SEQUENTIAL POINT ESTIMATION OF ESTIMABLE PAJUU~ETERS BASED ON U-STATISTICS Praab Kumar Se Departmet of Biostatistis Uiversity of North Carolia, Chapel Hill by ad Malay Ghosh Iowa State Uiversity Istitute
More informationChapter 8 Hypothesis Testing
Chapter 8 for BST 695: Speial Topis i Statistial Theory Kui Zhag, Chapter 8 Hypothesis Testig Setio 8 Itrodutio Defiitio 8 A hypothesis is a statemet about a populatio parameter Defiitio 8 The two omplemetary
More informationε > 0 N N n N a n < ε. Now notice that a n = a n.
4 Sequees.5. Null sequees..5.. Defiitio. A ull sequee is a sequee (a ) N that overges to 0. Hee, by defiitio of (a ) N overges to 0, a sequee (a ) N is a ull sequee if ad oly if ( ) ε > 0 N N N a < ε..5..
More informationM-ESTIMATORS AND L-ESTIMATORS OF LOCATION; UNIFORM INTEGRABILITY AND ASYMPTOTIC RISK-EFFICIENT SEQUENTIAL VERSIONS
.. M-ESTIMATORS AND L-ESTIMATORS OF LOCATION: UNIFORM INTEGRABILITY AND ASYMPTOTIC RISK-EFFICIENT SEQUENTIAL VERSIONS by JANA JURECKOVA Departmet of Probability &Statistis Charles Uiversity Prague 8, Czehoslovakia
More informationThe beta density, Bayes, Laplace, and Pólya
The beta desity, Bayes, Laplae, ad Pólya Saad Meimeh The beta desity as a ojugate form Suppose that is a biomial radom variable with idex ad parameter p, i.e. ( ) P ( p) p ( p) Applyig Bayes s rule, we
More informationObserver Design with Reduced Measurement Information
Observer Desig with Redued Measuremet Iformatio I pratie all the states aot be measured so that SVF aot be used Istead oly a redued set of measuremets give by y = x + Du p is available where y( R We assume
More informationAfter the completion of this section the student. V.4.2. Power Series Solution. V.4.3. The Method of Frobenius. V.4.4. Taylor Series Solution
Chapter V ODE V.4 Power Series Solutio Otober, 8 385 V.4 Power Series Solutio Objetives: After the ompletio of this setio the studet - should reall the power series solutio of a liear ODE with variable
More informationNonparametric Goodness-of-Fit Tests for Discrete, Grouped or Censored Data 1
Noparametri Goodess-of-Fit Tests for Disrete, Grouped or Cesored Data Boris Yu. Lemeshko, Ekateria V. Chimitova ad Stepa S. Kolesikov Novosibirsk State Tehial Uiversity Departmet of Applied Mathematis
More informationEconomics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator
Ecoomics 24B Relatio to Method of Momets ad Maximum Likelihood OLSE as a Maximum Likelihood Estimator Uder Assumptio 5 we have speci ed the distributio of the error, so we ca estimate the model parameters
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS
MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak
More informationLecture 8. Dirac and Weierstrass
Leture 8. Dira ad Weierstrass Audrey Terras May 5, 9 A New Kid of Produt of Futios You are familiar with the poitwise produt of futios de ed by f g(x) f(x) g(x): You just tae the produt of the real umbers
More information32 estimating the cumulative distribution function
32 estimatig the cumulative distributio fuctio 4.6 types of cofidece itervals/bads Let F be a class of distributio fuctios F ad let θ be some quatity of iterest, such as the mea of F or the whole fuctio
More informationUNIVERSITY OF NORTH CAROLINA Department of Statistics Chapel Hill, N. C. FOR MULTIVARIATE POPULATIONS. J. N. Srivastava.
UNIVERSITY OF NORTH CAROLINA Departmet of Statistics Chapel Hill N. C. A NOTE ON THE BEST LINEAR UNBIASED ESTIMATES FOR MULTIVARIATE POPULATIONS by J. N. Srivastava November 1962 Cotract No. AF 49(638)-213
More informationEECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1
EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum
More informationFluids Lecture 2 Notes
Fluids Leture Notes. Airfoil orte Sheet Models. Thi-Airfoil Aalysis Problem Readig: Aderso.,.7 Airfoil orte Sheet Models Surfae orte Sheet Model A aurate meas of represetig the flow about a airfoil i a
More informationChapter 3. Strong convergence. 3.1 Definition of almost sure convergence
Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i
More informationSx [ ] = x must yield a
Math -b Leture #5 Notes This wee we start with a remider about oordiates of a vetor relative to a basis for a subspae ad the importat speial ase where the subspae is all of R. This freedom to desribe vetors
More informationEfficient GMM LECTURE 12 GMM II
DECEMBER 1 010 LECTURE 1 II Efficiet The estimator depeds o the choice of the weight matrix A. The efficiet estimator is the oe that has the smallest asymptotic variace amog all estimators defied by differet
More informationAsymptotic distribution of products of sums of independent random variables
Proc. Idia Acad. Sci. Math. Sci. Vol. 3, No., May 03, pp. 83 9. c Idia Academy of Scieces Asymptotic distributio of products of sums of idepedet radom variables YANLING WANG, SUXIA YAO ad HONGXIA DU ollege
More informationLECTURE 8: ASYMPTOTICS I
LECTURE 8: ASYMPTOTICS I We are iterested i the properties of estimators as. Cosider a sequece of radom variables {, X 1}. N. M. Kiefer, Corell Uiversity, Ecoomics 60 1 Defiitio: (Weak covergece) A sequece
More informationAxioms of Measure Theory
MATH 532 Axioms of Measure Theory Dr. Neal, WKU I. The Space Throughout the course, we shall let X deote a geeric o-empty set. I geeral, we shall ot assume that ay algebraic structure exists o X so that
More information5 Birkhoff s Ergodic Theorem
5 Birkhoff s Ergodic Theorem Amog the most useful of the various geeralizatios of KolmogorovâĂŹs strog law of large umbers are the ergodic theorems of Birkhoff ad Kigma, which exted the validity of the
More informationNotes 19 : Martingale CLT
Notes 9 : Martigale CLT Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: [Bil95, Chapter 35], [Roc, Chapter 3]. Sice we have ot ecoutered weak covergece i some time, we first recall
More informationBernoulli Numbers. n(n+1) = n(n+1)(2n+1) = n(n 1) 2
Beroulli Numbers Beroulli umbers are amed after the great Swiss mathematiia Jaob Beroulli5-705 who used these umbers i the power-sum problem. The power-sum problem is to fid a formula for the sum of the
More informationCertain inclusion properties of subclass of starlike and convex functions of positive order involving Hohlov operator
Iteratioal Joural of Pure ad Applied Mathematial Siees. ISSN 0972-9828 Volume 0, Number (207), pp. 85-97 Researh Idia Publiatios http://www.ripubliatio.om Certai ilusio properties of sublass of starlike
More informationCONDITIONAL PROBABILITY INTEGRAL TRANSFORMATIONS FOR MULTIVARIATE NORMAL DISTRIBUTIONS
CONDITIONAL PROBABILITY INTEGRAL TRANSFORMATIONS FOR MULTIVARIATE NORMAL DISTRIBUTIONS Satiago Rico Gallardo, C. P. Queseberry, F. J. O'Reilly Istitute of Statistics Mimeograph Series No. 1148 Raleigh,
More informationTR/46 OCTOBER THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION A. TALBOT
TR/46 OCTOBER 974 THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION by A. TALBOT .. Itroductio. A problem i approximatio theory o which I have recetly worked [] required for its solutio a proof that the
More informationPrecise Rates in Complete Moment Convergence for Negatively Associated Sequences
Commuicatios of the Korea Statistical Society 29, Vol. 16, No. 5, 841 849 Precise Rates i Complete Momet Covergece for Negatively Associated Sequeces Dae-Hee Ryu 1,a a Departmet of Computer Sciece, ChugWoo
More informationResampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.
Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator
More informationLecture 19: Convergence
Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may
More informationConstruction of Control Chart for Random Queue Length for (M / M / c): ( / FCFS) Queueing Model Using Skewness
Iteratioal Joural of Sietifi ad Researh Publiatios, Volume, Issue, Deember ISSN 5-5 Costrutio of Cotrol Chart for Radom Queue Legth for (M / M / ): ( / FCFS) Queueig Model Usig Skewess Dr.(Mrs.) A.R. Sudamai
More informationDistribution of Random Samples & Limit theorems
STAT/MATH 395 A - PROBABILITY II UW Witer Quarter 2017 Néhémy Lim Distributio of Radom Samples & Limit theorems 1 Distributio of i.i.d. Samples Motivatig example. Assume that the goal of a study is to
More informationPREDICTION INTERVALS FOR FUTURE SAMPLE MEAN FROM INVERSE GAUSSIAN DISTRIBUTION
Qatar Uiv. Sci. J. (1991), 11: 19-26 PREDICTION INTERVALS FOR FUTURE SAMPLE MEAN FROM INVERSE GAUSSIAN DISTRIBUTION By MUHAMMAD S. ABU-SALIH ad RAFIQ K. AL-BAITAT Departmet of Statistics, Yarmouk Uiversity,
More informationRank tests and regression rank scores tests in measurement error models
Rak tests ad regressio rak scores tests i measuremet error models J. Jurečková ad A.K.Md.E. Saleh Charles Uiversity i Prague ad Carleto Uiversity i Ottawa Abstract The rak ad regressio rak score tests
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationSEMIGROUPS. D. Pfeifer. Communicated by Jerome A. Goldstein Dedicated to E.S. Lyapin on his 70th Birthday
A NOTE ON ~ROBABILISTIC REPRESENTATIONS OF OPERATOR SEMIGROUPS D. Pfeifer Commuicated by Jerome A. Goldstei Dedicated to E.S. Lyapi o his 70th Birthday I the theory of strogly cotiuous semigroups of bouded
More informationExponential Families and Bayesian Inference
Computer Visio Expoetial Families ad Bayesia Iferece Lecture Expoetial Families A expoetial family of distributios is a d-parameter family f(x; havig the followig form: f(x; = h(xe g(t T (x B(, (. where
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More informationProbability 2 - Notes 10. Lemma. If X is a random variable and g(x) 0 for all x in the support of f X, then P(g(X) 1) E[g(X)].
Probability 2 - Notes 0 Some Useful Iequalities. Lemma. If X is a radom variable ad g(x 0 for all x i the support of f X, the P(g(X E[g(X]. Proof. (cotiuous case P(g(X Corollaries x:g(x f X (xdx x:g(x
More informationJournal of Multivariate Analysis. Superefficient estimation of the marginals by exploiting knowledge on the copula
Joural of Multivariate Aalysis 102 (2011) 1315 1319 Cotets lists available at ScieceDirect Joural of Multivariate Aalysis joural homepage: www.elsevier.com/locate/jmva Superefficiet estimatio of the margials
More informationIt is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function.
MATH 532 Measurable Fuctios Dr. Neal, WKU Throughout, let ( X, F, µ) be a measure space ad let (!, F, P ) deote the special case of a probability space. We shall ow begi to study real-valued fuctios defied
More informationSupplementary Material for: Classical Testing in Functional Linear Models
To appear i the Joural of Noparametri Statistis Vol. 00, No. 00, Moth 20XX, 1 16 Supplemetary Material for: Classial Testig i utioal Liear Models Deha Kog a Aa-Maria Staiu b ad Arab Maity b a Departmet
More informationA NEW METHOD FOR CONSTRUCTING APPROXIMATE CONFIDENCE INTERVALS FOR M-ESTU1ATES. Dennis D. Boos
.- A NEW METHOD FOR CONSTRUCTING APPROXIMATE CONFIDENCE INTERVALS FOR M-ESTU1ATES by Deis D. Boos Departmet of Statistics North Carolia State Uiversity Istitute of Statistics Mimeo Series #1198 September,
More informationA new distribution-free quantile estimator
Biometrika (1982), 69, 3, pp. 635-40 Prited i Great Britai 635 A ew distributio-free quatile estimator BY FRANK E. HARRELL Cliical Biostatistics, Duke Uiversity Medical Ceter, Durham, North Carolia, U.S.A.
More informationFixed Point Approximation of Weakly Commuting Mappings in Banach Space
BULLETIN of the Bull. Malaysia Math. S. So. (Seod Series) 3 (000) 8-85 MALAYSIAN MATHEMATICAL SCIENCES SOCIETY Fied Poit Approimatio of Weakly Commutig Mappigs i Baah Spae ZAHEER AHMAD AND ABDALLA J. ASAD
More information1 Inferential Methods for Correlation and Regression Analysis
1 Iferetial Methods for Correlatio ad Regressio Aalysis I the chapter o Correlatio ad Regressio Aalysis tools for describig bivariate cotiuous data were itroduced. The sample Pearso Correlatio Coefficiet
More information17. Joint distributions of extreme order statistics Lehmann 5.1; Ferguson 15
17. Joit distributios of extreme order statistics Lehma 5.1; Ferguso 15 I Example 10., we derived the asymptotic distributio of the maximum from a radom sample from a uiform distributio. We did this usig
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationLecture 3. Properties of Summary Statistics: Sampling Distribution
Lecture 3 Properties of Summary Statistics: Samplig Distributio Mai Theme How ca we use math to justify that our umerical summaries from the sample are good summaries of the populatio? Lecture Summary
More information[412] A TEST FOR HOMOGENEITY OF THE MARGINAL DISTRIBUTIONS IN A TWO-WAY CLASSIFICATION
[412] A TEST FOR HOMOGENEITY OF THE MARGINAL DISTRIBUTIONS IN A TWO-WAY CLASSIFICATION BY ALAN STUART Divisio of Research Techiques, Lodo School of Ecoomics 1. INTRODUCTION There are several circumstaces
More informationLecture 2: Concentration Bounds
CSE 52: Desig ad Aalysis of Algorithms I Sprig 206 Lecture 2: Cocetratio Bouds Lecturer: Shaya Oveis Ghara March 30th Scribe: Syuzaa Sargsya Disclaimer: These otes have ot bee subjected to the usual scrutiy
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationIn this section we derive some finite-sample properties of the OLS estimator. b is an estimator of β. It is a function of the random sample data.
17 3. OLS Part III I this sectio we derive some fiite-sample properties of the OLS estimator. 3.1 The Samplig Distributio of the OLS Estimator y = Xβ + ε ; ε ~ N[0, σ 2 I ] b = (X X) 1 X y = f(y) ε is
More informationMath Third Midterm Exam November 17, 2010
Math 37 1. Treibergs σιι Third Midterm Exam Name: November 17, 1 1. Suppose that the mahie fillig mii-boxes of Fruitlad Raisis fills boxes so that the weight of the boxes has a populatio mea µ x = 14.1
More informationLinear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d
Liear regressio Daiel Hsu (COMS 477) Maximum likelihood estimatio Oe of the simplest liear regressio models is the followig: (X, Y ),..., (X, Y ), (X, Y ) are iid radom pairs takig values i R d R, ad Y
More informationMathematical Statistics - MS
Paper Specific Istructios. The examiatio is of hours duratio. There are a total of 60 questios carryig 00 marks. The etire paper is divided ito three sectios, A, B ad C. All sectios are compulsory. Questios
More informationThe value of Banach limits on a certain sequence of all rational numbers in the interval (0,1) Bao Qi Feng
The value of Baach limits o a certai sequece of all ratioal umbers i the iterval 0, Bao Qi Feg Departmet of Mathematical Scieces, Ket State Uiversity, Tuscarawas, 330 Uiversity Dr. NE, New Philadelphia,
More informationStat 421-SP2012 Interval Estimation Section
Stat 41-SP01 Iterval Estimatio Sectio 11.1-11. We ow uderstad (Chapter 10) how to fid poit estimators of a ukow parameter. o However, a poit estimate does ot provide ay iformatio about the ucertaity (possible
More informationEntropy and Ergodic Theory Lecture 5: Joint typicality and conditional AEP
Etropy ad Ergodic Theory Lecture 5: Joit typicality ad coditioal AEP 1 Notatio: from RVs back to distributios Let (Ω, F, P) be a probability space, ad let X ad Y be A- ad B-valued discrete RVs, respectively.
More information1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a real-valued radom variable
More informationIntegrable Functions. { f n } is called a determining sequence for f. If f is integrable with respect to, then f d does exist as a finite real number
MATH 532 Itegrable Fuctios Dr. Neal, WKU We ow shall defie what it meas for a measurable fuctio to be itegrable, show that all itegral properties of simple fuctios still hold, ad the give some coditios
More informationThe central limit theorem for Student s distribution. Problem Karim M. Abadir and Jan R. Magnus. Econometric Theory, 19, 1195 (2003)
The cetral limit theorem for Studet s distributio Problem 03.6.1 Karim M. Abadir ad Ja R. Magus Ecoometric Theory, 19, 1195 (003) Z Ecoometric Theory, 19, 003, 1195 1198+ Prited i the Uited States of America+
More informationlim za n n = z lim a n n.
Lecture 6 Sequeces ad Series Defiitio 1 By a sequece i a set A, we mea a mappig f : N A. It is customary to deote a sequece f by {s } where, s := f(). A sequece {z } of (complex) umbers is said to be coverget
More informationEstimation for Complete Data
Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of
More informationComputer Science 188 Artificial Intelligence. Introduction to Probability. Probability Ryan Waliany
Computer Siee 88 Artifiial Itelligee Rya Waliay Note: this is meat to be a simple referee sheet ad help studets uder the derivatios. If there s aythig that seems shaky or iorret do t hesitate to email
More informationREGRESSION WITH QUADRATIC LOSS
REGRESSION WITH QUADRATIC LOSS MAXIM RAGINSKY Regressio with quadratic loss is aother basic problem studied i statistical learig theory. We have a radom couple Z = X, Y ), where, as before, X is a R d
More informationStatisticians use the word population to refer the total number of (potential) observations under consideration
6 Samplig Distributios Statisticias use the word populatio to refer the total umber of (potetial) observatios uder cosideratio The populatio is just the set of all possible outcomes i our sample space
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 3 9/11/2013. Large deviations Theory. Cramér s Theorem
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/5.070J Fall 203 Lecture 3 9//203 Large deviatios Theory. Cramér s Theorem Cotet.. Cramér s Theorem. 2. Rate fuctio ad properties. 3. Chage of measure techique.
More informationThis section is optional.
4 Momet Geeratig Fuctios* This sectio is optioal. The momet geeratig fuctio g : R R of a radom variable X is defied as g(t) = E[e tx ]. Propositio 1. We have g () (0) = E[X ] for = 1, 2,... Proof. Therefore
More informationSummation Method for Some Special Series Exactly
The Iteratioal Joural of Mathematis, Siee, Tehology ad Maagemet (ISSN : 39-85) Vol. Issue Summatio Method for Some Speial Series Eatly D.A.Gismalla Deptt. Of Mathematis & omputer Studies Faulty of Siee
More informationLecture 7: Properties of Random Samples
Lecture 7: Properties of Radom Samples 1 Cotiued From Last Class Theorem 1.1. Let X 1, X,...X be a radom sample from a populatio with mea µ ad variace σ
More informationUnbiased Estimation. February 7-12, 2008
Ubiased Estimatio February 7-2, 2008 We begi with a sample X = (X,..., X ) of radom variables chose accordig to oe of a family of probabilities P θ where θ is elemet from the parameter space Θ. For radom
More informationBasics of Probability Theory (for Theory of Computation courses)
Basics of Probability Theory (for Theory of Computatio courses) Oded Goldreich Departmet of Computer Sciece Weizma Istitute of Sciece Rehovot, Israel. oded.goldreich@weizma.ac.il November 24, 2008 Preface.
More informationSolution. 1 Solutions of Homework 1. Sangchul Lee. October 27, Problem 1.1
Solutio Sagchul Lee October 7, 017 1 Solutios of Homework 1 Problem 1.1 Let Ω,F,P) be a probability space. Show that if {A : N} F such that A := lim A exists, the PA) = lim PA ). Proof. Usig the cotiuity
More informationSTK4011 and STK9011 Autumn 2016
STK4 ad STK9 Autum 6 ypothesis testig Covers (most of) the followig material from hapter 8: Setio 8. Setios 8.. ad 8..3 Setio 8.3. Setio 8.3. (util defiitio 8.3.6) Ørulf Borga Departmet of Mathematis Uiversity
More informationMachine Learning Brett Bernstein
Machie Learig Brett Berstei Week Lecture: Cocept Check Exercises Starred problems are optioal. Statistical Learig Theory. Suppose A = Y = R ad X is some other set. Furthermore, assume P X Y is a discrete
More informationON THE RATE Of CONVERGENCE for SOME STRONG APPROXIMATION THEOREMS IN EXTREMAL STATISTICS. Dietma:r Pfe;i.fer
ON THE RATE Of CONVERGENCE for SOME STRONG APPROXIMATION THEOREMS IN EXTREMAL STATISTICS Dietma:r Pfe;i.fer Abstract. Strog approximatio theorems for the logarithms of record ad iter-record times of a
More informationLecture 2: Monte Carlo Simulation
STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?
More informationThe Boolean Ring of Intervals
MATH 532 Lebesgue Measure Dr. Neal, WKU We ow shall apply the results obtaied about outer measure to the legth measure o the real lie. Throughout, our space X will be the set of real umbers R. Whe ecessary,
More informationRegression with quadratic loss
Regressio with quadratic loss Maxim Ragisky October 13, 2015 Regressio with quadratic loss is aother basic problem studied i statistical learig theory. We have a radom couple Z = X,Y, where, as before,
More informationSolutions: Homework 3
Solutios: Homework 3 Suppose that the radom variables Y,...,Y satisfy Y i = x i + " i : i =,..., IID where x,...,x R are fixed values ad ",...," Normal(0, )with R + kow. Fid ˆ = MLE( ). IND Solutio: Observe
More informationSTA Object Data Analysis - A List of Projects. January 18, 2018
STA 6557 Jauary 8, 208 Object Data Aalysis - A List of Projects. Schoeberg Mea glaucomatous shape chages of the Optic Nerve Head regio i aimal models 2. Aalysis of VW- Kedall ati-mea shapes with a applicatio
More informationBasic Probability/Statistical Theory I
Basi Probability/Statistial Theory I Epetatio The epetatio or epeted values of a disrete radom variable X is the arithmeti mea of the radom variable s distributio. E[ X ] p( X ) all Epetatio by oditioig
More informationOptimally Sparse SVMs
A. Proof of Lemma 3. We here prove a lower boud o the umber of support vectors to achieve geeralizatio bouds of the form which we cosider. Importatly, this result holds ot oly for liear classifiers, but
More informationCalculus 2 TAYLOR SERIES CONVERGENCE AND TAYLOR REMAINDER
Calulus TAYLO SEIES CONVEGENCE AND TAYLO EMAINDE Let the differee betwee f () ad its Taylor polyomial approimatio of order be (). f ( ) P ( ) + ( ) Cosider to be the remaider with the eat value ad the
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors
ECONOMETRIC THEORY MODULE XIII Lecture - 34 Asymptotic Theory ad Stochastic Regressors Dr. Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Asymptotic theory The asymptotic
More informationMATH/STAT 352: Lecture 15
MATH/STAT 352: Lecture 15 Sectios 5.2 ad 5.3. Large sample CI for a proportio ad small sample CI for a mea. 1 5.2: Cofidece Iterval for a Proportio Estimatig proportio of successes i a biomial experimet
More informationOFF-DIAGONAL MULTILINEAR INTERPOLATION BETWEEN ADJOINT OPERATORS
OFF-DIAGONAL MULTILINEAR INTERPOLATION BETWEEN ADJOINT OPERATORS LOUKAS GRAFAKOS AND RICHARD G. LYNCH 2 Abstract. We exted a theorem by Grafakos ad Tao [5] o multiliear iterpolatio betwee adjoit operators
More informationLecture 10: Universal coding and prediction
0-704: Iformatio Processig ad Learig Sprig 0 Lecture 0: Uiversal codig ad predictio Lecturer: Aarti Sigh Scribes: Georg M. Goerg Disclaimer: These otes have ot bee subjected to the usual scrutiy reserved
More informationSTAT Homework 1 - Solutions
STAT-36700 Homework 1 - Solutios Fall 018 September 11, 018 This cotais solutios for Homework 1. Please ote that we have icluded several additioal commets ad approaches to the problems to give you better
More informationKernel density estimator
Jauary, 07 NONPARAMETRIC ERNEL DENSITY ESTIMATION I this lecture, we discuss kerel estimatio of probability desity fuctios PDF Noparametric desity estimatio is oe of the cetral problems i statistics I
More informationSTATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. Comments:
Recall: STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS Commets:. So far we have estimates of the parameters! 0 ad!, but have o idea how good these estimates are. Assumptio: E(Y x)! 0 +! x (liear coditioal
More informationSelf-normalized deviation inequalities with application to t-statistic
Self-ormalized deviatio iequalities with applicatio to t-statistic Xiequa Fa Ceter for Applied Mathematics, Tiaji Uiversity, 30007 Tiaji, Chia Abstract Let ξ i i 1 be a sequece of idepedet ad symmetric
More informationRegression with an Evaporating Logarithmic Trend
Regressio with a Evaporatig Logarithmic Tred Peter C. B. Phillips Cowles Foudatio, Yale Uiversity, Uiversity of Aucklad & Uiversity of York ad Yixiao Su Departmet of Ecoomics Yale Uiversity October 5,
More informationPrincipal Component Analysis. Nuno Vasconcelos ECE Department, UCSD
Priipal Compoet Aalysis Nuo Vasoelos ECE Departmet, UCSD Curse of dimesioality typial observatio i Bayes deisio theory: error ireases whe umber of features is large problem: eve for simple models (e.g.
More informationCS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 5
CS434a/54a: Patter Recogitio Prof. Olga Veksler Lecture 5 Today Itroductio to parameter estimatio Two methods for parameter estimatio Maimum Likelihood Estimatio Bayesia Estimatio Itroducto Bayesia Decisio
More informationElement sampling: Part 2
Chapter 4 Elemet samplig: Part 2 4.1 Itroductio We ow cosider uequal probability samplig desigs which is very popular i practice. I the uequal probability samplig, we ca improve the efficiecy of the resultig
More informationINEQUALITIES BJORN POONEN
INEQUALITIES BJORN POONEN 1 The AM-GM iequality The most basic arithmetic mea-geometric mea (AM-GM) iequality states simply that if x ad y are oegative real umbers, the (x + y)/2 xy, with equality if ad
More information