ON ASYMPTOTIC REPRESENTATIONS FOR REDUCED QUANTILES IN SAMPLING FROM A LENGTH-BIAS~D DISTRIBUTION. Pranab Kumar Sen

Size: px
Start display at page:

Download "ON ASYMPTOTIC REPRESENTATIONS FOR REDUCED QUANTILES IN SAMPLING FROM A LENGTH-BIAS~D DISTRIBUTION. Pranab Kumar Sen"

Transcription

1 ON SYMTOTIC RERESENTTIONS FOR REDUCED QUNTILES IN SMLING FROM LENGTH-BIS~D DISTRIBUTION hy raab Kumar Se Departmet of Biostatistics Uiversity of North Carolia at Chapel Hill Istitute of Statistics Mimeo Series No October 1982

2 ON SYMTOTIC RERESENTTIONS FOR REDUCED QUNTILES IN SMLING FROM LENGTH-BISED DISTRIBUTION * BY RNB KUMR SEN Uiversity of North CaroZia~ ChapeZHiZZ. Noparametric estimatio of the quatiles of a distributio based o a sample from the correspodig legth-biased distributio is cosidered. log with some represetatios of this estimator i terms of," e averages of idepedet radom variables, some limitig results are established. The case of the reduced quatile process is treated briefly. MS Subject CZassificatio : 60F05, 62E20, 62G05 KeyWords ad hrases: symptotic ormality, Bahadur-represetatio, empirical process, ivariace priciples, reduced quatiles ad quatile process, weak covergece. * Work partially supported by the Natioal Heart, Lug ad Blood Istitute, Cotract NIH-NHLBI L from the Natioal Istitutes of Health.

3 1 ~ Let YI""'Y be idepedet ad idetically distributed (igied.) oegative radom variables (r.v.) from a distributio G, defied o R+ == [0,(0). G = G p is called a lesth-biased distributio correspodig to a +. distributio F (alsa defied o R ), 1f (1.1) Gp(Y) = }J-l f~ xd(x), for every y E: R+, where (1.2) }J 00 = faxdf(x) is assumed to be fiite. The distributio fuctio (d. f.) G p arises aturally i may fields; see for example, Gox(1969), atil ad Rao (1977,1978) ad Colema (1979) where may life applicatios are cosidered. We assume that the uderlyig d.f. F admits a uique p-quatile ~ = ~ (F),i.e., p p (1. 3) F(x) = phas a uique solutio ~p' where a < p < 1. Our mai iterest is to provide a oparametric estimate of ~p based o Y l,, Y, ad to study its various properties. For a somewhat related problem (based o a mixture of a ordiary ad a legth-biased distributio), we may refer to Vardi (l982a,b) Let Y 1 < < Y be the order statistics correspodig to Yl,,Y : -. - : The, the sample p-quatile correspodig to ~p is defied by Y : k where k is a suitably chose (radom) iteger, depedig o all the order statistics. This estimator is formally defied i Sectio 2, where the basic regularity coditios are also itroduced. Sectio 3 is devoted to the study of the large sample properties of this estimator based o (i) the weak covergece of some related empirical processes, (li) Bahadur (1966) represetatio of sample quatiles ad (iii) some strog ivariace priciples for the empirical distributios. Some geeral remarks are appeded i the cocludig sectio. ~!~~vs~etl..~~!..~~. Note that by (1.1) ad (1. 2), -1-1 ~ -1 ~p. -1 ~p -1 (2.1) }J =}J fo df(x) =}J f O x xdf(x) = f~ x dg(x), so that (2.2) -1 = 00-1 }J fox dg(x)

4 2 Let G (y) = -le~ 1 1= I (2.1) ad (2.2), G (2.3) ad for + I(Y i ~ y), Y E R be the empirical d.f. based o Yl,,Y we replace the true d.f. G by its oparametric estimator _I ~ give by -1 ~, we obtai the estimator _I 1 1 = - E~ Y-. ~ 1=1 :l Notig that the d.f. G is a step fuctio, we ow defie a (radom) iteger k (;:; K ) (2.4) K by = max{ k : k -1 E. 1 Y. 1= :l Note that depedig o the value of p (O<p<l) ad the Y.,i;:;l,,, the iequality 1 i (2.4) may ot hold eve for k=l This is particularly true whe may be small ad p is close to zero. We by lettig K ;:; may,however, remove this techical difficulty -1 -l 1 wheever Y : l > p( Ei=lY : i ). Thus, K is a positive iteger valued radol variable, ad, for every, p{ 1 < K < } = 1. The sample - - estimator of (2.5) We ~p is the take as ~,p = Y, where K is defied by (2.4). :K e- may remark that i the classical case, the sample p-quatile is defied by the kth largest order statistics, where k is a positive iteger such that ki is closest to p. However, i (2.5), the estimator comes out as a order statistic with a radom idex K whose properties are ot all that kow.i fact, K i (2.4) is defied i teris of partial sums of reciprocals of order statistics which are either idepedet or idetically distributed. Hece, the classical reewal theory results may ot "'_I -1-1 Note that by (2.3), ~ = ri=ly i has expectatio ) -2 (2.6) Y = f O y dg(y) - ~ = f O x df(x ~ apply directly to K -1 d ~ a var1ace y, where where we assume that E y- 2 = E X-I = v 2 < 00 The, by the classical cetral G F limit theorem, as (2.7) so that +00, 1 "'_I ~( ~ ~-l )1 y ~ x (0, 1), (2.8) ~-1) = 0 (1)

5 -1-2 Further, ote that a(x) = x has a cotiuous derivative al(x) = -x for all X E (0,00), so that by (2.7) ad (2.8), (2.9) ~ 2 ~ _I -1 ( ~- ~ ) = ~ (~ - ~ ) + Opel) 2 2 ~ " (0, ~ y ). These results will be useful i our subsequet aalysis. We 3 also assume that the d.f. F has a cotiuous probability desity fuctio (p.d.f.) f i some eighbourhood of t,; p G, is give by g(x) ad f(~') is strictly positive. Note that g, the p.d. f. of = xf(x), so that otig that ~ E (0, 00), we have p (2.10) 00 We may eed some other regularity coditios which will be itroduced as the occasios arise.,,~.v!y~"a!,j::.~p..:r:.e~~!.1t~t:~?~, '?f ~~p Let us deote by (3.1) H(x) = ~ y-ldg(y) ad H(x) = f~ y-ldg(y), for x (0,00 ). The, ote that both Had Hare odecreasig, ad, by (2.1)-(2.4), (3.2) H(~ ) = p/~ = p 1I(00) ad H(Y : K ) ~ ph(oo) < H(Y : K +1), where, covetioally, we let Y : = 00 Further, for every x (0,00 ), we + l let Y. (x) = Y. I(Y. < x), l=l,.,, so that ~ ~ -~ -1 (3.3) [H(x) - H(x)] = l:i=l[ Y i (x) where ~ 2.)('(0,. Yx ), (3.4) Yx 2 -_ fx o y-2dg (y) - (fx y- l dg(y))2. f ( ) o exists or every x 0,00. The~ we have the followig Theorem 1. If v < 00 (3.5) roof. Note that for every x > 0, ad (2.10) holds, the, as ~ 00 } -~ {-l -l} -~ {-1 -I}. - ~ ='p L 1 Y. ~ - l:. 1 Y.. ~ )-p~. +0 (1). 1= 1 1= 1 (3.6) ~H(x) - ~H(x) = ~{H(x)-H(;X)} +(~-~){HCx)-H(;X)} +(}1 -~)H(x). _1: lso, if we let x = ~p ±.C 2, for some fiite CC> 0), the, it ca be show that (3.3) holds with the further simplificatio that Y~ may be replaced by Y~ s such, by (2.9), (3.3) ad (3.6), we coclude that for every >0, there exist

6 a c «00) ad a iteger, such that for every (fixed) C ad >, 0-0 (3.7) O the (3.8) while, k I k k { 2 ~ H (s ±C- 2 ) - ~H(~ ±C- 2 ) I> c } < /2. p p k other had, if we let -!:2 J = {x: ~ - C- 2 < x < ~ +C p - - k 1 ~ H (~ -C- 2) < ~ H. (x) < ~ H (~ +C -~ ), V x p - - p by (2.10), as + 00 (3.8) ad (3.9) that,by virtue s J, k -!:2 (3.9) 2 {~H(~ ± C )_ ~H(~')} + ± C~f(~ ). p Hece, if we choose C so large that ~Cf(~) > c we coclude from (3.7), p. }, the of (3.2), amely, llh(y : K ):: p< ~H(Y:K +1),. (3.10) p{ Y : K S I } ~ 1 -,for every ~ o Havig obtaied this weaker boud fory : K,we like to exted a result of Ghosh(1971) o (a weaker) Bahadur represetatio of sample quatiles to our H ad employ the same for the proof of (3.5). Note that by (3.6), for every x,y E: I, (3.11) where, by '" ~ H (x)- ~H(x) - ~ H (y) + ~H(y) = ]J { H (x)- H(x) - H (y) + H(y)} + (J1 -]J ){. H(x)- H(y)}, (2.9), (2.10) ad the defiitio of I ' 4 e -, (3.12) sup{ I( ~ -]J ){H(x) - H(y)}1 : x,y S I } = Ope-I), 0~1 =Op(l),.while, usig the idetity that for x >- y, (3.13) H (x) - H (y) - H(x) + H(y) = fxu-ld[g (u) - G(u)] y = x-l{g (x)-g(x)} _y-l{g (y) _ G(y)} + fx u- 2 {G (u)-g(u)} du. y alog with (2.10) ad the Bahadur (1966) represetatio: (3.14) sup{ IG (x)-g (y) - G(x) + G(y)1 : x,y s J } = (- 3 / 4 log ), p we coclude that (3.15) sup { ~ IH(X) - H(x) -. H(Y) + H(y) I} = 0p(- 1 / 4 10g ) x,y sj By virtue of (3.10).ad (3.15J,,we.c(1)c1ude that k (3.16) 2{H (Y K) - H(Y K)} = 2 { H (~ ) - H(~ )} + 0 (1). : : p p p' so that, by (3.6), (3.15) ad (3.16), we have k

7 5 (3.17) where H(~ ) k (3.18).2{ Fially, H I (x) = Note k.2 h.l H (Y:K ) - j..ih (Y : K ) } k k =.2 {H (~ ) - H(~ )} + H(~ ).2 (j..i p p p -1 = j..i p ad j..ih(y:k) = p + -1 } j..i p - H(Y : K ) - j..i) + Opel) ~{ k = ~ H (~ ) - H(~ )} + p.2( j..i -j..i) + 0 (1). p p p -1 ope ). Hece, as + 00, (3.5) follows from (3.18), (2.7), (2.9) ad the fact that for x J, -1. x g(x) = f(x) + f(~ ) as Q.E.D. that {py~l.:.p j..i-l _ y~l(~ ) + pj..l-l = py~l_y~l(~ ), i > l} form a ]. 1 IIp sequece of i.i.d.r.v.'s with mea zero ad variace 2 2 ~p (3.19) a = (l-p) f O Y dg(y) + p J~ Y dg(y) ad hece, by (3.5) ad the cetral limit theorem, we arrive at the followig. Theorem 2. Uder the hypothesis of Theorem 1, (3.20) This result as well as (3.5) ca be exteded to several quatiles uder o extra regularity coditios. 4. Some geeral remarks. I (3.5), we have cosidered a weak represetatio for.,._ ,~. _~.T... _ - _...ot-... '... ' ,~ '..._J... ~ where the precise order of the remaider term has ot bee studied. If, i,p additio to (2.10), we assume that i some eighbourhood of ~, the p.d.f. f has p a bouded first derivative f', the, otig that g'(x) = (d/dx){xf(x)} = f(x) + xf'(x), we coclude that g' is also bouded i the same eighbourhood. s such, * k ~ we may let J = {x : I x -.~ I <C-.2 (log) } ad parallel to (3.10), we may p - * claim that Y : K I almost surely (a.s.), as + 00, while i (3.14), we may ot oly use the order as we obtai that as --7 oo, (4.1) I I - 3 / 4 log a.s., but also, by Taylor's expasio, *} sup{ -3/4 g(~ ){x - ~}- G(x) + G(~p) : x I = O( log ) a.s. p p s such, we obtai that uder this additioal regularity coditio, i (3.5), we have a almost sure represetatio with a remaider term O(- 3 / 4 log ).

8 6 Secodly, istead of the behaviour of a sigle quatile, if we like to study!,; the same for the etire process { 2 ( ~ - ~ ) ; O<p<l}, we may eed a more,p p striget momet coditio. Note that v < implies that as x f 0, x G(x) ~ 0, though the rate of this covergece is ot precisely kow. If we assume that oo -2-0 (4.2) = f Y dg(y) a the, we obtai that < 00 for some 0 > 0, (4.3) x- 2 - O G(x) ~ a as x f O. lso, by (3.1), for every x > 0, (4.4) (4.6)!,; 2{H (x) - Hex)} = -1 ~ = x IG (x) Further, it follows from O'Reilly (1974) that for every > 0,!,;!,; + (4.5) sup{ 2IG (x)-g(x)]/{g(x) [l-g(x)]} 2- : x R } = 0 (1), p. so that by (4.3) ad (4.5), for every x (0, ), as ~ 0, x-l~[g(x) - G(x)] = (~[G(X)-G(X)J/{G(X)[l-G(X)]}~-f)G(X)[l-G(X)J}~-E/x e. coverges to 0, i probability, where we choose so small that (2+0)(~ - ) > 1. s such, the represetatio i (4.4) is valid for every x > 0, ad, usig (3.6) ad (4.4), we have x -2!'; (4.7) ~[J..l H (x) - J..lH(x)J = J..lx- ~[G (x)-g(x)j +J..lf O y 2 IG (y)-g(y)]dy. If we let WO(G(x» (4.8) 1 + H(x)~( J..l - J..l) + opel) a.e. -I!,; x -2!'; = J..lX 2 IG (x)-g(x)] + }lf O y 2 [G (y)-g(y)]dy + p (x,y) = q !,; - H(x)J..l fa y d{ 2 IG (y) - G(y)]} + opel) a.e.!,; + = 2 [G (x)-g(x)], x R ad defie the p metric by q sup{ Ix(t)-y(t)l/q(t); O<t<l} ;"q(t) ={t(1-t)}~-, the, the weak covergece of WO = {Wo(t),O<t<l} to a tied-dow Wieer process W O, i the p metric i (4.8), follows from O'Reilly(1974), ad hece, usig q.!,; + (4.3) ad (4.7), the weak covergece of 2[ll H (x) -. ph (x) Lx R to a Gaussia. process follows readily. Thus, if we defie W * = {w* (t);o<t<l} by lettig!,; W*(G(x» = 2 + [ II H (x) - llh(x)], x Rad W * = {W* (t);o<t<l} by lettig

9 7 o. bet) W*(t) = }Jb(t)W (t) +}Jf o b (s)w (s)db(s) - H(b(t))}J fa W (s)b (s)db(s), for O<t<l where bet) = G-l(t), t (0,1), the, we have * ~. * (4.9) W ~ W,i the Skorokhod Jl-topology o D[O,l]. * Note that the covariace fuctio of W is give by (4.10) * * EW (s)w (t) = (1-5) (l-t) vst + st (V l - vsf\t). where (4.11) -(Sl\t}(V svt - VSf\t)' t.:t 2 v = fa y- dg(y),for t (0,1). t l.j 2 (s,t) (0,1), lso, i (2.4), we deote the solutio K by K (p) ad assume that f(t.: ) is. p strictly positive (ad fiite) for all p :O<p<l. The, istead of the Bahadurrepresetatio i (3.14), if we use its geeralizatio by Kiefer(l967) ad 0_ use (4.9), the, we are able to show that for every c > 0, as + 00, (412) sup 2!,,; I I!,,; y r: j(log)2 < c a.s., p (O, 1). :K (p) - '""p ad further, (3.18) holds simultaeously for all p E (0,1). s such, the weak 1 ivariace priciple for { ~[ t.: - ~ ]; O<p<l} follows from this exteded,p p versio of (3.18), (4.9) ad the radom chage of time results i Billigsley (1968,pp.144-lS0). Further, usig the results of Csaki (1977), (4.7) may be stregtheed to a a.s. represetatio,ad hece, strog ivariace priciples (as well as the law of iterated logarithm) for the reduced quatile process also follow uder the additioal regularity coditios (4.2) ad that sup{ Iff (x) I :x E R+} < 00

10 REFERENCES.- [1] BHDUR, R.R. (1966). ote o quatiles i large samples.. Math. Statist. 37, [2] BILLINGSLEY,. (1968). Covergece of robability Measures. Joh Wiley, New York. [3] COLEMN, R. (1979). Itroductio to Mathematical Stereology. Memoirs No. 3, Dept. of Theoretical Statistic.,Uiv. of arhus, Demark. [4] COX, D.R. (1969)~ Some samplig problems i techology. I New Developmets i Survey Samplig{ eds: N.L.Johso ad H. Smith), Wiley, New York. [5] CSKI, E. (1977). The law of iterated logarithm for ormalized empirical distributio fuctio. Zeit. Wahrsch. ve'1j). Geb. 38 J [6] GHOSH, J.K. (1971). ew proof of the Bahadur represetatio of quatiles ad a applicatio.. Math. Statist. 42 J [7]. KIEFER, J. (1967). O Bahadur's represetatio of sample quatiles.. Math. Statist. 38, [8] TIL, G.p. ad RO, C.R. (1977). The weighted distributios: survey of their applicatios. I pplicatios of Statistics Ced:.R. Krishaiah) North Hollad, msterdam, pp [9] TIL, G.. ad RO, C.R.(l978). Weighted distributios ad size-biased samplig with applicatios to wildlife populatios ad huma families. Biometrics 34 J [10] O'Reilly, N.E. (1974). O the weak covergece of empirical processes i sup-orm metrics..robability 2 J [ll] VRDI, Y. (1982a). Noparametric estimatio i the presece of legth-bias.. Statist. loj [12] VRDI, Y. (1982b). Noparametric estimatio i reewal processes.. Statist. loj

THE LIM;I,TING BEHAVIOUR OF THE EMPIRICAL KERNEL DISTRIBDTI'ON FUNCTION. Pranab Kumar Sen

THE LIM;I,TING BEHAVIOUR OF THE EMPIRICAL KERNEL DISTRIBDTI'ON FUNCTION. Pranab Kumar Sen -e ON THE LIM;I,TING BEHAVIOUR OF THE EMPIRICAL KERNEL DISTRIBDTI'ON FUNCTION By Praab Kumar Se Departmet of Biostatistics Uiversity of North Carolia at Chapel Hill Istitute of Statistic~ Mimeo Series

More information

Convergence of random variables. (telegram style notes) P.J.C. Spreij

Convergence of random variables. (telegram style notes) P.J.C. Spreij Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space

More information

4. Partial Sums and the Central Limit Theorem

4. Partial Sums and the Central Limit Theorem 1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems

More information

LECTURE 8: ASYMPTOTICS I

LECTURE 8: ASYMPTOTICS I LECTURE 8: ASYMPTOTICS I We are iterested i the properties of estimators as. Cosider a sequece of radom variables {, X 1}. N. M. Kiefer, Corell Uiversity, Ecoomics 60 1 Defiitio: (Weak covergece) A sequece

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i

More information

This section is optional.

This section is optional. 4 Momet Geeratig Fuctios* This sectio is optioal. The momet geeratig fuctio g : R R of a radom variable X is defied as g(t) = E[e tx ]. Propositio 1. We have g () (0) = E[X ] for = 1, 2,... Proof. Therefore

More information

Distribution of Random Samples & Limit theorems

Distribution of Random Samples & Limit theorems STAT/MATH 395 A - PROBABILITY II UW Witer Quarter 2017 Néhémy Lim Distributio of Radom Samples & Limit theorems 1 Distributio of i.i.d. Samples Motivatig example. Assume that the goal of a study is to

More information

Precise Rates in Complete Moment Convergence for Negatively Associated Sequences

Precise Rates in Complete Moment Convergence for Negatively Associated Sequences Commuicatios of the Korea Statistical Society 29, Vol. 16, No. 5, 841 849 Precise Rates i Complete Momet Covergece for Negatively Associated Sequeces Dae-Hee Ryu 1,a a Departmet of Computer Sciece, ChugWoo

More information

Asymptotic distribution of products of sums of independent random variables

Asymptotic distribution of products of sums of independent random variables Proc. Idia Acad. Sci. Math. Sci. Vol. 3, No., May 03, pp. 83 9. c Idia Academy of Scieces Asymptotic distributio of products of sums of idepedet radom variables YANLING WANG, SUXIA YAO ad HONGXIA DU ollege

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

Lecture 19: Convergence

Lecture 19: Convergence Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may

More information

32 estimating the cumulative distribution function

32 estimating the cumulative distribution function 32 estimatig the cumulative distributio fuctio 4.6 types of cofidece itervals/bads Let F be a class of distributio fuctios F ad let θ be some quatity of iterest, such as the mea of F or the whole fuctio

More information

Self-normalized deviation inequalities with application to t-statistic

Self-normalized deviation inequalities with application to t-statistic Self-ormalized deviatio iequalities with applicatio to t-statistic Xiequa Fa Ceter for Applied Mathematics, Tiaji Uiversity, 30007 Tiaji, Chia Abstract Let ξ i i 1 be a sequece of idepedet ad symmetric

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak

More information

ECE 901 Lecture 12: Complexity Regularization and the Squared Loss

ECE 901 Lecture 12: Complexity Regularization and the Squared Loss ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality

More information

ECE 330:541, Stochastic Signals and Systems Lecture Notes on Limit Theorems from Probability Fall 2002

ECE 330:541, Stochastic Signals and Systems Lecture Notes on Limit Theorems from Probability Fall 2002 ECE 330:541, Stochastic Sigals ad Systems Lecture Notes o Limit Theorems from robability Fall 00 I practice, there are two ways we ca costruct a ew sequece of radom variables from a old sequece of radom

More information

1 Convergence in Probability and the Weak Law of Large Numbers

1 Convergence in Probability and the Weak Law of Large Numbers 36-752 Advaced Probability Overview Sprig 2018 8. Covergece Cocepts: i Probability, i L p ad Almost Surely Istructor: Alessadro Rialdo Associated readig: Sec 2.4, 2.5, ad 4.11 of Ash ad Doléas-Dade; Sec

More information

Introduction to Probability. Ariel Yadin

Introduction to Probability. Ariel Yadin Itroductio to robability Ariel Yadi Lecture 2 *** Ja. 7 ***. Covergece of Radom Variables As i the case of sequeces of umbers, we would like to talk about covergece of radom variables. There are may ways

More information

Berry-Esseen bounds for self-normalized martingales

Berry-Esseen bounds for self-normalized martingales Berry-Essee bouds for self-ormalized martigales Xiequa Fa a, Qi-Ma Shao b a Ceter for Applied Mathematics, Tiaji Uiversity, Tiaji 30007, Chia b Departmet of Statistics, The Chiese Uiversity of Hog Kog,

More information

Notes 19 : Martingale CLT

Notes 19 : Martingale CLT Notes 9 : Martigale CLT Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: [Bil95, Chapter 35], [Roc, Chapter 3]. Sice we have ot ecoutered weak covergece i some time, we first recall

More information

FLUID LIMIT FOR CUMULATIVE IDLE TIME IN MULTIPHASE QUEUES. Akademijos 4, LT-08663, Vilnius, LITHUANIA 1,2 Vilnius University

FLUID LIMIT FOR CUMULATIVE IDLE TIME IN MULTIPHASE QUEUES. Akademijos 4, LT-08663, Vilnius, LITHUANIA 1,2 Vilnius University Iteratioal Joural of Pure ad Applied Mathematics Volume 95 No. 2 2014, 123-129 ISSN: 1311-8080 (prited versio); ISSN: 1314-3395 (o-lie versio) url: http://www.ijpam.eu doi: http://dx.doi.org/10.12732/ijpam.v95i2.1

More information

A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS

A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS J. Japa Statist. Soc. Vol. 41 No. 1 2011 67 73 A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS Yoichi Nishiyama* We cosider k-sample ad chage poit problems for idepedet data i a

More information

Information Theory and Statistics Lecture 4: Lempel-Ziv code

Information Theory and Statistics Lecture 4: Lempel-Ziv code Iformatio Theory ad Statistics Lecture 4: Lempel-Ziv code Łukasz Dębowski ldebowsk@ipipa.waw.pl Ph. D. Programme 203/204 Etropy rate is the limitig compressio rate Theorem For a statioary process (X i)

More information

Journal of Multivariate Analysis. Superefficient estimation of the marginals by exploiting knowledge on the copula

Journal of Multivariate Analysis. Superefficient estimation of the marginals by exploiting knowledge on the copula Joural of Multivariate Aalysis 102 (2011) 1315 1319 Cotets lists available at ScieceDirect Joural of Multivariate Aalysis joural homepage: www.elsevier.com/locate/jmva Superefficiet estimatio of the margials

More information

1 Introduction to reducing variance in Monte Carlo simulations

1 Introduction to reducing variance in Monte Carlo simulations Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by

More information

Chapter 6 Infinite Series

Chapter 6 Infinite Series Chapter 6 Ifiite Series I the previous chapter we cosidered itegrals which were improper i the sese that the iterval of itegratio was ubouded. I this chapter we are goig to discuss a topic which is somewhat

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 Fuctioal Law of Large Numbers. Costructio of the Wieer Measure Cotet. 1. Additioal techical results o weak covergece

More information

for all x ; ;x R. A ifiite sequece fx ; g is said to be ND if every fiite subset X ; ;X is ND. The coditios (.) ad (.3) are equivalet for =, but these

for all x ; ;x R. A ifiite sequece fx ; g is said to be ND if every fiite subset X ; ;X is ND. The coditios (.) ad (.3) are equivalet for =, but these sub-gaussia techiques i provig some strog it theorems Λ M. Amii A. Bozorgia Departmet of Mathematics, Faculty of Scieces Sista ad Baluchesta Uiversity, Zaheda, Ira Amii@hamoo.usb.ac.ir, Fax:054446565 Departmet

More information

Bull. Korean Math. Soc. 36 (1999), No. 3, pp. 451{457 THE STRONG CONSISTENCY OF NONLINEAR REGRESSION QUANTILES ESTIMATORS Seung Hoe Choi and Hae Kyung

Bull. Korean Math. Soc. 36 (1999), No. 3, pp. 451{457 THE STRONG CONSISTENCY OF NONLINEAR REGRESSION QUANTILES ESTIMATORS Seung Hoe Choi and Hae Kyung Bull. Korea Math. Soc. 36 (999), No. 3, pp. 45{457 THE STRONG CONSISTENCY OF NONLINEAR REGRESSION QUANTILES ESTIMATORS Abstract. This paper provides suciet coditios which esure the strog cosistecy of regressio

More information

Advanced Stochastic Processes.

Advanced Stochastic Processes. Advaced Stochastic Processes. David Gamarik LECTURE 2 Radom variables ad measurable fuctios. Strog Law of Large Numbers (SLLN). Scary stuff cotiued... Outlie of Lecture Radom variables ad measurable fuctios.

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 6 9/23/2013. Brownian motion. Introduction

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 6 9/23/2013. Brownian motion. Introduction MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/5.070J Fall 203 Lecture 6 9/23/203 Browia motio. Itroductio Cotet.. A heuristic costructio of a Browia motio from a radom walk. 2. Defiitio ad basic properties

More information

Lecture 15: Density estimation

Lecture 15: Density estimation Lecture 15: Desity estimatio Why do we estimate a desity? Suppose that X 1,...,X are i.i.d. radom variables from F ad that F is ukow but has a Lebesgue p.d.f. f. Estimatio of F ca be doe by estimatig f.

More information

CONDITIONAL PROBABILITY INTEGRAL TRANSFORMATIONS FOR MULTIVARIATE NORMAL DISTRIBUTIONS

CONDITIONAL PROBABILITY INTEGRAL TRANSFORMATIONS FOR MULTIVARIATE NORMAL DISTRIBUTIONS CONDITIONAL PROBABILITY INTEGRAL TRANSFORMATIONS FOR MULTIVARIATE NORMAL DISTRIBUTIONS Satiago Rico Gallardo, C. P. Queseberry, F. J. O'Reilly Istitute of Statistics Mimeograph Series No. 1148 Raleigh,

More information

Central limit theorem and almost sure central limit theorem for the product of some partial sums

Central limit theorem and almost sure central limit theorem for the product of some partial sums Proc. Idia Acad. Sci. Math. Sci. Vol. 8, No. 2, May 2008, pp. 289 294. Prited i Idia Cetral it theorem ad almost sure cetral it theorem for the product of some partial sums YU MIAO College of Mathematics

More information

Central Limit Theorem using Characteristic functions

Central Limit Theorem using Characteristic functions Cetral Limit Theorem usig Characteristic fuctios RogXi Guo MAT 477 Jauary 20, 2014 RogXi Guo (2014 Cetral Limit Theorem usig Characteristic fuctios Jauary 20, 2014 1 / 15 Itroductio study a radom variable

More information

ST5215: Advanced Statistical Theory

ST5215: Advanced Statistical Theory ST525: Advaced Statistical Theory Departmet of Statistics & Applied Probability Tuesday, September 7, 2 ST525: Advaced Statistical Theory Lecture : The law of large umbers The Law of Large Numbers The

More information

It is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function.

It is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function. MATH 532 Measurable Fuctios Dr. Neal, WKU Throughout, let ( X, F, µ) be a measure space ad let (!, F, P ) deote the special case of a probability space. We shall ow begi to study real-valued fuctios defied

More information

Basics of Probability Theory (for Theory of Computation courses)

Basics of Probability Theory (for Theory of Computation courses) Basics of Probability Theory (for Theory of Computatio courses) Oded Goldreich Departmet of Computer Sciece Weizma Istitute of Sciece Rehovot, Israel. oded.goldreich@weizma.ac.il November 24, 2008 Preface.

More information

ON THE RATE Of CONVERGENCE for SOME STRONG APPROXIMATION THEOREMS IN EXTREMAL STATISTICS. Dietma:r Pfe;i.fer

ON THE RATE Of CONVERGENCE for SOME STRONG APPROXIMATION THEOREMS IN EXTREMAL STATISTICS. Dietma:r Pfe;i.fer ON THE RATE Of CONVERGENCE for SOME STRONG APPROXIMATION THEOREMS IN EXTREMAL STATISTICS Dietma:r Pfe;i.fer Abstract. Strog approximatio theorems for the logarithms of record ad iter-record times of a

More information

A NEW METHOD FOR CONSTRUCTING APPROXIMATE CONFIDENCE INTERVALS FOR M-ESTU1ATES. Dennis D. Boos

A NEW METHOD FOR CONSTRUCTING APPROXIMATE CONFIDENCE INTERVALS FOR M-ESTU1ATES. Dennis D. Boos .- A NEW METHOD FOR CONSTRUCTING APPROXIMATE CONFIDENCE INTERVALS FOR M-ESTU1ATES by Deis D. Boos Departmet of Statistics North Carolia State Uiversity Istitute of Statistics Mimeo Series #1198 September,

More information

Random Variables, Sampling and Estimation

Random Variables, Sampling and Estimation Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig

More information

TR/46 OCTOBER THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION A. TALBOT

TR/46 OCTOBER THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION A. TALBOT TR/46 OCTOBER 974 THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION by A. TALBOT .. Itroductio. A problem i approximatio theory o which I have recetly worked [] required for its solutio a proof that the

More information

MAXIMAL INEQUALITIES AND STRONG LAW OF LARGE NUMBERS FOR AANA SEQUENCES

MAXIMAL INEQUALITIES AND STRONG LAW OF LARGE NUMBERS FOR AANA SEQUENCES Commu Korea Math Soc 26 20, No, pp 5 6 DOI 0434/CKMS20265 MAXIMAL INEQUALITIES AND STRONG LAW OF LARGE NUMBERS FOR AANA SEQUENCES Wag Xueju, Hu Shuhe, Li Xiaoqi, ad Yag Wezhi Abstract Let {X, } be a sequece

More information

MAT1026 Calculus II Basic Convergence Tests for Series

MAT1026 Calculus II Basic Convergence Tests for Series MAT026 Calculus II Basic Covergece Tests for Series Egi MERMUT 202.03.08 Dokuz Eylül Uiversity Faculty of Sciece Departmet of Mathematics İzmir/TURKEY Cotets Mootoe Covergece Theorem 2 2 Series of Real

More information

Element sampling: Part 2

Element sampling: Part 2 Chapter 4 Elemet samplig: Part 2 4.1 Itroductio We ow cosider uequal probability samplig desigs which is very popular i practice. I the uequal probability samplig, we ca improve the efficiecy of the resultig

More information

University of Colorado Denver Dept. Math. & Stat. Sciences Applied Analysis Preliminary Exam 13 January 2012, 10:00 am 2:00 pm. Good luck!

University of Colorado Denver Dept. Math. & Stat. Sciences Applied Analysis Preliminary Exam 13 January 2012, 10:00 am 2:00 pm. Good luck! Uiversity of Colorado Dever Dept. Math. & Stat. Scieces Applied Aalysis Prelimiary Exam 13 Jauary 01, 10:00 am :00 pm Name: The proctor will let you read the followig coditios before the exam begis, ad

More information

Probabilistic and Average Linear Widths in L -Norm with Respect to r-fold Wiener Measure

Probabilistic and Average Linear Widths in L -Norm with Respect to r-fold Wiener Measure joural of approximatio theory 84, 3140 (1996) Article No. 0003 Probabilistic ad Average Liear Widths i L -Norm with Respect to r-fold Wieer Measure V. E. Maiorov Departmet of Mathematics, Techio, Haifa,

More information

A Note on the Kolmogorov-Feller Weak Law of Large Numbers

A Note on the Kolmogorov-Feller Weak Law of Large Numbers Joural of Mathematical Research with Applicatios Mar., 015, Vol. 35, No., pp. 3 8 DOI:10.3770/j.iss:095-651.015.0.013 Http://jmre.dlut.edu.c A Note o the Kolmogorov-Feller Weak Law of Large Numbers Yachu

More information

SOME SEQUENCE SPACES DEFINED BY ORLICZ FUNCTIONS

SOME SEQUENCE SPACES DEFINED BY ORLICZ FUNCTIONS ARCHIVU ATHEATICU BRNO Tomus 40 2004, 33 40 SOE SEQUENCE SPACES DEFINED BY ORLICZ FUNCTIONS E. SAVAŞ AND R. SAVAŞ Abstract. I this paper we itroduce a ew cocept of λ-strog covergece with respect to a Orlicz

More information

STA Object Data Analysis - A List of Projects. January 18, 2018

STA Object Data Analysis - A List of Projects. January 18, 2018 STA 6557 Jauary 8, 208 Object Data Aalysis - A List of Projects. Schoeberg Mea glaucomatous shape chages of the Optic Nerve Head regio i aimal models 2. Aalysis of VW- Kedall ati-mea shapes with a applicatio

More information

Notes 5 : More on the a.s. convergence of sums

Notes 5 : More on the a.s. convergence of sums Notes 5 : More o the a.s. covergece of sums Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: Dur0, Sectios.5; Wil9, Sectio 4.7, Shi96, Sectio IV.4, Dur0, Sectio.. Radom series. Three-series

More information

AMS570 Lecture Notes #2

AMS570 Lecture Notes #2 AMS570 Lecture Notes # Review of Probability (cotiued) Probability distributios. () Biomial distributio Biomial Experimet: ) It cosists of trials ) Each trial results i of possible outcomes, S or F 3)

More information

ECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors

ECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors ECONOMETRIC THEORY MODULE XIII Lecture - 34 Asymptotic Theory ad Stochastic Regressors Dr. Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Asymptotic theory The asymptotic

More information

Estimation for Complete Data

Estimation for Complete Data Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of

More information

Econ 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1.

Econ 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1. Eco 325/327 Notes o Sample Mea, Sample Proportio, Cetral Limit Theorem, Chi-square Distributio, Studet s t distributio 1 Sample Mea By Hiro Kasahara We cosider a radom sample from a populatio. Defiitio

More information

An almost sure invariance principle for trimmed sums of random vectors

An almost sure invariance principle for trimmed sums of random vectors Proc. Idia Acad. Sci. Math. Sci. Vol. 20, No. 5, November 200, pp. 6 68. Idia Academy of Scieces A almost sure ivariace priciple for trimmed sums of radom vectors KE-ANG FU School of Statistics ad Mathematics,

More information

Sequences and Series of Functions

Sequences and Series of Functions Chapter 6 Sequeces ad Series of Fuctios 6.1. Covergece of a Sequece of Fuctios Poitwise Covergece. Defiitio 6.1. Let, for each N, fuctio f : A R be defied. If, for each x A, the sequece (f (x)) coverges

More information

Integrable Functions. { f n } is called a determining sequence for f. If f is integrable with respect to, then f d does exist as a finite real number

Integrable Functions. { f n } is called a determining sequence for f. If f is integrable with respect to, then f d does exist as a finite real number MATH 532 Itegrable Fuctios Dr. Neal, WKU We ow shall defie what it meas for a measurable fuctio to be itegrable, show that all itegral properties of simple fuctios still hold, ad the give some coditios

More information

Research Article Moment Inequality for ϕ-mixing Sequences and Its Applications

Research Article Moment Inequality for ϕ-mixing Sequences and Its Applications Hidawi Publishig Corporatio Joural of Iequalities ad Applicatios Volume 2009, Article ID 379743, 2 pages doi:0.55/2009/379743 Research Article Momet Iequality for ϕ-mixig Sequeces ad Its Applicatios Wag

More information

A survey on penalized empirical risk minimization Sara A. van de Geer

A survey on penalized empirical risk minimization Sara A. van de Geer A survey o pealized empirical risk miimizatio Sara A. va de Geer We address the questio how to choose the pealty i empirical risk miimizatio. Roughly speakig, this pealty should be a good boud for the

More information

Definition 4.2. (a) A sequence {x n } in a Banach space X is a basis for X if. unique scalars a n (x) such that x = n. a n (x) x n. (4.

Definition 4.2. (a) A sequence {x n } in a Banach space X is a basis for X if. unique scalars a n (x) such that x = n. a n (x) x n. (4. 4. BASES I BAACH SPACES 39 4. BASES I BAACH SPACES Sice a Baach space X is a vector space, it must possess a Hamel, or vector space, basis, i.e., a subset {x γ } γ Γ whose fiite liear spa is all of X ad

More information

Mi-Hwa Ko and Tae-Sung Kim

Mi-Hwa Ko and Tae-Sung Kim J. Korea Math. Soc. 42 2005), No. 5, pp. 949 957 ALMOST SURE CONVERGENCE FOR WEIGHTED SUMS OF NEGATIVELY ORTHANT DEPENDENT RANDOM VARIABLES Mi-Hwa Ko ad Tae-Sug Kim Abstract. For weighted sum of a sequece

More information

Gamma Distribution and Gamma Approximation

Gamma Distribution and Gamma Approximation Gamma Distributio ad Gamma Approimatio Xiaomig Zeg a Fuhua (Frak Cheg b a Xiame Uiversity, Xiame 365, Chia mzeg@jigia.mu.edu.c b Uiversity of Ketucky, Leigto, Ketucky 456-46, USA cheg@cs.uky.edu Abstract

More information

Appendix to: Hypothesis Testing for Multiple Mean and Correlation Curves with Functional Data

Appendix to: Hypothesis Testing for Multiple Mean and Correlation Curves with Functional Data Appedix to: Hypothesis Testig for Multiple Mea ad Correlatio Curves with Fuctioal Data Ao Yua 1, Hog-Bi Fag 1, Haiou Li 1, Coli O. Wu, Mig T. Ta 1, 1 Departmet of Biostatistics, Bioiformatics ad Biomathematics,

More information

SDS 321: Introduction to Probability and Statistics

SDS 321: Introduction to Probability and Statistics SDS 321: Itroductio to Probability ad Statistics Lecture 23: Cotiuous radom variables- Iequalities, CLT Puramrita Sarkar Departmet of Statistics ad Data Sciece The Uiversity of Texas at Austi www.cs.cmu.edu/

More information

Available online at J. Math. Comput. Sci. 2 (2012), No. 3, ISSN:

Available online at   J. Math. Comput. Sci. 2 (2012), No. 3, ISSN: Available olie at http://scik.org J. Math. Comput. Sci. 2 (202, No. 3, 656-672 ISSN: 927-5307 ON PARAMETER DEPENDENT REFINEMENT OF DISCRETE JENSEN S INEQUALITY FOR OPERATOR CONVEX FUNCTIONS L. HORVÁTH,

More information

Riesz-Fischer Sequences and Lower Frame Bounds

Riesz-Fischer Sequences and Lower Frame Bounds Zeitschrift für Aalysis ud ihre Aweduge Joural for Aalysis ad its Applicatios Volume 1 (00), No., 305 314 Riesz-Fischer Sequeces ad Lower Frame Bouds P. Casazza, O. Christese, S. Li ad A. Lider Abstract.

More information

Lecture 27: Optimal Estimators and Functional Delta Method

Lecture 27: Optimal Estimators and Functional Delta Method Stat210B: Theoretical Statistics Lecture Date: April 19, 2007 Lecture 27: Optimal Estimators ad Fuctioal Delta Method Lecturer: Michael I. Jorda Scribe: Guilherme V. Rocha 1 Achievig Optimal Estimators

More information

Power series are analytic

Power series are analytic Power series are aalytic Horia Corea 1 1 Fubii s theorem for double series Theorem 1.1. Let {α m }, be a real sequece idexed by two idices. Assume that the series α m is coverget for all ad C := ( α m

More information

y X F n (y), To see this, let y Y and apply property (ii) to find a sequence {y n } X such that y n y and lim sup F n (y n ) F (y).

y X F n (y), To see this, let y Y and apply property (ii) to find a sequence {y n } X such that y n y and lim sup F n (y n ) F (y). Modica Mortola Fuctioal 2 Γ-Covergece Let X, d) be a metric space ad cosider a sequece {F } of fuctioals F : X [, ]. We say that {F } Γ-coverges to a fuctioal F : X [, ] if the followig properties hold:

More information

IN THE NON-I.D. CASE. Pranab Kumar Sen. Department of Biostatistics University of North Carolina at Chapel Hill

IN THE NON-I.D. CASE. Pranab Kumar Sen. Department of Biostatistics University of North Carolina at Chapel Hill INVARIANCE PRINCIPLES FOR U-STATISTICS AND IN THE NON-I.D. CASE VON MISES' FUNCTIONALS by Praab Kumar Se Departmet of Biostatistics Uiversity of North Carolia at Chapel Hill Istitute of Statistics Mimeo

More information

Math 525: Lecture 5. January 18, 2018

Math 525: Lecture 5. January 18, 2018 Math 525: Lecture 5 Jauary 18, 2018 1 Series (review) Defiitio 1.1. A sequece (a ) R coverges to a poit L R (writte a L or lim a = L) if for each ǫ > 0, we ca fid N such that a L < ǫ for all N. If the

More information

Regression with an Evaporating Logarithmic Trend

Regression with an Evaporating Logarithmic Trend Regressio with a Evaporatig Logarithmic Tred Peter C. B. Phillips Cowles Foudatio, Yale Uiversity, Uiversity of Aucklad & Uiversity of York ad Yixiao Su Departmet of Ecoomics Yale Uiversity October 5,

More information

Feedback in Iterative Algorithms

Feedback in Iterative Algorithms Feedback i Iterative Algorithms Charles Byre (Charles Byre@uml.edu), Departmet of Mathematical Scieces, Uiversity of Massachusetts Lowell, Lowell, MA 01854 October 17, 2005 Abstract Whe the oegative system

More information

The standard deviation of the mean

The standard deviation of the mean Physics 6C Fall 20 The stadard deviatio of the mea These otes provide some clarificatio o the distictio betwee the stadard deviatio ad the stadard deviatio of the mea.. The sample mea ad variace Cosider

More information

Information Theory Tutorial Communication over Channels with memory. Chi Zhang Department of Electrical Engineering University of Notre Dame

Information Theory Tutorial Communication over Channels with memory. Chi Zhang Department of Electrical Engineering University of Notre Dame Iformatio Theory Tutorial Commuicatio over Chaels with memory Chi Zhag Departmet of Electrical Egieerig Uiversity of Notre Dame Abstract A geeral capacity formula C = sup I(; Y ), which is correct for

More information

Equivalent Banach Operator Ideal Norms 1

Equivalent Banach Operator Ideal Norms 1 It. Joural of Math. Aalysis, Vol. 6, 2012, o. 1, 19-27 Equivalet Baach Operator Ideal Norms 1 Musudi Sammy Chuka Uiversity College P.O. Box 109-60400, Keya sammusudi@yahoo.com Shem Aywa Maside Muliro Uiversity

More information

Frequentist Inference

Frequentist Inference Frequetist Iferece The topics of the ext three sectios are useful applicatios of the Cetral Limit Theorem. Without kowig aythig about the uderlyig distributio of a sequece of radom variables {X i }, for

More information

Linear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d

Linear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d Liear regressio Daiel Hsu (COMS 477) Maximum likelihood estimatio Oe of the simplest liear regressio models is the followig: (X, Y ),..., (X, Y ), (X, Y ) are iid radom pairs takig values i R d R, ad Y

More information

Maximum likelihood estimation from record-breaking data for the generalized Pareto distribution

Maximum likelihood estimation from record-breaking data for the generalized Pareto distribution METRON - Iteratioal Joural of Statistics 004, vol. LXII,. 3, pp. 377-389 NAGI S. ABD-EL-HAKIM KHALAF S. SULTAN Maximum likelihood estimatio from record-breakig data for the geeralized Pareto distributio

More information

Solutions of Homework 2.

Solutions of Homework 2. 1 Solutios of Homework 2. 1. Suppose X Y with E(Y )

More information

SOME THEORY AND PRACTICE OF STATISTICS by Howard G. Tucker

SOME THEORY AND PRACTICE OF STATISTICS by Howard G. Tucker SOME THEORY AND PRACTICE OF STATISTICS by Howard G. Tucker CHAPTER 9. POINT ESTIMATION 9. Covergece i Probability. The bases of poit estimatio have already bee laid out i previous chapters. I chapter 5

More information

EE 4TM4: Digital Communications II Probability Theory

EE 4TM4: Digital Communications II Probability Theory 1 EE 4TM4: Digital Commuicatios II Probability Theory I. RANDOM VARIABLES A radom variable is a real-valued fuctio defied o the sample space. Example: Suppose that our experimet cosists of tossig two fair

More information

Introducing a Novel Bivariate Generalized Skew-Symmetric Normal Distribution

Introducing a Novel Bivariate Generalized Skew-Symmetric Normal Distribution Joural of mathematics ad computer Sciece 7 (03) 66-7 Article history: Received April 03 Accepted May 03 Available olie Jue 03 Itroducig a Novel Bivariate Geeralized Skew-Symmetric Normal Distributio Behrouz

More information

Stochastic Simulation

Stochastic Simulation Stochastic Simulatio 1 Itroductio Readig Assigmet: Read Chapter 1 of text. We shall itroduce may of the key issues to be discussed i this course via a couple of model problems. Model Problem 1 (Jackso

More information

MATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4

MATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4 MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.

More information

Lecture Chapter 6: Convergence of Random Sequences

Lecture Chapter 6: Convergence of Random Sequences ECE5: Aalysis of Radom Sigals Fall 6 Lecture Chapter 6: Covergece of Radom Sequeces Dr Salim El Rouayheb Scribe: Abhay Ashutosh Doel, Qibo Zhag, Peiwe Tia, Pegzhe Wag, Lu Liu Radom sequece Defiitio A ifiite

More information

Detailed proofs of Propositions 3.1 and 3.2

Detailed proofs of Propositions 3.1 and 3.2 Detailed proofs of Propositios 3. ad 3. Proof of Propositio 3. NB: itegratio sets are geerally omitted for itegrals defied over a uit hypercube [0, s with ay s d. We first give four lemmas. The proof of

More information

Ma 530 Introduction to Power Series

Ma 530 Introduction to Power Series Ma 530 Itroductio to Power Series Please ote that there is material o power series at Visual Calculus. Some of this material was used as part of the presetatio of the topics that follow. What is a Power

More information

2 Banach spaces and Hilbert spaces

2 Banach spaces and Hilbert spaces 2 Baach spaces ad Hilbert spaces Tryig to do aalysis i the ratioal umbers is difficult for example cosider the set {x Q : x 2 2}. This set is o-empty ad bouded above but does ot have a least upper boud

More information

STAT Homework 1 - Solutions

STAT Homework 1 - Solutions STAT-36700 Homework 1 - Solutios Fall 018 September 11, 018 This cotais solutios for Homework 1. Please ote that we have icluded several additioal commets ad approaches to the problems to give you better

More information

Lecture 3 : Random variables and their distributions

Lecture 3 : Random variables and their distributions Lecture 3 : Radom variables ad their distributios 3.1 Radom variables Let (Ω, F) ad (S, S) be two measurable spaces. A map X : Ω S is measurable or a radom variable (deoted r.v.) if X 1 (A) {ω : X(ω) A}

More information

Expectation and Variance of a random variable

Expectation and Variance of a random variable Chapter 11 Expectatio ad Variace of a radom variable The aim of this lecture is to defie ad itroduce mathematical Expectatio ad variace of a fuctio of discrete & cotiuous radom variables ad the distributio

More information

Lecture 33: Bootstrap

Lecture 33: Bootstrap Lecture 33: ootstrap Motivatio To evaluate ad compare differet estimators, we eed cosistet estimators of variaces or asymptotic variaces of estimators. This is also importat for hypothesis testig ad cofidece

More information

Power series are analytic

Power series are analytic Power series are aalytic Horia Corea 1 1 The expoetial ad the logarithm For every x R we defie the fuctio give by exp(x) := 1 + x + x + + x + = x. If x = 0 we have exp(0) = 1. If x 0, cosider the series

More information

(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3

(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3 MATH 337 Sequeces Dr. Neal, WKU Let X be a metric space with distace fuctio d. We shall defie the geeral cocept of sequece ad limit i a metric space, the apply the results i particular to some special

More information

On Random Line Segments in the Unit Square

On Random Line Segments in the Unit Square O Radom Lie Segmets i the Uit Square Thomas A. Courtade Departmet of Electrical Egieerig Uiversity of Califoria Los Ageles, Califoria 90095 Email: tacourta@ee.ucla.edu I. INTRODUCTION Let Q = [0, 1] [0,

More information

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + 62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of

More information

It should be unbiased, or approximately unbiased. Variance of the variance estimator should be small. That is, the variance estimator is stable.

It should be unbiased, or approximately unbiased. Variance of the variance estimator should be small. That is, the variance estimator is stable. Chapter 10 Variace Estimatio 10.1 Itroductio Variace estimatio is a importat practical problem i survey samplig. Variace estimates are used i two purposes. Oe is the aalytic purpose such as costructig

More information