THE LIM;I,TING BEHAVIOUR OF THE EMPIRICAL KERNEL DISTRIBDTI'ON FUNCTION. Pranab Kumar Sen
|
|
- Merryl Carter
- 6 years ago
- Views:
Transcription
1 -e ON THE LIM;I,TING BEHAVIOUR OF THE EMPIRICAL KERNEL DISTRIBDTI'ON FUNCTION By Praab Kumar Se Departmet of Biostatistics Uiversity of North Carolia at Chapel Hill Istitute of Statistic~ Mimeo Series No July 198
2 ON THE LIMITING BEHAVIOUR OF THE EMPIRICAL KERNEL DISTRIBUTION FUNCTION * By PRANAB KUMAR SEN Uiversity of North Carolia, Chapel Hill. For a estimable parameter of degree m( ~ I), Gliveko-Catelli lemma type result for the empirical kerel distributio ad weak covergece of the related empirical process are studied. Some statistical applicatios of these results are also cosidered. AMS Subject Classificatios: 60F17, 6G99 Key Words &Phrases : Blackma-type estimator; degree; Gliveko-Catelli lemma; kerel; reverse (sub-)martigales; U-statistics; weak covergece. * Work partially supported by the Natioal Heart, Lug ad Blood Istitute, Cotract NIH-NHLBI L from the Natioal Istitutes of Health.
3 1. Itroductio. Let {X.,i>l} be a sequece of idepedet ad idetically ~ N~_~ ~~~ 1 - distributed radom vectors (i.i.d.r.v.) with a distributio fuctio (d. f.) F, defied o the real p-space EP, for some p ~ 1. Cosider a fuctioal 8(F) of the d.f. F, for which there exists a fuctio g(xl,,x m ), such that (1.1) = f. f g(xl,,xm)df(xl) df(x m ), for every F belogig to a class c.3< of d.f.'s o E P Without ay loss of geerality, we may assume that g(.) is a symmetric fuctio of its m argumets. If m(~ 1) is the miimal sample size for which (1.1) holds, the g(xl,,x m ) is called the kerel ad m the degree of 8 (F), ad a optimal (symmetric) estimator of 8 (F) is the V-statistic [ viz., Hoeffdig (1948)J (1.) g(x.,,x. ) ; C = { 1 < i < < i < }, 1 1 l 1 m,m - m - wheever > m. Let us assume that the kerel g (.) is real-valued ad deote bye. (1.3) H(y) = p{ g(xl,,x ) < y}, Y E E. m - We are primarily iterested i the estimatio of the d.f. H(y) i (1.3).Note that 8(F) (= fydh(y) ) is also a fuctioal of the d.f. H. Aalogous to (1.), we may cosider the followig estimator of H (to be termed the empirical kerel distributio fuctio (e.k.d.f.)): (1.4) I(g(X.,.,X.) <x), X E E, ::.m m Note that like V i (1.), H, for m _>, does ot ivolve idepedet summads, ad hece, the classical results o the asymptotic properties of the sample d.f. may ot be directly applicable to H Nevertheless, like the V, such asymptotic results ca be derived by usig some (reverse) sub-martigale theory. The mai objective of the preset study is to cosider the e.k.d.f. H 1 related empirical process {~{H (x) - H(x)},x E E} ad to study their asymptotic behaviour. ad the
4 Sectio is devoted to the study of the Gliveko-Catelli type almost sure (a.s.) covergece result o H - H. The weak covergece of the empirical k process (H - H ) is studied i Sectio 3. The cocludig sectio deals with some statistical applicatios of the results of Sectios ad 3.. Gliveko-Catelli lemma for H Note that by (1.3) ad (1.4), ---~---~~-~ ~ (.1) EH(x) = H(x), for every x We are iterested i showig that (.) sup{ IH (x) - H(x) I : x E: E} + 0 a.s., as + 00 Towards this, let~ be the sigma-field geerated by the uordered collectio {X 1,,X }.ad X.,j > 1, for > 1. Note that ~ is mootoe oicreasig. +J - - /'-" Lemma. L { ~~~ IH (x) - Hex) I,,J!..' > m} is a reverse sub-martigale. Proof. Note that for every x E, ~ m, e (.3) E [ H (x) I ;-.' IJ = () -1 l: /'-+ m C EII(g(X.,.,X. ) < x)1,'" 1],m /"+ 1 m Now, give ~ l' X.,, X. ca be ay m of the uits X ~ m 1,.,.,X + 1 with the +l -1 equal coditioal probability ( m), so that for every 1 <i < < im:, 1 (.4) E[I(g(X....,X. ) < x)1 :t'. 1J = E[I(g(X, 1,X) < x)1 tj 1] r-"+ m - /L+ 1 m +l -1 = ( ) l:c I (g (X. to. OJ X. ).::. x) = H +1 (x) m + 1 J,m l J m Thus, by (.3) ad (.4), for every ~ m, (.5) Sice E [ {H (x) s~p (.) property. Q.E.D. - H(x) }, X E: E I df J = {H lex) - H(x)},x E: E. (a.e.) /~J +l + is a covex fuctioal, (.5) isures the reverse sub-martigale Let ow * = [/mj be the largest iteger cotaied i /m, for > m. Also, for every ~ m, let * -1 *' (.6) H(x) = (*) Li=l I(g(X Ci.;.l)ii1H"."X im ).::. x), x E: E. * Note that H ivolves idepedet summads, ad, as i (.4), * (..7) E{ H (x) I.] = H (x), for every -x E: E..
5 4- By Lemma.1, (.7) ad the Kolmogorov iequality for reverse submartigales, we obtai that for every E > 0, ~ m, (.8) Now, H* p{ sup sup IHN(X) _ H(x) I _> E } N > x E E < E- l E{ sup IH (x) - H(x) I } X E E < E-lE{ E[ sup E I H*(x) - H(x) I - X E = E-lE{ sup E IH*cX) - H(x) I } XE. I,e] I } I. ] } - H relates to the classical case of idepedet summas for which the results of Dvoretzky, Kiefer ad Wolfowitz (1956) isure that for every r > 0, 1 * (.9) P{(*)Yz sup IH (x) _ H(x) I > r} < C e- r, U * ~ 1, xee ~ - Ii_ where C is a fiite positive costat, idepedet of rad *. Sice * _ /m, as + 00, (.9) isures that the right had side of (.8) coverges to a as + 00 This completes the proof of (.). We may also ote that for every ~.!,; * ~ 1, (*) {H* (X)-H(x)}/{1- H(x)},x E E} is a martigale, ad hece, by { the Hajek-Reyi-Chow iequality, it ca be show that the right had side of (.9) may be replaced by a more crude boud r -, for every r > 1, 50 that the covergece of the right had side of (.8) (to a as + 00) remais i tact. N_~ 1 3. Weak covergece of Yz(H - H). For the sake of simplicity, we assume that H(x) is a cotiuous fuctio of x E E ad deote by H-1(t) = if{ x: H(x) ~ t}, O<t<l. For every ( ~ m), we the itroduce a stochastic process W = {W(t); O<t<l} by lettig (3.1)!,; 1 W (t) = {H (H- (t)) - t }, a < t < 1. The, W belogs to the space DIO,l]. We ited to study the weak covergece of W to some appropriate (tied-dow) Gaussia fuctio W = {W(t);O~t~l}. Towards this, ote that for arbitrary r( ~ 1), 0 ~ t, l (Ap,A ),by (1.4) ad (3.1), r < < t < 1 ad o-ull r- A =
6 (3.) where r ~. 1 A.W (t.) J= J J = ~ L: r A. [ H (H- 1 (t,.)) j=l J' ' J 1 ~ = ~ {V - EV }, say, t. J J (3.3) ad (3.4) Thus, V (X.,.,X. ) ~l ~m r -1 (X.,..,X. ) = L:. 1 A. I(g(X.,,X. ) < H (t.)) ~l ~m J= J ~l ~m - J is a V-statistic ad we may borrow the classical results of Hoeffdig (1948) to show that the right had side of (3.) coverges i law to a ormal distributio with 0 mea ad a fiite variace (depedig o tl,,t ad A ). m - If we deote by (3.5) { -I -1 } I'; (s,t) = P g(xl,,x) < H (s), g(x 1,,X ) < H (t) - c m - m-c+ m-c - for every (s,t) E [0,1] ad c=o,l,,m (ote that 1';0(s,t) = 0 ), the, (3.6) E{[H (H-l(s)) - s][h (H-l(t)) - t J} = ()-l "m (m) (-m).,. (s t) f (t) [0 lj m '"'c=l c 'I-c "'c', or every s, E, Note that by (3.1) ad (.3.7) EW (s)w (t) (3.6), for every (s,t) E [O,lJ, + m 1';1 (s,t) = I';(s,t), say. as + 00, Thus, if we defie a Gaussia fuctio W= {W(t)jO<t~l}, such that EW = 0 st, ad the covariace fuctio of Wis give by { I';(s,t),(s,t) E [0,1]}, the from the above discussio it follows that the fiite dimesioal distributios (f.d.d.) of {W} coverge to those of W. Further, W (0) = 0 with probsbility 1 ad Wbelogs to the C[O,l] space, i probability. Hece, to establish the weak covergece of {W} to W, it suffices to show that {W } is tight. For this, it suffices to show that for every 0 ~ sl<5 < s3~ iteger (3.8) 1, there exist a [See Theorem 15.6 of Billigsley (1968), i this cotext.] For this, we * * * defie W = {W (t)jo<t<l} as i (3.1) with H beig replaced by H The, --
7 6 (3.9) * O the other had, W (.) ivolves * idepedet summads, ad hece, usig the momet geeratig fuctio of the multiomial distrubutio, we obtai that { * *] [ * ) *()]} E [ W (s) - W(sl) W (s3 - W s (3.10) < 5(/*) (s- sl) (s3 - s) < 5(m+l) (s- sl)(s3 - s), for every 0~sl<s<s3 ~l ad ~ m. Thus, (3.8) follows from (3.9) ad (3.10). Hece, we arrive at the followig. Theorem 3.1. W i (3.1) coverges i law to the Gaussia fuctio Wwith EW= - - ~ o ad covariace fuctio ~(s,t), give br (3.7). Note that ~(s,t) = 0 whe s or t is equal to 0 or I, ad hece, Wis tieddow at t = 0 ad t = 1. However, for m ~, i geeral, ~(s,t) is ot equal ~. to mi(s,t) - st, so that Wis ot ecessarily a Browia bridge. 4. ~~~~_~EE~~~~~~~~~' Let Xl",.,X be i.i.d.r.v.'s with a d.f. F(x) = F ((X-~)/0) where F is a specified d.f. ad the locatio ad scale parameters o 0 ~ ad 0 are ukow. Blackma(1955) has cosidered the estimatio of the locatio parameter (whe 0 is assumed to be specified) based o the empirical d.f. We cosider here a similar estimator of 0 whe ~ is ot specified. Note that if we let g(x.,x.) = (X. _ x.)/, the Eg(X.,X.) = E(Xl-~) = Var(X) = 1. J 1. J c 1. J 0, where c is a specifed positive o costat ad depeds o the specified 0 d.f. F We assume that F admits a fiite variace, ad, without ay loss of o 0 geerality, we may set c = 1. Thus, we have a kerel of degree ad the o empirical kerel d.f. H may be defied as i (1.4) with m=. We defie H(y) as i (1.3) ad sice F is specified, we may rewrite Hey) as o + (4.1) H(y) = H0 (y/ 0), Y E E = [ 0, CXl), where H depeds o F ad is of specified form too. Let the o 0
8 ' (4.) M(t) = fa [ H(ty) ~ HoCY) ] dho(y), tee As a estimator of 8 = 0, we cosider (4.3) A M (8 ) = if t M (t) Note that if we rewrite M(t) as e which is a solutio of dho(y), the, for t away from 8, M(t) blows up as + 00, while, for t close to 8, we may proceed as i Pyke(1970) ad through some routie steps obtai that as + 00 (4.4) ~ A ( 8-8 ) where h + 0 Cl) P is the desity fuctio correspodig to H o 0 ~ A i (3.1). Hece, the asymptotic ormality of ( e - 8) ad W (.) is defied as ca be obtaied from Theorem 3.1 ad (4.4). A similar treatmet holds for other Blackma-type estimators of estimable parameters whe the uderlyig d.f. is specified (apart from some.~ ukow parameters). I the cotext of tests of goodess of fit whe some of the parameters are ukow, a alterative procedure may be suggested as follows. Correspodig to the ukow parameters, obtai the kerels ad for these kerels, cosider the correspodig empirical kerel d.f.'s. The, a multivariate versio of Theorem 3.1 may be employed for the goodess of fit problem, usig either the Kolmogorov- Smirov or the Cramer-vo Mises' type statistics. The theory also ca be exteded to the two-sample case o parallel lies. REFERENCES BILLINGSLEY, P. (1968). Covergece of Probability Measures. New York: Wiley. BLACKMAN, J.(1955). O the approximatio of a distributio fuctio by a empiric distributio. A. Math. Statist. 6, DVORETZKY, A., KIEFER, J. ad Wolfowitz, J. (1956). Asymptotic miimax character of the sample distributio fuctio ad the classical multiomial estimator. A. Math. Statist. ~,
9 HOEFFDING, W. (1948). A class of statistics with asymptotically ormal distributio. A. Math. Statist. ~, PYKE, R. (1970). Asymptotic results for rak statistics. I Noparametric Techiques i Statistical Iferece (ed:m.l.puri), New York: Cambridge Uiv. Press, pp.l-37o
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS
MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak
More informationA RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS
J. Japa Statist. Soc. Vol. 41 No. 1 2011 67 73 A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS Yoichi Nishiyama* We cosider k-sample ad chage poit problems for idepedet data i a
More informationConvergence of random variables. (telegram style notes) P.J.C. Spreij
Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space
More informationSelf-normalized deviation inequalities with application to t-statistic
Self-ormalized deviatio iequalities with applicatio to t-statistic Xiequa Fa Ceter for Applied Mathematics, Tiaji Uiversity, 30007 Tiaji, Chia Abstract Let ξ i i 1 be a sequece of idepedet ad symmetric
More informationMAXIMAL INEQUALITIES AND STRONG LAW OF LARGE NUMBERS FOR AANA SEQUENCES
Commu Korea Math Soc 26 20, No, pp 5 6 DOI 0434/CKMS20265 MAXIMAL INEQUALITIES AND STRONG LAW OF LARGE NUMBERS FOR AANA SEQUENCES Wag Xueju, Hu Shuhe, Li Xiaoqi, ad Yag Wezhi Abstract Let {X, } be a sequece
More informationLecture 33: Bootstrap
Lecture 33: ootstrap Motivatio To evaluate ad compare differet estimators, we eed cosistet estimators of variaces or asymptotic variaces of estimators. This is also importat for hypothesis testig ad cofidece
More informationST5215: Advanced Statistical Theory
ST525: Advaced Statistical Theory Departmet of Statistics & Applied Probability Tuesday, September 7, 2 ST525: Advaced Statistical Theory Lecture : The law of large umbers The Law of Large Numbers The
More informationEmpirical Processes: Glivenko Cantelli Theorems
Empirical Processes: Gliveko Catelli Theorems Mouliath Baerjee Jue 6, 200 Gliveko Catelli classes of fuctios The reader is referred to Chapter.6 of Weller s Torgo otes, Chapter??? of VDVW ad Chapter 8.3
More information32 estimating the cumulative distribution function
32 estimatig the cumulative distributio fuctio 4.6 types of cofidece itervals/bads Let F be a class of distributio fuctios F ad let θ be some quatity of iterest, such as the mea of F or the whole fuctio
More informationLecture 19: Convergence
Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may
More information4. Partial Sums and the Central Limit Theorem
1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems
More informationLECTURE 8: ASYMPTOTICS I
LECTURE 8: ASYMPTOTICS I We are iterested i the properties of estimators as. Cosider a sequece of radom variables {, X 1}. N. M. Kiefer, Corell Uiversity, Ecoomics 60 1 Defiitio: (Weak covergece) A sequece
More informationIN THE NON-I.D. CASE. Pranab Kumar Sen. Department of Biostatistics University of North Carolina at Chapel Hill
INVARIANCE PRINCIPLES FOR U-STATISTICS AND IN THE NON-I.D. CASE VON MISES' FUNCTIONALS by Praab Kumar Se Departmet of Biostatistics Uiversity of North Carolia at Chapel Hill Istitute of Statistics Mimeo
More informationfor all x ; ;x R. A ifiite sequece fx ; g is said to be ND if every fiite subset X ; ;X is ND. The coditios (.) ad (.3) are equivalet for =, but these
sub-gaussia techiques i provig some strog it theorems Λ M. Amii A. Bozorgia Departmet of Mathematics, Faculty of Scieces Sista ad Baluchesta Uiversity, Zaheda, Ira Amii@hamoo.usb.ac.ir, Fax:054446565 Departmet
More informationChapter 3. Strong convergence. 3.1 Definition of almost sure convergence
Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i
More informationResampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.
Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator
More informationComplete Convergence for Asymptotically Almost Negatively Associated Random Variables
Applied Mathematical Scieces, Vol. 12, 2018, o. 30, 1441-1452 HIKARI Ltd, www.m-hikari.com https://doi.org/10.12988/ams.2018.810142 Complete Covergece for Asymptotically Almost Negatively Associated Radom
More informationECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors
ECONOMETRIC THEORY MODULE XIII Lecture - 34 Asymptotic Theory ad Stochastic Regressors Dr. Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Asymptotic theory The asymptotic
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 Fuctioal Law of Large Numbers. Costructio of the Wieer Measure Cotet. 1. Additioal techical results o weak covergece
More informationDistribution of Random Samples & Limit theorems
STAT/MATH 395 A - PROBABILITY II UW Witer Quarter 2017 Néhémy Lim Distributio of Radom Samples & Limit theorems 1 Distributio of i.i.d. Samples Motivatig example. Assume that the goal of a study is to
More informationA survey on penalized empirical risk minimization Sara A. van de Geer
A survey o pealized empirical risk miimizatio Sara A. va de Geer We address the questio how to choose the pealty i empirical risk miimizatio. Roughly speakig, this pealty should be a good boud for the
More informationRegression with an Evaporating Logarithmic Trend
Regressio with a Evaporatig Logarithmic Tred Peter C. B. Phillips Cowles Foudatio, Yale Uiversity, Uiversity of Aucklad & Uiversity of York ad Yixiao Su Departmet of Ecoomics Yale Uiversity October 5,
More informationProduct measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014.
Product measures, Toelli s ad Fubii s theorems For use i MAT3400/4400, autum 2014 Nadia S. Larse Versio of 13 October 2014. 1. Costructio of the product measure The purpose of these otes is to preset the
More informationMi-Hwa Ko and Tae-Sung Kim
J. Korea Math. Soc. 42 2005), No. 5, pp. 949 957 ALMOST SURE CONVERGENCE FOR WEIGHTED SUMS OF NEGATIVELY ORTHANT DEPENDENT RANDOM VARIABLES Mi-Hwa Ko ad Tae-Sug Kim Abstract. For weighted sum of a sequece
More informationGlivenko-Cantelli Classes
CS28B/Stat24B (Sprig 2008 Statistical Learig Theory Lecture: 4 Gliveko-Catelli Classes Lecturer: Peter Bartlett Scribe: Michelle Besi Itroductio This lecture will cover Gliveko-Catelli (GC classes ad itroduce
More informationEntropy Rates and Asymptotic Equipartition
Chapter 29 Etropy Rates ad Asymptotic Equipartitio Sectio 29. itroduces the etropy rate the asymptotic etropy per time-step of a stochastic process ad shows that it is well-defied; ad similarly for iformatio,
More informationBerry-Esseen bounds for self-normalized martingales
Berry-Essee bouds for self-ormalized martigales Xiequa Fa a, Qi-Ma Shao b a Ceter for Applied Mathematics, Tiaji Uiversity, Tiaji 30007, Chia b Departmet of Statistics, The Chiese Uiversity of Hog Kog,
More informationECE 330:541, Stochastic Signals and Systems Lecture Notes on Limit Theorems from Probability Fall 2002
ECE 330:541, Stochastic Sigals ad Systems Lecture Notes o Limit Theorems from robability Fall 00 I practice, there are two ways we ca costruct a ew sequece of radom variables from a old sequece of radom
More informationECE 901 Lecture 12: Complexity Regularization and the Squared Loss
ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality
More informationOn the convergence rates of Gladyshev s Hurst index estimator
Noliear Aalysis: Modellig ad Cotrol, 2010, Vol 15, No 4, 445 450 O the covergece rates of Gladyshev s Hurst idex estimator K Kubilius 1, D Melichov 2 1 Istitute of Mathematics ad Iformatics, Vilius Uiversity
More informationMachine Learning Theory Tübingen University, WS 2016/2017 Lecture 12
Machie Learig Theory Tübige Uiversity, WS 06/07 Lecture Tolstikhi Ilya Abstract I this lecture we derive risk bouds for kerel methods. We will start by showig that Soft Margi kerel SVM correspods to miimizig
More informationAppendix to: Hypothesis Testing for Multiple Mean and Correlation Curves with Functional Data
Appedix to: Hypothesis Testig for Multiple Mea ad Correlatio Curves with Fuctioal Data Ao Yua 1, Hog-Bi Fag 1, Haiou Li 1, Coli O. Wu, Mig T. Ta 1, 1 Departmet of Biostatistics, Bioiformatics ad Biomathematics,
More informationKernel density estimator
Jauary, 07 NONPARAMETRIC ERNEL DENSITY ESTIMATION I this lecture, we discuss kerel estimatio of probability desity fuctios PDF Noparametric desity estimatio is oe of the cetral problems i statistics I
More informationUNIVERSITY OF NORTH CAROLINA Department of Statistics Chapel Hill, N. C. FOR MULTIVARIATE POPULATIONS. J. N. Srivastava.
UNIVERSITY OF NORTH CAROLINA Departmet of Statistics Chapel Hill N. C. A NOTE ON THE BEST LINEAR UNBIASED ESTIMATES FOR MULTIVARIATE POPULATIONS by J. N. Srivastava November 1962 Cotract No. AF 49(638)-213
More informationLECTURE 11 LINEAR PROCESSES III: ASYMPTOTIC RESULTS
PRIL 7, 9 where LECTURE LINER PROCESSES III: SYMPTOTIC RESULTS (Phillips ad Solo (99) ad Phillips Lecture Notes o Statioary ad Nostatioary Time Series) I this lecture, we discuss the LLN ad CLT for a liear
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 6 9/23/2013. Brownian motion. Introduction
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/5.070J Fall 203 Lecture 6 9/23/203 Browia motio. Itroductio Cotet.. A heuristic costructio of a Browia motio from a radom walk. 2. Defiitio ad basic properties
More informationChapter 6 Principles of Data Reduction
Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a
More informationPrecise Rates in Complete Moment Convergence for Negatively Associated Sequences
Commuicatios of the Korea Statistical Society 29, Vol. 16, No. 5, 841 849 Precise Rates i Complete Momet Covergece for Negatively Associated Sequeces Dae-Hee Ryu 1,a a Departmet of Computer Sciece, ChugWoo
More information1 Introduction to reducing variance in Monte Carlo simulations
Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by
More informationON THE RATE Of CONVERGENCE for SOME STRONG APPROXIMATION THEOREMS IN EXTREMAL STATISTICS. Dietma:r Pfe;i.fer
ON THE RATE Of CONVERGENCE for SOME STRONG APPROXIMATION THEOREMS IN EXTREMAL STATISTICS Dietma:r Pfe;i.fer Abstract. Strog approximatio theorems for the logarithms of record ad iter-record times of a
More informationEquivalent Banach Operator Ideal Norms 1
It. Joural of Math. Aalysis, Vol. 6, 2012, o. 1, 19-27 Equivalet Baach Operator Ideal Norms 1 Musudi Sammy Chuka Uiversity College P.O. Box 109-60400, Keya sammusudi@yahoo.com Shem Aywa Maside Muliro Uiversity
More informationLecture 27: Optimal Estimators and Functional Delta Method
Stat210B: Theoretical Statistics Lecture Date: April 19, 2007 Lecture 27: Optimal Estimators ad Fuctioal Delta Method Lecturer: Michael I. Jorda Scribe: Guilherme V. Rocha 1 Achievig Optimal Estimators
More informationBull. Korean Math. Soc. 36 (1999), No. 3, pp. 451{457 THE STRONG CONSISTENCY OF NONLINEAR REGRESSION QUANTILES ESTIMATORS Seung Hoe Choi and Hae Kyung
Bull. Korea Math. Soc. 36 (999), No. 3, pp. 45{457 THE STRONG CONSISTENCY OF NONLINEAR REGRESSION QUANTILES ESTIMATORS Abstract. This paper provides suciet coditios which esure the strog cosistecy of regressio
More informationRates of Convergence for Quicksort
Rates of Covergece for Quicksort Ralph Neiiger School of Computer Sciece McGill Uiversity 480 Uiversity Street Motreal, HA 2K6 Caada Ludger Rüschedorf Istitut für Mathematische Stochastik Uiversität Freiburg
More informationSolution to Chapter 2 Analytical Exercises
Nov. 25, 23, Revised Dec. 27, 23 Hayashi Ecoometrics Solutio to Chapter 2 Aalytical Exercises. For ay ε >, So, plim z =. O the other had, which meas that lim E(z =. 2. As show i the hit, Prob( z > ε =
More informationNotes 27 : Brownian motion: path properties
Notes 27 : Browia motio: path properties Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces:[Dur10, Sectio 8.1], [MP10, Sectio 1.1, 1.2, 1.3]. Recall: DEF 27.1 (Covariace) Let X = (X
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationAsymptotic distribution of products of sums of independent random variables
Proc. Idia Acad. Sci. Math. Sci. Vol. 3, No., May 03, pp. 83 9. c Idia Academy of Scieces Asymptotic distributio of products of sums of idepedet radom variables YANLING WANG, SUXIA YAO ad HONGXIA DU ollege
More informationTHE SPECTRAL RADII AND NORMS OF LARGE DIMENSIONAL NON-CENTRAL RANDOM MATRICES
COMMUN. STATIST.-STOCHASTIC MODELS, 0(3), 525-532 (994) THE SPECTRAL RADII AND NORMS OF LARGE DIMENSIONAL NON-CENTRAL RANDOM MATRICES Jack W. Silverstei Departmet of Mathematics, Box 8205 North Carolia
More informationNotes 19 : Martingale CLT
Notes 9 : Martigale CLT Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: [Bil95, Chapter 35], [Roc, Chapter 3]. Sice we have ot ecoutered weak covergece i some time, we first recall
More informationON ASYMPTOTIC REPRESENTATIONS FOR REDUCED QUANTILES IN SAMPLING FROM A LENGTH-BIAS~D DISTRIBUTION. Pranab Kumar Sen
ON SYMTOTIC RERESENTTIONS FOR REDUCED QUNTILES IN SMLING FROM LENGTH-BIS~D DISTRIBUTION hy raab Kumar Se Departmet of Biostatistics Uiversity of North Carolia at Chapel Hill Istitute of Statistics Mimeo
More informationRank tests and regression rank scores tests in measurement error models
Rak tests ad regressio rak scores tests i measuremet error models J. Jurečková ad A.K.Md.E. Saleh Charles Uiversity i Prague ad Carleto Uiversity i Ottawa Abstract The rak ad regressio rak score tests
More informationSTAT331. Example of Martingale CLT with Cox s Model
STAT33 Example of Martigale CLT with Cox s Model I this uit we illustrate the Martigale Cetral Limit Theorem by applyig it to the partial likelihood score fuctio from Cox s model. For simplicity of presetatio
More informationStochastic Simulation
Stochastic Simulatio 1 Itroductio Readig Assigmet: Read Chapter 1 of text. We shall itroduce may of the key issues to be discussed i this course via a couple of model problems. Model Problem 1 (Jackso
More informationApproximation theorems for localized szász Mirakjan operators
Joural of Approximatio Theory 152 (2008) 125 134 www.elsevier.com/locate/jat Approximatio theorems for localized szász Miraja operators Lise Xie a,,1, Tigfa Xie b a Departmet of Mathematics, Lishui Uiversity,
More informationProbability and Random Processes
Probability ad Radom Processes Lecture 5 Probability ad radom variables The law of large umbers Mikael Skoglud, Probability ad radom processes 1/21 Why Measure Theoretic Probability? Stroger limit theorems
More information1 Convergence in Probability and the Weak Law of Large Numbers
36-752 Advaced Probability Overview Sprig 2018 8. Covergece Cocepts: i Probability, i L p ad Almost Surely Istructor: Alessadro Rialdo Associated readig: Sec 2.4, 2.5, ad 4.11 of Ash ad Doléas-Dade; Sec
More informationAn almost sure invariance principle for trimmed sums of random vectors
Proc. Idia Acad. Sci. Math. Sci. Vol. 20, No. 5, November 200, pp. 6 68. Idia Academy of Scieces A almost sure ivariace priciple for trimmed sums of radom vectors KE-ANG FU School of Statistics ad Mathematics,
More informationHAJEK-RENYI-TYPE INEQUALITY FOR SOME NONMONOTONIC FUNCTIONS OF ASSOCIATED RANDOM VARIABLES
HAJEK-RENYI-TYPE INEQUALITY FOR SOME NONMONOTONIC FUNCTIONS OF ASSOCIATED RANDOM VARIABLES ISHA DEWAN AND B. L. S. PRAKASA RAO Received 1 April 005; Revised 6 October 005; Accepted 11 December 005 Let
More informationHyun-Chull Kim and Tae-Sung Kim
Commu. Korea Math. Soc. 20 2005), No. 3, pp. 531 538 A CENTRAL LIMIT THEOREM FOR GENERAL WEIGHTED SUM OF LNQD RANDOM VARIABLES AND ITS APPLICATION Hyu-Chull Kim ad Tae-Sug Kim Abstract. I this paper we
More informationProbabilistic and Average Linear Widths in L -Norm with Respect to r-fold Wiener Measure
joural of approximatio theory 84, 3140 (1996) Article No. 0003 Probabilistic ad Average Liear Widths i L -Norm with Respect to r-fold Wieer Measure V. E. Maiorov Departmet of Mathematics, Techio, Haifa,
More informationNotes 5 : More on the a.s. convergence of sums
Notes 5 : More o the a.s. covergece of sums Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: Dur0, Sectios.5; Wil9, Sectio 4.7, Shi96, Sectio IV.4, Dur0, Sectio.. Radom series. Three-series
More informationIt is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function.
MATH 532 Measurable Fuctios Dr. Neal, WKU Throughout, let ( X, F, µ) be a measure space ad let (!, F, P ) deote the special case of a probability space. We shall ow begi to study real-valued fuctios defied
More informationLimit Theorems. Convergence in Probability. Let X be the number of heads observed in n tosses. Then, E[X] = np and Var[X] = np(1-p).
Limit Theorems Covergece i Probability Let X be the umber of heads observed i tosses. The, E[X] = p ad Var[X] = p(-p). L O This P x p NM QP P x p should be close to uity for large if our ituitio is correct.
More informationLecture 8: Convergence of transformations and law of large numbers
Lecture 8: Covergece of trasformatios ad law of large umbers Trasformatio ad covergece Trasformatio is a importat tool i statistics. If X coverges to X i some sese, we ofte eed to check whether g(x ) coverges
More informationIntroduction to Probability. Ariel Yadin
Itroductio to robability Ariel Yadi Lecture 2 *** Ja. 7 ***. Covergece of Radom Variables As i the case of sequeces of umbers, we would like to talk about covergece of radom variables. There are may ways
More informationki, X(n) lj (n) = (ϱ (n) ij ) 1 i,j d.
APPLICATIONES MATHEMATICAE 22,2 (1994), pp. 193 200 M. WIŚNIEWSKI (Kielce) EXTREME ORDER STATISTICS IN AN EQUALLY CORRELATED GAUSSIAN ARRAY Abstract. This paper cotais the results cocerig the wea covergece
More informationNotes on Snell Envelops and Examples
Notes o Sell Evelops ad Examples Example (Secretary Problem): Coside a pool of N cadidates whose qualificatios are represeted by ukow umbers {a > a 2 > > a N } from best to last. They are iterviewed sequetially
More informationA Note on the Kolmogorov-Feller Weak Law of Large Numbers
Joural of Mathematical Research with Applicatios Mar., 015, Vol. 35, No., pp. 3 8 DOI:10.3770/j.iss:095-651.015.0.013 Http://jmre.dlut.edu.c A Note o the Kolmogorov-Feller Weak Law of Large Numbers Yachu
More informationSlide Set 13 Linear Model with Endogenous Regressors and the GMM estimator
Slide Set 13 Liear Model with Edogeous Regressors ad the GMM estimator Pietro Coretto pcoretto@uisa.it Ecoometrics Master i Ecoomics ad Fiace (MEF) Uiversità degli Studi di Napoli Federico II Versio: Friday
More informationIt is often useful to approximate complicated functions using simpler ones. We consider the task of approximating a function by a polynomial.
Taylor Polyomials ad Taylor Series It is ofte useful to approximate complicated fuctios usig simpler oes We cosider the task of approximatig a fuctio by a polyomial If f is at least -times differetiable
More informationLecture 20: Multivariate convergence and the Central Limit Theorem
Lecture 20: Multivariate covergece ad the Cetral Limit Theorem Covergece i distributio for radom vectors Let Z,Z 1,Z 2,... be radom vectors o R k. If the cdf of Z is cotiuous, the we ca defie covergece
More informationSolution. 1 Solutions of Homework 1. Sangchul Lee. October 27, Problem 1.1
Solutio Sagchul Lee October 7, 017 1 Solutios of Homework 1 Problem 1.1 Let Ω,F,P) be a probability space. Show that if {A : N} F such that A := lim A exists, the PA) = lim PA ). Proof. Usig the cotiuity
More informationThis section is optional.
4 Momet Geeratig Fuctios* This sectio is optioal. The momet geeratig fuctio g : R R of a radom variable X is defied as g(t) = E[e tx ]. Propositio 1. We have g () (0) = E[X ] for = 1, 2,... Proof. Therefore
More informationAn alternative proof of a theorem of Aldous. concerning convergence in distribution for martingales.
A alterative proof of a theorem of Aldous cocerig covergece i distributio for martigales. Maurizio Pratelli Dipartimeto di Matematica, Uiversità di Pisa. Via Buoarroti 2. I-56127 Pisa, Italy e-mail: pratelli@dm.uipi.it
More information62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +
62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of
More informationInformation Theory and Statistics Lecture 4: Lempel-Ziv code
Iformatio Theory ad Statistics Lecture 4: Lempel-Ziv code Łukasz Dębowski ldebowsk@ipipa.waw.pl Ph. D. Programme 203/204 Etropy rate is the limitig compressio rate Theorem For a statioary process (X i)
More informationCentral limit theorem and almost sure central limit theorem for the product of some partial sums
Proc. Idia Acad. Sci. Math. Sci. Vol. 8, No. 2, May 2008, pp. 289 294. Prited i Idia Cetral it theorem ad almost sure cetral it theorem for the product of some partial sums YU MIAO College of Mathematics
More informationExponential Families and Bayesian Inference
Computer Visio Expoetial Families ad Bayesia Iferece Lecture Expoetial Families A expoetial family of distributios is a d-parameter family f(x; havig the followig form: f(x; = h(xe g(t T (x B(, (. where
More informationAn Introduction to Asymptotic Theory
A Itroductio to Asymptotic Theory Pig Yu School of Ecoomics ad Fiace The Uiversity of Hog Kog Pig Yu (HKU) Asymptotic Theory 1 / 20 Five Weapos i Asymptotic Theory Five Weapos i Asymptotic Theory Pig Yu
More informationAdvanced Stochastic Processes.
Advaced Stochastic Processes. David Gamarik LECTURE 2 Radom variables ad measurable fuctios. Strog Law of Large Numbers (SLLN). Scary stuff cotiued... Outlie of Lecture Radom variables ad measurable fuctios.
More informationSFB 823. Robust estimation of change-point location. Discussion Paper. Carina Gerstenberger
SFB 823 Robust estimatio of chage-poit locatio Discussio Paper Caria Gersteberger Nr. 2/207 Robust Estimatio of Chage-Poit Locatio Caria Gersteberger We itroduce a robust estimator of the locatio parameter
More informationA NEW METHOD FOR CONSTRUCTING APPROXIMATE CONFIDENCE INTERVALS FOR M-ESTU1ATES. Dennis D. Boos
.- A NEW METHOD FOR CONSTRUCTING APPROXIMATE CONFIDENCE INTERVALS FOR M-ESTU1ATES by Deis D. Boos Departmet of Statistics North Carolia State Uiversity Istitute of Statistics Mimeo Series #1198 September,
More informationInformation Theory Tutorial Communication over Channels with memory. Chi Zhang Department of Electrical Engineering University of Notre Dame
Iformatio Theory Tutorial Commuicatio over Chaels with memory Chi Zhag Departmet of Electrical Egieerig Uiversity of Notre Dame Abstract A geeral capacity formula C = sup I(; Y ), which is correct for
More informationApplication to Random Graphs
A Applicatio to Radom Graphs Brachig processes have a umber of iterestig ad importat applicatios. We shall cosider oe of the most famous of them, the Erdős-Réyi radom graph theory. 1 Defiitio A.1. Let
More informationLecture 01: the Central Limit Theorem. 1 Central Limit Theorem for i.i.d. random variables
CSCI-B609: A Theorist s Toolkit, Fall 06 Aug 3 Lecture 0: the Cetral Limit Theorem Lecturer: Yua Zhou Scribe: Yua Xie & Yua Zhou Cetral Limit Theorem for iid radom variables Let us say that we wat to aalyze
More informationJournal of Multivariate Analysis. Superefficient estimation of the marginals by exploiting knowledge on the copula
Joural of Multivariate Aalysis 102 (2011) 1315 1319 Cotets lists available at ScieceDirect Joural of Multivariate Aalysis joural homepage: www.elsevier.com/locate/jmva Superefficiet estimatio of the margials
More informationDefinition 4.2. (a) A sequence {x n } in a Banach space X is a basis for X if. unique scalars a n (x) such that x = n. a n (x) x n. (4.
4. BASES I BAACH SPACES 39 4. BASES I BAACH SPACES Sice a Baach space X is a vector space, it must possess a Hamel, or vector space, basis, i.e., a subset {x γ } γ Γ whose fiite liear spa is all of X ad
More informationLecture 15: Density estimation
Lecture 15: Desity estimatio Why do we estimate a desity? Suppose that X 1,...,X are i.i.d. radom variables from F ad that F is ukow but has a Lebesgue p.d.f. f. Estimatio of F ca be doe by estimatig f.
More informationOn Random Line Segments in the Unit Square
O Radom Lie Segmets i the Uit Square Thomas A. Courtade Departmet of Electrical Egieerig Uiversity of Califoria Los Ageles, Califoria 90095 Email: tacourta@ee.ucla.edu I. INTRODUCTION Let Q = [0, 1] [0,
More informationON PERMUTATIONAL CENTRAL LIMIT THEOREMS FOR GENERAL MULTIVARIATE LINEAR RANK STATISTICS
ON PERMUTATIONAL CENTRAL LIMIT THEOREMS FOR GENERAL MULTIVARIATE LINEAR RANK STATISTICS by Praab Kumar Se Departmet of Biostatistics Uiversity of North Carolia at Chapel Hill Istitute of Statistics Mimeo
More informationThe Central Limit Theorem
Chapter The Cetral Limit Theorem Deote by Z the stadard ormal radom variable with desity 2π e x2 /2. Lemma.. Ee itz = e t2 /2 Proof. We use the same calculatio as for the momet geeratig fuctio: exp(itx
More informationProbability and Statistics
ICME Refresher Course: robability ad Statistics Staford Uiversity robability ad Statistics Luyag Che September 20, 2016 1 Basic robability Theory 11 robability Spaces A probability space is a triple (Ω,
More informationSTX FACULTY WORKING PAPER NO EC*0BB4. Roger W. Koenker. and Related Empirical Processes. Strong Consistency of Regression Quantiles
J30 $385 lo. 1086 COPY 2 STX FACULTY WORKING PAPER NO. 1086 Strog Cosistecy of Regressio Quatiles ad Related Empirical Processes Gilbert W. Bassett Roger W. Koeker JHE LIBRARY oeihe 0EC*0BB4 UNWE atu;
More informationTR/46 OCTOBER THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION A. TALBOT
TR/46 OCTOBER 974 THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION by A. TALBOT .. Itroductio. A problem i approximatio theory o which I have recetly worked [] required for its solutio a proof that the
More informationSummary and Discussion on Simultaneous Analysis of Lasso and Dantzig Selector
Summary ad Discussio o Simultaeous Aalysis of Lasso ad Datzig Selector STAT732, Sprig 28 Duzhe Wag May 4, 28 Abstract This is a discussio o the work i Bickel, Ritov ad Tsybakov (29). We begi with a short
More information2.2. Central limit theorem.
36.. Cetral limit theorem. The most ideal case of the CLT is that the radom variables are iid with fiite variace. Although it is a special case of the more geeral Lideberg-Feller CLT, it is most stadard
More information1 = δ2 (0, ), Y Y n nδ. , T n = Y Y n n. ( U n,k + X ) ( f U n,k + Y ) n 2n f U n,k + θ Y ) 2 E X1 2 X1
8. The cetral limit theorems 8.1. The cetral limit theorem for i.i.d. sequeces. ecall that C ( is N -separatig. Theorem 8.1. Let X 1, X,... be i.i.d. radom variables with EX 1 = ad EX 1 = σ (,. Suppose
More information