Self-normalized deviation inequalities with application to t-statistic
|
|
- Cameron Boone
- 5 years ago
- Views:
Transcription
1 Self-ormalized deviatio iequalities with applicatio to t-statistic Xiequa Fa Ceter for Applied Mathematics, Tiaji Uiversity, Tiaji, Chia Abstract Let ξ i i 1 be a sequece of idepedet ad symmetric radom variables. We obtai some upper bouds o tail probabilities of self-ormalized deviatios 1k k ξ i / ξ i β 1/β x for x > 0 ad β > 1. Our boud is the best that ca be obtaied from the Berstei iequality uder the preset assumptio. A applicatio to Studet s t-statistic is also give. Keywords: Self-ormalized deviatios; Studet s t-statistic; expoetial iequalities 000 MSC: rimary 60E15; 60F10 1. Itroductio Let ξ i i 1 be a sequece of idepedet, cetered ad odegeerate real-valued radom variables r.v.s. Deote by S = ξ i ad V β = ξ i β 1/β, β > 1. The study of the tail probabilities S /V β x certaily has attracted some particular attetios. I the case where r.v.s ξ i i 1 are idetically distributed ad E ξ 1 β =, β > 1, Shao [9 proved the followig deep large deviatio priciple LD result: for ay x > 0, lim S 1/ [ { 1 V β 1 1/β x = sup if E exp t cx x c 0 t 0 β X β + β 1 β cβ/β 1. The related moderate deviatio priciples MD are also give by Shao [9 ad Jig, Liag ad Zhou [6. However, the LD ad MD results do ot dimiish the eed for tail probability iequalities valid for give. Such iequalities have bee obtaied i particular by Wag ad Jig [10. For istace, they proved that if the r.v.s ξ i i 1 are symmetric aroud 0, the for all x > 0, S V x exp { x. 1 Correspodig author. faxiequa@hotmail.com X. Fa. reprit submitted to Elsevier March 9, 017
2 This boud is rather tight for moderate x s. Ideed, as showed by the MD result of Shao [9 cf. Theorem 3.1, for certai class of r.v.s it holds that x S l V x = 1, for x ad x = o as. See also Theorem.1 of Jig, Liag ad Zhou [6 for o idetically distributed r.v.s. I Fa, Grama ad Liu [3, iequality 1 has bee further exteded to the case of partial imum: for all x > 0, 1k V x exp { x. 3 O the other had, by the Cauchy-Schwarz iequality, it is easy to see that S V. Therefore, for all x >, S V x 1k V x = 0, 4 which caot be deduced from 1 ad 3. Hece, the iequalities 1 ad 3 are ot tight eough for large x s. I this paper we give a improvemet o iequality 3; see iequality 5. Our iequality coicides with 4. More geeral, we establish a upper boud o tail probabilities 1k /V β x, x > 0, for symmetric r.v.s ξ i i 1. I particular, we show that our iequality is the best that ca be obtaied from the classical Berstei iequality: X > x if λ>0 E[e λx x. A applicatio to Studet s t-statistic is also give. The paper is orgaized as follows. Our mai results ad applicatios are stated ad discussed i Sectio. roofs are deferred to Sectio 3.. Mai results I the followig theorem, we give a self-ormalized deviatio iequality for idepedet ad symmetric radom variables. Theorem.1. Assume that ξ i i 1 is a sequece of idepedet, symmetric ad odegeerate radom variables. Deote by V β = ξ i β 1/β, β 1,. The for all x > 0, 1k V β x B β, x := 1 t 1 + t 1 1/βx 1 t {x β 1/β, 5 where t = β 1/β + x β 1/β x
3 with the covetio that B β, β 1/β =. Moreover, B, x is icreasig i ad for ay x > 0, lim B, x = exp { x. 6 Hölder s iequality implies that S V β β 1/β. Thus whe x > β 1/β, it holds that 1k S k V β x = 0. 7 This feature coicides with the fact that B β, x = 0 for all x > β 1/β. Notice that boud 5 is the best that ca be obtaied from the followig Berstei iequality S [ V β x if E S λ e x Vβ. 8 λ 0 Ideed, if ξ i = ±a, a > 0, with probabilities 1/, the it holds for all 0 < x <, [ if E e λ S x [ Vβ = if E S λ e x a 1/β = if λ 0 λ 0 λ 0 e λx cosh λ 1/β = B β, x. Moreover, whe x β 1/β, boud 5 teds to, which is the best possible at x = β 1/β. Ideed, for the ξ i s metioed above, it holds S k 1k V β β 1/β = ξ i = a for all i [1, = 1. By 6, it holds lim B, x = e x / e /, x 1/, 9 which seems to be cotracted with B, x as x 1/. I fact, 6 holds for ay fixed x > 0, but it does t hold for x = c 1/, where c is a positive absolute costat. For example, cosider the followig fuctio { B, x = exp x l 1 x4, x > 0. The the last fuctio satisfies 9 ad lim x 1/ B, x =. Sice the r.v.s ξ i i 1 are symmetric, it is obvious that for all x > 0, 1k V β x B β, x, where B β, x is defied by 5. Whe β 1,, iequality 5 implies the followig boud. 3
4 Corollary.1. Assume coditio of Theorem.1. If β 1,, the for all x > 0, 1k V β x exp { x β I particular, the last iequality implies that for ay β 1,, i probability. S 0,, V β For β 1,, iequality 10 implies the followig upper boud of LD: 1 lim sup l 1k V β β 1/β x x, x 0, It also implies the followig upper boud of MD: for ay α β β, β 1 β, lim sup 1 α+ β l 1 1k V β α x x, x 0,. 1 With certai regularity coditios o tail probabilities of ξ i, the LD ad MD results are allowed to be established. We refer to Shao [9 ad Jig, Liag ad Zhou [6. Wag ad Jig [10 proved that for all x > 0, S V x exp { x. 13 A earlier result similar to 13 ca be foud i [5, where Hitczeko has obtaied the same upper boud o tail probabilities S x V. Whe β =, iequality 10 reduces to the followig iequality of Fa et al. [3: for all x > 0, 1k V x exp { x. 14 Thus iequality 10 ca be regarded as a geeralizatio of 13 ad 14. Moreover, sice boud 5 is less tha boud 14, our iequality 5 improves o 14. If ξ i i 1 have + δth momets with 0 < δ 1, the iequalities 13 ad 14 ca be further improved. For istace, Jig, Shao ad Wag [7 proved the followig Cramér type large deviatios for i.i.d. ot ecessarily symmetric r.v.s: S xv = 1 Φx 1 + o1,, 15 uiformly for all 0 x = o δ/4+δ. Similarly, Liu, Shao ad Wag [8 proved the followig result for the imum of sums: xv = 1 Φx 1 + o1,, 16 1k 4
5 uiformly for all 0 x = o δ/4+δ. Moreover, these asymptotic estimatios are also more precise tha 5 for moderate x s. Let Y i i 1 be a sequece of idepedet odegeerate r.v.s, ad d i i 1 be a sequece of idepedet Rademacher r.v.s, i.e. d i = ±1 = 1. Let ξ i = d i Y i. Assume that Y i i 1 ad d i i 1 are idepedet. The we ow have S = d i Y i, V β = Y i β 1/β, β > 1. The followig result easily follows from Theorem.1 ad Corollary.1. Corollary.. Let ξ i = d i Y i for all i 1. If β 1,, the for all 0 < x β 1/β, 1k V β x B β, x exp { x β 1. I particular, the last iequality implies that for ay β 1,, i probability. where Cosider Studet s t-statistic T defied by It is kow that for all x > 0, ξ = S T x = S 0,, V β T = ξ / σ, ad σ = S x [S ξ i ξ. 1 + x 1 1/ ; 1/ see Efro [1. Notice that for all x > 0, it holds that 0 < x +x 1 < 1/. Usig iequality 5, we have the followig expoetial boud for Studet s t-statistic. Theorem.. Assume that ξ i i 1 is a sequece of idepedet, symmetric ad odegeerate radom variables. The for all x > 0, where B, x is defied by 5. T x B, x + x 1 1/, 17 5
6 3. roofs of Theorem.1 ad Corollary.1 The proof of Theorem.1 is based o a method called chage of probability measure for martigales. The method is developed by Grama ad Haeusler [4. See also Fa, Grama ad Liu [. roof of Theorem.1. For ay i 1, set η i = ξ i V β, F 0 = σ ξ j, 1 j ad F i = σ ξ k, 1 k i, ξ j, 1 j. 18 Sice ξ i i 1 are idepedet ad symmetric, the [ [ E[ξ i > y F i 1 = E ξ i > y ξ i = E ξ i > y ξ i = E[ ξ i > y F i 1. Thus η i, F i,..., is a sequece of coditioally symmetric martigale differeces, i.e. E[η i > y F i 1 = E[ η i > y F i 1. It is easy to see that S V β = η i 19 is a sum of martigale differeces, ad that η i, F i,..., satisfies η i β = For ay x > 0, defie the stoppig time T : { T x = mi k [1, : with the covetio that mi = 0. The it follows that ξ i β V β β = 1. k η i x, 1 { 1k /V β x = 1 {T x=k. For ay oegative umber λ, defie the martigale Mλ = M k λ, F k k=0,...,, where M k λ = k k=1 exp {λη i E [exp {λη i F i 1, M 0λ = 1. Sice T is a stoppig time, the M T k λ, λ > 0, is also a martigale. Defie the cojugate probability measure λ o Ω, F: d λ = M T λd. 0 Deote by E λ the expectatio with respect to λ. Usig the chage of probability measure 0, we have for all x > 0, S [ k 1k V β x = E λ M T λ 1 1 { 1k /V β x [ { k = E λ exp λ η i + Ψ k λ 1 {T x=k, 1 k=1 6
7 where Ψ k λ = k [ log E exp {λη i F i 1. Sice η i, F i,..., is coditioally symmetric, oe has ad thus it holds Sice E [exp {λη i F i 1 = E [exp { λη i F i 1, E [exp {λη i F i 1 = E [coshλη i F i 1. coshx = k=0 1 k! xk is a eve fuctio, the coshλη i is F i 1 measurable. Thus implies that E[ exp {λη i F i 1 = coshλη i. Notice that the fuctio gx = log coshx is eve ad covex i x R ad icreasig i x [0,. Sice η i 1 1/β η i β 1/β = 1 1/β, it holds Ψ k λ Ψ λ = 1 g λη i g λ λη i g 1/β. By the fact k η i x o the set {T x = k, iequality 1 implies that for all x > 0, 1k V β x The last iequality attais its miimum at k=1 exp { λ E λ [exp λx + g { λ λx + g { exp λx + g 1/β 1 {T =k [ E 1/β λ 1 {T =k k=1 λ. 3 1/β λ = λx = 1/β β 1/β log + x β 1/β, x 0, β 1/β. x Substitutig λ = λx i 3, we obtai the desired iequality 5 for all x 0, β 1/β. Whe x = β 1/β, we have 1k V β β 1/β = lim x β 1/β 1k V β x lim B β, x =. x β 1/β 7
8 Whe x > β 1/β, the desired iequality follows from 7. Notice that the fuctio hx = g x is covex ad icreasig i x [0,. Therefor g x/x is icreasig i x, ad g λ //λ / is decreasig i. Thus { λ B, x = if exp λx + g λ 0 1/ is icreasig i. Sice g λ 1/ λ /,, we obtai lim B, x = sup B, x = if λ 0 exp { λx + λ = exp { x. This completes the proof of Theorem.1. roof of Corollary.1. Sice coshx exp{x /, we have λ g 1/β for all λ > 0. Thus, from 3, for all x > 0, 1k V β x λ 1 if exp λ>0 if exp λ>0 = exp β 4 { λ λx + g { λx + λ { x β 1 1 β 1/β, 5 which gives the desired iequality 10. Ackowledgemets The author would like to thak the aoymous referee for valuable commets ad remarks. The work has bee partially supported by the Natioal Natural Sciece Foudatio of Chia Grats o ad o Refereces [1 B. Efro, Studet s t-test uder symmetry coditios, J. Amer. Statist. Assoc [ X. Fa, I. Grama, Q. Liu, Hoeffdig s iequality for supermartigales, Stochastic rocess. Appl [3 X. Fa, I. Grama, Q. Liu, Expoetial iequalities for martigales with applicatios, Electro. J. robab. 0, o [4 I. Grama, E. Haeusler, Large deviatios for martigales via Cramér s method, Stochastic rocess. Appl [5. Hitczeko, Upper bouds for the L p -orms of martigales, robab. Theory Related Fields
9 [6 B.Y. Jig, H.Y. Liag, W. Zhou, Self-ormalized moderate deviatios for idepedet radom variables, Sci. Chia Math [7 B.Y. Jig, Q.M. Shao, Q.Y. Wag, Self-ormalized Cramér-type large deviatios for idepedet radom variables. A. robab [8 W. Liu, Q.M. Shao, Q.Y. Wag, Self-ormalized Cramér type moderate deviatios for the imum of sums, Beroulli [9 Q.M. Shao, Self-ormalized large deviatios, A. robab [10 Q.Y. Wag, B.Y. Jig, A expoetial ouiform Berry-Essee boud for self-ormalized sums, A. robab
Berry-Esseen bounds for self-normalized martingales
Berry-Essee bouds for self-ormalized martigales Xiequa Fa a, Qi-Ma Shao b a Ceter for Applied Mathematics, Tiaji Uiversity, Tiaji 30007, Chia b Departmet of Statistics, The Chiese Uiversity of Hog Kog,
More informationGamma Distribution and Gamma Approximation
Gamma Distributio ad Gamma Approimatio Xiaomig Zeg a Fuhua (Frak Cheg b a Xiame Uiversity, Xiame 365, Chia mzeg@jigia.mu.edu.c b Uiversity of Ketucky, Leigto, Ketucky 456-46, USA cheg@cs.uky.edu Abstract
More informationLimit distributions for products of sums
Statistics & Probability Letters 62 (23) 93 Limit distributios for products of sums Yogcheg Qi Departmet of Mathematics ad Statistics, Uiversity of Miesota-Duluth, Campus Ceter 4, 7 Uiversity Drive, Duluth,
More informationApproximation theorems for localized szász Mirakjan operators
Joural of Approximatio Theory 152 (2008) 125 134 www.elsevier.com/locate/jat Approximatio theorems for localized szász Miraja operators Lise Xie a,,1, Tigfa Xie b a Departmet of Mathematics, Lishui Uiversity,
More informationThe log-behavior of n p(n) and n p(n)/n
Ramauja J. 44 017, 81-99 The log-behavior of p ad p/ William Y.C. Che 1 ad Ke Y. Zheg 1 Ceter for Applied Mathematics Tiaji Uiversity Tiaji 0007, P. R. Chia Ceter for Combiatorics, LPMC Nakai Uivercity
More informationAsymptotic distribution of products of sums of independent random variables
Proc. Idia Acad. Sci. Math. Sci. Vol. 3, No., May 03, pp. 83 9. c Idia Academy of Scieces Asymptotic distributio of products of sums of idepedet radom variables YANLING WANG, SUXIA YAO ad HONGXIA DU ollege
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationMi-Hwa Ko and Tae-Sung Kim
J. Korea Math. Soc. 42 2005), No. 5, pp. 949 957 ALMOST SURE CONVERGENCE FOR WEIGHTED SUMS OF NEGATIVELY ORTHANT DEPENDENT RANDOM VARIABLES Mi-Hwa Ko ad Tae-Sug Kim Abstract. For weighted sum of a sequece
More informationA Note on the Kolmogorov-Feller Weak Law of Large Numbers
Joural of Mathematical Research with Applicatios Mar., 015, Vol. 35, No., pp. 3 8 DOI:10.3770/j.iss:095-651.015.0.013 Http://jmre.dlut.edu.c A Note o the Kolmogorov-Feller Weak Law of Large Numbers Yachu
More informationCentral limit theorem and almost sure central limit theorem for the product of some partial sums
Proc. Idia Acad. Sci. Math. Sci. Vol. 8, No. 2, May 2008, pp. 289 294. Prited i Idia Cetral it theorem ad almost sure cetral it theorem for the product of some partial sums YU MIAO College of Mathematics
More informationSelf-normalized Cramér type Moderate Deviations for the Maximum of Sums
Self-ormalized Cramér type Moderate Deviatios for the Maximum of Sums Weidog Liu 1, Qi-Ma Shao ad Qiyig Wag 3 Abstract Let X 1, X,... be idepedet radom variables with zero meas ad fiite variaces, ad let
More informationarxiv: v1 [math.pr] 13 Oct 2011
A tail iequality for quadratic forms of subgaussia radom vectors Daiel Hsu, Sham M. Kakade,, ad Tog Zhag 3 arxiv:0.84v math.pr] 3 Oct 0 Microsoft Research New Eglad Departmet of Statistics, Wharto School,
More informationWeak Laws of Large Numbers for Sequences or Arrays of Correlated Random Variables
Iteratioal Mathematical Forum, Vol., 5, o. 4, 65-73 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/.988/imf.5.5 Weak Laws of Large Numers for Sequeces or Arrays of Correlated Radom Variales Yutig Lu School
More informationAppendix to Quicksort Asymptotics
Appedix to Quicksort Asymptotics James Alle Fill Departmet of Mathematical Scieces The Johs Hopkis Uiversity jimfill@jhu.edu ad http://www.mts.jhu.edu/~fill/ ad Svate Jaso Departmet of Mathematics Uppsala
More informationh(x i,x j ). (1.1) 1 i<j n
ESAIM: PS 15 2011 168 179 DOI: 10.1051/ps/2009014 ESAIM: Probability ad Statistics www.esaim-ps.org CRAMÉR TYPE MODERATE DEVIATIONS FOR STUDENTIZED U-STATISTICS,, Tze Leg Lai 1, Qi-Ma Shao 2 ad Qiyig Wag
More informationA note on self-normalized Dickey-Fuller test for unit root in autoregressive time series with GARCH errors
Appl. Math. J. Chiese Uiv. 008, 3(): 97-0 A ote o self-ormalized Dickey-Fuller test for uit root i autoregressive time series with GARCH errors YANG Xiao-rog ZHANG Li-xi Abstract. I this article, the uit
More informationECE 330:541, Stochastic Signals and Systems Lecture Notes on Limit Theorems from Probability Fall 2002
ECE 330:541, Stochastic Sigals ad Systems Lecture Notes o Limit Theorems from robability Fall 00 I practice, there are two ways we ca costruct a ew sequece of radom variables from a old sequece of radom
More informationA Note on Sums of Independent Random Variables
Cotemorary Mathematics Volume 00 XXXX A Note o Sums of Ideedet Radom Variables Pawe l Hitczeko ad Stehe Motgomery-Smith Abstract I this ote a two sided boud o the tail robability of sums of ideedet ad
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationGlivenko-Cantelli Classes
CS28B/Stat24B (Sprig 2008 Statistical Learig Theory Lecture: 4 Gliveko-Catelli Classes Lecturer: Peter Bartlett Scribe: Michelle Besi Itroductio This lecture will cover Gliveko-Catelli (GC classes ad itroduce
More informationBounds for the Extreme Eigenvalues Using the Trace and Determinant
ISSN 746-7659, Eglad, UK Joural of Iformatio ad Computig Sciece Vol 4, No, 9, pp 49-55 Bouds for the Etreme Eigevalues Usig the Trace ad Determiat Qi Zhog, +, Tig-Zhu Huag School of pplied Mathematics,
More informationConvergence of random variables. (telegram style notes) P.J.C. Spreij
Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space
More informationAn Introduction to Randomized Algorithms
A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis
More informationMAXIMAL INEQUALITIES AND STRONG LAW OF LARGE NUMBERS FOR AANA SEQUENCES
Commu Korea Math Soc 26 20, No, pp 5 6 DOI 0434/CKMS20265 MAXIMAL INEQUALITIES AND STRONG LAW OF LARGE NUMBERS FOR AANA SEQUENCES Wag Xueju, Hu Shuhe, Li Xiaoqi, ad Yag Wezhi Abstract Let {X, } be a sequece
More informationResearch Article Moment Inequality for ϕ-mixing Sequences and Its Applications
Hidawi Publishig Corporatio Joural of Iequalities ad Applicatios Volume 2009, Article ID 379743, 2 pages doi:0.55/2009/379743 Research Article Momet Iequality for ϕ-mixig Sequeces ad Its Applicatios Wag
More informationAn almost sure invariance principle for trimmed sums of random vectors
Proc. Idia Acad. Sci. Math. Sci. Vol. 20, No. 5, November 200, pp. 6 68. Idia Academy of Scieces A almost sure ivariace priciple for trimmed sums of radom vectors KE-ANG FU School of Statistics ad Mathematics,
More informationA survey on penalized empirical risk minimization Sara A. van de Geer
A survey o pealized empirical risk miimizatio Sara A. va de Geer We address the questio how to choose the pealty i empirical risk miimizatio. Roughly speakig, this pealty should be a good boud for the
More informationREGRESSION WITH QUADRATIC LOSS
REGRESSION WITH QUADRATIC LOSS MAXIM RAGINSKY Regressio with quadratic loss is aother basic problem studied i statistical learig theory. We have a radom couple Z = X, Y ), where, as before, X is a R d
More information2.2. Central limit theorem.
36.. Cetral limit theorem. The most ideal case of the CLT is that the radom variables are iid with fiite variace. Although it is a special case of the more geeral Lideberg-Feller CLT, it is most stadard
More informationarxiv: v1 [math.pr] 4 Dec 2013
Squared-Norm Empirical Process i Baach Space arxiv:32005v [mathpr] 4 Dec 203 Vicet Q Vu Departmet of Statistics The Ohio State Uiversity Columbus, OH vqv@statosuedu Abstract Jig Lei Departmet of Statistics
More informationLecture 8: Convergence of transformations and law of large numbers
Lecture 8: Covergece of trasformatios ad law of large umbers Trasformatio ad covergece Trasformatio is a importat tool i statistics. If X coverges to X i some sese, we ofte eed to check whether g(x ) coverges
More informationSupplementary Material for Fast Stochastic AUC Maximization with O(1/n)-Convergence Rate
Supplemetary Material for Fast Stochastic AUC Maximizatio with O/-Covergece Rate Migrui Liu Xiaoxua Zhag Zaiyi Che Xiaoyu Wag 3 iabao Yag echical Lemmas ized versio of Hoeffdig s iequality, ote that We
More informationInformation Theory and Statistics Lecture 4: Lempel-Ziv code
Iformatio Theory ad Statistics Lecture 4: Lempel-Ziv code Łukasz Dębowski ldebowsk@ipipa.waw.pl Ph. D. Programme 203/204 Etropy rate is the limitig compressio rate Theorem For a statioary process (X i)
More informationON THE KOMLÓS RÉVÉSZ ESTIMATION PROBLEM FOR RANDOM VARIABLES WITHOUT VARIANCES. Ben-Gurion University, Israel
ON THE KOMLÓS RÉVÉSZ ESTIMATION PROBLEM FOR RANDOM VARIABLES WITHOUT VARIANCES GUY COHEN Be-Gurio Uiversity, Israel e-mail: guycohe@ee.bgu.ac.il Abstract. Let {X } L p P), 1 < p 2, q = p/p 1), be a sequece
More informationLecture 01: the Central Limit Theorem. 1 Central Limit Theorem for i.i.d. random variables
CSCI-B609: A Theorist s Toolkit, Fall 06 Aug 3 Lecture 0: the Cetral Limit Theorem Lecturer: Yua Zhou Scribe: Yua Xie & Yua Zhou Cetral Limit Theorem for iid radom variables Let us say that we wat to aalyze
More informationExistence of viscosity solutions with asymptotic behavior of exterior problems for Hessian equations
Available olie at www.tjsa.com J. Noliear Sci. Appl. 9 (2016, 342 349 Research Article Existece of viscosity solutios with asymptotic behavior of exterior problems for Hessia equatios Xiayu Meg, Yogqiag
More informationOn the convergence rates of Gladyshev s Hurst index estimator
Noliear Aalysis: Modellig ad Cotrol, 2010, Vol 15, No 4, 445 450 O the covergece rates of Gladyshev s Hurst idex estimator K Kubilius 1, D Melichov 2 1 Istitute of Mathematics ad Iformatics, Vilius Uiversity
More informationChapter 5. Inequalities. 5.1 The Markov and Chebyshev inequalities
Chapter 5 Iequalities 5.1 The Markov ad Chebyshev iequalities As you have probably see o today s frot page: every perso i the upper teth percetile ears at least 1 times more tha the average salary. I other
More informationSolutions to HW Assignment 1
Solutios to HW: 1 Course: Theory of Probability II Page: 1 of 6 Uiversity of Texas at Austi Solutios to HW Assigmet 1 Problem 1.1. Let Ω, F, {F } 0, P) be a filtered probability space ad T a stoppig time.
More informationSequences and Series of Functions
Chapter 6 Sequeces ad Series of Fuctios 6.1. Covergece of a Sequece of Fuctios Poitwise Covergece. Defiitio 6.1. Let, for each N, fuctio f : A R be defied. If, for each x A, the sequece (f (x)) coverges
More informationA Hadamard-type lower bound for symmetric diagonally dominant positive matrices
A Hadamard-type lower boud for symmetric diagoally domiat positive matrices Christopher J. Hillar, Adre Wibisoo Uiversity of Califoria, Berkeley Jauary 7, 205 Abstract We prove a ew lower-boud form of
More informationON POINTWISE BINOMIAL APPROXIMATION
Iteratioal Joural of Pure ad Applied Mathematics Volume 71 No. 1 2011, 57-66 ON POINTWISE BINOMIAL APPROXIMATION BY w-functions K. Teerapabolar 1, P. Wogkasem 2 Departmet of Mathematics Faculty of Sciece
More informationON MONOTONICITY OF SOME COMBINATORIAL SEQUENCES
Publ. Math. Debrece 8504, o. 3-4, 85 95. ON MONOTONICITY OF SOME COMBINATORIAL SEQUENCES QING-HU HOU*, ZHI-WEI SUN** AND HAOMIN WEN Abstract. We cofirm Su s cojecture that F / F 4 is strictly decreasig
More informationNotes 5 : More on the a.s. convergence of sums
Notes 5 : More o the a.s. covergece of sums Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: Dur0, Sectios.5; Wil9, Sectio 4.7, Shi96, Sectio IV.4, Dur0, Sectio.. Radom series. Three-series
More informationLocal Approximation Properties for certain King type Operators
Filomat 27:1 (2013, 173 181 DOI 102298/FIL1301173O Published by Faculty of Scieces ad athematics, Uiversity of Niš, Serbia Available at: http://wwwpmfiacrs/filomat Local Approimatio Properties for certai
More informationChapter 3. Strong convergence. 3.1 Definition of almost sure convergence
Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i
More informationSharp large deviations for sums of bounded from above random variables
Noame mauscript No. will be iserted by the editor Sharp large deviatios for sums of bouded from above radom variables Xiequa Fa Received: date / Accepted: date Abstract We show large deviatio epasios for
More informationDistribution of Random Samples & Limit theorems
STAT/MATH 395 A - PROBABILITY II UW Witer Quarter 2017 Néhémy Lim Distributio of Radom Samples & Limit theorems 1 Distributio of i.i.d. Samples Motivatig example. Assume that the goal of a study is to
More informationLecture 3: August 31
36-705: Itermediate Statistics Fall 018 Lecturer: Siva Balakrisha Lecture 3: August 31 This lecture will be mostly a summary of other useful expoetial tail bouds We will ot prove ay of these i lecture,
More informationJ. Stat. Appl. Pro. Lett. 2, No. 1, (2015) 15
J. Stat. Appl. Pro. Lett. 2, No. 1, 15-22 2015 15 Joural of Statistics Applicatios & Probability Letters A Iteratioal Joural http://dx.doi.org/10.12785/jsapl/020102 Martigale Method for Rui Probabilityi
More informationIt is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function.
MATH 532 Measurable Fuctios Dr. Neal, WKU Throughout, let ( X, F, µ) be a measure space ad let (!, F, P ) deote the special case of a probability space. We shall ow begi to study real-valued fuctios defied
More informationEFFECTIVE WLLN, SLLN, AND CLT IN STATISTICAL MODELS
EFFECTIVE WLLN, SLLN, AND CLT IN STATISTICAL MODELS Ryszard Zieliński Ist Math Polish Acad Sc POBox 21, 00-956 Warszawa 10, Polad e-mail: rziel@impagovpl ABSTRACT Weak laws of large umbers (W LLN), strog
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 3 9/11/2013. Large deviations Theory. Cramér s Theorem
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/5.070J Fall 203 Lecture 3 9//203 Large deviatios Theory. Cramér s Theorem Cotet.. Cramér s Theorem. 2. Rate fuctio ad properties. 3. Chage of measure techique.
More information1 Convergence in Probability and the Weak Law of Large Numbers
36-752 Advaced Probability Overview Sprig 2018 8. Covergece Cocepts: i Probability, i L p ad Almost Surely Istructor: Alessadro Rialdo Associated readig: Sec 2.4, 2.5, ad 4.11 of Ash ad Doléas-Dade; Sec
More informationAn alternative proof of a theorem of Aldous. concerning convergence in distribution for martingales.
A alterative proof of a theorem of Aldous cocerig covergece i distributio for martigales. Maurizio Pratelli Dipartimeto di Matematica, Uiversità di Pisa. Via Buoarroti 2. I-56127 Pisa, Italy e-mail: pratelli@dm.uipi.it
More informationCOMPLETE CONVERGENCE AND COMPLETE MOMENT CONVERGENCE FOR ARRAYS OF ROWWISE END RANDOM VARIABLES
GLASNIK MATEMATIČKI Vol. 4969)2014), 449 468 COMPLETE CONVERGENCE AND COMPLETE MOMENT CONVERGENCE FOR ARRAYS OF ROWWISE END RANDOM VARIABLES Yogfeg Wu, Mauel Ordóñez Cabrera ad Adrei Volodi Toglig Uiversity
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationfor all x ; ;x R. A ifiite sequece fx ; g is said to be ND if every fiite subset X ; ;X is ND. The coditios (.) ad (.3) are equivalet for =, but these
sub-gaussia techiques i provig some strog it theorems Λ M. Amii A. Bozorgia Departmet of Mathematics, Faculty of Scieces Sista ad Baluchesta Uiversity, Zaheda, Ira Amii@hamoo.usb.ac.ir, Fax:054446565 Departmet
More information<, if ε > 0 2nloglogn. =, if ε < 0.
GLASNIK MATEMATIČKI Vol. 52(72)(207), 35 360 THE DAVIS-GUT LAW FOR INDEPENDENT AND IDENTICALLY DISTRIBUTED BANACH SPACE VALUED RANDOM ELEMENTS Pigya Che, Migyag Zhag ad Adrew Rosalsky Jia Uversity, P.
More informationNotes 19 : Martingale CLT
Notes 9 : Martigale CLT Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: [Bil95, Chapter 35], [Roc, Chapter 3]. Sice we have ot ecoutered weak covergece i some time, we first recall
More informationEcon 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1.
Eco 325/327 Notes o Sample Mea, Sample Proportio, Cetral Limit Theorem, Chi-square Distributio, Studet s t distributio 1 Sample Mea By Hiro Kasahara We cosider a radom sample from a populatio. Defiitio
More informationExponential Functions and Taylor Series
MATH 4530: Aalysis Oe Expoetial Fuctios ad Taylor Series James K. Peterso Departmet of Biological Scieces ad Departmet of Mathematical Scieces Clemso Uiversity March 29, 2017 MATH 4530: Aalysis Oe Outlie
More information1 Duality revisited. AM 221: Advanced Optimization Spring 2016
AM 22: Advaced Optimizatio Sprig 206 Prof. Yaro Siger Sectio 7 Wedesday, Mar. 9th Duality revisited I this sectio, we will give a slightly differet perspective o duality. optimizatio program: f(x) x R
More informationG. R. Pasha Department of Statistics Bahauddin Zakariya University Multan, Pakistan
Deviatio of the Variaces of Classical Estimators ad Negative Iteger Momet Estimator from Miimum Variace Boud with Referece to Maxwell Distributio G. R. Pasha Departmet of Statistics Bahauddi Zakariya Uiversity
More informationMath 2784 (or 2794W) University of Connecticut
ORDERS OF GROWTH PAT SMITH Math 2784 (or 2794W) Uiversity of Coecticut Date: Mar. 2, 22. ORDERS OF GROWTH. Itroductio Gaiig a ituitive feel for the relative growth of fuctios is importat if you really
More informationRademacher Complexity
EECS 598: Statistical Learig Theory, Witer 204 Topic 0 Rademacher Complexity Lecturer: Clayto Scott Scribe: Ya Deg, Kevi Moo Disclaimer: These otes have ot bee subjected to the usual scrutiy reserved for
More informationSupplementary Material for Fast Stochastic AUC Maximization with O(1/n)-Convergence Rate
Supplemetary Material for Fast Stochastic AUC Maximizatio with O/-Covergece Rate Migrui Liu Xiaoxua Zhag Zaiyi Che Xiaoyu Wag 3 iabao Yag echical Lemmas ized versio of Hoeffdig s iequality, ote that We
More informationResearch Article Complete Convergence for Maximal Sums of Negatively Associated Random Variables
Hidawi Publishig Corporatio Joural of Probability ad Statistics Volume 010, Article ID 764043, 17 pages doi:10.1155/010/764043 Research Article Complete Covergece for Maximal Sums of Negatively Associated
More informationBull. Korean Math. Soc. 36 (1999), No. 3, pp. 451{457 THE STRONG CONSISTENCY OF NONLINEAR REGRESSION QUANTILES ESTIMATORS Seung Hoe Choi and Hae Kyung
Bull. Korea Math. Soc. 36 (999), No. 3, pp. 45{457 THE STRONG CONSISTENCY OF NONLINEAR REGRESSION QUANTILES ESTIMATORS Abstract. This paper provides suciet coditios which esure the strog cosistecy of regressio
More informationAN EXTENSION OF SIMONS INEQUALITY AND APPLICATIONS. Robert DEVILLE and Catherine FINET
2001 vol. XIV, um. 1, 95-104 ISSN 1139-1138 AN EXTENSION OF SIMONS INEQUALITY AND APPLICATIONS Robert DEVILLE ad Catherie FINET Abstract This article is devoted to a extesio of Simos iequality. As a cosequece,
More informationOn Equivalence of Martingale Tail Bounds and Deterministic Regret Inequalities
O Equivalece of Martigale Tail Bouds ad Determiistic Regret Iequalities Sasha Rakhli Departmet of Statistics, The Wharto School Uiversity of Pesylvaia Dec 16, 2015 Joit work with K. Sridhara arxiv:1510.03925
More informationTR/46 OCTOBER THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION A. TALBOT
TR/46 OCTOBER 974 THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION by A. TALBOT .. Itroductio. A problem i approximatio theory o which I have recetly worked [] required for its solutio a proof that the
More informationWeighted Approximation by Videnskii and Lupas Operators
Weighted Approximatio by Videsii ad Lupas Operators Aif Barbaros Dime İstabul Uiversity Departmet of Egieerig Sciece April 5, 013 Aif Barbaros Dime İstabul Uiversity Departmet Weightedof Approximatio Egieerig
More informationRegression with quadratic loss
Regressio with quadratic loss Maxim Ragisky October 13, 2015 Regressio with quadratic loss is aother basic problem studied i statistical learig theory. We have a radom couple Z = X,Y, where, as before,
More informationMath 152. Rumbos Fall Solutions to Review Problems for Exam #2. Number of Heads Frequency
Math 152. Rumbos Fall 2009 1 Solutios to Review Problems for Exam #2 1. I the book Experimetatio ad Measuremet, by W. J. Youde ad published by the by the Natioal Sciece Teachers Associatio i 1962, the
More information1+x 1 + α+x. x = 2(α x2 ) 1+x
Math 2030 Homework 6 Solutios # [Problem 5] For coveiece we let α lim sup a ad β lim sup b. Without loss of geerality let us assume that α β. If α the by assumptio β < so i this case α + β. By Theorem
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More information4. Partial Sums and the Central Limit Theorem
1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems
More informationNEW FAST CONVERGENT SEQUENCES OF EULER-MASCHERONI TYPE
UPB Sci Bull, Series A, Vol 79, Iss, 207 ISSN 22-7027 NEW FAST CONVERGENT SEQUENCES OF EULER-MASCHERONI TYPE Gabriel Bercu We itroduce two ew sequeces of Euler-Mascheroi type which have fast covergece
More informationProbabilistic and Average Linear Widths in L -Norm with Respect to r-fold Wiener Measure
joural of approximatio theory 84, 3140 (1996) Article No. 0003 Probabilistic ad Average Liear Widths i L -Norm with Respect to r-fold Wieer Measure V. E. Maiorov Departmet of Mathematics, Techio, Haifa,
More informationThis section is optional.
4 Momet Geeratig Fuctios* This sectio is optioal. The momet geeratig fuctio g : R R of a radom variable X is defied as g(t) = E[e tx ]. Propositio 1. We have g () (0) = E[X ] for = 1, 2,... Proof. Therefore
More information(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3
MATH 337 Sequeces Dr. Neal, WKU Let X be a metric space with distace fuctio d. We shall defie the geeral cocept of sequece ad limit i a metric space, the apply the results i particular to some special
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationSome remarks on the paper Some elementary inequalities of G. Bennett
Soe rears o the paper Soe eleetary iequalities of G. Beett Dag Ah Tua ad Luu Quag Bay Vieta Natioal Uiversity - Haoi Uiversity of Sciece Abstract We give soe couterexaples ad soe rears of soe of the corollaries
More informationBertrand s Postulate. Theorem (Bertrand s Postulate): For every positive integer n, there is a prime p satisfying n < p 2n.
Bertrad s Postulate Our goal is to prove the followig Theorem Bertrad s Postulate: For every positive iteger, there is a prime p satisfyig < p We remark that Bertrad s Postulate is true by ispectio for,,
More informationMAS111 Convergence and Continuity
MAS Covergece ad Cotiuity Key Objectives At the ed of the course, studets should kow the followig topics ad be able to apply the basic priciples ad theorems therei to solvig various problems cocerig covergece
More informationPower series are analytic
Power series are aalytic Horia Corea 1 1 Fubii s theorem for double series Theorem 1.1. Let {α m }, be a real sequece idexed by two idices. Assume that the series α m is coverget for all ad C := ( α m
More informationA central limit theorem for moving average process with negatively associated innovation
Iteratioal Mathematical Forum, 1, 2006, o. 10, 495-502 A cetral limit theorem for movig average process with egatively associated iovatio MI-HWA KO Statistical Research Ceter for Complex Systems Seoul
More informationLarge Deviations in Quantum Information Theory
Large Deviatios i Quatum Iformatio Theory R. Ahlswede ad V. Bliovsky Abstract We obtai asymptotic estimates o the probabilities of evets of special types which are usefull i quatum iformatio theory, especially
More informationA stochastic model for phylogenetic trees
A stochastic model for phylogeetic trees by Thomas M. Liggett ad Rialdo B. Schiazi Uiversity of Califoria at Los Ageles, ad Uiversity of Colorado at Colorado Sprigs October 10, 2008 Abstract We propose
More informationHyun-Chull Kim and Tae-Sung Kim
Commu. Korea Math. Soc. 20 2005), No. 3, pp. 531 538 A CENTRAL LIMIT THEOREM FOR GENERAL WEIGHTED SUM OF LNQD RANDOM VARIABLES AND ITS APPLICATION Hyu-Chull Kim ad Tae-Sug Kim Abstract. I this paper we
More informationA New Solution Method for the Finite-Horizon Discrete-Time EOQ Problem
This is the Pre-Published Versio. A New Solutio Method for the Fiite-Horizo Discrete-Time EOQ Problem Chug-Lu Li Departmet of Logistics The Hog Kog Polytechic Uiversity Hug Hom, Kowloo, Hog Kog Phoe: +852-2766-7410
More informationReview Article Complete Convergence for Negatively Dependent Sequences of Random Variables
Hidawi Publishig Corporatio Joural of Iequalities ad Applicatios Volume 010, Article ID 50793, 10 pages doi:10.1155/010/50793 Review Article Complete Covergece for Negatively Depedet Sequeces of Radom
More informationk-generalized FIBONACCI NUMBERS CLOSE TO THE FORM 2 a + 3 b + 5 c 1. Introduction
Acta Math. Uiv. Comeiaae Vol. LXXXVI, 2 (2017), pp. 279 286 279 k-generalized FIBONACCI NUMBERS CLOSE TO THE FORM 2 a + 3 b + 5 c N. IRMAK ad M. ALP Abstract. The k-geeralized Fiboacci sequece { F (k)
More informationIntroduction to Probability. Ariel Yadin
Itroductio to robability Ariel Yadi Lecture 2 *** Ja. 7 ***. Covergece of Radom Variables As i the case of sequeces of umbers, we would like to talk about covergece of radom variables. There are may ways
More informationPrecise Rates in Complete Moment Convergence for Negatively Associated Sequences
Commuicatios of the Korea Statistical Society 29, Vol. 16, No. 5, 841 849 Precise Rates i Complete Momet Covergece for Negatively Associated Sequeces Dae-Hee Ryu 1,a a Departmet of Computer Sciece, ChugWoo
More informationConfidence interval for the two-parameter exponentiated Gumbel distribution based on record values
Iteratioal Joural of Applied Operatioal Research Vol. 4 No. 1 pp. 61-68 Witer 2014 Joural homepage: www.ijorlu.ir Cofidece iterval for the two-parameter expoetiated Gumbel distributio based o record values
More informationECE 901 Lecture 12: Complexity Regularization and the Squared Loss
ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality
More informationBasics of Probability Theory (for Theory of Computation courses)
Basics of Probability Theory (for Theory of Computatio courses) Oded Goldreich Departmet of Computer Sciece Weizma Istitute of Sciece Rehovot, Israel. oded.goldreich@weizma.ac.il November 24, 2008 Preface.
More informationQuantile regression with multilayer perceptrons.
Quatile regressio with multilayer perceptros. S.-F. Dimby ad J. Rykiewicz Uiversite Paris 1 - SAMM 90 Rue de Tolbiac, 75013 Paris - Frace Abstract. We cosider oliear quatile regressio ivolvig multilayer
More information