Moment-entropy inequalities for a random vector
|
|
- Naomi Fleming
- 6 years ago
- Views:
Transcription
1 1 Momet-etropy iequalities for a radom vector Erwi Lutwak, Deae ag, ad Gaoyog Zhag Abstract The p-th momet matrix is defied for a real radom vector, geeralizig the classical covariace matrix. Sharp iequalities relatig the p-th momet ad Reyi etropy are established, geeralizig the classical iequality relatig the secod momet ad the Shao etropy. The extremal distributios for these iequalities are completely characterized. I. INTRODUCTION I [9 the authors demostrated how the classical iformatio theoretic iequality for the Shao etropy ad secod momet of a real radom variable could be exteded to iequalities for Reyi etropy ad the p-th momet. The extremals of these iequalities were also completely characterized. Momet-etropy iequalities, usig Reyi etropy, for discrete radom variables have also bee obtaied by Arika [2. We describe how to exted the defiitio of the secod momet matrix of a real radom vector to that of the p-th momet matrix. Usig this, we exted the momet-etropy iequalities ad the characterizatio of the extremal distributios proved i [9 to higher dimesios. Variats ad geeralizatios of the theorems preseted ca be foud i work of the authors [8, [10, [11 ad Bastero- Romace [3. The authors would like to thak Christoph Haberl for his careful readig of this paper ad valuable suggestios for improvig it. II. THE p-th MOMENT MATRIX OF A RANDOM VECTOR A. Basic otatio Throughout this paper we deote: = -dimesioal Euclidea space x y = stadard Euclidea ier product of x, y x = x x S = positive defiite symmetric -by- matrices A = determiat of A S K = Lebesgue measure of K. The stadard Euclidea ball i will be deoted by B, ad its volume by ω. Each ier product o ca be writte uiquely as (x, y) x, y A = Ax Ay, for A S. The associated orm will be deoted by A. E. Lutwak (elutwak@poly.edu), D. ag (dyag@poly.edu), ad G. Zhag (gzhag@poly.edu) are with the Departmet of Mathematics, Polytechic Uiversity, Brookly, New ork. ad were supported i part by NSF Grat DMS Throughout this paper, X deotes a radom vector i. The probability measure o associated with a radom vector X is deoted m X. We will deote the stadard Lebesgue desity o by dx. By the desity fuctio f X of a radom vector X, we mea the Rado-Nikodym derivative of probability measure m X with respect to Lebesgue measure. If V is a vector space ad Φ : V is a cotiuous fuctio, the the expected value of Φ(X) is give by E[Φ(X) = Φ(x) dm X (x). We call a radom vector X odegeerate, if E[ v X > 0 for each ozero v. B. The p-th momet of a radom vector For p (0, ), the stadard p-th momet of a radom vector X is give by E[ X p = x p dm X (x). (1) More geerally, the p-th momet with respect to the ier product, A is C. The p-th momet matrix E[ X p A = x p A dm X(x). The secod momet matrix of a radom vector X is defied to be M 2 [X = E[X X, where for v, v v is the liear trasformatio give by x (x v)v. Recall that M 2 [X E[X is the covariace matrix. A importat observatio is that the defiitio of the momet matrix does ot use the ier product o. A uique characterizatio of the secod momet matrix is the followig: Let M = M 2 [X. The ier product, M 1/2 is the uique oe whose uit ball has maximal volume amog all ier products, A that are ormalized so that the secod momet satisfies E[ AX 2 =. We exted this characterizatio to a defiitio of the p-th momet matrix M p [X for all p (0, ). Theorem 1: If p (0, ) ad X is a odegeerate radom vector i with fiite p-th momet, the there exists a uique matrix A S such that ad E[ X p A = A A,
2 2 for each A S such that E[ X p A =. Moreover, the matrix A is the uique matrix i S satisfyig I = E[AX AX AX p 2. We defie the p-th momet matrix of a radom vector X to be M p [X = A p, where A is give by the theorem above. The proof of the theorem is give i IV A. Etropy III. MOMENT-ENTROP INEQUALITIES The Shao etropy of a radom vector X is defied to be h[x = f X log f X dx, provided that the itegral above exists. For λ > 0 the λ-reyi etropy power of a desity fuctio is defied to be ( f λ 1 λ X if λ 1, = e h[f if λ = 1, provided that the itegral above exists. Observe that lim N λ[x = N 1 [X. λ 1 The λ Reyi etropy of a radom vector X is defied to be h λ [X = log. The etropy h λ [X is cotiuous i λ ad, by the Hölder iequality, decreasig i λ. It is strictly decreasig, uless X is a uiform radom vector. It follows by the chai rule that for each A S. B. Relative etropy N λ [AX = A, (2) Give two radom vectors X, i, their relative Shao etropy or Kullback Leibler distace [6, [5, [1 (also, see page 231 i [4) is defied by ( ) fx h 1 [X, = f X log dx, (3) R f provided that the itegral above exists. Give λ > 0, we defie the relative λ Reyi etropy power of X ad as follows. If λ 1, the N λ [X, = ( ad, if λ = 1, the f X dx ( f λ X dx ( 1 λ R N 1 [X, = e h1[x,, λ(1 λ) f λ λ dx, (4) provided i both cases that the righthad side exists. Defie the λ Reyi relative etropy of radom vectors X ad by h λ [X, = log N λ [X,. Observe that h λ [X, is cotiuous i λ. Lemma 2: If X ad are radom vectors such that h λ [X, h λ [, ad h λ [X, are fiite, the h λ [X, 0. Equality holds if ad oly if X =. Proof: If λ > 1, the by the Hölder iequality, ( ) λ 1 ( f X dx f λ λ dx fx λ dx R ad if λ < 1, the we have fx λ = ( R ( f X ) λ f λ(1 λ) ) λ λ f X f R (R λ. λ, The iequality for λ = 1 follows by takig the limit λ 1. The equality coditios for λ 1 follow from the equality coditios of the Hölder iequality. The iequality for λ = 1, icludig the equality coditio, follows from the Jese iequality (details may be foud, for example, page 234 i [4). C. Geeralized Gaussias We call the extremal radom vectors for the mometetropy iequalities geeralized Gaussias ad recall their defiitio here. Give t R, let Let Γ(t) = t + = max(t, 0). deote the Gamma fuctio, ad let 0 x t 1 e x dx β(a, b) = Γ(a)Γ(b) Γ(a + b) deote the Beta fuctio. For each p (0, ) ad λ (/( + p), ), defie the stadard geeralized Gaussia to be the radom vector Z i whose desity fuctio f Z : [0, ) is give by a p,λ (1 + (1 λ) x p /(λ 1) + if λ 1 f Z (x) = (5) a p,1 e x p if λ = 1, where p(1 λ) p ω β( p, 1 1 λ p ) if λ < 1, p a p,λ = ω Γ( p ) if λ = 1, p(λ 1) p ω β( p, λ λ 1 ) if λ > 1. Ay radom vector i that ca be writte as = AZ, for some A S is called a geeralized Gaussia.
3 3 D. Iformatio measures of geeralized Gaussias If 0 < p < ad λ > /( + p), the λ-reyi etropy power of the stadard geeralized Gaussia radom vector Z is give by ( λ 1 (λ 1) 1 + a 1 p,λ if λ 1 N λ [Z = pλ e p a 1 p,1 if λ = 1 If 0 < p < ad λ > /( + p), the the p-th momet of Z is give by [ ( E[ Z p = λ 1 + p ) 1 1. We defie the costat c(, p, λ) = E[ Z p 1/p N λ [Z 1/ [ = a 1/ p,λ λ ( 1 + p ) 1 p 1 b(, p, λ), where ( ) 1 (1 λ) 1 (1 λ) b(, p, λ) = pλ if λ 1 e 1/p if λ = 1. Observe that if λ 1 ad 0 < p <, the f λ Z = a λ 1 p,λ (1 + (1 λ)e[ Z p ), (7) ad if λ = 1, the (6) h[z = log a p,1 + E[ Z p. (8) We will also eed the followig scalig idetities: f tz (x) = t f Z (t 1 x), (9) for each x. Therefore, ftz λ dx = t (1 λ) ad E[ tz p = t p E[ Z p. E. Spherical momet-etropy iequalities f λ Z dx, (10) The proof of Theorem 2 i [9 exteds easily to prove the followig. A more geeral versio ca be foud i [7. Theorem 3: If p (0, ), λ > /( + p), ad X is a radom vector i such that, E[ X p <, the E[ X p 1/p 1/ c(, p, λ), where c(, p, λ) is give by (6). Equality holds if ad oly if X = tz, for some t (0, ). Proof: For coveiece let a = a p,λ. Let ( E[ X p /p t = E[ Z p (11) ad = tz. If λ 1, the by (9) ad (5), (1), (11), ad (7), f X a λ 1 t (1 λ) + (1 λ)a λ 1 t (1 λ) p x p f X (x) dx = a λ 1 t (1 λ) (1 + (1 λ)t p E[ X p ) = a λ 1 t (1 λ) (1 + (1 λ)e[ Z p ) = t (1 λ) f λ Z, (12) where equality holds if λ < 1. It follows that if λ 1, the by Lemma 2, (4), (10) ad (12), ad (11), we have 1 N λ [X, λ ( ) ( = f λ t N λ[z = E[ X p /p f λ X N λ [Z E[ Z p /p. ) 1 ( 1 λ R ) λ 1 λ f X If λ = 1, the by Lemma 2, (3) ad (5), ad (8) ad (11), 0 h 1 [X, = h[x log a + log t + t p E[ X p = h[x + h[z + p log E[ X p E[ Z p. Lemma 2 shows that equality holds i all cases if ad oly if = X. F. Elliptic momet-etropy iequalities Corollary 4: If A S, p (0, ), λ > /( + p), ad X is a radom vector i satisfyig, E[ X p <, the E[ X p A 1/p c(, p, λ), (13) A 1/ 1/ where c(, p, λ) is give by (6). Equality holds if ad oly if X = ta 1 Z for some t (0, ). Proof: By (2) ad Theorem 3, E[ X p A 1/p A 1/ = E[ AX p 1/p 1/ N λ [AX 1/ E[ Z p 1/p N λ [Z 1/, ad equality holds if ad oly if AX = tz for some t (0, ). G. Affie momet-etropy iequalities Optimizig Corollary 4 over all A S yields the followig affie iequality. Theorem 5: If p (0, ), λ > /( + p), ad X is a radom vector i satisfyig, E[ X p <, the M p [X 1/p /p c(, p, λ),
4 4 where c(, p, λ) is give by (6). Equality holds if ad oly if X = A 1 Z for some A S. Proof: Substitute A = M p [X 1/p ito (13) Coversely, Corollary 4 follows from Theorem 5 by Theorem 1. IV. PROOF OF THEOREM 1 A. Isotropic positio of a probability measure A Borel measure µ o is said to be i isotropic positio, if x x x 2 dµ(x) = 1 I, (14) where I is the idetity matrix. Lemma 6: If p 0 ad µ is a Borel probability measure i isotropic positio, the for each A S, A 1/ ( Ax p x p /p dµ(x) 1, with either equality holdig if ad oly if A = ai for some a > 0. Proof: By Hölder s iequality, (R Ax p /p ( x p dµ(x) exp log Ax R x ) dµ(x), so it suffices to prove the p = 0 case oly. By (14), R (x e) 2 x 2 dµ(x) = 1, (15) for ay uit vector e. Let e 1,..., e be a orthoormal basis of eigevectors of A with correspodig eigevalues λ 1,..., λ. By the cocavity of log, ad (15), log Ax dµ(x) = 1 R log Ax 2 R x 2 x 2 dµ(x) = 1 log 2 i=1 1 2 i=1 = log A 1/. λ 2 i (x e i ) 2 x 2 (x e i ) 2 x 2 dµ(x) log λ 2 i dµ(x) The equality coditio follows from the strict cocavity of log. B. Proof of theorem Lemma 7: If p > 0 ad X is a odegeerate radom vector i with fiite p-th momet, the there exists c > 0 such that E[ e X p c, (16) for every uit vector e. Proof: The left side of (16) is a positive cotiuous fuctio of the uit sphere, which is compact. Theorem 8: If p 0 ad X is a odegeerate radom vector i with fiite p-th momet, the there exists A S, uique up to a scalar multiple, such that A 1/ E[ AX p 1/p A 1/ E[ A X p 1/p (17) for every A S. Proof: Let S S be the subset of matrices whose maximum eigevalue is exactly 1. This is a bouded set iside the set of all symmetric matrices, with its boudary S equal to positive semidefiite matrices with maximum eigevalue 1 ad miimum eigevalue 0. Give A S, let e be a eigevector of A with eigevalue 1. By Lemma 7, A 1/ E[ A X p 1/p A 1/ E[ X e p 1/p c 1/p A 1/. (18) Therefore, if A approaches the boudary S, the left side of (18) grows without boud. Sice the left side of (18) is a cotiuous fuctio o S, the existece of a miimum follows. Let A S be such a miimum ad = AX. The for each B S, B 1/ E[ B p 1/p = A 1/ BA 1/ E[ (BA)X p 1/p A 1/ A 1/ E[ AX p 1/p = E[ p 1/p. (19) with equality holdig if ad oly if equality holds for (17) with A = BA. Settig B = I + tb for B S, we get I + tb 1/ E[ (I + tb ) p 1/p E[ p 1/p, for each t ear 0. It follows that d dt I + tb 1/ E[ (I + tb ) p 1/p = 0, t=0 for each B S. A straightforward computatio shows that this holds oly if 1 E[ p I = E[ p 2. (20) Applyig Lemma 6 to dµ(x) = x p dm (x) E[ p, implies that equality holds for (19) oly if B = ai for some a (0, ). This, i tur, implies that equality holds for (17) oly if A = aa. Theorem 1 follows from Theorem 8 by rescalig A so that E[ p = ad substitutig = AX ito (20). REFERENCES [1 Shu-ichi Amari, Differetial-geometrical methods i statistics, Lecture Notes i Statistics, vol. 28, Spriger-Verlag, New ork, MR 86m:62053 [2 Erdal Arika, A iequality o guessig ad its applicatio to sequetial decodig, IEEE Tras. Iform. Theory 42 (1996), [3 J. Bastero ad M. Romace, Positios of covex bodies associated to extremal problems ad isotropic measures, Adv. Math. 184 (2004), o. 1,
5 5 [4 Thomas M. Cover ad Joy A. Thomas, Elemets of iformatio theory, Joh Wiley & Sos Ic., New ork, 1991, A Wiley-Itersciece Publicatio. [5 I. Csiszár, Iformatio-type measures of differece of probability distributios ad idirect observatios, Studia Sci. Math. Hugar. 2 (1967), MR 36 #2428 [6 S. Kullback ad R. A. Leibler, O iformatio ad sufficiecy, A. Math. Statistics 22 (1951), MR 12,623a [7 E. Lutwak, D. ag, ad G. Zhag, The Cramer-Rao iequality for star bodies, Duke Math. J. 112 (2002), [8, Momet etropy iequalities, Aals of Probability 32 (2004), [9, Cramer-Rao ad momet-etropy iequalities for Reyi etropy ad geeralized Fisher iformatio, IEEE Tras. Iform. Theory 51 (2005), [10, L p Joh ellipsoids, Proc. Lodo Math. Soc. 90 (2005), [11, Optimal Sobolev orms ad the L p Mikowski problem, It. Math. Res. Not. (2006), 62987, Erwi Lutwak Erwi Lutwak received his B.S., M.S., ad Ph.D. degrees i Mathematics from Polytechic Uiversity, where he is ow Professor of Mathematics. Deae ag Deae ag received his B.A. i mathematics ad physics from Uiversity of Pesylvaia ad Ph.D. i mathematics from Harvard Uiversity. He has bee a NSF Postdoctoral Fellow at the Courat Istitute ad o the faculty of Rice Uiversity ad Columbia Uiversity. He is ow a full professor at Polytechic Uiversity. Gaoyog Zhag Gaoyog Zhag received his B.S. degree i mathematics from Wuha Uiversity of Sciece ad Techology, M.S. degree i mathematics from Wuha Uiversity, Wuha, Chia, ad Ph.D. degree i mathematics from Temple Uiversity, Philadelphia. He was a Rademacher Lecturer at the Uiversity of Pesylvaia, a member of the Istitute for Advaced Study at Priceto, ad a member of the Mathematical Scieces Research Istitute at Berkeley. He was a assistat professor ad is ow a full professor at Polytechic Uiversity.
Several properties of new ellipsoids
Appl. Math. Mech. -Egl. Ed. 008 9(7):967 973 DOI 10.1007/s10483-008-0716-y c Shaghai Uiversity ad Spriger-Verlag 008 Applied Mathematics ad Mechaics (Eglish Editio) Several properties of ew ellipsoids
More informationarxiv: v1 [math.pr] 4 Dec 2013
Squared-Norm Empirical Process i Baach Space arxiv:32005v [mathpr] 4 Dec 203 Vicet Q Vu Departmet of Statistics The Ohio State Uiversity Columbus, OH vqv@statosuedu Abstract Jig Lei Departmet of Statistics
More informationBrief Review of Functions of Several Variables
Brief Review of Fuctios of Several Variables Differetiatio Differetiatio Recall, a fuctio f : R R is differetiable at x R if ( ) ( ) lim f x f x 0 exists df ( x) Whe this limit exists we call it or f(
More informationAn Extremal Property of the Regular Simplex
Covex Geometric Aalysis MSRI Publicatios Volume 34, 1998 A Extremal Property of the Regular Simplex MICHAEL SCHMUCKENSCHLÄGER Abstract. If C is a covex body i R such that the ellipsoid of miimal volume
More informationSelf-normalized deviation inequalities with application to t-statistic
Self-ormalized deviatio iequalities with applicatio to t-statistic Xiequa Fa Ceter for Applied Mathematics, Tiaji Uiversity, 30007 Tiaji, Chia Abstract Let ξ i i 1 be a sequece of idepedet ad symmetric
More informationLearning Theory: Lecture Notes
Learig Theory: Lecture Notes Kamalika Chaudhuri October 4, 0 Cocetratio of Averages Cocetratio of measure is very useful i showig bouds o the errors of machie-learig algorithms. We will begi with a basic
More informationLecture 19. sup y 1,..., yn B d n
STAT 06A: Polyomials of adom Variables Lecture date: Nov Lecture 19 Grothedieck s Iequality Scribe: Be Hough The scribes are based o a guest lecture by ya O Doell. I this lecture we prove Grothedieck s
More informationThe random version of Dvoretzky s theorem in l n
The radom versio of Dvoretzky s theorem i l Gideo Schechtma Abstract We show that with high probability a sectio of the l ball of dimesio k cε log c > 0 a uiversal costat) is ε close to a multiple of the
More informationA Hadamard-type lower bound for symmetric diagonally dominant positive matrices
A Hadamard-type lower boud for symmetric diagoally domiat positive matrices Christopher J. Hillar, Adre Wibisoo Uiversity of Califoria, Berkeley Jauary 7, 205 Abstract We prove a ew lower-boud form of
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 Fuctioal Law of Large Numbers. Costructio of the Wieer Measure Cotet. 1. Additioal techical results o weak covergece
More informationChapter 7 Isoperimetric problem
Chapter 7 Isoperimetric problem Recall that the isoperimetric problem (see the itroductio its coectio with ido s proble) is oe of the most classical problem of a shape optimizatio. It ca be formulated
More informationAdvanced Stochastic Processes.
Advaced Stochastic Processes. David Gamarik LECTURE 2 Radom variables ad measurable fuctios. Strog Law of Large Numbers (SLLN). Scary stuff cotiued... Outlie of Lecture Radom variables ad measurable fuctios.
More informationLet us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.
Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,
More informationInformation Theory Tutorial Communication over Channels with memory. Chi Zhang Department of Electrical Engineering University of Notre Dame
Iformatio Theory Tutorial Commuicatio over Chaels with memory Chi Zhag Departmet of Electrical Egieerig Uiversity of Notre Dame Abstract A geeral capacity formula C = sup I(; Y ), which is correct for
More informationMinimal surface area position of a convex body is not always an M-position
Miimal surface area positio of a covex body is ot always a M-positio Christos Saroglou Abstract Milma proved that there exists a absolute costat C > 0 such that, for every covex body i R there exists a
More informationSingular Continuous Measures by Michael Pejic 5/14/10
Sigular Cotiuous Measures by Michael Peic 5/4/0 Prelimiaries Give a set X, a σ-algebra o X is a collectio of subsets of X that cotais X ad ad is closed uder complemetatio ad coutable uios hece, coutable
More informationPAPER : IIT-JAM 2010
MATHEMATICS-MA (CODE A) Q.-Q.5: Oly oe optio is correct for each questio. Each questio carries (+6) marks for correct aswer ad ( ) marks for icorrect aswer.. Which of the followig coditios does NOT esure
More informationLecture 7: Properties of Random Samples
Lecture 7: Properties of Radom Samples 1 Cotiued From Last Class Theorem 1.1. Let X 1, X,...X be a radom sample from a populatio with mea µ ad variace σ
More informationConvergence of random variables. (telegram style notes) P.J.C. Spreij
Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space
More informationSupplementary Material for Fast Stochastic AUC Maximization with O(1/n)-Convergence Rate
Supplemetary Material for Fast Stochastic AUC Maximizatio with O/-Covergece Rate Migrui Liu Xiaoxua Zhag Zaiyi Che Xiaoyu Wag 3 iabao Yag echical Lemmas ized versio of Hoeffdig s iequality, ote that We
More informationThe log-behavior of n p(n) and n p(n)/n
Ramauja J. 44 017, 81-99 The log-behavior of p ad p/ William Y.C. Che 1 ad Ke Y. Zheg 1 Ceter for Applied Mathematics Tiaji Uiversity Tiaji 0007, P. R. Chia Ceter for Combiatorics, LPMC Nakai Uivercity
More informationConcavity Solutions of Second-Order Differential Equations
Proceedigs of the Paista Academy of Scieces 5 (3): 4 45 (4) Copyright Paista Academy of Scieces ISSN: 377-969 (prit), 36-448 (olie) Paista Academy of Scieces Research Article Cocavity Solutios of Secod-Order
More informationarxiv: v1 [math.pr] 13 Oct 2011
A tail iequality for quadratic forms of subgaussia radom vectors Daiel Hsu, Sham M. Kakade,, ad Tog Zhag 3 arxiv:0.84v math.pr] 3 Oct 0 Microsoft Research New Eglad Departmet of Statistics, Wharto School,
More informationThis section is optional.
4 Momet Geeratig Fuctios* This sectio is optioal. The momet geeratig fuctio g : R R of a radom variable X is defied as g(t) = E[e tx ]. Propositio 1. We have g () (0) = E[X ] for = 1, 2,... Proof. Therefore
More informationEntropy and Ergodic Theory Lecture 5: Joint typicality and conditional AEP
Etropy ad Ergodic Theory Lecture 5: Joit typicality ad coditioal AEP 1 Notatio: from RVs back to distributios Let (Ω, F, P) be a probability space, ad let X ad Y be A- ad B-valued discrete RVs, respectively.
More informationAffine moments of a random vector
Affie momets of a radom vector Erwi Lutwak, Sogju Lv, Deae Yag, ad Gaoyog Zhag Abstract A affie ivariat -th momet measure is defied for a radom vector ad used to rove shar momet-etroy iequalities that
More informationExponential Families and Bayesian Inference
Computer Visio Expoetial Families ad Bayesia Iferece Lecture Expoetial Families A expoetial family of distributios is a d-parameter family f(x; havig the followig form: f(x; = h(xe g(t T (x B(, (. where
More informationDec Communication on Applied Mathematics and Computation Vol.32 No.4
2018 12» Å 32 Å 4 Dec. 2018 Commuicatio o Applied Mathematics ad Computatio Vol.32 No.4 DOI 10.3969/j.iss.1006-6330.2018.04.021 L p Blaschke additio for polytopes LAI Ducam 1,2 (1. College of Scieces,
More informationAn almost sure invariance principle for trimmed sums of random vectors
Proc. Idia Acad. Sci. Math. Sci. Vol. 20, No. 5, November 200, pp. 6 68. Idia Academy of Scieces A almost sure ivariace priciple for trimmed sums of radom vectors KE-ANG FU School of Statistics ad Mathematics,
More informationINEQUALITY FOR CONVEX FUNCTIONS. p i. q i
Joural of Iequalities ad Special Fuctios ISSN: 17-4303, URL: http://www.ilirias.com Volume 6 Issue 015, Pages 5-14. SOME INEQUALITIES FOR f-divergences VIA SLATER S INEQUALITY FOR CONVEX FUNCTIONS SILVESTRU
More information2 Banach spaces and Hilbert spaces
2 Baach spaces ad Hilbert spaces Tryig to do aalysis i the ratioal umbers is difficult for example cosider the set {x Q : x 2 2}. This set is o-empty ad bouded above but does ot have a least upper boud
More informationHomework Set #3 - Solutions
EE 15 - Applicatios of Covex Optimizatio i Sigal Processig ad Commuicatios Dr. Adre Tkaceko JPL Third Term 11-1 Homework Set #3 - Solutios 1. a) Note that x is closer to x tha to x l i the Euclidea orm
More informationA Note on the Kolmogorov-Feller Weak Law of Large Numbers
Joural of Mathematical Research with Applicatios Mar., 015, Vol. 35, No., pp. 3 8 DOI:10.3770/j.iss:095-651.015.0.013 Http://jmre.dlut.edu.c A Note o the Kolmogorov-Feller Weak Law of Large Numbers Yachu
More informationb i u x i U a i j u x i u x j
M ath 5 2 7 Fall 2 0 0 9 L ecture 1 9 N ov. 1 6, 2 0 0 9 ) S ecod- Order Elliptic Equatios: Weak S olutios 1. Defiitios. I this ad the followig two lectures we will study the boudary value problem Here
More informationCitation Journal of Inequalities and Applications, 2012, p. 2012: 90
Title Polar Duals of Covex ad Star Bodies Author(s) Cheug, WS; Zhao, C; Che, LY Citatio Joural of Iequalities ad Applicatios, 2012, p. 2012: 90 Issued Date 2012 URL http://hdl.hadle.et/10722/181667 Rights
More informationMath Solutions to homework 6
Math 175 - Solutios to homework 6 Cédric De Groote November 16, 2017 Problem 1 (8.11 i the book): Let K be a compact Hermitia operator o a Hilbert space H ad let the kerel of K be {0}. Show that there
More informationEECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1
EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum
More informationAsymptotic distribution of products of sums of independent random variables
Proc. Idia Acad. Sci. Math. Sci. Vol. 3, No., May 03, pp. 83 9. c Idia Academy of Scieces Asymptotic distributio of products of sums of idepedet radom variables YANLING WANG, SUXIA YAO ad HONGXIA DU ollege
More informationlim za n n = z lim a n n.
Lecture 6 Sequeces ad Series Defiitio 1 By a sequece i a set A, we mea a mappig f : N A. It is customary to deote a sequece f by {s } where, s := f(). A sequece {z } of (complex) umbers is said to be coverget
More informationINEQUALITIES BJORN POONEN
INEQUALITIES BJORN POONEN 1 The AM-GM iequality The most basic arithmetic mea-geometric mea (AM-GM) iequality states simply that if x ad y are oegative real umbers, the (x + y)/2 xy, with equality if ad
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 6 9/23/2013. Brownian motion. Introduction
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/5.070J Fall 203 Lecture 6 9/23/203 Browia motio. Itroductio Cotet.. A heuristic costructio of a Browia motio from a radom walk. 2. Defiitio ad basic properties
More informationGamma Distribution and Gamma Approximation
Gamma Distributio ad Gamma Approimatio Xiaomig Zeg a Fuhua (Frak Cheg b a Xiame Uiversity, Xiame 365, Chia mzeg@jigia.mu.edu.c b Uiversity of Ketucky, Leigto, Ketucky 456-46, USA cheg@cs.uky.edu Abstract
More informationLecture 19: Convergence
Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may
More information1 Convergence in Probability and the Weak Law of Large Numbers
36-752 Advaced Probability Overview Sprig 2018 8. Covergece Cocepts: i Probability, i L p ad Almost Surely Istructor: Alessadro Rialdo Associated readig: Sec 2.4, 2.5, ad 4.11 of Ash ad Doléas-Dade; Sec
More informationThe Matrix Analog of the Kneser-Süss Inequality
Proceedigs of the 9th WSEAS Iteratioal Coferece o Applied Mathematics Istabul Turkey May 27-29 2006 pp495-499) The Matrix Aalog of the Keser-Süss Iequality PORAMATE TOM) PRANAYANUNTANA PATCHARIN HEMCHOTE
More informationBoundaries and the James theorem
Boudaries ad the James theorem L. Vesely 1. Itroductio The followig theorem is importat ad well kow. All spaces cosidered here are real ormed or Baach spaces. Give a ormed space X, we deote by B X ad S
More informationSupplementary Material for Fast Stochastic AUC Maximization with O(1/n)-Convergence Rate
Supplemetary Material for Fast Stochastic AUC Maximizatio with O/-Covergece Rate Migrui Liu Xiaoxua Zhag Zaiyi Che Xiaoyu Wag 3 iabao Yag echical Lemmas ized versio of Hoeffdig s iequality, ote that We
More informationDefinition 4.2. (a) A sequence {x n } in a Banach space X is a basis for X if. unique scalars a n (x) such that x = n. a n (x) x n. (4.
4. BASES I BAACH SPACES 39 4. BASES I BAACH SPACES Sice a Baach space X is a vector space, it must possess a Hamel, or vector space, basis, i.e., a subset {x γ } γ Γ whose fiite liear spa is all of X ad
More informationProduct measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014.
Product measures, Toelli s ad Fubii s theorems For use i MAT3400/4400, autum 2014 Nadia S. Larse Versio of 13 October 2014. 1. Costructio of the product measure The purpose of these otes is to preset the
More informationThe mother of most Gaussian and Euclidean inequalities
The mother of most Gaussia ad Euclidea iequalities M. Agueh, N. Ghoussoub ad X. Kag December, 00 Pacific Istitute for the Mathematical Scieces ad Departmet of Mathematics, The Uiversity of British Columbia,
More informationAPPLICATION OF YOUNG S INEQUALITY TO VOLUMES OF CONVEX SETS
APPLICATION OF YOUNG S INEQUALITY TO VOLUMES OF CONVEX SETS 1. Itroductio Let C be a bouded, covex subset of. Thus, by defiitio, with every two poits i the set, the lie segmet coectig these two poits is
More informationA Proof of Birkhoff s Ergodic Theorem
A Proof of Birkhoff s Ergodic Theorem Joseph Hora September 2, 205 Itroductio I Fall 203, I was learig the basics of ergodic theory, ad I came across this theorem. Oe of my supervisors, Athoy Quas, showed
More information18.657: Mathematics of Machine Learning
8.657: Mathematics of Machie Learig Lecturer: Philippe Rigollet Lecture 0 Scribe: Ade Forrow Oct. 3, 05 Recall the followig defiitios from last time: Defiitio: A fuctio K : X X R is called a positive symmetric
More information17. Joint distributions of extreme order statistics Lehmann 5.1; Ferguson 15
17. Joit distributios of extreme order statistics Lehma 5.1; Ferguso 15 I Example 10., we derived the asymptotic distributio of the maximum from a radom sample from a uiform distributio. We did this usig
More informationA Characterization of Compact Operators by Orthogonality
Australia Joural of Basic ad Applied Scieces, 5(6): 253-257, 211 ISSN 1991-8178 A Characterizatio of Compact Operators by Orthogoality Abdorreza Paahi, Mohamad Reza Farmai ad Azam Noorafa Zaai Departmet
More informationON POINTWISE BINOMIAL APPROXIMATION
Iteratioal Joural of Pure ad Applied Mathematics Volume 71 No. 1 2011, 57-66 ON POINTWISE BINOMIAL APPROXIMATION BY w-functions K. Teerapabolar 1, P. Wogkasem 2 Departmet of Mathematics Faculty of Sciece
More informationStatistical Theory MT 2008 Problems 1: Solution sketches
Statistical Theory MT 008 Problems : Solutio sketches. Which of the followig desities are withi a expoetial family? Explai your reasoig. a) Let 0 < θ < ad put fx, θ) = θ)θ x ; x = 0,,,... b) c) where α
More informationChapter 8. Euler s Gamma function
Chapter 8 Euler s Gamma fuctio The Gamma fuctio plays a importat role i the fuctioal equatio for ζ(s that we will derive i the ext chapter. I the preset chapter we have collected some properties of the
More informationPAijpam.eu ON TENSOR PRODUCT DECOMPOSITION
Iteratioal Joural of Pure ad Applied Mathematics Volume 103 No 3 2015, 537-545 ISSN: 1311-8080 (prited versio); ISSN: 1314-3395 (o-lie versio) url: http://wwwijpameu doi: http://dxdoiorg/1012732/ijpamv103i314
More informationCommon Coupled Fixed Point of Mappings Satisfying Rational Inequalities in Ordered Complex Valued Generalized Metric Spaces
IOSR Joural of Mathematics (IOSR-JM) e-issn: 78-578, p-issn:319-765x Volume 10, Issue 3 Ver II (May-Ju 014), PP 69-77 Commo Coupled Fixed Poit of Mappigs Satisfyig Ratioal Iequalities i Ordered Complex
More informationLecture 8: Convergence of transformations and law of large numbers
Lecture 8: Covergece of trasformatios ad law of large umbers Trasformatio ad covergece Trasformatio is a importat tool i statistics. If X coverges to X i some sese, we ofte eed to check whether g(x ) coverges
More informationLECTURE 8: ASYMPTOTICS I
LECTURE 8: ASYMPTOTICS I We are iterested i the properties of estimators as. Cosider a sequece of radom variables {, X 1}. N. M. Kiefer, Corell Uiversity, Ecoomics 60 1 Defiitio: (Weak covergece) A sequece
More informationBETWEEN QUASICONVEX AND CONVEX SET-VALUED MAPPINGS. 1. Introduction. Throughout the paper we denote by X a linear space and by Y a topological linear
BETWEEN QUASICONVEX AND CONVEX SET-VALUED MAPPINGS Abstract. The aim of this paper is to give sufficiet coditios for a quasicovex setvalued mappig to be covex. I particular, we recover several kow characterizatios
More informationEE 4TM4: Digital Communications II Probability Theory
1 EE 4TM4: Digital Commuicatios II Probability Theory I. RANDOM VARIABLES A radom variable is a real-valued fuctio defied o the sample space. Example: Suppose that our experimet cosists of tossig two fair
More informationSHARP INEQUALITIES INVOLVING THE CONSTANT e AND THE SEQUENCE (1 + 1/n) n
SHARP INEQUALITIES INVOLVING THE CONSTANT e AND THE SEQUENCE + / NECDET BATIR Abstract. Several ew ad sharp iequalities ivolvig the costat e ad the sequece + / are proved.. INTRODUCTION The costat e or
More informationECE 901 Lecture 14: Maximum Likelihood Estimation and Complexity Regularization
ECE 90 Lecture 4: Maximum Likelihood Estimatio ad Complexity Regularizatio R Nowak 5/7/009 Review : Maximum Likelihood Estimatio We have iid observatios draw from a ukow distributio Y i iid p θ, i,, where
More informationUnbiased Estimation. February 7-12, 2008
Ubiased Estimatio February 7-2, 2008 We begi with a sample X = (X,..., X ) of radom variables chose accordig to oe of a family of probabilities P θ where θ is elemet from the parameter space Θ. For radom
More informationChapter 3 Inner Product Spaces. Hilbert Spaces
Chapter 3 Ier Product Spaces. Hilbert Spaces 3. Ier Product Spaces. Hilbert Spaces 3.- Defiitio. A ier product space is a vector space X with a ier product defied o X. A Hilbert space is a complete ier
More informationA REFINEMENT OF JENSEN S INEQUALITY WITH APPLICATIONS. S. S. Dragomir 1. INTRODUCTION
TAIWANESE JOURNAL OF MATHEMATICS Vol. 14, No. 1,. 153-164, February 2010 This aer is available olie at htt://www.tjm.sysu.edu.tw/ A REFINEMENT OF JENSEN S INEQUALITY WITH APPLICATIONS FOR f-divergence
More informationMath 341 Lecture #31 6.5: Power Series
Math 341 Lecture #31 6.5: Power Series We ow tur our attetio to a particular kid of series of fuctios, amely, power series, f(x = a x = a 0 + a 1 x + a 2 x 2 + where a R for all N. I terms of a series
More informationIntegrable Functions. { f n } is called a determining sequence for f. If f is integrable with respect to, then f d does exist as a finite real number
MATH 532 Itegrable Fuctios Dr. Neal, WKU We ow shall defie what it meas for a measurable fuctio to be itegrable, show that all itegral properties of simple fuctios still hold, ad the give some coditios
More informationOn Orlicz N-frames. 1 Introduction. Renu Chugh 1,, Shashank Goel 2
Joural of Advaced Research i Pure Mathematics Olie ISSN: 1943-2380 Vol. 3, Issue. 1, 2010, pp. 104-110 doi: 10.5373/jarpm.473.061810 O Orlicz N-frames Reu Chugh 1,, Shashak Goel 2 1 Departmet of Mathematics,
More informationStatistical Theory MT 2009 Problems 1: Solution sketches
Statistical Theory MT 009 Problems : Solutio sketches. Which of the followig desities are withi a expoetial family? Explai your reasoig. (a) Let 0 < θ < ad put f(x, θ) = ( θ)θ x ; x = 0,,,... (b) (c) where
More informationChapter 3. Strong convergence. 3.1 Definition of almost sure convergence
Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i
More informationANOTHER WEIGHTED WEIBULL DISTRIBUTION FROM AZZALINI S FAMILY
ANOTHER WEIGHTED WEIBULL DISTRIBUTION FROM AZZALINI S FAMILY Sulema Nasiru, MSc. Departmet of Statistics, Faculty of Mathematical Scieces, Uiversity for Developmet Studies, Navrogo, Upper East Regio, Ghaa,
More informationON MEAN ERGODIC CONVERGENCE IN THE CALKIN ALGEBRAS
PROCEEDINGS OF THE AMERICAN MATHEMATICAL SOCIETY Volume 00, Number 0, Pages 000 000 S 0002-9939(XX0000-0 ON MEAN ERGODIC CONVERGENCE IN THE CALKIN ALGEBRAS MARCH T. BOEDIHARDJO AND WILLIAM B. JOHNSON 2
More informationWe are mainly going to be concerned with power series in x, such as. (x)} converges - that is, lims N n
Review of Power Series, Power Series Solutios A power series i x - a is a ifiite series of the form c (x a) =c +c (x a)+(x a) +... We also call this a power series cetered at a. Ex. (x+) is cetered at
More informationCentral limit theorem and almost sure central limit theorem for the product of some partial sums
Proc. Idia Acad. Sci. Math. Sci. Vol. 8, No. 2, May 2008, pp. 289 294. Prited i Idia Cetral it theorem ad almost sure cetral it theorem for the product of some partial sums YU MIAO College of Mathematics
More informationOn n-collinear elements and Riesz theorem
Available olie at www.tjsa.com J. Noliear Sci. Appl. 9 (206), 3066 3073 Research Article O -colliear elemets ad Riesz theorem Wasfi Shataawi a, Mihai Postolache b, a Departmet of Mathematics, Hashemite
More informationLecture 8: October 20, Applications of SVD: least squares approximation
Mathematical Toolkit Autum 2016 Lecturer: Madhur Tulsiai Lecture 8: October 20, 2016 1 Applicatios of SVD: least squares approximatio We discuss aother applicatio of sigular value decompositio (SVD) of
More informationLecture 3 : Random variables and their distributions
Lecture 3 : Radom variables ad their distributios 3.1 Radom variables Let (Ω, F) ad (S, S) be two measurable spaces. A map X : Ω S is measurable or a radom variable (deoted r.v.) if X 1 (A) {ω : X(ω) A}
More informationMaximum Likelihood Estimation and Complexity Regularization
ECE90 Sprig 004 Statistical Regularizatio ad Learig Theory Lecture: 4 Maximum Likelihood Estimatio ad Complexity Regularizatio Lecturer: Rob Nowak Scribe: Pam Limpiti Review : Maximum Likelihood Estimatio
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 3 9/11/2013. Large deviations Theory. Cramér s Theorem
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/5.070J Fall 203 Lecture 3 9//203 Large deviatios Theory. Cramér s Theorem Cotet.. Cramér s Theorem. 2. Rate fuctio ad properties. 3. Chage of measure techique.
More information1 = δ2 (0, ), Y Y n nδ. , T n = Y Y n n. ( U n,k + X ) ( f U n,k + Y ) n 2n f U n,k + θ Y ) 2 E X1 2 X1
8. The cetral limit theorems 8.1. The cetral limit theorem for i.i.d. sequeces. ecall that C ( is N -separatig. Theorem 8.1. Let X 1, X,... be i.i.d. radom variables with EX 1 = ad EX 1 = σ (,. Suppose
More information<, if ε > 0 2nloglogn. =, if ε < 0.
GLASNIK MATEMATIČKI Vol. 52(72)(207), 35 360 THE DAVIS-GUT LAW FOR INDEPENDENT AND IDENTICALLY DISTRIBUTED BANACH SPACE VALUED RANDOM ELEMENTS Pigya Che, Migyag Zhag ad Adrew Rosalsky Jia Uversity, P.
More informationOn Random Line Segments in the Unit Square
O Radom Lie Segmets i the Uit Square Thomas A. Courtade Departmet of Electrical Egieerig Uiversity of Califoria Los Ageles, Califoria 90095 Email: tacourta@ee.ucla.edu I. INTRODUCTION Let Q = [0, 1] [0,
More informationMi-Hwa Ko and Tae-Sung Kim
J. Korea Math. Soc. 42 2005), No. 5, pp. 949 957 ALMOST SURE CONVERGENCE FOR WEIGHTED SUMS OF NEGATIVELY ORTHANT DEPENDENT RANDOM VARIABLES Mi-Hwa Ko ad Tae-Sug Kim Abstract. For weighted sum of a sequece
More informationOFF-DIAGONAL MULTILINEAR INTERPOLATION BETWEEN ADJOINT OPERATORS
OFF-DIAGONAL MULTILINEAR INTERPOLATION BETWEEN ADJOINT OPERATORS LOUKAS GRAFAKOS AND RICHARD G. LYNCH 2 Abstract. We exted a theorem by Grafakos ad Tao [5] o multiliear iterpolatio betwee adjoit operators
More informationThe multiplicative structure of finite field and a construction of LRC
IERG6120 Codig for Distributed Storage Systems Lecture 8-06/10/2016 The multiplicative structure of fiite field ad a costructio of LRC Lecturer: Keeth Shum Scribe: Zhouyi Hu Notatios: We use the otatio
More informationMONOTONICITY OF SEQUENCES INVOLVING GEOMETRIC MEANS OF POSITIVE SEQUENCES WITH LOGARITHMICAL CONVEXITY
MONOTONICITY OF SEQUENCES INVOLVING GEOMETRIC MEANS OF POSITIVE SEQUENCES WITH LOGARITHMICAL CONVEXITY FENG QI AND BAI-NI GUO Abstract. Let f be a positive fuctio such that x [ f(x + )/f(x) ] is icreasig
More informationIt is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function.
MATH 532 Measurable Fuctios Dr. Neal, WKU Throughout, let ( X, F, µ) be a measure space ad let (!, F, P ) deote the special case of a probability space. We shall ow begi to study real-valued fuctios defied
More informationAn elementary proof that almost all real numbers are normal
Acta Uiv. Sapietiae, Mathematica, 2, (200 99 0 A elemetary proof that almost all real umbers are ormal Ferdiád Filip Departmet of Mathematics, Faculty of Educatio, J. Selye Uiversity, Rolícej šoly 59,
More informationfor all x ; ;x R. A ifiite sequece fx ; g is said to be ND if every fiite subset X ; ;X is ND. The coditios (.) ad (.3) are equivalet for =, but these
sub-gaussia techiques i provig some strog it theorems Λ M. Amii A. Bozorgia Departmet of Mathematics, Faculty of Scieces Sista ad Baluchesta Uiversity, Zaheda, Ira Amii@hamoo.usb.ac.ir, Fax:054446565 Departmet
More information2.1. The Algebraic and Order Properties of R Definition. A binary operation on a set F is a function B : F F! F.
CHAPTER 2 The Real Numbers 2.. The Algebraic ad Order Properties of R Defiitio. A biary operatio o a set F is a fuctio B : F F! F. For the biary operatios of + ad, we replace B(a, b) by a + b ad a b, respectively.
More informationA REMARK ON A PROBLEM OF KLEE
C O L L O Q U I U M M A T H E M A T I C U M VOL. 71 1996 NO. 1 A REMARK ON A PROBLEM OF KLEE BY N. J. K A L T O N (COLUMBIA, MISSOURI) AND N. T. P E C K (URBANA, ILLINOIS) This paper treats a property
More informationST5215: Advanced Statistical Theory
ST525: Advaced Statistical Theory Departmet of Statistics & Applied Probability Tuesday, September 7, 2 ST525: Advaced Statistical Theory Lecture : The law of large umbers The Law of Large Numbers The
More information5.1. The Rayleigh s quotient. Definition 49. Let A = A be a self-adjoint matrix. quotient is the function. R(x) = x,ax, for x = 0.
40 RODICA D. COSTIN 5. The Rayleigh s priciple ad the i priciple for the eigevalues of a self-adjoit matrix Eigevalues of self-adjoit matrices are easy to calculate. This sectio shows how this is doe usig
More informationAn operator equality involving a continuous field of operators and its norm inequalities
Available olie at www.sciecedirect.com Liear Algebra ad its Alicatios 49 (008) 59 67 www.elsevier.com/locate/laa A oerator equality ivolvig a cotiuous field of oerators ad its orm iequalities Mohammad
More information5 Birkhoff s Ergodic Theorem
5 Birkhoff s Ergodic Theorem Amog the most useful of the various geeralizatios of KolmogorovâĂŹs strog law of large umbers are the ergodic theorems of Birkhoff ad Kigma, which exted the validity of the
More information