Theory of Probability Fall 2008
|
|
- Charlene Reed
- 5 years ago
- Views:
Transcription
1 MIT OpenCourseWare Theory of Probability Fall 008 For information about citing these materials or our Terms of Use, visit:
2 Section Prekopa-Leindler inequality, entropy and concentration. In this section we will make several connections between the Kantorovich-Rubinstein theorem and other classical objects. Let us start with the following classical inequality. Theorem 5 (Prekopa-Leindler) Consider nonnegative integrable functions w, u, v : R n [0, ) such that for some λ (0, ), w(λx + ( λ)y) u(x) λ v(y) λ for all x, y R n. Then, ( ) λ ( ) λ wdx udx vdx. Proof. The proof will proceed by induction on n. Let us first show the induction step. Suppose the statement holds for n and we would like to show it for n +. By assumption, for any x, y R n and a, b R Let us fix a and b and consider functions w(λx + ( λ)y, λa + ( λ)b) u(x, a) λ v(y, b) λ. w (x) = w(x, λa + ( λ)b), u (x) = u(x, a), v (x) = v(x, b) on R n that satisfy w (λx + ( λ)y) u (x) λ v (y) λ. By induction assumption, ( ) λ ( ) λ w dx u dx v dx. R n R n R n These integrals still depend on a and b and we can define w (λa + ( λ)b) = w dx = w(x, λa + ( λ)b)dx R n R n and, similarly, u (a) = u (x, a)dx, v (b) = v (x, b)dx R n R n so that w (λa + ( λ)b) u (a) λ v (b) λ. 88
3 These functions are defined on R and, by induction assumption, ( ) λ ( ) λ ( ) λ ( ) λ w ds u ds v ds = wdz udz vdz, R R R R n+ R n+ R n+ which finishes the proof of the induction step. It remains to prove the case n =. Let us show two different proofs.. One approach is based on the Brunn-Minkowski inequality on the real line which says that, if γ is the Lebesgue measure and A, B are Borel sets on R, then γ(λa + ( λ)b) λγ(a) + ( λ)γ(b), where A+B is the set addition, i.e. A+B = {a+b : a A, b B}. We can also assume that u, v, w : R [0, ] because the inequality is homogeneous to scaling. We have {w a} λ{u a} + ( λ){v a} because if u(x) a and v(y) a then, by assumption, The Brunn-Minkowski inequality implies that Finally, w(λx + ( λ)y) u(x) λ v(y) λ a λ a λ = a. γ(w a) λγ(u a) + ( λ)γ(v a). w(z)dz = I(x w(z))dxdz = γ(w x)dx R R 0 0 λ γ(u x)dx + ( λ) γ(v x)dx 0 0 ( ) λ ( ) λ = λ u(z)dz + ( λ) v(z)dz u(z)dz v(z)dz. R R R R. Another approach is based on the transportation of measure. We can assume that u = v = by rescaling u v w u, v, w. u v ( u)λ ( v) λ Then we need to show that w. Without loss of generality, let us assume that u, v 0 are smooth and strictly positive, since one can easily reduce to this case. Define x(t), y(t) for 0 t by Then x(t) y(t) u(s)ds = t, v(s)ds = t. u(x(t))x (t) =, u(y(t))y (t) = and the derivatives x (t), y (t) > 0. Define z(t) = λx(t) + ( λ)y(t). Then + w(s)ds = w(z(s))dz(s) = w(λx(s) + ( λ)y(s))z (s)ds. 0 0 By arithmetic-geometric mean inequality z (s) = λx (s) + ( λ)y (s) (x (s)) λ (y (s)) λ 89
4 and, by assumption, w(λx(s) + ( λ)y(s)) u(x(s)) λ v(y(s)) λ. Therefore, λ λ w(s)ds u(x(s))x (s) v(y(s))y (s) ds = ds =. 0 0 This finishes the proof of theorem. Entropy and the Kullback-Leibler divergence. Consider a probability measure P on R n and a nonnegative measurable function u : R n [0, ). Definition (Entropy)We define the entropy of u with respect to P by Ent P (u) = u log udp udp log udp. One can give a different representation of entropy by { } Ent P (u) = sup uvdp : e v dp. (.0.) Indeed, if we consider a convex set V = {v : e v dp } then the above supremum is obviously a solution of the following saddle point problem: ( ) L(v, λ) = uvdp λ e v dp sup inf. The functional L is linear in λ and concave in v. Therefore, by the minimax theorem, a saddle point solution exists and sup inf = inf sup. The integral uvdp λ e v dp = (uv λe v )dp can be maximized pointwise by taking v such that u = λe v. Then u L(v, λ) = u log dp udp + λ λ and maximizing over λ gives λ = u and v = log(u/ u). This proves (.0.). Suppose now that a law Q is absolutely continuous with respect to P and denote its Radon-Nikodym derivative by Definition (Kullback-Leibler divergence) The quantity D(Q P) := log u dq = log dq dq dp is called the Kullback-Leibler divergence between P and Q. Clearly, D(Q P) = Ent P (u), since Ent P (u) = log dq dq dq dq dq dp dp log dp = log dq. dp dp dp dp dp The variational characterization (.0.) implies that if e v dp then vdq = uvdp D(Q P ). (.0.3) v λ 0 u = dq. (.0.) dp 90
5 Transportation inequality for log-concave measures. Suppose that a probability distribution P on R n has the Lebesgue density e V (x) where V (x) is strictly convex in the following sense: tv (x) + ( t)v (y) V (tx + ( t)y) C p ( t + o( t)) x y p (.0.4) as t for some p and C p > 0. Example. One example of the distribution that satisfies (.0.4) is the non-degenerate normal distribution N(0, C) that corresponds to V (x) = (C x, x) + const for some covariance matrix C, det C = 0. If we denote A = C / then t(ax, x) + ( t)(ay, y) (A(tx + ( t)y), (tx + ( t)y)) = t( t)(a(x y), (x y)) λmax (C) t( t) x y, (.0.5) where λ max (C) is the largest eigenvalue of C. Thus, (.0.4) holds with p = and C p = /(λ max (C)). Let us prove the following useful inequality for the Wasserstein distance. Theorem 5 If P satisfies (.0.4) and Q is absolutely continuous w.r.t. P then W p (Q, P) p Cp D(Q P). Proof. Take functions f, g C(R n ) such that f(x) + g(y) t( t) C p ( t + o( t)) x y p. Then, by (.0.4), f(x) + g(y) tv (x) + ( t)v (y) V (tx + ( t)y) t( t) and This implies that for By the Prekopa-Leindler inequality, t( t)f(x) tv (x) + t( t)g(y) ( t)v (y) V (tx + ( t)y). and since e V is the density of P we get w(tx + ( t)y) u(x) t v(y) t u(x) = e ( t)f(x) V (x), v(y) = e tg(y) V (y) and w(z) = e V (z). ( ) t ( ) t e ( t)f(x) V (x) dx e tg(x) V (x) dx e V (x) dx ( ) ( ( ( t ) t ) e ( t)f dp e tg dp and e ( t)f t dp e tg dp It is a simple calculus exercise to show that ( ) R s lim e sf dp = e fdp, s 0 ) t. 9
6 and, therefore, letting t proves that R if f(x) + g(y) C p x y p then e g dp e fdp. If we denote v = g + fdp then the last inequality is e v dp and (.0.3) implies that vdq = fdp + gdq D(Q P). Finally, using the Kantorovich-Rubinstein theorem, (0.0.), we get { } W p (Q, P) p = inf C p x y p dµ(x, y) : µ M(P, Q) C p { } = sup fdp + gdq : f(x) + g(y) C p x y p D(Q P) C p Cp and this finishes the proof. Concentration of Gaussian measure. Applying this result to the example before Theorem 5 gives that for the non-degenerate Gaussian distribution P = N(0, C), W (P, Q) λ max (C)D(Q P). (.0.6) Given a measurable set A R n with P(A) > 0, define the conditional distribution P A by Then, obviously, the Radon-Nikodym derivative P(CA) P A (C) =. P(A) dp A = I A dp P(A) and the Kullback-Leibler divergence D(P A P) = log dp A = log. A P(A) P(A) Since W is a metric, for any two Borel sets A and B ( ) W (P A, P B ) W (P A, P) + W (P B, P) λ max (C) log + log. P(A) P(B) Suppose that the sets A and B are apart from each other by a distance t, i.e. d(a, B) t > 0. Then any two points in the support of measures P A and P B are at a distance at least t from each other and the transportation distance W (P A, P B ) t. Therefore, ( ) t W (P A, P B ) λ max (C) log + log 4λ max (C) log. P(A) P(B) P(A)P(B) Therefore, ( t ) P(B) exp. P(A) 4λmax (C) In particular, if B = {x : d(x, A) t} then ( t ) P d(x, A) t exp P(A) 4λmax (C). 9
7 If the set A is not too small, e.g. P(A) /, this implies that ( t ) P d(x, A) t exp 4λmax (C). This shows that the Gaussian measure is exponentially concentrated near any large enough set. The constant /4 in the exponent is not optimal and can be replaced by /; this is just an example of application of the above ideas. The optimal result is the famous Gaussian isoperimetry, if P(A) = P(B) for some half-space B then P(A t ) P(B t ). Gaussian concentration via the Prekopa-Leindler inequality. If we denote c = /λ max (C) then setting t = / in (.0.5), V (x) + V (y) V x + y c x y. 4 Given a function f on R n let us define its infimum-convolution by g(y) = inf f(x) + c x y. x 4 Then, for all x and y, If we define c g(y) f(x) x y V (x) + V (y) V x + y. (.0.7) 4 u(x) = e f(x) V (x), v(y) = e g(y) V (y) V (z), w(z) = e then (.0.7) implies that w x + y u(x) / v(y) /. The Prekopa-Leindler inequality with λ = / implies that e g dp e f dp. (.0.8) Given a measurable set A, let f be equal to 0 on A and + on the complement of A. Then g(y) = c d(x, A) 4 and (.0.8) implies ( c ) exp d(x, A) dp(x). 4 P(A) By Chebyshev s inequality, ( ct ) ( t ) P d(x, A) t exp = exp P(A) 4 P(A) 4λmax (C). Trivial metric and total variation. Definition A total variation distance between probability measure P and Q on a measurable space (S, B) is defined by TV(P, Q) = sup P(A) Q(A). A B Using the Hahn-Jordan decomposition, we can represent a signed measure µ = P Q as µ = µ + µ such that for some set D B and for any set E B, µ + (E) = µ(ed) 0 and µ (E) = µ(ed c ) 0. 93
8 Therefore, for any A B, which makes it obvious that P(A) Q(A) = µ + (A) µ (A) = µ + (AD) µ (AD c ) sup P(A) Q(A) = µ + (D). A B Let us describe some connections of the total variation distance to the Kullback-Leibler divergence and the Kantorovich-Rubinstein theorem. Let us start with the following simple observation. Lemma 43 If f is a measurable function on S such that f and fdp = 0 then for any λ R, λf dp e λ / e. Proof. Since ( + f)/, ( f)/ [0, ] and x by convexity of e Therefore, we get + f λf = λ + f ( λ), e λf + f e λ + f e λ = ch(λ) + fsh(λ). e λf dp ch(λ) e λ /, where the last inequality is easy to see by Taylor s expansion. Let us now consider a trivial metric on S given by Formally, the Kantorovich-Rubinstein theorem in this case would state that { } W (P, Q) := inf I(x y)dµ(x, y) : µ M(P, Q) Theorem 53 If Q is absolutely continuous w.r.t. P then TV(P, Q) D(Q P). d(x, y) = I(x y). (.0.9) Then a -Lipschitz function f w.r.t. d, f L, is defined by the condition that for all x, y S, f(x) f(y). (.0.0) { } = sup fdq fdp : f L =: γ(p, Q). However, since any uncountable set S is not separable w.r.t. a trivial metric d, we can not apply the Kantorovich-Rubinstein theorem directly. In this case one can use the Hahn-Jordan decomposition to show that γ coincides with the total variation distance, γ(p, Q) = TV(P, Q) and it is easy to construct a measure µ M(P, Q) explicitly that witnesses the above equality. We leave this as an exercise. Thus, for the trivial metric d, W (P, Q) = γ(p, Q) = TV(P, Q). We have the following analogue of the KL divergence bound. 94
9 Proof. Take f such that (.0.0) holds. If we define g(x) = f(x) fdp then, clearly, g and gdp = 0. The above lemma implies that for any λ R, e λf λ R fdp λ / dp. The variational characterization of entropy (.0.3) implies that λ fdq λ fdp λ / D(Q P) and for λ > 0 we get fdq λ fdp + D(Q P). λ Minimizing the right hand side over λ > 0, we get fdq fdp D(Q P). Applying this to f and f yields the result. 95
A glimpse into convex geometry. A glimpse into convex geometry
A glimpse into convex geometry 5 \ þ ÏŒÆ Two basis reference: 1. Keith Ball, An elementary introduction to modern convex geometry 2. Chuanming Zong, What is known about unit cubes Convex geometry lies
More informationLogarithmic Sobolev Inequalities
Logarithmic Sobolev Inequalities M. Ledoux Institut de Mathématiques de Toulouse, France logarithmic Sobolev inequalities what they are, some history analytic, geometric, optimal transportation proofs
More information4. Conditional risk measures and their robust representation
4. Conditional risk measures and their robust representation We consider a discrete-time information structure given by a filtration (F t ) t=0,...,t on our probability space (Ω, F, P ). The time horizon
More informationCS229T/STATS231: Statistical Learning Theory. Lecturer: Tengyu Ma Lecture 11 Scribe: Jongho Kim, Jamie Kang October 29th, 2018
CS229T/STATS231: Statistical Learning Theory Lecturer: Tengyu Ma Lecture 11 Scribe: Jongho Kim, Jamie Kang October 29th, 2018 1 Overview This lecture mainly covers Recall the statistical theory of GANs
More informationLecture 35: December The fundamental statistical distances
36-705: Intermediate Statistics Fall 207 Lecturer: Siva Balakrishnan Lecture 35: December 4 Today we will discuss distances and metrics between distributions that are useful in statistics. I will be lose
More informationAround the Brunn-Minkowski inequality
Around the Brunn-Minkowski inequality Andrea Colesanti Technische Universität Berlin - Institut für Mathematik January 28, 2015 Summary Summary The Brunn-Minkowski inequality Summary The Brunn-Minkowski
More informationNishant Gurnani. GAN Reading Group. April 14th, / 107
Nishant Gurnani GAN Reading Group April 14th, 2017 1 / 107 Why are these Papers Important? 2 / 107 Why are these Papers Important? Recently a large number of GAN frameworks have been proposed - BGAN, LSGAN,
More informationAsymptotic Geometric Analysis, Fall 2006
Asymptotic Geometric Analysis, Fall 006 Gideon Schechtman January, 007 1 Introduction The course will deal with convex symmetric bodies in R n. In the first few lectures we will formulate and prove Dvoretzky
More informationn [ F (b j ) F (a j ) ], n j=1(a j, b j ] E (4.1)
1.4. CONSTRUCTION OF LEBESGUE-STIELTJES MEASURES In this section we shall put to use the Carathéodory-Hahn theory, in order to construct measures with certain desirable properties first on the real line
More informationSymmetric Matrices and Eigendecomposition
Symmetric Matrices and Eigendecomposition Robert M. Freund January, 2014 c 2014 Massachusetts Institute of Technology. All rights reserved. 1 2 1 Symmetric Matrices and Convexity of Quadratic Functions
More informationTHE EQUALITY CASES OF THE EHRHARD-BORELL INEQUALITY
THE EQUALITY CASES OF THE EHRHARD-BORELL INEQUALITY YAIR SHENFELD AND RAMON VAN HANDEL Abstract. The Ehrhard-Borell inequality is a far-reaching refinement of the classical Brunn-Minkowski inequality that
More informationMATH MEASURE THEORY AND FOURIER ANALYSIS. Contents
MATH 3969 - MEASURE THEORY AND FOURIER ANALYSIS ANDREW TULLOCH Contents 1. Measure Theory 2 1.1. Properties of Measures 3 1.2. Constructing σ-algebras and measures 3 1.3. Properties of the Lebesgue measure
More informationConvex Functions. Daniel P. Palomar. Hong Kong University of Science and Technology (HKUST)
Convex Functions Daniel P. Palomar Hong Kong University of Science and Technology (HKUST) ELEC5470 - Convex Optimization Fall 2017-18, HKUST, Hong Kong Outline of Lecture Definition convex function Examples
More informationMoment Measures. Bo az Klartag. Tel Aviv University. Talk at the asymptotic geometric analysis seminar. Tel Aviv, May 2013
Tel Aviv University Talk at the asymptotic geometric analysis seminar Tel Aviv, May 2013 Joint work with Dario Cordero-Erausquin. A bijection We present a correspondence between convex functions and Borel
More informationCHAPTER 6. Differentiation
CHPTER 6 Differentiation The generalization from elementary calculus of differentiation in measure theory is less obvious than that of integration, and the methods of treating it are somewhat involved.
More informationReal Analysis Chapter 3 Solutions Jonathan Conder. ν(f n ) = lim
. Suppose ( n ) n is an increasing sequence in M. For each n N define F n : n \ n (with 0 : ). Clearly ν( n n ) ν( nf n ) ν(f n ) lim n If ( n ) n is a decreasing sequence in M and ν( )
More informationStat410 Probability and Statistics II (F16)
Stat4 Probability and Statistics II (F6 Exponential, Poisson and Gamma Suppose on average every /λ hours, a Stochastic train arrives at the Random station. Further we assume the waiting time between two
More informationProduct measure and Fubini s theorem
Chapter 7 Product measure and Fubini s theorem This is based on [Billingsley, Section 18]. 1. Product spaces Suppose (Ω 1, F 1 ) and (Ω 2, F 2 ) are two probability spaces. In a product space Ω = Ω 1 Ω
More informationMAT 571 REAL ANALYSIS II LECTURE NOTES. Contents. 2. Product measures Iterated integrals Complete products Differentiation 17
MAT 57 REAL ANALSIS II LECTURE NOTES PROFESSOR: JOHN QUIGG SEMESTER: SPRING 205 Contents. Convergence in measure 2. Product measures 3 3. Iterated integrals 4 4. Complete products 9 5. Signed measures
More informationIE 521 Convex Optimization
Lecture 5: Convex II 6th February 2019 Convex Local Lipschitz Outline Local Lipschitz 1 / 23 Convex Local Lipschitz Convex Function: f : R n R is convex if dom(f ) is convex and for any λ [0, 1], x, y
More informationReview of Multi-Calculus (Study Guide for Spivak s CHAPTER ONE TO THREE)
Review of Multi-Calculus (Study Guide for Spivak s CHPTER ONE TO THREE) This material is for June 9 to 16 (Monday to Monday) Chapter I: Functions on R n Dot product and norm for vectors in R n : Let X
More informationL p Spaces and Convexity
L p Spaces and Convexity These notes largely follow the treatments in Royden, Real Analysis, and Rudin, Real & Complex Analysis. 1. Convex functions Let I R be an interval. For I open, we say a function
More information1 Functional Analysis
1 Functional Analysis 1 1.1 Banach spaces Remark 1.1. In classical mechanics, the state of some physical system is characterized as a point x in phase space (generalized position and momentum coordinates).
More informationDimensionality in the Stability of the Brunn-Minkowski Inequality: A blessing or a curse?
Dimensionality in the Stability of the Brunn-Minkowski Inequality: A blessing or a curse? Ronen Eldan, Tel Aviv University (Joint with Bo`az Klartag) Berkeley, September 23rd 2011 The Brunn-Minkowski Inequality
More informationNonparametric estimation of. s concave and log-concave densities: alternatives to maximum likelihood
Nonparametric estimation of s concave and log-concave densities: alternatives to maximum likelihood Jon A. Wellner University of Washington, Seattle Cowles Foundation Seminar, Yale University November
More informationEC /11. Math for Microeconomics September Course, Part II Problem Set 1 with Solutions. a11 a 12. x 2
LONDON SCHOOL OF ECONOMICS Professor Leonardo Felli Department of Economics S.478; x7525 EC400 2010/11 Math for Microeconomics September Course, Part II Problem Set 1 with Solutions 1. Show that the general
More informationLecture No 1 Introduction to Diffusion equations The heat equat
Lecture No 1 Introduction to Diffusion equations The heat equation Columbia University IAS summer program June, 2009 Outline of the lectures We will discuss some basic models of diffusion equations and
More informationA function(al) f is convex if dom f is a convex set, and. f(θx + (1 θ)y) < θf(x) + (1 θ)f(y) f(x) = x 3
Convex functions The domain dom f of a functional f : R N R is the subset of R N where f is well-defined. A function(al) f is convex if dom f is a convex set, and f(θx + (1 θ)y) θf(x) + (1 θ)f(y) for all
More informationChapter 1. Optimality Conditions: Unconstrained Optimization. 1.1 Differentiable Problems
Chapter 1 Optimality Conditions: Unconstrained Optimization 1.1 Differentiable Problems Consider the problem of minimizing the function f : R n R where f is twice continuously differentiable on R n : P
More informationGeneralized Orlicz spaces and Wasserstein distances for convex concave scale functions
Bull. Sci. math. 135 (2011 795 802 www.elsevier.com/locate/bulsci Generalized Orlicz spaces and Wasserstein distances for convex concave scale functions Karl-Theodor Sturm Institut für Angewandte Mathematik,
More informationSTAT 7032 Probability Spring Wlodek Bryc
STAT 7032 Probability Spring 2018 Wlodek Bryc Created: Friday, Jan 2, 2014 Revised for Spring 2018 Printed: January 9, 2018 File: Grad-Prob-2018.TEX Department of Mathematical Sciences, University of Cincinnati,
More informationg 2 (x) (1/3)M 1 = (1/3)(2/3)M.
COMPACTNESS If C R n is closed and bounded, then by B-W it is sequentially compact: any sequence of points in C has a subsequence converging to a point in C Conversely, any sequentially compact C R n is
More informationExercise 1. Show that the Radon-Nikodym theorem for a finite measure implies the theorem for a σ-finite measure.
Real Variables, Fall 2014 Problem set 8 Solution suggestions xercise 1. Show that the Radon-Nikodym theorem for a finite measure implies the theorem for a σ-finite measure. nswer: ssume that the Radon-Nikodym
More informationHelly's Theorem and its Equivalences via Convex Analysis
Portland State University PDXScholar University Honors Theses University Honors College 2014 Helly's Theorem and its Equivalences via Convex Analysis Adam Robinson Portland State University Let us know
More informationLinear and non-linear programming
Linear and non-linear programming Benjamin Recht March 11, 2005 The Gameplan Constrained Optimization Convexity Duality Applications/Taxonomy 1 Constrained Optimization minimize f(x) subject to g j (x)
More information2 (Bonus). Let A X consist of points (x, y) such that either x or y is a rational number. Is A measurable? What is its Lebesgue measure?
MA 645-4A (Real Analysis), Dr. Chernov Homework assignment 1 (Due 9/5). Prove that every countable set A is measurable and µ(a) = 0. 2 (Bonus). Let A consist of points (x, y) such that either x or y is
More informationMATHS 730 FC Lecture Notes March 5, Introduction
1 INTRODUCTION MATHS 730 FC Lecture Notes March 5, 2014 1 Introduction Definition. If A, B are sets and there exists a bijection A B, they have the same cardinality, which we write as A, #A. If there exists
More information3. Convex functions. basic properties and examples. operations that preserve convexity. the conjugate function. quasiconvex functions
3. Convex functions Convex Optimization Boyd & Vandenberghe basic properties and examples operations that preserve convexity the conjugate function quasiconvex functions log-concave and log-convex functions
More informationCHAPTER 1. Metric Spaces. 1. Definition and examples
CHAPTER Metric Spaces. Definition and examples Metric spaces generalize and clarify the notion of distance in the real line. The definitions will provide us with a useful tool for more general applications
More informationA SET OF LECTURE NOTES ON CONVEX OPTIMIZATION WITH SOME APPLICATIONS TO PROBABILITY THEORY INCOMPLETE DRAFT. MAY 06
A SET OF LECTURE NOTES ON CONVEX OPTIMIZATION WITH SOME APPLICATIONS TO PROBABILITY THEORY INCOMPLETE DRAFT. MAY 06 CHRISTIAN LÉONARD Contents Preliminaries 1 1. Convexity without topology 1 2. Convexity
More informationx log x, which is strictly convex, and use Jensen s Inequality:
2. Information measures: mutual information 2.1 Divergence: main inequality Theorem 2.1 (Information Inequality). D(P Q) 0 ; D(P Q) = 0 iff P = Q Proof. Let ϕ(x) x log x, which is strictly convex, and
More informationLARGE DEVIATIONS OF TYPICAL LINEAR FUNCTIONALS ON A CONVEX BODY WITH UNCONDITIONAL BASIS. S. G. Bobkov and F. L. Nazarov. September 25, 2011
LARGE DEVIATIONS OF TYPICAL LINEAR FUNCTIONALS ON A CONVEX BODY WITH UNCONDITIONAL BASIS S. G. Bobkov and F. L. Nazarov September 25, 20 Abstract We study large deviations of linear functionals on an isotropic
More informationBounded uniformly continuous functions
Bounded uniformly continuous functions Objectives. To study the basic properties of the C -algebra of the bounded uniformly continuous functions on some metric space. Requirements. Basic concepts of analysis:
More informationThe Pedestrian s Guide to Local Time
The Pedestrian s Guide to Local Time Tomas Björk, Department of Finance, Stockholm School of Economics, Box 651, SE-113 83 Stockholm, SWEDEN tomas.bjork@hhs.se November 19, 213 Preliminary version Comments
More informationConvex Optimization Notes
Convex Optimization Notes Jonathan Siegel January 2017 1 Convex Analysis This section is devoted to the study of convex functions f : B R {+ } and convex sets U B, for B a Banach space. The case of B =
More information3. Convex functions. basic properties and examples. operations that preserve convexity. the conjugate function. quasiconvex functions
3. Convex functions Convex Optimization Boyd & Vandenberghe basic properties and examples operations that preserve convexity the conjugate function quasiconvex functions log-concave and log-convex functions
More informationTheorem 2.1 (Caratheodory). A (countably additive) probability measure on a field has an extension. n=1
Chapter 2 Probability measures 1. Existence Theorem 2.1 (Caratheodory). A (countably additive) probability measure on a field has an extension to the generated σ-field Proof of Theorem 2.1. Let F 0 be
More informationProbability and Measure
Part II Year 2018 2017 2016 2015 2014 2013 2012 2011 2010 2009 2008 2007 2006 2005 2018 84 Paper 4, Section II 26J Let (X, A) be a measurable space. Let T : X X be a measurable map, and µ a probability
More informationMath 5588 Final Exam Solutions
Math 5588 Final Exam Solutions Prof. Jeff Calder May 9, 2017 1. Find the function u : [0, 1] R that minimizes I(u) = subject to u(0) = 0 and u(1) = 1. 1 0 e u(x) u (x) + u (x) 2 dx, Solution. Since the
More informationLecture 1 Measure concentration
CSE 29: Learning Theory Fall 2006 Lecture Measure concentration Lecturer: Sanjoy Dasgupta Scribe: Nakul Verma, Aaron Arvey, and Paul Ruvolo. Concentration of measure: examples We start with some examples
More informationSome lecture notes for Math 6050E: PDEs, Fall 2016
Some lecture notes for Math 65E: PDEs, Fall 216 Tianling Jin December 1, 216 1 Variational methods We discuss an example of the use of variational methods in obtaining existence of solutions. Theorem 1.1.
More informationIntroduction to Real Analysis Alternative Chapter 1
Christopher Heil Introduction to Real Analysis Alternative Chapter 1 A Primer on Norms and Banach Spaces Last Updated: March 10, 2018 c 2018 by Christopher Heil Chapter 1 A Primer on Norms and Banach Spaces
More informationConvex Functions and Optimization
Chapter 5 Convex Functions and Optimization 5.1 Convex Functions Our next topic is that of convex functions. Again, we will concentrate on the context of a map f : R n R although the situation can be generalized
More informationA Brunn Minkowski inequality for the Hessian eigenvalue in three-dimensional convex domain
Advances in Mathematics 5 010 1616 1633 www.elsevier.com/locate/aim A Brunn Minkowski inequality for the Hessian eigenvalue in three-dimensional convex domain Pan Liu a, Xi-Nan Ma b,,luxu c a Department
More informationIf Y and Y 0 satisfy (1-2), then Y = Y 0 a.s.
20 6. CONDITIONAL EXPECTATION Having discussed at length the limit theory for sums of independent random variables we will now move on to deal with dependent random variables. An important tool in this
More informationExamples of Dual Spaces from Measure Theory
Chapter 9 Examples of Dual Spaces from Measure Theory We have seen that L (, A, µ) is a Banach space for any measure space (, A, µ). We will extend that concept in the following section to identify an
More information3 (Due ). Let A X consist of points (x, y) such that either x or y is a rational number. Is A measurable? What is its Lebesgue measure?
MA 645-4A (Real Analysis), Dr. Chernov Homework assignment 1 (Due ). Show that the open disk x 2 + y 2 < 1 is a countable union of planar elementary sets. Show that the closed disk x 2 + y 2 1 is a countable
More information+ 2x sin x. f(b i ) f(a i ) < ɛ. i=1. i=1
Appendix To understand weak derivatives and distributional derivatives in the simplest context of functions of a single variable, we describe without proof some results from real analysis (see [7] and
More informationChapter 8. General Countably Additive Set Functions. 8.1 Hahn Decomposition Theorem
Chapter 8 General Countably dditive Set Functions In Theorem 5.2.2 the reader saw that if f : X R is integrable on the measure space (X,, µ) then we can define a countably additive set function ν on by
More informationConvex Geometry. Otto-von-Guericke Universität Magdeburg. Applications of the Brascamp-Lieb and Barthe inequalities. Exercise 12.
Applications of the Brascamp-Lieb and Barthe inequalities Exercise 12.1 Show that if m Ker M i {0} then both BL-I) and B-I) hold trivially. Exercise 12.2 Let λ 0, 1) and let f, g, h : R 0 R 0 be measurable
More informationConcentration inequalities and the entropy method
Concentration inequalities and the entropy method Gábor Lugosi ICREA and Pompeu Fabra University Barcelona what is concentration? We are interested in bounding random fluctuations of functions of many
More informationLebesgue Integration on R n
Lebesgue Integration on R n The treatment here is based loosely on that of Jones, Lebesgue Integration on Euclidean Space We give an overview from the perspective of a user of the theory Riemann integration
More informationAn introduction to some aspects of functional analysis
An introduction to some aspects of functional analysis Stephen Semmes Rice University Abstract These informal notes deal with some very basic objects in functional analysis, including norms and seminorms
More informationPreparatory Material for the European Intensive Program in Bydgoszcz 2011 Analytical and computer assisted methods in mathematical models
Preparatory Material for the European Intensive Program in Bydgoszcz 2011 Analytical and computer assisted methods in mathematical models September 4{18 Basics on the Lebesgue integral and the divergence
More informationLECTURE 2. Convexity and related notions. Last time: mutual information: definitions and properties. Lecture outline
LECTURE 2 Convexity and related notions Last time: Goals and mechanics of the class notation entropy: definitions and properties mutual information: definitions and properties Lecture outline Convexity
More informationVISCOSITY SOLUTIONS. We follow Han and Lin, Elliptic Partial Differential Equations, 5.
VISCOSITY SOLUTIONS PETER HINTZ We follow Han and Lin, Elliptic Partial Differential Equations, 5. 1. Motivation Throughout, we will assume that Ω R n is a bounded and connected domain and that a ij C(Ω)
More information4 Expectation & the Lebesgue Theorems
STA 205: Probability & Measure Theory Robert L. Wolpert 4 Expectation & the Lebesgue Theorems Let X and {X n : n N} be random variables on a probability space (Ω,F,P). If X n (ω) X(ω) for each ω Ω, does
More informationSHARP BOUNDARY TRACE INEQUALITIES. 1. Introduction
SHARP BOUNDARY TRACE INEQUALITIES GILES AUCHMUTY Abstract. This paper describes sharp inequalities for the trace of Sobolev functions on the boundary of a bounded region R N. The inequalities bound (semi-)norms
More informationECE598: Information-theoretic methods in high-dimensional statistics Spring 2016
ECE598: Information-theoretic methods in high-dimensional statistics Spring 06 Lecture : Mutual Information Method Lecturer: Yihong Wu Scribe: Jaeho Lee, Mar, 06 Ed. Mar 9 Quick review: Assouad s lemma
More informationEconomics 204 Summer/Fall 2011 Lecture 5 Friday July 29, 2011
Economics 204 Summer/Fall 2011 Lecture 5 Friday July 29, 2011 Section 2.6 (cont.) Properties of Real Functions Here we first study properties of functions from R to R, making use of the additional structure
More informationSubgradients. subgradients and quasigradients. subgradient calculus. optimality conditions via subgradients. directional derivatives
Subgradients subgradients and quasigradients subgradient calculus optimality conditions via subgradients directional derivatives Prof. S. Boyd, EE392o, Stanford University Basic inequality recall basic
More informationCONTENTS. 4 Hausdorff Measure Introduction The Cantor Set Rectifiable Curves Cantor Set-Like Objects...
Contents 1 Functional Analysis 1 1.1 Hilbert Spaces................................... 1 1.1.1 Spectral Theorem............................. 4 1.2 Normed Vector Spaces.............................. 7 1.2.1
More informationDistance-Divergence Inequalities
Distance-Divergence Inequalities Katalin Marton Alfréd Rényi Institute of Mathematics of the Hungarian Academy of Sciences Motivation To find a simple proof of the Blowing-up Lemma, proved by Ahlswede,
More informationSteiner s formula and large deviations theory
Steiner s formula and large deviations theory Venkat Anantharam EECS Department University of California, Berkeley May 19, 2015 Simons Conference on Networks and Stochastic Geometry Blanton Museum of Art
More informationSolutions to Tutorial 11 (Week 12)
THE UIVERSITY OF SYDEY SCHOOL OF MATHEMATICS AD STATISTICS Solutions to Tutorial 11 (Week 12) MATH3969: Measure Theory and Fourier Analysis (Advanced) Semester 2, 2017 Web Page: http://sydney.edu.au/science/maths/u/ug/sm/math3969/
More informationEstimates for probabilities of independent events and infinite series
Estimates for probabilities of independent events and infinite series Jürgen Grahl and Shahar evo September 9, 06 arxiv:609.0894v [math.pr] 8 Sep 06 Abstract This paper deals with finite or infinite sequences
More informationNon-linear wave equations. Hans Ringström. Department of Mathematics, KTH, Stockholm, Sweden
Non-linear wave equations Hans Ringström Department of Mathematics, KTH, 144 Stockholm, Sweden Contents Chapter 1. Introduction 5 Chapter 2. Local existence and uniqueness for ODE:s 9 1. Background material
More informationChapter 1 Preliminaries
Chapter 1 Preliminaries 1.1 Conventions and Notations Throughout the book we use the following notations for standard sets of numbers: N the set {1, 2,...} of natural numbers Z the set of integers Q the
More information4th Preparation Sheet - Solutions
Prof. Dr. Rainer Dahlhaus Probability Theory Summer term 017 4th Preparation Sheet - Solutions Remark: Throughout the exercise sheet we use the two equivalent definitions of separability of a metric space
More informationChapter 2 Convex Analysis
Chapter 2 Convex Analysis The theory of nonsmooth analysis is based on convex analysis. Thus, we start this chapter by giving basic concepts and results of convexity (for further readings see also [202,
More informationMath 5052 Measure Theory and Functional Analysis II Homework Assignment 7
Math 5052 Measure Theory and Functional Analysis II Homework Assignment 7 Prof. Wickerhauser Due Friday, February 5th, 2016 Please do Exercises 3, 6, 14, 16*, 17, 18, 21*, 23*, 24, 27*. Exercises marked
More informationConvex Analysis Background
Convex Analysis Background John C. Duchi Stanford University Park City Mathematics Institute 206 Abstract In this set of notes, we will outline several standard facts from convex analysis, the study of
More informationQUADRATIC MAJORIZATION 1. INTRODUCTION
QUADRATIC MAJORIZATION JAN DE LEEUW 1. INTRODUCTION Majorization methods are used extensively to solve complicated multivariate optimizaton problems. We refer to de Leeuw [1994]; Heiser [1995]; Lange et
More informationCalculus of Variations. Final Examination
Université Paris-Saclay M AMS and Optimization January 18th, 018 Calculus of Variations Final Examination Duration : 3h ; all kind of paper documents (notes, books...) are authorized. The total score of
More informationLecture 4: Convex Functions, Part I February 1
IE 521: Convex Optimization Instructor: Niao He Lecture 4: Convex Functions, Part I February 1 Spring 2017, UIUC Scribe: Shuanglong Wang Courtesy warning: These notes do not necessarily cover everything
More informationPart II Probability and Measure
Part II Probability and Measure Theorems Based on lectures by J. Miller Notes taken by Dexter Chua Michaelmas 2016 These notes are not endorsed by the lecturers, and I have modified them (often significantly)
More informationNonlinear Programming Algorithms Handout
Nonlinear Programming Algorithms Handout Michael C. Ferris Computer Sciences Department University of Wisconsin Madison, Wisconsin 5376 September 9 1 Eigenvalues The eigenvalues of a matrix A C n n are
More informationProbabilistic Methods in Asymptotic Geometric Analysis.
Probabilistic Methods in Asymptotic Geometric Analysis. C. Hugo Jiménez PUC-RIO, Brazil September 21st, 2016. Colmea. RJ 1 Origin 2 Normed Spaces 3 Distribution of volume of high dimensional convex bodies
More informationThe proximal mapping
The proximal mapping http://bicmr.pku.edu.cn/~wenzw/opt-2016-fall.html Acknowledgement: this slides is based on Prof. Lieven Vandenberghes lecture notes Outline 2/37 1 closed function 2 Conjugate function
More informationSigned Measures. Chapter Basic Properties of Signed Measures. 4.2 Jordan and Hahn Decompositions
Chapter 4 Signed Measures Up until now our measures have always assumed values that were greater than or equal to 0. In this chapter we will extend our definition to allow for both positive negative values.
More informationLecture Notes in Advanced Calculus 1 (80315) Raz Kupferman Institute of Mathematics The Hebrew University
Lecture Notes in Advanced Calculus 1 (80315) Raz Kupferman Institute of Mathematics The Hebrew University February 7, 2007 2 Contents 1 Metric Spaces 1 1.1 Basic definitions...........................
More informationOn the Brunn-Minkowski inequality for general measures with applications to new isoperimetric-type inequalities
On the Brunn-Minkowski inequality for general measures with applications to new isoperimetric-type inequalities Galyna Livshyts, Arnaud Marsiglietti, Piotr Nayar, Artem Zvavitch June 8, 2015 Abstract In
More informationConvex functions. Definition. f : R n! R is convex if dom f is a convex set and. f ( x +(1 )y) < f (x)+(1 )f (y) f ( x +(1 )y) apple f (x)+(1 )f (y)
Convex functions I basic properties and I operations that preserve convexity I quasiconvex functions I log-concave and log-convex functions IOE 611: Nonlinear Programming, Fall 2017 3. Convex functions
More informationSemicontinuous functions and convexity
Semicontinuous functions and convexity Jordan Bell jordan.bell@gmail.com Department of Mathematics, University of Toronto April 3, 2014 1 Lattices If (A, ) is a partially ordered set and S is a subset
More informationNOTES ON VECTOR-VALUED INTEGRATION MATH 581, SPRING 2017
NOTES ON VECTOR-VALUED INTEGRATION MATH 58, SPRING 207 Throughout, X will denote a Banach space. Definition 0.. Let ϕ(s) : X be a continuous function from a compact Jordan region R n to a Banach space
More informationI. ANALYSIS; PROBABILITY
ma414l1.tex Lecture 1. 12.1.2012 I. NLYSIS; PROBBILITY 1. Lebesgue Measure and Integral We recall Lebesgue measure (M411 Probability and Measure) λ: defined on intervals (a, b] by λ((a, b]) := b a (so
More information02. Measure and integral. 1. Borel-measurable functions and pointwise limits
(October 3, 2017) 02. Measure and integral Paul Garrett garrett@math.umn.edu http://www.math.umn.edu/ garrett/ [This document is http://www.math.umn.edu/ garrett/m/real/notes 2017-18/02 measure and integral.pdf]
More informationTheory of Ordinary Differential Equations
Theory of Ordinary Differential Equations Existence, Uniqueness and Stability Jishan Hu and Wei-Ping Li Department of Mathematics The Hong Kong University of Science and Technology ii Copyright c 24 by
More informationMidterm Examination: Economics 210A October 2011
Midterm Examination: Economics 210A October 2011 The exam has 6 questions. Answer as many as you can. Good luck. 1) A) Must every quasi-concave function must be concave? If so, prove it. If not, provide
More informationBrownian Motion. 1 Definition Brownian Motion Wiener measure... 3
Brownian Motion Contents 1 Definition 2 1.1 Brownian Motion................................. 2 1.2 Wiener measure.................................. 3 2 Construction 4 2.1 Gaussian process.................................
More information