Convexity in R n. The following lemma will be needed in a while. Lemma 1 Let x E, u R n. If τ I(x, u), τ 0, define. f(x + τu) f(x). τ.
|
|
- Kelly Hood
- 6 years ago
- Views:
Transcription
1 Convexity in R n Let E be a convex subset of R n. A function f : E (, ] is convex iff f(tx + (1 t)y) (1 t)f(x) + tf(y) x, y E, t [0, 1]. A similar definition holds in any vector space. A topology is needed for the next results, but they fail to hold in the infinite dimensional case. Intuitively, a function is convex if at every point the graph lies above the tangent plane. Of course there is no guarantee at first that there is a tangent plane. A first thing to notice is that the definition of convexity implies that if f is convex on E then the set {x E : f(x) < } is convex. From now on we assume that E is a convex subset of R n and f : E R is convex. That is, we throw away for the time being the points where f could be infinite. We will also assume from now on that E is an open convex subset of R n. Some of the results hold even if E is not open, but a lot don t; in particular Lemma 2 is false if E is not open. If x E, u R n, we define I(x, u) = {t R : x + tu E}; this is then an open interval in R containing 0. If x E and u R n, when writing f(x + tu) we will always assume that t I(x, u). The following lemma will be needed in a while. Lemma 1 Let x E, u R n. If I(x, u), 0, define ϕ() = Then ϕ increases in I(x, u)\{0}. f(x + u) f(x). Proof. Assume first 0 < σ < I(x, u). Then 0 < σ/ < 1 and ( x + σu = 1 σ ) x + σ (x + u); hence ( f(x + σu) 1 σ ) f(x) + σ f(x + u). Subtracting f(x) from both sides and dividing by σ, we get ϕ(σ) ϕ(). One proceeds similarly if σ < < 0. In this case 0 < /σ < 1 and we get f(x + u) f(x) (/σ)[f(x + σu) f(x)]. Dividing by reverses the inequality. Finally, assume σ < 0 <. Then x = ( σ) (x + σu) + (x + u), σ σ hence f(x) ( σ) f(x + σu) + f(x + u). σ σ Subtracting /( σ)f(x) from both sides and rearranging gives f(x + u) f(x) ( σ) σ f(x + σu) f(x). σ Multiplying by the positive quantity ( σ)/( σ) gives ϕ(σ) ϕ(). Next; continuity. The main step is proving that f is locally bounded. The idea behind that part of the proof is that every point of E can be in the interior of some polyhedron, a cube for example. By convexity, the function inside the cube is bounded by its values on the faces, on each face it is bounded by the values on the vertices. Thus inside a cube, f is bounded by the maximum on a finite set of values, hence is bounded.
2 Lemma 2 let E be an open convex subset of R n and let f : E R be convex. Then f is continuous. Proof. First it seems one has to see that f is locally bounded. Let x 0 = (x 01,..., x 0n ) E and let V = {x = (x 1,..., x n ) R n : x j x 0j δ}, where δ is chosen small enough so that V E. We see first that f is bounded above in V. If y V, then y is a convex combination (in more than one way) of the 2 n vertices of V ; thus by convexity f(y) max{f(x 0 + δ ϵ j e j ) : ϵ = (ϵ 1,..., ϵ n ) { 1, 1} n } j=1 where {e 1,..., e n } is the canonical basis of R n. Now let W be a compact neighborhood of x contained in the interior of V. To see that f is bounded below on W, assume it isn t. Then, by compactness, there will exist a sequence {x m } in W, converging to some z W, such that f(x m ) for m. Now let y m V be on the line joining x m to z, but on the opposite side of x m ; for example, let y m = z + ϵ(z x m ) = (1 + ϵ)z ϵx m where ϵ > 0 is small enough so that y m V. Then z = e 1 + ϵ x m ϵ y m hence f(z) e 1+ϵ f(x m) ϵ f(y m), but the right hand side goes to as m, since ϵ > 0 is fixed and {f(y m )} remains bounded above. This contradicts that f(z) >. We proved f is locally bounded. For continuity, assume again x E and let V be a compact neighborhood of x in E, so that f is bounded on V. Let {x m } be a sequence in V converging to x. We can write x m = x + m u m where for each m N, u m is a unit vector in R n and m 0; lim m m = 0. Let σ > 0 be such that x σu m V for all m. The main thing is that σ should not be zero, and be positive so that by Lemma 1), we have (since m 0 > σ) hence f(x + m ) f(x) m f(x + ( s)u m) f(x) σ f(x m ) f(x) = f(x + m ) f(x) m f(x) f(x σu m ) σ = f(x) f(x σu m), σ proving lim inf m (f(x m ) f(x)) 0. Similarly one proves that lim sup m (f(x m ) f(x)) 0. Continuity follows. 0 as m 0, Hahn-Banach. The version we need here is a finite dimensional one, but it is valid in all topological vector spaces. A good reference is Schaefer s Topological Vector Spaces book, but it appears in zillions of places. Theorem 3 Let L be a topological vector space, let M be a linear manifold in L and let A be an open non-empty convex subset of L such that A M =. There exists a closed hyperplane in L containing M not intersecting A. Just in case, a topological vector space (tvs) is a vector space L over F = R or C with a topology such that the maps (x, y) x + y : L L L, (α, x) αx : F L L, 2
3 are continuous. For example, normed spaces are tvs; in particular R n. A linear manifold in a vector space L is the translate of a subspace; any set of the form a + W = {a + w : w W }, where W is a linear subspace of L. A hyperplane is a linear manifold of codimension 1; i.e., a linear manifold of the form a + W where L = W N, and N is one-dimensional. All hyperplanes are closed in the finite dimensional case, not so in the infinite dimensional case. One proves that a subset H of the tvs L is a closed hyperplane if and only it is of the form H = {x L : f(x) = α} where f : L F is a continuous, non-identically vanishing, linear functional and α F. In R n a subset H is a hyperplane if and only if there exist ξ R n \{0}, α R such that H = {x R n : x ξ = α}. We want to consider the case in which A R n is open and convex, = A R n and x A, the boundary of A. Singleton sets are linear manifolds; they are translates of the zero dimensional subspace {0}. Thus {x} is and, since A is open, {x} A =, thus there exists 0 ξ R n, α R, such that ξ x = α and ξ y α for all y A. Since A is connected, being convex, one either has ξ y > α for all y A or ξ y < α for all y A. Replacing ξ by ξ if necessary, we can assume ξ y > α for all y A. Assume now that f : E R is convex; E a convex open subset of R n. Consider the set A = {(x, y) R n R : y > f(x)}. We see that A is convex in R n R and, since f is continuous, A is open. Let x E; then (x, f(x)) is on the boundary of A and by what we just did there exists ξ = (ν, ) R n R, ξ (0, 0), α R such that ξ x + f(x) = α, ξ y + s > α y E, s R, s > f(y). We notice that > 0. In fact, we can t have = 0, otherwise ξ y > α for all y E, contradicting that (if = 0) ξ x = α. Take now any point in E, for example x. Then ξ x + s > α for s > f(x), only possible if > 0. Dividing by and setting η = ξ/, we can write the consequence of applying Hahn-Banach as We conclude α = f(x) η x, s > α + η y y E, s R, s > f(y). f(y) α + η y = f(x) + η (y x) y E. The equation z = f(x) + η (y x) is the equation of a hyperplane through the point (x, f(x)), so the last inequality states that the graph of the function is always above that hyperplane. We have the following definition. Let E be a convex open subset of R n and let f : E R be convex. Let x E. The subdifferential of f at x is the set f(x) consisting of all η R n such that (1) f(y) f(x) + η (y x) y E. We have Lemma 4 Let f : E R be convex, where E is an open convex subset of R n. For every x E, the set f(x) is a non-empty closed convex subset of R n. The function f is differentiable at x E if and only if f(x) is a singleton set, in which case f(x) = { f(x)}. 3
4 Proof. It is proved above, as a consequence of Hahn-Banach, that f(x) for all x E. The fact that f(x) is closed and convex is trivial. Next we want to see that if x E and f(x) is a singleton set, then f is differentiable at x. Assume thus that x E and f(x) = {η}, for some η R n. Let u R n and consider the function ϕ of Lemma 1. By the lemma, the limits ρ(u) = lim 0+ f(x + u) f(x + σu), l(u) = lim σ 0 σ exist and f(x + u) f(x + σu) ρ(u) l(u) σ for all u R n, σ, I(x, u), σ < 0 <. We claim l(u) = η = ρ(u) for all u R n. To see this, let u R n and select s 0 R such that l(u) s 0 ρ(u). As before, let A = {(y, s) E R, s > f(y)}, which is open and convex in R n R, and let M = {(x + tu, f(x) + ts 0 ) : t R, which is a linear manifold (a line) in R n R. If (y, s) A M, then y = x + tu, s = f(x 0 ) + ts 0 for some t R (necessarily t I(x, u)) and f(x + tu) < f(x 0 ) + ts 0. This is impossible if t = 0. If t > 0 it works out to ϕ(t) < s 0, where ϕ is defined as above in terms of the u we are considering right now. However, ϕ(t) ρ(u) s 0 if t > 0. If t < 0 we similarly get ϕ(t) > s 0, a contradiction because ϕ(t) l(u) s 0 if t < 0. Thus A M =, and by Hahn-Banach there exists (ξ, ) R n R\{(0, 0)}, α R, such that (2) (3) ξ (x + tu) + (f(x) + ts 0 ) = α t R, Obviously, (2) is equivalent to (4) (5) ξ y + s > α (y, s) E R, s > f(y). ξ u + s 0 = 0, ξ x + f(x) = α. If = 0, we get ξ x = α, contradicting that we must get ξ x = ξ x + s > α if s > f(x). Thus > 0. In view of this, we see that (3) is equivalent to > 0 and f(y) α 1 ξ y y E. Using the value of α given by (5), we get f(y) f(x) 1 ξ(y x) y E. This implies that ( 1/)ξ f(x), hence ( 1/)ξ = η. By (4), this implies that s 0 = η u. The value of s is thus uniquely determined by u and by η proving that ρ(u) = l(u). On the other hand, if > 0, u R n, f(x + u) f(x) + η u implies that ϕ() η u for all > 0. Similarly ϕ() η u if < 0. Thus, in general ρ(u) η u l(u), proving the claim. To see that f is differentiable at x and that η = f(x), let ϵ > 0 be given. Since l(u) = ρ(u) = η u for all u R n, there exists δ > 0 such that 0 < < δ implies f(x + e i ) f(x) η e i < ϵ for i = 1,..., n, where {e 1,..., e n } is the canonical basis of R n. Let 0 u = (u 1,..., u n ) R n, and assume that = u u n < δ. We can write u = n i=1 u i f i where ẽ i = e i if u i 0, ẽ i = e i if u i < 0. Then x + u = i=1 u i (x + ẽ i ); 4
5 by convexity, Thus f(x + u) (6) 0 f(x + u) f(x) η u i=1 u i f(x + ẽ i ). i=1 ( ) f(x + u 1 ẽ i ) f(x) u i η ẽ i. Now ( ) f(x + ẽ i ) f(x) f(x + ei ) f(x) η ẽ i = ± η e i where = ± ; since = < δ, we get that f(x + ẽ i ) f(x) η ẽ i < ϵ; using this in (6) we proved that 0 f(x + u) f(x) η u < ϵ whenever u R n and < δ. The proof of differentiability is complete. Conversely, assume f is differentiable at x. In this case we get at once that f(x + u) f(x) f(x + u) f(x) ρ(u) = lim = f(x) u = lim = l(x); 0+ 0 as before we see that η f(x) implies l(u) η u ρ(u). It follows that η = (x). Monotonicity and cyclical monotonicity. Let S R n R n. It is said to be monotone of degree 1 iff (x 0 x 1 ) ξ 0 +(x 1 x 0 ) ξ 1 0 for all (x 0, ξ 0 ), (x 1, ξ 1 ) S. This, of course can be abbreviated as (x 0 x 1 ) (ξ 0 ξ 1 ) 0 for all (x 0, ξ 0 ), (x 1, ξ 1 ) S. What exactly this means geometrically may have to be looked into, perhaps. Similarly, one defines a set S R n R n to be monotone of degree m, where m N, iff m i=0 (x i+1 x i ) ξ i 0 for all (x 0, ξ 0 ),..., (x m, ξ m ) S, where x m+1 = x 0. A set S R n R n is said to be cyclically monotone iff it is monotone of all degrees. Let f : E R, E a convex, open subset of R n.the set f R n R n is defined by f = {(x, ξ) : x E, ξ f(x)}. If (x i, ξ i ) f for i = 0,..., m, then f(y) f(x i ) + (y x i ) ξ i for all y R n, i = 0,..., m. Taking in the i-th equation, y = x i+1, x m+1 = x 0, we see that f(x i+1 f(x i ) (x i+1 x i ) ξ i, i = 0,..., m. Adding over i = 0,..., m the left hand sides telescope to 0 and one gets m i=0 (x i+1 x i ) ξ i 0. In other words, the set f is cyclically monotone. It being obvious that a subset of a cyclically monotone set is cyclically monotone, we see that all subsets of f for a convex f are cyclically monotone. Rockafellar s theorem is the converse of this result. That is, he states it in the form of an if and only if condition, but the serious part is the converse. It seems 5
6 however that the convex function that comes out of this could be infinite at some points. Rockafellar defines a convex function as being proper iff it is not identically. As mentioned at the beginning, the set of points where f is finite is convex. It is also easy to see that a convex function can only be equal to on the outskirts of its domain; that is the set E = {x R n : f(x) < } is open. Thus if f : R n R is a proper convex function, all we said so far is valid on the set E = {x R n : f(x) < }. And, of course, f E R n ; f(x) if and only if x E. Theorem 5 (Rockafellar in R n ) A subset S R n R n is cyclically monotone if and only if there exists a proper convex f : R n R such that S f. Proof. The if part has been done, so we only need to do the only if part. Assume thus that S R n R n is cyclically monotone. One of the simplest of convex functions is an affine function, which is simply a function of the form f(x) = a + x ξ, for a, ξ R n. This type of function has the distinction that the convexity inequality is actually an equality, hence it is not only convex, it is also concave. We will need the following Lemma. The proof is quite simple, except that one has to be careful because the supremum in question can be infinite at some points, or possibly everywhere. Lemma 6 Let f α : R n (, ] be convex for all α A, A an index set. Then f : R n (, ] defined by is convex. f(x) = sup{f α (x)} α A To prove the theorem, Rockafellar now assumes, as one may, that S and fixes a pair (x 0, ξ 0 ) S. He then defines m 1 f(x) = sup{(x x m ) ξ m + (x i+1 x i ) ξ i : m N, (x i, ξ i ) S, i = 1,..., m}. i=0 The function f as a sup of affine, hence convex, functions is convex. It could be at a lot of places, but because S is cyclically monotone one has for all choices of (x 1, ξ 1 ),..., (x m, ξ m ) S, m 1 (x 0 x m ) ξ m + (x i+1 x i ) ξ i 0, i=0 thus f(x 0 ) 0. Selecting m = 1 and (x 1, ξ 1 ) = (x 0 ξ 0 ) we get an affine function that is 0 at x 0, thus f(x 0 ) = 0. Thus f is proper. The rest seems easy. To see that this function works we have to see that if (x, ξ) S then f(y) f(x) + (y x) ξ for all y R n (an inequality that automatically holds for y such that f(y) =, thus we could limit ourselves to y s such that f(y) < ). So let (x, ξ) S. In principle, we don t know yet that f(x) < so what we need to prove is: If α < f(x) then f(y) α + (y x) ξ y R n. This will prove it (and by restricting to y = x 0 proves f(x) < ). And the proof is now almost immediate, since by the definition of f, α < f(x) implies the existence of (x 1, ξ 1 ),..., (x m, ξ m ) S such that α < (x x m ) ξ m + (x m x m 1 ) ξ m (x 1 x 0 ) ξ 0. 6
7 On the other hand, since (x 1, ξ 1 ),..., (x m, ξ m ), (x, ξ) S, the definition of f(y) implies f(y) (y x) ξ+(x x m ) ξ m +(x m x m 1 ) ξ m 1 + +(x 1 x 0 ) ξ 0 > α+(y x) ξ. We are (i.e, Rockafellar is) done. In Singular integrals and differentiability properties of functions Stein proves the following theorem: Theorem ES. Let E R n, let U be open in R n and let f : U R be Lebesgue measurable. Then f is differentiable at almost every point of E if and only if the relation (7) f(x + y) f(x) = O( y ) as y 0 holds for almost every x E. It is, of course, not assumed that the constant appearing in the O above is uniform in x. (Chapter VIII, Theorem 3, page 250.) The proof is quite lengthy and uses a lot of results Stein developed previously. It has an immediate application to convex functions. Lemma 7 Let E be an open subset of R n and let f : E R be convex. Then f is differentiable a.e. Proof. Let x E. Since f is locally bounded, there is r > 0 and a constant C 0 such that if y x < r then y E and f(y) C. Assuming now 0 < y < r, let ω = ry/ y and let t = y /r (0, 1). Then x+y = (1 t)x+t(x+ω) so that by convexity f(x+y) f(x) (1 t)f(x)+tf(x+ω) f(x) = t(f(x+ω) f(x)) 2Ct = 2C r y. On the other hand, if ξ f(x), then f(x + y) f(x) ξ y ξ y. It follows that (7) holds for all x E; by Theorem ES f is a.e. differentiable. 7
g 2 (x) (1/3)M 1 = (1/3)(2/3)M.
COMPACTNESS If C R n is closed and bounded, then by B-W it is sequentially compact: any sequence of points in C has a subsequence converging to a point in C Conversely, any sequentially compact C R n is
More informationA NICE PROOF OF FARKAS LEMMA
A NICE PROOF OF FARKAS LEMMA DANIEL VICTOR TAUSK Abstract. The goal of this short note is to present a nice proof of Farkas Lemma which states that if C is the convex cone spanned by a finite set and if
More informationIntegral Jensen inequality
Integral Jensen inequality Let us consider a convex set R d, and a convex function f : (, + ]. For any x,..., x n and λ,..., λ n with n λ i =, we have () f( n λ ix i ) n λ if(x i ). For a R d, let δ a
More informationConvex Optimization Notes
Convex Optimization Notes Jonathan Siegel January 2017 1 Convex Analysis This section is devoted to the study of convex functions f : B R {+ } and convex sets U B, for B a Banach space. The case of B =
More informationConvex Analysis and Economic Theory AY Elementary properties of convex functions
Division of the Humanities and Social Sciences Ec 181 KC Border Convex Analysis and Economic Theory AY 2018 2019 Topic 6: Convex functions I 6.1 Elementary properties of convex functions We may occasionally
More informationOptimality Conditions for Nonsmooth Convex Optimization
Optimality Conditions for Nonsmooth Convex Optimization Sangkyun Lee Oct 22, 2014 Let us consider a convex function f : R n R, where R is the extended real field, R := R {, + }, which is proper (f never
More information3 Measurable Functions
3 Measurable Functions Notation A pair (X, F) where F is a σ-field of subsets of X is a measurable space. If µ is a measure on F then (X, F, µ) is a measure space. If µ(x) < then (X, F, µ) is a probability
More informationLecture 1: Background on Convex Analysis
Lecture 1: Background on Convex Analysis John Duchi PCMI 2016 Outline I Convex sets 1.1 Definitions and examples 2.2 Basic properties 3.3 Projections onto convex sets 4.4 Separating and supporting hyperplanes
More informationDivision of the Humanities and Social Sciences. Supergradients. KC Border Fall 2001 v ::15.45
Division of the Humanities and Social Sciences Supergradients KC Border Fall 2001 1 The supergradient of a concave function There is a useful way to characterize the concavity of differentiable functions.
More informationBASICS OF CONVEX ANALYSIS
BASICS OF CONVEX ANALYSIS MARKUS GRASMAIR 1. Main Definitions We start with providing the central definitions of convex functions and convex sets. Definition 1. A function f : R n R + } is called convex,
More informationLebesgue Integration: A non-rigorous introduction. What is wrong with Riemann integration?
Lebesgue Integration: A non-rigorous introduction What is wrong with Riemann integration? xample. Let f(x) = { 0 for x Q 1 for x / Q. The upper integral is 1, while the lower integral is 0. Yet, the function
More informationConvex Functions and Optimization
Chapter 5 Convex Functions and Optimization 5.1 Convex Functions Our next topic is that of convex functions. Again, we will concentrate on the context of a map f : R n R although the situation can be generalized
More informationOptimization and Optimal Control in Banach Spaces
Optimization and Optimal Control in Banach Spaces Bernhard Schmitzer October 19, 2017 1 Convex non-smooth optimization with proximal operators Remark 1.1 (Motivation). Convex optimization: easier to solve,
More informationA SET OF LECTURE NOTES ON CONVEX OPTIMIZATION WITH SOME APPLICATIONS TO PROBABILITY THEORY INCOMPLETE DRAFT. MAY 06
A SET OF LECTURE NOTES ON CONVEX OPTIMIZATION WITH SOME APPLICATIONS TO PROBABILITY THEORY INCOMPLETE DRAFT. MAY 06 CHRISTIAN LÉONARD Contents Preliminaries 1 1. Convexity without topology 1 2. Convexity
More informationConvex Geometry. Carsten Schütt
Convex Geometry Carsten Schütt November 25, 2006 2 Contents 0.1 Convex sets... 4 0.2 Separation.... 9 0.3 Extreme points..... 15 0.4 Blaschke selection principle... 18 0.5 Polytopes and polyhedra.... 23
More informationLocally convex spaces, the hyperplane separation theorem, and the Krein-Milman theorem
56 Chapter 7 Locally convex spaces, the hyperplane separation theorem, and the Krein-Milman theorem Recall that C(X) is not a normed linear space when X is not compact. On the other hand we could use semi
More informationSet, functions and Euclidean space. Seungjin Han
Set, functions and Euclidean space Seungjin Han September, 2018 1 Some Basics LOGIC A is necessary for B : If B holds, then A holds. B A A B is the contraposition of B A. A is sufficient for B: If A holds,
More informationExtreme points of compact convex sets
Extreme points of compact convex sets In this chapter, we are going to show that compact convex sets are determined by a proper subset, the set of its extreme points. Let us start with the main definition.
More information(convex combination!). Use convexity of f and multiply by the common denominator to get. Interchanging the role of x and y, we obtain that f is ( 2M ε
1. Continuity of convex functions in normed spaces In this chapter, we consider continuity properties of real-valued convex functions defined on open convex sets in normed spaces. Recall that every infinitedimensional
More informationChapter 2 Convex Analysis
Chapter 2 Convex Analysis The theory of nonsmooth analysis is based on convex analysis. Thus, we start this chapter by giving basic concepts and results of convexity (for further readings see also [202,
More information1 The Local-to-Global Lemma
Point-Set Topology Connectedness: Lecture 2 1 The Local-to-Global Lemma In the world of advanced mathematics, we are often interested in comparing the local properties of a space to its global properties.
More informationReview of Multi-Calculus (Study Guide for Spivak s CHAPTER ONE TO THREE)
Review of Multi-Calculus (Study Guide for Spivak s CHPTER ONE TO THREE) This material is for June 9 to 16 (Monday to Monday) Chapter I: Functions on R n Dot product and norm for vectors in R n : Let X
More informationL p Spaces and Convexity
L p Spaces and Convexity These notes largely follow the treatments in Royden, Real Analysis, and Rudin, Real & Complex Analysis. 1. Convex functions Let I R be an interval. For I open, we say a function
More information3 (Due ). Let A X consist of points (x, y) such that either x or y is a rational number. Is A measurable? What is its Lebesgue measure?
MA 645-4A (Real Analysis), Dr. Chernov Homework assignment 1 (Due ). Show that the open disk x 2 + y 2 < 1 is a countable union of planar elementary sets. Show that the closed disk x 2 + y 2 1 is a countable
More informationAppendix B Convex analysis
This version: 28/02/2014 Appendix B Convex analysis In this appendix we review a few basic notions of convexity and related notions that will be important for us at various times. B.1 The Hausdorff distance
More informationE. The Hahn-Banach Theorem
E. The Hahn-Banach Theorem This Appendix contains several technical results, that are extremely useful in Functional Analysis. The following terminology is useful in formulating the statements. Definitions.
More informationLecture 4 Lebesgue spaces and inequalities
Lecture 4: Lebesgue spaces and inequalities 1 of 10 Course: Theory of Probability I Term: Fall 2013 Instructor: Gordan Zitkovic Lecture 4 Lebesgue spaces and inequalities Lebesgue spaces We have seen how
More informationReal Analysis Notes. Thomas Goller
Real Analysis Notes Thomas Goller September 4, 2011 Contents 1 Abstract Measure Spaces 2 1.1 Basic Definitions........................... 2 1.2 Measurable Functions........................ 2 1.3 Integration..............................
More information1 Convexity, concavity and quasi-concavity. (SB )
UNIVERSITY OF MARYLAND ECON 600 Summer 2010 Lecture Two: Unconstrained Optimization 1 Convexity, concavity and quasi-concavity. (SB 21.1-21.3.) For any two points, x, y R n, we can trace out the line of
More informationUSING FUNCTIONAL ANALYSIS AND SOBOLEV SPACES TO SOLVE POISSON S EQUATION
USING FUNCTIONAL ANALYSIS AND SOBOLEV SPACES TO SOLVE POISSON S EQUATION YI WANG Abstract. We study Banach and Hilbert spaces with an eye towards defining weak solutions to elliptic PDE. Using Lax-Milgram
More informationMeasures. Chapter Some prerequisites. 1.2 Introduction
Lecture notes Course Analysis for PhD students Uppsala University, Spring 2018 Rostyslav Kozhan Chapter 1 Measures 1.1 Some prerequisites I will follow closely the textbook Real analysis: Modern Techniques
More informationCHAPTER 7. Connectedness
CHAPTER 7 Connectedness 7.1. Connected topological spaces Definition 7.1. A topological space (X, T X ) is said to be connected if there is no continuous surjection f : X {0, 1} where the two point set
More informationIntroduction and Preliminaries
Chapter 1 Introduction and Preliminaries This chapter serves two purposes. The first purpose is to prepare the readers for the more systematic development in later chapters of methods of real analysis
More informationMath 341: Convex Geometry. Xi Chen
Math 341: Convex Geometry Xi Chen 479 Central Academic Building, University of Alberta, Edmonton, Alberta T6G 2G1, CANADA E-mail address: xichen@math.ualberta.ca CHAPTER 1 Basics 1. Euclidean Geometry
More informationREAL VARIABLES: PROBLEM SET 1. = x limsup E k
REAL VARIABLES: PROBLEM SET 1 BEN ELDER 1. Problem 1.1a First let s prove that limsup E k consists of those points which belong to infinitely many E k. From equation 1.1: limsup E k = E k For limsup E
More informationAn introduction to some aspects of functional analysis
An introduction to some aspects of functional analysis Stephen Semmes Rice University Abstract These informal notes deal with some very basic objects in functional analysis, including norms and seminorms
More informationPROBLEMS. (b) (Polarization Identity) Show that in any inner product space
1 Professor Carl Cowen Math 54600 Fall 09 PROBLEMS 1. (Geometry in Inner Product Spaces) (a) (Parallelogram Law) Show that in any inner product space x + y 2 + x y 2 = 2( x 2 + y 2 ). (b) (Polarization
More informationChapter 2 Metric Spaces
Chapter 2 Metric Spaces The purpose of this chapter is to present a summary of some basic properties of metric and topological spaces that play an important role in the main body of the book. 2.1 Metrics
More informationConvex functions, subdifferentials, and the L.a.s.s.o.
Convex functions, subdifferentials, and the L.a.s.s.o. MATH 697 AM:ST September 26, 2017 Warmup Let us consider the absolute value function in R p u(x) = (x, x) = x 2 1 +... + x2 p Evidently, u is differentiable
More information1/12/05: sec 3.1 and my article: How good is the Lebesgue measure?, Math. Intelligencer 11(2) (1989),
Real Analysis 2, Math 651, Spring 2005 April 26, 2005 1 Real Analysis 2, Math 651, Spring 2005 Krzysztof Chris Ciesielski 1/12/05: sec 3.1 and my article: How good is the Lebesgue measure?, Math. Intelligencer
More information2. Dual space is essential for the concept of gradient which, in turn, leads to the variational analysis of Lagrange multipliers.
Chapter 3 Duality in Banach Space Modern optimization theory largely centers around the interplay of a normed vector space and its corresponding dual. The notion of duality is important for the following
More informationNOTES ON VECTOR-VALUED INTEGRATION MATH 581, SPRING 2017
NOTES ON VECTOR-VALUED INTEGRATION MATH 58, SPRING 207 Throughout, X will denote a Banach space. Definition 0.. Let ϕ(s) : X be a continuous function from a compact Jordan region R n to a Banach space
More informationarxiv:math/ v1 [math.fa] 4 Feb 1993
Lectures on Maximal Monotone Operators R. R. Phelps Dept. Math. GN 50, Univ. of Wash., Seattle WA 98195; phelps@math.washington.edu (Lectures given at Prague/Paseky Summer School, Czech Republic, August
More informationLecture Notes in Advanced Calculus 1 (80315) Raz Kupferman Institute of Mathematics The Hebrew University
Lecture Notes in Advanced Calculus 1 (80315) Raz Kupferman Institute of Mathematics The Hebrew University February 7, 2007 2 Contents 1 Metric Spaces 1 1.1 Basic definitions...........................
More informationGeometry and topology of continuous best and near best approximations
Journal of Approximation Theory 105: 252 262, Geometry and topology of continuous best and near best approximations Paul C. Kainen Dept. of Mathematics Georgetown University Washington, D.C. 20057 Věra
More informationSOLUTIONS TO SOME PROBLEMS
23 FUNCTIONAL ANALYSIS Spring 23 SOLUTIONS TO SOME PROBLEMS Warning:These solutions may contain errors!! PREPARED BY SULEYMAN ULUSOY PROBLEM 1. Prove that a necessary and sufficient condition that the
More information3. (a) What is a simple function? What is an integrable function? How is f dµ defined? Define it first
Math 632/6321: Theory of Functions of a Real Variable Sample Preinary Exam Questions 1. Let (, M, µ) be a measure space. (a) Prove that if µ() < and if 1 p < q
More informationIntroduction to Real Analysis Alternative Chapter 1
Christopher Heil Introduction to Real Analysis Alternative Chapter 1 A Primer on Norms and Banach Spaces Last Updated: March 10, 2018 c 2018 by Christopher Heil Chapter 1 A Primer on Norms and Banach Spaces
More informationOn duality theory of conic linear problems
On duality theory of conic linear problems Alexander Shapiro School of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta, Georgia 3332-25, USA e-mail: ashapiro@isye.gatech.edu
More informationLECTURE 15: COMPLETENESS AND CONVEXITY
LECTURE 15: COMPLETENESS AND CONVEXITY 1. The Hopf-Rinow Theorem Recall that a Riemannian manifold (M, g) is called geodesically complete if the maximal defining interval of any geodesic is R. On the other
More informationON SPACE-FILLING CURVES AND THE HAHN-MAZURKIEWICZ THEOREM
ON SPACE-FILLING CURVES AND THE HAHN-MAZURKIEWICZ THEOREM ALEXANDER KUPERS Abstract. These are notes on space-filling curves, looking at a few examples and proving the Hahn-Mazurkiewicz theorem. This theorem
More informationIntroduction to Convex Analysis Microeconomics II - Tutoring Class
Introduction to Convex Analysis Microeconomics II - Tutoring Class Professor: V. Filipe Martins-da-Rocha TA: Cinthia Konichi April 2010 1 Basic Concepts and Results This is a first glance on basic convex
More informationFunctional Analysis I
Functional Analysis I Course Notes by Stefan Richter Transcribed and Annotated by Gregory Zitelli Polar Decomposition Definition. An operator W B(H) is called a partial isometry if W x = X for all x (ker
More informationSECOND-ORDER CHARACTERIZATIONS OF CONVEX AND PSEUDOCONVEX FUNCTIONS
Journal of Applied Analysis Vol. 9, No. 2 (2003), pp. 261 273 SECOND-ORDER CHARACTERIZATIONS OF CONVEX AND PSEUDOCONVEX FUNCTIONS I. GINCHEV and V. I. IVANOV Received June 16, 2002 and, in revised form,
More informationThe local equicontinuity of a maximal monotone operator
arxiv:1410.3328v2 [math.fa] 3 Nov 2014 The local equicontinuity of a maximal monotone operator M.D. Voisei Abstract The local equicontinuity of an operator T : X X with proper Fitzpatrick function ϕ T
More information1 Topology Definition of a topology Basis (Base) of a topology The subspace topology & the product topology on X Y 3
Index Page 1 Topology 2 1.1 Definition of a topology 2 1.2 Basis (Base) of a topology 2 1.3 The subspace topology & the product topology on X Y 3 1.4 Basic topology concepts: limit points, closed sets,
More informationConvex Analysis and Economic Theory Winter 2018
Division of the Humanities and Social Sciences Ec 181 KC Border Convex Analysis and Economic Theory Winter 2018 Supplement A: Mathematical background A.1 Extended real numbers The extended real number
More informationOverview of normed linear spaces
20 Chapter 2 Overview of normed linear spaces Starting from this chapter, we begin examining linear spaces with at least one extra structure (topology or geometry). We assume linearity; this is a natural
More informationContinuity of convex functions in normed spaces
Continuity of convex functions in normed spaces In this chapter, we consider continuity properties of real-valued convex functions defined on open convex sets in normed spaces. Recall that every infinitedimensional
More informationMath 209B Homework 2
Math 29B Homework 2 Edward Burkard Note: All vector spaces are over the field F = R or C 4.6. Two Compactness Theorems. 4. Point Set Topology Exercise 6 The product of countably many sequentally compact
More informationBodies of constant width in arbitrary dimension
Bodies of constant width in arbitrary dimension Thomas Lachand-Robert, Edouard Oudet To cite this version: Thomas Lachand-Robert, Edouard Oudet. Bodies of constant width in arbitrary dimension. Mathematische
More informationAnalysis Comprehensive Exam Questions Fall 2008
Analysis Comprehensive xam Questions Fall 28. (a) Let R be measurable with finite Lebesgue measure. Suppose that {f n } n N is a bounded sequence in L 2 () and there exists a function f such that f n (x)
More informationMATHS 730 FC Lecture Notes March 5, Introduction
1 INTRODUCTION MATHS 730 FC Lecture Notes March 5, 2014 1 Introduction Definition. If A, B are sets and there exists a bijection A B, they have the same cardinality, which we write as A, #A. If there exists
More informationDef. A topological space X is disconnected if it admits a non-trivial splitting: (We ll abbreviate disjoint union of two subsets A and B meaning A B =
CONNECTEDNESS-Notes Def. A topological space X is disconnected if it admits a non-trivial splitting: X = A B, A B =, A, B open in X, and non-empty. (We ll abbreviate disjoint union of two subsets A and
More informationOptimality Conditions for Constrained Optimization
72 CHAPTER 7 Optimality Conditions for Constrained Optimization 1. First Order Conditions In this section we consider first order optimality conditions for the constrained problem P : minimize f 0 (x)
More informationU e = E (U\E) e E e + U\E e. (1.6)
12 1 Lebesgue Measure 1.2 Lebesgue Measure In Section 1.1 we defined the exterior Lebesgue measure of every subset of R d. Unfortunately, a major disadvantage of exterior measure is that it does not satisfy
More informationSemicontinuous functions and convexity
Semicontinuous functions and convexity Jordan Bell jordan.bell@gmail.com Department of Mathematics, University of Toronto April 3, 2014 1 Lattices If (A, ) is a partially ordered set and S is a subset
More informationChapter 1. Measure Spaces. 1.1 Algebras and σ algebras of sets Notation and preliminaries
Chapter 1 Measure Spaces 1.1 Algebras and σ algebras of sets 1.1.1 Notation and preliminaries We shall denote by X a nonempty set, by P(X) the set of all parts (i.e., subsets) of X, and by the empty set.
More informationSubgradients. subgradients and quasigradients. subgradient calculus. optimality conditions via subgradients. directional derivatives
Subgradients subgradients and quasigradients subgradient calculus optimality conditions via subgradients directional derivatives Prof. S. Boyd, EE392o, Stanford University Basic inequality recall basic
More informationChapter 1. Optimality Conditions: Unconstrained Optimization. 1.1 Differentiable Problems
Chapter 1 Optimality Conditions: Unconstrained Optimization 1.1 Differentiable Problems Consider the problem of minimizing the function f : R n R where f is twice continuously differentiable on R n : P
More informationMeasure Theory on Topological Spaces. Course: Prof. Tony Dorlas 2010 Typset: Cathal Ormond
Measure Theory on Topological Spaces Course: Prof. Tony Dorlas 2010 Typset: Cathal Ormond May 22, 2011 Contents 1 Introduction 2 1.1 The Riemann Integral........................................ 2 1.2 Measurable..............................................
More informationREAL ANALYSIS I HOMEWORK 4
REAL ANALYSIS I HOMEWORK 4 CİHAN BAHRAN The questions are from Stein and Shakarchi s text, Chapter 2.. Given a collection of sets E, E 2,..., E n, construct another collection E, E 2,..., E N, with N =
More information2 (Bonus). Let A X consist of points (x, y) such that either x or y is a rational number. Is A measurable? What is its Lebesgue measure?
MA 645-4A (Real Analysis), Dr. Chernov Homework assignment 1 (Due 9/5). Prove that every countable set A is measurable and µ(a) = 0. 2 (Bonus). Let A consist of points (x, y) such that either x or y is
More informationDiscrete Geometry. Problem 1. Austin Mohr. April 26, 2012
Discrete Geometry Austin Mohr April 26, 2012 Problem 1 Theorem 1 (Linear Programming Duality). Suppose x, y, b, c R n and A R n n, Ax b, x 0, A T y c, and y 0. If x maximizes c T x and y minimizes b T
More informationJ. Banasiak Department of Mathematics and Applied Mathematics University of Pretoria, Pretoria, South Africa BANACH LATTICES IN APPLICATIONS
J. Banasiak Department of Mathematics and Applied Mathematics University of Pretoria, Pretoria, South Africa BANACH LATTICES IN APPLICATIONS Contents 1 Introduction.........................................................................
More informationChapter 1. Preliminaries. The purpose of this chapter is to provide some basic background information. Linear Space. Hilbert Space.
Chapter 1 Preliminaries The purpose of this chapter is to provide some basic background information. Linear Space Hilbert Space Basic Principles 1 2 Preliminaries Linear Space The notion of linear space
More informationNormed Vector Spaces and Double Duals
Normed Vector Spaces and Double Duals Mathematics 481/525 In this note we look at a number of infinite-dimensional R-vector spaces that arise in analysis, and we consider their dual and double dual spaces
More informationFUNCTIONAL ANALYSIS-NORMED SPACE
MAT641- MSC Mathematics, MNIT Jaipur FUNCTIONAL ANALYSIS-NORMED SPACE DR. RITU AGARWAL MALAVIYA NATIONAL INSTITUTE OF TECHNOLOGY JAIPUR 1. Normed space Norm generalizes the concept of length in an arbitrary
More informationTools from Lebesgue integration
Tools from Lebesgue integration E.P. van den Ban Fall 2005 Introduction In these notes we describe some of the basic tools from the theory of Lebesgue integration. Definitions and results will be given
More informationConstraint qualifications for convex inequality systems with applications in constrained optimization
Constraint qualifications for convex inequality systems with applications in constrained optimization Chong Li, K. F. Ng and T. K. Pong Abstract. For an inequality system defined by an infinite family
More informationWhitney s Extension Problem for C m
Whitney s Extension Problem for C m by Charles Fefferman Department of Mathematics Princeton University Fine Hall Washington Road Princeton, New Jersey 08544 Email: cf@math.princeton.edu Supported by Grant
More informationCombinatorics in Banach space theory Lecture 12
Combinatorics in Banach space theory Lecture The next lemma considerably strengthens the assertion of Lemma.6(b). Lemma.9. For every Banach space X and any n N, either all the numbers n b n (X), c n (X)
More informationReal Analysis, 2nd Edition, G.B.Folland Elements of Functional Analysis
Real Analysis, 2nd Edition, G.B.Folland Chapter 5 Elements of Functional Analysis Yung-Hsiang Huang 5.1 Normed Vector Spaces 1. Note for any x, y X and a, b K, x+y x + y and by ax b y x + b a x. 2. It
More informationNotes for Functional Analysis
Notes for Functional Analysis Wang Zuoqin (typed by Xiyu Zhai) September 29, 2015 1 Lecture 09 1.1 Equicontinuity First let s recall the conception of equicontinuity for family of functions that we learned
More informationIntroduction to Convex and Quasiconvex Analysis
Introduction to Convex and Quasiconvex Analysis J.B.G.Frenk Econometric Institute, Erasmus University, Rotterdam G.Kassay Faculty of Mathematics, Babes Bolyai University, Cluj August 27, 2001 Abstract
More informationNormed and Banach spaces
Normed and Banach spaces László Erdős Nov 11, 2006 1 Norms We recall that the norm is a function on a vectorspace V, : V R +, satisfying the following properties x + y x + y cx = c x x = 0 x = 0 We always
More information1. Bounded linear maps. A linear map T : E F of real Banach
DIFFERENTIABLE MAPS 1. Bounded linear maps. A linear map T : E F of real Banach spaces E, F is bounded if M > 0 so that for all v E: T v M v. If v r T v C for some positive constants r, C, then T is bounded:
More informationThe small ball property in Banach spaces (quantitative results)
The small ball property in Banach spaces (quantitative results) Ehrhard Behrends Abstract A metric space (M, d) is said to have the small ball property (sbp) if for every ε 0 > 0 there exists a sequence
More information(c) For each α R \ {0}, the mapping x αx is a homeomorphism of X.
A short account of topological vector spaces Normed spaces, and especially Banach spaces, are basic ambient spaces in Infinite- Dimensional Analysis. However, there are situations in which it is necessary
More informationElements of Convex Optimization Theory
Elements of Convex Optimization Theory Costis Skiadas August 2015 This is a revised and extended version of Appendix A of Skiadas (2009), providing a self-contained overview of elements of convex optimization
More informationLocal strong convexity and local Lipschitz continuity of the gradient of convex functions
Local strong convexity and local Lipschitz continuity of the gradient of convex functions R. Goebel and R.T. Rockafellar May 23, 2007 Abstract. Given a pair of convex conjugate functions f and f, we investigate
More informationANALYSIS QUALIFYING EXAM FALL 2017: SOLUTIONS. 1 cos(nx) lim. n 2 x 2. g n (x) = 1 cos(nx) n 2 x 2. x 2.
ANALYSIS QUALIFYING EXAM FALL 27: SOLUTIONS Problem. Determine, with justification, the it cos(nx) n 2 x 2 dx. Solution. For an integer n >, define g n : (, ) R by Also define g : (, ) R by g(x) = g n
More informationMATH 51H Section 4. October 16, Recall what it means for a function between metric spaces to be continuous:
MATH 51H Section 4 October 16, 2015 1 Continuity Recall what it means for a function between metric spaces to be continuous: Definition. Let (X, d X ), (Y, d Y ) be metric spaces. A function f : X Y is
More information(x k ) sequence in F, lim x k = x x F. If F : R n R is a function, level sets and sublevel sets of F are any sets of the form (respectively);
STABILITY OF EQUILIBRIA AND LIAPUNOV FUNCTIONS. By topological properties in general we mean qualitative geometric properties (of subsets of R n or of functions in R n ), that is, those that don t depend
More informationNotions such as convergent sequence and Cauchy sequence make sense for any metric space. Convergent Sequences are Cauchy
Banach Spaces These notes provide an introduction to Banach spaces, which are complete normed vector spaces. For the purposes of these notes, all vector spaces are assumed to be over the real numbers.
More informationTranslative Sets and Functions and their Applications to Risk Measure Theory and Nonlinear Separation
Translative Sets and Functions and their Applications to Risk Measure Theory and Nonlinear Separation Andreas H. Hamel Abstract Recently defined concepts such as nonlinear separation functionals due to
More informationMATH MEASURE THEORY AND FOURIER ANALYSIS. Contents
MATH 3969 - MEASURE THEORY AND FOURIER ANALYSIS ANDREW TULLOCH Contents 1. Measure Theory 2 1.1. Properties of Measures 3 1.2. Constructing σ-algebras and measures 3 1.3. Properties of the Lebesgue measure
More informationVISCOSITY SOLUTIONS. We follow Han and Lin, Elliptic Partial Differential Equations, 5.
VISCOSITY SOLUTIONS PETER HINTZ We follow Han and Lin, Elliptic Partial Differential Equations, 5. 1. Motivation Throughout, we will assume that Ω R n is a bounded and connected domain and that a ij C(Ω)
More information2 Measure Theory. 2.1 Measures
2 Measure Theory 2.1 Measures A lot of this exposition is motivated by Folland s wonderful text, Real Analysis: Modern Techniques and Their Applications. Perhaps the most ubiquitous measure in our lives
More informationProblem Set 2: Solutions Math 201A: Fall 2016
Problem Set 2: s Math 201A: Fall 2016 Problem 1. (a) Prove that a closed subset of a complete metric space is complete. (b) Prove that a closed subset of a compact metric space is compact. (c) Prove that
More information