Lecture 7 Monotonicity. September 21, 2008
|
|
- Cory Logan
- 5 years ago
- Views:
Transcription
1 Lecture 7 Monotonicity September 21, 2008
2 Outline Introduce several monotonicity properties of vector functions Are satisfied immediately by gradient maps of convex functions In a sense, role of monotonicity in VI/CPs is similar that of convexity in optimization Game theory: Models, Algorithms and Applications 1
3 Focus Motivation from convex optimization and game theoretic problems Definition of monotone mappings and their variants Existence of solutions and convexity of solution sets Convex programming - a special case Game theory: Models, Algorithms and Applications 2
4 Monotone functions Definition 1 Given a set K R n, a mapping F : K R n is said to be (a) pseudo-monotone on K if for all vectors x, y K (x y) T F (y) 0 = (x y) T F (x) 0; (b) monotone on K if for all vectors x, y K (x y) T (F (x) F (y)) 0 (c) strictly monotone on K if for all vectors x, y K, x y (x y) T (F (x) F (y)) > 0 Game theory: Models, Algorithms and Applications 3
5 (d) ξ-monotone on K for some ξ > 1 if there exists a c > 0 such that for all x, y K (x y) T (F (x) F (y)) > c x y ξ (e) strongly monotone (or 2-monotone) on K if there exists a c > 0 such that for all x, y K (x y) T (F (x) F (y)) > c x y 2 Game theory: Models, Algorithms and Applications 4
6 Relationships strongly-monotone = ξ monotone = strictly-monotone = monotone monotone = pseudo-monotone. In addition, for an affine map, F (x) Ax + b and K R n, we have strongly-monotone ξ monotone strictly-monotone A 0 monotonicity A 0 Game theory: Models, Algorithms and Applications 5
7 Vector Mappings and their Jacobians More generally, if F C 1 on an open convex set D, then the following proposition holds: Proposition 1 Let D R n be an open convex set, and let F : D R n be a continuously differentiable function on D. Then the following hold: (a) F is monotone on D if and only if F (x) is positive semidefinite for all x D. (b) F is strictly monotone on D if and only if F (x) is positive definite for all x D. (c) F is strongly monotone on D if and only if F (x) is uniformly positive definite over D, i.e., there exists a c > 0 such that for all x D y T F (x)y c y 2, for all y R n. Proof: Homework. Game theory: Models, Algorithms and Applications 6
8 Why are monotone mappings important? Arise from important classes of optimization/game-theoretic problems Can articulate existence/uniqueness statements for such problems Convergence properties of algorithms may sometimes (but not always) be restricted to such monotone problems Game theory: Models, Algorithms and Applications 7
9 Convex programming problems Consider the optimization problem given by min x θ(x) x K, where K R n is a closed convex set, and θ : D R is a twice-continuously differentiable convex function on an open superset set D of the set K. An optimizer of this problem is given by the solution to VI(K, θ), i.e., x K such that (y x) T θ(x), y K. When θ( ) is a convex function, 2 θ(x) is positive semidefinite everywhere, implying that θ is a monotone vector mapping Therefore VI(K, θ) is a monotone VI NOTE: This is true even when θ is convex and differentiable Game theory: Models, Algorithms and Applications 8
10 Game-theoretic Problems Consider the game-theoretic problem given by agent problems: S i (x i ) min x i θ i (x i ; x i ) x i K i. Proposition 2 Let K i be closed and convex sets, and let θ i be convex and C 1. Then x is a Nash equilibrium if and only if x SOL(K, F ), where K = Π n i=1 K i and F(x) := ( θ i (x)) n i=1. K is a Cartesian product of K i and is also closed and convex Game theory: Models, Algorithms and Applications 9
11 Existence of solutions to monotone VIs Theorem 3 Let K R n be closed convex and F : K R n be continuous. (a) If F is strictly monotone on K, the VI(K, F ) has at most one solution. (b) If F is ξ monotone on K, the VI(K, F ) has a unique solution. (c) If F is Lipschitz continuous and ξ monotone on Ω for some ξ > 1, where K Ω, then there exists a c > 0 such that x x c F nat K (x) 1 ξ 1 for every x Ω, where x is the unique solution to the VI(K, F ). Result in (c) provides an upper bound on the distance from the solution Game theory: Models, Algorithms and Applications 10
12 Proof: (a) Suppose F is strictly monotone on K. VI(K, F ). Then for all y K, we have Let x, x be two solutions to (y x) T F (x) 0 (y x ) T F (x ) 0. But by substituting x and x for y in first and second expressions, we obtain (x x) T F (x) 0 (x x ) T F (x ) 0. But by adding these inequalities, we obtain (x x) T (F (x ) F (x)) 0, contradicting the strict monotonicity of F. Game theory: Models, Algorithms and Applications 11
13 (b) If F is ξ monotone, we merely need to show that VI(K, F ) has a solution. Its uniqueness follows from F being strictly monotone. For any ξ monotone mapping with ξ > 1, by definition there exists a c > 0 such that x, y K (x y) T (F (x) F (y)) c x y ξ For a fixed y K, it follows that F (x) T (x y) F (y)t (x y) x y ξ + c x ξ x ξ x ξ By letting x with x K, since ξ > 1, it follows lim inf x K x F (x) T (x y) x ξ c > 0. Game theory: Models, Algorithms and Applications 12
14 The existence is now immediate from the following result: Theorem 4 (Corollary from FP(I)) Let K R n be a closed convex set and let F : R n R n be continuous. If there exists an x ref K and a scalar ζ 0 such that lim inf x K, x F (x) T (x x ref ) x ζ > 0, (1) then the VI(K,F) has a nonempty compact solution set. A seen, F satisfies (1) with x ref = y for an arbitrary y K and ζ = ξ. Game theory: Models, Algorithms and Applications 13
15 (c) Let x K be the solution and c > 0 be the constant in ξ-monotonicity For a given x Ω, we define r F nat K (x). Then we have x r = Π K (x F (x)) = (y x + r) T (F (x) r) 0, y K with y = x, we have (x x + r) T (F (x) r) 0 Since x SOL(K, F ) and x r K, it follows (x r x ) T F (x ) 0 By adding the last two inequalities (after some algebra), we obtain (x x ) T (F (x) F (x )) r T (F (x) F (x )). Game theory: Models, Algorithms and Applications 14
16 The ξ monotonicity and Lipschitz continuity (with constant L > 0) of F implies that c x x ξ (x x ) T (F (x) F (x )) L r x x x x ξ 1 L r c x x c r ξ 1, 1 where c = ( L c ) 1 ξ 1. Generally, strict monotonicity is not sufficient to have a solution Example : real line. Consider the equation e x = 0 which has no zero on the Game theory: Models, Algorithms and Applications 15
17 Theorem 5 (Theorem of FP I) Let K R n be closed and convex, and F : K R n be continuous. If F is pseudo-monotone on K, then the three statements (a), (b), (c) of the main result of Lecture 6 are equivalent Proof: It suffices to show that (c) = (a), i.e., that the existence of solution to V I(K, F ) implies that, for some x ref K the set L < is bounded. In particular, we will show that the existence of solution to V I(K, F ) implies that the set L < = {x K F (x) T (x x ref ) < 0} is empty for some x ref K. Consider a solution x, and the set L < = {x K F (x) T (x x ) < 0}. Game theory: Models, Algorithms and Applications 16
18 Since x is solution, we have (x x ) T F (x ) 0 for all x K. By pseudo-monotonicity, it follows that (x x ) T F (x) 0 for all x K, implying that the set L < is empty. Game theory: Models, Algorithms and Applications 17
19 Convexity of solution set Next set of results: Solution set of pseudo-monotone VI is always convex Sufficient condition for such a VI to have a nonempty bounded solution set Need to define recession cones: Definition 2 A recession direction of a set X is a direction d such that for some vector x X, the ray {x + τd : τ 0} is contained in X. The set of all recession directions is denoted by X and called the recession cone of X. Game theory: Models, Algorithms and Applications 18
20 Instances of X If there is a nonzero w with w X, then X is unbounded If X is polyhedral, i.e., X = {x : Ax b}, then X = {d R n : Ad 0}. Theorem 6 Let K R n be a closed convex set and F : K R n be a continuous mapping. Also, let F be pseudo-monotone on K. Then the following hold: (a) The solution set SOL(K, F ) is convex. (b) If there exists a vector x ref K such that F (x ref ) belongs to the interior of the dual cone to K, i.e., F (x ref ) int(k ), then SOL(K, F ) is nonempty and compact. Game theory: Models, Algorithms and Applications 19
21 Proof: (a) Let F be pseudo monotone on K. We claim that the solution set SOL(K, F ) has the following structure: SOL(K, F ) = y K {x K : F (y) T (y x) 0}. (2) We prove this statement by showing that a vector in one of the sets lies in the other. Let x SOL(K, F ). Then, we have (y x ) T F (x ) 0 y K. By the pseudo-monotonicity of F on K, we have F (y) T (y x ) 0, y K, implying that x y K {x K : F (y) T (y x) 0.} Game theory: Models, Algorithms and Applications 20
22 Suppose x y K {x K : F (y) T (y x) 0}. Let z K be arbitrary. Define y = τx + (1 τ)z. By convexity of K, y belongs to K for all τ [0, 1]. Then we have F (y) T (y x ) 0 F (τx + (1 τ)z) T (z x ) 0. Letting τ 1, we have F (x ) T (z x ) 0, z K. Hence x SOL(K, F ). For a fixed, but arbitrary y K, the set {x K : F (y) T (y x) 0} Game theory: Models, Algorithms and Applications 21
23 is closed and convex. The intersection of any number of convex sets is convex, giving us convexity of SOL(K, F ). (b) We will show that the given property implies that the set L = {x K F (x) T (x x ref ) 0} is bounded. Then, the nonemptyness and compactness of SOL(K, F ) follows from Prop from FP(I) [main result of Lecture 6]. By the pseudo-monotonicity of F on K, we have that F (x ref ) T (x x ref ) 0 x L Hence, L {x K F (x ref ) T (x x ref ) 0} L, where the set L is closed and convex. Suppose that L is unbounded, then since L K, K is also unbounded. Thus, there exists a nonzero recession direction d K. For such a direction, we have F (x ref ) T d 0. Game theory: Models, Algorithms and Applications 22
24 By the given property, we have F (x ref ) int(k ). Therefore, there exists a small enough δ > 0 such that F (x ref ) δd (K ). Hence 0 d T (F (x ref ) δd) δd T d < 0. The contradiction implies that K is bounded and since L K, we see that L is bounded. Game theory: Models, Algorithms and Applications 23
25 Additional Properties of Solutions for Pseudo-Monotone VI s Proposition 7 [FP-I, Prop 2.3.6] Let F : K R n be pseudo-monotone on a convex set K R n. For any two solutions x 1 and x 2 in SOL(K,F), we have (x 1 x 2 ) T F (x 1 ) = (x 1 x 2 ) T F (x 2 ) = 0. Consequently (x 1 x 2 ) T (F (x 1 ) F (x 2 )) = 0. In addition, F (SOL(K, F )) (SOL(K, F ) ). Proposition 8 [FP-I, Cor 2.3.7] Let K R n be closed convex and let F : D R n be continuously differentiable on the open set D, where K D. If F is monotone on K and F (x) is symmetric for all x K, then F(SOL(K,F)) is a singleton. If x SOL(K, F ) and d (SOL(K, F )) ), then x + d SOL(K, F ). Game theory: Models, Algorithms and Applications 24
26 Application to Convex Optimization Consider the convex problem given by min θ(x) subject to x K, where θ : D R is a twice-continuously differentiable convex function on a closed convex set K R n. Proposition 9 Let K R n be a closed convex set and θ C 2 defined on an open convex set D containing K. If S opt, then for any x S opt, S opt = {x K : θ(x) = θ( x), θ( x) T (x x) = 0}. Game theory: Models, Algorithms and Applications 25
27 Proof: Let S denote {x K : θ(x) = θ( x), θ( x) T (x x) = 0}. We show that S opt S by using Propositions 7 and 8. Since θ( ) is convex, 2 θ is positive-semidefinite over K. Therefore θ is monotone over K and the problem may be cast as VI(K,F), with F monotone, and K closed and convex. By Proposition 7, we have for any two solutions of the problem ˆx and x, (ˆx x) T θ( x) = (ˆx x) T θ(x) = 0 (ˆx x) T ( θ(ˆx) θ( x)) = 0. To claim θ(ˆx) = θ( x), we invoke Proposition 8 with F = θ, which claims that F(SOL(K,F)) is a singleton. Hence θ(ˆx) = θ( x), implying ˆx S. We now show that S S opt. Let x S be arbitrary. Game theory: Models, Algorithms and Applications 26
28 By the convexity of θ at some x S opt, we have by the gradient inequality θ( x) θ(x) ( x x) T θ(x). Since x S, we have θ(x) = θ( x) and θ( x) T (x x) = 0, implying that θ( x) θ(x) ( x x) T ( x) = 0. Therefore, θ(x) θ( x) but x is optimal solution, i.e., θ( x) θ(y) for all y K. Hence, θ(x) = θ( x), showing that x S opt. Game theory: Models, Algorithms and Applications 27
Lecture 8 Plus properties, merit functions and gap functions. September 28, 2008
Lecture 8 Plus properties, merit functions and gap functions September 28, 2008 Outline Plus-properties and F-uniqueness Equation reformulations of VI/CPs Merit functions Gap merit functions FP-I book:
More informationLecture 9 Monotone VIs/CPs Properties of cones and some existence results. October 6, 2008
Lecture 9 Monotone VIs/CPs Properties of cones and some existence results October 6, 2008 Outline Properties of cones Existence results for monotone CPs/VIs Polyhedrality of solution sets Game theory:
More informationConvex Optimization Theory. Chapter 5 Exercises and Solutions: Extended Version
Convex Optimization Theory Chapter 5 Exercises and Solutions: Extended Version Dimitri P. Bertsekas Massachusetts Institute of Technology Athena Scientific, Belmont, Massachusetts http://www.athenasc.com
More information1 Review of last lecture and introduction
Semidefinite Programming Lecture 10 OR 637 Spring 2008 April 16, 2008 (Wednesday) Instructor: Michael Jeremy Todd Scribe: Yogeshwer (Yogi) Sharma 1 Review of last lecture and introduction Let us first
More informationSWFR ENG 4TE3 (6TE3) COMP SCI 4TE3 (6TE3) Continuous Optimization Algorithm. Convex Optimization. Computing and Software McMaster University
SWFR ENG 4TE3 (6TE3) COMP SCI 4TE3 (6TE3) Continuous Optimization Algorithm Convex Optimization Computing and Software McMaster University General NLO problem (NLO : Non Linear Optimization) (N LO) min
More informationLecture 19 Algorithms for VIs KKT Conditions-based Ideas. November 16, 2008
Lecture 19 Algorithms for VIs KKT Conditions-based Ideas November 16, 2008 Outline for solution of VIs Algorithms for general VIs Two basic approaches: First approach reformulates (and solves) the KKT
More information6.254 : Game Theory with Engineering Applications Lecture 7: Supermodular Games
6.254 : Game Theory with Engineering Applications Lecture 7: Asu Ozdaglar MIT February 25, 2010 1 Introduction Outline Uniqueness of a Pure Nash Equilibrium for Continuous Games Reading: Rosen J.B., Existence
More informationConvex Analysis and Optimization Chapter 2 Solutions
Convex Analysis and Optimization Chapter 2 Solutions Dimitri P. Bertsekas with Angelia Nedić and Asuman E. Ozdaglar Massachusetts Institute of Technology Athena Scientific, Belmont, Massachusetts http://www.athenasc.com
More informationEC9A0: Pre-sessional Advanced Mathematics Course. Lecture Notes: Unconstrained Optimisation By Pablo F. Beker 1
EC9A0: Pre-sessional Advanced Mathematics Course Lecture Notes: Unconstrained Optimisation By Pablo F. Beker 1 1 Infimum and Supremum Definition 1. Fix a set Y R. A number α R is an upper bound of Y if
More informationLecture 13 Newton-type Methods A Newton Method for VIs. October 20, 2008
Lecture 13 Newton-type Methods A Newton Method for VIs October 20, 2008 Outline Quick recap of Newton methods for composite functions Josephy-Newton methods for VIs A special case: mixed complementarity
More informationLecture 8. Strong Duality Results. September 22, 2008
Strong Duality Results September 22, 2008 Outline Lecture 8 Slater Condition and its Variations Convex Objective with Linear Inequality Constraints Quadratic Objective over Quadratic Constraints Representation
More informationDivision of the Humanities and Social Sciences. Supergradients. KC Border Fall 2001 v ::15.45
Division of the Humanities and Social Sciences Supergradients KC Border Fall 2001 1 The supergradient of a concave function There is a useful way to characterize the concavity of differentiable functions.
More informationSome Properties of the Augmented Lagrangian in Cone Constrained Optimization
MATHEMATICS OF OPERATIONS RESEARCH Vol. 29, No. 3, August 2004, pp. 479 491 issn 0364-765X eissn 1526-5471 04 2903 0479 informs doi 10.1287/moor.1040.0103 2004 INFORMS Some Properties of the Augmented
More informationGame theory: Models, Algorithms and Applications Lecture 4 Part II Geometry of the LCP. September 10, 2008
Game theory: Models, Algorithms and Applications Lecture 4 Part II Geometry of the LCP September 10, 2008 Geometry of the Complementarity Problem Definition 1 The set pos(a) generated by A R m p represents
More informationChapter 2: Preliminaries and elements of convex analysis
Chapter 2: Preliminaries and elements of convex analysis Edoardo Amaldi DEIB Politecnico di Milano edoardo.amaldi@polimi.it Website: http://home.deib.polimi.it/amaldi/opt-14-15.shtml Academic year 2014-15
More informationSOME STABILITY RESULTS FOR THE SEMI-AFFINE VARIATIONAL INEQUALITY PROBLEM. 1. Introduction
ACTA MATHEMATICA VIETNAMICA 271 Volume 29, Number 3, 2004, pp. 271-280 SOME STABILITY RESULTS FOR THE SEMI-AFFINE VARIATIONAL INEQUALITY PROBLEM NGUYEN NANG TAM Abstract. This paper establishes two theorems
More informationOptimization and Optimal Control in Banach Spaces
Optimization and Optimal Control in Banach Spaces Bernhard Schmitzer October 19, 2017 1 Convex non-smooth optimization with proximal operators Remark 1.1 (Motivation). Convex optimization: easier to solve,
More informationDO NOT OPEN THIS QUESTION BOOKLET UNTIL YOU ARE TOLD TO DO SO
QUESTION BOOKLET EECS 227A Fall 2009 Midterm Tuesday, Ocotober 20, 11:10-12:30pm DO NOT OPEN THIS QUESTION BOOKLET UNTIL YOU ARE TOLD TO DO SO You have 80 minutes to complete the midterm. The midterm consists
More informationSummer School: Semidefinite Optimization
Summer School: Semidefinite Optimization Christine Bachoc Université Bordeaux I, IMB Research Training Group Experimental and Constructive Algebra Haus Karrenberg, Sept. 3 - Sept. 7, 2012 Duality Theory
More information1 Directional Derivatives and Differentiability
Wednesday, January 18, 2012 1 Directional Derivatives and Differentiability Let E R N, let f : E R and let x 0 E. Given a direction v R N, let L be the line through x 0 in the direction v, that is, L :=
More informationMidterm 1. Every element of the set of functions is continuous
Econ 200 Mathematics for Economists Midterm Question.- Consider the set of functions F C(0, ) dened by { } F = f C(0, ) f(x) = ax b, a A R and b B R That is, F is a subset of the set of continuous functions
More informationTopology, Math 581, Fall 2017 last updated: November 24, Topology 1, Math 581, Fall 2017: Notes and homework Krzysztof Chris Ciesielski
Topology, Math 581, Fall 2017 last updated: November 24, 2017 1 Topology 1, Math 581, Fall 2017: Notes and homework Krzysztof Chris Ciesielski Class of August 17: Course and syllabus overview. Topology
More informationDivision of the Humanities and Social Sciences. Sums of sets, etc.
Division of the Humanities and Social Sciences Sums of sets, etc. KC Border September 2002 Rev. November 2012 Rev. September 2013 If E and F are subsets of R m, define the sum E + F = {x + y : x E; y F
More informationCourse Notes for EE227C (Spring 2018): Convex Optimization and Approximation
Course Notes for EE7C (Spring 018): Convex Optimization and Approximation Instructor: Moritz Hardt Email: hardt+ee7c@berkeley.edu Graduate Instructor: Max Simchowitz Email: msimchow+ee7c@berkeley.edu February
More informationChapter 1. Preliminaries
Introduction This dissertation is a reading of chapter 4 in part I of the book : Integer and Combinatorial Optimization by George L. Nemhauser & Laurence A. Wolsey. The chapter elaborates links between
More informationOn duality theory of conic linear problems
On duality theory of conic linear problems Alexander Shapiro School of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta, Georgia 3332-25, USA e-mail: ashapiro@isye.gatech.edu
More informationLECTURE 3 LECTURE OUTLINE
LECTURE 3 LECTURE OUTLINE Differentiable Conve Functions Conve and A ne Hulls Caratheodory s Theorem Reading: Sections 1.1, 1.2 All figures are courtesy of Athena Scientific, and are used with permission.
More informationg 2 (x) (1/3)M 1 = (1/3)(2/3)M.
COMPACTNESS If C R n is closed and bounded, then by B-W it is sequentially compact: any sequence of points in C has a subsequence converging to a point in C Conversely, any sequentially compact C R n is
More informationMaximal Monotone Inclusions and Fitzpatrick Functions
JOTA manuscript No. (will be inserted by the editor) Maximal Monotone Inclusions and Fitzpatrick Functions J. M. Borwein J. Dutta Communicated by Michel Thera. Abstract In this paper, we study maximal
More informationLecture 3. Optimization Problems and Iterative Algorithms
Lecture 3 Optimization Problems and Iterative Algorithms January 13, 2016 This material was jointly developed with Angelia Nedić at UIUC for IE 598ns Outline Special Functions: Linear, Quadratic, Convex
More informationBoundary Behavior of Excess Demand Functions without the Strong Monotonicity Assumption
Boundary Behavior of Excess Demand Functions without the Strong Monotonicity Assumption Chiaki Hara April 5, 2004 Abstract We give a theorem on the existence of an equilibrium price vector for an excess
More informationWhen are Sums Closed?
Division of the Humanities and Social Sciences Ec 181 KC Border Convex Analysis and Economic Theory Fall 2018 Winter 2019 Topic 20: When are Sums Closed? 20.1 Is a sum of closed sets closed? Example 0.2.2
More informationU e = E (U\E) e E e + U\E e. (1.6)
12 1 Lebesgue Measure 1.2 Lebesgue Measure In Section 1.1 we defined the exterior Lebesgue measure of every subset of R d. Unfortunately, a major disadvantage of exterior measure is that it does not satisfy
More informationConvex Functions. Daniel P. Palomar. Hong Kong University of Science and Technology (HKUST)
Convex Functions Daniel P. Palomar Hong Kong University of Science and Technology (HKUST) ELEC5470 - Convex Optimization Fall 2017-18, HKUST, Hong Kong Outline of Lecture Definition convex function Examples
More informationExtreme Abridgment of Boyd and Vandenberghe s Convex Optimization
Extreme Abridgment of Boyd and Vandenberghe s Convex Optimization Compiled by David Rosenberg Abstract Boyd and Vandenberghe s Convex Optimization book is very well-written and a pleasure to read. The
More informationarxiv: v2 [cs.gt] 1 Dec 2018
Exact Penalization of Generalized Nash Equilibrium Problems Qin Ba Jong-Shi Pang Original November 18, 2018 arxiv:1811.10674v2 [cs.gt] 1 Dec 2018 Abstract This paper presents an exact penalization theory
More informationLecture 4. Chapter 4: Lyapunov Stability. Eugenio Schuster. Mechanical Engineering and Mechanics Lehigh University.
Lecture 4 Chapter 4: Lyapunov Stability Eugenio Schuster schuster@lehigh.edu Mechanical Engineering and Mechanics Lehigh University Lecture 4 p. 1/86 Autonomous Systems Consider the autonomous system ẋ
More informationElements of Convex Optimization Theory
Elements of Convex Optimization Theory Costis Skiadas August 2015 This is a revised and extended version of Appendix A of Skiadas (2009), providing a self-contained overview of elements of convex optimization
More informationReal Analysis Math 131AH Rudin, Chapter #1. Dominique Abdi
Real Analysis Math 3AH Rudin, Chapter # Dominique Abdi.. If r is rational (r 0) and x is irrational, prove that r + x and rx are irrational. Solution. Assume the contrary, that r+x and rx are rational.
More informationConvex Analysis and Economic Theory AY Elementary properties of convex functions
Division of the Humanities and Social Sciences Ec 181 KC Border Convex Analysis and Economic Theory AY 2018 2019 Topic 6: Convex functions I 6.1 Elementary properties of convex functions We may occasionally
More informationCONSTRAINT QUALIFICATIONS, LAGRANGIAN DUALITY & SADDLE POINT OPTIMALITY CONDITIONS
CONSTRAINT QUALIFICATIONS, LAGRANGIAN DUALITY & SADDLE POINT OPTIMALITY CONDITIONS A Dissertation Submitted For The Award of the Degree of Master of Philosophy in Mathematics Neelam Patel School of Mathematics
More informationLecture 5. Theorems of Alternatives and Self-Dual Embedding
IE 8534 1 Lecture 5. Theorems of Alternatives and Self-Dual Embedding IE 8534 2 A system of linear equations may not have a solution. It is well known that either Ax = c has a solution, or A T y = 0, c
More informationLECTURE 25: REVIEW/EPILOGUE LECTURE OUTLINE
LECTURE 25: REVIEW/EPILOGUE LECTURE OUTLINE CONVEX ANALYSIS AND DUALITY Basic concepts of convex analysis Basic concepts of convex optimization Geometric duality framework - MC/MC Constrained optimization
More informationMATH 409 Advanced Calculus I Lecture 7: Monotone sequences. The Bolzano-Weierstrass theorem.
MATH 409 Advanced Calculus I Lecture 7: Monotone sequences. The Bolzano-Weierstrass theorem. Limit of a sequence Definition. Sequence {x n } of real numbers is said to converge to a real number a if for
More informationWeakly homogeneous variational inequalities and solvability of nonlinear equations over cones
Weakly homogeneous variational inequalities and solvability of nonlinear equations over cones M. Seetharama Gowda Department of Mathematics and Statistics University of Maryland, Baltimore County Baltimore,
More informationCHAPTER 2: CONVEX SETS AND CONCAVE FUNCTIONS. W. Erwin Diewert January 31, 2008.
1 ECONOMICS 594: LECTURE NOTES CHAPTER 2: CONVEX SETS AND CONCAVE FUNCTIONS W. Erwin Diewert January 31, 2008. 1. Introduction Many economic problems have the following structure: (i) a linear function
More informationOn John type ellipsoids
On John type ellipsoids B. Klartag Tel Aviv University Abstract Given an arbitrary convex symmetric body K R n, we construct a natural and non-trivial continuous map u K which associates ellipsoids to
More information2. The Concept of Convergence: Ultrafilters and Nets
2. The Concept of Convergence: Ultrafilters and Nets NOTE: AS OF 2008, SOME OF THIS STUFF IS A BIT OUT- DATED AND HAS A FEW TYPOS. I WILL REVISE THIS MATE- RIAL SOMETIME. In this lecture we discuss two
More informationIn English, this means that if we travel on a straight line between any two points in C, then we never leave C.
Convex sets In this section, we will be introduced to some of the mathematical fundamentals of convex sets. In order to motivate some of the definitions, we will look at the closest point problem from
More informationRadius Theorems for Monotone Mappings
Radius Theorems for Monotone Mappings A. L. Dontchev, A. Eberhard and R. T. Rockafellar Abstract. For a Hilbert space X and a mapping F : X X (potentially set-valued) that is maximal monotone locally around
More informationOptimality Conditions for Nonsmooth Convex Optimization
Optimality Conditions for Nonsmooth Convex Optimization Sangkyun Lee Oct 22, 2014 Let us consider a convex function f : R n R, where R is the extended real field, R := R {, + }, which is proper (f never
More informationBASICS OF CONVEX ANALYSIS
BASICS OF CONVEX ANALYSIS MARKUS GRASMAIR 1. Main Definitions We start with providing the central definitions of convex functions and convex sets. Definition 1. A function f : R n R + } is called convex,
More informationConvex Analysis and Optimization Chapter 4 Solutions
Convex Analysis and Optimization Chapter 4 Solutions Dimitri P. Bertsekas with Angelia Nedić and Asuman E. Ozdaglar Massachusetts Institute of Technology Athena Scientific, Belmont, Massachusetts http://www.athenasc.com
More informationIntroduction to Optimization Techniques. Nonlinear Optimization in Function Spaces
Introduction to Optimization Techniques Nonlinear Optimization in Function Spaces X : T : Gateaux and Fréchet Differentials Gateaux and Fréchet Differentials a vector space, Y : a normed space transformation
More informationChapter 2 Convex Analysis
Chapter 2 Convex Analysis The theory of nonsmooth analysis is based on convex analysis. Thus, we start this chapter by giving basic concepts and results of convexity (for further readings see also [202,
More informationConvex Sets with Applications to Economics
Convex Sets with Applications to Economics Debasis Mishra March 10, 2010 1 Convex Sets A set C R n is called convex if for all x, y C, we have λx+(1 λ)y C for all λ [0, 1]. The definition says that for
More informationMathematics 530. Practice Problems. n + 1 }
Department of Mathematical Sciences University of Delaware Prof. T. Angell October 19, 2015 Mathematics 530 Practice Problems 1. Recall that an indifference relation on a partially ordered set is defined
More informationConvex analysis and profit/cost/support functions
Division of the Humanities and Social Sciences Convex analysis and profit/cost/support functions KC Border October 2004 Revised January 2009 Let A be a subset of R m Convex analysts may give one of two
More informationLecture 5: The Bellman Equation
Lecture 5: The Bellman Equation Florian Scheuer 1 Plan Prove properties of the Bellman equation (In particular, existence and uniqueness of solution) Use this to prove properties of the solution Think
More informationMath 421, Homework #9 Solutions
Math 41, Homework #9 Solutions (1) (a) A set E R n is said to be path connected if for any pair of points x E and y E there exists a continuous function γ : [0, 1] R n satisfying γ(0) = x, γ(1) = y, and
More informationStability of Feedback Solutions for Infinite Horizon Noncooperative Differential Games
Stability of Feedback Solutions for Infinite Horizon Noncooperative Differential Games Alberto Bressan ) and Khai T. Nguyen ) *) Department of Mathematics, Penn State University **) Department of Mathematics,
More informationUSING FUNCTIONAL ANALYSIS AND SOBOLEV SPACES TO SOLVE POISSON S EQUATION
USING FUNCTIONAL ANALYSIS AND SOBOLEV SPACES TO SOLVE POISSON S EQUATION YI WANG Abstract. We study Banach and Hilbert spaces with an eye towards defining weak solutions to elliptic PDE. Using Lax-Milgram
More informationMore First-Order Optimization Algorithms
More First-Order Optimization Algorithms Yinyu Ye Department of Management Science and Engineering Stanford University Stanford, CA 94305, U.S.A. http://www.stanford.edu/ yyye Chapters 3, 8, 3 The SDM
More informationRegularized Iterative Stochastic Approximation Methods for Variational Inequality Problems
Regularized Iterative Stochastic Approximation Methods for Variational Inequality Problems Jayash Koshal, Angelia edić and Uday V. Shanbhag Abstract We consider a Cartesian stochastic variational inequality
More informationUNDERGROUND LECTURE NOTES 1: Optimality Conditions for Constrained Optimization Problems
UNDERGROUND LECTURE NOTES 1: Optimality Conditions for Constrained Optimization Problems Robert M. Freund February 2016 c 2016 Massachusetts Institute of Technology. All rights reserved. 1 1 Introduction
More informationAsymptotics of minimax stochastic programs
Asymptotics of minimax stochastic programs Alexander Shapiro Abstract. We discuss in this paper asymptotics of the sample average approximation (SAA) of the optimal value of a minimax stochastic programming
More informationContinuity and Differentiability of Quasiconvex Functions
Continuity and Differentiability of Quasiconvex Functions Jean-Pierre CROUZEIX CUST and LIMOS, Université Blaise Pascal Aubière, France Summer School on Generalized Convexity Samos, August 1999 Abstract
More informationRecursive Methods. Introduction to Dynamic Optimization
Recursive Methods Nr. 1 Outline Today s Lecture finish off: theorem of the maximum Bellman equation with bounded and continuous F differentiability of value function application: neoclassical growth model
More informationConvex Functions and Optimization
Chapter 5 Convex Functions and Optimization 5.1 Convex Functions Our next topic is that of convex functions. Again, we will concentrate on the context of a map f : R n R although the situation can be generalized
More informationM17 MAT25-21 HOMEWORK 6
M17 MAT25-21 HOMEWORK 6 DUE 10:00AM WEDNESDAY SEPTEMBER 13TH 1. To Hand In Double Series. The exercises in this section will guide you to complete the proof of the following theorem: Theorem 1: Absolute
More informationOn proximal-like methods for equilibrium programming
On proximal-lie methods for equilibrium programming Nils Langenberg Department of Mathematics, University of Trier 54286 Trier, Germany, langenberg@uni-trier.de Abstract In [?] Flam and Antipin discussed
More informationA convergence result for an Outer Approximation Scheme
A convergence result for an Outer Approximation Scheme R. S. Burachik Engenharia de Sistemas e Computação, COPPE-UFRJ, CP 68511, Rio de Janeiro, RJ, CEP 21941-972, Brazil regi@cos.ufrj.br J. O. Lopes Departamento
More informationMT804 Analysis Homework II
MT804 Analysis Homework II Eudoxus October 6, 2008 p. 135 4.5.1, 4.5.2 p. 136 4.5.3 part a only) p. 140 4.6.1 Exercise 4.5.1 Use the Intermediate Value Theorem to prove that every polynomial of with real
More informationShape Restricted Smoothing Splines via Constrained Optimal Control and Nonsmooth Newton s Methods
Shape Restricted Smoothing Splines via Constrained Optimal Control and Nonsmooth Newton s Methods Jinglai Shen and Teresa M. Lebair Original: January 24, 214; Revised: June 6, 214 Abstract Shape restricted
More informationLECTURE SLIDES ON BASED ON CLASS LECTURES AT THE CAMBRIDGE, MASS FALL 2007 BY DIMITRI P. BERTSEKAS.
LECTURE SLIDES ON CONVEX ANALYSIS AND OPTIMIZATION BASED ON 6.253 CLASS LECTURES AT THE MASSACHUSETTS INSTITUTE OF TECHNOLOGY CAMBRIDGE, MASS FALL 2007 BY DIMITRI P. BERTSEKAS http://web.mit.edu/dimitrib/www/home.html
More informationDETERMINISTIC AND STOCHASTIC SELECTION DYNAMICS
DETERMINISTIC AND STOCHASTIC SELECTION DYNAMICS Jörgen Weibull March 23, 2010 1 The multi-population replicator dynamic Domain of analysis: finite games in normal form, G =(N, S, π), with mixed-strategy
More informationNormal Fans of Polyhedral Convex Sets
Set-Valued Analysis manuscript No. (will be inserted by the editor) Normal Fans of Polyhedral Convex Sets Structures and Connections Shu Lu Stephen M. Robinson Received: date / Accepted: date Dedicated
More informationLecture 2: Convex Sets and Functions
Lecture 2: Convex Sets and Functions Hyang-Won Lee Dept. of Internet & Multimedia Eng. Konkuk University Lecture 2 Network Optimization, Fall 2015 1 / 22 Optimization Problems Optimization problems are
More informationMA651 Topology. Lecture 10. Metric Spaces.
MA65 Topology. Lecture 0. Metric Spaces. This text is based on the following books: Topology by James Dugundgji Fundamental concepts of topology by Peter O Neil Linear Algebra and Analysis by Marc Zamansky
More informationCubic regularization of Newton s method for convex problems with constraints
CORE DISCUSSION PAPER 006/39 Cubic regularization of Newton s method for convex problems with constraints Yu. Nesterov March 31, 006 Abstract In this paper we derive efficiency estimates of the regularized
More informationLecture 8: Basic convex analysis
Lecture 8: Basic convex analysis 1 Convex sets Both convex sets and functions have general importance in economic theory, not only in optimization. Given two points x; y 2 R n and 2 [0; 1]; the weighted
More informationSome Properties of Convex Hulls of Integer Points Contained in General Convex Sets
Some Properties of Convex Hulls of Integer Points Contained in General Convex Sets Santanu S. Dey and Diego A. Morán R. H. Milton Stewart School of Industrial and Systems Engineering, Georgia Institute
More informationOptimization Theory. A Concise Introduction. Jiongmin Yong
October 11, 017 16:5 ws-book9x6 Book Title Optimization Theory 017-08-Lecture Notes page 1 1 Optimization Theory A Concise Introduction Jiongmin Yong Optimization Theory 017-08-Lecture Notes page Optimization
More informationConvex Optimization & Lagrange Duality
Convex Optimization & Lagrange Duality Chee Wei Tan CS 8292 : Advanced Topics in Convex Optimization and its Applications Fall 2010 Outline Convex optimization Optimality condition Lagrange duality KKT
More informationNotions such as convergent sequence and Cauchy sequence make sense for any metric space. Convergent Sequences are Cauchy
Banach Spaces These notes provide an introduction to Banach spaces, which are complete normed vector spaces. For the purposes of these notes, all vector spaces are assumed to be over the real numbers.
More informationOn the Existence and Convergence of the Central Path for Convex Programming and Some Duality Results
Computational Optimization and Applications, 10, 51 77 (1998) c 1998 Kluwer Academic Publishers, Boston. Manufactured in The Netherlands. On the Existence and Convergence of the Central Path for Convex
More informationNonlinear Control. Nonlinear Control Lecture # 8 Time Varying and Perturbed Systems
Nonlinear Control Lecture # 8 Time Varying and Perturbed Systems Time-varying Systems ẋ = f(t,x) f(t,x) is piecewise continuous in t and locally Lipschitz in x for all t 0 and all x D, (0 D). The origin
More informationOn duality gap in linear conic problems
On duality gap in linear conic problems C. Zălinescu Abstract In their paper Duality of linear conic problems A. Shapiro and A. Nemirovski considered two possible properties (A) and (B) for dual linear
More information2 Sequences, Continuity, and Limits
2 Sequences, Continuity, and Limits In this chapter, we introduce the fundamental notions of continuity and limit of a real-valued function of two variables. As in ACICARA, the definitions as well as proofs
More informationNonlinear Systems and Control Lecture # 12 Converse Lyapunov Functions & Time Varying Systems. p. 1/1
Nonlinear Systems and Control Lecture # 12 Converse Lyapunov Functions & Time Varying Systems p. 1/1 p. 2/1 Converse Lyapunov Theorem Exponential Stability Let x = 0 be an exponentially stable equilibrium
More information1 Maximal Lattice-free Convex Sets
47-831: Advanced Integer Programming Lecturer: Amitabh Basu Lecture 3 Date: 03/23/2010 In this lecture, we explore the connections between lattices of R n and convex sets in R n. The structures will prove
More informationLP Duality: outline. Duality theory for Linear Programming. alternatives. optimization I Idea: polyhedra
LP Duality: outline I Motivation and definition of a dual LP I Weak duality I Separating hyperplane theorem and theorems of the alternatives I Strong duality and complementary slackness I Using duality
More informationSeparation in General Normed Vector Spaces 1
John Nachbar Washington University March 12, 2016 Separation in General Normed Vector Spaces 1 1 Introduction Recall the Basic Separation Theorem for convex sets in R N. Theorem 1. Let A R N be non-empty,
More informationLocal strong convexity and local Lipschitz continuity of the gradient of convex functions
Local strong convexity and local Lipschitz continuity of the gradient of convex functions R. Goebel and R.T. Rockafellar May 23, 2007 Abstract. Given a pair of convex conjugate functions f and f, we investigate
More informationConvex Sets. Prof. Dan A. Simovici UMB
Convex Sets Prof. Dan A. Simovici UMB 1 / 57 Outline 1 Closures, Interiors, Borders of Sets in R n 2 Segments and Convex Sets 3 Properties of the Class of Convex Sets 4 Closure and Interior Points of Convex
More informationCHARACTERIZATION OF (QUASI)CONVEX SET-VALUED MAPS
CHARACTERIZATION OF (QUASI)CONVEX SET-VALUED MAPS Abstract. The aim of this paper is to characterize in terms of classical (quasi)convexity of extended real-valued functions the set-valued maps which are
More informationConvex Optimization Theory
Convex Optimization Theory A SUMMARY BY DIMITRI P. BERTSEKAS We provide a summary of theoretical concepts and results relating to convex analysis, convex optimization, and duality theory. In particular,
More informationAnalysis Finite and Infinite Sets The Real Numbers The Cantor Set
Analysis Finite and Infinite Sets Definition. An initial segment is {n N n n 0 }. Definition. A finite set can be put into one-to-one correspondence with an initial segment. The empty set is also considered
More informationAppendix PRELIMINARIES 1. THEOREMS OF ALTERNATIVES FOR SYSTEMS OF LINEAR CONSTRAINTS
Appendix PRELIMINARIES 1. THEOREMS OF ALTERNATIVES FOR SYSTEMS OF LINEAR CONSTRAINTS Here we consider systems of linear constraints, consisting of equations or inequalities or both. A feasible solution
More information1. Gradient method. gradient method, first-order methods. quadratic bounds on convex functions. analysis of gradient method
L. Vandenberghe EE236C (Spring 2016) 1. Gradient method gradient method, first-order methods quadratic bounds on convex functions analysis of gradient method 1-1 Approximate course outline First-order
More information