Sub-b-convex Functions. and Sub-b-convex Programming
|
|
- Jonathan Collins
- 6 years ago
- Views:
Transcription
1 Sub-b-convex Functions and Sub-b-convex Programming Chao Mian-tao Jian Jin-bao Liang Dong-ying Abstract: The paper studied a new generalized convex function which called sub-b-convex function, and introduced a new concept of sub-b-convex set The basic properties of sub-b-convex functions were discussed in general case and differentiable case, respectively And, obtained the sufficient conditions that the sub-b convex function become quasi-convex function or pseudo-convex function Furthermore, the sufficient conditions of optimality for unconstrained and inequality constrained programming were obtained under the sub-b-convexity AMS Subject Classification: 26B25, 90C46 Key Words: convex function, sub-b-convex set, sub-b-convex function, pseudo-sub-b-convex function, optimality conditions g b à¼êúg b à5y x 7 {7 ùàl Á : ïä «g b à¼ê2âà¼ê, 0g b à8vg O3 œ/ 9Œ œ/e?øg b à¼êƒ'5ÿ, g b à¼ê [à¼ê9 à¼ê ^, 3g b à¼ê^ e ÑÃå9 تå5y `5^ Ä7 8µI[g, ÆÄ7 ( ); 2Üg, ÆÄ7 ( ); 2Ü Æ : 8: `zn Ø {9êÆïïÄ x 7,I,ïÄ),ù,chaomiantao@126com; 1 College of Applied Sciences, Beijing University of Technology, , Beijing, China; ó ŒÆ A^ênÆ, ; 2 Department of Mathematics and Computer Science, Guangxi College of Education, , Nanning, China; 2Ü Æ êæ OŽÅ ÆX, Hw {7,I,Æ,Ç, College of Mathematics and Information Science, Guangxi University, , Nanning, China; 2ÜŒÆêÆ &E ÆÆ, Hw ÏÕŠö: ùàl,å,ïä),ù, liangdy go@126com; Guangxi Vocational and Technical College of Communications, , Nanning, China; 2Ü Ï EâÆ, Hw
2 aò: 90C26, 90C46 ' c:à¼ê, g b à8ü, g b à¼ê, g b à¼ê, `5^ 1 Introduction Convexity plays a vital role in many aspects of mathematical programming, for example, sufficient optimality conditions and duality theorems Over the years, many generalized convexity were presented (see [1]-[11]) In this paper, we introduce a new class of functions, which are called sub-b-convex functions and present some results about them In the following, we review several concepts of generalized convexity which have some relationships with this work Though out the paper, we assume that the set S R n is a nonempty convex set Definition 11 (see [2]) A real function f : S R n R is said to be a quasi-convex function, if f(x + (1 )y) max{f(x), f(y)}, x, y S, (0, 1) Definition 12 (see [2]) Let f : S R n R be a differentiable function on S The function f is said to be pseudo-convex function, if for each x, y S with f(x) T (y x) 0, we have f(x) f(y); or equivalently, if f(x) < f(y), then f(x) T (y x) < 0 Theorem 11 (see [2]) Let f : S R n R be differentiable on S Then f is a quasi-convex function if and only if the following equivalent statements holds: (1) If x, y S and f(x) f(y), then f(y) T (x y) 0; (2) If x, y S and f(y) T (x y) > 0, then f(x) > f(y) 2 Sub-b-convex Functions and Their Properties In this section, we present the definition of sub-b-convex function and discuss its some basic properties Definition 21 Let S be a nonempty convex set in R n The function f : S R is said to be a sub-b-convex function on S with respect to map b : S S [0, 1] R, if f(x + (1 )y) f(x) + (1 )f(y) + b(x, y, ), x, y S, [0, 1] 2
3 Remark 21 If one defines map b(x, y, ) = f(x + (1 )y) f(x) (1 )f(y), then, each function is sub-b-convex with this map However, our interesting is to study some b(x, y, ) with special propertiesand, obviously, each convex function f is sub-b-convex function with respect to the map b(x, y, ) = 0 Proposition 21 If f i : S R, (i = 1, 2, 3,, m) are sub-b-convex functions with respect to maps b i : S S [0, 1] R, (i = 1, 2, 3,, m) respectively Then function f = m a i f i, a i 0, i = 1, 2, 3,, m i=1 is sub-b-convex with respect to b = m i=1 a ib i Proof For all x, y S and [0, 1], f(x + (1 )y) = m i=1 a if i (x + (1 )y) m i=1 a i[f i (x) + (1 )f i (y) + b i (x, y, )] = m i=1 a if i (x) + (1 ) m i=1 a if i (y) + m i=1 a ib i (x, y, ) = f(x) + (1 )f(y) + m i=1 a ib i (x, y, ) So, from the definition of sub-b-convexity, knows f is sub-b-convex with respect to b = m i=1 a ib i Proposition 22 If functions f i : S R, (i = 1, 2, 3,, m) are sub-b-convex functions with respect to b i, (i = 1, 2, 3,, m), respectively Then f = max{f i, i = 1, 2,, m} is sub-b-convex with respect to b = max{b i, i = 1, 2,, m} Proof For forall x, y S and [0, 1], from the sub-b-convexity of f i, we have f(x + (1 )y) = max{f i (x + (1 )y), i = 1, 2,, m} = f t (x + (1 )y) f t (x) + (1 )f t (y) + b t (x, y, ) f(x) + (1 )f(y) + b(x, y, ) So, f(x) is is sub-b-convex with respect to b = max{b i, i = 1, 2,, m} Here, we introduced a new concept of sub-b-convex set Definition 22 Let X R n+1 be a nonempty set X is said to be sub-b-convex with respect to b : R n R n [0, 1] R, if (x + (1 )y, α + (1 )β + b(x, y, )) X, (x, α), (y, β) X, x, y R n, [0, 1] 3
4 We now give a characterization of sub-b-convex function f : S R in the term of their epigraph E(f) given by E(f) = {(x, α) x S, α R, f(x) α} Theorem 21 A function f : S R is sub-b-convex with respect to b : R n R n [0, 1] R if and only if E(f) is a sub-b-convex set with respect to b Proof Suppose that f is sub-b-convex with respect to b Let (x 1, α 1 ), (x 2, α 2 ) E(f) Then, f(x 1 ) α 1, f(x 2 ) α 2 Since f is sub-b-convex with respect to b, we have f(x 1 + (1 )x 2 ) f(x 1 ) + (1 )f(x 2 ) + b(x 1, x 2, ) α 1 + (1 )α 2 + b(x 1, x 2, ) Hence, from Definition 22 one has (x 1 + (1 )x 2, α 1 + (1 )α 2 + b(x 1, x 2, )) E(f) Thus E(f) is a sub-b-convex set with respect to b Conversely, assume that E(f) is a sub-b-convex set with respect to b Let x 1, x 2 S, then (x 1, f(x 1 )), (x 2, f(x 2 )) E(f) Thus, for [0, 1], (x 1 + (1 )x 2, f(x 1 ) + (1 )f(x 2 ) + b(x 1, x 2, )) E(f) This further follows that f(x 1 + (1 )x 2 ) f(x 1 ) + (1 )f(x 2 ) + b(x 1, x 2, ) That is, f is sub-b-convex with respect to b Proposition 23 If X i (i I) is a family of sub-b-convex set with respect to a same map b(x, y, ), then i I X i is a sub-b-convex set with respect to b(x, y, ) Proof Let (x, α), (y, β) i I X i, [0, 1] Then, for each i I, (x, α), (y, β) X i Since X i is a sub-b-convex set with respect to b, it follows that (x + (1 )y, α + (1 )β + b(x, y, )) X i, i I Thus, (x + (1 )y, α + (1 )β + b(x, y, )) i I X i Hence, i I X i is a sub-b-convex set with respect to b(x, y, ) 4
5 Theorem 22 If f i (i I) is a family of numerical functions, and each f i sub-b-convex with respect to the same map b(x, y, ), then the numerical function f = sup i I f i (x) is a sub-b-convex function with respect to b(x, y, ) Proof Since f i is a sub-b-convex function on S with respect to b(x, y, ), its epigraph E(f i ) = {(x, α) x S, f i (x) α} is a sub-b-convex set with respect to b Therefor, their intersection i I E(f i ) = {(x, α) x S, f i (x) α, i I} = {(x, α) x S, f(x) α} = E(f) is also a sub-b-convex set with respect to b So, from Theorem 21 and Proposition 22, one know that f = sup i I f i (x) is a sub-b-convex function with respect to b(x, y, ) In the follows, we consider continuously differentiable functions which are sub-b-convex func- b(x,y,) tion with respect to a map b Further, we assume that the limit lim 0+ x, y S is exists for fixed Theorem 23 Suppose that f : S R is differentiable and sub-b-convex with respect to map b Then f(y) T (x y) f(x) f(y) + lim 0+ b(x, y, ) Proof From Taylor expansion and the sub-b-convexity of f, we have f(y) + f(y)(x y) + o() = f(x + (1 )y) f(x) + (1 )f(y) + b(x, y, ) This implies that f(y)(x y) + o() f(x) f(y) + b(x, y, ) Dividing the inequality above by and taking 0+, we have The proof of this theorem is completed result f(y) T (x y) f(x) f(y) + lim 0+ b(x, y, ) Base on Theorem 333 of [2] and Theorem 23 of this paper, it is easy to get the following Corollary 21 Let f : S R be differentiable and sub-b-convex with respect to b If for each b(x,y,) x, y S, lim 0, then f is a convex function on S 0+ Theorem 24 Suppose that f : S R is differentiable and sub-b-convex with respect to b, then ( f(y) f(x)) T b(x, y, ) (x y) lim + lim b(y, x, )
6 Proof From Theorem 23, we have Adding the two inequalities above, we have f(y) T (x y) f(x) f(y) + lim 0+ f(x) T (y x) f(y) f(x) + lim 0+ b(x, y, ), b(y, x, ) ( f(y) f(x)) T b(x, y, ) (x y) lim + lim b(y, x, ) The proof of this theorem is completed Theorem 25 Let f : S R be differentiable and sub-b-convex with respect to b If lim b(x,y,) f(x) f(y), x, y S, then f is quasi-convex Furthermore, if lim 0+ x, y S, then f is pseudo-convex 0+ b(x,y,) < f(x) f(y), we have If Proof For any x, y S and (0, 1) Suppose that f(x) f(y), then from Theorem 23, b(x,y,) lim 0+ f(y) T (x y) f(x) f(y) + lim 0+ b(x, y, ) b(x,y,) f(x) f(y), then f(x) f(y) + lim 0 So, f(y) T (x y) 0 0+ Therefor, we know from Theorem 11, we get that f is quasi-convex Similarly, if f(x) < f(y), we also have f(y) T (x y) < 0 So, from the Definition 12, we get that f is pseudo-convex 3 Optimality Conditions In this section, we apply the associated results above to the nonlinear programming problem First, we consider the unconstraint problem Theorem 41 Let f : S R be differentiable and sub-b-convex with respect to b Consider the optimal problem min{f(x) x S} If x S and relation f( x) T b(x, y, ) (x x) lim 0+ holds for each x S, then x is the optimal solution of f on S 0 (41) Proof For any x S, from Theorem 23, one has f( x) T b(x, x, ) (x x) lim 0+ 6 f(x) f( x)
7 From (41), we have f(x) f( x) 0 So, x is an optimal solution of f on S Next, we apply the associated results to the nonlinear programming problem with inequality constraints as follows: min f(x) (P g ) st g i (x) 0, i I = {1, 2,, m}, x R n Denote the feasible set of (P g ) by S g = { x R n g i (x) 0, i I} For convenience of discussion, we assume that f and g i are all differentiable and S g is a nonempty set in R n Now, we further extend the concept of sub-b-convex function, then discuss the optimality conditions of the corresponding programming Definition 44 Let S be a nonempty convex set in R n The function f : S R is said to be pseudo-sub-b-convex function on S with respect to b : S S [0, 1] R, if for each x, y S and (0, 1), from f(y) T b(x,y,) (x y) + lim 0+ 0 one can get f(x) f(y) Theorem 42 (Karush-Kuhn-Tucker Sufficient Conditions) The function f(x) is differentiable and pseudo-sub-b-convex with respect to b : S S [0, 1] R, g i (x) (i I) are differentiable and sub-b-convex with respect to b i : S S [0, 1] R (i I) Assume that x S g is a KKT point of (P g ) ie, there exist multipliers u i 0 (i I) such that f(x ) + i I u i g i (x ) = 0, u i g i (x ) = 0 (42) If b(x, x, ) lim 0+ i I u i lim 0+ b i (x, x, ), x S g (43) Then x is an optimal solution of the problem (P g ) Proof For any x S g, we have g i (x) 0 = g i (x ), i I(x ) = {i I g i (x ) = 0} Therefore, from the sub-b-convexity of g i (x) and Theorem 23, one obtain g i (x ) T (x x b(x,y,) ) lim 0 0+ for i I(x ) From (42), one has f(x ) T (x x ) = u i g i (x ) T (x x ) In view of (43), we have f(x ) T (x x ) + lim i I(x ) 0+ b(x,x,) u i ( g i (x ) T (x x b ) lim i (x,x,) ) 0+ From Theorem 0, i I(x ) So, i I(x ) i I(x ) u i g i (x ) T (x x ) + 23, one has g i (x ) T (x x b ) lim i (x,x,) 0+ f(x ) T (x x b(x, x, ) ) + lim u i lim i I(x ) 0+ b i (x,x,) = g i (x) g i (x ) = g i (x)
8 This together with the pseudo-sub-b-convexity of f(x), shows that f(x) f(x ), therefor x is an optimal solution of the problem (P g ) References [1] Bector CR, Singh C B-vex functions[j], Journal of Optimization Theory and Applications, 1991, 2(71): [2] Bazaraa MS, Hanif D, Shetty CM, et al Nonlinear Programming Theory and Algorithms (Second Edition)[M] The United States of America: John Wiley and Sons, 1993 [3] Youness EA E-convex sets, E-convex functions and E-convex programming[j], Journal of Optimization Theory and Applications, 1999, 2(102): [4] Yang XM On E-convex sets, E-convex functions and E-convex programming[j], Journal of Optimization Theory and Applications, 2001, 3(109): [5] Chen XS Some properties of semi-e-convex functions[j], Journal of Mathematical Analysis and Applications, 2002, (275): [6] Jian JB Incorrect results for E-convex functions and E-convex programming[j], Mathematical Research & Exposition (China), 2003, 3(23): [7] Jian JB On (E, F ) generalized convexity[j], International Journal of Mathematical Sciences, 2003, 1(2): [8] Jian JB, Hu QJ, Tang CM and Zheng HY Semi-(E, F )-convex functions and semi-(e, F )- convex programming[j], International Journal of Pure and Applied Mathematics, 2004, 4(14): [9] Jian JB, Pan HQ, Zeng HJ Semilocally prequasi-invex functions and characterizations[j], Journal of Industrial and Management Optimization,2007, 3(3): [10] Liu CP, Yang XM Strongly Prequasi-invex Functions and strongly quasi-invex Functions[J], OR Transactions, 2007, 4(24): [11] Zeng YF, Jian JB, Chao MT B-Semi-(E,F)-Convex Functions and Programming[J], OR Transactions, 2009, 2(13):
Numerical Optimization
Constrained Optimization Computer Science and Automation Indian Institute of Science Bangalore 560 012, India. NPTEL Course on Constrained Optimization Constrained Optimization Problem: min h j (x) 0,
More informationShiqian Ma, MAT-258A: Numerical Optimization 1. Chapter 4. Subgradient
Shiqian Ma, MAT-258A: Numerical Optimization 1 Chapter 4 Subgradient Shiqian Ma, MAT-258A: Numerical Optimization 2 4.1. Subgradients definition subgradient calculus duality and optimality conditions Shiqian
More informationOPTIMALITY CONDITIONS AND DUALITY FOR SEMI-INFINITE PROGRAMMING INVOLVING SEMILOCALLY TYPE I-PREINVEX AND RELATED FUNCTIONS
Commun. Korean Math. Soc. 27 (2012), No. 2, pp. 411 423 http://dx.doi.org/10.4134/ckms.2012.27.2.411 OPTIMALITY CONDITIONS AND DUALITY FOR SEMI-INFINITE PROGRAMMING INVOLVING SEMILOCALLY TYPE I-PREINVEX
More informationUNDERGROUND LECTURE NOTES 1: Optimality Conditions for Constrained Optimization Problems
UNDERGROUND LECTURE NOTES 1: Optimality Conditions for Constrained Optimization Problems Robert M. Freund February 2016 c 2016 Massachusetts Institute of Technology. All rights reserved. 1 1 Introduction
More informationDecision Science Letters
Decision Science Letters 8 (2019) *** *** Contents lists available at GrowingScience Decision Science Letters homepage: www.growingscience.com/dsl A new logarithmic penalty function approach for nonlinear
More informationLectures 9 and 10: Constrained optimization problems and their optimality conditions
Lectures 9 and 10: Constrained optimization problems and their optimality conditions Coralia Cartis, Mathematical Institute, University of Oxford C6.2/B2: Continuous Optimization Lectures 9 and 10: Constrained
More informationIntroduction to Optimization Techniques. Nonlinear Optimization in Function Spaces
Introduction to Optimization Techniques Nonlinear Optimization in Function Spaces X : T : Gateaux and Fréchet Differentials Gateaux and Fréchet Differentials a vector space, Y : a normed space transformation
More informationCollege of Education for Pure Sciences (Ibn-Haitham), Baghdad University, Baghdad, IRAQ
International Journal of Pure and Applied Mathematics Volume 116 No. 3 2017, 655-673 ISSN: 1311-8080 (printed version); ISSN: 1314-3395 (on-line version) url: http://www.ijpam.eu doi: 10.12732/ijpam.v116i3.11
More informationA Note on KKT Points of Homogeneous Programs 1
A Note on KKT Points of Homogeneous Programs 1 Y. B. Zhao 2 and D. Li 3 Abstract. Homogeneous programming is an important class of optimization problems. The purpose of this note is to give a truly equivalent
More informationConvex Optimization Lecture 6: KKT Conditions, and applications
Convex Optimization Lecture 6: KKT Conditions, and applications Dr. Michel Baes, IFOR / ETH Zürich Quick recall of last week s lecture Various aspects of convexity: The set of minimizers is convex. Convex
More informationCONVEX FUNCTIONS AND OPTIMIZATION TECHINIQUES A THESIS SUBMITTED IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DEGREE OF
CONVEX FUNCTIONS AND OPTIMIZATION TECHINIQUES A THESIS SUBMITTED IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DEGREE OF MASTER OF SCIENCE IN MATHEMATICS SUBMITTED TO NATIONAL INSTITUTE OF TECHNOLOGY,
More informationThe general programming problem is the nonlinear programming problem where a given function is maximized subject to a set of inequality constraints.
1 Optimization Mathematical programming refers to the basic mathematical problem of finding a maximum to a function, f, subject to some constraints. 1 In other words, the objective is to find a point,
More informationMathematical Programming Involving (α, ρ)-right upper-dini-derivative Functions
Filomat 27:5 (2013), 899 908 DOI 10.2298/FIL1305899Y Published by Faculty of Sciences and Mathematics, University of Niš, Serbia Available at: http://www.pmf.ni.ac.rs/filomat Mathematical Programming Involving
More informationGeneralization to inequality constrained problem. Maximize
Lecture 11. 26 September 2006 Review of Lecture #10: Second order optimality conditions necessary condition, sufficient condition. If the necessary condition is violated the point cannot be a local minimum
More informationConstrained Optimization and Lagrangian Duality
CIS 520: Machine Learning Oct 02, 2017 Constrained Optimization and Lagrangian Duality Lecturer: Shivani Agarwal Disclaimer: These notes are designed to be a supplement to the lecture. They may or may
More informationConstrained optimization
Constrained optimization In general, the formulation of constrained optimization is as follows minj(w), subject to H i (w) = 0, i = 1,..., k. where J is the cost function and H i are the constraints. Lagrange
More informationI.3. LMI DUALITY. Didier HENRION EECI Graduate School on Control Supélec - Spring 2010
I.3. LMI DUALITY Didier HENRION henrion@laas.fr EECI Graduate School on Control Supélec - Spring 2010 Primal and dual For primal problem p = inf x g 0 (x) s.t. g i (x) 0 define Lagrangian L(x, z) = g 0
More informationConvex Optimization & Lagrange Duality
Convex Optimization & Lagrange Duality Chee Wei Tan CS 8292 : Advanced Topics in Convex Optimization and its Applications Fall 2010 Outline Convex optimization Optimality condition Lagrange duality KKT
More informationOptimization Tutorial 1. Basic Gradient Descent
E0 270 Machine Learning Jan 16, 2015 Optimization Tutorial 1 Basic Gradient Descent Lecture by Harikrishna Narasimhan Note: This tutorial shall assume background in elementary calculus and linear algebra.
More informationProblem 1 HW3. Question 2. i) We first show that for a random variable X bounded in [0, 1], since x 2 apple x, wehave
Next, we show that, for any x Ø, (x) Æ 3 x x HW3 Problem i) We first show that for a random variable X bounded in [, ], since x apple x, wehave Var[X] EX [EX] apple EX [EX] EX( EX) Since EX [, ], therefore,
More informationSubgradient. Acknowledgement: this slides is based on Prof. Lieven Vandenberghes lecture notes. definition. subgradient calculus
1/41 Subgradient Acknowledgement: this slides is based on Prof. Lieven Vandenberghes lecture notes definition subgradient calculus duality and optimality conditions directional derivative Basic inequality
More informationCharacterizations of Solution Sets of Fréchet Differentiable Problems with Quasiconvex Objective Function
Characterizations of Solution Sets of Fréchet Differentiable Problems with Quasiconvex Objective Function arxiv:1805.03847v1 [math.oc] 10 May 2018 Vsevolod I. Ivanov Department of Mathematics, Technical
More informationDuality Theory of Constrained Optimization
Duality Theory of Constrained Optimization Robert M. Freund April, 2014 c 2014 Massachusetts Institute of Technology. All rights reserved. 1 2 1 The Practical Importance of Duality Duality is pervasive
More information8. Constrained Optimization
8. Constrained Optimization Daisuke Oyama Mathematics II May 11, 2018 Unconstrained Maximization Problem Let X R N be a nonempty set. Definition 8.1 For a function f : X R, x X is a (strict) local maximizer
More information5. Duality. Lagrangian
5. Duality Convex Optimization Boyd & Vandenberghe Lagrange dual problem weak and strong duality geometric interpretation optimality conditions perturbation and sensitivity analysis examples generalized
More informationDuality (Continued) min f ( x), X R R. Recall, the general primal problem is. The Lagrangian is a function. defined by
Duality (Continued) Recall, the general primal problem is min f ( x), xx g( x) 0 n m where X R, f : X R, g : XR ( X). he Lagrangian is a function L: XR R m defined by L( xλ, ) f ( x) λ g( x) Duality (Continued)
More informationF O R SOCI AL WORK RESE ARCH
7 TH EUROPE AN CONFERENCE F O R SOCI AL WORK RESE ARCH C h a l l e n g e s i n s o c i a l w o r k r e s e a r c h c o n f l i c t s, b a r r i e r s a n d p o s s i b i l i t i e s i n r e l a t i o n
More informationThe exact absolute value penalty function method for identifying strict global minima of order m in nonconvex nonsmooth programming
Optim Lett (2016 10:1561 1576 DOI 10.1007/s11590-015-0967-3 ORIGINAL PAPER The exact absolute value penalty function method for identifying strict global minima of order m in nonconvex nonsmooth programming
More informationConvex Optimization Boyd & Vandenberghe. 5. Duality
5. Duality Convex Optimization Boyd & Vandenberghe Lagrange dual problem weak and strong duality geometric interpretation optimality conditions perturbation and sensitivity analysis examples generalized
More informationOptimality Conditions for Constrained Optimization
72 CHAPTER 7 Optimality Conditions for Constrained Optimization 1. First Order Conditions In this section we consider first order optimality conditions for the constrained problem P : minimize f 0 (x)
More informationSubgradients. subgradients. strong and weak subgradient calculus. optimality conditions via subgradients. directional derivatives
Subgradients subgradients strong and weak subgradient calculus optimality conditions via subgradients directional derivatives Prof. S. Boyd, EE364b, Stanford University Basic inequality recall basic inequality
More informationLagrange Relaxation and Duality
Lagrange Relaxation and Duality As we have already known, constrained optimization problems are harder to solve than unconstrained problems. By relaxation we can solve a more difficult problem by a simpler
More informationStructural and Multidisciplinary Optimization. P. Duysinx and P. Tossings
Structural and Multidisciplinary Optimization P. Duysinx and P. Tossings 2018-2019 CONTACTS Pierre Duysinx Institut de Mécanique et du Génie Civil (B52/3) Phone number: 04/366.91.94 Email: P.Duysinx@uliege.be
More informationLecture 2: Convex Sets and Functions
Lecture 2: Convex Sets and Functions Hyang-Won Lee Dept. of Internet & Multimedia Eng. Konkuk University Lecture 2 Network Optimization, Fall 2015 1 / 22 Optimization Problems Optimization problems are
More informationLecture 6: Conic Optimization September 8
IE 598: Big Data Optimization Fall 2016 Lecture 6: Conic Optimization September 8 Lecturer: Niao He Scriber: Juan Xu Overview In this lecture, we finish up our previous discussion on optimality conditions
More informationNew Iterative Algorithm for Variational Inequality Problem and Fixed Point Problem in Hilbert Spaces
Int. Journal of Math. Analysis, Vol. 8, 2014, no. 20, 995-1003 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/10.12988/ijma.2014.4392 New Iterative Algorithm for Variational Inequality Problem and Fixed
More informationChapter 3: Constrained Extrema
Chapter 3: Constrained Extrema Math 368 c Copyright 2012, 2013 R Clark Robinson May 22, 2013 Chapter 3: Constrained Extrema 1 Implicit Function Theorem For scalar fn g : R n R with g(x ) 0 and g(x ) =
More informationSubgradients. subgradients and quasigradients. subgradient calculus. optimality conditions via subgradients. directional derivatives
Subgradients subgradients and quasigradients subgradient calculus optimality conditions via subgradients directional derivatives Prof. S. Boyd, EE392o, Stanford University Basic inequality recall basic
More informationSCALARIZATION APPROACHES FOR GENERALIZED VECTOR VARIATIONAL INEQUALITIES
Nonlinear Analysis Forum 12(1), pp. 119 124, 2007 SCALARIZATION APPROACHES FOR GENERALIZED VECTOR VARIATIONAL INEQUALITIES Zhi-bin Liu, Nan-jing Huang and Byung-Soo Lee Department of Applied Mathematics
More informationEC9A0: Pre-sessional Advanced Mathematics Course. Lecture Notes: Unconstrained Optimisation By Pablo F. Beker 1
EC9A0: Pre-sessional Advanced Mathematics Course Lecture Notes: Unconstrained Optimisation By Pablo F. Beker 1 1 Infimum and Supremum Definition 1. Fix a set Y R. A number α R is an upper bound of Y if
More informationNonlinear Optimization
Nonlinear Optimization Etienne de Klerk (UvT)/Kees Roos e-mail: C.Roos@ewi.tudelft.nl URL: http://www.isa.ewi.tudelft.nl/ roos Course WI3031 (Week 4) February-March, A.D. 2005 Optimization Group 1 Outline
More informationCO 250 Final Exam Guide
Spring 2017 CO 250 Final Exam Guide TABLE OF CONTENTS richardwu.ca CO 250 Final Exam Guide Introduction to Optimization Kanstantsin Pashkovich Spring 2017 University of Waterloo Last Revision: March 4,
More informationISM206 Lecture Optimization of Nonlinear Objective with Linear Constraints
ISM206 Lecture Optimization of Nonlinear Objective with Linear Constraints Instructor: Prof. Kevin Ross Scribe: Nitish John October 18, 2011 1 The Basic Goal The main idea is to transform a given constrained
More informationOn Monoids over which All Strongly Flat Right S-Acts Are Regular
Æ26 Æ4 ² Vol.26, No.4 2006µ11Â JOURNAL OF MATHEMATICAL RESEARCH AND EXPOSITION Nov., 2006 Article ID: 1000-341X(2006)04-0720-05 Document code: A On Monoids over which All Strongly Flat Right S-Acts Are
More informationThe Karush-Kuhn-Tucker (KKT) conditions
The Karush-Kuhn-Tucker (KKT) conditions In this section, we will give a set of sufficient (and at most times necessary) conditions for a x to be the solution of a given convex optimization problem. These
More informationRoles of Convexity in Optimization Theory. Efor, T. E and Nshi C. E
IDOSR PUBLICATIONS International Digital Organization for Scientific Research ISSN: 2550-7931 Roles of Convexity in Optimization Theory Efor T E and Nshi C E Department of Mathematics and Computer Science
More informationON THE CONSTRUCTION OF DUALLY FLAT FINSLER METRICS
Huang, L., Liu, H. and Mo, X. Osaka J. Math. 52 (2015), 377 391 ON THE CONSTRUCTION OF DUALLY FLAT FINSLER METRICS LIBING HUANG, HUAIFU LIU and XIAOHUAN MO (Received April 15, 2013, revised November 14,
More information! " # $! % & '! , ) ( + - (. ) ( ) * + / 0 1 2 3 0 / 4 5 / 6 0 ; 8 7 < = 7 > 8 7 8 9 : Œ Š ž P P h ˆ Š ˆ Œ ˆ Š ˆ Ž Ž Ý Ü Ý Ü Ý Ž Ý ê ç è ± ¹ ¼ ¹ ä ± ¹ w ç ¹ è ¼ è Œ ¹ ± ¹ è ¹ è ä ç w ¹ ã ¼ ¹ ä ¹ ¼ ¹ ±
More informationFIRST- AND SECOND-ORDER OPTIMALITY CONDITIONS FOR MATHEMATICAL PROGRAMS WITH VANISHING CONSTRAINTS 1. Tim Hoheisel and Christian Kanzow
FIRST- AND SECOND-ORDER OPTIMALITY CONDITIONS FOR MATHEMATICAL PROGRAMS WITH VANISHING CONSTRAINTS 1 Tim Hoheisel and Christian Kanzow Dedicated to Jiří Outrata on the occasion of his 60th birthday Preprint
More informationConstrained Optimization
1 / 22 Constrained Optimization ME598/494 Lecture Max Yi Ren Department of Mechanical Engineering, Arizona State University March 30, 2015 2 / 22 1. Equality constraints only 1.1 Reduced gradient 1.2 Lagrange
More informationResearch Article Optimality Conditions and Duality in Nonsmooth Multiobjective Programs
Hindawi Publishing Corporation Journal of Inequalities and Applications Volume 2010, Article ID 939537, 12 pages doi:10.1155/2010/939537 Research Article Optimality Conditions and Duality in Nonsmooth
More informationCONSTRAINT QUALIFICATIONS, LAGRANGIAN DUALITY & SADDLE POINT OPTIMALITY CONDITIONS
CONSTRAINT QUALIFICATIONS, LAGRANGIAN DUALITY & SADDLE POINT OPTIMALITY CONDITIONS A Dissertation Submitted For The Award of the Degree of Master of Philosophy in Mathematics Neelam Patel School of Mathematics
More informationExtreme Abridgment of Boyd and Vandenberghe s Convex Optimization
Extreme Abridgment of Boyd and Vandenberghe s Convex Optimization Compiled by David Rosenberg Abstract Boyd and Vandenberghe s Convex Optimization book is very well-written and a pleasure to read. The
More informationMVE165/MMG631 Linear and integer optimization with applications Lecture 13 Overview of nonlinear programming. Ann-Brith Strömberg
MVE165/MMG631 Overview of nonlinear programming Ann-Brith Strömberg 2015 05 21 Areas of applications, examples (Ch. 9.1) Structural optimization Design of aircraft, ships, bridges, etc Decide on the material
More informationOptimization and Optimal Control in Banach Spaces
Optimization and Optimal Control in Banach Spaces Bernhard Schmitzer October 19, 2017 1 Convex non-smooth optimization with proximal operators Remark 1.1 (Motivation). Convex optimization: easier to solve,
More informationChap 2. Optimality conditions
Chap 2. Optimality conditions Version: 29-09-2012 2.1 Optimality conditions in unconstrained optimization Recall the definitions of global, local minimizer. Geometry of minimization Consider for f C 1
More informationON LICQ AND THE UNIQUENESS OF LAGRANGE MULTIPLIERS
ON LICQ AND THE UNIQUENESS OF LAGRANGE MULTIPLIERS GERD WACHSMUTH Abstract. Kyparisis proved in 1985 that a strict version of the Mangasarian- Fromovitz constraint qualification (MFCQ) is equivalent to
More informationCharacterizations of the solution set for non-essentially quasiconvex programming
Optimization Letters manuscript No. (will be inserted by the editor) Characterizations of the solution set for non-essentially quasiconvex programming Satoshi Suzuki Daishi Kuroiwa Received: date / Accepted:
More informationConvex Optimization M2
Convex Optimization M2 Lecture 3 A. d Aspremont. Convex Optimization M2. 1/49 Duality A. d Aspremont. Convex Optimization M2. 2/49 DMs DM par email: dm.daspremont@gmail.com A. d Aspremont. Convex Optimization
More informationNew method for solving nonlinear sum of ratios problem based on simplicial bisection
V Ù â ð f 33 3 Vol33, No3 2013 3 Systems Engineering Theory & Practice Mar, 2013 : 1000-6788(2013)03-0742-06 : O2112!"#$%&')(*)+),-))/0)1)23)45 : A 687:9 1, ;:= 2 (1?@ACBEDCFHCFEIJKLCFFM, NCO 453007;
More informationConvex Functions and Optimization
Chapter 5 Convex Functions and Optimization 5.1 Convex Functions Our next topic is that of convex functions. Again, we will concentrate on the context of a map f : R n R although the situation can be generalized
More informationIntroduction to Machine Learning Lecture 7. Mehryar Mohri Courant Institute and Google Research
Introduction to Machine Learning Lecture 7 Mehryar Mohri Courant Institute and Google Research mohri@cims.nyu.edu Convex Optimization Differentiation Definition: let f : X R N R be a differentiable function,
More informationFollowing The Central Trajectory Using The Monomial Method Rather Than Newton's Method
Following The Central Trajectory Using The Monomial Method Rather Than Newton's Method Yi-Chih Hsieh and Dennis L. Bricer Department of Industrial Engineering The University of Iowa Iowa City, IA 52242
More informationExistence of minimizers
Existence of imizers We have just talked a lot about how to find the imizer of an unconstrained convex optimization problem. We have not talked too much, at least not in concrete mathematical terms, about
More information3 Measurable Functions
3 Measurable Functions Notation A pair (X, F) where F is a σ-field of subsets of X is a measurable space. If µ is a measure on F then (X, F, µ) is a measure space. If µ(x) < then (X, F, µ) is a probability
More informationThe Split Hierarchical Monotone Variational Inclusions Problems and Fixed Point Problems for Nonexpansive Semigroup
International Mathematical Forum, Vol. 11, 2016, no. 8, 395-408 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/10.12988/imf.2016.6220 The Split Hierarchical Monotone Variational Inclusions Problems and
More informationYuqing Chen, Yeol Je Cho, and Li Yang
Bull. Korean Math. Soc. 39 (2002), No. 4, pp. 535 541 NOTE ON THE RESULTS WITH LOWER SEMI-CONTINUITY Yuqing Chen, Yeol Je Cho, and Li Yang Abstract. In this paper, we introduce the concept of lower semicontinuous
More informationMATHEMATICAL ECONOMICS: OPTIMIZATION. Contents
MATHEMATICAL ECONOMICS: OPTIMIZATION JOÃO LOPES DIAS Contents 1. Introduction 2 1.1. Preliminaries 2 1.2. Optimal points and values 2 1.3. The optimization problems 3 1.4. Existence of optimal points 4
More informationNondifferentiable Higher Order Symmetric Duality under Invexity/Generalized Invexity
Filomat 28:8 (2014), 1661 1674 DOI 10.2298/FIL1408661G Published by Faculty of Sciences and Mathematics, University of Niš, Serbia Available at: http://www.pmf.ni.ac.rs/filomat Nondifferentiable Higher
More informationOPTIMIZATION THEORY IN A NUTSHELL Daniel McFadden, 1990, 2003
OPTIMIZATION THEORY IN A NUTSHELL Daniel McFadden, 1990, 2003 UNCONSTRAINED OPTIMIZATION 1. Consider the problem of maximizing a function f:ú n 6 ú within a set A f ú n. Typically, A might be all of ú
More informationFuchsian groups. 2.1 Definitions and discreteness
2 Fuchsian groups In the previous chapter we introduced and studied the elements of Mob(H), which are the real Moebius transformations. In this chapter we focus the attention of special subgroups of this
More informationOptimality conditions of set-valued optimization problem involving relative algebraic interior in ordered linear spaces
Optimality conditions of set-valued optimization problem involving relative algebraic interior in ordered linear spaces Zhi-Ang Zhou a, Xin-Min Yang b and Jian-Wen Peng c1 a Department of Applied Mathematics,
More informationT i t l e o f t h e w o r k : L a M a r e a Y o k o h a m a. A r t i s t : M a r i a n o P e n s o t t i ( P l a y w r i g h t, D i r e c t o r )
v e r. E N G O u t l i n e T i t l e o f t h e w o r k : L a M a r e a Y o k o h a m a A r t i s t : M a r i a n o P e n s o t t i ( P l a y w r i g h t, D i r e c t o r ) C o n t e n t s : T h i s w o
More informationAffine scaling interior Levenberg-Marquardt method for KKT systems. C S:Levenberg-Marquardt{)KKTXÚ
2013c6 $ Ê Æ Æ 117ò 12Ï June, 2013 Operations Research Transactions Vol.17 No.2 Affine scaling interior Levenberg-Marquardt method for KKT systems WANG Yunjuan 1, ZHU Detong 2 Abstract We develop and analyze
More informationLecture: Duality.
Lecture: Duality http://bicmr.pku.edu.cn/~wenzw/opt-2016-fall.html Acknowledgement: this slides is based on Prof. Lieven Vandenberghe s lecture notes Introduction 2/35 Lagrange dual problem weak and strong
More informationCentre d Economie de la Sorbonne UMR 8174
Centre d Economie de la Sorbonne UMR 8174 On alternative theorems and necessary conditions for efficiency Do Van LUU Manh Hung NGUYEN 2006.19 Maison des Sciences Économiques, 106-112 boulevard de L'Hôpital,
More informationOn the simplest expression of the perturbed Moore Penrose metric generalized inverse
Annals of the University of Bucharest (mathematical series) 4 (LXII) (2013), 433 446 On the simplest expression of the perturbed Moore Penrose metric generalized inverse Jianbing Cao and Yifeng Xue Communicated
More informationNew Class of duality models in discrete minmax fractional programming based on second-order univexities
STATISTICS, OPTIMIZATION AND INFORMATION COMPUTING Stat., Optim. Inf. Comput., Vol. 5, September 017, pp 6 77. Published online in International Academic Press www.iapress.org) New Class of duality models
More informationAlgorithms for nonlinear programming problems II
Algorithms for nonlinear programming problems II Martin Branda Charles University in Prague Faculty of Mathematics and Physics Department of Probability and Mathematical Statistics Computational Aspects
More informationLecture 3. Optimization Problems and Iterative Algorithms
Lecture 3 Optimization Problems and Iterative Algorithms January 13, 2016 This material was jointly developed with Angelia Nedić at UIUC for IE 598ns Outline Special Functions: Linear, Quadratic, Convex
More informationMicroeconomics I. September, c Leopold Sögner
Microeconomics I c Leopold Sögner Department of Economics and Finance Institute for Advanced Studies Stumpergasse 56 1060 Wien Tel: +43-1-59991 182 soegner@ihs.ac.at http://www.ihs.ac.at/ soegner September,
More informationOptimization. A first course on mathematics for economists
Optimization. A first course on mathematics for economists Xavier Martinez-Giralt Universitat Autònoma de Barcelona xavier.martinez.giralt@uab.eu II.3 Static optimization - Non-Linear programming OPT p.1/45
More informationOPTIMALITY CONDITIONS AND DUALITY IN MULTIOBJECTIVE FRACTIONAL PROGRAMMING INVOLVING RIGHT UPPER-DINI-DERIVATIVE FUNCTIONS
Miskolc Mathematical Notes HU e-issn 1787-2413 Vol. 16 (2015), No. 2, pp. 887 906 DOI: 10.18514/MMN.2015.1087 OPTIMALITY CONDITIONS AND DUALITY IN MULTIOBJECTIVE FRACTIONAL PROGRAMMING INVOLVING RIGHT
More informationCSCI : Optimization and Control of Networks. Review on Convex Optimization
CSCI7000-016: Optimization and Control of Networks Review on Convex Optimization 1 Convex set S R n is convex if x,y S, λ,µ 0, λ+µ = 1 λx+µy S geometrically: x,y S line segment through x,y S examples (one
More informationSecond Order Optimality Conditions for Constrained Nonlinear Programming
Second Order Optimality Conditions for Constrained Nonlinear Programming Lecture 10, Continuous Optimisation Oxford University Computing Laboratory, HT 2006 Notes by Dr Raphael Hauser (hauser@comlab.ox.ac.uk)
More informationSupport Vector Machines: Maximum Margin Classifiers
Support Vector Machines: Maximum Margin Classifiers Machine Learning and Pattern Recognition: September 16, 2008 Piotr Mirowski Based on slides by Sumit Chopra and Fu-Jie Huang 1 Outline What is behind
More informationConvex Optimization Theory. Chapter 5 Exercises and Solutions: Extended Version
Convex Optimization Theory Chapter 5 Exercises and Solutions: Extended Version Dimitri P. Bertsekas Massachusetts Institute of Technology Athena Scientific, Belmont, Massachusetts http://www.athenasc.com
More informationMathematical Economics. Lecture Notes (in extracts)
Prof. Dr. Frank Werner Faculty of Mathematics Institute of Mathematical Optimization (IMO) http://math.uni-magdeburg.de/ werner/math-ec-new.html Mathematical Economics Lecture Notes (in extracts) Winter
More informationSummary Notes on Maximization
Division of the Humanities and Social Sciences Summary Notes on Maximization KC Border Fall 2005 1 Classical Lagrange Multiplier Theorem 1 Definition A point x is a constrained local maximizer of f subject
More informationA Brief Review on Convex Optimization
A Brief Review on Convex Optimization 1 Convex set S R n is convex if x,y S, λ,µ 0, λ+µ = 1 λx+µy S geometrically: x,y S line segment through x,y S examples (one convex, two nonconvex sets): A Brief Review
More informationNONDIFFERENTIABLE SECOND-ORDER MINIMAX MIXED INTEGER SYMMETRIC DUALITY
J. Korean Math. Soc. 48 (011), No. 1, pp. 13 1 DOI 10.4134/JKMS.011.48.1.013 NONDIFFERENTIABLE SECOND-ORDER MINIMAX MIXED INTEGER SYMMETRIC DUALITY Tilak Raj Gulati and Shiv Kumar Gupta Abstract. In this
More informationLecture 8 Plus properties, merit functions and gap functions. September 28, 2008
Lecture 8 Plus properties, merit functions and gap functions September 28, 2008 Outline Plus-properties and F-uniqueness Equation reformulations of VI/CPs Merit functions Gap merit functions FP-I book:
More informationBulletin of the Transilvania University of Braşov Vol 10(59), No Series III: Mathematics, Informatics, Physics, 63-76
Bulletin of the Transilvania University of Braşov Vol 1(59), No. 2-217 Series III: Mathematics, Informatics, Physics, 63-76 A CONVERGENCE ANALYSIS OF THREE-STEP NEWTON-LIKE METHOD UNDER WEAK CONDITIONS
More informationNONDIFFERENTIABLE MULTIOBJECTIVE SECOND ORDER SYMMETRIC DUALITY WITH CONE CONSTRAINTS. Do Sang Kim, Yu Jung Lee and Hyo Jung Lee 1.
TAIWANESE JOURNAL OF MATHEMATICS Vol. 12, No. 8, pp. 1943-1964, November 2008 This paper is available online at http://www.tjm.nsysu.edu.tw/ NONDIFFERENTIABLE MULTIOBJECTIVE SECOND ORDER SYMMETRIC DUALITY
More informationSECTION C: CONTINUOUS OPTIMISATION LECTURE 9: FIRST ORDER OPTIMALITY CONDITIONS FOR CONSTRAINED NONLINEAR PROGRAMMING
Nf SECTION C: CONTINUOUS OPTIMISATION LECTURE 9: FIRST ORDER OPTIMALITY CONDITIONS FOR CONSTRAINED NONLINEAR PROGRAMMING f(x R m g HONOUR SCHOOL OF MATHEMATICS, OXFORD UNIVERSITY HILARY TERM 5, DR RAPHAEL
More informationMiscellaneous Nonlinear Programming Exercises
Miscellaneous Nonlinear Programming Exercises Henry Wolkowicz 2 08 21 University of Waterloo Department of Combinatorics & Optimization Waterloo, Ontario N2L 3G1, Canada Contents 1 Numerical Analysis Background
More informationINVEX FUNCTIONS AND CONSTRAINED LOCAL MINIMA
BULL. AUSRAL. MAH. SOC. VOL. 24 (1981), 357-366. 9C3 INVEX FUNCIONS AND CONSRAINED LOCAL MINIMA B.D. CRAVEN If a certain weakening of convexity holds for the objective and all constraint functions in a
More informationLECTURE 12 LECTURE OUTLINE. Subgradients Fenchel inequality Sensitivity in constrained optimization Subdifferential calculus Optimality conditions
LECTURE 12 LECTURE OUTLINE Subgradients Fenchel inequality Sensitivity in constrained optimization Subdifferential calculus Optimality conditions Reading: Section 5.4 All figures are courtesy of Athena
More informationExactness Property of the Exact Absolute Value Penalty Function Method for Solving Convex Nondifferentiable Interval-Valued Optimization Problems
J Optim Theory Appl (2018) 176:205 224 https://doi.org/10.1007/s10957-017-1204-2 Exactness Property of the Exact Absolute Value Penalty Function Method for Solving Convex Nondifferentiable Interval-Valued
More informationSolving generalized semi-infinite programs by reduction to simpler problems.
Solving generalized semi-infinite programs by reduction to simpler problems. G. Still, University of Twente January 20, 2004 Abstract. The paper intends to give a unifying treatment of different approaches
More information