Continuity and Differentiability of Quasiconvex Functions

Size: px
Start display at page:

Download "Continuity and Differentiability of Quasiconvex Functions"

Transcription

1 Continuity and Differentiability of Quasiconvex Functions Jean-Pierre CROUZEIX CUST and LIMOS, Université Blaise Pascal Aubière, France Summer School on Generalized Convexity Samos, August 1999 Abstract Continuity and differentiability of quasiconvex functions are studied. The connection with the monotonicity of real functions of several variables receives a special emphasis. 1 Introduction and notation The properties of convex functions are well known. A convex function of one real variable admits right and left derivatives at any point in the interior of its domain, hence it is continuous at such a point. A convex function f defined on a normed linear space E is continuous at x E if bounded in a neighbourhood of x. If, in addition, E = R n and x belongs to the interior of the domain of f, then f is continuous at x, the directional derivatives f (x, d) of f at x with respect to the directions d are well defined. Furthermore, f (x, d) is convex in d, and the subgradient f(x) off at x is defined as the closed convex set such that f(x) = { x : d, x f (x, d) for all d }. 1

2 It is important to notice that all these properties are due to the geometrical structures induced by the convexity of f. Indeed, the strict epigraph of f is convex in E R. Let x int(domf), then Let us define the following set {(x, f(x))} {(y, λ) :f(y) <λ} =. T (a) ={(x,λ ): x,y x + λ (λ f(x)) 0 (y, λ) s.t. f(y) <λ} (1) Then, in view of separation theorems on convex sets, T (a) is a nonempty closed convex cone and f(a) is obtained from T (a) as follows x f(a) (x, 1) T (a). The epigraph of a quasiconvex function is not convex, hence separation theorems do not apply, thence it is not possible to deal in a similar way. Still, convexity is present through the lower level sets of the function and it gives birth to some interesting properties. The purpose of this lecture is to show how to exploit this convexity. Through the lecture, we use the following notation: Let E be a normed linear real space and f : E [, + ] (as usual in convex analysis, we consider functions defined on the whole space; if it is not the case set f(x) =+ for x not in the domain). For λ (, ) let us define Clearly, for λ<µ, It is also easily seen that S λ (f) = {x : f(x) λ}, and Sλ (f) = {x : f(x) <λ}. S λ (f) S λ (f) S µ (f) S µ (f). S λ (f) = µ>λ Sµ (f) = µ>λ S µ (f). The function f can be recovered from its level sets, indeed: f(x) = inf [ λ : x S λ (f) ] = inf [ λ : x S λ (f)]. 2

3 By definition, f is said to be quasiconvex on E if x, y E, 0 <t<1= f(tx +(1 t)y) max[ f(x),f(y)], and strictly quasiconvex on C E, C being convex, if x, y C, x y, 0 <t<1= f(tx +(1 t)y) < max[ f(x),f(y)]. Quasiconvexity has a geometrical interpretation, indeed f quasiconvex S λ (f) convex λ R S λ (f) convex λ R. Recall that for a function f : E [, + ], and f lower semi-continuous (lsc in short) S λ (f) closed λ R f upper semi-continuous (usc in short) S λ (f) open λ R. A set C E is said to be evenly convex if it is the intersection of open half spaces. It results from separation theorems that open and closed convex sets are evenly convex. A function f is said to be evenly quasiconvex if all S λ (f) are convex. Lower semi-continuous quasiconvex functions and upper semi-continuous quasiconvex functions are evenly quasiconvex. Sometimes, infinite values are not well praised when considering continuity and differentiability. It is easy to avoid this problem: Given g : E [, + ], let us consider f(x) = arctan g(x). Then f : E [ π, + π ]. It is easy to see that f is (evenly) quasiconvex 2 2 if and only if g is (evenly) quasiconvex and f is lsc (usc) at a point a if and only if g is so. In this spirit, we shall say that g is differentiable at a if f is differentiable at this point. Thus, for continuity and differentiability questions in quasiconvex analysis, it is sufficient to consider functions which are finite on the whole space. 3

4 2 Regularized quasi convex functions Given a family {T λ } λ R such that T λ T µ E for all λ, µ R such that λ<µ, we define a function g : E [, + ] by Then, g(x) = inf [ λ : x T λ ]. S λ (g) = µ>λ T µ. Given f : E [, + ], we apply this process to the sets T λ = cl(s λ (f)), T λ = co(s λ (f)), T λ = eco(s λ (f)), and T λ = co(s λ (f)) where cl(s), co(s), eco(s) and co(s) denote the closure (i.e. the closed hull), the convex hull, the evenly convex hull and the closed convex hull of S respectively. We denote by f, f q, f e and f q respectively the different functions obtained with the process. Because any intersection of closed (convex, evenly convex, closed convex) sets is closed (convex, evenly convex, closed convex), then f, f q, f e and f q are respectively the greatest lower semi-continuous, quasiconvex, evenly quasiconvex, and lsc quasiconvex functions bounded from above by f. If is seen that f = f q when f is quasiconvex. The proof of the following result is rather easy and left to the reader. Proposition 2.1 Let f : E [, + ]. Then On the other hand, since f is lsc at a f(a) =f(a). S λ ( f) = µ>λ cl(s µ (f)) and S λ (f) = µ>λ S µ (f), it follows that for all λ R cl(s λ (f)) S λ ( f). The equality does not hold for a general function. However, for a quasiconvex function, we have the following result: 4

5 Proposition 2.2 Assume that f is quasiconvex and int(s λ (f)). Then cl(s λ (f)) = S λ ( f). Proof: Fix a int(s λ (f)). Let x S λ ( f), then x cl(s µ (f)) for all µ>λ and x t = x+t(a x) int(s µ (f)) for all t (0, 1). It follows that x t S λ (f) and therefore x cl(s λ (f)). Furthermore, for quasiconvex functions, we have also the following result: Proposition 2.3 Assume that f : R n [, + ] is quasiconvex. Then f is continuous at x if and only if f is continuous at x. Proof: Assume that f is continuous at x. Then f is lsc by definition, it is also usc at x since f q ( x) =f( x), f q f and f is usc at x. Next, assume that f is continuous at x. Let λ>f( x). Then S λ ( f) =cl(s λ (f)) is a neighbourhood of x. Since int(cl(s)) = int(s) for a convex set S with int(s), then S λ (f) is a neighbourhood of x as well. The conclusion follows. Evenly convex sets have been introduced by Fenchel [10]. Evenly quasiconvex functions have been introduced by Passy and Prisman [13] and, independently, by Martinez-Legaz [11]. The description of the process for constructing regularized functions is given in Crouzeix [3, 6]. 3 Quasiconvexity and monotonicity Let θ : R [, + ]. Then θ is quasiconvex if and only if there exists t [, + ] so that: either θ is nonincreasing on (,t] and nondecreasing on (t, + ) I, or θ is nonincreasing on (,t) and nondecreasing on [t, + ) I. Thus, the simplest examples of quasiconvex functions are the nondecreasing functions of one real variable. It results that, unlike convex functions, quasiconvex functions are not continuous in the interior of their domain. A fortiori, directional derivatives are not necessarily defined. Still, nondecreasing functions of one real variable are almost everywhere continuous and differentiable, hence quasiconvex functions of one real variable are also almost everywhere continuous and differentiable on the interior of their domains. 5

6 Quasiconvex functions of several variables have also connections with monotonicity. Let E be a normed linear space, f : E [, + ] and K be a convex cone of E, f is said to be nondecreasing with respect to K if x, y E, y x K = f(x) f(y). Theorem 3.1 Let f : E (, + ), f quasiconvex, λ R and a E such that int(s λ (f)) and a/ cl(s λ (f)). Then there exists an open convex neighbourhood V of a and a nonempty open convex cone K so that x, y V, y x K = f(x) f(y). Futhermore, if f is strictly quasiconvex x, y V, y x K, x y = f(x) <f(y). Proof: Let b int(s λ (f)), r>0 and R>0 be such that B(b,r) S λ (f) and S λ (f) B(a, R) =. Let some t >0. Set c = a + t(a b) and K = {d : c td B(b,r) for some t>0}. Then K is a nonempty open convex cone. Hence y K c K for all y c K. Set V = (c K) B(a, R). Assume that x, y V with y x K. Then there is t>1 so that z = y + t(x y) B(b,r). Notice that f(z) λ < f(y). The results follows from the (strict) quasiconvexity of f. In the particular case where E = R n, we derive the following result. Corollary 3.1 Let f : R n (, + ), f quasiconvex, λ R and a R n such that int(s λ (f)) and a/ cl(s λ (f)). Then there exist an open convex neighbourhood V of a and v 1,v 2,,v n, n linearly independent vectors such that x, x + t i v i V, t 1,t 2,,t n 0= f(x) f(x + t i v i ). Futhermore, if f is strictly quasiconvex and t i > 0, then the inequality is strict. 6

7 Proof: Choose for vectors v i n linearly independent vectors in K. In R n, locally Lipschitz functions also are strongly connected to monotonicity. Indeed, assume that f is locally Lipschitz in a neighbourhhod of a, i.e., there is r>0 and L>0 such that x i,y i [a i r, a i + r] for all i = f(y) f(x) L y i x i. Define g(x) =f(x)+l x i. Then a i r x i y i a i + r for all i implies g(x) g(y). 4 Continuity Given f : E [, + ], a E with <f(a) < + and a direction d E, we define the function of one real variable f a,d (t) =f(a + td). The first result concerns nondecreasing functions. Proposition 4.1 Assume that f(a) is finite, K is a convex cone with nonempty interior, f is nondecreasing with respect to K and d int(k). Then f is lsc (usc) at a if and only if f a,d is lsc (usc) at 0. Proof: Assume that f a,d is lsc (usc) at 0. Let λ <f(a) (λ + >f(a)). Then there is t < 0(t + > 0) such that λ <f(a+td) for all t t (λ + >f(a+td) for all t t + ). Take V =(a + t d)+k (V =(a + t + d) K). V is a neighbourhood of a and λ <f(a + t d) f(x) (λ + >f(a + t + d) f(x)) for all x V. We have seen (Theorem 3.1) that quasiconvex functions can be considered locally nondecreasing with respect to some open convex cone K. Hence the last proposition can be applied. However, a stronger result holds. Assume that f is quasiconvex and f(a) is finite. Let us define K(a) ={d : f(a + td) <f(a) for some t>0} (2) K(a) is a convex cone. Its interior is nonempty as soon as int( S f(a) (f)). Notice that K(a) contains the cones K of Theorem 3.1. Then, we have: 7

8 Proposition 4.2 Assume that f is quasiconvex, f(a) is finite and d int( K(a)). Then f is lsc (usc) at a if and only if f a,d is lsc (usc) at 0. Proof: Combine the proof of the last proposition with the proof of Theorem 3.1. In these two propositions, we have considered continuity in one direction d belonging to a specific cone. The following result can appear weaker since it involves continuity in all directions, but it deserves to be given in reason of its very simple formulation. Theorem 4.1 [3, 6] Assume that f is quasiconvex on R n and f(a) is finite. Then f is lsc (usc) at a if and only if, for all d R n, the function f a,d is lsc (usc) at 0. Proof: Assume that, for all d, f a,d is lsc at 0 and prove that f is lsc at a. If S f(a) (f) = there is nothing to prove. If not take some d in the relative interior of K(a) and adapt the proof of the last proposition. Next, assume that, for all d, f a,d is usc at 0. Let λ>f(a). Take d = e i be the i-th vector of the canonical basis of R n. There is t i > 0 such that f(a + td i ) <λfor all t [ t i,t i ]. Take for V the convex hull of the 2n points a ± t i d i. Then V is a neigborhood of a and V S λ (f). This result says that, in R n, a quasiconvex function is continuous at a if it is continuous along the lines at this point. Such a result does not hold for nondecreasing functions as it can be seen from easily obtained examples. Also, it does not hold for an infinite dimensional linear space: take a linear but not continuous function. 5Differentiability: notation and first results We start with the notation. Assume that f(a) is finite and h E. Then the upper and the lower Dini-derivative of f at a with respect to the direction h are respectively defined by f +(a, h) = lim sup t 0 + f (a, h) = lim inf t f(a + th) f(a), t f(a + th) f(a). t

9 If <f (a, h) =f +(a, h) < then the directional derivative of f with respect to the direction h exists and is defined by If for all h E f (a, h) =f (a, h) =f (a, h). f (a, h) and f (a, h) exist and f (a, h)+f (a, h) =0 then f is said to be differentiable at a along the lines or again weakly Gateauxdifferentiable at a. If there is a vector c E such that f (a, h) = c, h h E then f is said to be Gateaux-differentiable at a. Such a c is uniquely defined. It is called the (Gateaux-) gradient of f at a and denoted by f(a). If f is Gateaux-differentiable at a and f(a + h) f(a) f(a),h h 0 when h 0 then f is said to be Fréchet-differentiable at a. Although Fréchet- and Gateaux-differentiability do not coincide for a general function, they coincide when the function is monotone on R n. Theorem 5.1 (Chabrillac-Crouzeix [2]) Let f : R n [, ], K be a nonempty open convex cone. Assume that f is nondecreasing with respect to K and f is Gateaux-differentiable at a. Then f is Fréchet-differentiable at a. Proof: Assume that f is Gateaux- but not Fréchet-differentiable at a. Then there exist ɛ>0 and a sequence {h n } n converging to 0 such that for all n 7ɛ < f(a + h n) f(a) f(a),h n. (3) h n Set d n = 1 h h n n. Without loss of generality, we can assume that all the sequence {d n } n converges to some d. Let e int(k). Then µ>0 exists so that f(a),d d <ɛfor all d V (4) 9

10 where V = {d : d µe = d d d + = d + µe }. Then V is a neighbourhood of d. Forn large enough, d n V and therefore f(a + h n d ) f(a) f(a + h n ) f(a) f(a + h n d + ) f(a). (5) Since f is Gateaux-differentiable at a, for n large enough f(a + h n d ) f(a) f(a), h n d h n <ɛ, (6) and f(a + h n d + ) f(a) f(a), h n d + <ɛ. (7) h n The contradiction follows from Equations (3), (4), (5), (6) and (7). As an immediate corollary, we see that Gateaux- and Fréchet-differentiability coincide for locally Lipschitz functions on R n. Also, Theorem 5.1 can be applied to quasiconvex functions. Theorem 5.2 Assume that f : R n [, ] is quasiconvex. If f is Gateaux-differentiable at a, then f is Fréchet-differentiable at a as well. Proof: Let S = {x : f(x) <f(a)}. If int(s), there is λ R such that int(s λ (f)) and a/ cl(s λ (f)). The result follows from Theorems 3.1 and 5.1. If S =. Then f(x) f(a) for all x and therefore f(a) = 0. Let (e 1,e 2,,e n ) be the canonical basis of R n. Set e i+n = e i for i =1,,n. For h R n take t i = max[0,h i ] and t i+n = max[0, h i ]. Then a + h = a + i=2n i=1 t i e i = i=2n i=1 (a + t i h h e i) where h = i=n i=1 h i = i=2n i=1 t i. Then, since f is quasiconvex 0 f(a + th) f(a) h max i=1,,2n f(a + h e i ) f(a), h and the result follows again. 10

11 We are left with the case where int(s) = but S. Here again f(a) = 0. The proof is obtained in working on the affine set generated by S and using the same proof as above. A previous proof by Crouzeix [8] of that theorem does not make use of Theorem 5.1. It is well known that a nondecreasing function of one real variable is almost everywhere differentiable. The result still holds in R n. Theorem 5.3 (Chabrillac-Crouzeix [2]) Let f : R n [, ], K be a nonempty open convex cone. Assume that f is nondecreasing with respect to K. Then f is almost everywhere Fréchet-differentiable. The celebrated Rademacher s theorem on locally Lipschitz functions can be viewed as a corollary of this theorem. Another consequence is that quasiconvex functions on R n are also almost everywhere Fréchet-differentiable, a previous and direct proof of this result was given in Crouzeix [7]. 6 Directional derivatives It is clear that, for a general function, the Dini-derivatives f (a, h) and f +(a, h) are positively homogeneous of degree 1 with respect to the direction h. This is also the case for the directional derivative f (a, h) when defined. The following proposition is a direct consequence of quasiconvexity. Proposition 6.1 Assume that f : E [, ], f is quasiconvex and f(a) is finite. Then h : f +(a, h) is quasiconvex. There are counter-examples (Crouzeix [5]) where the function f is quasiconvex, but the lower Dini-derivative is not. The fact that, for a convex function, the directional derivative f (a, h) is convex and positively homogeneous in h has strong implications. Indeed, the indicator function of f(a), the Fenchel-subgradient of f at a, is nothing else that the Fenchel-conjugate of the function f (a,.). Quasiconvex positively homogeneous functions also will play a fundamental role as seen below. Theorem 6.1 (Newman [12], Crouzeix [4]) Assume that C E is convex and θ : C (, + ] is quasiconvex and positively homogeneous of degree one. 11

12 1. If θ(x) < 0 for all x C, then θ is convex on C, 2. If f θ(x) 0 for all x C, then θ is convex on C. Proof: Several types of proofs can be given. The following one is based on the geometrical aspect of convexity. Consider in case 1) and in case 2) S = S 1 (θ) { 1} E R, S = S 1 (θ) {1} E R. Next, let us consider the consider the cone T in E R generated by S. Both S and T are convex. In case 1) T corresponds to the epigraph of θ. In case 2) take T = T (S {0}) where S is the recession cone of S 1 (θ). Then, T corresponds to the the epigraph of θ as well. Now, assume that θ : R n (, + ] is quasiconvex and positively homogeneous of degree 1. Define θ and θ + by if θ(x) < 0 then θ (x) =θ(x) and θ + (x) =0, if θ(x) 0 then θ (x) =+ and θ + (x) =θ(x) (8) Then θ(x) = min[ θ (x),θ + (x) ]. Hence θ is the minimum of two convex functions. This decomposition will be useful for the directional derivatives and the upper Dini-derivatives of quasiconvex functions, indeed they are quasiconvex in the direction. Theorem 6.2 (Crouzeix [8]) Assume that f : E [, ] is quasiconvex, f(a) is finite and f is weakly Gateaux-differentiable at a. Then f is Gateauxdifferentiable at a as well. Proof: By assumption, f (a, h) +f (a, h) = 0 for all h. If f (a, h) =0 for all h, take f(a) = 0. Next, assume that f (a, h) 0 for some h. Set θ(h) =f (a, h), S = {h E : f (a, h) < 0}, S 0 = {h E : f (a, h) 0} and S + = {h E : f (a, h) > 0}. Then, S + = S. The sets S,S 0 and S + are convex. S 0 and S + are two complementarity sets. Hence the closure of S 0 is an half space. The functions θ and θ + are convex on S and S + respectively, furthermore θ (h) = θ + ( h) for all h S = S +. Hence θ is linear on S. Finally, it is seen that θ is linear on the whole space. 12

13 It follows that, for quasiconvex functions on R n,fréchet-, Gateaux- and weakly Gateaux-differentiability coincide. For nondecreasing functions on R n, Gateaux- and weakly Gateaux-differentiability do not coincide in general. The next theorem is to be compared with Proposition 4.2. The proof being not immediate, the reader is directed to Crouzeix [5]. As in Proposition 4.2, it involves the convex cone K(a) ={d : f(a + td) <f(a) for some t>0}. If f is differentiable at a and f(a) 0, then the closure of K(a) isan half-space. The theorem corresponds to a converse implication. Theorem 6.3 Assume that f is quasiconvex on R n, f(a) is finite, the closure of K(a) is an half space and d int( K(a)). Then f is Gateaux-differentiable at a if and only if the function of one real variable f a,d is differentiable at 0. 7 More on the Dini-derivatives The first result concerns nondecreasing functions. The proof is easy and left to the reader. Proposition 7.1 Assume that K is a convex cone with int(k) and f is nondecreasing with respect to K. Then f (a,.) and f +(a,.) are nondecreasing with respect to K. Hence they are continuous on K K. If f is quasiconvex, the result still holds with K(a) instead of K. Proposition 7.2 Assume f quasiconvex and f(a) is finite. Then f (a,.) and f +(a,.) are nondecreasing with respect to K(a), f (a,.) and f +(a,.) are continuous on int( K(a)) and int( K(a)). The following result [5] makes more clear the connection between the Diniderivatives and the cone K(a). Proposition 7.3 Assume f quasiconvex and f(a) is finite. Then h K(a) f (a, h) f +(a, h) 0, 13

14 h/ K(a) 0 f (a, h) f +(a, h) +, If h such that f (a, h) < 0 then f (a, d) < 0 for all d int( K(a)), If h int( K(a)) such that f (a, h) > then f (a, d) > for all d, If h such that f +(a, h) < 0 then f +(a, d) < 0 for all d int( K(a)), If h int( K(a)) such that f +(a, h) > then f +(a, d) > for all d. Let C be a convex set and f : C R be differentiable at a C. fonction f is said to be pseudoconvex at a on C if The y C and f(y) <f(a) f(a),y a < 0. If f is pseudoconvex at any a C then it is quasiconvex on C. Pseudoconvexity can be relaxed thanks to Dini-derivatives. A function f defined on a convex set C finite at a C is said to be D + pseudoconvex at a on C if y C and f(y) <f(a) f +(a, y a) < 0, and D pseudoconvex at a on C if y C and f(y) <f(a) f (a, y a) < 0. Proposition 7.3 says that a quasiconvex function is D + pseudoconvex and D pseudoconvex at a as soon as f +(a, h) and f +(a, h) respectively are negative for some h. Then, according to the case K(a) ={ h : f +(a, h) < 0}, or K(a) ={ h : f (a, h) < 0}. If S(a) ={x : f(x) <f(a)} and f is pseudoconvex at a in one of the senses above, then a cl( S(a)). That motivates another relaxation of 14

15 pseudoconvexity, still weaker than the previous ones: a quasiconvex function is said to be S pseudoconvex if S(a) a cl( S(a)) The Dini-derivatives of a quasiconvex functions are not finite in general. Assume that f is quasiconvex, D + pseudoconvex at a and f +(a, h) < for all h. Since f +(a,.) is quasiconvex and positively homogeneous of order 1, then the decomposition (8) can be applied. It follows that f +(a,.) is the minimum of two finite convex functions, hence it is continuous except perhaps on the boundary of K(a). Furthermore, it is convex on K(a). The same conclusions do not hold for f (a,.) because not quasiconvex. Generalized derivatives have been made popular with the Clarke approach. A good situation is when the function is locally Lipschitz. Unlike convex functions, quasiconvex functions are not locally Lipschitz on the interior of their domain: Lipschitz properties do not belong to the essence of quasiconvexity. Henceforth, our intimate opinion is that generalized derivatives for locally Lipschitz functions are quite inappropriate in quasiconvex analysis. However, because so many people have tried to adapt these generalized derivatives, we indicate that for quasiconvex functions, the Lipschitz condition holds if it holds in one direction. The result is as follows: Theorem 7.1 (Crouzeix [9]) Assume that f is quasiconvex on an open convex set C. Asume in addition that there exist a convex cone K, h int(k) and a constant L such that K K(x) for all x C, f(x + th) f(x) L t for all t and x such that both x and x + th lie in C. Then there exists a constant ˆL such that f(x) f(y) ˆL x y for all x, y C. Theorem 3.1 gives conditions for the existence of such a cone K. 15

16 8 The normal cone Quasiconvex analysis finds its main applications in optimization. A general formulation of an optimisation problem is minimize f(x) subject to x C. If C is convex and f is quasiconvex then we are faced with a quasiconvex optimization problem. A point a C is an optimal solution if {x : f(x) <f(a)} C =. Both sets are convex. Hence we are concerned with vectors a 0 such that a,x a 0 a,z a x, z so that z C, f(x) <f(a). Such vectors belong to the closed convex cone Ñ(a) ={ a : a,x a 0 for all x so that f(x) <f(a)} which is nothing else that the polar cone of K(a), i.e. Ñ(a) ={ a : a,d 0 for all d K(a)}. If f is convex and a belongs to the interior of the domain of f, then Ñ(a) is the projection on E of the set T (a) in Equation (1). Hence, Ñ(a) is the closed convex cone generated by f(a), the Fenchel subgradient of f at a. T (a) is the normal cone at point (a, f(a)) to the epigraph of f. When point a moves, then (a, f(a)) moves on the boundary of the epigraph which is convex. Hence the map T has continuity properties which afterwards implies continuity properties on the map f. These properties are the tools used to analyse sensibility in convex programming. The epigraph of a quasiconvex function is not convex and T (a) cannot be used. However, the level sets are convex and therefore continuity should be considered not on the map T but on the map Ñ. Recall that a point-to-set map M : E F is said to be closed at a point a if given a sequence {(a n,b n )} n converging to (a, b) with b n M(a n )we have b M(a). 16

17 The map is said to be closed on E if closed at any point a E. It is known that a map is closed on E if and only if its graph G(M) ={(x, y) :y M(x)} is a closed subset of E F. The map M is said to be USC at a point a if for all open set Ω M(a) there is a neighbourhood V of a such that Ω M(x) for all x V. We shall use the following well known characterization. Proposition 8.1 Let M : E K be a point-to-set map where E is a metric space and K is a compact set. Assume that, for all x in a neighbourhood of a, the set M(x) is compact and nonempty and the map M is closed at x. Then M is USC at a. Proposition 8.2 Let f : E [, + ] be quasiconvex. Assume that f is finite and lsc at a. Then Ñ is closed at a. Proof. Let {(a n,b n )} n be sequence converging to (a, b) with b n Ñ(a n). Let x be such that f(x) <f(a). Then there is a neighbourhood V of a such that f(x) <f(y) for all y V. For n large enough, a n V and therefore, because b n Ñ(a n), b n,x a n 0. Hence, passing to the limit b,x a 0. Because the inequality holds for all x with f(x) <f(a), it results that b Ñ(a). The normal cone Ñ is, of course, unbounded. Continuity with unbounded maps is sometimes difficult to handle. It is one of the reasons why the subgradient is used in sensibility in convex programming instead of the normal cone T at the epigraph. We shall say that a point-to-set map M : E F is C-USC at a (Borde- Crouzeix [1]) if there is a compact-valued map C such that C is USC at a and, for all x, M(x) is the cone generated by C(x), i.e. M(x) ={ y = λd : λ 0 and d C(x) }. Theorem 8.1 Let f : E (, + ), f quasiconvex, λ R and a E such that int(s λ (f)) and a/ cl(s λ (f)). Then Ñ is C-USC at a. 17

18 Proof: By Theorem 3.1, there is K an open nonempty convex cone such that K K(x) for x close to a. Let d K be fixed. We define a map C by C(x) ={ x Ñ(x) : x, d =1}. Then, for x close to a, M(x) is generated by C(x). Hence C is closed at x. Furthermore C(x) C = { x K o : x, d =1} where K o is the polar cone of K. The set C is compact and the result follows. If a convex function is differentiable, then its gradient is continuous. Now, assume that we are faced with a function f which is differentiable and quasiconvex. Let a be such f(a) 0. Then Ñ(a) ={λ f(a) :λ 0}. It results from Theorem 8.1 that the map 1 x f(x) f(x) is continuous at any x where the gradient does not vanishes. Recall that, for a convex function, the gradient itself is continuous, for a quasi convex function it is only the direction given by the gradient which is continuous. Some people prefer to consider the normal cone N(a) ={ a : a,x a 0 for all x so that f(x) f(a)} instead of Ñ(a). When f is pseudoconvex in one of the different senses we have given, the two cones coincide. 9 Are the generalized derivatives useful in quasiconvex analysis? Assume that f is finite in a. A general formulation of a generalized derivative of f at a with respect to a direction d is as follows f! (a, d) = some kind of limit 1 [f(x + th) f(y)] t when t 0 +,x,y aand h d. 18 (9)

19 The different ways by which the arguments x, y converge to a, h converges to d, the different orders to take the limits with respect to the arguments, the different types of limit (sup, inf,...) give birth to many combinations quite appropriate to exercice the skills of a mathematician. For instance, the upper (lower) Dini-derivative corresponds to the case where x = y = a, h = d and the limit is the limit sup (limit inf). Once a generalized derivative is defined, a generalized subgradient is built as the closed convex set! f(a) such that! f(a) = { x : d, x f! (a, d) for all d }. Now, it is time to look at the uses of such a generalized derivative and such a subgradient. Because we deal with optimization problems, the first use concerns optimality conditions. We have seen that, in the quasiconvex setting, the normal cone Ñ(a) plays a fundamental role.hence, the first property to be asked to generalized derivatives and/or generalized subgradients is that they allow to recover the cone Ñ(a). The second important use concerns sensibility. For that, a standard approach consists to consider some continuity on the subgradient, this continuity is provided in general by considering the convergences of the arguments x, y and h to a, a and d respectively in definition (9). Is it really necessary to consider generalized derivatives and the associated subgradient and not to consider directly the normal cone Ñ(a)? We have seen, in the last section, that the normal cone has the wished continuity property. Anyway, if we want to consider some generalized derivatives and their associate generalized subgradients, the simplest ones seem the best. Since, unlike in the convex case, directional derivatives cannot be considered, the best candidates are the Dini-derivatives. If f is pseudoconvex then Proposition 7.3 shows that Ñ(a) can be recovered from the Dini-derivatives. For simplicity we assume that these Dini-derivatives are finite. Let us define and u f(a) ={x : f +(a, d) x,d for all d K(a)}. l f(a) ={x : f (a, d) x,d for all d K(a)}. Then, Ñ(a) is the cone generated by u f(a) and/or l f(a), hence it is thoroughly defined from the knowledge of these sets. Furthermore, because 19

20 f +(a,.) is quasiconvex, for all h int( K(a)) f +(a, h) = sup[ x,h : x u f(a)]. An exhaustive bibliography on generalized derivatives and generalized subgradients in quasiconvex programming is reference [14]. References [1] J. Borde and J.-P. Crouzeix, Continuity of the normal cones to the level sets of quasi convex functions, Journal of Optimization Theory and Applications, Vol. 66, No 3,1990, [2] Y. Chabrillac and J.-P. Crouzeix, Continuity and differentiability properties of monotone real functions of several variables, Mathematical Programming Study, 30, 1987, pp [3] J.-P. Crouzeix, Contribution à l étude des fonctions quasiconvexes, Thèse de Docteur es Sciences, Université de Clermont-Ferrand 2, [4] J.-P. Crouzeix, Conditions for convexity of quasiconvex functions, Mathematics of Operations Research, Vol. 5, no 1, 1980, [5] J.-P. Crouzeix, Some differentiability properties of quasiconvex functions on R n, Optimization and Optimal Control, A. Auslender, W. Oettli and J. Stoer, editors, Springer-Verlag, Lecture Notes in Control and Information Sciences, Vol. 30, 1981, pp [6] J.-P. Crouzeix, Continuity and differentiability properties of quasiconvex functions, Generalized Concavity in Optimization and Economics, S. Schaible and W.T. Ziemba editors, Academic Press, New-York, 1981, pp [7] J.-P. Crouzeix, A review of continuity and differentiability properties of quasiconvex functions on R n, Convex Analysis and Optimization, J.-P. Aubin and R. Vinter editors, Research Notes in Mathematics, Vol. 57, Pitman Advanced Publishing Programs, 1982,

21 [8] J.-P. Crouzeix, About differentiability properties of quasiconvex functions, Journal of Optimization Theory and Applications, 36, 1982, pp [9] J.-P. Crouzeix, Some properties of Dini-derivatives of quasiconvex and pseudoconvex functions, New Trends in Mathematical Programming, F. Gianessi, T. Rapcsak and S. Komlosi editors, Kluwer Academic Publishers, 1998, [10] W. Fenchel, Convex cones sets and functions, Mimeographed lecture notes, Princeton University, [11] J.-E. Martinez-Legaz, Un concepto generalizado de conjugacion, applicacion a las funciones quasiconvexas, doctoral thesis, Universidad de Barcelona, [12] P. Newman, Some properties of concave functions, Journal of economic theory 1 (1969), [13] U. Passy and E.Z. Prisman, Conjugacy in quasiconvex Programming, Mathematical Programming 30 (1984), [14] J.-P. Penot, Are generalized derivatives useful for generalized convex functions?, Generalized Convexity, Generalized Monotonicity, J.-P. Crouzeix, J.-E. Martinez-Legaz and M. Volle editors, Kluwer Academic Publishers, 1998,

Journal of Inequalities in Pure and Applied Mathematics

Journal of Inequalities in Pure and Applied Mathematics Journal of Inequalities in Pure and Applied Mathematics http://jipam.vu.edu.au/ Volume 4, Issue 4, Article 67, 2003 ON GENERALIZED MONOTONE MULTIFUNCTIONS WITH APPLICATIONS TO OPTIMALITY CONDITIONS IN

More information

Optimization and Optimal Control in Banach Spaces

Optimization and Optimal Control in Banach Spaces Optimization and Optimal Control in Banach Spaces Bernhard Schmitzer October 19, 2017 1 Convex non-smooth optimization with proximal operators Remark 1.1 (Motivation). Convex optimization: easier to solve,

More information

On Optimality Conditions for Pseudoconvex Programming in Terms of Dini Subdifferentials

On Optimality Conditions for Pseudoconvex Programming in Terms of Dini Subdifferentials Int. Journal of Math. Analysis, Vol. 7, 2013, no. 18, 891-898 HIKARI Ltd, www.m-hikari.com On Optimality Conditions for Pseudoconvex Programming in Terms of Dini Subdifferentials Jaddar Abdessamad Mohamed

More information

Optimality Conditions for Nonsmooth Convex Optimization

Optimality Conditions for Nonsmooth Convex Optimization Optimality Conditions for Nonsmooth Convex Optimization Sangkyun Lee Oct 22, 2014 Let us consider a convex function f : R n R, where R is the extended real field, R := R {, + }, which is proper (f never

More information

Transformation of Quasiconvex Functions to Eliminate. Local Minima. JOTA manuscript No. (will be inserted by the editor) Suliman Al-Homidan Nicolas

Transformation of Quasiconvex Functions to Eliminate. Local Minima. JOTA manuscript No. (will be inserted by the editor) Suliman Al-Homidan Nicolas JOTA manuscript No. (will be inserted by the editor) Transformation of Quasiconvex Functions to Eliminate Local Minima Suliman Al-Homidan Nicolas Hadjisavvas Loai Shaalan Communicated by Constantin Zalinescu

More information

Chapter 2 Convex Analysis

Chapter 2 Convex Analysis Chapter 2 Convex Analysis The theory of nonsmooth analysis is based on convex analysis. Thus, we start this chapter by giving basic concepts and results of convexity (for further readings see also [202,

More information

Convex Functions. Pontus Giselsson

Convex Functions. Pontus Giselsson Convex Functions Pontus Giselsson 1 Today s lecture lower semicontinuity, closure, convex hull convexity preserving operations precomposition with affine mapping infimal convolution image function supremum

More information

Relaxed Quasimonotone Operators and Relaxed Quasiconvex Functions

Relaxed Quasimonotone Operators and Relaxed Quasiconvex Functions J Optim Theory Appl (2008) 138: 329 339 DOI 10.1007/s10957-008-9382-6 Relaxed Quasimonotone Operators and Relaxed Quasiconvex Functions M.R. Bai N. Hadjisavvas Published online: 12 April 2008 Springer

More information

g 2 (x) (1/3)M 1 = (1/3)(2/3)M.

g 2 (x) (1/3)M 1 = (1/3)(2/3)M. COMPACTNESS If C R n is closed and bounded, then by B-W it is sequentially compact: any sequence of points in C has a subsequence converging to a point in C Conversely, any sequentially compact C R n is

More information

FIRST ORDER CHARACTERIZATIONS OF PSEUDOCONVEX FUNCTIONS. Vsevolod Ivanov Ivanov

FIRST ORDER CHARACTERIZATIONS OF PSEUDOCONVEX FUNCTIONS. Vsevolod Ivanov Ivanov Serdica Math. J. 27 (2001), 203-218 FIRST ORDER CHARACTERIZATIONS OF PSEUDOCONVEX FUNCTIONS Vsevolod Ivanov Ivanov Communicated by A. L. Dontchev Abstract. First order characterizations of pseudoconvex

More information

Helly's Theorem and its Equivalences via Convex Analysis

Helly's Theorem and its Equivalences via Convex Analysis Portland State University PDXScholar University Honors Theses University Honors College 2014 Helly's Theorem and its Equivalences via Convex Analysis Adam Robinson Portland State University Let us know

More information

4. Convex Sets and (Quasi-)Concave Functions

4. Convex Sets and (Quasi-)Concave Functions 4. Convex Sets and (Quasi-)Concave Functions Daisuke Oyama Mathematics II April 17, 2017 Convex Sets Definition 4.1 A R N is convex if (1 α)x + αx A whenever x, x A and α [0, 1]. A R N is strictly convex

More information

Lecture 7 Monotonicity. September 21, 2008

Lecture 7 Monotonicity. September 21, 2008 Lecture 7 Monotonicity September 21, 2008 Outline Introduce several monotonicity properties of vector functions Are satisfied immediately by gradient maps of convex functions In a sense, role of monotonicity

More information

Convex Analysis and Economic Theory AY Elementary properties of convex functions

Convex Analysis and Economic Theory AY Elementary properties of convex functions Division of the Humanities and Social Sciences Ec 181 KC Border Convex Analysis and Economic Theory AY 2018 2019 Topic 6: Convex functions I 6.1 Elementary properties of convex functions We may occasionally

More information

On Semicontinuity of Convex-valued Multifunctions and Cesari s Property (Q)

On Semicontinuity of Convex-valued Multifunctions and Cesari s Property (Q) On Semicontinuity of Convex-valued Multifunctions and Cesari s Property (Q) Andreas Löhne May 2, 2005 (last update: November 22, 2005) Abstract We investigate two types of semicontinuity for set-valued

More information

Division of the Humanities and Social Sciences. Supergradients. KC Border Fall 2001 v ::15.45

Division of the Humanities and Social Sciences. Supergradients. KC Border Fall 2001 v ::15.45 Division of the Humanities and Social Sciences Supergradients KC Border Fall 2001 1 The supergradient of a concave function There is a useful way to characterize the concavity of differentiable functions.

More information

Subdifferential representation of convex functions: refinements and applications

Subdifferential representation of convex functions: refinements and applications Subdifferential representation of convex functions: refinements and applications Joël Benoist & Aris Daniilidis Abstract Every lower semicontinuous convex function can be represented through its subdifferential

More information

Iterative Convex Optimization Algorithms; Part One: Using the Baillon Haddad Theorem

Iterative Convex Optimization Algorithms; Part One: Using the Baillon Haddad Theorem Iterative Convex Optimization Algorithms; Part One: Using the Baillon Haddad Theorem Charles Byrne (Charles Byrne@uml.edu) http://faculty.uml.edu/cbyrne/cbyrne.html Department of Mathematical Sciences

More information

Characterizations of the solution set for non-essentially quasiconvex programming

Characterizations of the solution set for non-essentially quasiconvex programming Optimization Letters manuscript No. (will be inserted by the editor) Characterizations of the solution set for non-essentially quasiconvex programming Satoshi Suzuki Daishi Kuroiwa Received: date / Accepted:

More information

CHAPTER 2: CONVEX SETS AND CONCAVE FUNCTIONS. W. Erwin Diewert January 31, 2008.

CHAPTER 2: CONVEX SETS AND CONCAVE FUNCTIONS. W. Erwin Diewert January 31, 2008. 1 ECONOMICS 594: LECTURE NOTES CHAPTER 2: CONVEX SETS AND CONCAVE FUNCTIONS W. Erwin Diewert January 31, 2008. 1. Introduction Many economic problems have the following structure: (i) a linear function

More information

CONSTRAINT QUALIFICATIONS, LAGRANGIAN DUALITY & SADDLE POINT OPTIMALITY CONDITIONS

CONSTRAINT QUALIFICATIONS, LAGRANGIAN DUALITY & SADDLE POINT OPTIMALITY CONDITIONS CONSTRAINT QUALIFICATIONS, LAGRANGIAN DUALITY & SADDLE POINT OPTIMALITY CONDITIONS A Dissertation Submitted For The Award of the Degree of Master of Philosophy in Mathematics Neelam Patel School of Mathematics

More information

Local convexity on smooth manifolds 1,2,3. T. Rapcsák 4

Local convexity on smooth manifolds 1,2,3. T. Rapcsák 4 Local convexity on smooth manifolds 1,2,3 T. Rapcsák 4 1 The paper is dedicated to the memory of Guido Stampacchia. 2 The author wishes to thank F. Giannessi for the advice. 3 Research was supported in

More information

Generalized Convexity in Economics

Generalized Convexity in Economics Generalized Convexity in Economics J.E. Martínez-Legaz Universitat Autònoma de Barcelona, Spain 2nd Summer School: Generalized Convexity Analysis Introduction to Theory and Applications JULY 19, 2008 KAOHSIUNG

More information

1 Introduction The study of the existence of solutions of Variational Inequalities on unbounded domains usually involves the same sufficient assumptio

1 Introduction The study of the existence of solutions of Variational Inequalities on unbounded domains usually involves the same sufficient assumptio Coercivity Conditions and Variational Inequalities Aris Daniilidis Λ and Nicolas Hadjisavvas y Abstract Various coercivity conditions appear in the literature in order to guarantee solutions for the Variational

More information

Chapter 2: Preliminaries and elements of convex analysis

Chapter 2: Preliminaries and elements of convex analysis Chapter 2: Preliminaries and elements of convex analysis Edoardo Amaldi DEIB Politecnico di Milano edoardo.amaldi@polimi.it Website: http://home.deib.polimi.it/amaldi/opt-14-15.shtml Academic year 2014-15

More information

Local strong convexity and local Lipschitz continuity of the gradient of convex functions

Local strong convexity and local Lipschitz continuity of the gradient of convex functions Local strong convexity and local Lipschitz continuity of the gradient of convex functions R. Goebel and R.T. Rockafellar May 23, 2007 Abstract. Given a pair of convex conjugate functions f and f, we investigate

More information

Lecture 5. Theorems of Alternatives and Self-Dual Embedding

Lecture 5. Theorems of Alternatives and Self-Dual Embedding IE 8534 1 Lecture 5. Theorems of Alternatives and Self-Dual Embedding IE 8534 2 A system of linear equations may not have a solution. It is well known that either Ax = c has a solution, or A T y = 0, c

More information

GEOMETRIC APPROACH TO CONVEX SUBDIFFERENTIAL CALCULUS October 10, Dedicated to Franco Giannessi and Diethard Pallaschke with great respect

GEOMETRIC APPROACH TO CONVEX SUBDIFFERENTIAL CALCULUS October 10, Dedicated to Franco Giannessi and Diethard Pallaschke with great respect GEOMETRIC APPROACH TO CONVEX SUBDIFFERENTIAL CALCULUS October 10, 2018 BORIS S. MORDUKHOVICH 1 and NGUYEN MAU NAM 2 Dedicated to Franco Giannessi and Diethard Pallaschke with great respect Abstract. In

More information

A SET OF LECTURE NOTES ON CONVEX OPTIMIZATION WITH SOME APPLICATIONS TO PROBABILITY THEORY INCOMPLETE DRAFT. MAY 06

A SET OF LECTURE NOTES ON CONVEX OPTIMIZATION WITH SOME APPLICATIONS TO PROBABILITY THEORY INCOMPLETE DRAFT. MAY 06 A SET OF LECTURE NOTES ON CONVEX OPTIMIZATION WITH SOME APPLICATIONS TO PROBABILITY THEORY INCOMPLETE DRAFT. MAY 06 CHRISTIAN LÉONARD Contents Preliminaries 1 1. Convexity without topology 1 2. Convexity

More information

BASICS OF CONVEX ANALYSIS

BASICS OF CONVEX ANALYSIS BASICS OF CONVEX ANALYSIS MARKUS GRASMAIR 1. Main Definitions We start with providing the central definitions of convex functions and convex sets. Definition 1. A function f : R n R + } is called convex,

More information

On Linear Systems Containing Strict Inequalities in Reflexive Banach Spaces

On Linear Systems Containing Strict Inequalities in Reflexive Banach Spaces Applied Mathematical Sciences, Vol. 3, 2009, no. 43, 2119-2132 On Linear Systems Containing Strict Inequalities in Reflexive Banach Spaces E. Naraghirad Department of Mathematics of Yasouj University Yasouj,

More information

Contents: 1. Minimization. 2. The theorem of Lions-Stampacchia for variational inequalities. 3. Γ -Convergence. 4. Duality mapping.

Contents: 1. Minimization. 2. The theorem of Lions-Stampacchia for variational inequalities. 3. Γ -Convergence. 4. Duality mapping. Minimization Contents: 1. Minimization. 2. The theorem of Lions-Stampacchia for variational inequalities. 3. Γ -Convergence. 4. Duality mapping. 1 Minimization A Topological Result. Let S be a topological

More information

Convex Analysis and Optimization Chapter 4 Solutions

Convex Analysis and Optimization Chapter 4 Solutions Convex Analysis and Optimization Chapter 4 Solutions Dimitri P. Bertsekas with Angelia Nedić and Asuman E. Ozdaglar Massachusetts Institute of Technology Athena Scientific, Belmont, Massachusetts http://www.athenasc.com

More information

Integrability of pseudomonotone differentiable maps and the revealed preference problem

Integrability of pseudomonotone differentiable maps and the revealed preference problem Integrability of pseudomonotone differentiable maps and the revealed preference problem Jean-Pierre CROUZEIX, Tamás RAPCSÁK November 2003, revised october 2004 Abstract The problem considered is as follows:

More information

EC9A0: Pre-sessional Advanced Mathematics Course. Lecture Notes: Unconstrained Optimisation By Pablo F. Beker 1

EC9A0: Pre-sessional Advanced Mathematics Course. Lecture Notes: Unconstrained Optimisation By Pablo F. Beker 1 EC9A0: Pre-sessional Advanced Mathematics Course Lecture Notes: Unconstrained Optimisation By Pablo F. Beker 1 1 Infimum and Supremum Definition 1. Fix a set Y R. A number α R is an upper bound of Y if

More information

Epiconvergence and ε-subgradients of Convex Functions

Epiconvergence and ε-subgradients of Convex Functions Journal of Convex Analysis Volume 1 (1994), No.1, 87 100 Epiconvergence and ε-subgradients of Convex Functions Andrei Verona Department of Mathematics, California State University Los Angeles, CA 90032,

More information

Dedicated to Michel Théra in honor of his 70th birthday

Dedicated to Michel Théra in honor of his 70th birthday VARIATIONAL GEOMETRIC APPROACH TO GENERALIZED DIFFERENTIAL AND CONJUGATE CALCULI IN CONVEX ANALYSIS B. S. MORDUKHOVICH 1, N. M. NAM 2, R. B. RECTOR 3 and T. TRAN 4. Dedicated to Michel Théra in honor of

More information

ON GAP FUNCTIONS OF VARIATIONAL INEQUALITY IN A BANACH SPACE. Sangho Kum and Gue Myung Lee. 1. Introduction

ON GAP FUNCTIONS OF VARIATIONAL INEQUALITY IN A BANACH SPACE. Sangho Kum and Gue Myung Lee. 1. Introduction J. Korean Math. Soc. 38 (2001), No. 3, pp. 683 695 ON GAP FUNCTIONS OF VARIATIONAL INEQUALITY IN A BANACH SPACE Sangho Kum and Gue Myung Lee Abstract. In this paper we are concerned with theoretical properties

More information

GENERALIZED CONVEXITY AND OPTIMALITY CONDITIONS IN SCALAR AND VECTOR OPTIMIZATION

GENERALIZED CONVEXITY AND OPTIMALITY CONDITIONS IN SCALAR AND VECTOR OPTIMIZATION Chapter 4 GENERALIZED CONVEXITY AND OPTIMALITY CONDITIONS IN SCALAR AND VECTOR OPTIMIZATION Alberto Cambini Department of Statistics and Applied Mathematics University of Pisa, Via Cosmo Ridolfi 10 56124

More information

On Weak Pareto Optimality for Pseudoconvex Nonsmooth Multiobjective Optimization Problems

On Weak Pareto Optimality for Pseudoconvex Nonsmooth Multiobjective Optimization Problems Int. Journal of Math. Analysis, Vol. 7, 2013, no. 60, 2995-3003 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/10.12988/ijma.2013.311276 On Weak Pareto Optimality for Pseudoconvex Nonsmooth Multiobjective

More information

Characterizations of Solution Sets of Fréchet Differentiable Problems with Quasiconvex Objective Function

Characterizations of Solution Sets of Fréchet Differentiable Problems with Quasiconvex Objective Function Characterizations of Solution Sets of Fréchet Differentiable Problems with Quasiconvex Objective Function arxiv:1805.03847v1 [math.oc] 10 May 2018 Vsevolod I. Ivanov Department of Mathematics, Technical

More information

Appendix B Convex analysis

Appendix B Convex analysis This version: 28/02/2014 Appendix B Convex analysis In this appendix we review a few basic notions of convexity and related notions that will be important for us at various times. B.1 The Hausdorff distance

More information

SECOND-ORDER CHARACTERIZATIONS OF CONVEX AND PSEUDOCONVEX FUNCTIONS

SECOND-ORDER CHARACTERIZATIONS OF CONVEX AND PSEUDOCONVEX FUNCTIONS Journal of Applied Analysis Vol. 9, No. 2 (2003), pp. 261 273 SECOND-ORDER CHARACTERIZATIONS OF CONVEX AND PSEUDOCONVEX FUNCTIONS I. GINCHEV and V. I. IVANOV Received June 16, 2002 and, in revised form,

More information

SYMBOLIC CONVEX ANALYSIS

SYMBOLIC CONVEX ANALYSIS SYMBOLIC CONVEX ANALYSIS by Chris Hamilton B.Sc., Okanagan University College, 2001 a thesis submitted in partial fulfillment of the requirements for the degree of Master of Science in the Department of

More information

Convex Functions and Optimization

Convex Functions and Optimization Chapter 5 Convex Functions and Optimization 5.1 Convex Functions Our next topic is that of convex functions. Again, we will concentrate on the context of a map f : R n R although the situation can be generalized

More information

The proximal mapping

The proximal mapping The proximal mapping http://bicmr.pku.edu.cn/~wenzw/opt-2016-fall.html Acknowledgement: this slides is based on Prof. Lieven Vandenberghes lecture notes Outline 2/37 1 closed function 2 Conjugate function

More information

Math 273a: Optimization Subgradients of convex functions

Math 273a: Optimization Subgradients of convex functions Math 273a: Optimization Subgradients of convex functions Made by: Damek Davis Edited by Wotao Yin Department of Mathematics, UCLA Fall 2015 online discussions on piazza.com 1 / 42 Subgradients Assumptions

More information

Lecture Notes in Advanced Calculus 1 (80315) Raz Kupferman Institute of Mathematics The Hebrew University

Lecture Notes in Advanced Calculus 1 (80315) Raz Kupferman Institute of Mathematics The Hebrew University Lecture Notes in Advanced Calculus 1 (80315) Raz Kupferman Institute of Mathematics The Hebrew University February 7, 2007 2 Contents 1 Metric Spaces 1 1.1 Basic definitions...........................

More information

Lecture 5: The Bellman Equation

Lecture 5: The Bellman Equation Lecture 5: The Bellman Equation Florian Scheuer 1 Plan Prove properties of the Bellman equation (In particular, existence and uniqueness of solution) Use this to prove properties of the solution Think

More information

Some Properties of the Augmented Lagrangian in Cone Constrained Optimization

Some Properties of the Augmented Lagrangian in Cone Constrained Optimization MATHEMATICS OF OPERATIONS RESEARCH Vol. 29, No. 3, August 2004, pp. 479 491 issn 0364-765X eissn 1526-5471 04 2903 0479 informs doi 10.1287/moor.1040.0103 2004 INFORMS Some Properties of the Augmented

More information

Convex Optimization Theory. Chapter 5 Exercises and Solutions: Extended Version

Convex Optimization Theory. Chapter 5 Exercises and Solutions: Extended Version Convex Optimization Theory Chapter 5 Exercises and Solutions: Extended Version Dimitri P. Bertsekas Massachusetts Institute of Technology Athena Scientific, Belmont, Massachusetts http://www.athenasc.com

More information

Convex Optimization Notes

Convex Optimization Notes Convex Optimization Notes Jonathan Siegel January 2017 1 Convex Analysis This section is devoted to the study of convex functions f : B R {+ } and convex sets U B, for B a Banach space. The case of B =

More information

Convex Functions. Daniel P. Palomar. Hong Kong University of Science and Technology (HKUST)

Convex Functions. Daniel P. Palomar. Hong Kong University of Science and Technology (HKUST) Convex Functions Daniel P. Palomar Hong Kong University of Science and Technology (HKUST) ELEC5470 - Convex Optimization Fall 2017-18, HKUST, Hong Kong Outline of Lecture Definition convex function Examples

More information

Constraint qualifications for convex inequality systems with applications in constrained optimization

Constraint qualifications for convex inequality systems with applications in constrained optimization Constraint qualifications for convex inequality systems with applications in constrained optimization Chong Li, K. F. Ng and T. K. Pong Abstract. For an inequality system defined by an infinite family

More information

UNDERGROUND LECTURE NOTES 1: Optimality Conditions for Constrained Optimization Problems

UNDERGROUND LECTURE NOTES 1: Optimality Conditions for Constrained Optimization Problems UNDERGROUND LECTURE NOTES 1: Optimality Conditions for Constrained Optimization Problems Robert M. Freund February 2016 c 2016 Massachusetts Institute of Technology. All rights reserved. 1 1 Introduction

More information

An Overview of Generalized Convexity

An Overview of Generalized Convexity An Overview of Generalized Convexity Dinh The Luc University of Avignon, Avignon p.1/43 Outline Brief history of convex analysis From convexity to generalized convexity Quasiconvex functions Pseudoconvex

More information

ZERO DUALITY GAP FOR CONVEX PROGRAMS: A GENERAL RESULT

ZERO DUALITY GAP FOR CONVEX PROGRAMS: A GENERAL RESULT ZERO DUALITY GAP FOR CONVEX PROGRAMS: A GENERAL RESULT EMIL ERNST AND MICHEL VOLLE Abstract. This article addresses a general criterion providing a zero duality gap for convex programs in the setting of

More information

PROBLEMS. (b) (Polarization Identity) Show that in any inner product space

PROBLEMS. (b) (Polarization Identity) Show that in any inner product space 1 Professor Carl Cowen Math 54600 Fall 09 PROBLEMS 1. (Geometry in Inner Product Spaces) (a) (Parallelogram Law) Show that in any inner product space x + y 2 + x y 2 = 2( x 2 + y 2 ). (b) (Polarization

More information

Semicontinuous functions and convexity

Semicontinuous functions and convexity Semicontinuous functions and convexity Jordan Bell jordan.bell@gmail.com Department of Mathematics, University of Toronto April 3, 2014 1 Lattices If (A, ) is a partially ordered set and S is a subset

More information

Continuous Sets and Non-Attaining Functionals in Reflexive Banach Spaces

Continuous Sets and Non-Attaining Functionals in Reflexive Banach Spaces Laboratoire d Arithmétique, Calcul formel et d Optimisation UMR CNRS 6090 Continuous Sets and Non-Attaining Functionals in Reflexive Banach Spaces Emil Ernst Michel Théra Rapport de recherche n 2004-04

More information

The theory of monotone operators with applications

The theory of monotone operators with applications FACULTY OF MATHEMATICS AND COMPUTER SCIENCE BABEŞ-BOLYAI UNIVERSITY CLUJ-NAPOCA, ROMÂNIA László Szilárd Csaba The theory of monotone operators with applications Ph.D. Thesis Summary Scientific Advisor:

More information

CHARACTERIZATION OF (QUASI)CONVEX SET-VALUED MAPS

CHARACTERIZATION OF (QUASI)CONVEX SET-VALUED MAPS CHARACTERIZATION OF (QUASI)CONVEX SET-VALUED MAPS Abstract. The aim of this paper is to characterize in terms of classical (quasi)convexity of extended real-valued functions the set-valued maps which are

More information

1 Convexity, concavity and quasi-concavity. (SB )

1 Convexity, concavity and quasi-concavity. (SB ) UNIVERSITY OF MARYLAND ECON 600 Summer 2010 Lecture Two: Unconstrained Optimization 1 Convexity, concavity and quasi-concavity. (SB 21.1-21.3.) For any two points, x, y R n, we can trace out the line of

More information

SOME REMARKS ON SUBDIFFERENTIABILITY OF CONVEX FUNCTIONS

SOME REMARKS ON SUBDIFFERENTIABILITY OF CONVEX FUNCTIONS Applied Mathematics E-Notes, 5(2005), 150-156 c ISSN 1607-2510 Available free at mirror sites of http://www.math.nthu.edu.tw/ amen/ SOME REMARKS ON SUBDIFFERENTIABILITY OF CONVEX FUNCTIONS Mohamed Laghdir

More information

L p Spaces and Convexity

L p Spaces and Convexity L p Spaces and Convexity These notes largely follow the treatments in Royden, Real Analysis, and Rudin, Real & Complex Analysis. 1. Convex functions Let I R be an interval. For I open, we say a function

More information

Convex Analysis Background

Convex Analysis Background Convex Analysis Background John C. Duchi Stanford University Park City Mathematics Institute 206 Abstract In this set of notes, we will outline several standard facts from convex analysis, the study of

More information

THE UNIQUE MINIMAL DUAL REPRESENTATION OF A CONVEX FUNCTION

THE UNIQUE MINIMAL DUAL REPRESENTATION OF A CONVEX FUNCTION THE UNIQUE MINIMAL DUAL REPRESENTATION OF A CONVEX FUNCTION HALUK ERGIN AND TODD SARVER Abstract. Suppose (i) X is a separable Banach space, (ii) C is a convex subset of X that is a Baire space (when endowed

More information

Structural and Multidisciplinary Optimization. P. Duysinx and P. Tossings

Structural and Multidisciplinary Optimization. P. Duysinx and P. Tossings Structural and Multidisciplinary Optimization P. Duysinx and P. Tossings 2018-2019 CONTACTS Pierre Duysinx Institut de Mécanique et du Génie Civil (B52/3) Phone number: 04/366.91.94 Email: P.Duysinx@uliege.be

More information

Extreme Abridgment of Boyd and Vandenberghe s Convex Optimization

Extreme Abridgment of Boyd and Vandenberghe s Convex Optimization Extreme Abridgment of Boyd and Vandenberghe s Convex Optimization Compiled by David Rosenberg Abstract Boyd and Vandenberghe s Convex Optimization book is very well-written and a pleasure to read. The

More information

Convex Optimization Conjugate, Subdifferential, Proximation

Convex Optimization Conjugate, Subdifferential, Proximation 1 Lecture Notes, HCI, 3.11.211 Chapter 6 Convex Optimization Conjugate, Subdifferential, Proximation Bastian Goldlücke Computer Vision Group Technical University of Munich 2 Bastian Goldlücke Overview

More information

In Progress: Summary of Notation and Basic Results Convex Analysis C&O 663, Fall 2009

In Progress: Summary of Notation and Basic Results Convex Analysis C&O 663, Fall 2009 In Progress: Summary of Notation and Basic Results Convex Analysis C&O 663, Fall 2009 Intructor: Henry Wolkowicz November 26, 2009 University of Waterloo Department of Combinatorics & Optimization Abstract

More information

PROJECTIONS ONTO CONES IN BANACH SPACES

PROJECTIONS ONTO CONES IN BANACH SPACES Fixed Point Theory, 19(2018), No. 1,...-... DOI: http://www.math.ubbcluj.ro/ nodeacj/sfptcj.html PROJECTIONS ONTO CONES IN BANACH SPACES A. DOMOKOS AND M.M. MARSH Department of Mathematics and Statistics

More information

Chapter 1. Optimality Conditions: Unconstrained Optimization. 1.1 Differentiable Problems

Chapter 1. Optimality Conditions: Unconstrained Optimization. 1.1 Differentiable Problems Chapter 1 Optimality Conditions: Unconstrained Optimization 1.1 Differentiable Problems Consider the problem of minimizing the function f : R n R where f is twice continuously differentiable on R n : P

More information

Lecture 9 Monotone VIs/CPs Properties of cones and some existence results. October 6, 2008

Lecture 9 Monotone VIs/CPs Properties of cones and some existence results. October 6, 2008 Lecture 9 Monotone VIs/CPs Properties of cones and some existence results October 6, 2008 Outline Properties of cones Existence results for monotone CPs/VIs Polyhedrality of solution sets Game theory:

More information

Optimality Conditions for Constrained Optimization

Optimality Conditions for Constrained Optimization 72 CHAPTER 7 Optimality Conditions for Constrained Optimization 1. First Order Conditions In this section we consider first order optimality conditions for the constrained problem P : minimize f 0 (x)

More information

P-adic Functions - Part 1

P-adic Functions - Part 1 P-adic Functions - Part 1 Nicolae Ciocan 22.11.2011 1 Locally constant functions Motivation: Another big difference between p-adic analysis and real analysis is the existence of nontrivial locally constant

More information

Maximal Monotone Inclusions and Fitzpatrick Functions

Maximal Monotone Inclusions and Fitzpatrick Functions JOTA manuscript No. (will be inserted by the editor) Maximal Monotone Inclusions and Fitzpatrick Functions J. M. Borwein J. Dutta Communicated by Michel Thera. Abstract In this paper, we study maximal

More information

Existence of Global Minima for Constrained Optimization 1

Existence of Global Minima for Constrained Optimization 1 Existence of Global Minima for Constrained Optimization 1 A. E. Ozdaglar 2 and P. Tseng 3 Communicated by A. Miele 1 We thank Professor Dimitri Bertsekas for his comments and support in the writing of

More information

Economics 204 Summer/Fall 2011 Lecture 5 Friday July 29, 2011

Economics 204 Summer/Fall 2011 Lecture 5 Friday July 29, 2011 Economics 204 Summer/Fall 2011 Lecture 5 Friday July 29, 2011 Section 2.6 (cont.) Properties of Real Functions Here we first study properties of functions from R to R, making use of the additional structure

More information

A Unified Analysis of Nonconvex Optimization Duality and Penalty Methods with General Augmenting Functions

A Unified Analysis of Nonconvex Optimization Duality and Penalty Methods with General Augmenting Functions A Unified Analysis of Nonconvex Optimization Duality and Penalty Methods with General Augmenting Functions Angelia Nedić and Asuman Ozdaglar April 16, 2006 Abstract In this paper, we study a unifying framework

More information

Lecture 1: Background on Convex Analysis

Lecture 1: Background on Convex Analysis Lecture 1: Background on Convex Analysis John Duchi PCMI 2016 Outline I Convex sets 1.1 Definitions and examples 2.2 Basic properties 3.3 Projections onto convex sets 4.4 Separating and supporting hyperplanes

More information

Duality for almost convex optimization problems via the perturbation approach

Duality for almost convex optimization problems via the perturbation approach Duality for almost convex optimization problems via the perturbation approach Radu Ioan Boţ Gábor Kassay Gert Wanka Abstract. We deal with duality for almost convex finite dimensional optimization problems

More information

Introduction to Convex and Quasiconvex Analysis

Introduction to Convex and Quasiconvex Analysis Introduction to Convex and Quasiconvex Analysis J.B.G.Frenk Econometric Institute, Erasmus University, Rotterdam G.Kassay Faculty of Mathematics, Babes Bolyai University, Cluj August 27, 2001 Abstract

More information

ON A CLASS OF NONSMOOTH COMPOSITE FUNCTIONS

ON A CLASS OF NONSMOOTH COMPOSITE FUNCTIONS MATHEMATICS OF OPERATIONS RESEARCH Vol. 28, No. 4, November 2003, pp. 677 692 Printed in U.S.A. ON A CLASS OF NONSMOOTH COMPOSITE FUNCTIONS ALEXANDER SHAPIRO We discuss in this paper a class of nonsmooth

More information

MATH 409 Advanced Calculus I Lecture 7: Monotone sequences. The Bolzano-Weierstrass theorem.

MATH 409 Advanced Calculus I Lecture 7: Monotone sequences. The Bolzano-Weierstrass theorem. MATH 409 Advanced Calculus I Lecture 7: Monotone sequences. The Bolzano-Weierstrass theorem. Limit of a sequence Definition. Sequence {x n } of real numbers is said to converge to a real number a if for

More information

(convex combination!). Use convexity of f and multiply by the common denominator to get. Interchanging the role of x and y, we obtain that f is ( 2M ε

(convex combination!). Use convexity of f and multiply by the common denominator to get. Interchanging the role of x and y, we obtain that f is ( 2M ε 1. Continuity of convex functions in normed spaces In this chapter, we consider continuity properties of real-valued convex functions defined on open convex sets in normed spaces. Recall that every infinitedimensional

More information

Convex Analysis and Optimization Chapter 2 Solutions

Convex Analysis and Optimization Chapter 2 Solutions Convex Analysis and Optimization Chapter 2 Solutions Dimitri P. Bertsekas with Angelia Nedić and Asuman E. Ozdaglar Massachusetts Institute of Technology Athena Scientific, Belmont, Massachusetts http://www.athenasc.com

More information

Journal of Inequalities in Pure and Applied Mathematics

Journal of Inequalities in Pure and Applied Mathematics Journal of Inequalities in Pure and Applied Mathematics MONOTONE TRAJECTORIES OF DYNAMICAL SYSTEMS AND CLARKE S GENERALIZED JACOBIAN GIOVANNI P. CRESPI AND MATTEO ROCCA Université de la Vallée d Aoste

More information

On duality theory of conic linear problems

On duality theory of conic linear problems On duality theory of conic linear problems Alexander Shapiro School of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta, Georgia 3332-25, USA e-mail: ashapiro@isye.gatech.edu

More information

DIFFERENTIABILITY VIA DIRECTIONAL DERIVATIVES

DIFFERENTIABILITY VIA DIRECTIONAL DERIVATIVES PROCEEDINGS OK THE AMERICAN MATHEMATICAL SOCIETY Volume 70, Number 1, lune 1978 DIFFERENTIABILITY VIA DIRECTIONAL DERIVATIVES KA-SING LAU AND CLIFFORD E. WEIL Abstract. Let F be a continuous function from

More information

Sequential Pareto Subdifferential Sum Rule And Sequential Effi ciency

Sequential Pareto Subdifferential Sum Rule And Sequential Effi ciency Applied Mathematics E-Notes, 16(2016), 133-143 c ISSN 1607-2510 Available free at mirror sites of http://www.math.nthu.edu.tw/ amen/ Sequential Pareto Subdifferential Sum Rule And Sequential Effi ciency

More information

Dualities Associated To Binary Operations On R

Dualities Associated To Binary Operations On R Journal of Convex Analysis Volume 2 (1995), No.1/2, 185 209 Dualities Associated To Binary Operations On R Juan-Enrique Martínez-Legaz Universitat Autònoma de Barcelona, Departament d Economia i d Història

More information

FIXED POINT THEOREMS OF KRASNOSELSKII TYPE IN A SPACE OF CONTINUOUS FUNCTIONS

FIXED POINT THEOREMS OF KRASNOSELSKII TYPE IN A SPACE OF CONTINUOUS FUNCTIONS Fixed Point Theory, Volume 5, No. 2, 24, 181-195 http://www.math.ubbcluj.ro/ nodeacj/sfptcj.htm FIXED POINT THEOREMS OF KRASNOSELSKII TYPE IN A SPACE OF CONTINUOUS FUNCTIONS CEZAR AVRAMESCU 1 AND CRISTIAN

More information

Mathematics 530. Practice Problems. n + 1 }

Mathematics 530. Practice Problems. n + 1 } Department of Mathematical Sciences University of Delaware Prof. T. Angell October 19, 2015 Mathematics 530 Practice Problems 1. Recall that an indifference relation on a partially ordered set is defined

More information

1 Introduction CONVEXIFYING THE SET OF MATRICES OF BOUNDED RANK. APPLICATIONS TO THE QUASICONVEXIFICATION AND CONVEXIFICATION OF THE RANK FUNCTION

1 Introduction CONVEXIFYING THE SET OF MATRICES OF BOUNDED RANK. APPLICATIONS TO THE QUASICONVEXIFICATION AND CONVEXIFICATION OF THE RANK FUNCTION CONVEXIFYING THE SET OF MATRICES OF BOUNDED RANK. APPLICATIONS TO THE QUASICONVEXIFICATION AND CONVEXIFICATION OF THE RANK FUNCTION Jean-Baptiste Hiriart-Urruty and Hai Yen Le Institut de mathématiques

More information

Introduction to Convex Analysis Microeconomics II - Tutoring Class

Introduction to Convex Analysis Microeconomics II - Tutoring Class Introduction to Convex Analysis Microeconomics II - Tutoring Class Professor: V. Filipe Martins-da-Rocha TA: Cinthia Konichi April 2010 1 Basic Concepts and Results This is a first glance on basic convex

More information

Convexity in R n. The following lemma will be needed in a while. Lemma 1 Let x E, u R n. If τ I(x, u), τ 0, define. f(x + τu) f(x). τ.

Convexity in R n. The following lemma will be needed in a while. Lemma 1 Let x E, u R n. If τ I(x, u), τ 0, define. f(x + τu) f(x). τ. Convexity in R n Let E be a convex subset of R n. A function f : E (, ] is convex iff f(tx + (1 t)y) (1 t)f(x) + tf(y) x, y E, t [0, 1]. A similar definition holds in any vector space. A topology is needed

More information

WEAK CONVERGENCE OF RESOLVENTS OF MAXIMAL MONOTONE OPERATORS AND MOSCO CONVERGENCE

WEAK CONVERGENCE OF RESOLVENTS OF MAXIMAL MONOTONE OPERATORS AND MOSCO CONVERGENCE Fixed Point Theory, Volume 6, No. 1, 2005, 59-69 http://www.math.ubbcluj.ro/ nodeacj/sfptcj.htm WEAK CONVERGENCE OF RESOLVENTS OF MAXIMAL MONOTONE OPERATORS AND MOSCO CONVERGENCE YASUNORI KIMURA Department

More information

LECTURE 12 LECTURE OUTLINE. Subgradients Fenchel inequality Sensitivity in constrained optimization Subdifferential calculus Optimality conditions

LECTURE 12 LECTURE OUTLINE. Subgradients Fenchel inequality Sensitivity in constrained optimization Subdifferential calculus Optimality conditions LECTURE 12 LECTURE OUTLINE Subgradients Fenchel inequality Sensitivity in constrained optimization Subdifferential calculus Optimality conditions Reading: Section 5.4 All figures are courtesy of Athena

More information

Aliprantis, Border: Infinite-dimensional Analysis A Hitchhiker s Guide

Aliprantis, Border: Infinite-dimensional Analysis A Hitchhiker s Guide aliprantis.tex May 10, 2011 Aliprantis, Border: Infinite-dimensional Analysis A Hitchhiker s Guide Notes from [AB2]. 1 Odds and Ends 2 Topology 2.1 Topological spaces Example. (2.2) A semimetric = triangle

More information