arxiv: v1 [math.fa] 30 Oct 2018

Similar documents
SECOND-ORDER CHARACTERIZATIONS OF CONVEX AND PSEUDOCONVEX FUNCTIONS

FIRST ORDER CHARACTERIZATIONS OF PSEUDOCONVEX FUNCTIONS. Vsevolod Ivanov Ivanov

Characterizations of Pseudoconvex Functions and Semistrictly Quasiconvex Ones

Characterizations of the solution set for non-essentially quasiconvex programming

Journal of Inequalities in Pure and Applied Mathematics

Convex Functions and Optimization

BORIS MORDUKHOVICH Wayne State University Detroit, MI 48202, USA. Talk given at the SPCOM Adelaide, Australia, February 2015

ON GAP FUNCTIONS OF VARIATIONAL INEQUALITY IN A BANACH SPACE. Sangho Kum and Gue Myung Lee. 1. Introduction

Subdifferential representation of convex functions: refinements and applications

Necessary Optimality Conditions for ε e Pareto Solutions in Vector Optimization with Empty Interior Ordering Cones

generalized Jacobians, nonsmooth analysis, mean value conditions, optimality

Stability of efficient solutions for semi-infinite vector optimization problems

Mathematical Programming Involving (α, ρ)-right upper-dini-derivative Functions

arxiv: v1 [math.oc] 21 Mar 2015

On Nonconvex Subdifferential Calculus in Banach Spaces 1

Relationships between upper exhausters and the basic subdifferential in variational analysis

On Optimality Conditions for Pseudoconvex Programming in Terms of Dini Subdifferentials

Some Properties of the Augmented Lagrangian in Cone Constrained Optimization

Relaxed Quasimonotone Operators and Relaxed Quasiconvex Functions

Upper sign-continuity for equilibrium problems

SOME PROPERTIES ON THE CLOSED SUBSETS IN BANACH SPACES

Optimality Conditions for Nonsmooth Convex Optimization

GEOMETRIC APPROACH TO CONVEX SUBDIFFERENTIAL CALCULUS October 10, Dedicated to Franco Giannessi and Diethard Pallaschke with great respect

Local strong convexity and local Lipschitz continuity of the gradient of convex functions

On Weak Pareto Optimality for Pseudoconvex Nonsmooth Multiobjective Optimization Problems

The local equicontinuity of a maximal monotone operator

On the convexity of piecewise-defined functions

A convergence result for an Outer Approximation Scheme

Transformation of Quasiconvex Functions to Eliminate. Local Minima. JOTA manuscript No. (will be inserted by the editor) Suliman Al-Homidan Nicolas

On the Midpoint Method for Solving Generalized Equations

Brøndsted-Rockafellar property of subdifferentials of prox-bounded functions. Marc Lassonde Université des Antilles et de la Guyane

UNDERGROUND LECTURE NOTES 1: Optimality Conditions for Constrained Optimization Problems

GENERALIZED CONVEXITY AND OPTIMALITY CONDITIONS IN SCALAR AND VECTOR OPTIMIZATION

CHARACTERIZATION OF (QUASI)CONVEX SET-VALUED MAPS

Characterizations of Solution Sets of Fréchet Differentiable Problems with Quasiconvex Objective Function

Convex Analysis and Optimization Chapter 2 Solutions

ON GENERALIZED-CONVEX CONSTRAINED MULTI-OBJECTIVE OPTIMIZATION

THE LAGRANGE MULTIPLIERS FOR CONVEX VECTOR FUNCTIONS IN BANACH SPACES

An Overview of Generalized Convexity

PARTIAL SECOND-ORDER SUBDIFFERENTIALS IN VARIATIONAL ANALYSIS AND OPTIMIZATION BORIS S. MORDUKHOVICH 1, NGUYEN MAU NAM 2 and NGUYEN THI YEN NHI 3

On constraint qualifications with generalized convexity and optimality conditions

On the Weak Convergence of the Extragradient Method for Solving Pseudo-Monotone Variational Inequalities

AW -Convergence and Well-Posedness of Non Convex Functions

Refined optimality conditions for differences of convex functions

FULL STABILITY IN FINITE-DIMENSIONAL OPTIMIZATION

Journal of Inequalities in Pure and Applied Mathematics

A CHARACTERIZATION OF STRICT LOCAL MINIMIZERS OF ORDER ONE FOR STATIC MINMAX PROBLEMS IN THE PARAMETRIC CONSTRAINT CASE

ON A CLASS OF NONSMOOTH COMPOSITE FUNCTIONS

On second order conditions in vector optimization

The Journal of Nonlinear Science and Applications

Division of the Humanities and Social Sciences. Supergradients. KC Border Fall 2001 v ::15.45

On nonexpansive and accretive operators in Banach spaces

SOME REMARKS ON THE SPACE OF DIFFERENCES OF SUBLINEAR FUNCTIONS

Convex Analysis Background

Epiconvergence and ε-subgradients of Convex Functions

A Classroom Note on Twice Continuously Differentiable Strictly Convex and Strongly Quasiconvex Functions

SOME STABILITY RESULTS FOR THE SEMI-AFFINE VARIATIONAL INEQUALITY PROBLEM. 1. Introduction

g 2 (x) (1/3)M 1 = (1/3)(2/3)M.

Viscosity Iterative Approximating the Common Fixed Points of Non-expansive Semigroups in Banach Spaces

1 Introduction and preliminaries

Thai Journal of Mathematics Volume 14 (2016) Number 1 : ISSN

arxiv: v1 [math.fa] 16 Jun 2011

Variational inequalities for set-valued vector fields on Riemannian manifolds

Downloaded 09/27/13 to Redistribution subject to SIAM license or copyright; see

On robustness of the regularity property of maps

Contents: 1. Minimization. 2. The theorem of Lions-Stampacchia for variational inequalities. 3. Γ -Convergence. 4. Duality mapping.

NONDIFFERENTIABLE SECOND-ORDER MINIMAX MIXED INTEGER SYMMETRIC DUALITY

c???? Society for Industrial and Applied Mathematics Vol. 1, No. 1, pp ,???? 000

A Proximal Method for Identifying Active Manifolds

On Semicontinuity of Convex-valued Multifunctions and Cesari s Property (Q)

Radius Theorems for Monotone Mappings

arxiv: v1 [math.oc] 13 Mar 2019

Sum of two maximal monotone operators in a general Banach space is maximal

Applications of Mathematics

NEW MAXIMUM THEOREMS WITH STRICT QUASI-CONCAVITY. Won Kyu Kim and Ju Han Yoon. 1. Introduction

WEAK CONVERGENCE THEOREMS FOR EQUILIBRIUM PROBLEMS WITH NONLINEAR OPERATORS IN HILBERT SPACES

A Relaxed Explicit Extragradient-Like Method for Solving Generalized Mixed Equilibria, Variational Inequalities and Constrained Convex Minimization

Convergence Theorems of Approximate Proximal Point Algorithm for Zeroes of Maximal Monotone Operators in Hilbert Spaces 1

Yuqing Chen, Yeol Je Cho, and Li Yang

arxiv: v1 [math.fa] 17 May 2013

Convergence Rates in Regularization for Nonlinear Ill-Posed Equations Involving m-accretive Mappings in Banach Spaces

Optimization and Optimal Control in Banach Spaces

AN ASYMPTOTIC MEAN VALUE CHARACTERIZATION FOR p-harmonic FUNCTIONS. To the memory of our friend and colleague Fuensanta Andreu

CONVEX COMPOSITE FUNCTIONS IN BANACH SPACES AND THE PRIMAL LOWER-NICE PROPERTY

A generalized forward-backward method for solving split equality quasi inclusion problems in Banach spaces

Abstract. The connectivity of the efficient point set and of some proper efficient point sets in locally convex spaces is investigated.

Dedicated to Michel Théra in honor of his 70th birthday

Weak and strong convergence theorems of modified SP-iterations for generalized asymptotically quasi-nonexpansive mappings

LINEAR-CONVEX CONTROL AND DUALITY

arxiv: v1 [math.ca] 5 Mar 2015

PARTIAL REGULARITY OF BRENIER SOLUTIONS OF THE MONGE-AMPÈRE EQUATION

A quasisecant method for minimizing nonsmooth functions

DUALIZATION OF SUBGRADIENT CONDITIONS FOR OPTIMALITY

1 Lyapunov theory of stability

McMaster University. Advanced Optimization Laboratory. Title: A Proximal Method for Identifying Active Manifolds. Authors: Warren L.

Active sets, steepest descent, and smooth approximation of functions

The Strong Convergence of Subgradients of Convex Functions Along Directions: Perspectives and Open Problems

Generalized Hessians of C 1,1 - functions and second-order viscosity subjets

Identifying Active Constraints via Partial Smoothness and Prox-Regularity

WEAK CONVERGENCE OF RESOLVENTS OF MAXIMAL MONOTONE OPERATORS AND MOSCO CONVERGENCE

Transcription:

On Second-order Conditions for Quasiconvexity and Pseudoconvexity of C 1,1 -smooth Functions arxiv:1810.12783v1 [math.fa] 30 Oct 2018 Pham Duy Khanh, Vo Thanh Phat October 31, 2018 Abstract For a C 2 -smooth function on a finite-dimensional space, a necessary condition for its quasiconvexity is the positive semidefiniteness of its Hessian matrix on the subspace orthogonal to its gradient, whereas a sufficient condition for its strict pseudoconvexity is the positive definiteness of its Hessian matrix on the subspace orthogonal to its gradient. Our aim in this paper is to extend those conditions for C 1,1 -smooth functions by using the Fréchet and Mordukhovich second-order subdifferentials. Keywords Second-order subdifferential, Mean value theorem, C 1,1 -smooth function, Quasiconvexity, Pseudoconvexity. Mathematics Subject Classification (2010) 26A51, 26B25, 26E25, 49J52. 1 Introduction Since the notion of convexity does no longer suffice to many mathematical models used in decision sciences, economics, management sciences, stochastics, applied mathematics and engineering, various generalizations of convex functions have been introduced in literature such as (strictly) quasiconvex and (strictly) pseudoconvex functions. Those functions preserve one or more properties of convex functions and give rise to models which are more adaptable to real-world situations than convex models. Quasiconvex functions are characterized by the property that every level set is convex and pseudoconvex functions are such that the vanishing of the gradient ensures a global minimum. First-order characterizations for quasiconvexity and pseudoconvexity can be found in [4, 7, 10, 11] for smooth functions and [1, 2, 5, 14, 15, 16, 20, 22] for nonsmooth ones. The well-known second-order necessary condition for the quasiconvexity of C 2 -smooth functions (see for instance Department of Mathematics, HCMC University of Education, Ho Chi Minh, Vietnam and Center for Mathematical Modeling, Universidad de Chile, Santiago, Chile. E-mails: pdkhanh182@gmail.com; pdkhanh@dim.uchile.cl Department of Mathematics, HCMC University of Pedagogy, Ho Chi Minh, Vietnam. E-mail: vtphat1996@gmail.com 1

[3, 7, 9, 11]) states that the Hessian matrix of a quasiconvex function is positive-semidefinite on the subspace orthogonal to its gradient. Furthermore, if the Hessian matrix of a C 2 -smooth function is positive definite on the subspace orthogonal to its gradient then the given function is strictly pseudoconvex [11]. Relaxing the C 2 -smoothness property, several authors have characterized the quasiconvexity and pseudoconvexity by using various kinds of generalized second-order derivatives. Using Taylor s formula and an estimation formula of generalized Hessian, Luc [17] established the necessary and sufficient conditions for quasiconvexity of C 1,1 -smooth functions. In [12] Ginchev and Ivanov introduced the concept of second-order upper Dini-directional derivatives and used it to characterize the pseudoconvexity of radially upper semicontinuous functions. Recently, by using the theory of viscosity solutions of partial differential equations, Barron, Goebel, and Jensen [6] obtained some necessary conditions and sufficient ones for the quasiconvexity of upper semicontinuous functions. Although the Fréchet and the Mordukhovich second-order subdifferentials have a significant role in variational analysis and its applications [18, 19, 21], it seems to us that their use in characterizing quasiconvexity and pseudoconvexity of nonsmooth functions has not been studied, so far. This motivates us to find out some necessary conditions and sufficient ones for the quasiconvexity and pseudoconvexity of C 1,1 -smooth functions by usingthe Fréchet and Mordukhovich second-order subdifferentials. For the necessity, we prove that the Fréchet second-order subdifferential of a pseudoconvex function is positive semidefinite on the subspace orthogonal to its gradient while the Mordukhovich second-order subdifferential of a quasiconvex function is only positive semidefinite along its some selection. For the sufficiency, we propose two conditions guaranteeing the strict pseudoconvexity. The first one is the positive definiteness of the Mordukhovich second-order subdifferential of a given function on the subspace orthogonal to its gradient. The second one claims that the Fréchet second-order subdifferential of a given function has some selection which is positive on the subspace orthogonal to its gradient. Moreover, a second-order sufficient condition for the strict quasiconvexity is also established by using Fréchet second-order subdifferentials. The obtained results are analyzed and illustrated by suitable examples. The paper is organized as follows. Some background material from variational analysis and generalized convexity are recalled in Section 2. Section 3 presents some second-order conditions for quasiconvexity and pseudoconvexity of C 1,1 -smooth functions. Sufficient conditions are given in Section 4. Conclusions and further investigations are discussed in the last section. 2 Preliminaries We begin with some notions from [19] which will be needed in the sequel. Let F be a set-valued mapping between Euclidean spaces R n and R m. As usual, the effective domain and the graph of F are given, respectively, by domf := {x R n F(x) } and gphf = {(x,y) R n R m y F(x)}. 2

The sequential Painlevé-Kuratowski outer limit of F as x x is defined as Lim sup x x F(x) := {y R n sequences x k x, y k y, with y k F(x k ) for all k = 1,2,...}. (1) Let us consider an extended-real-valued function ϕ : R n R := (, ]. We always assume that ϕ is proper and lower semicontinuous. The Fréchet subdifferential of ϕ at x domϕ := {x R n : ϕ(x) < } (known as the presubdifferential and as the regular or viscosity subdifferential) is { ϕ( x) := x R n ϕ(x) ϕ( x) x },x x liminf 0. (2) x x x x Then the Mordukhovich subdifferential of ϕ at x (known also the general/basic or limiting subdifferential) is defined via the outer limit (1) ϕ( x) := Limsup x ϕ x ϕ(x), (3) where x ϕ x signifies that x x with ϕ(x) ϕ( x). Observe that both Fréchet and Mordukhovich subdifferentials reduce to the classical Fréchet derivative for continuously differentiable functions. Given a set Ω R n with its indicator function δ Ω (x) equal to 0 for x Ω and to otherwise, the Fréchet and the Mordukhovich normal cones to Ω at x Ω are defined, respectively, via the corresponding subdifferentials (2) and (3) by N( x;ω) := δ Ω ( x) and N( x;ω) := δ Ω ( x). (4) The Fréchet and Mordukhovich coderivatives of F at ( x, ȳ) gphf are defined, respectively, via corresponding normal cones (4) by D F(x,y)(y ) := {x R n : (x, y ) N(( x,ȳ),gphf)}, D F(x,y)(y ) := {x R n : (x, y ) N(( x,ȳ),gphf)}. We omit ȳ = f( x) in the above coderivative notions if F := f : R n R m is single-valued. Definition 2.1 Let ϕ : R n R be a function with a finite value at x. (i) For any ȳ ϕ( x), the map 2 ϕ( x,ȳ) : R n R n with the values 2 ϕ( x,ȳ)(u) = (D ϕ)( x,ȳ)(u) (u R n ) is said to be the Mordukhovich second-order subdifferential of ϕ at x relative to ȳ. (ii) For any ȳ ϕ( x), the map 2 ϕ( x,ȳ) : R n R n with the values 2 ϕ( x,ȳ)(u) = ( D ϕ)( x,ȳ)(u) (u R n ) is said to be the Fréchet second-order subdifferential of ϕ at x relative to ȳ. 3

We omit ȳ = ϕ( x) in the above second-order subdifferentials if ϕ C 1 around x, i.e., continuously Fréchet differentiable in a neighborhood of x. In general, the Fréchet second-order subdifferential and the Mordukhovich one are incomparable. However, if ϕ C 1 around x, then 2 ϕ( x)(u) 2 ϕ( x)(u), u R n. (5) If ϕ C 1,1 around x, i.e., Fréchet differentiable around x with the gradient ϕ being locally Lipschitzian around x then the calculation of second-order subdifferentials can be essentially simplified due to the following scalarization formulas (see [18, Proposition 3.5] and [19, Proposition 1.120]) 2 ϕ( x)(u) = u, ϕ ( x), 2 ϕ( x)(u) = u, ϕ ( x). (6) In this case, Mordukhovich second-order subdifferentials are nonempty [19, Corollary 2.25] while Fréchet ones may be empty. If ϕ C 2 around x, i.e., ϕ is twice continuously Fréchet differentiable in a neighborhood of x, then 2 ϕ( x)(u) = 2 ϕ( x)(u) = { 2 ϕ( x)u}, u R n. (7) Let us recall some well-known notions of generalized convexity. Definition 2.2 (a) A function ϕ : R n R is said to be quasiconvex if ϕ((1 λ)x+λy) max{ϕ(x),ϕ(y)} for every x,y R n and for every λ [0,1]. (b) A function ϕ : R n R is said to be strictly quasiconvex if ϕ((1 λ)x+λy) < max{ϕ(x),ϕ(y)} for every x,y R n,x y and for every λ (0,1). (c) A differentiable function ϕ : R n R is called pseudoconvex if x,y R n,ϕ(x) > ϕ(y) = ϕ(x),y x < 0. (d) A differentiable function ϕ : R n R is called strictly pseudoconvex if x,y R n, x y, ϕ(x) ϕ(y) = ϕ(x),y x < 0. It follows, immediately, from the given definitions, that a strictly quasiconvex (pseudoconvex) function is quasiconvex (pseudoconvex). For differentiable functions, (strict) pseudoconvexity implies (strict) quasiconvexity. The next theorem shall point out that within the class of (strictly) quasiconvex functions, (strict) pseudoconvexity may be specified by means of its behaviour at a critical point. 4

Theorem 2.1 [7, Theorem 3.2.9] Let ϕ : R n R be a continuous differentiable function. Then, ϕ is (strictly) pseudoconvex if and only if the following conditions hold: (i) ϕ is quasiconvex; (ii) If ϕ(x) = 0 then x is a (strict) local minimum for ϕ. Finally, we consider a lemma which will be used in the subsequent. Lemma 2.1 Let ϕ : R n R be a differentiable function. If ϕ is not strictly quasiconvex, then there exist x 1,x 2 R n,x 1 x 2 and t 0 (0,1) such that ϕ(x 1 +t 0 (x 2 x 1 )),x 2 x 1 = 0 and ϕ(x 1 +t(x 2 x 1 )) ϕ(x 1 +t 0 (x 2 x 1 )), t [0,1]. (8) Proof. Since ϕ is not strictly quasiconvex, there exist x 1,x 2 R n,α (0,1) such that x 1 x 2 and ϕ((1 α)x 1 +αx 2 ) max{ϕ(x 1 ),ϕ(x 2 )}. (9) Consider the function f : R R given by f(t) = ϕ(x 1 +t(x 2 x 1 )), t R. Then, thanks to the Weierstrass theorem and (9), we can find a number t 0 (0,1) for which the function f admits a maximum on the interval [0,1]. Hence, (8) is satisfied and by the Fermat rule we have 0 = f(t 0 ) = ϕ(x 1 +t 0 (x 2 x 1 )),x 2 x 1. 3 Necessary Conditions Let us recall the well-known second-order necessary condition for quasiconvexity of C 2 -smooth functions. Theorem 3.1 (see [3, Lemma 6.2] or [7, Theorem 3.4.2]) Let ϕ : R n R be a C 2 -smooth function. If ϕ is quasiconvex, then x,u R n, ϕ(x),u = 0 = 2 ϕ(x)u,u 0. (10) By using the mean value inequality in terms of Mordukhovich subdifferential for Lipschitzian functions [19, Corollary 3.51 ] we extend the above result to C 1,1 -smooth functions. Proposition 3.1 Let ϕ : R n R be a Lipschitz continuous function on open set containing [a,b]. Then one has x,b a ϕ(b) ϕ(a) for some x ϕ(c), c [a,b). 5

Theorem 3.2 Let ϕ : R n R be a C 1,1 -smooth function. If ϕ is quasiconvex then x,u R n, ϕ(x),u = 0 = z,u 0 for some z 2 ϕ(x)(u). (11) Proof. Let x,u R n be such that ϕ(x),u = 0. If u = 0 then z,u = 0 for all z 2 ϕ(x)(u). Otherwise, consider the function f : R n R given by f(y) := ϕ(y),u y R n. Then, f(x) = 0 and f is locally Lipschitz continuous on R n by the C 1,1 -smoothness of ϕ. Moreover, f is locally bounded (see [19, Corollary 1.81] or [21, Theorem 9.13]), robust [21, Proposition 8.7] on R n and for every y R n f(y) = u, ϕ (y) = 2 ϕ(y)(u). For the sequences x k := x+(1/k)u, x k := x (1/k)u (k N), one has x k x,x k x and, in view of Proposition 3.1, there exist θ k [0,1/k), θ k (0,1/k] and z k f(x+θ k u),z k f(x θ ku) such that z k,(1/k)u = z k,x k x f(x k ) f(x) = f(x k ), z k,(1/k)u = z k,x x k f(x) f(x k ) = f(x k ). By the quasiconvexity of ϕ, it follows from [11, Proposition 1] that 0 min{ ϕ(x k ),x k x k, ϕ(x k ),x k x k } = min{( 2/k)f(x k ),(2/k)f(x k )} min{( 2/k 2 ) z k,u,( 2/k 2 ) z k,u }. Therefore, max{ z k,u, z k,u } 0 for all k N. Since f is locally bounded at x, the sequences (z k ),(z k ) are bounded. Without loss of generality, we can assume that z k z and z k z. It follows that max{ z,u, z,u } 0 and by the robustness of f we have z,z f(x) = 2 ϕ(x)(u). The proof is complete. The established necessary condition says that, for a quasiconvex function, the Mordukhovich second-order subdifferential at one point is positive semidefinite along some its selection on the subspace orthogonal to its gradient at this point. The following example shows that the positive semidefiniteness cannot be extended to the whole mentioned subspace even for pseudoconvex function. Example 3.1 [13, Remark 3.1] Let ϕ : R R be defined by where ϕ(x) := x 0 φ(t)dt, 2t 2 +t 2 sin ( ) 1 t if t > 0, φ(t) = 0 if t = 0. 6

Observe that ϕ is a pseudoconvex C 1,1 -smooth function. Indeed, for every x R, we have φ(x) if x 0, ϕ(x) = φ( x) if x < 0. Hence, ϕ is locally Lipschitz and so it is C 1,1 -smooth. Moreover, ϕ(x) = 0 if and only if x = 0 and 0 is a local minimum of ϕ. It follows from [7, Theorem 3.2.7] that ϕ is a pseudoconvex function. Clearly, one has 2 ϕ(0)(u) = [ u, u ] for each u R. Thus, with u 0, there exists z 2 ϕ(0)(u) such that z,u < 0. Although the pseudoconvexity does not imply the positive semidefiniteness of the secondorder Mordukhovich subdifferential, it guarantees the positive semidefiniteness of the second-order Fréchet subdifferential. Theorem 3.3 Let ϕ : R n R be a C 1,1 -smooth function. If ϕ is pseudoconvex then x,u R n, ϕ(x),u = 0 = z,u 0 for all z 2 ϕ(x)(u). (12) Proof. Suppose to the contrary that there exist x,u R n and z 2 ϕ(x)(u) such that ϕ(x),u = 0 and z,u < 0. By (6), we have z u, ϕ (x) and so 0 liminf y x = liminf y x u, ϕ(y) u, ϕ(x) z,y x y x u, ϕ(y) z,y x. y x (13) For the sequence x k := x (1/k)u (k N), one has x k x and ϕ(x),x k x = ϕ(x), (1/k)u = 0. The pseudoconvexity of ϕ implies that ϕ(x k ) ϕ(x) and by the classical mean value theorem there exists θ k (0,1/k) such that 0 ϕ(x k ) ϕ(x) = ϕ(x θ k u),x k x = ϕ(x θ k u),( 1/k)u. For the sequence y k := x θ k u (k N), one has y k x and ϕ(y k ),u 0. Therefore, by (13) we have 0 liminf k liminf k = z,u u u, ϕ(y k ) z,y k x y k x z,θ k u θ k u which is contradict to z,u < 0. The next example shows that (12) is violated if the pseudoconvexity is relaxed to quasiconvexity. 7

Example 3.2 Let ϕ : R R be given by ϕ(x) := 1 2 x2 signx, x R. Observe that ϕ is a quasiconvex C 1,1 -smooth function and ϕ(x) = x for every x R. Moreover, we have 2 [ u,u] if u 0, ϕ(0)(u) = if u < 0. Observe that for z = 1,u = 1, we have z 2 ϕ(0)(u) and z,u < 0. 4 Sufficient Conditions A second-order sufficient condition for the strict pseudoconvexity in the C 2 -smoothness case is recalled in the following theorem. Theorem 4.1 [11, Proposition 4] Let ϕ : R n R be a C 2 -smooth function satisfying x R n,u R n \{0}, ϕ(x),u = 0 = 2 ϕ(x)u,u > 0. (14) Then, ϕ is a strictly pseudoconvex function. Our aim in this section is to establish some similar versions of Theorem 4.1 in the C 1,1 - smoothness case by using the Fréchet and Mordukhovich second-order subdifferentials. The first version is the replacement of the Hessian matrices in (14) by the Mordukhovich second-order subdifferentials. Our proof is based on Theorem 2.1 and the following sufficient optimality condition for C 1,1 -smooth functions. Proposition 4.1 [8, Corollary 4.8] Suppose that ϕ : R n R is a C 1,1 -smooth function and x R n. If ϕ(x) = 0 and z,u > 0 for all z 2 ϕ(x)(u),u R n then x is a strict local minimizer of ϕ. Theorem 4.2 Let ϕ : R n R be a C 1,1 -smooth function satisfying x R n,u R n \{0}, ϕ(x),u = 0 = z,u > 0 for all z 2 ϕ(x)(u). (15) Then ϕ is a strictly pseudoconvex function. Proof. Observe that if ϕ(x) = 0, then (15) implies the positive semidefiniteness of 2 ϕ(x) and so, by Proposition 4.1, x is a strict local minimizer of ϕ. Hence, it follows from Theorem 2.1 that ϕ is strictly pseudoconvex if and only if ϕ is quasiconvex. 8

Assume that ϕ is not quasiconvex. Then, by Lemma 2.1, there exist x 1,x 2 R n,x 1 x 2 and t 0 (0,1) such that ϕ(x 1 +t 0 (x 2 x 1 )),x 2 x 1 = 0 and (8) is satisfied. Let x := x 1 +t 0 (x 2 x 1 ) and u := x 2 x 1. It follows that u 0 and ϕ( x),u = 0 and so, by (15), z,u > 0, z 2 ϕ( x)(u). (16) For the sequence x k := x + (1/k)u (k N) we have x k x. For sufficiently large k, we have t 0 + 1/k (0,1) and so ϕ(x k ) ϕ( x) by (8). Applying the classical mean value theorem, for sufficiently large k, there exists θ k (0,1/k) such that ϕ( x+θ k u),(1/k)u = ϕ(x k ) ϕ( x) 0. (17) Consider the function φ : R n R given by φ(x) = u, ϕ (x), x R n. Applying Proposition 3.1, for every k, there exist γ k (0,θ k ] and z k φ( x+γ k u) such that z k, θ k u φ( x) φ( x+θ k u) = u, ϕ( x) u, ϕ( x+θ k u) = u, ϕ( x+θ k u). Combining the above inequality with (17) we have z k,u 0 for sufficiently large k. Since φ is locally bounded at x, the sequence (z k ) is bounded. Without loss of generality, we can assume that z k z. It follows that z,u 0 and by the robustness of φ we have z φ( x) = 2 ϕ( x)(u). This is contradict (16). The proof is complete. We consider two examples to analyze (15). The first one shows that (15) cannot be relaxed to the following condition x R n,u R n \{0}, ϕ(x),u = 0 = z,u > 0 for some z 2 ϕ(x)(u) (18) Moreover, (18) is not sufficient for the quasiconvexity of ϕ. Example 4.1 Let ϕ : R R be the function given by where x ϕ(x) := φ(t)dt, 0 2t 2 +t 2 sin( 1 t ) if t > 0, φ(t) = 0 if t = 0, 2t 2 +t 2 sin( 1 t ) if t < 0. 9

Observe that ϕ is a C 1,1 -smooth function and ϕ(x) = φ(x) for every x R. Moreover, we have 2 ϕ(0)(u) = [ u, u ] for all u R. Let x R, u R\{0} be such that ϕ(x),u = 0. It follows that ϕ(x) = 0, or equivalently x = 0. For z = u 2 ϕ(0)(u), we have z,u = u 2 > 0. The condition (18) holds for ϕ. Howerver, ϕ is not quasiconvex. Indeed, for x = 1 π,y = 1, we have π ϕ(x),y x = 4 π 3 > 0, ϕ(y),y x = 4 π 3 < 0. By [11, Proposition 1], ϕ is not quasiconvex. The second example points out that we cannot replace the Mordukhovich second-order subdifferential in (15) by the Fréchet second-order one since it may be empty. Example 4.2 Let ϕ : R R be the function given by ϕ(x) := x 0 φ(t)dt x R, where 2t tsin(log( t )) if t 0, φ(t) := 0 if t = 0 is a Lipschitz continuous function. Hence, ϕ is C 1,1 -smooth and ϕ(x) = φ(x) for every x R. Let x,u R, u 0 such that ϕ(x),u = 0. Then, ϕ(x) = 0 and so x = 0. We have 2 ϕ(0)(u) =. Thus, the below condition holds x R,u R\{0}, ϕ(x),u = 0 = z,u > 0 for all z 2 ϕ(x)(u). However, ϕ is not a pseudoconvex function. Indeed, for x = 0,y = 1, we have ϕ(x),y x = 0, ϕ(y),y x = 2 < 0. By [11, Proposition 2], ϕ is not pseudoconvex. When the Fréchet second-order subdifferential is nonempty, we can use it to characterize the strict quasiconvexity and strict pseudoconvexity of C 1,1 -smooth functions. Theorem 4.3 Let ϕ : R n R be a C 1,1 -smooth function satisfying x R n,u R n \{0}, ϕ(x),u = 0 = z,u > 0 for some z 2 ϕ(x)(u) 2 ϕ(x)( u) (19) Then ϕ is a strictly quasiconvex function. Proof. Assume that ϕ is not strictly quasiconvex. Then, by Lemma 2.1, there exist x 1,x 2 R n with x 1 x 2 and t 0 (0,1) such that ϕ(x 1 +t 0 (x 2 x 1 )),x 2 x 1 = 0 and (8) is satisfied. Let x := x 1 +t 0 (x 2 x 1 ) and u := x 2 x 1. It follows that u 0 and ϕ(x),u = 0 and so, by (19), there exists z 2 ϕ(x)(u) 2 ϕ(x)( u) such that z,u > 0. Since 2 ϕ(x)(u) 2 ϕ(x)( u) = u, ϕ (x) u, ϕ (x) 10

it must happen one of the following cases. Case 1: z u, ϕ (x). Since ϕ(x),u = 0, we have 0 liminf y x = liminf y x u, ϕ(y) u, ϕ(x) z,y x y x u, ϕ(y) z,y x. y x (20) For the sequence x k := x + (1/k)u (k N) we have x k x. For sufficiently large k, we have t 0 + 1/k (0,1) and so ϕ(x k ) ϕ(x) by (8). Applying the classical mean value theorem, for sufficiently large k, there exists θ k (0,1/k) such that ϕ(x+θ k u),(1/k)u = ϕ(x k ) ϕ(x) 0. (21) For the sequence y k := x + θ k u (k N) we have y k x and ϕ(y k ),u 0 by (21) for every k N. It follows from (20) that which is contradict to z,u > 0. 0 liminf k liminf k = z,u u u, ϕ(y k ) z,y k x y k x z,θ k u θ k u Case 2. z u, ϕ (x). Repeating the proof of Case 1. with u,z being replaced by u, z we also get a contradiction. Remark 4.1 Observe that the strict quasiconvexity in Theorem 4.3 cannot be improved to strict pseudoconvexity. Indeed, let ϕ be the function given in Example 3.2. We have 2 ϕ(0)(u) 2 ϕ(0)( u) = [ u, u ], for all u R. Observe that if x R, u R \ {0} such that ϕ(x),u = 0 then x = 0. Hence, with z := u 2 ϕ(0)(u) 2 ϕ(0)( u) we have z,u = u 2 > 0 and so (19) holds while ϕ is not strictly pseudoconvex. We now improve (19) to get another characterization for the strict pseudoconvexity. Theorem 4.4 Let ϕ : R n R be a C 1,1 -smooth function satisfying x R n,u R n \{0}, ϕ(x),u = 0 = z,u > 0 for some z 2 ϕ(x)(u). (22) Then ϕ is a strictly pseudoconvex function. 11

Proof. By Theorem 4.3, ϕ is strictly quasiconvex. We will use Theorem 2.1 to prove the strict pseudoconvexity of ϕ. Let x R n such that ϕ(x) = 0. It follows from (6) and (22) that u, ϕ (x) = 2 ϕ(x)(u) and u, ϕ (x) = 2 ϕ(x)( u) for every u R n \{0}. By [19, Proposition 1.87], the scalar function u, ϕ is differentiable at x for every u R n \{0}. Hence, ϕ is twice differentiable at x and 2 ϕ(x)(u) = { u, ϕ (x)} = { 2 ϕ(x)u} for every u R n \ {0}. Again, by (22), its Hessian 2 ϕ(x) is positive definite. Moreover, by [21, Theorem 13.2], the Hessian matrix 2 ϕ(x) also furnishes a quadratic expansion for ϕ at x. Therefore, the positive definiteness of 2 ϕ(x) and the vanishing of ϕ(x) yield that x is a strict local minimizer of ϕ. By Theorem 2.1, ϕ is strictly pseudoconvex. Remark 4.2 The condition (22) implies that ϕ is twice differentiable at every its critical point. In the two next examples, we will show that (22) and (15) are incomparable. Example 4.3 Let ϕ : R R be the function defined by 1 2 ϕ(x) = x2 if x 0, 3x 2 if x > 0. Then, ϕ is C 1,1 -smooth and x if x 0, ϕ(x) = 6x if x > 0. Let x,u R, u 0 such that ϕ(x),u = 0. Then, ϕ(x) = 0 and so x = 0. Clearly, 2 [u,6u] if u 0, ϕ(0)(u) = and 2 [u,6u] if u 0, ϕ(0)(u) = if u < 0, {u,6u} if u < 0. Hence, (15) holds while (22) is not satisfied. Example 4.4 Let ϕ : R R be the function defined by ϕ(x) := x 0 φ(t)dt, where φ : R R is given by 1 if t 1 2π ( ) π, t 1 φ(t) = 2 +t2 sin if 0 < t < 1 t π, 0 if t = 0. 1 if t 1 2π π. 12

Since φ is locally Lipschitz, ϕ is C 1,1 -smooth and ϕ(x) = φ(x) for every x R. Moreover, ϕ is twice differentiable everywhere except the points 1 π and 1 π. Let x,u Rn, u 0 such that ϕ(x),u = 0. Then ϕ(x) = 0, and so x = 0 since 1 2 +xsin(1 x ) > 0 for all x 0. Clearly, { } 1 [ 1 2 ϕ(0)(u) = 2 u and 2 2 ϕ(0)(u) = u, 3 2 u] if u 0, [ 3 2 u, 1 2 u] if u < 0. Hence, (22) holds while (15) is not satisfied. 5 Conclusions We have obtained several second-order necessary and sufficient conditions for the (strict) quasiconvexity and the (strict) pseudoconvexity of C 1,1 -smooth functions on finite-dimensional Euclidean spaces. Many examples are proposed to illustrate our results. Further investigations are needed to generalize our results to wider classes of smooth and non-smooth functions on infinite-dimensional Banach spaces. References 1. Aussel, D.: Corvellec, J.N., Lassonde, M.: Subdifferential characterization of quasiconvexity and convexity. J. Convex Anal. 1, 195 201 (1994) 2. Aussel, D.: Subdifferential properties of quasiconvex and pseudoconvex functions: Unified approach. J. Optim. Theory Appl. 97, 29 45 (1998) 3. Avriel, M.: r-convex functions. Math. Program. 2, 309 323 (1972) 4. Avriel, M., Diewert, W.E., Schaible, S., Zang, I.: Generalized Concavity, Mathematical Concepts and Methods in Science and Engineering, 36, Plenum Press, New York, (1988). 5. Barron, E.N., Goebel, R., Jensen, R.R.: The quasiconvex envelope through first-order partial differential equations which characterize quasiconvexity of nonsmooth functions. Discrete Contin. Dyn. Syst. Ser. B 17, 1693 1706 (2012) 6. Barron, E.N., Goebel, R., Jensen, R.R.: Quasiconvex functions and nonlinear PDEs. Trans. Amer. Math. Soc. 365, 4229 4255 (2013) 7. Cambina, A., Martein, L.: Generalized Convexity and Optimization. Theory and Applications, Springer, Berlin (2009) 8. Chieu, N.H., Lee, G.M., Yen, N.D.: Second-order subdifferentials and optimality conditions for C 1 -smooth optimization problems. Appl. Anal. Optim. 1, 461 476 (2017) 13

9. Crouzeix, J.-P.: On second order conditions for quasiconvexity. Math. Program. 18, 349 352 (1980) 10. Crouzeix, J.P., Ferland, J.A.: Criteria for quasiconvexity and pseudoconvexity: relationships and comparisons. Math. Program. 23, 193 205 (1982) 11. Crouzeix J.-P.: Characterizations of generalized convexity and monotonicity, a survey. Generalized Convexity, Generalized Monotonicity, 237 256 (1998) 12. Ginchev, I., Ivanov, V.I.: Second-order characterizations of convex and pseudoconvex functions. J. Appl. Anal. 9, 261-273 (2003) 13. Hiriart-Urruty, J.B., Strodiot, J.J., and Hien, N.V.:Generalized Hessian matrix and second order optimality conditions for problems with C 1,1 data. Appl. Math. Optim. 11, 43 56 (1984) 14. Hoa, B.T., Khanh P.D., Trinh, T.T.T.: Characterizations of nonsmooth robustly quasiconvex functions. J. Optim. Theory Appl. DOI: 10.1007/s10957-018-1421-3 15. Ivanov, V.I.: Characterizations of pseudoconvex functions and semistrictly quasiconvex ones. J. Global Optim. 57, 677 693 (2013) 16. Luc, D.T.: Characterizations of quasiconvex function. Bull. Aust. Math. Soc. 48, 393 405 (1993) 17. Luc, D.T.: Taylor s formula for C k,1 functions. SIAM J. Optim. 5, 659 669 (1995) 18. Mordukhovich, B.S.; Nam, N.M.; Yen, N.D.: Fréchet subdifferential calculus and optimality conditions in nondifferentiable programming, Optimization. 55, 685 708 (2006) 19. Mordukhovich, B.S.: Variational Analysis and Generalized Differentiation. In: Basic Theory, vol. I. Applications, vol. II. Springer, Berlin (2006) 20. Soleimani-damaneh, M.: Characterization of nonsmooth quasiconvex and pseudoconvex functions. J. Math. Anal. Appl. 330, 1387 1392 (2007) 21. Rockafellar, R.T., Wets, R.J.-B.: Variational Analysis. Springer, Berlin (1998) 22. Yang, X.Q.: Continuous generalized convex functions and their characterizations. Optimization 54, 495 506 (2005) 14