(U 2 ayxtyj < (2 ajjxjxj) (2 a^jj),

Similar documents
Some Properties of the Augmented Lagrangian in Cone Constrained Optimization

CLOSED RANGE POSITIVE OPERATORS ON BANACH SPACES

The local equicontinuity of a maximal monotone operator

arxiv: v1 [math.oc] 21 Mar 2015

Relaxed Quasimonotone Operators and Relaxed Quasiconvex Functions

Local strong convexity and local Lipschitz continuity of the gradient of convex functions

On nonexpansive and accretive operators in Banach spaces

WEAK CONVERGENCE OF RESOLVENTS OF MAXIMAL MONOTONE OPERATORS AND MOSCO CONVERGENCE

MAXIMALITY OF SUMS OF TWO MAXIMAL MONOTONE OPERATORS

Convex Optimization Theory. Chapter 5 Exercises and Solutions: Extended Version

SOME GENERALIZATION OF MINTY S LEMMA. Doo-Young Jung

Yuqing Chen, Yeol Je Cho, and Li Yang

ITERATIVE SCHEMES FOR APPROXIMATING SOLUTIONS OF ACCRETIVE OPERATORS IN BANACH SPACES SHOJI KAMIMURA AND WATARU TAKAHASHI. Received December 14, 1999

Two-Step Iteration Scheme for Nonexpansive Mappings in Banach Space

FUNCTION BASES FOR TOPOLOGICAL VECTOR SPACES. Yılmaz Yılmaz

Maximal Monotone Operators with a Unique Extension to the Bidual

Steepest descent approximations in Banach space 1

SOME REMARKS ON THE SPACE OF DIFFERENCES OF SUBLINEAR FUNCTIONS

Maximal Monotonicity, Conjugation and the Duality Product in Non-Reflexive Banach Spaces

Subdifferential representation of convex functions: refinements and applications

Brøndsted-Rockafellar property of subdifferentials of prox-bounded functions. Marc Lassonde Université des Antilles et de la Guyane

ON THE RANGE OF THE SUM OF MONOTONE OPERATORS IN GENERAL BANACH SPACES

CHAPTER 2: CONVEX SETS AND CONCAVE FUNCTIONS. W. Erwin Diewert January 31, 2008.

CONVERGENCE OF THE STEEPEST DESCENT METHOD FOR ACCRETIVE OPERATORS

Convergence rate estimates for the gradient differential inclusion

HAIYUN ZHOU, RAVI P. AGARWAL, YEOL JE CHO, AND YONG SOO KIM

On pseudomonotone variational inequalities

On Gap Functions for Equilibrium Problems via Fenchel Duality

STRONG CONVERGENCE OF AN IMPLICIT ITERATION PROCESS FOR ASYMPTOTICALLY NONEXPANSIVE IN THE INTERMEDIATE SENSE MAPPINGS IN BANACH SPACES

Introduction to Real Analysis Alternative Chapter 1

On a result of Pazy concerning the asymptotic behaviour of nonexpansive mappings

("-1/' .. f/ L) I LOCAL BOUNDEDNESS OF NONLINEAR, MONOTONE OPERA TORS. R. T. Rockafellar. MICHIGAN MATHEMATICAL vol. 16 (1969) pp.

A locally convex topology and an inner product 1

Viscosity Iterative Approximating the Common Fixed Points of Non-expansive Semigroups in Banach Spaces

Convexity in R n. The following lemma will be needed in a while. Lemma 1 Let x E, u R n. If τ I(x, u), τ 0, define. f(x + τu) f(x). τ.

ON A HYBRID PROXIMAL POINT ALGORITHM IN BANACH SPACES

PROBLEMS. (b) (Polarization Identity) Show that in any inner product space

Convex Optimization Notes

Victoria Martín-Márquez

Contents: 1. Minimization. 2. The theorem of Lions-Stampacchia for variational inequalities. 3. Γ -Convergence. 4. Duality mapping.

ON A LEMMA OF BISHOP AND PHELPS

Convergence Theorems of Approximate Proximal Point Algorithm for Zeroes of Maximal Monotone Operators in Hilbert Spaces 1

Convex analysis and profit/cost/support functions

Linear Normed Spaces (cont.) Inner Product Spaces

YET MORE ON THE DIFFERENTIABILITY OF CONVEX FUNCTIONS

The best generalised inverse of the linear operator in normed linear space

The Nearest Doubly Stochastic Matrix to a Real Matrix with the same First Moment

SOME RESULTS ON 2-INNER PRODUCT SPACES

CONVERGENCE OF HYBRID FIXED POINT FOR A PAIR OF NONLINEAR MAPPINGS IN BANACH SPACES

WEAK CONVERGENCE THEOREMS FOR EQUILIBRIUM PROBLEMS WITH NONLINEAR OPERATORS IN HILBERT SPACES

1 Introduction and preliminaries

Iterative Convex Optimization Algorithms; Part One: Using the Baillon Haddad Theorem

Lecture 1: Background on Convex Analysis

An introduction to some aspects of functional analysis

Hilbert Space Methods Used in a First Course in Quantum Mechanics A Recap WHY ARE WE HERE? QUOTE FROM WIKIPEDIA

STRONG CONVERGENCE THEOREMS FOR COMMUTATIVE FAMILIES OF LINEAR CONTRACTIVE OPERATORS IN BANACH SPACES

On Common Fixed Point and Approximation Results of Gregus Type

On duality theory of conic linear problems

FIXED POINT THEOREMS AND CHARACTERIZATIONS OF METRIC COMPLETENESS. Tomonari Suzuki Wataru Takahashi. 1. Introduction

PROJECTIONS ONTO CONES IN BANACH SPACES

Journal of Inequalities in Pure and Applied Mathematics

SHRINKING PROJECTION METHOD FOR A SEQUENCE OF RELATIVELY QUASI-NONEXPANSIVE MULTIVALUED MAPPINGS AND EQUILIBRIUM PROBLEM IN BANACH SPACES

BASICS OF CONVEX ANALYSIS

David Hilbert was old and partly deaf in the nineteen thirties. Yet being a diligent

arxiv: v1 [math.fa] 24 Oct 2018

TWO MAPPINGS RELATED TO SEMI-INNER PRODUCTS AND THEIR APPLICATIONS IN GEOMETRY OF NORMED LINEAR SPACES. S.S. Dragomir and J.J.

ON GAP FUNCTIONS OF VARIATIONAL INEQUALITY IN A BANACH SPACE. Sangho Kum and Gue Myung Lee. 1. Introduction

Shiqian Ma, MAT-258A: Numerical Optimization 1. Chapter 4. Subgradient

Duality (Continued) min f ( x), X R R. Recall, the general primal problem is. The Lagrangian is a function. defined by

Epiconvergence and ε-subgradients of Convex Functions

SEPARATION AXIOMS FOR INTERVAL TOPOLOGIES

i=1 α i. Given an m-times continuously

arxiv:math/ v1 [math.fa] 16 Jul 2001

ON WEAK SOLUTION OF A HYPERBOLIC DIFFERENTIAL INCLUSION WITH NONMONOTONE DISCONTINUOUS NONLINEAR TERM

Common fixed points of two generalized asymptotically quasi-nonexpansive mappings

Your first day at work MATH 806 (Fall 2015)

Shih-sen Chang, Yeol Je Cho, and Haiyun Zhou

Appendix A Functional Analysis

STRONG CONVERGENCE THEOREMS BY A HYBRID STEEPEST DESCENT METHOD FOR COUNTABLE NONEXPANSIVE MAPPINGS IN HILBERT SPACES

Upper sign-continuity for equilibrium problems

Introduction to Functional Analysis With Applications

A SHORT INTRODUCTION TO BANACH LATTICES AND

Leavitt path and graph C -algebras: connections via traces

REGULAR LAGRANGE MULTIPLIERS FOR CONTROL PROBLEMS WITH MIXED POINTWISE CONTROL-STATE CONSTRAINTS

Self-dual Smooth Approximations of Convex Functions via the Proximal Average

arxiv: v1 [math.fa] 11 Oct 2018

I teach myself... Hilbert spaces

IN AN ALGEBRA OF OPERATORS

SOME GEOMETRIC PROPERTIES RELATED TO THE FIXED POINT THEORY FOR NONEXPANSIVE MAPPINGS

On Banach-Steinhause Theorems in Generalized 2-Normed Spaces

Subdifferentiability and the Duality Gap

Examples of Convex Functions and Classifications of Normed Spaces

The Journal of Nonlinear Science and Applications

arxiv:math/ v1 [math.ca] 21 Apr 2006

Chapter 2. Vectors and Vector Spaces

INEQUALITIES FOR THE NORM AND THE NUMERICAL RADIUS OF LINEAR OPERATORS IN HILBERT SPACES

An inexact subgradient algorithm for Equilibrium Problems

The Subdifferential of Convex Deviation Measures and Risk Functions

PROPERTIES OF FIXED POINT SET OF A MULTIVALUED MAP

Semidefinite Programming

Transcription:

PROCEEDINGS Ol THE AMERICAN MATHEMATICAL SOCIETY Volume 59, Number 1. August 1976 THE MEANING OF THE CAUCHY-SCHWARZ- BUNIAKOVSKY INEQUALITY eduardo h. zarantonello1 Abstract. It is proved that a mapping 7": X -* X* from a topological real vector space into its dual satisfies the inequality (Ty,x~) < (Tx,x}' (Ty,yy if and only if it is the restriction of a positively homogeneous subdifferential operator. The Cauchy-Schwarz-Buniakovsky quadratic form says inequality for a nonnegative definite real,. / \l/2/ sl/2 (U 2 ayxtyj < (2 ajjxjxj) (2 a^jj), where positive roots are taken. Usually an absolute value sign is placed around the left-hand member, to obtain only an apparently stronger inequality. If x denotes the row vector of components xx,x2,...,xn, and x* = Tx the column-vector of components 2 OyXj, 2 a2jxj> > 2 anjxj> tnen (0 can De written in the form (2) <7>,jc> < (Tx,x),/2(Ty,y)]/2, the angular brackets indicating the matrix theoretical product of a columnvector and a line-vector. In this form the CSB-inequality appears as a relation satisfied by a mapping T: X > X* from a linear space X into its dual X*. Therefore, it is natural to ask what such a relation means for the operator T, or, in other words, what can be said of an operator T satisfying the CSBinequality. In posing such a question nothing should a priori be assumed of T beyond that which is strictly necessary to make the inequality meaningful. Thus, T will just be a mapping, possibly many valued, from X into X* satisfying the CSB-inequality (2), taken to mean (3) <y*,x) < (x*,xf2(y*,y)l/2, for any x and y in D(T) and any choice of x* and y* in Tx and Ty respectively, and where the square root is construed to mean that the quantity under the square root sign as well as the result of the operation is a nonnegative number. Let us recall in passing that the domain of definition of Received by the editors June 5, 1975. A MS (MOS) subject classifications (1970). Primary 47H05; Secondary 52A40, 26A86. Key words and phrases. Cauchy-Schwarz-Buniakovsky inequality, convex function, subdifferential, cyclically monotone operators. 1 Sponsored by the United States Army under Contract No. DA-31-124-ARO-D-462. American Mathematical Society 1976 133

!34 E. h. ZARANTONELLO a many-valued (or set-valued) mapping T is the set D(T) = {x Tx = 0}. Easily constructed examples of nonlinear many-valued operators satisfying (2) indicate that none of this generality is superfluous (see [6, Theorem 9.1]). Our purpose here is to point out that the CSB-inequality does not lead to a new category of objects but to a known class of operators, the positively homogeneous subdifferential operators, and in consequence, that the CSBinequality sits squarely in the midst of convexity. So, surprisingly, convexity rather than linearity (or "quadraticity") is the context in which the CSBinequality should be placed. Particular instances of this situation are known. Besides the linear positive selfadjoint operators a conspicuous case is offered by the "duality mapping" of a Banach space into its dual, defined by Jx = {x G X*\(x*,x> = x* = x }. This operator, of frequent appearance in convexity and monotonicity theory, satisfies the CSB-inequality and is the subdifferential of half the norm squared [1], [2]. Inequalities formally identical to (2), often going under the same name but of quite a different nature, are obtained by assigning to the angular brackets meanings other than that of the bilinear form effecting the pairing of two dual spaces. Our results, of course, do not apply to them. For instance, such is the case for the CSBinequality appearing in R. Tapia's papers on the characterization of inner product spaces [4], [5], where the operator is the identity mapping and the brackets denote a sort of generalization (nonbilinear) of the inner product. We begin by describing the terms and concepts needed for our discussion. Let Ibea locally convex, Hausdorff, topological, real vector space, and let X* be its dual (i.e. the set of all continuous linear functional endowed with a topology compatible with the duality between X and X*). Given in X an everywhere defined, lower semicontinuous, convex function k(x), with values on the extended real line ( oo,+oo], we say that a vector u* G X* is a subgradient of k at x, if (4) k(y) - k(x) > (u*,y - x>, Vy G X. When not empty the set of subgradients of k at x is a closed convex set in X*; it is called the "subdifferential" of k at x, and is denoted dk(x). The mapping from X into X*: x > dk(x), is "the subdifferential operator" associated to A:. Subdifferential operators are a subclass of the so-called "cyclically monotone operators". There are mappings T: X -> X* satisfying the inequalities <x*,x, - x0> + <x*,x2 - xx) + + <x*_,,x -x _,> (5) +<x*,x0-x > < 0, V/i > 0, Vx0, x,,..., x G D(T), Vx* G Tx,, i = 0, 1,..., n. If A1 is a Banach space the subdifferentials coincide with the maximal cyclically monotone mapping, that is, with cyclically monotone operators admitting no proper cyclically monotone extensions (cf. [3, Theorem 3']). In other words, since any cyclically monotone operator can be extended to a maximal one, a mapping T: X -» X* of a Banach space into its dual is cyclically monotone if and only if there is a lower semicontinuous convex function k(x) such that Tx C dk(x), Vx G D(T).

CAUCHY-SCHWARZ-BUNIAKOVSKY INEQUALITY 135 An operator T is said to be positively homogeneous if T(tx) ttx for / > 0. As we have already mentioned, it is the class of positively homogeneous subdifferential mappings that is of significance in relation to the CSBinequality, for the CSB-inequality plays for them the role that (5) played for subdifferential mappings in general. The precise result is the following Theorem. A mapping T: X > X* from a locally convex topological real vector space into its dual satisfies the CSB-inequality if and only if it is the restriction of a positively homogeneous subdifferential operator. Or equivalently, the CSBinequality holds if and only if there is a lower semicontinuous convex function k(x), positively homogeneous of degree two, such that (6) Tx C dk(x), Vx G D(T). In such a case k(x) = \{x*,x), Vx G D(T), Vx* G Tx. Proof. Assume first that T satisfies the CSB-inequality, and define the real valued function (7) *(*)= sup {t(y*,x)-(t2/2)(y*,y)}. y<ed(t),y*ety,t^0 As the supremum of a class of affine functions k(x) is a lower semicontinuous convex function; it is also apparent that k(x) is positively homogeneous of degree two. If x G D(T) and x* G Tx, then the triplet x, x*, t = 1, is a possible choice competing for the supremum in the definition of k, and hence k(x) > {-(x*,x). On the other hand $<**,*> - k(x) = inf U<**,*> + (t2/2)(y*,y) - t(y*,x)}, ysd(t).y* CTy,t>0 and since the geometric mean is not larger than the arithmetic one, $<**,*> - k(x) > inf t {t(x*,x)l/2(y*,y)]/2 - t(y*,x)} > 0, y D(T),y* ETy,t>0 by the CSB-inequality. Therefore k(x) = 0*,je>, Vx G D(T), Vx* G Tx. In particular, <x*, x> does not depend on the choice of x* in Tx, and without ambiguity we can write k(x) = \(Tx,x> for x G D(T). Next we see that any x* G Tx is a subgradient of k. To this end we must show that (8) k(y) - k(x) > (x*,y - x>, Vy G X, that is, in view of what has already been proved, that sup{/<z*,^> - (t2/2)(z*,z} - $<**,*> - <x*,y - x)} > 0, z G X, z* G Tz, t > 0, which is obvious since the expression in braces vanishes for z = x, z* = x*, t = 1. Thus, Tx C dk(x), Vx G D(T). We must also verify that 9&(x) is positively homogeneous of degree one. If x* G 3A:(x), then k(y) - k(x) > (x*,y - x>, Vy G X, whence replacing y by t~xy, t > 0, and multiplying by t2,

136 E. H. ZARANTONELLO k(y) - k(tx) > (tx*,y - tx), Vy G X, that is, tx* G dk(tx), and so, tdk(x) C 3A:(/x), Vx G X, t > 0. This relation is reversed by multiplying by /"' and replacing / and x by t~x and tx respectively, so dk(tx) = tdk(x), t > 0. Thus we have completed the proof that the CSB-inequality is sufficient for T to be the restriction of a positively homogeneous subdifferential operator, as well as the last part of the theorem. To establish necessity we show that any positively homogeneous subdifferential mapping T satisfies the CSB-inequality. This we do by means of inequalities (5), which T, as a subdifferential mapping, satisfies. We take any two points x and y in D(T) and any two of their respective images x* and y*, and for any positive integer m set = j (i + l)x, 0 < i < m - 1, I (2m- i)y, m < i < 2m - 1, + _j(/+l)x*, 0<i<m-l, *' ~\(2m- i)y*, m < / < 2m- 1. Clearly, x* G Tx, by the positive homogeneity of T. With this choice of points (5) yields (x* + 2x* + + (m l)x*,x) that is, + (mx*,my mx; -(my* +(m- \)y* + + 2y*,y) + (y*,x - y) < 0, \m(m - l)<x*,x> + m2(x*,y - x) - \(m + 2)(m - l)</,^> whence dividing by m1 and letting m» oo, + (y*,x-y) < 0, 0 >!<**,*> + (x*,y - x> - \(y*,y) = <x*,y) - J<**,*> " J<^*^>- By writing ty and /y* in place of y and /*, as we may, and letting t approach zero we obtain <x*,x> > 0, and similarly (y*,y) > 0. Finally the substitution x -> ;~'x,7 -> (y, x* -» '"'x*,^* -» (y*> yields 0>(/,y)-Jr2(x*,.)-l/V^ from which the CSB-inequality follows by observing that the supremum of the right-hand side is (x*,y) - (x*,x}l'2(y*,y)1'2. This brings the proof to an end. Remark. If the notation Tx C d{(tx,x> is allowed to mean that there is a l.s.c. convex function k(x) such that k(x) = j<tx,x) and Tx C dk(x), Vx G D(T), the conclusion may be drawn that the CSB-inequality is equivalent to the subdifferential relation Tx C 3j(Tx,x>.

cauchy-schwarz-buniakovsky inequality 137 References 1. J. P. Aubin, Optimal approximation and characterization of the error and stability functions in Banach spaces, J. Approximation Theory 3 (1970), 430-^44. MR 43 #795. 2. A. Beurling and A. E. Livingston, A theorem on duality mappings in Banach spaces, Ark. Mat. 4 (1962), 405^*11. MR 26 #2851. 3. R. T. Rockafellar, Convex functions, monotone operators and variational inequalities, Theory and Applications of Monotone Operators (Proc. NATO Advanced Study Inst., Venice, 1968), Edizioni "Oderisi", Gubbio, 1969, pp. 35-65. MR 41 #6028. 4. R. A. Tapia, A characterization of inner product spaces, Bull. Amer. Math. Soc. 79 (1973), 530-531. MR 47 #3964. 5. -, A characterization of inner product spaces, Proc. Amer. Math. Soc. 41 (1973), 569-574. MR 49 #5791. 6. E. H. Zarantonello, Projections on convex sets in Hilbert space and spectral theory. Contributions to Nonlinear Functional Analysis, Academic Press, New York, 1971, pp. 237-424. Mathematics Research Center, University of Wisconsin, Madison Wisconsin 53706