subgradient trajectories : the convex case

Similar documents
Spring School on Variational Analysis Paseky nad Jizerou, Czech Republic (April 20 24, 2009)

Characterizations of Lojasiewicz inequalities: subgradient flows, talweg, convexity.

From error bounds to the complexity of first-order descent methods for convex functions

ASYMPTOTIC BEHAVIOUR OF SELF-CONTRACTED PLANAR CURVES AND GRADIENT ORBITS OF CONVEX FUNCTIONS

Sequential convex programming,: value function and convergence

On damped second-order gradient systems

Solutions to Tutorial 8 (Week 9)

A semi-algebraic look at first-order methods

I P IANO : I NERTIAL P ROXIMAL A LGORITHM FOR N ON -C ONVEX O PTIMIZATION

Generic identifiability and second-order sufficiency in tame convex optimization

Solutions for Math 217 Assignment #3

CLARKE CRITICAL VALUES OF SUBANALYTIC LIPSCHITZ CONTINUOUS FUNCTIONS

Mañé s Conjecture from the control viewpoint

Nonlinear Systems and Control Lecture # 12 Converse Lyapunov Functions & Time Varying Systems. p. 1/1

Neighboring feasible trajectories in infinite dimension

Steepest descent method on a Riemannian manifold: the convex case

LECTURE 15: COMPLETENESS AND CONVEXITY

Lipschitz continuity properties

Convergence rates for an inertial algorithm of gradient type associated to a smooth nonconvex minimization

Integral Jensen inequality

Douglas-Rachford splitting for nonconvex feasibility problems

Active sets, steepest descent, and smooth approximation of functions

Definitions and Properties of R N

Tame variational analysis

Proximal Alternating Linearized Minimization for Nonconvex and Nonsmooth Problems

A sufficient condition for observability of waves by measurable subsets

A gradient type algorithm with backward inertial steps for a nonconvex minimization

Recent Trends in Differential Inclusions

Analysis of the convergence rate for the cyclic projection algorithm applied to basic semi-algebraic convex sets

arxiv: v2 [math.oc] 21 Nov 2017

Hausdorff dimension of weighted singular vectors in R 2

1 Lyapunov theory of stability

A user s guide to Lojasiewicz/KL inequalities

PROBLEMS. (b) (Polarization Identity) Show that in any inner product space

REVERSIBILITY AND OSCILLATIONS IN ZERO-SUM DISCOUNTED STOCHASTIC GAMES

Variational Analysis and Tame Optimization

(1) Consider the space S consisting of all continuous real-valued functions on the closed interval [0, 1]. For f, g S, define

Hedy Attouch, Jérôme Bolte, Benar Svaiter. To cite this version: HAL Id: hal

Analysis of the convergence rate for the cyclic projection algorithm applied to semi-algebraic convex sets

Functional Analysis HW #3

PARTIAL REGULARITY OF BRENIER SOLUTIONS OF THE MONGE-AMPÈRE EQUATION

An introduction to Mathematical Theory of Control

Relative Isoperimetric Inequality Outside Convex Bodies

Problem set 1, Real Analysis I, Spring, 2015.

Morse-Sard theorem for Clarke critical values

Convex Analysis and Economic Theory Winter 2018

A LOWER BOUND ON THE SUBRIEMANNIAN DISTANCE FOR HÖLDER DISTRIBUTIONS

Self-equilibrated Functions in Dual Vector Spaces: a Boundedness Criterion

On the iterate convergence of descent methods for convex optimization

SOME REMARKS ON SUBDIFFERENTIABILITY OF CONVEX FUNCTIONS

Generic Aubry sets on surfaces

ON A CERTAIN GENERALIZATION OF THE KRASNOSEL SKII THEOREM

Scaling limit of random planar maps Lecture 2.

Overview of normed linear spaces

History (Minimal Dynamics Theorem, Meeks-Perez-Ros 2005, CMC Dynamics Theorem, Meeks-Tinaglia 2008) Giuseppe Tinaglia

Steepest descent method on a Riemannian manifold: the convex case

Functional Analysis HW #1

7 About Egorov s and Lusin s theorems

Another consequence of the Cauchy Schwarz inequality is the continuity of the inner product.

Subdifferential representation of convex functions: refinements and applications

The Folk Theorem for Finitely Repeated Games with Mixed Strategies

An inertial forward-backward algorithm for the minimization of the sum of two nonconvex functions

arxiv: v1 [math.oc] 11 Jan 2008

Homework Assignment #5 Due Wednesday, March 3rd.

Dirichlet uniformly well-approximated numbers

MTG 5316/4302 FALL 2018 REVIEW FINAL

Existence and Approximation of Fixed Points of. Bregman Nonexpansive Operators. Banach Spaces

3. Convex functions. basic properties and examples. operations that preserve convexity. the conjugate function. quasiconvex functions

Spring 2014 Advanced Probability Overview. Lecture Notes Set 1: Course Overview, σ-fields, and Measures

B 1 = {B(x, r) x = (x 1, x 2 ) H, 0 < r < x 2 }. (a) Show that B = B 1 B 2 is a basis for a topology on X.

Exam February h

1. Foundations of Numerics from Advanced Mathematics. Mathematical Essentials and Notation

How circular are generalized circles

Estimates for the resolvent and spectral gaps for non self-adjoint operators. University Bordeaux

Dirichlet uniformly well-approximated numbers

First Order Methods beyond Convexity and Lipschitz Gradient Continuity with Applications to Quadratic Inverse Problems

2. Dual space is essential for the concept of gradient which, in turn, leads to the variational analysis of Lagrange multipliers.

g 2 (x) (1/3)M 1 = (1/3)(2/3)M.

Optimization and Optimal Control in Banach Spaces

Open Problems about Curves, Sets, and Measures

Complex Analysis Problems

Some Contributions to Convex Infinite-Dimensional Optimization Duality

There is a more global concept that is related to this circle of ideas that we discuss somewhat informally. Namely, a region R R n with a (smooth)

COUNTABLE PRODUCTS ELENA GUREVICH

Extremal Solutions of Differential Inclusions via Baire Category: a Dual Approach

Strongly convex functions, Moreau envelopes and the generic nature of convex functions with strong minimizers

Reproducing Kernel Hilbert Spaces Class 03, 15 February 2006 Andrea Caponnetto

ECARES Université Libre de Bruxelles MATH CAMP Basic Topology

Lecture 7: The wave equation: higher dimensional case

LECTURE 3: SMOOTH FUNCTIONS

Received: 15 December 2010 / Accepted: 30 July 2011 / Published online: 20 August 2011 Springer and Mathematical Optimization Society 2011

Some Properties of the Augmented Lagrangian in Cone Constrained Optimization

A local time scaling exponent for compact metric spaces

Block Coordinate Descent for Regularized Multi-convex Optimization

Derivatives. Differentiability problems in Banach spaces. Existence of derivatives. Sharpness of Lebesgue s result

Variational and Topological methods : Theory, Applications, Numerical Simulations, and Open Problems 6-9 June 2012, Northern Arizona University

MATH 722, COMPLEX ANALYSIS, SPRING 2009 PART 5

Analytic Continuation of Analytic (Fractal) Functions

Deforming conformal metrics with negative Bakry-Émery Ricci Tensor on manifolds with boundary

Exit times of diffusions with incompressible drifts

Transcription:

trajectories : Université de Tours www.lmpt.univ-tours.fr/ ley Joint work with : Jérôme Bolte (Paris vi) Aris Daniilidis (U. Autonoma Barcelona & Tours) and Laurent Mazet (Paris xii)

inequality inequality [ 1963] f : R N R is analytic. Let a be a critical point of f. Then there exists a neighborhood U of a, C > 0 and θ (0, 1) such that f (x) f (x) f (a) θ for all x U. Finite length of the gradient trajectories, Every critical point is limit of a gradient trajectory, etc.

Basic assumptions To simplify : H is a real Hilbert space f : H [0, + ) is smooth (f 0) For all r > 0, C r := {f r} (A0) (0 is a critical point and a global minimum) 0 C 0 (A1) (0 is an isolated critical value) There exits r 0 > 0 such that : x C r0 and f (x) > 0 f (x) 0 (A2) (Sublevel compactness) There exits r 0 > such that : C r0 = {f r 0 } is compact.

Generalization : K L-inequality We say that f satisfies inequality [Kurdyka 1998] if : There exists ϕ KL(0, r 0 ) such that : where : (ϕ f )(x) 1 for all x C r0 \ C 0. KL(0, r 0 ) = { ϕ : [0, r 0 ] R + continuous, ϕ(0) = 0, ϕ C 1 (0, r 0 ), ϕ > 0 }. Lojasiewicz inequality is a particular with ϕ(r) = 1 C(1 θ) r 1 θ.

The convex From now on, we assume that f is convex Issues : 1 Characterizations of the K L-inequality in 2 Does a convex function satisfy the K L-inequality?

Piecewise gradient curves Gradient dynamical system : { Ẋx (t) = f (X x (t)), t 0 X x (0) = x A piecewise gradient curve γ is a countable family of gradient curves X xi ([0, t i )) with f (X xi (0)) = f (x i ) = r i, f (X xi (t i )) = r i+1 r i C r0 x 0 X x0 (t) i + 0 C r2 C r1 C r3 x 1 x 2 C 0 0

Classical properties of the convex gradient curves Lemma. For all x 0 C r0 \ C 0, 1 t f (X x0 (t)) is convex, L 1 (0, + ) and decreasing with limit 0. 2 Each trajectory goes closer to all minima at the same time, i.e., for each a C 0, 3 For all T > 0, d dt X x 0 (t) a 2 2f (X x0 (t)) < 0. T 0 Ẋ x0 (t) dt 1 2 x 0 log T.

Characterizations of the K L-inequality (f convex) Theorem. The following statements are equivalent : 1 f satisfies the K L-inequality in C r0 : (ϕ f )(x) 1 with ϕ KL(0, r 0 ). 2 f satisfies the K L-inequality globally in H with ϕ KL(0, + ) which is concave. 1 3 r (0, r 0 ] is integrable. f (x) inf f (x)=r 4 For all piecewise gradient curves γ in C r0 we have length(γ) = ti i=0 0 Ẋ xi (t) dt <.

Length of the convex gradient curves [Brézis 1973] Given x 0 C r0, do we have length(x x0 ) = 0 Ẋ x0 (t) dt <? Theorem. [Brézis 1973] Yes if int(argmin(f )). finite length finite length Xx0 (t) Ẋx0 (t) C0 C0 unknown length Theorem. [Baillon 1978] No in general (counter-example in infinite dimension)

A sufficient condition for a convex function to satisfy K L-inequality Theorem. Assume that there exists m : [0, + ) [0, + ) continuous increasing with m(0) = 0 such that f m(dist(, C 0 )) on C r0 and r0 0 m 1 (r) dr < + (growth condition). (1) r Then K L-inequality holds for f. Proof : f (x) f (x), x p C0 (x) f (x) dist(x, C 0 ) f (x) m 1 (f (x)). non analytic examples : m(r) = exp( 1/r α ), α (0, 1) satisfies (1).

A smooth convex counterexample to K L-inequality Theorem. There exists a C 2 convex function f : R 2 R + with {f = 0} = D(0, 1) for which K L-inequality fails. Note that the gradient trajectories have uniform finite length.

An auxiliary problem A farmer rakes its (convex) field in several steps in the following way : l0 l1 l2 If he is unlucky, is it possible that he walks an infinite path? (i.e. l i = + ) i 0

An auxiliary problem A farmer rakes its (convex) field in several steps in the following way : l0 l1 l2 If he is unlucky, is it possible that he walks an infinite path? (i.e. l i = + ) i 0 Answer : Yes!

Hausdorff distance between nested convex sets Lemma. There exists a decreasing sequence of compact convex subsets {T k } k in R 2 such that : (i) T 0 is the disk D := D(0, 2) ; (ii) T k+1 int T k for every k N ; (iii) k N T k is the unit disk D(0, 1) ; (iv) + k=0 dist Hausdorff (T k, T k+1 ) = +.

Picture of the sequence of convex sets 1 l k := dist Hausdorff (T k, T k+1 ) R i R i+1 and N i Ri R i+1 It suffices to take R i R i+1 = 1 in order that i 2 i R i R i+1 < and k l k i N i(r i R i+1 ) i Ri R i+1 = +.

End of the construction Construction of a convex function with prescribed sublevel sets T k : [Torralba 1996]. Smoothing of the function.