A notion of Total Dual Integrality for Convex, Semidefinite and Extended Formulations

Similar documents
- Well-characterized problems, min-max relations, approximate certificates. - LP problems in the standard form, primal and dual linear programs

1 Review of last lecture and introduction

7. Lecture notes on the ellipsoid algorithm

LMI MODELLING 4. CONVEX LMI MODELLING. Didier HENRION. LAAS-CNRS Toulouse, FR Czech Tech Univ Prague, CZ. Universidad de Valladolid, SP March 2009

Linear and Combinatorial Optimization

CSC Linear Programming and Combinatorial Optimization Lecture 12: The Lift and Project Method

Additional Homework Problems

Semidefinite Programming Basics and Applications

Chapter 1. Preliminaries

CSC Linear Programming and Combinatorial Optimization Lecture 10: Semidefinite Programming

Shiqian Ma, MAT-258A: Numerical Optimization 1. Chapter 4. Subgradient

Linear Programming. Scheduling problems

On the relative strength of families of intersection cuts arising from pairs of tableau constraints in mixed integer programs

HW1 solutions. 1. α Ef(x) β, where Ef(x) is the expected value of f(x), i.e., Ef(x) = n. i=1 p if(a i ). (The function f : R R is given.

Lecture notes on the ellipsoid algorithm

Introduction to Semidefinite Programming I: Basic properties a

Integer Programming, Part 1

Convex Optimization M2

Cuts for mixed 0-1 conic programs

constraints Ax+Gy» b (thus any valid inequalityforp is of the form u(ax+gy)» ub for u 2 R m + ). In [13], Gomory introduced a family of valid inequali

Semidefinite and Second Order Cone Programming Seminar Fall 2001 Lecture 5

3.7 Strong valid inequalities for structured ILP problems

14. Duality. ˆ Upper and lower bounds. ˆ General duality. ˆ Constraint qualifications. ˆ Counterexample. ˆ Complementary slackness.

3. Linear Programming and Polyhedral Combinatorics

Lecture 1: Background on Convex Analysis

I.3. LMI DUALITY. Didier HENRION EECI Graduate School on Control Supélec - Spring 2010

LP Duality: outline. Duality theory for Linear Programming. alternatives. optimization I Idea: polyhedra

Linear and non-linear programming

Asteroide Santana, Santanu S. Dey. December 4, School of Industrial and Systems Engineering, Georgia Institute of Technology

4. Algebra and Duality

Integer Programming ISE 418. Lecture 13. Dr. Ted Ralphs

arxiv:math/ v1 [math.co] 23 May 2000

c 2000 Society for Industrial and Applied Mathematics

Lecture 5. Theorems of Alternatives and Self-Dual Embedding

Relations between Semidefinite, Copositive, Semi-infinite and Integer Programming

VERTICES OF SPECTRAHEDRA ARISING FROM THE ELLIPTOPE, THE THETA BODY, AND THEIR RELATIVES

Geometric Ramifications of the Lovász Theta Function and Their Interplay with Duality

Lecture 8. Strong Duality Results. September 22, 2008

Integer Programming ISE 418. Lecture 16. Dr. Ted Ralphs

COURSE ON LMI PART I.2 GEOMETRY OF LMI SETS. Didier HENRION henrion

Acyclic Semidefinite Approximations of Quadratically Constrained Quadratic Programs

LECTURE 25: REVIEW/EPILOGUE LECTURE OUTLINE

Convexification of Mixed-Integer Quadratically Constrained Quadratic Programs

Constrained Optimization and Lagrangian Duality

Technische Universität München, Zentrum Mathematik Lehrstuhl für Angewandte Geometrie und Diskrete Mathematik. Combinatorial Optimization (MA 4502)

Week 8. 1 LP is easy: the Ellipsoid Method

Separation Techniques for Constrained Nonlinear 0 1 Programming

On the relative strength of families of intersection cuts arising from pairs of tableau constraints in mixed integer programs

U.C. Berkeley CS294: Beyond Worst-Case Analysis Handout 12 Luca Trevisan October 3, 2017

WHEN DOES THE POSITIVE SEMIDEFINITENESS CONSTRAINT HELP IN LIFTING PROCEDURES?

9. Interpretations, Lifting, SOS and Moments

A Review of Linear Programming

Integer Programming ISE 418. Lecture 12. Dr. Ted Ralphs

EE364a Review Session 5

Semidefinite Programming

Conic Linear Optimization and its Dual. yyye

Successive Convex Relaxation Methods for Nonconvex Quadratic Optimization Problems

LP. Kap. 17: Interior-point methods

Mixed-integer linear representability, disjunctions, and variable elimination

3. Linear Programming and Polyhedral Combinatorics

Mathematics 530. Practice Problems. n + 1 }

Summer School: Semidefinite Optimization

The Ellipsoid Algorithm

5. Duality. Lagrangian

Lecture: Introduction to LP, SDP and SOCP

MAT-INF4110/MAT-INF9110 Mathematical optimization

CO 250 Final Exam Guide

LP Relaxations of Mixed Integer Programs

Lecture 2: The Simplex method

Lectures 6, 7 and part of 8

Integer programming: an introduction. Alessandro Astolfi

Part IB Optimisation

Lecture: Cone programming. Approximating the Lorentz cone.

Convex Optimization M2

Lecture 3: Lagrangian duality and algorithms for the Lagrangian dual problem

Convex relaxation. In example below, we have N = 6, and the cut we are considering

SEMIDEFINITE PROGRAM BASICS. Contents

Convex relaxation. In example below, we have N = 6, and the cut we are considering

arxiv: v15 [math.oc] 19 Oct 2016

1 Review Session. 1.1 Lecture 2

Subgradient. Acknowledgement: this slides is based on Prof. Lieven Vandenberghes lecture notes. definition. subgradient calculus

Optimization WS 13/14:, by Y. Goldstein/K. Reinert, 9. Dezember 2013, 16: Linear programming. Optimization Problems

Deciding Emptiness of the Gomory-Chvátal Closure is NP-Complete, Even for a Rational Polyhedron Containing No Integer Point

Minimal inequalities for an infinite relaxation of integer programs

Spring 2017 CO 250 Course Notes TABLE OF CONTENTS. richardwu.ca. CO 250 Course Notes. Introduction to Optimization

Lagrange Relaxation and Duality

The Primal-Dual Algorithm P&S Chapter 5 Last Revised October 30, 2006

OPTIMISATION 3: NOTES ON THE SIMPLEX ALGORITHM

Problem 1 (Exercise 2.2, Monograph)

Interior Point Algorithms for Constrained Convex Optimization

Lecture 8 Plus properties, merit functions and gap functions. September 28, 2008

Zero sum games Proving the vn theorem. Zero sum games. Roberto Lucchetti. Politecnico di Milano

Separation, Inverse Optimization, and Decomposition. Some Observations. Ted Ralphs 1 Joint work with: Aykut Bulut 1

Lecture #21. c T x Ax b. maximize subject to

Semidefinite and Second Order Cone Programming Seminar Fall 2001 Lecture 4

On the matrix-cut rank of polyhedra

{ move v ars to left, consts to right { replace = by t wo and constraints Ax b often nicer for theory Ax = b good for implementations. { A invertible

Applications of semidefinite programming in Algebraic Combinatorics

Lift-and-Project Techniques and SDP Hierarchies

EE/ACM Applications of Convex Optimization in Signal Processing and Communications Lecture 17

Transcription:

A notion of for Convex, Semidefinite and Extended Formulations Marcel de Carli Silva Levent Tunçel April 26, 2018

A vector in R n is integral if each of its components is an integer,

A vector in R n is integral if each of its components is an integer, and a rational system of linear inequalities Ax b is called totally dual integral (TDI)

A vector in R n is integral if each of its components is an integer, and a rational system of linear inequalities Ax b is called totally dual integral (TDI) if, for every integral vector c Z n, the LP problem dual to sup { c, x : Ax b} has an integral optimal solution whenever it has an optimal solution at all.

A vector in R n is integral if each of its components is an integer, and a rational system of linear inequalities Ax b is called totally dual integral (TDI) if, for every integral vector c Z n, the LP problem dual to sup { c, x : Ax b} has an integral optimal solution whenever it has an optimal solution at all. In this case, the polyhedron P determined by Ax b is integral, i.e., each nonempty face of P has an integral vector;

A vector in R n is integral if each of its components is an integer, and a rational system of linear inequalities Ax b is called totally dual integral (TDI) if, for every integral vector c Z n, the LP problem dual to sup { c, x : Ax b} has an integral optimal solution whenever it has an optimal solution at all. In this case, the polyhedron P determined by Ax b is integral, i.e., each nonempty face of P has an integral vector; thus, (under the assumption that both primal and dual are feasible)

A vector in R n is integral if each of its components is an integer, and a rational system of linear inequalities Ax b is called totally dual integral (TDI) if, for every integral vector c Z n, the LP problem dual to sup { c, x : Ax b} has an integral optimal solution whenever it has an optimal solution at all. In this case, the polyhedron P determined by Ax b is integral, i.e., each nonempty face of P has an integral vector; thus, (under the assumption that both primal and dual are feasible) equality holds throughout in the chain from the board.

A vector in R n is integral if each of its components is an integer, and a rational system of linear inequalities Ax b is called totally dual integral (TDI) if, for every integral vector c Z n, the LP problem dual to sup { c, x : Ax b} has an integral optimal solution whenever it has an optimal solution at all. In this case, the polyhedron P determined by Ax b is integral, i.e., each nonempty face of P has an integral vector; thus, (under the assumption that both primal and dual are feasible) equality holds throughout in the chain from the board. This was proved in seminal work of Edmonds and Giles [1977] as a consequence of the following fundamental result:

A vector in R n is integral if each of its components is an integer, and a rational system of linear inequalities Ax b is called totally dual integral (TDI) if, for every integral vector c Z n, the LP problem dual to sup { c, x : Ax b} has an integral optimal solution whenever it has an optimal solution at all. In this case, the polyhedron P determined by Ax b is integral, i.e., each nonempty face of P has an integral vector; thus, (under the assumption that both primal and dual are feasible) equality holds throughout in the chain from the board. This was proved in seminal work of Edmonds and Giles [1977] as a consequence of the following fundamental result: Theorem (Edmonds-Giles [1977]) If A Q m n and b Q m satisfy sup { c, x : Ax b} Z {± } for each c Z n, then the polyhedron {x R n : Ax b} is integral.

(Edmonds and Giles [1977]) If A Q m n and b Q m satisfy sup { c, x : Ax b} Z {± } for each c Z n, then the polyhedron {x R n : Ax b} is integral.

(Edmonds and Giles [1977]) If A Q m n and b Q m satisfy sup { c, x : Ax b} Z {± } for each c Z n, then the polyhedron {x R n : Ax b} is integral. Corollary (Hoffman [1974]) Let A Q m n and b Q m. If P := {x R n : Ax b} is bounded and max x P c, x Z for each c Z n, then P is integral.

To define the integrality constraint for the dual SDP, we shall consider the dual slack.

To define the integrality constraint for the dual SDP, we shall consider the dual slack. Definition Let S be feasible in the dual SDP. We say that S is integral if S is a sum N S = k=1 S k of rank-one matrices S 1,..., S N S n+1 + k [N], we have such that, for each (S k ) 00 = 1, (S k ) 0j + (S k ) jj = 0 j [n].

If C R n is a compact convex set, then C = {x R n : w, x δ (C w) w Z n }.

If C R n is a compact convex set, then C = {x R n : w, x δ (C w) w Z n }. Let C I := conv (C Z n ).

If C R n is a compact convex set, then C = {x R n : w, x δ (C w) w Z n }. Let C I := conv (C Z n ). Using a bit more from IP theory, we conclude the following generalization of Hoffman s Theorem.

If C R n is a compact convex set, then C = {x R n : w, x δ (C w) w Z n }. Let C I := conv (C Z n ). Using a bit more from IP theory, we conclude the following generalization of Hoffman s Theorem. Corollary If C R n is a nonempty compact convex set, then C = C I if and only if δ (C w) Z for every w Z n.

Let C R n be a nonempty compact convex set. Then, TFAE

Let C R n be a nonempty compact convex set. Then, TFAE (i) C = C I ;

Let C R n be a nonempty compact convex set. Then, TFAE (i) C = C I ; (ii) every nonempty face of C contains an integral point;

Let C R n be a nonempty compact convex set. Then, TFAE (i) C = C I ; (ii) every nonempty face of C contains an integral point; (iii) for every w R n, max{ w, x : x C} is attained by an integral vector;

Let C R n be a nonempty compact convex set. Then, TFAE (i) C = C I ; (ii) every nonempty face of C contains an integral point; (iii) for every w R n, max{ w, x : x C} is attained by an integral vector; (iv) every rational supporting hyperplane for C contains integral points;

Let C R n be a nonempty compact convex set. Then, TFAE (i) C = C I ; (ii) every nonempty face of C contains an integral point; (iii) for every w R n, max{ w, x : x C} is attained by an integral vector; (iv) every rational supporting hyperplane for C contains integral points; (v) x C such that for each w Z n, { } 1 w, x + inf η R ++ : w (C x)o η Z.

Definition Let L : R k S n+1 be a linear map. The system A( ˆX ) b, ˆX 0 is TDI through L

Definition Let L : R k S n+1 be a linear map. The system A( ˆX ) b, ˆX 0 is TDI through L if for every c Z k, the SDP dual to { } sup L(c), ˆX : A( ˆX ) b ˆX 0 has an integral optimal solution, whenever it has an optimal solution.

Definition Let L : R k S n+1 be a linear map. The system A( ˆX ) b, ˆX 0 is TDI through L if for every c Z k, the SDP dual to { } sup L(c), ˆX : A( ˆX ) b ˆX 0 has an integral optimal solution, whenever it has an optimal solution. Note, ˆX is of the form [ ] 1 x x X

Let A( ˆX ) b, ˆX 0 be TDI through a linear map L: R k S n+1.

Let A( ˆX ) b, ˆX 0 be { TDI through a linear map} L: R k S n+1. Set Ĉ := ˆX S n+1 + : A( ˆX ) b and C := L (Ĉ) R k.

Let A( ˆX ) b, ˆX 0 be { TDI through a linear map} L: R k S n+1. Set Ĉ := ˆX S n+1 + : A( ˆX ) b and C := L (Ĉ) R k. If b is integral, C is compact, and Ĉ has a positive definite matrix,

Let A( ˆX ) b, ˆX 0 be { TDI through a linear map} L: R k S n+1. Set Ĉ := ˆX S n+1 + : A( ˆX ) b and C := L (Ĉ) R k. If b is integral, C is compact, and Ĉ has a positive definite matrix, then C = C I.

Let A( ˆX ) b, ˆX 0 be TDI through a linear map L: R k S n+1 such that b is integral.

Let A( ˆX ) b, ˆX 0 be TDI through a linear map L: R k S n+1 such that { b is integral. Suppose } that Ĉ := ˆX S n+1 + : A( ˆX ) b has a positive definite matrix

Let A( ˆX ) b, ˆX 0 be TDI through a linear map L: R k S n+1 such that { b is integral. Suppose } that Ĉ := ˆX S n+1 + : A( ˆX ) b has a positive definite matrix and that C := L (Ĉ) [0, 1] k is compact.

Let A( ˆX ) b, ˆX 0 be TDI through a linear map L: R k S n+1 such that { b is integral. Suppose } that Ĉ := ˆX S n+1 + : A( ˆX ) b has a positive definite matrix and that C := L (Ĉ) [0, 1] k is compact. If Ĉ is a rank-one embedding of C I via L,

Let A( ˆX ) b, ˆX 0 be TDI through a linear map L: R k S n+1 such that { b is integral. Suppose } that Ĉ := ˆX S n+1 + : A( ˆX ) b has a positive definite matrix and that C := L (Ĉ) [0, 1] k is compact. If Ĉ is a rank-one embedding of C I via L, then for every w Z k, equality holds throughout in the chain of inequalities on the board,

Let A( ˆX ) b, ˆX 0 be TDI through a linear map L: R k S n+1 such that { b is integral. Suppose } that Ĉ := ˆX S n+1 + : A( ˆX ) b has a positive definite matrix and that C := L (Ĉ) [0, 1] k is compact. If Ĉ is a rank-one embedding of C I via L, then for every w Z k, equality holds throughout in the chain of inequalities on the board, all optimum values are equal to max { w, x : x C I },

Let A( ˆX ) b, ˆX 0 be TDI through a linear map L: R k S n+1 such that { b is integral. Suppose } that Ĉ := ˆX S n+1 + : A( ˆX ) b has a positive definite matrix and that C := L (Ĉ) [0, 1] k is compact. If Ĉ is a rank-one embedding of C I via L, then for every w Z k, equality holds throughout in the chain of inequalities on the board, all optimum values are equal to max { w, x : x C I }, and all suprema and infima are attained.

Open Problems/research Directions Obtain a primal-dual symmetric integrality condition for SDPs that applies to arbitrary ILPs, not just binary ones.

Open Problems/research Directions Obtain a primal-dual symmetric integrality condition for SDPs that applies to arbitrary ILPs, not just binary ones. Given k 1 and the LS + operator of Lovász and Schrijver [1991](called N + in their paper), determine the class of graphs for which the kth iterate of the LS + operator applied to the system x 0, x i + x j 1 ij E yields a TDI system through the appropriate lifting, leading to a family of combinatorial min-max theorems involving maximum weight stable sets in such graphs.

Open Problems/research Directions Obtain a primal-dual symmetric integrality condition for SDPs that applies to arbitrary ILPs, not just binary ones. Given k 1 and the LS + operator of Lovász and Schrijver [1991](called N + in their paper), determine the class of graphs for which the kth iterate of the LS + operator applied to the system x 0, x i + x j 1 ij E yields a TDI system through the appropriate lifting, leading to a family of combinatorial min-max theorems involving maximum weight stable sets in such graphs. Obtain systematic, primal-dual symmetric conditions for exactness in SDP relaxations for continuous problems.

Every pointed closed convex set is the intersection of all closed rational halfspaces containing it.

Every pointed closed convex set is the intersection of all closed rational halfspaces containing it. This presentation was based on: M. K. de Carli Silva and L. T., A notion of total dual integrality for convex, semidefinite, and extended formulations, arxiv:1801.09155 M. K. de Carli Silva and L. T., Pointed closed convex sets are the intersection of all rational supporting closed halfspaces, arxiv:1802.03296