Lift-and-Project Techniques and SDP Hierarchies
|
|
- Juliana Stokes
- 5 years ago
- Views:
Transcription
1 MFO seminar on Semidefinite Programming May 30, 2010
2 Typical combinatorial optimization problem: max c T x s.t. Ax b, x {0, 1} n P := {x R n Ax b} P I := conv(k {0, 1} n ) LP relaxation Integral polytope to be found Goal: Construct a new relaxation P such that P I P P, leading to P I after finitely many iterations. Gomory-Chvatal closure: P = {x u T Ax u T b u 0 with u T A integer}. P I is found after O(n 2 log n) iterations if P [0, 1] n. [Eisenbrand-Schulz 1999] But optimization over P is hard! [Eisenbrand 1999]
3 Plan of the lecture Goal: We present several techniques to construct a hierarchy of LP/SDP relaxations: P P 1... P n = P I. Lovász-Schrijver N / N + operators Sherali-Adams construction Lasserre construction LP / SDP LP SDP Great interest recently in such hierarchies: Polyhedral combinatorics: How many rounds are needed to find P I? Which valid inequalities are satisfied after t rounds? Complexity theory: What is the integrality gap after t rounds? Link to hardness of the problem? Proof systems: Use hierarchies as a model to generate inequalities and show e.g. P I =.
4 Lift-and-project strategy 1. Generate new constraints: Multiply the system Ax b by products of the constraints x i 0 and 1 x i 0. Polynomial system in x. 2. Linearize (and lift) by introducing new variables y I for products i I x i and setting x 2 i = x i. Linear system in (x, y). 3. Project back on the x-variable space. LP relaxation P satisfying P I P P.
5 Some notation Write Ax b as al T x b l (l = 1,..., m) ( ) 1 or as gl T 0 (l = 1,..., m) x ( ) bl setting g l =. a l Homogenization of P: { ( ) } 1 } P = λ λ 0, x P = {y R n+1 g T x l y 0 (l = 1,..., m) V = {1,..., n}.
6 The Lovász-Schrijver construction 1. Multiply Ax b by x i, 1 x i i V. ( ) ( 1 1 Quadratic system: gl T x x i, g l x 2. Linearize: Introduce the matrix variable Y = indexed by {0} V. Then, Y belongs to ) (1 x i ) 0 i ( )( ) T 1 1, x x M(P) = {Y S n+1 Y 0i = Y ii, Ye i, Y (e 0 e i ) P i}, 3. Project: N(P) = N + (P) = M + (P) = M(P) S + n+1. { x R V Y M(P) s.t. { x R V Y M + (P) s.t. ( ) } 1 = Ye x 0 ( ) } 1 = Ye x 0
7 Properties of the N- and N + -operators P I N + (P) N(P) P. N(P) conv(p {x x i = 0, 1}) for all i V. N n (P) = P I. Assume one can optimize in polynomial time over P. Then the same holds for N t (P) and for N+(P) t for any fixed t. Example: Consider the l 1 -ball centered at e/2: { P = x R V i I x i + } i V \I 1 x i 1 2 I V. Then: P I =, but 1 2 e Nn 1 + (P). n iterations of the N + operator are needed to find P I
8 Application to stable sets [Lovász-Schrijver 1991] P = FRAC(G) = {x R V + x i + x j 1 (ij E)} P I = STAB(G): stable set polytope of G = (V, E). N(FRAC(G)) = FRAC(G) intersected by the constraints: i V (C) x i C 1 2 for all odd circuits C. Y M(FRAC(G)) = y ij = 0 for edges ij E. N + (FRAC(G)) TH(G). Any clique inequality i Q x i 1 is valid for N + (P), while its N-rank is Q 2. The N + operator helps! n α(g) 2 N-rank n α(g) 1. N + -rank α(g) [equality if G = line graph of K 2p+1 ]
9 The Sherali-Adams construction 1. Multiply Ax b by x i (1 x j ) for all disjoint I, J V with I J = t. i I j J 2. Linearize & lift: Introduce new variables y U for all U P t (V ), setting x 2 i = x i and y i = x i. 3. Project back on x-variables space. Relaxation: SA t (P). Then: SA 1 (K) = N(P), Thus: SA t (P) N t (P). SA t (P) N(SA t 1 (P)).
10 Application to the matching polytope For G = (V, E), let P = {x R E + x(δ(v)) 1 v V }. Then: P I is the matching polytope ( = stable set polytope of the line graph of G). For G = K 2p+1 : N + -rank = p [Stephen-Tunçel 1999] N-rank [2p, p 2 ] [LS 1991] [Goemans-Tunçel 2001] SA-rank = 2p 1 [Mathieu-Sinclair 2009] Detailed analysis of the integrality gap: g t = max x SA t(p) e t x max x P e T x g t = = max x SA t(p) e t x. p p if t p 1 1 if t 2p 1 phase transition at 2p Θ( p)
11 A canonical lifting lemma x {0, 1} n y x = ( x i ) I V {0, 1} P(V ) i I = (1, x 1,.., x n, x 1 x 2,.., x n 1 x n,.., x i ) i V Z: matrix with columns y x for x {0, 1} n. Equivalently: Z is the 0/1 matrix indexed by P(V ) with Z(I, J) = 1 if I V, 0 else. Z 1 (I, J) = ( 1) J\I if I J, 0 else. If x P {0, 1} n, then Y = y x (y x ) T satisfies: Y 0 Y l = g l (x)y 0 localizing matrix Y (I, J) depends only on I J moment matrix y R P(V ) Y = M V (y) = (y I J ), Y l = M V (g l y)
12 Lemma: P I is equal to the projection on the x-variable space of {y R P(V ) y 0 = 1, M V (y) 0, M V (g l y) 0 l}. Sketch of proof: 1. Verify that M V (y) = Z diag(z 1 y)z T. 2. M V (y) 0 = λ := Z 1 y 0 = y = Zλ = λ x y x x {0,1} n where x λ x = y 0 = Use M V (g l y) 0 to show that λ x > 0 = x P (= x P I ). Each 0/1 polytope is projection of a simplex.
13 Case n = 2 Z = Z 1 = y 0 y 1 y 2 y 12 M V (y) = y 1 y 1 y 12 y 12 y 2 y 12 y 2 y 12 0 y 12 y 12 y 12 y 12 y 0 y 1 y 2 + y 12 0 y 1 y 12 0 y 2 y 12 0 y 12 0
14 SDP hierarchies Idea: Get SDP hierarchies by truncating M V (y) and M V (g l y): Consider M U (y) = (y I J ) I,J U, indexed by P(U) for U V, or M t (y) = (y I J ) I, J t, indexed by P t (V ) for some t n. 1. (local) Get the Sherali-Adams relaxation SA t (P) when considering M U (y) 0, M W (g l y) 0 U P t (V ), W P t 1 (V ). LP with variables y I for all I P t (V ) 2. (global) Get the Lasserre relaxation L t (P) when considering M t (y) 0, M t 1 (g l y) 0. Obviously: L t (P) SA t (P). SDP with variables y I for all I P 2t (V )
15 Link to the Lovász-Schrijver construction L 1 (P) P, L t (P) N + (L t 1 (P)). Thus: L t (P) N t 1 + (P). L t (P) is tighter but more expensive to compute! The SDP for L t (P) involves one matrix of order O(n t ), O(n 2t ) variables. The SDP for N t 1 + (P) involves O(nt 1 ) matrices of order n + 1, O(n t+1 ) variables. Note: One can define a (block-diagonal) hierarchy, in-between and cheaper than both L t (P) and N+ t 1 (P); roughly, unfold the recursive definition of the LS hierarchy, and consider suitably defined principal submatrices of M t (y) (which can be block-diagonalized to blocks of order n + 1). [Gvozdenovic-L-Vallentin 2009]
16 Application of the Lasserre construction to stable sets The localizing conditions in L t (FRAC(G)) boil down to the edge conditions: y ij = 0 (ij E) (for t 2). Natural generalization of the theta body TH(G). Get the bound las (t) (G). Convergence in α(g) steps: L t (FRAC(G)) = STAB(G) for t α(g). Open: Exist graphs G for which α(g) steps are needed? Question: What is the Lasserre rank of the matching polytope?
17 Application of the Lasserre construction to Max-Cut Max-Cut: max ij E w ij 1 x i x j 2 s.t. x {±1} V. Consider P = [ 1, 1] V, write xi 2 = 1, and project onto the subspace R (n 2) indexed by edges. The order 1 relaxation is the basic GW relaxation: max ij E w ij 1 X ij 2 s.t. X S + n, diag(x ) = e. The Lasserre rank of CUT(K n ) is at least n/2. [La 2003] (First time when ij E(K n) x ij n/2 becomes valid). Question: Does equality hold? (Yes for n 7).
18 The Lasserre relaxation of order 2 relaxation satisfies the triangle inequalities: Y = y 12 y 13 y y 12 1 y 23 y y 13 y 23 1 y y 23 y 13 y 12 1 = e T Ye 0 = y 12 + y 13 + y 23 1.
19 Some negative results about integrality gaps of hierarchies for max-cut Consider the basic LP relaxation of max-cut defined by the triangle inequalities. Its integrality gap is 1/2. [Schoenebeck-Trevisan-Tulsiani 2006] For the Lovász-Schrijver construction: The integrality gap remains 1/2 + ɛ after c ɛ n rounds of the N operator. But the integrality gap is after one round of the N + operator. [Charikar-Makarychev-Makarychev 2009] For the Sherali-Adams construction: The integrality gap remains 1/2 + ɛ after n γɛ iterations.
20 Some positive results Chlamtac-Singh [2008] give (for the first time) an approximation algorithm whose approximation guarantee improves indefinitely as one uses higher order relaxations in the SDP hierarchy: For the maximum independent set problem in a 3-uniform hypergraph G. Namely: Given γ > 0, assuming G contains an independent set of cardinality γn, then one can find an independent set of cardinality n Ω(γ2) using the relaxation of order Θ(1/γ 2 ).
21 Extensions to optimization over polynomials Minimize p(x) over {x g j (x) 0}. Linearize p = α p αx α by α p αy α. Impose SDP conditions on the moment matrix: M t (y) = (y α+β ) 0. hierarchy of SDP relaxations with asymptotic convergence (due to some SOS representation results). Exploit equations: h j (x) = 0. We saw how to exploit x 2 i = x i. The canonical lifting lemma extends to the finite variety case: when the equations h j = 0 have finitely many roots. Finite convergence of the hierarchy when the equations h j = 0 have finitely many real roots.
22 Another hierarchy construction via copositive programming Reformulation: α(g) = min λ s.t. λ(i + A G ) J C n, where C n = {M S n x T Mx 0 x R n +} is the copositive cone. Idea [Parrilo 2000]: Replace C n by the subcones L (t) n ( n ) r = {M S n (x T Mx) x i i=1 has non-negative coefficients}, ( n K n (t) = {M S n i,j=1 L (t) n M ij x 2 i x 2 j )( n K (t) n C n. i=1 [Pólya] If M is strictly copositive then M t 0 L(t) n. x 2 i ) t is SOS},
23 LP bound: ν (t) (G) = min λ s.t. λ(i + A G ) J L (t) n, SDP bound: ϑ (t) (G) = min λ s.t. λ(i + A G ) J K (t) n. ν (t) (G) < t α(g) 1. ν (t) (G) = α(g) if t α(g) 2. ϑ (0) (G) = ϑ (G) Conjecture: [de Klerk-Pasechnik 2002] ϑ (t) (G) = α(g) for t α(g) 1. Yes: For graphs with α(g) 8 [Gvozdenovic-La 2007] The Lasserre hierarchy refines the copositive hierarchy: las (t+1) (G) ϑ (t) (G). Note: The convergence in α(g) steps was easy for the Lasserre hierarchy!
MINI-TUTORIAL ON SEMI-ALGEBRAIC PROOF SYSTEMS. Albert Atserias Universitat Politècnica de Catalunya Barcelona
MINI-TUTORIAL ON SEMI-ALGEBRAIC PROOF SYSTEMS Albert Atserias Universitat Politècnica de Catalunya Barcelona Part I CONVEX POLYTOPES Convex polytopes as linear inequalities Polytope: P = {x R n : Ax b}
More informationNotes on the decomposition result of Karlin et al. [2] for the hierarchy of Lasserre by M. Laurent, December 13, 2012
Notes on the decomposition result of Karlin et al. [2] for the hierarchy of Lasserre by M. Laurent, December 13, 2012 We present the decomposition result of Karlin et al. [2] for the hierarchy of Lasserre
More informationIntroduction to LP and SDP Hierarchies
Introduction to LP and SDP Hierarchies Madhur Tulsiani Princeton University Local Constraints in Approximation Algorithms Linear Programming (LP) or Semidefinite Programming (SDP) based approximation algorithms
More informationLecture : Lovász Theta Body. Introduction to hierarchies.
Strong Relaations for Discrete Optimization Problems 20-27/05/6 Lecture : Lovász Theta Body. Introduction to hierarchies. Lecturer: Yuri Faenza Scribes: Yuri Faenza Recall: stable sets and perfect graphs
More informationThe maximal stable set problem : Copositive programming and Semidefinite Relaxations
The maximal stable set problem : Copositive programming and Semidefinite Relaxations Kartik Krishnan Department of Mathematical Sciences Rensselaer Polytechnic Institute Troy, NY 12180 USA kartis@rpi.edu
More informationIntroduction to Semidefinite Programming I: Basic properties a
Introduction to Semidefinite Programming I: Basic properties and variations on the Goemans-Williamson approximation algorithm for max-cut MFO seminar on Semidefinite Programming May 30, 2010 Semidefinite
More informationCSC Linear Programming and Combinatorial Optimization Lecture 12: The Lift and Project Method
CSC2411 - Linear Programming and Combinatorial Optimization Lecture 12: The Lift and Project Method Notes taken by Stefan Mathe April 28, 2007 Summary: Throughout the course, we have seen the importance
More informationOn the matrix-cut rank of polyhedra
On the matrix-cut rank of polyhedra William Cook and Sanjeeb Dash Computational and Applied Mathematics Rice University August 5, 00 Abstract Lovász and Schrijver (99) described a semi-definite operator
More informationSherali-Adams relaxations of the matching polytope
Sherali-Adams relaxations of the matching polytope Claire Mathieu Alistair Sinclair November 17, 2008 Abstract We study the Sherali-Adams lift-and-project hierarchy of linear programming relaxations of
More informationlinear programming and approximate constraint satisfaction
linear programming and approximate constraint satisfaction Siu On Chan MSR New England James R. Lee University of Washington Prasad Raghavendra UC Berkeley David Steurer Cornell results MAIN THEOREM: Any
More informationCuts for mixed 0-1 conic programs
Cuts for mixed 0-1 conic programs G. Iyengar 1 M. T. Cezik 2 1 IEOR Department Columbia University, New York. 2 GERAD Université de Montréal, Montréal TU-Chemnitz Workshop on Integer Programming and Continuous
More informationSemidefinite programming techniques in combinatorial optimization
Semidefinite programming techniques in combinatorial optimization Dept. of Combinatorics and Optimization, Faculty of Mathematics, University of Waterloo July 22 26, 2016 We will start with the discussion
More informationHierarchies. 1. Lovasz-Schrijver (LS), LS+ 2. Sherali Adams 3. Lasserre 4. Mixed Hierarchy (recently used) Idea: P = conv(subset S of 0,1 n )
Hierarchies Today 1. Some more familiarity with Hierarchies 2. Examples of some basic upper and lower bounds 3. Survey of recent results (possible material for future talks) Hierarchies 1. Lovasz-Schrijver
More informationSemidefinite and Second Order Cone Programming Seminar Fall 2001 Lecture 5
Semidefinite and Second Order Cone Programming Seminar Fall 2001 Lecture 5 Instructor: Farid Alizadeh Scribe: Anton Riabov 10/08/2001 1 Overview We continue studying the maximum eigenvalue SDP, and generalize
More informationCopositive Programming and Combinatorial Optimization
Copositive Programming and Combinatorial Optimization Franz Rendl http://www.math.uni-klu.ac.at Alpen-Adria-Universität Klagenfurt Austria joint work with M. Bomze (Wien) and F. Jarre (Düsseldorf) and
More informationOn the Rank of Cutting-Plane Proof Systems
On the Rank of Cutting-Plane Proof Systems Sebastian Pokutta 1 and Andreas S. Schulz 2 1 H. Milton Stewart School of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta, GA. Email:
More informationLift-and-Project Inequalities
Lift-and-Project Inequalities Q. Louveaux Abstract The lift-and-project technique is a systematic way to generate valid inequalities for a mixed binary program. The technique is interesting both on the
More informationCORC REPORT Approximate fixed-rank closures of covering problems
CORC REPORT 2003-01 Approximate fixed-rank closures of covering problems Daniel Bienstock and Mark Zuckerberg (Columbia University) January, 2003 version 2004-August-25 Abstract Consider a 0/1 integer
More informationLower bounds on the size of semidefinite relaxations. David Steurer Cornell
Lower bounds on the size of semidefinite relaxations David Steurer Cornell James R. Lee Washington Prasad Raghavendra Berkeley Institute for Advanced Study, November 2015 overview of results unconditional
More informationHilbert s 17th Problem to Semidefinite Programming & Convex Algebraic Geometry
Hilbert s 17th Problem to Semidefinite Programming & Convex Algebraic Geometry Rekha R. Thomas University of Washington, Seattle References Monique Laurent, Sums of squares, moment matrices and optimization
More informationCopositive Programming and Combinatorial Optimization
Copositive Programming and Combinatorial Optimization Franz Rendl http://www.math.uni-klu.ac.at Alpen-Adria-Universität Klagenfurt Austria joint work with I.M. Bomze (Wien) and F. Jarre (Düsseldorf) IMA
More informationModeling with semidefinite and copositive matrices
Modeling with semidefinite and copositive matrices Franz Rendl http://www.math.uni-klu.ac.at Alpen-Adria-Universität Klagenfurt Austria F. Rendl, Singapore workshop 2006 p.1/24 Overview Node and Edge relaxations
More information6-1 The Positivstellensatz P. Parrilo and S. Lall, ECC
6-1 The Positivstellensatz P. Parrilo and S. Lall, ECC 2003 2003.09.02.10 6. The Positivstellensatz Basic semialgebraic sets Semialgebraic sets Tarski-Seidenberg and quantifier elimination Feasibility
More informationLOVÁSZ-SCHRIJVER SDP-OPERATOR AND A SUPERCLASS OF NEAR-PERFECT GRAPHS
LOVÁSZ-SCHRIJVER SDP-OPERATOR AND A SUPERCLASS OF NEAR-PERFECT GRAPHS S. BIANCHI, M. ESCALANTE, G. NASINI, L. TUNÇEL Abstract. We study the Lovász-Schrijver SDP-operator applied to the fractional stable
More informationSherali-Adams Relaxations of the Matching Polytope
Sherali-Adams Relaxations of the Matching Polytope Claire Mathieu Computer Science Department Brown University Providence, RI 091 claire@cs.brown.edu Alistair Sinclair Computer Science Division University
More informationA NEW SEMIDEFINITE PROGRAMMING HIERARCHY FOR CYCLES IN BINARY MATROIDS AND CUTS IN GRAPHS
A NEW SEMIDEFINITE PROGRAMMING HIERARCHY FOR CYCLES IN BINARY MATROIDS AND CUTS IN GRAPHS JOÃO GOUVEIA, MONIQUE LAURENT, PABLO A. PARRILO, AND REKHA THOMAS Abstract. The theta bodies of a polynomial ideal
More informationCutting Planes for First Level RLT Relaxations of Mixed 0-1 Programs
Cutting Planes for First Level RLT Relaxations of Mixed 0-1 Programs 1 Cambridge, July 2013 1 Joint work with Franklin Djeumou Fomeni and Adam N. Letchford Outline 1. Introduction 2. Literature Review
More informationc 2000 Society for Industrial and Applied Mathematics
SIAM J. OPIM. Vol. 10, No. 3, pp. 750 778 c 2000 Society for Industrial and Applied Mathematics CONES OF MARICES AND SUCCESSIVE CONVEX RELAXAIONS OF NONCONVEX SES MASAKAZU KOJIMA AND LEVEN UNÇEL Abstract.
More informationWHEN DOES THE POSITIVE SEMIDEFINITENESS CONSTRAINT HELP IN LIFTING PROCEDURES?
MATHEMATICS OF OPERATIONS RESEARCH Vol. 6, No. 4, November 00, pp. 796 85 Printed in U.S.A. WHEN DOES THE POSITIVE SEMIDEFINITENESS CONSTRAINT HELP IN LIFTING PROCEDURES? MICHEL X. GOEMANS and LEVENT TUNÇEL
More informationIntegrality Gaps of Linear and Semi-definite Programming Relaxations for Knapsack
Integrality Gaps of Linear and Semi-definite Programming Relaxations for Knapsack Anna R. Karlin Claire Mathieu C. Thach Nguyen Abstract Recent years have seen an explosion of interest in lift and project
More informationSherali-Adams Relaxations of Graph Isomorphism Polytopes. Peter N. Malkin* and Mohammed Omar + UC Davis
Sherali-Adams Relaxations of Graph Isomorphism Polytopes Peter N. Malkin* and Mohammed Omar + UC Davis University of Washington May 18th 2010 *Partly funded by an IBM OCR grant and the NSF. + Partly funded
More information1 Strict local optimality in unconstrained optimization
ORF 53 Lecture 14 Spring 016, Princeton University Instructor: A.A. Ahmadi Scribe: G. Hall Thursday, April 14, 016 When in doubt on the accuracy of these notes, please cross check with the instructor s
More informationA Linear Round Lower Bound for Lovasz-Schrijver SDP Relaxations of Vertex Cover
A Linear Round Lower Bound for Lovasz-Schrijver SDP Relaxations of Vertex Cover Grant Schoenebeck Luca Trevisan Madhur Tulsiani Abstract We study semidefinite programming relaxations of Vertex Cover arising
More informationIntegrality Gaps for Sherali Adams Relaxations
Integrality Gaps for Sherali Adams Relaxations Moses Charikar Princeton University Konstantin Makarychev IBM T.J. Watson Research Center Yury Makarychev Microsoft Research Abstract We prove strong lower
More informationconstraints Ax+Gy» b (thus any valid inequalityforp is of the form u(ax+gy)» ub for u 2 R m + ). In [13], Gomory introduced a family of valid inequali
On the Rank of Mixed 0,1 Polyhedra Λ Gérard Cornuéjols Yanjun Li Graduate School of Industrial Administration Carnegie Mellon University, Pittsburgh, USA (corresponding author: gc0v@andrew.cmu.edu) February
More informationImproving Integrality Gaps via Chvátal-Gomory Rounding
Improving Integrality Gaps via Chvátal-Gomory Rounding Mohit Singh Kunal Talwar June 23, 2010 Abstract In this work, we study the strength of the Chvátal-Gomory cut generating procedure for several hard
More information1 The independent set problem
ORF 523 Lecture 11 Spring 2016, Princeton University Instructor: A.A. Ahmadi Scribe: G. Hall Tuesday, March 29, 2016 When in doubt on the accuracy of these notes, please cross chec with the instructor
More informationCarnegie Mellon University, Pittsburgh, USA. April Abstract
Elementary Closures for Integer Programs Gerard Cornuejols Yanjun Li Graduate School of Industrial Administration Carnegie Mellon University, Pittsburgh, USA April 2000 (revised October 2000) Abstract
More informationSemidefinite Programming and Integer Programming
Semidefinite Programming and Integer Programming Monique Laurent and Franz Rendl CWI, Kruislaan 413, 1098 SJ Amsterdam, The Netherlands monique@cwi.nl Universität Klagenfurt, Institut für Mathematik Universitätstrasse
More informationOptimal Sherali-Adams Gaps from Pairwise Independence
Optimal Sherali-Adams Gaps from Pairwise Independence Konstantinos Georgiou Avner Magen Madhur Tulsiani {cgeorg,avner}@cs.toronto.edu, madhurt@cs.berkeley.edu Abstract This work considers the problem of
More information47-831: Advanced Integer Programming Lecturer: Amitabh Basu Lecture 2 Date: 03/18/2010
47-831: Advanced Integer Programming Lecturer: Amitabh Basu Lecture Date: 03/18/010 We saw in the previous lecture that a lattice Λ can have many bases. In fact, if Λ is a lattice of a subspace L with
More informationA notion of Total Dual Integrality for Convex, Semidefinite and Extended Formulations
A notion of for Convex, Semidefinite and Extended Formulations Marcel de Carli Silva Levent Tunçel April 26, 2018 A vector in R n is integral if each of its components is an integer, A vector in R n is
More informationApplications of semidefinite programming in Algebraic Combinatorics
Applications of semidefinite programming in Algebraic Combinatorics Tohoku University The 23rd RAMP Symposium October 24, 2011 We often want to 1 Bound the value of a numerical parameter of certain combinatorial
More informationMath Matrix Algebra
Math 44 - Matrix Algebra Review notes - (Alberto Bressan, Spring 7) sec: Orthogonal diagonalization of symmetric matrices When we seek to diagonalize a general n n matrix A, two difficulties may arise:
More informationPart II Strong lift-and-project cutting planes. Vienna, January 2012
Part II Strong lift-and-project cutting planes Vienna, January 2012 The Lovász and Schrijver M(K, K) Operator Let K be a given linear system in 0 1 variables. for any pair of inequalities αx β 0 and α
More information1 Solution of a Large-Scale Traveling-Salesman Problem... 7 George B. Dantzig, Delbert R. Fulkerson, and Selmer M. Johnson
Part I The Early Years 1 Solution of a Large-Scale Traveling-Salesman Problem............ 7 George B. Dantzig, Delbert R. Fulkerson, and Selmer M. Johnson 2 The Hungarian Method for the Assignment Problem..............
More information3.7 Cutting plane methods
3.7 Cutting plane methods Generic ILP problem min{ c t x : x X = {x Z n + : Ax b} } with m n matrix A and n 1 vector b of rationals. According to Meyer s theorem: There exists an ideal formulation: conv(x
More informationLecture 3: Semidefinite Programming
Lecture 3: Semidefinite Programming Lecture Outline Part I: Semidefinite programming, examples, canonical form, and duality Part II: Strong Duality Failure Examples Part III: Conditions for strong duality
More informationON THE CONNECTION OF THE SHERALI-ADAMS CLOSURE AND BORDER BASES
ON THE CONNECTION OF THE SHERALI-ADAMS CLOSURE AND BORDER BASES SEBASTIAN POKUTTA AND ANDREAS S. SCHULZ ABSTRACT. The Sherali-Adams lift-and-project hierarchy is a fundamental construct in integer programming,
More informationApproximating Sparsest Cut in Graphs of Bounded Treewidth
Approximating Sparsest Cut in Graphs of Bounded Treewidth Eden Chlamtac 1, Robert Krauthgamer 1, and Prasad Raghavendra 2 1 Weizmann Institute of Science, Rehovot, Israel. {eden.chlamtac,robert.krauthgamer}@weizmann.ac.il
More informationSDP Relaxations for MAXCUT
SDP Relaxations for MAXCUT from Random Hyperplanes to Sum-of-Squares Certificates CATS @ UMD March 3, 2017 Ahmed Abdelkader MAXCUT SDP SOS March 3, 2017 1 / 27 Overview 1 MAXCUT, Hardness and UGC 2 LP
More informationCutting planes from extended LP formulations
Cutting planes from extended LP formulations Merve Bodur University of Wisconsin-Madison mbodur@wisc.edu Sanjeeb Dash IBM Research sanjeebd@us.ibm.com March 7, 2016 Oktay Günlük IBM Research gunluk@us.ibm.com
More informationOn Linear and Semidefinite Programming Relaxations for Hypergraph Matching
On Linear and Semidefinite Programming Relaxations for Hypergraph Matching Yuk Hei Chan Lap Chi Lau Department of Computer Science and Engineering The Chinese University of Hong Kong Abstract The hypergraph
More informationCutting Plane Methods II
6.859/5.083 Integer Programming and Combinatorial Optimization Fall 2009 Cutting Plane Methods II Gomory-Chvátal cuts Reminder P = {x R n : Ax b} with A Z m n, b Z m. For λ [0, ) m such that λ A Z n, (λ
More informationDeciding Emptiness of the Gomory-Chvátal Closure is NP-Complete, Even for a Rational Polyhedron Containing No Integer Point
Deciding Emptiness of the Gomory-Chvátal Closure is NP-Complete, Even for a Rational Polyhedron Containing No Integer Point Gérard Cornuéjols 1 and Yanjun Li 2 1 Tepper School of Business, Carnegie Mellon
More informationRelations between Semidefinite, Copositive, Semi-infinite and Integer Programming
Relations between Semidefinite, Copositive, Semi-infinite and Integer Programming Author: Faizan Ahmed Supervisor: Dr. Georg Still Master Thesis University of Twente the Netherlands May 2010 Relations
More informationMustapha Ç. Pinar 1. Communicated by Jean Abadie
RAIRO Operations Research RAIRO Oper. Res. 37 (2003) 17-27 DOI: 10.1051/ro:2003012 A DERIVATION OF LOVÁSZ THETA VIA AUGMENTED LAGRANGE DUALITY Mustapha Ç. Pinar 1 Communicated by Jean Abadie Abstract.
More informationTight Integrality Gaps for Lovasz-Schrijver LP Relaxations of Vertex Cover and Max Cut
Tight Integrality Gaps for Lovasz-Schrijver LP Relaxations of Vertex Cover and Max Cut Grant Schoenebeck Luca Trevisan Madhur Tulsiani Abstract We study linear programming relaxations of Vertex Cover and
More informationAdvances in Convex Optimization: Theory, Algorithms, and Applications
Advances in Convex Optimization: Theory, Algorithms, and Applications Stephen Boyd Electrical Engineering Department Stanford University (joint work with Lieven Vandenberghe, UCLA) ISIT 02 ISIT 02 Lausanne
More informationInteger Programming: Cutting Planes
OptIntro 1 / 39 Integer Programming: Cutting Planes Eduardo Camponogara Department of Automation and Systems Engineering Federal University of Santa Catarina October 2016 OptIntro 2 / 39 Summary Introduction
More informationChange in the State of the Art of (Mixed) Integer Programming
Change in the State of the Art of (Mixed) Integer Programming 1977 Vancouver Advanced Research Institute 24 papers 16 reports 1 paper computational, 4 small instances Report on computational aspects: only
More informationSemidefinite programs and combinatorial optimization
Semidefinite programs and combinatorial optimization Lecture notes by L. Lovász Microsoft Research Redmond, WA 98052 lovasz@microsoft.com http://www.research.microsoft.com/ lovasz Contents 1 Introduction
More informationSemidefinite Programming Basics and Applications
Semidefinite Programming Basics and Applications Ray Pörn, principal lecturer Åbo Akademi University Novia University of Applied Sciences Content What is semidefinite programming (SDP)? How to represent
More informationLecture 5. Max-cut, Expansion and Grothendieck s Inequality
CS369H: Hierarchies of Integer Programming Relaxations Spring 2016-2017 Lecture 5. Max-cut, Expansion and Grothendieck s Inequality Professor Moses Charikar Scribes: Kiran Shiragur Overview Here we derive
More informationDownloaded 05/14/13 to Redistribution subject to SIAM license or copyright; see
SIAM J. COMPUT. Vol. 39, No. 8, pp. 3553 3570 c 2010 Society for Industrial and Applied Mathematics INTEGRALITY GAPS OF 2 o(1) FOR VERTEX COVER SDPs IN THE LOVÁSZ SCHRIJVER HIERARCHY KONSTANTINOS GEORGIOU,
More informationCutting Plane Methods I
6.859/15.083 Integer Programming and Combinatorial Optimization Fall 2009 Cutting Planes Consider max{wx : Ax b, x integer}. Cutting Plane Methods I Establishing the optimality of a solution is equivalent
More information6.854J / J Advanced Algorithms Fall 2008
MIT OpenCourseWare http://ocw.mit.edu 6.85J / 8.5J Advanced Algorithms Fall 008 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms. 8.5/6.85 Advanced Algorithms
More informationOptimization over Structured Subsets of Positive Semidefinite Matrices via Column Generation
Optimization over Structured Subsets of Positive Semidefinite Matrices via Column Generation Amir Ali Ahmadi Princeton, ORFE a a a@princeton.edu Sanjeeb Dash IBM Research sanjeebd@us.ibm.com March 8, 2016
More informationPolyhedral Approach to Integer Linear Programming. Tepper School of Business Carnegie Mellon University, Pittsburgh
Polyhedral Approach to Integer Linear Programming Gérard Cornuéjols Tepper School of Business Carnegie Mellon University, Pittsburgh 1 / 30 Brief history First Algorithms Polynomial Algorithms Solving
More informationRelaxations of combinatorial problems via association schemes
1 Relaxations of combinatorial problems via association schemes Etienne de Klerk, Fernando M. de Oliveira Filho, and Dmitrii V. Pasechnik Tilburg University, The Netherlands; Nanyang Technological University,
More informationA General Framework for Convex Relaxation of Polynomial Optimization Problems over Cones
Research Reports on Mathematical and Computing Sciences Series B : Operations Research Department of Mathematical and Computing Sciences Tokyo Institute of Technology 2-12-1 Oh-Okayama, Meguro-ku, Tokyo
More informationOptimization Exercise Set n. 4 :
Optimization Exercise Set n. 4 : Prepared by S. Coniglio and E. Amaldi translated by O. Jabali 2018/2019 1 4.1 Airport location In air transportation, usually there is not a direct connection between every
More informationAnalysis of Copositive Optimization Based Linear Programming Bounds on Standard Quadratic Optimization
Analysis of Copositive Optimization Based Linear Programming Bounds on Standard Quadratic Optimization Gizem Sağol E. Alper Yıldırım April 18, 2014 Abstract The problem of minimizing a quadratic form over
More informationImproved bounds on book crossing numbers of complete bipartite graphs via semidefinite programming
Improved bounds on book crossing numbers of complete bipartite graphs via semidefinite programming Etienne de Klerk, Dima Pasechnik, and Gelasio Salazar NTU, Singapore, and Tilburg University, The Netherlands
More informationOptimization over Polynomials with Sums of Squares and Moment Matrices
Optimization over Polynomials with Sums of Squares and Moment Matrices Monique Laurent Centrum Wiskunde & Informatica (CWI), Amsterdam and University of Tilburg Positivity, Valuations and Quadratic Forms
More informationDimension reduction for semidefinite programming
1 / 22 Dimension reduction for semidefinite programming Pablo A. Parrilo Laboratory for Information and Decision Systems Electrical Engineering and Computer Science Massachusetts Institute of Technology
More informationarxiv: v2 [cs.ds] 11 Jun 2012
Directed Steiner Tree and the Lasserre Hierarchy Thomas Rothvoß arxiv:1111.5473v2 [cs.ds] 11 Jun 2012 M.I.T. rothvoss@math.mit.edu June 13, 2012 Abstract The goal for the DIRECTED STEINER TREE problem
More informationarxiv:math/ v1 [math.co] 23 May 2000
Some Fundamental Properties of Successive Convex Relaxation Methods on LCP and Related Problems arxiv:math/0005229v1 [math.co] 23 May 2000 Masakazu Kojima Department of Mathematical and Computing Sciences
More informationLecture Semidefinite Programming and Graph Partitioning
Approximation Algorithms and Hardness of Approximation April 16, 013 Lecture 14 Lecturer: Alantha Newman Scribes: Marwa El Halabi 1 Semidefinite Programming and Graph Partitioning In previous lectures,
More informationapproximation algorithms I
SUM-OF-SQUARES method and approximation algorithms I David Steurer Cornell Cargese Workshop, 201 meta-task encoded as low-degree polynomial in R x example: f(x) = i,j n w ij x i x j 2 given: functions
More informationMIT Algebraic techniques and semidefinite optimization February 14, Lecture 3
MI 6.97 Algebraic techniques and semidefinite optimization February 4, 6 Lecture 3 Lecturer: Pablo A. Parrilo Scribe: Pablo A. Parrilo In this lecture, we will discuss one of the most important applications
More informationCORC Technical Report TR Cuts for mixed 0-1 conic programming
CORC Technical Report TR-2001-03 Cuts for mixed 0-1 conic programming M. T. Çezik G. Iyengar July 25, 2005 Abstract In this we paper we study techniques for generating valid convex constraints for mixed
More information8 Approximation Algorithms and Max-Cut
8 Approximation Algorithms and Max-Cut 8. The Max-Cut problem Unless the widely believed P N P conjecture is false, there is no polynomial algorithm that can solve all instances of an NP-hard problem.
More informationSemidefinite programming lifts and sparse sums-of-squares
1/15 Semidefinite programming lifts and sparse sums-of-squares Hamza Fawzi (MIT, LIDS) Joint work with James Saunderson (UW) and Pablo Parrilo (MIT) Cornell ORIE, October 2015 Linear optimization 2/15
More informationA Note on Representations of Linear Inequalities in Non-Convex Mixed-Integer Quadratic Programs
A Note on Representations of Linear Inequalities in Non-Convex Mixed-Integer Quadratic Programs Adam N. Letchford Daniel J. Grainger To appear in Operations Research Letters Abstract In the literature
More informationHypergraph Matching by Linear and Semidefinite Programming. Yves Brise, ETH Zürich, Based on 2010 paper by Chan and Lau
Hypergraph Matching by Linear and Semidefinite Programming Yves Brise, ETH Zürich, 20110329 Based on 2010 paper by Chan and Lau Introduction Vertex set V : V = n Set of hyperedges E Hypergraph matching:
More informationSection Notes 9. IP: Cutting Planes. Applied Math 121. Week of April 12, 2010
Section Notes 9 IP: Cutting Planes Applied Math 121 Week of April 12, 2010 Goals for the week understand what a strong formulations is. be familiar with the cutting planes algorithm and the types of cuts
More information3.8 Strong valid inequalities
3.8 Strong valid inequalities By studying the problem structure, we can derive strong valid inequalities which lead to better approximations of the ideal formulation conv(x ) and hence to tighter bounds.
More informationTRISTRAM BOGART AND REKHA R. THOMAS
SMALL CHVÁTAL RANK TRISTRAM BOGART AND REKHA R. THOMAS Abstract. We introduce a new measure of complexity of integer hulls of rational polyhedra called the small Chvátal rank (SCR). The SCR of an integer
More informationLimitations of Linear and Semidefinite Programs by Grant Robert Schoenebeck
Limitations of Linear and Semidefinite Programs by Grant Robert Schoenebeck A dissertation submitted in partial satisfaction of the requirements for the degree of Doctor of Philosophy in Computer Science
More informationarxiv: v15 [math.oc] 19 Oct 2016
LP formulations for mixed-integer polynomial optimization problems Daniel Bienstock and Gonzalo Muñoz, Columbia University, December 2014 arxiv:1501.00288v15 [math.oc] 19 Oct 2016 Abstract We present a
More informationLecture 2. Split Inequalities and Gomory Mixed Integer Cuts. Tepper School of Business Carnegie Mellon University, Pittsburgh
Lecture 2 Split Inequalities and Gomory Mixed Integer Cuts Gérard Cornuéjols Tepper School of Business Carnegie Mellon University, Pittsburgh Mixed Integer Cuts Gomory 1963 Consider a single constraint
More informationGeometric Ramifications of the Lovász Theta Function and Their Interplay with Duality
Geometric Ramifications of the Lovász Theta Function and Their Interplay with Duality by Marcel Kenji de Carli Silva A thesis presented to the University of Waterloo in fulfillment of the thesis requirement
More informationOptimization Exercise Set n.5 :
Optimization Exercise Set n.5 : Prepared by S. Coniglio translated by O. Jabali 2016/2017 1 5.1 Airport location In air transportation, usually there is not a direct connection between every pair of airports.
More informationBreaking the Rectangle Bound Barrier against Formula Size Lower Bounds
Breaking the Rectangle Bound Barrier against Formula Size Lower Bounds Kenya Ueno The Young Researcher Development Center and Graduate School of Informatics, Kyoto University kenya@kuis.kyoto-u.ac.jp Abstract.
More informationConic approach to quantum graph parameters using linear optimization over the completely positive semidefinite cone
Conic approach to quantum graph parameters using linear optimization over the completely positive semidefinite cone Monique Laurent 1,2 and Teresa Piovesan 1 1 Centrum Wiskunde & Informatica (CWI), Amsterdam,
More informationRepresentations of Positive Polynomials: Theory, Practice, and
Representations of Positive Polynomials: Theory, Practice, and Applications Dept. of Mathematics and Computer Science Emory University, Atlanta, GA Currently: National Science Foundation Temple University
More informationConvex sets, conic matrix factorizations and conic rank lower bounds
Convex sets, conic matrix factorizations and conic rank lower bounds Pablo A. Parrilo Laboratory for Information and Decision Systems Electrical Engineering and Computer Science Massachusetts Institute
More informationOn the Chvatál-Complexity of Binary Knapsack Problems. Gergely Kovács 1 Béla Vizvári College for Modern Business Studies, Hungary
On the Chvatál-Complexity of Binary Knapsack Problems Gergely Kovács 1 Béla Vizvári 2 1 College for Modern Business Studies, Hungary 2 Eastern Mediterranean University, TRNC 2009. 1 Chvátal Cut and Complexity
More informationRelaxations and Randomized Methods for Nonconvex QCQPs
Relaxations and Randomized Methods for Nonconvex QCQPs Alexandre d Aspremont, Stephen Boyd EE392o, Stanford University Autumn, 2003 Introduction While some special classes of nonconvex problems can be
More information