Cutting Plane Methods II

Similar documents
1 Perfect Matching and Matching Polytopes

Cutting Plane Methods I

On the Relative Complexity of 15 Problems Related to 0/1-Integer Programming

Discrete Optimization 2010 Lecture 7 Introduction to Integer Programming

Maximum flow problem

Integer Programming: Cutting Planes

Technische Universität München, Zentrum Mathematik Lehrstuhl für Angewandte Geometrie und Diskrete Mathematik. Combinatorial Optimization (MA 4502)

ACO Comprehensive Exam March 20 and 21, Computability, Complexity and Algorithms

3.7 Cutting plane methods

3. Linear Programming and Polyhedral Combinatorics

Lecture #21. c T x Ax b. maximize subject to

NP and Computational Intractability

7. Lecture notes on the ellipsoid algorithm

The traveling salesman problem

- Well-characterized problems, min-max relations, approximate certificates. - LP problems in the standard form, primal and dual linear programs

Deciding Emptiness of the Gomory-Chvátal Closure is NP-Complete, Even for a Rational Polyhedron Containing No Integer Point

Multicommodity Flows and Column Generation

4. Duality Duality 4.1 Duality of LPs and the duality theorem. min c T x x R n, c R n. s.t. ai Tx = b i i M a i R n

Lecture 5 January 16, 2013

3. Linear Programming and Polyhedral Combinatorics

1 Matroid intersection

Mathematical Programs Linear Program (LP)

Advanced Combinatorial Optimization September 22, Lecture 4

Lecture notes on the ellipsoid algorithm

6.854J / J Advanced Algorithms Fall 2008

Integer Linear Programming (ILP)

Polynomial-Time Reductions

CS675: Convex and Combinatorial Optimization Fall 2014 Combinatorial Problems as Linear Programs. Instructor: Shaddin Dughmi

BBM402-Lecture 20: LP Duality

4. How to prove a problem is NPC

The Cutting Plane Method is Polynomial for Perfect Matchings

Integer Programming, Part 1

Duality of LPs and Applications

Lectures 6, 7 and part of 8

Week 8. 1 LP is easy: the Ellipsoid Method

15-850: Advanced Algorithms CMU, Fall 2018 HW #4 (out October 17, 2018) Due: October 28, 2018

Cutting Planes in SCIP

Part V. Matchings. Matching. 19 Augmenting Paths for Matchings. 18 Bipartite Matching via Flows

When the Gomory-Chvátal Closure Coincides with the Integer Hull

Solving the MWT. Recall the ILP for the MWT. We can obtain a solution to the MWT problem by solving the following ILP:

The Matching Polytope: General graphs

Integer Programming ISE 418. Lecture 12. Dr. Ted Ralphs

Optimization Methods in Management Science

Optimization Exercise Set n. 4 :

Cutting Plane Separators in SCIP

Mathematics for Decision Making: An Introduction. Lecture 13

A packing integer program arising in two-layer network design

Improving Christofides Algorithm for the s-t Path TSP

3.7 Strong valid inequalities for structured ILP problems

Integer Hulls of Rational Polyhedra. Rekha R. Thomas

Travelling Salesman Problem

GRAPH ALGORITHMS Week 7 (13 Nov - 18 Nov 2017)

CS675: Convex and Combinatorial Optimization Fall 2016 Combinatorial Problems as Linear and Convex Programs. Instructor: Shaddin Dughmi

EXERCISES SHORTEST PATHS: APPLICATIONS, OPTIMIZATION, VARIATIONS, AND SOLVING THE CONSTRAINED SHORTEST PATH PROBLEM. 1 Applications and Modelling

Integer Programming Methods LNMB

CO759: Algorithmic Game Theory Spring 2015

Polynomiality of Linear Programming

Discrete Optimization

CO 250 Final Exam Guide

3.8 Strong valid inequalities

Cutting planes from extended LP formulations

Optimization Exercise Set n.5 :

1 Integer Decomposition Property

CHAPTER 3 FUNDAMENTALS OF COMPUTATIONAL COMPLEXITY. E. Amaldi Foundations of Operations Research Politecnico di Milano 1

How tight is the corner relaxation? Insights gained from the stable set problem

Theory of Computation Chapter 9

NP Completeness. CS 374: Algorithms & Models of Computation, Spring Lecture 23. November 19, 2015

On the knapsack closure of 0-1 Integer Linear Programs. Matteo Fischetti University of Padova, Italy

LINEAR PROGRAMMING III

MA015: Graph Algorithms

CS599: Convex and Combinatorial Optimization Fall 2013 Lecture 17: Combinatorial Problems as Linear Programs III. Instructor: Shaddin Dughmi

Preliminaries. Graphs. E : set of edges (arcs) (Undirected) Graph : (i, j) = (j, i) (edges) V = {1, 2, 3, 4, 5}, E = {(1, 3), (3, 2), (2, 4)}

Agenda. Soviet Rail Network, We ve done Greedy Method Divide and Conquer Dynamic Programming

In complexity theory, algorithms and problems are classified by the growth order of computation time as a function of instance size.

Alternating paths revisited II: restricted b-matchings in bipartite graphs

Algorithm Design and Analysis

ACO Comprehensive Exam March 17 and 18, Computability, Complexity and Algorithms

Complexity Theory VU , SS The Polynomial Hierarchy. Reinhard Pichler

Outline. Complexity Theory EXACT TSP. The Class DP. Definition. Problem EXACT TSP. Complexity of EXACT TSP. Proposition VU 181.

On the Complexity of Budgeted Maximum Path Coverage on Trees

{ move v ars to left, consts to right { replace = by t wo and constraints Ax b often nicer for theory Ax = b good for implementations. { A invertible

8. INTRACTABILITY I. Lecture slides by Kevin Wayne Copyright 2005 Pearson-Addison Wesley. Last updated on 2/6/18 2:16 AM

On Counting Lattice Points and Chvátal-Gomory Cutting Planes

Optimization WS 13/14:, by Y. Goldstein/K. Reinert, 9. Dezember 2013, 16: Linear programming. Optimization Problems

Combinatorial Optimization

Dual bounds: can t get any better than...

arxiv: v15 [math.oc] 19 Oct 2016

ON THE INTEGRALITY OF THE UNCAPACITATED FACILITY LOCATION POLYTOPE. 1. Introduction

8.5 Sequencing Problems

CS 320, Fall Dr. Geri Georg, Instructor 320 NP 1

Combinatorial Optimization

4 Packing T-joins and T-cuts

Introduction to Integer Programming

Lecture 15: Algebraic Geometry II

A First Course in Combinatorial Optimization. JON LEE IBM T.J. Watson Research Center, Yorktown Heights, New York

Introduction to Semidefinite Programming I: Basic properties a

1 Primals and Duals: Zero Sum Games

Decision Procedures An Algorithmic Point of View

On Matroid Parity and Matching Polytopes

A Review of Linear Programming

Transcription:

6.859/5.083 Integer Programming and Combinatorial Optimization Fall 2009 Cutting Plane Methods II Gomory-Chvátal cuts Reminder P = {x R n : Ax b} with A Z m n, b Z m. For λ [0, ) m such that λ A Z n, (λ A)x λ b is valid for all integral points in P. Stable Sets Definitions Let G = (V, E) be an undirected graph. { } S V is stable if {u, v} E : u, v S =. Stable sets are the integer solutions to: x u + x v x v 0 for all {u, v} E for all v V The stable set polytope is { } P stab (G) = conv x {0, } V : x u + x v for all u, v E Odd Cycle Inequalities An odd cycle C in G consists of an odd number of vertices 0,,..., 2k and edges {i, i + }. The odd cycle inequality is valid for P stab (G). x v C 2 v C It has a cutting-plane proof that only needs one step of rounding. The separation problem for the class of odd cycle inequalities can be solved in polynomial time: Let y Q V.

We may assume that y 0 and y u + y v for all {u, v} E. Define, for each edge e = {u, v} E, z e := y u y v. So z e 0 for all e E. y satisfies all odd cycle constraints iff z satisfies z e for all odd cycles C. e C If we view z e as the length of edge e, then y satisfies all odd cycle inequalities iff the length of a shortest odd cycle is at least. Shortest Odd Cycles A shortest odd cycle can be found in polynomial time: Split each node v V into two nodes v and v 2. For each arc (u, v) create new arcs (u, v 2 ) and (u 2, v ), both of the same length as (u, v). Let D be the digraph constructed this way. For each v V find the shortest (v, v 2 )-path in D. The shortest among these paths gives us the shortest odd cycle. Perfect Matchings Definitions Let G = (V, E) be an undirected graph. A matching M E is perfect if M = V /2. Perfect matchings are the integer solutions to: x e = e δ(v) x e 0 for all v V for all e E The perfect matching polytope is { } P PM (G) = conv x {0, } E : x e = for all v V e δ(v) 2

Odd Cut Inequalities The following inequalities are valid for P PM (G): x e for all U V, U odd e δ(u) Each has a cutting-plane proof that requires rounding only once. The separation problem for this class of inequalities can be solved in polynomial time. {0,/2}-cuts Definition Let { } F /2 (A, b) := (λ A)x λ b : λ {0, /2} m, λ A Z n be the family of all {0,/2}-cuts. NP-Hardness Question: Can one separate efficiently over F /2 (A, b)? Theorem. Let A Z m n, b Z m, and y Q n with Ay b. Checking whether y violates some inequality in F /2 (A, b) is NP-complete. Preliminaries Let P = {x : Ax b} and y P. y violates a {0,/2}-cut iff there exists µ {0, } m such that µ A 0 (mod 2), µ b (mod 2), and µ (b Axˆ) <. (Because µ b = 2k + for some k Z, and µ Ax 2k can be written as µ (b Ax).) An NP-complete Problem Given Q {0, } r t, d {0, } r, and a positive integer K, decide whether there exists z {0, } t with at most K s such that Qz d (mod 2). 3

Reduction Let w := and consider P = {x R n : Ax b} with: K+ ( ) ( ) 0 Q 2 r A := d 2I t+, b := t, y := t w 2 Proof Sketch Step : Show (A, b, y) is a valid instance. 2 y P : Observe that b Ay = (w,..., w t, 0) 0. Proof sketch Step 2: Equivalence of Yes -instances. µ {0, } m with µ A 0 (mod 2), µ b (mod 2) iff z {0, } t such that Qz d (mod 2): ( ) ( ) Q 2 A := t d 2I t+, b := Proof sketch Step 2: Equivalence of Yes -instances. µ s.th. µ (b Ay) < iff z s.th. w z < ( z K): µ (b Ay) = µ (w,..., w t, 0) Primal Separation The Primal Separation Problem Let P be a 0/-polytope. Given a point y Q n and a vertex ˆx P, find c Z n and d Z such that cx d for all x P, cxˆ = d, and cy > d, if they exist. Theorem 2. For 0/-polytopes, optimization and primal separation are polynomial-time equivalent. 4

Perfect Matchings Let ˆx be the incidence vector of a perfect matching M. Let y Q E + be a point satisfying the node-degree equations. We have to find a min-weight odd cut (w.r.t. the edge weights given by y) among those that intersect M in exactly one edge. Let {s, t} M be an arbitrary edge of M. Let G {s,t} be the graph obtained from G by contracting the end nodes of all edges e M \ {{s, t}}. The minimum weight odd cut among those that contain exactly the edge {s, t} of M can be computed by finding a min-weight {s, t}-cut in G {s,t}. Theorem 3. The primal separation problem for the perfect matching polytope of a graph G = (V, E) can be solved with V /2 max-flow computations. Corollary 4. A minimum weight perfect matching can be computed in polynomial time. Proof Sketch The Verification Problem Let P R n be a 0/-polytope. Primal Separation Verification Augmentation Optimization Given an objective function c Z n and a vertex ˆx P, decide whether ˆx minimizes cx over P. 5

Primal Separation Verification Let C be the cone defined by the linear inequalities of P that are tight at ˆx. By LP duality, ˆx minimizes cx over P iff ˆx minimizes cx over C. By the equivalence of optimization and separation, minimizing cx over C is equivalent to solving the separation problem for C. One can solve the separation problem for C by solving the primal separation problem for P and ˆx. The Augmentation Problem Let P R n be a 0/-polytope. Given an objective function c Z n and a vertex x P, find a vertex x P such that cx < cx, if one exists. Verification Augmentation We may assume that x =. Use Verification to check whether x is optimal. If not: n M := i= c i + ; for i = to n do c i := c i M; call the verification oracle with input x and c; if x is optimal then y i := 0; c i := c i + M else y i := return y. Augmentation Optimization We may assume that c 0. Let C := max{c i : i =,..., n}, and K := log C. For k = 0,..., K, define c k by c k := c i /2 K k, i =,..., n. i for k = 0,,..., K do while x k is not optimal for c k do x k := aug(x k, c k ) x k+ := x k return x K+. 6

Running Time O(log C) many phases. At the end of phase k, x k is optimal with respect to c k, and hence for 2c k. Moreover, c k = 2c k + c(k), for some 0/-vector c(k). If x k+ denotes the optimal solution for c k at the end of phase k, we obtain c k (x k x k+ ) = 2c k (x k x k+ ) + c(k)(x k x k+ ) n. Thus, the algorithm determines an optimal solution by solving at most O(n log C) augmentation problems. 7

MIT OpenCourseWare http://ocw.mit.edu 5.083J / 6.859J Integer Programming and Combinatorial Optimization Fall 2009 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms.