Lecture 9: Dantzig-Wolfe Decomposition
|
|
- Griffin Gardner
- 6 years ago
- Views:
Transcription
1 Lecture 9: Dantzig-Wolfe Decomposition (3 units) Outline Dantzig-Wolfe decomposition Column generation algorithm Relation to Lagrangian dual Branch-and-price method Generated assignment problem and multi-commodity flow problem References 1 / 30
2 Dantzig-Wolfe decomposition Consider the following integer programming problem: (P) min (c 1 ) T x 1 +(c 2 ) T x 2 + +(c k ) T x k s.t. A 1 x 1 +A 2 x 2 + +A K x K = b D 1 x 1 d 1 D K x K d K x 1 Z n 1 +,..., x K Z n k + The constraint matrix has a block angular structure. Let X k = {x k Z n k D k x k d k }. 2 / 30
3 The sets are independent for k = 1,..., K, only the joint constraint K k=1 Ak x k = b link together the different sets of variables. Dualizing the joint constraint, we have the following Lagrangian dual of (P): (D) max L(u), u where K L(u) = min{ ((c k ) T u T A k )x k + b T u x k X k, k} = k=1 K L k (u) + b T u. k=1 where L k (u) = min{((c k ) T u T A k )x k x k X k }. 3 / 30
4 We have discussed Lagrangian relaxation and dual search in the previous lectures. Another way of exploiting the block-angular structure is Dantzig-Wolfe decomposition, which was invented by Dantzig and Wolfe in1961. The method is very closely connected to column generation and they are often used interchangeably. The set X k in (P) can be either continuous (polyhedron) or discrete (integer set). Minkowski-Weyl s Theorem: Given the convex set X = {x R n Ax b}. X can be represented by the extreme points and extreme rays of X : X = {x = i λ i x i + j µ i y j i λ i = 1, λ i 0, µ j 0}. 4 / 30
5 Changing representation When X k is a bounded polyhedron, we can express X k as T k X k = {x k = λ kt x kt λ kt = 1, λ kt 0}, T k t=1 t=1 where x kt, t = 1,..., T k, are extreme points of X k. When X k is a finite integer set, we can express X k as T k T k X k = {x k = λ kt x kt λ kt = 1, λ kt {0, 1}}, t=1 t=1 where x kt, t = 1,..., T k, list all the points of X k. 5 / 30
6 IP Master Problem Now, we substitute the expression of x k in (P), leading to the following IP Master Problem: (IPM) K T k min ((c k ) T x kt )λ kt s.t. k=1 t=1 K T k (A k x kt )λ kt = b k=1 t=1 T k λ kt = 1, k = 1,..., K, t=1 λ kt {0, 1}, k, t. How to solve this equivalent problem? Note that the number of variables or columns in the constraint matrix is K k=1 T k, which is usually exponentially large. 6 / 30
7 LP master problem We consider the LP relaxation of (IPM): (LPM) K T k min ((c k ) T x kt )λ kt s.t. k=1 t=1 K T k (A k x kt )λ kt = b k=1 t=1 T k λ kt = 1, k = 1,..., K, t=1 λ kt 0, k, t. How can we find all the points (or extreme points in the continuous case) of X k? We can use the idea of column generation. 7 / 30
8 Dual of the LP master problem The dual problem of (LPM) is (DLPM) m max b i π i + K i=1 k=1 µ k s.t. πa k x kt + µ k (c k ) T x kt, t = 1,..., T k, k = 1,..., K, where (π, µ k ) R m R K. Notice that a column in (LPM) corresponds a row in (DLPM). 8 / 30
9 Column generation algorithm Initialization. Suppose that a subset of columns P = K k=1 P k (at least one for each k) is available. Consider the Restricted LP Master Problem: (RLPM) K min ((c k ) T x kt )λ kt k=1 t P k K s.t. (A k x kt )λ kt = b k=1 t P k λ kt = 1, k = 1,..., K, t P k λ kt 0, t P k, k = 1,..., K. Let λ and (π, µ) R m R K be the optimal primal and dual solutions to (RLPM), respectively. 9 / 30
10 Primal feasibility. Any feasible solution of (LPM) can be expanded to a feasible solution of (RLPM) (setting λ kt = 0 for those columns not in P k. So v(rlpm) = m K πb i + µ k v(lpm). i=1 k=1 Optimality check for (LPM). We need to check whether (π, µ) is dual feasible for (LPM). For any x X k, the corresponding column is (c k ) T x A k x e k. The reduced cost for this column is (c k ) T x π T A k x µ k. Solve the following subproblem: (SP) ζ k = min{((c k ) T πa k )x µ k x X k }. 10 / 30
11 Stopping criterion. If ζ k 0, then the solution (π, µ) is dual feasible to (LPM) and so K k=1 t P k ((c k ) T x kt )λ kt = m K πb i + µ k v(lpm). i=1 k=1 So the expanded solution of λ is optimal to (LPM). Generating a new column. If ζ k < 0 for some k, the column corresponding to the optimal solution x of the subproblem (SP) has negative reduced cost. Introducing the column (c k ) T x A k x e k into (RLPM) will lead to a new (RLPM), which can be easily re-optimized using Primal Simplex Method. 11 / 30
12 Dual (lower) bound. From the subproblem, we have which implies ζ k ((c k ) T πa k )x µ k, x X k, πa k x + (µ k + ζ k ) (c k ) T x, x X k. Therefore, setting ζ = (ζ 1,..., ζ K ), we have that (π, µ + ζ) is dual feasible to (LPM). We thus have π T b + K (µ k + ζ k ) v(lpm). k=1 12 / 30
13 Relation to Lagrangian dual Theorem: K K v(lpm) = min{ (c k ) T x k A k x k = b, x k conv(x k )}. k=1 k=1 Proof: Note that (LPM) is obtained by substituting T k x k = λ kt x kt, t=1 T k λ kt = 1, λ kt 0, t=1 where x kt, t = 1,..., T k, are all the integer points in X k. This is equivalent to x k conv(x k ). Theorem: v(lpm) = v(d). Therefore, the LP relaxation of the IP master problem is actually equivalent to the Lagrangian dual. 13 / 30
14 Consider the general IP problem: min{c T x Ax b, Dx d, x Z n }. Strength of the D-W decomposition and Lagrangian dual: x 1 x 2 x CONV( 2) Figure: X 1 = {x Z n Ax b}, X 2 = {x Z n Dx d}. 14 / 30
15 Branch-and-Price Method Consider the general IP problem: (IP) min c T x s.t. Ax b Dx d, x Z n. ( complicating constraints) ( easy constraints) We assume that optimization over the set X 2 = {x Z n Dx d} is easy. This will be used in solving the column generation subproblem. Let x 1,..., x T be all the integer points of X 2. Then X 2 = {x = T λ i x i i=1 T λ i = 1, λ i {0, 1}}. i=1 15 / 30
16 Use this representation of X 2, we can rewrite (IP) as T (IPM) min c T ( λ i x i ) i=1 T s.t. A( λ i x i ) b, i=1 T λ i = 1, i=1 λ i {0, 1}, i = 1,..., T. This is a reformulation of (IP). 16 / 30
17 The LP relaxation of (IPM) is at least as strong as the direct LP relaxation of (IP). (Because the LP relaxation of (IPM) is equivalent to the Lagrangian relaxation of (IP) by dualizing the complicating constraint Ax b. We solve the LP relaxation of (IPM) using column generation. Adding one column to the LP master problem corresponds to adding one cutting plane to the dual problem of (LPM). The column generation subproblem is an optimization problem over X 2, which can be solved efficiently in many applications. We can embed this bounding scheme into a branch and price framework. Price here is referred to find the column with negative reduced cost by solving the subproblem. How to branch? 17 / 30
18 Branching with Dantzig-Wolfe Decomposition Unfortunately, branching on the variables (λ i ) of the reformulation doesn t work well because it s generally difficult to keep a variable from being generated again after it s been fixed to zero. Branching must be done in a way that does not destroy the structure of the column generation master problem and subproblem. We can do this by branching on the original variables, i.e., before the reformulation. In a 0-1 problem, branching on the jth original variable is equivalent to fixing the value of some element of the columns to be generated. This can usually be incorporated into the column generation subproblem. 18 / 30
19 Generalized Assignment Problem The problem is to assign m tasks to n machines subject to capacity constraints. An IP formulation of tho problem is m n (GAP) max p ij z ij s.t. i=1 j=1 n z ij = 1, i = 1,..., m, j=1 m w ij z ij d j, j = 1,..., n, i=1 z ij {0, 1}, i = 1,..., m, j = 1,..., n. Let s the columns in (GAP) represent feasible assignments of tasks to the machine. m X 2 = {z {0, 1} n m w ij z ij d j, j = 1,..., n}. i=1 19 / 30
20 The Dantzig-Wolfe decomposition master problem is: T n m j max λ j j y j s.t. j=1 i=1 j=1 k=1 p ij k=1 T n j λ j j y j ik = 1, i = 1,..., m, T j i=1 λ j k ik = 1, j = 1,..., n, λ j k {0, 1}, j = 1,..., n, k = 1,..., T j. This is a set-covering problem. The column generation subproblems are n knapsack problem with a single constraint m i=1 w ijz ij d j. 20 / 30
21 Multi-commodity flow problem Let D = (V, A) be a directed graph with nonnegative capacities u a for all a A. Given k commodities, i.e., node pairs (s 1, t 1 ),..., (s k, t k ). For each i = 1,..., k, we want to find an s i t i -flow, (xa), i such that the sum of these flows on each arc does not exceed a given capacity. This flow is called a feasible multicommodity flow and can be expressed by the following constraints: xa i xa i = 0, v V \ {s i, t i }, i = 1,..., k, a δ + (v) a δ (v) k xa i u a, a A, i=1 where δ + (v) = {(v, w) (v, w) A} and δ (v) = {(u, v) (u, v) A}. 21 / 30
22 Edge formulation The multicommodity flow problem (MCF) is to maximize the sum of the flow values of each commodes: k max xa i s.t. i=1 a δ + (v) a δ + (s i ) x i a a δ (v) a δ (s i ) k xa i u a, a A. i=1 x i a x i a = 0, v V \ {s i, t i }, i = 1,..., k, This formulation is called edge formulation of MCF. It is a linear program and can be solved polynomially. However, if we require the flow to be integer, i.e., x i a Z +, then the MCF is NP-hard. 22 / 30
23 Path formulation We now give a path formulation for MCF, which can be viewed as the reformulation of the edge formulation using Dantzig-Wolfe decomposition. Let P st be the set of all s t paths. Let P = P s1,t 1 P sk,t k. Let P a denote the set of paths that use arc a, i.e., P a = {p P a p}. For each p P si,t i, we define a flow variable f p. The multi-commodity flow problem can be expressed as (MCF ) max p P f p s.t. p P a f p u a, a A, f a 0, a A. 23 / 30
24 Column generation for MCF Let P P be a subset of all paths. Consider the restricted LP master problem: (MCF ) max p P f p s.t. p P a f p u a, a A, f a 0, a A. Note that a feasible solution (f p) p P for (MCF ) can be expanded to a feasible solution (f p ) p P to (MCF ) (setting f p = 0 for p P \ P. Thus, v(mcf ) v(mcf ). 24 / 30
25 The dual of (MCF ) is (DMCF ) min a A u a µ a s.t. a p µ a 1, p P, µ a 0, a A. Reduced cost 0 Dual feasible. So, if µ a 1, p P, a p then the current solution is optimal to (MCF ). Otherwise, we need to find a new column to improve (MCF ). 25 / 30
26 Checking whether the above inequality is satisfied for all paths is called pricing subproblem. This can be done efficiently by computing the shortest path w.r.t. the weight vector µ a (a A) for each commodity (s i, t i ) (i = 1,..., k). If the shortest paths are all at least 1, then we mush have µ a 1, p P, a p Otherwise, we find a new path p that has the positive reduced cost and we can add this path (column) to (MCF ). Finding a shortest (s i, t i )-path in graph (V, A) with nonnegative weights µ a 0 (a A) is polynomial (e.g., by Dijkstra s algorithm). 26 / 30
27 Column generation algorithm for MCF Repeat 1. Solve (MCF ) for P 2. Let µ be the optimal multiplier vector of (MCF ) 3. for i = 1,..., k, do Find a shortest path s i t i -path w.r.t. weight vector (µ a) If weight of the shortest path p is less than 1, add p to (MCF ) 4. end for Until no path has been added How to get an integer solution? 27 / 30
28 Dantzig-Wolfe decomposition for MCF We now show that the path formulation can be obtained from Dantzig-Wolfe decomposition. We first write the edge formulation in a simple form: Let max c T x s.t. Nx = 0, Ux u, x 0. (flow conservation) (capacity constraints) P = {x 0 Nx = 0}. This polyhedron is a cone and has a single vertex 0 and a finite number of rays r 1,..., r s. By the Minkowski-Weyl theorem, we have s P = cone{r 1,..., r s } = { λ i r i λ i 0}. i=1 28 / 30
29 Using the above expression of P, we can rewrite the edge formulation as s max λ i (c T r i ) s.t. i=1 s λ i (Nr i ) u, i=1 λ i 0, i = 1,..., s. Analyzing the structure of c and U, the above problem can be reduced to s max i=1 y i s.t. y i u a, a A i:a p i y i 0, i = 1,..., s, which is equivalent to the path formulation (refer to Numhauser and Wolsey (1988) for more details) 29 / 30
30 References 1. F. Vanderbeck, M. W. P. Savelsbergh, A generic view of Dantzig-Wolfe decomposition in mixed-integer programming, Vol. 34(3), , Operations Research Letters, F. Vanderbeck, L. A. Wolsey, Reformulation and decomposition of integer programs, in 50 Years of Integer Programming , Part 2, pp , Cynthia Barnhart, Ellis L. Johnson, George L. Nemhauser, Martin W. P. Savelsbergh and Pamela H. Vance, Branch-and-Price: Column Generation for Solving Huge Integer Programs, Operations Research, Vol. 46(3), , Marc Pfetsch, Multi-commodity flow and column generation, Lecture Notes, ZIB, / 30
Multicommodity Flows and Column Generation
Lecture Notes Multicommodity Flows and Column Generation Marc Pfetsch Zuse Institute Berlin pfetsch@zib.de last change: 2/8/2006 Technische Universität Berlin Fakultät II, Institut für Mathematik WS 2006/07
More informationLecture 8: Column Generation
Lecture 8: Column Generation (3 units) Outline Cutting stock problem Classical IP formulation Set covering formulation Column generation A dual perspective Vehicle routing problem 1 / 33 Cutting stock
More informationLecture 8: Column Generation
Lecture 8: Column Generation (3 units) Outline Cutting stock problem Classical IP formulation Set covering formulation Column generation A dual perspective 1 / 24 Cutting stock problem 2 / 24 Problem description
More informationInteger Programming ISE 418. Lecture 16. Dr. Ted Ralphs
Integer Programming ISE 418 Lecture 16 Dr. Ted Ralphs ISE 418 Lecture 16 1 Reading for This Lecture Wolsey, Chapters 10 and 11 Nemhauser and Wolsey Sections II.3.1, II.3.6, II.3.7, II.5.4 CCZ Chapter 8
More informationNotes on Dantzig-Wolfe decomposition and column generation
Notes on Dantzig-Wolfe decomposition and column generation Mette Gamst November 11, 2010 1 Introduction This note introduces an exact solution method for mathematical programming problems. The method is
More informationLagrangian Relaxation in MIP
Lagrangian Relaxation in MIP Bernard Gendron May 28, 2016 Master Class on Decomposition, CPAIOR2016, Banff, Canada CIRRELT and Département d informatique et de recherche opérationnelle, Université de Montréal,
More informationColumn Generation. MTech Seminar Report. Soumitra Pal Roll No: under the guidance of
Column Generation MTech Seminar Report by Soumitra Pal Roll No: 05305015 under the guidance of Prof. A. G. Ranade Computer Science and Engineering IIT-Bombay a Department of Computer Science and Engineering
More informationColumn Generation for Extended Formulations
1 / 28 Column Generation for Extended Formulations Ruslan Sadykov 1 François Vanderbeck 2,1 1 INRIA Bordeaux Sud-Ouest, France 2 University Bordeaux I, France ISMP 2012 Berlin, August 23 2 / 28 Contents
More informationExtended Formulations, Lagrangian Relaxation, & Column Generation: tackling large scale applications
Extended Formulations, Lagrangian Relaxation, & Column Generation: tackling large scale applications François Vanderbeck University of Bordeaux INRIA Bordeaux-Sud-Ouest part : Defining Extended Formulations
More informationOutline. Relaxation. Outline DMP204 SCHEDULING, TIMETABLING AND ROUTING. 1. Lagrangian Relaxation. Lecture 12 Single Machine Models, Column Generation
Outline DMP204 SCHEDULING, TIMETABLING AND ROUTING 1. Lagrangian Relaxation Lecture 12 Single Machine Models, Column Generation 2. Dantzig-Wolfe Decomposition Dantzig-Wolfe Decomposition Delayed Column
More informationColumn Generation. ORLAB - Operations Research Laboratory. Stefano Gualandi. June 14, Politecnico di Milano, Italy
ORLAB - Operations Research Laboratory Politecnico di Milano, Italy June 14, 2011 Cutting Stock Problem (from wikipedia) Imagine that you work in a paper mill and you have a number of rolls of paper of
More informationNetwork Flows. 6. Lagrangian Relaxation. Programming. Fall 2010 Instructor: Dr. Masoud Yaghini
In the name of God Network Flows 6. Lagrangian Relaxation 6.3 Lagrangian Relaxation and Integer Programming Fall 2010 Instructor: Dr. Masoud Yaghini Integer Programming Outline Branch-and-Bound Technique
More informationAn Integer Cutting-Plane Procedure for the Dantzig-Wolfe Decomposition: Theory
An Integer Cutting-Plane Procedure for the Dantzig-Wolfe Decomposition: Theory by Troels Martin Range Discussion Papers on Business and Economics No. 10/2006 FURTHER INFORMATION Department of Business
More informationLinear Programming Inverse Projection Theory Chapter 3
1 Linear Programming Inverse Projection Theory Chapter 3 University of Chicago Booth School of Business Kipp Martin September 26, 2017 2 Where We Are Headed We want to solve problems with special structure!
More informationPart 4. Decomposition Algorithms
In the name of God Part 4. 4.4. Column Generation for the Constrained Shortest Path Problem Spring 2010 Instructor: Dr. Masoud Yaghini Constrained Shortest Path Problem Constrained Shortest Path Problem
More informationInteger program reformulation for robust branch-and-cut-and-price
Integer program reformulation for robust branch-and-cut-and-price Marcus Poggi de Aragão Informática PUC-Rio Eduardo Uchoa Engenharia de Produção Universidade Federal Fluminense Outline of the talk Robust
More informationA Hub Location Problem with Fully Interconnected Backbone and Access Networks
A Hub Location Problem with Fully Interconnected Backbone and Access Networks Tommy Thomadsen Informatics and Mathematical Modelling Technical University of Denmark 2800 Kgs. Lyngby Denmark tt@imm.dtu.dk
More informationLinear and Integer Programming - ideas
Linear and Integer Programming - ideas Paweł Zieliński Institute of Mathematics and Computer Science, Wrocław University of Technology, Poland http://www.im.pwr.wroc.pl/ pziel/ Toulouse, France 2012 Literature
More informationResource Constrained Project Scheduling Linear and Integer Programming (1)
DM204, 2010 SCHEDULING, TIMETABLING AND ROUTING Lecture 3 Resource Constrained Project Linear and Integer Programming (1) Marco Chiarandini Department of Mathematics & Computer Science University of Southern
More informationInteger Programming Reformulations: Dantzig-Wolfe & Benders Decomposition the Coluna Software Platform
Integer Programming Reformulations: Dantzig-Wolfe & Benders Decomposition the Coluna Software Platform François Vanderbeck B. Detienne, F. Clautiaux, R. Griset, T. Leite, G. Marques, V. Nesello, A. Pessoa,
More informationTravelling Salesman Problem
Travelling Salesman Problem Fabio Furini November 10th, 2014 Travelling Salesman Problem 1 Outline 1 Traveling Salesman Problem Separation Travelling Salesman Problem 2 (Asymmetric) Traveling Salesman
More information3.7 Cutting plane methods
3.7 Cutting plane methods Generic ILP problem min{ c t x : x X = {x Z n + : Ax b} } with m n matrix A and n 1 vector b of rationals. According to Meyer s theorem: There exists an ideal formulation: conv(x
More informationReformulation and Decomposition of Integer Programs
Reformulation and Decomposition of Integer Programs François Vanderbeck 1 and Laurence A. Wolsey 2 (Reference: CORE DP 2009/16) (1) Université Bordeaux 1 & INRIA-Bordeaux (2) Université de Louvain, CORE.
More informationColumn Generation in Integer Programming with Applications in Multicriteria Optimization
Column Generation in Integer Programming with Applications in Multicriteria Optimization Matthias Ehrgott Department of Engineering Science The University of Auckland, New Zealand email: m.ehrgott@auckland.ac.nz
More informationColumn generation for extended formulations
EURO J Comput Optim (2013) 1:81 115 DOI 10.1007/s13675-013-0009-9 ORIGINAL PAPER Column generation for extended formulations Ruslan Sadykov François Vanderbeck Received: 5 May 2012 / Accepted: 21 December
More informationCut and Column Generation
F A C U L T Y O F S C I E N C E U N I V E R S I T Y O F C O P E N H A G E N PhD thesis Simon Spoorendonk Cut and Column Generation Academic advisor: David Pisinger Submitted: 31/10/08 Preface This Ph.D.
More informationA generic view of Dantzig Wolfe decomposition in mixed integer programming
Operations Research Letters 34 (2006) 296 306 Operations Research Letters www.elsevier.com/locate/orl A generic view of Dantzig Wolfe decomposition in mixed integer programming François Vanderbeck a,,
More information3.10 Lagrangian relaxation
3.10 Lagrangian relaxation Consider a generic ILP problem min {c t x : Ax b, Dx d, x Z n } with integer coefficients. Suppose Dx d are the complicating constraints. Often the linear relaxation and the
More informationOutline. Outline. Outline DMP204 SCHEDULING, TIMETABLING AND ROUTING. 1. Scheduling CPM/PERT Resource Constrained Project Scheduling Model
Outline DMP204 SCHEDULING, TIMETABLING AND ROUTING Lecture 3 and Mixed Integer Programg Marco Chiarandini 1. Resource Constrained Project Model 2. Mathematical Programg 2 Outline Outline 1. Resource Constrained
More informationDecomposition Methods for Integer Programming
Decomposition Methods for Integer Programming J.M. Valério de Carvalho vc@dps.uminho.pt Departamento de Produção e Sistemas Escola de Engenharia, Universidade do Minho Portugal PhD Course Programa Doutoral
More information- Well-characterized problems, min-max relations, approximate certificates. - LP problems in the standard form, primal and dual linear programs
LP-Duality ( Approximation Algorithms by V. Vazirani, Chapter 12) - Well-characterized problems, min-max relations, approximate certificates - LP problems in the standard form, primal and dual linear programs
More informationSection Notes 9. Midterm 2 Review. Applied Math / Engineering Sciences 121. Week of December 3, 2018
Section Notes 9 Midterm 2 Review Applied Math / Engineering Sciences 121 Week of December 3, 2018 The following list of topics is an overview of the material that was covered in the lectures and sections
More informationIntroduction to Bin Packing Problems
Introduction to Bin Packing Problems Fabio Furini March 13, 2015 Outline Origins and applications Applications: Definition: Bin Packing Problem (BPP) Solution techniques for the BPP Heuristic Algorithms
More informationCutting Plane Separators in SCIP
Cutting Plane Separators in SCIP Kati Wolter Zuse Institute Berlin DFG Research Center MATHEON Mathematics for key technologies 1 / 36 General Cutting Plane Method MIP min{c T x : x X MIP }, X MIP := {x
More informationInteger Programming: Cutting Planes
OptIntro 1 / 39 Integer Programming: Cutting Planes Eduardo Camponogara Department of Automation and Systems Engineering Federal University of Santa Catarina October 2016 OptIntro 2 / 39 Summary Introduction
More informationLecture #21. c T x Ax b. maximize subject to
COMPSCI 330: Design and Analysis of Algorithms 11/11/2014 Lecture #21 Lecturer: Debmalya Panigrahi Scribe: Samuel Haney 1 Overview In this lecture, we discuss linear programming. We first show that the
More informationNetwork Flows. 7. Multicommodity Flows Problems. Fall 2010 Instructor: Dr. Masoud Yaghini
In the name of God Network Flows 7. Multicommodity Flows Problems 7.3 Column Generation Approach Fall 2010 Instructor: Dr. Masoud Yaghini Path Flow Formulation Path Flow Formulation Let first reformulate
More informationClassification of Dantzig-Wolfe Reformulations for MIP s
Classification of Dantzig-Wolfe Reformulations for MIP s Raf Jans Rotterdam School of Management HEC Montreal Workshop on Column Generation Aussois, June 2008 Outline and Motivation Dantzig-Wolfe reformulation
More informationLP Relaxations of Mixed Integer Programs
LP Relaxations of Mixed Integer Programs John E. Mitchell Department of Mathematical Sciences RPI, Troy, NY 12180 USA February 2015 Mitchell LP Relaxations 1 / 29 LP Relaxations LP relaxations We want
More informationInteger Programming ISE 418. Lecture 8. Dr. Ted Ralphs
Integer Programming ISE 418 Lecture 8 Dr. Ted Ralphs ISE 418 Lecture 8 1 Reading for This Lecture Wolsey Chapter 2 Nemhauser and Wolsey Sections II.3.1, II.3.6, II.4.1, II.4.2, II.5.4 Duality for Mixed-Integer
More informationLecture 7: Lagrangian Relaxation and Duality Theory
Lecture 7: Lagrangian Relaxation and Duality Theory (3 units) Outline Lagrangian dual for linear IP Lagrangian dual for general IP Dual Search Lagrangian decomposition 1 / 23 Joseph Louis Lagrange Joseph
More informationThe Fixed Charge Transportation Problem: A Strong Formulation Based On Lagrangian Decomposition and Column Generation
The Fixed Charge Transportation Problem: A Strong Formulation Based On Lagrangian Decomposition and Column Generation Yixin Zhao, Torbjörn Larsson and Department of Mathematics, Linköping University, Sweden
More informationSection Notes 9. IP: Cutting Planes. Applied Math 121. Week of April 12, 2010
Section Notes 9 IP: Cutting Planes Applied Math 121 Week of April 12, 2010 Goals for the week understand what a strong formulations is. be familiar with the cutting planes algorithm and the types of cuts
More informationMVE165/MMG631 Linear and integer optimization with applications Lecture 8 Discrete optimization: theory and algorithms
MVE165/MMG631 Linear and integer optimization with applications Lecture 8 Discrete optimization: theory and algorithms Ann-Brith Strömberg 2017 04 07 Lecture 8 Linear and integer optimization with applications
More informationInteger Programming ISE 418. Lecture 12. Dr. Ted Ralphs
Integer Programming ISE 418 Lecture 12 Dr. Ted Ralphs ISE 418 Lecture 12 1 Reading for This Lecture Nemhauser and Wolsey Sections II.2.1 Wolsey Chapter 9 ISE 418 Lecture 12 2 Generating Stronger Valid
More informationIntroduction to Integer Linear Programming
Lecture 7/12/2006 p. 1/30 Introduction to Integer Linear Programming Leo Liberti, Ruslan Sadykov LIX, École Polytechnique liberti@lix.polytechnique.fr sadykov@lix.polytechnique.fr Lecture 7/12/2006 p.
More informationDiscrete Optimization 2010 Lecture 7 Introduction to Integer Programming
Discrete Optimization 2010 Lecture 7 Introduction to Integer Programming Marc Uetz University of Twente m.uetz@utwente.nl Lecture 8: sheet 1 / 32 Marc Uetz Discrete Optimization Outline 1 Intro: The Matching
More informationDiscrete Optimization
Prof. Friedrich Eisenbrand Martin Niemeier Due Date: April 15, 2010 Discussions: March 25, April 01 Discrete Optimization Spring 2010 s 3 You can hand in written solutions for up to two of the exercises
More information0-1 Reformulations of the Network Loading Problem
0-1 Reformulations of the Network Loading Problem Antonio Frangioni 1 frangio@di.unipi.it Bernard Gendron 2 bernard@crt.umontreal.ca 1 Dipartimento di Informatica Università di Pisa Via Buonarroti, 2 56127
More informationDecomposition methods in optimization
Decomposition methods in optimization I Approach I: I Partition problem constraints into two groups: explicit and implicit I Approach II: I Partition decision variables into two groups: primary and secondary
More informationBenders Decomposition
Benders Decomposition Yuping Huang, Dr. Qipeng Phil Zheng Department of Industrial and Management Systems Engineering West Virginia University IENG 593G Nonlinear Programg, Spring 2012 Yuping Huang (IMSE@WVU)
More information3.10 Column generation method
3.10 Column generation method Many relevant decision-making (discrete optimization) problems can be formulated as ILP problems with a very large (exponential) number of variables. Examples: cutting stock,
More informationComputational Integer Programming. Lecture 2: Modeling and Formulation. Dr. Ted Ralphs
Computational Integer Programming Lecture 2: Modeling and Formulation Dr. Ted Ralphs Computational MILP Lecture 2 1 Reading for This Lecture N&W Sections I.1.1-I.1.6 Wolsey Chapter 1 CCZ Chapter 2 Computational
More informationDiscrete (and Continuous) Optimization WI4 131
Discrete (and Continuous) Optimization WI4 131 Kees Roos Technische Universiteit Delft Faculteit Electrotechniek, Wiskunde en Informatica Afdeling Informatie, Systemen en Algoritmiek e-mail: C.Roos@ewi.tudelft.nl
More informationIP Cut Homework from J and B Chapter 9: 14, 15, 16, 23, 24, You wish to solve the IP below with a cutting plane technique.
IP Cut Homework from J and B Chapter 9: 14, 15, 16, 23, 24, 31 14. You wish to solve the IP below with a cutting plane technique. Maximize 4x 1 + 2x 2 + x 3 subject to 14x 1 + 10x 2 + 11x 3 32 10x 1 +
More informationIntroduction to Integer Programming
Lecture 3/3/2006 p. /27 Introduction to Integer Programming Leo Liberti LIX, École Polytechnique liberti@lix.polytechnique.fr Lecture 3/3/2006 p. 2/27 Contents IP formulations and examples Total unimodularity
More informationSeparation, Inverse Optimization, and Decomposition. Some Observations. Ted Ralphs 1 Joint work with: Aykut Bulut 1
: Some Observations Ted Ralphs 1 Joint work with: Aykut Bulut 1 1 COR@L Lab, Department of Industrial and Systems Engineering, Lehigh University MOA 2016, Beijing, China, 27 June 2016 What Is This Talk
More informationOperations Research Lecture 6: Integer Programming
Operations Research Lecture 6: Integer Programming Notes taken by Kaiquan Xu@Business School, Nanjing University May 12th 2016 1 Integer programming (IP) formulations The integer programming (IP) is the
More informationInteger Program Reformulation for Robust. Branch-and-Cut-and-Price Algorithms
Integer Program Reformulation for Robust Branch-and-Cut-and-Price Algorithms Marcus Poggi de Aragão 1, Eduardo Uchoa 2 1 Departamento de Informática, PUC-Rio, poggi@inf.puc-rio.br 2 Dep. de Engenharia
More informationCombinatorial Optimization
Combinatorial Optimization Lecture notes, WS 2010/11, TU Munich Prof. Dr. Raymond Hemmecke Version of February 9, 2011 Contents 1 The knapsack problem 1 1.1 Complete enumeration..................................
More informationFundamental Domains for Integer Programs with Symmetries
Fundamental Domains for Integer Programs with Symmetries Eric J. Friedman Cornell University, Ithaca, NY 14850, ejf27@cornell.edu, WWW home page: http://www.people.cornell.edu/pages/ejf27/ Abstract. We
More informationInterior-Point versus Simplex methods for Integer Programming Branch-and-Bound
Interior-Point versus Simplex methods for Integer Programming Branch-and-Bound Samir Elhedhli elhedhli@uwaterloo.ca Department of Management Sciences, University of Waterloo, Canada Page of 4 McMaster
More information1 Solution of a Large-Scale Traveling-Salesman Problem... 7 George B. Dantzig, Delbert R. Fulkerson, and Selmer M. Johnson
Part I The Early Years 1 Solution of a Large-Scale Traveling-Salesman Problem............ 7 George B. Dantzig, Delbert R. Fulkerson, and Selmer M. Johnson 2 The Hungarian Method for the Assignment Problem..............
More informationIntroduction to Mathematical Programming IE406. Lecture 10. Dr. Ted Ralphs
Introduction to Mathematical Programming IE406 Lecture 10 Dr. Ted Ralphs IE406 Lecture 10 1 Reading for This Lecture Bertsimas 4.1-4.3 IE406 Lecture 10 2 Duality Theory: Motivation Consider the following
More informationIntroduction to optimization and operations research
Introduction to optimization and operations research David Pisinger, Fall 2002 1 Smoked ham (Chvatal 1.6, adapted from Greene et al. (1957)) A meat packing plant produces 480 hams, 400 pork bellies, and
More informationOptimization WS 13/14:, by Y. Goldstein/K. Reinert, 9. Dezember 2013, 16: Linear programming. Optimization Problems
Optimization WS 13/14:, by Y. Goldstein/K. Reinert, 9. Dezember 2013, 16:38 2001 Linear programming Optimization Problems General optimization problem max{z(x) f j (x) 0,x D} or min{z(x) f j (x) 0,x D}
More information3.10 Column generation method
3.10 Column generation method Many relevant decision-making problems can be formulated as ILP problems with a very large (exponential) number of variables. Examples: cutting stock, crew scheduling, vehicle
More informationA Capacity Scaling Procedure for the Multi-Commodity Capacitated Network Design Problem. Ryutsu Keizai University Naoto KATAYAMA
A Capacity Scaling Procedure for the Multi-Commodity Capacitated Network Design Problem Ryutsu Keizai University Naoto KATAYAMA Problems 2006 1 Multi-Commodity Network Design Problem The basic model for
More informationFeasibility Pump Heuristics for Column Generation Approaches
1 / 29 Feasibility Pump Heuristics for Column Generation Approaches Ruslan Sadykov 2 Pierre Pesneau 1,2 Francois Vanderbeck 1,2 1 University Bordeaux I 2 INRIA Bordeaux Sud-Ouest SEA 2012 Bordeaux, France,
More informationOn the Polyhedral Structure of a Multi Item Production Planning Model with Setup Times
CORE DISCUSSION PAPER 2000/52 On the Polyhedral Structure of a Multi Item Production Planning Model with Setup Times Andrew J. Miller 1, George L. Nemhauser 2, and Martin W.P. Savelsbergh 2 November 2000
More informationCSC Linear Programming and Combinatorial Optimization Lecture 10: Semidefinite Programming
CSC2411 - Linear Programming and Combinatorial Optimization Lecture 10: Semidefinite Programming Notes taken by Mike Jamieson March 28, 2005 Summary: In this lecture, we introduce semidefinite programming
More information4. Duality Duality 4.1 Duality of LPs and the duality theorem. min c T x x R n, c R n. s.t. ai Tx = b i i M a i R n
2 4. Duality of LPs and the duality theorem... 22 4.2 Complementary slackness... 23 4.3 The shortest path problem and its dual... 24 4.4 Farkas' Lemma... 25 4.5 Dual information in the tableau... 26 4.6
More informationLecture 10: Linear programming duality and sensitivity 0-0
Lecture 10: Linear programming duality and sensitivity 0-0 The canonical primal dual pair 1 A R m n, b R m, and c R n maximize z = c T x (1) subject to Ax b, x 0 n and minimize w = b T y (2) subject to
More informationDecomposition and Reformulation in Integer Programming
and Reformulation in Integer Programming Laurence A. WOLSEY 7/1/2008 / Aussois and Reformulation in Integer Programming Outline 1 Resource 2 and Reformulation in Integer Programming Outline Resource 1
More informationApplications. Stephen J. Stoyan, Maged M. Dessouky*, and Xiaoqing Wang
Introduction to Large-Scale Linear Programming and Applications Stephen J. Stoyan, Maged M. Dessouky*, and Xiaoqing Wang Daniel J. Epstein Department of Industrial and Systems Engineering, University of
More information1 Column Generation and the Cutting Stock Problem
1 Column Generation and the Cutting Stock Problem In the linear programming approach to the traveling salesman problem we used the cutting plane approach. The cutting plane approach is appropriate when
More informationSeparation, Inverse Optimization, and Decomposition. Some Observations. Ted Ralphs 1 Joint work with: Aykut Bulut 1
: Some Observations Ted Ralphs 1 Joint work with: Aykut Bulut 1 1 COR@L Lab, Department of Industrial and Systems Engineering, Lehigh University COLGEN 2016, Buzios, Brazil, 25 May 2016 What Is This Talk
More informationCS 6820 Fall 2014 Lectures, October 3-20, 2014
Analysis of Algorithms Linear Programming Notes CS 6820 Fall 2014 Lectures, October 3-20, 2014 1 Linear programming The linear programming (LP) problem is the following optimization problem. We are given
More informationLift-and-Project Inequalities
Lift-and-Project Inequalities Q. Louveaux Abstract The lift-and-project technique is a systematic way to generate valid inequalities for a mixed binary program. The technique is interesting both on the
More informationCOT 6936: Topics in Algorithms! Giri Narasimhan. ECS 254A / EC 2443; Phone: x3748
COT 6936: Topics in Algorithms! Giri Narasimhan ECS 254A / EC 2443; Phone: x3748 giri@cs.fiu.edu https://moodle.cis.fiu.edu/v2.1/course/view.php?id=612 Gaussian Elimination! Solving a system of simultaneous
More informationSequential pairing of mixed integer inequalities
Sequential pairing of mixed integer inequalities Yongpei Guan, Shabbir Ahmed, George L. Nemhauser School of Industrial & Systems Engineering, Georgia Institute of Technology, 765 Ferst Drive, Atlanta,
More informationExercises - Linear Programming
Chapter 38 Exercises - Linear Programming By Sariel Har-Peled, December 10, 2007 1 Version: 1.0 This chapter include problems that are related to linear programming. 38.1 Miscellaneous Exercise 38.1.1
More informationDuality of LPs and Applications
Lecture 6 Duality of LPs and Applications Last lecture we introduced duality of linear programs. We saw how to form duals, and proved both the weak and strong duality theorems. In this lecture we will
More informationDecomposition-based Methods for Large-scale Discrete Optimization p.1
Decomposition-based Methods for Large-scale Discrete Optimization Matthew V Galati Ted K Ralphs Department of Industrial and Systems Engineering Lehigh University, Bethlehem, PA, USA Départment de Mathématiques
More informationLP Duality: outline. Duality theory for Linear Programming. alternatives. optimization I Idea: polyhedra
LP Duality: outline I Motivation and definition of a dual LP I Weak duality I Separating hyperplane theorem and theorems of the alternatives I Strong duality and complementary slackness I Using duality
More informationLinear Programming: Simplex
Linear Programming: Simplex Stephen J. Wright 1 2 Computer Sciences Department, University of Wisconsin-Madison. IMA, August 2016 Stephen Wright (UW-Madison) Linear Programming: Simplex IMA, August 2016
More informationAlgorithms and Theory of Computation. Lecture 13: Linear Programming (2)
Algorithms and Theory of Computation Lecture 13: Linear Programming (2) Xiaohui Bei MAS 714 September 25, 2018 Nanyang Technological University MAS 714 September 25, 2018 1 / 15 LP Duality Primal problem
More informationIE 5531: Engineering Optimization I
IE 5531: Engineering Optimization I Lecture 7: Duality and applications Prof. John Gunnar Carlsson September 29, 2010 Prof. John Gunnar Carlsson IE 5531: Engineering Optimization I September 29, 2010 1
More informationAn introductory example
CS1 Lecture 9 An introductory example Suppose that a company that produces three products wishes to decide the level of production of each so as to maximize profits. Let x 1 be the amount of Product 1
More informationInteger programming: an introduction. Alessandro Astolfi
Integer programming: an introduction Alessandro Astolfi Outline Introduction Examples Methods for solving ILP Optimization on graphs LP problems with integer solutions Summary Introduction Integer programming
More informationFixed-charge transportation problems on trees
Fixed-charge transportation problems on trees Gustavo Angulo * Mathieu Van Vyve * gustavo.angulo@uclouvain.be mathieu.vanvyve@uclouvain.be November 23, 2015 Abstract We consider a class of fixed-charge
More informationLecture 10: Linear programming. duality. and. The dual of the LP in standard form. maximize w = b T y (D) subject to A T y c, minimize z = c T x (P)
Lecture 10: Linear programming duality Michael Patriksson 19 February 2004 0-0 The dual of the LP in standard form minimize z = c T x (P) subject to Ax = b, x 0 n, and maximize w = b T y (D) subject to
More informationCutting Planes in SCIP
Cutting Planes in SCIP Kati Wolter Zuse-Institute Berlin Department Optimization Berlin, 6th June 2007 Outline 1 Cutting Planes in SCIP 2 Cutting Planes for the 0-1 Knapsack Problem 2.1 Cover Cuts 2.2
More informationBranch-and-Price-and-Cut for the Split Delivery Vehicle Routing Problem with Time Windows
Branch-and-Price-and-Cut for the Split Delivery Vehicle Routing Problem with Time Windows Guy Desaulniers École Polytechnique de Montréal and GERAD Column Generation 2008 Aussois, France Outline Introduction
More informationBBM402-Lecture 20: LP Duality
BBM402-Lecture 20: LP Duality Lecturer: Lale Özkahya Resources for the presentation: https://courses.engr.illinois.edu/cs473/fa2016/lectures.html An easy LP? which is compact form for max cx subject to
More information3.4 Relaxations and bounds
3.4 Relaxations and bounds Consider a generic Discrete Optimization problem z = min{c(x) : x X} with an optimal solution x X. In general, the algorithms generate not only a decreasing sequence of upper
More informationLarge-scale optimization and decomposition methods: outline. Column Generation and Cutting Plane methods: a unified view
Large-scale optimization and decomposition methods: outline I Solution approaches for large-scaled problems: I Delayed column generation I Cutting plane methods (delayed constraint generation) 7 I Problems
More informationIn the original knapsack problem, the value of the contents of the knapsack is maximized subject to a single capacity constraint, for example weight.
In the original knapsack problem, the value of the contents of the knapsack is maximized subject to a single capacity constraint, for example weight. In the multi-dimensional knapsack problem, additional
More informationIntroduction to integer programming II
Introduction to integer programming II Martin Branda Charles University in Prague Faculty of Mathematics and Physics Department of Probability and Mathematical Statistics Computational Aspects of Optimization
More informationto work with) can be solved by solving their LP relaxations with the Simplex method I Cutting plane algorithms, e.g., Gomory s fractional cutting
Summary so far z =max{c T x : Ax apple b, x 2 Z n +} I Modeling with IP (and MIP, and BIP) problems I Formulation for a discrete set that is a feasible region of an IP I Alternative formulations for the
More information