Foundations of Operations Research

Similar documents
Foundations of Operations Research

Section Notes 9. IP: Cutting Planes. Applied Math 121. Week of April 12, 2010

Optimization Methods in Management Science

Gomory Cuts. Chapter 5. Linear Arithmetic. Decision Procedures. An Algorithmic Point of View. Revision 1.0

min3x 1 + 4x 2 + 5x 3 2x 1 + 2x 2 + x 3 6 x 1 + 2x 2 + 3x 3 5 x 1, x 2, x 3 0.

maxz = 3x 1 +4x 2 2x 1 +x 2 6 2x 1 +3x 2 9 x 1,x 2

Math Models of OR: Sensitivity Analysis

IP Cut Homework from J and B Chapter 9: 14, 15, 16, 23, 24, You wish to solve the IP below with a cutting plane technique.

Math Models of OR: Some Definitions

21. Solve the LP given in Exercise 19 using the big-m method discussed in Exercise 20.

CO350 Linear Programming Chapter 6: The Simplex Method

Operations Research Lecture 6: Integer Programming

Introduction to Mathematical Programming IE406. Lecture 13. Dr. Ted Ralphs

Lesson 27 Linear Programming; The Simplex Method

Generating Gomory's Cuts for linear integer programming problems: the HOW and WHY

AM 121: Intro to Optimization! Models and Methods! Fall 2018!

(P ) Minimize 4x 1 + 6x 2 + 5x 3 s.t. 2x 1 3x 3 3 3x 2 2x 3 6

Part 1. The Review of Linear Programming

SOLVING INTEGER LINEAR PROGRAMS. 1. Solving the LP relaxation. 2. How to deal with fractional solutions?

Slack Variable. Max Z= 3x 1 + 4x 2 + 5X 3. Subject to: X 1 + X 2 + X x 1 + 4x 2 + X X 1 + X 2 + 4X 3 10 X 1 0, X 2 0, X 3 0

min 4x 1 5x 2 + 3x 3 s.t. x 1 + 2x 2 + x 3 = 10 x 1 x 2 6 x 1 + 3x 2 + x 3 14

3.7 Cutting plane methods

1. Algebraic and geometric treatments Consider an LP problem in the standard form. x 0. Solutions to the system of linear equations

Chap6 Duality Theory and Sensitivity Analysis

The Simplex Algorithm

The augmented form of this LP is the following linear system of equations:

Section Notes 9. Midterm 2 Review. Applied Math / Engineering Sciences 121. Week of December 3, 2018

The Simplex Method. Lecture 5 Standard and Canonical Forms and Setting up the Tableau. Lecture 5 Slide 1. FOMGT 353 Introduction to Management Science

9.5 THE SIMPLEX METHOD: MIXED CONSTRAINTS

Math 210 Finite Mathematics Chapter 4.2 Linear Programming Problems Minimization - The Dual Problem

Yinyu Ye, MS&E, Stanford MS&E310 Lecture Note #06. The Simplex Method

CSC Design and Analysis of Algorithms. LP Shader Electronics Example

4.7 Sensitivity analysis in Linear Programming

CHAPTER 2. The Simplex Method

Introduction to Mathematical Programming IE406. Lecture 21. Dr. Ted Ralphs

Sensitivity Analysis

March 13, Duality 3

Worked Examples for Chapter 5

Simplex Method for LP (II)

F 1 F 2 Daily Requirement Cost N N N

On the knapsack closure of 0-1 Integer Linear Programs. Matteo Fischetti University of Padova, Italy

The dual simplex method with bounds

1 Simplex and Matrices

Integer Programming. The focus of this chapter is on solution techniques for integer programming models.

Math 354 Summer 2004 Solutions to review problems for Midterm #1

Standard Form An LP is in standard form when: All variables are non-negativenegative All constraints are equalities Putting an LP formulation into sta

Simplex tableau CE 377K. April 2, 2015

Non-Standard Constraints. Setting up Phase 1 Phase 2

A Review of Linear Programming

In Chapters 3 and 4 we introduced linear programming

3.10 Column generation method

Cutting Plane Separators in SCIP

Linear programming: algebra

CS Algorithms and Complexity

OPTIMISATION 3: NOTES ON THE SIMPLEX ALGORITHM

Chapter 1 Linear Programming. Paragraph 5 Duality

ECE 307 Techniques for Engineering Decisions

AM 121: Intro to Optimization

Variants of Simplex Method

Section Notes 8. Integer Programming II. Applied Math 121. Week of April 5, expand your knowledge of big M s and logical constraints.

Linear Programming: Simplex Method CHAPTER The Simplex Tableau; Pivoting

3.10 Column generation method

(includes both Phases I & II)

A = Chapter 6. Linear Programming: The Simplex Method. + 21x 3 x x 2. C = 16x 1. + x x x 1. + x 3. 16,x 2.

Example. 1 Rows 1,..., m of the simplex tableau remain lexicographically positive

1 Review Session. 1.1 Lecture 2

4.4 The Simplex Method and the Standard Minimization Problem

Integer Programming ISE 418. Lecture 13. Dr. Ted Ralphs

Review Solutions, Exam 2, Operations Research

Dr. Maddah ENMG 500 Engineering Management I 10/21/07

Note 3: LP Duality. If the primal problem (P) in the canonical form is min Z = n (1) then the dual problem (D) in the canonical form is max W = m (2)

Math Homework 3: solutions. 1. Consider the region defined by the following constraints: x 1 + x 2 2 x 1 + 2x 2 6

Math Models of OR: Traveling Salesman Problem

Linear Programming, Lecture 4

Decision Procedures An Algorithmic Point of View

Farkas Lemma, Dual Simplex and Sensitivity Analysis

Mixing Inequalities and Maximal Lattice-Free Triangles

6.2: The Simplex Method: Maximization (with problem constraints of the form )

M340(921) Solutions Problem Set 6 (c) 2013, Philip D Loewen. g = 35y y y 3.

x 1 + 4x 2 = 5, 7x 1 + 5x 2 + 2x 3 4,

3.7 Strong valid inequalities for structured ILP problems

Linear Programming and the Simplex method

SAMPLE QUESTIONS. b = (30, 20, 40, 10, 50) T, c = (650, 1000, 1350, 1600, 1900) T.

3 The Simplex Method. 3.1 Basic Solutions

AM 121: Intro to Optimization Models and Methods

The Strength of Multi-Row Relaxations

9.1 Linear Programs in canonical form

MAT016: Optimization

In the original knapsack problem, the value of the contents of the knapsack is maximized subject to a single capacity constraint, for example weight.

1 Column Generation and the Cutting Stock Problem

Understanding the Simplex algorithm. Standard Optimization Problems.

Topic: Primal-Dual Algorithms Date: We finished our discussion of randomized rounding and began talking about LP Duality.

CPS 616 ITERATIVE IMPROVEMENTS 10-1

4. Duality and Sensitivity

COT 6936: Topics in Algorithms! Giri Narasimhan. ECS 254A / EC 2443; Phone: x3748

An Integer Cutting-Plane Procedure for the Dantzig-Wolfe Decomposition: Theory

On the knapsack closure of 0-1 Integer Linear Programs

Math Models of OR: Handling Upper Bounds in Simplex

Chapter 1: Linear Programming

Introduction to Integer Linear Programming

Transcription:

Solved exercises for the course of Foundations of Operations Research Roberto Cordone

Gomory cuts Given the ILP problem maxf = 4x 1 +3x 2 2x 1 +x 2 11 x 1 +2x 2 6 x 1,x 2 N solve it with the Gomory cutting plane method, determining all possible cuts and applying one of them at each step. The Gomory cutting plane algorithm The Gomory cutting plane algorithm consists in solving the continuous relaxation of an ILP problem and deriving from its optimal solution one or more inequalities which are violated by the solution itself, but respected by any integer feasible solution of the problem. These inequalities are added to the problem, which is reoptimized. Then, the method is applied again to the new solution, proceeding as long as the optimal solution becomes integer, and therefore feasible and optimal also for the original ILP problem. In order to generate the constraints, one combines the given linear constraints with the integrality constraint as follows. All constraints of a problem in basic canonical form are written as: a ij x j +x j = b i i = 1,...,m that is exactly one of the occurring variables is basic, whereas the others are nonbasic. We can obtain another constraint, which preserves all the integer feasible solutions, through two steps: 1. relax the constraint rounding dows its coefficients (replacing them with the maximum nonlarger integer) a ij x j +x j = b i i = 1,...,m 2. tighten the constraint rounding down the right-hand-side (replacing it with the maximum nonlarger integer) a ij x j +x j = b i i = 1,...,m 1

Geometrically speaking, the first step rotates the constraint (the angular coefficients of the separating hyperplane change), keeping all nonnegative solutions feasible. The second step transposes the constraint (the right-hand-side changes) so as to restrict the feasible region. If both the original and the derived constraint are maintained, the new fesible relaxed region becomes smaller, so that the continuous relaxation is tighter. However, no integer solution is lost. Solution First, solve the continuous relaxation of the problem with the simplex algorithm. It standard form is: minf = 4x 1 3x 2 2x 1 +x 2 +x 3 = 11 x 1 +2x 2 +x 4 = 6 x 1,x 2,x 3,x 4 0 The tableaus corresponding to the steps of the simplex method are the following (the pivot element is circled). 0-4 -3 0 0 11 2 1 1 0 6-1 2 0 1 22 0-1 2 0 11/2 1 1/2 1/2 0 23/2 0 5/2 1/2 1 26+3/5 0 0 11/5 2/5 16/5 1 0 2/5-1/5 23/5 0 1 1/5 2/5 The optimal relaxed solution is fractionary in all variables, and also the value of the objective function is fractional. One can therefore introduce a Gomory cut for each row of the tableau, that is three cuts, one of which deriving from row 0. Let us derive them, leaving the one derived from row 0 in the end, since it deserves some further remark. Row 1 Constraint x 1 +2/5x 3 1/5x 4 = 16/5, rounding down all coefficients, yields the looser constraint x 1 x 4 16/5, which can be tightened rounding down the right-hand-side, based on the fact that all variables and coefficients are integer: x 1 x 4 3 2

Equivalently, subtracting this relation from the original constraint, one obtains the fractional form of the cut: 2 5 x 3 + 4 5 x 4 1 5 which can be simply added to the tableau under the form: 2 5 x 3 4 5 x 4 +x 5 = 1 5 so as to proceed with the dual simplex method. To better understand the meaning of the introduction of the cut, let us retrieve its expression in terms of the natural variables x 1 and x 2, using the other constraints: since thesecondoriginal constraint guaranteesthat x 4 = 6+x 1 2x 2, we conclude that the cut derived from row 1 imposes x 2 9/2. Row 2 Fromconstraintx 2 +1/5x 3 +2/5x 4 = 23/5weobtain, roundingdownthe coefficients of all variables, the weaker constraint x 2 23/5, which can be strengthened rounding down also the right-hand-side, since variables and coefficients are all integer: x 2 4 Equivalently, subtracting this relation from the original constraint, one obtains the cut in fractional form: 1 5 x 3 + 2 5 x 4 3 5 which can be simply added to the tableau under the form: 1 5 x 3 2 5 x 4 +x 5 = 3 5 so as to proceed with the dual simplex method. We denote the new slack variable as x 5, though it is a different variable from the one introduced considering row 1, because usually one introduces a single Gomory cut at a time, but nothing forbids to introduce more (and even all) cuts simultaneously, each with its own different slack variable. The new cut, actually, resembles the previous one. To be precise, it dominates the previous one. Cuts generated from different rows can be identical, different (i. e. each cuts away a different region, with some solutions more and some solutions less than the other cuts), or some of them can dominate other ones. It is a good heuristic rule to focus on the rows whose right-hand-side has the most fractionary value, that is has a fractionary part closest to 1/2. In fact, in this case row 1 is less fractionary than row 2 and provides a dominated but. This is not guaranteed: it is just a heuristic rule, since the strength of a cut depends on its interaction with all the constraints of the problem. 3

Row 0 Notice that, in the given case, f = 4x 1 +3x 2, i. e. the cost coefficients are all integer. Therefore, also the objective function is, necessarily, integer. If not only the decision variables, but also the objective is guaranteed to be integer, row 0 can be used to generate an additional Gomory cut. This is not always true, but it is a quite common case. One should keep in mind that row 0 relates the variables x j with the value of the objective function z. So, it can be seen as an equality constraint, and processed as the regular constraints, with a slight difference. While row 1 of the tableau 16/5 1 0 2/5-1/5 simply stands for x 1 +2/5x 3 1/5x 4 = 16/5, row 0 of the tableau 26+3/5 0 0 11/5 2/5 stands for 11/5x 3 +2/5x 4 = z +26+3/5, and not 11/5x 3 +2/5x 4 = 26+3/5! Hence, applying the usual procedure, one obtains first the weaker constraint 2x 3 z +26+3/5 and then the stronger cut 2x 3 z +26 That means z 2x 3 26, which actually preserves the integer solutions, but removes the optimal relaxed solution, for which z = 26 3/5. Subtracting row 0 from the integer form of the cut, one obtains the fractionary form 1/5x 3 +2/5x 4 3/5 which can be added to the tableau under the form 1/5x 3 2/5x 4 +x 5 = 3/5. Notice that, forgetting the term z, the integer form would be completely wrong, whereas the fractionary form does not present any interpretation problem: it can be mechanically derived from row 0 with the same rules used for the other rows (get the fractionary components of the coefficients and of the right-hand-side, reverse their sign and introduce a new slack variable). The geometric meaning of thenew cut z 2x 3 26 canbededuced expressing z andx 3 intermsofthenaturalvariables(fromthegivenproblem, z = 4x 1 3x 2 and x 3 = 11 2x 1 x 2 ). The result is 4x 1 3x 2 2(11 2x 1 x 2 ) 26, and therefore x 2 4. So, in this specific problem two of the three Gomory cuts coincide and dominate the third one. In general, the cuts could also be independent. 4