Introduction to Mathematical Programming IE406. Lecture 13. Dr. Ted Ralphs

Similar documents
Farkas Lemma, Dual Simplex and Sensitivity Analysis

Introduction to Mathematical Programming IE406. Lecture 10. Dr. Ted Ralphs

The use of shadow price is an example of sensitivity analysis. Duality theory can be applied to do other kind of sensitivity analysis:

The Simplex Method. Lecture 5 Standard and Canonical Forms and Setting up the Tableau. Lecture 5 Slide 1. FOMGT 353 Introduction to Management Science

Sensitivity Analysis

Worked Examples for Chapter 5

Part 1. The Review of Linear Programming

MVE165/MMG631 Linear and integer optimization with applications Lecture 5 Linear programming duality and sensitivity analysis

Note 3: LP Duality. If the primal problem (P) in the canonical form is min Z = n (1) then the dual problem (D) in the canonical form is max W = m (2)

Review Solutions, Exam 2, Operations Research

Math Models of OR: Some Definitions

CO350 Linear Programming Chapter 6: The Simplex Method

Lecture 11: Post-Optimal Analysis. September 23, 2009

Slack Variable. Max Z= 3x 1 + 4x 2 + 5X 3. Subject to: X 1 + X 2 + X x 1 + 4x 2 + X X 1 + X 2 + 4X 3 10 X 1 0, X 2 0, X 3 0

21. Solve the LP given in Exercise 19 using the big-m method discussed in Exercise 20.

F 1 F 2 Daily Requirement Cost N N N

Chap6 Duality Theory and Sensitivity Analysis

Dual Basic Solutions. Observation 5.7. Consider LP in standard form with A 2 R m n,rank(a) =m, and dual LP:

Math Models of OR: Sensitivity Analysis

AM 121: Intro to Optimization

(P ) Minimize 4x 1 + 6x 2 + 5x 3 s.t. 2x 1 3x 3 3 3x 2 2x 3 6

Standard Form An LP is in standard form when: All variables are non-negativenegative All constraints are equalities Putting an LP formulation into sta

Relation of Pure Minimum Cost Flow Model to Linear Programming

Foundations of Operations Research

CO350 Linear Programming Chapter 6: The Simplex Method

Lesson 27 Linear Programming; The Simplex Method

Simplex Algorithm Using Canonical Tableaus

A Review of Linear Programming

IP Cut Homework from J and B Chapter 9: 14, 15, 16, 23, 24, You wish to solve the IP below with a cutting plane technique.

Today: Linear Programming (con t.)

Sensitivity Analysis and Duality in LP

4.6 Linear Programming duality

(includes both Phases I & II)

Linear Programming Duality P&S Chapter 3 Last Revised Nov 1, 2004

TIM 206 Lecture 3: The Simplex Method

Sensitivity Analysis and Duality

CO350 Linear Programming Chapter 8: Degeneracy and Finite Termination

min 4x 1 5x 2 + 3x 3 s.t. x 1 + 2x 2 + x 3 = 10 x 1 x 2 6 x 1 + 3x 2 + x 3 14

Example. 1 Rows 1,..., m of the simplex tableau remain lexicographically positive

"SYMMETRIC" PRIMAL-DUAL PAIR

AM 121: Intro to Optimization Models and Methods Fall 2018

Simplex tableau CE 377K. April 2, 2015

MAT016: Optimization

(includes both Phases I & II)

The Strong Duality Theorem 1

Operations Research Lecture 6: Integer Programming

Special cases of linear programming

Linear Programming Duality

4. Duality and Sensitivity

Summary of the simplex method

MATH 445/545 Homework 2: Due March 3rd, 2016

Lecture 2: The Simplex method

1. Algebraic and geometric treatments Consider an LP problem in the standard form. x 0. Solutions to the system of linear equations

Linear Programming, Lecture 4

Operations Research Lecture 2: Linear Programming Simplex Method

Systems Analysis in Construction

The dual simplex method with bounds

CO350 Linear Programming Chapter 5: Basic Solutions

3. Duality: What is duality? Why does it matter? Sensitivity through duality.

Lecture 5 Simplex Method. September 2, 2009

Optimisation and Operations Research

Understanding the Simplex algorithm. Standard Optimization Problems.

1 Review Session. 1.1 Lecture 2

Summary of the simplex method

OPERATIONS RESEARCH. Michał Kulej. Business Information Systems

Lecture Simplex Issues: Number of Pivots. ORIE 6300 Mathematical Programming I October 9, 2014

IE 400: Principles of Engineering Management. Simplex Method Continued

Foundations of Operations Research

Lecture 11 Linear programming : The Revised Simplex Method

4.7 Sensitivity analysis in Linear Programming

Yinyu Ye, MS&E, Stanford MS&E310 Lecture Note #06. The Simplex Method

Lecture 5. x 1,x 2,x 3 0 (1)

MATH2070 Optimisation

56:171 Operations Research Fall 1998

Math Models of OR: Handling Upper Bounds in Simplex

Motivating examples Introduction to algorithms Simplex algorithm. On a particular example General algorithm. Duality An application to game theory

CSC Design and Analysis of Algorithms. LP Shader Electronics Example

Linear and Combinatorial Optimization

Lecture #21. c T x Ax b. maximize subject to

Week_4: simplex method II

The Simplex Algorithm

Chapter 5 Linear Programming (LP)

M340(921) Solutions Problem Set 6 (c) 2013, Philip D Loewen. g = 35y y y 3.

Duality Theory, Optimality Conditions

Chapter 1 Linear Programming. Paragraph 5 Duality

Ann-Brith Strömberg. Lecture 4 Linear and Integer Optimization with Applications 1/10

Part IB Optimisation

Contents. 4.5 The(Primal)SimplexMethod NumericalExamplesoftheSimplexMethod

Ω R n is called the constraint set or feasible set. x 1

56:171 Operations Research Midterm Exam--15 October 2002

Linear Programming Redux

Algorithms and Theory of Computation. Lecture 13: Linear Programming (2)

Linear Programming in Matrix Form

IE 5531: Engineering Optimization I

Linear Programming Inverse Projection Theory Chapter 3

LINEAR PROGRAMMING 2. In many business and policy making situations the following type of problem is encountered:

Part III: A Simplex pivot

Lecture 8. Strong Duality Results. September 22, 2008

Math Models of OR: Extreme Points and Basic Feasible Solutions

Introduction. Very efficient solution procedure: simplex method.

Transcription:

Introduction to Mathematical Programming IE406 Lecture 13 Dr. Ted Ralphs

IE406 Lecture 13 1 Reading for This Lecture Bertsimas Chapter 5

IE406 Lecture 13 2 Sensitivity Analysis In many real-world problems, the following can occur: The input data is not very accurate. We don t know all of the constraints ahead of time. We don t know all of the variables ahead of time. Because of this, we want to analyze the dependence of the model on the input data, i.e., the matrix A, the right-hand side vector b, and the cost vector c. We would also like to know the effect of additional variables and constraints. This is done using sensitivity analysis. Sensitivity analysis requires nothing more than straightforward application of techniques we ve already developed.

IE406 Lecture 13 3 The Fundamental Idea Using the simplex algorithm to solve a standard form problem, we know that if B is an optimal basis, then two conditions are satisfied: B 1 b 0 c c B B 1 A 0 When the problem is changed, we can check to see how these conditions are affected. This is the simplest kind of analysis we have already seen several examples. When using the simplex method, we always have B 1 available, so we can easily recompute appropriate quantities. Where is B 1 in the simplex tableau?

IE406 Lecture 13 4 Adding a New Variable Suppose we want to consider adding a new variable to the problem, e.g., we want to consider adding a new product to our line. We simply compute the reduced cost of the new variable as c j c BB 1 A j where A j is the column corresponding to the new variable in the matrix. If the reduced costs is nonnegative, then we should not consider adding the product. Otherwise, it is eligible to enter the basis and we can reoptimize from the current feasible (but now non-optimal) basis.

IE406 Lecture 13 5 Adding a New Inequality Constraint Suppose we want to introduce a new constraint of the form a m+1x b m+1. The new constraint matrix (in standard form) would look like [ A 0 a m+1 1 ] Hence, the new basis matrix would look like [ ] B 0 B = a 1 The new basis inverse would then be [ B 1 B = 1 0 a B 1 1 ]

IE406 Lecture 13 6 Adding a New Inequality Constraint (cont.) The vector of reduced costs is [ [c 0] [c B 0] B 1 0 a B 1 1 ] [ A 0 a m+1 1 ] = [c c BB 1 A 0] and so the reduced costs remain unchanged. Hence, we have a dual feasible basis and we apply dual simplex. The tableau can be computed as B 1 [ A 0 a m+1 1 ] = [ B 1 A 0 a B 1 A a m+1 1 ] Note that B 1 A is available from the original tableau.

IE406 Lecture 13 7 Adding a New Equality Constraint Assume the new constraint is not satisfied by the current optimal solution. We introduce an artificial variable x n+1, as in the two-phase method, and consider the LP (assuming a m+1x > b m+1 ) min c x + Mx n+1 s.t. Ax = b a m+1x x n+1 = b m+1 x 0, x n+1 0 We can obtain a primal feasible basis by making the new variable basic. The new tableau can be computed as before. If the new problem is feasible and M is large enough, then the solution will have x n+1 = 0. The values of the remaining variables will yield an optimal solution to the original problem with the additional constraint.

IE406 Lecture 13 8 Changes to the Right-hand Side Suppose we change b i to b i + δ. The values of the basic variables change from B 1 b to B 1 (b + δe i ), where e i is the i th unit vector. The feasibility condition is then B 1 (b + δe i ) 0 If g is the i th column of B 1, then the feasibility condition becomes This is equivalent to ( max x ) B(j) {j g j >0} g j x B + δg 0 δ ( min x ) B(j). {j g j <0} g j If δ is outside the allowable range, we can reoptimize using dual simplex.

IE406 Lecture 13 9 Changes in the Cost Vector Suppose we change some cost coefficient from c j to c j + δ. If c j is the cost coefficient of a nonbasic variable, then we need only recalculate its reduced cost. The reduced cost itself increases by δ and the current solution remains optimal as long as δ c j. Otherwise, we reoptimize using the primal simplex method. If c j is the cost coefficient of the l th basic variable, then c B becomes c B + δe l and the new optimality conditions are (c B + δe l ) B 1 A c This is equivalent to δq c where q is the l th row of B 1 A, which is available in the simplex tableau.

IE406 Lecture 13 10 Changes in a Nonbasic Column of A Suppose we change some entry a ij of the constraint matrix to a ij + δ. If column j is nonbasic, then B does not change and we only need to check the reduced cost of column j. The new reduced cost is c j c BB 1 (A j + δe i ) This means the current solution remains optimal if c j δp i 0 Otherwise, we reoptimize with primal simplex.

IE406 Lecture 13 11 Changes in a Basic Column of A This case is more complicated and will be left to the next homework. Suppose x and p are optimal primal and dual solutions. If the basic column A j is changed to A j + δe i, then if x (δ) is the new solution, it can be shown that c x (δ) = c x δx jp i + O(δ 2 ) This is in concert with our previous economic interpretations of duality and optimality.