Linear programming: algebra

Similar documents
Math Models of OR: Some Definitions

Slack Variable. Max Z= 3x 1 + 4x 2 + 5X 3. Subject to: X 1 + X 2 + X x 1 + 4x 2 + X X 1 + X 2 + 4X 3 10 X 1 0, X 2 0, X 3 0

Prelude to the Simplex Algorithm. The Algebraic Approach The search for extreme point solutions.

Simplex Method for LP (II)

MAT016: Optimization

9.1 Linear Programs in canonical form

Lesson 27 Linear Programming; The Simplex Method

The simplex algorithm

Algebraic Simplex Active Learning Module 4

Part 1. The Review of Linear Programming Introduction

Chapter 4 The Simplex Algorithm Part I

TIM 206 Lecture 3: The Simplex Method

ORF 307: Lecture 2. Linear Programming: Chapter 2 Simplex Methods

6.2: The Simplex Method: Maximization (with problem constraints of the form )

IP Cut Homework from J and B Chapter 9: 14, 15, 16, 23, 24, You wish to solve the IP below with a cutting plane technique.

1 Review Session. 1.1 Lecture 2

The Simplex Method. Lecture 5 Standard and Canonical Forms and Setting up the Tableau. Lecture 5 Slide 1. FOMGT 353 Introduction to Management Science

Chapter 5 Linear Programming (LP)

9.5 THE SIMPLEX METHOD: MIXED CONSTRAINTS

Ω R n is called the constraint set or feasible set. x 1

Part 1. The Review of Linear Programming

Linear programming. Saad Mneimneh. maximize x 1 + x 2 subject to 4x 1 x 2 8 2x 1 + x x 1 2x 2 2

Simplex tableau CE 377K. April 2, 2015

CO350 Linear Programming Chapter 6: The Simplex Method

Supplementary lecture notes on linear programming. We will present an algorithm to solve linear programs of the form. maximize.

Introduction to Mathematical Programming IE406. Lecture 10. Dr. Ted Ralphs

Linear Programming Redux

Lecture 5 Simplex Method. September 2, 2009

MATH 445/545 Homework 2: Due March 3rd, 2016

In Chapters 3 and 4 we introduced linear programming

Linear Programming: Simplex Algorithm. A function of several variables, f(x) issaidtobelinear if it satisþes the two

Week_4: simplex method II

Yinyu Ye, MS&E, Stanford MS&E310 Lecture Note #06. The Simplex Method

Linear Programming: Simplex Method CHAPTER The Simplex Tableau; Pivoting

ECE 307 Techniques for Engineering Decisions

Chap6 Duality Theory and Sensitivity Analysis

Lecture 2: The Simplex method. 1. Repetition of the geometrical simplex method. 2. Linear programming problems on standard form.

Water Resources Systems: Modeling Techniques and Analysis

Linear Programming Inverse Projection Theory Chapter 3

Properties of a Simple Variant of Klee-Minty s LP and Their Proof

Math Models of OR: Handling Upper Bounds in Simplex

CSC Design and Analysis of Algorithms. LP Shader Electronics Example

THE STEPS OF THE SIMPLEX ALGORITHM

Lecture 11: Post-Optimal Analysis. September 23, 2009

Sensitivity Analysis and Duality

The Graphical Method & Algebraic Technique for Solving LP s. Métodos Cuantitativos M. En C. Eduardo Bustos Farías 1

Section 4.1 Solving Systems of Linear Inequalities

Math Models of OR: Sensitivity Analysis

CPS 616 ITERATIVE IMPROVEMENTS 10-1

CO 250 Final Exam Guide

Part 1. The Review of Linear Programming

21. Solve the LP given in Exercise 19 using the big-m method discussed in Exercise 20.

x 1 + 4x 2 = 5, 7x 1 + 5x 2 + 2x 3 4,

LP Duality: outline. Duality theory for Linear Programming. alternatives. optimization I Idea: polyhedra

Integer Programming. The focus of this chapter is on solution techniques for integer programming models.

March 13, Duality 3

The Simplex Method: An Example

Operations Research Lecture 6: Integer Programming

Dr. Maddah ENMG 500 Engineering Management I 10/21/07

The Simplex Algorithm and Goal Programming

The Simplex Method of Linear Programming

Sensitivity Analysis

OPRE 6201 : 3. Special Cases

(includes both Phases I & II)

Discrete Optimization

An introductory example

Lecture 7 Duality II

Linear Programming and the Simplex method

MA 162: Finite Mathematics - Section 3.3/4.1

IE 400: Principles of Engineering Management. Simplex Method Continued

4.7 Sensitivity analysis in Linear Programming

Introduction to optimization

On the Number of Solutions Generated by the Simplex Method for LP

February 22, Introduction to the Simplex Algorithm

3 Development of the Simplex Method Constructing Basic Solution Optimality Conditions The Simplex Method...

Linear programs, convex polyhedra, extreme points

Non-Standard Constraints. Setting up Phase 1 Phase 2

Chapter 2: Linear Programming Basics. (Bertsimas & Tsitsiklis, Chapter 1)

Today s class. Constrained optimization Linear programming. Prof. Jinbo Bi CSE, UConn. Numerical Methods, Fall 2011 Lecture 12

Today: Linear Programming (con t.)

Foundations of Operations Research

An example of LP problem: Political Elections

Sensitivity Analysis and Duality in LP

Today: Linear Programming

III. Linear Programming

Week 3: Simplex Method I

(includes both Phases I & II)

Introduction to the Simplex Algorithm Active Learning Module 3

MATH2070 Optimisation

"SYMMETRIC" PRIMAL-DUAL PAIR

Linear Programming, Lecture 4

LP. Lecture 3. Chapter 3: degeneracy. degeneracy example cycling the lexicographic method other pivot rules the fundamental theorem of LP

CSCI 1951-G Optimization Methods in Finance Part 01: Linear Programming

4.4 The Simplex Method and the Standard Minimization Problem

Lecture 11 Linear programming : The Revised Simplex Method

Variants of Simplex Method

Optimization Methods in Management Science

4.6 Linear Programming duality

On the number of distinct solutions generated by the simplex method for LP

Introduction to Mathematical Programming IE406. Lecture 13. Dr. Ted Ralphs

Transcription:

: algebra CE 377K March 26, 2015

ANNOUNCEMENTS

Groups and project topics due soon Announcements

Groups and project topics due soon Did everyone get my test email? Announcements

REVIEW

geometry Review

geometry Extreme points Review

geometry Extreme points Brute force solution method Review

geometry Extreme points Brute force solution method More elegant solution method Review

OUTLINE

Expanding to problems with more decision variables Algebraic equivalent of geometric methods Standard form for linear programs Outline

We are heading towards the simplex method for solving linear programs. Rather than brute forcing through all of the extreme points, the simplex method moves along the boundary of the feasible region in downhill directions. Outline

To develop the simplex method, we need a standard form for linear programs. Outline

To develop the simplex method, we need a standard form for linear programs. The standard form expresses a linear program in the following way: The objective function is to be minimized All decision variables are required to be non-negative All other constraints are equalities Outline

min x 1,...,x n s.t. n c i x i i=1 n a i1 x i = b 1 i=1. n a im x i = b m i=1 x 1,..., x n 0 Outline

Sometimes we can transform a nonstandard linear program into standard form: Outline

Sometimes we can transform a nonstandard linear program into standard form: If the objective is to maximize f (x), we can just as well minimize f (x). Outline

What if there is a decision variable x which can be either positive or negative? Outline

What if there is a decision variable x which can be either positive or negative? We can replace x with two decision variables x + and x, and add two constraints: x + 0 x 0 Outline

What if there is a decision variable x which can be either positive or negative? We can replace x with two decision variables x + and x, and add two constraints: x + 0 x 0 By substituting x + x everywhere x appeared in the original formulation, we can express the problem in standard form. Outline

What if there is an inequality constraint of the form a 1 x 1 + a 2 x 2 + + a n x n b Outline

What if there is an inequality constraint of the form a 1 x 1 + a 2 x 2 + + a n x n b We can add a nonnegative slack variable s and rewrite the constraint as a 1 x 1 + a 2 x 2 + + a n x n + s = b (and s 0) Outline

What if there is an inequality constraint of the form a 1 x 1 + a 2 x 2 + + a n x n b We can add a nonnegative slack variable s and rewrite the constraint as a 1 x 1 + a 2 x 2 + + a n x n + s = b (and s 0) What would we do for a inequality constraint? Outline

Convert this problem into standard form : max (2100 1000τ 1 ) + (3000 1500τ 2 ) τ 1,τ 2 s.t. 2100 1000τ 1 2000 3000 1500τ 2 2000 τ 1 τ 2 0.25 τ 2 τ 1 0.25 0 τ 1, τ 2 1 Outline

min 1000τ 1 + 1500τ 2 5100 τ 1,τ 2,s 1,s 2,s 3,s 4,s 5,s 6 s.t. 2100 1000τ 1 + s 1 = 2000 3000 1500τ 2 + s 2 = 2000 τ 1 τ 2 + s 3 = 0.25 τ 2 τ 1 + s 4 = 0.25 τ 1 + s 5 = 1 τ 2 + s 6 = 1 τ 1, τ 2, s 1, s 2, s 3, s 4, s 5, s 6 0 Outline

EXTREME POINTS ALGEBRAICALLY

When there are n decision variables, an extreme point of the feasible region corresponds to the intersection of n constraints (if the intersection point is feasible). Extreme points algebraically

When there are n decision variables, an extreme point of the feasible region corresponds to the intersection of n constraints (if the intersection point is feasible). Since the equations are linear, it is easy to find these intersection points. Extreme points algebraically

Extreme points algebraically

Furthermore, adjacent extreme points have n 1 of the constraints in common. Extreme points algebraically

Furthermore, adjacent extreme points have n 1 of the constraints in common. A preview of the simplex method: find the intersection point of n constraints; then substitute constraints one at a time, moving to adjacent extreme points until the optimal solution is found. Extreme points algebraically

GENERAL ALGEBRAIC PROCESS

Assume that a standard-form LP has n decision variables and m equality constraints. General algebraic process

Assume that a standard-form LP has n decision variables and m equality constraints. It is safe to assume that n m. (Why?) General algebraic process

What does the intersection of n constraints look like? General algebraic process

What does the intersection of n constraints look like? Any feasible point must satisfy all m equality constraints, so n m of the nonnegativity constraints must be tight. General algebraic process

What does the intersection of n constraints look like? Any feasible point must satisfy all m equality constraints, so n m of the nonnegativity constraints must be tight. That is, n m of the decision variables must be zero, and the other m can take positive or zero values. General algebraic process

The m decision variables which take take positive or zero values are called basic variables or a basis, and the remaining n m decision variables are called nonbasic. General algebraic process

The m decision variables which take take positive or zero values are called basic variables or a basis, and the remaining n m decision variables are called nonbasic. We can identify the extreme point corresponding to a basis by solving m equations in m unknowns. General algebraic process

min 1000τ 1 + 1500τ 2 5100 τ 1,τ 2,s 1,s 2,s 3,s 4,s 5,s 6 s.t. 2100 1000τ 1 + s 1 = 2000 3000 1500τ 2 + s 2 = 2000 τ 1 τ 2 + s 3 = 0.25 τ 2 τ 1 + s 4 = 0.25 τ 1 + s 5 = 1 τ 2 + s 6 = 1 τ 1, τ 2, s 1, s 2, s 3, s 4, s 5, s 6 0 Choose τ 1, τ 2, s 1, s 2, s 3, s 4 as basic variables. General algebraic process

A basis is feasible if the solution to these m equations consists of nonnegative values. General algebraic process

min 1000τ 1 + 1500τ 2 5100 τ 1,τ 2,s 1,s 2,s 3,s 4,s 5,s 6 s.t. 2100 1000τ 1 + s 1 = 2000 3000 1500τ 2 + s 2 = 2000 τ 1 τ 2 + s 3 = 0.25 τ 2 τ 1 + s 4 = 0.25 τ 1 + s 5 = 1 τ 2 + s 6 = 1 τ 1, τ 2, s 1, s 2, s 3, s 4, s 5, s 6 0 Choose s 1, s 2, s 3, s 4, s 5, s 6 as basic variables. General algebraic process