Lecture 6 Simplex method for linear programming
|
|
- Roger Myron Farmer
- 6 years ago
- Views:
Transcription
1 Lecture 6 Simplex method for linear programming Weinan E 1,2 and Tiejun Li 2 1 Department of Mathematics, Princeton University, weinan@princeton.edu 2 School of Mathematical Sciences, Peking University, tieli@pku.edu.cn No.1 Science Building, 1575
2 Outline Examples and standard form Fundamental theorem Simplex algorithm
3 Example: Transportation problem Schematics of transportation problem a 1 C ij b 1 a 2 b 2 a m Origin b n 1 b n Destination
4 Example: Transportation problem Formulation: m n min s = i=1 j=1 c ijx ij subject to the constraint m x ij b j, j = 1,..., n i=1 n x ij a i, i = 1,..., m j=1 x ij 0, i = 1,..., m; j = 1,..., n. where a i is the supply of the i-th origin, b j is the demand of the j-th destinations, x ij is the amount of the shipment from source i to destination j and c ij is the unit transportation cost from i to j. Optimization problem (Simplex method)
5 Linear programming Definition: If the minimized (or maximized) function and the constraints are all in linear form a 1x 1 + a 2x a nx n + b. This type of optimization is called linear programming.
6 General form of constraints of linear programming The minimized function will always be min w = c T x (or max) x where c, x R n. There are 3 kinds of constraints in general: Type I: type constraint a i1 x 1 + a i2 x a in x n b i Type II: = type constraint a j1 x 1 + a j2 x a jn x n = b j Type III: type constraint a k1 x 1 + a k2 x a kn x n b k
7 Examples: general form Example 1: (type III) min w = 100x x x x 4 s.t. x 1 + 5x x x x i 0, i = 1, 2, 3, 4 Example 2: (type I) max w = 7x + 12y s.t. 9x + 4y 360 4x + 5y 200 3x + 10y 300 x 0, y 0 Example 3: (type II) min w = x 1 + 3x 2 + 4x 3 s.t. x 1 + 2x 2 + x 3 = 5 2x 1 + 3x 2 + x 3 = 6 x 2 0, x 3 0
8 Standard form of constraints Standard form a 11x 1 + a 12x a 1nx n = b 1. a m1x 1 + a m2x a mnx n = b m x i 0, i = 1,..., n where b i 0 (i = 1,..., m). In matrix form Constraints min w = c T x (or max) x s.t. Ax = b, x 0 where A R m n, x R n, b R m, rank(a) = m n (This is not essential.) and b i 0 (i = 1,..., m).
9 Example 1: standard form Example 1: (type III) min w = 100x x x x 4 s.t. x 1 + 5x x x x i 0, i = 1, 2, 3, 4 Introduce surplus variable ( ) x 5 0, then the constraint becomes the standard form x 1 + 5x x x 4 x 5 = x i 0, i = 1, 2, 3, 4, 5
10 Example 2: standard form Example 2: max w = 7x + 12y s.t. 9x + 4y 360 4x + 5y 200 3x + 10y 300 x 0, y 0 Introduce slack variable ( ) x 1, x 2, x 3 0 and let x 4 = x, x 5 = y, then the constraint becomes the standard form max w = 7x x 5 x 1 +9x 4 + 4x 5 = 360 x 2 +4x 4 + 5x 5 = 200 x 3 +3x x 5 = 300 x i 0, i = 1, 2,..., 5
11 Example 3: standard form Example 3: min w = x 1 + 3x 2 + 4x 3 s.t. x 1 + 2x 2 + x 3 = 5 2x 1 + 3x 2 + x 3 = 6 x 2 0, x 3 0 Deal with the free variable x 1: Solving x 1 from one equation and substitute it into others. x 1 = 5 2x 2 x 3 then min w = 5 + x 2 + 3x 3 s.t. x 2 + x 3 = 4 x 2 0, x 3 0
12 Remark If some of b i < 0 in the primitive form, we can time 1 to both sides at first and introduce the slack and surplus variables again.
13 Outline Examples and standard form Fundamental theorem Simplex algorithm
14 Definitions For the standard form, n is called dimension, m is called order, variables x satisfying constraints s.t. Ax = b, x 0 are called feasible solution. Suppose rank(a) = m, and the first m columns of A are linearly independent, i.e. B = (a 1, a 2,..., a m) is nonsingular, where a i = (a 1i, a 2i,, a mi). Then call B a basis. The linear system Bx B = b has unique solution x B = B 1 b. Define x = (x B, 0), then x satisfies Ax = b. x is called a basic solution (the other x i are 0) with respect to B.
15 Definitions If there is 0 among x B, it is called a degenerate basic solution. If a basic solution is also a feasible solution, it is called a basic feasible solution. x i corresponding to column indices in B are called basic variable. The others are called non-basic variables. The number of the basic feasible solutions is less than C m n = n! m!(n m)!
16 Example Linear programming max w = 10x x 2 3x 1 + 4x 2 + x 3 = 9 5x 1 + 2x 2 + x 4 = 8 x 1 2x 2 + x 5 = 1 x i 0, i = 1, 2, 3, 4, 5 Choose B = (a 3, a 4, a 5) = I 3 3, then B is a basis, x = (0, 0, 9, 8, 1) is a non-degenerate basic solution. It satisfies the constraint, thus is a basic feasible solution. x 3, x 4, x 5 are basic variables.
17 Example Linear programming max w = 10x x 2 3x 1 + 4x x 1 + 5x 2 16 x i 0, i = 1, 2 The set of all the feasible solutions are called feasible region feasible region This feasible region is a colorred convex polyhedron ( ) spanned by points x 1 = (0, 0), x 2 = (0, 16 5 ), x3 = (3, 2) and x4 = ( 17 3, 0).
18 Definitions A convex set S means for any x 1, x 2 S and λ [0, 1], then x = λx 1 + (1 λ)x 2 S. A non-convex set is shown below. Graphically, convex means any line segment x 1x 2 belongs to S if x 1, x 2 S. The vertices x 1 = (0, 0), x 2 = (0, 16 ),... are called extreme points 5 because there is no y 1, y 2 S, y 1 y 2 and 0 < λ < 1, such that x i = λy 1 + (1 λ)y 2.
19 Fundamental theorem Theorem (Fundamental theorem) Optimizing a linear objective function w = c T x is achieved at the extreme points in the feasible region colorblue if the feasible solution set is not empty and the optimum is finite. Z =C*X max Z min =C*X
20 Some basic theorems There are three cases for the feasible solutions of the standard form Empty set; Unbounded set; unbounded convex Bounded convex polyhedron. A point in the feasible solution set is a extreme point if and only if it is a basic feasible solution.
21 Outline Examples and standard form Fundamental theorem Simplex algorithm
22 Simplex method Simplex method is first proposed by G.B. Dantzig in Simply searching for all of the basic solution is not applicable because the whole number is Cn m. Basic idea of simplex: Give a rule to transfer from one extreme point to another such that the objective function is decreased. This rule must be easily implemented.
23 Canonical form First suppose the standard form is Ax = b, x 0 One canonical form is to transfer a coefficient submatrix into I m with Gaussian elimination. For example x = (x 1, x 2, x 3) and ( ) ( ) (A, b) = B = then it is a canonical form for x 1 and x 3. One extreme point is x = (4, 0, 1), x 1 and x 3 are basic variables.
24 Transfer Now suppose A is in canonical form as the last example, then we transfer from one basic solution to another. Choose a 2 to enter the basis and a 1 leave the basis. ( ) ( ) A = ( ) The canonical form for x 2 and x 3. The basic solution is x = (0, 2, 3). It is also a extreme point.
25 Transfer The transferred basic solution may be not feasible in general. 1. How to make the transferred basic solution feasible? 2. How to make the objective function decreasing after transfer?
26 How to make the transferred basic solution feasible? Assumption: All of the basic feasible solutions are non-degenerate. i.e. if x = (x 1, x 2,..., x m, 0,..., 0) is a basic feasible solution, then x i > 0. Suppose the basis is {a 1, a 2,..., a m} initially, and select a k (k > m) enter the basis. Suppose m a k = y ik a i i=1 then for any ɛ > 0 m ɛa k = ɛy ik a i i=1 x is a basic feasible solution m x ia i = b i=1
27 How to make the transferred basic solution feasible? We have m (x i ɛy ik )a i + ɛa k = b i=1 Because x i > 0, if ɛ > 0 is small enough, x = (x 1 ɛy 1k, x 2 ɛy 2k,..., x m ɛy mk, 0,..., 0, ɛ, 0,..., 0) is a feasible solution. To make it a basic solution we choose ɛ = min 1 i m { xi y ik yik > 0 } = xr y rk then x is a basic feasible solution, and let a r leave the basis. If y ik 0 for i = 1, 2,..., m, then for any ɛ > 0, x is feasible, thus the feasible region is unbounded in this case.
28 How to make the transferred basic solution feasible? Suppose n = 6 and the constraints (A, b) = One basis a 1, a 2, a 3, the basic feasible solution x = (4, 3, 1, 0, 0, 0) We want to choose a 4 enter the basis. The problem is to choose a i leave the basis. Compute x i y ik (k = 4) so let a 1 enter into basis. i x i y ik 2 3 The new basic solution for x 2, x 3, x 4 is x = (0, 1, 3, 2, 0, 0).
29 How to make the objective function decreasing after transfer? The aim is to choose k such that the objective function decreasing after a k enter the basis. Suppose the canonical form is n x i + y ijx j = y i0, i = 1, 2,..., m j=m+1 where y i0 > 0. The basic feasible solution x = (y 10, y 20,..., y m0, 0,..., 0) the value of objective function m z 0 = c T Bx B = c k y k0 k=1
30 How to make the objective function decreased after transfer? For any feasible solution x = (x 1,..., x m, x m+1,..., x n), we have z = = m n n c k (y k0 y kj x j) + c jx j k=1 m c k y k0 + k=1 = z 0 + j=m+1 j=m+1 n j=m+1 c jx j j=m+1 n n m (c j c k y kj )x j k=1 n = z 0 + (c j z j)x j j=m+1 j=m+1 k=1 m ( c k y kj )x j where z j = c T By j = m k=1 c ky kj. If there exists j (m + 1 j n) such that r j = c j z j < 0, then when x j change from 0 to positive, the objective function will be decreased.
31 Simplex strategy Optimality criterion: If r j 0 for all j, then it is a optimal feasible solution. Unbounded criterion: If for some k (r k < 0), we have y jk 0 (j = 1, 2,, m), then min z =. Otherwise: We can choose the vector a k (r k < 0) to enter the basis and the vector a j ( y j0 y y jk = min i0 i y ik, y ik > 0) leave the basis.
32 Example Example min z = (3x 1 + x 2 + 3x 3) x x 2 5, x Step 1: change into standard form x min z = (3x 1 + x 2 + 3x 3) x 1 x 2 x 3 x 4 x 5 x 6 2 = 5, xi 0, i = 1, 2,..., 6 6
33 Example Step 2: Choose x 4, x 5, x 6 as basic variables, and compute the test number r 1 = c 1 z 1 = 3, r 2 = c 2 z 2 = 1, r 3 = c 3 z 3 = 3. set up simplex tableau Basis a 1 a 2 a 3 a 4 a 5 a 6 b a a a r j z 0 = 0
34 Example Step 3: Choose vector to enter the basis. Because r j < 0, j = 1, 2, 3, any one among a 1, a 2, a 3 could enter the basis. We choose a 2 (in general, a 1 or a 3 will be chosen because 3 is smaller). Step 4: Choose vector to leave the basis. Compute y i0 y ik, y ik > 0, k = 2, i = 1, 2, 3, we have Thus a 4 leave the basis. y 10 y 12 = 2, y 20 y 22 = 2.5, y 30 y 32 = 3 Step 5: Perform Gaussian elimination to obtain a new canonical form for basis a 2, a 5, a 6 and set up simplex tableau. Basis a 1 a 2 a 3 a 4 a 5 a 6 b a a a r j z 0 = 2
35 Example Step 6: Choose vector to enter the basis. Because r j < 0, j = 1, 3, any one among a 1, a 3 could enter the basis. We choose a 3. Step 7: Choose vector to leave the basis. Compute y i0 y ik, y ik > 0, k = 3, i = 1, 2, 3, we have (y i3 > 0, i = 1, 2) Thus a 5 leave the basis. y 10 y 13 = 2, y 20 y 23 = 1 Step 8: Perform Gaussian elimination to obtain a new canonical form for basis a 2, a 3, a 6 and set up simplex tableau. Basis a 1 a 2 a 3 a 4 a 5 a 6 b a a a r j z 0 = 4
36 Example Step 9: Choose vector to enter the basis. Because r j < 0, j = 1, 4, any one among a 1, a 4 could enter the basis. We choose a 1. Step 10: Choose vector to leave the basis. Compute y i0 y ik, y ik > 0, k = 1, i = 1, 2, 3, we have (y i1 > 0, i = 1) Thus a 2 leave the basis. y 10 y 11 = 1 5 Step 11: Perform Gaussian elimination to obtain a new canonical form for basis a 1, a 3, a 6 and set up simplex tableau. Basis a 1 a 2 a 3 a 4 a 5 a 6 b a a a r j z 5 0 = 27 5
37 Example Step 9: Choose vector to enter the basis. Because r j > 0, j = 1, 3, 6, so we obtain the optimal solution z = 27, and the corresponding extreme 5 point is x = ( 1 5, 0, 8, 0, 0, 4) 5
38 Initial basic feasible solution two step method An auxiliary problem (y R m ) m min z = i=1 y i Ax + y = b x 0, y 0 The initial basic feasible solution is trivial (x, y) = (0, b) Theorem: If the optimal feasible solution of the auxiliary problem is (x, 0), then x is a basic feasible solution of the primitive problem; if the optimal feasible solution of the auxiliary problem is (x, y ), y 0, then there is no feasible solution for the primitive problem.
39 What about the degenerate basic feasible solution? In general, the strategy of leaving and entering basis is chosen as 1. If more than one index j such that r j < 0, let 2. If choose a k to enter the basis; r k = min{r j r j < 0} { yi0 } min yik > 0 = yr 10 = = yr t0 y ik y r1 k y rt k and r 1 < < r t, then choose a r1 to leave the basis. For degenerate case, cycling will appear for this strategy!
40 What about the degenerate basic feasible solution? Bland s method: Change the strategy of leaving and entering basis into 1. If more than one index j such that r j < 0, let 2. If choose a k to enter the basis; k = min{j r j < 0} { yi0 } min yik > 0 = yr 10 = = yr t0 y ik y r1 k y rt k and r 1 < < r t, then choose a r1 to leave the basis (the same as before). Bland s method could eliminate the cycling, but it needs more computational effort.
41 Comment on simplex method In 1972, V. Klee and G. Minty constructed a linear programming problem which need O(2 n ) simplex steps! This shows simplex method is not a polynomial method. The first polynomial-time LP algorithm was devised by L. Khachian (USSR) in His ellipsoid method is O(n 6 ). Though his method is faster than simplex method theoretically, real implementations show counter results. In 1984, N. Karmarkar announced a polynomial-time LP method which is O(n 3.5 ). This begins the interior point revolution. Interior point method was faster than simplex for some very large problems, the reverse is true for some problems, and the two approaches are more or less comparable on others.
42 References G. Hadley, Linear programming, Addison-Wesley Publishing Company, Y. Ye, Interior point algorithms, theory and analysis, John Wiley & Sons, New York, 1997.
Linear and Integer Programming - ideas
Linear and Integer Programming - ideas Paweł Zieliński Institute of Mathematics and Computer Science, Wrocław University of Technology, Poland http://www.im.pwr.wroc.pl/ pziel/ Toulouse, France 2012 Literature
More information4.5 Simplex method. LP in standard form: min z = c T x s.t. Ax = b
4.5 Simplex method LP in standard form: min z = c T x s.t. Ax = b x 0 George Dantzig (1914-2005) Examine a sequence of basic feasible solutions with non increasing objective function values until an optimal
More informationCSCI 1951-G Optimization Methods in Finance Part 01: Linear Programming
CSCI 1951-G Optimization Methods in Finance Part 01: Linear Programming January 26, 2018 1 / 38 Liability/asset cash-flow matching problem Recall the formulation of the problem: max w c 1 + p 1 e 1 = 150
More informationLecture 2: The Simplex method
Lecture 2 1 Linear and Combinatorial Optimization Lecture 2: The Simplex method Basic solution. The Simplex method (standardform, b>0). 1. Repetition of basic solution. 2. One step in the Simplex algorithm.
More informationOPERATIONS RESEARCH. Linear Programming Problem
OPERATIONS RESEARCH Chapter 1 Linear Programming Problem Prof. Bibhas C. Giri Department of Mathematics Jadavpur University Kolkata, India Email: bcgiri.jumath@gmail.com MODULE - 2: Simplex Method for
More information9.1 Linear Programs in canonical form
9.1 Linear Programs in canonical form LP in standard form: max (LP) s.t. where b i R, i = 1,..., m z = j c jx j j a ijx j b i i = 1,..., m x j 0 j = 1,..., n But the Simplex method works only on systems
More informationLinear Programming and the Simplex method
Linear Programming and the Simplex method Harald Enzinger, Michael Rath Signal Processing and Speech Communication Laboratory Jan 9, 2012 Harald Enzinger, Michael Rath Jan 9, 2012 page 1/37 Outline Introduction
More informationOptimization (168) Lecture 7-8-9
Optimization (168) Lecture 7-8-9 Jesús De Loera UC Davis, Mathematics Wednesday, April 2, 2012 1 DEGENERACY IN THE SIMPLEX METHOD 2 DEGENERACY z =2x 1 x 2 + 8x 3 x 4 =1 2x 3 x 5 =3 2x 1 + 4x 2 6x 3 x 6
More informationTHE UNIVERSITY OF HONG KONG DEPARTMENT OF MATHEMATICS. Operations Research I
LN/MATH2901/CKC/MS/2008-09 THE UNIVERSITY OF HONG KONG DEPARTMENT OF MATHEMATICS Operations Research I Definition (Linear Programming) A linear programming (LP) problem is characterized by linear functions
More informationThe Simplex Algorithm
8.433 Combinatorial Optimization The Simplex Algorithm October 6, 8 Lecturer: Santosh Vempala We proved the following: Lemma (Farkas). Let A R m n, b R m. Exactly one of the following conditions is true:.
More information4.5 Simplex method. min z = c T x s.v. Ax = b. LP in standard form
4.5 Simplex method min z = c T x s.v. Ax = b x 0 LP in standard form Examine a sequence of basic feasible solutions with non increasing objective function value until an optimal solution is reached or
More informationMath 273a: Optimization The Simplex method
Math 273a: Optimization The Simplex method Instructor: Wotao Yin Department of Mathematics, UCLA Fall 2015 material taken from the textbook Chong-Zak, 4th Ed. Overview: idea and approach If a standard-form
More informationOptimization WS 13/14:, by Y. Goldstein/K. Reinert, 9. Dezember 2013, 16: Linear programming. Optimization Problems
Optimization WS 13/14:, by Y. Goldstein/K. Reinert, 9. Dezember 2013, 16:38 2001 Linear programming Optimization Problems General optimization problem max{z(x) f j (x) 0,x D} or min{z(x) f j (x) 0,x D}
More informationLINEAR PROGRAMMING. Relation to the Text (cont.) Relation to Material in Text. Relation to the Text. Relation to the Text (cont.
LINEAR PROGRAMMING Relation to Material in Text After a brief introduction to linear programming on p. 3, Cornuejols and Tϋtϋncϋ give a theoretical discussion including duality, and the simplex solution
More information3 The Simplex Method. 3.1 Basic Solutions
3 The Simplex Method 3.1 Basic Solutions In the LP of Example 2.3, the optimal solution happened to lie at an extreme point of the feasible set. This was not a coincidence. Consider an LP in general form,
More informationOptimization methods NOPT048
Optimization methods NOPT048 Jirka Fink https://ktiml.mff.cuni.cz/ fink/ Department of Theoretical Computer Science and Mathematical Logic Faculty of Mathematics and Physics Charles University in Prague
More informationmin 4x 1 5x 2 + 3x 3 s.t. x 1 + 2x 2 + x 3 = 10 x 1 x 2 6 x 1 + 3x 2 + x 3 14
The exam is three hours long and consists of 4 exercises. The exam is graded on a scale 0-25 points, and the points assigned to each question are indicated in parenthesis within the text. If necessary,
More informationLinear Programming. Murti V. Salapaka Electrical Engineering Department University Of Minnesota, Twin Cities
Linear Programming Murti V Salapaka Electrical Engineering Department University Of Minnesota, Twin Cities murtis@umnedu September 4, 2012 Linear Programming 1 The standard Linear Programming (SLP) problem:
More informationLecture 10 Polynomial interpolation
Lecture 10 Polynomial interpolation Weinan E 1,2 and Tiejun Li 2 1 Department of Mathematics, Princeton University, weinan@princeton.edu 2 School of Mathematical Sciences, Peking University, tieli@pku.edu.cn
More informationLecture 2: The Simplex method. 1. Repetition of the geometrical simplex method. 2. Linear programming problems on standard form.
Lecture 2: The Simplex method. Repetition of the geometrical simplex method. 2. Linear programming problems on standard form. 3. The Simplex algorithm. 4. How to find an initial basic solution. Lecture
More informationMATH 445/545 Test 1 Spring 2016
MATH 445/545 Test Spring 06 Note the problems are separated into two sections a set for all students and an additional set for those taking the course at the 545 level. Please read and follow all of these
More informationIE 5531: Engineering Optimization I
IE 5531: Engineering Optimization I Lecture 5: The Simplex method, continued Prof. John Gunnar Carlsson September 22, 2010 Prof. John Gunnar Carlsson IE 5531: Engineering Optimization I September 22, 2010
More informationLinear programs, convex polyhedra, extreme points
MVE165/MMG631 Extreme points of convex polyhedra; reformulations; basic feasible solutions; the simplex method Ann-Brith Strömberg 2015 03 27 Linear programs, convex polyhedra, extreme points A linear
More informationMATHEMATICAL PROGRAMMING I
MATHEMATICAL PROGRAMMING I Books There is no single course text, but there are many useful books, some more mathematical, others written at a more applied level. A selection is as follows: Bazaraa, Jarvis
More informationYinyu Ye, MS&E, Stanford MS&E310 Lecture Note #06. The Simplex Method
The Simplex Method Yinyu Ye Department of Management Science and Engineering Stanford University Stanford, CA 94305, U.S.A. http://www.stanford.edu/ yyye (LY, Chapters 2.3-2.5, 3.1-3.4) 1 Geometry of Linear
More information1 Overview. 2 Extreme Points. AM 221: Advanced Optimization Spring 2016
AM 22: Advanced Optimization Spring 206 Prof. Yaron Singer Lecture 7 February 7th Overview In the previous lectures we saw applications of duality to game theory and later to learning theory. In this lecture
More informationDeveloping an Algorithm for LP Preamble to Section 3 (Simplex Method)
Moving from BFS to BFS Developing an Algorithm for LP Preamble to Section (Simplex Method) We consider LP given in standard form and let x 0 be a BFS. Let B ; B ; :::; B m be the columns of A corresponding
More informationLinear Programming, Lecture 4
Linear Programming, Lecture 4 Corbett Redden October 3, 2016 Simplex Form Conventions Examples Simplex Method To run the simplex method, we start from a Linear Program (LP) in the following standard simplex
More informationSimplex Algorithm Using Canonical Tableaus
41 Simplex Algorithm Using Canonical Tableaus Consider LP in standard form: Min z = cx + α subject to Ax = b where A m n has rank m and α is a constant In tableau form we record it as below Original Tableau
More informationOptimization methods NOPT048
Optimization methods NOPT048 Jirka Fink https://ktiml.mff.cuni.cz/ fink/ Department of Theoretical Computer Science and Mathematical Logic Faculty of Mathematics and Physics Charles University in Prague
More informationNotes taken by Graham Taylor. January 22, 2005
CSC4 - Linear Programming and Combinatorial Optimization Lecture : Different forms of LP. The algebraic objects behind LP. Basic Feasible Solutions Notes taken by Graham Taylor January, 5 Summary: We first
More informationTIM 206 Lecture 3: The Simplex Method
TIM 206 Lecture 3: The Simplex Method Kevin Ross. Scribe: Shane Brennan (2006) September 29, 2011 1 Basic Feasible Solutions Have equation Ax = b contain more columns (variables) than rows (constraints),
More informationLecture Simplex Issues: Number of Pivots. ORIE 6300 Mathematical Programming I October 9, 2014
ORIE 6300 Mathematical Programming I October 9, 2014 Lecturer: David P. Williamson Lecture 14 Scribe: Calvin Wylie 1 Simplex Issues: Number of Pivots Question: How many pivots does the simplex algorithm
More informationMotivating examples Introduction to algorithms Simplex algorithm. On a particular example General algorithm. Duality An application to game theory
Instructor: Shengyu Zhang 1 LP Motivating examples Introduction to algorithms Simplex algorithm On a particular example General algorithm Duality An application to game theory 2 Example 1: profit maximization
More informationIII. Linear Programming
III. Linear Programming Thomas Sauerwald Easter 2017 Outline Introduction Standard and Slack Forms Formulating Problems as Linear Programs Simplex Algorithm Finding an Initial Solution III. Linear Programming
More informationLinear Programming. (Com S 477/577 Notes) Yan-Bin Jia. Nov 28, 2017
Linear Programming (Com S 4/ Notes) Yan-Bin Jia Nov 8, Introduction Many problems can be formulated as maximizing or minimizing an objective in the form of a linear function given a set of linear constraints
More information1 Review Session. 1.1 Lecture 2
1 Review Session Note: The following lists give an overview of the material that was covered in the lectures and sections. Your TF will go through these lists. If anything is unclear or you have questions
More informationOperations Research Lecture 2: Linear Programming Simplex Method
Operations Research Lecture 2: Linear Programming Simplex Method Notes taken by Kaiquan Xu@Business School, Nanjing University Mar 10th 2016 1 Geometry of LP 1.1 Graphical Representation and Solution Example
More informationIntroduction to Operations Research
Introduction to Operations Research (Week 4: Linear Programming: More on Simplex and Post-Optimality) José Rui Figueira Instituto Superior Técnico Universidade de Lisboa (figueira@tecnico.ulisboa.pt) March
More informationAnswer the following questions: Q1: Choose the correct answer ( 20 Points ):
Benha University Final Exam. (ختلفات) Class: 2 rd Year Students Subject: Operations Research Faculty of Computers & Informatics Date: - / 5 / 2017 Time: 3 hours Examiner: Dr. El-Sayed Badr Answer the following
More informationPart 1. The Review of Linear Programming
In the name of God Part 1. The Review of Linear Programming 1.2. Spring 2010 Instructor: Dr. Masoud Yaghini Outline Introduction Basic Feasible Solutions Key to the Algebra of the The Simplex Algorithm
More informationThe Simplex Method. Lecture 5 Standard and Canonical Forms and Setting up the Tableau. Lecture 5 Slide 1. FOMGT 353 Introduction to Management Science
The Simplex Method Lecture 5 Standard and Canonical Forms and Setting up the Tableau Lecture 5 Slide 1 The Simplex Method Formulate Constrained Maximization or Minimization Problem Convert to Standard
More informationCS711008Z Algorithm Design and Analysis
CS711008Z Algorithm Design and Analysis Lecture 8 Linear programming: interior point method Dongbo Bu Institute of Computing Technology Chinese Academy of Sciences, Beijing, China 1 / 31 Outline Brief
More informationLinear Programming. Linear Programming I. Lecture 1. Linear Programming. Linear Programming
Linear Programming Linear Programming Lecture Linear programming. Optimize a linear function subject to linear inequalities. (P) max " c j x j n j= n s. t. " a ij x j = b i # i # m j= x j 0 # j # n (P)
More information3. THE SIMPLEX ALGORITHM
Optimization. THE SIMPLEX ALGORITHM DPK Easter Term. Introduction We know that, if a linear programming problem has a finite optimal solution, it has an optimal solution at a basic feasible solution (b.f.s.).
More informationNote 3: LP Duality. If the primal problem (P) in the canonical form is min Z = n (1) then the dual problem (D) in the canonical form is max W = m (2)
Note 3: LP Duality If the primal problem (P) in the canonical form is min Z = n j=1 c j x j s.t. nj=1 a ij x j b i i = 1, 2,..., m (1) x j 0 j = 1, 2,..., n, then the dual problem (D) in the canonical
More informationPolynomiality of Linear Programming
Chapter 10 Polynomiality of Linear Programming In the previous section, we presented the Simplex Method. This method turns out to be very efficient for solving linear programmes in practice. While it is
More informationCSCI5654 (Linear Programming, Fall 2013) Lecture-8. Lecture 8 Slide# 1
CSCI5654 (Linear Programming, Fall 2013) Lecture-8 Lecture 8 Slide# 1 Today s Lecture 1. Recap of dual variables and strong duality. 2. Complementary Slackness Theorem. 3. Interpretation of dual variables.
More informationORF 522. Linear Programming and Convex Analysis
ORF 522 Linear Programming and Convex Analysis The Simplex Method Marco Cuturi Princeton ORF-522 1 Reminder: Basic Feasible Solutions, Extreme points, Optima Some important theorems last time for standard
More informationSummary of the simplex method
MVE165/MMG630, The simplex method; degeneracy; unbounded solutions; infeasibility; starting solutions; duality; interpretation Ann-Brith Strömberg 2012 03 16 Summary of the simplex method Optimality condition:
More informationInteger programming: an introduction. Alessandro Astolfi
Integer programming: an introduction Alessandro Astolfi Outline Introduction Examples Methods for solving ILP Optimization on graphs LP problems with integer solutions Summary Introduction Integer programming
More informationChapter 2: Linear Programming Basics. (Bertsimas & Tsitsiklis, Chapter 1)
Chapter 2: Linear Programming Basics (Bertsimas & Tsitsiklis, Chapter 1) 33 Example of a Linear Program Remarks. minimize 2x 1 x 2 + 4x 3 subject to x 1 + x 2 + x 4 2 3x 2 x 3 = 5 x 3 + x 4 3 x 1 0 x 3
More information1 date: February 23, 1998 le: papar1. coecient pivoting rule. a particular form of the simplex algorithm.
1 date: February 23, 1998 le: papar1 KLEE - MINTY EAMPLES FOR (LP) Abstract : The problem of determining the worst case behavior of the simplex algorithm remained an outstanding open problem for more than
More information3. Linear Programming and Polyhedral Combinatorics
Massachusetts Institute of Technology 18.433: Combinatorial Optimization Michel X. Goemans February 28th, 2013 3. Linear Programming and Polyhedral Combinatorics Summary of what was seen in the introductory
More informationThe Simplex Algorithm: Technicalities 1
1/45 The Simplex Algorithm: Technicalities 1 Adrian Vetta 1 This presentation is based upon the book Linear Programming by Vasek Chvatal 2/45 Two Issues Here we discuss two potential problems with the
More informationCO 602/CM 740: Fundamentals of Optimization Problem Set 4
CO 602/CM 740: Fundamentals of Optimization Problem Set 4 H. Wolkowicz Fall 2014. Handed out: Wednesday 2014-Oct-15. Due: Wednesday 2014-Oct-22 in class before lecture starts. Contents 1 Unique Optimum
More informationAM 121: Intro to Optimization
AM 121: Intro to Optimization Models and Methods Lecture 6: Phase I, degeneracy, smallest subscript rule. Yiling Chen SEAS Lesson Plan Phase 1 (initialization) Degeneracy and cycling Smallest subscript
More information3. Linear Programming and Polyhedral Combinatorics
Massachusetts Institute of Technology 18.453: Combinatorial Optimization Michel X. Goemans April 5, 2017 3. Linear Programming and Polyhedral Combinatorics Summary of what was seen in the introductory
More informationOptimisation and Operations Research
Optimisation and Operations Research Lecture 22: Linear Programming Revisited Matthew Roughan http://www.maths.adelaide.edu.au/matthew.roughan/ Lecture_notes/OORII/ School
More informationDistributed Real-Time Control Systems. Lecture Distributed Control Linear Programming
Distributed Real-Time Control Systems Lecture 13-14 Distributed Control Linear Programming 1 Linear Programs Optimize a linear function subject to a set of linear (affine) constraints. Many problems can
More informationIE 5531: Engineering Optimization I
IE 5531: Engineering Optimization I Lecture 3: Linear Programming, Continued Prof. John Gunnar Carlsson September 15, 2010 Prof. John Gunnar Carlsson IE 5531: Engineering Optimization I September 15, 2010
More informationCSC Design and Analysis of Algorithms. LP Shader Electronics Example
CSC 80- Design and Analysis of Algorithms Lecture (LP) LP Shader Electronics Example The Shader Electronics Company produces two products:.eclipse, a portable touchscreen digital player; it takes hours
More informationLecture: Algorithms for LP, SOCP and SDP
1/53 Lecture: Algorithms for LP, SOCP and SDP Zaiwen Wen Beijing International Center For Mathematical Research Peking University http://bicmr.pku.edu.cn/~wenzw/bigdata2018.html wenzw@pku.edu.cn Acknowledgement:
More informationCOMPUTATIONAL COMPLEXITY OF PARAMETRIC LINEAR PROGRAMMING +
Mathematical Programming 19 (1980) 213-219. North-Holland Publishing Company COMPUTATIONAL COMPLEXITY OF PARAMETRIC LINEAR PROGRAMMING + Katta G. MURTY The University of Michigan, Ann Arbor, MI, U.S.A.
More informationMath 5593 Linear Programming Week 1
University of Colorado Denver, Fall 2013, Prof. Engau 1 Problem-Solving in Operations Research 2 Brief History of Linear Programming 3 Review of Basic Linear Algebra Linear Programming - The Story About
More informationChapter 1: Linear Programming
Chapter 1: Linear Programming Math 368 c Copyright 2013 R Clark Robinson May 22, 2013 Chapter 1: Linear Programming 1 Max and Min For f : D R n R, f (D) = {f (x) : x D } is set of attainable values of
More informationStandard Form An LP is in standard form when: All variables are non-negativenegative All constraints are equalities Putting an LP formulation into sta
Chapter 4 Linear Programming: The Simplex Method An Overview of the Simplex Method Standard Form Tableau Form Setting Up the Initial Simplex Tableau Improving the Solution Calculating the Next Tableau
More informationLinear Programming. Chapter Introduction
Chapter 3 Linear Programming Linear programs (LP) play an important role in the theory and practice of optimization problems. Many COPs can directly be formulated as LPs. Furthermore, LPs are invaluable
More informationAlgorithms and Theory of Computation. Lecture 13: Linear Programming (2)
Algorithms and Theory of Computation Lecture 13: Linear Programming (2) Xiaohui Bei MAS 714 September 25, 2018 Nanyang Technological University MAS 714 September 25, 2018 1 / 15 LP Duality Primal problem
More informationMATH 445/545 Homework 2: Due March 3rd, 2016
MATH 445/545 Homework 2: Due March 3rd, 216 Answer the following questions. Please include the question with the solution (write or type them out doing this will help you digest the problem). I do not
More informationLecture 1 Introduction
L. Vandenberghe EE236A (Fall 2013-14) Lecture 1 Introduction course overview linear optimization examples history approximate syllabus basic definitions linear optimization in vector and matrix notation
More informationOperations Research. Duality in linear programming.
Operations Research Duality in linear programming Duality in linear programming As we have seen in past lessons, linear programming are either maximization or minimization type, containing m conditions
More informationSummary of the simplex method
MVE165/MMG631,Linear and integer optimization with applications The simplex method: degeneracy; unbounded solutions; starting solutions; infeasibility; alternative optimal solutions Ann-Brith Strömberg
More informationCSC373: Algorithm Design, Analysis and Complexity Fall 2017 DENIS PANKRATOV NOVEMBER 1, 2017
CSC373: Algorithm Design, Analysis and Complexity Fall 2017 DENIS PANKRATOV NOVEMBER 1, 2017 Linear Function f: R n R is linear if it can be written as f x = a T x for some a R n Example: f x 1, x 2 =
More information3. Vector spaces 3.1 Linear dependence and independence 3.2 Basis and dimension. 5. Extreme points and basic feasible solutions
A. LINEAR ALGEBRA. CONVEX SETS 1. Matrices and vectors 1.1 Matrix operations 1.2 The rank of a matrix 2. Systems of linear equations 2.1 Basic solutions 3. Vector spaces 3.1 Linear dependence and independence
More informationLINEAR PROGRAMMING I. a refreshing example standard form fundamental questions geometry linear algebra simplex algorithm
Linear programming Linear programming. Optimize a linear function subject to linear inequalities. (P) max c j x j n j= n s. t. a ij x j = b i i m j= x j 0 j n (P) max c T x s. t. Ax = b Lecture slides
More informationFundamental Theorems of Optimization
Fundamental Theorems of Optimization 1 Fundamental Theorems of Math Prog. Maximizing a concave function over a convex set. Maximizing a convex function over a closed bounded convex set. 2 Maximizing Concave
More informationBrief summary of linear programming and duality: Consider the linear program in standard form. (P ) min z = cx. x 0. (D) max yb. z = c B x B + c N x N
Brief summary of linear programming and duality: Consider the linear program in standard form (P ) min z = cx s.t. Ax = b x 0 where A R m n, c R 1 n, x R n 1, b R m 1,and its dual (D) max yb s.t. ya c.
More informationLinear Programming. Leo Liberti. LIX, École Polytechnique. Operations research courses / LP theory p.
Operations research courses / LP theory p. 1/47 Linear Programming Leo Liberti LIX, École Polytechnique liberti@lix.polytechnique.fr Operations research courses / LP theory p. 2/47 Contents LP formulations
More informationLP. Lecture 3. Chapter 3: degeneracy. degeneracy example cycling the lexicographic method other pivot rules the fundamental theorem of LP
LP. Lecture 3. Chapter 3: degeneracy. degeneracy example cycling the lexicographic method other pivot rules the fundamental theorem of LP 1 / 23 Repetition the simplex algorithm: sequence of pivots starting
More informationLinear and Integer Optimization (V3C1/F4C1)
Linear and Integer Optimization (V3C1/F4C1) Lecture notes Ulrich Brenner Research Institute for Discrete Mathematics, University of Bonn Winter term 2016/2017 March 8, 2017 12:02 1 Preface Continuous updates
More informationLecture slides by Kevin Wayne
LINEAR PROGRAMMING I a refreshing example standard form fundamental questions geometry linear algebra simplex algorithm Lecture slides by Kevin Wayne Last updated on 7/25/17 11:09 AM Linear programming
More information1 The linear algebra of linear programs (March 15 and 22, 2015)
1 The linear algebra of linear programs (March 15 and 22, 2015) Many optimization problems can be formulated as linear programs. The main features of a linear program are the following: Variables are real
More informationMATH2070 Optimisation
MATH2070 Optimisation Linear Programming Semester 2, 2012 Lecturer: I.W. Guo Lecture slides courtesy of J.R. Wishart Review The standard Linear Programming (LP) Problem Graphical method of solving LP problem
More informationLecture 8: Column Generation
Lecture 8: Column Generation (3 units) Outline Cutting stock problem Classical IP formulation Set covering formulation Column generation A dual perspective 1 / 24 Cutting stock problem 2 / 24 Problem description
More informationMVE165/MMG631 Linear and integer optimization with applications Lecture 5 Linear programming duality and sensitivity analysis
MVE165/MMG631 Linear and integer optimization with applications Lecture 5 Linear programming duality and sensitivity analysis Ann-Brith Strömberg 2017 03 29 Lecture 4 Linear and integer optimization with
More informationCOT 6936: Topics in Algorithms! Giri Narasimhan. ECS 254A / EC 2443; Phone: x3748
COT 6936: Topics in Algorithms! Giri Narasimhan ECS 254A / EC 2443; Phone: x3748 giri@cs.fiu.edu https://moodle.cis.fiu.edu/v2.1/course/view.php?id=612 Gaussian Elimination! Solving a system of simultaneous
More informationA Strongly Polynomial Simplex Method for Totally Unimodular LP
A Strongly Polynomial Simplex Method for Totally Unimodular LP Shinji Mizuno July 19, 2014 Abstract Kitahara and Mizuno get new bounds for the number of distinct solutions generated by the simplex method
More informationLecture 8: Column Generation
Lecture 8: Column Generation (3 units) Outline Cutting stock problem Classical IP formulation Set covering formulation Column generation A dual perspective Vehicle routing problem 1 / 33 Cutting stock
More information15-780: LinearProgramming
15-780: LinearProgramming J. Zico Kolter February 1-3, 2016 1 Outline Introduction Some linear algebra review Linear programming Simplex algorithm Duality and dual simplex 2 Outline Introduction Some linear
More informationNumerical Optimization
Linear Programming Computer Science and Automation Indian Institute of Science Bangalore 560 012, India. NPTEL Course on min x s.t. Transportation Problem ij c ijx ij 3 j=1 x ij a i, i = 1, 2 2 i=1 x ij
More informationLinear Programming. 1 An Introduction to Linear Programming
18.415/6.854 Advanced Algorithms October 1994 Lecturer: Michel X. Goemans Linear Programming 1 An Introduction to Linear Programming Linear programming is a very important class of problems, both algorithmically
More informationII. Analysis of Linear Programming Solutions
Optimization Methods Draft of August 26, 2005 II. Analysis of Linear Programming Solutions Robert Fourer Department of Industrial Engineering and Management Sciences Northwestern University Evanston, Illinois
More informationPrelude to the Simplex Algorithm. The Algebraic Approach The search for extreme point solutions.
Prelude to the Simplex Algorithm The Algebraic Approach The search for extreme point solutions. 1 Linear Programming-1 x 2 12 8 (4,8) Max z = 6x 1 + 4x 2 Subj. to: x 1 + x 2
More informationThe Simplex Method for Solving a Linear Program Prof. Stephen Graves
The Simplex Method for Solving a Linear Program Prof. Stephen Graves Observations from Geometry feasible region is a convex polyhedron an optimum occurs at a corner point possible algorithm - search over
More informationLinear Programming. Leo Liberti. February 20, Abstract
Linear Programming Leo Liberti LIX, École Polytechnique, F-91128 Palaiseau, France (liberti@lix.polytechnique.fr) February 20, 2006 Abstract This paper is a short didactical introduction to Linear Programming
More informationBBM402-Lecture 20: LP Duality
BBM402-Lecture 20: LP Duality Lecturer: Lale Özkahya Resources for the presentation: https://courses.engr.illinois.edu/cs473/fa2016/lectures.html An easy LP? which is compact form for max cx subject to
More informationExample Problem. Linear Program (standard form) CSCI5654 (Linear Programming, Fall 2013) Lecture-7. Duality
CSCI5654 (Linear Programming, Fall 013) Lecture-7 Duality Lecture 7 Slide# 1 Lecture 7 Slide# Linear Program (standard form) Example Problem maximize c 1 x 1 + + c n x n s.t. a j1 x 1 + + a jn x n b j
More informationMath 341: Convex Geometry. Xi Chen
Math 341: Convex Geometry Xi Chen 479 Central Academic Building, University of Alberta, Edmonton, Alberta T6G 2G1, CANADA E-mail address: xichen@math.ualberta.ca CHAPTER 1 Basics 1. Euclidean Geometry
More informationLecture 1 Numerical methods: principles, algorithms and applications: an introduction
Lecture 1 Numerical methods: principles, algorithms and applications: an introduction Weinan E 1,2 and Tiejun Li 2 1 Department of Mathematics, Princeton University, weinan@princeton.edu 2 School of Mathematical
More information