Simplex Method for LP (II)
|
|
- Osborn Garrison
- 6 years ago
- Views:
Transcription
1 Simplex Method for LP (II) Xiaoxi Li Wuhan University Sept. 27, 2017 (week 4) Operations Research (Li, X.) Simplex Method for LP (II) Sept. 27, 2017 (week 4) 1 / 31
2 Organization of this lecture Contents: Tie for entering/leaving variable Unbounded objective z Multiple optimal solutions "=" or " " constraint: the artificial-variable technique and the Big-M method Negative variables allowed The Two-Phase method for the artificial-variable technique Operations Research (Li, X.) Simplex Method for LP (II) Sept. 27, 2017 (week 4) 2 / 31
3 Tie for the entering or leaving variable When there is a tie for determining the entering or the leaving variable, just choose one arbitrarily. For an example: Eq. Basic variables z x 1 x 2 s 1 s 2 s 3 RHS (0) z (1) s (2) s (3) s It is possible to choose either x 1 or x 2 as the entering variable. They will lead to different optimal solution paths. Operations Research (Li, X.) Simplex Method for LP (II) Sept. 27, 2017 (week 4) 3 / 31
4 No leaving variable: unbounded objective z For an example: Eq. Basic variables z x 1 x 2 s 1 s 2 RHS (0) z (1) s (2) s Every coefficient in the pivot column is either zero or negative. Then the entering variable x 2 can be increased infinitely large (while x 1 = 0): { x 1 + 0x 2 + s 1 = 4 = s 1 = 4 0 3x 1 2x 2 + s 2 = 6 = 2x 2 = s As x 2 increases while keeping x 1 = 0, the objective z tends to infinity. Operations Research (Li, X.) Simplex Method for LP (II) Sept. 27, 2017 (week 4) 4 / 31
5 Multiple optimal solutions. It is possible for us to use the simplex method to identify all the CPF solutions if there are multiple. Then, by taking convex combinations of the CPF solutions, we obtain all the optimal solutions. When there are multiple optimal solutions, at least one of the nonbasic variables s i has a zero coefficient in the final Eq. (0). Increasing such variable s i will not increase the objective z, thus it is possible to leave the supporting hyperplane "s i = 0" to arrive at an adjacent CPF optimal solution (having the same z value). Operations Research (Li, X.) Simplex Method for LP (II) Sept. 27, 2017 (week 4) 5 / 31
6 For an example: Max z = 3x 1 + 2x 2, Initialization: Eq. Basic variables z x 1 x 2 s 1 s 2 s 3 RHS Optimal? (0) z NO (1) s (2) s (3) s The pivot number: 1. Operations Research (Li, X.) Simplex Method for LP (II) Sept. 27, 2017 (week 4) 6 / 31
7 Iteration 1: Eq. Basic variables z x 1 x 2 s 1 s 2 s 3 RHS Optimal? (0) z NO (1) x (2) s (3) s Iteration 2: Eq. Basic variables z x 1 x 2 s 1 s 2 s 3 RHS Optimal? (0) z Yes (1) x (2) s (3) x /2 0 1/2 3 Optimality Test: after Iteration 2, s 1,s 3 are nonbasic variables, and their coefficients in Eq. (0) are respectively 0 and 1. = (4,3,0,6,0) is an optimal solution. Operations Research (Li, X.) Simplex Method for LP (II) Sept. 27, 2017 (week 4) 7 / 31
8 The coefficient for the nonbasic variable s 1 in Eq. (0) is 0, thus it is possible to find another BF optimal solution following an Extra Iteration: Eq. Basic variables z x 1 x 2 s 1 s 2 s 3 RHS Optimal? (0) z Yes (1) x /3 1/3 2 (2) s /3-1/3 2 (3) x /2 0 6 We obtain another optimal BF solution (2,6,2,0,0). The set of optimal solutions is {α(4,3,0,6,0) + (1 α)(2,6,2,0,0) for some α [0,1]}. Check. Now s 2 is a nonbasic variable with 0 its coefficient in Eq. (0). Re-do an extra iteration by increasing s 2 leads to the previous simplex table. Operations Research (Li, X.) Simplex Method for LP (II) Sept. 27, 2017 (week 4) 8 / 31
9 The artificial-variable technique for LP in non-standard forms So far, we only studied the simplex method for LP in standard form. In this section we aim at solving the LP in non-standard forms, which are sorted into one of the following situations: z is minimized. some RHS constant "b i " is negative. some functional constraints with "=" or " ". some nonnegative constraint "x j 0" is withdrew. Idea: transform the non-standard LP problem to some equivalent LP in standard form, mainly by introducing the artificial variable. Operations Research (Li, X.) Simplex Method for LP (II) Sept. 27, 2017 (week 4) 9 / 31
10 z = c 1 x c n x n is minimized. Let z = z be the new objective function, then subject to the same constraints, Max z = c 1 x 1 c n x n is equivalent to Min z = c 1 x c n x n Some RHS constant "b i " is negative. Multiplying both sides 1 to obtain a positive constant on the RHS. For example: 5x 1 + 6x 2 5 5x 1 6x 2 5, which is in standard form; 5x 1 + 6x 2 3 5x 1 6x 2 3, with " ", to be solved. 5x 1 + 6x 2 = 1 5x 1 6x 2 = 1, with "=", to be solved. Operations Research (Li, X.) Simplex Method for LP (II) Sept. 27, 2017 (week 4) 10 / 31
11 Some functional constraints with "=". For an example: s.t. Maximize z = 3x 1 + 5x 2 x x x 1 + 2x 2 =18 3 x 1,x (0.1) The problem is as before except that we have replaced in Eq. + 3x 1 + 2x 2 18 by 3x 1 + 2x 2 = 18. Operations Research (Li, X.) Simplex Method for LP (II) Sept. 27, 2017 (week 4) 11 / 31
12 The feasible region for the LP problem with an equality constraint: Operations Research (Li, X.) Simplex Method for LP (II) Sept. 27, 2017 (week 4) 12 / 31
13 As before, we introduce slack variables to constraints 1, 2 to obtain: s.t. Maximize z = 3x 1 + 5x 2 x 1 + s 1 = 4 1 2x 2 + s 2 = x 1 + 2x 2 = 18 3 x 1, x 2, s 1, s (0.2) The previous LP (0.1) is not in standard form, thus this LP (0.2) is not in canonical form: there is no slack variable in constraint 3. The crucial point is that the Initialization step of the simplex method can not be carried out directly since there is not an obvious BF solution ( as the origin (0,0,4,12,18) in standard LP (0.1) ). Operations Research (Li, X.) Simplex Method for LP (II) Sept. 27, 2017 (week 4) 13 / 31
14 To solve the problem, introduce an artificial variable s 3 0 in 3, i.e. 3x 1 + 2x 2 + s 3 = 18 3, to obtain an initial BF solution (x 1,x 2,s 1,s 2, s 3 ) = (0,0,4,12,18), where {s 1,s 2, s 3 } are the basic variables. This is as to extend the feasible region to include the origin (0,0). However, in order to obtain an equivalent artificial problem, one puts a heavy penalty in the objective function for s 3 0 being strictly positive, i.e. Max z = 3x 1 + 5x 2 M s 3, where M > 0 is sufficiently large. The technique of introducing an artificial variable into the a LP constraint is called the artificial-variable technique; the method of relaxing the constraint and introducing a huge penalty on infeasible solutions (outside the pre-relaxed region) is called the Big-M method. Operations Research (Li, X.) Simplex Method for LP (II) Sept. 27, 2017 (week 4) 14 / 31
15 Define the artificial problem as: Define s 3 = 18 3x 1 2x 2 s.t. Maximize z = 3x 1 + 5x 2 M s 3 x x x 1 + 2x ( so 3x1 + 2x 2 + s 3 = 18 ) x 1, x 2, s (0.3) Operations Research (Li, X.) Simplex Method for LP (II) Sept. 27, 2017 (week 4) 15 / 31
16 Graphical analysis for the artificial problem: Operations Research (Li, X.) Simplex Method for LP (II) Sept. 27, 2017 (week 4) 16 / 31
17 Claim Suppose that LP (0.1) has a nonempty feasible region. Then for M > 0 sufficiently large a, any optimal solution (x1,x 2, s 3 ) to LP problem (0.3) satisfies: (i). (x1,x 2 ) is optimal to LP problem (0.1); (ii). s 3 = 0. a Compared with other coefficients/constants in LP (0.1). To apply the simplex method to artificial problem (0.3) (in standard form!), we first write its associated LP problem in canonical form. Step I. Introduce slack variables "s 1,s 2 " to " " constraints 1 and 2, and put the objective equation into the equation system: Eq.(0) z 3x 1 5x 2 + M s 3 = 0 Eq.(1) x 1 + s 1 = 4 Eq.(2) 2x 2 + s 2 = 12 Eq.(3) 3x 1 + 2x 2 + s 3 = 18 Operations Research (Li, X.) Simplex Method for LP (II) Sept. 27, 2017 (week 4) 17 / 31
18 Step II. Use elementary algebraic operations to write the objective function in terms of the nonbasic variables {x 1,x 2 } only. {s 1,s 2, s 3 } are basic variables, and {x 1,x 2 } are the nonbasic variables, so we make the operation Eq.(0 ) = Eq.(0) M Eq.(3) to obtain the new equation system (ready to apply the simplex method): Eq.(0) z (3M + 3)x 1 (2M + 5)x 2 = 18M Eq.(1) x 1 + s 1 = 4 Eq.(2) 2x 2 + s 2 = 12 Eq.(3) 3x 1 + 2x 2 + s 3 = 18 Operations Research (Li, X.) Simplex Method for LP (II) Sept. 27, 2017 (week 4) 18 / 31
19 We now put the coefficients of the above system into the simplex table to start solving the artificial problem with simplex method. Initialization Eq. Basic variables z x 1 x 2 s 1 s 2 s 3 RHS (0) z 1-3M-3-2M M (1) s (2) s (3) s Keep in mind: M > 0 is larger than any ordinary number you encounter during the solution process. In view of this, we see that the initial BF solution (0,0,4,12,18) is not optimal and we choose x 1 as the entering variable since 3M + 3 > 2M + 5. The minimum ratio test identifies s 1 as the leaving variable so "1" is the pivot number. Operations Research (Li, X.) Simplex Method for LP (II) Sept. 27, 2017 (week 4) 19 / 31
20 Iteration 1 Iteration 2 Eq. Basic variables z x 1 x 2 s 1 s 2 s 3 RHS (0) z 1 0-2M-5 3M M+12 (1) x (2) s (3) s Eq. Basic variables z x 1 x 2 s 1 s 2 s 3 RHS (0) z /2 0 M+5/2 27 (1) x (2) s (3) x /2 0 1/2 3 Iteration 3 (after which it is optimal) Eq. Basic variables z x 1 x 2 s 1 s 2 s 3 RHS (0) z /2 M+1 36 (1) x /3 1/3 2 (2) s /3-1/3 2 (3) x /2 0 6 Operations Research (Li, X.) Simplex Method for LP (II) Sept. 27, 2017 (week 4) 20 / 31
21 The optimal solution path is (0,0) (4,0) (4,3) (2,6); After Iteration 2, the artificial variable s 3 leaves the basis, i.e. we reach at the supporting hyperplane " s 3 = 0" ("3x 1 + 2x 2 = 18"), thus the feasible region of the original LP (0.1) Another iteration leads us to the optimal solution (2, 6). Operations Research (Li, X.) Simplex Method for LP (II) Sept. 27, 2017 (week 4) 21 / 31
22 Some functional constraints with " ". Adding one surplus variable first and then one artificial variable. For an example: s.t. Maximize z = 0.4x x 2 0.3x x x x x 1, x (0.4) Let "x 5 0" be a surplus variable. The system (0.4) is equivalent to: 0.3x x x x 2 x 5 = 6 2 x 1, x 2, x = It is then a problem of LP with an "=" constraint, which can be solved by introducing an artificial variable (same as before). (0.5) Operations Research (Li, X.) Simplex Method for LP (II) Sept. 27, 2017 (week 4) 22 / 31
23 Remark. It is possible to have several constraints of type " ", "=" or a mix of them. In this case, several artificial variables are needed (one for each constraint), and we put a big M for each of them in the objective function. At an optimal solution, all artificial variables should be zero. See pages in H-L for an example. It is possible to obtain at an optimal solution to an artificial LP problem that the artificial variable is nonzero. In this case, we deduce that there is no feasibility for the original LP problem. The coefficient for nonbasic variable in Eq. (0) is in the form of am + b. In identifying the entering variable, when there is a tie on the multiplication term "a", we look at the addition term "b". Operations Research (Li, X.) Simplex Method for LP (II) Sept. 27, 2017 (week 4) 23 / 31
24 Negative variables allowed In some applications, the constraint x j 0 for some j may not be required. A negative x j may be interpreted as a decrease in stock. Two possibilities: x j b j for some b j R. In this case, we define x j = x j b j 0 to be a decision variable, and substitute "x j = x j + b j" in other equations. x j R with no constraint. Introduce x j +,xj variables with x j = x j + xj. 0 two decision Operations Research (Li, X.) Simplex Method for LP (II) Sept. 27, 2017 (week 4) 24 / 31
25 For an example. s.t. Maximize z = 3x 1 + 5x 2 x 1 4 2x x 1 + 2x 2 18 x 2 0 is equivalent to the following (letting x j = x + j x j ) s.t. Maximize z = 3x 1 + 3x 1 + 5x 2 x 1 + x 1 4 2x x 1 + 3x 1 + 2x 2 18 x 1 +, x 1, x 2 0 Operations Research (Li, X.) Simplex Method for LP (II) Sept. 27, 2017 (week 4) 25 / 31
26 The Two-Phase method An easier way to treat the artificial problem involving no "Big M". Idea: first, start from the origin and arrive at the feasible region, by minimizing only the penalties; next, optimize the objective function within the feasible region. Apply the simplex method in two phases: Phase I. Minimize a new objective function as the sum of all the artificial variables. Conclude that the problem is infeasible if the resulting optimal solution contains a strictly positive artificial variable; Proceed to Phase II when all artificial variables leave the basic variables, thus equal zero, at an optimal solution. Phase II. Take the optimal solution in Phase I as an initial BF solution, and apply the simplex method to the original LP problem. Operations Research (Li, X.) Simplex Method for LP (II) Sept. 27, 2017 (week 4) 26 / 31
27 For an example. s.t. Maximize z = 3x 1 + 5x 2 x x x 1 + 2x 2 = 18 3 x 1,x Prepare as in the Big-M method: introducing slack variables (or even surplus variable if needed) and artificial variables to obtain an equivalent artificial problem in canonical form: s.t. Maximize z = 3x 1 + 5x 2 + M s 3 x 1 + s 1 = 4 1 2x 2 + s 2 = x 1 + 2x 2 + s 3 = 18 3 x 1, x 2, s 1, s 2, s (0.6) Operations Research (Li, X.) Simplex Method for LP (II) Sept. 27, 2017 (week 4) 27 / 31
28 To solve the above artificial LP (0.6), we use the two-phase method instead of the Big-M method. Phase I. s.t. Minimize y = s 3 x 1 + s 1 = 4 1 2x 2 + s 2 = x 1 + 2x 2 + s 3 = 18 3 x 1, x 2, s 1, s 2, s {s 1,s 2, s 3 } are the initial basic variables, so we need first to replace s 3 by x 1 and x 2 using equation " s 3 = 18 3x 1 2x 2 ". Further, this is a minimization problem, defining y = y, one obtains the Eq.(0) : y 3x 1 2x 2 = 18. Operations Research (Li, X.) Simplex Method for LP (II) Sept. 27, 2017 (week 4) 28 / 31
29 Initialization Iteration 1 Iteration 2 Eq. Basic variables -y x 1 x 2 s 1 s 2 s 3 RHS (0) -y (1) s (2) s (3) s Eq. Basic variables -y x 1 x 2 s 1 s 2 s 3 RHS (0) -y (1) x (2) s (3) s Eq. Basic variables -y x 1 x 2 s 1 s 2 s 3 RHS (0) -y (1) x (2) s (3) x /2 0 1/2 3 Operations Research (Li, X.) Simplex Method for LP (II) Sept. 27, 2017 (week 4) 29 / 31
30 After Iteration 2, it is optimal for the Phase I problem, where the artificial variable s 3 leaves the basis. The optimal BF solution is such that (x 1,s 2,x 2 ) are basic variables equal to (4,6,3). Phase II. Maximize z = 3x 1 + 5x 2 x 1 + s 1 = 4 1 3s 1 + s 2 s 3 = 6 2 s.t. x s s 3 = 3 3 x 1, x 2, s 1, s 2, s It s ready to apply the simplex method to the above LP in canonical form except that the objective function needs to be revised to contain only nonbasic variables {s 1, s 3 }: 1 : x 1 = 4 s 1 ; 3 : x 2 = s s 3, we obtain the revised objective function: z = 3(4 s 1 ) + 5( s s 3) = s s 3. Operations Research (Li, X.) Simplex Method for LP (II) Sept. 27, 2017 (week 4) 30 / 31
31 Initialization (of Phase II, compare with Iteration in Big-M method) Eq. Basic variables z x 1 x 2 s 1 s 2 s 3 RHS (0) z /2 0 x 27 (1) x x 4 (2) s x 6 (3) x /2 0 x 3 Iteration 1 (of Phase II) Eq. Basic variables z x 1 x 2 s 1 s 2 s 3 RHS (0) z /2 x 36 (1) x /3 x 2 (2) s /3 x 2 (3) x /2 x 6 It is optimal the BF solution: (x 1,s 1,x 2 ) = (2,2,6) basic variables and (s 2, s 3 ) = (0,0) the nonbasic variables. The optimal BF solution to the original LP problem is then (x 1,x 2 ) = (1,6) and the optimal value is 36. Operations Research (Li, X.) Simplex Method for LP (II) Sept. 27, 2017 (week 4) 31 / 31
21. Solve the LP given in Exercise 19 using the big-m method discussed in Exercise 20.
Extra Problems for Chapter 3. Linear Programming Methods 20. (Big-M Method) An alternative to the two-phase method of finding an initial basic feasible solution by minimizing the sum of the artificial
More informationTIM 206 Lecture 3: The Simplex Method
TIM 206 Lecture 3: The Simplex Method Kevin Ross. Scribe: Shane Brennan (2006) September 29, 2011 1 Basic Feasible Solutions Have equation Ax = b contain more columns (variables) than rows (constraints),
More informationIE 400: Principles of Engineering Management. Simplex Method Continued
IE 400: Principles of Engineering Management Simplex Method Continued 1 Agenda Simplex for min problems Alternative optimal solutions Unboundedness Degeneracy Big M method Two phase method 2 Simplex for
More informationThe Simplex Method. Lecture 5 Standard and Canonical Forms and Setting up the Tableau. Lecture 5 Slide 1. FOMGT 353 Introduction to Management Science
The Simplex Method Lecture 5 Standard and Canonical Forms and Setting up the Tableau Lecture 5 Slide 1 The Simplex Method Formulate Constrained Maximization or Minimization Problem Convert to Standard
More informationGauss-Jordan Elimination for Solving Linear Equations Example: 1. Solve the following equations: (3)
The Simple Method Gauss-Jordan Elimination for Solving Linear Equations Eample: Gauss-Jordan Elimination Solve the following equations: + + + + = 4 = = () () () - In the first step of the procedure, we
More informationDr. Maddah ENMG 500 Engineering Management I 10/21/07
Dr. Maddah ENMG 500 Engineering Management I 10/21/07 Computational Procedure of the Simplex Method The optimal solution of a general LP problem is obtained in the following steps: Step 1. Express the
More informationWeek_4: simplex method II
Week_4: simplex method II 1 1.introduction LPs in which all the constraints are ( ) with nonnegative right-hand sides offer a convenient all-slack starting basic feasible solution. Models involving (=)
More informationStandard Form An LP is in standard form when: All variables are non-negativenegative All constraints are equalities Putting an LP formulation into sta
Chapter 4 Linear Programming: The Simplex Method An Overview of the Simplex Method Standard Form Tableau Form Setting Up the Initial Simplex Tableau Improving the Solution Calculating the Next Tableau
More informationMATH 445/545 Homework 2: Due March 3rd, 2016
MATH 445/545 Homework 2: Due March 3rd, 216 Answer the following questions. Please include the question with the solution (write or type them out doing this will help you digest the problem). I do not
More informationIn Chapters 3 and 4 we introduced linear programming
SUPPLEMENT The Simplex Method CD3 In Chapters 3 and 4 we introduced linear programming and showed how models with two variables can be solved graphically. We relied on computer programs (WINQSB, Excel,
More informationAM 121: Intro to Optimization
AM 121: Intro to Optimization Models and Methods Lecture 6: Phase I, degeneracy, smallest subscript rule. Yiling Chen SEAS Lesson Plan Phase 1 (initialization) Degeneracy and cycling Smallest subscript
More information9.1 Linear Programs in canonical form
9.1 Linear Programs in canonical form LP in standard form: max (LP) s.t. where b i R, i = 1,..., m z = j c jx j j a ijx j b i i = 1,..., m x j 0 j = 1,..., n But the Simplex method works only on systems
More informationSlack Variable. Max Z= 3x 1 + 4x 2 + 5X 3. Subject to: X 1 + X 2 + X x 1 + 4x 2 + X X 1 + X 2 + 4X 3 10 X 1 0, X 2 0, X 3 0
Simplex Method Slack Variable Max Z= 3x 1 + 4x 2 + 5X 3 Subject to: X 1 + X 2 + X 3 20 3x 1 + 4x 2 + X 3 15 2X 1 + X 2 + 4X 3 10 X 1 0, X 2 0, X 3 0 Standard Form Max Z= 3x 1 +4x 2 +5X 3 + 0S 1 + 0S 2
More information1 Review Session. 1.1 Lecture 2
1 Review Session Note: The following lists give an overview of the material that was covered in the lectures and sections. Your TF will go through these lists. If anything is unclear or you have questions
More informationSummary of the simplex method
MVE165/MMG631,Linear and integer optimization with applications The simplex method: degeneracy; unbounded solutions; starting solutions; infeasibility; alternative optimal solutions Ann-Brith Strömberg
More informationOPRE 6201 : 3. Special Cases
OPRE 6201 : 3. Special Cases 1 Initialization: The Big-M Formulation Consider the linear program: Minimize 4x 1 +x 2 3x 1 +x 2 = 3 (1) 4x 1 +3x 2 6 (2) x 1 +2x 2 3 (3) x 1, x 2 0. Notice that there are
More informationChap6 Duality Theory and Sensitivity Analysis
Chap6 Duality Theory and Sensitivity Analysis The rationale of duality theory Max 4x 1 + x 2 + 5x 3 + 3x 4 S.T. x 1 x 2 x 3 + 3x 4 1 5x 1 + x 2 + 3x 3 + 8x 4 55 x 1 + 2x 2 + 3x 3 5x 4 3 x 1 ~x 4 0 If we
More informationSpecial cases of linear programming
Special cases of linear programming Infeasible solution Multiple solution (infinitely many solution) Unbounded solution Degenerated solution Notes on the Simplex tableau 1. The intersection of any basic
More informationMetode Kuantitatif Bisnis. Week 4 Linear Programming Simplex Method - Minimize
Metode Kuantitatif Bisnis Week 4 Linear Programming Simplex Method - Minimize Outlines Solve Linear Programming Model Using Graphic Solution Solve Linear Programming Model Using Simplex Method (Maximize)
More informationLecture 11: Post-Optimal Analysis. September 23, 2009
Lecture : Post-Optimal Analysis September 23, 2009 Today Lecture Dual-Simplex Algorithm Post-Optimal Analysis Chapters 4.4 and 4.5. IE 30/GE 330 Lecture Dual Simplex Method The dual simplex method will
More informationOPTIMISATION 3: NOTES ON THE SIMPLEX ALGORITHM
OPTIMISATION 3: NOTES ON THE SIMPLEX ALGORITHM Abstract These notes give a summary of the essential ideas and results It is not a complete account; see Winston Chapters 4, 5 and 6 The conventions and notation
More informationAM 121: Intro to Optimization Models and Methods
AM 121: Intro to Optimization Models and Methods Fall 2017 Lecture 2: Intro to LP, Linear algebra review. Yiling Chen SEAS Lecture 2: Lesson Plan What is an LP? Graphical and algebraic correspondence Problems
More informationΩ R n is called the constraint set or feasible set. x 1
1 Chapter 5 Linear Programming (LP) General constrained optimization problem: minimize subject to f(x) x Ω Ω R n is called the constraint set or feasible set. any point x Ω is called a feasible point We
More information(includes both Phases I & II)
Minimize z=3x 5x 4x 7x 5x 4x subject to 2x x2 x4 3x6 0 x 3x3 x4 3x5 2x6 2 4x2 2x3 3x4 x5 5 and x 0 j, 6 2 3 4 5 6 j ecause of the lack of a slack variable in each constraint, we must use Phase I to find
More information1. Algebraic and geometric treatments Consider an LP problem in the standard form. x 0. Solutions to the system of linear equations
The Simplex Method Most textbooks in mathematical optimization, especially linear programming, deal with the simplex method. In this note we study the simplex method. It requires basically elementary linear
More informationSensitivity Analysis
Dr. Maddah ENMG 500 /9/07 Sensitivity Analysis Changes in the RHS (b) Consider an optimal LP solution. Suppose that the original RHS (b) is changed from b 0 to b new. In the following, we study the affect
More informationReview Solutions, Exam 2, Operations Research
Review Solutions, Exam 2, Operations Research 1. Prove the weak duality theorem: For any x feasible for the primal and y feasible for the dual, then... HINT: Consider the quantity y T Ax. SOLUTION: To
More informationIntroduction. Very efficient solution procedure: simplex method.
LINEAR PROGRAMMING Introduction Development of linear programming was among the most important scientific advances of mid 20th cent. Most common type of applications: allocate limited resources to competing
More informationSummary of the simplex method
MVE165/MMG630, The simplex method; degeneracy; unbounded solutions; infeasibility; starting solutions; duality; interpretation Ann-Brith Strömberg 2012 03 16 Summary of the simplex method Optimality condition:
More informationOPERATIONS RESEARCH. Linear Programming Problem
OPERATIONS RESEARCH Chapter 1 Linear Programming Problem Prof. Bibhas C. Giri Department of Mathematics Jadavpur University Kolkata, India Email: bcgiri.jumath@gmail.com MODULE - 2: Simplex Method for
More informationYinyu Ye, MS&E, Stanford MS&E310 Lecture Note #06. The Simplex Method
The Simplex Method Yinyu Ye Department of Management Science and Engineering Stanford University Stanford, CA 94305, U.S.A. http://www.stanford.edu/ yyye (LY, Chapters 2.3-2.5, 3.1-3.4) 1 Geometry of Linear
More informationSensitivity Analysis and Duality in LP
Sensitivity Analysis and Duality in LP Xiaoxi Li EMS & IAS, Wuhan University Oct. 13th, 2016 (week vi) Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) 1 /
More informationSimplex Algorithm Using Canonical Tableaus
41 Simplex Algorithm Using Canonical Tableaus Consider LP in standard form: Min z = cx + α subject to Ax = b where A m n has rank m and α is a constant In tableau form we record it as below Original Tableau
More informationIntroduction to Operations Research Prof. G. Srinivasan Department of Management Studies Indian Institute of Technology, Madras
Introduction to Operations Research Prof. G. Srinivasan Department of Management Studies Indian Institute of Technology, Madras Module - 03 Simplex Algorithm Lecture 15 Infeasibility In this class, we
More informationSystems Analysis in Construction
Systems Analysis in Construction CB312 Construction & Building Engineering Department- AASTMT by A h m e d E l h a k e e m & M o h a m e d S a i e d 3. Linear Programming Optimization Simplex Method 135
More informationChapter 4 The Simplex Algorithm Part I
Chapter 4 The Simplex Algorithm Part I Based on Introduction to Mathematical Programming: Operations Research, Volume 1 4th edition, by Wayne L. Winston and Munirpallam Venkataramanan Lewis Ntaimo 1 Modeling
More informationLinear Programming, Lecture 4
Linear Programming, Lecture 4 Corbett Redden October 3, 2016 Simplex Form Conventions Examples Simplex Method To run the simplex method, we start from a Linear Program (LP) in the following standard simplex
More informationLecture 11 Linear programming : The Revised Simplex Method
Lecture 11 Linear programming : The Revised Simplex Method 11.1 The Revised Simplex Method While solving linear programming problem on a digital computer by regular simplex method, it requires storing
More informationExample. 1 Rows 1,..., m of the simplex tableau remain lexicographically positive
3.4 Anticycling Lexicographic order In this section we discuss two pivoting rules that are guaranteed to avoid cycling. These are the lexicographic rule and Bland s rule. Definition A vector u R n is lexicographically
More informationFebruary 17, Simplex Method Continued
15.053 February 17, 2005 Simplex Method Continued 1 Today s Lecture Review of the simplex algorithm. Formalizing the approach Alternative Optimal Solutions Obtaining an initial bfs Is the simplex algorithm
More informationECE 307 Techniques for Engineering Decisions
ECE 7 Techniques for Engineering Decisions Introduction to the Simple Algorithm George Gross Department of Electrical and Computer Engineering University of Illinois at Urbana-Champaign ECE 7 5 9 George
More informationLecture 5 Simplex Method. September 2, 2009
Simplex Method September 2, 2009 Outline: Lecture 5 Re-cap blind search Simplex method in steps Simplex tableau Operations Research Methods 1 Determining an optimal solution by exhaustive search Lecture
More informationORF 307: Lecture 2. Linear Programming: Chapter 2 Simplex Methods
ORF 307: Lecture 2 Linear Programming: Chapter 2 Simplex Methods Robert Vanderbei February 8, 2018 Slides last edited on February 8, 2018 http://www.princeton.edu/ rvdb Simplex Method for LP An Example.
More informationThe simplex algorithm
The simplex algorithm The simplex algorithm is the classical method for solving linear programs. Its running time is not polynomial in the worst case. It does yield insight into linear programs, however,
More information3 The Simplex Method. 3.1 Basic Solutions
3 The Simplex Method 3.1 Basic Solutions In the LP of Example 2.3, the optimal solution happened to lie at an extreme point of the feasible set. This was not a coincidence. Consider an LP in general form,
More informationMATH2070 Optimisation
MATH2070 Optimisation Linear Programming Semester 2, 2012 Lecturer: I.W. Guo Lecture slides courtesy of J.R. Wishart Review The standard Linear Programming (LP) Problem Graphical method of solving LP problem
More informationLinear Programming and the Simplex method
Linear Programming and the Simplex method Harald Enzinger, Michael Rath Signal Processing and Speech Communication Laboratory Jan 9, 2012 Harald Enzinger, Michael Rath Jan 9, 2012 page 1/37 Outline Introduction
More informationIntroduction to the Simplex Algorithm Active Learning Module 3
Introduction to the Simplex Algorithm Active Learning Module 3 J. René Villalobos and Gary L. Hogg Arizona State University Paul M. Griffin Georgia Institute of Technology Background Material Almost any
More informationIE 400 Principles of Engineering Management. The Simplex Algorithm-I: Set 3
IE 4 Principles of Engineering Management The Simple Algorithm-I: Set 3 So far, we have studied how to solve two-variable LP problems graphically. However, most real life problems have more than two variables!
More informationChapter 4 The Simplex Algorithm Part II
Chapter 4 The Simple Algorithm Part II Based on Introduction to Mathematical Programming: Operations Research, Volume 4th edition, by Wayne L Winston and Munirpallam Venkataramanan Lewis Ntaimo L Ntaimo
More informationDr. S. Bourazza Math-473 Jazan University Department of Mathematics
Dr. Said Bourazza Department of Mathematics Jazan University 1 P a g e Contents: Chapter 0: Modelization 3 Chapter1: Graphical Methods 7 Chapter2: Simplex method 13 Chapter3: Duality 36 Chapter4: Transportation
More informationNotes taken by Graham Taylor. January 22, 2005
CSC4 - Linear Programming and Combinatorial Optimization Lecture : Different forms of LP. The algebraic objects behind LP. Basic Feasible Solutions Notes taken by Graham Taylor January, 5 Summary: We first
More informationAlgebraic Simplex Active Learning Module 4
Algebraic Simplex Active Learning Module 4 J. René Villalobos and Gary L. Hogg Arizona State University Paul M. Griffin Georgia Institute of Technology Time required for the module: 50 Min. Reading Most
More informationmin3x 1 + 4x 2 + 5x 3 2x 1 + 2x 2 + x 3 6 x 1 + 2x 2 + 3x 3 5 x 1, x 2, x 3 0.
ex-.-. Foundations of Operations Research Prof. E. Amaldi. Dual simplex algorithm Given the linear program minx + x + x x + x + x 6 x + x + x x, x, x. solve it via the dual simplex algorithm. Describe
More informationPrelude to the Simplex Algorithm. The Algebraic Approach The search for extreme point solutions.
Prelude to the Simplex Algorithm The Algebraic Approach The search for extreme point solutions. 1 Linear Programming-1 x 2 12 8 (4,8) Max z = 6x 1 + 4x 2 Subj. to: x 1 + x 2
More informationNote 3: LP Duality. If the primal problem (P) in the canonical form is min Z = n (1) then the dual problem (D) in the canonical form is max W = m (2)
Note 3: LP Duality If the primal problem (P) in the canonical form is min Z = n j=1 c j x j s.t. nj=1 a ij x j b i i = 1, 2,..., m (1) x j 0 j = 1, 2,..., n, then the dual problem (D) in the canonical
More informationCivil Engineering Systems Analysis Lecture XII. Instructor: Prof. Naveen Eluru Department of Civil Engineering and Applied Mechanics
Civil Engineering Systems Analysis Lecture XII Instructor: Prof. Naveen Eluru Department of Civil Engineering and Applied Mechanics Today s Learning Objectives Dual Midterm 2 Let us look at a complex case
More informationWeek 3: Simplex Method I
Week 3: Simplex Method I 1 1. Introduction The simplex method computations are particularly tedious and repetitive. It attempts to move from one corner point of the solution space to a better corner point
More informationChapter 5 Linear Programming (LP)
Chapter 5 Linear Programming (LP) General constrained optimization problem: minimize f(x) subject to x R n is called the constraint set or feasible set. any point x is called a feasible point We consider
More information(includes both Phases I & II)
(includes both Phases I & II) Dennis ricker Dept of Mechanical & Industrial Engineering The University of Iowa Revised Simplex Method 09/23/04 page 1 of 22 Minimize z=3x + 5x + 4x + 7x + 5x + 4x subject
More information"SYMMETRIC" PRIMAL-DUAL PAIR
"SYMMETRIC" PRIMAL-DUAL PAIR PRIMAL Minimize cx DUAL Maximize y T b st Ax b st A T y c T x y Here c 1 n, x n 1, b m 1, A m n, y m 1, WITH THE PRIMAL IN STANDARD FORM... Minimize cx Maximize y T b st Ax
More informationLesson 27 Linear Programming; The Simplex Method
Lesson Linear Programming; The Simplex Method Math 0 April 9, 006 Setup A standard linear programming problem is to maximize the quantity c x + c x +... c n x n = c T x subject to constraints a x + a x
More informationDistributed Real-Time Control Systems. Lecture Distributed Control Linear Programming
Distributed Real-Time Control Systems Lecture 13-14 Distributed Control Linear Programming 1 Linear Programs Optimize a linear function subject to a set of linear (affine) constraints. Many problems can
More informationmaxz = 3x 1 +4x 2 2x 1 +x 2 6 2x 1 +3x 2 9 x 1,x 2
ex-5.-5. Foundations of Operations Research Prof. E. Amaldi 5. Branch-and-Bound Given the integer linear program maxz = x +x x +x 6 x +x 9 x,x integer solve it via the Branch-and-Bound method (solving
More informationMath Models of OR: Some Definitions
Math Models of OR: Some Definitions John E. Mitchell Department of Mathematical Sciences RPI, Troy, NY 12180 USA September 2018 Mitchell Some Definitions 1 / 20 Active constraints Outline 1 Active constraints
More informationLecture 2: The Simplex method. 1. Repetition of the geometrical simplex method. 2. Linear programming problems on standard form.
Lecture 2: The Simplex method. Repetition of the geometrical simplex method. 2. Linear programming problems on standard form. 3. The Simplex algorithm. 4. How to find an initial basic solution. Lecture
More informationThe Simplex Method for Solving a Linear Program Prof. Stephen Graves
The Simplex Method for Solving a Linear Program Prof. Stephen Graves Observations from Geometry feasible region is a convex polyhedron an optimum occurs at a corner point possible algorithm - search over
More information56:171 Operations Research Fall 1998
56:171 Operations Research Fall 1998 Quiz Solutions D.L.Bricker Dept of Mechanical & Industrial Engineering University of Iowa 56:171 Operations Research Quiz
More informationLecture 2: The Simplex method
Lecture 2 1 Linear and Combinatorial Optimization Lecture 2: The Simplex method Basic solution. The Simplex method (standardform, b>0). 1. Repetition of basic solution. 2. One step in the Simplex algorithm.
More informationThe Simplex Algorithm and Goal Programming
The Simplex Algorithm and Goal Programming In Chapter 3, we saw how to solve two-variable linear programming problems graphically. Unfortunately, most real-life LPs have many variables, so a method is
More informationVariants of Simplex Method
Variants of Simplex Method All the examples we have used in the previous chapter to illustrate simple algorithm have the following common form of constraints; i.e. a i x + a i x + + a in x n b i, i =,,,m
More informationThe Simplex Algorithm
The Simplex Algorithm How to Convert an LP to Standard Form Before the simplex algorithm can be used to solve an LP, the LP must be converted into a problem where all the constraints are equations and
More informationIE 5531: Engineering Optimization I
IE 5531: Engineering Optimization I Lecture 5: The Simplex method, continued Prof. John Gunnar Carlsson September 22, 2010 Prof. John Gunnar Carlsson IE 5531: Engineering Optimization I September 22, 2010
More informationOPERATIONS RESEARCH. Michał Kulej. Business Information Systems
OPERATIONS RESEARCH Michał Kulej Business Information Systems The development of the potential and academic programmes of Wrocław University of Technology Project co-financed by European Union within European
More informationThe Big M Method. Modify the LP
The Big M Method Modify the LP 1. If any functional constraints have negative constants on the right side, multiply both sides by 1 to obtain a constraint with a positive constant. Big M Simplex: 1 The
More informationThe Simplex Method. Standard form (max) z c T x = 0 such that Ax = b.
The Simplex Method Standard form (max) z c T x = 0 such that Ax = b. The Simplex Method Standard form (max) z c T x = 0 such that Ax = b. Build initial tableau. z c T 0 0 A b The Simplex Method Standard
More informationThe Simplex Method of Linear Programming
The Simplex Method of Linear Programming Online Tutorial 3 Tutorial Outline CONVERTING THE CONSTRAINTS TO EQUATIONS SETTING UP THE FIRST SIMPLEX TABLEAU SIMPLEX SOLUTION PROCEDURES SUMMARY OF SIMPLEX STEPS
More informationAM 121: Intro to Optimization Models and Methods Fall 2018
AM 121: Intro to Optimization Models and Methods Fall 2018 Lecture 5: The Simplex Method Yiling Chen Harvard SEAS Lesson Plan This lecture: Moving towards an algorithm for solving LPs Tableau. Adjacent
More informationLinear programming: algebra
: algebra CE 377K March 26, 2015 ANNOUNCEMENTS Groups and project topics due soon Announcements Groups and project topics due soon Did everyone get my test email? Announcements REVIEW geometry Review geometry
More informationThe Primal-Dual Algorithm P&S Chapter 5 Last Revised October 30, 2006
The Primal-Dual Algorithm P&S Chapter 5 Last Revised October 30, 2006 1 Simplex solves LP by starting at a Basic Feasible Solution (BFS) and moving from BFS to BFS, always improving the objective function,
More informationLINEAR PROGRAMMING. Introduction
LINEAR PROGRAMMING Introduction Development of linear programming was among the most important scientific advances of mid-20th cent. Most common type of applications: allocate limited resources to competing
More informationLecture 4: Algebra, Geometry, and Complexity of the Simplex Method. Reading: Sections 2.6.4, 3.5,
Lecture 4: Algebra, Geometry, and Complexity of the Simplex Method Reading: Sections 2.6.4, 3.5, 10.2 10.5 1 Summary of the Phase I/Phase II Simplex Method We write a typical simplex tableau as z x 1 x
More informationFundamental Theorems of Optimization
Fundamental Theorems of Optimization 1 Fundamental Theorems of Math Prog. Maximizing a concave function over a convex set. Maximizing a convex function over a closed bounded convex set. 2 Maximizing Concave
More informationPart 1. The Review of Linear Programming
In the name of God Part 1. The Review of Linear Programming 1.5. Spring 2010 Instructor: Dr. Masoud Yaghini Outline Introduction Formulation of the Dual Problem Primal-Dual Relationship Economic Interpretation
More informationLinear Programming Redux
Linear Programming Redux Jim Bremer May 12, 2008 The purpose of these notes is to review the basics of linear programming and the simplex method in a clear, concise, and comprehensive way. The book contains
More informationCO 250 Final Exam Guide
Spring 2017 CO 250 Final Exam Guide TABLE OF CONTENTS richardwu.ca CO 250 Final Exam Guide Introduction to Optimization Kanstantsin Pashkovich Spring 2017 University of Waterloo Last Revision: March 4,
More informationFebruary 22, Introduction to the Simplex Algorithm
15.53 February 22, 27 Introduction to the Simplex Algorithm 1 Quotes for today Give a man a fish and you feed him for a day. Teach him how to fish and you feed him for a lifetime. -- Lao Tzu Give a man
More informationMichælmas 2012 Operations Research III/IV 1
Michælmas 2012 Operations Research III/IV 1 An inventory example A company makes windsurfing boards and has orders for 40, 60, 75 and 25 boards respectively over the next four production quarters. All
More informationAnswer the following questions: Q1: Choose the correct answer ( 20 Points ):
Benha University Final Exam. (ختلفات) Class: 2 rd Year Students Subject: Operations Research Faculty of Computers & Informatics Date: - / 5 / 2017 Time: 3 hours Examiner: Dr. El-Sayed Badr Answer the following
More informationMATH 445/545 Test 1 Spring 2016
MATH 445/545 Test Spring 06 Note the problems are separated into two sections a set for all students and an additional set for those taking the course at the 545 level. Please read and follow all of these
More informationFarkas Lemma, Dual Simplex and Sensitivity Analysis
Summer 2011 Optimization I Lecture 10 Farkas Lemma, Dual Simplex and Sensitivity Analysis 1 Farkas Lemma Theorem 1. Let A R m n, b R m. Then exactly one of the following two alternatives is true: (i) x
More information9.5 THE SIMPLEX METHOD: MIXED CONSTRAINTS
SECTION 9.5 THE SIMPLEX METHOD: MIXED CONSTRAINTS 557 9.5 THE SIMPLEX METHOD: MIXED CONSTRAINTS In Sections 9. and 9., you looked at linear programming problems that occurred in standard form. The constraints
More informationSection Notes 9. IP: Cutting Planes. Applied Math 121. Week of April 12, 2010
Section Notes 9 IP: Cutting Planes Applied Math 121 Week of April 12, 2010 Goals for the week understand what a strong formulations is. be familiar with the cutting planes algorithm and the types of cuts
More informationIntroduction to Mathematical Programming IE406. Lecture 10. Dr. Ted Ralphs
Introduction to Mathematical Programming IE406 Lecture 10 Dr. Ted Ralphs IE406 Lecture 10 1 Reading for This Lecture Bertsimas 4.1-4.3 IE406 Lecture 10 2 Duality Theory: Motivation Consider the following
More informationWater Resources Systems: Modeling Techniques and Analysis
INDIAN INSTITUTE OF SCIENCE Water Resources Systems: Modeling Techniques and Analysis Lecture - 9 Course Instructor : Prof. P. P. MUJUMDAR Department of Civil Engg., IISc. Summary of the previous lecture
More informationEND3033 Operations Research I Sensitivity Analysis & Duality. to accompany Operations Research: Applications and Algorithms Fatih Cavdur
END3033 Operations Research I Sensitivity Analysis & Duality to accompany Operations Research: Applications and Algorithms Fatih Cavdur Introduction Consider the following problem where x 1 and x 2 corresponds
More informationMath 273a: Optimization The Simplex method
Math 273a: Optimization The Simplex method Instructor: Wotao Yin Department of Mathematics, UCLA Fall 2015 material taken from the textbook Chong-Zak, 4th Ed. Overview: idea and approach If a standard-form
More informationInteger Programming. The focus of this chapter is on solution techniques for integer programming models.
Integer Programming Introduction The general linear programming model depends on the assumption of divisibility. In other words, the decision variables are allowed to take non-negative integer as well
More informationLinear programs, convex polyhedra, extreme points
MVE165/MMG631 Extreme points of convex polyhedra; reformulations; basic feasible solutions; the simplex method Ann-Brith Strömberg 2015 03 27 Linear programs, convex polyhedra, extreme points A linear
More informationMath 354 Summer 2004 Solutions to review problems for Midterm #1
Solutions to review problems for Midterm #1 First: Midterm #1 covers Chapter 1 and 2. In particular, this means that it does not explicitly cover linear algebra. Also, I promise there will not be any proofs.
More information