The Strong Duality Theorem 1
|
|
- Madison Stevens
- 6 years ago
- Views:
Transcription
1 1/39 The Strong Duality Theorem 1 Adrian Vetta 1 This presentation is based upon the book Linear Programming by Vasek Chvatal
2 2/39 Part I Weak Duality
3 3/39 Primal and Dual Recall we have a primal linear program max s.t. n c j x j n a ij x j b i i [m] = {1, 2,..., m} x j 0 j [n] = {1, 2,..., n} and its dual linear program min s.t. m b i y i m a ij y i c j j [n] y i 0 i [m]
4 4/39 Weak Duality Theorem The Weak Duality Theorem. For any primal feasible solution (x 1, x 2,..., x n ) and any dual feasible solution (y 1, y 2,..., y m ) we have n c j x j b i y i
5 5/39 Proof of Weak Duality Weak Duality Theorem. For any primal feasible solution (x 1, x 2,..., x n ) and any and any dual feasible solution (y 1, y 2,..., y m ) we have n c j x j m b i y i. Proof. n x j c j = n x j a ij y i y i n a ij x i y i b i
6 6/39 Part II Strong Duality
7 7/39 Strong Duality Theorem The Strong Duality Theorem. If the primal has an optimal solution (x 1, x 2,..., x n) then the dual has an optimal solution (y 1, y 2,..., y m) such that n c j xj = b i y i
8 8/39 An Example Consider the primal and its dual maximise 4x 1 + x 2 + 5x 3 + 3x 4 subject to x 1 x 2 x 3 + 3x 4 1 5x 1 + x 2 + 3x 3 + 8x 4 55 x 1 + 2x 2 + 3x 3 5x 4 3 x 1, x 2, x 3, x 4 0 minimise y y 2 + 3y 3 subject to y 1 + 5y 2 y 3 4 y 1 + y 2 + 2y 3 1 y 1 + 3y 2 + 3y 3 5 3y 1 + 8y 2 5y 3 3 y 1, y 2, y 3 0
9 9/39 Optimal Solutions maximise 4x 1 + x 2 + 5x 3 + 3x 4 subject to x 1 x 2 x 3 + 3x 4 1 5x 1 + x 2 + 3x 3 + 8x 4 55 x 1 + 2x 2 + 3x 3 5x 4 3 x 1, x 2, x 3, x 4 0 The primal has optimal solution (x 1, x 2, x 3, x 4 ) = (0, 14, 0, 5) with value 29. minimise y y 2 + 3y 3 subject to y 1 + 5y 2 y 3 4 y 1 + y 2 + 2y 3 1 y 1 + 3y 2 + 3y 3 5 3y 1 + 8y 2 5y 3 3 y 1, y 2, y 3 0 The dual has optimal solution (y 1, y 2, y 3 ) = (11, 0, 6) with value 29.
10 10/39 Solving the Primal Let s solve the primal by the simplex method. maximise 4x 1 + x 2 + 5x 3 + 3x 4 subject to x 1 x 2 x 3 + 3x 4 1 5x 1 + x 2 + 3x 3 + 8x 4 55 x 1 + 2x 2 + 3x 3 5x 4 3 x 1, x 2, x 3, x 4 0 Put into dictionary form. z = 4x 1 + x 2 + 5x 3 + 3x 4 x 5 = 1 x 1 + x 2 + x 3 3x 4 x 6 = 55 5x 1 x 2 3x 3 8x 4 x 7 = 3 + x 1 2x 2 3x 3 + 5x 4
11 11/39 Pivot 1 z = 4x 1 + x 2 + 5x 3 + 3x 4 x 5 = 1 x 1 + x 2 + x 3 3x 4 x 6 = 55 5x 1 x 2 3x 3 8x 4 x 7 = 3 + x 1 2x 2 3x 3 + 5x 4 Pivot (Bland s Rule) Add x 1 to basis. (Lowest index.) Remove x 5 from basis. (No choice.) z = 4(1 + x 2 + x 3 3x 4 x 5) + x 2 + 5x 3 + 3x 4 x 1 = 1 + x 2 + x 3 3x 4 x 5 x 6 = 55 5(1 + x 2 + x 3 3x 4 x 5) x 2 3x 3 8x 4 x 7 = 3 + (1 + x 2 + x 3 3x 4 x 5) 2x 2 3x 3 + 5x 4 z = 4 + 5x 2 + 9x 3 9x 4 4x 5 x 1 = 1 + x 2 + x 3 3x 4 x 5 x 6 = 50 6x 2 8x 3 + 7x 4 + 5x 5 x 7 = 4 x 2 2x 3 + 2x 4 x 5
12 2/39 Pivot 2 z = 4 + 5x 2 + 9x 3 9x 4 4x 5 x 1 = 1 + x 2 + x 3 3x 4 x 5 x 6 = 50 6x 2 8x 3 + 7x 4 + 5x 5 x 7 = 4 x 2 2x 3 + 2x 4 x 5 Pivot: Add x 2 to basis. (Lowest index.) Remove x 7 from basis. (No choice.) z = 4 + 5(4 2x 3 + 2x 4 x 5 x 7) + 9x 3 9x 4 4x 5 x 2 = 4 2x 3 + 2x 4 x 5 x 7 x 1 = 1 + (4 2x 3 + 2x 4 x 5 x 7) + x 3 3x 4 x 5 x 6 = 50 6(4 2x 3 + 2x 4 x 5 x 7) 8x 3 + 7x 4 + 5x 5 z = 24 x 3 + x 4 9x 5 5x 7 x 2 = 4 2x 3 + 2x 4 x 5 x 7 x 1 = 5 x 3 x 4 2x 5 x 7 x 6 = x 3 5x x 5 + 6x 7
13 3/39 Pivot 3 z = 24 x 3 + x 4 9x 5 5x 7 x 2 = 4 2x 3 + 2x 4 x 5 x 7 x 1 = 5 x 3 x 4 2x 5 x 7 x 6 = x 3 5x x 5 + 6x 7 Pivot: Add x 4 to basis. (No choice.) Remove x 1 from basis. (No choice.) z = 24 x 3 + (5 x 3 2x 5 x 7 x 1) 9x 5 5x 7 x 4 = 5 x 3 2x 5 x 7 x 1 x 2 = 4 2x 3 + 2(5 x 3 2x 5 x 7 x 1) x 5 x 7 x 6 = x 3 5(5 x 3 2x 5 x 7 x 1) + 11x 5 + 6x 7 z = 29 2x 3 11x 5 6x 7 x 1 x 4 = 5 x 3 2x 5 x 7 x 1 x 2 = 14 4x 3 5x 5 3x 7 2x 1 x 6 = 1 + 9x x x 7 + 5x 1
14 14/39 An Optimal Primal Solution z = 29 x 1 2x 3 11x 5 6x 7 x 2 = 14 2x 1 4x 3 5x 5 3x 7 x 4 = 5 x 1 x 3 2x 5 x 7 x 6 = 1 + 5x 1 + 9x x x 7 The optimal solution is (x 1, x 2, x 3, x 4 ) = (0, 14, 0, 5). The optimal value is z = 29. So the optimal primal solution is as claimed.
15 15/39 An Optimal Dual Solution z = 29 x 1 2x 3 11x 5 6x 7 x 2 = 14 2x 1 4x 3 5x 5 3x 7 x 4 = 5 x 1 x 3 2x 5 x 7 x 6 = 1 + 5x 1 + 9x x x 7 Recall that the optimal dual solution is (y 1, y 2, y 3 ) = (11, 0, 6). How does the simplex algorithm confirm this? Look at the top row: z = 29 x 1 0x 2 2x 3 0x 4 11x 5 0x 6 6x 7 So the dual variables (y 1, y 2, y 3 ) have values equal to the coefficients of (x 5, x 6, x 7 ) in z!
16 16/39 Example 2 Take the following primal and its dual max 5x 1 + 4x 2 + 3x 3 s.t. 2x 1 + 3x 2 + x 3 5 4x 1 + x 2 + 2x x 1 + 4x 2 + 2x 3 8 x 1, x 2, x 3 0 min 5y y 2 + 8y 3 s.t. 2y 1 + 4y 2 + 3y 3 5 3y 1 + y 2 + 4y 3 4 y 1 + 2y 2 + 2y 3 3 y 1, y 2, y 3 0 Recall the final dictionary was z = 13 3x 2 1x 4 1x 6 x 1 = 2 2x 2 2x 4 + x 6 x 3 = 1 + x 2 + 3x 4 2x 6 x 5 = 1 + 5x 2 + 2x 4 So the primal solution is (x 1, x 2, x 3 ) = (2, 0, 1) with value 13. The dual solution is (y 1, y 2, y 3 ) = (1, 0, 1) with value 13.
17 17/39 Example 3 Take the following primal and its dual max 5x 1 + 5x 2 + 3x 3 s.t x 1 + 3x 2 + x 3 3 x 1 + 3x 3 2 2x 1 x 2 + 2x 3 4 2x 1 + 3x 2 x 3 2 x 1, x 2, x 3 0 min 3y 1 + 2y 2 + 4y 3 + 2y 4 s.t. y 1 y 2 + 2y 3 + 2y 4 5 3y 1 y 3 + 3y 4 5 y 1 + 3y 2 + 2y 3 y 4 3 y 1, y 2, y 3, y 4 0 Recall the final dictionary was z = 10 1x 5 1x 6 2x 7 x 1 = x x x 5 x 2 = x x x 5 x 3 = x x x 5 x 4 = x x x 5 So the primal solution is (x 1, x 2, x 3 ) = ( 32 29, 8 29, ) with value 10. The dual solution is (y 1, y 2, y 3, y 4 ) = (0, 1, 1, 2) with value 10.
18 18/39 Part III Proof of Strong Duality
19 19/39 Strong Duality Theorem The Strong Duality Theorem. If the primal has an optimal solution (x 1, x 2,..., x n) then the dual has an optimal solution (y 1, y 2,..., y m) such that n c j xj = b i y i
20 20/39 Intuition Look at the initial dictionary: And the final dictionary: z = 4x 1 + x 2 + 5x 3 + 3x 4 x 5 = 1 x 1 + x 2 + x 3 3x 4 x 6 = 55 5x 1 x 2 3x 3 8x 4 x 7 = 3 + x 1 2x 2 3x 3 + 5x 4 z = 29 x 1 2x 3 11x 5 6x 7 x 2 = 14 2x 1 4x 3 5x 5 3x 7 x 4 = 5 x 1 x 3 2x 5 x 7 x 6 = 1 + 5x 1 + 9x x x 7 The slack variable x 5 appears in one constraint in the initial dictionary. So the only way it can appear with a coefficient of 11 in the top row of the final dictionary is if we multiplied that constraint by 11. Similarly we must have multiplied the x 7 constraint by 6.
21 21/39 Intuition (cont.) Let s verify this. Add these constraints to the top row of the initial dictionary: z = 4x 1 + x 2 + 5x 3 + 3x x 5 = 11 (1 x 1 + x 2 + x 3 3x 4 ) + 6 x 7 = 6 (3 + x 1 2x 2 3x 3 + 5x 4 ) z + 11x 5 + 6x 7 = 29 x 1 2x 3 Thus z = 29 x 1 2x 3 11x 5 6x 7
22 22/39 Intuition (cont.) maximise 4x 1 + x 2 + 5x 3 + 3x 4 subject to x 1 x 2 x 3 + 3x 4 1 5x 1 + x 2 + 3x 3 + 8x 4 55 x 1 + 2x 2 + 3x 3 5x 4 3 x 1, x 2, x 3, x 4 0 In terms of the original LP we have 11 (x 1 x 2 x 3 + 3x 4 ) ( x 1 + 2x 2 + 3x 3 5x 4 ) 6 3 5x 1 + x 2 + 7x 3 + 3x 4 29 So 4x 1 + x 2 + 5x 3 + 3x 4 5x 1 + x 2 + 7x 3 + 3x 4 29
23 23/39 Intuition: Example 2 Look at the initial dictionary: And the final dictionary: z = 5x 1 + 4x 2 + 3x 3 x 4 = 5 2x 1 3x 2 x 3 x 5 = 11 4x 1 x 2 2x 3 x 6 = 8 3x 1 4x 2 2x 3 z = 13 3x 2 1x 4 1x 6 x 1 = 2 2x 2 2x 4 + x 6 x 3 = 1 + x 2 + 3x 4 2x 6 x 5 = 1 + 5x 2 + 2x 4 The slack variable x 4 appears in one constraint in the initial dictionary. So the only way it can appear with a coefficient of 1 in the top row of the final dictionary is if we multiplied that constraint by 1.
24 24/39 Intuition: Example 3 Look at the initial dictionary: And the final dictionary: z = 5x 1 + 5x 2 + 3x 3 x 4 = 3 x 1 3x 2 x 3 x 5 = 2 + x 1 3x 3 x 6 = 4 2x 1 + x 2 2x 3 x 7 = 2 2x 1 3x 2 + x 3 z = 10 1x 5 1x 6 2x 7 x 1 = x x x5 x 2 = x x x5 x 3 = x x6 8 x 4 = x x5 21 x x5 The slack variable x 7 appears in one constraint in the initial dictionary. So the only way it can appear with a coefficient of 2 in the top row of the final dictionary is if we multiplied that constraint by 2.
25 25/39 Proof Idea Does what we have seen always work? Run the simplex algorithm to find... The values of the decision variables (x 1, x 2,..., x n). The values of the slack variables (x n+1, x n+2,..., x n+m). The top row of the final dictionary n+m z = OPT γ k x k k=1 [We know γ k 0 for all k, and for variables in the basis γ k = 0.] Set the dual variables to be y i = γ n+i for all i 1, 2,..., m.
26 26/39 Proof of Strong Duality We only need to show two things: (1) That (y 1, y 2,..., y m) is feasible for the dual, i.e. a ij y i c j j [n] (2) It has value equal to the optimal primal value, i.e. n c j xj = b i y i
27 27/39 Proof of Strong Duality (cont.) Let z = OPT(primal) = So the final dictionary states that z = n e.g. z = 10 x 5 x 6 2x 7 n c j xj n+m c j xj γ k x k k=1 n+m = z γ k x k k=1 = OPT(primal) n+m k=1 γ k x k
28 8/39 Proof: Some Algebra nx n+m X c j x j = OPT γ k x k = OPT = OPT = OPT = OPT = OPT k=1 nx γ k x k k=1 n+m X k=n+1 γ k x k nx mx γ j x j γ n+i x n+i nx mx γ j x j yi x n+i nx mx γ j x j mx b i y i! + y i nx b i mx! nx a ij x j a ij y i γ j! x j
29 29/39 Proof: Dual Feasibility ( n c j x j = OPT b i y i ) + ( n m ) a ij yi γ j x j But this equality is true for all choices of {x 1, x 2,..., x n }. So it must be that c j = a ij y i But γ j 0, and so we have feasibility γ j (2) a ij y i c j
30 30/39 Proof: Dual Optimality ( n c j x j = OPT b i y i ) + ( n m ) a ij yi γ j x j But this equality is true for all choices of {x 1, x 2,..., x n }. So it must be that Thus we have strong duality OPT(primal) b i y i = 0 (1) b i y i = OPT(primal) = n c j xj
31 31/39 Part IV Complementary Slackness
32 2/39 Weak Duality Recall for any feasible solutions {x 1, x 2,..., x n } and {y 1, y 2,..., y m } n x j c j = n x j a ij y i y i n a ij x j y i b i
33 33/39 Strong Duality By strong duality, we must have equalities for the optimal solutions {x 1, x 2,..., x n} and {y 1, y 2,..., y m} n xj c j = = = n xj y i y i a ij y i n a ij xj b i
34 34/39 Some Observations P n x j c j = P n x j Pm a ijyi = P m y i Pn a ijxj P = m y b i So, by strong duality, we have We also have i x j c j = x j y i n a ij xi From these observations we obtain... = y i a ij y i b i
35 35/39 Complementary Slackness Complementary Slackness Theorem. A primal feasible solution (x 1, x 2,..., x n) and a dual feasible solution (y 1, y 2,..., y m) are both optimal if and only if and x j > 0 y i > 0 a ij y i = c j j [n] a ij xj = b i i [m]
36 36/39 Part V Consequences of Strong Duality
37 37/39 Running Times It is easy to check that the dual of the dual is the primal. So solving the dual will also give an optimal primal solution. Recall the # pivots is typically linear in the number of constraints. The # constraints in the dual is just the # variables, n, in the primal. Thus O(n) pivots are typically needed to solve the dual. So solving the dual can be far quicker than solving the primal!
38 38/39 Dual Variables We have seen many examples where the dual problem often has a nice combinatorial meaning. In economic problems often the primal variables correspond to allocations and the dual variables to prices.
39 39/39 Certificates The simplex algorithm gives us a certificate of optimality. Given a primal solution x the dual solution y proves x is optimal. [So always check that the x you found is optimal!] So a certificate let s us know when to stop searching. Certificates seem fundamental in assessing the hardness of problems...
Lecture 5. x 1,x 2,x 3 0 (1)
Computational Intractability Revised 2011/6/6 Lecture 5 Professor: David Avis Scribe:Ma Jiangbo, Atsuki Nagao 1 Duality The purpose of this lecture is to introduce duality, which is an important concept
More informationThe Simplex Algorithm: Technicalities 1
1/45 The Simplex Algorithm: Technicalities 1 Adrian Vetta 1 This presentation is based upon the book Linear Programming by Vasek Chvatal 2/45 Two Issues Here we discuss two potential problems with the
More informationExample Problem. Linear Program (standard form) CSCI5654 (Linear Programming, Fall 2013) Lecture-7. Duality
CSCI5654 (Linear Programming, Fall 013) Lecture-7 Duality Lecture 7 Slide# 1 Lecture 7 Slide# Linear Program (standard form) Example Problem maximize c 1 x 1 + + c n x n s.t. a j1 x 1 + + a jn x n b j
More informationThe Simplex Algorithm
8.433 Combinatorial Optimization The Simplex Algorithm October 6, 8 Lecturer: Santosh Vempala We proved the following: Lemma (Farkas). Let A R m n, b R m. Exactly one of the following conditions is true:.
More informationOptimisation and Operations Research
Optimisation and Operations Research Lecture 9: Duality and Complementary Slackness Matthew Roughan http://www.maths.adelaide.edu.au/matthew.roughan/ Lecture_notes/OORII/
More informationLinear Programming: Chapter 5 Duality
Linear Programming: Chapter 5 Duality Robert J. Vanderbei September 30, 2010 Slides last edited on October 5, 2010 Operations Research and Financial Engineering Princeton University Princeton, NJ 08544
More informationThe use of shadow price is an example of sensitivity analysis. Duality theory can be applied to do other kind of sensitivity analysis:
Sensitivity analysis The use of shadow price is an example of sensitivity analysis. Duality theory can be applied to do other kind of sensitivity analysis: Changing the coefficient of a nonbasic variable
More informationChap6 Duality Theory and Sensitivity Analysis
Chap6 Duality Theory and Sensitivity Analysis The rationale of duality theory Max 4x 1 + x 2 + 5x 3 + 3x 4 S.T. x 1 x 2 x 3 + 3x 4 1 5x 1 + x 2 + 3x 3 + 8x 4 55 x 1 + 2x 2 + 3x 3 5x 4 3 x 1 ~x 4 0 If we
More informationThe Primal-Dual Algorithm P&S Chapter 5 Last Revised October 30, 2006
The Primal-Dual Algorithm P&S Chapter 5 Last Revised October 30, 2006 1 Simplex solves LP by starting at a Basic Feasible Solution (BFS) and moving from BFS to BFS, always improving the objective function,
More informationNote 3: LP Duality. If the primal problem (P) in the canonical form is min Z = n (1) then the dual problem (D) in the canonical form is max W = m (2)
Note 3: LP Duality If the primal problem (P) in the canonical form is min Z = n j=1 c j x j s.t. nj=1 a ij x j b i i = 1, 2,..., m (1) x j 0 j = 1, 2,..., n, then the dual problem (D) in the canonical
More informationMATH2070 Optimisation
MATH2070 Optimisation Linear Programming Semester 2, 2012 Lecturer: I.W. Guo Lecture slides courtesy of J.R. Wishart Review The standard Linear Programming (LP) Problem Graphical method of solving LP problem
More informationReview Solutions, Exam 2, Operations Research
Review Solutions, Exam 2, Operations Research 1. Prove the weak duality theorem: For any x feasible for the primal and y feasible for the dual, then... HINT: Consider the quantity y T Ax. SOLUTION: To
More informationCSCI5654 (Linear Programming, Fall 2013) Lecture-8. Lecture 8 Slide# 1
CSCI5654 (Linear Programming, Fall 2013) Lecture-8 Lecture 8 Slide# 1 Today s Lecture 1. Recap of dual variables and strong duality. 2. Complementary Slackness Theorem. 3. Interpretation of dual variables.
More informationMVE165/MMG631 Linear and integer optimization with applications Lecture 5 Linear programming duality and sensitivity analysis
MVE165/MMG631 Linear and integer optimization with applications Lecture 5 Linear programming duality and sensitivity analysis Ann-Brith Strömberg 2017 03 29 Lecture 4 Linear and integer optimization with
More informationPart 1. The Review of Linear Programming
In the name of God Part 1. The Review of Linear Programming 1.5. Spring 2010 Instructor: Dr. Masoud Yaghini Outline Introduction Formulation of the Dual Problem Primal-Dual Relationship Economic Interpretation
More informationAlgorithmic Game Theory and Applications. Lecture 7: The LP Duality Theorem
Algorithmic Game Theory and Applications Lecture 7: The LP Duality Theorem Kousha Etessami recall LP s in Primal Form 1 Maximize c 1 x 1 + c 2 x 2 +... + c n x n a 1,1 x 1 + a 1,2 x 2 +... + a 1,n x n
More information1 Review Session. 1.1 Lecture 2
1 Review Session Note: The following lists give an overview of the material that was covered in the lectures and sections. Your TF will go through these lists. If anything is unclear or you have questions
More informationLinear and Combinatorial Optimization
Linear and Combinatorial Optimization The dual of an LP-problem. Connections between primal and dual. Duality theorems and complementary slack. Philipp Birken (Ctr. for the Math. Sc.) Lecture 3: Duality
More information(P ) Minimize 4x 1 + 6x 2 + 5x 3 s.t. 2x 1 3x 3 3 3x 2 2x 3 6
The exam is three hours long and consists of 4 exercises. The exam is graded on a scale 0-25 points, and the points assigned to each question are indicated in parenthesis within the text. Problem 1 Consider
More informationIntroduction to Mathematical Programming IE406. Lecture 10. Dr. Ted Ralphs
Introduction to Mathematical Programming IE406 Lecture 10 Dr. Ted Ralphs IE406 Lecture 10 1 Reading for This Lecture Bertsimas 4.1-4.3 IE406 Lecture 10 2 Duality Theory: Motivation Consider the following
More informationSensitivity Analysis and Duality in LP
Sensitivity Analysis and Duality in LP Xiaoxi Li EMS & IAS, Wuhan University Oct. 13th, 2016 (week vi) Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) 1 /
More information3. Duality: What is duality? Why does it matter? Sensitivity through duality.
1 Overview of lecture (10/5/10) 1. Review Simplex Method 2. Sensitivity Analysis: How does solution change as parameters change? How much is the optimal solution effected by changing A, b, or c? How much
More informationSensitivity Analysis and Duality
Sensitivity Analysis and Duality Part II Duality Based on Chapter 6 Introduction to Mathematical Programming: Operations Research, Volume 1 4th edition, by Wayne L. Winston and Munirpallam Venkataramanan
More informationLinear Programming Duality P&S Chapter 3 Last Revised Nov 1, 2004
Linear Programming Duality P&S Chapter 3 Last Revised Nov 1, 2004 1 In this section we lean about duality, which is another way to approach linear programming. In particular, we will see: How to define
More informationSlack Variable. Max Z= 3x 1 + 4x 2 + 5X 3. Subject to: X 1 + X 2 + X x 1 + 4x 2 + X X 1 + X 2 + 4X 3 10 X 1 0, X 2 0, X 3 0
Simplex Method Slack Variable Max Z= 3x 1 + 4x 2 + 5X 3 Subject to: X 1 + X 2 + X 3 20 3x 1 + 4x 2 + X 3 15 2X 1 + X 2 + 4X 3 10 X 1 0, X 2 0, X 3 0 Standard Form Max Z= 3x 1 +4x 2 +5X 3 + 0S 1 + 0S 2
More informationUnderstanding the Simplex algorithm. Standard Optimization Problems.
Understanding the Simplex algorithm. Ma 162 Spring 2011 Ma 162 Spring 2011 February 28, 2011 Standard Optimization Problems. A standard maximization problem can be conveniently described in matrix form
More informationSummary of the simplex method
MVE165/MMG630, The simplex method; degeneracy; unbounded solutions; infeasibility; starting solutions; duality; interpretation Ann-Brith Strömberg 2012 03 16 Summary of the simplex method Optimality condition:
More informationIntroduction to optimization
Introduction to optimization Geir Dahl CMA, Dept. of Mathematics and Dept. of Informatics University of Oslo 1 / 24 The plan 1. The basic concepts 2. Some useful tools (linear programming = linear optimization)
More informationFarkas Lemma, Dual Simplex and Sensitivity Analysis
Summer 2011 Optimization I Lecture 10 Farkas Lemma, Dual Simplex and Sensitivity Analysis 1 Farkas Lemma Theorem 1. Let A R m n, b R m. Then exactly one of the following two alternatives is true: (i) x
More informationEND3033 Operations Research I Sensitivity Analysis & Duality. to accompany Operations Research: Applications and Algorithms Fatih Cavdur
END3033 Operations Research I Sensitivity Analysis & Duality to accompany Operations Research: Applications and Algorithms Fatih Cavdur Introduction Consider the following problem where x 1 and x 2 corresponds
More informationFoundations of Operations Research
Solved exercises for the course of Foundations of Operations Research Roberto Cordone The dual simplex method Given the following LP problem: maxz = 5x 1 +8x 2 x 1 +x 2 6 5x 1 +9x 2 45 x 1,x 2 0 1. solve
More informationSAMPLE QUESTIONS. b = (30, 20, 40, 10, 50) T, c = (650, 1000, 1350, 1600, 1900) T.
SAMPLE QUESTIONS. (a) We first set up some constant vectors for our constraints. Let b = (30, 0, 40, 0, 0) T, c = (60, 000, 30, 600, 900) T. Then we set up variables x ij, where i, j and i + j 6. By using
More informationU.C. Berkeley CS294: Beyond Worst-Case Analysis Handout 12 Luca Trevisan October 3, 2017
U.C. Berkeley CS94: Beyond Worst-Case Analysis Handout 1 Luca Trevisan October 3, 017 Scribed by Maxim Rabinovich Lecture 1 In which we begin to prove that the SDP relaxation exactly recovers communities
More informationLINEAR PROGRAMMING. Relation to the Text (cont.) Relation to Material in Text. Relation to the Text. Relation to the Text (cont.
LINEAR PROGRAMMING Relation to Material in Text After a brief introduction to linear programming on p. 3, Cornuejols and Tϋtϋncϋ give a theoretical discussion including duality, and the simplex solution
More information4.6 Linear Programming duality
4.6 Linear Programming duality To any minimization (maximization) LP we can associate a closely related maximization (minimization) LP Different spaces and objective functions but in general same optimal
More information+ 5x 2. = x x. + x 2. Transform the original system into a system x 2 = x x 1. = x 1
University of California, Davis Department of Agricultural and Resource Economics ARE 5 Optimization with Economic Applications Lecture Notes Quirino Paris The Pivot Method for Solving Systems of Equations...................................
More informationMAT016: Optimization
MAT016: Optimization M.El Ghami e-mail: melghami@ii.uib.no URL: http://www.ii.uib.no/ melghami/ March 29, 2011 Outline for today The Simplex method in matrix notation Managing a production facility The
More informationChapter 1 Linear Programming. Paragraph 5 Duality
Chapter 1 Linear Programming Paragraph 5 Duality What we did so far We developed the 2-Phase Simplex Algorithm: Hop (reasonably) from basic solution (bs) to bs until you find a basic feasible solution
More informationChapter 3, Operations Research (OR)
Chapter 3, Operations Research (OR) Kent Andersen February 7, 2007 1 Linear Programs (continued) In the last chapter, we introduced the general form of a linear program, which we denote (P) Minimize Z
More informationCSCI 1951-G Optimization Methods in Finance Part 01: Linear Programming
CSCI 1951-G Optimization Methods in Finance Part 01: Linear Programming January 26, 2018 1 / 38 Liability/asset cash-flow matching problem Recall the formulation of the problem: max w c 1 + p 1 e 1 = 150
More informationLINEAR PROGRAMMING 2. In many business and policy making situations the following type of problem is encountered:
LINEAR PROGRAMMING 2 In many business and policy making situations the following type of problem is encountered: Maximise an objective subject to (in)equality constraints. Mathematical programming provides
More informationIntroduction to Mathematical Programming IE406. Lecture 13. Dr. Ted Ralphs
Introduction to Mathematical Programming IE406 Lecture 13 Dr. Ted Ralphs IE406 Lecture 13 1 Reading for This Lecture Bertsimas Chapter 5 IE406 Lecture 13 2 Sensitivity Analysis In many real-world problems,
More informationIE 5531: Engineering Optimization I
IE 5531: Engineering Optimization I Lecture 7: Duality and applications Prof. John Gunnar Carlsson September 29, 2010 Prof. John Gunnar Carlsson IE 5531: Engineering Optimization I September 29, 2010 1
More informationLecture 11: Post-Optimal Analysis. September 23, 2009
Lecture : Post-Optimal Analysis September 23, 2009 Today Lecture Dual-Simplex Algorithm Post-Optimal Analysis Chapters 4.4 and 4.5. IE 30/GE 330 Lecture Dual Simplex Method The dual simplex method will
More information3 The Simplex Method. 3.1 Basic Solutions
3 The Simplex Method 3.1 Basic Solutions In the LP of Example 2.3, the optimal solution happened to lie at an extreme point of the feasible set. This was not a coincidence. Consider an LP in general form,
More informationSensitivity Analysis
Dr. Maddah ENMG 500 /9/07 Sensitivity Analysis Changes in the RHS (b) Consider an optimal LP solution. Suppose that the original RHS (b) is changed from b 0 to b new. In the following, we study the affect
More informationSOLVING INTEGER LINEAR PROGRAMS. 1. Solving the LP relaxation. 2. How to deal with fractional solutions?
SOLVING INTEGER LINEAR PROGRAMS 1. Solving the LP relaxation. 2. How to deal with fractional solutions? Integer Linear Program: Example max x 1 2x 2 0.5x 3 0.2x 4 x 5 +0.6x 6 s.t. x 1 +2x 2 1 x 1 + x 2
More information(includes both Phases I & II)
(includes both Phases I & II) Dennis ricker Dept of Mechanical & Industrial Engineering The University of Iowa Revised Simplex Method 09/23/04 page 1 of 22 Minimize z=3x + 5x + 4x + 7x + 5x + 4x subject
More informationStandard Form An LP is in standard form when: All variables are non-negativenegative All constraints are equalities Putting an LP formulation into sta
Chapter 4 Linear Programming: The Simplex Method An Overview of the Simplex Method Standard Form Tableau Form Setting Up the Initial Simplex Tableau Improving the Solution Calculating the Next Tableau
More informationThe Simplex Method. Formulate Constrained Maximization or Minimization Problem. Convert to Standard Form. Convert to Canonical Form
The Simplex Method 1 The Simplex Method Formulate Constrained Maximization or Minimization Problem Convert to Standard Form Convert to Canonical Form Set Up the Tableau and the Initial Basic Feasible Solution
More information4. Duality and Sensitivity
4. Duality and Sensitivity For every instance of an LP, there is an associated LP known as the dual problem. The original problem is known as the primal problem. There are two de nitions of the dual pair
More informationLecture 10: Linear programming. duality. and. The dual of the LP in standard form. maximize w = b T y (D) subject to A T y c, minimize z = c T x (P)
Lecture 10: Linear programming duality Michael Patriksson 19 February 2004 0-0 The dual of the LP in standard form minimize z = c T x (P) subject to Ax = b, x 0 n, and maximize w = b T y (D) subject to
More informationDuality. Peter Bro Mitersen (University of Aarhus) Optimization, Lecture 9 February 28, / 49
Duality Maximize c T x for x F = {x (R + ) n Ax b} If we guess x F, we can say that c T x is a lower bound for the optimal value without executing the simplex algorithm. Can we make similar easy guesses
More informationRelation of Pure Minimum Cost Flow Model to Linear Programming
Appendix A Page 1 Relation of Pure Minimum Cost Flow Model to Linear Programming The Network Model The network pure minimum cost flow model has m nodes. The external flows given by the vector b with m
More informationIn the original knapsack problem, the value of the contents of the knapsack is maximized subject to a single capacity constraint, for example weight.
In the original knapsack problem, the value of the contents of the knapsack is maximized subject to a single capacity constraint, for example weight. In the multi-dimensional knapsack problem, additional
More informationMotivating examples Introduction to algorithms Simplex algorithm. On a particular example General algorithm. Duality An application to game theory
Instructor: Shengyu Zhang 1 LP Motivating examples Introduction to algorithms Simplex algorithm On a particular example General algorithm Duality An application to game theory 2 Example 1: profit maximization
More informationIntroduction to Mathematical Programming
Introduction to Mathematical Programming Ming Zhong Lecture 22 October 22, 2018 Ming Zhong (JHU) AMS Fall 2018 1 / 16 Table of Contents 1 The Simplex Method, Part II Ming Zhong (JHU) AMS Fall 2018 2 /
More informationLinear programming. Saad Mneimneh. maximize x 1 + x 2 subject to 4x 1 x 2 8 2x 1 + x x 1 2x 2 2
Linear programming Saad Mneimneh 1 Introduction Consider the following problem: x 1 + x x 1 x 8 x 1 + x 10 5x 1 x x 1, x 0 The feasible solution is a point (x 1, x ) that lies within the region defined
More informationIntroduction. Very efficient solution procedure: simplex method.
LINEAR PROGRAMMING Introduction Development of linear programming was among the most important scientific advances of mid 20th cent. Most common type of applications: allocate limited resources to competing
More informationLinear Programming Duality
Summer 2011 Optimization I Lecture 8 1 Duality recap Linear Programming Duality We motivated the dual of a linear program by thinking about the best possible lower bound on the optimal value we can achieve
More informationA Review of Linear Programming
A Review of Linear Programming Instructor: Farid Alizadeh IEOR 4600y Spring 2001 February 14, 2001 1 Overview In this note we review the basic properties of linear programming including the primal simplex
More informationSupplementary lecture notes on linear programming. We will present an algorithm to solve linear programs of the form. maximize.
Cornell University, Fall 2016 Supplementary lecture notes on linear programming CS 6820: Algorithms 26 Sep 28 Sep 1 The Simplex Method We will present an algorithm to solve linear programs of the form
More informationUNIVERSITY of LIMERICK
UNIVERSITY of LIMERICK OLLSCOIL LUIMNIGH Department of Mathematics & Statistics Faculty of Science and Engineering END OF SEMESTER ASSESSMENT PAPER MODULE CODE: MS4303 SEMESTER: Spring 2018 MODULE TITLE:
More informationBBM402-Lecture 20: LP Duality
BBM402-Lecture 20: LP Duality Lecturer: Lale Özkahya Resources for the presentation: https://courses.engr.illinois.edu/cs473/fa2016/lectures.html An easy LP? which is compact form for max cx subject to
More informationEE364a Review Session 5
EE364a Review Session 5 EE364a Review announcements: homeworks 1 and 2 graded homework 4 solutions (check solution to additional problem 1) scpd phone-in office hours: tuesdays 6-7pm (650-723-1156) 1 Complementary
More informationc) Place the Coefficients from all Equations into a Simplex Tableau, labeled above with variables indicating their respective columns
BUILDING A SIMPLEX TABLEAU AND PROPER PIVOT SELECTION Maximize : 15x + 25y + 18 z s. t. 2x+ 3y+ 4z 60 4x+ 4y+ 2z 100 8x+ 5y 80 x 0, y 0, z 0 a) Build Equations out of each of the constraints above by introducing
More informationmin 4x 1 5x 2 + 3x 3 s.t. x 1 + 2x 2 + x 3 = 10 x 1 x 2 6 x 1 + 3x 2 + x 3 14
The exam is three hours long and consists of 4 exercises. The exam is graded on a scale 0-25 points, and the points assigned to each question are indicated in parenthesis within the text. If necessary,
More informationTopic: Primal-Dual Algorithms Date: We finished our discussion of randomized rounding and began talking about LP Duality.
CS787: Advanced Algorithms Scribe: Amanda Burton, Leah Kluegel Lecturer: Shuchi Chawla Topic: Primal-Dual Algorithms Date: 10-17-07 14.1 Last Time We finished our discussion of randomized rounding and
More informationAM 121 Introduction to Optimization: Models and Methods Example Questions for Midterm 1
AM 121 Introduction to Optimization: Models and Methods Example Questions for Midterm 1 Prof. Yiling Chen Fall 2018 Here are some practice questions to help to prepare for the midterm. The midterm will
More informationCO350 Linear Programming Chapter 6: The Simplex Method
CO50 Linear Programming Chapter 6: The Simplex Method rd June 2005 Chapter 6: The Simplex Method 1 Recap Suppose A is an m-by-n matrix with rank m. max. c T x (P ) s.t. Ax = b x 0 On Wednesday, we learned
More information(includes both Phases I & II)
Minimize z=3x 5x 4x 7x 5x 4x subject to 2x x2 x4 3x6 0 x 3x3 x4 3x5 2x6 2 4x2 2x3 3x4 x5 5 and x 0 j, 6 2 3 4 5 6 j ecause of the lack of a slack variable in each constraint, we must use Phase I to find
More informationMATH 445/545 Homework 2: Due March 3rd, 2016
MATH 445/545 Homework 2: Due March 3rd, 216 Answer the following questions. Please include the question with the solution (write or type them out doing this will help you digest the problem). I do not
More informationII. Analysis of Linear Programming Solutions
Optimization Methods Draft of August 26, 2005 II. Analysis of Linear Programming Solutions Robert Fourer Department of Industrial Engineering and Management Sciences Northwestern University Evanston, Illinois
More informationF 1 F 2 Daily Requirement Cost N N N
Chapter 5 DUALITY 5. The Dual Problems Every linear programming problem has associated with it another linear programming problem and that the two problems have such a close relationship that whenever
More information1. Algebraic and geometric treatments Consider an LP problem in the standard form. x 0. Solutions to the system of linear equations
The Simplex Method Most textbooks in mathematical optimization, especially linear programming, deal with the simplex method. In this note we study the simplex method. It requires basically elementary linear
More information- Well-characterized problems, min-max relations, approximate certificates. - LP problems in the standard form, primal and dual linear programs
LP-Duality ( Approximation Algorithms by V. Vazirani, Chapter 12) - Well-characterized problems, min-max relations, approximate certificates - LP problems in the standard form, primal and dual linear programs
More informationOPTIMISATION 2007/8 EXAM PREPARATION GUIDELINES
General: OPTIMISATION 2007/8 EXAM PREPARATION GUIDELINES This points out some important directions for your revision. The exam is fully based on what was taught in class: lecture notes, handouts and homework.
More informationDual Basic Solutions. Observation 5.7. Consider LP in standard form with A 2 R m n,rank(a) =m, and dual LP:
Dual Basic Solutions Consider LP in standard form with A 2 R m n,rank(a) =m, and dual LP: Observation 5.7. AbasisB yields min c T x max p T b s.t. A x = b s.t. p T A apple c T x 0 aprimalbasicsolutiongivenbyx
More informationDecember 2014 MATH 340 Name Page 2 of 10 pages
December 2014 MATH 340 Name Page 2 of 10 pages Marks [8] 1. Find the value of Alice announces a pure strategy and Betty announces a pure strategy for the matrix game [ ] 1 4 A =. 5 2 Find the value of
More informationLinear Programming, Lecture 4
Linear Programming, Lecture 4 Corbett Redden October 3, 2016 Simplex Form Conventions Examples Simplex Method To run the simplex method, we start from a Linear Program (LP) in the following standard simplex
More informationDuality Theory, Optimality Conditions
5.1 Duality Theory, Optimality Conditions Katta G. Murty, IOE 510, LP, U. Of Michigan, Ann Arbor We only consider single objective LPs here. Concept of duality not defined for multiobjective LPs. Every
More informationDEPARTMENT OF STATISTICS AND OPERATIONS RESEARCH OPERATIONS RESEARCH DETERMINISTIC QUALIFYING EXAMINATION. Part I: Short Questions
DEPARTMENT OF STATISTICS AND OPERATIONS RESEARCH OPERATIONS RESEARCH DETERMINISTIC QUALIFYING EXAMINATION Part I: Short Questions August 12, 2008 9:00 am - 12 pm General Instructions This examination is
More informationThe Simplex Method. Lecture 5 Standard and Canonical Forms and Setting up the Tableau. Lecture 5 Slide 1. FOMGT 353 Introduction to Management Science
The Simplex Method Lecture 5 Standard and Canonical Forms and Setting up the Tableau Lecture 5 Slide 1 The Simplex Method Formulate Constrained Maximization or Minimization Problem Convert to Standard
More informationSystems Analysis in Construction
Systems Analysis in Construction CB312 Construction & Building Engineering Department- AASTMT by A h m e d E l h a k e e m & M o h a m e d S a i e d 3. Linear Programming Optimization Simplex Method 135
More informationLecture Simplex Issues: Number of Pivots. ORIE 6300 Mathematical Programming I October 9, 2014
ORIE 6300 Mathematical Programming I October 9, 2014 Lecturer: David P. Williamson Lecture 14 Scribe: Calvin Wylie 1 Simplex Issues: Number of Pivots Question: How many pivots does the simplex algorithm
More informationAnswers to problems. Chapter 1. Chapter (0, 0) (3.5,0) (0,4.5) (2, 3) 2.1(a) Last tableau. (b) Last tableau /2 -3/ /4 3/4 1/4 2.
Answers to problems Chapter 1 1.1. (0, 0) (3.5,0) (0,4.5) (, 3) Chapter.1(a) Last tableau X4 X3 B /5 7/5 x -3/5 /5 Xl 4/5-1/5 8 3 Xl =,X =3,B=8 (b) Last tableau c Xl -19/ X3-3/ -7 3/4 1/4 4.5 5/4-1/4.5
More informationFundamentals of Operations Research. Prof. G. Srinivasan. Indian Institute of Technology Madras. Lecture No. # 15
Fundamentals of Operations Research Prof. G. Srinivasan Indian Institute of Technology Madras Lecture No. # 15 Transportation Problem - Other Issues Assignment Problem - Introduction In the last lecture
More informationPart IB Optimisation
Part IB Optimisation Theorems Based on lectures by F. A. Fischer Notes taken by Dexter Chua Easter 2015 These notes are not endorsed by the lecturers, and I have modified them (often significantly) after
More informationLinear Programming Redux
Linear Programming Redux Jim Bremer May 12, 2008 The purpose of these notes is to review the basics of linear programming and the simplex method in a clear, concise, and comprehensive way. The book contains
More informationMidterm Review. Yinyu Ye Department of Management Science and Engineering Stanford University Stanford, CA 94305, U.S.A.
Midterm Review Yinyu Ye Department of Management Science and Engineering Stanford University Stanford, CA 94305, U.S.A. http://www.stanford.edu/ yyye (LY, Chapter 1-4, Appendices) 1 Separating hyperplane
More informationMath 16 - Practice Final
Math 16 - Practice Final May 28th 2007 Name: Instructions 1. In Part A, attempt every question. In Part B, attempt two of the five questions. If you attempt more you will only receive credit for your best
More informationCOT 6936: Topics in Algorithms! Giri Narasimhan. ECS 254A / EC 2443; Phone: x3748
COT 6936: Topics in Algorithms! Giri Narasimhan ECS 254A / EC 2443; Phone: x3748 giri@cs.fiu.edu https://moodle.cis.fiu.edu/v2.1/course/view.php?id=612 Gaussian Elimination! Solving a system of simultaneous
More informationLecture Notes 3: Duality
Algorithmic Methods 1/11/21 Professor: Yossi Azar Lecture Notes 3: Duality Scribe:Moran Bar-Gat 1 Introduction In this lecture we will present the dual concept, Farkas s Lema and their relation to the
More informationYinyu Ye, MS&E, Stanford MS&E310 Lecture Note #06. The Simplex Method
The Simplex Method Yinyu Ye Department of Management Science and Engineering Stanford University Stanford, CA 94305, U.S.A. http://www.stanford.edu/ yyye (LY, Chapters 2.3-2.5, 3.1-3.4) 1 Geometry of Linear
More informationMarch 13, Duality 3
15.53 March 13, 27 Duality 3 There are concepts much more difficult to grasp than duality in linear programming. -- Jim Orlin The concept [of nonduality], often described in English as "nondualism," is
More informationTRINITY COLLEGE DUBLIN THE UNIVERSITY OF DUBLIN. School of Mathematics
JS and SS Mathematics JS and SS TSM Mathematics TRINITY COLLEGE DUBLIN THE UNIVERSITY OF DUBLIN School of Mathematics MA3484 Methods of Mathematical Economics Trinity Term 2015 Saturday GOLDHALL 09.30
More informationOPTIMISATION 3: NOTES ON THE SIMPLEX ALGORITHM
OPTIMISATION 3: NOTES ON THE SIMPLEX ALGORITHM Abstract These notes give a summary of the essential ideas and results It is not a complete account; see Winston Chapters 4, 5 and 6 The conventions and notation
More informationCSC373: Algorithm Design, Analysis and Complexity Fall 2017 DENIS PANKRATOV NOVEMBER 1, 2017
CSC373: Algorithm Design, Analysis and Complexity Fall 2017 DENIS PANKRATOV NOVEMBER 1, 2017 Linear Function f: R n R is linear if it can be written as f x = a T x for some a R n Example: f x 1, x 2 =
More informationCOMP3121/9101/3821/9801 Lecture Notes. Linear Programming
COMP3121/9101/3821/9801 Lecture Notes Linear Programming LiC: Aleks Ignjatovic THE UNIVERSITY OF NEW SOUTH WALES School of Computer Science and Engineering The University of New South Wales Sydney 2052,
More informationOperations Research. Duality in linear programming.
Operations Research Duality in linear programming Duality in linear programming As we have seen in past lessons, linear programming are either maximization or minimization type, containing m conditions
More information