Sensitivity Analysis and Duality in LP
|
|
- Darren Scott
- 5 years ago
- Views:
Transcription
1 Sensitivity Analysis and Duality in LP Xiaoxi Li EMS & IAS, Wuhan University Oct. 13th, 2016 (week vi) Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) 1 / 35
2 Organization of this lecture Contents: Sensitivity Analysis Duality Shadow price and reduced cost Change in the RHS constants (resource s capacity) Change in objective coefficients (unit revenue) Formulation of the Primal-Dual problems Duality properties: weak, strong, and the complementary slackness Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) 2 / 35
3 Sensitivity Analysis Question after solving a LP problem: How does the optimal solution / value change in response to modification of LP model data? In what range of the LP model data is an optimal solution robust? Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) 3 / 35
4 Motivation for these questions: allowance for certain error in modelling phase; management decisions in response to market or technology adjustment: i.e. whether to purchase/rent additional resource(s) if available; open a new production line if possible; modify the production plan facing changing in demand (unit revenue). Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) 4 / 35
5 An example under consideration: Maximize z = 5x x 2 + 6x 3 6x 1 + 5x 2 + 8x x x x s.t. x x 1, x 2, x (0.1) After applying the simplex method, we obtain the final simplex tableau: Eq. Basic variables z x 1 x 2 x 3 s 1 s 2 s 3 RHS (0) z (1) x (2) s (3) x Basic variables: {x 2,s 3,x 1 }; Nonbasic variables: {x 3,s 1,s 2 }. Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) 5 / 35
6 Shadow price Question: how would the optimal value change if we increase one unit of Resource (1), (2) or (3)? At the optimal solution, s 1 and s 2 are nonbasic variables, equal to zero: both Constraint (1) and Constraint (2) bind and both resources are exhausted. s 3 is basic variable, equal to 11/: Resource (3), which is the limit production for Activity 1, has 11/ units un-used. Intuitively, increasing or decreasing the capacity of Resource (3) by a little bit will have no effect on the optimal solution/value; while increasing or decreasing the capacity of Resource (1) or Resource (2) even by a little bit will change the optimal solution/value. The Shadow price for a resource/constraint is the changing rate of the optimal value in the resource capacity when the modification is small. Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) 6 / 35
7 Computation of Shadow price A nice property: there is no need to re-do the simplex method so as to obtain the shadow prices; rather, they can be red directly from the final (optimal) simplex tableau. Claim. The shadow price for a resource/functional constraint is the associated slack variable s coefficient in Eq (0) of the final (optimal) tableau. for a resource un-exhausted at optimum (basic variable), it is zero; for a resource exhausted at optimum (nonbasic variable), it is positive. For the example. y 1 = 11 14, y 2 = 1 35, y 3 = 0. Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) / 35
8 Shadow price Claim. The shadow price for a resource/constraint is the associated slack variable s coefficient in Eq (0) of the final (optimal) tableau. Proof. Consider an increase of small in Resource (i) s capacity, i.e. the LP is the same as before except that b i is replaced by b i +. w.l.o.g, we assume no tie during the application of the simplex method to the original LP problem. For small, the same operations of the simplex method applies for the perturbed problem also (why?). The obtained final (optimal) simplex tableau has the same entries as the the unperturbed one except for the RHS vector, which will be the sum of the unperturbed RHS vector and an "additional vector corresponding the coefficients for ". The "additional vector corresponding the coefficients for " is the same as the column for s i. Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) 8 / 35
9 To illustrate, consider in the example that b 1 = 60 is replaced by Eq. Basic variables z x 1 x 2 x 3 s 1 s 2 s 3 RHS (0) z (1) s (2) s (3) s Eq. Basic variables z x 1 x 2 x 3 s 1 s 2 s 3 RHS (0) z (1) x (2) s (3) x The initial and the final (optimal) simplex tableaux s 1 and have the same column vector along the computation. The final vector defines the changing rates of optimal value/solution. The same operations work for s 3 but the changing rates for optimal value/solution are all zero (check). Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) 9 / 35
10 Interpretations of the shadow price: Marginal worth to the LP problem of each resource. For an example, if some additional capacity of Resource (i) is available for purchasing with a unit price u i. Then it will not be profitable if this price is beyond its shadow price, i.e. u i > y i. Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) 10 / 35
11 Reduced cost Above we have defined and analysed the shadow price for each functional constraint. The shadow price for a nonnegative constraint has an analogous meaning. It is termed the "reduced cost" due to the fact: it is connected by " rather than " ", so an increase on the RHS entry (which is zero) means a restriction on x j, thus incurring a cost. Claim. The reduced cost for an activity/nonnegative constraint is the negative of the associated decision variable s coefficient in Eq (0) of the final (optimal) tableau. for an activity of positive production at optimum (basic), it is zero; for a resource of zero production at optimum (nonbasic), it is positive. Proof. The similar computation as that for the shadow price, except for an attention paid on the opposite sign. Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) 11 / 35
12 Eq. Basic variables z x 1 x 2 x 3 s 1 s 2 s 3 RHS (0) z (1) x (2) s (3) x For the example. c 1 = 0, c 2 = 0, c 3 = 4. Illustrations. At optimum, x 3 = 0 thus Activity (3) is not produced. By forcing a production of > 0 unit of Activity (3), a loss of 4 in the optimal value is induced. At optimum, x 1 = 6 3 > 0 and x 2 = 4 2 > 0 thus both Activity (1) and Activity (2) are produced. By forcing a production of (small) > 0 unit of either Activity (1) or Activity (2), a loss of zero in the optimal value is induced. Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) 12 / 35
13 A different way of computing Activity (j) s reduced cost c j involving the shadow prices {y i } and its unit revenue c j ; (pricing out an activity) reduced cost (net unit revenue) = unit revenue "marginal cost". c j = c j i a ij y i. Interpretations of the reduced cost. The reduced cost measures the unit worth (cost if it is negative) of opening a new production line. Consider a LP without Activity (3): it has the same optimal solution structure (basis, shadow prices...) as when Activity (3) is allowed. A negative reduced cost for Activity (3) implies that there is no need to consider open this production line; On the other hand, if c j is large enough so c j = c j i a ij y i > 0, then it should consider open this line. Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) 13 / 35
14 Change in the RHS constants: the optimum range The shadow price/reduced cost measures the changing rate of the optimal value in the RHS constant when the change is small. When the change of the RHS constant could be significant, we consider the optimum range within which the optimal basis remains the same. Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) 14 / 35
15 For small, the obtained final simplex tableau after adding unit of Resource (1) is: Eq. Basic variables z x 1 x 2 x 3 s 1 s 2 s 3 RHS (0) z (1) x (2) s (3) x To have the above tableau still optimal thus the optimal basis {x 2,s 3,x 1 } remains the same, we should have: x 2 = s 3 = x 1 = Thus the optimum range is: and 5 2 bnew Question: compute the optimum range for Resource (2) & (3), Activity 1, 2, 3. Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) 15 / 35
16 Change in the objective coefficients: the optimum range Generally, change in the objective coefficients is less sensitive to the optimal solution/value than the change in the RHS constants. Consider no "shadow price" here, but only the "optimum range". The optimum range for Activity j is the range of such that the optimal solution remains the same after c j is replaced by c j +. Consider a change in Activity j s coefficient from c j to c j +. In the perturbed LP problem, applying the same simplex-method operations as unperturbed will give a "final" simplex tableau almost the same as before, except for x j s coefficient in Eq. (0). Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) 16 / 35
17 To illustrate, we take the example and distinguish two types of activities at optimum of the unperturbed problem. x 3 is a nonbasic variable. The final tableau after operations (assure yourself that it is like this). Eq. Basic variables z x 1 x 2 x 3 s 1 s 2 s 3 RHS 4 (0) z (1) x (2) s (3) x To keep the same optimal solution unchanged, we should have: 4 0 4, thus cnew = 64. Question. Show that Activity 3 s optimum range is such that the new reduced cost for it remains nonnegative. Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) 1 / 35
18 x 1 or x 2 is a basic variable. The final tableau after operations (assure yourself that it is like this). Eq. Basic variables z x 1 x 2 x 3 s 1 s 2 s 3 RHS (0) z (1) x (2) s (3) x The above tableau is not optimal for 0 (since x 1 should be a basic variable!), a further operation "Eq.(0) =Eq.(0)+3 Eq.(3)" is needed. Eq. Basic z x 1 x 2 x 3 s 1 s 2 s 3 RHS 4 (0) z (1) x (2) s (3) x Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) 18 / 35
19 Now to have the optimal solution remain the same, we should have: Thus and , 4 11 cnew 1 = c Ex. Compute the optimum range for Activity 2. Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) 19 / 35
20 Duality in LP optimal dual variable y i = primal shadow price of Constraint (i); optimal primal variable x j = dual shadow price of Constraint (j). Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) 20 / 35
21 The shadow price and the duality The shadow prices y i = optimal multipliers of constraints, which measure the marginal worth of an additional unit of resource; can be used for pricing out an activity: Activity i s net marginal revenue (reduced cost) is computed as c j = c j j a ij y j. can be seen as the internal pricing mechanism within the firm for the allocation of scared resources to competing activities. Duality is a unifying theory that help develops the relationship between a given LP problem (the primal) and another one (the dual) stated in terms of variables with a shadow-price interpretation. This theory helps further understanding of the optimal multipliers in terms of shadow-price interpretation; helps take the advantage of the computational efficiency of the dual problem (over the primal one). Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) 21 / 35
22 Back to this example we have studied before: s.t. Maximize z = 5x x 2 + 6x 3 6x 1 + 5x 2 + 8x x x x x x 1, x 2, x After applying the simplex method, we obtain the final simplex tableau: Eq. Basic z x 1 x 2 x 3 s 1 s 2 s 3 RHS (0) z (1) x (2) s (3) x Basic variables: {x 2,s 3,x 1 }; Nonbasic variables: {x 3,s 1,s 2 }. Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) 22 / 35
23 Observations/properties of the shadow prices y i. Value and interpretation. Positive shadow price Zero shadow price y 1 = 14 11, y 2 = 35 1 y 3 = 0 s 1 and s 2 nonbasic s 3 basic Constraint (1) & (2) bind Constraint (3) does not bind Resource (1) & (2) exhausted Resource (3) has unused part Pricing out the activities ( c j = c j i a ij y i 0). Zero reduced cost Negative reduced cost c 1 = c 2 = 0 c 3 = 4 x 1, x 2 basic x 3 nonbasic Activity (1) & (2) produced Activity (3) not produced (1),(2): unit revenue = marginal cost (3): unit revenue < marginal cost Opportunity cost for consuming firm s resources (v = i b i y i ). v = = 360 = 51 3 v = z = j c j xj the optimal value of the (primal) LP problem. Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) 23 / 35
24 Imagine that the firm does not own these capacities of resources but has to rent them for the production (= minimize the rents). Then a dual LP problem, characterized by the above summarized properties of shadow prices, can be formulated as follows. s.t. Minimize v = 60y y 2 + 8y 3 6y y 2 + y 3 5 (1) 5y y (2) 8y y 2 6 (3) y 1, y 2, y 3 0 (+) Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) 24 / 35
25 Formulation of the primal-dual problem Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) 25 / 35
26 Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) 26 / 35
27 Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) 2 / 35
28 Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) 28 / 35
29 Properties of LP duality We consider the (P)-(D) formulation in standard form and write them in compact forms. Let c,x R n, A R m n, b,y R m. (P) Max x z = c T x s.t. Ax b, x 0. (D) Min y v = b T y s.t. A T y c, y 0. Verify. The dual of the dual problem (D) is the primal problem (P). Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) 29 / 35
30 Weak Duality Property Theorem (Weak Duality Property) Let x R n be a feasible solution to (P) and let ȳ R m be a feasible solution to (D). Then c T x ȳ T A x b T ȳ. Moreover, if c T x = b T ȳ, then x solves (P) and ȳ solves (D). Corollary If (P) is unbounded, then (D) is infeasible; if (D) is unbounded, then (P) is infeasible. Proof. in (P): A x b, ȳ 0 = ȳ T A x b T ȳ; in (D): A T ȳ c, x 0 = x T A T ȳ c T x. Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) 30 / 35
31 Strong Duality Property Theorem (Strong Duality Property) If either (P) or (D) has a finite optimal solution, then so does the other, and the optimal values are equal. Proof. Assume that (P) has a finite optimal solution x and let z = c T x be its optimal value. Let y R m be the associated shadow price vector for (P) s functional constraints. Properties of the shadow prices: reduced costs are nonpositive: c = c A T y 0; shadow prices are nonnegative: y 0; resources opportunity cost is equal to value of (P): b T y = z. The Weak Duality Property implies that b T y = z = c T x b T ȳ for any feasible ȳ to (D). Now we have shown that y is feasible, so it is optimal to (D). The other direction is the same since the dual of the dual is the primal. Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) 31 / 35
32 The Complementary Slackness Conditions Corollary Let (x,y) be a pair of feasible solutions to (P)-(D). Then (x,y) solves (P)-(D) iff. c T x = y T Ax = b T y ( ). Proof. Weak Duality Property ("if") + Strong Duality Property ("only if"). Theorem (Complementary Slackness Conditions) Let (x,y) be a pair of feasible solutions to (P)-(D). Then (x,y) solves (P)-(D) iff. Proof. either x j = 0 or i a ij y i = c j for j = 1,...,n; either y j = 0 or j a ij x i = b i for i = 1,...,m. ( ): x T (A T y c) = j x j ( i a ij y i c i ) = 0; feasibility: x j 0 and i a ij y i c i 0 for j = 1,...,n. Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) 32 / 35
33 The Complementary Slackness Conditions The following corollary can be used to check whether a given feasible solution solves the LP problem or not. Corollary (Complementary Slackness Conditions) Let x R n be a feasible solution to (P). Then x solves (P) iff. there exists a vector y R m feasible for D) such that the following holds: Proof. (i)for each i = 1,...,m, if j a ij x j < b i, then y i = 0, and (ii) for each i = 1,...,n, if x j > 0 then i a ij y i = c j. The "only if " part is implied by the Theorem (Complementary Slackness Conditions). To see the the "if " part, observe in the Theorem (Weak Duality Property) the inequality "c T x y T Ax b T y". Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) 33 / 35
34 The Complementary Slackness Conditions: an example We use the Corollary (Complementary Slackness Conditions) to check a particular point x = (4,3) is optimal to the LP problem: Maximize z = 3x 1 + 5x 2 x x s.t. 3x 1 + 2x x 1, x From item (i) in Corollary (Complementary Slackness Conditions): Constraint 1 : 4 = 4 = no condition on y 1 Constraint 2 : 2 3 = 6 < 12 = y 2 = 0 Constraint 3 : = 18 = no condition on y 3 (0.2) Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) 34 / 35
35 The Complementary Slackness Conditions: an example From item (ii) in Corollary (Complementary Slackness Conditions): { Activity 1 : x 1 = 4 > 0 = y 1 + 0y 2 + 3y 3 = 3 Activity 2 : x 2 = 3 > 0 = 0y 1 + 2y 2 + 2y 3 = 5 Putting the above three equations of (y 1,y 2,y 3 ) together: Constraint 2 : y 2 = 0 Activity 1 : y 1 + 3y 3 = 3 Activity 2 : 2y 2 + 2y 3 = 5 We solved that (y 1,y 2,y 3 ) = ( 9 2,0, 5 2 ), which is not feasible for dual problem of LP (0.2) since y 1 = 9 2 < 0. This implies that (4,3) is not optimal for the primal LP (0.2). Operations Research (Li, X.) Sensitivity Analysis and Duality in LP Oct. 13th, 2016 (week vi) 35 / 35
Introduction to Mathematical Programming IE406. Lecture 10. Dr. Ted Ralphs
Introduction to Mathematical Programming IE406 Lecture 10 Dr. Ted Ralphs IE406 Lecture 10 1 Reading for This Lecture Bertsimas 4.1-4.3 IE406 Lecture 10 2 Duality Theory: Motivation Consider the following
More informationPart 1. The Review of Linear Programming
In the name of God Part 1. The Review of Linear Programming 1.5. Spring 2010 Instructor: Dr. Masoud Yaghini Outline Introduction Formulation of the Dual Problem Primal-Dual Relationship Economic Interpretation
More informationSensitivity Analysis and Duality
Sensitivity Analysis and Duality Part II Duality Based on Chapter 6 Introduction to Mathematical Programming: Operations Research, Volume 1 4th edition, by Wayne L. Winston and Munirpallam Venkataramanan
More informationChap6 Duality Theory and Sensitivity Analysis
Chap6 Duality Theory and Sensitivity Analysis The rationale of duality theory Max 4x 1 + x 2 + 5x 3 + 3x 4 S.T. x 1 x 2 x 3 + 3x 4 1 5x 1 + x 2 + 3x 3 + 8x 4 55 x 1 + 2x 2 + 3x 3 5x 4 3 x 1 ~x 4 0 If we
More informationDuality Theory, Optimality Conditions
5.1 Duality Theory, Optimality Conditions Katta G. Murty, IOE 510, LP, U. Of Michigan, Ann Arbor We only consider single objective LPs here. Concept of duality not defined for multiobjective LPs. Every
More information4.6 Linear Programming duality
4.6 Linear Programming duality To any minimization (maximization) LP we can associate a closely related maximization (minimization) LP Different spaces and objective functions but in general same optimal
More informationLinear and Combinatorial Optimization
Linear and Combinatorial Optimization The dual of an LP-problem. Connections between primal and dual. Duality theorems and complementary slack. Philipp Birken (Ctr. for the Math. Sc.) Lecture 3: Duality
More informationUnderstanding the Simplex algorithm. Standard Optimization Problems.
Understanding the Simplex algorithm. Ma 162 Spring 2011 Ma 162 Spring 2011 February 28, 2011 Standard Optimization Problems. A standard maximization problem can be conveniently described in matrix form
More informationReview Solutions, Exam 2, Operations Research
Review Solutions, Exam 2, Operations Research 1. Prove the weak duality theorem: For any x feasible for the primal and y feasible for the dual, then... HINT: Consider the quantity y T Ax. SOLUTION: To
More informationThe use of shadow price is an example of sensitivity analysis. Duality theory can be applied to do other kind of sensitivity analysis:
Sensitivity analysis The use of shadow price is an example of sensitivity analysis. Duality theory can be applied to do other kind of sensitivity analysis: Changing the coefficient of a nonbasic variable
More informationF 1 F 2 Daily Requirement Cost N N N
Chapter 5 DUALITY 5. The Dual Problems Every linear programming problem has associated with it another linear programming problem and that the two problems have such a close relationship that whenever
More informationFarkas Lemma, Dual Simplex and Sensitivity Analysis
Summer 2011 Optimization I Lecture 10 Farkas Lemma, Dual Simplex and Sensitivity Analysis 1 Farkas Lemma Theorem 1. Let A R m n, b R m. Then exactly one of the following two alternatives is true: (i) x
More informationLecture 11: Post-Optimal Analysis. September 23, 2009
Lecture : Post-Optimal Analysis September 23, 2009 Today Lecture Dual-Simplex Algorithm Post-Optimal Analysis Chapters 4.4 and 4.5. IE 30/GE 330 Lecture Dual Simplex Method The dual simplex method will
More informationLinear Programming Duality P&S Chapter 3 Last Revised Nov 1, 2004
Linear Programming Duality P&S Chapter 3 Last Revised Nov 1, 2004 1 In this section we lean about duality, which is another way to approach linear programming. In particular, we will see: How to define
More informationChapter 1: Linear Programming
Chapter 1: Linear Programming Math 368 c Copyright 2013 R Clark Robinson May 22, 2013 Chapter 1: Linear Programming 1 Max and Min For f : D R n R, f (D) = {f (x) : x D } is set of attainable values of
More informationIE 5531: Engineering Optimization I
IE 5531: Engineering Optimization I Lecture 7: Duality and applications Prof. John Gunnar Carlsson September 29, 2010 Prof. John Gunnar Carlsson IE 5531: Engineering Optimization I September 29, 2010 1
More informationSimplex Method for LP (II)
Simplex Method for LP (II) Xiaoxi Li Wuhan University Sept. 27, 2017 (week 4) Operations Research (Li, X.) Simplex Method for LP (II) Sept. 27, 2017 (week 4) 1 / 31 Organization of this lecture Contents:
More informationII. Analysis of Linear Programming Solutions
Optimization Methods Draft of August 26, 2005 II. Analysis of Linear Programming Solutions Robert Fourer Department of Industrial Engineering and Management Sciences Northwestern University Evanston, Illinois
More informationMVE165/MMG631 Linear and integer optimization with applications Lecture 5 Linear programming duality and sensitivity analysis
MVE165/MMG631 Linear and integer optimization with applications Lecture 5 Linear programming duality and sensitivity analysis Ann-Brith Strömberg 2017 03 29 Lecture 4 Linear and integer optimization with
More informationSpecial cases of linear programming
Special cases of linear programming Infeasible solution Multiple solution (infinitely many solution) Unbounded solution Degenerated solution Notes on the Simplex tableau 1. The intersection of any basic
More informationOPERATIONS RESEARCH. Michał Kulej. Business Information Systems
OPERATIONS RESEARCH Michał Kulej Business Information Systems The development of the potential and academic programmes of Wrocław University of Technology Project co-financed by European Union within European
More informationOptimisation. 3/10/2010 Tibor Illés Optimisation
Optimisation Lectures 3 & 4: Linear Programming Problem Formulation Different forms of problems, elements of the simplex algorithm and sensitivity analysis Lecturer: Tibor Illés tibor.illes@strath.ac.uk
More informationEND3033 Operations Research I Sensitivity Analysis & Duality. to accompany Operations Research: Applications and Algorithms Fatih Cavdur
END3033 Operations Research I Sensitivity Analysis & Duality to accompany Operations Research: Applications and Algorithms Fatih Cavdur Introduction Consider the following problem where x 1 and x 2 corresponds
More informationSensitivity Analysis
Dr. Maddah ENMG 500 /9/07 Sensitivity Analysis Changes in the RHS (b) Consider an optimal LP solution. Suppose that the original RHS (b) is changed from b 0 to b new. In the following, we study the affect
More informationWorked Examples for Chapter 5
Worked Examples for Chapter 5 Example for Section 5.2 Construct the primal-dual table and the dual problem for the following linear programming model fitting our standard form. Maximize Z = 5 x 1 + 4 x
More informationIntroduction. Very efficient solution procedure: simplex method.
LINEAR PROGRAMMING Introduction Development of linear programming was among the most important scientific advances of mid 20th cent. Most common type of applications: allocate limited resources to competing
More informationSlack Variable. Max Z= 3x 1 + 4x 2 + 5X 3. Subject to: X 1 + X 2 + X x 1 + 4x 2 + X X 1 + X 2 + 4X 3 10 X 1 0, X 2 0, X 3 0
Simplex Method Slack Variable Max Z= 3x 1 + 4x 2 + 5X 3 Subject to: X 1 + X 2 + X 3 20 3x 1 + 4x 2 + X 3 15 2X 1 + X 2 + 4X 3 10 X 1 0, X 2 0, X 3 0 Standard Form Max Z= 3x 1 +4x 2 +5X 3 + 0S 1 + 0S 2
More information4. Duality and Sensitivity
4. Duality and Sensitivity For every instance of an LP, there is an associated LP known as the dual problem. The original problem is known as the primal problem. There are two de nitions of the dual pair
More informationLecture 10: Linear programming duality and sensitivity 0-0
Lecture 10: Linear programming duality and sensitivity 0-0 The canonical primal dual pair 1 A R m n, b R m, and c R n maximize z = c T x (1) subject to Ax b, x 0 n and minimize w = b T y (2) subject to
More informationIn the original knapsack problem, the value of the contents of the knapsack is maximized subject to a single capacity constraint, for example weight.
In the original knapsack problem, the value of the contents of the knapsack is maximized subject to a single capacity constraint, for example weight. In the multi-dimensional knapsack problem, additional
More informationDr. S. Bourazza Math-473 Jazan University Department of Mathematics
Dr. Said Bourazza Department of Mathematics Jazan University 1 P a g e Contents: Chapter 0: Modelization 3 Chapter1: Graphical Methods 7 Chapter2: Simplex method 13 Chapter3: Duality 36 Chapter4: Transportation
More informationExample Problem. Linear Program (standard form) CSCI5654 (Linear Programming, Fall 2013) Lecture-7. Duality
CSCI5654 (Linear Programming, Fall 013) Lecture-7 Duality Lecture 7 Slide# 1 Lecture 7 Slide# Linear Program (standard form) Example Problem maximize c 1 x 1 + + c n x n s.t. a j1 x 1 + + a jn x n b j
More informationCSCI5654 (Linear Programming, Fall 2013) Lecture-8. Lecture 8 Slide# 1
CSCI5654 (Linear Programming, Fall 2013) Lecture-8 Lecture 8 Slide# 1 Today s Lecture 1. Recap of dual variables and strong duality. 2. Complementary Slackness Theorem. 3. Interpretation of dual variables.
More informationChapter 1 Linear Programming. Paragraph 5 Duality
Chapter 1 Linear Programming Paragraph 5 Duality What we did so far We developed the 2-Phase Simplex Algorithm: Hop (reasonably) from basic solution (bs) to bs until you find a basic feasible solution
More information1 Review Session. 1.1 Lecture 2
1 Review Session Note: The following lists give an overview of the material that was covered in the lectures and sections. Your TF will go through these lists. If anything is unclear or you have questions
More informationIntroduction to linear programming using LEGO.
Introduction to linear programming using LEGO. 1 The manufacturing problem. A manufacturer produces two pieces of furniture, tables and chairs. The production of the furniture requires the use of two different
More informationSummary of the simplex method
MVE165/MMG630, The simplex method; degeneracy; unbounded solutions; infeasibility; starting solutions; duality; interpretation Ann-Brith Strömberg 2012 03 16 Summary of the simplex method Optimality condition:
More informationLinear Programming Duality
Summer 2011 Optimization I Lecture 8 1 Duality recap Linear Programming Duality We motivated the dual of a linear program by thinking about the best possible lower bound on the optimal value we can achieve
More informationDuality in LPP Every LPP called the primal is associated with another LPP called dual. Either of the problems is primal with the other one as dual. The optimal solution of either problem reveals the information
More informationNote 3: LP Duality. If the primal problem (P) in the canonical form is min Z = n (1) then the dual problem (D) in the canonical form is max W = m (2)
Note 3: LP Duality If the primal problem (P) in the canonical form is min Z = n j=1 c j x j s.t. nj=1 a ij x j b i i = 1, 2,..., m (1) x j 0 j = 1, 2,..., n, then the dual problem (D) in the canonical
More informationMarch 13, Duality 3
15.53 March 13, 27 Duality 3 There are concepts much more difficult to grasp than duality in linear programming. -- Jim Orlin The concept [of nonduality], often described in English as "nondualism," is
More informationECE 307- Techniques for Engineering Decisions
ECE 307- Techniques for Engineering Decisions Lecture 4. Dualit Concepts in Linear Programming George Gross Department of Electrical and Computer Engineering Universit of Illinois at Urbana-Champaign DUALITY
More informationSystem Planning Lecture 7, F7: Optimization
System Planning 04 Lecture 7, F7: Optimization System Planning 04 Lecture 7, F7: Optimization Course goals Appendi A Content: Generally about optimization Formulate optimization problems Linear Programming
More information"SYMMETRIC" PRIMAL-DUAL PAIR
"SYMMETRIC" PRIMAL-DUAL PAIR PRIMAL Minimize cx DUAL Maximize y T b st Ax b st A T y c T x y Here c 1 n, x n 1, b m 1, A m n, y m 1, WITH THE PRIMAL IN STANDARD FORM... Minimize cx Maximize y T b st Ax
More informationLINEAR PROGRAMMING 2. In many business and policy making situations the following type of problem is encountered:
LINEAR PROGRAMMING 2 In many business and policy making situations the following type of problem is encountered: Maximise an objective subject to (in)equality constraints. Mathematical programming provides
More information21. Solve the LP given in Exercise 19 using the big-m method discussed in Exercise 20.
Extra Problems for Chapter 3. Linear Programming Methods 20. (Big-M Method) An alternative to the two-phase method of finding an initial basic feasible solution by minimizing the sum of the artificial
More information56:171 Operations Research Midterm Exam--15 October 2002
Name 56:171 Operations Research Midterm Exam--15 October 2002 Possible Score 1. True/False 25 _ 2. LP sensitivity analysis 25 _ 3. Transportation problem 15 _ 4. LP tableaux 15 _ Total 80 _ Part I: True(+)
More informationStandard Form An LP is in standard form when: All variables are non-negativenegative All constraints are equalities Putting an LP formulation into sta
Chapter 4 Linear Programming: The Simplex Method An Overview of the Simplex Method Standard Form Tableau Form Setting Up the Initial Simplex Tableau Improving the Solution Calculating the Next Tableau
More informationThe Dual Simplex Algorithm
p. 1 The Dual Simplex Algorithm Primal optimal (dual feasible) and primal feasible (dual optimal) bases The dual simplex tableau, dual optimality and the dual pivot rules Classical applications of linear
More informationIntroduction to Mathematical Programming IE406. Lecture 13. Dr. Ted Ralphs
Introduction to Mathematical Programming IE406 Lecture 13 Dr. Ted Ralphs IE406 Lecture 13 1 Reading for This Lecture Bertsimas Chapter 5 IE406 Lecture 13 2 Sensitivity Analysis In many real-world problems,
More informationThe Strong Duality Theorem 1
1/39 The Strong Duality Theorem 1 Adrian Vetta 1 This presentation is based upon the book Linear Programming by Vasek Chvatal 2/39 Part I Weak Duality 3/39 Primal and Dual Recall we have a primal linear
More informationOptimisation and Operations Research
Optimisation and Operations Research Lecture 9: Duality and Complementary Slackness Matthew Roughan http://www.maths.adelaide.edu.au/matthew.roughan/ Lecture_notes/OORII/
More informationMath Models of OR: Sensitivity Analysis
Math Models of OR: Sensitivity Analysis John E. Mitchell Department of Mathematical Sciences RPI, Troy, NY 8 USA October 8 Mitchell Sensitivity Analysis / 9 Optimal tableau and pivot matrix Outline Optimal
More informationLecture 10: Linear programming. duality. and. The dual of the LP in standard form. maximize w = b T y (D) subject to A T y c, minimize z = c T x (P)
Lecture 10: Linear programming duality Michael Patriksson 19 February 2004 0-0 The dual of the LP in standard form minimize z = c T x (P) subject to Ax = b, x 0 n, and maximize w = b T y (D) subject to
More informationLinear Programming Inverse Projection Theory Chapter 3
1 Linear Programming Inverse Projection Theory Chapter 3 University of Chicago Booth School of Business Kipp Martin September 26, 2017 2 Where We Are Headed We want to solve problems with special structure!
More informationLINEAR PROGRAMMING II
LINEAR PROGRAMMING II LP duality strong duality theorem bonus proof of LP duality applications Lecture slides by Kevin Wayne Last updated on 7/25/17 11:09 AM LINEAR PROGRAMMING II LP duality Strong duality
More informationSAMPLE QUESTIONS. b = (30, 20, 40, 10, 50) T, c = (650, 1000, 1350, 1600, 1900) T.
SAMPLE QUESTIONS. (a) We first set up some constant vectors for our constraints. Let b = (30, 0, 40, 0, 0) T, c = (60, 000, 30, 600, 900) T. Then we set up variables x ij, where i, j and i + j 6. By using
More informationLesson 27 Linear Programming; The Simplex Method
Lesson Linear Programming; The Simplex Method Math 0 April 9, 006 Setup A standard linear programming problem is to maximize the quantity c x + c x +... c n x n = c T x subject to constraints a x + a x
More informationBrief summary of linear programming and duality: Consider the linear program in standard form. (P ) min z = cx. x 0. (D) max yb. z = c B x B + c N x N
Brief summary of linear programming and duality: Consider the linear program in standard form (P ) min z = cx s.t. Ax = b x 0 where A R m n, c R 1 n, x R n 1, b R m 1,and its dual (D) max yb s.t. ya c.
More informationLinear Programming, Lecture 4
Linear Programming, Lecture 4 Corbett Redden October 3, 2016 Simplex Form Conventions Examples Simplex Method To run the simplex method, we start from a Linear Program (LP) in the following standard simplex
More informationUNIVERSITY of LIMERICK
UNIVERSITY of LIMERICK OLLSCOIL LUIMNIGH Department of Mathematics & Statistics Faculty of Science and Engineering END OF SEMESTER ASSESSMENT PAPER MODULE CODE: MS4303 SEMESTER: Spring 2018 MODULE TITLE:
More informationLecture 5. x 1,x 2,x 3 0 (1)
Computational Intractability Revised 2011/6/6 Lecture 5 Professor: David Avis Scribe:Ma Jiangbo, Atsuki Nagao 1 Duality The purpose of this lecture is to introduce duality, which is an important concept
More informationCO350 Linear Programming Chapter 6: The Simplex Method
CO350 Linear Programming Chapter 6: The Simplex Method 8th June 2005 Chapter 6: The Simplex Method 1 Minimization Problem ( 6.5) We can solve minimization problems by transforming it into a maximization
More informationYinyu Ye, MS&E, Stanford MS&E310 Lecture Note #06. The Simplex Method
The Simplex Method Yinyu Ye Department of Management Science and Engineering Stanford University Stanford, CA 94305, U.S.A. http://www.stanford.edu/ yyye (LY, Chapters 2.3-2.5, 3.1-3.4) 1 Geometry of Linear
More informationLecture Note 18: Duality
MATH 5330: Computational Methods of Linear Algebra 1 The Dual Problems Lecture Note 18: Duality Xianyi Zeng Department of Mathematical Sciences, UTEP The concept duality, just like accuracy and stability,
More informationChapter 4 The Simplex Algorithm Part I
Chapter 4 The Simplex Algorithm Part I Based on Introduction to Mathematical Programming: Operations Research, Volume 1 4th edition, by Wayne L. Winston and Munirpallam Venkataramanan Lewis Ntaimo 1 Modeling
More information3. Duality: What is duality? Why does it matter? Sensitivity through duality.
1 Overview of lecture (10/5/10) 1. Review Simplex Method 2. Sensitivity Analysis: How does solution change as parameters change? How much is the optimal solution effected by changing A, b, or c? How much
More informationx 4 = 40 +2x 5 +6x x 6 x 1 = 10 2x x 6 x 3 = 20 +x 5 x x 6 z = 540 3x 5 x 2 3x 6 x 4 x 5 x 6 x x
MATH 4 A Sensitivity Analysis Example from lectures The following examples have been sometimes given in lectures and so the fractions are rather unpleasant for testing purposes. Note that each question
More informationLinear Programming in Matrix Form
Linear Programming in Matrix Form Appendix B We first introduce matrix concepts in linear programming by developing a variation of the simplex method called the revised simplex method. This algorithm,
More informationMidterm Review. Yinyu Ye Department of Management Science and Engineering Stanford University Stanford, CA 94305, U.S.A.
Midterm Review Yinyu Ye Department of Management Science and Engineering Stanford University Stanford, CA 94305, U.S.A. http://www.stanford.edu/ yyye (LY, Chapter 1-4, Appendices) 1 Separating hyperplane
More informationLinear Programming. Linear Programming I. Lecture 1. Linear Programming. Linear Programming
Linear Programming Linear Programming Lecture Linear programming. Optimize a linear function subject to linear inequalities. (P) max " c j x j n j= n s. t. " a ij x j = b i # i # m j= x j 0 # j # n (P)
More informationLinear Programming: Chapter 5 Duality
Linear Programming: Chapter 5 Duality Robert J. Vanderbei September 30, 2010 Slides last edited on October 5, 2010 Operations Research and Financial Engineering Princeton University Princeton, NJ 08544
More informationThe Simplex Method. Lecture 5 Standard and Canonical Forms and Setting up the Tableau. Lecture 5 Slide 1. FOMGT 353 Introduction to Management Science
The Simplex Method Lecture 5 Standard and Canonical Forms and Setting up the Tableau Lecture 5 Slide 1 The Simplex Method Formulate Constrained Maximization or Minimization Problem Convert to Standard
More informationDiscrete Optimization
Prof. Friedrich Eisenbrand Martin Niemeier Due Date: April 15, 2010 Discussions: March 25, April 01 Discrete Optimization Spring 2010 s 3 You can hand in written solutions for up to two of the exercises
More informationMATH 445/545 Test 1 Spring 2016
MATH 445/545 Test Spring 06 Note the problems are separated into two sections a set for all students and an additional set for those taking the course at the 545 level. Please read and follow all of these
More information56:270 Final Exam - May
@ @ 56:270 Linear Programming @ @ Final Exam - May 4, 1989 @ @ @ @ @ @ @ @ @ @ @ @ @ @ Select any 7 of the 9 problems below: (1.) ANALYSIS OF MPSX OUTPUT: Please refer to the attached materials on the
More informationLinear Programming Redux
Linear Programming Redux Jim Bremer May 12, 2008 The purpose of these notes is to review the basics of linear programming and the simplex method in a clear, concise, and comprehensive way. The book contains
More information(P ) Minimize 4x 1 + 6x 2 + 5x 3 s.t. 2x 1 3x 3 3 3x 2 2x 3 6
The exam is three hours long and consists of 4 exercises. The exam is graded on a scale 0-25 points, and the points assigned to each question are indicated in parenthesis within the text. Problem 1 Consider
More informationmin 4x 1 5x 2 + 3x 3 s.t. x 1 + 2x 2 + x 3 = 10 x 1 x 2 6 x 1 + 3x 2 + x 3 14
The exam is three hours long and consists of 4 exercises. The exam is graded on a scale 0-25 points, and the points assigned to each question are indicated in parenthesis within the text. If necessary,
More information56:171 Operations Research Midterm Exam - October 26, 1989 Instructor: D.L. Bricker
56:171 Operations Research Midterm Exam - October 26, 1989 Instructor: D.L. Bricker Answer all of Part One and two (of the four) problems of Part Two Problem: 1 2 3 4 5 6 7 8 TOTAL Possible: 16 12 20 10
More information1. Algebraic and geometric treatments Consider an LP problem in the standard form. x 0. Solutions to the system of linear equations
The Simplex Method Most textbooks in mathematical optimization, especially linear programming, deal with the simplex method. In this note we study the simplex method. It requires basically elementary linear
More informationSEN301 OPERATIONS RESEARCH I LECTURE NOTES
SEN30 OPERATIONS RESEARCH I LECTURE NOTES SECTION II (208-209) Y. İlker Topcu, Ph.D. & Özgür Kabak, Ph.D. Acknowledgements: We would like to acknowledge Prof. W.L. Winston's "Operations Research: Applications
More informationLINEAR PROGRAMMING I. a refreshing example standard form fundamental questions geometry linear algebra simplex algorithm
Linear programming Linear programming. Optimize a linear function subject to linear inequalities. (P) max c j x j n j= n s. t. a ij x j = b i i m j= x j 0 j n (P) max c T x s. t. Ax = b Lecture slides
More informationRelation of Pure Minimum Cost Flow Model to Linear Programming
Appendix A Page 1 Relation of Pure Minimum Cost Flow Model to Linear Programming The Network Model The network pure minimum cost flow model has m nodes. The external flows given by the vector b with m
More informationAlgorithms and Theory of Computation. Lecture 13: Linear Programming (2)
Algorithms and Theory of Computation Lecture 13: Linear Programming (2) Xiaohui Bei MAS 714 September 25, 2018 Nanyang Technological University MAS 714 September 25, 2018 1 / 15 LP Duality Primal problem
More informationLecture slides by Kevin Wayne
LINEAR PROGRAMMING I a refreshing example standard form fundamental questions geometry linear algebra simplex algorithm Lecture slides by Kevin Wayne Last updated on 7/25/17 11:09 AM Linear programming
More informationConvex Optimization & Lagrange Duality
Convex Optimization & Lagrange Duality Chee Wei Tan CS 8292 : Advanced Topics in Convex Optimization and its Applications Fall 2010 Outline Convex optimization Optimality condition Lagrange duality KKT
More informationCOT 6936: Topics in Algorithms! Giri Narasimhan. ECS 254A / EC 2443; Phone: x3748
COT 6936: Topics in Algorithms! Giri Narasimhan ECS 254A / EC 2443; Phone: x3748 giri@cs.fiu.edu https://moodle.cis.fiu.edu/v2.1/course/view.php?id=612 Gaussian Elimination! Solving a system of simultaneous
More informationA Review of Linear Programming
A Review of Linear Programming Instructor: Farid Alizadeh IEOR 4600y Spring 2001 February 14, 2001 1 Overview In this note we review the basic properties of linear programming including the primal simplex
More informationIn Chapters 3 and 4 we introduced linear programming
SUPPLEMENT The Simplex Method CD3 In Chapters 3 and 4 we introduced linear programming and showed how models with two variables can be solved graphically. We relied on computer programs (WINQSB, Excel,
More informationDEPARTMENT OF STATISTICS AND OPERATIONS RESEARCH OPERATIONS RESEARCH DETERMINISTIC QUALIFYING EXAMINATION. Part I: Short Questions
DEPARTMENT OF STATISTICS AND OPERATIONS RESEARCH OPERATIONS RESEARCH DETERMINISTIC QUALIFYING EXAMINATION Part I: Short Questions August 12, 2008 9:00 am - 12 pm General Instructions This examination is
More informationAnswer the following questions: Q1: Choose the correct answer ( 20 Points ):
Benha University Final Exam. (ختلفات) Class: 2 rd Year Students Subject: Operations Research Faculty of Computers & Informatics Date: - / 5 / 2017 Time: 3 hours Examiner: Dr. El-Sayed Badr Answer the following
More informationAM 121 Introduction to Optimization: Models and Methods Example Questions for Midterm 1
AM 121 Introduction to Optimization: Models and Methods Example Questions for Midterm 1 Prof. Yiling Chen Fall 2018 Here are some practice questions to help to prepare for the midterm. The midterm will
More information4. The Dual Simplex Method
4. The Dual Simplex Method Javier Larrosa Albert Oliveras Enric Rodríguez-Carbonell Problem Solving and Constraint Programming (RPAR) Session 4 p.1/34 Basic Idea (1) Algorithm as explained so far known
More informationLectures 6, 7 and part of 8
Lectures 6, 7 and part of 8 Uriel Feige April 26, May 3, May 10, 2015 1 Linear programming duality 1.1 The diet problem revisited Recall the diet problem from Lecture 1. There are n foods, m nutrients,
More informationLecture 5 Simplex Method. September 2, 2009
Simplex Method September 2, 2009 Outline: Lecture 5 Re-cap blind search Simplex method in steps Simplex tableau Operations Research Methods 1 Determining an optimal solution by exhaustive search Lecture
More informationStudy Unit 3 : Linear algebra
1 Study Unit 3 : Linear algebra Chapter 3 : Sections 3.1, 3.2.1, 3.2.5, 3.3 Study guide C.2, C.3 and C.4 Chapter 9 : Section 9.1 1. Two equations in two unknowns Algebraically Method 1: Elimination Step
More information56:171 Operations Research Fall 1998
56:171 Operations Research Fall 1998 Quiz Solutions D.L.Bricker Dept of Mechanical & Industrial Engineering University of Iowa 56:171 Operations Research Quiz
More informationLecture #21. c T x Ax b. maximize subject to
COMPSCI 330: Design and Analysis of Algorithms 11/11/2014 Lecture #21 Lecturer: Debmalya Panigrahi Scribe: Samuel Haney 1 Overview In this lecture, we discuss linear programming. We first show that the
More informationCO350 Linear Programming Chapter 8: Degeneracy and Finite Termination
CO350 Linear Programming Chapter 8: Degeneracy and Finite Termination 27th June 2005 Chapter 8: Finite Termination 1 The perturbation method Recap max c T x (P ) s.t. Ax = b x 0 Assumption: B is a feasible
More information