MATH2070 Optimisation

Size: px
Start display at page:

Download "MATH2070 Optimisation"

Transcription

1 MATH2070 Optimisation Linear Programming Semester 2, 2012 Lecturer: I.W. Guo Lecture slides courtesy of J.R. Wishart

2 Review The standard Linear Programming (LP) Problem Graphical method of solving LP problem The simplex procedural algorithm Extensions to LP Algorithm to include other conditions Dual Problem

3 The standard Linear Programming (LP) Problem Graphical method of solving LP problem The simplex procedural algorithm Extensions to LP Algorithm to include other conditions Dual Problem

4 Motivation Where do Linear Programming problems occur? History and Applications Became a field of interest during World War II. Applications Allocation Problems Scheduling Blending of raw materials

5 Initial Example A pharmaceutical company can produce two types of drug using three different resources. Each resource is in very limited supply. Production data are listed in the table below: Resource usage/unit Resource Drug 1 Drug 2 Availability Resource Profit/unit 3 5 $1000

6 Formulation Resource usage/unit Resource Drug 1 Drug 2 Availability Resource Profit/unit 3 5 $1000 Define x 1, x 2 be the number produced for each type of drug. Profit : Z = 3x 1 + 5x 2 Optimisation We want to find the optimal x 1 and x 2 profit, Z. to maximise the total

7 Standard LP problem In full generality, the problem is given by, Maximise: Z = c 1 x 1 + c 2 x c n x n such that a 11 x 1 + a 12 x a 1n x n b 1 a 21 x 1 + a 22 x a 2n x n b 2... a m1 x 1 + a m2 x a mn x n b m and x 1 0, x 2 0,..., x n 0. where a ij, c i are constants and b i > 0 are constants.

8 Using matrix notation (slightly abusing notation), Maximise: Z = c T x such that: Ax b and x 0 where the vectors and matrices are defined, c 1 a 11 a a 1n c 2 a 21 a a 2n c = A = a m1 a n2... a mn c n x = x 1 x 2. x n b = b 1 b 2. b m

9 Objective Function and Decision Variables Decision Variables x T = (x 1, x 2,..., x n ) where x i are the decision variables and it is assumed that x i 0. Objective Function Z = Z(x) = c T x = c 1 x 1 + c 2 x c n x n, where c i are constants and are referred to as the cost coefficients. c i shows the linear increase/decrease in Z for unit increase in x i.

10 Constraints Constraint system of equations a 11 x 1 + a 12 x a 1n x n b 1 Ax b a 21 x 1 + a 22 x a 2n x n b 2.. a m1 x 1 + a n2 x a mn x n b m System of m different constraints described by the m equations with n decision variables. b is referred to the resource vector and it is assumed that b i > 0 are constants. Positivity condition Note that the resource vector b must have positive elements.

11 Feasible Solutions Feasible Solution Any point x satisfying Ax b and x 0 is called a feasible solution. Infeasible Solution Conversely, if a point x does not satisfy the above equations it is an infeasible solution. A feasible solution lies inside a closed region inside the n dimensional decision space. For the initial example that is a two dimensional region (x 1, x 2 ) plane.

12 Feasible Regions Empty Region It is possible for the feasible region to be empty. That is no point can be found to satisfy the constraints. This will be called an ill-posed problem. Feasible region is empty if constraint equations are inconsistent. Example x 2 R 1 R 2 x 1 R 1 R 2 =

13 Optimal solution Optimal solution A feasible solution that maximises the objective function Z is the optimal solution. The optimal solution is usually denoted x = (x 1, x 2,..., x n). The maximised objective function is denoted Z max = Z = Z(x ).

14 Location of Optimal Solutions The multivariate objective function Z = c T x is linear. From introductory lectures, we know that Z must lie on the boundary of the feasible region. Intro Lectures Here Optimal solution x will lie at either a corner point or an edge of the feasible polygon.

15 Feasible Regions The feasible region is actually a polygon in n dimensional space. Each equation in the constraint describes a plane. All equations (planes) together describe a region in space. For example,

16 Number of Solutions No solution Feasible region is empty. One optimal solution * Optimal solution at a corner point. Many optimal solutions Optimal solutions along an edge.

17 Unbounded feasible region Another scenario exists where the feasible region could be unbounded. In an example similar to the empty region. Example Unbounded feasible region x 2 x 1 + x 2 2 x 1 x 2 1 x 1

18 The standard Linear Programming (LP) Problem Graphical method of solving LP problem The simplex procedural algorithm Extensions to LP Algorithm to include other conditions Dual Problem

19 Return to example problem Resource usage/unit Resource Drug 1 Drug 2 Availability Resource Profit/unit 3 5 $1000 Bivariate problem (two dimensional) so can easily be solved graphically.

20 Feasible Region Feasible region is bounded by the five straight lines: x 1 = 0, x 2 = 0, x 1 = 4, 3x 1 + 2x 2 = 18, 2x 2 = 12. x 2 9 3x 1 +2x 2 = x 2 = 12 5 x 1 = Feasible region x 1

21 Find optimal solution(s) Objective function Z = 3x 1 + 5x 2 yields a single optimal solution. x 2 9 Direction of increasing Z(= 3x 1 +5x 2) 8 7 (0,6) 6 (2,6) 36 Optimal solution (x 1,x 2 ) = (2,6) Z = (4,3) (0,0) (4,0) x 1

22 Optimal Solutions Consider new objective function Z = 6x 1 + 4x 2 x2 9 Direction of increasing Z(= 4x1 + 6x2) C1(2,6) Note: Z = 6x1 +4x2 is parallel to the boundary line 3x1 +2x2 = C2(4,3) x1

23 Limitations of graphical method Graphical Limitations Graphical method is only practical in two dimensions. Alternative? The algebraic simplex algorithm. Iterative procedure. Historically created by George Dantzig in 1947.

24 The standard Linear Programming (LP) Problem Graphical method of solving LP problem The simplex procedural algorithm Extensions to LP Algorithm to include other conditions Dual Problem

25 Simplex Algorithm General overview of method Start at an initial feasible corner point. Usually x = 0. Move to an adjacent feasible corner point. Do this by finding corner with best potential increase in Z. Stop when at the optimal solution, Z. Determine optimality when other adjacent corner points result in decrease in Z.

26 Start at initial feasible corner point x 2 9 Direction of increasing Z(= 3x 1 +5x 2) 8 7 (0,6) 6 (2,6) (4,3) (0,0) (4,0) x 1

27 First corner point iteration x 2 9 Direction of increasing Z(= 3x 1 +5x 2) 8 7 (0,6) 6 (2,6) (4,3) (0,0) (4,0) x 1

28 Second corner point iteration x 2 9 Direction of increasing Z(= 3x 1 +5x 2) 8 7 (0,6) (2,6) 27 3 (4,3) (0,0) (4,0) x 1

29 Third and final corner point iteration x 2 9 Direction of increasing Z(= 3x 1 +5x 2) 8 7 (0,6) 6 (2,6) (4,3) (0,0) (4,0) x 1

30 Alternative direction: Start at initial point x 2 9 Direction of increasing Z(= 3x 1 +5x 2) 8 7 (0,6) 6 (2,6) (4,3) (0,0) (4,0) x 1

31 Alternative direction: First corner point x 2 9 Direction of increasing Z(= 3x 1 +5x 2) 8 7 (0,6) 6 (2,6) (4,3) (0,0) (4,0) x 1

32 Alternative direction: Second and final corner point x 2 9 Direction of increasing Z(= 3x 1 +5x 2) 8 7 (0,6) 6 (2,6) (4,3) (0,0) (4,0) x 1

33 System of equations Need to move from inequality constraints to equality constraints. Introduce new variables to reduce the inequalities to equalities. Example for some x 3 0. Definition 2x 1 3x 2 5 2x 1 3x 2 + x 3 = 5 Slack variables: Each introduced variable that reduces a (less than) inequality constraint to an equality constraint is called a slack variable.

34 Slack Variables For each constraint introduce a new variable equal to the difference between the RHS and LHS of the constraint. That is we have Ax b, Ax b à x = b a 11 x 1 + a 12 x a 1n x n b 1 a 21 x 1 + a 22 x a 2n x n b a m1 x 1 + a m2 x a mn x n b m with: x 1 0, x 2 0,, x n 0.

35 New constraint matrix After adding slack variables for each constraint x s = (x n+1, x n+2,..., x n+m ), a 11 x 1 + a 12 x a 1n x n + x n+1 = b 1 a 21 x 1 + a 22 x a 2n x n + x n+2 = b a m1 x 1 + a m2 x a mn x n + x n+m = b m with: x 1 0, x 2 0,..., x n 0, and: x n+1 0, x n+2 0,..., x n+m 0.

36 Return to example Initial constraints, x 1 4; 3x 1 + 2x 2 18; 2x 2 12 Introduce a new variable equal to the difference between the RHS and LHS of the constraint. x 3 = 4 x 1 ; x 4 = 18 3x 1 2x 2 ; x 5 = 12 2x 2. New system of constraints, x 1 4; 3x 1 + 2x 2 18; 2x x 1 + x 3 = 4; 3x 1 + 2x 2 + x 4 = 18; 2x 2 + x 5 = 12.

37 Algebraic representation Turn attention to algebraic representation of corner point method. Full problem with slack variables, Maximise: Z = c 1 x 1 + c 2 x c n x n such that a 11 x 1 + a 12 x a 1n x n + x n+1 = b 1 a 21 x 1 + a 22 x a 2n x n + x n+2 = b a m1 x 1 + a m2 x a mn x n + x n+m = b m and x 1 0, x 2 0,..., x n 0, x n+1 0,..., x n+m 0.

38 In tableau form Z x 1 x 2... x n x n+1 x n+2... x n+m RHS 1 c 1 c 2... c n a 11 a a 1n b 1 0 a 21 a a 2n b a m1 a m2... a mn b m Choose initial corner point solution at (x 1, x 2,..., x n ) = 0 Slack variables take the values of resource vector x s = (x n+1, x n+2,..., x n+m ) T = b Initially, slack variables are the basic variables. Initially, decision variables are the non-basic variables.

39 For the example Maximise: Z 3x 1 5x 2 = 0 such that: x 1 + x 3 = 4 3x 1 + 2x 2 + x 4 = x 2 + x 5 = 12 and x 1 0, x 2 0, x 3 0, x 4 0, x 5 0.

40 Geometric interpretation of slack variables x 2 I 4 9 I 1 I F x 5 = 0 F 4 I 2 I 5 4 x 4 = 0 3 x1 = 0 F 3 x3 = x 2 = 0 I 3 I x 1 F 1 F 2

41 In tableau form Step 1: Setup problem with initial corner point solution. Z x 1 x 2 x 3 x 4 x 5 RHS Slack variables are the initial basic variables, x 3 = 4, x 4 = 18, x 5 = 12. Decision variables are set to zero, x = 0

42 Step 2: Move to adjacent corner point. Which direction do we move? There are two choices... x 2 9 Direction of increasing Z(= 3x 1 +5x 2) 8 7 (0,6) 6 (2,6) (4,3) (0,0) (4,0) x 1

43 Thus x 3 is unaffected as x 2 increases, x 4 0 as x 2 9 and x 5 0 as x 2 6. Thus x 5 must leave the basis, as it goes to zero first. Choice of movement From Objective function, Z 3x 1 5x 2 = 0 Choose x2 to enter the basis. Which basic variable must leave the basis: x 3, x 4 or x 5? Fix x 1 = 0, Increase x 2 and see which basic variable reaches zero first. Constraints equations reduce to which imply x 3 = 4 2x 2 + x 4 = 18 2x 2 + x 5 = 12 x 3 = 4, x 4 = 18 2x 2, x 5 = 12 2x 2.

44 Algebraic rule Variable to enter the basis Choose variable that has the most negative coefficient in the first row of the Tableau. Variable to leave the basis Given variable x j is to enter the basis. Find k = arg min i=1,...,m Then variable x k is to leave the basis. b i a ij, where a ij > 0.

45 Algebraic Rule in practice Return to example, Basis Z x 1 x 2 x 3 x 4 x 5 RHS Ratio b i /a i2 Z x x x min Pivot on highlighted element. Basis Z x 1 x 2 x 3 x 4 x 5 RHS Z /2 30 x x x /2 6

46 Continue the algorithm Basis Z x 1 x 2 x 3 x 4 x 5 RHS Ratio b i /a i1 Z /2 30 x x min x /2 6 x 1 needs to enter the basis while x 4 leaves the basis. Basis Z x 1 x 2 x 3 x 4 x 5 RHS Ratio Z /2 36 x /3 1/3 2 x /3 1/3 2 x /2 6

47 Step 3: Stop when at Optimal solution. How do we know when we reach an optimal solution? Basis Z x 1 x 2 x 3 x 4 x 5 RHS Ratio Z /2 36 x /3 1/3 2 x /3 1/3 2 x /2 6 Stop when all the coefficients in the first row are non-negative. This is the optimal solution.

48 Interpret Tableau of Optimal solution Basis Z x 1 x 2 x 3 x 4 x 5 RHS Ratio Z /2 36 x /3 1/3 2 x /3 1/3 2 x /2 6 Any move from here will cause a decrease in Z. Objective function is Z = 36 x x 5. Optimal solution at x = (2, 6) with Z = 36. Slack variables are x s = (2, 0, 0).

49 Tie Breakers: Variable entering basis It is possible that there is no unique variable to choose for the rules. Entering Variable There may be a tied situation when there are two variables with the most negative coefficient. E.g. Basis Z x 1 x 2 x 3 x 4 x 5 RHS Z 1 0 a a 0 0 C where a > 0 and C > 0. Which variable should be chosen to enter the basis? x 2 or x 3?

50 Tie Breakers: Variable leaving basis It is also possible to have a tie for the variable leaving the basis. For example, consider the drug problem, with the second constraint modified to 3x 1 + 2x Initial simplex tableau: Maximise: Z = 3x 1 + 5x 2 subject to: x 1 4 3x 1 + 2x x 2 12 with: x 1, x 2 0. Basis Z x 1 x 2 x 3 x 4 x 5 RHS Ratio Z x x choose x either

51 Tie breaker (cont.) Basis Z x 1 x 2 x 3 x 4 x 5 RHS Ratio Z x x x Z /2 30 x x non-positive x /2 6 Notice the resource element is zero. Assumptions of simplex framework violated

52 Tie breaker (cont.) Basis Z x 1 x 2 x 3 x 4 x 5 RHS Ratio Z x x x Z 1 9/ / optimal x x 2 0 3/ /2 0 6 x degeneracy Degenerate point in the basis with x 5 = 0 Can cause stalling. Can cause an endless cycle.

53 Degenerate points x Corner points (0,6) and (4,0) are degenerate Feasible region x 1

54 Solution upon an edge Return to the previous pharmeutical example with Z = 6x 1 + 4x 2 x2 9 Direction of increasing Z(= 4x1 + 6x2) C1(2,6) Note: Z = 6x1 +4x2 is parallel to the boundary line 3x1 +2x2 = C2(4,3) x1

55 Solution upon an edge (cont) Final tableau form. Basis Z x 1 x 2 x 3 x 4 x 5 RHS Ratio Z x x x Z x x x Z optimal x x /2 1/2 0 3 x

56 Solution upon an edge (cont) Final tableau form. Basis Z x 1 x 2 x 3 x 4 x 5 RHS Ratio Z optimal x x /2 1/2 0 3 x x 1, x 2, x 5 are in the basis x 3 and x 4 are out of the basis. However, x 3 has a zero coefficient in the objective row. Optimal objective function Z = 36 2x 4

57 Solution upon an edge (cont) Final tableau form. Basis Z x 1 x 2 x 3 x 4 x 5 RHS Ratio Z optimal x x /2 1/2 0 3 x Can parametrise the solution to locate the edge. System of equations. Let x 3 = t 0. t [0, 2] x 1 = 4 t 0 t 4. x 2 = 3 + 3/2t 0 t 2. x 5 = 6 3t 0 t 2.

58 The standard Linear Programming (LP) Problem Graphical method of solving LP problem The simplex procedural algorithm Extensions to LP Algorithm to include other conditions Dual Problem

59 Minimising the Objective Function Consider finding the minimum To minimize Z = c 1 x 1 + c 2 x c n x n. Define a new objective function Ẑ = Z. Then min Z max Ẑ. f(x) x x f(x)

60 Greater than or equal to constraints If the problem has a constraint of the form a T x = a 1 x 1 + a 2 x a n x n b > 0, introduce a surplus variable x n+1 such that a 1 x 1 + a 2 x a n x n x n+1 = b, x n+1 0. As an example, consider Maximise: Z = 3x 1 + 5x 2 subject to: x 1 4 3x 1 + 2x x 2 12 with: x 1, x 2 0.

61 Greater than constraint example x Z = Feasible region x 1

62 Negative Resource Elements In the standard problem all resource elements b j (i j m) are non-negative. Suppose b j = b < 0. Then, is equivalent to a T x = a 1 x 1 + a 2 x a n x n b, a T x = a 1 x 1 a 2 x 2 a n x n b.

63 Negative Decision Variable If x k 0 introduce a new variable x k = x k. Then x k 0 is equivalent to x k 0.

64 Unrestricted Decision Variable If x k is unrestricted in sign, introduce two new variables, x k 0 and x k 0, and let x k = x k x k.

65 Two-Phase Method Return to the problem, Maximise: Z = 3x 1 + 5x 2 subject to: x 1 4 3x 1 + 2x x 2 12 with: x 1, x 2 0. Introduce slack and surplus variables, x 1 + x 3 = 4 3x 1 + 2x 2 x 4 = 18 2x 2 + x 5 = 12

66 Finding an initial feasible corner point In regular framework. Set decision variables to zero. Slack variables set to resource elements. x 1 + x 3 = 4 3x 1 + 2x 2 x 4 = 18 2x 2 + x 5 = 12 If done here, implies that, x 1 = 0, x 2 = 0, x 3 = 4, x 4 = 18, x 5 = 12 Surplus variable violates the positivity constraint!

67 Artificial Variables Introduce an artificial variable for any constraint that involves an equality or greater than or equal to condition. For example, introduce x 6 0 in second constraint equation. The constraint equations become x 1 + x 3 = 4 3x 1 + 2x 2 x 4 + x 6 = 18 2x 2 + x 5 = 12 Set decision and surplus variables to be zero. Set slack and artificial variables to resource elements (RHS) Initial corner point (x 1, x 2, x 3, x 4, x 5, x 6 ) = (0, 0, 4, 0, 12, 18).

68 Not a corner point of the actual problem. The initial corner point (x 1, x 2, x 3, x 4, x 5, x 6 ) = (0, 0, 4, 0, 12, 18) is not in the feasible set. x Z = Feasible region x1

69 Reconcile the initial corner point Feasible solution A feasible solution of the problem with artificial variables is a feasible solution of the original problem if and only if the artificial variables are zero. In the example, the second constraint gives RHS is smaller than 18 if x 6 > 0. 3x 1 + 2x 2 x 4 = 18 x 6 3x 1 + 2x 2 x 4 = 18 if and only if x 6 = 0. Thus we must force the artificial variables to zero.

70 Find initial feasible solution To find a basic feasible solution to the original problem maximize, W = x k 0. artificial If max W = 0, then all artificial variables are zero. Then proceed with regular simplex algorithm.

71 First Phase: Maximise W Basis x 1 x 2 x 3 x 4 x 5 x 6 RHS W Z x x W Z x x x After Maximisation on W is complete, remove W and all artificial variables.

72 First Phase: Maximise W Basis x 1 x 2 x 3 x 4 x 5 x 6 RHS Ratio W Z x x x W Z x x x W Z 0 0 9/2 5/2 0 5/2 27 x x /2 1/2 0 1/2 3 x

73 Second Phase: Maximise Z with new starting point. Basis x 1 x 2 x 3 x 4 x 5 RHS Ratio Z 0 0 9/2 5/ x x /2 1/2 0 3 x Z /2 36 x /3 1/3 2 x /2 6 x /3 1/3 2 6 Z /2 42 Optimal x x /2 6 x

74 Big M-method An alternative to the Two-Phase Maximise: Z = x 1 + 2x 2 subject to: x 1 + x 2 2 x 1 + x 2 1 x 2 3 with: x 1, x 2 0. Introduce slack, surplus and artificial variables as before. Modify objective function to penalise the artificial variables. Z = Z ± M x k. k artificial NB: Sign infront of M penalises against the optimatisation.

75 Big M-method Constraint equations x 1 + x 2 x 3 + x 6 = 2 x 1 + x 2 x 4 + x 7 = 1 x 2 + x 5 = 3 Objective function is Maximisation: Max: Z = x 1 + 2x 2 M(x 6 + x 7 ) NB: If Minimisation was desired consider, Min: Z = x 1 + 2x 2 +M(x 6 + x 7 ) M is considered to be an arbitrarily large number.

76 Big M- implementation: Basis x 1 x 2 x 3 x 4 x 5 x 6 x 7 RHS Ratio Z M M x Z 1-2M-2 M M M x x x Initialise tableau to ensure artificial variables are basic. Continue regular simplex algorithm.

77 Big M- implementation: Basis x 1 x 2 x 3 x 4 x 5 x 6 x 7 RHS Ratio Z 1-2M-2 M M M x x x Z -2M-1 0 M -M M+2 -M+2 1 x x x Z M+0.5 M x x x

78 Big M- implementation: Basis x 1 x 2 x 3 x 4 x 5 x 6 x 7 RHS Ratio Z M+0.5 M x x x Z M+2 M 4 x x x Z M M 6 opt x x x

79 The standard Linear Programming (LP) Problem Graphical method of solving LP problem The simplex procedural algorithm Extensions to LP Algorithm to include other conditions Dual Problem

80 Dual Problem Recall the regular problem in matrix notation, Primal Maximise: Z = c T x subject to: Ax b with: x 0 Refer to it as the Primal problem.

81 Definition of dual problem Primal Dual Maximise: Z = c T x Minimise: v = y T b subject to: Ax b subject to: y T A c T with: x 0 with: y 0 Return to initial pharmaceutical example: Maximise : Z = 3x 1 + 5x 2 such that: x 1 4 3x 1 + 2x 2 18 and x 1 0, x 2 0, x 3 0, x 4 0, x x 2 12

82 Example: Dual construction Find a bound for optimal solution. From constraints, Z = 3x 1 + 5x = 42 Consider a general linear combination of constraints, (x 1 )y 1 + (3x 1 + 2x 2 ) y 2 + (2x 2 )y 3 4y y y 3 Define a new objective function v := 4y y y 3 Notice, Z := 3x 1 + 5x 2 (y 1 + 3y 2 )x 1 + (2y 2 + 2y 3 ) x 2 4y y y 3 =: v

83 Example: continued Last statement true if y 0 and, y 1 + 3y 2 3 and 2y 2 + 2y 3 5 Dual problem is, Minimise : v = 4y y y 3 such that: y 1 + 3y 2 3 2y 2 + 2y 3 5 and y 1 0, y 2 0, y 3 0.

84 Useful applications Dimension of decision variables and constraint equations swap. Optimal values of Max: Z and Min: v coincide under certain conditions. Can sometimes simplify the problem to be solved.

85 Example Example Maximise: Z = 8x x 2 + 7x 3 subject to: x 1 + 5x 2 + 3x x 1 + 6x 2 + x 3 15 with: x 1, x 2, x 3 0. The corresponding dual problem is: Minimise: v = 10y y 2 subject to: y 1 + 4y 2 8 5y 1 + 6y y 1 + y 2 7 with: y 1, y 2 0, which can be solved graphically.

86 Graphical solution Minimise: v = 10y y 2 subject to: y 1 + 4y 2 8 5y 1 + 6y y 1 + y 2 7 with: y 1, y 2 0, y y1 +4y2 = Optimal solution, v = 435 7, (y1,y2) = (36 7, 5 7 ) y1 2y1 +y2 = 8 5y1 +6y2 = 30

87 Second Example Return to the Pharmaceutical problem. It has the dual problem, Minimise : v = 4y y y 3 such that: y 1 + 3y 2 3 2y 2 + 2y 3 5 and y 1 0, y 2 0, y 3 0. Standardise the problem for the simplex framework. Maximise: v = 4y 1 18y 2 12y 3 subject to: y 1 + 3y 2 y 4 + y 6 = 3 with: y 1 0, y 2 0, y y 2 + 2y 3 y 5 + y 7 = 5

88 Solve using Two-Phase First Phase: Maximise W Basis y 1 y 2 y 3 y 4 y 5 y 6 y 7 RHS W v W v y y

89 Maximise W Basis y 1 y 2 y 3 y 4 y 5 y 6 y 7 RHS Ratio W v y y /2 W 2/ /3 1 5/3 0 3 v y 2 1/ /3 0 1/3 0 1 y 7-2/ /3-1 -2/ /2 W v y 2 1/ /3 0 1/3 0 1 y 3-1/ /3-1/2-1/3 1/2 3/2

90 Phase Two: Discard W Notice that, Basis y 1 y 2 y 3 y 4 y 5 RHS v y 2 1/ /3 0 1 y 3-1/ /3-1/2 3/2 Max Z = 3x 1 + 5x 2 = 36 = Max v y = (y 1, y 2, y 3 ) = (0, 1, 3/2) and x = (2, 6) The optimal x can be found as the cost coefficients of the surplus variables y 4 and y 5 in the objective row. Agrees with graphical and simplex methods used before

Standard Form An LP is in standard form when: All variables are non-negativenegative All constraints are equalities Putting an LP formulation into sta

Standard Form An LP is in standard form when: All variables are non-negativenegative All constraints are equalities Putting an LP formulation into sta Chapter 4 Linear Programming: The Simplex Method An Overview of the Simplex Method Standard Form Tableau Form Setting Up the Initial Simplex Tableau Improving the Solution Calculating the Next Tableau

More information

OPERATIONS RESEARCH. Linear Programming Problem

OPERATIONS RESEARCH. Linear Programming Problem OPERATIONS RESEARCH Chapter 1 Linear Programming Problem Prof. Bibhas C. Giri Department of Mathematics Jadavpur University Kolkata, India Email: bcgiri.jumath@gmail.com MODULE - 2: Simplex Method for

More information

AM 121: Intro to Optimization Models and Methods

AM 121: Intro to Optimization Models and Methods AM 121: Intro to Optimization Models and Methods Fall 2017 Lecture 2: Intro to LP, Linear algebra review. Yiling Chen SEAS Lecture 2: Lesson Plan What is an LP? Graphical and algebraic correspondence Problems

More information

LINEAR PROGRAMMING 2. In many business and policy making situations the following type of problem is encountered:

LINEAR PROGRAMMING 2. In many business and policy making situations the following type of problem is encountered: LINEAR PROGRAMMING 2 In many business and policy making situations the following type of problem is encountered: Maximise an objective subject to (in)equality constraints. Mathematical programming provides

More information

Metode Kuantitatif Bisnis. Week 4 Linear Programming Simplex Method - Minimize

Metode Kuantitatif Bisnis. Week 4 Linear Programming Simplex Method - Minimize Metode Kuantitatif Bisnis Week 4 Linear Programming Simplex Method - Minimize Outlines Solve Linear Programming Model Using Graphic Solution Solve Linear Programming Model Using Simplex Method (Maximize)

More information

Systems Analysis in Construction

Systems Analysis in Construction Systems Analysis in Construction CB312 Construction & Building Engineering Department- AASTMT by A h m e d E l h a k e e m & M o h a m e d S a i e d 3. Linear Programming Optimization Simplex Method 135

More information

Linear Programming, Lecture 4

Linear Programming, Lecture 4 Linear Programming, Lecture 4 Corbett Redden October 3, 2016 Simplex Form Conventions Examples Simplex Method To run the simplex method, we start from a Linear Program (LP) in the following standard simplex

More information

Yinyu Ye, MS&E, Stanford MS&E310 Lecture Note #06. The Simplex Method

Yinyu Ye, MS&E, Stanford MS&E310 Lecture Note #06. The Simplex Method The Simplex Method Yinyu Ye Department of Management Science and Engineering Stanford University Stanford, CA 94305, U.S.A. http://www.stanford.edu/ yyye (LY, Chapters 2.3-2.5, 3.1-3.4) 1 Geometry of Linear

More information

Ω R n is called the constraint set or feasible set. x 1

Ω R n is called the constraint set or feasible set. x 1 1 Chapter 5 Linear Programming (LP) General constrained optimization problem: minimize subject to f(x) x Ω Ω R n is called the constraint set or feasible set. any point x Ω is called a feasible point We

More information

The Simplex Method. Lecture 5 Standard and Canonical Forms and Setting up the Tableau. Lecture 5 Slide 1. FOMGT 353 Introduction to Management Science

The Simplex Method. Lecture 5 Standard and Canonical Forms and Setting up the Tableau. Lecture 5 Slide 1. FOMGT 353 Introduction to Management Science The Simplex Method Lecture 5 Standard and Canonical Forms and Setting up the Tableau Lecture 5 Slide 1 The Simplex Method Formulate Constrained Maximization or Minimization Problem Convert to Standard

More information

Linear Programming and the Simplex method

Linear Programming and the Simplex method Linear Programming and the Simplex method Harald Enzinger, Michael Rath Signal Processing and Speech Communication Laboratory Jan 9, 2012 Harald Enzinger, Michael Rath Jan 9, 2012 page 1/37 Outline Introduction

More information

Dr. Maddah ENMG 500 Engineering Management I 10/21/07

Dr. Maddah ENMG 500 Engineering Management I 10/21/07 Dr. Maddah ENMG 500 Engineering Management I 10/21/07 Computational Procedure of the Simplex Method The optimal solution of a general LP problem is obtained in the following steps: Step 1. Express the

More information

IE 400: Principles of Engineering Management. Simplex Method Continued

IE 400: Principles of Engineering Management. Simplex Method Continued IE 400: Principles of Engineering Management Simplex Method Continued 1 Agenda Simplex for min problems Alternative optimal solutions Unboundedness Degeneracy Big M method Two phase method 2 Simplex for

More information

21. Solve the LP given in Exercise 19 using the big-m method discussed in Exercise 20.

21. Solve the LP given in Exercise 19 using the big-m method discussed in Exercise 20. Extra Problems for Chapter 3. Linear Programming Methods 20. (Big-M Method) An alternative to the two-phase method of finding an initial basic feasible solution by minimizing the sum of the artificial

More information

MATH2070/2970 Optimisation

MATH2070/2970 Optimisation MATH2070/2970 Optimisation Introduction Semester 2, 2012 Lecturer: I.W. Guo Lecture slides courtesy of J.R. Wishart Course Information Lecture Information Optimisation: Weeks 1 7 Contact Information Email:

More information

Special cases of linear programming

Special cases of linear programming Special cases of linear programming Infeasible solution Multiple solution (infinitely many solution) Unbounded solution Degenerated solution Notes on the Simplex tableau 1. The intersection of any basic

More information

OPTIMISATION 3: NOTES ON THE SIMPLEX ALGORITHM

OPTIMISATION 3: NOTES ON THE SIMPLEX ALGORITHM OPTIMISATION 3: NOTES ON THE SIMPLEX ALGORITHM Abstract These notes give a summary of the essential ideas and results It is not a complete account; see Winston Chapters 4, 5 and 6 The conventions and notation

More information

In Chapters 3 and 4 we introduced linear programming

In Chapters 3 and 4 we introduced linear programming SUPPLEMENT The Simplex Method CD3 In Chapters 3 and 4 we introduced linear programming and showed how models with two variables can be solved graphically. We relied on computer programs (WINQSB, Excel,

More information

Summary of the simplex method

Summary of the simplex method MVE165/MMG631,Linear and integer optimization with applications The simplex method: degeneracy; unbounded solutions; starting solutions; infeasibility; alternative optimal solutions Ann-Brith Strömberg

More information

Chapter 5 Linear Programming (LP)

Chapter 5 Linear Programming (LP) Chapter 5 Linear Programming (LP) General constrained optimization problem: minimize f(x) subject to x R n is called the constraint set or feasible set. any point x is called a feasible point We consider

More information

Gauss-Jordan Elimination for Solving Linear Equations Example: 1. Solve the following equations: (3)

Gauss-Jordan Elimination for Solving Linear Equations Example: 1. Solve the following equations: (3) The Simple Method Gauss-Jordan Elimination for Solving Linear Equations Eample: Gauss-Jordan Elimination Solve the following equations: + + + + = 4 = = () () () - In the first step of the procedure, we

More information

min 4x 1 5x 2 + 3x 3 s.t. x 1 + 2x 2 + x 3 = 10 x 1 x 2 6 x 1 + 3x 2 + x 3 14

min 4x 1 5x 2 + 3x 3 s.t. x 1 + 2x 2 + x 3 = 10 x 1 x 2 6 x 1 + 3x 2 + x 3 14 The exam is three hours long and consists of 4 exercises. The exam is graded on a scale 0-25 points, and the points assigned to each question are indicated in parenthesis within the text. If necessary,

More information

Sensitivity Analysis

Sensitivity Analysis Dr. Maddah ENMG 500 /9/07 Sensitivity Analysis Changes in the RHS (b) Consider an optimal LP solution. Suppose that the original RHS (b) is changed from b 0 to b new. In the following, we study the affect

More information

MATH 445/545 Test 1 Spring 2016

MATH 445/545 Test 1 Spring 2016 MATH 445/545 Test Spring 06 Note the problems are separated into two sections a set for all students and an additional set for those taking the course at the 545 level. Please read and follow all of these

More information

Slack Variable. Max Z= 3x 1 + 4x 2 + 5X 3. Subject to: X 1 + X 2 + X x 1 + 4x 2 + X X 1 + X 2 + 4X 3 10 X 1 0, X 2 0, X 3 0

Slack Variable. Max Z= 3x 1 + 4x 2 + 5X 3. Subject to: X 1 + X 2 + X x 1 + 4x 2 + X X 1 + X 2 + 4X 3 10 X 1 0, X 2 0, X 3 0 Simplex Method Slack Variable Max Z= 3x 1 + 4x 2 + 5X 3 Subject to: X 1 + X 2 + X 3 20 3x 1 + 4x 2 + X 3 15 2X 1 + X 2 + 4X 3 10 X 1 0, X 2 0, X 3 0 Standard Form Max Z= 3x 1 +4x 2 +5X 3 + 0S 1 + 0S 2

More information

MATH 445/545 Homework 2: Due March 3rd, 2016

MATH 445/545 Homework 2: Due March 3rd, 2016 MATH 445/545 Homework 2: Due March 3rd, 216 Answer the following questions. Please include the question with the solution (write or type them out doing this will help you digest the problem). I do not

More information

Simplex Method for LP (II)

Simplex Method for LP (II) Simplex Method for LP (II) Xiaoxi Li Wuhan University Sept. 27, 2017 (week 4) Operations Research (Li, X.) Simplex Method for LP (II) Sept. 27, 2017 (week 4) 1 / 31 Organization of this lecture Contents:

More information

UNIT-4 Chapter6 Linear Programming

UNIT-4 Chapter6 Linear Programming UNIT-4 Chapter6 Linear Programming Linear Programming 6.1 Introduction Operations Research is a scientific approach to problem solving for executive management. It came into existence in England during

More information

Dr. S. Bourazza Math-473 Jazan University Department of Mathematics

Dr. S. Bourazza Math-473 Jazan University Department of Mathematics Dr. Said Bourazza Department of Mathematics Jazan University 1 P a g e Contents: Chapter 0: Modelization 3 Chapter1: Graphical Methods 7 Chapter2: Simplex method 13 Chapter3: Duality 36 Chapter4: Transportation

More information

Simplex Algorithm Using Canonical Tableaus

Simplex Algorithm Using Canonical Tableaus 41 Simplex Algorithm Using Canonical Tableaus Consider LP in standard form: Min z = cx + α subject to Ax = b where A m n has rank m and α is a constant In tableau form we record it as below Original Tableau

More information

CO350 Linear Programming Chapter 6: The Simplex Method

CO350 Linear Programming Chapter 6: The Simplex Method CO350 Linear Programming Chapter 6: The Simplex Method 8th June 2005 Chapter 6: The Simplex Method 1 Minimization Problem ( 6.5) We can solve minimization problems by transforming it into a maximization

More information

Prelude to the Simplex Algorithm. The Algebraic Approach The search for extreme point solutions.

Prelude to the Simplex Algorithm. The Algebraic Approach The search for extreme point solutions. Prelude to the Simplex Algorithm The Algebraic Approach The search for extreme point solutions. 1 Linear Programming-1 x 2 12 8 (4,8) Max z = 6x 1 + 4x 2 Subj. to: x 1 + x 2

More information

Optimisation and Operations Research

Optimisation and Operations Research Optimisation and Operations Research Lecture 9: Duality and Complementary Slackness Matthew Roughan http://www.maths.adelaide.edu.au/matthew.roughan/ Lecture_notes/OORII/

More information

1 Review Session. 1.1 Lecture 2

1 Review Session. 1.1 Lecture 2 1 Review Session Note: The following lists give an overview of the material that was covered in the lectures and sections. Your TF will go through these lists. If anything is unclear or you have questions

More information

The Strong Duality Theorem 1

The Strong Duality Theorem 1 1/39 The Strong Duality Theorem 1 Adrian Vetta 1 This presentation is based upon the book Linear Programming by Vasek Chvatal 2/39 Part I Weak Duality 3/39 Primal and Dual Recall we have a primal linear

More information

UNIVERSITY of LIMERICK

UNIVERSITY of LIMERICK UNIVERSITY of LIMERICK OLLSCOIL LUIMNIGH Department of Mathematics & Statistics Faculty of Science and Engineering END OF SEMESTER ASSESSMENT PAPER MODULE CODE: MS4303 SEMESTER: Spring 2018 MODULE TITLE:

More information

New Artificial-Free Phase 1 Simplex Method

New Artificial-Free Phase 1 Simplex Method International Journal of Basic & Applied Sciences IJBAS-IJENS Vol:09 No:10 69 New Artificial-Free Phase 1 Simplex Method Nasiruddin Khan, Syed Inayatullah*, Muhammad Imtiaz and Fozia Hanif Khan Department

More information

Summary of the simplex method

Summary of the simplex method MVE165/MMG630, The simplex method; degeneracy; unbounded solutions; infeasibility; starting solutions; duality; interpretation Ann-Brith Strömberg 2012 03 16 Summary of the simplex method Optimality condition:

More information

Lecture 2: The Simplex method. 1. Repetition of the geometrical simplex method. 2. Linear programming problems on standard form.

Lecture 2: The Simplex method. 1. Repetition of the geometrical simplex method. 2. Linear programming problems on standard form. Lecture 2: The Simplex method. Repetition of the geometrical simplex method. 2. Linear programming problems on standard form. 3. The Simplex algorithm. 4. How to find an initial basic solution. Lecture

More information

February 17, Simplex Method Continued

February 17, Simplex Method Continued 15.053 February 17, 2005 Simplex Method Continued 1 Today s Lecture Review of the simplex algorithm. Formalizing the approach Alternative Optimal Solutions Obtaining an initial bfs Is the simplex algorithm

More information

AM 121: Intro to Optimization

AM 121: Intro to Optimization AM 121: Intro to Optimization Models and Methods Lecture 6: Phase I, degeneracy, smallest subscript rule. Yiling Chen SEAS Lesson Plan Phase 1 (initialization) Degeneracy and cycling Smallest subscript

More information

CSCI 1951-G Optimization Methods in Finance Part 01: Linear Programming

CSCI 1951-G Optimization Methods in Finance Part 01: Linear Programming CSCI 1951-G Optimization Methods in Finance Part 01: Linear Programming January 26, 2018 1 / 38 Liability/asset cash-flow matching problem Recall the formulation of the problem: max w c 1 + p 1 e 1 = 150

More information

Introduction to Mathematical Programming

Introduction to Mathematical Programming Introduction to Mathematical Programming Ming Zhong Lecture 22 October 22, 2018 Ming Zhong (JHU) AMS Fall 2018 1 / 16 Table of Contents 1 The Simplex Method, Part II Ming Zhong (JHU) AMS Fall 2018 2 /

More information

Introduction. Very efficient solution procedure: simplex method.

Introduction. Very efficient solution procedure: simplex method. LINEAR PROGRAMMING Introduction Development of linear programming was among the most important scientific advances of mid 20th cent. Most common type of applications: allocate limited resources to competing

More information

Answer the following questions: Q1: Choose the correct answer ( 20 Points ):

Answer the following questions: Q1: Choose the correct answer ( 20 Points ): Benha University Final Exam. (ختلفات) Class: 2 rd Year Students Subject: Operations Research Faculty of Computers & Informatics Date: - / 5 / 2017 Time: 3 hours Examiner: Dr. El-Sayed Badr Answer the following

More information

TIM 206 Lecture 3: The Simplex Method

TIM 206 Lecture 3: The Simplex Method TIM 206 Lecture 3: The Simplex Method Kevin Ross. Scribe: Shane Brennan (2006) September 29, 2011 1 Basic Feasible Solutions Have equation Ax = b contain more columns (variables) than rows (constraints),

More information

Lecture 9 Tuesday, 4/20/10. Linear Programming

Lecture 9 Tuesday, 4/20/10. Linear Programming UMass Lowell Computer Science 91.503 Analysis of Algorithms Prof. Karen Daniels Spring, 2010 Lecture 9 Tuesday, 4/20/10 Linear Programming 1 Overview Motivation & Basics Standard & Slack Forms Formulating

More information

Lecture 5. x 1,x 2,x 3 0 (1)

Lecture 5. x 1,x 2,x 3 0 (1) Computational Intractability Revised 2011/6/6 Lecture 5 Professor: David Avis Scribe:Ma Jiangbo, Atsuki Nagao 1 Duality The purpose of this lecture is to introduce duality, which is an important concept

More information

9.1 Linear Programs in canonical form

9.1 Linear Programs in canonical form 9.1 Linear Programs in canonical form LP in standard form: max (LP) s.t. where b i R, i = 1,..., m z = j c jx j j a ijx j b i i = 1,..., m x j 0 j = 1,..., n But the Simplex method works only on systems

More information

Chap6 Duality Theory and Sensitivity Analysis

Chap6 Duality Theory and Sensitivity Analysis Chap6 Duality Theory and Sensitivity Analysis The rationale of duality theory Max 4x 1 + x 2 + 5x 3 + 3x 4 S.T. x 1 x 2 x 3 + 3x 4 1 5x 1 + x 2 + 3x 3 + 8x 4 55 x 1 + 2x 2 + 3x 3 5x 4 3 x 1 ~x 4 0 If we

More information

Duality in LPP Every LPP called the primal is associated with another LPP called dual. Either of the problems is primal with the other one as dual. The optimal solution of either problem reveals the information

More information

3 The Simplex Method. 3.1 Basic Solutions

3 The Simplex Method. 3.1 Basic Solutions 3 The Simplex Method 3.1 Basic Solutions In the LP of Example 2.3, the optimal solution happened to lie at an extreme point of the feasible set. This was not a coincidence. Consider an LP in general form,

More information

Distributed Real-Time Control Systems. Lecture Distributed Control Linear Programming

Distributed Real-Time Control Systems. Lecture Distributed Control Linear Programming Distributed Real-Time Control Systems Lecture 13-14 Distributed Control Linear Programming 1 Linear Programs Optimize a linear function subject to a set of linear (affine) constraints. Many problems can

More information

Linear Programming: Chapter 5 Duality

Linear Programming: Chapter 5 Duality Linear Programming: Chapter 5 Duality Robert J. Vanderbei September 30, 2010 Slides last edited on October 5, 2010 Operations Research and Financial Engineering Princeton University Princeton, NJ 08544

More information

F 1 F 2 Daily Requirement Cost N N N

F 1 F 2 Daily Requirement Cost N N N Chapter 5 DUALITY 5. The Dual Problems Every linear programming problem has associated with it another linear programming problem and that the two problems have such a close relationship that whenever

More information

MAT016: Optimization

MAT016: Optimization MAT016: Optimization M.El Ghami e-mail: melghami@ii.uib.no URL: http://www.ii.uib.no/ melghami/ March 29, 2011 Outline for today The Simplex method in matrix notation Managing a production facility The

More information

Chapter 4 The Simplex Algorithm Part I

Chapter 4 The Simplex Algorithm Part I Chapter 4 The Simplex Algorithm Part I Based on Introduction to Mathematical Programming: Operations Research, Volume 1 4th edition, by Wayne L. Winston and Munirpallam Venkataramanan Lewis Ntaimo 1 Modeling

More information

4.6 Linear Programming duality

4.6 Linear Programming duality 4.6 Linear Programming duality To any minimization (maximization) LP we can associate a closely related maximization (minimization) LP Different spaces and objective functions but in general same optimal

More information

Michælmas 2012 Operations Research III/IV 1

Michælmas 2012 Operations Research III/IV 1 Michælmas 2012 Operations Research III/IV 1 An inventory example A company makes windsurfing boards and has orders for 40, 60, 75 and 25 boards respectively over the next four production quarters. All

More information

CO350 Linear Programming Chapter 6: The Simplex Method

CO350 Linear Programming Chapter 6: The Simplex Method CO50 Linear Programming Chapter 6: The Simplex Method rd June 2005 Chapter 6: The Simplex Method 1 Recap Suppose A is an m-by-n matrix with rank m. max. c T x (P ) s.t. Ax = b x 0 On Wednesday, we learned

More information

Lecture 4: Algebra, Geometry, and Complexity of the Simplex Method. Reading: Sections 2.6.4, 3.5,

Lecture 4: Algebra, Geometry, and Complexity of the Simplex Method. Reading: Sections 2.6.4, 3.5, Lecture 4: Algebra, Geometry, and Complexity of the Simplex Method Reading: Sections 2.6.4, 3.5, 10.2 10.5 1 Summary of the Phase I/Phase II Simplex Method We write a typical simplex tableau as z x 1 x

More information

Lecture 2: The Simplex method

Lecture 2: The Simplex method Lecture 2 1 Linear and Combinatorial Optimization Lecture 2: The Simplex method Basic solution. The Simplex method (standardform, b>0). 1. Repetition of basic solution. 2. One step in the Simplex algorithm.

More information

THE UNIVERSITY OF HONG KONG DEPARTMENT OF MATHEMATICS. Operations Research I

THE UNIVERSITY OF HONG KONG DEPARTMENT OF MATHEMATICS. Operations Research I LN/MATH2901/CKC/MS/2008-09 THE UNIVERSITY OF HONG KONG DEPARTMENT OF MATHEMATICS Operations Research I Definition (Linear Programming) A linear programming (LP) problem is characterized by linear functions

More information

"SYMMETRIC" PRIMAL-DUAL PAIR

SYMMETRIC PRIMAL-DUAL PAIR "SYMMETRIC" PRIMAL-DUAL PAIR PRIMAL Minimize cx DUAL Maximize y T b st Ax b st A T y c T x y Here c 1 n, x n 1, b m 1, A m n, y m 1, WITH THE PRIMAL IN STANDARD FORM... Minimize cx Maximize y T b st Ax

More information

Review Solutions, Exam 2, Operations Research

Review Solutions, Exam 2, Operations Research Review Solutions, Exam 2, Operations Research 1. Prove the weak duality theorem: For any x feasible for the primal and y feasible for the dual, then... HINT: Consider the quantity y T Ax. SOLUTION: To

More information

Part 1. The Review of Linear Programming

Part 1. The Review of Linear Programming In the name of God Part 1. The Review of Linear Programming 1.5. Spring 2010 Instructor: Dr. Masoud Yaghini Outline Introduction Formulation of the Dual Problem Primal-Dual Relationship Economic Interpretation

More information

Integer Programming. The focus of this chapter is on solution techniques for integer programming models.

Integer Programming. The focus of this chapter is on solution techniques for integer programming models. Integer Programming Introduction The general linear programming model depends on the assumption of divisibility. In other words, the decision variables are allowed to take non-negative integer as well

More information

Understanding the Simplex algorithm. Standard Optimization Problems.

Understanding the Simplex algorithm. Standard Optimization Problems. Understanding the Simplex algorithm. Ma 162 Spring 2011 Ma 162 Spring 2011 February 28, 2011 Standard Optimization Problems. A standard maximization problem can be conveniently described in matrix form

More information

(P ) Minimize 4x 1 + 6x 2 + 5x 3 s.t. 2x 1 3x 3 3 3x 2 2x 3 6

(P ) Minimize 4x 1 + 6x 2 + 5x 3 s.t. 2x 1 3x 3 3 3x 2 2x 3 6 The exam is three hours long and consists of 4 exercises. The exam is graded on a scale 0-25 points, and the points assigned to each question are indicated in parenthesis within the text. Problem 1 Consider

More information

Introduction to the Simplex Algorithm Active Learning Module 3

Introduction to the Simplex Algorithm Active Learning Module 3 Introduction to the Simplex Algorithm Active Learning Module 3 J. René Villalobos and Gary L. Hogg Arizona State University Paul M. Griffin Georgia Institute of Technology Background Material Almost any

More information

OPRE 6201 : 3. Special Cases

OPRE 6201 : 3. Special Cases OPRE 6201 : 3. Special Cases 1 Initialization: The Big-M Formulation Consider the linear program: Minimize 4x 1 +x 2 3x 1 +x 2 = 3 (1) 4x 1 +3x 2 6 (2) x 1 +2x 2 3 (3) x 1, x 2 0. Notice that there are

More information

Farkas Lemma, Dual Simplex and Sensitivity Analysis

Farkas Lemma, Dual Simplex and Sensitivity Analysis Summer 2011 Optimization I Lecture 10 Farkas Lemma, Dual Simplex and Sensitivity Analysis 1 Farkas Lemma Theorem 1. Let A R m n, b R m. Then exactly one of the following two alternatives is true: (i) x

More information

Optimisation. 3/10/2010 Tibor Illés Optimisation

Optimisation. 3/10/2010 Tibor Illés Optimisation Optimisation Lectures 3 & 4: Linear Programming Problem Formulation Different forms of problems, elements of the simplex algorithm and sensitivity analysis Lecturer: Tibor Illés tibor.illes@strath.ac.uk

More information

CO350 Linear Programming Chapter 8: Degeneracy and Finite Termination

CO350 Linear Programming Chapter 8: Degeneracy and Finite Termination CO350 Linear Programming Chapter 8: Degeneracy and Finite Termination 27th June 2005 Chapter 8: Finite Termination 1 The perturbation method Recap max c T x (P ) s.t. Ax = b x 0 Assumption: B is a feasible

More information

The Primal-Dual Algorithm P&S Chapter 5 Last Revised October 30, 2006

The Primal-Dual Algorithm P&S Chapter 5 Last Revised October 30, 2006 The Primal-Dual Algorithm P&S Chapter 5 Last Revised October 30, 2006 1 Simplex solves LP by starting at a Basic Feasible Solution (BFS) and moving from BFS to BFS, always improving the objective function,

More information

Dual Basic Solutions. Observation 5.7. Consider LP in standard form with A 2 R m n,rank(a) =m, and dual LP:

Dual Basic Solutions. Observation 5.7. Consider LP in standard form with A 2 R m n,rank(a) =m, and dual LP: Dual Basic Solutions Consider LP in standard form with A 2 R m n,rank(a) =m, and dual LP: Observation 5.7. AbasisB yields min c T x max p T b s.t. A x = b s.t. p T A apple c T x 0 aprimalbasicsolutiongivenbyx

More information

Part 1. The Review of Linear Programming

Part 1. The Review of Linear Programming In the name of God Part 1. The Review of Linear Programming 1.2. Spring 2010 Instructor: Dr. Masoud Yaghini Outline Introduction Basic Feasible Solutions Key to the Algebra of the The Simplex Algorithm

More information

Lecture slides by Kevin Wayne

Lecture slides by Kevin Wayne LINEAR PROGRAMMING I a refreshing example standard form fundamental questions geometry linear algebra simplex algorithm Lecture slides by Kevin Wayne Last updated on 7/25/17 11:09 AM Linear programming

More information

15-780: LinearProgramming

15-780: LinearProgramming 15-780: LinearProgramming J. Zico Kolter February 1-3, 2016 1 Outline Introduction Some linear algebra review Linear programming Simplex algorithm Duality and dual simplex 2 Outline Introduction Some linear

More information

Linear Programming. Linear Programming I. Lecture 1. Linear Programming. Linear Programming

Linear Programming. Linear Programming I. Lecture 1. Linear Programming. Linear Programming Linear Programming Linear Programming Lecture Linear programming. Optimize a linear function subject to linear inequalities. (P) max " c j x j n j= n s. t. " a ij x j = b i # i # m j= x j 0 # j # n (P)

More information

Linear Programming. H. R. Alvarez A., Ph. D. 1

Linear Programming. H. R. Alvarez A., Ph. D. 1 Linear Programming H. R. Alvarez A., Ph. D. 1 Introduction It is a mathematical technique that allows the selection of the best course of action defining a program of feasible actions. The objective of

More information

Motivating examples Introduction to algorithms Simplex algorithm. On a particular example General algorithm. Duality An application to game theory

Motivating examples Introduction to algorithms Simplex algorithm. On a particular example General algorithm. Duality An application to game theory Instructor: Shengyu Zhang 1 LP Motivating examples Introduction to algorithms Simplex algorithm On a particular example General algorithm Duality An application to game theory 2 Example 1: profit maximization

More information

Introduction to Operations Research Prof. G. Srinivasan Department of Management Studies Indian Institute of Technology, Madras

Introduction to Operations Research Prof. G. Srinivasan Department of Management Studies Indian Institute of Technology, Madras Introduction to Operations Research Prof. G. Srinivasan Department of Management Studies Indian Institute of Technology, Madras Module - 03 Simplex Algorithm Lecture 15 Infeasibility In this class, we

More information

Linear Programming Duality P&S Chapter 3 Last Revised Nov 1, 2004

Linear Programming Duality P&S Chapter 3 Last Revised Nov 1, 2004 Linear Programming Duality P&S Chapter 3 Last Revised Nov 1, 2004 1 In this section we lean about duality, which is another way to approach linear programming. In particular, we will see: How to define

More information

AM 121 Introduction to Optimization: Models and Methods Example Questions for Midterm 1

AM 121 Introduction to Optimization: Models and Methods Example Questions for Midterm 1 AM 121 Introduction to Optimization: Models and Methods Example Questions for Midterm 1 Prof. Yiling Chen Fall 2018 Here are some practice questions to help to prepare for the midterm. The midterm will

More information

The Simplex Algorithm and Goal Programming

The Simplex Algorithm and Goal Programming The Simplex Algorithm and Goal Programming In Chapter 3, we saw how to solve two-variable linear programming problems graphically. Unfortunately, most real-life LPs have many variables, so a method is

More information

MS-E2140. Lecture 1. (course book chapters )

MS-E2140. Lecture 1. (course book chapters ) Linear Programming MS-E2140 Motivations and background Lecture 1 (course book chapters 1.1-1.4) Linear programming problems and examples Problem manipulations and standard form problems Graphical representation

More information

Ann-Brith Strömberg. Lecture 4 Linear and Integer Optimization with Applications 1/10

Ann-Brith Strömberg. Lecture 4 Linear and Integer Optimization with Applications 1/10 MVE165/MMG631 Linear and Integer Optimization with Applications Lecture 4 Linear programming: degeneracy; unbounded solution; infeasibility; starting solutions Ann-Brith Strömberg 2017 03 28 Lecture 4

More information

56:171 Operations Research Midterm Exam - October 26, 1989 Instructor: D.L. Bricker

56:171 Operations Research Midterm Exam - October 26, 1989 Instructor: D.L. Bricker 56:171 Operations Research Midterm Exam - October 26, 1989 Instructor: D.L. Bricker Answer all of Part One and two (of the four) problems of Part Two Problem: 1 2 3 4 5 6 7 8 TOTAL Possible: 16 12 20 10

More information

Lecture 11: Post-Optimal Analysis. September 23, 2009

Lecture 11: Post-Optimal Analysis. September 23, 2009 Lecture : Post-Optimal Analysis September 23, 2009 Today Lecture Dual-Simplex Algorithm Post-Optimal Analysis Chapters 4.4 and 4.5. IE 30/GE 330 Lecture Dual Simplex Method The dual simplex method will

More information

Introduction to Mathematical Programming IE406. Lecture 10. Dr. Ted Ralphs

Introduction to Mathematical Programming IE406. Lecture 10. Dr. Ted Ralphs Introduction to Mathematical Programming IE406 Lecture 10 Dr. Ted Ralphs IE406 Lecture 10 1 Reading for This Lecture Bertsimas 4.1-4.3 IE406 Lecture 10 2 Duality Theory: Motivation Consider the following

More information

1 Overview. 2 Extreme Points. AM 221: Advanced Optimization Spring 2016

1 Overview. 2 Extreme Points. AM 221: Advanced Optimization Spring 2016 AM 22: Advanced Optimization Spring 206 Prof. Yaron Singer Lecture 7 February 7th Overview In the previous lectures we saw applications of duality to game theory and later to learning theory. In this lecture

More information

Contents. 4.5 The(Primal)SimplexMethod NumericalExamplesoftheSimplexMethod

Contents. 4.5 The(Primal)SimplexMethod NumericalExamplesoftheSimplexMethod Contents 4 The Simplex Method for Solving LPs 149 4.1 Transformations to be Carried Out On an LP Model Before Applying the Simplex Method On It... 151 4.2 Definitions of Various Types of Basic Vectors

More information

LINEAR PROGRAMMING I. a refreshing example standard form fundamental questions geometry linear algebra simplex algorithm

LINEAR PROGRAMMING I. a refreshing example standard form fundamental questions geometry linear algebra simplex algorithm Linear programming Linear programming. Optimize a linear function subject to linear inequalities. (P) max c j x j n j= n s. t. a ij x j = b i i m j= x j 0 j n (P) max c T x s. t. Ax = b Lecture slides

More information

Note 3: LP Duality. If the primal problem (P) in the canonical form is min Z = n (1) then the dual problem (D) in the canonical form is max W = m (2)

Note 3: LP Duality. If the primal problem (P) in the canonical form is min Z = n (1) then the dual problem (D) in the canonical form is max W = m (2) Note 3: LP Duality If the primal problem (P) in the canonical form is min Z = n j=1 c j x j s.t. nj=1 a ij x j b i i = 1, 2,..., m (1) x j 0 j = 1, 2,..., n, then the dual problem (D) in the canonical

More information

END3033 Operations Research I Sensitivity Analysis & Duality. to accompany Operations Research: Applications and Algorithms Fatih Cavdur

END3033 Operations Research I Sensitivity Analysis & Duality. to accompany Operations Research: Applications and Algorithms Fatih Cavdur END3033 Operations Research I Sensitivity Analysis & Duality to accompany Operations Research: Applications and Algorithms Fatih Cavdur Introduction Consider the following problem where x 1 and x 2 corresponds

More information

Introduction to Operations Research

Introduction to Operations Research Introduction to Operations Research (Week 4: Linear Programming: More on Simplex and Post-Optimality) José Rui Figueira Instituto Superior Técnico Universidade de Lisboa (figueira@tecnico.ulisboa.pt) March

More information

Lecture 10: Linear programming duality and sensitivity 0-0

Lecture 10: Linear programming duality and sensitivity 0-0 Lecture 10: Linear programming duality and sensitivity 0-0 The canonical primal dual pair 1 A R m n, b R m, and c R n maximize z = c T x (1) subject to Ax b, x 0 n and minimize w = b T y (2) subject to

More information

4. Duality and Sensitivity

4. Duality and Sensitivity 4. Duality and Sensitivity For every instance of an LP, there is an associated LP known as the dual problem. The original problem is known as the primal problem. There are two de nitions of the dual pair

More information

CSC373: Algorithm Design, Analysis and Complexity Fall 2017 DENIS PANKRATOV NOVEMBER 1, 2017

CSC373: Algorithm Design, Analysis and Complexity Fall 2017 DENIS PANKRATOV NOVEMBER 1, 2017 CSC373: Algorithm Design, Analysis and Complexity Fall 2017 DENIS PANKRATOV NOVEMBER 1, 2017 Linear Function f: R n R is linear if it can be written as f x = a T x for some a R n Example: f x 1, x 2 =

More information