IE 400 Principles of Engineering Management. The Simplex Algorithm-I: Set 3

Size: px
Start display at page:

Download "IE 400 Principles of Engineering Management. The Simplex Algorithm-I: Set 3"

Transcription

1 IE 4 Principles of Engineering Management The Simple Algorithm-I: Set 3

2 So far, we have studied how to solve two-variable LP problems graphically. However, most real life problems have more than two variables! Therefore, we need to have another method to solve LPs with more than two variables. We are going to study The Simple Algorithm which is quite useful in solving very large LP problems. Today, The Simple Algorithm is used to solve LP problems in many industrial applications that involve thousands of variables and constraints.

3 LP problems can have both equality and inequality constraints. LP problems can have nonnegative and urs (unrestricted in sign) variables. To use the Simple Method, LP problems should be converted to Standard Form LP.

4 Standard Form LP: Why? We know from 2-variables that etreme points are potential optimal solutions This will be true in higher dimensions as well We need an ALGERAIC way of characterizing etreme points. We can t draw the feasible region in higher dimensions Standard form LPs will provide an easy way to do this characterization All constraints are equalities, with constant nonnegative right-hand sides (RHS), All variables are nonnegative. Any LP can be brought into standard form!

5 Simple Method: Start with an etreme point Move to a neighboring etreme point in the improving direction Stop if all neighbors are no better Simple Greedy Logic How to find a feasible etreme point? How to go to a neighbor?

6 Converting LP into Standard Form: E: Consider the following LP problem: ma s.t () = - (2) (3), 2, 3 urs (free)

7 Converting LP into Standard Form: a) Define a slack variable for each of the constraint to convert the inequality constraint into an equality constraint: s = , s () So that, the first constraint becomes: s = 5 ()

8 Converting LP into Standard Form: b) Multiply the second constraint by - to get a nonnegative right hand side value, i.e. replace = - (2) with: = (2)

9 Converting LP into Standard Form: c) Define an ecess (surplus) variable for each of the constraints to convert the inequality constraint into an equality constraint: e 3 = , e 3 (3) So that, the third constraint becomes: e 3 = 8 (3)

10 Converting LP into Standard Form: d) Variable 2 has a reverse sign restriction: Replace 2 with - 2 throughout. If 2 is nonpositive then - 2 will be nonnegative

11 Converting LP into Standard Form: e) Variable 3 is unrestricted in sign: Replace 3 with 3-3 and force both 3 and 3 to both be nonnegative

12 Converting LP into Standard Form: ma ma z= s.t () s.t s = 5 () = - (2) = (2) (3) e 3 = 8 (3), 2, 3 urs, 2, 3, 3, s, e 3.

13 To Convert an LP into Standard Form: each inequality constraint is converted into an equality constraint by adding or subtracting nonnegative slack/ecess variables, an inequality (equality) can be multiplied by - to get nonnegative RHS, unrestricted variable can be represented as the difference of two new nonnegative variables. If i is urs, then let i = i - i where i, i. Replace every occurrence of i with restrictions i, i. i - i and add sign For sign restriction k, let k = - k and replace every occurrence of k with - k and add the sign restriction k.

14 Standard Form LP: Suppose that we converted an LP with m constraints into a standard form. Also assume that after the conversion, we have n variables as, 2, 3,, n.

15 Standard Form LP: Suppose that we converted an LP with m constraints into a standard form. Also assume that after the conversion, we have n variables as, 2, 3,, n.,2,...,n i b a a a b a a a b a a a s.t. c c c ma (min) i m mn 2 m2 m 2 2n n n 2 2 n 2 2 n n n

16 Standard Form LP: If we define: n 2 2 mn m2 m 2n 22 2 n 2 b b b b, and a a a a a a a a a A n

17 Standard Form LP: If we define: n 2 2 mn m2 m 2n 22 2 n 2 b b b b, and a a a a a a a a a A n LP can be written as the system of equations : A=b

18 Standard Form LP: For A=b to have a solution, rank (A b)=rank (A). We also assume that all redundant constraints are removed, so rank(a)=m. i.e = 4 () 2-3 = (2) = (3)

19 Standard Form LP: For A=b to have a solution, rank (A b)=rank (A). We also assume that all redundant constraints are removed, so rank(a)=m. i.e = 4 () 2-3 = (2) Constraint (3) can be written as a linear combination of () and (2): 2 [()+(2)] = (3) = (3) Remove the redundant constraint

20 Standard Form LP: efore proceeding any further with the discussion of the simple algorithm, we should define the concept of a basic solution to a linear system. asic Solution: A solution to A=b is called a basic solution if it is obtained by setting n-m variables equal to and solving for the remaining m variables whose columns are linearly independent.

21 Standard Form LP: The n-m variables whose values are set to are called nonbasic variables. The remaining m variables are called basic variables.

22 Standard Form LP: For A=b, where A is a m n matri, rank(a)=m, b, pick m linearly independent columns from A, rearrange A such that these chosen columns are the first m columns in A.

23 Standard Form LP: For A=b, where A is a m n matri, rank(a)=m, b, pick m linearly independent columns from A, rearrange A such that these chosen columns are the first m columns in A. Since elementary column and row operations do not change the system of linear equations, matri A can be brought into a form A=[ m m N m (n-m) ], where m m is invertible.

24 Standard Form LP: Let be the corresponding partition in. N b N b N b A N N

25 Standard Form LP: Let be the corresponding partition in. N A b N b N b N N If we set N, then - b will be a unique solution. For every such choice, a unique solution - b.

26 Standard Form LP: If a basic solution - b, then iscalleda basic feasiblesolution (bfs).

27 asic Solutions: Consider the system of equations: = = 3, 2, 3, 4

28 asic Solutions: Consider the system of equations: , 2 (a) Converting into a standard form LP: = = 3, 2, 3, 4 (b)

29 2 (,6) (,3) (3,3) 2 = 3 Feasible Region (4) (,) (6,) (3) + 2 = 6

30 asic Solutions: Consider the system of equations: = = 3, 2, 3, b A 4 3 2

31 asic Solutions:. Let us chose: 4 3 N 2 The columns are linearly independent A

32 asic Solutions:. Let us chose: 2 N 3 4 The columns are linearly independent Setting N and solving for : b - b

33 asic Solutions:. Let us chose: 4 3 N 2 The columns are linearly independent b b : for solving and Setting - N

34 asic Solutions: bfs. is a 3 3, 3 3 Since N 2

35 asic Solutions: N 3 The columns are Linearly dependent! Let us consider different ways of forming :

36 2. asic Solutions: Let us consider different ways of forming : 3 N 2 4 The columns are Linearly dependent! Hence the choice of 3 cannot be a basic solution.

37 asic Solutions: 3. Let us chose: 3 2 N 4 The columns are linearly independent

38 asic Solutions: 3. Let us chose: 3 2 N 4 The columns are linearly independent : and solvingfor Setting N bfs. is a b -

39 asic Solutions: 4. Let us chose: 4 N 3 2 The columns are linearly independent

40 asic Solutions: 4. Let us chose: 4 N 3 2 The columns are linearly independent : and solvingfor Setting N bfs. is a b -

41 asic Solutions: 5. Let us chose: 3 N 4 2 The columns are linearly independent

42 asic Solutions: 5. Let us chose: 3 N 4 2 The columns are linearly independent : and solvingfor Setting N, b -

43 asic Solutions: 5. Let us chose: 3 N 4 2 The columns are linearly independent : and solvingfor Setting N, b - This basic solution is not feasible!

44 asic Solutions: 6. Let us chose: 2 N 4 3 The columns are linearly independent

45 asic Solutions: 6. Let us chose: 2 N 4 3 The columns are linearly independent : and solvingfor Setting N bfs. is a b -

46 asic Feasible Solutions: So, this system of equations has 4 basic feasible solutions: 3 6, 3 3, 3 6, 3 3

47 (,3) 2 = = 6 (,) =( 3, 4 ) A (6,) (,6) (3,3) Feasible Region 3 6, 3 3, 3 6, 3 3 Recall previously determined bfs: =(, 4 ) =(, 2 ) =( 2, 3 ) C D A D C

48 asic Feasible Solutions: The number of basic feasible solutions m n

49 Theorem: A point in the feasible region of an LP is an etreme point if and only if it is a basic feasible solution to the LP.

50 Fundamental Theorem of LP: If feasible set of an LP is non-empty, then there is at least one bfs. If an LP has an optimal solution, then there is a bfs which is optimal.

51 This Theorem Implies: Finding an optimal solution to an LP problem is equivalent to finding the best bfs! The number of bfs m n Therefore, we should search for the best bfs.

52 One way is to enumerate all bfs and choose the one that gives he best objective function value.

53 One way is to enumerate all bfs and choose the one that gives he best objective function value. However, enumerating all bfs can be very epensive! For eample, for n 2 and m, n m is 84756!

54 Simple Algorithm does this in a clever way. Usually it finds an optimal solution within 3m enumeration.

55 Neighboring etreme points (bfs solutions): For any LP with m constraints, two bfs are said to be adjacent if their set of basic variables have m- basic variables in common. (Intuitively, two bfs are adjacent if they both lie on the same edge of the boundary of the feasible region) Simple Algorithm goes from an etreme point to an adjacent etreme point with a better objective value.

56 (,3) 2 = = 6 (,) () (3) =( 3, 4 ) A (6,) (,6) (3,3) Feasible Region =(, 4 ) =(, 2 ) =( 2, 3 ) C D A D C 3 6, 3 3, 3 6, 3 3 Recall previously determined bfs:

57 General Description of the Simple Algorithm:. Convert the LP problem into a standard form LP. 2. Obtain a bfs to the LP. This bfs is called the initial bfs. In general, the most recent bfs is called the current bfs. Therefore, at the beginning the initial bfs is the current bfs.

58 General Description of the Simple Algorithm: 3. Determine if the current bfs is an optimal solution or not. 4. If the current bfs is not optimal, then find an adjacent bfs with a better objective function value (one nonbasic variable becomes basic and one basic variable becomes nonbasic). 5. Go to Step 3.

59 The Simple Algorithm: To begin the simple algorithm, convert the LP into a standard form, Convert the objective function z=c +c c n n to the row- format: z-c -c c n n =

60 The Simple Algorithm: ma z= ma z s.t () s.t. z = () (2) s = 6 (), s 2 = 8 (2), 2,s,s 2

61 2 (-8,) (2) (4) () (,6) (,4) (,) A (3) (4/3,4/3) C Feasible Region (6,) D (2) = 8 asic feasible solutions ,,, A C D (4) (3) () + 2 = 6

62 The Simple Algorithm Canonical Form : Row asic Variable z = s = s 2 = 8 RHS A system of linear equations in which each equation has a variable with a coefficient in that equation ( and a zero coefficient in all other equations) is said to be in canonical form. If the RHS of each constraint in a canonical form is nonnegative, a basic feasible solution can be obtained by inspection.

63 The Simple Algorithm Recall that the Simple Algorithm begins with an initial bfs and attempts to find better ones. After obtaining a canonical form, we search for the initial bfs. y inspection, if we set = 2 =, we can solve for the values of s and s 2 by setting s i equal to the RHS of row i. V={s,s 2 } and NV={, 2 }

64 The Simple Algorithm You may also verify the calculations for the initial basic feasible solution by: s s 2 2 N The columns are linearly independent b b : for solving and Setting - N s s 8 6 s s 2 2

65 The Simple Algorithm Notice that each basic variable is associated with the row of the canonical form in which the basic variable has a coefficient of. To perform the simple algorithm, we also need a basic variable (not necessarily nonnegative!) for row. Observe that variable z appears in row with a coefficient of, and z does not appear in any other row. Therefore, we use z as basic variable for row.

66 The Simple Algorithm Let us denote the initial canonical form as canonical form. With this convention, the basic and nonbasic variables for the canonical form are V={z,s,s 2 } and NV={, 2 }. For this basic feasible solution, z=, s =6, s 2 =8, =, 2 =.

67 The Simple Algorithm In summary, the canonical form: LP has equality constraints and nonnegativity constraints, There is one basic variable for each equality constraint, The column for the basic variable for constraint i has a in constraint i and s elsewhere, The remaining variables are called nonbasic.

68 The Simple Algorithm Canonical Form : Row asic Variable z = s = s 2 = 8 RHS

69 The Simple Algorithm Canonical Form : Row asic Variable z= z = s = s = 6 2 s 2 = s 2 = 8 RHS Is this current basic feasible solution optimal? To answer this question, we should determine whether there is any way that z can be increased by increasing some nonbasic variable from its current value of zero while holding all other nonbasic variables at their current values of zero (To reach an adjacent bfs).

70 The Simple Algorithm Canonical Form : Row asic Variable z= z = s = s = 6 2 s 2 = s 2 = 8 RHS

71 The Simple Algorithm Canonical Form : Row asic Variable z= z = s = s = 6 2 s 2 = s 2 = 8 RHS Row : z = if is increased by unit, z increases by unit if 2 is increased by unit, z increases by 3 units So we choose 2 as the entering variable. If 2 is to increase from its current value of zero, it has to become a basic variable.

72 The Simple Algorithm For a ma. problem, the entering variable has a negative coefficient in row. Usually we choose the variable with the most negative coefficient to be the entering variable (ties may be broken in an arbitrary fashion). 2 will become basic. Therefore, one basic variable should become nonbasic. This will be the leaving variable.

73 The Simple Algorithm Increasing 2 may cause a basic variable to become negative. We look at how increasing 2 (while holding =) changes the values of current set of basic variables: s = 6 = 2 + s = s 2 = s 2 = 8 =

74 The Simple Algorithm As s, s = As s 2, s 2 = So, 2 can be at most 4 (otherwise s 2 would become negative!)

75 The Simple Algorithm Observe that for any row in which the entering variable has a positive coefficient, the row s basic variable becomes negative if the entering variable eceeds: Right Hand Side of row Coefficien t of entering variable in row

76 The Simple Algorithm Ratio Test: When entering a variable into the basis, for every row i in which the entering variable has a positive coefficient, we compute the ratio: Coefficien RHS of row i t of entering variable in row i, and determine the smallest one. The smallest ratio is the largest value of the entering variable that will keep all the current basic variables nonnegative.

77 The Simple Algorithm Canonical Form : Row asic Variable z= z = s = s = 6 2 s 2 = s 2 = 8 RHS If 2 =4, then s 2 = and s =2. Therefore s 2 is the leaving variable and becomes nonbasic. New basic variables = {s, 2 }; and new nonbasic variables = {,s 2 } Hence, new z = +3 2 =2.

78 The Simple Algorithm Canonical Form : Row asic Variable z= z = s = s = 6 2 s 2 = s 2 = 8 leaving variable entering variable Always make the entering variable a basic variable in a row that wins the ratio test (ties may be broken arbitrarily). RHS

79 The Simple Algorithm Canonical Form : Row asic Variable z z = s = s = 6 2 s 2 = s 2 = 8 leaving variable entering variable Always make the entering variable a basic variable in a row that wins the ratio test (ties may be broken arbitrarily). RHS

80 The Simple Algorithm Canonical Form : Row asic Variable z z = s s = 6 2 s 2 = s 2 = 8 leaving variable entering variable Always make the entering variable a basic variable in a row that wins the ratio test (ties may be broken arbitrarily). RHS

81 The Simple Algorithm Row asic Variable z z = s s = s 2 = 8 RHS Always make the entering variable a basic variable in a row that wins the ratio test (ties may be broken arbitrarily).

82 The Simple Algorithm Row asic Variable z z = s s = s 2 = 8 entering variable Always make the entering variable a basic variable in a row that wins the ratio test (ties may be broken arbitrarily). RHS

83 The Simple Algorithm Row asic Variable z z = s s = s 2 = 8 entering variable Always make the entering variable a basic variable in a row that wins the ratio test (ties may be broken arbitrarily). To make 2 a basic variable in row 2, we use elementary row operations to make 2 has a coefficient of in row 2 and coefficient of in all other rows. RHS

84 The Simple Algorithm Row asic Variable z z = s s = s 2 = 8 entering variable Always make the entering variable a basic variable in a row that wins the ratio test (ties may be broken arbitrarily). To make a basic variable in row 2, we use elementary row operations to make has a coefficient of in row 2 and coefficient of in all other rows. This procedure is called pivoting on row 2. RHS

85 The Simple Algorithm Row asic Variable z z = s s = s 2 = 8 entering variable Pivoting: Purpose is to rewrite the original problem in an equivalent form where columns corresponding to basic variables form an identity matri. This allows us to determine the values of entering and leaving variables in the new solution. RHS

86 The Simple Algorithm Row asic Variable z z = s s = s 2 = 8 RHS We may perform elementary row operations step by step, starting from the pivot row, one row at a time.

87 The Simple Algorithm Row asic Variable z z = s s = s 2 = 8 RHS To make 2 has a coefficient of in row 2: multiply row 2 by.5

88 The Simple Algorithm Row asic Variable z z = s s = s 2 = 4 RHS To make 2 has a coefficient of in row 2: multiply row 2 by.5

89 The Simple Algorithm Row asic Variable z z = s s = s 2 = 4 RHS To make 2 has a coefficient of in row : replace row with row row 2

90 The Simple Algorithm Row asic Variable z z = s.5 + s -.5 s 2 = s 2 = 4 RHS To make 2 has a coefficient of in row : replace row with row row 2

91 The Simple Algorithm Row asic Variable z z = s.5 + s -.5 s 2 = s 2 = 4 RHS To make 2 has a coefficient of in row : replace row with row + 3 (row 2)

92 The Simple Algorithm Row asic Variable RHS z z s 2 = 2 s.5 + s -.5 s 2 = s 2 = 4 To make 2 has a coefficient of in row : replace row with row + 3 (row 2)

93 The Simple Algorithm Canonical Form : Row asic Variable RHS z z s 2 = 2 s.5 + s -.5 s 2 = s 2 = 4 Is this bfs optimal? No, increasing the nonbasic variable will increase z! So is the entering variable. Also note that is the variable with the most negative coefficient in row.

94 The Simple Algorithm We perform the ratio test to find the leaving variable: Since s 2 =, the system is:.5 + s = 2, and s s = 2.5 4/ = 4, and 2 2 = So, = 4/3 and s becomes the leaving variable

95 The Simple Algorithm The new bfs is: = 4/3, 2 = 4/3, s =, s 2 =, z = 46/3. Now, keep the above results in mind and let us have a look at the pivot of the simple algorithm:

96 The Simple Algorithm Canonical Form : Row asic Variable entering variable RHS z z s 2 = 2 s.5 + s -.5 s 2 = s 2 = 4 leaving variable

97 The Simple Algorithm Row asic Variable entering variable RHS z z s 2 = s -.5 s 2 = s 2 = 4 leaving variable

98 The Simple Algorithm Canonical Form 2: Row asic Variable RHS z z s 2 = s -.5 s 2 = s 2 = 4 To make a basic variable in row, we use elementary row operations to make has a coefficient of in row and coefficient of in all other rows.

99 The Simple Algorithm Canonical Form 2: Row asic Variable RHS z z s 2 = s -.5 s 2 = s 2 = 4 To make has a coefficient of in row : multiply row by 2/3

100 The Simple Algorithm Canonical Form 2: Row asic Variable RHS z z s 2 = 2 + 2/3 s - /3 s 2 = 4/ s 2 = 4 To make has a coefficient of in row : multiply row by 2/3

101 The Simple Algorithm Canonical Form 2: Row asic Variable RHS z z s 2 = 2 + 2/3 s - /3 s 2 = 4/ s 2 = 4

102 The Simple Algorithm Canonical Form 2: Row asic Variable RHS z z s 2 = 2 + 2/3 s - /3 s 2 = 4/ s 2 = 4 To make has a coefficient of in row 2: multiply row by.5 and add to the row 2

103 The Simple Algorithm Canonical Form 2: Row asic Variable RHS z z s 2 = 2 + 2/3 s - /3 s 2 = 4/ /3 s + /3 s 2 = 4/3 To make has a coefficient of in row 2: multiply row by.5 and add to the row 2

104 The Simple Algorithm Canonical Form 2: Row asic Variable RHS z z s 2 = 2 + 2/3 s - /3 s 2 = 4/ /3 s + /3 s 2 = 4/3

105 The Simple Algorithm Canonical Form 2: Row asic Variable RHS z z s 2 = 2 + 2/3 s - /3 s 2 = 4/ /3 s + /3 s 2 = 4/3 To make has a coefficient of in row : multiply row by 2.5 and add to the row

106 The Simple Algorithm Canonical Form 2: Row asic Variable RHS z z + 5/3 s + 2/3 s 2 = 46/3 + 2/3 s - /3 s 2 = 4/ /3 s + /3 s 2 = 4/3 To make has a coefficient of in row : multiply row by 2.5 and add to the row

107 The Simple Algorithm Canonical Form 2: Row asic Variable RHS z z + 5/3 s + 2/3 s 2 = 46/3 + 2/3 s - /3 s 2 = 4/ /3 s + /3 s 2 = 4/3 This result is the same as we had calculated before!

108 The Simple Algorithm Previously calculated new bfs was: = 4/3, 2 = 4/3, s =, s 2 =, z = 46/3.

109 The Simple Algorithm Canonical Form 2: Row asic Variable RHS z z + 5/3 s + 2/3 s 2 = 46/3 + 2/3 s - /3 s 2 = 4/ /3 s + /3 s 2 = 4/3 Is this bfs optimal? YES! ecause increasing nonbasic variables s and s 2 will decrease z (Also note that there is no variable in row with a negative coefficient!)

110 Representing Simple Tableaus Instead of writing each variable in every constraint, we can use a shorthand display called a simple tableau.

111 Representing Simple Tableaus Canonical Form : Row asic Variable z= z = s = s = 6 2 s 2 = s 2 = 8 RHS For eample, canonical form could be written as Row asic Variable z 2 s s 2 RHS z= - -3 s =6 6 2 s 2 =8-2 8

112 Representing Simple Tableaus With this format, it is very easy to spot the basic variables. We just look for columns with a column of identity matri underneath.

113 2 Simple Iteration : 2 enters s 2 leaves ratio test=4, ma value for 2 (-8,) (2) (4) () (,6) (,4) (,) A (3) (4/3,4/3) C Feasible Region (6,) D (2) = 8 asic feasible solutions ,,, A C D (4) (3) () + 2 = 6 Simple Iteration 2: enters 3 leaves ratio test=4/3, ma value for

114 Also note that, since we are in canonical form, the basic variable of a row will be equal to the RHS of that row. Representing Simple Tableaus Simple Tableau-: asic Variable z 2 s s 2 RHS z= - -3 s =6 6 s 2 =8-2 8 Note that z will always be a basic variable. Therefore, we won t be mentioning it unless it is necessary. In addition, since row corresponds to the objective function, it is indicated separately in the simple tableau.

115 Representing Simple Tableaus Simple Tableau-: asic Variable z 2 s s 2 RHS z= - -3 s =6 6 s 2 =8-2 8 Now let us summarize what we have done so far!

116 Representing Simple Tableaus Simple Tableau-: asic Variable z 2 s s 2 RHS z For a ma problem: We start with an initial bfs in the canonical form above (if there are m slack variables, we use them as basic variables)

117 Representing Simple Tableaus Simple Tableau-: asic Variable z 2 s s 2 RHS z - -3 s 6 s For a ma problem: We start with an initial bfs in the canonical form above (if there are m slack variables, we use them as basic variables)

118 Representing Simple Tableaus Simple Tableau-: entering variable asic Variable z 2 s s 2 RHS z - -3 s 6 s Entering Variable: Choose a variable with the most negative coefficient in row.

119 Representing Simple Tableaus Simple Tableau-: entering variable asic Variable z 2 s s 2 RHS z - -3 s 6 s 2-2 8

120 Representing Simple Tableaus Simple Tableau-: entering variable asic Variable z 2 s s 2 RHS z - -3 s 6 s Leaving Variable: compute ratios: Coefficien RHS of row i t of entering variable in row, i The smallest positive ratio wins and the basic variable of the winning row leaves the basis.

121 Representing Simple Tableaus Simple Tableau-: entering variable asic Variable z 2 s s 2 RHS Ratio Test z - -3 s 6 6 s leaving variable pivot term Leaving Variable: compute ratios: Coefficien RHS of row i t of entering variable in row, i The smallest positive ratio wins and the basic variable of the winning row leaves the basis.

122 Representing Simple Tableaus Simple Tableau-: entering variable asic Variable z 2 s s 2 RHS Ratio Test z - -3 s 6 6 s leaving variable pivot term Leaving Variable: compute ratios: Coefficien RHS of row i t of entering variable in row, i The smallest positive ratio wins and the basic variable of the winning row leaves the basis.

123 Representing Simple Tableaus Simple Tableau-: asic Variable z 2 s s 2 RHS Ratio Test z - -3 s pivot term Leaving Variable: compute ratios: Coefficien RHS of row i t of entering variable in row, i The smallest positive ratio wins and the basic variable of the winning row leaves the basis.

124 Representing Simple Tableaus Simple Tableau-: asic Variable z 2 s s 2 RHS z - -3 s pivot term Leaving Variable: compute ratios: Coefficien RHS of row i t of entering variable in row, i The smallest positive ratio wins and the basic variable of the winning row leaves the basis.

125 Representing Simple Tableaus Simple Tableau-: asic Variable z 2 s s 2 RHS z - -3 s pivot term

126 Representing Simple Tableaus Simple Tableau-: asic Variable z 2 s s 2 RHS z - -3 s pivot term Pivot: Transform the tableau so that the new basic variable (entering variable) has in the row of the leaving variable (pivot row) and in other rows.

127 Representing Simple Tableaus Simple Tableau-: asic Variable z 2 s s 2 RHS z - -3 s 6 2 pivot term Pivot: Transform the tableau so that the new basic variable (entering variable) has in the row of the leaving variable (pivot row) and in other rows.

128 Representing Simple Tableaus Simple Tableau-: asic Variable z 2 s s 2 RHS z - -3 s 6 2 -/2 /2 4 pivot term Pivot: Transform the tableau so that the new basic variable (entering variable) has in the row of the leaving variable (pivot row) and in other rows.

129 Representing Simple Tableaus Simple Tableau-: asic Variable z 2 s s 2 RHS z - -3 s 2 -/2 /2 4 pivot term Pivot: Transform the tableau so that the new basic variable (entering variable) has in the row of the leaving variable (pivot row) and in other rows.

130 Representing Simple Tableaus Simple Tableau-: asic Variable z 2 s s 2 RHS z - -3 s 3/2 -/ /2 /2 4 pivot term Pivot: Transform the tableau so that the new basic variable (entering variable) has in the row of the leaving variable (pivot row) and in other rows.

131 Representing Simple Tableaus Simple Tableau-: asic Variable z z 2 s s 2 RHS s 3/2 -/ /2 /2 4 pivot term Pivot: Transform the tableau so that the new basic variable (entering variable) has in the row of the leaving variable (pivot row) and in other rows.

132 Representing Simple Tableaus Simple Tableau-: asic Variable z 2 s s 2 RHS z -5/2 3/2 2 s 3/2 -/ /2 /2 4 pivot term Pivot: Transform the tableau so that the new basic variable (entering variable) has in the row of the leaving variable (pivot row) and in other rows.

133 Representing Simple Tableaus Simple Tableau-: enter asic Variable z 2 s s 2 RHS z -5/2 3/2 2 s 3/2 -/ /2 /2 4

134 Representing Simple Tableaus leave Simple Tableau-: enter asic Variable z 2 s s 2 RHS Ratio Test z -5/2 3/2 2 s 3/2 -/2 2 4/3 2 -/2 /2 4 no ratio

135 Representing Simple Tableaus leave Simple Tableau-: enter asic Variable z 2 s s 2 RHS Ratio Test z -5/2 3/2 2 3/2 -/2 2 4/3 2 -/2 /2 4 no ratio

136 Representing Simple Tableaus Simple Tableau-: asic Variable z 2 s s 2 RHS Ratio Test z -5/2 3/2 2 3/2 -/2 2 4/3 2 -/2 /2 4 no ratio

137 Representing Simple Tableaus Simple Tableau-: asic Variable z 2 s s 2 RHS z -5/2 3/2 2 3/2 -/ /2 /2 4

138 Representing Simple Tableaus Simple Tableau-2: asic Variable z 2 s s 2 RHS z 5/3 2/3 46/3 2/3 -/3 4/3 2 /3 /3 4/3

139 Representing Simple Tableaus Simple Tableau-2: asic Variable z 2 s s 2 RHS z 5/3 2/3 46/3 2/3 -/3 4/3 2 /3 /3 4/3 Can we iterate more? No, because all row coefficients are nonnegative. We stop here. The current bfs is optimal!

140 Summary of the Simple Algorithm (For a ma problem) ) Convert the LP into the standard form and then obtain the canonical form 2) Find an initial bfs (if there are m slack variables, use them as basic variables). If all nonbasic variables have nonnegative coefficients in row, then the current LP is optimal. If there are any variables with a negative coefficient, then we should decide the entering variable. Entering variable: choose a variable with the most negative coefficient in row to enter the basis.

141 Summary of the Simple Algorithm 3) For any row in which the entering variable has a positive coefficient, compute the ratios: RHS of row i Coefficient of the entering variable in row i The smallest ratio wins (ties may be broken arbitrarily) and the basic variable of the winning row leaves the basis. 4) Pivot: Transform the tableau so that the new basic variable (entering variable) has coefficient of in the row of the leaving variable (pivot row) and coefficient of in all other rows. In the end, we get a tableau with a new canonical form.

142 Summary of the Simple Algorithm After the pivoting, note that: New pivot row coefficien t of variable in the the entering pivot row old pivot row new row i old coefficien t of row i - variable in the the entering pivot row new pivot row

143 Summary of the Simple Algorithm 5) Repeat steps,2,3, and 4 until all row coefficients becomes nonnegative. If each nonbasic variable has a nonnegative coefficient in a canonical form s row (remember that basic variables have coefficient of in row of a canonical form), then the canonical form is optimal. We stop here and the current bfs is optimal!

Chapter 4 The Simplex Algorithm Part I

Chapter 4 The Simplex Algorithm Part I Chapter 4 The Simplex Algorithm Part I Based on Introduction to Mathematical Programming: Operations Research, Volume 1 4th edition, by Wayne L. Winston and Munirpallam Venkataramanan Lewis Ntaimo 1 Modeling

More information

The Simplex Algorithm and Goal Programming

The Simplex Algorithm and Goal Programming The Simplex Algorithm and Goal Programming In Chapter 3, we saw how to solve two-variable linear programming problems graphically. Unfortunately, most real-life LPs have many variables, so a method is

More information

ECE 307 Techniques for Engineering Decisions

ECE 307 Techniques for Engineering Decisions ECE 7 Techniques for Engineering Decisions Introduction to the Simple Algorithm George Gross Department of Electrical and Computer Engineering University of Illinois at Urbana-Champaign ECE 7 5 9 George

More information

Week 3: Simplex Method I

Week 3: Simplex Method I Week 3: Simplex Method I 1 1. Introduction The simplex method computations are particularly tedious and repetitive. It attempts to move from one corner point of the solution space to a better corner point

More information

Chapter 4 The Simplex Algorithm Part II

Chapter 4 The Simplex Algorithm Part II Chapter 4 The Simple Algorithm Part II Based on Introduction to Mathematical Programming: Operations Research, Volume 4th edition, by Wayne L Winston and Munirpallam Venkataramanan Lewis Ntaimo L Ntaimo

More information

Math Models of OR: Some Definitions

Math Models of OR: Some Definitions Math Models of OR: Some Definitions John E. Mitchell Department of Mathematical Sciences RPI, Troy, NY 12180 USA September 2018 Mitchell Some Definitions 1 / 20 Active constraints Outline 1 Active constraints

More information

The Simplex Method. Lecture 5 Standard and Canonical Forms and Setting up the Tableau. Lecture 5 Slide 1. FOMGT 353 Introduction to Management Science

The Simplex Method. Lecture 5 Standard and Canonical Forms and Setting up the Tableau. Lecture 5 Slide 1. FOMGT 353 Introduction to Management Science The Simplex Method Lecture 5 Standard and Canonical Forms and Setting up the Tableau Lecture 5 Slide 1 The Simplex Method Formulate Constrained Maximization or Minimization Problem Convert to Standard

More information

TIM 206 Lecture 3: The Simplex Method

TIM 206 Lecture 3: The Simplex Method TIM 206 Lecture 3: The Simplex Method Kevin Ross. Scribe: Shane Brennan (2006) September 29, 2011 1 Basic Feasible Solutions Have equation Ax = b contain more columns (variables) than rows (constraints),

More information

Part 1. The Review of Linear Programming

Part 1. The Review of Linear Programming In the name of God Part 1. The Review of Linear Programming 1.2. Spring 2010 Instructor: Dr. Masoud Yaghini Outline Introduction Basic Feasible Solutions Key to the Algebra of the The Simplex Algorithm

More information

The Graphical Method & Algebraic Technique for Solving LP s. Métodos Cuantitativos M. En C. Eduardo Bustos Farías 1

The Graphical Method & Algebraic Technique for Solving LP s. Métodos Cuantitativos M. En C. Eduardo Bustos Farías 1 The Graphical Method & Algebraic Technique for Solving LP s Métodos Cuantitativos M. En C. Eduardo Bustos Farías The Graphical Method for Solving LP s If LP models have only two variables, they can be

More information

Ω R n is called the constraint set or feasible set. x 1

Ω R n is called the constraint set or feasible set. x 1 1 Chapter 5 Linear Programming (LP) General constrained optimization problem: minimize subject to f(x) x Ω Ω R n is called the constraint set or feasible set. any point x Ω is called a feasible point We

More information

February 22, Introduction to the Simplex Algorithm

February 22, Introduction to the Simplex Algorithm 15.53 February 22, 27 Introduction to the Simplex Algorithm 1 Quotes for today Give a man a fish and you feed him for a day. Teach him how to fish and you feed him for a lifetime. -- Lao Tzu Give a man

More information

1 Review Session. 1.1 Lecture 2

1 Review Session. 1.1 Lecture 2 1 Review Session Note: The following lists give an overview of the material that was covered in the lectures and sections. Your TF will go through these lists. If anything is unclear or you have questions

More information

Simplex Method for LP (II)

Simplex Method for LP (II) Simplex Method for LP (II) Xiaoxi Li Wuhan University Sept. 27, 2017 (week 4) Operations Research (Li, X.) Simplex Method for LP (II) Sept. 27, 2017 (week 4) 1 / 31 Organization of this lecture Contents:

More information

(includes both Phases I & II)

(includes both Phases I & II) Minimize z=3x 5x 4x 7x 5x 4x subject to 2x x2 x4 3x6 0 x 3x3 x4 3x5 2x6 2 4x2 2x3 3x4 x5 5 and x 0 j, 6 2 3 4 5 6 j ecause of the lack of a slack variable in each constraint, we must use Phase I to find

More information

CPS 616 ITERATIVE IMPROVEMENTS 10-1

CPS 616 ITERATIVE IMPROVEMENTS 10-1 CPS 66 ITERATIVE IMPROVEMENTS 0 - APPROACH Algorithm design technique for solving optimization problems Start with a feasible solution Repeat the following step until no improvement can be found: change

More information

Simplex Algorithm Using Canonical Tableaus

Simplex Algorithm Using Canonical Tableaus 41 Simplex Algorithm Using Canonical Tableaus Consider LP in standard form: Min z = cx + α subject to Ax = b where A m n has rank m and α is a constant In tableau form we record it as below Original Tableau

More information

Lesson 27 Linear Programming; The Simplex Method

Lesson 27 Linear Programming; The Simplex Method Lesson Linear Programming; The Simplex Method Math 0 April 9, 006 Setup A standard linear programming problem is to maximize the quantity c x + c x +... c n x n = c T x subject to constraints a x + a x

More information

Chapter 5 Linear Programming (LP)

Chapter 5 Linear Programming (LP) Chapter 5 Linear Programming (LP) General constrained optimization problem: minimize f(x) subject to x R n is called the constraint set or feasible set. any point x is called a feasible point We consider

More information

(includes both Phases I & II)

(includes both Phases I & II) (includes both Phases I & II) Dennis ricker Dept of Mechanical & Industrial Engineering The University of Iowa Revised Simplex Method 09/23/04 page 1 of 22 Minimize z=3x + 5x + 4x + 7x + 5x + 4x subject

More information

"SYMMETRIC" PRIMAL-DUAL PAIR

SYMMETRIC PRIMAL-DUAL PAIR "SYMMETRIC" PRIMAL-DUAL PAIR PRIMAL Minimize cx DUAL Maximize y T b st Ax b st A T y c T x y Here c 1 n, x n 1, b m 1, A m n, y m 1, WITH THE PRIMAL IN STANDARD FORM... Minimize cx Maximize y T b st Ax

More information

9.1 Linear Programs in canonical form

9.1 Linear Programs in canonical form 9.1 Linear Programs in canonical form LP in standard form: max (LP) s.t. where b i R, i = 1,..., m z = j c jx j j a ijx j b i i = 1,..., m x j 0 j = 1,..., n But the Simplex method works only on systems

More information

Yinyu Ye, MS&E, Stanford MS&E310 Lecture Note #06. The Simplex Method

Yinyu Ye, MS&E, Stanford MS&E310 Lecture Note #06. The Simplex Method The Simplex Method Yinyu Ye Department of Management Science and Engineering Stanford University Stanford, CA 94305, U.S.A. http://www.stanford.edu/ yyye (LY, Chapters 2.3-2.5, 3.1-3.4) 1 Geometry of Linear

More information

Gauss-Jordan Elimination for Solving Linear Equations Example: 1. Solve the following equations: (3)

Gauss-Jordan Elimination for Solving Linear Equations Example: 1. Solve the following equations: (3) The Simple Method Gauss-Jordan Elimination for Solving Linear Equations Eample: Gauss-Jordan Elimination Solve the following equations: + + + + = 4 = = () () () - In the first step of the procedure, we

More information

Standard Form An LP is in standard form when: All variables are non-negativenegative All constraints are equalities Putting an LP formulation into sta

Standard Form An LP is in standard form when: All variables are non-negativenegative All constraints are equalities Putting an LP formulation into sta Chapter 4 Linear Programming: The Simplex Method An Overview of the Simplex Method Standard Form Tableau Form Setting Up the Initial Simplex Tableau Improving the Solution Calculating the Next Tableau

More information

AM 121: Intro to Optimization

AM 121: Intro to Optimization AM 121: Intro to Optimization Models and Methods Lecture 6: Phase I, degeneracy, smallest subscript rule. Yiling Chen SEAS Lesson Plan Phase 1 (initialization) Degeneracy and cycling Smallest subscript

More information

Chap6 Duality Theory and Sensitivity Analysis

Chap6 Duality Theory and Sensitivity Analysis Chap6 Duality Theory and Sensitivity Analysis The rationale of duality theory Max 4x 1 + x 2 + 5x 3 + 3x 4 S.T. x 1 x 2 x 3 + 3x 4 1 5x 1 + x 2 + 3x 3 + 8x 4 55 x 1 + 2x 2 + 3x 3 5x 4 3 x 1 ~x 4 0 If we

More information

In Chapters 3 and 4 we introduced linear programming

In Chapters 3 and 4 we introduced linear programming SUPPLEMENT The Simplex Method CD3 In Chapters 3 and 4 we introduced linear programming and showed how models with two variables can be solved graphically. We relied on computer programs (WINQSB, Excel,

More information

AM 121: Intro to Optimization Models and Methods Fall 2018

AM 121: Intro to Optimization Models and Methods Fall 2018 AM 121: Intro to Optimization Models and Methods Fall 2018 Lecture 5: The Simplex Method Yiling Chen Harvard SEAS Lesson Plan This lecture: Moving towards an algorithm for solving LPs Tableau. Adjacent

More information

F 1 F 2 Daily Requirement Cost N N N

F 1 F 2 Daily Requirement Cost N N N Chapter 5 DUALITY 5. The Dual Problems Every linear programming problem has associated with it another linear programming problem and that the two problems have such a close relationship that whenever

More information

Prelude to the Simplex Algorithm. The Algebraic Approach The search for extreme point solutions.

Prelude to the Simplex Algorithm. The Algebraic Approach The search for extreme point solutions. Prelude to the Simplex Algorithm The Algebraic Approach The search for extreme point solutions. 1 Linear Programming-1 x 2 12 8 (4,8) Max z = 6x 1 + 4x 2 Subj. to: x 1 + x 2

More information

Dr. Maddah ENMG 500 Engineering Management I 10/21/07

Dr. Maddah ENMG 500 Engineering Management I 10/21/07 Dr. Maddah ENMG 500 Engineering Management I 10/21/07 Computational Procedure of the Simplex Method The optimal solution of a general LP problem is obtained in the following steps: Step 1. Express the

More information

Linear & Integer programming

Linear & Integer programming ELL 894 Performance Evaluation on Communication Networks Standard form I Lecture 5 Linear & Integer programming subject to where b is a vector of length m c T A = b (decision variables) and c are vectors

More information

Sensitivity Analysis

Sensitivity Analysis Dr. Maddah ENMG 500 /9/07 Sensitivity Analysis Changes in the RHS (b) Consider an optimal LP solution. Suppose that the original RHS (b) is changed from b 0 to b new. In the following, we study the affect

More information

A Review of Linear Programming

A Review of Linear Programming A Review of Linear Programming Instructor: Farid Alizadeh IEOR 4600y Spring 2001 February 14, 2001 1 Overview In this note we review the basic properties of linear programming including the primal simplex

More information

3. THE SIMPLEX ALGORITHM

3. THE SIMPLEX ALGORITHM Optimization. THE SIMPLEX ALGORITHM DPK Easter Term. Introduction We know that, if a linear programming problem has a finite optimal solution, it has an optimal solution at a basic feasible solution (b.f.s.).

More information

1. Algebraic and geometric treatments Consider an LP problem in the standard form. x 0. Solutions to the system of linear equations

1. Algebraic and geometric treatments Consider an LP problem in the standard form. x 0. Solutions to the system of linear equations The Simplex Method Most textbooks in mathematical optimization, especially linear programming, deal with the simplex method. In this note we study the simplex method. It requires basically elementary linear

More information

Dr. S. Bourazza Math-473 Jazan University Department of Mathematics

Dr. S. Bourazza Math-473 Jazan University Department of Mathematics Dr. Said Bourazza Department of Mathematics Jazan University 1 P a g e Contents: Chapter 0: Modelization 3 Chapter1: Graphical Methods 7 Chapter2: Simplex method 13 Chapter3: Duality 36 Chapter4: Transportation

More information

MATH 445/545 Homework 2: Due March 3rd, 2016

MATH 445/545 Homework 2: Due March 3rd, 2016 MATH 445/545 Homework 2: Due March 3rd, 216 Answer the following questions. Please include the question with the solution (write or type them out doing this will help you digest the problem). I do not

More information

The Simplex Method. Formulate Constrained Maximization or Minimization Problem. Convert to Standard Form. Convert to Canonical Form

The Simplex Method. Formulate Constrained Maximization or Minimization Problem. Convert to Standard Form. Convert to Canonical Form The Simplex Method 1 The Simplex Method Formulate Constrained Maximization or Minimization Problem Convert to Standard Form Convert to Canonical Form Set Up the Tableau and the Initial Basic Feasible Solution

More information

Linear Programming Redux

Linear Programming Redux Linear Programming Redux Jim Bremer May 12, 2008 The purpose of these notes is to review the basics of linear programming and the simplex method in a clear, concise, and comprehensive way. The book contains

More information

Linear Programming. Linear Programming I. Lecture 1. Linear Programming. Linear Programming

Linear Programming. Linear Programming I. Lecture 1. Linear Programming. Linear Programming Linear Programming Linear Programming Lecture Linear programming. Optimize a linear function subject to linear inequalities. (P) max " c j x j n j= n s. t. " a ij x j = b i # i # m j= x j 0 # j # n (P)

More information

IE 5531: Engineering Optimization I

IE 5531: Engineering Optimization I IE 5531: Engineering Optimization I Lecture 5: The Simplex method, continued Prof. John Gunnar Carlsson September 22, 2010 Prof. John Gunnar Carlsson IE 5531: Engineering Optimization I September 22, 2010

More information

IE 400: Principles of Engineering Management. Simplex Method Continued

IE 400: Principles of Engineering Management. Simplex Method Continued IE 400: Principles of Engineering Management Simplex Method Continued 1 Agenda Simplex for min problems Alternative optimal solutions Unboundedness Degeneracy Big M method Two phase method 2 Simplex for

More information

The dual simplex method with bounds

The dual simplex method with bounds The dual simplex method with bounds Linear programming basis. Let a linear programming problem be given by min s.t. c T x Ax = b x R n, (P) where we assume A R m n to be full row rank (we will see in the

More information

Review Solutions, Exam 2, Operations Research

Review Solutions, Exam 2, Operations Research Review Solutions, Exam 2, Operations Research 1. Prove the weak duality theorem: For any x feasible for the primal and y feasible for the dual, then... HINT: Consider the quantity y T Ax. SOLUTION: To

More information

CO350 Linear Programming Chapter 8: Degeneracy and Finite Termination

CO350 Linear Programming Chapter 8: Degeneracy and Finite Termination CO350 Linear Programming Chapter 8: Degeneracy and Finite Termination 27th June 2005 Chapter 8: Finite Termination 1 The perturbation method Recap max c T x (P ) s.t. Ax = b x 0 Assumption: B is a feasible

More information

The augmented form of this LP is the following linear system of equations:

The augmented form of this LP is the following linear system of equations: 1 Consider the following LP given in standard form: max z = 5 x_1 + 2 x_2 Subject to 3 x_1 + 2 x_2 2400 x_2 800 2 x_1 1200 x_1, x_2 >= 0 The augmented form of this LP is the following linear system of

More information

Optimization Methods in Management Science

Optimization Methods in Management Science Optimization Methods in Management Science MIT 15.05 Recitation 8 TAs: Giacomo Nannicini, Ebrahim Nasrabadi At the end of this recitation, students should be able to: 1. Derive Gomory cut from fractional

More information

Example. 1 Rows 1,..., m of the simplex tableau remain lexicographically positive

Example. 1 Rows 1,..., m of the simplex tableau remain lexicographically positive 3.4 Anticycling Lexicographic order In this section we discuss two pivoting rules that are guaranteed to avoid cycling. These are the lexicographic rule and Bland s rule. Definition A vector u R n is lexicographically

More information

Linear Programming, Lecture 4

Linear Programming, Lecture 4 Linear Programming, Lecture 4 Corbett Redden October 3, 2016 Simplex Form Conventions Examples Simplex Method To run the simplex method, we start from a Linear Program (LP) in the following standard simplex

More information

Simplex tableau CE 377K. April 2, 2015

Simplex tableau CE 377K. April 2, 2015 CE 377K April 2, 2015 Review Reduced costs Basic and nonbasic variables OUTLINE Review by example: simplex method demonstration Outline Example You own a small firm producing construction materials for

More information

OPERATIONS RESEARCH. Linear Programming Problem

OPERATIONS RESEARCH. Linear Programming Problem OPERATIONS RESEARCH Chapter 1 Linear Programming Problem Prof. Bibhas C. Giri Department of Mathematics Jadavpur University Kolkata, India Email: bcgiri.jumath@gmail.com MODULE - 2: Simplex Method for

More information

4. Duality and Sensitivity

4. Duality and Sensitivity 4. Duality and Sensitivity For every instance of an LP, there is an associated LP known as the dual problem. The original problem is known as the primal problem. There are two de nitions of the dual pair

More information

Slack Variable. Max Z= 3x 1 + 4x 2 + 5X 3. Subject to: X 1 + X 2 + X x 1 + 4x 2 + X X 1 + X 2 + 4X 3 10 X 1 0, X 2 0, X 3 0

Slack Variable. Max Z= 3x 1 + 4x 2 + 5X 3. Subject to: X 1 + X 2 + X x 1 + 4x 2 + X X 1 + X 2 + 4X 3 10 X 1 0, X 2 0, X 3 0 Simplex Method Slack Variable Max Z= 3x 1 + 4x 2 + 5X 3 Subject to: X 1 + X 2 + X 3 20 3x 1 + 4x 2 + X 3 15 2X 1 + X 2 + 4X 3 10 X 1 0, X 2 0, X 3 0 Standard Form Max Z= 3x 1 +4x 2 +5X 3 + 0S 1 + 0S 2

More information

Contents. 4.5 The(Primal)SimplexMethod NumericalExamplesoftheSimplexMethod

Contents. 4.5 The(Primal)SimplexMethod NumericalExamplesoftheSimplexMethod Contents 4 The Simplex Method for Solving LPs 149 4.1 Transformations to be Carried Out On an LP Model Before Applying the Simplex Method On It... 151 4.2 Definitions of Various Types of Basic Vectors

More information

MAT016: Optimization

MAT016: Optimization MAT016: Optimization M.El Ghami e-mail: melghami@ii.uib.no URL: http://www.ii.uib.no/ melghami/ March 29, 2011 Outline for today The Simplex method in matrix notation Managing a production facility The

More information

TRANSPORTATION PROBLEMS

TRANSPORTATION PROBLEMS Chapter 6 TRANSPORTATION PROBLEMS 61 Transportation Model Transportation models deal with the determination of a minimum-cost plan for transporting a commodity from a number of sources to a number of destinations

More information

Lecture 5 Simplex Method. September 2, 2009

Lecture 5 Simplex Method. September 2, 2009 Simplex Method September 2, 2009 Outline: Lecture 5 Re-cap blind search Simplex method in steps Simplex tableau Operations Research Methods 1 Determining an optimal solution by exhaustive search Lecture

More information

The Simplex Algorithm

The Simplex Algorithm The Simplex Algorithm How to Convert an LP to Standard Form Before the simplex algorithm can be used to solve an LP, the LP must be converted into a problem where all the constraints are equations and

More information

CO350 Linear Programming Chapter 6: The Simplex Method

CO350 Linear Programming Chapter 6: The Simplex Method CO50 Linear Programming Chapter 6: The Simplex Method rd June 2005 Chapter 6: The Simplex Method 1 Recap Suppose A is an m-by-n matrix with rank m. max. c T x (P ) s.t. Ax = b x 0 On Wednesday, we learned

More information

Lecture 4: Algebra, Geometry, and Complexity of the Simplex Method. Reading: Sections 2.6.4, 3.5,

Lecture 4: Algebra, Geometry, and Complexity of the Simplex Method. Reading: Sections 2.6.4, 3.5, Lecture 4: Algebra, Geometry, and Complexity of the Simplex Method Reading: Sections 2.6.4, 3.5, 10.2 10.5 1 Summary of the Phase I/Phase II Simplex Method We write a typical simplex tableau as z x 1 x

More information

Chapter 3, Operations Research (OR)

Chapter 3, Operations Research (OR) Chapter 3, Operations Research (OR) Kent Andersen February 7, 2007 1 Linear Programs (continued) In the last chapter, we introduced the general form of a linear program, which we denote (P) Minimize Z

More information

Introduction to the Simplex Algorithm Active Learning Module 3

Introduction to the Simplex Algorithm Active Learning Module 3 Introduction to the Simplex Algorithm Active Learning Module 3 J. René Villalobos and Gary L. Hogg Arizona State University Paul M. Griffin Georgia Institute of Technology Background Material Almost any

More information

MATH 4211/6211 Optimization Linear Programming

MATH 4211/6211 Optimization Linear Programming MATH 4211/6211 Optimization Linear Programming Xiaojing Ye Department of Mathematics & Statistics Georgia State University Xiaojing Ye, Math & Stat, Georgia State University 0 The standard form of a Linear

More information

MATH2070 Optimisation

MATH2070 Optimisation MATH2070 Optimisation Linear Programming Semester 2, 2012 Lecturer: I.W. Guo Lecture slides courtesy of J.R. Wishart Review The standard Linear Programming (LP) Problem Graphical method of solving LP problem

More information

OPTIMISATION 3: NOTES ON THE SIMPLEX ALGORITHM

OPTIMISATION 3: NOTES ON THE SIMPLEX ALGORITHM OPTIMISATION 3: NOTES ON THE SIMPLEX ALGORITHM Abstract These notes give a summary of the essential ideas and results It is not a complete account; see Winston Chapters 4, 5 and 6 The conventions and notation

More information

Fundamental Theorems of Optimization

Fundamental Theorems of Optimization Fundamental Theorems of Optimization 1 Fundamental Theorems of Math Prog. Maximizing a concave function over a convex set. Maximizing a convex function over a closed bounded convex set. 2 Maximizing Concave

More information

min3x 1 + 4x 2 + 5x 3 2x 1 + 2x 2 + x 3 6 x 1 + 2x 2 + 3x 3 5 x 1, x 2, x 3 0.

min3x 1 + 4x 2 + 5x 3 2x 1 + 2x 2 + x 3 6 x 1 + 2x 2 + 3x 3 5 x 1, x 2, x 3 0. ex-.-. Foundations of Operations Research Prof. E. Amaldi. Dual simplex algorithm Given the linear program minx + x + x x + x + x 6 x + x + x x, x, x. solve it via the dual simplex algorithm. Describe

More information

OPRE 6201 : 3. Special Cases

OPRE 6201 : 3. Special Cases OPRE 6201 : 3. Special Cases 1 Initialization: The Big-M Formulation Consider the linear program: Minimize 4x 1 +x 2 3x 1 +x 2 = 3 (1) 4x 1 +3x 2 6 (2) x 1 +2x 2 3 (3) x 1, x 2 0. Notice that there are

More information

Operations Research Lecture 2: Linear Programming Simplex Method

Operations Research Lecture 2: Linear Programming Simplex Method Operations Research Lecture 2: Linear Programming Simplex Method Notes taken by Kaiquan Xu@Business School, Nanjing University Mar 10th 2016 1 Geometry of LP 1.1 Graphical Representation and Solution Example

More information

Systems Analysis in Construction

Systems Analysis in Construction Systems Analysis in Construction CB312 Construction & Building Engineering Department- AASTMT by A h m e d E l h a k e e m & M o h a m e d S a i e d 3. Linear Programming Optimization Simplex Method 135

More information

LP. Lecture 3. Chapter 3: degeneracy. degeneracy example cycling the lexicographic method other pivot rules the fundamental theorem of LP

LP. Lecture 3. Chapter 3: degeneracy. degeneracy example cycling the lexicographic method other pivot rules the fundamental theorem of LP LP. Lecture 3. Chapter 3: degeneracy. degeneracy example cycling the lexicographic method other pivot rules the fundamental theorem of LP 1 / 23 Repetition the simplex algorithm: sequence of pivots starting

More information

Week_4: simplex method II

Week_4: simplex method II Week_4: simplex method II 1 1.introduction LPs in which all the constraints are ( ) with nonnegative right-hand sides offer a convenient all-slack starting basic feasible solution. Models involving (=)

More information

Distributed Real-Time Control Systems. Lecture Distributed Control Linear Programming

Distributed Real-Time Control Systems. Lecture Distributed Control Linear Programming Distributed Real-Time Control Systems Lecture 13-14 Distributed Control Linear Programming 1 Linear Programs Optimize a linear function subject to a set of linear (affine) constraints. Many problems can

More information

Developing an Algorithm for LP Preamble to Section 3 (Simplex Method)

Developing an Algorithm for LP Preamble to Section 3 (Simplex Method) Moving from BFS to BFS Developing an Algorithm for LP Preamble to Section (Simplex Method) We consider LP given in standard form and let x 0 be a BFS. Let B ; B ; :::; B m be the columns of A corresponding

More information

LINEAR PROGRAMMING I. a refreshing example standard form fundamental questions geometry linear algebra simplex algorithm

LINEAR PROGRAMMING I. a refreshing example standard form fundamental questions geometry linear algebra simplex algorithm Linear programming Linear programming. Optimize a linear function subject to linear inequalities. (P) max c j x j n j= n s. t. a ij x j = b i i m j= x j 0 j n (P) max c T x s. t. Ax = b Lecture slides

More information

ORF 307: Lecture 2. Linear Programming: Chapter 2 Simplex Methods

ORF 307: Lecture 2. Linear Programming: Chapter 2 Simplex Methods ORF 307: Lecture 2 Linear Programming: Chapter 2 Simplex Methods Robert Vanderbei February 8, 2018 Slides last edited on February 8, 2018 http://www.princeton.edu/ rvdb Simplex Method for LP An Example.

More information

THE STEPS OF THE SIMPLEX ALGORITHM

THE STEPS OF THE SIMPLEX ALGORITHM THE STEPS OF THE SIMPLEX ALGORITHM Contents 1. Introduction... 2 2. Slack and surplus variables... 2 3. Basic and nonbasic variables... 2 4. Admissible solutions... 3 5. Solution of a linear program (LP)...

More information

Lecture 2: The Simplex method

Lecture 2: The Simplex method Lecture 2 1 Linear and Combinatorial Optimization Lecture 2: The Simplex method Basic solution. The Simplex method (standardform, b>0). 1. Repetition of basic solution. 2. One step in the Simplex algorithm.

More information

ORF 522. Linear Programming and Convex Analysis

ORF 522. Linear Programming and Convex Analysis ORF 5 Linear Programming and Convex Analysis Initial solution and particular cases Marco Cuturi Princeton ORF-5 Reminder: Tableaux At each iteration, a tableau for an LP in standard form keeps track of....................

More information

Farkas Lemma, Dual Simplex and Sensitivity Analysis

Farkas Lemma, Dual Simplex and Sensitivity Analysis Summer 2011 Optimization I Lecture 10 Farkas Lemma, Dual Simplex and Sensitivity Analysis 1 Farkas Lemma Theorem 1. Let A R m n, b R m. Then exactly one of the following two alternatives is true: (i) x

More information

Lecture slides by Kevin Wayne

Lecture slides by Kevin Wayne LINEAR PROGRAMMING I a refreshing example standard form fundamental questions geometry linear algebra simplex algorithm Lecture slides by Kevin Wayne Last updated on 7/25/17 11:09 AM Linear programming

More information

AM 121: Intro to Optimization Models and Methods

AM 121: Intro to Optimization Models and Methods AM 121: Intro to Optimization Models and Methods Fall 2017 Lecture 2: Intro to LP, Linear algebra review. Yiling Chen SEAS Lecture 2: Lesson Plan What is an LP? Graphical and algebraic correspondence Problems

More information

21. Solve the LP given in Exercise 19 using the big-m method discussed in Exercise 20.

21. Solve the LP given in Exercise 19 using the big-m method discussed in Exercise 20. Extra Problems for Chapter 3. Linear Programming Methods 20. (Big-M Method) An alternative to the two-phase method of finding an initial basic feasible solution by minimizing the sum of the artificial

More information

3 The Simplex Method. 3.1 Basic Solutions

3 The Simplex Method. 3.1 Basic Solutions 3 The Simplex Method 3.1 Basic Solutions In the LP of Example 2.3, the optimal solution happened to lie at an extreme point of the feasible set. This was not a coincidence. Consider an LP in general form,

More information

February 17, Simplex Method Continued

February 17, Simplex Method Continued 15.053 February 17, 2005 Simplex Method Continued 1 Today s Lecture Review of the simplex algorithm. Formalizing the approach Alternative Optimal Solutions Obtaining an initial bfs Is the simplex algorithm

More information

Summary of the simplex method

Summary of the simplex method MVE165/MMG630, The simplex method; degeneracy; unbounded solutions; infeasibility; starting solutions; duality; interpretation Ann-Brith Strömberg 2012 03 16 Summary of the simplex method Optimality condition:

More information

c) Place the Coefficients from all Equations into a Simplex Tableau, labeled above with variables indicating their respective columns

c) Place the Coefficients from all Equations into a Simplex Tableau, labeled above with variables indicating their respective columns BUILDING A SIMPLEX TABLEAU AND PROPER PIVOT SELECTION Maximize : 15x + 25y + 18 z s. t. 2x+ 3y+ 4z 60 4x+ 4y+ 2z 100 8x+ 5y 80 x 0, y 0, z 0 a) Build Equations out of each of the constraints above by introducing

More information

IE 5531: Engineering Optimization I

IE 5531: Engineering Optimization I IE 5531: Engineering Optimization I Lecture 3: Linear Programming, Continued Prof. John Gunnar Carlsson September 15, 2010 Prof. John Gunnar Carlsson IE 5531: Engineering Optimization I September 15, 2010

More information

Section Notes 9. IP: Cutting Planes. Applied Math 121. Week of April 12, 2010

Section Notes 9. IP: Cutting Planes. Applied Math 121. Week of April 12, 2010 Section Notes 9 IP: Cutting Planes Applied Math 121 Week of April 12, 2010 Goals for the week understand what a strong formulations is. be familiar with the cutting planes algorithm and the types of cuts

More information

Linear Programming: Simplex Algorithm. A function of several variables, f(x) issaidtobelinear if it satisþes the two

Linear Programming: Simplex Algorithm. A function of several variables, f(x) issaidtobelinear if it satisþes the two Linear Programming: Simplex Algorithm A function of several variables, f(x) issaidtobelinear if it satisþes the two conditions: (i) f(x + Y )f(x) +f(y )and(ii)f(αx) αf(x), where X and Y are vectors of

More information

The Simplex Method for Solving a Linear Program Prof. Stephen Graves

The Simplex Method for Solving a Linear Program Prof. Stephen Graves The Simplex Method for Solving a Linear Program Prof. Stephen Graves Observations from Geometry feasible region is a convex polyhedron an optimum occurs at a corner point possible algorithm - search over

More information

Math Models of OR: Extreme Points and Basic Feasible Solutions

Math Models of OR: Extreme Points and Basic Feasible Solutions Math Models of OR: Extreme Points and Basic Feasible Solutions John E. Mitchell Department of Mathematical Sciences RPI, Troy, NY 1180 USA September 018 Mitchell Extreme Points and Basic Feasible Solutions

More information

Linear programs Optimization Geoff Gordon Ryan Tibshirani

Linear programs Optimization Geoff Gordon Ryan Tibshirani Linear programs 10-725 Optimization Geoff Gordon Ryan Tibshirani Review: LPs LPs: m constraints, n vars A: R m n b: R m c: R n x: R n ineq form [min or max] c T x s.t. Ax b m n std form [min or max] c

More information

Algebraic Simplex Active Learning Module 4

Algebraic Simplex Active Learning Module 4 Algebraic Simplex Active Learning Module 4 J. René Villalobos and Gary L. Hogg Arizona State University Paul M. Griffin Georgia Institute of Technology Time required for the module: 50 Min. Reading Most

More information

56:270 Final Exam - May

56:270  Final Exam - May @ @ 56:270 Linear Programming @ @ Final Exam - May 4, 1989 @ @ @ @ @ @ @ @ @ @ @ @ @ @ Select any 7 of the 9 problems below: (1.) ANALYSIS OF MPSX OUTPUT: Please refer to the attached materials on the

More information

+ 5x 2. = x x. + x 2. Transform the original system into a system x 2 = x x 1. = x 1

+ 5x 2. = x x. + x 2. Transform the original system into a system x 2 = x x 1. = x 1 University of California, Davis Department of Agricultural and Resource Economics ARE 5 Optimization with Economic Applications Lecture Notes Quirino Paris The Pivot Method for Solving Systems of Equations...................................

More information

Linear Programming for Planning Applications

Linear Programming for Planning Applications Communication Network Planning and Performance Learning Resource Linear Programming for Planning Applications Professor Richard Harris School of Electrical and Computer Systems Engineering, RMIT Linear

More information

CHAPTER 2. The Simplex Method

CHAPTER 2. The Simplex Method CHAPTER 2 The Simplex Method In this chapter we present the simplex method as it applies to linear programming problems in standard form. 1. An Example We first illustrate how the simplex method works

More information