System Planning Lecture 7, F7: Optimization

Similar documents
Sensitivity Analysis and Duality in LP

Example Problem. Linear Program (standard form) CSCI5654 (Linear Programming, Fall 2013) Lecture-7. Duality

Introduction to Mathematical Programming IE406. Lecture 10. Dr. Ted Ralphs

IE 5531: Engineering Optimization I

Linear Programming Duality

Lecture 5. x 1,x 2,x 3 0 (1)

Fundamentals of Operations Research. Prof. G. Srinivasan. Indian Institute of Technology Madras. Lecture No. # 15

4.6 Linear Programming duality

CSCI5654 (Linear Programming, Fall 2013) Lecture-8. Lecture 8 Slide# 1

Linear and Combinatorial Optimization


CPS 616 ITERATIVE IMPROVEMENTS 10-1

Summary of the simplex method

Lecture 11: Post-Optimal Analysis. September 23, 2009

Note 3: LP Duality. If the primal problem (P) in the canonical form is min Z = n (1) then the dual problem (D) in the canonical form is max W = m (2)

4. Duality Duality 4.1 Duality of LPs and the duality theorem. min c T x x R n, c R n. s.t. ai Tx = b i i M a i R n

Lectures 6, 7 and part of 8

56:270 Final Exam - May

Special cases of linear programming

(P ) Minimize 4x 1 + 6x 2 + 5x 3 s.t. 2x 1 3x 3 3 3x 2 2x 3 6

Optimeringslära för F (SF1811) / Optimization (SF1841)

UNIT-4 Chapter6 Linear Programming

Introduction to linear programming using LEGO.

6.854J / J Advanced Algorithms Fall 2008

Linear & Integer programming

Linear Programming Duality P&S Chapter 3 Last Revised Nov 1, 2004

Integer Programming and Branch and Bound

Linear Programming Inverse Projection Theory Chapter 3

Duality Theory, Optimality Conditions

EXERCISES SHORTEST PATHS: APPLICATIONS, OPTIMIZATION, VARIATIONS, AND SOLVING THE CONSTRAINED SHORTEST PATH PROBLEM. 1 Applications and Modelling

Midterm Review. Yinyu Ye Department of Management Science and Engineering Stanford University Stanford, CA 94305, U.S.A.

Review Solutions, Exam 2, Operations Research

Answer the following questions: Q1: Choose the correct answer ( 20 Points ):

Chapter 2: Linear Programming Basics. (Bertsimas & Tsitsiklis, Chapter 1)

min 4x 1 5x 2 + 3x 3 s.t. x 1 + 2x 2 + x 3 = 10 x 1 x 2 6 x 1 + 3x 2 + x 3 14

March 13, Duality 3

COT 6936: Topics in Algorithms! Giri Narasimhan. ECS 254A / EC 2443; Phone: x3748

Lecture Notes 3: Duality

Dr. S. Bourazza Math-473 Jazan University Department of Mathematics

Farkas Lemma, Dual Simplex and Sensitivity Analysis

21. Solve the LP given in Exercise 19 using the big-m method discussed in Exercise 20.

MVE165/MMG631 Linear and integer optimization with applications Lecture 5 Linear programming duality and sensitivity analysis

3. Duality: What is duality? Why does it matter? Sensitivity through duality.

Network Flow Problems Luis Goddyn, Math 408

In the original knapsack problem, the value of the contents of the knapsack is maximized subject to a single capacity constraint, for example weight.

Nonlinear Programming (Hillier, Lieberman Chapter 13) CHEM-E7155 Production Planning and Control

BBM402-Lecture 20: LP Duality

Discrete Optimization

Thursday, May 24, Linear Programming

Chap6 Duality Theory and Sensitivity Analysis

MS-E2140. Lecture 1. (course book chapters )

Gauss-Jordan Elimination for Solving Linear Equations Example: 1. Solve the following equations: (3)

4. Duality and Sensitivity

Optimisation. 3/10/2010 Tibor Illés Optimisation

56:171 Operations Research Midterm Exam - October 26, 1989 Instructor: D.L. Bricker

How to Take the Dual of a Linear Program

MULTIPLE CHOICE QUESTIONS DECISION SCIENCE

2. Linear Programming Problem

Solution Cases: 1. Unique Optimal Solution Reddy Mikks Example Diet Problem

Understanding the Simplex algorithm. Standard Optimization Problems.

Part 1. The Review of Linear Programming

Integer Linear Programming Modeling

Sensitivity Analysis

ECE 307- Techniques for Engineering Decisions

Algorithmic Game Theory and Applications. Lecture 7: The LP Duality Theorem

- Well-characterized problems, min-max relations, approximate certificates. - LP problems in the standard form, primal and dual linear programs

Introduction to Operations Research Prof. G. Srinivasan Department of Management Studies Indian Institute of Technology, Madras

F 1 F 2 Daily Requirement Cost N N N

Operations Research: Introduction. Concept of a Model

Introduction. Very efficient solution procedure: simplex method.

Lecture 10: Linear programming duality and sensitivity 0-0

Standard Form An LP is in standard form when: All variables are non-negativenegative All constraints are equalities Putting an LP formulation into sta

CSC373: Algorithm Design, Analysis and Complexity Fall 2017 DENIS PANKRATOV NOVEMBER 1, 2017

Linear Programming. H. R. Alvarez A., Ph. D. 1

Algorithms and Theory of Computation. Lecture 13: Linear Programming (2)

Summary of the simplex method

Review Questions, Final Exam

Welcome to CPSC 4850/ OR Algorithms

The Simplex Algorithm

Integer Programming (IP)

Linear Programming: Chapter 5 Duality

MS-E2140. Lecture 1. (course book chapters )

Topic: Primal-Dual Algorithms Date: We finished our discussion of randomized rounding and began talking about LP Duality.

Computational Integer Programming. Lecture 2: Modeling and Formulation. Dr. Ted Ralphs

UNIVERSITY OF CALICUT SCHOOL OF DISTANCE EDUCATION B Sc. Mathematics (2011 Admission Onwards) II SEMESTER Complementary Course

Optimisation and Operations Research

Introduction to Mathematical Programming

The Dual Simplex Algorithm

CHAPTER 1-2: SHADOW PRICES

Prelude to the Simplex Algorithm. The Algebraic Approach The search for extreme point solutions.

Lessons from MIP Search. John Hooker Carnegie Mellon University November 2009

Decomposition Techniques in Mathematical Programming

Lecture #21. c T x Ax b. maximize subject to

Lecture Note 18: Duality

MATH2070 Optimisation

The Primal-Dual Algorithm P&S Chapter 5 Last Revised October 30, 2006

UNIVERSITY of LIMERICK

LINEAR PROGRAMMING II

ENM 202 OPERATIONS RESEARCH (I) OR (I) 2 LECTURE NOTES. Solution Cases:

Distributed Real-Time Control Systems. Lecture Distributed Control Linear Programming

Transcription:

System Planning 04 Lecture 7, F7: Optimization

System Planning 04 Lecture 7, F7: Optimization Course goals Appendi A Content: Generally about optimization Formulate optimization problems Linear Programming (LP) Mied Integer Linear Programming (MILP)

Course Goals Short term planning To pass the course, the students should show that they are able to formulate short-term planning problems of hydro-thermal power systems, To receive a higher grade the students should also show that they are able to create specialised models for short-term planning problems, Computation Ability solving short-term planning problems essential Computation, not a goal, not eamined Home assignments give bonus points some are mandatory

Optimization Generally (/) Applied mathematics Application: technology, science, economics, etc. Something to be maimized or minimized Profit, cost, energy, speed, losses Given some constraints Physical, technical, economical, legal, etc.

Optimization Generally (/) In general form min f( ), subject to g ( ) b h ( ) = c Constraints f objective function optimization variable (multidimensional, e.g. vector) g, h constraints (multidimensional, e.g. vector), variable bounds (like the variable)

Optimization Formulating problems (/6). Formulate it verbally:. Think the problem through. Define denotations. Which parameters and variables are needed? 3. Formulate the problem in equation form. That is; define the objective and constraints ( and 3 are interrelated)

Optimization Formulating problems (/6) Eample: A corporation owns a number of factories How to deliver items to consumers??

Optimization Formulating problems (3/6). Formulate verbally:. How to deliver the goods, while. Minimizing the transport costs? 3. Subject to:.each factory's production capacity limit.fulfil the consumer demand

Optimization Formulating problems (4/6). Define denotations:. Indices and parameters:. m factories, factory i has the capacity a i. n customers, customer j demands b j units 3. Transportation costs from factory i to customer j is c ij per unit. Variables. Let ij, i =,..., m, j =,..., n denote the number of units transported from factory i to customer j

Optimization Formulating problems (5/6) 3. Formulate the problem mathematically: Objective function Transportation cost: m n i= j= c ij ij Constraints Production capacity: Demand: Variable bounds: n j= m i= ij ai i =... m ij b j j =... n ij 0 i =... m, j =... n

Optimization Formulating problems (6/6) The optimization problem: min m i= j= n s.t. a, i =... m j= n m b, j =... n i= ij ij ij ij i j 0, i =... m, j =... n ij c

LP Generally (/) Linear problems (LP-problems) A class of optimization problems Linear objective, linear constraints All LPs may be formulated (standard form): T min c subject to A = b 0

LP Generally (/) Various types of LP-problems eplained Eamples similar to those in Appendi A We will study: Etreme points Slack variables No feasible solution Inactive constraints Unbounded problem Degenerate problem Flat optimum Dual formulation Solution methods

LP Basic Eample (/) The problem: min z = 5 + 0 subject to + 4 + 0, 0

LP Basic Eample (/) Optimum at: =.5 = 0.5 Objective value: z =.5

LP Etreme points Corners in feasible space Denoted etreme points Optimum always in etreme point(s) 4 3 0 0 z = 0 z = 30 z = 40 3 4 + 4 +

LP Slack variables (/) LP-problem in standard form: min s.t. T c A = b 0 Introduce slack variables All constraints can be equalities

LP Slack variables (/) Without slack variables (A b) : 0 0, 4 + + 0 0, 0, 0, 4 4 3 4 3 = + = + With slack variables (A = b):

LP Infeasible problem (/) Feasible space empty Bad formulation min z = 5 + 0 s.t. + 4 + + 0, 0 Added constraint

LP Infeasible problem (/) 4 (a) + + (c) Feasible space following (c) 3 0 0 Feasible following (a) & (b) 4 + 3 4 (b)

LP Inactive Constraints (/) Some constraints does not constrain Given the objective min z = 5 + 0 subject to + 4 + + 7 0, 0 Added constraint

LP Inactive Constraints (/) Active constraints + 4 + 4 z = 40 3 z = 30 z = 0 0 0 3 4 + 7 Inactive constraints (Some algorithms like it!)

LP Unbounded Problem (/) If no constraint is active The objective is unbounded z min z = Objective function modified subject to + 4+ 0, 0

LP Unbounded Problem (/) + 4 3 z = -3 z = -4 z = -5 min z 4 + 0 0 3 4

LP Degenerate solution (/) More than one etreme point optimal All linear combination of these optimal min z = 0 + 0 subject to + 4 + 0, 0 New objective function

LP Degenerate solution (/) Line between etreme points optimal

LP Flat optimum (/) Etreme points with similar objective values min z = 0 + 9.99 subject to + 4 + 0, 0 New objective function

LP Flat optimum (/)

LP Duality (/5) Any LP problem (primal problem) has a corresponding dual problem Primal problem: T min c subject to A = b 0 Dual problem: T ma b λ λ subject to A T λ c λ 0 λ is said to be a dual variable

LP Duality (/5) Theorem (strong duality): If the primal problem has an optimal solution, then also the dual problem has an optimal solution. The objective values of these two problems equals.

LP Duality (3/5) min subject to T c A = b 0 One dual variable for each constraint! Question: What dual variables technically describe? Answer: Marginal value of the corresponding constraint i.e. objective value s dependence on RHS

LP Duality (4/5) In optimum: λ > 0 (active) λ > 0 (active) λ 3 = 0 (inactive)

LP Duality (5/5) Dual variables: λ Small perturbations in the right-hand-side, b Changes in the objective value, z: z = λ T b

MILP Generally Mied Integer Linear Programming problems Class of optimization problems Linear objective functions and linear constraints Some variables may be integers min z = such that A = b 0 T c { } { }, i,,..., m i, i m+, m+,..., n i i = n

MILP Eample + 4 3 Optimum at: = (.5) = (0.5) 4 + 0 0 3 4 z = 40 z = 30 z = 0 Optimal objective: z = 5 (.5)

MILP Solution Integer variables are easily implemented Integer problems generally hard to solve Computation time may increase eponentially If possible, avoid integer variables! Special case integer variable: binary variable {0,}

MILP Applying Binary Variable (/6) Minimize cost buying certain product Variable, 0: amount of the product, Decreasing marginal cost, e.g.: Economies of scale (outside this course, square root) Volume discount Cost [SEK] b Amount consumed

MILP Applying Binary Variable (/6) Split up in two variables = + b Cost [SEK] z = c + c c > c b Amount consumed

MILP Applying Binary Variable (3/6) Segment cheaper Prevent being positive as long < b Typically done by using binary variable Cost [SEK] b Amount consumed

MILP Applying Binary Variable (4/6) Introduce the binary variable s And the constraints s 0 + Ms 0 b Note: In real-life, M not arbitrary Cost [SEK] b Amount consumed s=0 s=

MILP Applying Binary Variable (5/6) Sizing of parameter M Not a part of the course subject to: ( m) Or, simpler M = min m, ( ) min z = + m + 0 m> 0 m ( ) M = min Cost [SEK] b s=0 s= Amount consumed

If s=0: 0 0 0, 0 = If s=: M M b b b + = 0 0, Cost [SEK] Amount consumed b s=0 s= 0 0 + Ms s b MILP Applying Binary Variable (6/6)

End of lecture 7 Net time short-term planning