t dt t SCLP Bellman (1953) CLP (Dantzig, Tyndall, Grinold, Perold, Anstreicher 60's-80's) Anderson (1978) SCLP

Similar documents
Control of computer chip semi-conductor wafer fabs

An introduction to the theory of SDDP algorithm

Solutions to Assignment 1

Lecture 20: Riccati Equations and Least Squares Feedback Control

Class Meeting # 10: Introduction to the Wave Equation

Differential Equations

EXERCISES FOR SECTION 1.5

Hybrid Control and Switched Systems. Lecture #3 What can go wrong? Trajectories of hybrid systems

F This leads to an unstable mode which is not observable at the output thus cannot be controlled by feeding back.

3.1.3 INTRODUCTION TO DYNAMIC OPTIMIZATION: DISCRETE TIME PROBLEMS. A. The Hamiltonian and First-Order Conditions in a Finite Time Horizon

ME 391 Mechanical Engineering Analysis

ENGI 9420 Engineering Analysis Assignment 2 Solutions

1 Subdivide the optimization horizon [t 0,t f ] into n s 1 control stages,

Section 3.5 Nonhomogeneous Equations; Method of Undetermined Coefficients

Backward stochastic dynamics on a filtered probability space

2. Nonlinear Conservation Law Equations

dt = C exp (3 ln t 4 ). t 4 W = C exp ( ln(4 t) 3) = C(4 t) 3.

An Introduction to Backward Stochastic Differential Equations (BSDEs) PIMS Summer School 2016 in Mathematical Finance.

Chapter 2. First Order Scalar Equations

t 2 B F x,t n dsdt t u x,t dxdt

u(x) = e x 2 y + 2 ) Integrate and solve for x (1 + x)y + y = cos x Answer: Divide both sides by 1 + x and solve for y. y = x y + cos x

Predator - Prey Model Trajectories and the nonlinear conservation law

Two Coupled Oscillators / Normal Modes

Algorithmic Trading: Optimal Control PIMS Summer School

Optima and Equilibria for Traffic Flow on a Network

4 Sequences of measurable functions

Structural Dynamics and Earthquake Engineering

Math 334 Fall 2011 Homework 11 Solutions

TEACHER NOTES MATH NSPIRED

8. Basic RL and RC Circuits

Utility maximization in incomplete markets

Optimality Conditions for Unconstrained Problems

SZG Macro 2011 Lecture 3: Dynamic Programming. SZG macro 2011 lecture 3 1

Chapter 2. Models, Censoring, and Likelihood for Failure-Time Data

An Introduction to Malliavin calculus and its applications

Simulation-Solving Dynamic Models ABE 5646 Week 2, Spring 2010

Echocardiography Project and Finite Fourier Series

Inventory Analysis and Management. Multi-Period Stochastic Models: Optimality of (s, S) Policy for K-Convex Objective Functions

MA 214 Calculus IV (Spring 2016) Section 2. Homework Assignment 1 Solutions

Ann. Funct. Anal. 2 (2011), no. 2, A nnals of F unctional A nalysis ISSN: (electronic) URL:

SUFFICIENT CONDITIONS FOR EXISTENCE SOLUTION OF LINEAR TWO-POINT BOUNDARY PROBLEM IN MINIMIZATION OF QUADRATIC FUNCTIONAL

BU Macro BU Macro Fall 2008, Lecture 4

KINEMATICS IN ONE DIMENSION

An Introduction to Stochastic Programming: The Recourse Problem

EMS SCM joint meeting. On stochastic partial differential equations of parabolic type

KEY. Math 334 Midterm I Fall 2008 sections 001 and 003 Instructor: Scott Glasgow

WEEK-3 Recitation PHYS 131. of the projectile s velocity remains constant throughout the motion, since the acceleration a x

T L. t=1. Proof of Lemma 1. Using the marginal cost accounting in Equation(4) and standard arguments. t )+Π RB. t )+K 1(Q RB

Math Week 14 April 16-20: sections first order systems of linear differential equations; 7.4 mass-spring systems.

The motions of the celt on a horizontal plane with viscous friction

A New Perturbative Approach in Nonlinear Singularity Analysis

1 Solutions to selected problems

arxiv:math/ v1 [math.nt] 3 Nov 2005

The Asymptotic Behavior of Nonoscillatory Solutions of Some Nonlinear Dynamic Equations on Time Scales

Problem Set on Differential Equations

Sliding Mode Extremum Seeking Control for Linear Quadratic Dynamic Game

Correspondence should be addressed to Nguyen Buong,

Robotics I. April 11, The kinematics of a 3R spatial robot is specified by the Denavit-Hartenberg parameters in Tab. 1.

Physics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle

Effects of Coordinate Curvature on Integration

The fundamental mass balance equation is ( 1 ) where: I = inputs P = production O = outputs L = losses A = accumulation

t is a basis for the solution space to this system, then the matrix having these solutions as columns, t x 1 t, x 2 t,... x n t x 2 t...

Chapter 6. Systems of First Order Linear Differential Equations

6.2 Transforms of Derivatives and Integrals.

Hamilton- J acobi Equation: Weak S olution We continue the study of the Hamilton-Jacobi equation:

Hamilton Jacobi equations

Matrix Versions of Some Refinements of the Arithmetic-Geometric Mean Inequality

SPLICING OF TIME OPTIMAL CONTROLS

Basilio Bona ROBOTICA 03CFIOR 1

Example on p. 157

Instructor: Barry McQuarrie Page 1 of 5

arxiv: v1 [math.fa] 9 Dec 2018

Comments on Window-Constrained Scheduling

Expert Advice for Amateurs

Representation of Stochastic Process by Means of Stochastic Integrals

Finish reading Chapter 2 of Spivak, rereading earlier sections as necessary. handout and fill in some missing details!

ln 2 1 ln y x c y C x

POSITIVE SOLUTIONS OF NEUTRAL DELAY DIFFERENTIAL EQUATION

Comparison between the Discrete and Continuous Time Models

Ordinary Differential Equations

Macroeconomic Theory Ph.D. Qualifying Examination Fall 2005 ANSWER EACH PART IN A SEPARATE BLUE BOOK. PART ONE: ANSWER IN BOOK 1 WEIGHT 1/3

Lecture 4 Notes (Little s Theorem)

SPECTRAL EVOLUTION OF A ONE PARAMETER EXTENSION OF A REAL SYMMETRIC TOEPLITZ MATRIX* William F. Trench. SIAM J. Matrix Anal. Appl. 11 (1990),

On Boundedness of Q-Learning Iterates for Stochastic Shortest Path Problems

5. Stochastic processes (1)

Supplement for Stochastic Convex Optimization: Faster Local Growth Implies Faster Global Convergence

The expectation value of the field operator.

) were both constant and we brought them from under the integral.

CHE302 LECTURE IV MATHEMATICAL MODELING OF CHEMICAL PROCESS. Professor Dae Ryook Yang

Essential Microeconomics : OPTIMAL CONTROL 1. Consider the following class of optimization problems

O Q L N. Discrete-Time Stochastic Dynamic Programming. I. Notation and basic assumptions. ε t : a px1 random vector of disturbances at time t.

A Primal-Dual Type Algorithm with the O(1/t) Convergence Rate for Large Scale Constrained Convex Programs

Math 2214 Solution Test 1B Fall 2017

CHAPTER 2 Signals And Spectra

Exam 1 Solutions. 1 Question 1. February 10, Part (A) 1.2 Part (B) To find equilibrium solutions, set P (t) = C = dp

Theory of! Partial Differential Equations!

Math 4600: Homework 11 Solutions

Math Final Exam Solutions

Oscillation of an Euler Cauchy Dynamic Equation S. Huff, G. Olumolode, N. Pennington, and A. Peterson

DISCRETE GRONWALL LEMMA AND APPLICATIONS

Transcription:

Coninuous Linear Programming. Separaed Coninuous Linear Programming Bellman (1953) max c () u() d H () u () + Gsusds (,) () a () u (), < < CLP (Danzig, yndall, Grinold, Perold, Ansreicher 6's-8's) Anderson (1978) max c () u() d Gu() s ds + x() = a() Hu () + z () = b () xuz,,, < < (Anderson, Nash, Philpo, Pullan 8's-9's). SCLP Dualiy, Srucure, Soluion by Discreizaion. In 2, W. proposed a simplex algorihm o solve: max ( ) c u( ) d Gu() s ds + x() = a+ α Hu () + z () = b xuz,,, < < SCLP wih linear daa MS&E324, Sanford Universiy, Spring 22 6B-1 Gideon Weiss manufacuring & conrol

Pullan s Dual Formulaion: Primal Problem: max c ( ) u ( ) d Gu() s ds+ x() = a() Hu () + z () = b () uxz,,, < < Pullan s SCLP Dual Problem min a ( ) dπ( ) + b ( ) rd ( ) G π() + H r() q() = c π( ) =, π, rq,, < < * Pullan s SCLP heorem (Pullan) Assume Hu () b (), u () has bounded feasible region. For abc,, piecewise analyic, here is a soluion which is piecewise analyic, For ac, piecewise polynomial of degree n +1, b piecewise polynomial of degree n here is a soluion wih u () piecewise polynomial of degree n. For ac, piecewise linear, b piecewise consan, here is a soluion wih u () piecewise consan. Number of breakpoins finie bounded (no polynomial) Srong dualiy holds Pullan s Algorihm: Sequence of discreizaions, converging (in infinie number of seps) o he opimal soluion. Noe: Separaed is very differen from General: in he one x () = usds (), direc inegraion in he oher u () = usds () + K differenial equaions MS&E324, Sanford Universiy, Spring 22 6B-2 Gideon Weiss manufacuring & conrol

SCLP wih Symmeric Primal / Dual max c ( ) u ( ) d+ d ( ) y ( ) d Gu() s ds + Fy() + x() = a() Hu () = b () xu,, < < SCLP min a ( ) p ( ) d+ b ( ) r ( ) d Gpsds () + Hr () q () = c () F p() = d() pq,, < < SCLP * Here: up, are primal and dual conrols ( ), xq, are primal and dual saes ( ), yr, are primal and dual supplemenary (unresriced) Dimensions: G K J, H I J, F K L MS&E324, Sanford Universiy, Spring 22 6B-3 Gideon Weiss manufacuring & conrol

Weak Dualiy and Complemenary Slackness Dual Objecive = a ( ) p ( ) d+ b ( ) r ( ) d { u () s G ds+ y( ) F } p() + u( ) H r() d = u( ) { G p( s) ds + H r( )} d + y( ) F p( ) d u ( ) c ( ) d+ y ( ) d ( ) d= Primal Objecive Equaliy will hold if and only if x ( ) pd ( ) =, u ( ) qd ( ) =. Complemenary Slackness: almos everywhere x () > p ( ) = u () > q ( ) = Corollary: he following are equivalen (a) uxy,, pqr,, are complemenary slack feasible primal and dual soluions (b) hey are opimal and have he same objecive value (no dualiy gap) (Srong dualiy no dualiy gap - exiss in LP bu no in oher problems, unless addiional condiions are imposed). MS&E324, Sanford Universiy, Spring 22 6B-4 Gideon Weiss manufacuring & conrol

Boundary Values For infiniesimal values of we solve: max c ( ) u ( ) + d ( ) y ( ) Fy() + x() = a() Hu () = b () xu,, < < min a ( ) p ( ) + b ( ) r ( ) Hr () q () = c () F p() = d() pq,, < < hese separae ino 2 ses of primal and dual problems: max d ( ) y( ) Fy( ) + x( ) = a( ) boundary LP x( ), min b ( ) r( ) Hr ( ) q( ) = c( ) q( ), boundary LP * Assumpion (Feasibiliy and Boundedness): he boundary problems are feasible and bounded. SCLP is feasible and bounded for some range of MS&E324, Sanford Universiy, Spring 22 6B-5 Gideon Weiss manufacuring & conrol

he Associaed LP Our soluion of SCLP will evolve hrough soluion of he following LP / LP*, under varying sign resricions. max c «( ) u ( ) + d ( ) y «( ) Gu() + Fy«( ) + ξ() = a«( ) Hu () = b () u (), y «( )" U", < < LP min a «( ) p ( ) + b ()«( r ) G p( ) + H r«( ) + θ( ) = c«( ) F p( ) = d( ) p, r«" U", < < LP * Noe: he ime indices on he variables are only labels, we label he variables o indicae heir role: ξ = x«, y«, θ = q«, r«assumpion (Non-Degeneracy): he r.h.s. of LP / LP* is (a.e. ) in general posiion o G F I column spaces of H, G H I F SCLP is non-degenerae: Soluion is unique and a an exreme poin in he funcion space of he soluions. MS&E324, Sanford Universiy, Spring 22 6B-6 Gideon Weiss manufacuring & conrol

he Srucure heorem Consider any funcions u ( ), x ( ), y ( ), p ( ), q ( ), r ( ), < < which saisfy up,, xyqr,,, are absoluely coninuous. Hence xyqr,,, have derivaives a.e. x( ), y( ) solve he boundary-lp, q( ), r( ) solve he boundary-lp*. For xy, hese are values a he lef boundary, qr, run in reversed ime so his is a he righ boundary. A all imes, he rae funcions (derivaives) u(), ξ(),«( y ), p( ), θ( ), r«( ), < < are complemenary slack feasible soluions for LP / LP*. hus hey are opimal soluions for LP / LP* under some sign configuraion of ξ, θ. By non-degeneracy hey are basic and unique soluions. A all imes, if xk() >, ξ k() is basic, if q ( ) >, θ ( ) is basic. j x () q (), < <. j heorem: A soluion o SCLP / SCLP* is opimal if (and only if for linear daa) i has hese properies. MS&E324, Sanford Universiy, Spring 22 6B-7 Gideon Weiss manufacuring & conrol

Resricion o he Linear Daa Case Problem: max ( γ + ( ) c ) u() d+ d y() d Gu() s ds + Fy() + x() = α + a Hu () xu,, < < min ( α + ( ) a ) p() d+ b r() d Gpsds () + Hr () q () = γ + c F p() = d pq,, < < Boundary: max dy min N br Fy + x = α = b SCLP ( linear daa) SCLP Hr q = γ * ( linear daa) x, q, Associaed LP max cu + d y«min ap + br «Gu+ Fy«+ ξ = a Gp + Hr «θ = c Hu = b Fp = d u, y«" U", p, r«" U" N N N MS&E324, Sanford Universiy, Spring 22 6B-8 Gideon Weiss manufacuring & conrol

he Algorihm he algorihm consrucs a soluion for SCLP / SCLP* for he whole range of ime horizons, < <. Corollary 1: he soluion for any ime horizon wih he 1 excepion of a finie lis: = ( ) < ( ) L < ( R) <, is characerized by a sequence of adjacen bases of LP, B 1, K, B N. For a paricular here are ime breakpoins = < 1L < N = such ha for n < < n n n n n n u, ξ,«y, p, θ,«r are basic B n. 1 n, In he single pivo Bn Bn +1 le v leave he basis if v = ξ k hen we have equaion xk( n)=. if v= hen we have equaion q ( ) =. u j Corollary 2: he soluion of he equaions xk( n)=, qj( n) =, ogeher wih: τ1+ L+ τ N = ( τ n = n n 1) deermines he soluion for a whole range of ime horizons, ( r 1) ( r) < < <. j n MS&E324, Sanford Universiy, Spring 22 6B-9 Gideon Weiss manufacuring & conrol

Algorihmic Srucure of Soluion: For ime horizon, Break poins: = < 1 < L < N = τ n = n n 1 N 1 Equaions: Adjacen Bn Bn+1 : = vn leaves: n n k k n k k m v = ξ x ( ) = x + ξ τ =, m= 1 n j j n j N N m j v = u q ( ) = q + θ τ =. and equaion N: τ1 + L+ τ N = m m= n+ 1 Slack Inequaliies, a local minima of x m k, q : k n k n n + 1 k n k k m ξ <, ξ > or n= N x ( ) = x + ξ τ, n j n+ 1 j n= or θ >, θ < q ( ) = q + θ τ. j m= 1 m j n j N N m j m= n+ 1 m MS&E324, Sanford Universiy, Spring 22 6B-1 Gideon Weiss manufacuring & conrol

Algorihm: ( ) ( 1) Sep 1: Soluion for < < is given by he soluion of boundary-lp / boundary-lp*. Sep r: Exend he soluion o nex ime horizon range. ( r) 1L 1 A d + τ = σ B I g Sep R+1 Sop when nex can be, or when soluion infeasible. MS&E324, Sanford Universiy, Spring 22 6B-11 Gideon Weiss manufacuring & conrol

Algorihm Case iii Buffer empies a x 1 x 2 < (l) x 2 x 1 ξ 1 leaves = (l) x 1 x 2 u 2 eners > (l) MS&E324, Sanford Universiy, Spring 22 6B-12 Gideon Weiss manufacuring & conrol

Algorihm Case ii Inerval shrinks a n B' C ξ 1 leaves x 1 q C B'' u 3 leaves 3 B' C B'' < (l) B' B'' ξ 1 u 3 leave x 1 q 3 B' B'' = (l) x 1 q 3 D B'' ξ 1 leaves B' D u 3 leaves B' D B'' > (l) MS&E324, Sanford Universiy, Spring 22 6B-13 Gideon Weiss manufacuring & conrol

Algorihm Case ii, Subproblem Inerval shrinks a n : subproblem for addiional inervals B' C ξ 1 leaves x 1 q C B'' u 3 leaves 3 B' C B'' < (l) B' B'' ξ 1 u 3 leave x 1 q 3 B' B'' = (l) subproblem E 1 D E 2 B' B'' ξ 1 u 3 leave x 1 q 3 B' B'' = (l) E 1 D 3u leaves x 1 q E B'' 1ξ leaves 3 2 B' E 1 D E 2 B'' > (l) Subproblem solved by recursive call o he algorihm, wih smaller, modified problem. MS&E324, Sanford Universiy, Spring 22 6B-14 Gideon Weiss manufacuring & conrol

Example 1: Pullan solved he following ASSE DISPOSAL PROBLEM in his 1993 paper: G= 1 H, = [ 1 2], 1 a1() = 4+, a2() = 3+ 2, b1() = 1, c1() = c2() = 2, < < 2. 2 max ( 2 u ) ( ) + ( 2 u ) ( d ) 1 2 u () s ds + x () = 4 + 1 1 u2() s ds + x2() = 3+ 2 u1() + u2() + z1() = 1 uxz,,, < < Our formulaion, for arbirary ime horizon is: max ( ) u1( ) + ( ) u2( ) d u1() s ds + x1() = 4 + u2() s ds + x2() = 3+ 2 u1() + u2() + z1() = 1 uxz,,, < < MS&E324, Sanford Universiy, Spring 22 6B-15 Gideon Weiss manufacuring & conrol

Example 1: he opimal soluion is: 1 2 I is solved in 3 seps: For ime horizons < < 4 9 : Empy buffer 1 only, u () = 1, x () = 4 9, x () = 3 + 2. 1 1 2 For ime horizons 4 < <2 : keep buffer 1 empy, and empy buffer 2: 9 9 5 u1() = 1, x1() =, u2() =, x2() = 5 2 2 For ime horizons 2 < < : keep buffers 1 and 2 empy: u () = 1, x () =, u () = 2, x () = 1 1 2 2 NOW WACH PULLAN SOLVE I: MS&E324, Sanford Universiy, Spring 22 6B-16 Gideon Weiss manufacuring & conrol

MS&E324, Sanford Universiy, Spring 22 6B-17 Gideon Weiss manufacuring & conrol

Example 2: A 2 machine 3 buffer example, m2 > m1+ m3: m 3 3 1 m1 2 m 2 m > m + m 2 1 3 3 Variaion 2 1 (Soluion of his example is join wih Florin Foram, 1992) MS&E324, Sanford Universiy, Spring 22 6B-18 Gideon Weiss manufacuring & conrol

S o l u i o n () 1, Buffer 3 drains B = { ξ, ξ, ξ, u, z } 1 1 2 3 3 2 () 1 ( 2), Buffer 2 drains Opimal basis B = { ξ, ξ, u, u, z } 3 1 2 2 3 1 Subproblem B = { ξ, ξ, u, ξ, u } 2 1 2 2 3 3 ( 2) ( 3), Flow ou of buffer 1 unil inerval 3 shrinks B = { ξ, u, u, u, z } 4 1 1 2 3 1 ( 3) ( 4), Basis B 3 repalced by B = { ξ, u, u, ξ, u } 3 1 1 2 3 3 MS&E324, Sanford Universiy, Spring 22 6B-19 Gideon Weiss manufacuring & conrol ( 4), empy B = { u, u, u, z, z } 5 1 2 3 1 2

Example 3: 5 machine 2 buffer re-enran example I II III IV V 2 1 3 6 7 4 5 8 1 12 11 13 15 14 16 9 19 18 2 17 MS&E324, Sanford Universiy, Spring 22 6B-2 Gideon Weiss manufacuring & conrol

S o l u i o n : MS&E324, Sanford Universiy, Spring 22 6B-21 Gideon Weiss manufacuring & conrol

Example 4: A coninuous ime Leonief Sysem X 25 2 15 1 5 MS&E324, Sanford Universiy, Spring 22 1 2 6B-22 3 Gideon Weiss 4 manufacuring & conrol 5

Evoluion of he soluion: x 4 q 6 r2 q 6 x 3 x 4 x 3 r 2 r 2 x 3 x 4 q 12 x 2 MS&E324, Sanford Universiy, Spring 22 6B-23 Gideon Weiss manufacuring & conrol