Direct and indirect methods for optimal control problems and applications in engineering
|
|
- Lorena Sanders
- 5 years ago
- Views:
Transcription
1 Direct and indirect methods for optimal control problems and applications in engineering Matthias Gerdts Computational Optimisation Group School of Mathematics The University of Birmingham M. Gerdts K.U. Leuven, 29/04/ / 49
2 Optimal Control and Applications test-driving Optimal Control Theory & Algorithms aerospace engineering control x_ x_2 0.2 robot control x y nonlinear programming PDE control M. Gerdts K.U. Leuven, 29/04/ / 49
3 Contents 1 Optimal Control Problems 2 Nonsmooth Newton Method 3 Direct Discretization 4 Parametric Optimization and Real-time Optimization 5 Gear Shifts and Mixed-Integer Optimal Control 6 Numerical Results M. Gerdts K.U. Leuven, 29/04/ / 49
4 Motivation: Robot Control Task: Minimize t f subject to q (t) = v(t) M(q(t))v (t) = f (q(t), v(t), u(t)) for t [0, t f ] and u i (t) u max + additional constraints, e.g. q i (t) q max v i (t) v max M. Gerdts K.U. Leuven, 29/04/ / 49
5 Optimal Control Problem (without pure state constraints) OCP Minimize Z 1 0 f 0 (x(t), u(t), p)dt s.t. x (t) f (x(t), u(t), p) = 0 a.e. in [0, 1] c(x(t), u(t), p) 0 a.e. in [0, 1] ψ(x(0), x(1), p) = 0 Notation differential state: x W 1, ([0, 1], IR nx ) control: u L ([0, 1], IR nu ) parameter: p, no optimization variable! M. Gerdts K.U. Leuven, 29/04/ / 49
6 Solution Paradigms Indirect approach: OCP(p) minimum principle BVP(p) multiple shooting Direct approach: Version 1: discretization approach OCP(p) discretization NLP(p) SQP Version 2: function space approach OCP(p) SQP/Newton discretization LEQ Computation of sensitivities w.r.t. p: linearized KKT conditions existence: regularity assumptions, SSC, strict complementarity, controllability,... M. Gerdts K.U. Leuven, 29/04/ / 49
7 First-Order Necessary Conditions: Minimum Principle Hamiltonian: H(x, u, λ, η) := f 0 (x, u) + λ f (x, u) + η c(x, u) Adjoint equation: λ (t) = H x (x (t), u (t), λ(t), η(t)) a.e. in [0, 1] Transversality conditions: λ(0) = σ ψ x 0, λ(1) = σ ψ x 1 Optimality conditions: H u (x (t), u (t), λ(t), η(t)) = 0 a.e. in [0, 1] Complementarity condition: η(t) 0, η(t) c(x (t), u (t)) = 0 a.e. in [0, 1] M. Gerdts K.U. Leuven, 29/04/ / 49
8 Nonsmooth Reformulation Idea: reformulate minimum principle equivalently as nonlinear equation: F (z) = 0, F : Z Y Z, Y appropriate Banach spaces Apply some version of Newton s method! How? ( complementarity conditions) M. Gerdts K.U. Leuven, 29/04/ / 49
9 Fischer-Burmeister Function [Fischer 92] Fischer-Burmeister function: ϕ(a, b) = a 2 + b 2 a b Properties: convex (hence locally Lipschitzsch) ϕ(a, b) = 0 a 0, b 0, ab = 0 ( 2 ψ(a, b) := ϕ(a, b) 2 = a 2 + b 2 a b) is continuously differentiable! But: ϕ is not differentiable at (0, 0) M. Gerdts K.U. Leuven, 29/04/ / 49
10 Nonsmooth Reformulation Minimum principle is equivalent with nonsmooth equation ( ) F1 (z) F (z) = = 0, z = (x, u, λ, η, σ) F 2 (z) Smooth part: F 1 (z) := x ( ) f (x( ), u( )) λ ( ) + H x (x( ), u( ), λ( ), η( )) ψ(x(0), x(1)) λ(0) + ψ x 0 (x(0), x(1)) σ λ(1) ψ x 1 (x(0), x(1)) σ H u (x( ), u( ), λ( ), η( )) M. Gerdts K.U. Leuven, 29/04/ / 49
11 Nonsmooth Reformulation Nonsmooth part: ( complementarity conditions) F 2 (z) := ϕ( c(x( ), u( )), η( )) ϕ( c 1 (x( ), u( )), η 1 ( )) :=. ϕ( c nc (x( ), u( )), η nc ( )) M. Gerdts K.U. Leuven, 29/04/ / 49
12 Local Nonsmooth Newton s Method Local Nonsmooth Newton s Method (0) Choose z 0. (1) If some stopping criterion is satisfied, stop. (2) Choose an arbitrary V k F(z k ) and compute the search direction d k from the linear equation V k (d k ) = F (z k ). (3) Set z k+1 = z k + d k, k = k + 1, and goto (1). F (z k ) replaces nonexisting Jacobian F (z k )! M. Gerdts K.U. Leuven, 29/04/ / 49
13 Generalized Jacobian [Ulbrich 02] Replacement for Jacobian: Set-valued map with F : Z L(Z, Y ) F (z k )(z) := ( F 1 (z k )(z) S ( c x x + c u u) + Rη ) S = diag(s 1,..., s nc ), R = diag(r 1,..., r nc ), (s i, r i ) φ(z k )a.e. Motivation: chain rule in finite dimensional spaces ( Clarke s generalized Jacobian) M. Gerdts K.U. Leuven, 29/04/ / 49
14 Local Convergence Theorem 1 (G. 07) Assumptions: Let z be a zero of F. Uniform nonsingularity: V 1 L(Y,Z ) C V F(z), z U r (z ) Then: Locally superlinear convergence if f 0, f, c, ψ C 2 Proof: Show semismoothness F(z) F (z ) V (z z ) Y = o( z z Z ) V F(z) Existence & boundedness of V 1 : coercivity, uniform linear independence, controllability M. Gerdts K.U. Leuven, 29/04/ / 49
15 Application to OCP: Search Direction Linear operator equation V k (d) = F (z k ) has following structure: linear BVP of type ξ = Bξ + b q = E 0 ξ(0) + E 1 ξ(1) for ξ = (x, λ, σ) if ( H A := uu ( ) c u Sc u R ) non-singular and A 1 C, linear DAE-BVP of at least index 2, otherwise M. Gerdts K.U. Leuven, 29/04/ / 49
16 Optimal Control of a PDAE Minimize Z 1 2 subject to (0,T ) Ω z z d 2 dxdydt + α 2 Z (0,T ) Ω z t = z p + u, 0 = div(z), z(0, x, y) = 0, (x, y) Ω, z(t, x, y) = 0, (t, x, y) (0, T ) Ω, u u max. u 2 dxdydt M. Gerdts K.U. Leuven, 29/04/ / 49
17 2D-Stokes Equation Method of lines: (5-point-star for, forward FD for, backward FD for div) Minimize 1 2 Z T subject to index-2 DAE 0 z h (t) z d,h (t) 2 dt + α 2 Z T 0 u h (t) 2 dt z h (t) = A hz h (t) + B h p h (t) + u h (t), z h (0) = 0, 0 = Bh z h(t) and u h (t) u max. M. Gerdts K.U. Leuven, 29/04/ / 49
18 2D-Stokes Equation: Collocation Structure of collocation matrix: E 0 E 1 M 1 I......, I Collocation matrix: M nt n t = 25, n x = 18, 10 5 eqns n t = # time steps Per iteration and time step: (13005 eqns, nonzero, SuperLU) M. Gerdts K.U. Leuven, 29/04/ / 49
19 2D-Stokes Equation: Results [M. Kunkel] (T = 2, α = 10 5, n x = 18, n t = 25) 1 ITER α 2 F (zk ) e e e e e e e e e e e e-06 M. Gerdts K.U. Leuven, 29/04/ / 49
20 Limitations/Difficulties problems with pure state constraints problems with singular controls linear dependencies (redundant initial values, constraints) robustness computation of 2nd derivatives algorithmic differentiation M. Gerdts K.U. Leuven, 29/04/ / 49
21 State Constrained Optimal Control Problem OCP Minimize Φ(x(0), x(1), p) s.t. x (t) f (x(t), u(t), p) = 0 a.e. in [0, 1] c(x(t), u(t), p) 0 a.e. in [0, 1] s(x(t), p) 0 in [0, 1] ψ(x(0), x(1), p) = 0 Notation state: x W 1, ([0, 1], IR nx ) control: u L ([0, 1], IR nu ) parameter: p, no optimization variable! M. Gerdts K.U. Leuven, 29/04/ / 49
22 Direct Shooting x h (BDF, RK) x 1 xm u h (B-Splines) u 1 un control grid t 0 t N state grid t 0 t M M. Gerdts K.U. Leuven, 29/04/ / 49
23 Direct Shooting DOCP Structure Minimize Φ(x h (t 0 ; z), x h (t N ; z), p) s.t. c(t i, x h (t i ; z), u h (t i ; z), p) 0, i, s(t i, x h (t i ; z), p) 0, i, ψ(x h (t 0 ; z), x h (t N ; z), p) = 0, x h ( t j ; z) x j = 0, j M = 1 (single shooting) : small & dense; z = (x 1, u 1,..., u N ) M > 1 (multiple shooting) : large-scale & sparse; z = (x 1,..., x M 1, u 1,..., u N ) M. Gerdts K.U. Leuven, 29/04/ / 49
24 Nonlinear Programming Numerical solution: sequential quadratic programming (SQP) Gradient and Jacobian Evaluation: finite Differences Sensitivity ODE (IND) if #constraints #variables Adjoint ODE if #constraints < #variables Automatic Differentiation fixed step-size integrator M. Gerdts K.U. Leuven, 29/04/ / 49
25 Test-Drives: Numerical Results Background: nonlinear optimal control problem with index-1 DAE (41 differential states, 4 algebraic states) direct discretization method numerical solution by SQP M. Gerdts K.U. Leuven, 29/04/ / 49
26 Long Test-Courses Challenges for long test-courses: solution is required soon (within minutes) solution has to be computed automatically and robustly for many different test-courses (without user interaction, without initial guess) optimizing the whole test-course is very difficult (very good initial guess necessary; sensitive; frequent breakdowns of SQP) nonlinear model predictive control (NMPC) M. Gerdts K.U. Leuven, 29/04/ / 49
27 Nonlinear Model Predictive Control z h (t) z i h (t) Ingredients: local time horizon T > 0 discretization parameter h = T /N shifting parameter 0 < M N z i+1 h (t) T i T i + T T i+1 = T i + Mh T i+1 + T M. Gerdts K.U. Leuven, 29/04/ / 49
28 Test-Course of Oschersleben y(t) [m] Center of gravity -250 x=pilon x(t) [m] length: 3650 [m] time horizon: T = 10 [s] grid points: N = 50 shift parameter: M = 2 weights: c 1 = 1, c 2 = 0.01 CPU time: 11m39.948s M. Gerdts K.U. Leuven, 29/04/ / 49
29 Oschersleben: Velocity and Lateral Acceleration v(t) [m/s] Velocity t [s] ay(t) [m/s^2] Lateral acceleration t [s] M. Gerdts K.U. Leuven, 29/04/ / 49
30 Parametric Optimization NLP(p) Minimize f (z, p) s.t. g i (z, p) = 0, i = 1,..., n E, g i (z, p) 0, i = n E + 1,..., n g Sensitivity [Fiacco 83] Let z be a strongly regular local minimum of (NLP(p 0 )) for nominal parameter p 0. Then: NLP(p) has unique strongly regular local minimum z(p), λ(p) in neighborhood of p 0. z(p), λ(p) are continuously differentiable w.r.t. p. M. Gerdts K.U. Leuven, 29/04/ / 49
31 Idea of Real-time Optimization [Büskens,Maurer] Given: ( offline) nominal parameter p 0 strongly regular local solution z(p 0 ) to NLP(p 0 ) sensitivities dz dp (p 0) Real-time update formula by linearization (p: perturbation of p 0 ): ( online) z(p) z(p 0 ) + dz dp (p 0) (p p 0 ) M. Gerdts K.U. Leuven, 29/04/ / 49
32 Computation of Sensitivities At p = p 0 it holds dz dp dλ A(z,p 0 ) dp zz 2 L ( ) z g A(z,p 0 ) = z g A(z,p 0 ) 0 Linear equation! 1 2 zp L p g A(z,p 0 ) M. Gerdts K.U. Leuven, 29/04/ / 49
33 Real-time optimal control: Application to DOCP(p) Open-loop: nominal solution sensitivities measurement: parameter p p real-timecontrol u(t, p) ẋ = f (x, u, p) x(t) Open-loop real-time update formula (p: perturbation of p 0 ): ( online) u i (p) u i (p 0 ) + du i dp (p 0) (p p 0 ) (i = 0,..., N) real-time control approximation: piecewise linear/constant with u i (p) M. Gerdts K.U. Leuven, 29/04/ / 49
34 Emergency Landing Manoeuvre in Realtime Scenario: propulsion system breakdown Goal: maximization of range w.r.t. current position Controls: lift coefficient, angle of bank no thrust available; no fuel consumption (constant mass) M. Gerdts K.U. Leuven, 29/04/ / 49
35 VW Golf Controls: Steering wheel gas pedal/brakes gear shift (integer!) M. Gerdts K.U. Leuven, 29/04/ / 49
36 Variable Time Transformation Method Method: based on variable time transformation Dubovitskii/Milyutin used it to prove global minimum principle Lee et al. 99: Control Parametrization Enhancing Technique (CPET), optimal control problems with discrete control set leads to standard optimal control problem with continuous control set easy and fast M. Gerdts K.U. Leuven, 29/04/ / 49
37 Optimal Control Problem Mixed-Integer OCP Notation Minimize ϕ(x(t 0 ), x(t f )) s.t. ẋ(t) f (t, x(t), u(t), v(t)) = 0 s(t, x(t)) 0 ψ(x(t 0 ), x(t f )) = 0 u(t) U v(t) V state: x W 1, ([t 0, t f ], IR nx ) controls: u L ([t 0, t f ], IR nu ), v L ([t 0, t f ], IR nv ) U IR nu convex, closed, V = {v 1,..., v M } discrete M. Gerdts K.U. Leuven, 29/04/ / 49
38 Discretization Main grid Minor grid G h : t i = t 0 + ih, i = 0,..., N, h = t f t 0 N G h,m : τ i,j = t i + j h, j = 0,..., M, i = 0,..., N 1 M M = number of discrete values in V = {v 1,..., v M } M. Gerdts K.U. Leuven, 29/04/ / 49
39 Idea Replace the discrete control v by a fixed and piecewise constant function on the minor grid according to v Gh,M (τ ) = v j for τ [τ i,j 1, τ i,j ], i = 0,..., N 1, j = 1,..., M v M. v 1 t i 1 τ i 1,j t i τ i,j t i+1 τ i+1, j M. Gerdts K.U. Leuven, 29/04/ / 49
40 Idea: Variable Time Transformation Variable time transformation: and Remark: t = t(τ ), t(τ ) := t 0 + t f t 0 = Z τ Z tf t 0 t 0 w(s)ds, τ [t 0, t f ] w(s)ds w is the speed of running through [t 0, t f ]: dt dτ = w(τ ), τ [t 0, t f ] w(τ ) = 0 in [τ i,j, τ i,j+1 ) [t(τ i,j ), t(τ i,j+1 )] shrinks to {t(τ i,j )} M. Gerdts K.U. Leuven, 29/04/ / 49
41 Time Transformation w(τ ) t i+2 t(τ ) t i+1 t i t i 1 t i 1 τ i 1,j t i τ i,j t i+1 τ i+1, j M. Gerdts K.U. Leuven, 29/04/ / 49
42 New Control Consider w as new control subject to the restrictions: w(τ ) 0 for all τ ( no running back in time) w(τ ) piecewise constant on the minor grid G h,m Major grid points are invariant under time transformation: Z ti+1 Control set: t i w(τ )dτ = t i+1 t i = h, i = 0,..., N 1 W := w L ([t 0, t f ], R) w(τ ) 0, w piecewise constant on G h,m, Z ti+1 t i w(τ )dτ = t i+1 t i i M. Gerdts K.U. Leuven, 29/04/ / 49
43 Backtransformation v Gh,M (τ ): w(τ ): Corresponding control v(s) = v Gh,M (t 1 (s)): t(τ t i 1 t i,1 ) t(τ i t i+1,1 ) = t(τ i+1 i,2 ) = t(τ i+1,2 ) M. Gerdts K.U. Leuven, 29/04/ / 49
44 Transformed Optimal Control Problem TOCP Minimize ϕ(x(t 0 ), x(t f )) s.t. ẋ(τ ) w(τ )f (τ, x(τ ), u(τ ), v Gh,M (τ )) = 0 s(τ, x(τ )) 0 ψ(x(t 0 ), x(t f )) = 0 u(τ ) U w W Remarks: If w(τ ) 0 in [τ i,j, τ i,j+1 ] then x remains constant therein! v Gh,M is the fixed function defined before! TOCP has only continuous controls, no discrete controls anymore! M. Gerdts K.U. Leuven, 29/04/ / 49
45 Result: 20 grid points steering angle velocity w δ : gear shift µ: Braking force: F B (t) 0, Gas pedal position: φ(t) 1 Complete enumeration (1 [s] to solve DOCP): years Branch & Bound: 23 m 52 s, objective value: Transformation: 2 m s, objective value: M. Gerdts K.U. Leuven, 29/04/ / 49
46 Result: 40 grid points Steering angle velocity w δ : Gear shift µ: Braking force: F B (t) 0, Gas pedal position: φ(t) 1 Complete enumeration (1 [s] to solve DOCP): years Branch & Bound: 232 h 25 m 31 s, objective value: Transformation: 9 m s, objective value: M. Gerdts K.U. Leuven, 29/04/ / 49
47 Result: 80 grid points Steering angle velocity w δ : Gear shift µ: Braking force: F B (t) 0, Gas pedal position: φ(t) 1 65 m s, objective value: M. Gerdts K.U. Leuven, 29/04/ / 49
48 Next steps... mechanical multibody systems with contacts and friction: optimal control problems with compl. constraints robust optimal solutions: min max u U p P s.t. ϕ(x(u, p)(t 0 ), x(u, p)(t f )) max s(x(u, p)(t), u(t)) 0. p P optimal solutions w.r.t. perturbations/uncertainties M. Gerdts K.U. Leuven, 29/04/ / 49
49 Thanks for your attention! Questions? Further information: web.mat.bham.ac.uk/m.gerdts M. Gerdts K.U. Leuven, 29/04/ / 49
Trajectory Planning and Collision Detection for Robotics Applications
Trajectory Planning and Collision Detection for Robotics Applications joint work with Rene Henrion, Dietmar Homberg, Chantal Landry (WIAS) Institute of Mathematics and Applied Computing Department of Aerospace
More informationNumerical Optimal Control Part 2: Discretization techniques, structure exploitation, calculation of gradients
Numerical Optimal Control Part 2: Discretization techniques, structure exploitation, calculation of gradients SADCO Summer School and Workshop on Optimal and Model Predictive Control OMPC 2013, Bayreuth
More informationNumerical Optimal Control Part 3: Function space methods
Numerical Optimal Control Part 3: Function space methods SADCO Summer School and Workshop on Optimal and Model Predictive Control OMPC 2013, Bayreuth Institute of Mathematics and Applied Computing Department
More informationTime-Optimal Automobile Test Drives with Gear Shifts
Time-Optimal Control of Automobile Test Drives with Gear Shifts Christian Kirches Interdisciplinary Center for Scientific Computing (IWR) Ruprecht-Karls-University of Heidelberg, Germany joint work with
More informationNumerical Optimal Control Overview. Moritz Diehl
Numerical Optimal Control Overview Moritz Diehl Simplified Optimal Control Problem in ODE path constraints h(x, u) 0 initial value x0 states x(t) terminal constraint r(x(t )) 0 controls u(t) 0 t T minimize
More informationTheory and Applications of Constrained Optimal Control Proble
Theory and Applications of Constrained Optimal Control Problems with Delays PART 1 : Mixed Control State Constraints Helmut Maurer 1, Laurenz Göllmann 2 1 Institut für Numerische und Angewandte Mathematik,
More informationHot-Starting NLP Solvers
Hot-Starting NLP Solvers Andreas Wächter Department of Industrial Engineering and Management Sciences Northwestern University waechter@iems.northwestern.edu 204 Mixed Integer Programming Workshop Ohio
More informationThe Direct Transcription Method For Optimal Control. Part 2: Optimal Control
The Direct Transcription Method For Optimal Control Part 2: Optimal Control John T Betts Partner, Applied Mathematical Analysis, LLC 1 Fundamental Principle of Transcription Methods Transcription Method
More informationDirect Methods. Moritz Diehl. Optimization in Engineering Center (OPTEC) and Electrical Engineering Department (ESAT) K.U.
Direct Methods Moritz Diehl Optimization in Engineering Center (OPTEC) and Electrical Engineering Department (ESAT) K.U. Leuven Belgium Overview Direct Single Shooting Direct Collocation Direct Multiple
More informationTutorial on Control and State Constrained Optimal Control Problems
Tutorial on Control and State Constrained Optimal Control Problems To cite this version:. blems. SADCO Summer School 211 - Optimal Control, Sep 211, London, United Kingdom. HAL Id: inria-629518
More informationDeterministic Dynamic Programming
Deterministic Dynamic Programming 1 Value Function Consider the following optimal control problem in Mayer s form: V (t 0, x 0 ) = inf u U J(t 1, x(t 1 )) (1) subject to ẋ(t) = f(t, x(t), u(t)), x(t 0
More informationThe first order quasi-linear PDEs
Chapter 2 The first order quasi-linear PDEs The first order quasi-linear PDEs have the following general form: F (x, u, Du) = 0, (2.1) where x = (x 1, x 2,, x 3 ) R n, u = u(x), Du is the gradient of u.
More informationNumerical Methods for Embedded Optimization and Optimal Control. Exercises
Summer Course Numerical Methods for Embedded Optimization and Optimal Control Exercises Moritz Diehl, Daniel Axehill and Lars Eriksson June 2011 Introduction This collection of exercises is intended to
More informationReal-time Constrained Nonlinear Optimization for Maximum Power Take-off of a Wave Energy Converter
Real-time Constrained Nonlinear Optimization for Maximum Power Take-off of a Wave Energy Converter Thomas Bewley 23 May 2014 Southern California Optimization Day Summary 1 Introduction 2 Nonlinear Model
More informationNumerical Treatment of Unstructured. Differential-Algebraic Equations. with Arbitrary Index
Numerical Treatment of Unstructured Differential-Algebraic Equations with Arbitrary Index Peter Kunkel (Leipzig) SDS2003, Bari-Monopoli, 22. 25.06.2003 Outline Numerical Treatment of Unstructured Differential-Algebraic
More informationECE7850 Lecture 8. Nonlinear Model Predictive Control: Theoretical Aspects
ECE7850 Lecture 8 Nonlinear Model Predictive Control: Theoretical Aspects Model Predictive control (MPC) is a powerful control design method for constrained dynamical systems. The basic principles and
More informationINVERSION IN INDIRECT OPTIMAL CONTROL
INVERSION IN INDIRECT OPTIMAL CONTROL François Chaplais, Nicolas Petit Centre Automatique et Systèmes, École Nationale Supérieure des Mines de Paris, 35, rue Saint-Honoré 7735 Fontainebleau Cedex, France,
More information1.2 Derivation. d p f = d p f(x(p)) = x fd p x (= f x x p ). (1) Second, g x x p + g p = 0. d p f = f x g 1. The expression f x gx
PDE-constrained optimization and the adjoint method Andrew M. Bradley November 16, 21 PDE-constrained optimization and the adjoint method for solving these and related problems appear in a wide range of
More informationminimize x subject to (x 2)(x 4) u,
Math 6366/6367: Optimization and Variational Methods Sample Preliminary Exam Questions 1. Suppose that f : [, L] R is a C 2 -function with f () on (, L) and that you have explicit formulae for
More informationEfficient Numerical Methods for Nonlinear MPC and Moving Horizon Estimation
Efficient Numerical Methods for Nonlinear MPC and Moving Horizon Estimation Moritz Diehl, Hans Joachim Ferreau, and Niels Haverbeke Optimization in Engineering Center (OPTEC) and ESAT-SCD, K.U. Leuven,
More informationTonelli Full-Regularity in the Calculus of Variations and Optimal Control
Tonelli Full-Regularity in the Calculus of Variations and Optimal Control Delfim F. M. Torres delfim@mat.ua.pt Department of Mathematics University of Aveiro 3810 193 Aveiro, Portugal http://www.mat.ua.pt/delfim
More informationCHAPTER 10: Numerical Methods for DAEs
CHAPTER 10: Numerical Methods for DAEs Numerical approaches for the solution of DAEs divide roughly into two classes: 1. direct discretization 2. reformulation (index reduction) plus discretization Direct
More informationNumerical approximation for optimal control problems via MPC and HJB. Giulia Fabrini
Numerical approximation for optimal control problems via MPC and HJB Giulia Fabrini Konstanz Women In Mathematics 15 May, 2018 G. Fabrini (University of Konstanz) Numerical approximation for OCP 1 / 33
More informationThe Lifted Newton Method and Its Use in Optimization
The Lifted Newton Method and Its Use in Optimization Moritz Diehl Optimization in Engineering Center (OPTEC), K.U. Leuven, Belgium joint work with Jan Albersmeyer (U. Heidelberg) ENSIACET, Toulouse, February
More informationNonlinear and robust MPC with applications in robotics
Nonlinear and robust MPC with applications in robotics Boris Houska, Mario Villanueva, Benoît Chachuat ShanghaiTech, Texas A&M, Imperial College London 1 Overview Introduction to Robust MPC Min-Max Differential
More informationON REGULARITY CONDITIONS FOR COMPLEMENTARITY PROBLEMS
ON REGULARITY CONDITIONS FOR COMPLEMENTARITY PROBLEMS A. F. Izmailov and A. S. Kurennoy December 011 ABSTRACT In the context of mixed complementarity problems various concepts of solution regularity are
More informationAn introduction to Mathematical Theory of Control
An introduction to Mathematical Theory of Control Vasile Staicu University of Aveiro UNICA, May 2018 Vasile Staicu (University of Aveiro) An introduction to Mathematical Theory of Control UNICA, May 2018
More informationSuboptimal Open-loop Control Using POD. Stefan Volkwein
Institute for Mathematics and Scientific Computing University of Graz, Austria PhD program in Mathematics for Technology Catania, May 22, 2007 Motivation Optimal control of evolution problems: min J(y,
More informationEN Applied Optimal Control Lecture 8: Dynamic Programming October 10, 2018
EN530.603 Applied Optimal Control Lecture 8: Dynamic Programming October 0, 08 Lecturer: Marin Kobilarov Dynamic Programming (DP) is conerned with the computation of an optimal policy, i.e. an optimal
More informationConvexity of the Reachable Set of Nonlinear Systems under L 2 Bounded Controls
1 1 Convexity of the Reachable Set of Nonlinear Systems under L 2 Bounded Controls B.T.Polyak Institute for Control Science, Moscow, Russia e-mail boris@ipu.rssi.ru Abstract Recently [1, 2] the new convexity
More informationPOD for Parametric PDEs and for Optimality Systems
POD for Parametric PDEs and for Optimality Systems M. Kahlbacher, K. Kunisch, H. Müller and S. Volkwein Institute for Mathematics and Scientific Computing University of Graz, Austria DMV-Jahrestagung 26,
More informationTheory and Applications of Optimal Control Problems with Tim
Theory and Applications of Optimal Control Problems with Time Delays University of Münster Applied Mathematics: Institute of Analysis and Numerics Université Pierre et Marie Curie, Paris, March 1, 217
More informationJoint work with Nguyen Hoang (Univ. Concepción, Chile) Padova, Italy, May 2018
EXTENDED EULER-LAGRANGE AND HAMILTONIAN CONDITIONS IN OPTIMAL CONTROL OF SWEEPING PROCESSES WITH CONTROLLED MOVING SETS BORIS MORDUKHOVICH Wayne State University Talk given at the conference Optimization,
More informationOPTIMAL CONTROL CHAPTER INTRODUCTION
CHAPTER 3 OPTIMAL CONTROL What is now proved was once only imagined. William Blake. 3.1 INTRODUCTION After more than three hundred years of evolution, optimal control theory has been formulated as an extension
More informationOptimal control of nonstructured nonlinear descriptor systems
Optimal control of nonstructured nonlinear descriptor systems TU Berlin DFG Research Center Institut für Mathematik MATHEON Workshop Elgersburg 19.02.07 joint work with Peter Kunkel Overview Applications
More informationStability of Feedback Solutions for Infinite Horizon Noncooperative Differential Games
Stability of Feedback Solutions for Infinite Horizon Noncooperative Differential Games Alberto Bressan ) and Khai T. Nguyen ) *) Department of Mathematics, Penn State University **) Department of Mathematics,
More informationRobot Control Basics CS 685
Robot Control Basics CS 685 Control basics Use some concepts from control theory to understand and learn how to control robots Control Theory general field studies control and understanding of behavior
More informationST5215: Advanced Statistical Theory
Department of Statistics & Applied Probability Monday, September 26, 2011 Lecture 10: Exponential families and Sufficient statistics Exponential Families Exponential families are important parametric families
More informationOptimal Control and Applications
V. M. Becerra - Session 1-2nd AstroNet-II Summer School Optimal Control and Applications Session 1 2nd AstroNet-II Summer School Victor M. Becerra School of Systems Engineering University of Reading 5-6
More informationConstrained Nonlinear Optimization Algorithms
Department of Industrial Engineering and Management Sciences Northwestern University waechter@iems.northwestern.edu Institute for Mathematics and its Applications University of Minnesota August 4, 2016
More informationTheory and Applications of Optimal Control Problems with Time-Delays
Theory and Applications of Optimal Control Problems with Time-Delays University of Münster Institute of Computational and Applied Mathematics South Pacific Optimization Meeting (SPOM) Newcastle, CARMA,
More informationPOD/DEIM 4DVAR Data Assimilation of the Shallow Water Equation Model
nonlinear 4DVAR 4DVAR Data Assimilation of the Shallow Water Equation Model R. Ştefănescu and Ionel M. Department of Scientific Computing Florida State University Tallahassee, Florida May 23, 2013 (Florida
More informationTheory, Solution Techniques and Applications of Singular Boundary Value Problems
Theory, Solution Techniques and Applications of Singular Boundary Value Problems W. Auzinger O. Koch E. Weinmüller Vienna University of Technology, Austria Problem Class z (t) = M(t) z(t) + f(t, z(t)),
More informationMathematical Programs with Complementarity Constraints in the Context of Inverse Optimal Control for Locomotion
Mathematical Programs with Complementarity Constraints in the Context of Inverse Optimal Control for Locomotion Sebastian Albrecht a and Michael Ulbrich a a Chair of Mathematical Optimization, Department
More informationSolution of Stochastic Optimal Control Problems and Financial Applications
Journal of Mathematical Extension Vol. 11, No. 4, (2017), 27-44 ISSN: 1735-8299 URL: http://www.ijmex.com Solution of Stochastic Optimal Control Problems and Financial Applications 2 Mat B. Kafash 1 Faculty
More informationBulletin of the. Iranian Mathematical Society
ISSN: 1017-060X (Print) ISSN: 1735-8515 (Online) Bulletin of the Iranian Mathematical Society Vol. 41 (2015), No. 5, pp. 1259 1269. Title: A uniform approximation method to solve absolute value equation
More informationAn Active-Set Quadratic Programming Method Based On Sequential Hot-Starts
An Active-Set Quadratic Programg Method Based On Sequential Hot-Starts Travis C. Johnson, Christian Kirches, and Andreas Wächter October 7, 203 Abstract A new method for solving sequences of quadratic
More informationModule 05 Introduction to Optimal Control
Module 05 Introduction to Optimal Control Ahmad F. Taha EE 5243: Introduction to Cyber-Physical Systems Email: ahmad.taha@utsa.edu Webpage: http://engineering.utsa.edu/ taha/index.html October 8, 2015
More informationPenalty and Barrier Methods General classical constrained minimization problem minimize f(x) subject to g(x) 0 h(x) =0 Penalty methods are motivated by the desire to use unconstrained optimization techniques
More informationGeneralized Derivatives Automatic Evaluation & Implications for Algorithms Paul I. Barton, Kamil A. Khan & Harry A. J. Watson
Generalized Derivatives Automatic Evaluation & Implications for Algorithms Paul I. Barton, Kamil A. Khan & Harry A. J. Watson Process Systems Engineering Laboratory Massachusetts Institute of Technology
More informationLecture 4. Chapter 4: Lyapunov Stability. Eugenio Schuster. Mechanical Engineering and Mechanics Lehigh University.
Lecture 4 Chapter 4: Lyapunov Stability Eugenio Schuster schuster@lehigh.edu Mechanical Engineering and Mechanics Lehigh University Lecture 4 p. 1/86 Autonomous Systems Consider the autonomous system ẋ
More informationPDE Constrained Optimization selected Proofs
PDE Constrained Optimization selected Proofs Jeff Snider jeff@snider.com George Mason University Department of Mathematical Sciences April, 214 Outline 1 Prelim 2 Thms 3.9 3.11 3 Thm 3.12 4 Thm 3.13 5
More informationSingle Shooting and ESDIRK Methods for adjoint-based optimization of an oil reservoir
Downloaded from orbit.dtu.dk on: Dec 2, 217 Single Shooting and ESDIRK Methods for adjoint-based optimization of an oil reservoir Capolei, Andrea; Völcker, Carsten; Frydendall, Jan; Jørgensen, John Bagterp
More informationEE363 homework 7 solutions
EE363 Prof. S. Boyd EE363 homework 7 solutions 1. Gain margin for a linear quadratic regulator. Let K be the optimal state feedback gain for the LQR problem with system ẋ = Ax + Bu, state cost matrix Q,
More informationNumerical Continuation and Normal Form Analysis of Limit Cycle Bifurcations without Computing Poincaré Maps
Numerical Continuation and Normal Form Analysis of Limit Cycle Bifurcations without Computing Poincaré Maps Yuri A. Kuznetsov joint work with W. Govaerts, A. Dhooge(Gent), and E. Doedel (Montreal) LCBIF
More informationLecture 16: Relaxation methods
Lecture 16: Relaxation methods Clever technique which begins with a first guess of the trajectory across the entire interval Break the interval into M small steps: x 1 =0, x 2,..x M =L Form a grid of points,
More informationChapter 2 Optimal Control Problem
Chapter 2 Optimal Control Problem Optimal control of any process can be achieved either in open or closed loop. In the following two chapters we concentrate mainly on the first class. The first chapter
More informationProper Orthogonal Decomposition in PDE-Constrained Optimization
Proper Orthogonal Decomposition in PDE-Constrained Optimization K. Kunisch Department of Mathematics and Computational Science University of Graz, Austria jointly with S. Volkwein Dynamic Programming Principle
More informationWHEN ARE THE (UN)CONSTRAINED STATIONARY POINTS OF THE IMPLICIT LAGRANGIAN GLOBAL SOLUTIONS?
WHEN ARE THE (UN)CONSTRAINED STATIONARY POINTS OF THE IMPLICIT LAGRANGIAN GLOBAL SOLUTIONS? Francisco Facchinei a,1 and Christian Kanzow b a Università di Roma La Sapienza Dipartimento di Informatica e
More informationCHAPTER 3 THE MAXIMUM PRINCIPLE: MIXED INEQUALITY CONSTRAINTS. p. 1/73
CHAPTER 3 THE MAXIMUM PRINCIPLE: MIXED INEQUALITY CONSTRAINTS p. 1/73 THE MAXIMUM PRINCIPLE: MIXED INEQUALITY CONSTRAINTS Mixed Inequality Constraints: Inequality constraints involving control and possibly
More informationApplications of Bang-Bang and Singular Control Problems in B. Problems in Biology and Biomedicine
Applications of Bang-Bang and Singular Control Problems in Biology and Biomedicine University of Münster Institute of Computational and Applied Mathematics South Pacific Continuous Optimization Meeting
More informationA Smoothing Newton Method for Solving Absolute Value Equations
A Smoothing Newton Method for Solving Absolute Value Equations Xiaoqin Jiang Department of public basic, Wuhan Yangtze Business University, Wuhan 430065, P.R. China 392875220@qq.com Abstract: In this paper,
More informationBalanced realization and model order reduction for nonlinear systems based on singular value analysis
Balanced realization and model order reduction for nonlinear systems based on singular value analysis Kenji Fujimoto a, and Jacquelien M. A. Scherpen b a Department of Mechanical Science and Engineering
More informationLecture 8 Plus properties, merit functions and gap functions. September 28, 2008
Lecture 8 Plus properties, merit functions and gap functions September 28, 2008 Outline Plus-properties and F-uniqueness Equation reformulations of VI/CPs Merit functions Gap merit functions FP-I book:
More informationAffine covariant Semi-smooth Newton in function space
Affine covariant Semi-smooth Newton in function space Anton Schiela March 14, 2018 These are lecture notes of my talks given for the Winter School Modern Methods in Nonsmooth Optimization that was held
More informationShooting methods for numerical solutions of control problems constrained. by linear and nonlinear hyperbolic partial differential equations
Shooting methods for numerical solutions of control problems constrained by linear and nonlinear hyperbolic partial differential equations by Sung-Dae Yang A dissertation submitted to the graduate faculty
More informationLimit solutions for control systems
Limit solutions for control systems M. Soledad Aronna Escola de Matemática Aplicada, FGV-Rio Oktobermat XV, 19 e 20 de Outubro de 2017, PUC-Rio 1 Introduction & motivation 2 Limit solutions 3 Commutative
More informationAM 205: lecture 19. Last time: Conditions for optimality, Newton s method for optimization Today: survey of optimization methods
AM 205: lecture 19 Last time: Conditions for optimality, Newton s method for optimization Today: survey of optimization methods Quasi-Newton Methods General form of quasi-newton methods: x k+1 = x k α
More informationOptimizing Economic Performance using Model Predictive Control
Optimizing Economic Performance using Model Predictive Control James B. Rawlings Department of Chemical and Biological Engineering Second Workshop on Computational Issues in Nonlinear Control Monterey,
More informationSOLVING NONLINEAR OPTIMAL CONTROL PROBLEMS WITH STATE AND CONTROL DELAYS BY SHOOTING METHODS COMBINED WITH NUMERICAL CONTINUATION ON THE DELAYS
1 2 3 4 5 6 7 8 9 1 11 12 13 14 15 16 17 18 19 2 21 22 23 24 25 26 27 28 29 3 31 32 33 34 35 36 SOLVING NONLINEAR OPTIMAL CONTROL PROBLEMS WITH STATE AND CONTROL DELAYS BY SHOOTING METHODS COMBINED WITH
More information(1) u (t) = f(t, u(t)), 0 t a.
I. Introduction 1. Ordinary Differential Equations. In most introductions to ordinary differential equations one learns a variety of methods for certain classes of equations, but the issues of existence
More informationECEEN 5448 Fall 2011 Homework #5 Solutions
ECEEN 5448 Fall 211 Homework #5 Solutions Professor David G. Meyer December 8, 211 1. Consider the 1-dimensional time-varying linear system ẋ t (u x) (a) Find the state-transition matrix, Φ(t, τ). Here
More information1 Computing with constraints
Notes for 2017-04-26 1 Computing with constraints Recall that our basic problem is minimize φ(x) s.t. x Ω where the feasible set Ω is defined by equality and inequality conditions Ω = {x R n : c i (x)
More informationNonlinear Control Systems
Nonlinear Control Systems António Pedro Aguiar pedro@isr.ist.utl.pt 5. Input-Output Stability DEEC PhD Course http://users.isr.ist.utl.pt/%7epedro/ncs2012/ 2012 1 Input-Output Stability y = Hu H denotes
More informationA New Penalty-SQP Method
Background and Motivation Illustration of Numerical Results Final Remarks Frank E. Curtis Informs Annual Meeting, October 2008 Background and Motivation Illustration of Numerical Results Final Remarks
More informationTopic # Feedback Control Systems
Topic #17 16.31 Feedback Control Systems Deterministic LQR Optimal control and the Riccati equation Weight Selection Fall 2007 16.31 17 1 Linear Quadratic Regulator (LQR) Have seen the solutions to the
More informationConvergence of a Gauss Pseudospectral Method for Optimal Control
Convergence of a Gauss Pseudospectral Method for Optimal Control Hongyan Hou William W. Hager Anil V. Rao A convergence theory is presented for approximations of continuous-time optimal control problems
More informationProblem 1 Cost of an Infinite Horizon LQR
THE UNIVERSITY OF TEXAS AT SAN ANTONIO EE 5243 INTRODUCTION TO CYBER-PHYSICAL SYSTEMS H O M E W O R K # 5 Ahmad F. Taha October 12, 215 Homework Instructions: 1. Type your solutions in the LATEX homework
More informationTechnische Universität Dresden Herausgeber: Der Rektor
Als Manuskript gedruckt Technische Universität Dresden Herausgeber: Der Rektor The Gradient of the Squared Residual as Error Bound an Application to Karush-Kuhn-Tucker Systems Andreas Fischer MATH-NM-13-2002
More informationIntroduction to the Optimal Control Software GPOPS II
Introduction to the Optimal Control Software GPOPS II Anil V. Rao Department of Mechanical and Aerospace Engineering University of Florida Gainesville, FL 32611-625 Tutorial on GPOPS II NSF CBMS Workshop
More informationTutorial on Control and State Constrained Optimal Control Pro. Control Problems and Applications Part 3 : Pure State Constraints
Tutorial on Control and State Constrained Optimal Control Problems and Applications Part 3 : Pure State Constraints University of Münster Institute of Computational and Applied Mathematics SADCO Summer
More informationControllability, Observability & Local Decompositions
ontrollability, Observability & Local Decompositions Harry G. Kwatny Department of Mechanical Engineering & Mechanics Drexel University Outline Lie Bracket Distributions ontrollability ontrollability Distributions
More informationRobust Process Control by Dynamic Stochastic Programming
Konrad-Zuse-Zentrum für Informationstechnik Berlin Takustraße 7 D-14195 Berlin-Dahlem Germany MARC C. STEINBACH Robust Process Control by Dynamic Stochastic Programming ZIB-Report 04-20 (May 2004) ROBUST
More informationMinimization with Equality Constraints
Path Constraints and Numerical Optimization Robert Stengel Optimal Control and Estimation, MAE 546, Princeton University, 2015 State and Control Equality Constraints Pseudoinverse State and Control Inequality
More informationLagrangian submanifolds and generating functions
Chapter 4 Lagrangian submanifolds and generating functions Motivated by theorem 3.9 we will now study properties of the manifold Λ φ X (R n \{0}) for a clean phase function φ. As shown in section 3.3 Λ
More informationChap. 1. Some Differential Geometric Tools
Chap. 1. Some Differential Geometric Tools 1. Manifold, Diffeomorphism 1.1. The Implicit Function Theorem ϕ : U R n R n p (0 p < n), of class C k (k 1) x 0 U such that ϕ(x 0 ) = 0 rank Dϕ(x) = n p x U
More informationNecessary optimality conditions for optimal control problems with nonsmooth mixed state and control constraints
Necessary optimality conditions for optimal control problems with nonsmooth mixed state and control constraints An Li and Jane J. Ye Abstract. In this paper we study an optimal control problem with nonsmooth
More informationNumerical discretization of tangent vectors of hyperbolic conservation laws.
Numerical discretization of tangent vectors of hyperbolic conservation laws. Michael Herty IGPM, RWTH Aachen www.sites.google.com/michaelherty joint work with Benedetto Piccoli MNCFF 2014, Bejing, 22.5.2014
More information1. INTRODUCTION 2. PROBLEM FORMULATION ROMAI J., 6, 2(2010), 1 13
Contents 1 A product formula approach to an inverse problem governed by nonlinear phase-field transition system. Case 1D Tommaso Benincasa, Costică Moroşanu 1 v ROMAI J., 6, 2(21), 1 13 A PRODUCT FORMULA
More informationAccelerated Block-Coordinate Relaxation for Regularized Optimization
Accelerated Block-Coordinate Relaxation for Regularized Optimization Stephen J. Wright Computer Sciences University of Wisconsin, Madison October 09, 2012 Problem descriptions Consider where f is smooth
More informationSecond-order optimality conditions for state-constrained optimal control problems
Second-order optimality conditions for state-constrained optimal control problems J. Frédéric Bonnans INRIA-Saclay & CMAP, Ecole Polytechnique, France Joint work with Audrey Hermant, INRIA-Saclay & CMAP
More informationAn homotopy method for exact tracking of nonlinear nonminimum phase systems: the example of the spherical inverted pendulum
9 American Control Conference Hyatt Regency Riverfront, St. Louis, MO, USA June -, 9 FrA.5 An homotopy method for exact tracking of nonlinear nonminimum phase systems: the example of the spherical inverted
More informationAlberto Bressan. Department of Mathematics, Penn State University
Non-cooperative Differential Games A Homotopy Approach Alberto Bressan Department of Mathematics, Penn State University 1 Differential Games d dt x(t) = G(x(t), u 1(t), u 2 (t)), x(0) = y, u i (t) U i
More informationSF2822 Applied Nonlinear Optimization. Preparatory question. Lecture 9: Sequential quadratic programming. Anders Forsgren
SF2822 Applied Nonlinear Optimization Lecture 9: Sequential quadratic programming Anders Forsgren SF2822 Applied Nonlinear Optimization, KTH / 24 Lecture 9, 207/208 Preparatory question. Try to solve theory
More informationThe Plan. Initial value problems (ivps) for ordinary differential equations (odes) Review of basic methods You are here: Hamiltonian systems
Scientific Computing with Case Studies SIAM Press, 2009 http://www.cs.umd.edu/users/oleary/sccswebpage Lecture Notes for Unit V Solution of Differential Equations Part 2 Dianne P. O Leary c 2008 The Plan
More informationThe estimation problem ODE stability The embedding method The simultaneous method In conclusion. Stability problems in ODE estimation
Mathematical Sciences Institute Australian National University HPSC Hanoi 2006 Outline The estimation problem ODE stability The embedding method The simultaneous method In conclusion Estimation Given the
More informationOptimal Control - Homework Exercise 3
Optimal Control - Homework Exercise 3 December 17, 2010 In this exercise two different problems will be considered, first the so called Zermelo problem the problem is to steer a boat in streaming water,
More information5 Handling Constraints
5 Handling Constraints Engineering design optimization problems are very rarely unconstrained. Moreover, the constraints that appear in these problems are typically nonlinear. This motivates our interest
More informationExtremal Trajectories for Bounded Velocity Differential Drive Robots
Extremal Trajectories for Bounded Velocity Differential Drive Robots Devin J. Balkcom Matthew T. Mason Robotics Institute and Computer Science Department Carnegie Mellon University Pittsburgh PA 523 Abstract
More informationIntegrodifferential Hyperbolic Equations and its Application for 2-D Rotational Fluid Flows
Integrodifferential Hyperbolic Equations and its Application for 2-D Rotational Fluid Flows Alexander Chesnokov Lavrentyev Institute of Hydrodynamics Novosibirsk, Russia chesnokov@hydro.nsc.ru July 14,
More information