Suboptimal Open-loop Control Using POD. Stefan Volkwein

Size: px
Start display at page:

Download "Suboptimal Open-loop Control Using POD. Stefan Volkwein"

Transcription

1 Institute for Mathematics and Scientific Computing University of Graz, Austria PhD program in Mathematics for Technology Catania, May 22, 2007

2 Motivation Optimal control of evolution problems: min J(y, u) s.t. ẏ(t) = F(y(t), u(t)) for t > 0, y(0) = y, u U Optimization methods: First-order methods: gradient type methods per iteration nonlinear state and linear adjoint equations Second-order methods: SQP or Newton methods per iteration coupled linear state and linear adjoint equations Spatial discretization by FE or FD large-scale problems and feedback-strategies not feasible Model reduction by POD

3 Outline Suboptimal control of a nonlinear heat equation Suboptimal control of the Navier-Stokes equation POD for parameter estimation

4 Nonlinear heat equation [Diwoky/V.] Model problem: minj(y, u) = 2 subject to Ω y(t, x) z(x) 2 dx + β 2 T 0 Γ u(t, s) 2 dsdt y t (t, x) = k y(t, x) for (t, x) Q = (0, T) Ω y (t, s) = b(y(t, s)) + u(t, s) n for (t, s) Σ = (0, T) Γ y(0, x) = y (x) for x Ω R 2 Assumptions: T, β, k > 0, z, y C(Ω), b C 2, (R) with b 0

5 Infinite-dimensional problem Optimization variables: z = (y, u) Z, Z function space Equality constraints: e = (e, e 2 ) e (z), ϕ = T y t (t, x)ϕ(t, x) + k y(t, x) ϕ(t, x)dxdt 0 Ω T 0 Γ ( b(y(t, s)) + u(t, s) ) ϕ(t, s)dsdt e 2 (z) = y(0, ) y Infinite-dimensional optimization in function spaces: min J(z) subject to e(z) = 0 Lagrange function: L(z, p) = J(z) + e(z), p Optimality conditions: L(z, p) =! 0 (Fréchet-derivatives)

6 First-order optimality conditions y L(y, u, p)! = 0: adjoint equation p t (t, x) = k p(t, x) p n (t, s) = b (y(t, s))p(t, s) p(t, x) = (y(t, x) z(x)) for (t, x) Q = (0, T) Ω for (t, s) Σ = (0, T) Γ for x Ω u L(z, p)! = 0: optimality condition βu = kp on Σ p L(z, p)! = 0: state equation y t (t, x) = k y(t, x) y (t, s) = b(y(t, s)) + u(t, s) n y(0, x) = y (x) for (t, x) Q for (t, s) Σ for x Ω

7 SQP methods SQP: sequentiel quadratic programming Quadratic programming problem: L(z, p) = J(z) + e(z), p min L(z n, p n ) + L z (z n, p n )δz + 2 L zz(z n, p n )(δz, δz) subject to e(z n ) + e (z n )δz = 0 First-order optimality conditions for (QP n ): KKT system ( ) ( ) ( Lzz (z n, p n ) e (z n ) δz Lz (z e (z n = n, p n ) ) 0 δp e(z n ) ) (QP n ) Convergence: locally quadratic rate in (z n, p n ) (infinite-dimensional) Globalization: modification of the Hessian and line-search methods Alternative: trust-region methods

8 POD model reduction Goal: POD Galerkin ansatz using l POD basis functions Snapshot POD: solve of heat equation for 0 t <... < t n T Problems: unknown optimal control good snapshot set? u = k βp depends on p POD approximation for p? Strategy: iterate basis computation and include adjoint information in the snapshot ensemble

9 Dynamic POD strategy [Hinze et al./sachs et al.] () Choose estimate u 0 ; compute snapshots by solving state equation with u = u 0 and adjoint equation with y = y(u 0 ); i := 0 (2) Determine l POD basis functions and associated ROM of infinite-dimensional optimization problem (3) Compute solution u i+ of optimization problem (e.g., by SQP) (4) If Ψ(i) = ui+ u i u i+ TOL then stop (stopping criterium) (5) i := i + ; compute snapshots by solving state equation with control u = u i and adjoint equation with y = y(u i ); go back to (2)

10 Numerical results Data: y (x, x 2 ) = 0x x 2, z(x, x 2 ) = x x 2, b(y) = arctan(y), k = β = 0, T =, 85 FEs Recall: Ψ(i) = ui+ u i u i+ stopping criterium for dynamic POD strategy i relative L 2 error for y relative L 2 error for u J(y, u) Ψ(i) POD opt FE POD Compute snapshots M-flops 8 CPU time in s 3.3 Compute POD basis M-flops 0.44 CPU time in s 0.0 Solve with SQP M-flops 84 CPU time in s 22 total M-flops FE CPU time in s

11 Suboptimal control PDE: y t = y in (0, T) Ω y n = 0 on (0, ) Γ y n = u(t)q on (0, ) Γ 2 y(0) = 0 on Ω R 3 Boundary condition at z = 0.5: ( ) 2 q(t, x) = e x 0.7 cos(2πt) ( ) 2 e y 0.7 sin(2πt) Cost functional: J(y, u) = 2 Ω y(t) 2 dx + σ T 2 0 u(t) 2 dt

12 POD computation Snapshot ensembles: { V = span {ȳ h (t j )} j, { V 2 = span { p h (t j )} j, V 3 = V V 2 E(l) = l i= λ i 00%: { ȳh (t j) ȳ h (t j ) t { p h (t j) p h (t j ) t } } j } } l E(l) for V E(l) for V 2 E(l) for V 3 l = % % % l = % 97.4 % % l = % % % l = % % % l = % % % j

13 Approximation of the dual variable Theoretical POD estimate for the dual: ) p l p L 2 (0,T;V) ( y C l y + p P l p 0 0 p P l p L 2 (0,T;H (Ω)) 0 2 p P l p L 2 (0,T;L 2 (Ω)) {ψ } {ψ 2 } {ψ 3 } Number l of POD basis functions {ψ } {ψ 2 } {ψ 3 } Number l of POD basis functions

14 Approximation of the control variable 2 Comparison of the optimal controls Comparison of u h u u h u 5 for ψ i u 5 for ψ i 2 u 5 for ψ i t axis 0.2 u h u 5 for ψ i u h u 5 for ψ i 2 u h u 5 for ψ i t axis l u h u l for {ψi }l i= u h u l for {ψi 2 }l i= u h u l for {ψi 3 }l i= l = l = l = l = l = u h u l for different POD basis {ψ j i }l i= corresponding to the ensembles V j, j =, 2, 3

15 Control of the Navier-Stokes equation [Hinze] Optimal control problem: min J(y, u) = Z T Z y z 2 dxdt + α Z T Z u 2 dxdt (y,u) 2 0 Ω 2 0 Ω subject to y t + (y )y ν y + p = Bu div y = 0 in Q = (0, T) Ω in Q y(t, ) = y d on (0, T) Γ d ν ηy(t, ) = pη on (0, T) Γ outlet y(0, ) = y in Ω Domain Ω:

16 Outline Nonlinear heat equation Navier-Stokes Parameter Id. Computation of the POD basis Uncontrolled flow: POD basis functions: ψ, ψ2, ψ3 and ψ4 Vorticity Y Vorticity Y X Vorticity Y X 2 Vorticity Y X X

17 projections predictions POD properties POD ansatz: y l = y m + l i= α i(t)ψ i with y m = m m i= y(t i) Projection onto the POD subspace: α i (t) and ( y(t) y m ) Tψi 4 2 amplitude time Different number of snapshots: N=4 N=8 N=0 N=6 N=20 amplitude time

18 Optimal solution Goal: mean flow field y m Starting value for optimizer: uncontrolled flow, i.e., y for u = 0 Optimal solution: flow field y l

19 Parameter estimation [Kahlbacher/V.] Model equations: g(x) = x 3 4 u + ( ) u + au = g in Ω = (0, ) (0, ) ( ) 3 u 4 n u = on Γ Data: choose a id 0 and compute (FE) solution u(a id ) to ( ) Reconstruction: estimate a 0 from u d = ( + εδ)u(a id ) Γ with random ε and factor δ = 5% Constrained optimization: min J(a, u) = α u u d 2 ds+κ a 2 s.t. (a, u) solves ( ) and a 0 Relaxation of the inequality: Γ min J λ (a, u) = J(a, u)+ max{ 0, λ + (0 a) } 2 s.t. (a, u) solves ( )

20 Global convergent optimization method Outer loop: augmented Lagrangian method control of k and λ k Inner loop: globalized SQP algorithm with fixed ( k, λ k ) for { min J k 3 (a, u) s.t. 4 u + ( ) u + au = g in Ω λ k 3 u 4 n u = on Γ Numerical results: α = 5000, κ = , a id = 25, l = Decay of the first eigenvalues 0 2 relative errors: 0 4 u l u(a id ) u(a id ) a l a id a id

21 Parameter identification Model equations: a(x) is piecewise constant on 4 subdomains of Ω 3 4 u + ( 2 ) u + au = in Ω = (0, ) (0, ) (0, ) 3 u 4 n u = on Γ ( ) Data: choose a id 0 and compute (FE) solution u(a id ) to ( ) Reconstruction: estimate a 0 from u d = ( + εδ)u(a id ) Γ with random ε and factor δ = 5% 0 0 Decay of the first eigenvalues

22 Global convergent optimization method Outer loop: augmented Lagrangian method control of k and λ k Inner loop: globalized SQP algorithm with fixed ( k, λ k ) for min J k λ k (a, u) s.t. 3 4 u + ( 2 ) u + au = in Ω 3 4 u n u = on Γ Numerical results: α = 0000, κ = 0 3 ( 2, 4, 4, 8 )T, a id = (0, 20, 5, 7) T, l = 7 POD FE a a id a id u u(a id ) u(a id ) CPU time in s

23 Parameter identification of the diffusion coefficient Model equations: g(x) = x c u + 25u = in Ω = (0, ) (0, ) c u n u = g on Γ ( ) Data: choose c id 0 and compute (FE) solution u(a id ) to ( ) Reconstruction: estimate c 0 from u d = ( + εδ)u(c id ) Γ with random ε and factor δ = 5% Optimal state and decay of the first eigenvalues: FE solution 0 0 Decay of the first eigenvalues y axis x axis

24 Global convergent optimization method Outer loop: augmented Lagrangian method control of k and λ k Inner loop: globalized SQP algorithm with fixed ( k, λ k ) for min J k λ k (c, u) s.t. { c u + 25u = in Ω c u n u = g on Γ Numerical results: α = 00000, κ = , c id = 3, l = 5 POD FE c c id c id u u(c id ) u(c id ) CPU time in s

POD for Parametric PDEs and for Optimality Systems

POD for Parametric PDEs and for Optimality Systems POD for Parametric PDEs and for Optimality Systems M. Kahlbacher, K. Kunisch, H. Müller and S. Volkwein Institute for Mathematics and Scientific Computing University of Graz, Austria DMV-Jahrestagung 26,

More information

Proper Orthogonal Decomposition in PDE-Constrained Optimization

Proper Orthogonal Decomposition in PDE-Constrained Optimization Proper Orthogonal Decomposition in PDE-Constrained Optimization K. Kunisch Department of Mathematics and Computational Science University of Graz, Austria jointly with S. Volkwein Dynamic Programming Principle

More information

Proper Orthogonal Decomposition. POD for PDE Constrained Optimization. Stefan Volkwein

Proper Orthogonal Decomposition. POD for PDE Constrained Optimization. Stefan Volkwein Proper Orthogonal Decomposition for PDE Constrained Optimization Institute of Mathematics and Statistics, University of Constance Joined work with F. Diwoky, M. Hinze, D. Hömberg, M. Kahlbacher, E. Kammann,

More information

Model order reduction & PDE constrained optimization

Model order reduction & PDE constrained optimization 1 Model order reduction & PDE constrained optimization Fachbereich Mathematik Optimierung und Approximation, Universität Hamburg Leuven, January 8, 01 Names Afanasiev, Attwell, Burns, Cordier,Fahl, Farrell,

More information

Constrained optimization: direct methods (cont.)

Constrained optimization: direct methods (cont.) Constrained optimization: direct methods (cont.) Jussi Hakanen Post-doctoral researcher jussi.hakanen@jyu.fi Direct methods Also known as methods of feasible directions Idea in a point x h, generate a

More information

Proper Orthogonal Decomposition (POD) for Nonlinear Dynamical Systems. Stefan Volkwein

Proper Orthogonal Decomposition (POD) for Nonlinear Dynamical Systems. Stefan Volkwein Proper Orthogonal Decomposition (POD) for Nonlinear Dynamical Systems Institute for Mathematics and Scientific Computing, Austria DISC Summerschool 5 Outline of the talk POD and singular value decomposition

More information

An optimal control problem for a parabolic PDE with control constraints

An optimal control problem for a parabolic PDE with control constraints An optimal control problem for a parabolic PDE with control constraints PhD Summer School on Reduced Basis Methods, Ulm Martin Gubisch University of Konstanz October 7 Martin Gubisch (University of Konstanz)

More information

Numerical approximation for optimal control problems via MPC and HJB. Giulia Fabrini

Numerical approximation for optimal control problems via MPC and HJB. Giulia Fabrini Numerical approximation for optimal control problems via MPC and HJB Giulia Fabrini Konstanz Women In Mathematics 15 May, 2018 G. Fabrini (University of Konstanz) Numerical approximation for OCP 1 / 33

More information

minimize x subject to (x 2)(x 4) u,

minimize x subject to (x 2)(x 4) u, Math 6366/6367: Optimization and Variational Methods Sample Preliminary Exam Questions 1. Suppose that f : [, L] R is a C 2 -function with f () on (, L) and that you have explicit formulae for

More information

Solving Distributed Optimal Control Problems for the Unsteady Burgers Equation in COMSOL Multiphysics

Solving Distributed Optimal Control Problems for the Unsteady Burgers Equation in COMSOL Multiphysics Excerpt from the Proceedings of the COMSOL Conference 2009 Milan Solving Distributed Optimal Control Problems for the Unsteady Burgers Equation in COMSOL Multiphysics Fikriye Yılmaz 1, Bülent Karasözen

More information

Adaptive methods for control problems with finite-dimensional control space

Adaptive methods for control problems with finite-dimensional control space Adaptive methods for control problems with finite-dimensional control space Saheed Akindeinde and Daniel Wachsmuth Johann Radon Institute for Computational and Applied Mathematics (RICAM) Austrian Academy

More information

Proper Orthogonal Decomposition for Optimal Control Problems with Mixed Control-State Constraints

Proper Orthogonal Decomposition for Optimal Control Problems with Mixed Control-State Constraints Proper Orthogonal Decomposition for Optimal Control Problems with Mixed Control-State Constraints Technische Universität Berlin Martin Gubisch, Stefan Volkwein University of Konstanz March, 3 Martin Gubisch,

More information

Optimization Problems with Constraints - introduction to theory, numerical Methods and applications

Optimization Problems with Constraints - introduction to theory, numerical Methods and applications Optimization Problems with Constraints - introduction to theory, numerical Methods and applications Dr. Abebe Geletu Ilmenau University of Technology Department of Simulation and Optimal Processes (SOP)

More information

OPTIMALITY CONDITIONS AND POD A-POSTERIORI ERROR ESTIMATES FOR A SEMILINEAR PARABOLIC OPTIMAL CONTROL

OPTIMALITY CONDITIONS AND POD A-POSTERIORI ERROR ESTIMATES FOR A SEMILINEAR PARABOLIC OPTIMAL CONTROL OPTIMALITY CONDITIONS AND POD A-POSTERIORI ERROR ESTIMATES FOR A SEMILINEAR PARABOLIC OPTIMAL CONTROL O. LASS, S. TRENZ, AND S. VOLKWEIN Abstract. In the present paper the authors consider an optimal control

More information

Eileen Kammann Fredi Tröltzsch Stefan Volkwein

Eileen Kammann Fredi Tröltzsch Stefan Volkwein Universität Konstanz A method of a-posteriori error estimation with application to proper orthogonal decomposition Eileen Kammann Fredi Tröltzsch Stefan Volkwein Konstanzer Schriften in Mathematik Nr.

More information

SF2822 Applied Nonlinear Optimization. Preparatory question. Lecture 9: Sequential quadratic programming. Anders Forsgren

SF2822 Applied Nonlinear Optimization. Preparatory question. Lecture 9: Sequential quadratic programming. Anders Forsgren SF2822 Applied Nonlinear Optimization Lecture 9: Sequential quadratic programming Anders Forsgren SF2822 Applied Nonlinear Optimization, KTH / 24 Lecture 9, 207/208 Preparatory question. Try to solve theory

More information

CE 191: Civil and Environmental Engineering Systems Analysis. LEC 05 : Optimality Conditions

CE 191: Civil and Environmental Engineering Systems Analysis. LEC 05 : Optimality Conditions CE 191: Civil and Environmental Engineering Systems Analysis LEC : Optimality Conditions Professor Scott Moura Civil & Environmental Engineering University of California, Berkeley Fall 214 Prof. Moura

More information

Trust-Region SQP Methods with Inexact Linear System Solves for Large-Scale Optimization

Trust-Region SQP Methods with Inexact Linear System Solves for Large-Scale Optimization Trust-Region SQP Methods with Inexact Linear System Solves for Large-Scale Optimization Denis Ridzal Department of Computational and Applied Mathematics Rice University, Houston, Texas dridzal@caam.rice.edu

More information

INTERPRETATION OF PROPER ORTHOGONAL DECOMPOSITION AS SINGULAR VALUE DECOMPOSITION AND HJB-BASED FEEDBACK DESIGN PAPER MSC-506

INTERPRETATION OF PROPER ORTHOGONAL DECOMPOSITION AS SINGULAR VALUE DECOMPOSITION AND HJB-BASED FEEDBACK DESIGN PAPER MSC-506 INTERPRETATION OF PROPER ORTHOGONAL DECOMPOSITION AS SINGULAR VALUE DECOMPOSITION AND HJB-BASED FEEDBACK DESIGN PAPER MSC-506 SIXTEENTH INTERNATIONAL SYMPOSIUM ON MATHEMATICAL THEORY OF NETWORKS AND SYSTEMS

More information

Algorithms for PDE-Constrained Optimization

Algorithms for PDE-Constrained Optimization GAMM-Mitteilungen, 31 January 2014 Algorithms for PDE-Constrained Optimization Roland Herzog 1 and Karl Kunisch 2 1 Chemnitz University of Technology, Faculty of Mathematics, Reichenhainer Straße 41, D

More information

Fast Iterative Solution of Saddle Point Problems

Fast Iterative Solution of Saddle Point Problems Michele Benzi Department of Mathematics and Computer Science Emory University Atlanta, GA Acknowledgments NSF (Computational Mathematics) Maxim Olshanskii (Mech-Math, Moscow State U.) Zhen Wang (PhD student,

More information

Constrained Optimization

Constrained Optimization 1 / 22 Constrained Optimization ME598/494 Lecture Max Yi Ren Department of Mechanical Engineering, Arizona State University March 30, 2015 2 / 22 1. Equality constraints only 1.1 Reduced gradient 1.2 Lagrange

More information

Optimal control problems with PDE constraints

Optimal control problems with PDE constraints Optimal control problems with PDE constraints Maya Neytcheva CIM, October 2017 General framework Unconstrained optimization problems min f (q) q x R n (real vector) and f : R n R is a smooth function.

More information

AM 205: lecture 19. Last time: Conditions for optimality, Newton s method for optimization Today: survey of optimization methods

AM 205: lecture 19. Last time: Conditions for optimality, Newton s method for optimization Today: survey of optimization methods AM 205: lecture 19 Last time: Conditions for optimality, Newton s method for optimization Today: survey of optimization methods Quasi-Newton Methods General form of quasi-newton methods: x k+1 = x k α

More information

An Inexact Newton Method for Nonlinear Constrained Optimization

An Inexact Newton Method for Nonlinear Constrained Optimization An Inexact Newton Method for Nonlinear Constrained Optimization Frank E. Curtis Numerical Analysis Seminar, January 23, 2009 Outline Motivation and background Algorithm development and theoretical results

More information

5 Handling Constraints

5 Handling Constraints 5 Handling Constraints Engineering design optimization problems are very rarely unconstrained. Moreover, the constraints that appear in these problems are typically nonlinear. This motivates our interest

More information

NECESSARY OPTIMALITY CONDITIONS FOR AN OPTIMAL CONTROL PROBLEM OF 2D

NECESSARY OPTIMALITY CONDITIONS FOR AN OPTIMAL CONTROL PROBLEM OF 2D NECESSARY OPTIMALITY CONDITIONS FOR AN OPTIMAL CONTROL PROBLEM OF 2D g-navier-stokes EQUATIONS Nguyen Duc Loc 1 Abstract Considered here is the optimal control problem of 2D g-navier-stokes equations.

More information

Algorithms for constrained local optimization

Algorithms for constrained local optimization Algorithms for constrained local optimization Fabio Schoen 2008 http://gol.dsi.unifi.it/users/schoen Algorithms for constrained local optimization p. Feasible direction methods Algorithms for constrained

More information

Reduced-Order Model Development and Control Design

Reduced-Order Model Development and Control Design Reduced-Order Model Development and Control Design K. Kunisch Department of Mathematics University of Graz, Austria Rome, January 6 Laser-Oberflächenhärtung eines Stahl-Werkstückes [WIAS-Berlin]: workpiece

More information

The HJB-POD approach for infinite dimensional control problems

The HJB-POD approach for infinite dimensional control problems The HJB-POD approach for infinite dimensional control problems M. Falcone works in collaboration with A. Alla, D. Kalise and S. Volkwein Università di Roma La Sapienza OCERTO Workshop Cortona, June 22,

More information

12. Interior-point methods

12. Interior-point methods 12. Interior-point methods Convex Optimization Boyd & Vandenberghe inequality constrained minimization logarithmic barrier function and central path barrier method feasibility and phase I methods complexity

More information

Reduced-Order Methods in PDE Constrained Optimization

Reduced-Order Methods in PDE Constrained Optimization Reduced-Order Methods in PDE Constrained Optimization M. Hinze (Hamburg), K. Kunisch (Graz), F. Tro ltzsch (Berlin) and E. Grimm, M. Gubisch, S. Rogg, A. Studinger, S. Trenz, S. Volkwein University of

More information

A posteriori error estimates for the adaptivity technique for the Tikhonov functional and global convergence for a coefficient inverse problem

A posteriori error estimates for the adaptivity technique for the Tikhonov functional and global convergence for a coefficient inverse problem A posteriori error estimates for the adaptivity technique for the Tikhonov functional and global convergence for a coefficient inverse problem Larisa Beilina Michael V. Klibanov December 18, 29 Abstract

More information

Hamburger Beiträge zur Angewandten Mathematik

Hamburger Beiträge zur Angewandten Mathematik Hamurger Beiträge zur Angewandten Mathematik POD asis updates for nonlinear PDE control Carmen Gräßle, Martin Guisch, Simone Metzdorf, Sarina Rogg, Stefan Volkwein Nr. 16-18 August 16 C. Gräßle, M. Guisch,

More information

ON CONVERGENCE OF A RECEDING HORIZON METHOD FOR PARABOLIC BOUNDARY CONTROL. fredi tröltzsch and daniel wachsmuth 1

ON CONVERGENCE OF A RECEDING HORIZON METHOD FOR PARABOLIC BOUNDARY CONTROL. fredi tröltzsch and daniel wachsmuth 1 ON CONVERGENCE OF A RECEDING HORIZON METHOD FOR PARABOLIC BOUNDARY CONTROL fredi tröltzsch and daniel wachsmuth Abstract. A method of receding horizon type is considered for a simplified linear-quadratic

More information

Projection methods to solve SDP

Projection methods to solve SDP Projection methods to solve SDP Franz Rendl http://www.math.uni-klu.ac.at Alpen-Adria-Universität Klagenfurt Austria F. Rendl, Oberwolfach Seminar, May 2010 p.1/32 Overview Augmented Primal-Dual Method

More information

Nonlinear stabilization via a linear observability

Nonlinear stabilization via a linear observability via a linear observability Kaïs Ammari Department of Mathematics University of Monastir Joint work with Fathia Alabau-Boussouira Collocated feedback stabilization Outline 1 Introduction and main result

More information

Interior Point Algorithms for Constrained Convex Optimization

Interior Point Algorithms for Constrained Convex Optimization Interior Point Algorithms for Constrained Convex Optimization Chee Wei Tan CS 8292 : Advanced Topics in Convex Optimization and its Applications Fall 2010 Outline Inequality constrained minimization problems

More information

Reduced-Order Multiobjective Optimal Control of Semilinear Parabolic Problems. Laura Iapichino Stefan Trenz Stefan Volkwein

Reduced-Order Multiobjective Optimal Control of Semilinear Parabolic Problems. Laura Iapichino Stefan Trenz Stefan Volkwein Universität Konstanz Reduced-Order Multiobjective Optimal Control of Semilinear Parabolic Problems Laura Iapichino Stefan Trenz Stefan Volkwein Konstanzer Schriften in Mathematik Nr. 347, Dezember 2015

More information

Dedicated to the 65th birthday of Prof Jürgen Sprekels

Dedicated to the 65th birthday of Prof Jürgen Sprekels OPTIMAL CONTROL OF MAGNETIC FIELDS IN FLOW MEASUREMENT SERGE NICAISE, SIMON STINGELIN, AND FREDI TRÖLTZSCH Dedicated to the 65th birthday of Prof Jürgen Sprekels Abstract. Optimal control problems are

More information

CS711008Z Algorithm Design and Analysis

CS711008Z Algorithm Design and Analysis CS711008Z Algorithm Design and Analysis Lecture 8 Linear programming: interior point method Dongbo Bu Institute of Computing Technology Chinese Academy of Sciences, Beijing, China 1 / 31 Outline Brief

More information

Time-dependent Dirichlet Boundary Conditions in Finite Element Discretizations

Time-dependent Dirichlet Boundary Conditions in Finite Element Discretizations Time-dependent Dirichlet Boundary Conditions in Finite Element Discretizations Peter Benner and Jan Heiland November 5, 2015 Seminar Talk at Uni Konstanz Introduction Motivation A controlled physical processes

More information

Approximation of fluid-structure interaction problems with Lagrange multiplier

Approximation of fluid-structure interaction problems with Lagrange multiplier Approximation of fluid-structure interaction problems with Lagrange multiplier Daniele Boffi Dipartimento di Matematica F. Casorati, Università di Pavia http://www-dimat.unipv.it/boffi May 30, 2016 Outline

More information

Convex Optimization. Ofer Meshi. Lecture 6: Lower Bounds Constrained Optimization

Convex Optimization. Ofer Meshi. Lecture 6: Lower Bounds Constrained Optimization Convex Optimization Ofer Meshi Lecture 6: Lower Bounds Constrained Optimization Lower Bounds Some upper bounds: #iter μ 2 M #iter 2 M #iter L L μ 2 Oracle/ops GD κ log 1/ε M x # ε L # x # L # ε # με f

More information

Proper Orthogonal Decomposition Surrogate Models for Nonlinear Dynamical Systems: Error Estimates and Suboptimal Control

Proper Orthogonal Decomposition Surrogate Models for Nonlinear Dynamical Systems: Error Estimates and Suboptimal Control Proper Orthogonal Decomposition Surrogate Models for Nonlinear Dynamical Systems: Error Estimates and Suboptimal Control Michael Hinze 1 and Stefan Volkwein 1 Institut für Numerische Mathematik, TU Dresden,

More information

Support Vector Machines

Support Vector Machines Support Vector Machines Support vector machines (SVMs) are one of the central concepts in all of machine learning. They are simply a combination of two ideas: linear classification via maximum (or optimal

More information

An Inexact Sequential Quadratic Optimization Method for Nonlinear Optimization

An Inexact Sequential Quadratic Optimization Method for Nonlinear Optimization An Inexact Sequential Quadratic Optimization Method for Nonlinear Optimization Frank E. Curtis, Lehigh University involving joint work with Travis Johnson, Northwestern University Daniel P. Robinson, Johns

More information

LECTURE # 0 BASIC NOTATIONS AND CONCEPTS IN THE THEORY OF PARTIAL DIFFERENTIAL EQUATIONS (PDES)

LECTURE # 0 BASIC NOTATIONS AND CONCEPTS IN THE THEORY OF PARTIAL DIFFERENTIAL EQUATIONS (PDES) LECTURE # 0 BASIC NOTATIONS AND CONCEPTS IN THE THEORY OF PARTIAL DIFFERENTIAL EQUATIONS (PDES) RAYTCHO LAZAROV 1 Notations and Basic Functional Spaces Scalar function in R d, d 1 will be denoted by u,

More information

Infinite-dimensional nonlinear predictive controller design for open-channel hydraulic systems

Infinite-dimensional nonlinear predictive controller design for open-channel hydraulic systems Infinite-dimensional nonlinear predictive controller design for open-channel hydraulic systems D. Georges, Control Systems Dept - Gipsa-lab, Grenoble INP Workshop on Irrigation Channels and Related Problems,

More information

PDE Constrained Optimization selected Proofs

PDE Constrained Optimization selected Proofs PDE Constrained Optimization selected Proofs Jeff Snider jeff@snider.com George Mason University Department of Mathematical Sciences April, 214 Outline 1 Prelim 2 Thms 3.9 3.11 3 Thm 3.12 4 Thm 3.13 5

More information

Proper Orthogonal Decomposition (POD)

Proper Orthogonal Decomposition (POD) Intro Results Problem etras Proper Orthogonal Decomposition () Advisor: Dr. Sorensen CAAM699 Department of Computational and Applied Mathematics Rice University September 5, 28 Outline Intro Results Problem

More information

AN AUGMENTED LAGRANGIAN AFFINE SCALING METHOD FOR NONLINEAR PROGRAMMING

AN AUGMENTED LAGRANGIAN AFFINE SCALING METHOD FOR NONLINEAR PROGRAMMING AN AUGMENTED LAGRANGIAN AFFINE SCALING METHOD FOR NONLINEAR PROGRAMMING XIAO WANG AND HONGCHAO ZHANG Abstract. In this paper, we propose an Augmented Lagrangian Affine Scaling (ALAS) algorithm for general

More information

Numerics and Control of PDEs Lecture 1. IFCAM IISc Bangalore

Numerics and Control of PDEs Lecture 1. IFCAM IISc Bangalore 1/1 Numerics and Control of PDEs Lecture 1 IFCAM IISc Bangalore July 22 August 2, 2013 Introduction to feedback stabilization Stabilizability of F.D.S. Mythily R., Praveen C., Jean-Pierre R. 2/1 Q1. Controllability.

More information

Lectures Notes Algorithms and Preconditioning in PDE-Constrained Optimization. Prof. Dr. R. Herzog

Lectures Notes Algorithms and Preconditioning in PDE-Constrained Optimization. Prof. Dr. R. Herzog Lectures Notes Algorithms and Preconditioning in PDE-Constrained Optimization Prof. Dr. R. Herzog held in July 2010 at the Summer School on Analysis and Numerics of PDE Constrained Optimization, Lambrecht

More information

AM 205: lecture 19. Last time: Conditions for optimality Today: Newton s method for optimization, survey of optimization methods

AM 205: lecture 19. Last time: Conditions for optimality Today: Newton s method for optimization, survey of optimization methods AM 205: lecture 19 Last time: Conditions for optimality Today: Newton s method for optimization, survey of optimization methods Optimality Conditions: Equality Constrained Case As another example of equality

More information

Numerical Optimization of Partial Differential Equations

Numerical Optimization of Partial Differential Equations Numerical Optimization of Partial Differential Equations Bartosz Protas Department of Mathematics & Statistics McMaster University, Hamilton, Ontario, Canada URL: http://www.math.mcmaster.ca/bprotas Rencontres

More information

Numerics and Control of PDEs Lecture 7. IFCAM IISc Bangalore. Feedback stabilization of a 1D nonlinear model

Numerics and Control of PDEs Lecture 7. IFCAM IISc Bangalore. Feedback stabilization of a 1D nonlinear model 1/3 Numerics and Control of PDEs Lecture 7 IFCAM IISc Bangalore July August, 13 Feedback stabilization of a 1D nonlinear model Mythily R., Praveen C., Jean-Pierre R. /3 Plan of lecture 7 1. The nonlinear

More information

PDE-constrained Optimization and Beyond (PDE-constrained Optimal Control)

PDE-constrained Optimization and Beyond (PDE-constrained Optimal Control) PDE-constrained Optimization and Beyond (PDE-constrained Optimal Control) Youngsoo Choi Introduction PDE-condstrained optimization has broad and important applications. It is in some sense an obvious consequence

More information

Sufficient Conditions for Finite-variable Constrained Minimization

Sufficient Conditions for Finite-variable Constrained Minimization Lecture 4 It is a small de tour but it is important to understand this before we move to calculus of variations. Sufficient Conditions for Finite-variable Constrained Minimization ME 256, Indian Institute

More information

Written Examination

Written Examination Division of Scientific Computing Department of Information Technology Uppsala University Optimization Written Examination 202-2-20 Time: 4:00-9:00 Allowed Tools: Pocket Calculator, one A4 paper with notes

More information

Multiobjective PDE-constrained optimization using the reduced basis method

Multiobjective PDE-constrained optimization using the reduced basis method Multiobjective PDE-constrained optimization using the reduced basis method Laura Iapichino1, Stefan Ulbrich2, Stefan Volkwein1 1 Universita t 2 Konstanz - Fachbereich Mathematik und Statistik Technischen

More information

The estimation problem ODE stability The embedding method The simultaneous method In conclusion. Stability problems in ODE estimation

The estimation problem ODE stability The embedding method The simultaneous method In conclusion. Stability problems in ODE estimation Mathematical Sciences Institute Australian National University HPSC Hanoi 2006 Outline The estimation problem ODE stability The embedding method The simultaneous method In conclusion Estimation Given the

More information

Exam in TMA4180 Optimization Theory

Exam in TMA4180 Optimization Theory Norwegian University of Science and Technology Department of Mathematical Sciences Page 1 of 11 Contact during exam: Anne Kværnø: 966384 Exam in TMA418 Optimization Theory Wednesday May 9, 13 Tid: 9. 13.

More information

Part 5: Penalty and augmented Lagrangian methods for equality constrained optimization. Nick Gould (RAL)

Part 5: Penalty and augmented Lagrangian methods for equality constrained optimization. Nick Gould (RAL) Part 5: Penalty and augmented Lagrangian methods for equality constrained optimization Nick Gould (RAL) x IR n f(x) subject to c(x) = Part C course on continuoue optimization CONSTRAINED MINIMIZATION x

More information

SECOND-ORDER SUFFICIENT OPTIMALITY CONDITIONS FOR THE OPTIMAL CONTROL OF NAVIER-STOKES EQUATIONS

SECOND-ORDER SUFFICIENT OPTIMALITY CONDITIONS FOR THE OPTIMAL CONTROL OF NAVIER-STOKES EQUATIONS 1 SECOND-ORDER SUFFICIENT OPTIMALITY CONDITIONS FOR THE OPTIMAL CONTROL OF NAVIER-STOKES EQUATIONS fredi tröltzsch and daniel wachsmuth 1 Abstract. In this paper sufficient optimality conditions are established

More information

Department of Aerospace Engineering AE602 Mathematics for Aerospace Engineers Assignment No. 6

Department of Aerospace Engineering AE602 Mathematics for Aerospace Engineers Assignment No. 6 Department of Aerospace Engineering AE Mathematics for Aerospace Engineers Assignment No.. Find the best least squares solution x to x, x 5. What error E is minimized? heck that the error vector ( x, 5

More information

UC Berkeley Department of Electrical Engineering and Computer Science. EECS 227A Nonlinear and Convex Optimization. Solutions 5 Fall 2009

UC Berkeley Department of Electrical Engineering and Computer Science. EECS 227A Nonlinear and Convex Optimization. Solutions 5 Fall 2009 UC Berkeley Department of Electrical Engineering and Computer Science EECS 227A Nonlinear and Convex Optimization Solutions 5 Fall 2009 Reading: Boyd and Vandenberghe, Chapter 5 Solution 5.1 Note that

More information

Finite Elements for Magnetohydrodynamics and its Optimal Control

Finite Elements for Magnetohydrodynamics and its Optimal Control Finite Elements for Magnetohydrodynamics and its Karl Kunisch Marco Discacciati (RICAM) FEM Symposium Chemnitz September 25 27, 2006 Overview 1 2 3 What is Magnetohydrodynamics? Magnetohydrodynamics (MHD)

More information

Optimization and control of a separated boundary-layer flow

Optimization and control of a separated boundary-layer flow Optimization and control of a separated boundary-layer flow Journal: 2011 Hawaii Summer Conferences Manuscript ID: Draft lumeetingid: 2225 Date Submitted by the Author: n/a Contact Author: PASSAGGIA, Pierre-Yves

More information

Constrained Optimization and Lagrangian Duality

Constrained Optimization and Lagrangian Duality CIS 520: Machine Learning Oct 02, 2017 Constrained Optimization and Lagrangian Duality Lecturer: Shivani Agarwal Disclaimer: These notes are designed to be a supplement to the lecture. They may or may

More information

K. Krumbiegel I. Neitzel A. Rösch

K. Krumbiegel I. Neitzel A. Rösch SUFFICIENT OPTIMALITY CONDITIONS FOR THE MOREAU-YOSIDA-TYPE REGULARIZATION CONCEPT APPLIED TO SEMILINEAR ELLIPTIC OPTIMAL CONTROL PROBLEMS WITH POINTWISE STATE CONSTRAINTS K. Krumbiegel I. Neitzel A. Rösch

More information

Comparison of the Reduced-Basis and POD a-posteriori Error Estimators for an Elliptic Linear-Quadratic Optimal Control

Comparison of the Reduced-Basis and POD a-posteriori Error Estimators for an Elliptic Linear-Quadratic Optimal Control SpezialForschungsBereich F 3 Karl Franzens Universität Graz Technische Universität Graz Medizinische Universität Graz Comparison of the Reduced-Basis and POD a-posteriori Error Estimators for an Elliptic

More information

POD/DEIM 4DVAR Data Assimilation of the Shallow Water Equation Model

POD/DEIM 4DVAR Data Assimilation of the Shallow Water Equation Model nonlinear 4DVAR 4DVAR Data Assimilation of the Shallow Water Equation Model R. Ştefănescu and Ionel M. Department of Scientific Computing Florida State University Tallahassee, Florida May 23, 2013 (Florida

More information

Optimal Control. Lecture 18. Hamilton-Jacobi-Bellman Equation, Cont. John T. Wen. March 29, Ref: Bryson & Ho Chapter 4.

Optimal Control. Lecture 18. Hamilton-Jacobi-Bellman Equation, Cont. John T. Wen. March 29, Ref: Bryson & Ho Chapter 4. Optimal Control Lecture 18 Hamilton-Jacobi-Bellman Equation, Cont. John T. Wen Ref: Bryson & Ho Chapter 4. March 29, 2004 Outline Hamilton-Jacobi-Bellman (HJB) Equation Iterative solution of HJB Equation

More information

Optimization. Escuela de Ingeniería Informática de Oviedo. (Dpto. de Matemáticas-UniOvi) Numerical Computation Optimization 1 / 30

Optimization. Escuela de Ingeniería Informática de Oviedo. (Dpto. de Matemáticas-UniOvi) Numerical Computation Optimization 1 / 30 Optimization Escuela de Ingeniería Informática de Oviedo (Dpto. de Matemáticas-UniOvi) Numerical Computation Optimization 1 / 30 Unconstrained optimization Outline 1 Unconstrained optimization 2 Constrained

More information

10 Numerical methods for constrained problems

10 Numerical methods for constrained problems 10 Numerical methods for constrained problems min s.t. f(x) h(x) = 0 (l), g(x) 0 (m), x X The algorithms can be roughly divided the following way: ˆ primal methods: find descent direction keeping inside

More information

Joint work with Nguyen Hoang (Univ. Concepción, Chile) Padova, Italy, May 2018

Joint work with Nguyen Hoang (Univ. Concepción, Chile) Padova, Italy, May 2018 EXTENDED EULER-LAGRANGE AND HAMILTONIAN CONDITIONS IN OPTIMAL CONTROL OF SWEEPING PROCESSES WITH CONTROLLED MOVING SETS BORIS MORDUKHOVICH Wayne State University Talk given at the conference Optimization,

More information

Algorithms for nonlinear programming problems II

Algorithms for nonlinear programming problems II Algorithms for nonlinear programming problems II Martin Branda Charles University in Prague Faculty of Mathematics and Physics Department of Probability and Mathematical Statistics Computational Aspects

More information

Bang bang control of elliptic and parabolic PDEs

Bang bang control of elliptic and parabolic PDEs 1/26 Bang bang control of elliptic and parabolic PDEs Michael Hinze (joint work with Nikolaus von Daniels & Klaus Deckelnick) Jackson, July 24, 2018 2/26 Model problem (P) min J(y, u) = 1 u U ad,y Y ad

More information

Lecture 13: Constrained optimization

Lecture 13: Constrained optimization 2010-12-03 Basic ideas A nonlinearly constrained problem must somehow be converted relaxed into a problem which we can solve (a linear/quadratic or unconstrained problem) We solve a sequence of such problems

More information

Reduced-Hessian Methods for Constrained Optimization

Reduced-Hessian Methods for Constrained Optimization Reduced-Hessian Methods for Constrained Optimization Philip E. Gill University of California, San Diego Joint work with: Michael Ferry & Elizabeth Wong 11th US & Mexico Workshop on Optimization and its

More information

1. INTRODUCTION 2. PROBLEM FORMULATION ROMAI J., 6, 2(2010), 1 13

1. INTRODUCTION 2. PROBLEM FORMULATION ROMAI J., 6, 2(2010), 1 13 Contents 1 A product formula approach to an inverse problem governed by nonlinear phase-field transition system. Case 1D Tommaso Benincasa, Costică Moroşanu 1 v ROMAI J., 6, 2(21), 1 13 A PRODUCT FORMULA

More information

Taylor expansions for the HJB equation associated with a bilinear control problem

Taylor expansions for the HJB equation associated with a bilinear control problem Taylor expansions for the HJB equation associated with a bilinear control problem Tobias Breiten, Karl Kunisch and Laurent Pfeiffer University of Graz, Austria Rome, June 217 Motivation dragged Brownian

More information

Newton s Method. Ryan Tibshirani Convex Optimization /36-725

Newton s Method. Ryan Tibshirani Convex Optimization /36-725 Newton s Method Ryan Tibshirani Convex Optimization 10-725/36-725 1 Last time: dual correspondences Given a function f : R n R, we define its conjugate f : R n R, Properties and examples: f (y) = max x

More information

Reduced-Order Greedy Controllability of Finite Dimensional Linear Systems. Giulia Fabrini Laura Iapichino Stefan Volkwein

Reduced-Order Greedy Controllability of Finite Dimensional Linear Systems. Giulia Fabrini Laura Iapichino Stefan Volkwein Universität Konstanz Reduced-Order Greedy Controllability of Finite Dimensional Linear Systems Giulia Fabrini Laura Iapichino Stefan Volkwein Konstanzer Schriften in Mathematik Nr. 364, Oktober 2017 ISSN

More information

Lagrange duality. The Lagrangian. We consider an optimization program of the form

Lagrange duality. The Lagrangian. We consider an optimization program of the form Lagrange duality Another way to arrive at the KKT conditions, and one which gives us some insight on solving constrained optimization problems, is through the Lagrange dual. The dual is a maximization

More information

A Sobolev trust-region method for numerical solution of the Ginz

A Sobolev trust-region method for numerical solution of the Ginz A Sobolev trust-region method for numerical solution of the Ginzburg-Landau equations Robert J. Renka Parimah Kazemi Department of Computer Science & Engineering University of North Texas June 6, 2012

More information

12. Interior-point methods

12. Interior-point methods 12. Interior-point methods Convex Optimization Boyd & Vandenberghe inequality constrained minimization logarithmic barrier function and central path barrier method feasibility and phase I methods complexity

More information

ON TWO OPTIMAL CONTROL PROBLEMS FOR MAGNETIC FIELDS

ON TWO OPTIMAL CONTROL PROBLEMS FOR MAGNETIC FIELDS ON TWO OPTIMAL CONTROL PROBLEMS FOR MAGNETIC FIELDS SERGE NICAISE, SIMON STINGELIN, AND FREDI TRÖLTZSCH Abstract. Two optimal control problems for instationary magnetization processes are considered in

More information

Real-time Constrained Nonlinear Optimization for Maximum Power Take-off of a Wave Energy Converter

Real-time Constrained Nonlinear Optimization for Maximum Power Take-off of a Wave Energy Converter Real-time Constrained Nonlinear Optimization for Maximum Power Take-off of a Wave Energy Converter Thomas Bewley 23 May 2014 Southern California Optimization Day Summary 1 Introduction 2 Nonlinear Model

More information

A GLOBALLY CONVERGENT STABILIZED SQP METHOD: SUPERLINEAR CONVERGENCE

A GLOBALLY CONVERGENT STABILIZED SQP METHOD: SUPERLINEAR CONVERGENCE A GLOBALLY CONVERGENT STABILIZED SQP METHOD: SUPERLINEAR CONVERGENCE Philip E. Gill Vyacheslav Kungurtsev Daniel P. Robinson UCSD Center for Computational Mathematics Technical Report CCoM-14-1 June 30,

More information

1 Computing with constraints

1 Computing with constraints Notes for 2017-04-26 1 Computing with constraints Recall that our basic problem is minimize φ(x) s.t. x Ω where the feasible set Ω is defined by equality and inequality conditions Ω = {x R n : c i (x)

More information

You should be able to...

You should be able to... Lecture Outline Gradient Projection Algorithm Constant Step Length, Varying Step Length, Diminishing Step Length Complexity Issues Gradient Projection With Exploration Projection Solving QPs: active set

More information

On sequential optimality conditions for constrained optimization. José Mario Martínez martinez

On sequential optimality conditions for constrained optimization. José Mario Martínez  martinez On sequential optimality conditions for constrained optimization José Mario Martínez www.ime.unicamp.br/ martinez UNICAMP, Brazil 2011 Collaborators This talk is based in joint papers with Roberto Andreani

More information

Approximation of the Linearized Boussinesq Equations

Approximation of the Linearized Boussinesq Equations Approximation of the Linearized Boussinesq Equations Alan Lattimer Advisors Jeffrey Borggaard Serkan Gugercin Department of Mathematics Virginia Tech SIAM Talk Series, Virginia Tech, April 22, 2014 Alan

More information

A Review of Preconditioning Techniques for Steady Incompressible Flow

A Review of Preconditioning Techniques for Steady Incompressible Flow Zeist 2009 p. 1/43 A Review of Preconditioning Techniques for Steady Incompressible Flow David Silvester School of Mathematics University of Manchester Zeist 2009 p. 2/43 PDEs Review : 1984 2005 Update

More information

Algorithms for Constrained Optimization

Algorithms for Constrained Optimization 1 / 42 Algorithms for Constrained Optimization ME598/494 Lecture Max Yi Ren Department of Mechanical Engineering, Arizona State University April 19, 2015 2 / 42 Outline 1. Convergence 2. Sequential quadratic

More information

1. Introduction. In this work we consider the solution of finite-dimensional constrained optimization problems of the form

1. Introduction. In this work we consider the solution of finite-dimensional constrained optimization problems of the form MULTILEVEL ALGORITHMS FOR LARGE-SCALE INTERIOR POINT METHODS MICHELE BENZI, ELDAD HABER, AND LAUREN TARALLI Abstract. We develop and compare multilevel algorithms for solving constrained nonlinear variational

More information

An Inexact Newton Method for Optimization

An Inexact Newton Method for Optimization New York University Brown Applied Mathematics Seminar, February 10, 2009 Brief biography New York State College of William and Mary (B.S.) Northwestern University (M.S. & Ph.D.) Courant Institute (Postdoc)

More information

Convex Optimization. Prof. Nati Srebro. Lecture 12: Infeasible-Start Newton s Method Interior Point Methods

Convex Optimization. Prof. Nati Srebro. Lecture 12: Infeasible-Start Newton s Method Interior Point Methods Convex Optimization Prof. Nati Srebro Lecture 12: Infeasible-Start Newton s Method Interior Point Methods Equality Constrained Optimization f 0 (x) s. t. A R p n, b R p Using access to: 2 nd order oracle

More information