Model Reduction (Approximation) of Large-Scale Systems. Introduction, motivating examples and problem formulation Lecture 1

Similar documents
Fluid flow dynamical model approximation and control

Large-scale and infinite dimensional dynamical systems approximation

Model Reduction for Unstable Systems

Infinite dimensional model analysis through data-driven interpolatory techniques

H 2 optimal model approximation by structured time-delay reduced order models

arxiv: v1 [cs.sy] 17 Nov 2015

BALANCING-RELATED MODEL REDUCTION FOR DATA-SPARSE SYSTEMS

Model reduction of large-scale dynamical systems

CME 345: MODEL REDUCTION

MODEL REDUCTION BY A CROSS-GRAMIAN APPROACH FOR DATA-SPARSE SYSTEMS

Approximation of the Linearized Boussinesq Equations

Stability preserving post-processing methods applied in the Loewner framework

H 2 optimal model reduction - Wilson s conditions for the cross-gramian

Krylov-Subspace Based Model Reduction of Nonlinear Circuit Models Using Bilinear and Quadratic-Linear Approximations

AN OVERVIEW OF MODEL REDUCTION TECHNIQUES APPLIED TO LARGE-SCALE STRUCTURAL DYNAMICS AND CONTROL MOTIVATING EXAMPLE INVERTED PENDULUM

Krylov Techniques for Model Reduction of Second-Order Systems

Iterative Rational Krylov Algorithm for Unstable Dynamical Systems and Generalized Coprime Factorizations

System Identification by Nuclear Norm Minimization

Robust Multivariable Control

Model reduction of large-scale systems

FEL3210 Multivariable Feedback Control

An iterative SVD-Krylov based method for model reduction of large-scale dynamical systems

An iterative SVD-Krylov based method for model reduction of large-scale dynamical systems

An iterative SVD-Krylov based method for model reduction of large-scale dynamical systems

Model reduction of large-scale systems by least squares

Model reduction of interconnected systems

ME 234, Lyapunov and Riccati Problems. 1. This problem is to recall some facts and formulae you already know. e Aτ BB e A τ dτ

Semidefinite Programming Duality and Linear Time-invariant Systems

NDI-BASED STRUCTURED LPV CONTROL A PROMISING APPROACH FOR AERIAL ROBOTICS

Model reduction via tangential interpolation

Gramian Based Model Reduction of Large-scale Dynamical Systems

Parallel Model Reduction of Large Linear Descriptor Systems via Balanced Truncation

Model reduction for linear systems by balancing

Fourier Model Reduction for Large-Scale Applications in Computational Fluid Dynamics

Lecture 2: Linear Algebra Review

The rational Krylov subspace for parameter dependent systems. V. Simoncini

Adaptive rational Krylov subspaces for large-scale dynamical systems. V. Simoncini

Implicit Volterra Series Interpolation for Model Reduction of Bilinear Systems

Model reduction of large-scale systems

Model Reduction of Inhomogeneous Initial Conditions

ẋ n = f n (x 1,...,x n,u 1,...,u m ) (5) y 1 = g 1 (x 1,...,x n,u 1,...,u m ) (6) y p = g p (x 1,...,x n,u 1,...,u m ) (7)

Scientific Computing

Introduction to Model Order Reduction

be a Householder matrix. Then prove the followings H = I 2 uut Hu = (I 2 uu u T u )u = u 2 uut u

H 2 -optimal model reduction of MIMO systems

Two-sided Eigenvalue Algorithms for Modal Approximation

Module 09 From s-domain to time-domain From ODEs, TFs to State-Space Modern Control

Passivity Preserving Model Reduction for Large-Scale Systems. Peter Benner.

SiMpLIfy: A Toolbox for Structured Model Reduction

Projection of state space realizations

Pseudospectra and Nonnormal Dynamical Systems

Chris Beattie and Serkan Gugercin

Model reduction of large-scale systems

Control Systems Design

Efficient Implementation of Large Scale Lyapunov and Riccati Equation Solvers

Model Reduction for Linear Dynamical Systems

Comparison of Model Reduction Methods with Applications to Circuit Simulation

Institut für Mathematik

Inexact Solves in Krylov-based Model Reduction

Lecture 2. Linear Systems

STA141C: Big Data & High Performance Statistical Computing

Data Analysis and Manifold Learning Lecture 2: Properties of Symmetric Matrices and Examples

Model Order Reduction of Continuous LTI Large Descriptor System Using LRCF-ADI and Square Root Balanced Truncation

forms Christopher Engström November 14, 2014 MAA704: Matrix factorization and canonical forms Matrix properties Matrix factorization Canonical forms

Model reduction of coupled systems

Control Systems Design

Balancing-Related Model Reduction for Large-Scale Systems

Krylov Subspace Methods for Nonlinear Model Reduction

Lecture notes: Applied linear algebra Part 1. Version 2

6.241 Dynamic Systems and Control

The Singular Value Decomposition

Model reduction of large-scale systems

Introduction to Model Order Reduction

Optimal Approximation of Dynamical Systems with Rational Krylov Methods. Department of Mathematics, Virginia Tech, USA

Lecture 11: CMSC 878R/AMSC698R. Iterative Methods An introduction. Outline. Inverse, LU decomposition, Cholesky, SVD, etc.

Numerical Linear Algebra

3 Gramians and Balanced Realizations

Balanced Truncation 1

A POD Projection Method for Large-Scale Algebraic Riccati Equations

Large Scale Data Analysis Using Deep Learning

The model reduction algorithm proposed is based on an iterative two-step LMI scheme. The convergence of the algorithm is not analyzed but examples sho

Gramians of structured systems and an error bound for structure-preserving model reduction

Data Mining Lecture 4: Covariance, EVD, PCA & SVD

CME 345: MODEL REDUCTION - Projection-Based Model Order Reduction

Realization-independent H 2 -approximation

1 Singular Value Decomposition and Principal Component

DESIGN OF OBSERVERS FOR SYSTEMS WITH SLOW AND FAST MODES

Case study: Approximations of the Bessel Function

Solving linear equations with Gaussian Elimination (I)

Upper and Lower Bounds of Frequency Interval Gramians for a Class of Perturbed Linear Systems Shaker, Hamid Reza

Linear Algebra in Actuarial Science: Slides to the lecture

Problem set 5 solutions 1

Lecture 4: Analysis of MIMO Systems

Rational Krylov Methods for Model Reduction of Large-scale Dynamical Systems

Model order reduction of large-scale dynamical systems with Jacobi-Davidson style eigensolvers

Factorized Solution of Sylvester Equations with Applications in Control

Numerical Methods - Numerical Linear Algebra

Rational Krylov methods for linear and nonlinear eigenvalue problems

Passive Interconnect Macromodeling Via Balanced Truncation of Linear Systems in Descriptor Form

Matrices A brief introduction

Transcription:

Lecture outines Motivating examples Norm and linear algebra reminder Introduction Summary Model Reduction (Approximation) of Large-Scale Systems Introduction, motivating examples and problem formulation Lecture 1 C. Poussot-Vassal, P. Vuillemin & I. Pontes Duff EDSYS, April 4-7th, 2016 (Toulouse, France) Case 1 u(f ) = [u(f1 )... u(fi )] y(f ) = [y(f1 )... y(fi )] Case 2 E x (t) = Ax(t) + Bu(t) y(t) = Cx(t) + Du(t) Case 3 H(s) = e τ s Σ (A, B, C, D)i Data more AP + P AT + BB T = 0 Σ WTV Kr (A, B) model reduction toolbox Σ (A, B, C, D )i C. Poussot-Vassal, P. Vuillemin & I. Pontes Duff [Onera - DCSD] DAE/ODE State x(t) Rn, n large or infinite Reduced DAE/ODE Reduced state x (t) Rr with r n (+) Simulation (+) Analysis (+) Control (+) Optimization Model Reduction (Approximation) of Large-Scale Systems

Lecture outines Practical aspects Schedule & outlines References Outlines Motivating examples Norm and linear algebra reminder Introduction Summary

Practical aspects Lecture outines Practical aspects Lecture (14 hours) and two Labs (6 hours). The lecture is addressed to people with basic knowledge in dynamical systems and linear algebra (e.g. Master, Engineer or Ph.D. degree). Motivation (sketch) & objective Provide an overview of the model reduction problem within the LTI case Present theoretical ideas (classical and advanced techniques) Present practical issues Provide practical illustration (by means of 2 Matlab-based Labs) Introduce recent advances within model approximation Provide numerical tools Material provided: slides, references and numerical tools (MORE toolbox).

Day 1 Lecture outines Schedule & outlines 14h-17h - Lecture (Introduction) Introduction, motivating examples, linear algebra and model reduction problem Overview of the approximation methods

Day 2 9h-12h - Lecture (Realization-based I) Gramian, SVD and modal techniques Moment matching and Krylov subspaces techniques Lecture outines Schedule & outlines 14h-17h - Lab 1 Application of the SVD techniques, the Arnoldi procedure and Krylov subspace

40 50 60 70 80 90 Bode Diagram 100 0 10 101 102 103 Frequency (rad/sec) Day 3 9h-12h - Lecture (Realization-based II) Generalized Krylov subspaces, tangential interpolation techniques H 2 model approximation : projection point of view H 2 model approximation : optimization point of view Lecture outines Schedule & outlines 14h-17h - Lecture (Realization free and delay structured reduced order models) The Loewner framework Application to delay and irrational dynamical models 1 0.95 0.9 H 2 norm error 0.85 0.8 Magnitude (db) 0.75 0.7 15 10 5 Real(λ) 0 0 5 10 15 20 25 30 35 40 Im(λ)

Day 4 Lecture outines Schedule & outlines 9h-12h - Lab 2 Generalized Krylov subspaces techniques and glimpse of the MORE Toolbox 14h-16h - Lecture (Further issues, discussion and tools) Applications on industrial and academic use cases Overview of the lecture, tools and discussions Σ (A, B, C, D)i Σ more AP + P A T + BB T = 0 model reduction toolbox W T V Kr(A, B) ˆΣ (Â, ˆB, Ĉ, ˆD)i

Some relevant references (numerical & control communities) This course has been largely inspired from Thanos Antoulas, RICE University slides David Amsallem & Charbel Farhat, Stanford University slides Matthias Kawski, Matlab examples Thanos Antoulas, Approximation of Large Scale Dynamical Systems Yousef Saad, Iterative methods for sparse linear systems (2nd edition) Lecture outines References PhDs Grimme (1997), Gugercin (2003), Vuillemin (2014) Articles Wilson (1974), Moore (1981), Ruhe (1994), Helmersson (1994), Boley (1994), Lehoucq (1996), Ebihara (2004), Gallivan (2006), Gugercin (2008), Simoncini (2009), Van Dooren (2010), Poussot-Vassal (2010-2011), Vuillemin (2012-2013)

Lecture outines Motivating examples Norm and linear algebra reminder Introduction Summary Lecture outines References1 MOdel REduction toolbox I It s a MATLAB toolbox (tested on Matlab 2010Rb), I Aim at approximating medium(large)-scale and infinite dimensional LTI models I http://w3.onera.fr/more/ Case 1 u(f ) = [u(f1 )... u(fi )] y(f ) = [y(f1 )... y(fi )] Case 2 E x (t) = Ax(t) + Bu(t) y(t) = Cx(t) + Du(t) Case 3 H(s) = e τ s Σ (A, B, C, D)i Data more AP + P AT + BB T = 0 Σ WTV Kr (A, B) model reduction toolbox Σ (A, B, C, D )i DAE/ODE State x(t) Rn, n large or infinite Reduced DAE/ODE Reduced state x (t) Rr with r n (+) Simulation (+) Analysis (+) Control (+) Optimization 1 C. Poussot-Vassal and P. Vuillemin, "Introduction to MORE: a MOdel REduction Toolbox", in Proceedings of the IEEE Multi-conference on Systems and Control, Dubrovnik, Croatia, October, 2012, pp. 776-781. C. Poussot-Vassal, P. Vuillemin & I. Pontes Duff [Onera - DCSD] Model Reduction (Approximation) of Large-Scale Systems

Lecture outines Outlines Motivating examples Problem statement and scope Building CD player ISS space station Clamped beam system Fluid dynamics Weather forecasting system Very large scale integration system River system Biological system Aerospace and... connection with control engineer problems Norm and linear algebra reminder Introduction Summary

Motivating examples Problem statement and scope Digitalization and computer-based modeling and studies are crucial steps for any system, concept or physical phenomena understanding. Problem: numerical dynamical models are too complex and parameter dependent Finite machine precision, computational burden and memory management: induces important time consumption generate inaccurate results Actual numerical tools limit the use of class and complexity models

Motivating examples Problem statement and scope Solution: provide robust and efficient numerical tools to simplify dynamical models The main objectives are to save time and improve quality, by (T) speeding up simulation time and reducing computation burden (Q) enhancing simulation accuracy and in memory management and extend scope, by (S) tailoring larger and more complex dynamical model class to standard tools Input-output frequency data Finite order large-scale linear model Σ more AP + P A T + BB T = 0 Σ (A, B, C, D)i model reduction toolbox W T V Kr(A, B) ˆΣ (Â, ˆB, Ĉ, ˆD)i A reduced-order linear dynamical system Infinite order linear model

80 70 60 50 40 30 20 10 0 10 Bode Diagram 20 2 10 10 1 100 101 102 Frequency (rad/sec) Motivating examples Problem statement and scope 2 How is it possible to approximate a linear dynamical system of large order with a lower order one which can be used in place for simulation/control/analysis...? Magnitude (db) Widely used in mechanical engineering (e.g. civilian, MEMS, aeronautics...) Model of 348 states 2 F. Leibfritz, "COMPl eib, COnstraint Matrix-optimization Problem LIbrary - a collection of test examples for nonlinear semidefinite programs, control system design and related problems", Universitat Trier, Tech. Rep., 2003.

Bode Diagram Frequency (rad/s) Motivating examples Problem statement and scope 2 How is it possible to approximate a linear dynamical system of large order with a lower order one which can be used in place for simulation/control/analysis...? 80 70 Original (n=348) Reduced (r=16) 60 50 Magnitude (db) 40 30 20 10 0 10 20 10 2 10 1 10 0 10 1 10 2 Widely used in mechanical engineering (e.g. civilian, MEMS, aeronautics...) Model of 348 states approximated with a model of 16 states ( 1/20) Objective: provide methods & tool for engineers & researchers 2 F. Leibfritz, "COMPl eib, COnstraint Matrix-optimization Problem LIbrary - a collection of test examples for nonlinear semidefinite programs, control system design and related problems", Universitat Trier, Tech. Rep., 2003.

Motivating examples Problem statement and scope % R e d u c t i o n o r d e r o b j e c t i v e r = 1 6 ; % Load COMPleib model and c o n s t r u c t t h e s t a t e s p a c e model name = CBM ; [ A, B1, B, C1, C, D11, D12, D21, nx, nw, nu, nz, ny ] = COMPleib ( name ) ; s y s = s s (A, B, C, 0 ) ; % Balanced T r u n c a t i o n ( Robust C o n t r o l Toolbox, Matlab ) sysbt = r e d u c e ( sys, r ) ; % ITIA ( u s i n g t h e COMPleib name as i n p u t ) opt. r e s t a r t = 0 ; [ s y s I T I A, out ] = morelti ( name, r, ITIA, opt ) ;» startexamplelecture1_1

40 50 60 70 80 90 Bode Diagram 100 0 10 101 102 103 Frequency (rad/sec) Lecture outines Motivating examples Norm and linear algebra reminder Introduction Summary Motivating examples Building Magnitude (db) Obj Earthquake prevention, structure weight reduction Mass damper like models Los-Angeles Hospital building model: 1 input, 1 output, n = 48

200 150 100 50 0 50 100 150 200 100 50 0 50 100 150 200 From: In(1) Bode Diagram 0 10 102 104 106 Frequency (rad/sec) From: In(2) 0 10 102 104 106 Lecture outines Motivating examples Norm and linear algebra reminder Introduction Summary Motivating examples CD player To: Out(2) Magnitude (db) To: Out(1) Obj Understand and optimize mechanical systems, control the reading optics Electro-mechanical model (DVD, CD-player, HDD,...) CD model: 2 inputs, 2 outputs, n = 120

Lecture outines Motivating examples Norm and linear algebra reminder Introduction Summary Motivating examples ISS space station Bode Diagram From: In(1) From: In(2) From: In(3) 0 To: Out(1) 50 100 150 200 To: Out(2) Magnitude (db) 0 50 100 150 200 0 To: Out(3) 50 100 150 200 1 10 0 10 1 10 2 10 3 10 1 10 0 10 1 10 Frequency (rad/sec) 2 10 3 10 1 10 0 10 1 10 2 10 3 10 Obj Control a flexible structure of the ISS station modules (due to solar panels...) I Structural model with 60 vibration modes I ISS model: 3 inputs, 3 outputs, n = 270 C. Poussot-Vassal, P. Vuillemin & I. Pontes Duff [Onera - DCSD] Model Reduction (Approximation) of Large-Scale Systems

80 70 60 50 40 30 20 10 0 10 Bode Diagram 20 2 10 10 1 100 101 102 Frequency (rad/sec) Lecture outines Motivating examples Norm and linear algebra reminder Introduction Summary Motivating examples Clamped beam system Magnitude (db) Obj Control of flexible structures Elastic model present in MEMS, industry Beam model: 1 inputs, 1 outputs, n = 348

Motivating examples Fluid dynamics 50 Bode diagram 40 30 Gain [db] 20 10 0 MORE toolbox (20 states, obtained in 1h20) 10 Original model (678735 states) Optimal interpolation points 10 0 10 1 ω [rad/s] Obj Control and simulate fluid mechanical systems (video) Discretisation of Navier Stoke equations at varying Reynolds numbers LTI model: 1 inputs, 1 outputs, n = 750, 000

Motivating examples Weather forecasting system Obj Prediction of natural dynamical events and related security issues Model obtained from discretization of PDEs Model adjustment by simulation and refinement, Riccati equations, optimal sensor positioning

Motivating examples Very large scale integration system Obj Intensive simulations are required to verify that internal electromagnetic fields do not significantly delay or distort circuit signals. Discretized Maxwell equations / RLC structure Interconnected, DAE, passivity

Motivating examples River system Obj Electricity management, water regulation Distributed systems, delays, parameter varying Saint Venant equations: 2 inputs, 1 output, n =

Motivating examples Biological system Obj Evaluate and control cell proliferation dynamics Markovian process No input, 1 output, n 10 9

Motivating examples Within aircraft manufacturer, models are built using finite elements methods, dynamical properties are adjusted for every mass cases, flight points, and finally adjustments are achieved with wind tunnel test. Aerospace Obj Control, reduce weight, analyze... Models rigid, flexible, aerodynamical delay dynamics Models are scattered and state space is partly/poorly known

Simulation Memory management, ODE solvers "Passive" optimization of dynamical systems Motivating examples and... connection with control engineer problems Observers / controllers Observer / Controller design: robust, optimal, predictive,... are numerical based techniques (e.g. involve SDP, LMI, nonlinear optimization, Riccati) LPV, LFT formulation enhance even more these problems H (iterative, Hamiltonian matrix) H 2 (Lyapunov equations) norms computation

Motivating examples and... connection with control engineer problems 3 Analysis H computation,... no eigenvalues along the imaginary axis of (with D = 0) [ ] A γbb T H(A, B, C, γ) = γc T C A T (1) Stability via Lyapunov and also... Eigenvalue, Kalman filter design Data mining (process quality, pertinent data) Learning Image compression 3 S. Boyd, V. Balakrishnan and A. Kabamka, "On computing the H norm of a transfer matrix", in Proceedings of the American Control Conference, Atlanta, Georgia, June 1988, pp.396-397.

Motivating examples and... connection with control engineer problems Original 10 0 50 100 10 1 150 200 250 300 σ k /σ max 10 2 10 3 350 400 100 200 300 400 500 600 700 10 4 10 2 10 1 10 0 k/n Truncation ratio k/n: 0.015, with error of 0.049 Truncation ratio k/n: 0.051, with error of 0.013 50 50 100 100 150 150 200 200 250 250 300 300 350 350 400 100 200 300 400 500 600 700 400 100 200 300 400 500 600 700 Trade-off between accuracy and complexity» funimagesvanalysis( airplane.jpg,[.05.1.2.5], gray )

Lecture outines Outlines Motivating examples Norm and linear algebra reminder H -norm H 2 -norm H 2,Ω -norm Matrix factorisation Introduction Summary

Definition: H -norm The H -norm of a n-th order stable system H(s) is given as, Norm and linear algebra reminder H -norm H H := sup σ (H(jω)) := ω R z 2 (2) max w L 2 w 2

Interpretation of the H -norm Norm and linear algebra reminder H -norm Physically, the H -norm of a SISO system describes the maximum value of the of its frequency response over the entire spectrum. In other words, it is the largest gain if the system is fed by harmonic input signal. 30 Bode Diagram Magnitude (db) 20 10 0 10 1 H(s) = s 2 + 0.1s + 1 10.0125 20 30 40 10 1 10 0 10 1 Frequency (rad/s)

Definition: H 2 -norm Norm and linear algebra reminder H 2-norm The H 2 -norm of a n-th order strictly proper stable system H(s) is given as, ( 1 ( ) H 2 H 2 := trace H(iν)H T (iν) dν) 2π ( ) (3) 1 := trace H(iν) 2 F 2π dν

Interpretation of the H 2 -norm Norm and linear algebra reminder H 2-norm Physically, the H 2 norm of a SISO system describes the integral of its frequency response over the entire spectrum. 30 Bode Diagram 20 Magnitude (db) 10 0 10 1 H(s) = s 2 + 0.1s + 1 2.2361 20 30 40 10 1 10 0 10 1 Frequency (rad/s)

Definition: H 2,Ω -norm (e.g. Ω = [ ω ω]) Norm and linear algebra reminder H 2,Ω -norm The H 2,Ω -norm of a n-th order proper stable system H(s) is given as, ( 1 ( ) H 2 H 2,Ω := trace H(iν)H T (iν) dν) 2π ( Ω ) (4) 1 := trace H(iν) 2 F 2π dν Ω

Interpretation of the H 2,Ω -norm Norm and linear algebra reminder Physically, the H 2,Ω norm of a SISO system describes the integral of its frequency response over the limited spectrum Ω. H 2,Ω -norm 30 Bode Diagram 20 Magnitude (db) 10 0 10 1 H(s) = s 2 + 0.1s + 1 2.1914 20 30 40 10 1 10 0 10 1 Frequency (rad/s)

Norm and linear algebra reminder Matrix factorisation Frobenius norm, norm The Frobenius norm A F is given as, A F = min(m,n) σi trace(aa 2 = T ) (5) i=1 (quite easy to compute)

SVD factorization, svd Decompose a matrix A such as, A = UΣV T R n m Norm and linear algebra reminder Σ = diag(σ 1,..., σ n), are the singular values (with σ 1 σ n) U = (u 1,..., u n), UU T = I n are the left singular vectors V = (v 1,..., v m), V V T = I m are the right singular vectors Matrix factorisation

LU factorization, lu Decompose a matrix A into a lower L and upper U matrix. A = LU Very useful to solve Ax = b, such as, Norm and linear algebra reminder Matrix factorisation L(Ux) = b (6) then, let y = Ux, solve Ly = b (7) y elements are successively founded. det(a) = det(l) det(u)

Cholesky factorization, chol Decompose a positive definite matrix A such as, A = LL T L, lower Norm and linear algebra reminder Very useful to compute A 1, to solve Ax = b, Lyapunov equations (AP + P A T + BB T = 0, with P positive definite) Matrix factorisation

QR factorization, qr Decompose a matrix A such as, A = QR Norm and linear algebra reminder Matrix factorisation Q is orthogonal (i.e. QQ T = Q T Q = I and Q T = Q 1 ) and R is upper triangular Basis of eigenvalue problems The first k columns of Q form an orthonormal basis for the span of the first k columns of A for any 1 k n

Norm and linear algebra reminder Matrix factorisation Eigenvalues factorization, eig or eigs Given a square matrix A R n n, the left / right eigenvectors and eigenvalues AR = RΛ LA = ΛL Λ = diag(λ 1,..., λ n) (8) Present in MANY control engineer problems

... e.g. Sylvester equation solver Find X, is equivalent to, solve the eigenvalue problem: [ ] [ ] A M V1 0 H V 2 Norm and linear algebra reminder Matrix factorisation AX + XH + M = 0 (9) [ ] V1 = Z (10) V 2 Indeed, we have: { AV1 + MV 2 = V 1 Z HV 2 = V 2 Z thus, AV 1 + MV 2 = V 1 V 1 2 HV 2 AV 1 + MV 2 + V 1 V 1 2 HV 2 = 0 AV 1 V 1 2 + V 1 V 1 2 H + M }{{}}{{} = 0 X X (11) (12)

Definition: Singular Value Decomposition Norm and linear algebra reminder Given a matrix A n m, its singular value decomposition is defined as follows: Matrix factorisation A = UΣV T where Σ = diag(σ 1,..., σ n) R n m (13) where σ 1 (A) σ n(a) 0 are the singular values and the columns of the orthogonal matrices U = (u 1,..., u n) and V = (v 1,..., v m) are the left and right singular vector of A respectively. SVD provides a measure of the energy (or information) repartition of a matrix. σ 1 (A) is the 2-induced norm of A. The SVD induces the Dyadic decomposition of A: A = σ 1 u 1 v1 T + σ 2u 2 v2 T + + σrurvt r (14) with rank(a) = r.

Lecture outines Outlines Motivating examples Norm and linear algebra reminder Introduction The big picture and classification of the linear system problems Case 1: Data-based model approximation Case 2: The realization-based LTI model approximation Case 3: Realization free model approximation Linear model approximation objective Summary

Lecture outines Motivating examples Norm and linear algebra reminder Introduction Summary Introduction The big picture and classification of the linear system problems Case 1 u(f ) = [u(f1 )... u(fi )] y(f ) = [y(f1 )... y(fi )] Case 2 E x (t) = Ax(t) + Bu(t) y(t) = Cx(t) + Du(t) Case 3 H(s) = e τ s Data DAE/ODE State x(t) Rn, n large or infinite Reduced DAE/ODE Reduced state x (t) Rr with r n (+) Simulation (+) Analysis (+) Control (+) Optimization C. Poussot-Vassal, P. Vuillemin & I. Pontes Duff [Onera - DCSD] Model Reduction (Approximation) of Large-Scale Systems

AP + P A T + BB T = 0 W T V Kr(A, B) ˆΣ (Â, ˆB, Ĉ, ˆD)i Introduction The big picture and classification of the linear system problems u 1(.) u 2(.). u nu (.) Dynamical system H x 1(.) x 2(.). x n(.) y 1(.) y 2(.). y ny (.) Case 1 Data-driven case: u i (.), and y i (.) are given (marginally treated in this lecture) Case 2 Finite order case: (E, A, B, C, D) is given (first part of the course) Case 3 Infinite order case: H(s) is given (second part of the course) Input-output frequency data Finite order large-scale linear model Σ (A, B, C, D)i Σ more model reduction toolbox A reduced-order linear dynamical system Infinite order linear model

AP + P A T + BB T = 0 model reduction toolbox W T V Kr(A, B) ˆΣ (Â, ˆB, Ĉ, ˆD)i Introduction Case 1: Data-based model approximation Input-output frequency data Finite order large-scale linear model Σ (A, B, C, D)i Σ more A reduced-order linear dynamical system Infinite order linear model Given a the {ω i, H(ω i )} set obtained from experiments or simulation Find a finite order model that matches the data From gust disturbance 20 Acceleration (db) 15 10 5 0 5 (Q) Optimal model found, that interpolates all the measured points (S) Tailored to Multi Input Multi Output models Model obtained in few seconds 10 15 20 WT experimental data MORE toolbox 10 20 30 40 50 60 70 80 90 100 Frequency (Hz)

AP + P A T + BB T = 0 model reduction toolbox W T V Kr(A, B) ˆΣ (Â, ˆB, Ĉ, ˆD)i Introduction Case 2: The realization-based LTI model approximation Input-output frequency data Finite order large-scale linear model Σ (A, B, C, D)i Σ more A reduced-order linear dynamical system Infinite order linear model Given a large-scale linear dynamical realization of a long range aircraft Find a simpler model that well reproduces the complex one Mismatch error (over a limited frequency range) 10 1 MATLAB MORE toolbox (T) Save engineer time in analysis, controller design, optimization (Q) Accuracy of 90% with a 97% simpler model (36 instead of 1700 states) Outperforms precision of commercial tools 10 15 20 25 30 35 40 45 50 Approximation order, r

AP + P A T + BB T = 0 model reduction toolbox W T V Kr(A, B) ˆΣ (Â, ˆB, Ĉ, ˆD)i Introduction Case 3: Realization free model approximation Input-output frequency data Finite order large-scale linear model Σ (A, B, C, D)i Σ more A reduced-order linear dynamical system Infinite order linear model Given an infinite dimensional, irrational and delay dependent model Find a low order model simpler to simulate and analyse From q e to z(s,q) From q s to z(s,q) 45 40 z [db] 50 55 60 65 70 200 10 4 700 10 2 1400 ω [rad/s] Q [m 3 /s] From q to z(s,q) e 45 z [db] 50 60 70 80 200 10 4 700 10 2 1400 ω [rad/s] Q [m 3 /s] From q to z(s,q) s 40 (T) Simulation velocity increased with a factor of 100, reducing optimization steps (Q) Accuracy close to 95% with a complexity of 8 equations (instead of PDE) (S) Allows to transform infinite to finite model z [db] 50 55 60 65 z [db] 50 60 70 70 200 700 1400 Q [m 3 /s] 10 2 ω [rad/s] 10 4 80 200 700 1400 Q [m 3 /s] 10 2 ω [rad/s] 10 4

Introduction Linear model approximation objective Let us consider H, a n u inputs, n y outputs linear dynamical system described by the complex-valued function of order n (n large or ) H : C C ny nu, (15)

Introduction Linear model approximation objective Let us consider H, a n u inputs, n y outputs linear dynamical system described by the complex-valued function of order n (n large or ) H : C C ny nu, (15) the model approximation problem consists in finding Ĥ of order r n that well reproduces the input-output behaviour of H. Ĥ : C C ny nu, (16) u1(.) u2(.). unu (.) Dynamical system H x1(.) x2(.). xn(.) y1(.) y2(.). yny (.) u1(.) u2(.). unu (.) Dynamical system Ĥ ˆx1(.) ˆx2(.). ˆxr(.) y1(.) y2(.). yny (.)

Introduction Linear model approximation objective (with realization) Let us consider H, a n u inputs, n y outputs linear dynamical system described by the complex-valued function of order n (n large or ) H : C C ny nu, (17) the model approximation problem consists in finding Ĥ of order r n with a given realization e.g. Ĥ : C C ny nu, (18) { Ê ˆx(t) = ˆx(t) + Ĥ : ˆBu(t) ŷ(t) = Ĉ ˆx(t) + ˆDu(t), (19) that well reproduces the input-output behaviour of H.

Introduction Linear model approximation objective (with realization) Let us consider H, a n u inputs, n y outputs linear dynamical system described by the complex-valued function of order n (n large or ) H : C C ny nu, (17) the model approximation problem consists in finding Ĥ of order r n with a given realization e.g. Ĥ : C C ny nu, (18) { Ê ˆx(t) = ˆx(t) + Ĥ : ˆBu(t) ŷ(t) = Ĉ ˆx(t) + ˆDu(t), (19) that well reproduces the input-output behaviour of H. "Well reproduce..."? Ĥ is a "good" approximation of H if E(t) = y(t) ŷ(t) is "small"

Lecture outines Outlines Motivating examples Norm and linear algebra reminder Introduction Summary The big picture Approximation objectives

Lecture outines Motivating examples Norm and linear algebra reminder Introduction Summary Summary The big picture Case 1 u(f ) = [u(f1 )... u(fi )] y(f ) = [y(f1 )... y(fi )] Case 2 E x (t) = Ax(t) + Bu(t) y(t) = Cx(t) + Du(t) Case 3 H(s) = e τ s Data DAE/ODE State x(t) Rn, n large or infinite Reduced DAE/ODE Reduced state x (t) Rr with r n (+) Simulation (+) Analysis (+) Control (+) Optimization C. Poussot-Vassal, P. Vuillemin & I. Pontes Duff [Onera - DCSD] Model Reduction (Approximation) of Large-Scale Systems

Mismatch error Summary Approximation objectives 4 5 6 7 Ĥ := argmin G H 2 dim(g) = r n H G H2 (20) ( 1 H 2 H 2 := trace 2π ( 1 := trace 2π ( H(iν)H T (iν) ) dν) ) (21) H(iν) 2 F dν 4 P. Van-Dooren, K. A. Gallivan, and P. A. Absil, "H 2 -optimal model reduction of MIMO systems", Applied Mathematics Letters, vol. 21(12), December 2008, pp. 53-62. 5 S. Gugercin and A C. Antoulas and C A. Beattie, "H 2 Model Reduction for Large Scale Linear Dynamical Systems", SIAM Journal on Matrix Analysis and Applications, vol. 30(2), June 2008, pp. 609-638. 6 K. A. Gallivan, A. Vanderope, and P. Van-Dooren, "Model reduction of MIMO systems via tangential interpolation", SIAM Journal of Matrix Analysis and Application, vol. 26(2), February 2004, pp. 328-349. 7 C. Poussot-Vassal, "An Iterative SVD-Tangential Interpolation Method for Medium-Scale MIMO Systems Approximation with Application on Flexible Aircraft", Proceedings of the 50th IEEE CDC - ECC, Orlando, Florida, USA, December, 2011, pp. 7117-7122.

Frequency-limited mismatch error Summary Approximation objectives 8 9 10 Ĥ := argmin G H dim(g) = r n H G H2,Ω (22) ( 1 H 2 H 2,Ω := trace 2π ( 1 := trace 2π Ω Ω ( H(iν)H T (iν) ) dν) H(iν) 2 F dν ) (23) 8 P. Vuillemin, C. Poussot-Vassal and D. Alazard, "H 2 optimal and frequency limited approximation methods for large-scale LTI dynamical systems", in Proceedings of the IFAC Symposium on Systems Structure and Control, Grenoble, France, February, 2013, pp. 719-724. 9 P. Vuillemin, C. Poussot-Vassal and D. Alazard, "A Spectral Expression for the Frequency-Limited H 2 -norm", arxiv:1211.1858, 2013. 10 P. Vuillemin, C. Poussot-Vassal and D. Alazard, "Poles Residues Descent Algorithm for Optimal Frequency-Limited H 2 Model Approximation", submitted to CDC, Florence, Italy, December, 2013.

Mismatch objective and eigenvector preservation Summary Approximation objectives 11 Ĥ := argmin G H 2 dim(g) = r n λ k (G) λ(h) k = 1,..., i 1 < r H G H2 (24) More than a H 2 (sub-optimal) criteria Keep some user defined eigenvalues... 11 C. Poussot-Vassal and P. Vuillemin, "An Iterative Eigenvector Tangential Interpolation Algorithm for Large-Scale LTI and a Class of LPV Model Approximation", in Proceedings of the European Control Conference, Zurich, Switzerland, July, 2013.

Lecture outines Motivating examples Norm and linear algebra reminder Introduction Summary Model Reduction (Approximation) of Large-Scale Systems Introduction, motivating examples and problem formulation Lecture 1 C. Poussot-Vassal, P. Vuillemin & I. Pontes Duff EDSYS, April 4-7th, 2016 (Toulouse, France) Case 1 u(f ) = [u(f1 )... u(fi )] y(f ) = [y(f1 )... y(fi )] Case 2 E x (t) = Ax(t) + Bu(t) y(t) = Cx(t) + Du(t) Case 3 H(s) = e τ s Σ (A, B, C, D)i Data more AP + P AT + BB T = 0 Σ WTV Kr (A, B) model reduction toolbox Σ (A, B, C, D )i C. Poussot-Vassal, P. Vuillemin & I. Pontes Duff [Onera - DCSD] DAE/ODE State x(t) Rn, n large or infinite Reduced DAE/ODE Reduced state x (t) Rr with r n (+) Simulation (+) Analysis (+) Control (+) Optimization Model Reduction (Approximation) of Large-Scale Systems