Model Reduction for Dynamical Systems Lecture 6

Similar documents
Then. 1 The eigenvalues of A are inside R = n i=1 R i. 2 Union of any k circles not intersecting the other (n k)

10. State Space Methods

t is a basis for the solution space to this system, then the matrix having these solutions as columns, t x 1 t, x 2 t,... x n t x 2 t...

Chapter 2. First Order Scalar Equations

Math 334 Fall 2011 Homework 11 Solutions

2.160 System Identification, Estimation, and Learning. Lecture Notes No. 8. March 6, 2006

Solutions of Sample Problems for Third In-Class Exam Math 246, Spring 2011, Professor David Levermore

Linear Response Theory: The connection between QFT and experiments

d 1 = c 1 b 2 - b 1 c 2 d 2 = c 1 b 3 - b 1 c 3

CHAPTER 2 Signals And Spectra

Hamilton- J acobi Equation: Explicit Formulas In this lecture we try to apply the method of characteristics to the Hamilton-Jacobi equation: u t

Optimality Conditions for Unconstrained Problems

Institute for Mathematical Methods in Economics. University of Technology Vienna. Singapore, May Manfred Deistler

Homework sheet Exercises done during the lecture of March 12, 2014

(1) (2) Differentiation of (1) and then substitution of (3) leads to. Therefore, we will simply consider the second-order linear system given by (4)

Chapter 6. Systems of First Order Linear Differential Equations

Course Notes for EE227C (Spring 2018): Convex Optimization and Approximation

System of Linear Differential Equations

Guest Lectures for Dr. MacFarlane s EE3350 Part Deux

Matrix Versions of Some Refinements of the Arithmetic-Geometric Mean Inequality

Ordinary Differential Equations

SPECTRAL EVOLUTION OF A ONE PARAMETER EXTENSION OF A REAL SYMMETRIC TOEPLITZ MATRIX* William F. Trench. SIAM J. Matrix Anal. Appl. 11 (1990),

Recursive Least-Squares Fixed-Interval Smoother Using Covariance Information based on Innovation Approach in Linear Continuous Stochastic Systems

Technical Report Doc ID: TR March-2013 (Last revision: 23-February-2016) On formulating quadratic functions in optimization models.

MATH 128A, SUMMER 2009, FINAL EXAM SOLUTION

1 Review of Zero-Sum Games

Lecture 2-1 Kinematics in One Dimension Displacement, Velocity and Acceleration Everything in the world is moving. Nothing stays still.

Hamilton- J acobi Equation: Weak S olution We continue the study of the Hamilton-Jacobi equation:

A problem related to Bárány Grünbaum conjecture

SUFFICIENT CONDITIONS FOR EXISTENCE SOLUTION OF LINEAR TWO-POINT BOUNDARY PROBLEM IN MINIMIZATION OF QUADRATIC FUNCTIONAL

Two Coupled Oscillators / Normal Modes

STABILITY OF RESET SWITCHING SYSTEMS

4. Advanced Stability Theory

( ) ( ) if t = t. It must satisfy the identity. So, bulkiness of the unit impulse (hyper)function is equal to 1. The defining characteristic is

Optimal Paired Choice Block Designs. Supplementary Material

ADDITIONAL PROBLEMS (a) Find the Fourier transform of the half-cosine pulse shown in Fig. 2.40(a). Additional Problems 91

Exercises: Similarity Transformation

KEY. Math 334 Midterm III Winter 2008 section 002 Instructor: Scott Glasgow

L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS. NA568 Mobile Robotics: Methods & Algorithms

STATE-SPACE MODELLING. A mass balance across the tank gives:

Operators related to the Jacobi setting, for all admissible parameter values

Second Order Linear Differential Equations

Continuous Time. Time-Domain System Analysis. Impulse Response. Impulse Response. Impulse Response. Impulse Response. ( t) + b 0.

Laplace Transform and its Relation to Fourier Transform

Signal and System (Chapter 3. Continuous-Time Systems)

THE MATRIX-TREE THEOREM

Math 2142 Exam 1 Review Problems. x 2 + f (0) 3! for the 3rd Taylor polynomial at x = 0. To calculate the various quantities:

Linear Dynamic Models

t + t sin t t cos t sin t. t cos t sin t dt t 2 = exp 2 log t log(t cos t sin t) = Multiplying by this factor and then integrating, we conclude that

LAPLACE TRANSFORM AND TRANSFER FUNCTION

EE363 homework 1 solutions

Removing Useless Productions of a Context Free Grammar through Petri Net

Bernoulli numbers. Francesco Chiatti, Matteo Pintonello. December 5, 2016

For example, the comb filter generated from. ( ) has a transfer function. e ) has L notches at ω = (2k+1)π/L and L peaks at ω = 2π k/l,

Robotics I. April 11, The kinematics of a 3R spatial robot is specified by the Denavit-Hartenberg parameters in Tab. 1.

Elements of Computer Graphics

3.1.3 INTRODUCTION TO DYNAMIC OPTIMIZATION: DISCRETE TIME PROBLEMS. A. The Hamiltonian and First-Order Conditions in a Finite Time Horizon

Properties Of Solutions To A Generalized Liénard Equation With Forcing Term

Homework 6 AERE331 Spring 2019 Due 4/24(W) Name Sec. 1 / 2

Lecture 9: September 25

Differential Equations

Computer-Aided Analysis of Electronic Circuits Course Notes 3

Section 4.4 Logarithmic Properties

SMT 2014 Calculus Test Solutions February 15, 2014 = 3 5 = 15.

KEY. Math 334 Midterm III Fall 2008 sections 001 and 003 Instructor: Scott Glasgow

LECTURE 1: GENERALIZED RAY KNIGHT THEOREM FOR FINITE MARKOV CHAINS

Unit Root Time Series. Univariate random walk

MA 214 Calculus IV (Spring 2016) Section 2. Homework Assignment 1 Solutions

4 Sequences of measurable functions

Generalized Least Squares

Physics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle

Vanishing Viscosity Method. There are another instructive and perhaps more natural discontinuous solutions of the conservation law

Second quantization and gauge invariance.

ODEs II, Lecture 1: Homogeneous Linear Systems - I. Mike Raugh 1. March 8, 2004

Math 10B: Mock Mid II. April 13, 2016

Introduction to Simulation - Lecture 16. Methods for Computing Periodic Steady-State - Part II Jacob White

SOLUTIONS TO ECE 3084

Pade and Laguerre Approximations Applied. to the Active Queue Management Model. of Internet Protocol

Orthogonal Rational Functions, Associated Rational Functions And Functions Of The Second Kind

THE GENERALIZED PASCAL MATRIX VIA THE GENERALIZED FIBONACCI MATRIX AND THE GENERALIZED PELL MATRIX

Latent Spaces and Matrix Factorization

THE BERNOULLI NUMBERS. t k. = lim. = lim = 1, d t B 1 = lim. 1+e t te t = lim t 0 (e t 1) 2. = lim = 1 2.

= ( ) ) or a system of differential equations with continuous parametrization (T = R

MATH 4330/5330, Fourier Analysis Section 6, Proof of Fourier s Theorem for Pointwise Convergence

We just finished the Erdős-Stone Theorem, and ex(n, F ) (1 1/(χ(F ) 1)) ( n

dt = C exp (3 ln t 4 ). t 4 W = C exp ( ln(4 t) 3) = C(4 t) 3.

Chapter 3 Boundary Value Problem

Introduction D P. r = constant discount rate, g = Gordon Model (1962): constant dividend growth rate.

Let us start with a two dimensional case. We consider a vector ( x,

Section 4.4 Logarithmic Properties

BEng (Hons) Telecommunications. Examinations for / Semester 2

4/9/2012. Signals and Systems KX5BQY EE235. Today s menu. System properties

Math Week 15: Section 7.4, mass-spring systems. These are notes for Monday. There will also be course review notes for Tuesday, posted later.

MATH 2050 Assignment 9 Winter Do not need to hand in. 1. Find the determinant by reducing to triangular form for the following matrices.

11!Hí MATHEMATICS : ERDŐS AND ULAM PROC. N. A. S. of decomposiion, properly speaking) conradics he possibiliy of defining a counably addiive real-valu

Predator - Prey Model Trajectories and the nonlinear conservation law

Some Ramsey results for the n-cube

Latent Spaces and Matrix Factorization

Chapter Three Systems of Linear Differential Equations

Solutions from Chapter 9.1 and 9.2

Transcription:

Oo-von-Guericke Universiä Magdeburg Faculy of Mahemaics Summer erm 07 Model Reducion for Dynamical Sysems ecure 6 v eer enner and ihong Feng Max lanck Insiue for Dynamics of Complex echnical Sysems Compuaional Mehods in Sysems and Conrol heory Magdeburg Germany benner@mpi-magdeburg.mpg.de feng@mpi-magdeburg.mpg.de hp://www.mpi-magdeburg.mpg.de/csc/eaching/7ss/mor

Ouline MOR: alanced runcaion

Overlook alanced runcaion: firs balancing hen runcae. Given a I sysem: / x y u x d dx For convenience of discussion we denoe he sysem as a block form: alancing runcae reduced model he unimporan par is runcaed

Eigenspaces of and make he wo measures pracically compuable ill now i seems we could do he runcaion by finding subspace spanned by he eigenvecors corresponding o he small eigenvalues of or. However i could happen ha saes which are difficul o reach produce he maximal energy of observaion; saes which produce he smalles energy of observaion are neverheless he easies o reach! For such sysem we do no know which saes o runcae!

Example: Consider he following I sysem / x y u x d dx. 0 0 3 0.5 0.5 0.5 0.5.5 he wo Gramians are: heir eigenvalues and eigenvecors are:.94 0.3868 0.9388 λ ξ 0.08578 0.9388 0.3868 λ ξ.3090 0.85865 0.5573 λ ξ 0.9098 0.5573 0.85865 λ ξ Eigenspaces of and make he wo measures pracically compuable

Eigenspaces of and make he wo measures pracically compuable 0.3868 0.5573 ξ 0.08578 0.9388 λ ξ. 3090 0.85865 λ ξ he angle beween ξ and is very small. his means if S is he subspace spanned by hen he easily observable saes ξ ξ ξ migh also be in S. ξ αξ α α x α >> - I ells us if we runcae he saes which are difficul o reach he saes locae in S we risk runcaing he saes which are easy o observe produce he maximal energy of observaion because hey migh also be in S.

Eigenspaces of and make he wo measures pracically compuable However if and have he same eigenvalues and eigenvecors hen he problems is solved. he saes in he subspace spanned by he eigenvecors of corresponding o he small eigenvalues always in he subspace spanned by he eigenvecors of corresponding o he small eigenvalues because he eigenvalues are he same and eigenvecors are he same herefore he subspaces are he same. Can we achieve his? Yes. e can achieve i by balancing.

MOR: alanced runcaion alancing asic idea of balancing ransformaion: x x Use sae space ransformaion o ge anoher realizaion of he same sysem so ha he ransformed Gramians are diagonal marices. Definiion of alancing ransformaion: Finding a nonsingular marix such ha and. Definiion of alanced sysem: he reachable observable and sable I sysem is balanced if is wo Gramians are equal i is principal-axis balanced if. diag σ σ n.

MOR: alanced runcaion alancing asic idea of balancing ransformaion: x x Use sae space ransformaion o ge anoher realizaion of he same sysem so ha he ransformed Gramians are equal and are diagonal marices. I.e. How o consruc? Recall ha. Since we have which means. should be he inverse of he marix Y of eigenvecors of.

MOR: alanced runcaion Check :? How o make alancing? If UU hen UU U UU U Here we mus have he relaion U. / / If furher U hen U UU How o compue? / Subsiue U he lef hand side / / U I ino we ge / U U / / U UU U U if /. U I. /. ook a he righ hand side we ge / / U U i. e. U U. herefore is he inverse of he marix of eigenvecors of U U. Furunaely he ranspose of U U is a s.p.d. marix. herefore he inverse of he marix of he marix iself.so ha we do no have o compue he inverse. eigenvecors is exacly

MOR: alanced runcaion alancing he above analysis clearly shows ha: Exisence of balancing ransformaion: dx / d y x Given a reachable observable and sable I sysem and he corresponding Gramians and a principal axis balancing ransformaion is given as follows: x u K U and UK / / Here UU is he Cholesky facorizaion of. U U K is he eigen-decomposiion of U U. Symmeric posiive semi-definie marix has real non-negive eigenvalues and orhogonal eigenvecors. Here he Eigenvecors in K are aken as orhonormal K

MOR: alanced runcaion alancing ha is he corresponding balanced sysem? pply he sae space ansformaion: x x o he original realizaion: dx / d y x x u x x dx / d y x x u

alancing : MOR: alanced runcaion alancing Given dx / d x y x u Compue. Compue UU U U K K he eigenvalues are ordered from he larges o he smalles dx / d x u / K U dx / d x u y x / UK y x

balanced sysem: dx / d y x x u he uni vecors e are he eigenvecors of : e σ e ssume ha he elemens on he herefore e e easily observable saes. r i i i i i n. diagonal of is already ordered as : σ σ σ. span he subspace conaining he firs r easily conrollable and runcae he difficul - o - observe and difficul - o - conrol saes means : x e x e x e x e x x x 0 0. MOR: alanced runcaion n n I.e. x x 0 0 :. Replace xr x x wih x dx / d x u z : x xr y x r r runcae r in he balanced sysem : z z u d 0 0 u y z 0 n

MOR: alanced runcaion runcae 0 0 0 z y u u z z d noher realizaion of he same sysem is: is a non-minimal realizaion of a sysem. ˆ z y u z dz he reduced-order model ROM herefore we have he following simple seps for runcaion:

alancing: MOR: alanced runcaion runcae dx / d y x x u K U / / UK dx / d y x x u runcae: Small par and Separaed according o he separaion of. dz / d z u yˆ z ROM!

MOR: alanced runcaion alancing: dx / d y x x u / K U / UK dx / d y x x u Does i make sense if we do model reducion on he balanced sysem raher han he original sysem? Yes. s a sae ransformaion balancing does no change he ransfer funcion and he HSVs. he balanced sysem is only a differen realizaion of he sysem.

Observe: / x y u x d dx / x y u x d dx ˆ / z y u z d dz Y Y Y Yx x x :. produc marix he of eigenvecors he are : in columns he Here.. hen and as as separae If x Y Y x Yx x x x x x Y Y Y Y Y Y Y Y Y Y Y Y Y Y Y Y MOR: alanced runcaion

MOR: alanced runcaion herefore he wo ROMs are he same: dz / d yˆ z z u dx / d Y x y Y x u Conclusion: balanced runcaion is erov-galerkin projecion as below: e x Y x dx / d y x u x erov - Galerkin Y x x dx / d y Y x using Y x u herefore balanced runcaion is equivalen o: finding he invarian subspace rangey of and remaining only he par Y which corresponds o he larges HSVs square roo of he eigenvalues of.

MOR: alanced runcaion lgorihm alancing:. Compue. Given dx / d x u y x. Compue UU 3. K U / U U K / UK K 4. alancing and separaing according o he separaion of : runcae: 5. Form he reduced model: dxˆ / d yˆ xˆ xˆ u

MOR: alanced runcaion compuaional deails Recall: In M use command: lyap ' lyap '

MOR: alanced runcaion Numerical issues he balancing marix is: / K U UU. Compuaion of U may cause numerical insabiliy because U is usually near singular. U is usually near singular because he marix has numerically low-rank i.e. near singular. is near singular because in may cases is eigenvalues decay rapidly o zero some eigenvalues are very close o zero e.g.. and behaves similarly as. λ 0 0 i However in algorihm we need o compue: / / K U UK Can we avoid compuing U?

MOR: alanced runcaion p p p p compuaional deails If using Choelsky facorizaion of boh Observe Use SVD insead of eigen- decomposiion U V Comparing wih defined in lgorihm we immediaely ge / U p o avoid compuing he inverse of U V V p U p we have: / V

MOR: alanced runcaion Numerical issues he balanced sysem which is balanced by and is: V / / U V V V / / / / / / U U U Furhermore if Define:. V V / V / U V we have: hen V V V U U U

MOR: alanced runcaion Numerical issues lgorihm SR mehod Geing he reduced model wihou compuing U :. Do Cholesky facorizaion of he wo Gramians: are lower riangular marices.. Do Singular value decomposiion SVD of marix i.e. here are wo orhonormal marices U V U U I V V I such ha V U V U U. V / 3. e / V V U. 4. e ˆ ˆ ˆ V V. 5. he reduced model is dxˆ / d x ˆ ˆ u ˆ yˆ ˆ xˆ

MOR: alanced runcaion Numerical issues lgorihm someimes canno coninue eiher because he Cholesky facorizaion of canno be done. his is because ha in some cases and include oo small eigenvalues like: λ 0 0 which is considered by he algorihm as a singular marix herefore Cholesky facorizaion canno be coninued. aper [enner 05] provides an algorihm compuing he numerically full rank facors n n n n of and which are in he forms ˆ ˆ R R n ˆ << n he full rank facors numerically saisfy:. [enner 05]. enner E.S. uiana-ori Model reducion based on specral projecion mehods. In:. enner V.. Mehrmann D.C. Sorensen eds. "Dimension Reduion of arge-scale Sysems" vol. 45 of ecure Noes in Compuaional Science and Engineering pp. 5-48 Springer-Verlag erlin/heidelberg 005. lgorihm 4 in he paper

MOR: alanced runcaion Numerical issues lgorihm 3 Geing he reduced model using full-rank facors [enner 05]:. Compue full-rank facors of he Gramians:. Compue SVD. V V U U V U / V 3. e. / U V 5. he reduced model is ˆ ˆ ˆ ˆ ˆ ˆ / ˆ x y u x d dx 4. e. ˆ ˆ ˆ V V. ˆ ˆ ˆ n n R R n n n n <<

MOR: alanced runcaion Error bound heorem [enner 05] If he original I sysem is sable hen he reduced model obained by lgorihm lgorihm lgorihm 3 saisfies: he reduced model is balanced minimal and sable. I s Gramians are equal o he same diagonal marix. he absolue error bound proof in [noulas 05] Chaper 7 holds. H s Hˆ s σ H n k r k