SYSTEM-THEORETIC METHODS FOR MODEL REDUCTION OF LARGE-SCALE SYSTEMS: SIMULATION, CONTROL, AND INVERSE PROBLEMS. Peter Benner

Similar documents
BALANCING-RELATED MODEL REDUCTION FOR LARGE-SCALE SYSTEMS

BALANCING-RELATED MODEL REDUCTION FOR DATA-SPARSE SYSTEMS

The Newton-ADI Method for Large-Scale Algebraic Riccati Equations. Peter Benner.

Model Reduction for Dynamical Systems

A Newton-Galerkin-ADI Method for Large-Scale Algebraic Riccati Equations

Passivity Preserving Model Reduction for Large-Scale Systems. Peter Benner.

Moving Frontiers in Model Reduction Using Numerical Linear Algebra

MODEL REDUCTION BY A CROSS-GRAMIAN APPROACH FOR DATA-SPARSE SYSTEMS

Structure preserving Krylov-subspace methods for Lyapunov equations

Model Reduction for Linear Dynamical Systems

ADI-preconditioned FGMRES for solving large generalized Lyapunov equations - A case study

Efficient Implementation of Large Scale Lyapunov and Riccati Equation Solvers

Balanced Truncation Model Reduction of Large and Sparse Generalized Linear Systems

Model Reduction for Unstable Systems

SyreNe System Reduction for Nanoscale IC Design

Model reduction for linear systems by balancing

Linear and Nonlinear Matrix Equations Arising in Model Reduction

Parallel Model Reduction of Large Linear Descriptor Systems via Balanced Truncation

Model reduction of coupled systems

Balancing-Related Model Reduction for Large-Scale Systems

S N. hochdimensionaler Lyapunov- und Sylvestergleichungen. Peter Benner. Mathematik in Industrie und Technik Fakultät für Mathematik TU Chemnitz

Model order reduction of electrical circuits with nonlinear elements

System Reduction for Nanoscale IC Design (SyreNe)

Parametrische Modellreduktion mit dünnen Gittern

The Kalman-Yakubovich-Popov Lemma for Differential-Algebraic Equations with Applications

Nonlinear Observers. Jaime A. Moreno. Eléctrica y Computación Instituto de Ingeniería Universidad Nacional Autónoma de México

Iterative Rational Krylov Algorithm for Unstable Dynamical Systems and Generalized Coprime Factorizations

Model order reduction of large-scale dynamical systems with Jacobi-Davidson style eigensolvers

Balancing-Related Model Reduction for Parabolic Control Systems

Fast Frequency Response Analysis using Model Order Reduction

6.241 Dynamic Systems and Control

Model reduction of nonlinear circuit equations

Comparison of methods for parametric model order reduction of instationary problems

Accelerating Model Reduction of Large Linear Systems with Graphics Processors

Numerical Solution of Descriptor Riccati Equations for Linearized Navier-Stokes Control Problems

Fluid flow dynamical model approximation and control

Balancing of Lossless and Passive Systems

Krylov Subspace Methods for Nonlinear Model Reduction

Model Order Reduction of Continuous LTI Large Descriptor System Using LRCF-ADI and Square Root Balanced Truncation

CME 345: MODEL REDUCTION

Order reduction numerical methods for the algebraic Riccati equation. V. Simoncini

Parametric Model Order Reduction for Linear Control Systems

Lecture Note #6 (Chap.10)

Contents. 1 State-Space Linear Systems 5. 2 Linearization Causality, Time Invariance, and Linearity 31

Model reduction of large-scale dynamical systems

Numerical Solution of Matrix Equations Arising in Control of Bilinear and Stochastic Systems

Approximation of the Linearized Boussinesq Equations

Factorized Solution of Sylvester Equations with Applications in Control

Gramian-Based Model Reduction for Data-Sparse Systems CSC/ Chemnitz Scientific Computing Preprints

Model reduction via tangential interpolation

1 Continuous-time Systems

A POD Projection Method for Large-Scale Algebraic Riccati Equations

ẋ n = f n (x 1,...,x n,u 1,...,u m ) (5) y 1 = g 1 (x 1,...,x n,u 1,...,u m ) (6) y p = g p (x 1,...,x n,u 1,...,u m ) (7)

RECURSIVE ESTIMATION AND KALMAN FILTERING

Krylov-Subspace Based Model Reduction of Nonlinear Circuit Models Using Bilinear and Quadratic-Linear Approximations

Model Order Reduction of Electrical Circuits with Nonlinear Elements

FEL3210 Multivariable Feedback Control

EEE582 Homework Problems

Balanced Truncation 1

H 2 optimal model reduction - Wilson s conditions for the cross-gramian

ME 234, Lyapunov and Riccati Problems. 1. This problem is to recall some facts and formulae you already know. e Aτ BB e A τ dτ

State Regulator. Advanced Control. design of controllers using pole placement and LQ design rules

Chapter 3. LQ, LQG and Control System Design. Dutch Institute of Systems and Control

EL 625 Lecture 10. Pole Placement and Observer Design. ẋ = Ax (1)

Modern Optimal Control

In this article we discuss sparse matrix algorithms and parallel algorithms, Solving Large-Scale Control Problems

Semidefinite Programming Duality and Linear Time-invariant Systems

Spectral factorization and H 2 -model following

Passive Interconnect Macromodeling Via Balanced Truncation of Linear Systems in Descriptor Form

Robust Multivariable Control

3 Gramians and Balanced Realizations

Matrix Equations and and Bivariate Function Approximation

6 OUTPUT FEEDBACK DESIGN

16.31 Fall 2005 Lecture Presentation Mon 31-Oct-05 ver 1.1

The rational Krylov subspace for parameter dependent systems. V. Simoncini

Linear System Theory

Computing Transfer Function Dominant Poles of Large Second-Order Systems

Reduced-order Model Based on H -Balancing for Infinite-Dimensional Systems

EE C128 / ME C134 Final Exam Fall 2014

Structured Krylov Subspace Methods for Eigenproblems with Spectral Symmetries

Two-sided Eigenvalue Algorithms for Modal Approximation

Optimal control and estimation

1. Find the solution of the following uncontrolled linear system. 2 α 1 1

MPC/LQG for infinite-dimensional systems using time-invariant linearizations

On Spectral Factorization and Riccati Equations for Time-Varying Systems in Discrete Time

Steady State Kalman Filter

Problem Set 5 Solutions 1

Lecture Note #6 (Chap.10)

Observability. It was the property in Lyapunov stability which allowed us to resolve that

João P. Hespanha. January 16, 2009

Introduction to Nonlinear Control Lecture # 4 Passivity

Model Order Reduction for Parameter-Varying Systems

Topic # Feedback Control Systems

System Identification by Nuclear Norm Minimization

ECEN 420 LINEAR CONTROL SYSTEMS. Lecture 6 Mathematical Representation of Physical Systems II 1/67

Denis ARZELIER arzelier

Model reduction of large-scale systems by least squares

Adaptive rational Krylov subspaces for large-scale dynamical systems. V. Simoncini

On the numerical solution of large-scale sparse discrete-time Riccati equations

LINEAR-QUADRATIC OPTIMAL CONTROL OF DIFFERENTIAL-ALGEBRAIC SYSTEMS: THE INFINITE TIME HORIZON PROBLEM WITH ZERO TERMINAL STATE

Transcription:

SYSTEM-THEORETIC METHODS FOR MODEL REDUCTION OF LARGE-SCALE SYSTEMS: SIMULATION, CONTROL, AND INVERSE PROBLEMS Professur Mathematik in Industrie und Technik Fakultät für Mathematik Technische Universität Chemnitz MATHMOD 2009 Vienna, February 11 13, 2009

Overview 1 Application Areas Goals 2 Balancing Basics Balanced Truncation and Relatives Solving Large-Scale Matrix Equations 3 Simulation Control 4

for Dynamical Application Areas Goals Dynamical with Σ : { Eẋ(t) = f (t, x(t), u(t)), x(t0 ) = x 0, (a) y(t) = g(t, x(t), u(t)) (b) (generalized) states x(t) R n (E R n n ), inputs u(t) R m, outputs y(t) R p, (b) is called output equation. E singular (a) is system of differential-algebraic equations (DAEs) otherwise (a) is system of ordinary differential equations (ODEs)

for Dynamical Application Areas Goals Original System Σ : j Eẋ(t) = f (t, x(t), u(t)), y(t) = g(t, x(t), u(t)). states x(t) R n, inputs u(t) R m, outputs y(t) R p. Reduced-Order System bσ : j Ê ˆx(t) = b f (t, ˆx(t), u(t)), ŷ(t) = bg(t, ˆx(t), u(t)). states ˆx(t) R r, r n inputs u(t) R m, outputs ŷ(t) R p. Goal: y ŷ < tolerance u for all admissible input signals.

for Dynamical Application Areas Goals Original System Σ : j Eẋ(t) = f (t, x(t), u(t)), y(t) = g(t, x(t), u(t)). states x(t) R n, inputs u(t) R m, outputs y(t) R p. Reduced-Order System bσ : j Ê ˆx(t) = b f (t, ˆx(t), u(t)), ŷ(t) = bg(t, ˆx(t), u(t)). states ˆx(t) R r, r n inputs u(t) R m, outputs ŷ(t) R p. Goal: y ŷ < tolerance u for all admissible input signals.

Linear Application Areas Goals Linear, Time-Invariant (LTI) / Descriptor Eẋ(t) = Ax(t) + Bu(t), A, E R n n, B R n m, y(t) = Cx(t) + Du(t), C R p n, D R p m. Laplace Transformation / Frequency Domain Application of Laplace transformation (x(t) x(s), ẋ(t) sx(s)) to linear system with x(0) = 0: sex(s) = Ax(s) + Bu(s), y(s) = Bx(s) + Du(s), yields I/O-relation in frequency domain: ( y(s) = G is the transfer function of Σ. C(sE A) 1 B + D }{{} =:G(s) ) u(s)

Linear Application Areas Goals Linear, Time-Invariant (LTI) / Descriptor Eẋ(t) = Ax(t) + Bu(t), A, E R n n, B R n m, y(t) = Cx(t) + Du(t), C R p n, D R p m. Laplace Transformation / Frequency Domain Application of Laplace transformation (x(t) x(s), ẋ(t) sx(s)) to linear system with x(0) = 0: sex(s) = Ax(s) + Bu(s), y(s) = Bx(s) + Du(s), yields I/O-relation in frequency domain: ( y(s) = G is the transfer function of Σ. C(sE A) 1 B + D }{{} =:G(s) ) u(s)

for Linear Application Areas Goals Problem Approximate the dynamical system Eẋ = Ax + Bu, A, E R n n, B R n m, y = Cx + Du, C R p n, D R p m, by reduced-order system Ê ˆx = ˆx + ˆBu, Â, Ê Rr r, ˆB R r m, ŷ = Ĉ ˆx + ˆDu, Ĉ R p r, ˆD R p m, of order r n, such that y ŷ = Gu Ĝu G Ĝ u < tolerance u. = Approximation problem: min order ( Ĝ) r G Ĝ.

for Linear Application Areas Goals Problem Approximate the dynamical system Eẋ = Ax + Bu, A, E R n n, B R n m, y = Cx + Du, C R p n, D R p m, by reduced-order system Ê ˆx = ˆx + ˆBu, Â, Ê Rr r, ˆB R r m, ŷ = Ĉ ˆx + ˆDu, Ĉ R p r, ˆD R p m, of order r n, such that y ŷ = Gu Ĝu G Ĝ u < tolerance u. = Approximation problem: min order ( Ĝ) r G Ĝ.

Application Areas General assumptions Application Areas Goals Here: linear systems, n m, p, n so large, that A(, E) cannot be stored in main memory (RAM) as n n array: n > 5000, say, e.g., from semi-discretization of PDEs, finite element modeling of MEMS, VLSI design/circuit simulation,... A(, E) sparse or data-sparse, i.e., A(, E) can be stored in O(n) or O(n log n) memory locations, but matrix manipulations like similarity transformations are too expensive (possible exception: permutations, sparse factorizations).

Application Areas General assumptions Application Areas Goals Here: linear systems, n m, p, n so large, that A(, E) cannot be stored in main memory (RAM) as n n array: n > 5000, say, e.g., from semi-discretization of PDEs, finite element modeling of MEMS, VLSI design/circuit simulation,... A(, E) sparse or data-sparse, i.e., A(, E) can be stored in O(n) or O(n log n) memory locations, but matrix manipulations like similarity transformations are too expensive (possible exception: permutations, sparse factorizations).

Application Areas General assumptions Application Areas Goals Here: linear systems, n m, p, n so large, that A(, E) cannot be stored in main memory (RAM) as n n array: n > 5000, say, e.g., from semi-discretization of PDEs, finite element modeling of MEMS, VLSI design/circuit simulation,... A(, E) sparse or data-sparse, i.e., A(, E) can be stored in O(n) or O(n log n) memory locations, but matrix manipulations like similarity transformations are too expensive (possible exception: permutations, sparse factorizations).

Application Areas General assumptions Application Areas Goals Here: linear systems, n m, p, n so large, that A(, E) cannot be stored in main memory (RAM) as n n array: n > 5000, say, e.g., from semi-discretization of PDEs, finite element modeling of MEMS, VLSI design/circuit simulation,... A(, E) sparse or data-sparse, i.e., A(, E) can be stored in O(n) or O(n log n) memory locations, but matrix manipulations like similarity transformations are too expensive (possible exception: permutations, sparse factorizations).

Application Areas Simulation Application Areas Goals Time-domain simulation Evaluation of variation-of-constants formula ( t ) y(t) = C exp(at) x 0 + exp( Aτ)Bu(τ)dτ, usually too expensive numerical simulation, e.g., using backwards Euler y h (t k+1 ) = C(E h k A) 1 (Ex h (t k ) + h k Bu(t k+1 )) + Du(t k+1 ), 0 Bottleneck: solution of (E h k A)z = b, computation time can be significantly reduced by using reduced-order model: ( ) ŷ h (t k+1 ) = Ĉ(Ê hkâ) 1 Êx h (t k ) + h k ˆBu(tk+1 ) + ˆDu(t k+1 ).

Application Areas Simulation Application Areas Goals Frequency-domain simulation Frequency response analysis, e.g., for Bode, Nyquist or Nichols plots, requires evaluation of transfer function G(ıω k ) = C(ıω k E A) 1 B + D, ω k 0, k = 1,..., N f. Bottleneck: solution of (ıω k E A)z = b. Computation time can be significantly reduced by using reduced-order model: Ĝ(ıω k ) = Ĉ(ıω kê Â) 1 ˆB + ˆD.

Application Areas Simulation Application Areas Goals Frequency-domain simulation Frequency response analysis, e.g., for Bode, Nyquist or Nichols plots, requires evaluation of transfer function G(ıω k ) = C(ıω k E A) 1 B + D, ω k 0, k = 1,..., N f. Bottleneck: solution of (ıω k E A)z = b. Computation time can be significantly reduced by using reduced-order model: Ĝ(ıω k ) = Ĉ(ıω kê Â) 1 ˆB + ˆD. But: the cost for solving the linear systems in time/frequency domain simulation may not benefit from smaller order, if efficient sparse direct solver for full-size sparse system matrices is available.

Application Areas Simulation Application Areas Goals An easy improvement Significant reduction can be achieved by transforming (Â, Ê) to Hessenberg-triangular form using QZ algorithm, i.e., compute orthogonal Q, Z such that ] [ ] [ ] Q(λÊ [ Â)Z = λ. New reduced-order system: (QÊZ, QÂZ, Q ˆB, ĈZ), linear systems of equations (jωê Â)x = b, (Ê h k Â)x k+1 = Êx k +..., etc. have Hessenberg form and can thus be solved using r 1 Givens rotations only! (Needs Hessenberg solver inside simulator.) For symmetric systems, further reduction can be achieved.

Application Areas (Optimal) Control Application Areas Goals Feedback Controllers A feedback controller (dynamic compensator) is a linear system of order N, where input = output of plant, output = input of plant. Modern (LQG-/H 2 -/H -) control design: N n. Practical controllers require small N (N 10, say) due to real-time constraints, increasing fragility for larger N. = reduce order of plant (n) and/or controller (N).

Application Areas (Optimal) Control Application Areas Goals Feedback Controllers A feedback controller (dynamic compensator) is a linear system of order N, where input = output of plant, output = input of plant. Modern (LQG-/H 2 -/H -) control design: N n. Practical controllers require small N (N 10, say) due to real-time constraints, increasing fragility for larger N. = reduce order of plant (n) and/or controller (N).

Application Areas (Optimal) Control Application Areas Goals Feedback Controllers A feedback controller (dynamic compensator) is a linear system of order N, where input = output of plant, output = input of plant. Modern (LQG-/H 2 -/H -) control design: N n. Practical controllers require small N (N 10, say) due to real-time constraints, increasing fragility for larger N. = reduce order of plant (n) and/or controller (N).

Application Areas Inverse Problems Application Areas Goals System inversion Assume m = p, D R m m invertible (generalizations possible!), then G 1 (s) = D 1 C(sE (A BD 1 C)) 1 BD 1 + D 1. Some applications like inverse-based control, identification of source terms, reconstruct input function from reference trajectory/measured outputs: given Y (s), the Laplace transform of y(t), compute U(s) = G 1 (s)y (s).

Application Areas Inverse Problems Application Areas Goals System inversion Assume m = p, D R m m invertible (generalizations possible!), then G 1 (s) = D 1 C(sE (A BD 1 C)) 1 BD 1 + D 1. Some applications like inverse-based control, identification of source terms, reconstruct input function from reference trajectory/measured outputs: given Y (s), the Laplace transform of y(t), compute U(s) = G 1 (s)y (s). Goal: reduced-order transfer function Ĝ(s) such that Û(s) = Ĝ 1 (s)y (s) has small error U Û = G 1 Y Ĝ 1 Y G 1 Ĝ 1 Y tolerance Y.

Application Areas Inverse Problems Application Areas Goals System inversion Assume m = p, D R m m invertible (generalizations possible!), then G 1 (s) = D 1 C(sE (A BD 1 C)) 1 BD 1 + D 1. Some applications like inverse-based control, identification of source terms, reconstruct input function from reference trajectory/measured outputs: given Y (s), the Laplace transform of y(t), compute U(s) = G 1 (s)y (s). Goal: reduced-order transfer function Ĝ(s) such that Û(s) = Ĝ 1 (s)y (s) has small error U Û = G 1 Y Ĝ 1 Y G 1 Ĝ 1 Y tolerance Y.

Goals Application Areas Goals Automatic generation of compact models. Satisfy desired error tolerance for all admissible input signals, i.e., want y ŷ < tolerance u u L 2 (R, R m ). = Need computable error bound/estimate! Preserve physical properties: stability (poles of G in C ), minimum phase (zeroes of G in C ), passivity ( system does not generate energy ), All this can be achieved by system-theoretic methods based on balancing!

Goals Application Areas Goals Automatic generation of compact models. Satisfy desired error tolerance for all admissible input signals, i.e., want y ŷ < tolerance u u L 2 (R, R m ). = Need computable error bound/estimate! Preserve physical properties: stability (poles of G in C ), minimum phase (zeroes of G in C ), passivity ( system does not generate energy ), All this can be achieved by system-theoretic methods based on balancing!

Goals Application Areas Goals Automatic generation of compact models. Satisfy desired error tolerance for all admissible input signals, i.e., want y ŷ < tolerance u u L 2 (R, R m ). = Need computable error bound/estimate! Preserve physical properties: stability (poles of G in C ), minimum phase (zeroes of G in C ), passivity ( system does not generate energy ), All this can be achieved by system-theoretic methods based on balancing!

Goals Application Areas Goals Automatic generation of compact models. Satisfy desired error tolerance for all admissible input signals, i.e., want y ŷ < tolerance u u L 2 (R, R m ). = Need computable error bound/estimate! Preserve physical properties: stability (poles of G in C ), minimum phase (zeroes of G in C ), passivity ( system does not generate energy ), All this can be achieved by system-theoretic methods based on balancing!

Balancing Basics (E = I n for ease of notation) Balancing Balanced Truncation and Relatives Matrix Equations Linear, Time-Invariant (LTI) Σ : { ẋ(t) = Ax + Bu, A R n n, B R n m, y(t) = Cx + Du, C R p n, D R p m. (A, B, C, D) is a realization of Σ (nonunique).

Balancing Basics (E = I n for ease of notation) Balancing Balanced Truncation and Relatives Matrix Equations Linear, Time-Invariant (LTI) Σ : { ẋ(t) = Ax + Bu, A R n n, B R n m, y(t) = Cx + Du, C R p n, D R p m. (A, B, C, D) is a realization of Σ (nonunique). Based on Balancing Given P, Q R n n symmetric positive definite (spd), and a contragredient transformation T : R n R n, TPT T = T T QT 1 = diag(σ 1,..., σ n ), σ 1... σ n 0. Balancing Σ w.r.t. P, Q: Σ (A, B, C, D) (TAT 1, TB, CT 1, D) Σ. Generalization to P, Q 0 possible: if ˆn is McMillan degree of Σ, then T (PQ)T 1 = diag(σ 1,..., σˆn, 0,..., 0).

Balancing Basics (E = I n for ease of notation) Balancing Balanced Truncation and Relatives Matrix Equations Linear, Time-Invariant (LTI) Σ : { ẋ(t) = Ax + Bu, A R n n, B R n m, y(t) = Cx + Du, C R p n, D R p m. (A, B, C, D) is a realization of Σ (nonunique). Based on Balancing Given P, Q R n n symmetric positive definite (spd), and a contragredient transformation T : R n R n, TPT T = T T QT 1 = diag(σ 1,..., σ n ), σ 1... σ n 0. Balancing Σ w.r.t. P, Q: Σ (A, B, C, D) (TAT 1, TB, CT 1, D) Σ. Generalization to P, Q 0 possible: if ˆn is McMillan degree of Σ, then T (PQ)T 1 = diag(σ 1,..., σˆn, 0,..., 0).

Balancing Basics (E = I n for ease of notation) Balancing Balanced Truncation and Relatives Matrix Equations Basic Procedure 1 Given Σ (A, B, C, D) and balancing (w.r.t. given P, Q spd) transformation T R n n nonsingular, compute (A, B, C, D) (TAT 1, TB, CT 1, D) ([ ] [ ] A11 A = 12 B1,, [ ) ] C A 21 A 22 B 1 C 2, D 2 2 Truncation reduced-order model: (Â, ˆB, Ĉ, ˆD) = (A 11, B 1, C 1, D).

Balancing Basics (E = I n for ease of notation) Balancing Balanced Truncation and Relatives Matrix Equations Basic Procedure 1 Given Σ (A, B, C, D) and balancing (w.r.t. given P, Q spd) transformation T R n n nonsingular, compute (A, B, C, D) (TAT 1, TB, CT 1, D) ([ ] [ ] A11 A = 12 B1,, [ ) ] C A 21 A 22 B 1 C 2, D 2 2 Truncation reduced-order model: (Â, ˆB, Ĉ, ˆD) = (A 11, B 1, C 1, D).

Balancing Basics (E = I n for ease of notation) Balancing Balanced Truncation and Relatives Matrix Equations Implementation: SR Method 1 Compute Cholesky (square) or full-rank (maybe rectangular, thin ) factors of P, Q 2 Compute SVD 3 Set P = S T S, Q = R T R. SR T = [ U 1, U 2 ] 4 Reduced-order model is [ Σ1 Σ 2 ] [ V T 1 V T 2 ]. W = R T V 1 Σ 1/2 1, V = S T U 1 Σ 1/2 1. (Â, ˆB, Ĉ, ˆD) := (W T AV, W T B, CV, D) ( (A 11, B 1, C 1, D).)

Balancing Basics (E = I n for ease of notation) Balancing Balanced Truncation and Relatives Matrix Equations Implementation: SR Method 1 Compute Cholesky (square) or full-rank (maybe rectangular, thin ) factors of P, Q 2 Compute SVD 3 Set P = S T S, Q = R T R. SR T = [ U 1, U 2 ] 4 Reduced-order model is [ Σ1 Σ 2 ] [ V T 1 V T 2 ]. W = R T V 1 Σ 1/2 1, V = S T U 1 Σ 1/2 1. (Â, ˆB, Ĉ, ˆD) := (W T AV, W T B, CV, D) ( (A 11, B 1, C 1, D).)

Balancing for Simulation, Control Truncate realization, balanced w.r.t. P = Q = diag(σ 1,..., σ n) = Σ, σ 1... σ r > σ r+1... σ n 0 at size r. Balancing Balanced Truncation and Relatives Matrix Equations Classical Balanced Truncation (BT) Mullis/Roberts 76, Moore 81 P/Q = controllability/observability Gramian of Σ (A, B, C, D). For asymptotically stable systems, P, Q solve dual Lyapunov equations AP + PA T + BB T = 0, A T Q + QA + C T C = 0. {σ BT 1,..., σ BT n } are the Hankel singular values (HSVs) of Σ. Preserves stability, extends to unstable systems w/o purely imaginary poles using frequency domain definition of the Gramians [Zhou/Salomon/Wu 99]. Preserves passivity for certain symmetric systems. Computable error bound comes for free: G Ĝ BT H 2 nx j=r+1 σ BT j, allows adaptive choice of r!

Balancing for Simulation, Control Truncate realization, balanced w.r.t. P = Q = diag(σ 1,..., σ n) = Σ, σ 1... σ r > σ r+1... σ n 0 at size r. Balancing Balanced Truncation and Relatives Matrix Equations Classical Balanced Truncation (BT) Mullis/Roberts 76, Moore 81 P/Q = controllability/observability Gramian of Σ (A, B, C, D). For asymptotically stable systems, P, Q solve dual Lyapunov equations AP + PA T + BB T = 0, A T Q + QA + C T C = 0. {σ BT 1,..., σ BT n } are the Hankel singular values (HSVs) of Σ. Preserves stability, extends to unstable systems w/o purely imaginary poles using frequency domain definition of the Gramians [Zhou/Salomon/Wu 99]. Preserves passivity for certain symmetric systems. Computable error bound comes for free: G Ĝ BT H 2 nx j=r+1 σ BT j, allows adaptive choice of r!

Balancing for Simulation, Control Truncate realization, balanced w.r.t. P = Q = diag(σ 1,..., σ n) = Σ, σ 1... σ r > σ r+1... σ n 0 at size r. Balancing Balanced Truncation and Relatives Matrix Equations Classical Balanced Truncation (BT) Mullis/Roberts 76, Moore 81 P/Q = controllability/observability Gramian of Σ (A, B, C, D). For asymptotically stable systems, P, Q solve dual Lyapunov equations AP + PA T + BB T = 0, A T Q + QA + C T C = 0. {σ BT 1,..., σ BT n } are the Hankel singular values (HSVs) of Σ. Preserves stability, extends to unstable systems w/o purely imaginary poles using frequency domain definition of the Gramians [Zhou/Salomon/Wu 99]. Preserves passivity for certain symmetric systems. Computable error bound comes for free: G Ĝ BT H 2 nx j=r+1 σ BT j, allows adaptive choice of r!

Balancing for Simulation, Control Truncate realization, balanced w.r.t. P = Q = diag(σ 1,..., σ n) = Σ, σ 1... σ r > σ r+1... σ n 0 at size r. Balancing Balanced Truncation and Relatives Matrix Equations Classical Balanced Truncation (BT) Mullis/Roberts 76, Moore 81 P/Q = controllability/observability Gramian of Σ (A, B, C, D). For asymptotically stable systems, P, Q solve dual Lyapunov equations AP + PA T + BB T = 0, A T Q + QA + C T C = 0. {σ BT 1,..., σ BT n } are the Hankel singular values (HSVs) of Σ. Preserves stability, extends to unstable systems w/o purely imaginary poles using frequency domain definition of the Gramians [Zhou/Salomon/Wu 99]. Preserves passivity for certain symmetric systems. Computable error bound comes for free: G Ĝ BT H 2 nx j=r+1 σ BT j, allows adaptive choice of r!

Balancing for Simulation, Control Truncate realization, balanced w.r.t. P = Q = diag(σ 1,..., σ n) = Σ, σ 1... σ r > σ r+1... σ n 0 at size r. Balancing Balanced Truncation and Relatives Matrix Equations Linear-Quadratic Gaussian Balanced Truncation (LQGBT) Jonckheere/Silverman 83 P/Q = controllability/observability Gramian of closed-loop system based on LQG compensator. P, Q solve dual algebraic Riccati equations (AREs) 0 = AP + PA T PC T CP + B T B, 0 = A T Q + QA QBB T Q + C T C. Applies to unstable systems! (Only stabilizability & detectability are required.) Computable error bound comes for free: if G = M 1 N, Ĝ = ˆM 1 ˆN are left coprime factorizations with stable factors, then ˆ N M ˆ nx ˆN ˆM H 2 σ LQG j 1 + (σ LQG j ) 2 1 2, allows adaptive choice of r! j=r+1 Yields reduced-order LQR/LQG controller for free!

Balancing for Simulation, Control Truncate realization, balanced w.r.t. P = Q = diag(σ 1,..., σ n) = Σ, σ 1... σ r > σ r+1... σ n 0 at size r. Balancing Balanced Truncation and Relatives Matrix Equations Linear-Quadratic Gaussian Balanced Truncation (LQGBT) Jonckheere/Silverman 83 P/Q = controllability/observability Gramian of closed-loop system based on LQG compensator. P, Q solve dual algebraic Riccati equations (AREs) 0 = AP + PA T PC T CP + B T B, 0 = A T Q + QA QBB T Q + C T C. Applies to unstable systems! (Only stabilizability & detectability are required.) Computable error bound comes for free: if G = M 1 N, Ĝ = ˆM 1 ˆN are left coprime factorizations with stable factors, then ˆ N M ˆ nx ˆN ˆM H 2 σ LQG j 1 + (σ LQG j ) 2 1 2, allows adaptive choice of r! j=r+1 Yields reduced-order LQR/LQG controller for free!

Balancing for Simulation, Control Truncate realization, balanced w.r.t. P = Q = diag(σ 1,..., σ n) = Σ, σ 1... σ r > σ r+1... σ n 0 at size r. Balancing Balanced Truncation and Relatives Matrix Equations Linear-Quadratic Gaussian Balanced Truncation (LQGBT) Jonckheere/Silverman 83 P/Q = controllability/observability Gramian of closed-loop system based on LQG compensator. P, Q solve dual algebraic Riccati equations (AREs) 0 = AP + PA T PC T CP + B T B, 0 = A T Q + QA QBB T Q + C T C. Applies to unstable systems! (Only stabilizability & detectability are required.) Computable error bound comes for free: if G = M 1 N, Ĝ = ˆM 1 ˆN are left coprime factorizations with stable factors, then ˆ N M ˆ nx ˆN ˆM H 2 σ LQG j 1 + (σ LQG j ) 2 1 2, allows adaptive choice of r! j=r+1 Yields reduced-order LQR/LQG controller for free!

Balancing for Simulation, Control Truncate realization, balanced w.r.t. P = Q = diag(σ 1,..., σ n) = Σ, σ 1... σ r > σ r+1... σ n 0 at size r. Balancing Balanced Truncation and Relatives Matrix Equations Linear-Quadratic Gaussian Balanced Truncation (LQGBT) Jonckheere/Silverman 83 P/Q = controllability/observability Gramian of closed-loop system based on LQG compensator. P, Q solve dual algebraic Riccati equations (AREs) 0 = AP + PA T PC T CP + B T B, 0 = A T Q + QA QBB T Q + C T C. Applies to unstable systems! (Only stabilizability & detectability are required.) Computable error bound comes for free: if G = M 1 N, Ĝ = ˆM 1 ˆN are left coprime factorizations with stable factors, then ˆ N M ˆ nx ˆN ˆM H 2 σ LQG j 1 + (σ LQG j ) 2 1 2, allows adaptive choice of r! j=r+1 Yields reduced-order LQR/LQG controller for free!

Balancing for Simulation of Passive Truncate realization, balanced w.r.t. P = Q = diag(σ 1,..., σ n) = Σ, σ 1... σ r > σ r+1... σ n 0 at size r. Balancing Balanced Truncation and Relatives Matrix Equations Positive-Real Balanced Truncation (PRBT) Green 88 Based on positive-real equations, related to positive real (Kalman-Yakubovich-Popov-Anderson) lemma. For m = p, P, Q solve dual AREs 0 = ĀP + PĀ T + PC T R 1 CP + B R 1 B T, 0 = ĀT Q + QĀ + QB R 1 B T Q + C T R 1 C, where R = D + D T, Ā = A B R 1 C. Preserves stability, strict passivity; needs stability of Ā. Computable error bound [Gugercin/Antoulas 03,B. 05]: G Ĝ PR H 2 R 2 ĜD G D (G D (s) := G(s) + D T, ĜD(s) := Ĝ(s) + DT.) nx k=r+1 σ PR k.

Balancing for Simulation of Passive Truncate realization, balanced w.r.t. P = Q = diag(σ 1,..., σ n) = Σ, σ 1... σ r > σ r+1... σ n 0 at size r. Balancing Balanced Truncation and Relatives Matrix Equations Positive-Real Balanced Truncation (PRBT) Green 88 Based on positive-real equations, related to positive real (Kalman-Yakubovich-Popov-Anderson) lemma. For m = p, P, Q solve dual AREs 0 = ĀP + PĀ T + PC T R 1 CP + B R 1 B T, 0 = ĀT Q + QĀ + QB R 1 B T Q + C T R 1 C, where R = D + D T, Ā = A B R 1 C. Preserves stability, strict passivity; needs stability of Ā. Computable error bound [Gugercin/Antoulas 03,B. 05]: G Ĝ PR H 2 R 2 ĜD G D (G D (s) := G(s) + D T, ĜD(s) := Ĝ(s) + DT.) nx k=r+1 σ PR k.

Balancing for Simulation of Passive Truncate realization, balanced w.r.t. P = Q = diag(σ 1,..., σ n) = Σ, σ 1... σ r > σ r+1... σ n 0 at size r. Balancing Balanced Truncation and Relatives Matrix Equations Positive-Real Balanced Truncation (PRBT) Green 88 Based on positive-real equations, related to positive real (Kalman-Yakubovich-Popov-Anderson) lemma. For m = p, P, Q solve dual AREs 0 = ĀP + PĀ T + PC T R 1 CP + B R 1 B T, 0 = ĀT Q + QĀ + QB R 1 B T Q + C T R 1 C, where R = D + D T, Ā = A B R 1 C. Preserves stability, strict passivity; needs stability of Ā. Computable error bound [Gugercin/Antoulas 03,B. 05]: G Ĝ PR H 2 R 2 ĜD G D (G D (s) := G(s) + D T, ĜD(s) := Ĝ(s) + DT.) nx k=r+1 σ PR k.

Balancing for Control, Simulation, Inverse Problems Truncate realization, balanced w.r.t. P = Q = diag(σ 1,..., σ n) = Σ, σ 1... σ r > σ r+1... σ n 0 at size r. Balancing Balanced Truncation and Relatives Matrix Equations Balanced Stochastic Truncation (BST) Desai/Pal 84, Green 88 P = controllability Gramian of Σ (A, B, C, D), i.e., solution of Lyapunov equation AP + PA T + BB T = 0. Q = observability Gramian of right spectral factor of power spectrum of Σ, i.e., solution of ARE A T W Q + QA W + QB W (DD T ) 1 B T W Q + C T (DD T ) 1 C = 0, where A W := A B W (DD T ) 1 C, B W := BD T + PC T.

Balancing for Control, Simulation, Inverse Problems Truncate realization, balanced w.r.t. P = Q = diag(σ 1,..., σ n) = Σ, σ 1... σ r > σ r+1... σ n 0 at size r. Balancing Balanced Truncation and Relatives Matrix Equations Balanced Stochastic Truncation (BST) Desai/Pal 84, Green 88 P = controllability Gramian of Σ (A, B, C, D), i.e., solution of Lyapunov equation AP + PA T + BB T = 0. Q = observability Gramian of right spectral factor of power spectrum of Σ, i.e., solution of ARE A T W Q + QA W + QB W (DD T ) 1 B T W Q + C T (DD T ) 1 C = 0, where A W := A B W (DD T ) 1 C, B W := BD T + PC T. Preserves stability; needs stability of A W. Computable relative error bound [Green 88]: BST H = G 1 (G Ĝ BST ) H ny j=r+1 1 + σj BST 1, 1 σj BST uniform approximation quality over full frequency range. Note: σ BST j 1.

Balancing for Control, Simulation, Inverse Problems Truncate realization, balanced w.r.t. P = Q = diag(σ 1,..., σ n) = Σ, σ 1... σ r > σ r+1... σ n 0 at size r. Balancing Balanced Truncation and Relatives Matrix Equations Balanced Stochastic Truncation (BST) Desai/Pal 84, Green 88 P = controllability Gramian of Σ (A, B, C, D), i.e., solution of Lyapunov equation AP + PA T + BB T = 0. Q = observability Gramian of right spectral factor of power spectrum of Σ, i.e., solution of ARE A T W Q + QA W + QB W (DD T ) 1 B T W Q + C T (DD T ) 1 C = 0, where A W := A B W (DD T ) 1 C, B W := BD T + PC T. Preserves stability; needs stability of A W. Computable relative error bound [Green 88]: BST H = G 1 (G Ĝ BST ) H ny j=r+1 1 + σj BST 1, 1 σj BST uniform approximation quality over full frequency range. Note: σ BST j 1.

Balancing for Control, Simulation, Inverse Problems Truncate realization, balanced w.r.t. P = Q = diag(σ 1,..., σ n) = Σ, σ 1... σ r > σ r+1... σ n 0 at size r. Balancing Balanced Truncation and Relatives Matrix Equations Balanced Stochastic Truncation (BST) Desai/Pal 84, Green 88 P = controllability Gramian of Σ (A, B, C, D), i.e., solution of Lyapunov equation AP + PA T + BB T = 0. Q = observability Gramian of right spectral factor of power spectrum of Σ, i.e., solution of ARE A T W Q + QA W + QB W (DD T ) 1 B T W Q + C T (DD T ) 1 C = 0, where A W := A B W (DD T ) 1 C, B W := BD T + PC T. Zeros of G(s) are preserved in Ĝ(s). = G(s) minimum-phase = Ĝ(s) minimum-phase. Error bound for inverse system [B. 03] If G(s) is square, minimal, stable, minimum-phase, nonsingular on jr, then! ny G 1 Ĝ 1 1 + σj BST H 1 Ĝ 1 1 σ BST H. j=r+1 j

Balancing for Control, Simulation, Inverse Problems Truncate realization, balanced w.r.t. P = Q = diag(σ 1,..., σ n) = Σ, σ 1... σ r > σ r+1... σ n 0 at size r. Balancing Balanced Truncation and Relatives Matrix Equations Balanced Stochastic Truncation (BST) Desai/Pal 84, Green 88 P = controllability Gramian of Σ (A, B, C, D), i.e., solution of Lyapunov equation AP + PA T + BB T = 0. Q = observability Gramian of right spectral factor of power spectrum of Σ, i.e., solution of ARE A T W Q + QA W + QB W (DD T ) 1 B T W Q + C T (DD T ) 1 C = 0, where A W := A B W (DD T ) 1 C, B W := BD T + PC T. Zeros of G(s) are preserved in Ĝ(s). = G(s) minimum-phase = Ĝ(s) minimum-phase. Error bound for inverse system [B. 03] If G(s) is square, minimal, stable, minimum-phase, nonsingular on jr, then! ny G 1 Ĝ 1 1 + σj BST H 1 Ĝ 1 1 σ BST H. j=r+1 j

Balanced Truncation and Relatives Balancing Balanced Truncation and Relatives Matrix Equations Basic Principle of Balanced Truncation Given positive semidefinite matrices P = S T S, Q = R T R, compute balancing state-space transformation so that P = Q = diag(σ 1,..., σ n ) = Σ, σ 1... σ n 0, and truncate corresponding realization at size r with σ r > σ r+1. Other Balancing-Based Methods Bounded-real balanced truncation (BRBT) based on bounded real lemma [Opdenacker/Jonckheere 88]; H balanced truncation (HinfBT) closed-loop balancing based on H compensator [Mustafa/Glover 91]. Both approaches require solution of dual AREs. Frequency-weighted versions of the above approaches.

Balanced Truncation and Relatives Balancing Balanced Truncation and Relatives Matrix Equations Basic Principle of Balanced Truncation Given positive semidefinite matrices P = S T S, Q = R T R, compute balancing state-space transformation so that P = Q = diag(σ 1,..., σ n ) = Σ, σ 1... σ n 0, and truncate corresponding realization at size r with σ r > σ r+1. All balancing-related methods have nice theoretical properties that make them appealing for applications in simulation, control, optimization, inverse problems.

Balanced Truncation and Relatives Balancing Balanced Truncation and Relatives Matrix Equations Basic Principle of Balanced Truncation Given positive semidefinite matrices P = S T S, Q = R T R, compute balancing state-space transformation so that P = Q = diag(σ 1,..., σ n ) = Σ, σ 1... σ n 0, and truncate corresponding realization at size r with σ r > σ r+1. All balancing-related methods have nice theoretical properties that make them appealing for applications in simulation, control, optimization, inverse problems. But: computationally demanding w.r.t. to memory and CPU time; need efficient solvers for linear (Lyapunov) and nonlinear (Riccati) matrix equations!

Solving Large-Scale Matrix Equations Algebraic Lyapunov and Riccati Equations Balancing Balanced Truncation and Relatives Matrix Equations General form for A, G = G T, W = W T R n n given and P R n n unknown: 0 = L(Q) := A T Q + QA + W, 0 = R(Q) := A T Q + QA QGQ + W. In large scale applications from semi-discretized control problems for PDEs, n = 10 3 10 6 (= 10 6 10 12 unknowns!), A has sparse representation (A = M 1 K for FEM), G, W low-rank with G, W {BB T, C T C}, where B R n m, m n, C R p n, p n. Standard (eigenproblem-based) O(n 3 ) methods are not applicable!

Solving Large-Scale Matrix Equations Algebraic Lyapunov and Riccati Equations Balancing Balanced Truncation and Relatives Matrix Equations General form for A, G = G T, W = W T R n n given and P R n n unknown: 0 = L(Q) := A T Q + QA + W, 0 = R(Q) := A T Q + QA QGQ + W. In large scale applications from semi-discretized control problems for PDEs, n = 10 3 10 6 (= 10 6 10 12 unknowns!), A has sparse representation (A = M 1 K for FEM), G, W low-rank with G, W {BB T, C T C}, where B R n m, m n, C R p n, p n. Standard (eigenproblem-based) O(n 3 ) methods are not applicable!

Low-Rank Approximation ARE 0 = A T Q + QA QBB T Q + CC T Balancing Balanced Truncation and Relatives Matrix Equations Consider spectrum of ARE solution (analogous for Lyapunov equations). Example: Linear 1D heat equation with point control, Ω = [ 0, 1 ], FEM discretization using linear B-splines, h = 1/100 = n = 101. Idea: Q = Q T 0 = n r Q = ZZ T = λ k z k zk T Z (r) (Z (r) ) T = λ k z k zk T. k=1 k=1

Low-Rank Approximation ARE 0 = A T Q + QA QBB T Q + CC T Balancing Balanced Truncation and Relatives Matrix Equations Consider spectrum of ARE solution (analogous for Lyapunov equations). Example: Linear 1D heat equation with point control, Ω = [ 0, 1 ], FEM discretization using linear B-splines, h = 1/100 = n = 101. Idea: Q = Q T 0 = n r Q = ZZ T = λ k z k zk T Z (r) (Z (r) ) T = λ k z k zk T. k=1 k=1

Solving Large-Scale Matrix Equations ADI Method for Lyapunov Equations Balancing Balanced Truncation and Relatives Matrix Equations For A R n n stable, B R n m (w n), consider Lyapunov equation AX + XA T = BB T. ADI Iteration: [Wachspress 1988] (A + p k I )X (j 1)/2 = BB T X k 1 (A T p k I ) (A + p k I )X k T = BB T X (j 1)/2 (A T p k I ) with parameters p k C and p k+1 = p k if p k R. For X 0 = 0 and proper choice of p k : lim k X k = X superlinear. Re-formulation using X k = Y k Y T k yields iteration for Y k...

Solving Large-Scale Matrix Equations ADI Method for Lyapunov Equations Balancing Balanced Truncation and Relatives Matrix Equations For A R n n stable, B R n m (w n), consider Lyapunov equation AX + XA T = BB T. ADI Iteration: [Wachspress 1988] (A + p k I )X (j 1)/2 = BB T X k 1 (A T p k I ) (A + p k I )X k T = BB T X (j 1)/2 (A T p k I ) with parameters p k C and p k+1 = p k if p k R. For X 0 = 0 and proper choice of p k : lim k X k = X superlinear. Re-formulation using X k = Y k Y T k yields iteration for Y k...

Factored ADI Iteration Lyapunov equation 0 = AX + XA T + BB T. Setting X k = Y k Y T k, some algebraic manipulations = Balancing Balanced Truncation and Relatives Matrix Equations Algorithm [Penzl 97/ 00, Li/White 99/ 02, B. 04, B./Li/Penzl 99/ 08] V 1 p 2Re (p 1)(A + p 1I ) 1 B, Y 1 V 1 FOR j = 2, 3,... q V k Re (pk ) `Vk 1 Re (p k 1 (p ) k + p k 1 )(A + p k I ) 1 V k 1 Y k ˆ Y k 1 V k Y k rrlq(y k, τ) % column compression At convergence, Y kmax Yk T max X, where Y kmax = [ V 1... V kmax ], Vk = C n m. Note: Implementation in real arithmetic possible by combining two steps.

Factored ADI Iteration Lyapunov equation 0 = AX + XA T + BB T. Setting X k = Y k Y T k, some algebraic manipulations = Balancing Balanced Truncation and Relatives Matrix Equations Algorithm [Penzl 97/ 00, Li/White 99/ 02, B. 04, B./Li/Penzl 99/ 08] V 1 p 2Re (p 1)(A + p 1I ) 1 B, Y 1 V 1 FOR j = 2, 3,... q V k Re (pk ) `Vk 1 Re (p k 1 (p ) k + p k 1 )(A + p k I ) 1 V k 1 Y k ˆ Y k 1 V k Y k rrlq(y k, τ) % column compression At convergence, Y kmax Yk T max X, where Y kmax = [ V 1... V kmax ], Vk = C n m. Note: Implementation in real arithmetic possible by combining two steps.

Factored Galerkin-ADI Iteration Lyapunov equation 0 = AX + XA T + BB T Balancing Balanced Truncation and Relatives Matrix Equations Projection-based methods for Lyapunov equations with A + A T < 0: 1 Compute orthonormal basis range (Z), Z R n r, for subspace Z R n, dim Z = r. 2 Set  := Z T AZ, ˆB := Z T B. 3 Solve small-size Lyapunov equation  ˆX + ˆX  T + ˆB ˆB T = 0. 4 Use X Z ˆX Z T. : Krylov subspace methods, i.e., for m = 1: Z = K(A, B, r) = span{b, AB, A 2 B,..., A r 1 B} [Jaimoukha/Kasenally 94, Jbilou 02 08]. K-PIK [Simoncini 07], Z = K(A, B, r) K(A 1, B, r).

Factored Galerkin-ADI Iteration Lyapunov equation 0 = AX + XA T + BB T Balancing Balanced Truncation and Relatives Matrix Equations Projection-based methods for Lyapunov equations with A + A T < 0: 1 Compute orthonormal basis range (Z), Z R n r, for subspace Z R n, dim Z = r. 2 Set  := Z T AZ, ˆB := Z T B. 3 Solve small-size Lyapunov equation  ˆX + ˆX  T + ˆB ˆB T = 0. 4 Use X Z ˆX Z T. : Krylov subspace methods, i.e., for m = 1: Z = K(A, B, r) = span{b, AB, A 2 B,..., A r 1 B} [Jaimoukha/Kasenally 94, Jbilou 02 08]. K-PIK [Simoncini 07], Z = K(A, B, r) K(A 1, B, r).

Factored Galerkin-ADI Iteration Lyapunov equation 0 = AX + XA T + BB T Balancing Balanced Truncation and Relatives Matrix Equations Projection-based methods for Lyapunov equations with A + A T < 0: 1 Compute orthonormal basis range (Z), Z R n r, for subspace Z R n, dim Z = r. 2 Set  := Z T AZ, ˆB := Z T B. 3 Solve small-size Lyapunov equation  ˆX + ˆX  T + ˆB ˆB T = 0. 4 Use X Z ˆX Z T. : ADI subspace [B./R.-C. Li/Truhar 08]: Z = colspan [ V 1,..., V r ]. Note: ADI subspace is rational Krylov subspace [J.-R. Li/White 02].

Factored Galerkin-ADI Iteration example Balancing Balanced Truncation and Relatives Matrix Equations FEM semi-discretized control problem for parabolic PDE: optimal cooling of rail profiles ( later), n = 20, 209, m = 7, p = 6. Good ADI shifts CPU times: 80s (projection every 5th ADI step) vs. 94s (no projection). Computations by Jens Saak.

Factored Galerkin-ADI Iteration example Balancing Balanced Truncation and Relatives Matrix Equations FEM semi-discretized control problem for parabolic PDE: optimal cooling of rail profiles ( later), n = 20, 209, m = 7, p = 6. Bad ADI shifts CPU times: 368s (projection every 5th ADI step) vs. 1207s (no projection). Computations by Jens Saak.

Newton s Method for AREs [Kleinman 68, Mehrmann 91, Lancaster/Rodman 95, B./Byers 94/ 98, B. 97, Guo/Laub 99] Balancing Balanced Truncation and Relatives Matrix Equations Consider 0 = R(Q) = C T C + A T Q + QA QBB T Q. Frechét derivative of R(Q) at Q: R Q : Z (A BBT Q) T Z + Z(A BB T Q). Newton-Kantorovich method: ( ) 1 Q j+1 = Q j R Q R(Qj j ), j = 0, 1, 2,... Newton s method (with line search) for AREs FOR j = 0, 1,... 1 A j A BB T Q j =: A BK j. 2 Solve the Lyapunov equation A T j N j + N j A j = R(Q j ). 3 Q j+1 Q j + t j N j. END FOR j

Newton s Method for AREs [Kleinman 68, Mehrmann 91, Lancaster/Rodman 95, B./Byers 94/ 98, B. 97, Guo/Laub 99] Balancing Balanced Truncation and Relatives Matrix Equations Consider 0 = R(Q) = C T C + A T Q + QA QBB T Q. Frechét derivative of R(Q) at Q: R Q : Z (A BBT Q) T Z + Z(A BB T Q). Newton-Kantorovich method: ( ) 1 Q j+1 = Q j R Q R(Qj j ), j = 0, 1, 2,... Newton s method (with line search) for AREs FOR j = 0, 1,... 1 A j A BB T Q j =: A BK j. 2 Solve the Lyapunov equation A T j N j + N j A j = R(Q j ). 3 Q j+1 Q j + t j N j. END FOR j

Low-Rank Newton-ADI for AREs Balancing Balanced Truncation and Relatives Matrix Equations Re-write Newton s method for AREs A T j (Q j + N j ) }{{} A T j A T j N j + N j A j = R(Q j ) + (Q j + N j ) }{{} =Q j+1 A j = C T C Q j BB T Q j }{{} =Q j+1 =: W j W T j Set Q j = Z j Zj T for rank (Z j ) n = ( Zj+1 Zj+1 T ) ( + Zj+1 Zj+1 T ) Aj = W j Wj T Factored Newton Iteration [B./Li/Penzl 99/ 08] Solve Lyapunov equations for Z j+1 directly by factored ADI iteration and use sparse + low-rank structure of A j.

Low-Rank Newton-ADI for AREs Balancing Balanced Truncation and Relatives Matrix Equations Re-write Newton s method for AREs A T j (Q j + N j ) }{{} A T j A T j N j + N j A j = R(Q j ) + (Q j + N j ) }{{} =Q j+1 A j = C T C Q j BB T Q j }{{} =Q j+1 =: W j W T j Set Q j = Z j Zj T for rank (Z j ) n = ( Zj+1 Zj+1 T ) ( + Zj+1 Zj+1 T ) Aj = W j Wj T Factored Newton Iteration [B./Li/Penzl 99/ 08] Solve Lyapunov equations for Z j+1 directly by factored ADI iteration and use sparse + low-rank structure of A j.

Solving Large-Scale Matrix Equations Performance of Matrix Equation Solvers Balancing Balanced Truncation and Relatives Matrix Equations Linear 2D heat equation with homogeneous Dirichlet boundary and point control/observation. FD discretization on uniform 150 150 grid. n = 22.500, m = p = 1, 10 shifts for ADI iterations. Convergence of large-scale matrix equation solvers:

Solving Large-Scale Matrix Equations Performance of matrix equation solvers Balancing Balanced Truncation and Relatives Matrix Equations Performance of Newton s method for accuracy 1/n grid unknowns R(P) F P F it. (ADI it.) CPU (sec.) 8 8 2,080 4.7e-7 2 (8) 0.47 16 16 32,896 1.6e-6 2 (10) 0.49 32 32 524,800 1.8e-5 2 (11) 0.91 64 64 8,390,656 1.8e-5 3 (14) 7.98 128 128 134,225,920 3.7e-6 3 (19) 79.46 Here, Convection-diffusion equation, m = 1 input and p = 2 outputs, P = P T R n n n(n+1) 2 unknowns. Confirms mesh independence principle for Newton-Kleinman [Burns/Sachs/Zietsmann 2006].

: Simulation Microthruster (MEMS) Simulation Control Co-integration of solid fuel with silicon micro-machined system. Goal: Ignition of solid fuel cells by electric impulse. Application: nano satellites. Thermo-dynamical model, ignition via heating an electric resistance by applying voltage source. Design problem: reach ignition temperature of fuel cell w/o firing neighboring cells. Spatial FEM discretization of thermo-dynamical model linear system, m = 1, p = 7. Source: The Oberwolfach Benchmark Collection http://www.imtek.de/simulation/benchmark Courtesy of C. Rossi, LAAS-CNRS/EU project Micropyros.

: Simulation Microthruster (MEMS) Simulation Control axial-symmetric 2D model FEM discretization using linear (quadratic) elements n = 4, 257 (11, 445) m = 1, p = 7. Reduced model computed using SpaRed, modal truncation using ARPACK, and Z. Bai s PVL implementation.

: Simulation Microthruster (MEMS) Simulation Control axial-symmetric 2D model FEM discretization using linear (quadratic) elements n = 4, 257 (11, 445) m = 1, p = 7. Reduced model computed using SpaRed, modal truncation using ARPACK, and Z. Bai s PVL implementation. Relative error n = 4, 257

: Simulation Microthruster (MEMS) Simulation Control axial-symmetric 2D model FEM discretization using linear (quadratic) elements n = 4, 257 (11, 445) m = 1, p = 7. Reduced model computed using SpaRed, modal truncation using ARPACK, and Z. Bai s PVL implementation. Relative error n = 4, 257 Relative error n = 11, 445

: Simulation Microthruster (MEMS) Simulation Control axial-symmetric 2D model FEM discretization using linear (quadratic) elements n = 4, 257 (11, 445) m = 1, p = 7. Reduced model computed using SpaRed, modal truncation using ARPACK, and Z. Bai s PVL implementation. Frequency Response BT/PVL

: Simulation Microthruster (MEMS) Simulation Control axial-symmetric 2D model FEM discretization using linear (quadratic) elements n = 4, 257 (11, 445) m = 1, p = 7. Reduced model computed using SpaRed, modal truncation using ARPACK, and Z. Bai s PVL implementation. Frequency Response BT/PVL Frequency Response BT/MT

: Simulation Spiral Inductor (Micro Electronics) Passive device used for RF filters etc. n = 1, 434, m = 1, p = 1. Simulation Control Source: The Oberwolfach Benchmark Collection http://www.imtek.de/simulation/benchmark

: Simulation Spiral Inductor (Micro Electronics) Simulation Control Passive device used for RF filters etc. n = 1, 434, m = 1, p = 1. rank of Gramians is 34/41. r = 20 passive model computed by PRBT (MorLab). Frequency Response Analysis Absolute Error Source: The Oberwolfach Benchmark Collection http://www.imtek.de/simulation/benchmark

: Control Optimal Cooling of Steel Profiles Simulation Control Mathematical model: boundary control for linearized 2D heat equation. c ρ t x = λ x, ξ Ω λ n x = κ(u k x), ξ Γ k, 1 k 7, x = 0, ξ Γ7. n = m = 7, p = 6. 16 55 51 15 83 34 92 9 10 47 43 FEM Discretization, different models for initial mesh (n = 371), 1, 2, 3, 4 steps of mesh refinement n = 1357, 5177, 20209, 79841. 4 60 22 63 3 2 Source: Physical model: courtesy of Mannesmann/Demag. Math. model: Tröltzsch/Unger 99/ 01, Penzl 99, Saak 03.

: Control Optimal Cooling of Steel Profiles n = 1357, Absolute Error n = 79841, Absolute error Simulation Control BT model computed with sign function method, MT w/o static condensation, same order as BT model. BT model computed using SpaRed, computation time: 8 min.

: Control 2D Heat Control Simulation Control FD discretized linear 2D heat equation with homogeneous Dirichlet boundary and point control/observation. n = 22.500, m = p = 1. Computed reduced-order model (BT): r = 6, BT error bound δ = 1.7 10 3. Solve LQR problem: quadratic cost functional, solution is linear state feedback. Transfer function approximation

: Control 2D Heat Control Simulation Control FD discretized linear 2D heat equation with homogeneous Dirichlet boundary and point control/observation. n = 22.500, m = p = 1. Computed reduced-order model (BT): r = 6, BT error bound δ = 1.7 10 3. Solve LQR problem: quadratic cost functional, solution is linear state feedback. Computed controls and outputs (implicit Euler)

: Control 2D Heat Control Simulation Control FD discretized linear 2D heat equation with homogeneous Dirichlet boundary and point control/observation. n = 22.500, m = p = 1. Computed reduced-order model (BT): r = 6, BT error bound δ = 1.7 10 3. Solve LQR problem: quadratic cost functional, solution is linear state feedback. Errors in controls and outputs

: Control BT vs. LQG BT Simulation Control Boundary control problem for 2D heat flow in copper on rectangular domain; control acts on two sides via Robins BC. FDM n = 4496, m = 2; 4 sensor locations p = 4. ranks of BT Gramians are 68 and 124, respectively, for LQG BT both have rank 210. Computed reduced-order model: r = 10. Source: COMPl eib v1.1, www.compleib.de.

: Control BT vs. LQG BT Simulation Control Boundary control problem for 2D heat flow in copper on rectangular domain; control acts on two sides via Robins BC. FDM n = 4496, m = 2; 4 sensor locations p = 4. ranks of BT Gramians are 68 and 124, respectively, for LQG BT both have rank 210. Computed reduced-order model: r = 10. Source: COMPl eib v1.1, www.compleib.de.

: Control BT vs. LQG BT Simulation Control Boundary control problem for 2D heat flow in copper on rectangular domain; control acts on two sides via Robins BC. FDM n = 4496, m = 2; 4 sensor locations p = 4. ranks of BT Gramians are 68 and 124, respectively, for LQG BT both have rank 210. Computed reduced-order model: r = 10. Source: COMPl eib v1.1, www.compleib.de.

Main message: Balanced truncation and family are applicable to large-scale systems. (If efficient numerical algorithms are employed.) Applications: nanoelectronics, microsystems technology, optimal control, machine tool design, systems biology,... Efficiency of numerical algorithms can be further enhanced, several details require deeper investigation. Algorithms for data-sparse systems using formatted arithmetic for H-matrices [Baur/B. 06/ 08]. Application to 2nd order systems talk of Jens Saak. Extension to descriptor systems possible. [Stykel since 02, B. 03/ 08, Freitas/Martins/Rommes 08, Heinkenschloß/Sorensen/Sun 06/ 08]. Combination of BT with sparse grid interpolation for parametric model reduction [Baur/B. 08/ 09].

Main message: Balanced truncation and family are applicable to large-scale systems. (If efficient numerical algorithms are employed.) Applications: nanoelectronics, microsystems technology, optimal control, machine tool design, systems biology,... Efficiency of numerical algorithms can be further enhanced, several details require deeper investigation. Extension to nonlinear systems employing Carleman bilinearization and tensor product structure of Krylov subspaces in combination with balanced truncation for bilinear systems [B./Damm 09] quite promising, in particular for polynomial nonlinearities as often encountered in biological systems. Theory and numerical algorithm for application to stochastic systems: [B./Damm 09]; need algorithmic enhancements for really large-scale problems.

Support BMBF research network SyreNe System Reduction for Nanoscale IC Design TU Berlin (T. Stykel, A. Steinbrecher) TU Braunschweig (H. Faßbender, J. Amorocho, M. Bollhöfer, A. Eppler) TU Chemnitz (P. Benner, A. Schneider, T. Mach) U Hamburg (M. Hinze, M. Vierling, M. Kunkel) FhG-ITWM Kaiserslautern (P. Lang, O. Schmidt) Infineon Technologies AG (P. Rotter) NEC Europe Ltd. (A. Basermann, C. Neff) Qimonda AG (G. Denk)

Support O-MOORE-NICE! Operational model order reduction for nanoscale IC electronics EU support via Marie Curie Host Fellowships for the Transfer of Knowledge (ToK) Industry-Academia Partnership Scheme. TU Chemnitz (P. Benner, M. Striebel) TU Eindhoven (W. Schilders, D. Harutyunyan) U Antwerpen (T. Dhaene, L. Di Tommasi) NXP Semiconductors (J. ter Maten, J. Rommes)

Support DFG Projects Automatic, Parameter-Preserving for Applications in Microsystems Technology. Jointly with Jan Gerrit Korvink (IMTEK/U Freiburg and FRIAS). Integrated Simulation of the System Machine Tool Drive System Stock Removal Process Using Reduced-Order Structural FE Models. Jointly with Michael Zäh (iwb/tu München) and Heike Faßbender (ICM/TU Braunschweig).