Using Model Order Reduction to Accelerate Optimization of Multi-Stage Linear Dynamical Systems

Similar documents
NOTICE: this is the author s version of a work that was accepted for publication in Computers and Chemical Engineering. Changes resulting from the

Krylov Subspace Methods for Nonlinear Model Reduction

A reduced basis method and ROM-based optimization for batch chromatography

Model Reduction for Dynamical Systems

4.8 Arnoldi Iteration, Krylov Subspaces and GMRES

Krylov-Subspace Based Model Reduction of Nonlinear Circuit Models Using Bilinear and Quadratic-Linear Approximations

The Nearest Doubly Stochastic Matrix to a Real Matrix with the same First Moment

Model Order Reduction for Systems with Non-Rational Transfer Function Arising in Computational Electromagnetics

Optimal startup operation of simulated moving bed chromatographic processes

VALIDATION OF AN ACTUAL SIMULATED MOVING BED UNIT TOWARDS ITS AUTOMATION CONTROL AIMING TO SEPARATE PRAZIQUANTEL ENANTIOMERS

Implicit Volterra Series Interpolation for Model Reduction of Bilinear Systems

Algebraic Multigrid as Solvers and as Preconditioner

Model Order Reduction via Matlab Parallel Computing Toolbox. Istanbul Technical University

LOCALIZED DISCRETE EMPIRICAL INTERPOLATION METHOD

Clustering-Based Model Order Reduction for Multi-Agent Systems with General Linear Time-Invariant Agents

A PRECONDITIONER FOR THE HELMHOLTZ EQUATION WITH PERFECTLY MATCHED LAYER

PROJECTED GMRES AND ITS VARIANTS

Linear programming. Saad Mneimneh. maximize x 1 + x 2 subject to 4x 1 x 2 8 2x 1 + x x 1 2x 2 2

arxiv: v1 [hep-lat] 2 May 2012

On Solving Large Algebraic. Riccati Matrix Equations

A Newton-Galerkin-ADI Method for Large-Scale Algebraic Riccati Equations

Combining multiple surrogate models to accelerate failure probability estimation with expensive high-fidelity models

Order reduction of large scale second-order systems using Krylov subspace methods

Arnoldi Methods in SLEPc

Opportunities for ELPA to Accelerate the Solution of the Bethe-Salpeter Eigenvalue Problem

Towards Reduced Order Modeling (ROM) for Gust Simulations

M.A. Botchev. September 5, 2014

Max Planck Institute Magdeburg Preprints

Applied Mathematics 205. Unit V: Eigenvalue Problems. Lecturer: Dr. David Knezevic

Max Planck Institute Magdeburg Preprints

TWELVE LIMIT CYCLES IN A CUBIC ORDER PLANAR SYSTEM WITH Z 2 -SYMMETRY. P. Yu 1,2 and M. Han 1

Fantope Regularization in Metric Learning

Simple iteration procedure

MODEL-BASED OPTIMIZATION AND CONTROL OF CHROMATOGRAPHIC PROCESSES

Course Notes: Week 1

Machine Learning Applied to 3-D Reservoir Simulation

Low Rank Approximation Lecture 7. Daniel Kressner Chair for Numerical Algorithms and HPC Institute of Mathematics, EPFL

Fast transient structural FE analysis imposing prescribed displacement condition. by using a model order reduction method via Krylov subspace

Fast Frequency Response Analysis using Model Order Reduction

ON THE GLOBAL KRYLOV SUBSPACE METHODS FOR SOLVING GENERAL COUPLED MATRIX EQUATIONS

Dynamics of forced and unsteady-state processes

SIMULATION ASSESSMENT OF CONTINUOUS SIMULATING MOVING BED CHROMATOGRAPHY PROCESS WITH PARTIAL FEED AND NEW STRATEGY WITH PARTIAL FEED

Time scale separation and the link between open-loop and closed-loop dynamics

Nested Krylov methods for shifted linear systems

University of Maryland Department of Computer Science TR-5009 University of Maryland Institute for Advanced Computer Studies TR April 2012

Iterative Methods for Linear Systems of Equations

Using Model Reduction techniques for simulating the heat transfer in electronic systems.

An Algorithmic Framework of Large-Scale Circuit Simulation Using Exponential Integrators

Approximation of the Linearized Boussinesq Equations

Numerical Methods - Numerical Linear Algebra

SUPERCRITICAL FLUID CHROMATOGRAPHY PROCESS OPTIMISATION OF THE SEPARATION OF TOCOPHEROL HOMOLOGUES

The parallel rational Arnoldi algorithm

DELFT UNIVERSITY OF TECHNOLOGY

Model reduction via tangential interpolation

Computational Linear Algebra

DELFT UNIVERSITY OF TECHNOLOGY

On the influence of eigenvalues on Bi-CG residual norms

The Conjugate Gradient Method

Block Iterative Eigensolvers for Sequences of Dense Correlated Eigenvalue Problems

CME342 Parallel Methods in Numerical Analysis. Matrix Computation: Iterative Methods II. Sparse Matrix-vector Multiplication.

A Domain Decomposition Based Jacobi-Davidson Algorithm for Quantum Dot Simulation

Uniform Convergence of a Multilevel Energy-based Quantization Scheme

Automatic Order Reduction for Finite Element Models

Model Reduction for Dynamical Systems

Model Reduction via Projection onto Nonlinear Manifolds, with Applications to Analog Circuits and Biochemical Systems

Iterative methods for Linear System of Equations. Joint Advanced Student School (JASS-2009)

Towards high performance IRKA on hybrid CPU-GPU systems

Fourier Model Reduction for Large-Scale Applications in Computational Fluid Dynamics

Krylov Techniques for Model Reduction of Second-Order Systems

Accepted to appear in SIAM Review, 2015

SOLVING SPARSE LINEAR SYSTEMS OF EQUATIONS. Chao Yang Computational Research Division Lawrence Berkeley National Laboratory Berkeley, CA, USA

University of Bristol - Explore Bristol Research. Peer reviewed version. Link to published version (if available): /6.

Efficient Data Assimilation for Spatiotemporal Chaos: a Local Ensemble Transform Kalman Filter

MATH 12 CLASS 4 NOTES, SEP

FEM and sparse linear system solving

Model Reduction for Linear Dynamical Systems

Tikhonov Regularization of Large Symmetric Problems

ROBUST STABLE NONLINEAR CONTROL AND DESIGN OF A CSTR IN A LARGE OPERATING RANGE. Johannes Gerhard, Martin Mönnigmann, Wolfgang Marquardt

EE5900 Spring Lecture 5 IC interconnect model order reduction Zhuo Feng

6.4 Krylov Subspaces and Conjugate Gradients

1 Extrapolation: A Hint of Things to Come

AMS526: Numerical Analysis I (Numerical Linear Algebra)

Assignment #10: Diagonalization of Symmetric Matrices, Quadratic Forms, Optimization, Singular Value Decomposition. Name:

Statistical approach in complex circuits by a wavelet based Thevenin s theorem

A POD Projection Method for Large-Scale Algebraic Riccati Equations

Contents. Preface... xi. Introduction...

Structured Krylov Subspace Methods for Eigenproblems with Spectral Symmetries

CLASSICAL ITERATIVE METHODS

Computing tomographic resolution matrices using Arnoldi s iterative inversion algorithm

Preconditioned inverse iteration and shift-invert Arnoldi method

Linear Solvers. Andrew Hazel

CAAM 336 DIFFERENTIAL EQUATIONS IN SCI AND ENG Examination 1

DELFT UNIVERSITY OF TECHNOLOGY

Phase space, Tangent-Linear and Adjoint Models, Singular Vectors, Lyapunov Vectors and Normal Modes

Lecture 1: Systems of linear equations and their solutions

Efficient Incremental Analysis of On-Chip Power Grid via Sparse Approximation

Comparing iterative methods to compute the overlap Dirac operator at nonzero chemical potential

The Nullspace free eigenvalue problem and the inexact Shift and invert Lanczos method. V. Simoncini. Dipartimento di Matematica, Università di Bologna

In order to solve the linear system KL M N when K is nonsymmetric, we can solve the equivalent system

Application of Multi-Objective Optimization in the Design of SMB in Chemical Process Industry

Transcription:

Using Model Order Reduction to Accelerate Optimization of Multi-Stage Linear Dynamical Systems Yao Yue, Suzhou Li, Lihong Feng, Andreas Seidel-Morgenstern, Peter Benner Max Planck Institute for Dynamics of Complex Technical Systems Sandtorstraße 1, D-39106 Magdeburg, Germany ABSTRACT: Simulated moving bed SMB) chromatography, an important technique for separating chemical compounds, is usually modeled by a multi-stage dynamical system. After a transient phase, an SMB usually reaches a cyclic steady state CSS), which is of central interest in the analysis of SMB systems. Therefore, computation of the CSS under a given parameter vector requires simulating a relatively high-order SMB model repeatedly, and is therefore already computationally expensive. Optimization of the operating condition requires evaluating the CSS s at all iterates and is computationally even more challenging. In our previous work, we proposed to use Krylov-type model order reduction methods, i.e., a straightforward method along with a partial-update strategy Yue, Li, Feng, Seidel-Morgenstern, & Benner 2014) and a subspace-exploiting strategy Li, Yue, Feng, Seidel-Morgenstern, & Benner 2014), to speed up SMB analysis. This paper puts these results into a more general mathematical framework of using projection-based model order reduction methods, especially Krylov-type methods, to reduce linear multi-stage systems. Special attention is paid to computation and optimization of the CSS. We also show that the two strategies can be combined to achieve an even better speedup. The efficiency of our methods is validated by numerical optimization of a linear SMB system. 1 INTRODUCTION Simulated moving bed SMB) chromatography Broughton & Gerhold 1961) is an important separation technique in chemical engineering. After first applications in petroleum and sugar separation, it serves nowadays as a crucial technique for enantiomer separations in the pharmaceutical industry Ganetsos & Barker 1992). In an SMB unit, multiple chromatographic columns are arranged circularly, and the inlets and outlets are periodically switched. After a transient phase, an SMB process normally reaches a so-called cyclic steady state CSS), which is typically used for production purposes. Since the CSS is a function of the operating conditions, finding an optimal CSS, e.g., the one corresponding to the highest production rate while fulfilling the requirements on production purities, is of great interest in the analysis of SMB systems, e.g., Rajendran, Paredes, & Mazzotti 2009, Seidel-Morgenstern, Keßler, & Kaspereit 2008). In the analysis of SMB processes, mathematical models play an indispensable role Minceva, Pais, & Rodrigues 2003). Thanks to the development of hardware and computing technology, a detailed discretized model that captures more accurate process dynamics can be employed in various analyses. However, although the dimension of such a model is not extremely high, the analysis of SMB processes is still computationally challenging due to the following reasons. First, to compute the CSS, the common practice is either to simulate the SMB system until the CSS is reached, or to solve a much larger linear system where the temporal variable is also discretized Minceva, Pais, & Rodrigues 2003). Second, parametric studies, e.g., operating condition optimization Dünnebier, Fricke, & Klatt 2000) and uncertainty quantification Kurup, Subramani, & Harris 2008), require evaluating the CSS for each parameter accessed, and are therefore much more expensive. Model order reduction MOR) has been proven to be a powerful tool for generating low-dimensional and computationally efficient approximations. Many MOR methods have been proposed and applied successfully in various fields such as circuit design and acoustics Antoulas 2005, Benner, Gugercin, & Willcox 2013). However, the research in reducing multistage systems is still limited. In Yue, Li, Feng, Seidel- Morgenstern, & Benner 2014) and Li, Yue, Feng, Seidel-Morgenstern, & Benner 2014), we proposed to use Krylov-type MOR methods Feldman & Freund 1995, Bai 2002, Meerbergen 2003), which are efficient for large-scale linear systems, to reduce multistage linear SMB systems. This paper will summarize those results and put them in a more general math-

ematical framework. We will first discuss a general framework in reducing multi-stage systems, and then propose two strategies for further speedups. Finally, we will demonstrate the efficiency of the proposed methods using an optimization problem arising from an SMB process. 2 BACKGROUND 2.1 Multi-stage linear systems This paper studies time-triggered multi-stage linear systems of the form: M i ẋ i t) = A i x i t) + B i, i = 1, 2,..., 1a) x i 0) = ϕ i x i 1 t e i)), i = 2, 3,..., 1b) x 1 0) = x 0 1, 1c) where t [0, t e i], M i, A i C n i n i, x i, B i C n i and ϕ i : C n i 1 C n i. When the governing differential equations and transition functions are stageindependent, as is the case of SMB processes, multistage linear systems may have a CSS, whose computation is a main focus of this paper. Therefore, we will pay special attention to the following system: Mẋ i t) = Ax i t) + B, i = 1, 2,..., 2a) x i 0) = ϕ x i 1 t e )), i = 2, 3,..., 2b) x 1 0) = x 0 1, 2c) where t [0, t e ], M, A C n n, x i, B C n and ϕ : C n C n. A CSS x css is a closed trajectory in the phase space as is shown in Fig. 1 and satisfies: ϕ x css t e )) = x css 0). 3) Figure 1: The CSS in the phase space. To compute the CSS, two important methods are the simulation method and the full-discretization method Minceva, Pais, & Rodrigues 2003). In this paper, we use the simulation method, which simulates the system repeatedly until the CSS is reached, as is shown in Fig. 2. 2.2 Projection-based MOR Many MOR techniques, e.g., Krylov-type MOR, balanced truncation and proper orthogonal decomposition POD), can be classified as projection-based Figure 2: of state vectors to CSS in the phase space. MOR Antoulas 2005, Benner, Gugercin, & Willcox 2013). A projection-based MOR approximates the state variable of the i-th stage x i τ) in a subspace colspanv i }, where V i C n k i, k i n, and in practice k i n normally holds. Then, we approximate x i τ) V i x i τ), where x i τ) C k i. 4) Substituting 4) in 1a) and left multiplying the resulting equation by Vi leads to the reduced order model ROM) M i Xi = Âi X i + B i, 5) where [Âi, M i ] = Vi [A i, M i ]V i and B i = Vi B i. Different projection-based MOR methods differ in how they build V i. We will discuss Krylov-type MOR in 3.2. 3 APPLYING PROJECTION-TYPE MOR TO MULTI-STAGE SYSTEMS The main goal of this paper is to use ROMs to accelerate computation of the CSS. However, a main obstacle is that for a ROM as in 5), the CSS may not exist. Assume that system 2) has a unique CSS and it does not lie within colspanv }. Then no CSS can exist in colspanv }. Therefore, except for special cases, a subspace normally contains no CSS. Since the CSS is not well-defined for a subspace, a relaxation, namely the pseudo-css, will be introduced in 3.1 to define a pseudo-cyclic trajectory with the help of a projector. Section 3.1 also shows that if we do not take switching into account in building ROMs, it is highly possible that we run into the problem of projection error during switching. In the rest of 3, we will briefly review Krylov-type MOR, and propose a straightforward method and two strategies for further speedup, which take special care to avoid the projection error during switching. 3.1 MOR of multi-stage systems: projection error during switching and the pseudo-css First we consider the general system 1). To be generic, we allow to approximate x i in different subspaces for different stages. Assume that at the i-th stage, we approximate xt) in the range of an orthonormal matrix V i C n k as x i t) = V i x i t), x i t) C k ). 6)

To approximate x i t) well, the condition x i 0) colspanv i } 7) should be satisfied, since otherwise, the best approximation of x i 0) is V V x i 0) with an error I V V )x i 0). With a bad approximation of the initial condition, the evolution cannot be approximated well. Now we discuss the approximation of transition condition 1b) via ROMs. The ideal case is that, the approximation of x i 0), namely V i x i 0), equals the approximation of ϕ i x i 1 t e i)), namely ϕ i V i 1 x i 1 t e i)). Therefore, the ideal transition is V i x i 0) = ϕ i Vi 1 x i 1 t e i) ). 8) However, equation 8) is an overdetermined system, and it normally does not have a solution unless ϕ i Vi 1 x i 1 t e i) ) colspanv i }, 9) which does not hold in general. If we simply take the least-squares solution x i 0) = V i ϕ i Vi 1 x i 1 t e i) ), 10) the error between the two sides of 8) is ϕ i Vi 1 x i 1 t e i) ) V i x i 0) =ϕ i Vi 1 x i 1 t e i) ) V i V i ϕ i Vi 1 x i 1 t e i) ) =I V i V i )ϕ i Vi 1 x i 1 t e i) ). 11) Therefore, the relative error can even reach 100% when Vi ϕ i Vi 1 x i 1 t e i) ) = 0. Now we study the approximation of the CSS in an arbitrary subspace colspanv }. Denote the CSS approximation by x PCSS. Here we consider system 2) because the CSS can exist only for such systems. Since the initial state approximation of the next stage ϕ V x PCSS t e ) ) does not necessarily lie within colspanv }, we must project it back to colspanv } to define a cyclic behavior. Using an orthogonal projector V V, we define the pseudo-css condition V x PCSS 0) = V V ϕ V x PCSS t e ) ), 12) or equivalently x PCSS 0) = V ϕ V x PCSS t e ) ). 13) The geometric meaning of the pseudo-css condition is illustrated in Fig. 3. It shows that a pseudo-css path can be divided into three phases: 1. In the evolution phase, x PCSS t) evolves from 0 to t e according to the ROM. The state approximation V x PCSS t) always lies within colspanv }. 2. In the switching phase, the end state approximation V x PCSS t e ) is mapped to the ideal initial condition of the next stage, namely ϕ V x PCSS t e ) ), which normally does not lie within colspanv }. 3. In the projection phase, the ideal initial condition of the next stage ϕ V x PCSS t e ) ) is projected to V V ϕ V x PCSS t e ) ), which lies within colspanv }. The pseudo-css condition 12) means that, after projection to colspanv }, the ideal initial condition of the next stage is identical to the initial condition of the current stage. Therefore, with the help of a projector V V, a pseudo cyclic trajectory is defined. Projection Figure 3: Pseudo-CSS in a subspace. If we discretize the ROM 5) in t and impose the pseudo-css condition, we get a linear system in which the number of variables equals the number of equations. Therefore, we expect the ROM to have a unique pseudo-css in most engineering applications. Although the rest of the paper focuses on Krylovtype MOR, the analysis above actually holds for any projection-type MOR. Since a subspace normally has only the pseudo-css, the goal in ROM-based CSS analysis is to build a subspace whose pseudo-css is close to the true CSS. This explains why POD methods Boulkroune, Kinnaert, & Zemouche 2013, Li, Feng, Benner, & Seidel-Morgenstern 2014) only need to sample the CSS for CSS-related analysis, even CSS computation via integration from a transient state. 3.2 A short introduction to Krylov-type MOR Given a matrix A C n n and a vector b C n, the k-th Krylov subspace is defined as K k A, b) = spanb, Ab, A 2 b,..., A k 1 b}. 14) To build a Krylov-subspace, directly computing A i b i = 0, 1,..., k 1) is numerically unstable. Since A is nonsymmetric in our SMB model, we use the classical Arnoldi process Arnoldi 1951) to build an orthonormal basis for the Krylov subspace. Consider the following first-order linear system in the frequency domain: A sm)x = B, Y = l 15) X. With a given frequency shift s 0, we define Ls 0 ) = A s 0 M. 16) Krylov-type MOR approximates X in the Krylov subspace K k Ls 0 ) 1 M, Ls 0 ) 1 B}. Assuming that the columns of V are orthnormal and colspanv } K k Ls 0 ) 1 M, Ls 0 ) 1 B}, 17)

a ROM can be built as  s M) X = B, Ŷ = l X, 18) where [Â, M] = V [A, M]V and [ B, l] = V [B, l]. The Krylov-type ROM 18) is well known to have the moment matching property, i.e., the first Taylor coefficients for V X or Ŷ ) in 18) and X or Y ) in 15) around s 0 match. To reduce the following dynamical system in the time domain with zero initial condition: Mẋ = Ax + B, Σ : y = l x, 19) x0) = 0, we can conduct a Laplace transform to obtain the following system in the frequency domain: A sm)x = 1 B, s Y = l 20) X, which is different from 15) only by a frequency scaling. Therefore, if 15) is approximated well, so is 20). Using a V satisfying 17) to reduce 19), we obtain a Krylov-type ROM in the time domain: M x =  x + B, Σ : ŷ = l x, 21) x0) = 0, where Â, M, B, l are defined the same as in 18). 3.3 A straightforward method In this section, we propose a straightforward method, which builds Krylov-type ROMs for the general multi-stage system 1) and does not suffer from projection error during switching. This basic idea is to use one ROM to approximate the state trajectory of each stage, and take account of the switching behavior when we build ROMs. Consider the switching from the i 1)-st stage to the i-th stage. Our goal is to build a V i such that: 1) good accuracy is achieved in approximating the dynamics of the i- th stage; 2) the ideal transition condition 8) holds, which means that the i-th stage should start with the state ϕ i Vi 1 x i 1 t e i) ). Therefore, in order to use the MOR method for reducing 19) to 21), which requires a full-order model FOM) 19) with zero initial condition, we first conduct the following shift: x i = x i ϕ i Vi 1 x i 1 t e i) ). 22) Then we rewrite the i-th stage of 1) in terms of x i as M i xi = A i x i + A i ϕ i Vi 1 x i 1 t e i) ) + B i, 23a) x i 0) = 0. 23b) Since x i 0) = 0 colspanv i } holds for any nontrivial V i, the initial point is exactly approximated and no projection error occurs due to 7). As system 23) is in the form of 19), the straightforward method directly follows the procedure in reducing 19) to 21). Therefore, it builds the Krylov subspace: K S k; s 0 ) = K k Ai s 0 M i ) 1 M i, A i s 0 M i ) 1 A i ϕ i V i 1 x i 1 t e i)) + B i )} 24) and uses an orthonormal basis of it as column vectors to build V i. With this V i, we can build a ROM of the form 21). This method requires only one LU factorization of A s 0 M), which is used for all stages. For the i-th iteration, the computational dominant part is k linear system solves. We conclude this section with an algorithm for the straightforward method. As a general algorithm that can be used for both transient and CSS analysis, we leave out the convergence condition. Algorithm 1 The straightforward method. 1. Initialization. Choose an initial state x 0, assign i = 1 and x 1 0) = x 0, where x i denotes an approximation of x i. 2. Shift. Shift x i by x i 0) to obtain x i, i.e., x i = x i x i 0); 3. Reduce & Simulate. Build the i-th ROM x i t) of the form 21) by using the subspace 24), and simulate the i-th ROM from t = 0 to t = t e i; 4. Shift Back & Update. Compute x i t e i), i.e., x i t e i) = V i xi t e i)) + x i 0), and x i+1 0) = ϕ i x i t e i)). Set i = i + 1 and go to Step 2. 3.4 Two strategies for further speedups In this section, we will present a partial-update strategy that speeds up the construction of the ROMs, and a subspace-exploiting strategy that reduces the number of ROMs required in computing the CSS. Both strategies apply only to the special formulation 2). 3.4.1 A partial-update strategy Since M, A, and B are stage-independent in 2), we rewrite 23a) as M x i = A x i + [ B, Aϕ V i 1 x i 1 t e ) )] [ 1 1 ], 25) which we reduce using the block Krylov subspace: K k Ls0 ) 1 M, Ls 0 ) 1[ B, AϕV i 1 x i 1 t e )) ]} =K k Ls0 ) 1 M, Ls 0 ) 1 B } K k Ls0 ) 1 M, Ls 0 ) 1 AϕV i 1 x i 1 t e )) }, 26)

where Ls 0 ) is defined in 16). Note that: 1) the first Krylov subspace above does not change among iterations, so it needs to be computed only once; 2) we can use different orders for the two Krylov subspaces Heres & Schilders 2004). Therefore, we define K P k 1, k 2 ; s 0 ) = K k1 Ls0 ) 1 M, Ls 0 ) 1 B } K k2 Ls0 ) 1 M, Ls 0 ) 1 AϕV i 1 x i 1 t e )) }. 27) If the system can be approximated well with k 1 k 2, this method has an advantage due to its lower computational cost since the most columns of V i do not change with i and can be precomputed. Like the straightforward method, this method also requires only one LU factorization. However, for iteration i, the computational dominant part is only k 2 linear solves. To apply the partial-update strategy, we just need to replace subspace 24) with subspace 27) in Step 3 of Algorithm 1. As will be shown in 4, the partial-update strategy works well for SMB systems. 3.4.2 The subspace-exploiting strategy The subspace-exploiting strategy is specially designed to accelerate the computation of the CSS. Although the straightforward method proposed in 3.3 is already efficient in computing the CSS, it does not fully exploit the ROMs since a ROM is used to simulate only one trajectory despite the fact that it allows for an infinite number of trajectories, each corresponding to a different initial reduced state x i 0). The basic idea of the subspace-exploiting strategy is to locate a trajectory in the subspace that is nearest to the true CSS, and at the same time, cheap to compute. Therefore, a reasonable choice is the pseudo- CSS proposed in 3.1. To compute the pseudo-css, the integration method can also be used as is shown in Fig. 4, similar to CSS computation of the FOM. Since building ROMs is computationally much more expensive than simulating ROMs, the subspace-exploiting is expected to be efficient because it uses more ROM simulations to fully exploit the subspaces, and build new ROMs only when it cannot be avoided. We describe its working flow in Algorithm 2. Projection pseudo-css Figure 4: Using the integration method to compute the pseudo- CSS, where we use the original system 2) other than the shifted system 23) for a simpler illustration. Algorithm 2 The inner loop of the subspaceexploiting method in computing the pseudo-css w.r.t. colspanv i }. It is an alternative of Step 3 in Algorithm 1. The notation used in Algorithm 1 is inherited. 1. Initialization. Build the i-th ROM Σ i of the form 21) using either one of the subspace 24) or 27), for which the columns of V i serve as orthonormal basis vectors. Set x i,1 0) = 0, where xi,j represents the state vector of the ROM at the j-th inner iteration. Choose a stopping criterion ɛ i) PCSS > 0, and set j = 1. 2.. Use Σ i to simulate x i,j t) from t = 0 to t = t e. 3. Switching. Compute the ideal initial condition of the next iteration ϕv i xi,j t e ) + x i 0)). 4. Projection. Project the ideal initial condition onto the subspace V i, whose coordinate is xi,j+1 0) = Vi ϕ V i xi,j t e ) + x i 0) ) ) x i 0). 5. Stopping test. If x i,j+1 0) x i,j 0) ɛ i) PCSS, stop; otherwise, set j = j + 1 and go to step 2. Throughout the inner loop, the shift x i 0) and the subspace V i are constants. In general, the true state vector is approximated by x i,j t) V i xi,j t) + x i 0). 28) The first inner iteration evolves from the zero initial condition and the trajectory is identical to that in the straightforward method. At convergence, V i xi,j 0) + x i 0), the initial state approximation of the i-th stage, is close to V i xi,j+1 0) + x i 0) = V i Vi ϕ V i xi,j t e ) + x i 0) ), the initial state approximation of the i + 1)-st stage after projection. Therefore, if Algorithm 2 converges, it must converge to the pseudo-css. 4 NUMERICAL RESULTS Here we use an optimization problem of an SMB process reported by Araújo, Rodrigues, & Mota 2006) to test our proposed methods. The SMB process can be described in the form 2). In this problem, we maximize the feed flow-rate Q F by choosing the parameters p = [Q I, Q II, Q III, Q IV, t e ] T R 5, where Q I Q IV represent the flow-rates in the four zones, and t e denotes the switching period. The optimization constraints are: 1) the purities of the products, which can be computed from x i t) in 2), must reach at least the minimal acceptable purities; 2) some physical constraints must be also satisfied. For more details, see Li, Yue, Feng, Seidel-Morgenstern, & Benner 2014). The numerical results in Table 1 show that using the proposed MOR methods significantly accelerates CSS optimization of the SMB process, and

Table 1: Comparison of optimization results computed by ROMs and the FOM. Model Order CPU time Q I Q II Q III Q IV t e Q F SF FOM 672 88.23 30.000 21.279 25.894 18.397 5.828 4.6152 SROM 50 42.70 30.001 21.260 25.877 18.431 5.834 4.6164 2.07 SROM+S1 75+5 6.23 30.000 21.275 25.880 18.446 5.828 4.6050 14.16 SROM+S2 50 5.28 30.001 21.258 25.877 18.413 5.834 4.6188 16.70 SROM+S1+S2 75+5 4.78 30.000 21.262 25.870 18.416 5.831 4.6086 18.45 SROM stands for the straightforward method, S1 for the partial-update strategy, S2 for the subspace-exploiting strategy and SF for the speedup factor. The units for Q I, Q II, Q III, Q IV and the objective Q F are all ml/min. The units for CPU time and the period t e are minutes. For the partial-update strategy, we specify both k 1 and k 2 for the model order. All computations were performed on a Linux machine with an Intel 3.0 GHz processor and 2 GB RAM, and the code was implemented in Fortran 90. at the same time achieves high accuracy. Unlike the subspace-exploiting strategy, the partial-update strategy requires a higher ROM order to reach similar accuracy. Both strategies further speed up CSS optimization, and the subspace-exploiting strategy turns out to be more efficient. When the two strategies are combined, we achieve the best speedup. In this combined case, since the partial-update strategy leads to cheaper ROM generation and a bit more expensive ROM simulation due to a higher ROM order, further applying the subspace-exploiting strategy does not result in a so significant speedup. However, when we deal with larger-scale FOMs, this further speedup should be more significant. 5 CONCLUSIONS This paper proposes a straightforward method along with two strategies to speed up the analysis of multistage linear dynamical systems. The straightforward method applies to general time-triggered systems and can speed up both transient and CSS analyses. It actually extends easily to stage-triggered multi-stage systems. Besides, we proposed two strategies especially for the analysis of multi-stage linear dynamical systems with stage-independent governing differential equations and transition functions. The partial-update strategy can be used for both transient and CSS analyses, but it can only be combined with Krylov-type MOR methods. The subspace-exploiting strategy can be combined with any projection-based MOR methods, but it can only be used for CSS analysis. When we use Krylov-type MOR methods to speed up CSS analysis, the two strategies can be freely combined to result in an even better speedup. REFERENCES Antoulas, A. C. 2005). Approximation of large-scale dynamical systems, Volume 6 of Advances in Design and Control. SIAM. Araújo, J. M. M., R. C. R. Rodrigues, & J. P. B. Mota 2006). Use of single-column models for efficient computation of the periodic state of a simulated moving-bed process. Ind. Eng. Chem. Res. 4515), 5314 5325. Arnoldi, W. E. 1951). The principle of minimized iterations in the solution of the matrix eigenvalue problem. Quarterly of Applied Mathematics 917), 17 29. Bai, Z. 2002). Krylov subspace techniques for reduced-order modeling of large-scale dynamical systems. Applied Numerical Mathematics 431 2), 9 44. Benner, P., S. Gugercin, & K. Willcox 2013, August). A survey of model reduction methods for parametric systems. Max Planck Institute Magdeburg Preprint MPIMD/13-14, MPI-Magdeburg. Available from http:// www.mpi-magdeburg.mpg.de/preprints/. Boulkroune, B., M. Kinnaert, & A. Zemouche 2013). PODbased state estimation of simulated moving bed chromatographic processes. In Proceedings of the 12th European Control Conference, Zurich, Switzerland, pp. 3408 3414. Broughton, D. B. & C. G. Gerhold 1961). Continuous sorption process employing fixed beds of sorbent moving inlets and outlets. U.S. Patent, 2,985,589. Dünnebier, G., J. Fricke, & K.-U. Klatt 2000). Optimal design and operation of simulated moving bed chromatographic reactors. Ind. Eng. Chem. Res. 397), 2290 2304. Feldman, P. & R. W. Freund 1995). Efficient linear circuit analysis by Padé approximation via the Lanczos process. IEEE Trans. Computer-Aided Design 145), 639 649. Ganetsos, G. & P. Barker 1992). Preparative and Production Scale Chromatography. CRC Press. Heres, P. & W. Schilders 2004). Practical issues of model order reduction with Krylov-subspace methods. In Progress in Electromagnetic Research Symposium 2004, Pisa, Italy, pp. 583 586. Kurup, A. S., H. J. Subramani, & M. T. Harris 2008). A Monte Carlo-based error propagation analysis of simulated moving bed systems. Sep. Purif. Technol. 623), 582 589. Li, S., L. Feng, P. Benner, & A. Seidel-Morgenstern 2014). Using surrogate models for efficient optimization of simulated moving bed chromatography. Computers & Chemical Engineering 144), 121 132. Li, S., Y. Yue, L. Feng, A. Seidel-Morgenstern, & P. Benner 2014). Model reduction for linear simulated moving bed chromatography systems using Krylov-subspace methods. Submitted to AIChE J. Meerbergen, K. 2003). The solution of parametrized symmetric linear systems. SIAM Journal on Matrix Analysis and Applications 244), 1038 1059. Minceva, M., L. S. Pais, & A. E. Rodrigues 2003). Cyclic steady state of simulated moving bed processes for enantiomers separation. Chem. Eng. Process. 422), 93 104. Rajendran, A., G. Paredes, & M. Mazzotti 2009). Simulated moving bed chromatography for the separation of enantiomers. J. Chromatogr. A 12164), 709 738. Seidel-Morgenstern, A., L. C. Keßler, & M. Kaspereit 2008). New developments in simulated moving bed chromatography. Chemical Engineering & Technology 316), 826 837. Yue, Y., S. Li, L. Feng, A. Seidel-Morgenstern, & P. Benner 2014). Efficient model reduction of SMB chromatography by Krylov-subspace method with application to uncertainty quantification. In Proceedings of ESCAPE 24.