arxiv: v1 [math.na] 23 Jun 2015

Transcription

1 Real-time solution of computational problems using databases of parametric linear reduced-order models with arbitrary underlying meshes David Amsallem a,, Radek ezaur a, Charbel Farhat b a Department of Aeronautics and Astronautics, Durand Building, 496 Lomita Mall. Stanford University, Stanford, , USA b Department of Aeronautics and Astronautics, Institute for Computational and Mathematical Engineering, Department of Mechanical Engineering. Stanford University, Mail Code 435, Stanford, CA 9435, U.S.A. arxiv:56.753v [math.na] 23 Jun 25 Abstract A comprehensive approach for real-time computations using a database of parameterized linear reducedorder models ROMs is proposed. he method proceeds by sampling offline ROMs for specific values of the parameters and interpolating online the associated reduced operators. In the offline phase, a preprocessing step transforms the reduced operators into consistent sets of generalized coordinates prior to their interpolation. he present paper also introduces a consistency enforcement approach for models defined on arbitrary underlying meshes. In the online phase, the operators are interpolated on matrix manifolds. he proposed framework is illustrated on two realistic multi-physics problems: an inverse acoustic scattering problem around a submarine and flutter predictions for a wing-tank system. he second application is implemented on a mobile device, illustrating the capability of the proposed framework to operate in realtime. Keywords: Parametric model order reduction, database, interpolation, mobile computing, aeroelasticity, acoustic scattering. Introduction Many engineering applications require the ability to generate predictions of the behavior of physical systems in real-time. Among those applications, one can mention design optimization, optimal control, the solution of inverse problems as well as uncertainty quantification. All of these applications require a large number of predictions for varying values of operating conditions. he operating conditions, usually described by a set of parameters, may define boundary conditions, initial conditions, physical or shape parameters that define the problem of interest and its underlying differential equations. However, each of these predictions usually demands computationally intensive calculations as accurate discretization of the underlying differential equations often leads to large scale systems of equations. Projection-based model reduction [, 2] reduces the large computational cost associated with each solution of the underlying high-dimensional model HDM by reducing the number of degrees of freedom in the computation. For this purpose, a reduced-order basis ROB is defined and the solution is restricted to the subspace described by the ROB. he current most challenging model reduction problems are those associated with nonlinear systems and parameter variations. Nonlinear systems require additional levels of approximation to enable large computational speedups [3, 4, 5, 6, 7, 8]. he model reduction of parameterized systems is also challenging due to the non-robustness of reduced-order model with respect to parameter variations that requires an appropriate offline training phase [9,,, 2]. Approaches addressing the addresses: amsallem@stanford.edu David Amsallem, rtezaur@stanford.edu Radek ezau, cfarhat@stanford.edu Charbel Farhat URL: stanford.edu/ amsallem David Amsallem Preprint submitted to Elsevier October, 28

2 model reduction of nonlinear parameterized systems are proposed in [3, 4, 5, 6]. he focus of the present paper is on the efficient model reduction of linear parameterized systems. More specifically, for linear parameterized systems, database approaches can be developed by precomputing in an offline phase the reduced linear operators of a common reduced dimension for specific values of the parameters [, 7, 8,, 9, 2, 2].hese linear operators are subsequently interpolated in the online phase for values of the parameters not present in the database. he small dimensionality of the reduced operators leads to real-time interpolation and predictions on-the-fly. he interpolation of local reduced operators is however a challenging because each reduced operator is written in terms of a distinct set of generalized coordinates corresponding to the local ROBs associated with each reduced-order model ROM. o address this issue, approaches based on congruent transformations are proposed in [8, 2, 2] when the underlying HDMs are defined on a common mesh. hese approaches cannot, however, be applied when each HDM is defined on a different mesh. he present paper introduces a novel approach, also based on congruent transformations, that addresses the challenge associated with arbitrary underlying meshes. Special care is also given in this paper to the interpolation step of the proposed procedure. he preservation of properties associated with the linear reduced operators can indeed be enforced by interpolating these operators on appropriate matrix manifolds [, 7, 8, 9, 2]. In that case, after appropriately mapping the reduced operators, interpolation can be carried out in the tangent space to the matrix manifold. As such, as long as the interpolation procedure preserves the tangent space, the interpolated quantity will also belong to the tangent space and can be mapped back to the manifold, leading to an interpolated reduced quantity that preserves its properties. his paper is organized as follows. he problem of interest and the ROM database approach are formulated in Section 2. he issue of consistency of reduced-order operators and its enforcement in the case of common and arbitrary underlying meshes are then investigated in Section 3. he interpolation of the resulting consistent database of ROMs is developed in Section 4. Special care is given to the sampling, storage and exploitation of the database. he proposed approach is applied in Section 5 to the model reduction of two parameterized systems. he first one is the analysis of a parameterized acoustic scattering system defined on arbitrary underlying meshes. In that case, the database approach is applied to the online solution of inverse problems. he second problem is the real-time flutter analysis of an aeroelastic system for flight conditions ranging from the subsonic to supersonic regimes. It is shown that the proposed approach successfully enables real-time predictions on a mobile device. Finally, conclusions are given in Section Problem formulation and solution approach In this paper, linear-time invariant parametric LIP systems of one of the following two forms are considered. First-order LIP systems of the form and their formulation in the frequency domain Eµ dw t = Aµwt + Bµut dt jωeµ Aµwω = Bµuω. 2 he high-dimensional state vector is w R N, j 2 =, t denotes time and ω frequency. E and A are square high-dimensional matrices of dimension N. u R Ni denotes the input variable of dimension N i N and B R N Ni. All operators depend on a vector of N µ parameters µ D R Nµ. For both formulations, an output quantity of interest y R No is defined as with N o N and G R No N and H R No Ni. y = Gµw + Hµu, 3 2

3 2. Second-order LIP systems of the form Mµ d2 w t + Cµdw t + Kµwt = Bµut 4 dt2 dt and their equivalent formulation in the frequency domain are considered ω 2 Mµ + jωcµ + Kµwω = Bµuω. 5 M, C and K are also parameter-dependent square linear operators of dimension N. For both formulations, an output quantity of interest y can be defined as in 3. he problem of interest is the fast computation of the output y for a given value of the parameters µ D. More specifically, the computational cost associated with these computations should not scale with N anymore. o address this problem, an approach based on a database of linear projection-based ROMs is considered. his approach proceeds in two steps.. In the first offline step, N DB sample parameter values {µ i } NDB i= D RNµ are selected and ROMs are constructed for each parameter value by defining right and left reduced-order bases ROBs Vµ R N k and Wµ R N k, k N and approximating the state w as w Vµq where q R k is either solution of a reduced LIP system in the time domain or frequency domain, as detailed below. he output equation in terms of the reduced variable q is then with G r µ = GµVµ R No k. y r = G r µq + Hµu 6 a For first-order LIP systems, the reduced equations in the time-domain are and in the frequency domain E r µ dq dt t = A rµqt + B r µut 7 jωe r µ A r µqω = B r µuω. 8 where E r µ = Wµ EµVµ R k k, A r µ = Wµ AµVµ R k k and B r µ = Wµ Bµ R k Ni. b For second-order LIP systems, the time-domain reduced equations are M r µ d2 q dt 2 t + C rµ dq dt t + K rµqt = B r µut 9 where M r µ = Wµ MµVµ, C r µ = Wµ CµVµ and K r µ = Wµ KµVµ are square reduced operators of dimension k. he reduced equations in the frequency domain are ω 2 M r µ + jωc r µ + K r µqω = B r µuω. here are several model reduction techniques that can be applied to construct the ROBs Wµ and Vµ for LI systems. Among those, the most popular are proper orthogonal decomposition POD [2, 22], balanced truncation [] and moment matching [23, 24]. Once the reduced operators are computed for the sampled values of the parameters, these reduced matrices are stored in a database of the form DB = {µ i, E r µ i, A r µ i, B r µ i, G r µ i, Hµ i } NDB i= 3

4 for first-order systems and for second-order systems. DB = {µ i, M r µ i, C r µ i, K r µ i, B r µ i, G r µ i, Hµ i } NDB i= 2 In this work, the left and right ROBs are assumed to have orthonormal columns with respect to a common symmetric positive definite matrix M, that is Wµ MWµ = I k and Vµ MVµ = I k. his property can be easily enforced a posteriori by applying a Gram-Schmidt orthogonalization procedure to the columns of non-orthonormal ROBs or directly in the ROB construction procedure [25]. 2. In the online phase, for a given value µ D of the parameters, reduced operators are constructed by interpolation of the elements of the database DB. wo technical issues however arise in the online interpolation step associated with the proposed approach:. he reduced quantities are not defined in the same system of reduced coordinates. Indeed, for each parameter µ i, the system of reduced coordinates is defined by the local ROBs Vµ i and Wµ i. A naive interpolation of the reduced operators may result in interpolation quantities that are not consistent with each other. A comprehensive approach to address this issue is proposed in Section 3 2. he linear operators stored in the database DB may have properties that should be preserved by interpolation. An approach relying on interpolation on a matrix manifold has been proposed in [7, 2] to preserve these properties. he approach is briefly recalled and extended in Section Consistency between reduced-order models 3.. Concept As underlined in the previous section and in [2], the fact that local reduced operators are defined in different sets of generalized coordinates prevents their direct interpolation. In this paper, two approaches are presented to address this issue. Both rely on a congruence transformation of the reduced operators to enforce consistency. hey recognize the fact that the choice of local ROBs is not unique. Indeed, for a given right ROB Vµ, any ROB of the form VµQ with Q Q = I k defines an equally valid coordinate representation for the same ROM [2] with M-orthogonal columns. Similarly, for the left ROB Wµ, any left ROB of the form WµZ with Z Z = I k defines an equally valid basis. In turn, for a given first-order LI ROM R = E r, A r, B r, G r, H, an equivalence class of ROMs under left and right multiplications by orthogonal matrices Z and Q can be defined as CR = { Z E r Q, Z A r Q, Z B r, G r Q, H such that Z Z = I, Q Q = I }. 3 Similarly, for a second-order LI ROM R = M r, C r, K r, B r, G r, H, the equivalence class of ROMs under left and right multiplications by orthogonal matrices Z and Q is CR = { Z M r Q, Z C r Q, Z K r Q, Z B r, G r Q, H such that Z Z = I, Q Q = I }. 4 Both approaches proposed in this paper will rely on a preprocessing step for which optimal transformations Q µ i and Z µ i, i =,, N DB are applied to the N DB ROMs stored in the database DB. he first approach, originally introduced in [2] and described in Section 3.2 is applicable whenever the underlying HDMs are defined on the same reference mesh. he location of the mesh nodes is potentially parameter dependent but the topology of the mesh is common to all parameter values. his requirement is relaxed in Section 3.3 where a novel approach is introduced to enforce consistency in the case of arbitrary meshes. In that case, each HDM can have a different number of dofs. A word of caution should however be formulated regarding interpolation of reduced linear operators. here are cases for which consistency cannot be enforced. Consider for instance the case of two configurations 4

5 µ and µ 2 associated with a common mesh and for which the right ROBs Vµ and Vµ 2 are orthogonal to each other. In that case, the subspaces respectively defined by the ROBs are orthogonal as well and no transformation of the form {Vµ i Qµ i } 2 i= can define a consistent set of reduced coordinates. he degree of consistency between two ROBs will be quantitatively defined in the case of common underlying meshes in Section 3.2 and a truncation procedure introduced to further enforce consistency Enforcement in the case of a common underlying mesh Consistency can be enforced in the case of a common underlying mesh by solving a series of Procrustes problems [2]. More specifically, given two local right reduced bases V i = Vµ i and V j = Vµ j, V j can be written in terms of V i as V j = V i R ij + ij 5 where ij is the component of V j that is M-orthogonal to V i i.e. ij MV i =. he subspace angles between the ROBs V i and V j define a measure of the maximum achievable consistency. he subspace angles can be computed by the following three-step procedure:. Form V i MV j = R ij. 2. Compute a singular value decomposition R ij = XΣY where X = [x,..., x k ], Y = [y,..., y k ] and Σ = diagσ,, σ k. 3. Compute the subspace angles as θ l = arccosσ l, l =,, k. he canonical vectors associated with each angle θ l are V i x l, V j y l. Note that the angles are ordered increasingly as θ θ k π 2. A subspace angle θ l that is equal to zero reflects perfect consistency between the associated vectors V i x l and V j y l. In general, angles that are greater than a threshold θ max = π 4 may define cases for which consistency cannot be achieved. One option to address this issue that is discussed below is to truncate the directions associated with those large angles. An alternate option is to refine the database until smaller subspace angles are achieved. For a given database DB, optimal transformations {Qµ i } NDB i= can be computed by fixing one of the ROBs say Qµ i = I k and computing the transformations as the minimizers of the following series of Procrustes problems: Qµ i = argmin S R k k V i S V i M, i =,, N DB, s.t. S S = I k, 6 where N M = M 2 N F. he optimal transformation Qµ i can be determined analytically from the SVD of R ii as Qµ i = XY. 7 As stated above, truncation of the ROBs can be used to enforce consistency. For each ROB V i, i =,, N DB, the maximum index l i for which the subspace angles with V i are smaller than θ max can be determined and all ROM truncated to the index L = min l i. 8 i=,,n DB runcating the ROMs will result in a loss of accuracy of each ROM when compared to the underlying HDM. However, this truncation step will improve accuracy after interpolation of the elements of the database as these will be more consistent. 5

6 3.3. Enforcement in the case of arbitrary underlying meshes In the case of arbitrary meshes, subspace angles cannot be defined as the underlying HDM spaces may be of different, parameter-dependent dimensions Nµ i. o address this issue, a heuristic procedure is developed in this section to enforce consistency for that specific scenario. As in the case of the Procrustes problem, one of the ROMs R i is selected to define a reference configuration. hen, for each ROM R i, i =,, N DB in the database, a transformed ROM R i is determined as the minimizer of a measure of distance of the reference ROM R i to the equivalence class CR i as he minimization problem is schematically depicted in Fig.. R i = argmin D i R, R i. 9 R CR i D i R? i, R i? Ri R i CR i CR i Figure meshes Schematic description of the minimization problem for consistency enforcement in the case of arbitrary he measure of distance D i R, R i is defined as follows:. For a first-order system, the distance between R = E r, A r, B r, G r, H and R = E r, A r, B r, G r, H is defined as the normalized expression D i R, R = ɛ E r E r 2 F + α A r A r 2 F + β B r B r 2 F + γ G r G r 2 F + η H H 2 F 2 where ɛ = E r 2, α = F A r 2, β = F B r 2, γ = F G r 2, η = F H 2 F are normalization constants based on the reduced operators in R i = E r, A r, B r, G r, H For a second-order system, the distance between R = M r, C r, K r, B r, G r, H and R = M r, C r, K r, B r, G r, H is defined as D i R, R = µ M r M r 2 F +ξ C r C r 2 F +κ K r K r 2 F +β B r B r 2 F +γ G r G r 2 F +η H H 2 F 22 where µ = M r 2, ξ = F C r 2, κ = F K r 2 23 F are normalization constants based on the reduced operators in R i = M r, C r, K r, B r, G r, H. 6

7 In practice, since the class CR i is parameterized by two transformation matrices Q and Z, the optimization problem 9 can be explicitly written for a first-order system in terms of R i = E ri, A ri, B ri, G ri, H i, R i and Q, Z as min Q,Z ɛ Z E ri Q E r 2 F + α Z A r Q A r 2 F + β Z B r B r 2 F + γ G r Q G r 2 F + η H H 2 F s.t. Q Q = I k, Z Z = I k. 24 A similar expression holds for second-order systems. he rest of this section will focus on first-order systems but the analysis directly carries over to second-order systems as well. Remark. In the case of Galerkin projection, Wµ i = Vµ i and Q = Z. hen 9 simplifies to min Q ɛ Q E ri Q E r 2 F + α Q A r Q A r 2 F + β Q B r B r 2 F + γ G r Q G r 2 F + η H H 2 F s.t. Q Q = I k. Problem 24 is equivalent to the maximization problem [8] 25 max Q,Z ɛz E ri Q, E r + αz A ri Q, A r + βb r B r, Z + γg r G r, Q s.t. Q Q = I k, Z Z = I k, 26 where M, N = trm N, M, N R m n. 27 he problem of maximizing the first term in Eq. 26 has been studied in the literature [26, 27] in the case Q = Z Galerkin projection. his first term defines a correlation criterion between the matrices E ri and E r. A solution to that problem developed in Ref. [26], consists of defining an iterative algorithm whose fixed points are the critical points of the maximization problem. his approach is here extended to the optimization problem of interest for enforcing consistency between ROM operators. Both Galerkin and Petrov-Galerkin projections are considered as follows. Galerkin projection. In this case, the functional in 26 is J G Q = ɛq E ri Q, E r + αq A ri Q, A r + βb r B r, Q + γg r G r, Q. 28 Adapting the algorithm developed in [26] to the present case, the iterative algorithm is based on an affine map defined as M s,g Q = ɛ E ri Q E + E ri QE r + α A ri Q A + A ri QA r + sq + βb ri B r + γg ri G r, 29 where s is a fixed real parameter chosen such that s > s min,g with s min,g = 2ɛ E ri E 2 2 r + 2α A ri A 2 2 r + βb ri B r + γg ri G r. 3 2 Defining the parameter s is necessary to ensure that the fixed points of the proposed iterative algorithm are exactly the critical points of the maximization problem see heorem. he proposed procedure then proceeds by iteratively solving the maximization problem Q j+ = arg max S S=I k S, M s,g S j, j =,. 3 7

8 he solution to this problem is established in the following lemma, leading to the proposed iterative procedure presented in Algorithm. Lemma. Let the singular value decomposition of M s,g Q j be defined as hen M s,g Q j = UΣV. 32 max Q, M s Q j = Q Q=I k k σ l M s,g Q j, 33 where {σ l M s,g Q j } k l= is the set of singular values of M s,gq j. he solution to the maximization problem is unique and equal to UV. A proof is offered in [26] in a more general setting. Algorithm Fixed-point procedure in the case of Galerkin projection : Compute s > 2ɛ E ri 2 E r 2 + 2α A ri 2 A r 2 + βb ri B r + γg ri G r. 2 2: Compute F = βb ri B r + γg ri G r. 3: Choose an orthogonal initial matrix Q R k k. 4: for j =, do 5: Compute the map M s,g Q j = ɛ E ri Q j E r + E ri Q j E r + α A ri Q j A r + A ri Q j A r + sq j + F l= 6: Compute its SVD U j+ Σ j+ V j+ = M s,g Q j 7: Q j+ = U j+ V j+ 8: end for In order to show that the fixed points of the recursive algorithm are the critical points of J G, one needs to characterize these critical points. his is done in the following theorem. heorem. he critical points Q of J G are orthogonal matrices satisfying the identity Q S = ɛ E ri Q E + E ri Q E r + α A ri Q A + A ri Q A r + βb ri B r + γg ri G r, 34 where S is a symmetric matrix. A proof is offered in Appendix. heorem 2. he set of the fixed points of the recursive Algorithm is exactly the set of the critical points of J G. A proof of the theorem is presented in Appendix 2. Petrov-Galerkin projection. Defining the functional J P G Q, Z = ɛz E ri Q, E r + αz A ri Q, A r + βb r B r, Z + γg r G r, Q, 35 8

9 the iterative algorithm is now based on the block-affine map defined as [ M Q ] M s,pg Q, Z = s,pg Q, Z M Z s,pg Q, Z [ ] [ ] [ Eri Q E ] = ɛ E r ri Z E r [ ] [ ] [ Ari Q A + α A r ri Z A r [ ] [ Q + s + βbri B ] r Z γg, ri G r ] 36 where s is chosen such that s > s min,pg with s min,pg = ɛ E ri E 2 2 r + α A ri A 2 2 r + max β B ri B r 2, γ G rig r Similarly as in the case of Galerkin projection, a fixed point procedure is defined in Algorithm 2. he Algorithm 2 Fixed-point procedure in the case of Petrov-Galerkin projection : Compute s > ɛ E ri 2 E r 2 + α A ri 2 A r 2 + max β B ri B r 2, γ G ri G r. 2 2: Compute F B = βb ri B r and FG = γg ri G r. 3: Choose orthogonal initial matrices Q R k k and Z R k k. 4: for j =, do 5: Compute the maps and 6: Compute their SVDs and M Q s,pg Q j, Z j = ɛe ri Z j E r + αari Z j A r + sqj + F G M Z s,pgq j, Z j = ɛe riq j E r + αa ri Q j A r + szj + F B U Q j+ ΣQ j+ VQ j+ = MQ s,pg Q j U Z j+σ Z j+v Z j+ = M Z s,pgq j 7: Q j+ = U Q j+ VQ j+ 8: Z j+ = U Z j+ VZ j+ 9: end for following theorems, whose proofs follow closely the ones of heorems and 2, establish the fact that the fixed point procedure in Algorithm 2 can be used to find critical points of J P G. heorem 3 he critical points Q, Z of J P G are orthogonal matrices satisfying the identities where S Q and S Z are symmetric matrices. Q S Q = ɛe ri Z E + αari Z A + γg ri G r, Z S Z = ɛe riq E + αa ri Q A r + βbri B 38 r, heorem 4. he set of the fixed points of the recursive Algorithm 2 is exactly the set of the critical points of J P G. 9

10 Remark. For the case of arbitrary meshes, assessing consistency is a more difficult task as two conflicting factors intervene in the distance measure D i : the inconsistency arising from a choice of two distinct sets of coordinates and 2 the inherent variation of the ROM operators due to parameter changes Consistent set of reduced-order models After the computation of the optimal transformation operators {Z µ i, Q µ i } Nµ i=, the reduced operators in the database DB are transformed accordingly as DB = {µ i ; E rµ i, A rµ i, B rµ i, G rµ i, H rµ i } Nµ i= = { µ i ; Z µ i E r µ i Q µ i, Z µ i A r µ i Q µ i, Z µ i B r µ i, G rµ i Q µ i, H r µ i } N µ i=. 39 Similar expressions hold for the case of second-order systems. 4. Interpolation in a database of ROMs on matrix manifolds 4.. Interpolation As indicated in Section 2, the interpolation of the linear operators stored in the database DB should often preserve properties of the operators such as symmetry, positivity, orthogonality or non-singularity. An approach to preserve these properties was first presented in []. It is based on the interpolation on the tangent space of the appropriate manifold and was applied to the case of interpolation of reduced operators in [7, 9, 2]. he algorithm proceeds for each of the elements of the database in four steps as follows:. An identification of the manifold the reduced matrices belong to 2. A mapping logarithmic map of all the database reduced matrices to the tangent space of the manifold at one of the database points 3. An interpolation of the mapped quantities in the tangent space at the target parameter µ 4. A mapping exponential map of the interpolated quantity back to the manifold leading to a reduced operator at the target parameter µ More details on the interpolation algorithm as well as the formulas for computing the mapping are provided in [2, 8]. In practice there may be several choices for an interpolation procedure on matrix manifolds as underlined by the following two cases. In [9], the authors develop a heuristic technique for interpolating non-singular matrices either on the manifold on non-singular matrices or square matrices. he heuristic proceeds by selecting the manifold for which a nonlinearity criterion is the smallest. his heuristic is applied in Section 5.2. An alternative to interpolating symmetric positive definite matrices on the tangent space to that manifold is to use the Choleski factorization. his novel approach is described in Algorithm 3 and applied in Section 5.. his approach avoids selecting one of the database points and interpolating in its associated tangent space. It preserves the SPD properties of the matrices as long as the interpolated quantity on the diagonal of the Choleski factor are all strictly non zero. here is no restriction on the interpolation technique in the tangent space to the matrix manifold of interest as long as the it leads to an interpolated quantity that preserves the tangent space [2]. In [28], the author identifies an interpolation technique that does not preserve that property. When the database parameters belong to a lattice of points, spline or polynomial interpolation can be used in the tangent space. When the dimension N µ of the parameter domain is large, however, interpolating from a lattice of points is not an option and instead, interpolation based on radial basis functions or Kriging can be used instead [, 8, 29].

11 Algorithm 3 Interpolation of SPD matrices by Choleski factorization : for i =,, N DB do 2: Compute the Choleski factorization K ri = S i S i 3: end for 4: Interpolate the Choleski factors {S i } NDB i=, leading to an interpolated factor S 5: Compute the interpolated matrix as K r = S S 4.2. Sampling he selection of sample points {µ i } N DB i= is an important step that influences the accuracy of the resulting interpolation approach. A poor choice of sample points will result in large errors of the proposed procedure in some regions of the parameter domain D. A priori sampling techniques such as factorial and latin hypercube sampling can be used to provide a uniform coverage of D. Alternatively, greedy techniques that iteratively sample the regions of the parameter space associated with the largest ROM error can provide a selection of the samples that is more suited for the problem of interest. Such greedy techniques have been introduced in the context of model reduction in general in [9, 3, 3, 3, 4, 32] and for interpolation of LIP ROM systems in particular in [29]. A priori sampling will be used in the application of Section 5.2 and a greedy sampling approach developed for the inverse problem application of Section Storage and exploitation In practice the reduced operators are stored after their congruence transformation in one database DB or several sub-databases {DB } Ns s= of the form DB = N S s= for first-order systems and DB = N S s= DB s = DB s = N S s= N S s= {µ i ; E rµ i, A rµ i, B rµ i, G rµ i, H µ i } N DB,s i= 4 {µ i ; M rµ i, C rµ i, K rµ i, B rµ i, G rµ i, H µ i } N DB,s i= 4 for second-order systems. Storing the database is inexpensive as it only involves reduced operators. In practice, a database with N DB = S s= N DB,s contains N DB N µ + 2k 2 + kn i + N o + N i N o matrix entries for first-order systems of the form and N DB N µ + 3k 2 + kn i + N o + N i N o entries for second-order systems of the form 4. he parameter domain D is in practice subdivided in N S non-overlaping subdomains {D s } N S s= such that D = N S s= D s 42 and each subdomain D s is associated with the sub-database DB s. hen, in the online phase, for a new value µ D of the parameters, the sub-database DB s it belongs to is readily identified and reduced-operators computed for µ using the ROMs stored in DB s. 5. Applications and performance assessment he proposed approaches are here applied to two challenging physical applications: the acoustic inverse obstacle problem and the aeroelastic flutter problem.

12 5.. Acoustic scattering analysis he acoustic inverse obstacle problem considered here consists in determining the shape of an obstacle or a part of this shape from the knowledge of some scattered far-field patterns, assuming certain characteristics of the surface of the obstacle. It is well-known [33] that such an inverse problem is non-linear and often quite ill-posed, making its numerical solution challenging. o illustrate the ROM database framework proposed above, a parameter identification problem is considered, where the shape of the obstacle is assumed to be known a-priori, but the vector of parameters µ R Nµ of the shape needs to be identified from the measured far-field pattern. his class of problems is a subset of a general acoustic inverse obstacle problem. In order to describe the considered problem more accurately, the corresponding direct acoustic scattering problem is recalled first. he scattering of time-harmonic acoustic waves by an impenetrable obstacle with the boundary Σ embedded in an infinite homogeneous fluid medium Ω e R d can be formulated as the following exterior boundary value problem for the unknown acoustic pressure field w in the fluid a + b ν lim r d 2 r w + κ 2 w = in Ω e, w + w inc = on Σ, w r jκw =, 43 where the incident wave is given by w inc = e jκd x, the unit vector d indicates the direction of the incident plane wave, and either a or b. Sound-hard, sound-soft, or impedance boundary conditions can all be represented by the second equation of 43. In the example below, the sound-hard scattering problem is used, leading to the choice of the Neumann boundary condition a = and b =. he third equation in 43 is the Sommerfeld radiation condition. It ensures, in the physical sense, that all waves are outgoing and, mathematically, that the direct scattering problem is well-posed for any wavenumber κ = ω/c, where ω is the angular frequency of the harmonic oscillations and c is the speed of sound in the fluid. In order to discretize the direct scattering problem 43, the finite element method is considered. he infinite domain is first truncated, and a perfectly matched layer [34] near the exterior boundary is used to simulate the effect of the Sommerfeld condition. his converts the boundary value problem 43 into that of solving the algebraic system of linear equations Kµ κ 2 Mµ wκ, µ = fκ, µ 44 for the unknown degrees of freedom w C N. his system is a second-order LI system of the form 5. Here, K corresponds to the finite element discretization of the Laplace operator, and M is a mass-type matrix. For an interior problem associated with the Helmholtz equation, M is real, symmetric positive-definite, and K is real, symmetric non-negative. When the perfectly matched layer is used, the matrices K and M become complex and non-hermitian. he source vector f arises from the discretization of the sound-hard boundary condition. he far field pattern characterizes the asymptotic behavior of the acoustic scattered field far away from the obstacle. In two dimensions, it admits the following integral representation [33] w ˆx = ej π 4 8πκ 2 Γ w y + jκ ˆx.ν wy e jκˆx.y dσ y ; ˆx S, 45 ν where S is the unit circle. After computing the finite-element solution, the integral 45 can be evaluated by integrating over a suitable curve Γ often the boundary Σ in the computational domain. he integral in 45 evaluated at N o locations ˆx,, ˆx No of the circle S can then be in practice represented by the action 2

13 of a matrix on the solution vector yκ, µ = Gκ, µwκ, µ with G C No N. Practically, the following logarithmic scale quantity is usually plotted Sˆx = log 2π w ˆx 2. his quantity can also be computed for each entry of the output vector yκ, µ as sκ, µ = s yκ, µ. 46 he inverse problem considered here consists of identifying parameters µ = L s, t s D R 2 of a two-dimensional mockup submarine, characterized by its length L s, and the position of its tower t s from given far-field data for several frequencies wavenumbers {s m κ i } Nκ i=. he inverse problem can be written as N κ min α i s yκ i, µ s m κ i 2 µ D 2 + β 2 µ 2 2 i= s.t. Kµ κ 2 i Mµ wκ i, µ = fκ i, µ, yκ i, µ = Gκ i, µwκ i, µ, i =,, N κ, 47 where a ikhonov regularization term has been added and {α i } Nκ i=, β are appropriate positive weights. Since the solution of the discrete direct problem 44 for each different wavenumber requires a costly refactorization of the matrix on the left-hand side, to enable the efficient computations for many wavenumbers, a reduced-order model is built using a derivative-based Galerkin projection DGP framework [24] for a given value µ of the shape parameters. In this method, based on moment-matching, N DGP derivatives of the solution with respect to the wavenumber κ are first computed by solving 44 with recursively constructed right-hand sides at Nκ DGP interpolating wavenumbers. hen, these derivatives are orthogonalized to achieve numerical robustness, and used to form a subspace of dimension k = Nκ DGP N DGP for Galerkin projection, leading to reduced matrices K r µ, M r µ, f r κ, µ and G r κ, µ. Figure 2 depicts the triangulated computational domain left with the elements in the PML layer shown in cyan; the real part of the solution for κ = 2, L s =, and t s =.2 is shown on the right. For different values of the shape parameters, the computational domain is remeshed. Isoparametric cubic Finite Elements are used. All computations are done using Matlab. he solution procedure described in detail below builds a database of frequency-sweep ROMs offline by sampling the shape parameter space adaptively to ensure accuracy. he database of the ROMs is then used to efficiently solve the reduced inverse problem. For a given value of the parameters, N DGP = 8 including the -th derivative are computed for the Nκ DGP = 2 frequencies κ {, 2}, leading to a ROM of dimension k = 6. In the present case, there are N = 36 outputs equidistributed on the sphere S. In a first set of numerical experiments, the effect of consistency on predictions based on a database of ROMs is illustrated. For that purpose, a small database of N DB = 4 ROMs is first created for the values of the parameters indicated in able where the number of dofs for each underlying HDM is also reported. One can observe that each HDM has a different number of dofs. he consistency enforcement procedure for arbitrary meshes developed in Section 3.3 is first applied to transform the reduced operators prior to their interpolation. In a second case, the operators are not transformed. In all cases, the reduced operators are interpolated on their appropriate manifold at µ = [.9625,.25] by bilinear interpolation as follows: he operators ReM r, ImM r and ReK r are SPD matrices and as such as interpolated on their appropriate manifold using the Choleski decomposition-based approach proposed in Section 4.. he operator ImK r is interpolated on the manifold of symmetric matrices. he operators {f r κ i,, G r κ i, } Nκ i= are interpolated on the manifold of rectangular complex matrices. 3

14 t s L s Figure 2 Computational mesh and the real part of the solution for κ = 2 DB point µ µ 2 Nµ.95. 4, , , ,929 able Database of ROMs and associated underlying HDM number of dofs Figure 3 reports the far-field pattern for κ = 4 at µ = [.9625,.25] computed by the HDM and the two ROM interpolation approaches. One can observe the importance of consistency as the inconsistent ROM database leads to poor predictions whereas the consistent ROM database predictions very closely follow the HDM results. Next an adaptive approach for constructing the ROM database is developed. he approach proceeds by comparing the predictions associated with the ROM database and HDM at the center of each hypercube of the database and refining that hypercube if the error is above a given threshold. he error can be associated with an output of interest, such as the far-field pattern, leading to a goal-oriented approach. In the following, the error will be based on the accuracy of the shape µ returned by solving the reduced inverse problem by simulated annealing. N κ min α i s y r κ i, µ s m κ i 2 µ D 2 + β 2 µ 2 2 i= s.t. Kr µ κ 2 i M r µ qκ i, µ = f r κ i, µ, y r κ i, µ = G r κ i, µqκ i, µ, i =,, N κ. 48 he error measure is then defined as Error = µ µ µ max µ 49 min where µ denotes the target shapes, µ min and µ max the lower and upper bounds for each shape parameters, respectively and the ratio in Error is computed entry-by-entry. 4

15 HDM Consistent ROM Inconsistent ROM ± Figure 3 Comparison of the far-field pattern predictions obtained by interpolation of inconsistent and consistent databases. Figure 4 reports the refined database for an error tolerance of 5% and the parameter domain D = [.9, ] [.,.2]. N DB = 2 points are sampled in the domain. he training errors obtained at each iteration refinement of the procedure are reported in Figure 5. One can observe that after the second refinement, all errors are below the error threshold of 5%. o validate the accuracy of the ROM database, 289 target shape parameters are selected in D and the reduced inverse problems solved for each of them. he distribution of corresponding errors are reported in Figures 6 and 7. One can observe that all errors are below the error threshold, confirming the validity of the training procedure. Finally, the CPU timings associated with the solution of a given inverse problem are compared for the HDM and ROM database strategy. he CPU timings are reported in able 2. One can observe that an impressive speedup of 27 is obtained thanks to the database strategy. For a given function call in the optimization problem, the speedup is equal to 27. Approach Error Number of Online optimization Speedup function calls Wall time HDM h 3 min ROM database s 27 able 2 Wall times associated with the solution of the inverse problem with the HDM and database of ROMs 5.2. Flutter analysis he aeroelastic analysis of a wing-store configuration flying in the subsonic, transonic and supersonic regimes is considered. Some properties of that system were originally studied in [35, 36]. Among those, the hydroelastic effects inside the fuel tank modify the structural properties of the wing-store configuration, thereby affecting the flutter characteristic of the system. his justifies parameterizing the aeroelastic system 5

16 µ µ Figure 4 Pre-computed database DB of reduced-order models selected by the adaptive sampling procedure. Error Iteration Figure 5 raining errors at each iteration of the adaptive sampling procedure. 6

17 Error Figure 6 Distribution of prediction errors for the solution of 289 inverse problems..4 Error µ 2..9 µ Figure 7 Prediction errors for the solution of 289 inverse problems. 7

18 a CFD surface grid b FE structural model Figure 8 High-dimensional aeroelastic model of a wing-store configuration. by the fuel fill level f inside the tank. Furthermore, the aeroelastic properties of the wing-store system depend heavily on the aerodynamic properties of the configuration. As a result, the system will also be parameterized by the free-stream Mach number M. he structural and fluid surface models of the wing-store system are graphically depicted in Figure 8. he structural subsystem is a second-order LIP of the form 4 and is modeled by the Finite Element method. For each fill level, a new structural mesh is generated inside the tank for the full physical domain. he hydroelastic effects are modeled by an added mass effect [35, 36], resulting in a linear HDM with N s = 6, 834 dofs for all values of f. he proposed ROM database approach will enable by-passing the re-meshing of the fuel domain everytime the fill level is varied. he fluid subsystem is modeled by the linearized Euler equations and discretized by the Finite Volume method using a second-order accurate linear flux reconstruction and a second-order accurate implicit backward difference time integration scheme. For each operating point µ = M, f, the nonlinear fluid HDM is linearized around a steady-state, resulting in a first-order LIP system of the form with N f 4, dofs. In this work, the operation domain of interest is M, f D = [.6,.] [, ]. For each operating point, the critical values of pressure p cr and velocity V cr at the onset of flutter are sought. Once, these quantities are determined, the flutter speed index FSI can be computed as FSI = V cr b s ω α µ, 5 where b s is the semi-chord of the wing at its root, ω α is the first dry torsional mode of the wing-store structural system and µ is the mass ratio as defined in [37, 35, 36]. he flutter speed indices of the system of interest are computed using the HDM for 26 different freestream Mach number and 5 different fill levels in the domain M, f D, resulting in 3 operating points, and reported in Figure 9. One can observe the characteristic flutter dip for M.96. he framework developed in this paper is then applied to the problem of interest to interpolate reduced aeroelastic operators. In this example, all structural and fluid HDMs are defined on the same mesh and the approach of enforcing ROM consistency developed in Section 3.2 is followed. For that purpose, N DB = 2 operating points are sampled and their corresponding aeroelastic ROMs constructed and stored in the offline phase in a database DB. hese points correspond to a lattice M, f {.6,.75,.9,.95,.,.5,.} {, 5, }. For each operating point, a structural ROM of dimension k s = 4 is constructed by projecting 8

19 the linear structural HDM onto its first four natural modes. hen a fluid ROM of dimension k f = 5 is constructed by POD using the approach described in [,, 8] and a reduction of the system in descriptor form [25]. he FSIs predicted by those 2 aeroelastic ROMs are reported in the right portion of Figure 9. Very good agreements can be observed at the database points when compared to their counterparts determined by the HDM that are depicted in the left portion of that same figure. HDM Database FSI FSI Fill Level % Mach Number Fill Level % Mach Number Figure 9 Comparison of the high-dimensional model and database reduced-order models flutter speed indices. he 2 pre-computed aeroelastic ROMs are then distributed in N s = 3 sub-databases: the first one covers the subsonic and lower transonic flow regime M [.6,.9], the second one the upper transonic regime M [.9,.] and the third one the supersonic regime M [.,.]. hese three databases are graphically depicted in Figure. In the online interpolation procedure, in each database, piecewise-linear interpolation will be used in the M direction and cubic spline interpolation in the f direction. 75 Fill level % 5 Database Database 2 Database Mach number Figure Pre-computed sub-databases {DB s} 3 s= of aeroelastic reduced-order models. 9

20 Before the online phase, the heuristic developed in [9] and mentioned in Section 4. is applied for choosing the manifold onto which to interpolate the reduced fluid operators. For the fluid operators, interpolation can indeed be done on the manifold GL k f of non-singular matrices of size k f or on R kf k f. Since the interpolation procedure of choice involves two points in the M direction and three in the f direction at a time, the heuristic is applied for six different regions of the parametric space, as indicated in able 3. As reported in able 3, the manifold GL k f is chosen in two regions while the manifold R kf k f is chosen in four regions. Database Database 2 Database 3 M [.6,.75] [.75,.9] [.9,.95] [.95, ] [,.5] [.5,.] GL k f R kf k f Manifold choice R kf k f R kf k f GL k f R kf k f GL k f R kf k f able 3 Non-linearity indicator in each database for the manifold choice heuristic Frequency Hz Fill level Figure Comparison of eigenvalues of the structural subsystem: HDM, interpolated ROM. Next, the proposed methodology is applied to interpolate the aeroelastic ROM operators. he properties of the structural operators resulting from that interpolation are first analyzed by comparing their respective eigenfrequencies to their HDM counterparts. he corresponding results are reported in Figure. Good agreements can be observed, even for fill levels that are not present in the database. Next, the interpolated aeroelastic ROM operators are used to predict the onset of flutter in the entire parametric domain M, f [.6,.] [, ]. he predicted FSIs are reported in Figure 2. Very good qualitative and quantitative agreement can be observed for all flight conditions considered. For comparison, response surface estimation RSE is also applied to predict flutter using the database FSI data reported in the right portion of Figure 9. In this case, bicubic spline interpolation is used. When compared with the predictions arising from ROM interpolation, the results from RSE are found to be much less accurate, especially near the transonic dip and in the supersonic regime. RSE cannot, in particular, predict the FSI behavior for low fill levels at supersonic speeds. It is quite remarkable that the method proposed in this paper can capture this complex phenomenon with only the ROM database associated with the results shown in the right portion of Figure 9. 2

21 Response Surface ROM Interpolation FSI FSI Fill Level % Mach Number Fill Level % Mach Number Figure 2 Comparison of flutter speed indices predicted using response surface estimation, 2 ROM interpolation. his example underlines the potential for accurate predictions of the proposed method which operates by interpolating models and not outputs, as in RSE. he offline and online CPU times associated with the prediction of the entire parametric FSI surface each of the four techniques are reported in able 4. hese results clearly demonstrate the real-time capability of the proposed approach, as it can accurately predict the FSI for 3 configurations in only 3 seconds. Approach Offline phase Online phase Wall time s Number of processors Wall time s Number of processors HDM - - 9,52, 32 RSE 28, 32 2 ROM database 28, 32 3 able 4 Wall times associated with computing the complete predicted FSI surface reported in Figure 9 and 2 he flutter behavior at supersonic speed for low fuel levels is then studied more in detail by predicting the FSI at an additional fuel level for 5% tank fill. he corresponding FSI are reported in Figure 3. In order to understand the physical phenomenon at play, the eigenvalues of the interpolated aeroelastic ROM matrices are computed for increasing values of free-stream pressure until flutter is reached. By following the wet structural modes in the complex plane, one can determine which structural mode flutters, that is which one is the first to cross the imaginary axis. Results are reported in Figures 4 and 5 for four different values of the free-stream mach number and an empty tank. One can observe that for M =.75 and M =.9, the first mode is the first to cross the imaginary axis while for M =.92 and M =., the third mode is the first one to flutter. hese results clearly show that a bifurcation phenomenon is at play. Being able to perform such analyses demonstrates another clear advantage of the proposed method over RSE. For that same fill level, the HDM predicts the same phenomenon, that is a peak of FSI in function of the free-stream Mach number M between M =.9 and M =.92, which is in perfect agreement with the results arising from the interpolated ROM. Next, the effect of the manifold choice heuristic is studied by considering interpolation on R kf k f and on GLk f, respectively, for the reduced fluid operator at every operating point. he corresponding results are reported in Figure 6 for interpolation using Choice and 3, respectively. One can observe that the predicted FSI are more accurate when the heuristic is used, especially for subsonic and transonic flight conditions. Finally, the effect of consistency on the results accuracy is investigated. Inconsistent interpolation for both the structural and fluid subsystems and for only one of those two subsystems is performed and the 2

22 HDM Response Surface FSI.3.25 FSI Fill Level % Mach Number Fill Level % Mach Number ROM Interpolation.4.35 FSI Fill Level % Mach Number Figure 3 Comparison of high-dimensional model and predicted flutter speed indices between M =.5 and M =. for low fuel fill levels using response surface estimation, 2 ROM interpolation 22

23 4 3 M = lbf/in^ M =.9 32 lbf/in^2 28 Imaginary Part Imaginary Part Real Part 4 M = lbf/in^ Real Part 4 M =. 32 lbf/in^ Imaginary Part Imaginary Part Real Part Real Part Figure 4 Aeroelastic matrix eigenvalues loci at % fill level for various free-stream Mach numbers. Imaginary Part M = Real Part M = lbf/in^ lbf/in^2 28 Imaginary Part M = Real Part M =. 32 lbf/in^ lbf/in^2 28 Imaginary Part Imaginary Part Real Part.5.5 Real Part Figure 5 Aeroelastic matrix eigenvalues loci at % fill level for various free-stream Mach numbers zoom. 23

24 ROM Interpolation ROM Interpolation FSI FSI Fill Level % Mach Number Fill Level % Mach Number Figure 6 Predicted flutter speed indices using ROM interpolation without the manifold choice heuristic: interpolation of the reduced fluid operator on R kf k f left and on GLk f right. ROM Interpolation ROM Interpolation FSI FSI Fill Level % Mach Number Fill Level % Mach Number ROM Interpolation.4.35 FSI Fill Level % Mach Number Figure 7 Predicted flutter speed indices using ROM interpolation without consistency enforcement: for the structural operators only top left, for the fluid operators only top right, for all operators bottom. 24

25 corresponding FSI results reported in Figure 7. he reader can observe the crucial effect of consistency as none of the interpolation of inconsistent ROMs leads to accurate predicted FSI. he interpolated ROM can also be used to predict the displacement at a given location of the wingtank system. Here wing tip displacements time histories are predicted using the interpolated ROM at the transonic tip, that is M =.97 for an empty tank. he corresponding results are reported in Figure 8 for three different cruise altitudes, and compared to predictions using the HDM. Good agreements can be observed. Wing ip Displacement m M=97,fill level = 99 %, sea level HDM Interpolated ROM Wing ip Displacement m M=97,fill level = 99 %, altitude:, ft HDM Interpolated ROM ime s ime s M=97,fill level = 99 %, altitude: 2, ft.6 Wing ip Displacement m HDM Interpolated ROM ime s Figure 8 Wing tip displacement at M =.97 with full tank predicted using the high-dimensional model and an interpolated ROM at various altitudes. Finally, in order to demonstrate the capability of the proposed method to operate on mobile devices, an iphone application is implemented for the aeroelastic system of interest. A screenshot of the application is displayed in Figure 9. he application can operate in the following two modes, based on the database of N DB = 2 points considered in this section: In the first mode, for a given value of the fill level f, the FSI is compiled for M [.6,.]. his is the mode depicted in Figure 9. 2 In the second mode, for a given combination M, f, the smallest aeroelastic damping ratio is computed for the altitude range h [, 4] ft. 6. Conclusions his work presents a framework for real-time predictions based on a database of linear reduced-order models. It is based on the offline pre-computation of reduced-order models and their online interpolation at unsampled values of the parameters. A pre-processing step is first established to enforce the consistency of the set of generalized coordinates each reduced operator is defined by. he present paper presents such 25

26 Figure 9 Screenshot of the iphone application depicting the FSI for fill level f = 43.77%. a step for both systems defined on common and arbitrary underlying meshes. he operators are then interpolated on the tangent space to a matrix manifold to enforce properties associated with each operator. he framework is then applied to two challenging multi-physics applications, demonstrated its capability to lead to real-time and accurate predictions. 7. Acknowledgements he authors would like to thank Mark Potts for the implementation of the iphone application. he authors acknowledge partial support by the Army Research Laboratory through the Army High Performance Computing Research Center under Cooperative Agreement W9NF , and partial support by the Office of Naval Research under grants no. N and N his document does not necessarily reflect the position of these institutions, and no official endorsement should be inferred. 8. Appendix : proof of heorem he objective function can be written as J G Q = ɛ Q E ri Q, E r + α Q A ri Q, A r + F, Q, 5 where F = βb ri B r + γc ri C r. he Lagrangian of the optimization problem is then LQ, S = J G Q + 2 S, I k Q Q = ɛ Q E ri Q, E r + α Q A ri Q, A r + F, Q + 2 S, I k Q Q, 52 where 2 S Rk k is a symmetric matrix of Lagrangian multipliers. Using the following identities [26], Q M, Q = M 53 Q M, Q Q = QM + M 54 Q Q MQ, N = MQN + M QN, 55 26