Reduced basis method for H 2 optimal feedback control problems

Size: px
Start display at page:

Download "Reduced basis method for H 2 optimal feedback control problems"

Transcription

1 A. Schmidt a B. Haasdonk b Reduced basis method for H 2 optimal feedback control problems Stuttgart, November 215 a Institute for Applied Analysis and Numerical Simulation, University of Stuttgart, Pfaffenwaldring 57, 7569 Stuttgart/ Germany {schmidta,haasdonk}@mathematik.uni-stuttgart.de Abstract In this paper we examine the application of known parametric model reduction techniques to the H 2 optimal feedback control problem. The H 2 control problem provides a realistic framework for control applications, since it considers disturbances in the system and in the measurement outputs. Furthermore it employs state-estimation to reconstruct the unknown state from the noisy measurements. It turns out, that the controller is a dynamical system and two solutions of algebraic Riccati equations (AREs) are required to form it. We apply parametric model order reduction techniques to the AREs and to the state equation of the observer and show by numerical examples, that this approach can yield a significant speed-up in multi-query scenarios for large scale parametric problems for the control of partial differential equations (PDE). Keywords Optimal Control parametric PDE Algebraic Riccati Equation State Estimation Stuttgart Research Centre for Simulation Technology (SRC SimTech) SimTech Cluster of Excellence Pfaffenwaldring 5a 7569 Stuttgart publications@simtech.uni-stuttgart.de

2 Reduced basis method for H 2 optimal feedback control problems A. Schmidt B. Haasdonk University of Stuttgart, Institute for Applied Analysis and Numerical Simulation, Pfaffenwaldring 57, 7569 Stuttgart - Germany {schmidta,haasdonk}@mathematik.uni-stuttgart.de Abstract: In this paper we examine the application of known parametric model reduction techniques to the H 2 optimal feedback control problem. The H 2 control problem provides a realistic framework for control applications, since it considers disturbances in the system and in the measurement outputs. Furthermore it employs state-estimation to reconstruct the unknown state from the noisy measurements. It turns out, that the controller is a dynamical system and two solutions of algebraic Riccati equations (AREs) are required to form it. We apply parametric model order reduction techniques to the AREs and to the state equation of the observer and show by numerical examples, that this approach can yield a significant speed-up in multi-query scenarios for large scale parametric problems for the control of partial differential equations (PDE). Keywords: Optimal control, feedback control, parametric PDEs, Riccati equation, state estimation, H 2 optimal control 1. INTRODUCTION The solution approaches to control problems can in general be divided into two main classes: Open-loop- and feedback control. In open-loop control, a control signal is calculated from the initial configuration and is then used to steer the system without getting back any information from the system. In contrast to that, feedback control uses measurements for the calculation of the control trajectory. It is an easy consequence of the conceptual designs, that only the latter method is able to cope with a-priori unknown disturbances. Realistic control problems should consider noise in the system dynamics and in the outputs. Furthermore, usually not the full state of the system is known, but only (partial) measurements, such as sensor information, can be used for control. A setup that takes into account all those design issues is the so called linear quadratic H 2 control problem, see for example Zhou et al. (1996). This particular problem aims at minimizing a certain norm in the frequency domain, which quantifies the influence of noise to the output of interest. The solution can be obtained by first finding an optimal state estimate, which is then used in a state-feedback controller to calculate the control signal. The main tool for both steps is the algebraic Riccati equation (ARE). The ARE is a matrix-valued nonlinear equation with many important applications in various areas of control theory, see Lancaster and Rodman (1995). We will consider systems that arise after spatial semidiscretization of parametric PDEs. The discretized problems are characterized by large dimensions, say in the order of The computational complexity can easily lead to impracticable calculation times for multi-query scenarios, for example in parameter studies or real-time applications. We thus propose to use recent model reduction techniques to obtain approximate controllers rapidly. The method of choice for the reduction of parametric problems is the reduced basis (RB) method, see Patera and Rozza (27). This method has already been successfully applied not only to the simulation of PDEs, but also for Kalmanfilter and the rapid approximation of solutions to the ARE, see Dihlmann and Haasdonk (215); Schmidt and Haasdonk (215); Schmidt et al. (214). We propose to use the RB method for the H 2 optimal control problem, where we reduce all high dimensional, and thus costly, operations. This paper is organized as follows. In Section 2 we give a brief introduction into the H 2 control setting and the control theory background. In Section 3, we first describe the reduction techniques for the ARE and for dynamical systems before we then apply them to the H 2 control problem. Numerical examples in Section 4 finally show the quality of the approximation. We conclude in Section 5 with final remarks. 2. H 2 OPTIMAL CONTROL Throughout this paper, we are discussing control problems that are modeled by parametric linear and time invariant (LTI) systems of the form ẋ(t) = A(µ)x(t) + B u (µ)u(t) + B w (µ)w(t) (1a) z(t) = C z (µ)x(t) + D zu (µ)u(t) (1b) y(t) = C y (µ)x(t) + D yw (µ)w(t) (1c) x() = x (µ). (1d) In the following the parameter µ is a vector from a bounded parameter set, denoted by P R ρ and all definitions and assumptions should be understood to hold

3 w(t) u(t) System Controller y(t) z(t) Fig. 1. Schematic representation of the control problem. for all parameters µ P. Furthermore, for the sake of brevity, we will omit the explicit dependence of the quantities on the parameter µ in the following. The dynamics of the state x(t) R n are modeled by the differential equation (1a) and can be influenced by the input function u(t) R mu, which will later be chosen as the control input. We consider two outputs of the system. The first output z(t) R pz is the performance output. This quantity should be rendered small by the controller. The second output y(t) R py describes the measurements from the system that are available as inputs for the controller. The function w(t) R mw models uncertain inputs to the system and enters in the state equation as well as in the measurement outputs. The dimensions of the matrices are A(µ) R n n, B u (µ) R n mu, B w (µ) R n mw, C z (µ) R pz n, D zu R pz mu, C y (µ) R py n and D yw (µ) R py mw. Remark 1. Discretizations like the finite element method usually lead to a mass matrix in front of the timederivative of the state: Eẋ(t) = Ax(t) + Bu(t). Formally, a multiplication with E 1 transforms the system to standard form. However, this should be avoided since it destroys important properties like sparsity or symmetry. A better approach is to work with the Cholesky factors (or the LU-decomposition in the general case), and to perform the inversion of E implicitly in the algorithms. The idea of feedback control is depicted in Figure 1: One tries to find a controller that transforms the measurement output signal y(t) to a control signal u(t) such that certain goals are achieved. Most importantly, the closed loop system should be stable, which means that if there is no disturbance w(t) entering the system, the state should decay to the origin x(t) for t. This is also called internal stability and is closely related to the stability of matrices: We say a matrix is stable, if all eigenvalues have negative real parts. We make a general ansatz for the controller, and chose an arbitrary dynamical system, where the measurements from the control system y(t) are inputs, and the control signal u(t) is the output: {ẋk (t) = A K x K (t) + B K y(t) (2a) u(t) = C K x K (t). (2b) Usually (but not necessarily), the dimension of x K (t) coincides with the state dimension n of the system. By closing the loop between y(t) and u(t), the interconnection of the system model with the controller can be written as an augmented LTI system of the form { ξ(t) = Aξ(t) + Bw(t) (3a) z(t) = Cξ(t), (3b) where ξ(t) R nk+n is an abbreviation for the combined vector (x(t) T, x K (t) T ) T and the system matrices are given as ( ) A B = C D B K C y A K B K D yw A B uc K B w C z D zu C K The closed loop system (3a)-(3b) thus provides a link between the disturbance input w(t) and the performance output z(t) and hides the interconnection of the system and the controller. For the purpose of controlling, the effect of the disturbance on the output should be minimized in some suitable sense. One way to measure the behavior of systems to noise, is to examine the transfer function G(s) of the system (3a)-(3b), which can be obtained by taking the Laplace transformation of the system equations (3a) (3b), see e.g. Kwakernaak and Sivan (1972). Z(s) = G(s)W (s), with G(s) = C(sI n+nk A) 1 B. Here, I n R n n is the n dimensional identity matrix and s is a complex number. We say that G(s) is stable, if all its poles have negative real parts, which is equivalent to the stability of A. The benefit of using the transfer function is, that it establishes a linear link between the input and the output of the system in the frequency domain. For such functions, the H 2 norm can be defined: G 2 2 := 1 tr ( G( jω) T G(jω) ) dω, 2π where j denotes the imaginary unit and tr ( ) is the trace operator. The functions W (s) and Z(s) are the Laplace transformations of w(t) respectively z(t). If not otherwise stated, the norm of a matrix G will always be the induced Euclidean 2-norm G = sup x =1 Gx. Before defining the H 2 optimal control problem and its solutions, we first recap some well known properties and intuitive interpretations of the above norms. Remark 2. (Facts about the H 2 norm). Given a stable transfer function G(s) = C(sI A) 1 B, the H 2 norm G 2 can be calculated by solving one of the following Lyapunov equations AL c + L C A T + BB T =, (4) A T L O + L O A + C T C =. (5) Then it holds G 2 2 = tr ( CL C C ) T = tr ( B T L O B ). The solutions to the above Lyapunov equations are also called observability and controllability Gramians of the system and play very important roles in different parts in linear systems theory, cf. Kwakernaak and Sivan (1972). The H 2 norm of a transfer function G(s) has an intuitive interpretation in the state space. Let z k (t) for k = 1,..., m u be the response of the following systems: ẋ k = Ax k, z k = Cx k, x k () = Be k, where e k R mu denotes the k-th unit input vector. Then the equality n H 2 2 = z k (t) T z k (t)dt k=1 holds, providing a relationship between the state space input-output behavior and the H 2 norm. Another useful interpretation is given, when the input w(t) is modeled as Gaussian white noise with unit covariance: In that case, the equality

4 [ 1 lim E t t t ] z(t) T z(t)dt = G 2 2 holds where E [ ] denotes the expected value. This establishes the link between linear Gaussian control and the H 2 optimal control problem, see also Remark 5. We now have all tools to formulate the H 2 optimal control problem: Definition 3. (H 2 optimal control problem). Given the system (1a) (1c), find a controller of the form (2a) (2b), such that the H 2 norm J := C(sI n+nk A) 1 B 2 2 of the closed loop system (3a) (3b) is minimized. Before we can give the solution for the H 2 and the H problem, we must make some rather technical assumptions on the structure of the problem: Assumption 4. (1) The pair (A, B u ) is stabilizable (i.e. there exists F R n mu such that (A + B u F ) is stable), and (A, C y ) is detectable (i.e. (A T, C T ) is stabilizable) (2) The pair (A, C z ) has no unobservable modes and (A, B w ) has no uncontrollable modes on the imaginary axis (3) DzuD T zu and D yw Dyw T are invertible (4) DzuC T z = and D yw Bw T = The first and second assumption are necessary in order to guarantee the existence of stabilizing solutions to the two AREs in Theorem 6. The third and fourth assumption can be relaxed when using advanced techniques like linear matrix inequalities, but they provide useful simplifcations in the solution structure. Remark 5. (Link to LQG-Control). It is worth to mention the relationship of the H 2 optimal control problem to the famous linear quadratic Gaussian (LQG) control problem, as it is merely a special kind of the general H 2 setting with a specific stochastic framework for the noise components. Assume that the disturbances w 1 (t) and w 2 (t) model independent Gaussian white noise with unit covariances. Consider the system ẋ(t) = Ax(t) + Bu(t) + B w w 1 (t), (6) y(t) = C y x(t) + D yw w 2 (t). (7) and the objective [ 1 t ] min lim E (x(s) T Qx(s) + u(s) T Ru(s)ds, (8) t t with Q and R being positive (semi)-definite matrices. This is a classical LQG problem, see also Athans (1971). The setup fits in the more general framework we stated above, when we set ẋ(t) = Ax(t) + (B w ) w + Bu(t) (9a) ( ) ( ) z(t) = Q 1/2 x(t) + R 1/2 u(t) (9b) y(t) = C y x(t) + ( D yw ) w(t) (9c) and abbreviate w(t) = (w 1 (t), w 2 (t)) T. Furthermore, it can be shown that the minimal value of (8) is the same as the H 2 norm of the closed loop system from the disturbances to the output z(t), see also Remark 2. Theorem 6. (Solution to the H 2 problem). Let P, Q R n n be the unique stabilizing solutions to the AREs A T P + P A P B u (D T zud zu ) 1 B T u P + C T z C z = (1) AQ + QA T QC T y (D yw D T yw) 1 C y Q + B w B T w =. (11) Define the control gain K := (D T zud zu ) 1 B T u P and the observer gain L := QC T y (D yw D T yw) 1. Then an H 2 optimal controller is given by u(t) := Kx K (t), (12) where x K (t) R n is the solution to the observer-equation: ẋ K (t) = (A BK)x K (t) + L[y(t) C y x K (t)]. (13) The optimal H 2 norm of the corresponding closed loop system is J = tr ( B T wp B w ) + tr ( B T u P QP V u ). Proof. See for example Zhou et al. (1996). The solution to the optimal output-feedback control problem has an interesting structure: If the full state x(t) is available for the control, then the controller u(t) = Kx(t) is optimal. This feedback controller is also called linear quadratic regulator (LQR). As the state x(t) is usually unknown, it is replaced by an optimal reconstruction in the sense of a Kalman filter, see Kalman and Bucy (1961); Luenberger (1964). The controller is hence an interconnection of an optimal state-feedback controller and an optimal state estimation. Remark 7. In Doyle (1978), it was shown that the LQG regulator, and thus also the H 2 feedback controller, lacks important robustness properties against uncertainties in the plant. Although we get very good results in the numerical examples, the robustness should be checked a- posteriori as it is not guaranteed by theory. 3. REDUCTION OF THE CONTROLLER We have seen in the last section that the determination of the optimal output based feedback controller requires the solution of two AREs (1) (11) and the integration of an n dimensional LTI system (13) for the state estimation. The latter must be performed in real-time, as the measurements from the true noisy output enter the controller, and the control signal generated by the controller must be present (almost) instantaneously to be fed back to the system. Since n can become very large in control problems for semidiscretized PDEs, the calculation of the control signal can get very expensive and easily impracticable for multi-query scenarios and real-time applications. Thus, we will show how existing parametric model reduction techniques for the ARE and for LTI systems can be applied simultaneously, in order to speed up the calculation of the controller and the control significantly. We begin with a brief review of existing reduction techniques for the ARE and dynamical systems. 3.1 Reduction of the ARE The key tool for calculating the control- and observation gain is the ARE, see Theorem 6: A T X + XA XBR 1 B T X + C T C =. (14) The ARE is of great importance in almost all fields of control theory, see for example Lancaster and Rodman (1995); Kwakernaak and Sivan (1972) and the references therein. Thus a lot of work has been done in the development of algorithms for solving large scale AREs, especially with

5 sparse matrices, as they appear for example in control problems for PDEs, see Benner and Saak (213). All of these algorithms work under the assumption that the solution matrices X R n n of the ARE can be factored in a so called low rank factorization X ZZ T with a thin rectangular matrix Z R n k. This is possible due to a fast decay in the singular values of X, which implies a low numerical rank of X. In a very recent paper, the singular value decay rate of solutions to the ARE has been studied, cf. Benner and Bujanović (214). In Schmidt and Haasdonk (215) it was shown, that the low rank structure furthermore allows the approximation of the solutions in the parametric case, by applying the reduced basis method. The calculation is divided in an offlineand an online stage. In the offline step, a low-dimensional subspace V R n with a basis matrix V R n N such that V = colspan V is constructed from the low rank factors Z of solutions to the ARE for carefully selected parameters from a training set P train P. This is done by using Greedy-type algorithms that make use of error estimators or error indicators to iteratively select the parameter which is approximated worst. Its corresponding solution to the full problem is then added to the basis. In the online phase, the full dimensional ARE is projected onto the low dimensional subspace V. Hence only a small ARE must be solved, which can be efficiently done by using standard methods, such as a Hamiltonian approach: A T N X N + X N A N XN T B N R 1 BN T X N + CNC T N = Once the N N matrix P N is calculated, the approximation to the full solution P can be defined as ˆP = V P N V T. The whole procedure can furthermore be rigorously validated by an a-posteriori error estimator P ˆP P. By using parameter separability (all data matrices have the form G(µ) = Q G l=1 Θ l(µ)g l ), the online calculation, including the error estimator, can be performed with a complexity independent of n. 3.2 Reduction of dynamical systems The state estimation requires the integration of an n dimensional differential equation, where the true measurements y(t) enter the observer. This should be performed in real-time, which is usually impossible due to the large dimension of the observer system. We thus propose to apply model order reduction techniques for the observer system, once the control- and observer gains are determined. Several methods exist for the reduction of dynamical systems, see Benner et al. (215) for a recent survey about parametric model reduction techniques. The reduction can be implemented to allow an efficient online calculation, cf. Haasdonk and Ohlberger (211). 3.3 Basis construction for the H 2 controller reduction Let P train P be a finite training set. We construct distinct bases for the two AREs and the observer, to achieve a flexible framework for the reduction. The pseudocode is given in Algorithm 1. We begin with the initialization of the empty basis matrices. In a loop over all training parameters, the snapshots for the AREs and the observer are calculated and concatenated in snapshot matrices. For the construction of the observer snapshots, we fix the input y (t) := sin(2πt) for t [, 1] and calculate the discretized solution for N T = 5 time steps. Once all snapshots are calculated, a singular value decomposition (SVD) is employed to extract the relevant data from the snapshot matrices, see Volkwein (211). The basis is then given by the left singular vectors V P, V Q and Vˆx of the corresponding SVDs. We take as many singular vectors, until we capture tol percent of the data. This can be done by finding the minimum number l such that l i=1 σ i(x) kx i=1 σ i(x) tol X, X {P, Q, ˆx} (15) is satisfied. Here the values σ i (X) are the singular values of the corresponding matrix X. Algorithm 1. Basis construction P [], Q [], ˆx [] for all µ P train do P = Z P ZP T Solution of (1) for µ P [ P, Z P ] Q = Z Q ZQ T Solution of (11) for µ Q [ Q, Z Q ] ˆx Solution of (2a) for µ with input y (t) ˆx [ ˆx, (x(t i )) N T i=1 ] end for [V P, S P ] SVD( P, tol P ) [V Q, S Q ] SVD( Q, tol Q ) [Vˆx, Sˆx ] SVD( ˆx, tolˆx ) 3.4 The reduced controller We assume that basis matrices V P R n N P, V Q R n N Q and Vˆx R n Nˆx for the AREs for P, Q and the observer ˆx are available. We define the reduced controller by using the reduced quantities in the equations for the feedback gain and the observer gain in the controller (12)-(13), and a subsequent projection of the reduced system for ˆx: Definition 8. (Reduced controller). Let ˆP = V P P NP VP T, ˆQ = VQ Q NQ VQ T be the approximate solutions to the ARE (1) and (11). Define the reduced gains ˆK := Bu T (DzuD T zu ) 1 ˆP, ˆL := T ˆQC y (D yw Dyw) T 1, and define the control signal û(t) := ˆK x(t), where x(t) R Nˆx satisfies the reduced observer equation x = Vx Ṱ (A B ˆK ˆLC y )Vˆx x + Vx Ṱ ˆLy (16) Remark 9. The above formulation captures the case where only a subset of the quantities P,Q and ˆx are reduced. This can be achieved by assuming V X = I n for any X equal to V P, V Q or Vˆx in Definition 8. Remark 1. Note that the whole procedure can be split in an offline/online efficient scheme, when parameter separability of the data matrices is assumed. This is possible due to an offline precalculation of matrix products that occur in the formulation of the controller. 4. NUMERICAL EXAMPLES We investigate the proposed procedure numerically. As a model we choose a damped wave equation on the 2D unit

6 1 µ 1 = 1 µ 1 = P Q ˆx Ω u y(t) 1 2 Ω y t Fig. 2. The setting for the numerical experiments (left) and the noisy uncontrolled output y for different damping parameters (right). square Ω = [, 1] 2. The PDE for the state f = f(t, ξ; µ), which models the wave propagation is given as f tt.2 f + µ 1 f t = χ Ωu u + B w w 1, ξ Ω, t > f(t, ξ; µ) =, ξ Ω, t f(, ξ; µ) = sin(ξ 1 ) sin(ξ 2 ), ξ Ω f t (, ξ; µ) =, ξ Ω. Here, χ Y = χ Y (ξ) is the characteristic function of the set Y at the point ξ and B w (ξ) := 2 sin(ξ 1 ) sin(ξ 2 ) describes the action of the noise w 1 (t) onto the system. The parameter µ 1 [1, 4] defines the damping of the wave. We define the measurement output s(t; µ) := 1 f(t, ξ; µ)dξ +.5w 2 (t), Ω y Ω y where w 2 (t) models additional disturbances. We choose two performance outputs: The undisturbed measurement 1 o 1 (t; µ) := µ 2 Ω y Ω y f(t, ξ; µ)dξ, weighted by the parameter µ 2 [1, 4] and the (scaled) control signal o 2 (t; µ) =.1u(t). A larger value for µ 2 results in a faster stabilization of the system. We chose independent Gaussian white noise for w 1 (t) and w 2 (t) with unit covariance. A picture of the setting and two example measurement outputs are given in Figure 2. We discretize the control model by applying a central finite difference (FD) scheme in space. The resulting n dimensional second order system can be rewritten as a n := 2n dimensional system with three outputs ẋ = A(µ)x + B w w + B u u y = C y x + D yw w z = C z (µ)x + D zu u, where we define the noise vector w(t) ( T ):= (w 1 (t), w 2 (t)) x1 and the augmented state x := R x 2n. The 2 vector z(t) is two-dimensional, where the first component represents the discretized version of o 1 (t) and the second component is the discrete weighted control o 2 (t). The system matrices are defined as ( ) ( ) ( In A(µ) =, B.2 h µ w =, B f B w u =, Bu) ( ) ( µ2 Cz D yw = ( 1), C z (µ) =, D zu (µ) =, µ3) where all matrices are the discrete counterparts of the continuous operators. h is the discrete FD-representation of the Laplace operator. The boundary values are not mapped in the vector x explicitly, but are considered in Fig. 3. Singular value decay for the snapshot matrices. The points and vertical lines indicate the basis size for which % of all snapshot data is covered. the discrete Laplace operator. The parameters vary in the parameter set P := [1, 4] [1, 5]. We chose a relative low dimension n = 4 since this already suffices to show the benefit of the proposed approach. The first order system is thus of dimension n = 8. All calculations were performed by using the Control Systems Toolbox in MATLAB. A full solution of one ARE takes about 1 seconds in MATLAB 215a with the function care. One timestep for the integration of the observer ODE takes seconds for the full 8 dimensional ODE. Note that both times can be significantly be sped up by using advanced solvers that make use of the sparsity and exploit the low rank structure. However, by increasing the dimension of the discretization, one can easily reach system sizes that make the procedure impracticable, even when using the latest solvers. We build the basis by applying Algorithm 1 and by using a finite training set with 5 elements, chosen randomly from the parameter domain P. In Figure 3 we plot the decay of the singular values for the snapshot matrices Q, P and ˆx. We see an exponential decay in all matrices, implying that the reduction will lead to good results. From the singular value decomposition, we extract a subset of the left singular vectors as basis for each of the components P, Q and ˆx. We do this by requiring the basis to capture % of the L 2 -energy of all snapshot data, see also Algorithm 1. The lines in the plot indicate this threshold. Tests with a larger basis introduced numerical inaccuracies that led to instabilities in the calculation of the solutions to the reduced AREs. The resulting bases (subsequently called full basis) have the sizes N P = 72, N Q = 2, and Nˆx = 67. Especially the low dimension of the observer allows a fast state estimation, which is the most crucial point for real-time applications. For testing the basis, we define a test set P test P with N test = 1 random parameters that were not contained in the training set P train for the basis building procedure. First, we compare the qualitative behavior by checking the control signals, see Figure 4. In this example, we used the full basis for the approximation of Q and ˆx. Already a small basis for the feedback matrix suffices to get a good control signal. For the full N P, the control signals are almost equal. A more quantitative comparison is given in Table 1. In this table, the relative error in the H 2 norm of the closed loop transfer functions from the disturbance input w(t) to the performance output z(t) is given

7 u(t) Table 1. Relative error in the transfer functions from w to z in the closed loop systems with zero initial condition. Using Nˆx = 4 leads to an unstable system. N P Nˆx Full N P =1 N P =2 N P = t Fig. 4. Control signal (second component of z(t)) for fixed µ = (1, 1), N Q = 2, Nˆx = 67 and increasing N P. G(s) G r (s) 2 G(s) 2. (17) The system behaves in an unstable way for Nˆx = 4, which could be due to the lack of robustness of the H 2 optimal controller. Uncertainties in the control loop can lead to instabilities. However, when using the full basis, we never experienced unstable behavior in all experiments that were performed. The good approximation behavior is also mirrored by the low relative error of.7%, when the full basis is used. One solution to the reduced ARE takes only 2ms and the speed-up for the integration of the observer is of factor 1, even in this small example. 5. CONCLUDING REMARKS In this article we considered the application of existing model order reduction techniques to the H 2 output feedback control problem. We showed how the controller can be reduced. Numerical examples proved that the procedure can lead to a large speed-up compared to a full calculation and simulation. Unfortunatelly, the H 2 control problem lacks robustness properties like the H robust control method. The numerical calculations showed instabilities, when too small basis sizes were employed. An application of the proposed framework to the H problem could lead to a more robust reduction, and maybe even allows to prove guaranteed bounds for ensuring the stability of the procedure. ACKNOWLEDGEMENTS The authors acknowledges funding by the Landesstiftung Baden Württemberg ggmbh and would like to thank the German Research Foundation (DFG) for financial support within the Cluster of Excellence in Simulation Technology (EXC 31/1) at the University of Stuttgart. REFERENCES Athans, M. (1971). The role and use of the stochastic linear-quadratic-gaussian problem in control system design. IEEE Transactions on Automatic Control, 16(6), doi:1.119/tac Benner, P. and Saak, J. (213). Numerical solution of large and sparse continuous time algebraic matrix Riccati and Lyapunov equations: a state of the art survey. GAMM-Mitteilungen, 36(1), doi: 1.12/gamm Benner, P. and Bujanović, Z. (214). On the solution of large-scale algebraic Riccati equations by using lowdimensional invariant subspaces. Preprint MPIMD/14-15, Max Planck Institute Magdeburg. Benner, P., Gugercin, S., and Willcox, K. (215). A survey of projection-based model reduction methods for parametric dynamical systems. SIAM Rev., 57(4), doi:1.1137/ Dihlmann, M. and Haasdonk, B. (215). A reduced basis Kalman filter for parametrized partial differential equations. ESAIM: Control, Optimisation and Calculus of Variations. doi:1.151/cocv/ Doyle, J. (1978). Guaranteed margins for LQG regulators. Automatic Control, IEEE Transactions on, 23(4), doi:1.119/tac Haasdonk, B. and Ohlberger, M. (211). Efficient reduced models and a posteriori error estimation for parametrized dynamical systems by offline/online decomposition. Math. Comp. Model Dyn., 17(2), doi:1.18/ Kalman, R.E. and Bucy, R.S. (1961). New results in linear filtering and prediction theory. Journal of Basic Engineering, 83(1), 95. doi:1.1115/ Kwakernaak, H. and Sivan, R. (1972). Linear optimal control systems, volume 1. Wiley-interscience New York. Lancaster, P. and Rodman, L. (1995). Algebraic Riccati equations. Oxford University Press. Luenberger, D. (1964). Observing the state of a linear system. Military Electronics, IEEE Transactions on, 8(2), doi:1.119/tme Patera, A. and Rozza, G. (27). Reduced Basis Approximation and a Posteriori Error Estimation for Parametrized Partial Differential Equations. To appear in (tentative) MIT Pappalardo Graduate Monographs in Mechanical Engineering. MIT. Schmidt, A., Dihlmann, M., and Haasdonk, B. (214). Basis generation approaches for a reduced basis linear quadratic regulator. In Proceedings of MATHMOD 215, doi:1.116/j.ifacol Schmidt, A. and Haasdonk, B. (215). Reduced basis approximation of large scale algebraic Riccati equations. Technical report, University of Stuttgart. Submitted. Volkwein, S. (211). Model reduction using proper orthogonal decomposition. Lecture notes, University of Konstanz. Zhou, K., Doyle, J., and Glover, K. (1996). Robust and Optimal Control. Prentice Hall.

Reduced Basis Method for Parametric

Reduced Basis Method for Parametric 1/24 Reduced Basis Method for Parametric H 2 -Optimal Control Problems NUMOC2017 Andreas Schmidt, Bernard Haasdonk Institute for Applied Analysis and Numerical Simulation, University of Stuttgart andreas.schmidt@mathematik.uni-stuttgart.de

More information

6.241 Dynamic Systems and Control

6.241 Dynamic Systems and Control 6.241 Dynamic Systems and Control Lecture 24: H2 Synthesis Emilio Frazzoli Aeronautics and Astronautics Massachusetts Institute of Technology May 4, 2011 E. Frazzoli (MIT) Lecture 24: H 2 Synthesis May

More information

EL2520 Control Theory and Practice

EL2520 Control Theory and Practice EL2520 Control Theory and Practice Lecture 8: Linear quadratic control Mikael Johansson School of Electrical Engineering KTH, Stockholm, Sweden Linear quadratic control Allows to compute the controller

More information

Denis ARZELIER arzelier

Denis ARZELIER   arzelier COURSE ON LMI OPTIMIZATION WITH APPLICATIONS IN CONTROL PART II.2 LMIs IN SYSTEMS CONTROL STATE-SPACE METHODS PERFORMANCE ANALYSIS and SYNTHESIS Denis ARZELIER www.laas.fr/ arzelier arzelier@laas.fr 15

More information

Schmidt, Andreas 1 and Haasdonk, Bernard 1

Schmidt, Andreas 1 and Haasdonk, Bernard 1 ESAIM: Control, Optimisation and Calculus of Variations URL: http://www.emath.fr/cocv/ Will be set by the publisher REDUCED BASIS APPROXIMATION OF LARGE SCALE PARAMETRIC ALGEBRAIC RICCATI EQUATIONS Schmidt,

More information

A-Posteriori Error Estimation for Parameterized Kernel-Based Systems

A-Posteriori Error Estimation for Parameterized Kernel-Based Systems A-Posteriori Error Estimation for Parameterized Kernel-Based Systems Daniel Wirtz Bernard Haasdonk Institute for Applied Analysis and Numerical Simulation University of Stuttgart 70569 Stuttgart, Pfaffenwaldring

More information

Parameterized Partial Differential Equations and the Proper Orthogonal D

Parameterized Partial Differential Equations and the Proper Orthogonal D Parameterized Partial Differential Equations and the Proper Orthogonal Decomposition Stanford University February 04, 2014 Outline Parameterized PDEs The steady case Dimensionality reduction Proper orthogonal

More information

Chapter 3. LQ, LQG and Control System Design. Dutch Institute of Systems and Control

Chapter 3. LQ, LQG and Control System Design. Dutch Institute of Systems and Control Chapter 3 LQ, LQG and Control System H 2 Design Overview LQ optimization state feedback LQG optimization output feedback H 2 optimization non-stochastic version of LQG Application to feedback system design

More information

Problem Set 5 Solutions 1

Problem Set 5 Solutions 1 Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science 6.245: MULTIVARIABLE CONTROL SYSTEMS by A. Megretski Problem Set 5 Solutions The problem set deals with Hankel

More information

Contents. 1 State-Space Linear Systems 5. 2 Linearization Causality, Time Invariance, and Linearity 31

Contents. 1 State-Space Linear Systems 5. 2 Linearization Causality, Time Invariance, and Linearity 31 Contents Preamble xiii Linear Systems I Basic Concepts 1 I System Representation 3 1 State-Space Linear Systems 5 1.1 State-Space Linear Systems 5 1.2 Block Diagrams 7 1.3 Exercises 11 2 Linearization

More information

Multi-Model Adaptive Regulation for a Family of Systems Containing Different Zero Structures

Multi-Model Adaptive Regulation for a Family of Systems Containing Different Zero Structures Preprints of the 19th World Congress The International Federation of Automatic Control Multi-Model Adaptive Regulation for a Family of Systems Containing Different Zero Structures Eric Peterson Harry G.

More information

The norms can also be characterized in terms of Riccati inequalities.

The norms can also be characterized in terms of Riccati inequalities. 9 Analysis of stability and H norms Consider the causal, linear, time-invariant system ẋ(t = Ax(t + Bu(t y(t = Cx(t Denote the transfer function G(s := C (si A 1 B. Theorem 85 The following statements

More information

Here represents the impulse (or delta) function. is an diagonal matrix of intensities, and is an diagonal matrix of intensities.

Here represents the impulse (or delta) function. is an diagonal matrix of intensities, and is an diagonal matrix of intensities. 19 KALMAN FILTER 19.1 Introduction In the previous section, we derived the linear quadratic regulator as an optimal solution for the fullstate feedback control problem. The inherent assumption was that

More information

State Regulator. Advanced Control. design of controllers using pole placement and LQ design rules

State Regulator. Advanced Control. design of controllers using pole placement and LQ design rules Advanced Control State Regulator Scope design of controllers using pole placement and LQ design rules Keywords pole placement, optimal control, LQ regulator, weighting matrixes Prerequisites Contact state

More information

Lecture 7 : Generalized Plant and LFT form Dr.-Ing. Sudchai Boonto Assistant Professor

Lecture 7 : Generalized Plant and LFT form Dr.-Ing. Sudchai Boonto Assistant Professor Dr.-Ing. Sudchai Boonto Assistant Professor Department of Control System and Instrumentation Engineering King Mongkuts Unniversity of Technology Thonburi Thailand Linear Quadratic Gaussian The state space

More information

Linear System Theory

Linear System Theory Linear System Theory Wonhee Kim Chapter 6: Controllability & Observability Chapter 7: Minimal Realizations May 2, 217 1 / 31 Recap State space equation Linear Algebra Solutions of LTI and LTV system Stability

More information

Optimal control and estimation

Optimal control and estimation Automatic Control 2 Optimal control and estimation Prof. Alberto Bemporad University of Trento Academic year 2010-2011 Prof. Alberto Bemporad (University of Trento) Automatic Control 2 Academic year 2010-2011

More information

ME 234, Lyapunov and Riccati Problems. 1. This problem is to recall some facts and formulae you already know. e Aτ BB e A τ dτ

ME 234, Lyapunov and Riccati Problems. 1. This problem is to recall some facts and formulae you already know. e Aτ BB e A τ dτ ME 234, Lyapunov and Riccati Problems. This problem is to recall some facts and formulae you already know. (a) Let A and B be matrices of appropriate dimension. Show that (A, B) is controllable if and

More information

Linear Quadratic Gausssian Control Design with Loop Transfer Recovery

Linear Quadratic Gausssian Control Design with Loop Transfer Recovery Linear Quadratic Gausssian Control Design with Loop Transfer Recovery Leonid Freidovich Department of Mathematics Michigan State University MI 48824, USA e-mail:leonid@math.msu.edu http://www.math.msu.edu/

More information

Reduced-Order Greedy Controllability of Finite Dimensional Linear Systems. Giulia Fabrini Laura Iapichino Stefan Volkwein

Reduced-Order Greedy Controllability of Finite Dimensional Linear Systems. Giulia Fabrini Laura Iapichino Stefan Volkwein Universität Konstanz Reduced-Order Greedy Controllability of Finite Dimensional Linear Systems Giulia Fabrini Laura Iapichino Stefan Volkwein Konstanzer Schriften in Mathematik Nr. 364, Oktober 2017 ISSN

More information

Semidefinite Programming Duality and Linear Time-invariant Systems

Semidefinite Programming Duality and Linear Time-invariant Systems Semidefinite Programming Duality and Linear Time-invariant Systems Venkataramanan (Ragu) Balakrishnan School of ECE, Purdue University 2 July 2004 Workshop on Linear Matrix Inequalities in Control LAAS-CNRS,

More information

6.241 Dynamic Systems and Control

6.241 Dynamic Systems and Control 6.41 Dynamic Systems and Control Lecture 5: H Synthesis Emilio Frazzoli Aeronautics and Astronautics Massachusetts Institute of Technology May 11, 011 E. Frazzoli (MIT) Lecture 5: H Synthesis May 11, 011

More information

Topic # Feedback Control Systems

Topic # Feedback Control Systems Topic #17 16.31 Feedback Control Systems Deterministic LQR Optimal control and the Riccati equation Weight Selection Fall 2007 16.31 17 1 Linear Quadratic Regulator (LQR) Have seen the solutions to the

More information

BALANCING-RELATED MODEL REDUCTION FOR DATA-SPARSE SYSTEMS

BALANCING-RELATED MODEL REDUCTION FOR DATA-SPARSE SYSTEMS BALANCING-RELATED Peter Benner Professur Mathematik in Industrie und Technik Fakultät für Mathematik Technische Universität Chemnitz Computational Methods with Applications Harrachov, 19 25 August 2007

More information

Robust Control 5 Nominal Controller Design Continued

Robust Control 5 Nominal Controller Design Continued Robust Control 5 Nominal Controller Design Continued Harry G. Kwatny Department of Mechanical Engineering & Mechanics Drexel University 4/14/2003 Outline he LQR Problem A Generalization to LQR Min-Max

More information

Lecture 8. Applications

Lecture 8. Applications Lecture 8. Applications Ivan Papusha CDS270 2: Mathematical Methods in Control and System Engineering May 8, 205 / 3 Logistics hw7 due this Wed, May 20 do an easy problem or CYOA hw8 (design problem) will

More information

5. Observer-based Controller Design

5. Observer-based Controller Design EE635 - Control System Theory 5. Observer-based Controller Design Jitkomut Songsiri state feedback pole-placement design regulation and tracking state observer feedback observer design LQR and LQG 5-1

More information

H 2 optimal model reduction - Wilson s conditions for the cross-gramian

H 2 optimal model reduction - Wilson s conditions for the cross-gramian H 2 optimal model reduction - Wilson s conditions for the cross-gramian Ha Binh Minh a, Carles Batlle b a School of Applied Mathematics and Informatics, Hanoi University of Science and Technology, Dai

More information

Hankel Optimal Model Reduction 1

Hankel Optimal Model Reduction 1 Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science 6.242, Fall 2004: MODEL REDUCTION Hankel Optimal Model Reduction 1 This lecture covers both the theory and

More information

Balanced Truncation 1

Balanced Truncation 1 Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science 6.242, Fall 2004: MODEL REDUCTION Balanced Truncation This lecture introduces balanced truncation for LTI

More information

Lecture 2: Discrete-time Linear Quadratic Optimal Control

Lecture 2: Discrete-time Linear Quadratic Optimal Control ME 33, U Berkeley, Spring 04 Xu hen Lecture : Discrete-time Linear Quadratic Optimal ontrol Big picture Example onvergence of finite-time LQ solutions Big picture previously: dynamic programming and finite-horizon

More information

Subject: Optimal Control Assignment-1 (Related to Lecture notes 1-10)

Subject: Optimal Control Assignment-1 (Related to Lecture notes 1-10) Subject: Optimal Control Assignment- (Related to Lecture notes -). Design a oil mug, shown in fig., to hold as much oil possible. The height and radius of the mug should not be more than 6cm. The mug must

More information

MPC/LQG for infinite-dimensional systems using time-invariant linearizations

MPC/LQG for infinite-dimensional systems using time-invariant linearizations MPC/LQG for infinite-dimensional systems using time-invariant linearizations Peter Benner 1 and Sabine Hein 2 1 Max Planck Institute for Dynamics of Complex Technical Systems, Sandtorstr. 1, 39106 Magdeburg,

More information

Decentralized LQG Control of Systems with a Broadcast Architecture

Decentralized LQG Control of Systems with a Broadcast Architecture Decentralized LQG Control of Systems with a Broadcast Architecture Laurent Lessard 1,2 IEEE Conference on Decision and Control, pp. 6241 6246, 212 Abstract In this paper, we consider dynamical subsystems

More information

10 Transfer Matrix Models

10 Transfer Matrix Models MIT EECS 6.241 (FALL 26) LECTURE NOTES BY A. MEGRETSKI 1 Transfer Matrix Models So far, transfer matrices were introduced for finite order state space LTI models, in which case they serve as an important

More information

H 2 Optimal State Feedback Control Synthesis. Raktim Bhattacharya Aerospace Engineering, Texas A&M University

H 2 Optimal State Feedback Control Synthesis. Raktim Bhattacharya Aerospace Engineering, Texas A&M University H 2 Optimal State Feedback Control Synthesis Raktim Bhattacharya Aerospace Engineering, Texas A&M University Motivation Motivation w(t) u(t) G K y(t) z(t) w(t) are exogenous signals reference, process

More information

Problem Set 4 Solution 1

Problem Set 4 Solution 1 Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science 6.245: MULTIVARIABLE CONTROL SYSTEMS by A. Megretski Problem Set 4 Solution Problem 4. For the SISO feedback

More information

OPTIMAL CONTROL AND ESTIMATION

OPTIMAL CONTROL AND ESTIMATION OPTIMAL CONTROL AND ESTIMATION Robert F. Stengel Department of Mechanical and Aerospace Engineering Princeton University, Princeton, New Jersey DOVER PUBLICATIONS, INC. New York CONTENTS 1. INTRODUCTION

More information

Computational Methods for Feedback Control in Damped Gyroscopic Second-order Systems 1

Computational Methods for Feedback Control in Damped Gyroscopic Second-order Systems 1 Computational Methods for Feedback Control in Damped Gyroscopic Second-order Systems 1 B. N. Datta, IEEE Fellow 2 D. R. Sarkissian 3 Abstract Two new computationally viable algorithms are proposed for

More information

Control Systems I. Lecture 4: Diagonalization, Modal Analysis, Intro to Feedback. Readings: Emilio Frazzoli

Control Systems I. Lecture 4: Diagonalization, Modal Analysis, Intro to Feedback. Readings: Emilio Frazzoli Control Systems I Lecture 4: Diagonalization, Modal Analysis, Intro to Feedback Readings: Emilio Frazzoli Institute for Dynamic Systems and Control D-MAVT ETH Zürich October 13, 2017 E. Frazzoli (ETH)

More information

Model Reduction for Unstable Systems

Model Reduction for Unstable Systems Model Reduction for Unstable Systems Klajdi Sinani Virginia Tech klajdi@vt.edu Advisor: Serkan Gugercin October 22, 2015 (VT) SIAM October 22, 2015 1 / 26 Overview 1 Introduction 2 Interpolatory Model

More information

Principles of Optimal Control Spring 2008

Principles of Optimal Control Spring 2008 MIT OpenCourseWare http://ocw.mit.edu 16.323 Principles of Optimal Control Spring 2008 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms. 16.323 Lecture

More information

Limiting Performance of Optimal Linear Filters

Limiting Performance of Optimal Linear Filters Limiting Performance of Optimal Linear Filters J.H. Braslavsky M.M. Seron D.Q. Mayne P.V. Kokotović Technical Report CCEC 97-414 Center for Control Engineering and Computation University of California

More information

LQR, Kalman Filter, and LQG. Postgraduate Course, M.Sc. Electrical Engineering Department College of Engineering University of Salahaddin

LQR, Kalman Filter, and LQG. Postgraduate Course, M.Sc. Electrical Engineering Department College of Engineering University of Salahaddin LQR, Kalman Filter, and LQG Postgraduate Course, M.Sc. Electrical Engineering Department College of Engineering University of Salahaddin May 2015 Linear Quadratic Regulator (LQR) Consider a linear system

More information

CONTROL DESIGN FOR SET POINT TRACKING

CONTROL DESIGN FOR SET POINT TRACKING Chapter 5 CONTROL DESIGN FOR SET POINT TRACKING In this chapter, we extend the pole placement, observer-based output feedback design to solve tracking problems. By tracking we mean that the output is commanded

More information

ESC794: Special Topics: Model Predictive Control

ESC794: Special Topics: Model Predictive Control ESC794: Special Topics: Model Predictive Control Discrete-Time Systems Hanz Richter, Professor Mechanical Engineering Department Cleveland State University Discrete-Time vs. Sampled-Data Systems A continuous-time

More information

Topic # Feedback Control Systems

Topic # Feedback Control Systems Topic #20 16.31 Feedback Control Systems Closed-loop system analysis Bounded Gain Theorem Robust Stability Fall 2007 16.31 20 1 SISO Performance Objectives Basic setup: d i d o r u y G c (s) G(s) n control

More information

Structured State Space Realizations for SLS Distributed Controllers

Structured State Space Realizations for SLS Distributed Controllers Structured State Space Realizations for SLS Distributed Controllers James Anderson and Nikolai Matni Abstract In recent work the system level synthesis (SLS) paradigm has been shown to provide a truly

More information

Chapter 2 Optimal Control Problem

Chapter 2 Optimal Control Problem Chapter 2 Optimal Control Problem Optimal control of any process can be achieved either in open or closed loop. In the following two chapters we concentrate mainly on the first class. The first chapter

More information

ẋ n = f n (x 1,...,x n,u 1,...,u m ) (5) y 1 = g 1 (x 1,...,x n,u 1,...,u m ) (6) y p = g p (x 1,...,x n,u 1,...,u m ) (7)

ẋ n = f n (x 1,...,x n,u 1,...,u m ) (5) y 1 = g 1 (x 1,...,x n,u 1,...,u m ) (6) y p = g p (x 1,...,x n,u 1,...,u m ) (7) EEE582 Topical Outline A.A. Rodriguez Fall 2007 GWC 352, 965-3712 The following represents a detailed topical outline of the course. It attempts to highlight most of the key concepts to be covered and

More information

Modern Optimal Control

Modern Optimal Control Modern Optimal Control Matthew M. Peet Arizona State University Lecture 22: H 2, LQG and LGR Conclusion To solve the H -optimal state-feedback problem, we solve min γ such that γ,x 1,Y 1,A n,b n,c n,d

More information

I. D. Landau, A. Karimi: A Course on Adaptive Control Adaptive Control. Part 9: Adaptive Control with Multiple Models and Switching

I. D. Landau, A. Karimi: A Course on Adaptive Control Adaptive Control. Part 9: Adaptive Control with Multiple Models and Switching I. D. Landau, A. Karimi: A Course on Adaptive Control - 5 1 Adaptive Control Part 9: Adaptive Control with Multiple Models and Switching I. D. Landau, A. Karimi: A Course on Adaptive Control - 5 2 Outline

More information

Chapter 9 Observers, Model-based Controllers 9. Introduction In here we deal with the general case where only a subset of the states, or linear combin

Chapter 9 Observers, Model-based Controllers 9. Introduction In here we deal with the general case where only a subset of the states, or linear combin Lectures on Dynamic Systems and Control Mohammed Dahleh Munther A. Dahleh George Verghese Department of Electrical Engineering and Computer Science Massachuasetts Institute of Technology c Chapter 9 Observers,

More information

Navigation and Obstacle Avoidance via Backstepping for Mechanical Systems with Drift in the Closed Loop

Navigation and Obstacle Avoidance via Backstepping for Mechanical Systems with Drift in the Closed Loop Navigation and Obstacle Avoidance via Backstepping for Mechanical Systems with Drift in the Closed Loop Jan Maximilian Montenbruck, Mathias Bürger, Frank Allgöwer Abstract We study backstepping controllers

More information

Model reduction for linear systems by balancing

Model reduction for linear systems by balancing Model reduction for linear systems by balancing Bart Besselink Jan C. Willems Center for Systems and Control Johann Bernoulli Institute for Mathematics and Computer Science University of Groningen, Groningen,

More information

EE C128 / ME C134 Final Exam Fall 2014

EE C128 / ME C134 Final Exam Fall 2014 EE C128 / ME C134 Final Exam Fall 2014 December 19, 2014 Your PRINTED FULL NAME Your STUDENT ID NUMBER Number of additional sheets 1. No computers, no tablets, no connected device (phone etc.) 2. Pocket

More information

Nonlinear Observers. Jaime A. Moreno. Eléctrica y Computación Instituto de Ingeniería Universidad Nacional Autónoma de México

Nonlinear Observers. Jaime A. Moreno. Eléctrica y Computación Instituto de Ingeniería Universidad Nacional Autónoma de México Nonlinear Observers Jaime A. Moreno JMorenoP@ii.unam.mx Eléctrica y Computación Instituto de Ingeniería Universidad Nacional Autónoma de México XVI Congreso Latinoamericano de Control Automático October

More information

EEE582 Homework Problems

EEE582 Homework Problems EEE582 Homework Problems HW. Write a state-space realization of the linearized model for the cruise control system around speeds v = 4 (Section.3, http://tsakalis.faculty.asu.edu/notes/models.pdf). Use

More information

Robust Multivariable Control

Robust Multivariable Control Lecture 2 Anders Helmersson anders.helmersson@liu.se ISY/Reglerteknik Linköpings universitet Today s topics Today s topics Norms Today s topics Norms Representation of dynamic systems Today s topics Norms

More information

Linear Algebra. P R E R E Q U I S I T E S A S S E S S M E N T Ahmad F. Taha August 24, 2015

Linear Algebra. P R E R E Q U I S I T E S A S S E S S M E N T Ahmad F. Taha August 24, 2015 THE UNIVERSITY OF TEXAS AT SAN ANTONIO EE 5243 INTRODUCTION TO CYBER-PHYSICAL SYSTEMS P R E R E Q U I S I T E S A S S E S S M E N T Ahmad F. Taha August 24, 2015 The objective of this exercise is to assess

More information

Linear-Quadratic-Gaussian (LQG) Controllers and Kalman Filters

Linear-Quadratic-Gaussian (LQG) Controllers and Kalman Filters Linear-Quadratic-Gaussian (LQG) Controllers and Kalman Filters Emo Todorov Applied Mathematics and Computer Science & Engineering University of Washington Winter 204 Emo Todorov (UW) AMATH/CSE 579, Winter

More information

EML5311 Lyapunov Stability & Robust Control Design

EML5311 Lyapunov Stability & Robust Control Design EML5311 Lyapunov Stability & Robust Control Design 1 Lyapunov Stability criterion In Robust control design of nonlinear uncertain systems, stability theory plays an important role in engineering systems.

More information

Appendix A Solving Linear Matrix Inequality (LMI) Problems

Appendix A Solving Linear Matrix Inequality (LMI) Problems Appendix A Solving Linear Matrix Inequality (LMI) Problems In this section, we present a brief introduction about linear matrix inequalities which have been used extensively to solve the FDI problems described

More information

1. Find the solution of the following uncontrolled linear system. 2 α 1 1

1. Find the solution of the following uncontrolled linear system. 2 α 1 1 Appendix B Revision Problems 1. Find the solution of the following uncontrolled linear system 0 1 1 ẋ = x, x(0) =. 2 3 1 Class test, August 1998 2. Given the linear system described by 2 α 1 1 ẋ = x +

More information

Lecture 9. Introduction to Kalman Filtering. Linear Quadratic Gaussian Control (LQG) G. Hovland 2004

Lecture 9. Introduction to Kalman Filtering. Linear Quadratic Gaussian Control (LQG) G. Hovland 2004 MER42 Advanced Control Lecture 9 Introduction to Kalman Filtering Linear Quadratic Gaussian Control (LQG) G. Hovland 24 Announcement No tutorials on hursday mornings 8-9am I will be present in all practical

More information

Module 07 Controllability and Controller Design of Dynamical LTI Systems

Module 07 Controllability and Controller Design of Dynamical LTI Systems Module 07 Controllability and Controller Design of Dynamical LTI Systems Ahmad F. Taha EE 5143: Linear Systems and Control Email: ahmad.taha@utsa.edu Webpage: http://engineering.utsa.edu/ataha October

More information

Empirical Interpolation of Nonlinear Parametrized Evolution Operators

Empirical Interpolation of Nonlinear Parametrized Evolution Operators MÜNSTER Empirical Interpolation of Nonlinear Parametrized Evolution Operators Martin Drohmann, Bernard Haasdonk, Mario Ohlberger 03/12/2010 MÜNSTER 2/20 > Motivation: Reduced Basis Method RB Scenario:

More information

Iterative Solution of a Matrix Riccati Equation Arising in Stochastic Control

Iterative Solution of a Matrix Riccati Equation Arising in Stochastic Control Iterative Solution of a Matrix Riccati Equation Arising in Stochastic Control Chun-Hua Guo Dedicated to Peter Lancaster on the occasion of his 70th birthday We consider iterative methods for finding the

More information

Mapping MIMO control system specifications into parameter space

Mapping MIMO control system specifications into parameter space Mapping MIMO control system specifications into parameter space Michael Muhler 1 Abstract This paper considers the mapping of design objectives for parametric multi-input multi-output systems into parameter

More information

Every real system has uncertainties, which include system parametric uncertainties, unmodeled dynamics

Every real system has uncertainties, which include system parametric uncertainties, unmodeled dynamics Sensitivity Analysis of Disturbance Accommodating Control with Kalman Filter Estimation Jemin George and John L. Crassidis University at Buffalo, State University of New York, Amherst, NY, 14-44 The design

More information

MATH4406 (Control Theory) Unit 1: Introduction Prepared by Yoni Nazarathy, July 21, 2012

MATH4406 (Control Theory) Unit 1: Introduction Prepared by Yoni Nazarathy, July 21, 2012 MATH4406 (Control Theory) Unit 1: Introduction Prepared by Yoni Nazarathy, July 21, 2012 Unit Outline Introduction to the course: Course goals, assessment, etc... What is Control Theory A bit of jargon,

More information

3 Gramians and Balanced Realizations

3 Gramians and Balanced Realizations 3 Gramians and Balanced Realizations In this lecture, we use an optimization approach to find suitable realizations for truncation and singular perturbation of G. It turns out that the recommended realizations

More information

Exam. 135 minutes, 15 minutes reading time

Exam. 135 minutes, 15 minutes reading time Exam August 6, 208 Control Systems II (5-0590-00) Dr. Jacopo Tani Exam Exam Duration: 35 minutes, 5 minutes reading time Number of Problems: 35 Number of Points: 47 Permitted aids: 0 pages (5 sheets) A4.

More information

w T 1 w T 2. w T n 0 if i j 1 if i = j

w T 1 w T 2. w T n 0 if i j 1 if i = j Lyapunov Operator Let A F n n be given, and define a linear operator L A : C n n C n n as L A (X) := A X + XA Suppose A is diagonalizable (what follows can be generalized even if this is not possible -

More information

CONTROL SYSTEMS, ROBOTICS AND AUTOMATION - Vol. XIII - Nonlinear Observers - A. J. Krener

CONTROL SYSTEMS, ROBOTICS AND AUTOMATION - Vol. XIII - Nonlinear Observers - A. J. Krener NONLINEAR OBSERVERS A. J. Krener University of California, Davis, CA, USA Keywords: nonlinear observer, state estimation, nonlinear filtering, observability, high gain observers, minimum energy estimation,

More information

Observability. It was the property in Lyapunov stability which allowed us to resolve that

Observability. It was the property in Lyapunov stability which allowed us to resolve that Observability We have seen observability twice already It was the property which permitted us to retrieve the initial state from the initial data {u(0),y(0),u(1),y(1),...,u(n 1),y(n 1)} It was the property

More information

The model reduction algorithm proposed is based on an iterative two-step LMI scheme. The convergence of the algorithm is not analyzed but examples sho

The model reduction algorithm proposed is based on an iterative two-step LMI scheme. The convergence of the algorithm is not analyzed but examples sho Model Reduction from an H 1 /LMI perspective A. Helmersson Department of Electrical Engineering Linkoping University S-581 8 Linkoping, Sweden tel: +6 1 816 fax: +6 1 86 email: andersh@isy.liu.se September

More information

LINEAR QUADRATIC GAUSSIAN

LINEAR QUADRATIC GAUSSIAN ECE553: Multivariable Control Systems II. LINEAR QUADRATIC GAUSSIAN.: Deriving LQG via separation principle We will now start to look at the design of controllers for systems Px.t/ D A.t/x.t/ C B u.t/u.t/

More information

L2 gains and system approximation quality 1

L2 gains and system approximation quality 1 Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science 6.242, Fall 24: MODEL REDUCTION L2 gains and system approximation quality 1 This lecture discusses the utility

More information

LMI Methods in Optimal and Robust Control

LMI Methods in Optimal and Robust Control LMI Methods in Optimal and Robust Control Matthew M. Peet Arizona State University Lecture 14: LMIs for Robust Control in the LF Framework ypes of Uncertainty In this Lecture, we will cover Unstructured,

More information

Raktim Bhattacharya. . AERO 632: Design of Advance Flight Control System. Norms for Signals and Systems

Raktim Bhattacharya. . AERO 632: Design of Advance Flight Control System. Norms for Signals and Systems . AERO 632: Design of Advance Flight Control System Norms for Signals and. Raktim Bhattacharya Laboratory For Uncertainty Quantification Aerospace Engineering, Texas A&M University. Norms for Signals ...

More information

6. Linear Quadratic Regulator Control

6. Linear Quadratic Regulator Control EE635 - Control System Theory 6. Linear Quadratic Regulator Control Jitkomut Songsiri algebraic Riccati Equation (ARE) infinite-time LQR (continuous) Hamiltonian matrix gain margin of LQR 6-1 Algebraic

More information

Lecture 15: H Control Synthesis

Lecture 15: H Control Synthesis c A. Shiriaev/L. Freidovich. March 12, 2010. Optimal Control for Linear Systems: Lecture 15 p. 1/14 Lecture 15: H Control Synthesis Example c A. Shiriaev/L. Freidovich. March 12, 2010. Optimal Control

More information

FEL3210 Multivariable Feedback Control

FEL3210 Multivariable Feedback Control FEL3210 Multivariable Feedback Control Lecture 8: Youla parametrization, LMIs, Model Reduction and Summary [Ch. 11-12] Elling W. Jacobsen, Automatic Control Lab, KTH Lecture 8: Youla, LMIs, Model Reduction

More information

LINEAR QUADRATIC OPTIMAL CONTROL BASED ON DYNAMIC COMPENSATION. Received October 2010; revised March 2011

LINEAR QUADRATIC OPTIMAL CONTROL BASED ON DYNAMIC COMPENSATION. Received October 2010; revised March 2011 International Journal of Innovative Computing, Information and Control ICIC International c 22 ISSN 349-498 Volume 8, Number 5(B), May 22 pp. 3743 3754 LINEAR QUADRATIC OPTIMAL CONTROL BASED ON DYNAMIC

More information

Modern Optimal Control

Modern Optimal Control Modern Optimal Control Matthew M. Peet Arizona State University Lecture 19: Stabilization via LMIs Optimization Optimization can be posed in functional form: min x F objective function : inequality constraints

More information

State observers for invariant dynamics on a Lie group

State observers for invariant dynamics on a Lie group State observers for invariant dynamics on a Lie group C. Lageman, R. Mahony, J. Trumpf 1 Introduction This paper concerns the design of full state observers for state space systems where the state is evolving

More information

16.31 Fall 2005 Lecture Presentation Mon 31-Oct-05 ver 1.1

16.31 Fall 2005 Lecture Presentation Mon 31-Oct-05 ver 1.1 16.31 Fall 2005 Lecture Presentation Mon 31-Oct-05 ver 1.1 Charles P. Coleman October 31, 2005 1 / 40 : Controllability Tests Observability Tests LEARNING OUTCOMES: Perform controllability tests Perform

More information

Chapter 5. Standard LTI Feedback Optimization Setup. 5.1 The Canonical Setup

Chapter 5. Standard LTI Feedback Optimization Setup. 5.1 The Canonical Setup Chapter 5 Standard LTI Feedback Optimization Setup Efficient LTI feedback optimization algorithms comprise a major component of modern feedback design approach: application problems involving complex models

More information

Efficient robust optimization for robust control with constraints Paul Goulart, Eric Kerrigan and Danny Ralph

Efficient robust optimization for robust control with constraints Paul Goulart, Eric Kerrigan and Danny Ralph Efficient robust optimization for robust control with constraints p. 1 Efficient robust optimization for robust control with constraints Paul Goulart, Eric Kerrigan and Danny Ralph Efficient robust optimization

More information

The Kalman-Yakubovich-Popov Lemma for Differential-Algebraic Equations with Applications

The Kalman-Yakubovich-Popov Lemma for Differential-Algebraic Equations with Applications MAX PLANCK INSTITUTE Elgersburg Workshop Elgersburg February 11-14, 2013 The Kalman-Yakubovich-Popov Lemma for Differential-Algebraic Equations with Applications Timo Reis 1 Matthias Voigt 2 1 Department

More information

H 2 Suboptimal Estimation and Control for Nonnegative

H 2 Suboptimal Estimation and Control for Nonnegative Proceedings of the 2007 American Control Conference Marriott Marquis Hotel at Times Square New York City, USA, July 11-13, 2007 FrC20.3 H 2 Suboptimal Estimation and Control for Nonnegative Dynamical Systems

More information

Control Systems I. Lecture 2: Modeling. Suggested Readings: Åström & Murray Ch. 2-3, Guzzella Ch Emilio Frazzoli

Control Systems I. Lecture 2: Modeling. Suggested Readings: Åström & Murray Ch. 2-3, Guzzella Ch Emilio Frazzoli Control Systems I Lecture 2: Modeling Suggested Readings: Åström & Murray Ch. 2-3, Guzzella Ch. 2-3 Emilio Frazzoli Institute for Dynamic Systems and Control D-MAVT ETH Zürich September 29, 2017 E. Frazzoli

More information

Zeros and zero dynamics

Zeros and zero dynamics CHAPTER 4 Zeros and zero dynamics 41 Zero dynamics for SISO systems Consider a linear system defined by a strictly proper scalar transfer function that does not have any common zero and pole: g(s) =α p(s)

More information

Linear State Feedback Controller Design

Linear State Feedback Controller Design Assignment For EE5101 - Linear Systems Sem I AY2010/2011 Linear State Feedback Controller Design Phang Swee King A0033585A Email: king@nus.edu.sg NGS/ECE Dept. Faculty of Engineering National University

More information

Krylov Subspace Methods for Nonlinear Model Reduction

Krylov Subspace Methods for Nonlinear Model Reduction MAX PLANCK INSTITUT Conference in honour of Nancy Nichols 70th birthday Reading, 2 3 July 2012 Krylov Subspace Methods for Nonlinear Model Reduction Peter Benner and Tobias Breiten Max Planck Institute

More information

Converse Lyapunov theorem and Input-to-State Stability

Converse Lyapunov theorem and Input-to-State Stability Converse Lyapunov theorem and Input-to-State Stability April 6, 2014 1 Converse Lyapunov theorem In the previous lecture, we have discussed few examples of nonlinear control systems and stability concepts

More information

Control Systems Design

Control Systems Design ELEC4410 Control Systems Design Lecture 18: State Feedback Tracking and State Estimation Julio H. Braslavsky julio@ee.newcastle.edu.au School of Electrical Engineering and Computer Science Lecture 18:

More information

INVERSE MODEL APPROACH TO DISTURBANCE REJECTION AND DECOUPLING CONTROLLER DESIGN. Leonid Lyubchyk

INVERSE MODEL APPROACH TO DISTURBANCE REJECTION AND DECOUPLING CONTROLLER DESIGN. Leonid Lyubchyk CINVESTAV Department of Automatic Control November 3, 20 INVERSE MODEL APPROACH TO DISTURBANCE REJECTION AND DECOUPLING CONTROLLER DESIGN Leonid Lyubchyk National Technical University of Ukraine Kharkov

More information

EE221A Linear System Theory Final Exam

EE221A Linear System Theory Final Exam EE221A Linear System Theory Final Exam Professor C. Tomlin Department of Electrical Engineering and Computer Sciences, UC Berkeley Fall 2016 12/16/16, 8-11am Your answers must be supported by analysis,

More information