RECURSIVE SUBSPACE IDENTIFICATION IN THE LEAST SQUARES FRAMEWORK
|
|
- Sheena Bryan
- 5 years ago
- Views:
Transcription
1 RECURSIVE SUBSPACE IDENTIFICATION IN THE LEAST SQUARES FRAMEWORK TRNKA PAVEL AND HAVLENA VLADIMÍR Dept of Control Engineering, Czech Technical University, Technická 2, Praha, Czech Republic mail: Abstract: Subspace identification methods 4SID) are relatively new in the field of linear systems identification In the recent years they proved to be efficient for industrial applications, due to their good properties, such as: same complexity of identification for single input/output and multiple input/output systems, direct state space model identification, numerical robustness QR and SVD factorization) and implicit model order reduction The algorithms are well developed for off-line identification, however online recursive identification is still rather an open topic The problem lies in the recursification of SVD, which is impossible and several approximations are used instead We use a different approach, exploiting the fact, that 4SID methods minimizes implicit optimality criterion, which is mean square error of multi-step predictions of the model The criterion allows for recursification in the least squares framework and prior knowledge incorporation We also address the problem of non-causality, which was recently pointed out in 4SID methods Keywords: System Identification, Subspace Identification, Least Squares, Recursive Algorithm, Multi-step Predictor 1 INTRODUCTION Modern control methods, like model predictive control, proved to be very effective in the industrial applications However the efficiency is often limited by the quality of the controlled system model, which is hard to obtain especially for the large systems with multiple inputs and multiple outputs MIMO) The recent advances in Subspace identification methods 4SID) Overschee and Moor [1996]) showed that they can be successful in the identification of such models from real world data The methods are moreover numerically robust, identify state space stochastic model and do not require extensive model parameterization like for example identification of MIMO ARMAX structure The 4SID methods are developed for off-line identification, however for industrial applications it is necessary to have on-line recursive algorithms for identification of the model, where parameters can vary in time This is still an open problem and several approaches have been suggested in Mercère et al [2005]; Kameyama and Ohsumi [2005], but the problem is still far from being solved The 4SID methods are based on the Geometrical Projections between the spaces spanned by the rows of certain matrices with Hankel structure built from measured input/output data and on exploration of these spaces by Singular Value Decomposition SVD) So far the suggested methods for recursification are rather complicated with complex theoretical background, because they are usually based on tricky recursive approximation of SVD We propose a new recursive 4SID method in the well-known least squares framework The 4SID methods can be shown to give a model, which is an optimal multistep predictor Trnka and Havlena [2005]), in the sense of minimizing the sum of prediction errors on the measured input/output data for a certain prediction horizon The oblique projections used in 4SID identification can be proved to arise from this multi-step optimization This fact can be exploited for recursive 4SID algorithm, allowing us to use recursive least squares with some type of forgetting and even allows us to incorporate prior information in the field of otherwise black-box approach of 4SID methods The prior information should be for example a funnel limiting model step response The paper is organized as follows: First the notation and the model used in subspace methods are established, next the standard subspace identification algorithm is shown, followed by its reformulation R068 1
2 into the least squares framework and finally the recursive 4SID algorithm is proposed The paper is closed with simulations results 2 STATE SPACE MODEL In this paper a state space model of stochastic system in the innovation form Ljung [1998]) is considered x k+1 = Ax k + Bu k + Ke k, 1) y k = Cx k + Du k + e k, 2) where u k R m is the m-dimensional input, x k R n is the n-dimensional state, y k R l is the l- dimensional output, K is the steady state Kalman gain and e k R l is an unknown innovation with covariance matrix E [ e k e T ] k = Re This model has close relation with widely used stochastic state space model x k+1 = Ax k + Bu k + v k, 3) y k = Cx k + Du k + w k, 4) where v k R m and w k R l are the process and the measurement noise with zero mean and covariance matrices E [ v k vk T ] [ = Q, E wk wk T ] [ = R and E vk wk T ] = S The process noise represents the disturbances entering the system and the measurement noise represent the uncertainty in the system observations The stochastic model 3 4) has good physical interpretation, however the innovation model 1 2) is more suitable for subspace methods, because it has a noise model with less degrees of freedom, which can be more appropriately identified from the given input/output data Both models can be shown to be equivalent from the input/output point of view up to the second order statistics means and covariances) 3 USED NOTATION Assume a set of input/output data samples u k, y k is available for k 0, 1,, 2i + j 2 These data can be arranged into Hankel matrices with i block rows and j columns u 0 u 1 u j 1 u 1 u 2 u j U p =, u i 1 u i u i+j 2 u i u i+1 u i+j 1 u i+1 u i+2 u i+j =, u 2i 1 u 2i u 2i+j 2 where U p is the matrix of past inputs and is the matrix of future inputs Although most of data samples are in both matrices, the notation past/feature is appropriate, because corresponding columns of U p and are subsequent without any common data samples and therefore have the meaning of the past and the future Value of the coefficient i is usually selected slightly larger then the upper bound of expected system order and the coefficient j is approximately equal to the number of measured data at disposal j i) From i and j ratio it is obvious that Hankel matrices U p and have the structures with long rows Output measurements and the noises can be simlirarly as the inputs arranged into Hankel matrices Y p, Y f, E p and E f System state sequence can be arranged in the matrices X p = x 0 x 1 x j 1 ), X f = x i x i+1 x i+j 1 ) R068 2
3 Recursively substituting the equation 1) into 2) a state space model in the matrix input/output form is obtained Y p = Γ i X p + H i U p + H s i E p, 5) Y f = Γ i X f + H i + H s i E f, 6) where Γ i R il n is an extended observability matrix and H i R il im and Hi s R il il are lower triangular Toeplitz matrices containing impulse response from deterministic input u k and stochastic input e k respectively This matrix form is a starting point for subspace identfication The structure of the parametres related matrices is as follows Γ i = C T CA) T CA i 1 ) T ) T D 0 0 CB D 0 H i =, CA i 2 B CA i 3 B D I m 0 0 Hi s CK I m 0 = CA i 2 K CA i 3 K I m 4 SUBSPACE IDENTIFICATION METHODS Subspace Identification Methods are relatively new in the field of system identification They are used for identification of linear time invariant state space model 1 2) directly from the input/output data They are generally entitled Subspace Identification Methods or more accurately 4SID methods Subspace State Space System IDentification) 4SID methods are an alternative to widely used Prediction Error Methods, like for example the least squares identification of ARX model or Gauss-Newton iterative ARMAX model identification 41 Standard 4SID Algorithm This section presents a brief version of unified subspace identification showing the basic steps of the algorithm First the measured data samples u k and y k are arranged into Hankel matrices U p,, Y p and Y f ) The next step is fundamental in the algorithm It is the computation of oblique projection Harville [1997]) The row space of future outputs matrix Y f is projected on the row space of past data matrix W p = Yp U p ) along the row space of future inputs O i = Y f / W p 7) Having obtained the matrix O i the rest of the algorithm is straightforward and uses the fact that O i can be written as a matrix multiplication O i = Γ i ˆXf, where matrix Γ i has full column rank and matrix ˆX f has full row rank Exploiting this fact and using singular value decomposition of weighted matrix O i weighting allows for tuning the algorithm) W 1 O i W 2 = UΣV T the order n of the system should be determined by inspecting the singular values in Σ to accordingly partition the matrices U, Σ and V T to obtain U 1 = U:, 1 : n), Σ 1 = Σ1 : n, 1 : n) and V T 1 = V 1 : R068 3
4 n, :) T Matlab like notation), which is used to compute Γ i and ˆX f as Γ i = W1 1 U 1 Σ 1/2 1, ˆX f = Γ i O i, where ) denotes Moore-Penrose matrix pseudo-inverse Harville [1997]) From the knowledge of the estimated state sequence ˆX f and measured input/output data, the state space model parameters A, B, C and D, can be computed by the least squares or total least squares from ) ) ) ˆXi+1 A B ˆXi = + ε, C D Y i U i where Y i is first block row of Hankel matrix Y f similarly U i ) Finally stochastic properties can be estimated from the residuals ) Ŝ = Σ 22, Σ11 Σ ˆK = Σ 12 Σ 1 22, where 12 = cov ε) Σ 21 Σ 22 This algorithm is only a basic version of subspace identification More sophisticated variations and extensions can be found in Overschee and Moor [1996], Overschee and Moor [1995] They differ mostly in the way of obtaining the model parameters from the matrix O i 42 4SID in the Least Squares Framework This section shows, how to derive the oblique projection 7), used in the unified 4SID algorithm, in the least squares framework Firstly a definition of the oblique projection will be recalled Assume the row spaces of the general matrices A R p j, B R q j and C R r j The oblique projection of the row space of A along the row space of B on the row space of C is defined as ) C T B T )) ] A / B C = A C T B T ) [ C B first r columns C 8) The important observation is that the equation 6), omitting the noise term, can be interpreted as the equation of a multi-step optimal predictor, based on the known system states X f and the inputs Ŷ f = Γ i X f + H i 9) However, the states X f are unknown in the process of identification As it is shown in Appendix A, the states can be estimated from the limited available input/outpu data set as a linear combination of past data W p The best output estimate is then Ỹ f = L w W p + H i, 10) which is based only on the input/output data Considering now the problem of optimal multi-step predictions, the parameter matrices L w and Hi d should be selected to let 10) optimally predict the measured outputs The quality of the prediction will be measured by a quadratic norm Frobenius norm) of prediction errors Yf min L Ỹf = min w,h i 2 L w,h i Y f ) ) W L w H p i 11) 2 Minimizing 11) means finding the best linear predictor in the sense of least squares Optimal values of L w and H i can be found from matrix pseudo-inverse Lw H i ) = Yf Wp ) R068 4
5 Denoting D = ) Wp the pseudo-inversion can be written as Lw H i ) = Yf D T DD T ) 1, 12) multiplying both sides of the equation by the matrix D from the right yields to ) Lw H i D T = Y f D DD T ) 1 D 13) }{{}}{{} Π D Ŷ f This expression represents the best linear prediction of Y f based on available data / ) Wp Ŷ f = Y f From Ŷf it is needed to get only the part coming from the term L w W p, because it is equal to Γ i ˆXi, which is the matrix O i necessary for further identification using SVD Section 41) To get it separately from 13) it is sufficient to use the right side of 12) and take only the first 2i columns and multiply them by the matrix W p alone L w W p = Y f D T [ DD T ) 1 ] first 2i columns W p Comparing this expression with 8) it is obvious, that it is equal with the oblique projection L w W p = Y f / W p, which can be rewritten using 19) as O i =) Γ i ˆXf = Y f / W p, yielding to the fundamental equation of subspace identification algorithm 7) 5 4SID RECURSIFICATION The objective function 11) and its interpretation as multi-step predictions optimization allows for straightforward recursification of 4SID algorithm without approximation or circumvent of SVD, which is typical for several recursive 4SID algorithms Recursive least squares can be used to find optimal L w and Hh d With each new measurements, the Hankel structure of data matrices Y f, W p and grow with one column The important facts allowing recursification is that L w and Hh d do not grow in time, they are not dependent on state basis selection and they are sufficient to estimate state space model parameters 4SID methods use O h = L w W p for model parameters estimation, suggesting that L w should be used in recursive 4SID for this estimation However, the meaning of L w is not very convenient and Hh d should be used instead The impulse response h k for k 0, h 1 can be read directly from the last block row of Hh d D should be read directly from h 0 and A,B,C using classical realization theory by Ho and Kalman 1966) Constructing a matrix of impulse responses h 1 h 2 h 3 h p h 2 h 3 h 4 H = h 3 h 4 h 5, h p h h 1 R068 5
6 A A max A 0 09 A 0 t min t max t Figure 1 Prior information as a funnel on the step response where p = h+1 2 for odd h H can be factorized by SVD as H = Γ p p, where p = B AB A p 1 B ) is the extended controllability matrix For a minimal realization, the matrices Γ p and p have full rank, and hence H has rank n, equal to the system order The algorithm of Ho and Kalman is based on the above observations The matrices B and C can be read directly from the first m columns of p and l rows of Γ p respectively The remaining matrix A is computed using shift invariance structure of Γ p : Γ p = Γ p A, where where Γ p is Γ p without the last block row and Γ p is Γ p without the first block row Algorithm Modifications: Forgetting To allow on-line identification of time-varying processes, the recursive algorithm can be modified to incorporate some well known type of forgetting For example from simple exponential to more advanced directionally constrained forgetting Prior Information A very convenient way to describe prior information is by a funnel limiting step or impulse response Figure 1) This approach can be used by initial conditions on mean value and covariance of H d h Ensuring Causality In Qin et al [2004, 2005], the 4SID methods based on the unified 4SID algorithm, were shown to have hidden non-causality The estimated parameter L w and Hh d of multi-step predictor are not constrained, however to ensure causality the matrix Hh d must have lower triangular structure From the structure of multi-step predictor it is obvious, that failing to ensure this property leads to non-causal predictions using future inputs predicting ŷ m from u n for n > m) This fact is one of the reasons, why 4SID methods generally do not work in closed-loop A solution proposed in Qin et al [2004] uses parsimonious parametrization Our recursive 4SID algorithm can easily ensure causality by prior information fixing upper triangle of Hh d to zero R068 6
7 Poles convergence 15 Poles convergence Real System ARMAX Off-line N4SID 0615 Real System ARMAX Off-line N4SID Imaginary Axis 0 Imaginary Axis Real Axis a) b) Real Axis Figure 2 Convergence of recursive 4SID algorithm a), Detail of the convergence of one of four system poles compared to off-line identification methods increasing number of iterations is marked by darker color) b) 6 SIMULATION RESULTS In this section the convergence of the recursive algorithm on a simple example is shown The experimental input/output sequences is generated by the 4th order state space model x k+1 = x k u k e k, y k = ) x k ) u k + e k, where the deterministic input is pseudo-random binary signal and the stochastic input is a white noise e k N0, 001) The identification started with non-informative prior information The positions of the identified system poles in each iteration related to the real poles and the poles from off-line N4SID and ARMAX methods are on Figure 2 CONCLUSION The interpretation of 4SID methods in the least squares framework showed one possibility how to recursify the algorithm, which seemed to be problematic for on-line use There can be several improvements, mainly to eliminate the separability in the optimality criterion 11), which causes the problems in the systems parameters separation step R068 7
8 ACKNOWLEDGEMENTS This work was financially supported by the Grant Agency of the Czech Republic under grant No 102/05/0271 and 102/05/2075 and by project Talent under grant No 102/03/H116 APPENDIX A System states as a linear combination of data history Recursive substitution of equation 1) in 2) and their formulation in a matrix form yields to the equations, which are fundamental in 4SID methods Y p = Γ i X p + H i U p + H s i E p, 14) Y f = Γ i X f + H i + H s i E f, 15) X f = A i X p + i U p + s i E p, 16) where i and s i are reverse controllability matrices for deterministic and stochastic subsystems with the following structure i = A i 1 B A i 2 B B ), s i = A i 1 K A i 2 K K ) From the equation 14) X p can be expressed as X p = Γ i Y p Γ i H iu p Γ i Hs i E p = Γ i Γ i H i Γ i H s i ) Using this expression in the equation 16), the future states X f can be obtained as Y p U p E p X f = A i Γ i Y p A i Γ i H iu p A i Γ i Hs i E p + i U p + s i E p ) Y p = A i Γ i i A i Γ i H i) s i Ai Γ i Hs i ) U p 17) E p These two last equations clearly indicate, that both past states X p and future states X f can be obtained as a linear combination of past data Y p, U p and E p The last equation can be substituted for X f in 15) and assuming i, j Y f = Γ i A i Γ i Γ i i A i Γ i H i) ) Y p U p ) + +H i + Hi s E f = L w W p + H i + Hi s E f 18) Future outputs Y f thus can be besides equation 6), where they are a linear combination of the system states X f and the inputs, expressed using a linear combination determined by matrices L w, H i and Hi s) of past data W p, known sequence of future inputs and the sequence of future innovations E f Replacing the unknown future innovations sequence E f with its mean, the equation of the linear predictor from input/output data is obtained Ŷ f = L w W p + H i Moreover from the comparison of 15) and 18 it is obvious that matrix O i output response from system states X f ) can be obtained from the past data W p Γ i X f = L w W p R068 8
9 Finally considering only limited input/output data set available assuming now limited W p and ), the future states X f in the equation 17) are only an estimate of future states ˆX f yielding in Ŷ f = L w W p + H i, where the following terms are equivalent L w W p = Γ i ˆXf = O i 19) References HARVILLE, D A 1997 Matrix Algebra From a Statistician s Perspective Springer-Verlag ISBN X KAMEYAMA, K; OHSUMI, A 2005 Recursive subspace prediction of linear time-vayring stochastic systems In Proceedings of the 16th IFAC World Congress Kidlington, Oxford, GB, Elsevier ISBN LJUNG, L 1998 System Identification: Theory for the User 2nd Edition) Prentice Hall PTR MERCÈRE, G; LECÆUCHE, S; VASSEUR, C 2005 Sequential correlation based propagator algorithm for recursive subspace identification In Proceedings of the 16th IFAC World Congress Kidlington, Oxford, GB, Elsevier ISBN OVERSCHEE, P V; MOOR, B D 1995 A unifying theorem for three subspace system identification Automatica, Special Issue on Trends in System Identification, 31, 12, OVERSCHEE, P V; MOOR, B D 1996 Subspace Identification for Linear Systems: Theory- Implementation-Applications Kluwer Academic Publishers QIN, S J; LIN, W; LJUNG, L 2004 A novel subspace identification approach with parsimonious parametrization Technical report, The University of Texas at Austin and Linköping University, Sweden QIN, S J; LIN, W; LJUNG, L 2005 A novel subspace identification approach with enforced causal models Automatica, 41, 12, TRNKA, P; HAVLENA, V 2005 Subspace identification as multi-step predictions optimization In Proceedings of the Fifth IASTED International Conference on Modelling, Simulation and Optimization, Anaheim: ACTA Press ISBN: R068 9
Subspace Identification Methods
Czech Technical University in Prague Faculty of Electrical Engineering Department of Control Engineering Subspace Identification Methods Technical Report Ing. Pavel Trnka Supervisor: Prof. Ing. Vladimír
More informationA New Subspace Identification Method for Open and Closed Loop Data
A New Subspace Identification Method for Open and Closed Loop Data Magnus Jansson July 2005 IR S3 SB 0524 IFAC World Congress 2005 ROYAL INSTITUTE OF TECHNOLOGY Department of Signals, Sensors & Systems
More informationAdaptive Channel Modeling for MIMO Wireless Communications
Adaptive Channel Modeling for MIMO Wireless Communications Chengjin Zhang Department of Electrical and Computer Engineering University of California, San Diego San Diego, CA 99- Email: zhangc@ucsdedu Robert
More informationClosed and Open Loop Subspace System Identification of the Kalman Filter
Modeling, Identification and Control, Vol 30, No 2, 2009, pp 71 86, ISSN 1890 1328 Closed and Open Loop Subspace System Identification of the Kalman Filter David Di Ruscio Telemark University College,
More informationOn Consistency of Closed-loop Subspace Identifictaion with Innovation Estimation
Technical report from Automatic Control at Linköpings universitet On Consistency of Closed-loop Subspace Identictaion with Innovation Estimation Weilu Lin, S Joe Qin, Lennart Ljung Division of Automatic
More informationSubspace Identification
Chapter 10 Subspace Identification Given observations of m 1 input signals, and p 1 signals resulting from those when fed into a dynamical system under study, can we estimate the internal dynamics regulating
More informationAn overview of subspace identification
Computers and Chemical Engineering 30 (2006) 1502 1513 An overview of subspace identification S Joe Qin Department of Chemical Engineering, The University of Texas at Austin, Austin, TX 78712, USA Received
More informationModel Predictive Control of Building Heating System
Model Predictive Control of Building Heating System Jan Široký 1, Samuel Prívara 2, Lukáš Ferkl 2 1 Department of Cybernetics, Faculty of Applied Sciences, University of West Bohemia in Pilsen, Czech Republic
More informationMultirate MVC Design and Control Performance Assessment: a Data Driven Subspace Approach*
Multirate MVC Design and Control Performance Assessment: a Data Driven Subspace Approach* Xiaorui Wang Department of Electrical and Computer Engineering University of Alberta Edmonton, AB, Canada T6G 2V4
More informationELEC system identification workshop. Subspace methods
1 / 33 ELEC system identification workshop Subspace methods Ivan Markovsky 2 / 33 Plan 1. Behavioral approach 2. Subspace methods 3. Optimization methods 3 / 33 Outline Exact modeling Algorithms 4 / 33
More informationFIR Filters for Stationary State Space Signal Models
Proceedings of the 17th World Congress The International Federation of Automatic Control FIR Filters for Stationary State Space Signal Models Jung Hun Park Wook Hyun Kwon School of Electrical Engineering
More informationSubspace Identification A Markov Parameter Approach
Subspace Identification A Markov Parameter Approach Nelson LC Chui JM Maciejowski Cambridge University Engineering Deptartment Cambridge, CB2 1PZ, England 22 December 1998 Technical report CUED/F-INFENG/TR337
More informationIdentification of MIMO linear models: introduction to subspace methods
Identification of MIMO linear models: introduction to subspace methods Marco Lovera Dipartimento di Scienze e Tecnologie Aerospaziali Politecnico di Milano marco.lovera@polimi.it State space identification
More informationRANGE CONTROL MPC APPROACH FOR TWO-DIMENSIONAL SYSTEM 1
RANGE CONTROL MPC APPROACH FOR TWO-DIMENSIONAL SYSTEM Jirka Roubal Vladimír Havlena Department of Control Engineering, Facult of Electrical Engineering, Czech Technical Universit in Prague Karlovo náměstí
More informationOn Identification of Cascade Systems 1
On Identification of Cascade Systems 1 Bo Wahlberg Håkan Hjalmarsson Jonas Mårtensson Automatic Control and ACCESS, School of Electrical Engineering, KTH, SE-100 44 Stockholm, Sweden. (bo.wahlberg@ee.kth.se
More informationDESIGNING A KALMAN FILTER WHEN NO NOISE COVARIANCE INFORMATION IS AVAILABLE. Robert Bos,1 Xavier Bombois Paul M. J. Van den Hof
DESIGNING A KALMAN FILTER WHEN NO NOISE COVARIANCE INFORMATION IS AVAILABLE Robert Bos,1 Xavier Bombois Paul M. J. Van den Hof Delft Center for Systems and Control, Delft University of Technology, Mekelweg
More informationSUBSPACE SYSTEM IDENTIFICATION Theory and applications
SUBSPACE SYSTEM IDENTIFICATION Theory and applications Lecture notes Dr. ing. David Di Ruscio Telemark Institute of Technology Email: david.di.ruscio@hit.no Porsgrunn, Norway January 1995 6th edition December
More informationSystem Identification by Nuclear Norm Minimization
Dept. of Information Engineering University of Pisa (Italy) System Identification by Nuclear Norm Minimization eng. Sergio Grammatico grammatico.sergio@gmail.com Class of Identification of Uncertain Systems
More informationWhile using the input and output data fu(t)g and fy(t)g, by the methods in system identification, we can get a black-box model like (In the case where
ESTIMATE PHYSICAL PARAMETERS BY BLACK-BOX MODELING Liang-Liang Xie Λ;1 and Lennart Ljung ΛΛ Λ Institute of Systems Science, Chinese Academy of Sciences, 100080, Beijing, China ΛΛ Department of Electrical
More informationADAPTIVE FILTER THEORY
ADAPTIVE FILTER THEORY Fourth Edition Simon Haykin Communications Research Laboratory McMaster University Hamilton, Ontario, Canada Front ice Hall PRENTICE HALL Upper Saddle River, New Jersey 07458 Preface
More informationCONTROL SYSTEMS, ROBOTICS, AND AUTOMATION - Vol. V - Prediction Error Methods - Torsten Söderström
PREDICTIO ERROR METHODS Torsten Söderström Department of Systems and Control, Information Technology, Uppsala University, Uppsala, Sweden Keywords: prediction error method, optimal prediction, identifiability,
More informationIndustrial Model Predictive Control
Industrial Model Predictive Control Emil Schultz Christensen Kongens Lyngby 2013 DTU Compute-M.Sc.-2013-49 Technical University of Denmark DTU Compute Matematiktovet, Building 303B, DK-2800 Kongens Lyngby,
More informationApplication of Modified Multi Model Predictive Control Algorithm to Fluid Catalytic Cracking Unit
Application of Modified Multi Model Predictive Control Algorithm to Fluid Catalytic Cracking Unit Nafay H. Rehman 1, Neelam Verma 2 Student 1, Asst. Professor 2 Department of Electrical and Electronics
More informationLessons in Estimation Theory for Signal Processing, Communications, and Control
Lessons in Estimation Theory for Signal Processing, Communications, and Control Jerry M. Mendel Department of Electrical Engineering University of Southern California Los Angeles, California PRENTICE HALL
More informationOptimal State Estimators for Linear Systems with Unknown Inputs
Optimal tate Estimators for Linear ystems with Unknown Inputs hreyas undaram and Christoforos N Hadjicostis Abstract We present a method for constructing linear minimum-variance unbiased state estimators
More informationEECE Adaptive Control
EECE 574 - Adaptive Control Basics of System Identification Guy Dumont Department of Electrical and Computer Engineering University of British Columbia January 2010 Guy Dumont (UBC) EECE574 - Basics of
More informationStatistical and Adaptive Signal Processing
r Statistical and Adaptive Signal Processing Spectral Estimation, Signal Modeling, Adaptive Filtering and Array Processing Dimitris G. Manolakis Massachusetts Institute of Technology Lincoln Laboratory
More informationCANONICAL LOSSLESS STATE-SPACE SYSTEMS: STAIRCASE FORMS AND THE SCHUR ALGORITHM
CANONICAL LOSSLESS STATE-SPACE SYSTEMS: STAIRCASE FORMS AND THE SCHUR ALGORITHM Ralf L.M. Peeters Bernard Hanzon Martine Olivi Dept. Mathematics, Universiteit Maastricht, P.O. Box 616, 6200 MD Maastricht,
More informationA Mathematica Toolbox for Signals, Models and Identification
The International Federation of Automatic Control A Mathematica Toolbox for Signals, Models and Identification Håkan Hjalmarsson Jonas Sjöberg ACCESS Linnaeus Center, Electrical Engineering, KTH Royal
More informationOPTIMAL CONTROL AND ESTIMATION
OPTIMAL CONTROL AND ESTIMATION Robert F. Stengel Department of Mechanical and Aerospace Engineering Princeton University, Princeton, New Jersey DOVER PUBLICATIONS, INC. New York CONTENTS 1. INTRODUCTION
More informationDepartement Elektrotechniek ESAT-SISTA/TR About the choice of State Space Basis in Combined. Deterministic-Stochastic Subspace Identication 1
Katholieke Universiteit Leuven Departement Elektrotechniek ESAT-SISTA/TR 994-24 About the choice of State Space asis in Combined Deterministic-Stochastic Subspace Identication Peter Van Overschee and art
More informationBASE VECTORS FOR SOLVING OF PARTIAL DIFFERENTIAL EQUATIONS
BASE VECTORS FOR SOLVING OF PARTIAL DIFFERENTIAL EQUATIONS J. Roubal, V. Havlena Department of Control Engineering, Facult of Electrical Engineering, Czech Technical Universit in Prague Abstract The distributed
More informationA Vector Space Justification of Householder Orthogonalization
A Vector Space Justification of Householder Orthogonalization Ronald Christensen Professor of Statistics Department of Mathematics and Statistics University of New Mexico August 28, 2015 Abstract We demonstrate
More informationEL 625 Lecture 10. Pole Placement and Observer Design. ẋ = Ax (1)
EL 625 Lecture 0 EL 625 Lecture 0 Pole Placement and Observer Design Pole Placement Consider the system ẋ Ax () The solution to this system is x(t) e At x(0) (2) If the eigenvalues of A all lie in the
More informationIdentification of continuous-time systems from samples of input±output data: An introduction
SaÅdhanaÅ, Vol. 5, Part, April 000, pp. 75±83. # Printed in India Identification of continuous-time systems from samples of input±output data: An introduction NARESH K SINHA Department of Electrical and
More information9 Multi-Model State Estimation
Technion Israel Institute of Technology, Department of Electrical Engineering Estimation and Identification in Dynamical Systems (048825) Lecture Notes, Fall 2009, Prof. N. Shimkin 9 Multi-Model State
More informationVARIANCE COMPUTATION OF MODAL PARAMETER ES- TIMATES FROM UPC SUBSPACE IDENTIFICATION
VARIANCE COMPUTATION OF MODAL PARAMETER ES- TIMATES FROM UPC SUBSPACE IDENTIFICATION Michael Döhler 1, Palle Andersen 2, Laurent Mevel 1 1 Inria/IFSTTAR, I4S, Rennes, France, {michaeldoehler, laurentmevel}@inriafr
More informationCramér-Rao Bounds for Estimation of Linear System Noise Covariances
Journal of Mechanical Engineering and Automation (): 6- DOI: 593/jjmea Cramér-Rao Bounds for Estimation of Linear System oise Covariances Peter Matiso * Vladimír Havlena Czech echnical University in Prague
More informationNetwork Reconstruction from Intrinsic Noise: Non-Minimum-Phase Systems
Preprints of the 19th World Congress he International Federation of Automatic Control Network Reconstruction from Intrinsic Noise: Non-Minimum-Phase Systems David Hayden, Ye Yuan Jorge Goncalves Department
More informationFINITE HORIZON ROBUST MODEL PREDICTIVE CONTROL USING LINEAR MATRIX INEQUALITIES. Danlei Chu, Tongwen Chen, Horacio J. Marquez
FINITE HORIZON ROBUST MODEL PREDICTIVE CONTROL USING LINEAR MATRIX INEQUALITIES Danlei Chu Tongwen Chen Horacio J Marquez Department of Electrical and Computer Engineering University of Alberta Edmonton
More informationIdentification of modal parameters from ambient vibration data using eigensystem realization algorithm with correlation technique
Journal of Mechanical Science and Technology 4 (1) (010) 377~38 www.springerlink.com/content/1738-494x DOI 107/s106-010-1005-0 Identification of modal parameters from ambient vibration data using eigensystem
More informationState Space Modeling for MIMO Wireless Channels
State Space Modeling for MIMO Wireless Channels Chengjin Zhang Department of Electrical and Computer Engineering University of California, San Diego San Diego, CA 99-47 Email: zhangc@ucsdedu Robert R Bitmead
More informationOutline Introduction: Problem Description Diculties Algebraic Structure: Algebraic Varieties Rank Decient Toeplitz Matrices Constructing Lower Rank St
Structured Lower Rank Approximation by Moody T. Chu (NCSU) joint with Robert E. Funderlic (NCSU) and Robert J. Plemmons (Wake Forest) March 5, 1998 Outline Introduction: Problem Description Diculties Algebraic
More informationOPTIMAL ESTIMATION of DYNAMIC SYSTEMS
CHAPMAN & HALL/CRC APPLIED MATHEMATICS -. AND NONLINEAR SCIENCE SERIES OPTIMAL ESTIMATION of DYNAMIC SYSTEMS John L Crassidis and John L. Junkins CHAPMAN & HALL/CRC A CRC Press Company Boca Raton London
More informationLinear-Quadratic Optimal Control: Full-State Feedback
Chapter 4 Linear-Quadratic Optimal Control: Full-State Feedback 1 Linear quadratic optimization is a basic method for designing controllers for linear (and often nonlinear) dynamical systems and is actually
More informationSUBSPACE IDENTIFICATION METHOD FOR COMBINED DETERMINISTIC-STOCHASTIC BILINEAR SYSTEMS. Huixin Chen and Jan Maciejowski 1
SUBSPACE IDENTIFICATION METHOD FOR COMBINED DETERMINISTIC-STOCHASTIC BILINEAR SYSTEMS Huixin Chen and Jan Maciejowski 1 Department of Engineering University of Cambridge Cambridge CB2 1PZ, U.K. Abstract:
More informationLecture 4 and 5 Controllability and Observability: Kalman decompositions
1 Lecture 4 and 5 Controllability and Observability: Kalman decompositions Spring 2013 - EE 194, Advanced Control (Prof. Khan) January 30 (Wed.) and Feb. 04 (Mon.), 2013 I. OBSERVABILITY OF DT LTI SYSTEMS
More information1 Cricket chirps: an example
Notes for 2016-09-26 1 Cricket chirps: an example Did you know that you can estimate the temperature by listening to the rate of chirps? The data set in Table 1 1. represents measurements of the number
More informationOptimal Polynomial Control for Discrete-Time Systems
1 Optimal Polynomial Control for Discrete-Time Systems Prof Guy Beale Electrical and Computer Engineering Department George Mason University Fairfax, Virginia Correspondence concerning this paper should
More informationAPPROXIMATE REALIZATION OF VALVE DYNAMICS WITH TIME DELAY
APPROXIMATE REALIZATION OF VALVE DYNAMICS WITH TIME DELAY Jan van Helvoirt,,1 Okko Bosgra, Bram de Jager Maarten Steinbuch Control Systems Technology Group, Mechanical Engineering Department, Technische
More informationMODEL PREDICTIVE CONTROL and optimization
MODEL PREDICTIVE CONTROL and optimization Lecture notes Model Predictive Control PhD., Associate professor David Di Ruscio System and Control Engineering Department of Technology Telemark University College
More informationHANKEL-NORM BASED INTERACTION MEASURE FOR INPUT-OUTPUT PAIRING
Copyright 2002 IFAC 15th Triennial World Congress, Barcelona, Spain HANKEL-NORM BASED INTERACTION MEASURE FOR INPUT-OUTPUT PAIRING Björn Wittenmark Department of Automatic Control Lund Institute of Technology
More informationLifted approach to ILC/Repetitive Control
Lifted approach to ILC/Repetitive Control Okko H. Bosgra Maarten Steinbuch TUD Delft Centre for Systems and Control TU/e Control System Technology Dutch Institute of Systems and Control DISC winter semester
More informationApplied Mathematics Letters
Applied Mathematics Letters 24 (2011) 797 802 Contents lists available at ScienceDirect Applied Mathematics Letters journal homepage: wwwelseviercom/locate/aml Model order determination using the Hankel
More informationOrthogonal projection based subspace identification against colored noise
Control Theory Tech, Vol 15, No 1, pp 69 77, February 2017 Control Theory and Technology http://linkspringercom/journal/11768 Orthogonal projection based subspace identification against colored noise Jie
More informationCOMP 558 lecture 18 Nov. 15, 2010
Least squares We have seen several least squares problems thus far, and we will see more in the upcoming lectures. For this reason it is good to have a more general picture of these problems and how to
More informationData-driven Subspace-based Model Predictive Control
Data-driven Subspace-based Model Predictive Control Noor Azizi Mardi (Doctor of Philosophy) 21 RMIT University Data-driven Subspace-based Model Predictive Control A thesis submitted in fulfillment of the
More informationProf. Dr.-Ing. Armin Dekorsy Department of Communications Engineering. Stochastic Processes and Linear Algebra Recap Slides
Prof. Dr.-Ing. Armin Dekorsy Department of Communications Engineering Stochastic Processes and Linear Algebra Recap Slides Stochastic processes and variables XX tt 0 = XX xx nn (tt) xx 2 (tt) XX tt XX
More informationTHIS paper studies the input design problem in system identification.
1534 IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 50, NO. 10, OCTOBER 2005 Input Design Via LMIs Admitting Frequency-Wise Model Specifications in Confidence Regions Henrik Jansson Håkan Hjalmarsson, Member,
More informationSINGLE DEGREE OF FREEDOM SYSTEM IDENTIFICATION USING LEAST SQUARES, SUBSPACE AND ERA-OKID IDENTIFICATION ALGORITHMS
3 th World Conference on Earthquake Engineering Vancouver, B.C., Canada August -6, 24 Paper No. 278 SINGLE DEGREE OF FREEDOM SYSTEM IDENTIFICATION USING LEAST SQUARES, SUBSPACE AND ERA-OKID IDENTIFICATION
More informationEECS 275 Matrix Computation
EECS 275 Matrix Computation Ming-Hsuan Yang Electrical Engineering and Computer Science University of California at Merced Merced, CA 95344 http://faculty.ucmerced.edu/mhyang Lecture 9 1 / 23 Overview
More informationReview problems for MA 54, Fall 2004.
Review problems for MA 54, Fall 2004. Below are the review problems for the final. They are mostly homework problems, or very similar. If you are comfortable doing these problems, you should be fine on
More informationProcess Modelling, Identification, and Control
Jan Mikles Miroslav Fikar 2008 AGI-Information Management Consultants May be used for personal purporses only or by libraries associated to dandelon.com network. Process Modelling, Identification, and
More informationLINEAR ALGEBRA KNOWLEDGE SURVEY
LINEAR ALGEBRA KNOWLEDGE SURVEY Instructions: This is a Knowledge Survey. For this assignment, I am only interested in your level of confidence about your ability to do the tasks on the following pages.
More informationStatistical Signal Processing Detection, Estimation, and Time Series Analysis
Statistical Signal Processing Detection, Estimation, and Time Series Analysis Louis L. Scharf University of Colorado at Boulder with Cedric Demeure collaborating on Chapters 10 and 11 A TT ADDISON-WESLEY
More informationFurther Results on Model Structure Validation for Closed Loop System Identification
Advances in Wireless Communications and etworks 7; 3(5: 57-66 http://www.sciencepublishinggroup.com/j/awcn doi:.648/j.awcn.735. Further esults on Model Structure Validation for Closed Loop System Identification
More informationADAPTIVE FILTER THEORY
ADAPTIVE FILTER THEORY Fifth Edition Simon Haykin Communications Research Laboratory McMaster University Hamilton, Ontario, Canada International Edition contributions by Telagarapu Prabhakar Department
More informationSubspace-based Identification
of Infinite-dimensional Multivariable Systems from Frequency-response Data Department of Electrical and Electronics Engineering Anadolu University, Eskişehir, Turkey October 12, 2008 Outline 1 2 3 4 Noise-free
More informationSubspace Based Identification for Adaptive Control
ISSN 28-536 ISRN LUTFD2/TFRT--576--SE Subspace Based Identification for Adaptive Control Brad Schofield Department of Automatic Control Lund Institute of Technology June 23 Department of Automatic Control
More informationVector and Matrix Norms. Vector and Matrix Norms
Vector and Matrix Norms Vector Space Algebra Matrix Algebra: We let x x and A A, where, if x is an element of an abstract vector space n, and A = A: n m, then x is a complex column vector of length n whose
More informationẋ n = f n (x 1,...,x n,u 1,...,u m ) (5) y 1 = g 1 (x 1,...,x n,u 1,...,u m ) (6) y p = g p (x 1,...,x n,u 1,...,u m ) (7)
EEE582 Topical Outline A.A. Rodriguez Fall 2007 GWC 352, 965-3712 The following represents a detailed topical outline of the course. It attempts to highlight most of the key concepts to be covered and
More informationApplied Mathematics 205. Unit II: Numerical Linear Algebra. Lecturer: Dr. David Knezevic
Applied Mathematics 205 Unit II: Numerical Linear Algebra Lecturer: Dr. David Knezevic Unit II: Numerical Linear Algebra Chapter II.3: QR Factorization, SVD 2 / 66 QR Factorization 3 / 66 QR Factorization
More informationOn solving linear systems arising from Shishkin mesh discretizations
On solving linear systems arising from Shishkin mesh discretizations Petr Tichý Faculty of Mathematics and Physics, Charles University joint work with Carlos Echeverría, Jörg Liesen, and Daniel Szyld October
More informationPerformance assessment of MIMO systems under partial information
Performance assessment of MIMO systems under partial information H Xia P Majecki A Ordys M Grimble Abstract Minimum variance (MV) can characterize the most fundamental performance limitation of a system,
More informationHere represents the impulse (or delta) function. is an diagonal matrix of intensities, and is an diagonal matrix of intensities.
19 KALMAN FILTER 19.1 Introduction In the previous section, we derived the linear quadratic regulator as an optimal solution for the fullstate feedback control problem. The inherent assumption was that
More informationSUBSPACE IDENTIFICATION METHODS
SUBSPACE IDENTIFICATION METHODS Katrien De Cock, Bart De Moor, KULeuven, Department of Electrical Engineering ESAT SCD, Kasteelpark Arenberg 0, B 300 Leuven, Belgium, tel: +32-6-32709, fax: +32-6-32970,
More informationNonlinear Identification of Backlash in Robot Transmissions
Nonlinear Identification of Backlash in Robot Transmissions G. Hovland, S. Hanssen, S. Moberg, T. Brogårdh, S. Gunnarsson, M. Isaksson ABB Corporate Research, Control Systems Group, Switzerland ABB Automation
More informationOperational modal analysis using forced excitation and input-output autoregressive coefficients
Operational modal analysis using forced excitation and input-output autoregressive coefficients *Kyeong-Taek Park 1) and Marco Torbol 2) 1), 2) School of Urban and Environment Engineering, UNIST, Ulsan,
More informationAMS526: Numerical Analysis I (Numerical Linear Algebra)
AMS526: Numerical Analysis I (Numerical Linear Algebra) Lecture 1: Course Overview & Matrix-Vector Multiplication Xiangmin Jiao SUNY Stony Brook Xiangmin Jiao Numerical Analysis I 1 / 20 Outline 1 Course
More informationInvestigation of traffic-induced floor vibrations in a building
Investigation of traffic-induced floor vibrations in a building Bo Li, Tuo Zou, Piotr Omenzetter Department of Civil and Environmental Engineering, The University of Auckland, Auckland, New Zealand. 2009
More informationEstimating Variances and Covariances in a Non-stationary Multivariate Time Series Using the K-matrix
Estimating Variances and Covariances in a Non-stationary Multivariate ime Series Using the K-matrix Stephen P Smith, January 019 Abstract. A second order time series model is described, and generalized
More informationSpatial Process Estimates as Smoothers: A Review
Spatial Process Estimates as Smoothers: A Review Soutir Bandyopadhyay 1 Basic Model The observational model considered here has the form Y i = f(x i ) + ɛ i, for 1 i n. (1.1) where Y i is the observed
More informationSection 3.2. Multiplication of Matrices and Multiplication of Vectors and Matrices
3.2. Multiplication of Matrices and Multiplication of Vectors and Matrices 1 Section 3.2. Multiplication of Matrices and Multiplication of Vectors and Matrices Note. In this section, we define the product
More informationON GRADIENT-BASED SEARCH FOR MULTIVARIABLE SYSTEM ESTIMATES. Adrian Wills Brett Ninness Stuart Gibson
ON GRADIENT-BASED SEARCH FOR MULTIVARIABLE SYSTEM ESTIMATES Adrian Wills Brett Ninness Stuart Gibson School of Electrical Engineering and Computer Science, University of Newcastle, Australia. Corresponding
More informationData-driven signal processing
1 / 35 Data-driven signal processing Ivan Markovsky 2 / 35 Modern signal processing is model-based 1. system identification prior information model structure 2. model-based design identification data parameter
More informationLinear Systems. Carlo Tomasi. June 12, r = rank(a) b range(a) n r solutions
Linear Systems Carlo Tomasi June, 08 Section characterizes the existence and multiplicity of the solutions of a linear system in terms of the four fundamental spaces associated with the system s matrix
More informationLinear Least-Squares Data Fitting
CHAPTER 6 Linear Least-Squares Data Fitting 61 Introduction Recall that in chapter 3 we were discussing linear systems of equations, written in shorthand in the form Ax = b In chapter 3, we just considered
More informationSystem identification and uncertainty domain determination: a subspace-based approach
2010 American Control Conference Marriott Waterfront, Baltimore, MD, USA June 30-July 02, 2010 FrC073 System identification and uncertainty domain determination: a subspace-based approach Wafa Farah, Guillaume
More informationNumerical Methods in Matrix Computations
Ake Bjorck Numerical Methods in Matrix Computations Springer Contents 1 Direct Methods for Linear Systems 1 1.1 Elements of Matrix Theory 1 1.1.1 Matrix Algebra 2 1.1.2 Vector Spaces 6 1.1.3 Submatrices
More informationSingular Value Decomposition
Chapter 5 Singular Value Decomposition We now reach an important Chapter in this course concerned with the Singular Value Decomposition of a matrix A. SVD, as it is commonly referred to, is one of the
More informationAPPENDIX: MATHEMATICAL INDUCTION AND OTHER FORMS OF PROOF
ELEMENTARY LINEAR ALGEBRA WORKBOOK/FOR USE WITH RON LARSON S TEXTBOOK ELEMENTARY LINEAR ALGEBRA CREATED BY SHANNON MARTIN MYERS APPENDIX: MATHEMATICAL INDUCTION AND OTHER FORMS OF PROOF When you are done
More informationHands-on Matrix Algebra Using R
Preface vii 1. R Preliminaries 1 1.1 Matrix Defined, Deeper Understanding Using Software.. 1 1.2 Introduction, Why R?.................... 2 1.3 Obtaining R.......................... 4 1.4 Reference Manuals
More informationIntroduction to Probabilistic Graphical Models
Introduction to Probabilistic Graphical Models Sargur Srihari srihari@cedar.buffalo.edu 1 Topics 1. What are probabilistic graphical models (PGMs) 2. Use of PGMs Engineering and AI 3. Directionality in
More informationAuxiliary signal design for failure detection in uncertain systems
Auxiliary signal design for failure detection in uncertain systems R. Nikoukhah, S. L. Campbell and F. Delebecque Abstract An auxiliary signal is an input signal that enhances the identifiability of a
More informationA subspace fitting method based on finite elements for identification and localization of damages in mechanical systems
Author manuscript, published in "11th International Conference on Computational Structures Technology 212, Croatia (212)" A subspace fitting method based on finite elements for identification and localization
More informationThe Solvability Conditions for the Inverse Eigenvalue Problem of Hermitian and Generalized Skew-Hamiltonian Matrices and Its Approximation
The Solvability Conditions for the Inverse Eigenvalue Problem of Hermitian and Generalized Skew-Hamiltonian Matrices and Its Approximation Zheng-jian Bai Abstract In this paper, we first consider the inverse
More informationStructured State Space Realizations for SLS Distributed Controllers
Structured State Space Realizations for SLS Distributed Controllers James Anderson and Nikolai Matni Abstract In recent work the system level synthesis (SLS) paradigm has been shown to provide a truly
More informationStatic Output Feedback Stabilisation with H Performance for a Class of Plants
Static Output Feedback Stabilisation with H Performance for a Class of Plants E. Prempain and I. Postlethwaite Control and Instrumentation Research, Department of Engineering, University of Leicester,
More information2 Introduction of Discrete-Time Systems
2 Introduction of Discrete-Time Systems This chapter concerns an important subclass of discrete-time systems, which are the linear and time-invariant systems excited by Gaussian distributed stochastic
More informationECE 275A Homework #3 Solutions
ECE 75A Homework #3 Solutions. Proof of (a). Obviously Ax = 0 y, Ax = 0 for all y. To show sufficiency, note that if y, Ax = 0 for all y, then it must certainly be true for the particular value of y =
More information