Lecture 4 and 5 Controllability and Observability: Kalman decompositions
|
|
- August Harvey
- 6 years ago
- Views:
Transcription
1 1 Lecture 4 and 5 Controllability and Observability: Kalman decompositions Spring EE 194, Advanced Control (Prof. Khan) January 30 (Wed.) and Feb. 04 (Mon.), 2013 I. OBSERVABILITY OF DT LTI SYSTEMS Consider the DT LTI dynamics again with the observation model. We are interested in deriving the necessary conditions for optimal estimation and thus the additional noise terms can be removed. The system to be considered is the following: x k+1 = Ax k + Bu k, (1) y k = Cx k, (2) as before we consider the worst case of one observation per k, i.e., p = 1. Definition 1 (Observability). A DT LTI system is said to be observable in n time-steps when the initial condition, x 0, can be recovered from a sequence of observations, y 0,..., y n 1, and inputs, u 0,..., u n 1. The observability problem is to find x 0 from a sequence of observations, y 0,..., y k 1, and The lecture material is largely based on: Fundamentals of Linear State Space Systems, John S. Bay, McGraw-Hill Series in Electrical Engineering, 1998.
2 2 inputs, u 0,..., u k 1. To this end, note that y 0 = Cx 0, y 1 = Cx 1, = CAx 0 + CBu 0, y 2 = Cx 2, = CA 2 x 0 + CABu 0 + CBu 1,. y k 1 = CA k 1 x 0 + CA k 2 Bu CBu k 2. In matrix form, the above is given by y 0 y 1 y 2. y k 1 = C CA CA 2. CA k 1 x 0 + Υ u 0 u 1 u 2. u k 1. The above is a linear system of equations compactly written as Ψ 0:k 1 = O 0:k 1 }{{} R k n x 0, (3) and hence, from the known inputs and known observations, the initial condition, x 0, can be recovered if and only if rank(o 0:k 1 ) = n. (4) Using the same arguments from controllability, we note that rank(o) < n for k n 2 as the observability matrix, O, has at most n 1 rows. Similarly, adding another observation after the nth observation does not help by Cayley-Hamilton arguments as rank(o 0:n 1 ) = rank(o 0:n ) = rank(o 0:n+1 ) =.... (5)
3 3 Hence, the observability matrix is defined as O = C CA CA 2. CA n 1, (6) without subscripts. Remark 1. In literature, rank(c) = n is often referred to as the system being (A, B) controllable. Similarly, rank(o) = n is often referred to as the system being (A, C) observable. Remark 2. Show that rank(c) = n CC T 0 (CC T ) 1 exists, (7) rank(o) = n O T O 0 (O T O) 1 exists. (8) Remark 3. Show that (A, C) observable (A T, C T ) controllable, (9) (A, B) controllable (A T, B T ) observable. (10)
4 4 II. KALMAN DECOMPOSITIONS Suppose it is known that a SISO (single-input single-output) system has rank(c) = n c < n, and rank(o) = n o < n. In other words, the SISO system, in question, is neither controllable nor observable. We are interested in a transformation that rearranges the system modes (eigenvalues) into: modes that are both controllable and observable; modes that are neither controllable nor observable; modes that are controllable but not observable; and modes that are observable but not controllable. Such a transformation is called Kalman decomposition. A. Decomposing controllable modes Firstly, consider separating only the controllable subspace from the rest of the state-space. To this end, consider a state transformation matrix, V, whose first n c columns are a maximal set of linearly independent columns from the controllability matrix, C. The remaining n n c columns are chosen to be linearly independent from the first n c columns (and linearly independent among themselves). The transformation operator (matrix) is n n, defined as [ ] [ ] V = v 1... v nc v nc+1... v n V 1 V 2. (11) It is straightforward to show that the transformed system (x k = V x k ) is x k+1 = V 1 AV x k + V 1 Bu, (12) y k = CV x k. (13) Partition V 1 as V 1 = V 1 V 2, (14) where V 1 is n c n and V 2 is (n n c ) n. Now note that I n = V 1 V = V 1 V 2 [ V 1 V 2 ] = V 1V 1 V 1 V 2 V 2 V 1 V 2 V 2 = I n c I n nc. (15)
5 5 The above leads to the following 1 : further leading to V 2 V 1 = 0 C lies in the null space of V 2, (16) V 2 B = 0, and V 2 AV 1 = 0. (17) The transformed system in Eq. (12) is thus given by A V 1 AV = V [ ] 1 A V 1 V 2 = V 1AV 1 V 1 AV 2 A c A cc, (18) V 2 V 2 AV 1 V 2 AV 2 0 A c B V 1 B = V 1 B = V 1B B c. (19) V 2 V 2 B 0 Now recall that a similarity transformation does not change the rank of the controllability matrix, C, of the transformed system. Mathematically, ([ rank(c) = rank V 1 B (V 1 AV )V 1 B... (V 1 AV ) n 1 V 1 B ([ ]) = rank V 1 B V 1 AB... V 1 A n 1 B, [ ]) = rank (V 1 B AB... A n 1 B, ([ ]) = rank B AB... A n 1 B, = rank (C), = n c. ]), Furthermore, ([ rank(c) = rank B AB... A nc 1 B = rank B c A c B c... Ac nc = rank B c A c B c... Ac nc = n c,... A n 1 B B c B c ]),... An 1 c 0, B c, 1 This is because all of the freedom in the linear independence of C is already captured in V 1.
6 6 where to go from second equation to the third, we use Cayley-Hamilton theorem. All of this to show that the subsystem (A c, B c ) is controllable. Conclusions: Using the transformation matrix, V, defined in Eq. (11), we have transformed the original system, x k+1 = Ax k + Bu k into the following system: x k+1 = Ax k + Bu k, (20) x c(k + 1) = A c A cc x c(k) + B c u k, (21) x c (k + 1) 0 A c x c (k) 0 such that the transformed state-space is separated into a controllable subspace and an uncontrollable subspace. Consider the transformed system in Eq. (20) and partition the (transformed) state-vector, x(k), into an n c 1 component, x c (k), and an n n c 1, x c (k). We get x c (k + 1) = A c x c (k) + A cc x c (k) + B c u k, (22) x c (k + 1) = A c x c (k). (23) Clearly, the lower subsystem, x c (k), is not controllable. In the transformed coordinate space, x k, we can only steer a portion, x c (k), of the transformed states. The subspace of R n that can be steered is denoted as R(C), defined as the row space of C, where R(C) is called the controllable subspace. Finally, recall that the eigenvalues of similar matrices, A and V 1 AV, are the same. Recall the structure of V 1 AV from Eq. (18); since V 1 AV is block upper-triangular, the eigenvalues of A are given by the eigenvalues of A c and A c, called the controllable eigenvalues (modes) and uncontrollable eigenvalues (modes), respectively. Example 1. Consider the CT LTI system: ẋ = C = 0 5 5, x u,
7 7 with rank(c) = 2 < 3. Defines V as V = , 1 and note that the requirement for choosing V are satisfied. Finally, verify that the transformed system matrices are V 1 AV = , V 1 B = Verify that the top-left subsystem is controllable. From this structure, we see that the twodimensional controllable system is grouped into the first two state variables and that the third state variable has neither an input signal nor a coupling from the other subsystem. It is therefore not controllable. B. Decomposing observable modes Now we can easily follow the same drill and come up with another transformation, x k = W x k, where W contains n o linearly independent rows of O and the remaining rows are chosen to be linearly independent of the first n o rows (and linearly independent among themselves). Finally, the transformed system, x k+1 = Ax k + Bu k, = A o 0 x k + y k = [ A oo C o 0 A o B o B o u k, (24) ] x k (25) is separated into an observable subspace and an unobservable subspace. In fact, we can now write this result as a theorem. Theorem 1. Consider the DT LTI system, x k+1 = Ax k, y k = Cx k,
8 8 where A R n n and C R p n. Let O be the observability matrix as defined in Eq. (6). If rank(o) = n o < n, there there exists a non-singular matrix, W R n n such that W 1 AW = A o 0 [ ], CW = C o 0, A oo A o where A o R no no, C o R no n, and the pair (A o, C o ) is observable. By carefully applying a sequence of such controllability and observability transformations, the complete Kalman decomposition results in a system of the following form: x co (k + 1) A co 0 A 13 0 x co (k) B co x co (k + 1) A 21 A co A 23 A 24 x co (k) B co = + u(k), (26) x co (k + 1) 0 0 A co 0 x co (k) 0 x co (k + 1) 0 0 A 43 A co x co (k) 0 x co (k) [ ] x co (k) y(k) = C co 0 C co 0. (27) x co (k) x co (k)
9 9 C. Kalman decomposition theorem Theorem 2. Given a DT (or CT) LTI system that is neither controllable nor observable, there exists a non-singular transformation, x = T x, such that the system dynamics can be transformed into the structure given by Eqs. (26) (27). Proof: The proof is left as an exercise and constitutes Homework 1.
10 10 APPENDIX A SIMILARITY TRANSFORMS Consider any invertible matrix, V R n n, and a state transformation, x k = V z k. The transformed DT-LTI system is given by x k+1 = Ax k + Bu k, V z k+1 = AV z k + Bu k, z k+1 = V} 1 {{ AV} z k + V} 1 {{ B} u k, A B y k = }{{} CV z k. C The new (transformed) system is now defined by the system matrices, A, B, and C. The two systems, x k and z k, are called similar systems. Remark 4. Each of the following can be proved. Given any DT-LTI systems, there are infinite possible transformations. Similar systems have the same eigenvalues; the eigenvectors of the corresponding system matrices are different. Similar systems have the same transfer functions; in other words, the transfer function of the DT-LTI dynamics is unique with infinite possible state-space realizations. The rank of the controllability and observability are invariant to a similar transformation. APPENDIX B TRIVIA: NULL SPACES Consider a set of m vectors, x i R n, i = 1,..., m. Definition 2 (Span). The span of m vectors, x i R n, i = 1,..., m is defined as the set of all vectors that can be written as a linear combination of {x i } s, i.e., { m } span(x 1,..., x m ) = y y = α i x i, (28) for α i R. i=1
11 11 Definition 3. The null space, N (A) R n, of an n n matrix, A, is defined as the set of all vectors such that Ay = 0, (29) for y N (A). Consider a real-valued matrix, A R n n and let x 1 0 and x 2 0 be the maximal set of linearly independent vectors 2 such that Ax 1 = 0, Ax 2 = 0, (30) which leads to 2 2 A α i x i = α i Ax i = 0. (31) i=1 i=1 Following the definition of span and null space, we can say that span(x 1, x 2 ) lies in the null space of A, i.e., N (A) = span(x 1, x 2 ). (32) In this particular case, the dimension of N (A) is 2 and 3 rank(a) = n 2. 2 In other words, there does not exist any other vector, x 3, that is linearly independent of x 1 and x 2 such that Ax 3 = 0. 3 This further leads to an alternate definition of rank as n n c, where n c dim(n (A)).
12 12 Lets recall the uncontrollable case with rank(c) = n c. Clearly, C has n c linearly independent (l.i.) columns (vectors in R n ); let the matrix V 1 R n nc consists of these n c l.i. columns. On the other hand, let the matrix Ṽ1 R n n nc consists of the remaining columns of C and note that every column of Ṽ1 span(columns of V 1 ), or, span(columns of V 1 ) contains every column of Ṽ1. The above leads to the following: Remark 5. If there exists a matrix, V 2, such that V 2 V 1 = 0, then every column of V 1 N (V 2 ), span(columns of V 1 ) N (V 2 ), every column of Ṽ1 N (V 2 ).
13 13 A. Kalman decomposition, revisited Construct a transformation matrix, V R n n, whose whose first n n c block is V 1. Choose the remaining n n c columns to be linearly independent from the first n c columns (and linearly independent among themselves); call the second n (n n c ) block as V 2 : [ ] V V 1 V 2, V 1 V 1, V 2 I n = V 1 V = V 1 V 2 [ V 1 V 2 ] = V 1V 1 V 1 V 2 V 2 V 1 V 2 V 2 = I n c 0 0 I n nc From the above, note that V 2 V 1 = 0. Now consider the transformed system matrices, A and B: A V 1 AV = V [ ] 1 A V 1 V 2 = V 1AV 1 V 1 AV 2, V 2 V 2 AV 1 V 2 AV 2 B V 1 B = V 1 B = V 1B. V 2 V 2 B. Note that AV 1 span(columns of V 1 ) N (V 2 ), B N (V 2 ).
Lecture 2 and 3: Controllability of DT-LTI systems
1 Lecture 2 and 3: Controllability of DT-LTI systems Spring 2013 - EE 194, Advanced Control (Prof Khan) January 23 (Wed) and 28 (Mon), 2013 I LTI SYSTEMS Recall that continuous-time LTI systems can be
More informationLecture 7 and 8. Fall EE 105, Feedback Control Systems (Prof. Khan) September 30 and October 05, 2015
1 Lecture 7 and 8 Fall 2015 - EE 105, Feedback Control Systems (Prof Khan) September 30 and October 05, 2015 I CONTROLLABILITY OF AN DT-LTI SYSTEM IN k TIME-STEPS The DT-LTI system is given by the following
More information1 Similarity transform 2. 2 Controllability The PBH test for controllability Observability The PBH test for observability...
Contents 1 Similarity transform 2 2 Controllability 3 21 The PBH test for controllability 5 3 Observability 6 31 The PBH test for observability 7 4 Example ([1, pp121) 9 5 Subspace decomposition 11 51
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science : Dynamic Systems Spring 2011
MASSACHUSETTS INSTITUTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science 6.4: Dynamic Systems Spring Homework Solutions Exercise 3. a) We are given the single input LTI system: [
More information16.31 Fall 2005 Lecture Presentation Mon 31-Oct-05 ver 1.1
16.31 Fall 2005 Lecture Presentation Mon 31-Oct-05 ver 1.1 Charles P. Coleman October 31, 2005 1 / 40 : Controllability Tests Observability Tests LEARNING OUTCOMES: Perform controllability tests Perform
More informationMATH 2331 Linear Algebra. Section 2.1 Matrix Operations. Definition: A : m n, B : n p. Example: Compute AB, if possible.
MATH 2331 Linear Algebra Section 2.1 Matrix Operations Definition: A : m n, B : n p ( 1 2 p ) ( 1 2 p ) AB = A b b b = Ab Ab Ab Example: Compute AB, if possible. 1 Row-column rule: i-j-th entry of AB:
More informationLinear System Theory
Linear System Theory Wonhee Kim Chapter 6: Controllability & Observability Chapter 7: Minimal Realizations May 2, 217 1 / 31 Recap State space equation Linear Algebra Solutions of LTI and LTV system Stability
More informationECEN 605 LINEAR SYSTEMS. Lecture 8 Invariant Subspaces 1/26
1/26 ECEN 605 LINEAR SYSTEMS Lecture 8 Invariant Subspaces Subspaces Let ẋ(t) = A x(t) + B u(t) y(t) = C x(t) (1a) (1b) denote a dynamic system where X, U and Y denote n, r and m dimensional vector spaces,
More informationDIAGONALIZATION. In order to see the implications of this definition, let us consider the following example Example 1. Consider the matrix
DIAGONALIZATION Definition We say that a matrix A of size n n is diagonalizable if there is a basis of R n consisting of eigenvectors of A ie if there are n linearly independent vectors v v n such that
More information1 Continuous-time Systems
Observability Completely controllable systems can be restructured by means of state feedback to have many desirable properties. But what if the state is not available for feedback? What if only the output
More information(a) II and III (b) I (c) I and III (d) I and II and III (e) None are true.
1 Which of the following statements is always true? I The null space of an m n matrix is a subspace of R m II If the set B = {v 1,, v n } spans a vector space V and dimv = n, then B is a basis for V III
More informationThe Jordan Normal Form and its Applications
The and its Applications Jeremy IMPACT Brigham Young University A square matrix A is a linear operator on {R, C} n. A is diagonalizable if and only if it has n linearly independent eigenvectors. What happens
More informationProperties of Matrices and Operations on Matrices
Properties of Matrices and Operations on Matrices A common data structure for statistical analysis is a rectangular array or matris. Rows represent individual observational units, or just observations,
More informationEigenvalues, Eigenvectors. Eigenvalues and eigenvector will be fundamentally related to the nature of the solutions of state space systems.
Chapter 3 Linear Algebra In this Chapter we provide a review of some basic concepts from Linear Algebra which will be required in order to compute solutions of LTI systems in state space form, discuss
More informationEK102 Linear Algebra PRACTICE PROBLEMS for Final Exam Spring 2016
EK102 Linear Algebra PRACTICE PROBLEMS for Final Exam Spring 2016 Answer the questions in the spaces provided on the question sheets. You must show your work to get credit for your answers. There will
More informationALGEBRA QUALIFYING EXAM PROBLEMS LINEAR ALGEBRA
ALGEBRA QUALIFYING EXAM PROBLEMS LINEAR ALGEBRA Kent State University Department of Mathematical Sciences Compiled and Maintained by Donald L. White Version: August 29, 2017 CONTENTS LINEAR ALGEBRA AND
More informationSolution for Homework 5
Solution for Homework 5 ME243A/ECE23A Fall 27 Exercise 1 The computation of the reachable subspace in continuous time can be handled easily introducing the concepts of inner product, orthogonal complement
More informationThe University of Texas at Austin Department of Electrical and Computer Engineering. EE381V: Large Scale Learning Spring 2013.
The University of Texas at Austin Department of Electrical and Computer Engineering EE381V: Large Scale Learning Spring 2013 Assignment Two Caramanis/Sanghavi Due: Tuesday, Feb. 19, 2013. Computational
More informationLinear Systems. Class 27. c 2008 Ron Buckmire. TITLE Projection Matrices and Orthogonal Diagonalization CURRENT READING Poole 5.4
Linear Systems Math Spring 8 c 8 Ron Buckmire Fowler 9 MWF 9: am - :5 am http://faculty.oxy.edu/ron/math//8/ Class 7 TITLE Projection Matrices and Orthogonal Diagonalization CURRENT READING Poole 5. Summary
More informationStudy Guide for Linear Algebra Exam 2
Study Guide for Linear Algebra Exam 2 Term Vector Space Definition A Vector Space is a nonempty set V of objects, on which are defined two operations, called addition and multiplication by scalars (real
More informationYORK UNIVERSITY. Faculty of Science Department of Mathematics and Statistics MATH M Test #1. July 11, 2013 Solutions
YORK UNIVERSITY Faculty of Science Department of Mathematics and Statistics MATH 222 3. M Test # July, 23 Solutions. For each statement indicate whether it is always TRUE or sometimes FALSE. Note: For
More informationEE731 Lecture Notes: Matrix Computations for Signal Processing
EE731 Lecture Notes: Matrix Computations for Signal Processing James P. Reilly c Department of Electrical and Computer Engineering McMaster University September 22, 2005 0 Preface This collection of ten
More informationMATH SOLUTIONS TO PRACTICE PROBLEMS - MIDTERM I. 1. We carry out row reduction. We begin with the row operations
MATH 2 - SOLUTIONS TO PRACTICE PROBLEMS - MIDTERM I. We carry out row reduction. We begin with the row operations yielding the matrix This is already upper triangular hence The lower triangular matrix
More informationContents. Preface for the Instructor. Preface for the Student. xvii. Acknowledgments. 1 Vector Spaces 1 1.A R n and C n 2
Contents Preface for the Instructor xi Preface for the Student xv Acknowledgments xvii 1 Vector Spaces 1 1.A R n and C n 2 Complex Numbers 2 Lists 5 F n 6 Digression on Fields 10 Exercises 1.A 11 1.B Definition
More informationSYSTEMTEORI - ÖVNING 5: FEEDBACK, POLE ASSIGNMENT AND OBSERVER
SYSTEMTEORI - ÖVNING 5: FEEDBACK, POLE ASSIGNMENT AND OBSERVER Exercise 54 Consider the system: ẍ aẋ bx u where u is the input and x the output signal (a): Determine a state space realization (b): Is the
More information1. Linear systems of equations. Chapters 7-8: Linear Algebra. Solution(s) of a linear system of equations (continued)
1 A linear system of equations of the form Sections 75, 78 & 81 a 11 x 1 + a 12 x 2 + + a 1n x n = b 1 a 21 x 1 + a 22 x 2 + + a 2n x n = b 2 a m1 x 1 + a m2 x 2 + + a mn x n = b m can be written in matrix
More informationIr O D = D = ( ) Section 2.6 Example 1. (Bottom of page 119) dim(v ) = dim(l(v, W )) = dim(v ) dim(f ) = dim(v )
Section 3.2 Theorem 3.6. Let A be an m n matrix of rank r. Then r m, r n, and, by means of a finite number of elementary row and column operations, A can be transformed into the matrix ( ) Ir O D = 1 O
More informationNotes on singular value decomposition for Math 54. Recall that if A is a symmetric n n matrix, then A has real eigenvalues A = P DP 1 A = P DP T.
Notes on singular value decomposition for Math 54 Recall that if A is a symmetric n n matrix, then A has real eigenvalues λ 1,, λ n (possibly repeated), and R n has an orthonormal basis v 1,, v n, where
More informationWhat is on this week. 1 Vector spaces (continued) 1.1 Null space and Column Space of a matrix
Professor Joana Amorim, jamorim@bu.edu What is on this week Vector spaces (continued). Null space and Column Space of a matrix............................. Null Space...........................................2
More informationEE451/551: Digital Control. Chapter 8: Properties of State Space Models
EE451/551: Digital Control Chapter 8: Properties of State Space Models Equilibrium State Definition 8.1: An equilibrium point or state is an initial state from which the system nevers departs unless perturbed
More informationControllability. Chapter Reachable States. This chapter develops the fundamental results about controllability and pole assignment.
Chapter Controllability This chapter develops the fundamental results about controllability and pole assignment Reachable States We study the linear system ẋ = Ax + Bu, t, where x(t) R n and u(t) R m Thus
More informationLinear Algebra Final Exam Study Guide Solutions Fall 2012
. Let A = Given that v = 7 7 67 5 75 78 Linear Algebra Final Exam Study Guide Solutions Fall 5 explain why it is not possible to diagonalize A. is an eigenvector for A and λ = is an eigenvalue for A diagonalize
More informationBalanced Truncation 1
Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science 6.242, Fall 2004: MODEL REDUCTION Balanced Truncation This lecture introduces balanced truncation for LTI
More informationMAT Linear Algebra Collection of sample exams
MAT 342 - Linear Algebra Collection of sample exams A-x. (0 pts Give the precise definition of the row echelon form. 2. ( 0 pts After performing row reductions on the augmented matrix for a certain system
More informationReview of Some Concepts from Linear Algebra: Part 2
Review of Some Concepts from Linear Algebra: Part 2 Department of Mathematics Boise State University January 16, 2019 Math 566 Linear Algebra Review: Part 2 January 16, 2019 1 / 22 Vector spaces A set
More informationRank and Nullity. MATH 322, Linear Algebra I. J. Robert Buchanan. Spring Department of Mathematics
Rank and Nullity MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 2015 Objectives We have defined and studied the important vector spaces associated with matrices (row space,
More informationOnline Exercises for Linear Algebra XM511
This document lists the online exercises for XM511. The section ( ) numbers refer to the textbook. TYPE I are True/False. Lecture 02 ( 1.1) Online Exercises for Linear Algebra XM511 1) The matrix [3 2
More informationMATH 221, Spring Homework 10 Solutions
MATH 22, Spring 28 - Homework Solutions Due Tuesday, May Section 52 Page 279, Problem 2: 4 λ A λi = and the characteristic polynomial is det(a λi) = ( 4 λ)( λ) ( )(6) = λ 6 λ 2 +λ+2 The solutions to the
More informationDS-GA 1002 Lecture notes 10 November 23, Linear models
DS-GA 2 Lecture notes November 23, 2 Linear functions Linear models A linear model encodes the assumption that two quantities are linearly related. Mathematically, this is characterized using linear functions.
More informationMath 4A Notes. Written by Victoria Kala Last updated June 11, 2017
Math 4A Notes Written by Victoria Kala vtkala@math.ucsb.edu Last updated June 11, 2017 Systems of Linear Equations A linear equation is an equation that can be written in the form a 1 x 1 + a 2 x 2 +...
More informationSystems and Control Theory Lecture Notes. Laura Giarré
Systems and Control Theory Lecture Notes Laura Giarré L. Giarré 2018-2019 Lesson 14: Rechability Reachability (DT) Reachability theorem (DT) Reachability properties (DT) Reachability gramian (DT) Reachability
More informationEL 625 Lecture 10. Pole Placement and Observer Design. ẋ = Ax (1)
EL 625 Lecture 0 EL 625 Lecture 0 Pole Placement and Observer Design Pole Placement Consider the system ẋ Ax () The solution to this system is x(t) e At x(0) (2) If the eigenvalues of A all lie in the
More informationME 234, Lyapunov and Riccati Problems. 1. This problem is to recall some facts and formulae you already know. e Aτ BB e A τ dτ
ME 234, Lyapunov and Riccati Problems. This problem is to recall some facts and formulae you already know. (a) Let A and B be matrices of appropriate dimension. Show that (A, B) is controllable if and
More information2. Review of Linear Algebra
2. Review of Linear Algebra ECE 83, Spring 217 In this course we will represent signals as vectors and operators (e.g., filters, transforms, etc) as matrices. This lecture reviews basic concepts from linear
More informationECEN 605 LINEAR SYSTEMS. Lecture 7 Solution of State Equations 1/77
1/77 ECEN 605 LINEAR SYSTEMS Lecture 7 Solution of State Equations Solution of State Space Equations Recall from the previous Lecture note, for a system: ẋ(t) = A x(t) + B u(t) y(t) = C x(t) + D u(t),
More informationB553 Lecture 5: Matrix Algebra Review
B553 Lecture 5: Matrix Algebra Review Kris Hauser January 19, 2012 We have seen in prior lectures how vectors represent points in R n and gradients of functions. Matrices represent linear transformations
More informationRow Space, Column Space, and Nullspace
Row Space, Column Space, and Nullspace MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 2015 Introduction Every matrix has associated with it three vector spaces: row space
More informationLecture 19 Observability and state estimation
EE263 Autumn 2007-08 Stephen Boyd Lecture 19 Observability and state estimation state estimation discrete-time observability observability controllability duality observers for noiseless case continuous-time
More informationMath Final December 2006 C. Robinson
Math 285-1 Final December 2006 C. Robinson 2 5 8 5 1 2 0-1 0 1. (21 Points) The matrix A = 1 2 2 3 1 8 3 2 6 has the reduced echelon form U = 0 0 1 2 0 0 0 0 0 1. 2 6 1 0 0 0 0 0 a. Find a basis for the
More informationEEE582 Homework Problems
EEE582 Homework Problems HW. Write a state-space realization of the linearized model for the cruise control system around speeds v = 4 (Section.3, http://tsakalis.faculty.asu.edu/notes/models.pdf). Use
More information1 Last time: least-squares problems
MATH Linear algebra (Fall 07) Lecture Last time: least-squares problems Definition. If A is an m n matrix and b R m, then a least-squares solution to the linear system Ax = b is a vector x R n such that
More informationChapter Two Elements of Linear Algebra
Chapter Two Elements of Linear Algebra Previously, in chapter one, we have considered single first order differential equations involving a single unknown function. In the next chapter we will begin to
More informationMATH 304 Linear Algebra Lecture 20: The Gram-Schmidt process (continued). Eigenvalues and eigenvectors.
MATH 304 Linear Algebra Lecture 20: The Gram-Schmidt process (continued). Eigenvalues and eigenvectors. Orthogonal sets Let V be a vector space with an inner product. Definition. Nonzero vectors v 1,v
More informationMath Linear Algebra Final Exam Review Sheet
Math 15-1 Linear Algebra Final Exam Review Sheet Vector Operations Vector addition is a component-wise operation. Two vectors v and w may be added together as long as they contain the same number n of
More informationModule 03 Linear Systems Theory: Necessary Background
Module 03 Linear Systems Theory: Necessary Background Ahmad F. Taha EE 5243: Introduction to Cyber-Physical Systems Email: ahmad.taha@utsa.edu Webpage: http://engineering.utsa.edu/ taha/index.html September
More informationChapter 3 Transformations
Chapter 3 Transformations An Introduction to Optimization Spring, 2014 Wei-Ta Chu 1 Linear Transformations A function is called a linear transformation if 1. for every and 2. for every If we fix the bases
More information1. Select the unique answer (choice) for each problem. Write only the answer.
MATH 5 Practice Problem Set Spring 7. Select the unique answer (choice) for each problem. Write only the answer. () Determine all the values of a for which the system has infinitely many solutions: x +
More informationECE504: Lecture 9. D. Richard Brown III. Worcester Polytechnic Institute. 04-Nov-2008
ECE504: Lecture 9 D. Richard Brown III Worcester Polytechnic Institute 04-Nov-2008 Worcester Polytechnic Institute D. Richard Brown III 04-Nov-2008 1 / 38 Lecture 9 Major Topics ECE504: Lecture 9 We are
More informationVector Spaces, Orthogonality, and Linear Least Squares
Week Vector Spaces, Orthogonality, and Linear Least Squares. Opening Remarks.. Visualizing Planes, Lines, and Solutions Consider the following system of linear equations from the opener for Week 9: χ χ
More informationCME 345: MODEL REDUCTION
CME 345: MODEL REDUCTION Balanced Truncation Charbel Farhat & David Amsallem Stanford University cfarhat@stanford.edu These slides are based on the recommended textbook: A.C. Antoulas, Approximation of
More informationMATH 583A REVIEW SESSION #1
MATH 583A REVIEW SESSION #1 BOJAN DURICKOVIC 1. Vector Spaces Very quick review of the basic linear algebra concepts (see any linear algebra textbook): (finite dimensional) vector space (or linear space),
More informationSECTION 3.3. PROBLEM 22. The null space of a matrix A is: N(A) = {X : AX = 0}. Here are the calculations of AX for X = a,b,c,d, and e. =
SECTION 3.3. PROBLEM. The null space of a matrix A is: N(A) {X : AX }. Here are the calculations of AX for X a,b,c,d, and e. Aa [ ][ ] 3 3 [ ][ ] Ac 3 3 [ ] 3 3 [ ] 4+4 6+6 Ae [ ], Ab [ ][ ] 3 3 3 [ ]
More informationAnalysis of Discrete-Time Systems
TU Berlin Discrete-Time Control Systems 1 Analysis of Discrete-Time Systems Overview Stability Sensitivity and Robustness Controllability, Reachability, Observability, and Detectabiliy TU Berlin Discrete-Time
More informationLinear Algebra- Final Exam Review
Linear Algebra- Final Exam Review. Let A be invertible. Show that, if v, v, v 3 are linearly independent vectors, so are Av, Av, Av 3. NOTE: It should be clear from your answer that you know the definition.
More informationMATH 23a, FALL 2002 THEORETICAL LINEAR ALGEBRA AND MULTIVARIABLE CALCULUS Solutions to Final Exam (in-class portion) January 22, 2003
MATH 23a, FALL 2002 THEORETICAL LINEAR ALGEBRA AND MULTIVARIABLE CALCULUS Solutions to Final Exam (in-class portion) January 22, 2003 1. True or False (28 points, 2 each) T or F If V is a vector space
More information(a) If A is a 3 by 4 matrix, what does this tell us about its nullspace? Solution: dim N(A) 1, since rank(a) 3. Ax =
. (5 points) (a) If A is a 3 by 4 matrix, what does this tell us about its nullspace? dim N(A), since rank(a) 3. (b) If we also know that Ax = has no solution, what do we know about the rank of A? C(A)
More informationIntro. Computer Control Systems: F8
Intro. Computer Control Systems: F8 Properties of state-space descriptions and feedback Dave Zachariah Dept. Information Technology, Div. Systems and Control 1 / 22 dave.zachariah@it.uu.se F7: Quiz! 2
More informationObservability and state estimation
EE263 Autumn 2015 S Boyd and S Lall Observability and state estimation state estimation discrete-time observability observability controllability duality observers for noiseless case continuous-time observability
More informationControl Systems Design, SC4026. SC4026 Fall 2010, dr. A. Abate, DCSC, TU Delft
Control Systems Design, SC4026 SC4026 Fall 2010, dr. A. Abate, DCSC, TU Delft Lecture 4 Controllability (a.k.a. Reachability) and Observability Algebraic Tests (Kalman rank condition & Hautus test) A few
More informationMathematics I. Exercises with solutions. 1 Linear Algebra. Vectors and Matrices Let , C = , B = A = Determine the following matrices:
Mathematics I Exercises with solutions Linear Algebra Vectors and Matrices.. Let A = 5, B = Determine the following matrices: 4 5, C = a) A + B; b) A B; c) AB; d) BA; e) (AB)C; f) A(BC) Solution: 4 5 a)
More informationModule 07 Controllability and Controller Design of Dynamical LTI Systems
Module 07 Controllability and Controller Design of Dynamical LTI Systems Ahmad F. Taha EE 5143: Linear Systems and Control Email: ahmad.taha@utsa.edu Webpage: http://engineering.utsa.edu/ataha October
More informationMATH2210 Notebook 3 Spring 2018
MATH2210 Notebook 3 Spring 2018 prepared by Professor Jenny Baglivo c Copyright 2009 2018 by Jenny A. Baglivo. All Rights Reserved. 3 MATH2210 Notebook 3 3 3.1 Vector Spaces and Subspaces.................................
More informationZeros and zero dynamics
CHAPTER 4 Zeros and zero dynamics 41 Zero dynamics for SISO systems Consider a linear system defined by a strictly proper scalar transfer function that does not have any common zero and pole: g(s) =α p(s)
More informationChapter 2: Matrix Algebra
Chapter 2: Matrix Algebra (Last Updated: October 12, 2016) These notes are derived primarily from Linear Algebra and its applications by David Lay (4ed). Write A = 1. Matrix operations [a 1 a n. Then entry
More informationJordan Canonical Form
Jordan Canonical Form Massoud Malek Jordan normal form or Jordan canonical form (named in honor of Camille Jordan) shows that by changing the basis, a given square matrix M can be transformed into a certain
More informationMTH 362: Advanced Engineering Mathematics
MTH 362: Advanced Engineering Mathematics Lecture 5 Jonathan A. Chávez Casillas 1 1 University of Rhode Island Department of Mathematics September 26, 2017 1 Linear Independence and Dependence of Vectors
More informationMCE693/793: Analysis and Control of Nonlinear Systems
MCE693/793: Analysis and Control of Nonlinear Systems Introduction to Nonlinear Controllability and Observability Hanz Richter Mechanical Engineering Department Cleveland State University Definition of
More information5.) For each of the given sets of vectors, determine whether or not the set spans R 3. Give reasons for your answers.
Linear Algebra - Test File - Spring Test # For problems - consider the following system of equations. x + y - z = x + y + 4z = x + y + 6z =.) Solve the system without using your calculator..) Find the
More informationMaths for Signals and Systems Linear Algebra in Engineering
Maths for Signals and Systems Linear Algebra in Engineering Lecture 3, Friday 4 th October 26 DR TANIA STATHAKI READER (ASSOCIATE PROFFESOR) IN SIGNAL PROCESSING IMPERIAL COLLEGE LONDON Mathematics for
More informationMeasurement partitioning and observational. equivalence in state estimation
Measurement partitioning and observational 1 equivalence in state estimation Mohammadreza Doostmohammadian, Student Member, IEEE, and Usman A. Khan, Senior Member, IEEE arxiv:1412.5111v1 [cs.it] 16 Dec
More informationEE263: Introduction to Linear Dynamical Systems Review Session 2
EE263: Introduction to Linear Dynamical Systems Review Session 2 Basic concepts from linear algebra nullspace range rank and conservation of dimension EE263 RS2 1 Prerequisites We assume that you are familiar
More informationHomework 1 Elena Davidson (B) (C) (D) (E) (F) (G) (H) (I)
CS 106 Spring 2004 Homework 1 Elena Davidson 8 April 2004 Problem 1.1 Let B be a 4 4 matrix to which we apply the following operations: 1. double column 1, 2. halve row 3, 3. add row 3 to row 1, 4. interchange
More informationMath 323 Exam 2 Sample Problems Solution Guide October 31, 2013
Math Exam Sample Problems Solution Guide October, Note that the following provides a guide to the solutions on the sample problems, but in some cases the complete solution would require more work or justification
More informationMath 18, Linear Algebra, Lecture C00, Spring 2017 Review and Practice Problems for Final Exam
Math 8, Linear Algebra, Lecture C, Spring 7 Review and Practice Problems for Final Exam. The augmentedmatrix of a linear system has been transformed by row operations into 5 4 8. Determine if the system
More informationTopic # Feedback Control
Topic #11 16.31 Feedback Control State-Space Systems State-space model features Observability Controllability Minimal Realizations Copyright 21 by Jonathan How. 1 Fall 21 16.31 11 1 State-Space Model Features
More informationMATH SOLUTIONS TO PRACTICE MIDTERM LECTURE 1, SUMMER Given vector spaces V and W, V W is the vector space given by
MATH 110 - SOLUTIONS TO PRACTICE MIDTERM LECTURE 1, SUMMER 2009 GSI: SANTIAGO CAÑEZ 1. Given vector spaces V and W, V W is the vector space given by V W = {(v, w) v V and w W }, with addition and scalar
More informationNumerical Linear Algebra Homework Assignment - Week 2
Numerical Linear Algebra Homework Assignment - Week 2 Đoàn Trần Nguyên Tùng Student ID: 1411352 8th October 2016 Exercise 2.1: Show that if a matrix A is both triangular and unitary, then it is diagonal.
More informationChap 3. Linear Algebra
Chap 3. Linear Algebra Outlines 1. Introduction 2. Basis, Representation, and Orthonormalization 3. Linear Algebraic Equations 4. Similarity Transformation 5. Diagonal Form and Jordan Form 6. Functions
More informationGeometric Control Theory
1 Geometric Control Theory Lecture notes by Xiaoming Hu and Anders Lindquist in collaboration with Jorge Mari and Janne Sand 2012 Optimization and Systems Theory Royal institute of technology SE-100 44
More informationLecture 22: Section 4.7
Lecture 22: Section 47 Shuanglin Shao December 2, 213 Row Space, Column Space, and Null Space Definition For an m n, a 11 a 12 a 1n a 21 a 22 a 2n A = a m1 a m2 a mn, the vectors r 1 = [ a 11 a 12 a 1n
More informationAnalysis of Discrete-Time Systems
TU Berlin Discrete-Time Control Systems TU Berlin Discrete-Time Control Systems 2 Stability Definitions We define stability first with respect to changes in the initial conditions Analysis of Discrete-Time
More informationJordan Canonical Form
Jordan Canonical Form Suppose A is a n n matrix operating on V = C n. First Reduction (to a repeated single eigenvalue). Let φ(x) = det(x A) = r (x λ i ) e i (1) be the characteristic equation of A. Factor
More informationThen x 1,..., x n is a basis as desired. Indeed, it suffices to verify that it spans V, since n = dim(v ). We may write any v V as r
Practice final solutions. I did not include definitions which you can find in Axler or in the course notes. These solutions are on the terse side, but would be acceptable in the final. However, if you
More information7. Symmetric Matrices and Quadratic Forms
Linear Algebra 7. Symmetric Matrices and Quadratic Forms CSIE NCU 1 7. Symmetric Matrices and Quadratic Forms 7.1 Diagonalization of symmetric matrices 2 7.2 Quadratic forms.. 9 7.4 The singular value
More informationLecture: Linear algebra. 4. Solutions of linear equation systems The fundamental theorem of linear algebra
Lecture: Linear algebra. 1. Subspaces. 2. Orthogonal complement. 3. The four fundamental subspaces 4. Solutions of linear equation systems The fundamental theorem of linear algebra 5. Determining the fundamental
More informationThe Singular Value Decomposition
The Singular Value Decomposition We are interested in more than just sym+def matrices. But the eigenvalue decompositions discussed in the last section of notes will play a major role in solving general
More informationThe Essentials of Linear State-Space Systems
:or-' The Essentials of Linear State-Space Systems J. Dwight Aplevich GIFT OF THE ASIA FOUNDATION NOT FOR RE-SALE John Wiley & Sons, Inc New York Chichester Weinheim OAI HOC OUOC GIA HA N^l TRUNGTAMTHANCTINTHUVIIN
More informationMath 1060 Linear Algebra Homework Exercises 1 1. Find the complete solutions (if any!) to each of the following systems of simultaneous equations:
Homework Exercises 1 1 Find the complete solutions (if any!) to each of the following systems of simultaneous equations: (i) x 4y + 3z = 2 3x 11y + 13z = 3 2x 9y + 2z = 7 x 2y + 6z = 2 (ii) x 4y + 3z =
More informationControllability, Observability, Full State Feedback, Observer Based Control
Multivariable Control Lecture 4 Controllability, Observability, Full State Feedback, Observer Based Control John T. Wen September 13, 24 Ref: 3.2-3.4 of Text Controllability ẋ = Ax + Bu; x() = x. At time
More informationMath 415 Exam I. Name: Student ID: Calculators, books and notes are not allowed!
Math 415 Exam I Calculators, books and notes are not allowed! Name: Student ID: Score: Math 415 Exam I (20pts) 1. Let A be a square matrix satisfying A 2 = 2A. Find the determinant of A. Sol. From A 2
More information