Linear System Theory
|
|
- Hector Norris
- 6 years ago
- Views:
Transcription
1 Linear System Theory Wonhee Kim Lecture 3 Mar. 21, / 38
2 Overview Recap Nonlinear systems: existence and uniqueness of a solution of differential equations Preliminaries Fields and Vector Spaces 2 / 38
3 Recap classical vs. modern control theory linearization: local analysis continuous and discrete-time LTI Systems system modeling: from ODE to state-space system system transformation: from time domain to frequency domain In this lecture, we will see why we study linear system theory not in the textbook, see Nonlinear Systems by H. Khalil 3 / 38
4 Recap: Frequency and Time Domain Analysis Differential equation Transfer function ẍ + 3ẋ + 2x = u(t) (s 2 + 3s + 2)X (s) = U(s) G(s) = X (s) U(s) = 1 s = 1 (s + 1)(s + 2) State space representation x 1 = x and x 2 = ẋ ) ( ) (ẋ1 0 1 ẋ = = x + ẋ ( 0 1) u 4 / 38
5 Recap: Frequency and Time Domain Analysis Transfer function State space representation G(s) = X (s) U(s) = 1 s = 1 (s + 1)(s + 2) ẋ = ) (ẋ1 = ẋ 2 ( 0 ) ( 0 x + u 1) What is the pole of the transfer function? What is the eigenvalue of matrix A? det(si A) = 0 ( ) s 1 det = 0 2 s + 3 s 2 + 3s + 2 = (s + 1)(s + 2) = 0 stable!!! Inverse Laplace transform of G(s): g(t) = e t e 2t 5 / 38
6 Recap:Frequency and Time Domain Analysis Transfer function G(z) = Y (z) U(z) = z (z 0.1)(z 2) = z z 2 2.1z Inverse z-transformation: g(t) = t t Pole: 0.1 and 2 Eigenvalue: : 0.1 and 2 6 / 38
7 One-dimensional LTI System dx(t) dt Is there a solution? What is the solution? = Ax(t), x(0) = x 0,, t [0, T ], A R If there is a solution, does it exist for all t [0, T ]? Is there a unique solution? Does existence and uniqueness of the solution depend on the initial condition x 0? These properties also hold when A is a matrix, which will be studied later in this course 7 / 38
8 Nonlinear Systems dx(t) dt Is there a solution? Yes = x 1/3 (t), x(0) = 0, t [0, 1] What is the solution? x(t) = 0 and x(t) = (2t/3) 3/2 If there is a solution, does it exist for all t [0, T ]? Yes Is there a unique solution? No 8 / 38
9 Nonlinear Systems dx(t) dt Is there a solution? Yes What is the solution? = x 2 (t), x(0) = 1, t [0, 1] x(t) = 1 t 1 If there is a solution, does it exist for all t [0, 1]? No finite escape time: the phenomenon that x(t) escapes to infinity at a finite time (also called conjugate point ) In this case, x(t) has a finite escape time at t = 1, since lim t 1 x(t) = 9 / 38
10 Nonlinear Systems Question: What is the condition under which there exists a unique solution to the nonlinear system? Definition A function f (x) : R n R n is Lipschitz if there exists a constant L 0 such that for all x, y R n, (note that for any x R n, x 2 = x T x) f (x) f (y) L x y f (x) f (y) x y L A function that has infinite slope at some point is not Lipschitz Question: Is f (x) continuous? Is f (x) = Ax Lipschitz? Yes (A: matrix or scalar) Is f (x) = x 1/3 Lipschitz? f (x) = 1 3 x 2 3 as x 0 10 / 38
11 Nonlinear Systems Theorem Suppose that f (x) is Lipschitz. Then, the state equation ẋ(t) = f (x(t)) with x(0) = x 0 has a unique solution over [0, T ]. LTI system: Lipschitz!! ẋ(t) = x 1/3 (t) dost not have a unique solution f (x) = x 1/3 is not Lipschitz This is one of the main properties of LTI systems Do you want to see the proof? We will not cover this in this class, since it requires heavy mathematics I will introduce the main idea of the proof 11 / 38
12 Nonlinear Systems Main idea of the proof t ẋ(t) = f (x(t)), x(0) = x 0 x(t) = x 0 + f (x(s))ds 0 Let (T x)(t) = x 0 + t 0 f (x(s))ds If x(t) satisfies the above relation, then x(t) is a solution of the ODE Equivalently, if there exists x(t) such that x(t) = (T x)(t), then we are done x(t) = (T x)(t) fixed point!!! We can show that there exist a unique fixed point of (T x)(t) under the Lipschitz condition The detailed proof will be provided in an advanced control course (e.g. nonlinear system control) 12 / 38
13 One-dimensional LTV System ẋ(t) = A(t)x(t), x(0) = x 0, A(t) : [0, T ] R A(t) is a function that is defined on [0, T ] The solution does not exist if A(t) is not continuous A(t) is continuous on [0, T ] there exists a constant c 0 such that A(t) c for all t [0, T ] (why???), which implies It is Lipschitz!!! A(t)x A(t)y A(t) x y c x y There exists a unique solution 13 / 38
14 Matrix, Function, Linear Algebra Linear vector space state space, input space, output space Linear operators reachability (controllability), observability operator Normed spaces stability Inner product controllability and observability grammians 14 / 38
15 Preliminaries Sets: Z-integer, Q-rational numbers, N-natural numbers, R-real numbers, R +, C-complex numbers, C + Cartesian product: two sets X and Y, the cartesian product is X Y A B = {(a, b) a A and b B} Function: f : X Y for any x X, f assigns a unique f (x) = y Y X : domain, Y : codomain {f (x) : x X }: range f : function, operator, map, transformation 15 / 38
16 Preliminaries Injective (one to one): f is injective if and only if f (x 1 ) = f (x 2 ) x 1 = x 2, conversely, x 1 x 2 implies f (x 1 ) f (x 2 ) Surjective (onto): f is surjective if and only if for all y Y, there exists x X such that y = f (x) Bijective (one to one correspondnce): f is bijective if and only if for all y Y, there exists a unique x X such that y = f (x) equivalently, f is bijective if and only if f is injective and surjective 16 / 38
17 Fields A field F is an object that consisting of a set of elements, and two binary operations: addition (+), multiplication ( ) such that Addition (i) associative: (α + β) + γ = α + (β + γ) for all α, β, γ F (ii) commutative: α + β = β + α for all α, β F (iii) there exists an identity element 0: α + 0 = α for all α F (iv) for all α F, there exists an inverse α such that α + ( α) = 0 Multiplication (i) associative: α (β γ) = (α β) γ for all α, β, γ F (ii) commutative: α β = β α for all α, β F (iii) there exists an identity element 1: α 1 = α for all α F (iv) for all α F, α 0, there exists an inverse α 1 such that α α 1 = α 1 α = 1 17 / 38
18 Fields Examples: R, C, Q Example: Consider the set of all 2 2 matrices for the form Matrix addition and multiplication ( ) ( ) ( ) x y , x, y R, 0, 1 y x The inverse always exists How about the set of all 2 2 matrices? 18 / 38
19 Vector Space vector space = linear space = linear vector space A linear space over a field F, (V, F), consists of a set V of vectors, a field F, and two operations, vector addition and scalar multiplication The two operations satisfy Addition (a) addition: for all x, y V, x + y V (b) associative: for all x, y, z V, (x + y) + z = x + (y + z) (c) commutative: for all x, y V, x + y = y + x (d) there exists a unique zero vector 0 V such that x + 0 = 0 + x = x for all x V (e) there exists a unique inverse x V such that x + ( x) = 0 for all x V 19 / 38
20 Vector Space vector space = linear space = linear vector space A linear space over a field F, (V, F), consists of a set V of vectors, a field F, and two operations, vector addition and scalar multiplication The two operations satisfy Multiplication (a) multiplication: for any α F and x V, αx V (b) associative: for any α, β F and x V, α(βx) = (αβ)x (c) distributive w.r.t. scalar addition: for any α F and x, y V, α(x + y) = αx + αy (d) distributive w.r.t. scalar multiplication for any α, β F and x V, (α + β)x = αx + βx (e) there exists a unique 1 F such that for any x V, 1x = x (f) there exists a unique 0 F such that for any x V, 0x = 0 20 / 38
21 Vector Space vector space = linear space = linear vector space A linear space over a field F, (V, F), consists of a set V of vectors, a field F, and two operations, vector addition and scalar multiplication Example: (F n, F) where F n = F F Example: (R n, R), (C n, C), (C n, R) Example: (R, C) is not a vector space! (why?) (1 + i)1 = 1 + i / R Example: a continuous function f : [t 0, t 1 ] R n, the set of such functions, (C([t 0, t 1 ], R n ), R), is a linear space Example: You will see other examples in HW 21 / 38
22 Vector Subspaces (Linear Subspaces) Let (V, F) be a linear space, and W V, i.e., W is a subset of V. Then (W, F) is called a subspace of (V, F) if (W, F) is itself a vector space (W, F) is a subspace if W V for any w 1, w 1 W and α, β F, αw 1 + βw 2 W 22 / 38
23 Vector Subspaces Example: In (R 2, R), every straight line passing through the origin is a subspace of (R 2, R). That is, ( x1 cx 2 ) for any fixed c R is a subspace of (R 2, R) Example: The vector space (R n, R) is a subspace of (C n, R) Question: Prove that if W 1 and W 2 are subspaces of V, then W 1 W 2 is a subspace W 1 W 2 is not necessarily a subspace Proof of (ii): We provide a counter example { ( ) 0 } W 1 = span, W 1 2 = span ( ( ( = + / W 1) 1) 0) 1 W 2 { ( 1 0 ) } 23 / 38
24 Linear Independence and Dependence Suppose (V, F) is a linear space (vector space). The set of vectors {v 1,..., v p }, v i V is said to be linearly independent if and only if where α i F α 1 v 1 + α 2 v α p v p = 0 α 1 = α 2 = = α p = 0 The set of vectors is said to be linearly dependent if and only if it is not linearly independent If the set of vectors is linearly dependent, then at least one (not everyone!!!) of them can be written as a linear combination of others 24 / 38
25 Example: x 1,..., x n R n and x 1 = 0. This is linearly dependent, since α 1 = 1, and α 2,..., α n = 0 Example: α 1 ( 1 1 ) ( ) 3 + α 2 2 ( / /5 ( ) ( α 3 = 4 0) ) α ( 1 α 2 0 = 0) α 3 Example: F = R, k {0, 1,...}, and define ( α1 α 1 ) f k : [ 1, 1] R such that f k (t) = t k ( ) 16/5 = α 3 2/5 The set {f 0,..., f n } is linearly independent in (F([ 1, 1], R), R) We need to show α 0 + α 1 tα 2 t α n t n = 0, where t [ 1, 1] and α i R, implies α i = 0 for all i 25 / 38
26 Dimension and Basis Dimension: The maximal number of linear independent vectors in a linear space (V, F) is called the dimension of the linear space (V, F) Example: (F n, F) Basis: A set of linearly independent vectors of a linear space (V, F) is said to be a basis of V if every vector in V can be expressed as a unique linear combination of these vectors Basis (equivalent definition): For a linear space (V, F), a set of vectors {v 1,..., v n } is called basis of V if {v 1,..., v n } spans V, V = { n i=1 α iv i : α i F, i} {v 1,..., v n } is linearly independent Example: Suppose that {v 1,.., v n } is a basis of V. Then for any v V, there exists a unique α 1,..., α n F such that v = α 1 v 1 + α 2 v α n v n = ( ) v 1 v n α 1. α n 26 / 38
27 Dimension and Basis Example: (R n, R), (C, C), (C n, C), (C, R), (C n, R) Example: (R 2 2, R), (R n n, R) Example: F = R, k {0, 1,...}, and define f k : (, ) R such that f k (t) = t k The set {f 0, f 1...} is linearly independent in (F((, ), R), R) Equivalently, there exist no real constants α i s not all zero, such that α i t k = 0 k=1 The dimension of (F((, ), R), R) is not finite (infinite-dimensional space) 27 / 38
28 Dimension and Basis Question: What is the relationship between dimension and basis in a vector space? Theorem In an n-dimensional vector space, (V, F), any set of n linearly independent vectors forms a basis By definition of the n-dimensional vector space, there exists a set of n linearly independent vectors, {v 1,..., v n } (note that n is the maximum number of linearly independent vectors that we can have). Let x V, and consider {x, v 1,..., v n } (note that they are linearly dependent!). There exist α 0, α 1,.., α n in F not all zero such that α 0 x + α 1 v α n v n = 0 Claim: α 0 0 (why??) by contradiction, suppose that α 0 = 0. Then α 1 v α n v n = 0 implies α 1,..., α n = 0 contradicts the fact that α i 0 for all i 28 / 38
29 Dimension and Basis Theorem In an n-dimensional vector space, (V, F), any set of n linearly independent vectors forms a basis Hence, x = ( α 1 /α 0 )v ( α n /α 0 )v n = β 1 v β n v n This implies that every vector x V can be expressed as a linear combination of {v 1,..., v n } x = ( α 1 /α 0 )v ( α n /α 0 )v n = β 1 v β n v n What is the next? uniqueness Suppose that there is another linear combination of x, namely x = β 1 v β n v n = γ 1 v γ n v n We have show that β i = γ i for all i. Consider, 0 = (β 1 γ 1 )v (β n γ n )v n 29 / 38
30 Dimension and Basis Dimension and Basis: If a linear space (V, F) has a basis of n elements, then (V, F) is said to be of dimension n. In other words, (V, F) is a n-dimensional linear space, and we write dim(v) = n Basis is not unique!! Given a basis, every vector x V can be uniquely represented by a set of scalars in F. Namely, for any v V, there exists a unique α i s in F such that v = α 1 v 1 + α 2 v α n v n α = (α 1,..., α n ) F n is called the representation of v or the coordination vector of v α i is called the coordinate of v w.r.t. v i 30 / 38
31 Dimension and Basis Example: (R n, R), (C, C), (C n, C), (C, R), (C n, R) Example: (R 2 2, R), (R n n, R) Example: F = R, k {0, 1,...}, and define f k : (, ) R such that f k (t) = t k The set {f 0, f 1...} is linearly independent in (F((, ), R), R) Equivalently, there exist no real constants α i s not all zero, such that α i t k = 0 k=1 The dimension of (F((, ), R), R) is not finite (infinite-dimensional space) Basis {1, t, t 2,...} 31 / 38
32 Change of Basis Basis is not unique For each basis, there are different representations of a vector x Suppose that {v 1,..., v n } and {e 1,..., e n } are bases (plural of basis) of the linear space (V, F). Then x = n α i v i = i=1 n β i e i, (α i β i, i) We need to figure out the relationship between the different representations of the same vector i=1 32 / 38
33 Change of Basis Suppose that {v 1,..., v n } and {e 1,..., e n } are bases (plural of basis) of the linear space (V, F). Then for any x V, we have a unique representation of x for each basis: x = n α i v i = i=1 n β i e i, (α i β i, i) i=1 α 1 = ( v 1 ) v n. = ( e 1 ) e n α n β 1. β n Now, for each e i, there is a unique representation w.r.t. v e i = ( ) v 1 v n γ 1i. γ ni = [v]α = [e]β 33 / 38
34 Change of Basis For each e i, there is a unique representation w.r.t. v e i = ( ) v 1 v n γ 1i. γ ni Hence, γ 11 γ 12 γ 1n ( ) ( ) γ 21 γ 22 γ 2n e1 e 2 e n = v1 v 2 v n γ n1 γ n2 γ nn Now, [e] = [v][γ] x = [v]α = [e]β = [v][γ]β Since for each x V there is a unique representation of x w.r.t. (v 1,..., v n ), we have α = [γ]β 34 / 38
35 Change of Basis Now, x = [v]α = [e]β = [v][γ]β Since for each x V there is a unique representation of x w.r.t. (v 1,..., v n ), we have α 1 γ 11 γ 12 γ 1n β 1 α 2 γ 21 γ 22 γ 2n β 2 or α = [γ]β. α n = γ n1 γ n2 γ nn β 1 γ 11 γ 12 γ 1n β 2. = γ 21 γ 22 γ 2n β n γ n1 γ n2 γ nn 1 α 1 α 2. α n. β n 35 / 38
36 Change of Basis Similarly, Hence, We have v i = ( ) e 1 e n p 1i. p ni p 11 p 12 p 1n p 21 p 22 p 2n [v] = [e] = [e][p] p n1 p n2 p nn x = [v]α = [e]β = [e][p]α β 1 p 11 p 12 p 1n α 1 β 2. = p 21 p 22 p 2n α , β n p n1 p n2 p nn α n α = [p] 1 β 36 / 38
37 Change of Basis Now, we can see that x = [v]α = [e]β = [e][p]α = [v]α = [e]β = [v][γ]β This implies β = [p]α, α = [γ]β α = [γ][p]α [γ][p] = I Hence, [γ] = [p] 1 or [p] = [γ] 1 This is known as Change of Basis!!! For x, suppose that the two bases (plural of basis) {v 1,..., v n } and {e 1,..., e n } are given, and you know that x = n i=1 α iv i = [v]α. Then you can represent x w.r.t. {e 1,..., e n } with x = [e][p]α = [e]β 37 / 38
38 Change of Basis Example v = Hence, {( 1 0), ( {( 0 1, e =, 1)} 1) [e] = [v][γ], [γ] = [e], [p] = [γ] 1 = [e] 1 x = ( ) ( ) = [e][p]α = [e][e] 1 α = ( )} ( ( 1 1 1, x =, α = 1 2) 2) ( ) ( ) / 38
Linear System Theory
Linear System Theory Wonhee Kim Lecture 4 Apr. 4, 2018 1 / 40 Recap Vector space, linear space, linear vector space Subspace Linearly independence and dependence Dimension, Basis, Change of Basis 2 / 40
More informationChap 4. State-Space Solutions and
Chap 4. State-Space Solutions and Realizations Outlines 1. Introduction 2. Solution of LTI State Equation 3. Equivalent State Equations 4. Realizations 5. Solution of Linear Time-Varying (LTV) Equations
More informationLinear System Theory. Wonhee Kim Lecture 1. March 7, 2018
Linear System Theory Wonhee Kim Lecture 1 March 7, 2018 1 / 22 Overview Course Information Prerequisites Course Outline What is Control Engineering? Examples of Control Systems Structure of Control Systems
More informationVector Spaces. Commutativity of +: u + v = v + u, u, v, V ; Associativity of +: u + (v + w) = (u + v) + w, u, v, w V ;
Vector Spaces A vector space is defined as a set V over a (scalar) field F, together with two binary operations, i.e., vector addition (+) and scalar multiplication ( ), satisfying the following axioms:
More informationElementary linear algebra
Chapter 1 Elementary linear algebra 1.1 Vector spaces Vector spaces owe their importance to the fact that so many models arising in the solutions of specific problems turn out to be vector spaces. The
More informationReview of Some Concepts from Linear Algebra: Part 2
Review of Some Concepts from Linear Algebra: Part 2 Department of Mathematics Boise State University January 16, 2019 Math 566 Linear Algebra Review: Part 2 January 16, 2019 1 / 22 Vector spaces A set
More informationVector Spaces and Linear Transformations
Vector Spaces and Linear Transformations Wei Shi, Jinan University 2017.11.1 1 / 18 Definition (Field) A field F = {F, +, } is an algebraic structure formed by a set F, and closed under binary operations
More informationDefinition 1. A set V is a vector space over the scalar field F {R, C} iff. there are two operations defined on V, called vector addition
6 Vector Spaces with Inned Product Basis and Dimension Section Objective(s): Vector Spaces and Subspaces Linear (In)dependence Basis and Dimension Inner Product 6 Vector Spaces and Subspaces Definition
More informationDefinition Suppose S R n, V R m are subspaces. A map U : S V is linear if
.6. Restriction of Linear Maps In this section, we restrict linear maps to subspaces. We observe that the notion of linearity still makes sense for maps whose domain and codomain are subspaces of R n,
More informationLinear System Theory
Linear System Theory Wonhee Kim Chapter 6: Controllability & Observability Chapter 7: Minimal Realizations May 2, 217 1 / 31 Recap State space equation Linear Algebra Solutions of LTI and LTV system Stability
More informationLinear algebra review
EE263 Autumn 2015 S. Boyd and S. Lall Linear algebra review vector space, subspaces independence, basis, dimension nullspace and range left and right invertibility 1 Vector spaces a vector space or linear
More informationSolution of Linear State-space Systems
Solution of Linear State-space Systems Homogeneous (u=0) LTV systems first Theorem (Peano-Baker series) The unique solution to x(t) = (t, )x 0 where The matrix function is given by is called the state
More informationAbstract Vector Spaces
CHAPTER 1 Abstract Vector Spaces 1.1 Vector Spaces Let K be a field, i.e. a number system where you can add, subtract, multiply and divide. In this course we will take K to be R, C or Q. Definition 1.1.
More informationVector Spaces. (1) Every vector space V has a zero vector 0 V
Vector Spaces 1. Vector Spaces A (real) vector space V is a set which has two operations: 1. An association of x, y V to an element x+y V. This operation is called vector addition. 2. The association of
More informationFamily Feud Review. Linear Algebra. October 22, 2013
Review Linear Algebra October 22, 2013 Question 1 Let A and B be matrices. If AB is a 4 7 matrix, then determine the dimensions of A and B if A has 19 columns. Answer 1 Answer A is a 4 19 matrix, while
More information1 Background and Review Material
1 Background and Review Material 1.1 Vector Spaces Let V be a nonempty set and consider the following two operations on elements of V : (x,y) x + y maps V V V (addition) (1.1) (α, x) αx maps F V V (scalar
More informationModule 09 From s-domain to time-domain From ODEs, TFs to State-Space Modern Control
Module 09 From s-domain to time-domain From ODEs, TFs to State-Space Modern Control Ahmad F. Taha EE 3413: Analysis and Desgin of Control Systems Email: ahmad.taha@utsa.edu Webpage: http://engineering.utsa.edu/
More informationMATH 304 Linear Algebra Lecture 20: The Gram-Schmidt process (continued). Eigenvalues and eigenvectors.
MATH 304 Linear Algebra Lecture 20: The Gram-Schmidt process (continued). Eigenvalues and eigenvectors. Orthogonal sets Let V be a vector space with an inner product. Definition. Nonzero vectors v 1,v
More informationSolution via Laplace transform and matrix exponential
EE263 Autumn 2015 S. Boyd and S. Lall Solution via Laplace transform and matrix exponential Laplace transform solving ẋ = Ax via Laplace transform state transition matrix matrix exponential qualitative
More informationNonlinear Control Systems
Nonlinear Control Systems António Pedro Aguiar pedro@isr.ist.utl.pt 3. Fundamental properties IST-DEEC PhD Course http://users.isr.ist.utl.pt/%7epedro/ncs2012/ 2012 1 Example Consider the system ẋ = f
More informationIntro. Computer Control Systems: F8
Intro. Computer Control Systems: F8 Properties of state-space descriptions and feedback Dave Zachariah Dept. Information Technology, Div. Systems and Control 1 / 22 dave.zachariah@it.uu.se F7: Quiz! 2
More informationLecture 3: Review of Linear Algebra
ECE 83 Fall 2 Statistical Signal Processing instructor: R Nowak Lecture 3: Review of Linear Algebra Very often in this course we will represent signals as vectors and operators (eg, filters, transforms,
More informationGrammians. Matthew M. Peet. Lecture 20: Grammians. Illinois Institute of Technology
Grammians Matthew M. Peet Illinois Institute of Technology Lecture 2: Grammians Lyapunov Equations Proposition 1. Suppose A is Hurwitz and Q is a square matrix. Then X = e AT s Qe As ds is the unique solution
More informationLecture 3: Review of Linear Algebra
ECE 83 Fall 2 Statistical Signal Processing instructor: R Nowak, scribe: R Nowak Lecture 3: Review of Linear Algebra Very often in this course we will represent signals as vectors and operators (eg, filters,
More informationECE504: Lecture 8. D. Richard Brown III. Worcester Polytechnic Institute. 28-Oct-2008
ECE504: Lecture 8 D. Richard Brown III Worcester Polytechnic Institute 28-Oct-2008 Worcester Polytechnic Institute D. Richard Brown III 28-Oct-2008 1 / 30 Lecture 8 Major Topics ECE504: Lecture 8 We are
More informationLinear ODEs. Existence of solutions to linear IVPs. Resolvent matrix. Autonomous linear systems
Linear ODEs p. 1 Linear ODEs Existence of solutions to linear IVPs Resolvent matrix Autonomous linear systems Linear ODEs Definition (Linear ODE) A linear ODE is a differential equation taking the form
More informationLINEAR ALGEBRA SUMMARY SHEET.
LINEAR ALGEBRA SUMMARY SHEET RADON ROSBOROUGH https://intuitiveexplanationscom/linear-algebra-summary-sheet/ This document is a concise collection of many of the important theorems of linear algebra, organized
More information1 Invariant subspaces
MATH 2040 Linear Algebra II Lecture Notes by Martin Li Lecture 8 Eigenvalues, eigenvectors and invariant subspaces 1 In previous lectures we have studied linear maps T : V W from a vector space V to another
More informationIdentification Methods for Structural Systems
Prof. Dr. Eleni Chatzi System Stability Fundamentals Overview System Stability Assume given a dynamic system with input u(t) and output x(t). The stability property of a dynamic system can be defined from
More information2. Review of Linear Algebra
2. Review of Linear Algebra ECE 83, Spring 217 In this course we will represent signals as vectors and operators (e.g., filters, transforms, etc) as matrices. This lecture reviews basic concepts from linear
More information2.3. VECTOR SPACES 25
2.3. VECTOR SPACES 25 2.3 Vector Spaces MATH 294 FALL 982 PRELIM # 3a 2.3. Let C[, ] denote the space of continuous functions defined on the interval [,] (i.e. f(x) is a member of C[, ] if f(x) is continuous
More informationMAT Linear Algebra Collection of sample exams
MAT 342 - Linear Algebra Collection of sample exams A-x. (0 pts Give the precise definition of the row echelon form. 2. ( 0 pts After performing row reductions on the augmented matrix for a certain system
More informationLecture 9: Vector Algebra
Lecture 9: Vector Algebra Linear combination of vectors Geometric interpretation Interpreting as Matrix-Vector Multiplication Span of a set of vectors Vector Spaces and Subspaces Linearly Independent/Dependent
More informationMathematics Review for Business PhD Students
Mathematics Review for Business PhD Students Anthony M. Marino Department of Finance and Business Economics Marshall School of Business Lecture 1: Introductory Material Sets The Real Number System Functions,
More informationL2 gains and system approximation quality 1
Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science 6.242, Fall 24: MODEL REDUCTION L2 gains and system approximation quality 1 This lecture discusses the utility
More informationLinear Algebra Lecture Notes-I
Linear Algebra Lecture Notes-I Vikas Bist Department of Mathematics Panjab University, Chandigarh-6004 email: bistvikas@gmail.com Last revised on February 9, 208 This text is based on the lectures delivered
More informationECE504: Lecture 10. D. Richard Brown III. Worcester Polytechnic Institute. 11-Nov-2008
ECE504: Lecture 10 D. Richard Brown III Worcester Polytechnic Institute 11-Nov-2008 Worcester Polytechnic Institute D. Richard Brown III 11-Nov-2008 1 / 25 Lecture 10 Major Topics We are finishing up Part
More informationA Second Course in Elementary Differential Equations
A Second Course in Elementary Differential Equations Marcel B Finan Arkansas Tech University c All Rights Reserved August 3, 23 Contents 28 Calculus of Matrix-Valued Functions of a Real Variable 4 29 nth
More informationME 234, Lyapunov and Riccati Problems. 1. This problem is to recall some facts and formulae you already know. e Aτ BB e A τ dτ
ME 234, Lyapunov and Riccati Problems. This problem is to recall some facts and formulae you already know. (a) Let A and B be matrices of appropriate dimension. Show that (A, B) is controllable if and
More informationNOTES on LINEAR ALGEBRA 1
School of Economics, Management and Statistics University of Bologna Academic Year 207/8 NOTES on LINEAR ALGEBRA for the students of Stats and Maths This is a modified version of the notes by Prof Laura
More information2.1 Sets. Definition 1 A set is an unordered collection of objects. Important sets: N, Z, Z +, Q, R.
2. Basic Structures 2.1 Sets Definition 1 A set is an unordered collection of objects. Important sets: N, Z, Z +, Q, R. Definition 2 Objects in a set are called elements or members of the set. A set is
More informationLinear Algebra. Preliminary Lecture Notes
Linear Algebra Preliminary Lecture Notes Adolfo J. Rumbos c Draft date May 9, 29 2 Contents 1 Motivation for the course 5 2 Euclidean n dimensional Space 7 2.1 Definition of n Dimensional Euclidean Space...........
More information1.4 Cardinality. Tom Lewis. Fall Term Tom Lewis () 1.4 Cardinality Fall Term / 9
1.4 Cardinality Tom Lewis Fall Term 2006 Tom Lewis () 1.4 Cardinality Fall Term 2006 1 / 9 Outline 1 Functions 2 Cardinality 3 Cantor s theorem Tom Lewis () 1.4 Cardinality Fall Term 2006 2 / 9 Functions
More information1. Foundations of Numerics from Advanced Mathematics. Linear Algebra
Foundations of Numerics from Advanced Mathematics Linear Algebra Linear Algebra, October 23, 22 Linear Algebra Mathematical Structures a mathematical structure consists of one or several sets and one or
More informationBalanced Truncation 1
Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science 6.242, Fall 2004: MODEL REDUCTION Balanced Truncation This lecture introduces balanced truncation for LTI
More informationLinear algebra and differential equations (Math 54): Lecture 10
Linear algebra and differential equations (Math 54): Lecture 10 Vivek Shende February 24, 2016 Hello and welcome to class! As you may have observed, your usual professor isn t here today. He ll be back
More informationCriteria for Determining If A Subset is a Subspace
These notes closely follow the presentation of the material given in David C. Lay s textbook Linear Algebra and its Applications (3rd edition). These notes are intended primarily for in-class presentation
More informationOnline Exercises for Linear Algebra XM511
This document lists the online exercises for XM511. The section ( ) numbers refer to the textbook. TYPE I are True/False. Lecture 02 ( 1.1) Online Exercises for Linear Algebra XM511 1) The matrix [3 2
More information1. General Vector Spaces
1.1. Vector space axioms. 1. General Vector Spaces Definition 1.1. Let V be a nonempty set of objects on which the operations of addition and scalar multiplication are defined. By addition we mean a rule
More informationALGEBRA QUALIFYING EXAM PROBLEMS LINEAR ALGEBRA
ALGEBRA QUALIFYING EXAM PROBLEMS LINEAR ALGEBRA Kent State University Department of Mathematical Sciences Compiled and Maintained by Donald L. White Version: August 29, 2017 CONTENTS LINEAR ALGEBRA AND
More informationFUNCTIONAL ANALYSIS-NORMED SPACE
MAT641- MSC Mathematics, MNIT Jaipur FUNCTIONAL ANALYSIS-NORMED SPACE DR. RITU AGARWAL MALAVIYA NATIONAL INSTITUTE OF TECHNOLOGY JAIPUR 1. Normed space Norm generalizes the concept of length in an arbitrary
More informationChapter 1. Preliminaries. The purpose of this chapter is to provide some basic background information. Linear Space. Hilbert Space.
Chapter 1 Preliminaries The purpose of this chapter is to provide some basic background information. Linear Space Hilbert Space Basic Principles 1 2 Preliminaries Linear Space The notion of linear space
More informationLinear Algebra. Preliminary Lecture Notes
Linear Algebra Preliminary Lecture Notes Adolfo J. Rumbos c Draft date April 29, 23 2 Contents Motivation for the course 5 2 Euclidean n dimensional Space 7 2. Definition of n Dimensional Euclidean Space...........
More informationReview 1 Math 321: Linear Algebra Spring 2010
Department of Mathematics and Statistics University of New Mexico Review 1 Math 321: Linear Algebra Spring 2010 This is a review for Midterm 1 that will be on Thursday March 11th, 2010. The main topics
More informationDS-GA 1002 Lecture notes 0 Fall Linear Algebra. These notes provide a review of basic concepts in linear algebra.
DS-GA 1002 Lecture notes 0 Fall 2016 Linear Algebra These notes provide a review of basic concepts in linear algebra. 1 Vector spaces You are no doubt familiar with vectors in R 2 or R 3, i.e. [ ] 1.1
More information21 Linear State-Space Representations
ME 132, Spring 25, UC Berkeley, A Packard 187 21 Linear State-Space Representations First, let s describe the most general type of dynamic system that we will consider/encounter in this class Systems may
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science : Dynamic Systems Spring 2011
MASSACHUSETTS INSTITUTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science 6.4: Dynamic Systems Spring Homework Solutions Exercise 3. a) We are given the single input LTI system: [
More informationLecture 1: Basic Concepts
ENGG 5781: Matrix Analysis and Computations Lecture 1: Basic Concepts 2018-19 First Term Instructor: Wing-Kin Ma This note is not a supplementary material for the main slides. I will write notes such as
More informationMathematics Review for Business PhD Students Lecture Notes
Mathematics Review for Business PhD Students Lecture Notes Anthony M. Marino Department of Finance and Business Economics Marshall School of Business University of Southern California Los Angeles, CA 90089-0804
More informationSept. 3, 2013 Math 3312 sec 003 Fall 2013
Sept. 3, 2013 Math 3312 sec 003 Fall 2013 Section 1.8: Intro to Linear Transformations Recall that the product Ax is a linear combination of the columns of A turns out to be a vector. If the columns of
More informationControl Systems. Frequency domain analysis. L. Lanari
Control Systems m i l e r p r a in r e v y n is o Frequency domain analysis L. Lanari outline introduce the Laplace unilateral transform define its properties show its advantages in turning ODEs to algebraic
More informationChapter 1 Vector Spaces
Chapter 1 Vector Spaces Per-Olof Persson persson@berkeley.edu Department of Mathematics University of California, Berkeley Math 110 Linear Algebra Vector Spaces Definition A vector space V over a field
More informationMATH 2331 Linear Algebra. Section 1.1 Systems of Linear Equations. Finding the solution to a set of two equations in two variables: Example 1: Solve:
MATH 2331 Linear Algebra Section 1.1 Systems of Linear Equations Finding the solution to a set of two equations in two variables: Example 1: Solve: x x = 3 1 2 2x + 4x = 12 1 2 Geometric meaning: Do these
More informationProblem 2 (Gaussian Elimination, Fundamental Spaces, Least Squares, Minimum Norm) Consider the following linear algebraic system of equations:
EEE58 Exam, Fall 6 AA Rodriguez Rules: Closed notes/books, No calculators permitted, open minds GWC 35, 965-37 Problem (Dynamic Augmentation: State Space Representation) Consider a dynamical system consisting
More informationVector Space Concepts
Vector Space Concepts ECE 174 Introduction to Linear & Nonlinear Optimization Ken Kreutz-Delgado ECE Department, UC San Diego Ken Kreutz-Delgado (UC San Diego) ECE 174 Fall 2016 1 / 25 Vector Space Theory
More informationSolutions for Math 225 Assignment #5 1
Solutions for Math 225 Assignment #5 1 (1) Find a polynomial f(x) of degree at most 3 satisfying that f(0) = 2, f( 1) = 1, f(1) = 3 and f(3) = 1. Solution. By Lagrange Interpolation, ( ) (x + 1)(x 1)(x
More informationGRE Subject test preparation Spring 2016 Topic: Abstract Algebra, Linear Algebra, Number Theory.
GRE Subject test preparation Spring 2016 Topic: Abstract Algebra, Linear Algebra, Number Theory. Linear Algebra Standard matrix manipulation to compute the kernel, intersection of subspaces, column spaces,
More informationPower Systems Control Prof. Wonhee Kim. Modeling in the Frequency and Time Domains
Power Systems Control Prof. Wonhee Kim Modeling in the Frequency and Time Domains Laplace Transform Review - Laplace transform - Inverse Laplace transform 2 Laplace Transform Review 3 Laplace Transform
More informationInfinite-Dimensional Triangularization
Infinite-Dimensional Triangularization Zachary Mesyan March 11, 2018 Abstract The goal of this paper is to generalize the theory of triangularizing matrices to linear transformations of an arbitrary vector
More informationA Primer in Econometric Theory
A Primer in Econometric Theory Lecture 1: Vector Spaces John Stachurski Lectures by Akshay Shanker May 5, 2017 1/104 Overview Linear algebra is an important foundation for mathematics and, in particular,
More informationSection 7.2: One-to-One, Onto and Inverse Functions
Section 7.2: One-to-One, Onto and Inverse Functions In this section we shall developed the elementary notions of one-to-one, onto and inverse functions, similar to that developed in a basic algebra course.
More informationME Fall 2001, Fall 2002, Spring I/O Stability. Preliminaries: Vector and function norms
I/O Stability Preliminaries: Vector and function norms 1. Sup norms are used for vectors for simplicity: x = max i x i. Other norms are also okay 2. Induced matrix norms: let A R n n, (i stands for induced)
More informationExercise Sheet 1.
Exercise Sheet 1 You can download my lecture and exercise sheets at the address http://sami.hust.edu.vn/giang-vien/?name=huynt 1) Let A, B be sets. What does the statement "A is not a subset of B " mean?
More informationNONCOMMUTATIVE POLYNOMIAL EQUATIONS. Edward S. Letzter. Introduction
NONCOMMUTATIVE POLYNOMIAL EQUATIONS Edward S Letzter Introduction My aim in these notes is twofold: First, to briefly review some linear algebra Second, to provide you with some new tools and techniques
More informationFunctional Analysis Exercise Class
Functional Analysis Exercise Class Week: December 4 8 Deadline to hand in the homework: your exercise class on week January 5. Exercises with solutions ) Let H, K be Hilbert spaces, and A : H K be a linear
More information4 Vector Spaces. 4.1 Basic Definition and Examples. Lecture 10
Lecture 10 4 Vector Spaces 4.1 Basic Definition and Examples Throughout mathematics we come across many types objects which can be added and multiplied by scalars to arrive at similar types of objects.
More informationOHSx XM511 Linear Algebra: Solutions to Online True/False Exercises
This document gives the solutions to all of the online exercises for OHSx XM511. The section ( ) numbers refer to the textbook. TYPE I are True/False. Answers are in square brackets [. Lecture 02 ( 1.1)
More informationControl Systems. Laplace domain analysis
Control Systems Laplace domain analysis L. Lanari outline introduce the Laplace unilateral transform define its properties show its advantages in turning ODEs to algebraic equations define an Input/Output
More informationMATH2210 Notebook 3 Spring 2018
MATH2210 Notebook 3 Spring 2018 prepared by Professor Jenny Baglivo c Copyright 2009 2018 by Jenny A. Baglivo. All Rights Reserved. 3 MATH2210 Notebook 3 3 3.1 Vector Spaces and Subspaces.................................
More informationLecture 1: Review of linear algebra
Lecture 1: Review of linear algebra Linear functions and linearization Inverse matrix, least-squares and least-norm solutions Subspaces, basis, and dimension Change of basis and similarity transformations
More informationInner product spaces. Layers of structure:
Inner product spaces Layers of structure: vector space normed linear space inner product space The abstract definition of an inner product, which we will see very shortly, is simple (and by itself is pretty
More informationECE504: Lecture 9. D. Richard Brown III. Worcester Polytechnic Institute. 04-Nov-2008
ECE504: Lecture 9 D. Richard Brown III Worcester Polytechnic Institute 04-Nov-2008 Worcester Polytechnic Institute D. Richard Brown III 04-Nov-2008 1 / 38 Lecture 9 Major Topics ECE504: Lecture 9 We are
More information6.241 Dynamic Systems and Control
6.241 Dynamic Systems and Control Lecture 12: I/O Stability Readings: DDV, Chapters 15, 16 Emilio Frazzoli Aeronautics and Astronautics Massachusetts Institute of Technology March 14, 2011 E. Frazzoli
More informationMANIFOLD STRUCTURES IN ALGEBRA
MANIFOLD STRUCTURES IN ALGEBRA MATTHEW GARCIA 1. Definitions Our aim is to describe the manifold structure on classical linear groups and from there deduce a number of results. Before we begin we make
More informationChapter 5. Linear Algebra. A linear (algebraic) equation in. unknowns, x 1, x 2,..., x n, is. an equation of the form
Chapter 5. Linear Algebra A linear (algebraic) equation in n unknowns, x 1, x 2,..., x n, is an equation of the form a 1 x 1 + a 2 x 2 + + a n x n = b where a 1, a 2,..., a n and b are real numbers. 1
More informationChapter 2. Vectors and Vector Spaces
2.1. Operations on Vectors 1 Chapter 2. Vectors and Vector Spaces Section 2.1. Operations on Vectors Note. In this section, we define several arithmetic operations on vectors (especially, vector addition
More informationSets and Functions. MATH 464/506, Real Analysis. J. Robert Buchanan. Summer Department of Mathematics. J. Robert Buchanan Sets and Functions
Sets and Functions MATH 464/506, Real Analysis J. Robert Buchanan Department of Mathematics Summer 2007 Notation x A means that element x is a member of set A. x / A means that x is not a member of A.
More informationChapter 2: Linear Independence and Bases
MATH20300: Linear Algebra 2 (2016 Chapter 2: Linear Independence and Bases 1 Linear Combinations and Spans Example 11 Consider the vector v (1, 1 R 2 What is the smallest subspace of (the real vector space
More informationIntroduction to Signal Spaces
Introduction to Signal Spaces Selin Aviyente Department of Electrical and Computer Engineering Michigan State University January 12, 2010 Motivation Outline 1 Motivation 2 Vector Space 3 Inner Product
More information6.241 Dynamic Systems and Control
6.241 Dynamic Systems and Control Lecture 7: State-space Models Readings: DDV, Chapters 7,8 Emilio Frazzoli Aeronautics and Astronautics Massachusetts Institute of Technology February 25, 2011 E. Frazzoli
More informationMA 2030 Linear Algebra and Numerical Analysis A V Jayanthan & Arindama Singh
MA 2030 Linear Algebra and Numerical Analysis A V Jayanthan & Arindama Singh January-May 2013 Information Lecture notes are available at Moodle site. It will be complete as far as material is concerned.
More informationx 3y 2z = 6 1.2) 2x 4y 3z = 8 3x + 6y + 8z = 5 x + 3y 2z + 5t = 4 1.5) 2x + 8y z + 9t = 9 3x + 5y 12z + 17t = 7
Linear Algebra and its Applications-Lab 1 1) Use Gaussian elimination to solve the following systems x 1 + x 2 2x 3 + 4x 4 = 5 1.1) 2x 1 + 2x 2 3x 3 + x 4 = 3 3x 1 + 3x 2 4x 3 2x 4 = 1 x + y + 2z = 4 1.4)
More information2. Dual space is essential for the concept of gradient which, in turn, leads to the variational analysis of Lagrange multipliers.
Chapter 3 Duality in Banach Space Modern optimization theory largely centers around the interplay of a normed vector space and its corresponding dual. The notion of duality is important for the following
More informationMATH 304 Linear Algebra Lecture 10: Linear independence. Wronskian.
MATH 304 Linear Algebra Lecture 10: Linear independence. Wronskian. Spanning set Let S be a subset of a vector space V. Definition. The span of the set S is the smallest subspace W V that contains S. If
More informationCountable and uncountable sets. Matrices.
CS 441 Discrete Mathematics for CS Lecture 11 Countable and uncountable sets. Matrices. Milos Hauskrecht milos@cs.pitt.edu 5329 Sennott Square Arithmetic series Definition: The sum of the terms of the
More informationCountable and uncountable sets. Matrices.
Lecture 11 Countable and uncountable sets. Matrices. Instructor: Kangil Kim (CSE) E-mail: kikim01@konkuk.ac.kr Tel. : 02-450-3493 Room : New Milenium Bldg. 1103 Lab : New Engineering Bldg. 1202 Next topic:
More informationSYSTEMTEORI - ÖVNING Stability of linear systems Exercise 3.1 (LTI system). Consider the following matrix:
SYSTEMTEORI - ÖVNING 3 1. Stability of linear systems Exercise 3.1 (LTI system. Consider the following matrix: ( A = 2 1 Use the Lyapunov method to determine if A is a stability matrix: a: in continuous
More informationModule 06 Stability of Dynamical Systems
Module 06 Stability of Dynamical Systems Ahmad F. Taha EE 5143: Linear Systems and Control Email: ahmad.taha@utsa.edu Webpage: http://engineering.utsa.edu/ataha October 10, 2017 Ahmad F. Taha Module 06
More informationAutonomous system = system without inputs
Autonomous system = system without inputs State space representation B(A,C) = {y there is x, such that σx = Ax, y = Cx } x is the state, n := dim(x) is the state dimension, y is the output Polynomial representation
More informationCourse Summary Math 211
Course Summary Math 211 table of contents I. Functions of several variables. II. R n. III. Derivatives. IV. Taylor s Theorem. V. Differential Geometry. VI. Applications. 1. Best affine approximations.
More information