The goal of this chapter is to study linear systems of ordinary differential equations: dt,..., dx ) T
|
|
- Jane Garrett
- 5 years ago
- Views:
Transcription
1 1 1 Linear Systems The goal of this chapter is to study linear systems of ordinary differential equations: ẋ = Ax, x(0) = x 0, (1) where x R n, A is an n n matrix and ẋ = dx ( dt = dx1 dt,..., dx ) T n. dt It will be shown that the unique solution of Eq. (1) is given by x(t) = e At x 0, where e At is an n n matrix defined by its Taylor series. A good portion of this chapter is concerned with the computation of e At in terms of the eigenvalues and eigenvectors of A.
2 2 1.1 Uncoupled Linear Systems Let s start the solution of the linear system (1) with the simplest case, where the system contains only one equation (i.e. n = 1): ẋ = ax, x(0) = c. The method of separation of variables immediately gives x(t) = c e at.
3 3 2 2 Uncoupled Systems: an Example To move one step forward, let s consider the following 2 2 uncoupled system: ẋ 1 = x 1, ẋ 2 = 2x 2, x 1 (0) = c 1, x 2 (0) = c 2. Its solution is easily found to be: x 1 (t) = c 1 e t, x 2 (t) = c 2 e 2t, or in matrix form: x(t) = [ e t 0 0 e 2t ] c =: e At c.
4 4 The General Case Clearly, the same procedure can be applied to solve uncoupled systems of any size. For example, the solution of the following 3 3 system: ẋ 1 = x 1, ẋ 2 = x 2, ẋ 3 = x 3, x 1 (0) = c 1, x 2 (0) = c 2, x 3 (0) = c 3. is given by x(t) = e t e t 0 c =: eat c. 0 0 e t
5 5 Phase Plane Analysis Before wrapping up this section, let s introduce some notations that will be useful in the study of the linear system ẋ = Ax. Let s first consider the 2 2 system: [ 1 0 ẋ = Ax, A = 0 2 ]. Recall it has the solution: x(t) = [ e t 0 0 e 2t ] c. Clearly, the above formula describes the dynamics of each of the system components x 1 and x 2.
6 6 Phase Portrait In many cases, however, we are interested in the dynamics of the entire system x = (x 1, x 2 ) T besides that of the individual components x 1 or x 2. To gain a better understanding of the entire system, we eliminate the variable t from the solution representation so that a single formula involving only x 1 and x 2 results: x 2 = c2 1c 2 x 2 1 For any fixed c 1, c 2, the above equation defines a curve in the x 1 x 2 -plane the so-called phase plane. The set of all solution curves for all possible values of c 1 and c 2 constitutes a phase portrait of the linear system ẋ = Ax..
7 7 The Phase Portrait of the 2 2 System The phase portrait of the 2 2 system is shown below. Figure 1: The phase portrait of the 2 2 system.
8 8 Vector Field The direction of the motion of the solution x = (x 1, x 2 ) T along the solution curves can be read off from the explicit formula x 1 (t) = c 1 e t, x 2 (t) = c 2 e 2t. On the other hand, it can also be directly determined from the right-hand side [ ] 1 0 f(x) = Ax = 0 2 x of the system, which defines a vector field on the phase plane. The vector field must be tangent to the solution curves at every point x on the phase plane.
9 9 The Vector Field of the 2 2 System The vector field of the 2 2 system is shown below. Figure 2: The vector field of the 2 2 system.
10 10 The Phase Portrait of the 3 3 System Similar analysis can be carried out for more general linear systems. For example, the following figure shows the phase portrait of the 3 3 system ẋ = Ax where A = diag[1, 1, 1]: Figure 3: The phase portrait of the 3 3 system.
11 Diagonalization In the last section, we have seen how to solve uncoupled linear systems of the form ẋ = Ax = diag[λ 1,...,λ n ]x. The purpose of this and the following sections is to develop solution techniques for general, coupled linear system where the matrix A is not necessarily diagonal. The key is to reduce A to its diagonal form, or in more general situations, to its Jordan form.
12 12 Matrices with Real Distinct Eigenvalues Let s start with the simple case where A has real, distinct eigenvalues. The following theorem provides the basis for the solution of the linear system ẋ = Ax. Theorem 1 If the eigenvalues λ 1, λ 2,...,λ n of an n n matrix A are real and distinct, then any set of corresponding eigenvectors {v 1,v 2,...,v n } forms a basis for R n, the matrix P = [v 1,v 2,...,v n ] is invertible and P 1 AP = diag[λ 1, λ 2,...,λ n ]. The proof of the theorem can be found in any standard linear algebra text, for example Lowenthal [Lo].
13 13 Matrices with Real Distinct Eigenvalues (Cont d) Using the above theorem, we may solve the linear system ẋ = Ax by introducing the change of variable: y = P 1 x. It reduces the original system to an uncoupled linear system: ẏ = diag[λ 1,...,λ n ]y, and the solution of the original system can then be easily found: x(t) = PE(t)P 1 x(0), where E(t) is the diagonal matrix E(t) = diag [ e λ 1t,...,e λ nt ].
14 14 Example As an example, consider the linear system ẋ 1 = x 1 3x 2, ẋ 2 = 2x 2, x 1 (0) = c 1, x 2 (0) = c 2. Using the procedure described above, the solution is found to be x 1 (t) = c 1 e t + c 2 (e t e 2t ), x 2 (t) = c 2 e 2t.
15 15 Example (Cont d) The phase portrait of the above system is shown below. Figure 4: The phase portrait of the example.
16 16 Stable and Unstable Subspaces Note that the subspaces spanned by the eigenvectors v 1 and v 2 of the matrix A determine the stable and unstable subspaces of the linear system ẋ = Ax, according to the following definition. Definition 2 Suppose that the n n matrix A has k negative eigenvalues λ 1,...,λ k and n k positive eigenvalues λ k+1,...,λ n and that these eigenvalues are distinct. Let {v 1,...,v n } be a corresponding set of eigenvectors. Then the stable and unstable subspaces of the linear system, E s and E u, are the linear subspaces spanned by {v 1,...,v k } and {v k+1,...,v n } respectively; i.e., E s = span{v 1,...,v k }, E u = span{v k+1,...,v n }.
17 Exponentials of Operators In the last section, we have seen how to solve the linear system ẋ = Ax when A has real distinct eigenvalues, or more generally when A is diagonalizable. The purpose of this and the following sections is to study the general case where A is not necessarily diagonalizable. The key is to define the matrix exponential e At and verify the identity d dt eat = Ae At.
18 18 Matrices as Linear Operators We shall define e At through the Taylor series e At = k=0 1 k! Ak t k, but first we need to make sure that the series converges in appropriate norms. To introduce a norm (i.e. a measure ) for an n n matrix A, we view it as a linear operator T that maps an element in R n (i.e. an n-vector) to another element in R n : T : R n R n, T(x) = Ax. It can be shown that the converse is also true, i.e. any linear operator that maps R m to R n can be identified with an n m matrix. So matrices are indeed synonyms for linear operators.
19 19 Operator Norm For a linear operator T : R n R n, we define the operator norm: T = sup x =0 T(x), x where x denotes the Euclidean norm of x R n : x = x x2 n. It can be readily verified that the operator norm has the following equivalent definitions: T = sup T(x) or T = sup T(x). x 1 x =1 Remark. The induced norm of the matrix representation A of the operator T is called the 2-norm of A.
20 20 Properties of the Operator Norm The operator norm has all of the usual properties of a norm, namely for any linear operators S, T : R n R n, (a) T 0 and T = 0 iff T = 0 (positive definiteness) (b) at = a T for any a R (positive homogeneity) (c) S + T S + T (triangle inequality or subadditivity) It can be shown that the space L(R n ) of linear operators T : R n R n equipped with the norm is a complete normed space, or in other words, a Banach space. The convergence of a sequence of operators T k L(R n ) can then be defined in terms of the norm.
21 21 Convergence in Operator Norm Definition 3 A sequence of linear operators T k L(R n ) is said to converge to a linear operator T L(R n ) as k, i.e., lim T k = T, k if for any ǫ > 0, there exists an N such that T T k < ǫ for all k N. Now we can show that the infinite Taylor series e Tt = k=0 1 k! T k t k, converges in the operator norm.
22 22 The Operator Exponential e Tt Theorem 4 Given T L(R n ) and t 0 > 0, the series e Tt := k=0 1 k! T k t k is absolutely and uniformly convergent for all t t 0. Moreover, e Tt e Tt. To prove this theorem, we need the following lemma. Lemma 5 For S, T L(R n ) and x R n, (a) T(x) T x (b) TS T S (c) T k T k for k = 0, 1, 2,...
23 23 The Matrix Exponential e At By identifying an n n matrix A with a linear operator T L(R n ) via the relation T(x) = Ax, we may define the matrix exponential e At as follows. Definition 6 Let A be an n n matrix. Then for t R, e At is the n n matrix defined by the Taylor series e At = k=0 1 k! Ak t k. As will be shown later, the matrix exponential e At can be computed in terms of the eigenvalues and eigenvectors of A.
24 24 Properties of the Matrix Exponential We next establish some basic properties of the operator exponential e T in order to facilitate the computation of the corresponding matrix exponential e A. Proposition 7 If P and T are linear operators on R n and S = PTP 1, then e S = Pe T P 1. Corollary 8 If P 1 AP = diag[λ j ], then e At = P diag[e λ jt ]P 1. Proposition 9 If S and T are linear operators on R n which commute, i.e., ST = TS, then e S+T = e S e T = e T e S. Corollary 10 If T is a linear operator on R n, the inverse of the linear operator e T is given by (e T ) 1 = e T.
25 25 Properties of the Matrix Exponential (Cont d) Corollary 11 (Complex Conjugate Eigenvalues) If [ ] a b A =, b a then e A = e a [ cosb sinb sinb cosb ]. Corollary 12 (Nontrivial Jordan Block) If [ ] a b A =, 0 a then e A = e a [ 1 b 0 1 ].
26 26 Matrix Exponential for 2 2 Matrices It will be shown in Section 1.8 that, for any 2 2 matrix A, there is an invertible 2 2 matrix P (whose columns consist of generalized eigenvectors of A) such that the matrix B = P 1 AP has one of the following forms: [ ] [ ] [ ] λ 0 λ 1 a b B =, B =, or B =. 0 µ 0 λ b a It then follows that e At = Pe Bt P 1 where [ ] [ e λt e Bt 0 1 t =, e Bt = e λt 0 e µt 0 1 [ ] cosb sinb or e Bt = e at. sinb cosb ],
Examples include: (a) the Lorenz system for climate and weather modeling (b) the Hodgkin-Huxley system for neuron modeling
1 Introduction Many natural processes can be viewed as dynamical systems, where the system is represented by a set of state variables and its evolution governed by a set of differential equations. Examples
More informationNORMS ON SPACE OF MATRICES
NORMS ON SPACE OF MATRICES. Operator Norms on Space of linear maps Let A be an n n real matrix and x 0 be a vector in R n. We would like to use the Picard iteration method to solve for the following system
More informationLinear ODEs. Existence of solutions to linear IVPs. Resolvent matrix. Autonomous linear systems
Linear ODEs p. 1 Linear ODEs Existence of solutions to linear IVPs Resolvent matrix Autonomous linear systems Linear ODEs Definition (Linear ODE) A linear ODE is a differential equation taking the form
More informationMath Ordinary Differential Equations
Math 411 - Ordinary Differential Equations Review Notes - 1 1 - Basic Theory A first order ordinary differential equation has the form x = f(t, x) (11) Here x = dx/dt Given an initial data x(t 0 ) = x
More informationDepartment of Mathematics IIT Guwahati
Stability of Linear Systems in R 2 Department of Mathematics IIT Guwahati A system of first order differential equations is called autonomous if the system can be written in the form dx 1 dt = g 1(x 1,
More information7 Planar systems of linear ODE
7 Planar systems of linear ODE Here I restrict my attention to a very special class of autonomous ODE: linear ODE with constant coefficients This is arguably the only class of ODE for which explicit solution
More informationLinear Algebra Practice Problems
Linear Algebra Practice Problems Math 24 Calculus III Summer 25, Session II. Determine whether the given set is a vector space. If not, give at least one axiom that is not satisfied. Unless otherwise stated,
More informationLinear Systems Notes for CDS-140a
Linear Systems Notes for CDS-140a October 27, 2008 1 Linear Systems Before beginning our study of linear dynamical systems, it only seems fair to ask the question why study linear systems? One might hope
More information21 Linear State-Space Representations
ME 132, Spring 25, UC Berkeley, A Packard 187 21 Linear State-Space Representations First, let s describe the most general type of dynamic system that we will consider/encounter in this class Systems may
More informationChapter 7. Canonical Forms. 7.1 Eigenvalues and Eigenvectors
Chapter 7 Canonical Forms 7.1 Eigenvalues and Eigenvectors Definition 7.1.1. Let V be a vector space over the field F and let T be a linear operator on V. An eigenvalue of T is a scalar λ F such that there
More informationDiagonalization. P. Danziger. u B = A 1. B u S.
7., 8., 8.2 Diagonalization P. Danziger Change of Basis Given a basis of R n, B {v,..., v n }, we have seen that the matrix whose columns consist of these vectors can be thought of as a change of basis
More informationThe following definition is fundamental.
1. Some Basics from Linear Algebra With these notes, I will try and clarify certain topics that I only quickly mention in class. First and foremost, I will assume that you are familiar with many basic
More informationDIAGONALIZABLE LINEAR SYSTEMS AND STABILITY. 1. Algebraic facts. We first recall two descriptions of matrix multiplication.
DIAGONALIZABLE LINEAR SYSTEMS AND STABILITY. 1. Algebraic facts. We first recall two descriptions of matrix multiplication. Let A be n n, P be n r, given by its columns: P = [v 1 v 2... v r ], where the
More informationJordan normal form notes (version date: 11/21/07)
Jordan normal form notes (version date: /2/7) If A has an eigenbasis {u,, u n }, ie a basis made up of eigenvectors, so that Au j = λ j u j, then A is diagonal with respect to that basis To see this, let
More informationNOTES ON LINEAR ODES
NOTES ON LINEAR ODES JONATHAN LUK We can now use all the discussions we had on linear algebra to study linear ODEs Most of this material appears in the textbook in 21, 22, 23, 26 As always, this is a preliminary
More informationINNER PRODUCT SPACE. Definition 1
INNER PRODUCT SPACE Definition 1 Suppose u, v and w are all vectors in vector space V and c is any scalar. An inner product space on the vectors space V is a function that associates with each pair of
More informationMA5510 Ordinary Differential Equation, Fall, 2014
MA551 Ordinary Differential Equation, Fall, 214 9/3/214 Linear systems of ordinary differential equations: Consider the first order linear equation for some constant a. The solution is given by such that
More informationDifferential Topology Final Exam With Solutions
Differential Topology Final Exam With Solutions Instructor: W. D. Gillam Date: Friday, May 20, 2016, 13:00 (1) Let X be a subset of R n, Y a subset of R m. Give the definitions of... (a) smooth function
More information1. The Transition Matrix (Hint: Recall that the solution to the linear equation ẋ = Ax + Bu is
ECE 55, Fall 2007 Problem Set #4 Solution The Transition Matrix (Hint: Recall that the solution to the linear equation ẋ Ax + Bu is x(t) e A(t ) x( ) + e A(t τ) Bu(τ)dτ () This formula is extremely important
More informationIn these chapter 2A notes write vectors in boldface to reduce the ambiguity of the notation.
1 2 Linear Systems In these chapter 2A notes write vectors in boldface to reduce the ambiguity of the notation 21 Matrix ODEs Let and is a scalar A linear function satisfies Linear superposition ) Linear
More informationControl Systems. Dynamic response in the time domain. L. Lanari
Control Systems Dynamic response in the time domain L. Lanari outline A diagonalizable - real eigenvalues (aperiodic natural modes) - complex conjugate eigenvalues (pseudoperiodic natural modes) - phase
More informationB5.6 Nonlinear Systems
B5.6 Nonlinear Systems 1. Linear systems Alain Goriely 2018 Mathematical Institute, University of Oxford Table of contents 1. Linear systems 1.1 Differential Equations 1.2 Linear flows 1.3 Linear maps
More informationA = 3 1. We conclude that the algebraic multiplicity of the eigenvalues are both one, that is,
65 Diagonalizable Matrices It is useful to introduce few more concepts, that are common in the literature Definition 65 The characteristic polynomial of an n n matrix A is the function p(λ) det(a λi) Example
More informationRemark By definition, an eigenvector must be a nonzero vector, but eigenvalue could be zero.
Sec 6 Eigenvalues and Eigenvectors Definition An eigenvector of an n n matrix A is a nonzero vector x such that A x λ x for some scalar λ A scalar λ is called an eigenvalue of A if there is a nontrivial
More information1. General Vector Spaces
1.1. Vector space axioms. 1. General Vector Spaces Definition 1.1. Let V be a nonempty set of objects on which the operations of addition and scalar multiplication are defined. By addition we mean a rule
More informationDynamic interpretation of eigenvectors
EE263 Autumn 2015 S. Boyd and S. Lall Dynamic interpretation of eigenvectors invariant sets complex eigenvectors & invariant planes left eigenvectors modal form discrete-time stability 1 Dynamic interpretation
More informationSolution of Linear State-space Systems
Solution of Linear State-space Systems Homogeneous (u=0) LTV systems first Theorem (Peano-Baker series) The unique solution to x(t) = (t, )x 0 where The matrix function is given by is called the state
More information2. Review of Linear Algebra
2. Review of Linear Algebra ECE 83, Spring 217 In this course we will represent signals as vectors and operators (e.g., filters, transforms, etc) as matrices. This lecture reviews basic concepts from linear
More informationLecture Notes for Math 524
Lecture Notes for Math 524 Dr Michael Y Li October 19, 2009 These notes are based on the lecture notes of Professor James S Muldowney, the books of Hale, Copple, Coddington and Levinson, and Perko They
More informationj=1 u 1jv 1j. 1/ 2 Lemma 1. An orthogonal set of vectors must be linearly independent.
Lecture Notes: Orthogonal and Symmetric Matrices Yufei Tao Department of Computer Science and Engineering Chinese University of Hong Kong taoyf@cse.cuhk.edu.hk Orthogonal Matrix Definition. Let u = [u
More informationLinear ODEs. Types of systems. Linear ODEs. Definition (Linear ODE) Linear ODEs. Existence of solutions to linear IVPs.
Linear ODEs Linear ODEs Existence of solutions to linear IVPs Resolvent matrix Autonomous linear systems p. 1 Linear ODEs Types of systems Definition (Linear ODE) A linear ODE is a ifferential equation
More information= A(λ, t)x. In this chapter we will focus on the case that the matrix A does not depend on time (so that the ODE is autonomous):
Chapter 2 Linear autonomous ODEs 2 Linearity Linear ODEs form an important class of ODEs They are characterized by the fact that the vector field f : R m R p R R m is linear at constant value of the parameters
More informationLecture Notes 6: Dynamic Equations Part C: Linear Difference Equation Systems
University of Warwick, EC9A0 Maths for Economists Peter J. Hammond 1 of 45 Lecture Notes 6: Dynamic Equations Part C: Linear Difference Equation Systems Peter J. Hammond latest revision 2017 September
More informationHomogeneous Linear Systems of Differential Equations with Constant Coefficients
Objective: Solve Homogeneous Linear Systems of Differential Equations with Constant Coefficients dx a x + a 2 x 2 + + a n x n, dx 2 a 2x + a 22 x 2 + + a 2n x n,. dx n = a n x + a n2 x 2 + + a nn x n.
More informationEntrance Exam, Differential Equations April, (Solve exactly 6 out of the 8 problems) y + 2y + y cos(x 2 y) = 0, y(0) = 2, y (0) = 4.
Entrance Exam, Differential Equations April, 7 (Solve exactly 6 out of the 8 problems). Consider the following initial value problem: { y + y + y cos(x y) =, y() = y. Find all the values y such that the
More informationHomogeneous and particular LTI solutions
Homogeneous and particular LTI solutions Daniele Carnevale Dipartimento di Ing. Civile ed Ing. Informatica (DICII), University of Rome Tor Vergata Fondamenti di Automatica e Controlli Automatici A.A. 2014-2015
More informationDIAGONALIZATION. In order to see the implications of this definition, let us consider the following example Example 1. Consider the matrix
DIAGONALIZATION Definition We say that a matrix A of size n n is diagonalizable if there is a basis of R n consisting of eigenvectors of A ie if there are n linearly independent vectors v v n such that
More informationLecture 5. Ch. 5, Norms for vectors and matrices. Norms for vectors and matrices Why?
KTH ROYAL INSTITUTE OF TECHNOLOGY Norms for vectors and matrices Why? Lecture 5 Ch. 5, Norms for vectors and matrices Emil Björnson/Magnus Jansson/Mats Bengtsson April 27, 2016 Problem: Measure size of
More information6 Linear Equation. 6.1 Equation with constant coefficients
6 Linear Equation 6.1 Equation with constant coefficients Consider the equation ẋ = Ax, x R n. This equating has n independent solutions. If the eigenvalues are distinct then the solutions are c k e λ
More informationSYSTEMTEORI - ÖVNING 1. In this exercise, we will learn how to solve the following linear differential equation:
SYSTEMTEORI - ÖVNING 1 GIANANTONIO BORTOLIN AND RYOZO NAGAMUNE In this exercise, we will learn how to solve the following linear differential equation: 01 ẋt Atxt, xt 0 x 0, xt R n, At R n n The equation
More informationDifferential Equations and Modeling
Differential Equations and Modeling Preliminary Lecture Notes Adolfo J. Rumbos c Draft date: March 22, 2018 March 22, 2018 2 Contents 1 Preface 5 2 Introduction to Modeling 7 2.1 Constructing Models.........................
More informationMath 3191 Applied Linear Algebra
Math 9 Applied Linear Algebra Lecture 9: Diagonalization Stephen Billups University of Colorado at Denver Math 9Applied Linear Algebra p./9 Section. Diagonalization The goal here is to develop a useful
More informationEcon Lecture 14. Outline
Econ 204 2010 Lecture 14 Outline 1. Differential Equations and Solutions 2. Existence and Uniqueness of Solutions 3. Autonomous Differential Equations 4. Complex Exponentials 5. Linear Differential Equations
More informationArchive of past papers, solutions and homeworks for. MATH 224, Linear Algebra 2, Spring 2013, Laurence Barker
Archive of past papers, solutions and homeworks for MATH 224, Linear Algebra 2, Spring 213, Laurence Barker version: 4 June 213 Source file: archfall99.tex page 2: Homeworks. page 3: Quizzes. page 4: Midterm
More informationRemark 1 By definition, an eigenvector must be a nonzero vector, but eigenvalue could be zero.
Sec 5 Eigenvectors and Eigenvalues In this chapter, vector means column vector Definition An eigenvector of an n n matrix A is a nonzero vector x such that A x λ x for some scalar λ A scalar λ is called
More informationMTH 2032 SemesterII
MTH 202 SemesterII 2010-11 Linear Algebra Worked Examples Dr. Tony Yee Department of Mathematics and Information Technology The Hong Kong Institute of Education December 28, 2011 ii Contents Table of Contents
More informationRecall : Eigenvalues and Eigenvectors
Recall : Eigenvalues and Eigenvectors Let A be an n n matrix. If a nonzero vector x in R n satisfies Ax λx for a scalar λ, then : The scalar λ is called an eigenvalue of A. The vector x is called an eigenvector
More informationDefinition: An n x n matrix, "A", is said to be diagonalizable if there exists a nonsingular matrix "X" and a diagonal matrix "D" such that X 1 A X
DIGONLIZTION Definition: n n x n matrix, "", is said to be diagonalizable if there exists a nonsingular matrix "X" and a diagonal matrix "D" such that X X D. Theorem: n n x n matrix, "", is diagonalizable
More informationLecture 3: Review of Linear Algebra
ECE 83 Fall 2 Statistical Signal Processing instructor: R Nowak, scribe: R Nowak Lecture 3: Review of Linear Algebra Very often in this course we will represent signals as vectors and operators (eg, filters,
More informationVector Spaces. Vector space, ν, over the field of complex numbers, C, is a set of elements a, b,..., satisfying the following axioms.
Vector Spaces Vector space, ν, over the field of complex numbers, C, is a set of elements a, b,..., satisfying the following axioms. For each two vectors a, b ν there exists a summation procedure: a +
More informationLinear Algebra- Final Exam Review
Linear Algebra- Final Exam Review. Let A be invertible. Show that, if v, v, v 3 are linearly independent vectors, so are Av, Av, Av 3. NOTE: It should be clear from your answer that you know the definition.
More informationB. Differential Equations A differential equation is an equation of the form
B Differential Equations A differential equation is an equation of the form ( n) F[ t; x(, xʹ (, x ʹ ʹ (, x ( ; α] = 0 dx d x ( n) d x where x ʹ ( =, x ʹ ʹ ( =,, x ( = n A differential equation describes
More informationAN ITERATION. In part as motivation, we consider an iteration method for solving a system of linear equations which has the form x Ax = b
AN ITERATION In part as motivation, we consider an iteration method for solving a system of linear equations which has the form x Ax = b In this, A is an n n matrix and b R n.systemsof this form arise
More informationLinear System Theory
Linear System Theory Wonhee Kim Lecture 4 Apr. 4, 2018 1 / 40 Recap Vector space, linear space, linear vector space Subspace Linearly independence and dependence Dimension, Basis, Change of Basis 2 / 40
More information1 Math 241A-B Homework Problem List for F2015 and W2016
1 Math 241A-B Homework Problem List for F2015 W2016 1.1 Homework 1. Due Wednesday, October 7, 2015 Notation 1.1 Let U be any set, g be a positive function on U, Y be a normed space. For any f : U Y let
More informationChapter III. Stability of Linear Systems
1 Chapter III Stability of Linear Systems 1. Stability and state transition matrix 2. Time-varying (non-autonomous) systems 3. Time-invariant systems 1 STABILITY AND STATE TRANSITION MATRIX 2 In this chapter,
More information16. Local theory of regular singular points and applications
16. Local theory of regular singular points and applications 265 16. Local theory of regular singular points and applications In this section we consider linear systems defined by the germs of meromorphic
More informationHilbert Spaces. Hilbert space is a vector space with some extra structure. We start with formal (axiomatic) definition of a vector space.
Hilbert Spaces Hilbert space is a vector space with some extra structure. We start with formal (axiomatic) definition of a vector space. Vector Space. Vector space, ν, over the field of complex numbers,
More informationPutzer s Algorithm. Norman Lebovitz. September 8, 2016
Putzer s Algorithm Norman Lebovitz September 8, 2016 1 Putzer s algorithm The differential equation dx = Ax, (1) dt where A is an n n matrix of constants, possesses the fundamental matrix solution exp(at),
More informationQuadratic forms. Here. Thus symmetric matrices are diagonalizable, and the diagonalization can be performed by means of an orthogonal matrix.
Quadratic forms 1. Symmetric matrices An n n matrix (a ij ) n ij=1 with entries on R is called symmetric if A T, that is, if a ij = a ji for all 1 i, j n. We denote by S n (R) the set of all n n symmetric
More informationAN ELEMENTARY PROOF OF THE SPECTRAL RADIUS FORMULA FOR MATRICES
AN ELEMENTARY PROOF OF THE SPECTRAL RADIUS FORMULA FOR MATRICES JOEL A. TROPP Abstract. We present an elementary proof that the spectral radius of a matrix A may be obtained using the formula ρ(a) lim
More informationLinear Algebra II Lecture 13
Linear Algebra II Lecture 13 Xi Chen 1 1 University of Alberta November 14, 2014 Outline 1 2 If v is an eigenvector of T : V V corresponding to λ, then v is an eigenvector of T m corresponding to λ m since
More informationMATH 2921 VECTOR CALCULUS AND DIFFERENTIAL EQUATIONS LINEAR SYSTEMS NOTES
MATH 9 VECTOR CALCULUS AND DIFFERENTIAL EQUATIONS LINEAR SYSTEMS NOTES R MARANGELL Contents. Higher Order ODEs and First Order Systems: One and the Same. Some First Examples 5 3. Matrix ODEs 6 4. Diagonalization
More informationDS-GA 1002 Lecture notes 0 Fall Linear Algebra. These notes provide a review of basic concepts in linear algebra.
DS-GA 1002 Lecture notes 0 Fall 2016 Linear Algebra These notes provide a review of basic concepts in linear algebra. 1 Vector spaces You are no doubt familiar with vectors in R 2 or R 3, i.e. [ ] 1.1
More informationLINEAR ALGEBRA MICHAEL PENKAVA
LINEAR ALGEBRA MICHAEL PENKAVA 1. Linear Maps Definition 1.1. If V and W are vector spaces over the same field K, then a map λ : V W is called a linear map if it satisfies the two conditions below: (1)
More informationInvariant Manifolds of Dynamical Systems and an application to Space Exploration
Invariant Manifolds of Dynamical Systems and an application to Space Exploration Mateo Wirth January 13, 2014 1 Abstract In this paper we go over the basics of stable and unstable manifolds associated
More informationLinear Algebra 2 Spectral Notes
Linear Algebra 2 Spectral Notes In what follows, V is an inner product vector space over F, where F = R or C. We will use results seen so far; in particular that every linear operator T L(V ) has a complex
More informationDifferential equations
Differential equations Math 7 Spring Practice problems for April Exam Problem Use the method of elimination to find the x-component of the general solution of x y = 6x 9x + y = x 6y 9y Soln: The system
More informationEcon 204 Supplement to Section 3.6 Diagonalization and Quadratic Forms. 1 Diagonalization and Change of Basis
Econ 204 Supplement to Section 3.6 Diagonalization and Quadratic Forms De La Fuente notes that, if an n n matrix has n distinct eigenvalues, it can be diagonalized. In this supplement, we will provide
More informationOrdinary Differential Equations II
Ordinary Differential Equations II February 23 2017 Separation of variables Wave eq. (PDE) 2 u t (t, x) = 2 u 2 c2 (t, x), x2 c > 0 constant. Describes small vibrations in a homogeneous string. u(t, x)
More information0.1 Rational Canonical Forms
We have already seen that it is useful and simpler to study linear systems using matrices. But matrices are themselves cumbersome, as they are stuffed with many entries, and it turns out that it s best
More informationUniversity of Colorado at Denver Mathematics Department Applied Linear Algebra Preliminary Exam With Solutions 16 January 2009, 10:00 am 2:00 pm
University of Colorado at Denver Mathematics Department Applied Linear Algebra Preliminary Exam With Solutions 16 January 2009, 10:00 am 2:00 pm Name: The proctor will let you read the following conditions
More informationMATH JORDAN FORM
MATH 53 JORDAN FORM Let A,, A k be square matrices of size n,, n k, respectively with entries in a field F We define the matrix A A k of size n = n + + n k as the block matrix A 0 0 0 0 A 0 0 0 0 A k It
More informationLINEAR ALGEBRA 1, 2012-I PARTIAL EXAM 3 SOLUTIONS TO PRACTICE PROBLEMS
LINEAR ALGEBRA, -I PARTIAL EXAM SOLUTIONS TO PRACTICE PROBLEMS Problem (a) For each of the two matrices below, (i) determine whether it is diagonalizable, (ii) determine whether it is orthogonally diagonalizable,
More informationMCE693/793: Analysis and Control of Nonlinear Systems
MCE693/793: Analysis and Control of Nonlinear Systems Systems of Differential Equations Phase Plane Analysis Hanz Richter Mechanical Engineering Department Cleveland State University Systems of Nonlinear
More informationEK102 Linear Algebra PRACTICE PROBLEMS for Final Exam Spring 2016
EK102 Linear Algebra PRACTICE PROBLEMS for Final Exam Spring 2016 Answer the questions in the spaces provided on the question sheets. You must show your work to get credit for your answers. There will
More informationV 1 V 2. r 3. r 6 r 4. Math 2250 Lab 12 Due Date : 4/25/2017 at 6:00pm
Math 50 Lab 1 Name: Due Date : 4/5/017 at 6:00pm 1. In the previous lab you considered the input-output model below with pure water flowing into the system, C 1 = C 5 =0. r 1, C 1 r 5, C 5 r r V 1 V r
More informationMATH 20F: LINEAR ALGEBRA LECTURE B00 (T. KEMP)
MATH 20F: LINEAR ALGEBRA LECTURE B00 (T KEMP) Definition 01 If T (x) = Ax is a linear transformation from R n to R m then Nul (T ) = {x R n : T (x) = 0} = Nul (A) Ran (T ) = {Ax R m : x R n } = {b R m
More information1. Foundations of Numerics from Advanced Mathematics. Linear Algebra
Foundations of Numerics from Advanced Mathematics Linear Algebra Linear Algebra, October 23, 22 Linear Algebra Mathematical Structures a mathematical structure consists of one or several sets and one or
More informationLecture 3: Review of Linear Algebra
ECE 83 Fall 2 Statistical Signal Processing instructor: R Nowak Lecture 3: Review of Linear Algebra Very often in this course we will represent signals as vectors and operators (eg, filters, transforms,
More informationLecture 4. Chapter 4: Lyapunov Stability. Eugenio Schuster. Mechanical Engineering and Mechanics Lehigh University.
Lecture 4 Chapter 4: Lyapunov Stability Eugenio Schuster schuster@lehigh.edu Mechanical Engineering and Mechanics Lehigh University Lecture 4 p. 1/86 Autonomous Systems Consider the autonomous system ẋ
More informationREPRESENTATION THEORY WEEK 7
REPRESENTATION THEORY WEEK 7 1. Characters of L k and S n A character of an irreducible representation of L k is a polynomial function constant on every conjugacy class. Since the set of diagonalizable
More informationSystems of Linear ODEs
P a g e 1 Systems of Linear ODEs Systems of ordinary differential equations can be solved in much the same way as discrete dynamical systems if the differential equations are linear. We will focus here
More informationEcon 204 Differential Equations. 1 Existence and Uniqueness of Solutions
Econ 4 Differential Equations In this supplement, we use the methods we have developed so far to study differential equations. 1 Existence and Uniqueness of Solutions Definition 1 A differential equation
More informationLMI Methods in Optimal and Robust Control
LMI Methods in Optimal and Robust Control Matthew M. Peet Arizona State University Lecture 4: LMIs for State-Space Internal Stability Solving the Equations Find the output given the input State-Space:
More informationx 3y 2z = 6 1.2) 2x 4y 3z = 8 3x + 6y + 8z = 5 x + 3y 2z + 5t = 4 1.5) 2x + 8y z + 9t = 9 3x + 5y 12z + 17t = 7
Linear Algebra and its Applications-Lab 1 1) Use Gaussian elimination to solve the following systems x 1 + x 2 2x 3 + 4x 4 = 5 1.1) 2x 1 + 2x 2 3x 3 + x 4 = 3 3x 1 + 3x 2 4x 3 2x 4 = 1 x + y + 2z = 4 1.4)
More information22.2. Applications of Eigenvalues and Eigenvectors. Introduction. Prerequisites. Learning Outcomes
Applications of Eigenvalues and Eigenvectors 22.2 Introduction Many applications of matrices in both engineering and science utilize eigenvalues and, sometimes, eigenvectors. Control theory, vibration
More informationTHEODORE VORONOV DIFFERENTIABLE MANIFOLDS. Fall Last updated: November 26, (Under construction.)
4 Vector fields Last updated: November 26, 2009. (Under construction.) 4.1 Tangent vectors as derivations After we have introduced topological notions, we can come back to analysis on manifolds. Let M
More informationMATH 304 Linear Algebra Lecture 20: The Gram-Schmidt process (continued). Eigenvalues and eigenvectors.
MATH 304 Linear Algebra Lecture 20: The Gram-Schmidt process (continued). Eigenvalues and eigenvectors. Orthogonal sets Let V be a vector space with an inner product. Definition. Nonzero vectors v 1,v
More informationsystems of linear di erential If the homogeneous linear di erential system is diagonalizable,
G. NAGY ODE October, 8.. Homogeneous Linear Differential Systems Section Objective(s): Linear Di erential Systems. Diagonalizable Systems. Real Distinct Eigenvalues. Complex Eigenvalues. Repeated Eigenvalues.
More information1.1 Limits and Continuity. Precise definition of a limit and limit laws. Squeeze Theorem. Intermediate Value Theorem. Extreme Value Theorem.
STATE EXAM MATHEMATICS Variant A ANSWERS AND SOLUTIONS 1 1.1 Limits and Continuity. Precise definition of a limit and limit laws. Squeeze Theorem. Intermediate Value Theorem. Extreme Value Theorem. Definition
More informationNumerical Linear Algebra
University of Alabama at Birmingham Department of Mathematics Numerical Linear Algebra Lecture Notes for MA 660 (1997 2014) Dr Nikolai Chernov April 2014 Chapter 0 Review of Linear Algebra 0.1 Matrices
More informationMATH 215/255 Solutions to Additional Practice Problems April dy dt
. For the nonlinear system MATH 5/55 Solutions to Additional Practice Problems April 08 dx dt = x( x y, dy dt = y(.5 y x, x 0, y 0, (a Show that if x(0 > 0 and y(0 = 0, then the solution (x(t, y(t of the
More informationNotions such as convergent sequence and Cauchy sequence make sense for any metric space. Convergent Sequences are Cauchy
Banach Spaces These notes provide an introduction to Banach spaces, which are complete normed vector spaces. For the purposes of these notes, all vector spaces are assumed to be over the real numbers.
More informationYORK UNIVERSITY. Faculty of Science Department of Mathematics and Statistics MATH M Test #2 Solutions
YORK UNIVERSITY Faculty of Science Department of Mathematics and Statistics MATH 3. M Test # Solutions. (8 pts) For each statement indicate whether it is always TRUE or sometimes FALSE. Note: For this
More information1. Matrix multiplication and Pauli Matrices: Pauli matrices are the 2 2 matrices. 1 0 i 0. 0 i
Problems in basic linear algebra Science Academies Lecture Workshop at PSGRK College Coimbatore, June 22-24, 2016 Govind S. Krishnaswami, Chennai Mathematical Institute http://www.cmi.ac.in/~govind/teaching,
More informationNotes on uniform convergence
Notes on uniform convergence Erik Wahlén erik.wahlen@math.lu.se January 17, 2012 1 Numerical sequences We begin by recalling some properties of numerical sequences. By a numerical sequence we simply mean
More informationLINEAR ALGEBRA QUESTION BANK
LINEAR ALGEBRA QUESTION BANK () ( points total) Circle True or False: TRUE / FALSE: If A is any n n matrix, and I n is the n n identity matrix, then I n A = AI n = A. TRUE / FALSE: If A, B are n n matrices,
More information2. Every linear system with the same number of equations as unknowns has a unique solution.
1. For matrices A, B, C, A + B = A + C if and only if A = B. 2. Every linear system with the same number of equations as unknowns has a unique solution. 3. Every linear system with the same number of equations
More informationIMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET
IMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET This is a (not quite comprehensive) list of definitions and theorems given in Math 1553. Pay particular attention to the ones in red. Study Tip For each
More information