= AΦ, Φ(0) = I, = k! tk A k = I + ta t2 A t3 A t4 A 4 +, (3) e ta 1
|
|
- Curtis Stevenson
- 5 years ago
- Views:
Transcription
1 Matrix Exponentials Math 26, Fall 200, Professor David Levermore We now consider the homogeneous constant coefficient, vector-valued initial-value problem dx (1) = Ax, x(t I) = x I, where A is a constant n n real matrix A special fundamental matrix associated with this problem is the solution Φ(t) of the matrix-valued initial-value problem dφ (2) = AΦ, Φ(0) = I, where I is the n n identity matrix We assert that Φ(t) satisfies (i) Φ(t + s) = Φ(t)Φ(s) for every t and s in R, (ii) Φ(t)Φ( t) = I for every t in R Assertion (i) follows because both sides satisfy the matrix-valued initial-value problem dψ = AΨ, Ψ(0) = Φ(s), and are therefore equal Assertion (ii) follows by setting s = t in assertion (i) and using the fact Φ(0) = I The fundamental matrix Φ(t) is therefore called the exponential of A and is commonly denoted as either e ta or exp(ta) It is easy to check that the solution of the initial-value problem (1) is given by x(t) = e (t ti)a x I The Taylor expansion of e ta about t = 0 is () e ta 1 = k! tk A k = I + ta t2 A t A t A +, k=0 where we define A 0 = I Recall that the Taylor expansion of e at is e at 1 = k! ak t k = 1 + at a2 t a t a t + k=0 Motivated by this fact, the book defines e ta by the infinite series () Matrix KEY Identity Given any polynomial p(z) = π 0 z m + π 1 z m π m 1 z + π m and any n n matrix A we define the n n matrix p(a) by p(a) = π 0 A m + π 1 A m π m 1 A + π m I Because for every nonnegative integer k one has d k = A k e ta, keta it follows from the definition of p(a) that d () p e ta = p(a)e ta This is the matrix version of the KEY identity Just as the scalar KEY identity allowed us to construct explicit solutions to higher-order linear differential equations with constant coefficients, the matrix KEY identity allows us to construct explicit solutions to first-order linear differential systems with a constant coefficient matrix 1
2 2 Computing the Matrix Exponential Given any n n matrix A, there are many ways to compute e At that are easier than evaluating the infinite series () The book gives a method that is based on computing the eigenvectors and (sometimes) the generalized eigenvectors of the matrix A This method requires a different approach depending on whether the eigenvalues of the real matrix A are real, complex conjugate, or have multiplicity greater than one These approaches are covered in Sections 75, 76, and 78, but these sections do not cover all the possible cases that can arise Here we will give a different method that covers all possible cases with a single approach Moreover, this method is generally much faster to carry out than the book s method when n is not too large This method begins by identifying a polynomial p(z) such that p(a) = 0 Such a polynomial is said to annihilate A The Cayley-Hamiltion Theorem states that one such polynomial is the characteristic polynomial of A, which we define by (5) p A (z) = det(iz A) This polyinomial has degree n Because det(zi A) = ( 1) n det(a zi), this definition of p A (z) coincides with the book s definition when n is even, and is its negative when n is odd Both conventions are common We have chosen the convention that makes p A (z) monic What matters most about p A (z) is its roots and their multiplicity, which are the same for both conventions These roots are called the eigenvalues of A The Cayley-Hamiltion Theorem states that (6) p A (A) = 0 We will not prove this for general n n matrices However, it is easy to verify for 2 2 matrices by a direct calculation Consider the general 2 2 matrix a11 a A = 12 a 21 a 22 Its characteristic polynomial is z a11 a p A (z) = det(iz A) = det 12 a 21 z a 22 = (z a 11 )(z a 22 ) a 21 a 12 = z 2 (a 11 + a 22 )z + (a 11 a 22 a 21 a 12 ) = z 2 tr(a)z + det(a), where tr(a) = a 11 + a 22 is the trace of A Then a direct calculation shows that p A (A) = A 2 (a 11 + a 22 )A + (a 11 a 22 a 21 a 12 )I 2 a11 a = 12 a11 a (a a 21 a 11 + a 22 ) 12 + (a 22 a 21 a 11 a 22 a 21 a 12 ) 22 a 2 = 11 + a 12 a 21 (a 11 + a 22 )a 12 (a 11 + a 22 )a 21 a 21 a 12 + a22 2 a11 a + 22 a 21 a a 11 a 22 a 21 a 12 = 0, which verifies (6) for 2 2 matrices (a11 + a 22 )a 11 (a 11 + a 22 )a 12 (a 11 + a 22 )a 21 (a 11 + a 22 )a 22
3 By the above paragraph, you can always find a polynomial p(z) of degree m n that annihilates A For this polynomial, we see from the matrix KEY identity () that d p e ta = p(a)e ta = 0 This means that each entry of e ta is a solution of the m th -order scalar homogeneous linear differential equation with constant coefficients d (7) p y = 0 If y 1 (t), y 1 (t),, y m (t) is a fundamental set of solutions to this equation then a general solution of it is y = c j y j (t), where c 1, c 2,, c m are arbitrary constants It follows that e ta must have the form (8) e ta = C j y j (t), where C 1, C 2,, C m are arbitrary n n constant matrices The constant matrices C 1, C 2,, C m may be determined by taking derivatives of (8) with respect to t and evaluating them at t = 0 The k th derivative of (8) evaluated at t = 0 gives () A k = C j y (k) j (0) Because y 1 (t), y 1 (t),, y m (t) is a fundamental set of solutions to (7), the constant matrices C 1, C 2,, C m are determined by () for k = 0, 1,, m 1 For example, if p(z) has m simple roots λ 1, λ 2,, λ m, then one can choose the fundamental set of solutions to (7) given by y j (t) = e λ jt, for j = 1, 2,, m Then (8) becomes the system of m linear equations (10) A k = C j λj k, for k = 0, 1,, m 1 This system may be solved for the constant matrices C 1, C 2,, C m, and the result placed into (8) to obtain e ta = C j e λjt Example Compute e ta for A = 2 2 Solution Because A is 2 2, its characteristic polynomial is p(z) = det(iz A) = z 2 tr(a)z + det(a) = z 2 6z + 5 = (z 1)(z 5)
4 Its roots are 1 and 5 System (10) then becomes I = C 1 + C 2, A = C 1 + 5C 2 This system can be easily solved to find 2 2 C 1 = 1(5I A) = C 2 = 1 (A I) = Formula (8) then yields e ta = C 1 e t + C 2 e 5t = 1 2 = 1 2 = , e t + e 5t e 5t e t e 5t e t e t + e 5t Exponentials of Two-by-Two Matrices There are simple formulas for the exponential of a general 2 2 real matrix a11 a A = 12 a 21 a 22 Because A is 2 2, its characteristic polynomial is Upon completing the square we see that p(z) = det(iz A) = z 2 tr(a)z + det(a) p(z) = (z µ) 2 δ, where the mean µ and discriminant δ are given by µ = tr(a), δ = tr(a)2 det(a) 2 There are three cases which are distinguished by the sign of δ If δ > 0 then p(z) has the simple real roots µ and µ + where = δ In this case [ (11) e ta = e µt I cosh(t) + (A µi) sinh(t) ] If δ < 0 then p(z) has the complex conjugate roots µ i and µ+i where = δ In this case [ (12) e ta = e µt I cos(t) + (A µi) sin(t) ] If δ = 0 then p(z) has the double real root µ In this case (1) e ta = e µt[ I + (A µi)t ] For 2 2 matrices you will find it faster to apply these formulas than to set-up and solve for C 1 and C 2 These formulas are eazy to remember Notice that formulas (11) and (12) are similar the first uses hyperbolic functions when p(z) has simple real roots, while the second uses trigonometric functions when p(z) has complex conjugate roots Formula (1) is the limiting case of both (11) and (12) as 0
5 5 Example Compute e ta for A = 2 2 Solution Because A is 2 2, its characteristic polynomial is p(z) = det(iz A) = z 2 tr(a)z + det(a) = z 2 6z + 5 = (z ) 2 It has the real roots ± 2 By (11) with µ = and = 2 we see that [ e ta = e t I cosh(2t) + (A I) sinh(2t) ] 2 [ ] = e t cosh(2t) + sinh(2t) cosh(2t) sinh(2t) = e t sinh(2t) cosh(2t) Example Compute e ta for A = Solution Because A is 2 2, its characteristic polynomial is p(z) = det(iz A) = z 2 tr(a)z + det(a) = z 2 z + 1 = (z 2) It has the conjugate roots 2 ± i By (12) with µ = 2 and = we see that [ e ta = e 2t I cos(t) + (A 2I) sin(t) ] [ ] sin(t) = e 2t cos(t) ( cos(2t) + = e 2t sin(t) 5 sin(t) ) 5 sin(t) cos(t) sin(t) Use of Natural Fundamental Sets The natural fundamental set of solutions to (7) are the solutions y 1 (t), y 1 (t),, y m (t) such that for each j = 1, 2,, m the solution y j (t) satifies the initial conditions (1) y (k 1) j (0) = δ jk for k = 1, 2,, m where δ jk is the Kronecker delta, which is defined by { 1 when j = k, δ jk = 0 when j k If y 1 (t), y 1 (t),, y m (t) is the natural fundamental set of solutions to (7) then () with k 1 replacing k becomes A k 1 = C j y (k 1) j (0) = C j δ jk = C k for k = 1, 2,, m
6 6 In that case (8) becomes (15) e ta = A j 1 y j (t), If the natural fundamental set of solutions to (7) is either known or easily found then this is the shortest route to computing e ta when m is not too large Example Compute e ta for A = Solution The characteristic polynomial of A is p(z) = det(iz A) = det z z 2 = z + + z + z + z 1 2 z = z + z = z(z 2 + ) Its roots are 0, ±i The associated higher-order equation is d y + dy = 0 By (10) its natural fundamental set of solutions y 1 (t), y 2 (t), and y (t) satisfy the initial conditions y 1 (0) = 1, y 2 (0) = 0, y (0) = 0, y 1 (0) = 0, y 2(0) = 1, y (0) = 0, y 1 y 2(0) = 0, y You can solve these three initial-value problems to find (16) y 1 (t) = 1, y 2 (t) = sin(t), y (t) = 1 cos(t) We will see a more efficient way to find these solutions a bit later, so we will not give any details here Given these solutions, formula (15) yields e ta = Iy 1 (t) + Ay 2 (t) + A 2 y (t) = sin(t) cos(t) = sin(t) cos(t) = + 5 cos(t) 2 2 cos(t) + 2 sin(t) cos(t) 1 sin(t) 2 2 cos(t) 2 sin(t) cos(t) 2 2 cos(t) + 2 sin(t) cos(t) + 1 sin(t) 2 2 cos(t) + 2 sin(t) + 5 cos(t)
7 Three Examples Formulas (11), (12), and (1) for the exponential of 2 2 matrices can be easily derived using the natural fundamental set of solutions to the equation d p y = 0, where p(z) = (z µ) 2 δ There are three cases which are distinguished by the sign of δ If δ > 0 then p(z) has the simple real roots µ and µ + where = δ In this case the natural fundamental set of solutions is (17) y 1 (t) = e µt cosh(t) µe µtsinh(t), y 2 (t) = e µtsinh(t) If δ < 0 then p(z) has the complex conjugate roots µ i and µ+i where = δ In this case the natural fundamental set of solutions is (18) y 1 (t) = e µt cos(t) µe µtsin(t), y 2 (t) = e µtsin(t) If δ = 0 then p(z) has the double real root µ In this case the natural fundamental set of solutions is (1) y 1 (t) = e µt µe µt t, y 2 (t) = e µt t Then by (15), formulas (11), (12), and (1) are abtained by plugging the natural fundamental sets of solutions (17), (18), and (1) respectively into e ta = Iy 1 (t) + Ay 2 (t) Notice that (1) is the limiting case of both (17) and (18) as 0 Remark The above examples shows that, once the natural fundamental set of solutions is found for the associated higher-order equation, employing formula (15) is straight forward It requires only computing A k up to k = m 1 and some addition For m 2 this requires (m 2)n multiplications, which grows fast as m and n get large (Often m = n) However, for small systems like the ones you will face in this course, it is generally the fastest method It will become even faster once you learn how to quickly generate the natural fundamental set of solutions for the associated higher-order equation from its Green function Generating Natural Fundamental Sets with Green Functions In each of the natural fundamental sets of solutions given by (17), (18), and (1), the solutions y 1 (t) and y 2 (t) are related by y 1 (t) = y 2 (t) 2µy 2(t) This is an instance of a more general fact For the m th -order equation d (20) p y = 0, where p(z) = z m + π 1 z m π m 1 z + π m, one can generate its entire natural fundamental set of solutions from the Green function g(t) associated with (20) Recall that the Green function g(t) satisfies the initial-value problem d (21) p g = 0, g(0) = g (0) = = g (m 2) (0) = 0, g (m 1) (0) = 1 7
8 8 The natural fundamental set of solutions is then given by the recipe (22) y m (t) = g(t), y m 1 (t) = g (t) + π 1 g(t), y m 2 (t) = g (t) + π 1 g (t) + π 2 g(t), y 2 (t) = g (m 2) (t) + π 1 g (m ) (t) + + π m g (t) + π m 2 g(t), y 1 (t) = g (m 1) (t) + π 1 g (m 2) (t) + π 2 g (m ) (t) + + π m 2 g (t) + π m 1 g(t) This entire set is thereby generated by the solution of the single initial-value problem (21) Example Show that (16) is indeed the natural fundamental set of solutions to the equation d y + dy = 0 Solution By (21) the Green function g(t) satisfies the initial-value problem d g + dg = 0, g(0) = g (0) = 0, g (0) = 1 The characteristic polynomial of this equation is p(z) = z +z, which has roots 0, ±i We therefore seek a solution in the form Because g(t) = c 1 + c 2 cos(t) + c sin(t) g (t) = c 2 sin(t) + c cos(t), g (t) = c 2 cos(t) c sin(t), the inital conditions for g(t) then yield the algebraic system g(0) = c 1 + c 2 = 0, g (0) = c = 0, g (0) = c 2 = 1 The solution of this system is c 1 = 1, c 2 = 1, and c = 0, whereby the Green function is g(t) = 1 cos(t) Because p(z) = z + z, we read off from (20) that π 1 = 0, π 2 =, and π = 0 Then by recipe (22) the natural fundamental set of solutions is given by y (t) = g(t) = 1 cos(t), y 2 (t) = g (t) + 0 g(t) = sin(t), y 1 (t) = g (t) + 0 g (t) + g(t) = cos(t) + 1 cos(t) = 1 This is indeed the set given by (16) Example Given the fact that p(z) = z z annihilates A, compute e ta for A =
9 Solution Because you are told that p(z) = z z annihilates A, you do not have to compute the characteristic polynomial of A By (21) the Green function g(t) satisfies the initial-value problem d g dg = 0, g(0) = g (0) = 0, g (0) = 1 The characteristic polynomial of this equation is p(z) = z z, which has roots 0, ±2 We therefore seek a solution in the form g(t) = c 1 + c 2 e 2t + c e 2t Because g (t) = 2c 2 e 2t 2c e 2t, g (t) = c 2 e 2t + c e 2t, the inital conditions for g(t) then yield the algebraic system g(0) = c 1 + c 2 + c = 0, g (0) = 2c 2 2c = 0, g (0) = c 2 + c = 1 The solution of this system is c 1 = 1 and c 2 = c = 1, whereby the Green function is 8 g(t) = e2t e 2t = 1 ( cosh(2t) 1 ) Because p(z) = z z, we read off from (20) that π 1 = 0, π 2 =, and π = 0 Then by recipe (22) the natural fundamental set of solutions is given by y (t) = g(t) = cosh(2t) 1, y 2 (t) = g (t) + 0 g(t) = sinh(2t), 2 y 1 (t) = g (t) + 0 g (t) g(t) = cosh(2t) cosh(2t) 1 Given these solutions, formula (15) yields = 1 e ta = Iy 1 (t) + Ay 2 (t) + A 2 y (t) = sinh(2t) = sinh(2t) cosh(2t) 1 cosh(2t) 1 1 sinh(2t) = cosh(2t) 1 cosh(2t) cosh(2t) cosh(2t) 1 sinh(2t) cosh(2t) cosh(2t) cosh(2t) 1 cosh(2t) 1 Remark The polynomial p(z) = z z used in the above example is not the characteristic polynomial of A With some effort you can check that p A (z) = z z 2 We saved quite a bit of work in computing e ta by using p(z) = z z as the annihilating polynomial rather than p A (z) = z z 2 because it has a lower degree Given the characteristic polynomial p A (z) of
10 10 a matrix A, every annihilating polynomial p(z) will have the same roots as p A (z), but these roots might have lower multiplicity If p(z) has simple roots then it has the lowest degree possible for an annihilating polynomial of A If p A (z) has roots that are not simple then it pays to find an annihilating polynomial of lower degree If A is either symmetric (A T = A) or skew-symmetric (A T = A) then it has an annihilating polynomial with simple roots In the example above, because A is symmetric and p A (z) has roots 2, 0, 0, and 2, we know that p(z) = (z + 2)z(z 2) = z z is an annihilating polynomial Because each root of p(z) is simple, it has the lowest degree possible for an annihilating polynomial of A Justification of Recipe (22) The following justification of recipe (22) is included for completeness It was not covered in lecture and you do not need to know this argument However, you should find the recipe itself quite useful We see from (21) that g(t) is a solution of d (2) p y = y (m) + π 1 y (m 1) + π 2 y (m 2) + + π m 1 y + π m y = 0, so that all of its derivatives are too Each y j (t) defined by (22) must also be a solution of (2) because it is a linear combination of g(t) and its derivatives The only thing that remains to be checked is that the initial conditions (1) are satisfied Because y m (t) = g(t), we see from (21) that the initial conditions (1) hold for y m (t) The key step is to show that if the initial conditions (1) hold for y j+1 (t) for some j < m then they hold for y j (t) Once this is done then we can argue that because the initial conditions (1) hold for y m (t), they also hold for y m 1 (t), which implies they also hold for y m 2 (t), which implies they also hold for y m (t), and so on down to y 1 (t) We now prove the key step We suppose that for some j < m the initial conditions (1) hold for y j+1 (t) This is the same as (2) y (k) j+1 (0) = δ jk for k = 0, 1,, m 1 Because y j+1 (t) satisfies (2), it follows from the above that m 1 d 0 = p y j+1 (t) = y (m) j+1 (0) + π m k y (k) j+1 (0) t=0 k=0 (25) m 1 = y (m) j+1 (0) + k=0 π m k δ jk = y (m) j+1 (0) + π m j We see from recipe (22) that y j (t) is related to y j+1 (t) by y j (t) = y j+1 (t) + π m jg(t) We evaluate the (k 1) st derivative of this relation at t = 0 to obtain y (k 1) j (0) = y (k) j+1 (0) + π m jg (k 1) (0) for k = 1, 2,, m Because g(t) satisfies the initial conions in (21), we see from (2) that this becomes y (k 1) j (0) = δ jk for k = 1, 2,, m 1, while we see from (25) that for k = m it becomes y (m 1) j (0) = y (m) j+1 (0) + π m j = 0 The initial conditions (1) thereby hold for y j (t) This completes the proof of the key step, which completes the justification of recipe (22)
FIRST-ORDER SYSTEMS OF ORDINARY DIFFERENTIAL EQUATIONS II: Homogeneous Linear Systems with Constant Coefficients
FIRST-ORDER SYSTEMS OF ORDINARY DIFFERENTIAL EQUATIONS II: Homogeneous Linear Systems with Constant Coefficients David Levermore Department of Mathematics University of Maryland 28 January 2012 Because
More informationπ 1 = tr(a), π n = ( 1) n det(a). In particular, when n = 2 one has
Eigen Methods Math 246, Spring 2009, Professor David Levermore Eigenpairs Let A be a real n n matrix A number λ possibly complex is an eigenvalue of A if there exists a nonzero vector v possibly complex
More informationEigenpairs and Diagonalizability Math 401, Spring 2010, Professor David Levermore
Eigenpairs and Diagonalizability Math 40, Spring 200, Professor David Levermore Eigenpairs Let A be an n n matrix A number λ possibly complex even when A is real is an eigenvalue of A if there exists a
More informationLinear Planar Systems Math 246, Spring 2009, Professor David Levermore We now consider linear systems of the form
Linear Planar Systems Math 246, Spring 2009, Professor David Levermore We now consider linear systems of the form d x x 1 = A, where A = dt y y a11 a 12 a 21 a 22 Here the entries of the coefficient matrix
More informationSolutions of the Sample Problems for the Third In-Class Exam Math 246, Fall 2017, Professor David Levermore
Solutions of the Sample Problems for the Third In-Class Exam Math 6 Fall 07 Professor David Levermore Compute the Laplace transform of ft t e t ut from its definition Solution The definition of the Laplace
More informationThird In-Class Exam Solutions Math 246, Professor David Levermore Thursday, 3 December 2009 (1) [6] Given that 2 is an eigenvalue of the matrix
Third In-Class Exam Solutions Math 26, Professor David Levermore Thursday, December 2009 ) [6] Given that 2 is an eigenvalue of the matrix A 2, 0 find all the eigenvectors of A associated with 2. Solution.
More informationHIGHER-ORDER LINEAR ORDINARY DIFFERENTIAL EQUATIONS II: Nonhomogeneous Equations. David Levermore Department of Mathematics University of Maryland
HIGHER-ORDER LINEAR ORDINARY DIFFERENTIAL EQUATIONS II: Nonhomogeneous Equations David Levermore Department of Mathematics University of Maryland 14 March 2012 Because the presentation of this material
More informationSolutions to Final Exam Sample Problems, Math 246, Spring 2011
Solutions to Final Exam Sample Problems, Math 246, Spring 2 () Consider the differential equation dy dt = (9 y2 )y 2 (a) Identify its equilibrium (stationary) points and classify their stability (b) Sketch
More informationHIGHER-ORDER LINEAR ORDINARY DIFFERENTIAL EQUATIONS. David Levermore Department of Mathematics University of Maryland.
HIGHER-ORDER LINEAR ORDINARY DIFFERENTIAL EQUATIONS David Levermore Department of Mathematics University of Maryland 28 March 2008 The following is a review of some of the material that we covered on higher-order
More informationHomework 3 Solutions Math 309, Fall 2015
Homework 3 Solutions Math 39, Fall 25 782 One easily checks that the only eigenvalue of the coefficient matrix is λ To find the associated eigenvector, we have 4 2 v v 8 4 (up to scalar multiplication)
More information7 Planar systems of linear ODE
7 Planar systems of linear ODE Here I restrict my attention to a very special class of autonomous ODE: linear ODE with constant coefficients This is arguably the only class of ODE for which explicit solution
More informationMATH 312 Section 8.3: Non-homogeneous Systems
MATH 32 Section 8.3: Non-homogeneous Systems Prof. Jonathan Duncan Walla Walla College Spring Quarter, 2007 Outline Undetermined Coefficients 2 Variation of Parameter 3 Conclusions Undetermined Coefficients
More informationLinear Algebra Practice Problems
Math 7, Professor Ramras Linear Algebra Practice Problems () Consider the following system of linear equations in the variables x, y, and z, in which the constants a and b are real numbers. x y + z = a
More informationSystems of Algebraic Equations and Systems of Differential Equations
Systems of Algebraic Equations and Systems of Differential Equations Topics: 2 by 2 systems of linear equations Matrix expression; Ax = b Solving 2 by 2 homogeneous systems Functions defined on matrices
More informationMath 3191 Applied Linear Algebra
Math 9 Applied Linear Algebra Lecture 9: Diagonalization Stephen Billups University of Colorado at Denver Math 9Applied Linear Algebra p./9 Section. Diagonalization The goal here is to develop a useful
More informationDifferential equations
Differential equations Math 7 Spring Practice problems for April Exam Problem Use the method of elimination to find the x-component of the general solution of x y = 6x 9x + y = x 6y 9y Soln: The system
More informationMath Ordinary Differential Equations
Math 411 - Ordinary Differential Equations Review Notes - 1 1 - Basic Theory A first order ordinary differential equation has the form x = f(t, x) (11) Here x = dx/dt Given an initial data x(t 0 ) = x
More informationAPPENDIX A. Background Mathematics. A.1 Linear Algebra. Vector algebra. Let x denote the n-dimensional column vector with components x 1 x 2.
APPENDIX A Background Mathematics A. Linear Algebra A.. Vector algebra Let x denote the n-dimensional column vector with components 0 x x 2 B C @. A x n Definition 6 (scalar product). The scalar product
More informationMATH 320, WEEK 11: Eigenvalues and Eigenvectors
MATH 30, WEEK : Eigenvalues and Eigenvectors Eigenvalues and Eigenvectors We have learned about several vector spaces which naturally arise from matrix operations In particular, we have learned about the
More informationLecture Notes: Eigenvalues and Eigenvectors. 1 Definitions. 2 Finding All Eigenvalues
Lecture Notes: Eigenvalues and Eigenvectors Yufei Tao Department of Computer Science and Engineering Chinese University of Hong Kong taoyf@cse.cuhk.edu.hk 1 Definitions Let A be an n n matrix. If there
More informationMath Matrix Algebra
Math 44 - Matrix Algebra Review notes - 4 (Alberto Bressan, Spring 27) Review of complex numbers In this chapter we shall need to work with complex numbers z C These can be written in the form z = a+ib,
More informationSpectral Theorem for Self-adjoint Linear Operators
Notes for the undergraduate lecture by David Adams. (These are the notes I would write if I was teaching a course on this topic. I have included more material than I will cover in the 45 minute lecture;
More informationMATH 56A: STOCHASTIC PROCESSES CHAPTER 0
MATH 56A: STOCHASTIC PROCESSES CHAPTER 0 0. Chapter 0 I reviewed basic properties of linear differential equations in one variable. I still need to do the theory for several variables. 0.1. linear differential
More informationLecture 5. Complex Numbers and Euler s Formula
Lecture 5. Complex Numbers and Euler s Formula University of British Columbia, Vancouver Yue-Xian Li March 017 1 Main purpose: To introduce some basic knowledge of complex numbers to students so that they
More informationChem 3502/4502 Physical Chemistry II (Quantum Mechanics) 3 Credits Fall Semester 2006 Christopher J. Cramer. Lecture 5, January 27, 2006
Chem 3502/4502 Physical Chemistry II (Quantum Mechanics) 3 Credits Fall Semester 2006 Christopher J. Cramer Lecture 5, January 27, 2006 Solved Homework (Homework for grading is also due today) We are told
More informationHIGHER-ORDER LINEAR ORDINARY DIFFERENTIAL EQUATIONS IV: Laplace Transform Method David Levermore Department of Mathematics University of Maryland
HIGHER-ORDER LINEAR ORDINARY DIFFERENTIAL EQUATIONS IV: Laplace Transform Method David Levermore Department of Mathematics University of Maryland 9 December Because the presentation of this material in
More informationHIGHER-ORDER LINEAR ORDINARY DIFFERENTIAL EQUATIONS IV: Laplace Transform Method. David Levermore Department of Mathematics University of Maryland
HIGHER-ORDER LINEAR ORDINARY DIFFERENTIAL EQUATIONS IV: Laplace Transform Method David Levermore Department of Mathematics University of Maryland 6 April Because the presentation of this material in lecture
More informationSystems of Second Order Differential Equations Cayley-Hamilton-Ziebur
Systems of Second Order Differential Equations Cayley-Hamilton-Ziebur Characteristic Equation Cayley-Hamilton Cayley-Hamilton Theorem An Example Euler s Substitution for u = A u The Cayley-Hamilton-Ziebur
More informationArchive of past papers, solutions and homeworks for. MATH 224, Linear Algebra 2, Spring 2013, Laurence Barker
Archive of past papers, solutions and homeworks for MATH 224, Linear Algebra 2, Spring 213, Laurence Barker version: 4 June 213 Source file: archfall99.tex page 2: Homeworks. page 3: Quizzes. page 4: Midterm
More informationFundamentals of Linear Algebra. Marcel B. Finan Arkansas Tech University c All Rights Reserved
Fundamentals of Linear Algebra Marcel B. Finan Arkansas Tech University c All Rights Reserved 2 PREFACE Linear algebra has evolved as a branch of mathematics with wide range of applications to the natural
More informationYou may use a calculator, but you must show all your work in order to receive credit.
Math 2410-010/015 Exam II April 7 th, 2017 Name: Instructions: Key Answer each question to the best of your ability. All answers must be written clearly. Be sure to erase or cross out any work that you
More informationLinear Algebra Practice Problems
Linear Algebra Practice Problems Math 24 Calculus III Summer 25, Session II. Determine whether the given set is a vector space. If not, give at least one axiom that is not satisfied. Unless otherwise stated,
More information1. General Vector Spaces
1.1. Vector space axioms. 1. General Vector Spaces Definition 1.1. Let V be a nonempty set of objects on which the operations of addition and scalar multiplication are defined. By addition we mean a rule
More informationSolutions to Final Exam Sample Problems, Math 246, Spring 2018
Solutions to Final Exam Sample Problems, Math 46, Spring 08 () Consider the differential equation dy dt = (9 y )y. (a) Find all of its stationary points and classify their stability. (b) Sketch its phase-line
More informationc Igor Zelenko, Fall
c Igor Zelenko, Fall 2017 1 18: Repeated Eigenvalues: algebraic and geometric multiplicities of eigenvalues, generalized eigenvectors, and solution for systems of differential equation with repeated eigenvalues
More informationThe Exponential of a Matrix
The Exponential of a Matrix 5-8- The solution to the exponential growth equation dx dt kx is given by x c e kt It is natural to ask whether you can solve a constant coefficient linear system x A x in a
More informationMa 227 Review for Systems of DEs
Ma 7 Review for Systems of DEs Matrices Basic Properties Addition and subtraction: Let A a ij mn and B b ij mn.then A B a ij b ij mn 3 A 6 B 6 4 7 6 A B 6 4 3 7 6 6 7 3 Scaler Multiplication: Let k be
More information1 Matrices and Systems of Linear Equations. a 1n a 2n
March 31, 2013 16-1 16. Systems of Linear Equations 1 Matrices and Systems of Linear Equations An m n matrix is an array A = (a ij ) of the form a 11 a 21 a m1 a 1n a 2n... a mn where each a ij is a real
More informationThe following definition is fundamental.
1. Some Basics from Linear Algebra With these notes, I will try and clarify certain topics that I only quickly mention in class. First and foremost, I will assume that you are familiar with many basic
More informationFIRST-ORDER SYSTEMS OF ORDINARY DIFFERENTIAL EQUATIONS III: Autonomous Planar Systems David Levermore Department of Mathematics University of Maryland
FIRST-ORDER SYSTEMS OF ORDINARY DIFFERENTIAL EQUATIONS III: Autonomous Planar Systems David Levermore Department of Mathematics University of Maryland 4 May 2012 Because the presentation of this material
More informationEigenvalues and Eigenvectors
LECTURE 3 Eigenvalues and Eigenvectors Definition 3.. Let A be an n n matrix. The eigenvalue-eigenvector problem for A is the problem of finding numbers λ and vectors v R 3 such that Av = λv. If λ, v are
More informationSolutions to Homework 5, Introduction to Differential Equations, 3450: , Dr. Montero, Spring y 4y = 48t 3.
Solutions to Homework 5, Introduction to Differential Equations, 3450:335-003, Dr. Montero, Spring 2009 Problem 1. Find a particular solution to the differential equation 4y = 48t 3. Solution: First we
More information18.06 Problem Set 8 - Solutions Due Wednesday, 14 November 2007 at 4 pm in
806 Problem Set 8 - Solutions Due Wednesday, 4 November 2007 at 4 pm in 2-06 08 03 Problem : 205+5+5+5 Consider the matrix A 02 07 a Check that A is a positive Markov matrix, and find its steady state
More informationEigenvalues and Eigenvectors
Eigenvalues and Eigenvectors Philippe B. Laval KSU Fall 2015 Philippe B. Laval (KSU) Eigenvalues and Eigenvectors Fall 2015 1 / 14 Introduction We define eigenvalues and eigenvectors. We discuss how to
More informationREVIEW OF DIFFERENTIAL CALCULUS
REVIEW OF DIFFERENTIAL CALCULUS DONU ARAPURA 1. Limits and continuity To simplify the statements, we will often stick to two variables, but everything holds with any number of variables. Let f(x, y) be
More informationNumerical Linear Algebra Homework Assignment - Week 2
Numerical Linear Algebra Homework Assignment - Week 2 Đoàn Trần Nguyên Tùng Student ID: 1411352 8th October 2016 Exercise 2.1: Show that if a matrix A is both triangular and unitary, then it is diagonal.
More informationAMS526: Numerical Analysis I (Numerical Linear Algebra)
AMS526: Numerical Analysis I (Numerical Linear Algebra) Lecture 16: Eigenvalue Problems; Similarity Transformations Xiangmin Jiao Stony Brook University Xiangmin Jiao Numerical Analysis I 1 / 18 Eigenvalue
More informationLecture 10 - Eigenvalues problem
Lecture 10 - Eigenvalues problem Department of Computer Science University of Houston February 28, 2008 1 Lecture 10 - Eigenvalues problem Introduction Eigenvalue problems form an important class of problems
More informationMATH 312 Section 4.5: Undetermined Coefficients
MATH 312 Section 4.5: Undetermined Coefficients Prof. Jonathan Duncan Walla Walla College Spring Quarter, 2007 Outline 1 Differential Operators 2 Annihilators 3 Undetermined Coefficients 4 Conclusion ODEs
More informationCourse 216: Ordinary Differential Equations
Course 16: Ordinary Differential Equations Notes by Chris Blair These notes cover the ODEs course given in 7-8 by Dr. John Stalker. Contents I Solving Linear ODEs 1 Reduction of Order Computing Matrix
More information4. Linear transformations as a vector space 17
4 Linear transformations as a vector space 17 d) 1 2 0 0 1 2 0 0 1 0 0 0 1 2 3 4 32 Let a linear transformation in R 2 be the reflection in the line = x 2 Find its matrix 33 For each linear transformation
More informationWe have already seen that the main problem of linear algebra is solving systems of linear equations.
Notes on Eigenvalues and Eigenvectors by Arunas Rudvalis Definition 1: Given a linear transformation T : R n R n a non-zero vector v in R n is called an eigenvector of T if Tv = λv for some real number
More informationExamples include: (a) the Lorenz system for climate and weather modeling (b) the Hodgkin-Huxley system for neuron modeling
1 Introduction Many natural processes can be viewed as dynamical systems, where the system is represented by a set of state variables and its evolution governed by a set of differential equations. Examples
More informationand let s calculate the image of some vectors under the transformation T.
Chapter 5 Eigenvalues and Eigenvectors 5. Eigenvalues and Eigenvectors Let T : R n R n be a linear transformation. Then T can be represented by a matrix (the standard matrix), and we can write T ( v) =
More informationDifferential Equations 2280 Sample Midterm Exam 3 with Solutions Exam Date: 24 April 2015 at 12:50pm
Differential Equations 228 Sample Midterm Exam 3 with Solutions Exam Date: 24 April 25 at 2:5pm Instructions: This in-class exam is 5 minutes. No calculators, notes, tables or books. No answer check is
More informationMatrices and Deformation
ES 111 Mathematical Methods in the Earth Sciences Matrices and Deformation Lecture Outline 13 - Thurs 9th Nov 2017 Strain Ellipse and Eigenvectors One way of thinking about a matrix is that it operates
More informationHIGHER-ORDER LINEAR ORDINARY DIFFERENTIAL EQUATIONS IV: Variable Coefficient Nonhomogeneous Case
HIGHER-ORDER LINEAR ORDINARY DIFFERENTIAL EQUATIONS IV: Variable Coefficient Nonhomogeneous Case David Levermore Department of Mathematics University of Maryland 15 March 2009 Because the presentation
More informationChapter 5. Linear Algebra. A linear (algebraic) equation in. unknowns, x 1, x 2,..., x n, is. an equation of the form
Chapter 5. Linear Algebra A linear (algebraic) equation in n unknowns, x 1, x 2,..., x n, is an equation of the form a 1 x 1 + a 2 x 2 + + a n x n = b where a 1, a 2,..., a n and b are real numbers. 1
More informationNotes on the matrix exponential
Notes on the matrix exponential Erik Wahlén erik.wahlen@math.lu.se February 14, 212 1 Introduction The purpose of these notes is to describe how one can compute the matrix exponential e A when A is not
More informationAnnouncements Monday, November 13
Announcements Monday, November 13 The third midterm is on this Friday, November 17 The exam covers 31, 32, 51, 52, 53, and 55 About half the problems will be conceptual, and the other half computational
More informationRemark By definition, an eigenvector must be a nonzero vector, but eigenvalue could be zero.
Sec 6 Eigenvalues and Eigenvectors Definition An eigenvector of an n n matrix A is a nonzero vector x such that A x λ x for some scalar λ A scalar λ is called an eigenvalue of A if there is a nontrivial
More informationOnline Exercises for Linear Algebra XM511
This document lists the online exercises for XM511. The section ( ) numbers refer to the textbook. TYPE I are True/False. Lecture 02 ( 1.1) Online Exercises for Linear Algebra XM511 1) The matrix [3 2
More informationChapter 7. Canonical Forms. 7.1 Eigenvalues and Eigenvectors
Chapter 7 Canonical Forms 7.1 Eigenvalues and Eigenvectors Definition 7.1.1. Let V be a vector space over the field F and let T be a linear operator on V. An eigenvalue of T is a scalar λ F such that there
More informationLecture Notes in Mathematics. Arkansas Tech University Department of Mathematics. The Basics of Linear Algebra
Lecture Notes in Mathematics Arkansas Tech University Department of Mathematics The Basics of Linear Algebra Marcel B. Finan c All Rights Reserved Last Updated November 30, 2015 2 Preface Linear algebra
More informationSecond In-Class Exam Solutions Math 246, Professor David Levermore Thursday, 31 March 2011
Second In-Class Exam Solutions Math 246, Professor David Levermore Thursday, 31 March 211 (1) [6] Give the interval of definition for the solution of the initial-value problem d 4 y dt 4 + 7 1 t 2 dy dt
More informationOld Math 330 Exams. David M. McClendon. Department of Mathematics Ferris State University
Old Math 330 Exams David M. McClendon Department of Mathematics Ferris State University Last updated to include exams from Fall 07 Contents Contents General information about these exams 3 Exams from Fall
More informationA matrix is a rectangular array of. objects arranged in rows and columns. The objects are called the entries. is called the size of the matrix, and
Section 5.5. Matrices and Vectors A matrix is a rectangular array of objects arranged in rows and columns. The objects are called the entries. A matrix with m rows and n columns is called an m n matrix.
More informationThe minimal polynomial
The minimal polynomial Michael H Mertens October 22, 2015 Introduction In these short notes we explain some of the important features of the minimal polynomial of a square matrix A and recall some basic
More information8.5 Taylor Polynomials and Taylor Series
8.5. TAYLOR POLYNOMIALS AND TAYLOR SERIES 50 8.5 Taylor Polynomials and Taylor Series Motivating Questions In this section, we strive to understand the ideas generated by the following important questions:
More informationThe goal of this chapter is to study linear systems of ordinary differential equations: dt,..., dx ) T
1 1 Linear Systems The goal of this chapter is to study linear systems of ordinary differential equations: ẋ = Ax, x(0) = x 0, (1) where x R n, A is an n n matrix and ẋ = dx ( dt = dx1 dt,..., dx ) T n.
More information1 Matrices and Systems of Linear Equations
March 3, 203 6-6. Systems of Linear Equations Matrices and Systems of Linear Equations An m n matrix is an array A = a ij of the form a a n a 2 a 2n... a m a mn where each a ij is a real or complex number.
More informationEigenvalues and Eigenvectors
Contents Eigenvalues and Eigenvectors. Basic Concepts. Applications of Eigenvalues and Eigenvectors 8.3 Repeated Eigenvalues and Symmetric Matrices 3.4 Numerical Determination of Eigenvalues and Eigenvectors
More informationSolutions to Math 53 Math 53 Practice Final
Solutions to Math 5 Math 5 Practice Final 20 points Consider the initial value problem y t 4yt = te t with y 0 = and y0 = 0 a 8 points Find the Laplace transform of the solution of this IVP b 8 points
More informationA matrix is a rectangular array of. objects arranged in rows and columns. The objects are called the entries. is called the size of the matrix, and
Section 5.5. Matrices and Vectors A matrix is a rectangular array of objects arranged in rows and columns. The objects are called the entries. A matrix with m rows and n columns is called an m n matrix.
More informationSection 8.2 : Homogeneous Linear Systems
Section 8.2 : Homogeneous Linear Systems Review: Eigenvalues and Eigenvectors Let A be an n n matrix with constant real components a ij. An eigenvector of A is a nonzero n 1 column vector v such that Av
More informationLU Factorization. A m x n matrix A admits an LU factorization if it can be written in the form of A = LU
LU Factorization A m n matri A admits an LU factorization if it can be written in the form of Where, A = LU L : is a m m lower triangular matri with s on the diagonal. The matri L is invertible and is
More informationSolutions to Second In-Class Exam: Math 401 Section 0201, Professor Levermore Friday, 16 April 2010
Solutions to Second In-Class Exam: Math 4 Section, Professor Levermore Friday, 6 April No notes, books, or electrontics You must show your reasoning for full credit Good luck! [] Consider the polynomials
More information3.3 Eigenvalues and Eigenvectors
.. EIGENVALUES AND EIGENVECTORS 27. Eigenvalues and Eigenvectors In this section, we assume A is an n n matrix and x is an n vector... Definitions In general, the product Ax results is another n vector
More informationEIGENVALUES AND EIGENVECTORS 3
EIGENVALUES AND EIGENVECTORS 3 1. Motivation 1.1. Diagonal matrices. Perhaps the simplest type of linear transformations are those whose matrix is diagonal (in some basis). Consider for example the matrices
More informationVector Spaces and SubSpaces
Vector Spaces and SubSpaces Linear Algebra MATH 2076 Linear Algebra Vector Spaces & SubSpaces Chapter 4, Section 1b 1 / 10 What is a Vector Space? A vector space is a bunch of objects that we call vectors
More information18.S34 linear algebra problems (2007)
18.S34 linear algebra problems (2007) Useful ideas for evaluating determinants 1. Row reduction, expanding by minors, or combinations thereof; sometimes these are useful in combination with an induction
More informationUCLA Math 135, Winter 2015 Ordinary Differential Equations
UCLA Math 135, Winter 2015 Ordinary Differential Equations C. David Levermore Department of Mathematics University of Maryland January 5, 2015 Contents 1.1. Normal Forms and Solutions 1.2. Initial-Value
More information2.3. VECTOR SPACES 25
2.3. VECTOR SPACES 25 2.3 Vector Spaces MATH 294 FALL 982 PRELIM # 3a 2.3. Let C[, ] denote the space of continuous functions defined on the interval [,] (i.e. f(x) is a member of C[, ] if f(x) is continuous
More information20D - Homework Assignment 5
Brian Bowers TA for Hui Sun MATH D Homework Assignment 5 November 8, 3 D - Homework Assignment 5 First, I present the list of all matrix row operations. We use combinations of these steps to row reduce
More informationNovember 18, 2013 ANALYTIC FUNCTIONAL CALCULUS
November 8, 203 ANALYTIC FUNCTIONAL CALCULUS RODICA D. COSTIN Contents. The spectral projection theorem. Functional calculus 2.. The spectral projection theorem for self-adjoint matrices 2.2. The spectral
More informationSystems of Linear Differential Equations Chapter 7
Systems of Linear Differential Equations Chapter 7 Doreen De Leon Department of Mathematics, California State University, Fresno June 22, 25 Motivating Examples: Applications of Systems of First Order
More informationEigenvalues and Eigenvectors: An Introduction
Eigenvalues and Eigenvectors: An Introduction The eigenvalue problem is a problem of considerable theoretical interest and wide-ranging application. For example, this problem is crucial in solving systems
More informationEven-Numbered Homework Solutions
-6 Even-Numbered Homework Solutions Suppose that the matric B has λ = + 5i as an eigenvalue with eigenvector Y 0 = solution to dy = BY Using Euler s formula, we can write the complex-valued solution Y
More information0.1 Rational Canonical Forms
We have already seen that it is useful and simpler to study linear systems using matrices. But matrices are themselves cumbersome, as they are stuffed with many entries, and it turns out that it s best
More informationLinear algebra and differential equations (Math 54): Lecture 20
Linear algebra and differential equations (Math 54): Lecture 20 Vivek Shende April 7, 2016 Hello and welcome to class! Last time We started discussing differential equations. We found a complete set of
More informationFinal Exam. Linear Algebra Summer 2011 Math S2010X (3) Corrin Clarkson. August 10th, Solutions
Final Exam Linear Algebra Summer Math SX (3) Corrin Clarkson August th, Name: Solutions Instructions: This is a closed book exam. You may not use the textbook, notes or a calculator. You will have 9 minutes
More informationMatrix Solutions to Linear Systems of ODEs
Matrix Solutions to Linear Systems of ODEs James K. Peterson Department of Biological Sciences and Department of Mathematical Sciences Clemson University November 3, 216 Outline 1 Symmetric Systems of
More information6 Linear Equation. 6.1 Equation with constant coefficients
6 Linear Equation 6.1 Equation with constant coefficients Consider the equation ẋ = Ax, x R n. This equating has n independent solutions. If the eigenvalues are distinct then the solutions are c k e λ
More informationWork sheet / Things to know. Chapter 3
MATH 251 Work sheet / Things to know 1. Second order linear differential equation Standard form: Chapter 3 What makes it homogeneous? We will, for the most part, work with equations with constant coefficients
More informationSome Notes on Linear Algebra
Some Notes on Linear Algebra prepared for a first course in differential equations Thomas L Scofield Department of Mathematics and Statistics Calvin College 1998 1 The purpose of these notes is to present
More informationNonhomogeneous Linear Equations: Variation of Parameters Professor David Levermore 17 October 2004 We now return to the discussion of the general case
Nonhomogeneous Linear Equations: Variation of Parameters Professor David Levermore 17 October 2004 We now return to the discussion of the general case L(t)y = a 0 (t)y + a 1 (t)y + a 2 (t)y = b(t). (1.1)
More information22.3. Repeated Eigenvalues and Symmetric Matrices. Introduction. Prerequisites. Learning Outcomes
Repeated Eigenvalues and Symmetric Matrices. Introduction In this Section we further develop the theory of eigenvalues and eigenvectors in two distinct directions. Firstly we look at matrices where one
More informationMATH 12 CLASS 4 NOTES, SEP
MATH 12 CLASS 4 NOTES, SEP 28 2011 Contents 1. Lines in R 3 1 2. Intersections of lines in R 3 2 3. The equation of a plane 4 4. Various problems with planes 5 4.1. Intersection of planes with planes or
More informationPutzer s Algorithm. Norman Lebovitz. September 8, 2016
Putzer s Algorithm Norman Lebovitz September 8, 2016 1 Putzer s algorithm The differential equation dx = Ax, (1) dt where A is an n n matrix of constants, possesses the fundamental matrix solution exp(at),
More informationMATH 1553-C MIDTERM EXAMINATION 3
MATH 553-C MIDTERM EXAMINATION 3 Name GT Email @gatech.edu Please read all instructions carefully before beginning. Please leave your GT ID card on your desk until your TA scans your exam. Each problem
More information