Mathematical Foundations -1- Difference equations. Systems of difference equations. Life cycle model 2. Phase diagram 4. Eigenvalue and eigenvector 5

Size: px
Start display at page:

Download "Mathematical Foundations -1- Difference equations. Systems of difference equations. Life cycle model 2. Phase diagram 4. Eigenvalue and eigenvector 5"

Transcription

1 Mathematical Foundations -- Difference equations Systems of difference equations Life cycle model Phase diagram 4 Eigenvalue and eigenvector 5 The general two variable model 9 Complex eigenvalues 5 Stable and unstable systems 4 John Riley August 4, 0

2 Mathematical Foundations -- Difference equations Review: Life-cycle model: the evolution of the system is defined by two linear equations. c = t α( + + r) c, t FOC W = t ( + r)( W + t ct). wealth equation For the baseline case we make the following assumptions. Assumptions: ( + r) α > and α < Consumption sequence: If c t > 0 consumption is growing larger at a constant rate. If c t < 0 consumption is growing more negative at a constant rate. John Riley August 4, 0

3 Mathematical Foundations -3- Difference equations More analysis: ct ( + ) = ( + r) αct ( ) Wt ( + ) = ( + r)( Wt ( ) Ct ( )). Constant growth paths. x( t+ ) = λx( t) Consumption and wealth grow at the same rate if Wt ( + ) = ( + r) αwt ( ). Substituting, Wt ( + ) = ( + r)( Wt ( ) Ct ( )) = ( + r) αwt ( ). Then Wt () Ct () = αwt () and so Ct () = ( α) Wt (). Summarizing, if Ct () = ( α) Wt () both consumption and wealth grow at the rate λ = ( + r) α. Also if Ct () = 0, then Ct+ ( ) = 0and Wt ( + ) = ( + rwt ) ( ) so both grow at the same rate + r John Riley August 4, 0

4 Mathematical Foundations -4- Difference equations Phase Diagram We can express the FOC and wealth equation in matrix form as follows. Wt ( + ) + r ( + r) Wt ( ) = ct ( + ) 0 ( + r) α ct ( ) () This is a linear difference equation system. John Riley August 4, 0

5 Mathematical Foundations -5- Difference equations. Solution with a constant growth rate Wt ( + ) Wt ( ) = λ ct ( + ) ct ( ). Any λ for which this holds is called an eigenvalue (or characteristic root.) Any vector Wt () v ct () = v for which this holds is called an eigenvector. Appealing to () Wt ( + ) + r ( + r) Wt ( ) Wt ( ) Wt ( ) λ 0 Wt ( ) λ λ ct ( ) = 0 ( r) α ct ( ) = ct ( ) = I = + + ct ( ) 0 λ ct ( ) + r ( + r) Wt ( ) λ 0 Wt ( ) = 0 ( + r) α c( t) 0 λ c( t) John Riley August 4, 0

6 Mathematical Foundations -6- Difference equations Solving for the eigenvalues (constant growth rates) If you write out the equation system it will be clear that this equation can be rewritten as follows. + r λ ( + r) W( t) 0 = 0 ( + r) α λ c( t) 0. () It follows that the determinant of this matrix is zero. + r λ ( + r) = 0 0 ( + r) α λ that is (( + r) α λ)( + r λ) = 0 Thus the eigenvalues are λ = ( + r) α and λ = + r. John Riley August 4, 0

7 Mathematical Foundations -7- Difference equations Solving for the eigenvectors Let v = ( v, v ) be an eigenvector associated with the first eigenvalue λ. From (), + r λ ( + r) v 0 0 ( r) α λ = v 0. + Substituting for λ. ( + r)( α) ( + r) v = v 0. That is, ( + r)( α) ( + r) v = v 0. Solving, ( α)v = v. Thus v = (, α) is an eigenvector. John Riley August 4, 0

8 Mathematical Foundations -8- Difference equations v = (, α) is an eigenvector. Note that this vector is in the positive quadrant or negative quadrant if and only if α <. This is the case depicted. Exercise: Consider the dynamics if α >. Similarly, substituting for λ, v = (, 0) is an eigenvector. If If x() x = v, then () v, = then x( t+ ) = λ v x( t ) t t + = λ v. The eigenvectors and constant growth paths are depicted in a phase diagram John Riley August 4, 0

9 Mathematical Foundations -9- Difference equations c = t α( + + r) c t W = t ( + r)( W + t ct). r Hence W t W = t (( + + r)( Wt ct) + r John Riley August 4, 0

10 Mathematical Foundations -0- Difference equations Consider any other x (). Since v and v are linearly independent we can write x () as some linear combination x() = α v + α v Then x() = Ax() = A( α v + α v ) = α Av + α A v = α λv + α λ v. Similarly x(3) = Ax() = A( αλv + αλv ) = ( αλav + αλa v ) = ( αλ v + αλ v ) Repeating this... x( t+ ) = α λ v + α λ v. t t Suppose λ > λ Then x( t+ ) = λ ( α ( λ ) v + α v ) λ α v t t t λ Thus the solution converges to the constant growth path with the higher eigenvector. John Riley August 4, 0

11 Mathematical Foundations -- Difference equations SYSTEMS OF LINEAR DIFFERENCE EQUATIONS The general two variable model x( t+ ) = Ax( t) = λx( t) = λi x( t). Rearranging, x( t+ ) λx( t) = Ax( t) λix( t) = ( A λ I ) x( t) = 0. For a stationary state this must hold with λ =, that is ( A I ) x( t) = 0. We assume that A I 0, so that the matrix A-I is invertible. Then the unique solution to the equation system ( A I ) x( t) = 0 is x() t = 0. John Riley August 4, 0

12 Mathematical Foundations -- Difference equations Next consider λ. For a constant growth path the equation system ( A λ I) x( t) = 0must have a non-zero solution. Arguing as above, this is not possible if A λ I is invertible. Hence for constant growth, a λ a A I = = ( + ) + A = 0. () λ λ a a λ a a λ This equation is known as the characteristic equation of the matrix A. The two roots λ, λ of the quadratic equation are known as the characteristic roots or eigenvalues. Associated with each, is an initial value of the state vector v and eigenvalues differ, the two initial state vectors are independent. v. These are known as the eigenvectors. As long as the two John Riley August 4, 0

13 Mathematical Foundations -3- Difference equations Real eigenvectors: We have seen that λ ( a + a ) λ + A = 0 () We can also write the characteristic equation as follows. ( λ λ )( λ λ ) = λ ( λ + λ ) λ λλ = 0. () Comparing () and (), the sum of the roots is the sum of the diagonal elements of A and the product of the roots is the determinant of A. Solving the quadratic characteristic equation yields the two roots λ λ = ( a+ a) + 4( a+ a) A = ( a+ a) 4( a+ a) A, (3) Thus there are two distinct real roots if and only if ( a + a ) 4 A = ( a a ) + 4a a > 0. Thus a sufficient condition for two distinct real roots is that aa > 0. John Riley August 4, 0

14 Mathematical Foundations -4- Difference equations Suppose this condition holds. Arguing exactly as in the example, any initial state vector x () can be expressed as a linear combination of v and v, that is x() = α v + α v. i i Since A v = λ v, i =,, it follows that A t v i = λ t v i, i =,. Then i i x( t+ ) = α λ v + α λ v. t t Thus the long run dynamics are determined by the eigenvalue with the larger absolute value. John Riley August 4, 0

15 Mathematical Foundations -5- Difference equations Complex eigenvalues a λ a A I = = ( + ) + A = ( )( ) = 0. (4) λ λ a a λ λ λ λ λ a a λ Consider the solution to the characteristic equation. λ λ = ( a+ a) + 4( a+ a) A = ( a+ a) 4( a+ a) A, (5) Suppose that the expression under the square root in (5) is negative. Then define α = ( a + a ) and β = A ( a + a ). 4 Then (5) can be rewritten as follows. λ = α + β λ = α β John Riley August 4, 0

16 Mathematical Foundations -6- Difference equations λ = α + β λ = α β It follows that there is no solution in terms of real numbers and so there can be no constant growth paths. We employ a remarkable mathematical sleight of hand and introduce complex numbers. We define i =. Then λ = α + iβ and λ = α iβ John Riley August 4, 0

17 Mathematical Foundations -7- Difference equations Example: Suppose that A =. The solution for a particular starting value is depicted. λ / A λi = = ( λ) + 4 = 0. / λ While there is no real root we note that i = and so ( λ) = i. 4 Taking the square root, λ = ± i John Riley August 4, 0

18 Mathematical Foundations -8- Difference equations As the first step in solving for the general solution, note that the eigenvalue λ and associated eigenvector v must satisfy the constant growth condition: ( A λ I ) v = 0, That is ( a λ ) v + av = 0. Without loss of generality we may choose v = then v = ( a λ)/ a. Since λ is a complex number, so is v. We will write this more succinctly as v = k+ ik. John Riley August 4, 0

19 Mathematical Foundations -9- Difference equations It proves extremely useful to express the vector of parameters ( α, β ) in polar coordinates. See Fig. B.4-4 below. Note that λ = α + iβ and λ = α iβ Then we can rewrite the eigenvalue as r = α + β = A and tan θ = β / α. λ = r(cosθ + isin θ), λ = r(cosθ isin θ) Fig. B.4-4: Polar coordinates John Riley August 4, 0

20 Mathematical Foundations -0- Difference equations iz Mathematical aside: For any z, cos z+ isin z = e. To see this consider the Taylor expansion around z = df d f d f 3 d f 4 f( z) = f(0) + (0) z+ (0) z + (0) z + (0) z dz! dz 3! dz 4! dz 3 sin z = sin0 + cos(0) z sin(0) z cos(0) z +... so 3! 3 4 cos z = cos(0) sin(0) z cos(0) z + sin(0) z + sin(0) z +... so! 3! 4! 3 sin z = z z ! Summing: 3 4 iz z iz z cos z+ isin z = !! 3! 4! 3 sin z = z z ! 4 z z cos z = ! 4! iz Finally Taylor s Expansion of e. iz i0 i0 i0 3 i0 3 4 i0 4 e = e + ie z+ i e z + i e z + i e z so! 3! 4! 3 4 iz iz z iz z e = !! 3! 4! John Riley August 4, 0

21 Mathematical Foundations -- Difference equations iθ cosθ + isinθ = e = cosθ + isinθ t iθ t Then (cosθ + isin θ) = e = cosθt+ isinθt And so if x() = v= k ik, and λ = r(cosθ + isin θ) + t t x( t+ ) = Ax( t) = A v=λ v t iθ t = re k ik + t = r (cos θ t+ isin θ t) k ik + John Riley August 4, 0

22 Mathematical Foundations -- Difference equations Collecting real and complex terms, Define cos sin t θt t θt xt ( + ) = r + ir k cosθt k sinθt k sinθt+ k cosθt. (6) cosθt sinθt. t t v () t = r and v () t = r kcosθt ksinθt ksinθt+ kcosθt We now argue that both v t iv t (( ) + ( ) is a solution, v () t and v () t are solutions to the difference equation system. Since x( t+ ) = v ( t+ ) + iv ( t+ ) = Ax( t) = Av ( t) + ia v ( t). John Riley August 4, 0

23 Mathematical Foundations -3- Difference equations Collecting real and complex terms, v t+ = v t v t+ = v t ( ) A ( ) and ( ) A ( ). Choose α and α so that combination. Then α v () + α v () = x(). Since v () t and v () t are solutions, so is any linear x() t = α v () t + α v () t is the general solution, given the initial state x (). John Riley August 4, 0

24 Mathematical Foundations -4- Difference equations Stable and unstable systems From (3) = + i = ( a+ a) + 4( a+ a) A λ α β = i = ( a+ a) 4( a+ a) A λ α β From Fig. B.4-4, we can rewrite these eigenvalues in polar coordinates as follows. where λ = r(cosθ + isin θ), λ = r(cosθ isin θ) r = α + β and Substituting for α and β, r (, ) ( ( a a), A 4( a a) ) αβ = + +. = A. From () the amplitude of the oscillation is t r at time t. Thus the amplitude of the oscillations is increasing if r > and decreasing if r <. Therefore the cycles of an oscillating system with complex eigenvalues are damped if and only if A <. John Riley August 4, 0

25 Mathematical Foundations -5- Difference equations Example (continued) If A =, we have seen that the eigenvalues are λ = + i and λ = i. Transforming the eigenvalues into polar coordinates, 5 λ = (cos θt+ i sin θt ) and Fig. B.4-5: Polar coordinates 5 (cos sin ) λ = θt i θt, where tanθ =. Note that, since r = A > the amplitude of the oscillations is increasing. Thus the dynamic system is unstable. John Riley August 4, 0

Diagonalization of Matrix

Diagonalization of Matrix of Matrix King Saud University August 29, 2018 of Matrix Table of contents 1 2 of Matrix Definition If A M n (R) and λ R. We say that λ is an eigenvalue of the matrix A if there is X R n \ {0} such that

More information

Properties of Linear Transformations from R n to R m

Properties of Linear Transformations from R n to R m Properties of Linear Transformations from R n to R m MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 2015 Topic Overview Relationship between the properties of a matrix transformation

More information

235 Final exam review questions

235 Final exam review questions 5 Final exam review questions Paul Hacking December 4, 0 () Let A be an n n matrix and T : R n R n, T (x) = Ax the linear transformation with matrix A. What does it mean to say that a vector v R n is an

More information

Recall : Eigenvalues and Eigenvectors

Recall : Eigenvalues and Eigenvectors Recall : Eigenvalues and Eigenvectors Let A be an n n matrix. If a nonzero vector x in R n satisfies Ax λx for a scalar λ, then : The scalar λ is called an eigenvalue of A. The vector x is called an eigenvector

More information

Jordan Canonical Form Homework Solutions

Jordan Canonical Form Homework Solutions Jordan Canonical Form Homework Solutions For each of the following, put the matrix in Jordan canonical form and find the matrix S such that S AS = J. [ ]. A = A λi = λ λ = ( λ) = λ λ = λ =, Since we have

More information

0.1 Diagonalization and its Applications

0.1 Diagonalization and its Applications .. DIAGONALIZATION AND ITS APPLICATIONS. Diagonalization and its Applications Exercise.. Let A be a -matrix whose characteristic polynomial is A (t) = t t + t +. a) Express A in term of powers A, A, and

More information

Copyright (c) 2006 Warren Weckesser

Copyright (c) 2006 Warren Weckesser 2.2. PLANAR LINEAR SYSTEMS 3 2.2. Planar Linear Systems We consider the linear system of two first order differential equations or equivalently, = ax + by (2.7) dy = cx + dy [ d x x = A x, where x =, and

More information

MATHEMATICS FOR ENGINEERS BASIC MATRIX THEORY TUTORIAL 3 - EIGENVECTORS AND EIGENVALUES

MATHEMATICS FOR ENGINEERS BASIC MATRIX THEORY TUTORIAL 3 - EIGENVECTORS AND EIGENVALUES MATHEMATICS FOR ENGINEERS BASIC MATRIX THEORY TUTORIAL 3 - EIGENVECTORS AND EIGENVALUES This is the third tutorial on matrix theory. It is entirely devoted to the subject of Eigenvectors and Eigenvalues

More information

Matrices and Deformation

Matrices and Deformation ES 111 Mathematical Methods in the Earth Sciences Matrices and Deformation Lecture Outline 13 - Thurs 9th Nov 2017 Strain Ellipse and Eigenvectors One way of thinking about a matrix is that it operates

More information

Linear Algebra - Part II

Linear Algebra - Part II Linear Algebra - Part II Projection, Eigendecomposition, SVD (Adapted from Sargur Srihari s slides) Brief Review from Part 1 Symmetric Matrix: A = A T Orthogonal Matrix: A T A = AA T = I and A 1 = A T

More information

Math 2331 Linear Algebra

Math 2331 Linear Algebra 5. Eigenvectors & Eigenvalues Math 233 Linear Algebra 5. Eigenvectors & Eigenvalues Shang-Huan Chiu Department of Mathematics, University of Houston schiu@math.uh.edu math.uh.edu/ schiu/ Shang-Huan Chiu,

More information

Econ Slides from Lecture 7

Econ Slides from Lecture 7 Econ 205 Sobel Econ 205 - Slides from Lecture 7 Joel Sobel August 31, 2010 Linear Algebra: Main Theory A linear combination of a collection of vectors {x 1,..., x k } is a vector of the form k λ ix i for

More information

Math 312 Lecture Notes Linear Two-dimensional Systems of Differential Equations

Math 312 Lecture Notes Linear Two-dimensional Systems of Differential Equations Math 2 Lecture Notes Linear Two-dimensional Systems of Differential Equations Warren Weckesser Department of Mathematics Colgate University February 2005 In these notes, we consider the linear system of

More information

Solutions to Final Practice Problems Written by Victoria Kala Last updated 12/5/2015

Solutions to Final Practice Problems Written by Victoria Kala Last updated 12/5/2015 Solutions to Final Practice Problems Written by Victoria Kala vtkala@math.ucsb.edu Last updated /5/05 Answers This page contains answers only. See the following pages for detailed solutions. (. (a x. See

More information

COMPLEX NUMBERS AND QUADRATIC EQUATIONS

COMPLEX NUMBERS AND QUADRATIC EQUATIONS Chapter 5 COMPLEX NUMBERS AND QUADRATIC EQUATIONS 5. Overview We know that the square of a real number is always non-negative e.g. (4) 6 and ( 4) 6. Therefore, square root of 6 is ± 4. What about the square

More information

Examination paper for TMA4110 Matematikk 3

Examination paper for TMA4110 Matematikk 3 Department of Mathematical Sciences Examination paper for TMA11 Matematikk 3 Academic contact during examination: Eugenia Malinnikova Phone: 735557 Examination date: 6th May, 15 Examination time (from

More information

Lecture 3 Eigenvalues and Eigenvectors

Lecture 3 Eigenvalues and Eigenvectors Lecture 3 Eigenvalues and Eigenvectors Eivind Eriksen BI Norwegian School of Management Department of Economics September 10, 2010 Eivind Eriksen (BI Dept of Economics) Lecture 3 Eigenvalues and Eigenvectors

More information

MATH 53H - Solutions to Problem Set III

MATH 53H - Solutions to Problem Set III MATH 53H - Solutions to Problem Set III. Fix λ not an eigenvalue of L. Then det(λi L) 0 λi L is invertible. We have then p L+N (λ) = det(λi L N) = det(λi L) det(i (λi L) N) = = p L (λ) det(i (λi L) N)

More information

Chapters 5 & 6: Theory Review: Solutions Math 308 F Spring 2015

Chapters 5 & 6: Theory Review: Solutions Math 308 F Spring 2015 Chapters 5 & 6: Theory Review: Solutions Math 308 F Spring 205. If A is a 3 3 triangular matrix, explain why det(a) is equal to the product of entries on the diagonal. If A is a lower triangular or diagonal

More information

Eigenpairs and Diagonalizability Math 401, Spring 2010, Professor David Levermore

Eigenpairs and Diagonalizability Math 401, Spring 2010, Professor David Levermore Eigenpairs and Diagonalizability Math 40, Spring 200, Professor David Levermore Eigenpairs Let A be an n n matrix A number λ possibly complex even when A is real is an eigenvalue of A if there exists a

More information

4 Matrix Diagonalization and Eigensystems

4 Matrix Diagonalization and Eigensystems 14.102, Math for Economists Fall 2004 Lecture Notes, 9/21/2004 These notes are primarily based on those written by George Marios Angeletos for the Harvard Math Camp in 1999 and 2000, and updated by Stavros

More information

Symmetric and anti symmetric matrices

Symmetric and anti symmetric matrices Symmetric and anti symmetric matrices In linear algebra, a symmetric matrix is a square matrix that is equal to its transpose. Formally, matrix A is symmetric if. A = A Because equal matrices have equal

More information

MATH 221, Spring Homework 10 Solutions

MATH 221, Spring Homework 10 Solutions MATH 22, Spring 28 - Homework Solutions Due Tuesday, May Section 52 Page 279, Problem 2: 4 λ A λi = and the characteristic polynomial is det(a λi) = ( 4 λ)( λ) ( )(6) = λ 6 λ 2 +λ+2 The solutions to the

More information

Linear Algebra: Matrix Eigenvalue Problems

Linear Algebra: Matrix Eigenvalue Problems CHAPTER8 Linear Algebra: Matrix Eigenvalue Problems Chapter 8 p1 A matrix eigenvalue problem considers the vector equation (1) Ax = λx. 8.0 Linear Algebra: Matrix Eigenvalue Problems Here A is a given

More information

MATH 304 Linear Algebra Lecture 33: Bases of eigenvectors. Diagonalization.

MATH 304 Linear Algebra Lecture 33: Bases of eigenvectors. Diagonalization. MATH 304 Linear Algebra Lecture 33: Bases of eigenvectors. Diagonalization. Eigenvalues and eigenvectors of an operator Definition. Let V be a vector space and L : V V be a linear operator. A number λ

More information

Math Matrix Algebra

Math Matrix Algebra Math 44 - Matrix Algebra Review notes - 4 (Alberto Bressan, Spring 27) Review of complex numbers In this chapter we shall need to work with complex numbers z C These can be written in the form z = a+ib,

More information

Eigenvalues and Eigenvectors

Eigenvalues and Eigenvectors Eigenvalues and Eigenvectors week -2 Fall 26 Eigenvalues and eigenvectors The most simple linear transformation from R n to R n may be the transformation of the form: T (x,,, x n ) (λ x, λ 2,, λ n x n

More information

Week Quadratic forms. Principal axes theorem. Text reference: this material corresponds to parts of sections 5.5, 8.2,

Week Quadratic forms. Principal axes theorem. Text reference: this material corresponds to parts of sections 5.5, 8.2, Math 051 W008 Margo Kondratieva Week 10-11 Quadratic forms Principal axes theorem Text reference: this material corresponds to parts of sections 55, 8, 83 89 Section 41 Motivation and introduction Consider

More information

CS 246 Review of Linear Algebra 01/17/19

CS 246 Review of Linear Algebra 01/17/19 1 Linear algebra In this section we will discuss vectors and matrices. We denote the (i, j)th entry of a matrix A as A ij, and the ith entry of a vector as v i. 1.1 Vectors and vector operations A vector

More information

JUST THE MATHS SLIDES NUMBER 9.6. MATRICES 6 (Eigenvalues and eigenvectors) A.J.Hobson

JUST THE MATHS SLIDES NUMBER 9.6. MATRICES 6 (Eigenvalues and eigenvectors) A.J.Hobson JUST THE MATHS SLIDES NUMBER 96 MATRICES 6 (Eigenvalues and eigenvectors) by AJHobson 96 The statement of the problem 962 The solution of the problem UNIT 96 - MATRICES 6 EIGENVALUES AND EIGENVECTORS 96

More information

Math 215 HW #9 Solutions

Math 215 HW #9 Solutions Math 5 HW #9 Solutions. Problem 4.4.. If A is a 5 by 5 matrix with all a ij, then det A. Volumes or the big formula or pivots should give some upper bound on the determinant. Answer: Let v i be the ith

More information

A = 3 1. We conclude that the algebraic multiplicity of the eigenvalues are both one, that is,

A = 3 1. We conclude that the algebraic multiplicity of the eigenvalues are both one, that is, 65 Diagonalizable Matrices It is useful to introduce few more concepts, that are common in the literature Definition 65 The characteristic polynomial of an n n matrix A is the function p(λ) det(a λi) Example

More information

DIAGONALIZATION. In order to see the implications of this definition, let us consider the following example Example 1. Consider the matrix

DIAGONALIZATION. In order to see the implications of this definition, let us consider the following example Example 1. Consider the matrix DIAGONALIZATION Definition We say that a matrix A of size n n is diagonalizable if there is a basis of R n consisting of eigenvectors of A ie if there are n linearly independent vectors v v n such that

More information

1 Inner Product and Orthogonality

1 Inner Product and Orthogonality CSCI 4/Fall 6/Vora/GWU/Orthogonality and Norms Inner Product and Orthogonality Definition : The inner product of two vectors x and y, x x x =.., y =. x n y y... y n is denoted x, y : Note that n x, y =

More information

JUST THE MATHS UNIT NUMBER 9.8. MATRICES 8 (Characteristic properties) & (Similarity transformations) A.J.Hobson

JUST THE MATHS UNIT NUMBER 9.8. MATRICES 8 (Characteristic properties) & (Similarity transformations) A.J.Hobson JUST THE MATHS UNIT NUMBER 9.8 MATRICES 8 (Characteristic properties) & (Similarity transformations) by A.J.Hobson 9.8. Properties of eigenvalues and eigenvectors 9.8. Similar matrices 9.8.3 Exercises

More information

Section 7.3 Double Angle Identities

Section 7.3 Double Angle Identities Section 7.3 Double Angle Identities 3 Section 7.3 Double Angle Identities Two special cases of the sum of angles identities arise often enough that we choose to state these identities separately. Identities

More information

What s Eigenanalysis? Matrix eigenanalysis is a computational theory for the matrix equation

What s Eigenanalysis? Matrix eigenanalysis is a computational theory for the matrix equation Eigenanalysis What s Eigenanalysis? Fourier s Eigenanalysis Model is a Replacement Process Powers and Fourier s Model Differential Equations and Fourier s Model Fourier s Model Illustrated What is Eigenanalysis?

More information

CS 143 Linear Algebra Review

CS 143 Linear Algebra Review CS 143 Linear Algebra Review Stefan Roth September 29, 2003 Introductory Remarks This review does not aim at mathematical rigor very much, but instead at ease of understanding and conciseness. Please see

More information

1. In this problem, if the statement is always true, circle T; otherwise, circle F.

1. In this problem, if the statement is always true, circle T; otherwise, circle F. Math 1553, Extra Practice for Midterm 3 (sections 45-65) Solutions 1 In this problem, if the statement is always true, circle T; otherwise, circle F a) T F If A is a square matrix and the homogeneous equation

More information

Math 1553 Worksheet 5.3, 5.5

Math 1553 Worksheet 5.3, 5.5 Math Worksheet, Answer yes / no / maybe In each case, A is a matrix whose entries are real a) If A is a matrix with characteristic polynomial λ(λ ), then the - eigenspace is -dimensional b) If A is an

More information

Mathematical Foundations

Mathematical Foundations Chapter 1 Mathematical Foundations 1.1 Big-O Notations In the description of algorithmic complexity, we often have to use the order notations, often in terms of big O and small o. Loosely speaking, for

More information

Introduction. The first chapter of FP1 introduces you to imaginary and complex numbers

Introduction. The first chapter of FP1 introduces you to imaginary and complex numbers Introduction The first chapter of FP1 introduces you to imaginary and complex numbers You will have seen at GCSE level that some quadratic equations cannot be solved Imaginary and complex numbers will

More information

Knowledge Discovery and Data Mining 1 (VO) ( )

Knowledge Discovery and Data Mining 1 (VO) ( ) Knowledge Discovery and Data Mining 1 (VO) (707.003) Review of Linear Algebra Denis Helic KTI, TU Graz Oct 9, 2014 Denis Helic (KTI, TU Graz) KDDM1 Oct 9, 2014 1 / 74 Big picture: KDDM Probability Theory

More information

EE263: Introduction to Linear Dynamical Systems Review Session 5

EE263: Introduction to Linear Dynamical Systems Review Session 5 EE263: Introduction to Linear Dynamical Systems Review Session 5 Outline eigenvalues and eigenvectors diagonalization matrix exponential EE263 RS5 1 Eigenvalues and eigenvectors we say that λ C is an eigenvalue

More information

TBP MATH33A Review Sheet. November 24, 2018

TBP MATH33A Review Sheet. November 24, 2018 TBP MATH33A Review Sheet November 24, 2018 General Transformation Matrices: Function Scaling by k Orthogonal projection onto line L Implementation If we want to scale I 2 by k, we use the following: [

More information

Math 240 Calculus III

Math 240 Calculus III Generalized Calculus III Summer 2015, Session II Thursday, July 23, 2015 Agenda 1. 2. 3. 4. Motivation Defective matrices cannot be diagonalized because they do not possess enough eigenvectors to make

More information

a 11 a 12 a 11 a 12 a 13 a 21 a 22 a 23 . a 31 a 32 a 33 a 12 a 21 a 23 a 31 a = = = = 12

a 11 a 12 a 11 a 12 a 13 a 21 a 22 a 23 . a 31 a 32 a 33 a 12 a 21 a 23 a 31 a = = = = 12 24 8 Matrices Determinant of 2 2 matrix Given a 2 2 matrix [ ] a a A = 2 a 2 a 22 the real number a a 22 a 2 a 2 is determinant and denoted by det(a) = a a 2 a 2 a 22 Example 8 Find determinant of 2 2

More information

Chapter 6. Eigenvalues. Josef Leydold Mathematical Methods WS 2018/19 6 Eigenvalues 1 / 45

Chapter 6. Eigenvalues. Josef Leydold Mathematical Methods WS 2018/19 6 Eigenvalues 1 / 45 Chapter 6 Eigenvalues Josef Leydold Mathematical Methods WS 2018/19 6 Eigenvalues 1 / 45 Closed Leontief Model In a closed Leontief input-output-model consumption and production coincide, i.e. V x = x

More information

DM554 Linear and Integer Programming. Lecture 9. Diagonalization. Marco Chiarandini

DM554 Linear and Integer Programming. Lecture 9. Diagonalization. Marco Chiarandini DM554 Linear and Integer Programming Lecture 9 Marco Chiarandini Department of Mathematics & Computer Science University of Southern Denmark Outline 1. More on 2. 3. 2 Resume Linear transformations and

More information

4. Determinants.

4. Determinants. 4. Determinants 4.1. Determinants; Cofactor Expansion Determinants of 2 2 and 3 3 Matrices 2 2 determinant 4.1. Determinants; Cofactor Expansion Determinants of 2 2 and 3 3 Matrices 3 3 determinant 4.1.

More information

Even-Numbered Homework Solutions

Even-Numbered Homework Solutions -6 Even-Numbered Homework Solutions Suppose that the matric B has λ = + 5i as an eigenvalue with eigenvector Y 0 = solution to dy = BY Using Euler s formula, we can write the complex-valued solution Y

More information

Eigenvalues. Matrices: Geometric Interpretation. Calculating Eigenvalues

Eigenvalues. Matrices: Geometric Interpretation. Calculating Eigenvalues Eigenvalues Matrices: Geometric Interpretation Start with a vector of length 2, for example, x =(1, 2). This among other things give the coordinates for a point on a plane. Take a 2 2 matrix, for example,

More information

4. Linear transformations as a vector space 17

4. Linear transformations as a vector space 17 4 Linear transformations as a vector space 17 d) 1 2 0 0 1 2 0 0 1 0 0 0 1 2 3 4 32 Let a linear transformation in R 2 be the reflection in the line = x 2 Find its matrix 33 For each linear transformation

More information

Math 315: Linear Algebra Solutions to Assignment 7

Math 315: Linear Algebra Solutions to Assignment 7 Math 5: Linear Algebra s to Assignment 7 # Find the eigenvalues of the following matrices. (a.) 4 0 0 0 (b.) 0 0 9 5 4. (a.) The characteristic polynomial det(λi A) = (λ )(λ )(λ ), so the eigenvalues are

More information

Math Homework 8 (selected problems)

Math Homework 8 (selected problems) Math 102 - Homework 8 (selected problems) David Lipshutz Problem 1. (Strang, 5.5: #14) In the list below, which classes of matrices contain A and which contain B? 1 1 1 1 A 0 0 1 0 0 0 0 1 and B 1 1 1

More information

cos + i sin = cos + i sin = cos 2π iθ

cos + i sin = cos + i sin = cos 2π iθ Complx numbrs 1C cosθ + sinθ = cosθ + i sin θ 1 a cosθ + sin θ = cos12θ + i sin12θ b 4 c d f 2 a b c d π π π π cos + isin = cos + isin 8 i = + π π 8π 8π 2π 2π cos + isin = cos + isin = cos + isin 1 i =

More information

Lecture Notes 6: Dynamic Equations Part C: Linear Difference Equation Systems

Lecture Notes 6: Dynamic Equations Part C: Linear Difference Equation Systems University of Warwick, EC9A0 Maths for Economists Peter J. Hammond 1 of 45 Lecture Notes 6: Dynamic Equations Part C: Linear Difference Equation Systems Peter J. Hammond latest revision 2017 September

More information

Math 3301 Homework Set Points ( ) ( ) I ll leave it to you to verify that the eigenvalues and eigenvectors for this matrix are, ( ) ( ) ( ) ( )

Math 3301 Homework Set Points ( ) ( ) I ll leave it to you to verify that the eigenvalues and eigenvectors for this matrix are, ( ) ( ) ( ) ( ) #7. ( pts) I ll leave it to you to verify that the eigenvalues and eigenvectors for this matrix are, λ 5 λ 7 t t ce The general solution is then : 5 7 c c c x( 0) c c 9 9 c+ c c t 5t 7 e + e A sketch of

More information

π 1 = tr(a), π n = ( 1) n det(a). In particular, when n = 2 one has

π 1 = tr(a), π n = ( 1) n det(a). In particular, when n = 2 one has Eigen Methods Math 246, Spring 2009, Professor David Levermore Eigenpairs Let A be a real n n matrix A number λ possibly complex is an eigenvalue of A if there exists a nonzero vector v possibly complex

More information

Matrices and Linear Algebra

Matrices and Linear Algebra Contents Quantitative methods for Economics and Business University of Ferrara Academic year 2017-2018 Contents 1 Basics 2 3 4 5 Contents 1 Basics 2 3 4 5 Contents 1 Basics 2 3 4 5 Contents 1 Basics 2

More information

Introduction to Matrix Algebra

Introduction to Matrix Algebra Introduction to Matrix Algebra August 18, 2010 1 Vectors 1.1 Notations A p-dimensional vector is p numbers put together. Written as x 1 x =. x p. When p = 1, this represents a point in the line. When p

More information

Jordan Normal Form and Singular Decomposition

Jordan Normal Form and Singular Decomposition University of Debrecen Diagonalization and eigenvalues Diagonalization We have seen that if A is an n n square matrix, then A is diagonalizable if and only if for all λ eigenvalues of A we have dim(u λ

More information

COMP 558 lecture 18 Nov. 15, 2010

COMP 558 lecture 18 Nov. 15, 2010 Least squares We have seen several least squares problems thus far, and we will see more in the upcoming lectures. For this reason it is good to have a more general picture of these problems and how to

More information

The Derivative. Appendix B. B.1 The Derivative of f. Mappings from IR to IR

The Derivative. Appendix B. B.1 The Derivative of f. Mappings from IR to IR Appendix B The Derivative B.1 The Derivative of f In this chapter, we give a short summary of the derivative. Specifically, we want to compare/contrast how the derivative appears for functions whose domain

More information

ELLIPSES. Problem: Find the points on the locus. Q(x, y) = 865x 2 294xy + 585y 2 = closest to, and farthest from, the origin. Answer.

ELLIPSES. Problem: Find the points on the locus. Q(x, y) = 865x 2 294xy + 585y 2 = closest to, and farthest from, the origin. Answer. ELLIPSES Problem: Find the points on the locus closest to, and farthest from, the origin. Answer. Q(x, y) 865x 2 294xy + 585y 2 1450 This is a Lagrange multiplier problem: we want to extremize f(x, y)

More information

Fall 2016 Math 2B Suggested Homework Problems Solutions

Fall 2016 Math 2B Suggested Homework Problems Solutions Fall 016 Math B Suggested Homework Problems Solutions Antiderivatives Exercise : For all x ], + [, the most general antiderivative of f is given by : ( x ( x F(x = + x + C = 1 x x + x + C. Exercise 4 :

More information

Solutions to the Calculus and Linear Algebra problems on the Comprehensive Examination of January 28, 2011

Solutions to the Calculus and Linear Algebra problems on the Comprehensive Examination of January 28, 2011 Solutions to the Calculus and Linear Algebra problems on the Comprehensive Examination of January 8, Solutions to Problems 5 are omitted since they involve topics no longer covered on the Comprehensive

More information

MTH 102: Linear Algebra Department of Mathematics and Statistics Indian Institute of Technology - Kanpur. Problem Set

MTH 102: Linear Algebra Department of Mathematics and Statistics Indian Institute of Technology - Kanpur. Problem Set MTH 102: Linear Algebra Department of Mathematics and Statistics Indian Institute of Technology - Kanpur Problem Set 6 Problems marked (T) are for discussions in Tutorial sessions. 1. Find the eigenvalues

More information

Further Mathematical Methods (Linear Algebra)

Further Mathematical Methods (Linear Algebra) Further Mathematical Methods (Linear Algebra) Solutions For The Examination Question (a) To be an inner product on the real vector space V a function x y which maps vectors x y V to R must be such that:

More information

Autonomous system = system without inputs

Autonomous system = system without inputs Autonomous system = system without inputs State space representation B(A,C) = {y there is x, such that σx = Ax, y = Cx } x is the state, n := dim(x) is the state dimension, y is the output Polynomial representation

More information

z = a + ib (4.1) i 2 = 1. (4.2) <(z) = a, (4.3) =(z) = b. (4.4)

z = a + ib (4.1) i 2 = 1. (4.2) <(z) = a, (4.3) =(z) = b. (4.4) Chapter 4 Complex Numbers 4.1 Definition of Complex Numbers A complex number is a number of the form where a and b are real numbers and i has the property that z a + ib (4.1) i 2 1. (4.2) a is called the

More information

2.10 Saddles, Nodes, Foci and Centers

2.10 Saddles, Nodes, Foci and Centers 2.10 Saddles, Nodes, Foci and Centers In Section 1.5, a linear system (1 where x R 2 was said to have a saddle, node, focus or center at the origin if its phase portrait was linearly equivalent to one

More information

Constant coefficients systems

Constant coefficients systems 5.3. 2 2 Constant coefficients systems Section Objective(s): Diagonalizable systems. Real Distinct Eigenvalues. Complex Eigenvalues. Non-Diagonalizable systems. 5.3.. Diagonalizable Systems. Remark: We

More information

1. General Vector Spaces

1. General Vector Spaces 1.1. Vector space axioms. 1. General Vector Spaces Definition 1.1. Let V be a nonempty set of objects on which the operations of addition and scalar multiplication are defined. By addition we mean a rule

More information

(the matrix with b 1 and b 2 as columns). If x is a vector in R 2, then its coordinate vector [x] B relative to B satisfies the formula.

(the matrix with b 1 and b 2 as columns). If x is a vector in R 2, then its coordinate vector [x] B relative to B satisfies the formula. 4 Diagonalization 4 Change of basis Let B (b,b ) be an ordered basis for R and let B b b (the matrix with b and b as columns) If x is a vector in R, then its coordinate vector x B relative to B satisfies

More information

ICS 6N Computational Linear Algebra Eigenvalues and Eigenvectors

ICS 6N Computational Linear Algebra Eigenvalues and Eigenvectors ICS 6N Computational Linear Algebra Eigenvalues and Eigenvectors Xiaohui Xie University of California, Irvine xhx@uci.edu Xiaohui Xie (UCI) ICS 6N 1 / 34 The powers of matrix Consider the following dynamic

More information

2 Eigenvectors and Eigenvalues in abstract spaces.

2 Eigenvectors and Eigenvalues in abstract spaces. MA322 Sathaye Notes on Eigenvalues Spring 27 Introduction In these notes, we start with the definition of eigenvectors in abstract vector spaces and follow with the more common definition of eigenvectors

More information

MAT2342 : Introduction to Linear Algebra Mike Newman, 5 October assignment 1

MAT2342 : Introduction to Linear Algebra Mike Newman, 5 October assignment 1 [/8 MAT4 : Introduction to Linear Algebra Mike Newman, 5 October 07 assignment You must show your work. You may use software or solvers of some sort to check calculation of eigenvalues, but you should

More information

Eigenvalues for Triangular Matrices. ENGI 7825: Linear Algebra Review Finding Eigenvalues and Diagonalization

Eigenvalues for Triangular Matrices. ENGI 7825: Linear Algebra Review Finding Eigenvalues and Diagonalization Eigenvalues for Triangular Matrices ENGI 78: Linear Algebra Review Finding Eigenvalues and Diagonalization Adapted from Notes Developed by Martin Scharlemann The eigenvalues for a triangular matrix are

More information

Eigenvalues and Eigenvectors 7.1 Eigenvalues and Eigenvecto

Eigenvalues and Eigenvectors 7.1 Eigenvalues and Eigenvecto 7.1 November 6 7.1 Eigenvalues and Eigenvecto Goals Suppose A is square matrix of order n. Eigenvalues of A will be defined. Eigenvectors of A, corresponding to each eigenvalue, will be defined. Eigenspaces

More information

Solutions to Dynamical Systems 2010 exam. Each question is worth 25 marks.

Solutions to Dynamical Systems 2010 exam. Each question is worth 25 marks. Solutions to Dynamical Systems exam Each question is worth marks [Unseen] Consider the following st order differential equation: dy dt Xy yy 4 a Find and classify all the fixed points of Hence draw the

More information

MATH 1553 PRACTICE MIDTERM 3 (VERSION B)

MATH 1553 PRACTICE MIDTERM 3 (VERSION B) MATH 1553 PRACTICE MIDTERM 3 (VERSION B) Name Section 1 2 3 4 5 Total Please read all instructions carefully before beginning. Each problem is worth 10 points. The maximum score on this exam is 50 points.

More information

Further Mathematical Methods (Linear Algebra)

Further Mathematical Methods (Linear Algebra) Further Mathematical Methods (Linear Algebra) Solutions For The 2 Examination Question (a) For a non-empty subset W of V to be a subspace of V we require that for all vectors x y W and all scalars α R:

More information

Statistics 992 Continuous-time Markov Chains Spring 2004

Statistics 992 Continuous-time Markov Chains Spring 2004 Summary Continuous-time finite-state-space Markov chains are stochastic processes that are widely used to model the process of nucleotide substitution. This chapter aims to present much of the mathematics

More information

Math Ordinary Differential Equations

Math Ordinary Differential Equations Math 411 - Ordinary Differential Equations Review Notes - 1 1 - Basic Theory A first order ordinary differential equation has the form x = f(t, x) (11) Here x = dx/dt Given an initial data x(t 0 ) = x

More information

Study Notes on Matrices & Determinants for GATE 2017

Study Notes on Matrices & Determinants for GATE 2017 Study Notes on Matrices & Determinants for GATE 2017 Matrices and Determinates are undoubtedly one of the most scoring and high yielding topics in GATE. At least 3-4 questions are always anticipated from

More information

Chapter 5. Eigenvalues and Eigenvectors

Chapter 5. Eigenvalues and Eigenvectors Chapter 5 Eigenvalues and Eigenvectors Section 5. Eigenvectors and Eigenvalues Motivation: Difference equations A Biology Question How to predict a population of rabbits with given dynamics:. half of the

More information

2013 Leaving Cert Higher Level Official Sample Paper 1

2013 Leaving Cert Higher Level Official Sample Paper 1 013 Leaving Cert Higher Level Official Sample Paper 1 Section A Concepts and Skills 150 marks Question 1 (5 marks) (a) w 1 + 3i is a complex number, where i 1. (i) Write w in polar form. We have w ( 1)

More information

Lecture Notes 6: Dynamic Equations Part B: Second and Higher-Order Linear Difference Equations in One Variable

Lecture Notes 6: Dynamic Equations Part B: Second and Higher-Order Linear Difference Equations in One Variable University of Warwick, EC9A0 Maths for Economists Peter J. Hammond 1 of 56 Lecture Notes 6: Dynamic Equations Part B: Second and Higher-Order Linear Difference Equations in One Variable Peter J. Hammond

More information

Math 4A Notes. Written by Victoria Kala Last updated June 11, 2017

Math 4A Notes. Written by Victoria Kala Last updated June 11, 2017 Math 4A Notes Written by Victoria Kala vtkala@math.ucsb.edu Last updated June 11, 2017 Systems of Linear Equations A linear equation is an equation that can be written in the form a 1 x 1 + a 2 x 2 +...

More information

Summer Session Practice Final Exam

Summer Session Practice Final Exam Math 2F Summer Session 25 Practice Final Exam Time Limit: Hours Name (Print): Teaching Assistant This exam contains pages (including this cover page) and 9 problems. Check to see if any pages are missing.

More information

Numerical Linear Algebra Homework Assignment - Week 2

Numerical Linear Algebra Homework Assignment - Week 2 Numerical Linear Algebra Homework Assignment - Week 2 Đoàn Trần Nguyên Tùng Student ID: 1411352 8th October 2016 Exercise 2.1: Show that if a matrix A is both triangular and unitary, then it is diagonal.

More information

Lec 2: Mathematical Economics

Lec 2: Mathematical Economics Lec 2: Mathematical Economics to Spectral Theory Sugata Bag Delhi School of Economics 24th August 2012 [SB] (Delhi School of Economics) Introductory Math Econ 24th August 2012 1 / 17 Definition: Eigen

More information

Math 108b: Notes on the Spectral Theorem

Math 108b: Notes on the Spectral Theorem Math 108b: Notes on the Spectral Theorem From section 6.3, we know that every linear operator T on a finite dimensional inner product space V has an adjoint. (T is defined as the unique linear operator

More information

Polynomial Jacobi Davidson Method for Large/Sparse Eigenvalue Problems

Polynomial Jacobi Davidson Method for Large/Sparse Eigenvalue Problems Polynomial Jacobi Davidson Method for Large/Sparse Eigenvalue Problems Tsung-Ming Huang Department of Mathematics National Taiwan Normal University, Taiwan April 28, 2011 T.M. Huang (Taiwan Normal Univ.)

More information

MATH 423 Linear Algebra II Lecture 20: Geometry of linear transformations. Eigenvalues and eigenvectors. Characteristic polynomial.

MATH 423 Linear Algebra II Lecture 20: Geometry of linear transformations. Eigenvalues and eigenvectors. Characteristic polynomial. MATH 423 Linear Algebra II Lecture 20: Geometry of linear transformations. Eigenvalues and eigenvectors. Characteristic polynomial. Geometric properties of determinants 2 2 determinants and plane geometry

More information

Linear Algebra. Matrices Operations. Consider, for example, a system of equations such as x + 2y z + 4w = 0, 3x 4y + 2z 6w = 0, x 3y 2z + w = 0.

Linear Algebra. Matrices Operations. Consider, for example, a system of equations such as x + 2y z + 4w = 0, 3x 4y + 2z 6w = 0, x 3y 2z + w = 0. Matrices Operations Linear Algebra Consider, for example, a system of equations such as x + 2y z + 4w = 0, 3x 4y + 2z 6w = 0, x 3y 2z + w = 0 The rectangular array 1 2 1 4 3 4 2 6 1 3 2 1 in which the

More information

Dynamical Systems. August 13, 2013

Dynamical Systems. August 13, 2013 Dynamical Systems Joshua Wilde, revised by Isabel Tecu, Takeshi Suzuki and María José Boccardi August 13, 2013 Dynamical Systems are systems, described by one or more equations, that evolve over time.

More information

Today in Physics 218: Fresnel s equations

Today in Physics 218: Fresnel s equations Today in Physics 8: Fresnel s equations Transmission and reflection with E parallel to the incidence plane The Fresnel equations Total internal reflection Polarization on reflection nterference R 08 06

More information

SET 1. (1) Solve for x: (a) e 2x = 5 3x

SET 1. (1) Solve for x: (a) e 2x = 5 3x () Solve for x: (a) e x = 5 3x SET We take natural log on both sides: ln(e x ) = ln(5 3x ) x = 3 x ln(5) Now we take log base on both sides: log ( x ) = log (3 x ln 5) x = log (3 x ) + log (ln(5)) x x

More information