In these chapter 2A notes write vectors in boldface to reduce the ambiguity of the notation.

Save this PDF as:
 WORD  PNG  TXT  JPG

Size: px
Start display at page:

Download "In these chapter 2A notes write vectors in boldface to reduce the ambiguity of the notation."

Transcription

1 1 2 Linear Systems In these chapter 2A notes write vectors in boldface to reduce the ambiguity of the notation 21 Matrix ODEs Let and is a scalar A linear function satisfies Linear superposition ) Linear scaling: Example: is not a linear function instead it is affine General form of a linear function: In matrix notation: Assume is a real matrix and General form for a linear ODE Example: (Linearization about an equilibrium point) Let Recall Taylor series expansion about Linear approximation at corresponds to throwing away the higher order terms Now suppose The same equation applies if the derivative is interpreted as a matrix Now suppose has an equilibrium point Expand the right hand side of the ODE in Taylor series about and use to obtain: Finally substitute let and make a linear approximation by throwing away the higher order terms to get This process of linearization about an equilibrium point is an important technique in the analysis of ODEs

2 2 Eigenvalues and Eigenvectors Let A be a real matrix and An eigenvector v of A is a nonzero solution of is the corresponding eigenvalue From linear algebra we know that the eigenvalues of a matrix A are given by the roots of the characteristic polynomial Look for solutions of [1] of form Substitution into [1] leads to Since is nonzero this implies with solution for an arbitrary constant The corresponding solution of [1] is Example: Consider the matrix Eigenvalues are solutions of They are and The first eigenvector satisfies or Letting we have This has the solution Eigenvectors are determined up to an arbitrary multiplicative factor Similarly find Two solutions of [1] for this matrix A are and Sketch examples of and in the ( plane Meiss calls these straight line solutions

3 3 Diagonalization Since [1] is linear linear combinations of solutions are themselves solutions Ex: If has linearly independent eigenvectors then these span In this case we also say that has a complete set of eigenvectors The matrix is nonsingular [Vertical bars separate column vectors] Then is the matrix with eigenvalues on the main diagonal and zeros in all of the other slots Multiplying by on the left to obtain In this case we say is diagonalizable or semisimple Example (continued) The inverse of any matrix is where Then use from the example above to obtain and Then we find If has linearly independent eigenvectors then any can be written as a linear combination of these where can be regarded as the coordinates of the point in eigenvector coordinates The matrix transforms from eigenvector coordinates to standard coordinates Correspondingly the matrix transforms back from standard coordinates to eigenvector coordinates With this in mind consider [1] Multiply on the left by to get:

4 4 [2] where are the coordinates of the point in the basis of eigenvectors Since is a diagonal matrix the equations [2] are not coupled The i^th component is just with solution for some constant In matrix notation this solution is written where Summary Our results in this subsection allow us to solve the following initial value problem in the case that the real matrix has a complete set of eigenvectors : The matrix initial condition by is nonsingular Multiply both the differential equation and the on the left to get Solve this uncoupled system to get and then multiply on the left by to get [3] where 22 Two-Dimensional Linear Systems Classify the two-dimensional linear systems according to the qualitative nature of their solutions These are systems of the form where is a matrix Eigenvalues are the roots of the characteristic polynomial Here is the trace of and is the determinant of The roots are

5 5 [6] where the is the discriminant of Qualitatively different cases of eigenvalues divide plane into 5 regions: Sketch of plane and the parabola Include in each of the 5 regions a sketch of the complex plane This is Meiss Fig 21 Note that the eigenvalues are distinct off of the parabola According to a theorem of linear algebra when the eigenvalues are distinct the corresponding eigenvectors will be too Then is diagonalizable and the general solution of the initial value problem has the form of [3] For the 2D case this may be written [4] The 5 regions of the plane correspond to 5 geometrically distinct phase portraits: [A] Unstable node: There are straight line solutions moving away from the origin that correspond to initial conditions on the eigenspaces and Other solutions are asymptotically parallel to as and asymptotically parallel to as Sketch -plane and several trajectories Like Meiss Fig 22 [B] Stable node: This is like [A] with arrows reversed and with and interchanged Straight line solutions move toward the origin on and Other solutions are asymptotically parallel to as and asymptotically parallel to as Sketch -plane and several trajectories [C] Saddle: Straight line solutions move away from the origin on and towards the origin on Other solution are asymptotic to as and asymptotic to as Sketch -plane and several trajectories Like Meiss Fig 23 [D] Unstable focus: Both the eigenvalues and eigenvectors are complex conjugate (To see this just take the complex conjugate of A ) Let where and are real vectors The solution is still given by [4] where and must also be conjugate in order that the solution be real Let these expressions into the right hand side of [4] one obtains [5] Substituting

6 6 We have written The solution is an exponentially expanding spiral Example The following phase portrait was constructed for the linear system with For this case and so that [E] Stable focus: The analysis is similar to that for an unstable focus The solution is an exponentially contracting spiral There are also several cases corresponding to boundaries between the 5 regions on the -plane The first two cases correspond to non-isolated equilibria which occur when there is a zero eigenvalue giving

7 7 [a] Unstable degenerate equilibrium: The eigenspace is a line of unstable equilibria Solutions that originate off this line move away exponentially as along lines parallel to [b] Stable degenerate equilibrium: The eigenspace is a line of stable equilibria Solutions that originate off this line move away exponentially as along lines parallel to [c] Center: are obtained for and The analysis is given by [5] with Trajectories are ellipses This case is particularly important both because it occurs in bifurcations (chapter 8) and because Hamiltonian systems always have To analyze the boundary states corresponding to the parabola we need to recall some concepts from linear algebra beginning with two concepts of the multiplicity of an eigenvalue: An eigenvalue has algebraic multiplicity if the characteristic polynomial can be written where ie is a -fold root of the characteristic polynomial An eigenvalue has geometric multiplicity if it has linearly independent eigenvectors ie and A theorem of linear algebra is that the geometric multiplicity is at most the algebraic multiplicity When the geometric multiplicity is less than the algebraic multiplicity the matrix is defective The column space or range of a matrix is defined to be the span of its column vectors If then The rank of B is the dimension of the range: Then the geometric multiplicity of is The null space or kernel of a matrix B is the set of vectors that the matrix send to zero: For example consider an eigenvalue and eigenvector of matrix These satisfy or equivalently Then The dimension of the kernel is called the nullity of a matrix:

8 8 If matrix has columns a theorem of linear algebra implies that Continue the example If the geometric multiplicity of is then has linearly independent eigenvectors associated with and Return to the analysis of the boundary states in the -plane on the parabola where is the trace of and is the determinant of Then [6] implies that the matrix has an eigenvalue of algebraic multiplicity 2 When the geometric multiplicity of is 2 That is for every vector This implies Every nonzero vector is an eigenvector and the solution of is uniform expansion away from the origin for or uniform contraction toward the origin for When the geometric multiplicity of is 1 the matrix has only a single eigenvector This means [4] cannot be the general solution of the initial value problem The solution will be obtained in section Exponentials of Operators Let be a vector space We may have or but results in this section also apply to infinite dimensional vector spaces An operator maps a vector to some other vector A linear operator T satisfies linear superposition and scaling If and and are scalars then If and is a basis for then T will be represented by a matrix in that basis In this case may replaced by in the equations below We write the space of linear operators on is itself an dimensional vector space Notice that a matrix representing has components If then represents the Euclidean norm: We will also define an operator norm The operator norm satisfies the usual properties for norms In particular the triangle inequality is satisfied If S and T are operators on then [The matrix norm is a continuous function of its argument See Hirsch and Smale p 78]

9 9 A linear operator also satisfies since for For any integer we have by the same logic Since this is true for all we conclude [6] An operator for which is said to be bounded Example Suppose On a finite dimensional vector space the sphere is compact and the Euclidean norm is continuous Therefore attains a maximum value on the sphere and is bounded A series in a normed vector space is absolutely convergent if the series converges This condition implies that converges (Hirsch and Smale 1974) Recall the Taylor series for about from calculus: We formally define the exponential of an operator in the same way: [7] Lemma 21 If T is a bounded linear operator then is as well Proof By [6] and the series of real numbers converges to Therefore the series [7] converges absolutely by the comparison test It also follows that Properties of the exponential The first 6 of these are from Meiss His Roman numerals are given but in my order I have added a property (vii) [i] This is a direct consequence of the definition of the exponential [v] If then

10 10 Notice and insert in the definition of the exponential [vi] If is an eigenvector of with eigenvalue then Notice and let [iv] If B is nonsingular then Using the definition of the exponential [iii] If A and B commute then (the law of exponents!) See exercise #6 The idea of part (a) is that if and are real numbers then the series for their exponentials can be manipulated to show that Since matrices and commute their series can be manipulated in the same way However the manipulation is complicated Parts (b) and (c) provide a much shorter proof [ii] Follows directly from the property [iii] [vii] The matrices and commute Let be a positive integer then and let The three examples given at the end of this section are important The first anticipates results in section 26 Example (Nilpotent matrices) A matrix N has nilpotency k if but For example consider where has nilpotency 2 Every matrix commutes with the identity matrix; in particular the matrices and N commute Then from property (iii) where only the first two terms in the series for are nonzero Example (Roots of Identity) This result will be used in the next example The matrix

11 11 has powers Insert into the definition of the matrix exponential and recall the MacLaurin series To obtain Example (Rotation Matrix) If is real and has a pair of complex conjugate eigenvalues then the associated eigenvectors will also be complex conjugate Let the eigenvectors be denoted and We will see in section 25 that when A is transformed using the matrix we get the form From the example above The matrix in the last expression rotates a vector in the plane clockwise by an angle 24 Fundamental Solution Theorem Theorem 23 Let be an matrix Then the initial value problem [1] has the unique solution Proof First demonstrate that the solution works The differential equation is satisfied:

12 12 The initial condition is also satisfied: To show that the solution is unique suppose Then use the product rule to obtain is another solution of the initial value problem where we have also used the fact that and commute Therefore is a constant and by property (ii) in section 23 Moreover since the two solutions must satisfy the same initial condition Example Mass-spring system Consider a spring of natural length L mass m and Hooke s law constant k on a frictionless table: The figure shows the spring extended a distance of motion gives beyond its natural length Newton s law This ODE is affine but we can make it linear by substituting Then get This can be further simplified by introducing the dimensionless time where Denote to get Write as a first order system

13 13 Consider the initial value problem using : Note that and According to the classification of linear systems the solution is a center By the Fundamental Theorem the solution of the initial value problem is Finally express the answer in terms of : where and Consider the result of Theorem 23 for a set of initial condition vectors Put the initial condition vectors together to form a matrix and the solutions together to form We then have Theorem 24 The matrix initial value problem Has the unique solution A matrix initial value problem is used in the beautiful proof of the law of exponents for the matrix exponential given by problem 6 parts (b) and (c)! The fundamental matrix solution is the solution of the initial value problem Its name arises from the fact that solve the initial value problem [1] for any Check by calculating (t) and using this formula When is a constant matrix We will return to fundamental matrix solution in section 28 when we will consider a function of time

8.1 Bifurcations of Equilibria

8.1 Bifurcations of Equilibria 1 81 Bifurcations of Equilibria Bifurcation theory studies qualitative changes in solutions as a parameter varies In general one could study the bifurcation theory of ODEs PDEs integro-differential equations

More information

7 Planar systems of linear ODE

7 Planar systems of linear ODE 7 Planar systems of linear ODE Here I restrict my attention to a very special class of autonomous ODE: linear ODE with constant coefficients This is arguably the only class of ODE for which explicit solution

More information

AN ELEMENTARY PROOF OF THE SPECTRAL RADIUS FORMULA FOR MATRICES

AN ELEMENTARY PROOF OF THE SPECTRAL RADIUS FORMULA FOR MATRICES AN ELEMENTARY PROOF OF THE SPECTRAL RADIUS FORMULA FOR MATRICES JOEL A. TROPP Abstract. We present an elementary proof that the spectral radius of a matrix A may be obtained using the formula ρ(a) lim

More information

Linear Algebra Practice Problems

Linear Algebra Practice Problems Linear Algebra Practice Problems Math 24 Calculus III Summer 25, Session II. Determine whether the given set is a vector space. If not, give at least one axiom that is not satisfied. Unless otherwise stated,

More information

1. General Vector Spaces

1. General Vector Spaces 1.1. Vector space axioms. 1. General Vector Spaces Definition 1.1. Let V be a nonempty set of objects on which the operations of addition and scalar multiplication are defined. By addition we mean a rule

More information

NONCOMMUTATIVE POLYNOMIAL EQUATIONS. Edward S. Letzter. Introduction

NONCOMMUTATIVE POLYNOMIAL EQUATIONS. Edward S. Letzter. Introduction NONCOMMUTATIVE POLYNOMIAL EQUATIONS Edward S Letzter Introduction My aim in these notes is twofold: First, to briefly review some linear algebra Second, to provide you with some new tools and techniques

More information

AS and A level Further mathematics contents lists

AS and A level Further mathematics contents lists AS and A level Further mathematics contents lists Contents Core Pure Mathematics Book 1/AS... 2 Core Pure Mathematics Book 2... 4 Further Pure Mathematics 1... 6 Further Pure Mathematics 2... 8 Further

More information

Def. (a, b) is a critical point of the autonomous system. 1 Proper node (stable or unstable) 2 Improper node (stable or unstable)

Def. (a, b) is a critical point of the autonomous system. 1 Proper node (stable or unstable) 2 Improper node (stable or unstable) Types of critical points Def. (a, b) is a critical point of the autonomous system Math 216 Differential Equations Kenneth Harris kaharri@umich.edu Department of Mathematics University of Michigan November

More information

MA 265 FINAL EXAM Fall 2012

MA 265 FINAL EXAM Fall 2012 MA 265 FINAL EXAM Fall 22 NAME: INSTRUCTOR S NAME:. There are a total of 25 problems. You should show work on the exam sheet, and pencil in the correct answer on the scantron. 2. No books, notes, or calculators

More information

and let s calculate the image of some vectors under the transformation T.

and let s calculate the image of some vectors under the transformation T. Chapter 5 Eigenvalues and Eigenvectors 5. Eigenvalues and Eigenvectors Let T : R n R n be a linear transformation. Then T can be represented by a matrix (the standard matrix), and we can write T ( v) =

More information

4. Linear transformations as a vector space 17

4. Linear transformations as a vector space 17 4 Linear transformations as a vector space 17 d) 1 2 0 0 1 2 0 0 1 0 0 0 1 2 3 4 32 Let a linear transformation in R 2 be the reflection in the line = x 2 Find its matrix 33 For each linear transformation

More information

One Dimensional Dynamical Systems

One Dimensional Dynamical Systems 16 CHAPTER 2 One Dimensional Dynamical Systems We begin by analyzing some dynamical systems with one-dimensional phase spaces, and in particular their bifurcations. All equations in this Chapter are scalar

More information

(a) II and III (b) I (c) I and III (d) I and II and III (e) None are true.

(a) II and III (b) I (c) I and III (d) I and II and III (e) None are true. 1 Which of the following statements is always true? I The null space of an m n matrix is a subspace of R m II If the set B = {v 1,, v n } spans a vector space V and dimv = n, then B is a basis for V III

More information

Stability lectures. Stability of Linear Systems. Stability of Linear Systems. Stability of Continuous Systems. EECE 571M/491M, Spring 2008 Lecture 5

Stability lectures. Stability of Linear Systems. Stability of Linear Systems. Stability of Continuous Systems. EECE 571M/491M, Spring 2008 Lecture 5 EECE 571M/491M, Spring 2008 Lecture 5 Stability of Continuous Systems http://courses.ece.ubc.ca/491m moishi@ece.ubc.ca Dr. Meeko Oishi Electrical and Computer Engineering University of British Columbia,

More information

Solutions Chapter 9. u. (c) u(t) = 1 e t + c 2 e 3 t! c 1 e t 3c 2 e 3 t. (v) (a) u(t) = c 1 e t cos 3t + c 2 e t sin 3t. (b) du

Solutions Chapter 9. u. (c) u(t) = 1 e t + c 2 e 3 t! c 1 e t 3c 2 e 3 t. (v) (a) u(t) = c 1 e t cos 3t + c 2 e t sin 3t. (b) du Solutions hapter 9 dode 9 asic Solution Techniques 9 hoose one or more of the following differential equations, and then: (a) Solve the equation directly (b) Write down its phase plane equivalent, and

More information

MATHEMATICS COMPREHENSIVE EXAM: IN-CLASS COMPONENT

MATHEMATICS COMPREHENSIVE EXAM: IN-CLASS COMPONENT MATHEMATICS COMPREHENSIVE EXAM: IN-CLASS COMPONENT The following is the list of questions for the oral exam. At the same time, these questions represent all topics for the written exam. The procedure for

More information

Generalized Eigenvectors and Jordan Form

Generalized Eigenvectors and Jordan Form Generalized Eigenvectors and Jordan Form We have seen that an n n matrix A is diagonalizable precisely when the dimensions of its eigenspaces sum to n. So if A is not diagonalizable, there is at least

More information

Calculating determinants for larger matrices

Calculating determinants for larger matrices Day 26 Calculating determinants for larger matrices We now proceed to define det A for n n matrices A As before, we are looking for a function of A that satisfies the product formula det(ab) = det A det

More information

Math 240 Calculus III

Math 240 Calculus III Generalized Calculus III Summer 2015, Session II Thursday, July 23, 2015 Agenda 1. 2. 3. 4. Motivation Defective matrices cannot be diagonalized because they do not possess enough eigenvectors to make

More information

Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition

Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Prof. Tesler Math 283 Fall 2016 Also see the separate version of this with Matlab and R commands. Prof. Tesler Diagonalizing

More information

Math 312 Lecture Notes Linear Two-dimensional Systems of Differential Equations

Math 312 Lecture Notes Linear Two-dimensional Systems of Differential Equations Math 2 Lecture Notes Linear Two-dimensional Systems of Differential Equations Warren Weckesser Department of Mathematics Colgate University February 2005 In these notes, we consider the linear system of

More information

Chapters 5 & 6: Theory Review: Solutions Math 308 F Spring 2015

Chapters 5 & 6: Theory Review: Solutions Math 308 F Spring 2015 Chapters 5 & 6: Theory Review: Solutions Math 308 F Spring 205. If A is a 3 3 triangular matrix, explain why det(a) is equal to the product of entries on the diagonal. If A is a lower triangular or diagonal

More information

Math Camp Lecture 4: Linear Algebra. Xiao Yu Wang. Aug 2010 MIT. Xiao Yu Wang (MIT) Math Camp /10 1 / 88

Math Camp Lecture 4: Linear Algebra. Xiao Yu Wang. Aug 2010 MIT. Xiao Yu Wang (MIT) Math Camp /10 1 / 88 Math Camp 2010 Lecture 4: Linear Algebra Xiao Yu Wang MIT Aug 2010 Xiao Yu Wang (MIT) Math Camp 2010 08/10 1 / 88 Linear Algebra Game Plan Vector Spaces Linear Transformations and Matrices Determinant

More information

ALGEBRA QUALIFYING EXAM PROBLEMS LINEAR ALGEBRA

ALGEBRA QUALIFYING EXAM PROBLEMS LINEAR ALGEBRA ALGEBRA QUALIFYING EXAM PROBLEMS LINEAR ALGEBRA Kent State University Department of Mathematical Sciences Compiled and Maintained by Donald L. White Version: August 29, 2017 CONTENTS LINEAR ALGEBRA AND

More information

Definition (T -invariant subspace) Example. Example

Definition (T -invariant subspace) Example. Example Eigenvalues, Eigenvectors, Similarity, and Diagonalization We now turn our attention to linear transformations of the form T : V V. To better understand the effect of T on the vector space V, we begin

More information

Eigenvalues and Eigenvectors 7.2 Diagonalization

Eigenvalues and Eigenvectors 7.2 Diagonalization Eigenvalues and Eigenvectors 7.2 Diagonalization November 8 Goals Suppose A is square matrix of order n. Provide necessary and sufficient condition when there is an invertible matrix P such that P 1 AP

More information

Extra Problems for Math 2050 Linear Algebra I

Extra Problems for Math 2050 Linear Algebra I Extra Problems for Math 5 Linear Algebra I Find the vector AB and illustrate with a picture if A = (,) and B = (,4) Find B, given A = (,4) and [ AB = A = (,4) and [ AB = 8 If possible, express x = 7 as

More information

Lecture Note 1: Background

Lecture Note 1: Background ECE5463: Introduction to Robotics Lecture Note 1: Background Prof. Wei Zhang Department of Electrical and Computer Engineering Ohio State University Columbus, Ohio, USA Spring 2018 Lecture 1 (ECE5463 Sp18)

More information

IMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET

IMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET IMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET This is a (not quite comprehensive) list of definitions and theorems given in Math 1553. Pay particular attention to the ones in red. Study Tip For each

More information

Eigenvalues and Eigenvectors

Eigenvalues and Eigenvectors CHAPTER Eigenvalues and Eigenvectors CHAPTER CONTENTS. Eigenvalues and Eigenvectors 9. Diagonalization. Complex Vector Spaces.4 Differential Equations 6. Dynamical Systems and Markov Chains INTRODUCTION

More information

EE/ACM Applications of Convex Optimization in Signal Processing and Communications Lecture 2

EE/ACM Applications of Convex Optimization in Signal Processing and Communications Lecture 2 EE/ACM 150 - Applications of Convex Optimization in Signal Processing and Communications Lecture 2 Andre Tkacenko Signal Processing Research Group Jet Propulsion Laboratory April 5, 2012 Andre Tkacenko

More information

Linear Algebra Massoud Malek

Linear Algebra Massoud Malek CSUEB Linear Algebra Massoud Malek Inner Product and Normed Space In all that follows, the n n identity matrix is denoted by I n, the n n zero matrix by Z n, and the zero vector by θ n An inner product

More information

MATH 369 Linear Algebra

MATH 369 Linear Algebra Assignment # Problem # A father and his two sons are together 00 years old. The father is twice as old as his older son and 30 years older than his younger son. How old is each person? Problem # 2 Determine

More information

MATH 304 Linear Algebra Lecture 34: Review for Test 2.

MATH 304 Linear Algebra Lecture 34: Review for Test 2. MATH 304 Linear Algebra Lecture 34: Review for Test 2. Topics for Test 2 Linear transformations (Leon 4.1 4.3) Matrix transformations Matrix of a linear mapping Similar matrices Orthogonality (Leon 5.1

More information

A matrix is a rectangular array of. objects arranged in rows and columns. The objects are called the entries. is called the size of the matrix, and

A matrix is a rectangular array of. objects arranged in rows and columns. The objects are called the entries. is called the size of the matrix, and Section 5.5. Matrices and Vectors A matrix is a rectangular array of objects arranged in rows and columns. The objects are called the entries. A matrix with m rows and n columns is called an m n matrix.

More information

Two Dimensional Linear Systems of ODEs

Two Dimensional Linear Systems of ODEs 34 CHAPTER 3 Two Dimensional Linear Sstems of ODEs A first-der, autonomous, homogeneous linear sstem of two ODEs has the fm x t ax + b, t cx + d where a, b, c, d are real constants The matrix fm is 31

More information

IMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET

IMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET IMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET This is a (not quite comprehensive) list of definitions and theorems given in Math 1553. Pay particular attention to the ones in red. Study Tip For each

More information

Chapter 2. Error Correcting Codes. 2.1 Basic Notions

Chapter 2. Error Correcting Codes. 2.1 Basic Notions Chapter 2 Error Correcting Codes The identification number schemes we discussed in the previous chapter give us the ability to determine if an error has been made in recording or transmitting information.

More information

Understanding the Matrix Exponential

Understanding the Matrix Exponential Transformations Understanding the Matrix Exponential Lecture 8 Math 634 9/17/99 Now that we have a representation of the solution of constant-coefficient initial-value problems, we should ask ourselves:

More information

MATH 20F: LINEAR ALGEBRA LECTURE B00 (T. KEMP)

MATH 20F: LINEAR ALGEBRA LECTURE B00 (T. KEMP) MATH 20F: LINEAR ALGEBRA LECTURE B00 (T KEMP) Definition 01 If T (x) = Ax is a linear transformation from R n to R m then Nul (T ) = {x R n : T (x) = 0} = Nul (A) Ran (T ) = {Ax R m : x R n } = {b R m

More information

MATH 304 Linear Algebra Lecture 23: Diagonalization. Review for Test 2.

MATH 304 Linear Algebra Lecture 23: Diagonalization. Review for Test 2. MATH 304 Linear Algebra Lecture 23: Diagonalization. Review for Test 2. Diagonalization Let L be a linear operator on a finite-dimensional vector space V. Then the following conditions are equivalent:

More information

Chapter 4 & 5: Vector Spaces & Linear Transformations

Chapter 4 & 5: Vector Spaces & Linear Transformations Chapter 4 & 5: Vector Spaces & Linear Transformations Philip Gressman University of Pennsylvania Philip Gressman Math 240 002 2014C: Chapters 4 & 5 1 / 40 Objective The purpose of Chapter 4 is to think

More information

Recall the convention that, for us, all vectors are column vectors.

Recall the convention that, for us, all vectors are column vectors. Some linear algebra Recall the convention that, for us, all vectors are column vectors. 1. Symmetric matrices Let A be a real matrix. Recall that a complex number λ is an eigenvalue of A if there exists

More information

Lecture 12: Diagonalization

Lecture 12: Diagonalization Lecture : Diagonalization A square matrix D is called diagonal if all but diagonal entries are zero: a a D a n 5 n n. () Diagonal matrices are the simplest matrices that are basically equivalent to vectors

More information

Eigenvalues, Eigenvectors, and an Intro to PCA

Eigenvalues, Eigenvectors, and an Intro to PCA Eigenvalues, Eigenvectors, and an Intro to PCA Eigenvalues, Eigenvectors, and an Intro to PCA Changing Basis We ve talked so far about re-writing our data using a new set of variables, or a new basis.

More information

33A Linear Algebra and Applications: Practice Final Exam - Solutions

33A Linear Algebra and Applications: Practice Final Exam - Solutions 33A Linear Algebra and Applications: Practice Final Eam - Solutions Question Consider a plane V in R 3 with a basis given by v = and v =. Suppose, y are both in V. (a) [3 points] If [ ] B =, find. (b)

More information

22m:033 Notes: 7.1 Diagonalization of Symmetric Matrices

22m:033 Notes: 7.1 Diagonalization of Symmetric Matrices m:33 Notes: 7. Diagonalization of Symmetric Matrices Dennis Roseman University of Iowa Iowa City, IA http://www.math.uiowa.edu/ roseman May 3, Symmetric matrices Definition. A symmetric matrix is a matrix

More information

20D - Homework Assignment 5

20D - Homework Assignment 5 Brian Bowers TA for Hui Sun MATH D Homework Assignment 5 November 8, 3 D - Homework Assignment 5 First, I present the list of all matrix row operations. We use combinations of these steps to row reduce

More information

Tennessee s State Mathematics Standards Precalculus

Tennessee s State Mathematics Standards Precalculus Tennessee s State Mathematics Standards Precalculus Domain Cluster Standard Number Expressions (N-NE) Represent, interpret, compare, and simplify number expressions 1. Use the laws of exponents and logarithms

More information

Topic 2 Quiz 2. choice C implies B and B implies C. correct-choice C implies B, but B does not imply C

Topic 2 Quiz 2. choice C implies B and B implies C. correct-choice C implies B, but B does not imply C Topic 1 Quiz 1 text A reduced row-echelon form of a 3 by 4 matrix can have how many leading one s? choice must have 3 choice may have 1, 2, or 3 correct-choice may have 0, 1, 2, or 3 choice may have 0,

More information

MULTIVARIABLE CALCULUS, LINEAR ALGEBRA, AND DIFFERENTIAL EQUATIONS

MULTIVARIABLE CALCULUS, LINEAR ALGEBRA, AND DIFFERENTIAL EQUATIONS T H I R D E D I T I O N MULTIVARIABLE CALCULUS, LINEAR ALGEBRA, AND DIFFERENTIAL EQUATIONS STANLEY I. GROSSMAN University of Montana and University College London SAUNDERS COLLEGE PUBLISHING HARCOURT BRACE

More information

1. Select the unique answer (choice) for each problem. Write only the answer.

1. Select the unique answer (choice) for each problem. Write only the answer. MATH 5 Practice Problem Set Spring 7. Select the unique answer (choice) for each problem. Write only the answer. () Determine all the values of a for which the system has infinitely many solutions: x +

More information

Jordan normal form notes (version date: 11/21/07)

Jordan normal form notes (version date: 11/21/07) Jordan normal form notes (version date: /2/7) If A has an eigenbasis {u,, u n }, ie a basis made up of eigenvectors, so that Au j = λ j u j, then A is diagonal with respect to that basis To see this, let

More information

Matrices and Vectors. Definition of Matrix. An MxN matrix A is a two-dimensional array of numbers A =

Matrices and Vectors. Definition of Matrix. An MxN matrix A is a two-dimensional array of numbers A = 30 MATHEMATICS REVIEW G A.1.1 Matrices and Vectors Definition of Matrix. An MxN matrix A is a two-dimensional array of numbers A = a 11 a 12... a 1N a 21 a 22... a 2N...... a M1 a M2... a MN A matrix can

More information

e j = Ad(f i ) 1 2a ij/a ii

e j = Ad(f i ) 1 2a ij/a ii A characterization of generalized Kac-Moody algebras. J. Algebra 174, 1073-1079 (1995). Richard E. Borcherds, D.P.M.M.S., 16 Mill Lane, Cambridge CB2 1SB, England. Generalized Kac-Moody algebras can be

More information

Linear Algebra- Final Exam Review

Linear Algebra- Final Exam Review Linear Algebra- Final Exam Review. Let A be invertible. Show that, if v, v, v 3 are linearly independent vectors, so are Av, Av, Av 3. NOTE: It should be clear from your answer that you know the definition.

More information

2.3. VECTOR SPACES 25

2.3. VECTOR SPACES 25 2.3. VECTOR SPACES 25 2.3 Vector Spaces MATH 294 FALL 982 PRELIM # 3a 2.3. Let C[, ] denote the space of continuous functions defined on the interval [,] (i.e. f(x) is a member of C[, ] if f(x) is continuous

More information

Eigenvalues and Eigenvectors

Eigenvalues and Eigenvectors LECTURE 3 Eigenvalues and Eigenvectors Definition 3.. Let A be an n n matrix. The eigenvalue-eigenvector problem for A is the problem of finding numbers λ and vectors v R 3 such that Av = λv. If λ, v are

More information

Precalculus. Precalculus Higher Mathematics Courses 85

Precalculus. Precalculus Higher Mathematics Courses 85 Precalculus Precalculus combines the trigonometric, geometric, and algebraic techniques needed to prepare students for the study of calculus, and strengthens students conceptual understanding of problems

More information

Math Linear Algebra Final Exam Review Sheet

Math Linear Algebra Final Exam Review Sheet Math 15-1 Linear Algebra Final Exam Review Sheet Vector Operations Vector addition is a component-wise operation. Two vectors v and w may be added together as long as they contain the same number n of

More information

ABSTRACT ALGEBRA WITH APPLICATIONS

ABSTRACT ALGEBRA WITH APPLICATIONS ABSTRACT ALGEBRA WITH APPLICATIONS IN TWO VOLUMES VOLUME I VECTOR SPACES AND GROUPS KARLHEINZ SPINDLER Darmstadt, Germany Marcel Dekker, Inc. New York Basel Hong Kong Contents f Volume I Preface v VECTOR

More information

UNIVERSITY OF NORTH ALABAMA MA 110 FINITE MATHEMATICS

UNIVERSITY OF NORTH ALABAMA MA 110 FINITE MATHEMATICS MA 110 FINITE MATHEMATICS Course Description. This course is intended to give an overview of topics in finite mathematics together with their applications and is taken primarily by students who are not

More information

VAR Model. (k-variate) VAR(p) model (in the Reduced Form): Y t-2. Y t-1 = A + B 1. Y t + B 2. Y t-p. + ε t. + + B p. where:

VAR Model. (k-variate) VAR(p) model (in the Reduced Form): Y t-2. Y t-1 = A + B 1. Y t + B 2. Y t-p. + ε t. + + B p. where: VAR Model (k-variate VAR(p model (in the Reduced Form: where: Y t = A + B 1 Y t-1 + B 2 Y t-2 + + B p Y t-p + ε t Y t = (y 1t, y 2t,, y kt : a (k x 1 vector of time series variables A: a (k x 1 vector

More information

SPRING OF 2008 D. DETERMINANTS

SPRING OF 2008 D. DETERMINANTS 18024 SPRING OF 2008 D DETERMINANTS In many applications of linear algebra to calculus and geometry, the concept of a determinant plays an important role This chapter studies the basic properties of determinants

More information

MATRICES. knowledge on matrices Knowledge on matrix operations. Matrix as a tool of solving linear equations with two or three unknowns.

MATRICES. knowledge on matrices Knowledge on matrix operations. Matrix as a tool of solving linear equations with two or three unknowns. MATRICES After studying this chapter you will acquire the skills in knowledge on matrices Knowledge on matrix operations. Matrix as a tool of solving linear equations with two or three unknowns. List of

More information

No books, no notes, no calculators. You must show work, unless the question is a true/false, yes/no, or fill-in-the-blank question.

No books, no notes, no calculators. You must show work, unless the question is a true/false, yes/no, or fill-in-the-blank question. Math 304 Final Exam (May 8) Spring 206 No books, no notes, no calculators. You must show work, unless the question is a true/false, yes/no, or fill-in-the-blank question. Name: Section: Question Points

More information

Section 3: Complex numbers

Section 3: Complex numbers Essentially: Section 3: Complex numbers C (set of complex numbers) up to different notation: the same as R 2 (euclidean plane), (i) Write the real 1 instead of the first elementary unit vector e 1 = (1,

More information

Eigenvalues and Eigenvectors

Eigenvalues and Eigenvectors Eigenvalues and Eigenvectors week -2 Fall 26 Eigenvalues and eigenvectors The most simple linear transformation from R n to R n may be the transformation of the form: T (x,,, x n ) (λ x, λ 2,, λ n x n

More information

Generalized eigenvector - Wikipedia, the free encyclopedia

Generalized eigenvector - Wikipedia, the free encyclopedia 1 of 30 18/03/2013 20:00 Generalized eigenvector From Wikipedia, the free encyclopedia In linear algebra, for a matrix A, there may not always exist a full set of linearly independent eigenvectors that

More information

FIRST-ORDER SYSTEMS OF ORDINARY DIFFERENTIAL EQUATIONS III: Autonomous Planar Systems David Levermore Department of Mathematics University of Maryland

FIRST-ORDER SYSTEMS OF ORDINARY DIFFERENTIAL EQUATIONS III: Autonomous Planar Systems David Levermore Department of Mathematics University of Maryland FIRST-ORDER SYSTEMS OF ORDINARY DIFFERENTIAL EQUATIONS III: Autonomous Planar Systems David Levermore Department of Mathematics University of Maryland 4 May 2012 Because the presentation of this material

More information

GATE Engineering Mathematics SAMPLE STUDY MATERIAL. Postal Correspondence Course GATE. Engineering. Mathematics GATE ENGINEERING MATHEMATICS

GATE Engineering Mathematics SAMPLE STUDY MATERIAL. Postal Correspondence Course GATE. Engineering. Mathematics GATE ENGINEERING MATHEMATICS SAMPLE STUDY MATERIAL Postal Correspondence Course GATE Engineering Mathematics GATE ENGINEERING MATHEMATICS ENGINEERING MATHEMATICS GATE Syllabus CIVIL ENGINEERING CE CHEMICAL ENGINEERING CH MECHANICAL

More information

Lecture Notes: Eigenvalues and Eigenvectors. 1 Definitions. 2 Finding All Eigenvalues

Lecture Notes: Eigenvalues and Eigenvectors. 1 Definitions. 2 Finding All Eigenvalues Lecture Notes: Eigenvalues and Eigenvectors Yufei Tao Department of Computer Science and Engineering Chinese University of Hong Kong taoyf@cse.cuhk.edu.hk 1 Definitions Let A be an n n matrix. If there

More information

Ordinary and Partial Differential Equations

Ordinary and Partial Differential Equations Ordinary and Partial Differential Equations An Introduction to Dynamical Systems John W. Cain, Ph.D. and Angela M. Reynolds, Ph.D. Mathematics Textbook Series. Editor: Lon Mitchell 1. Book of Proof by

More information

Chapter 9 Global Nonlinear Techniques

Chapter 9 Global Nonlinear Techniques Chapter 9 Global Nonlinear Techniques Consider nonlinear dynamical system 0 Nullcline X 0 = F (X) = B @ f 1 (X) f 2 (X). f n (X) x j nullcline = fx : f j (X) = 0g equilibrium solutions = intersection of

More information

HONORS LINEAR ALGEBRA (MATH V 2020) SPRING 2013

HONORS LINEAR ALGEBRA (MATH V 2020) SPRING 2013 HONORS LINEAR ALGEBRA (MATH V 2020) SPRING 2013 PROFESSOR HENRY C. PINKHAM 1. Prerequisites The only prerequisite is Calculus III (Math 1201) or the equivalent: the first semester of multivariable calculus.

More information

Supplementary Notes on Linear Algebra

Supplementary Notes on Linear Algebra Supplementary Notes on Linear Algebra Mariusz Wodzicki May 3, 2015 1 Vector spaces 1.1 Coordinatization of a vector space 1.1.1 Given a basis B = {b 1,..., b n } in a vector space V, any vector v V can

More information

Math 113 Homework 5. Bowei Liu, Chao Li. Fall 2013

Math 113 Homework 5. Bowei Liu, Chao Li. Fall 2013 Math 113 Homework 5 Bowei Liu, Chao Li Fall 2013 This homework is due Thursday November 7th at the start of class. Remember to write clearly, and justify your solutions. Please make sure to put your name

More information

Linear Equations in Linear Algebra

Linear Equations in Linear Algebra 1 Linear Equations in Linear Algebra 1.3 VECTOR EQUATIONS VECTOR EQUATIONS Vectors in 2 A matrix with only one column is called a column vector, or simply a vector. An example of a vector with two entries

More information

ANSWERS Final Exam Math 250b, Section 2 (Professor J. M. Cushing), 15 May 2008 PART 1

ANSWERS Final Exam Math 250b, Section 2 (Professor J. M. Cushing), 15 May 2008 PART 1 ANSWERS Final Exam Math 50b, Section (Professor J. M. Cushing), 5 May 008 PART. (0 points) A bacterial population x grows exponentially according to the equation x 0 = rx, where r>0is the per unit rate

More information

Matrix Mathematics. Theory, Facts, and Formulas with Application to Linear Systems Theory. Dennis S. Bernstein

Matrix Mathematics. Theory, Facts, and Formulas with Application to Linear Systems Theory. Dennis S. Bernstein Matrix Mathematics Theory, Facts, and Formulas with Application to Linear Systems Theory Dennis S. Bernstein PRINCETON UNIVERSITY PRESS PRINCETON AND OXFORD Contents Special Symbols xv Conventions, Notation,

More information

Chapter 7. Linear Algebra: Matrices, Vectors,

Chapter 7. Linear Algebra: Matrices, Vectors, Chapter 7. Linear Algebra: Matrices, Vectors, Determinants. Linear Systems Linear algebra includes the theory and application of linear systems of equations, linear transformations, and eigenvalue problems.

More information

Ir O D = D = ( ) Section 2.6 Example 1. (Bottom of page 119) dim(v ) = dim(l(v, W )) = dim(v ) dim(f ) = dim(v )

Ir O D = D = ( ) Section 2.6 Example 1. (Bottom of page 119) dim(v ) = dim(l(v, W )) = dim(v ) dim(f ) = dim(v ) Section 3.2 Theorem 3.6. Let A be an m n matrix of rank r. Then r m, r n, and, by means of a finite number of elementary row and column operations, A can be transformed into the matrix ( ) Ir O D = 1 O

More information

Basic Concepts in Linear Algebra

Basic Concepts in Linear Algebra Basic Concepts in Linear Algebra Grady B Wright Department of Mathematics Boise State University February 2, 2015 Grady B Wright Linear Algebra Basics February 2, 2015 1 / 39 Numerical Linear Algebra Linear

More information

Linear Algebra Primer

Linear Algebra Primer Linear Algebra Primer David Doria daviddoria@gmail.com Wednesday 3 rd December, 2008 Contents Why is it called Linear Algebra? 4 2 What is a Matrix? 4 2. Input and Output.....................................

More information

Matrices related to linear transformations

Matrices related to linear transformations Math 4326 Fall 207 Matrices related to linear transformations We have encountered several ways in which matrices relate to linear transformations. In this note, I summarize the important facts and formulas

More information

Module 9 : Infinite Series, Tests of Convergence, Absolute and Conditional Convergence, Taylor and Maclaurin Series

Module 9 : Infinite Series, Tests of Convergence, Absolute and Conditional Convergence, Taylor and Maclaurin Series Module 9 : Infinite Series, Tests of Convergence, Absolute and Conditional Convergence, Taylor and Maclaurin Series Lecture 27 : Series of functions [Section 271] Objectives In this section you will learn

More information

Unit Activity Correlations to Common Core State Standards. Precalculus. Table of Contents

Unit Activity Correlations to Common Core State Standards. Precalculus. Table of Contents Unit Activity Correlations to Common Core State Standards Precalculus Table of Contents Number and Quantity 1 Algebra 3 Functions 3 Geometry 5 Statistics and Probability 6 Number and Quantity The Complex

More information

5.) For each of the given sets of vectors, determine whether or not the set spans R 3. Give reasons for your answers.

5.) For each of the given sets of vectors, determine whether or not the set spans R 3. Give reasons for your answers. Linear Algebra - Test File - Spring Test # For problems - consider the following system of equations. x + y - z = x + y + 4z = x + y + 6z =.) Solve the system without using your calculator..) Find the

More information

Chapter Two Elements of Linear Algebra

Chapter Two Elements of Linear Algebra Chapter Two Elements of Linear Algebra Previously, in chapter one, we have considered single first order differential equations involving a single unknown function. In the next chapter we will begin to

More information

Math 110 Linear Algebra Midterm 2 Review October 28, 2017

Math 110 Linear Algebra Midterm 2 Review October 28, 2017 Math 11 Linear Algebra Midterm Review October 8, 17 Material Material covered on the midterm includes: All lectures from Thursday, Sept. 1st to Tuesday, Oct. 4th Homeworks 9 to 17 Quizzes 5 to 9 Sections

More information

ft-uiowa-math2550 Assignment OptionalFinalExamReviewMultChoiceMEDIUMlengthForm due 12/31/2014 at 10:36pm CST

ft-uiowa-math2550 Assignment OptionalFinalExamReviewMultChoiceMEDIUMlengthForm due 12/31/2014 at 10:36pm CST me me ft-uiowa-math255 Assignment OptionalFinalExamReviewMultChoiceMEDIUMlengthForm due 2/3/2 at :3pm CST. ( pt) Library/TCNJ/TCNJ LinearSystems/problem3.pg Give a geometric description of the following

More information

MAS4107 Linear Algebra 2

MAS4107 Linear Algebra 2 General Prerequisites MAS4107 Linear Algebra 2 Peter Sin University of Florida email: sin@math.ufl.edu Familiarity with the notion of mathematical proof and some experience in reading and writing proofs.

More information

Computational math: Assignment 1

Computational math: Assignment 1 Computational math: Assignment 1 Thanks Ting Gao for her Latex file 11 Let B be a 4 4 matrix to which we apply the following operations: 1double column 1, halve row 3, 3add row 3 to row 1, 4interchange

More information

Alabama Course of Study: Mathematics Precalculus

Alabama Course of Study: Mathematics Precalculus A Correlation of : Graphical, Numerical, Algebraic 8 th Edition to the INTRODUCTION This document demonstrates how : Graphical, Numerical, Algebraic, 8th Edition 2011, (Demana, et al.), meets the indicators

More information

Tangent spaces, normals and extrema

Tangent spaces, normals and extrema Chapter 3 Tangent spaces, normals and extrema If S is a surface in 3-space, with a point a S where S looks smooth, i.e., without any fold or cusp or self-crossing, we can intuitively define the tangent

More information

Elementary Linear Algebra Review for Exam 2 Exam is Monday, November 16th.

Elementary Linear Algebra Review for Exam 2 Exam is Monday, November 16th. Elementary Linear Algebra Review for Exam Exam is Monday, November 6th. The exam will cover sections:.4,..4, 5. 5., 7., the class notes on Markov Models. You must be able to do each of the following. Section.4

More information

Jordan Canonical Form Homework Solutions

Jordan Canonical Form Homework Solutions Jordan Canonical Form Homework Solutions For each of the following, put the matrix in Jordan canonical form and find the matrix S such that S AS = J. [ ]. A = A λi = λ λ = ( λ) = λ λ = λ =, Since we have

More information

LECTURE VI: SELF-ADJOINT AND UNITARY OPERATORS MAT FALL 2006 PRINCETON UNIVERSITY

LECTURE VI: SELF-ADJOINT AND UNITARY OPERATORS MAT FALL 2006 PRINCETON UNIVERSITY LECTURE VI: SELF-ADJOINT AND UNITARY OPERATORS MAT 204 - FALL 2006 PRINCETON UNIVERSITY ALFONSO SORRENTINO 1 Adjoint of a linear operator Note: In these notes, V will denote a n-dimensional euclidean vector

More information

MATRIX ALGEBRA. or x = (x 1,..., x n ) R n. y 1 y 2. x 2. x m. y m. y = cos θ 1 = x 1 L x. sin θ 1 = x 2. cos θ 2 = y 1 L y.

MATRIX ALGEBRA. or x = (x 1,..., x n ) R n. y 1 y 2. x 2. x m. y m. y = cos θ 1 = x 1 L x. sin θ 1 = x 2. cos θ 2 = y 1 L y. as Basics Vectors MATRIX ALGEBRA An array of n real numbers x, x,, x n is called a vector and it is written x = x x n or x = x,, x n R n prime operation=transposing a column to a row Basic vector operations

More information