# Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition

Save this PDF as:

Size: px
Start display at page:

## Transcription

1 Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Prof. Tesler Math 283 Fall 2016 Also see the separate version of this with Matlab and R commands. Prof. Tesler Diagonalizing a matrix Math 283 / Fall / 32

2 Matrices A matrix is a square or rectangular table of numbers. An m n matrix has m rows and n columns. This is read m by n. This matrix is 2 3: A = [ 1 2 ] The entry in row i, column j, is denoted A i, j or A ij. A 1,1 = 1 A 1,2 = 2 A 1,3 = 3 A 2,1 = 4 A 2,2 = 5 A 2,3 = 6 Prof. Tesler Diagonalizing a matrix Math 283 / Fall / 32

3 Matrix multiplication A B = C [ ] ] [ = } {{ } } {{ } 2 3 } {{ } Let A be p q and B be q r. The product AB = C is a certain p r matrix of dot products: C i, j = q A i,k B k, j = dot product (i th row of A) (j th column of B) k=1 The number of columns in A must equal the number of rows in B (namely q) in order to be able to compute the dot products. Prof. Tesler Diagonalizing a matrix Math 283 / Fall / 32

4 Matrix multiplication [ ] = [ 2 ] C 1,1 = 1(5) + 2(0) + 3( 1) = = 2 Prof. Tesler Diagonalizing a matrix Math 283 / Fall / 32

5 Matrix multiplication [ ] = [ 2 18 ] C 1,2 = 1( 2) + 2(1) + 3(6) = = 18 Prof. Tesler Diagonalizing a matrix Math 283 / Fall / 32

6 Matrix multiplication [ ] = [ ] C 1,3 = 1(3) + 2(1) + 3(4) = = 17 Prof. Tesler Diagonalizing a matrix Math 283 / Fall / 32

7 Matrix multiplication [ ] = [ ] C 1,4 = 1(2) + 2( 1) + 3(3) = = 9 Prof. Tesler Diagonalizing a matrix Math 283 / Fall / 32

8 Matrix multiplication [ ] = [ ] C 2,1 = 4(5) + 5(0) + 6( 1) = = 14 Prof. Tesler Diagonalizing a matrix Math 283 / Fall / 32

9 Matrix multiplication [ ] = [ ] C 2,2 = 4( 2) + 5(1) + 6(6) = = 33 Prof. Tesler Diagonalizing a matrix Math 283 / Fall / 32

10 Matrix multiplication [ ] = [ ] C 2,3 = 4(3) + 5(1) + 6(4) = = 41 Prof. Tesler Diagonalizing a matrix Math 283 / Fall / 32

11 Matrix multiplication [ ] = [ ] C 2,4 = 4(2) + 5( 1) + 6(3) = = 21 Prof. Tesler Diagonalizing a matrix Math 283 / Fall / 32

12 Transpose of a matrix Given matrix A of dimensions p q, the transpose A is q p, obtained by interchanging rows and columns: (A ) ij = A ji. [ ] = Transpose of a product reverses the order and transposes the factors: (AB) = B A [ ] = = [ ] Prof. Tesler Diagonalizing a matrix Math 283 / Fall / 32

13 Multiplying several matrices Multiplication is not commutative: usually, AB BA. AB and BA are both defined only if A and B are both n n. Even then, they are usually not equal. Multiplication is associative: (AB)C = A(BC) Suppose A is p 1 p 2 B is p 2 p 3 C is p 3 p 4 D is p 4 p 5 Then ABCD is p 1 p 5. By associativity, it may be computed in many ways, such as A(B(CD)), (AB)(CD),... or directly by: (ABCD) i, j = p 2 p 3 p 4 k 2 =1 k 3 =1 k 4 =1 A i, k2 B k2, k 3 C k3, k 4 D k4, j This generalizes to any number of matrices. Powers A 2 = AA, A 3 = AAA,... are defined for square matrices. Prof. Tesler Diagonalizing a matrix Math 283 / Fall / 32

14 Inverse matrix The n n identity matrix I is I = I i, j = { 1 if i = j (main diagonal); 0 if i j (elsewhere). The inverse of an n n matrix A is an n n matrix A 1 such that A A 1 = I and A 1 A = I. It may or may not exist. For 2 2 matrices [ ] a b A = c d A 1 = 1 ad bc [ d ] b c a unless det(a) = ad bc = 0, in which case A 1 is undefined. For n n matrices, use the row reduction algorithm (a.k.a. Gaussian elimination) in Linear Algebra. If A, B are invertible and the same size: (AB) 1 = B 1 A 1 The order is reversed and the factors are inverted. Prof. Tesler Diagonalizing a matrix Math 283 / Fall / 32

15 Span, basis, and linear (in)dependence The span of vectors v 1,..., v k is the set of all linear combinations α 1 v α k v k α 1,..., α k R Example 1 In 3D, 1 0 span 0, 0 = 0 1 x 0 : x, z R z = xz plane Here, the span of these two vectors is a 2-dimensional space. Every vector in it is generated by a unique linear combination. Prof. Tesler Diagonalizing a matrix Math 283 / Fall / 32

16 Span, basis, and linear (in)dependence Example 2 In 3D, span 0, 1, 0 = 0 0 1/2 x y : x, y, z R = R3. z Note that x y = (x y) 0 + y 1 2z 0 z 0 0 1/2 Here, the span of these three vectors is a 3-dimensional space. Every vector in R 3 is generated by a unique linear combination. Prof. Tesler Diagonalizing a matrix Math 283 / Fall / 32

17 Span, basis, and linear (in)dependence Example 3 In 3D, span 0, 0, 0 = x 0 : x, z R z = xz plane This is a plane (2D), even though it s a span of three vectors. Note that v 2 = v 1 + v 3, or v 1 v 2 + v 3 = 0. There are multiple ways to generate each vector in the span: for all x, z, t, x = x 0 + z 0 + t ( v 1 v 2 + v 3 ) = (x + t) 0 t 0 + (z + t) 0 } {{ } z = 0 Prof. Tesler Diagonalizing a matrix Math 283 / Fall / 32

18 Span, basis, and linear (in)dependence Given vectors v 1,..., v k, if there is a linear combination α 1 v α k v k = 0 with at least one α i 0, the vectors are linearly dependent (Ex. 3). Otherwise they are linearly independent (Ex. 1 2). Linearly independent vectors form a basis of the space S they span. Any vector in S is a unique linear combination of basis vectors (vs. it s not unique if v 1,..., v k are linearly dependent). One basis of R n is a unit vector on each axis: but there are other possibilities, e.g., Example 2: [ [ ] [ ] [ ] ,, ], [ ], [ 0 0 1/2 ] Prof. Tesler Diagonalizing a matrix Math 283 / Fall / 32

19 Eigenvectors Eigenvalues and eigenvectors Let A be a square matrix (k k) and v 0 be a column vector (k 1). If A v = λ v for a scalar λ, then v is an eigenvector of A with eigenvalue λ. Example [8 [ ] ] [ ] 1 3 = [ ] (8)(1) + ( 1)(3) (6)(1) + (3)(3) is an eigenvector with eigenvalue 5. = [ ] 5 15 = 5 [ ] 1 3 But this is just a verification. How do we find eigenvalues and eigenvectors? Prof. Tesler Diagonalizing a matrix Math 283 / Fall / 32

20 Finding eigenvalues and eigenvectors We will work with the example P = [ ] Form the identity matrix of the same dimensions: [ ] 1 0 I = 0 1 The formula for the determinant depends on the dimensions of the matrix. For a 2 2 matrix, [ ] a b det = ad bc c d Prof. Tesler Diagonalizing a matrix Math 283 / Fall / 32

21 Finding eigenvalues and eigenvectors Compute the determinant of P λi: [ ] 8 λ 1 det(p λi) = det 6 3 λ = (8 λ)(3 λ) ( 1)(6) = 24 11λ + λ = λ 2 11λ + 30 This is the characteristic polynomial of P. It has degree k in λ. The characteristic equation is det(p λi) = 0. Solve it for λ. For k = 2, use the quadratic formula: λ = 11 ± ( 11) 2 4(1)(30) 2 The eigenvalues are λ = 5 and λ = 6. = 5, 6 Prof. Tesler Diagonalizing a matrix Math 283 / Fall / 32

22 Finding the (right) eigenvector for λ = 5 Let v = [ ] a. We will solve for a, b. b The equation P v = λ v is equivalent to (P λi) v = 0. [ ] 0 0 = (P 5I) v = [ ] [ ] 3 1 a 6 2 b = [ ] 3a b 6a 2b so 3a b = 0 and 6a 2b = 0 (which are equivalent). Solving gives b = 3a. Thus, [ ] a v = = b Any nonzero scalar multiple of eigenvalue 5. [ ] a 3a [ ] 1 3 = a [ ] 1 3 is an eigenvector of P with Prof. Tesler Diagonalizing a matrix Math 283 / Fall / 32

23 Finding the (right) eigenvector for λ = 6 Let v = [ ] a. We will solve for a, b. b The equation P v = λ v is equivalent to (P λi) v = 0. [ ] 0 0 = (P 6I) v = [ ] [ ] 2 1 a 6 3 b = [ ] 2a b 6a 3b so 2a b = 0 and 6a 3b = 0 (which are equivalent). Solving gives b = 2a. Thus, [ ] a v = = b Any nonzero scalar multiple of eigenvalue 6. [ ] a 2a [ ] 1 2 = a [ ] 1 2 is an eigenvector of P with Prof. Tesler Diagonalizing a matrix Math 283 / Fall / 32

24 Verify the eigenvectors [ ] [ ] [ ] [ ] = = [ ] 8(1) 1(3) 6(1) + 3(3) [ ] 8(2) 1(4) 6(2) + 3(4) = = [ ] 5 15 [ ] [ ] 1 = 5 3 [ ] 2 = 6 4 Prof. Tesler Diagonalizing a matrix Math 283 / Fall / 32

25 Normalization: Which scalar multiple should we use? In some applications, any nonzero multiple is fine. In others, a particular scaling is required. Markov chains / Stochastic matrices Scale the vector [ ] so that the entries sum up to 1. 1 For v = a, the sum is a (1 + 3) = 4a = 1, so a = 1/4: 3 [ ] 1/4 v = 3/4 Principal component analysis Scale it to be a unit vector, so that the sum of the squares of its entries equals 1: 1 = a 2 ( ) = 10a 2 ±1 so a = = ± v = ± [ ] 1/ 10 3/ 10 (two possibilities) Prof. Tesler Diagonalizing a matrix Math 283 / Fall / 32

26 Finding the left eigenvector for λ = 5 Let v = [ a b ]. We will solve for a, b. The equation vp = λ v is equivalent to v(p λi) = 0. [ ] [ ] [ ] = v(p 5I) = a b 6 2 = [ 3a + 6b a 2b ] so 3a + 6b = 0 and a 2b = 0 (which are equivalent). Solving gives b = a/2. Thus, v = [ a b ] = [ a a/2 ] = a [ 1 1/2 ] Any nonzero scalar multiple of [ 1 with eigenvalue 5. 1/2 ] is a left eigenvector of P Prof. Tesler Diagonalizing a matrix Math 283 / Fall / 32

27 Finding the left eigenvector for λ = 6 Let v = [ a b ]. We will solve for a, b. The equation vp = λ v is equivalent to v(p λi) = 0. [ ] [ ] [ ] = v(p 6I) = a b 6 3 = [ 2a + 6b a 3b ] so 2a + 6b = 0 and a 3b = 0 (which are equivalent). Solving gives b = a/3. Thus, v = [ a b ] = [ a a/3 ] = a [ 1 1/3 ] Any nonzero scalar multiple of [ 1 with eigenvalue 6. 1/3 ] is a left eigenvector of P Prof. Tesler Diagonalizing a matrix Math 283 / Fall / 32

28 Verify the left eigenvectors [ ] [ ] = [ 2(8) + 1(6) 2( 1) + 1(3) ] = [ 10 5 ] = 5 [ 2 1 ] [ ] [ ] = [ 1.5(8).5(6) 1.5( 1).5(3) ] = [ 9 3 ] = 6 [ ] Prof. Tesler Diagonalizing a matrix Math 283 / Fall / 32

29 Diagonalizing a matrix This procedure assumes there are k linearly independent eigenvectors, where P is k k. If the characteristic polynomial has k distinct roots, then there are k such eigenvectors. But if roots are repeated, there may or may not be a full set of eigenvectors. We ll explore this complication later. Prof. Tesler Diagonalizing a matrix Math 283 / Fall / 32

30 Diagonalizing a matrix Put the right eigenvectors r 1, r 2,... into the columns of a matrix V. Form diagonal matrix D with eigenvalues λ 1, λ 2,... in the same order: V = [ [ ] [ ] [ ] ] 1 2 λ r 1 r 2 = D = = λ [ ] [ ] Compute V 1 l = = l 2 3/2 1/2 Its rows are the left eigenvectors l 1, l 2,... of P, in the same order as the eigenvalues in D, scaled so that l i r i = 1. This gives the diagonalization P = VDV 1 : P = V D V 1 [ ] [ ] [ ] [ ] = /2 1/2 Prof. Tesler Diagonalizing a matrix Math 283 / Fall / 32

31 Matrix powers using the spectral decomposition An expansion of P n is P n = (VDV 1 )(VDV 1 ) (VDV 1 ) = VD n V 1 : [ ] [ ] [ ] P n = VD n V 1 5 n 0 = V 0 6 n V 1 5 n 0 = V V V n V 1 V [ ] 5 n 0 V 1 = 0 0 [ ][ ][ ] [ n (1)(5 = n )( 2) (1)(5 n ] )(1) (3)(5 n )( 2) (3)(5 n )(1) ] [ ] [ 2 ] 1 = n λ1 r 1 l 1 = 5 n 2 1 = 5 n [ V [ ] n V 1 = [ ] [ ] [ ] [ ( n = n )(1.5) 2(6 n ] )(.5) (6 n )(1.5) 4(6 n )(.5) ] [ ] [1.5 ].5 = n λ2 r 2 l 2 = 6 n 3 1 = 6 n [ Prof. Tesler Diagonalizing a matrix Math 283 / Fall / 32

32 Matrix powers using the spectral decomposition Continue computing P n : P n = VD n V 1 = V [ ] = 5 n [ ] 5 n n + 6 n [ V 1 = V ] [ ] 5 n 0 V 1 + V 0 0 [ ] n V 1 General formula (with k = 2 and two distinct eigenvalues): P n = VD n V 1 = λ 1 n r 1 l 1 + λ 2 n r 2 l 2 General formula: If P is k k and is diagonalizable, this becomes: P n = VD n V 1 = λ 1 n r 1 l 1 + λ 2 n r 2 l λ k n r k l k What if the matrix is not diagonalizable? We will see a generalization called the Jordan Canonical Form. Prof. Tesler Diagonalizing a matrix Math 283 / Fall / 32

### Math Linear Algebra Final Exam Review Sheet

Math 15-1 Linear Algebra Final Exam Review Sheet Vector Operations Vector addition is a component-wise operation. Two vectors v and w may be added together as long as they contain the same number n of

### and let s calculate the image of some vectors under the transformation T.

Chapter 5 Eigenvalues and Eigenvectors 5. Eigenvalues and Eigenvectors Let T : R n R n be a linear transformation. Then T can be represented by a matrix (the standard matrix), and we can write T ( v) =

### Linear Algebra Practice Problems

Linear Algebra Practice Problems Math 24 Calculus III Summer 25, Session II. Determine whether the given set is a vector space. If not, give at least one axiom that is not satisfied. Unless otherwise stated,

### Definition (T -invariant subspace) Example. Example

Eigenvalues, Eigenvectors, Similarity, and Diagonalization We now turn our attention to linear transformations of the form T : V V. To better understand the effect of T on the vector space V, we begin

### Math Camp Lecture 4: Linear Algebra. Xiao Yu Wang. Aug 2010 MIT. Xiao Yu Wang (MIT) Math Camp /10 1 / 88

Math Camp 2010 Lecture 4: Linear Algebra Xiao Yu Wang MIT Aug 2010 Xiao Yu Wang (MIT) Math Camp 2010 08/10 1 / 88 Linear Algebra Game Plan Vector Spaces Linear Transformations and Matrices Determinant

### A matrix is a rectangular array of. objects arranged in rows and columns. The objects are called the entries. is called the size of the matrix, and

Section 5.5. Matrices and Vectors A matrix is a rectangular array of objects arranged in rows and columns. The objects are called the entries. A matrix with m rows and n columns is called an m n matrix.

### c c c c c c c c c c a 3x3 matrix C= has a determinant determined by

Linear Algebra Determinants and Eigenvalues Introduction: Many important geometric and algebraic properties of square matrices are associated with a single real number revealed by what s known as the determinant.

### MATH 323 Linear Algebra Lecture 6: Matrix algebra (continued). Determinants.

MATH 323 Linear Algebra Lecture 6: Matrix algebra (continued). Determinants. Elementary matrices Theorem 1 Any elementary row operation σ on matrices with n rows can be simulated as left multiplication

### Math 215 HW #9 Solutions

Math 5 HW #9 Solutions. Problem 4.4.. If A is a 5 by 5 matrix with all a ij, then det A. Volumes or the big formula or pivots should give some upper bound on the determinant. Answer: Let v i be the ith

### MATH 20F: LINEAR ALGEBRA LECTURE B00 (T. KEMP)

MATH 20F: LINEAR ALGEBRA LECTURE B00 (T KEMP) Definition 01 If T (x) = Ax is a linear transformation from R n to R m then Nul (T ) = {x R n : T (x) = 0} = Nul (A) Ran (T ) = {Ax R m : x R n } = {b R m

### 0.1 Eigenvalues and Eigenvectors

0.. EIGENVALUES AND EIGENVECTORS MATH 22AL Computer LAB for Linear Algebra Eigenvalues and Eigenvectors Dr. Daddel Please save your MATLAB Session (diary)as LAB9.text and submit. 0. Eigenvalues and Eigenvectors

### MAC Module 2 Systems of Linear Equations and Matrices II. Learning Objectives. Upon completing this module, you should be able to :

MAC 0 Module Systems of Linear Equations and Matrices II Learning Objectives Upon completing this module, you should be able to :. Find the inverse of a square matrix.. Determine whether a matrix is invertible..

### 1 Multiply Eq. E i by λ 0: (λe i ) (E i ) 2 Multiply Eq. E j by λ and add to Eq. E i : (E i + λe j ) (E i )

Direct Methods for Linear Systems Chapter Direct Methods for Solving Linear Systems Per-Olof Persson persson@berkeleyedu Department of Mathematics University of California, Berkeley Math 18A Numerical

### IMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET

IMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET This is a (not quite comprehensive) list of definitions and theorems given in Math 1553. Pay particular attention to the ones in red. Study Tip For each

### IMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET

IMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET This is a (not quite comprehensive) list of definitions and theorems given in Math 1553. Pay particular attention to the ones in red. Study Tip For each

### 2. Matrix Algebra and Random Vectors

2. Matrix Algebra and Random Vectors 2.1 Introduction Multivariate data can be conveniently display as array of numbers. In general, a rectangular array of numbers with, for instance, n rows and p columns

### CHAPTER 8: Matrices and Determinants

(Exercises for Chapter 8: Matrices and Determinants) E.8.1 CHAPTER 8: Matrices and Determinants (A) means refer to Part A, (B) means refer to Part B, etc. Most of these exercises can be done without a

### Extra Problems for Math 2050 Linear Algebra I

Extra Problems for Math 5 Linear Algebra I Find the vector AB and illustrate with a picture if A = (,) and B = (,4) Find B, given A = (,4) and [ AB = A = (,4) and [ AB = 8 If possible, express x = 7 as

### Linear Algebra Primer

Linear Algebra Primer David Doria daviddoria@gmail.com Wednesday 3 rd December, 2008 Contents Why is it called Linear Algebra? 4 2 What is a Matrix? 4 2. Input and Output.....................................

### Topic 2 Quiz 2. choice C implies B and B implies C. correct-choice C implies B, but B does not imply C

Topic 1 Quiz 1 text A reduced row-echelon form of a 3 by 4 matrix can have how many leading one s? choice must have 3 choice may have 1, 2, or 3 correct-choice may have 0, 1, 2, or 3 choice may have 0,

### MATH 304 Linear Algebra Lecture 33: Bases of eigenvectors. Diagonalization.

MATH 304 Linear Algebra Lecture 33: Bases of eigenvectors. Diagonalization. Eigenvalues and eigenvectors of an operator Definition. Let V be a vector space and L : V V be a linear operator. A number λ

### Linear Algebra for Machine Learning. Sargur N. Srihari

Linear Algebra for Machine Learning Sargur N. srihari@cedar.buffalo.edu 1 Overview Linear Algebra is based on continuous math rather than discrete math Computer scientists have little experience with it

### Linear Algebra & Geometry why is linear algebra useful in computer vision?

Linear Algebra & Geometry why is linear algebra useful in computer vision? References: -Any book on linear algebra! -[HZ] chapters 2, 4 Some of the slides in this lecture are courtesy to Prof. Octavia

### Linear Equations and Matrix

1/60 Chia-Ping Chen Professor Department of Computer Science and Engineering National Sun Yat-sen University Linear Algebra Gaussian Elimination 2/60 Alpha Go Linear algebra begins with a system of linear

### Eigenvalues, Eigenvectors, and Diagonalization

Math 240 TA: Shuyi Weng Winter 207 February 23, 207 Eigenvalues, Eigenvectors, and Diagonalization The concepts of eigenvalues, eigenvectors, and diagonalization are best studied with examples. We will

### Introduction to Matrices

214 Analysis and Design of Feedback Control Systems Introduction to Matrices Derek Rowell October 2002 Modern system dynamics is based upon a matrix representation of the dynamic equations governing the

### Generalized Eigenvectors and Jordan Form

Generalized Eigenvectors and Jordan Form We have seen that an n n matrix A is diagonalizable precisely when the dimensions of its eigenspaces sum to n. So if A is not diagonalizable, there is at least

### Topic 15 Notes Jeremy Orloff

Topic 5 Notes Jeremy Orloff 5 Transpose, Inverse, Determinant 5. Goals. Know the definition and be able to compute the inverse of any square matrix using row operations. 2. Know the properties of inverses.

### ELEMENTARY LINEAR ALGEBRA WITH APPLICATIONS. 1. Linear Equations and Matrices

ELEMENTARY LINEAR ALGEBRA WITH APPLICATIONS KOLMAN & HILL NOTES BY OTTO MUTZBAUER 11 Systems of Linear Equations 1 Linear Equations and Matrices Numbers in our context are either real numbers or complex

### Maths for Signals and Systems Linear Algebra in Engineering

Maths for Signals and Systems Linear Algebra in Engineering Lectures 13 15, Tuesday 8 th and Friday 11 th November 016 DR TANIA STATHAKI READER (ASSOCIATE PROFFESOR) IN SIGNAL PROCESSING IMPERIAL COLLEGE

### 22m:033 Notes: 7.1 Diagonalization of Symmetric Matrices

m:33 Notes: 7. Diagonalization of Symmetric Matrices Dennis Roseman University of Iowa Iowa City, IA http://www.math.uiowa.edu/ roseman May 3, Symmetric matrices Definition. A symmetric matrix is a matrix

### Math 110 Linear Algebra Midterm 2 Review October 28, 2017

Math 11 Linear Algebra Midterm Review October 8, 17 Material Material covered on the midterm includes: All lectures from Thursday, Sept. 1st to Tuesday, Oct. 4th Homeworks 9 to 17 Quizzes 5 to 9 Sections

### TOPIC III LINEAR ALGEBRA

[1] Linear Equations TOPIC III LINEAR ALGEBRA (1) Case of Two Endogenous Variables 1) Linear vs. Nonlinear Equations Linear equation: ax + by = c, where a, b and c are constants. 2 Nonlinear equation:

### SOLUTIONS: ASSIGNMENT Use Gaussian elimination to find the determinant of the matrix. = det. = det = 1 ( 2) 3 6 = 36. v 4.

SOLUTIONS: ASSIGNMENT 9 66 Use Gaussian elimination to find the determinant of the matrix det 1 1 4 4 1 1 1 1 8 8 = det = det 0 7 9 0 0 0 6 = 1 ( ) 3 6 = 36 = det = det 0 0 6 1 0 0 0 6 61 Consider a 4

### Math 314/ Exam 2 Blue Exam Solutions December 4, 2008 Instructor: Dr. S. Cooper. Name:

Math 34/84 - Exam Blue Exam Solutions December 4, 8 Instructor: Dr. S. Cooper Name: Read each question carefully. Be sure to show all of your work and not just your final conclusion. You may not use your

### Matrices. Math 240 Calculus III. Wednesday, July 10, Summer 2013, Session II. Matrices. Math 240. Definitions and Notation.

function Matrices Calculus III Summer 2013, Session II Wednesday, July 10, 2013 Agenda function 1. 2. function function Definition An m n matrix is a rectangular array of numbers arranged in m horizontal

### MATH 369 Linear Algebra

Assignment # Problem # A father and his two sons are together 00 years old. The father is twice as old as his older son and 30 years older than his younger son. How old is each person? Problem # 2 Determine

### MATH 304 Linear Algebra Lecture 10: Linear independence. Wronskian.

MATH 304 Linear Algebra Lecture 10: Linear independence. Wronskian. Spanning set Let S be a subset of a vector space V. Definition. The span of the set S is the smallest subspace W V that contains S. If

### Solutions to Final Practice Problems Written by Victoria Kala Last updated 12/5/2015

Solutions to Final Practice Problems Written by Victoria Kala vtkala@math.ucsb.edu Last updated /5/05 Answers This page contains answers only. See the following pages for detailed solutions. (. (a x. See

### Review of Linear Algebra Definitions, Change of Basis, Trace, Spectral Theorem

Review of Linear Algebra Definitions, Change of Basis, Trace, Spectral Theorem Steven J. Miller June 19, 2004 Abstract Matrices can be thought of as rectangular (often square) arrays of numbers, or as

### ICS 6N Computational Linear Algebra Matrix Algebra

ICS 6N Computational Linear Algebra Matrix Algebra Xiaohui Xie University of California, Irvine xhx@uci.edu February 2, 2017 Xiaohui Xie (UCI) ICS 6N February 2, 2017 1 / 24 Matrix Consider an m n matrix

### Ir O D = D = ( ) Section 2.6 Example 1. (Bottom of page 119) dim(v ) = dim(l(v, W )) = dim(v ) dim(f ) = dim(v )

Section 3.2 Theorem 3.6. Let A be an m n matrix of rank r. Then r m, r n, and, by means of a finite number of elementary row and column operations, A can be transformed into the matrix ( ) Ir O D = 1 O

### Linear Algebra. Workbook

Linear Algebra Workbook Paul Yiu Department of Mathematics Florida Atlantic University Last Update: November 21 Student: Fall 2011 Checklist Name: A B C D E F F G H I J 1 2 3 4 5 6 7 8 9 10 xxx xxx xxx

### Matrix Operations: Determinant

Matrix Operations: Determinant Determinants Determinants are only applicable for square matrices. Determinant of the square matrix A is denoted as: det(a) or A Recall that the absolute value of the determinant

### 18.06SC Final Exam Solutions

18.06SC Final Exam Solutions 1 (4+7=11 pts.) Suppose A is 3 by 4, and Ax = 0 has exactly 2 special solutions: 1 2 x 1 = 1 and x 2 = 1 1 0 0 1 (a) Remembering that A is 3 by 4, find its row reduced echelon

### Chapters 5 & 6: Theory Review: Solutions Math 308 F Spring 2015

Chapters 5 & 6: Theory Review: Solutions Math 308 F Spring 205. If A is a 3 3 triangular matrix, explain why det(a) is equal to the product of entries on the diagonal. If A is a lower triangular or diagonal

### Properties of Matrices and Operations on Matrices

Properties of Matrices and Operations on Matrices A common data structure for statistical analysis is a rectangular array or matris. Rows represent individual observational units, or just observations,

### HOMEWORK PROBLEMS FROM STRANG S LINEAR ALGEBRA AND ITS APPLICATIONS (4TH EDITION)

HOMEWORK PROBLEMS FROM STRANG S LINEAR ALGEBRA AND ITS APPLICATIONS (4TH EDITION) PROFESSOR STEVEN MILLER: BROWN UNIVERSITY: SPRING 2007 1. CHAPTER 1: MATRICES AND GAUSSIAN ELIMINATION Page 9, # 3: Describe

### Inverting Matrices. 1 Properties of Transpose. 2 Matrix Algebra. P. Danziger 3.2, 3.3

3., 3.3 Inverting Matrices P. Danziger 1 Properties of Transpose Transpose has higher precedence than multiplication and addition, so AB T A ( B T and A + B T A + ( B T As opposed to the bracketed expressions

### Linear algebra II Homework #1 solutions A = This means that every eigenvector with eigenvalue λ = 1 must have the form

Linear algebra II Homework # solutions. Find the eigenvalues and the eigenvectors of the matrix 4 6 A =. 5 Since tra = 9 and deta = = 8, the characteristic polynomial is f(λ) = λ (tra)λ+deta = λ 9λ+8 =

### 18.06 Problem Set 8 - Solutions Due Wednesday, 14 November 2007 at 4 pm in

806 Problem Set 8 - Solutions Due Wednesday, 4 November 2007 at 4 pm in 2-06 08 03 Problem : 205+5+5+5 Consider the matrix A 02 07 a Check that A is a positive Markov matrix, and find its steady state

### Review of some mathematical tools

MATHEMATICAL FOUNDATIONS OF SIGNAL PROCESSING Fall 2016 Benjamín Béjar Haro, Mihailo Kolundžija, Reza Parhizkar, Adam Scholefield Teaching assistants: Golnoosh Elhami, Hanjie Pan Review of some mathematical

### Matrices and Determinants

Chapter1 Matrices and Determinants 11 INTRODUCTION Matrix means an arrangement or array Matrices (plural of matrix) were introduced by Cayley in 1860 A matrix A is rectangular array of m n numbers (or

### Review of Linear Algebra

Review of Linear Algebra Dr Gerhard Roth COMP 40A Winter 05 Version Linear algebra Is an important area of mathematics It is the basis of computer vision Is very widely taught, and there are many resources

### Topics in linear algebra

Chapter 6 Topics in linear algebra 6.1 Change of basis I want to remind you of one of the basic ideas in linear algebra: change of basis. Let F be a field, V and W be finite dimensional vector spaces over

### 80 min. 65 points in total. The raw score will be normalized according to the course policy to count into the final score.

This is a closed book, closed notes exam You need to justify every one of your answers unless you are asked not to do so Completely correct answers given without justification will receive little credit

### Generalized eigenvector - Wikipedia, the free encyclopedia

1 of 30 18/03/2013 20:00 Generalized eigenvector From Wikipedia, the free encyclopedia In linear algebra, for a matrix A, there may not always exist a full set of linearly independent eigenvectors that

### CS100: DISCRETE STRUCTURES. Lecture 3 Matrices Ch 3 Pages:

CS100: DISCRETE STRUCTURES Lecture 3 Matrices Ch 3 Pages: 246-262 Matrices 2 Introduction DEFINITION 1: A matrix is a rectangular array of numbers. A matrix with m rows and n columns is called an m x n

### 4. Linear transformations as a vector space 17

4 Linear transformations as a vector space 17 d) 1 2 0 0 1 2 0 0 1 0 0 0 1 2 3 4 32 Let a linear transformation in R 2 be the reflection in the line = x 2 Find its matrix 33 For each linear transformation

### Mathematical Foundations

Chapter 1 Mathematical Foundations 1.1 Big-O Notations In the description of algorithmic complexity, we often have to use the order notations, often in terms of big O and small o. Loosely speaking, for

### 18.06 Problem Set 2 Solution

18.06 Problem Set 2 Solution Total: 100 points Section 2.5. Problem 24: Use Gauss-Jordan elimination on [U I] to find the upper triangular U 1 : 1 a b 1 0 UU 1 = I 0 1 c x 1 x 2 x 3 = 0 1 0. 0 0 1 0 0

### MATRICES. knowledge on matrices Knowledge on matrix operations. Matrix as a tool of solving linear equations with two or three unknowns.

MATRICES After studying this chapter you will acquire the skills in knowledge on matrices Knowledge on matrix operations. Matrix as a tool of solving linear equations with two or three unknowns. List of

### Math 240 Calculus III

The Calculus III Summer 2015, Session II Wednesday, July 8, 2015 Agenda 1. of the determinant 2. determinants 3. of determinants What is the determinant? Yesterday: Ax = b has a unique solution when A

### Lecture 12: Diagonalization

Lecture : Diagonalization A square matrix D is called diagonal if all but diagonal entries are zero: a a D a n 5 n n. () Diagonal matrices are the simplest matrices that are basically equivalent to vectors

### Chapter Two Elements of Linear Algebra

Chapter Two Elements of Linear Algebra Previously, in chapter one, we have considered single first order differential equations involving a single unknown function. In the next chapter we will begin to

### Linear algebra and applications to graphs Part 1

Linear algebra and applications to graphs Part 1 Written up by Mikhail Belkin and Moon Duchin Instructor: Laszlo Babai June 17, 2001 1 Basic Linear Algebra Exercise 1.1 Let V and W be linear subspaces

### Math Lecture 26 : The Properties of Determinants

Math 2270 - Lecture 26 : The Properties of Determinants Dylan Zwick Fall 202 The lecture covers section 5. from the textbook. The determinant of a square matrix is a number that tells you quite a bit about

### Lecture 1 Review: Linear models have the form (in matrix notation) Y = Xβ + ε,

2. REVIEW OF LINEAR ALGEBRA 1 Lecture 1 Review: Linear models have the form (in matrix notation) Y = Xβ + ε, where Y n 1 response vector and X n p is the model matrix (or design matrix ) with one row for

### Math 18, Linear Algebra, Lecture C00, Spring 2017 Review and Practice Problems for Final Exam

Math 8, Linear Algebra, Lecture C, Spring 7 Review and Practice Problems for Final Exam. The augmentedmatrix of a linear system has been transformed by row operations into 5 4 8. Determine if the system

### Linear Algebra: Linear Systems and Matrices - Quadratic Forms and Deniteness - Eigenvalues and Markov Chains

Linear Algebra: Linear Systems and Matrices - Quadratic Forms and Deniteness - Eigenvalues and Markov Chains Joshua Wilde, revised by Isabel Tecu, Takeshi Suzuki and María José Boccardi August 3, 3 Systems

### Stat 159/259: Linear Algebra Notes

Stat 159/259: Linear Algebra Notes Jarrod Millman November 16, 2015 Abstract These notes assume you ve taken a semester of undergraduate linear algebra. In particular, I assume you are familiar with the

### MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 1 x 2. x n 8 (4) 3 4 2

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS SYSTEMS OF EQUATIONS AND MATRICES Representation of a linear system The general system of m equations in n unknowns can be written a x + a 2 x 2 + + a n x n b a

### BASIC ALGORITHMS IN LINEAR ALGEBRA. Matrices and Applications of Gaussian Elimination. A 2 x. A T m x. A 1 x A T 1. A m x

BASIC ALGORITHMS IN LINEAR ALGEBRA STEVEN DALE CUTKOSKY Matrices and Applications of Gaussian Elimination Systems of Equations Suppose that A is an n n matrix with coefficents in a field F, and x = (x,,

### Math 443 Differential Geometry Spring Handout 3: Bilinear and Quadratic Forms This handout should be read just before Chapter 4 of the textbook.

Math 443 Differential Geometry Spring 2013 Handout 3: Bilinear and Quadratic Forms This handout should be read just before Chapter 4 of the textbook. Endomorphisms of a Vector Space This handout discusses

### M 340L CS Homework Set 12 Solutions. Note: Scale all eigenvectors so the largest component is +1.

M 34L CS Homework Set 2 Solutions Note: Scale all eigenvectors so the largest component is +.. For each of these matrices, find the characteristic polynomial p( ) det( A I). factor it to get the eigenvalues:,

### Formula for the inverse matrix. Cramer s rule. Review: 3 3 determinants can be computed expanding by any row or column

Math 20F Linear Algebra Lecture 18 1 Determinants, n n Review: The 3 3 case Slide 1 Determinants n n (Expansions by rows and columns Relation with Gauss elimination matrices: Properties) Formula for the

### Determinants Chapter 3 of Lay

Determinants Chapter of Lay Dr. Doreen De Leon Math 152, Fall 201 1 Introduction to Determinants Section.1 of Lay Given a square matrix A = [a ij, the determinant of A is denoted by det A or a 11 a 1j

### ALGEBRA QUALIFYING EXAM PROBLEMS LINEAR ALGEBRA

ALGEBRA QUALIFYING EXAM PROBLEMS LINEAR ALGEBRA Kent State University Department of Mathematical Sciences Compiled and Maintained by Donald L. White Version: August 29, 2017 CONTENTS LINEAR ALGEBRA AND

### Numerical Linear Algebra

Numerical Linear Algebra Direct Methods Philippe B. Laval KSU Fall 2017 Philippe B. Laval (KSU) Linear Systems: Direct Solution Methods Fall 2017 1 / 14 Introduction The solution of linear systems is one

### Mathematical Methods wk 2: Linear Operators

John Magorrian, magog@thphysoxacuk These are work-in-progress notes for the second-year course on mathematical methods The most up-to-date version is available from http://www-thphysphysicsoxacuk/people/johnmagorrian/mm

MTH50 Spring 07 HW Assignment 7 {From [FIS0]}: Sec 44 #4a h 6; Sec 5 #ad ac 4ae 4 7 The due date for this assignment is 04/05/7 Sec 44 #4a h Evaluate the erminant of the following matrices by any legitimate

### B553 Lecture 5: Matrix Algebra Review

B553 Lecture 5: Matrix Algebra Review Kris Hauser January 19, 2012 We have seen in prior lectures how vectors represent points in R n and gradients of functions. Matrices represent linear transformations

### CHAPTER 6. Direct Methods for Solving Linear Systems

CHAPTER 6 Direct Methods for Solving Linear Systems. Introduction A direct method for approximating the solution of a system of n linear equations in n unknowns is one that gives the exact solution to

### AN ELEMENTARY PROOF OF THE SPECTRAL RADIUS FORMULA FOR MATRICES

AN ELEMENTARY PROOF OF THE SPECTRAL RADIUS FORMULA FOR MATRICES JOEL A. TROPP Abstract. We present an elementary proof that the spectral radius of a matrix A may be obtained using the formula ρ(a) lim

### Chapter 2: Matrices and Linear Systems

Chapter 2: Matrices and Linear Systems Paul Pearson Outline Matrices Linear systems Row operations Inverses Determinants Matrices Definition An m n matrix A = (a ij ) is a rectangular array of real numbers

### Chapter 4 & 5: Vector Spaces & Linear Transformations

Chapter 4 & 5: Vector Spaces & Linear Transformations Philip Gressman University of Pennsylvania Philip Gressman Math 240 002 2014C: Chapters 4 & 5 1 / 40 Objective The purpose of Chapter 4 is to think

### 1. General Vector Spaces

1.1. Vector space axioms. 1. General Vector Spaces Definition 1.1. Let V be a nonempty set of objects on which the operations of addition and scalar multiplication are defined. By addition we mean a rule

### Basic Concepts in Matrix Algebra

Basic Concepts in Matrix Algebra An column array of p elements is called a vector of dimension p and is written as x p 1 = x 1 x 2. x p. The transpose of the column vector x p 1 is row vector x = [x 1

### Linear Algebra in Actuarial Science: Slides to the lecture

Linear Algebra in Actuarial Science: Slides to the lecture Fall Semester 2010/2011 Linear Algebra is a Tool-Box Linear Equation Systems Discretization of differential equations: solving linear equations

### 2.3. VECTOR SPACES 25

2.3. VECTOR SPACES 25 2.3 Vector Spaces MATH 294 FALL 982 PRELIM # 3a 2.3. Let C[, ] denote the space of continuous functions defined on the interval [,] (i.e. f(x) is a member of C[, ] if f(x) is continuous

### Systems of Linear Equations. By: Tri Atmojo Kusmayadi and Mardiyana Mathematics Education Sebelas Maret University

Systems of Linear Equations By: Tri Atmojo Kusmayadi and Mardiyana Mathematics Education Sebelas Maret University Standard of Competency: Understanding the properties of systems of linear equations, matrices,

### 1. Select the unique answer (choice) for each problem. Write only the answer.

MATH 5 Practice Problem Set Spring 7. Select the unique answer (choice) for each problem. Write only the answer. () Determine all the values of a for which the system has infinitely many solutions: x +

### MA 265 FINAL EXAM Fall 2012

MA 265 FINAL EXAM Fall 22 NAME: INSTRUCTOR S NAME:. There are a total of 25 problems. You should show work on the exam sheet, and pencil in the correct answer on the scantron. 2. No books, notes, or calculators

### Principal Components Analysis (PCA) and Singular Value Decomposition (SVD) with applications to Microarrays

Principal Components Analysis (PCA) and Singular Value Decomposition (SVD) with applications to Microarrays Prof. Tesler Math 283 Fall 2015 Prof. Tesler Principal Components Analysis Math 283 / Fall 2015

### Eigenvalues and Eigenvectors

Chapter 6 Eigenvalues and Eigenvectors 6. Introduction to Eigenvalues Eigenvalues are the key to a system of n differential equations : dy=dt ay becomes dy=dt Ay. Now A is a matrix and y is a vector.y.t/;

### L3: Review of linear algebra and MATLAB

L3: Review of linear algebra and MATLAB Vector and matrix notation Vectors Matrices Vector spaces Linear transformations Eigenvalues and eigenvectors MATLAB primer CSCE 666 Pattern Analysis Ricardo Gutierrez-Osuna

### Math 4377/6308 Advanced Linear Algebra

3.1 Elementary Matrix Math 4377/6308 Advanced Linear Algebra 3.1 Elementary Matrix Operations and Elementary Matrix Jiwen He Department of Mathematics, University of Houston jiwenhe@math.uh.edu math.uh.edu/

### EIGENVALUES AND EIGENVECTORS

EIGENVALUES AND EIGENVECTORS Diagonalizable linear transformations and matrices Recall, a matrix, D, is diagonal if it is square and the only non-zero entries are on the diagonal This is equivalent to