Eigenvalues and Eigenvectors
|
|
- Juniper Marvin Walters
- 6 years ago
- Views:
Transcription
1 Chapter 6 Eigenvalues and Eigenvectors 6. Introduction to Eigenvalues Eigenvalues are the key to a system of n differential equations : dy=dt ay becomes dy=dt Ay. Now A is a matrix and y is a vector.y.t/; : : : ; y n.t//. The vector y changes with time. Here is a system of two equations with its by matrix A : y 4y C y y y C y is y y 4 y : () y How to solve this coupled system, y Ay with y and y in both equations? The good way is to find solutions that uncouple the problem. We want y and y to grow or decay in exactly the same way (with the same e t ) : Look for y.t/ e t a y.t/ e t b In vector notation this is y.t/ e t x () That vector x.a; b/ is called an eigenvector. The growth rate is an eigenvalue. This section will show how to find x and. Here I will jump to x and for the matrix in (). a First eigenvector x = and first eigenvalue 5 in y e b 5t x y e 5t y 5 e 5t 4y C y has y e 5t y 5 e 5t y C y a Second eigenvector x = and second eigenvalue in y e b t x This y e t x is a second solution y e t y e t has y e t 4y C y y e t y C y
2 6 Chapter 6. Eigenvalues and Eigenvectors Those two x s and s combine with any c, c to give the complete solution to y Ay : e 5t e Complete solution y.t/ c e 5t C c t e t c e 5t C c e t : () This is exactly what we hope to achieve for other equations y Ay with constant A. The solutions we want have the special form y.t/ e t x. Substitute that solution into y Ay, to see the equation Ax x for an eigenvalue and its eigenvector x : d dt.et x/ A.e t x/ is e t x Ae t x: ivide both sides by e t : Eigenvalue and eigenvector of A Ax x (4) Those eigenvalues (5 and for this A) are a new way to see into the heart of a matrix. This chapter enters a different part of linear algebra, based on Ax x. The last page of Chapter 6 has eigenvalue-eigenvector information about many different matrices. Finding Eigenvalues from det.a I/ Almost all vectors change direction, when they are multiplied by A. Certain very exceptional vectors x are in the same direction as Ax. Those are the eigenvectors. The vector Ax (in the same direction as x) is a number times the original x. The eigenvalue tells whether the eigenvector x is stretched or shrunk or reversed or left unchanged when it is multiplied by A. We may find or or or. The eigenvalue could be zero! Ax x puts this eigenvector x in the nullspace of A. If A is the identity matrix, every vector has Ax x. All vectors are eigenvectors of I. Most by matrices have two eigenvector directions and two eigenvalues and. To find the eigenvalues, write the equation Ax x in the good form.a I/x. If.A I/x, then A I is a singular matrix. Its determinant must be zero. The determinant of A I a b c d is.a /.d / bc : Our goal is to shift A by the right amount I, so that.a I/x has a solution. Then x is the eigenvector, is the eigenvalue, and A I is not invertible. So we look for numbers that make det.a I/. I will start with the matrix A in equation (). 4 Example For A, subtract from the diagonal and find the determinant : det.a 4 I/ det 6 C 5. 5/. /: (5) I factored the quadratic, to see the two eigenvalues 5 and. The matrices A 5I and A I are singular. We have found the s from det.a I/.
3 6.. Introduction to Eigenvalues 7 For each of the eigenvalues 5 and, we now find an eigenvector x :.A 5I/ x is.a I/ x is x x and and x x Those were the vectors.a; b/ in our special solutions y e t x. Both components of y have the growth rate, so the differential equation was easily solved : y e t x. Two eigenvectors gave two solutions. Combinations c y C c y give all solutions. Example Find the eigenvalues and eigenvectors of the Markov matrix A :8 : : :7. det.a :8 : I/ det : :7 C. / : I factored the quadratic into times, to see the two eigenvalues and. The eigenvectors x and x are in the nullspaces of A I and A I..A I/ x is Ax x The first eigenvector is x.:6; :4/.A I/ x is Ax x The second eigenvector is x.; / :6 x :4 x and and :8 : :6 Ax x (Ax x means that ) : :7 :4 :8 : :5 Ax (this is : :7 :5 x so ). If x is multiplied again by A, we still get x. Every power of A will give A n x x. Multiplying x by A gave x, and if we multiply again we get. / times x. When A is squared, the eigenvectors x stay the same. A x A.x/.Ax/ x. Notice. This pattern keeps going, because the eigenvectors stay in their own directions. They never get mixed. The eigenvectors of A are the same x and x. The eigenvalues of A are and. / very small number. We mention that this particular A is a Markov matrix. Its entries are positive and every column adds to. Those facts guarantee that the largest eigenvalue must be.
4 8 Chapter 6. Eigenvalues and Eigenvectors :6 Ax x :4 A x./ x :5 :5 Ax x :5 x :5 A A x.:5/ x :8 : : :7 Ax x A n x n x :5 :5 Figure 6.: The eigenvectors keep their directions. A has eigenvalues and.:5/. The eigenvector Ax x is the steady state which all columns of A k will approach. Giant Markov matrices are the key to Google s search algorithm. It ranks web pages. Linear algebra has made Google one of the most valuable companies in the world. Powers of a Matrix When the eigenvalues of A are known, we immediately know the eigenvalues of all powers A k and shifts A C ci and all functions of A. Each eigenvector of A is also an eigenvector of A k and A and A C ci : If Ax x then A k x k x and A x x and.a C ci/x. C c/x: (6) Start again with A x, which is A times Ax x. Then Ax is the same as Ax for any number, and Ax is x. We have proved that A x x. For higher powers A k x, continue multiplying Ax x by A. Step by step you reach A k x k x. For the eigenvalues of A, first multiply by A and then divide by : Eigenvalues of A are Ax x x A x A x x (7) We are assuming that A exists! If A is invertible then will never be zero. Invertible matrices have all. Singular matrices have the eigenvalue. The shift from A to A C ci just adds c to every eigenvalue (don t change x) : Shift of A If Ax x then.a C ci/x Ax C cx. C c/x: (8) As long as we keep the same eigenvector x, we can allow any function of A : Functions of A.A C A C 5I/x. C C 5/x e A x e x: (9)
5 6.. Introduction to Eigenvalues 9 I slipped in e A I C A C A C to show that infinite series produce matrices too. Let me show you the powers of the Markov matrix A in Example. That starting matrix is unrecognizable after a few steps. :8 : :7 :45 :65 :55 :6 :6 : :7 : :55 :5 :475 :4 :4 () A A A A A was found by using and its eigenvector Œ:6; :4, not by multiplying matrices. The eigenvalues of A are and, so the eigenvalues of A are and. /. That last number is extremely small, and we can t see it in the first digits of A. How could you multiply A 99 times another vector like v.:8; :/? This is not an eigenvector, but v is a combination of eigenvectors. This is a key idea, to express any vector v by using the eigenvectors. Separate into eigenvectors v x C.:/x :8 :6 : v C : () : :4 : Each eigenvector is multiplied by its eigenvalue, when we multiply the vector by A. After 99 steps, x is unchanged and x is multiplied by. /99 : :8 A 99 is A 99.x C :x / x C.:/. :6 : /99 x C 4 very small 5 : :4 vector This is the first column of A, because v.:8; :/ is the first column of A. The number we originally wrote as :6 was not exact. We left out.:/. /99 which wouldn t show up for decimal places. The eigenvector x.:6; :4/ is a steady state that doesn t change (because /. The eigenvector x is a decaying mode that virtually disappears (because =/. The higher the power of A, the more closely its columns approach the steady state. Bad News About AB and A C B Normally the eigenvalues of A and B (separately) do not tell us the eigenvalues of AB. We also don t know about A C B. When A and B have different eigenvectors, our reasoning fails. The good results for A are wrong for AB and A C B, when AB is different from BA. The eigenvalues won t come from A and B separately : A B AB BA A C B All the eigenvalues of A and B are zero. But AB has an eigenvalue, and A C B has eigenvalues and. But one rule holds : AB and BA have the same eigenvalues.
6 Chapter 6. Eigenvalues and Eigenvectors eterminants The determinant is a single number with amazing properties. It is zero when the matrix has no inverse. That leads to the eigenvalue equation det.a I/. When A is invertible, the determinant of A is =.det A/. Every entry in A is a ratio of two determinants. I want to summarize the algebra, leaving the details for my companion textbook Introduction to Linear Algebra. The difficulty with det.a I/ is that an n by n determinant involves n Š terms. For n 5 this is terms generally impossible to use. For n there are six terms, three with plus signs and three with minus. Each of those six terms includes one number from every row and every column : C C C eterminant from nš 6 terms Three plus signs, three minus signs C./.5/.9/ C./.6/.7/ C./.4/.8/./.5/.7/./.6/.8/./.4/.9/ That shows how to find the six terms. For this particular matrix the total must be det A, because the matrix happens to be singular : row C row equals.row /. Let me start with five useful properties of determinants, for all square matrices.. Subtracting a multiple of one row from another row leaves det A unchanged.. The determinant reverses sign when two rows are exchanged.. If A is triangular then det A product of diagonal entries. 4. The determinant of AB equals.det A/ times.det B/. 5. The determinant of A T equals the determinant of A. By combining ; ; you will see how the determinant comes from elimination : The determinant equals (product of the pivots): () Property says that A and U have the same determinant, unless rows are exchanged. Property says that an odd number of exchanges would leave det A det U. Property says that det U is the product of the pivots on its main diagonal. When elimination takes A to U, we find det A (product of the pivots). This is how all numerical software (like MATLAB or Python or Julia ) would compute det A. Plus and minus signs play a big part in determinants. Half of the n Š terms have plus signs, and half come with minus signs. For n, one row exchange puts 5 7 or 6 8 or 4 9 on the main diagonal. A minus sign from one row exchange.
7 6.. Introduction to Eigenvalues Two row exchanges (an even number) take you back to () (6) (7) and () (4) (8). This indicates how the 4 terms would go for n 4, twelve terms with plus and twelve with minus. Even permutation matrices have det P and odd permutations have det P. Inverse of A If det A, you can solve Av b and find A using determinants : Cramer s Rule v det B det A v det B det A v n det B n det A () The matrix B j replaces the j th column of A by the vector b. Cramer s Rule is expensive! To find the columns of A, we solve AA I. That is the Gauss-Jordan idea : For each column b in I, solve Av b to find a column v of A. In this special case, when b is a column of I, the numbers det B j in Cramer s Rule are called cofactors. They reduce to determinants of size n, because b has so many zeros. Every entry of A is a cofactor of A divided by the determinant of A. I will close with three examples, to introduce the trace of a matrix and to show that real matrices can have imaginary (or complex) eigenvalues and eigenvectors. Example Find the eigenvalues and eigenvectors of S. Solution You can see that x.; / will be in the same direction as Sx.; /. Then x is an eigenvector of S with. We want the matrix S I to be singular. S det.s I/ det 4 C : Notice that is the determinant of S (without ). And 4 is the sum C down the central diagonal of S. The diagonal sum 4 is the trace of A. It equals C C. Now factor 4 C into. /. /. The matrix S I is singular (zero determinant) for and. Each eigenvalue has an eigenvector:.s I/ x.s I/ x The eigenvalues and are real. The eigenvectors.; / and.; / are orthogonal. Those properties always come together for symmetric matrices (Section 6.5). Here is an antisymmetric matrix with A T A. It rotates all real vectors by 9 ı. Real vectors can t be eigenvectors of a rotation matrix because it changes their direction.
8 Chapter 6. Eigenvalues and Eigenvectors Example 4 This real matrix has imaginary eigenvalues i, i and complex eigenvectors : A A T det.a I/ det C : That determinant C is zero for i and i. The eigenvectors are.; i/ and.; i/ : i i i i i i i i Somehow those complex vectors x and x don t get rotated (I don t really know how). Multiplying the eigenvalues.i/. i/ gives det A. Adding the eigenvalues gives.i/ C. i/. This equals the sum C down the diagonal of A. Product of eigenvalues = determinant Sum of eigenvalues = trace (4) Those are true statements for all square matrices. The trace is the sum a C C a nn down the main diagonal of A. This sum and product are is especially valuable for by matrices, when the determinant ad bc and the trace C a C d completely determine and. Look now at rotation of a plane through any angle. Example 5 Rotation comes from an orthogonal matrix Q. Then e i and e i : cos Q sin sin cos cos C i sin cos i sin C cos trace determinant I multiplied. /. / to get cos C sin. In polar form e i times e i is. The eigenvectors of Q are.; i/ and.; i/ for all rotation angles. Before ending this section, I need to tell you the truth. It is not easy to find eigenvalues and eigenvectors of large matrices. The equation det.a I/ is more or less limited to by and by. For larger matrices, we can gradually make them triangular without changing the eigenvalues. For triangular matrices the eigenvalues are on the diagonal. A good code to compute and x is free in LAPACK. The MATLAB command is eig.a/. REVIEW OF THE KEY IEAS. Ax x says that eigenvectors x keep the same direction when multiplied by A.. Ax x also says that det.a I/. This equation determines n eigenvalues.. The eigenvalues of A and A are and, with the same eigenvectors as A. 4. Singular matrices have. Triangular matrices have s on their diagonal.
9 6.. Introduction to Eigenvalues 5. The sum down the main diagonal of A (the trace) is the sum of the eigenvalues. 6. The determinant is the product of the s. It is also (product of the pivots). Problem Set 6. Example has powers of this Markov matrix A : :8 : :7 :45 A and A : :7 : :55 and A :6 :6 : :4 :4 (a) A has eigenvalues and. Find the eigenvalues of A and A. (b) What are the eigenvectors of A? One eigenvector is in the nullspace. (c) Check the determinant of A and A. Compare with.det A/ and.det A/. Find the eigenvalues and the eigenvectors of these two matrices : 4 4 A and A C I : 4 A C I has the eigenvectors as A. Its eigenvalues are by. Compute the eigenvalues and eigenvectors of A and also A : A and A = : = A has the eigenvectors as A. When A has eigenvalues and, its inverse has eigenvalues. Check that C trace of A C. 4 Compute the eigenvalues and eigenvectors of A and A : 7 A and A : 6 A has the same as A. When A has eigenvalues and, the eigenvalues of A are. In this example, why is C? 5 Find the eigenvalues of A and B (easy for triangular matrices) and A C B : 4 A and B and A C B : 4 Eigenvalues of A C B (are equal to) (might not be equal to) eigenvalues of A plus eigenvalues of B.
10 4 Chapter 6. Eigenvalues and Eigenvectors 6 Find the eigenvalues of A and B and AB and BA : A and B and AB and BA : (a) Are the eigenvalues of AB equal to eigenvalues of A times eigenvalues of B? (b) Are the eigenvalues of AB equal to the eigenvalues of BA? Yes! 7 Elimination produces a triangular matrix U. The eigenvalues of U are on its diagonal (why?). They are not the eigenvalues of A. Give a by example of A and U. 8 (a) If you know that x is an eigenvector, the way to find is to. (b) If you know that is an eigenvalue, the way to find x is to. 9 What do you do to the equation Ax x, in order to prove (a), (b), and (c)? (a) is an eigenvalue of A, as in Problem 4. (b) is an eigenvalue of A, as in Problem. (c) C is an eigenvalue of A C I, as in Problem. Find the eigenvalues and eigenvectors for both of these Markov matrices A and A. Explain from those answers why A is close to A : :6 : A and A :4 :8 = = : = = A by matrix B has eigenvalues ; ;. This information allows you to find : (a) the rank of B (b) the eigenvalues of B (c) the eigenvalues of.b CI/. Find three eigenvectors for this matrix P. Projection matrices only have and. Eigenvectors are in or orthogonal to the subspace that P projects onto. : :4 Projection matrix P P P T P 4 :4 :8 5 : If two eigenvectors x and y share the same repeated eigenvalue, so do all their combinations cx C d y. Find an eigenvector of P with no zero components. From the unit vector u 6 ; 6 ; 6 ; 5 6 construct the rank one projection matrix P uu T. This matrix has P P because u T u. (a) Explain why P u.uu T /u equals u. Then u is an eigenvector with. (b) If v is perpendicular to u show that Pv. Then. (c) Find three independent eigenvectors of P all with eigenvalue.
11 6.. Introduction to Eigenvalues 5 4 Solve det.q I/ by the quadratic formula to reach cos i sin : cos sin Q rotates the xy plane by the angle. No real s. sin cos Find the eigenvectors of Q by solving.q I/x. Use i. 5 Find three by matrices that have. The trace is zero and the determinant is zero. A might not be the zero matrix but check that A is all zeros. 6 This matrix is singular with rank one. Find three s and three eigenvectors : Rank one A : 7 When a C b c C d show that.; / is an eigenvector and find both eigenvalues : 5 a b Use the trace to find A A : 4 c d 8 If A has 4 and 5 then det.a I/. 4/. 5/ 9 C. Find three matrices that have trace a C d 9 and determinant, so 4 and 5. 9 Suppose Au u and Av v and Aw 5w. The eigenvalues are ; ; 5. (a) Give a basis for the nullspace of A and a basis for the column space. (b) Find a particular solution to Ax v C w. Find all solutions. (c) Ax u has no solution. If it did then would be in the column space. Choose the last row of A to produce.a/ eigenvalues 4 and 7.b/ any and. Companion matrix A : The eigenvalues of A equal the eigenvalues of A T. This is because det.a I/ equals det.a T I/. That is true because. Show by an example that the eigenvectors of A and A T are not the same. Construct any by Markov matrix M : positive entries down each column add to. Show that M T.; ; /.; ; /. By Problem, is also an eigenvalue of M. Challenge : A by singular Markov matrix with trace has what s? Suppose A and B have the same eigenvalues ; : : :; n with the same independent eigenvectors x ; : : :; x n. Then A B. Reason : Any vector v is a combination c x C C c n x n. What is Av? What is Bv?
12 6 Chapter 6. Eigenvalues and Eigenvectors 4 The block B has eigenvalues ; and C has eigenvalues ; 4 and has eigenvalues 5; 7. Find the eigenvalues of the 4 by 4 matrix A : B C A : 6 5 Find the rank and the four eigenvalues of A and C : A and C : 6 Subtract I from the previous A. Find the eigenvalues of B and B : B A I and B : 7 (Review) Find the eigenvalues of A, B, and C : A and B 4 5 and C 4 5 : 6 8 Every permutation matrix leaves x.; ; : : :; / unchanged. Then. Find two more s (possibly complex) for these permutations, from det.p I/ : P 4 5 and P 4 5 : 9 The determinant of A equals the product n. Start with the polynomial det.a I/ separated into its n factors (always possible). Then set : det.a I/. /. /. n / so det A : The sum of the diagonal entries (the trace) equals the sum of the eigenvalues : a b A has det.a I/.a C d/ C ad bc : c d The quadratic formula gives the eigenvalues.acd C p /= and. Their sum is. If A has and 4 then det.a I/.
6 EIGENVALUES AND EIGENVECTORS
6 EIGENVALUES AND EIGENVECTORS INTRODUCTION TO EIGENVALUES 61 Linear equations Ax = b come from steady state problems Eigenvalues have their greatest importance in dynamic problems The solution of du/dt
More informationConceptual Questions for Review
Conceptual Questions for Review Chapter 1 1.1 Which vectors are linear combinations of v = (3, 1) and w = (4, 3)? 1.2 Compare the dot product of v = (3, 1) and w = (4, 3) to the product of their lengths.
More informationHOMEWORK PROBLEMS FROM STRANG S LINEAR ALGEBRA AND ITS APPLICATIONS (4TH EDITION)
HOMEWORK PROBLEMS FROM STRANG S LINEAR ALGEBRA AND ITS APPLICATIONS (4TH EDITION) PROFESSOR STEVEN MILLER: BROWN UNIVERSITY: SPRING 2007 1. CHAPTER 1: MATRICES AND GAUSSIAN ELIMINATION Page 9, # 3: Describe
More information[Disclaimer: This is not a complete list of everything you need to know, just some of the topics that gave people difficulty.]
Math 43 Review Notes [Disclaimer: This is not a complete list of everything you need to know, just some of the topics that gave people difficulty Dot Product If v (v, v, v 3 and w (w, w, w 3, then the
More information18.06SC Final Exam Solutions
18.06SC Final Exam Solutions 1 (4+7=11 pts.) Suppose A is 3 by 4, and Ax = 0 has exactly 2 special solutions: 1 2 x 1 = 1 and x 2 = 1 1 0 0 1 (a) Remembering that A is 3 by 4, find its row reduced echelon
More informationMath Linear Algebra Final Exam Review Sheet
Math 15-1 Linear Algebra Final Exam Review Sheet Vector Operations Vector addition is a component-wise operation. Two vectors v and w may be added together as long as they contain the same number n of
More informationMath 520 Exam 2 Topic Outline Sections 1 3 (Xiao/Dumas/Liaw) Spring 2008
Math 520 Exam 2 Topic Outline Sections 1 3 (Xiao/Dumas/Liaw) Spring 2008 Exam 2 will be held on Tuesday, April 8, 7-8pm in 117 MacMillan What will be covered The exam will cover material from the lectures
More informationq n. Q T Q = I. Projections Least Squares best fit solution to Ax = b. Gram-Schmidt process for getting an orthonormal basis from any basis.
Exam Review Material covered by the exam [ Orthogonal matrices Q = q 1... ] q n. Q T Q = I. Projections Least Squares best fit solution to Ax = b. Gram-Schmidt process for getting an orthonormal basis
More informationMath 215 HW #9 Solutions
Math 5 HW #9 Solutions. Problem 4.4.. If A is a 5 by 5 matrix with all a ij, then det A. Volumes or the big formula or pivots should give some upper bound on the determinant. Answer: Let v i be the ith
More informationLinear Algebra Primer
Linear Algebra Primer David Doria daviddoria@gmail.com Wednesday 3 rd December, 2008 Contents Why is it called Linear Algebra? 4 2 What is a Matrix? 4 2. Input and Output.....................................
More informationMath 18.6, Spring 213 Problem Set #6 April 5, 213 Problem 1 ( 5.2, 4). Identify all the nonzero terms in the big formula for the determinants of the following matrices: 1 1 1 2 A = 1 1 1 1 1 1, B = 3 4
More informationA Brief Outline of Math 355
A Brief Outline of Math 355 Lecture 1 The geometry of linear equations; elimination with matrices A system of m linear equations with n unknowns can be thought of geometrically as m hyperplanes intersecting
More informationMethods for Solving Linear Systems Part 2
Methods for Solving Linear Systems Part 2 We have studied the properties of matrices and found out that there are more ways that we can solve Linear Systems. In Section 7.3, we learned that we can use
More informationExtra Problems for Math 2050 Linear Algebra I
Extra Problems for Math 5 Linear Algebra I Find the vector AB and illustrate with a picture if A = (,) and B = (,4) Find B, given A = (,4) and [ AB = A = (,4) and [ AB = 8 If possible, express x = 7 as
More informationMIT Final Exam Solutions, Spring 2017
MIT 8.6 Final Exam Solutions, Spring 7 Problem : For some real matrix A, the following vectors form a basis for its column space and null space: C(A) = span,, N(A) = span,,. (a) What is the size m n of
More informationReview problems for MA 54, Fall 2004.
Review problems for MA 54, Fall 2004. Below are the review problems for the final. They are mostly homework problems, or very similar. If you are comfortable doing these problems, you should be fine on
More information(a) If A is a 3 by 4 matrix, what does this tell us about its nullspace? Solution: dim N(A) 1, since rank(a) 3. Ax =
. (5 points) (a) If A is a 3 by 4 matrix, what does this tell us about its nullspace? dim N(A), since rank(a) 3. (b) If we also know that Ax = has no solution, what do we know about the rank of A? C(A)
More informationANSWERS. E k E 2 E 1 A = B
MATH 7- Final Exam Spring ANSWERS Essay Questions points Define an Elementary Matrix Display the fundamental matrix multiply equation which summarizes a sequence of swap, combination and multiply operations,
More informationChapter 2 Notes, Linear Algebra 5e Lay
Contents.1 Operations with Matrices..................................1.1 Addition and Subtraction.............................1. Multiplication by a scalar............................ 3.1.3 Multiplication
More informationCHAPTER 8: Matrices and Determinants
(Exercises for Chapter 8: Matrices and Determinants) E.8.1 CHAPTER 8: Matrices and Determinants (A) means refer to Part A, (B) means refer to Part B, etc. Most of these exercises can be done without a
More informationMath Lecture 26 : The Properties of Determinants
Math 2270 - Lecture 26 : The Properties of Determinants Dylan Zwick Fall 202 The lecture covers section 5. from the textbook. The determinant of a square matrix is a number that tells you quite a bit about
More information18.06 Problem Set 8 - Solutions Due Wednesday, 14 November 2007 at 4 pm in
806 Problem Set 8 - Solutions Due Wednesday, 4 November 2007 at 4 pm in 2-06 08 03 Problem : 205+5+5+5 Consider the matrix A 02 07 a Check that A is a positive Markov matrix, and find its steady state
More informationft-uiowa-math2550 Assignment NOTRequiredJustHWformatOfQuizReviewForExam3part2 due 12/31/2014 at 07:10pm CST
me me ft-uiowa-math2550 Assignment NOTRequiredJustHWformatOfQuizReviewForExam3part2 due 12/31/2014 at 07:10pm CST 1. (1 pt) local/library/ui/eigentf.pg A is n n an matrices.. There are an infinite number
More informationThere are six more problems on the next two pages
Math 435 bg & bu: Topics in linear algebra Summer 25 Final exam Wed., 8/3/5. Justify all your work to receive full credit. Name:. Let A 3 2 5 Find a permutation matrix P, a lower triangular matrix L with
More informationLinear Algebra review Powers of a diagonalizable matrix Spectral decomposition
Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Prof. Tesler Math 283 Fall 2016 Also see the separate version of this with Matlab and R commands. Prof. Tesler Diagonalizing
More informationANSWERS (5 points) Let A be a 2 2 matrix such that A =. Compute A. 2
MATH 7- Final Exam Sample Problems Spring 7 ANSWERS ) ) ). 5 points) Let A be a matrix such that A =. Compute A. ) A = A ) = ) = ). 5 points) State ) the definition of norm, ) the Cauchy-Schwartz inequality
More information2. Every linear system with the same number of equations as unknowns has a unique solution.
1. For matrices A, B, C, A + B = A + C if and only if A = B. 2. Every linear system with the same number of equations as unknowns has a unique solution. 3. Every linear system with the same number of equations
More informationStudy Guide for Linear Algebra Exam 2
Study Guide for Linear Algebra Exam 2 Term Vector Space Definition A Vector Space is a nonempty set V of objects, on which are defined two operations, called addition and multiplication by scalars (real
More informationFinal Review Sheet. B = (1, 1 + 3x, 1 + x 2 ) then 2 + 3x + 6x 2
Final Review Sheet The final will cover Sections Chapters 1,2,3 and 4, as well as sections 5.1-5.4, 6.1-6.2 and 7.1-7.3 from chapters 5,6 and 7. This is essentially all material covered this term. Watch
More informationLinear Algebra review Powers of a diagonalizable matrix Spectral decomposition
Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Prof. Tesler Math 283 Fall 2018 Also see the separate version of this with Matlab and R commands. Prof. Tesler Diagonalizing
More informationQuiz ) Locate your 1 st order neighbors. 1) Simplify. Name Hometown. Name Hometown. Name Hometown.
Quiz 1) Simplify 9999 999 9999 998 9999 998 2) Locate your 1 st order neighbors Name Hometown Me Name Hometown Name Hometown Name Hometown Solving Linear Algebraic Equa3ons Basic Concepts Here only real
More informationQueens College, CUNY, Department of Computer Science Numerical Methods CSCI 361 / 761 Spring 2018 Instructor: Dr. Sateesh Mane.
Queens College, CUNY, Department of Computer Science Numerical Methods CSCI 361 / 761 Spring 2018 Instructor: Dr. Sateesh Mane c Sateesh R. Mane 2018 8 Lecture 8 8.1 Matrices July 22, 2018 We shall study
More information3 Matrix Algebra. 3.1 Operations on matrices
3 Matrix Algebra A matrix is a rectangular array of numbers; it is of size m n if it has m rows and n columns. A 1 n matrix is a row vector; an m 1 matrix is a column vector. For example: 1 5 3 5 3 5 8
More informationChapter 5 Eigenvalues and Eigenvectors
Chapter 5 Eigenvalues and Eigenvectors Outline 5.1 Eigenvalues and Eigenvectors 5.2 Diagonalization 5.3 Complex Vector Spaces 2 5.1 Eigenvalues and Eigenvectors Eigenvalue and Eigenvector If A is a n n
More informationCheat Sheet for MATH461
Cheat Sheet for MATH46 Here is the stuff you really need to remember for the exams Linear systems Ax = b Problem: We consider a linear system of m equations for n unknowns x,,x n : For a given matrix A
More informationTopic 2 Quiz 2. choice C implies B and B implies C. correct-choice C implies B, but B does not imply C
Topic 1 Quiz 1 text A reduced row-echelon form of a 3 by 4 matrix can have how many leading one s? choice must have 3 choice may have 1, 2, or 3 correct-choice may have 0, 1, 2, or 3 choice may have 0,
More informationCS 246 Review of Linear Algebra 01/17/19
1 Linear algebra In this section we will discuss vectors and matrices. We denote the (i, j)th entry of a matrix A as A ij, and the ith entry of a vector as v i. 1.1 Vectors and vector operations A vector
More informationCalculating determinants for larger matrices
Day 26 Calculating determinants for larger matrices We now proceed to define det A for n n matrices A As before, we are looking for a function of A that satisfies the product formula det(ab) = det A det
More information18.06 Quiz 2 April 7, 2010 Professor Strang
18.06 Quiz 2 April 7, 2010 Professor Strang Your PRINTED name is: 1. Your recitation number or instructor is 2. 3. 1. (33 points) (a) Find the matrix P that projects every vector b in R 3 onto the line
More informationLinear Algebra: Lecture Notes. Dr Rachel Quinlan School of Mathematics, Statistics and Applied Mathematics NUI Galway
Linear Algebra: Lecture Notes Dr Rachel Quinlan School of Mathematics, Statistics and Applied Mathematics NUI Galway November 6, 23 Contents Systems of Linear Equations 2 Introduction 2 2 Elementary Row
More informationMaths for Signals and Systems Linear Algebra in Engineering
Maths for Signals and Systems Linear Algebra in Engineering Lectures 13-14, Tuesday 11 th November 2014 DR TANIA STATHAKI READER (ASSOCIATE PROFFESOR) IN SIGNAL PROCESSING IMPERIAL COLLEGE LONDON Eigenvectors
More informationLinear Algebra. Matrices Operations. Consider, for example, a system of equations such as x + 2y z + 4w = 0, 3x 4y + 2z 6w = 0, x 3y 2z + w = 0.
Matrices Operations Linear Algebra Consider, for example, a system of equations such as x + 2y z + 4w = 0, 3x 4y + 2z 6w = 0, x 3y 2z + w = 0 The rectangular array 1 2 1 4 3 4 2 6 1 3 2 1 in which the
More informationEigenvalues and Eigenvectors: An Introduction
Eigenvalues and Eigenvectors: An Introduction The eigenvalue problem is a problem of considerable theoretical interest and wide-ranging application. For example, this problem is crucial in solving systems
More information18.06 Problem Set 3 - Solutions Due Wednesday, 26 September 2007 at 4 pm in
8.6 Problem Set 3 - s Due Wednesday, 26 September 27 at 4 pm in 2-6. Problem : (=2+2+2+2+2) A vector space is by definition a nonempty set V (whose elements are called vectors) together with rules of addition
More informationGAUSSIAN ELIMINATION AND LU DECOMPOSITION (SUPPLEMENT FOR MA511)
GAUSSIAN ELIMINATION AND LU DECOMPOSITION (SUPPLEMENT FOR MA511) D. ARAPURA Gaussian elimination is the go to method for all basic linear classes including this one. We go summarize the main ideas. 1.
More information4 ORTHOGONALITY ORTHOGONALITY OF THE FOUR SUBSPACES 4.1
4 ORTHOGONALITY ORTHOGONALITY OF THE FOUR SUBSPACES 4.1 Two vectors are orthogonal when their dot product is zero: v w = orv T w =. This chapter moves up a level, from orthogonal vectors to orthogonal
More informationMath Homework 8 (selected problems)
Math 102 - Homework 8 (selected problems) David Lipshutz Problem 1. (Strang, 5.5: #14) In the list below, which classes of matrices contain A and which contain B? 1 1 1 1 A 0 0 1 0 0 0 0 1 and B 1 1 1
More informationSolution Set 7, Fall '12
Solution Set 7, 18.06 Fall '12 1. Do Problem 26 from 5.1. (It might take a while but when you see it, it's easy) Solution. Let n 3, and let A be an n n matrix whose i, j entry is i + j. To show that det
More information7.6 The Inverse of a Square Matrix
7.6 The Inverse of a Square Matrix Copyright Cengage Learning. All rights reserved. What You Should Learn Verify that two matrices are inverses of each other. Use Gauss-Jordan elimination to find inverses
More informationTopic 15 Notes Jeremy Orloff
Topic 5 Notes Jeremy Orloff 5 Transpose, Inverse, Determinant 5. Goals. Know the definition and be able to compute the inverse of any square matrix using row operations. 2. Know the properties of inverses.
More informationpset3-sol September 7, 2017
pset3-sol September 7, 2017 1 18.06 pset 3 Solutions 1.1 Problem 1 Suppose that you solve AX = B with and find that X is 1 1 1 1 B = 0 2 2 2 1 1 0 1 1 1 0 1 X = 1 0 1 3 1 0 2 1 1.1.1 (a) What is A 1? (You
More informationMATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 1 x 2. x n 8 (4) 3 4 2
MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS SYSTEMS OF EQUATIONS AND MATRICES Representation of a linear system The general system of m equations in n unknowns can be written a x + a 2 x 2 + + a n x n b a
More informationMath 18, Linear Algebra, Lecture C00, Spring 2017 Review and Practice Problems for Final Exam
Math 8, Linear Algebra, Lecture C, Spring 7 Review and Practice Problems for Final Exam. The augmentedmatrix of a linear system has been transformed by row operations into 5 4 8. Determine if the system
More informationChapter 5. Eigenvalues and Eigenvectors
Chapter 5 Eigenvalues and Eigenvectors Section 5. Eigenvectors and Eigenvalues Motivation: Difference equations A Biology Question How to predict a population of rabbits with given dynamics:. half of the
More informationMaths for Signals and Systems Linear Algebra in Engineering
Maths for Signals and Systems Linear Algebra in Engineering Lectures 13 15, Tuesday 8 th and Friday 11 th November 016 DR TANIA STATHAKI READER (ASSOCIATE PROFFESOR) IN SIGNAL PROCESSING IMPERIAL COLLEGE
More informationLinear Algebra, Summer 2011, pt. 2
Linear Algebra, Summer 2, pt. 2 June 8, 2 Contents Inverses. 2 Vector Spaces. 3 2. Examples of vector spaces..................... 3 2.2 The column space......................... 6 2.3 The null space...........................
More informationMath 102, Winter Final Exam Review. Chapter 1. Matrices and Gaussian Elimination
Math 0, Winter 07 Final Exam Review Chapter. Matrices and Gaussian Elimination { x + x =,. Different forms of a system of linear equations. Example: The x + 4x = 4. [ ] [ ] [ ] vector form (or the column
More information0.1 Eigenvalues and Eigenvectors
0.. EIGENVALUES AND EIGENVECTORS MATH 22AL Computer LAB for Linear Algebra Eigenvalues and Eigenvectors Dr. Daddel Please save your MATLAB Session (diary)as LAB9.text and submit. 0. Eigenvalues and Eigenvectors
More informationChapter 5. Linear Algebra. A linear (algebraic) equation in. unknowns, x 1, x 2,..., x n, is. an equation of the form
Chapter 5. Linear Algebra A linear (algebraic) equation in n unknowns, x 1, x 2,..., x n, is an equation of the form a 1 x 1 + a 2 x 2 + + a n x n = b where a 1, a 2,..., a n and b are real numbers. 1
More information2. Linear algebra. matrices and vectors. linear equations. range and nullspace of matrices. function of vectors, gradient and Hessian
FE661 - Statistical Methods for Financial Engineering 2. Linear algebra Jitkomut Songsiri matrices and vectors linear equations range and nullspace of matrices function of vectors, gradient and Hessian
More informationLinear Algebra, part 2 Eigenvalues, eigenvectors and least squares solutions
Linear Algebra, part 2 Eigenvalues, eigenvectors and least squares solutions Anna-Karin Tornberg Mathematical Models, Analysis and Simulation Fall semester, 2013 Main problem of linear algebra 2: Given
More informationMATH 310, REVIEW SHEET 2
MATH 310, REVIEW SHEET 2 These notes are a very short summary of the key topics in the book (and follow the book pretty closely). You should be familiar with everything on here, but it s not comprehensive,
More informationLINEAR ALGEBRA KNOWLEDGE SURVEY
LINEAR ALGEBRA KNOWLEDGE SURVEY Instructions: This is a Knowledge Survey. For this assignment, I am only interested in your level of confidence about your ability to do the tasks on the following pages.
More informationIntroduction to Matrices
POLS 704 Introduction to Matrices Introduction to Matrices. The Cast of Characters A matrix is a rectangular array (i.e., a table) of numbers. For example, 2 3 X 4 5 6 (4 3) 7 8 9 0 0 0 Thismatrix,with4rowsand3columns,isoforder
More informationMATH 1120 (LINEAR ALGEBRA 1), FINAL EXAM FALL 2011 SOLUTIONS TO PRACTICE VERSION
MATH (LINEAR ALGEBRA ) FINAL EXAM FALL SOLUTIONS TO PRACTICE VERSION Problem (a) For each matrix below (i) find a basis for its column space (ii) find a basis for its row space (iii) determine whether
More informationLinear Algebra. Chapter Linear Equations
Chapter 3 Linear Algebra Dixit algorizmi. Or, So said al-khwarizmi, being the opening words of a 12 th century Latin translation of a work on arithmetic by al-khwarizmi (ca. 78 84). 3.1 Linear Equations
More informationMatrices and Linear Algebra
Contents Quantitative methods for Economics and Business University of Ferrara Academic year 2017-2018 Contents 1 Basics 2 3 4 5 Contents 1 Basics 2 3 4 5 Contents 1 Basics 2 3 4 5 Contents 1 Basics 2
More informationLecture Notes in Linear Algebra
Lecture Notes in Linear Algebra Dr. Abdullah Al-Azemi Mathematics Department Kuwait University February 4, 2017 Contents 1 Linear Equations and Matrices 1 1.2 Matrices............................................
More information(a) II and III (b) I (c) I and III (d) I and II and III (e) None are true.
1 Which of the following statements is always true? I The null space of an m n matrix is a subspace of R m II If the set B = {v 1,, v n } spans a vector space V and dimv = n, then B is a basis for V III
More informationMTH 464: Computational Linear Algebra
MTH 464: Computational Linear Algebra Lecture Outlines Exam 2 Material Prof. M. Beauregard Department of Mathematics & Statistics Stephen F. Austin State University March 2, 2018 Linear Algebra (MTH 464)
More informationLinear Algebra Highlights
Linear Algebra Highlights Chapter 1 A linear equation in n variables is of the form a 1 x 1 + a 2 x 2 + + a n x n. We can have m equations in n variables, a system of linear equations, which we want to
More information18.06 Professor Johnson Quiz 1 October 3, 2007
18.6 Professor Johnson Quiz 1 October 3, 7 SOLUTIONS 1 3 pts.) A given circuit network directed graph) which has an m n incidence matrix A rows = edges, columns = nodes) and a conductance matrix C [diagonal
More information18.06 Problem Set 1 Solutions Due Thursday, 11 February 2010 at 4 pm in Total: 100 points
18.06 Problem Set 1 Solutions Due Thursday, 11 February 2010 at 4 pm in 2-106. Total: 100 points Section 1.2. Problem 23: The figure shows that cos(α) = v 1 / v and sin(α) = v 2 / v. Similarly cos(β) is
More informationReview Questions REVIEW QUESTIONS 71
REVIEW QUESTIONS 71 MATLAB, is [42]. For a comprehensive treatment of error analysis and perturbation theory for linear systems and many other problems in linear algebra, see [126, 241]. An overview of
More informationReview for Exam Find all a for which the following linear system has no solutions, one solution, and infinitely many solutions.
Review for Exam. Find all a for which the following linear system has no solutions, one solution, and infinitely many solutions. x + y z = 2 x + 2y + z = 3 x + y + (a 2 5)z = a 2 The augmented matrix for
More informationProblem Set (T) If A is an m n matrix, B is an n p matrix and D is a p s matrix, then show
MTH 0: Linear Algebra Department of Mathematics and Statistics Indian Institute of Technology - Kanpur Problem Set Problems marked (T) are for discussions in Tutorial sessions (T) If A is an m n matrix,
More informationNotes on Linear Algebra
Notes on Linear Algebra Chris Woodward Rutgers University, New Brunswick Copyright 3, All right reserved Contents Vectors Pancakes and waffles Vector operations 3 3 Vector form of a linear system 4 4 Vectors
More informationSolutions to Final Practice Problems Written by Victoria Kala Last updated 12/5/2015
Solutions to Final Practice Problems Written by Victoria Kala vtkala@math.ucsb.edu Last updated /5/05 Answers This page contains answers only. See the following pages for detailed solutions. (. (a x. See
More information22A-2 SUMMER 2014 LECTURE 5
A- SUMMER 0 LECTURE 5 NATHANIEL GALLUP Agenda Elimination to the identity matrix Inverse matrices LU factorization Elimination to the identity matrix Previously, we have used elimination to get a system
More informationChapters 5 & 6: Theory Review: Solutions Math 308 F Spring 2015
Chapters 5 & 6: Theory Review: Solutions Math 308 F Spring 205. If A is a 3 3 triangular matrix, explain why det(a) is equal to the product of entries on the diagonal. If A is a lower triangular or diagonal
More informationChapter 2. Matrix Arithmetic. Chapter 2
Matrix Arithmetic Matrix Addition and Subtraction Addition and subtraction act element-wise on matrices. In order for the addition/subtraction (A B) to be possible, the two matrices A and B must have the
More informationMH1200 Final 2014/2015
MH200 Final 204/205 November 22, 204 QUESTION. (20 marks) Let where a R. A = 2 3 4, B = 2 3 4, 3 6 a 3 6 0. For what values of a is A singular? 2. What is the minimum value of the rank of A over all a
More informationj=1 x j p, if 1 p <, x i ξ : x i < ξ} 0 as p.
LINEAR ALGEBRA Fall 203 The final exam Almost all of the problems solved Exercise Let (V, ) be a normed vector space. Prove x y x y for all x, y V. Everybody knows how to do this! Exercise 2 If V is a
More informationLinear Algebra: Matrix Eigenvalue Problems
CHAPTER8 Linear Algebra: Matrix Eigenvalue Problems Chapter 8 p1 A matrix eigenvalue problem considers the vector equation (1) Ax = λx. 8.0 Linear Algebra: Matrix Eigenvalue Problems Here A is a given
More information9 Appendix. Determinants and Cramer s formula
LINEAR ALGEBRA: THEORY Version: August 12, 2000 133 9 Appendix Determinants and Cramer s formula Here we the definition of the determinant in the general case and summarize some features Then we show how
More information4. Determinants.
4. Determinants 4.1. Determinants; Cofactor Expansion Determinants of 2 2 and 3 3 Matrices 2 2 determinant 4.1. Determinants; Cofactor Expansion Determinants of 2 2 and 3 3 Matrices 3 3 determinant 4.1.
More information18.06 Problem Set 2 Solution
18.06 Problem Set 2 Solution Total: 100 points Section 2.5. Problem 24: Use Gauss-Jordan elimination on [U I] to find the upper triangular U 1 : 1 a b 1 0 UU 1 = I 0 1 c x 1 x 2 x 3 = 0 1 0. 0 0 1 0 0
More informationComputational Methods CMSC/AMSC/MAPL 460. Eigenvalues and Eigenvectors. Ramani Duraiswami, Dept. of Computer Science
Computational Methods CMSC/AMSC/MAPL 460 Eigenvalues and Eigenvectors Ramani Duraiswami, Dept. of Computer Science Eigen Values of a Matrix Recap: A N N matrix A has an eigenvector x (non-zero) with corresponding
More informationIMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET
IMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET This is a (not quite comprehensive) list of definitions and theorems given in Math 1553. Pay particular attention to the ones in red. Study Tip For each
More informationPractical Linear Algebra: A Geometry Toolbox
Practical Linear Algebra: A Geometry Toolbox Third edition Chapter 12: Gauss for Linear Systems Gerald Farin & Dianne Hansford CRC Press, Taylor & Francis Group, An A K Peters Book www.farinhansford.com/books/pla
More informationAMS10 HW7 Solutions. All credit is given for effort. (-5 pts for any missing sections) Problem 1 (20 pts) Consider the following matrix 2 A =
AMS1 HW Solutions All credit is given for effort. (- pts for any missing sections) Problem 1 ( pts) Consider the following matrix 1 1 9 a. Calculate the eigenvalues of A. Eigenvalues are 1 1.1, 9.81,.1
More informationSolution Set 3, Fall '12
Solution Set 3, 86 Fall '2 Do Problem 5 from 32 [ 3 5 Solution (a) A = Only one elimination step is needed to produce the 2 6 echelon form The pivot is the in row, column, and the entry to eliminate is
More informationChapter 4. Solving Systems of Equations. Chapter 4
Solving Systems of Equations 3 Scenarios for Solutions There are three general situations we may find ourselves in when attempting to solve systems of equations: 1 The system could have one unique solution.
More informationIMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET
IMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET This is a (not quite comprehensive) list of definitions and theorems given in Math 1553. Pay particular attention to the ones in red. Study Tip For each
More informationHomework Set #8 Solutions
Exercises.2 (p. 19) Homework Set #8 Solutions Assignment: Do #6, 8, 12, 14, 2, 24, 26, 29, 0, 2, 4, 5, 6, 9, 40, 42 6. Reducing the matrix to echelon form: 1 5 2 1 R2 R2 R1 1 5 0 18 12 2 1 R R 2R1 1 5
More informationFinal Exam, Linear Algebra, Fall, 2003, W. Stephen Wilson
Final Exam, Linear Algebra, Fall, 2003, W. Stephen Wilson Name: TA Name and section: NO CALCULATORS, SHOW ALL WORK, NO OTHER PAPERS ON DESK. There is very little actual work to be done on this exam if
More informationMath 1553, Introduction to Linear Algebra
Learning goals articulate what students are expected to be able to do in a course that can be measured. This course has course-level learning goals that pertain to the entire course, and section-level
More informationft-uiowa-math2550 Assignment OptionalFinalExamReviewMultChoiceMEDIUMlengthForm due 12/31/2014 at 10:36pm CST
me me ft-uiowa-math255 Assignment OptionalFinalExamReviewMultChoiceMEDIUMlengthForm due 2/3/2 at :3pm CST. ( pt) Library/TCNJ/TCNJ LinearSystems/problem3.pg Give a geometric description of the following
More informationRecall : Eigenvalues and Eigenvectors
Recall : Eigenvalues and Eigenvectors Let A be an n n matrix. If a nonzero vector x in R n satisfies Ax λx for a scalar λ, then : The scalar λ is called an eigenvalue of A. The vector x is called an eigenvector
More information1. Let A = (a) 2 (b) 3 (c) 0 (d) 4 (e) 1
. Let A =. The rank of A is (a) (b) (c) (d) (e). Let P = {a +a t+a t } where {a,a,a } range over all real numbers, and let T : P P be a linear transformation dedifined by T (a + a t + a t )=a +9a t If
More information