Math 408 Advanced Linear Algebra
|
|
- Blake Wood
- 5 years ago
- Views:
Transcription
1 Math 408 Advanced Linear Algebra Chi-Kwong Li Chapter 4 Hermitian and symmetric matrices Basic properties Theorem Let A M n. The following are equivalent. Remark (a) A is Hermitian, i.e., A = A. (b) x Ax R for all x C n. (c) A is normal with real eigenvalues. (a) Let A M n. Then A = H + ig, where H = (A + A )/2 and G = (A A )/(2i) are Hermitian. Also, AA and A A are Hermitian. If A is Hermitian, then A k is Hermitian for positive integer k, and A 1 is Hermitian if A is invertible. (b) The set of Hermitian matrices form a real linear space. (c) The product of Hermitian matrices may not be Hermitian. (d) The product of two Hermitian matrices is Hermitian if and only if they commute. (e) A matrix A is the product of two Hermitian matrices if and only if A is similar to A (via a Hermitian matrix), equivalently, A is similar to a real matrix. Proof. (a) If A is Hermitian, then A = U DU for some real diagonal matrix D. So, A k = U D k U is Hermitian for positive integers k (or negative integers if A 1 exists). (b) Let H n be the set of n n Hermitian matrices. Then 0 H n, and ra + sb H n for any A, B H n and r, s R. (c) Consider A = E 12 + E 21 and B = E 11 E 22. (d) If A, B H n commute then A = U D 1 U and B = U D 2 U for some unitary U and real diagonal D 1, D 2. Thus, AB = U (D 1 D 2 )U is unitary. If A, B, AB H n, then AB = (AB) = B A = BA. (e) Suppose A = HK with H, K H n. If H = U DU for some unitary U and D = D 1 0 n k, ( ) where D 1 is an invertible real diagonal matrix in H k. Then U AU = DU D1 K KU = and U A U = ( K11 D ). Now, K 11 D 1 and DK 11 have the same Jordan blocks for the nonzero eigenvalues, and rank (A m ) = rank ((A ) m ) for all m. Thus, A and A have the same Jordan form and are similar. Suppose AS = SA with S = H+iG. Then S A = AS implies that A(H+iG) = (H+iG)A and (H ig)a = A(H ig). Hence, AH = HA and AG = GA. Hence AK = KA for some invertible K = H + tg. Thus, A = K(A K 1 ), where (A K 1 ) = K 1 A = A K 1. Suppose A and A are similar. Then they have the same Jordan blocks. Thus, the Jordan blocks J m (λ) and J m (λ) will occur together in A for any nonreal eigenvalue λ, and can be combined to a real Jordan block. Thus, A is similar to a direct sum of real Jordan blocks. 1
2 Suppose S 1 AS = R for a real matrix R. Then S 1 AS = R = T 1 R t T = T 1 R T = T 1 S A (S 1 ) T. Thus, A and A are similar. Eigenvalue inequalities Denote by λ 1 (A) λ n (A) the eigenvalues of a Hermitian matrix A M n. Theorem (Courant-Fischer-Weyl) Suppose A M n is Hermitian. Then for k {1,..., n}. λ k (A) = max dim W =k min v W,v v=1 v Av = min dim W =n k+1 min v W,v v=1 v Av. Proof. For simplicity, write λ j = λ j (A) for all j. Suppose {u 1,..., u n } is a set of orthonormal eigenvectors of A such that Au j = λ j u j. For any subspace of dimension W, say, spanned by w 1,..., w k, it contains a unit vector v in the span of {u k,..., u n }. Thus, v = n j=k µ ju j with n j=k µ j 2 = 1 such that v Av = µ j 2 λ j j=k µ j 2 λ k = λ k. Let W be the span of u 1,..., u k. For any v W, we have v = k γ jv j so that v Av = k γ j 2 λ j j=k γ j 2 λ k = λ k and the equality holds if v = u k. The first equality holds. The proof is complete. Corollary (Rayleigh principle) Let A M n be Hermitian. For any unit vector x C n, j=k λ 1 (A) v Av λ n (A). Corollary (Interlacing inequalities) Let A M n be Hermitian with eigenvalues a 1 a n and B M n 1 be a principal submatrix of A with eigenvalues b 1 b n 1. Then a 1 b 1 a 2 a n 1 b n 1 a n. Theorem (Fan-Pall) Suppose a 1,..., a n and b 1,..., b n 1 satisfy the interlacing inequalities. Then there is a Hermitian matrix A M n with a principal submatrix B M n 1 with a 1,..., a n and b 1,..., b n 1 as eigenvalues. Proof. By the discussion in class, We may assume that a 1 > b 1 > a 2 > a n 1 > b n 1 > b n. Let D = diag (a 1,..., a n ). We show that there is a unitary U such that if we delete the first row and first column of the matrix A = UDU, we get a matrix B H n 1 with eigenvalues b 1 b n. To see this, note that for t / {a 1,..., a n }, we have ti A = U(tI D)U is invertible with inverse (ti A) 1 = U(t D) 1 U. (1) 2
3 Recall that the (1, 1) entry of an invertible matrix C equals det(c(1, 1))/ det(c) using the adjoint matrix formula, where C(1, 1) is obtained from C by removing its first row and first column. So, the (1, 1) entry of (ti A) 1 equals det(ti B)/ det(ti A) as B is the matrix obtained from A by removing the first row and the first column. Now, consider the right side of (1). If the first row of U equals (x 1,..., x n ), then the (1, 1) entry of the matrix is f(t) = x 1 2 t a x n 2 t a n. Equating the two expressions for the (1, 1) entry of (ti A) 1 mentioned above, we have det(ti B) = x j 2 t a j det(ti A) = x j 2 a k ). k j(t Homework 1. (a) Show that for all i = 1,..., n, the value w i = n 1 (a i b j )/ j i (a i a j ) is positive. By our assumption that a 1 > b 1 > b n 1 > b n, we see that for j i, we have a i > b j if and only if a i > a j. Thus, the numerator and the denominators have the same number of negative terms. Thus, the quotient is positive. (b) If we choose x i = w i for all i = 1,..., n, show that x j 2 n 1 det(ti A) = (t b j ) t a j for all t = a 1,..., a n, and hence the two polynomials in t are identical. If we substitute a i on the left hand side, all the summands are zero except for the one involving x i 2, and by the definition of x i 2 the expression reduces to n 1 (a i b j ). Since both side are polynomials of degree n 1, we see that the two polynomail are identical. (c) Show that if we choose a unitary U with the first row x = (x 1,..., x n ) satisfying (b), then U AU has a principal submatrix with eigenvalues b 1 b n 1 as asserted. By part (a) and (b), and the previous discussion, such a choice of U will yield a submatrix B of A = UDU such that det(ti B) = n 1 (t b j). Thus, B has the desired eigenvalues. Definition Let c = (c 1,..., c n ) and d = (d 1,..., d n ) be real vectors. We say that c is majorized by d, denoted by c d if the sum of the k largest entries of c is not larger than that of d for k = {1,..., n 1}, and the sum of all entries of c is the same as that of d. Theorem Suppose a = (a 1,..., a n ) and d = (d 1,..., d n ) are real vectors. Then there is a Hermitian matrix in M n with eigenvalues a 1,..., a n and diagonal entries d 1,..., d n if and only if d a. 3
4 Homework 2. (a) Suppose n = 2. If (d 1, d 2 ) (a 1, a 2 ), show that there is a vector v R 2 such that v t Dv = d 1, where D = diag (a 1, a 2 ). Furthermore, if P is an orthogonal matrix with the first column equal to v, then P t DP has diagonal entries d 1, d 2. Note that a 2 d 1 a 1. Assume v t = (cos θ, sin θ). Then f(θ) = v t Dv = a 1 cos 2 θ + a 2 sin 2 θ. Now, f(0) = a 1 d 1 and f(π/2) = a 2 d 1. By continuity, there is θ [0, π/2] such that f(θ) = d 1. Let w t = ( sin θ, cos θ). Then P = [v w] is orthogonal, P t DP has (1, 1) entry d 1. By the trace condition, we see that the (2, 2) entry of P t DP is d 2 so that a 1 + a 2 = d 1 + d 2. (b) Suppose n 3. Suppose (d 1,..., d n ) (a 1,..., a n ), where a 1 a n and d 1 d n. Let k be the largest integer such that a k d 1. (b.1) If a 1 a n, show that k < n and a k d 1 > a k+1. Assume a 1 a n d 1 d n. Then a a n = d d n implies that a 1 = = a n = d 1 = = d n, which is a contradiction. (b.2) Show that d = (d 2,..., d n ) is majorized by ã = (a 1,..., a k 1, ã k+1, a k+2..., a n ) where ã k+1 = a k + a k+1 d 1. Consider the sum of the l largest entries of the second vector. Case 1. If l < k, then l a j l d j l d j+1, which is the sum of the l largest entries of the first vector. Case 2. If l k, then the sum of the l largest entries of ã is at least l+1 a j d 1 which is larger than or equal to l d j+1, which is the sum of the l largest entries of d, by the original assumption. (b.3) (Optional) Show by induction that one can construct a real symmetric matrix with eigenvalues a 1,..., a n and diagonal entries d 1,..., d n. We prove by induction on n. If n = 2, the result follows from (a). Suppose n > 2. Construct the vector d and ã in (b). There is unitary (real orthogonal) V M n 1 so that V DV has diagonal entries d 2,..., d n, where D = diag (ã k+1, a 1,..., a k 1, a k+2,..., a n ). Now, there is a unitary (real ( ) ( ) orthogonal) P M 2 such that P ak 0 d1 P =. Let Q = (P I a k+1 0 ã n 2 )([1] V ). k+1 Then Q diag (a k, a k+1, a 1,..., a k 1, a k+2,..., a n )Q has diagonal entries d 1,..., d n. Theorem (Lidskii) Let A, B M n be Hermitian with eigenvalues a 1 a n and b 1 b n, Suppose C = A + B has eigenvalues c 1 c n. Then for any 1 i 1 < < i m n, m b n j+1 s=1 m (c is a is ) s=1 m b j. s=1 Corollary (Weyl) Let A, B M n be Hermitian. Then for any j, k {1,..., n} with j + k 1 n, we have λ j (A) + λ k (B) λ j+k 1 (C). 4
5 Proof. Suppose A has eigenvalues a 1 a n and B has eigenvalues b 1 b n. We may replace (A, B) by (A a j I, B b k I) and assume that a j = 0 = b k. Let A = UD 1 U and B = V D 2 V be such that U, V M n are unitary, D 1 = diag (a 1,..., a n ) and D 2 = diag (b 1,..., b n ). Set A 1 = Udiag (a 1,..., a j 1, 0,..., 0)U and B 1 = V diag (b 1,..., b k 1, 0,..., 0)V. Note that A 1 +B 1 has rank at most j +k 2, i.e., A 1 +B 1 has at most j +k 2 nonzero eigenvalues. Thus, λ j+k 1 (A 1 + B 1 ) = 0 and λ j+k 1 (A + B) λ 1 (A + B A 1 B 1 ). Now, set X = A 1 + B 1, Y = A + B A 1 B 1, and Z = X + Y = A + B. By Lidskii Theorem, we have λ j+k 1 (Z) λ j+k 1 (X) λ 1 (Y ). Next, set X = A A 1, Y = B B 1, and Z = X + Y. By Lidskii Theorem again, λ 1 (Z) λ 1 (X) + λ 1 (Y ). Thus, λ 1 (A + B A 1 B 1 ) λ 1 (A A 1 ) + λ 1 (B B 1 ) = λ j (A) + λ k (B). Positive semi-definite matrices Definition A matrix A M n is positive definite (positive semi-definite) if x Ax is positive (nonnegative) for all nonzero x C n. Theorem Let A M n. The following are equivalent. (a) A is positive definite (semi-definite). (b) A is normal with positive (nonnegative) eigenvalues. (c) A = RR, where R M n with det(r) > 0 and can be chosen to be in triangular form or positive definite (R M n with det(r) 0 and can be positive demi-definite). (d) A is Hermitian with det(a k ) > 0 for k = 1,..., n, where A k is the leading k k principal submatrix. (There is a permutation matrix P such that P AP t = Ã 0 n m such that det(ãj) > 0 for j = 1,..., m.) Proof. The equivalence of (a) and (b) are shown in class. To prove (b) (c). Let A = UDU where U is unitary, and D = diag (a 1,..., a n ). Then for D = diag ( a 1,..., a n ), we have A = RR with R = U DU. Evidently, R is positive definite. Further, we can write R = LV for some unitary V and lower triangular L so that A = LL. To prove (c) (a). Note that for any nonzero x C n, y = R x is nonzero as R is invertible. Thus, x Ax = y y > 0. Thus, A is positive definite. To prove (c) (d) if we choose R to be lower triangular in condition (c). Then det(a k ) = det(r k R k ) = det(r k) det(r k ) = det(r k) 2 > 0. To prove (d) (c), by Gaussian elimination, we can choose L 1 by changing the first column of I n so that L 1 A has zero entries in the (i, 1) positions for i = 2,..., n. Since A is Hermitian and the first row of L 1 A is the same as A, we have L 1 AL 1 = [a 11 ] A 2 where a 11 is the (1, 1) entry of A. Now, change L 1 to L 1 = L 1 ( diag ( a11, 1,..., 1) ). Then L 1 A L 1 = [1] A 2. Now, use induction argumet on A 2, we see that A 2 = L 2 L 2 for some lower triangular matrix with positive 1 diagonal entries. Set R = L 1 ([1] L 2). Then A = RR. 5
6 Definition Let A M n. Then AA and A A has the same collection of nonnegative eigenvalues. The numbers s j (A) = λ j (AA ) is the jth singular value of A for j = 1,..., n. Theorem Let A M n. (a) (SVD decomposition) There is are unitary matrices such that U AV is a diagonal matrix with diagonal entries s 1 (A),..., s n (A). (b) (Polar decomposition) There are positive semi-definite matrices P, Q and unitary matrices Ṽ, Ũ such that A = P Ṽ = ŨQ. Theorem Let A M n. Then the matrix ( ) 0 A A has eigenvalues ±s 0 1 (A),..., ±s n (A). Remark We can deduce singular value inequalities using the above (Wielandt) matrix. Congruence Theorem Let A M n be Hermitian, and S M n be invertible. Then S AS and A have the same number of positive and negative eigenvalues. In particular, there is an invertible T M n such that T AT = I p I q 0 s. Theorem Let A, B M n be Hermitian. Then there is an invertible S M n such that both S AS and S BS are in diagonal form if any one of the following is true. (a) There are real numbers a, b such that aa + bb is positive definite. (b) The matrix A is invertible and A 1 B is similar to a real diagonal matrix. Symmetric matrices For real symmetric matrices, the theory of Hermitian matrices applies. For complex symmetric matrices, we have the following results. Theorem Let A M n. The following are equivalent. (a) A is symmetric. (b) There is a unitary U M n such that A = UDU t such that D has nonnegative entries arranged in descending order. (c) A = SS t for some S M n. Theorem Let A M n. Then A is normal and symmetric if and only if there is a real orthogonal matrix A such that QAQ t is a diagonal matrix. Theorem Every matrix A is similar to a symmetric matrix. Consequently, every matrix A is a product of two symmetric matrices. Theorem Let A M n be symmetric. Then A is diagonalizable if and only if there is a complex orthogonal matrix Q such that Q t AQ is in diagonal form. 6
Throughout these notes we assume V, W are finite dimensional inner product spaces over C.
Math 342 - Linear Algebra II Notes Throughout these notes we assume V, W are finite dimensional inner product spaces over C 1 Upper Triangular Representation Proposition: Let T L(V ) There exists an orthonormal
More informationMath 102, Winter Final Exam Review. Chapter 1. Matrices and Gaussian Elimination
Math 0, Winter 07 Final Exam Review Chapter. Matrices and Gaussian Elimination { x + x =,. Different forms of a system of linear equations. Example: The x + 4x = 4. [ ] [ ] [ ] vector form (or the column
More informationChapter 0 Preliminaries
Chapter 0 Preliminaries Objective of the course Introduce basic matrix results and techniques that are useful in theory and applications. It is important to know many results, but there is no way I can
More informationReview problems for MA 54, Fall 2004.
Review problems for MA 54, Fall 2004. Below are the review problems for the final. They are mostly homework problems, or very similar. If you are comfortable doing these problems, you should be fine on
More informationLecture notes on Quantum Computing. Chapter 1 Mathematical Background
Lecture notes on Quantum Computing Chapter 1 Mathematical Background Vector states of a quantum system with n physical states are represented by unique vectors in C n, the set of n 1 column vectors 1 For
More informationMATH 240 Spring, Chapter 1: Linear Equations and Matrices
MATH 240 Spring, 2006 Chapter Summaries for Kolman / Hill, Elementary Linear Algebra, 8th Ed. Sections 1.1 1.6, 2.1 2.2, 3.2 3.8, 4.3 4.5, 5.1 5.3, 5.5, 6.1 6.5, 7.1 7.2, 7.4 DEFINITIONS Chapter 1: Linear
More informationConceptual Questions for Review
Conceptual Questions for Review Chapter 1 1.1 Which vectors are linear combinations of v = (3, 1) and w = (4, 3)? 1.2 Compare the dot product of v = (3, 1) and w = (4, 3) to the product of their lengths.
More informationLinear Algebra Practice Problems
Linear Algebra Practice Problems Math 24 Calculus III Summer 25, Session II. Determine whether the given set is a vector space. If not, give at least one axiom that is not satisfied. Unless otherwise stated,
More informationMATH 423 Linear Algebra II Lecture 33: Diagonalization of normal operators.
MATH 423 Linear Algebra II Lecture 33: Diagonalization of normal operators. Adjoint operator and adjoint matrix Given a linear operator L on an inner product space V, the adjoint of L is a transformation
More informationI. Multiple Choice Questions (Answer any eight)
Name of the student : Roll No : CS65: Linear Algebra and Random Processes Exam - Course Instructor : Prashanth L.A. Date : Sep-24, 27 Duration : 5 minutes INSTRUCTIONS: The test will be evaluated ONLY
More informationProblem Set (T) If A is an m n matrix, B is an n p matrix and D is a p s matrix, then show
MTH 0: Linear Algebra Department of Mathematics and Statistics Indian Institute of Technology - Kanpur Problem Set Problems marked (T) are for discussions in Tutorial sessions (T) If A is an m n matrix,
More information18.06 Problem Set 8 - Solutions Due Wednesday, 14 November 2007 at 4 pm in
806 Problem Set 8 - Solutions Due Wednesday, 4 November 2007 at 4 pm in 2-06 08 03 Problem : 205+5+5+5 Consider the matrix A 02 07 a Check that A is a positive Markov matrix, and find its steady state
More informationChapter 7: Symmetric Matrices and Quadratic Forms
Chapter 7: Symmetric Matrices and Quadratic Forms (Last Updated: December, 06) These notes are derived primarily from Linear Algebra and its applications by David Lay (4ed). A few theorems have been moved
More informationThe Singular Value Decomposition and Least Squares Problems
The Singular Value Decomposition and Least Squares Problems Tom Lyche Centre of Mathematics for Applications, Department of Informatics, University of Oslo September 27, 2009 Applications of SVD solving
More informationUNIT 6: The singular value decomposition.
UNIT 6: The singular value decomposition. María Barbero Liñán Universidad Carlos III de Madrid Bachelor in Statistics and Business Mathematical methods II 2011-2012 A square matrix is symmetric if A T
More informationMath 108b: Notes on the Spectral Theorem
Math 108b: Notes on the Spectral Theorem From section 6.3, we know that every linear operator T on a finite dimensional inner product space V has an adjoint. (T is defined as the unique linear operator
More informationOHSx XM511 Linear Algebra: Solutions to Online True/False Exercises
This document gives the solutions to all of the online exercises for OHSx XM511. The section ( ) numbers refer to the textbook. TYPE I are True/False. Answers are in square brackets [. Lecture 02 ( 1.1)
More informationMath Homework 8 (selected problems)
Math 102 - Homework 8 (selected problems) David Lipshutz Problem 1. (Strang, 5.5: #14) In the list below, which classes of matrices contain A and which contain B? 1 1 1 1 A 0 0 1 0 0 0 0 1 and B 1 1 1
More informationLecture Summaries for Linear Algebra M51A
These lecture summaries may also be viewed online by clicking the L icon at the top right of any lecture screen. Lecture Summaries for Linear Algebra M51A refers to the section in the textbook. Lecture
More information1 Last time: least-squares problems
MATH Linear algebra (Fall 07) Lecture Last time: least-squares problems Definition. If A is an m n matrix and b R m, then a least-squares solution to the linear system Ax = b is a vector x R n such that
More informationMath Linear Algebra Final Exam Review Sheet
Math 15-1 Linear Algebra Final Exam Review Sheet Vector Operations Vector addition is a component-wise operation. Two vectors v and w may be added together as long as they contain the same number n of
More information(a) If A is a 3 by 4 matrix, what does this tell us about its nullspace? Solution: dim N(A) 1, since rank(a) 3. Ax =
. (5 points) (a) If A is a 3 by 4 matrix, what does this tell us about its nullspace? dim N(A), since rank(a) 3. (b) If we also know that Ax = has no solution, what do we know about the rank of A? C(A)
More information1. General Vector Spaces
1.1. Vector space axioms. 1. General Vector Spaces Definition 1.1. Let V be a nonempty set of objects on which the operations of addition and scalar multiplication are defined. By addition we mean a rule
More informationSpectral inequalities and equalities involving products of matrices
Spectral inequalities and equalities involving products of matrices Chi-Kwong Li 1 Department of Mathematics, College of William & Mary, Williamsburg, Virginia 23187 (ckli@math.wm.edu) Yiu-Tung Poon Department
More informationLinear Algebra Lecture Notes-II
Linear Algebra Lecture Notes-II Vikas Bist Department of Mathematics Panjab University, Chandigarh-64 email: bistvikas@gmail.com Last revised on March 5, 8 This text is based on the lectures delivered
More informationMath 315: Linear Algebra Solutions to Assignment 7
Math 5: Linear Algebra s to Assignment 7 # Find the eigenvalues of the following matrices. (a.) 4 0 0 0 (b.) 0 0 9 5 4. (a.) The characteristic polynomial det(λi A) = (λ )(λ )(λ ), so the eigenvalues are
More informationMatrix Theory, Math6304 Lecture Notes from October 25, 2012
Matrix Theory, Math6304 Lecture Notes from October 25, 2012 taken by John Haas Last Time (10/23/12) Example of Low Rank Perturbation Relationship Between Eigenvalues and Principal Submatrices: We started
More informationA = 3 1. We conclude that the algebraic multiplicity of the eigenvalues are both one, that is,
65 Diagonalizable Matrices It is useful to introduce few more concepts, that are common in the literature Definition 65 The characteristic polynomial of an n n matrix A is the function p(λ) det(a λi) Example
More informationAlgebra C Numerical Linear Algebra Sample Exam Problems
Algebra C Numerical Linear Algebra Sample Exam Problems Notation. Denote by V a finite-dimensional Hilbert space with inner product (, ) and corresponding norm. The abbreviation SPD is used for symmetric
More informationDIAGONALIZATION. In order to see the implications of this definition, let us consider the following example Example 1. Consider the matrix
DIAGONALIZATION Definition We say that a matrix A of size n n is diagonalizable if there is a basis of R n consisting of eigenvectors of A ie if there are n linearly independent vectors v v n such that
More information1 Linear Algebra Problems
Linear Algebra Problems. Let A be the conjugate transpose of the complex matrix A; i.e., A = A t : A is said to be Hermitian if A = A; real symmetric if A is real and A t = A; skew-hermitian if A = A and
More informationBASIC ALGORITHMS IN LINEAR ALGEBRA. Matrices and Applications of Gaussian Elimination. A 2 x. A T m x. A 1 x A T 1. A m x
BASIC ALGORITHMS IN LINEAR ALGEBRA STEVEN DALE CUTKOSKY Matrices and Applications of Gaussian Elimination Systems of Equations Suppose that A is an n n matrix with coefficents in a field F, and x = (x,,
More informationb jσ(j), Keywords: Decomposable numerical range, principal character AMS Subject Classification: 15A60
On the Hu-Hurley-Tam Conjecture Concerning The Generalized Numerical Range Che-Man Cheng Faculty of Science and Technology, University of Macau, Macau. E-mail: fstcmc@umac.mo and Chi-Kwong Li Department
More informationSingular Value Decomposition (SVD) and Polar Form
Chapter 2 Singular Value Decomposition (SVD) and Polar Form 2.1 Polar Form In this chapter, we assume that we are dealing with a real Euclidean space E. Let f: E E be any linear map. In general, it may
More informationFinal Exam, Linear Algebra, Fall, 2003, W. Stephen Wilson
Final Exam, Linear Algebra, Fall, 2003, W. Stephen Wilson Name: TA Name and section: NO CALCULATORS, SHOW ALL WORK, NO OTHER PAPERS ON DESK. There is very little actual work to be done on this exam if
More informationEigenvalues and Eigenvectors A =
Eigenvalues and Eigenvectors Definition 0 Let A R n n be an n n real matrix A number λ R is a real eigenvalue of A if there exists a nonzero vector v R n such that A v = λ v The vector v is called an eigenvector
More informationLinear algebra and applications to graphs Part 1
Linear algebra and applications to graphs Part 1 Written up by Mikhail Belkin and Moon Duchin Instructor: Laszlo Babai June 17, 2001 1 Basic Linear Algebra Exercise 1.1 Let V and W be linear subspaces
More informationMATH 511 ADVANCED LINEAR ALGEBRA SPRING 2006
MATH 511 ADVANCED LINEAR ALGEBRA SPRING 2006 Sherod Eubanks HOMEWORK 2 2.1 : 2, 5, 9, 12 2.3 : 3, 6 2.4 : 2, 4, 5, 9, 11 Section 2.1: Unitary Matrices Problem 2 If λ σ(u) and U M n is unitary, show that
More informationNumerical Linear Algebra Homework Assignment - Week 2
Numerical Linear Algebra Homework Assignment - Week 2 Đoàn Trần Nguyên Tùng Student ID: 1411352 8th October 2016 Exercise 2.1: Show that if a matrix A is both triangular and unitary, then it is diagonal.
More informationDiagonalizing Matrices
Diagonalizing Matrices Massoud Malek A A Let A = A k be an n n non-singular matrix and let B = A = [B, B,, B k,, B n ] Then A n A B = A A 0 0 A k [B, B,, B k,, B n ] = 0 0 = I n 0 A n Notice that A i B
More informationMath 102 Final Exam - Dec 14 - PCYNH pm Fall Name Student No. Section A0
Math 12 Final Exam - Dec 14 - PCYNH 122-6pm Fall 212 Name Student No. Section A No aids allowed. Answer all questions on test paper. Total Marks: 4 8 questions (plus a 9th bonus question), 5 points per
More informationALGEBRA QUALIFYING EXAM PROBLEMS LINEAR ALGEBRA
ALGEBRA QUALIFYING EXAM PROBLEMS LINEAR ALGEBRA Kent State University Department of Mathematical Sciences Compiled and Maintained by Donald L. White Version: August 29, 2017 CONTENTS LINEAR ALGEBRA AND
More informationLinear Algebra. Workbook
Linear Algebra Workbook Paul Yiu Department of Mathematics Florida Atlantic University Last Update: November 21 Student: Fall 2011 Checklist Name: A B C D E F F G H I J 1 2 3 4 5 6 7 8 9 10 xxx xxx xxx
More informationOnline Exercises for Linear Algebra XM511
This document lists the online exercises for XM511. The section ( ) numbers refer to the textbook. TYPE I are True/False. Lecture 02 ( 1.1) Online Exercises for Linear Algebra XM511 1) The matrix [3 2
More informationThe Singular Value Decomposition
The Singular Value Decomposition Philippe B. Laval KSU Fall 2015 Philippe B. Laval (KSU) SVD Fall 2015 1 / 13 Review of Key Concepts We review some key definitions and results about matrices that will
More information18.06SC Final Exam Solutions
18.06SC Final Exam Solutions 1 (4+7=11 pts.) Suppose A is 3 by 4, and Ax = 0 has exactly 2 special solutions: 1 2 x 1 = 1 and x 2 = 1 1 0 0 1 (a) Remembering that A is 3 by 4, find its row reduced echelon
More informationElementary linear algebra
Chapter 1 Elementary linear algebra 1.1 Vector spaces Vector spaces owe their importance to the fact that so many models arising in the solutions of specific problems turn out to be vector spaces. The
More informationTherefore, A and B have the same characteristic polynomial and hence, the same eigenvalues.
Similar Matrices and Diagonalization Page 1 Theorem If A and B are n n matrices, which are similar, then they have the same characteristic equation and hence the same eigenvalues. Proof Let A and B be
More informationMATH 304 Linear Algebra Lecture 23: Diagonalization. Review for Test 2.
MATH 304 Linear Algebra Lecture 23: Diagonalization. Review for Test 2. Diagonalization Let L be a linear operator on a finite-dimensional vector space V. Then the following conditions are equivalent:
More informationHOMEWORK PROBLEMS FROM STRANG S LINEAR ALGEBRA AND ITS APPLICATIONS (4TH EDITION)
HOMEWORK PROBLEMS FROM STRANG S LINEAR ALGEBRA AND ITS APPLICATIONS (4TH EDITION) PROFESSOR STEVEN MILLER: BROWN UNIVERSITY: SPRING 2007 1. CHAPTER 1: MATRICES AND GAUSSIAN ELIMINATION Page 9, # 3: Describe
More informationCompound matrices and some classical inequalities
Compound matrices and some classical inequalities Tin-Yau Tam Mathematics & Statistics Auburn University Dec. 3, 04 We discuss some elegant proofs of several classical inequalities of matrices by using
More informationUniversity of Colorado at Denver Mathematics Department Applied Linear Algebra Preliminary Exam With Solutions 16 January 2009, 10:00 am 2:00 pm
University of Colorado at Denver Mathematics Department Applied Linear Algebra Preliminary Exam With Solutions 16 January 2009, 10:00 am 2:00 pm Name: The proctor will let you read the following conditions
More informationDiagonalization by a unitary similarity transformation
Physics 116A Winter 2011 Diagonalization by a unitary similarity transformation In these notes, we will always assume that the vector space V is a complex n-dimensional space 1 Introduction A semi-simple
More informationFoundations of Matrix Analysis
1 Foundations of Matrix Analysis In this chapter we recall the basic elements of linear algebra which will be employed in the remainder of the text For most of the proofs as well as for the details, the
More informationANSWERS. E k E 2 E 1 A = B
MATH 7- Final Exam Spring ANSWERS Essay Questions points Define an Elementary Matrix Display the fundamental matrix multiply equation which summarizes a sequence of swap, combination and multiply operations,
More informationChapter 6: Orthogonality
Chapter 6: Orthogonality (Last Updated: November 7, 7) These notes are derived primarily from Linear Algebra and its applications by David Lay (4ed). A few theorems have been moved around.. Inner products
More informationMATH 20F: LINEAR ALGEBRA LECTURE B00 (T. KEMP)
MATH 20F: LINEAR ALGEBRA LECTURE B00 (T KEMP) Definition 01 If T (x) = Ax is a linear transformation from R n to R m then Nul (T ) = {x R n : T (x) = 0} = Nul (A) Ran (T ) = {Ax R m : x R n } = {b R m
More informationLinear Algebra review Powers of a diagonalizable matrix Spectral decomposition
Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Prof. Tesler Math 283 Fall 2016 Also see the separate version of this with Matlab and R commands. Prof. Tesler Diagonalizing
More informationAMS526: Numerical Analysis I (Numerical Linear Algebra)
AMS526: Numerical Analysis I (Numerical Linear Algebra) Lecture 16: Eigenvalue Problems; Similarity Transformations Xiangmin Jiao Stony Brook University Xiangmin Jiao Numerical Analysis I 1 / 18 Eigenvalue
More informationMATH 235. Final ANSWERS May 5, 2015
MATH 235 Final ANSWERS May 5, 25. ( points) Fix positive integers m, n and consider the vector space V of all m n matrices with entries in the real numbers R. (a) Find the dimension of V and prove your
More informationPreliminary/Qualifying Exam in Numerical Analysis (Math 502a) Spring 2012
Instructions Preliminary/Qualifying Exam in Numerical Analysis (Math 502a) Spring 2012 The exam consists of four problems, each having multiple parts. You should attempt to solve all four problems. 1.
More informationCANONICAL FORMS, HIGHER RANK NUMERICAL RANGES, TOTALLY ISOTROPIC SUBSPACES, AND MATRIX EQUATIONS
CANONICAL FORMS, HIGHER RANK NUMERICAL RANGES, TOTALLY ISOTROPIC SUBSPACES, AND MATRIX EQUATIONS CHI-KWONG LI AND NUNG-SING SZE Abstract. Results on matrix canonical forms are used to give a complete description
More informationComputational Methods CMSC/AMSC/MAPL 460. Eigenvalues and Eigenvectors. Ramani Duraiswami, Dept. of Computer Science
Computational Methods CMSC/AMSC/MAPL 460 Eigenvalues and Eigenvectors Ramani Duraiswami, Dept. of Computer Science Eigen Values of a Matrix Recap: A N N matrix A has an eigenvector x (non-zero) with corresponding
More informationSpectral Theorem for Self-adjoint Linear Operators
Notes for the undergraduate lecture by David Adams. (These are the notes I would write if I was teaching a course on this topic. I have included more material than I will cover in the 45 minute lecture;
More informationMATH 304 Linear Algebra Lecture 34: Review for Test 2.
MATH 304 Linear Algebra Lecture 34: Review for Test 2. Topics for Test 2 Linear transformations (Leon 4.1 4.3) Matrix transformations Matrix of a linear mapping Similar matrices Orthogonality (Leon 5.1
More informationEigenvalues and Eigenvectors
/88 Chia-Ping Chen Department of Computer Science and Engineering National Sun Yat-sen University Linear Algebra Eigenvalue Problem /88 Eigenvalue Equation By definition, the eigenvalue equation for matrix
More information1. What is the determinant of the following matrix? a 1 a 2 4a 3 2a 2 b 1 b 2 4b 3 2b c 1. = 4, then det
What is the determinant of the following matrix? 3 4 3 4 3 4 4 3 A 0 B 8 C 55 D 0 E 60 If det a a a 3 b b b 3 c c c 3 = 4, then det a a 4a 3 a b b 4b 3 b c c c 3 c = A 8 B 6 C 4 D E 3 Let A be an n n matrix
More informationLecture 8: Linear Algebra Background
CSE 521: Design and Analysis of Algorithms I Winter 2017 Lecture 8: Linear Algebra Background Lecturer: Shayan Oveis Gharan 2/1/2017 Scribe: Swati Padmanabhan Disclaimer: These notes have not been subjected
More informationArchive of past papers, solutions and homeworks for. MATH 224, Linear Algebra 2, Spring 2013, Laurence Barker
Archive of past papers, solutions and homeworks for MATH 224, Linear Algebra 2, Spring 213, Laurence Barker version: 4 June 213 Source file: archfall99.tex page 2: Homeworks. page 3: Quizzes. page 4: Midterm
More informationEquality: Two matrices A and B are equal, i.e., A = B if A and B have the same order and the entries of A and B are the same.
Introduction Matrix Operations Matrix: An m n matrix A is an m-by-n array of scalars from a field (for example real numbers) of the form a a a n a a a n A a m a m a mn The order (or size) of A is m n (read
More informationEigenvalues and Eigenvectors
Eigenvalues and Eigenvectors Definition 0 Let A R n n be an n n real matrix A number λ R is a real eigenvalue of A if there exists a nonzero vector v R n such that A v = λ v The vector v is called an eigenvector
More informationlinearly indepedent eigenvectors as the multiplicity of the root, but in general there may be no more than one. For further discussion, assume matrice
3. Eigenvalues and Eigenvectors, Spectral Representation 3.. Eigenvalues and Eigenvectors A vector ' is eigenvector of a matrix K, if K' is parallel to ' and ' 6, i.e., K' k' k is the eigenvalue. If is
More informationMATH 320: PRACTICE PROBLEMS FOR THE FINAL AND SOLUTIONS
MATH 320: PRACTICE PROBLEMS FOR THE FINAL AND SOLUTIONS There will be eight problems on the final. The following are sample problems. Problem 1. Let F be the vector space of all real valued functions on
More informationThe Singular Value Decomposition (SVD) and Principal Component Analysis (PCA)
Chapter 5 The Singular Value Decomposition (SVD) and Principal Component Analysis (PCA) 5.1 Basics of SVD 5.1.1 Review of Key Concepts We review some key definitions and results about matrices that will
More informationMTH 5102 Linear Algebra Practice Final Exam April 26, 2016
Name (Last name, First name): MTH 5 Linear Algebra Practice Final Exam April 6, 6 Exam Instructions: You have hours to complete the exam. There are a total of 9 problems. You must show your work and write
More information1. Select the unique answer (choice) for each problem. Write only the answer.
MATH 5 Practice Problem Set Spring 7. Select the unique answer (choice) for each problem. Write only the answer. () Determine all the values of a for which the system has infinitely many solutions: x +
More informationMath 18, Linear Algebra, Lecture C00, Spring 2017 Review and Practice Problems for Final Exam
Math 8, Linear Algebra, Lecture C, Spring 7 Review and Practice Problems for Final Exam. The augmentedmatrix of a linear system has been transformed by row operations into 5 4 8. Determine if the system
More informationQuantum Computing Lecture 2. Review of Linear Algebra
Quantum Computing Lecture 2 Review of Linear Algebra Maris Ozols Linear algebra States of a quantum system form a vector space and their transformations are described by linear operators Vector spaces
More informationEigenvalues and Eigenvectors
Chapter 1 Eigenvalues and Eigenvectors Among problems in numerical linear algebra, the determination of the eigenvalues and eigenvectors of matrices is second in importance only to the solution of linear
More informationMIT Final Exam Solutions, Spring 2017
MIT 8.6 Final Exam Solutions, Spring 7 Problem : For some real matrix A, the following vectors form a basis for its column space and null space: C(A) = span,, N(A) = span,,. (a) What is the size m n of
More informationSymmetric and anti symmetric matrices
Symmetric and anti symmetric matrices In linear algebra, a symmetric matrix is a square matrix that is equal to its transpose. Formally, matrix A is symmetric if. A = A Because equal matrices have equal
More informationLecture notes: Applied linear algebra Part 1. Version 2
Lecture notes: Applied linear algebra Part 1. Version 2 Michael Karow Berlin University of Technology karow@math.tu-berlin.de October 2, 2008 1 Notation, basic notions and facts 1.1 Subspaces, range and
More informationELEMENTARY LINEAR ALGEBRA WITH APPLICATIONS. 1. Linear Equations and Matrices
ELEMENTARY LINEAR ALGEBRA WITH APPLICATIONS KOLMAN & HILL NOTES BY OTTO MUTZBAUER 11 Systems of Linear Equations 1 Linear Equations and Matrices Numbers in our context are either real numbers or complex
More informationConvexity of the Joint Numerical Range
Convexity of the Joint Numerical Range Chi-Kwong Li and Yiu-Tung Poon October 26, 2004 Dedicated to Professor Yik-Hoi Au-Yeung on the occasion of his retirement. Abstract Let A = (A 1,..., A m ) be an
More informationLecture notes: Applied linear algebra Part 2. Version 1
Lecture notes: Applied linear algebra Part 2. Version 1 Michael Karow Berlin University of Technology karow@math.tu-berlin.de October 2, 2008 First, some exercises: xercise 0.1 (2 Points) Another least
More informationSingular Value Decomposition
Singular Value Decomposition Motivatation The diagonalization theorem play a part in many interesting applications. Unfortunately not all matrices can be factored as A = PDP However a factorization A =
More informationNotes on basis changes and matrix diagonalization
Notes on basis changes and matrix diagonalization Howard E Haber Santa Cruz Institute for Particle Physics, University of California, Santa Cruz, CA 95064 April 17, 2017 1 Coordinates of vectors and matrix
More informationCS 246 Review of Linear Algebra 01/17/19
1 Linear algebra In this section we will discuss vectors and matrices. We denote the (i, j)th entry of a matrix A as A ij, and the ith entry of a vector as v i. 1.1 Vectors and vector operations A vector
More informationApplied Linear Algebra in Geoscience Using MATLAB
Applied Linear Algebra in Geoscience Using MATLAB Contents Getting Started Creating Arrays Mathematical Operations with Arrays Using Script Files and Managing Data Two-Dimensional Plots Programming in
More informationProblem # Max points possible Actual score Total 120
FINAL EXAMINATION - MATH 2121, FALL 2017. Name: ID#: Email: Lecture & Tutorial: Problem # Max points possible Actual score 1 15 2 15 3 10 4 15 5 15 6 15 7 10 8 10 9 15 Total 120 You have 180 minutes to
More information33AH, WINTER 2018: STUDY GUIDE FOR FINAL EXAM
33AH, WINTER 2018: STUDY GUIDE FOR FINAL EXAM (UPDATED MARCH 17, 2018) The final exam will be cumulative, with a bit more weight on more recent material. This outline covers the what we ve done since the
More informationLinear Algebra: Matrix Eigenvalue Problems
CHAPTER8 Linear Algebra: Matrix Eigenvalue Problems Chapter 8 p1 A matrix eigenvalue problem considers the vector equation (1) Ax = λx. 8.0 Linear Algebra: Matrix Eigenvalue Problems Here A is a given
More informationand let s calculate the image of some vectors under the transformation T.
Chapter 5 Eigenvalues and Eigenvectors 5. Eigenvalues and Eigenvectors Let T : R n R n be a linear transformation. Then T can be represented by a matrix (the standard matrix), and we can write T ( v) =
More informationLinear Algebra Review. Vectors
Linear Algebra Review 9/4/7 Linear Algebra Review By Tim K. Marks UCSD Borrows heavily from: Jana Kosecka http://cs.gmu.edu/~kosecka/cs682.html Virginia de Sa (UCSD) Cogsci 8F Linear Algebra review Vectors
More informationNumerical Methods I Eigenvalue Problems
Numerical Methods I Eigenvalue Problems Aleksandar Donev Courant Institute, NYU 1 donev@courant.nyu.edu 1 MATH-GA 2011.003 / CSCI-GA 2945.003, Fall 2014 October 2nd, 2014 A. Donev (Courant Institute) Lecture
More informationQuestion: Given an n x n matrix A, how do we find its eigenvalues? Idea: Suppose c is an eigenvalue of A, then what is the determinant of A-cI?
Section 5. The Characteristic Polynomial Question: Given an n x n matrix A, how do we find its eigenvalues? Idea: Suppose c is an eigenvalue of A, then what is the determinant of A-cI? Property The eigenvalues
More informationEXERCISES ON DETERMINANTS, EIGENVALUES AND EIGENVECTORS. 1. Determinants
EXERCISES ON DETERMINANTS, EIGENVALUES AND EIGENVECTORS. Determinants Ex... Let A = 0 4 4 2 0 and B = 0 3 0. (a) Compute 0 0 0 0 A. (b) Compute det(2a 2 B), det(4a + B), det(2(a 3 B 2 )). 0 t Ex..2. For
More information7. Symmetric Matrices and Quadratic Forms
Linear Algebra 7. Symmetric Matrices and Quadratic Forms CSIE NCU 1 7. Symmetric Matrices and Quadratic Forms 7.1 Diagonalization of symmetric matrices 2 7.2 Quadratic forms.. 9 7.4 The singular value
More informationMATH 221, Spring Homework 10 Solutions
MATH 22, Spring 28 - Homework Solutions Due Tuesday, May Section 52 Page 279, Problem 2: 4 λ A λi = and the characteristic polynomial is det(a λi) = ( 4 λ)( λ) ( )(6) = λ 6 λ 2 +λ+2 The solutions to the
More informationLINEAR ALGEBRA 1, 2012-I PARTIAL EXAM 3 SOLUTIONS TO PRACTICE PROBLEMS
LINEAR ALGEBRA, -I PARTIAL EXAM SOLUTIONS TO PRACTICE PROBLEMS Problem (a) For each of the two matrices below, (i) determine whether it is diagonalizable, (ii) determine whether it is orthogonally diagonalizable,
More information