PROOF OF TWO MATRIX THEOREMS VIA TRIANGULAR FACTORIZATIONS ROY MATHIAS
|
|
- Lawrence Atkinson
- 5 years ago
- Views:
Transcription
1 PROOF OF TWO MATRIX THEOREMS VIA TRIANGULAR FACTORIZATIONS ROY MATHIAS Abstract. We present elementary proofs of the Cauchy-Binet Theorem on determinants and of the fact that the eigenvalues of a matrix are continuous functions of its entries by rst reducing these problems to triangular matrices. Key words. Eigenvalue Continuity, Cauchy-Binet Theorem, Determinant AMS(MOS) subject classications. 15A15, 15A18 In this paper we present elementary proofs of the Cauchy-Binet Theorem on determinants and of the fact that the eigenvalues of a matrix are continuous functions of its entries. Both these results are useful, but are not usually proved in the textbooks nor in many of the references in which they are used. Let M n denote the space of n n complex matrices. Given A 2 M n let i (A); i = 1; : : : ; n denote its eigenvalues, and let (A) = f 1 (A); ; n (A)g denote the collection of the eigenvalues of A counting multiplicity. We will measure the distance between the eigenvalues of A; B 2 M n by the matching distance (1) d M ((A); (B)) min max i=1; : : : ; n j i(a)? (i) (B)j where the minimum is taken over all permutations on f1; : : : ; ng. This measure is not, in general, easy to compute since by Hall's Marriage Theorem for any t 0, (2) d M ((A); (B)) t if and only if for each k = 1; : : : ; n and each subset f1; : : : ; ng of cardinality k there is a subset f1; : : : ; ng such that (3) max i2 minj i (A)? j (B)j t: j2 (See for example [1, Chapter 1] for an exposition of the application of Hall's Theorem to the matching distance and a discussion of other measures of the distance between eigenvalues.) However, if we take t 0 such that (4) t < 1 2 minfj i(a)? j (A)j : i (A) 6= j (A)g (taking the minimum to be +1 if the eigenvalues of A are all identical) then, because no point can be within a distance t of two distinct eigenvalues of A, one can easily show Institute for Mathematics and its Applications, 514 Vincent Hall, 206 Church St. SE, University of Minnesota, Minneapolis, MN On leave from Department of Mathematics, College of William & Mary, Williamsburg, VA na.mathias@na-net.ornl.gov.
2 2 roy mathias that (2) holds if and only if for each eigenvalue i (A) of multiplicity k there are at least k eigenvalues of B in D t ( i (A)) fz 2 C : jz? i (A)j tg: When we say that the eigenvalues of a matrix are a continuous function of its entries we mean that given any A = [a ij ] n i;j=1 2 M n and > 0 there exists such that whenever B = [b ij ] n i;j=1 2 M n is such that ja ij? b ij j ; i; j = 1; : : : ; n then (5) d M ((A); (B)) : This is equivalent to saying that if A k! A then for each k there is a permutation k such that lim k!1 k (i)(a k ) = i (A); or in words, that if the eigenvalues of A k are suitably ordered then they converge to those of A. Theorem 1. The eigenvalues of A 2 M n are a continuous function of its entries. The usual proof of the continuity of the eigenvalues of a matrix uses the fact that the eigenvalues of the matrix are the roots of characteristic polynomial and the fact the roots of a polynomial are continuous functions of the coecients [6, Appendix K]. The proof of the latter depends on Rouche's Theorem, which one may want to avoid in a course in Linear Algebra. Our proof is based on a compactness argument and Schur's Triangularization Theorem [3, Theorem 2.3.1]: Theorem 2 (Schur). Let A 2 M n have eigenvalues 1 ; : : : ; n, given in any order. Then, there is a unitary U 2 M n such that T U AU is upper triangular and t ii = i. Proof. (of Theorem 1) The proof is by contradiction. Take t = 1 2 minfj i? j j : i 6= j ; and i ; j are eigenvalues of Ag: That is, t is half the minimum distance between distinct eigenvalues of A. Suppose that A k! A and that the eigenvalues of A k do not converge to those of A. Then there must be an > 0, an eigenvalue of A of multiplicity m and a subsequence A ij such that the number of eigenvalues of A ij in D () = fjz? j g is less than m for j = 1; 2; : : :. We may assume with loss of generality that the subsequence fa ij g is actually fa j g, the sequence itself, and that < t. By Theorem 2 there are unitary matrices U j such that T j U j A j U j is upper triangular and its rst n? m + 1 diagonal entries lie outsided (). By the compactness
3 proofs via matrix factorizations 3 of the set of unitary matrices there is a convergent subsequence fu ij g that converges to a unitary U. Then U AU = lim j!1 U i j A ij U ij = lim j!1 T ij : Therefore, U AU is upper triangular and its n? m + 1 leading diagonal entries, which are n?m+1 of the eigenvalues of A, lie outside D (). This contradicts the assumption that is an eigenvalue of A of multiplicity m. 2 This approach to the proof of Theorem 1 has also been noted in [2, Problem 7.1.6]. The fact that the eigenvalues of a matrix are continuous functions of its entries is very useful in numerical linear algebra. It is used in the proof of Gershgorin's Theorem, stated below, which gives a quantitative version of the continuity of the eigenvalues of a matrix. Theorem 3 (Gershgorin). Let A = [a ij ] 2 M n. The eigenvalues of A lie in the union of the discs D i fz : jz? a ii j X j6=i ja ij jg: Furthermore, if the union of any k of these discs is disjoint form the remaining n? k then there are precisely k eigenvalues of A in the uniion of these k discs. The second part of the theorem is what makes it useful. For example, from the rst apart alone one can only conclude that the eigenvalues of lie in 1 0! ; < 1=2 fjz? 1j g [ fjzj < g and not that there is one eigenvalue near 0 and one near 1. The continuity of the eigenvalues is essential in existing proofs of the second part of Gershgorin's Theorem (see e.g., [3, Theorem 6.1.1]). The rst part, which is used mainly as a criterion for nonsingularity or to provide a bound on the spectral radius can be proved by considering the ith component of the equation (A? I)x = 0, where x i is the largest entry of x in absolute value. It was necessary to use the Schur Decomposition of the A i rather that the Jordan Decomposition: S i A i S?1 i = J i where J i is a Jordan canonical form of A i. The reason is that the set of invertible matrices is not compact so we cannot be sure that fs i g has a convergent subsequence, and even if it does we cannot be sure that the limit is invertible. The Schur decomposition can also be used to prove the Cayley-Hamilton Theorem (for complex matrices) [3, Theorem 2.4.2], the Spectral Radius Theorem [3, Corollary ], and some results relating the eigenvalues and singular values of a matrix [5].
4 4 roy mathias Now we will prove the Cauchy-Binet Theorem. First we must introduce some notation. Given integers k; n with 1 k n we let the n kc subsets of f1; : : : ; ng be ordered in some xed order. Henceforth, when we use the term \subset" we will mean a subset of f1; : : : ; ng of cardinality k. Let A denote the collection of these subsets, and let A 2 M n. Given ; 2 A we dene A(; ) to be the k k submatrix of A lying in rows corresponding to the indices in and the columns corresponding to the indices in. We dene the kth compound of A to be the n kc n k C matrix with entries indexed by the elements of A given by C k (A) ; = det A(; ); ; 2 A: Notice that C n (A) = det(a), and that C n?1 (A) = adj(a) T, the transpose of the classical adjoint of A if the subsets are ordered f2; : : : ; ng; f1; 3; : : : ; ng; : : : ; f1; : : : ; n? 1g. The basic result on compounds is Theorem 4 (Cauchy-Binet). Let A; B 2 M n and let k be an integer between 1 and n. Then (6) C k (AB) = C k (A)C k (B): One can see that the result is true for k = n since det(ab) = det(a) det(b), and for k = n? 1 since C n?1 (AB) = (adj(ab)) T = (adj(b)adj(a)) T = adj(a) T adj(b) T = C n?1 (A)C n?1 (B): Using Theorems 2 and 4 one can show that the eigenvalues of C k (A) are all products of k eigenvalues of A. The details can be found in [4, Chapter 19, F.2.b]. One can also dene a kth additive compound of A by k (A) d dt C k(i + ta) : t=0 The eigenvalues of k (A) are all sums of k eigenvalues of A [4, Chapter 19, F.3]. These two compounds are very useful in proving results for sums and products of the eigenvalues and singular values of matrices [4, Chapters 9 and 20]. We will use the following lemma to reduce the proof of Theorem 4 to the case where B is an elementary matrix, that is B = [b ij ] n i;j=1 is of the form (7) b ij = 8 >< >: 1 i = j x i = l; j = m 0 otherwise for some l 6= m. The lemma can be proved by a variant of the method used to prove the existence of row-reduced echelon form. Note that the L i in the lemma are not necessarily lower triangular, and the R i are not necessarily upper triangular.
5 proofs via matrix factorizations 5 Lemma 5. Let A =2 M n. Then there are elementary matrices L i ; i = 1; : : : ; l and R i ; i = 1; : : : ; r and a diagonal matrix D such that A = L 1 L l DR 1 R r : Proof. (of Theorem 4) In view of Lemma 5 it is sucient to prove Theorem 4 in the case that B is a diagonal matrix or an elementary matrix (7). The case of diagonal B is much easier and we omit it. We will assume that l < m (so that B is upper triangular) as the other case can be dealt with in the same way. We will verify (6) in this special case by direct computation. First we will compute C k (B), then C k (AB), and then check that (6) holds. We will dene by s() to be the cardinality of \ fl + 1; : : : ; m? 1g. Also, given a subset containing m but not l we dene the the `complementary' subset by nfmg [ flg: For any subsets and one can check, by explicitly writing down the matrix B(; ) that (8) C k (B) ; = det(b(; )) = 8 >< >: 1 if = (?1) s() x if l 2 ; and = 0 otherwise The second case is the only case that is not immediate. In this case one can check that B(; ) = I j1 B ~ I j2 where j 1 + j 1 + s() = k and B ~ is s() s() and of the form One can now check that ~B = x C A : 1 0 det(b(; )) = det( ~ B) = (?1) s() x by applying s() column interchanges to transform ~ B to be diagonal. Now x and. Let us compute C k (AB). There are several cases. If m 62 then once can easily check that A(; ) = (AB)(; ) and hence that C k (AB) = C k (A). Now consider the case m 2. Let a i denote the k vector consisting of the entries in the ith column of A and the rows corresponding to. Let the elements of be i 1 < < i k, and assume that i r = m. Then writing (AB)(; ) column-wise we have (AB)(; ) = [a i1 a ir?1 (a ir + xa l ) a ir+1 a ik ]:
6 6 roy mathias So, using the Laplace expansion ofdthe determinant on the rth column of this matrix we have (9) det((ab)(; )) = det([a i1 a ik ]) + det([a i1 a ir?1 (xa l ) a ir+1 a ik ]) = det(a(; )) + x det([a i1 a ir?1 a l a ir+1 a ik ]): Call the second matrix in the nal expression C. There are two subcases. If l 2 then two of the columns of C are the same so det(c) = 0. Otherwise l 62 and the columns of C are those of A(; ) but in a dierent order. By the denition of s(), we know that i r?s() < l < i r?s()+1. So, if the rth column of C, which is a l, is moved to between the [r? s()]th and [r? s() + 1]th columns then the resulting matrix is A(; ). This transformation can be accomplished by interchanging a l and the column on its left s() times so To summarize, we have shown det(c) = (?1) s() det(a(; )): (10) ( Ck (A) C k (AB) ; = ; if m 62 ; or fl; mg C k (A) ; + (?1) s() x C k (A) ; otherwise From (8) one can verify that : [C k (A)C k (B)] ; = X 2A C k (A) ; C k (B) ; is the same as (10). 2 If k = n the proof simplies greatly since we only have to show that det(ab) = det(a) when B is an elementary matrix. This follows easily from (9) and the fact that the second matrix in (9) has two identical columns and hence has determinant 0. Thus we have a proof of the multiplicativity of the determinant that does not involve much computation. We could have avoided the use of Lemma 5 in the proof Theorem 4 by using the LU factorization of B - a better known fact. One way to do this is to use the fact that any matrix B 2 M n may be factored as B = P LDU where P is a permutation, L is a product of lower triangular elementary matrices, U is a product of upper triangular matrices and D is diagonal.' However, this would require that one verify (6) for permutation matrices as well as for elementary matrices. Another way to avoid the use of Lemma 5 is to use that fact that if the leading principal minors of B are non-zero then B = LDU with L; D and U as before. To verify (6) for such B it is again sucient to verify it for diagonal and elementary matrices. One can then obtain (6) for general B by a limiting argument. The approach employed in the paper is perhaps the simplest. REFERENCES
7 proofs via matrix factorizations 7 [1] R. Bhatia. Perturbation Bounds for Matrix Eigenvalues. Pitman Research Notes in Mathematics 162. Longman Scientic and Technical, New York, [2] G. H. Golub and C. F. Van Loan. Matrix Computations. The Johns Hopkins University Press, Baltimore, second edition, [3] R. A. Horn and C. R. Johnson. Matrix Analysis. Cambridge University Press, New York, [4] A. W. Marshall and I. Olkin. Inequalities: Theory of Majorization and its Applications. Academic Press, London, [5] R. Mathias. Two theorems on singular values and eigenvalues. Amer. Math. Monthly, 97(1):47{50, [6] A. M. Ostrowski. Solution of Equations and Systems of Equations. Academic Press, London, 1960.
Chapter 2:Determinants. Section 2.1: Determinants by cofactor expansion
Chapter 2:Determinants Section 2.1: Determinants by cofactor expansion [ ] a b Recall: The 2 2 matrix is invertible if ad bc 0. The c d ([ ]) a b function f = ad bc is called the determinant and it associates
More informationLinear Systems and Matrices
Department of Mathematics The Chinese University of Hong Kong 1 System of m linear equations in n unknowns (linear system) a 11 x 1 + a 12 x 2 + + a 1n x n = b 1 a 21 x 1 + a 22 x 2 + + a 2n x n = b 2.......
More informationSpectral inequalities and equalities involving products of matrices
Spectral inequalities and equalities involving products of matrices Chi-Kwong Li 1 Department of Mathematics, College of William & Mary, Williamsburg, Virginia 23187 (ckli@math.wm.edu) Yiu-Tung Poon Department
More informationMath 102, Winter Final Exam Review. Chapter 1. Matrices and Gaussian Elimination
Math 0, Winter 07 Final Exam Review Chapter. Matrices and Gaussian Elimination { x + x =,. Different forms of a system of linear equations. Example: The x + 4x = 4. [ ] [ ] [ ] vector form (or the column
More informationChapter 2. Square matrices
Chapter 2. Square matrices Lecture notes for MA1111 P. Karageorgis pete@maths.tcd.ie 1/18 Invertible matrices Definition 2.1 Invertible matrices An n n matrix A is said to be invertible, if there is a
More informationMAC Module 3 Determinants. Learning Objectives. Upon completing this module, you should be able to:
MAC 2 Module Determinants Learning Objectives Upon completing this module, you should be able to:. Determine the minor, cofactor, and adjoint of a matrix. 2. Evaluate the determinant of a matrix by cofactor
More informationCompound matrices and some classical inequalities
Compound matrices and some classical inequalities Tin-Yau Tam Mathematics & Statistics Auburn University Dec. 3, 04 We discuss some elegant proofs of several classical inequalities of matrices by using
More informationChapter 4. Determinants
4.2 The Determinant of a Square Matrix 1 Chapter 4. Determinants 4.2 The Determinant of a Square Matrix Note. In this section we define the determinant of an n n matrix. We will do so recursively by defining
More informationIr O D = D = ( ) Section 2.6 Example 1. (Bottom of page 119) dim(v ) = dim(l(v, W )) = dim(v ) dim(f ) = dim(v )
Section 3.2 Theorem 3.6. Let A be an m n matrix of rank r. Then r m, r n, and, by means of a finite number of elementary row and column operations, A can be transformed into the matrix ( ) Ir O D = 1 O
More informationProperties of the Determinant Function
Properties of the Determinant Function MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 2015 Overview Today s discussion will illuminate some of the properties of the determinant:
More informationMath Camp Notes: Linear Algebra I
Math Camp Notes: Linear Algebra I Basic Matrix Operations and Properties Consider two n m matrices: a a m A = a n a nm Then the basic matrix operations are as follows: a + b a m + b m A + B = a n + b n
More informationMath 240 Calculus III
The Calculus III Summer 2015, Session II Wednesday, July 8, 2015 Agenda 1. of the determinant 2. determinants 3. of determinants What is the determinant? Yesterday: Ax = b has a unique solution when A
More informationDeterminants by Cofactor Expansion (III)
Determinants by Cofactor Expansion (III) Comment: (Reminder) If A is an n n matrix, then the determinant of A can be computed as a cofactor expansion along the jth column det(a) = a1j C1j + a2j C2j +...
More informationGraduate Mathematical Economics Lecture 1
Graduate Mathematical Economics Lecture 1 Yu Ren WISE, Xiamen University September 23, 2012 Outline 1 2 Course Outline ematical techniques used in graduate level economics courses Mathematics for Economists
More informationLinear Algebra: Lecture notes from Kolman and Hill 9th edition.
Linear Algebra: Lecture notes from Kolman and Hill 9th edition Taylan Şengül March 20, 2019 Please let me know of any mistakes in these notes Contents Week 1 1 11 Systems of Linear Equations 1 12 Matrices
More informationb jσ(j), Keywords: Decomposable numerical range, principal character AMS Subject Classification: 15A60
On the Hu-Hurley-Tam Conjecture Concerning The Generalized Numerical Range Che-Man Cheng Faculty of Science and Technology, University of Macau, Macau. E-mail: fstcmc@umac.mo and Chi-Kwong Li Department
More informationLinear Algebra (part 1) : Matrices and Systems of Linear Equations (by Evan Dummit, 2016, v. 2.02)
Linear Algebra (part ) : Matrices and Systems of Linear Equations (by Evan Dummit, 206, v 202) Contents 2 Matrices and Systems of Linear Equations 2 Systems of Linear Equations 2 Elimination, Matrix Formulation
More informationELEMENTARY LINEAR ALGEBRA WITH APPLICATIONS. 1. Linear Equations and Matrices
ELEMENTARY LINEAR ALGEBRA WITH APPLICATIONS KOLMAN & HILL NOTES BY OTTO MUTZBAUER 11 Systems of Linear Equations 1 Linear Equations and Matrices Numbers in our context are either real numbers or complex
More informationFundamentals of Engineering Analysis (650163)
Philadelphia University Faculty of Engineering Communications and Electronics Engineering Fundamentals of Engineering Analysis (6563) Part Dr. Omar R Daoud Matrices: Introduction DEFINITION A matrix is
More informationMath Linear Algebra Final Exam Review Sheet
Math 15-1 Linear Algebra Final Exam Review Sheet Vector Operations Vector addition is a component-wise operation. Two vectors v and w may be added together as long as they contain the same number n of
More informationLinear Algebra: Linear Systems and Matrices - Quadratic Forms and Deniteness - Eigenvalues and Markov Chains
Linear Algebra: Linear Systems and Matrices - Quadratic Forms and Deniteness - Eigenvalues and Markov Chains Joshua Wilde, revised by Isabel Tecu, Takeshi Suzuki and María José Boccardi August 3, 3 Systems
More informationUndergraduate Mathematical Economics Lecture 1
Undergraduate Mathematical Economics Lecture 1 Yu Ren WISE, Xiamen University September 15, 2014 Outline 1 Courses Description and Requirement 2 Course Outline ematical techniques used in economics courses
More informationDeterminants Chapter 3 of Lay
Determinants Chapter of Lay Dr. Doreen De Leon Math 152, Fall 201 1 Introduction to Determinants Section.1 of Lay Given a square matrix A = [a ij, the determinant of A is denoted by det A or a 11 a 1j
More informationInterlacing Inequalities for Totally Nonnegative Matrices
Interlacing Inequalities for Totally Nonnegative Matrices Chi-Kwong Li and Roy Mathias October 26, 2004 Dedicated to Professor T. Ando on the occasion of his 70th birthday. Abstract Suppose λ 1 λ n 0 are
More information1 Matrices and Systems of Linear Equations
Linear Algebra (part ) : Matrices and Systems of Linear Equations (by Evan Dummit, 207, v 260) Contents Matrices and Systems of Linear Equations Systems of Linear Equations Elimination, Matrix Formulation
More informationLinear Algebra. Matrices Operations. Consider, for example, a system of equations such as x + 2y z + 4w = 0, 3x 4y + 2z 6w = 0, x 3y 2z + w = 0.
Matrices Operations Linear Algebra Consider, for example, a system of equations such as x + 2y z + 4w = 0, 3x 4y + 2z 6w = 0, x 3y 2z + w = 0 The rectangular array 1 2 1 4 3 4 2 6 1 3 2 1 in which the
More information0.1 Rational Canonical Forms
We have already seen that it is useful and simpler to study linear systems using matrices. But matrices are themselves cumbersome, as they are stuffed with many entries, and it turns out that it s best
More informationChapter 4 - MATRIX ALGEBRA. ... a 2j... a 2n. a i1 a i2... a ij... a in
Chapter 4 - MATRIX ALGEBRA 4.1. Matrix Operations A a 11 a 12... a 1j... a 1n a 21. a 22.... a 2j... a 2n. a i1 a i2... a ij... a in... a m1 a m2... a mj... a mn The entry in the ith row and the jth column
More informationII. Determinant Functions
Supplemental Materials for EE203001 Students II Determinant Functions Chung-Chin Lu Department of Electrical Engineering National Tsing Hua University May 22, 2003 1 Three Axioms for a Determinant Function
More informationOn the adjacency matrix of a block graph
On the adjacency matrix of a block graph R. B. Bapat Stat-Math Unit Indian Statistical Institute, Delhi 7-SJSS Marg, New Delhi 110 016, India. email: rbb@isid.ac.in Souvik Roy Economics and Planning Unit
More informationMATH 240 Spring, Chapter 1: Linear Equations and Matrices
MATH 240 Spring, 2006 Chapter Summaries for Kolman / Hill, Elementary Linear Algebra, 8th Ed. Sections 1.1 1.6, 2.1 2.2, 3.2 3.8, 4.3 4.5, 5.1 5.3, 5.5, 6.1 6.5, 7.1 7.2, 7.4 DEFINITIONS Chapter 1: Linear
More information1 Matrices and Systems of Linear Equations. a 1n a 2n
March 31, 2013 16-1 16. Systems of Linear Equations 1 Matrices and Systems of Linear Equations An m n matrix is an array A = (a ij ) of the form a 11 a 21 a m1 a 1n a 2n... a mn where each a ij is a real
More informationMATH2210 Notebook 2 Spring 2018
MATH2210 Notebook 2 Spring 2018 prepared by Professor Jenny Baglivo c Copyright 2009 2018 by Jenny A. Baglivo. All Rights Reserved. 2 MATH2210 Notebook 2 3 2.1 Matrices and Their Operations................................
More informationChapter 3. Determinants and Eigenvalues
Chapter 3. Determinants and Eigenvalues 3.1. Determinants With each square matrix we can associate a real number called the determinant of the matrix. Determinants have important applications to the theory
More informationc c c c c c c c c c a 3x3 matrix C= has a determinant determined by
Linear Algebra Determinants and Eigenvalues Introduction: Many important geometric and algebraic properties of square matrices are associated with a single real number revealed by what s known as the determinant.
More informationQuestion: Given an n x n matrix A, how do we find its eigenvalues? Idea: Suppose c is an eigenvalue of A, then what is the determinant of A-cI?
Section 5. The Characteristic Polynomial Question: Given an n x n matrix A, how do we find its eigenvalues? Idea: Suppose c is an eigenvalue of A, then what is the determinant of A-cI? Property The eigenvalues
More informationSPECTRALLY ARBITRARY FACTORIZATION: THE NONDEROGATORY CASE. 1. Introduction
SPECTRALLY ARBITRARY FACTORIZATION: THE NONDEROGATORY CASE CHARLES R. JOHNSON AND YULIN ZHANG Dedicated to E.M.Sá Abstract. It is known that a nonsingular, nonscalar, n-by-n complex matrix A may be factored
More informationSection 5.6. LU and LDU Factorizations
5.6. LU and LDU Factorizations Section 5.6. LU and LDU Factorizations Note. We largely follow Fraleigh and Beauregard s approach to this topic from Linear Algebra, 3rd Edition, Addison-Wesley (995). See
More informationEquality: Two matrices A and B are equal, i.e., A = B if A and B have the same order and the entries of A and B are the same.
Introduction Matrix Operations Matrix: An m n matrix A is an m-by-n array of scalars from a field (for example real numbers) of the form a a a n a a a n A a m a m a mn The order (or size) of A is m n (read
More informationMatrix Algebra Determinant, Inverse matrix. Matrices. A. Fabretti. Mathematics 2 A.Y. 2015/2016. A. Fabretti Matrices
Matrices A. Fabretti Mathematics 2 A.Y. 2015/2016 Table of contents Matrix Algebra Determinant Inverse Matrix Introduction A matrix is a rectangular array of numbers. The size of a matrix is indicated
More information(f + g)(s) = f(s) + g(s) for f, g V, s S (cf)(s) = cf(s) for c F, f V, s S
1 Vector spaces 1.1 Definition (Vector space) Let V be a set with a binary operation +, F a field, and (c, v) cv be a mapping from F V into V. Then V is called a vector space over F (or a linear space
More informationSPRING OF 2008 D. DETERMINANTS
18024 SPRING OF 2008 D DETERMINANTS In many applications of linear algebra to calculus and geometry, the concept of a determinant plays an important role This chapter studies the basic properties of determinants
More informationLecture Notes in Linear Algebra
Lecture Notes in Linear Algebra Dr. Abdullah Al-Azemi Mathematics Department Kuwait University February 4, 2017 Contents 1 Linear Equations and Matrices 1 1.2 Matrices............................................
More informationMATH 2050 Assignment 8 Fall [10] 1. Find the determinant by reducing to triangular form for the following matrices.
MATH 2050 Assignment 8 Fall 2016 [10] 1. Find the determinant by reducing to triangular form for the following matrices. 0 1 2 (a) A = 2 1 4. ANS: We perform the Gaussian Elimination on A by the following
More information4. Determinants.
4. Determinants 4.1. Determinants; Cofactor Expansion Determinants of 2 2 and 3 3 Matrices 2 2 determinant 4.1. Determinants; Cofactor Expansion Determinants of 2 2 and 3 3 Matrices 3 3 determinant 4.1.
More informationMATH 2030: EIGENVALUES AND EIGENVECTORS
MATH 2030: EIGENVALUES AND EIGENVECTORS Determinants Although we are introducing determinants in the context of matrices, the theory of determinants predates matrices by at least two hundred years Their
More informationLecture Summaries for Linear Algebra M51A
These lecture summaries may also be viewed online by clicking the L icon at the top right of any lecture screen. Lecture Summaries for Linear Algebra M51A refers to the section in the textbook. Lecture
More informationMATH 323 Linear Algebra Lecture 6: Matrix algebra (continued). Determinants.
MATH 323 Linear Algebra Lecture 6: Matrix algebra (continued). Determinants. Elementary matrices Theorem 1 Any elementary row operation σ on matrices with n rows can be simulated as left multiplication
More information16 Chapter 3. Separation Properties, Principal Pivot Transforms, Classes... for all j 2 J is said to be a subcomplementary vector of variables for (3.
Chapter 3 SEPARATION PROPERTIES, PRINCIPAL PIVOT TRANSFORMS, CLASSES OF MATRICES In this chapter we present the basic mathematical results on the LCP. Many of these results are used in later chapters to
More informationA = , A 32 = n ( 1) i +j a i j det(a i j). (1) j=1
Lecture Notes: Determinant of a Square Matrix Yufei Tao Department of Computer Science and Engineering Chinese University of Hong Kong taoyf@cse.cuhk.edu.hk 1 Determinant Definition Let A [a ij ] be an
More informationFoundations of Matrix Analysis
1 Foundations of Matrix Analysis In this chapter we recall the basic elements of linear algebra which will be employed in the remainder of the text For most of the proofs as well as for the details, the
More informationLecture 10: Determinants and Cramer s Rule
Lecture 0: Determinants and Cramer s Rule The determinant and its applications. Definition The determinant of a square matrix A, denoted by det(a) or A, is a real number, which is defined as follows. -by-
More informationComponents and change of basis
Math 20F Linear Algebra Lecture 16 1 Components and change of basis Slide 1 Review: Isomorphism Review: Components in a basis Unique representation in a basis Change of basis Review: Isomorphism Definition
More informationFormula for the inverse matrix. Cramer s rule. Review: 3 3 determinants can be computed expanding by any row or column
Math 20F Linear Algebra Lecture 18 1 Determinants, n n Review: The 3 3 case Slide 1 Determinants n n (Expansions by rows and columns Relation with Gauss elimination matrices: Properties) Formula for the
More informationTOPIC III LINEAR ALGEBRA
[1] Linear Equations TOPIC III LINEAR ALGEBRA (1) Case of Two Endogenous Variables 1) Linear vs. Nonlinear Equations Linear equation: ax + by = c, where a, b and c are constants. 2 Nonlinear equation:
More information1 Last time: least-squares problems
MATH Linear algebra (Fall 07) Lecture Last time: least-squares problems Definition. If A is an m n matrix and b R m, then a least-squares solution to the linear system Ax = b is a vector x R n such that
More informationan Off-Diagonal Block of
J. oflnequal. & Appl., 1999, Vol. 3, pp. 137-142 Reprints available directly from the publisher Photocopying permitted by license only (C) 1999 OPA (Overseas Publishers Association) N.V. Published by license
More informationANSWERS (5 points) Let A be a 2 2 matrix such that A =. Compute A. 2
MATH 7- Final Exam Sample Problems Spring 7 ANSWERS ) ) ). 5 points) Let A be a matrix such that A =. Compute A. ) A = A ) = ) = ). 5 points) State ) the definition of norm, ) the Cauchy-Schwartz inequality
More informationConvexity of the Joint Numerical Range
Convexity of the Joint Numerical Range Chi-Kwong Li and Yiu-Tung Poon October 26, 2004 Dedicated to Professor Yik-Hoi Au-Yeung on the occasion of his retirement. Abstract Let A = (A 1,..., A m ) be an
More information4.1 Eigenvalues, Eigenvectors, and The Characteristic Polynomial
Linear Algebra (part 4): Eigenvalues, Diagonalization, and the Jordan Form (by Evan Dummit, 27, v ) Contents 4 Eigenvalues, Diagonalization, and the Jordan Canonical Form 4 Eigenvalues, Eigenvectors, and
More informationOnline Exercises for Linear Algebra XM511
This document lists the online exercises for XM511. The section ( ) numbers refer to the textbook. TYPE I are True/False. Lecture 02 ( 1.1) Online Exercises for Linear Algebra XM511 1) The matrix [3 2
More informationGaussian Elimination and Back Substitution
Jim Lambers MAT 610 Summer Session 2009-10 Lecture 4 Notes These notes correspond to Sections 31 and 32 in the text Gaussian Elimination and Back Substitution The basic idea behind methods for solving
More information1 Determinants. 1.1 Determinant
1 Determinants [SB], Chapter 9, p.188-196. [SB], Chapter 26, p.719-739. Bellow w ll study the central question: which additional conditions must satisfy a quadratic matrix A to be invertible, that is to
More informationMath 110 Linear Algebra Midterm 2 Review October 28, 2017
Math 11 Linear Algebra Midterm Review October 8, 17 Material Material covered on the midterm includes: All lectures from Thursday, Sept. 1st to Tuesday, Oct. 4th Homeworks 9 to 17 Quizzes 5 to 9 Sections
More informationLinear Algebra review Powers of a diagonalizable matrix Spectral decomposition
Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Prof. Tesler Math 283 Fall 2016 Also see the separate version of this with Matlab and R commands. Prof. Tesler Diagonalizing
More informationEE731 Lecture Notes: Matrix Computations for Signal Processing
EE731 Lecture Notes: Matrix Computations for Signal Processing James P. Reilly c Department of Electrical and Computer Engineering McMaster University September 22, 2005 0 Preface This collection of ten
More informationMatrices and Determinants
Chapter1 Matrices and Determinants 11 INTRODUCTION Matrix means an arrangement or array Matrices (plural of matrix) were introduced by Cayley in 1860 A matrix A is rectangular array of m n numbers (or
More informationMATH 213 Linear Algebra and ODEs Spring 2015 Study Sheet for Midterm Exam. Topics
MATH 213 Linear Algebra and ODEs Spring 2015 Study Sheet for Midterm Exam This study sheet will not be allowed during the test Books and notes will not be allowed during the test Calculators and cell phones
More informationANSWERS. E k E 2 E 1 A = B
MATH 7- Final Exam Spring ANSWERS Essay Questions points Define an Elementary Matrix Display the fundamental matrix multiply equation which summarizes a sequence of swap, combination and multiply operations,
More informationMATHEMATICS 217 NOTES
MATHEMATICS 27 NOTES PART I THE JORDAN CANONICAL FORM The characteristic polynomial of an n n matrix A is the polynomial χ A (λ) = det(λi A), a monic polynomial of degree n; a monic polynomial in the variable
More informationLinear Algebra review Powers of a diagonalizable matrix Spectral decomposition
Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Prof. Tesler Math 283 Fall 2018 Also see the separate version of this with Matlab and R commands. Prof. Tesler Diagonalizing
More information1 Multiply Eq. E i by λ 0: (λe i ) (E i ) 2 Multiply Eq. E j by λ and add to Eq. E i : (E i + λe j ) (E i )
Direct Methods for Linear Systems Chapter Direct Methods for Solving Linear Systems Per-Olof Persson persson@berkeleyedu Department of Mathematics University of California, Berkeley Math 18A Numerical
More informationSTABILITY OF INVARIANT SUBSPACES OF COMMUTING MATRICES We obtain some further results for pairs of commuting matrices. We show that a pair of commutin
On the stability of invariant subspaces of commuting matrices Tomaz Kosir and Bor Plestenjak September 18, 001 Abstract We study the stability of (joint) invariant subspaces of a nite set of commuting
More informationLinear Operators Preserving the Numerical Range (Radius) on Triangular Matrices
Linear Operators Preserving the Numerical Range (Radius) on Triangular Matrices Chi-Kwong Li Department of Mathematics, College of William & Mary, P.O. Box 8795, Williamsburg, VA 23187-8795, USA. E-mail:
More informationDeterminants. Samy Tindel. Purdue University. Differential equations and linear algebra - MA 262
Determinants Samy Tindel Purdue University Differential equations and linear algebra - MA 262 Taken from Differential equations and linear algebra by Goode and Annin Samy T. Determinants Differential equations
More informationA Note on Eigenvalues of Perturbed Hermitian Matrices
A Note on Eigenvalues of Perturbed Hermitian Matrices Chi-Kwong Li Ren-Cang Li July 2004 Let ( H1 E A = E H 2 Abstract and à = ( H1 H 2 be Hermitian matrices with eigenvalues λ 1 λ k and λ 1 λ k, respectively.
More informationMinimum number of non-zero-entries in a 7 7 stable matrix
Linear Algebra and its Applications 572 (2019) 135 152 Contents lists available at ScienceDirect Linear Algebra and its Applications www.elsevier.com/locate/laa Minimum number of non-zero-entries in a
More informationOHSx XM511 Linear Algebra: Solutions to Online True/False Exercises
This document gives the solutions to all of the online exercises for OHSx XM511. The section ( ) numbers refer to the textbook. TYPE I are True/False. Answers are in square brackets [. Lecture 02 ( 1.1)
More informationNOTES FOR LINEAR ALGEBRA 133
NOTES FOR LINEAR ALGEBRA 33 William J Anderson McGill University These are not official notes for Math 33 identical to the notes projected in class They are intended for Anderson s section 4, and are 2
More informationMath 489AB Exercises for Chapter 2 Fall Section 2.3
Math 489AB Exercises for Chapter 2 Fall 2008 Section 2.3 2.3.3. Let A M n (R). Then the eigenvalues of A are the roots of the characteristic polynomial p A (t). Since A is real, p A (t) is a polynomial
More informationSYLLABUS. 1 Linear maps and matrices
Dr. K. Bellová Mathematics 2 (10-PHY-BIPMA2) SYLLABUS 1 Linear maps and matrices Operations with linear maps. Prop 1.1.1: 1) sum, scalar multiple, composition of linear maps are linear maps; 2) L(U, V
More informationMATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 1 x 2. x n 8 (4) 3 4 2
MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS SYSTEMS OF EQUATIONS AND MATRICES Representation of a linear system The general system of m equations in n unknowns can be written a x + a 2 x 2 + + a n x n b a
More informationHere are some additional properties of the determinant function.
List of properties Here are some additional properties of the determinant function. Prop Throughout let A, B M nn. 1 If A = (a ij ) is upper triangular then det(a) = a 11 a 22... a nn. 2 If a row or column
More informationMath113: Linear Algebra. Beifang Chen
Math3: Linear Algebra Beifang Chen Spring 26 Contents Systems of Linear Equations 3 Systems of Linear Equations 3 Linear Systems 3 2 Geometric Interpretation 3 3 Matrices of Linear Systems 4 4 Elementary
More informationON THE QR ITERATIONS OF REAL MATRICES
Unspecified Journal Volume, Number, Pages S????-????(XX- ON THE QR ITERATIONS OF REAL MATRICES HUAJUN HUANG AND TIN-YAU TAM Abstract. We answer a question of D. Serre on the QR iterations of a real matrix
More informationEvaluating Determinants by Row Reduction
Evaluating Determinants by Row Reduction MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 2015 Objectives Reduce a matrix to row echelon form and evaluate its determinant.
More informationACI-matrices all of whose completions have the same rank
ACI-matrices all of whose completions have the same rank Zejun Huang, Xingzhi Zhan Department of Mathematics East China Normal University Shanghai 200241, China Abstract We characterize the ACI-matrices
More informationSection 3.3. Matrix Rank and the Inverse of a Full Rank Matrix
3.3. Matrix Rank and the Inverse of a Full Rank Matrix 1 Section 3.3. Matrix Rank and the Inverse of a Full Rank Matrix Note. The lengthy section (21 pages in the text) gives a thorough study of the rank
More informationBasics of Calculus and Algebra
Monika Department of Economics ISCTE-IUL September 2012 Basics of linear algebra Real valued Functions Differential Calculus Integral Calculus Optimization Introduction I A matrix is a rectangular array
More informationDeterminants. Beifang Chen
Determinants Beifang Chen 1 Motivation Determinant is a function that each square real matrix A is assigned a real number, denoted det A, satisfying certain properties If A is a 3 3 matrix, writing A [u,
More informationLinear Algebra Primer
Introduction Linear Algebra Primer Daniel S. Stutts, Ph.D. Original Edition: 2/99 Current Edition: 4//4 This primer was written to provide a brief overview of the main concepts and methods in elementary
More informationCalculating determinants for larger matrices
Day 26 Calculating determinants for larger matrices We now proceed to define det A for n n matrices A As before, we are looking for a function of A that satisfies the product formula det(ab) = det A det
More informationLecture notes: Applied linear algebra Part 2. Version 1
Lecture notes: Applied linear algebra Part 2. Version 1 Michael Karow Berlin University of Technology karow@math.tu-berlin.de October 2, 2008 First, some exercises: xercise 0.1 (2 Points) Another least
More informationarxiv: v3 [math.ra] 22 Aug 2014
arxiv:1407.0331v3 [math.ra] 22 Aug 2014 Positivity of Partitioned Hermitian Matrices with Unitarily Invariant Norms Abstract Chi-Kwong Li a, Fuzhen Zhang b a Department of Mathematics, College of William
More informationCounting Matrices Over a Finite Field With All Eigenvalues in the Field
Counting Matrices Over a Finite Field With All Eigenvalues in the Field Lisa Kaylor David Offner Department of Mathematics and Computer Science Westminster College, Pennsylvania, USA kaylorlm@wclive.westminster.edu
More informationCentral Groupoids, Central Digraphs, and Zero-One Matrices A Satisfying A 2 = J
Central Groupoids, Central Digraphs, and Zero-One Matrices A Satisfying A 2 = J Frank Curtis, John Drew, Chi-Kwong Li, and Daniel Pragel September 25, 2003 Abstract We study central groupoids, central
More informationMATH 106 LINEAR ALGEBRA LECTURE NOTES
MATH 6 LINEAR ALGEBRA LECTURE NOTES FALL - These Lecture Notes are not in a final form being still subject of improvement Contents Systems of linear equations and matrices 5 Introduction to systems of
More informationLinear Algebra M1 - FIB. Contents: 5. Matrices, systems of linear equations and determinants 6. Vector space 7. Linear maps 8.
Linear Algebra M1 - FIB Contents: 5 Matrices, systems of linear equations and determinants 6 Vector space 7 Linear maps 8 Diagonalization Anna de Mier Montserrat Maureso Dept Matemàtica Aplicada II Translation:
More informationdet(ka) = k n det A.
Properties of determinants Theorem. If A is n n, then for any k, det(ka) = k n det A. Multiplying one row of A by k multiplies the determinant by k. But ka has every row multiplied by k, so the determinant
More information2. Linear algebra. matrices and vectors. linear equations. range and nullspace of matrices. function of vectors, gradient and Hessian
FE661 - Statistical Methods for Financial Engineering 2. Linear algebra Jitkomut Songsiri matrices and vectors linear equations range and nullspace of matrices function of vectors, gradient and Hessian
More information