Matrices A brief introduction
|
|
- Georgia West
- 5 years ago
- Views:
Transcription
1 Matrices A brief introduction Basilio Bona DAUIN Politecnico di Torino Semester 1, B. Bona (DAUIN) Matrices Semester 1, / 41
2 Definitions Definition A matrix is a set of N real or complex numbers organized in m rows and n columns, with N = mn a 11 a 12 a 1n a A = 21 a 22 a 2n a ij [ ] a ij i = 1,...,m j = 1,...,n a m1 a m2 a mn A matrix is always written as a boldface capital letter viene as in A. To indicate matrix dimensions we use the following symbols A m n A m n A F m n A F m n where F = R for real elements and F = C for complex elements. B. Bona (DAUIN) Matrices Semester 1, / 41
3 Transpose matrix Given a matrix A m n we define a transpose matrix the matrix obtained exchanging rows and columns a 11 a 21 a m1 A T n m = a 12 a 22 a m a 1n a 2n a mn The following property holds (A T ) T = A B. Bona (DAUIN) Matrices Semester 1, / 41
4 Square matrix A matrix is said to be square when m = n A square n n matrix is upper triangular when a ij = 0, i > j a 11 a 12 a 1n 0 a A n n = 22 a 2n a nn If a square matrix is upper triangular its transpose is lower triangular and viceversa a A T n n = a 12 a a 1n a 2n a nn B. Bona (DAUIN) Matrices Semester 1, / 41
5 Symmetric matrix A real square matrix is said to be symmetric if A = A T, or A A T = O In a real symmetric matrix there are at least n(n+1) independent 2 elements. If a matrix K has complex elements k ij = a ij +jb ij (where j = 1) its conjugate is K with elements k ij = a ij jb ij. Given a complex matrix K, an adjoint matrix K is defined, as the conjugate transpose K = K T = K T A complex matrix is called self-adjoint or hermitian when K = K. Some textbooks indicate this matrix as K or K H B. Bona (DAUIN) Matrices Semester 1, / 41
6 Diagonal matrix A square matrix is said to be diagonal if a ij = 0 for i j a a A n n = diag(a i ) = a n A diagonal matrix is always symmetric. B. Bona (DAUIN) Matrices Semester 1, / 41
7 Matrix Algebra Matrices form an algebra, i.e., a vector space endowed with the product operator. The main operations are: product by a scalar, sum, matrix product Product by a scalar a 11 a 12 a 1n αa 11 αa 12 αa 1n a αa = α 21 a 22 a 2n = αa 21 αa 22 αa 2n a m1 a m2 a mn αa m1 αa m2 αa mn Sum a 11 +b 11 a 12 +b 12 a 1n +b 1n a A+B = 21 +b 21 a 22 +b 22 a 2n +b 2n a m1 +b m1 a m2 +b m2 a mn +b mn B. Bona (DAUIN) Matrices Semester 1, / 41
8 Sum Properties A+O = A A+B = B+A (A+B)+C = A+(B+C) (A+B) T = A T +B T The neutral element O is called null or zero matrix. The matrix difference is defined introducing the scalar α = 1: A B = A+( 1)B. B. Bona (DAUIN) Matrices Semester 1, / 41
9 Matrix Product Matrix product The operation follows the rule row by column : the generic c ij element of the product matrix C m p = A m n B n p is The following identity holds: c ij = n a ik b kj k=1 α(a B) = (αa) B = A (αb) B. Bona (DAUIN) Matrices Semester 1, / 41
10 Product Properties A B C = (A B) C = A (B C) A (B+C) = A B+A C (A+B) C = A C+B C (A B) T = B T A T In general: the matrix product is NOT commutative: A B B A, except some particular case; A B = A C does not imply B = C, except some particular case; A B = O does not imply A = O or B = O, except some particular case. B. Bona (DAUIN) Matrices Semester 1, / 41
11 Identity Matrix The neutral element wrt the matrix product is calledidentity matrix usually written as I n or I when there are no ambiguities on the dimension. Identity matrix I = Given a rectangular matrix A m n the following hold A m n = I m A m n = A m n I n B. Bona (DAUIN) Matrices Semester 1, / 41
12 Matrix Power Given a square matric A R n n, the k-th power is k A k = A l=1 One matrix is said to be idempotent iff A 2 = A A k = A. B. Bona (DAUIN) Matrices Semester 1, / 41
13 Matrix Trace Trace The trace of a square matrix A n n is the sum of its diagonal elements tr(a) = Trace satisfy the following properties tr(αa+βb) = αtr(a)+β tr(b) tr(ab) = tr(ba) tr(a) = tr(a T ) tr(a) = tr(t 1 AT) for T non-singular (see below for explanation) n k=1 a kk B. Bona (DAUIN) Matrices Semester 1, / 41
14 Row/column cancellation Given the square matrix A R n n, we call A (ij) R (n 1) (n 1) the matrix obtained deleting the la i-the row and the j-the columns of A. Example: given A = deleting row 2, column 3 we obtain A (23) = B. Bona (DAUIN) Matrices Semester 1, / 41
15 Minors and Determinant A minor of order p of a generic matrix A m n is defined as the il determinant D p of a square sub-matrix obtained selecting any p rows and p columns of A m n There exist as many minors as the possible choices of p on m rows and p on n columns The definition of determinant will be given soon. Given a matrix A m n its principal minors of order k are the determinants D k, with k = 1,,min{m,n}, obtained selecting the first k rows and k columns of A m n. B. Bona (DAUIN) Matrices Semester 1, / 41
16 Example Given the 4 3 matrix A = we compute a generic minor D 2, for example that obtained selecting the first and rows 1 and 3 and columns 1 and 2 (in red). First we form the submatrix D = and then we compute the determinant [ ] D 2 = det(d) = 3 1 ( 3 1) = 0 B. Bona (DAUIN) Matrices Semester 1, / 41
17 Example Given the 4 3 matrix A = we compute the principal minors minors D k,k = 1,2,3, D 1 = 1 [ ] 1 3 D 2 = det = D 3 = det = B. Bona (DAUIN) Matrices Semester 1, / 41
18 Complement We call the complement C rc of a generic (r,c) element of a square matrix A n n the determinant of the matrix obtained deleting its r-the row and the c-th column, i.e., deta (rc) D rc = deta (rc). The cofactor of the (r,c) element of a square matrix A n n is the signed product C rc = ( 1) r+c D rc B. Bona (DAUIN) Matrices Semester 1, / 41
19 Example Given the 3 3 matrix some of the cofactors are A = C 11 = ( 1) 2 (45 48) = 3 C 12 = ( 1) 3 (36 42) = 6 C 31 = ( 1) 4 (12 15) = 3 B. Bona (DAUIN) Matrices Semester 1, / 41
20 Adjugate/Adjunct/Adjoint The cofactor matrix of A is the n n matrix C whose (i,j) entry C ij is the (i,j) cofactor of A C ij = ( 1) i+j D ij The adjugate or adjunct or adjoint of a square matrix A is the transpose of C, that is, the n n matrix whose (i,j) entry is the (j,i) cofactor of A, A adj ij = C ji = ( 1) i+j D ji The adjoint matrix of A is the matrix X that satisfies the following equality AX = XA = det(a)i B. Bona (DAUIN) Matrices Semester 1, / 41
21 Example Given the 3 3 matrix its adjoint is A = A adj = B. Bona (DAUIN) Matrices Semester 1, / 41
22 Determinant The determinant of a square matrix A x n can be computed in different ways. Choosing any row i, the definition by row is: det(a) = n a ik ( 1) i+k det(a (ik) ) = k=1 n a ik A ik k=1 Choosing any column j, the definition by column is:: det(a) = n a kj ( 1) k+j det(a (kj) ) = k=1 n a kj A kj Since these definitions are recursive, involving the determinants of increasingly smaller minors, we define the determinant of a 1 1 matrix A = a, simply as deta = a. k=1 B. Bona (DAUIN) Matrices Semester 1, / 41
23 Properties The determinant has the following properties: det(a B) = det(a)det(b) det(a T ) = det(a) det(ka) = k n det(a) if one exchanges s rows or columns of A, obtaining A s, then det(a s ) = ( 1) s det(a) if A has two or more rows/columns equal or proportional, then det(a) = 0 if A has a row/column that can be obtained as a linear combination of other rows/columns, then det(a) = 0 if A is triangular, then det(a) = n i=1 a ii if A is block-triangular, with p blocks A ii on the diagonal, then det(a) = p i=1 deta ii B. Bona (DAUIN) Matrices Semester 1, / 41
24 Rank and Singularity A matrix A is singular if det(a) = 0. The rank (or characteristic) of a matrix A m n is the number ρ(a m n ), defined as the largest integer p for which at least a minor D p is non-zero. The following properties hold: ρ(a) min{m,n} if ρ(a) = min{m,n}, A is said to be full rank if ρ(a) < min{m,n}, the rank of the matrix is said to drop if A n n and deta < n the matrix is not full rank, or is rank deficient ρ(a B) min{ρ(a),ρ(b)} ρ(a) = ρ(a T ) ρ(a A T ) = ρ(a T A) = ρ(a) B. Bona (DAUIN) Matrices Semester 1, / 41
25 Invertible Matrix A square matrix A R n n it is said to be invertible or non singular if the inverse A 1 n n exists, such that AA 1 = A 1 A = I n A matrix is invertible iff ρ(a) = n, i.e., it is full-rank; this is equivalent to have a non zero determinant det(a) 0. The inverse is computed as: A 1 = 1 det(a) Aadj The following properties hold: (A 1 ) 1 = A; (A T ) 1 = (A 1 ) T. The inverse, if exists, allows to solve the following matrix equation with respect to the unknown x, as y = Ax x = A 1 y. B. Bona (DAUIN) Matrices Semester 1, / 41
26 Matrix derivative If a square matrix A n n (t) has elements function of a variable (e.g., the time t) a ij (t), then the matrix derivative is [ ] d d A(t) = Ȧ(t) = dt dt a ij(t) = [ȧ ij (t)] If A(t) rank is full, ρ(a(t)) = n for every t, then the derivative of the inverse is d dt A(t) 1 1 = A (t)ȧ(t)a(t) 1 Notice that, since the inverse is a nonlinear function, the derivative of the inverse is in general different from the inverse of the derivative [ da(t) dt ] 1 d [ A(t) 1 ] dt B. Bona (DAUIN) Matrices Semester 1, / 41
27 Example Given the square matrix we have The inverse of A is A(t) = d A(t) = Ȧ(t) = dt A(t) 1 = [ ] cosθ(t) sinθ(t) sin θ(t) cos θ(t) [ ] sinθ(t) cosθ(t) θ cosθ(t) sinθ(t) [ ] cosθ(t) sinθ(t) = A(t) sinθ(t) cosθ(t) T and in this particular case the two inverses are equal [ da(t) dt ] 1 = d [ A(t) 1 ] = dt [ ] cosθ(t) sinθ(t) sinθ(t) cosθ(t) B. Bona (DAUIN) Matrices Semester 1, / 41
28 Matrix Decomposition Given a real matrix A R m n, the following products give symmetric matrices A T A R n n AA T R m m Given a square matrix A, it is always possible to decompose it in a sum of two matrices where is symmetric, and A = A s +A ss A s = 1 2 (A+AT ) A ss = 1 2 (A AT ) is skew-symmetric. B. Bona (DAUIN) Matrices Semester 1, / 41
29 Similarity Transformation Similarity transformation Given a square matrix A R n n and a square nonsingular matrix T R n n, the matrix B R n n obtained as B = T 1 AT or B = TAT 1 is called similar to A, and the transformation T is called similarity transformation. B. Bona (DAUIN) Matrices Semester 1, / 41
30 Eigenvalues and Eigenvectors If it is possible to find a nonsingular matrix U such that A is similar to the diagonal matrix Λ = diag(λ i ) A = UΛU 1 AU = UΛ and if we call u i the i-th column of U, we have U = [ u 1 u 2 u n ] Au i = λ i u i This relation is the well known formula defining eigenvectors and eigenvalues of A. The λ i are the eigenvalues of A and the u i are the eigenvectors of A. B. Bona (DAUIN) Matrices Semester 1, / 41
31 Eigenvalues and Eigenvectors Eigenvalues and eigenvectors Given a square matrix A n n, the matrix eigenvalues λ i are the (real or complex) solutions of the characteristic equation det(λi A) = 0 det(λi A) is a polynomial in λ, called the characteristic polynomial of A. If the eigenvalues are all distinct, we call eigenvectors the vectors u i that satisfy the following identity Au i = λ i u i B. Bona (DAUIN) Matrices Semester 1, / 41
32 Geometrical interpretation If the eigenvalues are not all distinct, we obtain the generalized eigenvectors, whose characterization goes beyond the scope of this presentation. From a geometrical point of view, the eigenvectors represent those particular directions in the R n space, i.e., the domain of the linear transformation represented by A, that remain invariant under the transformation, while the eigenvalues give the scaling constants along these same directions. The set of the matrix eigenvalues is usually indicated as Λ(A) or {λ i (A)}; the set of the matrix eigenvectors is indicated as {u i (A)}. In general, they are normalized, i.e., {u i (A)} = 1 B. Bona (DAUIN) Matrices Semester 1, / 41
33 Eigenvalues Properties Given a square matrix A and its eigenvalues, {λ i (A)}, the following properties hold true {λ i (A+cI)} = {(λ i (A)+c)} {λ i (ca)} = {(cλ i (A)} Given a triangular matrix a 11 a 12 a 1n 0 a 22 a 2n......, 0 0 a nn a a 21 a a n1 a n2 a nn its eigenvalues are the elements on the main diagonal {λ i (A)} = {a ii }; the same is true for a diagonal matrix. B. Bona (DAUIN) Matrices Semester 1, / 41
34 Other properties Given a square matrix A n n and its eigenvalues {λ i (A)}, the following hold true n det(a) = and tr(a) = i=1 n i=1 Given any invertible similarity transformation T, B = T 1 AT the eigenvalues of A are invariant to it, i.e., {λ i (B)} = {λ i (A)} λ i λ i B. Bona (DAUIN) Matrices Semester 1, / 41
35 Modal matrix If we build a matrix M whose columns are the normalized eigenvectors u i (A) M = [ u 1 u n ] then the similarity transformation with respect to M results in the diagonal matrix λ λ Λ = = M 1 AM 0 0 λ n M is the modal matrix. If A is symmetric, all its eigenvalues are real and we have In this case M is orthonormal. Λ = M T AM B. Bona (DAUIN) Matrices Semester 1, / 41
36 Singular Value decomposition (SVD) Given a matrix A R m n, having rank r = ρ(a) s, with s = min{m,n}, it can be decomposed (factored) in the following way: A = UΣV T = s σ i u i v T i (1) i=1 The decomposition is characterized by three elements: σ i u i v i as follows. B. Bona (DAUIN) Matrices Semester 1, / 41
37 SVD Characterization σ i (A) 0 are the singular values and are equal to the non-negative square roots of the eigenvalues of the symmetric matrix A T A: {σ i (A)} = { λ i (A T A)} σ i 0 ordered in decreasing order σ 1 σ 2 σ s 0 if r < s there are r positive singular values; the remaining ones are zero σ 1 σ 2 σ r > 0; σ r+1 = = σ s = 0 U is a orthonormal (m m) matrix U = [ u 1 u 2 u m ] containing the eigenvectors u i of AA T B. Bona (DAUIN) Matrices Semester 1, / 41
38 SVD Characterization V is a (n n) orthonormal matrix V = [ v 1 v 2 v n ] whose columns are the eigenvectors v i of the matrix A T A Σ is a (m n) matrix, with the following structure if m < n Σ = [ Σ s O ] if m = n Σ = Σ s if m > n Σ = [ Σs O where Σ s = diag(σ i ) is diagonal with dimension s s, having the singular values on the diagonal. ]. B. Bona (DAUIN) Matrices Semester 1, / 41
39 Example Given its SVD is where A = [ ] A = UΣV T ρ(a) = 2 [ ] U = [ ] Σ = V = B. Bona (DAUIN) Matrices Semester 1, / 41
40 Alternative SVD Decomposition Alternately, we can decompose the A matrix as follows: where A = [ P P ] [ ] Σr O }{{} O O U }{{} Σ [ Q T Q T ] }{{} V T P is an orthonormal m r matrix, P is an orthonormal m (m r) matrix; = PΣ r Q T (2) Q is an orthonormal n r matrix, Q T is an orthonormal n (n r) matrix; Σ r is an diagonal r r matrix, whose diagonal elements are the positive singular values σ i > 0, i = 1,,r. B. Bona (DAUIN) Matrices Semester 1, / 41
41 Rank The rank r = ρ(a) of A is equal to the number r s of nonzero singular values. Given any matrix A R m n, both A T A and AA T are symmetric, with identical positive singular values and differ only for the number of zero singular values. B. Bona (DAUIN) Matrices Semester 1, / 41
Matrices A brief introduction
Matrices A brief introduction Basilio Bona DAUIN Politecnico di Torino Semester 1, 2014-15 B. Bona (DAUIN) Matrices Semester 1, 2014-15 1 / 44 Definitions Definition A matrix is a set of N real or complex
More informationMatrices A brief introduction
Matrices A brief introduction Basilio Bona DAUIN Politecnico di Torino September 2013 Basilio Bona (DAUIN) Matrices September 2013 1 / 74 Definitions Definition A matrix is a set of N real or complex numbers
More informationFoundations of Matrix Analysis
1 Foundations of Matrix Analysis In this chapter we recall the basic elements of linear algebra which will be employed in the remainder of the text For most of the proofs as well as for the details, the
More informationMathematics. EC / EE / IN / ME / CE. for
Mathematics for EC / EE / IN / ME / CE By www.thegateacademy.com Syllabus Syllabus for Mathematics Linear Algebra: Matrix Algebra, Systems of Linear Equations, Eigenvalues and Eigenvectors. Probability
More informationFundamentals of Engineering Analysis (650163)
Philadelphia University Faculty of Engineering Communications and Electronics Engineering Fundamentals of Engineering Analysis (6563) Part Dr. Omar R Daoud Matrices: Introduction DEFINITION A matrix is
More informationMath Camp II. Basic Linear Algebra. Yiqing Xu. Aug 26, 2014 MIT
Math Camp II Basic Linear Algebra Yiqing Xu MIT Aug 26, 2014 1 Solving Systems of Linear Equations 2 Vectors and Vector Spaces 3 Matrices 4 Least Squares Systems of Linear Equations Definition A linear
More informationChapter 4 - MATRIX ALGEBRA. ... a 2j... a 2n. a i1 a i2... a ij... a in
Chapter 4 - MATRIX ALGEBRA 4.1. Matrix Operations A a 11 a 12... a 1j... a 1n a 21. a 22.... a 2j... a 2n. a i1 a i2... a ij... a in... a m1 a m2... a mj... a mn The entry in the ith row and the jth column
More informationc c c c c c c c c c a 3x3 matrix C= has a determinant determined by
Linear Algebra Determinants and Eigenvalues Introduction: Many important geometric and algebraic properties of square matrices are associated with a single real number revealed by what s known as the determinant.
More informationLecture 1 Review: Linear models have the form (in matrix notation) Y = Xβ + ε,
2. REVIEW OF LINEAR ALGEBRA 1 Lecture 1 Review: Linear models have the form (in matrix notation) Y = Xβ + ε, where Y n 1 response vector and X n p is the model matrix (or design matrix ) with one row for
More informationPhys 201. Matrices and Determinants
Phys 201 Matrices and Determinants 1 1.1 Matrices 1.2 Operations of matrices 1.3 Types of matrices 1.4 Properties of matrices 1.5 Determinants 1.6 Inverse of a 3 3 matrix 2 1.1 Matrices A 2 3 7 =! " 1
More informationMATH2210 Notebook 2 Spring 2018
MATH2210 Notebook 2 Spring 2018 prepared by Professor Jenny Baglivo c Copyright 2009 2018 by Jenny A. Baglivo. All Rights Reserved. 2 MATH2210 Notebook 2 3 2.1 Matrices and Their Operations................................
More informationMATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 1 x 2. x n 8 (4) 3 4 2
MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS SYSTEMS OF EQUATIONS AND MATRICES Representation of a linear system The general system of m equations in n unknowns can be written a x + a 2 x 2 + + a n x n b a
More informationMatrices and Determinants
Chapter1 Matrices and Determinants 11 INTRODUCTION Matrix means an arrangement or array Matrices (plural of matrix) were introduced by Cayley in 1860 A matrix A is rectangular array of m n numbers (or
More informationEquality: Two matrices A and B are equal, i.e., A = B if A and B have the same order and the entries of A and B are the same.
Introduction Matrix Operations Matrix: An m n matrix A is an m-by-n array of scalars from a field (for example real numbers) of the form a a a n a a a n A a m a m a mn The order (or size) of A is m n (read
More informationMathematical Foundations of Applied Statistics: Matrix Algebra
Mathematical Foundations of Applied Statistics: Matrix Algebra Steffen Unkel Department of Medical Statistics University Medical Center Göttingen, Germany Winter term 2018/19 1/105 Literature Seber, G.
More informationIntroduction to Matrices
214 Analysis and Design of Feedback Control Systems Introduction to Matrices Derek Rowell October 2002 Modern system dynamics is based upon a matrix representation of the dynamic equations governing the
More information1 Multiply Eq. E i by λ 0: (λe i ) (E i ) 2 Multiply Eq. E j by λ and add to Eq. E i : (E i + λe j ) (E i )
Direct Methods for Linear Systems Chapter Direct Methods for Solving Linear Systems Per-Olof Persson persson@berkeleyedu Department of Mathematics University of California, Berkeley Math 18A Numerical
More informationMath Camp Lecture 4: Linear Algebra. Xiao Yu Wang. Aug 2010 MIT. Xiao Yu Wang (MIT) Math Camp /10 1 / 88
Math Camp 2010 Lecture 4: Linear Algebra Xiao Yu Wang MIT Aug 2010 Xiao Yu Wang (MIT) Math Camp 2010 08/10 1 / 88 Linear Algebra Game Plan Vector Spaces Linear Transformations and Matrices Determinant
More informationLinGloss. A glossary of linear algebra
LinGloss A glossary of linear algebra Contents: Decompositions Types of Matrices Theorems Other objects? Quasi-triangular A matrix A is quasi-triangular iff it is a triangular matrix except its diagonal
More informationLinear Algebra Review. Vectors
Linear Algebra Review 9/4/7 Linear Algebra Review By Tim K. Marks UCSD Borrows heavily from: Jana Kosecka http://cs.gmu.edu/~kosecka/cs682.html Virginia de Sa (UCSD) Cogsci 8F Linear Algebra review Vectors
More informationKnowledge Discovery and Data Mining 1 (VO) ( )
Knowledge Discovery and Data Mining 1 (VO) (707.003) Review of Linear Algebra Denis Helic KTI, TU Graz Oct 9, 2014 Denis Helic (KTI, TU Graz) KDDM1 Oct 9, 2014 1 / 74 Big picture: KDDM Probability Theory
More informationLecture Notes in Linear Algebra
Lecture Notes in Linear Algebra Dr. Abdullah Al-Azemi Mathematics Department Kuwait University February 4, 2017 Contents 1 Linear Equations and Matrices 1 1.2 Matrices............................................
More informationSAMPLE OF THE STUDY MATERIAL PART OF CHAPTER 1 Introduction to Linear Algebra
1.1. Introduction SAMPLE OF THE STUDY MATERIAL PART OF CHAPTER 1 Introduction to Linear algebra is a specific branch of mathematics dealing with the study of vectors, vector spaces with functions that
More informationMatrices and Linear Algebra
Contents Quantitative methods for Economics and Business University of Ferrara Academic year 2017-2018 Contents 1 Basics 2 3 4 5 Contents 1 Basics 2 3 4 5 Contents 1 Basics 2 3 4 5 Contents 1 Basics 2
More informationLinear Systems and Matrices
Department of Mathematics The Chinese University of Hong Kong 1 System of m linear equations in n unknowns (linear system) a 11 x 1 + a 12 x 2 + + a 1n x n = b 1 a 21 x 1 + a 22 x 2 + + a 2n x n = b 2.......
More informationMatrices. Chapter Definitions and Notations
Chapter 3 Matrices 3. Definitions and Notations Matrices are yet another mathematical object. Learning about matrices means learning what they are, how they are represented, the types of operations which
More informationMath Bootcamp An p-dimensional vector is p numbers put together. Written as. x 1 x =. x p
Math Bootcamp 2012 1 Review of matrix algebra 1.1 Vectors and rules of operations An p-dimensional vector is p numbers put together. Written as x 1 x =. x p. When p = 1, this represents a point in the
More informationEE/ACM Applications of Convex Optimization in Signal Processing and Communications Lecture 2
EE/ACM 150 - Applications of Convex Optimization in Signal Processing and Communications Lecture 2 Andre Tkacenko Signal Processing Research Group Jet Propulsion Laboratory April 5, 2012 Andre Tkacenko
More informationLinear Algebra. Matrices Operations. Consider, for example, a system of equations such as x + 2y z + 4w = 0, 3x 4y + 2z 6w = 0, x 3y 2z + w = 0.
Matrices Operations Linear Algebra Consider, for example, a system of equations such as x + 2y z + 4w = 0, 3x 4y + 2z 6w = 0, x 3y 2z + w = 0 The rectangular array 1 2 1 4 3 4 2 6 1 3 2 1 in which the
More informationMath 315: Linear Algebra Solutions to Assignment 7
Math 5: Linear Algebra s to Assignment 7 # Find the eigenvalues of the following matrices. (a.) 4 0 0 0 (b.) 0 0 9 5 4. (a.) The characteristic polynomial det(λi A) = (λ )(λ )(λ ), so the eigenvalues are
More informationConceptual Questions for Review
Conceptual Questions for Review Chapter 1 1.1 Which vectors are linear combinations of v = (3, 1) and w = (4, 3)? 1.2 Compare the dot product of v = (3, 1) and w = (4, 3) to the product of their lengths.
More informationProblem Set (T) If A is an m n matrix, B is an n p matrix and D is a p s matrix, then show
MTH 0: Linear Algebra Department of Mathematics and Statistics Indian Institute of Technology - Kanpur Problem Set Problems marked (T) are for discussions in Tutorial sessions (T) If A is an m n matrix,
More informationMatrix Algebra Determinant, Inverse matrix. Matrices. A. Fabretti. Mathematics 2 A.Y. 2015/2016. A. Fabretti Matrices
Matrices A. Fabretti Mathematics 2 A.Y. 2015/2016 Table of contents Matrix Algebra Determinant Inverse Matrix Introduction A matrix is a rectangular array of numbers. The size of a matrix is indicated
More informationGraduate Mathematical Economics Lecture 1
Graduate Mathematical Economics Lecture 1 Yu Ren WISE, Xiamen University September 23, 2012 Outline 1 2 Course Outline ematical techniques used in graduate level economics courses Mathematics for Economists
More informationMATRICES AND MATRIX OPERATIONS
SIZE OF THE MATRIX is defined by number of rows and columns in the matrix. For the matrix that have m rows and n columns we say the size of the matrix is m x n. If matrix have the same number of rows (n)
More informationSAMPLE OF THE STUDY MATERIAL PART OF CHAPTER 1 Introduction to Linear Algebra
SAMPLE OF THE STUDY MATERIAL PART OF CHAPTER 1 Introduction to 1.1. Introduction Linear algebra is a specific branch of mathematics dealing with the study of vectors, vector spaces with functions that
More informationELE/MCE 503 Linear Algebra Facts Fall 2018
ELE/MCE 503 Linear Algebra Facts Fall 2018 Fact N.1 A set of vectors is linearly independent if and only if none of the vectors in the set can be written as a linear combination of the others. Fact N.2
More information2. Linear algebra. matrices and vectors. linear equations. range and nullspace of matrices. function of vectors, gradient and Hessian
FE661 - Statistical Methods for Financial Engineering 2. Linear algebra Jitkomut Songsiri matrices and vectors linear equations range and nullspace of matrices function of vectors, gradient and Hessian
More informationQuantum Computing Lecture 2. Review of Linear Algebra
Quantum Computing Lecture 2 Review of Linear Algebra Maris Ozols Linear algebra States of a quantum system form a vector space and their transformations are described by linear operators Vector spaces
More informationn n matrices The system of m linear equations in n variables x 1, x 2,..., x n can be written as a matrix equation by Ax = b, or in full
n n matrices Matrices Definitions Diagonal, Identity, and zero matrices Addition Multiplication Transpose and inverse The system of m linear equations in n variables x 1, x 2,..., x n a 11 x 1 + a 12 x
More informationMath 240 Calculus III
The Calculus III Summer 2015, Session II Wednesday, July 8, 2015 Agenda 1. of the determinant 2. determinants 3. of determinants What is the determinant? Yesterday: Ax = b has a unique solution when A
More informationUndergraduate Mathematical Economics Lecture 1
Undergraduate Mathematical Economics Lecture 1 Yu Ren WISE, Xiamen University September 15, 2014 Outline 1 Courses Description and Requirement 2 Course Outline ematical techniques used in economics courses
More informationLinear Algebra Primer
Introduction Linear Algebra Primer Daniel S. Stutts, Ph.D. Original Edition: 2/99 Current Edition: 4//4 This primer was written to provide a brief overview of the main concepts and methods in elementary
More informationIntroduction to Quantitative Techniques for MSc Programmes SCHOOL OF ECONOMICS, MATHEMATICS AND STATISTICS MALET STREET LONDON WC1E 7HX
Introduction to Quantitative Techniques for MSc Programmes SCHOOL OF ECONOMICS, MATHEMATICS AND STATISTICS MALET STREET LONDON WC1E 7HX September 2007 MSc Sep Intro QT 1 Who are these course for? The September
More informationVectors and matrices: matrices (Version 2) This is a very brief summary of my lecture notes.
Vectors and matrices: matrices (Version 2) This is a very brief summary of my lecture notes Matrices and linear equations A matrix is an m-by-n array of numbers A = a 11 a 12 a 13 a 1n a 21 a 22 a 23 a
More informationMathematical Methods wk 2: Linear Operators
John Magorrian, magog@thphysoxacuk These are work-in-progress notes for the second-year course on mathematical methods The most up-to-date version is available from http://www-thphysphysicsoxacuk/people/johnmagorrian/mm
More informationLecture 10: Determinants and Cramer s Rule
Lecture 0: Determinants and Cramer s Rule The determinant and its applications. Definition The determinant of a square matrix A, denoted by det(a) or A, is a real number, which is defined as follows. -by-
More informationMatrices Gaussian elimination Determinants. Graphics 2009/2010, period 1. Lecture 4: matrices
Graphics 2009/2010, period 1 Lecture 4 Matrices m n matrices Matrices Definitions Diagonal, Identity, and zero matrices Addition Multiplication Transpose and inverse The system of m linear equations in
More informationLinear Algebra Highlights
Linear Algebra Highlights Chapter 1 A linear equation in n variables is of the form a 1 x 1 + a 2 x 2 + + a n x n. We can have m equations in n variables, a system of linear equations, which we want to
More informationMatrices. In this chapter: matrices, determinants. inverse matrix
Matrices In this chapter: matrices, determinants inverse matrix 1 1.1 Matrices A matrix is a retangular array of numbers. Rows: horizontal lines. A = a 11 a 12 a 13 a 21 a 22 a 23 a 31 a 32 a 33 a 41 a
More informationA matrix is a rectangular array of. objects arranged in rows and columns. The objects are called the entries. is called the size of the matrix, and
Section 5.5. Matrices and Vectors A matrix is a rectangular array of objects arranged in rows and columns. The objects are called the entries. A matrix with m rows and n columns is called an m n matrix.
More informationJim Lambers MAT 610 Summer Session Lecture 1 Notes
Jim Lambers MAT 60 Summer Session 2009-0 Lecture Notes Introduction This course is about numerical linear algebra, which is the study of the approximate solution of fundamental problems from linear algebra
More information1. Linear systems of equations. Chapters 7-8: Linear Algebra. Solution(s) of a linear system of equations (continued)
1 A linear system of equations of the form Sections 75, 78 & 81 a 11 x 1 + a 12 x 2 + + a 1n x n = b 1 a 21 x 1 + a 22 x 2 + + a 2n x n = b 2 a m1 x 1 + a m2 x 2 + + a mn x n = b m can be written in matrix
More informationChapter 7. Linear Algebra: Matrices, Vectors,
Chapter 7. Linear Algebra: Matrices, Vectors, Determinants. Linear Systems Linear algebra includes the theory and application of linear systems of equations, linear transformations, and eigenvalue problems.
More informationIntroduction to Matrix Algebra
Introduction to Matrix Algebra August 18, 2010 1 Vectors 1.1 Notations A p-dimensional vector is p numbers put together. Written as x 1 x =. x p. When p = 1, this represents a point in the line. When p
More informationA matrix is a rectangular array of. objects arranged in rows and columns. The objects are called the entries. is called the size of the matrix, and
Section 5.5. Matrices and Vectors A matrix is a rectangular array of objects arranged in rows and columns. The objects are called the entries. A matrix with m rows and n columns is called an m n matrix.
More informationLinear Algebra Primer
Linear Algebra Primer D.S. Stutts November 8, 995 Introduction This primer was written to provide a brief overview of the main concepts and methods in elementary linear algebra. It was not intended to
More informationMATH 423 Linear Algebra II Lecture 33: Diagonalization of normal operators.
MATH 423 Linear Algebra II Lecture 33: Diagonalization of normal operators. Adjoint operator and adjoint matrix Given a linear operator L on an inner product space V, the adjoint of L is a transformation
More informationMassachusetts Institute of Technology Department of Economics Statistics. Lecture Notes on Matrix Algebra
Massachusetts Institute of Technology Department of Economics 14.381 Statistics Guido Kuersteiner Lecture Notes on Matrix Algebra These lecture notes summarize some basic results on matrix algebra used
More informationTaxonomy of n n Matrices. Complex. Integer. Real. diagonalizable. Real. Doubly stochastic. Unimodular. Invertible. Permutation. Orthogonal.
Doubly stochastic Taxonomy of n n Matrices Each rectangle represents one class of complex n n matrices. Arrows indicate subset relations. Classes in green are closed under multiplication. Classes in blue
More informationSymmetric and anti symmetric matrices
Symmetric and anti symmetric matrices In linear algebra, a symmetric matrix is a square matrix that is equal to its transpose. Formally, matrix A is symmetric if. A = A Because equal matrices have equal
More informationMath 102, Winter Final Exam Review. Chapter 1. Matrices and Gaussian Elimination
Math 0, Winter 07 Final Exam Review Chapter. Matrices and Gaussian Elimination { x + x =,. Different forms of a system of linear equations. Example: The x + 4x = 4. [ ] [ ] [ ] vector form (or the column
More informationNotes on Linear Algebra
1 Notes on Linear Algebra Jean Walrand August 2005 I INTRODUCTION Linear Algebra is the theory of linear transformations Applications abound in estimation control and Markov chains You should be familiar
More informationMATH 240 Spring, Chapter 1: Linear Equations and Matrices
MATH 240 Spring, 2006 Chapter Summaries for Kolman / Hill, Elementary Linear Algebra, 8th Ed. Sections 1.1 1.6, 2.1 2.2, 3.2 3.8, 4.3 4.5, 5.1 5.3, 5.5, 6.1 6.5, 7.1 7.2, 7.4 DEFINITIONS Chapter 1: Linear
More informationElementary maths for GMT
Elementary maths for GMT Linear Algebra Part 2: Matrices, Elimination and Determinant m n matrices The system of m linear equations in n variables x 1, x 2,, x n a 11 x 1 + a 12 x 2 + + a 1n x n = b 1
More information1 Determinants. 1.1 Determinant
1 Determinants [SB], Chapter 9, p.188-196. [SB], Chapter 26, p.719-739. Bellow w ll study the central question: which additional conditions must satisfy a quadratic matrix A to be invertible, that is to
More informationA = 3 B = A 1 1 matrix is the same as a number or scalar, 3 = [3].
Appendix : A Very Brief Linear ALgebra Review Introduction Linear Algebra, also known as matrix theory, is an important element of all branches of mathematics Very often in this course we study the shapes
More information(a) If A is a 3 by 4 matrix, what does this tell us about its nullspace? Solution: dim N(A) 1, since rank(a) 3. Ax =
. (5 points) (a) If A is a 3 by 4 matrix, what does this tell us about its nullspace? dim N(A), since rank(a) 3. (b) If we also know that Ax = has no solution, what do we know about the rank of A? C(A)
More informationCP3 REVISION LECTURES VECTORS AND MATRICES Lecture 1. Prof. N. Harnew University of Oxford TT 2013
CP3 REVISION LECTURES VECTORS AND MATRICES Lecture 1 Prof. N. Harnew University of Oxford TT 2013 1 OUTLINE 1. Vector Algebra 2. Vector Geometry 3. Types of Matrices and Matrix Operations 4. Determinants
More informationChapter 2:Determinants. Section 2.1: Determinants by cofactor expansion
Chapter 2:Determinants Section 2.1: Determinants by cofactor expansion [ ] a b Recall: The 2 2 matrix is invertible if ad bc 0. The c d ([ ]) a b function f = ad bc is called the determinant and it associates
More informationA VERY BRIEF LINEAR ALGEBRA REVIEW for MAP 5485 Introduction to Mathematical Biophysics Fall 2010
A VERY BRIEF LINEAR ALGEBRA REVIEW for MAP 5485 Introduction to Mathematical Biophysics Fall 00 Introduction Linear Algebra, also known as matrix theory, is an important element of all branches of mathematics
More informationEE731 Lecture Notes: Matrix Computations for Signal Processing
EE731 Lecture Notes: Matrix Computations for Signal Processing James P. Reilly c Department of Electrical and Computer Engineering McMaster University September 22, 2005 0 Preface This collection of ten
More informationLinear Algebra: Matrix Eigenvalue Problems
CHAPTER8 Linear Algebra: Matrix Eigenvalue Problems Chapter 8 p1 A matrix eigenvalue problem considers the vector equation (1) Ax = λx. 8.0 Linear Algebra: Matrix Eigenvalue Problems Here A is a given
More informationChapter 3. Matrices. 3.1 Matrices
40 Chapter 3 Matrices 3.1 Matrices Definition 3.1 Matrix) A matrix A is a rectangular array of m n real numbers {a ij } written as a 11 a 12 a 1n a 21 a 22 a 2n A =.... a m1 a m2 a mn The array has m rows
More information4. Determinants.
4. Determinants 4.1. Determinants; Cofactor Expansion Determinants of 2 2 and 3 3 Matrices 2 2 determinant 4.1. Determinants; Cofactor Expansion Determinants of 2 2 and 3 3 Matrices 3 3 determinant 4.1.
More informationLinear Algebra review Powers of a diagonalizable matrix Spectral decomposition
Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Prof. Tesler Math 283 Fall 2016 Also see the separate version of this with Matlab and R commands. Prof. Tesler Diagonalizing
More informationECON 186 Class Notes: Linear Algebra
ECON 86 Class Notes: Linear Algebra Jijian Fan Jijian Fan ECON 86 / 27 Singularity and Rank As discussed previously, squareness is a necessary condition for a matrix to be nonsingular (have an inverse).
More informationMA 1B ANALYTIC - HOMEWORK SET 7 SOLUTIONS
MA 1B ANALYTIC - HOMEWORK SET 7 SOLUTIONS 1. (7 pts)[apostol IV.8., 13, 14] (.) Let A be an n n matrix with characteristic polynomial f(λ). Prove (by induction) that the coefficient of λ n 1 in f(λ) is
More informationChapter 1. Matrix Calculus
Chapter 1 Matrix Calculus 11 Definitions and Notation We assume that the reader is familiar with some basic terms in linear algebra such as vector spaces, linearly dependent vectors, matrix addition and
More informationIntroduction to Mobile Robotics Compact Course on Linear Algebra. Wolfram Burgard, Cyrill Stachniss, Kai Arras, Maren Bennewitz
Introduction to Mobile Robotics Compact Course on Linear Algebra Wolfram Burgard, Cyrill Stachniss, Kai Arras, Maren Bennewitz Vectors Arrays of numbers Vectors represent a point in a n dimensional space
More informationALGEBRA QUALIFYING EXAM PROBLEMS LINEAR ALGEBRA
ALGEBRA QUALIFYING EXAM PROBLEMS LINEAR ALGEBRA Kent State University Department of Mathematical Sciences Compiled and Maintained by Donald L. White Version: August 29, 2017 CONTENTS LINEAR ALGEBRA AND
More informationENGI 9420 Lecture Notes 2 - Matrix Algebra Page Matrix operations can render the solution of a linear system much more efficient.
ENGI 940 Lecture Notes - Matrix Algebra Page.0. Matrix Algebra A linear system of m equations in n unknowns, a x + a x + + a x b (where the a ij and i n n a x + a x + + a x b n n a x + a x + + a x b m
More information3 Matrix Algebra. 3.1 Operations on matrices
3 Matrix Algebra A matrix is a rectangular array of numbers; it is of size m n if it has m rows and n columns. A 1 n matrix is a row vector; an m 1 matrix is a column vector. For example: 1 5 3 5 3 5 8
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY Chemistry 5.76 Revised February, 1982 NOTES ON MATRIX METHODS
MASSACHUSETTS INSTITUTE OF TECHNOLOGY Chemistry 5.76 Revised February, 198 NOTES ON MATRIX METHODS 1. Matrix Algebra Margenau and Murphy, The Mathematics of Physics and Chemistry, Chapter 10, give almost
More informationLecture Summaries for Linear Algebra M51A
These lecture summaries may also be viewed online by clicking the L icon at the top right of any lecture screen. Lecture Summaries for Linear Algebra M51A refers to the section in the textbook. Lecture
More informationReview of Linear Algebra
Review of Linear Algebra Definitions An m n (read "m by n") matrix, is a rectangular array of entries, where m is the number of rows and n the number of columns. 2 Definitions (Con t) A is square if m=
More informationMATH 106 LINEAR ALGEBRA LECTURE NOTES
MATH 6 LINEAR ALGEBRA LECTURE NOTES FALL - These Lecture Notes are not in a final form being still subject of improvement Contents Systems of linear equations and matrices 5 Introduction to systems of
More informationCayley-Hamilton Theorem
Cayley-Hamilton Theorem Massoud Malek In all that follows, the n n identity matrix is denoted by I n, the n n zero matrix by Z n, and the zero vector by θ n Let A be an n n matrix Although det (λ I n A
More informationReview of Some Concepts from Linear Algebra: Part 2
Review of Some Concepts from Linear Algebra: Part 2 Department of Mathematics Boise State University January 16, 2019 Math 566 Linear Algebra Review: Part 2 January 16, 2019 1 / 22 Vector spaces A set
More informationA Brief Outline of Math 355
A Brief Outline of Math 355 Lecture 1 The geometry of linear equations; elimination with matrices A system of m linear equations with n unknowns can be thought of geometrically as m hyperplanes intersecting
More informationLinear Algebra in Actuarial Science: Slides to the lecture
Linear Algebra in Actuarial Science: Slides to the lecture Fall Semester 2010/2011 Linear Algebra is a Tool-Box Linear Equation Systems Discretization of differential equations: solving linear equations
More informationNOTES on LINEAR ALGEBRA 1
School of Economics, Management and Statistics University of Bologna Academic Year 207/8 NOTES on LINEAR ALGEBRA for the students of Stats and Maths This is a modified version of the notes by Prof Laura
More informationAlgebra C Numerical Linear Algebra Sample Exam Problems
Algebra C Numerical Linear Algebra Sample Exam Problems Notation. Denote by V a finite-dimensional Hilbert space with inner product (, ) and corresponding norm. The abbreviation SPD is used for symmetric
More informationUnit 3: Matrices. Juan Luis Melero and Eduardo Eyras. September 2018
Unit 3: Matrices Juan Luis Melero and Eduardo Eyras September 2018 1 Contents 1 Matrices and operations 4 1.1 Definition of a matrix....................... 4 1.2 Addition and subtraction of matrices..............
More informationMATRICES The numbers or letters in any given matrix are called its entries or elements
MATRICES A matrix is defined as a rectangular array of numbers. Examples are: 1 2 4 a b 1 4 5 A : B : C 0 1 3 c b 1 6 2 2 5 8 The numbers or letters in any given matrix are called its entries or elements
More informationTheorem A.1. If A is any nonzero m x n matrix, then A is equivalent to a partitioned matrix of the form. k k n-k. m-k k m-k n-k
I. REVIEW OF LINEAR ALGEBRA A. Equivalence Definition A1. If A and B are two m x n matrices, then A is equivalent to B if we can obtain B from A by a finite sequence of elementary row or elementary column
More information1 Linear Algebra Problems
Linear Algebra Problems. Let A be the conjugate transpose of the complex matrix A; i.e., A = A t : A is said to be Hermitian if A = A; real symmetric if A is real and A t = A; skew-hermitian if A = A and
More informationa 11 a 12 a 11 a 12 a 13 a 21 a 22 a 23 . a 31 a 32 a 33 a 12 a 21 a 23 a 31 a = = = = 12
24 8 Matrices Determinant of 2 2 matrix Given a 2 2 matrix [ ] a a A = 2 a 2 a 22 the real number a a 22 a 2 a 2 is determinant and denoted by det(a) = a a 2 a 2 a 22 Example 8 Find determinant of 2 2
More information= 1 and 2 1. T =, and so det A b d
Chapter 8 Determinants The founder of the theory of determinants is usually taken to be Gottfried Wilhelm Leibniz (1646 1716, who also shares the credit for inventing calculus with Sir Isaac Newton (1643
More informationElementary Row Operations on Matrices
King Saud University September 17, 018 Table of contents 1 Definition A real matrix is a rectangular array whose entries are real numbers. These numbers are organized on rows and columns. An m n matrix
More information