Matrix Algebra Review
|
|
- Quentin Cummings
- 5 years ago
- Views:
Transcription
1 APPENDIX A Matrix Algebra Review This appendix presents some of the basic definitions and properties of matrices. Many of the matrices in the appendix are named the same as the matrices that appear in the book's notation. I do this so that readers may become more familiar with the structural equation notation at the same time they are reviewing matrix algebra. Those wishing a more detailed treatment of matrices should refer to Lunneborg and Abbott (1983), Searle (1982), Graybill (1983), or Hadley (1961). SCALARS, VECTORS, AND MATRICES A basic distinction is that between scalars, vectors, and matrices. A single element, value, or quantity is referred to as a scalar. For instance, the covariance between Xl and X 2, COV(x l, x 2 ), is a scalar, as is the number 5 and the regression coefficient 13 21, When two or more scalars are written in a row or a column, they form a row or column vector. The order of a row vector is 1 X c, where the 1 indicates one row and c is the number of columns (elements); the order of a column vector is r X 1. Three examples of vectors are a'=[l 4 5 2], f' = ["'Ill "'I2I] Boldface print shows that a symbol (e.g., E) refers to a vector (or matrix) rather than a scalar. In the preceding examples E is a 3 X 1 column vector and a' and f' are row vectors of orders 1 X 4 and 1 X 2, respectively. The prime superscript distinguishes row vectors (e.g., a') from column vectors 449
2 450 MATRIX ALGEBRA REVIEW (e.g., E). The prime stands for the transpose operator, which I will define later. A matrix is a group of elements arranged into rows and columns. Matrices also are represented by boldface symbols. The order of a matrix is indicated by r X c, where r is the number of rows and c is the number of columns. The order r X c also is the dimension of the matrix. As examples, consider The dimension of S is 2 X 2, whereas r is a 3 X 2 matrix. Vectors and scalars are special cases of matrices. A row vector is a 1 X c matrix, a column vector is an r X 1 matrix, and a scalar is a 1 X 1 matrix. Two matrices, say Sand T, are equal if they are of the same order and if every element Si} of S equals the corresponding element til of T for all i's and j's. For instance, here Sand T are equal, but Sand T* are not: S=T T* = S '" T*, for S21 '" 0 MATRIX OPERA nons To add two or more matrices, they must be of the same dimension or order. The resulting matrix is of the same order, with each element equal to the sum of the corresponding elements in each of the matrices added together. For instance, I = [~ n B+I= f3n + 1 [ f321 f312 ] f
3 MATRIX OPERATIONS 451 Two useful properties of matrix addition, for any matrices S, T, and U of the same order, are as follows: 1. S + T = T + S. 2. (S + T) + U = S + (T + U). Two matrices can be multiplied only when the number of columns in the first matrix equals the number of rows in the second matrix. If this condition is met the matrices are said to be conformable with respect to multiplication. If the first matrix has order a X b and the second matrix has order b X c, then the resulting product of these two matrices is a matrix of order a X c. The ij element of the product matrix is derived by multiplying the elements of the ith row of the first matrix by the corresponding elements of the Jth column of the second matrix and summing all terms. Consider two matrices Sand T of orders a X band b X c, respectively: I Sll S12 SIb S21 S22 S2b Sal Sa2 Sub S T tll t12 tie t 21 t22 t2c t ~l tb2 t~c U = l"b U 12 U 2l U 22 U al U a2 To form the matrix product of S times T, labeled U, start with the first row of S, which is enclosed in a box. Each element in this row is multiplied by the corresponding element in the first column of T, which is also enclosed in a box. The sum of these b products equals Ull of U. In other words Ull = Slltll + S12t2l Slbtblo This may be stated more generally as u ij = b L Siktkj k~l for each element of U.
4 452 MATRIX ALGEBRA REVIEW For example, B+~' H "~ [::] f X 3 3 xl [ fin"' 1 B'I'] = f321y/1 ~ f J 3 x I (The term B'I'] appears in the latent variable model.) Some properties of matrix multiplication for any matrices S, T, and U that are conformable are as follows: 1. ST 4= TS (except in special cases). 2. (ST)U = S(TU). 3. S(T + U) = ST + Su. 4. c(s + T) = cs + ct (where c is a scalar). These properties come into play at many points throughout the book. The order in which matrices are multiplied is important. For this reason premultiplication and postmultiplication by a matrix are distinguished. For instance, if U = ST, we can say that U results from the premultiplication of T by S or the postmultiplication of S by T. The transpose of a matrix interchanges its rows and columns. The transpose of a matrix is indicated by a prime (') symbol following the matrix. As an example, consider f and f/: f' = [Yll o 2 X 3 The first row of f is the first column of f/, the second row is the second column, and the third row is the third column. The order of f is 3 X 2, whereas the order of f' is 2 X 3. The transpose of an a X b order matrix leads to a b X a matrix.
5 MATRIX OPERATIONS 453 Some useful properties of the transpose operator are listed below: 1. (S')' = S. 2. (S + T)' = S' + T' (where Sand T have the same order). 3. (ST)' = T'S' (where matrices are conformable for multiplication). 4. (STU)' = U'T'S' (where matrices are conformable for multiplication). Some additional matrix types and matrix operations are important for square matrices. A square matrix is a matrix that has the same number of rows and columns. An example of a square matrix is Yll r= 0 [ o o Y22 Y32 The dimension of the r matrix is 3 X 3. The trace is defined for a square matrix. It is the sum of the elements on the main diagonal. For an n X n matrix S, tr(s) = " L Sii i~l Properties of the trace include: 1. tr(s) = tr(s'). 2. tr(st) = tr(ts) (if T and S conform for multiplication). 3. tr(s + T) = tr(s) + tr(t) (if Sand T conform for addition). The trace appears in the fitting functions and indices of goodness of fit for many structural equation techniques. If all the elements above (or below) the main diagonal of a square matrix are zero, the matrix is triangular. For instance, the B matrix for recursive models (which I discuss in Chapter 4) may be written as a triangular matrix. The B matrix contains the coefficients of the effects of the endogenous latent variables on one another. To illustrate, one such B matrix is ~l
6 454 MATRIX ALGEBRA REVIEW Note that in this case the main diagonal elements are zero. However, triangular matrices may have nonzero entries in the main diagonal. A diagonal matrix is a square matrix that has some nonzero elements along the main diagonal and zeros elsewhere. For instance, 8 0, the covariance matrix (see Chapter 2), of the errors of measurement for the X variables, commonly is assumed to be diagonal. For 8 1, 8 2, and 8 3, the population covariance matrix 8 0 might look as follows: The zeros above and below the main diagonal represent the assumption that the errors of measurement for different variables are uncorrelated. A symmetric matrix is a square matrix that equals its transpose (e.g., S = S'). The typical correlation and covariance matrices are symmetric since the ij element equals the ji element. For instance, COV(X1' x 2 ) VAR(x 2 ) COV(X3' x 2 ) For all the variables, the covariance of Xi and Xj equals the covariance of Xj and Xi' Sometimes symmetric matrices, such as ~, are written with blanks above the main diagonal because these terms are redundant. An identity matrix, I, is a square matrix with ones down the main diagonal and zeros elsewhere. The 3 X 3 identity matrix is o o 1 Properties of the identity matrix, I, include the following: 1. IS = SI = S (for any I and S conformable for multiplication). 2. I = I'.
7 MATRIX OPERATIONS 455 A vector that consists of all ones is a unit vector: l' = [1 1 1 ] Unit vector products have some interesting properties. If you premultiply a matrix by a conformable unit vector, the result is a row vector whose elements are the column sums of the matrix. For example, Postmultiplying a matrix by a conforming unit vector leads to a column vector of row sums: Finally, if we both premultiply and postmultiply a matrix by conforming unit vectors, a scalar that equals the sum of all the matrix elements results: U sing unit vectors and some of the other matrix properties, we can compute the covariance matrix. Consider X an N X P matrix of N observations for p variables. The 1 X P row vector of means for X is formed as The deviation form of X requires subtracting from X a matrix whose columns consist of N X 1 vectors of the means for the corresponding variables in X. So every element in the first column equals the mean of the first variable in X, every element in the second column equals the mean of
8 456 MATRIX ALGEBRA REVIEW the second column of X, and so on. This matrix of means is l( ~ )l'x which, when subtracted from X, forms deviation from the mean scores: X-l(~)l'X If the preceding deviation score matrix is represented by Z, then the p X P unbiased sample covariance matrix estimator S is S = ( 1 (N - 1) )Z'Z A numerical example illustrates these calculations: 3 1 l-~ -1 0 X= 4 ~j ( ~ ) l'x = (±)[ l(~)n~ Do 2 l]l-~ 1) ~ l~ Z = X - l( ~ )lfx = l -~ i j j ~ ~ [0 jj 2 cov(x 1, x 2 ) var( x 2 ) 1 ] cov(x 1, x 3 ) j COV(X2' x 3 ) COV(X3' x 2 ) var( x 3 )
9 MATRIX OPERATIONS 457 The last line is the unbiased sample covariance matrix and contains the variances of the variables in the main diagonal and the covariances of all pairs of variables in the off-diagonal elements. All covariance matrices are square and symmetric. Suppose that I form a diagonal matrix from the main diagonal of S: where var(x;) represents the sample variance of Xi' The square root of D, represented as Dl/2, has standard deviations in its diagonal: f [Var(Xl)]1/2 Dl/2 = 0 o and D ~ 1/2 has the inverse of the standard deviations in its main diagonal. If S is postmultiplied by D ~ 1/ 2, the first column is divided by the standard deviation of Xl' the second column is divided by the standard deviation of X 2, and the third column is divided by the standard deviation of X3: SD~1/2 = [var(x l )]1/2 COV(X2' Xl) [var(xl)]1/2 COV(Xl' x 2 ) [var( X ) ]1/2 2 [var(x 2 ) ]1/2 COV(X3' Xl) COV(X3' X 2 ) [var(xl)] 1/2 [var(x 2 )]1/2 COV(Xl' x 3 ) [var(x3)]1/2 COV(X2' X 3 ) [var(x3)]1/2 [var( X 3 ) r/ 2 Premultiplying SD~1/2 by D~1/2 leads to cov( XI' X2) [var( XI )var( X2)] 1/2 [var( XI )var( Xl)] 1/2 cov(x2' Xl) [var( X2 )var( XI)] 1/2 [var( X2 )var( Xl) ]1/2 cov( Xl' XI) [ var( Xl )var( X 2 )] 1/2
10 458 MATRIX ALGEBRA REVIEW The resulting matrix is the sample correlation matrix with the off-diagonal elements equal to the correlations of the Xi and xi variables. These results generalize to any dimension matrix. If the covariance matrix S is pre- and postmultiplied by 0-1 / 2, where 0-1 / 2 is the diagonal matrix with the standard deviations of x in its diagonal, then the resulting matrix is the sample correlation matrix. The nonnegative integer power of square matrices occurs in the decomposition of effects in path analysis. It is defined as the number of times a matrix is multiplied by itself. For instance, For any square matrix, S, a scalar quantity exists called the determinant of S, represented as I S I or det S. In the case of a 2 X 2 matrix the determinant is If S is a 3 X 3 matrix, the determinant is Sll S12 s13 S21 S22 S23 = SllS22S 33 - S12S 21 S 33 + S12 S 23 S 31 - S13S22S31 S31 S32 S33 As the order of S increases, the formula for the determinant becomes more complicated. There is a general rule for calculating determinants for a square matrix of any order. To explain this rule, the concepts of a minor and a cofactor need to be defined. The minor of a matrix is the determinant of the matrix obtained when the ith row and Jth column of a matrix are removed. Consider the following matrix S:
11 MATRIX OPERATIONS 459 The minor with respect to Sll' represented as I Sll I, is The minor of S22 is The cofactor of the element s;) is defined as (-1);+) times the minor of s;)' The cofactors of each element of matrix S placed in the appropriate ijth location creates a new matrix: -ISd + IS 221 -ISd The determinant of a matrix can be found by multiplying each element in any given row (column) in the S matrix by the corresponding cofactor in the preceding matrix. This is then summed over all elements in the row (column). For example, if we do this for the first row of S, we obtain -S12(.S21S33 - S23S 31) +S13(S21S32 - S22s 31) = SllS22S 33 - Slls23s 32 -S12 S 21S 33 + S12 S 23 S 31 +S13S 21 S 32 - s13 s 22S 31 = Slls22s 33 - S12S 21 S 33 +S12 S 23 S 31 - s13s 22 s 31 +S13S 21S 32 - slls23s 32 Note that this formula is identical to the earlier formula for the determinant
12 460 MATRIX ALGEBRA REVIEW of a 3 X 3 matrix. Slightly different arrangements of terms occur depending on the row or column selected for expansion. However, regardless of which formula is chosen, the determinant will be the same. Useful properties of the determinant for square and conformable Sand T and a scalar c include: 1. IS'I = lsi. 2. If S = ct, then I S I = cql T I (where q is the order of S). 3. If S has two identical rows (or columns), lsi = O. 4. ISTI = ISIITI. The determinant appears in the fitting functions for the estimators of structural equations. It also is useful in finding the rank and inverse of matrices. The inverse of a square matrix S is that matrix S -1 that, when S is preor postmultiplied by S - \ produces the identity matrix, I: SS-1 = S-1S = I The inverse of a matrix is calculated from the adjoint and the determinant of a matrix. The adjoint of a matrix is the transpose of the matrix of co factors defined earlier. Using the 3 X 3 S matrix, the adjoint of S is The inverse matrix is adjs = [ + ISul -ISui + IS 131 -IS211 + IS 221 -IS231 1 S-1 = -(adj S) lsi To illustrate the calculation of the inverse, consider the simple case of a two-variable covariance matrix: S = [20 10] lsi = (20)(20) - (10)(10) = = Matrix of cofactors of S = [ ] 20. [20 ad] S = ] 20
13 MATRIX OPERATIONS 461 (The adjoint of a symmetric matrix of co factors equals the matrix of cofactors.) S -1 1 [ 20 = ] 20 Multiplying S -1 by S yields a 2 X 2 identity matrix. Note that the inverse S -1 does not exist if I S I = O. If a matrix has a zero determinant, it is called a singular matrix. Two properties of inverses for conformable square matrices S, T, and U are the following: 1. (S,)-1 = (S-1),. 2. (ST)-1 = T-1S-1; (STU)-1 = U- 1 T- 1 S-1. In manipulating the latent variable equations, we sometimes need to take inverses. In addition the inverse appears in explanations of the fitting functions and in several other topics. Another important property of a matrix is its rank. The rank of a matrix, S, is the maximum number of independent columns or rows of S, where S is any a X b order matrix. Another way to define the rank is as the order of the largest square submatrix of S whose determinant is nonzero. The properties of ranks for matrices Sand T include the following: 1. rank(s) ~ min(a, b), where a is the number of rows, b is the number of columns. 2. rank(st) ~ min[rank(s), rank(t)]. The rank of matrices appears in the discussion of identification of models in Chapter 4. Eigenvalues and eigenvectors are important characteristics of square matrices. If a vector u =1= 0, a scalar e, and an n X n matrix S exist such that Su = eu then u is an eigenvector and e is an eigenvalue of S. The eigenvectors and eigenvalues are sometimes referred to as latent vectors and latent values, or characteristic vectors and characteristic roots. (Often such an equation is represented as Ax = M. I depart from this practice so that ),. is not confused with the factor loadings which use the same symbol.)
14 462 MATRIX ALGEBRA REVIEW The preceding equation may be rewritten as Su - eu = 0 (S - el)u = 0 Only if (S - e I) is singular, does a nontrivial solutiod for this equation exist. If (S - e I) is singular, then IS - ell = 0 Solving this equation for e provides the eigenvalues. To illustrate, suppose that S is a 2 x 2 correlation matrix: S = [ ] 1.00 The (S - el) matrix is S _ I = [ e e ] e The determinant is IS - ell = ( e) = e 2-2e The two solutions for e, 1.5 and 0.5, are the eigenvalues for this 2 X 2 correlation matrix. Each eigenvalue, e, has a set of eigenvectors, u, associated with it. For example, the e of 1.5 leads to the following: (S - el)u = e [ ]/ U 1 ] _ e. U2 [ ] [ U l ] = _ u u l u2 = u l u2 = 0 la trivial solution for e would exist if u = O. As specified here, I assume that u is a nonzero vector.
15 MATRIX OPERATIONS 463 From this you can see that u 1 = u 2 and that an infinite set of values would work as the eigenvector for the eigenvalue of 1.5. Though the eigenvalues for the preceding example and for all real symmetric matrices are real numbers, this need not be true for nonsymmetric matrices. When the eigenvalue is a complex number, say z = a + ib, where a and b are real constants and i = Ff, we commonly refer to the modulus or norm of z which is (a 2 + b 2 )1/2. Some useful properties of the eigenvalues for a symmetric or nonsymmetric square matrix S are 1. A b X b matrix S has b eigenvalues (some may take the same value). 2. The product of all eigenvalues for S equals 1 S I. 3. The number of nonzero eigenvalues of S equals the rank of S. 4. The sum of the eigenvalues of S equals the tr S. Eigenvalue and eigenvectors playa large role in traditional factor analyses. In this book they are useful in the decomposition of effects in path analysis discussed in Chapter 8. Quadratic forms are represented by which equals x'sx (1 X b)(b X b)(b Xl) LX;S;; + L LX;Xj(s;j + Sj;) j >i Usually S for a quadratic form is a symmetric matrix so that x'sx = LX;s;; + 2L LXiXjS;j j >i Quadratic forms result in a scalar. S is positive-definite if x'sx is positive for all nonzero x vectors. If this quadratic form is nonnegative for all nonzero x, then S is positive-semidefinite. The eigenvalues of a positive definite matrix are all positive. If S is positive-definite, then S is nonsingular. The eigenvalues of a positive semidefinite matrix are positive or zero. Negative-definite and negative-semidefinite have analogous definitions and properties.
16 464 MATRIX ALGEBRA REVIEW Occasionally, structural equation models analyzed with the LISREL program (Joreskog and Sorbom 1984) may report that a matrix is not posi ti ve-defini teo For instance, suppose that we analyze the following sample covariance matrix S: S is not positive-definite, since x'sx is zero for some x =1= (e.g., x' = [ D. Indeed, S is singular (I S I = 0), and singular matrices are not positive-definite. Consider the following three matrices: [23 31] [-2 1 1] [0 0] Assume that these are estimates of the covariance matrix of the disturbances from two equations. None is positive-definite. The failure of the first two to be positive-definite indicates a problem. In the first case the covariance (= 3) and variances (2 and 1) imply an impossible correlation value (= 3/ Ii). The middle matrix has an impossible negative disturbance variance (= - 2). Whether the nonpositive definite nature of the last matrix is troublesome depends on whether the variance of the first disturbance should be zero. Identity relations (e.g., 111 = ) or when measurement error is absent (e.g., Xl = ~l) are two situations where zero disturbance variances make sense. However, when zero is not a plausible value, then the analyst must determine the source of this improbable value. The vec operator is the operation of forming a vector from a matrix by stacking each column of a matrix one under the other. For instance: J /312] = [/3~1 1 /312 1 The vec operator appears in Chapter 8.
17 MATRIX OPERATIONS 465 A Kronecker product (or a direct product) of two matrices, S( p X q) and T( m X n), is defined as Each element of the left matrix, S, is multiplied by T to form a submatrix Sij T. All of these submatrices combined result in a pm X qn matrix. An example is: ] [ 1 f3 12 Y12 ] [Yll = f321 1 Yu f3 21 Y12f3 12 ] Y12 Kronecker's products appear in the formulas for the asymptotic standard errors of indirect effects in Chapter 8.
MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 1 x 2. x n 8 (4) 3 4 2
MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS SYSTEMS OF EQUATIONS AND MATRICES Representation of a linear system The general system of m equations in n unknowns can be written a x + a 2 x 2 + + a n x n b a
More information1 Determinants. 1.1 Determinant
1 Determinants [SB], Chapter 9, p.188-196. [SB], Chapter 26, p.719-739. Bellow w ll study the central question: which additional conditions must satisfy a quadratic matrix A to be invertible, that is to
More informationDo not copy, quote, or cite without permission LECTURE 4: THE GENERAL LISREL MODEL
LECTURE 4: THE GENERAL LISREL MODEL I. QUICK REVIEW OF A LITTLE MATRIX ALGEBRA. II. A SIMPLE RECURSIVE MODEL IN LATENT VARIABLES. III. THE GENERAL LISREL MODEL IN MATRIX FORM. A. SPECIFYING STRUCTURAL
More informationIntroduction to Matrices
214 Analysis and Design of Feedback Control Systems Introduction to Matrices Derek Rowell October 2002 Modern system dynamics is based upon a matrix representation of the dynamic equations governing the
More informationChapter 3. Determinants and Eigenvalues
Chapter 3. Determinants and Eigenvalues 3.1. Determinants With each square matrix we can associate a real number called the determinant of the matrix. Determinants have important applications to the theory
More informationLinear Algebra. The analysis of many models in the social sciences reduces to the study of systems of equations.
POLI 7 - Mathematical and Statistical Foundations Prof S Saiegh Fall Lecture Notes - Class 4 October 4, Linear Algebra The analysis of many models in the social sciences reduces to the study of systems
More informationA Little Necessary Matrix Algebra for Doctoral Studies in Business & Economics. Matrix Algebra
A Little Necessary Matrix Algebra for Doctoral Studies in Business & Economics James J. Cochran Department of Marketing & Analysis Louisiana Tech University Jcochran@cab.latech.edu Matrix Algebra Matrix
More informationReview of Vectors and Matrices
A P P E N D I X D Review of Vectors and Matrices D. VECTORS D.. Definition of a Vector Let p, p, Á, p n be any n real numbers and P an ordered set of these real numbers that is, P = p, p, Á, p n Then P
More informationMath Bootcamp An p-dimensional vector is p numbers put together. Written as. x 1 x =. x p
Math Bootcamp 2012 1 Review of matrix algebra 1.1 Vectors and rules of operations An p-dimensional vector is p numbers put together. Written as x 1 x =. x p. When p = 1, this represents a point in the
More informationAppendix A: Matrices
Appendix A: Matrices A matrix is a rectangular array of numbers Such arrays have rows and columns The numbers of rows and columns are referred to as the dimensions of a matrix A matrix with, say, 5 rows
More informationChapter 2:Determinants. Section 2.1: Determinants by cofactor expansion
Chapter 2:Determinants Section 2.1: Determinants by cofactor expansion [ ] a b Recall: The 2 2 matrix is invertible if ad bc 0. The c d ([ ]) a b function f = ad bc is called the determinant and it associates
More informationReview of Linear Algebra
Review of Linear Algebra Definitions An m n (read "m by n") matrix, is a rectangular array of entries, where m is the number of rows and n the number of columns. 2 Definitions (Con t) A is square if m=
More informationECON 186 Class Notes: Linear Algebra
ECON 86 Class Notes: Linear Algebra Jijian Fan Jijian Fan ECON 86 / 27 Singularity and Rank As discussed previously, squareness is a necessary condition for a matrix to be nonsingular (have an inverse).
More informationLinear Systems and Matrices
Department of Mathematics The Chinese University of Hong Kong 1 System of m linear equations in n unknowns (linear system) a 11 x 1 + a 12 x 2 + + a 1n x n = b 1 a 21 x 1 + a 22 x 2 + + a 2n x n = b 2.......
More informationBare minimum on matrix algebra. Psychology 588: Covariance structure and factor models
Bare minimum on matrix algebra Psychology 588: Covariance structure and factor models Matrix multiplication 2 Consider three notations for linear combinations y11 y1 m x11 x 1p b11 b 1m y y x x b b n1
More informationChapter 4 - MATRIX ALGEBRA. ... a 2j... a 2n. a i1 a i2... a ij... a in
Chapter 4 - MATRIX ALGEBRA 4.1. Matrix Operations A a 11 a 12... a 1j... a 1n a 21. a 22.... a 2j... a 2n. a i1 a i2... a ij... a in... a m1 a m2... a mj... a mn The entry in the ith row and the jth column
More informationEquality: Two matrices A and B are equal, i.e., A = B if A and B have the same order and the entries of A and B are the same.
Introduction Matrix Operations Matrix: An m n matrix A is an m-by-n array of scalars from a field (for example real numbers) of the form a a a n a a a n A a m a m a mn The order (or size) of A is m n (read
More informationPOLI270 - Linear Algebra
POLI7 - Linear Algebra Septemer 8th Basics a x + a x +... + a n x n b () is the linear form where a, b are parameters and x n are variables. For a given equation such as x +x you only need a variable and
More informationc c c c c c c c c c a 3x3 matrix C= has a determinant determined by
Linear Algebra Determinants and Eigenvalues Introduction: Many important geometric and algebraic properties of square matrices are associated with a single real number revealed by what s known as the determinant.
More informationMathematics. EC / EE / IN / ME / CE. for
Mathematics for EC / EE / IN / ME / CE By www.thegateacademy.com Syllabus Syllabus for Mathematics Linear Algebra: Matrix Algebra, Systems of Linear Equations, Eigenvalues and Eigenvectors. Probability
More informationLemma 8: Suppose the N by N matrix A has the following block upper triangular form:
17 4 Determinants and the Inverse of a Square Matrix In this section, we are going to use our knowledge of determinants and their properties to derive an explicit formula for the inverse of a square matrix
More informationChapter 4. Determinants
4.2 The Determinant of a Square Matrix 1 Chapter 4. Determinants 4.2 The Determinant of a Square Matrix Note. In this section we define the determinant of an n n matrix. We will do so recursively by defining
More informationTheorem A.1. If A is any nonzero m x n matrix, then A is equivalent to a partitioned matrix of the form. k k n-k. m-k k m-k n-k
I. REVIEW OF LINEAR ALGEBRA A. Equivalence Definition A1. If A and B are two m x n matrices, then A is equivalent to B if we can obtain B from A by a finite sequence of elementary row or elementary column
More informationMatrix Algebra Determinant, Inverse matrix. Matrices. A. Fabretti. Mathematics 2 A.Y. 2015/2016. A. Fabretti Matrices
Matrices A. Fabretti Mathematics 2 A.Y. 2015/2016 Table of contents Matrix Algebra Determinant Inverse Matrix Introduction A matrix is a rectangular array of numbers. The size of a matrix is indicated
More information4. Determinants.
4. Determinants 4.1. Determinants; Cofactor Expansion Determinants of 2 2 and 3 3 Matrices 2 2 determinant 4.1. Determinants; Cofactor Expansion Determinants of 2 2 and 3 3 Matrices 3 3 determinant 4.1.
More informationLinear Algebra. James Je Heon Kim
Linear lgebra James Je Heon Kim (jjk9columbia.edu) If you are unfamiliar with linear or matrix algebra, you will nd that it is very di erent from basic algebra or calculus. For the duration of this session,
More information1300 Linear Algebra and Vector Geometry
1300 Linear Algebra and Vector Geometry R. Craigen Office: MH 523 Email: craigenr@umanitoba.ca May-June 2017 Matrix Inversion Algorithm One payoff from this theorem: It gives us a way to invert matrices.
More informationGraduate Mathematical Economics Lecture 1
Graduate Mathematical Economics Lecture 1 Yu Ren WISE, Xiamen University September 23, 2012 Outline 1 2 Course Outline ematical techniques used in graduate level economics courses Mathematics for Economists
More informationUndergraduate Mathematical Economics Lecture 1
Undergraduate Mathematical Economics Lecture 1 Yu Ren WISE, Xiamen University September 15, 2014 Outline 1 Courses Description and Requirement 2 Course Outline ematical techniques used in economics courses
More informationA Review of Matrix Analysis
Matrix Notation Part Matrix Operations Matrices are simply rectangular arrays of quantities Each quantity in the array is called an element of the matrix and an element can be either a numerical value
More informationMath Camp Lecture 4: Linear Algebra. Xiao Yu Wang. Aug 2010 MIT. Xiao Yu Wang (MIT) Math Camp /10 1 / 88
Math Camp 2010 Lecture 4: Linear Algebra Xiao Yu Wang MIT Aug 2010 Xiao Yu Wang (MIT) Math Camp 2010 08/10 1 / 88 Linear Algebra Game Plan Vector Spaces Linear Transformations and Matrices Determinant
More informationLecture 7. Econ August 18
Lecture 7 Econ 2001 2015 August 18 Lecture 7 Outline First, the theorem of the maximum, an amazing result about continuity in optimization problems. Then, we start linear algebra, mostly looking at familiar
More informationMatrix Algebra. Matrix Algebra. Chapter 8 - S&B
Chapter 8 - S&B Algebraic operations Matrix: The size of a matrix is indicated by the number of its rows and the number of its columns. A matrix with k rows and n columns is called a k n matrix. The number
More information(b) If a multiple of one row of A is added to another row to produce B then det(b) =det(a).
.(5pts) Let B = 5 5. Compute det(b). (a) (b) (c) 6 (d) (e) 6.(5pts) Determine which statement is not always true for n n matrices A and B. (a) If two rows of A are interchanged to produce B, then det(b)
More informationLinear Algebra. Matrices Operations. Consider, for example, a system of equations such as x + 2y z + 4w = 0, 3x 4y + 2z 6w = 0, x 3y 2z + w = 0.
Matrices Operations Linear Algebra Consider, for example, a system of equations such as x + 2y z + 4w = 0, 3x 4y + 2z 6w = 0, x 3y 2z + w = 0 The rectangular array 1 2 1 4 3 4 2 6 1 3 2 1 in which the
More informationLinear Algebra: Lecture notes from Kolman and Hill 9th edition.
Linear Algebra: Lecture notes from Kolman and Hill 9th edition Taylan Şengül March 20, 2019 Please let me know of any mistakes in these notes Contents Week 1 1 11 Systems of Linear Equations 1 12 Matrices
More informationELE/MCE 503 Linear Algebra Facts Fall 2018
ELE/MCE 503 Linear Algebra Facts Fall 2018 Fact N.1 A set of vectors is linearly independent if and only if none of the vectors in the set can be written as a linear combination of the others. Fact N.2
More informationReview problems for MA 54, Fall 2004.
Review problems for MA 54, Fall 2004. Below are the review problems for the final. They are mostly homework problems, or very similar. If you are comfortable doing these problems, you should be fine on
More informationChapter 3 Transformations
Chapter 3 Transformations An Introduction to Optimization Spring, 2014 Wei-Ta Chu 1 Linear Transformations A function is called a linear transformation if 1. for every and 2. for every If we fix the bases
More information1 Matrices and Systems of Linear Equations. a 1n a 2n
March 31, 2013 16-1 16. Systems of Linear Equations 1 Matrices and Systems of Linear Equations An m n matrix is an array A = (a ij ) of the form a 11 a 21 a m1 a 1n a 2n... a mn where each a ij is a real
More informationMatrices A brief introduction
Matrices A brief introduction Basilio Bona DAUIN Politecnico di Torino Semester 1, 2014-15 B. Bona (DAUIN) Matrices Semester 1, 2014-15 1 / 41 Definitions Definition A matrix is a set of N real or complex
More informationMATRICES. knowledge on matrices Knowledge on matrix operations. Matrix as a tool of solving linear equations with two or three unknowns.
MATRICES After studying this chapter you will acquire the skills in knowledge on matrices Knowledge on matrix operations. Matrix as a tool of solving linear equations with two or three unknowns. List of
More informationEE731 Lecture Notes: Matrix Computations for Signal Processing
EE731 Lecture Notes: Matrix Computations for Signal Processing James P. Reilly c Department of Electrical and Computer Engineering McMaster University September 22, 2005 0 Preface This collection of ten
More informationMatrix & Linear Algebra
Matrix & Linear Algebra Jamie Monogan University of Georgia For more information: http://monogan.myweb.uga.edu/teaching/mm/ Jamie Monogan (UGA) Matrix & Linear Algebra 1 / 84 Vectors Vectors Vector: A
More informationMatrices and Determinants
Chapter1 Matrices and Determinants 11 INTRODUCTION Matrix means an arrangement or array Matrices (plural of matrix) were introduced by Cayley in 1860 A matrix A is rectangular array of m n numbers (or
More informationNumerical Linear Algebra Homework Assignment - Week 2
Numerical Linear Algebra Homework Assignment - Week 2 Đoàn Trần Nguyên Tùng Student ID: 1411352 8th October 2016 Exercise 2.1: Show that if a matrix A is both triangular and unitary, then it is diagonal.
More informationIntroduction to Matrix Algebra
Introduction to Matrix Algebra August 18, 2010 1 Vectors 1.1 Notations A p-dimensional vector is p numbers put together. Written as x 1 x =. x p. When p = 1, this represents a point in the line. When p
More informationLinear Equations in Linear Algebra
1 Linear Equations in Linear Algebra 1.7 LINEAR INDEPENDENCE LINEAR INDEPENDENCE Definition: An indexed set of vectors {v 1,, v p } in n is said to be linearly independent if the vector equation x x x
More informationIntroduction to Determinants
Introduction to Determinants For any square matrix of order 2, we have found a necessary and sufficient condition for invertibility. Indeed, consider the matrix The matrix A is invertible if and only if.
More informationLecture Notes in Linear Algebra
Lecture Notes in Linear Algebra Dr. Abdullah Al-Azemi Mathematics Department Kuwait University February 4, 2017 Contents 1 Linear Equations and Matrices 1 1.2 Matrices............................................
More informationFundamentals of Engineering Analysis (650163)
Philadelphia University Faculty of Engineering Communications and Electronics Engineering Fundamentals of Engineering Analysis (6563) Part Dr. Omar R Daoud Matrices: Introduction DEFINITION A matrix is
More informationEIGENVALUES AND EIGENVECTORS 3
EIGENVALUES AND EIGENVECTORS 3 1. Motivation 1.1. Diagonal matrices. Perhaps the simplest type of linear transformations are those whose matrix is diagonal (in some basis). Consider for example the matrices
More informationAPPENDIX A. Matrix Algebra. a n1 a n2 g a nk
APPENDIX A Matrix Algebra A.1 TERMINOLOGY A matrix is a rectangular array of numbers, denoted a 11 a 12 g a 1K a A = [a ik ] = [A] ik = D 21 a 22 g a 2K T. g a n1 a n2 g a nk (A-1) The typical element
More informationIntroduction to Matrices
POLS 704 Introduction to Matrices Introduction to Matrices. The Cast of Characters A matrix is a rectangular array (i.e., a table) of numbers. For example, 2 3 X 4 5 6 (4 3) 7 8 9 0 0 0 Thismatrix,with4rowsand3columns,isoforder
More informationChapter 1. Matrix Algebra
ST4233, Linear Models, Semester 1 2008-2009 Chapter 1. Matrix Algebra 1 Matrix and vector notation Definition 1.1 A matrix is a rectangular or square array of numbers of variables. We use uppercase boldface
More information1 Multiply Eq. E i by λ 0: (λe i ) (E i ) 2 Multiply Eq. E j by λ and add to Eq. E i : (E i + λe j ) (E i )
Direct Methods for Linear Systems Chapter Direct Methods for Solving Linear Systems Per-Olof Persson persson@berkeleyedu Department of Mathematics University of California, Berkeley Math 18A Numerical
More informationLecture Summaries for Linear Algebra M51A
These lecture summaries may also be viewed online by clicking the L icon at the top right of any lecture screen. Lecture Summaries for Linear Algebra M51A refers to the section in the textbook. Lecture
More informationChapter 1: Systems of linear equations and matrices. Section 1.1: Introduction to systems of linear equations
Chapter 1: Systems of linear equations and matrices Section 1.1: Introduction to systems of linear equations Definition: A linear equation in n variables can be expressed in the form a 1 x 1 + a 2 x 2
More informationMATRICES The numbers or letters in any given matrix are called its entries or elements
MATRICES A matrix is defined as a rectangular array of numbers. Examples are: 1 2 4 a b 1 4 5 A : B : C 0 1 3 c b 1 6 2 2 5 8 The numbers or letters in any given matrix are called its entries or elements
More informationPrinciple Components Analysis (PCA) Relationship Between a Linear Combination of Variables and Axes Rotation for PCA
Principle Components Analysis (PCA) Relationship Between a Linear Combination of Variables and Axes Rotation for PCA Principle Components Analysis: Uses one group of variables (we will call this X) In
More informationMath Camp II. Basic Linear Algebra. Yiqing Xu. Aug 26, 2014 MIT
Math Camp II Basic Linear Algebra Yiqing Xu MIT Aug 26, 2014 1 Solving Systems of Linear Equations 2 Vectors and Vector Spaces 3 Matrices 4 Least Squares Systems of Linear Equations Definition A linear
More informationTOPIC III LINEAR ALGEBRA
[1] Linear Equations TOPIC III LINEAR ALGEBRA (1) Case of Two Endogenous Variables 1) Linear vs. Nonlinear Equations Linear equation: ax + by = c, where a, b and c are constants. 2 Nonlinear equation:
More informationMultivariate Statistical Analysis
Multivariate Statistical Analysis Fall 2011 C. L. Williams, Ph.D. Lecture 4 for Applied Multivariate Analysis Outline 1 Eigen values and eigen vectors Characteristic equation Some properties of eigendecompositions
More informationA matrix is a rectangular array of. objects arranged in rows and columns. The objects are called the entries. is called the size of the matrix, and
Section 5.5. Matrices and Vectors A matrix is a rectangular array of objects arranged in rows and columns. The objects are called the entries. A matrix with m rows and n columns is called an m n matrix.
More informationMATRICES AND MATRIX OPERATIONS
SIZE OF THE MATRIX is defined by number of rows and columns in the matrix. For the matrix that have m rows and n columns we say the size of the matrix is m x n. If matrix have the same number of rows (n)
More informationMatrix Operations: Determinant
Matrix Operations: Determinant Determinants Determinants are only applicable for square matrices. Determinant of the square matrix A is denoted as: det(a) or A Recall that the absolute value of the determinant
More informationLinear Algebra Primer
Linear Algebra Primer David Doria daviddoria@gmail.com Wednesday 3 rd December, 2008 Contents Why is it called Linear Algebra? 4 2 What is a Matrix? 4 2. Input and Output.....................................
More informationA matrix is a rectangular array of. objects arranged in rows and columns. The objects are called the entries. is called the size of the matrix, and
Section 5.5. Matrices and Vectors A matrix is a rectangular array of objects arranged in rows and columns. The objects are called the entries. A matrix with m rows and n columns is called an m n matrix.
More informationIntroduction to Quantitative Techniques for MSc Programmes SCHOOL OF ECONOMICS, MATHEMATICS AND STATISTICS MALET STREET LONDON WC1E 7HX
Introduction to Quantitative Techniques for MSc Programmes SCHOOL OF ECONOMICS, MATHEMATICS AND STATISTICS MALET STREET LONDON WC1E 7HX September 2007 MSc Sep Intro QT 1 Who are these course for? The September
More informationDeterminants Chapter 3 of Lay
Determinants Chapter of Lay Dr. Doreen De Leon Math 152, Fall 201 1 Introduction to Determinants Section.1 of Lay Given a square matrix A = [a ij, the determinant of A is denoted by det A or a 11 a 1j
More informationChap 3. Linear Algebra
Chap 3. Linear Algebra Outlines 1. Introduction 2. Basis, Representation, and Orthonormalization 3. Linear Algebraic Equations 4. Similarity Transformation 5. Diagonal Form and Jordan Form 6. Functions
More informationChapter 5. Linear Algebra. A linear (algebraic) equation in. unknowns, x 1, x 2,..., x n, is. an equation of the form
Chapter 5. Linear Algebra A linear (algebraic) equation in n unknowns, x 1, x 2,..., x n, is an equation of the form a 1 x 1 + a 2 x 2 + + a n x n = b where a 1, a 2,..., a n and b are real numbers. 1
More informationStudy Guide for Linear Algebra Exam 2
Study Guide for Linear Algebra Exam 2 Term Vector Space Definition A Vector Space is a nonempty set V of objects, on which are defined two operations, called addition and multiplication by scalars (real
More informationSection 9.2: Matrices.. a m1 a m2 a mn
Section 9.2: Matrices Definition: A matrix is a rectangular array of numbers: a 11 a 12 a 1n a 21 a 22 a 2n A =...... a m1 a m2 a mn In general, a ij denotes the (i, j) entry of A. That is, the entry in
More informationLetting be a field, e.g., of the real numbers, the complex numbers, the rational numbers, the rational functions W(s) of a complex variable s, etc.
1 Polynomial Matrices 1.1 Polynomials Letting be a field, e.g., of the real numbers, the complex numbers, the rational numbers, the rational functions W(s) of a complex variable s, etc., n ws ( ) as a
More informationELEMENTARY LINEAR ALGEBRA
ELEMENTARY LINEAR ALGEBRA K R MATTHEWS DEPARTMENT OF MATHEMATICS UNIVERSITY OF QUEENSLAND First Printing, 99 Chapter LINEAR EQUATIONS Introduction to linear equations A linear equation in n unknowns x,
More informationELEMENTS OF MATRIX ALGEBRA
ELEMENTS OF MATRIX ALGEBRA CHUNG-MING KUAN Department of Finance National Taiwan University September 09, 2009 c Chung-Ming Kuan, 1996, 2001, 2009 E-mail: ckuan@ntuedutw; URL: homepagentuedutw/ ckuan CONTENTS
More informationFoundations of Matrix Analysis
1 Foundations of Matrix Analysis In this chapter we recall the basic elements of linear algebra which will be employed in the remainder of the text For most of the proofs as well as for the details, the
More informationLinear Algebra Primer
Introduction Linear Algebra Primer Daniel S. Stutts, Ph.D. Original Edition: 2/99 Current Edition: 4//4 This primer was written to provide a brief overview of the main concepts and methods in elementary
More information2. Matrix Algebra and Random Vectors
2. Matrix Algebra and Random Vectors 2.1 Introduction Multivariate data can be conveniently display as array of numbers. In general, a rectangular array of numbers with, for instance, n rows and p columns
More informationTopic 15 Notes Jeremy Orloff
Topic 5 Notes Jeremy Orloff 5 Transpose, Inverse, Determinant 5. Goals. Know the definition and be able to compute the inverse of any square matrix using row operations. 2. Know the properties of inverses.
More informationVectors To begin, let us describe an element of the state space as a point with numerical coordinates, that is x 1. x 2. x =
Linear Algebra Review Vectors To begin, let us describe an element of the state space as a point with numerical coordinates, that is x 1 x x = 2. x n Vectors of up to three dimensions are easy to diagram.
More informationSystems of Linear Equations and Matrices
Chapter 1 Systems of Linear Equations and Matrices System of linear algebraic equations and their solution constitute one of the major topics studied in the course known as linear algebra. In the first
More informationMAC Module 2 Systems of Linear Equations and Matrices II. Learning Objectives. Upon completing this module, you should be able to :
MAC 0 Module Systems of Linear Equations and Matrices II Learning Objectives Upon completing this module, you should be able to :. Find the inverse of a square matrix.. Determine whether a matrix is invertible..
More informationDeterminants by Cofactor Expansion (III)
Determinants by Cofactor Expansion (III) Comment: (Reminder) If A is an n n matrix, then the determinant of A can be computed as a cofactor expansion along the jth column det(a) = a1j C1j + a2j C2j +...
More informationM. Matrices and Linear Algebra
M. Matrices and Linear Algebra. Matrix algebra. In section D we calculated the determinants of square arrays of numbers. Such arrays are important in mathematics and its applications; they are called matrices.
More informationMATH 213 Linear Algebra and ODEs Spring 2015 Study Sheet for Midterm Exam. Topics
MATH 213 Linear Algebra and ODEs Spring 2015 Study Sheet for Midterm Exam This study sheet will not be allowed during the test Books and notes will not be allowed during the test Calculators and cell phones
More informationSection 9.2: Matrices. Definition: A matrix A consists of a rectangular array of numbers, or elements, arranged in m rows and n columns.
Section 9.2: Matrices Definition: A matrix A consists of a rectangular array of numbers, or elements, arranged in m rows and n columns. That is, a 11 a 12 a 1n a 21 a 22 a 2n A =...... a m1 a m2 a mn A
More informationSystems of Linear Equations and Matrices
Chapter 1 Systems of Linear Equations and Matrices System of linear algebraic equations and their solution constitute one of the major topics studied in the course known as linear algebra. In the first
More informationLinear Algebra and Matrices
Linear Algebra and Matrices 4 Overview In this chapter we studying true matrix operations, not element operations as was done in earlier chapters. Working with MAT- LAB functions should now be fairly routine.
More informationMAC Module 3 Determinants. Learning Objectives. Upon completing this module, you should be able to:
MAC 2 Module Determinants Learning Objectives Upon completing this module, you should be able to:. Determine the minor, cofactor, and adjoint of a matrix. 2. Evaluate the determinant of a matrix by cofactor
More informationPhys 201. Matrices and Determinants
Phys 201 Matrices and Determinants 1 1.1 Matrices 1.2 Operations of matrices 1.3 Types of matrices 1.4 Properties of matrices 1.5 Determinants 1.6 Inverse of a 3 3 matrix 2 1.1 Matrices A 2 3 7 =! " 1
More informationa11 a A = : a 21 a 22
Matrices The study of linear systems is facilitated by introducing matrices. Matrix theory provides a convenient language and notation to express many of the ideas concisely, and complicated formulas are
More informationMatrices 2. Slide for MA1203 Business Mathematics II Week 4
Matrices 2 Slide for MA1203 Business Mathematics II Week 4 2.7 Leontief Input Output Model Input Output Analysis One important applications of matrix theory to the field of economics is the study of the
More informationSAMPLE OF THE STUDY MATERIAL PART OF CHAPTER 1 Introduction to Linear Algebra
1.1. Introduction SAMPLE OF THE STUDY MATERIAL PART OF CHAPTER 1 Introduction to Linear algebra is a specific branch of mathematics dealing with the study of vectors, vector spaces with functions that
More informationLinear Algebra: Lecture Notes. Dr Rachel Quinlan School of Mathematics, Statistics and Applied Mathematics NUI Galway
Linear Algebra: Lecture Notes Dr Rachel Quinlan School of Mathematics, Statistics and Applied Mathematics NUI Galway November 6, 23 Contents Systems of Linear Equations 2 Introduction 2 2 Elementary Row
More informationM.A.P. Matrix Algebra Procedures. by Mary Donovan, Adrienne Copeland, & Patrick Curry
M.A.P. Matrix Algebra Procedures by Mary Donovan, Adrienne Copeland, & Patrick Curry This document provides an easy to follow background and review of basic matrix definitions and algebra. Because population
More informationLinear Algebra review Powers of a diagonalizable matrix Spectral decomposition
Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Prof. Tesler Math 283 Fall 2016 Also see the separate version of this with Matlab and R commands. Prof. Tesler Diagonalizing
More informationMAT 2037 LINEAR ALGEBRA I web:
MAT 237 LINEAR ALGEBRA I 2625 Dokuz Eylül University, Faculty of Science, Department of Mathematics web: Instructor: Engin Mermut http://kisideuedutr/enginmermut/ HOMEWORK 2 MATRIX ALGEBRA Textbook: Linear
More informationG1110 & 852G1 Numerical Linear Algebra
The University of Sussex Department of Mathematics G & 85G Numerical Linear Algebra Lecture Notes Autumn Term Kerstin Hesse (w aw S w a w w (w aw H(wa = (w aw + w Figure : Geometric explanation of the
More information