Review from Bootcamp: Linear Algebra
|
|
- Justin Owen
- 6 years ago
- Views:
Transcription
1 Review from Bootcamp: Linear Algebra D. Alex Hughes October 27, 2014
2 1 Properties of Estimators 2 Linear Algebra Addition and Subtraction Transpose Multiplication Cross Product Trace 3 Special Matrices Matrix Inversion Determinants D. Alex Hughes Linear Algebra Review October 27, / 46
3 Properties of Estimators 1 Unbiasedness: 2 Asymptotic Unbiasedness: E(ˆθ) θ = 0 lim P( E[ˆθ] θ > ɛ) 0; ɛ > 0 n 3 Efficiency 4 Consistency 1 MSE = 1 E[(ˆθ θ) 2 ] lim n P( ˆθ θ > ɛ) 0 ɛ > 0 D. Alex Hughes Linear Algebra Review October 27, / 46
4 Linear algebra Motivation: Linear algebra or matrix algebra avoids the mess and lets us solve for things we care about quickly, cleanly and easily. This is no different than algebra. Consider the difference in the following formulas for the mean: x = x 1 + x 2 n x = x 1 + x 2 + x 3 n x = x 1 + x 2 + x 3 + x 4 n xi x = n D. Alex Hughes Linear Algebra Review October 27, / 46
5 Linear algebra Similarly, matrix algebra is a form of notation that cleans up the mess when working with more complex formulas. So suspend disbelief and concern, and treat this as a new language you are learning. Think of this as algebra on steroids. D. Alex Hughes Linear Algebra Review October 27, / 46
6 Motivation Why are we studying matrix algebra? We will use matrix algebra to derive the least squares estimator Matrices are an intuitive way to think about data. We have a set of observations (perhaps individuals) on the row, and observe many different characteristics (such as race, gender, PID, etc.) corresponding to columns Matrices are useful for solving systems of equations, like multiple regression Notation is much more compact and concise D. Alex Hughes Linear Algebra Review October 27, / 46
7 Definition of Matrices and Vectors Definition A matrix is simply an arrangement of numbers in rectangular form. Generally, a (j k) matrix A can be written as follows: a 11 a 12 a 1k a 21 a 22 a 2k A = a j1 a j2 a jk Note that there are j rows and k columns, defining the dimensionality (order) of the matrix. Also note that the elements are double sub-scripted, with the row number first, and the column number second. In general terms, the A above is of order (j, k). D. Alex Hughes Linear Algebra Review October 27, / 46
8 Examples Example W = [ is of order (2, 2). This is also called a square matrix. There are also rectangular matrices (j k), such as: ] Example which is of order (4,2). Γ = D. Alex Hughes Linear Algebra Review October 27, / 46
9 Notation Matrices are usually written using capital, bold-faced Roman or Greek letters. Roman is typically data, and Greek is typically parameters. This is not universal. D. Alex Hughes Linear Algebra Review October 27, / 46
10 Vector Definition Vectors are matrices that have either one row or one column. is the same as a scalar a regular number. Row vectors have a single row and multiple columns. α = [ ] α 1 α 2 α 3 α k Column vectors are those that have a single column and multiple rows. y 1 y 2 y =. y k D. Alex Hughes Linear Algebra Review October 27, / 46
11 Operations on Matrices Addition and Subtraction Scalar addition is simply: m + n = = 7 Addition is similarly defined for matrices. If matrices or vectors are of the same order, then they can be added. One performs the addition element by element. D. Alex Hughes Linear Algebra Review October 27, / 46
12 Addition A + B = C: [ a11 a 12 a 21 a 22 ] [ b11 b + 12 b 21 b 22 ] [ a11 + b = 11 a 12 + b 12 a 21 + b 21 a 22 + b 22 ] [ c11 c = 12 c 21 c 22 ] D. Alex Hughes Linear Algebra Review October 27, / 46
13 Subtraction A B = D: [ ] [ ] = [ ] D. Alex Hughes Linear Algebra Review October 27, / 46
14 Properties of Matrix Addition A + B = B + A. Matrix addition is commutative. (A + B) + C = A + (B + C). Matrix addition is associative. D. Alex Hughes Linear Algebra Review October 27, / 46
15 Transpose Definition To transpose a matrix is to exchange order subscripts. An order (j, k) matrix becomes an order (k, j) matrix. Transposition is denoted by placing a prime after a matrix or by placing a superscript T. Q = q 1,1 q 1,2 q 2,1 q 2,2 q 3,1 q 3,2 [ ] Q q1,1 q = 2,1 q 3,1 q 1,2 q 2,2 q 3,2 Note that the subscripts in the transpose remain the same, they are just exchanged. D. Alex Hughes Linear Algebra Review October 27, / 46
16 Example Example ω = ω = [ ] D. Alex Hughes Linear Algebra Review October 27, / 46
17 Some Definitions There are a few results regarding transposition that are important to remember: An order (j, j) matrix A is said to be symmetric iff A = A. (A ) = A W = For a scalar k, (ka) = ka. W = For two matrices of the same order, the transpose of the sum is equal to the sum of the transposes. (A + B) = A + B D. Alex Hughes Linear Algebra Review October 27, / 46
18 Matrices and Multiplication Scalar times a matrix. In words, a scalar α times a matrix A equals the scalar times each element of A. Thus, [ ] [ ] a1,1 a αa = α 1,2 αa1,1 αa = 1,2 a 2,1 a 2,2 αa 2,1 αa 2,2 So, for: A = [ ] [ A = ] D. Alex Hughes Linear Algebra Review October 27, / 46
19 Matrices and Multiplication Definition Given A of order (m, n) and B of order (n, r), then the product AB = C is the order (m, r) matrix whose entries are defined by: c i,j = n a i,k b k,j k=1 where i = 1,..., m and j = 1,..., r and k 1 = n 2 D. Alex Hughes Linear Algebra Review October 27, / 46
20 Matrices and Multiplication A = [ ] B = AB = = [ ( 2) ( 3) ( 2) ( 3) [ ] ] D. Alex Hughes Linear Algebra Review October 27, / 46
21 Matrices and Multiplication Is multiplication of matrices commutative? A = [ ] B = D. Alex Hughes Linear Algebra Review October 27, / 46
22 Matrices and Multiplication BA = No: Multiplication of matrices is not commutative. In other words: AB BA. D. Alex Hughes Linear Algebra Review October 27, / 46
23 Matrices and Multiplication Important results Matrix multiplication is not commutative: AB BA. Matrix multiplication is associative: (AB)C = A(BC) Matrix multiplication is distributive: A(B + C) = AB + AC The transpose of a product can be written as (AB) = B A D. Alex Hughes Linear Algebra Review October 27, / 46
24 Vectors and Multiplication Inner product of vectors e e = [ ] e 1 e 2 e N e 1 e 2. e N Alt: outer product e e = e 1 e 1 + e 2 e e N e N = N i=1 e 2 i D. Alex Hughes Linear Algebra Review October 27, / 46
25 Other Useful Vector Products Let i denote an order (N, 1) vector of ones, and x denote an order (N, 1) vector of data. i x = (x 1 + x 2 + x N ) = x i From this, it follows that: 1 N i x = 1 xi = x N D. Alex Hughes Linear Algebra Review October 27, / 46
26 Cross Product A B = ˆn A B cos(θ) ˆn: perpendicular unit vector A : Length of A θ: angle between A & B D. Alex Hughes Linear Algebra Review October 27, / 46
27 Trace Sum of the diagonal elements of a square matrix. A = a 11 a 12 a 1n a 21 a 22 a 2n a n1 a n2 a nn tr(a) = a ii = a 11 + a a nn D. Alex Hughes Linear Algebra Review October 27, / 46
28 Special Matrices and Their Properties When performing scalar algebra, we know that x 1 = x, which is known as the identity relationship. There is a similar relationship in matrix algebra: AI = A. What is I? It can be shown that I is a diagonal, square matrix with ones on the main diagonal, and zeros on the off diagonal. For example, the order three identity matrix is: I 3 = D. Alex Hughes Linear Algebra Review October 27, / 46
29 Special Matrices and Their Properties Notice that I is oftentimes subscripted to denote its dimensionality. Here is an example of the use of an identity matrix: [ ] [ ] [ ] = D. Alex Hughes Linear Algebra Review October 27, / 46
30 Special Matrices and Their Properties One of the nice properties of the identity matrix is that it is commutative with respect to multiplication. That is, AIB = IAB = ABI = AB An identity in scalar algebra is x + 0 = x. This generalizes to matrix algebra, with the definition of the null matrix, which is simply a matrix of zeros, denoted 0 j,k. Here is an example: A + 0 2,2 = [ ] [ ] = [ ] = A D. Alex Hughes Linear Algebra Review October 27, / 46
31 Matrix Inversion Definition: ZZ 1 = I This is roughly akin to division in non-matrix algebra. Actually calculating the inverse of a matrix takes several steps and has several prerequisites. D. Alex Hughes Linear Algebra Review October 27, / 46
32 Matrix Inversion General solution for a square matrix A: A 1 = 1 A adja So we need to figure out 1 A and adj(a). D. Alex Hughes Linear Algebra Review October 27, / 46
33 Matrix Inversion The first of these, A, is called the determinant. There s lots to learn about determinants, but we ll stick to the basics. Most importantly, if the determinant is NOT zero, a square matrix is invertible. The determinant is a scalar, that is, a single number, like 5. For a two by two matrix, the determinant is: [ ] a11 a A = 12 = a a 21 a 11 a 22 a 21 a So you multiply the corners and subtract one product from the other. D. Alex Hughes Linear Algebra Review October 27, / 46
34 Graphical Intuition for Determinant of a 2x2 Matrix D. Alex Hughes Linear Algebra Review October 27, / 46
35 D. Alex Hughes Linear Algebra Review October 27, / 46
36 D. Alex Hughes Linear Algebra Review October 27, / 46
37 Graphical Linear Algebra For a 2x2 matrix, the determinant is two times the area of the triangle defined by the row vectors. Think about this for a matrix like: [ ] 1 2 A = 1 2 Or... A = [ Most linear algebra functions can be represented graphically. Ask me for citations if you want a book that illustrates all these. ] D. Alex Hughes Linear Algebra Review October 27, / 46
38 Calculating Determinants With three by three matrices, the determinant is still quite manageable: a 11 a 12 a 13 A = a 21 a 22 a 23 a 31 a 32 a 33 = a 11 a 22 a 33 + a 12 a 23 a 31 + a 13 a 21 a 32 a 11 a 23 a 32 a 12 a 21 a 33 a 13 a 22 a 31 Graphically, this means adding the diagonal products from left to right, and subtracting the diagonal products from right to left. (example) D. Alex Hughes Linear Algebra Review October 27, / 46
39 More Determinants For bigger matrices, we have to use alternative methods, typically the Laplace Expansion. Basically, we break the matrix into sub-matricies, and calculate determinants of these submatricies, then combine our results. Steps: 1 Pick a row or column to work with. 2 For each element in that row, calculate the subdeterminant, also called the minor. 3 Multiply each element by its subdeterminant, determine signs, and add. D. Alex Hughes Linear Algebra Review October 27, / 46
40 Higher Order Determinants - Example = D. Alex Hughes Linear Algebra Review October 27, / 46
41 Properties of Determinants A = A Interchanging any two rows or columns will alter sign but not value of determinant. Multiplication of one row by k will change A to k A. Addition/subtraction of a multiple of any row to another row will leave the value of the determ unaltered (works for col too). If one row or columns is a multiple of another, the value of the determinant will be zero - matrix is singular D. Alex Hughes Linear Algebra Review October 27, / 46
42 Tricks for Determinants Pick a good row or column = = D. Alex Hughes Linear Algebra Review October 27, / 46
43 Tricks for Determinants Manipulate rows if possible = = D. Alex Hughes Linear Algebra Review October 27, / 46
44 Back to inverting a matrix A 1 = 1 A adj(a) (adj means adjugate) where C 11 C 12 C 1n C 21 C 22 C 2n adj(a) = C n1 C n2 C nn D. Alex Hughes Linear Algebra Review October 27, / 46
45 Cofactors C ij is a matrix cofactor - the determinant of the matrix when excluding row i and column j, and adj(a) is the transpose of the matrix of cofactors. The determinant of the cofactor submatrix is multiplied by 1 when i + j is even, and by -1 when i + j is odd. D. Alex Hughes Linear Algebra Review October 27, / 46
46 Easy Inversion - 2X2 A 1 = 1 A adj(a) [ ] 1 2 X = 1 3 X 1 = 1 [ ] D. Alex Hughes Linear Algebra Review October 27, / 46
MATRICES AND MATRIX OPERATIONS
SIZE OF THE MATRIX is defined by number of rows and columns in the matrix. For the matrix that have m rows and n columns we say the size of the matrix is m x n. If matrix have the same number of rows (n)
More informationPhys 201. Matrices and Determinants
Phys 201 Matrices and Determinants 1 1.1 Matrices 1.2 Operations of matrices 1.3 Types of matrices 1.4 Properties of matrices 1.5 Determinants 1.6 Inverse of a 3 3 matrix 2 1.1 Matrices A 2 3 7 =! " 1
More informationMATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 1 x 2. x n 8 (4) 3 4 2
MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS SYSTEMS OF EQUATIONS AND MATRICES Representation of a linear system The general system of m equations in n unknowns can be written a x + a 2 x 2 + + a n x n b a
More informationM. Matrices and Linear Algebra
M. Matrices and Linear Algebra. Matrix algebra. In section D we calculated the determinants of square arrays of numbers. Such arrays are important in mathematics and its applications; they are called matrices.
More informationChapter 1: Systems of linear equations and matrices. Section 1.1: Introduction to systems of linear equations
Chapter 1: Systems of linear equations and matrices Section 1.1: Introduction to systems of linear equations Definition: A linear equation in n variables can be expressed in the form a 1 x 1 + a 2 x 2
More informationA Review of Matrix Analysis
Matrix Notation Part Matrix Operations Matrices are simply rectangular arrays of quantities Each quantity in the array is called an element of the matrix and an element can be either a numerical value
More informationMatrices and Determinants
Chapter1 Matrices and Determinants 11 INTRODUCTION Matrix means an arrangement or array Matrices (plural of matrix) were introduced by Cayley in 1860 A matrix A is rectangular array of m n numbers (or
More informationElementary Row Operations on Matrices
King Saud University September 17, 018 Table of contents 1 Definition A real matrix is a rectangular array whose entries are real numbers. These numbers are organized on rows and columns. An m n matrix
More informationA primer on matrices
A primer on matrices Stephen Boyd August 4, 2007 These notes describe the notation of matrices, the mechanics of matrix manipulation, and how to use matrices to formulate and solve sets of simultaneous
More informationMathematics. EC / EE / IN / ME / CE. for
Mathematics for EC / EE / IN / ME / CE By www.thegateacademy.com Syllabus Syllabus for Mathematics Linear Algebra: Matrix Algebra, Systems of Linear Equations, Eigenvalues and Eigenvectors. Probability
More informationIntroduction to Matrices
214 Analysis and Design of Feedback Control Systems Introduction to Matrices Derek Rowell October 2002 Modern system dynamics is based upon a matrix representation of the dynamic equations governing the
More informationGraphics (INFOGR), , Block IV, lecture 8 Deb Panja. Today: Matrices. Welcome
Graphics (INFOGR), 2017-18, Block IV, lecture 8 Deb Panja Today: Matrices Welcome 1 Today Matrices: why and what? Matrix operations Determinants Adjoint/adjugate and inverse of matrices Geometric interpretation
More informationMatrices. Chapter Definitions and Notations
Chapter 3 Matrices 3. Definitions and Notations Matrices are yet another mathematical object. Learning about matrices means learning what they are, how they are represented, the types of operations which
More informationMatrices BUSINESS MATHEMATICS
Matrices BUSINESS MATHEMATICS 1 CONTENTS Matrices Special matrices Operations with matrices Matrix multipication More operations with matrices Matrix transposition Symmetric matrices Old exam question
More informationFundamentals of Engineering Analysis (650163)
Philadelphia University Faculty of Engineering Communications and Electronics Engineering Fundamentals of Engineering Analysis (6563) Part Dr. Omar R Daoud Matrices: Introduction DEFINITION A matrix is
More informationSAMPLE OF THE STUDY MATERIAL PART OF CHAPTER 1 Introduction to Linear Algebra
1.1. Introduction SAMPLE OF THE STUDY MATERIAL PART OF CHAPTER 1 Introduction to Linear algebra is a specific branch of mathematics dealing with the study of vectors, vector spaces with functions that
More informationMatrices and Vectors
Matrices and Vectors James K. Peterson Department of Biological Sciences and Department of Mathematical Sciences Clemson University November 11, 2013 Outline 1 Matrices and Vectors 2 Vector Details 3 Matrix
More informationIntroduction to Matrix Algebra
Introduction to Clayton Webb CRMDA University of Kansas August 2015 Motivation Outline Where we are headed Introduction Motivation We learned how to calculate correlation and regression coefficients in
More informationECON 186 Class Notes: Linear Algebra
ECON 86 Class Notes: Linear Algebra Jijian Fan Jijian Fan ECON 86 / 27 Singularity and Rank As discussed previously, squareness is a necessary condition for a matrix to be nonsingular (have an inverse).
More informationMATH 2030: EIGENVALUES AND EIGENVECTORS
MATH 2030: EIGENVALUES AND EIGENVECTORS Determinants Although we are introducing determinants in the context of matrices, the theory of determinants predates matrices by at least two hundred years Their
More informationSAMPLE OF THE STUDY MATERIAL PART OF CHAPTER 1 Introduction to Linear Algebra
SAMPLE OF THE STUDY MATERIAL PART OF CHAPTER 1 Introduction to 1.1. Introduction Linear algebra is a specific branch of mathematics dealing with the study of vectors, vector spaces with functions that
More informationBasic Linear Algebra in MATLAB
Basic Linear Algebra in MATLAB 9.29 Optional Lecture 2 In the last optional lecture we learned the the basic type in MATLAB is a matrix of double precision floating point numbers. You learned a number
More information10. Linear Systems of ODEs, Matrix multiplication, superposition principle (parts of sections )
c Dr. Igor Zelenko, Fall 2017 1 10. Linear Systems of ODEs, Matrix multiplication, superposition principle (parts of sections 7.2-7.4) 1. When each of the functions F 1, F 2,..., F n in right-hand side
More informationMatrix & Linear Algebra
Matrix & Linear Algebra Jamie Monogan University of Georgia For more information: http://monogan.myweb.uga.edu/teaching/mm/ Jamie Monogan (UGA) Matrix & Linear Algebra 1 / 84 Vectors Vectors Vector: A
More informationThings we can already do with matrices. Unit II - Matrix arithmetic. Defining the matrix product. Things that fail in matrix arithmetic
Unit II - Matrix arithmetic matrix multiplication matrix inverses elementary matrices finding the inverse of a matrix determinants Unit II - Matrix arithmetic 1 Things we can already do with matrices equality
More informationNotation, Matrices, and Matrix Mathematics
Geographic Information Analysis, Second Edition. David O Sullivan and David J. Unwin. 010 John Wiley & Sons, Inc. Published 010 by John Wiley & Sons, Inc. Appendix A Notation, Matrices, and Matrix Mathematics
More informationElementary maths for GMT
Elementary maths for GMT Linear Algebra Part 2: Matrices, Elimination and Determinant m n matrices The system of m linear equations in n variables x 1, x 2,, x n a 11 x 1 + a 12 x 2 + + a 1n x n = b 1
More informationMatrix Basic Concepts
Matrix Basic Concepts Topics: What is a matrix? Matrix terminology Elements or entries Diagonal entries Address/location of entries Rows and columns Size of a matrix A column matrix; vectors Special types
More informationMatrices Gaussian elimination Determinants. Graphics 2009/2010, period 1. Lecture 4: matrices
Graphics 2009/2010, period 1 Lecture 4 Matrices m n matrices Matrices Definitions Diagonal, Identity, and zero matrices Addition Multiplication Transpose and inverse The system of m linear equations in
More informationBasic Concepts in Linear Algebra
Basic Concepts in Linear Algebra Grady B Wright Department of Mathematics Boise State University February 2, 2015 Grady B Wright Linear Algebra Basics February 2, 2015 1 / 39 Numerical Linear Algebra Linear
More informationMath Camp II. Basic Linear Algebra. Yiqing Xu. Aug 26, 2014 MIT
Math Camp II Basic Linear Algebra Yiqing Xu MIT Aug 26, 2014 1 Solving Systems of Linear Equations 2 Vectors and Vector Spaces 3 Matrices 4 Least Squares Systems of Linear Equations Definition A linear
More informationIntroduction to Determinants
Introduction to Determinants For any square matrix of order 2, we have found a necessary and sufficient condition for invertibility. Indeed, consider the matrix The matrix A is invertible if and only if.
More information. a m1 a mn. a 1 a 2 a = a n
Biostat 140655, 2008: Matrix Algebra Review 1 Definition: An m n matrix, A m n, is a rectangular array of real numbers with m rows and n columns Element in the i th row and the j th column is denoted by
More informationIntroduction to Quantitative Techniques for MSc Programmes SCHOOL OF ECONOMICS, MATHEMATICS AND STATISTICS MALET STREET LONDON WC1E 7HX
Introduction to Quantitative Techniques for MSc Programmes SCHOOL OF ECONOMICS, MATHEMATICS AND STATISTICS MALET STREET LONDON WC1E 7HX September 2007 MSc Sep Intro QT 1 Who are these course for? The September
More informationPOLI270 - Linear Algebra
POLI7 - Linear Algebra Septemer 8th Basics a x + a x +... + a n x n b () is the linear form where a, b are parameters and x n are variables. For a given equation such as x +x you only need a variable and
More informationReview of Basic Concepts in Linear Algebra
Review of Basic Concepts in Linear Algebra Grady B Wright Department of Mathematics Boise State University September 7, 2017 Math 565 Linear Algebra Review September 7, 2017 1 / 40 Numerical Linear Algebra
More informationn n matrices The system of m linear equations in n variables x 1, x 2,..., x n can be written as a matrix equation by Ax = b, or in full
n n matrices Matrices Definitions Diagonal, Identity, and zero matrices Addition Multiplication Transpose and inverse The system of m linear equations in n variables x 1, x 2,..., x n a 11 x 1 + a 12 x
More informationDeterminants - Uniqueness and Properties
Determinants - Uniqueness and Properties 2-2-2008 In order to show that there s only one determinant function on M(n, R), I m going to derive another formula for the determinant It involves permutations
More informationMATRICES The numbers or letters in any given matrix are called its entries or elements
MATRICES A matrix is defined as a rectangular array of numbers. Examples are: 1 2 4 a b 1 4 5 A : B : C 0 1 3 c b 1 6 2 2 5 8 The numbers or letters in any given matrix are called its entries or elements
More informationKnowledge Discovery and Data Mining 1 (VO) ( )
Knowledge Discovery and Data Mining 1 (VO) (707.003) Review of Linear Algebra Denis Helic KTI, TU Graz Oct 9, 2014 Denis Helic (KTI, TU Graz) KDDM1 Oct 9, 2014 1 / 74 Big picture: KDDM Probability Theory
More information1 Determinants. 1.1 Determinant
1 Determinants [SB], Chapter 9, p.188-196. [SB], Chapter 26, p.719-739. Bellow w ll study the central question: which additional conditions must satisfy a quadratic matrix A to be invertible, that is to
More informationLecture Notes in Linear Algebra
Lecture Notes in Linear Algebra Dr. Abdullah Al-Azemi Mathematics Department Kuwait University February 4, 2017 Contents 1 Linear Equations and Matrices 1 1.2 Matrices............................................
More informationLinear Algebra Primer
Introduction Linear Algebra Primer Daniel S. Stutts, Ph.D. Original Edition: 2/99 Current Edition: 4//4 This primer was written to provide a brief overview of the main concepts and methods in elementary
More informationLinear Algebra. Matrices Operations. Consider, for example, a system of equations such as x + 2y z + 4w = 0, 3x 4y + 2z 6w = 0, x 3y 2z + w = 0.
Matrices Operations Linear Algebra Consider, for example, a system of equations such as x + 2y z + 4w = 0, 3x 4y + 2z 6w = 0, x 3y 2z + w = 0 The rectangular array 1 2 1 4 3 4 2 6 1 3 2 1 in which the
More informationMatrices A brief introduction
Matrices A brief introduction Basilio Bona DAUIN Politecnico di Torino Semester 1, 2014-15 B. Bona (DAUIN) Matrices Semester 1, 2014-15 1 / 41 Definitions Definition A matrix is a set of N real or complex
More informationMATH 320, WEEK 7: Matrices, Matrix Operations
MATH 320, WEEK 7: Matrices, Matrix Operations 1 Matrices We have introduced ourselves to the notion of the grid-like coefficient matrix as a short-hand coefficient place-keeper for performing Gaussian
More informationLecture 7: Vectors and Matrices II Introduction to Matrices (See Sections, 3.3, 3.6, 3.7 and 3.9 in Boas)
Lecture 7: Vectors and Matrices II Introduction to Matrices (See Sections 3.3 3.6 3.7 and 3.9 in Boas) Here we will continue our discussion of vectors and their transformations. In Lecture 6 we gained
More information1 Multiply Eq. E i by λ 0: (λe i ) (E i ) 2 Multiply Eq. E j by λ and add to Eq. E i : (E i + λe j ) (E i )
Direct Methods for Linear Systems Chapter Direct Methods for Solving Linear Systems Per-Olof Persson persson@berkeleyedu Department of Mathematics University of California, Berkeley Math 18A Numerical
More informationA primer on matrices
A primer on matrices Stephen Boyd August 4, 2007 These notes describe the notation of matrices, the mechanics of matrix manipulation, and how to use matrices to formulate and solve sets of simultaneous
More informationMatrix Algebra Determinant, Inverse matrix. Matrices. A. Fabretti. Mathematics 2 A.Y. 2015/2016. A. Fabretti Matrices
Matrices A. Fabretti Mathematics 2 A.Y. 2015/2016 Table of contents Matrix Algebra Determinant Inverse Matrix Introduction A matrix is a rectangular array of numbers. The size of a matrix is indicated
More informationGetting Started with Communications Engineering. Rows first, columns second. Remember that. R then C. 1
1 Rows first, columns second. Remember that. R then C. 1 A matrix is a set of real or complex numbers arranged in a rectangular array. They can be any size and shape (provided they are rectangular). A
More informationa11 a A = : a 21 a 22
Matrices The study of linear systems is facilitated by introducing matrices. Matrix theory provides a convenient language and notation to express many of the ideas concisely, and complicated formulas are
More informationThe word Matrices is the plural of the word Matrix. A matrix is a rectangular arrangement (or array) of numbers called elements.
Numeracy Matrices Definition The word Matrices is the plural of the word Matrix A matrix is a rectangular arrangement (or array) of numbers called elements A x 3 matrix can be represented as below Matrix
More information1 Matrices and Systems of Linear Equations. a 1n a 2n
March 31, 2013 16-1 16. Systems of Linear Equations 1 Matrices and Systems of Linear Equations An m n matrix is an array A = (a ij ) of the form a 11 a 21 a m1 a 1n a 2n... a mn where each a ij is a real
More information[ Here 21 is the dot product of (3, 1, 2, 5) with (2, 3, 1, 2), and 31 is the dot product of
. Matrices A matrix is any rectangular array of numbers. For example 3 5 6 4 8 3 3 is 3 4 matrix, i.e. a rectangular array of numbers with three rows four columns. We usually use capital letters for matrices,
More informationMath Bootcamp An p-dimensional vector is p numbers put together. Written as. x 1 x =. x p
Math Bootcamp 2012 1 Review of matrix algebra 1.1 Vectors and rules of operations An p-dimensional vector is p numbers put together. Written as x 1 x =. x p. When p = 1, this represents a point in the
More information18.02 Multivariable Calculus Fall 2007
MIT OpenCourseWare http://ocw.mit.edu 18.02 Multivariable Calculus Fall 2007 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms. M. Matrices and Linear Algebra
More informationMath 123, Week 2: Matrix Operations, Inverses
Math 23, Week 2: Matrix Operations, Inverses Section : Matrices We have introduced ourselves to the grid-like coefficient matrix when performing Gaussian elimination We now formally define general matrices
More informationLinear Algebra. The analysis of many models in the social sciences reduces to the study of systems of equations.
POLI 7 - Mathematical and Statistical Foundations Prof S Saiegh Fall Lecture Notes - Class 4 October 4, Linear Algebra The analysis of many models in the social sciences reduces to the study of systems
More informationTOPIC III LINEAR ALGEBRA
[1] Linear Equations TOPIC III LINEAR ALGEBRA (1) Case of Two Endogenous Variables 1) Linear vs. Nonlinear Equations Linear equation: ax + by = c, where a, b and c are constants. 2 Nonlinear equation:
More information1300 Linear Algebra and Vector Geometry
1300 Linear Algebra and Vector Geometry R. Craigen Office: MH 523 Email: craigenr@umanitoba.ca May-June 2017 Matrix Inversion Algorithm One payoff from this theorem: It gives us a way to invert matrices.
More informationPrepared by: M. S. KumarSwamy, TGT(Maths) Page
Prepared by: M. S. KumarSwamy, TGT(Maths) Page - 50 - CHAPTER 3: MATRICES QUICK REVISION (Important Concepts & Formulae) MARKS WEIGHTAGE 03 marks Matrix A matrix is an ordered rectangular array of numbers
More informationImage Registration Lecture 2: Vectors and Matrices
Image Registration Lecture 2: Vectors and Matrices Prof. Charlene Tsai Lecture Overview Vectors Matrices Basics Orthogonal matrices Singular Value Decomposition (SVD) 2 1 Preliminary Comments Some of this
More informationMath 360 Linear Algebra Fall Class Notes. a a a a a a. a a a
Math 360 Linear Algebra Fall 2008 9-10-08 Class Notes Matrices As we have already seen, a matrix is a rectangular array of numbers. If a matrix A has m columns and n rows, we say that its dimensions are
More informationLecture 8: Determinants I
8-1 MATH 1B03/1ZC3 Winter 2019 Lecture 8: Determinants I Instructor: Dr Rushworth January 29th Determinants via cofactor expansion (from Chapter 2.1 of Anton-Rorres) Matrices encode information. Often
More informationMatrices. 1 a a2 1 b b 2 1 c c π
Matrices 2-3-207 A matrix is a rectangular array of numbers: 2 π 4 37 42 0 3 a a2 b b 2 c c 2 Actually, the entries can be more general than numbers, but you can think of the entries as numbers to start
More informationMatrices. In this chapter: matrices, determinants. inverse matrix
Matrices In this chapter: matrices, determinants inverse matrix 1 1.1 Matrices A matrix is a retangular array of numbers. Rows: horizontal lines. A = a 11 a 12 a 13 a 21 a 22 a 23 a 31 a 32 a 33 a 41 a
More informationFoundations of Matrix Analysis
1 Foundations of Matrix Analysis In this chapter we recall the basic elements of linear algebra which will be employed in the remainder of the text For most of the proofs as well as for the details, the
More information3 (Maths) Linear Algebra
3 (Maths) Linear Algebra References: Simon and Blume, chapters 6 to 11, 16 and 23; Pemberton and Rau, chapters 11 to 13 and 25; Sundaram, sections 1.3 and 1.5. The methods and concepts of linear algebra
More informationIntroduction. Vectors and Matrices. Vectors [1] Vectors [2]
Introduction Vectors and Matrices Dr. TGI Fernando 1 2 Data is frequently arranged in arrays, that is, sets whose elements are indexed by one or more subscripts. Vector - one dimensional array Matrix -
More informationChapter 7. Linear Algebra: Matrices, Vectors,
Chapter 7. Linear Algebra: Matrices, Vectors, Determinants. Linear Systems Linear algebra includes the theory and application of linear systems of equations, linear transformations, and eigenvalue problems.
More information1 Matrices and matrix algebra
1 Matrices and matrix algebra 1.1 Examples of matrices A matrix is a rectangular array of numbers and/or variables. For instance 4 2 0 3 1 A = 5 1.2 0.7 x 3 π 3 4 6 27 is a matrix with 3 rows and 5 columns
More informationMath Camp Lecture 4: Linear Algebra. Xiao Yu Wang. Aug 2010 MIT. Xiao Yu Wang (MIT) Math Camp /10 1 / 88
Math Camp 2010 Lecture 4: Linear Algebra Xiao Yu Wang MIT Aug 2010 Xiao Yu Wang (MIT) Math Camp 2010 08/10 1 / 88 Linear Algebra Game Plan Vector Spaces Linear Transformations and Matrices Determinant
More informationMath Camp Notes: Linear Algebra I
Math Camp Notes: Linear Algebra I Basic Matrix Operations and Properties Consider two n m matrices: a a m A = a n a nm Then the basic matrix operations are as follows: a + b a m + b m A + B = a n + b n
More informationSection 12.4 Algebra of Matrices
244 Section 2.4 Algebra of Matrices Before we can discuss Matrix Algebra, we need to have a clear idea what it means to say that two matrices are equal. Let's start a definition. Equal Matrices Two matrices
More informationMaterials engineering Collage \\ Ceramic & construction materials department Numerical Analysis \\Third stage by \\ Dalya Hekmat
Materials engineering Collage \\ Ceramic & construction materials department Numerical Analysis \\Third stage by \\ Dalya Hekmat Linear Algebra Lecture 2 1.3.7 Matrix Matrix multiplication using Falk s
More informationTopic 1: Matrix diagonalization
Topic : Matrix diagonalization Review of Matrices and Determinants Definition A matrix is a rectangular array of real numbers a a a m a A = a a m a n a n a nm The matrix is said to be of order n m if it
More informationArrays: Vectors and Matrices
Arrays: Vectors and Matrices Vectors Vectors are an efficient notational method for representing lists of numbers. They are equivalent to the arrays in the programming language "C. A typical vector might
More informationChapter 2:Determinants. Section 2.1: Determinants by cofactor expansion
Chapter 2:Determinants Section 2.1: Determinants by cofactor expansion [ ] a b Recall: The 2 2 matrix is invertible if ad bc 0. The c d ([ ]) a b function f = ad bc is called the determinant and it associates
More informationLinear Equations and Matrix
1/60 Chia-Ping Chen Professor Department of Computer Science and Engineering National Sun Yat-sen University Linear Algebra Gaussian Elimination 2/60 Alpha Go Linear algebra begins with a system of linear
More informationReview of Linear Algebra
Review of Linear Algebra Definitions An m n (read "m by n") matrix, is a rectangular array of entries, where m is the number of rows and n the number of columns. 2 Definitions (Con t) A is square if m=
More information11 a 12 a 13 a 21 a 22 a b 12 b 13 b 21 b 22 b b 11 a 12 + b 12 a 13 + b 13 a 21 + b 21 a 22 + b 22 a 23 + b 23
Chapter 2 (3 3) Matrices The methods used described in the previous chapter for solving sets of linear equations are equally applicable to 3 3 matrices. The algebra becomes more drawn out for larger matrices,
More informationLinear Systems and Matrices
Department of Mathematics The Chinese University of Hong Kong 1 System of m linear equations in n unknowns (linear system) a 11 x 1 + a 12 x 2 + + a 1n x n = b 1 a 21 x 1 + a 22 x 2 + + a 2n x n = b 2.......
More informationMATHEMATICS. IMPORTANT FORMULAE AND CONCEPTS for. Final Revision CLASS XII CHAPTER WISE CONCEPTS, FORMULAS FOR QUICK REVISION.
MATHEMATICS IMPORTANT FORMULAE AND CONCEPTS for Final Revision CLASS XII 2016 17 CHAPTER WISE CONCEPTS, FORMULAS FOR QUICK REVISION Prepared by M. S. KUMARSWAMY, TGT(MATHS) M. Sc. Gold Medallist (Elect.),
More informationThe Laplace Expansion Theorem: Computing the Determinants and Inverses of Matrices
The Laplace Expansion Theorem: Computing the Determinants and Inverses of Matrices David Eberly, Geometric Tools, Redmond WA 98052 https://www.geometrictools.com/ This work is licensed under the Creative
More informationChapter 4 - MATRIX ALGEBRA. ... a 2j... a 2n. a i1 a i2... a ij... a in
Chapter 4 - MATRIX ALGEBRA 4.1. Matrix Operations A a 11 a 12... a 1j... a 1n a 21. a 22.... a 2j... a 2n. a i1 a i2... a ij... a in... a m1 a m2... a mj... a mn The entry in the ith row and the jth column
More informationCP3 REVISION LECTURES VECTORS AND MATRICES Lecture 1. Prof. N. Harnew University of Oxford TT 2013
CP3 REVISION LECTURES VECTORS AND MATRICES Lecture 1 Prof. N. Harnew University of Oxford TT 2013 1 OUTLINE 1. Vector Algebra 2. Vector Geometry 3. Types of Matrices and Matrix Operations 4. Determinants
More informationCS100: DISCRETE STRUCTURES. Lecture 3 Matrices Ch 3 Pages:
CS100: DISCRETE STRUCTURES Lecture 3 Matrices Ch 3 Pages: 246-262 Matrices 2 Introduction DEFINITION 1: A matrix is a rectangular array of numbers. A matrix with m rows and n columns is called an m x n
More informationWe use the overhead arrow to denote a column vector, i.e., a number with a direction. For example, in three-space, we write
1 MATH FACTS 11 Vectors 111 Definition We use the overhead arrow to denote a column vector, ie, a number with a direction For example, in three-space, we write The elements of a vector have a graphical
More informationLinear Algebra, Vectors and Matrices
Linear Algebra, Vectors and Matrices Prof. Manuela Pedio 20550 Quantitative Methods for Finance August 2018 Outline of the Course Lectures 1 and 2 (3 hours, in class): Linear and non-linear functions on
More informationMathematics for Graphics and Vision
Mathematics for Graphics and Vision Steven Mills March 3, 06 Contents Introduction 5 Scalars 6. Visualising Scalars........................ 6. Operations on Scalars...................... 6.3 A Note on
More informationMATH2210 Notebook 2 Spring 2018
MATH2210 Notebook 2 Spring 2018 prepared by Professor Jenny Baglivo c Copyright 2009 2018 by Jenny A. Baglivo. All Rights Reserved. 2 MATH2210 Notebook 2 3 2.1 Matrices and Their Operations................................
More informationMatrices and Determinants for Undergraduates. By Dr. Anju Gupta. Ms. Reena Yadav
Matrices and Determinants for Undergraduates By Dr. Anju Gupta Director, NCWEB, University of Delhi Ms. Reena Yadav Assistant Professor, NCWEB, University of Delhi Matrices A rectangular arrangement consisting
More informationMatrix representation of a linear map
Matrix representation of a linear map As before, let e i = (0,..., 0, 1, 0,..., 0) T, with 1 in the i th place and 0 elsewhere, be standard basis vectors. Given linear map f : R n R m we get n column vectors
More informationLecture 3 Linear Algebra Background
Lecture 3 Linear Algebra Background Dan Sheldon September 17, 2012 Motivation Preview of next class: y (1) w 0 + w 1 x (1) 1 + w 2 x (1) 2 +... + w d x (1) d y (2) w 0 + w 1 x (2) 1 + w 2 x (2) 2 +...
More informationReview of Vectors and Matrices
A P P E N D I X D Review of Vectors and Matrices D. VECTORS D.. Definition of a Vector Let p, p, Á, p n be any n real numbers and P an ordered set of these real numbers that is, P = p, p, Á, p n Then P
More informationMobile Robotics 1. A Compact Course on Linear Algebra. Giorgio Grisetti
Mobile Robotics 1 A Compact Course on Linear Algebra Giorgio Grisetti SA-1 Vectors Arrays of numbers They represent a point in a n dimensional space 2 Vectors: Scalar Product Scalar-Vector Product Changes
More informationMATH 106 LINEAR ALGEBRA LECTURE NOTES
MATH 6 LINEAR ALGEBRA LECTURE NOTES FALL - These Lecture Notes are not in a final form being still subject of improvement Contents Systems of linear equations and matrices 5 Introduction to systems of
More informationLinear Algebra and Matrix Inversion
Jim Lambers MAT 46/56 Spring Semester 29- Lecture 2 Notes These notes correspond to Section 63 in the text Linear Algebra and Matrix Inversion Vector Spaces and Linear Transformations Matrices are much
More information1111: Linear Algebra I
1111: Linear Algebra I Dr. Vladimir Dotsenko (Vlad) Michaelmas Term 2015 Dr. Vladimir Dotsenko (Vlad) 1111: Linear Algebra I Michaelmas Term 2015 1 / 10 Row expansion of the determinant Our next goal is
More information