MTH 464: Computational Linear Algebra

Size: px
Start display at page:

Download "MTH 464: Computational Linear Algebra"

Transcription

1 MTH 464: Computational Linear Algebra Lecture Outlines Exam 2 Material Prof. M. Beauregard Department of Mathematics & Statistics Stephen F. Austin State University February 6, 2018 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Contents I 1 Lecture 1 2 Lecture 2 3 Lecture 3 4 Lecture 4 5 Lecture 5 6 Lecture 6 7 Lecture 7 8 Lecture 8 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

2 Lecture 1 Overview Goal for today: Understand what a linear transformation is [section 1.8] Outline: 1 Matrix Transformations 2 Linear Transformations Assignment (1.8): Read: section 1.9 Work: section 1.8 (p. 69) #1, 3, 4, 7, 8, 10, 11, 17, 24 Extra practice: #5, 13, 15, Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 1 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

3 Lecture 1 Linear Independence (review) Recall: A set of vectors { v 1,..., v p } is linearly independent iff: (definition, page 57) The vector equation x 1 v x p v p = 0 has only the trivial solution x 1 = 0,..., x p = 0 (box, page 58) With A = [ v 1... v p ] : the matrix equation Ax = 0 has only the trivial solution x = 0 Equivalently: A set of vectors { v 1,..., v p } is linearly dependent iff: (Theorem 7, page 59) At least one of the vectors is a linear combination of the others. Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 1 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

4 Matrix Transformations Notation Let A and B be sets. Lecture 1 f : A B means that f is a function from A (called its domain) into B (called its codomain). The range of the function f is the set of images (outputs) under f (this is a subset of B, but not necessarily all of B). Definition (page 64) For an m n matrix A, the associated matrix transformation is the function T : R n R m defined by the rule left-multiply by A : T (x) = Ax for all vectors x in R n Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 1 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

5 Linear Transformations Definition (page 66) Lecture 1 A function T : R n R m is a linear transformation if and only if it preserves addition and scalar multiplication: T (u + v) = T (u) + T (v) for all vectors u, v in R n T (cu) = ct (u) for all scalars c and all vectors u in R n Fact (box, page 67) If T is a linear transformation, then: T (c 1 v c p v p ) = c 1 T (v 1 ) + + c p T (v p ) Fact (page 66) Every matrix transformation is a linear transformation. Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 1 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

6 Lecture 2 Overview Goal for today: Learn to find the matrix of a linear transformation [section 1.9] Outline: 1 Matrix of a Linear Transformation 2 Linear Transformations Given Geometrically 3 Existence and Uniqueness Assignment: Read: 2.1 Work: section 1.9 (p. 79) #1, 3, 5, 7, 9, 11, 13, 15, 17, 23, 25 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 2 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

7 Lecture 2 Matrix of a Linear Transformation Recall: A linear transformation is a function T : R n R m which preserves addition and scalar multiplication: T (u + v) = T (u) + T (v) for all vectors u, v in R n T (cu) = ct (u) for all scalars c and all vectors u in R n A matrix transformation has the form T (x) = Ax, where A is m n Every matrix transformation is a linear transformation. Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 2 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

8 Standard Matrix Theorem 10 (page 72) Lecture 2 Let T : R n R m be a linear transformation. Then there exists a unique matrix A such that T (x) = Ax, for all x R n. A is called the standard matrix for the linear transformation T determined as: A = [T (e 1 )... T (e n )] Determine A: T : R 2 R 2 and reflects points over the vertical x 2 -axis. T : R 2 R 2 and horizontally shears points along the x 1 -axis by amount k. T : R 2 R 2 and rotates points clockwise by π/2. Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 2 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

9 Lecture 2 Existence and Uniqueness Given T : R n R m with T (x) = Ax and a vector b R m : Is there a vector x R n such that T (x) = b? Is there only one vector x R n such that T (x) = b? Definition (page 76) A linear transformation T : R n R m is: onto if and only if every vector b R m is the image of at least one vector x R n. one-to-one if and only if every vector b R m is the image of at most one vector x R n. Theorem 12 (page 77) A linear transformation T : R n R m is: onto iff the columns of A span R m (pivot in each row) one-to-one iff the columns of A are linearly independent (pivot in each column) [Theorem 11: iff T (x) = 0 only for x = 0] Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 2 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

10 Lecture 3 Overview Goal for today: Understand matrix multiplication [section 2.1] Outline: 1 Matrix Notation and Basic Operations 2 Matrix Multiplication 3 Properties Assignment (2.1): Read: section 2.2 Work: section 2.1 (p. 102) #1, 5, 7, 8, 11, 13, 15 19, 27 Extra practice: #3, 9, 21, 23, 25 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 3 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

11 Lecture 3 Basic Definitions Definition Let A and B be n m matrices with entries a ij and b ij, respectively. 1 The main diagonal of a matrix is a 11, a 22,..., a nn. 2 A diagonal matrix has zero entries for all a ij except the main diagonal. 3 The zero matrix is a matrix of all zero entries. 4 The transpose of a matrix swaps rows and columns and is denoted as A 5 A and B are said to be equal if a ij = b ij for all i and j. 6 The entries of A + B are a ij + b ij. Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 3 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

12 Lecture 3 Matrix Algebra - Addition and Scalar Multiplication Theorem 1 (page 95) Let A, B, and C be matrices of the same size, and let r and s be scalars. (1) A + B = B + A (4) r(a+b) = ra + rb (2) (A+B)+C = A+(B+C) (5) (r+s)a=ra + sa (3) A+0 = A (6) r(sa)=(rs)a Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 3 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

13 Lecture 3 Matrix Multiplication Definition (page 97) If A is an m n matrix, and B is an n p matrix with columns b 1, b 2,..., b p, then their product AB is the m p matrix given by AB = A [ b 1 b 2... b p ] = [ Ab1 Ab 2... Ab p ] Note: must have number of columns of A = number of rows of B Definition (page 98) Row-Column Rule - with notation as in the definition above, the entry in row i, column j of the product AB is (AB) ij = a i1 b 1j + a i2 b 2j + + a in b nj = n a ik b kj k=1 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 3 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

14 Lecture 3 Matrix Multiplication Fact In general AB BA Therefore matrix multiplication is NOT commutative! Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 3 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

15 Lecture 3 Matrix Multiplication Let A, B, and C be matrices of the correct size. 1 Does AB = BA? Not in general. 2 If AB = AC then is B = C? Not in general. A = ( ) ( ) ( ) , B =, C = If AB = 0 then is either A or B the zero matrix? Not in general. A = ( ) ( ) , B = Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 3 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

16 Lecture 4 Overview Goal for today: Understand (and learn to compute) the matrix inverse [section 2.2] Outline: 1 Elementary Matrices 2 The Inverse of a Matrix 3 Computing the Inverse 4 Properties of the Inverse Assignment (2.2): Read: section 2.3 Work: section 2.2 (p. 111) #2, 5, 7, 9, 13, 16, 18, 19, 32 Extra practice: Remaining questions from Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 4 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

17 Elementary Matrices Definition Lecture 4 An elementary matrix is one that is obtained by performing a single elementary row operation on an identity matrix. An elementary matrix is: Always square. Always reversible (invertible) For a n n elementary matrix there are n or n + 1 nonzero entries Examples: What 3 3 elementary matrix swaps row 1 with row three? What 4 4 elementary matrix replaces row 1 by 2 row 1 plus 3 row 3? What 4 4 elementary matrix replaces row 3 by 2 row 1 plus 3 row 3? What 2 2 elementary matrix scales row 2 by 5? Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 4 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

18 Lecture 4 Inverse of an n n Matrix Definition (page 105) An n n matrix is said to be invertible if there exists an n n matrix C such that CA = I and AC = I, where I is the n n identity matrix. We denote the inverse of A by A 1. 1 A matrix that is not invertible is called a singular matrix. 2 A matrix that is invertible is called a nonsingular matrix. Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 4 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

19 Lecture 4 Gauss-Jordan Elimination Fact Given an n n matrix A. Then inverse exists if and only if there exists n linearly independent columns of the square matrix A. It is found by augmenting A with the n n identity matrix and casting it into a row reduced echelon form. The inverse is the matrix in the augmented position, that is, [ ] [ A I ] I A 1 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 4 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

20 Utility of Matrix Inverses Lecture 4 Theorem 5 (page 106) If A is an invertible n n matrix, then for each b R n, the equation Ax = b has the unique solution x = A 1 b. Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 4 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

21 Lecture 4 Utility of Matrix Inverses [contd] Theorem 6 (page 107) (a) If A is an invertible matrix, then A 1 is invertible and ( A 1) 1 = A. (b) If A and B are n n invertible matrices, then so is AB, and the inverse of AB is the product of the inverses of A and B in the reverse order, that is, (AB) 1 = B 1 A 1. (c) If A is an invertible matrix, then so is A, and the inverse of A is the transpose of A 1, that is, (A ) 1 = ( A 1). Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 4 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

22 Lecture 4 Question on inverses 1 Row operations can be viewed as a matrix operating on another matrix. Are these operations invertible? 2 If A is an n m matrix with m linearly independent column vectors then an inverse exists. 3 Suppose AB = AC. If A is an invertible matrix then B = C. 4 Suppose AB = 0. If A is invertible matrix then B = 0. Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 4 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

23 Lecture 5 Overview Goal for today: Fundamental theorems involving invertible matrices [section 2.3] Outline: 1 Matrix Inverses 2 The Invertible Matrix Theorem Assignment (2.3): Read: section 2.4 Work: section 2.3 (p. 117) #1, 3, 4, 8, 9, 11, 14, 15, 17 Extra practice: Remaining questions in 1-32, 41. Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 5 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

24 Lecture 5 Exercise Prove the following. 1 If A is invertible then A 1 is unique. 2 If A and B are invertible matrices then AB is an invertible matrix. 3 If A is invertible then ( A 1) 1 = A. 4 If A is invertible iff A is invertible. Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 5 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

25 True/False Lecture 5 In the following you may assume that the matrices are invertible and of the right size. 1 (A + B) 1 = A 1 + B 1 2 (AB) 1 = A 1 B 1 3 The solution to Ax = b is x = A 1 b. 4 If A = VDV 1 for some invertible matrix V and diagonal matrix D then A n = VD n V 1 5 If A = VDV 1 for some invertible matrix V and diagonal matrix D then exp(a) = V exp(a)v 1 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 5 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

26 Matrix Inverse (review) Lecture 5 Definition (page 105) An n n matrix A is invertible if and only if there is an n n matrix C such that CA = I and AC = I. If so, C is unique and is called the inverse of A (denoted by C = A 1 ). Other words: A matrix that is invertible is called a nonsingular matrix A matrix that is not invertible is called a singular matrix Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 5 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

27 Lecture 5 Gauss-Jordan Elimination Routine Method: (pages 110) To compute the inverse of an n n matrix A: 1 Form the augmented matrix [ A I ] 2 Use elementary row operations (EROs) to reduce this to [ I B ] 3 If this is possible, then B = A 1 ; if not, then A is not invertible. Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 5 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

28 Lecture 5 The Invertible Matrix Theorem (Theorem 8, page 114) Let A be an n n matrix. The following are equivalent: a. A is invertible. b. A is row-equivalent to the identity matrix. c. A has n pivot positions. d. The equation Ax = 0 has only the trivial solution. e. The columns of A form a linearly independent set. f. The linear transformation x Ax is one-to-one. g. The equation Ax = b has at least one solution for each b in R n. h. The columns of A span R n. i. The linear transformation x Ax is onto (i.e, maps R n onto R m ). j. There is an n n matrix C such that CA = I. k. There is an n n matrix D such that AD = I. l. A T is invertible. Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 5 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

29 Lecture 6 Overview Goal for today: Outline: Understand some practical aspects of matrix computations [Sections 2.3] 1 Nearly Singular Matrices 2 Condition Number 3 Partitioned Matrices [section 2.4] Assignment (2.4): Read: section 2.5 Work: section 2.4 (p. 123) #2, 8, 10, 11, 21 Extra practice: #3, 5, 6, 12, 13, 15 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 6 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

30 Lecture 6 Invertible Matrix Theorem (Recap) Assume A is an n n matrix (True/False): 1 If there is an n n matrix D such that AD = I, then DA = I. 2 If the span of the columns of an n n matrix is R n then the matrix is invertible. 3 If there exists a nontrivial solution to Ax = 0 then A is invertible. 4 If the matrix A has n pivot columns then the row reduced echelon form of A is equivalent to I. 5 If the matrix A and the equation Ax = b are consistent for each b R n then the matrix A is invertible. Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 6 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

31 Lecture 6 Nearly Singular Matrices We know: Every square matrix is either nonsingular or singular (Theorem 8). In practice: A nonsingular square matrix may be nearly singular and be just as bad as a singular matrix. For a linear system Ax = b with a nearly singular matrix A: The solution x is sensitive to small changes in the data b. This sensitivity depends on the system not the solution method. Reducing the sensitivity requires reformulating the problem. The sensitivity is measured by the condition number. Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 6 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

32 Lecture 6 Condition Number [see Numerical Notes, page 116] Fact If A is nonsingular, b 0, and Ax = b and Aˆx = ˆb, then ˆx x x cond(a) ˆb b b In Matlab: cond(a) is the condition number of a matrix A. cond(a) 1 are problematic in computations. RCOND is an estimate of its reciprocal 1/ cond(a) Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 6 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

33 Lecture 6 Partitioned Matrices Idea: Partition (split) matrices into blocks Do matrix operations blockwise Fact (section 2.4) Matrix addition, scalar multiplication, and matrix multiplication may be computed blockwise if the numbers of blocks and their sizes match appropriately (the matrices are partitioned comformably). Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 6 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

34 Lecture 7 Overview Goal for today: Learn to find and use the LU factorization [section 2.5] Outline: 1 Using A = LU 2 Finding A = LU Assignment (2.5): Read: section 2.7 (skip 2.6) Work: section 2.5 (p. 131) #1, 4, 5, 7, 9, 12, 32 Extra practice: #3, 11, 13 *This problem can also be done easily by hand. Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 7 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

35 Lecture 7 Using the Factorization A = LU Idea: Factor A = LU with L and U lower- and upper-triangular Represents the row-reduction process in matrix form Method (page 126): To solve Ax = b given L and U: 1 Solve Ly = b for y 2 Solve Ux = y for x Why use the LU factorization? Consider the operation counts: Find A 1 : 2n 3 Use A 1 : 2n 2 n Find L, U: 2 3 n3 Use L, U: 2n 2 n Conclusion: Using LU factorization is three times faster than using the inverse Compute L and U once, then reuse for subsequent linear systems This is the way most software is organized (e.g., LAPACK) Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 7 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

36 Lecture 7 Computing the Factorization A = LU Idea: Details: Notes: Reduce A to U (echelon form) Record the EROs used to form L Use only replacement operations To change a i,j to zero use the operation R i m i,j R j R i Store multiplier m i,j = a i,j /a j,j in corresponding location in L Textbook version (pages ) is the same (without notation) Possible to incorporate row interchanges (called pivoting) This is the best method for dense linear systems of moderate size Used by almost all software (including MATLAB) Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 7 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

37 Lecture 8 Overview Goal for today: Understand and learn how to develop a LU factorization [section 2.5] Outline: 1 LU basic idea (review) 2 Examples Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 8 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

38 Lecture 8 LU Factorization Fundamental idea: Reduce A to U (echelon form) Record the EROs used to form L The matrix A = LU Fundamental rules: To eliminate a i,j use the operation R i m i,j R j R i where m i,j = a i,j /a j,j Store multiplier m i,j = a i,j /a j,j in l i,j of the lower triangular matrix L (caution with rectangular matrices) Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 8 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

39 Example 1 Lecture 8 Determine the LU factorization of the matrix: A = A , L = = U, L = How can we check this factorization? Multiply L times U and show it equals A. So there exists a mistake on this slide! Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 8 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

40 Example 2 Lecture 8 Determine the LU factorization of the matrix: A A = , L =, L = = U, L = Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 8 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

41 Example 3 Lecture 8 Determine the LU factorization of the matrix: A = A A , L =, L = Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 8 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

42 Example 3 - Continued Lecture 8 A A , L = = U, L = Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 8 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

43 Lecture 8 Using LU Consider the matrix equation Ax = b. If you are given L and U then: 1 LUx = b 2 Solve Ly = b through a forward substitution 3 Solve Ux = y through a backward substitution Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 8 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

44 Lecture 8 Example 1 Solve for x in LUx = b where U = 0 2 1, L = , b = Step One: Solve Ly = b [L b] = , y = Step Two: Solve Ux = y [U y] = , x = /9 2/9 5/9 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88 Lecture 8 Linear Algebra (MTH 464) Lecture Outlines February 6, / 88

MTH 464: Computational Linear Algebra

MTH 464: Computational Linear Algebra MTH 464: Computational Linear Algebra Lecture Outlines Exam 2 Material Prof. M. Beauregard Department of Mathematics & Statistics Stephen F. Austin State University March 2, 2018 Linear Algebra (MTH 464)

More information

MTH 464: Computational Linear Algebra

MTH 464: Computational Linear Algebra MTH 464: Computational Linear Algebra Lecture Outlines Exam 1 Material Dr. M. Beauregard Department of Mathematics & Statistics Stephen F. Austin State University January 9, 2018 Linear Algebra (MTH 464)

More information

Chapter 2 Notes, Linear Algebra 5e Lay

Chapter 2 Notes, Linear Algebra 5e Lay Contents.1 Operations with Matrices..................................1.1 Addition and Subtraction.............................1. Multiplication by a scalar............................ 3.1.3 Multiplication

More information

MATH2210 Notebook 2 Spring 2018

MATH2210 Notebook 2 Spring 2018 MATH2210 Notebook 2 Spring 2018 prepared by Professor Jenny Baglivo c Copyright 2009 2018 by Jenny A. Baglivo. All Rights Reserved. 2 MATH2210 Notebook 2 3 2.1 Matrices and Their Operations................................

More information

MATH 2331 Linear Algebra. Section 2.1 Matrix Operations. Definition: A : m n, B : n p. Example: Compute AB, if possible.

MATH 2331 Linear Algebra. Section 2.1 Matrix Operations. Definition: A : m n, B : n p. Example: Compute AB, if possible. MATH 2331 Linear Algebra Section 2.1 Matrix Operations Definition: A : m n, B : n p ( 1 2 p ) ( 1 2 p ) AB = A b b b = Ab Ab Ab Example: Compute AB, if possible. 1 Row-column rule: i-j-th entry of AB:

More information

Chapter 1: Systems of linear equations and matrices. Section 1.1: Introduction to systems of linear equations

Chapter 1: Systems of linear equations and matrices. Section 1.1: Introduction to systems of linear equations Chapter 1: Systems of linear equations and matrices Section 1.1: Introduction to systems of linear equations Definition: A linear equation in n variables can be expressed in the form a 1 x 1 + a 2 x 2

More information

Linear Algebra Section 2.6 : LU Decomposition Section 2.7 : Permutations and transposes Wednesday, February 13th Math 301 Week #4

Linear Algebra Section 2.6 : LU Decomposition Section 2.7 : Permutations and transposes Wednesday, February 13th Math 301 Week #4 Linear Algebra Section. : LU Decomposition Section. : Permutations and transposes Wednesday, February 1th Math 01 Week # 1 The LU Decomposition We learned last time that we can factor a invertible matrix

More information

Linear equations in linear algebra

Linear equations in linear algebra Linear equations in linear algebra Samy Tindel Purdue University Differential equations and linear algebra - MA 262 Taken from Differential equations and linear algebra Pearson Collections Samy T. Linear

More information

MATH 2331 Linear Algebra. Section 1.1 Systems of Linear Equations. Finding the solution to a set of two equations in two variables: Example 1: Solve:

MATH 2331 Linear Algebra. Section 1.1 Systems of Linear Equations. Finding the solution to a set of two equations in two variables: Example 1: Solve: MATH 2331 Linear Algebra Section 1.1 Systems of Linear Equations Finding the solution to a set of two equations in two variables: Example 1: Solve: x x = 3 1 2 2x + 4x = 12 1 2 Geometric meaning: Do these

More information

Chapter 4 - MATRIX ALGEBRA. ... a 2j... a 2n. a i1 a i2... a ij... a in

Chapter 4 - MATRIX ALGEBRA. ... a 2j... a 2n. a i1 a i2... a ij... a in Chapter 4 - MATRIX ALGEBRA 4.1. Matrix Operations A a 11 a 12... a 1j... a 1n a 21. a 22.... a 2j... a 2n. a i1 a i2... a ij... a in... a m1 a m2... a mj... a mn The entry in the ith row and the jth column

More information

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 1 x 2. x n 8 (4) 3 4 2

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 1 x 2. x n 8 (4) 3 4 2 MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS SYSTEMS OF EQUATIONS AND MATRICES Representation of a linear system The general system of m equations in n unknowns can be written a x + a 2 x 2 + + a n x n b a

More information

MTH501- Linear Algebra MCQS MIDTERM EXAMINATION ~ LIBRIANSMINE ~

MTH501- Linear Algebra MCQS MIDTERM EXAMINATION ~ LIBRIANSMINE ~ MTH501- Linear Algebra MCQS MIDTERM EXAMINATION ~ LIBRIANSMINE ~ Question No: 1 (Marks: 1) If for a linear transformation the equation T(x) =0 has only the trivial solution then T is One-to-one Onto Question

More information

Review Questions REVIEW QUESTIONS 71

Review Questions REVIEW QUESTIONS 71 REVIEW QUESTIONS 71 MATLAB, is [42]. For a comprehensive treatment of error analysis and perturbation theory for linear systems and many other problems in linear algebra, see [126, 241]. An overview of

More information

Math 1553 Introduction to Linear Algebra

Math 1553 Introduction to Linear Algebra Math 1553 Introduction to Linear Algebra Lecture Notes Chapter 2 Matrix Algebra School of Mathematics The Georgia Institute of Technology Math 1553 Lecture Notes for Chapter 2 Introduction, Slide 1 Section

More information

Linear Algebra and Matrix Inversion

Linear Algebra and Matrix Inversion Jim Lambers MAT 46/56 Spring Semester 29- Lecture 2 Notes These notes correspond to Section 63 in the text Linear Algebra and Matrix Inversion Vector Spaces and Linear Transformations Matrices are much

More information

MAC Module 2 Systems of Linear Equations and Matrices II. Learning Objectives. Upon completing this module, you should be able to :

MAC Module 2 Systems of Linear Equations and Matrices II. Learning Objectives. Upon completing this module, you should be able to : MAC 0 Module Systems of Linear Equations and Matrices II Learning Objectives Upon completing this module, you should be able to :. Find the inverse of a square matrix.. Determine whether a matrix is invertible..

More information

Linear Algebra March 16, 2019

Linear Algebra March 16, 2019 Linear Algebra March 16, 2019 2 Contents 0.1 Notation................................ 4 1 Systems of linear equations, and matrices 5 1.1 Systems of linear equations..................... 5 1.2 Augmented

More information

ORIE 6300 Mathematical Programming I August 25, Recitation 1

ORIE 6300 Mathematical Programming I August 25, Recitation 1 ORIE 6300 Mathematical Programming I August 25, 2016 Lecturer: Calvin Wylie Recitation 1 Scribe: Mateo Díaz 1 Linear Algebra Review 1 1.1 Independence, Spanning, and Dimension Definition 1 A (usually infinite)

More information

Elementary maths for GMT

Elementary maths for GMT Elementary maths for GMT Linear Algebra Part 2: Matrices, Elimination and Determinant m n matrices The system of m linear equations in n variables x 1, x 2,, x n a 11 x 1 + a 12 x 2 + + a 1n x n = b 1

More information

Matrices and systems of linear equations

Matrices and systems of linear equations Matrices and systems of linear equations Samy Tindel Purdue University Differential equations and linear algebra - MA 262 Taken from Differential equations and linear algebra by Goode and Annin Samy T.

More information

Scientific Computing: Dense Linear Systems

Scientific Computing: Dense Linear Systems Scientific Computing: Dense Linear Systems Aleksandar Donev Courant Institute, NYU 1 donev@courant.nyu.edu 1 Course MATH-GA.2043 or CSCI-GA.2112, Spring 2012 February 9th, 2012 A. Donev (Courant Institute)

More information

Linear Algebra Exam 1 Spring 2007

Linear Algebra Exam 1 Spring 2007 Linear Algebra Exam 1 Spring 2007 March 15, 2007 Name: SOLUTION KEY (Total 55 points, plus 5 more for Pledged Assignment.) Honor Code Statement: Directions: Complete all problems. Justify all answers/solutions.

More information

A Review of Matrix Analysis

A Review of Matrix Analysis Matrix Notation Part Matrix Operations Matrices are simply rectangular arrays of quantities Each quantity in the array is called an element of the matrix and an element can be either a numerical value

More information

Elementary Row Operations on Matrices

Elementary Row Operations on Matrices King Saud University September 17, 018 Table of contents 1 Definition A real matrix is a rectangular array whose entries are real numbers. These numbers are organized on rows and columns. An m n matrix

More information

Math 4A Notes. Written by Victoria Kala Last updated June 11, 2017

Math 4A Notes. Written by Victoria Kala Last updated June 11, 2017 Math 4A Notes Written by Victoria Kala vtkala@math.ucsb.edu Last updated June 11, 2017 Systems of Linear Equations A linear equation is an equation that can be written in the form a 1 x 1 + a 2 x 2 +...

More information

Matrix operations Linear Algebra with Computer Science Application

Matrix operations Linear Algebra with Computer Science Application Linear Algebra with Computer Science Application February 14, 2018 1 Matrix operations 11 Matrix operations If A is an m n matrix that is, a matrix with m rows and n columns then the scalar entry in the

More information

Online Exercises for Linear Algebra XM511

Online Exercises for Linear Algebra XM511 This document lists the online exercises for XM511. The section ( ) numbers refer to the textbook. TYPE I are True/False. Lecture 02 ( 1.1) Online Exercises for Linear Algebra XM511 1) The matrix [3 2

More information

7.6 The Inverse of a Square Matrix

7.6 The Inverse of a Square Matrix 7.6 The Inverse of a Square Matrix Copyright Cengage Learning. All rights reserved. What You Should Learn Verify that two matrices are inverses of each other. Use Gauss-Jordan elimination to find inverses

More information

ANALYTICAL MATHEMATICS FOR APPLICATIONS 2018 LECTURE NOTES 3

ANALYTICAL MATHEMATICS FOR APPLICATIONS 2018 LECTURE NOTES 3 ANALYTICAL MATHEMATICS FOR APPLICATIONS 2018 LECTURE NOTES 3 ISSUED 24 FEBRUARY 2018 1 Gaussian elimination Let A be an (m n)-matrix Consider the following row operations on A (1) Swap the positions any

More information

Equality: Two matrices A and B are equal, i.e., A = B if A and B have the same order and the entries of A and B are the same.

Equality: Two matrices A and B are equal, i.e., A = B if A and B have the same order and the entries of A and B are the same. Introduction Matrix Operations Matrix: An m n matrix A is an m-by-n array of scalars from a field (for example real numbers) of the form a a a n a a a n A a m a m a mn The order (or size) of A is m n (read

More information

Math Camp II. Basic Linear Algebra. Yiqing Xu. Aug 26, 2014 MIT

Math Camp II. Basic Linear Algebra. Yiqing Xu. Aug 26, 2014 MIT Math Camp II Basic Linear Algebra Yiqing Xu MIT Aug 26, 2014 1 Solving Systems of Linear Equations 2 Vectors and Vector Spaces 3 Matrices 4 Least Squares Systems of Linear Equations Definition A linear

More information

Linear Algebra. Solving Linear Systems. Copyright 2005, W.R. Winfrey

Linear Algebra. Solving Linear Systems. Copyright 2005, W.R. Winfrey Copyright 2005, W.R. Winfrey Topics Preliminaries Echelon Form of a Matrix Elementary Matrices; Finding A -1 Equivalent Matrices LU-Factorization Topics Preliminaries Echelon Form of a Matrix Elementary

More information

GAUSSIAN ELIMINATION AND LU DECOMPOSITION (SUPPLEMENT FOR MA511)

GAUSSIAN ELIMINATION AND LU DECOMPOSITION (SUPPLEMENT FOR MA511) GAUSSIAN ELIMINATION AND LU DECOMPOSITION (SUPPLEMENT FOR MA511) D. ARAPURA Gaussian elimination is the go to method for all basic linear classes including this one. We go summarize the main ideas. 1.

More information

Fall Inverse of a matrix. Institute: UC San Diego. Authors: Alexander Knop

Fall Inverse of a matrix. Institute: UC San Diego. Authors: Alexander Knop Fall 2017 Inverse of a matrix Authors: Alexander Knop Institute: UC San Diego Row-Column Rule If the product AB is defined, then the entry in row i and column j of AB is the sum of the products of corresponding

More information

Mon Feb Matrix inverses, the elementary matrix approach overview of skipped section 2.5. Announcements: Warm-up Exercise:

Mon Feb Matrix inverses, the elementary matrix approach overview of skipped section 2.5. Announcements: Warm-up Exercise: Math 2270-004 Week 6 notes We will not necessarily finish the material from a given day's notes on that day We may also add or subtract some material as the week progresses, but these notes represent an

More information

Gaussian Elimination and Back Substitution

Gaussian Elimination and Back Substitution Jim Lambers MAT 610 Summer Session 2009-10 Lecture 4 Notes These notes correspond to Sections 31 and 32 in the text Gaussian Elimination and Back Substitution The basic idea behind methods for solving

More information

MAT 2037 LINEAR ALGEBRA I web:

MAT 2037 LINEAR ALGEBRA I web: MAT 237 LINEAR ALGEBRA I 2625 Dokuz Eylül University, Faculty of Science, Department of Mathematics web: Instructor: Engin Mermut http://kisideuedutr/enginmermut/ HOMEWORK 2 MATRIX ALGEBRA Textbook: Linear

More information

Section Gaussian Elimination

Section Gaussian Elimination Section. - Gaussian Elimination A matrix is said to be in row echelon form (REF) if it has the following properties:. The first nonzero entry in any row is a. We call this a leading one or pivot one..

More information

We could express the left side as a sum of vectors and obtain the Vector Form of a Linear System: a 12 a x n. a m2

We could express the left side as a sum of vectors and obtain the Vector Form of a Linear System: a 12 a x n. a m2 Week 22 Equations, Matrices and Transformations Coefficient Matrix and Vector Forms of a Linear System Suppose we have a system of m linear equations in n unknowns a 11 x 1 + a 12 x 2 + + a 1n x n b 1

More information

Numerical Methods I Solving Square Linear Systems: GEM and LU factorization

Numerical Methods I Solving Square Linear Systems: GEM and LU factorization Numerical Methods I Solving Square Linear Systems: GEM and LU factorization Aleksandar Donev Courant Institute, NYU 1 donev@courant.nyu.edu 1 MATH-GA 2011.003 / CSCI-GA 2945.003, Fall 2014 September 18th,

More information

Linear Equations in Linear Algebra

Linear Equations in Linear Algebra 1 Linear Equations in Linear Algebra 1.7 LINEAR INDEPENDENCE LINEAR INDEPENDENCE Definition: An indexed set of vectors {v 1,, v p } in n is said to be linearly independent if the vector equation x x x

More information

INVERSE OF A MATRIX [2.2]

INVERSE OF A MATRIX [2.2] INVERSE OF A MATRIX [2.2] The inverse of a matrix: Introduction We have a mapping from R n to R n represented by a matrix A. Can we invert this mapping? i.e. can we find a matrix (call it B for now) such

More information

Math 3191 Applied Linear Algebra

Math 3191 Applied Linear Algebra Math 191 Applied Linear Algebra Lecture 8: Inverse of a Matrix Stephen Billups University of Colorado at Denver Math 191Applied Linear Algebra p.1/0 Announcements We will not make it to section. tonight,

More information

MTH5112 Linear Algebra I MTH5212 Applied Linear Algebra (2017/2018)

MTH5112 Linear Algebra I MTH5212 Applied Linear Algebra (2017/2018) MTH5112 Linear Algebra I MTH5212 Applied Linear Algebra (2017/2018) COURSEWORK 3 SOLUTIONS Exercise ( ) 1. (a) Write A = (a ij ) n n and B = (b ij ) n n. Since A and B are diagonal, we have a ij = 0 and

More information

Elementary Matrices. MATH 322, Linear Algebra I. J. Robert Buchanan. Spring Department of Mathematics

Elementary Matrices. MATH 322, Linear Algebra I. J. Robert Buchanan. Spring Department of Mathematics Elementary Matrices MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 2015 Outline Today s discussion will focus on: elementary matrices and their properties, using elementary

More information

Review Let A, B, and C be matrices of the same size, and let r and s be scalars. Then

Review Let A, B, and C be matrices of the same size, and let r and s be scalars. Then 1 Sec 21 Matrix Operations Review Let A, B, and C be matrices of the same size, and let r and s be scalars Then (i) A + B = B + A (iv) r(a + B) = ra + rb (ii) (A + B) + C = A + (B + C) (v) (r + s)a = ra

More information

Linear Algebra: Lecture notes from Kolman and Hill 9th edition.

Linear Algebra: Lecture notes from Kolman and Hill 9th edition. Linear Algebra: Lecture notes from Kolman and Hill 9th edition Taylan Şengül March 20, 2019 Please let me know of any mistakes in these notes Contents Week 1 1 11 Systems of Linear Equations 1 12 Matrices

More information

MODEL ANSWERS TO THE THIRD HOMEWORK

MODEL ANSWERS TO THE THIRD HOMEWORK MODEL ANSWERS TO THE THIRD HOMEWORK 1 (i) We apply Gaussian elimination to A First note that the second row is a multiple of the first row So we need to swap the second and third rows 1 3 2 1 2 6 5 7 3

More information

Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition

Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Prof. Tesler Math 283 Fall 2016 Also see the separate version of this with Matlab and R commands. Prof. Tesler Diagonalizing

More information

2.1 Gaussian Elimination

2.1 Gaussian Elimination 2. Gaussian Elimination A common problem encountered in numerical models is the one in which there are n equations and n unknowns. The following is a description of the Gaussian elimination method for

More information

Fundamentals of Engineering Analysis (650163)

Fundamentals of Engineering Analysis (650163) Philadelphia University Faculty of Engineering Communications and Electronics Engineering Fundamentals of Engineering Analysis (6563) Part Dr. Omar R Daoud Matrices: Introduction DEFINITION A matrix is

More information

Matrix & Linear Algebra

Matrix & Linear Algebra Matrix & Linear Algebra Jamie Monogan University of Georgia For more information: http://monogan.myweb.uga.edu/teaching/mm/ Jamie Monogan (UGA) Matrix & Linear Algebra 1 / 84 Vectors Vectors Vector: A

More information

22A-2 SUMMER 2014 LECTURE 5

22A-2 SUMMER 2014 LECTURE 5 A- SUMMER 0 LECTURE 5 NATHANIEL GALLUP Agenda Elimination to the identity matrix Inverse matrices LU factorization Elimination to the identity matrix Previously, we have used elimination to get a system

More information

MATH 3511 Lecture 1. Solving Linear Systems 1

MATH 3511 Lecture 1. Solving Linear Systems 1 MATH 3511 Lecture 1 Solving Linear Systems 1 Dmitriy Leykekhman Spring 2012 Goals Review of basic linear algebra Solution of simple linear systems Gaussian elimination D Leykekhman - MATH 3511 Introduction

More information

Definition 2.3. We define addition and multiplication of matrices as follows.

Definition 2.3. We define addition and multiplication of matrices as follows. 14 Chapter 2 Matrices In this chapter, we review matrix algebra from Linear Algebra I, consider row and column operations on matrices, and define the rank of a matrix. Along the way prove that the row

More information

Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition

Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Prof. Tesler Math 283 Fall 2018 Also see the separate version of this with Matlab and R commands. Prof. Tesler Diagonalizing

More information

Lectures on Linear Algebra for IT

Lectures on Linear Algebra for IT Lectures on Linear Algebra for IT by Mgr. Tereza Kovářová, Ph.D. following content of lectures by Ing. Petr Beremlijski, Ph.D. Department of Applied Mathematics, VSB - TU Ostrava Czech Republic 2. Systems

More information

Chapter 1: Systems of Linear Equations

Chapter 1: Systems of Linear Equations Chapter : Systems of Linear Equations February, 9 Systems of linear equations Linear systems Lecture A linear equation in variables x, x,, x n is an equation of the form a x + a x + + a n x n = b, where

More information

Chapter 7. Linear Algebra: Matrices, Vectors,

Chapter 7. Linear Algebra: Matrices, Vectors, Chapter 7. Linear Algebra: Matrices, Vectors, Determinants. Linear Systems Linear algebra includes the theory and application of linear systems of equations, linear transformations, and eigenvalue problems.

More information

Math 313 Chapter 1 Review

Math 313 Chapter 1 Review Math 313 Chapter 1 Review Howard Anton, 9th Edition May 2010 Do NOT write on me! Contents 1 1.1 Introduction to Systems of Linear Equations 2 2 1.2 Gaussian Elimination 3 3 1.3 Matrices and Matrix Operations

More information

Components and change of basis

Components and change of basis Math 20F Linear Algebra Lecture 16 1 Components and change of basis Slide 1 Review: Isomorphism Review: Components in a basis Unique representation in a basis Change of basis Review: Isomorphism Definition

More information

Vectors and matrices: matrices (Version 2) This is a very brief summary of my lecture notes.

Vectors and matrices: matrices (Version 2) This is a very brief summary of my lecture notes. Vectors and matrices: matrices (Version 2) This is a very brief summary of my lecture notes Matrices and linear equations A matrix is an m-by-n array of numbers A = a 11 a 12 a 13 a 1n a 21 a 22 a 23 a

More information

Practical Linear Algebra: A Geometry Toolbox

Practical Linear Algebra: A Geometry Toolbox Practical Linear Algebra: A Geometry Toolbox Third edition Chapter 12: Gauss for Linear Systems Gerald Farin & Dianne Hansford CRC Press, Taylor & Francis Group, An A K Peters Book www.farinhansford.com/books/pla

More information

LU Factorization. Marco Chiarandini. DM559 Linear and Integer Programming. Department of Mathematics & Computer Science University of Southern Denmark

LU Factorization. Marco Chiarandini. DM559 Linear and Integer Programming. Department of Mathematics & Computer Science University of Southern Denmark DM559 Linear and Integer Programming LU Factorization Marco Chiarandini Department of Mathematics & Computer Science University of Southern Denmark [Based on slides by Lieven Vandenberghe, UCLA] Outline

More information

MATRICES. a m,1 a m,n A =

MATRICES. a m,1 a m,n A = MATRICES Matrices are rectangular arrays of real or complex numbers With them, we define arithmetic operations that are generalizations of those for real and complex numbers The general form a matrix of

More information

Linear Algebra I Lecture 8

Linear Algebra I Lecture 8 Linear Algebra I Lecture 8 Xi Chen 1 1 University of Alberta January 25, 2019 Outline 1 2 Gauss-Jordan Elimination Given a system of linear equations f 1 (x 1, x 2,..., x n ) = 0 f 2 (x 1, x 2,..., x n

More information

CHAPTER 6. Direct Methods for Solving Linear Systems

CHAPTER 6. Direct Methods for Solving Linear Systems CHAPTER 6 Direct Methods for Solving Linear Systems. Introduction A direct method for approximating the solution of a system of n linear equations in n unknowns is one that gives the exact solution to

More information

Review of matrices. Let m, n IN. A rectangle of numbers written like A =

Review of matrices. Let m, n IN. A rectangle of numbers written like A = Review of matrices Let m, n IN. A rectangle of numbers written like a 11 a 12... a 1n a 21 a 22... a 2n A =...... a m1 a m2... a mn where each a ij IR is called a matrix with m rows and n columns or an

More information

Solving Ax = b w/ different b s: LU-Factorization

Solving Ax = b w/ different b s: LU-Factorization Solving Ax = b w/ different b s: LU-Factorization Linear Algebra Josh Engwer TTU 14 September 2015 Josh Engwer (TTU) Solving Ax = b w/ different b s: LU-Factorization 14 September 2015 1 / 21 Elementary

More information

System of Linear Equations

System of Linear Equations Math 20F Linear Algebra Lecture 2 1 System of Linear Equations Slide 1 Definition 1 Fix a set of numbers a ij, b i, where i = 1,, m and j = 1,, n A system of m linear equations in n variables x j, is given

More information

MATH10212 Linear Algebra B Homework Week 4

MATH10212 Linear Algebra B Homework Week 4 MATH22 Linear Algebra B Homework Week 4 Students are strongly advised to acquire a copy of the Textbook: D. C. Lay Linear Algebra and its Applications. Pearson, 26. ISBN -52-2873-4. Normally, homework

More information

CS412: Lecture #17. Mridul Aanjaneya. March 19, 2015

CS412: Lecture #17. Mridul Aanjaneya. March 19, 2015 CS: Lecture #7 Mridul Aanjaneya March 9, 5 Solving linear systems of equations Consider a lower triangular matrix L: l l l L = l 3 l 3 l 33 l n l nn A procedure similar to that for upper triangular systems

More information

MATH 315 Linear Algebra Homework #1 Assigned: August 20, 2018

MATH 315 Linear Algebra Homework #1 Assigned: August 20, 2018 Homework #1 Assigned: August 20, 2018 Review the following subjects involving systems of equations and matrices from Calculus II. Linear systems of equations Converting systems to matrix form Pivot entry

More information

Linear Algebra. Matrices Operations. Consider, for example, a system of equations such as x + 2y z + 4w = 0, 3x 4y + 2z 6w = 0, x 3y 2z + w = 0.

Linear Algebra. Matrices Operations. Consider, for example, a system of equations such as x + 2y z + 4w = 0, 3x 4y + 2z 6w = 0, x 3y 2z + w = 0. Matrices Operations Linear Algebra Consider, for example, a system of equations such as x + 2y z + 4w = 0, 3x 4y + 2z 6w = 0, x 3y 2z + w = 0 The rectangular array 1 2 1 4 3 4 2 6 1 3 2 1 in which the

More information

This can be accomplished by left matrix multiplication as follows: I

This can be accomplished by left matrix multiplication as follows: I 1 Numerical Linear Algebra 11 The LU Factorization Recall from linear algebra that Gaussian elimination is a method for solving linear systems of the form Ax = b, where A R m n and bran(a) In this method

More information

Linear Algebra. The analysis of many models in the social sciences reduces to the study of systems of equations.

Linear Algebra. The analysis of many models in the social sciences reduces to the study of systems of equations. POLI 7 - Mathematical and Statistical Foundations Prof S Saiegh Fall Lecture Notes - Class 4 October 4, Linear Algebra The analysis of many models in the social sciences reduces to the study of systems

More information

Numerical Linear Algebra

Numerical Linear Algebra Numerical Linear Algebra Direct Methods Philippe B. Laval KSU Fall 2017 Philippe B. Laval (KSU) Linear Systems: Direct Solution Methods Fall 2017 1 / 14 Introduction The solution of linear systems is one

More information

MTH 215: Introduction to Linear Algebra

MTH 215: Introduction to Linear Algebra MTH 215: Introduction to Linear Algebra Lecture 5 Jonathan A. Chávez Casillas 1 1 University of Rhode Island Department of Mathematics September 20, 2017 1 LU Factorization 2 3 4 Triangular Matrices Definition

More information

Lecture Notes in Linear Algebra

Lecture Notes in Linear Algebra Lecture Notes in Linear Algebra Dr. Abdullah Al-Azemi Mathematics Department Kuwait University February 4, 2017 Contents 1 Linear Equations and Matrices 1 1.2 Matrices............................................

More information

Midterm 1 Review. Written by Victoria Kala SH 6432u Office Hours: R 12:30 1:30 pm Last updated 10/10/2015

Midterm 1 Review. Written by Victoria Kala SH 6432u Office Hours: R 12:30 1:30 pm Last updated 10/10/2015 Midterm 1 Review Written by Victoria Kala vtkala@math.ucsb.edu SH 6432u Office Hours: R 12:30 1:30 pm Last updated 10/10/2015 Summary This Midterm Review contains notes on sections 1.1 1.5 and 1.7 in your

More information

Mon Feb Matrix algebra and matrix inverses. Announcements: Warm-up Exercise:

Mon Feb Matrix algebra and matrix inverses. Announcements: Warm-up Exercise: Math 2270-004 Week 5 notes We will not necessarily finish the material from a given day's notes on that day We may also add or subtract some material as the week progresses, but these notes represent an

More information

Direct Methods for Solving Linear Systems. Matrix Factorization

Direct Methods for Solving Linear Systems. Matrix Factorization Direct Methods for Solving Linear Systems Matrix Factorization Numerical Analysis (9th Edition) R L Burden & J D Faires Beamer Presentation Slides prepared by John Carroll Dublin City University c 2011

More information

Next topics: Solving systems of linear equations

Next topics: Solving systems of linear equations Next topics: Solving systems of linear equations 1 Gaussian elimination (today) 2 Gaussian elimination with partial pivoting (Week 9) 3 The method of LU-decomposition (Week 10) 4 Iterative techniques:

More information

Math 344 Lecture # Linear Systems

Math 344 Lecture # Linear Systems Math 344 Lecture #12 2.7 Linear Systems Through a choice of bases S and T for finite dimensional vector spaces V (with dimension n) and W (with dimension m), a linear equation L(v) = w becomes the linear

More information

Math Linear Algebra Final Exam Review Sheet

Math Linear Algebra Final Exam Review Sheet Math 15-1 Linear Algebra Final Exam Review Sheet Vector Operations Vector addition is a component-wise operation. Two vectors v and w may be added together as long as they contain the same number n of

More information

Multiplying matrices by diagonal matrices is faster than usual matrix multiplication.

Multiplying matrices by diagonal matrices is faster than usual matrix multiplication. 7-6 Multiplying matrices by diagonal matrices is faster than usual matrix multiplication. The following equations generalize to matrices of any size. Multiplying a matrix from the left by a diagonal matrix

More information

1 Multiply Eq. E i by λ 0: (λe i ) (E i ) 2 Multiply Eq. E j by λ and add to Eq. E i : (E i + λe j ) (E i )

1 Multiply Eq. E i by λ 0: (λe i ) (E i ) 2 Multiply Eq. E j by λ and add to Eq. E i : (E i + λe j ) (E i ) Direct Methods for Linear Systems Chapter Direct Methods for Solving Linear Systems Per-Olof Persson persson@berkeleyedu Department of Mathematics University of California, Berkeley Math 18A Numerical

More information

LS.1 Review of Linear Algebra

LS.1 Review of Linear Algebra LS. LINEAR SYSTEMS LS.1 Review of Linear Algebra In these notes, we will investigate a way of handling a linear system of ODE s directly, instead of using elimination to reduce it to a single higher-order

More information

The Solution of Linear Systems AX = B

The Solution of Linear Systems AX = B Chapter 2 The Solution of Linear Systems AX = B 21 Upper-triangular Linear Systems We will now develop the back-substitution algorithm, which is useful for solving a linear system of equations that has

More information

Numerical Linear Algebra

Numerical Linear Algebra Chapter 3 Numerical Linear Algebra We review some techniques used to solve Ax = b where A is an n n matrix, and x and b are n 1 vectors (column vectors). We then review eigenvalues and eigenvectors and

More information

Math 102, Winter Final Exam Review. Chapter 1. Matrices and Gaussian Elimination

Math 102, Winter Final Exam Review. Chapter 1. Matrices and Gaussian Elimination Math 0, Winter 07 Final Exam Review Chapter. Matrices and Gaussian Elimination { x + x =,. Different forms of a system of linear equations. Example: The x + 4x = 4. [ ] [ ] [ ] vector form (or the column

More information

Graduate Mathematical Economics Lecture 1

Graduate Mathematical Economics Lecture 1 Graduate Mathematical Economics Lecture 1 Yu Ren WISE, Xiamen University September 23, 2012 Outline 1 2 Course Outline ematical techniques used in graduate level economics courses Mathematics for Economists

More information

a s 1.3 Matrix Multiplication. Know how to multiply two matrices and be able to write down the formula

a s 1.3 Matrix Multiplication. Know how to multiply two matrices and be able to write down the formula Syllabus for Math 308, Paul Smith Book: Kolman-Hill Chapter 1. Linear Equations and Matrices 1.1 Systems of Linear Equations Definition of a linear equation and a solution to a linear equations. Meaning

More information

1 - Systems of Linear Equations

1 - Systems of Linear Equations 1 - Systems of Linear Equations 1.1 Introduction to Systems of Linear Equations Almost every problem in linear algebra will involve solving a system of equations. ü LINEAR EQUATIONS IN n VARIABLES We are

More information

Linear Algebra Summary. Based on Linear Algebra and its applications by David C. Lay

Linear Algebra Summary. Based on Linear Algebra and its applications by David C. Lay Linear Algebra Summary Based on Linear Algebra and its applications by David C. Lay Preface The goal of this summary is to offer a complete overview of all theorems and definitions introduced in the chapters

More information

Math 240 Calculus III

Math 240 Calculus III The Calculus III Summer 2015, Session II Wednesday, July 8, 2015 Agenda 1. of the determinant 2. determinants 3. of determinants What is the determinant? Yesterday: Ax = b has a unique solution when A

More information

Chapter 1. Vectors, Matrices, and Linear Spaces

Chapter 1. Vectors, Matrices, and Linear Spaces 1.4 Solving Systems of Linear Equations 1 Chapter 1. Vectors, Matrices, and Linear Spaces 1.4. Solving Systems of Linear Equations Note. We give an algorithm for solving a system of linear equations (called

More information

Linear Algebra Highlights

Linear Algebra Highlights Linear Algebra Highlights Chapter 1 A linear equation in n variables is of the form a 1 x 1 + a 2 x 2 + + a n x n. We can have m equations in n variables, a system of linear equations, which we want to

More information

Math 60. Rumbos Spring Solutions to Assignment #17

Math 60. Rumbos Spring Solutions to Assignment #17 Math 60. Rumbos Spring 2009 1 Solutions to Assignment #17 a b 1. Prove that if ad bc 0 then the matrix A = is invertible and c d compute A 1. a b Solution: Let A = and assume that ad bc 0. c d First consider

More information

The matrix will only be consistent if the last entry of row three is 0, meaning 2b 3 + b 2 b 1 = 0.

The matrix will only be consistent if the last entry of row three is 0, meaning 2b 3 + b 2 b 1 = 0. ) Find all solutions of the linear system. Express the answer in vector form. x + 2x + x + x 5 = 2 2x 2 + 2x + 2x + x 5 = 8 x + 2x + x + 9x 5 = 2 2 Solution: Reduce the augmented matrix [ 2 2 2 8 ] to

More information