Section Partitioned Matrices and LU Factorization
|
|
- Christal Cooper
- 5 years ago
- Views:
Transcription
1 Section Partitioned Matrices and LU Factorization Gexin Yu College of William and Mary
2 partition matrices into blocks In real world problems, systems can have huge numbers of equations and un-knowns. Standard computation techniques are inefficient in such cases, so we need to develop techniques which exploit the internal structure of the matrices. In most cases, the matrices of interest have lots of zeros.
3 partition matrices into blocks In real world problems, systems can have huge numbers of equations and un-knowns. Standard computation techniques are inefficient in such cases, so we need to develop techniques which exploit the internal structure of the matrices. In most cases, the matrices of interest have lots of zeros. One approach to simplify the computation is to partition a matrix into blocks.
4 partition matrices into blocks In real world problems, systems can have huge numbers of equations and un-knowns. Standard computation techniques are inefficient in such cases, so we need to develop techniques which exploit the internal structure of the matrices. In most cases, the matrices of interest have lots of zeros. One approach to simplify the computation is to partition a matrix into blocks Ex: A =
5 partition matrices into blocks In real world problems, systems can have huge numbers of equations and un-knowns. Standard computation techniques are inefficient in such cases, so we need to develop techniques which exploit the internal structure of the matrices. In most cases, the matrices of interest have lots of zeros. One approach to simplify the computation is to partition a matrix into blocks Ex: A = This partition can also be written as the following 2 3 block matrix: [ ] A11 A A = 12 A 13 A 21 A 22 A 23
6 partition matrices into blocks In real world problems, systems can have huge numbers of equations and un-knowns. Standard computation techniques are inefficient in such cases, so we need to develop techniques which exploit the internal structure of the matrices. In most cases, the matrices of interest have lots of zeros. One approach to simplify the computation is to partition a matrix into blocks Ex: A = This partition can also be written as the following 2 3 block matrix: [ ] A11 A A = 12 A 13 A 21 A 22 A 23 In the block form, we have blocks A 11 = [ 3 0 ] and so on.
7 Operations on partitioned matrices (Addition and scalar multiplication) IF matrices A and B are the same size and are partitioned in exactly the same way, namely A = (A ij ) and B = (B ij ), then A + B = (A ij + B ij ), and ra = (ra ij )
8 Operations on partitioned matrices (Addition and scalar multiplication) IF matrices A and B are the same size and are partitioned in exactly the same way, namely A = (A ij ) and B = (B ij ), then A + B = (A ij + B ij ), and ra = (ra ij ) (multiplication) If the partitions of A and B are comfortable for block multiplication, namely, the column partition of A matches the row partition of B, then if A = (A ij ) m n and B = (B ij ) n p, then AB = (C ij ) m p, where C ij = A i1 B ij + A i2 B 2j A in B nj
9 Example Find AB, where A = [ A11 A = 12 A 21 A 22 ], B = = 5 2 [ B1 B 2 ]
10 Example Find AB, where A = [ A11 A = 12 A 21 A 22 ], B = = 5 2 [ B1 B 2 ] Soln: [ ] [ ] [ ] A11 A AB = 12 B1 A11 B = 1 + A 12 B 2 A 21 A 22 B 2 A 21 B 1 + A 22 B =
11 Example [ ] [ ] A O C I Compute, where A, B, C and D are n n, O is the I B O D n n zero matrix, and I is the n n identity matrix.
12 Example Soln: [ ] [ ] A O C I Compute, where A, B, C and D are n n, O is the I B O D n n zero matrix, and I is the n n identity matrix. [ ] [ ] [ ] [ ] A O C I AC AI AC A = = I B O D IC II + BD C I + BD
13 Example [ ] [ ] A O C I Compute, where A, B, C and D are n n, O is the I B O D n n zero matrix, and I is the n n identity matrix. [ ] [ ] [ ] [ ] A O C I AC AI AC A Soln: = = I B O D IC II + BD C I + BD If we do direct multiplication: to compute each term uses 2n multiplications and 2n additions, or 4n flops (floating point operations). Since there are 4n 2 terms in the resulting matrix, direct multiplication uses 4n 4n 2 = 16n 3 flops.
14 Example [ ] [ ] A O C I Compute, where A, B, C and D are n n, O is the I B O D n n zero matrix, and I is the n n identity matrix. [ ] [ ] [ ] [ ] A O C I AC AI AC A Soln: = = I B O D IC II + BD C I + BD If we do direct multiplication: to compute each term uses 2n multiplications and 2n additions, or 4n flops (floating point operations). Since there are 4n 2 terms in the resulting matrix, direct multiplication uses 4n 4n 2 = 16n 3 flops. In the above computation, to compute AC takes 2n n 2 flops, to compute BD takes 2n n 2 flops, to add I + BD takes n flops, so partitioned multiplication uses 4n 3 + n? flops.
15 Example [ ] [ ] A O C I Compute, where A, B, C and D are n n, O is the I B O D n n zero matrix, and I is the n n identity matrix. [ ] [ ] [ ] [ ] A O C I AC AI AC A Soln: = = I B O D IC II + BD C I + BD If we do direct multiplication: to compute each term uses 2n multiplications and 2n additions, or 4n flops (floating point operations). Since there are 4n 2 terms in the resulting matrix, direct multiplication uses 4n 4n 2 = 16n 3 flops. In the above computation, to compute AC takes 2n n 2 flops, to compute BD takes 2n n 2 flops, to add I + BD takes n flops, so partitioned multiplication uses 4n 3 + n? flops. Take n = How many steps do we save?
16 Inverse of Partitioned Matrices [ ] A11 A A matrix of the form 12 is said to be block upper triangular. 0 A 22 Assume that A 11 is p p, A 22 is q q, and A is invertible. Find a formula for A 1.
17 Inverse of Partitioned Matrices [ ] A11 A A matrix of the form 12 is said to be block upper triangular. 0 A 22 Assume that A 11 is p p, A 22 is q q, and A is invertible. Find a formula for A 1. Soln: Let A 1 be B and partition B so that [ ] [ ] [ ] A11 A 12 B11 B 12 Ip 0 = 0 A 22 B 21 B 22 0 I q
18 Inverse of Partitioned Matrices [ ] A11 A A matrix of the form 12 is said to be block upper triangular. 0 A 22 Assume that A 11 is p p, A 22 is q q, and A is invertible. Find a formula for A 1. Soln: Let A 1 be B and partition B so that [ ] [ ] [ ] A11 A 12 B11 B 12 Ip 0 = 0 A 22 B 21 B 22 0 I q So we will have A 11 B 11 + A 12 B 21 = I p (1) A 11 B 12 + A 12 B 22 = 0 (2) A 22 B 21 = 0 (3) A 22 B 22 = I q (4)
19 As A is invertible, A 22 must be invertible. So from (??), we get B 22 = A 1 22, and from (??), we have B 21 = 0.
20 As A is invertible, A 22 must be invertible. So from (??), we get B 22 = A 1 22, and from (??), we have B 21 = 0. As A is invertible, A 11 must be invertible. So from (??) and B 21 = 0, we get B 11 = A 1 11.
21 As A is invertible, A 22 must be invertible. So from (??), we get B 22 = A 1 22, and from (??), we have B 21 = 0. As A is invertible, A 11 must be invertible. So from (??) and B 21 = 0, we get B 11 = A From (??), we get A 11 B 12 = A 12 B 22 = A 12 A So B 12 = A 1 11 A 12A 1 22.
22 As A is invertible, A 22 must be invertible. So from (??), we get B 22 = A 1 22, and from (??), we have B 21 = 0. As A is invertible, A 11 must be invertible. So from (??) and B 21 = 0, we get B 11 = A From (??), we get A 11 B 12 = A 12 B 22 = A 12 A So B 12 = A 1 11 A 12A So [ ] 1 A 1 A11 A = 12 = 0 A 22 [ A 1 11 A 1 11 A 12A 1 ] 22 0 A 1 22
23 As A is invertible, A 22 must be invertible. So from (??), we get B 22 = A 1 22, and from (??), we have B 21 = 0. As A is invertible, A 11 must be invertible. So from (??) and B 21 = 0, we get B 11 = A From (??), we get A 11 B 12 = A 12 B 22 = A 12 A So B 12 = A 1 11 A 12A So [ ] 1 A 1 A11 A = 12 = 0 A 22 [ A 1 11 A 1 11 A 12A 1 ] 22 0 A 1 22 A block diagonal matrix is a partitioned matrix with zero blocks off the main diagonal (of blocks). From the above example, such a matrix is invertible if and only if each block on the diagonal is invertible.
24 Example: find the inverse of the following matrix
25 LU Factorization An LU-factorization of an m n matrix A is an equation that expresses A as a product of an m m lower triangular matrix and an m n upper triangular matrix.
26 LU Factorization An LU-factorization of an m n matrix A is an equation that expresses A as a product of an m m lower triangular matrix and an m n upper triangular matrix. In particular, if A can be row reduced to echelon form without row interchanges, then we could make the main diagonal of L to be 1s. Or u 11 u 12 u u 1n l u 22 u u 2n A = LU = l 31 l l m1 l m2 l m u u 3n u nm
27 Motivation for LU Factorization If we want to solve the matrix equation Ax = b and we have LU-factorization of A = LU, then we can the following: Ax = LUx = L(Ux) = b so let y = Ux, we have Ly = b. Solve Ly = b to get y. Sove Ux = y to get x.
28 An LU factorization algorithm Suppose that A can be reduced to an echelon form U using only row replacements that add a multiple of one row to another row below it.
29 An LU factorization algorithm Suppose that A can be reduced to an echelon form U using only row replacements that add a multiple of one row to another row below it. So there are unit lower triangular elementary matrices E 1, E 2,..., E p such that E p... E 1 A = U
30 An LU factorization algorithm Suppose that A can be reduced to an echelon form U using only row replacements that add a multiple of one row to another row below it. So there are unit lower triangular elementary matrices E 1, E 2,..., E p such that E p... E 1 A = U Then A = (E p... E 1 ) 1 U = LU, with L = (E p... E 1 ) 1 = E Ep 1
31 An LU factorization algorithm Suppose that A can be reduced to an echelon form U using only row replacements that add a multiple of one row to another row below it. So there are unit lower triangular elementary matrices E 1, E 2,..., E p such that E p... E 1 A = U Then A = (E p... E 1 ) 1 U = LU, with L = (E p... E 1 ) 1 = E Ep 1 The above argument suggests the following algorithm to find an LU factorization of A:
32 An LU factorization algorithm Suppose that A can be reduced to an echelon form U using only row replacements that add a multiple of one row to another row below it. So there are unit lower triangular elementary matrices E 1, E 2,..., E p such that E p... E 1 A = U Then A = (E p... E 1 ) 1 U = LU, with L = (E p... E 1 ) 1 = E Ep 1 The above argument suggests the following algorithm to find an LU factorization of A: 1 Use row operations to reduce A to an upper triangles, and record the elementary matrices E 1, E 2,..., E p.
33 An LU factorization algorithm Suppose that A can be reduced to an echelon form U using only row replacements that add a multiple of one row to another row below it. So there are unit lower triangular elementary matrices E 1, E 2,..., E p such that E p... E 1 A = U Then A = (E p... E 1 ) 1 U = LU, with L = (E p... E 1 ) 1 = E Ep 1 The above argument suggests the following algorithm to find an LU factorization of A: 1 Use row operations to reduce A to an upper triangles, and record the elementary matrices E 1, E 2,..., E p. 2 Then L = E Ep 1. Or I = E 1... E p L.
34 Example Ex. Find an LU factorization of A =
35 Example Ex. Find an LU factorization of A = We first reduce A to an upper triangular form by row operations, and record each step with an elementary matrix A = A 1 (5) = U (6)
36 In the first step, we used row operations R2 + 2R1, R3 R1, R4 + 3R1, which corresponds to elementary matrices E 1 = , E 2 = , E 3 =
37 In the first step, we used row operations R2 + 2R1, R3 R1, R4 + 3R1, which corresponds to elementary matrices E 1 = , E 2 = , E 3 = In the second step, we used row operations R3 + 3R2, R4 4R2, which corresponds to elementary matrices E 4 = , E 5 =
38 In the first step, we used row operations R2 + 2R1, R3 R1, R4 + 3R1, which corresponds to elementary matrices E 1 = , E 2 = , E 3 = In the second step, we used row operations R3 + 3R2, R4 4R2, which corresponds to elementary matrices E 4 = , E 5 = In the last step, the row operation is R4 2R3, and the corresponding elementary matrix is E 6 = ,
39 One important observation (the position of d could be anywhere): if E = d , then E 1 = d
40 One important observation (the position of d could be anywhere): if E = d , then E 1 = d So (pay attend to the result) L 1 = E1 1 E 2 1 E 3 1 I =
41 One important observation (the position of d could be anywhere): if E = d , then E 1 = d So (pay attend to the result) L 1 = E1 1 E 2 1 E 3 1 I = Thus L = L 1 E4 1 E 5 1 E 6 1 =
MTH 215: Introduction to Linear Algebra
MTH 215: Introduction to Linear Algebra Lecture 5 Jonathan A. Chávez Casillas 1 1 University of Rhode Island Department of Mathematics September 20, 2017 1 LU Factorization 2 3 4 Triangular Matrices Definition
More informationFall Inverse of a matrix. Institute: UC San Diego. Authors: Alexander Knop
Fall 2017 Inverse of a matrix Authors: Alexander Knop Institute: UC San Diego Row-Column Rule If the product AB is defined, then the entry in row i and column j of AB is the sum of the products of corresponding
More informationMATH2210 Notebook 2 Spring 2018
MATH2210 Notebook 2 Spring 2018 prepared by Professor Jenny Baglivo c Copyright 2009 2018 by Jenny A. Baglivo. All Rights Reserved. 2 MATH2210 Notebook 2 3 2.1 Matrices and Their Operations................................
More informationSolving Ax = b w/ different b s: LU-Factorization
Solving Ax = b w/ different b s: LU-Factorization Linear Algebra Josh Engwer TTU 14 September 2015 Josh Engwer (TTU) Solving Ax = b w/ different b s: LU-Factorization 14 September 2015 1 / 21 Elementary
More informationMath 344 Lecture # Linear Systems
Math 344 Lecture #12 2.7 Linear Systems Through a choice of bases S and T for finite dimensional vector spaces V (with dimension n) and W (with dimension m), a linear equation L(v) = w becomes the linear
More informationMatrix Algebra. Matrix Algebra. Chapter 8 - S&B
Chapter 8 - S&B Algebraic operations Matrix: The size of a matrix is indicated by the number of its rows and the number of its columns. A matrix with k rows and n columns is called a k n matrix. The number
More informationMatrix Factorization Reading: Lay 2.5
Matrix Factorization Reading: Lay 2.5 October, 20 You have seen that if we know the inverse A of a matrix A, we can easily solve the equation Ax = b. Solving a large number of equations Ax = b, Ax 2 =
More information2.1 Gaussian Elimination
2. Gaussian Elimination A common problem encountered in numerical models is the one in which there are n equations and n unknowns. The following is a description of the Gaussian elimination method for
More informationMATH 2030: ASSIGNMENT 4 SOLUTIONS
MATH 23: ASSIGNMENT 4 SOLUTIONS More on the LU factorization Q.: pg 96, q 24. Find the P t LU factorization of the matrix 2 A = 3 2 2 A.. By interchanging row and row 4 we get a matrix that may be easily
More informationMTH 464: Computational Linear Algebra
MTH 464: Computational Linear Algebra Lecture Outlines Exam 2 Material Prof. M. Beauregard Department of Mathematics & Statistics Stephen F. Austin State University February 6, 2018 Linear Algebra (MTH
More informationLinear Algebra Section 2.6 : LU Decomposition Section 2.7 : Permutations and transposes Wednesday, February 13th Math 301 Week #4
Linear Algebra Section. : LU Decomposition Section. : Permutations and transposes Wednesday, February 1th Math 01 Week # 1 The LU Decomposition We learned last time that we can factor a invertible matrix
More informationEigenvalues and Eigenvectors
5 Eigenvalues and Eigenvectors 5.2 THE CHARACTERISTIC EQUATION DETERMINANATS n n Let A be an matrix, let U be any echelon form obtained from A by row replacements and row interchanges (without scaling),
More information30.3. LU Decomposition. Introduction. Prerequisites. Learning Outcomes
LU Decomposition 30.3 Introduction In this Section we consider another direct method for obtaining the solution of systems of equations in the form AX B. Prerequisites Before starting this Section you
More informationReview of matrices. Let m, n IN. A rectangle of numbers written like A =
Review of matrices Let m, n IN. A rectangle of numbers written like a 11 a 12... a 1n a 21 a 22... a 2n A =...... a m1 a m2... a mn where each a ij IR is called a matrix with m rows and n columns or an
More informationLU Factorization. Marco Chiarandini. DM559 Linear and Integer Programming. Department of Mathematics & Computer Science University of Southern Denmark
DM559 Linear and Integer Programming LU Factorization Marco Chiarandini Department of Mathematics & Computer Science University of Southern Denmark [Based on slides by Lieven Vandenberghe, UCLA] Outline
More informationEigenvalues and Eigenvectors
5 Eigenvalues and Eigenvectors 5.2 THE CHARACTERISTIC EQUATION DETERMINANATS nn Let A be an matrix, let U be any echelon form obtained from A by row replacements and row interchanges (without scaling),
More informationNext topics: Solving systems of linear equations
Next topics: Solving systems of linear equations 1 Gaussian elimination (today) 2 Gaussian elimination with partial pivoting (Week 9) 3 The method of LU-decomposition (Week 10) 4 Iterative techniques:
More informationElementary matrices, continued. To summarize, we have identified 3 types of row operations and their corresponding
Elementary matrices, continued To summarize, we have identified 3 types of row operations and their corresponding elementary matrices. If you check the previous examples, you ll find that these matrices
More informationMATH 323 Linear Algebra Lecture 6: Matrix algebra (continued). Determinants.
MATH 323 Linear Algebra Lecture 6: Matrix algebra (continued). Determinants. Elementary matrices Theorem 1 Any elementary row operation σ on matrices with n rows can be simulated as left multiplication
More informationMATH 2331 Linear Algebra. Section 2.1 Matrix Operations. Definition: A : m n, B : n p. Example: Compute AB, if possible.
MATH 2331 Linear Algebra Section 2.1 Matrix Operations Definition: A : m n, B : n p ( 1 2 p ) ( 1 2 p ) AB = A b b b = Ab Ab Ab Example: Compute AB, if possible. 1 Row-column rule: i-j-th entry of AB:
More informationMA 511, Session 10. The Four Fundamental Subspaces of a Matrix
MA 5, Session The Four Fundamental Subspaces of a Matrix Let A be a m n matrix. (i) The row space C(A T )ofais the subspace of R n spanned by the rows of A. (ii) The null space N (A) ofa is the subspace
More informationDeterminants Chapter 3 of Lay
Determinants Chapter of Lay Dr. Doreen De Leon Math 152, Fall 201 1 Introduction to Determinants Section.1 of Lay Given a square matrix A = [a ij, the determinant of A is denoted by det A or a 11 a 1j
More informationMTH501- Linear Algebra MCQS MIDTERM EXAMINATION ~ LIBRIANSMINE ~
MTH501- Linear Algebra MCQS MIDTERM EXAMINATION ~ LIBRIANSMINE ~ Question No: 1 (Marks: 1) If for a linear transformation the equation T(x) =0 has only the trivial solution then T is One-to-one Onto Question
More informationMatrix operations Linear Algebra with Computer Science Application
Linear Algebra with Computer Science Application February 14, 2018 1 Matrix operations 11 Matrix operations If A is an m n matrix that is, a matrix with m rows and n columns then the scalar entry in the
More information4 Elementary matrices, continued
4 Elementary matrices, continued We have identified 3 types of row operations and their corresponding elementary matrices. To repeat the recipe: These matrices are constructed by performing the given row
More informationGraduate Mathematical Economics Lecture 1
Graduate Mathematical Economics Lecture 1 Yu Ren WISE, Xiamen University September 23, 2012 Outline 1 2 Course Outline ematical techniques used in graduate level economics courses Mathematics for Economists
More informationUndergraduate Mathematical Economics Lecture 1
Undergraduate Mathematical Economics Lecture 1 Yu Ren WISE, Xiamen University September 15, 2014 Outline 1 Courses Description and Requirement 2 Course Outline ematical techniques used in economics courses
More informationSystem of Linear Equations
Math 20F Linear Algebra Lecture 2 1 System of Linear Equations Slide 1 Definition 1 Fix a set of numbers a ij, b i, where i = 1,, m and j = 1,, n A system of m linear equations in n variables x j, is given
More informationElementary Row Operations on Matrices
King Saud University September 17, 018 Table of contents 1 Definition A real matrix is a rectangular array whose entries are real numbers. These numbers are organized on rows and columns. An m n matrix
More informationMAC1105-College Algebra. Chapter 5-Systems of Equations & Matrices
MAC05-College Algebra Chapter 5-Systems of Equations & Matrices 5. Systems of Equations in Two Variables Solving Systems of Two Linear Equations/ Two-Variable Linear Equations A system of equations is
More informationIntroduction to Determinants
Introduction to Determinants For any square matrix of order 2, we have found a necessary and sufficient condition for invertibility. Indeed, consider the matrix The matrix A is invertible if and only if.
More informationNecessary And Sufficient Conditions For Existence of the LU Factorization of an Arbitrary Matrix.
arxiv:math/0506382v1 [math.na] 19 Jun 2005 Necessary And Sufficient Conditions For Existence of the LU Factorization of an Arbitrary Matrix. Adviser: Charles R. Johnson Department of Mathematics College
More informationGAUSSIAN ELIMINATION AND LU DECOMPOSITION (SUPPLEMENT FOR MA511)
GAUSSIAN ELIMINATION AND LU DECOMPOSITION (SUPPLEMENT FOR MA511) D. ARAPURA Gaussian elimination is the go to method for all basic linear classes including this one. We go summarize the main ideas. 1.
More informationforms Christopher Engström November 14, 2014 MAA704: Matrix factorization and canonical forms Matrix properties Matrix factorization Canonical forms
Christopher Engström November 14, 2014 Hermitian LU QR echelon Contents of todays lecture Some interesting / useful / important of matrices Hermitian LU QR echelon Rewriting a as a product of several matrices.
More informationANALYTICAL MATHEMATICS FOR APPLICATIONS 2018 LECTURE NOTES 3
ANALYTICAL MATHEMATICS FOR APPLICATIONS 2018 LECTURE NOTES 3 ISSUED 24 FEBRUARY 2018 1 Gaussian elimination Let A be an (m n)-matrix Consider the following row operations on A (1) Swap the positions any
More informationMath 3C Lecture 20. John Douglas Moore
Math 3C Lecture 20 John Douglas Moore May 18, 2009 TENTATIVE FORMULA I Midterm I: 20% Midterm II: 20% Homework: 10% Quizzes: 10% Final: 40% TENTATIVE FORMULA II Higher of two midterms: 30% Homework: 10%
More informationMAC Module 2 Systems of Linear Equations and Matrices II. Learning Objectives. Upon completing this module, you should be able to :
MAC 0 Module Systems of Linear Equations and Matrices II Learning Objectives Upon completing this module, you should be able to :. Find the inverse of a square matrix.. Determine whether a matrix is invertible..
More informationSection 5.6. LU and LDU Factorizations
5.6. LU and LDU Factorizations Section 5.6. LU and LDU Factorizations Note. We largely follow Fraleigh and Beauregard s approach to this topic from Linear Algebra, 3rd Edition, Addison-Wesley (995). See
More informationChapter 4. Determinants
4.2 The Determinant of a Square Matrix 1 Chapter 4. Determinants 4.2 The Determinant of a Square Matrix Note. In this section we define the determinant of an n n matrix. We will do so recursively by defining
More informationMATRICES. a m,1 a m,n A =
MATRICES Matrices are rectangular arrays of real or complex numbers With them, we define arithmetic operations that are generalizations of those for real and complex numbers The general form a matrix of
More informationMTH 464: Computational Linear Algebra
MTH 464: Computational Linear Algebra Lecture Outlines Exam 2 Material Prof. M. Beauregard Department of Mathematics & Statistics Stephen F. Austin State University March 2, 2018 Linear Algebra (MTH 464)
More informationCSL361 Problem set 4: Basic linear algebra
CSL361 Problem set 4: Basic linear algebra February 21, 2017 [Note:] If the numerical matrix computations turn out to be tedious, you may use the function rref in Matlab. 1 Row-reduced echelon matrices
More informationChapter 3. Determinants and Eigenvalues
Chapter 3. Determinants and Eigenvalues 3.1. Determinants With each square matrix we can associate a real number called the determinant of the matrix. Determinants have important applications to the theory
More informationMIDTERM 1 - SOLUTIONS
MIDTERM - SOLUTIONS MATH 254 - SUMMER 2002 - KUNIYUKI CHAPTERS, 2, GRADED OUT OF 75 POINTS 2 50 POINTS TOTAL ) Use either Gaussian elimination with back-substitution or Gauss-Jordan elimination to solve
More informationDeterminants by Cofactor Expansion (III)
Determinants by Cofactor Expansion (III) Comment: (Reminder) If A is an n n matrix, then the determinant of A can be computed as a cofactor expansion along the jth column det(a) = a1j C1j + a2j C2j +...
More information4. Determinants.
4. Determinants 4.1. Determinants; Cofactor Expansion Determinants of 2 2 and 3 3 Matrices 2 2 determinant 4.1. Determinants; Cofactor Expansion Determinants of 2 2 and 3 3 Matrices 3 3 determinant 4.1.
More informationMath "Matrix Approach to Solving Systems" Bibiana Lopez. November Crafton Hills College. (CHC) 6.3 November / 25
Math 102 6.3 "Matrix Approach to Solving Systems" Bibiana Lopez Crafton Hills College November 2010 (CHC) 6.3 November 2010 1 / 25 Objectives: * Define a matrix and determine its order. * Write the augmented
More informationThe Solution of Linear Systems AX = B
Chapter 2 The Solution of Linear Systems AX = B 21 Upper-triangular Linear Systems We will now develop the back-substitution algorithm, which is useful for solving a linear system of equations that has
More informationAMS526: Numerical Analysis I (Numerical Linear Algebra)
AMS526: Numerical Analysis I (Numerical Linear Algebra) Lecture 12: Gaussian Elimination and LU Factorization Xiangmin Jiao SUNY Stony Brook Xiangmin Jiao Numerical Analysis I 1 / 10 Gaussian Elimination
More informationScientific Computing
Scientific Computing Direct solution methods Martin van Gijzen Delft University of Technology October 3, 2018 1 Program October 3 Matrix norms LU decomposition Basic algorithm Cost Stability Pivoting Pivoting
More information4 Elementary matrices, continued
4 Elementary matrices, continued We have identified 3 types of row operations and their corresponding elementary matrices. If you check the previous examples, you ll find that these matrices are constructed
More informationGaussian Elimination and Back Substitution
Jim Lambers MAT 610 Summer Session 2009-10 Lecture 4 Notes These notes correspond to Sections 31 and 32 in the text Gaussian Elimination and Back Substitution The basic idea behind methods for solving
More informationDepartment of Aerospace Engineering AE602 Mathematics for Aerospace Engineers Assignment No. 4
Department of Aerospace Engineering AE6 Mathematics for Aerospace Engineers Assignment No.. Decide whether or not the following vectors are linearly independent, by solving c v + c v + c 3 v 3 + c v :
More informationLecture 22: Section 4.7
Lecture 22: Section 47 Shuanglin Shao December 2, 213 Row Space, Column Space, and Null Space Definition For an m n, a 11 a 12 a 1n a 21 a 22 a 2n A = a m1 a m2 a mn, the vectors r 1 = [ a 11 a 12 a 1n
More informationReview for Exam Find all a for which the following linear system has no solutions, one solution, and infinitely many solutions.
Review for Exam. Find all a for which the following linear system has no solutions, one solution, and infinitely many solutions. x + y z = 2 x + 2y + z = 3 x + y + (a 2 5)z = a 2 The augmented matrix for
More informationDeterminants: summary of main results
Determinants: summary of main results A determinant of an n n matrix is a real number associated with this matrix. Its definition is complex for the general case We start with n = 2 and list important
More informationRemark By definition, an eigenvector must be a nonzero vector, but eigenvalue could be zero.
Sec 6 Eigenvalues and Eigenvectors Definition An eigenvector of an n n matrix A is a nonzero vector x such that A x λ x for some scalar λ A scalar λ is called an eigenvalue of A if there is a nontrivial
More informationChapter 2:Determinants. Section 2.1: Determinants by cofactor expansion
Chapter 2:Determinants Section 2.1: Determinants by cofactor expansion [ ] a b Recall: The 2 2 matrix is invertible if ad bc 0. The c d ([ ]) a b function f = ad bc is called the determinant and it associates
More informationMODEL ANSWERS TO THE THIRD HOMEWORK
MODEL ANSWERS TO THE THIRD HOMEWORK 1 (i) We apply Gaussian elimination to A First note that the second row is a multiple of the first row So we need to swap the second and third rows 1 3 2 1 2 6 5 7 3
More informationKevin James. MTHSC 3110 Section 2.2 Inverses of Matrices
MTHSC 3110 Section 2.2 Inverses of Matrices Definition Suppose that T : R n R m is linear. We will say that T is invertible if for every b R m there is exactly one x R n so that T ( x) = b. Note If T is
More informationMAT 343 Laboratory 3 The LU factorization
In this laboratory session we will learn how to MAT 343 Laboratory 3 The LU factorization 1. Find the LU factorization of a matrix using elementary matrices 2. Use the MATLAB command lu to find the LU
More information3.4 Elementary Matrices and Matrix Inverse
Math 220: Summer 2015 3.4 Elementary Matrices and Matrix Inverse A n n elementary matrix is a matrix which is obtained from the n n identity matrix I n n by a single elementary row operation. Elementary
More informationMath 313 Chapter 1 Review
Math 313 Chapter 1 Review Howard Anton, 9th Edition May 2010 Do NOT write on me! Contents 1 1.1 Introduction to Systems of Linear Equations 2 2 1.2 Gaussian Elimination 3 3 1.3 Matrices and Matrix Operations
More informationMatrix Arithmetic. j=1
An m n matrix is an array A = Matrix Arithmetic a 11 a 12 a 1n a 21 a 22 a 2n a m1 a m2 a mn of real numbers a ij An m n matrix has m rows and n columns a ij is the entry in the i-th row and j-th column
More informationIntroduction. Vectors and Matrices. Vectors [1] Vectors [2]
Introduction Vectors and Matrices Dr. TGI Fernando 1 2 Data is frequently arranged in arrays, that is, sets whose elements are indexed by one or more subscripts. Vector - one dimensional array Matrix -
More informationExtra Problems: Chapter 1
MA131 (Section 750002): Prepared by Asst.Prof.Dr.Archara Pacheenburawana 1 Extra Problems: Chapter 1 1. In each of the following answer true if the statement is always true and false otherwise in the space
More informationComponents and change of basis
Math 20F Linear Algebra Lecture 16 1 Components and change of basis Slide 1 Review: Isomorphism Review: Components in a basis Unique representation in a basis Change of basis Review: Isomorphism Definition
More informationFundamentals of Engineering Analysis (650163)
Philadelphia University Faculty of Engineering Communications and Electronics Engineering Fundamentals of Engineering Analysis (6563) Part Dr. Omar R Daoud Matrices: Introduction DEFINITION A matrix is
More informationMath 4377/6308 Advanced Linear Algebra
3.1 Elementary Matrix Math 4377/6308 Advanced Linear Algebra 3.1 Elementary Matrix Operations and Elementary Matrix Jiwen He Department of Mathematics, University of Houston jiwenhe@math.uh.edu math.uh.edu/
More informationMath 3191 Applied Linear Algebra
Math 191 Applied Linear Algebra Lecture 8: Inverse of a Matrix Stephen Billups University of Colorado at Denver Math 191Applied Linear Algebra p.1/0 Announcements We will not make it to section. tonight,
More informationMATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 1 x 2. x n 8 (4) 3 4 2
MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS SYSTEMS OF EQUATIONS AND MATRICES Representation of a linear system The general system of m equations in n unknowns can be written a x + a 2 x 2 + + a n x n b a
More informationMATH 2030: MATRICES. Example 0.2. Q:Define A 1 =, A. 3 4 A: We wish to find c 1, c 2, and c 3 such that. c 1 + c c
MATH 2030: MATRICES Matrix Algebra As with vectors, we may use the algebra of matrices to simplify calculations. However, matrices have operations that vectors do not possess, and so it will be of interest
More informationTopics. Vectors (column matrices): Vector addition and scalar multiplication The matrix of a linear function y Ax The elements of a matrix A : A ij
Topics Vectors (column matrices): Vector addition and scalar multiplication The matrix of a linear function y Ax The elements of a matrix A : A ij or a ij lives in row i and column j Definition of a matrix
More informationMatrices: 2.1 Operations with Matrices
Goals In this chapter and section we study matrix operations: Define matrix addition Define multiplication of matrix by a scalar, to be called scalar multiplication. Define multiplication of two matrices,
More informationMath 1553 Introduction to Linear Algebra
Math 1553 Introduction to Linear Algebra Lecture Notes Chapter 2 Matrix Algebra School of Mathematics The Georgia Institute of Technology Math 1553 Lecture Notes for Chapter 2 Introduction, Slide 1 Section
More informationLectures on Linear Algebra for IT
Lectures on Linear Algebra for IT by Mgr Tereza Kovářová, PhD following content of lectures by Ing Petr Beremlijski, PhD Department of Applied Mathematics, VSB - TU Ostrava Czech Republic 3 Inverse Matrix
More informationPhys 201. Matrices and Determinants
Phys 201 Matrices and Determinants 1 1.1 Matrices 1.2 Operations of matrices 1.3 Types of matrices 1.4 Properties of matrices 1.5 Determinants 1.6 Inverse of a 3 3 matrix 2 1.1 Matrices A 2 3 7 =! " 1
More informationEvaluating Determinants by Row Reduction
Evaluating Determinants by Row Reduction MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 2015 Objectives Reduce a matrix to row echelon form and evaluate its determinant.
More informationMath 18, Linear Algebra, Lecture C00, Spring 2017 Review and Practice Problems for Final Exam
Math 8, Linear Algebra, Lecture C, Spring 7 Review and Practice Problems for Final Exam. The augmentedmatrix of a linear system has been transformed by row operations into 5 4 8. Determine if the system
More informationChapter 2. Square matrices
Chapter 2. Square matrices Lecture notes for MA1111 P. Karageorgis pete@maths.tcd.ie 1/18 Invertible matrices Definition 2.1 Invertible matrices An n n matrix A is said to be invertible, if there is a
More informationMatrix decompositions
Matrix decompositions How can we solve Ax = b? 1 Linear algebra Typical linear system of equations : x 1 x +x = x 1 +x +9x = 0 x 1 +x x = The variables x 1, x, and x only appear as linear terms (no powers
More informationLINEAR ALGEBRA SUMMARY SHEET.
LINEAR ALGEBRA SUMMARY SHEET RADON ROSBOROUGH https://intuitiveexplanationscom/linear-algebra-summary-sheet/ This document is a concise collection of many of the important theorems of linear algebra, organized
More informationMatrix Algebra & Elementary Matrices
Matrix lgebra & Elementary Matrices To add two matrices, they must have identical dimensions. To multiply them the number of columns of the first must equal the number of rows of the second. The laws below
More informationSection 12.4 Algebra of Matrices
244 Section 2.4 Algebra of Matrices Before we can discuss Matrix Algebra, we need to have a clear idea what it means to say that two matrices are equal. Let's start a definition. Equal Matrices Two matrices
More information5x 2 = 10. x 1 + 7(2) = 4. x 1 3x 2 = 4. 3x 1 + 9x 2 = 8
1 To solve the system x 1 + x 2 = 4 2x 1 9x 2 = 2 we find an (easier to solve) equivalent system as follows: Replace equation 2 with (2 times equation 1 + equation 2): x 1 + x 2 = 4 Solve equation 2 for
More informationA FIRST COURSE IN LINEAR ALGEBRA. An Open Text by Ken Kuttler. Matrix Arithmetic
A FIRST COURSE IN LINEAR ALGEBRA An Open Text by Ken Kuttler Matrix Arithmetic Lecture Notes by Karen Seyffarth Adapted by LYRYX SERVICE COURSE SOLUTION Attribution-NonCommercial-ShareAlike (CC BY-NC-SA)
More informationis a 3 4 matrix. It has 3 rows and 4 columns. The first row is the horizontal row [ ]
Matrices: Definition: An m n matrix, A m n is a rectangular array of numbers with m rows and n columns: a, a, a,n a, a, a,n A m,n =...... a m, a m, a m,n Each a i,j is the entry at the i th row, j th column.
More informationn n matrices The system of m linear equations in n variables x 1, x 2,..., x n can be written as a matrix equation by Ax = b, or in full
n n matrices Matrices Definitions Diagonal, Identity, and zero matrices Addition Multiplication Transpose and inverse The system of m linear equations in n variables x 1, x 2,..., x n a 11 x 1 + a 12 x
More informationChapter 4 - MATRIX ALGEBRA. ... a 2j... a 2n. a i1 a i2... a ij... a in
Chapter 4 - MATRIX ALGEBRA 4.1. Matrix Operations A a 11 a 12... a 1j... a 1n a 21. a 22.... a 2j... a 2n. a i1 a i2... a ij... a in... a m1 a m2... a mj... a mn The entry in the ith row and the jth column
More informationNumerical Linear Algebra
Numerical Linear Algebra Direct Methods Philippe B. Laval KSU Fall 2017 Philippe B. Laval (KSU) Linear Systems: Direct Solution Methods Fall 2017 1 / 14 Introduction The solution of linear systems is one
More informationMath 103, Summer 2006 Determinants July 25, 2006 DETERMINANTS. 1. Some Motivation
DETERMINANTS 1. Some Motivation Today we re going to be talking about erminants. We ll see the definition in a minute, but before we get into ails I just want to give you an idea of why we care about erminants.
More informationMatrix Operations. Linear Combination Vector Algebra Angle Between Vectors Projections and Reflections Equality of matrices, Augmented Matrix
Linear Combination Vector Algebra Angle Between Vectors Projections and Reflections Equality of matrices, Augmented Matrix Matrix Operations Matrix Addition and Matrix Scalar Multiply Matrix Multiply Matrix
More informationElementary Matrices. MATH 322, Linear Algebra I. J. Robert Buchanan. Spring Department of Mathematics
Elementary Matrices MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 2015 Outline Today s discussion will focus on: elementary matrices and their properties, using elementary
More informationRemark 1 By definition, an eigenvector must be a nonzero vector, but eigenvalue could be zero.
Sec 5 Eigenvectors and Eigenvalues In this chapter, vector means column vector Definition An eigenvector of an n n matrix A is a nonzero vector x such that A x λ x for some scalar λ A scalar λ is called
More informationLecture 6 & 7. Shuanglin Shao. September 16th and 18th, 2013
Lecture 6 & 7 Shuanglin Shao September 16th and 18th, 2013 1 Elementary matrices 2 Equivalence Theorem 3 A method of inverting matrices Def An n n matrice is called an elementary matrix if it can be obtained
More informationSection 2.2: The Inverse of a Matrix
Section 22: The Inverse of a Matrix Recall that a linear equation ax b, where a and b are scalars and a 0, has the unique solution x a 1 b, where a 1 is the reciprocal of a From this result, it is natural
More information12/1/2015 LINEAR ALGEBRA PRE-MID ASSIGNMENT ASSIGNED BY: PROF. SULEMAN SUBMITTED BY: M. REHAN ASGHAR BSSE 4 ROLL NO: 15126
12/1/2015 LINEAR ALGEBRA PRE-MID ASSIGNMENT ASSIGNED BY: PROF. SULEMAN SUBMITTED BY: M. REHAN ASGHAR Cramer s Rule Solving a physical system of linear equation by using Cramer s rule Cramer s rule is really
More informationWe could express the left side as a sum of vectors and obtain the Vector Form of a Linear System: a 12 a x n. a m2
Week 22 Equations, Matrices and Transformations Coefficient Matrix and Vector Forms of a Linear System Suppose we have a system of m linear equations in n unknowns a 11 x 1 + a 12 x 2 + + a 1n x n b 1
More informationMATRICES. knowledge on matrices Knowledge on matrix operations. Matrix as a tool of solving linear equations with two or three unknowns.
MATRICES After studying this chapter you will acquire the skills in knowledge on matrices Knowledge on matrix operations. Matrix as a tool of solving linear equations with two or three unknowns. List of
More informationFormula for the inverse matrix. Cramer s rule. Review: 3 3 determinants can be computed expanding by any row or column
Math 20F Linear Algebra Lecture 18 1 Determinants, n n Review: The 3 3 case Slide 1 Determinants n n (Expansions by rows and columns Relation with Gauss elimination matrices: Properties) Formula for the
More information