Linear Algebra. James Je Heon Kim
|
|
- Marsha Walsh
- 6 years ago
- Views:
Transcription
1 Linear lgebra James Je Heon Kim (jjk9columbia.edu) If you are unfamiliar with linear or matrix algebra, you will nd that it is very di erent from basic algebra or calculus. For the duration of this session, we will be focusing on de nitions of such concepts as linear equations, matrices, determinants, vector spaces, inner products, linear transformations, eigenvalues and eigenvectors, and their applications to interesting mathematical problems. Texts: Linear lgebra and Its pplications (3rd Edition) ddison Wesley c23, by David. Lay (DL) Module Properties of Matrices System of Linear Equation DL (Recommended):..6, 22, 3.6.8, 4, 5.7., 3, 5,.8., 3, 5, 2 Module 2 Linear Independence Inverse of Matrix Linear Systems and Inverses Determinants DL(Recommended): 2..3, 5, 7,, 5, 6, 9, , 9,, 9, , 9, Eigenvalues/Eigenvectors ramer s Rule Orthogonality(?) DL(Recommended): 5..3, 4, 5, 7, , ,, , 5, , , 9, Module 3
2 Linear lgebra: Module. Module Topics:.. Linear Equation System of Linear Equations Method of Substitution Gaussian Elimination Gauss-Jordan Elimination Matrix Methods a x + a 2 x 2 + ::: + a n x n = b 4x 5x = x! rearranged! x 2 = 2( p 6 x ) + x 3! rearranged!..2 Systems of Linear Equations ollection of one or more linear equations involving ollection of one or more linear equations involving same variables say x ; :::; x n. n example is x 2x 2 + x 3 = 2x 2 8x 3 = 8 4x + 5x 2 + 9x 3 = 9 More generally, we might have a system of m equations in n unknowns a x + a 2 x 2 + ::: + a n x n = b a 2 x + a 22 x 2 + ::: + a 2n x n = b 2... a m x + a m2 x 2 + ::: + a mn x n = b m Examples for this workshop were drawn from Lay (23) Linear lgebra and Its pplications, Leon(22) Linear lgebra with pplications (6th Edition), and Harvard University s Political Science Math (P)refresher. 2
3 The set of all possible solutions is called the solution set of the linear system. Two linear systems are called equivalent if they have the same solution sets. Finding the solution set of a system of two linear equations in two variables is easy because it amounts to nding the intersection of two lines. x + x 2 = x 2x 2 = 3 x + x 2 = 3 x + x 2 = 2x 4x 2 = 8 2x 2x 2 = 6 If there are three equations in three variables, each equation would de ne a plane in a 3 dimensional space. Same reasoning applies. If there are more than 3 variables, the intersection of hyperplanes would determine the solution set...3 Strategies for Solving a System In order to solve the system of linear equations, we can utilize all or one of the following three strategies:. Substitution 2. Elimination (of variables) 3. Matrix Methods Method of Substitution Steps:. Solve one equation for one variable, say x, in terms of the other variables in the equation 2. Substitute the expression for x into the other m equations, resulting in a new system of m equations in n unknowns. 3. Repeat steps & 2 until one equation in one unknown, say x n. We now have a value for x n. 4. ackward substitution: substitute x n into previous equation(s). Repeat using the successive expressions of each variable in terms of the other variables to nd the values of all x i s. Using substitution, solve: x 2x 2 = x + 3x 2 = 3 3
4 Using substitution, solve: x 2x 2 + x 3 = 2x 2 8x 3 = 8 4x + 5x 2 + 9x 3 = 9 Method of Elimination a) Elementary Row Operations Elementary row operations are used to transform the equations of a linear system, while maintaining an equivalent linear system equivalent in the sense that the same values of xj solve both the original and transformed systems. These operations are. (Replacement) dd one row to a multiple of another row. 2. (Interchange) Interchange two rows. 3. (Scaling) Multiply all entries in a row by a nonzero constant. Take Example 2, for instance, we can: dd the st row to the 2nd row of equation to get: x 2x 2 = x 2 = 2 Then use backward substitution to get x = 3 x 2 = 2 We can apply the similar procedure to solve for Example 3 x 2x 2 + x 3 = 2x 2 8x 3 = 8 4x + 5x 2 + 9x 3 = 9 (i) To do so, add 4 times st row to the 3rd row of equation. To get a new 3rd row of equation. (ii) Now, multiply equation 2 by 2 in order to obtain as the coe cient for x 2. (This calculation will simplify the arithmetic for the next step.) 4
5 (iii) Use the x 2 in equation 2 to eliminate the 3x 2 in equation 3 in order to obtain: (iv) The new system has a triangular form: We can use backward substitution to nd the solution set. heck to see if (29, 6, 3) is a solution of the original system. b) Gaussian Elimination Method by which we start with some linear system of m equations in n unknowns and use the elementary equation operations to eliminate variables until we arrive at an equivalent system of the form: a x + a 2x 2 + a 3x 3 + ::: + a nx n = b a 22x 2 + a 23x 3 + ::: + a 2nx n = b 2 a 33x 3 + ::: + a 3nx n = b 3 : : : : : : a mnx n = b m The bold faced coe cients are referred to as pivots. (Essentially similar to the method shown above) c) Gauss-Jordan Elimination 5
6 Takes the Gaussian elimination method one step further. Once the linear system is in the reduced form shown in the preceding section, elementary row operations and Gaussian eliminations are used to and (i) hange the coe cient of the pivot term in each equation to (ii) Eliminate all terms above each pivot in its column, resulting in a reduced, equivalent system. For a system of m equations in n unknowns, a typical reduced system would be: x = b x 2 = b 2 x 3 = b 3. :. :. : x n = b m d) Matrix Method Matrices provide an easy and e cient way to represent linear systems such as: a x + a 2 x 2 + ::: + a n x n = b a 2 x + a 22 x 2 + ::: + a 2n x n = b 2... a m x + a m2 x 2 + ::: + a mn x n = b m The m n coe cient matrix is an array of mn real numbers arranged in m rows by n columns. = a a 2 ::: a n a 2 : a 2n : : : a m a m2 ::: a mn The RHS of the linear system is represented by the vector b = b b 2 : ugmented matrix: when we append b to the coe cient matrix ; we get the augmented matrix ^ = [jb] b m 6
7 ^ = a a 2 ::: a n a 2 : a 2n : : : a m a m2 ::: a mn b b 2 : b m The rules of elementary row operations apply here. Gaussian elimination of the augmented matrix results in a row echelon form. a a 2 ::: a n b a 22 a 23 a 2n b 2 : : : a mn b m Note: (i) ll nonzero rows are above any rows of all zeros. (ii) Each leading entry of a row is in a column to the right of the leading entry of the row above it. (iii) ll entries in a column below a leading entry are zeros. Reduced row echelon form Satis es the following additional conditions (iv) The leading entry in each nonzero row is. (v) Each leading is the only nonzero entry in its column. a b a 22 b 2 : ::: : a mn b m In essence, this is the matrix equivalent of a linear system after Gauss-Jordan elimination. Exercise Solve the system using matrix method: x + x 2 = x x 2 = 3 x + 2x 2 = 2 7
8 Exercise 2 Solve the system using matrix method x + x 2 x 3 + 3x 4 = 3x + x 2 x 3 x 4 = 2x x 2 x 3 x 4 = Exercise 3 In the downtown section of a certain city, two sets of one way streets intersect as shown below. The average hourly volume tra c entering and leaving this section during rush hour is given in the diagram. Determine the amount of tra c between each of the four intersections. Rank, Uniqueness and onsistency s the exercises suggest, there are two fundamental questions that we may want to address when we are solving for a system of linear equations ) Is the system consistent? (Does a solution exist?) 2) If a solution exists, is it unique? (Is there one and only one solution?) We can determine whether one in nite, or no solutions exist if we know () the number of equations m, (2) the number of unknowns n, and (3) the rank of the matrix representing the linear system. Rank: number of nonzero rows in its row echelon form. 8
9 Example 4 Example 5 Example Rank = b 4 5 b 2 b 3 b 4 Rank = 2 ; b j 6= Rank = 4 Let be the coe cient matrix and ^ = [jb] be the augmented matrix. Then,. rank rank  ugmenting with b can never result in more zero rows than originally in itself. Suppose row i in is all zeros and that b i is non-zero. ugmenting with b will yield a non-zero row i in ^: 2. rank rows y de nition of a rank.3 3. rank columns Suppose there are more rows than columns (otherwise the previous rule applies). Each column can contain at most one pivot. y pivoting, all other entries in a column below the pivot are zeroed. Hence, there will only be as many non-zero rows as pivots, which will equal the number of columns. Existence of solutions:. Exactly one solution rank = rank  = rows = columns Necessary condition for a system to have a unique solution: that there be exactly as many equations as unknowns. 2. In nite solutions rank = rank; and columns > rank If a system has a solution and has more unknowns than equations, then it has in nitely many solutions. 9
10 3. No solution rank < rank  Then there is a zero-row i in s reduced echelon that corresponds to a non-zero row i in ^ s reduced echelon. Row i of the translates to the equation: x i + x i2 + ::: + x in = b i Where b i 6= : Hence, the system has no solution. Exercise 7 x + 2x 2 + x 3 = 2x + 4x 2 + 2x 3 = 3 Exercise 8 x + x 2 + x 3 + x 4 + x 5 = 2 x + x 2 + x 3 + 2x 4 + 2x 5 = 3 x + x 2 + x 3 + 2x 4 + 3x 5 = 2 2 Linear lgebra: Module 2 2. Module Topics: 2 Linear Independence Matrix lgebra Inverse Determinants ramer s Rule Eigenvalues & Eigenvectors 2.. Linear Independence Let v ; v 2 ; ::::; v n be a set of n vectors each of which is of order m. Then the set of vectors is linearly dependent if there exist scalars a ; a 2 ; :::; a n at least one of which is not such that Or a v + a 2 v 2 + a 3 v 3 + ::: + a n v n = 2 Examples for this workshop were drawn from Lay (23) Linear lgebra and Its pplications, Leon(22) Linear lgebra with pplications (6th Edition), and Harvard University s Political Science Math (P)refresher.
11 V a = Example 9 Is there linear dependence? v = 2 3 v 2 = v 3 = 2 Hint: We can try to augment these vectors into a matrix and solve for a reduced row echelon form and see if we can nd some relationship between the rows. If we can determine some functional linear relationship between these vectors, we can say that there is linear dependence Matrix lgebra Matrix: matrix is an array of mn real numbers arranged in m rows by n column. a a 2 ::: a n = a 2 a 22 a 2n : : a m a m2 ::: a mn Matrix addition (or subtraction): Let and be two m n matrices. Then a + b a 2 + b 2 ::: a n + b n + = a 2 + b 2 a 22 + b 22 ::: a 2n + b 2n : a m + b m a m2 + b m2 :::: a mn + b mn Note: and must be the same size! Example = Example = Example = is Scalar Multiplication: Given the scalar s, the scalar multiplication of s
12 s = s a a 2 ::: a n a 2 a 22 a 2n : : a m a m2 ::: a mn = sa sa 2 ::: sa n sa 2 sa 22 sa 2n : : sa m sa m2 ::: sa mn Matrix multiplication: If is an m n matrix and is a k n matrix, then their product = is an m n matrix where So If = c ij = a i b j + a i2 b 2j + ::: + a ik b kj 2 3 = and = 4 5 then, =? 3 6 Note: the number of columns of the rst matrix must equal the number of rows of the second matrix. The size of the matrices (including the resulting product) must be: (m k)(k n) = (m n) Using matrix multiplication, we can now write the linear equation. a a 2 ::: a n Let be a m n coe cient matrix a 2 a 22 a 2n : : a m a m2 ::: a mn x be a m vector array of unknowns x x 2 : x m b be a m vector array of constants b b 2 : b m Then, 2
13 x = b a x + a 2 x 2 + ::: + a n x m = b a 2 x + a 22 x 2 + ::: + a 2n x m = b 2 : : a m x + a m2 x 2 + ::: + a mn x m = b m 2..3 Law of Matrix lgebra. ssociative ( + ) + = + ( + ) () = () 2. ommutative + = + Question: Is multiplication of matrices commutative? 6= or =?an you think of an example that can show whether one or the other? 3. Distributive ( + ) = + ( + ) = + 2 Exercise 3 If = 3 4 Solve a) () b) () c) ( + ) d) + If = and = then, 2 =? 3 =? n =? and = 2. Transpose Transpose of the m n matrix is the n m matrix T interchanging the rows and columns of. obtained by The following rules apply for transposed matrices a) ( + ) T = T + T b) ( T ) T = c).(s) T = s T 3
14 Exercise 4 = for T T and () T = Solve d) () T = T T 2..4 The Inverse of a Matrix Identity Matrix: The n n identity matrix I n is the matrix whose diagonal elements are and all o -diagonal elements are. So I n = a a 2 ::: a n a 2 a 22 a 2n : : a m a m2 ::: a mn where all diagonal a = a 22 = a 33 = ::: = a mn = and all other o -diagonal elements are. Inverse Matrix: n n matrix is nonsingular or invertible if there exists an n n matrix such that = = I n is the inverse of. If there is no such ; then is singular or noninvertible. Invertible: a Let = c b d (2:) If ad bc 6=, then is invertible (or nonsingular) d b and = ad bc c a Properties of Inverse. If the inverse exists, it is unique 2. nonsingular! nonsingular ( ) = 3. and nonsingular! nonsingular () = 4
15 4. nonsingular! ( T ) = ( ) T Exercise 5 Find if = 2 = Determinants If = (a) is a matrix, then will have a multiplicative inverse if and only if a 6= : Thus, if we de ne, det() = a then will be nonsingular if and only if det() 6= : Hence, the determinant will equal zero when the inverse does not exist. Since the inverse of a, a, does not exist when a =, we let the determinant of a be a: 2 2 Matrix a a Let = 2 a 2 a 22 In order to nd its determinant,. Multiply the second row of by a 2. Subtract a 2 times the rst row from the new second row There are two alternatives to this method: a) Take the rst upper left hand corner element and eliminate its corresponding row and column elements; then multiply with the remaining element(s). Do the same for all other rst row elements alternating subtraction and addition. b) Simply multiply the diagonal elemtns together and subtract the product of the upper left hand element in the matrix to that of the other. The determinant is of the form: a a 22 a 2 a 2 6= We say that is nonsingular only if a a 22 determinant of a 2 2 matrix as a 2 a 2 6= : We then de ne the 5
16 a a 2 a 2 a 22 = a a 22 a 2 a 2 = a ja 22 j a 2 ja 2 j a a 2 a 3 a 2 a 22 a 23 a 3 a 32 a 33 Extending this to a 3 3 matrix we get = a a 22 a 23 a a 32 a 33 a 2 a 23 2 a 3 a 33 + a 3 a 2 a 22 a 3 a 32 For n 2, the determinant of an n n matrix = [a ij ] is given by nx det = a det a 2 det 2 +:::+( ) +n a n det n = ( ) +j a j det j For a triangular or diagonal matrices, the determinant is just the product of the diagonal terms. Example: R = r r 2 r 3 r 22 r 23 r 33 j= Then jrj = r r 22 r 23 r 33 = r r 22 r 33 Exercise 6 Exercise Shortcut for a 3 3 matrix: a a 2 a 3 a 2 a 22 a 23 a 3 a 32 a 33 = (a a 22 a 33 + a 2 a 23 a 3 + a 2 a 32 a 3 ) (a 3 a 22 a 3 + a 2 a 2 a 33 + a 23 a 32 a ) 6
17 Properties of determinants. jj = j T j 2. If results from by interchanging two rows, thenjj = j j 3. If two rows of are equal, then jj = 4. If a row of consists of all zeros, then jj = 5. If is obtained by multiplying a row of by a scalar s, then jj = jsj 6. If is obtained from by adding to the ith row of the jth row (i 6= j) multiplied by a scalar s, then jj = jj 7. If no row interchanges and no scalar multplicatinos of a single row are used to compute the row echelon form R from the n n coe cient matrix, then jj = jrj 8. square matrix is nonsingular if and only if its determinent is not zero 9. jj = jj jj. If is nonsingular, then jj 6= and j j = jj Knowing the determinant is useful. For instance, we can calculate the matrix inverse if we know its determinant: = jj adj() entry is ji: where adj() [adjoint of ] is a nn matrix whose (i,j)th So, if we see equation 2., adj = a22 a 2 a 2 a For a 3 3 matrix, the adjoint is the transpose of the cofactors 2 2 If = adj() = 2 3 Using above de nition of an inverse, calculate = 7
18 2..5 ramer s Rule Let be a n n nonsingular matrix and let b 2 R n : Let i be the matrix obtained by replacing the ith column of by b. If x is the unique aolution to x = b; then x i = det(i) det() for i = ; 2; :::; n Use ramer s Rule to solve x + 2x 2 + x 3 = 5 2x + 2x 2 + x 3 = 6 x + 2x 2 + 3x 3 = 9 Note: ramer s rule gives us a convenient method for writing the solution to a n n system of linear equations in terms of determinants. However, we must evaluate n+ determinents of order n if we wish to use ramer s Rule. Evaluating even two of these determinants generally involves more computation than solving the system using Gaussian elimination technique Eigenvalues & Eigenvectors onsider the following: Given a k k matrix, can we nd a scalar and a nonzero vector x such that x = x? The answer to this question is a "yes". In fact, there exists k (possibly nondistinct) values for and in ntely many vectors x satisfying this condition. This is known as the eigenvalue/eigenvector problem. 8
19 How do we calculate them? 2..7 Some useful application of linear algebra: Linear Regression lthough linear algebra may seem impractical for rst time users, it is a very useful tool for understanding the theoretical basis of linear regression. To illustrate, if we have a collection of data where the dependent variable is y and explanatory variables are series of X s, we can represent them using matrix notations as: y = y y 2 : y n X = x x 2 ::: x k x 2 x 22 : : : : x n x n2 ::: x nk If we wish to represent the relationship between these two variables y and X using linear regression, they are: y = X + " where represents the coreponding coe cient vector based on the data y and X, and " is the random error term. The most popular method of estimating is by using the least squares method where we seek to minimize the sum of the squared elements of ": That is, we seek to minimize nx " 2 i = "T " = (y X) T (y X) i= 9
20 One way to do this is to nd the derivative of the above equation with respect to and then set it equal to zero and solve for : This yields: X T X = X T y If we minimize this term, we can obtain the coe cient estimate ^ ^ = (X T X) X T y So we can actually try this with real data to see if it works. Let y be the price in thousands of dollars Let x be the lot size (in hundreds of square yards). Let x 2 be the number of bedrooms y = 22 5 X = Find the linear relationship between y and X. 2
Matrix & Linear Algebra
Matrix & Linear Algebra Jamie Monogan University of Georgia For more information: http://monogan.myweb.uga.edu/teaching/mm/ Jamie Monogan (UGA) Matrix & Linear Algebra 1 / 84 Vectors Vectors Vector: A
More informationMATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 1 x 2. x n 8 (4) 3 4 2
MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS SYSTEMS OF EQUATIONS AND MATRICES Representation of a linear system The general system of m equations in n unknowns can be written a x + a 2 x 2 + + a n x n b a
More informationMAC Module 3 Determinants. Learning Objectives. Upon completing this module, you should be able to:
MAC 2 Module Determinants Learning Objectives Upon completing this module, you should be able to:. Determine the minor, cofactor, and adjoint of a matrix. 2. Evaluate the determinant of a matrix by cofactor
More informationChapter 1: Systems of linear equations and matrices. Section 1.1: Introduction to systems of linear equations
Chapter 1: Systems of linear equations and matrices Section 1.1: Introduction to systems of linear equations Definition: A linear equation in n variables can be expressed in the form a 1 x 1 + a 2 x 2
More informationMath Camp II. Basic Linear Algebra. Yiqing Xu. Aug 26, 2014 MIT
Math Camp II Basic Linear Algebra Yiqing Xu MIT Aug 26, 2014 1 Solving Systems of Linear Equations 2 Vectors and Vector Spaces 3 Matrices 4 Least Squares Systems of Linear Equations Definition A linear
More informationFundamentals of Engineering Analysis (650163)
Philadelphia University Faculty of Engineering Communications and Electronics Engineering Fundamentals of Engineering Analysis (6563) Part Dr. Omar R Daoud Matrices: Introduction DEFINITION A matrix is
More informationCHAPTER 6. Direct Methods for Solving Linear Systems
CHAPTER 6 Direct Methods for Solving Linear Systems. Introduction A direct method for approximating the solution of a system of n linear equations in n unknowns is one that gives the exact solution to
More informationSystem of Linear Equations
Chapter 7 - S&B Gaussian and Gauss-Jordan Elimination We will study systems of linear equations by describing techniques for solving such systems. The preferred solution technique- Gaussian elimination-
More informationElementary maths for GMT
Elementary maths for GMT Linear Algebra Part 2: Matrices, Elimination and Determinant m n matrices The system of m linear equations in n variables x 1, x 2,, x n a 11 x 1 + a 12 x 2 + + a 1n x n = b 1
More information1 Determinants. 1.1 Determinant
1 Determinants [SB], Chapter 9, p.188-196. [SB], Chapter 26, p.719-739. Bellow w ll study the central question: which additional conditions must satisfy a quadratic matrix A to be invertible, that is to
More informationMAC Module 2 Systems of Linear Equations and Matrices II. Learning Objectives. Upon completing this module, you should be able to :
MAC 0 Module Systems of Linear Equations and Matrices II Learning Objectives Upon completing this module, you should be able to :. Find the inverse of a square matrix.. Determine whether a matrix is invertible..
More information1 Multiply Eq. E i by λ 0: (λe i ) (E i ) 2 Multiply Eq. E j by λ and add to Eq. E i : (E i + λe j ) (E i )
Direct Methods for Linear Systems Chapter Direct Methods for Solving Linear Systems Per-Olof Persson persson@berkeleyedu Department of Mathematics University of California, Berkeley Math 18A Numerical
More informationa11 a A = : a 21 a 22
Matrices The study of linear systems is facilitated by introducing matrices. Matrix theory provides a convenient language and notation to express many of the ideas concisely, and complicated formulas are
More informationA Review of Matrix Analysis
Matrix Notation Part Matrix Operations Matrices are simply rectangular arrays of quantities Each quantity in the array is called an element of the matrix and an element can be either a numerical value
More informationMTH 2530: Linear Algebra. Sec Systems of Linear Equations
MTH 0 Linear Algebra Professor Chao Huang Department of Mathematics and Statistics Wright State University Week # Section.,. Sec... Systems of Linear Equations... D examples Example Consider a system of
More informationMath Camp Lecture 4: Linear Algebra. Xiao Yu Wang. Aug 2010 MIT. Xiao Yu Wang (MIT) Math Camp /10 1 / 88
Math Camp 2010 Lecture 4: Linear Algebra Xiao Yu Wang MIT Aug 2010 Xiao Yu Wang (MIT) Math Camp 2010 08/10 1 / 88 Linear Algebra Game Plan Vector Spaces Linear Transformations and Matrices Determinant
More informationCHAPTER 8: Matrices and Determinants
(Exercises for Chapter 8: Matrices and Determinants) E.8.1 CHAPTER 8: Matrices and Determinants (A) means refer to Part A, (B) means refer to Part B, etc. Most of these exercises can be done without a
More informationPOLI270 - Linear Algebra
POLI7 - Linear Algebra Septemer 8th Basics a x + a x +... + a n x n b () is the linear form where a, b are parameters and x n are variables. For a given equation such as x +x you only need a variable and
More informationMath Linear Algebra Final Exam Review Sheet
Math 15-1 Linear Algebra Final Exam Review Sheet Vector Operations Vector addition is a component-wise operation. Two vectors v and w may be added together as long as they contain the same number n of
More informationChapter 4 - MATRIX ALGEBRA. ... a 2j... a 2n. a i1 a i2... a ij... a in
Chapter 4 - MATRIX ALGEBRA 4.1. Matrix Operations A a 11 a 12... a 1j... a 1n a 21. a 22.... a 2j... a 2n. a i1 a i2... a ij... a in... a m1 a m2... a mj... a mn The entry in the ith row and the jth column
More informationMath 4A Notes. Written by Victoria Kala Last updated June 11, 2017
Math 4A Notes Written by Victoria Kala vtkala@math.ucsb.edu Last updated June 11, 2017 Systems of Linear Equations A linear equation is an equation that can be written in the form a 1 x 1 + a 2 x 2 +...
More informationMAC Module 1 Systems of Linear Equations and Matrices I
MAC 2103 Module 1 Systems of Linear Equations and Matrices I 1 Learning Objectives Upon completing this module, you should be able to: 1. Represent a system of linear equations as an augmented matrix.
More informationLinear Algebra. Matrices Operations. Consider, for example, a system of equations such as x + 2y z + 4w = 0, 3x 4y + 2z 6w = 0, x 3y 2z + w = 0.
Matrices Operations Linear Algebra Consider, for example, a system of equations such as x + 2y z + 4w = 0, 3x 4y + 2z 6w = 0, x 3y 2z + w = 0 The rectangular array 1 2 1 4 3 4 2 6 1 3 2 1 in which the
More informationMATH 315 Linear Algebra Homework #1 Assigned: August 20, 2018
Homework #1 Assigned: August 20, 2018 Review the following subjects involving systems of equations and matrices from Calculus II. Linear systems of equations Converting systems to matrix form Pivot entry
More informationIntroduction to Matrices and Linear Systems Ch. 3
Introduction to Matrices and Linear Systems Ch. 3 Doreen De Leon Department of Mathematics, California State University, Fresno June, 5 Basic Matrix Concepts and Operations Section 3.4. Basic Matrix Concepts
More informationTopics. Vectors (column matrices): Vector addition and scalar multiplication The matrix of a linear function y Ax The elements of a matrix A : A ij
Topics Vectors (column matrices): Vector addition and scalar multiplication The matrix of a linear function y Ax The elements of a matrix A : A ij or a ij lives in row i and column j Definition of a matrix
More informationFinite Mathematics Chapter 2. where a, b, c, d, h, and k are real numbers and neither a and b nor c and d are both zero.
Finite Mathematics Chapter 2 Section 2.1 Systems of Linear Equations: An Introduction Systems of Equations Recall that a system of two linear equations in two variables may be written in the general form
More informationGraduate Mathematical Economics Lecture 1
Graduate Mathematical Economics Lecture 1 Yu Ren WISE, Xiamen University September 23, 2012 Outline 1 2 Course Outline ematical techniques used in graduate level economics courses Mathematics for Economists
More informationMATH 240 Spring, Chapter 1: Linear Equations and Matrices
MATH 240 Spring, 2006 Chapter Summaries for Kolman / Hill, Elementary Linear Algebra, 8th Ed. Sections 1.1 1.6, 2.1 2.2, 3.2 3.8, 4.3 4.5, 5.1 5.3, 5.5, 6.1 6.5, 7.1 7.2, 7.4 DEFINITIONS Chapter 1: Linear
More informationEquality: Two matrices A and B are equal, i.e., A = B if A and B have the same order and the entries of A and B are the same.
Introduction Matrix Operations Matrix: An m n matrix A is an m-by-n array of scalars from a field (for example real numbers) of the form a a a n a a a n A a m a m a mn The order (or size) of A is m n (read
More informationLecture Notes in Linear Algebra
Lecture Notes in Linear Algebra Dr. Abdullah Al-Azemi Mathematics Department Kuwait University February 4, 2017 Contents 1 Linear Equations and Matrices 1 1.2 Matrices............................................
More informationMAC Learning Objectives. Learning Objectives (Cont.) Module 10 System of Equations and Inequalities II
MAC 1140 Module 10 System of Equations and Inequalities II Learning Objectives Upon completing this module, you should be able to 1. represent systems of linear equations with matrices. 2. transform a
More informationThings we can already do with matrices. Unit II - Matrix arithmetic. Defining the matrix product. Things that fail in matrix arithmetic
Unit II - Matrix arithmetic matrix multiplication matrix inverses elementary matrices finding the inverse of a matrix determinants Unit II - Matrix arithmetic 1 Things we can already do with matrices equality
More informationLinear Algebra: Lecture notes from Kolman and Hill 9th edition.
Linear Algebra: Lecture notes from Kolman and Hill 9th edition Taylan Şengül March 20, 2019 Please let me know of any mistakes in these notes Contents Week 1 1 11 Systems of Linear Equations 1 12 Matrices
More informationIntroduction to Matrices
POLS 704 Introduction to Matrices Introduction to Matrices. The Cast of Characters A matrix is a rectangular array (i.e., a table) of numbers. For example, 2 3 X 4 5 6 (4 3) 7 8 9 0 0 0 Thismatrix,with4rowsand3columns,isoforder
More informationECON 186 Class Notes: Linear Algebra
ECON 86 Class Notes: Linear Algebra Jijian Fan Jijian Fan ECON 86 / 27 Singularity and Rank As discussed previously, squareness is a necessary condition for a matrix to be nonsingular (have an inverse).
More informationChapter 1. Vectors, Matrices, and Linear Spaces
1.4 Solving Systems of Linear Equations 1 Chapter 1. Vectors, Matrices, and Linear Spaces 1.4. Solving Systems of Linear Equations Note. We give an algorithm for solving a system of linear equations (called
More informationMatrices and systems of linear equations
Matrices and systems of linear equations Samy Tindel Purdue University Differential equations and linear algebra - MA 262 Taken from Differential equations and linear algebra by Goode and Annin Samy T.
More informationGAUSSIAN ELIMINATION AND LU DECOMPOSITION (SUPPLEMENT FOR MA511)
GAUSSIAN ELIMINATION AND LU DECOMPOSITION (SUPPLEMENT FOR MA511) D. ARAPURA Gaussian elimination is the go to method for all basic linear classes including this one. We go summarize the main ideas. 1.
More informationChapter 5. Linear Algebra. A linear (algebraic) equation in. unknowns, x 1, x 2,..., x n, is. an equation of the form
Chapter 5. Linear Algebra A linear (algebraic) equation in n unknowns, x 1, x 2,..., x n, is an equation of the form a 1 x 1 + a 2 x 2 + + a n x n = b where a 1, a 2,..., a n and b are real numbers. 1
More informationLinear Algebra and Matrix Inversion
Jim Lambers MAT 46/56 Spring Semester 29- Lecture 2 Notes These notes correspond to Section 63 in the text Linear Algebra and Matrix Inversion Vector Spaces and Linear Transformations Matrices are much
More informationElementary Row Operations on Matrices
King Saud University September 17, 018 Table of contents 1 Definition A real matrix is a rectangular array whose entries are real numbers. These numbers are organized on rows and columns. An m n matrix
More informationMath 240 Calculus III
The Calculus III Summer 2015, Session II Wednesday, July 8, 2015 Agenda 1. of the determinant 2. determinants 3. of determinants What is the determinant? Yesterday: Ax = b has a unique solution when A
More informationReview of Vectors and Matrices
A P P E N D I X D Review of Vectors and Matrices D. VECTORS D.. Definition of a Vector Let p, p, Á, p n be any n real numbers and P an ordered set of these real numbers that is, P = p, p, Á, p n Then P
More informationLINEAR SYSTEMS, MATRICES, AND VECTORS
ELEMENTARY LINEAR ALGEBRA WORKBOOK CREATED BY SHANNON MARTIN MYERS LINEAR SYSTEMS, MATRICES, AND VECTORS Now that I ve been teaching Linear Algebra for a few years, I thought it would be great to integrate
More informationMatrix Algebra. Matrix Algebra. Chapter 8 - S&B
Chapter 8 - S&B Algebraic operations Matrix: The size of a matrix is indicated by the number of its rows and the number of its columns. A matrix with k rows and n columns is called a k n matrix. The number
More information22A-2 SUMMER 2014 LECTURE 5
A- SUMMER 0 LECTURE 5 NATHANIEL GALLUP Agenda Elimination to the identity matrix Inverse matrices LU factorization Elimination to the identity matrix Previously, we have used elimination to get a system
More informationIntroduction. Vectors and Matrices. Vectors [1] Vectors [2]
Introduction Vectors and Matrices Dr. TGI Fernando 1 2 Data is frequently arranged in arrays, that is, sets whose elements are indexed by one or more subscripts. Vector - one dimensional array Matrix -
More informationVectors and matrices: matrices (Version 2) This is a very brief summary of my lecture notes.
Vectors and matrices: matrices (Version 2) This is a very brief summary of my lecture notes Matrices and linear equations A matrix is an m-by-n array of numbers A = a 11 a 12 a 13 a 1n a 21 a 22 a 23 a
More informationUndergraduate Mathematical Economics Lecture 1
Undergraduate Mathematical Economics Lecture 1 Yu Ren WISE, Xiamen University September 15, 2014 Outline 1 Courses Description and Requirement 2 Course Outline ematical techniques used in economics courses
More information7.6 The Inverse of a Square Matrix
7.6 The Inverse of a Square Matrix Copyright Cengage Learning. All rights reserved. What You Should Learn Verify that two matrices are inverses of each other. Use Gauss-Jordan elimination to find inverses
More informationMATRICES. knowledge on matrices Knowledge on matrix operations. Matrix as a tool of solving linear equations with two or three unknowns.
MATRICES After studying this chapter you will acquire the skills in knowledge on matrices Knowledge on matrix operations. Matrix as a tool of solving linear equations with two or three unknowns. List of
More informationReview of Basic Concepts in Linear Algebra
Review of Basic Concepts in Linear Algebra Grady B Wright Department of Mathematics Boise State University September 7, 2017 Math 565 Linear Algebra Review September 7, 2017 1 / 40 Numerical Linear Algebra
More informationECON0702: Mathematical Methods in Economics
ECON0702: Mathematical Methods in Economics Yulei Luo SEF of HKU January 12, 2009 Luo, Y. (SEF of HKU) MME January 12, 2009 1 / 35 Course Outline Economics: The study of the choices people (consumers,
More informationMath 313 Chapter 1 Review
Math 313 Chapter 1 Review Howard Anton, 9th Edition May 2010 Do NOT write on me! Contents 1 1.1 Introduction to Systems of Linear Equations 2 2 1.2 Gaussian Elimination 3 3 1.3 Matrices and Matrix Operations
More informationElementary matrices, continued. To summarize, we have identified 3 types of row operations and their corresponding
Elementary matrices, continued To summarize, we have identified 3 types of row operations and their corresponding elementary matrices. If you check the previous examples, you ll find that these matrices
More informationIntroduction to Matrices
214 Analysis and Design of Feedback Control Systems Introduction to Matrices Derek Rowell October 2002 Modern system dynamics is based upon a matrix representation of the dynamic equations governing the
More informationLemma 8: Suppose the N by N matrix A has the following block upper triangular form:
17 4 Determinants and the Inverse of a Square Matrix In this section, we are going to use our knowledge of determinants and their properties to derive an explicit formula for the inverse of a square matrix
More informationElementary Linear Algebra
Elementary Linear Algebra Linear algebra is the study of; linear sets of equations and their transformation properties. Linear algebra allows the analysis of; rotations in space, least squares fitting,
More informationLinear Algebra Primer
Linear Algebra Primer David Doria daviddoria@gmail.com Wednesday 3 rd December, 2008 Contents Why is it called Linear Algebra? 4 2 What is a Matrix? 4 2. Input and Output.....................................
More informationLinear Algebra March 16, 2019
Linear Algebra March 16, 2019 2 Contents 0.1 Notation................................ 4 1 Systems of linear equations, and matrices 5 1.1 Systems of linear equations..................... 5 1.2 Augmented
More information4 Elementary matrices, continued
4 Elementary matrices, continued We have identified 3 types of row operations and their corresponding elementary matrices. If you check the previous examples, you ll find that these matrices are constructed
More informationLinear Algebra. The analysis of many models in the social sciences reduces to the study of systems of equations.
POLI 7 - Mathematical and Statistical Foundations Prof S Saiegh Fall Lecture Notes - Class 4 October 4, Linear Algebra The analysis of many models in the social sciences reduces to the study of systems
More informationReview of Linear Algebra
Review of Linear Algebra Definitions An m n (read "m by n") matrix, is a rectangular array of entries, where m is the number of rows and n the number of columns. 2 Definitions (Con t) A is square if m=
More information4 Elementary matrices, continued
4 Elementary matrices, continued We have identified 3 types of row operations and their corresponding elementary matrices. To repeat the recipe: These matrices are constructed by performing the given row
More informationPresentation by: H. Sarper. Chapter 2 - Learning Objectives
Chapter Basic Linear lgebra to accompany Introduction to Mathematical Programming Operations Research, Volume, th edition, by Wayne L. Winston and Munirpallam Venkataramanan Presentation by: H. Sarper
More informationBasic Concepts in Linear Algebra
Basic Concepts in Linear Algebra Grady B Wright Department of Mathematics Boise State University February 2, 2015 Grady B Wright Linear Algebra Basics February 2, 2015 1 / 39 Numerical Linear Algebra Linear
More informationELEMENTARY LINEAR ALGEBRA WITH APPLICATIONS. 1. Linear Equations and Matrices
ELEMENTARY LINEAR ALGEBRA WITH APPLICATIONS KOLMAN & HILL NOTES BY OTTO MUTZBAUER 11 Systems of Linear Equations 1 Linear Equations and Matrices Numbers in our context are either real numbers or complex
More informationGaussian Elimination and Back Substitution
Jim Lambers MAT 610 Summer Session 2009-10 Lecture 4 Notes These notes correspond to Sections 31 and 32 in the text Gaussian Elimination and Back Substitution The basic idea behind methods for solving
More information3. Vector spaces 3.1 Linear dependence and independence 3.2 Basis and dimension. 5. Extreme points and basic feasible solutions
A. LINEAR ALGEBRA. CONVEX SETS 1. Matrices and vectors 1.1 Matrix operations 1.2 The rank of a matrix 2. Systems of linear equations 2.1 Basic solutions 3. Vector spaces 3.1 Linear dependence and independence
More informationChapter 2:Determinants. Section 2.1: Determinants by cofactor expansion
Chapter 2:Determinants Section 2.1: Determinants by cofactor expansion [ ] a b Recall: The 2 2 matrix is invertible if ad bc 0. The c d ([ ]) a b function f = ad bc is called the determinant and it associates
More information1 Matrices and Systems of Linear Equations. a 1n a 2n
March 31, 2013 16-1 16. Systems of Linear Equations 1 Matrices and Systems of Linear Equations An m n matrix is an array A = (a ij ) of the form a 11 a 21 a m1 a 1n a 2n... a mn where each a ij is a real
More informationLinear Systems and Matrices
Department of Mathematics The Chinese University of Hong Kong 1 System of m linear equations in n unknowns (linear system) a 11 x 1 + a 12 x 2 + + a 1n x n = b 1 a 21 x 1 + a 22 x 2 + + a 2n x n = b 2.......
More informationSystems of Linear Equations and Matrices
Chapter 1 Systems of Linear Equations and Matrices System of linear algebraic equations and their solution constitute one of the major topics studied in the course known as linear algebra. In the first
More informationMatrices. In this chapter: matrices, determinants. inverse matrix
Matrices In this chapter: matrices, determinants inverse matrix 1 1.1 Matrices A matrix is a retangular array of numbers. Rows: horizontal lines. A = a 11 a 12 a 13 a 21 a 22 a 23 a 31 a 32 a 33 a 41 a
More informationA matrix is a rectangular array of. objects arranged in rows and columns. The objects are called the entries. is called the size of the matrix, and
Section 5.5. Matrices and Vectors A matrix is a rectangular array of objects arranged in rows and columns. The objects are called the entries. A matrix with m rows and n columns is called an m n matrix.
More informationGlossary of Linear Algebra Terms. Prepared by Vince Zaccone For Campus Learning Assistance Services at UCSB
Glossary of Linear Algebra Terms Basis (for a subspace) A linearly independent set of vectors that spans the space Basic Variable A variable in a linear system that corresponds to a pivot column in the
More informationMathematics. EC / EE / IN / ME / CE. for
Mathematics for EC / EE / IN / ME / CE By www.thegateacademy.com Syllabus Syllabus for Mathematics Linear Algebra: Matrix Algebra, Systems of Linear Equations, Eigenvalues and Eigenvectors. Probability
More informationSystems of Linear Equations and Matrices
Chapter 1 Systems of Linear Equations and Matrices System of linear algebraic equations and their solution constitute one of the major topics studied in the course known as linear algebra. In the first
More informationA matrix is a rectangular array of. objects arranged in rows and columns. The objects are called the entries. is called the size of the matrix, and
Section 5.5. Matrices and Vectors A matrix is a rectangular array of objects arranged in rows and columns. The objects are called the entries. A matrix with m rows and n columns is called an m n matrix.
More informationMAC1105-College Algebra. Chapter 5-Systems of Equations & Matrices
MAC05-College Algebra Chapter 5-Systems of Equations & Matrices 5. Systems of Equations in Two Variables Solving Systems of Two Linear Equations/ Two-Variable Linear Equations A system of equations is
More informationCalculating determinants for larger matrices
Day 26 Calculating determinants for larger matrices We now proceed to define det A for n n matrices A As before, we are looking for a function of A that satisfies the product formula det(ab) = det A det
More informationMATH 213 Linear Algebra and ODEs Spring 2015 Study Sheet for Midterm Exam. Topics
MATH 213 Linear Algebra and ODEs Spring 2015 Study Sheet for Midterm Exam This study sheet will not be allowed during the test Books and notes will not be allowed during the test Calculators and cell phones
More informationENGI 9420 Lecture Notes 2 - Matrix Algebra Page Matrix operations can render the solution of a linear system much more efficient.
ENGI 940 Lecture Notes - Matrix Algebra Page.0. Matrix Algebra A linear system of m equations in n unknowns, a x + a x + + a x b (where the a ij and i n n a x + a x + + a x b n n a x + a x + + a x b m
More informationMATRICES. a m,1 a m,n A =
MATRICES Matrices are rectangular arrays of real or complex numbers With them, we define arithmetic operations that are generalizations of those for real and complex numbers The general form a matrix of
More informationChapter 4. Solving Systems of Equations. Chapter 4
Solving Systems of Equations 3 Scenarios for Solutions There are three general situations we may find ourselves in when attempting to solve systems of equations: 1 The system could have one unique solution.
More informationLinear Algebra review Powers of a diagonalizable matrix Spectral decomposition
Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Prof. Tesler Math 283 Fall 2016 Also see the separate version of this with Matlab and R commands. Prof. Tesler Diagonalizing
More informationDigital Workbook for GRA 6035 Mathematics
Eivind Eriksen Digital Workbook for GRA 6035 Mathematics November 10, 2014 BI Norwegian Business School Contents Part I Lectures in GRA6035 Mathematics 1 Linear Systems and Gaussian Elimination........................
More informationEvaluating Determinants by Row Reduction
Evaluating Determinants by Row Reduction MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 2015 Objectives Reduce a matrix to row echelon form and evaluate its determinant.
More informationLinear Algebra I Lecture 8
Linear Algebra I Lecture 8 Xi Chen 1 1 University of Alberta January 25, 2019 Outline 1 2 Gauss-Jordan Elimination Given a system of linear equations f 1 (x 1, x 2,..., x n ) = 0 f 2 (x 1, x 2,..., x n
More informationChapter 9: Systems of Equations and Inequalities
Chapter 9: Systems of Equations and Inequalities 9. Systems of Equations Solve the system of equations below. By this we mean, find pair(s) of numbers (x, y) (if possible) that satisfy both equations.
More informationChapter 2: Matrices and Linear Systems
Chapter 2: Matrices and Linear Systems Paul Pearson Outline Matrices Linear systems Row operations Inverses Determinants Matrices Definition An m n matrix A = (a ij ) is a rectangular array of real numbers
More informationSection 6.2 Larger Systems of Linear Equations
Section 6.2 Larger Systems of Linear Equations Gaussian Elimination In general, to solve a system of linear equations using its augmented matrix, we use elementary row operations to arrive at a matrix
More informationSection 9.2: Matrices.. a m1 a m2 a mn
Section 9.2: Matrices Definition: A matrix is a rectangular array of numbers: a 11 a 12 a 1n a 21 a 22 a 2n A =...... a m1 a m2 a mn In general, a ij denotes the (i, j) entry of A. That is, the entry in
More informationMATH Topics in Applied Mathematics Lecture 12: Evaluation of determinants. Cross product.
MATH 311-504 Topics in Applied Mathematics Lecture 12: Evaluation of determinants. Cross product. Determinant is a scalar assigned to each square matrix. Notation. The determinant of a matrix A = (a ij
More informationScientific Computing: Dense Linear Systems
Scientific Computing: Dense Linear Systems Aleksandar Donev Courant Institute, NYU 1 donev@courant.nyu.edu 1 Course MATH-GA.2043 or CSCI-GA.2112, Spring 2012 February 9th, 2012 A. Donev (Courant Institute)
More informationMath Camp Notes: Linear Algebra I
Math Camp Notes: Linear Algebra I Basic Matrix Operations and Properties Consider two n m matrices: a a m A = a n a nm Then the basic matrix operations are as follows: a + b a m + b m A + B = a n + b n
More informationLinear Algebra Highlights
Linear Algebra Highlights Chapter 1 A linear equation in n variables is of the form a 1 x 1 + a 2 x 2 + + a n x n. We can have m equations in n variables, a system of linear equations, which we want to
More informationGauss-Jordan Row Reduction and Reduced Row Echelon Form
Gauss-Jordan Row Reduction and Reduced Row Echelon Form If we put the augmented matrix of a linear system in reduced row-echelon form, then we don t need to back-substitute to solve the system. To put
More informationChapter 7. Linear Algebra: Matrices, Vectors,
Chapter 7. Linear Algebra: Matrices, Vectors, Determinants. Linear Systems Linear algebra includes the theory and application of linear systems of equations, linear transformations, and eigenvalue problems.
More information