Fundamentals of Engineering Analysis (650163)
|
|
- Meredith Berry
- 5 years ago
- Views:
Transcription
1 Philadelphia University Faculty of Engineering Communications and Electronics Engineering Fundamentals of Engineering Analysis (6563) Part Dr. Omar R Daoud
2 Matrices: Introduction DEFINITION A matrix is any rectangular array of numbers or functions o o o o o o o o o o a a n a m a mn The number of functions are called entries or elements of the matrix m stands for the number of rows n stands for the number of columns The size of the matrix is (m n) An (n n) matrix is called a squared matrix or a matrix of order n. A ( ) matrix is simply a constant or single function. A (m ) matrix is called a column vector. A ( n) matrix is called a row vector. Matrices are denoted by capital boldface letters A, B, C,, or by writing the general entry in brackets; thus A = [a jk ], and so on. Vectors are denoted by lowercase boldface letters a, b, or by its general component in brackets, a = [a j ], /7/8 Dr. Omar R Daoud
3 Matrices: Introduction Introduction The first matrix in has two rows, which are the horizontal lines of entries. Furthermore, it has three columns, which are the vertical lines of entries. The second and third matrices are square matrices, which means that each has as many rows as columns 3 and, respectively. a a a. 6 a a a x 4 e x, a a a, 6x 3 e 4x 3.3 5, a a a 3, /7/8 Dr. Omar R Daoud 3
4 Matrices: Introduction Introduction The entries of the second matrix have two indices, signifying their location within the matrix. The first index is the number of the row, and the second is the number of the column, a a a. 6 a a a x 4 e x, a a a, 6x 3 e 4x 3.3 5, a a a 3, together the entry s position is uniquely identified. For example, a 3 (read a two three) is in Row and Column 3, etc. The notation is standard and applies to all matrices, including those that are not square. /7/8 Dr. Omar R Daoud 4
5 Matrices: Introduction Introduction The fourth matrix has just one row and is called a row vector. The last matrix has just one column and is called a column vector. a a a. 6 a a a x 4 e x, a a a, 6x 3 e 4x 3.3 5, a a a 3, Because the goal of the indexing of entries was to uniquely identify the position of an element within a matrix, one index suffices for vectors, whether they are row or column vectors. Thus, the third entry of the row vector is denoted by a 3. /7/8 Dr. Omar R Daoud 5
6 Matrices: Arithmetic Operations DEFINITION Two matrices A = [a jk ] and B = [b jk ] are Equal, written A = B, if and only if they have the same size and the corresponding entries are equal, that is, a = b, a = b, and so on. Otherwise, they are called Different. DEFINITION 3 o The sum of two matrices A = [a jk ] and B = [b jk ] of the same size is written as A + B and has the entries a jk + b jk obtained by adding the corresponding entries of A and B. o Matrices of different sizes cannot be added. /7/8 Dr. Omar R Daoud 6
7 Matrices: Arithmetic Operations DEFINITION 4 The product of any m n matrix A = [a jk ] and any scalar c (number c) is written as ca The m n matrix ca = [ca jk ] obtained by multiplying each entry of A by c. DEFINITION 5 The product C = AB (in this order) of an m n matrix A = [a jk ] times an r p matrix B = [b jk ] is defined if and only if r = n and is then the m p matrix C = [c jk ] with n entries c a b a b a b a b jk jl lk j k j k jn nk l j,, m k,, p. The condition r = n means that the second factor, B, must have as many rows as the first factor, A, has columns, namely n. A diagram of sizes that shows when matrix multiplication is possible is as follows: A B = C [m n] [n p] = [m p]. /7/8 Dr. Omar R Daoud 7
8 Matrices: Arithmetic Operations Introduction Rules For the addition of matrices of the same size m n: (a) A B B A (b) ( A B) C A ( B C) (written A B C) (c) A A (d) A ( A). For scalar multiplication: (a) c( A B) ca cb (b) ( c k) A ca ka (c) c( ka) ( ck) A (written cka) (d) A A. Here denotes the zero matrix (of size m n), that is, the m n matrix with all entries zero From (a) and (b), the addition is commutative and associative /7/8 Dr. Omar R Daoud 8
9 Matrices: Arithmetic Operations Introduction Rules For matrix multiplication: In matrix products the order of factors must always be observed very carefully. Otherwise matrix multiplication satisfies rules similar to those for numbers, namely. (a) ( ka) B k( AB) A( kb) written kab or AkB (b) A( BC) ( AB) C written ABC (c) ( A B) C AC BC Provided A, B, and C are such that the expressions on the left are defined; here, k is any scalar. (d) C( A B) CA CB From (b) the multiplication is associative, and from (c) and (d) it is distributive. /7/8 Dr. Omar R Daoud 9
10 Matrices: Arithmetic Operations Introduction Rules For matrix Addition: Example: A + B = C = = Here c = 3+ = 5, c = 5- = 3, c 3 = -+ 3 =, and so on. The entry in the box is c 3 = = 3. /7/8 Dr. Omar R Daoud
11 Matrices: Arithmetic Operations Introduction Rules For matrix Addition: Example: A = = = Here k a ka ij ij /7/8 Dr. Omar R Daoud
12 Matrices: Arithmetic Operations A aij Introduction Rules For matrix multiplication: Example3 : k If is an n m matrix and B b m ij C= A.B c ij ik is an a b kj c ij mq matrix then is an nq matrix where AB Here c = ( ) 9 =, and so on. The entry in the box is c 3 = = 4. The product BA is not defined. /7/8 Dr. Omar R Daoud
13 Matrices: Arithmetic Operations Introduction Rules For matrix multiplication: Example: given A =, B = but Matrix Multiplication Is Not Commutative, AB BA in General, so AB = does not necessarily imply BA = or A = or B = /7/8 Dr. Omar R Daoud 3
14 Matrices: Arithmetic Operations column vectors and conversely. DEFINITION 6 The transpose of an m n matrix A = [a jk ] is the n m matrix A T (read A transpose) that has the first row of A as its first column, the second row of A as its second column, and so on. Thus the transpose of A is A T = [a kj ], written out A T If A is the given matrix, then we denote its transpose by A T As a special case, Transposition converts row vectors to For square matrices, we can also reflect the elements along the main diagonal. a a a m a a a m a. kj a a a n n mn Example : Given A = 9 5, find AT A T = 9 5 /7/8 Dr. Omar R Daoud 4
15 Matrices: Arithmetic Operations Introduction Rules For matrix transposition: T (a) ( A ) (b) ( A B) A B (c) ca) A ca T T T (d) ( AB) B A. T T T T T T Note that in (d) the transposed matrices are in reversed order. /7/8 Dr. Omar R Daoud 5
16 Matrices: Arithmetic Operations DEFINITION 7 Symmetric matrices are square matrices whose transpose equals the matrix itself A T = A (thus a kj = a jk ). A = 5 = A T 5 3 DEFINITION 8 Skew-symmetric matrices are square matrices whose transpose equals the minus matrix itself. A T = -A (thus a kj = -a jk ) hence a jj =. A = 3 3 = A T /7/8 Dr. Omar R Daoud 6
17 Matrices: Arithmetic Operations DEFINITION 9 Upper triangular matrices are square matrices that can have nonzero entries only on and above the main diagonal, whereas any entry below the diagonal must be zero. b b b 3 B = b b 3 b 33 Lower triangular matrices can have nonzero entries only on and below the main diagonal. Any entry on the main diagonal of a triangular matrix may be zero or not. A = a a a a 3 a 3 a , 3, 8, /7/8 Dr. Omar R Daoud 7
18 Matrices: Arithmetic Operations DEFINITION Diagonal Matrices are square matrices that can have nonzero entries only on the main diagonal. Any entry above or below the main diagonal must be zero. B = b b = b Scalar Matrix is a matrix that has equal diagonal entries of a diagonal matrix S. The multiplication of any square matrix A of the same size by S has the same effect as the multiplication by a scalar c, AS = SA = ca. A unit matrix (or identity matrix) is a scalar matrix, whose entries on the main diagonal are all, and it is denoted by I n or simply by I. AI = IA = A. I /7/8 Dr. Omar R Daoud 8
19 Matrices: Determinants DEFINITION A determinant of second order is denoted by D and defined by a a D a a a a det A. a a A determinant of third order can be defined by a a a a a a a a a D a a a a a a a a a a a a a a a So here we have bars (whereas a matrix has brackets).. The signs on the right are Each of the three terms on the right is an entry in the first column of D times its minor, that is, the second-order determinant (for a delete the first row and first column, and so on). /7/8 Dr. Omar R Daoud 9
20 Matrices: Determinants Cramer s Rule: A determinant of order n is a scalar associated with an n n matrix A = [a jk ] is a a a n a a a n D det A. a a a m m mn For n =, this determinant is defined by D = a. For n by D = a j C j + a j C j + + a jn C jn ( j =,,, or n) or D = a k C k + a k C k + + a nk C nk (k =,,, or n) Where C jk = ( ) j+k M jk M jk is a determinant of order n, namely, the determinant of the submatrix of A obtained from A by omitting the row and column of the entry a jk, that is, the jth row and the kth column We may expand D by any row or column. /7/8 Dr. Omar R Daoud
21 Matrices: Determinants Cramer s Rule: Terms used in connection with determinants are taken from matrices: In D we have n entries a jk n rows and n columns, and a main diagonal on which a, a,, a nn stand. Two terms are new: M jk is called the minor of a jk in D, and C jk the cofactor of a jk in D. For later use we note that may also be written in terms of minors n jk D ( ) a M ( j,,, or n) k n jk D ( ) a M ( k,,, or n) j jk jk jk jk /7/8 Dr. Omar R Daoud
22 Matrices: Determinants Cramer s Rule: A minor of a matrix is the determinant of some smaller square matrix, obtained by removing one or more of its rows and columns. Given a matrix A, the minor obtained by removing the j th row and k th column is denoted by M jk. It is also called the minor of the (j, k)- entry a jk in A. Expansion on the first row: /7/8 Dr. Omar R Daoud
23 Matrices: Determinants Cramer s Rule: A minor of a matrix is the determinant of some smaller square matrix, obtained by removing one or more of its rows and columns. Given a matrix A, the minor obtained by removing the j th row and k th column is denoted by M jk. It is also called the minor of the (j, k)- entry a jk in A. Expansion on the second row: /7/8 Dr. Omar R Daoud 3
24 Matrices: Determinants Cramer s Rule: A minor of a matrix is the determinant of some smaller square matrix, obtained by removing one or more of its rows and columns. Given a matrix A, the minor obtained by removing the j th row and k th column is denoted by M jk. It is also called the minor of the (j, k)- entry a jk in A. Expansion on the third row: /7/8 Dr. Omar R Daoud 4
25 Matrices: Determinants Cramer s Rule: A minor of a matrix is the determinant of some smaller square matrix, obtained by removing one or more of its rows and columns. Given a matrix A, the minor obtained by removing the j th row and k th column is denoted by M jk. It is also called the minor of the (j, k)- entry a jk in A. Expansion on the third column: Computation on the third column is easy, because there are lots of zeros. /7/8 Dr. Omar R Daoud 5
26 Matrices: Determinants Cramer s Rule: Sign Pattern: Expansion on the first row Expansion on the second row Expansion on the last row /7/8 Dr. Omar R Daoud 6
27 Matrices: Determinants Cramer s Rule: The minor together with the appropriate sign is called cofactor. Given a matrix The cofactor of C ij is defined as: Expansion on the i th row (i=,,3): Expansion on the j th column (j=,,3): /7/8 Dr. Omar R Daoud 7
28 Matrices: Determinants Cramer s Rule: Every square matrix has a determinant. The determinant of a matrix is a number. Matrix: (+) Matrix: (-) = 3.5 =.5 = 695 /7/8 Dr. Omar R Daoud 8
29 Matrices: Determinants Cramer s Rule: Example: Expansion of a 3 rd order determinant D =( ) 3(4 + 4) + ( + 6) = This is the expansion by the first row. The expansion by the third column is D /7/8 Dr. Omar R Daoud 9
30 Matrices: Determinants Elementary Row Operations: An attractive way of finding determinants An upper triangular determinant is achieved, whose value is then very easy to compute, being just the product of its diagonal entries. Behavior of an nth-order Determinant under Elementary Row Operations: Interchange of two rows/columns multiplies the value of the determinant by. Addition of a multiple of a row/column to another row/column does not alter the value of the determinant. Multiplication of a row/column by a nonzero constant c multiplies the value of the determinant by c. (This holds also when c =, but no longer gives an elementary row operation.) /7/8 Dr. Omar R Daoud 3
31 Matrices: Determinants Elementary Row Operations: An attractive way of finding determinants An upper triangular determinant is achieved, whose value is then very easy to compute, being just the product of its diagonal entries. Behavior of an nth-order Determinant under Elementary Row Operations: Transposition leaves the value of a determinant unaltered. A zero row/column renders the value of a determinant zero. Proportional rows/columns render the value of a determinant zero. In particular, a determinant with two identical rows/columns has the value zero. /7/8 Dr. Omar R Daoud 3
32 Matrices: Determinants Elementary Row Operations: Rank in Terms of Determinants: Consider an m n matrix A = [a jk ]: A has rank r if and only if A has an r r submatrix with a nonzero determinant. The determinant of any square submatrix with more than r rows, contained in A (if such a matrix exists!) has a value equal to zero. Furthermore, if m = n, we have: An n n square matrix A has rank n if and only if det A. /7/8 Dr. Omar R Daoud 3
33 Matrices: Determinants Elementary Row Operations: Example: Evaluation of Determinants by Reduction to Triangular Form. Row Row Row 4.5 Row Row 3.4 Row Row 4.6 Row D Row Row /7/8 Dr. Omar R Daoud 33
34 Matrices: Determinants Rule of Sarrus (Diagonal method): Rewrite first two rows of the matrix, multiply diagonals going up! multiply diagonals going down! Bottom minus top! (-5) = 78 /7/8 Dr. Omar R Daoud 34
35 Matrices: Determinants Rule of Sarrus (Diagonal method): Rewrite first two rows of the matrix, multiply diagonals going up! multiply diagonals going down! Bottom minus top! = /7/8 Dr. Omar R Daoud 35
36 Matrices: Determinants Rule of Sarrus (Diagonal method): Transpose has the same determinant AB = A B /7/8 Dr. Omar R Daoud 36
37 Matrices: Determinants Example: The determinant of a matrix product: Given Find A, B, and AB /7/8 Dr. Omar R Daoud 37 3 A 3 B 7 3 A 3 B AB AB
38 Matrices: Inversion DEFINITION The inverse of an n n matrix A = [a jk ] is denoted by A and is an n n matrix such that A = A A = I where I is the n n unit matrix DEFINITION 3 If A is a square matrix, and if a matrix B of the same size can be found such that AB=BA=I, then A is said to be invertible and B is called an inverse of A. If no such matrix B can be found, then A is said to be singular. /7/8 Dr. Omar R Daoud 38
39 Matrices: Inversion Properties of Matrix Invers: If A is an invertible matrix then its inverse is unique. (A - ) - = A. (A k ) - = (A - ) k (we will denote this as A -k ) (ca) - = (/c)a -, c. ( A T ) - = (A - ) T. If A is an invertible matrix, then the system of equations Ax = b has a unique solution given by x = A - b. A singular matrix, is the matrix that has no inverse. /7/8 Dr. Omar R Daoud 39
40 Matrices: Inversion DEFINITION 3 The Adjoint matrix of [A], Adj[A], is obtained by taking the transpose of the cofactor matrix of [A]. The minor for element a ij of matrix [A] is found by removing the ith row and jth column from [A] and then calculating the determinant of the remaining matrix. The matrix inverse of a matrix can be calculated by making use of the Adjoint matrix as where: A A adj( A) A is the determinant of the matrix A, adj(a) is the adjoint matrix, which can be found from the cofactor matrix /7/8 Dr. Omar R Daoud 4
41 Matrices: Inversion C ij = ( ) - i + j M ij Adjoint Matrix Method (Inverse of a Matrix by Determinants): -4 5 Example: Find the matrix inverse of A T adj A = [C] T = M = 3 = -8 M M M 3 M M M 3 M 3 M 3 M M = 5 = M 3 = 5 = The resulting matrix of minors is: M The resulting cofactor matrix is: C /7/8 Dr. Omar R Daoud 4
42 Matrices: Inversion - [ A] = adj [ A] A -4 5 Example: Find the matrix inverse of A Adjoint Matrix Method: C and then the determinant is: adj A A A = = A /7/8 Dr. Omar R Daoud 4
43 Matrices: Inversion - [ A] = adj [ A] A Adjoint Matrix Method: Example: Find the matrix inverse of A det A = ( 7) = C 7, C, C 3, C 3, C, C 7, C 8, C, C, A /7/8 Dr. Omar R Daoud 43
44 Matrices: Inversion C ij = ( ) - i + j M ij A Adjoint Matrix Method: Example3: Find the matrix inverse of A 4 A 5 A A A3 A A3 A3 5 A Then the inverse will be T A A The cofactor matrix is: /7/8 Dr. Omar R Daoud 44
45 Matrices: Inversion C ij = ( ) - i + j M ij Adjoint Matrix Method: 3 A, 4 Example4: Find the matrix inverse of A 3..3 /7/8 Dr. Omar R Daoud 45
46 Matrices: Inversion DEFINITION 4 If Gauss Jordan elimination method is applied on a squared matrix, thus it can be used to calculate the matrix's inverse. This can be done by augmenting the square matrix with the identity matrix of the same dimensions., and through the following matrix operations: A I A A I I A /7/8 Dr. Omar R Daoud 46
47 Matrices: Inversion Gauss-Jordan Elimination Method: A Example: Determine the inverse A of Row 3 Row Row Row 3 Row.5 Row Row 3 Row. Row Row Row 3 Row 3.5 Row 3 A I Row Row /7/8 Dr. Omar R Daoud 47
48 Matrices: Inversion Gauss-Jordan Elimination Method: Example: Determine the inverse A of A Hence AA = I. Similarly A A = I. /7/8 Dr. Omar R Daoud 48
49 Matrices: Inversion Gauss-Jordan Elimination Method: Example: Determine the inverse A of /7/8 Dr. Omar R Daoud 49 A I A A I
50 Matrices: Rank DEFINITION 4 A positive integer r is said to be the Rank of a non-zero matrix A, if There exists at least one non-zero minor of order r of A Every minor of order greater than r of A is zero. Thus, it is the maximum number of linearly independent row vectors of A. Specifications: Given any matrix, its row-rank and column-rank are equal (we can just say the rank of a matrix. It means either the row-rank of column-rank). If some column vectors are linearly dependent, they remain linearly dependent after any elementary row operation. /7/8 Dr. Omar R Daoud 5
51 Matrices: Rank DEFINITION 4 A positive integer r is said to be the Rank of a non-zero matrix A, if There exists at least one non-zero minor of order r of A Every minor of order greater than r of A is zero. Thus, it is the maximum number of linearly independent row vectors of A. Specifications: Any row operation does not change the column- rank. By the same argument, apply to the transpose of the matrix, we conclude that any column operation does not change the row-rank as well We call a matrix A row-equivalent to a matrix A if A can be obtained from A by (finitely many!) elementary row operations. The maximum number of linearly independent row vectors of a matrix does not change if we change the order of rows or multiply a row by a nonzero c or take a linear combination by adding a multiple of a row to another row. This shows that rank is invariant under elementary row operations. /7/8 Dr. Omar R Daoud 5
52 Matrices: Rank Example: Determine the rank of A= Linearly independent Linearly independent Linearly independent Linearly dependent Linearly independent Linearly independent Linearly dependent Row-Rank = /7/8 Dr. Omar R Daoud 5
53 Matrices: Rank Example: Determine the rank of A= Row reductions Row-rank = Row-rank = Because row reductions do not affect the number of linearly independent rows /7/8 Dr. Omar R Daoud 53
54 Matrices: Rank Example: Determine the rank of A= List all combinations of columns Column-Rank = Linearly independent?? Y Y Y Y Y Y Y Y Y Y N N N N N /7/8 Dr. Omar R Daoud 54
55 Matrices: Rank Example: Determine the rank of Row + Row Row 3 7 Row A Row 3 + Row (given) The last matrix has two nonzero rows. Hence rank A =. /7/8 Dr. Omar R Daoud 55
56 Matrices: Rank Example3: Determine the rank of A= Apply row reductions. row-rank and column-rank do not change. Apply column reductions. row-rank and column-rank do not change. The top-left corner is an identity matrix. The row-rank and column-rank of this normal form is certainly the size of this identity submatrix, and are therefore equal. /7/8 Dr. Omar R Daoud 56
57 Matrices: Rank Example4: Determine the rank of A= Rank = Rank = Rank = Rank = Rank = Rank = Rank = /7/8 Dr. Omar R Daoud 57
58 Matrices: Rank vs. Determinant Determinant Real number Defined to square matrix only Non-zero det implies existence of inverse. When det is zero, We know that all the columns (or rows) together are linearly dependent, but don t know any information about subset of columns (or rows) which are linearly independent. Rank Integer Defined to any rectangular matrix When applied to nn square matrix, rank=n implies existence of inverse. /7/8 Dr. Omar R Daoud 58
59 Matrices: Solution of Linear Systems of Equations DEFINITION 5 A linear system of m equations in n unknowns x,, x n is a set of equations of the form a x + a x.. +a n x n = b a x + a x.. +a n x n = b a m x + a m x.. +a mn x n = b m The system is called linear because each variable x j appears in the first power only, Just as in the equation of a straight line. a,, a mn are given numbers, called the coefficients of the system. b,, b m on the right are also given numbers. If all the bj are zero, then it is called a homogeneous system. If at least one bj is not zero, then it is called a nonhomogeneous system. A solution of it, is a set of numbers x,, x n that satisfies all the m equations. A solution vector is a vector x whose components form the solution. If the system is homogeneous, it always has at least the trivial solution x x n =. /7/8 Dr. Omar R Daoud 59
60 Matrices: Solution of Linear Systems of Equations Matrix From Linear System From the definition of matrix multiplication, the m equations may be written as a single vector equation as Ax = b, where the coefficient matrix A = [a jk ] is the m n matrix. A = a a n, x = a m a mn x x n and b = The augmented matrix of A, à could be formed as a a n b A = a m a mn It is merely a reminder that the last column of à did not come from matrix A but came from vector b The augmented matrix à determines the system completely because it contains all the given and needed numbers appearing in the equations. b m b b m /7/8 Dr. Omar R Daoud 6
61 Matrices: Solution of Linear Systems of Equations Gauss Elimination Method: Back Substitution: Step : Write the augmented matrix ( three parameters as an example (x3, x, x)) Step : Elimination of x: Call the first row of A the pivot row and the first equation the pivot equation. Call the coefficient of its x-term the pivot in this step. Use this equation to eliminate x (get rid of x) in the other equations. Step 3: Elimination of x: The first equation remains as it is. We want the new second equation to serve as the next pivot equation. But if it has no x-term (in fact, it is = ), we must first change the order of the equations and the corresponding rows of the new matrix (put = at the end and move the third equation and the fourth equation one place up). This is called partial pivoting (as opposed to the rarely used total pivoting, in which the order of the unknowns is also changed). Step 4: Back substitution: Triangular means that all the nonzero entries of the corresponding coefficient matrix lie above the diagonal and form an upside-down 9 triangle. Then we can solve the system by back substitution. Determination of x3, x, x (in this order) Working backward from the last to the first equation of this triangular system, we can now readily find x3, then x, and then x /7/8 Dr. Omar R Daoud 6
62 Matrices: Solution of Linear Systems of Equations Gauss Elimination Method: Back Substitution: Example: Solve the following linear system: Augmented Matrix à Elimination of x Row Row Row 4 Row Elimination of x Row 3 3 Row Elimination of x step: Move the third equation and the fourth equation from the previous step one place up x x x 3 x x x 3 x 5x 9 3 x x 8. Back Substitution /7/8 Dr. Omar R Daoud x 9 x 5 x 9 x x x.
63 Matrices: Solution of Linear Systems of Equations Gauss Elimination Method: Back Substitution: 6x x +x 3 +4x 4 = x Example: Solve the following linear system: 8x +6x 3 +x 4 = 34 3x 3x +9x 3 +9x 4 = 7 6x +4x +x 3 8x 4 = 38 /7/8 Dr. Omar R Daoud 63
64 Matrices: Solution of Linear Systems of Equations Gauss Elimination Method: Back Substitution: Example: Solve the following linear system: 6x x +x 3 +4x 4 = x 8x +6x 3 +x 4 = 34 3x 3x +9x 3 +9x 4 = 7 6x +4x +x 3 8x 4 = 38 /7/8 Dr. Omar R Daoud 64
65 Matrices: Solution of Linear Systems of Equations Gauss Elimination Method: Back Substitution: Example: Solve the following linear system: 6x x +x 3 +4x 4 = x 8x +6x 3 +x 4 = 34 3x 3x +9x 3 +9x 4 = 7 6x +4x +x 3 8x 4 = 38 /7/8 Dr. Omar R Daoud 65
66 Matrices: Solution of Linear Systems of Equations Lower and Upper Decomposition Method: First, suppose that Gaussian elimination can be performed on the system Ax = b without row interchanges having nonzero pivot elements a ii (i) for each i =,,.. n. For j =,3,.. n perform the operation E j m j, E E j, where m j, = a j () a (), these operations transform the system into one in which all the entries in the first column below the diagonal are zeros. This is called the first Gaussian transformation matrix. /7/8 Dr. Omar R Daoud 66
67 Matrices: Solution of Linear Systems of Equations Lower and Upper Decomposition Method: M () Ax = b = A () x = b () In similar manner we construct M () the identity matrix with the entries below the diagonal in the second column replaced by the negatives of the multipliers, m j, = a j () a () The product of M() by A () has zeros below the diagonal in the first two columns. M () A () x = b () = M () M () ( Ax = b) = A (3) x = b (3) In general, with A (k) x = b (k) and then A (k+) x = M (k) A (k) x = M (k) M () Ax = M (k) b k = b (k+) = M (k) M () b /7/8 Dr. Omar R Daoud 67
68 Matrices: Solution of Linear Systems of Equations Lower and Upper Decomposition Method: The process ends with the formation of A (n) x = b (n), where A (n) = M (n ) M (n ) M A is an upper triangular matrix This process forms the upper portion of the matrix factorization, U = A (n). To determine the complementary lower triangular matrix, L = L () L () L (n ), where L (k) (k) = M /7/8 Dr. Omar R Daoud 68
69 Matrices: Solution of Linear Systems of Equations Lower and Upper Decomposition Method: (LU Factorization Algorithm) To factor an n n matrix A = LU = a ij = l ij u ij follow Step : select l ij and u ij satisfying a ij = l ij u ij Step : for j =,, n set u j = a j l l j = a j u as the first row of U as the first column of L Step 3: for i =,, n Do i Step 3: select l ii and u ii satisfying l ii u ii = a ii k= l ik u ki Step 3: for j = +,., n set u ij = l i ii a ij k= l ik u kj for the i-th row of U l ji = u i ii a ji k= l jk u ki for the j-th column of L Step 4: select l nn and u nn satisfying l nn u nn = a nn k= l nk u kn Step 5: Output l ij for j =,.., i and i =,.., n Output u ij for j = i,.., n and i =,.., n n From Step 4: If l nn u nn =, then A = LU but A is singular /7/8 Dr. Omar R Daoud 69
70 Matrices: Solution of Linear Systems of Equations Lower and Upper Decomposition Method: Thus, the LU construction will be LU = L () L () L (n ) A (n) = M () M () M (n ) M (n ) M (n ) M A = A x x +3x 4 = 8 x Example: Solve the following linear systems of equations x x 3 +x 4 = 7 3x x x 3 +x 4 = 4 x +x +3x 3 x 4 = 7 Part : Find the Upper Matrix Step : A = 3 3 3, M () = 3 Step : A () = M () A = m j, = a j () a () /7/8 Dr. Omar R Daoud 7
71 Matrices: Solution of Linear Systems of Equations Lower and Upper Decomposition Method: x x +3x 4 = 8 x Example: Solve the following linear systems of equations x x 3 +x 4 = 7 3x x x 3 +x 4 = 4 x +x +3x 3 x 4 = 7 Step 3:A (3) = M () A () = Part : Find the Lower Matrix = Step : M () = 3, M () = 4 3 Step: L = M () M () = /7/8 Dr. Omar R Daoud 7
72 Matrices: Solution of Linear Systems of Equations Lower and Upper Decomposition Method: x x +3x 4 = 8 x Example: Solve the following linear systems of equations x x 3 +x 4 = 7 3x x x 3 +x 4 = 4 x +x +3x 3 x 4 = 7 Part 3: The Solution Step : Ax = LUx = b = Step: Suppose y = Ux b = Ly x x x 3 x 4 = y y y 3 y 4 = y = 8 y y = 7 y = 9 3y + 4y + y 3 = 4 y 3 = 6 y 3y + y 4 = 7 y 4 = 6 /7/8 Dr. Omar R Daoud 7
73 Matrices: Solution of Linear Systems of Equations Lower and Upper Decomposition Method: x x +3x 4 = 8 x Example: Solve the following linear systems of equations x x 3 +x 4 = 7 3x x x 3 +x 4 = 4 x +x +3x 3 x 4 = 7 Part 3: The Solution Step 3: Ux = y = x x x 3 x 4 = x + x + 3x 4 = 8 x = 3 x x 3 5x 4 = 9 x = 3x 3 + 3x 4 = 6 x 3 = 3x 4 = 6 x 4 = /7/8 Dr. Omar R Daoud 73
74 Matrices: Solution of Linear Systems of Equations Lower and Upper Decomposition Method: 6x x +x 3 +4x 4 = x Example: Solve the following linear systems of equations 8x +6x 3 +x 4 = 34 3x 3x +9x 3 +3x 4 = 7 6x +4x +x 3 8x 4 = 38 Part : Find the Upper Matrix Step : A = Step 3: A (3) = M () A () = , M () = , Step : A () = M () A = = , 3 4 Step 4: A (4) = M (3) A (3) = = = U /7/8 Dr. Omar R Daoud 74
75 Matrices: Solution of Linear Systems of Equations Lower and Upper Decomposition Method: 6x x +x 3 +4x 4 = x Example: Solve the following linear systems of equations 8x +6x 3 +x 4 = 34 3x 3x +9x 3 +3x 4 = 7 6x +4x +x 3 8x 4 = 38 Part : Find the Lower Matrix Step : M () =, M () = 3, M (3) =, Step: L = M () M () M (3) = 3 /7/8 Dr. Omar R Daoud 75
76 Matrices: Solution of Linear Systems of Equations Lower and Upper Decomposition Method: 6x x +x 3 +4x 4 = x Example: Solve the following linear systems of equations 8x +6x 3 +x 4 = 34 3x 3x +9x 3 +3x 4 = 7 6x +4x +x 3 8x 4 = 38 Part 3: The Solution Step : Ax = LUx = b = x x x 3 x 4 = Step: Suppose y = Ux b = Ly 3 y y y 3 y 4 = y = y + y = 34 y =. 5y + 3y + y 3 = 7 y 3 = 9 y.5y + y 3 + y 4 = 38 y 4 = 3 /7/8 Dr. Omar R Daoud 76
77 Matrices: Solution of Linear Systems of Equations Lower and Upper Decomposition Method: 6x x +x 3 +4x 4 = x Example: Solve the following linear systems of equations 8x +6x 3 +x 4 = 34 3x 3x +9x 3 +3x 4 = 7 6x +4x +x 3 8x 4 = 38 Part 3: The Solution Step 3: Ux = y = x x x 3 x 4 = 9 3 6x x + x 3 + 4x 4 = x = 4x + x 3 + x 4 = x = 3 x 3 5x 4 = 9 x 3 = 3x 4 = 3 x 4 = /7/8 Dr. Omar R Daoud 77
78 Matrices: Solution of Linear Systems of Equations Cramer s Rule: Cramer s Rule: relies on determinants, Based on the coefficient matrix DEFINITION 6 ax + by = e cx + dy = f a c a x + a x.. +a n x n = b a For the linear systems of equations x + a x.. +a n x n = b with a coefficient matrix of a m x + a m x.. +a mn x n = b m a a n A =, with a det A the solution can be found based on Cramer s rule as a m a mn b d x = b a a n b m a m a mn det (A), x = a b a n a m b m a mn det (A),.., x n = a a b a m a m bm det (A) /7/8 Dr. Omar R Daoud 78
79 Matrices: Solution of Linear Systems of Equations Cramer s Rule: Example: Solve the following linear systems of equations 8 +5x = x 4x = Step : A = 8 5 4, b = Step : det A = = 4 Step 3: x = 5 4 det (A) =, x = 8 det (A) = /7/8 Dr. Omar R Daoud 79
80 Matrices: Solution of Linear Systems of Equations Cramer s Rule: Example: Solve the following linear systems of equations x 4x + 5x 3 = 36 3x + 5x + 7x 3 = 7 5x + 3x 8x 3 = 3 Step : A = Step : Step 3: det A = , b = = 336 x = det (A) =, x = det (A) =-3, x 3 = det (A) =4 /7/8 Dr. Omar R Daoud 8
81 Matrices: Solution of Linear Systems of Equations Matrix Inversion: DEFINITION 7 a x + a x.. +a n x n = b a For the linear systems of equations x + a x.. +a n x n = b with a coefficient matrix of a m x + a m x.. +a mn x n = b m a a n A =, with a det A the solution can be found based on the matrix inversion rule as a m a mn x = A b x x n = a a n a m a mn b b m /7/8 Dr. Omar R Daoud 8
82 Matrices: Solution of Linear Systems of Equations Matrix Inversion Rule: Example: Solve the following linear systems of equations x + x + x 3 = x + x = x + x + x 3 = 3 Step : A = Step : A = Step 3: , b = 3 x = = x =, x =, x 3 = /7/8 Dr. Omar R Daoud 8
83 Matrices: Solution of Linear Systems of Equations Matrix Inversion Rule: Example: Solve the following linear systems of equations x + x + x 3 = x x + x 3 = 3x + x + 3x 3 = 4 Step : A = Step : 3 3, b = 4 A Does not exist We cannot use the inverse matrix method. Whenever the inverse of a matrix does not exist, we say that the matrix is singular. /7/8 Dr. Omar R Daoud 83
84 Matrices: Eigenvalues and Eigenvectors DEFINITION 8 If A = a a n is n n matrix, do there exist nonzero vectors x such that Ax is a scalar a n a nn Eigenvalue multiple of x. Ax x Eigenvector A: an nn matrix : a scalar (could be zero) x: a nonzero vector in R n An eigenvalue of A is a scalar such that det( IA) (Characteristic equation of A) The eigenvectors of A corresponding to are the nonzero solutions of ( IA) x /7/8 Dr. Omar R Daoud 84
85 Matrices: Eigenvalues and Eigenvectors Finding Eigenvalues and Eigenvectors Example: Find the egigenvaluse and eigenvectors for A = 3 4 Step : Characteristic equation det (A I) = ( )( 4 ) (3)( ) = Set to Then = =, /7/8 Dr. Omar R Daoud 85
86 Matrices: Eigenvalues and Eigenvectors Finding Eigenvalues and Eigenvectors Example: Find the egigenvaluse and eigenvectors for A = 3 4 Step : Solving for the x vector () 3 4 x x = x x x x = x x x = 3x 4x = x 3x 3x =, they are dependent of a factor of 3 and then x = x ; we can represent all eigenvectors for eigenvalue - as multiples of a simple basis vector: P = t, where t is a parameter /7/8 Dr. Omar R Daoud 86
87 Matrices: Eigenvalues and Eigenvectors Finding Eigenvalues and Eigenvectors Example: Find the egigenvaluse and eigenvectors for A = 3 4 Step : Solving for the x vector () 3 4 x x = x x x x = x 3x x = 3x 4x = x 3x x =, they are dependent of a factor of 3 and then x = 3 x ; we can represent all eigenvectors for eigenvalue - as multiples of a simple basis vector: P = t 3 = t 3, where t is a parameter /7/8 Dr. Omar R Daoud 87
88 Matrices: Eigenvalues and Eigenvectors Finding Eigenvalues and Eigenvectors Example: Find the egigenvaluse and eigenvectors for A 5 Step : Characteristic equation det( I A) 5, 3 ( )( ) Eigenvalue:, /7/8 Dr. Omar R Daoud 88
89 Matrices: Eigenvalues and Eigenvectors Finding Eigenvalues and Eigenvectors Example: Find the egigenvaluse and eigenvectors for Step : Solving for the x vector () 3 x 4 ( I A) x x 3 G.-J. E. 4 4 x 4t 4, x t t t A () 5 4 x 3 ( I A) x x 4 G.-J. E. 3 3 x 3s 3, x s s s /7/8 Dr. Omar R Daoud 89
90 Matrices: Eigenvalues and Eigenvectors Finding Eigenvalues and Eigenvectors Example3: Find the egigenvaluse and eigenvectors for Step : Characteristic equation A 5 3 I 5 A 3 Eigenvalue: ( ) ( )( 3),, 3 3 /7/8 Dr. Omar R Daoud 9
91 Matrices: Eigenvalues and Eigenvectors Finding Eigenvalues and Eigenvectors Example3: Find the egigenvaluse and eigenvectors for Step : Solving for the x vector A 5 3 () x 5 x ( I A) x x 3 x4, is a basis for the eigenspace corresponding to x t x s s t, s, t x 3 t x4 t G.-J.E. The dimension of the eigenspace of λ = is /7/8 Dr. Omar R Daoud 9
92 Matrices: Eigenvalues and Eigenvectors Finding Eigenvalues and Eigenvectors Example3: Find the egigenvaluse and eigenvectors for Step : Solving for the x vector () x 5 x ( I A) x x 3 x4 A G.-J.E. 5 x x 5t 5 t, t x 3 t x4 3 5 is a basis for the eigenspace corresponding to The dimension of the eigenspace of λ = is /7/8 Dr. Omar R Daoud 9
93 Matrices: Eigenvalues and Eigenvectors Finding Eigenvalues and Eigenvectors Example3: Find the egigenvaluse and eigenvectors for Step : Solving for the x vector (3) 3 3 x 5 x ( 3I A) x x 3 x4 5 is a basis for the eigenspace corresponding to 3 3 A /7/8 Dr. Omar R Daoud 93 G.-J.E. 5 3 x x 5t 5 t, t x 3 x4 t The dimension of the eigenspace of λ 3 = 3 is
94 Matrices: Eigenvalues and Eigenvectors DEFINITION 9 If A is an n n triangular matrix, then its eigenvalues are the entries on its main diagonal Example: Find the eigenvaluse for (a) A (a) I A ( )( )( 3) 5 3 3,, 3 3 /7/8 Dr. Omar R Daoud 94
95 Matrices: Eigenvalues and Eigenvectors DEFINITION 9 If A is an n n triangular matrix, then its eigenvalues are the entries on its main diagonal Example: Find the eigenvaluse for (b) A 4 3 (b),,, 4, /7/8 Dr. Omar R Daoud 95
96 Matrices: Diagonalization DEFINITION A squared matrix A is called Diagonalizable if there exits an invertible matrix P such that P AP is a diagonal matrix. If A and B are similar nn matrices, then they have the same eigenvalues. An nn matrix A is diagonalizable if and only if it has n linearly independent eigenvectors Example: check whether the following matrix is diagonalizable 3 3 A 3 I A 3 ( 4)( ) The eigenvalues : 4,, /7/8 Dr. Omar 3 R Daoud 96
97 Matrices: Diagonalization Example: check whether the following matrix is diagonalizable 3 A 3 () 4 the eigenvector p () the eigenvector p, 3 p 4 P [ p p p3], and P AP /7/8 Dr. Omar R Daoud 97
98 Matrices: Diagonalization Example: Show that the following matrix is not diagonalizable A = I A ( ) The eigenvalue, and then solve ( I A) x for eigenvectors I A I A eigenvector p Since A does not have two linearly independent eigenvectors, A is not diagonalizable /7/8 Dr. Omar R Daoud 98
99 Matrices: Diagonalization Example3: Find a matrix P such that P AP is diagonal for A = I A 3 ( )( )( 3) The eigenvalues :,, 3 3 x G.-J. E. I A x 3 3 x 3 x t x eigenvector p x 3 t /7/8 Dr. Omar R Daoud 99
100 Matrices: Diagonalization Example3: Find a matrix P such that P AP is diagonal for A = x G.-J. E. I A 5 4 x 3 x 3 x 4 t x 4 t eigenvector p x 3 t 4 /7/8 Dr. Omar R Daoud
101 Matrices: Diagonalization Example3: Find a matrix P such that P AP is diagonal for A = x G.-J. E. 3I A x 3 4 x 3 x t x t eigenvector p 3 x 3 t /7/8 Dr. Omar R Daoud
102 Matrices: Diagonalization Example3: Find a matrix P such that P AP is diagonal for A = 3 3 P [ p p p3] and it follows that 4 P AP 3 A k based on the diagonalization technique A k = PD k P = λ k k λ n /7/8 Dr. Omar R Daoud
103 Matrices: Diagonalization Example4: Determine whether the matrix A is diagonalizable A 3 Because A is a triangular matrix, its eigenvalues are,, 3 3 The three values are distinct; Thus, A is diagonalizable /7/8 Dr. Omar R Daoud 3
104 Matrices: Diagonalization DEFINITION If A is nn symmetric matrix, then : A is diagonalizable (it has n linearly independent eigenvectors), except the ones in the form of A = ai All eigenvalues of A are real If is an eigenvalue of A with the multiplicity to be k, then has k linearly independent eigenvectors. That is the eigenspace of has dimension k. Any two eigenvectors from different eigenspace are orthogonal DEFINITION An nn P is orthogonal matrix if and only if its column vectors form an orthonormal set( this means that in any column vector P = [p, p,. p n ], p i p j = for i j and p i p i = Thus, a squared matrix P is called orthogonal if it is invertible and P = P T or PP T = P T P = I /7/8 Dr. Omar R Daoud 4
105 Matrices: Diagonalization DEFINITION If matrix A is orthogonally diagonalizable If A is a symmetric matrix If there are an orthogonal matrix P with P = P T and a diagonal matrix D such that A = PDP T = PDP A T = (PDP T ) T = P TT D T P T = A, so A is symmetric /7/8 Dr. Omar R Daoud 5
106 Matrices: Diagonalization Example: show that P is an orthogonal matrix P = T PP I Moreover, let p, p 5, and p 5 3, we can produce p p p p /7/8 Dr. Omar R Daoud p p p p p p and p p So {p, p, p 3 } is an orthonormal
107 Matrices: Diagonalization Example: Find an orthogonal matrix P that diagonalizes A = 4 4 () I A ( 3) ( 6) 6, 3 (has a multiplicity of ) v () 6, v (,, ) u (,, ) v (3) 3, v (,, ), v (, 4, 5) 3 v v = v v 3 = u orthogonal v v (,, ), u (,, ) v v3 /7/8 Dr. Omar R Daoud 7
108 Matrices: Diagonalization /7/8 Dr. Omar R Daoud 8 Example: Find an orthogonal matrix P that diagonalizes A = P 3 u u u AP P
109 Matrices: Diagonalization Example3: If possible diagonalize the matrix A The normalized (unit) eigenvectors Then A = PDP, since P is squared and has orthonormal matrix, then it is simply orthogonal and P = P T /7/8 Dr. Omar R Daoud 9
110 Matrices: Diagonalization Example3: Orthogonally diagonalize the matrix A Althogh v and v are linearly independent, they are not orthogonal. Thus: Gram-Schmidt Process: The normalized (unit) eigenvectors for =7 /7/8 Dr. Omar R Daoud
111 Matrices: Diagonalization Example3: Orthogonally diagonalize the matrix A Gram-Schmidt Process: v i+ = u i+ i (u i+,v k ) k= v (v k,v k ) k Example: find the orthogonal version of u = orthonormal basis, u =, u 3 = and then the v = u =, v = u ( (u,v ) ) v (v,v ) u, v = + + = v, v = + + = 3 = v 3 = u 3 ( (u 3,v ) (v,v ) ) v ( (u 3,v ) (v,v ) )v u 3, v = + + = v, v = + + = 3 u 3, v = = 3 = v, v = = 3 v, v, v 3 are the orthogonal basis /7/8 Dr. Omar R Daoud
112 Matrices: Diagonalization Example3: Orthogonally diagonalize the matrix A Gram-Schmidt Process: v i+ = u i+ i (u i+,v k ) k= v (v k,v k ) k Example: find the orthogonal version of u = orthonormal basis, u =, u 3 = and then the The present magnitude of v is + + = 3 so we replace the vector by 3 v The magnitude of v is = 6 so we replace the vector by v The magnitude of v 3 is = so we replace the vector by v 3 { , , } are the orthonormal basis /7/8 Dr. Omar R Daoud
113 Matrices: Diagonalization Example3: Orthogonally diagonalize the matrix A The normalized (unit) eigenvectors for =- u 3 is orthogonal to the other eigenvectors u and u. Hence {u, u, u 3 } Is an orthonormal set Then A = PDP, since P is squared and has orthonormal matrix, then it is simply orthogonal and P = P T /7/8 Dr. Omar R Daoud 3
Chapter 7. Linear Algebra: Matrices, Vectors,
Chapter 7. Linear Algebra: Matrices, Vectors, Determinants. Linear Systems Linear algebra includes the theory and application of linear systems of equations, linear transformations, and eigenvalue problems.
More informationLinear Algebra. Matrices Operations. Consider, for example, a system of equations such as x + 2y z + 4w = 0, 3x 4y + 2z 6w = 0, x 3y 2z + w = 0.
Matrices Operations Linear Algebra Consider, for example, a system of equations such as x + 2y z + 4w = 0, 3x 4y + 2z 6w = 0, x 3y 2z + w = 0 The rectangular array 1 2 1 4 3 4 2 6 1 3 2 1 in which the
More informationMATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 1 x 2. x n 8 (4) 3 4 2
MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS SYSTEMS OF EQUATIONS AND MATRICES Representation of a linear system The general system of m equations in n unknowns can be written a x + a 2 x 2 + + a n x n b a
More informationLinear Algebra: Lecture notes from Kolman and Hill 9th edition.
Linear Algebra: Lecture notes from Kolman and Hill 9th edition Taylan Şengül March 20, 2019 Please let me know of any mistakes in these notes Contents Week 1 1 11 Systems of Linear Equations 1 12 Matrices
More informationEquality: Two matrices A and B are equal, i.e., A = B if A and B have the same order and the entries of A and B are the same.
Introduction Matrix Operations Matrix: An m n matrix A is an m-by-n array of scalars from a field (for example real numbers) of the form a a a n a a a n A a m a m a mn The order (or size) of A is m n (read
More informationMATRICES. knowledge on matrices Knowledge on matrix operations. Matrix as a tool of solving linear equations with two or three unknowns.
MATRICES After studying this chapter you will acquire the skills in knowledge on matrices Knowledge on matrix operations. Matrix as a tool of solving linear equations with two or three unknowns. List of
More information1 Determinants. 1.1 Determinant
1 Determinants [SB], Chapter 9, p.188-196. [SB], Chapter 26, p.719-739. Bellow w ll study the central question: which additional conditions must satisfy a quadratic matrix A to be invertible, that is to
More informationLecture Notes in Linear Algebra
Lecture Notes in Linear Algebra Dr. Abdullah Al-Azemi Mathematics Department Kuwait University February 4, 2017 Contents 1 Linear Equations and Matrices 1 1.2 Matrices............................................
More informationChapter 1: Systems of linear equations and matrices. Section 1.1: Introduction to systems of linear equations
Chapter 1: Systems of linear equations and matrices Section 1.1: Introduction to systems of linear equations Definition: A linear equation in n variables can be expressed in the form a 1 x 1 + a 2 x 2
More information1 Multiply Eq. E i by λ 0: (λe i ) (E i ) 2 Multiply Eq. E j by λ and add to Eq. E i : (E i + λe j ) (E i )
Direct Methods for Linear Systems Chapter Direct Methods for Solving Linear Systems Per-Olof Persson persson@berkeleyedu Department of Mathematics University of California, Berkeley Math 18A Numerical
More informationMATH 240 Spring, Chapter 1: Linear Equations and Matrices
MATH 240 Spring, 2006 Chapter Summaries for Kolman / Hill, Elementary Linear Algebra, 8th Ed. Sections 1.1 1.6, 2.1 2.2, 3.2 3.8, 4.3 4.5, 5.1 5.3, 5.5, 6.1 6.5, 7.1 7.2, 7.4 DEFINITIONS Chapter 1: Linear
More informationLinear Algebra March 16, 2019
Linear Algebra March 16, 2019 2 Contents 0.1 Notation................................ 4 1 Systems of linear equations, and matrices 5 1.1 Systems of linear equations..................... 5 1.2 Augmented
More informationMatrices and Determinants
Chapter1 Matrices and Determinants 11 INTRODUCTION Matrix means an arrangement or array Matrices (plural of matrix) were introduced by Cayley in 1860 A matrix A is rectangular array of m n numbers (or
More informationAPPENDIX: MATHEMATICAL INDUCTION AND OTHER FORMS OF PROOF
ELEMENTARY LINEAR ALGEBRA WORKBOOK/FOR USE WITH RON LARSON S TEXTBOOK ELEMENTARY LINEAR ALGEBRA CREATED BY SHANNON MARTIN MYERS APPENDIX: MATHEMATICAL INDUCTION AND OTHER FORMS OF PROOF When you are done
More informationLinear Systems and Matrices
Department of Mathematics The Chinese University of Hong Kong 1 System of m linear equations in n unknowns (linear system) a 11 x 1 + a 12 x 2 + + a 1n x n = b 1 a 21 x 1 + a 22 x 2 + + a 2n x n = b 2.......
More informationMATRICES AND MATRIX OPERATIONS
SIZE OF THE MATRIX is defined by number of rows and columns in the matrix. For the matrix that have m rows and n columns we say the size of the matrix is m x n. If matrix have the same number of rows (n)
More informationLinear Algebra Highlights
Linear Algebra Highlights Chapter 1 A linear equation in n variables is of the form a 1 x 1 + a 2 x 2 + + a n x n. We can have m equations in n variables, a system of linear equations, which we want to
More informationElementary maths for GMT
Elementary maths for GMT Linear Algebra Part 2: Matrices, Elimination and Determinant m n matrices The system of m linear equations in n variables x 1, x 2,, x n a 11 x 1 + a 12 x 2 + + a 1n x n = b 1
More informationMath113: Linear Algebra. Beifang Chen
Math3: Linear Algebra Beifang Chen Spring 26 Contents Systems of Linear Equations 3 Systems of Linear Equations 3 Linear Systems 3 2 Geometric Interpretation 3 3 Matrices of Linear Systems 4 4 Elementary
More informationA Review of Matrix Analysis
Matrix Notation Part Matrix Operations Matrices are simply rectangular arrays of quantities Each quantity in the array is called an element of the matrix and an element can be either a numerical value
More informationChapter 5. Linear Algebra. A linear (algebraic) equation in. unknowns, x 1, x 2,..., x n, is. an equation of the form
Chapter 5. Linear Algebra A linear (algebraic) equation in n unknowns, x 1, x 2,..., x n, is an equation of the form a 1 x 1 + a 2 x 2 + + a n x n = b where a 1, a 2,..., a n and b are real numbers. 1
More informationa 11 a 12 a 11 a 12 a 13 a 21 a 22 a 23 . a 31 a 32 a 33 a 12 a 21 a 23 a 31 a = = = = 12
24 8 Matrices Determinant of 2 2 matrix Given a 2 2 matrix [ ] a a A = 2 a 2 a 22 the real number a a 22 a 2 a 2 is determinant and denoted by det(a) = a a 2 a 2 a 22 Example 8 Find determinant of 2 2
More informationChapter 3. Determinants and Eigenvalues
Chapter 3. Determinants and Eigenvalues 3.1. Determinants With each square matrix we can associate a real number called the determinant of the matrix. Determinants have important applications to the theory
More informationMath Linear Algebra Final Exam Review Sheet
Math 15-1 Linear Algebra Final Exam Review Sheet Vector Operations Vector addition is a component-wise operation. Two vectors v and w may be added together as long as they contain the same number n of
More informationLemma 8: Suppose the N by N matrix A has the following block upper triangular form:
17 4 Determinants and the Inverse of a Square Matrix In this section, we are going to use our knowledge of determinants and their properties to derive an explicit formula for the inverse of a square matrix
More informationELEMENTARY LINEAR ALGEBRA WITH APPLICATIONS. 1. Linear Equations and Matrices
ELEMENTARY LINEAR ALGEBRA WITH APPLICATIONS KOLMAN & HILL NOTES BY OTTO MUTZBAUER 11 Systems of Linear Equations 1 Linear Equations and Matrices Numbers in our context are either real numbers or complex
More informationMATRICES. a m,1 a m,n A =
MATRICES Matrices are rectangular arrays of real or complex numbers With them, we define arithmetic operations that are generalizations of those for real and complex numbers The general form a matrix of
More informationCHAPTER 6. Direct Methods for Solving Linear Systems
CHAPTER 6 Direct Methods for Solving Linear Systems. Introduction A direct method for approximating the solution of a system of n linear equations in n unknowns is one that gives the exact solution to
More informationPrepared by: M. S. KumarSwamy, TGT(Maths) Page
Prepared by: M. S. KumarSwamy, TGT(Maths) Page - 50 - CHAPTER 3: MATRICES QUICK REVISION (Important Concepts & Formulae) MARKS WEIGHTAGE 03 marks Matrix A matrix is an ordered rectangular array of numbers
More informationMATH2210 Notebook 2 Spring 2018
MATH2210 Notebook 2 Spring 2018 prepared by Professor Jenny Baglivo c Copyright 2009 2018 by Jenny A. Baglivo. All Rights Reserved. 2 MATH2210 Notebook 2 3 2.1 Matrices and Their Operations................................
More informationVectors and matrices: matrices (Version 2) This is a very brief summary of my lecture notes.
Vectors and matrices: matrices (Version 2) This is a very brief summary of my lecture notes Matrices and linear equations A matrix is an m-by-n array of numbers A = a 11 a 12 a 13 a 1n a 21 a 22 a 23 a
More informationFinite Mathematics Chapter 2. where a, b, c, d, h, and k are real numbers and neither a and b nor c and d are both zero.
Finite Mathematics Chapter 2 Section 2.1 Systems of Linear Equations: An Introduction Systems of Equations Recall that a system of two linear equations in two variables may be written in the general form
More information[ Here 21 is the dot product of (3, 1, 2, 5) with (2, 3, 1, 2), and 31 is the dot product of
. Matrices A matrix is any rectangular array of numbers. For example 3 5 6 4 8 3 3 is 3 4 matrix, i.e. a rectangular array of numbers with three rows four columns. We usually use capital letters for matrices,
More informationA matrix over a field F is a rectangular array of elements from F. The symbol
Chapter MATRICES Matrix arithmetic A matrix over a field F is a rectangular array of elements from F The symbol M m n (F ) denotes the collection of all m n matrices over F Matrices will usually be denoted
More informationMATH 213 Linear Algebra and ODEs Spring 2015 Study Sheet for Midterm Exam. Topics
MATH 213 Linear Algebra and ODEs Spring 2015 Study Sheet for Midterm Exam This study sheet will not be allowed during the test Books and notes will not be allowed during the test Calculators and cell phones
More informationPhys 201. Matrices and Determinants
Phys 201 Matrices and Determinants 1 1.1 Matrices 1.2 Operations of matrices 1.3 Types of matrices 1.4 Properties of matrices 1.5 Determinants 1.6 Inverse of a 3 3 matrix 2 1.1 Matrices A 2 3 7 =! " 1
More informationIntroduction to Matrices
214 Analysis and Design of Feedback Control Systems Introduction to Matrices Derek Rowell October 2002 Modern system dynamics is based upon a matrix representation of the dynamic equations governing the
More informationECON 186 Class Notes: Linear Algebra
ECON 86 Class Notes: Linear Algebra Jijian Fan Jijian Fan ECON 86 / 27 Singularity and Rank As discussed previously, squareness is a necessary condition for a matrix to be nonsingular (have an inverse).
More informationGlossary of Linear Algebra Terms. Prepared by Vince Zaccone For Campus Learning Assistance Services at UCSB
Glossary of Linear Algebra Terms Basis (for a subspace) A linearly independent set of vectors that spans the space Basic Variable A variable in a linear system that corresponds to a pivot column in the
More informationMatrix Algebra for Engineers Jeffrey R. Chasnov
Matrix Algebra for Engineers Jeffrey R. Chasnov The Hong Kong University of Science and Technology The Hong Kong University of Science and Technology Department of Mathematics Clear Water Bay, Kowloon
More informationA matrix is a rectangular array of. objects arranged in rows and columns. The objects are called the entries. is called the size of the matrix, and
Section 5.5. Matrices and Vectors A matrix is a rectangular array of objects arranged in rows and columns. The objects are called the entries. A matrix with m rows and n columns is called an m n matrix.
More informationLinear Algebra (part 1) : Matrices and Systems of Linear Equations (by Evan Dummit, 2016, v. 2.02)
Linear Algebra (part ) : Matrices and Systems of Linear Equations (by Evan Dummit, 206, v 202) Contents 2 Matrices and Systems of Linear Equations 2 Systems of Linear Equations 2 Elimination, Matrix Formulation
More informationA matrix is a rectangular array of. objects arranged in rows and columns. The objects are called the entries. is called the size of the matrix, and
Section 5.5. Matrices and Vectors A matrix is a rectangular array of objects arranged in rows and columns. The objects are called the entries. A matrix with m rows and n columns is called an m n matrix.
More informationLinear Algebra. The analysis of many models in the social sciences reduces to the study of systems of equations.
POLI 7 - Mathematical and Statistical Foundations Prof S Saiegh Fall Lecture Notes - Class 4 October 4, Linear Algebra The analysis of many models in the social sciences reduces to the study of systems
More informationIntroduction to Matrices and Linear Systems Ch. 3
Introduction to Matrices and Linear Systems Ch. 3 Doreen De Leon Department of Mathematics, California State University, Fresno June, 5 Basic Matrix Concepts and Operations Section 3.4. Basic Matrix Concepts
More informationc c c c c c c c c c a 3x3 matrix C= has a determinant determined by
Linear Algebra Determinants and Eigenvalues Introduction: Many important geometric and algebraic properties of square matrices are associated with a single real number revealed by what s known as the determinant.
More informationSection 9.2: Matrices.. a m1 a m2 a mn
Section 9.2: Matrices Definition: A matrix is a rectangular array of numbers: a 11 a 12 a 1n a 21 a 22 a 2n A =...... a m1 a m2 a mn In general, a ij denotes the (i, j) entry of A. That is, the entry in
More informationNotes on Mathematics
Notes on Mathematics - 12 1 Peeyush Chandra, A. K. Lal, V. Raghavendra, G. Santhanam 1 Supported by a grant from MHRD 2 Contents I Linear Algebra 7 1 Matrices 9 1.1 Definition of a Matrix......................................
More information3 (Maths) Linear Algebra
3 (Maths) Linear Algebra References: Simon and Blume, chapters 6 to 11, 16 and 23; Pemberton and Rau, chapters 11 to 13 and 25; Sundaram, sections 1.3 and 1.5. The methods and concepts of linear algebra
More informationChapter 4 - MATRIX ALGEBRA. ... a 2j... a 2n. a i1 a i2... a ij... a in
Chapter 4 - MATRIX ALGEBRA 4.1. Matrix Operations A a 11 a 12... a 1j... a 1n a 21. a 22.... a 2j... a 2n. a i1 a i2... a ij... a in... a m1 a m2... a mj... a mn The entry in the ith row and the jth column
More informationLinear Algebra Primer
Linear Algebra Primer David Doria daviddoria@gmail.com Wednesday 3 rd December, 2008 Contents Why is it called Linear Algebra? 4 2 What is a Matrix? 4 2. Input and Output.....................................
More information1 Matrices and Systems of Linear Equations
Linear Algebra (part ) : Matrices and Systems of Linear Equations (by Evan Dummit, 207, v 260) Contents Matrices and Systems of Linear Equations Systems of Linear Equations Elimination, Matrix Formulation
More informationENGI 9420 Lecture Notes 2 - Matrix Algebra Page Matrix operations can render the solution of a linear system much more efficient.
ENGI 940 Lecture Notes - Matrix Algebra Page.0. Matrix Algebra A linear system of m equations in n unknowns, a x + a x + + a x b (where the a ij and i n n a x + a x + + a x b n n a x + a x + + a x b m
More informationDigital Workbook for GRA 6035 Mathematics
Eivind Eriksen Digital Workbook for GRA 6035 Mathematics November 10, 2014 BI Norwegian Business School Contents Part I Lectures in GRA6035 Mathematics 1 Linear Systems and Gaussian Elimination........................
More informationLinear Algebra and Matrix Inversion
Jim Lambers MAT 46/56 Spring Semester 29- Lecture 2 Notes These notes correspond to Section 63 in the text Linear Algebra and Matrix Inversion Vector Spaces and Linear Transformations Matrices are much
More informationLINEAR SYSTEMS, MATRICES, AND VECTORS
ELEMENTARY LINEAR ALGEBRA WORKBOOK CREATED BY SHANNON MARTIN MYERS LINEAR SYSTEMS, MATRICES, AND VECTORS Now that I ve been teaching Linear Algebra for a few years, I thought it would be great to integrate
More informationMatrix & Linear Algebra
Matrix & Linear Algebra Jamie Monogan University of Georgia For more information: http://monogan.myweb.uga.edu/teaching/mm/ Jamie Monogan (UGA) Matrix & Linear Algebra 1 / 84 Vectors Vectors Vector: A
More informationSection 9.2: Matrices. Definition: A matrix A consists of a rectangular array of numbers, or elements, arranged in m rows and n columns.
Section 9.2: Matrices Definition: A matrix A consists of a rectangular array of numbers, or elements, arranged in m rows and n columns. That is, a 11 a 12 a 1n a 21 a 22 a 2n A =...... a m1 a m2 a mn A
More informationLinear Algebra: Matrix Eigenvalue Problems
CHAPTER8 Linear Algebra: Matrix Eigenvalue Problems Chapter 8 p1 A matrix eigenvalue problem considers the vector equation (1) Ax = λx. 8.0 Linear Algebra: Matrix Eigenvalue Problems Here A is a given
More informationSystems of Linear Equations and Matrices
Chapter 1 Systems of Linear Equations and Matrices System of linear algebraic equations and their solution constitute one of the major topics studied in the course known as linear algebra. In the first
More informationGraduate Mathematical Economics Lecture 1
Graduate Mathematical Economics Lecture 1 Yu Ren WISE, Xiamen University September 23, 2012 Outline 1 2 Course Outline ematical techniques used in graduate level economics courses Mathematics for Economists
More informationUndergraduate Mathematical Economics Lecture 1
Undergraduate Mathematical Economics Lecture 1 Yu Ren WISE, Xiamen University September 15, 2014 Outline 1 Courses Description and Requirement 2 Course Outline ematical techniques used in economics courses
More informationLinear Algebra M1 - FIB. Contents: 5. Matrices, systems of linear equations and determinants 6. Vector space 7. Linear maps 8.
Linear Algebra M1 - FIB Contents: 5 Matrices, systems of linear equations and determinants 6 Vector space 7 Linear maps 8 Diagonalization Anna de Mier Montserrat Maureso Dept Matemàtica Aplicada II Translation:
More informationLinear Equations and Matrix
1/60 Chia-Ping Chen Professor Department of Computer Science and Engineering National Sun Yat-sen University Linear Algebra Gaussian Elimination 2/60 Alpha Go Linear algebra begins with a system of linear
More informationUNIT 1 DETERMINANTS 1.0 INTRODUCTION 1.1 OBJECTIVES. Structure
UNIT 1 DETERMINANTS Determinants Structure 1.0 Introduction 1.1 Objectives 1.2 Determinants of Order 2 and 3 1.3 Determinants of Order 3 1.4 Properties of Determinants 1.5 Application of Determinants 1.6
More informationII. Determinant Functions
Supplemental Materials for EE203001 Students II Determinant Functions Chung-Chin Lu Department of Electrical Engineering National Tsing Hua University May 22, 2003 1 Three Axioms for a Determinant Function
More informationn n matrices The system of m linear equations in n variables x 1, x 2,..., x n can be written as a matrix equation by Ax = b, or in full
n n matrices Matrices Definitions Diagonal, Identity, and zero matrices Addition Multiplication Transpose and inverse The system of m linear equations in n variables x 1, x 2,..., x n a 11 x 1 + a 12 x
More informationChapter 2. Square matrices
Chapter 2. Square matrices Lecture notes for MA1111 P. Karageorgis pete@maths.tcd.ie 1/18 Invertible matrices Definition 2.1 Invertible matrices An n n matrix A is said to be invertible, if there is a
More informationMatrices A brief introduction
Matrices A brief introduction Basilio Bona DAUIN Politecnico di Torino Semester 1, 2014-15 B. Bona (DAUIN) Matrices Semester 1, 2014-15 1 / 41 Definitions Definition A matrix is a set of N real or complex
More informationGaussian Elimination and Back Substitution
Jim Lambers MAT 610 Summer Session 2009-10 Lecture 4 Notes These notes correspond to Sections 31 and 32 in the text Gaussian Elimination and Back Substitution The basic idea behind methods for solving
More informationElementary Row Operations on Matrices
King Saud University September 17, 018 Table of contents 1 Definition A real matrix is a rectangular array whose entries are real numbers. These numbers are organized on rows and columns. An m n matrix
More informationLINEAR ALGEBRA SUMMARY SHEET.
LINEAR ALGEBRA SUMMARY SHEET RADON ROSBOROUGH https://intuitiveexplanationscom/linear-algebra-summary-sheet/ This document is a concise collection of many of the important theorems of linear algebra, organized
More informationSystems of Linear Equations and Matrices
Chapter 1 Systems of Linear Equations and Matrices System of linear algebraic equations and their solution constitute one of the major topics studied in the course known as linear algebra. In the first
More informationSAMPLE OF THE STUDY MATERIAL PART OF CHAPTER 1 Introduction to Linear Algebra
1.1. Introduction SAMPLE OF THE STUDY MATERIAL PART OF CHAPTER 1 Introduction to Linear algebra is a specific branch of mathematics dealing with the study of vectors, vector spaces with functions that
More informationMATRICES The numbers or letters in any given matrix are called its entries or elements
MATRICES A matrix is defined as a rectangular array of numbers. Examples are: 1 2 4 a b 1 4 5 A : B : C 0 1 3 c b 1 6 2 2 5 8 The numbers or letters in any given matrix are called its entries or elements
More informationMAT Linear Algebra Collection of sample exams
MAT 342 - Linear Algebra Collection of sample exams A-x. (0 pts Give the precise definition of the row echelon form. 2. ( 0 pts After performing row reductions on the augmented matrix for a certain system
More informationMatrices. In this chapter: matrices, determinants. inverse matrix
Matrices In this chapter: matrices, determinants inverse matrix 1 1.1 Matrices A matrix is a retangular array of numbers. Rows: horizontal lines. A = a 11 a 12 a 13 a 21 a 22 a 23 a 31 a 32 a 33 a 41 a
More informationELEMENTARY LINEAR ALGEBRA
ELEMENTARY LINEAR ALGEBRA K R MATTHEWS DEPARTMENT OF MATHEMATICS UNIVERSITY OF QUEENSLAND First Printing, 99 Chapter LINEAR EQUATIONS Introduction to linear equations A linear equation in n unknowns x,
More information3 Matrix Algebra. 3.1 Operations on matrices
3 Matrix Algebra A matrix is a rectangular array of numbers; it is of size m n if it has m rows and n columns. A 1 n matrix is a row vector; an m 1 matrix is a column vector. For example: 1 5 3 5 3 5 8
More informationIMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET
IMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET This is a (not quite comprehensive) list of definitions and theorems given in Math 1553. Pay particular attention to the ones in red. Study Tip For each
More informationChapter 2:Determinants. Section 2.1: Determinants by cofactor expansion
Chapter 2:Determinants Section 2.1: Determinants by cofactor expansion [ ] a b Recall: The 2 2 matrix is invertible if ad bc 0. The c d ([ ]) a b function f = ad bc is called the determinant and it associates
More informationThings we can already do with matrices. Unit II - Matrix arithmetic. Defining the matrix product. Things that fail in matrix arithmetic
Unit II - Matrix arithmetic matrix multiplication matrix inverses elementary matrices finding the inverse of a matrix determinants Unit II - Matrix arithmetic 1 Things we can already do with matrices equality
More informationLinear Algebra Homework and Study Guide
Linear Algebra Homework and Study Guide Phil R. Smith, Ph.D. February 28, 20 Homework Problem Sets Organized by Learning Outcomes Test I: Systems of Linear Equations; Matrices Lesson. Give examples of
More informationIntroduction to Mobile Robotics Compact Course on Linear Algebra. Wolfram Burgard, Cyrill Stachniss, Kai Arras, Maren Bennewitz
Introduction to Mobile Robotics Compact Course on Linear Algebra Wolfram Burgard, Cyrill Stachniss, Kai Arras, Maren Bennewitz Vectors Arrays of numbers Vectors represent a point in a n dimensional space
More informationReview of Vectors and Matrices
A P P E N D I X D Review of Vectors and Matrices D. VECTORS D.. Definition of a Vector Let p, p, Á, p n be any n real numbers and P an ordered set of these real numbers that is, P = p, p, Á, p n Then P
More informationMATH 106 LINEAR ALGEBRA LECTURE NOTES
MATH 6 LINEAR ALGEBRA LECTURE NOTES FALL - These Lecture Notes are not in a final form being still subject of improvement Contents Systems of linear equations and matrices 5 Introduction to systems of
More informationMath Camp Notes: Linear Algebra I
Math Camp Notes: Linear Algebra I Basic Matrix Operations and Properties Consider two n m matrices: a a m A = a n a nm Then the basic matrix operations are as follows: a + b a m + b m A + B = a n + b n
More informationDirect Methods for Solving Linear Systems. Matrix Factorization
Direct Methods for Solving Linear Systems Matrix Factorization Numerical Analysis (9th Edition) R L Burden & J D Faires Beamer Presentation Slides prepared by John Carroll Dublin City University c 2011
More informationNOTES on LINEAR ALGEBRA 1
School of Economics, Management and Statistics University of Bologna Academic Year 207/8 NOTES on LINEAR ALGEBRA for the students of Stats and Maths This is a modified version of the notes by Prof Laura
More informationInverting Matrices. 1 Properties of Transpose. 2 Matrix Algebra. P. Danziger 3.2, 3.3
3., 3.3 Inverting Matrices P. Danziger 1 Properties of Transpose Transpose has higher precedence than multiplication and addition, so AB T A ( B T and A + B T A + ( B T As opposed to the bracketed expressions
More informationMatrices and Matrix Algebra.
Matrices and Matrix Algebra 3.1. Operations on Matrices Matrix Notation and Terminology Matrix: a rectangular array of numbers, called entries. A matrix with m rows and n columns m n A n n matrix : a square
More informationDaily Update. Math 290: Elementary Linear Algebra Fall 2018
Daily Update Math 90: Elementary Linear Algebra Fall 08 Lecture 7: Tuesday, December 4 After reviewing the definitions of a linear transformation, and the kernel and range of a linear transformation, we
More informationMatrix Algebra Determinant, Inverse matrix. Matrices. A. Fabretti. Mathematics 2 A.Y. 2015/2016. A. Fabretti Matrices
Matrices A. Fabretti Mathematics 2 A.Y. 2015/2016 Table of contents Matrix Algebra Determinant Inverse Matrix Introduction A matrix is a rectangular array of numbers. The size of a matrix is indicated
More informationIntroduction. Vectors and Matrices. Vectors [1] Vectors [2]
Introduction Vectors and Matrices Dr. TGI Fernando 1 2 Data is frequently arranged in arrays, that is, sets whose elements are indexed by one or more subscripts. Vector - one dimensional array Matrix -
More informationLinear Algebra. James Je Heon Kim
Linear lgebra James Je Heon Kim (jjk9columbia.edu) If you are unfamiliar with linear or matrix algebra, you will nd that it is very di erent from basic algebra or calculus. For the duration of this session,
More informationa 11 x 1 + a 12 x a 1n x n = b 1 a 21 x 1 + a 22 x a 2n x n = b 2.
Chapter 1 LINEAR EQUATIONS 11 Introduction to linear equations A linear equation in n unknowns x 1, x,, x n is an equation of the form a 1 x 1 + a x + + a n x n = b, where a 1, a,, a n, b are given real
More informationIntroduction to Determinants
Introduction to Determinants For any square matrix of order 2, we have found a necessary and sufficient condition for invertibility. Indeed, consider the matrix The matrix A is invertible if and only if.
More informationANSWERS. E k E 2 E 1 A = B
MATH 7- Final Exam Spring ANSWERS Essay Questions points Define an Elementary Matrix Display the fundamental matrix multiply equation which summarizes a sequence of swap, combination and multiply operations,
More informationMatrices. Chapter Definitions and Notations
Chapter 3 Matrices 3. Definitions and Notations Matrices are yet another mathematical object. Learning about matrices means learning what they are, how they are represented, the types of operations which
More informationIMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET
IMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET This is a (not quite comprehensive) list of definitions and theorems given in Math 1553. Pay particular attention to the ones in red. Study Tip For each
More information