NOTES ON LINEAR ALGEBRA. 1. Determinants
|
|
- Mitchell Wood
- 5 years ago
- Views:
Transcription
1 NOTES ON LINEAR ALGEBRA 1 Determinants In this section, we study determinants of matrices We study their properties, methods of computation and some applications We are familiar with the following formulas for determinants: [ a b det[a] = a, det c d ] = ad bc, and det a b c d e f g h i = aei ahf bdi+bgf +cdh ceg There is an explicit formula for determinant, det A, for any n n matrix A This involves n! terms Our approach to determinants is via their properties It makes their study more elegant Let A be a 3 3 matrix with real entries Let A i be the i th row of A, i = 1, 2, 3 We write A = (A 1, A 2, A 3 ) We think of A 1, A 2, A 3 as vectors in R 3 Then det A = det(a 1, A 2, A 3 ) = A 1 A 2 A 3 Thus det A is the volume of the parallelepiped formed by the row vectors of A Hence det A = 0 if and only if A 1, A 2, A 3 are coplanar The following properties of det A follow from those of triple scalar product: (1) Multilinearity : Let B 2, C 2 R 3 and α, β R Then det(a 1, αb 2 + βc 2, A 3 ) = α det(a 1, B 2, A 3 ) + β det(a 1, C 2, A 3 ) Similarly we can show that linearity holds for other rows also (2) Alternating : det A = 0 when two rows of A are equal In this case the rows generate either a plane or a line whose volume is zero (3) Normalization : det(e 1, e 2, e 3 ) = 1 where e 1, e 2, e 3 are the unit coordinate vectors in the direction of positive x-axis, y-axis and z-axis respectively These properties motivate the axioms for determinant like functions on n n matrices We will write an n n matrix A with row vectors A 1, A 2,, A n as A = (A 1, A 2,, A n ) Let d(a 1, A 2,, A n ) be a function defined on the rows A 1, A 2,, A n of a matrix A We assume that the entries of A are in any field F Definition 11 (i) d(a 1, A 2,, A n ) is called multilinear if for each k = 1, 2,, n; α, β scalars and a vector C F n d(a 1,, αa k + βc,, A n ) = αd(a 1,, A k,, A n ) + βd(a 1, A 2,, C,, A n ) (ii) d(a 1, A 2,, A n ) is called alternating if d(a 1, A 2,, A n ) = 0 if A i = A j for i j 1
2 2 NOTES ON LINEAR ALGEBRA (iii) d(a 1, A 2,, A n ) is called normalized if d(e 1, e 2,, e n ) = 1 where e i is the i th unit coordinate vector (0, 0,, 1, 0,, 0) where 1 occurs in i th place (iv) A normalized alternating and multillinear function d(a 1, A 2,, A n ) on n n matrices A = (A 1, A 2,, A n ) is called a determinant function of order n Our immediate objective is to show that there is only one determinant function of order n This fact is very useful in finding formulas for determinants or proving that certain formula gives determinant of some matrix We simply show that the formula defines an alternating, multilinear and normalized function on the rows of n n matrices Lemma 12 Suppose that d(a 1, A 2,, A n ) is a multilinear alternating function on rows of n n matrices Then (1) If some A k = 0 then d(a 1, A 2,, A n ) = 0 (2) d(a 1, A 2,, A i,, A j,, A n ) = d(a 1, A 2,, A j,, A i,, A n ) Proof (1) If A k = 0 then by multilinearity d(a 1, A 2,, 0A k,, A n ) = 0 d(a 1, A 2,, A k,, A n ) = 0 (2) Put A i = B, A j = C Then by alternating property of d(a 1, A 2,, A n ), 0 = d(a 1, A 2,, B + C,, B + C,, A n ) = d(a 1, A 2,, B,, B + C,, A n ) + d(a 1, A 2,, C,, B + C,, A n ) = d(a 1, A 2,, B,, C,, A n ) + d(a 1, A 2,, C,, B,, A n ) Hence d(a 1, A 2,, B,, C,, A n ) = d(a 1, A 2,, C,, B,, A n ) Computation of determinants We now derive the familiar formula for the determinant of 2 2 matrices Suppose d(a 1, A 2 ) is an alternating multilinear normalized function on 2 2 matrices A = (A 1, A 2 ) Then [ ] x y d = xu yz z u To derive this formula, write the first row as A = xe 1 + ye 2 and the second row as A 2 = ze 1 + ue 2 Then d(a 1, A 2 ) = d(xe 1 + ye 2, ze 1 + ue 2 ) = d(xe 1 + ye 2, ze 1 ) + d(xe 1 + ye 2, ue 2 ) = d(xe 1, ze 1 ) + d(ye 2, ze 1 ) +d(xe 1, ue 2 ) + d(ye 2, ue 2 ) = yzd(e 2, e 1 ) + xud(e 1, e 2 ) = (xu yz)d(e 1, e 2 ) = xu yz
3 NOTES ON LINEAR ALGEBRA 3 Exercise 13 Let d be an alternating, multilinear, and normalized function on the rows of n n matrices If the rows of A are dependent show that d(a) = 0 Exercise 14 Let U be an upper triangular matrix and d is an alternating multilinear normalized function on the rows of n n matrices Show that d(u) = product of diagonal entries of U Show the same result for lower triangular matrices Computation by Gauss Elimination Method This is one of the most efficient ways to calculate determinant functions Let A be an n n matrix Suppose E = the n n elementary matrix for the row operation ca j + A i F = the n n elementary matrix for the row operation A i A j G = the n n elementary matrix for the row operation A i ca i Suppose that U is the row-echelon form of A If c 1, c 2,, c p are the multipliers used for the row operations A i ca i and r row exchanges have been used to get U from A then for any alternating multilinear function d, d(a) = ( 1) r (c 1 c 2 c p ) 1 d(u) To see this we simply note that d(f A) = d(a), d(ea) = d(a) and d(ga) = cd(a) Suppose that u 11, u 22,, u nn are the diagonal entries of U then d(a) = ( 1) r (c 1 c 2, c p ) 1 u 11 u 22 u nn d(e 1, e 2,, e n ) Existence and uniqueness of determinant function Theorem 15 (Uniqueness of determinant function) Let f be an alternating multilinear function of order n and d a determinant function of order n Then for all n n matrices A = (A 1, A 2,, A n ), f(a 1, A 2,, A n ) = d(a 1, A 2,, A n )f(e 1, e 2,, e n ) In particular, if f is also a determinant function then f(a 1, A 2,, A n ) = d(a 1, A 2,, A n ) Proof Consider the function g(a 1, A 2,, A n ) = f(a 1, A 2,, A n ) d(a 1, A 2,, A n )f(e 1, e 2,, e n ) We show that g 0 Since f, d are alternating and multilinear so is g and thus we have g(a 1, A 2,, A n ) = cg(e 1, e 2,, e n ), where c depends only on A = (A 1, A 2,, A n ) Thus g(e 1, e 2,, e n ) = f(e 1, e 2,, e n ) d(e 1, e 2,, e n )f(e 1,, e n ) = 0 Hence g 0
4 4 NOTES ON LINEAR ALGEBRA We shall use det A or A for d(a 1,, A n ) since d is unique We have proved uniqueness of determinant function of order n It remains to show their existence We set det [a] = a by definition We have already proved the formula for det A for 2 2 matrices The determinant of an n n matrix A can be computed in terms of certain (n 1) (n 1) determinants by a process called expansion by minors Let A ij = be the (n 1) (n 1) matrix obtained from A by deleting the i th row and j th column of A Theorem 16 Let A = (a ij ) be an n n matrix Then, for 1 k n, det A = ( 1) k+1 (a 1k det A 1k a 2k det A 2k + + ( 1) n+1 a nk det A nk ) Proof We prove the case k = 1 The other cases are similar Let us denote the right hand side of the above equation by f(a 1, A 2,, A n ) We show that f(a 1, A 2,, A n ) is a determinant function by induction on n It is easily checked for n = 1 and n = 2 Suppose that the rows A j and A j+1 of A are equal Then A i1 have equal rows except when i = j or i = j + 1 By induction det A i1 = 0 for i j, j + 1 Thus det A = a j1 [ ( 1) j+1 det (A j1 ) ] + [ ( 1) j+2 det A j+11 ] aj+11 Since A j = A j+1, a j1 = a j+1 1 and A j1 = A j+11 Thus det A = 0 Therefore f(a 1, A 2,, A n ) is alternating If A = (e 1, e 2,, e n ) then by induction det A = 1 det A 11 = det (e 1, e 2,, e n 1 ) = 1 We leave the multilinear property of f(a 1,, A n ) as an exercise for the reader Determinant and Invertibility Theorem 17 Let A, B be two n n matrices Then det (AB) = det A det B Proof Let D i denote the ith row of of a matrix D Then (AB) i = A i B Therefore we need to prove: det (A 1 B, A 2 B, A n B) = det (A 1, A 2,, A n ) det (B 1,, B n ) = det (A 1, A 2,, A n ) det (e 1 B, e 2 B,, e n B) Keep B fixed and define f(a 1, A 2,, A n ) = det (A 1 B, A 2 B,, A n B) We show that f is alternating and multilinear Let C F n Then
5 NOTES ON LINEAR ALGEBRA 5 Therefore f(a 1,, A i,, A i,, A n ) = det (A 1 B,, A i B,, A i B,, A n B) = 0 f(a 1,, αa k + βc,, A n ) = det (A 1 B,, (αa k + βc)b,, A n B) = det (A 1 B,, αa k B + βcb,, A n B) = α det (A 1 B,, A k B,, A n B) + β det (A 1 B,, CB,, A n B) = αf(a 1,, A n ) + βf(a 1,, C,, A n ) f(a 1, A 2,, A n ) = det (A 1,, A n )f(e 1, e 2,, e n ) = det (A 1,, A n ) det (B 1, B 2,, B n ) Hence det (AB) = det A det B Lemma 18 A is an invertible matrix if and only if det A 0 In this case, det A 1 = 1 det A Proof Suppose A is invertible Then AA 1 = I Thus det A 1 det A = det I = 1 So det A 0 and det A 1 = 1/ det A Coversely let det A 0 By Exercise 13,we have rank A = n Thus the standard basis vectors e 1, e 2,, e n F n 1 can be expressed in terms of the column vectors of A For i = 1, 2,, n write e i = b 1i A 1 + b 2i A b ni A n for uniquely determined scalars b ij Let B = (b ij ) Then AB = I Hence A is invertible Theorem 19 For any n n matrix A, det A = det A t Proof If rank A < n then A is not invertible and det A = 0 Since the row rank and the column rank are equal, it follows that det A t = 0 So we may assume that A is invertible By Gauss elimination A can be reduced to the identity matrix by elementary row operations Thus A is a product of elementary matrices Now, it can be easily checked that each elementary matrix is either symmetric or lower triangular or upper trianlgular By Exercise 14 the determinant of a lower or upper triangular matrix is equal to the determinant of its transpose Let A = E 1 E 2 E r for some elementary matrices E 1, E 2,, E r Hence r r r det A = det E i = det Ei t = det Er i t = det A t i=1 i=1 i=1
6 6 NOTES ON LINEAR ALGEBRA It follows from the theorem above that the determinant function is multilinear, alternating, and normalized with respect to the columns We also have the row expansion analog of Theorem 16 Theorem 110 Let B be a n n matrix Then for k = 1, 2,, n, det B = ( 1) k+1 (b k1 det B k1 b k2 det B k2 + + ( 1) n+1 b kn det B kn ) The cofactor matrix and a formula for A 1 Definition: Let A = (a ij ) be an n n matrix The cofactor of a ij, denoted by cof a ij is defined as cof a ij = ( 1) i+j det A ij The cofactor matrix of A denoted by cof A is the matrix cof A = ( cof a ij ) Theorem 111 For any n n matrix A with n 2, A( cof A) t = ( det A)I = ( cof A) t A In particular, if det A is nonzero then A 1 = 1 det A ( cof A)t, hence A is invertible Proof The (i, j) entry of ( cof A) t A is : a 1j cof a 1i + a 2j cof a 2i + + a nj cof a ni If i = j, it is easy to see that it is det A When i j consider the matrix B obtained by replacing i th column of A by j th column of A So B has a repeated column Hence det B = 0 To get the other equation, substitute A t for A in the equation just proved, take transpose and observe that cof A t = ( cof A) t Theorem 112 (Cramer s Rule) Suppose a 11 a 12 a 1n a 21 a 22 a 2n a n1 a n2 a nn x 1 x 2 x n b 1 = b 2 is system of n linear equations in n unknowns, x 1, x 2,, x n Suppose the coefficient matrix A = (a ij ) is invertible Let C j be the matrix obtained from A by replacing j th column of A by b = (b 1, b 2,, b n ) t Then for j = 1, 2,, n, x j = det C j det A Proof We have b = x 1 A 1 + x 2 A x n A n, where A j is the jth column of A Using multilinearity of the determinant on the columns of C j we see that det C j = x j det A b n
7 NOTES ON LINEAR ALGEBRA 7 Determinants and permutations We derive a formula for determinant of a matrix by means of permutations Recall that a permutation of the set [n] = {1, 2,, n} is a bijection of [n] Let σ be a permutation of [n] We write this as ( σ = 1 2 n σ(1) σ(2) σ(n) Let the set of permutations of [n] be denoted by S n For any σ S n we define the permutation matrix A σ by If τ S n then for all k = 1, 2,, n, Hence A στ = A σ A τ A σ = [e σ(1), e σ(2),, e σ(n) ] ) A στ (e k ) = e στ(k) and A σ A τ (e k ) = A σ e τ(k) = e στ(k) Definition 113 The signature ɛ(σ) of a permutation σ S n is defined by ɛ(σ) = det A σ Since A σ is obtained from the identity matrix by permuting the rows, ɛ(σ) = ±1 Lemma 114 For all σ, τ S n, ɛ(στ) = ɛ(σ)ɛ(τ) Proof ɛ(στ) = det A στ = det A σ det A τ = ɛ(σ)ɛ(τ) Definition 115 A permutation σ is called a transposition if there exist i j [n] such that σ(i) = j, σ(j) = i and σ(k) = k for all k [n] \ {i, j} In this case we write σ = (ij) Theorem 116 Every permutation in S n is a product of transpositions Proof Let σ S n Suppose that σ(n) = n Then σ S n 1 By induction on n, σ is a product of transpositions If σ(n) n and σ(n) = i then (in)σ(n) = n Hence the permutation (in)σ is a product of transpositions Thus σ is a product of transpositions Definition 117 A permutation σ is called even (resp odd) if ɛ(σ) = 1 (resp 1) Since ɛ(στ) = ɛ(σ)ɛ(τ), product of even permutations is even, product of an odd and even permutation is odd and product of odd permutations is even A transposition is an odd permutation Hence if a permutation is a product of even number of transpositions if and only is it is even and it is odd if and only if it is a product of odd number of transpositions Theorem 118 Let F be a field and A = (a ij ) F n n Then det A = σ S n ɛ(σ)a 1σ(1) a 2σ(2) a nσ(n)
8 8 NOTES ON LINEAR ALGEBRA Proof Let a i denote the i th row vector of A Then det (a 1, a 2,, a n ) = det a 1j e j, a 2, a 3,, a n ) = = = = j=1 a 1j det (e j, a 2, a 3,, a n )) j=1 a 1j1 det j 1 =1 j 1 =1 j 2 =1 j 1 =1 j 2 =1 = e j1, a 2j2 e j2, a 3,, a n ) j 2 =1 a 1j1 a 2j2 det (e j1, e j2, a 3,, a n ) a 1j1 a 2j2 a njn det (e j1, e j2,, e njn ) j n=1 σ S n ɛ(σ)a 1σ(1) a 2σ(2) a nσ(n) Determinant and rank of a matrix Finally we discuss the rank of a matrix in terms of determinants An r r minor of an m n matrix is the determinant of a submatrix obtained by deleting m r rows and n r columns of A Lemma 119 Let F be a field and A F n n Then rank(a) = n if and only if det A 0 Proof Let rank(a) = n Then by row and column operations A can be reduced to the identity matrix Since the nonvanishing of det A remains unchanged under elementary row and column operations, we conclude that det A 0 Conversely let det A 0 If rank(a) < n then the column vectors of A are linearly dependent Let b 1 A 1 + b 2 A b n A n = 0 for some scalars b 1, b 2,, b n Then Ab = 0 where b = (b 1, b 2,, b n ) t Since det A 0, A is invertible Hence b = 0 which is a contradiction Theorem 120 The rank of an m n matrix A is r if and only if A has an r r nonzero minor and all r + k r + k minors of A are zero for all k = 1, 2, Proof We say that det rank A = r if the condition on the minors stated in the theorem is satisfied Let rank(a) = r Then there exist r linearly independent rows of A and any s rows of A where s > r are linearly dependent We may then form an r n submatrix B of A whose rows are linearly independent Hence rank(b) = r Hence we can find r linearly independent columns of B Hence there is an r r nonzero minor of A Hence det rank(a) rank(a)
9 NOTES ON LINEAR ALGEBRA 9 Coversely let det rank(a) = r Then there exists an r r submatrix of A having nonzero determinant Hence the rows of A that contain this submatrix are linearly independent Therefore rank(a) det rank(a) Determinant of a linear map Definition 121 Let T : V V be a linear operator of an n-dimensional dimensional vector space V Let B be a basis of V Then the determinant det T of T is defined to be det (MB B (T )) Note that determinant of a linear operator on V is well-defined Indeed, if C is another basis of V, then we know that MC C(T ) = P 1 AP for an invertible matrix P where A = MB B(T ) Hence det M C C (T ) = det A Theorem 122 Let T be a linear operator on an n-dimensional vector space V Then T is invertible if and only if det T 0 Proof Let T be invertible Then there is a linear map S : V V such that T S = ST = I Let M(T ) denote the matrix of T with respect to a basis B of V Hence M(T )M(S) = I Thus det M(T ) det M(S) = 1 Hence det M(T ) = det T 0 Conversely let det T 0 Then det M(T ) 0 Hence rank M(T ) = rank T = n Thus T is onto Since V is finite-dimensional, T is invertible 2 Orthogonal projections, best approximations and least squares Let V be a finite dimensional inner product space We have seen how to project a vector onto a nonzero vector We now discuss the orthogonal projection of a vector onto a subspace Let W be a nonzero subspace of V The orthogonal subspace W of W is defined as W = {u V u w for all w W } Theorem 21 Every v V can be written uniquely as v = x + y, where x W and y W Proof (Existence) Let {v 1, v 2,, v k } be an orthonormal basis of W Set x = v, v 1 v 1 + v, v 2 v v, v k v k
10 10 NOTES ON LINEAR ALGEBRA and put y = v x Clearly v = x + y and x W We now check that y W For i = 1, 2,, k we have It follows that y W y, v i = v x, v i = v, v i x, v i k = v, v i v, v j v j, v i = v, v i j=1 k v, v j v j, v i j=1 = v, v i v, v i (by orthonormality) = 0 (Uniqueness) Let v = x + y = x + y, where x, x W and y, y W Then x x = y y W W But W W = {0} Hence x = x and y = y Exercise 22 Show that dim W + dim W = dim V Definition 23 For a subspace W, we define a function p W : V W as follows: given v V, express v uniquely as v = x + y, where x W and y W Define p W (v) = x We call p W (v) the orthogonal projection of v onto W Note that v p W (v) W Definition 24 Let W be a subspace of V and let v V A best approximation to v by vectors in W is a vector u in W such that v u v w, for all w W The next result shows that orthogonal projection gives the unique best approximator Theorem 25 Let v V and let W be a subspace of V Let w W Then the following are equivalent: (1) w is a best approximation to v by vectors in W (2) w = p W (v) (3) v w W Proof We have v w 2 = v p W (v) + p W (v) w 2 = v p W (v) 2 + p W (v) w 2, where the second equality follows from Pythogoras theorem on noting that p W (v) w W and v p W (v) W It follows that (1) and (2) are equivalent To see the equivalence of (1) and (3) write v = w + (v w) and apply Theorem 1 Example 26 Let V = C[0, 2π] = {f : [0, 2π] R f is continuous} Consider the trigonometric functions: u 0 = 1, u 2n 1 = cos nx, u 2n = sin nx for n = 1, 2,
11 NOTES ON LINEAR ALGEBRA 11 The functions in the subspace T generated by u n, n = 0, 1, 2, are called trigonometric polynomials The vector space V is an inner product space with the inner product f(x), g(x) = 2π 0 f(x)g(x)dx It is easy to check that u m u n for all m n Check that u 0, u 0 = 2π 0 Thus the set dt = 2π, cos nx, cos nx = B m = {φ 0 = 1 2π, φ 2n 1 (x) = 2π 0 cos 2 nx = sin nx, sin nx 2π cos nx sin nx, φ 2n (x) = n = 1, 2,, n} π π 0 sin 2 nx = π is an orthonormal basis of the subspace W = L(B m ) For a function f V the best approximation by trigonometric polynomials in W is given by P W (f) = 2m k=0 f, φ k φ k The real numbers f, φ k for k = 0, 1, are called the Fourier coefficients in honour of the French mathematician Joseph Fourier ( ), who was led to these in his study of the heat equation Projection of a vector onto the column space of a matrix Let us now consider projection from the matrix point of view Consider R n with standard inner product Let A be an n m (m n) matrix and let b R n We want to project b onto the column space of A The projection of b onto the column space of A will be a vector of the form p = Ax, for some x R m From Theorem 25, p is the projection if and only if b Ax is orthogonal to every column of A In other words, x should satisfy the equations A t (b Ax) = 0, ora t Ax = A t b The above equations are called normal equations in Gauss-Markov theory in statistics Lemma 27 rank(a t A) = rank A and nullity(a t A) = nullity(a) In particular, if the columns of A are linearly independent, then A t A is an invertible matrix Proof Let A t Az = 0, for z R m Then A t w = 0, where w = Az Now w is in the column space of A and is orthogonal to every column of A This implies that w = 0 Thus N(A) = N(A t A) where N(B) denotes the nullspace of a mrtix B Let n(b) denote the nullity of B By the rank-nullity theorem, rank(a t A) + n(a t A) = m = rank A + n(a) Hence rank(a t A) = rank(a) Thus if the columns of A are linearly independent then the m m matrix A t A has rank m Hence it is invertible If the columns of A are linearly independent, the (unique) solution to the normal equations is (A t A) 1 A t b and the projection of b onto the column space of A is A(A t A) 1 A t b Note that the normal equations always have a solution (why?), although the solution will not be unique in case the columns of A are linearly dependent
12 12 NOTES ON LINEAR ALGEBRA Example 28 Let A = and b = Then A t A = [ ] and A t b = (1, 4) t The unique solution to the normal equations is x = (2, 3) t and b Ax = (2, 2, 2) t (note that this vector is orthogonal to the columns of A) /2 1 Now let B = 1 0 1/2 We have B t B = 1 2 3/2 and B t b = /2 3/2 3/2 3/2 3/2 Note that A and B have the same column spaces (the third column of B is the average of the first two columns) So the projection of b onto the column space of B will be the same as before However the normal equations do not have a unique solution in this case Check that x = (2, 3, 0) t, (3, 2, 2) t are both solutions of the normal equations B t Bx = B t b Gauss Least squares method Suppose we have a large number of data points (x i, y i ), i = 1, 2,, n collected from some experiment Frequently there is reason to believe that these points should lie on a straight line So we want a linear function y(x) = s + tx such that y(x i ) = y i, i = 1,, n Due to uncertainity in data and experimental error, in practice the points will deviate somewhat from a straightline and so it is impossible to find a linear y(x) that passes through all of them So we seek a line that fits the data well, in the sense that the errors are made as small as possible A natural question that arises now is: how do we define the error? Consider the following system of linear equations, in the variables s and t, and known coefficients x i, y i, i = 1,, n: s + x 1 t = y 1, s + x 2 t = y 2, s + x n t = y n Note that typically n would be much greater than 2 If we can find s and t to satisfy all these equations, then we have solved our problem However, for reasons mentioned above, this is not always possible For given values of s and t the error in the ith equation is y i s x i t There are several ways of combining the errors in the individual equations to get a measure of the total error The following are three examples: n (y i s x i t) 2, y i s x i t, max 1 i n y i s x i t i=1 i=1 Both analytically and computationally, a nice theory exists for the first of these choices and this is what we shall study The problem of finding s, t so as to minimize n (y i s x i t) 2 is called a least squares problem i=1
13 Let A = NOTES ON LINEAR ALGEBRA 13 1 x 1 1 x 2 1 x n, b = y 1 y 2 y n, x = The least squares problem is finding an x such that b Ax is minimized, ie, find an x such that Ax is the best approximation to b in the column space of A This is precisely the problem of projecting b onto the column space of A A straight line can be considered as a polynomial of degree 1 We can also try to fit an m th degree polynomial y(x) = s 0 + s 1 x + s 2 x s m x m to the data points (x i, y i ), i = 1,, n, so as to minimize the error (in the least squares sense) In this case s 0, s 1,, s m are the variables and we have A = 1 x 1 x 2 1 x m 1 1 x 2 x 2 2 x m 2 1 x n x 2 n x m n, b = y 1 y 2 y n [ s t ], x = Example 29 Find C, D such that the straight line b = C + Dt best fits the following data in the least squares sense: b = 1 at t = 1, b = 1 at t = 1, b = 3 at t = We want to project b = (1, 1, 3) t onto the column space of A = 1 1 Now A t A = 1 2 [ ] 3 2 and A t b = (5, 6) t The normal equations are 2 6 [ ] [ C D ] = [ 5 6 The solution is C = 9/7, D = 4/7 and the best line is b = t ] s 0 s 1 s m
II. Determinant Functions
Supplemental Materials for EE203001 Students II Determinant Functions Chung-Chin Lu Department of Electrical Engineering National Tsing Hua University May 22, 2003 1 Three Axioms for a Determinant Function
More informationDeterminants. Beifang Chen
Determinants Beifang Chen 1 Motivation Determinant is a function that each square real matrix A is assigned a real number, denoted det A, satisfying certain properties If A is a 3 3 matrix, writing A [u,
More information1. General Vector Spaces
1.1. Vector space axioms. 1. General Vector Spaces Definition 1.1. Let V be a nonempty set of objects on which the operations of addition and scalar multiplication are defined. By addition we mean a rule
More informationMATH 240 Spring, Chapter 1: Linear Equations and Matrices
MATH 240 Spring, 2006 Chapter Summaries for Kolman / Hill, Elementary Linear Algebra, 8th Ed. Sections 1.1 1.6, 2.1 2.2, 3.2 3.8, 4.3 4.5, 5.1 5.3, 5.5, 6.1 6.5, 7.1 7.2, 7.4 DEFINITIONS Chapter 1: Linear
More informationEquality: Two matrices A and B are equal, i.e., A = B if A and B have the same order and the entries of A and B are the same.
Introduction Matrix Operations Matrix: An m n matrix A is an m-by-n array of scalars from a field (for example real numbers) of the form a a a n a a a n A a m a m a mn The order (or size) of A is m n (read
More informationMath Linear Algebra Final Exam Review Sheet
Math 15-1 Linear Algebra Final Exam Review Sheet Vector Operations Vector addition is a component-wise operation. Two vectors v and w may be added together as long as they contain the same number n of
More informationDETERMINANTS. , x 2 = a 11b 2 a 21 b 1
DETERMINANTS 1 Solving linear equations The simplest type of equations are linear The equation (1) ax = b is a linear equation, in the sense that the function f(x) = ax is linear 1 and it is equated to
More informationLinear Systems and Matrices
Department of Mathematics The Chinese University of Hong Kong 1 System of m linear equations in n unknowns (linear system) a 11 x 1 + a 12 x 2 + + a 1n x n = b 1 a 21 x 1 + a 22 x 2 + + a 2n x n = b 2.......
More information1 Determinants. 1.1 Determinant
1 Determinants [SB], Chapter 9, p.188-196. [SB], Chapter 26, p.719-739. Bellow w ll study the central question: which additional conditions must satisfy a quadratic matrix A to be invertible, that is to
More informationMATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 1 x 2. x n 8 (4) 3 4 2
MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS SYSTEMS OF EQUATIONS AND MATRICES Representation of a linear system The general system of m equations in n unknowns can be written a x + a 2 x 2 + + a n x n b a
More informationLemma 8: Suppose the N by N matrix A has the following block upper triangular form:
17 4 Determinants and the Inverse of a Square Matrix In this section, we are going to use our knowledge of determinants and their properties to derive an explicit formula for the inverse of a square matrix
More informationMatrices. In this chapter: matrices, determinants. inverse matrix
Matrices In this chapter: matrices, determinants inverse matrix 1 1.1 Matrices A matrix is a retangular array of numbers. Rows: horizontal lines. A = a 11 a 12 a 13 a 21 a 22 a 23 a 31 a 32 a 33 a 41 a
More informationA Brief Outline of Math 355
A Brief Outline of Math 355 Lecture 1 The geometry of linear equations; elimination with matrices A system of m linear equations with n unknowns can be thought of geometrically as m hyperplanes intersecting
More informationMath 520 Exam 2 Topic Outline Sections 1 3 (Xiao/Dumas/Liaw) Spring 2008
Math 520 Exam 2 Topic Outline Sections 1 3 (Xiao/Dumas/Liaw) Spring 2008 Exam 2 will be held on Tuesday, April 8, 7-8pm in 117 MacMillan What will be covered The exam will cover material from the lectures
More informationChapter 2:Determinants. Section 2.1: Determinants by cofactor expansion
Chapter 2:Determinants Section 2.1: Determinants by cofactor expansion [ ] a b Recall: The 2 2 matrix is invertible if ad bc 0. The c d ([ ]) a b function f = ad bc is called the determinant and it associates
More informationMath 4A Notes. Written by Victoria Kala Last updated June 11, 2017
Math 4A Notes Written by Victoria Kala vtkala@math.ucsb.edu Last updated June 11, 2017 Systems of Linear Equations A linear equation is an equation that can be written in the form a 1 x 1 + a 2 x 2 +...
More informationMath113: Linear Algebra. Beifang Chen
Math3: Linear Algebra Beifang Chen Spring 26 Contents Systems of Linear Equations 3 Systems of Linear Equations 3 Linear Systems 3 2 Geometric Interpretation 3 3 Matrices of Linear Systems 4 4 Elementary
More informationDeterminants Chapter 3 of Lay
Determinants Chapter of Lay Dr. Doreen De Leon Math 152, Fall 201 1 Introduction to Determinants Section.1 of Lay Given a square matrix A = [a ij, the determinant of A is denoted by det A or a 11 a 1j
More informationLINEAR ALGEBRA REVIEW
LINEAR ALGEBRA REVIEW SPENCER BECKER-KAHN Basic Definitions Domain and Codomain. Let f : X Y be any function. This notation means that X is the domain of f and Y is the codomain of f. This means that for
More informationa 11 a 12 a 11 a 12 a 13 a 21 a 22 a 23 . a 31 a 32 a 33 a 12 a 21 a 23 a 31 a = = = = 12
24 8 Matrices Determinant of 2 2 matrix Given a 2 2 matrix [ ] a a A = 2 a 2 a 22 the real number a a 22 a 2 a 2 is determinant and denoted by det(a) = a a 2 a 2 a 22 Example 8 Find determinant of 2 2
More informationMATH Topics in Applied Mathematics Lecture 12: Evaluation of determinants. Cross product.
MATH 311-504 Topics in Applied Mathematics Lecture 12: Evaluation of determinants. Cross product. Determinant is a scalar assigned to each square matrix. Notation. The determinant of a matrix A = (a ij
More informationELEMENTARY LINEAR ALGEBRA WITH APPLICATIONS. 1. Linear Equations and Matrices
ELEMENTARY LINEAR ALGEBRA WITH APPLICATIONS KOLMAN & HILL NOTES BY OTTO MUTZBAUER 11 Systems of Linear Equations 1 Linear Equations and Matrices Numbers in our context are either real numbers or complex
More informationDeterminants - Uniqueness and Properties
Determinants - Uniqueness and Properties 2-2-2008 In order to show that there s only one determinant function on M(n, R), I m going to derive another formula for the determinant It involves permutations
More informationELE/MCE 503 Linear Algebra Facts Fall 2018
ELE/MCE 503 Linear Algebra Facts Fall 2018 Fact N.1 A set of vectors is linearly independent if and only if none of the vectors in the set can be written as a linear combination of the others. Fact N.2
More informationNOTES on LINEAR ALGEBRA 1
School of Economics, Management and Statistics University of Bologna Academic Year 207/8 NOTES on LINEAR ALGEBRA for the students of Stats and Maths This is a modified version of the notes by Prof Laura
More informationLinear Algebra: Lecture notes from Kolman and Hill 9th edition.
Linear Algebra: Lecture notes from Kolman and Hill 9th edition Taylan Şengül March 20, 2019 Please let me know of any mistakes in these notes Contents Week 1 1 11 Systems of Linear Equations 1 12 Matrices
More informationEXERCISE SET 5.1. = (kx + kx + k, ky + ky + k ) = (kx + kx + 1, ky + ky + 1) = ((k + )x + 1, (k + )y + 1)
EXERCISE SET 5. 6. The pair (, 2) is in the set but the pair ( )(, 2) = (, 2) is not because the first component is negative; hence Axiom 6 fails. Axiom 5 also fails. 8. Axioms, 2, 3, 6, 9, and are easily
More informationEE731 Lecture Notes: Matrix Computations for Signal Processing
EE731 Lecture Notes: Matrix Computations for Signal Processing James P. Reilly c Department of Electrical and Computer Engineering McMaster University September 22, 2005 0 Preface This collection of ten
More informationLinear Algebra Primer
Linear Algebra Primer David Doria daviddoria@gmail.com Wednesday 3 rd December, 2008 Contents Why is it called Linear Algebra? 4 2 What is a Matrix? 4 2. Input and Output.....................................
More informationProblem Set (T) If A is an m n matrix, B is an n p matrix and D is a p s matrix, then show
MTH 0: Linear Algebra Department of Mathematics and Statistics Indian Institute of Technology - Kanpur Problem Set Problems marked (T) are for discussions in Tutorial sessions (T) If A is an m n matrix,
More informationANALYTICAL MATHEMATICS FOR APPLICATIONS 2018 LECTURE NOTES 3
ANALYTICAL MATHEMATICS FOR APPLICATIONS 2018 LECTURE NOTES 3 ISSUED 24 FEBRUARY 2018 1 Gaussian elimination Let A be an (m n)-matrix Consider the following row operations on A (1) Swap the positions any
More informationLecture Notes in Linear Algebra
Lecture Notes in Linear Algebra Dr. Abdullah Al-Azemi Mathematics Department Kuwait University February 4, 2017 Contents 1 Linear Equations and Matrices 1 1.2 Matrices............................................
More information(a) If A is a 3 by 4 matrix, what does this tell us about its nullspace? Solution: dim N(A) 1, since rank(a) 3. Ax =
. (5 points) (a) If A is a 3 by 4 matrix, what does this tell us about its nullspace? dim N(A), since rank(a) 3. (b) If we also know that Ax = has no solution, what do we know about the rank of A? C(A)
More information2. Linear algebra. matrices and vectors. linear equations. range and nullspace of matrices. function of vectors, gradient and Hessian
FE661 - Statistical Methods for Financial Engineering 2. Linear algebra Jitkomut Songsiri matrices and vectors linear equations range and nullspace of matrices function of vectors, gradient and Hessian
More informationMath Camp Notes: Linear Algebra I
Math Camp Notes: Linear Algebra I Basic Matrix Operations and Properties Consider two n m matrices: a a m A = a n a nm Then the basic matrix operations are as follows: a + b a m + b m A + B = a n + b n
More informationEvaluating Determinants by Row Reduction
Evaluating Determinants by Row Reduction MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 2015 Objectives Reduce a matrix to row echelon form and evaluate its determinant.
More informationConceptual Questions for Review
Conceptual Questions for Review Chapter 1 1.1 Which vectors are linear combinations of v = (3, 1) and w = (4, 3)? 1.2 Compare the dot product of v = (3, 1) and w = (4, 3) to the product of their lengths.
More information1300 Linear Algebra and Vector Geometry
1300 Linear Algebra and Vector Geometry R. Craigen Office: MH 523 Email: craigenr@umanitoba.ca May-June 2017 Matrix Inversion Algorithm One payoff from this theorem: It gives us a way to invert matrices.
More informationHOMEWORK PROBLEMS FROM STRANG S LINEAR ALGEBRA AND ITS APPLICATIONS (4TH EDITION)
HOMEWORK PROBLEMS FROM STRANG S LINEAR ALGEBRA AND ITS APPLICATIONS (4TH EDITION) PROFESSOR STEVEN MILLER: BROWN UNIVERSITY: SPRING 2007 1. CHAPTER 1: MATRICES AND GAUSSIAN ELIMINATION Page 9, # 3: Describe
More informationChapter 2: Matrices and Linear Systems
Chapter 2: Matrices and Linear Systems Paul Pearson Outline Matrices Linear systems Row operations Inverses Determinants Matrices Definition An m n matrix A = (a ij ) is a rectangular array of real numbers
More informationLinear Algebra Highlights
Linear Algebra Highlights Chapter 1 A linear equation in n variables is of the form a 1 x 1 + a 2 x 2 + + a n x n. We can have m equations in n variables, a system of linear equations, which we want to
More informationMatrix Operations: Determinant
Matrix Operations: Determinant Determinants Determinants are only applicable for square matrices. Determinant of the square matrix A is denoted as: det(a) or A Recall that the absolute value of the determinant
More informationChapter 2. Square matrices
Chapter 2. Square matrices Lecture notes for MA1111 P. Karageorgis pete@maths.tcd.ie 1/18 Invertible matrices Definition 2.1 Invertible matrices An n n matrix A is said to be invertible, if there is a
More informationGraduate Mathematical Economics Lecture 1
Graduate Mathematical Economics Lecture 1 Yu Ren WISE, Xiamen University September 23, 2012 Outline 1 2 Course Outline ematical techniques used in graduate level economics courses Mathematics for Economists
More informationDeterminants: Uniqueness and more
Math 5327 Spring 2018 Determinants: Uniqueness and more Uniqueness The main theorem we are after: Theorem 1 The determinant of and n n matrix A is the unique n-linear, alternating function from F n n to
More informationFundamentals of Linear Algebra. Marcel B. Finan Arkansas Tech University c All Rights Reserved
Fundamentals of Linear Algebra Marcel B. Finan Arkansas Tech University c All Rights Reserved 2 PREFACE Linear algebra has evolved as a branch of mathematics with wide range of applications to the natural
More informationLinear Algebra M1 - FIB. Contents: 5. Matrices, systems of linear equations and determinants 6. Vector space 7. Linear maps 8.
Linear Algebra M1 - FIB Contents: 5 Matrices, systems of linear equations and determinants 6 Vector space 7 Linear maps 8 Diagonalization Anna de Mier Montserrat Maureso Dept Matemàtica Aplicada II Translation:
More informationChapter 4 - MATRIX ALGEBRA. ... a 2j... a 2n. a i1 a i2... a ij... a in
Chapter 4 - MATRIX ALGEBRA 4.1. Matrix Operations A a 11 a 12... a 1j... a 1n a 21. a 22.... a 2j... a 2n. a i1 a i2... a ij... a in... a m1 a m2... a mj... a mn The entry in the ith row and the jth column
More informationSPRING OF 2008 D. DETERMINANTS
18024 SPRING OF 2008 D DETERMINANTS In many applications of linear algebra to calculus and geometry, the concept of a determinant plays an important role This chapter studies the basic properties of determinants
More informationMATH 106 LINEAR ALGEBRA LECTURE NOTES
MATH 6 LINEAR ALGEBRA LECTURE NOTES FALL - These Lecture Notes are not in a final form being still subject of improvement Contents Systems of linear equations and matrices 5 Introduction to systems of
More information1. Select the unique answer (choice) for each problem. Write only the answer.
MATH 5 Practice Problem Set Spring 7. Select the unique answer (choice) for each problem. Write only the answer. () Determine all the values of a for which the system has infinitely many solutions: x +
More information3 Matrix Algebra. 3.1 Operations on matrices
3 Matrix Algebra A matrix is a rectangular array of numbers; it is of size m n if it has m rows and n columns. A 1 n matrix is a row vector; an m 1 matrix is a column vector. For example: 1 5 3 5 3 5 8
More informationMath 18.6, Spring 213 Problem Set #6 April 5, 213 Problem 1 ( 5.2, 4). Identify all the nonzero terms in the big formula for the determinants of the following matrices: 1 1 1 2 A = 1 1 1 1 1 1, B = 3 4
More informationRow Space and Column Space of a Matrix
Row Space and Column Space of a Matrix 1/18 Summary: To a m n matrix A = (a ij ), we can naturally associate subspaces of K n and of K m, called the row space of A and the column space of A, respectively.
More informationNotes on Linear Algebra
1 Notes on Linear Algebra Jean Walrand August 2005 I INTRODUCTION Linear Algebra is the theory of linear transformations Applications abound in estimation control and Markov chains You should be familiar
More informationGlossary of Linear Algebra Terms. Prepared by Vince Zaccone For Campus Learning Assistance Services at UCSB
Glossary of Linear Algebra Terms Basis (for a subspace) A linearly independent set of vectors that spans the space Basic Variable A variable in a linear system that corresponds to a pivot column in the
More informationENGR-1100 Introduction to Engineering Analysis. Lecture 21
ENGR-1100 Introduction to Engineering Analysis Lecture 21 Lecture outline Procedure (algorithm) for finding the inverse of invertible matrix. Investigate the system of linear equation and invertibility
More informationNotes on Determinants and Matrix Inverse
Notes on Determinants and Matrix Inverse University of British Columbia, Vancouver Yue-Xian Li March 17, 2015 1 1 Definition of determinant Determinant is a scalar that measures the magnitude or size of
More informationProperties of the Determinant Function
Properties of the Determinant Function MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 2015 Overview Today s discussion will illuminate some of the properties of the determinant:
More informationLecture Summaries for Linear Algebra M51A
These lecture summaries may also be viewed online by clicking the L icon at the top right of any lecture screen. Lecture Summaries for Linear Algebra M51A refers to the section in the textbook. Lecture
More informationAPPENDIX: MATHEMATICAL INDUCTION AND OTHER FORMS OF PROOF
ELEMENTARY LINEAR ALGEBRA WORKBOOK/FOR USE WITH RON LARSON S TEXTBOOK ELEMENTARY LINEAR ALGEBRA CREATED BY SHANNON MARTIN MYERS APPENDIX: MATHEMATICAL INDUCTION AND OTHER FORMS OF PROOF When you are done
More informationComponents and change of basis
Math 20F Linear Algebra Lecture 16 1 Components and change of basis Slide 1 Review: Isomorphism Review: Components in a basis Unique representation in a basis Change of basis Review: Isomorphism Definition
More informationCSL361 Problem set 4: Basic linear algebra
CSL361 Problem set 4: Basic linear algebra February 21, 2017 [Note:] If the numerical matrix computations turn out to be tedious, you may use the function rref in Matlab. 1 Row-reduced echelon matrices
More informationECON 186 Class Notes: Linear Algebra
ECON 86 Class Notes: Linear Algebra Jijian Fan Jijian Fan ECON 86 / 27 Singularity and Rank As discussed previously, squareness is a necessary condition for a matrix to be nonsingular (have an inverse).
More informationMatrix Algebra. Matrix Algebra. Chapter 8 - S&B
Chapter 8 - S&B Algebraic operations Matrix: The size of a matrix is indicated by the number of its rows and the number of its columns. A matrix with k rows and n columns is called a k n matrix. The number
More informationFormula for the inverse matrix. Cramer s rule. Review: 3 3 determinants can be computed expanding by any row or column
Math 20F Linear Algebra Lecture 18 1 Determinants, n n Review: The 3 3 case Slide 1 Determinants n n (Expansions by rows and columns Relation with Gauss elimination matrices: Properties) Formula for the
More informationMatrix Algebra Determinant, Inverse matrix. Matrices. A. Fabretti. Mathematics 2 A.Y. 2015/2016. A. Fabretti Matrices
Matrices A. Fabretti Mathematics 2 A.Y. 2015/2016 Table of contents Matrix Algebra Determinant Inverse Matrix Introduction A matrix is a rectangular array of numbers. The size of a matrix is indicated
More informationMath 313 Chapter 5 Review
Math 313 Chapter 5 Review Howard Anton, 9th Edition May 2010 Do NOT write on me! Contents 1 5.1 Real Vector Spaces 2 2 5.2 Subspaces 3 3 5.3 Linear Independence 4 4 5.4 Basis and Dimension 5 5 5.5 Row
More informationc c c c c c c c c c a 3x3 matrix C= has a determinant determined by
Linear Algebra Determinants and Eigenvalues Introduction: Many important geometric and algebraic properties of square matrices are associated with a single real number revealed by what s known as the determinant.
More informationChapter SSM: Linear Algebra Section Fails to be invertible; since det = 6 6 = Invertible; since det = = 2.
SSM: Linear Algebra Section 61 61 Chapter 6 1 2 1 Fails to be invertible; since det = 6 6 = 0 3 6 3 5 3 Invertible; since det = 33 35 = 2 7 11 5 Invertible; since det 2 5 7 0 11 7 = 2 11 5 + 0 + 0 0 0
More informationSolution to Homework 1
Solution to Homework Sec 2 (a) Yes It is condition (VS 3) (b) No If x, y are both zero vectors Then by condition (VS 3) x = x + y = y (c) No Let e be the zero vector We have e = 2e (d) No It will be false
More informationREVIEW FOR EXAM II. The exam covers sections , the part of 3.7 on Markov chains, and
REVIEW FOR EXAM II The exam covers sections 3.4 3.6, the part of 3.7 on Markov chains, and 4.1 4.3. 1. The LU factorization: An n n matrix A has an LU factorization if A = LU, where L is lower triangular
More informationLinear Algebra (part 1) : Matrices and Systems of Linear Equations (by Evan Dummit, 2016, v. 2.02)
Linear Algebra (part ) : Matrices and Systems of Linear Equations (by Evan Dummit, 206, v 202) Contents 2 Matrices and Systems of Linear Equations 2 Systems of Linear Equations 2 Elimination, Matrix Formulation
More informationEigenvalues and Eigenvectors. Review: Invertibility. Eigenvalues and Eigenvectors. The Finite Dimensional Case. January 18, 2018
January 18, 2018 Contents 1 2 3 4 Review 1 We looked at general determinant functions proved that they are all multiples of a special one, called det f (A) = f (I n ) det A. Review 1 We looked at general
More informationSolution Set 7, Fall '12
Solution Set 7, 18.06 Fall '12 1. Do Problem 26 from 5.1. (It might take a while but when you see it, it's easy) Solution. Let n 3, and let A be an n n matrix whose i, j entry is i + j. To show that det
More informationChapter 3. Determinants and Eigenvalues
Chapter 3. Determinants and Eigenvalues 3.1. Determinants With each square matrix we can associate a real number called the determinant of the matrix. Determinants have important applications to the theory
More informationMath 240 Calculus III
The Calculus III Summer 2015, Session II Wednesday, July 8, 2015 Agenda 1. of the determinant 2. determinants 3. of determinants What is the determinant? Yesterday: Ax = b has a unique solution when A
More information4. Determinants.
4. Determinants 4.1. Determinants; Cofactor Expansion Determinants of 2 2 and 3 3 Matrices 2 2 determinant 4.1. Determinants; Cofactor Expansion Determinants of 2 2 and 3 3 Matrices 3 3 determinant 4.1.
More informationChapter 7. Linear Algebra: Matrices, Vectors,
Chapter 7. Linear Algebra: Matrices, Vectors, Determinants. Linear Systems Linear algebra includes the theory and application of linear systems of equations, linear transformations, and eigenvalue problems.
More informationMTH Linear Algebra. Study Guide. Dr. Tony Yee Department of Mathematics and Information Technology The Hong Kong Institute of Education
MTH 3 Linear Algebra Study Guide Dr. Tony Yee Department of Mathematics and Information Technology The Hong Kong Institute of Education June 3, ii Contents Table of Contents iii Matrix Algebra. Real Life
More informationENGR-1100 Introduction to Engineering Analysis. Lecture 21. Lecture outline
ENGR-1100 Introduction to Engineering Analysis Lecture 21 Lecture outline Procedure (algorithm) for finding the inverse of invertible matrix. Investigate the system of linear equation and invertibility
More informationLectures on Linear Algebra for IT
Lectures on Linear Algebra for IT by Mgr. Tereza Kovářová, Ph.D. following content of lectures by Ing. Petr Beremlijski, Ph.D. Department of Applied Mathematics, VSB - TU Ostrava Czech Republic 11. Determinants
More informationDeterminants. Samy Tindel. Purdue University. Differential equations and linear algebra - MA 262
Determinants Samy Tindel Purdue University Differential equations and linear algebra - MA 262 Taken from Differential equations and linear algebra by Goode and Annin Samy T. Determinants Differential equations
More informationUndergraduate Mathematical Economics Lecture 1
Undergraduate Mathematical Economics Lecture 1 Yu Ren WISE, Xiamen University September 15, 2014 Outline 1 Courses Description and Requirement 2 Course Outline ematical techniques used in economics courses
More informationMATH 2331 Linear Algebra. Section 2.1 Matrix Operations. Definition: A : m n, B : n p. Example: Compute AB, if possible.
MATH 2331 Linear Algebra Section 2.1 Matrix Operations Definition: A : m n, B : n p ( 1 2 p ) ( 1 2 p ) AB = A b b b = Ab Ab Ab Example: Compute AB, if possible. 1 Row-column rule: i-j-th entry of AB:
More informationIMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET
IMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET This is a (not quite comprehensive) list of definitions and theorems given in Math 1553. Pay particular attention to the ones in red. Study Tip For each
More informationUnit 3: Matrices. Juan Luis Melero and Eduardo Eyras. September 2018
Unit 3: Matrices Juan Luis Melero and Eduardo Eyras September 2018 1 Contents 1 Matrices and operations 4 1.1 Definition of a matrix....................... 4 1.2 Addition and subtraction of matrices..............
More informationMATH 323 Linear Algebra Lecture 12: Basis of a vector space (continued). Rank and nullity of a matrix.
MATH 323 Linear Algebra Lecture 12: Basis of a vector space (continued). Rank and nullity of a matrix. Basis Definition. Let V be a vector space. A linearly independent spanning set for V is called a basis.
More informationAlgorithms to Compute Bases and the Rank of a Matrix
Algorithms to Compute Bases and the Rank of a Matrix Subspaces associated to a matrix Suppose that A is an m n matrix The row space of A is the subspace of R n spanned by the rows of A The column space
More informationChapter 2: Matrix Algebra
Chapter 2: Matrix Algebra (Last Updated: October 12, 2016) These notes are derived primarily from Linear Algebra and its applications by David Lay (4ed). Write A = 1. Matrix operations [a 1 a n. Then entry
More informationSolutions to Final Exam
Solutions to Final Exam. Let A be a 3 5 matrix. Let b be a nonzero 5-vector. Assume that the nullity of A is. (a) What is the rank of A? 3 (b) Are the rows of A linearly independent? (c) Are the columns
More informationLinear Algebra. Matrices Operations. Consider, for example, a system of equations such as x + 2y z + 4w = 0, 3x 4y + 2z 6w = 0, x 3y 2z + w = 0.
Matrices Operations Linear Algebra Consider, for example, a system of equations such as x + 2y z + 4w = 0, 3x 4y + 2z 6w = 0, x 3y 2z + w = 0 The rectangular array 1 2 1 4 3 4 2 6 1 3 2 1 in which the
More information1 Last time: determinants
1 Last time: determinants Let n be a positive integer If A is an n n matrix, then its determinant is the number det A = Π(X, A)( 1) inv(x) X S n where S n is the set of n n permutation matrices Π(X, A)
More informationLinear algebra I Homework #1 due Thursday, Oct Show that the diagonals of a square are orthogonal to one another.
Homework # due Thursday, Oct. 0. Show that the diagonals of a square are orthogonal to one another. Hint: Place the vertices of the square along the axes and then introduce coordinates. 2. Find the equation
More informationFundamentals of Engineering Analysis (650163)
Philadelphia University Faculty of Engineering Communications and Electronics Engineering Fundamentals of Engineering Analysis (6563) Part Dr. Omar R Daoud Matrices: Introduction DEFINITION A matrix is
More information1 Matrices and Systems of Linear Equations
Linear Algebra (part ) : Matrices and Systems of Linear Equations (by Evan Dummit, 207, v 260) Contents Matrices and Systems of Linear Equations Systems of Linear Equations Elimination, Matrix Formulation
More informationMTH 464: Computational Linear Algebra
MTH 464: Computational Linear Algebra Lecture Outlines Exam 2 Material Prof. M. Beauregard Department of Mathematics & Statistics Stephen F. Austin State University March 2, 2018 Linear Algebra (MTH 464)
More informationSUMMARY OF MATH 1600
SUMMARY OF MATH 1600 Note: The following list is intended as a study guide for the final exam. It is a continuation of the study guide for the midterm. It does not claim to be a comprehensive list. You
More informationLinear Algebra Primer
Linear Algebra Primer D.S. Stutts November 8, 995 Introduction This primer was written to provide a brief overview of the main concepts and methods in elementary linear algebra. It was not intended to
More informationMAT 2037 LINEAR ALGEBRA I web:
MAT 237 LINEAR ALGEBRA I 2625 Dokuz Eylül University, Faculty of Science, Department of Mathematics web: Instructor: Engin Mermut http://kisideuedutr/enginmermut/ HOMEWORK 2 MATRIX ALGEBRA Textbook: Linear
More information