Preliminary Linear Algebra 1. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
|
|
- Derick Martin
- 6 years ago
- Views:
Transcription
1 Preliminary Linear Algebra 1 Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
2 Notation for all there exists such that therefore because end of proof (QED) Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
3 Notation A = B A implies B A B A if and only if (iff) B a B a is an element of the set B A B A is a proper subset of B A B A is a subset of B R n Euclidean n-space opyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
4 Matrix Notation A = [a m n ij ] = m n columns. a 11 a 12 a 1n a 21 a 22 a 2n. is a matrix with m rows and n..... a m1 a m2 a mn The entry in the i th row and j th column of A is a ij. opyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
5 Square Matrices and Vectors Matrix m n A is said to be square if m = n. A matrix with one column is called a vector. A matrix with one row is called a row vector. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
6 Notation In these STAT611 notes, bold uppercase letters are typically used to denote matrices, and bold lowercase letters are typically used to denote vectors. opyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
7 Examples 0 or 0 n is a vector of zeros. 1 or 1 n is a vector of ones. I or I n or I n n is the identity matrix. For example, I 3 = = diag(1, 1, 1) Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
8 Special Types of Square Matrices A square matrix n n A is upper triangular if a ij = 0, i > j. A square matrix n n A is lower triangular if a ij = 0, i < j. A square matrix n n A is diagonal if a ij = 0, i j. Write one example for each of these types of matrices. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
9 Examples Upper triangular Lower triangular Diagonal Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
10 Matrix Transpose If m n A = [a ij ], the transpose of A, denoted A, is the matrix n m B = [b ij ], where b ij = a ji, i = 1,..., m; j = 1,..., n. That is, B = A is the matrix whose columns are the rows of A and whose rows are the columns of A. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
11 A Symmetric Matrix A square matrix n n A is symmetric if A = A. opyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
12 Examples Find the transpose of [ ] Provide an example of a symmetric matrix. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
13 Examples [ ] [ ] = The matrix is symmetric. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
14 Matrix Multiplication Suppose and Then A B m n n k A = [a m n ij ] = B = [b n k ij ] = a 1. = [a (1),..., a (n) ] a m b 1. = C = [c ij = m k b n = [b (1),..., b (k) ]. n a il b lj ] = [c ij = a ib (j) ] l=1 a 1 B = [Ab (1),..., Ab (k) ] =. = a mb n a (l) b l. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100 l=1
15 Matrix Multiplication Suppose and [ ] 1 2 A = 3 4 [ ] 5 6 B =. 7 8 Work out AB using AB = n l=1 a(l) b l. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
16 Matrix Multiplication [ ] [ ] = = = [ ] [ ] 1 2 [5 6] + [7 8] 3 4 [ ] [ ] [ ] Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
17 Transpose of a Matrix Product (AB) = B A The transpose of a product is the product of the transposes in reverse order. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
18 Scalar Multiplication of a Matrix If c R, then c times the matrix A is the matrix whose i, j th element is c times the i, j th element of A; i.e., ca 11 ca 12 ca 1n ca 21 ca 22 ca 2n c m n A = c[a ij ] = [ca ij ] = m n m n ca m1 ca m2 ca mn Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
19 Linear Combination If x 1,..., x n R m and c 1,..., c n R, then n c i x i = c 1 x c n x n i=1 is a linear combination (LC) of x 1,..., x n. The coefficients of the LC are c 1,..., c n. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
20 Linear Independence and Linear Dependence A set of vectors x 1,..., x n is linearly independent (LI) if n c i x i = 0 c 1 = = c n = 0. i=1 A set of vectors x 1,..., x n is linearly dependent (LD) if c 1,..., c n not all 0 n c i x i = 0. i=1 Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
21 Prove or disprove: any set of vectors that contains the vector 0 is LD. Prove or disprove: The following set of vectors is LI , 4, Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
22 Suppose x 1 = 0 and x 2,..., x n are any other vectors of the same dimension as x 1. If we take c 1 = 1, c 2 = = c n = 0, then n i=1 c ix i = 0 and c 1, c 2,..., c n are not all zero. Thus, any set of vectors containing 0 is LD. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
23 If we take c 1 = 2, c 2 = 1, c 3 = 1 then c 1 Thus the set of vectors is LD c c 3 6 = One way to arrive at such solution is to search for a solution to the system of the equations: c 1 + 7c 2 + 9c 3 = 0 5c 1 + 4c 2 6c 3 = 0 3c 1 + c 2 + 7c 3 = 0. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
24 Fact V1: The nonzero vectors x 1,..., x n are LD x j is a LC of x 1,..., x j 1 for some j {2,..., n}. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
25 Proof of Fact V1: (= ) Suppose there exist c 1,..., c n such that n i=1 c ix i = 0. Let j = max{i : c i 0}. Since x 1,..., x n are nonzero, j > 1. Then j c i x i = 0 = i=1 = j 1 c i x i = c j x j. i=1 j 1 i=1 c i c j x i = x j. ( =) Suppose x j = j 1 i=1 c ix i, then n i=1 d ix i = 0, where { ci if i < j d i = 1 if i = j 0 if i > j. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
26 Orthogonality The two vectors x, y are orthogonal to each other if their inner product is zero, i.e., x y = y x = n x i y i = 0. i=1 The length of a vector, also known as its Euclidean norm, is x := x x = n xi 2. i=1 Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
27 The vectors x 1,..., x n are mutually orthogonal if x ix j = 0, i j. The vectors x 1,..., x n are mutually orthonormal if x ix j = 0 i j, and x i = 1 i = 1,..., n. opyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
28 Write down a set of mutually orthogonal but not mutually orthonormal vectors. Write down a set of mutually orthonormal vectors. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
29 [ ] [ ] 2 0, are mutually orthogonal but not mutually orthonormal. 0 1 [ ] [ ] 1 0, are mutually orthonormal , are mutually orthonormal. opyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
30 Orthogonal Matrix A square matrix with mutually orthonormal columns is called an orthogonal matrix. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
31 Show that if Q is orthogonal, then Q Q = I. Show that if Q is orthogonal and x is any vector of appropriate dimension, then Qx = x. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
32 Q Q = [q i q j], where Q = [q 1,..., q n ]. By orthogonality of Q, q 1,..., q n are mutually orthonormal. Thus, q iq j = 0 i j and q i = 1 i = 1,..., n. Q Q = I. opyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
33 Qx = (Qx) Qx = x Q Qx = x Ix = x x = x. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
34 An orthogonal matrix Q is sometimes called a rotation matrix because if a vector x is premultiplied by Q, the result (Qx) is the vector x rotated n 1 n n to a new position in R n. opyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
35 Vector Space A vector space S is a set of vectors that is closed under addition (i.e., if x 1 S, x 2 S, then x 1 + x 2 S) and closed under scalar multiplication (i.e., if c R, x S, then cx S). In other words, c 1 x 1 + c 2 x 2 S c 1, c 2 R; x 1, x 2 S. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
36 Is {x R n : x = 1} a vector space? Is {x R n : 1 x = 0} a vector space? Is { n m Ax : x R m } a vector space? opyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
37 Suppose y R n, c R and y = 1, then cy = (cy) cy = c 2 y y = c y = c. Thus y {x R n : x = 1} does not imply that cy {x R n : x = 1}. Therefore, this set is not a vector space. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
38 Let S = {x R n : 1 x = 0}. Suppose c 1, c 2 R and x 1, x 2 S, then 1 (c 1 x 1 + c 2 x 2 ) = c 1 1 x 1 + c 2 1 x 2 = 0. Thus c 1 x 1 + c 2 x 2 S and it follows that S is a vector space. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
39 Let { S = Ax : x R m}. n m Suppose c 1, c 2 R and y 1, y 2 S. y 1, y 2 S = x 1, x 2 R m y 1 = Ax 1 and y 2 = Ax 2. Thus, c 1 y 1 + c 2 y 2 = c 1 Ax 1 + c 2 Ax 2 = A(c 1 x 1 + c 2 x 2 ). c 1 x 1 + c 2 x 2 R m, c 1 y 1 + c 2 y 2 S. It follows that S is a vector space. opyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
40 Generators of a Vector Space A vector space S is said to be generated by a set of vectors x 1,..., x n if x S = x = n c i x i for some c 1,..., c n R. i=1 opyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
41 Span of a Set of Vectors The span of vectors x 1,..., x n is the set of all LC of x 1,..., x n, i.e., { n } span{x 1,..., x n } = c i x i : c 1,..., c n R. span{x 1,..., x n } is the vector space generated by x 1,..., x n. i=1 Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
42 Find a set of vectors that generates the space {x R 3 : 1 x = 0}; i.e., find a set of vectors whose span is S = {x R 3 : 1 x = 0}. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
43 Let x 1 = 1 0, x 2 = 0 1. Note that 1 x 1 = 0 and 1 x 2 = Thus, x 1, x 2 S so that span{x 1, x 2 } S. Now suppose y = y 1 S. y 2 y 3 Then 0 = 1 y = y 1 + y 2 + y 3 = y 3 = y 1 y 2 so that y 1 x 1 + y 2 x 2 = y y 1 y 2 = y 2 = y 1 y 2 = y. y 1 y 2 y 1 y 2 y 3 S span{x 1, x 2 }, and S = span{x 1, x 2 }. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
44 Basis of a Vector Space If a vector space S is generated by LI vectors x 1,..., x n, then x 1,..., x n form a basis for S. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
45 Fact V2: Suppose a 1,..., a n form a basis for a vector space S. If b 1,..., b k are LI vectors in S, then k n. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
46 Proof of Fact V2: Because a 1,..., a n form a basis for S and b 1 S, b 1 = n i=1 c ia i for some c 1,..., c n R. Thus, a 1,..., a n, b 1 are LD by Fact V1. Again, using V1, we have a j a LC of b 1, a 1,..., a j 1 for some j {1, 2,..., n}. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
47 Thus, b 1, a 1,..., a j 1, a j+1,..., a n generate S. It follows that b 1, a 1,..., a j 1, a j+1,..., a n, b 2 is a LD set of vectors by V1. Again by V1, one of the vectors b 1, b 2, a 1,..., a j 1, a j+1,..., a n is a LC of the preceding vectors. It is not b 2 b 1,..., b k are LI. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
48 Thus b 1, b 2 and n 2 of a 1,..., a n generate S. If k > n, we can continue adding b vectors and deleting a vectors to get b 1,..., b n generates S. However, then V1 would imply b 1,..., b n+1 are LD. This contradicts LI of b 1,..., b k k n. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
49 Fact V3: If {a 1,..., a n } and {b 1,..., b k } each provide a basis for a vector space S, then n = k. Proof: By V2, we have k n and n k. k = n. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
50 Dimension of a Vector Space A basis for a vector space is not unique, but the number of vectors in the basis, known as dimension of the vector space, is unique. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
51 Find dim(s), the dimension of vector space S, for S = {x R 3 : 1 x = 0}. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
52 As demonstrated previously, 1 0 span 0, 1 = S Because 0, 1 is a LI set of vectors, 0, forms a basis for S. Thus, dim(s) = 2 (even though dimension of vectors in S is 3). Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
53 Consider the set { 0}. Is this a vector space? If so, what is its n 1 dimension? Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
54 {0} is a vector space because c 1 x 1 + c 2 x 2 = 0 {0} c 1, c 2 R and x 1, x 2 {0}. The set {0} generates the vector space {0}. However, {0} is not a LI set of vectors. dim({0}) = 0. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
55 Fact V4: Suppose a 1,..., a n are LI vectors in a vector space S with dimension n. Then a 1,..., a n form a basis for S. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
56 Proof of Fact V4: It suffices to show that a 1,..., a n generate S. Let a denote an arbitrary vector in S. By V2, a 1,..., a n, a are LD. By V1, a = n i=1 c ia i for some c 1,..., c n R. Thus { n } S = c i x i : c 1,..., c n R, and the result follows. i=1 Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
57 Fact V5: If a 1,..., a k are LI vectors in an n-dimensional vector space S, then there exists a basis for S that contains a 1,..., a k. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
58 Proof of Fact V5: k n by V2. If k = n, the result follows from V4. Suppose k < n. Then, there exist a k+1 S such that a 1,..., a k+1 are LI. Because if not, a 1,..., a k would generate S (by V1), and thus be a basis of dimension k < n, which is impossible by V3. Similarly, we can continue to add vectors to {a 1,..., a k+1 } until we have a 1,..., a n LI vectors. The result follows from V4. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
59 Fact V6: If a 1,..., a k are LI and orthonormal vectors in R n, then there exist a k+1,..., a n such that a 1,..., a n are LI and orthornormal. Proof: HW problem. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
60 Rank of a Matrix It can be shown that the (maximum) number of LI rows of a matrix m n A is the same as the (maximum) number of LI columns of m n A. This number of LI rows or columns is known as the rank of m n A and is denoted rank( m n A) or r( m n A). Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
61 If r( m n A) = m, m n A is said to have full row rank. If r( m n A) = n, m n A is said to have full column rank. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
62 Inverse of a Matrix If r( n n A) = n, there exists a matrix n n B such that n n A n n B = n n I. Such a matrix B is called the inverse of A and is denoted A 1. opyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
63 Prove that r( n n A) = n n n B n n A n n B = n n I. Prove that n n A n n B = n n I = n n B n n A = n n I Thus AA 1 = A 1 A = I. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
64 Proof: (= ): The columns of A form a basis for R n by V4. Thus, there exists a LC of columns of n n A that equals e i for all i = 1,..., n, where e i is the i th column of the identity matrix n n I. Let b i denote the coefficients of the LC of the columns of A that yields e i. Then, with B = [b 1,..., b n ], we have AB = [Ab 1,..., Ab n ] = [e 1,..., e n ] = I. opyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
65 ( =): If n n B n n A n n B = n n I, then the columns of A generate R n x R n, ABx = Ix = x. If the columns of A were LD, then a subset of the columns of A would be LI and also generate R n. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
66 However, such a subset would be a basis for R n and thus must have n elements. Thus, the columns of A must be LI. Hence, r( n n A) = n. A n n n n B = n n I = Columns of n n A are LI = Rows of n n A are LI = Rows of n n A are a basis for R n = n n C n n C n n A = n n I. opyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
67 Thus, AB = I = CAB = CI = IB = C = B = C. AA 1 = A 1 A = I Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
68 Singular / Nonsingular Matrix If r( n n A) = n, n n A is said to be nonsingular. If r( n n A) < n, n n A is said to be singular. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
69 Inverse of a Nonsingular 2 2 Matrix [ ] 1 [ ] a b d b = 1 ad bc if ad bc 0. c d c a [ ] a b is singular if ad bc = 0. c d Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
70 Column Space of a Matrix The column space of a matrix m n A, denoted by C(A), is the vector space generated by the columns of m n A; i.e., C(A) = {Ax : x R n }. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
71 dim(c(a)) = r( m n A) because the largest possible subset of LI columns of A is a basis for C(A). m n Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
72 Let A = Find r(a). Give a basis for C(A). Characterize C(A). Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
73 = Thus, the columns of A are LD and r(a) < 3. c c = c 1 2c 1 + c 2 4c 1 + 2c 2 = 0 = c 1 = c 2 = 0. r(a) = 2. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
74 A basis for C(A) is given by 1 2 4, x C(A) = x = c c for some c 1, c 2 R n. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
75 Note c 1 x = 2c 1 + c 2 : c 1, c 2 R = C(A) 4c 1 + 2c 2 is the set of vectors in R 3 where the first component is arbitrary and the third component is twice the second component, i.e., {x R 3 : 2x 2 = x 3 }. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
76 Result A.1: rank(ab) min{rank(a), rank(b)} Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
77 Proof of Result A.1: Let b 1,..., b n denote the columns of B so that B = [b 1,..., b n ]. Then AB = [Ab 1,..., Ab n ]. This implies that the columns of AB are in C(A). Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
78 dim(c(a)) is rank(a). There does not exist a set of LI vectors in C(A) with more than rank(a) vectors by Fact V2. It follows that rank(ab) rank(a). Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
79 It remains to show that rank(ab) rank(b). Note that rank(ab) is the same as rank((ab) ) = rank(b A ). Our previous argument shows that rank(b A ) rank(b ) = rank(b). Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
80 Provide an example where rank(ab) < min{rank(a), rank(b)}. opyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
81 [ ] [ ] A =, B = Then AB = 0. Therefore, rank(ab) = 0, rank(a) = 1, rank(b) = 1. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
82 Result A.2: (a) If A = BC, then C(A) C(B), (b) If C(A) C(B), then there exist C such that A = BC. opyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
83 Proof of A.2(a): Suppose x C(A) then y x = Ay. Now A = BC = x = BCy. Thus, z x = Bz (namely, z = Cy). x C(B). We have shown x C(A) = x C(B). C(A) C(B). Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
84 Proof of A.2(b): Let a 1,..., a n denote the columns of A. C(A) C(B) = a 1,..., a n C(B). Let c i be such that Bc i = a i i = 1,..., n. Then denote C = [c 1,..., c n ]. It follows that BC = B[c 1,..., c n ] = [Bc 1,..., Bc n ] = [a 1,..., a n ] = A. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
85 Null Space of a Matrix The null space of a matrix A, denoted N (A) is defined as N (A) = {y : Ay = 0}. Note that N (A) is the set of vectors orthogonal to every row of A. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
86 A vector in N (A) can also be seen as a vector of coefficients corresponding to a LC of the columns of A that is 0. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
87 Note that if A has dimension m n, then the vectors in C(A) have dimension m and the vectors in N (A) have dimension n. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
88 Is the null space of a matrix m n A a vector space? Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
89 Yes. Suppose x N (A). Then c R, A(cx) = cax = c0 = 0. Thus x N (A) = cx N (A) c R. Suppose x 1, x 2 N (A). Then A(x 1 + x 2 ) = Ax 1 + Ax 2 = = 0. Thus, x 1, x 2 N (A) = x 1 + x 2 N (A). Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
90 Find the null space of A = Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
91 y 1 + 2y 2 = 0 2y 1 + 4y 2 = 0 Ay = 0 = y 1 2y 2 = 0 3y 1 + 6y 2 = 0 = y 1 = 2y 2 = N (A) = {y R 2 : y 1 = 2y 2 }. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
92 Result A.3: rank( m n A) = n N (A) = {0}. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
93 Proof of Result A.3: Let [a 1,..., a n ] = A. Then y 1 y n Ay = [a 1,..., a n ]. = y 1 a y n a n. r( m n A) = n a 1,..., a n are LI Ay = 0 only if y = 0 N (A) = {0}. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
94 Theorem A.1: If the matrix A is m n with rank r, then dim(n (A)) = n r, or more elegantly, dim(n ( m n A)) + dim(c( m n A)) = n. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
95 Proof of Theorem A.1: Let k = dim(n (A)). Results A.3 covers the case where k = 0. Suppose now that k > 0. Let u 1,..., u k form a basis for N (A). Then Au m n i = 0 i = 1,..., k. By Fact V5, there exist u k+1,..., u n such that u 1,..., u n form a basis for R n. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
96 We will now argue that the n k vectors Au k+1,..., Au n form a basis for C(A). If so, then dim(n (A)) + dim(c(a)) = k + n k = n, i.e., dim(n (A)) = n dim(c(a)) = n r. opyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
97 First note that Au i C(A) i = k + 1,..., n. Now note that c k+1 Au k c n Au n = 0 = A(c k+1 u k c n u n ) = 0 = c k+1 u k c n u n N (A) n = c 1,..., c k R c 1 u c k u k = c j u j j=k+1 = c 1 u c k u k c k+1 u k+1 c n u n = 0 = c 1 = = c n = 0 by LI of u 1,..., u n. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
98 Therefore, Au k+1,..., Au n are LI. Now let U = [u 1,..., u n ]. Because u 1,..., u n are LI and a basis for R n, U 1 UU 1 = I. Let x R n be arbitrary and define z = U 1 x. opyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
99 Then Ax = AUU 1 x = AUz = [Au 1,..., Au k, Au k+1,..., Au n ]z = [0,..., 0, Au k+1,..., Au n ]z = z k+1 Au k z n Au n. Therefore, any vector in C(A) can be written as a LC of Au k+1,..., Au n. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
100 It follows that Au k+1,..., Au n is a basis for C(A). n k = r and k + r = n. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
Preliminaries. Copyright c 2018 Dan Nettleton (Iowa State University) Statistics / 38
Preliminaries Copyright c 2018 Dan Nettleton (Iowa State University) Statistics 510 1 / 38 Notation for Scalars, Vectors, and Matrices Lowercase letters = scalars: x, c, σ. Boldface, lowercase letters
More informationKnowledge Discovery and Data Mining 1 (VO) ( )
Knowledge Discovery and Data Mining 1 (VO) (707.003) Review of Linear Algebra Denis Helic KTI, TU Graz Oct 9, 2014 Denis Helic (KTI, TU Graz) KDDM1 Oct 9, 2014 1 / 74 Big picture: KDDM Probability Theory
More informationMath Bootcamp An p-dimensional vector is p numbers put together. Written as. x 1 x =. x p
Math Bootcamp 2012 1 Review of matrix algebra 1.1 Vectors and rules of operations An p-dimensional vector is p numbers put together. Written as x 1 x =. x p. When p = 1, this represents a point in the
More informationMiscellaneous Results, Solving Equations, and Generalized Inverses. opyright c 2012 Dan Nettleton (Iowa State University) Statistics / 51
Miscellaneous Results, Solving Equations, and Generalized Inverses opyright c 2012 Dan Nettleton (Iowa State University) Statistics 611 1 / 51 Result A.7: Suppose S and T are vector spaces. If S T and
More informationNOTES on LINEAR ALGEBRA 1
School of Economics, Management and Statistics University of Bologna Academic Year 207/8 NOTES on LINEAR ALGEBRA for the students of Stats and Maths This is a modified version of the notes by Prof Laura
More informationLinear Algebra Formulas. Ben Lee
Linear Algebra Formulas Ben Lee January 27, 2016 Definitions and Terms Diagonal: Diagonal of matrix A is a collection of entries A ij where i = j. Diagonal Matrix: A matrix (usually square), where entries
More informationChapter 1. Matrix Algebra
ST4233, Linear Models, Semester 1 2008-2009 Chapter 1. Matrix Algebra 1 Matrix and vector notation Definition 1.1 A matrix is a rectangular or square array of numbers of variables. We use uppercase boldface
More informationReview of Linear Algebra
Review of Linear Algebra Definitions An m n (read "m by n") matrix, is a rectangular array of entries, where m is the number of rows and n the number of columns. 2 Definitions (Con t) A is square if m=
More informationLecture 1 Review: Linear models have the form (in matrix notation) Y = Xβ + ε,
2. REVIEW OF LINEAR ALGEBRA 1 Lecture 1 Review: Linear models have the form (in matrix notation) Y = Xβ + ε, where Y n 1 response vector and X n p is the model matrix (or design matrix ) with one row for
More informationIntroduction to Matrix Algebra
Introduction to Matrix Algebra August 18, 2010 1 Vectors 1.1 Notations A p-dimensional vector is p numbers put together. Written as x 1 x =. x p. When p = 1, this represents a point in the line. When p
More informationIFT 6760A - Lecture 1 Linear Algebra Refresher
IFT 6760A - Lecture 1 Linear Algebra Refresher Scribe(s): Tianyu Li Instructor: Guillaume Rabusseau 1 Summary In the previous lecture we have introduced some applications of linear algebra in machine learning,
More informationb 1 b 2.. b = b m A = [a 1,a 2,...,a n ] where a 1,j a 2,j a j = a m,j Let A R m n and x 1 x 2 x = x n
Lectures -2: Linear Algebra Background Almost all linear and nonlinear problems in scientific computation require the use of linear algebra These lectures review basic concepts in a way that has proven
More informationMATH 2331 Linear Algebra. Section 2.1 Matrix Operations. Definition: A : m n, B : n p. Example: Compute AB, if possible.
MATH 2331 Linear Algebra Section 2.1 Matrix Operations Definition: A : m n, B : n p ( 1 2 p ) ( 1 2 p ) AB = A b b b = Ab Ab Ab Example: Compute AB, if possible. 1 Row-column rule: i-j-th entry of AB:
More informationLinear Algebra Review. Vectors
Linear Algebra Review 9/4/7 Linear Algebra Review By Tim K. Marks UCSD Borrows heavily from: Jana Kosecka http://cs.gmu.edu/~kosecka/cs682.html Virginia de Sa (UCSD) Cogsci 8F Linear Algebra review Vectors
More informationLecture 7. Econ August 18
Lecture 7 Econ 2001 2015 August 18 Lecture 7 Outline First, the theorem of the maximum, an amazing result about continuity in optimization problems. Then, we start linear algebra, mostly looking at familiar
More informationProblem Set (T) If A is an m n matrix, B is an n p matrix and D is a p s matrix, then show
MTH 0: Linear Algebra Department of Mathematics and Statistics Indian Institute of Technology - Kanpur Problem Set Problems marked (T) are for discussions in Tutorial sessions (T) If A is an m n matrix,
More informationEE731 Lecture Notes: Matrix Computations for Signal Processing
EE731 Lecture Notes: Matrix Computations for Signal Processing James P. Reilly c Department of Electrical and Computer Engineering McMaster University September 22, 2005 0 Preface This collection of ten
More informationSTAT200C: Review of Linear Algebra
Stat200C Instructor: Zhaoxia Yu STAT200C: Review of Linear Algebra 1 Review of Linear Algebra 1.1 Vector Spaces, Rank, Trace, and Linear Equations 1.1.1 Rank and Vector Spaces Definition A vector whose
More informationRecall the convention that, for us, all vectors are column vectors.
Some linear algebra Recall the convention that, for us, all vectors are column vectors. 1. Symmetric matrices Let A be a real matrix. Recall that a complex number λ is an eigenvalue of A if there exists
More informationMAT Linear Algebra Collection of sample exams
MAT 342 - Linear Algebra Collection of sample exams A-x. (0 pts Give the precise definition of the row echelon form. 2. ( 0 pts After performing row reductions on the augmented matrix for a certain system
More informationELE/MCE 503 Linear Algebra Facts Fall 2018
ELE/MCE 503 Linear Algebra Facts Fall 2018 Fact N.1 A set of vectors is linearly independent if and only if none of the vectors in the set can be written as a linear combination of the others. Fact N.2
More informationj=1 x j p, if 1 p <, x i ξ : x i < ξ} 0 as p.
LINEAR ALGEBRA Fall 203 The final exam Almost all of the problems solved Exercise Let (V, ) be a normed vector space. Prove x y x y for all x, y V. Everybody knows how to do this! Exercise 2 If V is a
More information2. Linear algebra. matrices and vectors. linear equations. range and nullspace of matrices. function of vectors, gradient and Hessian
FE661 - Statistical Methods for Financial Engineering 2. Linear algebra Jitkomut Songsiri matrices and vectors linear equations range and nullspace of matrices function of vectors, gradient and Hessian
More informationMatrix Algebra: Summary
May, 27 Appendix E Matrix Algebra: Summary ontents E. Vectors and Matrtices.......................... 2 E.. Notation.................................. 2 E..2 Special Types of Vectors.........................
More informationDeterminants. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 25
Determinants opyright c 2012 Dan Nettleton (Iowa State University) Statistics 611 1 / 25 Notation The determinant of a square matrix n n A is denoted det(a) or A. opyright c 2012 Dan Nettleton (Iowa State
More informationMatrix Algebra. Matrix Algebra. Chapter 8 - S&B
Chapter 8 - S&B Algebraic operations Matrix: The size of a matrix is indicated by the number of its rows and the number of its columns. A matrix with k rows and n columns is called a k n matrix. The number
More informationIntroduction to Numerical Linear Algebra II
Introduction to Numerical Linear Algebra II Petros Drineas These slides were prepared by Ilse Ipsen for the 2015 Gene Golub SIAM Summer School on RandNLA 1 / 49 Overview We will cover this material in
More informationChapter 2: Matrix Algebra
Chapter 2: Matrix Algebra (Last Updated: October 12, 2016) These notes are derived primarily from Linear Algebra and its applications by David Lay (4ed). Write A = 1. Matrix operations [a 1 a n. Then entry
More informationMathematical Foundations of Applied Statistics: Matrix Algebra
Mathematical Foundations of Applied Statistics: Matrix Algebra Steffen Unkel Department of Medical Statistics University Medical Center Göttingen, Germany Winter term 2018/19 1/105 Literature Seber, G.
More informationEE/ACM Applications of Convex Optimization in Signal Processing and Communications Lecture 2
EE/ACM 150 - Applications of Convex Optimization in Signal Processing and Communications Lecture 2 Andre Tkacenko Signal Processing Research Group Jet Propulsion Laboratory April 5, 2012 Andre Tkacenko
More informationOrthogonality. 6.1 Orthogonal Vectors and Subspaces. Chapter 6
Chapter 6 Orthogonality 6.1 Orthogonal Vectors and Subspaces Recall that if nonzero vectors x, y R n are linearly independent then the subspace of all vectors αx + βy, α, β R (the space spanned by x and
More information[3] (b) Find a reduced row-echelon matrix row-equivalent to ,1 2 2
MATH Key for sample nal exam, August 998 []. (a) Dene the term \reduced row-echelon matrix". A matrix is reduced row-echelon if the following conditions are satised. every zero row lies below every nonzero
More informationLinear Algebra and Matrix Inversion
Jim Lambers MAT 46/56 Spring Semester 29- Lecture 2 Notes These notes correspond to Section 63 in the text Linear Algebra and Matrix Inversion Vector Spaces and Linear Transformations Matrices are much
More informationConstraints on Solutions to the Normal Equations. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 41
Constraints on Solutions to the Normal Equations Copyright c 2012 Dan Nettleton (Iowa State University) Statistics 611 1 / 41 If rank( n p X) = r < p, there are infinitely many solutions to the NE X Xb
More informationDS-GA 1002 Lecture notes 0 Fall Linear Algebra. These notes provide a review of basic concepts in linear algebra.
DS-GA 1002 Lecture notes 0 Fall 2016 Linear Algebra These notes provide a review of basic concepts in linear algebra. 1 Vector spaces You are no doubt familiar with vectors in R 2 or R 3, i.e. [ ] 1.1
More informationHomework 2 Solutions
Homework 2 Solutions EE 263 Stanford University Summer 2018 July 5, 2018 1. Halfspace. Suppose a, b R n are two given points. Show that the set of points in R n that are closer to a than b is a halfspace,
More informationMath 321: Linear Algebra
Math 32: Linear Algebra T. Kapitula Department of Mathematics and Statistics University of New Mexico September 8, 24 Textbook: Linear Algebra,by J. Hefferon E-mail: kapitula@math.unm.edu Prof. Kapitula,
More informationLinear Algebra. The analysis of many models in the social sciences reduces to the study of systems of equations.
POLI 7 - Mathematical and Statistical Foundations Prof S Saiegh Fall Lecture Notes - Class 4 October 4, Linear Algebra The analysis of many models in the social sciences reduces to the study of systems
More informationMAT 242 CHAPTER 4: SUBSPACES OF R n
MAT 242 CHAPTER 4: SUBSPACES OF R n JOHN QUIGG 1. Subspaces Recall that R n is the set of n 1 matrices, also called vectors, and satisfies the following properties: x + y = y + x x + (y + z) = (x + y)
More informationElementary linear algebra
Chapter 1 Elementary linear algebra 1.1 Vector spaces Vector spaces owe their importance to the fact that so many models arising in the solutions of specific problems turn out to be vector spaces. The
More informationMatrix Algebra: Definitions and Basic Operations
Section 4 Matrix Algebra: Definitions and Basic Operations Definitions Analyzing economic models often involve working with large sets of linear equations. Matrix algebra provides a set of tools for dealing
More information1. General Vector Spaces
1.1. Vector space axioms. 1. General Vector Spaces Definition 1.1. Let V be a nonempty set of objects on which the operations of addition and scalar multiplication are defined. By addition we mean a rule
More informationThis property turns out to be a general property of eigenvectors of a symmetric A that correspond to distinct eigenvalues as we shall see later.
34 To obtain an eigenvector x 2 0 2 for l 2 = 0, define: B 2 A - l 2 I 2 = È 1, 1, 1 Î 1-0 È 1, 0, 0 Î 1 = È 1, 1, 1 Î 1. To transform B 2 into an upper triangular matrix, subtract the first row of B 2
More informationMath Camp II. Basic Linear Algebra. Yiqing Xu. Aug 26, 2014 MIT
Math Camp II Basic Linear Algebra Yiqing Xu MIT Aug 26, 2014 1 Solving Systems of Linear Equations 2 Vectors and Vector Spaces 3 Matrices 4 Least Squares Systems of Linear Equations Definition A linear
More information18.06 Problem Set 3 - Solutions Due Wednesday, 26 September 2007 at 4 pm in
8.6 Problem Set 3 - s Due Wednesday, 26 September 27 at 4 pm in 2-6. Problem : (=2+2+2+2+2) A vector space is by definition a nonempty set V (whose elements are called vectors) together with rules of addition
More informationECS130 Scientific Computing. Lecture 1: Introduction. Monday, January 7, 10:00 10:50 am
ECS130 Scientific Computing Lecture 1: Introduction Monday, January 7, 10:00 10:50 am About Course: ECS130 Scientific Computing Professor: Zhaojun Bai Webpage: http://web.cs.ucdavis.edu/~bai/ecs130/ Today
More informationBasic Concepts in Linear Algebra
Basic Concepts in Linear Algebra Grady B Wright Department of Mathematics Boise State University February 2, 2015 Grady B Wright Linear Algebra Basics February 2, 2015 1 / 39 Numerical Linear Algebra Linear
More informationYORK UNIVERSITY. Faculty of Science Department of Mathematics and Statistics MATH M Test #1. July 11, 2013 Solutions
YORK UNIVERSITY Faculty of Science Department of Mathematics and Statistics MATH 222 3. M Test # July, 23 Solutions. For each statement indicate whether it is always TRUE or sometimes FALSE. Note: For
More informationMATH 240 Spring, Chapter 1: Linear Equations and Matrices
MATH 240 Spring, 2006 Chapter Summaries for Kolman / Hill, Elementary Linear Algebra, 8th Ed. Sections 1.1 1.6, 2.1 2.2, 3.2 3.8, 4.3 4.5, 5.1 5.3, 5.5, 6.1 6.5, 7.1 7.2, 7.4 DEFINITIONS Chapter 1: Linear
More informationLinear Algebra Massoud Malek
CSUEB Linear Algebra Massoud Malek Inner Product and Normed Space In all that follows, the n n identity matrix is denoted by I n, the n n zero matrix by Z n, and the zero vector by θ n An inner product
More informationLecture: Linear algebra. 4. Solutions of linear equation systems The fundamental theorem of linear algebra
Lecture: Linear algebra. 1. Subspaces. 2. Orthogonal complement. 3. The four fundamental subspaces 4. Solutions of linear equation systems The fundamental theorem of linear algebra 5. Determining the fundamental
More informationReview of Basic Concepts in Linear Algebra
Review of Basic Concepts in Linear Algebra Grady B Wright Department of Mathematics Boise State University September 7, 2017 Math 565 Linear Algebra Review September 7, 2017 1 / 40 Numerical Linear Algebra
More informationEstimation of the Response Mean. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 27
Estimation of the Response Mean Copyright c 202 Dan Nettleton (Iowa State University) Statistics 5 / 27 The Gauss-Markov Linear Model y = Xβ + ɛ y is an n random vector of responses. X is an n p matrix
More information1. What is the determinant of the following matrix? a 1 a 2 4a 3 2a 2 b 1 b 2 4b 3 2b c 1. = 4, then det
What is the determinant of the following matrix? 3 4 3 4 3 4 4 3 A 0 B 8 C 55 D 0 E 60 If det a a a 3 b b b 3 c c c 3 = 4, then det a a 4a 3 a b b 4b 3 b c c c 3 c = A 8 B 6 C 4 D E 3 Let A be an n n matrix
More informationSECTION 3.3. PROBLEM 22. The null space of a matrix A is: N(A) = {X : AX = 0}. Here are the calculations of AX for X = a,b,c,d, and e. =
SECTION 3.3. PROBLEM. The null space of a matrix A is: N(A) {X : AX }. Here are the calculations of AX for X a,b,c,d, and e. Aa [ ][ ] 3 3 [ ][ ] Ac 3 3 [ ] 3 3 [ ] 4+4 6+6 Ae [ ], Ab [ ][ ] 3 3 3 [ ]
More informationMatrix & Linear Algebra
Matrix & Linear Algebra Jamie Monogan University of Georgia For more information: http://monogan.myweb.uga.edu/teaching/mm/ Jamie Monogan (UGA) Matrix & Linear Algebra 1 / 84 Vectors Vectors Vector: A
More informationMA 511, Session 10. The Four Fundamental Subspaces of a Matrix
MA 5, Session The Four Fundamental Subspaces of a Matrix Let A be a m n matrix. (i) The row space C(A T )ofais the subspace of R n spanned by the rows of A. (ii) The null space N (A) ofa is the subspace
More informationMATRIX ALGEBRA. or x = (x 1,..., x n ) R n. y 1 y 2. x 2. x m. y m. y = cos θ 1 = x 1 L x. sin θ 1 = x 2. cos θ 2 = y 1 L y.
as Basics Vectors MATRIX ALGEBRA An array of n real numbers x, x,, x n is called a vector and it is written x = x x n or x = x,, x n R n prime operation=transposing a column to a row Basic vector operations
More informationApplied Matrix Algebra Lecture Notes Section 2.2. Gerald Höhn Department of Mathematics, Kansas State University
Applied Matrix Algebra Lecture Notes Section 22 Gerald Höhn Department of Mathematics, Kansas State University September, 216 Chapter 2 Matrices 22 Inverses Let (S) a 11 x 1 + a 12 x 2 + +a 1n x n = b
More informationLinear Algebra (Review) Volker Tresp 2018
Linear Algebra (Review) Volker Tresp 2018 1 Vectors k, M, N are scalars A one-dimensional array c is a column vector. Thus in two dimensions, ( ) c1 c = c 2 c i is the i-th component of c c T = (c 1, c
More informationlinearly indepedent eigenvectors as the multiplicity of the root, but in general there may be no more than one. For further discussion, assume matrice
3. Eigenvalues and Eigenvectors, Spectral Representation 3.. Eigenvalues and Eigenvectors A vector ' is eigenvector of a matrix K, if K' is parallel to ' and ' 6, i.e., K' k' k is the eigenvalue. If is
More informationThe University of Texas at Austin Department of Electrical and Computer Engineering. EE381V: Large Scale Learning Spring 2013.
The University of Texas at Austin Department of Electrical and Computer Engineering EE381V: Large Scale Learning Spring 2013 Assignment Two Caramanis/Sanghavi Due: Tuesday, Feb. 19, 2013. Computational
More informationSection 3.3. Matrix Rank and the Inverse of a Full Rank Matrix
3.3. Matrix Rank and the Inverse of a Full Rank Matrix 1 Section 3.3. Matrix Rank and the Inverse of a Full Rank Matrix Note. The lengthy section (21 pages in the text) gives a thorough study of the rank
More informationQuick Tour of Linear Algebra and Graph Theory
Quick Tour of Linear Algebra and Graph Theory CS224W: Social and Information Network Analysis Fall 2014 David Hallac Based on Peter Lofgren, Yu Wayne Wu, and Borja Pelato s previous versions Matrices and
More informationQuick Tour of Linear Algebra and Graph Theory
Quick Tour of Linear Algebra and Graph Theory CS224w: Social and Information Network Analysis Fall 2012 Yu Wayne Wu Based on Borja Pelato s version in Fall 2011 Matrices and Vectors Matrix: A rectangular
More informationLinear Algebra V = T = ( 4 3 ).
Linear Algebra Vectors A column vector is a list of numbers stored vertically The dimension of a column vector is the number of values in the vector W is a -dimensional column vector and V is a 5-dimensional
More informationJim Lambers MAT 610 Summer Session Lecture 1 Notes
Jim Lambers MAT 60 Summer Session 2009-0 Lecture Notes Introduction This course is about numerical linear algebra, which is the study of the approximate solution of fundamental problems from linear algebra
More informationMath Camp Lecture 4: Linear Algebra. Xiao Yu Wang. Aug 2010 MIT. Xiao Yu Wang (MIT) Math Camp /10 1 / 88
Math Camp 2010 Lecture 4: Linear Algebra Xiao Yu Wang MIT Aug 2010 Xiao Yu Wang (MIT) Math Camp 2010 08/10 1 / 88 Linear Algebra Game Plan Vector Spaces Linear Transformations and Matrices Determinant
More informationLecture Notes in Linear Algebra
Lecture Notes in Linear Algebra Dr. Abdullah Al-Azemi Mathematics Department Kuwait University February 4, 2017 Contents 1 Linear Equations and Matrices 1 1.2 Matrices............................................
More informationSpring 2014 Math 272 Final Exam Review Sheet
Spring 2014 Math 272 Final Exam Review Sheet You will not be allowed use of a calculator or any other device other than your pencil or pen and some scratch paper. Notes are also not allowed. In kindness
More informationMath 1553 Introduction to Linear Algebra
Math 1553 Introduction to Linear Algebra Lecture Notes Chapter 2 Matrix Algebra School of Mathematics The Georgia Institute of Technology Math 1553 Lecture Notes for Chapter 2 Introduction, Slide 1 Section
More informationSTAT 8260 Theory of Linear Models Lecture Notes
STAT 8260 Theory of Linear Models Lecture Notes Classical linear models are at the core of the field of statistics, and are probably the most commonly used set of statistical techniques in practice. For
More informationMATH 369 Linear Algebra
Assignment # Problem # A father and his two sons are together 00 years old. The father is twice as old as his older son and 30 years older than his younger son. How old is each person? Problem # 2 Determine
More information10-701/ Recitation : Linear Algebra Review (based on notes written by Jing Xiang)
10-701/15-781 Recitation : Linear Algebra Review (based on notes written by Jing Xiang) Manojit Nandi February 1, 2014 Outline Linear Algebra General Properties Matrix Operations Inner Products and Orthogonal
More informationChap 3. Linear Algebra
Chap 3. Linear Algebra Outlines 1. Introduction 2. Basis, Representation, and Orthonormalization 3. Linear Algebraic Equations 4. Similarity Transformation 5. Diagonal Form and Jordan Form 6. Functions
More informationMatrix Arithmetic. j=1
An m n matrix is an array A = Matrix Arithmetic a 11 a 12 a 1n a 21 a 22 a 2n a m1 a m2 a mn of real numbers a ij An m n matrix has m rows and n columns a ij is the entry in the i-th row and j-th column
More informationChapter 4 Euclid Space
Chapter 4 Euclid Space Inner Product Spaces Definition.. Let V be a real vector space over IR. A real inner product on V is a real valued function on V V, denoted by (, ), which satisfies () (x, y) = (y,
More informationPOLI270 - Linear Algebra
POLI7 - Linear Algebra Septemer 8th Basics a x + a x +... + a n x n b () is the linear form where a, b are parameters and x n are variables. For a given equation such as x +x you only need a variable and
More informationI. Multiple Choice Questions (Answer any eight)
Name of the student : Roll No : CS65: Linear Algebra and Random Processes Exam - Course Instructor : Prashanth L.A. Date : Sep-24, 27 Duration : 5 minutes INSTRUCTIONS: The test will be evaluated ONLY
More information文件中找不不到关系 ID 为 rid3 的图像部件. Review of LINEAR ALGEBRA I. TA: Yujia Xie CSE 6740 Computational Data Analysis. Georgia Institute of Technology
文件中找不不到关系 ID 为 rid3 的图像部件 Review of LINEAR ALGEBRA I TA: Yujia Xie CSE 6740 Computational Data Analysis Georgia Institute of Technology 1. Notations A R $ & : a matrix with m rows and n columns, where
More informationChapter 1 Vector Spaces
Chapter 1 Vector Spaces Per-Olof Persson persson@berkeley.edu Department of Mathematics University of California, Berkeley Math 110 Linear Algebra Vector Spaces Definition A vector space V over a field
More informationMATH 20F: LINEAR ALGEBRA LECTURE B00 (T. KEMP)
MATH 20F: LINEAR ALGEBRA LECTURE B00 (T KEMP) Definition 01 If T (x) = Ax is a linear transformation from R n to R m then Nul (T ) = {x R n : T (x) = 0} = Nul (A) Ran (T ) = {Ax R m : x R n } = {b R m
More informationA Review of Linear Algebra
A Review of Linear Algebra Gerald Recktenwald Portland State University Mechanical Engineering Department gerry@me.pdx.edu These slides are a supplement to the book Numerical Methods with Matlab: Implementations
More informationNotes on Linear Algebra
1 Notes on Linear Algebra Jean Walrand August 2005 I INTRODUCTION Linear Algebra is the theory of linear transformations Applications abound in estimation control and Markov chains You should be familiar
More informationChapter 7. Linear Algebra: Matrices, Vectors,
Chapter 7. Linear Algebra: Matrices, Vectors, Determinants. Linear Systems Linear algebra includes the theory and application of linear systems of equations, linear transformations, and eigenvalue problems.
More informationFall Inverse of a matrix. Institute: UC San Diego. Authors: Alexander Knop
Fall 2017 Inverse of a matrix Authors: Alexander Knop Institute: UC San Diego Row-Column Rule If the product AB is defined, then the entry in row i and column j of AB is the sum of the products of corresponding
More informationMATH 260 LINEAR ALGEBRA EXAM III Fall 2014
MAH 60 LINEAR ALGEBRA EXAM III Fall 0 Instructions: the use of built-in functions of your calculator such as det( ) or RREF is permitted ) Consider the table and the vectors and matrices given below Fill
More informationMassachusetts Institute of Technology Department of Economics Statistics. Lecture Notes on Matrix Algebra
Massachusetts Institute of Technology Department of Economics 14.381 Statistics Guido Kuersteiner Lecture Notes on Matrix Algebra These lecture notes summarize some basic results on matrix algebra used
More informationFundamentals of Engineering Analysis (650163)
Philadelphia University Faculty of Engineering Communications and Electronics Engineering Fundamentals of Engineering Analysis (6563) Part Dr. Omar R Daoud Matrices: Introduction DEFINITION A matrix is
More informationAPPENDIX A. Matrix Algebra. a n1 a n2 g a nk
APPENDIX A Matrix Algebra A.1 TERMINOLOGY A matrix is a rectangular array of numbers, denoted a 11 a 12 g a 1K a A = [a ik ] = [A] ik = D 21 a 22 g a 2K T. g a n1 a n2 g a nk (A-1) The typical element
More information2.2. Show that U 0 is a vector space. For each α 0 in F, show by example that U α does not satisfy closure.
Hints for Exercises 1.3. This diagram says that f α = β g. I will prove f injective g injective. You should show g injective f injective. Assume f is injective. Now suppose g(x) = g(y) for some x, y A.
More informationIntroduction to Matrices
POLS 704 Introduction to Matrices Introduction to Matrices. The Cast of Characters A matrix is a rectangular array (i.e., a table) of numbers. For example, 2 3 X 4 5 6 (4 3) 7 8 9 0 0 0 Thismatrix,with4rowsand3columns,isoforder
More informationChapter 3 Transformations
Chapter 3 Transformations An Introduction to Optimization Spring, 2014 Wei-Ta Chu 1 Linear Transformations A function is called a linear transformation if 1. for every and 2. for every If we fix the bases
More informationLinear Algebra (Review) Volker Tresp 2017
Linear Algebra (Review) Volker Tresp 2017 1 Vectors k is a scalar (a number) c is a column vector. Thus in two dimensions, c = ( c1 c 2 ) (Advanced: More precisely, a vector is defined in a vector space.
More informationMath 102 Final Exam - Dec 14 - PCYNH pm Fall Name Student No. Section A0
Math 12 Final Exam - Dec 14 - PCYNH 122-6pm Fall 212 Name Student No. Section A No aids allowed. Answer all questions on test paper. Total Marks: 4 8 questions (plus a 9th bonus question), 5 points per
More information1 Linear Algebra Problems
Linear Algebra Problems. Let A be the conjugate transpose of the complex matrix A; i.e., A = A t : A is said to be Hermitian if A = A; real symmetric if A is real and A t = A; skew-hermitian if A = A and
More informationA FIRST COURSE IN LINEAR ALGEBRA. An Open Text by Ken Kuttler. Matrix Arithmetic
A FIRST COURSE IN LINEAR ALGEBRA An Open Text by Ken Kuttler Matrix Arithmetic Lecture Notes by Karen Seyffarth Adapted by LYRYX SERVICE COURSE SOLUTION Attribution-NonCommercial-ShareAlike (CC BY-NC-SA)
More informationLinear Systems and Matrices
Department of Mathematics The Chinese University of Hong Kong 1 System of m linear equations in n unknowns (linear system) a 11 x 1 + a 12 x 2 + + a 1n x n = b 1 a 21 x 1 + a 22 x 2 + + a 2n x n = b 2.......
More informationGeneral Linear Test of a General Linear Hypothesis. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 35
General Linear Test of a General Linear Hypothesis Copyright c 2012 Dan Nettleton (Iowa State University) Statistics 611 1 / 35 Suppose the NTGMM holds so that y = Xβ + ε, where ε N(0, σ 2 I). opyright
More informationDetermining Unitary Equivalence to a 3 3 Complex Symmetric Matrix from the Upper Triangular Form. Jay Daigle Advised by Stephan Garcia
Determining Unitary Equivalence to a 3 3 Complex Symmetric Matrix from the Upper Triangular Form Jay Daigle Advised by Stephan Garcia April 4, 2008 2 Contents Introduction 5 2 Technical Background 9 3
More information