ENGINEERING MATH 1 Fall 2009 VECTOR SPACES
|
|
- Stewart Brown
- 5 years ago
- Views:
Transcription
1 ENGINEERING MATH 1 Fall 2009 VECTOR SPACES A vector space, more specifically, a real vector space (as opposed to a complex one or some even stranger ones) is any set that is closed under an operation of addition and under multiplication by real numbers. To be a bit more precise, if a set V is to be a vector space, then 1. One has to be able to add any two elements of V to get another element of V. Specifically, an operation + has to be defined so that if x, y V, one can form x + y and x + y V. This operation should have the usual properties, namely it has to be associative and commutative, there should be a zero element (denoted by 0) that has no effect when added to another element (If x V, then x+0 = x) and one should also be able to subtract in V ; that is, if x V then x has an additive inverse x which when added to x results in 0. Subtraction is then defined by x y = x + ( y). 2. If x V and c is a real number, it should make sense to multiply x by c to get cx V. The usual properties should hold, specifically, c(x + y) = cx + cy if c R, x, y V. (c + d)x = cx + dx if c, d R, x V. c(dx) = (cd)x = d(cx) if c, d R, x V. 1x = x if x V. The last property may seem a bit strange, but one possibly could define some weird product in which 1 times x is not x, and one wants to be sure nobody goes around saying he or she has a vector space in that case. The elements of V are then called vectors, the real numbers are then called scalars. For us the main examples are: 1. For every pair of positive integers m, n, the set of m n matrices, with the usual operations, is a vector space. Of particular interest are the cases m = 1; we then have column matrices or vectors. This space can be identified with R n, n-tuples of real numbers. n = 1; we then have row matrices or vectors. identified with R m, m-tuples of real numbers. R n for every positive integer n. This space can be The 0 element of this space is the 0 matrix. Actually, the most important case is the set R n of all n-tuples of real numbers, with the usual operations. The 0 element is the vector with all components equal to If I is an interval in R; that is, I is one of the following sets I = (a, b) for some a, b, a < b (a = or b = being allowed), or I = [a, b) for some a, b, < a < b (b = being allowed), or I = (a, b] for some a, b, a < b < (a = a possibility), or I = [a, b] for some a, b, < a < b <, then the set V of all real valued functions on I is a vector space. If f(x), g(x) are defined for x I, if c R, we define (f + g)(x), (cf)(x) in the usual and obvious way: (f + g)(x) = f(x) + g(x), (cf)(x) = cf(x), (x I). The 0 element of this vector space is the identically 0 function; the function f defined by f(x) = 0 for all x I.
2 2 Linear Combinations. In every vector space one can combine vectors with scalars to get linear combinations. The precise definition is: Suppose v 1, v 2,..., v n are vectors. A linear combination of these vectors is any vector of the form v = c 1 v 1 + c 2 v c n v n, where c 1, c 2,..., c n are scalars. The scalars c 1,..., c n are the coefficients of the linear combination. Examples. 1. In R consider the vectors v 1 = (1, 1, 0), v 2 = (2,, 0) and v = (0, 5, 0). Here are a few linear combinations of these vectors: 2v 1 7v 2 + 4v = (2, 2, 0) + ( 14, 21, 0) + (0, 20, 0) = ( 12, 1, 0), v 1 + 2v 2 v = (,, 0) + (4, 6, 0) + (0, 5, 0) = (7, 4, 0), v 1 + v 2 + 0v = ( 1, 1, 0) + (2,, 0) = (1, 2, 0), (if in a combination a vector appears with coefficient 0, we just omit it, for example write v 1 + v 2 instead of v 1 + v 2 + 0v ), 2v 2 = 0v 1 + 2v 2 + 0v = (4, 6, 0), 10v 1 + 5v 2 = ( 10, 10, 0) + (10, 15, 0) = (0, 5, 0) = v, v 2 = 0v v 2 + 0v. We can notice a few facts of general interest. The last computation shows v 2 is itself a linear combination of v 1, v 2, v. This is of course generally true; every vector of a set of vectors is a linear combination of this set; just take all coefficients equal to 0, except the one corresponding to the vector in question, which you take equal to 1. More interestingly, the fifth example shows that v is a linear combination of the other vectors of the bunch; that is a combination of v 1 and v 2. This means we don t need it for the purpose of forming linear combinations; in every linear combination we can just replace v 5 by 10v 1 + 5v 2, collect terms, to get a linear combination of v 1, v 2 alone. For example, in the first computation we get ( 12, 1, 0) as a linear combination of just v 1, v 2 by ( 12, 1, 0) = 2v 1 7v 2 + 4v = 2v 1 7v 2 + 4( 10v 1 + 5v 2 ) = 2v 1 7v 2 40v v 2 = 8v 1 + 1v 2. Here is an important definition: A set v 1,..., v n of vectors is linearly independent if no vector from the set is a linear combination of the other vectors from the set. We just saw that v 1, v 2, v as given was not linearly independent. Is the set consisting of v 1, v 2 linearly independent? This is the same as asking is one of v 1, v 2 a linear combination of the other one, meaning is v 1 = cv 2 for some constant, or is v 2 = cv 1 for some constant c. It is easy to see that the answer is NO. If v 1 = cv 2, then c must satisfy (1, 1, 0) = (2c, c, 0), thus 2c = 1 and c = 1, only possible if 2 =, and there is good evidence to conclude that 2. Similarly one sees that v 2 = cv 1 is impossible. Usually, when one vector of a bunch is a linear combination of others in the bunch, there are other vectors in the bunch with the same property. For example, in our case, we can ask ourselves whether v 2 is a linear combination of v 1, v. This is the same as asking whether there are scalars a, b such that v 2 = av 1 + bv or (2,, 0) = (a, a, 0) + (0, 5b, 0) = (a, a + 5b, 0). This leads to the system of equations a = 2, a+5b =, with the immediate solution a = 2, b = 1/5. Thus v 2 = 2v v. We can then write the vector of the first computation above without using v 2 : ( 12, 1, 0) = 2v 1 7v 2 + 4v = 2v 1 7(2v v ) + 4v = 12v v.
3 Exercise. Show that v 1 is a linear combination of v 2, v and write ( 12, 1, 0) as a linear combination of v 2, v. We ll do one more thing with these vectors, describe the set of all their linear combinations. We don t need all three; since v depends on v 1, v 2, it suffices to describe all the linear combinations of v 1, v 2. This will consist of all vectors (a, b, c) such that one can find coefficients c 1, c 2 such that c 1 v 1 + c 2 v 2 = (a, b, c). If we equate components, we are asking for all vectors (a, b, c) such that c 1 + 2c 2 = a c 1 + c 2 = b 0c 1 + 0c 2 = c. Obviously, c = 0. The other two equations are however easy to solve without any problem. By Gauss, Gauss Jordan, or otherwise, c 1 = a 2b, c 2 = b a. In other words, no matter what a, b are, every vector of the form (a, b, 0) is a linear combination of v 1, v 2, hence also of v 1, v 2, v. For later reference we remark that the set of vectors that are combinations of v 1, v 2, v form a set closed under addition and scalar multiplication containing the 0 vector of the space. 2. Here is a similar example in R 4. Consider the vectors v 1 = (1, 2, 1, ), v 2 = (1, 0, 2, 4) and v = (1, 1, 1, 1). We want to answer two questions: (a) Are they linearly independent? (b) What is the set of all linear combinations of these vectors; i.e., when is a vector (a, b, c, d) of R 4 a linear combination of these vectors? It would be very tedious to answer the first one by checking first whether v 1 depends on v 2, v, then if v 2 depends on v 1, v, finally if v depends on v 1, v 2. There is a better way to check for independence of vectors v 1,..., v n in a vector space. One considers the equation (1) c 1 v c n v n = 0 (The 0 element of the space). If one can show there is a solution with at least one c i 0, then one has one s answer. For example, just as an example, suppose that there is a solution of (1) with c 2 0. Then we can solve for v 2 = (c 1 /c 2 )v 1 (c /c 2 )v + + ( c n /c 2 )v n, and the system is not linearly independent. But if no such solution exists, then the system is linearly independent. Let us try it with our vectors. The vector equation c 1 v 1 + c 2 v 2 + c v = 0 results in a system of 4 linear equations in the unknowns c 1, c 2, c : c 1 + c 2 + c = 0 2c 1 + c = 0 c 1 + 2c 2 c = 0 c 1 + 4c 2 c = 0. To solve it we row reduce the augmented matrix of the system The canonical row reduced form is
4 4 showing that the only solution is c 1 = 0, c 2 = 0, c = 0. The system is linearly independent. Exercise. Verify that the stated row reduced form is the right one. To answer the second question, we need to determine all vectors (a, b, c, d) for which the system c 1 + c 2 + c = a 2c 1 + c = b c 1 + 2c 2 c = c c 1 + 4c 2 c = d. has a solution. The augmented matrix is now a b c 4 1 d and the exact same row operations as before take it to the canonical form: 2a + b + c a + c a b 2c a 4b c + d The conclusion is that a vector v = (a, b, c, d) is a linear combination of the given three vectors v 1, v 2, v if and only if 2a 4b c + d = 0; that is, d = 2a + 4b + c, in which case v = c 1 v 1 + c 2 + c v if c 1 = 2a + b + c, c 2 = a + c, c = 4a b 2c. For example, consider the vector (4,, 2, 14). Here a = 4, b =, c = 2, d = 14. We see that the equation 2a + 4b + c = d holds, so this vector is a linear combination of the given v 1, v 2, v. Taking c 1 = 2a + b + c we verify that indeed = 5, c 2 = a + c = 2, c = 4a b 2c (4,, 2, 14) = 5(1, 2, 1, ) + 2(1, 0, 2, 4) + 7(1, 1, 1, 1). Here is something we learned while going through this example: = 7, A set v 1,..., v n of vectors is linearly independent if and only if the equation c c n = 0 (the 0 here being the 0 element of the vector space), has the only solution c 1 = c 2 = = c n = 0. (This is frequently given as a definition in most textbooks).. Let V be the set of all functions defined on (, ). We consider the functions as vectors, the 0 vector being the identically zero function. Consider f, f 2, f, f 4 where f 1 (x) = x, f 2 (x) = sin x, f (x) = cos x, f 4 (x) = sin(x + π 6 ).
5 5 Are these functions linearly independent? If we remember well our trigonometry it is easy to see that the answer is no, because sin(x + π 6 ) = sin x cos π 6 + cos x sin π 6 = 2 sin x + 1 cos x; 2 that is, f 4 = ( /2)f 2 + (1/2)f. What if we remove f 4 ; are f 1, f 2, f linearly independent? We may later on see an easier way of deciding this, for now we do a brute force attack. We suppose that c 1 f + c 2 f 2 + c f = 0 and try to either solve this equation for some triple c 1, c 2, c not all zero, or show that the only solution is c 1 = c 2 = c = 0. Because the 0 element is the identically zero function, the equation c 1 f + c 2 f 2 +c f = 0 is equivalent to c 1 x + c 2 sin x + c cosx = 0 for all values of x. Let s give values to x, see what happens. For example if x = 0 we should have c c 2 sin 0 + c cos0 = 0; in other words, c = 0. With c = 0, we look for c 1, c 2 so that c 1 x + c 2 sin x = 0 for all x. Take x = π and we get c 1 π = 0, thus c 1 = 0. Finally if c 2 sin x = 0 for all x, we must have c 2 = 0. The answer to the last question is yes, f 1, f 2, f are linearly independent. Subspaces. If V is a vector space, a subspace is any subset that contains the 0 element and is closed under addition and scalar multiplication. A subspace of a vector space is a vector space in its own right, with the operations of V. Examples. In each case, verify it is, or isn t, a subspace of the indicated vector space. 1. V = R and W the set of all vectors of the form (a, b, 0) (triples of real numbers with third component 0). W is a subspace of V. Why? Because (a) The 0 vector of V is (0, 0, 0), of the form (a, b, 0) with a = b = 0. (b) If v, w are vectors in W, then (say) v = (a, b, 0), w = (c, d, 0), so that v + w = (a + c, b + d, 0) is again a vector with third component 0, hence in W. (c) If v = (a, b, 0) is in W and c is a scalar, then cv = (ac, bc, 0) W. 2. Let V = R 2 and consider the set W consisting of all vectors (a, b) with a = b. It is a subspace.. Let V = R 2 and consider the set W consisting of all vectors (a, b) with a 2 = b 2. It is NOT a subspace. Why? Because, for example, the vectors (1, 1) and (1, 1) are in W, but (1, 1) + (1, 1) = (2, 0) is not in W. 4. Here is what could be our main example: Let V be any vector space and let v 1,..., v n be vectors in V. The set W of ALL linear combinations of the vectors v 1,..., v n is a subspace of V. In fact, (a) 0 = 0v v n, so 0 is a linear combination of the vectors and hence in W. (Note: In the equation 0 = 0v 1 + 0v n, the zero on the leftt hand side is the zero element of the vector space; the zeros on the right hand side are the real number 0. One usually knows, or should know, from the context which is which.) (b) Suppose v, w are in W. Then we can write v = c 1 v c n v n, w = d 1 v 1 + +d n v n for scalars (real numbers) c 1,..., c n, d 1,..., d n. Then v + w = (c 1 + d 1 )v (c n + d n )v n also is a linear combination of v 1,..., v n, hence in W. (c) Suppose v is in W and c is a scalar. We can write v = c 1 v 1 + +c n v n for scalars (real numbers) c 1,..., c n ; then cv = (cc 1 )v (cc n )v n also is a linear combination of v 1,..., v n, hence in W.
6 6 5. Two silly examples: If V is a vector space, then it itself is a subspace of itself. Also, the set consisting only of 0, the 0 element of V by itself, is a subspace of V. 6. Suppose that I = (a, b) is an open interval of real numbers and let V be the set of ALL real valued functions of domain I, W the set of all continuous functions on I, X the set of all differentiable functions of on I. It should be clear that W is a subset of V, and X of W. It is also easy to see that W is a subspace of the vector space V ; and X is a subspace of the vector space W. It is sort of evident that a subspace X of a subspace W of V is also a subspace of V. 7. An important example: Let A = [a ij ] be an m n matrix. Consider the homogeneous system of equations, Ax = 0; that is, the system written in less abbreviated form as a 11 x 1 + a 12 x a 1n x n = 0 a 21 x 1 + a 22 x a 2n x n = 0 a m1 x 1 + a m2 x a mn x n = 0 We will identify here an n-tuple (b 1,..., b n ) with the column vector b 1... b n In this way we can talk of a solution of the system as being an n-tuple (x 1,..., x n ) satisfying the equations, or a column vector x such that Ax = 0. For example, for the system: 2x 1 + x 2 x = 0 x 1 + 2x 2 x = 0, the vector (1, 1, 1) is a solution. We identify this vector with the column matrix 1 1 ; 1 it is a solution because if we replace x 1 by 1, x 2 by 1 and x by 1 in the equations, the equations ar satisfied. Or we can say that it is a solution because [ ] = 0 (the 2 1 zero matrix.) As n-tuples, the solutions of the homogeneous system of m linear equations in n unknowns are n-tuples, thus the set of ALL solutions is a subset of R n. Here is the important fact: The set of all solutions of a homogeneous system of linear equations is a subspace of R n, n=number of unknowns. In fact, given such a system, the 0 vector in R n ; that is the vector (0,..., 0) }{{} n zeroes is ALWAYS a solution. If VECTORS (column vectors) x, y are solutions, then Ax = 0, Ay = 0 so that A(x + y) = Ax + Ay = = 0, and x + y is also a solution. Finally, if x is a solution and c is a scalar, then A(cx) = cax = c0 = 0, so cx is also a solution. This shows that the solution space of a system of m homogeneous linear equations in n unknowns is a subspace of R n.
7 7 Bases and Dimension. Given a vector space we can ask for a minimal set of vectors that span the space. We say the space is spanned by vectors v 1,..., v n if and only if every vector of the space is a linear combination of v 1,..., v n. Examples. 1. The vectors (1, 1, 2), (1, 2, ), (1, 0, 4), (2, 2, 2) span R. How do we verify that? To say these vectors span is equivalent to saying that given any vector of R ; in other words any triple of numbers (a, b, c), we can find coefficients c 1, c 2, c, c 4 such that the equation (a, b, c) = c 1 (1, 1, 2) + c 2 (1, 2, ) + c (1, 0, 4) + c 4 (2, 2, 2) is solvable. In terms of components, this means that the system of equations c 1 + c 2 + c + 2c 4 = a c 1 + 2c 2 + 2c 4 = b 2c 1 + c 2 + 4c + 2c 4 = c can be solved for all choices of a, b, c. To see whether this is or isn t so, we consider the augmented matrix, and row reduce a b a b a c c 2a a b a b b a b a c a b c a b 10 8a b 2c a+2b+c a b+c. And we are done. This shows that we can select c 4 at will, any value will do. And then c 1 = 10 c 8a b 2c 4 + c 2 = 2 c 4 + 4a + 2b + c c = 2 c 4 + a b + c We get several conclusions from these computations. The first one is that the vectors (1, 1, 2), (1, 2, ), (1, 0, 4), (2, 2, 2) span R. But they are not a minimal set. Since c 4 can be chosen any way we wish, one choice is c 4 = 0, and that means that the fourth vector is superfluous. 2. In the previous example we saw a set of vectors spanning R. It is not the most obvious set. For any n the vectors e 1 = (1, 0,..., 0), e 2 = (0, 1, 0,..., 0),..., e n = (0,..., 0, n) span R n. The vector e j for any j in the range 1 to n is n-tuple having a 1 in the j-th place, all other entries equal to 0. It is clear (is it) that if x = (x 1,..., x n ) R n, then x = x 1 e 1 + x 2 e 2 + x n e n is a linear combination of these vectors.
8 8. Consider the set of all linear combinations of the functions e x, e x ; this is a vector space, and a subspace of the vector space of all real valued functions defined in the interval (, ). Show that cosh x, sinh x are in the span of of these functions; in fact, show that the spans of e x, e x and of cosh x, sinh x are identical. Solution. By definition cosh x = 1 2 ex e x, sinh x = 1 2 ex 1 2 e x, so cosh x, sinh x are linear combinations of e x, e x and every linear combination of cosh x, sinh x is also one of e x, e x. In fact, we will have ( 1 c 1 cosh x + c 2 sinh x = c 1 2 ex + 1 ) ( 1 2 e x + c 2 2 ex 1 ) 2 e x = c 1 + c 2 2 e x + c 1 c 2 2 e x. The span of cosh x, sinh x is thus contained in that of e x, e x. But, conversely, e x = cosh x + sinh x, e x = cosh x sinh x so that e x, e x are linear combinations of cosh x, sinh x and the span of e x, e x is included in that of cosh x, sinh x; in other words, the two spans are equal. Here are some important facts and definitions. Definition. A set of vectors v 1,..., v n of a vector space V is a basis of the vector space if (and only if) it is a minimal spanning set. That is: 1. Every vector of V is a linear combination of the vectors v 1,..., v n. 2. No proper subset of the set v 1,..., v n spans all of V ; in particular, if we remove the vector v 1, then v 1 cannot be obtained as a linear combination of v 2,..., v n ; same for v 2, etc. In other words, no vector from the set can be a lienar combination of the remaining vectors. An equivalent definition, the one usually found in textbooks is: A set of vectors v 1,..., v n is a basis of the vector space V if (and only if) the set is linearly independent and spans V. A property of a basis, which can also be used as a definition is: A set v 1,..., v n is a basis of V if and only if every vector of V can be written uniquely as a linear combination of the vectors v 1,..., v n. For example, in our first example above, with v 1 = (1, 1, 2), v 2 = (1, 2, ), v = (1, 0, 4), v 4 = (2, 2, 2), v 1, v 2, v, v 4 is not a basis of R because we have the freedom of choosing c 4 any way we wish. However, once we put c 4 = 0 (i.e., exclude c 4 ) all freedom of choice is gone; the vector (a, b, c) can be written in the form c 1 v 1 + c 2 v 2 + c v only in one form; the only choice of c, c 2, c that works is given by what we found above, namely (to repeat): c 1 = 8a b 2c c 2 = 4a + 2b + c c = a b + c For example, (1,, 5) can be written as a linear combination of v 1, v 2, v in the form (1,, 5) = 5 v v v.
9 9 Exercise. Write the vectors (1, 0, 0), (0, 1, 0)and(0, 0, 1) as a linear combination of v 1, v 2, v. Definition. A vector space is finite dimensional if it has a finite basis. We come to a very important result: Suppose V is a finite dimensional vector space. Then any two bases have the same number of elements. That number is called the dimension of the vector space. Examples and more. 1. We saw that (1, 1, 2), (1, 2, ), (1, 0, 4) is a basis of R. But the obvious basis is (1, 0, 0), (0, 1, 0), (0, 0, 1). In general, for every n the set of n vectors e 1 = (1, 0,..., 0), e 2 = (0, 1, 0,..., 0),..., e n = (0,..., 0, n) are easily seen to be linearly independent and (as mentioned above) span R n, showing R n has dimension n. To be continued in class Complete notes may eventually appear.
Linear Algebra, Summer 2011, pt. 2
Linear Algebra, Summer 2, pt. 2 June 8, 2 Contents Inverses. 2 Vector Spaces. 3 2. Examples of vector spaces..................... 3 2.2 The column space......................... 6 2.3 The null space...........................
More informationBASIC NOTIONS. x + y = 1 3, 3x 5y + z = A + 3B,C + 2D, DC are not defined. A + C =
CHAPTER I BASIC NOTIONS (a) 8666 and 8833 (b) a =6,a =4 will work in the first case, but there are no possible such weightings to produce the second case, since Student and Student 3 have to end up with
More informationChapter 13: General Solutions to Homogeneous Linear Differential Equations
Worked Solutions 1 Chapter 13: General Solutions to Homogeneous Linear Differential Equations 13.2 a. Verifying that {y 1, y 2 } is a fundamental solution set: We have y 1 (x) = cos(2x) y 1 (x) = 2 sin(2x)
More informationMath 54 HW 4 solutions
Math 54 HW 4 solutions 2.2. Section 2.2 (a) False: Recall that performing a series of elementary row operations A is equivalent to multiplying A by a series of elementary matrices. Suppose that E,...,
More informationLinear algebra and differential equations (Math 54): Lecture 10
Linear algebra and differential equations (Math 54): Lecture 10 Vivek Shende February 24, 2016 Hello and welcome to class! As you may have observed, your usual professor isn t here today. He ll be back
More informationMath 24 Spring 2012 Questions (mostly) from the Textbook
Math 24 Spring 2012 Questions (mostly) from the Textbook 1. TRUE OR FALSE? (a) The zero vector space has no basis. (F) (b) Every vector space that is generated by a finite set has a basis. (c) Every vector
More information7.5 Operations with Matrices. Copyright Cengage Learning. All rights reserved.
7.5 Operations with Matrices Copyright Cengage Learning. All rights reserved. What You Should Learn Decide whether two matrices are equal. Add and subtract matrices and multiply matrices by scalars. Multiply
More information1 Last time: inverses
MATH Linear algebra (Fall 8) Lecture 8 Last time: inverses The following all mean the same thing for a function f : X Y : f is invertible f is one-to-one and onto 3 For each b Y there is exactly one a
More information40h + 15c = c = h
Chapter One Linear Systems I Solving Linear Systems Systems of linear equations are common in science and mathematics. These two examples from high school science [Onan] give a sense of how they arise.
More information2.3 Terminology for Systems of Linear Equations
page 133 e 2t sin 2t 44 A(t) = t 2 5 te t, a = 0, b = 1 sec 2 t 3t sin t 45 The matrix function A(t) in Problem 39, with a = 0 and b = 1 Integration of matrix functions given in the text was done with
More informationMath 54 Homework 3 Solutions 9/
Math 54 Homework 3 Solutions 9/4.8.8.2 0 0 3 3 0 0 3 6 2 9 3 0 0 3 0 0 3 a a/3 0 0 3 b b/3. c c/3 0 0 3.8.8 The number of rows of a matrix is the size (dimension) of the space it maps to; the number of
More informationLECTURES 14/15: LINEAR INDEPENDENCE AND BASES
LECTURES 14/15: LINEAR INDEPENDENCE AND BASES MA1111: LINEAR ALGEBRA I, MICHAELMAS 2016 1. Linear Independence We have seen in examples of span sets of vectors that sometimes adding additional vectors
More informationLecture 10: Powers of Matrices, Difference Equations
Lecture 10: Powers of Matrices, Difference Equations Difference Equations A difference equation, also sometimes called a recurrence equation is an equation that defines a sequence recursively, i.e. each
More informationReview Solutions for Exam 1
Definitions Basic Theorems. Finish the definition: Review Solutions for Exam (a) A linear combination of vectors {v,..., v n } is: any vector of the form c v + c v + + c n v n (b) A set of vectors {v,...,
More informationCSL361 Problem set 4: Basic linear algebra
CSL361 Problem set 4: Basic linear algebra February 21, 2017 [Note:] If the numerical matrix computations turn out to be tedious, you may use the function rref in Matlab. 1 Row-reduced echelon matrices
More informationLinear independence, span, basis, dimension - and their connection with linear systems
Linear independence span basis dimension - and their connection with linear systems Linear independence of a set of vectors: We say the set of vectors v v..v k is linearly independent provided c v c v..c
More informationLinear equations in linear algebra
Linear equations in linear algebra Samy Tindel Purdue University Differential equations and linear algebra - MA 262 Taken from Differential equations and linear algebra Pearson Collections Samy T. Linear
More information2 so Q[ 2] is closed under both additive and multiplicative inverses. a 2 2b 2 + b
. FINITE-DIMENSIONAL VECTOR SPACES.. Fields By now you ll have acquired a fair knowledge of matrices. These are a concrete embodiment of something rather more abstract. Sometimes it is easier to use matrices,
More informationEXERCISE SET 5.1. = (kx + kx + k, ky + ky + k ) = (kx + kx + 1, ky + ky + 1) = ((k + )x + 1, (k + )y + 1)
EXERCISE SET 5. 6. The pair (, 2) is in the set but the pair ( )(, 2) = (, 2) is not because the first component is negative; hence Axiom 6 fails. Axiom 5 also fails. 8. Axioms, 2, 3, 6, 9, and are easily
More informationChapter 3. Vector spaces
Chapter 3. Vector spaces Lecture notes for MA1111 P. Karageorgis pete@maths.tcd.ie 1/22 Linear combinations Suppose that v 1,v 2,...,v n and v are vectors in R m. Definition 3.1 Linear combination We say
More informationFinal Review Sheet. B = (1, 1 + 3x, 1 + x 2 ) then 2 + 3x + 6x 2
Final Review Sheet The final will cover Sections Chapters 1,2,3 and 4, as well as sections 5.1-5.4, 6.1-6.2 and 7.1-7.3 from chapters 5,6 and 7. This is essentially all material covered this term. Watch
More informationLinear Algebra. Hoffman & Kunze. 2nd edition. Answers and Solutions to Problems and Exercises Typos, comments and etc...
Linear Algebra Hoffman & Kunze 2nd edition Answers and Solutions to Problems and Exercises Typos, comments and etc Gregory R Grant University of Pennsylvania email: ggrant@upennedu Julyl 2017 2 Note This
More informationAPPM 3310 Problem Set 4 Solutions
APPM 33 Problem Set 4 Solutions. Problem.. Note: Since these are nonstandard definitions of addition and scalar multiplication, be sure to show that they satisfy all of the vector space axioms. Solution:
More informationChapter 2 Notes, Linear Algebra 5e Lay
Contents.1 Operations with Matrices..................................1.1 Addition and Subtraction.............................1. Multiplication by a scalar............................ 3.1.3 Multiplication
More informationSome Notes on Linear Algebra
Some Notes on Linear Algebra prepared for a first course in differential equations Thomas L Scofield Department of Mathematics and Statistics Calvin College 1998 1 The purpose of these notes is to present
More informationChapter 1 Vector Spaces
Chapter 1 Vector Spaces Per-Olof Persson persson@berkeley.edu Department of Mathematics University of California, Berkeley Math 110 Linear Algebra Vector Spaces Definition A vector space V over a field
More informationMATH 221: SOLUTIONS TO SELECTED HOMEWORK PROBLEMS
MATH 221: SOLUTIONS TO SELECTED HOMEWORK PROBLEMS 1. HW 1: Due September 4 1.1.21. Suppose v, w R n and c is a scalar. Prove that Span(v + cw, w) = Span(v, w). We must prove two things: that every element
More informationLinear Algebra. Min Yan
Linear Algebra Min Yan January 2, 2018 2 Contents 1 Vector Space 7 1.1 Definition................................. 7 1.1.1 Axioms of Vector Space..................... 7 1.1.2 Consequence of Axiom......................
More informationLinear Independence Reading: Lay 1.7
Linear Independence Reading: Lay 17 September 11, 213 In this section, we discuss the concept of linear dependence and independence I am going to introduce the definitions and then work some examples and
More informationLinear Algebra. Linear Algebra. Chih-Wei Yi. Dept. of Computer Science National Chiao Tung University. November 12, 2008
Linear Algebra Chih-Wei Yi Dept. of Computer Science National Chiao Tung University November, 008 Section De nition and Examples Section De nition and Examples Section De nition and Examples De nition
More informationLinear Algebra. Chapter Linear Equations
Chapter 3 Linear Algebra Dixit algorizmi. Or, So said al-khwarizmi, being the opening words of a 12 th century Latin translation of a work on arithmetic by al-khwarizmi (ca. 78 84). 3.1 Linear Equations
More informationMath 4A Notes. Written by Victoria Kala Last updated June 11, 2017
Math 4A Notes Written by Victoria Kala vtkala@math.ucsb.edu Last updated June 11, 2017 Systems of Linear Equations A linear equation is an equation that can be written in the form a 1 x 1 + a 2 x 2 +...
More informationRow Space, Column Space, and Nullspace
Row Space, Column Space, and Nullspace MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 2015 Introduction Every matrix has associated with it three vector spaces: row space
More informationb for the linear system x 1 + x 2 + a 2 x 3 = a x 1 + x 3 = 3 x 1 + x 2 + 9x 3 = 3 ] 1 1 a 2 a
Practice Exercises for Exam Exam will be on Monday, September 8, 7. The syllabus for Exam consists of Sections One.I, One.III, Two.I, and Two.II. You should know the main definitions, results and computational
More informationLECTURES 4/5: SYSTEMS OF LINEAR EQUATIONS
LECTURES 4/5: SYSTEMS OF LINEAR EQUATIONS MA1111: LINEAR ALGEBRA I, MICHAELMAS 2016 1 Linear equations We now switch gears to discuss the topic of solving linear equations, and more interestingly, systems
More informationVector Spaces. Chapter Two
Chapter Two Vector Spaces The first chapter began by introducing Gauss method and finished with a fair understanding, keyed on the Linear Combination Lemma, of how it finds the solution set of a linear
More informationLINEAR ALGEBRA W W L CHEN
LINEAR ALGEBRA W W L CHEN c W W L Chen, 994, 28. This chapter is available free to all individuals, on the understanding that it is not to be used for financial gain, and may be downloaded and/or photocopied,
More informationChapter 5. Linear Algebra. A linear (algebraic) equation in. unknowns, x 1, x 2,..., x n, is. an equation of the form
Chapter 5. Linear Algebra A linear (algebraic) equation in n unknowns, x 1, x 2,..., x n, is an equation of the form a 1 x 1 + a 2 x 2 + + a n x n = b where a 1, a 2,..., a n and b are real numbers. 1
More informationx + 2y + 3z = 8 x + 3y = 7 x + 2z = 3
Chapter 2: Solving Linear Equations 23 Elimination Using Matrices As we saw in the presentation, we can use elimination to make a system of linear equations into an upper triangular system that is easy
More information1 Last time: multiplying vectors matrices
MATH Linear algebra (Fall 7) Lecture Last time: multiplying vectors matrices Given a matrix A = a a a n a a a n and a vector v = a m a m a mn Av = v a a + v a a v v + + Rn we define a n a n a m a m a mn
More informationFirst we introduce the sets that are going to serve as the generalizations of the scalars.
Contents 1 Fields...................................... 2 2 Vector spaces.................................. 4 3 Matrices..................................... 7 4 Linear systems and matrices..........................
More informationAbstract Vector Spaces
CHAPTER 1 Abstract Vector Spaces 1.1 Vector Spaces Let K be a field, i.e. a number system where you can add, subtract, multiply and divide. In this course we will take K to be R, C or Q. Definition 1.1.
More informationMAT 242 CHAPTER 4: SUBSPACES OF R n
MAT 242 CHAPTER 4: SUBSPACES OF R n JOHN QUIGG 1. Subspaces Recall that R n is the set of n 1 matrices, also called vectors, and satisfies the following properties: x + y = y + x x + (y + z) = (x + y)
More informationVector Spaces and Dimension. Subspaces of. R n. addition and scalar mutiplication. That is, if u, v in V and alpha in R then ( u + v) Exercise: x
Vector Spaces and Dimension Subspaces of Definition: A non-empty subset V is a subspace of if V is closed under addition and scalar mutiplication. That is, if u, v in V and alpha in R then ( u + v) V and
More informationMidterm 1 Review. Written by Victoria Kala SH 6432u Office Hours: R 12:30 1:30 pm Last updated 10/10/2015
Midterm 1 Review Written by Victoria Kala vtkala@math.ucsb.edu SH 6432u Office Hours: R 12:30 1:30 pm Last updated 10/10/2015 Summary This Midterm Review contains notes on sections 1.1 1.5 and 1.7 in your
More informationMath 4310 Solutions to homework 1 Due 9/1/16
Math 0 Solutions to homework Due 9//6. An element [a] Z/nZ is idempotent if [a] 2 [a]. Find all idempotent elements in Z/0Z and in Z/Z. Solution. First note we clearly have [0] 2 [0] so [0] is idempotent
More informationMath 110 Professor Ken Ribet
Math 110 Professor Ken Ribet Linear Algebra Spring, 2005 January 20, 2005 A psychologist named Nalini Ambady gave students three 10-second soundless videotapes of a teacher lecturing. Then she asked the
More information1.4 Techniques of Integration
.4 Techniques of Integration Recall the following strategy for evaluating definite integrals, which arose from the Fundamental Theorem of Calculus (see Section.3). To calculate b a f(x) dx. Find a function
More informationMath 601 Solutions to Homework 3
Math 601 Solutions to Homework 3 1 Use Cramer s Rule to solve the following system of linear equations (Solve for x 1, x 2, and x 3 in terms of a, b, and c 2x 1 x 2 + 7x 3 = a 5x 1 2x 2 x 3 = b 3x 1 x
More informationMath 369 Exam #2 Practice Problem Solutions
Math 369 Exam #2 Practice Problem Solutions 2 5. Is { 2, 3, 8 } a basis for R 3? Answer: No, it is not. To show that it is not a basis, it suffices to show that this is not a linearly independent set.
More informationLS.1 Review of Linear Algebra
LS. LINEAR SYSTEMS LS.1 Review of Linear Algebra In these notes, we will investigate a way of handling a linear system of ODE s directly, instead of using elimination to reduce it to a single higher-order
More information4.3 - Linear Combinations and Independence of Vectors
- Linear Combinations and Independence of Vectors De nitions, Theorems, and Examples De nition 1 A vector v in a vector space V is called a linear combination of the vectors u 1, u,,u k in V if v can be
More informationMAT2342 : Introduction to Applied Linear Algebra Mike Newman, fall Projections. introduction
MAT4 : Introduction to Applied Linear Algebra Mike Newman fall 7 9. Projections introduction One reason to consider projections is to understand approximate solutions to linear systems. A common example
More information2.3. VECTOR SPACES 25
2.3. VECTOR SPACES 25 2.3 Vector Spaces MATH 294 FALL 982 PRELIM # 3a 2.3. Let C[, ] denote the space of continuous functions defined on the interval [,] (i.e. f(x) is a member of C[, ] if f(x) is continuous
More informationLecture 22: Section 4.7
Lecture 22: Section 47 Shuanglin Shao December 2, 213 Row Space, Column Space, and Null Space Definition For an m n, a 11 a 12 a 1n a 21 a 22 a 2n A = a m1 a m2 a mn, the vectors r 1 = [ a 11 a 12 a 1n
More informationSection 29: What s an Inverse?
Section 29: What s an Inverse? Our investigations in the last section showed that all of the matrix operations had an identity element. The identity element for addition is, for obvious reasons, called
More information3 Fields, Elementary Matrices and Calculating Inverses
3 Fields, Elementary Matrices and Calculating Inverses 3. Fields So far we have worked with matrices whose entries are real numbers (and systems of equations whose coefficients and solutions are real numbers).
More informationj=1 x j p, if 1 p <, x i ξ : x i < ξ} 0 as p.
LINEAR ALGEBRA Fall 203 The final exam Almost all of the problems solved Exercise Let (V, ) be a normed vector space. Prove x y x y for all x, y V. Everybody knows how to do this! Exercise 2 If V is a
More informationIntroduction to Algebra: The First Week
Introduction to Algebra: The First Week Background: According to the thermostat on the wall, the temperature in the classroom right now is 72 degrees Fahrenheit. I want to write to my friend in Europe,
More informationContents. 2.1 Vectors in R n. Linear Algebra (part 2) : Vector Spaces (by Evan Dummit, 2017, v. 2.50) 2 Vector Spaces
Linear Algebra (part 2) : Vector Spaces (by Evan Dummit, 2017, v 250) Contents 2 Vector Spaces 1 21 Vectors in R n 1 22 The Formal Denition of a Vector Space 4 23 Subspaces 6 24 Linear Combinations and
More informationMatrices related to linear transformations
Math 4326 Fall 207 Matrices related to linear transformations We have encountered several ways in which matrices relate to linear transformations. In this note, I summarize the important facts and formulas
More informationLinear Combination. v = a 1 v 1 + a 2 v a k v k
Linear Combination Definition 1 Given a set of vectors {v 1, v 2,..., v k } in a vector space V, any vector of the form v = a 1 v 1 + a 2 v 2 +... + a k v k for some scalars a 1, a 2,..., a k, is called
More informationMath Linear Algebra Final Exam Review Sheet
Math 15-1 Linear Algebra Final Exam Review Sheet Vector Operations Vector addition is a component-wise operation. Two vectors v and w may be added together as long as they contain the same number n of
More informationNAME MATH 304 Examination 2 Page 1
NAME MATH 4 Examination 2 Page. [8 points (a) Find the following determinant. However, use only properties of determinants, without calculating directly (that is without expanding along a column or row
More information1. Let r, s, t, v be the homogeneous relations defined on the set M = {2, 3, 4, 5, 6} by
Seminar 1 1. Which ones of the usual symbols of addition, subtraction, multiplication and division define an operation (composition law) on the numerical sets N, Z, Q, R, C? 2. Let A = {a 1, a 2, a 3 }.
More information2 Systems of Linear Equations
2 Systems of Linear Equations A system of equations of the form or is called a system of linear equations. x + 2y = 7 2x y = 4 5p 6q + r = 4 2p + 3q 5r = 7 6p q + 4r = 2 Definition. An equation involving
More informationMath Linear Algebra
Math 39 - Linear Algebra A simple description of the subject of (finite dimensional Linear Algebra might be the study of matrices and vectors Matrices are arrays that are (usually filled with real or complex
More informationThis last statement about dimension is only one part of a more fundamental fact.
Chapter 4 Isomorphism and Coordinates Recall that a vector space isomorphism is a linear map that is both one-to-one and onto. Such a map preserves every aspect of the vector space structure. In other
More informationMath 290, Midterm II-key
Math 290, Midterm II-key Name (Print): (first) Signature: (last) The following rules apply: There are a total of 20 points on this 50 minutes exam. This contains 7 pages (including this cover page) and
More informationAPPENDIX: MATHEMATICAL INDUCTION AND OTHER FORMS OF PROOF
ELEMENTARY LINEAR ALGEBRA WORKBOOK/FOR USE WITH RON LARSON S TEXTBOOK ELEMENTARY LINEAR ALGEBRA CREATED BY SHANNON MARTIN MYERS APPENDIX: MATHEMATICAL INDUCTION AND OTHER FORMS OF PROOF When you are done
More informationMatrix Inverses. November 19, 2014
Matrix Inverses November 9, 204 22 The Inverse of a Matrix Now that we have discussed how to multiply two matrices, we can finally have a proper discussion of what we mean by the expression A for a matrix
More informationchapter 12 MORE MATRIX ALGEBRA 12.1 Systems of Linear Equations GOALS
chapter MORE MATRIX ALGEBRA GOALS In Chapter we studied matrix operations and the algebra of sets and logic. We also made note of the strong resemblance of matrix algebra to elementary algebra. The reader
More informationSECTION 3.3. PROBLEM 22. The null space of a matrix A is: N(A) = {X : AX = 0}. Here are the calculations of AX for X = a,b,c,d, and e. =
SECTION 3.3. PROBLEM. The null space of a matrix A is: N(A) {X : AX }. Here are the calculations of AX for X a,b,c,d, and e. Aa [ ][ ] 3 3 [ ][ ] Ac 3 3 [ ] 3 3 [ ] 4+4 6+6 Ae [ ], Ab [ ][ ] 3 3 3 [ ]
More informationLecture 2 Systems of Linear Equations and Matrices, Continued
Lecture 2 Systems of Linear Equations and Matrices, Continued Math 19620 Outline of Lecture Algorithm for putting a matrix in row reduced echelon form - i.e. Gauss-Jordan Elimination Number of Solutions
More informationMATH 300, Second Exam REVIEW SOLUTIONS. NOTE: You may use a calculator for this exam- You only need something that will perform basic arithmetic.
MATH 300, Second Exam REVIEW SOLUTIONS NOTE: You may use a calculator for this exam- You only need something that will perform basic arithmetic. [ ] [ ] 2 2. Let u = and v =, Let S be the parallelegram
More informationChapter 2: Matrix Algebra
Chapter 2: Matrix Algebra (Last Updated: October 12, 2016) These notes are derived primarily from Linear Algebra and its applications by David Lay (4ed). Write A = 1. Matrix operations [a 1 a n. Then entry
More informationChapter Five Notes N P U2C5
Chapter Five Notes N P UC5 Name Period Section 5.: Linear and Quadratic Functions with Modeling In every math class you have had since algebra you have worked with equations. Most of those equations have
More informationOHSx XM511 Linear Algebra: Solutions to Online True/False Exercises
This document gives the solutions to all of the online exercises for OHSx XM511. The section ( ) numbers refer to the textbook. TYPE I are True/False. Answers are in square brackets [. Lecture 02 ( 1.1)
More informationLecture 8: A Crash Course in Linear Algebra
Math/CS 120: Intro. to Math Professor: Padraic Bartlett Lecture 8: A Crash Course in Linear Algebra Week 9 UCSB 2014 Qué sed de saber cuánto! Pablo Neruda, Oda a los Números 1 Linear Algebra In the past
More informationSolution to Homework 1
Solution to Homework Sec 2 (a) Yes It is condition (VS 3) (b) No If x, y are both zero vectors Then by condition (VS 3) x = x + y = y (c) No Let e be the zero vector We have e = 2e (d) No It will be false
More informationMath 314H EXAM I. 1. (28 points) The row reduced echelon form of the augmented matrix for the system. is the matrix
Math 34H EXAM I Do all of the problems below. Point values for each of the problems are adjacent to the problem number. Calculators may be used to check your answer but not to arrive at your answer. That
More informationLinear Algebra II. 2 Matrices. Notes 2 21st October Matrix algebra
MTH6140 Linear Algebra II Notes 2 21st October 2010 2 Matrices You have certainly seen matrices before; indeed, we met some in the first chapter of the notes Here we revise matrix algebra, consider row
More informationftdt. We often drop the parentheses and write Tf instead of Tf. We could also write in this example Tfx 0
Linear algebra: The study of linear transformations on vector spaces. Q: What s a linear transformation? What s a vector space? Linear transformations and matrices: We first discuss linear transformations
More informationRoberto s Notes on Linear Algebra Chapter 4: Matrix Algebra Section 4. Matrix products
Roberto s Notes on Linear Algebra Chapter 4: Matrix Algebra Section 4 Matrix products What you need to know already: The dot product of vectors Basic matrix operations. Special types of matrices What you
More informationMath Lecture 18 Notes
Math 1010 - Lecture 18 Notes Dylan Zwick Fall 2009 In our last lecture we talked about how we can add, subtract, and multiply polynomials, and we figured out that, basically, if you can add, subtract,
More informationLinear Algebra Handout
Linear Algebra Handout References Some material and suggested problems are taken from Fundamentals of Matrix Algebra by Gregory Hartman, which can be found here: http://www.vmi.edu/content.aspx?id=779979.
More informationMath 1060 Linear Algebra Homework Exercises 1 1. Find the complete solutions (if any!) to each of the following systems of simultaneous equations:
Homework Exercises 1 1 Find the complete solutions (if any!) to each of the following systems of simultaneous equations: (i) x 4y + 3z = 2 3x 11y + 13z = 3 2x 9y + 2z = 7 x 2y + 6z = 2 (ii) x 4y + 3z =
More informationLinear Algebra for Beginners Open Doors to Great Careers. Richard Han
Linear Algebra for Beginners Open Doors to Great Careers Richard Han Copyright 2018 Richard Han All rights reserved. CONTENTS PREFACE... 7 1 - INTRODUCTION... 8 2 SOLVING SYSTEMS OF LINEAR EQUATIONS...
More informationMATH 213 Linear Algebra and ODEs Spring 2015 Study Sheet for Midterm Exam. Topics
MATH 213 Linear Algebra and ODEs Spring 2015 Study Sheet for Midterm Exam This study sheet will not be allowed during the test Books and notes will not be allowed during the test Calculators and cell phones
More informationUNDETERMINED COEFFICIENTS SUPERPOSITION APPROACH *
4.4 UNDETERMINED COEFFICIENTS SUPERPOSITION APPROACH 19 Discussion Problems 59. Two roots of a cubic auxiliary equation with real coeffi cients are m 1 1 and m i. What is the corresponding homogeneous
More informationLinear Algebra, 4th day, Thursday 7/1/04 REU Info:
Linear Algebra, 4th day, Thursday 7/1/04 REU 004. Info http//people.cs.uchicago.edu/laci/reu04. Instructor Laszlo Babai Scribe Nick Gurski 1 Linear maps We shall study the notion of maps between vector
More informationLinear Algebra March 16, 2019
Linear Algebra March 16, 2019 2 Contents 0.1 Notation................................ 4 1 Systems of linear equations, and matrices 5 1.1 Systems of linear equations..................... 5 1.2 Augmented
More informationReview 1 Math 321: Linear Algebra Spring 2010
Department of Mathematics and Statistics University of New Mexico Review 1 Math 321: Linear Algebra Spring 2010 This is a review for Midterm 1 that will be on Thursday March 11th, 2010. The main topics
More informationElementary maths for GMT
Elementary maths for GMT Linear Algebra Part 2: Matrices, Elimination and Determinant m n matrices The system of m linear equations in n variables x 1, x 2,, x n a 11 x 1 + a 12 x 2 + + a 1n x n = b 1
More information[ Here 21 is the dot product of (3, 1, 2, 5) with (2, 3, 1, 2), and 31 is the dot product of
. Matrices A matrix is any rectangular array of numbers. For example 3 5 6 4 8 3 3 is 3 4 matrix, i.e. a rectangular array of numbers with three rows four columns. We usually use capital letters for matrices,
More information0.2 Vector spaces. J.A.Beachy 1
J.A.Beachy 1 0.2 Vector spaces I m going to begin this section at a rather basic level, giving the definitions of a field and of a vector space in much that same detail as you would have met them in a
More informationMath 480 The Vector Space of Differentiable Functions
Math 480 The Vector Space of Differentiable Functions The vector space of differentiable functions. Let C (R) denote the set of all infinitely differentiable functions f : R R. Then C (R) is a vector space,
More informationContents. 1 Vectors, Lines and Planes 1. 2 Gaussian Elimination Matrices Vector Spaces and Subspaces 124
Matrices Math 220 Copyright 2016 Pinaki Das This document is freely redistributable under the terms of the GNU Free Documentation License For more information, visit http://wwwgnuorg/copyleft/fdlhtml Contents
More informationAnswers in blue. If you have questions or spot an error, let me know. 1. Find all matrices that commute with A =. 4 3
Answers in blue. If you have questions or spot an error, let me know. 3 4. Find all matrices that commute with A =. 4 3 a b If we set B = and set AB = BA, we see that 3a + 4b = 3a 4c, 4a + 3b = 3b 4d,
More informationDEF 1 Let V be a vector space and W be a nonempty subset of V. If W is a vector space w.r.t. the operations, in V, then W is called a subspace of V.
6.2 SUBSPACES DEF 1 Let V be a vector space and W be a nonempty subset of V. If W is a vector space w.r.t. the operations, in V, then W is called a subspace of V. HMHsueh 1 EX 1 (Ex. 1) Every vector space
More information