NOTES (1) FOR MATH 375, FALL 2012

Size: px
Start display at page:

Download "NOTES (1) FOR MATH 375, FALL 2012"

Transcription

1 NOTES 1) FOR MATH 375, FALL Vector Spaces 11 Axioms Linear algebra grows out of the problem of solving simultaneous systems of linear equations such as 3x + 2y = 5, 111) x 3y = 9, or 2x + 3y z = 4, x 4y + 2z = 1, 3x + 10y 4z = 9 112) While you are probably familiar with techniques for solving 111), the system in 112) is a bit trickier since there are actually infinitely many solutions In both of these examples there are the same number of equations as unknowns, but it is also of interest to study systems where these numbers can be different, such as 3x + 2y = 5, x 3y = 9, 113) x + 4x = 11, or 2x + 3y z = 4, 114) x 4y + 2z = 1 We begin by studying the spaces of all possible solutions to any of these systems Thus we consider all possible pairs of real numbers x, y) for systems 111) and 113), and all triples of real numbers x, y, z) for the systems 112) and 114) More generally, we want to be able to study a system of m equations in n unknowns: c 1,1 x 1 + c 1,2 x c 1,n 1 x n 1 + c 1,n x n = d 1, c 2,1 x 1 + c 2,2 x c 2,n 1 x n 1 + c 2,n x n = d 2, c m,1 x 1 + c m,2 x c m,n 1 x n 1 + c m,n x n = d m Here the possible solutions are n-tuples of real numbers x 1, x 2,, x n 1, x n ) 115) 9/5/12 Definition 11 The space of all ordered n-tuples of real numbers is denoted by R n This space can come equipped with two algebraic operations, addition and scalar multiplication These are defined as follows: a) If x = x 1,, x n ) and y = y 1,, y n ) are any two elements of R n, their sum x + y is defined to be the n-tuple x + y = x 1 + y 1,, x n + y n ) b) If x = x 1,, x n ) is any element of R n and λ is any real number, the product λx is defined to be the n-tuple λx = λx 1,, λx n ) We denote the special element 0,, 0) by 0 Sometimes we want to consider equations with complex numbers as coefficients or data, and then we are led to solutions which involve complex numbers Definition 12 The space of all ordered n-tuples of complex numbers is denoted by C n This space can come equipped with two algebraic operations, addition and scalar multiplication These are defined as follows:

2 NOTES 1) FOR MATH 375, FALL a) If z = z 1,, z n ) and w = w 1,, w n ) are any two elements of C n, their sum z + w is defined to be the n-tuple z + w = z 1 + w 1,, z n + w n ) 116) * b) If z = z 1,, z n ) is any element of C n and λ is any complex number, the product λz is defined to be the n-tuple λz = λz 1,, λz n ) 117) * We denote the special element 0,, 0) by 0 The following properties of addition and scalar multiplication in R n are easy to check: If x, y R n, then x + y R n If x R n and λ R then λx R n If x, y R n then x + y = y + x If x, y, t R n then x + y) + t = x + y + t) If x R n then 0 + x = x If x R n then x + 1)x = 0 If x R n and if λ, µ R, then λµ)x = λµx) If x, y R n and if λ R, then λx + y) = λx + λy If x R n and if λ, µ R, then λ + µ)x = λx + µy If x R n then 1x = x Moreover, there is an identical set of properties for the complex version C n These properties appear sufficiently often in mathematics to motivate the following abstract definition Definition 13 A nonempty set V is a real vector space if the following ten axioms are satisfied: 1) If x, y V, there is a unique element in V called the sum of x and y; it is denoted by x + y V 2) If x V, λ R, there is a unique element in V called the product of λ and x; it is denoted by λx V 3) If x, y V then x + y = y + x 4) If x, y, t V then x + y) + t = x + y + t) 5) If x V then 0 + x = x 6) If x V then x + 1)x = 0 7) If x V and if λ, µ R, then λµ)x = λµx) 8) If x, y V and if λ R, then λx + y) = λx + λy 9) If x V and if λ, µ R, then λ + µ)x = λx + µy 10) If x V then 1x = x A non-empty set V is called a complex vector space if the same ten axioms hold with the collection of scalars R replaced by the larger) collection of scalars C Why do mathematicians make an abstract definition like this? While one can make up any definition one wants, the real reason is that the definition is useful This usually involves two statements: A) There are many examples of real and complex vector spaces in addition to the special cases of R n and C n discussed above When an object appears sufficiently often, it is useful to give it a name B) Many of the results that we want to establish do NOT depend on the particular nature of the set of elements we are studying, but ONLY depend on the properties listed in the axioms Thus the definition focuses our attention on what is import ant, and what may be just incidental

3 NOTES 1) FOR MATH 375, FALL Further examples of vector spaces 121 Vector spaces of functions 9/7/12 One of the most important examples arises as follows Let S be a non-empty set A real-valued function on S is then a rule, often denoted by a letter like f or g, which associates to each element s S a unique real number, denoted by fs) or gs) We consider the set V = V R S) of all real-valued functions on S It is very important to note that the elements of V are individual functions or rules; the values of the functions which are real numbers) are not elements of V For example, suppose that S consists of the interval [0, 1] = {t R : 0 t 1} Let us write down some examples of elements V R S) f 1 defined by f 1 t) = 1 + t 2 ; f 2 defined by f 2 t) = sint) + e 5t ; 1 for 0 t 1 2, f 3 defined by f 3 t) = 2t for 1 2 t 1; 1 for 0 t 1 2, f 4 defined by f 4 t) = 2t 1 for 1 2 t 1; 1 for t a rational number, f 5 defined by f 5 t) = 2t 1 for t an irrational number In order to make V R S) into a vector space, we must satisfy axioms 1 and 2, which means we have to define the sum of two functions, and also the product of a real number and a function But this is easy to do If f, g V R S) and if λ R, let f + g and λf be the real-valued functions defined on S given by f + g)s) = fs) + gs), λf)s) = λfs) 121) Lemma 14 If addition and scalar multiplication are defined as in equation 121), then the set V R S) of all real-valued functions on the set S is a real vector space 122 Vector spaces of matrices An m n complex matrix is a rectangular array of complex numbers with m rows and n columns Thus an m n complex matrix M looks like a 1,1 + ib 1,1 a 1,2 + ib 1,2 a 1,n + ib 1,n a 2,1 + ib 2,1 a 2,2 + ib 2,2 a 2,n + ib 2,n M = 122) a m,1 + ib m,1 a m,2 + ib m,2 a m,n + ib m,n Let M m n C) denote the set of all m n complex matrices We can make M m n C) into a complex vector space by defining addition and scalar multiplication as follows:

4 NOTES 1) FOR MATH 375, FALL A) Let a 1,1 + ib 1,1 a 1,n + ib 1,n a 2,1 + ib 2,1 a 2,n + ib 2,n M 1 =, a m,1 + ib m,1 a m,n + ib m,n x 1,1 + iy 1,1 x 1,n + iy 1,n x 2,1 + iy 2,1 x 2,n + iy 2,n M 2 = x m,1 + iy m,1 x m,n + iy m,n Then define a 1,1 + x 1,1 ) + ib 1,1 + y 1,1 ) a 1,n + x 1,n ) + ib 1,n + y 1,n ) a 2,1 + x 2,1 ) + ib 2,1 + y 2,1 ) a 2,n + x 2,n ) + ib 2,n + y 2,n ) M 1 + M 2 = 123) a m,1 + x m,1 ) + ib m,1 + y m,1 ) a m,n + x m,n ) + ib m,n + y m,n )) B) Let λ + iµ) C and let a 1,1 + ib 1,1 a 1,2 + ib 1,2 a 1,n + ib 1,n a 2,1 + ib 2,1 a 2,2 + ib 2,2 a 2,n + ib 2,n M = 124) a m,1 + ib m,1 a m,2 + ib m,2 a m,n + ib m,n * Then define λ + iµ)a 1,1 + ib 1,1 ) λ + iµ)a 1,2 + ib 1,2 ) λ + iµ)a 1,n + ib 1,n ) λ + iµ)a 2,1 + ib 2,1 ) λ + iµ)a 2,2 + ib 2,2 ) λ + iµ)a 2,n + ib 2,n ) λ + iµ)m = 125) λ + iµ)a m,1 + ib m,1 ) λ + iµ)a m,2 + ib m,2 ) λ + iµ)a m,n + ib m,n ) Lemma 15 If addition and scalar multiplication are defined as in equations 123) and 125), then the set M m n C) of all m n complex matrices is a complex vector space 123 Homogeneous solutions Let us modify the system of linear equations in 112) and consider the system 2x + 3y z = 0, x 4y + 2z = 0, 3x + 10y 4z = 0 126) Let V denote the set of all 3-tuples of real numbers x, y, z) which are solutions of the system 126) Note that this is certainly a subset of R 3, so we can add elements of V and multiply them by real scalars We make the following important observations: The sum of two elements of V is not just an element of R 3, but is actually an element of V again The product of any real number with an element of V is not just an element of R 3 but is actually an element of V again Lemma 16 The set V of all solutions to the system 126) is a vector space if addition and scalar multiplication have the usual meaning for elements of R 3 The key to the observations above is that the terms on the right-hand side of the equations in 126) are all zero One can and should) check that the set of all solutions to the original system 112) is NOT a vector space

5 NOTES 1) FOR MATH 375, FALL Using the Axioms Examples 1 and 2 from the text): Let V be a vector space 1) Prove that there is one and only one identity element in V Proof The existence of an identity element is guaranteed by Axiom 5 The point of this problem is to show uniqueness Thus suppose there are two elements 0 1, 0 2 V such that for all x V it follows that x = x and x = x We must show that 0 1 = 0 2 We argue as follows Since x = x for all x V and since 0 2 V it follows that = 0 2 Also since x = x for all x V and since 0 1 V it follows that = 0 1 But then and so 0 1 = = = by Axiom 3) = 0 2, 2) Prove that if x V there is one and only one inverse for x in V Proof The existence of an inverse is guaranteed by Axiom 6, which asserts that x + 1)x = 0 The point of this exercise is to show uniqueness Thus suppose there are two elements y 1 and y 2 so that x + y 1 = 0 and x + y 2 = 0 We must show that y 1 = y 2 We argue as follows We have and so y 1 = y 2 y 1 = y by Axiom 5) = y 1 + x + y 2 ) since we are assuming that 0 = x + y 2 ) = y 1 + x) + y 2 by Axiom 4) = x + y 1 ) + y 2 by Axiom 3) = 0 + y 2 since we are assuming that 0 = x + y 1 )) = y by Axiom 3) = y 2 by Axiom 5) 14 Subspaces 9/10/12 The example of homogeneous solutions in Subsection 123 above motivate the following definition Definition 17 Let V be a vector space A subspace of V is a subset W V such that W is a vector space if the operations of addition and multiplication by a scalar are those that are given in V Note that in order to be a vector space, W must be non-empty, and in particular it must contain the identity element 0 of V Lemma 18 Let V be a vector space, and let W V be a non-empty subset Then W is a subspace if and only if the following two conditions are satisfied: a) If x and y are elements of W then x + y is also an element of W b) If x is an element of W and if λ is a scalar, then λx is again an element of W Note that x + y and λx are automatically elements of V since we are assuming that V is a vector space The key point is the requirement that they actually belong to the subset W ) Proof If W is a vector space, then assertions a) and b) follow from Axioms 1 and 2 for vector spaces Thus the harder part of the proof is the opposite implication: if a) and b) are satisfied, then W is a vector space But if a) and b) are satisfied, then Axioms 1 and 2 for vector spaces are satisfied Then all the other eight axioms follow since they are true for elements of V and hence for elements of W

6 NOTES 1) FOR MATH 375, FALL As an application, observe that since the sum of two continuous functions is continuous, and since the product of a continuous function by a scalar is continuous, it follows that the set of continuous functions on the interval [0, 1] is a subspace of the set of all functions on [0, 1] see subsection 121), and hence this set is a vector space 21 Definitions 2 Linear Combinations and Linear Span If V is a vector space and if S = {x 1,, x n } V is a finite set of vectors, then a vector y V is a linear combination of the vectors {x 1,, x n } if there are scalars {α 1,, α n } such that y = α 1 x 1 + α 2 x α n x n Note, for example, that the vector 0 is always a linear combination of {x 1,, x n } since we can write 0 = 0x 1 + 0x x n 211) Definition 21 Let V be a vector space, and let S = {x 1,, x n } V be a finite set of vectors The span of S, denoted by LS) is the set of all linear combinations of the elements of S That is LS) = {y V : y = α 1 x α n x n } Proposition 22 Let V be a vector space, and let S = {x 1,, x n } be a finite set of elements of V Then the span LS) of all linear combinations of {x 1,, x n }, is a subspace of V Proof Let v 1 = α 1 x α n v n and v 2 = β 1 x β n v n be two linear combinations of the set of elements {x 1,, x n }, and let λ be a scalar Then the axioms for a vector space show that v 1 + v 2 = α 1 + β 1 )x α n + β n )x n, λv 1 = λα 1 x λα n x n You should verify this!) This shows that LS) is closed under addition and multiplication by scalars It now follows from Lemma 18 that LS) is a subspace of V 9/12/12 22 The notion of linear span, and why should anyone be interested? I would like to convince you that the notion of linear span, defined in Definition 21, actually has something to do with solving linear equations Suppose that a, b, c are three given real numbers, and consider the system of equations 3x + 2y z = a, x y + 3z = b, 221) 3x + 7y 11z = c We ask: for which numbers a, b, and c can we solve this equation? For example, let a = 4, b = 3, and c = 1 That is, consider the system 3x + 2y z = 4, x y + 3z = 3, 3x + 7y 11z = 1 This system of equations does have a solution For example, we can take x = 1, y = 1, and z = 1 On the other hand, if we let a = 1, b = 0, and c = 1 I claim that there is no solution In this case we are considering the system 3x + 2y z = 1, x y + 3z = 0, 3x + 7y 11z = 1

7 NOTES 1) FOR MATH 375, FALL Suppose there were a solution x, y, z) which satisfies all three equations If we multiply the second equation by 3, we get the system 3x + 2y z = 1, 3x 3y + 9z = 0, 3x + 7y 11z = 1 Then subtracting the second equation from the first, we get 5y 10z = 1, and subtracting the third equation from the second, we get But then it would follow that 10y + 20z = 1 1 = 10y + 20z = 2)5y 10z) = 2)1) = 2 which is impossible! Thus for some triples of numbers a, b, c) we can solve the system in 221), while for others we cannot solve the system Is there anything useful we can say about when the system can or cannot be solved? Let us some of the notation we have introduced In the vector space R 3, let S be the subset consisting of three vectors as follows: S = { 3, 1, 3), 2, 1, 7), 1, 3, 11) } What does it mean that a vector a, b, c) R 3 is a linear combination of these three vectors? It means that we can find three scalars x, y, and z so that a, b, c) = x3, 1, 3) + y2, 1, 7) + z 1, 3, 11) But we can calculate the vector on the right hand side It is just 3x + 2y z, x y + 3z, 3x + 7y 11z) Thus to say that a, b, c) is a linear combination of the three vectors is to say that there are scalars x, y, z so that But this just means that a, b, c) = 3x + 2y z, x y + 3z, 3x + 7y 11z) a = 3x + 2y z, b = x y + 3z, z = 3x + 7y 11z Thus a, b, c) is a linear combination of the three vectors S = { 3, 1, 3), 2, 1, 7), 1, 3, 11) } if and only if the system of equations given in 221) has a solution In other words, we have rephrased the question of whether we can solve this system of equations into another question about whether a vector is a linear combination of three special vectors Note that the three vectors are the columns in the 3 3 matrix of coefficients in the system of equations) In particular, the set of ALL vectors a, b, c) for which we can solve the equation is the same as the linear span LS) Now last time we proved that LS) is a subspace of R 3 Thus we can conclude that since we cannot solve the system for all triples a, b, c), the set of triples for which we can solve the equation is either a plane passing through the origin, or a line passing through the origin, or only the origin Of course, the last case cannot be true since we found a non-zero triple for which the system can be solved EXERCISE: Decide whether the span LS) is a line or a plane

8 NOTES 1) FOR MATH 375, FALL Linear dependence and independence Let us return to equation 211), which gives a trivial way of writing 0 as a linear combination Is it possible to write the vector 0 as a linear combination of {x 1,, x n } in some other way? That is, do there exist scalars {α 1,, α n } which are not all zero such that Let us look at two examples: 0 = α 1 x 1 + α 2 x α n x n? Example 1: In the vector space R 3 let v 1 = 1, 2, 3), let v 2 = 3, 2, 1) and let v 3 = 1, 2, 5) It is easy to check that 2v 1 + 1)v 2 + 1)v 3 = 0 Thus there is a non-trivial linear combination of these three vectors which equals zero Example 2: In the vector space R 3 let w 1 = 1, 2, 3), let w 2 = 3, 2, 0) and let w 3 = 1, 0, 0) If α 1, α 2, α 3 R and if we have α 1 w 1 + α 2 w 2 + α 3 w 3 = α 1 + 3α 2 α 3, 2α 1 + 2α 2, 3α 1 ) = 0, 0 = α 1 + 3α 2 α 3, 0 = 2α 1 + 2α 2, 0 = 3α 1 Solving these equations, it follows that α 1 = α 2 = α 3 = 0 Thus in this case, there is NO non-trivial linear combination which gives the vector 0 We give a name to these two kinds of phenomena: Definition 23 Let V be a vector space A set S of vectors in V is linearly dependent if there is a finite set of distinct elements {x 1,, x n } S and scalars {α 1,, α n }, at least one of which is non-zero, such that α 1 x α n x n = 0 A set of vectors S V is linearly independent if it is not linearly dependent Thus Example 1 above shows that the set of vectors S = {1, 2, 3), 3, 2, 1), 1, 2, 5)} R 3 is linearly dependent, while Example 2 shows that the set of vectors S = {1, 2, 3), 3, 2, 0), 1, 0, 0)} R 3 is linearly independent The following is perhaps the most important result about linear independence Theorem 24 Let V be a vector space, and let S = {x 1,, x k } V be a linearly independent set of vectors Let LS) denote the space of this set Then every set of k + 1 elements of LS) is a linearly dependent set Proof We argue by mathematical induction on the number k of elements in the set S We first consider the case when k = 1 Thus S = {x} is a linearly independent set of elements This means that x 0 why?) Let y 1 and y 2 be any two elements of LS) Then y 1 = α 1 x and y 2 = α 2 x If both α 1 = α 2 = 0, then y 1 = y 2 = 0, and these vectors are linearly dependent Thus suppose at least one of {α 1, α 2 } is non-zero Then α 2 y 1 α 1 y 2 = α 2 α 1 x α 1 α 2 x = 0, and this gives a non-trivial linear combination equaling zero Thus {y 1, y 2 } is linearly dependent This completes the case when k = 1 By mathematical induction, we now assume that whenever we have a set S of k 1 elements which are linearly independent, then any set of k elements in LS ) are linearly dependent We want to show that the result is also true for a set S = {x 1,, x k } of linearly independent elements

9 NOTES 1) FOR MATH 375, FALL Let {y 1,, y k+1 } be any collection of k + 1 elements in LS) Since each y j is a linear combination of 9/17/12 {x 1,, x k }, there are scalars {α j,k } so that y 1 = α 1,1 x 1 + α 1,2 x α 1,k 1 x k 1 + α 1,k x k, y 2 = α 2,1 x 1 + α 2,2 x α 2,k 1 x k 1 + α 2,k x k, y k = α k,1 x 1 + α k,2 x α k,k 1 x k 1 + α k,k x k, y k+1 = α k+1,1 x 1 + α k+1,2 x x k 1 + x k, There are now two possibilities Either α 1,k = α 2,k = α k,k = = 0, or at least one of these coefficients is not zero If α 1,1 = α 2,1 = α k,1 = α k+1,1 = 0, then looking only at the first k equations, we have written {y 1,, y k } as linear combinations of {x 1,, x k 1 } By our induction hypothesis, the vectors {y 1,, y k } are linearly dependent, and then the same is true of the vectors {y 1,, y k+1 } Now suppose that at least one of these coefficients is non-zero After relabeling the indices, let us assume that 0 Then we can do some algebra ie we subtract a multiple of the k + 1) st equation from each of the first k equations) to get y 1 α 1,k y k+1 = y 2 α 2,k y k+1 = y k α k,k y k+1 = α 1,1 α 1,k ) α k+1,1 α 2,1 α ) 2,k α k+1,1 α k,1 α k,k α k+1,1 x α 1,k 1 α 1,k ) 1 x k 1, ) x k 1, x α 2,k 1 α 2,k 1 ) x α k,k 1 α ) k,k 1 x k 1 We now have k elements each a linear combination of k 1) linearly independent elements It follows from the induction hypothesis that the k elements are linearly dependent Thus there are scalars {λ 1,, λ k }, not all zero, such that But this says that k j=1 λ j y j k λ 1 y λ k y k α ) j,k y k+1 = 0 α j,k α j=1 k+1,k y k+1 = 0, which shows that the vectors {y 1,, y k, y k+1 } are also linearly dependent This completes the proof 9/19/12 3 Bases and dimension Definition 31 Let V be a vector space and let S V be a set of elements of V Then S is a basis for V if and only if a) The linear span LS) is equal to V That is, for every v V there are elements x 1,, x k in S and scalars α 1,, α k so that v = α 1 x α k v k b) The elements of the set S are linearly independent That is, if {y 1,, y m } are any distinct elements of S and if β 1,, β m } are scalars such that β 1 y β m y m = 0, then β 1 = = β m = 0 If a vector space V has a basis consisting of a finite number of elements or consists only of the vector 0, the space is said to be finite dimensional Theorem 32 Let V be a finite dimensional vector space Then every basis for V has the same number of elements This number is called the dimension of the vector space V

10 NOTES 1) FOR MATH 375, FALL Proof Let S be a basis for V which consists of a finite number, say n, of elements s 1,, s n Let T be any other basis for V Suppose T contains more than n elements Then we can find n + 1 elements t 1,, t n+1 in T Since S is a basis, LS) = V But then we have n + 1 elements t 1,, t n+1 in LS), and by Theorem 24, the elements {t 1,, t n+1 } must be linearly dependent But this contradicts the hypothesis that the elements of a basis are linearly independent It follows that T contains at most n elements Next, suppose that T consists of strictly less than n elements Suppose T = {t 1,, t k } with k < n Then since T is a basis, LT ) = V But then we have n elements s 1,, s n in LT ), and by Theorem 24, these elements must be linearly dependent This contradicts the same hypothesis Thus T consists of exactly n elements, and this completes the proof Examples: I) The set S = {1, 0), 0, 1)} R 2 is a basis for R 2 II) The set S = {1, 1), 1, 1)} C 2 is a basis for C 2 III) The vector space R n is an n-dimensional real vector space, and the vector space C n is an n-dimensional complex vector space IV) The set S = {1, t, t 2,, t n } is a basis for the vector space of polynomials of degree less than or equal to n V) The space of all polynomials does not have a finite basis 9/21/12 Theorem 33 Let V be a finite dimensional vector space with dimension n Then: a) Any set of linearly independent elements in V has at most n elements in it b) If S = {v 1,, v k } V are linearly independent vectors and v k+1 V, then v k+1 / LS) if and only if the vectors {v 1, v 2,, v k, v k+1 } are also linearly independent c) Any set S of n linearly independent elements in V is a basis for V d) Any set S of n elements in V which span V is a basis for V e) If S V contains a non-zero element then we can find a subset S S consisting of linearly independent elements such that LS) = LS ) Proof Since V has dimension n, there is a basis B = {x 1,, x n } for V consisting of n elements This means that LB) = V and the n vectors {x 1,, x n } are linearly independent Proof of a) Let S = {v 1,, v k } be any set of linearly independent elements in V Since LB) = V, we have {v 1,, v k } LB) Then by Theorem 24, since {v 1,, v k } are linearly independent, we must have k n This establishes statement a) Proof of b) Let S = {v 1,, v k } be any set of k linearly independent elements in V If v k+1 LS), then we can write v k+1 = λ 1 v λ k v k, and hence λ 1 v λ k v k + 1)v k+1 = 0 This shows that the vectors {v 1,, v k+1 } are linearly independent Next let v k+1 / LS) Suppose we have an equation α 1 v α k v k + α k+1 v k+1 = 0 301) We first show that α k+1 = 0 using argument by contradiction If α k+1 0 we could write v k+1 = α 1 v 1 α k α k+1 α k+1 But this would mean that v k+1 LS), which cannot be the case Thus α k+1 = 0 But then we have the equation α 1 v α n v n = 0

11 NOTES 1) FOR MATH 375, FALL Since the vectors {v 1,, v n } are assumed to be linearly independent, it follows that α 1 = α 2 = = α n = 0 Thus for any equation of the form 301), it follows that all the coefficients are zero, and this says that the vectors {v 1,, v n, v n+1 } are linearly independent This establishes b) Proof of c) Let S = {v 1,, v n } be any set of n linearly independent elements in V To show that S is a basis, we only need to show that LS) = V We argue by contradiction If LS) V, then there is a vector v n+1 in V such that v n+1 / LS) But by assertion b) of the Theorem, the vectors {v 1,, v n, v n+1 } are linearly independent However, this contradicts assertion a) of the Theorem, which we have already established Thus the hypothesis that LS) V leads to a contradiction, and so we must have LS) = V Since the elements of S are assumed to be linearly independent, it follows that S is a basis This establishes c) Proof of d) We need to show that the elements of S are linearly independent If they are not, then by assertion e) below whose proof does not depend on assertion d)), we can find a subset S S of elements which are linearly independent, and which also span V But this would mean that we can find a basis for V with strictly fewer than n elements, which is a contradiction This establishes d) Proof of e) Let v 1 S be a non-zero element Then {v 1 } is a linearly independent subset of S We are done if Lv 1 ) = LS) If Lv 1 ) LS), choose v 2 S such that v 2 is not in Lv 1 ) [How do we know we can do this?] Then {v 1, v 2 } is a set of linearly independent vectors We are done if Lv 1, v 2 ) = LS) If not we repeat the process This must stop after n times since V is n-dimensional This completes the proof Example: Consider the system of equations 3x + 2y z = a, 2x 5y + z = b, 7x + 30y 9z = c a) Find a basis for the set of vectors x, y, z) r 3 which are solutions to this system when a = b = c = 0 b) Find a basis for the set of vectors a, b, c) R 3 for which this system has a solution Solution for a): We need to find the solutions to the system of homogeneous equations 3x + 2y z = 0, 2x 5y + z = 0, 7x + 30y 9z = 0 If we add the first two equations we get 5x 3y = 0 and if we multiply the first equation by 9 and subtract it from the third equation, we get 20x + 12y = 0 This second equation is a multiple of the first, and so the solution to the two of them is any pair x, y) with y = 5 3x Once we have x and y we can use any of the equations to solve for z, and we get z = 3x + 2y = 3x x = 19 3 x Thus we see that the solutions to the system of homogeneous equations is any vector of the form v = x, 5 3 x, 19 3 x) = x 3, 5, 19) 3 Thus the set of solutions to the homogeneous equations is spanned by the single vector 3, 5, 19), and the set of solutions is 1-dimensional Solution for b): We can rewrite this system as a single vector equation x3, 2, 7) + y2, 5, 30) + z 1, +1, 9) = a, b, c) Thus the set of vectors a, b, c) R 3 for which this system has a solution is exactly the linear span of the set of three vectors S = {3, 2, 7), 2, 5, 30), 1, +1, 9)} We need to find a basis for LS) If the three vectors were linearly independent, they would be a basis Let us check Suppose α3, 2, 7) + β2, 5, 30) + γ 1, +1, 9) = 0, 0, 0)

12 NOTES 1) FOR MATH 375, FALL This is just the system 3α + 2β γ = 0, 2α 5β + γ = 0, 7α + 30β 9γ = 0 We have already seen that this system has a non-zero solution Thus these three vectors are linearly dependent Let us look at the first two and ask if they are linearly independent That is, suppose This is just the system This is just the system α3, 2, 7) + β2, 5, 30) = 0, 0, 0) 3α + 2β = 0, 2α 5β = 0, 7α + 30β = 0 This time it is easy to see that the only solution is α = β = 0 Thus the two vectors {3, 2, 7), 2, 5, 30)} are linearly independent, and hence form a basis for the set of vectors a, b, c) for which the inhomogeneous system has a solution This vector space has dimension 2

Chapter 1 Vector Spaces

Chapter 1 Vector Spaces Chapter 1 Vector Spaces Per-Olof Persson persson@berkeley.edu Department of Mathematics University of California, Berkeley Math 110 Linear Algebra Vector Spaces Definition A vector space V over a field

More information

Vector Spaces. Addition : R n R n R n Scalar multiplication : R R n R n.

Vector Spaces. Addition : R n R n R n Scalar multiplication : R R n R n. Vector Spaces Definition: The usual addition and scalar multiplication of n-tuples x = (x 1,..., x n ) R n (also called vectors) are the addition and scalar multiplication operations defined component-wise:

More information

1 Invariant subspaces

1 Invariant subspaces MATH 2040 Linear Algebra II Lecture Notes by Martin Li Lecture 8 Eigenvalues, eigenvectors and invariant subspaces 1 In previous lectures we have studied linear maps T : V W from a vector space V to another

More information

Chapter 2: Linear Independence and Bases

Chapter 2: Linear Independence and Bases MATH20300: Linear Algebra 2 (2016 Chapter 2: Linear Independence and Bases 1 Linear Combinations and Spans Example 11 Consider the vector v (1, 1 R 2 What is the smallest subspace of (the real vector space

More information

Math 341: Convex Geometry. Xi Chen

Math 341: Convex Geometry. Xi Chen Math 341: Convex Geometry Xi Chen 479 Central Academic Building, University of Alberta, Edmonton, Alberta T6G 2G1, CANADA E-mail address: xichen@math.ualberta.ca CHAPTER 1 Basics 1. Euclidean Geometry

More information

chapter 12 MORE MATRIX ALGEBRA 12.1 Systems of Linear Equations GOALS

chapter 12 MORE MATRIX ALGEBRA 12.1 Systems of Linear Equations GOALS chapter MORE MATRIX ALGEBRA GOALS In Chapter we studied matrix operations and the algebra of sets and logic. We also made note of the strong resemblance of matrix algebra to elementary algebra. The reader

More information

Mathematical foundations - linear algebra

Mathematical foundations - linear algebra Mathematical foundations - linear algebra Andrea Passerini passerini@disi.unitn.it Machine Learning Vector space Definition (over reals) A set X is called a vector space over IR if addition and scalar

More information

DS-GA 1002 Lecture notes 0 Fall Linear Algebra. These notes provide a review of basic concepts in linear algebra.

DS-GA 1002 Lecture notes 0 Fall Linear Algebra. These notes provide a review of basic concepts in linear algebra. DS-GA 1002 Lecture notes 0 Fall 2016 Linear Algebra These notes provide a review of basic concepts in linear algebra. 1 Vector spaces You are no doubt familiar with vectors in R 2 or R 3, i.e. [ ] 1.1

More information

a (b + c) = a b + a c

a (b + c) = a b + a c Chapter 1 Vector spaces In the Linear Algebra I module, we encountered two kinds of vector space, namely real and complex. The real numbers and the complex numbers are both examples of an algebraic structure

More information

Advanced Engineering Mathematics Prof. Pratima Panigrahi Department of Mathematics Indian Institute of Technology, Kharagpur

Advanced Engineering Mathematics Prof. Pratima Panigrahi Department of Mathematics Indian Institute of Technology, Kharagpur Advanced Engineering Mathematics Prof. Pratima Panigrahi Department of Mathematics Indian Institute of Technology, Kharagpur Lecture No. # 02 Vector Spaces, Subspaces, linearly Dependent/Independent of

More information

2 so Q[ 2] is closed under both additive and multiplicative inverses. a 2 2b 2 + b

2 so Q[ 2] is closed under both additive and multiplicative inverses. a 2 2b 2 + b . FINITE-DIMENSIONAL VECTOR SPACES.. Fields By now you ll have acquired a fair knowledge of matrices. These are a concrete embodiment of something rather more abstract. Sometimes it is easier to use matrices,

More information

Study Guide for Linear Algebra Exam 2

Study Guide for Linear Algebra Exam 2 Study Guide for Linear Algebra Exam 2 Term Vector Space Definition A Vector Space is a nonempty set V of objects, on which are defined two operations, called addition and multiplication by scalars (real

More information

Footnotes to Linear Algebra (MA 540 fall 2013), T. Goodwillie, Bases

Footnotes to Linear Algebra (MA 540 fall 2013), T. Goodwillie, Bases Footnotes to Linear Algebra (MA 540 fall 2013), T. Goodwillie, Bases November 18, 2013 1 Spanning and linear independence I will outline a slightly different approach to the material in Chapter 2 of Axler

More information

Spanning, linear dependence, dimension

Spanning, linear dependence, dimension Spanning, linear dependence, dimension In the crudest possible measure of these things, the real line R and the plane R have the same size (and so does 3-space, R 3 ) That is, there is a function between

More information

0.2 Vector spaces. J.A.Beachy 1

0.2 Vector spaces. J.A.Beachy 1 J.A.Beachy 1 0.2 Vector spaces I m going to begin this section at a rather basic level, giving the definitions of a field and of a vector space in much that same detail as you would have met them in a

More information

Vector Space Basics. 1 Abstract Vector Spaces. 1. (commutativity of vector addition) u + v = v + u. 2. (associativity of vector addition)

Vector Space Basics. 1 Abstract Vector Spaces. 1. (commutativity of vector addition) u + v = v + u. 2. (associativity of vector addition) Vector Space Basics (Remark: these notes are highly formal and may be a useful reference to some students however I am also posting Ray Heitmann's notes to Canvas for students interested in a direct computational

More information

MA106 Linear Algebra lecture notes

MA106 Linear Algebra lecture notes MA106 Linear Algebra lecture notes Lecturers: Diane Maclagan and Damiano Testa 2017-18 Term 2 Contents 1 Introduction 3 2 Matrix review 3 3 Gaussian Elimination 5 3.1 Linear equations and matrices.......................

More information

Linear Vector Spaces

Linear Vector Spaces CHAPTER 1 Linear Vector Spaces Definition 1.0.1. A linear vector space over a field F is a triple (V, +, ), where V is a set, + : V V V and : F V V are maps with the properties : (i) ( x, y V ), x + y

More information

Row Space, Column Space, and Nullspace

Row Space, Column Space, and Nullspace Row Space, Column Space, and Nullspace MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 2015 Introduction Every matrix has associated with it three vector spaces: row space

More information

Review of Linear Algebra

Review of Linear Algebra Review of Linear Algebra Throughout these notes, F denotes a field (often called the scalars in this context). 1 Definition of a vector space Definition 1.1. A F -vector space or simply a vector space

More information

ADVANCED CALCULUS - MTH433 LECTURE 4 - FINITE AND INFINITE SETS

ADVANCED CALCULUS - MTH433 LECTURE 4 - FINITE AND INFINITE SETS ADVANCED CALCULUS - MTH433 LECTURE 4 - FINITE AND INFINITE SETS 1. Cardinal number of a set The cardinal number (or simply cardinal) of a set is a generalization of the concept of the number of elements

More information

Linear Algebra. Preliminary Lecture Notes

Linear Algebra. Preliminary Lecture Notes Linear Algebra Preliminary Lecture Notes Adolfo J. Rumbos c Draft date April 29, 23 2 Contents Motivation for the course 5 2 Euclidean n dimensional Space 7 2. Definition of n Dimensional Euclidean Space...........

More information

Introduction to Mathematical Programming IE406. Lecture 3. Dr. Ted Ralphs

Introduction to Mathematical Programming IE406. Lecture 3. Dr. Ted Ralphs Introduction to Mathematical Programming IE406 Lecture 3 Dr. Ted Ralphs IE406 Lecture 3 1 Reading for This Lecture Bertsimas 2.1-2.2 IE406 Lecture 3 2 From Last Time Recall the Two Crude Petroleum example.

More information

Math 24 Spring 2012 Questions (mostly) from the Textbook

Math 24 Spring 2012 Questions (mostly) from the Textbook Math 24 Spring 2012 Questions (mostly) from the Textbook 1. TRUE OR FALSE? (a) The zero vector space has no basis. (F) (b) Every vector space that is generated by a finite set has a basis. (c) Every vector

More information

Linear algebra and differential equations (Math 54): Lecture 10

Linear algebra and differential equations (Math 54): Lecture 10 Linear algebra and differential equations (Math 54): Lecture 10 Vivek Shende February 24, 2016 Hello and welcome to class! As you may have observed, your usual professor isn t here today. He ll be back

More information

1.3 Linear Dependence & span K

1.3 Linear Dependence & span K ( ) Conversely, suppose that every vector v V can be expressed uniquely as v = u +w for u U and w W. Then, the existence of this expression for each v V is simply the statement that V = U +W. Moreover,

More information

The following definition is fundamental.

The following definition is fundamental. 1. Some Basics from Linear Algebra With these notes, I will try and clarify certain topics that I only quickly mention in class. First and foremost, I will assume that you are familiar with many basic

More information

Linear Algebra. Preliminary Lecture Notes

Linear Algebra. Preliminary Lecture Notes Linear Algebra Preliminary Lecture Notes Adolfo J. Rumbos c Draft date May 9, 29 2 Contents 1 Motivation for the course 5 2 Euclidean n dimensional Space 7 2.1 Definition of n Dimensional Euclidean Space...........

More information

Chapter 2 - Introduction to Vector Spaces

Chapter 2 - Introduction to Vector Spaces Chapter 2 - Introduction to Vector Spaces Justin Leduc These lecture notes are meant to be used by students entering the University of Mannheim Master program in Economics. They constitute the base for

More information

MATH 423 Linear Algebra II Lecture 3: Subspaces of vector spaces. Review of complex numbers. Vector space over a field.

MATH 423 Linear Algebra II Lecture 3: Subspaces of vector spaces. Review of complex numbers. Vector space over a field. MATH 423 Linear Algebra II Lecture 3: Subspaces of vector spaces. Review of complex numbers. Vector space over a field. Vector space A vector space is a set V equipped with two operations, addition V V

More information

MATH 51H Section 4. October 16, Recall what it means for a function between metric spaces to be continuous:

MATH 51H Section 4. October 16, Recall what it means for a function between metric spaces to be continuous: MATH 51H Section 4 October 16, 2015 1 Continuity Recall what it means for a function between metric spaces to be continuous: Definition. Let (X, d X ), (Y, d Y ) be metric spaces. A function f : X Y is

More information

Linear Algebra. Chapter 5

Linear Algebra. Chapter 5 Chapter 5 Linear Algebra The guiding theme in linear algebra is the interplay between algebraic manipulations and geometric interpretations. This dual representation is what makes linear algebra a fruitful

More information

The Cyclic Decomposition of a Nilpotent Operator

The Cyclic Decomposition of a Nilpotent Operator The Cyclic Decomposition of a Nilpotent Operator 1 Introduction. J.H. Shapiro Suppose T is a linear transformation on a vector space V. Recall Exercise #3 of Chapter 8 of our text, which we restate here

More information

Chapter 1. Vectors, Matrices, and Linear Spaces

Chapter 1. Vectors, Matrices, and Linear Spaces 1.6 Homogeneous Systems, Subspaces and Bases 1 Chapter 1. Vectors, Matrices, and Linear Spaces 1.6. Homogeneous Systems, Subspaces and Bases Note. In this section we explore the structure of the solution

More information

Vector space and subspace

Vector space and subspace Vector space and subspace Math 112, week 8 Goals: Vector space, subspace, span. Null space, column space. Linearly independent, bases. Suggested Textbook Readings: Sections 4.1, 4.2, 4.3 Week 8: Vector

More information

MTH 309 Supplemental Lecture Notes Based on Robert Messer, Linear Algebra Gateway to Mathematics

MTH 309 Supplemental Lecture Notes Based on Robert Messer, Linear Algebra Gateway to Mathematics MTH 309 Supplemental Lecture Notes Based on Robert Messer, Linear Algebra Gateway to Mathematics Ulrich Meierfrankenfeld Department of Mathematics Michigan State University East Lansing MI 48824 meier@math.msu.edu

More information

5 Set Operations, Functions, and Counting

5 Set Operations, Functions, and Counting 5 Set Operations, Functions, and Counting Let N denote the positive integers, N 0 := N {0} be the non-negative integers and Z = N 0 ( N) the positive and negative integers including 0, Q the rational numbers,

More information

Math 3013 Problem Set 6

Math 3013 Problem Set 6 Math 3013 Problem Set 6 Problems from 31 (pgs 189-190 of text): 11,16,18 Problems from 32 (pgs 140-141 of text): 4,8,12,23,25,26 1 (Problems 3111 and 31 16 in text) Determine whether the given set is closed

More information

MATH 225 Summer 2005 Linear Algebra II Solutions to Assignment 1 Due: Wednesday July 13, 2005

MATH 225 Summer 2005 Linear Algebra II Solutions to Assignment 1 Due: Wednesday July 13, 2005 MATH 225 Summer 25 Linear Algebra II Solutions to Assignment 1 Due: Wednesday July 13, 25 Department of Mathematical and Statistical Sciences University of Alberta Question 1. [p 224. #2] The set of all

More information

LINEAR ALGEBRA REVIEW

LINEAR ALGEBRA REVIEW LINEAR ALGEBRA REVIEW JC Stuff you should know for the exam. 1. Basics on vector spaces (1) F n is the set of all n-tuples (a 1,... a n ) with a i F. It forms a VS with the operations of + and scalar multiplication

More information

MATH 326: RINGS AND MODULES STEFAN GILLE

MATH 326: RINGS AND MODULES STEFAN GILLE MATH 326: RINGS AND MODULES STEFAN GILLE 1 2 STEFAN GILLE 1. Rings We recall first the definition of a group. 1.1. Definition. Let G be a non empty set. The set G is called a group if there is a map called

More information

Vector Spaces. Chapter 1

Vector Spaces. Chapter 1 Chapter 1 Vector Spaces Linear algebra is the study of linear maps on finite-dimensional vector spaces. Eventually we will learn what all these terms mean. In this chapter we will define vector spaces

More information

Unit 2, Section 3: Linear Combinations, Spanning, and Linear Independence Linear Combinations, Spanning, and Linear Independence

Unit 2, Section 3: Linear Combinations, Spanning, and Linear Independence Linear Combinations, Spanning, and Linear Independence Linear Combinations Spanning and Linear Independence We have seen that there are two operations defined on a given vector space V :. vector addition of two vectors and. scalar multiplication of a vector

More information

i=1 α ip i, where s The analogue of subspaces

i=1 α ip i, where s The analogue of subspaces Definition: Let X = {P 1,...,P s } be an affine basis for A. If we write P = s i=1 α ip i, where s i=1 α i = 1 then the uniquely determined coefficients, α i, are called the barycentric coordinates of

More information

The following techniques for methods of proofs are discussed in our text: - Vacuous proof - Trivial proof

The following techniques for methods of proofs are discussed in our text: - Vacuous proof - Trivial proof Ch. 1.6 Introduction to Proofs The following techniques for methods of proofs are discussed in our text - Vacuous proof - Trivial proof - Direct proof - Indirect proof (our book calls this by contraposition)

More information

Homework #2 Solutions Due: September 5, for all n N n 3 = n2 (n + 1) 2 4

Homework #2 Solutions Due: September 5, for all n N n 3 = n2 (n + 1) 2 4 Do the following exercises from the text: Chapter (Section 3):, 1, 17(a)-(b), 3 Prove that 1 3 + 3 + + n 3 n (n + 1) for all n N Proof The proof is by induction on n For n N, let S(n) be the statement

More information

M17 MAT25-21 HOMEWORK 6

M17 MAT25-21 HOMEWORK 6 M17 MAT25-21 HOMEWORK 6 DUE 10:00AM WEDNESDAY SEPTEMBER 13TH 1. To Hand In Double Series. The exercises in this section will guide you to complete the proof of the following theorem: Theorem 1: Absolute

More information

Matrices and RRE Form

Matrices and RRE Form Matrices and RRE Form Notation R is the real numbers, C is the complex numbers (we will only consider complex numbers towards the end of the course) is read as an element of For instance, x R means that

More information

Abstract & Applied Linear Algebra (Chapters 1-2) James A. Bernhard University of Puget Sound

Abstract & Applied Linear Algebra (Chapters 1-2) James A. Bernhard University of Puget Sound Abstract & Applied Linear Algebra (Chapters 1-2) James A. Bernhard University of Puget Sound Copyright 2018 by James A. Bernhard Contents 1 Vector spaces 3 1.1 Definitions and basic properties.................

More information

Econ Slides from Lecture 7

Econ Slides from Lecture 7 Econ 205 Sobel Econ 205 - Slides from Lecture 7 Joel Sobel August 31, 2010 Linear Algebra: Main Theory A linear combination of a collection of vectors {x 1,..., x k } is a vector of the form k λ ix i for

More information

Algebraic Methods in Combinatorics

Algebraic Methods in Combinatorics Algebraic Methods in Combinatorics Po-Shen Loh 27 June 2008 1 Warm-up 1. (A result of Bourbaki on finite geometries, from Răzvan) Let X be a finite set, and let F be a family of distinct proper subsets

More information

6. The scalar multiple of u by c, denoted by c u is (also) in V. (closure under scalar multiplication)

6. The scalar multiple of u by c, denoted by c u is (also) in V. (closure under scalar multiplication) Definition: A subspace of a vector space V is a subset H of V which is itself a vector space with respect to the addition and scalar multiplication in V. As soon as one verifies a), b), c) below for H,

More information

4.6 Bases and Dimension

4.6 Bases and Dimension 46 Bases and Dimension 281 40 (a) Show that {1,x,x 2,x 3 } is linearly independent on every interval (b) If f k (x) = x k for k = 0, 1,,n, show that {f 0,f 1,,f n } is linearly independent on every interval

More information

Mathematical Methods wk 1: Vectors

Mathematical Methods wk 1: Vectors Mathematical Methods wk : Vectors John Magorrian, magog@thphysoxacuk These are work-in-progress notes for the second-year course on mathematical methods The most up-to-date version is available from http://www-thphysphysicsoxacuk/people/johnmagorrian/mm

More information

Mathematical Methods wk 1: Vectors

Mathematical Methods wk 1: Vectors Mathematical Methods wk : Vectors John Magorrian, magog@thphysoxacuk These are work-in-progress notes for the second-year course on mathematical methods The most up-to-date version is available from http://www-thphysphysicsoxacuk/people/johnmagorrian/mm

More information

Lecture 8: A Crash Course in Linear Algebra

Lecture 8: A Crash Course in Linear Algebra Math/CS 120: Intro. to Math Professor: Padraic Bartlett Lecture 8: A Crash Course in Linear Algebra Week 9 UCSB 2014 Qué sed de saber cuánto! Pablo Neruda, Oda a los Números 1 Linear Algebra In the past

More information

Discrete Math, Spring Solutions to Problems V

Discrete Math, Spring Solutions to Problems V Discrete Math, Spring 202 - Solutions to Problems V Suppose we have statements P, P 2, P 3,, one for each natural number In other words, we have the collection or set of statements {P n n N} a Suppose

More information

ELEMENTARY LINEAR ALGEBRA

ELEMENTARY LINEAR ALGEBRA ELEMENTARY LINEAR ALGEBRA DAVID MEREDITH These notes are about the application and computation of linear algebra objects in F n, where F is a field. I think everything here works over any field including

More information

Linear Algebra Lecture Notes

Linear Algebra Lecture Notes Linear Algebra Lecture Notes Lecturers: Inna Capdeboscq and Damiano Testa Warwick, January 2017 Contents 1 Number Systems and Fields 3 1.1 Axioms for number systems............................ 3 2 Vector

More information

DR.RUPNATHJI( DR.RUPAK NATH )

DR.RUPNATHJI( DR.RUPAK NATH ) Contents 1 Sets 1 2 The Real Numbers 9 3 Sequences 29 4 Series 59 5 Functions 81 6 Power Series 105 7 The elementary functions 111 Chapter 1 Sets It is very convenient to introduce some notation and terminology

More information

Abstract Vector Spaces and Concrete Examples

Abstract Vector Spaces and Concrete Examples LECTURE 18 Abstract Vector Spaces and Concrete Examples Our discussion of linear algebra so far has been devoted to discussing the relations between systems of linear equations, matrices, and vectors.

More information

SUPPLEMENT TO CHAPTER 3

SUPPLEMENT TO CHAPTER 3 SUPPLEMENT TO CHAPTER 3 1.1 Linear combinations and spanning sets Consider the vector space R 3 with the unit vectors e 1 = (1, 0, 0), e 2 = (0, 1, 0), e 3 = (0, 0, 1). Every vector v = (a, b, c) R 3 can

More information

Linear Algebra (part 1) : Vector Spaces (by Evan Dummit, 2017, v. 1.07) 1.1 The Formal Denition of a Vector Space

Linear Algebra (part 1) : Vector Spaces (by Evan Dummit, 2017, v. 1.07) 1.1 The Formal Denition of a Vector Space Linear Algebra (part 1) : Vector Spaces (by Evan Dummit, 2017, v. 1.07) Contents 1 Vector Spaces 1 1.1 The Formal Denition of a Vector Space.................................. 1 1.2 Subspaces...................................................

More information

In N we can do addition, but in order to do subtraction we need to extend N to the integers

In N we can do addition, but in order to do subtraction we need to extend N to the integers Chapter 1 The Real Numbers 1.1. Some Preliminaries Discussion: The Irrationality of 2. We begin with the natural numbers N = {1, 2, 3, }. In N we can do addition, but in order to do subtraction we need

More information

August 23, 2017 Let us measure everything that is measurable, and make measurable everything that is not yet so. Galileo Galilei. 1.

August 23, 2017 Let us measure everything that is measurable, and make measurable everything that is not yet so. Galileo Galilei. 1. August 23, 2017 Let us measure everything that is measurable, and make measurable everything that is not yet so. Galileo Galilei 1. Vector spaces 1.1. Notations. x S denotes the fact that the element x

More information

Prelims Linear Algebra I Michaelmas Term 2014

Prelims Linear Algebra I Michaelmas Term 2014 Prelims Linear Algebra I Michaelmas Term 2014 1 Systems of linear equations and matrices Let m,n be positive integers. An m n matrix is a rectangular array, with nm numbers, arranged in m rows and n columns.

More information

Math 4310 Solutions to homework 1 Due 9/1/16

Math 4310 Solutions to homework 1 Due 9/1/16 Math 0 Solutions to homework Due 9//6. An element [a] Z/nZ is idempotent if [a] 2 [a]. Find all idempotent elements in Z/0Z and in Z/Z. Solution. First note we clearly have [0] 2 [0] so [0] is idempotent

More information

3 The language of proof

3 The language of proof 3 The language of proof After working through this section, you should be able to: (a) understand what is asserted by various types of mathematical statements, in particular implications and equivalences;

More information

Linear Algebra II. 2 Matrices. Notes 2 21st October Matrix algebra

Linear Algebra II. 2 Matrices. Notes 2 21st October Matrix algebra MTH6140 Linear Algebra II Notes 2 21st October 2010 2 Matrices You have certainly seen matrices before; indeed, we met some in the first chapter of the notes Here we revise matrix algebra, consider row

More information

Systems of Linear Equations

Systems of Linear Equations LECTURE 6 Systems of Linear Equations You may recall that in Math 303, matrices were first introduced as a means of encapsulating the essential data underlying a system of linear equations; that is to

More information

2. Prime and Maximal Ideals

2. Prime and Maximal Ideals 18 Andreas Gathmann 2. Prime and Maximal Ideals There are two special kinds of ideals that are of particular importance, both algebraically and geometrically: the so-called prime and maximal ideals. Let

More information

Mathematics Department Stanford University Math 61CM/DM Vector spaces and linear maps

Mathematics Department Stanford University Math 61CM/DM Vector spaces and linear maps Mathematics Department Stanford University Math 61CM/DM Vector spaces and linear maps We start with the definition of a vector space; you can find this in Section A.8 of the text (over R, but it works

More information

n n P} is a bounded subset Proof. Let A be a nonempty subset of Z, bounded above. Define the set

n n P} is a bounded subset Proof. Let A be a nonempty subset of Z, bounded above. Define the set 1 Mathematical Induction We assume that the set Z of integers are well defined, and we are familiar with the addition, subtraction, multiplication, and division. In particular, we assume the following

More information

Linear vector spaces and subspaces.

Linear vector spaces and subspaces. Math 2051 W2008 Margo Kondratieva Week 1 Linear vector spaces and subspaces. Section 1.1 The notion of a linear vector space. For the purpose of these notes we regard (m 1)-matrices as m-dimensional vectors,

More information

Part III. 10 Topological Space Basics. Topological Spaces

Part III. 10 Topological Space Basics. Topological Spaces Part III 10 Topological Space Basics Topological Spaces Using the metric space results above as motivation we will axiomatize the notion of being an open set to more general settings. Definition 10.1.

More information

The set of all solutions to the homogeneous equation Ax = 0 is a subspace of R n if A is m n.

The set of all solutions to the homogeneous equation Ax = 0 is a subspace of R n if A is m n. 0 Subspaces (Now, we are ready to start the course....) Definitions: A linear combination of the vectors v, v,..., v m is any vector of the form c v + c v +... + c m v m, where c,..., c m R. A subset V

More information

MATH 423 Linear Algebra II Lecture 12: Review for Test 1.

MATH 423 Linear Algebra II Lecture 12: Review for Test 1. MATH 423 Linear Algebra II Lecture 12: Review for Test 1. Topics for Test 1 Vector spaces (F/I/S 1.1 1.7, 2.2, 2.4) Vector spaces: axioms and basic properties. Basic examples of vector spaces (coordinate

More information

Exercises Chapter II.

Exercises Chapter II. Page 64 Exercises Chapter II. 5. Let A = (1, 2) and B = ( 2, 6). Sketch vectors of the form X = c 1 A + c 2 B for various values of c 1 and c 2. Which vectors in R 2 can be written in this manner? B y

More information

1 - Systems of Linear Equations

1 - Systems of Linear Equations 1 - Systems of Linear Equations 1.1 Introduction to Systems of Linear Equations Almost every problem in linear algebra will involve solving a system of equations. ü LINEAR EQUATIONS IN n VARIABLES We are

More information

Convex Optimization Notes

Convex Optimization Notes Convex Optimization Notes Jonathan Siegel January 2017 1 Convex Analysis This section is devoted to the study of convex functions f : B R {+ } and convex sets U B, for B a Banach space. The case of B =

More information

2.3 Terminology for Systems of Linear Equations

2.3 Terminology for Systems of Linear Equations page 133 e 2t sin 2t 44 A(t) = t 2 5 te t, a = 0, b = 1 sec 2 t 3t sin t 45 The matrix function A(t) in Problem 39, with a = 0 and b = 1 Integration of matrix functions given in the text was done with

More information

Math Camp Lecture 4: Linear Algebra. Xiao Yu Wang. Aug 2010 MIT. Xiao Yu Wang (MIT) Math Camp /10 1 / 88

Math Camp Lecture 4: Linear Algebra. Xiao Yu Wang. Aug 2010 MIT. Xiao Yu Wang (MIT) Math Camp /10 1 / 88 Math Camp 2010 Lecture 4: Linear Algebra Xiao Yu Wang MIT Aug 2010 Xiao Yu Wang (MIT) Math Camp 2010 08/10 1 / 88 Linear Algebra Game Plan Vector Spaces Linear Transformations and Matrices Determinant

More information

Some Notes on Linear Algebra

Some Notes on Linear Algebra Some Notes on Linear Algebra prepared for a first course in differential equations Thomas L Scofield Department of Mathematics and Statistics Calvin College 1998 1 The purpose of these notes is to present

More information

Vector Spaces. Chapter Two

Vector Spaces. Chapter Two Chapter Two Vector Spaces The first chapter began by introducing Gauss method and finished with a fair understanding, keyed on the Linear Combination Lemma, of how it finds the solution set of a linear

More information

MATH 205 HOMEWORK #3 OFFICIAL SOLUTION. Problem 1: Find all eigenvalues and eigenvectors of the following linear transformations. (a) F = R, V = R 3,

MATH 205 HOMEWORK #3 OFFICIAL SOLUTION. Problem 1: Find all eigenvalues and eigenvectors of the following linear transformations. (a) F = R, V = R 3, MATH 205 HOMEWORK #3 OFFICIAL SOLUTION Problem 1: Find all eigenvalues and eigenvectors of the following linear transformations. a F = R, V = R 3, b F = R or C, V = F 2, T = T = 9 4 4 8 3 4 16 8 7 0 1

More information

Chapter One. The Real Number System

Chapter One. The Real Number System Chapter One. The Real Number System We shall give a quick introduction to the real number system. It is imperative that we know how the set of real numbers behaves in the way that its completeness and

More information

Lecture 2: Linear operators

Lecture 2: Linear operators Lecture 2: Linear operators Rajat Mittal IIT Kanpur The mathematical formulation of Quantum computing requires vector spaces and linear operators So, we need to be comfortable with linear algebra to study

More information

MATH Solutions to Homework Set 1

MATH Solutions to Homework Set 1 MATH 463-523 Solutions to Homework Set 1 1. Let F be a field, and let F n denote the set of n-tuples of elements of F, with operations of scalar multiplication and vector addition defined by λ [α 1,...,

More information

NOTES on LINEAR ALGEBRA 1

NOTES on LINEAR ALGEBRA 1 School of Economics, Management and Statistics University of Bologna Academic Year 207/8 NOTES on LINEAR ALGEBRA for the students of Stats and Maths This is a modified version of the notes by Prof Laura

More information

( 9x + 3y. y 3y = (λ 9)x 3x + y = λy 9x + 3y = 3λy 9x + (λ 9)x = λ(λ 9)x. (λ 2 10λ)x = 0

( 9x + 3y. y 3y = (λ 9)x 3x + y = λy 9x + 3y = 3λy 9x + (λ 9)x = λ(λ 9)x. (λ 2 10λ)x = 0 Math 46 (Lesieutre Practice final ( minutes December 9, 8 Problem Consider the matrix M ( 9 a Prove that there is a basis for R consisting of orthonormal eigenvectors for M This is just the spectral theorem:

More information

Linear Algebra I. Ronald van Luijk, 2015

Linear Algebra I. Ronald van Luijk, 2015 Linear Algebra I Ronald van Luijk, 2015 With many parts from Linear Algebra I by Michael Stoll, 2007 Contents Dependencies among sections 3 Chapter 1. Euclidean space: lines and hyperplanes 5 1.1. Definition

More information

6.4 BASIS AND DIMENSION (Review) DEF 1 Vectors v 1, v 2,, v k in a vector space V are said to form a basis for V if. (a) v 1,, v k span V and

6.4 BASIS AND DIMENSION (Review) DEF 1 Vectors v 1, v 2,, v k in a vector space V are said to form a basis for V if. (a) v 1,, v k span V and 6.4 BASIS AND DIMENSION (Review) DEF 1 Vectors v 1, v 2,, v k in a vector space V are said to form a basis for V if (a) v 1,, v k span V and (b) v 1,, v k are linearly independent. HMHsueh 1 Natural Basis

More information

Math 350 Fall 2011 Notes about inner product spaces. In this notes we state and prove some important properties of inner product spaces.

Math 350 Fall 2011 Notes about inner product spaces. In this notes we state and prove some important properties of inner product spaces. Math 350 Fall 2011 Notes about inner product spaces In this notes we state and prove some important properties of inner product spaces. First, recall the dot product on R n : if x, y R n, say x = (x 1,...,

More information

Linear Algebra. Paul Yiu. Department of Mathematics Florida Atlantic University. Fall 2011

Linear Algebra. Paul Yiu. Department of Mathematics Florida Atlantic University. Fall 2011 Linear Algebra Paul Yiu Department of Mathematics Florida Atlantic University Fall 2011 Linear Algebra Paul Yiu Department of Mathematics Florida Atlantic University Fall 2011 1A: Vector spaces Fields

More information

MATH 324 Summer 2011 Elementary Number Theory. Notes on Mathematical Induction. Recall the following axiom for the set of integers.

MATH 324 Summer 2011 Elementary Number Theory. Notes on Mathematical Induction. Recall the following axiom for the set of integers. MATH 4 Summer 011 Elementary Number Theory Notes on Mathematical Induction Principle of Mathematical Induction Recall the following axiom for the set of integers. Well-Ordering Axiom for the Integers If

More information

HW 4 SOLUTIONS. , x + x x 1 ) 2

HW 4 SOLUTIONS. , x + x x 1 ) 2 HW 4 SOLUTIONS The Way of Analysis p. 98: 1.) Suppose that A is open. Show that A minus a finite set is still open. This follows by induction as long as A minus one point x is still open. To see that A

More information

Cardinality and ordinal numbers

Cardinality and ordinal numbers Cardinality and ordinal numbers The cardinality A of a finite set A is simply the number of elements in it. When it comes to infinite sets, we no longer can speak of the number of elements in such a set.

More information

Optimization Theory. A Concise Introduction. Jiongmin Yong

Optimization Theory. A Concise Introduction. Jiongmin Yong October 11, 017 16:5 ws-book9x6 Book Title Optimization Theory 017-08-Lecture Notes page 1 1 Optimization Theory A Concise Introduction Jiongmin Yong Optimization Theory 017-08-Lecture Notes page Optimization

More information

Linear Algebra Notes. Lecture Notes, University of Toronto, Fall 2016

Linear Algebra Notes. Lecture Notes, University of Toronto, Fall 2016 Linear Algebra Notes Lecture Notes, University of Toronto, Fall 2016 (Ctd ) 11 Isomorphisms 1 Linear maps Definition 11 An invertible linear map T : V W is called a linear isomorphism from V to W Etymology:

More information

In N we can do addition, but in order to do subtraction we need to extend N to the integers

In N we can do addition, but in order to do subtraction we need to extend N to the integers Chapter The Real Numbers.. Some Preliminaries Discussion: The Irrationality of 2. We begin with the natural numbers N = {, 2, 3, }. In N we can do addition, but in order to do subtraction we need to extend

More information