Basic Theorems about Independence, Spanning, Basis, and Dimension

Size: px
Start display at page:

Download "Basic Theorems about Independence, Spanning, Basis, and Dimension"

Transcription

1 Basic Theorems about Independence, Spanning, Basis, and Dimension Theorem 1 If v 1 ; : : : ; v m span V; then every set of vectors in V with more than m vectors must be linearly dependent. Proof. Let w 1 ; : : : ; w n be vectors in V with n > m: We will show that w 1 ; : : : ; w n are linearly dependent. Consider the canonical equation c 1 w 1 + : : : + c n w n = 0 (1) We will show that there exist c 1 ; : : : ; c n not all zero satisfying the canonical equation above. Since v 1 ; : : : ; v m span V we can write each w i in as a linear combination of v 1 ; : : : ; v m : Then equation (1) becomes c 1 (a 11 v 1 + : : : + a m1 v m ) + : : : + c n (a 1n v 1 + : : : + a mn v m ) = 0 (2) Rearranging the terms gives (a 11 c 1 + : : : + a 1n c n )v 1 + : : : + (a m1 c 1 + : : : + a mn c n )v m = 0 (3) Now consider the homogeneous system of equations shown below. a 11 c 1 + : : : + a 1n c n = 0... (4) a m1 c 1 + : : : + a mn c n = 0 A previous theorem implies there exist solutions c 1 ; : : : ; c n not all zero to system because n > m; that is, there are more unknowns than equations. These same c 1 ; : : : ; c n (not all zero) satisfy equations (3) and (2) and (1). Because there exist c 1 ; : : : ; c n not all zero satisfying the canonical equation (1) the vectors w 1 ; : : : ; w n are linearly dependent. Theorem 2 If v 1 ; : : : ; v n are linearly independent in V; then every set of vectors in V with fewer than n vectors cannot span V: Proof. (by contradiction) Assume w 1 ; : : : ; w m (with m < n) span V: Then by Theorem 1 every set of vectors in V with more than m vectors must be linearly dependent. This contradicts our hypothesis that v 1 ; : : : ; v n are linearly independent.

2 Theorem 3 If v 1 ; : : : ; v n is a basis of V and w 1 ; : : : ; w m is a basis of V; then n = m: Proof. By denition of basis v 1 ; : : : ; v n span V and w 1 ; : : : ; w m are linearly independent, so theorem 1 says m n: Similarly, w 1 ; : : : ; w m span V and v 1 ; : : : ; v n are linearly independent, so theorem 1 implies n m: The. only possibility is that n = m: Theorem 3 says that if V has one basis with n elements, then all bases of V have n elements. The number n is intrinsic to the space itself and is independent of which basis you choose. We make the following denition. Denition Let V be a vector space with a basis of n vectors. The number n is called the dimension of V: Theorem 4 Suppose v 1 ; : : : ; v k are linearly independent. If v k+1 =2 spanfv 1 ; : : : ; v k g; then v 1 ; : : : ; v k ; v k+1 are linearly independent. Proof. Consider the canonical equation c 1 v 1 + : : : + c k v k + c k+1 v k+1 = 0 We rst claim that c k+1 = 0: For if c k+1 6= 0; the we can solve the canonical equation for v k+1 to get v k+1 = 1 c k+1 ( c 1 v 1 c k v k ) This contradicts the fact that v k+1 =2 spanfv 1 ; : : : ; v k g: Hence, c k+1 = 0 as claimed. The canonical equation now simplies to c 1 v 1 + : : : + c k v k = 0 Now, since v 1 ; : : : ; v k are linearly independent we have c 1 = 0; : : : ; c k = 0 (in addition to c k+1 = 0): Hence, the vectors v 1 ; : : : ; v k ; v k+1 are linearly independent, which is what we wanted to show.

3 Theorem 5 Suppose v 1 ; : : : ; v k span V: If v k 2 spanfv 1 ; : : : ; v k 1 g; then v 1 ; : : : ; v k 1 span V: Proof. Choose an arbitrary vector v in V: and show that v can be written as a linear combination of v 1 ; : : : ; v k 1 : By hypothesis we can write v as a linear combination of v 1 ; : : : ; v k ; That is, v = c 1 v 1 + : : : + c k 1 v k 1 + c k v k But since v k 2 spanfv 1 ; : : : ; v k 1 g we can write v k = b 1 v 1 + : : : + b k 1 v k 1 Substituting this expression for v k into the previous expression for v gives v = c 1 v 1 + : : : + c k 1 v k 1 + c k (b 1 v 1 + : : : + b k 1 v k 1 ) v = (c 1 + c k b 1 )v 1 + : : : + (c k 1 + c k b k 1 )v k 1 Thus we see that v is a linear combination of v 1 ; : : : ; v k 1 : Since v was an arbitrary vector in V; v 1 ; : : : ; v k 1 span V; as claimed

4 Theorem 6 (The Cut-Your-Work-In-Half Theorem) (Part I) If V is of dimension n and v 1 ; : : : ; v n are linearly independent, then v 1 ; : : : ; v n must span V (and hence form a basis of V ): (Part II) If V is of dimension n and v 1 ; : : : ; v n span V; then v 1 ; : : : ; v n must be linearly independent (and hence form a basis of V ): Proof. (of Part I by contradiction) We want to show v 1 ; : : : ; v n span V: To arrive at a contradiction, suppose they do not span V: That means there is some vector in V which is not in the span of v 1 ; : : : ; v n ; call it v n+1 : By Theorem 4 the vectors v 1 ; : : : ; v n ; v n+1 are linearly independent: Now our hypothesis that V is of dimension n says V has a basis w 1 ; : : : ; w n and these n basis vectors span V: This is now a contradiction to Theorem 1 which says every set with more than n vectors must be linearly dependent. This completes the proof of part I. (of Part II by contradiction) We want to show that v 1 ; : : : ; v n are linearly independent. To arrive at a contradiction suppose they are linearly dependent. This means that one of v 1 ; : : : ; v n is a linear combination of the others. Without loss of generality, suppose v n = c 1 v 1 + : : : + c n 1 v n 1 Then by Theorem 6 it must the case that v 1 ; : : : ; v n 1 span V: Now V has a basis w 1 ; : : : ; w n and these n vectors are linearly independent. This is now a contradiction to theorem 2 which says that fewer than n vectors cannot span V:

5 Theorem 7 Suppose V is of dimension n: Then every linearly independent set with fewer than n vectors can be extended to a basis of V: Proof. Suppose S k is a set of k linearly independent vectors with k < n: By Theorem 2 S k does not span V: So there exists a vector v k+1 =2 span(s k ): By Theorem 4 S k+1 = S k [ fv k+1 g must be linearly independent. In this way, we can continue to append vectors to the original set S k until we arrive at a set S n of n linearly independent vectors. By Theorem 6 (Part I), S n must be a basis of V Theorem 8 Suppose V is of dimension n: Then every spanning set with more than n vectors can be reduced to a basis of V: Proof. Suppose S k is a set of k vectors which spans V with k > n: By Theorem 1 S k must be linearly dependent, meaning one is a linear combination of the others. By Theorem 5 that one vector may be discarded from the set and the remaining set S k 1 of k 1 vectors still spans V: In this way, we can continue to discard vectors from the original set S k until we arrive at a set S n of n vectors which spans V: By Theorem 6 (Part II) S n must be a basis of V:

Lecture 11. Andrei Antonenko. February 26, Last time we studied bases of vector spaces. Today we re going to give some examples of bases.

Lecture 11. Andrei Antonenko. February 26, Last time we studied bases of vector spaces. Today we re going to give some examples of bases. Lecture 11 Andrei Antonenko February 6, 003 1 Examples of bases Last time we studied bases of vector spaces. Today we re going to give some examples of bases. Example 1.1. Consider the vector space P the

More information

Homework 6 Solutions. Solution. Note {e t, te t, t 2 e t, e 2t } is linearly independent. If β = {e t, te t, t 2 e t, e 2t }, then

Homework 6 Solutions. Solution. Note {e t, te t, t 2 e t, e 2t } is linearly independent. If β = {e t, te t, t 2 e t, e 2t }, then Homework 6 Solutions 1 Let V be the real vector space spanned by the functions e t, te t, t 2 e t, e 2t Find a Jordan canonical basis and a Jordan canonical form of T on V dened by T (f) = f Solution Note

More information

New concepts: Span of a vector set, matrix column space (range) Linearly dependent set of vectors Matrix null space

New concepts: Span of a vector set, matrix column space (range) Linearly dependent set of vectors Matrix null space Lesson 6: Linear independence, matrix column space and null space New concepts: Span of a vector set, matrix column space (range) Linearly dependent set of vectors Matrix null space Two linear systems:

More information

Linear Algebra 1A - solutions of ex. 8

Linear Algebra 1A - solutions of ex. 8 Linear Algebra 1A - solutions of ex. 8 Sum of subspaces, direct sum (skhum yashar) 1) Let V be a vector space, and let U, W V be two subspaces. (a) Prove that V = U W if and only if the following two statements

More information

19. Basis and Dimension

19. Basis and Dimension 9. Basis and Dimension In the last Section we established the notion of a linearly independent set of vectors in a vector space V and of a set of vectors that span V. We saw that any set of vectors that

More information

Chapter 1: Systems of Linear Equations

Chapter 1: Systems of Linear Equations Chapter : Systems of Linear Equations February, 9 Systems of linear equations Linear systems Lecture A linear equation in variables x, x,, x n is an equation of the form a x + a x + + a n x n = b, where

More information

The Jordan Canonical Form

The Jordan Canonical Form The Jordan Canonical Form The Jordan canonical form describes the structure of an arbitrary linear transformation on a finite-dimensional vector space over an algebraically closed field. Here we develop

More information

The Cyclic Decomposition of a Nilpotent Operator

The Cyclic Decomposition of a Nilpotent Operator The Cyclic Decomposition of a Nilpotent Operator 1 Introduction. J.H. Shapiro Suppose T is a linear transformation on a vector space V. Recall Exercise #3 of Chapter 8 of our text, which we restate here

More information

NOTES (1) FOR MATH 375, FALL 2012

NOTES (1) FOR MATH 375, FALL 2012 NOTES 1) FOR MATH 375, FALL 2012 1 Vector Spaces 11 Axioms Linear algebra grows out of the problem of solving simultaneous systems of linear equations such as 3x + 2y = 5, 111) x 3y = 9, or 2x + 3y z =

More information

linearly indepedent eigenvectors as the multiplicity of the root, but in general there may be no more than one. For further discussion, assume matrice

linearly indepedent eigenvectors as the multiplicity of the root, but in general there may be no more than one. For further discussion, assume matrice 3. Eigenvalues and Eigenvectors, Spectral Representation 3.. Eigenvalues and Eigenvectors A vector ' is eigenvector of a matrix K, if K' is parallel to ' and ' 6, i.e., K' k' k is the eigenvalue. If is

More information

6.4 BASIS AND DIMENSION (Review) DEF 1 Vectors v 1, v 2,, v k in a vector space V are said to form a basis for V if. (a) v 1,, v k span V and

6.4 BASIS AND DIMENSION (Review) DEF 1 Vectors v 1, v 2,, v k in a vector space V are said to form a basis for V if. (a) v 1,, v k span V and 6.4 BASIS AND DIMENSION (Review) DEF 1 Vectors v 1, v 2,, v k in a vector space V are said to form a basis for V if (a) v 1,, v k span V and (b) v 1,, v k are linearly independent. HMHsueh 1 Natural Basis

More information

Vector Spaces 4.3 LINEARLY INDEPENDENT SETS; BASES Pearson Education, Inc.

Vector Spaces 4.3 LINEARLY INDEPENDENT SETS; BASES Pearson Education, Inc. 4 Vector Spaces 4.3 LINEARLY INDEPENDENT SETS; BASES LINEAR INDEPENDENT SETS; BASES An indexed set of vectors {v 1,, v p } in V is said to be linearly independent if the vector equation c c c 1 1 2 2 p

More information

Row Space, Column Space, and Nullspace

Row Space, Column Space, and Nullspace Row Space, Column Space, and Nullspace MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 2015 Introduction Every matrix has associated with it three vector spaces: row space

More information

Mathematics Department Stanford University Math 61CM/DM Inner products

Mathematics Department Stanford University Math 61CM/DM Inner products Mathematics Department Stanford University Math 61CM/DM Inner products Recall the definition of an inner product space; see Appendix A.8 of the textbook. Definition 1 An inner product space V is a vector

More information

4. Higher Order Linear DEs

4. Higher Order Linear DEs 4. Higher Order Linear DEs Department of Mathematics & Statistics ASU Outline of Chapter 4 1 General Theory of nth Order Linear Equations 2 Homogeneous Equations with Constant Coecients 3 The Method of

More information

Math 1180, Notes, 14 1 C. v 1 v n v 2. C A ; w n. A and w = v i w i : v w = i=1

Math 1180, Notes, 14 1 C. v 1 v n v 2. C A ; w n. A and w = v i w i : v w = i=1 Math 8, 9 Notes, 4 Orthogonality We now start using the dot product a lot. v v = v v n then by Recall that if w w ; w n and w = v w = nx v i w i : Using this denition, we dene the \norm", or length, of

More information

Linear Algebra (part 1) : Vector Spaces (by Evan Dummit, 2017, v. 1.07) 1.1 The Formal Denition of a Vector Space

Linear Algebra (part 1) : Vector Spaces (by Evan Dummit, 2017, v. 1.07) 1.1 The Formal Denition of a Vector Space Linear Algebra (part 1) : Vector Spaces (by Evan Dummit, 2017, v. 1.07) Contents 1 Vector Spaces 1 1.1 The Formal Denition of a Vector Space.................................. 1 1.2 Subspaces...................................................

More information

Math 581 Problem Set 5 Solutions

Math 581 Problem Set 5 Solutions Math 581 Problem Set 5 Solutions 1. Show that the set { 2, 2 + i, 3 i} is linearly independent over Q. Proof: Suppose there exists a 0, a 1, and a 2 in Q so that a 0 2 + a1 ( 2 + i) + a 2 ( 3 i) = 0. Then

More information

Contents. 6 Systems of First-Order Linear Dierential Equations. 6.1 General Theory of (First-Order) Linear Systems

Contents. 6 Systems of First-Order Linear Dierential Equations. 6.1 General Theory of (First-Order) Linear Systems Dierential Equations (part 3): Systems of First-Order Dierential Equations (by Evan Dummit, 26, v 2) Contents 6 Systems of First-Order Linear Dierential Equations 6 General Theory of (First-Order) Linear

More information

Chapter 1. Vectors, Matrices, and Linear Spaces

Chapter 1. Vectors, Matrices, and Linear Spaces 1.6 Homogeneous Systems, Subspaces and Bases 1 Chapter 1. Vectors, Matrices, and Linear Spaces 1.6. Homogeneous Systems, Subspaces and Bases Note. In this section we explore the structure of the solution

More information

Lecture 6: Spanning Set & Linear Independency

Lecture 6: Spanning Set & Linear Independency Lecture 6: Elif Tan Ankara University Elif Tan (Ankara University) Lecture 6 / 0 Definition (Linear Combination) Let v, v 2,..., v k be vectors in (V,, ) a vector space. A vector v V is called a linear

More information

Math 113 Winter 2013 Prof. Church Midterm Solutions

Math 113 Winter 2013 Prof. Church Midterm Solutions Math 113 Winter 2013 Prof. Church Midterm Solutions Name: Student ID: Signature: Question 1 (20 points). Let V be a finite-dimensional vector space, and let T L(V, W ). Assume that v 1,..., v n is a basis

More information

Coordinate Systems. S. F. Ellermeyer. July 10, 2009

Coordinate Systems. S. F. Ellermeyer. July 10, 2009 Coordinate Systems S F Ellermeyer July 10, 009 These notes closely follow the presentation of the material given in David C Lay s textbook Linear Algebra and its Applications (rd edition) These notes are

More information

EE5120 Linear Algebra: Tutorial 3, July-Dec

EE5120 Linear Algebra: Tutorial 3, July-Dec EE5120 Linear Algebra: Tutorial 3, July-Dec 2017-18 1. Let S 1 and S 2 be two subsets of a vector space V such that S 1 S 2. Say True/False for each of the following. If True, prove it. If False, justify

More information

Determine whether the following system has a trivial solution or non-trivial solution:

Determine whether the following system has a trivial solution or non-trivial solution: Practice Questions Lecture # 7 and 8 Question # Determine whether the following system has a trivial solution or non-trivial solution: x x + x x x x x The coefficient matrix is / R, R R R+ R The corresponding

More information

6.4 Basis and Dimension

6.4 Basis and Dimension 6.4 Basis and Dimension DEF ( p. 263) AsetS ={v 1, v 2, v k } of vectors in a vector space V is a basis for V if (1) S spans V and (2) S is linearly independent. MATH 316U (003) - 6.4 (Basis and Dimension)

More information

2018 Fall 2210Q Section 013 Midterm Exam I Solution

2018 Fall 2210Q Section 013 Midterm Exam I Solution 8 Fall Q Section 3 Midterm Exam I Solution True or False questions ( points = points) () An example of a linear combination of vectors v, v is the vector v. True. We can write v as v + v. () If two matrices

More information

Systems of Linear Equations

Systems of Linear Equations LECTURE 6 Systems of Linear Equations You may recall that in Math 303, matrices were first introduced as a means of encapsulating the essential data underlying a system of linear equations; that is to

More information

Homework 4, 5, 6 Solutions. > 0, and so a n 0 = n + 1 n = ( n+1 n)( n+1+ n) 1 if n is odd 1/n if n is even diverges.

Homework 4, 5, 6 Solutions. > 0, and so a n 0 = n + 1 n = ( n+1 n)( n+1+ n) 1 if n is odd 1/n if n is even diverges. 2..2(a) lim a n = 0. Homework 4, 5, 6 Solutions Proof. Let ɛ > 0. Then for n n = 2+ 2ɛ we have 2n 3 4+ ɛ 3 > ɛ > 0, so 0 < 2n 3 < ɛ, and thus a n 0 = 2n 3 < ɛ. 2..2(g) lim ( n + n) = 0. Proof. Let ɛ >

More information

This lecture: basis and dimension 4.4. Linear Independence: Suppose that V is a vector space and. r 1 x 1 + r 2 x r k x k = 0

This lecture: basis and dimension 4.4. Linear Independence: Suppose that V is a vector space and. r 1 x 1 + r 2 x r k x k = 0 Linear Independence: Suppose that V is a vector space and that x, x 2,, x k belong to V {x, x 2,, x k } are linearly independent if r x + r 2 x 2 + + r k x k = only for r = r 2 = = r k = The vectors x,

More information

Linear Independence. Consider a plane P that includes the origin in R 3 {u, v, w} in P. and non-zero vectors

Linear Independence. Consider a plane P that includes the origin in R 3 {u, v, w} in P. and non-zero vectors Linear Independence Consider a plane P that includes the origin in R 3 {u, v, w} in P. and non-zero vectors If no two of u, v and w are parallel, then P =span{u, v, w}. But any two vectors determines a

More information

Vector Space Basics. 1 Abstract Vector Spaces. 1. (commutativity of vector addition) u + v = v + u. 2. (associativity of vector addition)

Vector Space Basics. 1 Abstract Vector Spaces. 1. (commutativity of vector addition) u + v = v + u. 2. (associativity of vector addition) Vector Space Basics (Remark: these notes are highly formal and may be a useful reference to some students however I am also posting Ray Heitmann's notes to Canvas for students interested in a direct computational

More information

Lecture 22: Section 4.7

Lecture 22: Section 4.7 Lecture 22: Section 47 Shuanglin Shao December 2, 213 Row Space, Column Space, and Null Space Definition For an m n, a 11 a 12 a 1n a 21 a 22 a 2n A = a m1 a m2 a mn, the vectors r 1 = [ a 11 a 12 a 1n

More information

1. TRUE or FALSE. 2. Find the complete solution set to the system:

1. TRUE or FALSE. 2. Find the complete solution set to the system: TRUE or FALSE (a A homogenous system with more variables than equations has a nonzero solution True (The number of pivots is going to be less than the number of columns and therefore there is a free variable

More information

MATH 225 Summer 2005 Linear Algebra II Solutions to Assignment 1 Due: Wednesday July 13, 2005

MATH 225 Summer 2005 Linear Algebra II Solutions to Assignment 1 Due: Wednesday July 13, 2005 MATH 225 Summer 25 Linear Algebra II Solutions to Assignment 1 Due: Wednesday July 13, 25 Department of Mathematical and Statistical Sciences University of Alberta Question 1. [p 224. #2] The set of all

More information

The Inclusion Exclusion Principle and Its More General Version

The Inclusion Exclusion Principle and Its More General Version The Inclusion Exclusion Principle and Its More General Version Stewart Weiss June 28, 2009 1 Introduction The Inclusion-Exclusion Principle is typically seen in the context of combinatorics or probability

More information

Find the solution set of 2x 3y = 5. Answer: We solve for x = (5 + 3y)/2. Hence the solution space consists of all vectors of the form

Find the solution set of 2x 3y = 5. Answer: We solve for x = (5 + 3y)/2. Hence the solution space consists of all vectors of the form Math 2 Homework #7 March 4, 2 7.3.3. Find the solution set of 2x 3y = 5. Answer: We solve for x = (5 + 3y/2. Hence the solution space consists of all vectors of the form ( ( ( ( x (5 + 3y/2 5/2 3/2 x =

More information

We showed that adding a vector to a basis produces a linearly dependent set of vectors; more is true.

We showed that adding a vector to a basis produces a linearly dependent set of vectors; more is true. Dimension We showed that adding a vector to a basis produces a linearly dependent set of vectors; more is true. Lemma If a vector space V has a basis B containing n vectors, then any set containing more

More information

A NICE PROOF OF FARKAS LEMMA

A NICE PROOF OF FARKAS LEMMA A NICE PROOF OF FARKAS LEMMA DANIEL VICTOR TAUSK Abstract. The goal of this short note is to present a nice proof of Farkas Lemma which states that if C is the convex cone spanned by a finite set and if

More information

Topics in linear algebra

Topics in linear algebra Chapter 6 Topics in linear algebra 6.1 Change of basis I want to remind you of one of the basic ideas in linear algebra: change of basis. Let F be a field, V and W be finite dimensional vector spaces over

More information

Techinical Proofs for Nonlinear Learning using Local Coordinate Coding

Techinical Proofs for Nonlinear Learning using Local Coordinate Coding Techinical Proofs for Nonlinear Learning using Local Coordinate Coding 1 Notations and Main Results Denition 1.1 (Lipschitz Smoothness) A function f(x) on R d is (α, β, p)-lipschitz smooth with respect

More information

Early stopping: the idea. TRB for benign failures. Early Stopping: The Protocol. Termination

Early stopping: the idea. TRB for benign failures. Early Stopping: The Protocol. Termination TRB for benign failures Early stopping: the idea Sender in round : :! send m to all Process p in round! k, # k # f+!! :! if delivered m in round k- and p " sender then 2:!! send m to all 3:!! halt 4:!

More information

Math 314H EXAM I. 1. (28 points) The row reduced echelon form of the augmented matrix for the system. is the matrix

Math 314H EXAM I. 1. (28 points) The row reduced echelon form of the augmented matrix for the system. is the matrix Math 34H EXAM I Do all of the problems below. Point values for each of the problems are adjacent to the problem number. Calculators may be used to check your answer but not to arrive at your answer. That

More information

Calculus and linear algebra for biomedical engineering Week 3: Matrices, linear systems of equations, and the Gauss algorithm

Calculus and linear algebra for biomedical engineering Week 3: Matrices, linear systems of equations, and the Gauss algorithm Calculus and linear algebra for biomedical engineering Week 3: Matrices, linear systems of equations, and the Gauss algorithm Hartmut Führ fuehr@matha.rwth-aachen.de Lehrstuhl A für Mathematik, RWTH Aachen

More information

Math 3013 Problem Set 6

Math 3013 Problem Set 6 Math 3013 Problem Set 6 Problems from 31 (pgs 189-190 of text): 11,16,18 Problems from 32 (pgs 140-141 of text): 4,8,12,23,25,26 1 (Problems 3111 and 31 16 in text) Determine whether the given set is closed

More information

Theorem 1 ( special version of MASCHKE s theorem ) Given L:V V, there is a basis B of V such that A A l

Theorem 1 ( special version of MASCHKE s theorem ) Given L:V V, there is a basis B of V such that A A l Mathematics 369 The Jordan Canonical Form A. Hulpke While SCHU Rs theorem permits us to transform a matrix into upper triangular form, we can in fact do even better, if we don t insist on an orthogonal

More information

MATH 20F: LINEAR ALGEBRA LECTURE B00 (T. KEMP)

MATH 20F: LINEAR ALGEBRA LECTURE B00 (T. KEMP) MATH 20F: LINEAR ALGEBRA LECTURE B00 (T KEMP) Definition 01 If T (x) = Ax is a linear transformation from R n to R m then Nul (T ) = {x R n : T (x) = 0} = Nul (A) Ran (T ) = {Ax R m : x R n } = {b R m

More information

2-Distance Problems. Combinatorics, 2016 Fall, USTC Week 16, Dec 20&22. Theorem 1. (Frankl-Wilson, 1981) If F is an L-intersecting family in 2 [n],

2-Distance Problems. Combinatorics, 2016 Fall, USTC Week 16, Dec 20&22. Theorem 1. (Frankl-Wilson, 1981) If F is an L-intersecting family in 2 [n], Combinatorics, 206 Fall, USTC Week 6, Dec 20&22 2-Distance Problems Theorem (Frankl-Wilson, 98 If F is an L-intersecting family in 2 [n], then F L k=0 ( n k Proof Let F = {A, A 2,, A m } where A A 2 A

More information

Homework #2 Solutions Due: September 5, for all n N n 3 = n2 (n + 1) 2 4

Homework #2 Solutions Due: September 5, for all n N n 3 = n2 (n + 1) 2 4 Do the following exercises from the text: Chapter (Section 3):, 1, 17(a)-(b), 3 Prove that 1 3 + 3 + + n 3 n (n + 1) for all n N Proof The proof is by induction on n For n N, let S(n) be the statement

More information

MATH SOLUTIONS TO PRACTICE PROBLEMS - MIDTERM I. 1. We carry out row reduction. We begin with the row operations

MATH SOLUTIONS TO PRACTICE PROBLEMS - MIDTERM I. 1. We carry out row reduction. We begin with the row operations MATH 2 - SOLUTIONS TO PRACTICE PROBLEMS - MIDTERM I. We carry out row reduction. We begin with the row operations yielding the matrix This is already upper triangular hence The lower triangular matrix

More information

Math 2331 Linear Algebra

Math 2331 Linear Algebra 4.5 The Dimension of a Vector Space Math 233 Linear Algebra 4.5 The Dimension of a Vector Space Shang-Huan Chiu Department of Mathematics, University of Houston schiu@math.uh.edu math.uh.edu/ schiu/ Shang-Huan

More information

MA 242 LINEAR ALGEBRA C1, Solutions to First Midterm Exam

MA 242 LINEAR ALGEBRA C1, Solutions to First Midterm Exam MA 242 LINEAR ALGEBRA C Solutions to First Midterm Exam Prof Nikola Popovic October 2 9:am - :am Problem ( points) Determine h and k such that the solution set of x + = k 4x + h = 8 (a) is empty (b) contains

More information

1. Determine by inspection which of the following sets of vectors is linearly independent. 3 3.

1. Determine by inspection which of the following sets of vectors is linearly independent. 3 3. 1. Determine by inspection which of the following sets of vectors is linearly independent. (a) (d) 1, 3 4, 1 { [ [,, 1 1] 3]} (b) 1, 4 5, (c) 3 6 (e) 1, 3, 4 4 3 1 4 Solution. The answer is (a): v 1 is

More information

CS1800: Mathematical Induction. Professor Kevin Gold

CS1800: Mathematical Induction. Professor Kevin Gold CS1800: Mathematical Induction Professor Kevin Gold Induction: Used to Prove Patterns Just Keep Going For an algorithm, we may want to prove that it just keeps working, no matter how big the input size

More information

4.3 - Linear Combinations and Independence of Vectors

4.3 - Linear Combinations and Independence of Vectors - Linear Combinations and Independence of Vectors De nitions, Theorems, and Examples De nition 1 A vector v in a vector space V is called a linear combination of the vectors u 1, u,,u k in V if v can be

More information

MAS201 LINEAR MATHEMATICS FOR APPLICATIONS

MAS201 LINEAR MATHEMATICS FOR APPLICATIONS MAS2 LINEAR MATHEMATICS FOR APPLICATIONS NEIL STRICKLAND. Introduction From rst year courses you will already be familiar with systems of linear equations, row-reduction and eigenvalue methods, with emphasis

More information

Lecture 21: 5.6 Rank and Nullity

Lecture 21: 5.6 Rank and Nullity Lecture 21: 5.6 Rank and Nullity Wei-Ta Chu 2008/12/5 Rank and Nullity Definition The common dimension of the row and column space of a matrix A is called the rank ( 秩 ) of A and is denoted by rank(a);

More information

Carleton College, winter 2013 Math 232, Solutions to review problems and practice midterm 2 Prof. Jones 15. T 17. F 38. T 21. F 26. T 22. T 27.

Carleton College, winter 2013 Math 232, Solutions to review problems and practice midterm 2 Prof. Jones 15. T 17. F 38. T 21. F 26. T 22. T 27. Carleton College, winter 23 Math 232, Solutions to review problems and practice midterm 2 Prof. Jones Solutions to review problems: Chapter 3: 6. F 8. F. T 5. T 23. F 7. T 9. F 4. T 7. F 38. T Chapter

More information

Math 51 Tutorial { August 10

Math 51 Tutorial { August 10 SSEA Summer 7 Math 5 Tutorial { August. The span of a set of vectors {v, v,..., v } is given by span (v, v,..., v k ) {c v + c v + + c k v k c, c,..., c k R}. This set can be viewed algebraically as an

More information

Linear Algebra II. 2 Matrices. Notes 2 21st October Matrix algebra

Linear Algebra II. 2 Matrices. Notes 2 21st October Matrix algebra MTH6140 Linear Algebra II Notes 2 21st October 2010 2 Matrices You have certainly seen matrices before; indeed, we met some in the first chapter of the notes Here we revise matrix algebra, consider row

More information

MATH 2050 Assignment 6 Fall 2018 Due: Thursday, November 1. x + y + 2z = 2 x + y + z = c 4x + 2z = 2

MATH 2050 Assignment 6 Fall 2018 Due: Thursday, November 1. x + y + 2z = 2 x + y + z = c 4x + 2z = 2 MATH 5 Assignment 6 Fall 8 Due: Thursday, November [5]. For what value of c does have a solution? Is it unique? x + y + z = x + y + z = c 4x + z = Writing the system as an augmented matrix, we have c R

More information

Mathematical Economics: Lecture 6

Mathematical Economics: Lecture 6 Mathematical Economics: Lecture 6 Yu Ren WISE, Xiamen University October 10, 2012 Outline Chapter 11 Linear Independence 1 Chapter 11 Linear Independence New Section Chapter 11: Linear Independence Linear

More information

Vector Spaces 4.5 Basis and Dimension

Vector Spaces 4.5 Basis and Dimension Vector Spaces 4.5 and Dimension Summer 2017 Vector Spaces 4.5 and Dimension Goals Discuss two related important concepts: Define of a Vectors Space V. Define Dimension dim(v ) of a Vectors Space V. Vector

More information

Richard DiSalvo. Dr. Elmer. Mathematical Foundations of Economics. Fall/Spring,

Richard DiSalvo. Dr. Elmer. Mathematical Foundations of Economics. Fall/Spring, The Finite Dimensional Normed Linear Space Theorem Richard DiSalvo Dr. Elmer Mathematical Foundations of Economics Fall/Spring, 20-202 The claim that follows, which I have called the nite-dimensional normed

More information

Contents. 2.1 Vectors in R n. Linear Algebra (part 2) : Vector Spaces (by Evan Dummit, 2017, v. 2.50) 2 Vector Spaces

Contents. 2.1 Vectors in R n. Linear Algebra (part 2) : Vector Spaces (by Evan Dummit, 2017, v. 2.50) 2 Vector Spaces Linear Algebra (part 2) : Vector Spaces (by Evan Dummit, 2017, v 250) Contents 2 Vector Spaces 1 21 Vectors in R n 1 22 The Formal Denition of a Vector Space 4 23 Subspaces 6 24 Linear Combinations and

More information

Greedy Algorithms. CSE 101: Design and Analysis of Algorithms Lecture 10

Greedy Algorithms. CSE 101: Design and Analysis of Algorithms Lecture 10 Greedy Algorithms CSE 101: Design and Analysis of Algorithms Lecture 10 CSE 101: Design and analysis of algorithms Greedy algorithms Reading: Kleinberg and Tardos, sections 4.1, 4.2, and 4.3 Homework 4

More information

Linear equations in linear algebra

Linear equations in linear algebra Linear equations in linear algebra Samy Tindel Purdue University Differential equations and linear algebra - MA 262 Taken from Differential equations and linear algebra Pearson Collections Samy T. Linear

More information

1. Model existence theorem.

1. Model existence theorem. We fix a first order logic F such that 1. Model existence theorem. C. We let S be the set of statements of F and we suppose Γ S. We let VFT be the set of variable free terms. For each s VFT we let [s]

More information

2.2. Show that U 0 is a vector space. For each α 0 in F, show by example that U α does not satisfy closure.

2.2. Show that U 0 is a vector space. For each α 0 in F, show by example that U α does not satisfy closure. Hints for Exercises 1.3. This diagram says that f α = β g. I will prove f injective g injective. You should show g injective f injective. Assume f is injective. Now suppose g(x) = g(y) for some x, y A.

More information

Solution: By inspection, the standard matrix of T is: A = Where, Ae 1 = 3. , and Ae 3 = 4. , Ae 2 =

Solution: By inspection, the standard matrix of T is: A = Where, Ae 1 = 3. , and Ae 3 = 4. , Ae 2 = This is a typical assignment, but you may not be familiar with the material. You should also be aware that many schools only give two exams, but also collect homework which is usually worth a small part

More information

Chapter 3. More about Vector Spaces Linear Independence, Basis and Dimension. Contents. 1 Linear Combinations, Span

Chapter 3. More about Vector Spaces Linear Independence, Basis and Dimension. Contents. 1 Linear Combinations, Span Chapter 3 More about Vector Spaces Linear Independence, Basis and Dimension Vincent Astier, School of Mathematical Sciences, University College Dublin 3. Contents Linear Combinations, Span Linear Independence,

More information

Recursion and Induction

Recursion and Induction Recursion and Induction Themes Recursion Recurrence Definitions Recursive Relations Induction (prove properties of recursive programs and objects defined recursively) Examples Tower of Hanoi Gray Codes

More information

The natural numbers. Definition. Let X be any inductive set. We define the set of natural numbers as N = C(X).

The natural numbers. Definition. Let X be any inductive set. We define the set of natural numbers as N = C(X). The natural numbers As mentioned earlier in the course, the natural numbers can be constructed using the axioms of set theory. In this note we want to discuss the necessary details of this construction.

More information

(a). W contains the zero vector in R n. (b). W is closed under addition. (c). W is closed under scalar multiplication.

(a). W contains the zero vector in R n. (b). W is closed under addition. (c). W is closed under scalar multiplication. . Subspaces of R n Bases and Linear Independence Definition. Subspaces of R n A subset W of R n is called a subspace of R n if it has the following properties: (a). W contains the zero vector in R n. (b).

More information

4.6 Bases and Dimension

4.6 Bases and Dimension 46 Bases and Dimension 281 40 (a) Show that {1,x,x 2,x 3 } is linearly independent on every interval (b) If f k (x) = x k for k = 0, 1,,n, show that {f 0,f 1,,f n } is linearly independent on every interval

More information

1 Last time: multiplying vectors matrices

1 Last time: multiplying vectors matrices MATH Linear algebra (Fall 7) Lecture Last time: multiplying vectors matrices Given a matrix A = a a a n a a a n and a vector v = a m a m a mn Av = v a a + v a a v v + + Rn we define a n a n a m a m a mn

More information

Lecture 9: Vector Algebra

Lecture 9: Vector Algebra Lecture 9: Vector Algebra Linear combination of vectors Geometric interpretation Interpreting as Matrix-Vector Multiplication Span of a set of vectors Vector Spaces and Subspaces Linearly Independent/Dependent

More information

Example Bases and Basic Feasible Solutions 63 Let q = >: ; > and M = >: ;2 > and consider the LCP (q M). The class of ; ;2 complementary cones

Example Bases and Basic Feasible Solutions 63 Let q = >: ; > and M = >: ;2 > and consider the LCP (q M). The class of ; ;2 complementary cones Chapter 2 THE COMPLEMENTARY PIVOT ALGORITHM AND ITS EXTENSION TO FIXED POINT COMPUTING LCPs of order 2 can be solved by drawing all the complementary cones in the q q 2 - plane as discussed in Chapter.

More information

New concepts: rank-nullity theorem Inverse matrix Gauss-Jordan algorithm to nd inverse

New concepts: rank-nullity theorem Inverse matrix Gauss-Jordan algorithm to nd inverse Lesson 10: Rank-nullity theorem, General solution of Ax = b (A 2 R mm ) New concepts: rank-nullity theorem Inverse matrix Gauss-Jordan algorithm to nd inverse Matrix rank. matrix nullity Denition. The

More information

Solution. That ϕ W is a linear map W W follows from the definition of subspace. The map ϕ is ϕ(v + W ) = ϕ(v) + W, which is well-defined since

Solution. That ϕ W is a linear map W W follows from the definition of subspace. The map ϕ is ϕ(v + W ) = ϕ(v) + W, which is well-defined since MAS 5312 Section 2779 Introduction to Algebra 2 Solutions to Selected Problems, Chapters 11 13 11.2.9 Given a linear ϕ : V V such that ϕ(w ) W, show ϕ induces linear ϕ W : W W and ϕ : V/W V/W : Solution.

More information

c i r i i=1 r 1 = [1, 2] r 2 = [0, 1] r 3 = [3, 4].

c i r i i=1 r 1 = [1, 2] r 2 = [0, 1] r 3 = [3, 4]. Lecture Notes: Rank of a Matrix Yufei Tao Department of Computer Science and Engineering Chinese University of Hong Kong taoyf@cse.cuhk.edu.hk 1 Linear Independence Definition 1. Let r 1, r 2,..., r m

More information

The Maximum and Minimum Principle

The Maximum and Minimum Principle MODULE 5: HEAT EQUATION 5 Lecture 2 The Maximum and Minimum Principle In this lecture, we shall prove the maximum and minimum properties of the heat equation. These properties can be used to prove uniqueness

More information

(II.B) Basis and dimension

(II.B) Basis and dimension (II.B) Basis and dimension How would you explain that a plane has two dimensions? Well, you can go in two independent directions, and no more. To make this idea precise, we formulate the DEFINITION 1.

More information

0.1 Tangent Spaces and Lagrange Multipliers

0.1 Tangent Spaces and Lagrange Multipliers 01 TANGENT SPACES AND LAGRANGE MULTIPLIERS 1 01 Tangent Spaces and Lagrange Multipliers If a differentiable function G = (G 1,, G k ) : E n+k E k then the surface S defined by S = { x G( x) = v} is called

More information

Chapter 3. Directions: For questions 1-11 mark each statement True or False. Justify each answer.

Chapter 3. Directions: For questions 1-11 mark each statement True or False. Justify each answer. Chapter 3 Directions: For questions 1-11 mark each statement True or False. Justify each answer. 1. (True False) Asking whether the linear system corresponding to an augmented matrix [ a 1 a 2 a 3 b ]

More information

1 Solutions to selected problems

1 Solutions to selected problems 1 Solutions to selected problems 1. Let A B R n. Show that int A int B but in general bd A bd B. Solution. Let x int A. Then there is ɛ > 0 such that B ɛ (x) A B. This shows x int B. If A = [0, 1] and

More information

Non-singular Linear Transformations

Non-singular Linear Transformations Non-singular Linear Transformations and SUBMITTED BY: Ms. Harjeet Kaur Associate Professor Department of Mathematics PGGCG 11, Chandigarh Definition: A linear transformation T : V V is said to be non-singular

More information

Linear Algebra. Preliminary Lecture Notes

Linear Algebra. Preliminary Lecture Notes Linear Algebra Preliminary Lecture Notes Adolfo J. Rumbos c Draft date May 9, 29 2 Contents 1 Motivation for the course 5 2 Euclidean n dimensional Space 7 2.1 Definition of n Dimensional Euclidean Space...........

More information

SESHADRI CONSTANTS ON SURFACES

SESHADRI CONSTANTS ON SURFACES SESHADRI CONSTANTS ON SURFACES KRISHNA HANUMANTHU 1. PRELIMINARIES By a surface, we mean a projective nonsingular variety of dimension over C. A curve C on a surface X is an effective divisor. The group

More information

5.4 Basis And Dimension

5.4 Basis And Dimension 5.4 Basis And Dimension 1 Nonrectangular Coordinate Systems We describe this by saying that the coordinate system establishes a one-to-one correspondence between points in the plane and ordered pairs of

More information

Lecture 11: Dimension. How does Span(S) vary with S

Lecture 11: Dimension. How does Span(S) vary with S Lecture 11: Dimension Aim Lecture A basis {v 1,..., v n } of V gives n-dim coord system. Suggests V is n-dimensional. Need theory to ensure any two bases have the same number of vectors. How does Span(S)

More information

Notes on the matrix exponential

Notes on the matrix exponential Notes on the matrix exponential Erik Wahlén erik.wahlen@math.lu.se February 14, 212 1 Introduction The purpose of these notes is to describe how one can compute the matrix exponential e A when A is not

More information

i=1 α ip i, where s The analogue of subspaces

i=1 α ip i, where s The analogue of subspaces Definition: Let X = {P 1,...,P s } be an affine basis for A. If we write P = s i=1 α ip i, where s i=1 α i = 1 then the uniquely determined coefficients, α i, are called the barycentric coordinates of

More information

5 Eigenvalues and Diagonalization

5 Eigenvalues and Diagonalization Linear Algebra (part 5): Eigenvalues and Diagonalization (by Evan Dummit, 27, v 5) Contents 5 Eigenvalues and Diagonalization 5 Eigenvalues, Eigenvectors, and The Characteristic Polynomial 5 Eigenvalues

More information

Lecture Notes 1: Vector spaces

Lecture Notes 1: Vector spaces Optimization-based data analysis Fall 2017 Lecture Notes 1: Vector spaces In this chapter we review certain basic concepts of linear algebra, highlighting their application to signal processing. 1 Vector

More information

Math 3C Lecture 25. John Douglas Moore

Math 3C Lecture 25. John Douglas Moore Math 3C Lecture 25 John Douglas Moore June 1, 2009 Let V be a vector space. A basis for V is a collection of vectors {v 1,..., v k } such that 1. V = Span{v 1,..., v k }, and 2. {v 1,..., v k } are linearly

More information

Kernel and range. Definition: A homogeneous linear equation is an equation of the form A v = 0

Kernel and range. Definition: A homogeneous linear equation is an equation of the form A v = 0 Kernel and range Definition: The kernel (or null-space) of A is ker A { v V : A v = 0 ( U)}. Theorem 5.3. ker A is a subspace of V. (In particular, it always contains 0 V.) Definition: A is one-to-one

More information

Winter 2017 Ma 1b Analytical Problem Set 2 Solutions

Winter 2017 Ma 1b Analytical Problem Set 2 Solutions 1. (5 pts) From Ch. 1.10 in Apostol: Problems 1,3,5,7,9. Also, when appropriate exhibit a basis for S. Solution. (1.10.1) Yes, S is a subspace of V 3 with basis {(0, 0, 1), (0, 1, 0)} and dimension 2.

More information

Linear Algebra. Preliminary Lecture Notes

Linear Algebra. Preliminary Lecture Notes Linear Algebra Preliminary Lecture Notes Adolfo J. Rumbos c Draft date April 29, 23 2 Contents Motivation for the course 5 2 Euclidean n dimensional Space 7 2. Definition of n Dimensional Euclidean Space...........

More information

This MUST hold matrix multiplication satisfies the distributive property.

This MUST hold matrix multiplication satisfies the distributive property. The columns of AB are combinations of the columns of A. The reason is that each column of AB equals A times the corresponding column of B. But that is a linear combination of the columns of A with coefficients

More information