Lecture 13: Row and column spaces

Size: px
Start display at page:

Download "Lecture 13: Row and column spaces"

Transcription

1 Spring 2018 UW-Madison Lecture 13: Row and column spaces 1 The column space of a matrix 1.1 Definition The column space of matrix A denoted as Col(A) is the space consisting of all linear combinations of the columns of A. The dimension of Col(A) is called the column rank of the matrix A. Consider an m-by-n matrix A m n = [a 1 a 2...a n ] where each a j is the column of A and it is a m-by-1 column vector i.e. a j R m j = 12...n. Then the column vector set and column vector space are defined as follows respectively 1. Column vector set: S(A) = {a 1 a 2...a n }. 2. Column vector space: Col(A) = {all linear combinations of the columns of A} { } n = w : w = c 1 a 1 +c 2 a 2 + +c n a n = c i a i = span(s(a)) Col(A)isasubspaceofR m spannedbythecolumnvectorsets(a) = {a 1 a 2...a n }. In other words Col(A) is the smallest subspace containing S(A). Proposition 1.1 (key property of column space). Consider the linear system Ax = b x 1 a 1 + x n a n = b. It implies that the linear system Ax = b is solvable (at least one solution) if and only if b Col(A). Several simple cases: 1 Copy right reserved by Yingwei Wang i=1

2 Spring 2018 UW-Madison 1. The column space of identity matrix is the whole space: Col(I n ) = R n. It implies that the linear system I n x = b is always solvable for any right hand side b. 2. The column space of zero matrix is the zero space: Col(0 n ) = {0}. It implies that the linear system 0 n x = b is solvable if and only if the right hand side b = A =. Then the column space of A is a line in R i.e. Col(A) = {} 1 1 span. In other words v Col(A) it can be written as v = c How to find the bases for the column space? Given a matrix A m n there are three ways to find the bases for Col(A): 1. Perform the Gaussian elimination on [A b] and find the requirement for b according to Section 3 in Lecture note Perform Gaussian elimination on A and figure out which columns of the original matrices are the bases. 3. Perform Gaussian elimination on A T to get the row reduced echelon form. Example 1. Find the bases for the column space of the matrix 1 1 A = Solution: I will show three ways to find the base for Col(A). 1. Perform the Gaussian elimination on [A b]: 1 1 b 1 [A b] = 1 2 b b b b 1 R 1 +R 2 R b 2 +b 1 ( 2)R 1 +R 3 R b b 4 2b 1 2 Copy right reserved by Yingwei Wang

3 Spring 2018 UW-Madison 1 1 b 1 ( 1)R 2 R (b 2 +b 1 ) 0 2 b b 4 2b b 1 ( 1)R 2 +R 4 R (b 2 +b 1 ) 2R 2 +R 3 R b 3 2(b 2 +b 1 ). 0 0 b 4 2b 1 +(b 2 +b 1 ) In order to guarantee a solution the last two rows should be zeros which means { b3 2(b 2 +b 1 ) = 0 b 4 2b 1 +(b 2 +b 1 ) = 0 { b3 = 2b 1 +2b 2 b 4 = b 1 b 2. (1.1) There are infinitely many solutions to the linear system (1.1). We can choose b 1 b 2 as free variables and b 3 b 4 are pivot variables. Then we have If we choose b 1 = 1b 2 = 0 then we can get b 3 = 2b 4 = 1; If we choose b 1 = 0b 2 = 1 then we can get b 3 = 2b 4 = 1. So we can obtain the standard basis set for Col(A): 1 0 Col(A) = span Another way to solve the linear system (1.1) is to write the matrix form b b b 3 =. (1.2) 0 b 4 We can find two linearly independent solution to the linear system (1.2) which are also the bases for the Col(A). 2. Perform Gaussian elimination on A and figure out which columns of the original matrices are the bases. 3 Copy right reserved by Yingwei Wang

4 Spring 2018 UW-Madison We have already known that A = We can observe two pivots in the echelon form which indicates that the two columns of A are linearly independent. So we can simply choose the column set as the basis set 1 1 Col(A) = span A very important remark: We can not choose the column vectors in the echelon form after Gaussian elimination since they are just the indicators instead of the bases. We have to go back to the original matrix and find the bases. 3. Perform the Gaussian elimination on A T to get the reduced echelon form: A T = ( 1)R 1 +R 2 R ( 1)R 2 R R 2 +R 1 R The reduced echelon form of A T also gives us the standard basis set for Col(A): 1 0 Col(A) = span Copy right reserved by Yingwei Wang

5 Spring 2018 UW-Madison 2 The row space of a matrix. The row space of A denoted as Row(A) is the space spanned by all of the rows of A i.e. Row(A) = {all linear combinations of the rows of A}. Recall the definition of transpose in the end of Lecture note 9. A key property: The row space of A is equivalent to the column space of A T i.e. Row(A) = Col(A T ). Question: How to find the bases for Row(A)? Answer: Let B = A T. We can find the bases for Col(B). and then get the bases for Row(A). Example 2. Find the bases for the row space of the matrix 1 1 A = Solution: Let us consider the transpose of A: ( ) B = A T = We will find the bases for Col(A T ) and then back to Row(A). 1. Work on [B b] = [A T b]: [B b] = [A T b1 b] = b 2 ( 1)R 1 +R 2 R b b 2 b 1 ( 1)R 2 R b b 2 +b 1 It follows that there is no requirement for the right hand size b which means the column space of A T is the whole space R 2. So the row space of A is also R 2 i.e. Row(A) = R 2 = span{(10)(01)}. 5 Copy right reserved by Yingwei Wang.

6 Spring 2018 UW-Madison 2. Work on B = A T : B = A T = ( 1)R 1 +R 2 R ( 1)R 2 R R 2 +R 1 R It indicates that the first two columns of B are linearly independent and they can be served as the bases for Col(B) i.e. {( ) ( )} 1 1 Col(B) = span. 1 2 It is equivalent to say that the first two rows of A could be served as the bases for Row(A) i.e. Row(A) = span{(11)( 1 2)}. 3. Work on B T = (A T ) T = A: It is easy to know that B T = A = G.E. 0 1 ( 1)R 2 +R 1 R It follows that the standard basis for Col(B) is {( ( ) 1)} So we can go back to Row(A) i.e. Row(A) = span{(10)(01)}. In addition Examples 1 and 2 show that the dimensions of Row(A) and Col(A) are exactly the same. Actually it is true for any matrix A m n. 6 Copy right reserved by Yingwei Wang

7 Spring 2018 UW-Madison Definition 2.1. The rank of a matrix A is the dimension of its row space or column space i.e. rank(a) = dim(col(a)) = dim(row(a)). (2.1) For example we have already known that rank(i n ) = n rank(0 n ) = 0 () 1 2 rank = rank = Furthermore from Examples 1 and 2 we can also find the bases for Null(A) and Null(A T ): It follows that Null(A) = span{0} 2 1 Null(A T ) = span dim(row(a)) + dim(null(a)) = n = the number of columns dim(col(a))+dim(null(a T )) = m = the number of rows. 7 Copy right reserved by Yingwei Wang

8 Spring 2018 UW-Madison 3 Four fundamental subspaces 3.1 The useful properties Consider the matrix A m n. The four fundamental subspaces of A are shown as follows: 1. Column space: Col(A) is a subspace of R m and dim(col(a)) = rank(a); 2. Row space: Row(A) = Col(A T ) is a subspace of R n and dim(col(a T )) = rank(a); 3. Null space: Null(A) is a subspace of R n and dim(null(a)) = n rank(a); 4. Leftnull space: Null(A T ) is a subspace of R m and dim(null(a T )) = m rank(a). 5. For any vector x Null(A) and any vector r Row(A) we have x r = 0. In other words we say Null(A) Row(A) A. 6. For any vector x Null(A T ) and any vector c Col(A) we have x c = 0. In other words we say Null(A T ) Col(A) A. 3.2 Given any matrix A how to find the bases for four fundamental subspaces? See Examples of Chapter 4.5 in your textbook about how to find the bases for row spaces and column spaces. Here I will show more examples on how to find the bases for four fundamental subspaces Col(A) Row(A) = Col(A T ) Null(A) and Null(A T ). Example 3. Find the dimension and bases for four fundamental subspaces of the matrix A = Solution: 8 Copy right reserved by Yingwei Wang

9 Spring 2018 UW-Madison 1. Column space. I will show three ways to find the bases for Col(A). (a) Work on [A b]: b 1 [A b] = b b b 1 ( 1)R 1 +R 2 R b 2 b 1 ( 2)R 1 +R 3 R b 3 2b b 1 ( 1)R 2 +R 3 R b 2 b b 3 b 1 b 2 In order to guarantee a solution the last row should be a zero row which means b 1 +b 2 b 3 = 0 b 1 pivot b 2 b 3 free 1 1 Col(A) = span (b) Work on A: A = It indicates that the first two columns of A are linearly independent so they can be chosen as bases: 1 2 Col(A) = span (c) Work on A T : A T = Copy right reserved by Yingwei Wang

10 Spring 2018 UW-Madison ( 1)R 1 +R 4 R ( 2)R 1 +R 2 R ( 1)R 2 R ( 1)R 2 +R 3 R ( 1)R 2 +R 1 R It follows that the first two rows in the reduced echelon form are the bases for Col(A): 1 0 Col(A) = span In addition the dimension of Col(A) is 2 i.e. dim(col(a)) = Row space. I will show three ways to find the bases for Row(A) = Col(A T ). (a) Work on [A T b]: b 1 [A T b] = b b b b 1 ( 1)R 1 +R 4 R b 2 2b 1 ( 2)R 1 +R 2 R b b 4 b b 1 R 2 +R 3 R b 2 2b b 3 +b 2 2b b 4 b 1 10 Copy right reserved by Yingwei Wang

11 Spring 2018 UW-Madison In order to guarantee a solution the last two rows should be zeros which means { b3 +b 2 2b 1 = 0 (b) Work on A T : b 4 b 1 = 0 { 2b1 b 2 b 3 = 0 b 1 b 4 = b 1 b 2 b 3 b 4 1 Col(A T ) = span = Row(A) = span{(1201)(0 110)} A T = It implies that the first two columns of A T are linearly indepedent so they can be served as the bases i.e. 1 1 Col(A T ) = span Row(A) = span{(1201)(1111)}. (c) Work on (A T ) T = A: A = Copy right reserved by Yingwei Wang

12 Spring 2018 UW-Madison It follows that the first two rows in the reduced echelon form are the bases for Col(A T ): 1 0 Col(A T ) = span Row(A) = span{(1021)(01 10)}. In addition the dimension of Row(A) is 2 i.e. dim(row(a)) = Null space. We need to solve Ax = A = It indicates that x 3 x 4 are free variables and x 1 x 2 are pivot variables so the bases for null space are 2 1 Null(A) = span In addition the dimension of Null(A) is 2 i.e. dim(null(a)) = Left null space. We need to solve A T x = A T = Copy right reserved by Yingwei Wang

13 Spring 2018 UW-Madison It indicates that x 1 x 2 are pivot variables and x 3 is a free variable so the bases for left null space are 1 Null(A T ) = span 1. 1 In addition the dimension of Null(A T ) is 1 i.e. dim(null(a T )) = 1. Example 4. Find the dimension and bases for four fundamental subspaces of the matrix A = Solution: 1. Column space. I will show three ways to find the bases for Col(A): (a) Work on [A b]: b 1 [A b] = b b b 1 ( 1)R 1 +R 3 R b b 3 b b 1 R 2 R b 3 b b 2 It implies that the only requirement is b 2 = 0. So the column space of A is 1 0 Col(A) = span Copy right reserved by Yingwei Wang

14 Spring 2018 UW-Madison (b) Work on A: A = It indicates that the second and third columns of original matrix A are linearly independent so they can be served as the bases for column space i.e. 1 Col(A) = span (c) Work on A T : A T = R 1 R ( 1)R 1 +R 4 R ( 1)R 1 +R 2 R ( 1)R 2 +R 4 R It implies that the first two rows in the reduced echelon form could be served as the bases i.e. 1 0 Col(A) = span Copy right reserved by Yingwei Wang

15 Spring 2018 UW-Madison In addition the dimension of Col(A) is 2 i.e. dim(col(a)) = Row space. I will show three ways to find the bases for Row(A) = Col(A T ). (a) Work on [A T b]: b 1 [A T b] = b b b b 3 R 1 R b b b b 3 ( 1)R 1 +R 4 R b 2 b 3 ( 1)R 1 +R 2 R b b 4 b b 3 ( 1)R 2 +R 4 R b 2 b b b 4 b 2 In order to guarantee a solution the last two rows should be zeros which means (b) Work on A T : b 1 = 0 b 4 b 2 = Col(A T ) = span Row(A) = span{(0101)(0010)} A T = Copy right reserved by Yingwei Wang

16 Spring 2018 UW-Madison It implies that the first and third columns of A T are linearly indepedent so they can be served as the bases i.e. 0 0 Col(A T ) = span Row(A) = span{(0111)(0101)}. (c) Work on (A T ) T = A: A = It implies that the first two rows of the reduced echelon form could be served as the bases for Col(A T ) i.e. 0 0 Col(A T ) = span Row(A) = span{(0101)(0010)}. In addition the dimension of Row(A) is 2 i.e. dim(row(a)) = Null space. We need to solve Ax = A = It implies that x 2 x 3 are pivot variables and x 1 x 4 are free variables. 1 0 Null(A) = span Copy right reserved by Yingwei Wang

17 Spring 2018 UW-Madison In addition the dimension of Null(A) is 2 i.e. dim(null(a)) = Left null space. We need to solve A T x = A T = It implies that x 1 x 3 are pivot variables and x 2 is a free variable. 0 Null(A T ) = span 1. 0 In addition the dimension of Null(A T ) is 1 i.e. dim(null(a)) = Copy right reserved by Yingwei Wang

Lecture 14: Orthogonality and general vector spaces. 2 Orthogonal vectors, spaces and matrices

Lecture 14: Orthogonality and general vector spaces. 2 Orthogonal vectors, spaces and matrices Lecture 14: Orthogonality and general vector spaces 1 Symmetric matrices Recall the definition of transpose A T in Lecture note 9. Definition 1.1. If a square matrix S satisfies then we say S is a symmetric

More information

Practice Problems for the Final Exam

Practice Problems for the Final Exam Practice Problems for the Final Exam Linear Algebra. Matrix multiplication: (a) Problem 3 in Midterm One. (b) Problem 2 in Quiz. 2. Solve the linear system: (a) Problem 4 in Midterm One. (b) Problem in

More information

Math 123, Week 5: Linear Independence, Basis, and Matrix Spaces. Section 1: Linear Independence

Math 123, Week 5: Linear Independence, Basis, and Matrix Spaces. Section 1: Linear Independence Math 123, Week 5: Linear Independence, Basis, and Matrix Spaces Section 1: Linear Independence Recall that every row on the left-hand side of the coefficient matrix of a linear system A x = b which could

More information

Math 2174: Practice Midterm 1

Math 2174: Practice Midterm 1 Math 74: Practice Midterm Show your work and explain your reasoning as appropriate. No calculators. One page of handwritten notes is allowed for the exam, as well as one blank page of scratch paper.. Consider

More information

Review Notes for Linear Algebra True or False Last Updated: February 22, 2010

Review Notes for Linear Algebra True or False Last Updated: February 22, 2010 Review Notes for Linear Algebra True or False Last Updated: February 22, 2010 Chapter 4 [ Vector Spaces 4.1 If {v 1,v 2,,v n } and {w 1,w 2,,w n } are linearly independent, then {v 1 +w 1,v 2 +w 2,,v n

More information

ICS 6N Computational Linear Algebra Vector Space

ICS 6N Computational Linear Algebra Vector Space ICS 6N Computational Linear Algebra Vector Space Xiaohui Xie University of California, Irvine xhx@uci.edu Xiaohui Xie (UCI) ICS 6N 1 / 24 Vector Space Definition: A vector space is a non empty set V of

More information

MATH 2331 Linear Algebra. Section 2.1 Matrix Operations. Definition: A : m n, B : n p. Example: Compute AB, if possible.

MATH 2331 Linear Algebra. Section 2.1 Matrix Operations. Definition: A : m n, B : n p. Example: Compute AB, if possible. MATH 2331 Linear Algebra Section 2.1 Matrix Operations Definition: A : m n, B : n p ( 1 2 p ) ( 1 2 p ) AB = A b b b = Ab Ab Ab Example: Compute AB, if possible. 1 Row-column rule: i-j-th entry of AB:

More information

Midterm #2 Solutions

Midterm #2 Solutions Naneh Apkarian Math F Winter Midterm # Solutions Here is a solution key for the second midterm. The solutions presented here are more complete and thorough than your responses needed to be - in order to

More information

SUMMARY OF MATH 1600

SUMMARY OF MATH 1600 SUMMARY OF MATH 1600 Note: The following list is intended as a study guide for the final exam. It is a continuation of the study guide for the midterm. It does not claim to be a comprehensive list. You

More information

MTH 362: Advanced Engineering Mathematics

MTH 362: Advanced Engineering Mathematics MTH 362: Advanced Engineering Mathematics Lecture 5 Jonathan A. Chávez Casillas 1 1 University of Rhode Island Department of Mathematics September 26, 2017 1 Linear Independence and Dependence of Vectors

More information

Math 369 Exam #2 Practice Problem Solutions

Math 369 Exam #2 Practice Problem Solutions Math 369 Exam #2 Practice Problem Solutions 2 5. Is { 2, 3, 8 } a basis for R 3? Answer: No, it is not. To show that it is not a basis, it suffices to show that this is not a linearly independent set.

More information

Math 102, Winter 2009, Homework 7

Math 102, Winter 2009, Homework 7 Math 2, Winter 29, Homework 7 () Find the standard matrix of the linear transformation T : R 3 R 3 obtained by reflection through the plane x + z = followed by a rotation about the positive x-axes by 6

More information

MATH2210 Notebook 3 Spring 2018

MATH2210 Notebook 3 Spring 2018 MATH2210 Notebook 3 Spring 2018 prepared by Professor Jenny Baglivo c Copyright 2009 2018 by Jenny A. Baglivo. All Rights Reserved. 3 MATH2210 Notebook 3 3 3.1 Vector Spaces and Subspaces.................................

More information

Practice Final Exam. Solutions.

Practice Final Exam. Solutions. MATH Applied Linear Algebra December 6, 8 Practice Final Exam Solutions Find the standard matrix f the linear transfmation T : R R such that T, T, T Solution: Easy to see that the transfmation T can be

More information

Math 308 Discussion Problems #4 Chapter 4 (after 4.3)

Math 308 Discussion Problems #4 Chapter 4 (after 4.3) Math 38 Discussion Problems #4 Chapter 4 (after 4.3) () (after 4.) Let S be a plane in R 3 passing through the origin, so that S is a two-dimensional subspace of R 3. Say that a linear transformation T

More information

EK102 Linear Algebra PRACTICE PROBLEMS for Final Exam Spring 2016

EK102 Linear Algebra PRACTICE PROBLEMS for Final Exam Spring 2016 EK102 Linear Algebra PRACTICE PROBLEMS for Final Exam Spring 2016 Answer the questions in the spaces provided on the question sheets. You must show your work to get credit for your answers. There will

More information

Math 308 Practice Test for Final Exam Winter 2015

Math 308 Practice Test for Final Exam Winter 2015 Math 38 Practice Test for Final Exam Winter 25 No books are allowed during the exam. But you are allowed one sheet ( x 8) of handwritten notes (back and front). You may use a calculator. For TRUE/FALSE

More information

Kevin James. MTHSC 3110 Section 4.3 Linear Independence in Vector Sp

Kevin James. MTHSC 3110 Section 4.3 Linear Independence in Vector Sp MTHSC 3 Section 4.3 Linear Independence in Vector Spaces; Bases Definition Let V be a vector space and let { v. v 2,..., v p } V. If the only solution to the equation x v + x 2 v 2 + + x p v p = is the

More information

(a) only (ii) and (iv) (b) only (ii) and (iii) (c) only (i) and (ii) (d) only (iv) (e) only (i) and (iii)

(a) only (ii) and (iv) (b) only (ii) and (iii) (c) only (i) and (ii) (d) only (iv) (e) only (i) and (iii) . Which of the following are Vector Spaces? (i) V = { polynomials of the form q(t) = t 3 + at 2 + bt + c : a b c are real numbers} (ii) V = {at { 2 + b : a b are real numbers} } a (iii) V = : a 0 b is

More information

2018 Fall 2210Q Section 013 Midterm Exam II Solution

2018 Fall 2210Q Section 013 Midterm Exam II Solution 08 Fall 0Q Section 0 Midterm Exam II Solution True or False questions points 0 0 points) ) Let A be an n n matrix. If the equation Ax b has at least one solution for each b R n, then the solution is unique

More information

Lecture 3q Bases for Row(A), Col(A), and Null(A) (pages )

Lecture 3q Bases for Row(A), Col(A), and Null(A) (pages ) Lecture 3q Bases for Row(A), Col(A), and Null(A) (pages 57-6) Recall that the basis for a subspace S is a set of vectors that both spans S and is linearly independent. Moreover, we saw in section 2.3 that

More information

LINEAR ALGEBRA REVIEW

LINEAR ALGEBRA REVIEW LINEAR ALGEBRA REVIEW SPENCER BECKER-KAHN Basic Definitions Domain and Codomain. Let f : X Y be any function. This notation means that X is the domain of f and Y is the codomain of f. This means that for

More information

Lecture 22: Section 4.7

Lecture 22: Section 4.7 Lecture 22: Section 47 Shuanglin Shao December 2, 213 Row Space, Column Space, and Null Space Definition For an m n, a 11 a 12 a 1n a 21 a 22 a 2n A = a m1 a m2 a mn, the vectors r 1 = [ a 11 a 12 a 1n

More information

Solutions to Section 2.9 Homework Problems Problems 1 5, 7, 9, 10 15, (odd), and 38. S. F. Ellermeyer June 21, 2002

Solutions to Section 2.9 Homework Problems Problems 1 5, 7, 9, 10 15, (odd), and 38. S. F. Ellermeyer June 21, 2002 Solutions to Section 9 Homework Problems Problems 9 (odd) and 8 S F Ellermeyer June The pictured set contains the vector u but not the vector u so this set is not a subspace of The pictured set contains

More information

Instructions Please answer the five problems on your own paper. These are essay questions: you should write in complete sentences.

Instructions Please answer the five problems on your own paper. These are essay questions: you should write in complete sentences. Instructions Please answer the five problems on your own paper. These are essay questions: you should write in complete sentences.. Recall that P 3 denotes the vector space of polynomials of degree less

More information

Lecture 7: Introduction to linear systems

Lecture 7: Introduction to linear systems Lecture 7: Introduction to linear systems Two pictures of linear systems Consider the following system of linear algebraic equations { x 2y =, 2x+y = 7. (.) Note that it is a linear system with two unknowns

More information

Lecture 11: Vector space and subspace

Lecture 11: Vector space and subspace Lecture : Vector space and subspace Vector space. R n space Definition.. The space R n consists of all column vector v with n real components, i.e. R n = { v : v = [v,v 2,...,v n ] T, v j R,j =,2,...,n

More information

Linear Algebra: Homework 7

Linear Algebra: Homework 7 Linear Algebra: Homework 7 Alvin Lin August 6 - December 6 Section 3.5 Exercise x Let S be the collection of vectors in R y that satisfy the given property. In each case, either prove that S forms a subspace

More information

Math 4A Notes. Written by Victoria Kala Last updated June 11, 2017

Math 4A Notes. Written by Victoria Kala Last updated June 11, 2017 Math 4A Notes Written by Victoria Kala vtkala@math.ucsb.edu Last updated June 11, 2017 Systems of Linear Equations A linear equation is an equation that can be written in the form a 1 x 1 + a 2 x 2 +...

More information

Department of Aerospace Engineering AE602 Mathematics for Aerospace Engineers Assignment No. 4

Department of Aerospace Engineering AE602 Mathematics for Aerospace Engineers Assignment No. 4 Department of Aerospace Engineering AE6 Mathematics for Aerospace Engineers Assignment No.. Decide whether or not the following vectors are linearly independent, by solving c v + c v + c 3 v 3 + c v :

More information

SYMBOL EXPLANATION EXAMPLE

SYMBOL EXPLANATION EXAMPLE MATH 4310 PRELIM I REVIEW Notation These are the symbols we have used in class, leading up to Prelim I, and which I will use on the exam SYMBOL EXPLANATION EXAMPLE {a, b, c, } The is the way to write the

More information

MATH 2030: ASSIGNMENT 4 SOLUTIONS

MATH 2030: ASSIGNMENT 4 SOLUTIONS MATH 23: ASSIGNMENT 4 SOLUTIONS More on the LU factorization Q.: pg 96, q 24. Find the P t LU factorization of the matrix 2 A = 3 2 2 A.. By interchanging row and row 4 we get a matrix that may be easily

More information

2. (10 pts) How many vectors are in the null space of the matrix A = 0 1 1? (i). Zero. (iv). Three. (ii). One. (v).

2. (10 pts) How many vectors are in the null space of the matrix A = 0 1 1? (i). Zero. (iv). Three. (ii). One. (v). Exam 3 MAS 3105 Applied Linear Algebra, Spring 2018 (Clearly!) Print Name: Apr 10, 2018 Read all of what follows carefully before starting! 1. This test has 7 problems and is worth 110 points. Please be

More information

Algorithms to Compute Bases and the Rank of a Matrix

Algorithms to Compute Bases and the Rank of a Matrix Algorithms to Compute Bases and the Rank of a Matrix Subspaces associated to a matrix Suppose that A is an m n matrix The row space of A is the subspace of R n spanned by the rows of A The column space

More information

Dimension and Structure

Dimension and Structure 96 Chapter 7 Dimension and Structure 7.1 Basis and Dimensions Bases for Subspaces Definition 7.1.1. A set of vectors in a subspace V of R n is said to be a basis for V if it is linearly independent and

More information

Shorts

Shorts Math 45 - Midterm Thursday, October 3, 4 Circle your section: Philipp Hieronymi pm 3pm Armin Straub 9am am Name: NetID: UIN: Problem. [ point] Write down the number of your discussion section (for instance,

More information

1. General Vector Spaces

1. General Vector Spaces 1.1. Vector space axioms. 1. General Vector Spaces Definition 1.1. Let V be a nonempty set of objects on which the operations of addition and scalar multiplication are defined. By addition we mean a rule

More information

We see that this is a linear system with 3 equations in 3 unknowns. equation is A x = b, where

We see that this is a linear system with 3 equations in 3 unknowns. equation is A x = b, where Practice Problems Math 35 Spring 7: Solutions. Write the system of equations as a matrix equation and find all solutions using Gauss elimination: x + y + 4z =, x + 3y + z = 5, x + y + 5z = 3. We see that

More information

Cheat Sheet for MATH461

Cheat Sheet for MATH461 Cheat Sheet for MATH46 Here is the stuff you really need to remember for the exams Linear systems Ax = b Problem: We consider a linear system of m equations for n unknowns x,,x n : For a given matrix A

More information

Exam in TMA4110 Calculus 3, June 2013 Solution

Exam in TMA4110 Calculus 3, June 2013 Solution Norwegian University of Science and Technology Department of Mathematical Sciences Page of 8 Exam in TMA4 Calculus 3, June 3 Solution Problem Let T : R 3 R 3 be a linear transformation such that T = 4,

More information

March 27 Math 3260 sec. 56 Spring 2018

March 27 Math 3260 sec. 56 Spring 2018 March 27 Math 3260 sec. 56 Spring 2018 Section 4.6: Rank Definition: The row space, denoted Row A, of an m n matrix A is the subspace of R n spanned by the rows of A. We now have three vector spaces associated

More information

Solutions to Math 51 First Exam April 21, 2011

Solutions to Math 51 First Exam April 21, 2011 Solutions to Math 5 First Exam April,. ( points) (a) Give the precise definition of a (linear) subspace V of R n. (4 points) A linear subspace V of R n is a subset V R n which satisfies V. If x, y V then

More information

MAT 242 CHAPTER 4: SUBSPACES OF R n

MAT 242 CHAPTER 4: SUBSPACES OF R n MAT 242 CHAPTER 4: SUBSPACES OF R n JOHN QUIGG 1. Subspaces Recall that R n is the set of n 1 matrices, also called vectors, and satisfies the following properties: x + y = y + x x + (y + z) = (x + y)

More information

Matrix invertibility. Rank-Nullity Theorem: For any n-column matrix A, nullity A +ranka = n

Matrix invertibility. Rank-Nullity Theorem: For any n-column matrix A, nullity A +ranka = n Matrix invertibility Rank-Nullity Theorem: For any n-column matrix A, nullity A +ranka = n Corollary: Let A be an R C matrix. Then A is invertible if and only if R = C and the columns of A are linearly

More information

LECTURES 14/15: LINEAR INDEPENDENCE AND BASES

LECTURES 14/15: LINEAR INDEPENDENCE AND BASES LECTURES 14/15: LINEAR INDEPENDENCE AND BASES MA1111: LINEAR ALGEBRA I, MICHAELMAS 2016 1. Linear Independence We have seen in examples of span sets of vectors that sometimes adding additional vectors

More information

The definition of a vector space (V, +, )

The definition of a vector space (V, +, ) The definition of a vector space (V, +, ) 1. For any u and v in V, u + v is also in V. 2. For any u and v in V, u + v = v + u. 3. For any u, v, w in V, u + ( v + w) = ( u + v) + w. 4. There is an element

More information

1 Systems of equations

1 Systems of equations Highlights from linear algebra David Milovich, Math 2 TA for sections -6 November, 28 Systems of equations A leading entry in a matrix is the first (leftmost) nonzero entry of a row. For example, the leading

More information

Last lecture: linear combinations and spanning sets. Let X = {x 1, x 2,..., x k } be a set of vectors in a vector

Last lecture: linear combinations and spanning sets. Let X = {x 1, x 2,..., x k } be a set of vectors in a vector Last lecture: linear combinations and spanning sets Let X = { k } be a set of vectors in a vector space V A linear combination of k is any vector of the form r + r + + r k k V for r + r + + r k k for scalars

More information

MATH 2050 Assignment 6 Fall 2018 Due: Thursday, November 1. x + y + 2z = 2 x + y + z = c 4x + 2z = 2

MATH 2050 Assignment 6 Fall 2018 Due: Thursday, November 1. x + y + 2z = 2 x + y + z = c 4x + 2z = 2 MATH 5 Assignment 6 Fall 8 Due: Thursday, November [5]. For what value of c does have a solution? Is it unique? x + y + z = x + y + z = c 4x + z = Writing the system as an augmented matrix, we have c R

More information

Row Space, Column Space, and Nullspace

Row Space, Column Space, and Nullspace Row Space, Column Space, and Nullspace MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 2015 Introduction Every matrix has associated with it three vector spaces: row space

More information

Math 544, Exam 2 Information.

Math 544, Exam 2 Information. Math 544, Exam 2 Information. 10/12/10, LC 115, 2:00-3:15. Exam 2 will be based on: Sections 1.7, 1.9, 3.2, 3.3, 3.4; The corresponding assigned homework problems (see http://www.math.sc.edu/ boylan/sccourses/544fa10/544.html)

More information

ANALYTICAL MATHEMATICS FOR APPLICATIONS 2018 LECTURE NOTES 3

ANALYTICAL MATHEMATICS FOR APPLICATIONS 2018 LECTURE NOTES 3 ANALYTICAL MATHEMATICS FOR APPLICATIONS 2018 LECTURE NOTES 3 ISSUED 24 FEBRUARY 2018 1 Gaussian elimination Let A be an (m n)-matrix Consider the following row operations on A (1) Swap the positions any

More information

Third Midterm Exam Name: Practice Problems November 11, Find a basis for the subspace spanned by the following vectors.

Third Midterm Exam Name: Practice Problems November 11, Find a basis for the subspace spanned by the following vectors. Math 7 Treibergs Third Midterm Exam Name: Practice Problems November, Find a basis for the subspace spanned by the following vectors,,, We put the vectors in as columns Then row reduce and choose the pivot

More information

Math 54 First Midterm Exam, Prof. Srivastava September 23, 2016, 4:10pm 5:00pm, 155 Dwinelle Hall.

Math 54 First Midterm Exam, Prof. Srivastava September 23, 2016, 4:10pm 5:00pm, 155 Dwinelle Hall. Math 54 First Midterm Exam, Prof Srivastava September 23, 26, 4:pm 5:pm, 55 Dwinelle Hall Name: SID: Instructions: Write all answers in the provided space This exam includes two pages of scratch paper,

More information

Solutions to Final Practice Problems Written by Victoria Kala Last updated 12/5/2015

Solutions to Final Practice Problems Written by Victoria Kala Last updated 12/5/2015 Solutions to Final Practice Problems Written by Victoria Kala vtkala@math.ucsb.edu Last updated /5/05 Answers This page contains answers only. See the following pages for detailed solutions. (. (a x. See

More information

A First Course in LINEAR ALGEBRA An Open Text. by Ken Kuttler. Adapted for YORK UNIVERSITY. MATH 2022 LINEAR ALGEBRA II All Sections WINTER 2017

A First Course in LINEAR ALGEBRA An Open Text. by Ken Kuttler. Adapted for YORK UNIVERSITY. MATH 2022 LINEAR ALGEBRA II All Sections WINTER 2017 with Open Texts A First Course in LINEAR ALGEBRA An Open Text by Ken Kuttler Adapted for YORK UNIVERSITY MATH LINEAR ALGEBRA II All Sections WINTER 7 Creative Commons License (CC BY) advancing learning

More information

(c)

(c) 1. Find the reduced echelon form of the matrix 1 1 5 1 8 5. 1 1 1 (a) 3 1 3 0 1 3 1 (b) 0 0 1 (c) 3 0 0 1 0 (d) 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 (e) 1 0 5 0 0 1 3 0 0 0 0 Solution. 1 1 1 1 1 1 1 1

More information

Math 323 Exam 2 Sample Problems Solution Guide October 31, 2013

Math 323 Exam 2 Sample Problems Solution Guide October 31, 2013 Math Exam Sample Problems Solution Guide October, Note that the following provides a guide to the solutions on the sample problems, but in some cases the complete solution would require more work or justification

More information

7. Dimension and Structure.

7. Dimension and Structure. 7. Dimension and Structure 7.1. Basis and Dimension Bases for Subspaces Example 2 The standard unit vectors e 1, e 2,, e n are linearly independent, for if we write (2) in component form, then we obtain

More information

MATH 2210Q MIDTERM EXAM I PRACTICE PROBLEMS

MATH 2210Q MIDTERM EXAM I PRACTICE PROBLEMS MATH Q MIDTERM EXAM I PRACTICE PROBLEMS Date and place: Thursday, November, 8, in-class exam Section : : :5pm at MONT Section : 9: :5pm at MONT 5 Material: Sections,, 7 Lecture 9 8, Quiz, Worksheet 9 8,

More information

Solutions to Exam I MATH 304, section 6

Solutions to Exam I MATH 304, section 6 Solutions to Exam I MATH 304, section 6 YOU MUST SHOW ALL WORK TO GET CREDIT. Problem 1. Let A = 1 2 5 6 1 2 5 6 3 2 0 0 1 3 1 1 2 0 1 3, B =, C =, I = I 0 0 0 1 1 3 4 = 4 4 identity matrix. 3 1 2 6 0

More information

b 1 b 2.. b = b m A = [a 1,a 2,...,a n ] where a 1,j a 2,j a j = a m,j Let A R m n and x 1 x 2 x = x n

b 1 b 2.. b = b m A = [a 1,a 2,...,a n ] where a 1,j a 2,j a j = a m,j Let A R m n and x 1 x 2 x = x n Lectures -2: Linear Algebra Background Almost all linear and nonlinear problems in scientific computation require the use of linear algebra These lectures review basic concepts in a way that has proven

More information

PRACTICE PROBLEMS FOR THE FINAL

PRACTICE PROBLEMS FOR THE FINAL PRACTICE PROBLEMS FOR THE FINAL Here are a slew of practice problems for the final culled from old exams:. Let P be the vector space of polynomials of degree at most. Let B = {, (t ), t + t }. (a) Show

More information

Matrix Algebra for Engineers Jeffrey R. Chasnov

Matrix Algebra for Engineers Jeffrey R. Chasnov Matrix Algebra for Engineers Jeffrey R. Chasnov The Hong Kong University of Science and Technology The Hong Kong University of Science and Technology Department of Mathematics Clear Water Bay, Kowloon

More information

The Fundamental Theorem of Linear Algebra

The Fundamental Theorem of Linear Algebra The Fundamental Theorem of Linear Algebra Nicholas Hoell Contents 1 Prelude: Orthogonal Complements 1 2 The Fundamental Theorem of Linear Algebra 2 2.1 The Diagram........................................

More information

DS-GA 1002 Lecture notes 10 November 23, Linear models

DS-GA 1002 Lecture notes 10 November 23, Linear models DS-GA 2 Lecture notes November 23, 2 Linear functions Linear models A linear model encodes the assumption that two quantities are linearly related. Mathematically, this is characterized using linear functions.

More information

Math 54 HW 4 solutions

Math 54 HW 4 solutions Math 54 HW 4 solutions 2.2. Section 2.2 (a) False: Recall that performing a series of elementary row operations A is equivalent to multiplying A by a series of elementary matrices. Suppose that E,...,

More information

x 1 + 2x 2 + 3x 3 = 0 x 1 + 2x 2 + 3x 3 = 0, x 2 + x 3 = 0 x 3 3 x 3 1

x 1 + 2x 2 + 3x 3 = 0 x 1 + 2x 2 + 3x 3 = 0, x 2 + x 3 = 0 x 3 3 x 3 1 . Orthogonal Complements and Projections In this section we discuss orthogonal complements and orthogonal projections. The orthogonal complement of a subspace S is the complement that is orthogonal to

More information

Math 314/814 Topics for first exam

Math 314/814 Topics for first exam Chapter 2: Systems of linear equations Math 314/814 Topics for first exam Some examples Systems of linear equations: 2x 3y z = 6 3x + 2y + z = 7 Goal: find simultaneous solutions: all x, y, z satisfying

More information

Vector space and subspace

Vector space and subspace Vector space and subspace Math 112, week 8 Goals: Vector space, subspace, span. Null space, column space. Linearly independent, bases. Suggested Textbook Readings: Sections 4.1, 4.2, 4.3 Week 8: Vector

More information

Typical Problem: Compute.

Typical Problem: Compute. Math 2040 Chapter 6 Orhtogonality and Least Squares 6.1 and some of 6.7: Inner Product, Length and Orthogonality. Definition: If x, y R n, then x y = x 1 y 1 +... + x n y n is the dot product of x and

More information

ELE/MCE 503 Linear Algebra Facts Fall 2018

ELE/MCE 503 Linear Algebra Facts Fall 2018 ELE/MCE 503 Linear Algebra Facts Fall 2018 Fact N.1 A set of vectors is linearly independent if and only if none of the vectors in the set can be written as a linear combination of the others. Fact N.2

More information

Chapter 3. Directions: For questions 1-11 mark each statement True or False. Justify each answer.

Chapter 3. Directions: For questions 1-11 mark each statement True or False. Justify each answer. Chapter 3 Directions: For questions 1-11 mark each statement True or False. Justify each answer. 1. (True False) Asking whether the linear system corresponding to an augmented matrix [ a 1 a 2 a 3 b ]

More information

2. Every linear system with the same number of equations as unknowns has a unique solution.

2. Every linear system with the same number of equations as unknowns has a unique solution. 1. For matrices A, B, C, A + B = A + C if and only if A = B. 2. Every linear system with the same number of equations as unknowns has a unique solution. 3. Every linear system with the same number of equations

More information

Lecture 10: Determinants and Cramer s Rule

Lecture 10: Determinants and Cramer s Rule Lecture 0: Determinants and Cramer s Rule The determinant and its applications. Definition The determinant of a square matrix A, denoted by det(a) or A, is a real number, which is defined as follows. -by-

More information

1 Last time: linear systems and row operations

1 Last time: linear systems and row operations 1 Last time: linear systems and row operations Here s what we did last time: a system of linear equations or linear system is a list of equations a 11 x 1 + a 12 x 2 + + a 1n x n = b 1 a 21 x 1 + a 22

More information

Midterm 1 Solutions Math Section 55 - Spring 2018 Instructor: Daren Cheng

Midterm 1 Solutions Math Section 55 - Spring 2018 Instructor: Daren Cheng Midterm 1 Solutions Math 20250 Section 55 - Spring 2018 Instructor: Daren Cheng #1 Do the following problems using row reduction. (a) (6 pts) Let A = 2 1 2 6 1 3 8 17 3 5 4 5 Find bases for N A and R A,

More information

Worksheet for Lecture 15 (due October 23) Section 4.3 Linearly Independent Sets; Bases

Worksheet for Lecture 15 (due October 23) Section 4.3 Linearly Independent Sets; Bases Worksheet for Lecture 5 (due October 23) Name: Section 4.3 Linearly Independent Sets; Bases Definition An indexed set {v,..., v n } in a vector space V is linearly dependent if there is a linear relation

More information

Topics. Vectors (column matrices): Vector addition and scalar multiplication The matrix of a linear function y Ax The elements of a matrix A : A ij

Topics. Vectors (column matrices): Vector addition and scalar multiplication The matrix of a linear function y Ax The elements of a matrix A : A ij Topics Vectors (column matrices): Vector addition and scalar multiplication The matrix of a linear function y Ax The elements of a matrix A : A ij or a ij lives in row i and column j Definition of a matrix

More information

Math Linear algebra, Spring Semester Dan Abramovich

Math Linear algebra, Spring Semester Dan Abramovich Math 52 0 - Linear algebra, Spring Semester 2012-2013 Dan Abramovich Fields. We learned to work with fields of numbers in school: Q = fractions of integers R = all real numbers, represented by infinite

More information

MATH 152 Exam 1-Solutions 135 pts. Write your answers on separate paper. You do not need to copy the questions. Show your work!!!

MATH 152 Exam 1-Solutions 135 pts. Write your answers on separate paper. You do not need to copy the questions. Show your work!!! MATH Exam -Solutions pts Write your answers on separate paper. You do not need to copy the questions. Show your work!!!. ( pts) Find the reduced row echelon form of the matrix Solution : 4 4 6 4 4 R R

More information

Math 3191 Applied Linear Algebra

Math 3191 Applied Linear Algebra Math 191 Applied Linear Algebra Lecture 16: Change of Basis Stephen Billups University of Colorado at Denver Math 191Applied Linear Algebra p.1/0 Rank The rank of A is the dimension of the column space

More information

Worksheet for Lecture 15 (due October 23) Section 4.3 Linearly Independent Sets; Bases

Worksheet for Lecture 15 (due October 23) Section 4.3 Linearly Independent Sets; Bases Worksheet for Lecture 5 (due October 23) Name: Section 4.3 Linearly Independent Sets; Bases Definition An indexed set {v,..., v n } in a vector space V is linearly dependent if there is a linear relation

More information

18.06 Problem Set 3 Solution Due Wednesday, 25 February 2009 at 4 pm in Total: 160 points.

18.06 Problem Set 3 Solution Due Wednesday, 25 February 2009 at 4 pm in Total: 160 points. 8.6 Problem Set 3 Solution Due Wednesday, 25 February 29 at 4 pm in 2-6. Total: 6 points. Problem : Consider the matrix A = 2 4 2 6 3 4 2 7 (a) Reduce A to echelon form U, find a special solution for each

More information

AMS526: Numerical Analysis I (Numerical Linear Algebra)

AMS526: Numerical Analysis I (Numerical Linear Algebra) AMS526: Numerical Analysis I (Numerical Linear Algebra) Lecture 1: Course Overview & Matrix-Vector Multiplication Xiangmin Jiao SUNY Stony Brook Xiangmin Jiao Numerical Analysis I 1 / 20 Outline 1 Course

More information

INVERSE OF A MATRIX [2.2]

INVERSE OF A MATRIX [2.2] INVERSE OF A MATRIX [2.2] The inverse of a matrix: Introduction We have a mapping from R n to R n represented by a matrix A. Can we invert this mapping? i.e. can we find a matrix (call it B for now) such

More information

Math Final December 2006 C. Robinson

Math Final December 2006 C. Robinson Math 285-1 Final December 2006 C. Robinson 2 5 8 5 1 2 0-1 0 1. (21 Points) The matrix A = 1 2 2 3 1 8 3 2 6 has the reduced echelon form U = 0 0 1 2 0 0 0 0 0 1. 2 6 1 0 0 0 0 0 a. Find a basis for the

More information

Overview. Motivation for the inner product. Question. Definition

Overview. Motivation for the inner product. Question. Definition Overview Last time we studied the evolution of a discrete linear dynamical system, and today we begin the final topic of the course (loosely speaking) Today we ll recall the definition and properties of

More information

Math 51, Homework-2. Section numbers are from the course textbook.

Math 51, Homework-2. Section numbers are from the course textbook. SSEA Summer 2017 Math 51, Homework-2 Section numbers are from the course textbook. 1. Write the parametric equation of the plane that contains the following point and line: 1 1 1 3 2, 4 2 + t 3 0 t R.

More information

We showed that adding a vector to a basis produces a linearly dependent set of vectors; more is true.

We showed that adding a vector to a basis produces a linearly dependent set of vectors; more is true. Dimension We showed that adding a vector to a basis produces a linearly dependent set of vectors; more is true. Lemma If a vector space V has a basis B containing n vectors, then any set containing more

More information

x = t 1 x 1 + t 2 x t k x k

x = t 1 x 1 + t 2 x t k x k Def.: Given vectors x,...,x k in R n, the set of all their linear combinations is called their span, and is denoted by span(x,...,x k ) Thm.: span(x,...,x k ) is a subspace of R n Def.: If V is a subspace

More information

Rank and Nullity. MATH 322, Linear Algebra I. J. Robert Buchanan. Spring Department of Mathematics

Rank and Nullity. MATH 322, Linear Algebra I. J. Robert Buchanan. Spring Department of Mathematics Rank and Nullity MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 2015 Objectives We have defined and studied the important vector spaces associated with matrices (row space,

More information

spring, math 204 (mitchell) list of theorems 1 Linear Systems Linear Transformations Matrix Algebra

spring, math 204 (mitchell) list of theorems 1 Linear Systems Linear Transformations Matrix Algebra spring, 2016. math 204 (mitchell) list of theorems 1 Linear Systems THEOREM 1.0.1 (Theorem 1.1). Uniqueness of Reduced Row-Echelon Form THEOREM 1.0.2 (Theorem 1.2). Existence and Uniqueness Theorem THEOREM

More information

Linear Algebra Exam 1 Spring 2007

Linear Algebra Exam 1 Spring 2007 Linear Algebra Exam 1 Spring 2007 March 15, 2007 Name: SOLUTION KEY (Total 55 points, plus 5 more for Pledged Assignment.) Honor Code Statement: Directions: Complete all problems. Justify all answers/solutions.

More information

MTH 35, SPRING 2017 NIKOS APOSTOLAKIS

MTH 35, SPRING 2017 NIKOS APOSTOLAKIS MTH 35, SPRING 2017 NIKOS APOSTOLAKIS 1. Linear independence Example 1. Recall the set S = {a i : i = 1,...,5} R 4 of the last two lectures, where a 1 = (1,1,3,1) a 2 = (2,1,2, 1) a 3 = (7,3,5, 5) a 4

More information

Linear Algebra. Grinshpan

Linear Algebra. Grinshpan Linear Algebra Grinshpan Saturday class, 2/23/9 This lecture involves topics from Sections 3-34 Subspaces associated to a matrix Given an n m matrix A, we have three subspaces associated to it The column

More information

Introduction to Mathematical Programming IE406. Lecture 3. Dr. Ted Ralphs

Introduction to Mathematical Programming IE406. Lecture 3. Dr. Ted Ralphs Introduction to Mathematical Programming IE406 Lecture 3 Dr. Ted Ralphs IE406 Lecture 3 1 Reading for This Lecture Bertsimas 2.1-2.2 IE406 Lecture 3 2 From Last Time Recall the Two Crude Petroleum example.

More information

What is on this week. 1 Vector spaces (continued) 1.1 Null space and Column Space of a matrix

What is on this week. 1 Vector spaces (continued) 1.1 Null space and Column Space of a matrix Professor Joana Amorim, jamorim@bu.edu What is on this week Vector spaces (continued). Null space and Column Space of a matrix............................. Null Space...........................................2

More information

Math 18, Linear Algebra, Lecture C00, Spring 2017 Review and Practice Problems for Final Exam

Math 18, Linear Algebra, Lecture C00, Spring 2017 Review and Practice Problems for Final Exam Math 8, Linear Algebra, Lecture C, Spring 7 Review and Practice Problems for Final Exam. The augmentedmatrix of a linear system has been transformed by row operations into 5 4 8. Determine if the system

More information

Solution of Linear Equations

Solution of Linear Equations Solution of Linear Equations (Com S 477/577 Notes) Yan-Bin Jia Sep 7, 07 We have discussed general methods for solving arbitrary equations, and looked at the special class of polynomial equations A subclass

More information