Linear Maps and Matrices

Size: px
Start display at page:

Download "Linear Maps and Matrices"

Transcription

1 Linear Maps and Matrices Maps Suppose that V and W are sets A map F : V W is a function; that is, to every v V there is assigned a unique element w F v in W Two maps F : V W and G : V W are equal if F v Gv for all v V An important operation on maps is composition, which plays a major role in linear maps Suppose that G : W X is a map The composition G F : V X is defined by for v V Linear maps G F v GF v Definition Suppose that V and W are vector spaces A map L : V W is linear if: Suppose that v, v V Then Suppose that v V and c R Then L v + v L v + L v Lc v cl v Theorem Suppose that L : V W is a linear map Then L V W, L v L v for v V, Suppose that v,, v n V and c,, c n R Then Lc v + + c n v n c L v + c L v + + c n L v n Example Determine if the map L : R R defined by x x + x L x x + 6x for is linear x x R Solution: L is linear Suppose that v y + z Lv + v L y + z y y and v z z R y + z + y + z y + z + 6y + z y + y z + z + Lv y + 6y z + 6z + Lv y + y + z + z y + 6y + z + 6z

2 Suppose that Thus L is a linear map v cy Lcv L cy cy + y cy + 6y y y R and c R cy + cy cy + 6cy c y + y clv y + 6y To show that a map is not linear, we must give specific vectors or scalars which give a counterexample to or of the definition of a linear map Example Determine if L : R R defined by Lx, x x, x for x, x R is a linear map Solution: L is not linear Let v, and c Then which is not equal to clv L,,, Lcv L,,, Thus of the definition of a linear map does not hold for L Recall that C i [a, b] is the vector space of i times continuously differentiable functions on the closed interval [a, b] By the rules of calculus, the map S : C i [a, b] R defined by Sf b a fdx for f C i [a, b] is a linear map and D : C i+ [a, b] C i [a, b] defined by is a linear map Df df dx for f Ci+ [a, b] Suppose that L : V W is a linear map The Kernel of L is The Image of L is KernelL { v V L v W } ImageL {L v v V } KernelL is a subspace of V and ImageL is a subspace of W Linear maps from R n to R m Suppose that A R m n is an m n matrix Then we have a linear map L A : R n R m, defined by L A x A x for x R n In fact, the maps of this type are the only linear maps from R n to R m

3 Example Let A Then the linear map L A : R R satisfies L A x x A x x x x for x x x x x x R x + x + x x + x + x Theorem 6 Suppose that L : R n R m is a linear map Then there is a unique m n matrix A such that L L A Proof We will prove the existence of such a matrix A Set For x x,, x n T R n, we have A Le, Le,, Le n L x Lx e + x e + + x n e n x Le + x Le + + x n Le n since L is linear, Le, Le,, Le n x A x L A x L L A since L x L A x for all x R n Definition 7 Suppose that L : R n R m is a linear map The m n matrix A Le,, Le n which has the property that L L A is called the matrix of L Example 8 Let L : R R be defined by L x x x + x + x x x + x + x for The matrix of L is A L, L x x x, L R Example verifies the calculation of Example 8 It is not difficult to compute bases of the Kernel and Image of a linear map from R n into R m, since we have the following identities:

4 KernelL A NA and ImageL A Column SpaceA Example 9 Find bases of the kernel and image of the linear map L : R R defined by x x + x L x x + 6x for x x R Compute the dimension of the kernel of L and the image of L Solution: The matrix of L is A Le, Le We compute that the RRE form of A is Since the only leading one is in the first column, { } 6 is a basis of ImageL Column SpaceA by the Algorithm to refine the columns of a matrix to a basis of its column space of Lecture Note 6, and dim ImageL To find a basis of NA, we write x t x t with t R Thus { t is a basis of NA KernelL by the Algorithm to compute a basis of a null space of a matrix of Lecture Note 6, and dim KernelL Suppose that L A : R n R m and L B : R m R l Then the composition L B L A : R n R l, defined by L B L A v L B L A v for v R n satisfies } L B L A L BA where BA is the l n matrix obtained by multiplying the l m matrix B and the m n matrix A Distance preserving linear maps

5 Example Given an angle θ, Let cosθ sinθ R θ sinθ cosθ L Rθ : R R is the linear map which rotates a vector v R counterclockwise about the origin by the angle θ Example Let A L A : R R is the linear map which reflects a vector v R about the x-axis Recall that the length of a vector is v x + x v x x R Theorem Page 7 of M Artin s Algebra, first edition The linear maps L : R R which preserve length L v v for all v R are the rotations Example and reflections about a line through the origin Volume Suppose that v,, v n R n Let P {t v + + t n v n t,, t n R and t i for i n} P is the box spanned by v,, v n Suppose that L L A : R n R n is a linear map Then LP is the box spanned by Lv,, Lv n We compare the volumes of P and LP by the formula vollp DetA volp To prove this, we use the formula for computing the volume of P using a determinant from Lecture Note, the fact that determinant preserves matrix multiplication and the formulas for matrix multiplication from the beginning of Lecture Note to calculate vollp DetLv, Lv,, Lv n DetAv, Av,, Av n DetAv,, v n DetADetv,, v n DetA volp If we further assume that L L A is distance preserving, then we can calculate that DetA ±, so that vollp volp Inverses of linear maps A map F : S T is - if for all p, q S, F p F q implies p q If F is linear, then F is - if and only if KernelF { S }

6 If F is -, then S is the only element which can map to T Suppose that KernelF { S }, and p, q S are such that F p F q Then F p q F p F q W so p q KernelF, and p q V Thus p q A map F : S T is onto if for all v T, there exists q S such that F p q If F is linear, then F is onto if and only if ImageF T In Example 9, we computed that ImageL R so L is not onto and KernelL { } so L is not - A map F : S T is invertible if there exists a map G : T S such that G F is the identity map id S on S and F G is the identity map id T on T ; that is, GF x x for all x S and F Gy y for all y T A map F is invertible if and only if F is - and onto If F is invertible then the map G is unique We will write G F and say that G is the inverse of F Theorem Suppose that L : V W is a linear map which is - and onto Then the inverse map L : W V is a linear map A - and onto linear map L : V W is called an isomorphism Theorem Suppose that A is an m n matrix Then the linear map L A : R n R m is an isomorphism if and only if n m and DetA If L A is an isomorphism, then the inverse map of L A is L A L A, where A is the inverse matrix of A Vector spaces V and W are called isomorphic if there exists an isomorphism L : V W Isomorphic vector spaces are indistinguishable as vector spaces Theorem Suppose that V is an n-dimensional vector space Then V is isomorphic to R n Let {v,, v n } be a basis of V Theorem is proven by showing that the map ϕ : V R n defined by ϕ v v is an isomorphism of vector spaces The inverse map ϕ : R n V is ϕ x x n x v + + x n v n These isomorphisms are useful in understanding the algorithm of the next section The matrix of a linear map with respect to a given basis Suppose that F : V W is a linear map Let {v,, v n } be a basis of V, and {w,, w m } be a basis of W The matrix M F of the linear map F with respect to the bases of V and of W is the unique m n matrix M F which has the property that M F v F v 6

7 for all v V It follows that M F F v, F v,, F v n The matrix of a linear map L : R n R m, defined after Theorem 6 as A Le,, Le n, is then the the matrix of L with respect to the standard bases of R n and R m The relationship between F and L M F is shown in the following diagram; the vertical arrows are isomorphisms identifying V with R n and W with R m respectively V ϕ R n F L M F W ϕ R m Often it is best to compute M F directly from This works particularly well when is a basis such as a standard basis in which it is easy to compute coordinate vectors The computation of M F directly from is done by solving for the coefficients of the matrix A a ij in the system of equations to get F v a w + a w + + a m w m F v a w + a w + + a m w m F v n a n w + a n w + + a nm w m M F A T After finding the matrix of a linear map F, bases of the Kernel of F and Image of F can be computed from formulas and Example 6 Let U span, cosx, sinx C, where C is the vector space of infinitely differentiable functions, and let D : U U be differentiation, cosx, sinx are linearly independent by the Wronskian criterion of Lecture Note, and so {, cosx, sinx} is a basis of U Compute the matrix M D using equation Find a basis of the Kernel of D Find a basis of the Image of D Solution: We have D + cosx + sinx Dcosx sinx + cosx + sinx Dsinx cosx + cosx + sinx 7

8 Thus M D D, Dcos x, Dsin x The RRE form of M D is Writing with t R, we see that x x x t t is a basis of KernelL M D NM D by the algorithm to compute a basis of a null space of Lecture Note 6 Thus {} is a basis of the kernel of D, since Since the second and third columns of the RRE form of M D have leading ones, a basis of Column SpaceM D ImageL M D is, by the Algorithm to refine the columns of a matrix to a basis of its column space of Lecture Note 6 so a basis of the image of D is since sinx { sinx, cosx} and cosx If F is the identity map id so that V W, then M id is the transition matrix M defined in Lecture Note 6 Suppose that G : W X is a linear map, and is a basis of X We have a linear map G F : V X We have the important formula 8

9 6 M G F M GM F A particularly important application of this formula is 7 M F M id V M F M id V S M F S, where F : V V is linear, and are bases of V, S M and S M Definition 7 Suppose that A and B are n n matrices B is similar to A if there exists an invertible n n matrix S such that B S AS We have the following result which generalizes the criterion of Theorem Theorem 8 Suppose that L : V W is a linear map of finite dimensional vector spaces, is a basis of V and is a basis of W Then L is invertible if and only if dim V dim W and DetM L If L is invertible, then M L M L Theorem 9 Suppose that V and W are finite dimensional vector spaces and L : V W is a linear map Then dimkernell + dimimagel dimv Proof Let n be the dimension of V and m be the dimension of W Let be a basis of V and be a basis of W Let A M L be the matrix of L with respect to the bases and A is an m n matrix We have that the nullity of A is the dimension of the Kernel of L Taking the coordinate vector with respect to is an isomorphism of the Kernel of L and the null space NA and the rank of A is the dimension of the Image of L Taking the coordinate vector with respect to is an isomorphism of the Image of L and the column space of A Now by the rank nullity theorem we have that dimv n ranka + nullitya dimimagel + dimkernell An Algorithm to compute the matrix of a linear map with respect to given bases Let F : V W be a linear map, and suppose that {v,, v n } is a basis of V and {w,, w m } is a basis of W Let be a basis of W which is easy to compute with such as a standard basis of W The m m + n matrix w, w,, w m F v,, F v n is transformed by elementary row operations into the reduced row echelon form I m M F Example Let L L A : R R be the linear map where A 9

10 Find the matrix M L where { v, v } and { w, w } Use your answer to part to compute L v if v Solution: We compute Lv L and We form the matrix Lv L w w Lv Lv which has the RRE form Thus M L solving part To solve part we compute L v M L v, Example Let L : P P be the linear map defined by Lc + c x c + c + c + c x for c + c x P Compute M L where {v + x, v + x} and {w + x, w x} Solution: The standard basis of P is {, x} We compute and Lv L + x x + 6x taking c, c Lv L + x x + 8x taking c, c We form the matrix w w Lv Lv 6 8

11 which has the RRE form so M L

Algorithms to Compute Bases and the Rank of a Matrix

Algorithms to Compute Bases and the Rank of a Matrix Algorithms to Compute Bases and the Rank of a Matrix Subspaces associated to a matrix Suppose that A is an m n matrix The row space of A is the subspace of R n spanned by the rows of A The column space

More information

Math 323 Exam 2 Sample Problems Solution Guide October 31, 2013

Math 323 Exam 2 Sample Problems Solution Guide October 31, 2013 Math Exam Sample Problems Solution Guide October, Note that the following provides a guide to the solutions on the sample problems, but in some cases the complete solution would require more work or justification

More information

Math 313 Chapter 5 Review

Math 313 Chapter 5 Review Math 313 Chapter 5 Review Howard Anton, 9th Edition May 2010 Do NOT write on me! Contents 1 5.1 Real Vector Spaces 2 2 5.2 Subspaces 3 3 5.3 Linear Independence 4 4 5.4 Basis and Dimension 5 5 5.5 Row

More information

LINEAR ALGEBRA REVIEW

LINEAR ALGEBRA REVIEW LINEAR ALGEBRA REVIEW SPENCER BECKER-KAHN Basic Definitions Domain and Codomain. Let f : X Y be any function. This notation means that X is the domain of f and Y is the codomain of f. This means that for

More information

MAT Linear Algebra Collection of sample exams

MAT Linear Algebra Collection of sample exams MAT 342 - Linear Algebra Collection of sample exams A-x. (0 pts Give the precise definition of the row echelon form. 2. ( 0 pts After performing row reductions on the augmented matrix for a certain system

More information

MATH 315 Linear Algebra Homework #1 Assigned: August 20, 2018

MATH 315 Linear Algebra Homework #1 Assigned: August 20, 2018 Homework #1 Assigned: August 20, 2018 Review the following subjects involving systems of equations and matrices from Calculus II. Linear systems of equations Converting systems to matrix form Pivot entry

More information

The definition of a vector space (V, +, )

The definition of a vector space (V, +, ) The definition of a vector space (V, +, ) 1. For any u and v in V, u + v is also in V. 2. For any u and v in V, u + v = v + u. 3. For any u, v, w in V, u + ( v + w) = ( u + v) + w. 4. There is an element

More information

MATH 240 Spring, Chapter 1: Linear Equations and Matrices

MATH 240 Spring, Chapter 1: Linear Equations and Matrices MATH 240 Spring, 2006 Chapter Summaries for Kolman / Hill, Elementary Linear Algebra, 8th Ed. Sections 1.1 1.6, 2.1 2.2, 3.2 3.8, 4.3 4.5, 5.1 5.3, 5.5, 6.1 6.5, 7.1 7.2, 7.4 DEFINITIONS Chapter 1: Linear

More information

MATH 167: APPLIED LINEAR ALGEBRA Chapter 2

MATH 167: APPLIED LINEAR ALGEBRA Chapter 2 MATH 167: APPLIED LINEAR ALGEBRA Chapter 2 Jesús De Loera, UC Davis February 1, 2012 General Linear Systems of Equations (2.2). Given a system of m equations and n unknowns. Now m n is OK! Apply elementary

More information

Math 480 The Vector Space of Differentiable Functions

Math 480 The Vector Space of Differentiable Functions Math 480 The Vector Space of Differentiable Functions The vector space of differentiable functions. Let C (R) denote the set of all infinitely differentiable functions f : R R. Then C (R) is a vector space,

More information

Linear Algebra. and

Linear Algebra. and Instructions Please answer the six problems on your own paper. These are essay questions: you should write in complete sentences. 1. Are the two matrices 1 2 2 1 3 5 2 7 and 1 1 1 4 4 2 5 5 2 row equivalent?

More information

Eigenvalues and Eigenvectors A =

Eigenvalues and Eigenvectors A = Eigenvalues and Eigenvectors Definition 0 Let A R n n be an n n real matrix A number λ R is a real eigenvalue of A if there exists a nonzero vector v R n such that A v = λ v The vector v is called an eigenvector

More information

Row Space and Column Space of a Matrix

Row Space and Column Space of a Matrix Row Space and Column Space of a Matrix 1/18 Summary: To a m n matrix A = (a ij ), we can naturally associate subspaces of K n and of K m, called the row space of A and the column space of A, respectively.

More information

MATH 323 Linear Algebra Lecture 12: Basis of a vector space (continued). Rank and nullity of a matrix.

MATH 323 Linear Algebra Lecture 12: Basis of a vector space (continued). Rank and nullity of a matrix. MATH 323 Linear Algebra Lecture 12: Basis of a vector space (continued). Rank and nullity of a matrix. Basis Definition. Let V be a vector space. A linearly independent spanning set for V is called a basis.

More information

Midterm 1 Solutions Math Section 55 - Spring 2018 Instructor: Daren Cheng

Midterm 1 Solutions Math Section 55 - Spring 2018 Instructor: Daren Cheng Midterm 1 Solutions Math 20250 Section 55 - Spring 2018 Instructor: Daren Cheng #1 Do the following problems using row reduction. (a) (6 pts) Let A = 2 1 2 6 1 3 8 17 3 5 4 5 Find bases for N A and R A,

More information

Chapter 3. Directions: For questions 1-11 mark each statement True or False. Justify each answer.

Chapter 3. Directions: For questions 1-11 mark each statement True or False. Justify each answer. Chapter 3 Directions: For questions 1-11 mark each statement True or False. Justify each answer. 1. (True False) Asking whether the linear system corresponding to an augmented matrix [ a 1 a 2 a 3 b ]

More information

Rank and Nullity. MATH 322, Linear Algebra I. J. Robert Buchanan. Spring Department of Mathematics

Rank and Nullity. MATH 322, Linear Algebra I. J. Robert Buchanan. Spring Department of Mathematics Rank and Nullity MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 2015 Objectives We have defined and studied the important vector spaces associated with matrices (row space,

More information

Instructions Please answer the five problems on your own paper. These are essay questions: you should write in complete sentences.

Instructions Please answer the five problems on your own paper. These are essay questions: you should write in complete sentences. Instructions Please answer the five problems on your own paper. These are essay questions: you should write in complete sentences.. Recall that P 3 denotes the vector space of polynomials of degree less

More information

CSL361 Problem set 4: Basic linear algebra

CSL361 Problem set 4: Basic linear algebra CSL361 Problem set 4: Basic linear algebra February 21, 2017 [Note:] If the numerical matrix computations turn out to be tedious, you may use the function rref in Matlab. 1 Row-reduced echelon matrices

More information

Math 4A Notes. Written by Victoria Kala Last updated June 11, 2017

Math 4A Notes. Written by Victoria Kala Last updated June 11, 2017 Math 4A Notes Written by Victoria Kala vtkala@math.ucsb.edu Last updated June 11, 2017 Systems of Linear Equations A linear equation is an equation that can be written in the form a 1 x 1 + a 2 x 2 +...

More information

2. Every linear system with the same number of equations as unknowns has a unique solution.

2. Every linear system with the same number of equations as unknowns has a unique solution. 1. For matrices A, B, C, A + B = A + C if and only if A = B. 2. Every linear system with the same number of equations as unknowns has a unique solution. 3. Every linear system with the same number of equations

More information

Math Final December 2006 C. Robinson

Math Final December 2006 C. Robinson Math 285-1 Final December 2006 C. Robinson 2 5 8 5 1 2 0-1 0 1. (21 Points) The matrix A = 1 2 2 3 1 8 3 2 6 has the reduced echelon form U = 0 0 1 2 0 0 0 0 0 1. 2 6 1 0 0 0 0 0 a. Find a basis for the

More information

The Wronskian as a Method for Introducing Vector Spaces

The Wronskian as a Method for Introducing Vector Spaces The Wronskian as a Method for Introducing Vector Spaces Daniel A. Ramras Department of Mathematical Sciences, New Mexico State University http://math.nmsu.edu/ ramras/wronskian.html January 10, 2013 Daniel

More information

CHANGE OF BASIS FOR LINEAR SPACES

CHANGE OF BASIS FOR LINEAR SPACES CHANGE OF ASIS FOR LINEAR SPACES. Motivating Example Consider P 2 the space of polynomials of degree at most 2. Let : P 2 P 2 be defined by (p)(x) = p (x) p(x). his is a linear transformation. We would

More information

Eigenvalues and Eigenvectors

Eigenvalues and Eigenvectors Eigenvalues and Eigenvectors Definition 0 Let A R n n be an n n real matrix A number λ R is a real eigenvalue of A if there exists a nonzero vector v R n such that A v = λ v The vector v is called an eigenvector

More information

MTH 362: Advanced Engineering Mathematics

MTH 362: Advanced Engineering Mathematics MTH 362: Advanced Engineering Mathematics Lecture 5 Jonathan A. Chávez Casillas 1 1 University of Rhode Island Department of Mathematics September 26, 2017 1 Linear Independence and Dependence of Vectors

More information

Elementary Linear Algebra Review for Exam 2 Exam is Monday, November 16th.

Elementary Linear Algebra Review for Exam 2 Exam is Monday, November 16th. Elementary Linear Algebra Review for Exam Exam is Monday, November 6th. The exam will cover sections:.4,..4, 5. 5., 7., the class notes on Markov Models. You must be able to do each of the following. Section.4

More information

MATH 2360 REVIEW PROBLEMS

MATH 2360 REVIEW PROBLEMS MATH 2360 REVIEW PROBLEMS Problem 1: In (a) (d) below, either compute the matrix product or indicate why it does not exist: ( )( ) 1 2 2 1 (a) 0 1 1 2 ( ) 0 1 2 (b) 0 3 1 4 3 4 5 2 5 (c) 0 3 ) 1 4 ( 1

More information

Math 415 Exam I. Name: Student ID: Calculators, books and notes are not allowed!

Math 415 Exam I. Name: Student ID: Calculators, books and notes are not allowed! Math 415 Exam I Calculators, books and notes are not allowed! Name: Student ID: Score: Math 415 Exam I (20pts) 1. Let A be a square matrix satisfying A 2 = 2A. Find the determinant of A. Sol. From A 2

More information

Solutions to Final Practice Problems Written by Victoria Kala Last updated 12/5/2015

Solutions to Final Practice Problems Written by Victoria Kala Last updated 12/5/2015 Solutions to Final Practice Problems Written by Victoria Kala vtkala@math.ucsb.edu Last updated /5/05 Answers This page contains answers only. See the following pages for detailed solutions. (. (a x. See

More information

MAT 242 CHAPTER 4: SUBSPACES OF R n

MAT 242 CHAPTER 4: SUBSPACES OF R n MAT 242 CHAPTER 4: SUBSPACES OF R n JOHN QUIGG 1. Subspaces Recall that R n is the set of n 1 matrices, also called vectors, and satisfies the following properties: x + y = y + x x + (y + z) = (x + y)

More information

Review Notes for Linear Algebra True or False Last Updated: February 22, 2010

Review Notes for Linear Algebra True or False Last Updated: February 22, 2010 Review Notes for Linear Algebra True or False Last Updated: February 22, 2010 Chapter 4 [ Vector Spaces 4.1 If {v 1,v 2,,v n } and {w 1,w 2,,w n } are linearly independent, then {v 1 +w 1,v 2 +w 2,,v n

More information

LECTURE 7: LINEAR TRANSFORMATION (CHAPTER 4 IN THE BOOK)

LECTURE 7: LINEAR TRANSFORMATION (CHAPTER 4 IN THE BOOK) LECTURE 7: LINEAR TRANSFORMATION (CHAPTER 4 IN THE BOOK) Everything marked by is not required by the course syllabus In this lecture, F is a fixed field and all vector spcaes are over F. One can assume

More information

1. General Vector Spaces

1. General Vector Spaces 1.1. Vector space axioms. 1. General Vector Spaces Definition 1.1. Let V be a nonempty set of objects on which the operations of addition and scalar multiplication are defined. By addition we mean a rule

More information

Linear Algebra Notes. Lecture Notes, University of Toronto, Fall 2016

Linear Algebra Notes. Lecture Notes, University of Toronto, Fall 2016 Linear Algebra Notes Lecture Notes, University of Toronto, Fall 2016 (Ctd ) 11 Isomorphisms 1 Linear maps Definition 11 An invertible linear map T : V W is called a linear isomorphism from V to W Etymology:

More information

Definitions for Quizzes

Definitions for Quizzes Definitions for Quizzes Italicized text (or something close to it) will be given to you. Plain text is (an example of) what you should write as a definition. [Bracketed text will not be given, nor does

More information

Math 353, Practice Midterm 1

Math 353, Practice Midterm 1 Math 353, Practice Midterm Name: This exam consists of 8 pages including this front page Ground Rules No calculator is allowed 2 Show your work for every problem unless otherwise stated Score 2 2 3 5 4

More information

Matrix invertibility. Rank-Nullity Theorem: For any n-column matrix A, nullity A +ranka = n

Matrix invertibility. Rank-Nullity Theorem: For any n-column matrix A, nullity A +ranka = n Matrix invertibility Rank-Nullity Theorem: For any n-column matrix A, nullity A +ranka = n Corollary: Let A be an R C matrix. Then A is invertible if and only if R = C and the columns of A are linearly

More information

Lecture Summaries for Linear Algebra M51A

Lecture Summaries for Linear Algebra M51A These lecture summaries may also be viewed online by clicking the L icon at the top right of any lecture screen. Lecture Summaries for Linear Algebra M51A refers to the section in the textbook. Lecture

More information

Chapter 2 Subspaces of R n and Their Dimensions

Chapter 2 Subspaces of R n and Their Dimensions Chapter 2 Subspaces of R n and Their Dimensions Vector Space R n. R n Definition.. The vector space R n is a set of all n-tuples (called vectors) x x 2 x =., where x, x 2,, x n are real numbers, together

More information

2. Linear algebra. matrices and vectors. linear equations. range and nullspace of matrices. function of vectors, gradient and Hessian

2. Linear algebra. matrices and vectors. linear equations. range and nullspace of matrices. function of vectors, gradient and Hessian FE661 - Statistical Methods for Financial Engineering 2. Linear algebra Jitkomut Songsiri matrices and vectors linear equations range and nullspace of matrices function of vectors, gradient and Hessian

More information

Math 1553 Introduction to Linear Algebra

Math 1553 Introduction to Linear Algebra Math 1553 Introduction to Linear Algebra Lecture Notes Chapter 2 Matrix Algebra School of Mathematics The Georgia Institute of Technology Math 1553 Lecture Notes for Chapter 2 Introduction, Slide 1 Section

More information

Problem Set (T) If A is an m n matrix, B is an n p matrix and D is a p s matrix, then show

Problem Set (T) If A is an m n matrix, B is an n p matrix and D is a p s matrix, then show MTH 0: Linear Algebra Department of Mathematics and Statistics Indian Institute of Technology - Kanpur Problem Set Problems marked (T) are for discussions in Tutorial sessions (T) If A is an m n matrix,

More information

Linear transformations

Linear transformations Linear transformations Samy Tindel Purdue University Differential equations and linear algebra - MA 262 Taken from Differential equations and linear algebra by Goode and Annin Samy T. Linear transformations

More information

MATH 20F: LINEAR ALGEBRA LECTURE B00 (T. KEMP)

MATH 20F: LINEAR ALGEBRA LECTURE B00 (T. KEMP) MATH 20F: LINEAR ALGEBRA LECTURE B00 (T KEMP) Definition 01 If T (x) = Ax is a linear transformation from R n to R m then Nul (T ) = {x R n : T (x) = 0} = Nul (A) Ran (T ) = {Ax R m : x R n } = {b R m

More information

A = 1 6 (y 1 8y 2 5y 3 ) Therefore, a general solution to this system is given by

A = 1 6 (y 1 8y 2 5y 3 ) Therefore, a general solution to this system is given by Mid-Term Solutions 1. Let A = 3 1 2 2 1 1 1 3 0. For which triples (y 1, y 2, y 3 ) does AX = Y have a solution? Solution. The following sequence of elementary row operations: R 1 R 1 /3, R 1 2R 1 + R

More information

Final EXAM Preparation Sheet

Final EXAM Preparation Sheet Final EXAM Preparation Sheet M369 Fall 217 1 Key concepts The following list contains the main concepts and ideas that we have explored this semester. For each concept, make sure that you remember about

More information

Math Linear Algebra Final Exam Review Sheet

Math Linear Algebra Final Exam Review Sheet Math 15-1 Linear Algebra Final Exam Review Sheet Vector Operations Vector addition is a component-wise operation. Two vectors v and w may be added together as long as they contain the same number n of

More information

Math 54 HW 4 solutions

Math 54 HW 4 solutions Math 54 HW 4 solutions 2.2. Section 2.2 (a) False: Recall that performing a series of elementary row operations A is equivalent to multiplying A by a series of elementary matrices. Suppose that E,...,

More information

Vector Spaces and Linear Transformations

Vector Spaces and Linear Transformations Vector Spaces and Linear Transformations Wei Shi, Jinan University 2017.11.1 1 / 18 Definition (Field) A field F = {F, +, } is an algebraic structure formed by a set F, and closed under binary operations

More information

is Use at most six elementary row operations. (Partial

is Use at most six elementary row operations. (Partial MATH 235 SPRING 2 EXAM SOLUTIONS () (6 points) a) Show that the reduced row echelon form of the augmented matrix of the system x + + 2x 4 + x 5 = 3 x x 3 + x 4 + x 5 = 2 2x + 2x 3 2x 4 x 5 = 3 is. Use

More information

Practice Exam. 2x 1 + 4x 2 + 2x 3 = 4 x 1 + 2x 2 + 3x 3 = 1 2x 1 + 3x 2 + 4x 3 = 5

Practice Exam. 2x 1 + 4x 2 + 2x 3 = 4 x 1 + 2x 2 + 3x 3 = 1 2x 1 + 3x 2 + 4x 3 = 5 Practice Exam. Solve the linear system using an augmented matrix. State whether the solution is unique, there are no solutions or whether there are infinitely many solutions. If the solution is unique,

More information

Math 18, Linear Algebra, Lecture C00, Spring 2017 Review and Practice Problems for Final Exam

Math 18, Linear Algebra, Lecture C00, Spring 2017 Review and Practice Problems for Final Exam Math 8, Linear Algebra, Lecture C, Spring 7 Review and Practice Problems for Final Exam. The augmentedmatrix of a linear system has been transformed by row operations into 5 4 8. Determine if the system

More information

Rank & nullity. Defn. Let T : V W be linear. We define the rank of T to be rank T = dim im T & the nullity of T to be nullt = dim ker T.

Rank & nullity. Defn. Let T : V W be linear. We define the rank of T to be rank T = dim im T & the nullity of T to be nullt = dim ker T. Rank & nullity Aim lecture: We further study vector space complements, which is a tool which allows us to decompose linear problems into smaller ones. We give an algorithm for finding complements & an

More information

MATH2210 Notebook 3 Spring 2018

MATH2210 Notebook 3 Spring 2018 MATH2210 Notebook 3 Spring 2018 prepared by Professor Jenny Baglivo c Copyright 2009 2018 by Jenny A. Baglivo. All Rights Reserved. 3 MATH2210 Notebook 3 3 3.1 Vector Spaces and Subspaces.................................

More information

1 Last time: determinants

1 Last time: determinants 1 Last time: determinants Let n be a positive integer If A is an n n matrix, then its determinant is the number det A = Π(X, A)( 1) inv(x) X S n where S n is the set of n n permutation matrices Π(X, A)

More information

Kevin James. MTHSC 3110 Section 4.3 Linear Independence in Vector Sp

Kevin James. MTHSC 3110 Section 4.3 Linear Independence in Vector Sp MTHSC 3 Section 4.3 Linear Independence in Vector Spaces; Bases Definition Let V be a vector space and let { v. v 2,..., v p } V. If the only solution to the equation x v + x 2 v 2 + + x p v p = is the

More information

MODULE 8 Topics: Null space, range, column space, row space and rank of a matrix

MODULE 8 Topics: Null space, range, column space, row space and rank of a matrix MODULE 8 Topics: Null space, range, column space, row space and rank of a matrix Definition: Let L : V 1 V 2 be a linear operator. The null space N (L) of L is the subspace of V 1 defined by N (L) = {x

More information

MATH 2331 Linear Algebra. Section 2.1 Matrix Operations. Definition: A : m n, B : n p. Example: Compute AB, if possible.

MATH 2331 Linear Algebra. Section 2.1 Matrix Operations. Definition: A : m n, B : n p. Example: Compute AB, if possible. MATH 2331 Linear Algebra Section 2.1 Matrix Operations Definition: A : m n, B : n p ( 1 2 p ) ( 1 2 p ) AB = A b b b = Ab Ab Ab Example: Compute AB, if possible. 1 Row-column rule: i-j-th entry of AB:

More information

Lecture 21: 5.6 Rank and Nullity

Lecture 21: 5.6 Rank and Nullity Lecture 21: 5.6 Rank and Nullity Wei-Ta Chu 2008/12/5 Rank and Nullity Definition The common dimension of the row and column space of a matrix A is called the rank ( 秩 ) of A and is denoted by rank(a);

More information

Online Exercises for Linear Algebra XM511

Online Exercises for Linear Algebra XM511 This document lists the online exercises for XM511. The section ( ) numbers refer to the textbook. TYPE I are True/False. Lecture 02 ( 1.1) Online Exercises for Linear Algebra XM511 1) The matrix [3 2

More information

This lecture is a review for the exam. The majority of the exam is on what we ve learned about rectangular matrices.

This lecture is a review for the exam. The majority of the exam is on what we ve learned about rectangular matrices. Exam review This lecture is a review for the exam. The majority of the exam is on what we ve learned about rectangular matrices. Sample question Suppose u, v and w are non-zero vectors in R 7. They span

More information

Dimension. Eigenvalue and eigenvector

Dimension. Eigenvalue and eigenvector Dimension. Eigenvalue and eigenvector Math 112, week 9 Goals: Bases, dimension, rank-nullity theorem. Eigenvalue and eigenvector. Suggested Textbook Readings: Sections 4.5, 4.6, 5.1, 5.2 Week 9: Dimension,

More information

Abstract Vector Spaces and Concrete Examples

Abstract Vector Spaces and Concrete Examples LECTURE 18 Abstract Vector Spaces and Concrete Examples Our discussion of linear algebra so far has been devoted to discussing the relations between systems of linear equations, matrices, and vectors.

More information

Introduction to Linear Algebra, Second Edition, Serge Lange

Introduction to Linear Algebra, Second Edition, Serge Lange Introduction to Linear Algebra, Second Edition, Serge Lange Chapter I: Vectors R n defined. Addition and scalar multiplication in R n. Two geometric interpretations for a vector: point and displacement.

More information

(a) II and III (b) I (c) I and III (d) I and II and III (e) None are true.

(a) II and III (b) I (c) I and III (d) I and II and III (e) None are true. 1 Which of the following statements is always true? I The null space of an m n matrix is a subspace of R m II If the set B = {v 1,, v n } spans a vector space V and dimv = n, then B is a basis for V III

More information

Equality: Two matrices A and B are equal, i.e., A = B if A and B have the same order and the entries of A and B are the same.

Equality: Two matrices A and B are equal, i.e., A = B if A and B have the same order and the entries of A and B are the same. Introduction Matrix Operations Matrix: An m n matrix A is an m-by-n array of scalars from a field (for example real numbers) of the form a a a n a a a n A a m a m a mn The order (or size) of A is m n (read

More information

Announcements Monday, October 29

Announcements Monday, October 29 Announcements Monday, October 29 WeBWorK on determinents due on Wednesday at :59pm. The quiz on Friday covers 5., 5.2, 5.3. My office is Skiles 244 and Rabinoffice hours are: Mondays, 2 pm; Wednesdays,

More information

2.3. VECTOR SPACES 25

2.3. VECTOR SPACES 25 2.3. VECTOR SPACES 25 2.3 Vector Spaces MATH 294 FALL 982 PRELIM # 3a 2.3. Let C[, ] denote the space of continuous functions defined on the interval [,] (i.e. f(x) is a member of C[, ] if f(x) is continuous

More information

MAT 1332: CALCULUS FOR LIFE SCIENCES. Contents. 1. Review: Linear Algebra II Vectors and matrices Definition. 1.2.

MAT 1332: CALCULUS FOR LIFE SCIENCES. Contents. 1. Review: Linear Algebra II Vectors and matrices Definition. 1.2. MAT 1332: CALCULUS FOR LIFE SCIENCES JING LI Contents 1 Review: Linear Algebra II Vectors and matrices 1 11 Definition 1 12 Operations 1 2 Linear Algebra III Inverses and Determinants 1 21 Inverse Matrices

More information

Math 321: Linear Algebra

Math 321: Linear Algebra Math 32: Linear Algebra T. Kapitula Department of Mathematics and Statistics University of New Mexico September 8, 24 Textbook: Linear Algebra,by J. Hefferon E-mail: kapitula@math.unm.edu Prof. Kapitula,

More information

Advanced Linear Algebra Math 4377 / 6308 (Spring 2015) March 5, 2015

Advanced Linear Algebra Math 4377 / 6308 (Spring 2015) March 5, 2015 Midterm 1 Advanced Linear Algebra Math 4377 / 638 (Spring 215) March 5, 215 2 points 1. Mark each statement True or False. Justify each answer. (If true, cite appropriate facts or theorems. If false, explain

More information

2018 Fall 2210Q Section 013 Midterm Exam II Solution

2018 Fall 2210Q Section 013 Midterm Exam II Solution 08 Fall 0Q Section 0 Midterm Exam II Solution True or False questions points 0 0 points) ) Let A be an n n matrix. If the equation Ax b has at least one solution for each b R n, then the solution is unique

More information

LECTURES 14/15: LINEAR INDEPENDENCE AND BASES

LECTURES 14/15: LINEAR INDEPENDENCE AND BASES LECTURES 14/15: LINEAR INDEPENDENCE AND BASES MA1111: LINEAR ALGEBRA I, MICHAELMAS 2016 1. Linear Independence We have seen in examples of span sets of vectors that sometimes adding additional vectors

More information

MATH 320: PRACTICE PROBLEMS FOR THE FINAL AND SOLUTIONS

MATH 320: PRACTICE PROBLEMS FOR THE FINAL AND SOLUTIONS MATH 320: PRACTICE PROBLEMS FOR THE FINAL AND SOLUTIONS There will be eight problems on the final. The following are sample problems. Problem 1. Let F be the vector space of all real valued functions on

More information

Lecture 22: Section 4.7

Lecture 22: Section 4.7 Lecture 22: Section 47 Shuanglin Shao December 2, 213 Row Space, Column Space, and Null Space Definition For an m n, a 11 a 12 a 1n a 21 a 22 a 2n A = a m1 a m2 a mn, the vectors r 1 = [ a 11 a 12 a 1n

More information

Definition Suppose S R n, V R m are subspaces. A map U : S V is linear if

Definition Suppose S R n, V R m are subspaces. A map U : S V is linear if .6. Restriction of Linear Maps In this section, we restrict linear maps to subspaces. We observe that the notion of linearity still makes sense for maps whose domain and codomain are subspaces of R n,

More information

Family Feud Review. Linear Algebra. October 22, 2013

Family Feud Review. Linear Algebra. October 22, 2013 Review Linear Algebra October 22, 2013 Question 1 Let A and B be matrices. If AB is a 4 7 matrix, then determine the dimensions of A and B if A has 19 columns. Answer 1 Answer A is a 4 19 matrix, while

More information

5 Linear Transformations

5 Linear Transformations Lecture 13 5 Linear Transformations 5.1 Basic Definitions and Examples We have already come across with the notion of linear transformations on euclidean spaces. We shall now see that this notion readily

More information

Solutions to Exam I MATH 304, section 6

Solutions to Exam I MATH 304, section 6 Solutions to Exam I MATH 304, section 6 YOU MUST SHOW ALL WORK TO GET CREDIT. Problem 1. Let A = 1 2 5 6 1 2 5 6 3 2 0 0 1 3 1 1 2 0 1 3, B =, C =, I = I 0 0 0 1 1 3 4 = 4 4 identity matrix. 3 1 2 6 0

More information

Review problems for MA 54, Fall 2004.

Review problems for MA 54, Fall 2004. Review problems for MA 54, Fall 2004. Below are the review problems for the final. They are mostly homework problems, or very similar. If you are comfortable doing these problems, you should be fine on

More information

Glossary of Linear Algebra Terms. Prepared by Vince Zaccone For Campus Learning Assistance Services at UCSB

Glossary of Linear Algebra Terms. Prepared by Vince Zaccone For Campus Learning Assistance Services at UCSB Glossary of Linear Algebra Terms Basis (for a subspace) A linearly independent set of vectors that spans the space Basic Variable A variable in a linear system that corresponds to a pivot column in the

More information

4.9 The Rank-Nullity Theorem

4.9 The Rank-Nullity Theorem For Problems 7 10, use the ideas in this section to determine a basis for the subspace of R n spanned by the given set of vectors. 7. {(1, 1, 2), (5, 4, 1), (7, 5, 4)}. 8. {(1, 3, 3), (1, 5, 1), (2, 7,

More information

Final Review Written by Victoria Kala SH 6432u Office Hours R 12:30 1:30pm Last Updated 11/30/2015

Final Review Written by Victoria Kala SH 6432u Office Hours R 12:30 1:30pm Last Updated 11/30/2015 Final Review Written by Victoria Kala vtkala@mathucsbedu SH 6432u Office Hours R 12:30 1:30pm Last Updated 11/30/2015 Summary This review contains notes on sections 44 47, 51 53, 61, 62, 65 For your final,

More information

Kevin James. MTHSC 3110 Section 2.2 Inverses of Matrices

Kevin James. MTHSC 3110 Section 2.2 Inverses of Matrices MTHSC 3110 Section 2.2 Inverses of Matrices Definition Suppose that T : R n R m is linear. We will say that T is invertible if for every b R m there is exactly one x R n so that T ( x) = b. Note If T is

More information

Linear Algebra Formulas. Ben Lee

Linear Algebra Formulas. Ben Lee Linear Algebra Formulas Ben Lee January 27, 2016 Definitions and Terms Diagonal: Diagonal of matrix A is a collection of entries A ij where i = j. Diagonal Matrix: A matrix (usually square), where entries

More information

Systems of Linear Equations

Systems of Linear Equations Systems of Linear Equations Math 108A: August 21, 2008 John Douglas Moore Our goal in these notes is to explain a few facts regarding linear systems of equations not included in the first few chapters

More information

Math 123, Week 5: Linear Independence, Basis, and Matrix Spaces. Section 1: Linear Independence

Math 123, Week 5: Linear Independence, Basis, and Matrix Spaces. Section 1: Linear Independence Math 123, Week 5: Linear Independence, Basis, and Matrix Spaces Section 1: Linear Independence Recall that every row on the left-hand side of the coefficient matrix of a linear system A x = b which could

More information

Lecture 3: Linear Algebra Review, Part II

Lecture 3: Linear Algebra Review, Part II Lecture 3: Linear Algebra Review, Part II Brian Borchers January 4, Linear Independence Definition The vectors v, v,..., v n are linearly independent if the system of equations c v + c v +...+ c n v n

More information

Math 321: Linear Algebra

Math 321: Linear Algebra Math 32: Linear Algebra T Kapitula Department of Mathematics and Statistics University of New Mexico September 8, 24 Textbook: Linear Algebra,by J Hefferon E-mail: kapitula@mathunmedu Prof Kapitula, Spring

More information

Row Space, Column Space, and Nullspace

Row Space, Column Space, and Nullspace Row Space, Column Space, and Nullspace MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 2015 Introduction Every matrix has associated with it three vector spaces: row space

More information

Math 54 First Midterm Exam, Prof. Srivastava September 23, 2016, 4:10pm 5:00pm, 155 Dwinelle Hall.

Math 54 First Midterm Exam, Prof. Srivastava September 23, 2016, 4:10pm 5:00pm, 155 Dwinelle Hall. Math 54 First Midterm Exam, Prof Srivastava September 23, 26, 4:pm 5:pm, 55 Dwinelle Hall Name: SID: Instructions: Write all answers in the provided space This exam includes two pages of scratch paper,

More information

MATRIX THEORY (WEEK 2)

MATRIX THEORY (WEEK 2) MATRIX THEORY (WEEK 2) JAMES FULLWOOD Example 0.1. Let L : R 3 R 4 be the linear map given by L(a, b, c) = (a, b, 0, 0). Then which is the z-axis in R 3, and ker(l) = {(x, y, z) R 3 x = y = 0}, im(l) =

More information

1. Let V, W be two vector spaces over F and let T : V W be a set theoretic map. Prove that the following are equivalent: T (cu + v) = ct (u) + T (v)

1. Let V, W be two vector spaces over F and let T : V W be a set theoretic map. Prove that the following are equivalent: T (cu + v) = ct (u) + T (v) Math 790 Test 3 (Solutions) Satya Mandal Fall 05 Each Problem 10 points Due on: October 2, 2005 I like short proofs and elmentary proof. Unless otherwise stated, F is a field and V, W are two vector sapces

More information

(a) only (ii) and (iv) (b) only (ii) and (iii) (c) only (i) and (ii) (d) only (iv) (e) only (i) and (iii)

(a) only (ii) and (iv) (b) only (ii) and (iii) (c) only (i) and (ii) (d) only (iv) (e) only (i) and (iii) . Which of the following are Vector Spaces? (i) V = { polynomials of the form q(t) = t 3 + at 2 + bt + c : a b c are real numbers} (ii) V = {at { 2 + b : a b are real numbers} } a (iii) V = : a 0 b is

More information

Components and change of basis

Components and change of basis Math 20F Linear Algebra Lecture 16 1 Components and change of basis Slide 1 Review: Isomorphism Review: Components in a basis Unique representation in a basis Change of basis Review: Isomorphism Definition

More information

x y + z = 3 2y z = 1 4x + y = 0

x y + z = 3 2y z = 1 4x + y = 0 MA 253: Practice Exam Solutions You may not use a graphing calculator, computer, textbook, notes, or refer to other people (except the instructor). Show all of your work; your work is your answer. Problem

More information

MA 265 FINAL EXAM Fall 2012

MA 265 FINAL EXAM Fall 2012 MA 265 FINAL EXAM Fall 22 NAME: INSTRUCTOR S NAME:. There are a total of 25 problems. You should show work on the exam sheet, and pencil in the correct answer on the scantron. 2. No books, notes, or calculators

More information

LECTURE 6: VECTOR SPACES II (CHAPTER 3 IN THE BOOK)

LECTURE 6: VECTOR SPACES II (CHAPTER 3 IN THE BOOK) LECTURE 6: VECTOR SPACES II (CHAPTER 3 IN THE BOOK) In this lecture, F is a fixed field. One can assume F = R or C. 1. More about the spanning set 1.1. Let S = { v 1, v n } be n vectors in V, we have defined

More information

Linear Algebra Highlights

Linear Algebra Highlights Linear Algebra Highlights Chapter 1 A linear equation in n variables is of the form a 1 x 1 + a 2 x 2 + + a n x n. We can have m equations in n variables, a system of linear equations, which we want to

More information