Outline. Linear maps. 1 Vector addition is commutative: summands can be swapped: 2 addition is associative: grouping of summands is irrelevant:
|
|
- Scarlett Owens
- 5 years ago
- Views:
Transcription
1 Outline Wiskunde : Vector Spaces and Linear Maps B Jacobs Institute for Computing and Information Sciences Digital Security Version: spring 0 B Jacobs Version: spring 0 Wiskunde / 55 Points in plane The set of points in a plane is usually written as R {x, y x, y R} or as R x { x, y R} y Two points can be added, as in: x, y + x, y x + x, y + y What is this geometrically? Also, points can be multiplied by a number scalar : a x, y a x, a y Several nice properties hold, like: a x, y + x, y a x, y + a x, y B Jacobs Version: spring 0 Wiskunde / 55 Points in space Points in 3-dimensional are described as: x R 3 {x, y, z x, y, z R} or as R 3 { y x, y, z R} z Again such 3-dimensional points can be added and multiplied: x, y, z + x, y, z x + x, y + y, z + z a x, y, z a x, a y, a z And similar nice properties hold Mathematicians like to capture such similarities in an abstract definition sometimes the definition is so abstract one gets lost but then it is good to keep the main examples in mind B Jacobs Version: spring 0 Wiskunde 4 / 55 Vector space A vector space consists of a set V, whose elements are called vectors can be added can be multiplied with a real number The precise requirements are in the next two slides For each n N, n-dimensional space R n is a vector space, where R n {x, x,, x n x,, x n R} This includes points in a plane n and points in space n 3 B Jacobs Version: spring 0 Wiskunde 6 / 55 B Jacobs Version: spring 0 Wiskunde 5 / 55 Addition for vectors: precise requirements Vector addition is commutative: summands can be swapped: v + w w + v addition is associative: grouping of summands is irrelevant: u + v + w u + v + w 3 there is a zero vector 0 such that: v + 0 v, and hence by also: 0 + v v 4 each vector v has an additive inverse minus v such that: v + v 0 B Jacobs Version: spring 0 Wiskunde 7 / 55
2 Scalar multiplication for vectors: precise requirements Base in space R is unit for scalar multiplication: v v two scalar multiplications can be done as one: 3 distributivity a b v }{{} twice scalar mult ab v }{{} mult in R a v + w a v + a w a + b v a v + b v Exercise Check for yourself that all these properties hold for R n B Jacobs Version: spring 0 Wiskunde 8 / 55 Independence Vectors v,, v n in a vector space V are called independent if for all scalars a,, a n R one has: a v + + a n v n 0 in V implies a a a n 0 The 3 vectors, 0, 0, 0,, 0, 0, 0, R 3 are independent, since if a, 0, 0 + a 0,, 0 + a 3 0, 0, 0, 0, 0 then, using the computation from the previous slide, a, a, a 3 0, 0, 0, so that a a a 3 0 B Jacobs Version: spring 0 Wiskunde / 55 Proving independence via equation solving II In R 3 we can distinguish three special vectors:, 0, 0 R 3 0,, 0 R 3 0, 0, R 3 These vectors form a basis: each vector x, y, z can be expressed in terms of these three special vectors: x, 0, 0 + y 0,, 0 + z 0, 0, x, 0, 0 + 0, y, 0 + 0, 0, z x, y, z Moreover, these three special vectors are independent It is a challenge to capture this intuitive notion of basis abstractly in terms of the notion of vector space it can then be used for all examples of vector spaces B Jacobs Version: spring 0 Wiskunde 0 / 55 Proving independence via equation solving I 0 Investigate independence of,, and Thus we ask: are there any non-zero a, a, a 3 R with: 0 0 a + a + a If there is a non-zero solution, the vectors are dependent, and if a a a 3 0 is the only solution, they are independent B Jacobs Version: spring 0 Wiskunde / 55 Proving independence via equation solving III Our question involves the systems of equations / matrix: a + a 0 0 a a + 5a 3 0 corresponding to 5 3a + 4a + a This one has non-zero solutions a, a, a 3 compute and check for yourself! Thus the original vectors are dependent Explicitly: Same independence question for:,, 3 With corresponding matrix: 5 0 reducing to Thus the only solution is a a a 3 0 The vectors are independent! B Jacobs Version: spring 0 Wiskunde 3 / 55 B Jacobs Version: spring 0 Wiskunde 4 / 55
3 Non-independence / dependence Basis In the plane two vectors v, w R are dependent if and only if: they are on the same line ie v a w, for some scalar a : for v, and w, 4 we have: v w, so they are on the same line a v + a w 0, eg for a 0 and a 0 In space, three vectors u, v, w R 3 are dependent if they are in the same plane or even line In general, if v,, v n V are dependent, if and only if each v i can be expressed as linear combination of the others the v j with j i B Jacobs Version: spring 0 Wiskunde 5 / 55 The standard basis for R n Vectors v,, v n V form a basis for a vector space V if these v,, v n are independent, and span V in the sense that each w V can be written as linear combination of these v,, v n, namely as: w a v + + a n v n for certain a,, a n R These scalars a i are uniquely determined by w V see below a space V may have several bases, but the number of elements of such a basis for V is always the same; it is called the dimension of V, sometimes written as dimv N B Jacobs Version: spring 0 Wiskunde 6 / 55 An alternative basis for R For the space R n {x,, x n x i R} there is a standard choice of base vectors:, 0, 0, 0, 0,, 0,, 0, 0,, 0, We have already seen that they are independent; it is easy to see that they span R n This enables us to state precisely that R n has n dimensions The standard basis for R is, 0, 0, But many other choices are possible, eg,,, independence: if a, + b, 0, 0, then: { { a + b 0 a 0 and thus a b 0 b 0 spanning: each point x, y can written in terms of,,,, namely: x, y x+y x y, +, B Jacobs Version: spring 0 Wiskunde 7 / 55 Uniqueness of representations Lemma Suppose V is a vector space, with basis v,, v n assume x V can be represented in two ways: x a v + + a n v n and also x b v + + b n v n Then: a b and and a n b n Proof: This follows from independence of v,, v n since: 0 x x a v + + a n v n b v + + b n v n a b v + + a n b n v n Hence a i b i 0, by independence, and thus a i b i B Jacobs Version: spring 0 Wiskunde 8 / 55 Functions A function f is an operation that sends elements of one set X to another set Y in that case we write f : X Y or sometimes X f Y this f sends x X to f x Y X is called the domain and Y the codomain of the function f f n n can be seen as function N Q, that is from the natural numbers N to the rational numbers Q A function is sometimes also called a map or a mapping On each set X there is the identity function id : X X that does nothing: idx x Also one can compose functions X f Y g Z to a function: g f : X Z given by g f x gf x B Jacobs Version: spring 0 Wiskunde 9 / 55 B Jacobs Version: spring 0 Wiskunde / 55
4 Linear functions We have seen that the two relevant operations of a vector space are addition and scalar multiplication A linear function is required to preserve these two Let V, W be two vector spaces, and f : V W a function between them; f is called linear if it preserves both: addition: for all v, v V, f v } + {{ v } f v + f v }{{} in V in W scalar multiplication: for each v V and a R, f a }{{} v a f v }{{} in V in W B Jacobs Version: spring 0 Wiskunde / 55 Linear map examples I First we consider functions f : R R Most of them are not linear, like, for instance: f x + x, since f 0 0 f x x, since f f f These linear maps R R can only be very simple Lemma Each linear map f : R R is of the form f x c x, for some c R this constant c depends on f Proof: Scalar multiplication on R is ordinary multiplication Hence: f x f x x f f x c x, for c f preserve zero Lemma Each linear map f : V W preserves: zero: f 0 0 minus: f v f v Proof: Nice illustration of axiomatic reasoning: 0 f 0 f 0 f v f v + 0 f f 0 f v + f v f v f 0 + f 0 f 0 f v + f v f v f 0 + f 0 f 0 f v + v f v f f 0 f v f 0 0 f v f v B Jacobs Version: spring 0 Wiskunde 3 / 55 Linear map examples II Consider the map f : R 3 R given by f x, x, x 3 x x, x + x 3 We show in detail that this f is linear, following the definition Preservation of scalar multiplication from R 3 to R : f a x, x, x 3 f a x, a x, a x 3 a x a x, a x + a x 3 a x x, a x + x 3 a x x, x + x 3 a f x, x, x 3 B Jacobs Version: spring 0 Wiskunde 4 / 55 Linear map examples II cntd Preservation of addition from R 3 to R : f x, x, x 3 + y, y, y 3 f x + y, x + y, x 3 + y 3 x + y x + y, x + y + x 3 + y 3 x x + y y, x + x 3 + y + y 3 x x, x + x 3 + y y, y + y 3 f x, x, x 3 + f y, y, y 3 B Jacobs Version: spring 0 Wiskunde 5 / 55 Linear map examples III Consider the map f : R R given by f x, y x cosϕ y sinϕ, x sinϕ + y cosϕ In the same way one can show that f is linear [Do it yourself!] This map described rotation in the plane, with angle ϕ: B Jacobs Version: spring 0 Wiskunde 6 / 55 B Jacobs Version: spring 0 Wiskunde 7 / 55
5 and bases, example I Recall the linear map f x, x, x 3 x x, x + x 3 Claim: this map is entirely determined by what it does on the base vectors, 0, 0, 0,, 0, 0, 0, R 3, namely: f, 0, 0, 0 f 0,, 0, f 0, 0, 0, Indeed, by linearity: f x, x, x 3 f x, 0, 0 + 0, x, 0 + 0, 0, x 3 f x, 0, 0 + x 0,, 0 + x 3 0, 0, f x, 0, 0 + f x 0,, 0 + f x f, 0, 0 + x f 0,, 0 + x 3 f 0, 0, x, 0 + x, + x 3 0, x x, x + x 3 x 3 0, 0, B Jacobs Version: spring 0 Wiskunde 9 / 55 The general case The aim is to obtain a matrix for an arbitrary linear map Assume a linear map f : V W, where: the vector space V has basis {v,, v n } V ; W has basis {w,, w m } Each x V can be written as x a v + + a n v n Hence: f x f a v + + a n v n a f v + + a n f v n by linearity of f Thus, f is determined by its values f v,, f v n on base vectors v j V By writing f v j b j w + + b mj w m we obtain an m n matrix with entries b ij i m,j n and bases, example I cntd Our f x, x, x 3 x x, x + x 3 is thus determined by: f, 0, 0, 0 f 0,, 0, f 0, 0, 0, We can organise these data in a 3 matrix: 0 0 The f v i, for base vector v i, appears as the i-the column Applying f can be done by a new kind of multiplication: x 0 x 0 def x + x + 0 x 3 x x 0 x x + x + x 3 x + x 3 3 B Jacobs Version: spring 0 Wiskunde 30 / 55 Towards matrix-vector multiplication In this setting, we have: f x f a v + + a n v n a f v + + a n f v n a b w + + b m w m + + an bn w + + b mn w m a b + + a n b n w + + a b m + + a n b mn wm b a + + b n a n w + + b m a + + b mn a n wm This motivates the definition of matrix-vector multiplication: b b n a b a + + b n a n b m b mn a n b m a + + b mn a n B Jacobs Version: spring 0 Wiskunde 3 / 55 Matrix-vector multiplication, concretely Recall f x, x, x 3 x x, x + x 3 with matrix: 0 0 We can directly calculate f,,,, We can also get the same result by matrix-vector multiplication: This multiplication can be understood as: putting the argument values x, x, x 3 in variables of the underlying equations, and computing the outcome B Jacobs Version: spring 0 Wiskunde 33 / 55 B Jacobs Version: spring 0 Wiskunde 3 / 55 Another example, to learn the mechanics B Jacobs Version: spring 0 Wiskunde 34 / 55
6 Linear function from matrix Matrix summary We have seen how a linear function can be described via a matrix One can also read each matrix as a linear function Consider the matrix It has 3 columns/inputs and two rows/outputs Hence it describes a function f : R 3 R Namely: f x, x, x 3 x x 3, 5x + x 3x 3 Assume bases {v,, v n } V and {w,, w m } W Each linear map f : V W corresponds to an m n matrix, and vice-versa We often write the matrix of f as M f The i-th column in this matrix M f is given by the coefficients of f v i, wrt the basis w,, w m of W Matrix-vector multiplication corresponds to function application: f v is the same as M f v This matrix M f of f depends on the choice of basis: for different bases of V and W a different matrix is obtained Matrix-vector multiplication forms itself a linear function B Jacobs Version: spring 0 Wiskunde 35 / 55 The identity matrix Consider the following n n identity matrix with diagonal of s: 0 0 I n To which function does I n correspond? The identity function R n R n To which system of equations does I n correspond? x 0 x n 0 B Jacobs Version: spring 0 Wiskunde 37 / 55 Matrices as vectors II: example B Jacobs Version: spring 0 Wiskunde 36 / 55 Matrices as vectors I Write Mat m,n {M M is an m n matrix} Thus each M Mat m,n can be written as M a ij, for i m and j n We can add two such matrices M, N Mat m,n, giving M + N Mat m,n the matrices are added entry-wise, that is: if M a ij, N b ij, M + N c ij, then c ij a ij + b ij Similarly, matrices can be multiplied by a scalar s R s M Mat m,n has entries s a ij Finally, there is a zero matrix 0 m,n Mat m,n, with only zeros as entries Mat m,n is a vector space B Jacobs Version: spring 0 Wiskunde 38 / 55 Matrices as vectors III: transpose Addition: For a matrix M Mat m,n write M T Mat n,m for the transpose of M It is obtained by mirroring: if M a ij then M T has entries a ji Scalar multiplication: Transposition is a linear map T : Mat m,n Mat n,m That is: M + N T M T + N T a M T a M T B Jacobs Version: spring 0 Wiskunde 39 / 55 B Jacobs Version: spring 0 Wiskunde 40 / 55
7 definitions Subspace definition Let f : V W be a linear map the kernel of f is the subset of V given by: kerf {x V f x 0} the image of f is the subset of W given by: imf {f x x V } Consider the function f : R R given by f x 0, x the kernel is {x R 0, x 0, 0} {0} the image is y-axis {0, x x R} B Jacobs Version: spring 0 Wiskunde 4 / 55 Subspace examples A subset S V of a vector space V is called a linear subspace if S is closed under addition and scalar multiplication: 0 S v, v S implies v + v S v S and a R implies a v S Note A subspace S V is a vector space itself, and can thus also have a basis Also S can have its own dimension, where dims dimv B Jacobs Version: spring 0 Wiskunde 43 / 55 Basis for subspaces Earlier we saw that the subset of solutions of a system of equations is closed under addition and scalar multiplication, and thus is a linear subspace The diagonal D {x, x x R} R is a linear subspace: if x, x, x, x D, then also x, x + x, x x + x, x + x D if x, x D and a R, also a x, x a x, a x D Also: D has a single vector as basis, for example, thus, D has dimension Let the space V have dimension n, and a subspace S V dimension p, where p n Then: any set of > p vectors in S is linearly dependent any set of < p vectors in S does not span S any set of p independent vectors in S is a basis for S any set of p vectors that spans S is a basis for S B Jacobs Version: spring 0 Wiskunde 44 / 55 Kernels and images are subspaces For a linear map f : V W, kerf {x f x 0} V is a linear subspace imf {f x x V } W is a linear subspace As subspaces kerf and imf also have dimensions see later Proof: We check two cases do the others yourself! Closure of kerf under addition: if x, x kerf, then f x 0 and f x 0 By linearity of f, f x + x f x + f x , so x + x kerf Closure of imf under scalar multiplication: Assume y imf, say y f x, and a R Again by linearity: a y a f x f a x, so a y imf B Jacobs Version: spring 0 Wiskunde 46 / 55 B Jacobs Version: spring 0 Wiskunde 45 / 55 The kernel as solution space With this kernel and image terminology we can connect some previous notions Suppose a linear map f : V W has matrix M f Then: v kerf f v 0 M f v 0 v is solution of the equations given by M f Moreover, the dimension of the kernel dimkerf is the same as the number of columns without pivots in the echelon form of M f B Jacobs Version: spring 0 Wiskunde 47 / 55
8 Independence and kernels More concretely Assume a vector space V with vectors v,, v n V We define a function f : R n V by Then: f a,, a n a v + + a n v n You can check for yourself that f is linear the vectors v,, v n are independent a v + + a n v n 0 implies a a n 0 f a,, a n 0 implies a a n 0 kerf {0,, 0} the matrix M f of f has only 0,, 0 as solution the echelon form of M f has n pivots B Jacobs Version: spring 0 Wiskunde 48 / 55 Kernel-image-dimension theorem aka rank-nullity For a linear map f : V W one has: dimkerf + dimimf dimv Pictorial proof: Consider echelon forms of the matrix M f of f : }{{}}{{}}{{} dimimf dimkerf dimimf, where dimkerf 0 B Jacobs Version: spring 0 Wiskunde 50 / 55 ctd We now know: dimimf 3 dimkerf 3 Thus the image of f : R 3 R is the whole codomain R Hence f is surjective 0 In the echelon form 0 we can see the basis of imf, namely the first two columns 0 That is: and, the standard basis for imf R 0 These base vectors are indeed in imf, since: Consider the 3 vectors 0,, and 0 they are independent because the associated matrix 0 0 reduces to and this echelon form has 3 pivots, that is, only 0 as solution B Jacobs Version: spring 0 Wiskunde 49 / 55 Consider the map f : R 3 R given by M f 0 The echelon form of M f is 0 { Thus: x, x, x 3 kerf x x 3 0 { 5x + x 3x 3 0 x x 3 0 x x 3 0 Thus kerf is -dimenionsional, say with base vector Check: Indeed, M f 0 B Jacobs Version: spring 0 Wiskunde 5 / 55 Main points, so far, I We have seen matrices as abstractions of systems of equations by removing variables: a x + + a n x n b a a n x b is a m x m + + a mn x mn b m a m a mn matrices capture the behaviour of linear maps on base vectors: M f f v f v n where f v i x n b n B Jacobs Version: spring 0 Wiskunde 5 / 55 B Jacobs Version: spring 0 Wiskunde 54 / 55
9 Main points, so far, II These two points are connected: solutions of a homogeneous system M f kerf x x n 0 0 Also: basic solutions are base vectors of this kernel Solutions of a non-homogeneous system M f b exist if and only if imf b n x x n are in b b n Also: these solutions are of the form P + H i, with H i kerf B Jacobs Version: spring 0 Wiskunde 55 / 55
Matrix Calculations: Linear maps, bases, and matrices
Matrix Calculations: Linear maps, bases, and matrices A Kissinger Institute for Computing and Information Sciences Version: autumn 2017 A Kissinger Version: autumn 2017 Matrix Calculations 1 / 37 Outline
More informationand The important theorem which connects these various spaces with each other is the following: (with the notation above)
When F : U V is a linear transformation there are two special subspaces associated to F which are very important. One is a subspace of U and the other is a subspace of V. They are: kerf U (the kernel of
More informationMAT 242 CHAPTER 4: SUBSPACES OF R n
MAT 242 CHAPTER 4: SUBSPACES OF R n JOHN QUIGG 1. Subspaces Recall that R n is the set of n 1 matrices, also called vectors, and satisfies the following properties: x + y = y + x x + (y + z) = (x + y)
More informationLinear equations in linear algebra
Linear equations in linear algebra Samy Tindel Purdue University Differential equations and linear algebra - MA 262 Taken from Differential equations and linear algebra Pearson Collections Samy T. Linear
More informationMAT224 Practice Exercises - Week 7.5 Fall Comments
MAT224 Practice Exercises - Week 75 Fall 27 Comments The purpose of this practice exercise set is to give a review of the midterm material via easy proof questions You can read it as a summary and you
More informationRow Space, Column Space, and Nullspace
Row Space, Column Space, and Nullspace MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 2015 Introduction Every matrix has associated with it three vector spaces: row space
More informationWe showed that adding a vector to a basis produces a linearly dependent set of vectors; more is true.
Dimension We showed that adding a vector to a basis produces a linearly dependent set of vectors; more is true. Lemma If a vector space V has a basis B containing n vectors, then any set containing more
More informationLINEAR ALGEBRA REVIEW
LINEAR ALGEBRA REVIEW SPENCER BECKER-KAHN Basic Definitions Domain and Codomain. Let f : X Y be any function. This notation means that X is the domain of f and Y is the codomain of f. This means that for
More informationAbstract Vector Spaces and Concrete Examples
LECTURE 18 Abstract Vector Spaces and Concrete Examples Our discussion of linear algebra so far has been devoted to discussing the relations between systems of linear equations, matrices, and vectors.
More informationChapter 2 Linear Transformations
Chapter 2 Linear Transformations Linear Transformations Loosely speaking, a linear transformation is a function from one vector space to another that preserves the vector space operations. Let us be more
More informationis Use at most six elementary row operations. (Partial
MATH 235 SPRING 2 EXAM SOLUTIONS () (6 points) a) Show that the reduced row echelon form of the augmented matrix of the system x + + 2x 4 + x 5 = 3 x x 3 + x 4 + x 5 = 2 2x + 2x 3 2x 4 x 5 = 3 is. Use
More informationTues Feb Vector spaces and subspaces. Announcements: Warm-up Exercise:
Math 2270-004 Week 7 notes We will not necessarily finish the material from a given day's notes on that day. We may also add or subtract some material as the week progresses, but these notes represent
More informationMATH 323 Linear Algebra Lecture 12: Basis of a vector space (continued). Rank and nullity of a matrix.
MATH 323 Linear Algebra Lecture 12: Basis of a vector space (continued). Rank and nullity of a matrix. Basis Definition. Let V be a vector space. A linearly independent spanning set for V is called a basis.
More informationThe definition of a vector space (V, +, )
The definition of a vector space (V, +, ) 1. For any u and v in V, u + v is also in V. 2. For any u and v in V, u + v = v + u. 3. For any u, v, w in V, u + ( v + w) = ( u + v) + w. 4. There is an element
More informationLinear Algebra. Min Yan
Linear Algebra Min Yan January 2, 2018 2 Contents 1 Vector Space 7 1.1 Definition................................. 7 1.1.1 Axioms of Vector Space..................... 7 1.1.2 Consequence of Axiom......................
More informationMATH10212 Linear Algebra B Homework Week 4
MATH22 Linear Algebra B Homework Week 4 Students are strongly advised to acquire a copy of the Textbook: D. C. Lay Linear Algebra and its Applications. Pearson, 26. ISBN -52-2873-4. Normally, homework
More informationLinear Algebra Notes. Lecture Notes, University of Toronto, Fall 2016
Linear Algebra Notes Lecture Notes, University of Toronto, Fall 2016 (Ctd ) 11 Isomorphisms 1 Linear maps Definition 11 An invertible linear map T : V W is called a linear isomorphism from V to W Etymology:
More informationChapter 2 Subspaces of R n and Their Dimensions
Chapter 2 Subspaces of R n and Their Dimensions Vector Space R n. R n Definition.. The vector space R n is a set of all n-tuples (called vectors) x x 2 x =., where x, x 2,, x n are real numbers, together
More information(II.B) Basis and dimension
(II.B) Basis and dimension How would you explain that a plane has two dimensions? Well, you can go in two independent directions, and no more. To make this idea precise, we formulate the DEFINITION 1.
More informationChapter 3. Directions: For questions 1-11 mark each statement True or False. Justify each answer.
Chapter 3 Directions: For questions 1-11 mark each statement True or False. Justify each answer. 1. (True False) Asking whether the linear system corresponding to an augmented matrix [ a 1 a 2 a 3 b ]
More informationModern Algebra Prof. Manindra Agrawal Department of Computer Science and Engineering Indian Institute of Technology, Kanpur
Modern Algebra Prof. Manindra Agrawal Department of Computer Science and Engineering Indian Institute of Technology, Kanpur Lecture 02 Groups: Subgroups and homomorphism (Refer Slide Time: 00:13) We looked
More informationMath 3108: Linear Algebra
Math 3108: Linear Algebra Instructor: Jason Murphy Department of Mathematics and Statistics Missouri University of Science and Technology 1 / 323 Contents. Chapter 1. Slides 3 70 Chapter 2. Slides 71 118
More informationLECTURES 14/15: LINEAR INDEPENDENCE AND BASES
LECTURES 14/15: LINEAR INDEPENDENCE AND BASES MA1111: LINEAR ALGEBRA I, MICHAELMAS 2016 1. Linear Independence We have seen in examples of span sets of vectors that sometimes adding additional vectors
More informationLinear Algebra, Summer 2011, pt. 2
Linear Algebra, Summer 2, pt. 2 June 8, 2 Contents Inverses. 2 Vector Spaces. 3 2. Examples of vector spaces..................... 3 2.2 The column space......................... 6 2.3 The null space...........................
More informationUNDERSTANDING THE DIAGONALIZATION PROBLEM. Roy Skjelnes. 1.- Linear Maps 1.1. Linear maps. A map T : R n R m is a linear map if
UNDERSTANDING THE DIAGONALIZATION PROBLEM Roy Skjelnes Abstract These notes are additional material to the course B107, given fall 200 The style may appear a bit coarse and consequently the student is
More informationHomework 5 M 373K Mark Lindberg and Travis Schedler
Homework 5 M 373K Mark Lindberg and Travis Schedler 1. Artin, Chapter 3, Exercise.1. Prove that the numbers of the form a + b, where a and b are rational numbers, form a subfield of C. Let F be the numbers
More information1.8 Dual Spaces (non-examinable)
2 Theorem 1715 is just a restatement in terms of linear morphisms of a fact that you might have come across before: every m n matrix can be row-reduced to reduced echelon form using row operations Moreover,
More information5 Linear Transformations
Lecture 13 5 Linear Transformations 5.1 Basic Definitions and Examples We have already come across with the notion of linear transformations on euclidean spaces. We shall now see that this notion readily
More informationDefinition 1. A set V is a vector space over the scalar field F {R, C} iff. there are two operations defined on V, called vector addition
6 Vector Spaces with Inned Product Basis and Dimension Section Objective(s): Vector Spaces and Subspaces Linear (In)dependence Basis and Dimension Inner Product 6 Vector Spaces and Subspaces Definition
More informationTest 1 Review Problems Spring 2015
Test Review Problems Spring 25 Let T HomV and let S be a subspace of V Define a map τ : V /S V /S by τv + S T v + S Is τ well-defined? If so when is it well-defined? If τ is well-defined is it a homomorphism?
More informationChapter 4 & 5: Vector Spaces & Linear Transformations
Chapter 4 & 5: Vector Spaces & Linear Transformations Philip Gressman University of Pennsylvania Philip Gressman Math 240 002 2014C: Chapters 4 & 5 1 / 40 Objective The purpose of Chapter 4 is to think
More informationMathematics Department Stanford University Math 61CM/DM Vector spaces and linear maps
Mathematics Department Stanford University Math 61CM/DM Vector spaces and linear maps We start with the definition of a vector space; you can find this in Section A.8 of the text (over R, but it works
More informationMath 4A Notes. Written by Victoria Kala Last updated June 11, 2017
Math 4A Notes Written by Victoria Kala vtkala@math.ucsb.edu Last updated June 11, 2017 Systems of Linear Equations A linear equation is an equation that can be written in the form a 1 x 1 + a 2 x 2 +...
More informationDS-GA 1002 Lecture notes 0 Fall Linear Algebra. These notes provide a review of basic concepts in linear algebra.
DS-GA 1002 Lecture notes 0 Fall 2016 Linear Algebra These notes provide a review of basic concepts in linear algebra. 1 Vector spaces You are no doubt familiar with vectors in R 2 or R 3, i.e. [ ] 1.1
More informationRow Space and Column Space of a Matrix
Row Space and Column Space of a Matrix 1/18 Summary: To a m n matrix A = (a ij ), we can naturally associate subspaces of K n and of K m, called the row space of A and the column space of A, respectively.
More informationVector Spaces and Linear Transformations
Vector Spaces and Linear Transformations Wei Shi, Jinan University 2017.11.1 1 / 18 Definition (Field) A field F = {F, +, } is an algebraic structure formed by a set F, and closed under binary operations
More informationThis last statement about dimension is only one part of a more fundamental fact.
Chapter 4 Isomorphism and Coordinates Recall that a vector space isomorphism is a linear map that is both one-to-one and onto. Such a map preserves every aspect of the vector space structure. In other
More informationSolutions to Math 51 First Exam April 21, 2011
Solutions to Math 5 First Exam April,. ( points) (a) Give the precise definition of a (linear) subspace V of R n. (4 points) A linear subspace V of R n is a subset V R n which satisfies V. If x, y V then
More informationLinear Algebra MAT 331. Wai Yan Pong
Linear Algebra MAT 33 Wai Yan Pong August 7, 8 Contents Linear Equations 4. Systems of Linear Equations..................... 4. Gauss-Jordan Elimination...................... 6 Linear Independence. Vector
More informationChapter 2: Matrix Algebra
Chapter 2: Matrix Algebra (Last Updated: October 12, 2016) These notes are derived primarily from Linear Algebra and its applications by David Lay (4ed). Write A = 1. Matrix operations [a 1 a n. Then entry
More informationMATH 315 Linear Algebra Homework #1 Assigned: August 20, 2018
Homework #1 Assigned: August 20, 2018 Review the following subjects involving systems of equations and matrices from Calculus II. Linear systems of equations Converting systems to matrix form Pivot entry
More informationMATH 240 Spring, Chapter 1: Linear Equations and Matrices
MATH 240 Spring, 2006 Chapter Summaries for Kolman / Hill, Elementary Linear Algebra, 8th Ed. Sections 1.1 1.6, 2.1 2.2, 3.2 3.8, 4.3 4.5, 5.1 5.3, 5.5, 6.1 6.5, 7.1 7.2, 7.4 DEFINITIONS Chapter 1: Linear
More informationMath 396. Quotient spaces
Math 396. Quotient spaces. Definition Let F be a field, V a vector space over F and W V a subspace of V. For v, v V, we say that v v mod W if and only if v v W. One can readily verify that with this definition
More informationMath 110, Spring 2015: Midterm Solutions
Math 11, Spring 215: Midterm Solutions These are not intended as model answers ; in many cases far more explanation is provided than would be necessary to receive full credit. The goal here is to make
More informationReview Notes for Midterm #2
Review Notes for Midterm #2 Joris Vankerschaver This version: Nov. 2, 200 Abstract This is a summary of the basic definitions and results that we discussed during class. Whenever a proof is provided, I
More informationWe see that this is a linear system with 3 equations in 3 unknowns. equation is A x = b, where
Practice Problems Math 35 Spring 7: Solutions. Write the system of equations as a matrix equation and find all solutions using Gauss elimination: x + y + 4z =, x + 3y + z = 5, x + y + 5z = 3. We see that
More informationThe Four Fundamental Subspaces
The Four Fundamental Subspaces Introduction Each m n matrix has, associated with it, four subspaces, two in R m and two in R n To understand their relationships is one of the most basic questions in linear
More informationLinear Algebra March 16, 2019
Linear Algebra March 16, 2019 2 Contents 0.1 Notation................................ 4 1 Systems of linear equations, and matrices 5 1.1 Systems of linear equations..................... 5 1.2 Augmented
More informationMatrix representation of a linear map
Matrix representation of a linear map As before, let e i = (0,..., 0, 1, 0,..., 0) T, with 1 in the i th place and 0 elsewhere, be standard basis vectors. Given linear map f : R n R m we get n column vectors
More informationInstructions Please answer the five problems on your own paper. These are essay questions: you should write in complete sentences.
Instructions Please answer the five problems on your own paper. These are essay questions: you should write in complete sentences.. Recall that P 3 denotes the vector space of polynomials of degree less
More informationJORDAN NORMAL FORM. Contents Introduction 1 Jordan Normal Form 1 Conclusion 5 References 5
JORDAN NORMAL FORM KATAYUN KAMDIN Abstract. This paper outlines a proof of the Jordan Normal Form Theorem. First we show that a complex, finite dimensional vector space can be decomposed into a direct
More informationChapter 2. Error Correcting Codes. 2.1 Basic Notions
Chapter 2 Error Correcting Codes The identification number schemes we discussed in the previous chapter give us the ability to determine if an error has been made in recording or transmitting information.
More informationChapter 2. General Vector Spaces. 2.1 Real Vector Spaces
Chapter 2 General Vector Spaces Outline : Real vector spaces Subspaces Linear independence Basis and dimension Row Space, Column Space, and Nullspace 2 Real Vector Spaces 2 Example () Let u and v be vectors
More informationMTH 35, SPRING 2017 NIKOS APOSTOLAKIS
MTH 35, SPRING 2017 NIKOS APOSTOLAKIS 1. Linear independence Example 1. Recall the set S = {a i : i = 1,...,5} R 4 of the last two lectures, where a 1 = (1,1,3,1) a 2 = (2,1,2, 1) a 3 = (7,3,5, 5) a 4
More informationSpan & Linear Independence (Pop Quiz)
Span & Linear Independence (Pop Quiz). Consider the following vectors: v = 2, v 2 = 4 5, v 3 = 3 2, v 4 = Is the set of vectors S = {v, v 2, v 3, v 4 } linearly independent? Solution: Notice that the number
More informationANALYTICAL MATHEMATICS FOR APPLICATIONS 2018 LECTURE NOTES 3
ANALYTICAL MATHEMATICS FOR APPLICATIONS 2018 LECTURE NOTES 3 ISSUED 24 FEBRUARY 2018 1 Gaussian elimination Let A be an (m n)-matrix Consider the following row operations on A (1) Swap the positions any
More informationGRE Subject test preparation Spring 2016 Topic: Abstract Algebra, Linear Algebra, Number Theory.
GRE Subject test preparation Spring 2016 Topic: Abstract Algebra, Linear Algebra, Number Theory. Linear Algebra Standard matrix manipulation to compute the kernel, intersection of subspaces, column spaces,
More informationSYMBOL EXPLANATION EXAMPLE
MATH 4310 PRELIM I REVIEW Notation These are the symbols we have used in class, leading up to Prelim I, and which I will use on the exam SYMBOL EXPLANATION EXAMPLE {a, b, c, } The is the way to write the
More informationFirst we introduce the sets that are going to serve as the generalizations of the scalars.
Contents 1 Fields...................................... 2 2 Vector spaces.................................. 4 3 Matrices..................................... 7 4 Linear systems and matrices..........................
More informationMath 113 Midterm Exam Solutions
Math 113 Midterm Exam Solutions Held Thursday, May 7, 2013, 7-9 pm. 1. (10 points) Let V be a vector space over F and T : V V be a linear operator. Suppose that there is a non-zero vector v V such that
More information(b) The nonzero rows of R form a basis of the row space. Thus, a basis is [ ], [ ], [ ]
Exam will be on Monday, October 6, 27. The syllabus for Exam 2 consists of Sections Two.III., Two.III.2, Two.III.3, Three.I, and Three.II. You should know the main definitions, results and computational
More informationExam 1 - Definitions and Basic Theorems
Exam 1 - Definitions and Basic Theorems One of the difficuliies in preparing for an exam where there will be a lot of proof problems is knowing what you re allowed to cite and what you actually have to
More informationAN APPLICATION OF LINEAR ALGEBRA TO NETWORKS
AN APPLICATION OF LINEAR ALGEBRA TO NETWORKS K. N. RAGHAVAN 1. Statement of the problem Imagine that between two nodes there is a network of electrical connections, as for example in the following picture
More informationMatrices and systems of linear equations
Matrices and systems of linear equations Samy Tindel Purdue University Differential equations and linear algebra - MA 262 Taken from Differential equations and linear algebra by Goode and Annin Samy T.
More information15B. Isometries and Functionals 1
5B. Isometries and Functionals Isometries If the important functions between vector spaces V and W are those that preserve linearity (i.e., linear transformations), then the important functions between
More informationCSL361 Problem set 4: Basic linear algebra
CSL361 Problem set 4: Basic linear algebra February 21, 2017 [Note:] If the numerical matrix computations turn out to be tedious, you may use the function rref in Matlab. 1 Row-reduced echelon matrices
More informationAdvanced Engineering Mathematics Prof. Pratima Panigrahi Department of Mathematics Indian Institute of Technology, Kharagpur
Advanced Engineering Mathematics Prof. Pratima Panigrahi Department of Mathematics Indian Institute of Technology, Kharagpur Lecture No. # 02 Vector Spaces, Subspaces, linearly Dependent/Independent of
More information(1) for all (2) for all and all
8. Linear mappings and matrices A mapping f from IR n to IR m is called linear if it fulfills the following two properties: (1) for all (2) for all and all Mappings of this sort appear frequently in the
More informationDefinition Suppose S R n, V R m are subspaces. A map U : S V is linear if
.6. Restriction of Linear Maps In this section, we restrict linear maps to subspaces. We observe that the notion of linearity still makes sense for maps whose domain and codomain are subspaces of R n,
More informationMathematics Department Stanford University Math 61CM/DM Inner products
Mathematics Department Stanford University Math 61CM/DM Inner products Recall the definition of an inner product space; see Appendix A.8 of the textbook. Definition 1 An inner product space V is a vector
More informationKevin James. MTHSC 3110 Section 2.1 Matrix Operations
MTHSC 3110 Section 2.1 Matrix Operations Notation Let A be an m n matrix, that is, m rows and n columns. We ll refer to the entries of A by their row and column indices. The entry in the i th row and j
More information4 Vector Spaces. 4.1 Basic Definition and Examples. Lecture 10
Lecture 10 4 Vector Spaces 4.1 Basic Definition and Examples Throughout mathematics we come across many types objects which can be added and multiplied by scalars to arrive at similar types of objects.
More informationCategories and Quantum Informatics: Hilbert spaces
Categories and Quantum Informatics: Hilbert spaces Chris Heunen Spring 2018 We introduce our main example category Hilb by recalling in some detail the mathematical formalism that underlies quantum theory:
More informationMatrix representation of a linear map
Matrix representation of a linear map As before, let e i = (0,..., 0, 1, 0,..., 0) T, with 1 in the i th place and 0 elsewhere, be standard basis vectors. Given linear map f : R n R m we get n column vectors
More informationLinear Algebra. Preliminary Lecture Notes
Linear Algebra Preliminary Lecture Notes Adolfo J. Rumbos c Draft date May 9, 29 2 Contents 1 Motivation for the course 5 2 Euclidean n dimensional Space 7 2.1 Definition of n Dimensional Euclidean Space...........
More informationEquality: Two matrices A and B are equal, i.e., A = B if A and B have the same order and the entries of A and B are the same.
Introduction Matrix Operations Matrix: An m n matrix A is an m-by-n array of scalars from a field (for example real numbers) of the form a a a n a a a n A a m a m a mn The order (or size) of A is m n (read
More information2: LINEAR TRANSFORMATIONS AND MATRICES
2: LINEAR TRANSFORMATIONS AND MATRICES STEVEN HEILMAN Contents 1. Review 1 2. Linear Transformations 1 3. Null spaces, range, coordinate bases 2 4. Linear Transformations and Bases 4 5. Matrix Representation,
More informationChapter Two Elements of Linear Algebra
Chapter Two Elements of Linear Algebra Previously, in chapter one, we have considered single first order differential equations involving a single unknown function. In the next chapter we will begin to
More informationMATH 167: APPLIED LINEAR ALGEBRA Chapter 2
MATH 167: APPLIED LINEAR ALGEBRA Chapter 2 Jesús De Loera, UC Davis February 1, 2012 General Linear Systems of Equations (2.2). Given a system of m equations and n unknowns. Now m n is OK! Apply elementary
More informationMath 4377/6308 Advanced Linear Algebra
2. Linear Transformations Math 4377/638 Advanced Linear Algebra 2. Linear Transformations, Null Spaces and Ranges Jiwen He Department of Mathematics, University of Houston jiwenhe@math.uh.edu math.uh.edu/
More informationMATH PRACTICE EXAM 1 SOLUTIONS
MATH 2359 PRACTICE EXAM SOLUTIONS SPRING 205 Throughout this exam, V and W will denote vector spaces over R Part I: True/False () For each of the following statements, determine whether the statement is
More informationOutline. Wiskunde 1: Linear Equations. About this course II. About this course I. About this course III. About this course IV. Exercises.
Outline Wiskunde 1: Linear Equations B. Jacobs Institute for Computing and Information Sciences Digital Security Version: spring 2012 Data fitting Stoichiometric B. Jacobs Version: spring 2012 Wiskunde
More informationLinear Algebra II. 2 Matrices. Notes 2 21st October Matrix algebra
MTH6140 Linear Algebra II Notes 2 21st October 2010 2 Matrices You have certainly seen matrices before; indeed, we met some in the first chapter of the notes Here we revise matrix algebra, consider row
More informationLinear Algebra. Preliminary Lecture Notes
Linear Algebra Preliminary Lecture Notes Adolfo J. Rumbos c Draft date April 29, 23 2 Contents Motivation for the course 5 2 Euclidean n dimensional Space 7 2. Definition of n Dimensional Euclidean Space...........
More informationMODEL ANSWERS TO THE FIRST QUIZ. 1. (18pts) (i) Give the definition of a m n matrix. A m n matrix with entries in a field F is a function
MODEL ANSWERS TO THE FIRST QUIZ 1. (18pts) (i) Give the definition of a m n matrix. A m n matrix with entries in a field F is a function A: I J F, where I is the set of integers between 1 and m and J is
More information3 - Vector Spaces Definition vector space linear space u, v,
3 - Vector Spaces Vectors in R and R 3 are essentially matrices. They can be vieed either as column vectors (matrices of size and 3, respectively) or ro vectors ( and 3 matrices). The addition and scalar
More informationMATH 20F: LINEAR ALGEBRA LECTURE B00 (T. KEMP)
MATH 20F: LINEAR ALGEBRA LECTURE B00 (T KEMP) Definition 01 If T (x) = Ax is a linear transformation from R n to R m then Nul (T ) = {x R n : T (x) = 0} = Nul (A) Ran (T ) = {Ax R m : x R n } = {b R m
More informationLINEAR ALGEBRA REVIEW
LINEAR ALGEBRA REVIEW When we define a term, we put it in boldface. This is a very compressed review; please read it very carefully and be sure to ask questions on parts you aren t sure of. x 1 WedenotethesetofrealnumbersbyR.
More informationLecture 22: Section 4.7
Lecture 22: Section 47 Shuanglin Shao December 2, 213 Row Space, Column Space, and Null Space Definition For an m n, a 11 a 12 a 1n a 21 a 22 a 2n A = a m1 a m2 a mn, the vectors r 1 = [ a 11 a 12 a 1n
More informationLinear Algebra (Math-324) Lecture Notes
Linear Algebra (Math-324) Lecture Notes Dr. Ali Koam and Dr. Azeem Haider September 24, 2017 c 2017,, Jazan All Rights Reserved 1 Contents 1 Real Vector Spaces 6 2 Subspaces 11 3 Linear Combination and
More informationMATH SOLUTIONS TO PRACTICE PROBLEMS - MIDTERM I. 1. We carry out row reduction. We begin with the row operations
MATH 2 - SOLUTIONS TO PRACTICE PROBLEMS - MIDTERM I. We carry out row reduction. We begin with the row operations yielding the matrix This is already upper triangular hence The lower triangular matrix
More informationSpring 2015 Midterm 1 03/04/15 Lecturer: Jesse Gell-Redman
Math 0 Spring 05 Midterm 03/04/5 Lecturer: Jesse Gell-Redman Time Limit: 50 minutes Name (Print): Teaching Assistant This exam contains pages (including this cover page) and 5 problems. Check to see if
More informationa (b + c) = a b + a c
Chapter 1 Vector spaces In the Linear Algebra I module, we encountered two kinds of vector space, namely real and complex. The real numbers and the complex numbers are both examples of an algebraic structure
More informationLinear and Bilinear Algebra (2WF04) Jan Draisma
Linear and Bilinear Algebra (2WF04) Jan Draisma CHAPTER 1 Basics We will assume familiarity with the terms field, vector space, subspace, basis, dimension, and direct sums. If you are not sure what these
More informationSystems of Linear Equations
LECTURE 6 Systems of Linear Equations You may recall that in Math 303, matrices were first introduced as a means of encapsulating the essential data underlying a system of linear equations; that is to
More informationMAT 2037 LINEAR ALGEBRA I web:
MAT 237 LINEAR ALGEBRA I 2625 Dokuz Eylül University, Faculty of Science, Department of Mathematics web: Instructor: Engin Mermut http://kisideuedutr/enginmermut/ HOMEWORK 2 MATRIX ALGEBRA Textbook: Linear
More informationMath 1553 Introduction to Linear Algebra
Math 1553 Introduction to Linear Algebra Lecture Notes Chapter 2 Matrix Algebra School of Mathematics The Georgia Institute of Technology Math 1553 Lecture Notes for Chapter 2 Introduction, Slide 1 Section
More informationMath 205, Summer I, Week 3a (continued): Chapter 4, Sections 5 and 6. Week 3b. Chapter 4, [Sections 7], 8 and 9
Math 205, Summer I, 2016 Week 3a (continued): Chapter 4, Sections 5 and 6. Week 3b Chapter 4, [Sections 7], 8 and 9 4.5 Linear Dependence, Linear Independence 4.6 Bases and Dimension 4.7 Change of Basis,
More informationMath 321: Linear Algebra
Math 32: Linear Algebra T. Kapitula Department of Mathematics and Statistics University of New Mexico September 8, 24 Textbook: Linear Algebra,by J. Hefferon E-mail: kapitula@math.unm.edu Prof. Kapitula,
More informationReview of linear algebra
Review of linear algebra 1 Vectors and matrices We will just touch very briefly on certain aspects of linear algebra, most of which should be familiar. Recall that we deal with vectors, i.e. elements of
More information