Lecture 23: 6.1 Inner Products
|
|
- Muriel Marsh
- 6 years ago
- Views:
Transcription
1 Lecture 23: 6.1 Inner Products Wei-Ta Chu 2008/12/17
2 Definition An inner product on a real vector space V is a function that associates a real number u, vwith each pair of vectors u and v in V in such a way that the following axioms are satisfied for all vectors u, v, and w in V and all scalars k. u, v= v, u u + v, w= u, w+ v, w ku, v= k u, v u, u0 and u, u= 0 if and only if u = 0 A real vector space with an inner product is called a real inner product space. 2008/12/17 Elementary Linear Algebra 2
3 Euclidean Inner Product on R n If u = (u 1, u 2,, u n ) and v = (v 1, v 2,, v n ) are vectors in R n, then the formula v, u= u v = u 1 v 1 + u 2 v u n v n defines v, uto be the Euclidean product on R n. The four inner product axioms hold by Theorem /12/17 Elementary Linear Algebra 3
4 Properties of Euclidean Inner Product Theorem If u, v and w are vectors in R n and k is any scalar, then u v = v u (u + v) w = u w + v w (k u) v = k (u v) v v 0; Further, v v = 0 if and only if v = 0 Example (3u + 2v) (4u + v) = (3u) (4u + v) + (2v) (4u + v ) = (3u) (4u) + (3u) v + (2v) (4u) + (2v) v =12(u u) + 11(u v) + 2(v v) 2008/12/17 Elementary Linear Algebra 4
5 Euclidean Inner Product vs. Inner Product The Euclidean inner product is the most important inner product on R n. However, there are various applications in which it is desirable to modify the Euclidean inner product by weighting its terms differently. More precisely, if w 1,w,,w 2,,w n are positive real numbers, and if u=(u 1,u 2,,u n ) and v=(v 1,v 2,,v n ) are vectors in R n, then it can be shown which is called weighted Euclidean inner product with weights w 1,w 2,,w n 2008/12/17 Elementary Linear Algebra 5
6 Example Suppose that some physical experiment can produce any of n possible numerical values x 1,x 2,,x n. We perform m repetitions of the experiment and yield these values with various frequencies; that is, x 1 occurs f 1 times, x 2 occurs f 2 times, and so forth. f 1 +f+ +f 2 + +f n =m. Thus, the arithmetic average, or mean, is 2008/12/17 Elementary Linear Algebra 6
7 Example If we let f=(f 1,f 2,,f n ), x=(x 1,x 2,,x n ), w 1 =w 2 = =w n =1/m Then this equation can be expressed as the weighted inner product 2008/12/17 Elementary Linear Algebra 7
8 Weighted Euclidean Product Let u = (u 1, u 2 ) and v = (v 1, v 2 ) be vectors in R 2. Verify that the weighted Euclidean inner product u, v= 3u 1 v 1 + 2u 2 v 2 satisfies the four product axioms. Solution: Note first that if u and v are interchanged in this equation, the right side remains the same. Therefore, u, v= v, u. If w = (w 1, w 2 ), then u + v, w= 3(u 1 +v 1 )w 1 + 2(u 2 +v 2 )w 2 = (3u 1 w 1 + 2u 2 w 2 ) + (3v 1 w 1 + 2v 2 w 2 )= u, w+ v, w which establishes the second axiom. 2008/12/17 Elementary Linear Algebra 8
9 Weighted Euclidean Product ku, v=3(ku 1 )v 1 + 2(ku 2 )v 2 = k(3u 1 v 1 + 2u 2 v 2 ) = k u, v which establishes the third axiom. v, v= 3v 1 v 1 +2v 2 v 2 = 3v v 22.Obviously, v, v= 3v v Furthermore, v, v= 3v v 22 = 0 if and only if v 1 = v 2 = 0, That is, if and only if v = (v 1,v 2 )=0. Thus, the fourth axiom is satisfied. 2008/12/17 Elementary Linear Algebra 9
10 Definition If V is an inner product space, then the norm (or length) of a vector u in V is denoted by u and is defined by u = u, u ½ The distance between two points (vectors) u and v is denoted by d(u,v) and is defined by d(u, v) = u v If a vector has norm 1, then we say that it is a unit vector. 2008/12/17 Elementary Linear Algebra 10
11 Norm and Distance in R n If u = (u 1, u 2,, u n ) and v = (v 1, v 2,, v n ) are vectors in R n with the Euclidean inner product, then d 1/ 2 1/ 2 ( u, v) u v u v, u v ( u v ) ( u v ) ( u v ) ( u v )... ( u v ) n n 2008/12/17 Elementary Linear Algebra 11
12 Weighted Euclidean Inner Product The norm and distance depend on the inner product used. If the inner product is changed, then the norms and distances between vectors also change. For example, for the vectors u = (1,0) and v = (0,1) in R 2 with the Euclidean inner product, we have u 1 and d( u, v) u v (1, 1) ( 1) However, if we change to the weighted Euclidean inner product u, v= 3u 1 v 1 + 2u 2 v 2, then we obtain u u, u 1/ 2 ( ) 1/ 2 3 d( u, v) u v (1, 1),(1, 1) 1/ 2 [ ( 1) ( 1)] 1/ /12/17 Elementary Linear Algebra 12
13 Unit Circles and Spheres in Inner Product Space If V is an inner product space, then the set of points in V that satisfy u = 1 is called the unite sphere or sometimes the unit circle in V. In R 2 and R 3 these are the points that lie 1 unit away form the origin. 2008/12/17 Elementary Linear Algebra 13
14 Unit Circles in R 2 Sketch the unit circle in an xy-coordinate system in R 2 using the Euclidean inner product u, v= u 1 v 1 + u 2 v 2 Sketch the unit circle in an xy-coordinate system in R 2 using the Euclidean inner product u, v= 1/9u 1 v 1 + 1/4u 2 v 2 Solution If u = (x,y), then u = u, u ½ = (x 2 + y 2 ) ½, so the equation of the unit circle is x 2 + y 2 = 1. If u = (x,y), then u = u, u ½ = (1/9x 2 + 1/4y 2 ) ½, so the equation of the unit circle is x 2 /9 + y 2 /4 = /12/17 Elementary Linear Algebra 14
15 Inner Products Generated by Matrices u 1 v 1 u 2 v 2 Let u and v= be vectors in R n (expressed as n1 : : un vn matrices), and let A be an invertible nn matrix. If u v is the Euclidean inner product on R n, then the formula u, v= Au Av defines an inner product; it is called the inner product on R n generated by A. Recalling that the Euclidean inner product u v can be written as the matrix product v T u, the above formula can be written in the alternative form u, v= (Av) T Au, or equivalently, u, v= v T A T Au 2008/12/17 Elementary Linear Algebra 15
16 Inner Product Generated by the Identity Matrix The inner product on R n generated by the nn identity matrix is the Euclidean inner product: Let A = I, we have u, v= Iu Iv = u v The weighted Euclidean inner product u, v= 3u 1 v 1 + 2u 2 v 2 is the inner product on R 2 generated by since 3 0 A u 3 0 u u, v v u u v 1 v2 v 1 v2 3u1v 1 2 u /12/17 Elementary Linear Algebra 16
17 Inner Product Generated by the Identity Matrix In general, the weighted Euclidean inner product u, v= w 1 u 1 v 1 + w 2 u 2 v w n u n v n is the inner product on R n generated by 2008/12/17 Elementary Linear Algebra 17
18 An Inner Product on M 22 If U u u and V v v u u v v are any two 22 matrices, then U, V= tr(u T V) = tr(v T U) = u 1 v 1 + u 2 v 2 + u 3 v 3 + u 4 v 4 defines an inner product on M 22 For example, if U and V then U, V= 1(-1)+2(0) + 3(3) + 4(2) = 16 The norm of a matrix U relative to this inner product is U U, U u u u u 1/ and the unit sphere in this space consists of all 22 matrices U whose entries satisfy the equation U = 1, which on squaring yields u 12 + u 22 + u 32 + u 42 = /12/17 Elementary Linear Algebra 18
19 An Inner Product on P 2 If p = a 0 + a 1 x + a 2 x 2 and q = b 0 + b 1 x + b 2 x 2 are any two vectors in P 2, then the following formula defines an inner product on P 2 : p, q= a 0 b 0 + a 1 b 1 + a 2 b 2 The norm of the polynomial p relative to this inner product is 1/ p p, p a a a and the unit sphere in this space consists of all polynomials p in P 2 whose coefficients satisfy the equation p = 1, which on squaring yields a 02 + a 12 + a 22 =1 2008/12/17 Elementary Linear Algebra 19
20 Theorem (Properties of Inner Products) If u, v, and w are vectors in a real inner product space, and k is any scalar, then: 0, v= v, 0= 0 u, v + w= u, v+ u, w u, kv=k u, v u v, w= u, w v, w u, v w= u, v u, w 2008/12/17 Elementary Linear Algebra 20
21 Example u 2v, 3u + 4v = u, 3u + 4v 2v, 3u+4v = u, 3u+ u, 4v 2v, 3u 2v, 4v = 3 u, u+ 4 u, v 6 v, u 8 v, v = 3 u u, v 6 u, v 8 v 2 = 3 u 2 2 u, v 8 v /12/17 Elementary Linear Algebra 21
22 Example We are guaranteed without any further proof that the five properties given in Theorem are true for the inner product on R n generated by any matrix A. u, v + w= (v+w) T A T Au =(v T +w T )A T Au =(v T A T Au) + (w T A T Au) = u, v+ u, w [Property of transpose] [Property of matrix multiplication] 2008/12/17 Elementary Linear Algebra 22
23 Lecture 23: 6.2 Angle and Orthogonality Wei-Ta Chu 2008/12/17
24 Theorem Theorem (Cauchy-Schwarz Inequality) If u and v are vectors in a real inner product space, then u, v u v The inequality can be written in the following two forms The Cauchy-Schwarz inequality for R n (Theorem 4.1.3) follows as a special case of this theorem by taking u, vto be the Euclidean inner product u v. 2008/12/17 Elementary Linear Algebra 24
25 Theorem Theorem (Properties of Length) If u and v are vectors in an inner product space V, and if k is any scalar, then : u 0 u = 0 if and only if u = 0 ku = k u u + v u + v (Triangle inequality) Proof of (d) (Property of absolute value) (Theorem 6.2.1) 2008/12/17 Elementary Linear Algebra 25
26 Theorem Theorem (Properties of Distance) If u, v, and w are vectors in an inner product space V, and if k is any scalar, then: d(u, v) 0 d(u, v) = 0 if and only if u = v d(u, v) = d(v, u) d(u, v) d(u, w) + d(w, v) (Triangle inequality) 2008/12/17 Elementary Linear Algebra 26
27 Angle Between Vectors Cauchy-Schwarz inequality can be used to define angles in general inner product cases. We define to be the angle between u and v. 2008/12/17 Elementary Linear Algebra 27
28 Example Let R 4 have the Euclidean inner product. Find the cosine of the angle between the vectors u = (4, 3, 1, -2) and v = (-2, 1, 2, 3). 2008/12/17 Elementary Linear Algebra 28
29 Orthogonality Definition Two vectors u and v in an inner product space are called orthogonal if u, v= 0. Example (U, V= tr(u T V) = tr(v T U) = u 1 v 1 + u 2 v 2 + u 3 v 3 + u 4 v 4 ) If M 22 has the inner project defined previously, then the matrices U and are orthogonal, since U, V= 1(0) + 0(2) + 1(0) + 1(0) = 0. V 2008/12/17 Elementary Linear Algebra 29
30 Orthogonal Vectors in P 2 Let P 2 have the inner product p, q p( x) q( x) dx and let p = x and q = x 2. 1 Then p q 1 1 1/ 2 1 1/ 2 1/ 2 2 p, p xxdx x dx / 2 1 1/ 2 1/ q, q x x dx x dx p, q xx dx x dx because p, q= 0, the vectors p = x and q = x 2 are orthogonal relative to the given inner product /12/17 Elementary Linear Algebra 30
31 Theorem (Generalized Theorem of Pythagoras) If u and v are orthogonal vectors in an inner product space, then Proof u + v 2 = u 2 + v /12/17 Elementary Linear Algebra 31
32 Example Since p = x and q = x 2 are orthogonal relative to the inner product 1 p, q p( x) q( x) dx on P 2. 1 It follows from the Theorem of Pythagoras that p + q 2 = p 2 + q 2 Thus, from the previous example: p+ q ( ) ( ) We can check this result by direct integration: p+ q p+ q, p+ q ( x x )( x x ) dx x dx 2 x dx x dx /12/17 Elementary Linear Algebra 32
33 Orthogonality Definition Let W be a subspace of an inner product space V. A vector u in V is said to be orthogonal to W if it is orthogonal to every vector in W, and the set of all vectors in V that are orthogonal to W is called the orthogonal complement ( 正交補餘 ) of W. If V is a plane through the origin of R 3 with Euclidean inner product, then the set of all vectors that are orthogonal to every vector in V forms the line L through the origin that is perpendicular to V. L V 2008/12/17 Elementary Linear Algebra 33
34 Theorem Theorem (Properties of Orthogonal Complements) If W is a subspace of a finite-dimensional inner product space V, then: W is a subspace of V. (read W perp ) The only vector common to W and W is 0; that is,w W = 0. The orthogonal complement of W is W; that is, (W ) = W. 2008/12/17 Elementary Linear Algebra 34
35 Proof of Theorem 6.2.5(a) Note first that 0, w=0 for every vector w in W, so W contains at least the zero vector. We want to show that the sum of two vectors in W is orthogonal to every vector in W (closed under addition) and that any scalar multiple of a vector in W is orthogonal to every vector in W (closed under scalar multiplication). 2008/12/17 Elementary Linear Algebra 35
36 Proof of Theorem 6.2.5(a) Let u and v be any vector in W, let k be any scalar, and let w be any vector in W. Then from the definition of W, we have u, w=0 and v, w=0. Using the basic properties of the inner product, we have u+v, w= u, w+ v, w= = 0 ku, w= ku, w= k(0) = 0 Which proves that u+v and ku are in W. 2008/12/17 Elementary Linear Algebra 36
37 Proof of Theorem 6.2.5(b) The only vector common to W and W is 0; that is,w W = 0. If v is common to W and W, then v, v=0, which implies that v=0 by Axiom 4 for inner products. 2008/12/17 Elementary Linear Algebra 37
38 Theorem Theorem If A is an mn matrix, then: The nullspace of A and the row space of A are orthogonal complements in R n with respect to the Euclidean inner product. The nullspace of A T and the column space of A are orthogonal complements in R m with respect to the Euclidean inner product. 2008/12/17 Elementary Linear Algebra 38
39 Proof of Theorem 6.2.6(a) We must show that if a vector v is orthogonal to every vector in the row space, then Av=0, and conversely, that if Av=0, then v is orthogonal to every vector in the row space. Assume that v is orthogonal to every vector in the row space of A. Then in particular, v is orthogonal to the row vectors r 1, r 2,, r m of A; that is 2008/12/17 Elementary Linear Algebra 39
40 Proof of Theorem 6.2.6(a) The linear system Ax=0 can be expressed in dot product notation as And it follows that v is a solution of this system and hence lies in the nullspace of A. 2008/12/17 Elementary Linear Algebra 40
41 Proof of Theorem 6.2.6(a) Conversely, assume that v is a vector in the nullspace of A, so Av=0. It follows that But if r is any vector in the row space of A, then r is expressible as a linear combination of the row vectors of A, say Thus Which proves that v is orthogonal to every vector in the row space of A. 2008/12/17 Elementary Linear Algebra 41
42 Example (Basis for an Orthogonal Complement) Let W be the subspace of R 5 spanned by the vectors w 1 =(2, 2, -1, 0, 1), w 2 =(-1, -1, 2, -3, 1), w 3 =(1, 1, -2, 0, - 1), w 4 =(0, 0, 1, 1, 1). Find a basis for the orthogonal complement of W. Solution The space W spanned by w 1, w 2, w 3, and w 4 is the same as the row space of the matrix A By Theorem 6.2.6, the nullspace of A is the orthogonal complement of W. In Example 4 of Section 5.5 we showed that v 0 and 1 1 v form a basis for this nullspace. Thus, vectors v 1 = (-1, 1, 0, 0, 0) and v 2 = (-1, 0, -1, 0, 1) form a basis for the orthogonal complement of W. 2008/12/17 Elementary Linear Algebra 42
43 Remarks In any inner product space V, the zero space {0} and the entire space V are orthogonal complements. If A is an matrix, to say that Ax=0 has only the trivial solution is equivalent to saying that the orthogonal complement of the nullspace of A is all of R n, or equivalently, that the row space of A is all of R n. 2008/12/17 Elementary Linear Algebra 43
44 Theorem (Equivalent Statements) If A is an mn matrix, and if T A : R n R n is multiplication by A, then the following are equivalent: A is invertible. Ax = 0 has only the trivial solution. The reduced row-echelon form of A is I n. A is expressible as a product of elementary matrices. Ax = b is consistent for every n1 matrix b. Ax = b has exactly one solution for every n1 matrix b. det(a) 0. The range of T A is R n. T A is one-to-one. The column vectors of A are linearly independent. The row vectors of A are linearly independent. The column vectors of A span R n. The row vectors of A span R n. The column vectors of A form a basis for R n. The row vectors of A form a basis for R n. A has rank n. A has nullity 0. The orthogonal complement of the nullspace of A is R n. The orthogonal complement of the row of A is {0}. 2008/12/17 Elementary Linear Algebra 44
Lecture 20: 6.1 Inner Products
Lecture 0: 6.1 Inner Products Wei-Ta Chu 011/1/5 Definition An inner product on a real vector space V is a function that associates a real number u, v with each pair of vectors u and v in V in such a way
More informationLINEAR ALGEBRA W W L CHEN
LINEAR ALGEBRA W W L CHEN c W W L Chen, 1997, 2008. This chapter is available free to all individuals, on the understanding that it is not to be used for financial gain, and may be downloaded and/or photocopied,
More informationORTHOGONALITY AND LEAST-SQUARES [CHAP. 6]
ORTHOGONALITY AND LEAST-SQUARES [CHAP. 6] Inner products and Norms Inner product or dot product of 2 vectors u and v in R n : u.v = u 1 v 1 + u 2 v 2 + + u n v n Calculate u.v when u = 1 2 2 0 v = 1 0
More informationMATH 304 Linear Algebra Lecture 19: Least squares problems (continued). Norms and inner products.
MATH 304 Linear Algebra Lecture 19: Least squares problems (continued). Norms and inner products. Orthogonal projection Theorem 1 Let V be a subspace of R n. Then any vector x R n is uniquely represented
More informationMATH 323 Linear Algebra Lecture 12: Basis of a vector space (continued). Rank and nullity of a matrix.
MATH 323 Linear Algebra Lecture 12: Basis of a vector space (continued). Rank and nullity of a matrix. Basis Definition. Let V be a vector space. A linearly independent spanning set for V is called a basis.
More informationRecall: Dot product on R 2 : u v = (u 1, u 2 ) (v 1, v 2 ) = u 1 v 1 + u 2 v 2, u u = u u 2 2 = u 2. Geometric Meaning:
Recall: Dot product on R 2 : u v = (u 1, u 2 ) (v 1, v 2 ) = u 1 v 1 + u 2 v 2, u u = u 2 1 + u 2 2 = u 2. Geometric Meaning: u v = u v cos θ. u θ v 1 Reason: The opposite side is given by u v. u v 2 =
More informationMATH 304 Linear Algebra Lecture 18: Orthogonal projection (continued). Least squares problems. Normed vector spaces.
MATH 304 Linear Algebra Lecture 18: Orthogonal projection (continued). Least squares problems. Normed vector spaces. Orthogonality Definition 1. Vectors x,y R n are said to be orthogonal (denoted x y)
More informationChapter 2. General Vector Spaces. 2.1 Real Vector Spaces
Chapter 2 General Vector Spaces Outline : Real vector spaces Subspaces Linear independence Basis and dimension Row Space, Column Space, and Nullspace 2 Real Vector Spaces 2 Example () Let u and v be vectors
More informationChapter 5 Eigenvalues and Eigenvectors
Chapter 5 Eigenvalues and Eigenvectors Outline 5.1 Eigenvalues and Eigenvectors 5.2 Diagonalization 5.3 Complex Vector Spaces 2 5.1 Eigenvalues and Eigenvectors Eigenvalue and Eigenvector If A is a n n
More information4.3 - Linear Combinations and Independence of Vectors
- Linear Combinations and Independence of Vectors De nitions, Theorems, and Examples De nition 1 A vector v in a vector space V is called a linear combination of the vectors u 1, u,,u k in V if v can be
More informationInner products. Theorem (basic properties): Given vectors u, v, w in an inner product space V, and a scalar k, the following properties hold:
Inner products Definition: An inner product on a real vector space V is an operation (function) that assigns to each pair of vectors ( u, v) in V a scalar u, v satisfying the following axioms: 1. u, v
More informationMATH 20F: LINEAR ALGEBRA LECTURE B00 (T. KEMP)
MATH 20F: LINEAR ALGEBRA LECTURE B00 (T KEMP) Definition 01 If T (x) = Ax is a linear transformation from R n to R m then Nul (T ) = {x R n : T (x) = 0} = Nul (A) Ran (T ) = {Ax R m : x R n } = {b R m
More informationRow Space, Column Space, and Nullspace
Row Space, Column Space, and Nullspace MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 2015 Introduction Every matrix has associated with it three vector spaces: row space
More informationSystems of Linear Equations
Systems of Linear Equations Math 108A: August 21, 2008 John Douglas Moore Our goal in these notes is to explain a few facts regarding linear systems of equations not included in the first few chapters
More information1. General Vector Spaces
1.1. Vector space axioms. 1. General Vector Spaces Definition 1.1. Let V be a nonempty set of objects on which the operations of addition and scalar multiplication are defined. By addition we mean a rule
More informationb 1 b 2.. b = b m A = [a 1,a 2,...,a n ] where a 1,j a 2,j a j = a m,j Let A R m n and x 1 x 2 x = x n
Lectures -2: Linear Algebra Background Almost all linear and nonlinear problems in scientific computation require the use of linear algebra These lectures review basic concepts in a way that has proven
More informationINNER PRODUCT SPACE. Definition 1
INNER PRODUCT SPACE Definition 1 Suppose u, v and w are all vectors in vector space V and c is any scalar. An inner product space on the vectors space V is a function that associates with each pair of
More informationMath 3191 Applied Linear Algebra
Math 191 Applied Linear Algebra Lecture 1: Inner Products, Length, Orthogonality Stephen Billups University of Colorado at Denver Math 191Applied Linear Algebra p.1/ Motivation Not all linear systems have
More informationLecture 21: 5.6 Rank and Nullity
Lecture 21: 5.6 Rank and Nullity Wei-Ta Chu 2008/12/5 Rank and Nullity Definition The common dimension of the row and column space of a matrix A is called the rank ( 秩 ) of A and is denoted by rank(a);
More informationMAT Linear Algebra Collection of sample exams
MAT 342 - Linear Algebra Collection of sample exams A-x. (0 pts Give the precise definition of the row echelon form. 2. ( 0 pts After performing row reductions on the augmented matrix for a certain system
More informationChapter 3 Transformations
Chapter 3 Transformations An Introduction to Optimization Spring, 2014 Wei-Ta Chu 1 Linear Transformations A function is called a linear transformation if 1. for every and 2. for every If we fix the bases
More informationThe Four Fundamental Subspaces
The Four Fundamental Subspaces Introduction Each m n matrix has, associated with it, four subspaces, two in R m and two in R n To understand their relationships is one of the most basic questions in linear
More informationMath 350 Fall 2011 Notes about inner product spaces. In this notes we state and prove some important properties of inner product spaces.
Math 350 Fall 2011 Notes about inner product spaces In this notes we state and prove some important properties of inner product spaces. First, recall the dot product on R n : if x, y R n, say x = (x 1,...,
More information2. Linear algebra. matrices and vectors. linear equations. range and nullspace of matrices. function of vectors, gradient and Hessian
FE661 - Statistical Methods for Financial Engineering 2. Linear algebra Jitkomut Songsiri matrices and vectors linear equations range and nullspace of matrices function of vectors, gradient and Hessian
More informationMATH 240 Spring, Chapter 1: Linear Equations and Matrices
MATH 240 Spring, 2006 Chapter Summaries for Kolman / Hill, Elementary Linear Algebra, 8th Ed. Sections 1.1 1.6, 2.1 2.2, 3.2 3.8, 4.3 4.5, 5.1 5.3, 5.5, 6.1 6.5, 7.1 7.2, 7.4 DEFINITIONS Chapter 1: Linear
More informationMath 313 Chapter 5 Review
Math 313 Chapter 5 Review Howard Anton, 9th Edition May 2010 Do NOT write on me! Contents 1 5.1 Real Vector Spaces 2 2 5.2 Subspaces 3 3 5.3 Linear Independence 4 4 5.4 Basis and Dimension 5 5 5.5 Row
More informationhomogeneous 71 hyperplane 10 hyperplane 34 hyperplane 69 identity map 171 identity map 186 identity map 206 identity matrix 110 identity matrix 45
address 12 adjoint matrix 118 alternating 112 alternating 203 angle 159 angle 33 angle 60 area 120 associative 180 augmented matrix 11 axes 5 Axiom of Choice 153 basis 178 basis 210 basis 74 basis test
More information2. Every linear system with the same number of equations as unknowns has a unique solution.
1. For matrices A, B, C, A + B = A + C if and only if A = B. 2. Every linear system with the same number of equations as unknowns has a unique solution. 3. Every linear system with the same number of equations
More informationx 1 x 2. x 1, x 2,..., x n R. x n
WEEK In general terms, our aim in this first part of the course is to use vector space theory to study the geometry of Euclidean space A good knowledge of the subject matter of the Matrix Applications
More information6 Inner Product Spaces
Lectures 16,17,18 6 Inner Product Spaces 6.1 Basic Definition Parallelogram law, the ability to measure angle between two vectors and in particular, the concept of perpendicularity make the euclidean space
More informationMath 302 Outcome Statements Winter 2013
Math 302 Outcome Statements Winter 2013 1 Rectangular Space Coordinates; Vectors in the Three-Dimensional Space (a) Cartesian coordinates of a point (b) sphere (c) symmetry about a point, a line, and a
More informationLinear Equations and Vectors
Chapter Linear Equations and Vectors Linear Algebra, Fall 6 Matrices and Systems of Linear Equations Figure. Linear Algebra, Fall 6 Figure. Linear Algebra, Fall 6 Figure. Linear Algebra, Fall 6 Unique
More informationMath 290, Midterm II-key
Math 290, Midterm II-key Name (Print): (first) Signature: (last) The following rules apply: There are a total of 20 points on this 50 minutes exam. This contains 7 pages (including this cover page) and
More informationDefinitions for Quizzes
Definitions for Quizzes Italicized text (or something close to it) will be given to you. Plain text is (an example of) what you should write as a definition. [Bracketed text will not be given, nor does
More informationAssignment 1 Math 5341 Linear Algebra Review. Give complete answers to each of the following questions. Show all of your work.
Assignment 1 Math 5341 Linear Algebra Review Give complete answers to each of the following questions Show all of your work Note: You might struggle with some of these questions, either because it has
More informationStudy Guide for Linear Algebra Exam 2
Study Guide for Linear Algebra Exam 2 Term Vector Space Definition A Vector Space is a nonempty set V of objects, on which are defined two operations, called addition and multiplication by scalars (real
More informationInner Product Spaces 5.2 Inner product spaces
Inner Product Spaces 5.2 Inner product spaces November 15 Goals Concept of length, distance, and angle in R 2 or R n is extended to abstract vector spaces V. Sucn a vector space will be called an Inner
More informationApplied Linear Algebra in Geoscience Using MATLAB
Applied Linear Algebra in Geoscience Using MATLAB Contents Getting Started Creating Arrays Mathematical Operations with Arrays Using Script Files and Managing Data Two-Dimensional Plots Programming in
More informationConceptual Questions for Review
Conceptual Questions for Review Chapter 1 1.1 Which vectors are linear combinations of v = (3, 1) and w = (4, 3)? 1.2 Compare the dot product of v = (3, 1) and w = (4, 3) to the product of their lengths.
More informationLecture 16: 9.2 Geometry of Linear Operators
Lecture 16: 9.2 Geometry of Linear Operators Wei-Ta Chu 2008/11/19 Theorem 9.2.1 If T: R 2 R 2 is multiplication by an invertible matrix A, then the geometric effect of T is the same as an appropriate
More informationTypical Problem: Compute.
Math 2040 Chapter 6 Orhtogonality and Least Squares 6.1 and some of 6.7: Inner Product, Length and Orthogonality. Definition: If x, y R n, then x y = x 1 y 1 +... + x n y n is the dot product of x and
More informationMTH 2032 SemesterII
MTH 202 SemesterII 2010-11 Linear Algebra Worked Examples Dr. Tony Yee Department of Mathematics and Information Technology The Hong Kong Institute of Education December 28, 2011 ii Contents Table of Contents
More informationMATH 304 Linear Algebra Lecture 23: Diagonalization. Review for Test 2.
MATH 304 Linear Algebra Lecture 23: Diagonalization. Review for Test 2. Diagonalization Let L be a linear operator on a finite-dimensional vector space V. Then the following conditions are equivalent:
More informationLinear Algebra Highlights
Linear Algebra Highlights Chapter 1 A linear equation in n variables is of the form a 1 x 1 + a 2 x 2 + + a n x n. We can have m equations in n variables, a system of linear equations, which we want to
More informationLinear Algebra Massoud Malek
CSUEB Linear Algebra Massoud Malek Inner Product and Normed Space In all that follows, the n n identity matrix is denoted by I n, the n n zero matrix by Z n, and the zero vector by θ n An inner product
More informationLinear Algebra. Session 12
Linear Algebra. Session 12 Dr. Marco A Roque Sol 08/01/2017 Example 12.1 Find the constant function that is the least squares fit to the following data x 0 1 2 3 f(x) 1 0 1 2 Solution c = 1 c = 0 f (x)
More informationMath 4A Notes. Written by Victoria Kala Last updated June 11, 2017
Math 4A Notes Written by Victoria Kala vtkala@math.ucsb.edu Last updated June 11, 2017 Systems of Linear Equations A linear equation is an equation that can be written in the form a 1 x 1 + a 2 x 2 +...
More informationFinal Examination 201-NYC-05 - Linear Algebra I December 8 th, and b = 4. Find the value(s) of a for which the equation Ax = b
Final Examination -NYC-5 - Linear Algebra I December 8 th 7. (4 points) Let A = has: (a) a unique solution. a a (b) infinitely many solutions. (c) no solution. and b = 4. Find the value(s) of a for which
More informationChapter 6. Orthogonality and Least Squares
Chapter 6 Orthogonality and Least Squares Section 6.1 Inner Product, Length, and Orthogonality Orientation Recall: This course is about learning to: Solve the matrix equation Ax = b Solve the matrix equation
More informationAlgebra II. Paulius Drungilas and Jonas Jankauskas
Algebra II Paulius Drungilas and Jonas Jankauskas Contents 1. Quadratic forms 3 What is quadratic form? 3 Change of variables. 3 Equivalence of quadratic forms. 4 Canonical form. 4 Normal form. 7 Positive
More informationThe Gram-Schmidt Process 1
The Gram-Schmidt Process In this section all vector spaces will be subspaces of some R m. Definition.. Let S = {v...v n } R m. The set S is said to be orthogonal if v v j = whenever i j. If in addition
More informationLinear Analysis Lecture 5
Linear Analysis Lecture 5 Inner Products and V Let dim V < with inner product,. Choose a basis B and let v, w V have coordinates in F n given by x 1. x n and y 1. y n, respectively. Let A F n n be the
More informationLecture 11: Vector space and subspace
Lecture : Vector space and subspace Vector space. R n space Definition.. The space R n consists of all column vector v with n real components, i.e. R n = { v : v = [v,v 2,...,v n ] T, v j R,j =,2,...,n
More informationDefinition 1. A set V is a vector space over the scalar field F {R, C} iff. there are two operations defined on V, called vector addition
6 Vector Spaces with Inned Product Basis and Dimension Section Objective(s): Vector Spaces and Subspaces Linear (In)dependence Basis and Dimension Inner Product 6 Vector Spaces and Subspaces Definition
More informationInner Product Spaces 6.1 Length and Dot Product in R n
Inner Product Spaces 6.1 Length and Dot Product in R n Summer 2017 Goals We imitate the concept of length and angle between two vectors in R 2, R 3 to define the same in the n space R n. Main topics are:
More informationElementary Linear Algebra Review for Exam 2 Exam is Monday, November 16th.
Elementary Linear Algebra Review for Exam Exam is Monday, November 6th. The exam will cover sections:.4,..4, 5. 5., 7., the class notes on Markov Models. You must be able to do each of the following. Section.4
More information1. Let m 1 and n 1 be two natural numbers such that m > n. Which of the following is/are true?
. Let m and n be two natural numbers such that m > n. Which of the following is/are true? (i) A linear system of m equations in n variables is always consistent. (ii) A linear system of n equations in
More informationReview of Some Concepts from Linear Algebra: Part 2
Review of Some Concepts from Linear Algebra: Part 2 Department of Mathematics Boise State University January 16, 2019 Math 566 Linear Algebra Review: Part 2 January 16, 2019 1 / 22 Vector spaces A set
More informationLINEAR ALGEBRA REVIEW
LINEAR ALGEBRA REVIEW JC Stuff you should know for the exam. 1. Basics on vector spaces (1) F n is the set of all n-tuples (a 1,... a n ) with a i F. It forms a VS with the operations of + and scalar multiplication
More informationChapter 3: Vector Spaces x1: Basic concepts Basic idea: a vector space V is a collection of things you can add together, and multiply by scalars (= nu
Math 314 Topics for second exam Technically, everything covered by the rst exam plus Chapter 2 x6 Determinants (Square) matrices come in two avors: invertible (all Ax = b have a solution) and noninvertible
More informationEXERCISE SET 5.1. = (kx + kx + k, ky + ky + k ) = (kx + kx + 1, ky + ky + 1) = ((k + )x + 1, (k + )y + 1)
EXERCISE SET 5. 6. The pair (, 2) is in the set but the pair ( )(, 2) = (, 2) is not because the first component is negative; hence Axiom 6 fails. Axiom 5 also fails. 8. Axioms, 2, 3, 6, 9, and are easily
More informationMath 102, Winter Final Exam Review. Chapter 1. Matrices and Gaussian Elimination
Math 0, Winter 07 Final Exam Review Chapter. Matrices and Gaussian Elimination { x + x =,. Different forms of a system of linear equations. Example: The x + 4x = 4. [ ] [ ] [ ] vector form (or the column
More informationMATH 304 Linear Algebra Lecture 34: Review for Test 2.
MATH 304 Linear Algebra Lecture 34: Review for Test 2. Topics for Test 2 Linear transformations (Leon 4.1 4.3) Matrix transformations Matrix of a linear mapping Similar matrices Orthogonality (Leon 5.1
More informationMath Linear Algebra Final Exam Review Sheet
Math 15-1 Linear Algebra Final Exam Review Sheet Vector Operations Vector addition is a component-wise operation. Two vectors v and w may be added together as long as they contain the same number n of
More informationReview of Linear Algebra
Review of Linear Algebra Definitions An m n (read "m by n") matrix, is a rectangular array of entries, where m is the number of rows and n the number of columns. 2 Definitions (Con t) A is square if m=
More informationVector Spaces. Commutativity of +: u + v = v + u, u, v, V ; Associativity of +: u + (v + w) = (u + v) + w, u, v, w V ;
Vector Spaces A vector space is defined as a set V over a (scalar) field F, together with two binary operations, i.e., vector addition (+) and scalar multiplication ( ), satisfying the following axioms:
More informationExtra Problems for Math 2050 Linear Algebra I
Extra Problems for Math 5 Linear Algebra I Find the vector AB and illustrate with a picture if A = (,) and B = (,4) Find B, given A = (,4) and [ AB = A = (,4) and [ AB = 8 If possible, express x = 7 as
More informationSYLLABUS UNDER AUTONOMY MATHEMATICS
SYLLABUS UNDER AUTONOMY SEMESTER III Calculus and Analysis MATHEMATICS COURSE: A.MAT.3.01 [45 LECTURES] LEARNING OBJECTIVES : To learn about i) lub axiom of R and its consequences ii) Convergence of sequences
More information7. Dimension and Structure.
7. Dimension and Structure 7.1. Basis and Dimension Bases for Subspaces Example 2 The standard unit vectors e 1, e 2,, e n are linearly independent, for if we write (2) in component form, then we obtain
More informationMATH 31 - ADDITIONAL PRACTICE PROBLEMS FOR FINAL
MATH 3 - ADDITIONAL PRACTICE PROBLEMS FOR FINAL MAIN TOPICS FOR THE FINAL EXAM:. Vectors. Dot product. Cross product. Geometric applications. 2. Row reduction. Null space, column space, row space, left
More informationMATH 2360 REVIEW PROBLEMS
MATH 2360 REVIEW PROBLEMS Problem 1: In (a) (d) below, either compute the matrix product or indicate why it does not exist: ( )( ) 1 2 2 1 (a) 0 1 1 2 ( ) 0 1 2 (b) 0 3 1 4 3 4 5 2 5 (c) 0 3 ) 1 4 ( 1
More informationDS-GA 1002 Lecture notes 0 Fall Linear Algebra. These notes provide a review of basic concepts in linear algebra.
DS-GA 1002 Lecture notes 0 Fall 2016 Linear Algebra These notes provide a review of basic concepts in linear algebra. 1 Vector spaces You are no doubt familiar with vectors in R 2 or R 3, i.e. [ ] 1.1
More informationSection 6.1. Inner Product, Length, and Orthogonality
Section 6. Inner Product, Length, and Orthogonality Orientation Almost solve the equation Ax = b Problem: In the real world, data is imperfect. x v u But due to measurement error, the measured x is not
More informationA Review of Linear Algebra
A Review of Linear Algebra Mohammad Emtiyaz Khan CS,UBC A Review of Linear Algebra p.1/13 Basics Column vector x R n, Row vector x T, Matrix A R m n. Matrix Multiplication, (m n)(n k) m k, AB BA. Transpose
More informationMath 3C Lecture 20. John Douglas Moore
Math 3C Lecture 20 John Douglas Moore May 18, 2009 TENTATIVE FORMULA I Midterm I: 20% Midterm II: 20% Homework: 10% Quizzes: 10% Final: 40% TENTATIVE FORMULA II Higher of two midterms: 30% Homework: 10%
More informationMATH 106 LINEAR ALGEBRA LECTURE NOTES
MATH 6 LINEAR ALGEBRA LECTURE NOTES FALL - These Lecture Notes are not in a final form being still subject of improvement Contents Systems of linear equations and matrices 5 Introduction to systems of
More informationv = v 1 2 +v 2 2. Two successive applications of this idea give the length of the vector v R 3 :
Length, Angle and the Inner Product The length (or norm) of a vector v R 2 (viewed as connecting the origin to a point (v 1,v 2 )) is easily determined by the Pythagorean Theorem and is denoted v : v =
More information6.1. Inner Product, Length and Orthogonality
These are brief notes for the lecture on Friday November 13, and Monday November 1, 2009: they are not complete, but they are a guide to what I want to say on those days. They are guaranteed to be incorrect..1.
More informationChapter 1: Systems of Linear Equations
Chapter : Systems of Linear Equations February, 9 Systems of linear equations Linear systems Lecture A linear equation in variables x, x,, x n is an equation of the form a x + a x + + a n x n = b, where
More informationMath 18, Linear Algebra, Lecture C00, Spring 2017 Review and Practice Problems for Final Exam
Math 8, Linear Algebra, Lecture C, Spring 7 Review and Practice Problems for Final Exam. The augmentedmatrix of a linear system has been transformed by row operations into 5 4 8. Determine if the system
More informationLINEAR ALGEBRA SUMMARY SHEET.
LINEAR ALGEBRA SUMMARY SHEET RADON ROSBOROUGH https://intuitiveexplanationscom/linear-algebra-summary-sheet/ This document is a concise collection of many of the important theorems of linear algebra, organized
More informationDot Products. K. Behrend. April 3, Abstract A short review of some basic facts on the dot product. Projections. The spectral theorem.
Dot Products K. Behrend April 3, 008 Abstract A short review of some basic facts on the dot product. Projections. The spectral theorem. Contents The dot product 3. Length of a vector........................
More informationThe value of a problem is not so much coming up with the answer as in the ideas and attempted ideas it forces on the would be solver I.N.
Math 410 Homework Problems In the following pages you will find all of the homework problems for the semester. Homework should be written out neatly and stapled and turned in at the beginning of class
More informationMAT 242 CHAPTER 4: SUBSPACES OF R n
MAT 242 CHAPTER 4: SUBSPACES OF R n JOHN QUIGG 1. Subspaces Recall that R n is the set of n 1 matrices, also called vectors, and satisfies the following properties: x + y = y + x x + (y + z) = (x + y)
More informationMath 2331 Linear Algebra
6.1 Inner Product, Length & Orthogonality Math 2331 Linear Algebra 6.1 Inner Product, Length & Orthogonality Shang-Huan Chiu Department of Mathematics, University of Houston schiu@math.uh.edu math.uh.edu/
More informationChapter 2. Vectors and Vector Spaces
2.1. Operations on Vectors 1 Chapter 2. Vectors and Vector Spaces Section 2.1. Operations on Vectors Note. In this section, we define several arithmetic operations on vectors (especially, vector addition
More informationLinear independence, span, basis, dimension - and their connection with linear systems
Linear independence span basis dimension - and their connection with linear systems Linear independence of a set of vectors: We say the set of vectors v v..v k is linearly independent provided c v c v..c
More informationMatrices and Matrix Algebra.
Matrices and Matrix Algebra 3.1. Operations on Matrices Matrix Notation and Terminology Matrix: a rectangular array of numbers, called entries. A matrix with m rows and n columns m n A n n matrix : a square
More informationMATH 235. Final ANSWERS May 5, 2015
MATH 235 Final ANSWERS May 5, 25. ( points) Fix positive integers m, n and consider the vector space V of all m n matrices with entries in the real numbers R. (a) Find the dimension of V and prove your
More informationSECTION 3.3. PROBLEM 22. The null space of a matrix A is: N(A) = {X : AX = 0}. Here are the calculations of AX for X = a,b,c,d, and e. =
SECTION 3.3. PROBLEM. The null space of a matrix A is: N(A) {X : AX }. Here are the calculations of AX for X a,b,c,d, and e. Aa [ ][ ] 3 3 [ ][ ] Ac 3 3 [ ] 3 3 [ ] 4+4 6+6 Ae [ ], Ab [ ][ ] 3 3 3 [ ]
More informationThe definition of a vector space (V, +, )
The definition of a vector space (V, +, ) 1. For any u and v in V, u + v is also in V. 2. For any u and v in V, u + v = v + u. 3. For any u, v, w in V, u + ( v + w) = ( u + v) + w. 4. There is an element
More informationMATH 235: Inner Product Spaces, Assignment 7
MATH 235: Inner Product Spaces, Assignment 7 Hand in questions 3,4,5,6,9, by 9:3 am on Wednesday March 26, 28. Contents Orthogonal Basis for Inner Product Space 2 2 Inner-Product Function Space 2 3 Weighted
More informationMTH 362: Advanced Engineering Mathematics
MTH 362: Advanced Engineering Mathematics Lecture 5 Jonathan A. Chávez Casillas 1 1 University of Rhode Island Department of Mathematics September 26, 2017 1 Linear Independence and Dependence of Vectors
More informationGlossary of Linear Algebra Terms. Prepared by Vince Zaccone For Campus Learning Assistance Services at UCSB
Glossary of Linear Algebra Terms Basis (for a subspace) A linearly independent set of vectors that spans the space Basic Variable A variable in a linear system that corresponds to a pivot column in the
More informationLinear Algebra. Linear Algebra. Chih-Wei Yi. Dept. of Computer Science National Chiao Tung University. November 12, 2008
Linear Algebra Chih-Wei Yi Dept. of Computer Science National Chiao Tung University November, 008 Section De nition and Examples Section De nition and Examples Section De nition and Examples De nition
More informationLinear Algebra. 1.1 Introduction to vectors 1.2 Lengths and dot products. January 28th, 2013 Math 301. Monday, January 28, 13
Linear Algebra 1.1 Introduction to vectors 1.2 Lengths and dot products January 28th, 2013 Math 301 Notation for linear systems 12w +4x + 23y +9z =0 2u + v +5w 2x +2y +8z =1 5u + v 6w +2x +4y z =6 8u 4v
More informationChapter 6: Orthogonality
Chapter 6: Orthogonality (Last Updated: November 7, 7) These notes are derived primarily from Linear Algebra and its applications by David Lay (4ed). A few theorems have been moved around.. Inner products
More informationMATH 22A: LINEAR ALGEBRA Chapter 4
MATH 22A: LINEAR ALGEBRA Chapter 4 Jesús De Loera, UC Davis November 30, 2012 Orthogonality and Least Squares Approximation QUESTION: Suppose Ax = b has no solution!! Then what to do? Can we find an Approximate
More informationKnowledge Discovery and Data Mining 1 (VO) ( )
Knowledge Discovery and Data Mining 1 (VO) (707.003) Review of Linear Algebra Denis Helic KTI, TU Graz Oct 9, 2014 Denis Helic (KTI, TU Graz) KDDM1 Oct 9, 2014 1 / 74 Big picture: KDDM Probability Theory
More informationSECTION v 2 x + v 2 y, (5.1)
CHAPTER 5 5.1 Normed Spaces SECTION 5.1 171 REAL AND COMPLEX NORMED, METRIC, AND INNER PRODUCT SPACES So far, our studies have concentrated only on properties of vector spaces that follow from Definition
More information