Inner Product Spaces 5.2 Inner product spaces

Size: px
Start display at page:

Download "Inner Product Spaces 5.2 Inner product spaces"

Transcription

1 Inner Product Spaces 5.2 Inner product spaces November 15

2 Goals Concept of length, distance, and angle in R 2 or R n is extended to abstract vector spaces V. Sucn a vector space will be called an Inner Product Space. An Inner Product Space V comes with an inner product that is like dot product in R n. The Euclidean space R n is only one example of such Inner Product Spaces.

3 Inner Product Definition Suppose V is a vector space. An inner product on V is a function, : V V R that associates to each odered pair (u,v) of vectors a real number u,v is associated, such that for all u,v,w in V and scalar c, we have 1. u,v v,u. 2. u,v+w u,v + u,w. 3. c u,v cu,v. 4. v,v 0 and v 0 v,v 0. The vector space V with such an inner product is called and inner product space.

4 Properties: Theorem 5.7 Theorem 5.7 Let V be an inner product space. Let u,v V be two vectors and c be a scalar, Then, 1. 0,v 0 2. u+v,w u,w + v,w 3. u,cv c u,v Proof. We would have to use the properties in the definition. 1. Use (3): 0,v 00,v 0 0,v Use commutativity (1) and (2): u+v,w w,u+v w,u + w,v u,w + v,w 3. Use (1) and (3): u,cv cv,u c v,u c u,v The proofs are complete.

5 Definitions Definitions Let V be an inner product space and u,v V. 1. The length or norm of v is defined as v v,v. 2. The distance between u,v V is defined as d(u,v) u v 3. The angle θ vectors u,v V is defined by the formula: cosθ u,v u v 0 θ π. A version of Cauchy-Swartz inequality, to be given later, would assert that right side is between -1 and 1.

6 Theorem(s) 5.8 Theorem(s) 5.8 Let V be an inner product space and u,v V. Then, 1. Cauchy-Schwartz Inequality: u, v u v. 2. Triangle Inequality: u+v u + v. 3. (Definition) We say that u, v are (mutually) orthogonal or perpendicular, if u,v 0. We write u v. 4. Pythagorean Theorem. If u, v are orthogonal, then u+v 2 u 2 + v 2. Proof. Exactly similar to the corresponding theorem in 5.1 for R n.

7 Orthogonal Projection Definition. Let V be an inner product space. Suppose v V is a non-zero vector. Then, for u V define Orthogonal Projection of u unto v: proj v (u) v,u v 2 v u 8 proj vu proj v(u) u v

8 Continued Theorem. In fact (u proj v (u)) proj v (u). Proof. ( ) v,u u proj v (u),proj v (u) u v 2 v, v,u v 2 v u, v,u ( v,u v 2 v v 2 v ) v,u 2 v 2 v,u 2 v 4 v,v 0, v,u v 2 v The proof is complete. Remark. If v (1,0) (or on x axis) and u (x,y), then proj v u (x,0).

9 Examples (1) The Obvious Example: With dot product as the inner product, the Euclidean n space R n is an inner product space. (2) Example 2 (Textbook): On R 2 for u (u 1,u 2 ),v (v 1,v 2 ) define u,v u 1 v 1 +2u 2 v 2. This defines an inner product on R 2. Proof. One directly checks: (1) u,v v,u, (2) u+v,w v,w + u,w, (3) cu,v c v,u, (4) v,v 0 and v,v 0 v 0.

10 Examples (3) 5.2 Example 5 Let V C[a,b] be the vector space of all continuous functions f : [a,b] R. For f,g C[a,b], define inner product f,g b a f(x)g(x)dx. It is easy to check that f,g satisfies the properties ofinner product space. Namely, 1. f,g g,f, for all f,g C[a,b]. 2. f,g +h f,g + f,h, for all f,g,h C[a,b]. 3. c f,g cf,g, for all f,g C[a,b] and c R. 4. f,f 0 for all f C[a,b] and f 0 f,f 0.

11 Continued Accordingly, for f C[a,b], we can define length (or norm) f b f,f f(x) 2 dx. This length of continuous functions would have all the properties that you expect length to have. a

12 Exercise 20 Exercise 20 In R 2, define an inner product (as above): for u (u 1,u 2 ), v (v 1,v 2 ) define u,v u 1 v 1 +2u 2 v 2. Let u (0, 6), v (,1). (1) Compute u, v. Solution: u,v u 1 v 1 +2u 2 v 2 0 ()+2( 6) 1 2. (2) Compute u. Solution: u u,u u 1 u 1 +2u 2 u ( 6) ( 6) 72.

13 Continued (3) Compute v. Solution: v v,v ()()+2(1) (1) 3. (4) Compute d(u, v). Solution: d(u,v) u v (1, 7) 1 1+2( 7)( 7) 99.

14 Exercise 40 Exercise 40 Let V C[,1] with inner product f,g 1 f(x)g(x)dx for f,g, V. Let f(x) x and g(x) x 2 x +2. (1) Compute f,g. Solution: We have 1 1 ( f,g f(x)g(x)dx x 3 +x 2 2x ) dx [ ] x x3 3 2x2 2 x [ ] [ ]

15 Continued (2) Compute norm f. Solution: We have f 1 1 f,f f(x) 2 dx x 2 dx [x 3 3 ] 1 x ( ) 2 3 3

16 Continued (3) Compute norm g. Solution: We have g 1 1 g,g g(x) 2 dx (x 2 x +2) 2 dx 1 (x 4 2x 3 +5x 2 4x +4)dx [x 5 5 2x4 4 +5x3 3 4x2 2 +4x ]

17 Continued (4) Compute d(f,g). Solution: We have 1 d(f,g) f g f,f ( x 2 2) 2 dx 1 (x 4 +4x 2 +4)dx [x x3 3 +4x ] 1

18 Exercise 66 Exercise 66 Let V C[,1] with inner product f,g as in Exercise 40 (by definite integral). Let f(x) x and g(x) 3x2. Show that f and g are orthogonal. 2 Solution: We have to show that f,g 0. We have f,g 1 f(x)g(x)dx 1 ( ) 3x x dx 2 2 (3x3 x)dx [ )] 1 1 (3 x4 2 4 x2 1 ( ) 1 ( ) 0. 2 So, f g.

19 Exercise Exercise Let u (2, 2) and v (3,1). Compute proj v (u) and proj u (v) Solution. First u,v , u 2 2 +( 2) 2 8, v proj v (u) v,u v 2 v 4 ( 6 10 (3,1) 5, 2 ) 5 proj u (v) u,v u 2 u 4 (2, 2) (1,) 8

20 Exercise 78 Exercise 78 Let V C[,1] with inner product f,g as in Exercise 40 (by definite integral). Let f(x) x 3 x and g(x) 2x. Compute the orthogonal projection of f onto g. Solution Recall the definition: proj v (u) v,u v 2 v So, First compute g,f 1 (x 3 x)(2x )dx proj g (f) g,f g 2 g 1 (2x 4 x 3 2x 2 +x)dx

21 Continued ( [2 x5 5 x4 4 2x3 ) ] x2 2 ( ) 8 15 So g,f 8 15

22 Continued Now compute g ] 1 (2x) 2 dx (4x 2 4x+1)dx [4 x3 3 4x2 2 +x (4 13 ) [ ] () 14 3

23 Continued So, proj g (f) g,f g 2 g (2x ) 4 (2x ) 35

24 : 5.2 See site!

Inner Product Spaces 6.1 Length and Dot Product in R n

Inner Product Spaces 6.1 Length and Dot Product in R n Inner Product Spaces 6.1 Length and Dot Product in R n Summer 2017 Goals We imitate the concept of length and angle between two vectors in R 2, R 3 to define the same in the n space R n. Main topics are:

More information

Lecture 20: 6.1 Inner Products

Lecture 20: 6.1 Inner Products Lecture 0: 6.1 Inner Products Wei-Ta Chu 011/1/5 Definition An inner product on a real vector space V is a function that associates a real number u, v with each pair of vectors u and v in V in such a way

More information

ORTHOGONALITY AND LEAST-SQUARES [CHAP. 6]

ORTHOGONALITY AND LEAST-SQUARES [CHAP. 6] ORTHOGONALITY AND LEAST-SQUARES [CHAP. 6] Inner products and Norms Inner product or dot product of 2 vectors u and v in R n : u.v = u 1 v 1 + u 2 v 2 + + u n v n Calculate u.v when u = 1 2 2 0 v = 1 0

More information

LINEAR ALGEBRA W W L CHEN

LINEAR ALGEBRA W W L CHEN LINEAR ALGEBRA W W L CHEN c W W L Chen, 1997, 2008. This chapter is available free to all individuals, on the understanding that it is not to be used for financial gain, and may be downloaded and/or photocopied,

More information

Lecture 23: 6.1 Inner Products

Lecture 23: 6.1 Inner Products Lecture 23: 6.1 Inner Products Wei-Ta Chu 2008/12/17 Definition An inner product on a real vector space V is a function that associates a real number u, vwith each pair of vectors u and v in V in such

More information

v = v 1 2 +v 2 2. Two successive applications of this idea give the length of the vector v R 3 :

v = v 1 2 +v 2 2. Two successive applications of this idea give the length of the vector v R 3 : Length, Angle and the Inner Product The length (or norm) of a vector v R 2 (viewed as connecting the origin to a point (v 1,v 2 )) is easily determined by the Pythagorean Theorem and is denoted v : v =

More information

Inner products. Theorem (basic properties): Given vectors u, v, w in an inner product space V, and a scalar k, the following properties hold:

Inner products. Theorem (basic properties): Given vectors u, v, w in an inner product space V, and a scalar k, the following properties hold: Inner products Definition: An inner product on a real vector space V is an operation (function) that assigns to each pair of vectors ( u, v) in V a scalar u, v satisfying the following axioms: 1. u, v

More information

Inner Product Spaces

Inner Product Spaces Inner Product Spaces Linear Algebra Josh Engwer TTU 28 October 2015 Josh Engwer (TTU) Inner Product Spaces 28 October 2015 1 / 15 Inner Product Space (Definition) An inner product is the notion of a dot

More information

Geometry of Vector Spaces

Geometry of Vector Spaces Geometry of Vector Spaces Fall 14 MATH43 In these notes we show that it is possible to do geometry in vector spaces as well, that is similar to plane geometry. We start by giving the definition of an abstract

More information

Linear Algebra. Alvin Lin. August December 2017

Linear Algebra. Alvin Lin. August December 2017 Linear Algebra Alvin Lin August 207 - December 207 Linear Algebra The study of linear algebra is about two basic things. We study vector spaces and structure preserving maps between vector spaces. A vector

More information

Unit 2. Projec.ons and Subspaces

Unit 2. Projec.ons and Subspaces Unit. Projec.ons and Subspaces Linear Algebra and Op.miza.on MSc Bioinforma.cs for Health Sciences Eduardo Eyras Pompeu Fabra University 8-9 hkp://comprna.upf.edu/courses/master_mat/ Inner product (scalar

More information

6. Orthogonality and Least-Squares

6. Orthogonality and Least-Squares Linear Algebra 6. Orthogonality and Least-Squares CSIE NCU 1 6. Orthogonality and Least-Squares 6.1 Inner product, length, and orthogonality. 2 6.2 Orthogonal sets... 8 6.3 Orthogonal projections... 13

More information

The Gram-Schmidt Process 1

The Gram-Schmidt Process 1 The Gram-Schmidt Process In this section all vector spaces will be subspaces of some R m. Definition.. Let S = {v...v n } R m. The set S is said to be orthogonal if v v j = whenever i j. If in addition

More information

7 Bilinear forms and inner products

7 Bilinear forms and inner products 7 Bilinear forms and inner products Definition 7.1 A bilinear form θ on a vector space V over a field F is a function θ : V V F such that θ(λu+µv,w) = λθ(u,w)+µθ(v,w) θ(u,λv +µw) = λθ(u,v)+µθ(u,w) for

More information

The Transpose of a Vector

The Transpose of a Vector 8 CHAPTER Vectors The Transpose of a Vector We now consider the transpose of a vector in R n, which is a row vector. For a vector u 1 u. u n the transpose is denoted by u T = [ u 1 u u n ] EXAMPLE -5 Find

More information

b 1 b 2.. b = b m A = [a 1,a 2,...,a n ] where a 1,j a 2,j a j = a m,j Let A R m n and x 1 x 2 x = x n

b 1 b 2.. b = b m A = [a 1,a 2,...,a n ] where a 1,j a 2,j a j = a m,j Let A R m n and x 1 x 2 x = x n Lectures -2: Linear Algebra Background Almost all linear and nonlinear problems in scientific computation require the use of linear algebra These lectures review basic concepts in a way that has proven

More information

MATH 235: Inner Product Spaces, Assignment 7

MATH 235: Inner Product Spaces, Assignment 7 MATH 235: Inner Product Spaces, Assignment 7 Hand in questions 3,4,5,6,9, by 9:3 am on Wednesday March 26, 28. Contents Orthogonal Basis for Inner Product Space 2 2 Inner-Product Function Space 2 3 Weighted

More information

F F. proj cos( ) v. v proj v

F F. proj cos( ) v. v proj v Geometric Definition of Dot Product 1.2 The Dot Product Suppose you are pulling up on a rope attached to a box, as shown above. How would you find the force moving the box towards you? As stated above,

More information

Recall: Dot product on R 2 : u v = (u 1, u 2 ) (v 1, v 2 ) = u 1 v 1 + u 2 v 2, u u = u u 2 2 = u 2. Geometric Meaning:

Recall: Dot product on R 2 : u v = (u 1, u 2 ) (v 1, v 2 ) = u 1 v 1 + u 2 v 2, u u = u u 2 2 = u 2. Geometric Meaning: Recall: Dot product on R 2 : u v = (u 1, u 2 ) (v 1, v 2 ) = u 1 v 1 + u 2 v 2, u u = u 2 1 + u 2 2 = u 2. Geometric Meaning: u v = u v cos θ. u θ v 1 Reason: The opposite side is given by u v. u v 2 =

More information

MATH 304 Linear Algebra Lecture 19: Least squares problems (continued). Norms and inner products.

MATH 304 Linear Algebra Lecture 19: Least squares problems (continued). Norms and inner products. MATH 304 Linear Algebra Lecture 19: Least squares problems (continued). Norms and inner products. Orthogonal projection Theorem 1 Let V be a subspace of R n. Then any vector x R n is uniquely represented

More information

INNER PRODUCT SPACE. Definition 1

INNER PRODUCT SPACE. Definition 1 INNER PRODUCT SPACE Definition 1 Suppose u, v and w are all vectors in vector space V and c is any scalar. An inner product space on the vectors space V is a function that associates with each pair of

More information

Inner Product Spaces

Inner Product Spaces Inner Product Spaces Introduction Recall in the lecture on vector spaces that geometric vectors (i.e. vectors in two and three-dimensional Cartesian space have the properties of addition, subtraction,

More information

Projection Theorem 1

Projection Theorem 1 Projection Theorem 1 Cauchy-Schwarz Inequality Lemma. (Cauchy-Schwarz Inequality) For all x, y in an inner product space, [ xy, ] x y. Equality holds if and only if x y or y θ. Proof. If y θ, the inequality

More information

Math 350 Fall 2011 Notes about inner product spaces. In this notes we state and prove some important properties of inner product spaces.

Math 350 Fall 2011 Notes about inner product spaces. In this notes we state and prove some important properties of inner product spaces. Math 350 Fall 2011 Notes about inner product spaces In this notes we state and prove some important properties of inner product spaces. First, recall the dot product on R n : if x, y R n, say x = (x 1,...,

More information

Definitions and Properties of R N

Definitions and Properties of R N Definitions and Properties of R N R N as a set As a set R n is simply the set of all ordered n-tuples (x 1,, x N ), called vectors. We usually denote the vector (x 1,, x N ), (y 1,, y N ), by x, y, or

More information

Introduction to Kernel methods

Introduction to Kernel methods Introduction to Kernel ethods ML Workshop, ISI Kolkata Chiranjib Bhattacharyya Machine Learning lab Dept of CSA, IISc chiru@csa.iisc.ernet.in http://drona.csa.iisc.ernet.in/~chiru 19th Oct, 2012 Introduction

More information

Final Exam - Take Home Portion Math 211, Summer 2017

Final Exam - Take Home Portion Math 211, Summer 2017 Final Exam - Take Home Portion Math 2, Summer 207 Name: Directions: Complete a total of 5 problems. Problem must be completed. The remaining problems are categorized in four groups. Select one problem

More information

Contents. Appendix D (Inner Product Spaces) W-51. Index W-63

Contents. Appendix D (Inner Product Spaces) W-51. Index W-63 Contents Appendix D (Inner Product Spaces W-5 Index W-63 Inner city space W-49 W-5 Chapter : Appendix D Inner Product Spaces The inner product, taken of any two vectors in an arbitrary vector space, generalizes

More information

Designing Information Devices and Systems I Fall 2018 Lecture Notes Note 21

Designing Information Devices and Systems I Fall 2018 Lecture Notes Note 21 EECS 16A Designing Information Devices and Systems I Fall 2018 Lecture Notes Note 21 21.1 Module Goals In this module, we introduce a family of ideas that are connected to optimization and machine learning,

More information

LESSON 23: EXTREMA OF FUNCTIONS OF 2 VARIABLES OCTOBER 25, 2017

LESSON 23: EXTREMA OF FUNCTIONS OF 2 VARIABLES OCTOBER 25, 2017 LESSON : EXTREMA OF FUNCTIONS OF VARIABLES OCTOBER 5, 017 Just like with functions of a single variable, we want to find the minima (plural of minimum) and maxima (plural of maximum) of functions of several

More information

Math Linear Algebra II. 1. Inner Products and Norms

Math Linear Algebra II. 1. Inner Products and Norms Math 342 - Linear Algebra II Notes 1. Inner Products and Norms One knows from a basic introduction to vectors in R n Math 254 at OSU) that the length of a vector x = x 1 x 2... x n ) T R n, denoted x,

More information

The Gram Schmidt Process

The Gram Schmidt Process The Gram Schmidt Process Now we will present a procedure, based on orthogonal projection, that converts any linearly independent set of vectors into an orthogonal set. Let us begin with the simple case

More information

The Gram Schmidt Process

The Gram Schmidt Process u 2 u The Gram Schmidt Process Now we will present a procedure, based on orthogonal projection, that converts any linearly independent set of vectors into an orthogonal set. Let us begin with the simple

More information

6.1. Inner Product, Length and Orthogonality

6.1. Inner Product, Length and Orthogonality These are brief notes for the lecture on Friday November 13, and Monday November 1, 2009: they are not complete, but they are a guide to what I want to say on those days. They are guaranteed to be incorrect..1.

More information

Chapter 4 Euclid Space

Chapter 4 Euclid Space Chapter 4 Euclid Space Inner Product Spaces Definition.. Let V be a real vector space over IR. A real inner product on V is a real valued function on V V, denoted by (, ), which satisfies () (x, y) = (y,

More information

Linear Algebra Massoud Malek

Linear Algebra Massoud Malek CSUEB Linear Algebra Massoud Malek Inner Product and Normed Space In all that follows, the n n identity matrix is denoted by I n, the n n zero matrix by Z n, and the zero vector by θ n An inner product

More information

Notes on multivariable calculus

Notes on multivariable calculus Notes on multivariable calculus Jonathan Wise February 2, 2010 1 Review of trigonometry Trigonometry is essentially the study of the relationship between polar coordinates and Cartesian coordinates in

More information

Dot product. The dot product is an inner product on a coordinate vector space (Definition 1, Theorem

Dot product. The dot product is an inner product on a coordinate vector space (Definition 1, Theorem Dot product The dot product is an inner product on a coordinate vector space (Definition 1, Theorem 1). Definition 1 Given vectors v and u in n-dimensional space, the dot product is defined as, n v u v

More information

Give a geometric description of the set of points in space whose coordinates satisfy the given pair of equations.

Give a geometric description of the set of points in space whose coordinates satisfy the given pair of equations. 1. Give a geometric description of the set of points in space whose coordinates satisfy the given pair of equations. x + y = 5, z = 4 Choose the correct description. A. The circle with center (0,0, 4)

More information

Sec. 1.1: Basics of Vectors

Sec. 1.1: Basics of Vectors Sec. 1.1: Basics of Vectors Notation for Euclidean space R n : all points (x 1, x 2,..., x n ) in n-dimensional space. Examples: 1. R 1 : all points on the real number line. 2. R 2 : all points (x 1, x

More information

Vector Spaces 4.2 Vector Spaces

Vector Spaces 4.2 Vector Spaces 4.2 September 27 4.2 Goals Give definition of Give examples and non-examples of 4.2 Abstruct Definition of A List of Important Properties of Operations on Sets On the set of integers Z, or on the set of

More information

Section 7.5 Inner Product Spaces

Section 7.5 Inner Product Spaces Section 7.5 Inner Product Spaces With the dot product defined in Chapter 6, we were able to study the following properties of vectors in R n. ) Length or norm of a vector u. ( u = p u u ) 2) Distance of

More information

Lecture 1.4: Inner products and orthogonality

Lecture 1.4: Inner products and orthogonality Lecture 1.4: Inner products and orthogonality Matthew Macauley Department of Mathematical Sciences Clemson University http://www.math.clemson.edu/~macaule/ Math 4340, Advanced Engineering Mathematics M.

More information

Linear Analysis Lecture 5

Linear Analysis Lecture 5 Linear Analysis Lecture 5 Inner Products and V Let dim V < with inner product,. Choose a basis B and let v, w V have coordinates in F n given by x 1. x n and y 1. y n, respectively. Let A F n n be the

More information

4.1 Distance and Length

4.1 Distance and Length Chapter Vector Geometry In this chapter we will look more closely at certain geometric aspects of vectors in R n. We will first develop an intuitive understanding of some basic concepts by looking at vectors

More information

Solution to Homework 1

Solution to Homework 1 Solution to Homework 1 Olena Bormashenko September, 0 Section 1.1:, 5b)d), 7b)f), 8a)b), ; Section 1.:, 5, 7, 9, 10, b)c), 1, 15b), 3 Section 1.1. In each of the following cases, find a point that is two-thirds

More information

Vector Geometry. Chapter 5

Vector Geometry. Chapter 5 Chapter 5 Vector Geometry In this chapter we will look more closely at certain geometric aspects of vectors in R n. We will first develop an intuitive understanding of some basic concepts by looking at

More information

Vector Spaces 4.1 Vectors in n Spaces

Vector Spaces 4.1 Vectors in n Spaces Vector Spaces 4.1 Vectors in n Spaces September 27 Goals Get familar with real n spaces R n, like R 2, R 3. Get familiar with some of the properties of the real n spaces R n. Justify why points in R n

More information

Vector spaces. DS-GA 1013 / MATH-GA 2824 Optimization-based Data Analysis.

Vector spaces. DS-GA 1013 / MATH-GA 2824 Optimization-based Data Analysis. Vector spaces DS-GA 1013 / MATH-GA 2824 Optimization-based Data Analysis http://www.cims.nyu.edu/~cfgranda/pages/obda_fall17/index.html Carlos Fernandez-Granda Vector space Consists of: A set V A scalar

More information

6 Inner Product Spaces

6 Inner Product Spaces Lectures 16,17,18 6 Inner Product Spaces 6.1 Basic Definition Parallelogram law, the ability to measure angle between two vectors and in particular, the concept of perpendicularity make the euclidean space

More information

SECTION v 2 x + v 2 y, (5.1)

SECTION v 2 x + v 2 y, (5.1) CHAPTER 5 5.1 Normed Spaces SECTION 5.1 171 REAL AND COMPLEX NORMED, METRIC, AND INNER PRODUCT SPACES So far, our studies have concentrated only on properties of vector spaces that follow from Definition

More information

Worksheet for Lecture 23 (due December 4) Section 6.1 Inner product, length, and orthogonality

Worksheet for Lecture 23 (due December 4) Section 6.1 Inner product, length, and orthogonality Worksheet for Lecture (due December 4) Name: Section 6 Inner product, length, and orthogonality u Definition Let u = u n product or dot product to be and v = v v n be vectors in R n We define their inner

More information

Outline. Linear Algebra for Computer Vision

Outline. Linear Algebra for Computer Vision Outline Linear Algebra for Computer Vision Introduction CMSC 88 D Notation and Basics Motivation Linear systems of equations Gauss Elimination, LU decomposition Linear Spaces and Operators Addition, scalar

More information

There are two things that are particularly nice about the first basis

There are two things that are particularly nice about the first basis Orthogonality and the Gram-Schmidt Process In Chapter 4, we spent a great deal of time studying the problem of finding a basis for a vector space We know that a basis for a vector space can potentially

More information

MATH Linear Algebra

MATH Linear Algebra MATH 4 - Linear Algebra One of the key driving forces for the development of linear algebra was the profound idea (going back to 7th century and the work of Pierre Fermat and Rene Descartes) that geometry

More information

MAT 1339-S14 Class 8

MAT 1339-S14 Class 8 MAT 1339-S14 Class 8 July 28, 2014 Contents 7.2 Review Dot Product........................... 2 7.3 Applications of the Dot Product..................... 4 7.4 Vectors in Three-Space.........................

More information

Practical Linear Algebra: A Geometry Toolbox

Practical Linear Algebra: A Geometry Toolbox Practical Linear Algebra: A Geometry Toolbox Third edition Chapter 2: Here and There: Points and Vectors in 2D Gerald Farin & Dianne Hansford CRC Press, Taylor & Francis Group, An A K Peters Book www.farinhansford.com/books/pla

More information

Quiz 2 Practice Problems

Quiz 2 Practice Problems Quiz Practice Problems Practice problems are similar, both in difficulty and in scope, to the type of problems you will see on the quiz. Problems marked with a are for your entertainment and are not essential.

More information

Last week we presented the following expression for the angles between two vectors u and v in R n ( ) θ = cos 1 u v

Last week we presented the following expression for the angles between two vectors u and v in R n ( ) θ = cos 1 u v Orthogonality (I) Last week we presented the following expression for the angles between two vectors u and v in R n ( ) θ = cos 1 u v u v which brings us to the fact that θ = π/2 u v = 0. Definition (Orthogonality).

More information

Dot Products. K. Behrend. April 3, Abstract A short review of some basic facts on the dot product. Projections. The spectral theorem.

Dot Products. K. Behrend. April 3, Abstract A short review of some basic facts on the dot product. Projections. The spectral theorem. Dot Products K. Behrend April 3, 008 Abstract A short review of some basic facts on the dot product. Projections. The spectral theorem. Contents The dot product 3. Length of a vector........................

More information

Representation of objects. Representation of objects. Transformations. Hierarchy of spaces. Dimensionality reduction

Representation of objects. Representation of objects. Transformations. Hierarchy of spaces. Dimensionality reduction Representation of objects Representation of objects For searching/mining, first need to represent the objects Images/videos: MPEG features Graphs: Matrix Text document: tf/idf vector, bag of words Kernels

More information

Jim Lambers MAT 169 Fall Semester Practice Final Exam

Jim Lambers MAT 169 Fall Semester Practice Final Exam Jim Lambers MAT 169 Fall Semester 2010-11 Practice Final Exam 1. A ship is moving northwest at a speed of 50 mi/h. A passenger is walking due southeast on the deck at 4 mi/h. Find the speed of the passenger

More information

10.1 Three Dimensional Space

10.1 Three Dimensional Space Math 172 Chapter 10A notes Page 1 of 12 10.1 Three Dimensional Space 2D space 0 xx.. xx-, 0 yy yy-, PP(xx, yy) [Fig. 1] Point PP represented by (xx, yy), an ordered pair of real nos. Set of all ordered

More information

Covariance and Dot Product

Covariance and Dot Product Covariance and Dot Product 1 Introduction. As you learned in Calculus III and Linear Algebra, the dot product of two vectors x = (x 1,..., x n ) and y = (y 1,..., y n ) in R n is the number n := x i y

More information

Orthonormal Bases; Gram-Schmidt Process; QR-Decomposition

Orthonormal Bases; Gram-Schmidt Process; QR-Decomposition Orthonormal Bases; Gram-Schmidt Process; QR-Decomposition MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 205 Motivation When working with an inner product space, the most

More information

Designing Information Devices and Systems II

Designing Information Devices and Systems II EECS 16B Fall 2016 Designing Information Devices and Systems II Linear Algebra Notes Introduction In this set of notes, we will derive the linear least squares equation, study the properties symmetric

More information

Vectors in Function Spaces

Vectors in Function Spaces Jim Lambers MAT 66 Spring Semester 15-16 Lecture 18 Notes These notes correspond to Section 6.3 in the text. Vectors in Function Spaces We begin with some necessary terminology. A vector space V, also

More information

1. Subspaces A subset M of Hilbert space H is a subspace of it is closed under the operation of forming linear combinations;i.e.,

1. Subspaces A subset M of Hilbert space H is a subspace of it is closed under the operation of forming linear combinations;i.e., Abstract Hilbert Space Results We have learned a little about the Hilbert spaces L U and and we have at least defined H 1 U and the scale of Hilbert spaces H p U. Now we are going to develop additional

More information

Lecture Note on Linear Algebra 17. Standard Inner Product

Lecture Note on Linear Algebra 17. Standard Inner Product Lecture Note on Linear Algebra 17. Standard Inner Product Wei-Shi Zheng, wszheng@ieee.org, 2011 November 21, 2011 1 What Do You Learn from This Note Up to this point, the theory we have established can

More information

Approximation Theory

Approximation Theory Approximation Theory Function approximation is the task of constructing, for a given function, a simpler function so that the difference between the two functions is small and to then provide a quantifiable

More information

CHAPTER II HILBERT SPACES

CHAPTER II HILBERT SPACES CHAPTER II HILBERT SPACES 2.1 Geometry of Hilbert Spaces Definition 2.1.1. Let X be a complex linear space. An inner product on X is a function, : X X C which satisfies the following axioms : 1. y, x =

More information

7.1 Projections and Components

7.1 Projections and Components 7. Projections and Components As we have seen, the dot product of two vectors tells us the cosine of the angle between them. So far, we have only used this to find the angle between two vectors, but cosines

More information

MTH 2310, FALL Introduction

MTH 2310, FALL Introduction MTH 2310, FALL 2011 SECTION 6.2: ORTHOGONAL SETS Homework Problems: 1, 5, 9, 13, 17, 21, 23 1, 27, 29, 35 1. Introduction We have discussed previously the benefits of having a set of vectors that is linearly

More information

MTAEA Vectors in Euclidean Spaces

MTAEA Vectors in Euclidean Spaces School of Economics, Australian National University January 25, 2010 Vectors. Economists usually work in the vector space R n. A point in this space is called a vector, and is typically defined by its

More information

EGR2013 Tutorial 8. Linear Algebra. Powers of a Matrix and Matrix Polynomial

EGR2013 Tutorial 8. Linear Algebra. Powers of a Matrix and Matrix Polynomial EGR1 Tutorial 8 Linear Algebra Outline Powers of a Matrix and Matrix Polynomial Vector Algebra Vector Spaces Powers of a Matrix and Matrix Polynomial If A is a square matrix, then we define the nonnegative

More information

Linear Algebra: Homework 3

Linear Algebra: Homework 3 Linear Algebra: Homework 3 Alvin Lin August 206 - December 206 Section.2 Exercise 48 Find all values of the scalar k for which the two vectors are orthogonal. [ ] [ ] 2 k + u v 3 k u v 0 2(k + ) + 3(k

More information

Applied Linear Algebra in Geoscience Using MATLAB

Applied Linear Algebra in Geoscience Using MATLAB Applied Linear Algebra in Geoscience Using MATLAB Contents Getting Started Creating Arrays Mathematical Operations with Arrays Using Script Files and Managing Data Two-Dimensional Plots Programming in

More information

Overview of vector calculus. Coordinate systems in space. Distance formula. (Sec. 12.1)

Overview of vector calculus. Coordinate systems in space. Distance formula. (Sec. 12.1) Math 20C Multivariable Calculus Lecture 1 1 Coordinates in space Slide 1 Overview of vector calculus. Coordinate systems in space. Distance formula. (Sec. 12.1) Vector calculus studies derivatives and

More information

10 Orthogonality Orthogonal subspaces

10 Orthogonality Orthogonal subspaces 10 Orthogonality 10.1 Orthogonal subspaces In the plane R 2 we think of the coordinate axes as being orthogonal (perpendicular) to each other. We can express this in terms of vectors by saying that every

More information

1. General Vector Spaces

1. General Vector Spaces 1.1. Vector space axioms. 1. General Vector Spaces Definition 1.1. Let V be a nonempty set of objects on which the operations of addition and scalar multiplication are defined. By addition we mean a rule

More information

Math Linear Algebra

Math Linear Algebra Math 220 - Linear Algebra (Summer 208) Solutions to Homework #7 Exercise 6..20 (a) TRUE. u v v u = 0 is equivalent to u v = v u. The latter identity is true due to the commutative property of the inner

More information

Math 328 Course Notes

Math 328 Course Notes Math 328 Course Notes Ian Robertson March 3, 2006 3 Properties of C[0, 1]: Sup-norm and Completeness In this chapter we are going to examine the vector space of all continuous functions defined on the

More information

FFTs in Graphics and Vision. The Laplace Operator

FFTs in Graphics and Vision. The Laplace Operator FFTs in Graphics and Vision The Laplace Operator 1 Outline Math Stuff Symmetric/Hermitian Matrices Lagrange Multipliers Diagonalizing Symmetric Matrices The Laplacian Operator 2 Linear Operators Definition:

More information

Chapter 6: Orthogonality

Chapter 6: Orthogonality Chapter 6: Orthogonality (Last Updated: November 7, 7) These notes are derived primarily from Linear Algebra and its applications by David Lay (4ed). A few theorems have been moved around.. Inner products

More information

Vector Spaces. distributive law u,v. Associative Law. 1 v v. Let 1 be the unit element in F, then

Vector Spaces. distributive law u,v. Associative Law. 1 v v. Let 1 be the unit element in F, then 1 Def: V be a set of elements with a binary operation + is defined. F be a field. A multiplication operator between a F and v V is also defined. The V is called a vector space over the field F if: V is

More information

1 The theoretical constructions

1 The theoretical constructions Linear Transformations and Matrix Representations Samuel R Buss - Spring 003 Revision (Corrections appreciated!) These notes review the topics I lectured on while covering sections 4, 4, and 5 of the textbook

More information

INVITATION FOR BID Exploratory Geothermal Drilling Services Department of Natural Resources (DNR)

INVITATION FOR BID Exploratory Geothermal Drilling Services Department of Natural Resources (DNR) V F B 21064 xy G v f u u ( B u: y : : u : -B ( u /k Wy y 30 2 1500 ff y W 98501 Bx 41017 y W 98504-1017 W 360-407-9399 w@wv y 18 2012 2:00 1500 ff 2331 y W 98501 ://wwwwv//u-f ://wwwwv/v/-k B U B V BF

More information

Linear Algebra. Session 12

Linear Algebra. Session 12 Linear Algebra. Session 12 Dr. Marco A Roque Sol 08/01/2017 Example 12.1 Find the constant function that is the least squares fit to the following data x 0 1 2 3 f(x) 1 0 1 2 Solution c = 1 c = 0 f (x)

More information

Functions of Several Variables

Functions of Several Variables Jim Lambers MAT 419/519 Summer Session 2011-12 Lecture 2 Notes These notes correspond to Section 1.2 in the text. Functions of Several Variables We now generalize the results from the previous section,

More information

Math 261 Lecture Notes: Sections 6.1, 6.2, 6.3 and 6.4 Orthogonal Sets and Projections

Math 261 Lecture Notes: Sections 6.1, 6.2, 6.3 and 6.4 Orthogonal Sets and Projections Math 6 Lecture Notes: Sections 6., 6., 6. and 6. Orthogonal Sets and Projections We will not cover general inner product spaces. We will, however, focus on a particular inner product space the inner product

More information

10.2,3,4. Vectors in 3D, Dot products and Cross Products

10.2,3,4. Vectors in 3D, Dot products and Cross Products Name: Section: 10.2,3,4. Vectors in 3D, Dot products and Cross Products 1. Sketch the plane parallel to the xy-plane through (2, 4, 2) 2. For the given vectors u and v, evaluate the following expressions.

More information

Precalculus Notes: Unit 6 Vectors, Parametrics, Polars, & Complex Numbers

Precalculus Notes: Unit 6 Vectors, Parametrics, Polars, & Complex Numbers Syllabus Objectives: 5.1 The student will eplore methods of vector addition and subtraction. 5. The student will develop strategies for computing a vector s direction angle and magnitude given its coordinates.

More information

94 CHAPTER 3. VECTORS AND THE GEOMETRY OF SPACE

94 CHAPTER 3. VECTORS AND THE GEOMETRY OF SPACE 94 CHAPTER 3. VECTORS AND THE GEOMETRY OF SPACE 3.3 Dot Product We haven t yet de ned a multiplication between vectors. It turns out there are di erent ways this can be done. In this section, we present

More information

MTH 2032 SemesterII

MTH 2032 SemesterII MTH 202 SemesterII 2010-11 Linear Algebra Worked Examples Dr. Tony Yee Department of Mathematics and Information Technology The Hong Kong Institute of Education December 28, 2011 ii Contents Table of Contents

More information

(, ) : R n R n R. 1. It is bilinear, meaning it s linear in each argument: that is

(, ) : R n R n R. 1. It is bilinear, meaning it s linear in each argument: that is 17 Inner products Up until now, we have only examined the properties of vectors and matrices in R n. But normally, when we think of R n, we re really thinking of n-dimensional Euclidean space - that is,

More information

Vector Calculus. Lecture Notes

Vector Calculus. Lecture Notes Vector Calculus Lecture Notes Adolfo J. Rumbos c Draft date November 23, 211 2 Contents 1 Motivation for the course 5 2 Euclidean Space 7 2.1 Definition of n Dimensional Euclidean Space........... 7 2.2

More information

Derivatives in 2D. Outline. James K. Peterson. November 9, Derivatives in 2D! Chain Rule

Derivatives in 2D. Outline. James K. Peterson. November 9, Derivatives in 2D! Chain Rule Derivatives in 2D James K. Peterson Department of Biological Sciences and Department of Mathematical Sciences Clemson University November 9, 2016 Outline Derivatives in 2D! Chain Rule Let s go back to

More information

Another consequence of the Cauchy Schwarz inequality is the continuity of the inner product.

Another consequence of the Cauchy Schwarz inequality is the continuity of the inner product. . Inner product spaces 1 Theorem.1 (Cauchy Schwarz inequality). If X is an inner product space then x,y x y. (.) Proof. First note that 0 u v v u = u v u v Re u,v. (.3) Therefore, Re u,v u v (.) for all

More information

Worksheet 1.4: Geometry of the Dot and Cross Products

Worksheet 1.4: Geometry of the Dot and Cross Products Boise State Math 275 (Ultman) Worksheet 1.4: Geometry of the Dot and Cross Products From the Toolbox (what you need from previous classes): Basic algebra and trigonometry: be able to solve quadratic equations,

More information

The Cross Product of Two Vectors

The Cross Product of Two Vectors The Cross roduct of Two Vectors In proving some statements involving surface integrals, there will be a need to approximate areas of segments of the surface by areas of parallelograms. Therefore it is

More information