Inner Product Spaces 5.2 Inner product spaces
|
|
- Charity Phillips
- 6 years ago
- Views:
Transcription
1 Inner Product Spaces 5.2 Inner product spaces November 15
2 Goals Concept of length, distance, and angle in R 2 or R n is extended to abstract vector spaces V. Sucn a vector space will be called an Inner Product Space. An Inner Product Space V comes with an inner product that is like dot product in R n. The Euclidean space R n is only one example of such Inner Product Spaces.
3 Inner Product Definition Suppose V is a vector space. An inner product on V is a function, : V V R that associates to each odered pair (u,v) of vectors a real number u,v is associated, such that for all u,v,w in V and scalar c, we have 1. u,v v,u. 2. u,v+w u,v + u,w. 3. c u,v cu,v. 4. v,v 0 and v 0 v,v 0. The vector space V with such an inner product is called and inner product space.
4 Properties: Theorem 5.7 Theorem 5.7 Let V be an inner product space. Let u,v V be two vectors and c be a scalar, Then, 1. 0,v 0 2. u+v,w u,w + v,w 3. u,cv c u,v Proof. We would have to use the properties in the definition. 1. Use (3): 0,v 00,v 0 0,v Use commutativity (1) and (2): u+v,w w,u+v w,u + w,v u,w + v,w 3. Use (1) and (3): u,cv cv,u c v,u c u,v The proofs are complete.
5 Definitions Definitions Let V be an inner product space and u,v V. 1. The length or norm of v is defined as v v,v. 2. The distance between u,v V is defined as d(u,v) u v 3. The angle θ vectors u,v V is defined by the formula: cosθ u,v u v 0 θ π. A version of Cauchy-Swartz inequality, to be given later, would assert that right side is between -1 and 1.
6 Theorem(s) 5.8 Theorem(s) 5.8 Let V be an inner product space and u,v V. Then, 1. Cauchy-Schwartz Inequality: u, v u v. 2. Triangle Inequality: u+v u + v. 3. (Definition) We say that u, v are (mutually) orthogonal or perpendicular, if u,v 0. We write u v. 4. Pythagorean Theorem. If u, v are orthogonal, then u+v 2 u 2 + v 2. Proof. Exactly similar to the corresponding theorem in 5.1 for R n.
7 Orthogonal Projection Definition. Let V be an inner product space. Suppose v V is a non-zero vector. Then, for u V define Orthogonal Projection of u unto v: proj v (u) v,u v 2 v u 8 proj vu proj v(u) u v
8 Continued Theorem. In fact (u proj v (u)) proj v (u). Proof. ( ) v,u u proj v (u),proj v (u) u v 2 v, v,u v 2 v u, v,u ( v,u v 2 v v 2 v ) v,u 2 v 2 v,u 2 v 4 v,v 0, v,u v 2 v The proof is complete. Remark. If v (1,0) (or on x axis) and u (x,y), then proj v u (x,0).
9 Examples (1) The Obvious Example: With dot product as the inner product, the Euclidean n space R n is an inner product space. (2) Example 2 (Textbook): On R 2 for u (u 1,u 2 ),v (v 1,v 2 ) define u,v u 1 v 1 +2u 2 v 2. This defines an inner product on R 2. Proof. One directly checks: (1) u,v v,u, (2) u+v,w v,w + u,w, (3) cu,v c v,u, (4) v,v 0 and v,v 0 v 0.
10 Examples (3) 5.2 Example 5 Let V C[a,b] be the vector space of all continuous functions f : [a,b] R. For f,g C[a,b], define inner product f,g b a f(x)g(x)dx. It is easy to check that f,g satisfies the properties ofinner product space. Namely, 1. f,g g,f, for all f,g C[a,b]. 2. f,g +h f,g + f,h, for all f,g,h C[a,b]. 3. c f,g cf,g, for all f,g C[a,b] and c R. 4. f,f 0 for all f C[a,b] and f 0 f,f 0.
11 Continued Accordingly, for f C[a,b], we can define length (or norm) f b f,f f(x) 2 dx. This length of continuous functions would have all the properties that you expect length to have. a
12 Exercise 20 Exercise 20 In R 2, define an inner product (as above): for u (u 1,u 2 ), v (v 1,v 2 ) define u,v u 1 v 1 +2u 2 v 2. Let u (0, 6), v (,1). (1) Compute u, v. Solution: u,v u 1 v 1 +2u 2 v 2 0 ()+2( 6) 1 2. (2) Compute u. Solution: u u,u u 1 u 1 +2u 2 u ( 6) ( 6) 72.
13 Continued (3) Compute v. Solution: v v,v ()()+2(1) (1) 3. (4) Compute d(u, v). Solution: d(u,v) u v (1, 7) 1 1+2( 7)( 7) 99.
14 Exercise 40 Exercise 40 Let V C[,1] with inner product f,g 1 f(x)g(x)dx for f,g, V. Let f(x) x and g(x) x 2 x +2. (1) Compute f,g. Solution: We have 1 1 ( f,g f(x)g(x)dx x 3 +x 2 2x ) dx [ ] x x3 3 2x2 2 x [ ] [ ]
15 Continued (2) Compute norm f. Solution: We have f 1 1 f,f f(x) 2 dx x 2 dx [x 3 3 ] 1 x ( ) 2 3 3
16 Continued (3) Compute norm g. Solution: We have g 1 1 g,g g(x) 2 dx (x 2 x +2) 2 dx 1 (x 4 2x 3 +5x 2 4x +4)dx [x 5 5 2x4 4 +5x3 3 4x2 2 +4x ]
17 Continued (4) Compute d(f,g). Solution: We have 1 d(f,g) f g f,f ( x 2 2) 2 dx 1 (x 4 +4x 2 +4)dx [x x3 3 +4x ] 1
18 Exercise 66 Exercise 66 Let V C[,1] with inner product f,g as in Exercise 40 (by definite integral). Let f(x) x and g(x) 3x2. Show that f and g are orthogonal. 2 Solution: We have to show that f,g 0. We have f,g 1 f(x)g(x)dx 1 ( ) 3x x dx 2 2 (3x3 x)dx [ )] 1 1 (3 x4 2 4 x2 1 ( ) 1 ( ) 0. 2 So, f g.
19 Exercise Exercise Let u (2, 2) and v (3,1). Compute proj v (u) and proj u (v) Solution. First u,v , u 2 2 +( 2) 2 8, v proj v (u) v,u v 2 v 4 ( 6 10 (3,1) 5, 2 ) 5 proj u (v) u,v u 2 u 4 (2, 2) (1,) 8
20 Exercise 78 Exercise 78 Let V C[,1] with inner product f,g as in Exercise 40 (by definite integral). Let f(x) x 3 x and g(x) 2x. Compute the orthogonal projection of f onto g. Solution Recall the definition: proj v (u) v,u v 2 v So, First compute g,f 1 (x 3 x)(2x )dx proj g (f) g,f g 2 g 1 (2x 4 x 3 2x 2 +x)dx
21 Continued ( [2 x5 5 x4 4 2x3 ) ] x2 2 ( ) 8 15 So g,f 8 15
22 Continued Now compute g ] 1 (2x) 2 dx (4x 2 4x+1)dx [4 x3 3 4x2 2 +x (4 13 ) [ ] () 14 3
23 Continued So, proj g (f) g,f g 2 g (2x ) 4 (2x ) 35
24 : 5.2 See site!
Inner Product Spaces 6.1 Length and Dot Product in R n
Inner Product Spaces 6.1 Length and Dot Product in R n Summer 2017 Goals We imitate the concept of length and angle between two vectors in R 2, R 3 to define the same in the n space R n. Main topics are:
More informationLecture 20: 6.1 Inner Products
Lecture 0: 6.1 Inner Products Wei-Ta Chu 011/1/5 Definition An inner product on a real vector space V is a function that associates a real number u, v with each pair of vectors u and v in V in such a way
More informationORTHOGONALITY AND LEAST-SQUARES [CHAP. 6]
ORTHOGONALITY AND LEAST-SQUARES [CHAP. 6] Inner products and Norms Inner product or dot product of 2 vectors u and v in R n : u.v = u 1 v 1 + u 2 v 2 + + u n v n Calculate u.v when u = 1 2 2 0 v = 1 0
More informationLINEAR ALGEBRA W W L CHEN
LINEAR ALGEBRA W W L CHEN c W W L Chen, 1997, 2008. This chapter is available free to all individuals, on the understanding that it is not to be used for financial gain, and may be downloaded and/or photocopied,
More informationLecture 23: 6.1 Inner Products
Lecture 23: 6.1 Inner Products Wei-Ta Chu 2008/12/17 Definition An inner product on a real vector space V is a function that associates a real number u, vwith each pair of vectors u and v in V in such
More informationv = v 1 2 +v 2 2. Two successive applications of this idea give the length of the vector v R 3 :
Length, Angle and the Inner Product The length (or norm) of a vector v R 2 (viewed as connecting the origin to a point (v 1,v 2 )) is easily determined by the Pythagorean Theorem and is denoted v : v =
More informationInner products. Theorem (basic properties): Given vectors u, v, w in an inner product space V, and a scalar k, the following properties hold:
Inner products Definition: An inner product on a real vector space V is an operation (function) that assigns to each pair of vectors ( u, v) in V a scalar u, v satisfying the following axioms: 1. u, v
More informationInner Product Spaces
Inner Product Spaces Linear Algebra Josh Engwer TTU 28 October 2015 Josh Engwer (TTU) Inner Product Spaces 28 October 2015 1 / 15 Inner Product Space (Definition) An inner product is the notion of a dot
More informationGeometry of Vector Spaces
Geometry of Vector Spaces Fall 14 MATH43 In these notes we show that it is possible to do geometry in vector spaces as well, that is similar to plane geometry. We start by giving the definition of an abstract
More informationLinear Algebra. Alvin Lin. August December 2017
Linear Algebra Alvin Lin August 207 - December 207 Linear Algebra The study of linear algebra is about two basic things. We study vector spaces and structure preserving maps between vector spaces. A vector
More informationUnit 2. Projec.ons and Subspaces
Unit. Projec.ons and Subspaces Linear Algebra and Op.miza.on MSc Bioinforma.cs for Health Sciences Eduardo Eyras Pompeu Fabra University 8-9 hkp://comprna.upf.edu/courses/master_mat/ Inner product (scalar
More information6. Orthogonality and Least-Squares
Linear Algebra 6. Orthogonality and Least-Squares CSIE NCU 1 6. Orthogonality and Least-Squares 6.1 Inner product, length, and orthogonality. 2 6.2 Orthogonal sets... 8 6.3 Orthogonal projections... 13
More informationThe Gram-Schmidt Process 1
The Gram-Schmidt Process In this section all vector spaces will be subspaces of some R m. Definition.. Let S = {v...v n } R m. The set S is said to be orthogonal if v v j = whenever i j. If in addition
More information7 Bilinear forms and inner products
7 Bilinear forms and inner products Definition 7.1 A bilinear form θ on a vector space V over a field F is a function θ : V V F such that θ(λu+µv,w) = λθ(u,w)+µθ(v,w) θ(u,λv +µw) = λθ(u,v)+µθ(u,w) for
More informationThe Transpose of a Vector
8 CHAPTER Vectors The Transpose of a Vector We now consider the transpose of a vector in R n, which is a row vector. For a vector u 1 u. u n the transpose is denoted by u T = [ u 1 u u n ] EXAMPLE -5 Find
More informationb 1 b 2.. b = b m A = [a 1,a 2,...,a n ] where a 1,j a 2,j a j = a m,j Let A R m n and x 1 x 2 x = x n
Lectures -2: Linear Algebra Background Almost all linear and nonlinear problems in scientific computation require the use of linear algebra These lectures review basic concepts in a way that has proven
More informationMATH 235: Inner Product Spaces, Assignment 7
MATH 235: Inner Product Spaces, Assignment 7 Hand in questions 3,4,5,6,9, by 9:3 am on Wednesday March 26, 28. Contents Orthogonal Basis for Inner Product Space 2 2 Inner-Product Function Space 2 3 Weighted
More informationF F. proj cos( ) v. v proj v
Geometric Definition of Dot Product 1.2 The Dot Product Suppose you are pulling up on a rope attached to a box, as shown above. How would you find the force moving the box towards you? As stated above,
More informationRecall: Dot product on R 2 : u v = (u 1, u 2 ) (v 1, v 2 ) = u 1 v 1 + u 2 v 2, u u = u u 2 2 = u 2. Geometric Meaning:
Recall: Dot product on R 2 : u v = (u 1, u 2 ) (v 1, v 2 ) = u 1 v 1 + u 2 v 2, u u = u 2 1 + u 2 2 = u 2. Geometric Meaning: u v = u v cos θ. u θ v 1 Reason: The opposite side is given by u v. u v 2 =
More informationMATH 304 Linear Algebra Lecture 19: Least squares problems (continued). Norms and inner products.
MATH 304 Linear Algebra Lecture 19: Least squares problems (continued). Norms and inner products. Orthogonal projection Theorem 1 Let V be a subspace of R n. Then any vector x R n is uniquely represented
More informationINNER PRODUCT SPACE. Definition 1
INNER PRODUCT SPACE Definition 1 Suppose u, v and w are all vectors in vector space V and c is any scalar. An inner product space on the vectors space V is a function that associates with each pair of
More informationInner Product Spaces
Inner Product Spaces Introduction Recall in the lecture on vector spaces that geometric vectors (i.e. vectors in two and three-dimensional Cartesian space have the properties of addition, subtraction,
More informationProjection Theorem 1
Projection Theorem 1 Cauchy-Schwarz Inequality Lemma. (Cauchy-Schwarz Inequality) For all x, y in an inner product space, [ xy, ] x y. Equality holds if and only if x y or y θ. Proof. If y θ, the inequality
More informationMath 350 Fall 2011 Notes about inner product spaces. In this notes we state and prove some important properties of inner product spaces.
Math 350 Fall 2011 Notes about inner product spaces In this notes we state and prove some important properties of inner product spaces. First, recall the dot product on R n : if x, y R n, say x = (x 1,...,
More informationDefinitions and Properties of R N
Definitions and Properties of R N R N as a set As a set R n is simply the set of all ordered n-tuples (x 1,, x N ), called vectors. We usually denote the vector (x 1,, x N ), (y 1,, y N ), by x, y, or
More informationIntroduction to Kernel methods
Introduction to Kernel ethods ML Workshop, ISI Kolkata Chiranjib Bhattacharyya Machine Learning lab Dept of CSA, IISc chiru@csa.iisc.ernet.in http://drona.csa.iisc.ernet.in/~chiru 19th Oct, 2012 Introduction
More informationFinal Exam - Take Home Portion Math 211, Summer 2017
Final Exam - Take Home Portion Math 2, Summer 207 Name: Directions: Complete a total of 5 problems. Problem must be completed. The remaining problems are categorized in four groups. Select one problem
More informationContents. Appendix D (Inner Product Spaces) W-51. Index W-63
Contents Appendix D (Inner Product Spaces W-5 Index W-63 Inner city space W-49 W-5 Chapter : Appendix D Inner Product Spaces The inner product, taken of any two vectors in an arbitrary vector space, generalizes
More informationDesigning Information Devices and Systems I Fall 2018 Lecture Notes Note 21
EECS 16A Designing Information Devices and Systems I Fall 2018 Lecture Notes Note 21 21.1 Module Goals In this module, we introduce a family of ideas that are connected to optimization and machine learning,
More informationLESSON 23: EXTREMA OF FUNCTIONS OF 2 VARIABLES OCTOBER 25, 2017
LESSON : EXTREMA OF FUNCTIONS OF VARIABLES OCTOBER 5, 017 Just like with functions of a single variable, we want to find the minima (plural of minimum) and maxima (plural of maximum) of functions of several
More informationMath Linear Algebra II. 1. Inner Products and Norms
Math 342 - Linear Algebra II Notes 1. Inner Products and Norms One knows from a basic introduction to vectors in R n Math 254 at OSU) that the length of a vector x = x 1 x 2... x n ) T R n, denoted x,
More informationThe Gram Schmidt Process
The Gram Schmidt Process Now we will present a procedure, based on orthogonal projection, that converts any linearly independent set of vectors into an orthogonal set. Let us begin with the simple case
More informationThe Gram Schmidt Process
u 2 u The Gram Schmidt Process Now we will present a procedure, based on orthogonal projection, that converts any linearly independent set of vectors into an orthogonal set. Let us begin with the simple
More information6.1. Inner Product, Length and Orthogonality
These are brief notes for the lecture on Friday November 13, and Monday November 1, 2009: they are not complete, but they are a guide to what I want to say on those days. They are guaranteed to be incorrect..1.
More informationChapter 4 Euclid Space
Chapter 4 Euclid Space Inner Product Spaces Definition.. Let V be a real vector space over IR. A real inner product on V is a real valued function on V V, denoted by (, ), which satisfies () (x, y) = (y,
More informationLinear Algebra Massoud Malek
CSUEB Linear Algebra Massoud Malek Inner Product and Normed Space In all that follows, the n n identity matrix is denoted by I n, the n n zero matrix by Z n, and the zero vector by θ n An inner product
More informationNotes on multivariable calculus
Notes on multivariable calculus Jonathan Wise February 2, 2010 1 Review of trigonometry Trigonometry is essentially the study of the relationship between polar coordinates and Cartesian coordinates in
More informationDot product. The dot product is an inner product on a coordinate vector space (Definition 1, Theorem
Dot product The dot product is an inner product on a coordinate vector space (Definition 1, Theorem 1). Definition 1 Given vectors v and u in n-dimensional space, the dot product is defined as, n v u v
More informationGive a geometric description of the set of points in space whose coordinates satisfy the given pair of equations.
1. Give a geometric description of the set of points in space whose coordinates satisfy the given pair of equations. x + y = 5, z = 4 Choose the correct description. A. The circle with center (0,0, 4)
More informationSec. 1.1: Basics of Vectors
Sec. 1.1: Basics of Vectors Notation for Euclidean space R n : all points (x 1, x 2,..., x n ) in n-dimensional space. Examples: 1. R 1 : all points on the real number line. 2. R 2 : all points (x 1, x
More informationVector Spaces 4.2 Vector Spaces
4.2 September 27 4.2 Goals Give definition of Give examples and non-examples of 4.2 Abstruct Definition of A List of Important Properties of Operations on Sets On the set of integers Z, or on the set of
More informationSection 7.5 Inner Product Spaces
Section 7.5 Inner Product Spaces With the dot product defined in Chapter 6, we were able to study the following properties of vectors in R n. ) Length or norm of a vector u. ( u = p u u ) 2) Distance of
More informationLecture 1.4: Inner products and orthogonality
Lecture 1.4: Inner products and orthogonality Matthew Macauley Department of Mathematical Sciences Clemson University http://www.math.clemson.edu/~macaule/ Math 4340, Advanced Engineering Mathematics M.
More informationLinear Analysis Lecture 5
Linear Analysis Lecture 5 Inner Products and V Let dim V < with inner product,. Choose a basis B and let v, w V have coordinates in F n given by x 1. x n and y 1. y n, respectively. Let A F n n be the
More information4.1 Distance and Length
Chapter Vector Geometry In this chapter we will look more closely at certain geometric aspects of vectors in R n. We will first develop an intuitive understanding of some basic concepts by looking at vectors
More informationSolution to Homework 1
Solution to Homework 1 Olena Bormashenko September, 0 Section 1.1:, 5b)d), 7b)f), 8a)b), ; Section 1.:, 5, 7, 9, 10, b)c), 1, 15b), 3 Section 1.1. In each of the following cases, find a point that is two-thirds
More informationVector Geometry. Chapter 5
Chapter 5 Vector Geometry In this chapter we will look more closely at certain geometric aspects of vectors in R n. We will first develop an intuitive understanding of some basic concepts by looking at
More informationVector Spaces 4.1 Vectors in n Spaces
Vector Spaces 4.1 Vectors in n Spaces September 27 Goals Get familar with real n spaces R n, like R 2, R 3. Get familiar with some of the properties of the real n spaces R n. Justify why points in R n
More informationVector spaces. DS-GA 1013 / MATH-GA 2824 Optimization-based Data Analysis.
Vector spaces DS-GA 1013 / MATH-GA 2824 Optimization-based Data Analysis http://www.cims.nyu.edu/~cfgranda/pages/obda_fall17/index.html Carlos Fernandez-Granda Vector space Consists of: A set V A scalar
More information6 Inner Product Spaces
Lectures 16,17,18 6 Inner Product Spaces 6.1 Basic Definition Parallelogram law, the ability to measure angle between two vectors and in particular, the concept of perpendicularity make the euclidean space
More informationSECTION v 2 x + v 2 y, (5.1)
CHAPTER 5 5.1 Normed Spaces SECTION 5.1 171 REAL AND COMPLEX NORMED, METRIC, AND INNER PRODUCT SPACES So far, our studies have concentrated only on properties of vector spaces that follow from Definition
More informationWorksheet for Lecture 23 (due December 4) Section 6.1 Inner product, length, and orthogonality
Worksheet for Lecture (due December 4) Name: Section 6 Inner product, length, and orthogonality u Definition Let u = u n product or dot product to be and v = v v n be vectors in R n We define their inner
More informationOutline. Linear Algebra for Computer Vision
Outline Linear Algebra for Computer Vision Introduction CMSC 88 D Notation and Basics Motivation Linear systems of equations Gauss Elimination, LU decomposition Linear Spaces and Operators Addition, scalar
More informationThere are two things that are particularly nice about the first basis
Orthogonality and the Gram-Schmidt Process In Chapter 4, we spent a great deal of time studying the problem of finding a basis for a vector space We know that a basis for a vector space can potentially
More informationMATH Linear Algebra
MATH 4 - Linear Algebra One of the key driving forces for the development of linear algebra was the profound idea (going back to 7th century and the work of Pierre Fermat and Rene Descartes) that geometry
More informationMAT 1339-S14 Class 8
MAT 1339-S14 Class 8 July 28, 2014 Contents 7.2 Review Dot Product........................... 2 7.3 Applications of the Dot Product..................... 4 7.4 Vectors in Three-Space.........................
More informationPractical Linear Algebra: A Geometry Toolbox
Practical Linear Algebra: A Geometry Toolbox Third edition Chapter 2: Here and There: Points and Vectors in 2D Gerald Farin & Dianne Hansford CRC Press, Taylor & Francis Group, An A K Peters Book www.farinhansford.com/books/pla
More informationQuiz 2 Practice Problems
Quiz Practice Problems Practice problems are similar, both in difficulty and in scope, to the type of problems you will see on the quiz. Problems marked with a are for your entertainment and are not essential.
More informationLast week we presented the following expression for the angles between two vectors u and v in R n ( ) θ = cos 1 u v
Orthogonality (I) Last week we presented the following expression for the angles between two vectors u and v in R n ( ) θ = cos 1 u v u v which brings us to the fact that θ = π/2 u v = 0. Definition (Orthogonality).
More informationDot Products. K. Behrend. April 3, Abstract A short review of some basic facts on the dot product. Projections. The spectral theorem.
Dot Products K. Behrend April 3, 008 Abstract A short review of some basic facts on the dot product. Projections. The spectral theorem. Contents The dot product 3. Length of a vector........................
More informationRepresentation of objects. Representation of objects. Transformations. Hierarchy of spaces. Dimensionality reduction
Representation of objects Representation of objects For searching/mining, first need to represent the objects Images/videos: MPEG features Graphs: Matrix Text document: tf/idf vector, bag of words Kernels
More informationJim Lambers MAT 169 Fall Semester Practice Final Exam
Jim Lambers MAT 169 Fall Semester 2010-11 Practice Final Exam 1. A ship is moving northwest at a speed of 50 mi/h. A passenger is walking due southeast on the deck at 4 mi/h. Find the speed of the passenger
More information10.1 Three Dimensional Space
Math 172 Chapter 10A notes Page 1 of 12 10.1 Three Dimensional Space 2D space 0 xx.. xx-, 0 yy yy-, PP(xx, yy) [Fig. 1] Point PP represented by (xx, yy), an ordered pair of real nos. Set of all ordered
More informationCovariance and Dot Product
Covariance and Dot Product 1 Introduction. As you learned in Calculus III and Linear Algebra, the dot product of two vectors x = (x 1,..., x n ) and y = (y 1,..., y n ) in R n is the number n := x i y
More informationOrthonormal Bases; Gram-Schmidt Process; QR-Decomposition
Orthonormal Bases; Gram-Schmidt Process; QR-Decomposition MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 205 Motivation When working with an inner product space, the most
More informationDesigning Information Devices and Systems II
EECS 16B Fall 2016 Designing Information Devices and Systems II Linear Algebra Notes Introduction In this set of notes, we will derive the linear least squares equation, study the properties symmetric
More informationVectors in Function Spaces
Jim Lambers MAT 66 Spring Semester 15-16 Lecture 18 Notes These notes correspond to Section 6.3 in the text. Vectors in Function Spaces We begin with some necessary terminology. A vector space V, also
More information1. Subspaces A subset M of Hilbert space H is a subspace of it is closed under the operation of forming linear combinations;i.e.,
Abstract Hilbert Space Results We have learned a little about the Hilbert spaces L U and and we have at least defined H 1 U and the scale of Hilbert spaces H p U. Now we are going to develop additional
More informationLecture Note on Linear Algebra 17. Standard Inner Product
Lecture Note on Linear Algebra 17. Standard Inner Product Wei-Shi Zheng, wszheng@ieee.org, 2011 November 21, 2011 1 What Do You Learn from This Note Up to this point, the theory we have established can
More informationApproximation Theory
Approximation Theory Function approximation is the task of constructing, for a given function, a simpler function so that the difference between the two functions is small and to then provide a quantifiable
More informationCHAPTER II HILBERT SPACES
CHAPTER II HILBERT SPACES 2.1 Geometry of Hilbert Spaces Definition 2.1.1. Let X be a complex linear space. An inner product on X is a function, : X X C which satisfies the following axioms : 1. y, x =
More information7.1 Projections and Components
7. Projections and Components As we have seen, the dot product of two vectors tells us the cosine of the angle between them. So far, we have only used this to find the angle between two vectors, but cosines
More informationMTH 2310, FALL Introduction
MTH 2310, FALL 2011 SECTION 6.2: ORTHOGONAL SETS Homework Problems: 1, 5, 9, 13, 17, 21, 23 1, 27, 29, 35 1. Introduction We have discussed previously the benefits of having a set of vectors that is linearly
More informationMTAEA Vectors in Euclidean Spaces
School of Economics, Australian National University January 25, 2010 Vectors. Economists usually work in the vector space R n. A point in this space is called a vector, and is typically defined by its
More informationEGR2013 Tutorial 8. Linear Algebra. Powers of a Matrix and Matrix Polynomial
EGR1 Tutorial 8 Linear Algebra Outline Powers of a Matrix and Matrix Polynomial Vector Algebra Vector Spaces Powers of a Matrix and Matrix Polynomial If A is a square matrix, then we define the nonnegative
More informationLinear Algebra: Homework 3
Linear Algebra: Homework 3 Alvin Lin August 206 - December 206 Section.2 Exercise 48 Find all values of the scalar k for which the two vectors are orthogonal. [ ] [ ] 2 k + u v 3 k u v 0 2(k + ) + 3(k
More informationApplied Linear Algebra in Geoscience Using MATLAB
Applied Linear Algebra in Geoscience Using MATLAB Contents Getting Started Creating Arrays Mathematical Operations with Arrays Using Script Files and Managing Data Two-Dimensional Plots Programming in
More informationOverview of vector calculus. Coordinate systems in space. Distance formula. (Sec. 12.1)
Math 20C Multivariable Calculus Lecture 1 1 Coordinates in space Slide 1 Overview of vector calculus. Coordinate systems in space. Distance formula. (Sec. 12.1) Vector calculus studies derivatives and
More information10 Orthogonality Orthogonal subspaces
10 Orthogonality 10.1 Orthogonal subspaces In the plane R 2 we think of the coordinate axes as being orthogonal (perpendicular) to each other. We can express this in terms of vectors by saying that every
More information1. General Vector Spaces
1.1. Vector space axioms. 1. General Vector Spaces Definition 1.1. Let V be a nonempty set of objects on which the operations of addition and scalar multiplication are defined. By addition we mean a rule
More informationMath Linear Algebra
Math 220 - Linear Algebra (Summer 208) Solutions to Homework #7 Exercise 6..20 (a) TRUE. u v v u = 0 is equivalent to u v = v u. The latter identity is true due to the commutative property of the inner
More informationMath 328 Course Notes
Math 328 Course Notes Ian Robertson March 3, 2006 3 Properties of C[0, 1]: Sup-norm and Completeness In this chapter we are going to examine the vector space of all continuous functions defined on the
More informationFFTs in Graphics and Vision. The Laplace Operator
FFTs in Graphics and Vision The Laplace Operator 1 Outline Math Stuff Symmetric/Hermitian Matrices Lagrange Multipliers Diagonalizing Symmetric Matrices The Laplacian Operator 2 Linear Operators Definition:
More informationChapter 6: Orthogonality
Chapter 6: Orthogonality (Last Updated: November 7, 7) These notes are derived primarily from Linear Algebra and its applications by David Lay (4ed). A few theorems have been moved around.. Inner products
More informationVector Spaces. distributive law u,v. Associative Law. 1 v v. Let 1 be the unit element in F, then
1 Def: V be a set of elements with a binary operation + is defined. F be a field. A multiplication operator between a F and v V is also defined. The V is called a vector space over the field F if: V is
More information1 The theoretical constructions
Linear Transformations and Matrix Representations Samuel R Buss - Spring 003 Revision (Corrections appreciated!) These notes review the topics I lectured on while covering sections 4, 4, and 5 of the textbook
More informationINVITATION FOR BID Exploratory Geothermal Drilling Services Department of Natural Resources (DNR)
V F B 21064 xy G v f u u ( B u: y : : u : -B ( u /k Wy y 30 2 1500 ff y W 98501 Bx 41017 y W 98504-1017 W 360-407-9399 w@wv y 18 2012 2:00 1500 ff 2331 y W 98501 ://wwwwv//u-f ://wwwwv/v/-k B U B V BF
More informationLinear Algebra. Session 12
Linear Algebra. Session 12 Dr. Marco A Roque Sol 08/01/2017 Example 12.1 Find the constant function that is the least squares fit to the following data x 0 1 2 3 f(x) 1 0 1 2 Solution c = 1 c = 0 f (x)
More informationFunctions of Several Variables
Jim Lambers MAT 419/519 Summer Session 2011-12 Lecture 2 Notes These notes correspond to Section 1.2 in the text. Functions of Several Variables We now generalize the results from the previous section,
More informationMath 261 Lecture Notes: Sections 6.1, 6.2, 6.3 and 6.4 Orthogonal Sets and Projections
Math 6 Lecture Notes: Sections 6., 6., 6. and 6. Orthogonal Sets and Projections We will not cover general inner product spaces. We will, however, focus on a particular inner product space the inner product
More information10.2,3,4. Vectors in 3D, Dot products and Cross Products
Name: Section: 10.2,3,4. Vectors in 3D, Dot products and Cross Products 1. Sketch the plane parallel to the xy-plane through (2, 4, 2) 2. For the given vectors u and v, evaluate the following expressions.
More informationPrecalculus Notes: Unit 6 Vectors, Parametrics, Polars, & Complex Numbers
Syllabus Objectives: 5.1 The student will eplore methods of vector addition and subtraction. 5. The student will develop strategies for computing a vector s direction angle and magnitude given its coordinates.
More information94 CHAPTER 3. VECTORS AND THE GEOMETRY OF SPACE
94 CHAPTER 3. VECTORS AND THE GEOMETRY OF SPACE 3.3 Dot Product We haven t yet de ned a multiplication between vectors. It turns out there are di erent ways this can be done. In this section, we present
More informationMTH 2032 SemesterII
MTH 202 SemesterII 2010-11 Linear Algebra Worked Examples Dr. Tony Yee Department of Mathematics and Information Technology The Hong Kong Institute of Education December 28, 2011 ii Contents Table of Contents
More information(, ) : R n R n R. 1. It is bilinear, meaning it s linear in each argument: that is
17 Inner products Up until now, we have only examined the properties of vectors and matrices in R n. But normally, when we think of R n, we re really thinking of n-dimensional Euclidean space - that is,
More informationVector Calculus. Lecture Notes
Vector Calculus Lecture Notes Adolfo J. Rumbos c Draft date November 23, 211 2 Contents 1 Motivation for the course 5 2 Euclidean Space 7 2.1 Definition of n Dimensional Euclidean Space........... 7 2.2
More informationDerivatives in 2D. Outline. James K. Peterson. November 9, Derivatives in 2D! Chain Rule
Derivatives in 2D James K. Peterson Department of Biological Sciences and Department of Mathematical Sciences Clemson University November 9, 2016 Outline Derivatives in 2D! Chain Rule Let s go back to
More informationAnother consequence of the Cauchy Schwarz inequality is the continuity of the inner product.
. Inner product spaces 1 Theorem.1 (Cauchy Schwarz inequality). If X is an inner product space then x,y x y. (.) Proof. First note that 0 u v v u = u v u v Re u,v. (.3) Therefore, Re u,v u v (.) for all
More informationWorksheet 1.4: Geometry of the Dot and Cross Products
Boise State Math 275 (Ultman) Worksheet 1.4: Geometry of the Dot and Cross Products From the Toolbox (what you need from previous classes): Basic algebra and trigonometry: be able to solve quadratic equations,
More informationThe Cross Product of Two Vectors
The Cross roduct of Two Vectors In proving some statements involving surface integrals, there will be a need to approximate areas of segments of the surface by areas of parallelograms. Therefore it is
More information