Covariance and Dot Product
|
|
- Blaise Dalton
- 6 years ago
- Views:
Transcription
1 Covariance and Dot Product 1 Introduction. As you learned in Calculus III and Linear Algebra, the dot product of two vectors x = (x 1,..., x n ) and y = (y 1,..., y n ) in R n is the number n := x i y i, and as you learned in Probability, the covariance of two random variables X and Y 1 is the number i=1 := E [(X µ X )(Y µ Y )]. These two quantities appear to have nothing in common, beyond the fact that each is a function that accepts two inputs of the same type and returns a numerical value. Appearances can be deceptive, though: the dot product and the covariance are actually twins. In this handout, I will show why this is so. 2 Dot Products and Covariance: Elementary Properties. The table below lists each elementary property 2 of dot product beside the corresponding elementary property of covariance. As you can see, except for a slight discrepancy between L2 and R2, the properties in each row correspond perfectly. Dot Product Covariance L1. 0 R1. 0 L2. = 0 x = 0 R2. = 0 X is constant L3. = y x R3. = Cov(Y, X) L4. (α x) y = α() = x (α y) R4. Cov(αX, Y ) = α = Cov(x, αy ) L5. x ( y 1 + y 2 ) = ( 1 ) + ( 2 ) R5. Cov(X, Y 1 +Y 2 ) = Cov(X, Y 1 ) + Cov(X, Y 2 ) 1 X and Y need to be defined on the same sample space. We will assume throughout that this is the case. 2 These properties are deemed elementary because all of the other properties can be derived from them. 1
2 3 Dot Products and Covariance: Some Derived Properties. As I mentioned in the introduction, there many properties follow from L1 L5 or respectively from R1 R5. In this section, I will discuss several important examples. 3.1 The Pythagorean Relation. I will begin with a pair of parallel definitions: the length of a vector and the standard deviation of a random variable. 3 Dot Product Covariance x := σ X := L6. x + y 2 = x 2 + 2() + y 2 R6. σ 2 X+Y σ 2 Y L7. = 0 x + y 2 = x 2 + y 2 R7. = 0 σ 2 X+Y + σ 2 Y Formulas L6/R6 can be derived by routine parallel calculations from L1 L5 and R1 R5 respectively, and properties L7/R7 follow immediately from formulas L6/R6 respectively. When both sides of the in L7 (respectively R7) are true, then each of these formulas can be intrepreted as the Pythagorean Theorem for an appropriately labeled right triangle. Exercise 1 (a): Derive Formula L6 from properties L1 L5 and the definition of x. (b): Use L6 to prove L7. Exercise 2 (a): Derive Formula R6 from properties R1 R5 and the definition of σ X. (b): Use R6 to prove R The Cauchy-Schwarz Inequality. The most important property of the dot product is the formula (for nonzero vectors) (1) = ( x )( y ) cos(θ), 3 It is important to note that we are defining x from the dot product of x with itself not from the coordinates of x). Similarly, we are using covariance to define σ X.
3 where 0 θ π is the non-reflex angle between x and y. 4 There is an immediate consequence that follows from (1). If you take the absolute value on both sides of (1) and use the fact that cos(θ) 1, you arrive very quickly at the Cauchy-Schwarz Inequality: 5 (2) ( x )( y ). At first glance, it does not seem as though either (1) or (2) could possibly correspond to a property of covariance. Consider (1) first. The the analogue of this equation for covariance would seem to be (3) = σ X σ Y cos(φ), for some angle φ. This equation seems utterly meaningless: what angle could φ possibly represent? Now, consider (2). In this case, the analoguous inequality for covariance would seem to be (4) σ X σ Y. In contrast to equation (3), inequality (4) is definitely not meaningless; however, it is not clear (yet) whether it is true. At this point, we certainly do not have a proof of it: without an angle φ that makes (3) true, we cannot use cos(φ) 1 to deduce (4) from (3). Remarkably, as it turns out, there is a different way to prove (1) and (2). The trick, as you will see (Theorem 3.1 below), is to reverse the logical order, by first proving (2) without using cos(θ) and then by using (2) to prove (1). It also turns out that this alternate approach does have a covariance parallel; the proof or (2) corresponds to a proof of (4), and the proof of (1) from (2) indicates what angle φ will make (3) true. The cosine-free proof of (2) is based upon the properties of projections. Recall that if x is a nonzero vector and y is any vector, then the projection p = proj x ( y) of y onto x is the shadow that y casts upon the line l containing x, when the light rays are perpendicular to l. 6 Recall also that one can calculate p with the dot-product-based formula 7 (5) p = x. Since (5) is dot-product based, it gives rise to an analogous covariance-based entity, namely the random variable ( ) (6) P := X, where X is a nonconstant random variable and Y is any random variable. Before discussing the details of Theorem 3.1, I will extend the table so as to include definitions (5) and (6) and equations (1), (2), (3), and (4); this should help you keep the larger picture in focus. 8 4 θ is contained in the (usually) unique plane P containing x and y. 5 The importance of this inequality, which cannot be made clear in a Calculus III course, will emerge in the course of this discussion. 6 The light rays are in the same plane P mentioned above. 7 Formula (5) should actually be viewed as the definition of proj x ( y). 8 You may find the complete table on the last page of this handout.
4 (5). p := x (6). P := ( ) X L8. p ( y p) = 0 R8. Cov(P, Y P ) = 0 L9. ( x )( y ) R9. σ X σ Y L10. = ( x )( y ) cos(θ) R10. = σ X σ Y cos(φ) The proofs of R8 and R9, which parallel the proofs of of L8 and L9, will be left as exercises. Property R10, which is still meaningless at this point, will be discussed in section 3.3. Theorem 3.1 L8: p ( y p) = 0, where p is the vector proj x ( y). L9: ( x )( y ). L10: = ( x )( y ) cos(θ). Proof of L8. The proof will be easier to follow if I first put α := Equation (5) in the simpler form (7) The proof is the following calculation. p = α x. p ( y p) = (α x) ( y α x) (L4) = α[ x ( y α x)] (L5) = α[ x (α x)] (L4) = α[ α()] (definition of α) = α[ ()] (cancel) = α[ ] = 0. Proof of L9. The first step is to apply the = direction of L7 to L9: : this allows me to express (8) p ( y p) = 0 = p 2 + y p 2 = y 2. Since y p 2 0, (8) leads immediately to the inequality (9) or, equivalently, p 2 y 2 p p y 2.
5 Then, replacing p with α x and calculating gives (10) (α x) (α x) y 2 α 2 x 2 y 2 α x y ( ) x 2 x y x y ( x )( y ). Proof of L10. From L9, it follows that ( x )( y ) = ( x )( y ) 1, so that there is an angle ˆθ such that We also know from equation (1) 9 that cos(ˆθ) = ( x )( y ). Hence, cos(ˆθ) = cos(θ), so that ˆθ = θ. cos(θ) = ( x )( y ). As mentioned above, one can prove R8 and LR by same arguments used to prove L8 and L9. I will therefore leave the proof of Theorem 3.2 as an exercise. Theorem 3.2 R8: Cov(P, Y P ) = 0, where P is the random variable defined in (6). R9: σ X σ Y. Exercise 3 Prove both parts of Theorem 3.2. Exercise 4 One of the Calculus III handouts uses L9 to prove the triangle inequality By a parallel argument, use R9 to prove x + y x + y. σ X+Y σ X + σ Y. 9 We know this equation is correct by the Law-of-Cosines proof from Calc III/Linear Algebra.
6 Exercise 5 (a): Show that if you get equality in L9 that is, if = ( x )( y ) then y = c x for a certain scalar c. (Identify c.) (Hint: If you have equality in the last line of the proof of L9 [inequality (10)], then (working upwards), you also have equality in (9), so you can replace p 2 with y 2 in equation (8). Do so, and proceed from there...) (b): Show that if you get equality in R9 that is, if = σ X σ Y then Y = mx +b for certain scalars m and b. (Identify m.) 3.3 Property R10 and the Correlation Coefficient. If we divide R9 through by σ X σ Y, we get (11) σ X σ Y there is therefore an angle φ such that (12) Multiplying (12) through by σ X σ Y then gives σ X σ Y = σ X σ Y 1; = cos(φ). = σ X σ Y cos(φ), so that R10 holds true for this angle φ. This suggests that we define the angle between X and Y to be this angle φ. 10 As you are aware, the correlation coefficient ρ(x, Y ) of two nonconstant random variables X and Y is defined by the formula (13) ρ(x, Y ) :=. σ X σ Y Compare equations (13) and (12): ρ(x, Y ) is the cos(φ) of equation (12). Now compare equation (13) and inequality (11): inequality (11) is actually the well-known theorem ρ(x, Y ) 1. As you are also aware, different values of ρ(x, Y ) imply different linear relationships between X and Y : 11 ρ(x, Y ) is close to 1 Y is almost an increasing linear function of X ρ(x, Y ) is close to ( 1) Y is almost a decreasing linear function of X ρ(x, Y ) is close to 0 there is almost no linear relationship between X and Y If you vizualize ρ(x, Y ) as the cosine of the angle between X and Y, you will form a complementary mental image picture: ρ(x, Y ) is close to 1 X and Y go in almost the same direction ρ(x, Y ) is close to ( 1) X and Y go in almost the opposite directions ρ(x, Y ) is close to 0 X and Y are almost perpendicular 10 Observe that the collection of random variables over a fixed sample space constitutes a vector space. You can visualize X, Y and φ against this backdrop. 11 Compare Exercise 5(b).
7 4 The Entire Table. Dot Product Covariance L1. 0 R1. 0 L2. = 0 x = 0 R2. = 0 X is constant L3. = y x R3. = Cov(Y, X) L4. (α x) y = α() = x (α y) R4. Cov(αX, Y ) = α = Cov(x, αy ) L5. x ( y 1 + y 2 ) = ( 1 ) + ( 2 ) R5. Cov(X, Y 1 +Y 2 ) = Cov(X, Y 1 ) + Cov(X, Y 2 ) x := σ X := L6. x + y 2 = x 2 + 2() + y 2 R6. σ 2 X+Y σ 2 Y L7. = 0 x + y 2 = x 2 + y 2 R7. = 0 σ 2 X+Y + σ 2 Y (5). p := x (6). P := ( ) X L8. p ( y p) = 0 R8. Cov(P, Y P ) = 0 L9. ( x )( y ) R9. σ X σ Y L10. = ( x )( y ) cos(θ) R10. = σ X σ Y cos(φ)
Linear Algebra. Alvin Lin. August December 2017
Linear Algebra Alvin Lin August 207 - December 207 Linear Algebra The study of linear algebra is about two basic things. We study vector spaces and structure preserving maps between vector spaces. A vector
More informationDot Products. K. Behrend. April 3, Abstract A short review of some basic facts on the dot product. Projections. The spectral theorem.
Dot Products K. Behrend April 3, 008 Abstract A short review of some basic facts on the dot product. Projections. The spectral theorem. Contents The dot product 3. Length of a vector........................
More informationMATH 12 CLASS 2 NOTES, SEP Contents. 2. Dot product: determining the angle between two vectors 2
MATH 12 CLASS 2 NOTES, SEP 23 2011 Contents 1. Dot product: definition, basic properties 1 2. Dot product: determining the angle between two vectors 2 Quick links to definitions/theorems Dot product definition
More informationWhat you will learn today
What you will learn today The Dot Product Equations of Vectors and the Geometry of Space 1/29 Direction angles and Direction cosines Projections Definitions: 1. a : a 1, a 2, a 3, b : b 1, b 2, b 3, a
More informationv = v 1 2 +v 2 2. Two successive applications of this idea give the length of the vector v R 3 :
Length, Angle and the Inner Product The length (or norm) of a vector v R 2 (viewed as connecting the origin to a point (v 1,v 2 )) is easily determined by the Pythagorean Theorem and is denoted v : v =
More information7.1 Projections and Components
7. Projections and Components As we have seen, the dot product of two vectors tells us the cosine of the angle between them. So far, we have only used this to find the angle between two vectors, but cosines
More informationSolution to Homework 1
Solution to Homework 1 Olena Bormashenko September, 0 Section 1.1:, 5b)d), 7b)f), 8a)b), ; Section 1.:, 5, 7, 9, 10, b)c), 1, 15b), 3 Section 1.1. In each of the following cases, find a point that is two-thirds
More informationLaw of Trichotomy and Boundary Equations
Law of Trichotomy and Boundary Equations Law of Trichotomy: For any two real numbers a and b, exactly one of the following is true. i. a < b ii. a = b iii. a > b The Law of Trichotomy is a formal statement
More informationNotes on multivariable calculus
Notes on multivariable calculus Jonathan Wise February 2, 2010 1 Review of trigonometry Trigonometry is essentially the study of the relationship between polar coordinates and Cartesian coordinates in
More information(arrows denote positive direction)
12 Chapter 12 12.1 3-dimensional Coordinate System The 3-dimensional coordinate system we use are coordinates on R 3. The coordinate is presented as a triple of numbers: (a,b,c). In the Cartesian coordinate
More informationy 2 . = x 1y 1 + x 2 y x + + x n y n 2 7 = 1(2) + 3(7) 5(4) = 3. x x = x x x2 n.
6.. Length, Angle, and Orthogonality In this section, we discuss the defintion of length and angle for vectors and define what it means for two vectors to be orthogonal. Then, we see that linear systems
More informationExercise Solutions for Introduction to 3D Game Programming with DirectX 10
Exercise Solutions for Introduction to 3D Game Programming with DirectX 10 Frank Luna, September 6, 009 Solutions to Part I Chapter 1 1. Let u = 1, and v = 3, 4. Perform the following computations and
More information3 Scalar Product. 3.0 The Dot Product. ~v ~w := v 1 w 1 + v 2 w v n w n.
3 Scalar Product Copyright 2017, Gregory G. Smith 28 September 2017 Although vector products on R n are rare, every coordinate space R n is equipped with a binary operation that sends two vectors to a
More informationDesigning Information Devices and Systems I Fall 2018 Lecture Notes Note 21
EECS 16A Designing Information Devices and Systems I Fall 2018 Lecture Notes Note 21 21.1 Module Goals In this module, we introduce a family of ideas that are connected to optimization and machine learning,
More informationDetailed objectives are given in each of the sections listed below. 1. Cartesian Space Coordinates. 2. Displacements, Forces, Velocities and Vectors
Unit 1 Vectors In this unit, we introduce vectors, vector operations, and equations of lines and planes. Note: Unit 1 is based on Chapter 12 of the textbook, Salas and Hille s Calculus: Several Variables,
More informationVectors. 1 Basic Definitions. Liming Pang
Vectors Liming Pang 1 Basic Definitions Definition 1. A vector in a line/plane/space is a quantity which has both magnitude and direction. The magnitude is a nonnegative real number and the direction is
More informationBrief Review of Exam Topics
Math 32A Discussion Session Week 3 Notes October 17 and 19, 2017 We ll use this week s discussion session to prepare for the first midterm. We ll start with a quick rundown of the relevant topics, and
More informationIf the pull is downward (Fig. 1), we want C to point into the page. If the pull is upward (Fig. 2), we want C to point out of the page.
11.5 Cross Product Contemporary Calculus 1 11.5 CROSS PRODUCT This section is the final one about the arithmetic of vectors, and it introduces a second type of vector vector multiplication called the cross
More informationInner Product and Orthogonality
Inner Product and Orthogonality P. Sam Johnson October 3, 2014 P. Sam Johnson (NITK) Inner Product and Orthogonality October 3, 2014 1 / 37 Overview In the Euclidean space R 2 and R 3 there are two concepts,
More informationMAT 1339-S14 Class 8
MAT 1339-S14 Class 8 July 28, 2014 Contents 7.2 Review Dot Product........................... 2 7.3 Applications of the Dot Product..................... 4 7.4 Vectors in Three-Space.........................
More informationQuiz 2 Practice Problems
Quiz Practice Problems Practice problems are similar, both in difficulty and in scope, to the type of problems you will see on the quiz. Problems marked with a are for your entertainment and are not essential.
More informationOctober 25, 2013 INNER PRODUCT SPACES
October 25, 2013 INNER PRODUCT SPACES RODICA D. COSTIN Contents 1. Inner product 2 1.1. Inner product 2 1.2. Inner product spaces 4 2. Orthogonal bases 5 2.1. Existence of an orthogonal basis 7 2.2. Orthogonal
More informationy 1 y 2 . = x 1y 1 + x 2 y x + + x n y n y n 2 7 = 1(2) + 3(7) 5(4) = 4.
. Length, Angle, and Orthogonality In this section, we discuss the defintion of length and angle for vectors. We also define what it means for two vectors to be orthogonal. Then we see that linear systems
More information6. Vectors. Given two points, P 0 = (x 0, y 0 ) and P 1 = (x 1, y 1 ), a vector can be drawn with its foot at P 0 and
6. Vectors For purposes of applications in calculus and physics, a vector has both a direction and a magnitude (length), and is usually represented as an arrow. The start of the arrow is the vector s foot,
More informationThe Transpose of a Vector
8 CHAPTER Vectors The Transpose of a Vector We now consider the transpose of a vector in R n, which is a row vector. For a vector u 1 u. u n the transpose is denoted by u T = [ u 1 u u n ] EXAMPLE -5 Find
More informationSolution Set 7, Fall '12
Solution Set 7, 18.06 Fall '12 1. Do Problem 26 from 5.1. (It might take a while but when you see it, it's easy) Solution. Let n 3, and let A be an n n matrix whose i, j entry is i + j. To show that det
More informationVector Geometry. Chapter 5
Chapter 5 Vector Geometry In this chapter we will look more closely at certain geometric aspects of vectors in R n. We will first develop an intuitive understanding of some basic concepts by looking at
More informationInner Product Spaces 5.2 Inner product spaces
Inner Product Spaces 5.2 Inner product spaces November 15 Goals Concept of length, distance, and angle in R 2 or R n is extended to abstract vector spaces V. Sucn a vector space will be called an Inner
More information4.1 Distance and Length
Chapter Vector Geometry In this chapter we will look more closely at certain geometric aspects of vectors in R n. We will first develop an intuitive understanding of some basic concepts by looking at vectors
More informationSystems of Linear Equations
Systems of Linear Equations Math 108A: August 21, 2008 John Douglas Moore Our goal in these notes is to explain a few facts regarding linear systems of equations not included in the first few chapters
More informationVectors for Physics. AP Physics C
Vectors for Physics AP Physics C A Vector is a quantity that has a magnitude (size) AND a direction. can be in one-dimension, two-dimensions, or even three-dimensions can be represented using a magnitude
More informationAnalytic Trigonometry. Copyright Cengage Learning. All rights reserved.
Analytic Trigonometry Copyright Cengage Learning. All rights reserved. 7.1 Trigonometric Identities Copyright Cengage Learning. All rights reserved. Objectives Simplifying Trigonometric Expressions Proving
More informationGive a geometric description of the set of points in space whose coordinates satisfy the given pair of equations.
1. Give a geometric description of the set of points in space whose coordinates satisfy the given pair of equations. x + y = 5, z = 4 Choose the correct description. A. The circle with center (0,0, 4)
More informationVectors and Matrices Statistics with Vectors and Matrices
Vectors and Matrices Statistics with Vectors and Matrices Lecture 3 September 7, 005 Analysis Lecture #3-9/7/005 Slide 1 of 55 Today s Lecture Vectors and Matrices (Supplement A - augmented with SAS proc
More information(, ) : R n R n R. 1. It is bilinear, meaning it s linear in each argument: that is
17 Inner products Up until now, we have only examined the properties of vectors and matrices in R n. But normally, when we think of R n, we re really thinking of n-dimensional Euclidean space - that is,
More informationNotes: Vectors and Scalars
A particle moving along a straight line can move in only two directions and we can specify which directions with a plus or negative sign. For a particle moving in three dimensions; however, a plus sign
More informationVectors and Plane Geometry
Vectors and Plane Geometry Karl Heinz Dovermann Professor of Mathematics University of Hawaii January 7, 0 Preface During the first week of the semester it is difficult to get started with the course
More informationa b 0 a cos u, 0 u 180 :
Section 7.3 The Dot Product of Two Geometric Vectors In hapter 6, the concept of multiplying a vector by a scalar was discussed. In this section, we introduce the dot product of two vectors and deal specifically
More informationCourse Notes Math 275 Boise State University. Shari Ultman
Course Notes Math 275 Boise State University Shari Ultman Fall 2017 Contents 1 Vectors 1 1.1 Introduction to 3-Space & Vectors.............. 3 1.2 Working With Vectors.................... 7 1.3 Introduction
More information12.1 Three Dimensional Coordinate Systems (Review) Equation of a sphere
12.2 Vectors 12.1 Three Dimensional Coordinate Systems (Reiew) Equation of a sphere x a 2 + y b 2 + (z c) 2 = r 2 Center (a,b,c) radius r 12.2 Vectors Quantities like displacement, elocity, and force inole
More informationThe Cross Product The cross product of v = (v 1,v 2,v 3 ) and w = (w 1,w 2,w 3 ) is
The Cross Product 1-1-2018 The cross product of v = (v 1,v 2,v 3 ) and w = (w 1,w 2,w 3 ) is v w = (v 2 w 3 v 3 w 2 )î+(v 3 w 1 v 1 w 3 )ĵ+(v 1 w 2 v 2 w 1 )ˆk = v 1 v 2 v 3 w 1 w 2 w 3. Strictly speaking,
More informationWorksheet 1.4: Geometry of the Dot and Cross Products
Boise State Math 275 (Ultman) Worksheet 1.4: Geometry of the Dot and Cross Products From the Toolbox (what you need from previous classes): Basic algebra and trigonometry: be able to solve quadratic equations,
More informationMidterm 1 Review. Distance = (x 1 x 0 ) 2 + (y 1 y 0 ) 2.
Midterm 1 Review Comments about the midterm The midterm will consist of five questions and will test on material from the first seven lectures the material given below. No calculus either single variable
More informationwhich has a check digit of 9. This is consistent with the first nine digits of the ISBN, since
vector Then the check digit c is computed using the following procedure: 1. Form the dot product. 2. Divide by 11, thereby producing a remainder c that is an integer between 0 and 10, inclusive. The check
More information94 CHAPTER 3. VECTORS AND THE GEOMETRY OF SPACE
94 CHAPTER 3. VECTORS AND THE GEOMETRY OF SPACE 3.3 Dot Product We haven t yet de ned a multiplication between vectors. It turns out there are di erent ways this can be done. In this section, we present
More informationREVIEW - Vectors. Vectors. Vector Algebra. Multiplication by a scalar
J. Peraire Dynamics 16.07 Fall 2004 Version 1.1 REVIEW - Vectors By using vectors and defining appropriate operations between them, physical laws can often be written in a simple form. Since we will making
More informationMATH 221: SOLUTIONS TO SELECTED HOMEWORK PROBLEMS
MATH 221: SOLUTIONS TO SELECTED HOMEWORK PROBLEMS 1. HW 1: Due September 4 1.1.21. Suppose v, w R n and c is a scalar. Prove that Span(v + cw, w) = Span(v, w). We must prove two things: that every element
More informationLinear Algebra Massoud Malek
CSUEB Linear Algebra Massoud Malek Inner Product and Normed Space In all that follows, the n n identity matrix is denoted by I n, the n n zero matrix by Z n, and the zero vector by θ n An inner product
More informationReview of Coordinate Systems
Vector in 2 R and 3 R Review of Coordinate Systems Used to describe the position of a point in space Common coordinate systems are: Cartesian Polar Cartesian Coordinate System Also called rectangular coordinate
More informationInner products. Theorem (basic properties): Given vectors u, v, w in an inner product space V, and a scalar k, the following properties hold:
Inner products Definition: An inner product on a real vector space V is an operation (function) that assigns to each pair of vectors ( u, v) in V a scalar u, v satisfying the following axioms: 1. u, v
More informationMath 32A Discussion Session Week 2 Notes October 10 and 12, 2017
Math 32A Discussion Session Week 2 Notes October 10 and 12, 2017 Since we didn t get a chance to discuss parametrized lines last week, we may spend some time discussing those before moving on to the dot
More informationLINEAR ALGEBRA - CHAPTER 1: VECTORS
LINEAR ALGEBRA - CHAPTER 1: VECTORS A game to introduce Linear Algebra In measurement, there are many quantities whose description entirely rely on magnitude, i.e., length, area, volume, mass and temperature.
More informationMTH 2032 SemesterII
MTH 202 SemesterII 2010-11 Linear Algebra Worked Examples Dr. Tony Yee Department of Mathematics and Information Technology The Hong Kong Institute of Education December 28, 2011 ii Contents Table of Contents
More information45. The Parallelogram Law states that. product of a and b is the vector a b a 2 b 3 a 3 b 2, a 3 b 1 a 1 b 3, a 1 b 2 a 2 b 1. a c. a 1. b 1.
SECTION 10.4 THE CROSS PRODUCT 537 42. Suppose that all sides of a quadrilateral are equal in length and opposite sides are parallel. Use vector methods to show that the diagonals are perpendicular. 43.
More information4.3 - Linear Combinations and Independence of Vectors
- Linear Combinations and Independence of Vectors De nitions, Theorems, and Examples De nition 1 A vector v in a vector space V is called a linear combination of the vectors u 1, u,,u k in V if v can be
More informationMon Apr dot product, length, orthogonality, projection onto the span of a single vector. Announcements: Warm-up Exercise:
Math 2270-004 Week 2 notes We will not necessarily finish the material from a gien day's notes on that day. We may also add or subtract some material as the week progresses, but these notes represent an
More informationChapter 3. The Scalar Product. 3.1 The scalar product using coördinates
Chapter The Scalar Product The scalar product is a way of multiplying two vectors to produce a scalar (real number) Let u and v be nonzero vectors represented by AB and AC C v A θ u B We define the angle
More informationCalculus Vector Principia Mathematica. Lynne Ryan Associate Professor Mathematics Blue Ridge Community College
Calculus Vector Principia Mathematica Lynne Ryan Associate Professor Mathematics Blue Ridge Community College Defining a vector Vectors in the plane A scalar is a quantity that can be represented by a
More informationThe Geometry of R n. Supplemental Lecture Notes for Linear Algebra Courses at Georgia Tech
The Geometry of R n Supplemental Lecture Notes for Linear Algebra Courses at Georgia Tech Contents Vectors in R n. Vectors....................................... The Length and Direction of a Vector......................3
More informationNumbers, proof and all that jazz.
CHAPTER 1 Numbers, proof and all that jazz. There is a fundamental difference between mathematics and other sciences. In most sciences, one does experiments to determine laws. A law will remain a law,
More information1.1 Single Variable Calculus versus Multivariable Calculus Rectangular Coordinate Systems... 4
MATH2202 Notebook 1 Fall 2015/2016 prepared by Professor Jenny Baglivo Contents 1 MATH2202 Notebook 1 3 1.1 Single Variable Calculus versus Multivariable Calculus................... 3 1.2 Rectangular Coordinate
More informationLecture 3: Linear Algebra Review, Part II
Lecture 3: Linear Algebra Review, Part II Brian Borchers January 4, Linear Independence Definition The vectors v, v,..., v n are linearly independent if the system of equations c v + c v +...+ c n v n
More informationFactoring and Algebraic Fractions
Worksheet. Algebraic Fractions Section Factoring and Algebraic Fractions As pointed out in worksheet., we can use factoring to simplify algebraic expressions, and in particular we can use it to simplify
More informationMath 302 Outcome Statements Winter 2013
Math 302 Outcome Statements Winter 2013 1 Rectangular Space Coordinates; Vectors in the Three-Dimensional Space (a) Cartesian coordinates of a point (b) sphere (c) symmetry about a point, a line, and a
More informationThe geometry of least squares
The geometry of least squares We can think of a vector as a point in space, where the elements of the vector are the coordinates of the point. Consider for example, the following vector s: t = ( 4, 0),
More informationInner Product Spaces 6.1 Length and Dot Product in R n
Inner Product Spaces 6.1 Length and Dot Product in R n Summer 2017 Goals We imitate the concept of length and angle between two vectors in R 2, R 3 to define the same in the n space R n. Main topics are:
More information2. FUNCTIONS AND ALGEBRA
2. FUNCTIONS AND ALGEBRA You might think of this chapter as an icebreaker. Functions are the primary participants in the game of calculus, so before we play the game we ought to get to know a few functions.
More informationExercise 1a: Determine the dot product of each of the following pairs of vectors.
Bob Bron, CCBC Dundalk Math 53 Calculus 3, Chapter Section 3 Dot Product (Geometric Definition) Def.: The dot product of to vectors v and n in is given by here θ, satisfying 0, is the angle beteen v and.
More informationx 1 x 2. x 1, x 2,..., x n R. x n
WEEK In general terms, our aim in this first part of the course is to use vector space theory to study the geometry of Euclidean space A good knowledge of the subject matter of the Matrix Applications
More informationCHAPTER 6: ADDITIONAL TOPICS IN TRIG
(Section 6.1: The Law of Sines) 6.01 CHAPTER 6: ADDITIONAL TOPICS IN TRIG SECTION 6.1: THE LAW OF SINES PART A: THE SETUP AND THE LAW The Law of Sines and the Law of Cosines will allow us to analyze and
More information58. The Triangle Inequality for vectors is. dot product.] 59. The Parallelogram Law states that
786 CAPTER 12 VECTORS AND TE GEOETRY OF SPACE 0, 0, 1, and 1, 1, 1 as shown in the figure. Then the centroid is. ( 1 2, 1 2, 1 2 ) ] x z C 54. If c a a, where a,, and c are all nonzero vectors, show that
More informationProperties of Linear Transformations from R n to R m
Properties of Linear Transformations from R n to R m MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 2015 Topic Overview Relationship between the properties of a matrix transformation
More informationCHAPTER 4. APPLICATIONS AND REVIEW IN TRIGONOMETRY
CHAPTER 4. APPLICATIONS AND REVIEW IN TRIGONOMETRY In the present chapter we apply the vector algebra and the basic properties of the dot product described in the last chapter to planar geometry and trigonometry.
More informationReal Analysis III. (MAT312β) Department of Mathematics University of Ruhuna. A.W.L. Pubudu Thilan
Real Analysis III (MAT312β) Department of Mathematics University of Ruhuna A.W.L. Pubudu Thilan Department of Mathematics University of Ruhuna Real Analysis III(MAT312β) 1/87 About course unit Course unit:
More information1111: Linear Algebra I
1111: Linear Algebra I Dr. Vladimir Dotsenko (Vlad) Michaelmas Term 2015 Dr. Vladimir Dotsenko (Vlad) 1111: Linear Algebra I Michaelmas Term 2015 1 / 8 Elementary matrices Let us define elementary matrices.
More informationDefinitions and Properties of R N
Definitions and Properties of R N R N as a set As a set R n is simply the set of all ordered n-tuples (x 1,, x N ), called vectors. We usually denote the vector (x 1,, x N ), (y 1,, y N ), by x, y, or
More informationDistance in the Plane
Distance in the Plane The absolute value function is defined as { x if x 0; and x = x if x < 0. If the number a is positive or zero, then a = a. If a is negative, then a is the number you d get by erasing
More information22A-2 SUMMER 2014 LECTURE Agenda
22A-2 SUMMER 204 LECTURE 2 NATHANIEL GALLUP The Dot Product Continued Matrices Group Work Vectors and Linear Equations Agenda 2 Dot Product Continued Angles between vectors Given two 2-dimensional vectors
More informationRecall: Dot product on R 2 : u v = (u 1, u 2 ) (v 1, v 2 ) = u 1 v 1 + u 2 v 2, u u = u u 2 2 = u 2. Geometric Meaning:
Recall: Dot product on R 2 : u v = (u 1, u 2 ) (v 1, v 2 ) = u 1 v 1 + u 2 v 2, u u = u 2 1 + u 2 2 = u 2. Geometric Meaning: u v = u v cos θ. u θ v 1 Reason: The opposite side is given by u v. u v 2 =
More informationLECTURE 2: CROSS PRODUCTS, MULTILINEARITY, AND AREAS OF PARALLELOGRAMS
LECTURE : CROSS PRODUCTS, MULTILINEARITY, AND AREAS OF PARALLELOGRAMS MA1111: LINEAR ALGEBRA I, MICHAELMAS 016 1. Finishing up dot products Last time we stated the following theorem, for which I owe you
More informationMAC Module 5 Vectors in 2-Space and 3-Space II
MAC 2103 Module 5 Vectors in 2-Space and 3-Space II 1 Learning Objectives Upon completing this module, you should be able to: 1. Determine the cross product of a vector in R 3. 2. Determine a scalar triple
More informationGeneral Physics I, Spring Vectors
General Physics I, Spring 2011 Vectors 1 Vectors: Introduction A vector quantity in physics is one that has a magnitude (absolute value) and a direction. We have seen three already: displacement, velocity,
More informationIntegrated Math II Performance Level Descriptors
Limited Integrated Math II Performance Level Descriptors A student performing at the Limited Level demonstrates a minimal command of Ohio s Learning Standards for Integrated Math II. A student at this
More informationchapter 12 MORE MATRIX ALGEBRA 12.1 Systems of Linear Equations GOALS
chapter MORE MATRIX ALGEBRA GOALS In Chapter we studied matrix operations and the algebra of sets and logic. We also made note of the strong resemblance of matrix algebra to elementary algebra. The reader
More informationDot product and linear least squares problems
Dot product and linear least squares problems Dot Product For vectors u,v R n we define the dot product Note that we can also write this as u v = u,,u n u v = u v + + u n v n v v n = u v + + u n v n The
More informationUnit #17: Spring Trig Unit. A. First Quadrant Notice how the x-values decrease by while the y-values increase by that same amount.
Name Unit #17: Spring Trig Unit Notes #1: Basic Trig Review I. Unit Circle A circle with center point and radius. A. First Quadrant Notice how the x-values decrease by while the y-values increase by that
More informationLecture Note on Linear Algebra 17. Standard Inner Product
Lecture Note on Linear Algebra 17. Standard Inner Product Wei-Shi Zheng, wszheng@ieee.org, 2011 November 21, 2011 1 What Do You Learn from This Note Up to this point, the theory we have established can
More information15. LECTURE 15. I can calculate the dot product of two vectors and interpret its meaning. I can find the projection of one vector onto another one.
5. LECTURE 5 Objectives I can calculate the dot product of two vectors and interpret its meaning. I can find the projection of one vector onto another one. In the last few lectures, we ve learned that
More informationMA201: Further Mathematical Methods (Linear Algebra) 2002
MA201: Further Mathematical Methods (Linear Algebra) 2002 General Information Teaching This course involves two types of teaching session that you should be attending: Lectures This is a half unit course
More informationLinear Algebra I. Ronald van Luijk, 2015
Linear Algebra I Ronald van Luijk, 2015 With many parts from Linear Algebra I by Michael Stoll, 2007 Contents Dependencies among sections 3 Chapter 1. Euclidean space: lines and hyperplanes 5 1.1. Definition
More information1 Matrices and matrix algebra
1 Matrices and matrix algebra 1.1 Examples of matrices A matrix is a rectangular array of numbers and/or variables. For instance 4 2 0 3 1 A = 5 1.2 0.7 x 3 π 3 4 6 27 is a matrix with 3 rows and 5 columns
More informationApplied Linear Algebra in Geoscience Using MATLAB
Applied Linear Algebra in Geoscience Using MATLAB Contents Getting Started Creating Arrays Mathematical Operations with Arrays Using Script Files and Managing Data Two-Dimensional Plots Programming in
More informationCalculus 1 for AE (WI1421LR) Lecture 1: 12.3 The dot product 12.4 The cross product
Calculus 1 for AE (WI1421LR) : 12.3 The dot product 12.4 The cross product About this course Textbook James Stewart, Calculus, Early Transcendentals, 7th edition Course Coordinator Dr. Roelof Koekoek,
More informationExtra Problems for Math 2050 Linear Algebra I
Extra Problems for Math 5 Linear Algebra I Find the vector AB and illustrate with a picture if A = (,) and B = (,4) Find B, given A = (,4) and [ AB = A = (,4) and [ AB = 8 If possible, express x = 7 as
More informationLecture 6 - Introduction to Electricity
Lecture 6 - Introduction to Electricity A Puzzle... We are all familiar with visualizing an integral as the area under a curve. For example, a b f[x] dx equals the sum of the areas of the rectangles of
More informationMAT2342 : Introduction to Applied Linear Algebra Mike Newman, fall Projections. introduction
MAT4 : Introduction to Applied Linear Algebra Mike Newman fall 7 9. Projections introduction One reason to consider projections is to understand approximate solutions to linear systems. A common example
More informationLecture Notes on Metric Spaces
Lecture Notes on Metric Spaces Math 117: Summer 2007 John Douglas Moore Our goal of these notes is to explain a few facts regarding metric spaces not included in the first few chapters of the text [1],
More informationVectors for Beginners
Vectors for Beginners Leo Dorst September 6, 2007 1 Three ways of looking at linear algebra We will always try to look at what we do in linear algebra at three levels: geometric: drawing a picture. This
More informationDistances in R 3. Last time we figured out the (parametric) equation of a line and the (scalar) equation of a plane:
Distances in R 3 Last time we figured out the (parametric) equation of a line and the (scalar) equation of a plane: Definition: The equation of a line through point P(x 0, y 0, z 0 ) with directional vector
More information2. Matrix Algebra and Random Vectors
2. Matrix Algebra and Random Vectors 2.1 Introduction Multivariate data can be conveniently display as array of numbers. In general, a rectangular array of numbers with, for instance, n rows and p columns
More information