The Transpose of a Vector

Similar documents
ORTHOGONALITY AND LEAST-SQUARES [CHAP. 6]

Inner Product Spaces 6.1 Length and Dot Product in R n

INNER PRODUCT SPACE. Definition 1

Mathematics Department Stanford University Math 61CM/DM Inner products

Inner Product Spaces

Linear Algebra Massoud Malek

Applied Linear Algebra in Geoscience Using MATLAB

Quantum Computing Lecture 2. Review of Linear Algebra

v = v 1 2 +v 2 2. Two successive applications of this idea give the length of the vector v R 3 :

Chapter 6. Orthogonality and Least Squares

Linear Algebra. Alvin Lin. August December 2017

October 25, 2013 INNER PRODUCT SPACES

Projection Theorem 1

(, ) : R n R n R. 1. It is bilinear, meaning it s linear in each argument: that is

There are two things that are particularly nice about the first basis

Inner Product Spaces 5.2 Inner product spaces

Vectors in Function Spaces

Polar Form of a Complex Number (I)

y 2 . = x 1y 1 + x 2 y x + + x n y n 2 7 = 1(2) + 3(7) 5(4) = 3. x x = x x x2 n.

Lecture 20: 6.1 Inner Products

Definitions and Properties of R N

(v, w) = arccos( < v, w >

March 27 Math 3260 sec. 56 Spring 2018

Vector Spaces. Commutativity of +: u + v = v + u, u, v, V ; Associativity of +: u + (v + w) = (u + v) + w, u, v, w V ;

Math 290, Midterm II-key

Definition 1. A set V is a vector space over the scalar field F {R, C} iff. there are two operations defined on V, called vector addition

(v, w) = arccos( < v, w >

Notes on Linear Algebra and Matrix Theory

Math 3191 Applied Linear Algebra

Orthogonality and Least Squares

EGR2013 Tutorial 8. Linear Algebra. Powers of a Matrix and Matrix Polynomial

Section 6.1. Inner Product, Length, and Orthogonality

Lecture 23: 6.1 Inner Products

y 1 y 2 . = x 1y 1 + x 2 y x + + x n y n y n 2 7 = 1(2) + 3(7) 5(4) = 4.

Section 3.9. Matrix Norm

Recall: Dot product on R 2 : u v = (u 1, u 2 ) (v 1, v 2 ) = u 1 v 1 + u 2 v 2, u u = u u 2 2 = u 2. Geometric Meaning:

Solutions to assignment 5. x y = x z + z y x z + z y < = 5. x y x z = x (y z) x y z x y + ( z) x ( y + z ) < 2 (3 + 4) = 14,

Announcements Wednesday, November 15

Inner products and Norms. Inner product of 2 vectors. Inner product of 2 vectors x and y in R n : x 1 y 1 + x 2 y x n y n in R n

Untitled September 04, 2007

Inner product spaces. Layers of structure:

Math 2331 Linear Algebra

Normed & Inner Product Vector Spaces

Dot Products. K. Behrend. April 3, Abstract A short review of some basic facts on the dot product. Projections. The spectral theorem.

Designing Information Devices and Systems I Fall 2018 Lecture Notes Note 21

MATH 304 Linear Algebra Lecture 19: Least squares problems (continued). Norms and inner products.

Matrix Operations. Linear Combination Vector Algebra Angle Between Vectors Projections and Reflections Equality of matrices, Augmented Matrix

7.1 Projections and Components

Math 413/513 Chapter 6 (from Friedberg, Insel, & Spence)

Lecture # 3 Orthogonal Matrices and Matrix Norms. We repeat the definition an orthogonal set and orthornormal set.

MATH0328: Numerical Linear Algebra Homework 3 SOLUTIONS

Typical Problem: Compute.

This appendix provides a very basic introduction to linear algebra concepts.

Categories and Quantum Informatics: Hilbert spaces

2. Signal Space Concepts

Basic Concepts in Linear Algebra

Inner products. Theorem (basic properties): Given vectors u, v, w in an inner product space V, and a scalar k, the following properties hold:

ANSWERS (5 points) Let A be a 2 2 matrix such that A =. Compute A. 2

b 1 b 2.. b = b m A = [a 1,a 2,...,a n ] where a 1,j a 2,j a j = a m,j Let A R m n and x 1 x 2 x = x n

(v, w) = arccos( < v, w >

Section 7.5 Inner Product Spaces

1. Vectors.

LAKELAND COMMUNITY COLLEGE COURSE OUTLINE FORM

Vector spaces. DS-GA 1013 / MATH-GA 2824 Optimization-based Data Analysis.

Review of Basic Concepts in Linear Algebra

Mathematical Methods wk 1: Vectors

Mathematical Methods wk 1: Vectors

which has a check digit of 9. This is consistent with the first nine digits of the ISBN, since

Hilbert Spaces. Contents

7 Bilinear forms and inner products

Section 10.7 The Cross Product

Worksheet for Lecture 23 (due December 4) Section 6.1 Inner product, length, and orthogonality

Review of Linear Algebra

Solutions to Selected Questions from Denis Sevee s Vector Geometry. (Updated )

We wish to solve a system of N simultaneous linear algebraic equations for the N unknowns x 1, x 2,...,x N, that are expressed in the general form

Lecture 6: Geometry of OLS Estimation of Linear Regession

Math Linear Algebra II. 1. Inner Products and Norms

Problem Set 1. Homeworks will graded based on content and clarity. Please show your work clearly for full credit.

Riemannian geometry of surfaces

DS-GA 1002 Lecture notes 0 Fall Linear Algebra. These notes provide a review of basic concepts in linear algebra.

Lecture Note on Linear Algebra 17. Standard Inner Product

Solution to Homework 1

Functions of Several Variables

The Four Fundamental Subspaces

Archive of past papers, solutions and homeworks for. MATH 224, Linear Algebra 2, Spring 2013, Laurence Barker

Linear Algebra V = T = ( 4 3 ).

Lecture Notes 1: Vector spaces

MTAEA Vectors in Euclidean Spaces

MTH 2032 SemesterII

The following definition is fundamental.

Cambridge University Press The Mathematics of Signal Processing Steven B. Damelin and Willard Miller Excerpt More information

22A-2 SUMMER 2014 LECTURE Agenda

Inner Product and Orthogonality

j=1 u 1jv 1j. 1/ 2 Lemma 1. An orthogonal set of vectors must be linearly independent.

1. General Vector Spaces

6.1. Inner Product, Length and Orthogonality

1.6 Lecture 2: Conjugation and inequalities

Math 276, Spring 2007 Additional Notes on Vectors

Designing Information Devices and Systems II

12x + 18y = 30? ax + by = m

Transcription:

8 CHAPTER Vectors The Transpose of a Vector We now consider the transpose of a vector in R n, which is a row vector. For a vector u 1 u. u n the transpose is denoted by u T = [ u 1 u u n ] EXAMPLE -5 Find the transpose of the vector v = 1 5 SOLUTION -5 The transpose is found by writing the components of the vector in a row. Therefore we have v T = [ 1 5 ] EXAMPLE -6 Find the transpose of 1 0 1 SOLUTION -6 We write the components of u as a row vector u T = [ 1 0 1 ]

CHAPTER Vectors 85 For vectors in a complex vector space, the situation is slightly more complicated. We call the equivalent vector the conjugate and we need to apply two steps to calculate it: Take the transpose of the vector. Compute the complex conjugate of each component. The conjugate of a vector in a complex vector space is written as u.if you don t recall complex numbers, the complex conjugate is found by letting i i. In this book we denote the complex conjugate operation by *. Therefore the complex conjugate of α is written as α. The best way to learn what to do is to look at a couple of examples. EXAMPLE -7 Let Calculate u. SOLUTION -7 First we take the transpose of the vector i 5 u T = [ i 5 ] Now we take the complex conjugate, letting i i: u = [ i 5 ] = i 5 EXAMPLE -8 Find the conjugate of v = + i 3i 5i SOLUTION -8 We take the transpose to write v as a row vector v T = [ + i 3i 5i ]

86 CHAPTER Vectors Now take the complex conjugate of each component to obtain The Dot or Inner Product v = [ + i 3i 5i ] = [ i 3i + 5i ] We needed to learn how to write column vectors as row vectors for real and complex vector spaces because this makes computing inner products much easier. The inner product is a number and so it is also known as the scalar product. In a real vector space, the scalar product between two vectors u 1 u v 1 v., v =. u n v n is computed in the following way: v 1 v (u, v) = u 1 u u n. = u 1v 1 + u v + +u n v n = v n n u i v i i=1 EXAMPLE -9 Let 1 3, v = 5 6 and compute their dot product. SOLUTION -9 We have (u, v) = [ 1 3 ] 5 = ()() + ( 1)(5) + (3)( 6) 6 = 8 5 18 = 15

CHAPTER Vectors 87 If the inner product of two vectors is zero, we say that the vectors are orthogonal. EXAMPLE -10 Show that 1, v = 5 are orthogonal. SOLUTION -10 The inner product is (u, v) = [ 1 ] 5 = (1)() + ( )(5) + ()() = 10 + 8 = 0 To compute the inner product in a complex vector space, we compute the conjugate of the first vector. We use the notation v 1 v (u, v) = [ u 1 u ] u n. = u 1 v 1 + u v + +u n v n = v n n ui v i i=1 EXAMPLE -11 Find the inner product of i 3, v = 6 5i SOLUTION -11 Taking the conjugate of u, we obtain u = [ i 6 ]

88 CHAPTER Vectors Therefore we have (u, v) = [ i 6 ] 3 = ( i)(3) + (6)(5i) = 6i + 30i = i 5i Note that the inner product is a linear operation, and so In a complex vector space, we have The Norm of a Vector (u + v, w) = (u, w) + (v, w) (u, v + w) = (u, v) + (u, w) (αu, v) = α (u, v) (u, v) = (v, u) (αu, v) = α (u, v) (u,βv) = β (u, v) (u, v) = (v, u) We carry over the notion of length to abstract vector spaces through the norm. The norm is written as u and is defined as the nonnegative square root of the dot product (u, u). More specifically, we have u = (u, u) = u 1 + u + +u n The norm must be a real number to have any meaning as a length. This is why we compute the conjugate of the vector in the first slot of the inner product for a complex vector space. We illustrate this more clearly with an example. EXAMPLE -1 Find the norm of v = i 1 + i

CHAPTER Vectors 89 SOLUTION -1 We first compute the conjugate v = i 1 + i = [ i 1 i ] The inner product is (v, v) = [ i 1 i ] i = ( i)(i) + ()() + (1 i)(1 + i) 1 + i = + 16 + = The norm of the vector is the positive square root of this quantity: Note that v = (v, v) = (u, u) 0 For any vector u, with equality only for the zero vector. A unit vector is a vector that has a norm that is equal to 1. We can construct a unit vector from any vector v by writing ṽ = v v EXAMPLE -13 A vector in a real vector space is w = 1 Unit Vectors Use this vector to construct a unit vector.

90 CHAPTER Vectors SOLUTION -13 The inner product is (w, w) = ()() + ( 1)( 1) = + 1 = 5 The norm of this vector is the positive square root: w = (w, w) = 5 We can construct a unit vector by dividing w by its norm: w w = 1 w = 1 [ 5 ] = 5 5 1 1 5 We call this procedure normalization or say we are normalizing the vector. The Angle between Two Vectors The angle between two vectors u and v is cos θ = (u, v) u v Two Theorems Involving Vectors The Cauchy Schwartz inequality states that (u, v) u v and the triangle inequality says u + v u + v

CHAPTER Vectors 91 Distance between Two Vectors We can carry over a notion of distance between two vectors. This is given by d (u, v) = u v = (u 1 v 1 ) + (u v ) + +(u n v n ) EXAMPLE -1 Find the distance between 1, v = 1 3 SOLUTION -1 The difference between the vectors is u v = 1 1 3 = 1 1 3 = 1 The inner product is (u v, u v) = (1) + ( ) + ( ) = 1 + 16 + = 1 and so the distance function gives d (u, v) = u v = (u v, u v) = 1 1. Construct the sum and difference of the vectors 1 v =, w = 8 Quiz

9 CHAPTER Vectors. Find the scalar multiplication of the vector 1 by k = 3. 3. Using the rules for vector addition and scalar multiplication, write the vector a = 3 in terms of the vectors e 1 = 1 0, e = 0 1, e 3 = 0 0 0 0 1 The vectors e i are called the standard basis of R 3.. Find the inner product of [ i ], v = 1 3 5. Find the norm of the vectors a =, b = 1 i, c = 8i i 6. Normalize the vectors a = 3, 1 1 + i i

CHAPTER Vectors 93 7. Let, v =, w = 1 5 1 1 Find (a) u + v w (b) 3w (c) u + 5v + 7w (d) The norm of each vector (e) Normalize each vector