Mathematical Methods wk 1: Vectors
|
|
- Eleanore Carpenter
- 5 years ago
- Views:
Transcription
1 Mathematical Methods wk : Vectors John Magorrian, magog@thphysoxacuk These are work-in-progress notes for the second-year course on mathematical methods The most up-to-date version is available from Linear vector spaces A linear vector space (or just vector space for short) consists of a set V of vectors (the elements of which we ll usually denote by a, b,, a, b, or a, b, ); a set F of scalars (scalars denoted by α, β, a, b,), a rule for adding two vectors to produce another vector, a rule for multiplying vectors by scalars, that together satisfy conditions The four most interesting conditions are the following (i) The set V of vectors is closed under addition, ie, (ii) V is also closed under multiplication by scalars, ie, (iii) V contains a special zero vector, V, for which a + b V for all a, b V; () α a V for all a V and α F (2) a + = a for all a V; (3) (iv) Every vector has an additive inverse: for all a V there is some a V for which a + a = (4) The other six conditions are more technical The addition operator must be commutative and associative: a + b = b + a, (5) ( a + b ) + c = a + ( b + c ) (6) The multiplication-by-scalar operation must be distributive with respect to vector and scalar addition, consistent with the operation of multiplying two scalars and must satisfy the multiplicative identity: α( a + b ) = α a + α b (7) (α + β) a = α a + β a (8) α(β a ) = (αβ) a (9) a = a () For our purposes the set F will usually be either the set R of all real numbers (in which case we have a real vector space) or the set C of all complex numbers (giving a complex vector space)
2 Mathematical Methods wk : Vectors I 2 Basic ideas In a raw vector space there is no notion of the length of a vector or the angle between two vectors Nevertheless, there are many important ideas that follow by applying the basic rules ( ) above to linear combinations of vectors, ie, weighted sums such as α v + α 2 v 2 + () A set of vectors { v,, v n } is said to be linearly independent (abbreviated LI) if the only solution to the equation α v + α 2 v 2 + α n v n = (2) is if all scalar coefficients α i = Otherwise the set is linearly dependent The dimension of a vector space is the maximum number of LI vectors in the space The span of a list of vectors v,, v m is the set of all possible linear combinations {α v + +α m v m : α,, α m F} A list e, e 2, e n of vectors forms a basis for the space V if the elements of the list are LI and span V Then any a V can be expressed as a = a i e i, (3) and the coefficients (a,, a n ) for which (3) holds are known as the components or coordinates of a with respect to the basis vectors e i Claim: Given a basis e,, e n the coordinates a i of a are unique Proof: suppose that there is another set of coordinates a i Then we can express a in two ways: a = a e + e a n e n = a e + a 2 e a n e n (4) Subtracting, = (a a ) e + ( a 2) e (a n a n) e n (5) But the e i are LI Therefore the only way of satisfying the equation is if all a i a i = So a i = a i: the coordinates are unique A subset W V is a subspace of V if it satisfies conditions ( 4) That is: it must be closed under addition of vectors and multiplication by scalars; it must contain the zero vector; the additive inverse of each element must be included Conditions (5 ) are automatically satisfied because they depend only on the definition of the addition and multiplication operations 2 Examples Example: Three-dimensional column vectors with real coefficients The set of column vectors (x, x 2, x 3 ) T with x i R forms a real vector space under the usual rules of vector addition and multiplication by scalars This space is usually known as R 3 To confirm that this really is a vector space, let s check the conditions ( ) The usual rules of vector algebra satisfy conditions (5 ) For the conditions ( 4) note that: (i) For any a, b b 2 R 3, the sum a + b b 2 a + b + b 2 R 3 a 3 b 3 a 3 b 3 a 3 + b 3 (ii) Multiplying any vector a by a real scalar α gives α a αa α R 3 a 3 a 3 αa 3
3 I 3 Mathematical Methods wk : Vectors (iii) There is a zero element, (,, ) T R 3 (iv) Each vector a has an additive inverse a R 3 a 3 a 3 So, all conditions ( ) are satisfied Here are two possible bases for this space:,, or π,, 2 (6) 6 Each of these basis sets has three LI elements that span R 3 Therefore the dimension of R 3 is 3 Exercise: The set of all 3-dimensional column vectors with real coefficients cannot form a complex vector space Why not? (Which of the conditions is broken?) Example: R n and C n Similarly, the set of all n-dimensional column vectors with real (complex) elements forms a real (complex) vector space under the usual rules of vector addition and multiplication by scalars Example: Arrows on a plane The set of all arrows on a plane with the obvious definitions of addition of arrows and multiplication by scalars forms a real two-dimensional vector space There is an natural, invertible mapping between elements elements x R 2 and arrows for which α x +α 2 x 2 maps to α arrow + α 2 arrow 2 whenever x maps to arrow and x 2 maps to arrow 2 An invertible mapping between two vector spaces that preserves the operations of addition and multiplication is known as a isomorphism Example: Perverse arrows in the plane Let us introduce a new vector space of arrows in the plane that uses the same definition of vector addition as in the previous example, but in which multiplication by a complex scalar α is defined by increasing the length of the vector by a factor α and rotating it anticlockwise by an angle arg α Any arrow in the plane can be represented as Our new multiplication rule is that r, θ = ( ) r cos φ (7) r sin φ α r, θ α r, θ + arg α (8) which is another member of V for all choices of α, r, θ The addition operation is unchanged so this new definition satisfies the first four conditions ( 4) Let s check the more technical conditions: α(β r, φ ) = α β r, φ + arg β = α β r, φ + arg β + arg α = β α r, φ + arg α + arg β = β α r, φ + arg α = β(α r, φ ) Therefore our new multiplication rule satisfies condition (5) (9) Exercise: Show that all of the conditions (5 ) are satisfied What is the dimension of this space? Find another vector space to which it is isomorphic Example: The set of all m n matrices with complex coefficients forms a complex vector space with dimension mn The most natural basis is,,,,, (2)
4 Mathematical Methods wk : Vectors I 4 Example: n th -order polynomials The set of all n th -order polynomials in a complex variable z forms an n + dimensional complex vector space A natural basis is the set of monomials {, z, z 2,, z n } Example: Trigonometric polynomials Given n distinct (mod 2π) complex constants λ,, λ n, the set of all linear combinations of e iλnz forms an n-dimensional complex vector space Example: Functions for which the integral The set L 2 (a, b) of all complex-valued functions f : [a, b] C (2) b a dx f(x) 2 (22) exists forms a complex vector space under the usual operations of addition of functions and multiplication of functions by scalars This space has an infinite number of dimensions We postpone the issue of identifying a suitable basis until 4 later 3 Linear maps A mapping A : V W from one vector space V to another W is a linear map if it satisfies A ( v + v 2 ) = A v + A v 2, A ( α v ) = αa v, (23) for all v, v 2 V and scalars α F A linear operator is the special case of a linear map from a vector space V to itself Now let n be the dimension of V and m the dimension of W Choose any basis e,, e n for V and another, e,, e m, for W Any vector v V can be expressed as v = n a j e j Using the properties (23) we have that the image of v under the linear map A is A v = ( a j A ej ) (24) j= As this holds for any v V, we see that the map A is completely determined by the images A e,, A e n of V s basis vectors Each of these images A e i is a vector that lives in W and so can be expressed in terms of the basis e,, e m as m A e j = A ij e i, (25) where A ij is the i th component in the e,, e m basis of the vector A e j Substituting this into (24), m A v = A ij a j e i (26) j= That is, a vector in V with components a,, a n maps under A to another vector in W whose i th component is given by n j= A ija j The values of the coefficients A ij depend on the choice of basis for V and W
5 I 5 Mathematical Methods wk : Vectors 4 Representation of vectors and linear maps by matrices Given a basis e,, e n for an n-dimensional vector space let us represent Then any vector v can be expressed as e =, e 2 =,, e n = (27) v = a e + e a n e n = a a n (28) Given two vector spaces, V with dimension n and W with dimension m, then any linear map A from V to W can be represented as the matrix with A A 2 A n A A v = 2 A 22 A 2n A m A m2 A mn A A 2 A n A A = 2 A 22 A 2n, (29) A m A m2 A mn a a n = being given by the familiar rules of matrix multiplication A a + A A n a n A 2 a + A A 2n a n A m a + A m2 + + A mn a n (3) Linear operators (that is, linear maps of a vector space to itself) are represented by square n n matrices Further reading Linear vector spaces are introduced in RHB 8 and linear maps in RHB 82 DK II is another good starting point Most maths-for-physicists books introduce inner products (see 2 below) at the same time as vector spaces Nevertheless, pausing to work out the consequences of the unadorned conditions ( ) is an supremely useful introduction to mathematical reasoning: many of the statements that we take as self-evident from our experience in manipulating vectors and matrices are not easy to prove without some practice For more on this see, eg, Linear Algebra by Lang or similar books for mathematicians
6 2 Inner-product spaces Mathematical Methods wk : Vectors I 6 The conditions ( ) do not allow us to say whether two vectors are orthogonal, or even what the length of a vector is To do these, we need to introduce some additional structure on the space, namely the idea of an inner product This is a straightforward generalization of the familiar scalar product In the following I use bra-ket notation a b for the inner product of the vectors a and b An inner product is a mapping V V F that takes two vectors and returns a scalar and satisfies the following conditions for all a, b, c V and α F: c d = c a + c b if d = a + b ; (2) c d = α c a if d = α a ; (22) a b = b a ; (23) a a =, only if a =, >, otherwise (24) Notice that the inner product is linear in the second argument, but not necessarily in the first An inner-product space is simply a vector space V on which an inner product a b has been defined Some definitions: The inner product of a vector with itself, a a, is real and non-negative The length or norm of the vector a is a a a The vectors a and b are orthogonal if a b = A set of vectors { v i } of V is orthonormal if v i v j = δ ij The condition (23) is essential if we want lengths of vectors to be real numbers, but a consequence is that in general the inner product is not linear in both arguments Exercise: Use the properties (2 24) above to show that d c = α a c + β b c (25) for d = α a + β b Some books use the term sesquilinear to describe this property Under what conditions is the scalar product linear in both arguments? Exercise: Show that if a v = for all v V then a = Exercise: Show that any n orthonormal vectors in an n-dimensional inner-product space form a basis The converse is not true: see 24 below 2 Orthonormal bases Let V be an n-dimensional inner-product space in which the vectors { e i } form an orthonormal basis so that e i e j = δ ij and let a = a i e i, and b = b i e i (26) be any two vectors in V Using properties (2) and (22) of the inner product together with the orthonormality of the basis vectors, we have that the projection of a onto the j th basis vector e j a = a i e j e i = a i δ ji = a j (27)
7 I 7 Mathematical Methods wk : Vectors and similarly e j b = b j Therefore the inner product of a and b is a b = b i a e i = b i e i a = a i b i (28) This can be written in matrix form as b a b = ( a a n ) = a b, (29) where a is the Hermitian conjugate of the column vector a b n 22 Duals: bras and kets There is another way of looking at the inner product that serves as a useful reminder of its sesquilinearity and helps motivate the unfamiliar a b notation Consider the set V of all linear maps from ket vectors v V to scalars F Applying any L V to an element v = α e + + α n e n of V, we have, by the linearity of L, that ( n ) L v = L α i e i = α i L e i (2) So, given a basis { e,, e n } for V, any L V is completely defined by the n scalar values L e,,l e n We can turn V into a vector space Given L, L 2 V, define their sum (L + L 2 ) as the new mapping (L + L 2 ) v L v + L 2 v (2) and the result of multiplying L V by a scalar α as the mapping (αl) defined through (αl) v α L v (22) It is easy to confirm that the set V with these operations satisfies the conditions ( ) Inhabitants of the vector space V are called bras and are more conventionally written a, b etc instead of the L, L 2 notation used above V has the same dimension as V and is known as the dual space (or adjoint space) of V For every ket there is a corresponding dual (or adjoint) bra and vice versa The addition and mutliplication rules (2) and (22) above mean that if kets a, b have dual bras a, b respectively, then the ket v = α a + β b has dual v = α a + β b (23) Given basis kets e,, e n V we may introduce corresponding basis bras e,, e n V with each e i defined through e i ( e j ) = δ ij (24) Then given a = a i e i and b = b i e i, the dual to a is a = n a i e i and we may define ( n a b ( a ) ( b ) = a i e i ) b j e j = j= j= a i b j e i e j = j= a i b j δ ij = a i b i, (25)
8 Mathematical Methods wk : Vectors I 8 in agreement with equation (29) from the previous section It is easy to confirm that this alternative definition of a b as the result of operating on the ket vector b by the bra vector a V satisfies the conditions (2 24) for an inner product 23 Representation of bras and kets Here is a brief summary of the results in the last two sections If we have an orthonormal basis in which we represent kets by column vectors ( 4), v = α e + α 2 e α n e n = α + α α n = then the bra dual to v is represented by the Hermitian conjugate of this column vector: α α 2 α n, (26) v =α e + α 2 e α n e n =α ( ) + α 2 ( ) + + α n ( ) = ( α α 2 α n ) (27) The inner product a b of the vectors a = (a,, a n ) T and b = (b,, b n ) T is obtained by premultiplying b by the dual vector to a under the usual rules of matrix multiplication: b a b a b = ( a a 2 a n ) 2 b b n = n a i b i (28) 24 Gram Schmidt procedure for constructing an orthonormal basis In an n-dimensional inner-product space any list of n LI vectors v, v n is a basis, but in general this basis is not orthonormal There is a simple procedure for constructing an orthonormal basis from the list () Start with the first vector from the list, v The first basis vector e is defined via e = v e = e / e (29) (2) Take the next vector v 2 Subtract any component that is parallel to the previously constructed basis vector e Normalise the result to get e 2 e 2 = v 2 e v 2 e e 2 = e 2 / e 2 (22) (i) Similarly, work along the remaining v i, i = 3,, n, subtracting from each one any component that is parallel to any of the previously constructed basis vectors e,, e i That is, i e i = v i e j v i e j j= e i = e i / e i (22)
9 I 9 Mathematical Methods wk : Vectors It is easy to see that applying any e k with k < i to both sides of (22) yields e k e i = : by construction each new e i is orthogonal to all the preceding ones The same procedure can be used to construct an orthonormal basis for the space spanned by a list of vectors v,, v m of any length, including cases where the list is not LI: if v i is linearly dependent on the preceding v,, v i then e i = and so that particular v i does not produce a new basis vector Example: Example Consider the list v = (, i, i, ) T, v 2 = (, 2, 2, ) T, v 3 = (,,, ) T and v 4 = (2,,, ) T From v we immediately have that The corresponding basis bra is the row vector e = 2 (, i, i, ) T (222) e = 2 (, i, i, ) (223) The inner product e v 2 = 2 2i, so e 2 = v 2 ( 2 2i) e = (,,, ) T = e 2 (224) For v 3 the necessary inner products are e v 3 = 2i and e 2 v 3 = Then e 3 = v 3 ( 2i) e e 2 = (,,, ) T = e 3 (225) Finally, notice that e 4 = because v 4 = 2 e 3 2i e Therefore the four vectors v,, v 4 span a three-dimensional subspace of the original four-dimensional space The kets e, e 2 and e 3 constructed above are one possible orthonormal basis for this subspace 25 Some important relations Recall that a 2 a a Pythagoras if a b = then a + b 2 = a 2 + b 2 (226) Parallelogram law Triange inequality a + b 2 + a b 2 = 2 a 2 + b 2 (227) a + b a + b (228) Cauchy Schwarz inequality a b 2 a a b b (229) Proof of (229): Let d = a + c b, where c is a scalar whose value we choose later Then d = a + c b By the properties of the inner product, d d = a a + c b a + c a b + c 2 b b (23) Now choose c = b a / b b Then c = a b / b b and (23) becomes which on rearrangement gives the required result a a a b 2 / b b, (23)
10 Mathematical Methods wk : Vectors I Further reading Much of the material in this section is covered in 8 of RHB and II of DK For another introduction to the concept of dual vectors see 3 of Shankar s Principles of Quantum Mechanics (The first chapter of Shankar gives a succinct summary of the first half of this course) Beware in that most books written for mathematicians the inner product a, b is defined to be linear in the first argument
Mathematical Methods wk 1: Vectors
Mathematical Methods wk : Vectors John Magorrian, magog@thphysoxacuk These are work-in-progress notes for the second-year course on mathematical methods The most up-to-date version is available from http://www-thphysphysicsoxacuk/people/johnmagorrian/mm
More informationMathematics Department Stanford University Math 61CM/DM Inner products
Mathematics Department Stanford University Math 61CM/DM Inner products Recall the definition of an inner product space; see Appendix A.8 of the textbook. Definition 1 An inner product space V is a vector
More informationINNER PRODUCT SPACE. Definition 1
INNER PRODUCT SPACE Definition 1 Suppose u, v and w are all vectors in vector space V and c is any scalar. An inner product space on the vectors space V is a function that associates with each pair of
More informationQuantum Computing Lecture 2. Review of Linear Algebra
Quantum Computing Lecture 2 Review of Linear Algebra Maris Ozols Linear algebra States of a quantum system form a vector space and their transformations are described by linear operators Vector spaces
More informationLinear Algebra Massoud Malek
CSUEB Linear Algebra Massoud Malek Inner Product and Normed Space In all that follows, the n n identity matrix is denoted by I n, the n n zero matrix by Z n, and the zero vector by θ n An inner product
More informationHilbert Spaces. Hilbert space is a vector space with some extra structure. We start with formal (axiomatic) definition of a vector space.
Hilbert Spaces Hilbert space is a vector space with some extra structure. We start with formal (axiomatic) definition of a vector space. Vector Space. Vector space, ν, over the field of complex numbers,
More informationThe following definition is fundamental.
1. Some Basics from Linear Algebra With these notes, I will try and clarify certain topics that I only quickly mention in class. First and foremost, I will assume that you are familiar with many basic
More informationOctober 25, 2013 INNER PRODUCT SPACES
October 25, 2013 INNER PRODUCT SPACES RODICA D. COSTIN Contents 1. Inner product 2 1.1. Inner product 2 1.2. Inner product spaces 4 2. Orthogonal bases 5 2.1. Existence of an orthogonal basis 7 2.2. Orthogonal
More informationLinear Algebra and Dirac Notation, Pt. 1
Linear Algebra and Dirac Notation, Pt. 1 PHYS 500 - Southern Illinois University February 1, 2017 PHYS 500 - Southern Illinois University Linear Algebra and Dirac Notation, Pt. 1 February 1, 2017 1 / 13
More informationLinear Algebra. Min Yan
Linear Algebra Min Yan January 2, 2018 2 Contents 1 Vector Space 7 1.1 Definition................................. 7 1.1.1 Axioms of Vector Space..................... 7 1.1.2 Consequence of Axiom......................
More informationMathematical Methods wk 2: Linear Operators
John Magorrian, magog@thphysoxacuk These are work-in-progress notes for the second-year course on mathematical methods The most up-to-date version is available from http://www-thphysphysicsoxacuk/people/johnmagorrian/mm
More informationVector Spaces. Vector space, ν, over the field of complex numbers, C, is a set of elements a, b,..., satisfying the following axioms.
Vector Spaces Vector space, ν, over the field of complex numbers, C, is a set of elements a, b,..., satisfying the following axioms. For each two vectors a, b ν there exists a summation procedure: a +
More information1. General Vector Spaces
1.1. Vector space axioms. 1. General Vector Spaces Definition 1.1. Let V be a nonempty set of objects on which the operations of addition and scalar multiplication are defined. By addition we mean a rule
More informationElementary linear algebra
Chapter 1 Elementary linear algebra 1.1 Vector spaces Vector spaces owe their importance to the fact that so many models arising in the solutions of specific problems turn out to be vector spaces. The
More informationInner products. Theorem (basic properties): Given vectors u, v, w in an inner product space V, and a scalar k, the following properties hold:
Inner products Definition: An inner product on a real vector space V is an operation (function) that assigns to each pair of vectors ( u, v) in V a scalar u, v satisfying the following axioms: 1. u, v
More informationVector Spaces for Quantum Mechanics J. P. Leahy January 30, 2012
PHYS 20602 Handout 1 Vector Spaces for Quantum Mechanics J. P. Leahy January 30, 2012 Handout Contents Examples Classes Examples for Lectures 1 to 4 (with hints at end) Definitions of groups and vector
More informationVectors in Function Spaces
Jim Lambers MAT 66 Spring Semester 15-16 Lecture 18 Notes These notes correspond to Section 6.3 in the text. Vectors in Function Spaces We begin with some necessary terminology. A vector space V, also
More informationDS-GA 1002 Lecture notes 0 Fall Linear Algebra. These notes provide a review of basic concepts in linear algebra.
DS-GA 1002 Lecture notes 0 Fall 2016 Linear Algebra These notes provide a review of basic concepts in linear algebra. 1 Vector spaces You are no doubt familiar with vectors in R 2 or R 3, i.e. [ ] 1.1
More informationLecture Notes 1: Vector spaces
Optimization-based data analysis Fall 2017 Lecture Notes 1: Vector spaces In this chapter we review certain basic concepts of linear algebra, highlighting their application to signal processing. 1 Vector
More informationFourier and Wavelet Signal Processing
Ecole Polytechnique Federale de Lausanne (EPFL) Audio-Visual Communications Laboratory (LCAV) Fourier and Wavelet Signal Processing Martin Vetterli Amina Chebira, Ali Hormati Spring 2011 2/25/2011 1 Outline
More informationMath 350 Fall 2011 Notes about inner product spaces. In this notes we state and prove some important properties of inner product spaces.
Math 350 Fall 2011 Notes about inner product spaces In this notes we state and prove some important properties of inner product spaces. First, recall the dot product on R n : if x, y R n, say x = (x 1,...,
More information1 Dirac Notation for Vector Spaces
Theoretical Physics Notes 2: Dirac Notation This installment of the notes covers Dirac notation, which proves to be very useful in many ways. For example, it gives a convenient way of expressing amplitudes
More informationThere are two things that are particularly nice about the first basis
Orthogonality and the Gram-Schmidt Process In Chapter 4, we spent a great deal of time studying the problem of finding a basis for a vector space We know that a basis for a vector space can potentially
More informationApplied Linear Algebra in Geoscience Using MATLAB
Applied Linear Algebra in Geoscience Using MATLAB Contents Getting Started Creating Arrays Mathematical Operations with Arrays Using Script Files and Managing Data Two-Dimensional Plots Programming in
More informationFunctional Analysis Exercise Class
Functional Analysis Exercise Class Week: December 4 8 Deadline to hand in the homework: your exercise class on week January 5. Exercises with solutions ) Let H, K be Hilbert spaces, and A : H K be a linear
More informationMath Linear Algebra II. 1. Inner Products and Norms
Math 342 - Linear Algebra II Notes 1. Inner Products and Norms One knows from a basic introduction to vectors in R n Math 254 at OSU) that the length of a vector x = x 1 x 2... x n ) T R n, denoted x,
More informationMathematical Foundations of Quantum Mechanics
Mathematical Foundations of Quantum Mechanics 2016-17 Dr Judith A. McGovern Maths of Vector Spaces This section is designed to be read in conjunction with chapter 1 of Shankar s Principles of Quantum Mechanics,
More informationLinear Algebra Notes. Lecture Notes, University of Toronto, Fall 2016
Linear Algebra Notes Lecture Notes, University of Toronto, Fall 2016 (Ctd ) 11 Isomorphisms 1 Linear maps Definition 11 An invertible linear map T : V W is called a linear isomorphism from V to W Etymology:
More informationRecall: Dot product on R 2 : u v = (u 1, u 2 ) (v 1, v 2 ) = u 1 v 1 + u 2 v 2, u u = u u 2 2 = u 2. Geometric Meaning:
Recall: Dot product on R 2 : u v = (u 1, u 2 ) (v 1, v 2 ) = u 1 v 1 + u 2 v 2, u u = u 2 1 + u 2 2 = u 2. Geometric Meaning: u v = u v cos θ. u θ v 1 Reason: The opposite side is given by u v. u v 2 =
More informationDefinition 1. A set V is a vector space over the scalar field F {R, C} iff. there are two operations defined on V, called vector addition
6 Vector Spaces with Inned Product Basis and Dimension Section Objective(s): Vector Spaces and Subspaces Linear (In)dependence Basis and Dimension Inner Product 6 Vector Spaces and Subspaces Definition
More informationCategories and Quantum Informatics: Hilbert spaces
Categories and Quantum Informatics: Hilbert spaces Chris Heunen Spring 2018 We introduce our main example category Hilb by recalling in some detail the mathematical formalism that underlies quantum theory:
More informationLecture 3: Hilbert spaces, tensor products
CS903: Quantum computation and Information theory (Special Topics In TCS) Lecture 3: Hilbert spaces, tensor products This lecture will formalize many of the notions introduced informally in the second
More informationMATH 235. Final ANSWERS May 5, 2015
MATH 235 Final ANSWERS May 5, 25. ( points) Fix positive integers m, n and consider the vector space V of all m n matrices with entries in the real numbers R. (a) Find the dimension of V and prove your
More informationOrthonormal Bases; Gram-Schmidt Process; QR-Decomposition
Orthonormal Bases; Gram-Schmidt Process; QR-Decomposition MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 205 Motivation When working with an inner product space, the most
More informationMATH 240 Spring, Chapter 1: Linear Equations and Matrices
MATH 240 Spring, 2006 Chapter Summaries for Kolman / Hill, Elementary Linear Algebra, 8th Ed. Sections 1.1 1.6, 2.1 2.2, 3.2 3.8, 4.3 4.5, 5.1 5.3, 5.5, 6.1 6.5, 7.1 7.2, 7.4 DEFINITIONS Chapter 1: Linear
More informationInner product spaces. Layers of structure:
Inner product spaces Layers of structure: vector space normed linear space inner product space The abstract definition of an inner product, which we will see very shortly, is simple (and by itself is pretty
More informationLINEAR ALGEBRA W W L CHEN
LINEAR ALGEBRA W W L CHEN c W W L Chen, 1997, 2008. This chapter is available free to all individuals, on the understanding that it is not to be used for financial gain, and may be downloaded and/or photocopied,
More information(K + L)(c x) = K(c x) + L(c x) (def of K + L) = K( x) + K( y) + L( x) + L( y) (K, L are linear) = (K L)( x) + (K L)( y).
Exercise 71 We have L( x) = x 1 L( v 1 ) + x 2 L( v 2 ) + + x n L( v n ) n = x i (a 1i w 1 + a 2i w 2 + + a mi w m ) i=1 ( n ) ( n ) ( n ) = x i a 1i w 1 + x i a 2i w 2 + + x i a mi w m i=1 Therefore y
More informationTune-Up Lecture Notes Linear Algebra I
Tune-Up Lecture Notes Linear Algebra I One usually first encounters a vector depicted as a directed line segment in Euclidean space, or what amounts to the same thing, as an ordered n-tuple of numbers
More informationA Brief Introduction to Functional Analysis
A Brief Introduction to Functional Analysis Sungwook Lee Department of Mathematics University of Southern Mississippi sunglee@usm.edu July 5, 2007 Definition 1. An algebra A is a vector space over C with
More informationDefinitions for Quizzes
Definitions for Quizzes Italicized text (or something close to it) will be given to you. Plain text is (an example of) what you should write as a definition. [Bracketed text will not be given, nor does
More informationSUMMARY OF MATH 1600
SUMMARY OF MATH 1600 Note: The following list is intended as a study guide for the final exam. It is a continuation of the study guide for the midterm. It does not claim to be a comprehensive list. You
More informationCambridge University Press The Mathematics of Signal Processing Steven B. Damelin and Willard Miller Excerpt More information
Introduction Consider a linear system y = Φx where Φ can be taken as an m n matrix acting on Euclidean space or more generally, a linear operator on a Hilbert space. We call the vector x a signal or input,
More informationLINEAR ALGEBRA REVIEW
LINEAR ALGEBRA REVIEW JC Stuff you should know for the exam. 1. Basics on vector spaces (1) F n is the set of all n-tuples (a 1,... a n ) with a i F. It forms a VS with the operations of + and scalar multiplication
More informationChapter 2 Linear Transformations
Chapter 2 Linear Transformations Linear Transformations Loosely speaking, a linear transformation is a function from one vector space to another that preserves the vector space operations. Let us be more
More informationCHAPTER VIII HILBERT SPACES
CHAPTER VIII HILBERT SPACES DEFINITION Let X and Y be two complex vector spaces. A map T : X Y is called a conjugate-linear transformation if it is a reallinear transformation from X into Y, and if T (λx)
More informationVector spaces. DS-GA 1013 / MATH-GA 2824 Optimization-based Data Analysis.
Vector spaces DS-GA 1013 / MATH-GA 2824 Optimization-based Data Analysis http://www.cims.nyu.edu/~cfgranda/pages/obda_fall17/index.html Carlos Fernandez-Granda Vector space Consists of: A set V A scalar
More informationLinear Algebra II. 7 Inner product spaces. Notes 7 16th December Inner products and orthonormal bases
MTH6140 Linear Algebra II Notes 7 16th December 2010 7 Inner product spaces Ordinary Euclidean space is a 3-dimensional vector space over R, but it is more than that: the extra geometric structure (lengths,
More informationPage 52. Lecture 3: Inner Product Spaces Dual Spaces, Dirac Notation, and Adjoints Date Revised: 2008/10/03 Date Given: 2008/10/03
Page 5 Lecture : Inner Product Spaces Dual Spaces, Dirac Notation, and Adjoints Date Revised: 008/10/0 Date Given: 008/10/0 Inner Product Spaces: Definitions Section. Mathematical Preliminaries: Inner
More informationMath Linear Algebra
Math 220 - Linear Algebra (Summer 208) Solutions to Homework #7 Exercise 6..20 (a) TRUE. u v v u = 0 is equivalent to u v = v u. The latter identity is true due to the commutative property of the inner
More informationFinite-dimensional spaces. C n is the space of n-tuples x = (x 1,..., x n ) of complex numbers. It is a Hilbert space with the inner product
Chapter 4 Hilbert Spaces 4.1 Inner Product Spaces Inner Product Space. A complex vector space E is called an inner product space (or a pre-hilbert space, or a unitary space) if there is a mapping (, )
More informationFunctional Analysis HW #5
Functional Analysis HW #5 Sangchul Lee October 29, 2015 Contents 1 Solutions........................................ 1 1 Solutions Exercise 3.4. Show that C([0, 1]) is not a Hilbert space, that is, there
More information4 Hilbert spaces. The proof of the Hilbert basis theorem is not mathematics, it is theology. Camille Jordan
The proof of the Hilbert basis theorem is not mathematics, it is theology. Camille Jordan Wir müssen wissen, wir werden wissen. David Hilbert We now continue to study a special class of Banach spaces,
More informationIr O D = D = ( ) Section 2.6 Example 1. (Bottom of page 119) dim(v ) = dim(l(v, W )) = dim(v ) dim(f ) = dim(v )
Section 3.2 Theorem 3.6. Let A be an m n matrix of rank r. Then r m, r n, and, by means of a finite number of elementary row and column operations, A can be transformed into the matrix ( ) Ir O D = 1 O
More informationSupplementary information I Hilbert Space, Dirac Notation, and Matrix Mechanics. EE270 Fall 2017
Supplementary information I Hilbert Space, Dirac Notation, and Matrix Mechanics Properties of Vector Spaces Unit vectors ~xi form a basis which spans the space and which are orthonormal ( if i = j ~xi
More informationChapter III. Quantum Computation. Mathematical preliminaries. A.1 Complex numbers. A.2 Linear algebra review
Chapter III Quantum Computation These lecture notes are exclusively for the use of students in Prof. MacLennan s Unconventional Computation course. c 2017, B. J. MacLennan, EECS, University of Tennessee,
More informationBindel, Fall 2016 Matrix Computations (CS 6210) Notes for
1 Logistics Notes for 2016-08-29 General announcement: we are switching from weekly to bi-weekly homeworks (mostly because the course is much bigger than planned). If you want to do HW but are not formally
More informationI teach myself... Hilbert spaces
I teach myself... Hilbert spaces by F.J.Sayas, for MATH 806 November 4, 2015 This document will be growing with the semester. Every in red is for you to justify. Even if we start with the basic definition
More informationNumerical Linear Algebra
University of Alabama at Birmingham Department of Mathematics Numerical Linear Algebra Lecture Notes for MA 660 (1997 2014) Dr Nikolai Chernov April 2014 Chapter 0 Review of Linear Algebra 0.1 Matrices
More informationChapter 2. Linear Algebra. rather simple and learning them will eventually allow us to explain the strange results of
Chapter 2 Linear Algebra In this chapter, we study the formal structure that provides the background for quantum mechanics. The basic ideas of the mathematical machinery, linear algebra, are rather simple
More information1 Vectors. Notes for Bindel, Spring 2017 Numerical Analysis (CS 4220)
Notes for 2017-01-30 Most of mathematics is best learned by doing. Linear algebra is no exception. You have had a previous class in which you learned the basics of linear algebra, and you will have plenty
More informationECS130 Scientific Computing. Lecture 1: Introduction. Monday, January 7, 10:00 10:50 am
ECS130 Scientific Computing Lecture 1: Introduction Monday, January 7, 10:00 10:50 am About Course: ECS130 Scientific Computing Professor: Zhaojun Bai Webpage: http://web.cs.ucdavis.edu/~bai/ecs130/ Today
More informationInner Product and Orthogonality
Inner Product and Orthogonality P. Sam Johnson October 3, 2014 P. Sam Johnson (NITK) Inner Product and Orthogonality October 3, 2014 1 / 37 Overview In the Euclidean space R 2 and R 3 there are two concepts,
More informationTypical Problem: Compute.
Math 2040 Chapter 6 Orhtogonality and Least Squares 6.1 and some of 6.7: Inner Product, Length and Orthogonality. Definition: If x, y R n, then x y = x 1 y 1 +... + x n y n is the dot product of x and
More informationMATH 20F: LINEAR ALGEBRA LECTURE B00 (T. KEMP)
MATH 20F: LINEAR ALGEBRA LECTURE B00 (T KEMP) Definition 01 If T (x) = Ax is a linear transformation from R n to R m then Nul (T ) = {x R n : T (x) = 0} = Nul (A) Ran (T ) = {Ax R m : x R n } = {b R m
More information1. Foundations of Numerics from Advanced Mathematics. Linear Algebra
Foundations of Numerics from Advanced Mathematics Linear Algebra Linear Algebra, October 23, 22 Linear Algebra Mathematical Structures a mathematical structure consists of one or several sets and one or
More information2. Review of Linear Algebra
2. Review of Linear Algebra ECE 83, Spring 217 In this course we will represent signals as vectors and operators (e.g., filters, transforms, etc) as matrices. This lecture reviews basic concepts from linear
More informationWOMP 2001: LINEAR ALGEBRA. 1. Vector spaces
WOMP 2001: LINEAR ALGEBRA DAN GROSSMAN Reference Roman, S Advanced Linear Algebra, GTM #135 (Not very good) Let k be a field, eg, R, Q, C, F q, K(t), 1 Vector spaces Definition A vector space over k is
More informationMath 413/513 Chapter 6 (from Friedberg, Insel, & Spence)
Math 413/513 Chapter 6 (from Friedberg, Insel, & Spence) David Glickenstein December 7, 2015 1 Inner product spaces In this chapter, we will only consider the elds R and C. De nition 1 Let V be a vector
More informationInner Product Spaces
Inner Product Spaces Introduction Recall in the lecture on vector spaces that geometric vectors (i.e. vectors in two and three-dimensional Cartesian space have the properties of addition, subtraction,
More informationMATH 1120 (LINEAR ALGEBRA 1), FINAL EXAM FALL 2011 SOLUTIONS TO PRACTICE VERSION
MATH (LINEAR ALGEBRA ) FINAL EXAM FALL SOLUTIONS TO PRACTICE VERSION Problem (a) For each matrix below (i) find a basis for its column space (ii) find a basis for its row space (iii) determine whether
More informationChapter 6: Orthogonality
Chapter 6: Orthogonality (Last Updated: November 7, 7) These notes are derived primarily from Linear Algebra and its applications by David Lay (4ed). A few theorems have been moved around.. Inner products
More informationLecture 3: Review of Linear Algebra
ECE 83 Fall 2 Statistical Signal Processing instructor: R Nowak Lecture 3: Review of Linear Algebra Very often in this course we will represent signals as vectors and operators (eg, filters, transforms,
More informationwhich arises when we compute the orthogonal projection of a vector y in a subspace with an orthogonal basis. Hence assume that P y = A ij = x j, x i
MODULE 6 Topics: Gram-Schmidt orthogonalization process We begin by observing that if the vectors {x j } N are mutually orthogonal in an inner product space V then they are necessarily linearly independent.
More informationAlgebra II. Paulius Drungilas and Jonas Jankauskas
Algebra II Paulius Drungilas and Jonas Jankauskas Contents 1. Quadratic forms 3 What is quadratic form? 3 Change of variables. 3 Equivalence of quadratic forms. 4 Canonical form. 4 Normal form. 7 Positive
More informationSection 7.5 Inner Product Spaces
Section 7.5 Inner Product Spaces With the dot product defined in Chapter 6, we were able to study the following properties of vectors in R n. ) Length or norm of a vector u. ( u = p u u ) 2) Distance of
More informationChapter 1 Vector Spaces
Chapter 1 Vector Spaces Per-Olof Persson persson@berkeley.edu Department of Mathematics University of California, Berkeley Math 110 Linear Algebra Vector Spaces Definition A vector space V over a field
More informationPart 1a: Inner product, Orthogonality, Vector/Matrix norm
Part 1a: Inner product, Orthogonality, Vector/Matrix norm September 19, 2018 Numerical Linear Algebra Part 1a September 19, 2018 1 / 16 1. Inner product on a linear space V over the number field F A map,
More informationLecture 3: Review of Linear Algebra
ECE 83 Fall 2 Statistical Signal Processing instructor: R Nowak, scribe: R Nowak Lecture 3: Review of Linear Algebra Very often in this course we will represent signals as vectors and operators (eg, filters,
More information1 Mathematical preliminaries
1 Mathematical preliminaries The mathematical language of quantum mechanics is that of vector spaces and linear algebra. In this preliminary section, we will collect the various definitions and mathematical
More informationMATH 235: Inner Product Spaces, Assignment 7
MATH 235: Inner Product Spaces, Assignment 7 Hand in questions 3,4,5,6,9, by 9:3 am on Wednesday March 26, 28. Contents Orthogonal Basis for Inner Product Space 2 2 Inner-Product Function Space 2 3 Weighted
More informationMATH 220: INNER PRODUCT SPACES, SYMMETRIC OPERATORS, ORTHOGONALITY
MATH 22: INNER PRODUCT SPACES, SYMMETRIC OPERATORS, ORTHOGONALITY When discussing separation of variables, we noted that at the last step we need to express the inhomogeneous initial or boundary data as
More informationMath 593: Problem Set 10
Math 593: Problem Set Feng Zhu, edited by Prof Smith Hermitian inner-product spaces (a By conjugate-symmetry and linearity in the first argument, f(v, λw = f(λw, v = λf(w, v = λf(w, v = λf(v, w. (b We
More informationChem 3502/4502 Physical Chemistry II (Quantum Mechanics) 3 Credits Fall Semester 2006 Christopher J. Cramer. Lecture 5, January 27, 2006
Chem 3502/4502 Physical Chemistry II (Quantum Mechanics) 3 Credits Fall Semester 2006 Christopher J. Cramer Lecture 5, January 27, 2006 Solved Homework (Homework for grading is also due today) We are told
More information1 The Dirac notation for vectors in Quantum Mechanics
This module aims at developing the mathematical foundation of Quantum Mechanics, starting from linear vector space and covering topics such as inner product space, Hilbert space, operators in Quantum Mechanics
More informationDot Products. K. Behrend. April 3, Abstract A short review of some basic facts on the dot product. Projections. The spectral theorem.
Dot Products K. Behrend April 3, 008 Abstract A short review of some basic facts on the dot product. Projections. The spectral theorem. Contents The dot product 3. Length of a vector........................
More information5 Compact linear operators
5 Compact linear operators One of the most important results of Linear Algebra is that for every selfadjoint linear map A on a finite-dimensional space, there exists a basis consisting of eigenvectors.
More informationReview of linear algebra
Review of linear algebra 1 Vectors and matrices We will just touch very briefly on certain aspects of linear algebra, most of which should be familiar. Recall that we deal with vectors, i.e. elements of
More informationLinear Algebra 2 Spectral Notes
Linear Algebra 2 Spectral Notes In what follows, V is an inner product vector space over F, where F = R or C. We will use results seen so far; in particular that every linear operator T L(V ) has a complex
More informationII. The Machinery of Quantum Mechanics
II. The Machinery of Quantum Mechanics Based on the results of the experiments described in the previous section, we recognize that real experiments do not behave quite as we expect. This section presents
More informationLecture notes on Quantum Computing. Chapter 1 Mathematical Background
Lecture notes on Quantum Computing Chapter 1 Mathematical Background Vector states of a quantum system with n physical states are represented by unique vectors in C n, the set of n 1 column vectors 1 For
More informationMATH Linear Algebra
MATH 304 - Linear Algebra In the previous note we learned an important algorithm to produce orthogonal sequences of vectors called the Gramm-Schmidt orthogonalization process. Gramm-Schmidt orthogonalization
More informationChapter 2. Vectors and Vector Spaces
2.2. Cartesian Coordinates and Geometrical Properties of Vectors 1 Chapter 2. Vectors and Vector Spaces Section 2.2. Cartesian Coordinates and Geometrical Properties of Vectors Note. There is a natural
More informationLinear Algebra Review
Chapter 1 Linear Algebra Review It is assumed that you have had a course in linear algebra, and are familiar with matrix multiplication, eigenvectors, etc. I will review some of these terms here, but quite
More informationv = v 1 2 +v 2 2. Two successive applications of this idea give the length of the vector v R 3 :
Length, Angle and the Inner Product The length (or norm) of a vector v R 2 (viewed as connecting the origin to a point (v 1,v 2 )) is easily determined by the Pythagorean Theorem and is denoted v : v =
More informationNORMS ON SPACE OF MATRICES
NORMS ON SPACE OF MATRICES. Operator Norms on Space of linear maps Let A be an n n real matrix and x 0 be a vector in R n. We would like to use the Picard iteration method to solve for the following system
More informationSupplementary Notes on Linear Algebra
Supplementary Notes on Linear Algebra Mariusz Wodzicki May 3, 2015 1 Vector spaces 1.1 Coordinatization of a vector space 1.1.1 Given a basis B = {b 1,..., b n } in a vector space V, any vector v V can
More informationMATH 304 Linear Algebra Lecture 20: The Gram-Schmidt process (continued). Eigenvalues and eigenvectors.
MATH 304 Linear Algebra Lecture 20: The Gram-Schmidt process (continued). Eigenvalues and eigenvectors. Orthogonal sets Let V be a vector space with an inner product. Definition. Nonzero vectors v 1,v
More informationMAT Linear Algebra Collection of sample exams
MAT 342 - Linear Algebra Collection of sample exams A-x. (0 pts Give the precise definition of the row echelon form. 2. ( 0 pts After performing row reductions on the augmented matrix for a certain system
More informationMATH 583A REVIEW SESSION #1
MATH 583A REVIEW SESSION #1 BOJAN DURICKOVIC 1. Vector Spaces Very quick review of the basic linear algebra concepts (see any linear algebra textbook): (finite dimensional) vector space (or linear space),
More information