Orthonormal Bases; Gram-Schmidt Process; QR-Decomposition
|
|
- Collin Ford
- 5 years ago
- Views:
Transcription
1 Orthonormal Bases; Gram-Schmidt Process; QR-Decomposition MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 205
2 Motivation When working with an inner product space, the most convenient bases are those that. consist of orthogonal vectors, and 2. consist of vectors of length.
3 Orthogonal Sets Definition A set of vectors in an inner product space is an orthogonal set if all the vectors are pairwise orthogonal. An orthogonal set in which each vector has norm (length) is called an orthonormal set.
4 Orthogonal Sets Definition A set of vectors in an inner product space is an orthogonal set if all the vectors are pairwise orthogonal. An orthogonal set in which each vector has norm (length) is called an orthonormal set. Example The standard basis {e, e 2,..., e n } is an orthonormal set in R n.
5 Orthogonal Sets Definition A set of vectors in an inner product space is an orthogonal set if all the vectors are pairwise orthogonal. An orthogonal set in which each vector has norm (length) is called an orthonormal set. Example The standard basis {e, e 2,..., e n } is an orthonormal set in R n. Recall: if v V and v 0 then has norm. u = v v
6 Example Create an orthonormal set of vectors from: v = (0,, 0) v 2 = (, 0, ) v 3 = (, 0, )
7 Example Create an orthonormal set of vectors from: v = (0,, 0) v 2 = (, 0, ) v 3 = (, 0, ) u = (0,, 0) u 2 = (/ 2, 0, / 2) u 3 = (/ 2, 0, / 2)
8 Orthogonality and Linear Independence Theorem If S = {v, v 2,..., v n } is an orthogonal set of nonzero vectors in an inner product space, then S is linearly independent.
9 Proof Suppose there are scalars k, k 2,..., k n such that k v + k 2 v k n v n = 0. Scalar k i = 0 since k v + k 2 v k n v n, v i = 0, v i k v, v i + k 2 v 2, v i + + k n v n, v i = 0 k i v i, v i = 0 k i v i 2 = 0 k i = 0 Since this is true for all i we have k = k 2 = = k n = 0.
10 Orthonormal Basis Definition A basis for an inner product space consisting of orthonormal vectors is called an orthonormal basis. A basis for an inner product space consisting of orthogonal vectors is called an orthogonal basis.
11 Orthonormal Basis Definition A basis for an inner product space consisting of orthonormal vectors is called an orthonormal basis. A basis for an inner product space consisting of orthogonal vectors is called an orthogonal basis. Theorem If B = {v, v 2,..., v n } is an orthonormal basis for an inner product space V, and if u V, then u = u, v v + u, v 2 v u, v n v n. Remark: The coordinates of u relative to B are u, v, u, v 2,..., u, v n.
12 Example Let u =, u 2 = 2 3, u 3 = 4 5 Verify that {u, u 2, u 3 } is an orthogonal basis for R 3 and find an orthonormal basis for R 3. Express u = 0 in terms of this orthonormal basis.
13 Solution Since u = 3, u 2 = 4, and u 3 = 42 then v = 3, v 2 = 42 are orthonormal vectors. 2 3, v 3 = u = u, v v + u, v 2 v 2 + u, v 3 v 3 = 2 v v v
14 Coordinates Relative to Orthonormal Bases Theorem If B is an orthonormal basis for an n-dimensional inner product space, and if (u) B = (u, u 2,..., u n ) and (v) B = (v, v 2,..., v n ) then u = u 2 + u2 2 + u2 n d(u, v) = (u v ) 2 + (u 2 v 2 ) (u n v n ) 2 u, v = u v + u 2 v u n v n
15 Coordinates Relative to Orthonormal Bases Theorem If B is an orthonormal basis for an n-dimensional inner product space, and if (u) B = (u, u 2,..., u n ) and (v) B = (v, v 2,..., v n ) then u = u 2 + u2 2 + u2 n d(u, v) = (u v ) 2 + (u 2 v 2 ) (u n v n ) 2 u, v = u v + u 2 v u n v n Remark: computing norms, distances, and inner products with coordinates relative to orthonormal bases is equivalent to computing them in Euclidean coordinates.
16 Coordinates Relative to Orthogonal Bases If B = {v, v 2,..., v n } is merely an orthogonal basis for V then { } v B = v, v 2 v 2,..., v n v n is an orthonormal basis for V. Thus if u V u = u, v v 2 v + u, v 2 v 2 2 v u, v n v n 2 v n.
17 Orthogonal Projections Question: how do you create an orthogonal basis for an arbitrary finite-dimensional inner product space?
18 Orthogonal Projections Question: how do you create an orthogonal basis for an arbitrary finite-dimensional inner product space? Theorem (Projection Theorem) If W is a finite-dimensional subspace of an inner product space V, then every vector u V can expressed uniquely as where w W and w 2 W. u = w + w 2
19 Orthogonal Projections Question: how do you create an orthogonal basis for an arbitrary finite-dimensional inner product space? Theorem (Projection Theorem) If W is a finite-dimensional subspace of an inner product space V, then every vector u V can expressed uniquely as where w W and w 2 W. u = w + w 2 Remark: w is called the orthogonal projection of u on W. w 2 is called the component of u orthogonal to W.
20 Illustration u = w + w 2 = proj W u + proj W u Thus proj W u = u proj W u u = proj W u + (u proj W u) u w 2 u u-proj w u w proj W u
21 Calculating Orthogonal Projections Theorem Suppose W is an finite-dimensional subspace of an inner product space V.. If B = {v, v 2,..., v r } is an orthonormal basis for W and u V then proj W u = u, v v + u, v 2 v u, v r v r. 2. If B = {v, v 2,..., v r } is an orthogonal basis for W and u V then proj W u = u, v v 2 v + u, v 2 v 2 2 v u, v r v r 2 v r.
22 Example B = {v, v 2, v 3 } = 3, 4 2 3, 42 is an orthonormal basis for R 3. Let W = span{v, v 2 }. 4 5 Calculate proj W 0.
23 Solution proj W 0 = (, 0, ), + (, 0, ), = 2 v v = (,, ) v 4 (2,, 3) v 2
24 Gram-Schmidt Process Remark: we know that every nonzero finite-dimensional vector space has a basis. We can develop a stronger statement for inner product spaces.
25 Gram-Schmidt Process Remark: we know that every nonzero finite-dimensional vector space has a basis. We can develop a stronger statement for inner product spaces. Theorem Every nonzero finite-dimensional inner product space has an orthonormal basis.
26 Gram-Schmidt Process Remark: we know that every nonzero finite-dimensional vector space has a basis. We can develop a stronger statement for inner product spaces. Theorem Every nonzero finite-dimensional inner product space has an orthonormal basis. Proof. The proof is an algorithm known as the Gram-Schmidt Process.
27 Gram-Schmidt Algorithm Let S = {v, v 2,..., v n } be a basis for V.
28 Gram-Schmidt Algorithm Let S = {v, v 2,..., v n } be a basis for V. To construct an orthonormal basis for V we perform the following steps.
29 Gram-Schmidt Algorithm Let S = {v, v 2,..., v n } be a basis for V. To construct an orthonormal basis for V we perform the following steps.. Let u = v and define W = span{u }.
30 Gram-Schmidt Algorithm Let S = {v, v 2,..., v n } be a basis for V. To construct an orthonormal basis for V we perform the following steps.. Let u = v and define W = span{u }. 2. Let u 2 = v 2 proj W v 2 = v 2 v 2, u u 2 u and define W 2 = span{u, u 2 }.
31 Gram-Schmidt Algorithm Let S = {v, v 2,..., v n } be a basis for V. To construct an orthonormal basis for V we perform the following steps.. Let u = v and define W = span{u }. 2. Let u 2 = v 2 proj W v 2 = v 2 v 2, u u 2 u and define W 2 = span{u, u 2 }. 3. Let u 3 = v 3 proj W2 v 3 = v 3 v 3, u u 2 u v 3, u 2 u 2 2 u 2 and define W 3 = span{u, u 2, u 3 }.
32 Gram-Schmidt Algorithm Let S = {v, v 2,..., v n } be a basis for V. To construct an orthonormal basis for V we perform the following steps.. Let u = v and define W = span{u }. 2. Let u 2 = v 2 proj W v 2 = v 2 v 2, u u 2 u and define W 2 = span{u, u 2 }. 3. Let u 3 = v 3 proj W2 v 3 = v 3 v 3, u u 2 u v 3, u 2 u 2 2 u 2 and define W 3 = span{u, u 2, u 3 }. 4. Continue in this manner until we have defined B = {u, u 2,..., u n }, an orthogonal basis for V.
33 Gram-Schmidt Algorithm Let S = {v, v 2,..., v n } be a basis for V. To construct an orthonormal basis for V we perform the following steps.. Let u = v and define W = span{u }. 2. Let u 2 = v 2 proj W v 2 = v 2 v 2, u u 2 u and define W 2 = span{u, u 2 }. 3. Let u 3 = v 3 proj W2 v 3 = v 3 v 3, u u 2 u v 3, u 2 u 2 2 u 2 and define W 3 = span{u, u 2, u 3 }. 4. Continue in this manner until we have defined B = {u, u 2,..., u n }, an orthogonal basis for V. { } u 5. B = u, u 2 u 2,..., u n is orthonormal basis for V. u n
34 Example Given 2 2, 4 3 2, 2 find an orthonormal basis for R 3.
35 Solution Step : v = ( (, 2, 2) (, 2, 2) = 3, 2 ) 3, 2 3
36 Solution ( (, 2, 2) Step : v = (, 2, 2) = 3, 2 ) 3, 2 3 Step 2: v 2 = (4, 3, 2) (4, 3, 2), v v 2 v = (4, 3, 2) (4, 3, 2), v v since v is a unit vector. ( 0 v 2 = (4, 3, 2) 2v = 3, 5 3, 0 ) 3 We will replace v 2 with a unit vector in the same direction, so v 2 = (2/3, /3, 2/3).
37 Solution ( (, 2, 2) Step : v = (, 2, 2) = 3, 2 ) 3, 2 3 Step 2: v 2 = (4, 3, 2) (4, 3, 2), v v 2 v = (4, 3, 2) (4, 3, 2), v v since v is a unit vector. ( 0 v 2 = (4, 3, 2) 2v = 3, 5 3, 0 ) 3 We will replace v 2 with a unit vector in the same direction, so v 2 = (2/3, /3, 2/3). Step 3: v 3 = (, 2, ) (, 2, ), v (, 2, ), v 2 (since v and v 2 are unit vectors). ( v 3 = (, 2, ) ()v (2)v 2 = 2 3, 2 3, ) 3 Vector v 3 is already a unit vector.
38 Example Let vector space P 2 have the inner product p, q = p(x)q(x) dx. Given {, x, x 2 } find an orthonormal basis for P 2.
39 Solution ( of 2), = v = 2 () 2 dx = 2
40 Solution ( of 2), = v = 2 u = x v 2 = () 2 dx = 2 x, = x 2 = x 2 2 x x, x = 2 x dx 3 2 x
41 Solution (2 of 2) v = 2 3 v 2 = 2 x u 3 = x 2 x 2, 3 2 x 2, 2 = x (0) 2 x = x x 3 2 x v 3 = x 2 /3 x 2 3, x 2 3 = 5 8 (3x 2 )
42 Extending Orthonormal Sets Recall: earlier we stated a theorem which said that a linearly independent set in a finite-dimensional vector space can be enlarged to a basis by adding appropriate vectors.
43 Extending Orthonormal Sets Recall: earlier we stated a theorem which said that a linearly independent set in a finite-dimensional vector space can be enlarged to a basis by adding appropriate vectors. Theorem If W is a finite-dimensional inner product space, then: Every orthogonal set of nonzero vectors in W can be enlarged to an orthogonal basis for W. Every orthonormal set of nonzero vectors in W can be enlarged to an orthonormal basis for W.
44 QR-Decomposition Remark: the Gram-Schmidt Process can be used to factor certain matrices.
45 QR-Decomposition Remark: the Gram-Schmidt Process can be used to factor certain matrices. Theorem (QR-Decomposition) If A is an m n matrix with linearly independent column vectors, then A can be factored as A = QR where Q is an m n matrix with orthonormal column vectors, and R is an n n invertible upper triangular matrix.
46 QR-Decomposition (continued) Proof. Suppose A = [ u u 2 u n ] and rank(a) = n.
47 QR-Decomposition (continued) Proof. Suppose A = [ u u 2 u n ] and rank(a) = n. Apply the Gram-Schmidt process to {u, u 2,..., u n } to produce the orthonormal basis {q, q 2,..., q n } and define matrix Q = [ q q 2 q n ].
48 QR-Decomposition (continued) Proof. Note that u = u, q q + u, q 2 q u, q n q n u 2 = u 2, q q + u 2, q 2 q u 2, q n q n. u n = u n, q q + u n, q 2 q u n, q n q n
49 QR-Decomposition (continued) Proof. Note that u = u, q q + u, q 2 q u, q n q n u 2 = u 2, q q + u 2, q 2 q u 2, q n q n. u n = u n, q q + u n, q 2 q u n, q n q n Writing this system of equations in matrix form yields u, q u 2, q u n, q u, q 2 u 2, q 2 u n, q 2 A = Q... = QR u, q n u 2, q n u n, q n
50 QR-Decomposition (continued) Proof. By definition i q i = u i u i, q j q j j= i u i = q i + u i, q j q j j= u i span{q, q 2,..., q i }
51 QR-Decomposition (continued) Proof. By definition i q i = u i u i, q j q j j= i u i = q i + u i, q j q j j= u i span{q, q 2,..., q i } Thus for j 2 vector q j is orthogonal to u, u 2,..., u j.
52 QR-Decomposition (continued) Proof. Thus R = u, q u 2, q u n, q 0 u 2, q 2 u n, q u n, q n
53 QR-Decomposition (continued) Proof. Thus R = u, q u 2, q u n, q 0 u 2, q 2 u n, q u n, q n We must still show that u i, q i 0 for i =, 2,..., n in order for R to be nonsingular.
54 QR-Decomposition (continued) Proof. Recall i u i = q i + u i, q j q j u i, q i = j= i q i + u i, q j q j, q i j= i = q i, q i + u i, q j q j, q i }{{} j= =0 = q i 2 0
55 QR-Decomposition (continued) Proof. Thus (finally) R = u, q u 2, q u n, q 0 u 2, q 2 u n, q u n, q n which is invertible.
56 Example Example Find the QR-decomposition of A =
57 Example Example Find the QR-decomposition of A = Hint: an orthonormal basis for the column space of A is 2 2, 2,
58 Proof of Projection Theorem Theorem (Projection Theorem) If W is a finite-dimensional subspace of an inner product space V, then every vector u V can expressed uniquely as where w W and w 2 W. Proof. There are two steps: u = w + w 2
59 Proof of Projection Theorem Theorem (Projection Theorem) If W is a finite-dimensional subspace of an inner product space V, then every vector u V can expressed uniquely as where w W and w 2 W. Proof. There are two steps: u = w + w 2. Find w and w 2 with the stated properties.
60 Proof of Projection Theorem Theorem (Projection Theorem) If W is a finite-dimensional subspace of an inner product space V, then every vector u V can expressed uniquely as where w W and w 2 W. Proof. There are two steps: u = w + w 2. Find w and w 2 with the stated properties. 2. Show that w and w 2 are unique.
61 Homework Read Section 6.3 Exercises:, 3, 7, 9, 5, 9, 27, 29
Section 6.2, 6.3 Orthogonal Sets, Orthogonal Projections
Section 6. 6. Orthogonal Sets Orthogonal Projections Main Ideas in these sections: Orthogonal set = A set of mutually orthogonal vectors. OG LI. Orthogonal Projection of y onto u or onto an OG set {u u
More informationSection 6.4. The Gram Schmidt Process
Section 6.4 The Gram Schmidt Process Motivation The procedures in 6 start with an orthogonal basis {u, u,..., u m}. Find the B-coordinates of a vector x using dot products: x = m i= x u i u i u i u i Find
More informationThe Gram Schmidt Process
u 2 u The Gram Schmidt Process Now we will present a procedure, based on orthogonal projection, that converts any linearly independent set of vectors into an orthogonal set. Let us begin with the simple
More informationThe Gram Schmidt Process
The Gram Schmidt Process Now we will present a procedure, based on orthogonal projection, that converts any linearly independent set of vectors into an orthogonal set. Let us begin with the simple case
More informationWorksheet for Lecture 25 Section 6.4 Gram-Schmidt Process
Worksheet for Lecture Name: Section.4 Gram-Schmidt Process Goal For a subspace W = Span{v,..., v n }, we want to find an orthonormal basis of W. Example Let W = Span{x, x } with x = and x =. Give an orthogonal
More informationMath Linear Algebra
Math 220 - Linear Algebra (Summer 208) Solutions to Homework #7 Exercise 6..20 (a) TRUE. u v v u = 0 is equivalent to u v = v u. The latter identity is true due to the commutative property of the inner
More informationMath 3191 Applied Linear Algebra
Math 9 Applied Linear Algebra Lecture : Orthogonal Projections, Gram-Schmidt Stephen Billups University of Colorado at Denver Math 9Applied Linear Algebra p./ Orthonormal Sets A set of vectors {u, u,...,
More informationLecture 4 Orthonormal vectors and QR factorization
Orthonormal vectors and QR factorization 4 1 Lecture 4 Orthonormal vectors and QR factorization EE263 Autumn 2004 orthonormal vectors Gram-Schmidt procedure, QR factorization orthogonal decomposition induced
More informationMATH 304 Linear Algebra Lecture 20: The Gram-Schmidt process (continued). Eigenvalues and eigenvectors.
MATH 304 Linear Algebra Lecture 20: The Gram-Schmidt process (continued). Eigenvalues and eigenvectors. Orthogonal sets Let V be a vector space with an inner product. Definition. Nonzero vectors v 1,v
More informationLinear Independence. MATH 322, Linear Algebra I. J. Robert Buchanan. Spring Department of Mathematics
Linear Independence MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 2015 Introduction Given a set of vectors {v 1, v 2,..., v r } and another vector v span{v 1, v 2,...,
More information6. Orthogonality and Least-Squares
Linear Algebra 6. Orthogonality and Least-Squares CSIE NCU 1 6. Orthogonality and Least-Squares 6.1 Inner product, length, and orthogonality. 2 6.2 Orthogonal sets... 8 6.3 Orthogonal projections... 13
More informationChapter 6: Orthogonality
Chapter 6: Orthogonality (Last Updated: November 7, 7) These notes are derived primarily from Linear Algebra and its applications by David Lay (4ed). A few theorems have been moved around.. Inner products
More informationRow Space, Column Space, and Nullspace
Row Space, Column Space, and Nullspace MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 2015 Introduction Every matrix has associated with it three vector spaces: row space
More informationMTH 2310, FALL Introduction
MTH 2310, FALL 2011 SECTION 6.2: ORTHOGONAL SETS Homework Problems: 1, 5, 9, 13, 17, 21, 23 1, 27, 29, 35 1. Introduction We have discussed previously the benefits of having a set of vectors that is linearly
More informationMath 416, Spring 2010 Gram-Schmidt, the QR-factorization, Orthogonal Matrices March 4, 2010 GRAM-SCHMIDT, THE QR-FACTORIZATION, ORTHOGONAL MATRICES
Math 46, Spring 00 Gram-Schmidt, the QR-factorization, Orthogonal Matrices March 4, 00 GRAM-SCHMIDT, THE QR-FACTORIZATION, ORTHOGONAL MATRICES Recap Yesterday we talked about several new, important concepts
More informationApplied Linear Algebra in Geoscience Using MATLAB
Applied Linear Algebra in Geoscience Using MATLAB Contents Getting Started Creating Arrays Mathematical Operations with Arrays Using Script Files and Managing Data Two-Dimensional Plots Programming in
More informationMath 3191 Applied Linear Algebra
Math 191 Applied Linear Algebra Lecture 1: Inner Products, Length, Orthogonality Stephen Billups University of Colorado at Denver Math 191Applied Linear Algebra p.1/ Motivation Not all linear systems have
More informationLINEAR ALGEBRA W W L CHEN
LINEAR ALGEBRA W W L CHEN c W W L Chen, 1997, 2008. This chapter is available free to all individuals, on the understanding that it is not to be used for financial gain, and may be downloaded and/or photocopied,
More informationInner products. Theorem (basic properties): Given vectors u, v, w in an inner product space V, and a scalar k, the following properties hold:
Inner products Definition: An inner product on a real vector space V is an operation (function) that assigns to each pair of vectors ( u, v) in V a scalar u, v satisfying the following axioms: 1. u, v
More informationMath 261 Lecture Notes: Sections 6.1, 6.2, 6.3 and 6.4 Orthogonal Sets and Projections
Math 6 Lecture Notes: Sections 6., 6., 6. and 6. Orthogonal Sets and Projections We will not cover general inner product spaces. We will, however, focus on a particular inner product space the inner product
More informationChapter 3 Transformations
Chapter 3 Transformations An Introduction to Optimization Spring, 2014 Wei-Ta Chu 1 Linear Transformations A function is called a linear transformation if 1. for every and 2. for every If we fix the bases
More informationMATH 22A: LINEAR ALGEBRA Chapter 4
MATH 22A: LINEAR ALGEBRA Chapter 4 Jesús De Loera, UC Davis November 30, 2012 Orthogonality and Least Squares Approximation QUESTION: Suppose Ax = b has no solution!! Then what to do? Can we find an Approximate
More informationLecture 10: Vector Algebra: Orthogonal Basis
Lecture 0: Vector Algebra: Orthogonal Basis Orthogonal Basis of a subspace Computing an orthogonal basis for a subspace using Gram-Schmidt Orthogonalization Process Orthogonal Set Any set of vectors that
More informationLinear Algebra Massoud Malek
CSUEB Linear Algebra Massoud Malek Inner Product and Normed Space In all that follows, the n n identity matrix is denoted by I n, the n n zero matrix by Z n, and the zero vector by θ n An inner product
More informationOrthogonal Complements
Orthogonal Complements Definition Let W be a subspace of R n. If a vector z is orthogonal to every vector in W, then z is said to be orthogonal to W. The set of all such vectors z is called the orthogonal
More informationHomework 5. (due Wednesday 8 th Nov midnight)
Homework (due Wednesday 8 th Nov midnight) Use this definition for Column Space of a Matrix Column Space of a matrix A is the set ColA of all linear combinations of the columns of A. In other words, if
More informationMTH 2032 SemesterII
MTH 202 SemesterII 2010-11 Linear Algebra Worked Examples Dr. Tony Yee Department of Mathematics and Information Technology The Hong Kong Institute of Education December 28, 2011 ii Contents Table of Contents
More informationorthogonal relations between vectors and subspaces Then we study some applications in vector spaces and linear systems, including Orthonormal Basis,
5 Orthogonality Goals: We use scalar products to find the length of a vector, the angle between 2 vectors, projections, orthogonal relations between vectors and subspaces Then we study some applications
More informationINNER PRODUCT SPACE. Definition 1
INNER PRODUCT SPACE Definition 1 Suppose u, v and w are all vectors in vector space V and c is any scalar. An inner product space on the vectors space V is a function that associates with each pair of
More informationMATH 240 Spring, Chapter 1: Linear Equations and Matrices
MATH 240 Spring, 2006 Chapter Summaries for Kolman / Hill, Elementary Linear Algebra, 8th Ed. Sections 1.1 1.6, 2.1 2.2, 3.2 3.8, 4.3 4.5, 5.1 5.3, 5.5, 6.1 6.5, 7.1 7.2, 7.4 DEFINITIONS Chapter 1: Linear
More informationEXAM. Exam 1. Math 5316, Fall December 2, 2012
EXAM Exam Math 536, Fall 22 December 2, 22 Write all of your answers on separate sheets of paper. You can keep the exam questions. This is a takehome exam, to be worked individually. You can use your notes.
More informationMath 2331 Linear Algebra
6.2 Orthogonal Sets Math 233 Linear Algebra 6.2 Orthogonal Sets Jiwen He Department of Mathematics, University of Houston jiwenhe@math.uh.edu math.uh.edu/ jiwenhe/math233 Jiwen He, University of Houston
More informationMath Linear Algebra II. 1. Inner Products and Norms
Math 342 - Linear Algebra II Notes 1. Inner Products and Norms One knows from a basic introduction to vectors in R n Math 254 at OSU) that the length of a vector x = x 1 x 2... x n ) T R n, denoted x,
More informationElementary Matrices. MATH 322, Linear Algebra I. J. Robert Buchanan. Spring Department of Mathematics
Elementary Matrices MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 2015 Outline Today s discussion will focus on: elementary matrices and their properties, using elementary
More informationNo books, no notes, no calculators. You must show work, unless the question is a true/false, yes/no, or fill-in-the-blank question.
Math 304 Final Exam (May 8) Spring 206 No books, no notes, no calculators. You must show work, unless the question is a true/false, yes/no, or fill-in-the-blank question. Name: Section: Question Points
More informationMath 224, Fall 2007 Exam 3 Thursday, December 6, 2007
Math 224, Fall 2007 Exam 3 Thursday, December 6, 2007 You have 1 hour and 20 minutes. No notes, books, or other references. You are permitted to use Maple during this exam, but you must start with a blank
More informationMATH 20F: LINEAR ALGEBRA LECTURE B00 (T. KEMP)
MATH 20F: LINEAR ALGEBRA LECTURE B00 (T KEMP) Definition 01 If T (x) = Ax is a linear transformation from R n to R m then Nul (T ) = {x R n : T (x) = 0} = Nul (A) Ran (T ) = {Ax R m : x R n } = {b R m
More informationLinear Models Review
Linear Models Review Vectors in IR n will be written as ordered n-tuples which are understood to be column vectors, or n 1 matrices. A vector variable will be indicted with bold face, and the prime sign
More informationRank and Nullity. MATH 322, Linear Algebra I. J. Robert Buchanan. Spring Department of Mathematics
Rank and Nullity MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 2015 Objectives We have defined and studied the important vector spaces associated with matrices (row space,
More informationVectors. Vectors and the scalar multiplication and vector addition operations:
Vectors Vectors and the scalar multiplication and vector addition operations: x 1 x 1 y 1 2x 1 + 3y 1 x x n 1 = 2 x R n, 2 2 y + 3 2 2x = 2 + 3y 2............ x n x n y n 2x n + 3y n I ll use the two terms
More informationHomework 11 Solutions. Math 110, Fall 2013.
Homework 11 Solutions Math 110, Fall 2013 1 a) Suppose that T were self-adjoint Then, the Spectral Theorem tells us that there would exist an orthonormal basis of P 2 (R), (p 1, p 2, p 3 ), consisting
More informationORTHOGONALITY AND LEAST-SQUARES [CHAP. 6]
ORTHOGONALITY AND LEAST-SQUARES [CHAP. 6] Inner products and Norms Inner product or dot product of 2 vectors u and v in R n : u.v = u 1 v 1 + u 2 v 2 + + u n v n Calculate u.v when u = 1 2 2 0 v = 1 0
More informationDot product and linear least squares problems
Dot product and linear least squares problems Dot Product For vectors u,v R n we define the dot product Note that we can also write this as u v = u,,u n u v = u v + + u n v n v v n = u v + + u n v n The
More informationMATH 23a, FALL 2002 THEORETICAL LINEAR ALGEBRA AND MULTIVARIABLE CALCULUS Solutions to Final Exam (in-class portion) January 22, 2003
MATH 23a, FALL 2002 THEORETICAL LINEAR ALGEBRA AND MULTIVARIABLE CALCULUS Solutions to Final Exam (in-class portion) January 22, 2003 1. True or False (28 points, 2 each) T or F If V is a vector space
More informationLINEAR ALGEBRA 1, 2012-I PARTIAL EXAM 3 SOLUTIONS TO PRACTICE PROBLEMS
LINEAR ALGEBRA, -I PARTIAL EXAM SOLUTIONS TO PRACTICE PROBLEMS Problem (a) For each of the two matrices below, (i) determine whether it is diagonalizable, (ii) determine whether it is orthogonally diagonalizable,
More informationMarch 27 Math 3260 sec. 56 Spring 2018
March 27 Math 3260 sec. 56 Spring 2018 Section 4.6: Rank Definition: The row space, denoted Row A, of an m n matrix A is the subspace of R n spanned by the rows of A. We now have three vector spaces associated
More information2. Review of Linear Algebra
2. Review of Linear Algebra ECE 83, Spring 217 In this course we will represent signals as vectors and operators (e.g., filters, transforms, etc) as matrices. This lecture reviews basic concepts from linear
More informationA Primer in Econometric Theory
A Primer in Econometric Theory Lecture 1: Vector Spaces John Stachurski Lectures by Akshay Shanker May 5, 2017 1/104 Overview Linear algebra is an important foundation for mathematics and, in particular,
More informationMATH 1120 (LINEAR ALGEBRA 1), FINAL EXAM FALL 2011 SOLUTIONS TO PRACTICE VERSION
MATH (LINEAR ALGEBRA ) FINAL EXAM FALL SOLUTIONS TO PRACTICE VERSION Problem (a) For each matrix below (i) find a basis for its column space (ii) find a basis for its row space (iii) determine whether
More informationMath 1180, Notes, 14 1 C. v 1 v n v 2. C A ; w n. A and w = v i w i : v w = i=1
Math 8, 9 Notes, 4 Orthogonality We now start using the dot product a lot. v v = v v n then by Recall that if w w ; w n and w = v w = nx v i w i : Using this denition, we dene the \norm", or length, of
More informationMATH Linear Algebra
MATH 304 - Linear Algebra In the previous note we learned an important algorithm to produce orthogonal sequences of vectors called the Gramm-Schmidt orthogonalization process. Gramm-Schmidt orthogonalization
More informationMAT Linear Algebra Collection of sample exams
MAT 342 - Linear Algebra Collection of sample exams A-x. (0 pts Give the precise definition of the row echelon form. 2. ( 0 pts After performing row reductions on the augmented matrix for a certain system
More informationPractice Exam. 2x 1 + 4x 2 + 2x 3 = 4 x 1 + 2x 2 + 3x 3 = 1 2x 1 + 3x 2 + 4x 3 = 5
Practice Exam. Solve the linear system using an augmented matrix. State whether the solution is unique, there are no solutions or whether there are infinitely many solutions. If the solution is unique,
More informationProperties of Linear Transformations from R n to R m
Properties of Linear Transformations from R n to R m MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 2015 Topic Overview Relationship between the properties of a matrix transformation
More informationMATH 235: Inner Product Spaces, Assignment 7
MATH 235: Inner Product Spaces, Assignment 7 Hand in questions 3,4,5,6,9, by 9:3 am on Wednesday March 26, 28. Contents Orthogonal Basis for Inner Product Space 2 2 Inner-Product Function Space 2 3 Weighted
More informationLecture 03. Math 22 Summer 2017 Section 2 June 26, 2017
Lecture 03 Math 22 Summer 2017 Section 2 June 26, 2017 Just for today (10 minutes) Review row reduction algorithm (40 minutes) 1.3 (15 minutes) Classwork Review row reduction algorithm Review row reduction
More informationMATH 167: APPLIED LINEAR ALGEBRA Least-Squares
MATH 167: APPLIED LINEAR ALGEBRA Least-Squares October 30, 2014 Least Squares We do a series of experiments, collecting data. We wish to see patterns!! We expect the output b to be a linear function of
More information1 0 1, then use that decomposition to solve the least squares problem. 1 Ax = 2. q 1 = a 1 a 1 = 1. to find the intermediate result:
Exercise Find the QR decomposition of A =, then use that decomposition to solve the least squares problem Ax = 2 3 4 Solution Name the columns of A by A = [a a 2 a 3 ] and denote the columns of the results
More informationMath 4377/6308 Advanced Linear Algebra
1.4 Linear Combinations Math 4377/6308 Advanced Linear Algebra 1.4 Linear Combinations & Systems of Linear Equations Jiwen He Department of Mathematics, University of Houston jiwenhe@math.uh.edu math.uh.edu/
More informationApplied Mathematics 205. Unit II: Numerical Linear Algebra. Lecturer: Dr. David Knezevic
Applied Mathematics 205 Unit II: Numerical Linear Algebra Lecturer: Dr. David Knezevic Unit II: Numerical Linear Algebra Chapter II.3: QR Factorization, SVD 2 / 66 QR Factorization 3 / 66 QR Factorization
More informationMath 407: Linear Optimization
Math 407: Linear Optimization Lecture 16: The Linear Least Squares Problem II Math Dept, University of Washington February 28, 2018 Lecture 16: The Linear Least Squares Problem II (Math Dept, University
More informationLinear Algebra. Paul Yiu. Department of Mathematics Florida Atlantic University. Fall A: Inner products
Linear Algebra Paul Yiu Department of Mathematics Florida Atlantic University Fall 2011 6A: Inner products In this chapter, the field F = R or C. We regard F equipped with a conjugation χ : F F. If F =
More informationELE/MCE 503 Linear Algebra Facts Fall 2018
ELE/MCE 503 Linear Algebra Facts Fall 2018 Fact N.1 A set of vectors is linearly independent if and only if none of the vectors in the set can be written as a linear combination of the others. Fact N.2
More informationExercises for Unit I (Topics from linear algebra)
Exercises for Unit I (Topics from linear algebra) I.0 : Background Note. There is no corresponding section in the course notes, but as noted at the beginning of Unit I these are a few exercises which involve
More informationLecture notes: Applied linear algebra Part 1. Version 2
Lecture notes: Applied linear algebra Part 1. Version 2 Michael Karow Berlin University of Technology karow@math.tu-berlin.de October 2, 2008 1 Notation, basic notions and facts 1.1 Subspaces, range and
More informationArchive of past papers, solutions and homeworks for. MATH 224, Linear Algebra 2, Spring 2013, Laurence Barker
Archive of past papers, solutions and homeworks for MATH 224, Linear Algebra 2, Spring 213, Laurence Barker version: 4 June 213 Source file: archfall99.tex page 2: Homeworks. page 3: Quizzes. page 4: Midterm
More informationExercises for Unit I (Topics from linear algebra)
Exercises for Unit I (Topics from linear algebra) I.0 : Background This does not correspond to a section in the course notes, but as noted at the beginning of Unit I it contains some exercises which involve
More informationThe 'linear algebra way' of talking about "angle" and "similarity" between two vectors is called "inner product". We'll define this next.
Orthogonality and QR The 'linear algebra way' of talking about "angle" and "similarity" between two vectors is called "inner product". We'll define this next. So, what is an inner product? An inner product
More informationMAT2342 : Introduction to Applied Linear Algebra Mike Newman, fall Projections. introduction
MAT4 : Introduction to Applied Linear Algebra Mike Newman fall 7 9. Projections introduction One reason to consider projections is to understand approximate solutions to linear systems. A common example
More informationThere are two things that are particularly nice about the first basis
Orthogonality and the Gram-Schmidt Process In Chapter 4, we spent a great deal of time studying the problem of finding a basis for a vector space We know that a basis for a vector space can potentially
More informationCheat Sheet for MATH461
Cheat Sheet for MATH46 Here is the stuff you really need to remember for the exams Linear systems Ax = b Problem: We consider a linear system of m equations for n unknowns x,,x n : For a given matrix A
More informationLINEAR ALGEBRA SUMMARY SHEET.
LINEAR ALGEBRA SUMMARY SHEET RADON ROSBOROUGH https://intuitiveexplanationscom/linear-algebra-summary-sheet/ This document is a concise collection of many of the important theorems of linear algebra, organized
More informationSolution to Homework 8, Math 2568
Solution to Homework 8, Math 568 S 5.4: No. 0. Use property of heorem 5 to test for linear independence in P 3 for the following set of cubic polynomials S = { x 3 x, x x, x, x 3 }. Solution: If we use
More informationMath 290, Midterm II-key
Math 290, Midterm II-key Name (Print): (first) Signature: (last) The following rules apply: There are a total of 20 points on this 50 minutes exam. This contains 7 pages (including this cover page) and
More informationEvaluating Determinants by Row Reduction
Evaluating Determinants by Row Reduction MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 2015 Objectives Reduce a matrix to row echelon form and evaluate its determinant.
More informationLinear Algebra. and
Instructions Please answer the six problems on your own paper. These are essay questions: you should write in complete sentences. 1. Are the two matrices 1 2 2 1 3 5 2 7 and 1 1 1 4 4 2 5 5 2 row equivalent?
More informationMATH 304 Linear Algebra Lecture 34: Review for Test 2.
MATH 304 Linear Algebra Lecture 34: Review for Test 2. Topics for Test 2 Linear transformations (Leon 4.1 4.3) Matrix transformations Matrix of a linear mapping Similar matrices Orthogonality (Leon 5.1
More informationReview of Linear Algebra
Review of Linear Algebra Definitions An m n (read "m by n") matrix, is a rectangular array of entries, where m is the number of rows and n the number of columns. 2 Definitions (Con t) A is square if m=
More informationIMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET
IMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET This is a (not quite comprehensive) list of definitions and theorems given in Math 1553. Pay particular attention to the ones in red. Study Tip For each
More informationMATH 115A: SAMPLE FINAL SOLUTIONS
MATH A: SAMPLE FINAL SOLUTIONS JOE HUGHES. Let V be the set of all functions f : R R such that f( x) = f(x) for all x R. Show that V is a vector space over R under the usual addition and scalar multiplication
More informationAM 205: lecture 8. Last time: Cholesky factorization, QR factorization Today: how to compute the QR factorization, the Singular Value Decomposition
AM 205: lecture 8 Last time: Cholesky factorization, QR factorization Today: how to compute the QR factorization, the Singular Value Decomposition QR Factorization A matrix A R m n, m n, can be factorized
More informationSolutions to Review Problems for Chapter 6 ( ), 7.1
Solutions to Review Problems for Chapter (-, 7 The Final Exam is on Thursday, June,, : AM : AM at NESBITT Final Exam Breakdown Sections % -,7-9,- - % -9,-,7,-,-7 - % -, 7 - % Let u u and v Let x x x x,
More informationAssignment #9: Orthogonal Projections, Gram-Schmidt, and Least Squares. Name:
Assignment 9: Orthogonal Projections, Gram-Schmidt, and Least Squares Due date: Friday, April 0, 08 (:pm) Name: Section Number Assignment 9: Orthogonal Projections, Gram-Schmidt, and Least Squares Due
More informationMath 2331 Linear Algebra
6. Orthogonal Projections Math 2 Linear Algebra 6. Orthogonal Projections Jiwen He Department of Mathematics, University of Houston jiwenhe@math.uh.edu math.uh.edu/ jiwenhe/math2 Jiwen He, University of
More informationLeast-Squares Systems and The QR factorization
Least-Squares Systems and The QR factorization Orthogonality Least-squares systems. The Gram-Schmidt and Modified Gram-Schmidt processes. The Householder QR and the Givens QR. Orthogonality The Gram-Schmidt
More informationTypical Problem: Compute.
Math 2040 Chapter 6 Orhtogonality and Least Squares 6.1 and some of 6.7: Inner Product, Length and Orthogonality. Definition: If x, y R n, then x y = x 1 y 1 +... + x n y n is the dot product of x and
More informationChapter 4 Euclid Space
Chapter 4 Euclid Space Inner Product Spaces Definition.. Let V be a real vector space over IR. A real inner product on V is a real valued function on V V, denoted by (, ), which satisfies () (x, y) = (y,
More information5.) For each of the given sets of vectors, determine whether or not the set spans R 3. Give reasons for your answers.
Linear Algebra - Test File - Spring Test # For problems - consider the following system of equations. x + y - z = x + y + 4z = x + y + 6z =.) Solve the system without using your calculator..) Find the
More informationMatrix decompositions
Matrix decompositions Zdeněk Dvořák May 19, 2015 Lemma 1 (Schur decomposition). If A is a symmetric real matrix, then there exists an orthogonal matrix Q and a diagonal matrix D such that A = QDQ T. The
More informationMath Real Analysis II
Math 4 - Real Analysis II Solutions to Homework due May Recall that a function f is called even if f( x) = f(x) and called odd if f( x) = f(x) for all x. We saw that these classes of functions had a particularly
More informationDiagonalization. MATH 322, Linear Algebra I. J. Robert Buchanan. Spring Department of Mathematics
Diagonalization MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 2015 Motivation Today we consider two fundamental questions: Given an n n matrix A, does there exist a basis
More informationReview problems for MA 54, Fall 2004.
Review problems for MA 54, Fall 2004. Below are the review problems for the final. They are mostly homework problems, or very similar. If you are comfortable doing these problems, you should be fine on
More informationChapter 7: Symmetric Matrices and Quadratic Forms
Chapter 7: Symmetric Matrices and Quadratic Forms (Last Updated: December, 06) These notes are derived primarily from Linear Algebra and its applications by David Lay (4ed). A few theorems have been moved
More informationMathematics Department Stanford University Math 61CM/DM Inner products
Mathematics Department Stanford University Math 61CM/DM Inner products Recall the definition of an inner product space; see Appendix A.8 of the textbook. Definition 1 An inner product space V is a vector
More informationMATH 260 LINEAR ALGEBRA EXAM III Fall 2014
MAH 60 LINEAR ALGEBRA EXAM III Fall 0 Instructions: the use of built-in functions of your calculator such as det( ) or RREF is permitted ) Consider the table and the vectors and matrices given below Fill
More informationThe value of a problem is not so much coming up with the answer as in the ideas and attempted ideas it forces on the would be solver I.N.
Math 410 Homework Problems In the following pages you will find all of the homework problems for the semester. Homework should be written out neatly and stapled and turned in at the beginning of class
More informationIMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET
IMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET This is a (not quite comprehensive) list of definitions and theorems given in Math 1553. Pay particular attention to the ones in red. Study Tip For each
More informationThe Gram-Schmidt Process 1
The Gram-Schmidt Process In this section all vector spaces will be subspaces of some R m. Definition.. Let S = {v...v n } R m. The set S is said to be orthogonal if v v j = whenever i j. If in addition
More information1. General Vector Spaces
1.1. Vector space axioms. 1. General Vector Spaces Definition 1.1. Let V be a nonempty set of objects on which the operations of addition and scalar multiplication are defined. By addition we mean a rule
More informationMATH 425-Spring 2010 HOMEWORK ASSIGNMENTS
MATH 425-Spring 2010 HOMEWORK ASSIGNMENTS Instructor: Shmuel Friedland Department of Mathematics, Statistics and Computer Science email: friedlan@uic.edu Last update April 18, 2010 1 HOMEWORK ASSIGNMENT
More information