Quizzes for Math 304

Similar documents
2. Every linear system with the same number of equations as unknowns has a unique solution.

Glossary of Linear Algebra Terms. Prepared by Vince Zaccone For Campus Learning Assistance Services at UCSB

MATH 240 Spring, Chapter 1: Linear Equations and Matrices

1. Let m 1 and n 1 be two natural numbers such that m > n. Which of the following is/are true?

(a) II and III (b) I (c) I and III (d) I and II and III (e) None are true.

Math 4A Notes. Written by Victoria Kala Last updated June 11, 2017

MATH 20F: LINEAR ALGEBRA LECTURE B00 (T. KEMP)

IMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET

Math Final December 2006 C. Robinson

What is on this week. 1 Vector spaces (continued) 1.1 Null space and Column Space of a matrix

MATH 304 Linear Algebra Lecture 34: Review for Test 2.

MATH 31 - ADDITIONAL PRACTICE PROBLEMS FOR FINAL

MATH 1120 (LINEAR ALGEBRA 1), FINAL EXAM FALL 2011 SOLUTIONS TO PRACTICE VERSION

(b) If a multiple of one row of A is added to another row to produce B then det(b) =det(a).

IMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET

DIAGONALIZATION. In order to see the implications of this definition, let us consider the following example Example 1. Consider the matrix

MAT Linear Algebra Collection of sample exams

1. What is the determinant of the following matrix? a 1 a 2 4a 3 2a 2 b 1 b 2 4b 3 2b c 1. = 4, then det

Math 314/ Exam 2 Blue Exam Solutions December 4, 2008 Instructor: Dr. S. Cooper. Name:

Chapter 3. Directions: For questions 1-11 mark each statement True or False. Justify each answer.

Math 18, Linear Algebra, Lecture C00, Spring 2017 Review and Practice Problems for Final Exam

Math 314H EXAM I. 1. (28 points) The row reduced echelon form of the augmented matrix for the system. is the matrix

Problem 1: Solving a linear equation

MATH Linear Algebra

Solutions to Final Exam

Solving a system by back-substitution, checking consistency of a system (no rows of the form

Solutions to Exam I MATH 304, section 6

W2 ) = dim(w 1 )+ dim(w 2 ) for any two finite dimensional subspaces W 1, W 2 of V.

Definitions for Quizzes

No books, no notes, no calculators. You must show work, unless the question is a true/false, yes/no, or fill-in-the-blank question.

Math 20F Final Exam(ver. c)

LINEAR ALGEBRA SUMMARY SHEET.

235 Final exam review questions

Chapters 5 & 6: Theory Review: Solutions Math 308 F Spring 2015

is Use at most six elementary row operations. (Partial

Solutions to practice questions for the final

PRACTICE PROBLEMS FOR THE FINAL

MA 265 FINAL EXAM Fall 2012

Math Computation Test 1 September 26 th, 2016 Debate: Computation vs. Theory Whatever wins, it ll be Huuuge!

Linear Algebra. and

1 Last time: least-squares problems

Math 369 Exam #2 Practice Problem Solutions

Section 2.2: The Inverse of a Matrix

PRACTICE FINAL EXAM. why. If they are dependent, exhibit a linear dependence relation among them.

MATH 115A: SAMPLE FINAL SOLUTIONS

Linear Algebra Final Exam Study Guide Solutions Fall 2012

Recall : Eigenvalues and Eigenvectors

Math 1553, Introduction to Linear Algebra

LINEAR ALGEBRA 1, 2012-I PARTIAL EXAM 3 SOLUTIONS TO PRACTICE PROBLEMS

Warm-up. True or false? Baby proof. 2. The system of normal equations for A x = y has solutions iff A x = y has solutions

Spring 2014 Math 272 Final Exam Review Sheet

The value of a problem is not so much coming up with the answer as in the ideas and attempted ideas it forces on the would be solver I.N.

MATH 304 Linear Algebra Lecture 23: Diagonalization. Review for Test 2.

MATH 2360 REVIEW PROBLEMS

MATH 152 Exam 1-Solutions 135 pts. Write your answers on separate paper. You do not need to copy the questions. Show your work!!!

Math 217 Midterm 1. Winter Solutions. Question Points Score Total: 100

1. In this problem, if the statement is always true, circle T; otherwise, circle F.

Elementary Linear Algebra Review for Exam 2 Exam is Monday, November 16th.

MATH 1553 PRACTICE FINAL EXAMINATION

Reduction to the associated homogeneous system via a particular solution

Assignment 1 Math 5341 Linear Algebra Review. Give complete answers to each of the following questions. Show all of your work.

BASIC ALGORITHMS IN LINEAR ALGEBRA. Matrices and Applications of Gaussian Elimination. A 2 x. A T m x. A 1 x A T 1. A m x

YORK UNIVERSITY. Faculty of Science Department of Mathematics and Statistics MATH M Test #1. July 11, 2013 Solutions

LINEAR ALGEBRA QUESTION BANK

spring, math 204 (mitchell) list of theorems 1 Linear Systems Linear Transformations Matrix Algebra

5.) For each of the given sets of vectors, determine whether or not the set spans R 3. Give reasons for your answers.

Linear Algebra problems

Linear Algebra- Final Exam Review

Sample Final Exam: Solutions

Linear Algebra 1 Exam 1 Solutions 6/12/3

Study Guide for Linear Algebra Exam 2

(i) [7 points] Compute the determinant of the following matrix using cofactor expansion.

Math 415 Exam I. Name: Student ID: Calculators, books and notes are not allowed!

homogeneous 71 hyperplane 10 hyperplane 34 hyperplane 69 identity map 171 identity map 186 identity map 206 identity matrix 110 identity matrix 45

Math 205, Summer I, Week 4b:

Online Exercises for Linear Algebra XM511

Practice Final Exam. Solutions.

MATH 1553 SAMPLE FINAL EXAM, SPRING 2018

Solutions to Final Practice Problems Written by Victoria Kala Last updated 12/5/2015

MATH 235. Final ANSWERS May 5, 2015

LINEAR ALGEBRA REVIEW

ft-uiowa-math2550 Assignment OptionalFinalExamReviewMultChoiceMEDIUMlengthForm due 12/31/2014 at 10:36pm CST

ANSWERS. E k E 2 E 1 A = B

1. Let A = (a) 2 (b) 3 (c) 0 (d) 4 (e) 1

MATH 221, Spring Homework 10 Solutions

Linear Algebra Math 221

Summer Session Practice Final Exam

NATIONAL UNIVERSITY OF SINGAPORE MA1101R

Announcements Monday, October 29

Linear Algebra Practice Problems

Practice Final Exam Solutions

Columbus State Community College Mathematics Department Public Syllabus

DEPARTMENT OF MATHEMATICS

Final Examination 201-NYC-05 December and b =

MATH 304 Linear Algebra Lecture 20: The Gram-Schmidt process (continued). Eigenvalues and eigenvectors.

Practice problems for Exam 3 A =

Practice Exam. 2x 1 + 4x 2 + 2x 3 = 4 x 1 + 2x 2 + 3x 3 = 1 2x 1 + 3x 2 + 4x 3 = 5

Math 102, Winter Final Exam Review. Chapter 1. Matrices and Gaussian Elimination

Span & Linear Independence (Pop Quiz)

EXERCISE SET 5.1. = (kx + kx + k, ky + ky + k ) = (kx + kx + 1, ky + ky + 1) = ((k + )x + 1, (k + )y + 1)

Transcription:

Quizzes for Math 304 QUIZ. A system of linear equations has augmented matrix 2 4 4 A = 2 0 2 4 3 5 2 a) Write down this system of equations; b) Find the reduced row-echelon form of A; c) What are the pivot columns of A the rank of A? d) what are the free variables of the system found in a). e) Solve the system of equations found in a). Solution. a) The system of linear equations with augmented matrix A is 2x + 4x 2 + x 3 + 4x 4 = 4 x 2x 2 x 4 =. 2x + 4x 2 +3x 3 x 4 = 5 x + 2x 2 x 3 + x 4 = b) For convenience, we perform the operation S,4 to have in the first entry of the first column (this way we avoid fractions). We get the matrix 2 2 0 2 4 3 5. 2 4 4

Now we perform operations E 2, (), E 3, ( 2), E 4, ( 2) to get 2 0 0 0 2 0 0 5 3 7. 0 0 3 6 Next we perform E 3,2 (5), E 4,2 (3) to get 2 0 0 0 2 0 0 0 3 3. 0 0 0 0 We perform D 3 ( /3) and get 2 0 0 0 2 0 0 0. 0 0 0 0 The we perform E 4,3 () and get 2 0 0 0 2 0 0 0. 0 0 0 0 The last matrix is in a row-echelon form. Already at this stage we could read off the rank, free variables, and the number of solutions to the system. To get to a reduced row-echelon form we perform E,4 (), E 2,4 (2), E 3,4 ( ) to get 2 0 0 0 0 0 0 0 0 0. 0 0 0 0 Then we do E,3 ( ) to get 2 0 0 0 0 0 0 0 0 0 0. 0 0 0 0 Next we do D 2 ( ) and then E,2 () to finally get the reduced row-echelon form 2 0 0 0 0 0 0 0 0 0 0 0. 0 0 0 0 2

c) We now see that the first, third, fourth, and fifth columns of A are pivot columns. It follows that the rank of A is 4. d) The free variables correspond to the non-pivot columns, so x 2 is the only free variable. e) Since the last column of A is a pivot column, the system is inconsistent, i.e. has no solutions. QUIZ 2. a) Is the matrix 2 3 4 A = 0 2 2 0 one-to-one? Explain your answer. b) Is the matrix B = onto? Is it one-to-one? Explain your answer. c) State a definition of a linear transformation. Solution. a) Recall that an m n matrix A is one-to-one if and only if rank(a) = n. Recall also that rank is always smaller or equal than each m and n. In our case, m = 3, n = 4 so rank(a) 3 and A is not one-to-one. b) We need to compute the rank of B. We perform elementary row operations E 2, ( ), E 3, ( ), and E 4, ( ) to get 0 2 0 2 0 2 2 0 0 0 2 2 3

Now we perform E 3,2 ( ) and get 0 2 0 2 0 0 2 2 0 0 2 2 Finally, after performing E 4,3 ( ) we get a matrix in row-echelon form: 0 2 0 2 0 0 2 2 0 0 0 4 We see that all rows are non-zero (all columns are pivot) so the rank of B is 4. Since B is a 4 4 matrix of rank 4, it is both one-to-one and onto. c) A linear transformation from R n to R m is a function L : R n R m which satisfies the following conditions:. L(u + w) = L(u) + L(w) for any vectors u, w in R n. 2. L(cu) = cl(u) for any u R n and c R. QUIZ 3. a) Compute the product [ ] C = 0 2 3. 2 0 0 Is C one-to-one? Answer this question without any computations. b) The function T : R 3 R 2, T(a, b, c) = (a b+c, 2a+c) is a linear transformation. What is the matrix of T, i.e what is the matrix A such that T = L A? c) Write down the 4 4 matrix E 2,3 ( 2). [ ] 3 4 d) Find the inverse of the matrix. 5 7 4

Solution. a) We have [ ] 3 3 C = 0 2 3 = 2 0 2 0. 0 2 3 [ ] The matrix C is not one-to-one. To justify this, let A = 0 2 3 and B =. 2 0 0 Thus C = AB and therefore L C = L A L B. Now L B : R 3 R 2 is not one-to-one (since 3 > 2). This means that L B (u) = L B (w) for two different vectors u, w. It follows that L C (u) = L A (L B (u)) = L A (L B (w)) = L C (w), so L C is not one-to-one. b) Recall that if A is an m n matrix then the first column of A is L A (e ), the second column of A is L A (e 2 ), etc. In our case, T(e ) = T(, 0, 0) = (, 2), T(e 2 ) = T(0,, 0) = (, 0), and T(e 3 ) = T(0, 0, ) = (, ). Thus the matrix of T is [ ] A =. 2 0 c)the 4 4 matrix E 2,3 ( 2) is 0 0 0 E 2,3 ( 2) = 0 2 0 0 0 0. 0 0 0 d) We need to find the matrix in reduced row-echelon form row equivalent to the matrix [ ] 3 4 0. 5 7 0 We do D (/3) to get Next we do E 2, ( 5) and get [ 4 3 0 3 5 7 0 [ 4 3 0 3 0 3 5 3 5 ]. ].

Now we do D 2 (3) and get [ 4 3 0 3 0 5 3 ]. Finally, we do E,2 ( 4/3) and get [ ] 0 7 4. 0 5 3 Thus [ ] [ ] 3 4 7 4 =. 5 7 5 3 We can also conclude that [ ] 7 4 = E,2 ( 4/3)D 2 (3)E 2, ( 5)D (/3) 5 3 and [ ] 3 4 = (E,2 ( 4/3)D 2 (3)E 2, ( 5)D (/3)) = D (3)E 2, (5)D 2 (/3)E,2 (4/3). 5 7 3 2 0 QUIZ 4. Let A = 2. 5 3 2 a) Find A. b) Express A as a product of elementary matrices. 2 0 c) Suppose that B is a matrix such that AB = 0 0. Is B invertible? Explain 0 0 0 your answer. Solution. a) We start with the matrix 3 2 0 0 0 2 0 0. 5 3 2 0 0 Do E,2 ( ) to get 0 2 0 0. 5 3 2 0 0 6

Then do E 2, ( 2), E 3, ( 5) and get 0 0 3 2 3 0. 0 2 7 5 5 Now do E,2 (), E 3,2 ( 2) which results in 0 2 2 0 0 3 2 3 0. 0 0 Next do E 2,3 ( 3), E,3 ( 2) and get 0 0 4 2 0 0 6 3. 0 0 Finally, do D 2 ( ) and get Thus b) From part a) we have Thus 0 0 4 2 0 0 6 3. 0 0 A = 4 2 6 3. A = D 2 ( )E 2,3 ( 3)E,3 ( 2)E,2 ()E 3,2 ( 2)E 2, ( 2)E 3, ( 5)E,2 ( ). A = (A ) = E,2 ()E 3, (5)E 2, (2)E 3,2 (2)E,2 ( )E,3 (2)E 2,3 (3)D 2 ( ). c) We know from a) that A is invertible. If B were invertible too, then AB would be invertible as well. However, AB is a 3 3 matrix of rank 2 (note that it is in reduced row-echelon form), so it is not invertible. Thus B is not invertible. QUIZ 5. a) Define the kernel of a liner transformation T : V W. b) Finish the sentence: The vectors v,..., v n are linearly independent if and only if.... c) Let v = (,,, ), v 2 = (0, 3,, 3), v 3 = (, 2, 0, 3). 7

. Is v = (, 8, 2, ) in the span of v, v 2, v 3? If yes, express v as a linear combination of v, v 2, v 3. 2. Are v, v 2, v 3 linearly independent? Solution. a) The kernel ker(t) of the linear transformation T : V W is the set {v V : T(v) = 0}, i.e. the set of all vectors in V which are mapped to 0 by T. The kernel is a subspace of V. b) The vectors v,..., v n are linearly independent if and only if none of them is 0 and none is a linear combination of the other vectors. Equivalently: The vectors v,..., v n are linearly independent if and only if the only numbers a,..., a n such that a v + a 2 v 2 +... + a n v n = 0 are a = a 2 =... = a n = 0. c) The first question asks if there are solutions to x v + x 2 v 2 + x 3 v 3 = v. Second question asks if there is a non-trivial solution to x v + x 2 v 2 + x 3 v 3 = 0. We answer both questions by finding reduced row echelon form row-equivalent to the matrix 0 3 2 8 0 2. 3 3 Do E 2, ( ), E 3, ( ), E 4, ( ) to get 0 0 3 3 9 0 3. 0 3 4 2 Then do S 2,3 followed by E 3,2 ( 3) and E 4,2 ( 3) and get 0 0 3 0 0 0 0. 0 0 3 8

Finally, do S 3,4 followed by E 2,3 ( ) and E,3 () to get 0 0 2 0 0 0 0 0 3. 0 0 0 0 We see that the corresponding system of linear equations is consistent (the last column is not pivot) and has unique solution x = 2, x 2 = 0, x 3 = 3. This means that v = 2v + 0 v 2 + 3v 3 is in the span of v, v 2, v 3. For the second question, we ask if the associated homogeneous system has nontrivial solutions. Since all the columns of the coefficient matrix are pivot, the homogeneous system has only trivial solution, so v, v 2, v 3 are linearly independent. QUIZ 6. a) What does it mean that a vector space V is finite dimensional? b) Define a basis of a finite dimensional vector space? c) Let v = (, 2,, ), v 2 = (2, 4, 2, 2), v 3 = (0,,, 2), v 4 = (, 4, 5). Let T : R 4 R 4 be the linear transformation such that T(e ) = v, T(e 2 ) = v 2, T(e 3 ) = v 3, T(e 4 ) = v 4.. Is (,,, ) in the image of T? 2. Find a basis of the image of T and express each v i as a linear combination of the vectors in this basis. 3. Find a basis of the kernel of T. Solution. a) A vector space V is finite dimensional if V = span{v,..., v n } for some finite sequence v,..., v n of vectors in V. b) A basis of a finite dimensional vector space V is a sequence v,..., v n of vectors in V which is linearly independent and such that V = span{v,..., v n }. c) The matrix of T is 2 0 A = 2 4 4 2. 2 2 5 9

We start with the matrix 2 0 2 4 4 2 2 2 5 and perform elementary row operations to bring the part to the left of the dividing line into reduced row-echelon form. We get 2 0 0 0 2 0 0 0 0. 0 0 0 0 2 Since the last column is a pivot column, we conclude that (,,, ) is not in the image of T. This answers part. We see that the pivot columns to the left of the dividing line are columns one and three. Thus v, v 3 is a basis of the image of T. Moreover, from the reduced row-echelon form of Awe see that v 2 = 2v and v 4 = v + 2v 3. This answers part 2. The homogeneous system Ax = 0 has free varaibles x 2 and x 4. The solution corresponsing to x 2 =, x 4 = 0 is ( 2,, 0, 0). The solution corrsponding to x 2 = 0, x 4 = is (, 0, 2, ). Thus ( 2,, 0, 0), (, 0, 2, ) is a basis of the kernel of T. QUIZ 7. a) Find the transition matrix from the basis v = (,, 0), v 2 = (, 0, ), v 3 = (0,, ) to the basis u = (, 0, 0), u 2 = (,, 0), u 3 = (,, ) of R 3. b) T : R 2 R 3 is given by T(a, b) = (a + 2b, a, 0). What is the matrix of T in bases e, e 2 of R 2 and v = (,, 0), v 2 = (, 0, ), v 3 = (0,, ) of R 3. Solution. a) We need to express each vector of the first basis as a linear combination of the vectors in the second basis. We start with the matrix whose columns are the vectors of the second basis followed by the vectors in the first basis: 0 0 0. 0 0 0 We find the reduced row-echelon form of this matrix, which is the matrix 0 0 0 0 0 0. 0 0 0 0

From this matrix we see that v = u 2, v 2 = u u 2 + u 3, v 3 = u + u 3. The transition matrix from the basis v to the basis u is ui v = 0 0. 0 b) We need to express each vector T(e ), T(e 2 ) as a linear combination of the vectors v, v 2, v 3. We have T(e ) = T(, 0) = (,, 0) and T(e 2 ) = T(0, ) = (2, 0, 0). We start with the matrix 2 0 0. 0 0 0 0 The reduced row-echelon form of this matrix is 0 0 0 0 0. 0 0 This tells us that T(e ) = v 2 v 3 and T(e 2 ) = v + v 2 v 3. Thus, the matrix of T in the bases e and v is vt e = 0. QUIZ 8. a) Define an eigenvalue of a linear transformation T : V V. b) The matrix has eigenvalues and. A = 2 2 2 2 2 3. Show that A is diagonalizable. 2. Find a matrix B such that B AB is diagonal. Solution. a) A scalar λ is called an eigenvalue of the linear transformation T : V V if there is a non-zero vector v V such that T(v) = λv. Any such v is

called an eigenvector of T corresponding to the eigenvalue λ. In other words, an eigenvector of T is a non-zero vector v such that T(v) = λv for some scalar λ. b) We need to find the dimension and a basis of the eigenspaces corresponding to each eigenvalue. The eigenspace of a matrix A corrsponding to an eigenvalue λ is the space of all solutions to the homogeneous system of linear equations: (A λi)x = 0.. The eigenspace corresponding to is the space of solutions to (A + I)x = 2 2 2 + 0 0 x 0 0 x 2 = 2 2 x 2 2 2 x 2 = 0 0. 2 2 3 0 0 x 3 2 2 2 x 3 0 The reduced row echelon form of 2 2 2 2 2 is 0 0 0. This matrix has rank, 2 2 2 0 0 0 so our system has 3 = 2-dimensional space of solutions. x 2 and x 3 are the free varaibles and the vectors v = (,, 0), v 2 = (, 0, ) form a basis of the eigenspace corresponding to. 2. The eigenspace corresponding to is the space of solutions to (A I)x = 2 2 2 0 0 x 0 0 x 2 = 0 2 x 2 0 2 x 2 = 0 0. 2 2 3 0 0 x 3 2 2 4 x 3 0 The reduced row echelon form of 0 2 2 0 2 is 0 0. This matrix has rank 2 2 4 0 0 0 2, so our system has 3 2 = -dimensional space of solutions. x 3 is the free varaible and the vector v 3 = (,, ) forms a basis of the eigenspace corresponding to. According to the results from class, vectors v, v 2, v 3 are linearly independent, hence form a basis of R 3. This basis consists of eigenvectors of A, so A is diagonalizable. This solves part. For part 2., we can take B to be thetransition matrix from the basis v, v 2, v 3 to the standard basis. Then B AB = 0 0 0 0 (note that,, are the 0 0 eigenvalues corresponding to the vectors v, v 2, v 3 respectively). 2

We have B = 0 0 and a simple computations yields B = 0 2. We noe easily check that indeed B AB = 0 2 2 2 2 0 = 0 0 0 0. 2 2 3 0 0 0 QUIZ 9. a) Define the characteristic polynomial of a matrix A. 2 0 b) Compute the determinant of the matrix 2 2 3 0. 4 2 0 c) Find all eigenvalues of the matrix 0 0 2 0 2. 0 Solution. a) The characteristic polynomial p A (t) of a matrix A is defined as p A (t) = det(a ti). It is a polynomial of degree n with leading coefficient ( ) n, where n is the size of A. b) Note that the third column of our matrix has only one non-zero entry. This suggests to start with the Laplace expansion by the third column: 2 0 2 2 2 = ( ) 2 3. 3 0 4 2 0 4 2 To compute the 3 3 determinant we first do the row operations E 2, (), E 3, () 3

and then do Laplace expansion by the third column: 2 2 3 = 4 3 0 4 3 = ( ) = (6 5) =. 5 4 4 2 5 4 0 Thus the original determinant is equal to 2 ( ) = 2. c) First we compute the characteristic polynomial of our matrix which is t 0 2 p(t) = t 2 t 2 = ( t) t + ( ) 0 2 t = 0 t = ( t)(t 2 + t 2) ( 2) = t 3 t 2 + 2t + 2 = (t + )(t 2 2). We see that the roots of p(t) are, 2, 2, so these are the eigenvalues of our matrix. QUIZ 0. a) Define an inner product on a vector space V. b) Consider the vector space R 4 with the dort product as the inner product.. What is the angle between vectors (,, 0, 0) and (,,, )? 2. Let v = (,, 0, 0), v 2 = (,,, 0), v 3 = (,, 2, ). Use Gramm-Scmidt orthogonalization process to fina an orthogonal basis of span{v, v 2, v 3 }. Solution. a) An inner product on a vector space V is a function V V R which to any pair of vectors u, w of V assigns a real number, denoted by < u, w >, such that the following conditions are satisfied:. < u, w >=< w, u > for any two vectors u, w V. 2. < au + bu 2, w >= a < u, w > +b < u 2, w > for any vectors u, u 2, w V and any numbers a, b. 3. < u, u > is positive (i.e. < u, u >> 0) for any non-zero vector u V. 4

b) Recall that the angle (u, w) between two vectors u, w V is the unique angle in the interval [0, π] such that cos (u, w) = < u, w > u w. Since in our problem the inner product is the dot product, we have < (,, 0, 0), (,,, ) >= (,, 0, 0) (,,, ) = 2, (,, 0, 0) = < (,, 0, 0), (,, 0, 0) > = (,, 0, 0) (,, 0, 0) = 2, (,,, ) = < (,,, ), (,,, ) > = (,,, ) (,,, ) = 4 = 2 Thus cos (u, w) = 2/(2 2) = 2/2, so (u, w) = π/4. c) Recall the Gramm-Schimidt orthogonalization process. Gramm-Schmidt orthogonalization process. Let <, > be an inner product on a vector space V and let v,..., v k be linearly independent. Define recursively vectors w,..., w k as follows: ( < vj+, w > w = v, w j+ = v j+ Then. w, w 2,..., w k is orthogonal. < w, w > w + < v j+, w 2 > < w 2, w 2 > w 2 +... + < v j+, w j > < w j, w j > w j 2. span{w,..., w j } = span{v,..., v j } for j =,..., k. Let us apply the Gramm-Schmidt orthogonalization process to the vectors v, v 2, v 3. We have step : w = v = (,, 0, 0) and < w, w >= (,, 0, 0) (,, 0, 0) = 2, ). step 2: < v 2, w >= (,,, 0) (,, 0, 0) = 2 so and w 2 = v 2 < v 2, w > < w, w > w = (,,, 0) 2 (,, 0, 0) = (0, 0,, 0), 2 < w 2, w 2 >= (0, 0,, 0) (0, 0,, 0) =. 5

step 3: < v 3, w >= (,, 2, ) (,, 0, 0) = 2, < v 3, w 2 >= (,, 2, ) (0, 0,, 0) = 2 so w 3 = v 3 < v 3, w > < w, w > w < v 3, w 2 > < w 2, w 2 > w 2 = (,, 2, ) 2 2 (,, 0, 0) 2 (0, 0,, 0) = (0, 0, 0, ). We see that w, w 2, w 3 is an orthogonal basis of span{v, v 2, v 3 }(verify this!). QUIZ. Consider R 4 with the dot product as an inner product. Let v = (,,, ), v 2 = (, 2, 3, 2), W = span{v, v 2 }.. Find the orthogonal projection of v = (, 3, 5, 7) onto W. 2. What is the orthogonal projection of v onto W (THINK!)? 3. Find a basis of W Solution.. First we need to find an orthogonal basis of W. We apply Gram- Schmidt process to v, v 2 : w = v = (,,, ), < w, w >= v v = 4, w 2 = v 2 < v 2, w > < w, w > w = v 2 v 2 w w = (, 2, 3, 2) 8 (,,, ) = (, 0,, 0). w w 4 Once we have an othogonal basis w, w 2 of W, we can apply the formula for the projection P W (v) of v onto W: P W (v) = < v, w > < w, w > w + < v, w 2 > < w 2, w 2 > w 2 = v w w w w + v w 2 w 2 w 2 w 2 = = 6 4 (,,, ) + 4 (, 0,, 0) = (2, 4, 6, 4). 2 2. Recall, that if W is a subspace of an inner-product space V and v V then v = w + u for unique w W and u W. In other words, v = P W (v) + P W (v). Thus P W (v) = v P W (v) = (, 3, 5, 7) (2, 4, 6, 4) = (,,, 3). 6

3. Recall that a vector x = (x, x 2, x 3, x 4 ) belongs to W iff it is orthogonal to every vector in W, which is equivalent to beeing orthogonal to every vector of some spanning set of W. In our case, x W if and only if x v = 0 = x v 2. In other words, W is the set of solutions to the system x v = 0, x v 2 = 0, which is a homogeneous system of linear equations: x v = x + x 2 + x 3 + x 4 = 0, x v 2 = x + 2x 2 + 3x 3 + 2x 4 = 0. [ ] The coefficient matrix of this system is which has the reduced rowechelon form. There are two free variables x 3, x 4 and a basis of 2 3 2 [ ] 0 0 0 2 solutions is u = (, 2,, 0), u 2 = (0,, 0, ). Thus u, u 2 is a basis of W. 7