Solutions to Final Practice Problems Written by Victoria Kala vtkala@math.ucsb.edu Last updated /5/05 Answers This page contains answers only. See the following pages for detailed solutions. (. (a x. See detailed solution 7 (b x 0 5 ( 8. (a x B 5 (b x B 0 5. P B C 4. 5. (, P 4 C B 6. rank(a, nullity(a ( 4. A P DP where P ( 5 0 D 0 4., π 5. See detailed solution 6. 5 5 7. (a 0 (b (c 6 (d 00 8. (a See detailed solution (b See detailed solution ( /4, 7. dim col(a dim row(a dim null(a T 8. See detailed solution 9. Yes 0. Yes, λ. (a λ +, λ ( ( + v, v (b λ, λ 0, λ 5, v 0 7/ /9 0, v 4/, v /9 9. (a w B (, 5 (b w B (0,, 0. (a Not orthogonal (b Orthogonal. (a 46 5 (, 4 (b (,, ( / 5. (a ˆx, Aˆx 9/ / 4 (b ˆx, Aˆx 9 9 0
Detailed Solutions. Find the vector x determined by the given coordinate vector x B and given basis B: {( ( } ( 4 5 (a B,, x 5 6 B Solution. Since B is a basis of R, for every x R we can write x c b + c b where b, b are the basis elements of B. The coordinate vector is the vector x B (c, c. Since we are given x B (5,, then ( ( ( ( ( 4 5 x 5 + +. 5 6 5 8 7 4 4 (b B, 5, 7, x B 8 0 7 Solution. Since B is a basis of R, for every x R we can write x c b + c b + c b where b, b, b are the basis elements of B. The coordinate vector is the vector x B (c, c, c. Since we are given x B ( 4, 8, 7, then 4 4 4 8 0 x ( 4 + 8 5 + ( 7 7 8 + 40 + 49 0 0 6 5. Find the coordinate vector x B of the given vector x relative to the given basis B: {( ( ( (a B,, x 5} Solution. Since B is a basis of R, for every x R we can write x c b + c b where b, b are the basis elements of B. The coordinate vector is the vector x B (c, c. Since we are given x (,, then ( ( ( c + c. 5
We can rewrite this system as a matrix equation and use row reduction to solve (you could also use an inverse to solve: ( ( ( R+R R R+R R 0 8 5 0 5 0 5 The solution to this system is c 8, c 5, therefore x B (b B 0,,, x 5 8 4 Solution. Since B is a basis of R, for every x R we can write x c b + c b + c b ( 8. 5 where b, b, b are the basis elements of B. The coordinate vector is the vector x B (c, c, c. Since we are given x (, 5, 4, then 5 c 0 + c + c 4 8 We can rewrite this system as a matrix equation and use row reduction to solve (you could also use an inverse to solve, if it exists: 0 5 R+R R 0 5 R+R R 0 5 8 4 0 5 0 0 5 R+R R 0 0 0 0 0 5 R+R R R+R R 0 0 0 0 0 0 0 5 0 0 0 0 0 0 5 The solution to this system is c, c 0, c 5, therefore x B 0. 5. Find the change of coordinates matrix from B to C and the change of coordinates matrix from C to B where {( ( {( ( B,, C,. 8 5} 4 }
Solution. To find the change of coordinates matrix from B to C, call it P B C, we set up the augmented matrix ( c c b b, where b, b are the basis elements of B and c, c are the basis elements of C. We then reduce to get the ( I P B C. ( ( ( 4R+R R R R 4 8 5 0 9 0 4 ( R+R R 0. 0 4 ( Thus P B C. 4 To find the change of coordinates matrix from C to B, call it P B C, we can set up the augmented matrix ( b b c c, and solve using the same method as above, OR we can calculate P B C. I will do the latter, but feel free to use whichever method you are more comfortable with. ( P C B P B C ( (. 4 9 8 4 4 4. Find the dimension of the subspace of all vectors in R whose first and third entries are equal. Solution. There are two ways to approach this problem: one way is to find the basis of this set, another is to look at what the elements look like. Both approaches are very similar. We first want to write this set out: x U y R : x z z The x z represents that the first and third entries are equal. Since x z, substitute this in to either the first or third equation. Every element in U will look like x y. x There are two unknowns here (x and y, hence the dimension is. If you want to see what the basis looks like, write it out the element in parametric form: x y x 0 x + 0 y. 0 4
Therefore the basis of U is the set 0, 0. 0 dimension is. This set has elements, hence the 5. Find the dimension of the subspace spanned by the given vectors:, 4, 8 6, 0 0 5 7 Solution. Let U denote the span of the set of vectors above. Recall that the dimension relates to the basis, and that a basis is the set of linearly independent vectors which span the set. To find the linearly independent vectors of U, we will form a matrix, reduce, and identify the columns with pivots (note that these are the same steps to finding the column space!. 8 4 6 0 0 5 7 8 0 0 6 0 5 7 R+R R R+R R 8 0 5 7 0 0 6 R R 8 0 5 7 0 0 0 8 The number of pivots will tell us the number of elements in our basis for U. Here we have pivots (st, nd, 4th columns, hence dim(u. If you want to write out the basis, you will just take the st, nd, and 4th vectors from U: U span, 4, 0 0 7 Notice that we have elements in our basis, hence dim(u. 6 9 0 6. Find the rank and nullity of A 0 4 5 0 0 0 5. 0 Solution. The rank is the dimension of the column space, which is just the number of pivots. We have pivots (st, nd, 5th columns, hence rank(a. Using the Rank-Nullity theorem, nullity(a #columns(a rank(a 5. 7. If the null space of a 5 6 matrix A is 4-dimensional, what are the dimensions of the column space and row space of A, and the dimension of the null space of A T? 5
Solution. Since the nullspace of A is 4-dimensional, then nullity(a 4. Using the Rank- Nullity Theorem, rank(a #columns(a nullity(a 6 4. The rank is equal to the dimension of the column space and dimension of the row space, hence these are both. The dimension of the null space of A T is nullity(a T #rows(a rank(a 5 4. To summarize: dim col(a, dim row(a, dim null(a T. 8. Show that if A has eigenvalue λ 0 then A does not exist. Proof. We will use the eigenvalue equation det(a λi 0. If λ 0, then this equation becomes det(a 0I 0 det(a 0. Since det(a 0, then A is not invertible, hence A does not exist. 9. Is λ an eigenvalue of (? Why or why not? 8 Solution. We will use the eigenvalue equation det(a λi 0. We need to show that if λ, then det(a I 0. Start with the left hand side and show we get 0: (( ( 0 det(a I det 8 0 6 6 0. Since we got ( 0, this shows that the eigenvalue equation is satisfied. eigenvalue of. 8 6 7 0. Is an eigenvector of 7? If so, find the eigenvalue. 5 6 5 λ is indeed an Solution. We will use the eigenvalue-eigenvector equation Av λv. We need to show that if v, then this equation is satisfied. Start with the left hand side and show we get a multiple of v: 6 7 + 7 7 6 + 7 4. 5 6 5 5 + 5 6
Since we got a multiple of v, then v is an indeed an eigenvector of 6 7 7, and its 5 6 5 eigenvalue is λ.. Find the eigenvalues and eigenvectors of each matrix: ( (a Solution. We will use the eigenvalue equation det(a λi 0: (( ( λ 0 det 0 λ λ λ ( λ( λ ( ( λ + λ + λ + λ λ. We use the quadratic formula to find the roots of this equation: λ ± 4 4(( ( ± 8 ± Therefore the eigenvalues are λ +, λ. We now find the eigenvectors using the equation (A λiv 0. When λ +, ( λ 0 λ 0 ( 0 0 ±. ( ( + 0 ( + 0 ( ( R+R R 0 0 0 0 x is a pivot, x is a free variable. The second equation tells us that x ( + x, hence the general solution is ( ( ( x ( + x + x x. This shows that λ has the eigenvector v When λ, ( λ 0 λ 0 ( + 0 + 0 x ( +. ( ( 0 ( 0 (+ ( R+R R 0 0 0 + 0 7
x is a pivot, x is a free variable. The second equation tells us that x ( x, hence the general solution is ( ( ( x ( x x x x. ( This shows that λ has the eigenvector v. (b 6 0 9 0 5 8 Solution. We will use the eigenvalue equation det(a λi 0: 6 0 λ 0 0 6 λ 0 det 9 0 0 λ 0 9 λ 0 5 8 0 0 λ 5 8 λ ( λ 6 λ 9 λ ( λ [(6 λ(9 λ ( ( ] ( λ [ 54 6λ 9λ + λ 4 ] ( λ(λ 5λ 50 ( λ(λ 0(λ 5 Set this equal to 0 and solve for λ. The eigenvalues are λ, λ 0, λ 5. We now find the eigenvectors using the equation (A λiv 0. When λ, 6 λ 0 0 9 λ 0 0 5 8 λ 0 6 0 0 0 0 5 8 0 0 5R+R R R+R R R+R R 4 0 0 0 4 0 0 0 0 0 4 0 0 0 0 0 6 0 0 4 0 0 5 8 0 0 6 0 0 9 0 0 5 8 0 R+R R 4 R R, R R 4R+R R 4 0 0 0 4 0 0 5 8 0 0 4 0 0 0 0 0 0 0 0 0 0 0 0 0 0 x, x are pivots. x is a free variable. The first equation tells us that x 0, the second equation tells us that x 0, hence the general solution is x 0 0 x 0 0 x. x x 8
This shows that λ has the eigenvector v 0 0. When λ 0, 6 λ 0 0 9 λ 0 0 5 8 λ 0 4 0 0 0 0 5 8 7 0 R+R R R R R+R R 6 7 0 0 0 6 7 0 0 4/ 0 6 0 0 0 9 0 0 0 5 8 0 0 0 0 5 8 7 0 R+R R 6R+R R R R 6 7 0 0 4 0 0 7/ 0 0 4/ 0 0 0 5 8 7 0 x, x are pivots. x is a free variable. The first equation tells us that x 7 x, the second equation tells us that x 4 x, hence the general solution is x 7/x 7/ x 4/x 4/ x. x x 7/ This shows that λ has the eigenvector v 4/. When λ 5, 6 λ 0 0 6 5 0 0 9 λ 0 0 9 5 0 0 5 8 λ 0 5 8 5 0 0 0 4 0 0 5 8 0 5R+R R R+R R 0 0 0 8 0 R+R R 0 0 5 8 0 8 R R 0 /9 0 0 /9 0 R R 0 0 0 /9 0 0 0 5 8 0 9
x, x are pivots. x is a free variable. The first equation tells us that x 9 x, the second equation tells us that x 9 x, hence the general solution is x x x /9x /9 /9x /9 x. This shows that λ has the eigenvector v /9 /9. x. Let A and B be similar matrices. Show that A and B have the same eigenvalues. Proof. Since A and B are similar, there exists an invertible P such that A P BP. To show that the eigenvalues of A and B are the same, we wish to show that det(a λi B λi. Starting from the left hand side, det(a λi det(p BP λi det(p BP λp P det [ P (BP λp ] det [ P (B λip ] det(p det(b λidet(p det(p det(b λi det(p det(b λi Since we have shown that det(a λi det(b λi, then A and B must have the same eigenvalues.. Diagonalize the matrix (. 4 Solution. We begin by finding the eigenvalues. We will use the eigenvalue equation det(a λi 0: (( ( λ 0 det 4 0 λ λ 4 λ ( λ( λ λ λ + λ λ λ 0 (λ 5(λ + Set this equal to 0 and solve for λ. The eigenvalues are λ 5, λ. We now find the eigenvectors using the equation (A λiv 0: When λ 5: ( λ 0 4 λ 0 ( R R 0 4 4 0 ( 5 0 4 5 0 ( 0 4 4 0 ( 4R+R R 0 0 0 0 0
x is a pivot, x is a free variable. The first equation tells us that x x, hence the general solution is ( ( ( x x x x x. ( This shows that λ has eigenvector v. When λ : ( λ 0 4 λ 0 R+R R ( ( ( 0 4 0 4 ( 0 4 0 ( 4 0 ( 4 R R /4 0 0 0 0 0 0 0 x is a pivot, x is a free variable. The first equation tells us that x /4x, hence the general solution is ( ( ( x /4x /4 x x x. ( /4 This shows that λ has the eigenvector v. We now form the matrix P of eigenvectors and the diagonal matrix D of eigenvalues. You get to choose the order. I will choose P ( v v, which means that λ and λ will follow the same order in D: ( ( /4 5 0 P, D. 0 We now calculate P. You can either set up an augmented matrix or use the equation of the inverse of a matrix. I will do the latter: ( P /4 4 ( /4. (( ( /4( 7 If our calculations are correct, A P DP. Let s check: ( ( ( P DP /4 5 0 4 /4 0 7 ( ( ( /4 5 0 /4 4 7 0 ( ( 5 6/4 /4 4 7 5 4 ( 5 6/4 5/4 + 6/4 4 7 5 + 5/4 7 ( 4 A ( 4/4 /7 7 7/4
4. Let u (,, and v (,,. Find u v and determine the angle θ between u and v. Solution. The dot product of u and v is To determine θ, we will use the fact that We now need to find u, v : u v ( ( + ( +. u v u v cos θ cos θ u v u v. u + ( + 6 v + + 6 Therefore cos θ u v u v 6 6 6 ( θ cos π 5. Show that u (6,, 4 and v (, 0, are orthogonal. Solution. To show that u and v are orthogonal, we need to show that u v 0: u v 6( + (0 + 4( + 0 0. 6. Find the distance between u (0, and v (, 5. Solution. The distance between u and v is given by u v : u v (0, (, 5 (0 (, ( 5 (, + + 4 5 5 5. Problems added /0 : 7. Let A be a matrix with eigenvalue λ. Find the eigenvalues of the following: (a A 0
Solution. We will use the eigenvalue-eigenvector equation Av λv. Since A has eigenvalue λ, this equation becomes Av v. There are two ways to do this problem: You can build up from the above equation, or you can start with A 0 and break it down. Build up : Multiply by A on the left on both sides: A(Av v A v (Av A v (v A v v. Multiply by A on the left on both sides again: A(A v v A v (Av A v (v A v v. Repeat this pattern of multiplying by A on the left. You will get So A 0 has eigenvalue 0. Break it down : Start with A 0 v: (b A A 0 v 0 v. A 0 v A A A (Av A A Acdotv. A A A (Av A Ac... A v A A Av 0 v. Again, A 0 has eigenvalue 0. Solution. We will again use the equation Av v. Multiply by A on both sides: A (Av v v A v A v v Thus A has eigenvalue. (c A + 4I Solution. We will again use the equation Av v. Add 4Iv onto both sides: A v + 4Iv v + 4Iv (A + 4Iv v + 4v (A + 4Iv 6v. Thus A + 4I has eigenvalue 6. (d 00A
Solution. We will again use the equation Av v. Multiply by 00 on both sides: Thus 00A has eigenvalue 00. 00(Av v 00Av 00v. 8. Let u (0,, 0, u (, 0,, u (, 0, be vectors in R. (a Show that the set S {u, u, u } is an orthogonal set. Proof. We need to show that the dot product of all possible combinations of these vectors is 0: Thus S is an orthogonal set. u u 0( + (0 + 0( 0 u u 0( + (0 + 0( 0 u u ( + 0(0 + ( 0 (b Convert S into an orthonormal set by normalizing the vectors. Solution. An orthonormal set is an orthogonal set and contains unit vectors. We showed in part (a that S is an orthogonal set. Now we need to normalize the vectors. First, look at u : u 0 + + 0 Thus u is already a unit vector and we do not need to normalize it. Next, look at u : u + 0 + u is therefore not a unit vector. We define a new vector v that is a unit vector: v u ( (, 0,, 0,. u Now look at u : u + 0 + ( u is therefore not a unit vector. We define a new vector v that is a unit vector: v u ( (, 0,, 0,. u Thus our orthonormal set is given by S {u, v, v }. 9. In each part, an orthonormal basis {u,..., u n } is given. Find the coordinate vector of w with respect to that basis. (Use inner products! ( ( (a u,, u, ; w (, 7 4
Solution. Let B denote the basis given. Since B is a basis, then for every w we can write w c u + c u. The coordinate vector is w B (c, c. Since B is an orthonormal basis, then we know that c w u and c w u. u u u u These constants are called the scalar projection of w onto u and u, respectively. Calculate the following dot products: ( w u + 7 ( 7 4 u u ( ( + ( ( w u + 7 + 7 0 5 5 u u ( + ( + Note: We should not be surprised that u u and u u were both. Recall that the definition of the norm is u u u, or, equivalently, u u u. Since we were given that B is an orthonormal basis, the norms of u and u are, therefore u u and u u are both. Now we use the formulas for c and c : c w u u u c c w u 5 5. u u Thus w B (, 5. (b u (,,, u (,,, u (,, ; w (, 0, Solution. Let B denote the basis given. Since B is a basis, then for every w we can write w c u + c u + c u. The coordinate vector is w B (c, c, c. Since B is an orthonormal basis, then we know that c w u and c w u and c w u. u u u u u u 5
These constants are called the scalar projection of w onto u, u, and u, respectively. Calculate the following dot products: ( ( w u + 0 ( + 0 u u ( ( + ( 4 9 + 4 9 + 9 ( ( ( w u + 0 + + 0 4 u u ( + ( ( 4 9 + 9 + 4 9 ( ( ( w u + 0 + + 0 + 4 u u ( + ( + ( 9 + 4 9 + 4 9 Again, we should not be surprised that u u, u u, and u u were all equal to (see the note in part (a. Now we use the formulas for c, c, c : Thus w B (0,,. c w u u u 0 0 c w u u u c w u u u 0. Determine which of the following matrices are orthogonal: (a 0 / 0 0 0 0 / Solution. Let Q denote the matrix above. We wish to show that Q T Q I. 0 / T 0 / Q T Q 0 0 0 0 / 0 0 0 0 / 0 0 0 / 0 0 / 0 / 0 0 0 0 / 0 0 0 / 0 / 6
Since Q T Q I, then this matrix not orthogonal. / / 6 / (b 0 / 6 / / / 6 / Solution. Let Q denote the matrix above. We wish to show that Q T Q I. / / 6 / T Q T Q 0 / 6 / / / 6 / / / 6 / 0 / 6 / / / 6 / / 0 / / 6 / 6 / / / 6 / 6 / / / 0 / 6 / / / 6 / / + / / + / / 6 + / 6 / + / /6 + 4/6 + /6 / 8 / 8 + / 8 / 6 + / 6 / 8 / 8 + / 8 / + / + / 0 0 0 0 0 0 Since Q T Q I then Q is orthogonal.. Find the orthogonal projection of v onto w: (a v (6, 7, w (, 4 Solution. The orthogonal projection of v onto w is given by Calculate the following dot products: v w w w w v w 6( + 7(4 8 + 8 46 w w ( + 4(4 9 + 6 5 Hence v w w w w 46 (, 4. 5 ( (b v (,, 0, w,, 7
Solution. The orthogonal projection of v onto w is given by Calculate the following dot products: ( v w + v w w w w ( + 0 ( w w ( + ( + ( + + Hence ( v w w w w,, (,,.. Find the least squares solution of the linear system Ax b, and find the orthogonal projection of b onto the column space of A: 7 (a A, b 0 7 Solution. Since we are asked to find the least squares solution, we need to solve the system A T Aˆx A T b for ˆx. Find A T A: T A T A ( ( + + + + 4 ( 6 8
Find A T b: A T b T 7 0 7 ( 7 0 7 ( 7 + 0 + 7 7 + 0 4 ( 4 7 Therefore the system A T Aˆx A T b is given by ( ( 4 ˆx 6 7 You can solve this using row reduction or finding an inverse matrix. Let s do row reduction: ( ( ( 4 R+R R 4 7 R+R R 4 7 6 7 6 7 0 4 7 ( 4 R R 4 7 0 / ( 4R+R R 0 5 0 / therefore ˆx (5, /. This is the least squares solution. We now wish to find the orthogonal projection of b onto the column space of A. We do this by finding Aˆx: 5 + / / ( 5 / 5 + / 5 + 9/ 4. 0 6 (b A 0, b 0 9 Solution. Since we are asked to find the least squares solution, we need to solve the system A T Aˆx A T b 9
for ˆx. Find A T A: T 0 0 A T A 0 0 0 0 0 0 + 4 + + 0 + + + 4 + 0 0 + + + 0 + + + 0 + 0 4 + 0 0 + 0 + 4 + 0 + 7 4 6 4 6 6 Find A T b: T 0 6 A T b 0 0 9 6 0 0 9 0 6 + 0 + 9 + 0 + 0 + 9 + 6 + 0 + 0 8 9 Therefore the system A T Aˆx A T b is given by 7 4 6 8 4 ˆx. 6 6 9 We will solve this system using row reduction: 7 4 6 8 4 R+R R 6 6 9 0 9 4 6 6 9 0
4R+R R R R 0 4 0 9 6 6 9 R R 0 9 0 4 0 5 R+R R 0 9 0 4 0 0 9 0 0 0 0 0 0 9 6R+R R R+R R R+R R R R 0 9 0 4 0 6 45 0 9 0 4 0 0 9 0 9 0 0 0 0 9 0 0 0 0 0 0 9 therefore ˆx (,, 9. This is the least squares solution. We now wish to find the orthogonal projection of b onto the column space of A. We do this by finding Aˆx: 0 + 0 9 + 0 9 4 8 4 8 0 9 + 0 9 + 0 9. 9 0