Discrete Riccati equations and block Toeplitz matrices

Size: px
Start display at page:

Download "Discrete Riccati equations and block Toeplitz matrices"

Transcription

1 Discrete Riccati equations and block Toeplitz matrices André Ran Vrije Universiteit Amsterdam Leonid Lerer Technion-Israel Institute of Technology Haifa André Ran and Leonid Lerer 1

2 Discrete algebraic Riccati equation X = AXA + Q AXB(R + B XB) 1 B XA Standing assumptions: A is invertible, R is Hermitian and invertible, Q is Hermitian No definitiness conditions on Q and R André Ran and Leonid Lerer 2

3 Discrete algebraic Riccati equation X = AXA + Q AXB(R + B XB) 1 B XA Standing assumptions: A is invertible, R is Hermitian and invertible, Q is Hermitian No definitiness conditions on Q and R A solution is a Hermitian matrix X for which R + B XB is invertible, and the is satisfied André Ran and Leonid Lerer 2

4 Discrete algebraic Riccati equation X = AXA + Q AXB(R + B XB) 1 B XA Standing assumptions: A is invertible, R is Hermitian and invertible, Q is Hermitian No definitiness conditions on Q and R A solution is a Hermitian matrix X for which R + B XB is invertible, and the is satisfied Goal: describe the set of all solutions in terms of two given solutions X 1 and X 0, when X 1 X 0 is invertible Second goal: to apply this to an interesting special case André Ran and Leonid Lerer 2

5 Reduction to the case Q = 0 Let X 0 be a fixed solution and let X be any other solution Denote by A 0 = A AX 0 B(R + B X 0 B) 1 B, and R 0 = R + B X 0 B The latter matrix is invertible by assumption, since X 0 is a solution Then Y = X X 0 satisfies the equation Y = A 0 Y A 0 A 0 Y B(R 0 + B Y B) 1 B Y A 0 So, without loss of generality Q = 0, supposing we know a solution André Ran and Leonid Lerer 3

6 Reduction to Lyapunov equation Assume that A is invertible, and let X be an invertible solution of : X = AXA AXB(R + B XB) 1 B XA Then Y = X 1 solves the Stein equation Y A Y A = BR 1 B and conversely, if Y is an invertible solution of the Stein equation, then X = Y 1 solves the discrete algebraic Riccati equation above André Ran and Leonid Lerer 4

7 Reduction to Lyapunov equation Assume that A is invertible, and let X be an invertible solution of : X = AXA AXB(R + B XB) 1 B XA Then Y = X 1 solves the Stein equation Y A Y A = BR 1 B and conversely, if Y is an invertible solution of the Stein equation, then X = Y 1 solves the discrete algebraic Riccati equation above Note: the zero matrix is an obvious solution of the algebraic Riccati equation André Ran and Leonid Lerer 4

8 Non-invertible solutions X = AXA AXB(R + B XB) 1 B XA X + an invertible solution, A invertible André Ran and Leonid Lerer 5

9 Non-invertible solutions X = AXA AXB(R + B XB) 1 B XA X + an invertible solution, A invertible Theorem Let N be an A -invariant subspace which is X + -nondegenerate, that is, C r = (X + N) +N Let P N be the projection onto (X + N) along N, and put X N = X + P N Then X N is a Hermitian solution of the algebraic Riccati equation for which kerx N = N André Ran and Leonid Lerer 5

10 Non-invertible solutions X = AXA AXB(R + B XB) 1 B XA X + an invertible solution, A invertible Theorem Let N be an A -invariant subspace which is X + -nondegenerate, that is, C r = (X + N) +N Let P N be the projection onto (X + N) along N, and put X N = X + P N Then X N is a Hermitian solution of the algebraic Riccati equation for which kerx N = N For converse we need an additional assumption André Ran and Leonid Lerer 5

11 Description of all solutions A is invertible, so X = AXA AXB(R + B XB) 1 B XA X(A ) 1 = ( A AXB(R + B XB) 1 B ) X Consequently, for any solution X the subspace N = kerx is invariant under A André Ran and Leonid Lerer 6

12 Description of all solutions A is invertible, so X = AXA AXB(R + B XB) 1 B XA X(A ) 1 = ( A AXB(R + B XB) 1 B ) X Consequently, for any solution X the subspace N = kerx is invariant under A Would like to conclude that for any solution X its kernel is X + -nondegenerate This is true under an extra assumption on A André Ran and Leonid Lerer 6

13 Main theorem I Theorem Assume that A and (A ) 1 have no common eigenvalues Then, if X solves ker X is X + -nondegenerate There is a one-to-one correspondence between solutions of and subspaces N that are A -invariant and X + -nondegenerate, which is given by X = X + P N, where P N is the projection onto (X + N) along N In particular, there can be only one invertible solution of André Ran and Leonid Lerer 7

14 Main theorem I Theorem Assume that A and (A ) 1 have no common eigenvalues Then, if X solves ker X is X + -nondegenerate There is a one-to-one correspondence between solutions of and subspaces N that are A -invariant and X + -nondegenerate, which is given by X = X + P N, where P N is the projection onto (X + N) along N In particular, there can be only one invertible solution of Observe that the uniqueness of the solution of the Stein equation is in fact equivalent to A and A 1 having no common eigenvalues André Ran and Leonid Lerer 7

15 Main theorem II Assume that A and (A ) 1 have no common eigenvalues, and let Y be the unique solution of the Stein equation Y A Y A = BR 1 B Theorem There is a one-to-one correspondence between solutions of and subspaces N that are A -invariant and Y -nondegenerate which is given by X = Y 1 P N, where P N is the projection onto Y N along N André Ran and Leonid Lerer 8

16 Special case: companion type A = K = K 1 I 0 0 K 2 0 I, B = I K n 0 0 I 0 0 Define X (n) 00 Assume K is invertible = R, X(n) j0 = K jr André Ran and Leonid Lerer 9

17 Special case: companion type A = K = K 1 I 0 0 K 2 0 I, B = I K n 0 0 I 0 0 Define X (n) 00 Assume K is invertible Stein equation: = R, X(n) j0 = K jr Y K Y K = diag ( ) (X (n) 00 ) André Ran and Leonid Lerer 9

18 Special case: companion type A = K = K 1 I 0 0 K 2 0 I, B = I K n 0 0 I 0 0 Define X (n) 00 Assume K is invertible Stein equation: : = R, X(n) j0 = K jr Y K Y K = diag ( ) (X (n) 00 ) X = KXK KXB(X (n) 00 + B XB) 1 B XK André Ran and Leonid Lerer 9

19 Connection to block Toeplitz matrices The invertible solution X of the Riccati equation X = KXK KXB(X (n) 00 + B XB) 1 B XK is congruent to the inverse of a block Toeplitz matrix André Ran and Leonid Lerer 10

20 Connection to block Toeplitz matrices The invertible solution X of the Riccati equation X = KXK KXB(X (n) 00 + B XB) 1 B XK is congruent to the inverse of a block Toeplitz matrix Use Gohberg-Lerer result: André Ran and Leonid Lerer 10

21 Connection to block Toeplitz matrices The invertible solution X of the Riccati equation X = KXK KXB(X (n) 00 + B XB) 1 B XK is congruent to the inverse of a block Toeplitz matrix Use Gohberg-Lerer result: Y = X 1 = T n 1, where T n is the block Toeplitz matrix given by ( ) T n = K X (n) X 1 K, André Ran and Leonid Lerer 10

22 Connection to block Toeplitz matrices The invertible solution X of the Riccati equation X = KXK KXB(X (n) 00 + B XB) 1 B XK is congruent to the inverse of a block Toeplitz matrix Use Gohberg-Lerer result: Y = X 1 = T n 1, where T n is the block Toeplitz matrix given by ( ) T n = K X (n) X 1 K, where K is given by André Ran and Leonid Lerer 10

23 Connection to block Toeplitz matrices K = 00 ) K 1 I 0 0 K 2 0 I I 0 K n 0 0 I (X (n) André Ran and Leonid Lerer 11

24 Discussion of the extra assumption Gohberg-Lerer: If R = X 00 > 0, K and (K ) 1 are even allowed to have common eigenvalues!!! To ensure existence of an invertible solution to the Stein equation Y K Y K = diag ( ) (X (n) 00 ) n P(λ) = ( λ n j K j )R 1/2 j=0 André Ran and Leonid Lerer 12

25 Discussion of the extra assumption Gohberg-Lerer: If R = X 00 > 0, K and (K ) 1 are even allowed to have common eigenvalues!!! To ensure existence of an invertible solution to the Stein equation Y K Y K = diag ( ) (X (n) 00 ) P(λ) = ( n λ n j K j )R 1/2 André Ran and Leonid Lerer 12 j=0 Theorem[Gohberg-Lerer] The Stein equation has an invertible solution if and only if for every symmetric pair of eigenvalues λ 0, λ 1 0 and for any right Jordan chains x 1,, x k and y 1,, y l of P corresponding to λ 0 and λ 1 0, respectively, there holds, with ν = max{k, l}: ( ) ν x ν j, y j = 0 j=1

26 Putting it all together K, B and R as above, assume K invertible, R > 0 If ( ) holds whenever λ 0, λ 1 0 are both eigenvalues of K, then: there is an invertible block Toeplitz Hermitian matrix Y = T n 1 solving the Stein equation, André Ran and Leonid Lerer 13

27 Putting it all together K, B and R as above, assume K invertible, R > 0 If ( ) holds whenever λ 0, λ 1 0 are both eigenvalues of K, then: there is an invertible block Toeplitz Hermitian matrix Y = T n 1 solving the Stein equation, the solutions of are in 1-1 correspondence to K-invariant subspaces N which are Y -nondegenerate: X N = P NY 1 P N where P N is the projection onto Y N along N André Ran and Leonid Lerer 13

28 K = / , R = I 2 0 1/6 0 0 σ(k) = {2, 1/2, 3, 1/3} There are pairs of eigenvalues symmetrically placed with respect to the unit circle The corresponding eigenvectors are, respectively, x 1 = Condition ( ) is satisfied 0, x 2 = 3 0, x 3 = 1 André Ran and Leonid Lerer , x 4 = 2 0 1

29 Solution to Stein equation The block Toeplitz invertible solution to the Stein equation: Y = 7/ / /10 0 3/2 5/ / /2 0 21/10 André Ran and Leonid Lerer 15

30 Solution to Stein equation The block Toeplitz invertible solution to the Stein equation: Y = 7/ / /10 0 3/2 5/ / /2 0 21/10 14 nontrivial K-invariant subspaces: four one-dimensional subspaces, six two-dimensional ones, and again four three-dimensional ones All of them are Y -nondegenerate André Ran and Leonid Lerer 15

31 Solution to Stein equation The block Toeplitz invertible solution to the Stein equation: Y = 7/ / /10 0 3/2 5/ / /2 0 21/10 14 nontrivial K-invariant subspaces: four one-dimensional subspaces, six two-dimensional ones, and again four three-dimensional ones All of them are Y -nondegenerate So 14 solutions in total André Ran and Leonid Lerer 15

32 Invertible and rank 3 solutions Subspace Solution N = (0) Y 1 = 0 35/ / / /36 45/4 0 15/4 0 N = span {x 1 } 0 35/ /36 15/4 0 5/ / / N = span {x 2 } 0 1/30 0 1/ /10 0 3/10 96/ /11 0 N = span {x 3 } 0 35/ /36 48/ / / / N = span {x 4 } 0 2/33 0 4/ /33 0 8/33 André Ran and Leonid Lerer 16

33 Rank 2 solutions Subspace N = span {x 1, x 3 } N = span {x 2, x 4 } N = span {x 1, x 2 } N = span {x 1, x 4 } N = span {x 2, x 3 } N = span {x 3, x 4 } Solution / / / / /4 0 15/ /30 0 1/10 15/4 0 5/ /10 0 3/10 45/4 0 15/ /33 0 4/33 15/4 0 5/ /33 0 8/33 96/ / /30 0 1/10 48/ / /10 0 3/10 96/ / /33 0 4/33 48/ / /33 0 8/33 André Ran and Leonid Lerer 17

34 Rank 1 solutions Subspace Solution N = span {x 1, x 2, x 3 } 0 1/30 0 1/ /10 0 3/10 45/4 0 15/4 0 N = span {x 1, x 2, x 4 } /4 0 5/ N = span {x 1, x 3, x 4 } 0 2/33 0 4/ /33 0 8/33 96/ /11 0 N = span {x 2, x 3, x 4 } / / N = C André Ran and Leonid Lerer 18

35 Thank you for your attention! André Ran and Leonid Lerer 19

Family Feud Review. Linear Algebra. October 22, 2013

Family Feud Review. Linear Algebra. October 22, 2013 Review Linear Algebra October 22, 2013 Question 1 Let A and B be matrices. If AB is a 4 7 matrix, then determine the dimensions of A and B if A has 19 columns. Answer 1 Answer A is a 4 19 matrix, while

More information

w T 1 w T 2. w T n 0 if i j 1 if i = j

w T 1 w T 2. w T n 0 if i j 1 if i = j Lyapunov Operator Let A F n n be given, and define a linear operator L A : C n n C n n as L A (X) := A X + XA Suppose A is diagonalizable (what follows can be generalized even if this is not possible -

More information

DIAGONALIZATION. In order to see the implications of this definition, let us consider the following example Example 1. Consider the matrix

DIAGONALIZATION. In order to see the implications of this definition, let us consider the following example Example 1. Consider the matrix DIAGONALIZATION Definition We say that a matrix A of size n n is diagonalizable if there is a basis of R n consisting of eigenvectors of A ie if there are n linearly independent vectors v v n such that

More information

Assignment 1 Math 5341 Linear Algebra Review. Give complete answers to each of the following questions. Show all of your work.

Assignment 1 Math 5341 Linear Algebra Review. Give complete answers to each of the following questions. Show all of your work. Assignment 1 Math 5341 Linear Algebra Review Give complete answers to each of the following questions Show all of your work Note: You might struggle with some of these questions, either because it has

More information

1 Linear Algebra Problems

1 Linear Algebra Problems Linear Algebra Problems. Let A be the conjugate transpose of the complex matrix A; i.e., A = A t : A is said to be Hermitian if A = A; real symmetric if A is real and A t = A; skew-hermitian if A = A and

More information

Block companion matrices, discrete-time block diagonal stability and polynomial matrices

Block companion matrices, discrete-time block diagonal stability and polynomial matrices Block companion matrices, discrete-time block diagonal stability and polynomial matrices Harald K. Wimmer Mathematisches Institut Universität Würzburg D-97074 Würzburg Germany October 25, 2008 Abstract

More information

ISOLATED SEMIDEFINITE SOLUTIONS OF THE CONTINUOUS-TIME ALGEBRAIC RICCATI EQUATION

ISOLATED SEMIDEFINITE SOLUTIONS OF THE CONTINUOUS-TIME ALGEBRAIC RICCATI EQUATION ISOLATED SEMIDEFINITE SOLUTIONS OF THE CONTINUOUS-TIME ALGEBRAIC RICCATI EQUATION Harald K. Wimmer 1 The set of all negative-semidefinite solutions of the CARE A X + XA + XBB X C C = 0 is homeomorphic

More information

Spring 2019 Exam 2 3/27/19 Time Limit: / Problem Points Score. Total: 280

Spring 2019 Exam 2 3/27/19 Time Limit: / Problem Points Score. Total: 280 Math 307 Spring 2019 Exam 2 3/27/19 Time Limit: / Name (Print): Problem Points Score 1 15 2 20 3 35 4 30 5 10 6 20 7 20 8 20 9 20 10 20 11 10 12 10 13 10 14 10 15 10 16 10 17 10 Total: 280 Math 307 Exam

More information

ALGEBRA QUALIFYING EXAM PROBLEMS LINEAR ALGEBRA

ALGEBRA QUALIFYING EXAM PROBLEMS LINEAR ALGEBRA ALGEBRA QUALIFYING EXAM PROBLEMS LINEAR ALGEBRA Kent State University Department of Mathematical Sciences Compiled and Maintained by Donald L. White Version: August 29, 2017 CONTENTS LINEAR ALGEBRA AND

More information

Linear Systems. Class 27. c 2008 Ron Buckmire. TITLE Projection Matrices and Orthogonal Diagonalization CURRENT READING Poole 5.4

Linear Systems. Class 27. c 2008 Ron Buckmire. TITLE Projection Matrices and Orthogonal Diagonalization CURRENT READING Poole 5.4 Linear Systems Math Spring 8 c 8 Ron Buckmire Fowler 9 MWF 9: am - :5 am http://faculty.oxy.edu/ron/math//8/ Class 7 TITLE Projection Matrices and Orthogonal Diagonalization CURRENT READING Poole 5. Summary

More information

2. Every linear system with the same number of equations as unknowns has a unique solution.

2. Every linear system with the same number of equations as unknowns has a unique solution. 1. For matrices A, B, C, A + B = A + C if and only if A = B. 2. Every linear system with the same number of equations as unknowns has a unique solution. 3. Every linear system with the same number of equations

More information

(a) II and III (b) I (c) I and III (d) I and II and III (e) None are true.

(a) II and III (b) I (c) I and III (d) I and II and III (e) None are true. 1 Which of the following statements is always true? I The null space of an m n matrix is a subspace of R m II If the set B = {v 1,, v n } spans a vector space V and dimv = n, then B is a basis for V III

More information

PRACTICE FINAL EXAM. why. If they are dependent, exhibit a linear dependence relation among them.

PRACTICE FINAL EXAM. why. If they are dependent, exhibit a linear dependence relation among them. Prof A Suciu MTH U37 LINEAR ALGEBRA Spring 2005 PRACTICE FINAL EXAM Are the following vectors independent or dependent? If they are independent, say why If they are dependent, exhibit a linear dependence

More information

spring, math 204 (mitchell) list of theorems 1 Linear Systems Linear Transformations Matrix Algebra

spring, math 204 (mitchell) list of theorems 1 Linear Systems Linear Transformations Matrix Algebra spring, 2016. math 204 (mitchell) list of theorems 1 Linear Systems THEOREM 1.0.1 (Theorem 1.1). Uniqueness of Reduced Row-Echelon Form THEOREM 1.0.2 (Theorem 1.2). Existence and Uniqueness Theorem THEOREM

More information

YORK UNIVERSITY. Faculty of Science Department of Mathematics and Statistics MATH M Test #2 Solutions

YORK UNIVERSITY. Faculty of Science Department of Mathematics and Statistics MATH M Test #2 Solutions YORK UNIVERSITY Faculty of Science Department of Mathematics and Statistics MATH 3. M Test # Solutions. (8 pts) For each statement indicate whether it is always TRUE or sometimes FALSE. Note: For this

More information

Matrix Mathematics. Theory, Facts, and Formulas with Application to Linear Systems Theory. Dennis S. Bernstein

Matrix Mathematics. Theory, Facts, and Formulas with Application to Linear Systems Theory. Dennis S. Bernstein Matrix Mathematics Theory, Facts, and Formulas with Application to Linear Systems Theory Dennis S. Bernstein PRINCETON UNIVERSITY PRESS PRINCETON AND OXFORD Contents Special Symbols xv Conventions, Notation,

More information

Chapter One. Introduction

Chapter One. Introduction Chapter One Introduction Besides the introduction, front matter, back matter, and Appendix (Chapter 15), the book consists of two parts. The first part comprises Chapters 2 7. Here, fundamental properties

More information

5.) For each of the given sets of vectors, determine whether or not the set spans R 3. Give reasons for your answers.

5.) For each of the given sets of vectors, determine whether or not the set spans R 3. Give reasons for your answers. Linear Algebra - Test File - Spring Test # For problems - consider the following system of equations. x + y - z = x + y + 4z = x + y + 6z =.) Solve the system without using your calculator..) Find the

More information

Definite versus Indefinite Linear Algebra. Christian Mehl Institut für Mathematik TU Berlin Germany. 10th SIAM Conference on Applied Linear Algebra

Definite versus Indefinite Linear Algebra. Christian Mehl Institut für Mathematik TU Berlin Germany. 10th SIAM Conference on Applied Linear Algebra Definite versus Indefinite Linear Algebra Christian Mehl Institut für Mathematik TU Berlin Germany 10th SIAM Conference on Applied Linear Algebra Monterey Bay Seaside, October 26-29, 2009 Indefinite Linear

More information

1. What is the determinant of the following matrix? a 1 a 2 4a 3 2a 2 b 1 b 2 4b 3 2b c 1. = 4, then det

1. What is the determinant of the following matrix? a 1 a 2 4a 3 2a 2 b 1 b 2 4b 3 2b c 1. = 4, then det What is the determinant of the following matrix? 3 4 3 4 3 4 4 3 A 0 B 8 C 55 D 0 E 60 If det a a a 3 b b b 3 c c c 3 = 4, then det a a 4a 3 a b b 4b 3 b c c c 3 c = A 8 B 6 C 4 D E 3 Let A be an n n matrix

More information

Announcements Wednesday, November 01

Announcements Wednesday, November 01 Announcements Wednesday, November 01 WeBWorK 3.1, 3.2 are due today at 11:59pm. The quiz on Friday covers 3.1, 3.2. My office is Skiles 244. Rabinoffice hours are Monday, 1 3pm and Tuesday, 9 11am. Section

More information

Jordan normal form notes (version date: 11/21/07)

Jordan normal form notes (version date: 11/21/07) Jordan normal form notes (version date: /2/7) If A has an eigenbasis {u,, u n }, ie a basis made up of eigenvectors, so that Au j = λ j u j, then A is diagonal with respect to that basis To see this, let

More information

Hamiltonian Matrices and the Algebraic Riccati Equation. Seminar presentation

Hamiltonian Matrices and the Algebraic Riccati Equation. Seminar presentation Hamiltonian Matrices and the Algebraic Riccati Equation Seminar presentation by Piyapong Yuantong 7th December 2009 Technische Universität Chemnitz 1 Hamiltonian matrices We start by introducing the square

More information

GRE Subject test preparation Spring 2016 Topic: Abstract Algebra, Linear Algebra, Number Theory.

GRE Subject test preparation Spring 2016 Topic: Abstract Algebra, Linear Algebra, Number Theory. GRE Subject test preparation Spring 2016 Topic: Abstract Algebra, Linear Algebra, Number Theory. Linear Algebra Standard matrix manipulation to compute the kernel, intersection of subspaces, column spaces,

More information

MATH 2331 Linear Algebra. Section 2.1 Matrix Operations. Definition: A : m n, B : n p. Example: Compute AB, if possible.

MATH 2331 Linear Algebra. Section 2.1 Matrix Operations. Definition: A : m n, B : n p. Example: Compute AB, if possible. MATH 2331 Linear Algebra Section 2.1 Matrix Operations Definition: A : m n, B : n p ( 1 2 p ) ( 1 2 p ) AB = A b b b = Ab Ab Ab Example: Compute AB, if possible. 1 Row-column rule: i-j-th entry of AB:

More information

The Jordan Canonical Form

The Jordan Canonical Form The Jordan Canonical Form The Jordan canonical form describes the structure of an arbitrary linear transformation on a finite-dimensional vector space over an algebraically closed field. Here we develop

More information

Solutions to Final Exam

Solutions to Final Exam Solutions to Final Exam. Let A be a 3 5 matrix. Let b be a nonzero 5-vector. Assume that the nullity of A is. (a) What is the rank of A? 3 (b) Are the rows of A linearly independent? (c) Are the columns

More information

YORK UNIVERSITY. Faculty of Science Department of Mathematics and Statistics MATH M Test #1. July 11, 2013 Solutions

YORK UNIVERSITY. Faculty of Science Department of Mathematics and Statistics MATH M Test #1. July 11, 2013 Solutions YORK UNIVERSITY Faculty of Science Department of Mathematics and Statistics MATH 222 3. M Test # July, 23 Solutions. For each statement indicate whether it is always TRUE or sometimes FALSE. Note: For

More information

Problem Set (T) If A is an m n matrix, B is an n p matrix and D is a p s matrix, then show

Problem Set (T) If A is an m n matrix, B is an n p matrix and D is a p s matrix, then show MTH 0: Linear Algebra Department of Mathematics and Statistics Indian Institute of Technology - Kanpur Problem Set Problems marked (T) are for discussions in Tutorial sessions (T) If A is an m n matrix,

More information

The norms can also be characterized in terms of Riccati inequalities.

The norms can also be characterized in terms of Riccati inequalities. 9 Analysis of stability and H norms Consider the causal, linear, time-invariant system ẋ(t = Ax(t + Bu(t y(t = Cx(t Denote the transfer function G(s := C (si A 1 B. Theorem 85 The following statements

More information

The symmetric linear matrix equation

The symmetric linear matrix equation Electronic Journal of Linear Algebra Volume 9 Volume 9 (00) Article 8 00 The symmetric linear matrix equation Andre CM Ran Martine CB Reurings mcreurin@csvunl Follow this and additional works at: http://repositoryuwyoedu/ela

More information

Study Guide for Linear Algebra Exam 2

Study Guide for Linear Algebra Exam 2 Study Guide for Linear Algebra Exam 2 Term Vector Space Definition A Vector Space is a nonempty set V of objects, on which are defined two operations, called addition and multiplication by scalars (real

More information

ELA

ELA RANGES OF SYLVESTER MAPS AND A MNMAL RANK PROBLEM ANDRE CM RAN AND LEBA RODMAN Abstract t is proved that the range of a Sylvester map defined by two matrices of sizes p p and q q, respectively, plus matrices

More information

MATH 20F: LINEAR ALGEBRA LECTURE B00 (T. KEMP)

MATH 20F: LINEAR ALGEBRA LECTURE B00 (T. KEMP) MATH 20F: LINEAR ALGEBRA LECTURE B00 (T KEMP) Definition 01 If T (x) = Ax is a linear transformation from R n to R m then Nul (T ) = {x R n : T (x) = 0} = Nul (A) Ran (T ) = {Ax R m : x R n } = {b R m

More information

Conceptual Questions for Review

Conceptual Questions for Review Conceptual Questions for Review Chapter 1 1.1 Which vectors are linear combinations of v = (3, 1) and w = (4, 3)? 1.2 Compare the dot product of v = (3, 1) and w = (4, 3) to the product of their lengths.

More information

235 Final exam review questions

235 Final exam review questions 5 Final exam review questions Paul Hacking December 4, 0 () Let A be an n n matrix and T : R n R n, T (x) = Ax the linear transformation with matrix A. What does it mean to say that a vector v R n is an

More information

Contents. Preface for the Instructor. Preface for the Student. xvii. Acknowledgments. 1 Vector Spaces 1 1.A R n and C n 2

Contents. Preface for the Instructor. Preface for the Student. xvii. Acknowledgments. 1 Vector Spaces 1 1.A R n and C n 2 Contents Preface for the Instructor xi Preface for the Student xv Acknowledgments xvii 1 Vector Spaces 1 1.A R n and C n 2 Complex Numbers 2 Lists 5 F n 6 Digression on Fields 10 Exercises 1.A 11 1.B Definition

More information

The Kalman-Yakubovich-Popov Lemma for Differential-Algebraic Equations with Applications

The Kalman-Yakubovich-Popov Lemma for Differential-Algebraic Equations with Applications MAX PLANCK INSTITUTE Elgersburg Workshop Elgersburg February 11-14, 2013 The Kalman-Yakubovich-Popov Lemma for Differential-Algebraic Equations with Applications Timo Reis 1 Matthias Voigt 2 1 Department

More information

MATH 304 Linear Algebra Lecture 20: The Gram-Schmidt process (continued). Eigenvalues and eigenvectors.

MATH 304 Linear Algebra Lecture 20: The Gram-Schmidt process (continued). Eigenvalues and eigenvectors. MATH 304 Linear Algebra Lecture 20: The Gram-Schmidt process (continued). Eigenvalues and eigenvectors. Orthogonal sets Let V be a vector space with an inner product. Definition. Nonzero vectors v 1,v

More information

Properties of Linear Transformations from R n to R m

Properties of Linear Transformations from R n to R m Properties of Linear Transformations from R n to R m MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 2015 Topic Overview Relationship between the properties of a matrix transformation

More information

Criteria for Determining If A Subset is a Subspace

Criteria for Determining If A Subset is a Subspace These notes closely follow the presentation of the material given in David C. Lay s textbook Linear Algebra and its Applications (3rd edition). These notes are intended primarily for in-class presentation

More information

MATH 54 QUIZ I, KYLE MILLER MARCH 1, 2016, 40 MINUTES (5 PAGES) Problem Number Total

MATH 54 QUIZ I, KYLE MILLER MARCH 1, 2016, 40 MINUTES (5 PAGES) Problem Number Total MATH 54 QUIZ I, KYLE MILLER MARCH, 206, 40 MINUTES (5 PAGES) Problem Number 2 3 4 Total Score YOUR NAME: SOLUTIONS No calculators, no references, no cheat sheets. Answers without justification will receive

More information

MAT Linear Algebra Collection of sample exams

MAT Linear Algebra Collection of sample exams MAT 342 - Linear Algebra Collection of sample exams A-x. (0 pts Give the precise definition of the row echelon form. 2. ( 0 pts After performing row reductions on the augmented matrix for a certain system

More information

Eigenvalue perturbation theory of structured real matrices and their sign characteristics under generic structured rank-one perturbations

Eigenvalue perturbation theory of structured real matrices and their sign characteristics under generic structured rank-one perturbations Eigenvalue perturbation theory of structured real matrices and their sign characteristics under generic structured rank-one perturbations Christian Mehl Volker Mehrmann André C. M. Ran Leiba Rodman April

More information

Linear transformations

Linear transformations Linear transformations Samy Tindel Purdue University Differential equations and linear algebra - MA 262 Taken from Differential equations and linear algebra by Goode and Annin Samy T. Linear transformations

More information

I. Multiple Choice Questions (Answer any eight)

I. Multiple Choice Questions (Answer any eight) Name of the student : Roll No : CS65: Linear Algebra and Random Processes Exam - Course Instructor : Prashanth L.A. Date : Sep-24, 27 Duration : 5 minutes INSTRUCTIONS: The test will be evaluated ONLY

More information

TOEPLITZ OPERATORS. Toeplitz studied infinite matrices with NW-SE diagonals constant. f e C :

TOEPLITZ OPERATORS. Toeplitz studied infinite matrices with NW-SE diagonals constant. f e C : TOEPLITZ OPERATORS EFTON PARK 1. Introduction to Toeplitz Operators Otto Toeplitz lived from 1881-1940 in Goettingen, and it was pretty rough there, so he eventually went to Palestine and eventually contracted

More information

Definition (T -invariant subspace) Example. Example

Definition (T -invariant subspace) Example. Example Eigenvalues, Eigenvectors, Similarity, and Diagonalization We now turn our attention to linear transformations of the form T : V V. To better understand the effect of T on the vector space V, we begin

More information

Linear Algebra. Grinshpan

Linear Algebra. Grinshpan Linear Algebra Grinshpan Saturday class, 2/23/9 This lecture involves topics from Sections 3-34 Subspaces associated to a matrix Given an n m matrix A, we have three subspaces associated to it The column

More information

Glossary of Linear Algebra Terms. Prepared by Vince Zaccone For Campus Learning Assistance Services at UCSB

Glossary of Linear Algebra Terms. Prepared by Vince Zaccone For Campus Learning Assistance Services at UCSB Glossary of Linear Algebra Terms Basis (for a subspace) A linearly independent set of vectors that spans the space Basic Variable A variable in a linear system that corresponds to a pivot column in the

More information

MATH 583A REVIEW SESSION #1

MATH 583A REVIEW SESSION #1 MATH 583A REVIEW SESSION #1 BOJAN DURICKOVIC 1. Vector Spaces Very quick review of the basic linear algebra concepts (see any linear algebra textbook): (finite dimensional) vector space (or linear space),

More information

Section 6.2: THE KERNEL AND RANGE OF A LINEAR TRANSFORMATIONS

Section 6.2: THE KERNEL AND RANGE OF A LINEAR TRANSFORMATIONS Section 6.2: THE KERNEL AND RANGE OF A LINEAR TRANSFORMATIONS When you are done with your homework you should be able to Find the kernel of a linear transformation Find a basis for the range, the rank,

More information

MATH 320: PRACTICE PROBLEMS FOR THE FINAL AND SOLUTIONS

MATH 320: PRACTICE PROBLEMS FOR THE FINAL AND SOLUTIONS MATH 320: PRACTICE PROBLEMS FOR THE FINAL AND SOLUTIONS There will be eight problems on the final. The following are sample problems. Problem 1. Let F be the vector space of all real valued functions on

More information

Linear Algebra Practice Problems

Linear Algebra Practice Problems Linear Algebra Practice Problems Page of 7 Linear Algebra Practice Problems These problems cover Chapters 4, 5, 6, and 7 of Elementary Linear Algebra, 6th ed, by Ron Larson and David Falvo (ISBN-3 = 978--68-78376-2,

More information

Linear Algebra Practice Problems

Linear Algebra Practice Problems Linear Algebra Practice Problems Math 24 Calculus III Summer 25, Session II. Determine whether the given set is a vector space. If not, give at least one axiom that is not satisfied. Unless otherwise stated,

More information

J-SPECTRAL FACTORIZATION FOR RATIONAL MATRIX FUNCTIONS WITH ALTERNATIVE REALIZATION

J-SPECTRAL FACTORIZATION FOR RATIONAL MATRIX FUNCTIONS WITH ALTERNATIVE REALIZATION J-SPECTRAL FACTORIZATION FOR RATIONAL MATRIX FUNCTIONS WITH ALTERNATIVE REALIZATION GILBERT J. GROENEWALD AND MARK A. PETERSEN Abstract. In this paper, recent results by Petersen and Ran on the J-spectral

More information

Matrix Theory. A.Holst, V.Ufnarovski

Matrix Theory. A.Holst, V.Ufnarovski Matrix Theory AHolst, VUfnarovski 55 HINTS AND ANSWERS 9 55 Hints and answers There are two different approaches In the first one write A as a block of rows and note that in B = E ij A all rows different

More information

Test 3, Linear Algebra

Test 3, Linear Algebra Test 3, Linear Algebra Dr. Adam Graham-Squire, Fall 2017 Name: I pledge that I have neither given nor received any unauthorized assistance on this exam. (signature) DIRECTIONS 1. Don t panic. 2. Show all

More information

Online Exercises for Linear Algebra XM511

Online Exercises for Linear Algebra XM511 This document lists the online exercises for XM511. The section ( ) numbers refer to the textbook. TYPE I are True/False. Lecture 02 ( 1.1) Online Exercises for Linear Algebra XM511 1) The matrix [3 2

More information

Linear algebra II Tutorial solutions #1 A = x 1

Linear algebra II Tutorial solutions #1 A = x 1 Linear algebra II Tutorial solutions #. Find the eigenvalues and the eigenvectors of the matrix [ ] 5 2 A =. 4 3 Since tra = 8 and deta = 5 8 = 7, the characteristic polynomial is f(λ) = λ 2 (tra)λ+deta

More information

NOTES ON BILINEAR FORMS

NOTES ON BILINEAR FORMS NOTES ON BILINEAR FORMS PARAMESWARAN SANKARAN These notes are intended as a supplement to the talk given by the author at the IMSc Outreach Programme Enriching Collegiate Education-2015. Symmetric bilinear

More information

Solution: a) Let us consider the matrix form of the system, focusing on the augmented matrix: 0 k k + 1. k 2 1 = 0. k = 1

Solution: a) Let us consider the matrix form of the system, focusing on the augmented matrix: 0 k k + 1. k 2 1 = 0. k = 1 Exercise. Given the system of equations 8 < : x + y + z x + y + z k x + k y + z k where k R. a) Study the system in terms of the values of k. b) Find the solutions when k, using the reduced row echelon

More information

18.06 Problem Set 2 Solution

18.06 Problem Set 2 Solution 18.06 Problem Set 2 Solution Total: 100 points Section 2.5. Problem 24: Use Gauss-Jordan elimination on [U I] to find the upper triangular U 1 : 1 a b 1 0 UU 1 = I 0 1 c x 1 x 2 x 3 = 0 1 0. 0 0 1 0 0

More information

Stability and Inertia Theorems for Generalized Lyapunov Equations

Stability and Inertia Theorems for Generalized Lyapunov Equations Published in Linear Algebra and its Applications, 355(1-3, 2002, pp. 297-314. Stability and Inertia Theorems for Generalized Lyapunov Equations Tatjana Stykel Abstract We study generalized Lyapunov equations

More information

ACM 104. Homework Set 4 Solutions February 14, 2001

ACM 104. Homework Set 4 Solutions February 14, 2001 ACM 04 Homework Set 4 Solutions February 4, 00 Franklin Chapter, Problem 4, page 55 Suppose that we feel that some observations are more important or reliable than others Redefine the function to be minimized

More information

Announcements Wednesday, November 01

Announcements Wednesday, November 01 Announcements Wednesday, November 01 WeBWorK 3.1, 3.2 are due today at 11:59pm. The quiz on Friday covers 3.1, 3.2. My office is Skiles 244. Rabinoffice hours are Monday, 1 3pm and Tuesday, 9 11am. Section

More information

Spectral theory for compact operators on Banach spaces

Spectral theory for compact operators on Banach spaces 68 Chapter 9 Spectral theory for compact operators on Banach spaces Recall that a subset S of a metric space X is precompact if its closure is compact, or equivalently every sequence contains a Cauchy

More information

LINEAR ALGEBRA 1, 2012-I PARTIAL EXAM 3 SOLUTIONS TO PRACTICE PROBLEMS

LINEAR ALGEBRA 1, 2012-I PARTIAL EXAM 3 SOLUTIONS TO PRACTICE PROBLEMS LINEAR ALGEBRA, -I PARTIAL EXAM SOLUTIONS TO PRACTICE PROBLEMS Problem (a) For each of the two matrices below, (i) determine whether it is diagonalizable, (ii) determine whether it is orthogonally diagonalizable,

More information

The Jordan Normal Form and its Applications

The Jordan Normal Form and its Applications The and its Applications Jeremy IMPACT Brigham Young University A square matrix A is a linear operator on {R, C} n. A is diagonalizable if and only if it has n linearly independent eigenvectors. What happens

More information

MATHEMATICS 217 NOTES

MATHEMATICS 217 NOTES MATHEMATICS 27 NOTES PART I THE JORDAN CANONICAL FORM The characteristic polynomial of an n n matrix A is the polynomial χ A (λ) = det(λi A), a monic polynomial of degree n; a monic polynomial in the variable

More information

1 Invariant subspaces

1 Invariant subspaces MATH 2040 Linear Algebra II Lecture Notes by Martin Li Lecture 8 Eigenvalues, eigenvectors and invariant subspaces 1 In previous lectures we have studied linear maps T : V W from a vector space V to another

More information

Remark By definition, an eigenvector must be a nonzero vector, but eigenvalue could be zero.

Remark By definition, an eigenvector must be a nonzero vector, but eigenvalue could be zero. Sec 6 Eigenvalues and Eigenvectors Definition An eigenvector of an n n matrix A is a nonzero vector x such that A x λ x for some scalar λ A scalar λ is called an eigenvalue of A if there is a nontrivial

More information

Iterative methods: introduction and background. Vrije Universiteit Amsterdam

Iterative methods: introduction and background. Vrije Universiteit Amsterdam Iterative methods: introduction and background André Ran Vrije Universiteit Amsterdam 1 Consider the set of linear equations (I + αt)u = v, where v is given, α > 0 and T is the symmetric tridiagonal Toeplitz

More information

Chap 3. Linear Algebra

Chap 3. Linear Algebra Chap 3. Linear Algebra Outlines 1. Introduction 2. Basis, Representation, and Orthonormalization 3. Linear Algebraic Equations 4. Similarity Transformation 5. Diagonal Form and Jordan Form 6. Functions

More information

ME 234, Lyapunov and Riccati Problems. 1. This problem is to recall some facts and formulae you already know. e Aτ BB e A τ dτ

ME 234, Lyapunov and Riccati Problems. 1. This problem is to recall some facts and formulae you already know. e Aτ BB e A τ dτ ME 234, Lyapunov and Riccati Problems. This problem is to recall some facts and formulae you already know. (a) Let A and B be matrices of appropriate dimension. Show that (A, B) is controllable if and

More information

Bare-bones outline of eigenvalue theory and the Jordan canonical form

Bare-bones outline of eigenvalue theory and the Jordan canonical form Bare-bones outline of eigenvalue theory and the Jordan canonical form April 3, 2007 N.B.: You should also consult the text/class notes for worked examples. Let F be a field, let V be a finite-dimensional

More information

Math 1553, Introduction to Linear Algebra

Math 1553, Introduction to Linear Algebra Learning goals articulate what students are expected to be able to do in a course that can be measured. This course has course-level learning goals that pertain to the entire course, and section-level

More information

Eigenpairs and Similarity Transformations

Eigenpairs and Similarity Transformations CHAPTER 5 Eigenpairs and Similarity Transformations Exercise 56: Characteristic polynomial of transpose we have that A T ( )=det(a T I)=det((A I) T )=det(a I) = A ( ) A ( ) = det(a I) =det(a T I) =det(a

More information

LINEAR ALGEBRA KNOWLEDGE SURVEY

LINEAR ALGEBRA KNOWLEDGE SURVEY LINEAR ALGEBRA KNOWLEDGE SURVEY Instructions: This is a Knowledge Survey. For this assignment, I am only interested in your level of confidence about your ability to do the tasks on the following pages.

More information

linearly indepedent eigenvectors as the multiplicity of the root, but in general there may be no more than one. For further discussion, assume matrice

linearly indepedent eigenvectors as the multiplicity of the root, but in general there may be no more than one. For further discussion, assume matrice 3. Eigenvalues and Eigenvectors, Spectral Representation 3.. Eigenvalues and Eigenvectors A vector ' is eigenvector of a matrix K, if K' is parallel to ' and ' 6, i.e., K' k' k is the eigenvalue. If is

More information

Elementary Linear Algebra Review for Exam 2 Exam is Monday, November 16th.

Elementary Linear Algebra Review for Exam 2 Exam is Monday, November 16th. Elementary Linear Algebra Review for Exam Exam is Monday, November 6th. The exam will cover sections:.4,..4, 5. 5., 7., the class notes on Markov Models. You must be able to do each of the following. Section.4

More information

Analysis Preliminary Exam Workshop: Hilbert Spaces

Analysis Preliminary Exam Workshop: Hilbert Spaces Analysis Preliminary Exam Workshop: Hilbert Spaces 1. Hilbert spaces A Hilbert space H is a complete real or complex inner product space. Consider complex Hilbert spaces for definiteness. If (, ) : H H

More information

EE/ACM Applications of Convex Optimization in Signal Processing and Communications Lecture 4

EE/ACM Applications of Convex Optimization in Signal Processing and Communications Lecture 4 EE/ACM 150 - Applications of Convex Optimization in Signal Processing and Communications Lecture 4 Andre Tkacenko Signal Processing Research Group Jet Propulsion Laboratory April 12, 2012 Andre Tkacenko

More information

33A Linear Algebra and Applications: Practice Final Exam - Solutions

33A Linear Algebra and Applications: Practice Final Exam - Solutions 33A Linear Algebra and Applications: Practice Final Eam - Solutions Question Consider a plane V in R 3 with a basis given by v = and v =. Suppose, y are both in V. (a) [3 points] If [ ] B =, find. (b)

More information

Final A. Problem Points Score Total 100. Math115A Nadja Hempel 03/23/2017

Final A. Problem Points Score Total 100. Math115A Nadja Hempel 03/23/2017 Final A Math115A Nadja Hempel 03/23/2017 nadja@math.ucla.edu Name: UID: Problem Points Score 1 10 2 20 3 5 4 5 5 9 6 5 7 7 8 13 9 16 10 10 Total 100 1 2 Exercise 1. (10pt) Let T : V V be a linear transformation.

More information

NORMS ON SPACE OF MATRICES

NORMS ON SPACE OF MATRICES NORMS ON SPACE OF MATRICES. Operator Norms on Space of linear maps Let A be an n n real matrix and x 0 be a vector in R n. We would like to use the Picard iteration method to solve for the following system

More information

Perturbation theory for eigenvalues of Hermitian pencils. Christian Mehl Institut für Mathematik TU Berlin, Germany. 9th Elgersburg Workshop

Perturbation theory for eigenvalues of Hermitian pencils. Christian Mehl Institut für Mathematik TU Berlin, Germany. 9th Elgersburg Workshop Perturbation theory for eigenvalues of Hermitian pencils Christian Mehl Institut für Mathematik TU Berlin, Germany 9th Elgersburg Workshop Elgersburg, March 3, 2014 joint work with Shreemayee Bora, Michael

More information

Iterative Solution of a Matrix Riccati Equation Arising in Stochastic Control

Iterative Solution of a Matrix Riccati Equation Arising in Stochastic Control Iterative Solution of a Matrix Riccati Equation Arising in Stochastic Control Chun-Hua Guo Dedicated to Peter Lancaster on the occasion of his 70th birthday We consider iterative methods for finding the

More information

Department of Mathematics Technion - Israel Institute of Technology Haifa 32000, Israel

Department of Mathematics Technion - Israel Institute of Technology Haifa 32000, Israel Linear Transformations Which Preserve or Decrease Rank Raphael Loewy Department of Mathematics Technion - Israel Institute of Technology Haifa 32000, Israel Submitted by Graciano de Oliveira ABSTRACT We

More information

LINEAR ALGEBRA BOOT CAMP WEEK 1: THE BASICS

LINEAR ALGEBRA BOOT CAMP WEEK 1: THE BASICS LINEAR ALGEBRA BOOT CAMP WEEK 1: THE BASICS Unless otherwise stated, all vector spaces in this worksheet are finite dimensional and the scalar field F has characteristic zero. The following are facts (in

More information

On the game-theoretic value of a linear transformation on a symmetric cone

On the game-theoretic value of a linear transformation on a symmetric cone On the game-theoretic value of a linear transformation ona symmetric cone p. 1/25 On the game-theoretic value of a linear transformation on a symmetric cone M. Seetharama Gowda Department of Mathematics

More information

MATH36001 Generalized Inverses and the SVD 2015

MATH36001 Generalized Inverses and the SVD 2015 MATH36001 Generalized Inverses and the SVD 201 1 Generalized Inverses of Matrices A matrix has an inverse only if it is square and nonsingular. However there are theoretical and practical applications

More information

Linear Algebra. Rekha Santhanam. April 3, Johns Hopkins Univ. Rekha Santhanam (Johns Hopkins Univ.) Linear Algebra April 3, / 7

Linear Algebra. Rekha Santhanam. April 3, Johns Hopkins Univ. Rekha Santhanam (Johns Hopkins Univ.) Linear Algebra April 3, / 7 Linear Algebra Rekha Santhanam Johns Hopkins Univ. April 3, 2009 Rekha Santhanam (Johns Hopkins Univ.) Linear Algebra April 3, 2009 1 / 7 Dynamical Systems Denote owl and wood rat populations at time k

More information

1. In this problem, if the statement is always true, circle T; otherwise, circle F.

1. In this problem, if the statement is always true, circle T; otherwise, circle F. Math 1553, Extra Practice for Midterm 3 (sections 45-65) Solutions 1 In this problem, if the statement is always true, circle T; otherwise, circle F a) T F If A is a square matrix and the homogeneous equation

More information

MATH 240 Spring, Chapter 1: Linear Equations and Matrices

MATH 240 Spring, Chapter 1: Linear Equations and Matrices MATH 240 Spring, 2006 Chapter Summaries for Kolman / Hill, Elementary Linear Algebra, 8th Ed. Sections 1.1 1.6, 2.1 2.2, 3.2 3.8, 4.3 4.5, 5.1 5.3, 5.5, 6.1 6.5, 7.1 7.2, 7.4 DEFINITIONS Chapter 1: Linear

More information

Positive entries of stable matrices

Positive entries of stable matrices Positive entries of stable matrices Shmuel Friedland Department of Mathematics, Statistics and Computer Science, University of Illinois at Chicago Chicago, Illinois 60607-7045, USA Daniel Hershkowitz,

More information

Vector Spaces and Linear Transformations

Vector Spaces and Linear Transformations Vector Spaces and Linear Transformations Wei Shi, Jinan University 2017.11.1 1 / 18 Definition (Field) A field F = {F, +, } is an algebraic structure formed by a set F, and closed under binary operations

More information

LECTURE 7. k=1 (, v k)u k. Moreover r

LECTURE 7. k=1 (, v k)u k. Moreover r LECTURE 7 Finite rank operators Definition. T is said to be of rank r (r < ) if dim T(H) = r. The class of operators of rank r is denoted by K r and K := r K r. Theorem 1. T K r iff T K r. Proof. Let T

More information

A proof of the Jordan normal form theorem

A proof of the Jordan normal form theorem A proof of the Jordan normal form theorem Jordan normal form theorem states that any matrix is similar to a blockdiagonal matrix with Jordan blocks on the diagonal. To prove it, we first reformulate it

More information

Chapter 2 Notes, Linear Algebra 5e Lay

Chapter 2 Notes, Linear Algebra 5e Lay Contents.1 Operations with Matrices..................................1.1 Addition and Subtraction.............................1. Multiplication by a scalar............................ 3.1.3 Multiplication

More information