Discrete Riccati equations and block Toeplitz matrices

Similar documents
Family Feud Review. Linear Algebra. October 22, 2013

w T 1 w T 2. w T n 0 if i j 1 if i = j

DIAGONALIZATION. In order to see the implications of this definition, let us consider the following example Example 1. Consider the matrix

Assignment 1 Math 5341 Linear Algebra Review. Give complete answers to each of the following questions. Show all of your work.

1 Linear Algebra Problems

Block companion matrices, discrete-time block diagonal stability and polynomial matrices

ISOLATED SEMIDEFINITE SOLUTIONS OF THE CONTINUOUS-TIME ALGEBRAIC RICCATI EQUATION

Spring 2019 Exam 2 3/27/19 Time Limit: / Problem Points Score. Total: 280

ALGEBRA QUALIFYING EXAM PROBLEMS LINEAR ALGEBRA

Linear Systems. Class 27. c 2008 Ron Buckmire. TITLE Projection Matrices and Orthogonal Diagonalization CURRENT READING Poole 5.4

2. Every linear system with the same number of equations as unknowns has a unique solution.

(a) II and III (b) I (c) I and III (d) I and II and III (e) None are true.

PRACTICE FINAL EXAM. why. If they are dependent, exhibit a linear dependence relation among them.

spring, math 204 (mitchell) list of theorems 1 Linear Systems Linear Transformations Matrix Algebra

YORK UNIVERSITY. Faculty of Science Department of Mathematics and Statistics MATH M Test #2 Solutions

Matrix Mathematics. Theory, Facts, and Formulas with Application to Linear Systems Theory. Dennis S. Bernstein

Chapter One. Introduction

5.) For each of the given sets of vectors, determine whether or not the set spans R 3. Give reasons for your answers.

Definite versus Indefinite Linear Algebra. Christian Mehl Institut für Mathematik TU Berlin Germany. 10th SIAM Conference on Applied Linear Algebra

1. What is the determinant of the following matrix? a 1 a 2 4a 3 2a 2 b 1 b 2 4b 3 2b c 1. = 4, then det

Announcements Wednesday, November 01

Jordan normal form notes (version date: 11/21/07)

Hamiltonian Matrices and the Algebraic Riccati Equation. Seminar presentation

GRE Subject test preparation Spring 2016 Topic: Abstract Algebra, Linear Algebra, Number Theory.

MATH 2331 Linear Algebra. Section 2.1 Matrix Operations. Definition: A : m n, B : n p. Example: Compute AB, if possible.

The Jordan Canonical Form

Solutions to Final Exam

YORK UNIVERSITY. Faculty of Science Department of Mathematics and Statistics MATH M Test #1. July 11, 2013 Solutions

Problem Set (T) If A is an m n matrix, B is an n p matrix and D is a p s matrix, then show

The norms can also be characterized in terms of Riccati inequalities.

The symmetric linear matrix equation

Study Guide for Linear Algebra Exam 2

ELA

MATH 20F: LINEAR ALGEBRA LECTURE B00 (T. KEMP)

Conceptual Questions for Review

235 Final exam review questions

Contents. Preface for the Instructor. Preface for the Student. xvii. Acknowledgments. 1 Vector Spaces 1 1.A R n and C n 2

The Kalman-Yakubovich-Popov Lemma for Differential-Algebraic Equations with Applications

MATH 304 Linear Algebra Lecture 20: The Gram-Schmidt process (continued). Eigenvalues and eigenvectors.

Properties of Linear Transformations from R n to R m

Criteria for Determining If A Subset is a Subspace

MATH 54 QUIZ I, KYLE MILLER MARCH 1, 2016, 40 MINUTES (5 PAGES) Problem Number Total

MAT Linear Algebra Collection of sample exams

Eigenvalue perturbation theory of structured real matrices and their sign characteristics under generic structured rank-one perturbations

Linear transformations

I. Multiple Choice Questions (Answer any eight)

TOEPLITZ OPERATORS. Toeplitz studied infinite matrices with NW-SE diagonals constant. f e C :

Definition (T -invariant subspace) Example. Example

Linear Algebra. Grinshpan

Glossary of Linear Algebra Terms. Prepared by Vince Zaccone For Campus Learning Assistance Services at UCSB

MATH 583A REVIEW SESSION #1

Section 6.2: THE KERNEL AND RANGE OF A LINEAR TRANSFORMATIONS

MATH 320: PRACTICE PROBLEMS FOR THE FINAL AND SOLUTIONS

Linear Algebra Practice Problems

Linear Algebra Practice Problems

J-SPECTRAL FACTORIZATION FOR RATIONAL MATRIX FUNCTIONS WITH ALTERNATIVE REALIZATION

Matrix Theory. A.Holst, V.Ufnarovski

Test 3, Linear Algebra

Online Exercises for Linear Algebra XM511

Linear algebra II Tutorial solutions #1 A = x 1

NOTES ON BILINEAR FORMS

Solution: a) Let us consider the matrix form of the system, focusing on the augmented matrix: 0 k k + 1. k 2 1 = 0. k = 1

18.06 Problem Set 2 Solution

Stability and Inertia Theorems for Generalized Lyapunov Equations

ACM 104. Homework Set 4 Solutions February 14, 2001

Announcements Wednesday, November 01

Spectral theory for compact operators on Banach spaces

LINEAR ALGEBRA 1, 2012-I PARTIAL EXAM 3 SOLUTIONS TO PRACTICE PROBLEMS

The Jordan Normal Form and its Applications

MATHEMATICS 217 NOTES

1 Invariant subspaces

Remark By definition, an eigenvector must be a nonzero vector, but eigenvalue could be zero.

Iterative methods: introduction and background. Vrije Universiteit Amsterdam

Chap 3. Linear Algebra

ME 234, Lyapunov and Riccati Problems. 1. This problem is to recall some facts and formulae you already know. e Aτ BB e A τ dτ

Bare-bones outline of eigenvalue theory and the Jordan canonical form

Math 1553, Introduction to Linear Algebra

Eigenpairs and Similarity Transformations

LINEAR ALGEBRA KNOWLEDGE SURVEY

linearly indepedent eigenvectors as the multiplicity of the root, but in general there may be no more than one. For further discussion, assume matrice

Elementary Linear Algebra Review for Exam 2 Exam is Monday, November 16th.

Analysis Preliminary Exam Workshop: Hilbert Spaces

EE/ACM Applications of Convex Optimization in Signal Processing and Communications Lecture 4

33A Linear Algebra and Applications: Practice Final Exam - Solutions

Final A. Problem Points Score Total 100. Math115A Nadja Hempel 03/23/2017

NORMS ON SPACE OF MATRICES

Perturbation theory for eigenvalues of Hermitian pencils. Christian Mehl Institut für Mathematik TU Berlin, Germany. 9th Elgersburg Workshop

Iterative Solution of a Matrix Riccati Equation Arising in Stochastic Control

Department of Mathematics Technion - Israel Institute of Technology Haifa 32000, Israel

LINEAR ALGEBRA BOOT CAMP WEEK 1: THE BASICS

On the game-theoretic value of a linear transformation on a symmetric cone

MATH36001 Generalized Inverses and the SVD 2015

Linear Algebra. Rekha Santhanam. April 3, Johns Hopkins Univ. Rekha Santhanam (Johns Hopkins Univ.) Linear Algebra April 3, / 7

1. In this problem, if the statement is always true, circle T; otherwise, circle F.

MATH 240 Spring, Chapter 1: Linear Equations and Matrices

Positive entries of stable matrices

Vector Spaces and Linear Transformations

LECTURE 7. k=1 (, v k)u k. Moreover r

A proof of the Jordan normal form theorem

Chapter 2 Notes, Linear Algebra 5e Lay

Transcription:

Discrete Riccati equations and block Toeplitz matrices André Ran Vrije Universiteit Amsterdam Leonid Lerer Technion-Israel Institute of Technology Haifa André Ran and Leonid Lerer 1

Discrete algebraic Riccati equation X = AXA + Q AXB(R + B XB) 1 B XA Standing assumptions: A is invertible, R is Hermitian and invertible, Q is Hermitian No definitiness conditions on Q and R André Ran and Leonid Lerer 2

Discrete algebraic Riccati equation X = AXA + Q AXB(R + B XB) 1 B XA Standing assumptions: A is invertible, R is Hermitian and invertible, Q is Hermitian No definitiness conditions on Q and R A solution is a Hermitian matrix X for which R + B XB is invertible, and the is satisfied André Ran and Leonid Lerer 2

Discrete algebraic Riccati equation X = AXA + Q AXB(R + B XB) 1 B XA Standing assumptions: A is invertible, R is Hermitian and invertible, Q is Hermitian No definitiness conditions on Q and R A solution is a Hermitian matrix X for which R + B XB is invertible, and the is satisfied Goal: describe the set of all solutions in terms of two given solutions X 1 and X 0, when X 1 X 0 is invertible Second goal: to apply this to an interesting special case André Ran and Leonid Lerer 2

Reduction to the case Q = 0 Let X 0 be a fixed solution and let X be any other solution Denote by A 0 = A AX 0 B(R + B X 0 B) 1 B, and R 0 = R + B X 0 B The latter matrix is invertible by assumption, since X 0 is a solution Then Y = X X 0 satisfies the equation Y = A 0 Y A 0 A 0 Y B(R 0 + B Y B) 1 B Y A 0 So, without loss of generality Q = 0, supposing we know a solution André Ran and Leonid Lerer 3

Reduction to Lyapunov equation Assume that A is invertible, and let X be an invertible solution of : X = AXA AXB(R + B XB) 1 B XA Then Y = X 1 solves the Stein equation Y A Y A = BR 1 B and conversely, if Y is an invertible solution of the Stein equation, then X = Y 1 solves the discrete algebraic Riccati equation above André Ran and Leonid Lerer 4

Reduction to Lyapunov equation Assume that A is invertible, and let X be an invertible solution of : X = AXA AXB(R + B XB) 1 B XA Then Y = X 1 solves the Stein equation Y A Y A = BR 1 B and conversely, if Y is an invertible solution of the Stein equation, then X = Y 1 solves the discrete algebraic Riccati equation above Note: the zero matrix is an obvious solution of the algebraic Riccati equation André Ran and Leonid Lerer 4

Non-invertible solutions X = AXA AXB(R + B XB) 1 B XA X + an invertible solution, A invertible André Ran and Leonid Lerer 5

Non-invertible solutions X = AXA AXB(R + B XB) 1 B XA X + an invertible solution, A invertible Theorem Let N be an A -invariant subspace which is X + -nondegenerate, that is, C r = (X + N) +N Let P N be the projection onto (X + N) along N, and put X N = X + P N Then X N is a Hermitian solution of the algebraic Riccati equation for which kerx N = N André Ran and Leonid Lerer 5

Non-invertible solutions X = AXA AXB(R + B XB) 1 B XA X + an invertible solution, A invertible Theorem Let N be an A -invariant subspace which is X + -nondegenerate, that is, C r = (X + N) +N Let P N be the projection onto (X + N) along N, and put X N = X + P N Then X N is a Hermitian solution of the algebraic Riccati equation for which kerx N = N For converse we need an additional assumption André Ran and Leonid Lerer 5

Description of all solutions A is invertible, so X = AXA AXB(R + B XB) 1 B XA X(A ) 1 = ( A AXB(R + B XB) 1 B ) X Consequently, for any solution X the subspace N = kerx is invariant under A André Ran and Leonid Lerer 6

Description of all solutions A is invertible, so X = AXA AXB(R + B XB) 1 B XA X(A ) 1 = ( A AXB(R + B XB) 1 B ) X Consequently, for any solution X the subspace N = kerx is invariant under A Would like to conclude that for any solution X its kernel is X + -nondegenerate This is true under an extra assumption on A André Ran and Leonid Lerer 6

Main theorem I Theorem Assume that A and (A ) 1 have no common eigenvalues Then, if X solves ker X is X + -nondegenerate There is a one-to-one correspondence between solutions of and subspaces N that are A -invariant and X + -nondegenerate, which is given by X = X + P N, where P N is the projection onto (X + N) along N In particular, there can be only one invertible solution of André Ran and Leonid Lerer 7

Main theorem I Theorem Assume that A and (A ) 1 have no common eigenvalues Then, if X solves ker X is X + -nondegenerate There is a one-to-one correspondence between solutions of and subspaces N that are A -invariant and X + -nondegenerate, which is given by X = X + P N, where P N is the projection onto (X + N) along N In particular, there can be only one invertible solution of Observe that the uniqueness of the solution of the Stein equation is in fact equivalent to A and A 1 having no common eigenvalues André Ran and Leonid Lerer 7

Main theorem II Assume that A and (A ) 1 have no common eigenvalues, and let Y be the unique solution of the Stein equation Y A Y A = BR 1 B Theorem There is a one-to-one correspondence between solutions of and subspaces N that are A -invariant and Y -nondegenerate which is given by X = Y 1 P N, where P N is the projection onto Y N along N André Ran and Leonid Lerer 8

Special case: companion type A = K = K 1 I 0 0 K 2 0 I, B = I K n 0 0 I 0 0 Define X (n) 00 Assume K is invertible = R, X(n) j0 = K jr André Ran and Leonid Lerer 9

Special case: companion type A = K = K 1 I 0 0 K 2 0 I, B = I K n 0 0 I 0 0 Define X (n) 00 Assume K is invertible Stein equation: = R, X(n) j0 = K jr Y K Y K = diag ( ) (X (n) 00 ) 1 0 0 André Ran and Leonid Lerer 9

Special case: companion type A = K = K 1 I 0 0 K 2 0 I, B = I K n 0 0 I 0 0 Define X (n) 00 Assume K is invertible Stein equation: : = R, X(n) j0 = K jr Y K Y K = diag ( ) (X (n) 00 ) 1 0 0 X = KXK KXB(X (n) 00 + B XB) 1 B XK André Ran and Leonid Lerer 9

Connection to block Toeplitz matrices The invertible solution X of the Riccati equation X = KXK KXB(X (n) 00 + B XB) 1 B XK is congruent to the inverse of a block Toeplitz matrix André Ran and Leonid Lerer 10

Connection to block Toeplitz matrices The invertible solution X of the Riccati equation X = KXK KXB(X (n) 00 + B XB) 1 B XK is congruent to the inverse of a block Toeplitz matrix Use Gohberg-Lerer result: André Ran and Leonid Lerer 10

Connection to block Toeplitz matrices The invertible solution X of the Riccati equation X = KXK KXB(X (n) 00 + B XB) 1 B XK is congruent to the inverse of a block Toeplitz matrix Use Gohberg-Lerer result: Y = X 1 = T n 1, where T n is the block Toeplitz matrix given by ( ) T n = K X (n) 00 0 0 X 1 K, André Ran and Leonid Lerer 10

Connection to block Toeplitz matrices The invertible solution X of the Riccati equation X = KXK KXB(X (n) 00 + B XB) 1 B XK is congruent to the inverse of a block Toeplitz matrix Use Gohberg-Lerer result: Y = X 1 = T n 1, where T n is the block Toeplitz matrix given by ( ) T n = K X (n) 00 0 0 X 1 K, where K is given by André Ran and Leonid Lerer 10

Connection to block Toeplitz matrices K = 00 ) 1 0 0 K 1 I 0 0 K 2 0 I I 0 K n 0 0 I (X (n) André Ran and Leonid Lerer 11

Discussion of the extra assumption Gohberg-Lerer: If R = X 00 > 0, K and (K ) 1 are even allowed to have common eigenvalues!!! To ensure existence of an invertible solution to the Stein equation Y K Y K = diag ( ) (X (n) 00 ) 1 0 0 n P(λ) = ( λ n j K j )R 1/2 j=0 André Ran and Leonid Lerer 12

Discussion of the extra assumption Gohberg-Lerer: If R = X 00 > 0, K and (K ) 1 are even allowed to have common eigenvalues!!! To ensure existence of an invertible solution to the Stein equation Y K Y K = diag ( ) (X (n) 00 ) 1 0 0 P(λ) = ( n λ n j K j )R 1/2 André Ran and Leonid Lerer 12 j=0 Theorem[Gohberg-Lerer] The Stein equation has an invertible solution if and only if for every symmetric pair of eigenvalues λ 0, λ 1 0 and for any right Jordan chains x 1,, x k and y 1,, y l of P corresponding to λ 0 and λ 1 0, respectively, there holds, with ν = max{k, l}: ( ) ν x ν j, y j = 0 j=1

Putting it all together K, B and R as above, assume K invertible, R > 0 If ( ) holds whenever λ 0, λ 1 0 are both eigenvalues of K, then: there is an invertible block Toeplitz Hermitian matrix Y = T n 1 solving the Stein equation, André Ran and Leonid Lerer 13

Putting it all together K, B and R as above, assume K invertible, R > 0 If ( ) holds whenever λ 0, λ 1 0 are both eigenvalues of K, then: there is an invertible block Toeplitz Hermitian matrix Y = T n 1 solving the Stein equation, the solutions of are in 1-1 correspondence to K-invariant subspaces N which are Y -nondegenerate: X N = P NY 1 P N where P N is the projection onto Y N along N André Ran and Leonid Lerer 13

K = 5 0 1 0 0 5/6 0 1 6 0 0 0, R = I 2 0 1/6 0 0 σ(k) = {2, 1/2, 3, 1/3} There are pairs of eigenvalues symmetrically placed with respect to the unit circle The corresponding eigenvectors are, respectively, x 1 = 1 0 3 0 Condition ( ) is satisfied 0, x 2 = 3 0, x 3 = 1 André Ran and Leonid Lerer 14 1 0 2 0 0, x 4 = 2 0 1

Solution to Stein equation The block Toeplitz invertible solution to the Stein equation: Y = 7/120 0 5/120 0 0 21/10 0 3/2 5/120 0 7/120 0 0 3/2 0 21/10 André Ran and Leonid Lerer 15

Solution to Stein equation The block Toeplitz invertible solution to the Stein equation: Y = 7/120 0 5/120 0 0 21/10 0 3/2 5/120 0 7/120 0 0 3/2 0 21/10 14 nontrivial K-invariant subspaces: four one-dimensional subspaces, six two-dimensional ones, and again four three-dimensional ones All of them are Y -nondegenerate André Ran and Leonid Lerer 15

Solution to Stein equation The block Toeplitz invertible solution to the Stein equation: Y = 7/120 0 5/120 0 0 21/10 0 3/2 5/120 0 7/120 0 0 3/2 0 21/10 14 nontrivial K-invariant subspaces: four one-dimensional subspaces, six two-dimensional ones, and again four three-dimensional ones All of them are Y -nondegenerate So 14 solutions in total André Ran and Leonid Lerer 15

Invertible and rank 3 solutions Subspace Solution 35 0 25 0 N = (0) Y 1 = 0 35/36 0 25/36 25 0 35 0 0 25/36 0 35/36 45/4 0 15/4 0 N = span {x 1 } 0 35/36 0 25/36 15/4 0 5/4 0 0 25/36 0 35/36 35 0 25 0 N = span {x 2 } 0 1/30 0 1/10 25 0 35 0 0 1/10 0 3/10 96/11 0 48/11 0 N = span {x 3 } 0 35/36 0 25/36 48/11 0 24/11 0 0 25/36 0 35/36 35 0 25 0 N = span {x 4 } 0 2/33 0 4/33 25 0 35 0 0 4/33 0 8/33 André Ran and Leonid Lerer 16

Rank 2 solutions Subspace N = span {x 1, x 3 } N = span {x 2, x 4 } N = span {x 1, x 2 } N = span {x 1, x 4 } N = span {x 2, x 3 } N = span {x 3, x 4 } Solution 0 0 0 0 0 35/36 0 25/36 0 0 0 0 0 25/36 0 35/36 35 0 25 0 0 0 0 0 25 0 35 0 0 0 0 0 45/4 0 15/4 0 0 1/30 0 1/10 15/4 0 5/4 0 0 1/10 0 3/10 45/4 0 15/4 0 0 2/33 0 4/33 15/4 0 5/4 0 0 4/33 0 8/33 96/11 0 48/11 0 0 1/30 0 1/10 48/11 0 24/11 0 0 1/10 0 3/10 96/11 0 48/11 0 0 2/33 0 4/33 48/11 0 24/11 0 0 4/33 0 8/33 André Ran and Leonid Lerer 17

Rank 1 solutions Subspace Solution 0 0 0 0 N = span {x 1, x 2, x 3 } 0 1/30 0 1/10 0 0 0 0 0 1/10 0 3/10 45/4 0 15/4 0 N = span {x 1, x 2, x 4 } 0 0 0 0 15/4 0 5/4 0 0 0 0 0 0 0 0 0 N = span {x 1, x 3, x 4 } 0 2/33 0 4/33 0 0 0 0 0 4/33 0 8/33 96/11 0 48/11 0 N = span {x 2, x 3, x 4 } 0 0 0 0 48/11 0 24/11 0 0 0 0 0 N = C 4 0 4 4 André Ran and Leonid Lerer 18

Thank you for your attention! André Ran and Leonid Lerer 19