Sufficiency Conditions for Finite Escape Times in Systems of Quadratic Differential Equations

Similar documents
Linear Algebra. Linear Equations and Matrices. Copyright 2005, W.R. Winfrey

A note on linear differential equations with periodic coefficients.

OPTIMAL CONTROL AND ESTIMATION

There are six more problems on the next two pages


A SUBSPACE THEOREM FOR ORDINARY LINEAR DIFFERENTIAL EQUATIONS

EE/ACM Applications of Convex Optimization in Signal Processing and Communications Lecture 4

ON IDENTIFICATION OF DYNAMICAL SYSTEM PARAMETERS FROM EXPERIMENTAL DATA

Linear Algebra, part 2 Eigenvalues, eigenvectors and least squares solutions

Time-Invariant Linear Quadratic Regulators Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 2015

Time-Invariant Linear Quadratic Regulators!

CHANGES IN SIGNATURE INDUCED BY THE LYAPUNOV MAPPING 2A X AX + XA*

DS-GA 1002 Lecture notes 0 Fall Linear Algebra. These notes provide a review of basic concepts in linear algebra.

2D-Volterra-Lotka Modeling For 2 Species

Iterative Solution of a Matrix Riccati Equation Arising in Stochastic Control

Image Registration Lecture 2: Vectors and Matrices

Journal of Inequalities in Pure and Applied Mathematics

THE NUMERICAL EVALUATION OF THE MAXIMUM-LIKELIHOOD ESTIMATE OF A SUBSET OF MIXTURE PROPORTIONS*

Exercise Sheet 1.

The Application of the Poincart-Transform to the Lotka-Volterra Model

Econ Slides from Lecture 7

y" + Q(t)y = o, i e /, (l.i)

Review of Basic Concepts in Linear Algebra

INEQUALITIES CONCERNING THE INVERSES OF POSITIVE DEFINITE MATRICES

MATRICES AND MATRIX OPERATIONS

Linearization at equilibrium points

Elementary linear algebra

MATH 240 Spring, Chapter 1: Linear Equations and Matrices

Some New Results on Lyapunov-Type Diagonal Stability

ON DIVISION ALGEBRAS*

GOLDEN SEQUENCES OF MATRICES WITH APPLICATIONS TO FIBONACCI ALGEBRA

Convergence Rate of Nonlinear Switched Systems

Eigenvalues, random walks and Ramanujan graphs

On Linear-Quadratic Control Theory of Implicit Difference Equations

Impulsive Stabilization and Application to a Population Growth Model*

Control of elementary quantum flows Luigi Accardi Centro Vito Volterra, Università di Roma Tor Vergata Via di Tor Vergata, snc Roma, Italy

EIGENVALUES AND EIGENVECTORS 3

GENERAL ARTICLE Realm of Matrices

Research Article Stabilization Analysis and Synthesis of Discrete-Time Descriptor Markov Jump Systems with Partially Unknown Transition Probabilities

Math 4377/6308 Advanced Linear Algebra

Extra Problems for Math 2050 Linear Algebra I

8 Periodic Linear Di erential Equations - Floquet Theory

Algebra II. Paulius Drungilas and Jonas Jankauskas

Inner products and Norms. Inner product of 2 vectors. Inner product of 2 vectors x and y in R n : x 1 y 1 + x 2 y x n y n in R n

Generating Functions of Partitions

The Kalman-Yakubovich-Popov Lemma for Differential-Algebraic Equations with Applications

P = 1 F m(p ) = IP = P I = f(i) = QI = IQ = 1 F m(p ) = Q, so we are done.

Mathematical Theory of Control Systems Design

Matrix Differential Calculus with Applications in Statistics and Econometrics

Basic Concepts in Linear Algebra

Asymptotic behaviour of solutions of third order nonlinear differential equations

Lecture 2: Linear Algebra Review

Introduction. Vectors and Matrices. Vectors [1] Vectors [2]

Stochastic Design Criteria in Linear Models

Lecture Notes in Linear Algebra

MAT Linear Algebra Collection of sample exams

Mathematical Foundations

Appendix A Solving Linear Matrix Inequality (LMI) Problems

Math 60. Rumbos Spring Solutions to Assignment #17

The Solvability Conditions for the Inverse Eigenvalue Problem of Hermitian and Generalized Skew-Hamiltonian Matrices and Its Approximation

Lecture Notes 6: Dynamic Equations Part C: Linear Difference Equation Systems

On the algebraic Riccati equation

Letting be a field, e.g., of the real numbers, the complex numbers, the rational numbers, the rational functions W(s) of a complex variable s, etc.

A CLASS OF SCHUR MULTIPLIERS ON SOME QUASI-BANACH SPACES OF INFINITE MATRICES

arxiv: v1 [cs.ds] 11 Oct 2018

CONVERGENCE PROOF FOR RECURSIVE SOLUTION OF LINEAR-QUADRATIC NASH GAMES FOR QUASI-SINGULARLY PERTURBED SYSTEMS. S. Koskie, D. Skataric and B.

MULTI-AGENT TRACKING OF A HIGH-DIMENSIONAL ACTIVE LEADER WITH SWITCHING TOPOLOGY

SYLLABUS UNDER AUTONOMY MATHEMATICS

Chapter 1. Matrix Algebra

On Lotka-Volterra Evolution Law

An Efficient Algorithm for Deriving Summation Identities from Mutual Recurrences

SAMPLE OF THE STUDY MATERIAL PART OF CHAPTER 1 Introduction to Linear Algebra

Rank-one LMIs and Lyapunov's Inequality. Gjerrit Meinsma 4. Abstract. We describe a new proof of the well-known Lyapunov's matrix inequality about

Linear Algebra Highlights

ON THE "BANG-BANG" CONTROL PROBLEM*

Linear Algebra Massoud Malek

adopt the usual symbols R and C in order to denote the set of real and complex numbers, respectively. The open and closed right half-planes of C are d

Energy of Graphs. Sivaram K. Narayan Central Michigan University. Presented at CMU on October 10, 2015

Characterization of half-radial matrices

There are no Barker arrays having more than two dimensions

-P" -p. and V n = a n + ft\ (1.2)

Glossary of Linear Algebra Terms. Prepared by Vince Zaccone For Campus Learning Assistance Services at UCSB

NORMS ON SPACE OF MATRICES

General Mathematics Vol. 16, No. 1 (2008), A. P. Madrid, C. C. Peña

Robotics. Control Theory. Marc Toussaint U Stuttgart

Sliding Modes in Control and Optimization

Digital Workbook for GRA 6035 Mathematics

K E L LY T H O M P S O N

Definition 2.3. We define addition and multiplication of matrices as follows.

On the Skeel condition number, growth factor and pivoting strategies for Gaussian elimination

MATRIX ALGEBRA. or x = (x 1,..., x n ) R n. y 1 y 2. x 2. x m. y m. y = cos θ 1 = x 1 L x. sin θ 1 = x 2. cos θ 2 = y 1 L y.

Chapter 3. Determinants and Eigenvalues

Subject: Optimal Control Assignment-1 (Related to Lecture notes 1-10)

SOME INEQUALITIES FOR COMMUTATORS OF BOUNDED LINEAR OPERATORS IN HILBERT SPACES. S. S. Dragomir

only nite eigenvalues. This is an extension of earlier results from [2]. Then we concentrate on the Riccati equation appearing in H 2 and linear quadr

Solvability of Linear Matrix Equations in a Symmetric Matrix Variable

REGULAR A-OPTIMAL SPRING BALANCE WEIGHING DESIGNS

Introduction to Matrix Algebra

1. General Vector Spaces

THE SPECTRAL DIAMETER IN BANACH ALGEBRAS

Transcription:

/. Inst. Maths Applies (1977) 19, 377-383 Sufficiency Conditions for Finite Escape Times in Systems of Quadratic Differential Equations W. M. GETZ AND D. H. JACOBSON National Research Institute for Mathematical Sciences, CSIR, P.O. Box 395, Pretoria 0001, Republic of South Africa [Received 12 June 1975 and in revised form 20 April 1976] Sufficient conditions are derived for solutions of a general autonomous system of quadratic ordinary vector differential equations to exhibit finite escape times. These results are extended to a matrix Riccati-type differential equation using Kronecker matrix products and a "stacking operator". Finally, these results are applied to a class of models used extensively in population dynamics. 1. Introduction GENERAL procedures are well-known for analysing the stability properties of systems of non-linear ordinary differential equations. Important among these procedures are: (i) the various Lyapunov-type theorems (Hahn, 1967; Cesari, 1963, chapter 3) and (ii) the analysis of the stability properties of the corresponding variational system, viz. the non-linear system linearized about one of its stationary points (Willems, 1970, chapter 5). Stability results pertaining to specific systems are known for many different types of non-linear differential equations. Often these results are derived by finding a suitable Lyapunov function for the system concerned and accordingly the applicability of the results is limited to that system. However, few explicit results exist for the stability properties of quadratic differential equations, especially since suitable Lyapunov functions for general quadratic systems are difficult to find. The primary reason for this is that the time derivative of a scalar function of even order is odd and it is therefore difficult to comment upon its sign without knowing more about the structure of the solutions of the quadratic differential equations. In this paper we derive sufficiency conditions for solutions of autonomous systems of quadratic differential equations to have a finite escape time. An upper bound for the escape time is also given. Using the Kronecker matrix product and an operator which stacks columns of a matrix into an extended vector, we show that the matrix Riccati-equation that arises in the linear-quadratic regulator problem of optimal control theory, can be rewritten into a format such that our results complement known sufficient conditions of the Kalman-type (Jacobson, 1970). Finally, we demonstrate that the results derived in this paper can be applied to a general class of systems of autonomous quadratic differential equations used to model interacting populations. The Lotka-Volterra model of predator-prey dynamics is a special case of this class. 25 377

378 W. M. GETZ AND D. H. JACOBSON 2. Sufficiency Result In this section we derive sufficient conditions for the solution to the quadratic system x,- = x T AiX+bfx+ci / = 1,..., n x(t 0 ) = x 0 (1) to escape in a finite time, i.e. \\\(t; x 0,? 0 ) -» oo as t -> t e < oo. In (1) the nxn matrices A t are constant and without loss of generality can be assumed to be symmetric. The n-vectors b,- and the scalars c,- are constant. To facilitate a compact notation the following definitions are made. For any constant vector co e W with /th element co,-, define i =1 where X a is the smallest eigenvalue of A a. It is worth noting that X a is real since each Ai was assumed to be symmetric. Further X a > 0 if A m > 0. THEOREM 2.1. Consider the system of equations given in (1). Suppose there exists a vector coe W such that A m > 0 (positive definite). Then the solution of system (1) has a finite escape time t e under the following conditions: (i) for all x 0, whenever A ra < 0; (ii) for x 0 satisfying whenever A a > 0. In case (i) co T x o > - t. ^ / 0 + 2/v' r A;{^2- In case (ii) Proof. Multiplying the ith equation of (1) by co h i = 1,..., n and adding these equations, we have along solutions of (1) that the following equality holds dco T x -r, T ^- = \ T A a x + Kx + c a. (2) A m is assumed positive definite so that we obtain from (2) after completing the square and using the Cauchy-Schwarz inequality, the inequality Since the solution u(t; u(t 0 ), t 0 ) to the scalar equation ^ = kiu 2 + k 2 u + /c 3 u(t 0 ) = co r x 0 (4) where k x = AJco 7 k 2 = a,, 1 / 7 ' 7 '

FINITE ESCAPE TIMES 379 and is a lower bound to w T x, we have that a> T x escapes in a finite time, i.e. x(/; x 0, t o )\\ -» oo, whenever u(t; to r x o, / 0 ) does. By finding the roots of the right hand side of (4) and noting that k Y > 0, conditions (i) and (ii) are derived directly. Also since x(/; x 0, / 0 ) will escape not later than u(t; a T x 0, t 0 ) the upper bound for t e is easily computed from the finite escape time for u(t; r x 0, / 0 ). 3. The Matrix Riccati Equation In this section we apply Theorem 2.1 to the autonomous matrix Riccati equation ~ = Q + PF + F T P-PRP P(t 0 ) = n, (5) where all matrices belong to U nxn and Q, R and II and hence P(t; P o, t 0 ) are taken to be symmetric. The existence of solutions to (5) on [t 0, oo) is an important consideration in the Kalman-Bucy filtering theory and the optimal linear-quadratic control problem where equations of type (5) arise. R is usually assumed to be positive definite. Many sufficient conditions are known for the solution of (5) to exist on [t 0, oo) (Bucy, 1967; Jacobson, 1970; Rodriguez-Canabal, 1970). In particular, if the Kalman conditions (Jacobson, 1970) R > 0, 2 ^ 0 and D ^ 0 (6) hold, a solution to (5) exists on [t 0, oo). The sufficiency results for the solution of (5) to escape in a finite time, as presented below, thus complement known conditions for solutions of (5) to exist and hence the results can be applied to filtering and regulating problems in optimal control. The results of the previous section cannot, however, be directly applied to (5) in its matrix form. To convert (5) into a suitable form for analysis the following mathematical devices must be defined and elementary properties used. (i) The Kronecker product A B of any two matrices A e U mx " and Be U pxq is defined (Nissan, 1968; Bellman, 1970) as a matrix CeU mp * nq whose elements in the (i l)p+1 to ip rows and (J Y)q+1 toy<7 columns are (a tj B), i = 1,..., m, 7=1,..., n. i.e. C =... a mn B J It is easily seen that (A B) T = A T B T and (A B)~ l = ^~ 1 5~ 1 A, Bnon-singular. (ii) For any matrix A e W* n define a stacking operator o(a) as an WH-vector formed by stacking the columns of A under each other, in order, starting with the first; i.e. = (a lu..., a ml ; a l2,..., a m2 ;...; a Xn,...,a mn ) T.

380 W. M. GETZ AND D. H. JACOBSON a is easily seen to be a linear operator from U mxn to U mn, i.e. for A, Be U mx " and ceu. o(cb) = ca(b). (iii) For any matrices A, B and P for which the matrix product APB is defined, it can be shown that (Nissan, 1968) a(apb) = (B T A)a(P). Using OHj") above and the symmetry conditions on P, Q, R and II we can prove the following lemma. LEMMA 3.1. Let We W x " be a given constant symmetric matrix. Then along solutions to (5) the following equality is satisfied T () r (OK(0f:(0 T q (7) where = o{w) P = <P) q = <*(0 ** = [F I+I F]o(W) K = - W R and I is the identity matrix. Proof. We have (as in Theorem 2.1) along solutions to (5) that ^o(w)o(p) = o(wfa(q+pf+f T P-PRP). at Now a(w) T a(prp) = a(w)\l PR)a(P) = a(rpw) T a(p) = a(p) T W Ro(P). Similarly a(pf+f T P) = [F T I+I F T )o(p). Using the above, (7) is easily seen to be true. Comparing equations (7) and (2) we can immediately apply Theorem 2.1 to equation (5) as follows. THEOREM 3.2. The solution P(t; II, t 0 ) of the matrix Riccati equation ~ = Q+PF+F T P-PRP P(t 0 ) = n at where all matrices belong to W x " andp, Q, R (non-singular) and U are symmetric, has a finite escape time if there exists a symmetric matrix We U" x " such that W R > 0 and (i) A(W, F, R,Q)<0 or (ii) A(W, F, R,Q)>0 and, F, R,

where FINITE ESCAPE TIMES 381 A(W, F, R, 0 = -W [ff( W) T (F 1+ I F) T W- 1 R~ 1 (F&I+1 F)a( W) and X > 0 is the smallest eigenvalue of W R. Notes. (a) The n 2 -vector a(p) actually contains n(n +1)/2 independent elements, since by symmetry considerations p it = p J( for all i, j provided i # j. (b) If R > 0, which is the case in the standard linear-quadratic optimal control problem, then W R > 0 whenever - W > 0. In many cases a suitable W may be W = I. (c) Since properties (i), (ii) and (iii) for Kronecker products as stated above are not exclusive to symmetric or even square matrices, Theorem 2.1 can, using the methods of this section, be applied to more general quadratic matrix equations than (5). Example 3.3 The following simple example demonstrates the application of Theorem 3.2 in conjunction with sufficiency results, for example those stated in (6), to an analysis of the existence of solutions of the matrix Riccati equation. In (5) let Pe R 2x2, R = IF = I 2 Q=\l 11 I 12 an d n = where / will denote the nxn identity matrix, i.e. P = -P 2 +P+Q P(t o ) = U.. (8) From conditions (6) we have that P(t; IT, / 0 ) exists on [/ 0, 00) provided Q ^ 0 and n ss 0. Apply Theorem 3.2 by choosing W = / 2. Then - W R = 7 4 => X = 1 I F+F I = 7 4 a(w) T a(w) = 2 a(w) T a(q) = -(q 11 +g 22 ) = -trace Q a(w) T a(u) = -(7i 11 + jr 22 ) = -trace II. Hence A(W,F,R,Q) = 1 + 2 trace Q. Using the results stated in Theorem 3.2 we have that the solution P(t; II, f 0 ) to (8) escapes in a finite time: (i) for all IT, whenever trace Q < \; (ii) for trace II < 1 ^/1 + 2 trace Q whenever trace Q ^ \. We have, from the above analysis, that (a) when Q = 0, P(t; II, / 0 ) exists on [t 0, 00) whenever II ^ 0, and escapes in a finite time whenever trace II < 0; (b) when II = 0, P(t; II, / ) exists on [/ 0, 00) whenever Q^ 0, and escapes in a finite time whenever y/2 trace Q+l-1 < 0 or trace Q < - i, i.e. trace Q < 0.

382 W. M. GETZ AND D. H. JACOBSON Since the stipulation that the trace of a matrix should have a definite sign is much less restrictive than requiring the matrix itself to be definite, the finite escape time conditions in (a) and (b) above are less restrictive in form than the Kalman existence conditions. However, in (ii) above we see that the condition on trace II is dependent on trace Q so that we cannot state conditions on II and Q independently of each other as we can for the Kalman existence conditions applied to equation (8). This restriction in stating sufficiency results for a finite escape time to exist can be minimized by selecting a W (other than /) which will (in some sense) maximize the range of Q's and II's which will satisfy the inequality given in (ii) above. 4. Models in Population Dynamics A mathematical model frequently used to describe the dynamic behaviour of n interacting populations x u x 2,..., x n is given by a system of quadratic differential equations Equation (9) can be written in the format of equation (2) as follows. Let "0... \a ix 0... 0 (9). a u...0 Hence 0...ia in 0 bf = (0,..., 0, e lt 0,.... 0) c=0....0 (O 2 S 2,..., (O n S B ) a> n a m Since c a = 0, condition (ii) of Theorem 2.1 must always hold under the assumption that A m > 0. Then the condition on ra r x 0 becomes o T x 0 > -WA~*K

FINITE ESCAPE TIMES 383 Since A a is symmetric and positive definite and! > 0 is its smallest eigenvalue, we have that l/l a > 0 is the largest eigenvalue of A~ l. Hence it is easily seen that using the Cauchy-Schwarz inequality. Hence and thus oo T x 0 > ^<o T A~ 1 b a> + iy/(a T <o)bl ) A~ 1 bjk a> ^ 0. Note that this analysis applies in general to the condition on co r x o in case (ii) of Theorem 3.2, whenever c a = 0. Using the above forms for A a and b m we can apply Theorem 2.1 to equation (9) to derive a set of sufficient conditions for the solution to (9) to exhibit a finite escape time. 5. Conclusion In this paper we have presented sufficiency conditions for solutions to systems of autonomous quadratic differential equations to exhibit a finite escape time. Trivially, these conditions can be applied to non-autonomous non-linear systems whose solutions are bounded below in some suitable manner by solutions to autonomous quadratic differential equations. A restriction on the application of the results presented in this paper is the requirement that there exists an w e W such that Y<M, > 0. REFERENCES BELLMAN, R. E. 1970 Introduction to matrix analysis, 2nd edn. New York: McGraw-Hill. BUCY, R. S. 1967 /. Comput. Syst. Sci. 1, 349-361. CESARI, L. 1963 Asymptotic behaviour and stability problems in ordinary differential equations, 2nd edn. Berlin, Gottingen, Heidelberg: Springer-Verlag. HAHN, W. 1967 Stability of motion. Berlin, Heidelberg, New York: Springer-Verlag. JACOBSON, D. H. 1970 /. Diff. Equ. 8, 258-263. NISSAN, D. H. 1968 Econometrica 36, 603-604. RODRIGUEZ-CANABAL, J. 1973 Stochastics 1, 129-149. WILLEMS, J. L. 1970 Stability theory of dynamical systems. London: Thomas Nelson & Sons Ltd.