Chapter III. Stability of Linear Systems
|
|
- Isaac Horton
- 5 years ago
- Views:
Transcription
1 1 Chapter III Stability of Linear Systems 1. Stability and state transition matrix 2. Time-varying (non-autonomous) systems 3. Time-invariant systems
2 1 STABILITY AND STATE TRANSITION MATRIX 2 In this chapter, we study the Lyapunov stability of systems described by linear vector differential equations. The results presented here not only enable us to obtain necessary and sufficient conditions for the stability of linear systems, but also pave the way to deriving Lyapunov s linearization method, which is presented in the next chapter. 1 Stability and state transition matrix Consider a system described by the linear vector differential equation ẋ(t) = A(t)x(t), t 0 (1) The system (1) is autonomous is A( ) is constant as a function of time ; otherwise it is non-autonomous. It is clear that 0 is always an equilibrium of the system (1). Further, 0 is an isolated equilibrium if A(t) is nonsingular for some t 0.
3 1 STABILITY AND STATE TRANSITION MATRIX 3 The general solution of (1) is given by x(t) = Φ(t, t 0 )x(t 0 ) (2) where Φ(, ) is the state transition matrix associated with A( ) and is the unique solution of the equation d dt Φ(t, t 0) = A(t)Φ(t, t 0 ), t t 0 0 (3) Φ(t 0, t 0 ) = I, t 0 0 (4) With the aid of this explicit characterization of the solutions of (1), it is possible to derive some useful conditions for the stability of the equilibrium 0. Since these conditions involve the state transition matrix Φ, they are not of much computational value, because in general it is impossible to derive an analytical expression for Φ. Nevertheless, they are of conceptual value, enabling one to understand the mechanisms of stability and instability in linear systems.
4 1 STABILITY AND STATE TRANSITION MATRIX 4 Theorem 1.1. The equilibrium 0 is stable if and only if for each t 0 0 it is true that sup Φ(t, t 0 ) i := m(t 0 ) < (5) t t 0 where i denotes the induced norm of matrix. Proof : Assume that (5) is true, and let ɛ > 0, t 0 0 be specified. If we define δ(ɛ, t 0 ) as ɛ/m(t 0 ), then x(t 0 ) < δ x(t) Φ(t, t 0 ) i x(t 0 ) < m(t 0 )δ = ɛ (6) This shows that the equilibrium 0 is stable. Assume that (5) is false, so that Φ(t, t 0 ) i is an unbounded function of t for some t 0 0. To show that 0 is an unstable equilibrium, let ɛ > 0 be any positive number, and let δ be an arbitrary positive number. It is shown that one can choose an x(t 0 ) in the ball B δ such that the resulting solution x(t) satisfies x(t) ɛ for some t t 0.
5 1 STABILITY AND STATE TRANSITION MATRIX 5 Select a δ 1 in the open interval (0, δ). Since Φ(t, t 0 ) i is unbounded as a function of t, there exists a t t 0 such that Next, select a vector v of norm one such that Φ(t, t 0 ) i > ɛ δ 1 (7) Φ(t, t 0 )v = Φ(t, t 0 ) i (8) This is possible in view of the definition of the induced norm. Finally, let x(t 0 ) = δ 1 v. Then x B δ. Moreover, x(t) = Φ(t, t 0 )x(t 0 ) = δ 1 Φ(t, t 0 )v = δ 1 Φ(t, t 0 ) i > ɛ (9) Hence, the equilibrium 0 is unstable. Remark 1.1. Note that, in the case of linear systems, the instability does indeed imply that some solution trajectories actually blow-up. This is in contrast to the case of nonlinear systems, where instability of 0 can be accompanied by the boundedness of all solutions.
6 1 STABILITY AND STATE TRANSITION MATRIX 6 Necessary and sufficient conditions for uniform stability are given next : Theorem 1.2. The equilibrium 0 is uniformly stable if and only if sup sup Φ(t, t 0 ) i := m 0 < (10) t 0 0 t t 0 Proof : Suppose m 0 is finite, then for any ɛ and any t 0 0, there exists a δ = ɛ/m 0 such that x 0 δ, t 0 0 x(t, t 0, x 0 ) < ɛ, t t 0. Suppose m(t 0 ) is unbounded as a function of t 0. Then at least one component of Φ(, ), say the ij-component, has the property that sup φ ij (t, t 0 ) is unbounded as a function of t 0 (11) t t 0 Let x 0 = e j, the elementary vector. Then (11) implies that the quantity x(t) / x 0 = Φ(t, t 0 )x 0 / x 0 cannot be bounded independent of t 0. Hence, 0 is not uniformly stable.
7 1 STABILITY AND STATE TRANSITION MATRIX 7 The next theorem characterizes uniform asymptotic stability. Theorem 1.3. The equilibrium 0 is (globally) uniformly asymptotically stable if and only if sup sup Φ(t, t 0 ) i := m 0 < (12) t 0 0 t t 0 Φ(t + t 0, t 0 ) i 0 as t, uniformly in t 0 (13) Proof : Assume (12) holds, then 0 is uniformly stable. Also, if (13) holds, then the ratio Φ(t, t 0 )x 0 / x 0 approaches 0 uniformly in t 0 so 0 is uniformly attractive. Hence, 0 is uniformly asymptotically stable. left as an exercice.
8 1 STABILITY AND STATE TRANSITION MATRIX 8 The next theorem shows that, for linear systems, uniform asymptotic stability is equivalent to exponential stability. Theorem 1.4. The equilibrium 0 is uniformly stable if and only if there exist constants m, λ > 0 such that Φ(t, t 0 ) i m exp[ λ(t t 0 )], t t 0 (14) Proof : Assume (14) is satisfied. Then clearly (12) and (13) are also true, whence 0 is uniformly asymptotically stable by Theorem 1.3. Conversely, suppose (12) and (13) are true. Then there exist finite constants µ and T such that Φ(t, t 0 ) i µ, t t 0 0 (15) Φ(t + t 0, t 0 ) i 1/2, t T, t 0 0. (16) In particular, (16) implies that Φ(T + t 0, t 0 ) i 1/2, t 0 0. (17) Now, given any t 0 and any t t 0, pick an integer k such that
9 1 STABILITY AND STATE TRANSITION MATRIX 9 t 0 + kt t t 0 + (k + 1)T. Then Φ(t, t 0 ) = Φ(t, t 0 + kt )Φ(t 0 + kt, t 0 + kt T )... Φ(t 0 + T, t 0 ) (18) Hence Φ(t, t 0 ) i = Φ(t, t 0 + kt ) i Π k j=1 Φ(t 0 + jt, t 0 + jt T ) i µ2 k 2µ2 (t t 0)/T Hence (14) is satisfied if we define This completes the proof. m = 2µ and λ = log2 T. This section contains several results that relate the stability properties of a linear system to its state transition matrix. Since these results require an explicit expression of the state transition matrix, they are not of much use for testing purposes. Nevertheless, they do provide some insight.
10 2 TIME-INVARIANT SYSTEMS 10 2 Time-invariant systems Throughout this section, attention is restricted to linear time-invariant systems of the form ẋ(t) = Ax(t) (19) In this special case, Lyapunov theory is very complete, as we shall see. Theorem 2.1. (1)The equilibrium 0 of (19) is exponentially stable if and only if all the eigenvalues of A have negative real parts. (2) The equilibrium 0 of (19) is stable if and only if all the eigenvalues of A have nonpositive real parts. Proof : The state transition matrix Φ(t, t 0 ) of the system (19) is given by Φ(t, t 0 ) = exp[a(t t 0 )] (20)
11 2 TIME-INVARIANT SYSTEMS 11 where exp( ) is the matrix exponential. Furthermore, exp(at) can be expressed as exp(at) = r i=1 m i j=1 p ij (A)t j 1 exp(λ i t) (21) where r is the number of distinct eigenvalues of A ; λ 1,... λ r are the distinct eigenvalues ; m i is the multiplicity of the eigenvalue λ i and p ij are interpolating polynomials. The stated conditions for stability and for asymptotic stability now follow readily from Theorem 1.2 and 1.3. Example A = [ The eigenvalues are λ 1 = 1 and λ 2 = 2. Then the equilibrium 0 is unstable. ]
12 2 TIME-INVARIANT SYSTEMS A = [ The eigenvalues are λ 1 = 1 and λ 2 = 2. Then the equilibrium 0 is exponentially stable. A = [ The eigenvalues are λ 1 = 1 and λ 2 = 2. Then the equilibrium 0 is unstable. A = [ The eigenvalues are λ 1 = i and λ 2 = i. Then the equilibrium 0 is stable. ] ] ]
13 2 TIME-INVARIANT SYSTEMS A = [ The eigenvalues are λ 1 = 1 + i and λ 2 = 1 i. Then the equilibrium 0 is unstable. ] Thus in the case of linear time-invariant systems of the form (19), the stability status of the equilibrium 0 can be ascertained by studying the eigenvalues of A. However it is possible to formulate an entirely different approach to the problem, based on the use of quadratic Lyapunov functions. This theory is of interest in itself, and is also useful in studying non-linear systems using linearization methods.
14 2 TIME-INVARIANT SYSTEMS 14 Given the system (19), the idea is to choose a Lyapunov function candidate of the form V (x) = x P x (22) where P is a real symmetric matrix. Then V is given by V (x) = ẋ P x + x P ẋ = x Qx (23) where A P + P A = Q (24) Equation (24) is commonly known as the Lyapunov Matrix Equation. By means of this equation, it is possible to study the stability properties of the equilibrium 0 of the system (19). For example, if a pair of matrices (P, Q) satisfying (24) can be found such that both P and Q are positive definite, then both V and V are positive definite functions, and V is radially unbounded. Hence, by Theorem 3.4 in Chapter 3, 0 is globally exponentially stable. On the other hand, if a pair (P, Q) can be found such that Q is positive definite and P has at least one nonpositive eigenvalue, then V is positive definite, and V assumes nonpositive values arbitrarily close to the origin. Hence, by Theorem 88, the origin is unstable.
15 2 TIME-INVARIANT SYSTEMS 15 There are two ways in which (24) can be tackled : 1) Given a matrix A, one can pick a particular matrix P and study the properties of the matrix Q resulting from (24). 2) Given a matrix A, one can pick a particular matrix Q and study the matrix P resulting from (24).
16 2 TIME-INVARIANT SYSTEMS 16 One difficulty with selecting Q and trying to find the corresponding P is that, depending on the matrix A, (24) may not have a unique solution for P. The next result gives necessary and sufficient conditions under which (24) has a unique solution corresponding to each Q. Lemma 2.1. Let A R n n, and let {λ 1, λ 2,..., λ n } denote the (not necessarily distinct) eigenvalues of A. Then (24) has a unique solution for P corresponding to each Q R n n if and only if λ i + λ j 0, i, j (25) On the basis of Lemma 2.1, one can state the following corollary : Corollary 2.1. If for some choice of Q R n n, Equation (24) does not have a unique solution P, then the origin is not asymptotically stable. Proof : If all the eigenvalues of A have negative real parts, then (25) is satisfied.
17 2 TIME-INVARIANT SYSTEMS 17 The following lemma provides an alternate characterization of the solutions of (24). Note that a matrix A is called Hurwitz if all of its eigenvalues have negative real parts. Lemma 2.2. Let A be a Hurwitz matrix. Then, for each Q R n n, the corresponding unique solution of (24) is given by P = 0 e A t Qe At dt (26) Proof : If A is Hurwitz, then the condition (25) is satisfied, and (24) has a unique solution for P corresponding to each Q R n n. Moreover, if A is Hurwitz, then the integral on the right side of (26) is well-defined. Let M denote this integral. It is now shown that A M + MA = Q (27)
18 2 TIME-INVARIANT SYSTEMS 18 By the uniqueness of solutions to (24), it then follows that P = M. To prove (27), observe that A M + MA = = 0 = Q This completes the proof. 0 [A e A t Qe At + e A t Qe At A]dt d[e A t Qe At ] = [e A t Qe At] Remark 2.1. Note that the above lemma also provides a convenient way to compute infinite integrals of the form (26). 0
19 2 TIME-INVARIANT SYSTEMS 19 We can now state one of the main results of the Lyapunov matrix equation : Theorem 2.2. Given a matrix A R n n, the following three statements are equivalent : (1) A is a Hurwitz matrix. (2) There exists some positive definite matrix Q R n n such that (24) has a corresponding unique positive definite solution P. (3) For every positive definite matrix Q R n n, (24) has a unique positive definite solution P. Proof : (3) (2) Obvious. (2) (1) Suppose (2) is true for some particular Q. Then we can apply Theorem 3.3 in Chapter 3, with the Lyapunov function candidate V (x) = x P x. Then V (x) = x Qx, and one can conclude that 0 is asymptotically stable. By Theorem 2.1, this implies that A is Hurwitz.
20 2 TIME-INVARIANT SYSTEMS 20 (1) (3) Suppose A is Hurwitz and let Q be positive definite but otherwise arbitrary. By Lemma 2.2, Equation (24) has a corresponding unique solution P given by (26). It only remains to show that P is positive definite. For this purpose, factor Q in the form M M where M is nonsingular. Now it is claimed that P is positive definite because with Q = M M, P becomes Thus, for any x R n, x P x = 0 P = x P x > 0, x 0 (28) x e A t M Me At xdt = 0 e A t M Me At dt (29) Substituting t = 0 gives Mx = 0, which implies x = 0. Hence, P is 0 Me At x 2 2dt 0 (30) where 2 denotes the Euclidean norm. Next, if x P x = 0, then Me At x = 0, t 0 (31)
21 2 TIME-INVARIANT SYSTEMS 21 positive definite. Remark 2.2. Theorem 2.2 is very important in that it enables one to determine the stability status of the equilibrium 0 in the following manner : Given A R n n, pick Q R n n to be any positive definite matrix (a logical choice is the identity matrix). Attempt to solve (24) for P. (a) If (24) has no solution or has non-unique solution, then 0 is not asymptotically stable. (b) If P is unique but not positive definite, then once again 0 is not asymptotically stable. (c) If P is uniquely determined and positive definite, then 0 is asymptotically stable.
22 2 TIME-INVARIANT SYSTEMS 22 Example 2.2. In this example we demonstrate the necessary steps required in applying the Lyapunov stability test. Consider the following continuous time invariant system represented by ẋ1(t) ẋ 2 (t) ẋ 3 (t) = x 1(t) x 2 (t) x 3 (t) (32) It is easy to check by MATLAB function eig that the eigenvalues of this system are λ 1 = , λ 2 = i0.5623, λ 3 = i and hence this system is asymptotically stable. In order to apply the Lyapunov method, we first choose a positive definite matrix Q. The standard initial guess for Q is identity, i.e. Q = I 3. With the help of the MATLAB function lyap (used for solving the algebraic Lyapunov equation), we can execute the following statement P = lyap(a, Q) and obtain the solution P as P =
23 2 TIME-INVARIANT SYSTEMS 23 Examining the positive definiteness of the matrix P (all eigenvalues of P must be in the closed right half plane), we get that the eigenvalues of this matrix are given , , hence P is positive definite and the Lyapunov test indicates that the system under consideration is asymptotically stable. It can be seen from this particular example that the Lyapunov stability test is not numerically very efficient since we have first to solve the linear algebraic Lyapunov equation and then to test the positive definiteness of the matrix P, which requires finding its eigenvalues. Of course, we can find the eigenvalue of the matrix A immediately and from that information determine the system stability. It is true that the Lyapunov stability test is not the right method to test the stability of linear systems when the system matrix is given by numerical entries. However, it can be used as a useful concept in theoretical considerations, e.g. to prove some other stability results.
24 2 TIME-INVARIANT SYSTEMS 24 Theorem 2.2 shows that, if A is Hurwitz and Q is positive definite. The next result shows that, under certain conditions, P is positive definite even when Q is positive semi-definite. Lemma 2.3. Suppose A R n n and satisfies (25). Suppose C R n n, and that rank L = Let f(t) = Ce At x. Then f as well as all its derivatives are C CA Under these conditions, the equation. CA n 1 has a unique positive definite solution P. = n (33) A P + P A = C C (34) Proof : Existence and uniqueness of P follows from Lemma (2.1). To show that P is positive definite, we have x P x = 0 Ce At x = 0, t 0
25 2 TIME-INVARIANT SYSTEMS 25 identically zero. In particular, Lx = 0, which implies x = 0. Hence, P is positive definite. Example 2.3. Consider the same system matrix as in Example 2.2 with the matrix Q 1 obtained from Q 1 = C T C = 0 0 [ ] = Note that the rank of the matrix L is 3, then L is full rank. Then, the Lyapunov algebraic equation has the positive definite solution P 1 = A P 1 + P 1 A = Q 1 (35) which can be confirmed by finding the eigenvalues of P 1, so that the considered linear system is asymptotically stable.
26 3 TIME-VARYING SYSTEMS 26 3 Time-Varying Systems Here, we interested in the stability of the following time-varying system ẋ(t) = A(t)x(t), t 0 (36) In the case of linear time-varying systems, the stability status of the equilibrium 0 can be ascertained, in principle at least, by studying the state transition matrix. Existence of Quadratic Lyapunov Functions For time-invariant systems, it has been shown that if 0 is exponentially stable then a quadratic Lyapunov function exists. A similar result is now proved for time-varying systems, under the assumption that 0 is exponentially stable. This result is based on two preliminary lemmas :
27 3 TIME-VARYING SYSTEMS 27 Lemma 3.1. Suppose Q : R + R n n is continuous and bounded, and that the equilibrium 0 of (36) is uniformly asymptotically stable. Then, for each t 0, the matrix P (t) = t Φ (τ, t)q(τ)φ(τ, t)dτ (37) is well-defined ; moreover, P (t) is bounded as a function of t. Proof : The assumption of uniform asymptotic stability implies that 0 is exponentially stable. Thus, there exist constants m, λ > 0 such that Φ(τ, t) i m exp[ λ(τ t)], τ t 0. (38) The previous bound, together with the boundeness of Q( ), proves the lemma.
28 3 TIME-VARYING SYSTEMS 28 Lemma 3.2. Suppose that, in addition to the assumption of Lemma (3.1), the following conditions also hold : (1) Q(t) is symmetric and positive definite for each t 0 ; moreover, there exists a constant α > 0 such that αx x x Q(t)x, t 0, x R n. (39) (2) The matrix A( ) is bounded, i.e. m 0 := sup t 0 A(t) i,2 < (40) Under these conditions, the matrix P (t) is defined in (37) is positive definite for each t 0 ; moreover, there exists a constant β > 0 such that βx x x P (t)x, t 0, x R n. (41)
29 3 TIME-VARYING SYSTEMS 29 Theorem 3.1. Suppose Q( ) and A( ) satisfy the hypotheses of Lemma 3.2. Then for each function Q( ) satisfying the hypotheses, the function V (t, x) = x P (t)x is a Lyapunov function for establishing the exponential stability of the equilibrium 0. Proof : With V (t, x) defined as above, we have V (t, x) = x [ P (t) + A (t)p (t) + P (t)a(t)]x It is easy to verify by differentiating (37) that Hence P (t) = A (t)p (t) P (t)a(t) Q(t) (42) V (t, x) = x Q(t)x Thus the functions V and V satisfy all the needed conditions.
30 3 TIME-VARYING SYSTEMS 30 Example 3.1. Consider the linear time-varying system { ẋ1 (t) = 1 2 (cos t esin t )x 1 (t) + sin 2 t x 2 (t) ẋ 2 (t) = sin 2 t x 1 (t) (cos t esin t )x 2 (t) Then A(t) = [ 1 2 (cos t esin t ) sin 2 t sin 2 t 1 2 (cos t esin t ) Taking Q = I, simple calculation shows that P (t) = [ ] e sin t 0 0 e sin t is a solution of (42). The system is exponentially stable. ].
Nonlinear Control Lecture 5: Stability Analysis II
Nonlinear Control Lecture 5: Stability Analysis II Farzaneh Abdollahi Department of Electrical Engineering Amirkabir University of Technology Fall 2010 Farzaneh Abdollahi Nonlinear Control Lecture 5 1/41
More information1 Lyapunov theory of stability
M.Kawski, APM 581 Diff Equns Intro to Lyapunov theory. November 15, 29 1 1 Lyapunov theory of stability Introduction. Lyapunov s second (or direct) method provides tools for studying (asymptotic) stability
More information1. Find the solution of the following uncontrolled linear system. 2 α 1 1
Appendix B Revision Problems 1. Find the solution of the following uncontrolled linear system 0 1 1 ẋ = x, x(0) =. 2 3 1 Class test, August 1998 2. Given the linear system described by 2 α 1 1 ẋ = x +
More informationSolution of Linear State-space Systems
Solution of Linear State-space Systems Homogeneous (u=0) LTV systems first Theorem (Peano-Baker series) The unique solution to x(t) = (t, )x 0 where The matrix function is given by is called the state
More informationLecture 4. Chapter 4: Lyapunov Stability. Eugenio Schuster. Mechanical Engineering and Mechanics Lehigh University.
Lecture 4 Chapter 4: Lyapunov Stability Eugenio Schuster schuster@lehigh.edu Mechanical Engineering and Mechanics Lehigh University Lecture 4 p. 1/86 Autonomous Systems Consider the autonomous system ẋ
More informationSolution of Additional Exercises for Chapter 4
1 1. (1) Try V (x) = 1 (x 1 + x ). Solution of Additional Exercises for Chapter 4 V (x) = x 1 ( x 1 + x ) x = x 1 x + x 1 x In the neighborhood of the origin, the term (x 1 + x ) dominates. Hence, the
More informationIntroduction to Nonlinear Control Lecture # 3 Time-Varying and Perturbed Systems
p. 1/5 Introduction to Nonlinear Control Lecture # 3 Time-Varying and Perturbed Systems p. 2/5 Time-varying Systems ẋ = f(t, x) f(t, x) is piecewise continuous in t and locally Lipschitz in x for all t
More informationLyapunov Theory for Discrete Time Systems
Università degli studi di Padova Dipartimento di Ingegneria dell Informazione Nicoletta Bof, Ruggero Carli, Luca Schenato Technical Report Lyapunov Theory for Discrete Time Systems This work contains a
More informationLyapunov Stability Theory
Lyapunov Stability Theory Peter Al Hokayem and Eduardo Gallestey March 16, 2015 1 Introduction In this lecture we consider the stability of equilibrium points of autonomous nonlinear systems, both in continuous
More informationME Fall 2001, Fall 2002, Spring I/O Stability. Preliminaries: Vector and function norms
I/O Stability Preliminaries: Vector and function norms 1. Sup norms are used for vectors for simplicity: x = max i x i. Other norms are also okay 2. Induced matrix norms: let A R n n, (i stands for induced)
More informationMCE/EEC 647/747: Robot Dynamics and Control. Lecture 8: Basic Lyapunov Stability Theory
MCE/EEC 647/747: Robot Dynamics and Control Lecture 8: Basic Lyapunov Stability Theory Reading: SHV Appendix Mechanical Engineering Hanz Richter, PhD MCE503 p.1/17 Stability in the sense of Lyapunov A
More informationNonlinear Control. Nonlinear Control Lecture # 8 Time Varying and Perturbed Systems
Nonlinear Control Lecture # 8 Time Varying and Perturbed Systems Time-varying Systems ẋ = f(t,x) f(t,x) is piecewise continuous in t and locally Lipschitz in x for all t 0 and all x D, (0 D). The origin
More informationLyapunov stability ORDINARY DIFFERENTIAL EQUATIONS
Lyapunov stability ORDINARY DIFFERENTIAL EQUATIONS An ordinary differential equation is a mathematical model of a continuous state continuous time system: X = < n state space f: < n! < n vector field (assigns
More informationConverse Lyapunov theorem and Input-to-State Stability
Converse Lyapunov theorem and Input-to-State Stability April 6, 2014 1 Converse Lyapunov theorem In the previous lecture, we have discussed few examples of nonlinear control systems and stability concepts
More informationEN Nonlinear Control and Planning in Robotics Lecture 3: Stability February 4, 2015
EN530.678 Nonlinear Control and Planning in Robotics Lecture 3: Stability February 4, 2015 Prof: Marin Kobilarov 0.1 Model prerequisites Consider ẋ = f(t, x). We will make the following basic assumptions
More informationModule 06 Stability of Dynamical Systems
Module 06 Stability of Dynamical Systems Ahmad F. Taha EE 5143: Linear Systems and Control Email: ahmad.taha@utsa.edu Webpage: http://engineering.utsa.edu/ataha October 10, 2017 Ahmad F. Taha Module 06
More informationNonlinear Systems and Control Lecture # 12 Converse Lyapunov Functions & Time Varying Systems. p. 1/1
Nonlinear Systems and Control Lecture # 12 Converse Lyapunov Functions & Time Varying Systems p. 1/1 p. 2/1 Converse Lyapunov Theorem Exponential Stability Let x = 0 be an exponentially stable equilibrium
More informationTopic # /31 Feedback Control Systems. Analysis of Nonlinear Systems Lyapunov Stability Analysis
Topic # 16.30/31 Feedback Control Systems Analysis of Nonlinear Systems Lyapunov Stability Analysis Fall 010 16.30/31 Lyapunov Stability Analysis Very general method to prove (or disprove) stability of
More informationGeorgia Institute of Technology Nonlinear Controls Theory Primer ME 6402
Georgia Institute of Technology Nonlinear Controls Theory Primer ME 640 Ajeya Karajgikar April 6, 011 Definition Stability (Lyapunov): The equilibrium state x = 0 is said to be stable if, for any R > 0,
More informationPutzer s Algorithm. Norman Lebovitz. September 8, 2016
Putzer s Algorithm Norman Lebovitz September 8, 2016 1 Putzer s algorithm The differential equation dx = Ax, (1) dt where A is an n n matrix of constants, possesses the fundamental matrix solution exp(at),
More information6 Linear Equation. 6.1 Equation with constant coefficients
6 Linear Equation 6.1 Equation with constant coefficients Consider the equation ẋ = Ax, x R n. This equating has n independent solutions. If the eigenvalues are distinct then the solutions are c k e λ
More information2 Lyapunov Stability. x(0) x 0 < δ x(t) x 0 < ɛ
1 2 Lyapunov Stability Whereas I/O stability is concerned with the effect of inputs on outputs, Lyapunov stability deals with unforced systems: ẋ = f(x, t) (1) where x R n, t R +, and f : R n R + R n.
More informationNonlinear Control. Nonlinear Control Lecture # 3 Stability of Equilibrium Points
Nonlinear Control Lecture # 3 Stability of Equilibrium Points The Invariance Principle Definitions Let x(t) be a solution of ẋ = f(x) A point p is a positive limit point of x(t) if there is a sequence
More informationECE504: Lecture 8. D. Richard Brown III. Worcester Polytechnic Institute. 28-Oct-2008
ECE504: Lecture 8 D. Richard Brown III Worcester Polytechnic Institute 28-Oct-2008 Worcester Polytechnic Institute D. Richard Brown III 28-Oct-2008 1 / 30 Lecture 8 Major Topics ECE504: Lecture 8 We are
More informationTheorem 1. ẋ = Ax is globally exponentially stable (GES) iff A is Hurwitz (i.e., max(re(σ(a))) < 0).
Linear Systems Notes Lecture Proposition. A M n (R) is positive definite iff all nested minors are greater than or equal to zero. n Proof. ( ): Positive definite iff λ i >. Let det(a) = λj and H = {x D
More informationHybrid Control and Switched Systems. Lecture #11 Stability of switched system: Arbitrary switching
Hybrid Control and Switched Systems Lecture #11 Stability of switched system: Arbitrary switching João P. Hespanha University of California at Santa Barbara Stability under arbitrary switching Instability
More informationStability theory is a fundamental topic in mathematics and engineering, that include every
Stability Theory Stability theory is a fundamental topic in mathematics and engineering, that include every branches of control theory. For a control system, the least requirement is that the system is
More informationExamples include: (a) the Lorenz system for climate and weather modeling (b) the Hodgkin-Huxley system for neuron modeling
1 Introduction Many natural processes can be viewed as dynamical systems, where the system is represented by a set of state variables and its evolution governed by a set of differential equations. Examples
More informationNonlinear Control. Nonlinear Control Lecture # 2 Stability of Equilibrium Points
Nonlinear Control Lecture # 2 Stability of Equilibrium Points Basic Concepts ẋ = f(x) f is locally Lipschitz over a domain D R n Suppose x D is an equilibrium point; that is, f( x) = 0 Characterize and
More information21 Linear State-Space Representations
ME 132, Spring 25, UC Berkeley, A Packard 187 21 Linear State-Space Representations First, let s describe the most general type of dynamic system that we will consider/encounter in this class Systems may
More informationStability of Stochastic Differential Equations
Lyapunov stability theory for ODEs s Stability of Stochastic Differential Equations Part 1: Introduction Department of Mathematics and Statistics University of Strathclyde Glasgow, G1 1XH December 2010
More informationThe goal of this chapter is to study linear systems of ordinary differential equations: dt,..., dx ) T
1 1 Linear Systems The goal of this chapter is to study linear systems of ordinary differential equations: ẋ = Ax, x(0) = x 0, (1) where x R n, A is an n n matrix and ẋ = dx ( dt = dx1 dt,..., dx ) T n.
More informationStability in the sense of Lyapunov
CHAPTER 5 Stability in the sense of Lyapunov Stability is one of the most important properties characterizing a system s qualitative behavior. There are a number of stability concepts used in the study
More informationHybrid Control and Switched Systems. Lecture #7 Stability and convergence of ODEs
Hybrid Control and Switched Systems Lecture #7 Stability and convergence of ODEs João P. Hespanha University of California at Santa Barbara Summary Lyapunov stability of ODEs epsilon-delta and beta-function
More informationNonlinear systems. Lyapunov stability theory. G. Ferrari Trecate
Nonlinear systems Lyapunov stability theory G. Ferrari Trecate Dipartimento di Ingegneria Industriale e dell Informazione Università degli Studi di Pavia Advanced automation and control Ferrari Trecate
More informationConvergence Rate of Nonlinear Switched Systems
Convergence Rate of Nonlinear Switched Systems Philippe JOUAN and Saïd NACIRI arxiv:1511.01737v1 [math.oc] 5 Nov 2015 January 23, 2018 Abstract This paper is concerned with the convergence rate of the
More information1. The Transition Matrix (Hint: Recall that the solution to the linear equation ẋ = Ax + Bu is
ECE 55, Fall 2007 Problem Set #4 Solution The Transition Matrix (Hint: Recall that the solution to the linear equation ẋ Ax + Bu is x(t) e A(t ) x( ) + e A(t τ) Bu(τ)dτ () This formula is extremely important
More informationMath Ordinary Differential Equations
Math 411 - Ordinary Differential Equations Review Notes - 1 1 - Basic Theory A first order ordinary differential equation has the form x = f(t, x) (11) Here x = dx/dt Given an initial data x(t 0 ) = x
More information7 Planar systems of linear ODE
7 Planar systems of linear ODE Here I restrict my attention to a very special class of autonomous ODE: linear ODE with constant coefficients This is arguably the only class of ODE for which explicit solution
More information8 Periodic Linear Di erential Equations - Floquet Theory
8 Periodic Linear Di erential Equations - Floquet Theory The general theory of time varying linear di erential equations _x(t) = A(t)x(t) is still amazingly incomplete. Only for certain classes of functions
More informationDepartment of Mathematics IIT Guwahati
Stability of Linear Systems in R 2 Department of Mathematics IIT Guwahati A system of first order differential equations is called autonomous if the system can be written in the form dx 1 dt = g 1(x 1,
More informationCDS Solutions to the Midterm Exam
CDS 22 - Solutions to the Midterm Exam Instructor: Danielle C. Tarraf November 6, 27 Problem (a) Recall that the H norm of a transfer function is time-delay invariant. Hence: ( ) Ĝ(s) = s + a = sup /2
More informationInput-to-state stability and interconnected Systems
10th Elgersburg School Day 1 Input-to-state stability and interconnected Systems Sergey Dashkovskiy Universität Würzburg Elgersburg, March 5, 2018 1/20 Introduction Consider Solution: ẋ := dx dt = ax,
More informationUsing Lyapunov Theory I
Lecture 33 Stability Analysis of Nonlinear Systems Using Lyapunov heory I Dr. Radhakant Padhi Asst. Professor Dept. of Aerospace Engineering Indian Institute of Science - Bangalore Outline Motivation Definitions
More informationProf. Krstic Nonlinear Systems MAE281A Homework set 1 Linearization & phase portrait
Prof. Krstic Nonlinear Systems MAE28A Homework set Linearization & phase portrait. For each of the following systems, find all equilibrium points and determine the type of each isolated equilibrium. Use
More informationLMI Methods in Optimal and Robust Control
LMI Methods in Optimal and Robust Control Matthew M. Peet Arizona State University Lecture 15: Nonlinear Systems and Lyapunov Functions Overview Our next goal is to extend LMI s and optimization to nonlinear
More informationOn Linear Copositive Lyapunov Functions and the Stability of Switched Positive Linear Systems
1 On Linear Copositive Lyapunov Functions and the Stability of Switched Positive Linear Systems O. Mason and R. Shorten Abstract We consider the problem of common linear copositive function existence for
More informationMCE693/793: Analysis and Control of Nonlinear Systems
MCE693/793: Analysis and Control of Nonlinear Systems Lyapunov Stability - I Hanz Richter Mechanical Engineering Department Cleveland State University Definition of Stability - Lyapunov Sense Lyapunov
More information1 The Observability Canonical Form
NONLINEAR OBSERVERS AND SEPARATION PRINCIPLE 1 The Observability Canonical Form In this Chapter we discuss the design of observers for nonlinear systems modelled by equations of the form ẋ = f(x, u) (1)
More informationHybrid Systems Course Lyapunov stability
Hybrid Systems Course Lyapunov stability OUTLINE Focus: stability of an equilibrium point continuous systems decribed by ordinary differential equations (brief review) hybrid automata OUTLINE Focus: stability
More informationSolution via Laplace transform and matrix exponential
EE263 Autumn 2015 S. Boyd and S. Lall Solution via Laplace transform and matrix exponential Laplace transform solving ẋ = Ax via Laplace transform state transition matrix matrix exponential qualitative
More informationExponential stability of families of linear delay systems
Exponential stability of families of linear delay systems F. Wirth Zentrum für Technomathematik Universität Bremen 28334 Bremen, Germany fabian@math.uni-bremen.de Keywords: Abstract Stability, delay systems,
More information3 Stability and Lyapunov Functions
CDS140a Nonlinear Systems: Local Theory 02/01/2011 3 Stability and Lyapunov Functions 3.1 Lyapunov Stability Denition: An equilibrium point x 0 of (1) is stable if for all ɛ > 0, there exists a δ > 0 such
More informationOrdinary Differential Equations II
Ordinary Differential Equations II February 9 217 Linearization of an autonomous system We consider the system (1) x = f(x) near a fixed point x. As usual f C 1. Without loss of generality we assume x
More informationHybrid Systems - Lecture n. 3 Lyapunov stability
OUTLINE Focus: stability of equilibrium point Hybrid Systems - Lecture n. 3 Lyapunov stability Maria Prandini DEI - Politecnico di Milano E-mail: prandini@elet.polimi.it continuous systems decribed by
More informationEML5311 Lyapunov Stability & Robust Control Design
EML5311 Lyapunov Stability & Robust Control Design 1 Lyapunov Stability criterion In Robust control design of nonlinear uncertain systems, stability theory plays an important role in engineering systems.
More informationODEs Cathal Ormond 1
ODEs Cathal Ormond 2 1. Separable ODEs Contents 2. First Order ODEs 3. Linear ODEs 4. 5. 6. Chapter 1 Separable ODEs 1.1 Definition: An ODE An Ordinary Differential Equation (an ODE) is an equation whose
More informationOn the stability of switched positive linear systems
On the stability of switched positive linear systems L. Gurvits, R. Shorten and O. Mason Abstract It was recently conjectured that the Hurwitz stability of the convex hull of a set of Metzler matrices
More informationControl Systems. Internal Stability - LTI systems. L. Lanari
Control Systems Internal Stability - LTI systems L. Lanari outline LTI systems: definitions conditions South stability criterion equilibrium points Nonlinear systems: equilibrium points examples stable
More information1 Relative degree and local normal forms
THE ZERO DYNAMICS OF A NONLINEAR SYSTEM 1 Relative degree and local normal orms The purpose o this Section is to show how single-input single-output nonlinear systems can be locally given, by means o a
More informationNonlinear Control Lecture 4: Stability Analysis I
Nonlinear Control Lecture 4: Stability Analysis I Farzaneh Abdollahi Department of Electrical Engineering Amirkabir University of Technology Fall 2010 Farzaneh Abdollahi Nonlinear Control Lecture 4 1/70
More informationQuadratic and Copositive Lyapunov Functions and the Stability of Positive Switched Linear Systems
Proceedings of the 2007 American Control Conference Marriott Marquis Hotel at Times Square New York City, USA, July 11-13, 2007 WeA20.1 Quadratic and Copositive Lyapunov Functions and the Stability of
More informationSwitched systems: stability
Switched systems: stability OUTLINE Switched Systems Stability of Switched Systems OUTLINE Switched Systems Stability of Switched Systems a family of systems SWITCHED SYSTEMS SWITCHED SYSTEMS a family
More informationA note on linear differential equations with periodic coefficients.
A note on linear differential equations with periodic coefficients. Maite Grau (1) and Daniel Peralta-Salas (2) (1) Departament de Matemàtica. Universitat de Lleida. Avda. Jaume II, 69. 251 Lleida, Spain.
More informationCourse 216: Ordinary Differential Equations
Course 16: Ordinary Differential Equations Notes by Chris Blair These notes cover the ODEs course given in 7-8 by Dr. John Stalker. Contents I Solving Linear ODEs 1 Reduction of Order Computing Matrix
More informationAutomatic Control 2. Nonlinear systems. Prof. Alberto Bemporad. University of Trento. Academic year
Automatic Control 2 Nonlinear systems Prof. Alberto Bemporad University of Trento Academic year 2010-2011 Prof. Alberto Bemporad (University of Trento) Automatic Control 2 Academic year 2010-2011 1 / 18
More informationLinear ODEs. Existence of solutions to linear IVPs. Resolvent matrix. Autonomous linear systems
Linear ODEs p. 1 Linear ODEs Existence of solutions to linear IVPs Resolvent matrix Autonomous linear systems Linear ODEs Definition (Linear ODE) A linear ODE is a differential equation taking the form
More informationL 2 -induced Gains of Switched Systems and Classes of Switching Signals
L 2 -induced Gains of Switched Systems and Classes of Switching Signals Kenji Hirata and João P. Hespanha Abstract This paper addresses the L 2-induced gain analysis for switched linear systems. We exploit
More information3. Fundamentals of Lyapunov Theory
Applied Nonlinear Control Nguyen an ien -.. Fundamentals of Lyapunov heory he objective of this chapter is to present Lyapunov stability theorem and illustrate its use in the analysis and the design of
More informationEE363 homework 7 solutions
EE363 Prof. S. Boyd EE363 homework 7 solutions 1. Gain margin for a linear quadratic regulator. Let K be the optimal state feedback gain for the LQR problem with system ẋ = Ax + Bu, state cost matrix Q,
More informationDeterministic Dynamic Programming
Deterministic Dynamic Programming 1 Value Function Consider the following optimal control problem in Mayer s form: V (t 0, x 0 ) = inf u U J(t 1, x(t 1 )) (1) subject to ẋ(t) = f(t, x(t), u(t)), x(t 0
More informationTHE INVERSE FUNCTION THEOREM
THE INVERSE FUNCTION THEOREM W. PATRICK HOOPER The implicit function theorem is the following result: Theorem 1. Let f be a C 1 function from a neighborhood of a point a R n into R n. Suppose A = Df(a)
More informationNonlinear Control. Nonlinear Control Lecture # 8 Time Varying and Perturbed Systems
Nonlinear Control Lecture # 8 Time Varying and Perturbed Systems Time-varying Systems ẋ = f(t,x) f(t,x) is piecewise continuous in t and locally Lipschitz in x for all t 0 and all x D, (0 D). The origin
More informationStabilization and Passivity-Based Control
DISC Systems and Control Theory of Nonlinear Systems, 2010 1 Stabilization and Passivity-Based Control Lecture 8 Nonlinear Dynamical Control Systems, Chapter 10, plus handout from R. Sepulchre, Constructive
More informationLecture 9. Systems of Two First Order Linear ODEs
Math 245 - Mathematics of Physics and Engineering I Lecture 9. Systems of Two First Order Linear ODEs January 30, 2012 Konstantin Zuev (USC) Math 245, Lecture 9 January 30, 2012 1 / 15 Agenda General Form
More informationNOTES ON LINEAR ODES
NOTES ON LINEAR ODES JONATHAN LUK We can now use all the discussions we had on linear algebra to study linear ODEs Most of this material appears in the textbook in 21, 22, 23, 26 As always, this is a preliminary
More informationHalf of Final Exam Name: Practice Problems October 28, 2014
Math 54. Treibergs Half of Final Exam Name: Practice Problems October 28, 24 Half of the final will be over material since the last midterm exam, such as the practice problems given here. The other half
More informationMathematical Economics. Lecture Notes (in extracts)
Prof. Dr. Frank Werner Faculty of Mathematics Institute of Mathematical Optimization (IMO) http://math.uni-magdeburg.de/ werner/math-ec-new.html Mathematical Economics Lecture Notes (in extracts) Winter
More informationLecture Notes of EE 714
Lecture Notes of EE 714 Lecture 1 Motivation Systems theory that we have studied so far deals with the notion of specified input and output spaces. But there are systems which do not have a clear demarcation
More informationChapter 7. Canonical Forms. 7.1 Eigenvalues and Eigenvectors
Chapter 7 Canonical Forms 7.1 Eigenvalues and Eigenvectors Definition 7.1.1. Let V be a vector space over the field F and let T be a linear operator on V. An eigenvalue of T is a scalar λ F such that there
More informationPeriodic Linear Systems
Periodic Linear Systems Lecture 17 Math 634 10/8/99 We now consider ẋ = A(t)x (1) when A is a continuous periodic n n matrix function of t; i.e., when there is a constant T>0 such that A(t + T )=A(t) for
More informationSTABILIZATION THROUGH HYBRID CONTROL
STABILIZATION THROUGH HYBRID CONTROL João P. Hespanha, Department of Electrical and Computer Engineering, University of California, Santa Barbara, CA 93106-9560, USA. Keywords: Hybrid Systems; Switched
More informationLecture 10: Singular Perturbations and Averaging 1
Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science 6.243j (Fall 2003): DYNAMICS OF NONLINEAR SYSTEMS by A. Megretski Lecture 10: Singular Perturbations and
More informationOn the stability of switched positive linear systems
1 On the stability of switched positive linear systems L. Gurvits, R. Shorten and O. Mason Abstract It was recently conjectured that the Hurwitz stability of the convex hull of a set of Metzler matrices
More informationChapter 1. Preliminaries. The purpose of this chapter is to provide some basic background information. Linear Space. Hilbert Space.
Chapter 1 Preliminaries The purpose of this chapter is to provide some basic background information. Linear Space Hilbert Space Basic Principles 1 2 Preliminaries Linear Space The notion of linear space
More informationChap 3. Linear Algebra
Chap 3. Linear Algebra Outlines 1. Introduction 2. Basis, Representation, and Orthonormalization 3. Linear Algebraic Equations 4. Similarity Transformation 5. Diagonal Form and Jordan Form 6. Functions
More informationStability of Impulsive Switched Systems in Two Measures
Stability of Impulsive Switched Systems in Two Measures by Benjamin Turnbull A thesis presented to the University of Waterloo in fulfillment of the thesis requirement for the degree of Master of Mathematics
More informationNonlinear Systems Theory
Nonlinear Systems Theory Matthew M. Peet Arizona State University Lecture 2: Nonlinear Systems Theory Overview Our next goal is to extend LMI s and optimization to nonlinear systems analysis. Today we
More informationZ i Q ij Z j. J(x, φ; U) = X T φ(t ) 2 h + where h k k, H(t) k k and R(t) r r are nonnegative definite matrices (R(t) is uniformly in t nonsingular).
2. LINEAR QUADRATIC DETERMINISTIC PROBLEM Notations: For a vector Z, Z = Z, Z is the Euclidean norm here Z, Z = i Z2 i is the inner product; For a vector Z and nonnegative definite matrix Q, Z Q = Z, QZ
More informationDynamical Systems & Lyapunov Stability
Dynamical Systems & Lyapunov Stability Harry G. Kwatny Department of Mechanical Engineering & Mechanics Drexel University Outline Ordinary Differential Equations Existence & uniqueness Continuous dependence
More informationEE263: Introduction to Linear Dynamical Systems Review Session 5
EE263: Introduction to Linear Dynamical Systems Review Session 5 Outline eigenvalues and eigenvectors diagonalization matrix exponential EE263 RS5 1 Eigenvalues and eigenvectors we say that λ C is an eigenvalue
More informationPreliminary results on the stability of switched positive linear systems
1 Preliminary results on the stability of switched positive linear systems L. Gurvits, R. Shorten and O. Mason Abstract It was recently conjectured that the Hurwitz stability of a polytope of Metzler matrices
More informationOPTIMAL CONTROL. Sadegh Bolouki. Lecture slides for ECE 515. University of Illinois, Urbana-Champaign. Fall S. Bolouki (UIUC) 1 / 28
OPTIMAL CONTROL Sadegh Bolouki Lecture slides for ECE 515 University of Illinois, Urbana-Champaign Fall 2016 S. Bolouki (UIUC) 1 / 28 (Example from Optimal Control Theory, Kirk) Objective: To get from
More information19 Jacobian Linearizations, equilibrium points
169 19 Jacobian Linearizations, equilibrium points In modeling systems, we see that nearly all systems are nonlinear, in that the differential equations governing the evolution of the system s variables
More informationState will have dimension 5. One possible choice is given by y and its derivatives up to y (4)
A Exercise State will have dimension 5. One possible choice is given by y and its derivatives up to y (4 x T (t [ y(t y ( (t y (2 (t y (3 (t y (4 (t ] T With this choice we obtain A B C [ ] D 2 3 4 To
More informationNORMS ON SPACE OF MATRICES
NORMS ON SPACE OF MATRICES. Operator Norms on Space of linear maps Let A be an n n real matrix and x 0 be a vector in R n. We would like to use the Picard iteration method to solve for the following system
More informationThere is a more global concept that is related to this circle of ideas that we discuss somewhat informally. Namely, a region R R n with a (smooth)
82 Introduction Liapunov Functions Besides the Liapunov spectral theorem, there is another basic method of proving stability that is a generalization of the energy method we have seen in the introductory
More informationControl Systems Design
ELEC4410 Control Systems Design Lecture 14: Controllability Julio H. Braslavsky julio@ee.newcastle.edu.au School of Electrical Engineering and Computer Science Lecture 14: Controllability p.1/23 Outline
More informationMathematical Systems Theory: Advanced Course Exercise Session 5. 1 Accessibility of a nonlinear system
Mathematical Systems Theory: dvanced Course Exercise Session 5 1 ccessibility of a nonlinear system Consider an affine nonlinear control system: [ ẋ = f(x)+g(x)u, x() = x, G(x) = g 1 (x) g m (x) ], where
More informationStability of Nonlinear Systems An Introduction
Stability of Nonlinear Systems An Introduction Michael Baldea Department of Chemical Engineering The University of Texas at Austin April 3, 2012 The Concept of Stability Consider the generic nonlinear
More information