# 1 Lyapunov theory of stability

Size: px
Start display at page:

## Transcription

1 M.Kawski, APM 581 Diff Equns Intro to Lyapunov theory. November 15, Lyapunov theory of stability Introduction. Lyapunov s second (or direct) method provides tools for studying (asymptotic) stability properties of an equilibrium point of a dynamical system (or systems of differential equations). The intuitive picture is that of a scalar output-function, often thought of as a generalized energy that is bounded below, and decreasing along solutions. If this function has only a single local minimum, and it is strictly decreasing along all nonequilibrium solutions, then one expects that all solutions tend to that equilibrium where the output function has a minimum. This is indeed correct. In the sequel we state and prove theorems, including some that relax the requirement of strictly or globally decreasing, and also discuss converse theorems that guarantee the existence of such functions. Figure 1: Output decreasing along trajectories, V not proper Much of the power of the method comes from its simplicity one does not need to know any solutions: Knowing only the differential (or difference) equation one can easily establish whether such an output function is decreasing along solutions. However, while it is easy to see that for every asymptotically stable system there exists many, even smooth, such Lyapunov functions, in many cases it is almost impossible to get one s hands onto one such Lyapunov function. They are easy to construct for e.g. linear systems, and many strategies are available for special classes in general it is a true art to come up with explicit formulas for good candidate Lyapunov functions.

2 M.Kawski, APM 581 Diff Equns Intro to Lyapunov theory. November 15, 29 2 We begin with one example and some preliminary definitions. For a function V : R n R and a locally Lipschitz continuous vector field f: R n R n define the derivative V (p) of V along the flow Φ of f at the point p R n by the following limit provided it exists 1 V (p) = lim (V (Φ(t, p)) V (p)). t t In the case that V is continuously differentiable, this agrees with the directional derivative of V in the direction of f(p) at p. This is defined for any vector field f: R n R n, and if V is continuously differentiable, one has the formula V = (DV ) f which is convenient for practical applications. In particular, for any times t 1 t 2 and any point p for which the flow is defined, the fundamental theorem of calculus yields that V is decreasing if V is nonpositive along a trajectory. t2 t2 V (Φ(t 2, p)) V (Φ(t 1, p)) = V (Φ(t, p) dt dt =. t 1 t 1 Example 1 For a damped pendulum, write the equation of motion ml φ+mk φ+mg sin φ = as a first order system: ẋ = y ẏ = g sin x ky l Figure 2: Generalized Lyapunov function for pendulum A natural candidate Lyapunov function is obtained from the total energy E = E pot + E kin = mgl(1 cos φ) ml2 φ2. In the (x, y) coordinates this yields, after division by m, the candidate Lyapunov function

3 M.Kawski, APM 581 Diff Equns Intro to Lyapunov theory. November 15, 29 3 V (x, y) = gl(1 cos x) l2 y 2 Near the origin, the graph of this function looks very similar to a paraboloid but globally it has other features which will motivate more detailed studies later. It is easily seen (and discussed in detail below) that the rate of change of V along solutions of the system for positive friction k >, as long as y, (with common abuse of notation) V (x, y) = (DV )(x, y) (ẋ, ẏ) = gly sin x + l 2 y( g l sin x ky) = k l2 y 2 clearly is negative. It makes sense that at the instances when the angular velocity y = φ is zero (i.e. when the pendulum changes directions), there is no loss of energy. But since the pendulum cannot stay in any of these states, it will continue to lose energy, and settle into an equilibrium corresponding to V =. The detailed analysis of situations in which the Lyapunov function is not strictly decreasing along trajectories culminates in Lasalle s Invariance Principle. Definition 1 A function V : R n [, ) is called positive definite if V (x) = if and only if x =. A function V : X Y between topological spaces X and Y is called proper if for every compact set K Y its preimage V 1 (K) X is compact. A function V : R n [, ) is called radially unbounded if for every M R there exists R R such that for all x R n, if x > R then V (x) > M. Proposition 1 A continuous function V : R n [, ) is radially unbounded if and only if it is proper. Suppose V : R n [, ) is continuous and proper, and M [, ). The interval [, M] is compact, and since f is proper, the preimage K = V 1 ([, M]) is compact. In particular, K R n is bounded, i.e., there exists R R such that K B n (, R). If x R n such that x > R, then x K = V 1 ([, M]), and thus V (x) > M. Conversely suppose V is continuous and radially unbounded and let K R be compact. Thus K is closed, and by continuity of V, the preimage V 1 (K) R n is also closed. Since K is bounded, there exists M R such that K [ M, M]. Since V is radially unbounded, there exists R R so that V (R n \ B n (, R)) (M, ). Therefore, V 1 (K) B n (, R) and V 1 (K) is compact.

4 M.Kawski, APM 581 Diff Equns Intro to Lyapunov theory. November 15, 29 4 Note: Even if a continuous function V goes to infinity along along every ray r (r cos θ, r sin θ) as r goes to infinity, it need not be radially unbounded as the following simple example shows. V ( r, ) = r2 + r 2 and V (r cos θ, r sin θ) = r2 + r 2 1 (1 ) if θ π. 1+r 2 1+r 2 1+(r tan( θ 2 ))2 There are many versions of Lyapunov stability theorems that make different regularity assumptions, that are local or global in nature, that concern continuous or discrete dynamical systems (differential or difference equations), deterministic or stochastic, finite or infinite (PDE) dimensional. They all have in common the picture sketched above, but the technical details may offer many challenges. Theorem 1 Suppose f: R n R n is locally Lipschitz continuous, f() =, and V : R n R is continuously differentiable, proper, positive definite such that V is negative definite. Then the origin is a globally asymptotically stable equilibrium of x = f(x). A function V satisfying the hypotheses of this theorem is called a Lyapunov function for the (flow of the) system x = f(x). Since f is locally Lipschitz continuous, solutions to initial value problems of x = f(x) exist locally and are unique. The only way that they can fail to exist for all positive times is if they escape to infinity in finite time. But since for every q R n, and every t, V (Φ(t, q)) V (q), and the sublevelset V 1 ([, V (q)]) is compact, every solution curve stays bounded in forward time. To show Lyapunov stability suppose ε > is given. Choose ε 1 (, ε). Since V is continuous and the closed ball B n (, ε 1 ) B n (, ε) is compact, there exists M R such that V is bounded above by M on B n (, ε 1 ). Since V is continuous, there exists δ > such that for all x B n (, δ), V (x) < M. Hence for every p B n (, δ) and every t, since V is nonpositive, V (Φ(t, p)) = V (p) + t V (Φ(s, p)) ds V (p) M. Hence for every p B n (, δ) and all t, Φ(t, p) B n (, ε 1 ) B n (, ε). To show that the origin is attractive, fix any p R n and define c = lim inf t V (Φ(t, p)) = lim t V (Φ(t, p)) If c = then we are done since V is positive definite. Otherwise, choose δ > such that < c δ < c + δ < V (p), and consider the annular region A = V 1 ([c δ < c + δ]) R n. Since V is proper, A is compact.

5 M.Kawski, APM 581 Diff Equns Intro to Lyapunov theory. November 15, 29 5 Figure 3: No positive limit for V (Φ(t, p)) Since V is continuously differentiable and f is continuous, V is continuous. Since V is negative definite, there exists µ > such that for all x A, V (x) µ. By choice of c there exists T R such that V (Φ(T, p)) < c + δ, i.e., Φ(T, p) A. Calculate: 2δ V (Φ(T + 2δ, p)) = V (Φ(T, p)) + µ µ which contradicts the choice of c. V (Φ(T + s, p)) ds (c + δ) + Thus c = and the origin is globally asymptotically stable. 2δ µ µ ds (c δ) Theorem 2 Suppose Ω R n is open, Ω, f: Ω R n is locally Lipschitz continuous, f() =, and V : Ω R is continuously differentiable, positive definite (on Ω) and such that V is negative definite. Then the origin is a locally asymptotically stable equilibrium of x = f(x), i.e. there exists an open neighborhood U R n of the origin such that every solution starting at any p U is defined for all positive times, will converge to the origin as t goes to infinity, and the equilibrium is Lyapunov stable. For time-varying systems x = f(t, x) there exists a parallel rich theory which utilizes time varying Lyapunov functions V (t, x). The main additional technical feature that one needs

6 M.Kawski, APM 581 Diff Equns Intro to Lyapunov theory. November 15, 29 6 to be attentive of is that definiteness properties be uniform in time, e.g. V (t, x, y) = x 2 + e t y 2 are not sufficient. functions like Theorem 3 (Lasalle s Invariance Principle) Suppose Ω R n is open, f: Ω R n is locally Lipschitz continuous, and V : Ω R is continuously differentiable. Suppose K Ω is compact, invariant, and for all x K, V (x). Let E = V 1 () and let M E be the largest invariant set contained in E. Then every solution starting in K approaches M as t. Comments: In many common applications of Lasalle s Invariance Principle V is a positive definite function which fails to guarantee that V is negative definite only because there are some points, like in the example of the damped pendulum, where V vanishes. One usually proceeds by demonstrating that f is nontangent to the set E = V 1 () except at the equilibrium point to conclude asymptotic stability However, Lasalle s theorem has much broader applications e.g., in the statement above there is no requirement that V be positive definite. Thus it also applies to the example of the energy function for the damped pendulum which has infinite numbers of local minima and saddle points, compare figure 1 there is no need to first restrict one s attention to a small neighborhood of one equilibrium point on which V is positive definite. Suppose K, f, V, E and M are as in the statement of the theorem. Suppose p K and consider the curve t Φ(t, p). Since V is continuous it is bounded from below on the compact set K. Since K is invariant by hypothesis, for all t, Φ(t, p) K. Moreover, using that K is compact, and hence bounded, the ω-limit set ω(p) is nonempty. Since K is closed, ω(p) K. Using lemma 4, for all q ω(p), V (q) = and therefore ω(p) {y : V (y) = } = V 1 () = E M. Since ω-limit sets are invariant, ω(p) M. Since ω-limit sets are attracting, for every ɛ > there exists T R such that for every t > T there exists q ω(p) such that Φ(t, p) q < ε. Since ω(p) M, it follows that q M. This proves that the solution curve starting at an arbitrary p K approaches M as t. Lemma 4 Suppose Ω R n is open, f: Ω R n is locally Lipschitz continuous, and V : Ω R is continuously differentiable and bounded from below. Suppose that p Ω and for all t, Φ(t, p) is defined and is contained in Ω. Then for all q ω(p), V (q) =.

7 M.Kawski, APM 581 Diff Equns Intro to Lyapunov theory. November 15, 29 7 Suppose Ω, f, V and p are as in the statement of the lemma. If ω(p) = then there is nothing to prove. Suppose q 1 = q 3 ω(p), q 2 ω(p) and fix any ε >. Since V is continuous at q 1 and at q 2, there exists δ > such that for all x Ω, for i = 1, 2, if x q i < δ then V (x) V (q i ) < ε 4. Since q 1, q 2 ω(p), there exist t 1 t 2 t 3 such that for i = 1, 2, 3, Φ(t i, p) q i < δ, and hence for i = 1, 2, 3, V (Φ(t i, p)) V (q i ) < ε 4. This implies that V (Φ(t 3, p)) V (Φ(t 1, p)) V (Φ(t 3, p)) V (q 1 ) + V (q 1 ) V (Φ(t 1, p)) < ε 2. Since V does not change sign this implies Therefore V (Φ(t 2, p)) V (Φ(t 1, p)) = t2 t 1 t3 t 1 V (Φ(s, p) ds V (Φ(s, p) ds V (Φ(t 3, p)) V (Φ(t 1, p)) < ε 2. V (q 2 ) V (q 1 ) V (q 2 ) V (Φ(t 2, p)) + V (Φ(t 2, p)) V (Φ(t 1, p)) + V (Φ(t 1, p)) V (q 1 ) < ε 4 + ε 2 + ε 4 = ε. Since ε > was arbitrary, this establishes that V is constant on ω(p). Now use that ω(p) is invariant, i.e., for every q ω(p) and all t R, Φ(t, q) ω(p). By the foregoing, for every q ω(p) and all t R, V (Φ(t, q)) = V (q) and therefore V (q) = d 1 dt t= (V (Φ(t, q)) V (q)) =, t proving that V vanishes identically on ω(p). There are many theorems that guarantee for every asymptotically stable system the existence of Lyapunov functions, even with various additional properties such as being C, or being homogeneous. But these theorems are mainly useful for theoretical purposes, since, even though their proofs are generally very constructive, they rely on knowing the solutions of the system! In practical applications, where one tries to find a candidate Lyapunov function to establish asymptotic stability, it generally is considered an art to come up with good candidates. Even if one has found a Lyapunov function, it may be very difficult to rigorously prove that its derivative along solution curves is negative definite. A few general suggestions: For asymptotically stable linear systems one always can find a quadratic Lyapunov function. There is a rich literature in engineering about effectively computing suitable Lyapunov functions. One of their main uses is to establish robustness properties, i.e. showing that suitable perturbations of an asymptotically stable system are still asymptotically stable.

8 M.Kawski, APM 581 Diff Equns Intro to Lyapunov theory. November 15, 29 8 In systems arising from modeling physical models, the total energy of the system, and various similarly inspired output functions often serve as good starting points. Taking Taylor approximations of smooth systems yields systems with polynomial right hand sides. These suggest that one try polynomial functions as candidate Lyapunov functions. These are finitely parameterized, and one obtains inequalities for definiteness of V and V that have a finite number of parameters, and thus may be amenable to plain calculus methods for establishing that some minimum is nonnegative for suitable choices of parameters. In general it may be easier to start with a desired negative definite V, use this to compute the corresponding V, and then show that V is positive definite! This is demonstrated in the following simple theorem for linear systems. Theorem 5 Suppose A R n n. The origin is an asymptotically stable equilibrium point of the system x = Ax if and only for every positive definite Q = Q T R n n there exists a positive definite P = P T R n n such that P A + A T P = Q. Moreover, such P is unique. Sufficiency is immediate. Conversely suppose that all eigenvalues of A have strictly negative real parts and Q = Q T is positive definite. Define P = e tat Qe ta dt. This integral converges absolutely because the norm of the integrand is bounded by a function of the form Ct N e αt for some positive constants C, N, α. It is clear that P = P R is symmetric since the integrand is symmetric at every t To show that P is positive definite, suppose x R n is such that x T P x =. Then ( = e ta x ) T ( Q e ta x ) dt Since Q is positive definite this implies that for all t e ta x =. Since for every t, e ta is invertible, this implies x = proving that P is positive definite. To show that the function V (x) = x T P x has the desired derivative along solutions, first note that formally V (x) = ẋ T P x + x T P dotx = x T (P A + A T P )x. Now calculate ) P A + A T P = (e tat Qe ta A + A T e tat Qe ta dt = ) d (e tat Qe ta dt dt = e tat Qe ta = Q.

9 M.Kawski, APM 581 Diff Equns Intro to Lyapunov theory. November 15, 29 9 To show uniqueness, suppose P, P R n n are both positive definite, symmetric and satisfy P A + A T P = P A + A T P = Q. Then (P P )A + A T (P P ( ) =, and hence for every t e tat (P P )A + A T (P P ) ) e ta = But the expression on the left hand side is the time derivative d dt etat (P P ))e ta. Since the derivative vanishes identically, the product e tat (P P )e ta must be a constant function of t, and in particular, must at every time be equal to its value at t =. Therefore for all t, e tat (P P ))e ta = e AT (P P )e A = P P. On the other hand, since the origin was assumed to be asymptotically stable, as t goes to infinity, e ta goes to zero, and therefore (P P ) = lim t etat (P P ))e ta = (P P )) =. Proofs of converse theorem for nonlinear systems use a similar constructions. One technical difficulty is that the solution might not converge exponentially fast to the equilibrium, and hence integrals like V (x) = Φ(t, x) 2 dt need not converge. Moreover, one needs to establish that even if this defines a function value V (x) at every point, that the so-defined function is indeed continuously differentiable. It turns out that one can always achieve that V is even C, compare classic theorems by Massera and Kurzweil. As a hands-on example to illustrate the construction, consider the system x = Ax where ( ) ( ) 1 1 A =, and define Q = I = Make the Ansatz V (x) = x T P x = p 11 x p 12 x 1 x 2 + p 22 x 2 2 with p ij R. Calculate the derivative along solutions of x = Ax. V (x) = (Ax) T P x + x T P (Ax) = 2p 11 x 1 x 2 2p 12 x p 12 x 2 1 2p 12 x 1 x 2 + p 22 x 1 x 2 p 22 x 2 2 = 2p 12 x ( p 11 p 12 + p 22 )x 1 x 2 + 2( p 12 p 22 )x 2 2! = x 2 1 x 2 2. This defines a linear system for the entries of P 2 p p p 22 which has the unique solution ( 3 1 P = = When trying to adapt Lyapunov methods for stability to an instability theorem, a first thought might be to keep V positive definite and argue with indefinite V. But unlike in stability theorems, one does need to consider all trajectories. Hence it suffices to identify a suitable region in which both V and V have the same sign. The following statement and arguments use the delicate intersection of a closed set F with the open set V 1 (, ). ). 1 1

10 M.Kawski, APM 581 Diff Equns Intro to Lyapunov theory. November 15, 29 1 Theorem 6 (adapted from Chetaev 1934). Suppose E R n is open, E, f: E R n and V : E R are continuously differentiable, f() =, V () =. Suppose U an open neighborhood of with compact closure F = U E such that the restriction of V = (DV )f to F V 1 (, ) is strictly positive. If for every open neighborhood W R n of the set W V 1 (, ) is nonempty, then the origin is an unstable equilibrium of ẋ = f(x). Assume above hypotheses. Let W be an open neighborhood of R n. There exists z W V 1 (, ). Define a = V (z) >. The set K = F V 1 [a, ) is compact, and it is nonempty since z K. Using the continuity of V and V there exist m = min x K V (x) and M = max x K V (x). Since K = F V 1 [a, ) F V 1 (, ) it follows that m >. Let I [, ) be the maximal interval of existence for φ: I E such that φ() = z, and φ = f φ. Define the set T = {t I: for all s [, t], φ(s) K}. For all t T, Hence for all t T, d (V φ)(t) = ( V φ)(t) m. dt V (φ(t)) = V (φ() + t V (φ(s)) ds a + mt. Since V is bounded above by M, T is also bounded above. Let t the the least upper bound of T. Since K E, I [, t ] and φ(t ) is well-defined. Moreover t lies in the interior of I. Since for all t [, t ), φ(t) K, and for every δ > there exist t I, t < t < t + δ such that φ(t) K it follows that φ(t ) lies on the boundary of the set K. The boundary of K is contained in the union K V 1 (a) (F \ U). Since V (φ(t )) a + mt > a it follows that φ(t ) V 1 (a). Therefore φ(t ) (F \ U), and, in particular, φ(t ) U. Since W was arbitrary, this shows that the origin is an unstable equilibrium of f. This is a very first draft, likely with many many type-ohs. Comments are appreciated.

### Chapter III. Stability of Linear Systems

1 Chapter III Stability of Linear Systems 1. Stability and state transition matrix 2. Time-varying (non-autonomous) systems 3. Time-invariant systems 1 STABILITY AND STATE TRANSITION MATRIX 2 In this chapter,

### Topic # /31 Feedback Control Systems. Analysis of Nonlinear Systems Lyapunov Stability Analysis

Topic # 16.30/31 Feedback Control Systems Analysis of Nonlinear Systems Lyapunov Stability Analysis Fall 010 16.30/31 Lyapunov Stability Analysis Very general method to prove (or disprove) stability of

### 3 Stability and Lyapunov Functions

CDS140a Nonlinear Systems: Local Theory 02/01/2011 3 Stability and Lyapunov Functions 3.1 Lyapunov Stability Denition: An equilibrium point x 0 of (1) is stable if for all ɛ > 0, there exists a δ > 0 such

### Lyapunov Stability Theory

Lyapunov Stability Theory Peter Al Hokayem and Eduardo Gallestey March 16, 2015 1 Introduction In this lecture we consider the stability of equilibrium points of autonomous nonlinear systems, both in continuous

### Nonlinear Control. Nonlinear Control Lecture # 3 Stability of Equilibrium Points

Nonlinear Control Lecture # 3 Stability of Equilibrium Points The Invariance Principle Definitions Let x(t) be a solution of ẋ = f(x) A point p is a positive limit point of x(t) if there is a sequence

### Nonlinear Systems and Control Lecture # 12 Converse Lyapunov Functions & Time Varying Systems. p. 1/1

Nonlinear Systems and Control Lecture # 12 Converse Lyapunov Functions & Time Varying Systems p. 1/1 p. 2/1 Converse Lyapunov Theorem Exponential Stability Let x = 0 be an exponentially stable equilibrium

### (x k ) sequence in F, lim x k = x x F. If F : R n R is a function, level sets and sublevel sets of F are any sets of the form (respectively);

STABILITY OF EQUILIBRIA AND LIAPUNOV FUNCTIONS. By topological properties in general we mean qualitative geometric properties (of subsets of R n or of functions in R n ), that is, those that don t depend

### Lecture 4. Chapter 4: Lyapunov Stability. Eugenio Schuster. Mechanical Engineering and Mechanics Lehigh University.

Lecture 4 Chapter 4: Lyapunov Stability Eugenio Schuster schuster@lehigh.edu Mechanical Engineering and Mechanics Lehigh University Lecture 4 p. 1/86 Autonomous Systems Consider the autonomous system ẋ

### EN Nonlinear Control and Planning in Robotics Lecture 3: Stability February 4, 2015

EN530.678 Nonlinear Control and Planning in Robotics Lecture 3: Stability February 4, 2015 Prof: Marin Kobilarov 0.1 Model prerequisites Consider ẋ = f(t, x). We will make the following basic assumptions

### 1 The Observability Canonical Form

NONLINEAR OBSERVERS AND SEPARATION PRINCIPLE 1 The Observability Canonical Form In this Chapter we discuss the design of observers for nonlinear systems modelled by equations of the form ẋ = f(x, u) (1)

### Nonlinear Control. Nonlinear Control Lecture # 8 Time Varying and Perturbed Systems

Nonlinear Control Lecture # 8 Time Varying and Perturbed Systems Time-varying Systems ẋ = f(t,x) f(t,x) is piecewise continuous in t and locally Lipschitz in x for all t 0 and all x D, (0 D). The origin

### There is a more global concept that is related to this circle of ideas that we discuss somewhat informally. Namely, a region R R n with a (smooth)

82 Introduction Liapunov Functions Besides the Liapunov spectral theorem, there is another basic method of proving stability that is a generalization of the energy method we have seen in the introductory

### Nonlinear Control. Nonlinear Control Lecture # 2 Stability of Equilibrium Points

Nonlinear Control Lecture # 2 Stability of Equilibrium Points Basic Concepts ẋ = f(x) f is locally Lipschitz over a domain D R n Suppose x D is an equilibrium point; that is, f( x) = 0 Characterize and

### Introduction to Nonlinear Control Lecture # 3 Time-Varying and Perturbed Systems

p. 1/5 Introduction to Nonlinear Control Lecture # 3 Time-Varying and Perturbed Systems p. 2/5 Time-varying Systems ẋ = f(t, x) f(t, x) is piecewise continuous in t and locally Lipschitz in x for all t

### Dynamical Systems & Lyapunov Stability

Dynamical Systems & Lyapunov Stability Harry G. Kwatny Department of Mechanical Engineering & Mechanics Drexel University Outline Ordinary Differential Equations Existence & uniqueness Continuous dependence

### Nonlinear Control Lecture 5: Stability Analysis II

Nonlinear Control Lecture 5: Stability Analysis II Farzaneh Abdollahi Department of Electrical Engineering Amirkabir University of Technology Fall 2010 Farzaneh Abdollahi Nonlinear Control Lecture 5 1/41

### LMI Methods in Optimal and Robust Control

LMI Methods in Optimal and Robust Control Matthew M. Peet Arizona State University Lecture 15: Nonlinear Systems and Lyapunov Functions Overview Our next goal is to extend LMI s and optimization to nonlinear

### Solution of Additional Exercises for Chapter 4

1 1. (1) Try V (x) = 1 (x 1 + x ). Solution of Additional Exercises for Chapter 4 V (x) = x 1 ( x 1 + x ) x = x 1 x + x 1 x In the neighborhood of the origin, the term (x 1 + x ) dominates. Hence, the

### Georgia Institute of Technology Nonlinear Controls Theory Primer ME 6402

Georgia Institute of Technology Nonlinear Controls Theory Primer ME 640 Ajeya Karajgikar April 6, 011 Definition Stability (Lyapunov): The equilibrium state x = 0 is said to be stable if, for any R > 0,

### An introduction to Mathematical Theory of Control

An introduction to Mathematical Theory of Control Vasile Staicu University of Aveiro UNICA, May 2018 Vasile Staicu (University of Aveiro) An introduction to Mathematical Theory of Control UNICA, May 2018

### Stability of Feedback Solutions for Infinite Horizon Noncooperative Differential Games

Stability of Feedback Solutions for Infinite Horizon Noncooperative Differential Games Alberto Bressan ) and Khai T. Nguyen ) *) Department of Mathematics, Penn State University **) Department of Mathematics,

### Stability of Nonlinear Systems An Introduction

Stability of Nonlinear Systems An Introduction Michael Baldea Department of Chemical Engineering The University of Texas at Austin April 3, 2012 The Concept of Stability Consider the generic nonlinear

### LECTURE 8: DYNAMICAL SYSTEMS 7

15-382 COLLECTIVE INTELLIGENCE S18 LECTURE 8: DYNAMICAL SYSTEMS 7 INSTRUCTOR: GIANNI A. DI CARO GEOMETRIES IN THE PHASE SPACE Damped pendulum One cp in the region between two separatrix Separatrix Basin

### Using Lyapunov Theory I

Lecture 33 Stability Analysis of Nonlinear Systems Using Lyapunov heory I Dr. Radhakant Padhi Asst. Professor Dept. of Aerospace Engineering Indian Institute of Science - Bangalore Outline Motivation Definitions

### Propagating terraces and the dynamics of front-like solutions of reaction-diffusion equations on R

Propagating terraces and the dynamics of front-like solutions of reaction-diffusion equations on R P. Poláčik School of Mathematics, University of Minnesota Minneapolis, MN 55455 Abstract We consider semilinear

### Stability in the sense of Lyapunov

CHAPTER 5 Stability in the sense of Lyapunov Stability is one of the most important properties characterizing a system s qualitative behavior. There are a number of stability concepts used in the study

### Converse Lyapunov theorem and Input-to-State Stability

Converse Lyapunov theorem and Input-to-State Stability April 6, 2014 1 Converse Lyapunov theorem In the previous lecture, we have discussed few examples of nonlinear control systems and stability concepts

### MCE693/793: Analysis and Control of Nonlinear Systems

MCE693/793: Analysis and Control of Nonlinear Systems Lyapunov Stability - I Hanz Richter Mechanical Engineering Department Cleveland State University Definition of Stability - Lyapunov Sense Lyapunov

### 3. Fundamentals of Lyapunov Theory

Applied Nonlinear Control Nguyen an ien -.. Fundamentals of Lyapunov heory he objective of this chapter is to present Lyapunov stability theorem and illustrate its use in the analysis and the design of

### Solution of Linear State-space Systems

Solution of Linear State-space Systems Homogeneous (u=0) LTV systems first Theorem (Peano-Baker series) The unique solution to x(t) = (t, )x 0 where The matrix function is given by is called the state

### Half of Final Exam Name: Practice Problems October 28, 2014

Math 54. Treibergs Half of Final Exam Name: Practice Problems October 28, 24 Half of the final will be over material since the last midterm exam, such as the practice problems given here. The other half

### An introduction to Birkhoff normal form

An introduction to Birkhoff normal form Dario Bambusi Dipartimento di Matematica, Universitá di Milano via Saldini 50, 0133 Milano (Italy) 19.11.14 1 Introduction The aim of this note is to present an

### MCE/EEC 647/747: Robot Dynamics and Control. Lecture 8: Basic Lyapunov Stability Theory

MCE/EEC 647/747: Robot Dynamics and Control Lecture 8: Basic Lyapunov Stability Theory Reading: SHV Appendix Mechanical Engineering Hanz Richter, PhD MCE503 p.1/17 Stability in the sense of Lyapunov A

### Calculating the domain of attraction: Zubov s method and extensions

Calculating the domain of attraction: Zubov s method and extensions Fabio Camilli 1 Lars Grüne 2 Fabian Wirth 3 1 University of L Aquila, Italy 2 University of Bayreuth, Germany 3 Hamilton Institute, NUI

### Now I switch to nonlinear systems. In this chapter the main object of study will be

Chapter 4 Stability 4.1 Autonomous systems Now I switch to nonlinear systems. In this chapter the main object of study will be ẋ = f(x), x(t) X R k, f : X R k, (4.1) where f is supposed to be locally Lipschitz

### LAW OF LARGE NUMBERS FOR THE SIRS EPIDEMIC

LAW OF LARGE NUMBERS FOR THE SIRS EPIDEMIC R. G. DOLGOARSHINNYKH Abstract. We establish law of large numbers for SIRS stochastic epidemic processes: as the population size increases the paths of SIRS epidemic

### Prof. Krstic Nonlinear Systems MAE281A Homework set 1 Linearization & phase portrait

Prof. Krstic Nonlinear Systems MAE28A Homework set Linearization & phase portrait. For each of the following systems, find all equilibrium points and determine the type of each isolated equilibrium. Use

### B5.6 Nonlinear Systems

B5.6 Nonlinear Systems 5. Global Bifurcations, Homoclinic chaos, Melnikov s method Alain Goriely 2018 Mathematical Institute, University of Oxford Table of contents 1. Motivation 1.1 The problem 1.2 A

### Nonlinear Control. Nonlinear Control Lecture # 8 Time Varying and Perturbed Systems

Nonlinear Control Lecture # 8 Time Varying and Perturbed Systems Time-varying Systems ẋ = f(t,x) f(t,x) is piecewise continuous in t and locally Lipschitz in x for all t 0 and all x D, (0 D). The origin

### Nonlinear Autonomous Systems of Differential

Chapter 4 Nonlinear Autonomous Systems of Differential Equations 4.0 The Phase Plane: Linear Systems 4.0.1 Introduction Consider a system of the form x = A(x), (4.0.1) where A is independent of t. Such

### Locally convex spaces, the hyperplane separation theorem, and the Krein-Milman theorem

56 Chapter 7 Locally convex spaces, the hyperplane separation theorem, and the Krein-Milman theorem Recall that C(X) is not a normed linear space when X is not compact. On the other hand we could use semi

### Convergence Rate of Nonlinear Switched Systems

Convergence Rate of Nonlinear Switched Systems Philippe JOUAN and Saïd NACIRI arxiv:1511.01737v1 [math.oc] 5 Nov 2015 January 23, 2018 Abstract This paper is concerned with the convergence rate of the

### Stability theory is a fundamental topic in mathematics and engineering, that include every

Stability Theory Stability theory is a fundamental topic in mathematics and engineering, that include every branches of control theory. For a control system, the least requirement is that the system is

### Modeling and Analysis of Dynamic Systems

Modeling and Analysis of Dynamic Systems Dr. Guillaume Ducard Fall 2017 Institute for Dynamic Systems and Control ETH Zurich, Switzerland G. Ducard c 1 / 57 Outline 1 Lecture 13: Linear System - Stability

### One Dimensional Dynamical Systems

16 CHAPTER 2 One Dimensional Dynamical Systems We begin by analyzing some dynamical systems with one-dimensional phase spaces, and in particular their bifurcations. All equations in this Chapter are scalar

### Nonlinear systems. Lyapunov stability theory. G. Ferrari Trecate

Nonlinear systems Lyapunov stability theory G. Ferrari Trecate Dipartimento di Ingegneria Industriale e dell Informazione Università degli Studi di Pavia Advanced automation and control Ferrari Trecate

### Handout 2: Invariant Sets and Stability

Engineering Tripos Part IIB Nonlinear Systems and Control Module 4F2 1 Invariant Sets Handout 2: Invariant Sets and Stability Consider again the autonomous dynamical system ẋ = f(x), x() = x (1) with state

### Continuous and Piecewise Affine Lyapunov Functions using the Yoshizawa Construction

Continuous and Piecewise Affine Lyapunov Functions using the Yoshizawa Construction Sigurður Hafstein, Christopher M Kellett, Huijuan Li Abstract We present a novel numerical technique for the computation

### The Liapunov Method for Determining Stability (DRAFT)

44 The Liapunov Method for Determining Stability (DRAFT) 44.1 The Liapunov Method, Naively Developed In the last chapter, we discussed describing trajectories of a 2 2 autonomous system x = F(x) as level

### Achieve asymptotic stability using Lyapunov's second method

IOSR Journal of Mathematics (IOSR-JM) e-issn: 78-578, p-issn: 39-765X Volume 3, Issue Ver I (Jan - Feb 07), PP 7-77 wwwiosrjournalsorg Achieve asymptotic stability using Lyapunov's second method Runak

### A plane autonomous system is a pair of simultaneous first-order differential equations,

Chapter 11 Phase-Plane Techniques 11.1 Plane Autonomous Systems A plane autonomous system is a pair of simultaneous first-order differential equations, ẋ = f(x, y), ẏ = g(x, y). This system has an equilibrium

### Math Ordinary Differential Equations

Math 411 - Ordinary Differential Equations Review Notes - 1 1 - Basic Theory A first order ordinary differential equation has the form x = f(t, x) (11) Here x = dx/dt Given an initial data x(t 0 ) = x

### A Unified Analysis of Nonconvex Optimization Duality and Penalty Methods with General Augmenting Functions

A Unified Analysis of Nonconvex Optimization Duality and Penalty Methods with General Augmenting Functions Angelia Nedić and Asuman Ozdaglar April 16, 2006 Abstract In this paper, we study a unifying framework

### Periodic Sinks and Observable Chaos

Periodic Sinks and Observable Chaos Systems of Study: Let M = S 1 R. T a,b,l : M M is a three-parameter family of maps defined by where θ S 1, r R. θ 1 = a+θ +Lsin2πθ +r r 1 = br +blsin2πθ Outline of Contents:

### Navigation and Obstacle Avoidance via Backstepping for Mechanical Systems with Drift in the Closed Loop

Navigation and Obstacle Avoidance via Backstepping for Mechanical Systems with Drift in the Closed Loop Jan Maximilian Montenbruck, Mathias Bürger, Frank Allgöwer Abstract We study backstepping controllers

### STABILITY. Phase portraits and local stability

MAS271 Methods for differential equations Dr. R. Jain STABILITY Phase portraits and local stability We are interested in system of ordinary differential equations of the form ẋ = f(x, y), ẏ = g(x, y),

### ODE Final exam - Solutions

ODE Final exam - Solutions May 3, 018 1 Computational questions (30 For all the following ODE s with given initial condition, find the expression of the solution as a function of the time variable t You

### 2.10 Saddles, Nodes, Foci and Centers

2.10 Saddles, Nodes, Foci and Centers In Section 1.5, a linear system (1 where x R 2 was said to have a saddle, node, focus or center at the origin if its phase portrait was linearly equivalent to one

### STABILITY ANALYSIS OF DYNAMIC SYSTEMS

C. Melchiorri (DEI) Automatic Control & System Theory 1 AUTOMATIC CONTROL AND SYSTEM THEORY STABILITY ANALYSIS OF DYNAMIC SYSTEMS Claudio Melchiorri Dipartimento di Ingegneria dell Energia Elettrica e

### Chapter 6 Nonlinear Systems and Phenomena. Friday, November 2, 12

Chapter 6 Nonlinear Systems and Phenomena 6.1 Stability and the Phase Plane We now move to nonlinear systems Begin with the first-order system for x(t) d dt x = f(x,t), x(0) = x 0 In particular, consider

### Consider a particle in 1D at position x(t), subject to a force F (x), so that mẍ = F (x). Define the kinetic energy to be.

Chapter 4 Energy and Stability 4.1 Energy in 1D Consider a particle in 1D at position x(t), subject to a force F (x), so that mẍ = F (x). Define the kinetic energy to be T = 1 2 mẋ2 and the potential energy

### The Dirichlet s P rinciple. In this lecture we discuss an alternative formulation of the Dirichlet problem for the Laplace equation:

Oct. 1 The Dirichlet s P rinciple In this lecture we discuss an alternative formulation of the Dirichlet problem for the Laplace equation: 1. Dirichlet s Principle. u = in, u = g on. ( 1 ) If we multiply

### u( x) = g( y) ds y ( 1 ) U solves u = 0 in U; u = 0 on U. ( 3)

M ath 5 2 7 Fall 2 0 0 9 L ecture 4 ( S ep. 6, 2 0 0 9 ) Properties and Estimates of Laplace s and Poisson s Equations In our last lecture we derived the formulas for the solutions of Poisson s equation

### ẋ = f(x, y), ẏ = g(x, y), (x, y) D, can only have periodic solutions if (f,g) changes sign in D or if (f,g)=0in D.

4 Periodic Solutions We have shown that in the case of an autonomous equation the periodic solutions correspond with closed orbits in phase-space. Autonomous two-dimensional systems with phase-space R

### Tangent spaces, normals and extrema

Chapter 3 Tangent spaces, normals and extrema If S is a surface in 3-space, with a point a S where S looks smooth, i.e., without any fold or cusp or self-crossing, we can intuitively define the tangent

### APPPHYS217 Tuesday 25 May 2010

APPPHYS7 Tuesday 5 May Our aim today is to take a brief tour of some topics in nonlinear dynamics. Some good references include: [Perko] Lawrence Perko Differential Equations and Dynamical Systems (Springer-Verlag

### CHAPTER 7. Connectedness

CHAPTER 7 Connectedness 7.1. Connected topological spaces Definition 7.1. A topological space (X, T X ) is said to be connected if there is no continuous surjection f : X {0, 1} where the two point set

### Metric Spaces and Topology

Chapter 2 Metric Spaces and Topology From an engineering perspective, the most important way to construct a topology on a set is to define the topology in terms of a metric on the set. This approach underlies

### 2tdt 1 y = t2 + C y = which implies C = 1 and the solution is y = 1

Lectures - Week 11 General First Order ODEs & Numerical Methods for IVPs In general, nonlinear problems are much more difficult to solve than linear ones. Unfortunately many phenomena exhibit nonlinear

### Control of Mobile Robots

Control of Mobile Robots Regulation and trajectory tracking Prof. Luca Bascetta (luca.bascetta@polimi.it) Politecnico di Milano Dipartimento di Elettronica, Informazione e Bioingegneria Organization and

### Optimization and Optimal Control in Banach Spaces

Optimization and Optimal Control in Banach Spaces Bernhard Schmitzer October 19, 2017 1 Convex non-smooth optimization with proximal operators Remark 1.1 (Motivation). Convex optimization: easier to solve,

### Key words. saddle-point dynamics, asymptotic convergence, convex-concave functions, proximal calculus, center manifold theory, nonsmooth dynamics

SADDLE-POINT DYNAMICS: CONDITIONS FOR ASYMPTOTIC STABILITY OF SADDLE POINTS ASHISH CHERUKURI, BAHMAN GHARESIFARD, AND JORGE CORTÉS Abstract. This paper considers continuously differentiable functions of

### Control, Stabilization and Numerics for Partial Differential Equations

Paris-Sud, Orsay, December 06 Control, Stabilization and Numerics for Partial Differential Equations Enrique Zuazua Universidad Autónoma 28049 Madrid, Spain enrique.zuazua@uam.es http://www.uam.es/enrique.zuazua

### An asymptotic ratio characterization of input-to-state stability

1 An asymptotic ratio characterization of input-to-state stability Daniel Liberzon and Hyungbo Shim Abstract For continuous-time nonlinear systems with inputs, we introduce the notion of an asymptotic

### 1 Directional Derivatives and Differentiability

Wednesday, January 18, 2012 1 Directional Derivatives and Differentiability Let E R N, let f : E R and let x 0 E. Given a direction v R N, let L be the line through x 0 in the direction v, that is, L :=

### Stabilization of a 3D Rigid Pendulum

25 American Control Conference June 8-, 25. Portland, OR, USA ThC5.6 Stabilization of a 3D Rigid Pendulum Nalin A. Chaturvedi, Fabio Bacconi, Amit K. Sanyal, Dennis Bernstein, N. Harris McClamroch Department

### Course 212: Academic Year Section 1: Metric Spaces

Course 212: Academic Year 1991-2 Section 1: Metric Spaces D. R. Wilkins Contents 1 Metric Spaces 3 1.1 Distance Functions and Metric Spaces............. 3 1.2 Convergence and Continuity in Metric Spaces.........

### An homotopy method for exact tracking of nonlinear nonminimum phase systems: the example of the spherical inverted pendulum

9 American Control Conference Hyatt Regency Riverfront, St. Louis, MO, USA June -, 9 FrA.5 An homotopy method for exact tracking of nonlinear nonminimum phase systems: the example of the spherical inverted

### Functional Analysis Exercise Class

Functional Analysis Exercise Class Week 2 November 6 November Deadline to hand in the homeworks: your exercise class on week 9 November 13 November Exercises (1) Let X be the following space of piecewise

### 2 Statement of the problem and assumptions

Mathematical Notes, 25, vol. 78, no. 4, pp. 466 48. Existence Theorem for Optimal Control Problems on an Infinite Time Interval A.V. Dmitruk and N.V. Kuz kina We consider an optimal control problem on

### THE INVERSE FUNCTION THEOREM

THE INVERSE FUNCTION THEOREM W. PATRICK HOOPER The implicit function theorem is the following result: Theorem 1. Let f be a C 1 function from a neighborhood of a point a R n into R n. Suppose A = Df(a)

### TOPOLOGICAL EQUIVALENCE OF LINEAR ORDINARY DIFFERENTIAL EQUATIONS

TOPOLOGICAL EQUIVALENCE OF LINEAR ORDINARY DIFFERENTIAL EQUATIONS ALEX HUMMELS Abstract. This paper proves a theorem that gives conditions for the topological equivalence of linear ordinary differential

### 2 Lyapunov Stability. x(0) x 0 < δ x(t) x 0 < ɛ

1 2 Lyapunov Stability Whereas I/O stability is concerned with the effect of inputs on outputs, Lyapunov stability deals with unforced systems: ẋ = f(x, t) (1) where x R n, t R +, and f : R n R + R n.

### Passivity-based Stabilization of Non-Compact Sets

Passivity-based Stabilization of Non-Compact Sets Mohamed I. El-Hawwary and Manfredi Maggiore Abstract We investigate the stabilization of closed sets for passive nonlinear systems which are contained

### INVERSE FUNCTION THEOREM and SURFACES IN R n

INVERSE FUNCTION THEOREM and SURFACES IN R n Let f C k (U; R n ), with U R n open. Assume df(a) GL(R n ), where a U. The Inverse Function Theorem says there is an open neighborhood V U of a in R n so that

### Set, functions and Euclidean space. Seungjin Han

Set, functions and Euclidean space Seungjin Han September, 2018 1 Some Basics LOGIC A is necessary for B : If B holds, then A holds. B A A B is the contraposition of B A. A is sufficient for B: If A holds,

### Linear ODE s with periodic coefficients

Linear ODE s with periodic coefficients 1 Examples y = sin(t)y, solutions Ce cos t. Periodic, go to 0 as t +. y = 2 sin 2 (t)y, solutions Ce t sin(2t)/2. Not periodic, go to to 0 as t +. y = (1 + sin(t))y,

### LMI Methods in Optimal and Robust Control

LMI Methods in Optimal and Robust Control Matthew M. Peet Arizona State University Lecture 20: LMI/SOS Tools for the Study of Hybrid Systems Stability Concepts There are several classes of problems for

### 1. Bounded linear maps. A linear map T : E F of real Banach

DIFFERENTIABLE MAPS 1. Bounded linear maps. A linear map T : E F of real Banach spaces E, F is bounded if M > 0 so that for all v E: T v M v. If v r T v C for some positive constants r, C, then T is bounded:

### Minimum-Phase Property of Nonlinear Systems in Terms of a Dissipation Inequality

Minimum-Phase Property of Nonlinear Systems in Terms of a Dissipation Inequality Christian Ebenbauer Institute for Systems Theory in Engineering, University of Stuttgart, 70550 Stuttgart, Germany ce@ist.uni-stuttgart.de

### STRICT LYAPUNOV FUNCTION AND CHETAEV FUNCTION FOR STABILITY/INSTABILITY ANALYSIS OF THE PENDULUM 1

STRICT LYAPUNOV FUNCTION AND CHETAEV FUNCTION FOR STABILITY/INSTABILITY ANALYSIS OF THE PENDULUM Rafael Kelly and Victor Santibañez Dirección de Telemática, CICESE Apdo Postal 65, Adm, Carretera Tijuana

### Topological properties

CHAPTER 4 Topological properties 1. Connectedness Definitions and examples Basic properties Connected components Connected versus path connected, again 2. Compactness Definition and first examples Topological

### Lecture 1: Entropy, convexity, and matrix scaling CSE 599S: Entropy optimality, Winter 2016 Instructor: James R. Lee Last updated: January 24, 2016

Lecture 1: Entropy, convexity, and matrix scaling CSE 599S: Entropy optimality, Winter 2016 Instructor: James R. Lee Last updated: January 24, 2016 1 Entropy Since this course is about entropy maximization,

### f(s)ds, i.e. to write down the general solution in

1. First order ODEs. Simplest examples. Existence and uniqueness theorem Example 1.1. Consider the equation (1.1) x (t) = 1 This is an equation because there is an unknown: the function x(t). This is a

### Nonlinear Systems Theory

Nonlinear Systems Theory Matthew M. Peet Arizona State University Lecture 2: Nonlinear Systems Theory Overview Our next goal is to extend LMI s and optimization to nonlinear systems analysis. Today we

### Ordinary Differential Equations II

Ordinary Differential Equations II February 9 217 Linearization of an autonomous system We consider the system (1) x = f(x) near a fixed point x. As usual f C 1. Without loss of generality we assume x

### 7 Planar systems of linear ODE

7 Planar systems of linear ODE Here I restrict my attention to a very special class of autonomous ODE: linear ODE with constant coefficients This is arguably the only class of ODE for which explicit solution

### Feedback control for a chemostat with two organisms

Feedback control for a chemostat with two organisms Patrick De Leenheer and Hal Smith Arizona State University Department of Mathematics and Statistics Tempe, AZ 85287 email: leenheer@math.la.asu.edu,