Hybrid Control and Switched Systems. Lecture #7 Stability and convergence of ODEs

Size: px
Start display at page:

Download "Hybrid Control and Switched Systems. Lecture #7 Stability and convergence of ODEs"

Transcription

1 Hybrid Control and Switched Systems Lecture #7 Stability and convergence of ODEs João P. Hespanha University of California at Santa Barbara Summary Lyapunov stability of ODEs epsilon-delta and beta-function definitions Lyapunov s stability theorem LaSalle s invariance principle Stability of linear systems 1

2 Properties of hybrid systems sig set of all piecewise continuous signals x:[0,t) R n, T (0, ] sig set of all piecewise constant signals q:[0,t), T (0, ] Sequence property p : sig sig {false,true} E.g., A pair of signals (q, x) sig sig satisfies p if p(q, x) = true A hybrid automaton H satisfies p ( write H ² p ) if p(q, x) = true, for every solution (q, x) of H ensemble properties property of the whole family of solutions (cannot be checked just by looking at isolated solutions) e.g., continuity with respect to initial conditions Lyapunov stability (ODEs) equilibrium point x eq R n for which f(x eq ) = 0 E.g., pendulum equation thus x(t) = x eq t 0 is a solution to the ODE l two equilibrium points: x 1 = 0, x 2 = 0 (down) and x 1 = π, x 2 = 0 (up) θ m 2

3 Lyapunov stability (ODEs) equilibrium point x eq R n for which f(x eq ) = 0 thus x(t) = x eq t 0 is a solution to the ODE Definition (e δ definition): The equilibrium point x eq R n is (Lyapunov) stable if e > 0 δ >0 : x(t 0 ) x eq δ x(t) x eq e t t 0 0 e x eq δ x(t) 1. if the solution starts close to x eq it will remain close to it forever 2. e can be made arbitrarily small by choosing δ sufficiently small Example #1: Pendulum l θ m x eq =(0,0) stable x eq =(π,0) unstable pend.m 3

4 Lyapunov stability continuity definition sig set of all piecewise continuous signals taking values in R n Given a signal x sig, x sig ú sup t 0 x(t) signal norm ODE can be seen as an operator T : R n sig that maps x 0 R n into the solution that starts at x(0) = x 0 Definition (continuity definition): The equilibrium point x eq R n is (Lyapunov) stable if T is continuous at x eq : e > 0 δ >0 : x 0 x eq δ T(x 0 ) T(x eq ) sig e x eq e δ x(t) sup t 0 x(t) x eq e can be extended to nonequilibrium solutions Stability of arbitrary solutions sig set of all piecewise continuous signals taking values in R n Given a signal x sig, x sig ú sup t 0 x(t) signal norm ODE can be seen as an operator T : R n sig that maps x 0 R n into the solution that starts at x(0) = x 0 Definition (continuity definition): A solution x * :[0,T) R n is (Lyapunov) stable if T is continuous at x * 0 ú x* (0), i.e., e > 0 δ >0 : x 0 x * 0 δ T(x 0 ) T(x* 0 ) sig e δ sup t 0 x(t) x * (t) e x(t) x * (t) e pend.m 4

5 Example #2: Van der Pol oscillator x * Lyapunov stable vdp.m E.g., Van der Pol oscillator Stability of arbitrary solutions x * unstable vdp.m 5

6 Lyapunov stability equilibrium point x eq R n for which f(x eq ) = 0 class set of functions α:[0, ) [0, ) that are 1. continuous 2. strictly increasing 3. α(0)=0 Definition (class function definition): The equilibrium point x eq R n is (Lyapunov) stable if α : x(t) x eq α( x(t 0 ) x eq ) t t 0 0, x(t 0 ) x eq c α(s) s α( x(t 0 ) x eq ) x(t 0 ) x eq x eq x(t) t the function α can be constructed directly from the δ(e) in the e δ (or continuity) definitions Asymptotic stability equilibrium point x eq R n for which f(x eq ) = 0 class set of functions α:[0, ) [0, ) that are 1. continuous 2. strictly increasing 3. α(0)=0 α(s) s Definition: The equilibrium point x eq R n is (globally) asymptotically stable if it is Lyapunov stable and for every initial state the solution exists on [0, ) and x(t) x eq as t. α( x(t 0 ) x eq ) x(t 0 ) x eq x eq x(t) t 6

7 Asymptotic stability β(s,t) equilibrium point x eq R n for which f(x eq ) = 0 class set of functions β:[0, ) [0, ) [0, ) s.t. 1. for each fixed t, β(,t) 2. for each fixed s, β(s, ) is monotone decreasing and β(s,t) 0 as t (for each fixed t) β(s,t) (for each fixed s) Definition (class function definition): t The equilibrium point x eq R n is (globally) asymptotically stable if β : x(t) x eq β( x(t 0 ) x eq,t t 0 ) t t 0 0 s β( x(t 0 ) x eq,0) x(t 0 ) x eq x eq x(t) β( x(t 0 ) x eq,t) t We have exponential stability when β(s,t) = c e -λ t s with c,λ > 0 linear in s and negative exponential in t Example #1: Pendulum k > 0 (with friction) k = 0 (no friction) x 2 x 1 x eq =(0,0) asymptotically stable x eq =(π,0) unstable x eq =(0,0) stable but not asymptotically x eq =(π,0) unstable pend.m 7

8 Example #3: Butterfly Convergence by itself does not imply stability, e.g., Why was Mr. Lyapunov so picky? Why shouldn t boundedness and convergence to zero suffice? equilibrium point (0,0) all solutions converge to zero but x eq = (0,0) system is not stable converge.m Lyapunov s stability theorem Definition (class function definition): The equilibrium point x eq R n is (Lyapunov) stable if α : x(t) x eq α( x(t 0 ) x eq ) t t 0 0, x(t 0 ) x eq c Suppose we could show that x(t) x eq always decreases along solutions to the ODE. Then x(t) x eq x(t 0 ) x eq t t 0 0 we could pick α(s) = s Lyapunov stability We can draw the same conclusion by using other measures of how far the solution is from x eq : V: R n R positive definite V(x) 0 x R n with = 0 only for x = 0 V: R n R radially unbounded x V(x) provides a measure of how far x is from x eq (not necessarily a metric may not satisfy triangular inequality) 8

9 Lyapunov s stability theorem V: R n R positive definite V(x) 0 x R n with = 0 only for x = 0 Q: How to check if V(x(t) x eq ) decreases along solutions? provides a measure of how far x is from x eq (not necessarily a metric may not satisfy triangular inequality) A: V(x(t) x eq ) will decrease if gradient of V can be computed without actually computing x(t) (i.e., solving the ODE) Lyapunov s stability theorem Definition (class function definition): The equilibrium point x eq R n is (Lyapunov) stable if α : x(t) x eq α( x(t 0 ) x eq ) t t 0 0, x(t 0 ) x eq c Lyapunov function Theorem (Lyapunov): Suppose there exists a continuously differentiable, positive definite function V: R n R such that Then x eq is a Lyapunov stable equilibrium. (cup-like function) V(z x eq ) Why? V non increasing V(x(t) x eq ) V(x(t 0 ) x eq ) t t 0 Thus, by making x(t 0 ) x eq small we can make V(x(t) x eq ) arbitrarily small t t 0 So, by making x(t 0 ) x eq small we can make x(t) x eq arbitrarily small t t 0 (we can actually compute α from V explicitly and take c = + ). z 9

10 Example #1: Pendulum l θ m For x eq = (0,0) positive definite because V(x) = 0 only for x 1 = 2kπ k Z & x 2 = 0 (all these points are really the same because x 1 is an angle) Therefore x eq =(0,0) is Lyapunov stable pend.m Example #1: Pendulum l θ m For x eq = (π,0) positive definite because V(x) = 0 only for x 1 = 2kπ k Z & x 2 = 0 (all these points are really the same because x 1 is an angle) Cannot conclude that x eq =(π,0) is Lyapunov stable (in fact it is not!) pend.m 10

11 Lyapunov s stability theorem Definition (class function definition): The equilibrium point x eq R n is (Lyapunov) stable if α : x(t) x eq α( x(t 0 ) x eq ) t t 0 0, x(t 0 ) x eq c Theorem (Lyapunov): Suppose there exists a continuously differentiable, positive definite, radially unbounded function V: R n R such that Then x eq is a Lyapunov stable equilibrium and the solution always exists globally. Moreover, if = 0 only for z = x eq then x eq is a (globally) asymptotically stable equilibrium. Why? V can only stop decreasing when x(t) reaches x eq but V must stop decreasing because it cannot become negative Thus, x(t) must converge to x eq Lyapunov s stability theorem Definition (class function definition): The equilibrium point x eq R n is (Lyapunov) stable if α : x(t) x eq α( x(t 0 ) x eq ) t t 0 0, x(t 0 ) x eq c Theorem (Lyapunov): Suppose there exists a continuously differentiable, positive definite, radially unbounded function V: R n R such that Then x eq is a Lyapunov stable equilibrium and the solution always exists globally. Moreover, if = 0 only for z = x eq then x eq is a (globally) asymptotically stable equilibrium. What if for other z then x eq? Can we still claim some form of convergence? 11

12 Example #1: Pendulum l θ m For x eq = (0,0) not strict for (x 1 0, x 2 =0!) pend.m LaSalle s Invariance Principle M R n is an invariant set x(t 0 ) M x(t) M t t 0 (in the context of hybrid systems: Reach(M) M ) Theorem (LaSalle Invariance Principle): Suppose there exists a continuously differentiable, positive definite, radially unbounded function V: R n R such that Then x eq is a Lyapunov stable equilibrium and the solution always exists globally. Moreover, x(t) converges to the largest invariant set M contained in E ú { z R n : W(z) = 0 } Note that: 1. When W(z) = 0 only for z = x eq then E = {x eq }. Since M E, M = {x eq } and therefore x(t) x eq asympt. stability 2. Even when E is larger then {x eq } we often have M = {x eq } and can conclude asymptotic stability. Lyapunov theorem 12

13 Example #1: Pendulum l θ m For x eq = (0,0) Inside E, the ODE becomes E ú { (x 1,x 2 ): x 1 R, x 2 =0} define set M for which system remains inside E Therefore x converges to M ú { (x 1,x 2 ): x 1 = k π Z, x 2 =0} However, the equilibrium point x eq =(0,0) is not (globally) asymptotically stable because if the system starts, e.g., at (π,0) it remains there forever. pend.m Linear systems Solution to a linear ODE: Theorem: The origin x eq = 0 is an equilibrium point. It is 1. Lyapunov stable if and only if all eigenvalues of A have negative or zero real parts and for each eigenvalue with zero real part there is an independent eigenvector. 2. Asymptotically stable if and only if all eigenvalues of A have negative real parts. In this case the origin is actually exponentially stable 13

14 Linear systems linear.m Lyapunov equation Solution to a linear ODE: Theorem: The origin x eq = 0 is an equilibrium point. It is asymptotically stable if and only if for every positive symmetric definite matrix Q the equation A P + P A = Q Lyapunov equation has a unique solutions P that is symmetric and positive definite Recall: given a symmetric matrix P P is positive definite all eigenvalues are positive P positive definite x P x > 0 x 0 P is positive semi-definite all eigenvalues are positive or zero P positive semi-definite x P x 0 x 14

15 Lyapunov equation Solution to a linear ODE: Theorem: The origin x eq = 0 is an equilibrium point. It is asymptotically stable if and only if for every positive symmetric definite matrix Q the equation A P + P A = Q Lyapunov equation has a unique solutions P that is symmetric and positive definite Why? 1. asympt. stable P exists and is unique (constructive proof) A is asympt. stable e At decreases to zero exponentiall fast P is well defined (limit exists and is finite) change of integration variable τ = T s Lyapunov equation Solution to a linear ODE: Theorem: The origin x eq = 0 is an equilibrium point. It is asymptotically stable if and only if for every positive symmetric definite matrix Q the equation A P + P A = Q Lyapunov equation has a unique solutions P that is symmetric and positive definite Why? 2. P exists asymp. stable Consider the quadratic Lyapunov equation: V(x) = x P x V is positive definite & radially unbounded because P is positive definite V is continuously differentiable: thus system is asymptotically stable by Lyapunov Theorem 15

16 Next lecture Lyapunov stability of hybrid systems 16

Hybrid Control and Switched Systems. Lecture #11 Stability of switched system: Arbitrary switching

Hybrid Control and Switched Systems. Lecture #11 Stability of switched system: Arbitrary switching Hybrid Control and Switched Systems Lecture #11 Stability of switched system: Arbitrary switching João P. Hespanha University of California at Santa Barbara Stability under arbitrary switching Instability

More information

Hybrid Control and Switched Systems. Lecture #8 Stability and convergence of hybrid systems (topological view)

Hybrid Control and Switched Systems. Lecture #8 Stability and convergence of hybrid systems (topological view) Hybrid Control and Switched Systems Lecture #8 Stability and convergence of hybrid systems (topological view) João P. Hespanha University of California at Santa Barbara Summary Lyapunov stability of hybrid

More information

Hybrid Control and Switched Systems. Lecture #9 Analysis tools for hybrid systems: Impact maps

Hybrid Control and Switched Systems. Lecture #9 Analysis tools for hybrid systems: Impact maps Hybrid Control and Switched Systems Lecture #9 Analysis tools for hybrid systems: Impact maps João P. Hespanha University of California at Santa Barbara Summary Analysis tools for hybrid systems Impact

More information

Lyapunov stability ORDINARY DIFFERENTIAL EQUATIONS

Lyapunov stability ORDINARY DIFFERENTIAL EQUATIONS Lyapunov stability ORDINARY DIFFERENTIAL EQUATIONS An ordinary differential equation is a mathematical model of a continuous state continuous time system: X = < n state space f: < n! < n vector field (assigns

More information

Lecture 4. Chapter 4: Lyapunov Stability. Eugenio Schuster. Mechanical Engineering and Mechanics Lehigh University.

Lecture 4. Chapter 4: Lyapunov Stability. Eugenio Schuster. Mechanical Engineering and Mechanics Lehigh University. Lecture 4 Chapter 4: Lyapunov Stability Eugenio Schuster schuster@lehigh.edu Mechanical Engineering and Mechanics Lehigh University Lecture 4 p. 1/86 Autonomous Systems Consider the autonomous system ẋ

More information

Chapter III. Stability of Linear Systems

Chapter III. Stability of Linear Systems 1 Chapter III Stability of Linear Systems 1. Stability and state transition matrix 2. Time-varying (non-autonomous) systems 3. Time-invariant systems 1 STABILITY AND STATE TRANSITION MATRIX 2 In this chapter,

More information

STABILITY ANALYSIS OF DYNAMIC SYSTEMS

STABILITY ANALYSIS OF DYNAMIC SYSTEMS C. Melchiorri (DEI) Automatic Control & System Theory 1 AUTOMATIC CONTROL AND SYSTEM THEORY STABILITY ANALYSIS OF DYNAMIC SYSTEMS Claudio Melchiorri Dipartimento di Ingegneria dell Energia Elettrica e

More information

Hybrid Systems - Lecture n. 3 Lyapunov stability

Hybrid Systems - Lecture n. 3 Lyapunov stability OUTLINE Focus: stability of equilibrium point Hybrid Systems - Lecture n. 3 Lyapunov stability Maria Prandini DEI - Politecnico di Milano E-mail: prandini@elet.polimi.it continuous systems decribed by

More information

L 2 -induced Gains of Switched Systems and Classes of Switching Signals

L 2 -induced Gains of Switched Systems and Classes of Switching Signals L 2 -induced Gains of Switched Systems and Classes of Switching Signals Kenji Hirata and João P. Hespanha Abstract This paper addresses the L 2-induced gain analysis for switched linear systems. We exploit

More information

2 Lyapunov Stability. x(0) x 0 < δ x(t) x 0 < ɛ

2 Lyapunov Stability. x(0) x 0 < δ x(t) x 0 < ɛ 1 2 Lyapunov Stability Whereas I/O stability is concerned with the effect of inputs on outputs, Lyapunov stability deals with unforced systems: ẋ = f(x, t) (1) where x R n, t R +, and f : R n R + R n.

More information

Hybrid Systems Course Lyapunov stability

Hybrid Systems Course Lyapunov stability Hybrid Systems Course Lyapunov stability OUTLINE Focus: stability of an equilibrium point continuous systems decribed by ordinary differential equations (brief review) hybrid automata OUTLINE Focus: stability

More information

Lyapunov Stability Theory

Lyapunov Stability Theory Lyapunov Stability Theory Peter Al Hokayem and Eduardo Gallestey March 16, 2015 1 Introduction In this lecture we consider the stability of equilibrium points of autonomous nonlinear systems, both in continuous

More information

Nonlinear Control Lecture 5: Stability Analysis II

Nonlinear Control Lecture 5: Stability Analysis II Nonlinear Control Lecture 5: Stability Analysis II Farzaneh Abdollahi Department of Electrical Engineering Amirkabir University of Technology Fall 2010 Farzaneh Abdollahi Nonlinear Control Lecture 5 1/41

More information

Nonlinear Control. Nonlinear Control Lecture # 2 Stability of Equilibrium Points

Nonlinear Control. Nonlinear Control Lecture # 2 Stability of Equilibrium Points Nonlinear Control Lecture # 2 Stability of Equilibrium Points Basic Concepts ẋ = f(x) f is locally Lipschitz over a domain D R n Suppose x D is an equilibrium point; that is, f( x) = 0 Characterize and

More information

Stability lectures. Stability of Linear Systems. Stability of Linear Systems. Stability of Continuous Systems. EECE 571M/491M, Spring 2008 Lecture 5

Stability lectures. Stability of Linear Systems. Stability of Linear Systems. Stability of Continuous Systems. EECE 571M/491M, Spring 2008 Lecture 5 EECE 571M/491M, Spring 2008 Lecture 5 Stability of Continuous Systems http://courses.ece.ubc.ca/491m moishi@ece.ubc.ca Dr. Meeko Oishi Electrical and Computer Engineering University of British Columbia,

More information

Modeling & Control of Hybrid Systems Chapter 4 Stability

Modeling & Control of Hybrid Systems Chapter 4 Stability Modeling & Control of Hybrid Systems Chapter 4 Stability Overview 1. Switched systems 2. Lyapunov theory for smooth and linear systems 3. Stability for any switching signal 4. Stability for given switching

More information

Switched systems: stability

Switched systems: stability Switched systems: stability OUTLINE Switched Systems Stability of Switched Systems OUTLINE Switched Systems Stability of Switched Systems a family of systems SWITCHED SYSTEMS SWITCHED SYSTEMS a family

More information

Introduction to Nonlinear Control Lecture # 3 Time-Varying and Perturbed Systems

Introduction to Nonlinear Control Lecture # 3 Time-Varying and Perturbed Systems p. 1/5 Introduction to Nonlinear Control Lecture # 3 Time-Varying and Perturbed Systems p. 2/5 Time-varying Systems ẋ = f(t, x) f(t, x) is piecewise continuous in t and locally Lipschitz in x for all t

More information

Topic # /31 Feedback Control Systems. Analysis of Nonlinear Systems Lyapunov Stability Analysis

Topic # /31 Feedback Control Systems. Analysis of Nonlinear Systems Lyapunov Stability Analysis Topic # 16.30/31 Feedback Control Systems Analysis of Nonlinear Systems Lyapunov Stability Analysis Fall 010 16.30/31 Lyapunov Stability Analysis Very general method to prove (or disprove) stability of

More information

MCE693/793: Analysis and Control of Nonlinear Systems

MCE693/793: Analysis and Control of Nonlinear Systems MCE693/793: Analysis and Control of Nonlinear Systems Lyapunov Stability - I Hanz Richter Mechanical Engineering Department Cleveland State University Definition of Stability - Lyapunov Sense Lyapunov

More information

Nonlinear Control. Nonlinear Control Lecture # 8 Time Varying and Perturbed Systems

Nonlinear Control. Nonlinear Control Lecture # 8 Time Varying and Perturbed Systems Nonlinear Control Lecture # 8 Time Varying and Perturbed Systems Time-varying Systems ẋ = f(t,x) f(t,x) is piecewise continuous in t and locally Lipschitz in x for all t 0 and all x D, (0 D). The origin

More information

EN Nonlinear Control and Planning in Robotics Lecture 3: Stability February 4, 2015

EN Nonlinear Control and Planning in Robotics Lecture 3: Stability February 4, 2015 EN530.678 Nonlinear Control and Planning in Robotics Lecture 3: Stability February 4, 2015 Prof: Marin Kobilarov 0.1 Model prerequisites Consider ẋ = f(t, x). We will make the following basic assumptions

More information

Nonlinear Control. Nonlinear Control Lecture # 3 Stability of Equilibrium Points

Nonlinear Control. Nonlinear Control Lecture # 3 Stability of Equilibrium Points Nonlinear Control Lecture # 3 Stability of Equilibrium Points The Invariance Principle Definitions Let x(t) be a solution of ẋ = f(x) A point p is a positive limit point of x(t) if there is a sequence

More information

Control of Robotic Manipulators

Control of Robotic Manipulators Control of Robotic Manipulators Set Point Control Technique 1: Joint PD Control Joint torque Joint position error Joint velocity error Why 0? Equivalent to adding a virtual spring and damper to the joints

More information

Nonlinear Control. Nonlinear Control Lecture # 8 Time Varying and Perturbed Systems

Nonlinear Control. Nonlinear Control Lecture # 8 Time Varying and Perturbed Systems Nonlinear Control Lecture # 8 Time Varying and Perturbed Systems Time-varying Systems ẋ = f(t,x) f(t,x) is piecewise continuous in t and locally Lipschitz in x for all t 0 and all x D, (0 D). The origin

More information

Control Systems. Internal Stability - LTI systems. L. Lanari

Control Systems. Internal Stability - LTI systems. L. Lanari Control Systems Internal Stability - LTI systems L. Lanari outline LTI systems: definitions conditions South stability criterion equilibrium points Nonlinear systems: equilibrium points examples stable

More information

ME Fall 2001, Fall 2002, Spring I/O Stability. Preliminaries: Vector and function norms

ME Fall 2001, Fall 2002, Spring I/O Stability. Preliminaries: Vector and function norms I/O Stability Preliminaries: Vector and function norms 1. Sup norms are used for vectors for simplicity: x = max i x i. Other norms are also okay 2. Induced matrix norms: let A R n n, (i stands for induced)

More information

Converse Lyapunov theorem and Input-to-State Stability

Converse Lyapunov theorem and Input-to-State Stability Converse Lyapunov theorem and Input-to-State Stability April 6, 2014 1 Converse Lyapunov theorem In the previous lecture, we have discussed few examples of nonlinear control systems and stability concepts

More information

Video 8.1 Vijay Kumar. Property of University of Pennsylvania, Vijay Kumar

Video 8.1 Vijay Kumar. Property of University of Pennsylvania, Vijay Kumar Video 8.1 Vijay Kumar 1 Definitions State State equations Equilibrium 2 Stability Stable Unstable Neutrally (Critically) Stable 3 Stability Translate the origin to x e x(t) =0 is stable (Lyapunov stable)

More information

Handout 2: Invariant Sets and Stability

Handout 2: Invariant Sets and Stability Engineering Tripos Part IIB Nonlinear Systems and Control Module 4F2 1 Invariant Sets Handout 2: Invariant Sets and Stability Consider again the autonomous dynamical system ẋ = f(x), x() = x (1) with state

More information

Solution of Linear State-space Systems

Solution of Linear State-space Systems Solution of Linear State-space Systems Homogeneous (u=0) LTV systems first Theorem (Peano-Baker series) The unique solution to x(t) = (t, )x 0 where The matrix function is given by is called the state

More information

LECTURE 8: DYNAMICAL SYSTEMS 7

LECTURE 8: DYNAMICAL SYSTEMS 7 15-382 COLLECTIVE INTELLIGENCE S18 LECTURE 8: DYNAMICAL SYSTEMS 7 INSTRUCTOR: GIANNI A. DI CARO GEOMETRIES IN THE PHASE SPACE Damped pendulum One cp in the region between two separatrix Separatrix Basin

More information

ENGI 9420 Lecture Notes 4 - Stability Analysis Page Stability Analysis for Non-linear Ordinary Differential Equations

ENGI 9420 Lecture Notes 4 - Stability Analysis Page Stability Analysis for Non-linear Ordinary Differential Equations ENGI 940 Lecture Notes 4 - Stability Analysis Page 4.01 4. Stability Analysis for Non-linear Ordinary Differential Equations A pair of simultaneous first order homogeneous linear ordinary differential

More information

Lecture 9 Nonlinear Control Design

Lecture 9 Nonlinear Control Design Lecture 9 Nonlinear Control Design Exact-linearization Lyapunov-based design Lab 2 Adaptive control Sliding modes control Literature: [Khalil, ch.s 13, 14.1,14.2] and [Glad-Ljung,ch.17] Course Outline

More information

Lecture 8. Chapter 5: Input-Output Stability Chapter 6: Passivity Chapter 14: Passivity-Based Control. Eugenio Schuster.

Lecture 8. Chapter 5: Input-Output Stability Chapter 6: Passivity Chapter 14: Passivity-Based Control. Eugenio Schuster. Lecture 8 Chapter 5: Input-Output Stability Chapter 6: Passivity Chapter 14: Passivity-Based Control Eugenio Schuster schuster@lehigh.edu Mechanical Engineering and Mechanics Lehigh University Lecture

More information

1 Lyapunov theory of stability

1 Lyapunov theory of stability M.Kawski, APM 581 Diff Equns Intro to Lyapunov theory. November 15, 29 1 1 Lyapunov theory of stability Introduction. Lyapunov s second (or direct) method provides tools for studying (asymptotic) stability

More information

(Refer Slide Time: 00:32)

(Refer Slide Time: 00:32) Nonlinear Dynamical Systems Prof. Madhu. N. Belur and Prof. Harish. K. Pillai Department of Electrical Engineering Indian Institute of Technology, Bombay Lecture - 12 Scilab simulation of Lotka Volterra

More information

NOTES ON LINEAR ODES

NOTES ON LINEAR ODES NOTES ON LINEAR ODES JONATHAN LUK We can now use all the discussions we had on linear algebra to study linear ODEs Most of this material appears in the textbook in 21, 22, 23, 26 As always, this is a preliminary

More information

Hybrid Control and Switched Systems. Lecture #1 Hybrid systems are everywhere: Examples

Hybrid Control and Switched Systems. Lecture #1 Hybrid systems are everywhere: Examples Hybrid Control and Switched Systems Lecture #1 Hybrid systems are everywhere: Examples João P. Hespanha University of California at Santa Barbara Summary Examples of hybrid systems 1. Bouncing ball 2.

More information

Nonlinear Systems and Control Lecture # 12 Converse Lyapunov Functions & Time Varying Systems. p. 1/1

Nonlinear Systems and Control Lecture # 12 Converse Lyapunov Functions & Time Varying Systems. p. 1/1 Nonlinear Systems and Control Lecture # 12 Converse Lyapunov Functions & Time Varying Systems p. 1/1 p. 2/1 Converse Lyapunov Theorem Exponential Stability Let x = 0 be an exponentially stable equilibrium

More information

Nonlinear Control Lecture 4: Stability Analysis I

Nonlinear Control Lecture 4: Stability Analysis I Nonlinear Control Lecture 4: Stability Analysis I Farzaneh Abdollahi Department of Electrical Engineering Amirkabir University of Technology Fall 2010 Farzaneh Abdollahi Nonlinear Control Lecture 4 1/70

More information

Unconstrained minimization of smooth functions

Unconstrained minimization of smooth functions Unconstrained minimization of smooth functions We want to solve min x R N f(x), where f is convex. In this section, we will assume that f is differentiable (so its gradient exists at every point), and

More information

Using Lyapunov Theory I

Using Lyapunov Theory I Lecture 33 Stability Analysis of Nonlinear Systems Using Lyapunov heory I Dr. Radhakant Padhi Asst. Professor Dept. of Aerospace Engineering Indian Institute of Science - Bangalore Outline Motivation Definitions

More information

Math 312 Lecture Notes Linear Two-dimensional Systems of Differential Equations

Math 312 Lecture Notes Linear Two-dimensional Systems of Differential Equations Math 2 Lecture Notes Linear Two-dimensional Systems of Differential Equations Warren Weckesser Department of Mathematics Colgate University February 2005 In these notes, we consider the linear system of

More information

Convergence Rate of Nonlinear Switched Systems

Convergence Rate of Nonlinear Switched Systems Convergence Rate of Nonlinear Switched Systems Philippe JOUAN and Saïd NACIRI arxiv:1511.01737v1 [math.oc] 5 Nov 2015 January 23, 2018 Abstract This paper is concerned with the convergence rate of the

More information

Stability of Nonlinear Systems An Introduction

Stability of Nonlinear Systems An Introduction Stability of Nonlinear Systems An Introduction Michael Baldea Department of Chemical Engineering The University of Texas at Austin April 3, 2012 The Concept of Stability Consider the generic nonlinear

More information

Robotics. Control Theory. Marc Toussaint U Stuttgart

Robotics. Control Theory. Marc Toussaint U Stuttgart Robotics Control Theory Topics in control theory, optimal control, HJB equation, infinite horizon case, Linear-Quadratic optimal control, Riccati equations (differential, algebraic, discrete-time), controllability,

More information

CDS 101/110a: Lecture 2.1 Dynamic Behavior

CDS 101/110a: Lecture 2.1 Dynamic Behavior CDS 11/11a: Lecture.1 Dynamic Behavior Richard M. Murray 6 October 8 Goals: Learn to use phase portraits to visualize behavior of dynamical systems Understand different types of stability for an equilibrium

More information

Nonlinear System Analysis

Nonlinear System Analysis Nonlinear System Analysis Lyapunov Based Approach Lecture 4 Module 1 Dr. Laxmidhar Behera Department of Electrical Engineering, Indian Institute of Technology, Kanpur. January 4, 2003 Intelligent Control

More information

EG4321/EG7040. Nonlinear Control. Dr. Matt Turner

EG4321/EG7040. Nonlinear Control. Dr. Matt Turner EG4321/EG7040 Nonlinear Control Dr. Matt Turner EG4321/EG7040 [An introduction to] Nonlinear Control Dr. Matt Turner EG4321/EG7040 [An introduction to] Nonlinear [System Analysis] and Control Dr. Matt

More information

Modeling and Analysis of Dynamic Systems

Modeling and Analysis of Dynamic Systems Modeling and Analysis of Dynamic Systems Dr. Guillaume Ducard Fall 2017 Institute for Dynamic Systems and Control ETH Zurich, Switzerland G. Ducard c 1 / 57 Outline 1 Lecture 13: Linear System - Stability

More information

EE363 homework 7 solutions

EE363 homework 7 solutions EE363 Prof. S. Boyd EE363 homework 7 solutions 1. Gain margin for a linear quadratic regulator. Let K be the optimal state feedback gain for the LQR problem with system ẋ = Ax + Bu, state cost matrix Q,

More information

Nonlinear dynamics & chaos BECS

Nonlinear dynamics & chaos BECS Nonlinear dynamics & chaos BECS-114.7151 Phase portraits Focus: nonlinear systems in two dimensions General form of a vector field on the phase plane: Vector notation: Phase portraits Solution x(t) describes

More information

MCE/EEC 647/747: Robot Dynamics and Control. Lecture 8: Basic Lyapunov Stability Theory

MCE/EEC 647/747: Robot Dynamics and Control. Lecture 8: Basic Lyapunov Stability Theory MCE/EEC 647/747: Robot Dynamics and Control Lecture 8: Basic Lyapunov Stability Theory Reading: SHV Appendix Mechanical Engineering Hanz Richter, PhD MCE503 p.1/17 Stability in the sense of Lyapunov A

More information

CDS 101/110a: Lecture 2.1 Dynamic Behavior

CDS 101/110a: Lecture 2.1 Dynamic Behavior CDS 11/11a: Lecture 2.1 Dynamic Behavior Richard M. Murray 6 October 28 Goals: Learn to use phase portraits to visualize behavior of dynamical systems Understand different types of stability for an equilibrium

More information

Hybrid Systems Techniques for Convergence of Solutions to Switching Systems

Hybrid Systems Techniques for Convergence of Solutions to Switching Systems Hybrid Systems Techniques for Convergence of Solutions to Switching Systems Rafal Goebel, Ricardo G. Sanfelice, and Andrew R. Teel Abstract Invariance principles for hybrid systems are used to derive invariance

More information

Convex Functions. Daniel P. Palomar. Hong Kong University of Science and Technology (HKUST)

Convex Functions. Daniel P. Palomar. Hong Kong University of Science and Technology (HKUST) Convex Functions Daniel P. Palomar Hong Kong University of Science and Technology (HKUST) ELEC5470 - Convex Optimization Fall 2017-18, HKUST, Hong Kong Outline of Lecture Definition convex function Examples

More information

On Input-to-State Stability of Impulsive Systems

On Input-to-State Stability of Impulsive Systems Proceedings of the 44th IEEE Conference on Decision and Control, and the European Control Conference 2005 Seville, Spain, December 12-15, 2005 TuC16.5 On Input-to-State Stability of Impulsive Systems João

More information

Problem set 3: Solutions Math 207A, Fall where a, b are positive constants, and determine their linearized stability.

Problem set 3: Solutions Math 207A, Fall where a, b are positive constants, and determine their linearized stability. Problem set 3: s Math 207A, Fall 2014 1. Fin the fixe points of the Hénon map x n+1 = a x 2 n +by n, y n+1 = x n, where a, b are positive constants, an etermine their linearize stability. The fixe points

More information

TTK4150 Nonlinear Control Systems Solution 6 Part 2

TTK4150 Nonlinear Control Systems Solution 6 Part 2 TTK4150 Nonlinear Control Systems Solution 6 Part 2 Department of Engineering Cybernetics Norwegian University of Science and Technology Fall 2003 Solution 1 Thesystemisgivenby φ = R (φ) ω and J 1 ω 1

More information

Section 1.4: Second-Order and Higher-Order Equations. Consider a second-order, linear, homogeneous equation with constant coefficients

Section 1.4: Second-Order and Higher-Order Equations. Consider a second-order, linear, homogeneous equation with constant coefficients Section 1.4: Second-Order and Higher-Order Equations Consider a second-order, linear, homogeneous equation with constant coefficients x t+2 + ax t+1 + bx t = 0. (1) To solve this difference equation, we

More information

UNIVERSITY OF MANITOBA

UNIVERSITY OF MANITOBA Question Points Score INSTRUCTIONS TO STUDENTS: This is a 6 hour examination. No extra time will be given. No texts, notes, or other aids are permitted. There are no calculators, cellphones or electronic

More information

On Input-to-State Stability of Impulsive Systems

On Input-to-State Stability of Impulsive Systems On Input-to-State Stability of Impulsive Systems João P. Hespanha Electrical and Comp. Eng. Dept. Univ. California, Santa Barbara Daniel Liberzon Coordinated Science Lab. Univ. of Illinois, Urbana-Champaign

More information

STABILIZATION THROUGH HYBRID CONTROL

STABILIZATION THROUGH HYBRID CONTROL STABILIZATION THROUGH HYBRID CONTROL João P. Hespanha, Department of Electrical and Computer Engineering, University of California, Santa Barbara, CA 93106-9560, USA. Keywords: Hybrid Systems; Switched

More information

Converse Lyapunov-Krasovskii Theorems for Systems Described by Neutral Functional Differential Equation in Hale s Form

Converse Lyapunov-Krasovskii Theorems for Systems Described by Neutral Functional Differential Equation in Hale s Form Converse Lyapunov-Krasovskii Theorems for Systems Described by Neutral Functional Differential Equation in Hale s Form arxiv:1206.3504v1 [math.ds] 15 Jun 2012 P. Pepe I. Karafyllis Abstract In this paper

More information

BIBO STABILITY AND ASYMPTOTIC STABILITY

BIBO STABILITY AND ASYMPTOTIC STABILITY BIBO STABILITY AND ASYMPTOTIC STABILITY FRANCESCO NORI Abstract. In this report with discuss the concepts of bounded-input boundedoutput stability (BIBO) and of Lyapunov stability. Examples are given to

More information

Chapter 13 Internal (Lyapunov) Stability 13.1 Introduction We have already seen some examples of both stable and unstable systems. The objective of th

Chapter 13 Internal (Lyapunov) Stability 13.1 Introduction We have already seen some examples of both stable and unstable systems. The objective of th Lectures on Dynamic Systems and Control Mohammed Dahleh Munther A. Dahleh George Verghese Department of Electrical Engineering and Computer Science Massachuasetts Institute of Technology 1 1 c Chapter

More information

CDS 101 Precourse Phase Plane Analysis and Stability

CDS 101 Precourse Phase Plane Analysis and Stability CDS 101 Precourse Phase Plane Analysis and Stability Melvin Leok Control and Dynamical Systems California Institute of Technology Pasadena, CA, 26 September, 2002. mleok@cds.caltech.edu http://www.cds.caltech.edu/

More information

On the Stabilization of Neutrally Stable Linear Discrete Time Systems

On the Stabilization of Neutrally Stable Linear Discrete Time Systems TWCCC Texas Wisconsin California Control Consortium Technical report number 2017 01 On the Stabilization of Neutrally Stable Linear Discrete Time Systems Travis J. Arnold and James B. Rawlings Department

More information

An asymptotic ratio characterization of input-to-state stability

An asymptotic ratio characterization of input-to-state stability 1 An asymptotic ratio characterization of input-to-state stability Daniel Liberzon and Hyungbo Shim Abstract For continuous-time nonlinear systems with inputs, we introduce the notion of an asymptotic

More information

4 Second-Order Systems

4 Second-Order Systems 4 Second-Order Systems Second-order autonomous systems occupy an important place in the study of nonlinear systems because solution trajectories can be represented in the plane. This allows for easy visualization

More information

Math 331 Homework Assignment Chapter 7 Page 1 of 9

Math 331 Homework Assignment Chapter 7 Page 1 of 9 Math Homework Assignment Chapter 7 Page of 9 Instructions: Please make sure to demonstrate every step in your calculations. Return your answers including this homework sheet back to the instructor as a

More information

3 Stability and Lyapunov Functions

3 Stability and Lyapunov Functions CDS140a Nonlinear Systems: Local Theory 02/01/2011 3 Stability and Lyapunov Functions 3.1 Lyapunov Stability Denition: An equilibrium point x 0 of (1) is stable if for all ɛ > 0, there exists a δ > 0 such

More information

Half of Final Exam Name: Practice Problems October 28, 2014

Half of Final Exam Name: Practice Problems October 28, 2014 Math 54. Treibergs Half of Final Exam Name: Practice Problems October 28, 24 Half of the final will be over material since the last midterm exam, such as the practice problems given here. The other half

More information

Stability of Feedback Solutions for Infinite Horizon Noncooperative Differential Games

Stability of Feedback Solutions for Infinite Horizon Noncooperative Differential Games Stability of Feedback Solutions for Infinite Horizon Noncooperative Differential Games Alberto Bressan ) and Khai T. Nguyen ) *) Department of Mathematics, Penn State University **) Department of Mathematics,

More information

Controlo Switched Systems: Mixing Logic with Differential Equations. João P. Hespanha. University of California at Santa Barbara.

Controlo Switched Systems: Mixing Logic with Differential Equations. João P. Hespanha. University of California at Santa Barbara. Controlo 00 5 th Portuguese Conference on Automatic Control University of Aveiro,, September 5-7, 5 00 Switched Systems: Mixing Logic with Differential Equations João P. Hespanha University of California

More information

Calculus for the Life Sciences II Assignment 6 solutions. f(x, y) = 3π 3 cos 2x + 2 sin 3y

Calculus for the Life Sciences II Assignment 6 solutions. f(x, y) = 3π 3 cos 2x + 2 sin 3y Calculus for the Life Sciences II Assignment 6 solutions Find the tangent plane to the graph of the function at the point (0, π f(x, y = 3π 3 cos 2x + 2 sin 3y Solution: The tangent plane of f at a point

More information

A plane autonomous system is a pair of simultaneous first-order differential equations,

A plane autonomous system is a pair of simultaneous first-order differential equations, Chapter 11 Phase-Plane Techniques 11.1 Plane Autonomous Systems A plane autonomous system is a pair of simultaneous first-order differential equations, ẋ = f(x, y), ẏ = g(x, y). This system has an equilibrium

More information

STABILITY OF PLANAR NONLINEAR SWITCHED SYSTEMS

STABILITY OF PLANAR NONLINEAR SWITCHED SYSTEMS LABORATOIRE INORMATIQUE, SINAUX ET SYSTÈMES DE SOPHIA ANTIPOLIS UMR 6070 STABILITY O PLANAR NONLINEAR SWITCHED SYSTEMS Ugo Boscain, régoire Charlot Projet TOpModel Rapport de recherche ISRN I3S/RR 2004-07

More information

Module 06 Stability of Dynamical Systems

Module 06 Stability of Dynamical Systems Module 06 Stability of Dynamical Systems Ahmad F. Taha EE 5143: Linear Systems and Control Email: ahmad.taha@utsa.edu Webpage: http://engineering.utsa.edu/ataha October 10, 2017 Ahmad F. Taha Module 06

More information

Copyright (c) 2006 Warren Weckesser

Copyright (c) 2006 Warren Weckesser 2.2. PLANAR LINEAR SYSTEMS 3 2.2. Planar Linear Systems We consider the linear system of two first order differential equations or equivalently, = ax + by (2.7) dy = cx + dy [ d x x = A x, where x =, and

More information

1. Find the solution of the following uncontrolled linear system. 2 α 1 1

1. Find the solution of the following uncontrolled linear system. 2 α 1 1 Appendix B Revision Problems 1. Find the solution of the following uncontrolled linear system 0 1 1 ẋ = x, x(0) =. 2 3 1 Class test, August 1998 2. Given the linear system described by 2 α 1 1 ẋ = x +

More information

Dynamical Systems & Lyapunov Stability

Dynamical Systems & Lyapunov Stability Dynamical Systems & Lyapunov Stability Harry G. Kwatny Department of Mechanical Engineering & Mechanics Drexel University Outline Ordinary Differential Equations Existence & uniqueness Continuous dependence

More information

MCE693/793: Analysis and Control of Nonlinear Systems

MCE693/793: Analysis and Control of Nonlinear Systems MCE693/793: Analysis and Control of Nonlinear Systems Systems of Differential Equations Phase Plane Analysis Hanz Richter Mechanical Engineering Department Cleveland State University Systems of Nonlinear

More information

ECE504: Lecture 8. D. Richard Brown III. Worcester Polytechnic Institute. 28-Oct-2008

ECE504: Lecture 8. D. Richard Brown III. Worcester Polytechnic Institute. 28-Oct-2008 ECE504: Lecture 8 D. Richard Brown III Worcester Polytechnic Institute 28-Oct-2008 Worcester Polytechnic Institute D. Richard Brown III 28-Oct-2008 1 / 30 Lecture 8 Major Topics ECE504: Lecture 8 We are

More information

There is a more global concept that is related to this circle of ideas that we discuss somewhat informally. Namely, a region R R n with a (smooth)

There is a more global concept that is related to this circle of ideas that we discuss somewhat informally. Namely, a region R R n with a (smooth) 82 Introduction Liapunov Functions Besides the Liapunov spectral theorem, there is another basic method of proving stability that is a generalization of the energy method we have seen in the introductory

More information

Main topics and some repetition exercises for the course MMG511/MVE161 ODE and mathematical modeling in year Main topics in the course:

Main topics and some repetition exercises for the course MMG511/MVE161 ODE and mathematical modeling in year Main topics in the course: Main topics and some repetition exercises for the course MMG5/MVE6 ODE and mathematical modeling in year 04. Main topics in the course:. Banach fixed point principle. Picard- Lindelöf theorem. Lipschitz

More information

Section 5.4 (Systems of Linear Differential Equation); 9.5 Eigenvalues and Eigenvectors, cont d

Section 5.4 (Systems of Linear Differential Equation); 9.5 Eigenvalues and Eigenvectors, cont d Section 5.4 (Systems of Linear Differential Equation); 9.5 Eigenvalues and Eigenvectors, cont d July 6, 2009 Today s Session Today s Session A Summary of This Session: Today s Session A Summary of This

More information

Stability in the sense of Lyapunov

Stability in the sense of Lyapunov CHAPTER 5 Stability in the sense of Lyapunov Stability is one of the most important properties characterizing a system s qualitative behavior. There are a number of stability concepts used in the study

More information

1 The pendulum equation

1 The pendulum equation Math 270 Honors ODE I Fall, 2008 Class notes # 5 A longer than usual homework assignment is at the end. The pendulum equation We now come to a particularly important example, the equation for an oscillating

More information

Lecture Note 1: Background

Lecture Note 1: Background ECE5463: Introduction to Robotics Lecture Note 1: Background Prof. Wei Zhang Department of Electrical and Computer Engineering Ohio State University Columbus, Ohio, USA Spring 2018 Lecture 1 (ECE5463 Sp18)

More information

Lyapunov Theory for Discrete Time Systems

Lyapunov Theory for Discrete Time Systems Università degli studi di Padova Dipartimento di Ingegneria dell Informazione Nicoletta Bof, Ruggero Carli, Luca Schenato Technical Report Lyapunov Theory for Discrete Time Systems This work contains a

More information

Equilibria with a nontrivial nodal set and the dynamics of parabolic equations on symmetric domains

Equilibria with a nontrivial nodal set and the dynamics of parabolic equations on symmetric domains Equilibria with a nontrivial nodal set and the dynamics of parabolic equations on symmetric domains J. Földes Department of Mathematics, Univerité Libre de Bruxelles 1050 Brussels, Belgium P. Poláčik School

More information

Piecewise Quadratic Lyapunov Functions for Piecewise Affine Time-Delay Systems

Piecewise Quadratic Lyapunov Functions for Piecewise Affine Time-Delay Systems Piecewise Quadratic Lyapunov Functions for Piecewise Affine ime-delay Systems Vishwesh Kulkarni Myungsoo Jun João Hespanha Abstract We investigate some particular classes of hybrid systems subect to a

More information

Exponential Decay: From Semi-Global to Global

Exponential Decay: From Semi-Global to Global Exponential Decay: From Semi-Global to Global Martin Gugat Benasque 2013 Martin Gugat (FAU) From semi-global to global. 1 / 13 How to get solutions that are global in time? 1 Sometimes, the semiglobal

More information

Now I switch to nonlinear systems. In this chapter the main object of study will be

Now I switch to nonlinear systems. In this chapter the main object of study will be Chapter 4 Stability 4.1 Autonomous systems Now I switch to nonlinear systems. In this chapter the main object of study will be ẋ = f(x), x(t) X R k, f : X R k, (4.1) where f is supposed to be locally Lipschitz

More information

ON INPUT-TO-STATE STABILITY OF IMPULSIVE SYSTEMS

ON INPUT-TO-STATE STABILITY OF IMPULSIVE SYSTEMS ON INPUT-TO-STATE STABILITY OF IMPULSIVE SYSTEMS EXTENDED VERSION) João P. Hespanha Electrical and Comp. Eng. Dept. Univ. California, Santa Barbara Daniel Liberzon Coordinated Science Lab. Univ. of Illinois,

More information

Examples include: (a) the Lorenz system for climate and weather modeling (b) the Hodgkin-Huxley system for neuron modeling

Examples include: (a) the Lorenz system for climate and weather modeling (b) the Hodgkin-Huxley system for neuron modeling 1 Introduction Many natural processes can be viewed as dynamical systems, where the system is represented by a set of state variables and its evolution governed by a set of differential equations. Examples

More information

EML5311 Lyapunov Stability & Robust Control Design

EML5311 Lyapunov Stability & Robust Control Design EML5311 Lyapunov Stability & Robust Control Design 1 Lyapunov Stability criterion In Robust control design of nonlinear uncertain systems, stability theory plays an important role in engineering systems.

More information

Lecture - 11 Bendixson and Poincare Bendixson Criteria Van der Pol Oscillator

Lecture - 11 Bendixson and Poincare Bendixson Criteria Van der Pol Oscillator Nonlinear Dynamical Systems Prof. Madhu. N. Belur and Prof. Harish. K. Pillai Department of Electrical Engineering Indian Institute of Technology, Bombay Lecture - 11 Bendixson and Poincare Bendixson Criteria

More information