Stochastic Nonlinear Stabilization Part II: Inverse Optimality Hua Deng and Miroslav Krstic Department of Mechanical Engineering h
|
|
- Arnold Dawson
- 5 years ago
- Views:
Transcription
1 Stochastic Nonlinear Stabilization Part II: Inverse Optimality Hua Deng and Miroslav Krstic Department of Mechanical Engineering University of Maryland College Park, MD 7 fax: ( {977 krstic@eng.umd.edu ( {7 ( {6 Submitted to Systems and Control Letters January, 997 Abstract After considering the stabilization of a specic class of stochastic nonlinear systems in a companion paper, in this second part, we address the classical question of when is a stabilizing (in probability controller optimal and show that for every system with a stochastic control Lyapunov function it is possible to construct a controller which is optimal with respect to a meaningful cost functional. hen we return to the problem from Part I and design an optimal backstepping controller whose cost functional includes penalty on control eort and which has an innite gain margin. Keywords: stochastic nonlinear systems, control Lyapunov functions, backstepping. his work was supported in part by the National Science Foundation under Grant ECS-9-86, in part by the Air Force Oce of Scientic Research under Grant F9696.
2 Introduction After considering the stabilization of strict-feedback stochastic systems in a companion paper [], in this paper we present the following new results: For general stochastic systems ane in the control and noise inputs, we design stabilizing control laws which are also optimal with respect to meaningful cost functionals. his result is a stochastic counterpart of the inverse optimality result of Freeman and Kokotovic [] for systems with deterministic uncertainties. Furthermore, we show how our backstepping design from [], which achieves stability, can be redesigned to also achieve inverse optimality. In contrast to the design of Pan and Basar [9], our cost functional includes penalty on the control eort and has an innite gain margin [](namely, the property that it remains stabilizing when multiplied by any constant no smaller than one, which is one of the main advantages of inverse optimality. Stochastic Control Lyapunov Functions Consider the system which, in addition to the noise input w, has a control input u: dx = f(xdt g (xdw g (xudt; (. where f( = ; g ( = and u IR m. We say that the system is globally asymptotically stabilizable in probability if there exists a control law u = (x continuous away from the origin, with ( =, such that the equilibrium x = of the closed-loop system is globally asymptotically stable in probability. Denition. A smooth positive denite radially unbounded function V : IR n IR is called a stochastic control Lyapunov function (sclf for system (. if it satises ( inf L uir m f V (g g L g V u < ; 8x 6= : (. he existence of an sclf guarantees global asymptotic stabilizability in probability, as shown in the following theorem whose proof we incorporate into the proof of heorem. for completeness. heorem. (Florchinger [] he system (. is globally asymptotically stabilizable in probability if there exists an sclf. Inverse Optimal Stabilization in Probability Denition. he problem of inverse optimal stabilization in probability for system (. is solvable if there exist a class K function whose derivative is also a class K function, a matrix-valued function R (x such that R (x = R (x > for all x, a positive denite radially unbounded function l(x, and a feedback control law u = (x continuous away from the origin with ( =, which guarantees global asymptotic stability in probability of the equilibrium x = and minimizes the cost functional J(u = E Z h l(x R (x = u i d : (.
3 In the language of stochastic risk-sensitive optimal control [], the cost functional (. would correspond to the risk-neutral case. In the next theorem we extensively use the Legendre-Fenchel transform given as follows: For a class K function, whose derivative is also a class K function, ` denotes `(r = heorem. Consider the control law Z r (? (sds: (. Lg V R?= u = (x =?R? (L g V ` ; (. L g V R?= where V (x is a Lyapunov function candidate, is a class K function whose derivative is also a class K function, and R (x is a matrix-valued function such that R (x = R (x >. If the control law (. achieves global asymptotic stability in probability for the system (. with respect to V (x, then the control law u = (x =? R? (L g V (? Lg V R?= L g V R?= ; (. solves the problem of inverse optimal stabilization in probability for the system (. by minimizing the cost functional (Z J(u = E l(x # R = u d ; (. where l(x = ` Lg V R?= (? ` Lg V R?=? L f V? # (g g : (.6 Proof. Since the control law (. globally asymptotically stabilizes the system in probability, then there exists a continuous positive denite function W : IR n IR such that LV j (: = L f V (g g L g V (x L f V (g r =?` V R?= g?w (x: (.7 hen we have l(x W (x (? ` Lg V R?= : (.8
4 Since W (x is positive denite,, and ` is a class K function (Lemma A., l(x is positive denite. herefore J(u is a meaningful cost functional. Before we engage into proving that the control law (. minimizes (., we rst show that it is stabilizing. With Lemma A. we get LV j (: = L f V (g g = L f V r (g g? L g V R?=?? Lg V R?= i h` Lg V R?= (? Lg V R?= LV j (: < ; 8x 6= ; (.9 which proves that (. achieves global asymptotic stability in probability and, in particular, that x(t with probability. Now we prove optimality. Recalling that the It^o dierential of V is dv = g (xdw; (. according to the property of It^o's integral [8, heorem.9], we get Z t E V (? V (t LV (x(d = : (. hen substituting l(x into J(u, we have (Z J(u = E l(x Now we note that which yields = E fv (x(g E? lim E fv (x(tg t = E fv (x(g E (Z (Z # u d R = LV j (: l(x R = u # R = u d ` Lg V R?= L g V u] dg? lim t E fv (x(tg : (. J(u = E fv (x(g E? R= R = u (Z = Lg V R?= R= u R= u R= u R = u u 7 d 9 >= >; ; (. ` R= u? lim E fv (x(tg : (. t
5 With the general Young's inequality (Lemma A., we obtain J(u E fv (x(g E? R= u (Z? ` R= R= u # u d ` R= u? lim t E fv (x(tg = E fv (x(g? lim t E fv (x(tg ; (. where the equality holds if and only if R= u R= u R= u = R= u u R= R= u ; (.6 that is, u = u. Since u = u is stabilizing in probability, lim t E fv (x(tg =, and thus arg min u J(u = u (.7 min u J(u = E fv (x(g : (.8 o satisfy the requirements of Denition., it only remains to prove that (x is continuous and ( =. Because g ; R =@x are continuous functions, and (? is a class K function, (x is continuous away from L g V R?= =. If Lg V R?=, continuity can be inferred from the fact that lim L g V R?= j (xj = lim L g V R?= = lim L g V R?= 8 < : ( R?= R?= Lg V R?= (? Lg V R?= 9 = L g V R?= ; (? Lg V R?= = : ( =, L g V ( = and we have ( =. Remark. Even though not explicit in the proof of heorem., V (x solves the following family of Hamilton-Jacobi-Bellman equations parameterized by [; : L f V r g? ` Lg V R?= l(x = : (. In the next corollary we design controllers which are inverse optimal in the sense of Denition.. Corollary. If the system (. has an sclf, then the problem of inverse optimal stabilization in probability is solvable.
6 Proof. Let (r = r, =, and R (x = I 8 >< >:? L g V (L g V r L g V (L g V ; L g V 6= any positive number; L g V = : (. hen, with (? (r = r, the optimal control candidate (. is given by Sontag's formula []: where u = s (x = 8 >< >:? r L g V (L g V L g V (L g V (L g V ; L g V 6= ; L g V = = L f V r (g g : (. According to [], this formula is smooth away from the origin because (. implies that, when x 6=, L g V = < : (. We note that the control law s (x will also be continuous at the origin if and only if the sclf V (x satises the small control property [] (the property that there exist some control law continuous at the origin which is stabilizing with respect to V (x. o prove that s (x is inverse optimal, we prove that the control law (. is stabilizing. Since ` (r = r, (. becomes u = s(x. hen the innitesimal generator of the system (. with the control law u = s(x is? LV =? r L g V (L g V # ; (. which is negative denite because of (.. Inverse Optimal Stabilization via Backstepping he controller given in able in [] is stabilizing but is not inverse optimal because it is not of the form (.. In this section we will redesign the stabilizing functions i (x to get an inverse optimal control law. n o design a control law in the form (., we rst note from V = z i that for system dx i = x i dt ' i (x i dw; i = ; ; n? (. dx n = udt ' n (x n dw; (. 6 i=
7 L g V = z n and, since u is a scalar input, R (x is sought as a scalar positive function. he following lemma is instrumental in motivating the inverse optimal design. Lemma. If there exists a continuous positive function M(x such that the control law u = (x =?M(xz n (. globally asymptotically stabilizes system (. in probability with respect to the Lyapunov n function V = z i, then the control law i= u = (x = (x; (. solves the problem of inverse optimal stabilization in probability. Proof. Let (r = r (. R = M?= : (.6 hen the control laws (. and (. are given, respectively, as u = (x =? R?= z n ; (.7 u = (x =? R?= z n : (.8 By dividing the last two expressions, we get (., and the lemma follows by heorem.. From the lemma it follows that we should seek a stabilizing control law in the form of (.. If we consider carefully the parenthesis including u in (. in [], every term except the second, the third, and the sixth has z n as a factor. We now deal with the three terms one at a time. he second term yields?z n n? l= =?z n? x l n? =?z n? n z n n? z l l= k= n? l= l z n? n z k lk z l? n? n? l= z n n? lk n? z n? n l n? z n l z lk k 7 z k lk l z l
8 = z n n? = z l l= k= n? n? l= z k n? n? z k k= l=k lk n? z l l= n? n? n? l= l? n? l= n? l l l= k= n? l where the inequality is obtained by applying Young's inequality, l l= n? lk n? lk lk z l ; n? n z n? z n l z l l z n? n z k n? z n lk lk lk z k n? ; (. and the last equation comes from changing the summation order in the second term. As to the third and the sixth terms, in the rst parenthesis in (: in [], we have? z n =? z n =? 8 z n = 8 z n n? p;q= n? ' p ' q n? p;q= n? q p;q= k= l= n? p q p;q= k= l= n? p p;q= k= l= n? p p q z k pk z n? n pqkl z n q q p;q= k= l= l= pk ql z k z n? n? n? z l ql pk ql z k z pqkl l pk ql z k n? n? pk ql z k p q z l p;q= k= l= pqkl l= z l n? n? p p= q=l k= pqkl (. and z n nn n? k= z k nk 8
9 = n? = 9 z n z nnn nk zk k= n? k nn nk z n # z k k= k n? k nn nk n? k= k= k Substituting (.9, (. and (. into (. in [], we have LV z n 8 < : u z n 8 z n 9 z n z p q p;q= k= l= n? n? n? n? l= n? k nn nk z z n? l= l z r z n? i= i?? l= ii z i r z i i z i i? x l? i? k= z k ik z i n k? k=i l= kil n r n? l z k: (. l l= k= pk ql z k z n n? z nnn nn n? n? nkj nlj j= k= l= nkl z z k? k= l= If li ; pqil ; and i are chosen as li i? p;q= kl n? z i i? z i r i? n? p p= q= k= n? n? p= q=i k= 9 = ; pqk i? ' p ' q i z i i? ikj ilj j= k= l= ikl z pqki i? z i i z i z i ii n? lk lk A : (. n? l=i li n? l= l? i?? n? n? p p= q= k= pqk n? n? p= q=i k= pqki where c and c i are those in [, (. and (.], and u =?M(xz n 9 p?? i = c (.6 = c i ; (.7 (.8
10 M(x = c n n? nn 8 n? p p;q= k= n? n? q n? r n? n? nkj nlj j= k= l= nkl n? l= n? l 9 pk ql z k n? k= l l= k= k nn n? lk lk where c i > ; i = ; ; n; and M(x is a positive function, with (.6{(.8, we get LV? n i= (.9 c i z i : (. hus, according to Lemma., we achieve not only global asymptotic stability in probability, but also inverse optimality. heorem. he control law u =? M(xz n; (. guarantees that the equilibrium at the origin of the system (. is globally asymptotically stable in probability and also minimizes the cost functional (Z J(u = E ; (. l(x 7 6 M(x? u # d for some positive denite radially unbounded function l(x parameterized by. Remark. We point out that the quartic form of the penalty on u in (. is due to the quartic nature of the sclf. Appendix Lemma A. (Krstic and Li [7] If and its derivative are class K functions, then the Legendre-Fenchel transform satises the following properties: (a `(r = r (? (r? (? (r = Z r (? (sds (A. (b `` = (A. (c ` is a class K function (A. (d ` ( (r = r (r? (r: (A. Lemma A. (Young's inequality [, heorem 6] For any two vectors x and y, the following holds x y (jxj `(jyj; and the equality is achieved if and only if y = (jxj x jxj ; that is, for x = (? (jyj y jyj : (A. (A.6
11 References []. Basar and P. Bernhard, H -Optimal Control and Related Minimax Design Problems: A Dynamic Game Approach, Boston, MA: Birkhauser, nd ed., 99. [] H. Deng and M. Krstic, \Stochastic nonlinear stabilization Part I: A backstepping design, submitted to Systems & Control Letters, 997. [] P. Florchinger, \A universal formula for the stabilization of control stochastic dierential equations, Stochastic Analysis and Applications, vol., pp. {6, 99. [] R. A. Freeman and P. V. Kokotovic, Robust Nonlinear Control Design, Boston, MA: Birkhauser, 996. [] G. Hardy, J. E. Littlewood, and G. Polya, Inequalities, nd Edition, Cambridge University Press, 989. [6] M. Krstic, I. Kanellakopoulos, and P. V. Kokotovic, Nonlinear and Adaptive Control Design, New York: Wiley, 99. [7] M. Krstic and Z. H. Li, \Inverse optimal design of input-to-state stabilizing nonlinear controllers, submitted to IEEE ransactions on Automatic Control, 996. [8] B. ksendal, Stochastic Dierential Equations{An Introduction with Applications, New York, Springer-Verlag, 99. [9] Z. Pan and. Basar, \Backstepping controller design for nonlinear stochastic systems under a risk-sensitive cost criterion, submitted to SIAM Journal of Control and Optimization, 996. [] R. Sepulchre, M. Jankovic and P. V. Kokotovic, Constructive Nonlinear Control, New York: Springer-Verlag, 997. [] E. D. Sontag, \A `universal' construction of Artstein's theorem on nonlinear stabilization, Systems & Control Letters, vol., pp. 7{, 989.
tion. For example, we shall write _x = f(x x d ) instead of _x(t) = f(x(t) x d (t)) and x d () instead of x d (t)(). The notation jj is used to denote
Extension of control Lyapunov functions to time-delay systems Mrdjan Jankovic Ford Research Laboratory P.O. Box 53, MD 36 SRL Dearborn, MI 4811 e-mail: mjankov1@ford.com Abstract The concept of control
More informationEVER since the emergence of stochastic stabilization theory
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 46, NO. 8, AUGUST 2001 1237 Stabilization of Stochastic Nonlinear Systems Driven by Noise of Unknown Covariance Hua Deng, Miroslav Krstić, and Ruth J. Williams
More informationGlobal stabilization of feedforward systems with exponentially unstable Jacobian linearization
Global stabilization of feedforward systems with exponentially unstable Jacobian linearization F Grognard, R Sepulchre, G Bastin Center for Systems Engineering and Applied Mechanics Université catholique
More informationOn integral-input-to-state stabilization
On integral-input-to-state stabilization Daniel Liberzon Dept. of Electrical Eng. Yale University New Haven, CT 652 liberzon@@sysc.eng.yale.edu Yuan Wang Dept. of Mathematics Florida Atlantic University
More informationAbstract. Previous characterizations of iss-stability are shown to generalize without change to the
On Characterizations of Input-to-State Stability with Respect to Compact Sets Eduardo D. Sontag and Yuan Wang Department of Mathematics, Rutgers University, New Brunswick, NJ 08903, USA Department of Mathematics,
More informationNONLINEAR SAMPLED DATA CONTROLLER REDESIGN VIA LYAPUNOV FUNCTIONS 1
NONLINEAR SAMPLED DAA CONROLLER REDESIGN VIA LYAPUNOV FUNCIONS 1 Lars Grüne Dragan Nešić Mathematical Institute, University of Bayreuth, 9544 Bayreuth, Germany, lars.gruene@uni-bayreuth.de Department of
More informationState-Feedback Optimal Controllers for Deterministic Nonlinear Systems
State-Feedback Optimal Controllers for Deterministic Nonlinear Systems Chang-Hee Won*, Abstract A full-state feedback optimal control problem is solved for a general deterministic nonlinear system. The
More informationLyapunov Based Control
Lyapunov Based Control Control Lyapunov Functions Consider the system: x = f(x, u), x R n f(0,0) = 0 Idea: Construct a stabilizing controller in steps: 1. Choose a differentiable function V: R n R, such
More informationnamics Conclusions are given in Section 4 2 Redesign by state feedback We refer the reader to Sontag [2, 3] for the denitions of class K, K and KL fun
Robust Global Stabilization with Input Unmodeled Dynamics: An ISS Small-Gain Approach Λ Zhong-Ping Jiang y Murat Arcak z Abstract: This paper addresses the global asymptotic stabilization of nonlinear
More informationDynamic backstepping control for pure-feedback nonlinear systems
Dynamic backstepping control for pure-feedback nonlinear systems ZHANG Sheng *, QIAN Wei-qi (7.6) Computational Aerodynamics Institution, China Aerodynamics Research and Development Center, Mianyang, 6,
More informationStrong Lyapunov Functions for Systems Satisfying the Conditions of La Salle
06 IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 49, NO. 6, JUNE 004 Strong Lyapunov Functions or Systems Satisying the Conditions o La Salle Frédéric Mazenc and Dragan Ne sić Abstract We present a construction
More informationBenchmark problems in stability and design of. switched systems. Daniel Liberzon and A. Stephen Morse. Department of Electrical Engineering
Benchmark problems in stability and design of switched systems Daniel Liberzon and A. Stephen Morse Department of Electrical Engineering Yale University New Haven, CT 06520-8267 fliberzon, morseg@sysc.eng.yale.edu
More informationLYAPUNOV theory plays a major role in stability analysis.
1090 IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 49, NO. 7, JULY 2004 Satisficing: A New Approach to Constructive Nonlinear Control J. Willard Curtis, Member, IEEE, and Randal W. Beard, Senior Member,
More informationSmall Gain Theorems on Input-to-Output Stability
Small Gain Theorems on Input-to-Output Stability Zhong-Ping Jiang Yuan Wang. Dept. of Electrical & Computer Engineering Polytechnic University Brooklyn, NY 11201, U.S.A. zjiang@control.poly.edu Dept. of
More informationH 1 optimisation. Is hoped that the practical advantages of receding horizon control might be combined with the robustness advantages of H 1 control.
A game theoretic approach to moving horizon control Sanjay Lall and Keith Glover Abstract A control law is constructed for a linear time varying system by solving a two player zero sum dierential game
More informationLocally optimal controllers and application to orbital transfer (long version)
9th IFAC Symposium on Nonlinear Control Systems Toulouse, France, September 4-6, 13 FrA1.4 Locally optimal controllers and application to orbital transfer (long version) S. Benachour V. Andrieu Université
More informationUCLA Chemical Engineering. Process & Control Systems Engineering Laboratory
Constrained Innite-Time Nonlinear Quadratic Optimal Control V. Manousiouthakis D. Chmielewski Chemical Engineering Department UCLA 1998 AIChE Annual Meeting Outline Unconstrained Innite-Time Nonlinear
More informationA NONLINEAR TRANSFORMATION APPROACH TO GLOBAL ADAPTIVE OUTPUT FEEDBACK CONTROL OF 3RD-ORDER UNCERTAIN NONLINEAR SYSTEMS
Copyright 00 IFAC 15th Triennial World Congress, Barcelona, Spain A NONLINEAR TRANSFORMATION APPROACH TO GLOBAL ADAPTIVE OUTPUT FEEDBACK CONTROL OF RD-ORDER UNCERTAIN NONLINEAR SYSTEMS Choon-Ki Ahn, Beom-Soo
More informationL -Bounded Robust Control of Nonlinear Cascade Systems
L -Bounded Robust Control of Nonlinear Cascade Systems Shoudong Huang M.R. James Z.P. Jiang August 19, 2004 Accepted by Systems & Control Letters Abstract In this paper, we consider the L -bounded robust
More informationVECTOR Lyapunov functions have been used for a long
2550 IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL 58, NO 10, OCTOBER 2013 Global Stabilization of Nonlinear Systems Based on Vector Control Lyapunov Functions Iasson Karafyllis Zhong-Ping Jiang, Fellow,
More informationNew Lyapunov Krasovskii functionals for stability of linear retarded and neutral type systems
Systems & Control Letters 43 (21 39 319 www.elsevier.com/locate/sysconle New Lyapunov Krasovskii functionals for stability of linear retarded and neutral type systems E. Fridman Department of Electrical
More informationFeedback stabilisation with positive control of dissipative compartmental systems
Feedback stabilisation with positive control of dissipative compartmental systems G. Bastin and A. Provost Centre for Systems Engineering and Applied Mechanics (CESAME Université Catholique de Louvain
More informationSINCE the 1959 publication of Otto J. M. Smith s Smith
IEEE TRANSACTIONS ON AUTOMATIC CONTROL 287 Input Delay Compensation for Forward Complete and Strict-Feedforward Nonlinear Systems Miroslav Krstic, Fellow, IEEE Abstract We present an approach for compensating
More informationEects of small delays on stability of singularly perturbed systems
Automatica 38 (2002) 897 902 www.elsevier.com/locate/automatica Technical Communique Eects of small delays on stability of singularly perturbed systems Emilia Fridman Department of Electrical Engineering
More informationand the nite horizon cost index with the nite terminal weighting matrix F > : N?1 X J(z r ; u; w) = [z(n)? z r (N)] T F [z(n)? z r (N)] + t= [kz? z r
Intervalwise Receding Horizon H 1 -Tracking Control for Discrete Linear Periodic Systems Ki Baek Kim, Jae-Won Lee, Young Il. Lee, and Wook Hyun Kwon School of Electrical Engineering Seoul National University,
More informationAdaptive and Robust Controls of Uncertain Systems With Nonlinear Parameterization
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 48, NO. 0, OCTOBER 003 87 Adaptive and Robust Controls of Uncertain Systems With Nonlinear Parameterization Zhihua Qu Abstract Two classes of partially known
More informationNavigation and Obstacle Avoidance via Backstepping for Mechanical Systems with Drift in the Closed Loop
Navigation and Obstacle Avoidance via Backstepping for Mechanical Systems with Drift in the Closed Loop Jan Maximilian Montenbruck, Mathias Bürger, Frank Allgöwer Abstract We study backstepping controllers
More informationConverse Lyapunov Functions for Inclusions 2 Basic denitions Given a set A, A stands for the closure of A, A stands for the interior set of A, coa sta
A smooth Lyapunov function from a class-kl estimate involving two positive semidenite functions Andrew R. Teel y ECE Dept. University of California Santa Barbara, CA 93106 teel@ece.ucsb.edu Laurent Praly
More informationFinite-time stability and input-to-state stability of stochastic nonlinear systems
Finite-time stability and input-to-state stability of stochastic nonlinear systems KANG Yu, ZHAO Ping,. Department of Automation, University of Science and Technology of China, Hefei 36, Anhui, P. R. China
More informationOutput Regulation of Uncertain Nonlinear Systems with Nonlinear Exosystems
Output Regulation of Uncertain Nonlinear Systems with Nonlinear Exosystems Zhengtao Ding Manchester School of Engineering, University of Manchester Oxford Road, Manchester M3 9PL, United Kingdom zhengtaoding@manacuk
More informationOptimal Control Using an Algebraic Method for Control-Affine Nonlinear Systems. Abstract
Optimal Control Using an Algebraic Method for Control-Affine Nonlinear Systems Chang-Hee Won and Saroj Biswas Department of Electrical and Computer Engineering Temple University 1947 N. 12th Street Philadelphia,
More informationInverse Optimality Design for Biological Movement Systems
Inverse Optimality Design for Biological Movement Systems Weiwei Li Emanuel Todorov Dan Liu Nordson Asymtek Carlsbad CA 921 USA e-mail: wwli@ieee.org. University of Washington Seattle WA 98195 USA Google
More informationRobust Stabilization of Jet Engine Compressor in the Presence of Noise and Unmeasured States
obust Stabilization of Jet Engine Compressor in the Presence of Noise and Unmeasured States John A Akpobi, Member, IAENG and Aloagbaye I Momodu Abstract Compressors for jet engines in operation experience
More informationH CONTROL FOR NONLINEAR STOCHASTIC SYSTEMS: THE OUTPUT-FEEDBACK CASE. Nadav Berman,1 Uri Shaked,2
H CONTROL FOR NONLINEAR STOCHASTIC SYSTEMS: THE OUTPUT-FEEDBACK CASE Nadav Berman,1 Uri Shaked,2 Ben-Gurion University of the Negev, Dept. of Mechanical Engineering, Beer-Sheva, Israel Tel-Aviv University,
More informationIN THIS paper we will consider nonlinear systems of the
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 44, NO. 1, JANUARY 1999 3 Robust Stabilization of Nonlinear Systems Pointwise Norm-Bounded Uncertainties: A Control Lyapunov Function Approach Stefano Battilotti,
More informationOn Sontag s Formula for the Input-to-State Practical Stabilization of Retarded Control-Affine Systems
On Sontag s Formula for the Input-to-State Practical Stabilization of Retarded Control-Affine Systems arxiv:1206.4240v1 [math.oc] 19 Jun 2012 P. Pepe Abstract In this paper input-to-state practically stabilizing
More informationGlobal Linearization, and nally Model Predictive (Receding Horizon) Control (MPC), including hybrid approaches such as Model Predictive Control combin
Comparison of Nonlinear Control Design Techniques on a Model of the Caltech Ducted Fan Jie Yu, Ali Jadbabaie y, James Primbs, and Yun Huang Abstract In this paper we compare dierent nonlinear control design
More informationA converse Lyapunov theorem for discrete-time systems with disturbances
Systems & Control Letters 45 (2002) 49 58 www.elsevier.com/locate/sysconle A converse Lyapunov theorem for discrete-time systems with disturbances Zhong-Ping Jiang a; ; 1, Yuan Wang b; 2 a Department of
More informationContraction Based Adaptive Control of a Class of Nonlinear Systems
9 American Control Conference Hyatt Regency Riverfront, St. Louis, MO, USA June -, 9 WeB4.5 Contraction Based Adaptive Control of a Class of Nonlinear Systems B. B. Sharma and I. N. Kar, Member IEEE Abstract
More informationEvent-based Stabilization of Nonlinear Time-Delay Systems
Preprints of the 19th World Congress The International Federation of Automatic Control Event-based Stabilization of Nonlinear Time-Delay Systems Sylvain Durand Nicolas Marchand J. Fermi Guerrero-Castellanos
More informationAn LMI Approach to Robust Controller Designs of Takagi-Sugeno fuzzy Systems with Parametric Uncertainties
An LMI Approach to Robust Controller Designs of akagi-sugeno fuzzy Systems with Parametric Uncertainties Li Qi and Jun-You Yang School of Electrical Engineering Shenyang University of echnolog Shenyang,
More informationAdaptive Nonlinear Control A Tutorial. Miroslav Krstić
Adaptive Nonlinear Control A Tutorial Miroslav Krstić University of California, San Diego Backstepping Tuning Functions Design Modular Design Output Feedback Extensions A Stochastic Example Applications
More informationRobust control and applications in economic theory
Robust control and applications in economic theory In honour of Professor Emeritus Grigoris Kalogeropoulos on the occasion of his retirement A. N. Yannacopoulos Department of Statistics AUEB 24 May 2013
More informationLinear Quadratic Zero-Sum Two-Person Differential Games Pierre Bernhard June 15, 2013
Linear Quadratic Zero-Sum Two-Person Differential Games Pierre Bernhard June 15, 2013 Abstract As in optimal control theory, linear quadratic (LQ) differential games (DG) can be solved, even in high dimension,
More informationLinear Quadratic Zero-Sum Two-Person Differential Games
Linear Quadratic Zero-Sum Two-Person Differential Games Pierre Bernhard To cite this version: Pierre Bernhard. Linear Quadratic Zero-Sum Two-Person Differential Games. Encyclopaedia of Systems and Control,
More informationStabilization of a Chain of Exponential Integrators Using a Strict Lyapunov Function
Stabilization of a Chain of Exponential Integrators Using a Strict Lyapunov Function Michael Malisoff Miroslav Krstic Chain of Exponential Integrators { Ẋ = (Y Y )X Ẏ = (D D)Y, (X, Y ) (0, ) 2 X = pest
More informationControlled Diffusions and Hamilton-Jacobi Bellman Equations
Controlled Diffusions and Hamilton-Jacobi Bellman Equations Emo Todorov Applied Mathematics and Computer Science & Engineering University of Washington Winter 2014 Emo Todorov (UW) AMATH/CSE 579, Winter
More informationRESEARCH ARTICLE. Nonlinear and locally optimal controller design for input affine locally controllable systems
International Journal of Control Vol., No., Month 2x, 1 17 RESEARCH ARTICLE Nonlinear and locally optimal controller design for input affine locally controllable systems Mariem Sahnoun, Vincent Andrieu,
More informationAn important method in stability and ISS analysis of continuous-time systems is based on the use class-kl and class-k functions (for classical results
Formulas relating KL stability estimates of discrete-time and sampled-data nonlinear systems D. Nesic Department of Electrical and Electronic Engineering, The University of Melbourne, Parkville, 3052,
More informationComments on integral variants of ISS 1
Systems & Control Letters 34 (1998) 93 1 Comments on integral variants of ISS 1 Eduardo D. Sontag Department of Mathematics, Rutgers University, Piscataway, NJ 8854-819, USA Received 2 June 1997; received
More informationAlexander Scheinker Miroslav Krstić. Model-Free Stabilization by Extremum Seeking
Alexander Scheinker Miroslav Krstić Model-Free Stabilization by Extremum Seeking 123 Preface Originating in 1922, in its 95-year history, extremum seeking has served as a tool for model-free real-time
More informationSwitching H 2/H Control of Singular Perturbation Systems
Australian Journal of Basic and Applied Sciences, 3(4): 443-45, 009 ISSN 1991-8178 Switching H /H Control of Singular Perturbation Systems Ahmad Fakharian, Fatemeh Jamshidi, Mohammad aghi Hamidi Beheshti
More informationInformation, Utility & Bounded Rationality
Information, Utility & Bounded Rationality Pedro A. Ortega and Daniel A. Braun Department of Engineering, University of Cambridge Trumpington Street, Cambridge, CB2 PZ, UK {dab54,pao32}@cam.ac.uk Abstract.
More informationResearch Article Finite-Time Robust Stabilization for Stochastic Neural Networks
Abstract and Applied Analysis Volume 212, Article ID 231349, 15 pages doi:1.1155/212/231349 Research Article Finite-Time Robust Stabilization for Stochastic Neural Networks Weixiong Jin, 1 Xiaoyang Liu,
More informationPrediction-based adaptive control of a class of discrete-time nonlinear systems with nonlinear growth rate
www.scichina.com info.scichina.com www.springerlin.com Prediction-based adaptive control of a class of discrete-time nonlinear systems with nonlinear growth rate WEI Chen & CHEN ZongJi School of Automation
More informationThe Uniformity Principle: A New Tool for. Probabilistic Robustness Analysis. B. R. Barmish and C. M. Lagoa. further discussion.
The Uniformity Principle A New Tool for Probabilistic Robustness Analysis B. R. Barmish and C. M. Lagoa Department of Electrical and Computer Engineering University of Wisconsin-Madison, Madison, WI 53706
More informationAn asymptotic ratio characterization of input-to-state stability
1 An asymptotic ratio characterization of input-to-state stability Daniel Liberzon and Hyungbo Shim Abstract For continuous-time nonlinear systems with inputs, we introduce the notion of an asymptotic
More informationGLOBAL ANALYSIS OF PIECEWISE LINEAR SYSTEMS USING IMPACT MAPS AND QUADRATIC SURFACE LYAPUNOV FUNCTIONS
GLOBAL ANALYSIS OF PIECEWISE LINEAR SYSTEMS USING IMPACT MAPS AND QUADRATIC SURFACE LYAPUNOV FUNCTIONS Jorge M. Gonçalves, Alexandre Megretski y, Munther A. Dahleh y California Institute of Technology
More information3 Stability and Lyapunov Functions
CDS140a Nonlinear Systems: Local Theory 02/01/2011 3 Stability and Lyapunov Functions 3.1 Lyapunov Stability Denition: An equilibrium point x 0 of (1) is stable if for all ɛ > 0, there exists a δ > 0 such
More informationRisk-Sensitive Control with HARA Utility
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 46, NO. 4, APRIL 2001 563 Risk-Sensitive Control with HARA Utility Andrew E. B. Lim Xun Yu Zhou, Senior Member, IEEE Abstract In this paper, a control methodology
More informationConverse Lyapunov theorem and Input-to-State Stability
Converse Lyapunov theorem and Input-to-State Stability April 6, 2014 1 Converse Lyapunov theorem In the previous lecture, we have discussed few examples of nonlinear control systems and stability concepts
More informationAn L 2 Disturbance Attenuation Solution to the Nonlinear Benchmark Problem Panagiotis Tsiotras Department of Mechanical, Aerospace and Nuclear Enginee
An L Disturbance Attenuation Solution to the Nonlinear Benchmark Problem Panagiotis Tsiotras Department of Mechanical, Aerospace and Nuclear Engineering University of Virginia, Charlottesville, VA 9- Tel:
More informationA GENERALIZATION OF SONTAG S FORMULA FOR HIGH-PERFORMANCE CLF-BASED CONTROL. J. Willard Curtis III. A dissertation submitted to the faculty of
A GENERALIZATION OF SONTAG S FORMULA FOR HIGH-PERFORMANCE CLF-BASED CONTROL by J. Willard Curtis III A dissertation submitted to the faculty of Brigham Young University in partial fulfillment of the requirements
More informationADAPTIVE EXTREMUM SEEKING CONTROL OF CONTINUOUS STIRRED TANK BIOREACTORS 1
ADAPTIVE EXTREMUM SEEKING CONTROL OF CONTINUOUS STIRRED TANK BIOREACTORS M. Guay, D. Dochain M. Perrier Department of Chemical Engineering, Queen s University, Kingston, Ontario, Canada K7L 3N6 CESAME,
More informationOPTIMAL CONTROL AND ESTIMATION
OPTIMAL CONTROL AND ESTIMATION Robert F. Stengel Department of Mechanical and Aerospace Engineering Princeton University, Princeton, New Jersey DOVER PUBLICATIONS, INC. New York CONTENTS 1. INTRODUCTION
More information1. Numerical Methods for Stochastic Control Problems in Continuous Time (with H. J. Kushner), Second Revised Edition, Springer-Verlag, New York, 2001.
Paul Dupuis Professor of Applied Mathematics Division of Applied Mathematics Brown University Publications Books: 1. Numerical Methods for Stochastic Control Problems in Continuous Time (with H. J. Kushner),
More informationH State-Feedback Controller Design for Discrete-Time Fuzzy Systems Using Fuzzy Weighting-Dependent Lyapunov Functions
IEEE TRANSACTIONS ON FUZZY SYSTEMS, VOL 11, NO 2, APRIL 2003 271 H State-Feedback Controller Design for Discrete-Time Fuzzy Systems Using Fuzzy Weighting-Dependent Lyapunov Functions Doo Jin Choi and PooGyeon
More informationPassivity-based Stabilization of Non-Compact Sets
Passivity-based Stabilization of Non-Compact Sets Mohamed I. El-Hawwary and Manfredi Maggiore Abstract We investigate the stabilization of closed sets for passive nonlinear systems which are contained
More informationTo appear in IEEE Control Systems Magazine 1. Basic Problems in Stability and Design of. Switched Systems. Yale University. New Haven, CT
To appear in IEEE Control Systems Magazine 1 Basic Problems in Stability and Design of Switched Systems Daniel Liberzon and A. Stephen Morse Department of Electrical Engineering Yale University New Haven,
More informationInput to state Stability
Input to state Stability Mini course, Universität Stuttgart, November 2004 Lars Grüne, Mathematisches Institut, Universität Bayreuth Part III: Lyapunov functions and quantitative aspects ISS Consider with
More informationNull controllable region of LTI discrete-time systems with input saturation
Automatica 38 (2002) 2009 2013 www.elsevier.com/locate/automatica Technical Communique Null controllable region of LTI discrete-time systems with input saturation Tingshu Hu a;, Daniel E. Miller b,liqiu
More informationHyperbolicity of Systems Describing Value Functions in Differential Games which Model Duopoly Problems. Joanna Zwierzchowska
Decision Making in Manufacturing and Services Vol. 9 05 No. pp. 89 00 Hyperbolicity of Systems Describing Value Functions in Differential Games which Model Duopoly Problems Joanna Zwierzchowska Abstract.
More informationDisturbance Attenuation for a Class of Nonlinear Systems by Output Feedback
Disturbance Attenuation for a Class of Nonlinear Systems by Output Feedback Wei in Chunjiang Qian and Xianqing Huang Submitted to Systems & Control etters /5/ Abstract This paper studies the problem of
More informationStability Criteria for Interconnected iiss Systems and ISS Systems Using Scaling of Supply Rates
Stability Criteria for Interconnected iiss Systems and ISS Systems Using Scaling of Supply Rates Hiroshi Ito Abstract This paper deals with problems of stability analysis of feedback and cascade interconnection
More information1. Introduction The nonlinear complementarity problem (NCP) is to nd a point x 2 IR n such that hx; F (x)i = ; x 2 IR n + ; F (x) 2 IRn + ; where F is
New NCP-Functions and Their Properties 3 by Christian Kanzow y, Nobuo Yamashita z and Masao Fukushima z y University of Hamburg, Institute of Applied Mathematics, Bundesstrasse 55, D-2146 Hamburg, Germany,
More informationonly nite eigenvalues. This is an extension of earlier results from [2]. Then we concentrate on the Riccati equation appearing in H 2 and linear quadr
The discrete algebraic Riccati equation and linear matrix inequality nton. Stoorvogel y Department of Mathematics and Computing Science Eindhoven Univ. of Technology P.O. ox 53, 56 M Eindhoven The Netherlands
More informationSolution of Stochastic Optimal Control Problems and Financial Applications
Journal of Mathematical Extension Vol. 11, No. 4, (2017), 27-44 ISSN: 1735-8299 URL: http://www.ijmex.com Solution of Stochastic Optimal Control Problems and Financial Applications 2 Mat B. Kafash 1 Faculty
More informationNonlinear Systems and Control Lecture # 12 Converse Lyapunov Functions & Time Varying Systems. p. 1/1
Nonlinear Systems and Control Lecture # 12 Converse Lyapunov Functions & Time Varying Systems p. 1/1 p. 2/1 Converse Lyapunov Theorem Exponential Stability Let x = 0 be an exponentially stable equilibrium
More informationsemigroups are consistent, we shall simply use the notation T (t). Assume further that U and Y are separable Hilbert spaces (the input and output spac
CDC-REG467 Optimal Hankel norm approximation for the Pritchard-Salamon class of non-exponentially stable innite-dimensional systems A.J. Sasane and R.F. Curtain Department of Mathematics, University of
More informationSpurious Chaotic Solutions of Dierential. Equations. Sigitas Keras. September Department of Applied Mathematics and Theoretical Physics
UNIVERSITY OF CAMBRIDGE Numerical Analysis Reports Spurious Chaotic Solutions of Dierential Equations Sigitas Keras DAMTP 994/NA6 September 994 Department of Applied Mathematics and Theoretical Physics
More informationChapter 13 Internal (Lyapunov) Stability 13.1 Introduction We have already seen some examples of both stable and unstable systems. The objective of th
Lectures on Dynamic Systems and Control Mohammed Dahleh Munther A. Dahleh George Verghese Department of Electrical Engineering and Computer Science Massachuasetts Institute of Technology 1 1 c Chapter
More informationUniversity of California. Berkeley, CA fzhangjun johans lygeros Abstract
Dynamical Systems Revisited: Hybrid Systems with Zeno Executions Jun Zhang, Karl Henrik Johansson y, John Lygeros, and Shankar Sastry Department of Electrical Engineering and Computer Sciences University
More informationLinear-Quadratic Stochastic Differential Games with General Noise Processes
Linear-Quadratic Stochastic Differential Games with General Noise Processes Tyrone E. Duncan Abstract In this paper a noncooperative, two person, zero sum, stochastic differential game is formulated and
More informationAsymptotic Properties of an Approximate Maximum Likelihood Estimator for Stochastic PDEs
Asymptotic Properties of an Approximate Maximum Likelihood Estimator for Stochastic PDEs M. Huebner S. Lototsky B.L. Rozovskii In: Yu. M. Kabanov, B. L. Rozovskii, and A. N. Shiryaev editors, Statistics
More informationDelay-Dependent Stability Criteria for Linear Systems with Multiple Time Delays
Delay-Dependent Stability Criteria for Linear Systems with Multiple Time Delays Yong He, Min Wu, Jin-Hua She Abstract This paper deals with the problem of the delay-dependent stability of linear systems
More informationINVERSE OPTIMAL CONTROL APPROACH FOR PINNING COMPLEX DYNAMICAL NETWORKS
PHYSCON 2013, San Luis Potosí, México, 26 29th August, 2013 INVERSE OPTIMAL CONTROL APPROACH FOR PINNING COMPLEX DYNAMICAL NETWORKS Edgar N. Sanchez IEEE Member Control Automatico CINVESTAV, Unidad Guadalajara
More informationAdaptive backstepping for trajectory tracking of nonlinearly parameterized class of nonlinear systems
Adaptive backstepping for trajectory tracking of nonlinearly parameterized class of nonlinear systems Hakim Bouadi, Felix Antonio Claudio Mora-Camino To cite this version: Hakim Bouadi, Felix Antonio Claudio
More informationNoise-to-State Stability for Stochastic Hopfield Neural Networks with Delays
Noise-to-State Stability for Stochastic Hopfield Neural Networks with Delays Yuli Fu and Xurong Mao Department of Statistics and Modelling Science,University of Strathclyde Glasgow G1 1XH,Scotland, UK
More informationLyapunov-based methods in control
Dr. Alexander Schaum Lyapunov-based methods in control Selected topics of control engineering Seminar Notes Stand: Summer term 2018 c Lehrstuhl für Regelungstechnik Christian Albrechts Universität zu Kiel
More informationAn Overview of Risk-Sensitive Stochastic Optimal Control
An Overview of Risk-Sensitive Stochastic Optimal Control Matt James Australian National University Workshop: Stochastic control, communications and numerics perspective UniSA, Adelaide, Sept. 2004. 1 Outline
More informationOptimal Control. Lecture 20. Control Lyapunov Function, Optimal Estimation. John T. Wen. April 5. Ref: Papers by R. Freeman (on-line), B&H Ch.
Optimal Control Lecture 20 Control Lyapunov Function, Optimal Estimation John T. Wen April 5 Ref: Papers by R. Freeman (on-line), B&H Ch. 12 Outline Summary of Control Lyapunov Function and example Introduction
More informationUCLA Chemical Engineering. Process & Control Systems Engineering Laboratory
Constrained Innite-time Optimal Control Donald J. Chmielewski Chemical Engineering Department University of California Los Angeles February 23, 2000 Stochastic Formulation - Min Max Formulation - UCLA
More informationA LaSalle version of Matrosov theorem
5th IEEE Conference on Decision Control European Control Conference (CDC-ECC) Orlo, FL, USA, December -5, A LaSalle version of Matrosov theorem Alessro Astolfi Laurent Praly Abstract A weak version of
More informationQuadratic Stability of Dynamical Systems. Raktim Bhattacharya Aerospace Engineering, Texas A&M University
.. Quadratic Stability of Dynamical Systems Raktim Bhattacharya Aerospace Engineering, Texas A&M University Quadratic Lyapunov Functions Quadratic Stability Dynamical system is quadratically stable if
More informationBACKSTEPPING FOR NONLINEAR SYSTEMS WITH DELAY IN THE INPUT REVISITED
BACKSTEPPING FOR NONLINEAR SYSTEMS WITH DELAY IN THE INPUT REVISITED FRÉDÉRIC MAZENC, SILVIU-IULIAN NICULESCU, AND MOUNIR BEKAIK Abstract. In this paper, a new solution to the problem of globally asymptotically
More informationObserver-based quantized output feedback control of nonlinear systems
Proceedings of the 17th World Congress The International Federation of Automatic Control Observer-based quantized output feedback control of nonlinear systems Daniel Liberzon Coordinated Science Laboratory,
More information2 BAISHENG YAN When L =,it is easily seen that the set K = coincides with the set of conformal matrices, that is, K = = fr j 0 R 2 SO(n)g: Weakly L-qu
RELAXATION AND ATTAINMENT RESULTS FOR AN INTEGRAL FUNCTIONAL WITH UNBOUNDED ENERGY-WELL BAISHENG YAN Abstract. Consider functional I(u) = R jjdujn ; L det Duj dx whose energy-well consists of matrices
More informationAverage Reward Parameters
Simulation-Based Optimization of Markov Reward Processes: Implementation Issues Peter Marbach 2 John N. Tsitsiklis 3 Abstract We consider discrete time, nite state space Markov reward processes which depend
More informationNoncooperative continuous-time Markov games
Morfismos, Vol. 9, No. 1, 2005, pp. 39 54 Noncooperative continuous-time Markov games Héctor Jasso-Fuentes Abstract This work concerns noncooperative continuous-time Markov games with Polish state and
More informationMarkov processes Course note 2. Martingale problems, recurrence properties of discrete time chains.
Institute for Applied Mathematics WS17/18 Massimiliano Gubinelli Markov processes Course note 2. Martingale problems, recurrence properties of discrete time chains. [version 1, 2017.11.1] We introduce
More information