arxiv: v1 [math.oc] 8 Sep 2015

Similar documents
Relative controllability of nonlinear systems with delays in control

Solution in semi infinite diffusion couples (error function analysis)

Existence and Uniqueness Results for Random Impulsive Integro-Differential Equation

CS286.2 Lecture 14: Quantum de Finetti Theorems II

V.Abramov - FURTHER ANALYSIS OF CONFIDENCE INTERVALS FOR LARGE CLIENT/SERVER COMPUTER NETWORKS

Comb Filters. Comb Filters

GENERATING CERTAIN QUINTIC IRREDUCIBLE POLYNOMIALS OVER FINITE FIELDS. Youngwoo Ahn and Kitae Kim

Dynamic Team Decision Theory. EECS 558 Project Shrutivandana Sharma and David Shuman December 10, 2005

Variants of Pegasos. December 11, 2009

John Geweke a and Gianni Amisano b a Departments of Economics and Statistics, University of Iowa, USA b European Central Bank, Frankfurt, Germany

CS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 4

On One Analytic Method of. Constructing Program Controls

HEAT CONDUCTION PROBLEM IN A TWO-LAYERED HOLLOW CYLINDER BY USING THE GREEN S FUNCTION METHOD

Lecture 18: The Laplace Transform (See Sections and 14.7 in Boas)

( ) () we define the interaction representation by the unitary transformation () = ()

CH.3. COMPATIBILITY EQUATIONS. Continuum Mechanics Course (MMC) - ETSECCPB - UPC

Comparison of Differences between Power Means 1

3. OVERVIEW OF NUMERICAL METHODS

Let s treat the problem of the response of a system to an applied external force. Again,

Chapter Lagrangian Interpolation

Chapter 6: AC Circuits

Appendix H: Rarefaction and extrapolation of Hill numbers for incidence data

In the complete model, these slopes are ANALYSIS OF VARIANCE FOR THE COMPLETE TWO-WAY MODEL. (! i+1 -! i ) + [(!") i+1,q - [(!

Notes on the stability of dynamic systems and the use of Eigen Values.

Approximate Analytic Solution of (2+1) - Dimensional Zakharov-Kuznetsov(Zk) Equations Using Homotopy

Linear Response Theory: The connection between QFT and experiments

CHAPTER 10: LINEAR DISCRIMINATION

Online Supplement for Dynamic Multi-Technology. Production-Inventory Problem with Emissions Trading

On computing differential transform of nonlinear non-autonomous functions and its applications

. The geometric multiplicity is dim[ker( λi. number of linearly independent eigenvectors associated with this eigenvalue.

ON THE WEAK LIMITS OF SMOOTH MAPS FOR THE DIRICHLET ENERGY BETWEEN MANIFOLDS

Robustness Experiments with Two Variance Components

THE PREDICTION OF COMPETITIVE ENVIRONMENT IN BUSINESS

Mechanics Physics 151

Part II CONTINUOUS TIME STOCHASTIC PROCESSES

Should Exact Index Numbers have Standard Errors? Theory and Application to Asian Growth

Cubic Bezier Homotopy Function for Solving Exponential Equations

e-journal Reliability: Theory& Applications No 2 (Vol.2) Vyacheslav Abramov

Mechanics Physics 151

Math 128b Project. Jude Yuen

. The geometric multiplicity is dim[ker( λi. A )], i.e. the number of linearly independent eigenvectors associated with this eigenvalue.

SOME NOISELESS CODING THEOREMS OF INACCURACY MEASURE OF ORDER α AND TYPE β

FI 3103 Quantum Physics

Epistemic Game Theory: Online Appendix

Tight results for Next Fit and Worst Fit with resource augmentation

Lecture 6: Learning for Control (Generalised Linear Regression)

How about the more general "linear" scalar functions of scalars (i.e., a 1st degree polynomial of the following form with a constant term )?

Time-interval analysis of β decay. V. Horvat and J. C. Hardy

Sampling Procedure of the Sum of two Binary Markov Process Realizations

On the numerical treatment ofthenonlinear partial differentialequation of fractional order

TSS = SST + SSE An orthogonal partition of the total SS

Performance Analysis for a Network having Standby Redundant Unit with Waiting in Repair

Mechanics Physics 151

Method of upper lower solutions for nonlinear system of fractional differential equations and applications

Decentralised Sliding Mode Load Frequency Control for an Interconnected Power System with Uncertainties and Nonlinearities

[ ] 2. [ ]3 + (Δx i + Δx i 1 ) / 2. Δx i-1 Δx i Δx i+1. TPG4160 Reservoir Simulation 2018 Lecture note 3. page 1 of 5

Lecture 11 SVM cont

PHYS 705: Classical Mechanics. Canonical Transformation

Outline. Probabilistic Model Learning. Probabilistic Model Learning. Probabilistic Model for Time-series Data: Hidden Markov Model

Volatility Interpolation

Testing a new idea to solve the P = NP problem with mathematical induction

A NEW TECHNIQUE FOR SOLVING THE 1-D BURGERS EQUATION

P R = P 0. The system is shown on the next figure:

Department of Economics University of Toronto

Motion in Two Dimensions

Bayes rule for a classification problem INF Discriminant functions for the normal density. Euclidean distance. Mahalanobis distance

Survival Analysis and Reliability. A Note on the Mean Residual Life Function of a Parallel System

First-order piecewise-linear dynamic circuits

Chapter 6 DETECTION AND ESTIMATION: Model of digital communication system. Fundamental issues in digital communications are

Ordinary Differential Equations in Neuroscience with Matlab examples. Aim 1- Gain understanding of how to set up and solve ODE s

II. Light is a Ray (Geometrical Optics)

FTCS Solution to the Heat Equation

Delay Dependent Robust Stability of T-S Fuzzy. Systems with Additive Time Varying Delays

On elements with index of the form 2 a 3 b in a parametric family of biquadratic elds

arxiv: v1 [cs.sy] 2 Sep 2014

Lecture VI Regression

Online Appendix for. Strategic safety stocks in supply chains with evolving forecasts

An introduction to Support Vector Machine

Density Matrix Description of NMR BCMB/CHEM 8190

Existence of Time Periodic Solutions for the Ginzburg-Landau Equations. model of superconductivity

Dual Approximate Dynamic Programming for Large Scale Hydro Valleys

2.1 Constitutive Theory

Discrete Time Approximation and Monte-Carlo Simulation of Backward Stochastic Differential Equations

@FMI c Kyung Moon Sa Co.

This document is downloaded from DR-NTU, Nanyang Technological University Library, Singapore.

A New Generalized Gronwall-Bellman Type Inequality

Genetic Algorithm in Parameter Estimation of Nonlinear Dynamic Systems

Handout # 6 (MEEN 617) Numerical Integration to Find Time Response of SDOF mechanical system Y X (2) and write EOM (1) as two first-order Eqs.

2/20/2013. EE 101 Midterm 2 Review

Advanced Machine Learning & Perception

Chapter 2 Linear dynamic analysis of a structural system

Dynamic Team Decision Theory

10. A.C CIRCUITS. Theoretically current grows to maximum value after infinite time. But practically it grows to maximum after 5τ. Decay of current :

Including the ordinary differential of distance with time as velocity makes a system of ordinary differential equations.

( ) [ ] MAP Decision Rule

Supporting Information: The integrated Global Temperature change Potential (igtp) and relationships between emission metrics

Appendix to Online Clustering with Experts

Lecture 2 M/G/1 queues. M/G/1-queue

Delay-Range-Dependent Stability Analysis for Continuous Linear System with Interval Delay

New M-Estimator Objective Function. in Simultaneous Equations Model. (A Comparative Study)

Transcription:

Non-lnear Graden Algorhm for Parameer Esmaon: Exended verson Juan G Rueda-Escobedo and Jame A oreno arxv:5090559v [mahoc] 8 Sep 05 Absrac Graden algorhms are classcal n adapve conrol and parameer esmaon For nsananeous quadrac cos funcons hey lead o a lnear me-varyng dynamc sysem ha converges exponenally under perssence of excaon condons In hs paper we consder nsananeous non-quadrac cos funcons, for whch he graden algorhm leads o non-lnear and non Lpschz me-varyng dynamcs, whch are homogeneous n he sae We show ha under perssence of excaon condons hey also converge globally, unformly and asympocally Compared o he lnear counerpar, hey accelerae he convergence and can provde for fne-me or fxed-me sably I INTRODUCTION Ths work s an exended verson of [] In hs paper he proof of he clams n [] are presened n he appendces Ths proof are omed n he frs work because of s lengh, nsead, he space s used o dscuss and clarfy he resuls A classcal lnear paramerc model s gven by y := u T θ 0, where θ 0 R n are he parameers, u R n s he regressor and y R s he measured sgnal Oupu y along wh an esmae of he parameers ˆθ s used o buld he oupu esmaon error e := u T ˆθ y, whch can be rewren as e = u T x, where x := ˆθ θ 0 s he parameer esmaon error The am s o use e o drve x o zero Snce Perssence of Excaon PE of u s equvalen o he Unform and Complee Observably of he assocaed lnear dynamcal sysem θ 0 = 0, y = u T θ 0 [], [3], s a necessary condon o assure unform and robus convergence of any algorhm In parcular, for he Lnear Graden Descen and he Recursve Leas Square ehods PE s a necessary and suffcen condon for exponenal convergence [], [3] In fac, he use of correcon erms lnear n e canno provde for convergence faser han exponenal So, f acceleraed convergence s desred, algorhms usng nonlnear correcng erms are requred In recen years, J G Rueda-Escobedo and J A oreno are wh Elécrca y Compuacón, Insuo de Ingenería, Unversdad Naconal Auónoma de éxco, 0450 éxco DF, exco, JRuedaE@ngenunammx; JorenoP@unammx he use of homogeneous sysems and homogeneous correcon erms for conrol and observaon purposes have been very successful n provdng fne me and fxed me convergence [4], [5] Furhermore, homogeneous hgher order sldng modes HOS provde for dsconnuous correcon erms, whch provde no only fne me convergence bu also nsensvy o mached, bounded perurbaons [6], [7], [8] Homogeney has been mporan for hese resuls, snce provdes useful properes: eg local asympoc sably s equvalen o global fne me sably for sysems of negave homogeney degree [9], [6], [0] ovaed by hese resuls we propose n hs work non-lnear esmaon algorhms, wh nonlnear correcon erms n e, ha lead o me-varyng dynamcal sysems The proposed schemes can be obaned as he negave graden of an nsananeous convex non smooh funcon of he oupu esmaon error The resulng error sysems are homogeneous or homogeneous n he b-lm n he esmaon error x [9], [], bu me-varyng Unlke me nvaran homogeneous sysems, me-varyng sysems do no possess such srong properes For example, neher local asympoc sably mples global asympoc sably, nor negave homogeney degree mples fne me convergence [] Some local asympoc sably resuls for me-varyng sysems homogeneous n he sae have been obaned, when he homogeney degree s zero [], and for posve homogeney degree [], usng averagng echnques We show n hs paper, n sraghforward a drec manner, ha he proposed algorhms converge globally and asympocally under he PE condon of he regressor When n =, he algorhm s able o converge n fne-me and s also able o esmae a me-varyng parameer oreover, addng homogeneous erms of posve degree he esmaon error converges n fxedme, e he convergence me s upper bounded by a consan ndependen of he nal esmaon error For n > global, unform and asympoc sably can be assured and acceleraon for large nal condons can be obaned

II OTIVATION AND PROBLE STATEENT The esmaon problem may be regarded as a mnmzaon problem In hs conex a common cornersone s o se a convex cos funcon of he oupu esmaon error In hs work we choose he followng srucure for he cos funcon Jˆθ p := u T ˆθ y p+ p + Here he exponen p > 0 s a parameer o be chosen The erm ˆθ Jˆθ p shows he drecon n whch he parameer esmaed needs o change Wh hs dea n mnd we propose he followng algorhm ˆθ := ˆθ Jˆθ p = u T ˆθ y p sgn u T ˆθ y u For he sake of readably le us defne w p := w p sgnw Wh hs convenon he algorhm s rewren as ˆθ = u T ˆθ y p u We denoe as compose algorhm an algorhm ha resuls from addng vecor felds of he form n o aval of he dynamcs ras assocaed o each p Ths leads o ˆθ = u T ˆθ y p u = To analyse he convergence of he algorhms o θ 0 he dynamcs of he esmaon error x = ˆθ θ 0 s needed Hence s necessary o compue he me dervave of x In he case of he sngle algorhm n hs error dynamcs s as follow ẋ = u T x p u 3 Consderng f, x = u T x p u and replacng he argumen x by ɛx, wh ɛ > 0, we have he followng relaon f, ɛx = ɛ p ɛf, x Takng hs no consderaon and followng Defnon n [], we can sad ha he sysem 3 s homogeneous wh homogeney degree p When 0 < p < he homogeney degree s negave; for p = s zero; and for p > he homogeney degree s posve Now, he convergence analyss for hs class of algorhms reduces o esablsh he sably and he aracvy of he orgn of a me-varan homogeneous sysem Repeang he same analyss for he compose algorhm he error dynamcs s ẋ = u T x p u 4 = Please, noce ha hs sysem s no longer homogeneous A quck sably check wh a quadrac Lyapunov funcon V x := xt x yelds o global unform sably GUS of he orgn of 3 and 4 The me dervave of V s presened for boh cases n order o show s negave sem-defnveness: along 3 V = u T x p+ 0, 5a along 4 V = u T x p+ 0 5b = Noce ha he erm u T x can vansh ousde he se { u = 0} { x = 0} To asser he unform asympoc sably UAS of he orgn of 3 and 4 u needs o be PE In [3] a convenen descrpon of he Perssen Excaon s gven Ths descrpon s expressed as a lower bound of he negral of he regressor and s found convenen because fs well n he sudy of he esmaon-error convergence For convenence he defnon s reproduced below Defnon : Le u : R + R n be a pecewse connuous funcon I s sad ha u s of PE f here exs T > 0 and ɛ > 0 such ha T +T u T sw ds ɛ, for all w R n wh w = To conclude hs secon, we presen some defnons of me-varyng sysems Defnon : Le a me-varyng sysem be represened by ẋ = fx, where f0, = 0 for all Le Ω be a conneced open subse of R n, such ha 0 Ω The pon x = 0 s Unformly fne-me sable UFTS f s unformly sable and for any x 0 Ω here exs 0 Tx 0 < + such ha x, 0, x 0 = 0 for all 0 + Tx 0 Also, f Ω = R n hen x = 0 s sad o be globally unformly fne-me sable GUFTS Unformly fxed-me sable UFxTS f s GUFTS and exs T < + such ha T Tx 0 for every x 0 R n III AIN RESULT In hs secon he sably of 3 and 4 s presened Two cases are recognzed: when only one parameer needs o be esmaed scalar case and when are more han one vecor case Ths dvson s done because he resuls n he vecor case do no reflec ceran phenomena ha occurred n he scalar one The proof of he heorems can be found n he Appendces

A Scalar Case The resuls n he scalar case are sronger han n he vecor one due o he fac ha he produc u T x can only be zero f one or boh of he varables are zero Perssen excaon prevens u o say n zero or o exhb a growng dwellng me n zero Ths mples ha, for sayng n zero, x needs o be zero When he exponen p s chosen n he nerval [0, he algorhm converges n unform fne-me and a bound of he convergence me s gven as an neger mulple of he perssen excaon perod T The nex saemen summarzes hs dscusson Theorem : Le u be a pece-wse connuous funcon of and of PE Le 0 p < and n =, hen he orgn of 3 s globally unformly fne-me sable An upper bound of he convergence me s Tx 0 x0 p pt ɛ p+ T 6 where x 0 s he esmaon error a he nal me; T and ɛ are as n Defnon and denoes he celng funcon When p = he lnear case s obaned and s properes are well know [], [3], for hs s lef ou of he dscusson For p > only global unform asympoc sably GUAS can be assered bu oher neresng propery arse No maer how large he nal error s, he me τc need o reach a smaller level se V x = c s only funcon of c Ths s referred o as escape from nfne n fne me unformly n We gaher hese resuls n he followng heorem Theorem : Le u be a pece-wse connuous funcon of and of PE, p > and n =, hen he orgn of 3 s globally unformly asympocally sable Furhermore, he me needed o escape from nfny o a compac regon V x c s bounded by τc p p T ɛ p+ c p T 7 The sudy of he convergence of he compose algorhm can be done usng he prevous resuls For he scalar case he sably can be assered va a Comparson Lemma for dfferenal nequales [4] In shor, he rajecores of he sysem 4 are below he rajecores correspondng o each of he sngle algorhms wh every solaed exponen p Ths can be seen from 5b whch can be rewren as V = = p + u p+ V p + p + u p+ V p +, =,,, h An mporan case occurs when a leas one exponen s n [0, and anoher one s greaer han one For hs case he me needed for he algorhm o converge o θ 0 s ndependen of he nal esmaon error and he nal me f u s of PE Ths s summarzed n he followng heorem Theorem 3: Le u be a pece-wse connuous funcon of and of PE, also n = Consder he sysem 4 and le P := {p, p,, p h } be he se of he exponens Denoe p m he mnmum elemen n P and p he maxmum Assume ha 0 p m < and p > Le P m be he subse of he exponen smaller han one and P he subse of he exponens greaer han one Defne p P as he exponen whch maxmzes p ɛ p+ and p P m he exponen whch maxmzes p ɛ p+, hen an upper bound of he me needed o converge o zero s T pt ɛ p+ + p p T ɛ p+ T Las bu no leas, a dsconnuous algorhm capable of esmang one varyng parameer s presened Ths algorhm makes use of he regressor sgn and he sgn of he oupu esmaon error ˆθ = L sgn uˆθ y sgn u, 8 wh L > 0 Now assume ha he parameer varaon s bounded, e θ [ γ, γ], γ 0 Also s consdered ha u s of PE and canno say n zero for me nervals, bu can cross The error dynamcs nduced by 8 s ẋ L sgn x + θ 9 whch s a dfferenal ncluson [9] By employng V x = x as Lyapunov Funcon s dervave along he rajecores of 9 s V = L x θx = L + θ sgnx x, whch s negave f L > γ and u 0 If u say n zero he rack of θ s los bu can be recovered laer f u s of PE To guaranee exac rackng, u canno say n zero B Vecor Case When θ 0 s a vecor he se where u T x s zero grows Ths changes he general behavour of our algorhms Only GUAS can be guaraneed n general wh perssen excaon Also, he dsconnuous algorhm whch resul of selecng p = 0 does no converge In he laer case, a sgnal of PE can be consruced for whch he oupu esmaon error e becomes zero n fne

me bu x does no reach he orgn The sably properes of he orgn of 3 are summarzed n he followng heorem Theorem 4: Le u be a pece-wse connuous funcon of and of PE, unformly bounded by u, hen he orgn of 3 s globally unformly asympocally sable for any p > 0 Alhough only GUAS can be assered wh PE n general, n he followng secon wo classes of sgnals of PE are presened One of hem guaranees global unform exponenal sably GUES and he oher GUFTS; n boh cases for 0 < p < Ths means ha he sgnals u whch can provde UFTS are n a subse of hose of PE The compose algorhm sll works n he vecor case bu nohng more han GUAS can be clamed In conras o he scalar case he sably of he compose vecor algorhm canno be obaned va he Comparson Lemma The followng heorem synheszes hs dscusson Theorem 5: Le u be a pece-wse connuous funcon of and of PE, unformly bounded by u, hen he orgn of 4 s globally unformly asympocally sable f p p m + where p m s he mnmum exponen n he se {p, p,, p h } and p s he maxmum The exra condon regardng he exponens appears due o he way he proof was done and we hnk s no nrnsc o he sably In he scalar case he Comparson Lemma gves nformaon abou he relaonshp beween he rajecores of he sngle algorhm bu n hs case nohng can be concluded In he nex secon smulaon examples are presened for he compose algorhm In he Fgure 4 and Fgure 5 can be seen ha he Lyapunov funcon s below of he correspondng one for he sngle algorhms bu hs does no need o be rue n general IV EXAPLES In hs secon examples are presened In he scalar case, smulaons of a parameer esmaon process are shown, whereas for he vecor case also he behavour of he error s suded for a specfc class of sgnals A Scalar case Numercal smulaon s performed o llusrae he dfference beween he classc graden algorhm and he famly presened n hs work For hs am we choose: θ 0 = 5, ˆθ0 = 0, u = cos Four algorhms were smulaed: one wh p = 3 4, oher wh p =, a hrd one wh p 3 = 3 and a compose one wh p and p 3 Fgure and Fgure show he behavour of he Lyapunov funcon V = ˆθ θ 0 In he frs fgure he nal value of V and s decayng behavour are presened for all he algorhms As can be seen here s an orderng n he decay: Compose > p = 3 > p = > p = 3 4, and hs s due o he nal value of V 0 >> When he esmaon error becomes smaller he order changes as n Fgure In Fgure he behavour s shown when V < 004 Fg Behavour of V n he Scalar case a In hs regon he decay order s: Compose > p = 3 4 > p = > p = 3 as s expeced from he knd of convergence of every algorhm: u fxed-me > u fne-me > u exponenal > u asympoc Ths order does no change for any fuure me Now a esmaon of a me-varyng parameer s done Fg Behavour of V n he Scalar case b va 8 The smulaon parameers are: θ = cos3 4, ˆθ0 = 0, u = cos + 5, L = 33 Snce he regressor s non-zero for any me, an exac rackng of he parameer s acheved as shown n Fgure 3 B Vecor case Frs smulaon resuls are presened for he esmaon process of hree parameers wh and Four algorhms were smulaed: he frs wh p = 3/4, he second wh p =, he hrd one wh p 3 = 3/ and he las one wh p and p 3 The smulaon resuls are shown n Fgure 4 and Fgure 5 o compare he behavour of he algorhms, when dfferen exponens are chosen Laer, he response of he algorhm for 0 < p < s found for

Fg 3 Tme-varyng parameer esmaon process Fg 5 Smulaon resuls vecor case b pecewse consan sgnal and he class of convergence s esablshed for For he smulaon example he nex condons were seleced: u = [ cos cos3 5 cos5 ]T, θ 0 = [ ] T 3 4, ˆθ 0 = [ 0 0 0 ]T As n he las secon only he plo of V = ˆθ θ 0 T ˆθ θ 0 s presened In Fgure 4 he decay of V s shown a he begnnng of he process and he decay order s preserved Also n Fgure 5 he change of order ha was found for he scalar case s obaned However we do no see, n general, a change of order for arbrary parameer values Now he response of he sysem 3 when u s Fg 4 Smulaon resuls for vecor case a pecewse consan s analyzed Le us defne a new varable as follows z := u T x, s dynamcs s ż = u T ẋ = u z p snce u = 0 almos everywhere, where denoes he Eucldean norm For smplcy we assume ha he lengh of he nervals where u remans consan has a consan value τ > 0 The soluon of z n he nerval [, +τ] wh u = µ, u µ > 0 and p > 0, p s z = z p p µ p sgnz For 0 < p < he expresson above holds f z p p u and z = 0 oherwse The soluon of z can be used o fnd he soluon of x by nocng ha ẋ = z p u Ths s gven n he forhcomng expresson x = x µ µ µ T x sgnµ T x µ T x p p µ p Resrcng he analyss for 0 < p < s clear ha, f τ s large enough hen x + τ s orhogonal o µ x + τ = x µ µµt x = I n µ µµt x Fx τ, f x p pu p+ m τ hen x + τ becomes orhogonal o µ Ths means ha here exss a ball cenered n zero for whch τ s always large enough o make x orhogonal o any µ If he sequence U = {µ } = s chosen o fulfl he noon of perssen excaon for dscree sysems n [5], hen he orgn s GUAS by Theorem 4 and x can reach any ball cenered n zero n fne me, e always reach he ball n where τ guaranees ha x becomes orhogonal o µ, and hs yelds a dscree sysem whch s descrbed by he followng dfference equaon x k+ = I n µ k µ kµ T k x k Only assumng PE of he sequence U, GUES of he orgn can be concluded makng an analogue analyss o he one shown n he proof for Theorem 4 n Appendx II-D bu akng V k x = x T k x k, V = V k+t V k x nsead of V x and V respecvely Now ake n muual orhogonal vecors {v, v,, v n }, v T v j = 0, j, and exce he sysem wh hem, hen x k+n = 0 x k+n = = n = I n v v v T x k I n n = v v v T x k = 0 A sequence consruced wh hese vecors s of PE and also makes he sysem GUFTS Ths shows ha perssen excaon canno guaranee fne-me convergence n he vecor case bu does no forbd

V CONCLUSIONS In hs work a parameer esmaon echnque s presened Wh he proposed algorhms we obaned fneme and fxed-me convergence o he rue parameers However hs properes canno be guaraneed n general A deep sudy of he sgnals ha can asser such mporan properes s sll needed Even hough he algorhms were seleced o make he error dynamcs homogeneous n he sae, hs does no help n he analyss However, he homogeneous nonlneares can enhance he robusness properes of our algorhms wr addve perurbaons n comparson wh classcal approaches ACKNOWLEDGEENT The auhors hank he fnancal suppor from PAPIIT- UNA Programa de Apoyo a Proyecos de Invesgacón e Innovacón Tecnológca, projec IN364; Fondo de Colaboracón II-FI UNA, Projec IISGBAS- -04; CONACyT Consejo Naconal de Cenca y Tecnología, projec 47; and CONACyT CVU: 4970 REFERENCES [] J G Rueda-Escobedo and J A oreno, Non-lnear graden algorhm for parameer esmaon, n Decson and Conrol CDC, 05 IEEE 54h Annual Conference on, 05, p o appear [] B D O Anderson, Exponenal sably of lnear equaons arsng n adapve denfcaon, IEEE Trans Auoma Conr, vol, no, pp 83 88, 977 [3] A P organ and K S Narendra, On he unform asympoc sably of ceran lnear nonauonomous dfferenal equaons, SIA Journal on Conrol and Opmzaon, vol 5, no, pp 5 4, Jan 977 [4] S Bha and D Bernsen, Geomerc homogeney wh applcaons o fne-me sably, ahemacs of Conrol, Sgnals, and Sysems, vol 7, no, pp 0 7, 005 [5] V Andreu, L Praly, and A Asolf, Homogeneous approxmaon, recursve observer desgn and oupu feedback, SIA J Conrol Opm, vol 47, no 4, pp 84 850, 008 [6] A Levan, Homogeney approach o hgh-order sldng mode desgn, Auomaca, vol 4, pp 83 830, 005 [7] J oreno, Lyapunov approach for analyss and desgn of second order sldng mode algorhms, n Sldng odes afer he frs decade of he s Cenury, ser LNCIS, 4, L Frdman, J oreno, and R Irare, Eds Berln - Hedelberg: Sprnger- Verlag, 0, pp 3 50 [8] E Bernuau, D Efmov, W Perruque, and A Polyakov, On homogeney and s applcaon n sldng mode, Inernaonal Journal of Frankln Inue, vol 35, no 4, pp 866 90, 04 [9] A Bacco and L Roser, Lapunov Funcons and Sably n Conrol Theory, ser Communcaon and Conrol Engneerng Berln - Hedelberg: Sprnger-Verlag, 005, ch 5, pp 80 86 [0] E Bernuau, D Efmov, W Perruque, and A Polyakov, On an exenson of homogeney noon for dfferenal nclusons, n European Conrol Conference, Zurch, Swzerland, Jul 03 [] J Peueman and D Aeyels, Averagng resuls and he sudy of unform asympoc sably of homogeneous dfferenal equaons ha are no fas me-varyng, SIA Journal on Conrol and Opmzaon, vol 37, no 4, pp 997 00, 999 [] R T Closkey, An averagng heorem for me-perodc degree zero homogeneous dfferenal equaons, Sysems & Conrol Leers, vol 3, pp 79 8, 997 [3] K S Narendra and A Annaswamy, Perssen excaon n adapve sysems, Inernaonal Journal of Conrol, vol 45, no, pp 7 60, 987 [4] H K Khall, Nonlnear Sysems Upper Saddle Rver, New Jersey 07458: Prence Hall, 00, ch 3, pp 0 04 [5] T-H Lee and K S Narendra, Robus adapve conrol of dscree-me sysems usng perssen excaon, Auomaca, vol 4, no 6, pp 78 788, 988 [6] K S Narendra and A Annaswamy, Sable Adapve Sysems Englewood Clffs, New Jersey 0763: Prence Hall, 989, ch, pp 7 74 APPENDIX I PERSISTENT EXCITATION To prove unform asympoc sably raher han unform sably he perssen excaon n he regressor s needed For usng he propery adequaely he nex proposon s developed Proposon : If u s of PE, hen he followng nequaly holds for T, ɛ and w as n Defnon and p 0 +T u T sw p+ ds T ɛ p+ Proof: Applyng he Hölder nequaly o f = u T w and g = on he nerval [, +T ] and usng as Hölder conjugaes we oban p+ and p p+ +T T p u T sw p+ ds usng Defnon leads o +T +T u T sw p+ ds T p+ u T sw ds p+, T p ɛp+ = T ɛ p+ Ths dervaon from he PE s done n he am of easly presen he proof of he heorems A Proof of Theorem APPENDIX II PROOF OF THEORES TO 5 For n = he erm u T x can be rewren as u x = u V replacng hs n 5a yelds V = p+ u p+ V p+ Solvng he dfferenal equaon we have V = V p 0 p p 0 us p+ ds p 0 Ths soluon s vald for p 0 and p For 0 p < he soluon exss f V p 0 p p 0 us p+ ds afer ha V = 0 The PE guaranees ha here exss 0 when he nequaly no longer holds To esmae hs me s suffcen o fnd an neger k such ha he negral of u p+ from

0 o 0 + kt s greaer han p / pv p 0 Usng Proposon 0+kT p us p+ ds kt ɛ p+ 0 p V p 0 Solvng for k and akng he leas neger ha fulflls he nequaly yelds p p k = V 0, pt ɛp+ hen he me ha guaranees ha V reaches zero s = k T + 0 Noce ha V 0 can be replaced by x 0 n o oban 6 B Poof of Theorem Consder agan he soluon for V n 0 Snce p >, Equaon 0 can be rewren as V = V p 0 + p p 0 us p+ p ds As u s of PE he denomnaor grows unbounded makng V 0 as Now an esmae of he me needed for V o decreases from V 0 o a value equal or smaller han c s calculaed Subsung V for c n 5a and evaluang he negral from 0 o s clear ha he value of he negral needs o be larger enough o sasfy he nex nequaly 0 us p+ ds p p c p V p 0 Fxng 0 as an neger mulple of T, e 0 = kt, from Proposon we know ha he negral s greaer or equal o kt ɛ p+ Forcng he RHS of he las nequaly o be less han kt ɛ p+ we ge kt ɛ p+ p p c p V p 0 Now solvng for k and akng he smalles neger ha fulfl he nequaly yelds k, p p T ɛ p+ c p V p 0 k = p p T ɛ p+ c p V p 0 Takng he lm when V 0 he bound 7 s found k = p T ɛ p+ p c p C Proof of Theorem 3 From 5b follows ha V u T x p+ = p + u V p +, whch defne a dfferen dfferenal nequaly for each erm n he sum From he Comparson Lemma we known ha he soluon of V s for below of each soluon of V p, where V p = u V p + ; V p ake he form of 0 Le p + P and P m be as n he heorem For each p P we can asser ha V p can escape from nfny o a compac se n fne me and so V Fx he level se as V x = and esmae he me needed o reach τ p p T ɛ p+ T, p P The smalles me ha he algorhm can guaranee s obaned when p ɛ p+ s maxmum Take ha quany as he esmae Now, wh p j P m, we can esmae he me needed for each V pj o converge from he level se V x = o zero Tx 0 p j T ɛ pj+ T, p j P m, x 0 V x0 = Agan, he smalles me ha he algorhm can guaranee s when p j ɛ pj+ s maxmzed Then he me needed by he algorhm o converge s, a mos, he sum of he wo esmaes D Proof of Theorem 4 Followng he dea n [6] a lower bound of he negral of u T x p+ s needed Take he erm u T x and add a zero n he form u T x u T x nsde he absolue value, by means of he rangle nequaly he nex paron s obaned u T x u T x u T x x Rsng boh sdes o p+ and usng he Jensen nequaly afer ha, he nequaly yelds u T x p+ p ut x p+ u T x x p+ Inegrang boh sdes from o +T and usng Proposon o bound he frs erm n he RHS becomes +T u T x p+ d T ɛp+ x p+ p +T u T x x p+ d To bound he magnude of he second erm n he RHS of he las nequaly, he nex procedure may be used

assumng u s unformly bounded, e u u : +T u T sx xs p+ ds u p+ +T x xs p+ ds u p+ T sup x xs p+ s [, +T ] u p+ T +T p+ ẋs ds 3 The norm of ẋ n hs case s u T x p u whch s less han u T x p u Hölder nequaly can be used wh f = u T x p and g = n he nerval [, + T ] wh p+ p and p + as Hölder conjugaes, hen +T p T u T sxs p+ ds +T p+ u T sxs p ds Usng hs n 3 and hen he resul n one ges +T u T x p+ d T ɛp+ p x p+ T u p+ +T p u T x p+ d Ths can be rewren as T ɛ p+ p x p+ +T u T x p+ d + T u p+ +T p, u T x p+ d By algebrac manpulaon and defnng z := u T x p+ d he noaon can be smplfed: +T z + T u p+ z p T ɛp+ p x p+ Noce ha he polynomal P z := z + T u p+ z p s a src monooncally ncreasng funcon for z 0 and s nverse exss By denong hs as P z and usng n he nequaly above, one ges +T z = u T x p+ d P T ɛ p+ x p+ p Recallng V from 5a and negrang for he same me nerval s obvous ha +T V d P T ɛ p+ p x p+ < 0 Snce P s also a src monooncally ncreasng funcon and from Theorem 5 n [3] he global unform asympoc sably of he orgn of 3 s sablshed for any p > 0 E Proof of Theorem 5 In 5b several erms of he form u T x p+ appear; an analyss of each erm separaely s done before sudy he full dervave of V By akng he erm u T x and addng a zero n he form u T x u T x nsde he absolue sgn and hen applyng he rangle nequaly he nex paron s found u T x u T x x + u T x, rsng o p + and usng he Jensen Inequaly p ut x p+ u T x x p+ Solvng for u T x p+ [, + T ] +T u T sxs p+ ds p + u T x p+ and negrang beween +T u T sx p+ ds +T u T sx xs p+ ds A lower bound of he frs erm n he RHS of he nequaly can be found usng Proposon The followng nequaly s obaned +T u T sxs p+ ds T ɛp+ p x p + +T u T sx xs p+ ds 4 A upper bound of he magnude of he second erm s que more dffcul Assumng u s unformly bounded by u, e u u, he negral can be bounded as +T u T sx xs p+ ds +T u p+ x xs p+ ds u p+ T sup x xs p+ s [,+T ] u p+ T +T p+ ẋs ds 5 Now an analyss of he negral of ẋ s requred Frs he norm of ẋ s esmaed ẋ = u T x p j u u u T x p j j= j= Inegrang and usng he Jensen nequaly for he funcon p+ +T p + ẋs ds u p + hp +T j= p + u T sxs p j ds 6

The resrcon p p m + guaranees ha p+ p j for every, j and hen p+ p p j, + p + p j are Hölder conjugaes Now he Hölder nequaly s used wh f = u T x pj and g = n he nerval [, + T ] and Hölder conjugaes as descrbed before T p p j + +T u T sxs p+ pj ds +T u T sxs p p + j ds Usng 5 n 6, applyng 7 n he sum, one has u p + h p T p +T + T p j j= u p + T +T From 4, 5 and 8 we oban +T u T sxs p+ pj ds u T sxs p+ ds T ɛp+ p x p + +T u p + h p T p + T p j j= 7 p + ẋs ds 8 u T sxs p+ pj ds Defnng z := +T u T sxs p+ ds he las nequaly can be rewren as z + u p + h p T p + T p zp j j T ɛp + x p p+ j= The polynomal n he LHS s a src monooncally ncreasng funcon and zero when z = 0, hen s nverse exss and also s a src monooncally ncreasng funcon By denong he polynomal as P and s nverse as P one ges +T u T sxs p+ ds P T ɛ p + p x p + 9 Now negrang 5b from o + T and usng 9 he nex nequaly for V s obaned +T V sds = = = +T P u T sxs p + ds T ɛ p + p x p + Ths sasfes he assumpons of he Theorem 5 n [3] and guaranees he global unform asympoc sably of he orgn of 4