arxiv: v1 [math.oc] 20 Dec 2018

Transcription

1 Robust H Filtering for Nonlinear Discrete-time Stochastic arxiv: v1 [math.oc] 2 Dec 218 Systems Tianliang Zhang 1, Feiqi Deng 1 and Weihai Zhang 2 1 School of Automation Science and Engineering, South China University of Technology, Guangzhou 5164, P. R. China 2 College of Information and Electrical Engineering, Shandong University of Science and Technology, Qingdao 26651, P. R. China Abstract- ThispapermainlydiscussestheH filteringofgeneralnonlineardiscretetimevarying stochastic systems. A nonlinear discrete-time stochastic bounded real lemma (SBRL) is firstly obtained by means of the smoothness of the conditional mathematical expectation, and then, based on the given SBRL and a stochastic LaSalle-type theorem, a sufficient condition for the existence of the H filtering of general nonlinear discrete time-varying stochastic systems is presented via a new introduced Hamilton-Jacobi inequality (HJI), which is easily verified. When the worst-case disturbance {vk } k N is considered, the suboptimal H 2 /H filtering is studied. Two examples including a practical engineering example show the effectiveness of our main results. Keywords: H filtering, suboptimal H 2 /H filtering, stochastic LaSalle-type theorem, discrete-time stochastic systems, internal stability and external stability. 1 Introduction H control theory was initially formulated by G. Zames [27] in the early 198 s for linear time-invariant systems, which has been one of the most important control approaches in the presence of external disturbances. Because in engineering practice, the system state is not always available, how to estimate the unavailable state variable or a linear combination of the state variable from the measurement output is an important issue of modern control theory. t lzhang@163.com(t. Zhang), aufqdeng@scut.edu.cn(f. Deng), w hzhang@163.com(w. Zhang) 1

2 When the system noise is stationary Gaussian white noise, Kalman filtering has been shown to be one of the most celebrated estimation methods. However, in practical applications, we may not be able to accurately know the statistical properties of external disturbances. In this case, one has to turn to Robust H filter. Robust H filter requires one to design a filter such that the l 2 -gain from the exogenous disturbance to the estimated error is less than a prescribed level γ >. In contrast with the well-known Kalman filtering, one of the main advantages of H filtering is that it is not necessary to know exactly the statistical properties of the external disturbance but only assumes the external disturbance to have bounded energy [31]. We refer the reader to [3,4,18,21,24,26] for practical applications of H filtering in signal processing and sensor networks. Stochastic H control of linear continuous-time Itô stochastic systems seems to start from the well-known works [11, 22]. After then, based on the stochastic bounded real lemma of [11], full- and reduced-order robust H estimation problems for stationary continuous-time linear stochastic Itô systems were discussed in[8] and[25], respectively. All the above works are limited to the linear stationary stochastic systems. We refer the reader to the monographs [5, 2, 29] for the early development in the H control theory of linear Itô systems. By means of completing squares and stochastic dynamic programming principle, the state-feedback H control was extensively investigated in[3] for affine stochastic Itô systems. Based on the stochastic bounded real lemma given in [3], the reference [31] solved the the nonlinear stochastic H filter design of nonlinear affine Itô systems by solving a second-order Hamilton-Jacobi inequality (HJI). As said by J. P. LaSalle [13], Today there is more and more reason for studying difference equations systematically. They are in their own right important mathematical models.. Along the development of computer technique, it is expected that the study on discrete-time systems will become more and more important [2,6,7,16,28,32]. H control of linear discrete-time stochastic systems with multiplicative noise was initiated by [7], and then generalized to nonlinear discrete stochastic systems [2]. In [19], H filtering of discrete fuzzy stochastic systems with sensor nonlinearities was studied. In [14], H filtering for a class of nonlinear discrete-time stochastic systems with uncertainties and random Markovian delays was investigated. Although, the H control and filtering of continuous-time Itô systems have been solved in [3] and [31], respectively. However, for a general nonlinear discrete stochastic system, its H control and filtering problems seem more complicated than continuous-time Itô systems. The main reason lies in that discrete nonlinear stochastic systems do not have an infinitesimal generator LV(x) as in 2

3 Itô systems, which is a useful tool in completing squares [17]. In [2], the nonlinear discrete-time H control was discussed based on an HJI, where the HJI depends on the supremum of a conditional mathematical expectation function, which is not easily verified. Generally speaking, the technique of completing squares used in [3] becomes invalid for general discrete-time nonlinear systems. Moreover, due to adaptiveness requirement, the method of Taylor s series expansion is not applicable as done in deterministic nonlinear systems [15]; see [29]. Assummarizedabove, howtogivepracticalcriteriaforgeneraldiscretestochastich control and filtering that do not depend on the mathematical expectation of the state trajectory is a challenging work. In [32], by Doob s super-martingale theory, a LaSalle-type stability theorem was established. A newmethodbased on convex analysis was introducedto solve theh control of general discrete-time nonlinear stochastic systems in [16]. In [16], the Lyapunov function is selected as a convex function, which help separate the state x k from the coupling of x k and the unknown exogenous disturbance v k. In this paper, our main goal is to deal with H filtering for general nonlinear discrete stochastic systems. Firstly, by applying the smoothness of the conditional mathematical expectation, for general discrete time-varying nonlinear time-varying stochastic systems, a stochastic bounded real lemma (SBRL) on external stability is given based on a new introduced HJI, where the HJI does not depend on the mathematical expectations of the state and external disturbance. Secondly, a sufficient condition for the existence of H filtering for general nonlinear discrete time-varying stochastic systems has been presented based on our newly developed stochastic LaSalle s invariant principle [32] and SBRL. As corollaries, H filtering problems of nonlinear stochastic time-invariant systems and affine nonlinear stochastic systems are discussed. Thirdly, wealsodiscussthesuboptimalh 2 /H filteringproblemsofnonlinearstochastic systemsandlinear stochastic systems under worst-case disturbance {vk } k N. In particular, for linear stochastic systems, we prove that a desired suboptimal H 2 /H filtering can be constructed by solving a convex optimization problem. This paper is organized as follows: In section 2, some preliminaries are made, where a useful lemma-lemma 2.3 on stability in probability is obtained. Section 3 is concerned about the general nonlinear H filtering, and section 4 is about the suboptimal H 2 /H filtering. In section 5, we present two examples, one is a numerical example, but the other one is a practical vehicle roll example, to illustrate the validity of our main results. For convenience, the notations adopted in this paper are as follows: 3

4 M : the transpose of the matrix M or vector M; M > (M < ): the matrix M is a positive definite (negative definite) real symmetric matrix; I n : n n identity matrix; R n : the n-dimensional real Euclidean vector space with the standard 2-norm x ; R n m : the space of n m real matrices. N := {,1,2,,}; l 2 (Ω,F,{F k} k N,R nv ): the space of stochastic F k -adapted sequence {v k } k N with the norm [ ] v l 2 = E v k 2 <. k= A function f(x) is called a positive function, if f(x) > for any x, and f() = ; K: the family of all strictly increasing continuous positive functions µ( ). 2 Preliminaries Consider the following general discrete time-varying nonlinear stochastic system x k+1 = f k (x k,w k,v k ), f k (,,), y k = g k (x k,v k ), g k (,), (1) z k = m k (x k,v k ), m k (,), where x k R n is the n-dimensional state vector, y k R ny is the n y -dimensional measurement output,v k R nv standsfortheexogenousdisturbancesignalwith{v k } k N l 2 (Ω,F,{F k} k N,R nv ), z k R nz is called the regulated output, which is the combination of the state and the exogenous disturbance to be estimated, and {w k } k N is a sequence of independent n w -dimensional random variables defined on the complete filtered probability space (Ω,F,{F k } k N,P), where F k = σ(w,w 1,,w k 1 ), F = {φ,ω}. f k : R n R nw R nv R n, g k : R n R nv R ny and m k : R n R nv R nz are continuous vector-valued functions. {x s,x,v k } k N denotes the solution sequence of system (1) with the initial state x R n starting at the initial time k = s under the exogenous disturbance {v k } k N. Similarly, {y s,x,v k } k N and {z s,x,v k } k N can also be defined. In what follows, we construct the following filter for the estimation of z k : ˆx k+1 = ˆf k (ˆx k )+ĝ k (y k ), ˆfk () = ĝ k () =, ẑ k = ˆm k (ˆx k ), ˆm k () =, ˆx =, where ˆx k R nˆx is the estimated value of x k, ˆfk, ĝ k, and ˆm k are filter parameters to be determined. ẑ k R nz is the estimated value of z k in system (1). Let η k = x k, and z k z k ẑ k, ˆx k 4 (2)

5 where z k denotes the estimation error of the regulated output, then we get the following augmented system: η k+1 = f k (η k,w k,v k ) = y k = g k (x k,v k ), f k (x k,w k,v k ) ˆf k (ˆx k )+ĝ k (y k ), (3) z k = m k (η k,v k ) = m k (x k,v k ) ˆm k (ˆx k ), where η k R nη. Remark 1 In practical engineering, only dim(ˆx k ) dim(x k ) is valuable. When dim(ˆx k ) = dim(x k ), (2) is called a full-order filter; when dim(ˆx k ) < dim(x k ), (2) is called a reduced-order filter; see [25]. Definition 1 (Internal stability) System (3) is said to be internally stable, if when v = {v k } k N, the zero solution of η k+1 = f k (η k,w k,) (4) is globally asymptotically stable in probability. In other word, for any ε >, there have ( ) and lim P η sup k η,η, k > ε = (5) P{ lim k η,η, k = } = 1. (6) When only (5) holds, system (4) is said to be stable in probability. Definition 2 (External stability) For any given positive real number γ >, system (3) is called externally stable, if for any nonzero {v k } k N l 2 (Ω,F,{F k} k N,R nv ) and zero initiate state η =, we have z 2 l 2 γ2 v 2 l. (7) 2 Remark 2 Define an operator called the perturbation operator of system (3) as follows: L : v l 2 (Ω,F,{F k } k N,R nv ) z l 2 (Ω,F,{F k } k N,R nz ) 5

6 with the norm of L defined by L = z l 2 sup, (8) η =, v l (Ω,F,{F 2 k } k N,R nv ) v l 2 then the inequality (7) can be rewritten as L γ. L means the worst case effect from the stochastic disturbance {v k } k N to the controlled output { z k } k N. Therefore, in order to determine whether the system (3) is externally stable, it is important to find a way to determine or estimate the norm L. The nonlinear stochastic H filtering can be stated as follows: Definition 3 (Nonlinear stochastic H filtering) Find the filter parameters ˆf k (ˆx), ĝ k (y), and ˆm k (ˆx k ) such that (i) The augmented system (3) is internally stable, i.e., when v k =, k N, system (3) is globally asymptotically stable in probability. (ii) The augmented system (3) is externally stable, i.e., the norm of the perturbation operator L γ, where γ > is the given disturbance attenuation level. Definition 4 [1,17] We consider a continuous function V k (x) := V(k,x) defined on N D r with D r := {x : x r}. Let K be the family of all continuous strictly increasing functions µ( ) : R + R +, such that µ() = and µ(t) > for any t >. (i) {V k (x)} k N is a positive definite function sequence on N D r in the sense of Lyapunov if V k () for k N, and there exists µ K, such that V k (x) µ( x ), (k,x) N D r. (ii) {V k (x)} k N is said to be radially unbounded if lim inf inf V k(x) =. (9) x k N We call v := {v k = v k } k N as the worst-case disturbance sequence, if v = argmin{j (v) := E 6 (γ 2 v k 2 z k 2 )}, k=

7 see [29]. The following property of the conditional mathematical expectation plays an important role in this paper. Lemma 1 (Theorem 6.4 of [12]) If R n -valued random variable α is independent of the σ- field G, and R d -valued random variable β is G-measurable, then for any bounded or nonnegative function f : R n R d R, E[f(α,β) G] = E[f(α,x)] x=β a.s. holds. For a Lyapunov function sequence {V k (η)} k N, V k : R nη R +, because w k is independent of F k, x k, ˆx k and v k are F k -measurable, from Lemma 1, we have E[V k+1 (η k+1 ) F k ] = E[V k+1 ( f k (η k,w k,v k )) F k ] = E[V k+1 ( f k (η,w k,v))] η=ηk,v=v k. We define v V k (η) := E[V k+1 ( f k (η,w k,v))] V k (η), η R nη,v R nv as the difference operator of the function sequence {V k } k N, and set H k (η,v) := v V k (η) + m k (η,v) 2. The following lemma is referred to as a SBRL, which gives a sufficient condition for the external stability. Lemma 2 For a given γ >, if there exists a positive definite Lyapunov function sequence {V k (η)} k N satisfies the following HJI inequality H k (η,v) γ 2 v 2, k N, (1) then system (3) is externally stable. Proof: Let {η k } k N be the solution of system (3), we have E[V k+1 (η k+1 )] E[V k (η k )] =E{E[V k+1 (η k+1 ) F k ]} E[V k (η k )] =E{E[V k+1 ( f k (η k,w k,v k ) F k ] V k (η k )}. (11) 7

8 By Lemma 1, we have E{E[V k+1 ( f k (η k,w k,v k ) F k ] V k (η k )} =E{E[V k+1 ( f k (η,w k,v))] η=ηk,v=v k V k (η k )} =E{[ v V k (η)] η=ηk,v=v k }, which together with condition (1), it follows from (11) that E[V k+1 (η k+1 )] E[V k (η k )] γ 2 E v k 2 E m k (η k,v k ) 2. (12) Taking a summation on both sides of the above inequality from k = to k = N, we can get that E[V N+1 (η N+1 )] E[V (η )] N N γ 2 E v k 2 E m k (η,v k ) 2. (13) k= k= Note that V k (η) > for η due to the positivity of the function sequence {V k } k N and η =, then (13) leads to N N E m k (η k,v k ) 2 = E z k 2 k= k= N γ 2 E v k 2. k= Let N, we obtain E z k 2 γ 2 E v k 2 k= k= for any {v k } k N l 2 (Ω,F,{F k } k N,R nv ). The proof is completed according to Definition 2. Lemma 3 Suppose there exist a positive definite Lyapunov function sequence {V k (η)} k N such that v= V k (η), (η,k) D h N, (14) then the stochastic difference equation η k+1 = f k (η k,w k,), η R η is stable in probability. 8

9 Proof: By Definition 4-(i), there exists µ( ) K such that V k (η) µ( η ), (η,k) D r N. For any ǫ (,1) and < r < h, because V k () =, k N, V k (η) is continuous with respect to η, we can find a positive constant δ >, δ < r such that For any fixed η D δ, define 1 ǫ sup η D δ V (η) µ(r). (15) τ r = max{k : η k < r}. Under the condition of v= V k (η), by Lemma 1, for any η i D r, we have E[V i+1 (η i+1 ) F i ] V i (η i ) =E[V i+1 ( f i (η i,ω i,)) V i (η i ) F i ] =E[V i+1 ( f i (η,ω i,)) V i (η)] η=ηi = v= V i (η) η=ηi, a.s.. Taking a summation from i = to τ r k, it follows that τ r k [E[V i+1 (η i+1 ) F i ] V i (η i )]. i= Taking a mathematical expectation operator in above, we have E[V τr k+1(η τr k+1)] V (η ). (16) Because E[V τr k+1(η τr k+1)] =E[I {τr<k}v τr+1(η τr+1)]+e[i {τr k}v k+1 (η k+1 )] E[I {τr<k}v τr+1(η τr+1)] P(τ r < k)µ(r). (17) Combing (15), (16) and (17) leads to P(τ r < k) V (η ) µ(r) ǫ. Let k, then P(τ r < ) ε, or equivalently, P( η k < r, k N) > 1 ε. This theorem is proved. The following is the so-called LaSalle-type theorem, which cites from Theorem 3.1 of [32]. 9

10 Lemma 4 Suppose there exist a radially unbounded positive Lyapunov function sequence {V k (η)} k N, a deterministic real-valued sequence {γ k } k N, and a nonnegative function W : R nη R +, satisfying Let η k be the solution of v= V k (η) γ k W(η), η R nη,k N, (18) γ k <. (19) k= η k+1 = f k (η k,w k,), k N, then and lim V k(η k ) exists and is finite almost surely, k lim W(η k) =,a.s.. k 3 General nonlinear H filtering In this section, we will discuss the H filtering design problem for both nonlinear time-varying and time-invariant stochastic systems. Theorem 1 For a given disturbance attenuation level γ >, suppose that there exist a positive definite radially unbounded Lyapunov sequence {V k } k N, and a positive radially unbounded function W : R nη R +, such that (1) and m k (η,) 2 W(η) (2) hold, then system (2) is a desired H filter for system (1). Proof: We first show that the augmented system (3) is internally stable. By (1) and the definition of H k (η,v), we have v= V k (η)+ m k (η,) 2 or equivalently, v= V k (η) m k (η,) 2. (21) By (2), (21) gives that v= V k (η) W(η), 1

11 which, according to Lemma 3, implies that system (3) is stable in probability when v =. In addition, by Lemma 4, we have lim k W(η k ) =,a.s.. In view of W(η) being a positive radially unbounded function, hence, the set of all limit points G (η) only contains a zero point, that is, G (η) = {η : W(η) = } = {}. So from lim k W(η k ) =, a.s., it follows that P{ lim k η k = } =. The internal stability is proved. While the external stability is obtained by Lemma 2. The proof of this theorem is completed. In particular, for the following discrete time-invariant nonlinear stochastic system x k+1 = f(x k,w k,v k ), f(,,) =, y k = g(x k,v k ), g(,) =, (22) z k = m(x k,v k ), m(,) =, the filter equation is often taken as ˆx k+1 = ˆf(ˆx k )+ĝ(y k ), ˆf() = ĝ() =, ẑ k = ˆm(ˆx k ), ˆm() =, ˆx =. In this case, the augmented system can be rewritten as η k+1 = f(η f(x k,w k,v k ) k,w k,v k ) =, ˆf(ˆx k )+ĝ(y k ) (23) (24) z k = m(η k,v k ) = m(x k,v k ) ˆm(ˆx k ). We choose a common positive Lyapunov function V : R nη R +, and for any η R nη,v R nv, we write v,k V(η) := E[V( f(η,w k,v))] V(η), k N, (25) and reset H k (η,v) := v,k V(η) + m(η,v) 2. Theorem 1 immediately yields the following corollary: 11

12 Corollary 1 For a given disturbance attenuation level γ >. Suppose there exist a positive radially unbounded Lyapunov function V(η), and a positive radially unbounded function W : R nη R +, such that (1) and m(η,) 2 W(η) (26) hold, then system (23) is a desired H filter for system (22). Remark 3 If {w k } k N is an independently identically distributed random variable sequence, then E[V( f(η,w k,v))] = E[V( f(η,w,v))], k N, while (25) and H k (η,v) can be replaced by v V(η) := E[V( f(η,w,v))] V(η) and respectively. H(η,v) := v V(η)+ m(η,v) 2, Corollary 2 For a given disturbance attenuation level γ >, suppose {w k } k N is an independently identically distributed random variable sequence. If there exist a positive radially unbounded Lyapunov function V(η), and a positive radially unbounded function W : R nη R +, satisfying (26) and H(η,v) γ 2 v 2, (27) then system (23) is a desired H filter for system (22). A special case of system (22) is the following affine nonlinear stochastic system x k+1 = f 1 (x k )+h 1 (x k )v k +[f 2 (x k )+h 2 (x k )v k ]w k, y k = g 1 (x k )+g 2 (x k )v k, (28) z k = m(x k ), k N, where {w k } k is a sequence of one-dimensional independent white noise processes. Assume that E[w i ] =, E[w i w j ] = δ ij, where δ ij is a Kronecker function defined by δ ij = for i j 12

13 while δ ij = 1 for i = j. We take the H filter equation for system (28) as ˆx k+1 = ˆf(ˆx k )+ĝ(ˆx k )y k, ẑ k = ˆm(ˆx k ), k N. Thus the augmented system can be rewritten as η k+1 = f 1 (η k )+ h 1 (η k )v k +[ f 2 (η k )+ h 2 (η k )v k ]w k, z k = m(η k ), (29) (3) where f 1 (η k ) = h 1 (η k ) = f 1 (x k ), f2 (η k ) = f 2(x k ) ˆf(ˆx k )+ĝ(ˆx k )g 1 (x k ) h 1 (x k ), h 2 (η k ) = h 2(x k ), ĝ(ˆx k )g 2 (x k ), m(η k ) = m(x k ) ˆm(ˆx k ). Theorem 2 Given the disturbance attenuation level γ >. Suppose m(η) is a continuous positive radially unbounded function, i.e., lim inf m(η) =. η If there exists a solution (Q >, ˆf,ĝ, ˆm) satisfying 2Θ 1 + Θ 2 η Qη + m(η) 2, (31) where Θ 1 = f 1 (η)q f 1 (η)+ f 2, (η)q f 2 (η), (32) Θ 2 = v (2 h 1(η)Q h 1 (η)+2 h 2(η)Q h 2 (η) γ 2 I)v. (33) Then, system (29) is the desired H filter of system (28). Proof: We take V(η) = η Qη for all η R nη. Since Q >, there holds lim infv(η) =. η 13

14 For any η R nη,v R nv, H k (η,v) = v,k V(η)+ m(η) 2 where Θ 1 is defined in (32), Because Hence, according to (31), =E[V( f 1 (η)+ h 1 (η)v +[ f 2 (η)+ h 2 (η)v]w k )] V(η)+ m(η) 2 =Θ 1 +Θ 2 +Θ 3 η Qη + m(η) 2, (34) Θ 2 =v ( h 1(η)Q h 1 (η)+ h 2(η)Q h 2 (η))v, Θ 3 = f 1(η)Q h 1 (η)v +v h 1 (η)q f 1 (η)+ f 2(η)Q h 2 (η)v +v h 2 (η)q f 2 (η). f 1(η)Q h 1 (η)v +v h 1 (η)q f 1 (η) v h 1 (η)q h 1 v + f 1(η)Q f 1, f 2 (η)q h 2 (η)v +v h 2 (η)q f 2 (η) f 2 (η)q f 2 +v h 2 (η)q h 2 v. H k (η,v) γ 2 v 2 2Θ 1 + Θ 2 η Qη + m(η) 2, where Θ 2 is defined in (33). So system (3) is externally stable by Lemma 2. In addition, from H k (η,v) γ 2 v 2, it yields that v=,k V(η) m(η) 2. By Lemma 4, lim m(η k) =,a.s.. k Since m(η k ) is a positive and radially unbounded function, we must have lim k η k =, a.s.. Hence, system (3) is internally stable. The proof is completed. If Q can be partitioned as a block diagonal matrix Q = Q 1, Q 2 then, the inequality (31) can be rewritten as 2Θ 1 + Θ 2 η Qη + m(η) 2 2[f 1(x)Q 1 f 1 (x)+(ˆf(ˆx)+ĝ(ˆx)g 1 (x)) Q 2 (ˆf(ˆx)+ĝ(ˆx)g 1 (x))]+v [2h 1 (x)q 1h 1 (x)v +2(ĝ(ˆx)g 2 (x)) Q 2 (ĝ(ˆx)g 2 (x)) γ 2 I]v x Q 1 x+ ˆx Q 2ˆx+2 m(x) 2 +2 ˆm(ˆx) 2. 14

15 So the following corollary is obtained. Corollary 3 Consider the disturbance attenuation level γ >. If there exists the solution (Q 1 >, Q 2 >, ˆf, ĝ, ˆm) solving 2[h 1 (x)q 1h 1 (x)+(ĝ(ˆx)g 2 (x)) Q 2 (ĝ(ˆx)g 2 (x))] γ 2 I, (35) and 2[f 1 (x)q 1f 1 (x)+(ˆf(ˆx)+ĝ(ˆx)g 1 (x)) Q 2 (ˆf(ˆx)+ĝ(ˆx)g 1 (x))] x Q 1 x+ ˆx Q 2ˆx+2 m(x) 2 +2 ˆm(ˆx) 2, (36) then the desired H filter for the system (28) is given by (29). 4 Suboptimal H 2 /H filtering In this section, we further consider the suboptimal H 2 /H filtering design, that is, we design a filter that not only satisfies the robust H performance, but also minimizes the estimation error under the worst-case disturbance. Theorem 3 Consider system (3). For a given disturbance attenuation level γ >, suppose there exist a positive definite Lyapunov function sequence {V k } k N, a deterministic real-valued sequence {γ k } k N, and a nonnegative function W : R nη R + satisfying (1), (19) and v V k (η) γ k W(η), k N, (η,v) R nη R nv, (37) then the worst-case disturbance {v k } k N and the corresponding augmented system state {η k } k N satisfy Moreover, k= H k (η k,v k ) γ2 v k 2 =, k N. (38) E z k 2 = V (η )+ γ 2 E vk 2, v = {vk } k N. k= Moreover a suboptimal mixed H 2 /H filter can be synthesized by solving the following constrained optimization problem: min V (η ). s.t.ˆf,ĝ,ˆm,(1),(37) 15

16 Proof: Firstly, foranyadmissibleexternaldisturbancev = {v k } k N l 2 (Ω,F,{F k} k N,R nv ) and any initial state η, by the smoothness of the conditional mathematical expectation, we get EV k (η k ) EV k+1 (η k+1 ) =E{E[V k (η k ) V k+1 ( f k (η k,w k,v k )] F k } =E{[V k (η)] E[V k+1 ( f k (η,w k,v)]} η=ηk,v=v k =E[ v V k ( f(η,w k,v))+γ 2 v 2 z k 2 ] η=ηk,v=v k γ 2 E v k 2 +E z k 2 =E[ H k (η,v)+γ 2 v 2 ] η=ηk,v=v k γ 2 E v k 2 +E z k 2. (39) Setting v k = v k in (39) and considering equation (38), it follows that γ 2 E v k 2 E z k 2 = EV k+1 (η k+1 ) EV k(η k ), where z k is the estimation error corresponding to v k. Taking the summation from k = to k = T on both sides of the above, we have T E[γ 2 vk 2 z k 2 ] = E[V T+1 (ηt+1)] V (η ). (4) k= Obviously, for any admissible disturbance {v k } k N l 2 (Ω,F,{F k } k N,R nv ) satisfying (1), we have T E[γ 2 v k 2 z k 2 ] E[V T+1 (η T+1 )] V (η ). (41) k= By (37) and Lemma 3.2 of [32], it yields that for v l 2 (Ω,F,{F k} k N,R nv ), Letting T in (4) and (41), we have lim E[V T+1(η T+1 )] =, T lim E[V T+1(ηT+1 )] =. T E[γ 2 v k 2 z k 2 ] k= E[γ 2 vk 2 z k 2 ] k= = V (η ), which shows that {v k } k N is the worst-case disturbance, and E z k 2 = V (η )+ γ 2 E vk 2, v = {vk } k N. k= k= 16

17 The theorem is proved. Based on Theorem 3, if we consider time-invariant system (24) and assume that w k, k N, have the same distribution, we can get the following corollary that is easily verified. Corollary 4 Consider system (24). For a given disturbance attenuation level γ >, suppose there exist a positive Lyapunov function V(η), a deterministic real-valued sequence {γ k } k N, and a nonnegative function W : R nη R +, such that, for k N, (η,v) R nη R nv, H(η,v) γ 2 v 2, (42) v V(η) γ k W(η), (43) and γ k <, k= then the worst-case disturbance {v k } k N and the corresponding augmented system state {η k } k N satisfy Moreover, k= H(η k,v k ) γ2 v k 2 =, k N. E z k 2 = V(η )+ γ 2 E vk 2, v = {vk } k N. k= Simultaneously, a suboptimal mixed H 2 /H filter can be synthesized by solving the following constrained optimization problem: min V (η ). s.t.ˆf,ĝ,ˆm,(42),(43) We find that for the general nonlinear stochastic system (1), to design its mixed H 2 /H filter, one needs to solve the constrained optimization problem: min V (η ), s.t.ˆf,ĝ,ˆm,(1),(37) which is not an easy thing. However, for linear discrete-time stochastic systems, the abovementioned problem can be converted into solving a convex optimization problem. In particular, the corresponding work for linear continuous time-invariant Itô systems has been done in [8]. We consider the following system x k+1 = Ax k +Bv k +(Cx k +Dv k )w k, y k = Kx k +Lv k, z k = Gx k +Mv k. (44) 17

18 Assume that Ew k = and Ew 2 k = 1 for all k N. {w k} k N is the one-dimensional independent random variable sequence. We design the following filter for the estimation of z k : ˆx k+1 = Ax k + ˆK(y k Kˆx k ), ẑ k = Gˆx k. Denoting η = x and z = z ẑ, we obtain x ˆx η k+1 = Ãη k + Bv k +( Cη k + Dv k )w k, z k = Gη k + Mv k, (45) (46) where à = A A ˆKK B, B =, C = B ˆKL D = D [, G = G D C C, ], M = M. Setting V(η) = η Pη and the disturbance attenuation level γ >, we have H(η,v) γ 2 v 2 =E[Ãη + Bv +( Cη + Dv)w k ] P[Ãη + Bv +( Cη + Dv)w k ] η Pη +( Gη + Mv) ( Gη + Mv) γ 2 v 2 = η P η v v =η [à PÃ+ C P C P + G G ( à P B + C P D + G M) ( B P B + D P D + M M γ 2 I) 1 (à P B + C P D + G M)]η +(v v ) ( B P B + D P D + M M γ 2 I)(v v ), where P = à PÃ+ C P C P + G G à P B + C P D + G M B P B + D P D + M M γ 2 I 18

19 and v = ( B P B + D P D + M M γ 2 I) 1 (Ã P B + C P D + G M)η. Thus when the following generalized algebraic Riccati inequality (GARI) Ã PÃ+ C P C P + G G ( Ã P B + C P D + G M) ( B P B + D P D + M M γ 2 I) 1 (Ã P B + C P D + G M) <, (47) B P B + D P D + M M γ 2 I < admits a positive definite matrix solution P >, (1) holds. So system (46) is externally stable by Lemma 2. From (47), v= V(η) = η (Ã PÃ+ C P C P)η < η Υη, where, Υ := G G ( Ã P B + C P D + G M) ( B P B + D P D + M M γ 2 I) 1 (Ã P B + C P D + G M) by Lemmas 3-4, system (46) is internally stable. Summarize the above discussions, we have Corollary 5 Consider system (46). For a given disturbance attenuation level γ >, if GARI (47) or P < has a positive definite matrix solution P >, then (45) is the H filter of (44). In this case, the worst-case disturbance {v k } k N satisfies v k = ( B P B + D P D + M M γ 2 I) 1 (Ã P B + C P D + G M)ηk. Moreover, a suboptimal mixed H 2 /H filter can be synthesized by solving the following constraint optimization problem: min s.t. ˆK,(47) trace(p). 19

20 Theorem 4 Consider system (44). For a given disturbance attenuation level γ >, if there exist matrices P 1 >, P 2 > and P K solving the following LMI P 1 A P 1 C P 1 C P 2 P 2 A P 2 K P K G γ 2 I B P 1 B P 2 L P K D P 1 D P 2 M P 1 <, P 2 P 1 P 2 I (48) then the filter (45) is the desired H filter and the filter parameter is given by ˆK = P 1 2 P K. Moreover, a suboptimal mixed H 2 /H filter can be synthesized by solving the following constraint optimization problem: min s.t. ˆK,(48) trace(p 1 +P 2 ). Proof: By Schur s complement, P < is equivalent to that P Ã P C P G γ 2 I B P D P M P <. P I If we take P = diag(p 1,P 2 ), considering system (46), then this theorem is proved by Corollary 5. 5 Illustrative examples In this section, we give two examples to illustrate the effectiveness of our obtained results. Example 5.1: Let x k = x k(1), y k = y k(1). We consider the following nonlinear x k (2) y k (2) 2

21 discrete-time stochastic system: x k+1 (1) =.6x k (1) 3 1+x k (1) 2 +x k (2) 2 +.1v kx k (1) +.5x k (2)sin(v k )w k, x k+1 (2) =.65x k (2)+.1x k (2)x k (1) +.5v k sin(x k (2))w k, (49) y k (1) =.5x k (1)+v k sin(x k (1)), y k (2) =.5x k (2)+v k sin(x k (2)), z k =.1x k (1)+.1x k (2). In the sequel, we design an H filter for system (49). The environmental noise {w k } k N is assumed as a one-dimensional independent white noise process and the external disturbance v k = 2 (.9999) k, k N, so k= v2 k <. We choose the Lyapunov function as V(η k ) = x k 2 + ˆx k 2 = x k I x k. ˆx k I ˆx k By Corollary 4, it is easy to test that (35) and (36) hold with Q 1 = I and Q 2 = I and the appropriate H filter for (49) is designed as ˆx k+1 (1) =.5ˆx k (1)+.5y k (1), ˆx k+1 (2) =.5ˆx k (2)+.5y k (2), (5) ẑ k =.1ˆx k (1)+.1ˆx k (2). Figures 1 and 2 show a sample trajectory in an experiment. Figure 1 shows trajectories of the z k and ẑ k, and the error z k = z k ẑ k is depicted in Figure 2. We use Matlab to simulate system (49) and system (5) for 1 times to obtain the approximate value of k i= E z2 i. In Figure 3, we can see that k i= E z2 i is always less than k i= Eγ2 vi 2, which is in accordance with our theoretical analysis. Example 5.2: In order to verify the validity of Theorem 4, we use the vehicle model in [1]. A vehicle s roll dynamic is governed by the following differential equation: I xx η +(C R +D n w k ) η +K R η =m s a y h cr +m s h cr gsin(η), (51) 21

22 iteration times k Figure 1: z k and ẑ k iteration times k Figure 2: The estimation error z k. 22

23 iteration times k iteration times k Figure 3: k i= Eγ2 v 2 i and k i= E z2 i. where η is the vehicle roll angle, D n means the noise intensity, I xx is the sprung mass moment of the inertia with respect to the roll axis, m s is the sprung mass, h cr is the sprung mass height about the roll axis, C R is the total torsional damping, K R is the stiffness coefficient, a y is the lateral acceleration at the vehicle center of gravity (COG) and g is the acceleration due to gravity. {w k } k N represents the system internal noise driven by one-dimensional independent white noise processes with E[w k ] =, E[w k w j ] = δ kj, where δ kj is a Kronecker function defined by δ kj = for k j while δ kj = 1 for k = j. Then, by setting the length of the sampling interval T =.1, the continuous-time system (51) can be discretized into the following system: x k+1 = Ax k +Cx k w k +Bv k, y k = Hx k +Lv k, (52) where x k = x k(1) x k (2) = z k = Mx k, η k, v k is the disturbance with v k =.1.9 t, y k is the η k 23

24 measurement signal, z k is the regulation output, and 1 T A =, C = (m sh cr K R )T I xx 1 C RT I xx DnT I xx H =, B =.7916, L =.8248 [ ], M = , All parameters of the Mercedes-Benz commercial vehicle used in [1] are presented in Table 1. Then, in order to estimate η k, we need to determine the parameter ˆK. So, by Theorem 4, we Table 1: Parameters of the Mercedes-Benz commercial vehicle Symbol Value Unit C R 5371 N ms/rad m s 17 kg h cr.25 m I xx 17 kg m 2 K R N ms/rad D n 2 N ms/rad can find a set of feasible solutions to (48) as follows: P 1 =, P 2 =, P K = and ˆK =

25 .5 xt(1) t(sec) t(sec) xt(2) 1 1 Figure 4: The state trajectory xk of system (52). Thus we can design a proper filter as 1 x = k+1 (ms hcr KR )T I xx under x = x (1) T 1 CR T Ixx x k (yk H x k ), z = x (1) k k (53) =. Using Matlab to simulate systems (52)-(53) for 1 times x (2).1 x (1), we can obtain Figures 4-5. From Figures 4 and 5, we can see = under x = 1 x (2) that the augmented system is stable. Figure 6 displays z k (1) = xk (1) x k (1), which converges to zero quickly. So, filter (53) can track the the adjustment output of (52). Based on the data P of the 1 experiments, we obtain the approximate value of ki= Ekz i k2. In Figure 7, the red P P curve stands for ki= Ekz i k2 and blue curve represents ki= Eγ 2 kvi k2. Figure 7 shows that Pk Pk i= Ekz i k i= γ Ekvi k, which is in accordance with our theoretical analysis. 25

26 x t (1) t(sec) t(sec) x t (2) 1.5 Figure 5: The state trajectory x k of system (53)..12 z t and its mean The mean t(sec) 2 25 Figure 6: z k (1) = xk (1) x k (1). 26 3

27 2.5 2 t/t i= zi 2 and t/t i= γ2 vi t(sec) Figure 7: k i= E z i 2 and k i= Eγ2 v i 2. 6 Conclusions ThispaperhasstudiedtherobustH filteringofgeneralnonlineardiscretestochasticsystems. A SBRL has been obtained based on the property of a conditional mathematical expectation (Lemma 2.2). By means of the discrete-time stochastic LaSalle s invariance principle, it is shown that the nonlinear stochastic H filtering can be constructed by solving an HJI. In the case of the worst-case disturbance {vk } k N, a suboptimal H 2 /H filtering has also been studied. Two examples including a practical example are presented to illustrate the validity of our main results. References [1] Boada, B. L., Boada, M. J. L., Vargas-Melendez, L., & Diaz, V. (218). A robust observer based on H filtering with parameter uncertainties combined with neural networks for estimation of vehicle roll angle, Mechanical Systems and Signal Processing, 99, [2] Berman, N., &Shaked,U.(26). H controlfordiscrete-timenonlinearstochasticsystems. IEEE Transactions on Automatic Control, 51, [3] Chen, B. S., & Wu, W. S. (28). Robust filtering circuit design for stochastic gene networks under intrinsic and extrinsic molecular noises. Mathematical Biosciences, 211:

28 [4] Wu, C. F., Chen, B. S., & Zhang, W. (217). Multiobjective Investment Policy for Nonlinear Stochastic Financial System: Fuzzy Approach. IEEE Transactions on Fuzzy Systems, 25(2): [5] Dragan, V., Morozan, T., & Stoica, A. M. (26). Mathematical Methods in Robust Control of Linear Stochastic Systems. New York: Springer. [6] Dragan, V., Morozan, T., & Stoica, A. M. (21). Mathematical Methods in Robust Control of Discrete-Time Linear Stochastic Systems. New York: Springer. [7] El Bouhtouri, A., Hinrichsen, D., & Pritchard, A. J. (1999). H -type control for discretetime stochastic systems. International Journal of Robust and Nonlinear Control, 9, [8] Gershon, E., Limebeer, D. J. N., Shaked, U., & Yaesh, I. (21). Robust H filtering of stationary continuous-time linear systems with stochastic uncertainties. IEEE Transactions on Automatic Control, 46, [9] EI Hellani, D., EI Hajjaji, A., & Ceschi, R. (218). Finite frequency H filter design for T-S fuzzy systems: New approach. Signal Processing, 143, [1] Has minskii, R. Z. (198). Stochastic Stability of Differential Equations. Alphen: Sijtjoff and Noordhoff. [11] Hinrichsen, D., & Pritchard, A. J. (1998). Stochastic H. SIAM Journal on Control and Optimization, 36, [12] Kallenberg O. (212). Foundations of Mordern Probability. New York: Springer-Verlag. [13] LaSalle, J. P. (1976). The Stability of Dynamical Systems. SIAM: Philadelphia. [14] Li, H., & Shi, Y. (212). Robust H filtering for nonlinear stochastic systems with uncertainties and Markov delays. Automatica, 48, [15] Lin, W., & Byrnes, C. I. (1996). H control of discrete-time nonlinear systems. IEEE Transactions on Automatic Control, 41(4): [16] Lin, X., Zhang, T., Zhang, W., & Chen, B. S. (218). New approach to general nonlinear discrete-time stochastic H control. IEEE Transactions on Automatic Control, 1.119/TAC

29 [17] Mao, X. (27). Stochastic Differential Equations and their Applications. 2nd Edition, Chichester:Horwood Publishing. [18] Mao, W., Deng, F., & Wan, A. (216). Robust H 2 /H global linearization filter design for nonlinear stochastic time-varying delay systems. Science China-Information Sciences, 59, 3224, doi: 1.17/s [19] Niu, Y., Ho, D. W. C., & Li, C. W. (21). Filtering for discrete fuzzy stochastic systems with sensor nonlinearities. IEEE Transactions on Fuzzy Systems, 18, [2] Petersen, I. R., Ugrinovskii, V. A., & Savkin, A. V. (2). Robust Control Design Using H Methods. New York: Springer-Verlag. [21] Su, X., Shi,P., Wu, L., & Song, Y. D. (216). Fault detection filtering for nonlinear switched stochastic systems. IEEE Transactions on Automatic Control, 61, [22] Ugrinovskii, V. A. (1998). Robust H control in the presence of stochastic uncertainty. Int J. Contr., 71, , [23] Wang, H., Zhang, D., & Lu, R. (218) Event-triggered H filter design for Markovian jump systems with quantization. Nonlinear Analysis: Hybrid Systems, 28, [24] Wang, T., Qiu, J., Fu, S., & Ji, W. (217). Distributed fuzzy H filtering for nonlinear multirate networked double-layer industrial processes. IEEE Transactions on Industrial Electronics, 64, [25] Xu, S., & Chen, T. (22). Reduced-order H filtering for stochastic systems. IEEE Transactions on Signal Processing, 5, [26] Yan, H., Qian, F., Yang, F., & Shi, H. (216). H filtering for nonlinear networked systems with randomly occurring distributed delays, missing measurements and sensor saturation. Information Sciences, 37, [27] Zames, G. (1981). Feedback and optimal sensitivity: model reference transformations, multiplicative seminorms, and approximate inverses. IEEE Transactions on Automatic Control, 26, [28] Zhao, X., & Deng, F. (214). Moment stability of nonlinear discrete stochastic systems with time-delays based on H-representation technique. Automatica, 5(2):

30 [29] Zhang, W., Xie, L., & Chen, B. S. (217). Stochastic H2/H Control: A Nash Game Approach. Boca Raton, FL, USA: CRC Press. [3] Zhang, W., & Chen, B. S. (26). State feedback H control for a class of nonlinear stochastic systems. SIAM Journal on Control and Optimization, 44, [31] Zhang, W., Chen, B. S., & Tseng, C. S. (25). RobustH filtering for nonlinear stochastic systems. IEEE Transactions on Signal Processing, 53, [32] Zhang, W., Lin, X., & Chen, B. S. (217). LaSalle-type theorem and its applications to infinite horizon optimal control of discrete-time nonlinear stochastic systems. IEEE Transactions on Automatic Control, 62,