Closed-Form Unbiased Frequency Estimation of a Noisy Sinusoid Using Notch Filters

Size: px
Start display at page:

Download "Closed-Form Unbiased Frequency Estimation of a Noisy Sinusoid Using Notch Filters"

Transcription

1 IEEE TRASACTIOS O AUTOMATIC COTROL, VOL. 48, O. 7, JULY small parameter " > 0, has been established. This proposition is based on the assumption of the stabilizability of the boundary-layer system. It was also shown that this connection is only one-direction valid, i.e., the controllability of the reduced-order and boundary-layer systems always yields the controllability of the original system, but not vice versa. The criterion of the impulse-free E0-controllability of the reduced-order system is derived in the terms of an auxiliary gain matrix K(t). The invariance of this criterion to K(t) is shown. Due to the duality, similar results can be obtained for the Euclidean space observability of singularly perturbed linear time-dependent systems with multiple small delay. In this case, the assumption of the stabilizability of the boundary-layer system has to be replaced by the assumption of the detectability of this system. [0] P. V. Kokotovic, Applications of singular perturbation techniques to control problems, SIAM Rev., vol. 6, pp , [1] H. K. Khalil, Feedback control of implicit singularly perturbed systems, in Proc. 3rd Conf. Decision Control, Las Vegas, V, 1984, pp Closed-Form Unbiased Frequency Estimation of a oisy Sinusoid Using otch Filters Sergio M. Savaresi, S. Bittanti, and H. C. So REFERECES [1] P. V. Kokotovic and A. H. Haddad, Controllability and time-optimal control of systems with slow and fast modes, IEEE Trans. Automat. Contr., vol. AC-0, pp , [] P. V. Kokotovic, H. K. Khalil, and J. O Reilly, Singular Perturbation Methods in Control: Analysis and Design. London, U.K.: Academic, [3] H. K. Khalil, Feedback control of nonstandard singularly perturbed systems, IEEE Trans. Automat. Contr., vol. 34, pp , Oct [4] Y. Y. Wang, P. M. Frank, and. E. Wu, ear-optimal control of nonstandard singularly perturbed systems, Automatica, vol. 30, pp. 77 9, [5] H. Krishnan and. H. McClamroch, On the connection between nonlinear differential-algebraic equations and singularly perturbed control systems in nonstandard form, IEEE Trans. Automat. Contr., vol. 39, pp , May [6] V. Kecman and Z. Gajic, Optimal control and filtering for nonstandard singularly perturbed linear systems, J. Guid. Control Dyna., vol., pp , [7] H. Xu and K. Mizukami, onstandard extension of H -optimal control for singularly perturbed systems, in Advances in Dynamic Games and Applications. Boston, MA: Birkhauser, 000, vol. 5, pp [8] E. Fridman, A descriptor system approach to nonlinear singularly perturbed optimal control problem, Automatica, vol. 37, pp , 001. [9] V. Y. Glizer and E. Fridman, H control of linear singularly perturbed systems with small state delay, J. Math. Anal. Applicat., vol. 50, pp , 000. [10] T. B. Kopeikina, Controllability of singularly perturbed linear systems with time-lag, Diff. Equat., vol. 5, pp , [11] V. Y. Glizer, Euclidean space controllability of singularly perturbed linear systems with state delay, Syst. Control Lett., vol. 43, pp , 001. [1], Controllability of singularly perturbed linear time-dependent systems with small state delay, Dyna. Control, vol. 11, pp , 001. [13] R. B. Vinter and R. H. Kwong, The infinite time quadratic control problem for linear systems with state and control delays: an evolution equation approach, SIAM J. Control Optim., vol. 19, pp , [14] M. C. Delfour, C. McCalla, and S. K. Mitter, Stability and the infinite-time quadratic cost problem for linear hereditary differential systems, SIAM J. Control, vol. 13, pp , [15] V. Y. Glizer, Asymptotic solution of a singularly perturbed set of functional-differential equations of Riccati type encountered in the optimal control theory, onlinear Diff. Equat. Applicat., vol. 5, pp , [16] R. B. Zmood, The Euclidean space controllability of control systems with delay, SIAM J. Control, vol. 1, pp , [17] A. Halanay, Differential Equations: Stability, Oscillations, Time Lags. ew York: Academic, [18] I. M. Cherevko, An estimate for the fundamental matrix of singularly perturbed differential-functional equations and some applications, Diff. Equat., vol. 33, pp , [19] M. C. Delfour and S. K. Mitter, Controllability, observability and optimal feedback control of affine hereditary differential systems, SIAM J. Control, vol. 10, pp , 197. Abstract In this note, the problem of the frequency estimation of a sinusoid embedded in white noise is considered. The approach used herein is the minimization of the sample variance of the output of constrained notch filters fed by the noisy sinusoid. In particular, this note focuses on closed-form expressions of the frequency estimate, which can be obtained using notch filters having an all-zeros finite-inpulse response (FIR) structure. The results presented in this note are as follows. 1) It is shown that the FIR notch filters obtained from standard second-order infinite-impulse response (IIR) filters are inadequate. ) A new second-order IIR notch filter is proposed, which provides an unbiased estimate of the frequency. 3) The FIR filter obtained from the new IIR filter provides a closed-form unbiased frequency estimate. 4) The closed-form frequency estimate obtained using the new FIR notch filter asymptotically converges toward the Pisarenko Harmonic Decomposition estimator and the Yule Walker estimator. Index Terms Frequency estimation, harmonic analysis, notch filters, unbiased parameter identification. I. ITRODUCTIO AD PROBLEM STATEMET This note deals with the problem of estimating the frequency 0 of a harmonic signal s(t) =A cos( 0 t + '), given its noisy measurement y(t) =s(t)+n(t), t =1; ;...;, where n(t) is a zero-mean white Gaussian noise (n WG(0; )). This problem is frequently encountered in real-world applications, especially in the fields of adaptive control and signal processing, and numerous techniques have been developed for its treatment (see, e.g., [4] [7], [10] [13], [15], [18], [1]). This note focuses on the class of estimation methods based on constrained notch filters (see, e.g., [8] and the references cited therein). The basic idea underlying notch-filters-based estimation techniques is the minimization, with respect to, of the loss function J() = "(t; ) (1) where "(t; ) = G(z 01 ; )y(t) is the output of a notch filter with transfer function G(z 01 ; ), fed by the measured signal y(t). The notch of G(z 01 ; ) is centered around the frequency. In general, the dependence of J() on is nonlinear and nonconvex; hence, iterative quasi-ewton minimization methods must be used. Manuscript received ovember 5, 00; revised January 31, 00. Recommended by Associate Editor A. Garulli. This work was supported by MIUR project ew Methods for Identification and Adaptive Control for Industrial Systems, and by the EU project onlinear and Adaptive Control. S. M. Savaresi and S. Bittanti are with the Dipartimento di Elettronica e Informazione, Politecnico di Milano, 0133 Milan, Italy ( savaresi@elet.poi.it). H. C. So is with the Department of Computer Engineering and Information Technology, City University of Hong Kong, Hong Kong. Digital Object Identifier /TAC /03$ IEEE

2 186 IEEE TRASACTIOS O AUTOMATIC COTROL, VOL. 48, O. 7, JULY 003 Obviously, the most crucial design choice in a notch-based estimation technique is the selection of the structure and of the parameterization of the filter G(z 01 ; ). Usually, second-order IIR filter with a strongly constrained parameterization are used. Starting from second-order filters, simple finite-impulse response (FIR) filters or more sophisticated higher order infinite-impulse response (IIR) filters have been developed and proposed ([], [9], [17]). Two slightly different second-order IIR notch filters are typically used in practice. They have the following expressions: G 1(z 01 ; ;)= 1 0 cos()z01 + z cos()z 01 + z 0 () G cos()z 01 + z 0 (z ; ;)= 1 0 (1 + ) cos()z 01 + : (3) z0 In () and (3), the parameter (0 <1) is known as the de-biasing parameter or the poles-contraction factor (note that only affects the position of the poles). In the literature, filters of this type are also known as constrained notch filter, where the term constrained refers to the fact that their structure is strongly under parameterized: the five parameters of a fully-parameterized second-order digital IIR filter are reduced to one parameter only. As a matter of fact, since is regarded as a design parameter, the only unknown parameter of () and (3) is the angular frequency. The main difference between () and (3) is that (3) provides a rigorously unbiased estimation of the frequency of a pure tone embedded in white noise, whereas () provides a biased estimate. It is easy to see that such bias is negligible if 1; the problem of the bias becomes severe if 1. The properties of such filters have been discussed and analyzed in a large number of works (see, e.g., [3], [14], [5], [6], and the references cited therein). ote that if the unknown frequency 0 is time-varying, and the minimization of (1) is made recursively, the estimation algorithm usually is called frequency tracker (see e.g. []). otch filters are frequently used for real-time recursive frequency estimation: in the literature this problem is referred to as adaptive notch filtering (AF). This work does not focus on AF but the results presented herein can be straightforwardly extended to AF as well. The goal of this note is to develop closed-form frequency estimators based on notch filters. The starting point of this work can be summarized in the following simple observations. First, note that closed-form expressions of the frequency estimator cannot be obtained if the notch filter has a IIR structure, due to the autoregressive part of the filter. Moreover, observe that a constrained FIR notch filter can be easily obtained from G 1 (z 01 ; ;) by setting =0; unfortunately, this is not possible using G (z 01 ; ; ) (note that G (z 01 ; ; 0) is not a FIR). Finally, note that the closed-form frequency estimate obtained from G 1(z 01 ; ; 0) is severely affected by a bias error. Starting from these observations, the main results and original contributions of this note are the following. Section II: A new second-order IIR unbiasing constrained notch filter G 3(z 01 ; ;) is developed and analyzed. Section III: It is shown that a closed-form frequency estimate can be obtained using the FIR filters G 1 (z 01 ; ; 0) and G 3(z 01 ; ; 0); the major advantage of G 3(z 01 ; ; 0) over G 1(z 01 ; ; 0) is that it provides a rigorously unbiased estimate of 0. Section IV: It is shown that the closed-form frequency estimate provided by the FIR notch filter G 3(z 01 ; ; 0), if the number of data snapshots is large, tends to the frequency estimators provided by the Pisarenko Harmonic Decomposition (PHD) approach, and by the Yule Walker (YW) approach. II. EW UBIASIG SECOD-ORDER COSTRAIED OTCH FILTER As already remarked in Section I, one of the major drawbacks of the notch filter () (the most widely used in practice) is that it provides a biased estimation of 0. This bias is particularly severe when 1. Starting from the cost function (1), a new unbiasing second-order IIR notch filter can be obtained as follows. Consider the long-run (asymptotic) version of the cost function (1), namely where and J() =!1 1 "(t; ) = G(z 01 ; )y(t): "(t; ) It is easy to see that J() can be given the following expression (see [3]): J() = G(e j! ; ) S y (!)d! (4) where S y(!) is the power spectrum of y(t), which can be split into the power spectra of s(t) and n(t), namely S y (!) =S s (!)+S n (!) S n (!) = S s (!) = A 1 (! + 0)+ 1 (! 0 0) : Compute the asymptotic cost function J 1() associated with the notch filter G 1 (z 01 ; ;), by plugging in (4) the expression of the notch filter () and the expressions of S s (!) and S n (!) J 1 () = J 1 (s) () + J (n) 1 (); 1 () = 1 J (s) 1 () = A G 1(e j! ; ;) d! G 1(e j! ; 0 ;) : For the computation of 1 () (the contribution to J 1 () due to the noise) we have resorted to the Rugizka algorithm (this algorithm is based on theory of residues; see []). The calculus of J (s) 1 () calls for cumbersome but easier computations. The expressions obtained for J (s) 1 () and 1 () are shown in (5a) and (b) at the bottom of the page. It is interesting to note that an J (s) 1 () = 1 () = A (cos()0cos( 0)) cos ( 0)+4 cos () cos() cos( 0) 0 4 cos() cos( 0) 0 (5a) cos () + + cos () + 1 (1 + )( + cos() + 1) ( 0 cos() + 1) : (5b)

3 IEEE TRASACTIOS O AUTOMATIC COTROL, VOL. 48, O. 7, JULY Fig. 1. Shape of the function (; ) in the ranges [0; ] and [0; 1]. expression very similar to (5b) is proposed in [5] (10). The two expressions (both correctly derived) do not coincide since they have a slightly different meaning. Observe that the bias in the frequency estimate obtained using G 1 (z 01 ; ;) is due to the fact that 1 () is a function of. This dependence of 1 () on has the effect of moving the minimum of J 1() away from 0 (note, instead, that 0 is the minimum of J (s) 1 ()). ow, observe that the minimum of J (s) 1 () does not change if J (s) 1 () is multiplied by a strictly positive function of and, say (;) (obviously for [0;) and [0; 1)). This is due by the presence of the factor (cos()0cos( 0)) in J (s) 1 (), which is null if = 0. Consider then the following function (;): (;) = (1+)( + cos()+1) ( 0 cos()+1) (1+ )( cos ()++1+cos ()) : (6) ote that such function is the square-root of the inverse of 1 () (but for the coefficient =), multiplied by (1 + )). A new unbiasing filter G 3 (z 01 ; ;) can be obtained from G 1 (z 01 ; ;) and (6) as follows: G 3(z 01 ; ;)=(;)G 1(z 01 ; ;) 1 0 cos()z 01 + z 0 = (;) 1 0 cos()z 01 + : (7) z0 Due to the fact that G 3(z 01 ; ;) is simply obtained by multiplying G 1 (z 01 ; ;) by (;), some remarks on the shape of (;) are due (see Fig. 1 where (;) is plotted in the ranges [0;] and [0; 1]). (;) is not null in the ranges [0;] and [0; 1]; this can be easily seen from (6). This guarantees the well posedness of the optimization problem based on the cost function (1). ote that (; 1) = 1, whereas (; 0) strongly differs from 1; this is expected since (;) is a sort of de-biasing factor of G 1 (z 01 ; ;). Therefore, (;) leaves G 1 (z 01 ; ;) almost unchanged if is close to 1, whereas (;) provides a strong correction to G 1(z 01 ; ;) for small values of. ote that (=;)=18 [0; 1], and that (;) is symmetric with respect to == in the range [0;]. This is consistent with a peculiar feature of G 1 (z 01 ; ;): it provides an unbiased estimate [0; 1] if and only if 0 = = ([3]). In order to get a complete understanding of the differences between the three second-order constrained notch filters G 1(z 01 ; ;), G (z 01 ; ;), and G 3 (z 01 ; ;), it is interesting to compare the corresponding asymptotic cost functions J 1 (), J (), and J 3 (), respectively. The closed-form expressions of J 1 () has already been computed in (5). Following the same procedure, J () = J (s) () + () and J 3 () = J (s) 3 () + 3 () can be obtained as (8a), (8b), (9a), and (9b), shown at the bottom of the next page By comparing J 1(), J (), and J 3() it is apparent that J () and J 3 () have the minimum exactly at 0 (unbiased estimate), since

4 188 IEEE TRASACTIOS O AUTOMATIC COTROL, VOL. 48, O. 7, JULY 003 Fig.. Shape of the cost functions J (), J (), and J () (A = 1, = 1, = =6, = 0:5). () and 3 () do not depend on. On the contrary, as already observed, J 1() provides a biased estimate since 1 () is dependent. The shapes of these three different cost functions can be better appreciated from Fig., where J 1 (), J (), and J 3 () are displayed for A = 1, = 1(signal-to-noise ratio (SR)= 0:5), 0 = =6, and =0:5. To conclude this section, it is worth remarking that the new filter G 3 (z 01 ; ;) merges the two main appealing features of G 1(z 01 ; ;) and G (z 01 ; ;): similarly to G 1(z 01 ; ;), an FIR filter can be obtained from G 3 (z 01 ; ;) by simply using =0; similarly to G (z 01 ; ;), G 3 (z 01 ; ;) provides an unbiased estimate of 0 8 [0; 1). These features will be fully exploited in the following section, in order to obtain closed-form frequency estimates based on FIR notch filters. III. CLOSED-FORM FREQUECY ESTIMATIO VIA OTCH FILTERS A closed-form notch-based frequency estimate cannot be obtained if the filter has a IIR structure. Consider the FIR filters obtained by simply setting =0in () and in (7) (it has been already observed that setting =0in G (z 01 ; ;) does not yield a FIR filter), namely G 1 (z 01 ; ; 0) = 1 0 cos()z 01 +z 0 G 3 (z 01 ; ; 0) = 1 cos () cos()z01 +z 0 : Using such filters, closed-form frequency estimators from the data can be obtained as follows. J (s) () = A (cos() 0 cos( 0 )) 1+ 4 cos () 0 4 cos() cos( 0 ) cos () + cos () 0 4 cos() cos( 0 ) 0 cos() cos( 0 )+4 cos ( 0 ) (8a) () = (1 + ) J (s) A (cos() 0 cos( 0 )) (;) 3 () = (9a) cos ( 0 )+4 cos () cos() cos( 0 ) 0 4 cos() cos( 0 ) 0 3 () = (1 + ) : (8b) (9b)

5 IEEE TRASACTIOS O AUTOMATIC COTROL, VOL. 48, O. 7, JULY Fig. 3. Asymptotic bias error of (11) (A = 1, =1). A. Closed-Form Frequency Estimator Obtained Using G1(z 01 ; ; 0) Consider the following cost function, obtained by plugging in (1) the FIR notch filter G1(z 01 ; ; 0): J1() = (y(t) 0 cos ()y(t 0 1) + y(t 0 )) and differentiate J1() with respect to : dj1() d = [(y(t) 0 cos()y(t 0 1) + y(t 0 )) ( sin()y(t0 1))] : (10) ote that (10) is quadratic with respect to cos(); hence, by solving dj1()=d =0with respect to cos(), it is easy to see that the following holds: cos() = y(t 0 1) (y(t) +y(t 0 )) y(t 0 1) : The closed-form frequency estimator, therefore, is given by ^1 = arccos y(t 0 1) (y(t) +y(t 0 )) y(t 0 1) : (11) As the number of data grows, ^1 tends to the minimum of the asymptotic cost function (5) (in the special case of =0). After some cumbersome computation, the following asymptotic expression of (11) is obtained: A ^1 =!1! arccos A + cos(0) : (1) From (1), it is apparent that the frequency estimate is affected by a severe bias; note that the bias is null in the (trivial and unrealistic) case of zero noise ( =0); it grows as the SR decreases. To get a quantitative idea of this bias error, in Fig. 3 the asymptotic bias error in the case of SR= 0:5 (A =1, =1) is displayed. As expected, the bias is null if 0 = =; it is maximum for 0 =0or 0 =. ote that, in average, the bias error is huge; hence, the frequency estimate (11) is of no use in practice. B. Closed-Form Frequency Estimator Obtained Using G3(z 01 ; ; 0) Consider the following cost function, obtained by plugging in (1) the FIR notch filter G3(z 01 ; ; 0): J3() = (y(t)0 cos()y(t01) + y(t 0 )) cos () + 1 and differentiate J3() with respect to ; (13), as shown at the bottom of the next page holds. Consider now the problem of solving dj3()=d =0with respect to. After some manipulation the following expression is obtained: (sin() (y(t)0 cos()y(t01) + y(t 0 )) (y(t 0 1) + cos()y(t) + cos()y(t0))) = 0: (14)

6 190 IEEE TRASACTIOS O AUTOMATIC COTROL, VOL. 48, O. 7, JULY 003 Equation (14) admits a trivial solution: sin() = 0. Assuming that 0 6= f0;g, the following quadratic form (with respect to cos()) can be obtained from (14): y(t01) (y(t)+y(t0)) cos ()+ y(t01) 0(y(t)+y(t0)) cos()0 y(t01) (y(t)+y(t0)) =0: (15) From (15), a closed-form frequency estimator can be computed. It has the expression shown in (16) at the bottom of the page. As the number of data grows, ^3 tends to the minimum of the asymptotic cost function (8) (in the special case of =0) ^3!!1 0: Thus, the new filter G3(z 01 ; ; 0) provides a simple closed-form unbiased estimate of 0. Interestingly, (16) is closely related to the method given in [19] and [0], even if it the derivation of this result is completely different. We conclude this section by briefly discussing the problem of using a finite number of data. This note mainly deals with asymptotic results, even if (16) is used for finite. To get a rough and preinary indication on its behavior when is small, in Fig. 4 the average frequency estimate and error variance obtained using (16) for = 100, = 1:000, = 10:000, and = 100:000 are displayed. The results in Fig. 4 have been obtained using 100 different uncorrelated (obviously for the noisy part only) realizations of the signal y. It is apparent that both the bias and the variance errors rapidly decrease when gets large. A comparison for finite (and low) values of between this estimation algorithm and other estimation algorithms goes out of the scope of this note and might be the subject of future work. IV. RELATED FREQUECY-ESTIMATIO METHODS In the literature, other closed-form frequency estimators for harmonic signals in white noise have been proposed and analyzed. Two celebrated estimators are the YW estimator, and the PHD estimator (see, e.g., [1], [7], [16], [19], [0], [3], and [4]). In this section, they will be briefly recalled and compared with the asymptotic version of the notch-based estimator (16). A. YW Approach Given a signal y(t) =s(t) +n(t), where s(t) =A cos(0t + '), n WG(0; ), the autocorrelation coefficients of order 1 and, say r1 and r, respectively, are given by r1 = E [y(t)y(t 0 1)] = A cos( 0) r = E [y(t)y(t 0 )] = A cos( 0) : (17) By einating the parameter A in (17), the following equation is obtained: r1 cos (0) 0 r cos(0) 0 r1 =0: Its solution with respect to 0 provides the YW frequency estimator, given by ^YW = arccos r + r +8r 1 4r1 : (18) B. PHD Approach Given a zero-mean stationary signal y(t), its autocorrelation matrix of order three is given by R = r0 r1 r r1 r0 r1 r r1 r0 r0 = E y(t) r1 = E [y(t)y(t 0 1)] r = E [y(t)y(t 0 )] : The eigenvector associated with the smallest eigenvalue of R has the following form: 1 0 r +p r +8r 1 : (19) r Pisarenko (see [16] and the analysis proposed in [7]) has proven that, if y(t) =s(t)+n(t) (s(t) =A cos(0t+'), n WG(0; ), the smallest eigenvalue of R must have the following simple expression: [1 0 cos(0) 1] T : (0) By comparing (19) and (0), the PHD frequency estimator is obtained ^ PHD = arccos T r + r +8r 1 4r1 : (1) dj3() d = (y(t) 0 cos()y(t 0 1) + y(t 0 )) (( + cos()) sin()y(t 0 1) + sin() (y(t) 0 cos()y(t 0 1) + y(t 0 ))) ( + cos()) : (13) ^3 = arccos 1 0 y(t01) 0(y(t)+y(t0)) + 4 y(t01) 0(y(t)+y(t 0 )) +8 y(t01) (y(t)+y(t0)) : y(t01) (y(t)+y(t0)) (16)

7 IEEE TRASACTIOS O AUTOMATIC COTROL, VOL. 48, O. 7, JULY Fig. 4. Average frequency estimate and error variance for different values of (A = 1, = 1, = =6). Interestingly enough, the YW and PHD approaches provide exactly the same results. This has been recently proven and discussed in [3] and [4]. Consider now the notch-based closed-form estimator (16). The following result holds. Proposition 1: Given a signal y(t) = s(t) +n(t), where s(t) = A cos( 0 t + '), n WG(0; ), the notch-filter based estimator (16) asymptotically converges toward ^YW and ^PHD, namely!1 ^3 = arccos r + r +8r 1 4r1 r1 = E [y(t)y(t 0 1)] r = E [y(t)y(t 0 )] : Proof: If is large, the following hold:!1 1 y(t 0 1) (y(t)+y(t0 )) =!1 1 y(t)y(t 0 1) =E [y(t)y(t 0 1)] ; (a)!1 1 y(t 0 1) 0 (y(t)+y(t 0 )) = 0E [y(t)y(t 0 )] : (b) By plugging in (16) the asymptotic expressions (), it is easy to see that!1 ^3 = arccos r + r +8r 1 4r1 r1 = E [y(t)y(t 0 1)] r = E [y(t)y(t 0 )] : From a theoretical point of view the fact that (asymptotically) ^YW, ^PHD and ^3 are exactly the same, is particularly interesting: it shows the equivalence of three classical approaches which have been independently conceived and developed following three completely different paths. V. COCLUSIO AD FUTURE WORK In this work, a notch FIR filter which provides and unbiased closed-form frequency estimate of harmonic signals in white noise has been proposed. This estimator has been proven to converge asymptotically to the well-known YW and PHD estimators. These three equivalent estimators are very appealing since they admit a very simple closed-form expression starting from a set of measured data. However, their main flaw is the sensitivity to the noise: they guarantee an unbiased estimate if the noise is white; when the noise is colored, the bias error can be large. In order to try to overcome this pitfall, probably the most interesting rationale is that proposed by Quinn and Fernandes in [15]: the idea is

8 19 IEEE TRASACTIOS O AUTOMATIC COTROL, VOL. 48, O. 7, JULY 003 to prefilter the data with a frequency enhancer, in an iterative fashion; at each step the frequency enhancer is centered around the frequency estimated at the previous step. This approach seems to fit perfectly to simple closed-form estimators. The reduction of the noise-sensitivity of FIR-based frequency estimators using frequency enhancers is currently the subject of further investigation. [5] Y. Xiao, Y. Takeshita, and K. Shida, Steady-state analysis of a plain gradient algorithm for a second-order adaptive IIR notch filter with constrained poles and zeros, IEEE Trans. Circuits Systems, vol. 48, pp , July 001. [6], Tracking properties of a gradient-based second-order adaptive IIR notch filter with constrained poles and zeros, IEEE Trans. Signal Processing, vol. 50, pp , Apr. 00. REFERECES [1] E. Anarim and Y. Istefanopulos, Statistical analysis of Pisarenko type tone frequency estimator, Signal Processing, vol. 4, pp , [] K. J. Åström, Introduction to Stochastic Control Theory. ew York: Academic, [3] S. Bittanti, M. Campi, and S. M. Savaresi, Unbiased estimation of a sinusoid in noise via adapted notch filters, Automatica, vol. 33, no., pp , [4] S. Bittanti and G. Picci, Eds., Identification, Adaptation, Learning The Science of Learning Models from Data. Berlin, Germany: Springer- Verlag, 1996, Computer and Systems Sciences. [5] S. Bittanti and S. M. Savaresi, On the parametrization and design of an extended Kalman filter frequency tracker, IEEE Trans. Automat. Contr., vol. 45, pp , Sept [6] B. Boashash, Estimating and interpreting the instantaneous frequency of a signal, Proc. IEEE, vol. 80, pp , Apr [7] A. Eriksson and P. Stoica, On statistical analysis of Pisarenko tone frequency estimator, Signal Processing, vol. 31, pp , [8] P. Händel and A. ehorai, Tracking analysis of an adaptive notch filter with constrained poles and zeros, IEEE Trans. Signal Processing, vol. 4, pp , Feb [9] P. Händel, P. Tichavsky, and S. M. Savaresi, Large error recovery for a class of frequency tracking algorithms, Int. J. Adapt. Control Signal Processing, vol. 1, pp , [10] L. Hsu, R. Ortega, and G. Damm, A globally convergent frequency estimator, IEEE Trans. Automat. Contr., vol. 44, pp , Apr [11] S. M. Kay, Modern Spectral Estimation: Theory and Applications. Upper Saddle River, J: Prentice-Hall, [1] B. La Scala and R. Bitmead, Design of an extended Kalman filter frequency tracker, IEEE Trans. Signal Processing, vol. 44, pp , Mar [13] B. La Scala, R. Bitmead, and B. G. Quinn, An extended Kalman filter frequency tracker for high-noise environments, IEEE Trans. Signal Processing, vol. 44, pp , Feb [14] G. Li, A stable and efficient adaptive notch filter for direct frequency estimation, IEEE Trans. Signal Processing, vol. 45, pp , Aug [15] B. G. Quinn and J. M. Fernandes, A fast efficient technique for the estimation of frequency, Biometrika, vol. 78, pp , [16] V. F. Pisarenko, The retrieval of harmonics from a covariance function, J. Roy. Astr., vol. 33, pp , [17] S. M. Savaresi, Funnel filters: a new class of filters for frequency estimation of harmonic signals, Automatica, vol. 33, no. 9, pp , [18] S. M. Savaresi, R. Bitmead, and W. Dunstan, onlinear system identification using closed-loop data with no external excitation: the case of a lean combustion process, Int. J. Control, vol. 74, no. 18, pp , 001. [19] H. C. So, A closed form frequency estimator for a noisy sinusoid, in 45th IEEE Midwest Symp. Circuits Systems, Tulsa, OK, 00. [0] H. C. So and S. K. Ip, A novel frequency estimator and its comparative performances for short record lengths, in 11th Eur. Signal Processing Conf., Toulouse, France, 00. [1] P. Stoica, List of references on spectral line analysis, Signal Processing, vol. 31, pp , 199. [] P. Strobach, Single section least squares adaptive notch filter, IEEE Trans. Signal Processing, vol. 43, pp , Aug [3] Y. Xiao and Y. Tadokoro, On Pisarenko and constrained Yule-Walker estimators of tone frequency, IEICE Trans., vol. E77-A, no. 8, pp , [4], Statistical analysis of a simple constrained high-order Yule-Walker tone frequency estimator, IEICE Trans., vol. E78-A, no. 10, pp , Comments on A Robust State Observer Scheme M. Boutayeb and M. Darouach Abstract In this note, we point out that the sufficient conditions given in a recent paper to assure convergence of the proposed robust state observer are incomplete. Index Terms Robust observer design, stability analysis, uncertain systems. I. ITRODUCTIO In [], a robust state observer scheme was proposed for uncertain linear systems. The main result and theorem may be summarized as follows. Consider the linear map 6 1 _x = A 0 +1 A x + Bu y = Cx + Du where 1 A represents the model uncertainty, assumed to be bounded by >0 with k1 A k <. The authors propose the following observer dynamics: 6 _^x = A0 ^x + Bu + H(y 0 ^y) + ^y = C ^x + Du: Theorem: We are given the uncertain system 6 1 and the state observer 6. If we set = ^x T ^x r T r P 01 C T r; r = y 0 ^y where P > 0 satisfies the following matrix inequality: (A 0 0 HC) T P + P (A 0 0 HC)+P + I<0 and H, such that (A 0 0 HC) is stable, then the state error vector e = x 0 ^x converges to zero. < Manuscript received June 7, 00; revised September 7, 00, January 10, 003, and January 17, 003. Recommended by Associate Editor M. E. Valcher. M. Boutayeb is with the LSIIT-CRS UMR 7005, University of Louis Pasteur, Illkirch, France ( Mohamed.Boutayeb@ipst.ulp.ustrasbg.fr). M. Darouach is with the CRA-CRS UMR 7039, University of Henri Poincaré, IUT of Longwy 54400, France ( Mohamed.Darouach@iut-longwy.uhp-nancy.fr). Digital Object Identifier /TAC /03$ IEEE

CLOSED-FORM FREQUENCY ESTIMATION USING SECOND-ORDER NOTCH FILTERS. S.M. Savaresi, S. Bittanti, H.C. So*

CLOSED-FORM FREQUENCY ESTIMATION USING SECOND-ORDER NOTCH FILTERS. S.M. Savaresi, S. Bittanti, H.C. So* CLOSED-FORM FREQUECY ESTIMATIO USIG SECOD-ORDER OTCH FILTERS S.M. Savaresi S. Bittanti H.C. So* Dipartimento di Elettronica e Informazione Politecnico di Milano Piazza L. da Vinci Milano ITALY. * Department

More information

Filter Design for Linear Time Delay Systems

Filter Design for Linear Time Delay Systems IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 49, NO. 11, NOVEMBER 2001 2839 ANewH Filter Design for Linear Time Delay Systems E. Fridman Uri Shaked, Fellow, IEEE Abstract A new delay-dependent filtering

More information

Lyapunov Stability of Linear Predictor Feedback for Distributed Input Delays

Lyapunov Stability of Linear Predictor Feedback for Distributed Input Delays IEEE TRANSACTIONS ON AUTOMATIC CONTROL VOL. 56 NO. 3 MARCH 2011 655 Lyapunov Stability of Linear Predictor Feedback for Distributed Input Delays Nikolaos Bekiaris-Liberis Miroslav Krstic In this case system

More information

FIR Filters for Stationary State Space Signal Models

FIR Filters for Stationary State Space Signal Models Proceedings of the 17th World Congress The International Federation of Automatic Control FIR Filters for Stationary State Space Signal Models Jung Hun Park Wook Hyun Kwon School of Electrical Engineering

More information

Virtual Reference Feedback Tuning for non-linear systems

Virtual Reference Feedback Tuning for non-linear systems Proceedings of the 44th IEEE Conference on Decision and Control, and the European Control Conference 25 Seville, Spain, December 2-5, 25 ThA9.6 Virtual Reference Feedback Tuning for non-linear systems

More information

Expressions for the covariance matrix of covariance data

Expressions for the covariance matrix of covariance data Expressions for the covariance matrix of covariance data Torsten Söderström Division of Systems and Control, Department of Information Technology, Uppsala University, P O Box 337, SE-7505 Uppsala, Sweden

More information

CONTROL SYSTEMS, ROBOTICS, AND AUTOMATION - Vol. V - Prediction Error Methods - Torsten Söderström

CONTROL SYSTEMS, ROBOTICS, AND AUTOMATION - Vol. V - Prediction Error Methods - Torsten Söderström PREDICTIO ERROR METHODS Torsten Söderström Department of Systems and Control, Information Technology, Uppsala University, Uppsala, Sweden Keywords: prediction error method, optimal prediction, identifiability,

More information

Auxiliary signal design for failure detection in uncertain systems

Auxiliary signal design for failure detection in uncertain systems Auxiliary signal design for failure detection in uncertain systems R. Nikoukhah, S. L. Campbell and F. Delebecque Abstract An auxiliary signal is an input signal that enhances the identifiability of a

More information

Optimal Polynomial Control for Discrete-Time Systems

Optimal Polynomial Control for Discrete-Time Systems 1 Optimal Polynomial Control for Discrete-Time Systems Prof Guy Beale Electrical and Computer Engineering Department George Mason University Fairfax, Virginia Correspondence concerning this paper should

More information

OPTIMAL CONTROL AND ESTIMATION

OPTIMAL CONTROL AND ESTIMATION OPTIMAL CONTROL AND ESTIMATION Robert F. Stengel Department of Mechanical and Aerospace Engineering Princeton University, Princeton, New Jersey DOVER PUBLICATIONS, INC. New York CONTENTS 1. INTRODUCTION

More information

On Input Design for System Identification

On Input Design for System Identification On Input Design for System Identification Input Design Using Markov Chains CHIARA BRIGHENTI Masters Degree Project Stockholm, Sweden March 2009 XR-EE-RT 2009:002 Abstract When system identification methods

More information

A Subspace Approach to Estimation of. Measurements 1. Carlos E. Davila. Electrical Engineering Department, Southern Methodist University

A Subspace Approach to Estimation of. Measurements 1. Carlos E. Davila. Electrical Engineering Department, Southern Methodist University EDICS category SP 1 A Subspace Approach to Estimation of Autoregressive Parameters From Noisy Measurements 1 Carlos E Davila Electrical Engineering Department, Southern Methodist University Dallas, Texas

More information

EFFECTS OF ILL-CONDITIONED DATA ON LEAST SQUARES ADAPTIVE FILTERS. Gary A. Ybarra and S.T. Alexander

EFFECTS OF ILL-CONDITIONED DATA ON LEAST SQUARES ADAPTIVE FILTERS. Gary A. Ybarra and S.T. Alexander EFFECTS OF ILL-CONDITIONED DATA ON LEAST SQUARES ADAPTIVE FILTERS Gary A. Ybarra and S.T. Alexander Center for Communications and Signal Processing Electrical and Computer Engineering Department North

More information

A New Algorithm for Solving Cross Coupled Algebraic Riccati Equations of Singularly Perturbed Nash Games

A New Algorithm for Solving Cross Coupled Algebraic Riccati Equations of Singularly Perturbed Nash Games A New Algorithm for Solving Cross Coupled Algebraic Riccati Equations of Singularly Perturbed Nash Games Hiroaki Mukaidani Hua Xu and Koichi Mizukami Faculty of Information Sciences Hiroshima City University

More information

Riccati difference equations to non linear extended Kalman filter constraints

Riccati difference equations to non linear extended Kalman filter constraints International Journal of Scientific & Engineering Research Volume 3, Issue 12, December-2012 1 Riccati difference equations to non linear extended Kalman filter constraints Abstract Elizabeth.S 1 & Jothilakshmi.R

More information

State feedback gain scheduling for linear systems with time-varying parameters

State feedback gain scheduling for linear systems with time-varying parameters State feedback gain scheduling for linear systems with time-varying parameters Vinícius F. Montagner and Pedro L. D. Peres Abstract This paper addresses the problem of parameter dependent state feedback

More information

FOR OVER 50 years, control engineers have appreciated

FOR OVER 50 years, control engineers have appreciated IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 49, NO. 7, JULY 2004 1081 Further Results on Robustness of (Possibly Discontinuous) Sample Hold Feedback Christopher M. Kellett, Member, IEEE, Hyungbo Shim,

More information

A New Method for Varying Adaptive Bandwidth Selection

A New Method for Varying Adaptive Bandwidth Selection IEEE TRASACTIOS O SIGAL PROCESSIG, VOL. 47, O. 9, SEPTEMBER 1999 2567 TABLE I SQUARE ROOT MEA SQUARED ERRORS (SRMSE) OF ESTIMATIO USIG THE LPA AD VARIOUS WAVELET METHODS A ew Method for Varying Adaptive

More information

PERIODIC signals are commonly experienced in industrial

PERIODIC signals are commonly experienced in industrial IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, VOL. 15, NO. 2, MARCH 2007 369 Repetitive Learning Control of Nonlinear Continuous-Time Systems Using Quasi-Sliding Mode Xiao-Dong Li, Tommy W. S. Chow,

More information

Discrete-Time H Gaussian Filter

Discrete-Time H Gaussian Filter Proceedings of the 17th World Congress The International Federation of Automatic Control Discrete-Time H Gaussian Filter Ali Tahmasebi and Xiang Chen Department of Electrical and Computer Engineering,

More information

LTI Systems, Additive Noise, and Order Estimation

LTI Systems, Additive Noise, and Order Estimation LTI Systems, Additive oise, and Order Estimation Soosan Beheshti, Munther A. Dahleh Laboratory for Information and Decision Systems Department of Electrical Engineering and Computer Science Massachusetts

More information

Further Results on Model Structure Validation for Closed Loop System Identification

Further Results on Model Structure Validation for Closed Loop System Identification Advances in Wireless Communications and etworks 7; 3(5: 57-66 http://www.sciencepublishinggroup.com/j/awcn doi:.648/j.awcn.735. Further esults on Model Structure Validation for Closed Loop System Identification

More information

CRC for Robust and Adaptive Systems. Peter J Kootsookos. Abstract. This paper develops an adaptive controller for active vibration control.

CRC for Robust and Adaptive Systems. Peter J Kootsookos. Abstract. This paper develops an adaptive controller for active vibration control. Closed-loop Frequency Tracking and Rejection Allan J Connolly CRC for Robust and Adaptive Systems Department of Systems Engineering The Australian National University, Canberra ACT 0200 Australia Barbara

More information

Here represents the impulse (or delta) function. is an diagonal matrix of intensities, and is an diagonal matrix of intensities.

Here represents the impulse (or delta) function. is an diagonal matrix of intensities, and is an diagonal matrix of intensities. 19 KALMAN FILTER 19.1 Introduction In the previous section, we derived the linear quadratic regulator as an optimal solution for the fullstate feedback control problem. The inherent assumption was that

More information

CONVERGENCE PROOF FOR RECURSIVE SOLUTION OF LINEAR-QUADRATIC NASH GAMES FOR QUASI-SINGULARLY PERTURBED SYSTEMS. S. Koskie, D. Skataric and B.

CONVERGENCE PROOF FOR RECURSIVE SOLUTION OF LINEAR-QUADRATIC NASH GAMES FOR QUASI-SINGULARLY PERTURBED SYSTEMS. S. Koskie, D. Skataric and B. To appear in Dynamics of Continuous, Discrete and Impulsive Systems http:monotone.uwaterloo.ca/ journal CONVERGENCE PROOF FOR RECURSIVE SOLUTION OF LINEAR-QUADRATIC NASH GAMES FOR QUASI-SINGULARLY PERTURBED

More information

On Moving Average Parameter Estimation

On Moving Average Parameter Estimation On Moving Average Parameter Estimation Niclas Sandgren and Petre Stoica Contact information: niclas.sandgren@it.uu.se, tel: +46 8 473392 Abstract Estimation of the autoregressive moving average (ARMA)

More information

ADAPTIVE FILTER THEORY

ADAPTIVE FILTER THEORY ADAPTIVE FILTER THEORY Fourth Edition Simon Haykin Communications Research Laboratory McMaster University Hamilton, Ontario, Canada Front ice Hall PRENTICE HALL Upper Saddle River, New Jersey 07458 Preface

More information

Unbiased minimum variance estimation for systems with unknown exogenous inputs

Unbiased minimum variance estimation for systems with unknown exogenous inputs Unbiased minimum variance estimation for systems with unknown exogenous inputs Mohamed Darouach, Michel Zasadzinski To cite this version: Mohamed Darouach, Michel Zasadzinski. Unbiased minimum variance

More information

Sliding Modes in Control and Optimization

Sliding Modes in Control and Optimization Vadim I. Utkin Sliding Modes in Control and Optimization With 24 Figures Springer-Verlag Berlin Heidelberg New York London Paris Tokyo Hong Kong Barcelona Budapest Contents Parti. Mathematical Tools 1

More information

MANY adaptive control methods rely on parameter estimation

MANY adaptive control methods rely on parameter estimation 610 IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL 52, NO 4, APRIL 2007 Direct Adaptive Dynamic Compensation for Minimum Phase Systems With Unknown Relative Degree Jesse B Hoagg and Dennis S Bernstein Abstract

More information

THIS paper deals with robust control in the setup associated

THIS paper deals with robust control in the setup associated IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL 50, NO 10, OCTOBER 2005 1501 Control-Oriented Model Validation and Errors Quantification in the `1 Setup V F Sokolov Abstract A priori information required for

More information

IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 58, NO. 5, MAY invertible, that is (1) In this way, on, and on, system (3) becomes

IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 58, NO. 5, MAY invertible, that is (1) In this way, on, and on, system (3) becomes IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 58, NO. 5, MAY 2013 1269 Sliding Mode and Active Disturbance Rejection Control to Stabilization of One-Dimensional Anti-Stable Wave Equations Subject to Disturbance

More information

The Rationale for Second Level Adaptation

The Rationale for Second Level Adaptation The Rationale for Second Level Adaptation Kumpati S. Narendra, Yu Wang and Wei Chen Center for Systems Science, Yale University arxiv:1510.04989v1 [cs.sy] 16 Oct 2015 Abstract Recently, a new approach

More information

On the convergence of the iterative solution of the likelihood equations

On the convergence of the iterative solution of the likelihood equations On the convergence of the iterative solution of the likelihood equations R. Moddemeijer University of Groningen, Department of Computing Science, P.O. Box 800, NL-9700 AV Groningen, The Netherlands, e-mail:

More information

The Discrete Kalman Filtering of a Class of Dynamic Multiscale Systems

The Discrete Kalman Filtering of a Class of Dynamic Multiscale Systems 668 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II: ANALOG AND DIGITAL SIGNAL PROCESSING, VOL 49, NO 10, OCTOBER 2002 The Discrete Kalman Filtering of a Class of Dynamic Multiscale Systems Lei Zhang, Quan

More information

An insight into noise covariance estimation for Kalman filter design

An insight into noise covariance estimation for Kalman filter design Preprints of the 19th World Congress The International Federation of Automatic Control An insight into noise covariance estimation for Kalman filter design Simone Formentin, Sergio Bittanti (IFAC Fellow)

More information

Optimal Decentralized Control of Coupled Subsystems With Control Sharing

Optimal Decentralized Control of Coupled Subsystems With Control Sharing IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 58, NO. 9, SEPTEMBER 2013 2377 Optimal Decentralized Control of Coupled Subsystems With Control Sharing Aditya Mahajan, Member, IEEE Abstract Subsystems that

More information

IEEE Transactions on Automatic Control, 2013, v. 58 n. 6, p

IEEE Transactions on Automatic Control, 2013, v. 58 n. 6, p Title Sufficient and Necessary LMI Conditions for Robust Stability of Rationally Time-Varying Uncertain Systems Author(s) Chesi, G Citation IEEE Transactions on Automatic Control, 2013, v. 58 n. 6, p.

More information

RECURSIVE SUBSPACE IDENTIFICATION IN THE LEAST SQUARES FRAMEWORK

RECURSIVE SUBSPACE IDENTIFICATION IN THE LEAST SQUARES FRAMEWORK RECURSIVE SUBSPACE IDENTIFICATION IN THE LEAST SQUARES FRAMEWORK TRNKA PAVEL AND HAVLENA VLADIMÍR Dept of Control Engineering, Czech Technical University, Technická 2, 166 27 Praha, Czech Republic mail:

More information

On the convergence of the iterative solution of the likelihood equations

On the convergence of the iterative solution of the likelihood equations On the convergence of the iterative solution of the likelihood equations R. Moddemeijer University of Groningen, Department of Computing Science, P.O. Box 800, NL-9700 AV Groningen, The Netherlands, e-mail:

More information

CONTROLLING CHAOTIC DYNAMICS USING BACKSTEPPING DESIGN WITH APPLICATION TO THE LORENZ SYSTEM AND CHUA S CIRCUIT

CONTROLLING CHAOTIC DYNAMICS USING BACKSTEPPING DESIGN WITH APPLICATION TO THE LORENZ SYSTEM AND CHUA S CIRCUIT Letters International Journal of Bifurcation and Chaos, Vol. 9, No. 7 (1999) 1425 1434 c World Scientific Publishing Company CONTROLLING CHAOTIC DYNAMICS USING BACKSTEPPING DESIGN WITH APPLICATION TO THE

More information

Adaptive and Robust Controls of Uncertain Systems With Nonlinear Parameterization

Adaptive and Robust Controls of Uncertain Systems With Nonlinear Parameterization IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 48, NO. 0, OCTOBER 003 87 Adaptive and Robust Controls of Uncertain Systems With Nonlinear Parameterization Zhihua Qu Abstract Two classes of partially known

More information

Optimum Sampling Vectors for Wiener Filter Noise Reduction

Optimum Sampling Vectors for Wiener Filter Noise Reduction 58 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 50, NO. 1, JANUARY 2002 Optimum Sampling Vectors for Wiener Filter Noise Reduction Yukihiko Yamashita, Member, IEEE Absact Sampling is a very important and

More information

THIS paper studies the input design problem in system identification.

THIS paper studies the input design problem in system identification. 1534 IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 50, NO. 10, OCTOBER 2005 Input Design Via LMIs Admitting Frequency-Wise Model Specifications in Confidence Regions Henrik Jansson Håkan Hjalmarsson, Member,

More information

Introduction to Model Predictive Control. Dipartimento di Elettronica e Informazione

Introduction to Model Predictive Control. Dipartimento di Elettronica e Informazione Introduction to Model Predictive Control Riccardo Scattolini Riccardo Scattolini Dipartimento di Elettronica e Informazione Finite horizon optimal control 2 Consider the system At time k we want to compute

More information

Automatic Control Systems theory overview (discrete time systems)

Automatic Control Systems theory overview (discrete time systems) Automatic Control Systems theory overview (discrete time systems) Prof. Luca Bascetta (luca.bascetta@polimi.it) Politecnico di Milano Dipartimento di Elettronica, Informazione e Bioingegneria Motivations

More information

Maximum Likelihood Modeling Of Orbits Of Nonlinear ODEs

Maximum Likelihood Modeling Of Orbits Of Nonlinear ODEs Maimum Likelihood Modeling Of Orbits Of onlinear ODEs orsten Söderström, orbjörn Wigren and Emad Abd-Elrady Department of Systems and Control, Information echnology, Uppsala Univ., PO Bo 337, SE-75 05

More information

Design of FIR Smoother Using Covariance Information for Estimating Signal at Start Time in Linear Continuous Systems

Design of FIR Smoother Using Covariance Information for Estimating Signal at Start Time in Linear Continuous Systems Systems Science and Applied Mathematics Vol. 1 No. 3 2016 pp. 29-37 http://www.aiscience.org/journal/ssam Design of FIR Smoother Using Covariance Information for Estimating Signal at Start Time in Linear

More information

On Identification of Cascade Systems 1

On Identification of Cascade Systems 1 On Identification of Cascade Systems 1 Bo Wahlberg Håkan Hjalmarsson Jonas Mårtensson Automatic Control and ACCESS, School of Electrical Engineering, KTH, SE-100 44 Stockholm, Sweden. (bo.wahlberg@ee.kth.se

More information

EECE Adaptive Control

EECE Adaptive Control EECE 574 - Adaptive Control Basics of System Identification Guy Dumont Department of Electrical and Computer Engineering University of British Columbia January 2010 Guy Dumont (UBC) EECE574 - Basics of

More information

Stability of Switched Linear Hyperbolic Systems by Lyapunov Techniques

Stability of Switched Linear Hyperbolic Systems by Lyapunov Techniques 2196 IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 59, NO. 8, AUGUST 2014 Stability of Switched Linear Hyperbolic Systems by Lyapunov Techniques Christophe Prieur, Antoine Girard, Emmanuel Witrant Abstract

More information

Order Selection for Vector Autoregressive Models

Order Selection for Vector Autoregressive Models IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 51, NO. 2, FEBRUARY 2003 427 Order Selection for Vector Autoregressive Models Stijn de Waele and Piet M. T. Broersen Abstract Order-selection criteria for vector

More information

LQR, Kalman Filter, and LQG. Postgraduate Course, M.Sc. Electrical Engineering Department College of Engineering University of Salahaddin

LQR, Kalman Filter, and LQG. Postgraduate Course, M.Sc. Electrical Engineering Department College of Engineering University of Salahaddin LQR, Kalman Filter, and LQG Postgraduate Course, M.Sc. Electrical Engineering Department College of Engineering University of Salahaddin May 2015 Linear Quadratic Regulator (LQR) Consider a linear system

More information

Statistical and Adaptive Signal Processing

Statistical and Adaptive Signal Processing r Statistical and Adaptive Signal Processing Spectral Estimation, Signal Modeling, Adaptive Filtering and Array Processing Dimitris G. Manolakis Massachusetts Institute of Technology Lincoln Laboratory

More information

H State-Feedback Controller Design for Discrete-Time Fuzzy Systems Using Fuzzy Weighting-Dependent Lyapunov Functions

H State-Feedback Controller Design for Discrete-Time Fuzzy Systems Using Fuzzy Weighting-Dependent Lyapunov Functions IEEE TRANSACTIONS ON FUZZY SYSTEMS, VOL 11, NO 2, APRIL 2003 271 H State-Feedback Controller Design for Discrete-Time Fuzzy Systems Using Fuzzy Weighting-Dependent Lyapunov Functions Doo Jin Choi and PooGyeon

More information

Nonlinear Discrete-Time Observer Design with Linearizable Error Dynamics

Nonlinear Discrete-Time Observer Design with Linearizable Error Dynamics 622 IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 48, NO. 4, APRIL 2003 Nonlinear Discrete-Time Observer Design with Linearizable Error Dynamics MingQing Xiao, Nikolaos Kazantzis, Costas Kravaris, Arthur

More information

Limit Cycles in High-Resolution Quantized Feedback Systems

Limit Cycles in High-Resolution Quantized Feedback Systems Limit Cycles in High-Resolution Quantized Feedback Systems Li Hong Idris Lim School of Engineering University of Glasgow Glasgow, United Kingdom LiHonIdris.Lim@glasgow.ac.uk Ai Poh Loh Department of Electrical

More information

New Lyapunov Krasovskii functionals for stability of linear retarded and neutral type systems

New Lyapunov Krasovskii functionals for stability of linear retarded and neutral type systems Systems & Control Letters 43 (21 39 319 www.elsevier.com/locate/sysconle New Lyapunov Krasovskii functionals for stability of linear retarded and neutral type systems E. Fridman Department of Electrical

More information

554 IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 55, NO. 2, FEBRUARY and such that /$ IEEE

554 IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 55, NO. 2, FEBRUARY and such that /$ IEEE 554 IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 55, NO. 2, FEBRUARY 2010 REFERENCES [1] M. Fliess, J. Levine, P. Martin, and P. Rouchon, Flatness and defect of nonlinear systems: Introductory theory and

More information

Prediction-based adaptive control of a class of discrete-time nonlinear systems with nonlinear growth rate

Prediction-based adaptive control of a class of discrete-time nonlinear systems with nonlinear growth rate www.scichina.com info.scichina.com www.springerlin.com Prediction-based adaptive control of a class of discrete-time nonlinear systems with nonlinear growth rate WEI Chen & CHEN ZongJi School of Automation

More information

Estimation of white-box model parameters via artificial data generation: a two-stage approach

Estimation of white-box model parameters via artificial data generation: a two-stage approach Estimation of white-box model parameters via artificial data generation: a two-stage approach Simone Garatti Sergio Bittanti Dipartimento di Elettronica ed Informazione, Politecnico di Milano, piazza L

More information

Fixed-Order Robust H Filter Design for Markovian Jump Systems With Uncertain Switching Probabilities

Fixed-Order Robust H Filter Design for Markovian Jump Systems With Uncertain Switching Probabilities IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 54, NO. 4, APRIL 2006 1421 Fixed-Order Robust H Filter Design for Markovian Jump Systems With Uncertain Switching Probabilities Junlin Xiong and James Lam,

More information

A sub-optimal second order sliding mode controller for systems with saturating actuators

A sub-optimal second order sliding mode controller for systems with saturating actuators 28 American Control Conference Westin Seattle Hotel, Seattle, Washington, USA June -3, 28 FrB2.5 A sub-optimal second order sliding mode for systems with saturating actuators Antonella Ferrara and Matteo

More information

IN neural-network training, the most well-known online

IN neural-network training, the most well-known online IEEE TRANSACTIONS ON NEURAL NETWORKS, VOL. 10, NO. 1, JANUARY 1999 161 On the Kalman Filtering Method in Neural-Network Training and Pruning John Sum, Chi-sing Leung, Gilbert H. Young, and Wing-kay Kan

More information

Performance of an Adaptive Algorithm for Sinusoidal Disturbance Rejection in High Noise

Performance of an Adaptive Algorithm for Sinusoidal Disturbance Rejection in High Noise Performance of an Adaptive Algorithm for Sinusoidal Disturbance Rejection in High Noise MarcBodson Department of Electrical Engineering University of Utah Salt Lake City, UT 842, U.S.A. (8) 58 859 bodson@ee.utah.edu

More information

6.435, System Identification

6.435, System Identification System Identification 6.435 SET 3 Nonparametric Identification Munther A. Dahleh 1 Nonparametric Methods for System ID Time domain methods Impulse response Step response Correlation analysis / time Frequency

More information

Closed-Form Design of Maximally Flat IIR Half-Band Filters

Closed-Form Design of Maximally Flat IIR Half-Band Filters IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II: ANALOG AND DIGITAL SIGNAL PROCESSING, VOL. 49, NO. 6, JUNE 2002 409 Closed-Form Design of Maximally Flat IIR Half-B Filters Xi Zhang, Senior Member, IEEE,

More information

DISCRETE-TIME ADAPTIVE LQG/LTR CONTROL

DISCRETE-TIME ADAPTIVE LQG/LTR CONTROL DISCRETE-TIME ADAPTIVE LQG/LTR CONTROL DARIUSZ HORLA Poznan University of Technology Inst. of Control and Inf. Eng. ul. Piotrowo 3a, 6-965 Poznan POLAND ANDRZEJ KRÓLIKOWSKI Poznan University of Technology

More information

I. D. Landau, A. Karimi: A Course on Adaptive Control Adaptive Control. Part 9: Adaptive Control with Multiple Models and Switching

I. D. Landau, A. Karimi: A Course on Adaptive Control Adaptive Control. Part 9: Adaptive Control with Multiple Models and Switching I. D. Landau, A. Karimi: A Course on Adaptive Control - 5 1 Adaptive Control Part 9: Adaptive Control with Multiple Models and Switching I. D. Landau, A. Karimi: A Course on Adaptive Control - 5 2 Outline

More information

Lessons in Estimation Theory for Signal Processing, Communications, and Control

Lessons in Estimation Theory for Signal Processing, Communications, and Control Lessons in Estimation Theory for Signal Processing, Communications, and Control Jerry M. Mendel Department of Electrical Engineering University of Southern California Los Angeles, California PRENTICE HALL

More information

City, University of London Institutional Repository

City, University of London Institutional Repository City Research Online City, University of London Institutional Repository Citation: Zhao, S., Shmaliy, Y. S., Khan, S. & Liu, F. (2015. Improving state estimates over finite data using optimal FIR filtering

More information

Title without the persistently exciting c. works must be obtained from the IEE

Title without the persistently exciting c.   works must be obtained from the IEE Title Exact convergence analysis of adapt without the persistently exciting c Author(s) Sakai, H; Yang, JM; Oka, T Citation IEEE TRANSACTIONS ON SIGNAL 55(5): 2077-2083 PROCESS Issue Date 2007-05 URL http://hdl.handle.net/2433/50544

More information

IN THIS PAPER, we consider a class of continuous-time recurrent

IN THIS PAPER, we consider a class of continuous-time recurrent IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II: EXPRESS BRIEFS, VOL. 51, NO. 4, APRIL 2004 161 Global Output Convergence of a Class of Continuous-Time Recurrent Neural Networks With Time-Varying Thresholds

More information

Robust Gain Scheduling Synchronization Method for Quadratic Chaotic Systems With Channel Time Delay Yu Liang and Horacio J.

Robust Gain Scheduling Synchronization Method for Quadratic Chaotic Systems With Channel Time Delay Yu Liang and Horacio J. 604 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I: REGULAR PAPERS, VOL. 56, NO. 3, MARCH 2009 Robust Gain Scheduling Synchronization Method for Quadratic Chaotic Systems With Channel Time Delay Yu Liang

More information

Identification of continuous-time systems from samples of input±output data: An introduction

Identification of continuous-time systems from samples of input±output data: An introduction SaÅdhanaÅ, Vol. 5, Part, April 000, pp. 75±83. # Printed in India Identification of continuous-time systems from samples of input±output data: An introduction NARESH K SINHA Department of Electrical and

More information

Frequency estimation by DFT interpolation: A comparison of methods

Frequency estimation by DFT interpolation: A comparison of methods Frequency estimation by DFT interpolation: A comparison of methods Bernd Bischl, Uwe Ligges, Claus Weihs March 5, 009 Abstract This article comments on a frequency estimator which was proposed by [6] and

More information

OBSERVER DESIGN WITH GUARANTEED BOUND FOR LPV SYSTEMS. Jamal Daafouz Gilles Millerioux Lionel Rosier

OBSERVER DESIGN WITH GUARANTEED BOUND FOR LPV SYSTEMS. Jamal Daafouz Gilles Millerioux Lionel Rosier OBSERVER DESIGN WITH GUARANTEED BOUND FOR LPV SYSTEMS Jamal Daafouz Gilles Millerioux Lionel Rosier CRAN UMR 739 ENSEM 2, Avenue de la Forêt de Haye 54516 Vandoeuvre-lès-Nancy Cedex France, Email: Jamal.Daafouz@ensem.inpl-nancy.fr

More information

Linear Quadratic Zero-Sum Two-Person Differential Games

Linear Quadratic Zero-Sum Two-Person Differential Games Linear Quadratic Zero-Sum Two-Person Differential Games Pierre Bernhard To cite this version: Pierre Bernhard. Linear Quadratic Zero-Sum Two-Person Differential Games. Encyclopaedia of Systems and Control,

More information

OPTIMAL ESTIMATION of DYNAMIC SYSTEMS

OPTIMAL ESTIMATION of DYNAMIC SYSTEMS CHAPMAN & HALL/CRC APPLIED MATHEMATICS -. AND NONLINEAR SCIENCE SERIES OPTIMAL ESTIMATION of DYNAMIC SYSTEMS John L Crassidis and John L. Junkins CHAPMAN & HALL/CRC A CRC Press Company Boca Raton London

More information

APPROXIMATE SOLUTION OF A SYSTEM OF LINEAR EQUATIONS WITH RANDOM PERTURBATIONS

APPROXIMATE SOLUTION OF A SYSTEM OF LINEAR EQUATIONS WITH RANDOM PERTURBATIONS APPROXIMATE SOLUTION OF A SYSTEM OF LINEAR EQUATIONS WITH RANDOM PERTURBATIONS P. Date paresh.date@brunel.ac.uk Center for Analysis of Risk and Optimisation Modelling Applications, Department of Mathematical

More information

INPUT-TO-STATE COVARIANCES FOR SPECTRAL ANALYSIS: THE BIASED ESTIMATE

INPUT-TO-STATE COVARIANCES FOR SPECTRAL ANALYSIS: THE BIASED ESTIMATE INPUT-TO-STATE COVARIANCES FOR SPECTRAL ANALYSIS: THE BIASED ESTIMATE JOHAN KARLSSON AND PER ENQVIST Abstract. In many practical applications second order moments are used for estimation of power spectrum.

More information

Comments and Corrections

Comments and Corrections 1386 IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL 59, NO 5, MAY 2014 Comments and Corrections Corrections to Stochastic Barbalat s Lemma and Its Applications Xin Yu and Zhaojing Wu Abstract The proof of

More information

Optimal Control of Weakly Coupled Systems and Applications

Optimal Control of Weakly Coupled Systems and Applications Optimal Control of Weakly Coupled Systems and Applications HIGH ACCURACY TECHNIQUES Z. Gajić, M-T. Lim, D. Skatarić W-C. Su, and V. Kecman Taylor & Francis (CRC Press, Dekker) 2008 Preface This book is

More information

A Delay-dependent Condition for the Exponential Stability of Switched Linear Systems with Time-varying Delay

A Delay-dependent Condition for the Exponential Stability of Switched Linear Systems with Time-varying Delay A Delay-dependent Condition for the Exponential Stability of Switched Linear Systems with Time-varying Delay Kreangkri Ratchagit Department of Mathematics Faculty of Science Maejo University Chiang Mai

More information

IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 50, NO. 5, MAY Bo Yang, Student Member, IEEE, and Wei Lin, Senior Member, IEEE (1.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 50, NO. 5, MAY Bo Yang, Student Member, IEEE, and Wei Lin, Senior Member, IEEE (1. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL 50, NO 5, MAY 2005 619 Robust Output Feedback Stabilization of Uncertain Nonlinear Systems With Uncontrollable and Unobservable Linearization Bo Yang, Student

More information

Automatic Spectral Analysis With Time Series Models

Automatic Spectral Analysis With Time Series Models IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, VOL. 51, NO. 2, APRIL 2002 211 Automatic Spectral Analysis With Time Series Models Piet M. T. Broersen Abstract The increased computational speed and

More information

(q 1)t. Control theory lends itself well such unification, as the structure and behavior of discrete control

(q 1)t. Control theory lends itself well such unification, as the structure and behavior of discrete control My general research area is the study of differential and difference equations. Currently I am working in an emerging field in dynamical systems. I would describe my work as a cross between the theoretical

More information

Acomplex-valued harmonic with a time-varying phase is a

Acomplex-valued harmonic with a time-varying phase is a IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 46, NO. 9, SEPTEMBER 1998 2315 Instantaneous Frequency Estimation Using the Wigner Distribution with Varying and Data-Driven Window Length Vladimir Katkovnik,

More information

KNOWN approaches for improving the performance of

KNOWN approaches for improving the performance of IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II: EXPRESS BRIEFS, VOL. 58, NO. 8, AUGUST 2011 537 Robust Quasi-Newton Adaptive Filtering Algorithms Md. Zulfiquar Ali Bhotto, Student Member, IEEE, and Andreas

More information

A Recurrent Neural Network for Solving Sylvester Equation With Time-Varying Coefficients

A Recurrent Neural Network for Solving Sylvester Equation With Time-Varying Coefficients IEEE TRANSACTIONS ON NEURAL NETWORKS, VOL 13, NO 5, SEPTEMBER 2002 1053 A Recurrent Neural Network for Solving Sylvester Equation With Time-Varying Coefficients Yunong Zhang, Danchi Jiang, Jun Wang, Senior

More information

System Modeling and Identification CHBE 702 Korea University Prof. Dae Ryook Yang

System Modeling and Identification CHBE 702 Korea University Prof. Dae Ryook Yang System Modeling and Identification CHBE 702 Korea University Prof. Dae Ryook Yang 1-1 Course Description Emphases Delivering concepts and Practice Programming Identification Methods using Matlab Class

More information

OUTPUT REGULATION OF THE SIMPLIFIED LORENZ CHAOTIC SYSTEM

OUTPUT REGULATION OF THE SIMPLIFIED LORENZ CHAOTIC SYSTEM OUTPUT REGULATION OF THE SIMPLIFIED LORENZ CHAOTIC SYSTEM Sundarapandian Vaidyanathan Research and Development Centre, Vel Tech Dr. RR & Dr. SR Technical University Avadi, Chennai-600 06, Tamil Nadu, INDIA

More information

Cramér-Rao Bounds for Estimation of Linear System Noise Covariances

Cramér-Rao Bounds for Estimation of Linear System Noise Covariances Journal of Mechanical Engineering and Automation (): 6- DOI: 593/jjmea Cramér-Rao Bounds for Estimation of Linear System oise Covariances Peter Matiso * Vladimír Havlena Czech echnical University in Prague

More information

Application-Oriented Estimator Selection

Application-Oriented Estimator Selection IEEE SIGNAL PROCESSING LETTERS, VOL. 22, NO. 4, APRIL 2015 489 Application-Oriented Estimator Selection Dimitrios Katselis, Member, IEEE, and Cristian R. Rojas, Member, IEEE Abstract Designing the optimal

More information

OUTPUT REGULATION OF RÖSSLER PROTOTYPE-4 CHAOTIC SYSTEM BY STATE FEEDBACK CONTROL

OUTPUT REGULATION OF RÖSSLER PROTOTYPE-4 CHAOTIC SYSTEM BY STATE FEEDBACK CONTROL International Journal in Foundations of Computer Science & Technology (IJFCST),Vol., No., March 01 OUTPUT REGULATION OF RÖSSLER PROTOTYPE-4 CHAOTIC SYSTEM BY STATE FEEDBACK CONTROL Sundarapandian Vaidyanathan

More information

Fast adaptive ESPRIT algorithm

Fast adaptive ESPRIT algorithm Fast adaptive ESPRIT algorithm Roland Badeau, Gaël Richard, Bertrand David To cite this version: Roland Badeau, Gaël Richard, Bertrand David. Fast adaptive ESPRIT algorithm. Proc. of IEEE Workshop on Statistical

More information

Impulsive Stabilization for Control and Synchronization of Chaotic Systems: Theory and Application to Secure Communication

Impulsive Stabilization for Control and Synchronization of Chaotic Systems: Theory and Application to Secure Communication 976 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I: FUNDAMENTAL THEORY AND APPLICATIONS, VOL. 44, NO. 10, OCTOBER 1997 Impulsive Stabilization for Control and Synchronization of Chaotic Systems: Theory and

More information

Subspace Identification

Subspace Identification Chapter 10 Subspace Identification Given observations of m 1 input signals, and p 1 signals resulting from those when fed into a dynamical system under study, can we estimate the internal dynamics regulating

More information

Linear Quadratic Zero-Sum Two-Person Differential Games Pierre Bernhard June 15, 2013

Linear Quadratic Zero-Sum Two-Person Differential Games Pierre Bernhard June 15, 2013 Linear Quadratic Zero-Sum Two-Person Differential Games Pierre Bernhard June 15, 2013 Abstract As in optimal control theory, linear quadratic (LQ) differential games (DG) can be solved, even in high dimension,

More information

Computing running DCTs and DSTs based on their second-order shift properties

Computing running DCTs and DSTs based on their second-order shift properties University of Wollongong Research Online Faculty of Informatics - Papers (Archive) Faculty of Engineering Information Sciences 000 Computing running DCTs DSTs based on their second-order shift properties

More information