FIXED-INTERVAL smoothers (see [1] [10]) can outperform

Size: px
Start display at page:

Download "FIXED-INTERVAL smoothers (see [1] [10]) can outperform"

Transcription

1 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL 54, NO 3, MARCH Optimal Robust Noncausal Filter Formulations Garry A Einicke, Senior Member, IEEE Abstract The paper describes an optimal minimum-variance noncausal filter or fixed-interval smoother The optimal solution involves a cascade of a Kalman predictor an adjoint Kalman predictor A robust smoother involving H predictors is also described Filter asymptotes are developed for output estimation input estimation problems which yield bounds on the spectrum of the estimation error These bounds lead to a priori estimates for the scalar in the H filter smoother design The results of simulation studies are presented, which demonstrate that optimal, robust, extended Kalman smoothers can provide performance benefits Index Terms H, Kalman filtering, noncausal filtering, robustness, smoothing I INTRODUCTION FIXED-INTERVAL smoothers (see [1] [10]) can outperform filters when processing blocks of noisy measurements Application of the optimal Wiener Kalman solutions requires knowledge of the plant statistics of the noise processes These optimal solutions minimize the 2-norm of the map from the input noises to the estimation error can perform poorly when there are errors or uncertainties in the problem assumptions This has motivated the development of robust estimation techniques (eg, see [8] [19]) In particular, the estimation techniques minimize the -norm of the map from the input noises to the estimation error can accommodate worst-case conditions The optimal noncausal filter or fixed-interval smoother was first described in the frequency domain by Wiener [1], [2] An early time-domain fixed-interval smoothing algorithm using the Kalman framework was developed by Rauch [3] Some further developments of [3] are reported by Mayne in [4] Rauch, Tung Striebel developed a maximum-likelihood smoother [5], which uses a Kalman filter, stores the corrected states, predicted covariances or corrected covariances, employs them within a backward recursion In the Fraser Potter smoother [6], Kalman filters are applied in forward backward directions The smoothed state estimate arises as a linear combination of forward backward state estimates weighted by the inverse of the underlying error covariance matrices Catlin subsequently showed that the same smoother can be derived without assuming that the forward backward errors are independent [7] A continuous-time robust fixed-interval smoother for the case when the noises the induced norm of the plant are Manuscript received October 13, 2004; revised May 9, 2005 The associate editor coordinating the review of this manuscript approving it for publication was Dr Dominic K C Ho The author is with the Division of Exploration Mining, Commonwealth Scientific Industrial Research Organization (CSIRO), Kenmore, QLD 4069, Australia ( garryeinicke@csiroau) Digital Object Identifier /TSP bounded but are otherwise arbitrary, is presented in [8] The smoother arises as a combination of forward states from an filter that involves an algebraic Riccati equation (ARE) adjoint states that evolve according to a Hamiltonian matrix A discrete-time case is described in [9], which employs an Riccati difference equation (RDE) within a filter to calculate forward states that are combined with adjoint states to obtain smoothed estimates The use of both a forward a backward ARE in the solution of a continuous-time robust smoothing problem is detailed in [10] An algorithm for discrete-time fixed-lag smoothing that relies on the solution of an RDE is described in [11] The work of [11] also establishes the tradeoff between the minimum smoothing lag achieving a prescribed performance level A Krein space approach which yields existence conditions for a continuous-time fixed-lag smoother is developed in [12] An alternative to the approach of [9] [10] for accommodating model uncertainties is presented in [13], where a quadratic Lyapunov function for all possible uncertainties is defined a convex optimization problem with linear matrix inequality constraints is solved Another technique for managing model uncertainties within robust designs is through the solution of a regularized weighted recursive least-squares problem, which is detailed in [14] This paper develops smoothing formulations for problems in which uncertainties may be present in the problem specifications In previous work [15], [16], robust techniques have been developed for nonlinear filtering problems Some robustness was achieved in [16] by assuming fixed solutions to the underlying Riccati equations In [15], an extra parameter was introduced, which bounds a model uncertainty A naïve approach is adopted here, where some uncertainty is accommodated implicitly via an appropriate choice of the scalar within the default framework of [17], which evolved from the J-factorization approach of [18] A minimum-variance noncausal filter or fixed-interval smoother is described which derives from classical frequency domain (Wiener) filtering The noncausal filter involves a cascade of a forward Kalman predictor an adjoint Kalman predictor A robust fixed-interval smoother is constructed similarly using predictors However, the efficacy of an approach depends on finding an optimal scalar To this end, filter asymptotes are developed for time-invariant output estimation input estimation problems which yield bounds on the spectrum of the estimation error The derivation of these bounds is also motivated by the remarks within [19] lead to a priori estimates for in the filter smoother designs The remainder of the paper is organized as follows Some notation the realization of discrete-time adjoint systems is described in Section II-A The time-invariant time-varying optimal minimum-variance noncausal filter formulations are de X/$ IEEE

2 1070 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL 54, NO 3, MARCH 2006 veloped in Sections II-B II-C, respectively The optimal solutions rely on the assumption that the underlying processes are Gaussian that the covariances are known Section III introduces a robust smoother formulation that attempts to accommodate uncertain input processes Asymptotes are developed for single-input-single-output (SISO) output estimation input estimation examples It is shown that the maximum magnitudes of the robust solutions approach the asymptotes closer than the optimal minimum-variance solutions Linear nonlinear applications are described in Section IV, where it is demonstrated that optimal, robust extended Kalman smoothers can provide performance benefits Fig 1 General filtering problem Consider a linear system that maps which has the state-space realization II OPTIMAL NONCAUSAL FILTERING A Adjoint Systems In Section II-B, where a minimum-variance noncausal filter is derived, the discrete-time adjoint system is required Let be a linear operator between two Hilbert spaces Suppose that has the state space realization where,,,,,,,,, Let denote the inner product Then the adjoint of is the linear system that maps satisfies [18] Following the continuous-time approach [18] (1) Then it is straightforward to show that for an arbitrary B A Linear Time-Invariant Noncausal Filter Formulation Consider the general filtering problem depicted in Fig 1, where is given by (1) The reference system maps has the state space realization where, A linear system mapping is to be designed that produces estimates of the output of, denoted by, from the measurements (3) (4) (5) where,, is an independent process with Denote the estimation error as define (6) where the adjoint is the linear system The adjoint (2) has the same 2-norm the same -norm as the original system (1) Note that the adjoint system is anticausal, ie, it evolves backward in time Suppose, hypothetically, that is asymptotically stable it is desired to realize The cannot be realized directly because it is unstable By exploiting, the can be realized by operating on the transposed time-reversed input data then taking the transposed time reverse of the result (see [20, Ex 23]) (2) The is known as the map from the inputs to the estimation error By exping completing the squares, it can be shown that, where, (see [19]) Assuming that the inputs are independent, zeromean Gaussian processes, the optimal solution that minimizes the causal part of hence is the Kalman filter which is given by where one-step-ahead predictor gain, (7) is the Kalman

3 EINICKE: OPTIMAL AND ROBUST NONCAUSAL FILTER FORMULATIONS 1071 is the Kalman filter gain, is the solution of the ARE The form (7) follows from the results of [17] specialized for (1), (4), (5), (6) In the case of state estimation no feedthrough terms, the solution (7) reverts to the better known formulation (16) (111) of [21] In linear time-invariant estimation problems, the causal Wiener filter is equivalent to the minimum-variance Kalman filter This motivates the derivation of a minimum-variance noncausal filter Theorem: For the time-invariant filtering problem defined by (1), (4), (5), (6), suppose that the factor satisfies the existence conditions defined in [22], that the inverse exists Then the following applies (i) In the general case, where, the solution (8) (9) (10) difference matrix approach of [22] the Kalman predictor equality of [24] Applying the matrix inversion lemma [25, Lemma 67] results in (8), the adjoint yields (9) (ii) By minmizing, it follows that the optimal smoother for the output estimation problem is defined by The optimal smoother for output estimation (8), (9), (12) involves a cascade of a evolving forward in time followed by a evolving backward in time It can be implemented via the following three-step procedure Step 1) Realize the system (8) operating on the measurements Step 2) In lieu of (9), which is unrealizable, exploit, that is, operate (8) on the time-reversed transpose of the then take the time-reversed transpose of the result Step 3) Apply (12) The Kalman filter (7) can be written as Therefore, the difference between the filter smoother is It can be seen that the benefit of smoothing diminishes when the measurement noise becomes negligible In the case of input estimation or equalization where, the optimal smoother solution is given by This equalizer can be realized similarly by evolving forward in time, followed by a backward evolution of subsequently C A Linear Time-Varying Noncausal Filter Formulation Consider the linear time-varying systems,,, having the state space realizations, the solu- satisfies (ii) In the output estimation case, where tion (8), (9), (11) (12) satisfies Proof: (i) By minimizing, it follows that the optimal smoother for the general problem is defined by It can be shown that comparing the ARE together with the identity (3) leads to A derivation is shown in [21] Alternative derivations follow from the continuous-time case in [23], the return respectively, where,,,, Suppose that exists, where Then is defined similarly where The Kalman filter for time-varying plants is given by (13) where,, is the solution of the RDE

4 1072 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL 54, NO 3, MARCH 2006 The Kalman filter is the optimal causal solution that minimizes, which is equivalent to minimizing the variance of the estimation error Next it is shown that a time-varying noncausal filter can be constructed which also minimizes Corollary: For the above time-varying filtering problem where, suppose that the factor its inverse Fig 2 Noncausal filter for output estimation exist Then the following applies (i) In the general case, where, the solution (14) matrix inversion lemma results in (14) its adjoint yields (15) (ii) The result follows by substituting within The structure of the noncausal filter for output estimation is shown in Fig 2 in which denotes the Kalman predictor Although the plants are time-varying, the factorization is constructed analogously to the time-invariant case It follows from the corollary that when the plant the input processes are locally stationary, ie, the time-varying parameters change sufficiently slowly, then The conditions for stationarity include the monotonicity results for time-varying Riccati equations that are reported in [26] Nonlinear smoothers can be constructed similarly using forward adjoint extended Kalman predictors an example is presented subsequently In some nonlinear applications, such as FM demodulation (see [16] [21]), the error covariance can converge, ie, so, which suggests that the false algebraic Riccati technique of [24], [27] [16] can be readily applied within nonlinear smoothers satisfies (15) (16) (17), the solu- (ii) In the output estimation case, where tion (14), (15) satisfies Proof: (i) The result follows by substituting within Comparing with the identity (3) leads to (18) Applying the III ROBUST NONCAUSAL FILTERING A A Robust Noncausal Filter Formulation Suppose that the inputs are not Gaussian A causal solution designed for worst-case inputs is the filter (see [8] [15], [17] [19]), which minimizes the -norm of the map from the input processes to the estimation error The filter achieves the performance for all, a given In the stationary case, this performance criterion is equivalent to the maximum magnitude of the estimation error power spectral density being bounded above by From the results of [17], the time-varying filter possesses the structure of (7) in which

5 EINICKE: OPTIMAL AND ROBUST NONCAUSAL FILTER FORMULATIONS 1073,, where (19) smoothers can be constructed using the structure of (14) (18), in which,, are substituted with,, respectively Some examples that demonstrate how performance benefits can arise are presented in Sections III-C, III-D, IV B Some General Properties of Filters This section remarks on three properties of filters First, the filter is designed to revert to the Kalman filter at Second, the cost of an solution is an increased upper bound for the state error covariance Third, the solution of the RDE monotonically approaches the solution of the Kalman RDE It follows from the monotonicity property that a designer is required to search iteratively for a that yields a performance benefit; to this end, some a priori guidance is presented in Sections III-C III-D The increased error covariance property indicates that filters can exhibit degraded performance when the problem assumptions are, in fact, correct Conversely, when uncertainty in the problem assumptions is accommodated successfully, robust solutions can be advantageous, which is illustrated in Section IV An equivalent form of the quadratic term of the RDE (19) can be obtained via (241) of [17] as, where (20), shown at the bottom of the page, in which Lemma 1: at Lemma 2: The cost of an solution is an increased upper bound for the state error covariance Lemma 3: As, the solution of the RDE (19) or equivalently (20) monotonically approaches the solution of the Kalman RDE The proofs are described in [28] techniques can also accommodate model uncertainty explicitly as is shown in [15] However, the efficacy of estimation depends on finding an optimal, which is discussed in the subsequent sections C A Stationary Output Estimation Case In the problem (1), (4), (5) (6), consider a time-invariant, SISO, autoregressive (AR) plant having the canonical form, Since the plant is time-invariant, the transfer function exists is denoted by Consider the output estimation case where in (4) Some notation is defined prior to stating some observations for this problem Suppose that an filter has been constructed for the above plant Let the ARE solution, predictor gain, filter gain, predictor, filter smoother transfer function matrices be denoted by,,,,, respectively The filter transfer function matrix may be written as, (20)

6 1074 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL 54, NO 3, MARCH 2006 where The transfer function matrix of the map from the inputs to the filter output estimation error is (21) The smoother transfer function matrix can be written as Similarly, let,,, denote the minimum-variance ARE solution, predictor gain, filter gain, filter smoother transfer function matrices, respectively Proposition 1: In the above output estimation problem: (i) (ii) (iii) (22) (23) achieves the performance, when (from (24)), an a priori design estimate is D A Stationary Input Estimation Case Consider a time-invariant, SISO, AR plant having the transfer function where, are defined in Section III-C, together with Consider an input estimation (or equalization) problem with, within (1), (4), (5) (6) The transfer function matrix of the causal solution that estimates the input of the plant is The transfer function matrix of the map from the inputs to the input estimation error is (27) The noncausal transfer function matrix of the input estimator can be written as Proposition 2: For the above input estimation problem: (i) (28) (iv) (v) (24) (25) (ii) (iii) (29) (26) Outline of Proof: (i) Let denote the (1,1) component of The low measurement noise observation (22) follows from (ii) Observation (23) follows from, which results in (iii) Observation (24) follows immediately from the application of (22) in (21) (iv) Observation (25) follows from (v) Observation (26) follows from which results in An interpretation of (22) (25) is that when, the maximum magnitudes of the filters smoothers asymptotically approach a short circuit (or zero impedance) From (23) (26), as, the maximum magnitudes of the solutions approach the short circuit asymptote closer than the optimal minimum-variance solutions That is, for low measurement noise, the robust solutions accommodate some uncertainty by giving greater weighting to the data Since the filter (iv) (v) (30) (31) (32) Outline of Proof: (i) (iv) The high measurement noise observations (28) (31) follow from (ii) (v) The observations (29) (32) follow from, which results in (iii) The observation (30) follows immediately from the application of (28) in (27) An interpretation of (28) (31) is that when, the maximum magnitudes of the equalizers asymptotically approach an open circuit (or infinite impedance) From (29)

7 EINICKE: OPTIMAL AND ROBUST NONCAUSAL FILTER FORMULATIONS 1075 (32), as, the maximum magnitude of the solutions approaches the open circuit asymptote closer than that of the optimum minimum-variance solutions That is, at high measurement noise, the robust solutions accommodate some uncertainty by giving less weighting to the data Since the solution achieves the performance, when (from (30)), an a priori design estimate is Proposition 1 follows intuitively Indeed, the short circuit asymptote is sometimes referred to as the singular filter Proposition 2 may appear counter-intuitive warrants a further explanation When the plant is minimum phase the measurement noise is negligible, the equalizer inverts the plant Conversely, when the equalization problem is dominated by measurement noise, the solution is a low gain filter; that is, the estimation error is minimized by giving less weighting to the data (a) IV APPLICATIONS A Speech Enhancement In high-measurement noise applications, sampled speech is often modeled as an AR1 process (33) (34) where,, the speech message measurement noise are uncorrelated, zero-mean, Gaussian processes of variances, respectively Suppose that a filter designed for (33) (34) has produced state estimates from measurements Using the approach of [29] assuming that, it is straightforward to show that the maximum-likelihood estimates (MLEs) for the unknown parameters are, A voiced speech utterance a eiou was sampled at 8 khz for the purpose of comparing smoother performance Simulations were conducted with the zero-mean, unity-variance speech sample interpolated to a 16-kHz sample rate, to which 200 realizations of Gaussian noise were added the signal-to-noise ratio (SNR) was varied from 5 to 5 db The were calculated at 20-dB SNR using Kalman filter state estimates within an expectation maximization algorithm The results of simulations that compare the performance of the minimum-variance smoother with the Fraser Potter smoother [6] the maximum likelihood smoother [5] are presented in Fig 3(a) It can be seen that the Fraser Potter smoother exhibits the worst MSE is suboptimal In the case of this example, indistinguishable performance is exhibited by the maximum-likelihood smoother the minimum-variance smoother (14), (15) (18) which achieves when designs require an optimum value for the scalar within (19) If is too small the of (19) is not positive definite, the filter will lack stability Conversely, if is too large, the filter design will be too conservative The a priori initial design (from Proposition 1) permits a one-sided search (b) Fig 3 (a) Fixed-interval smoother performance comparison: (i) minimumvariance smoother (dotted line); (ii) Fraser Potter smoother (dashed line); (iii) maximum-likelihood smoother (crosses) (b) Speech estimate performance comparison: (i) data (crosses); (ii) Kalman filter (dotted line); (iii) H filter (dashed line); (iv) minimum-variance smoother (dotted dashed line); (v) robust smoother (solid line) instead of a two-sided search for an optimal Here an approximate MLE for was calculated online an initial value of was incremented by 10% until the solution of (19) was positive definite for each noise realization The results of simulations are shown in Fig 3(b) It can be seen for this example that the filter outperforms the Kalman filter By appealing to Proposition 1, it is argued that the performance improvement arises as a consequence of giving greater weighting to the data The time-varying minimum-variance smoothers were applied to the above-mentioned noisy speech data the simulation results are indicated by the dotted dashed line the solid line in Fig 3(b), respectively It can be seen that smoothers outperform causal filters The figure indicates that the robust smoother exhibits about 4-dB reduction in MSE compared to the Kalman filter at 0-dB SNR The improvement was observed to be manifested by the estimate trajectories exhibiting fewer errors in the vicinity of the speech message peaks, which is consistent with the stated interpretation of Proposition 1 Lemma 2 states that the cost of the robust filter is a degradation in MSE when the plant is known However, Fig 3(b) demonstrates that combining robust forward backward state predictors within (8), (9), (12) yielded an MSE improvement Therefore, the AR1 plant (33) together with the MLEs

8 1076 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL 54, NO 3, MARCH 2006 of do not adequately model voiced speech Indeed, higher order models are used in speech coding For example, the full-rate GSM speech coder employs an eighth order linear predictive coding analysis [30] Nevertheless, this first order example does demonstrate that trading off optimality is appropriate in the presence of uncertainty B FM Demodulation Consider a nonlinear plant of the form,, in which the nonlinearities, are assumed to be smooth, differentiable functions of appropriate dimensions (see [21]) An extended Kalman smoother for the corresponding output estimation problem can be implemented using the linearizations akin to the extended Kalman filter (EKF) via the following three-step procedure Step 1) In view of (14), calculate,,, where,,, in which Step 2) In lieu of (15), calculate the by carrying out Step 1) operating on the transposed time-reversed data, then taking the transposed time-reverse of the result Step 3) Calculate Consider the problem of demodulating a unity amplitude frequency modulated (FM) signal Let where,, denote the instantaneous frequency, instantaneous phase, complex observations measurement noise respectively Simulations were conducted in which an FM signal was generated using the speech message described in Section IV-A The MLE parameter estimates of Section IV-A were used within an extended Kalman Filter demodulator An FM discriminator [31], ie,, serves as a benchmark as an auxiliary frequency measurement for an extended Kalman smoother The innovations within Steps 1) 2) are given, respectively, by, Fig 4 FM demodulation performance comparison: (i) FM discriminator (crosses); (ii) EKF (dotted line); (iii) Robust EKF (dashed line); (iv) extended Kalman smoother robust extended Kalman smoother (solid line) The SNR was varied in 15-dB steps from 3 to 15 db The MSEs were calculated over 200 realizations of Gaussian measurement noise are shown in Fig 4 It can be seen from the figure, that at 75 db SNR, the EKF improves on the FM discriminator MSE by about 12 db The improvement arises because the EKF demodulator exploits the signal model whereas the FM discriminator does not The figure shows that the extended Kalman smoother further reduces the MSE by about 2 db, which illustrates the advantage of exploiting all the data in the time interval Since the filter achieves the performance, an a priori design estimate is, where is obtained from an EKF demodulator implementation A robust EKF a robust extended Kalman smoother were designed in which an initial value of 05 times the above estimate for the was incremented by 10% until the solution of (19) was positive definite for each noise realization The resulting MSE performance is shown in Fig 4 It can be seen at 75-dB SNR that the robust EKF provides about a 1-dB performance improvement compared to the EKF, whereas the extended Kalman smoother the robust extended Kalman smoother performance are indistinguishable This nonlinear example illustrates once again that smoothers can outperform filters Since a first-order speech model is used the output mapping is linearized, some model uncertainty is present, so the robust design demonstrates a marginal improvement over the EKF A procedure that explicitly accommodates linearization errors within a robust EKF is described in [15] V CONCLUSION The paper introduces an optimum minimum-variance noncausal filter or fixed-interval smoother for discrete-time systems The smoother involves a cascade of a Kalman predictor an adjoint Kalman predictor It is shown that the solution is optimal in the sense that it minimizes the 2-norm of the map from the input processes to the estimation error

9 EINICKE: OPTIMAL AND ROBUST NONCAUSAL FILTER FORMULATIONS 1077 The advantage of a state space formulation is that timevarying, uncertain nonlinear applications can be described In particular, a robust smoother is developed which employs predictors designs require an optimal to be found Therefore, solution asymptotes are developed for stationary output estimation input estimation problems, which yield bounds on the spectrum of the estimation error These bounds lead to a priori estimates for the scalar in the robust filter smoother designs The solution asymptotes also provide an insight into how robust designs achieve performance benefits That is, when uncertainties exist, robust filters pay more attention to the data, whereas robust equalizers pay less attention to the data A speech enhancement example is discussed that demonstrates that combining forward adjoint predictors within a robust smoother can be beneficial An extended Kalman smoother is presented for nonlinear problems an a priori estimate for the within robust designs is described A FM demodulation example is presented which illustrates that optimal robust smoothers can provide performance benefits ACKNOWLEDGMENT The author would like to thank Prof M-A Poubelle for providing helpful advice over the Pacific Dr D Hainsworth for checking the manuscript REFERENCES [1] J S Meditch, A survey of data smoothing for linear nonlinear dynamic systems, Automatica, vol 9, pp , 1973 [2] T Kailath, A view of three decades of linear filtering theory, IEEE Trans Inf Theory, vol 20, no 2, pp , Mar 1974 [3] H E Rauch, Solutions to the linear smoothing problem, IEEE Trans Autom Control, vol 8, no 4, pp , Oct 1963 [4] D Q Mayne, A solution of the smoothing problem for linear dnamic systems, Automatica, vol 4, pp 73 92, 1966 [5] H E Rauch, F Tung, C T Striebel, Maximum likelihood estimates of linear dynamic systems, AIAA J, vol 3, no 8, pp , Aug 1965 [6] D C Fraser J E Potter, The optimum linear smoother as a combination of two optimum linear filters, IEEE Trans Autom Control, vol AC-14, no 4, pp , Aug 1969 [7] D C Catlin, The independence of forward backward estimation errors in the two-filter form of the fixed interval Kalman smoother, IEEE Trans Automat Control, vol 25, no 6, pp , Dec 1980 [8] K M Nagpal P P Khargonekar, Filtering smoothing in an H setting, IEEE Trans Autom Control, vol 36, no 2, pp , Feb 1991 [9] Y Theordor, U Shaked, C E de Souza, A game theory approach to robust discrete-time H estimation, IEEE Trans Signal Process, vol 32, no 6, pp , Jun 1996 [10] S O R Moheimani, A V Savkin, I R Petersen, Robust filtering, prediction, smoothing observability of uncertain systems, IEEE Trans Circuits Syst, vol 45, no 4, pp , Apr 1998 [11] P Bolzern, P Colaneri, G De Nicolao, On discrete-time H fixed-lag smoothing, IEEE Trans Signal Process, vol 52, no 1, pp , Jan 2004 [12] H Zhang, L Xie, W Wang, X Lu, An innovation approach to H fixed-lag smoothing for continuous time-varying systems, IEEE Trans Autom Control, vol 49, no 12, pp , Dec 2004 [13] F Wang V Balakrishnan, Robust-state filtering for systems with deterministic stochastic uncertainties, IEEE Trans Signal Process, vol 51, no 10, pp , Oct 2003 [14] A Subramanian A H Sayed, Regularized robust filters for timevarying uncertain discrete-time systems, IEEE Trans Autom Control, vol 49, no 6, pp , Jun 2004 [15] G A Einicke L B White, Robust extended Kalman filtering, IEEE Trans Signal Process, vol 47, no 9, pp , Sep 1999 [16] G A Einicke, L B White, R R Bitmead, The use of fake Algebraic Riccati equations for co-channel demodulation, IEEE Trans Signal Process, vol 51, no 9, pp , Sep 2003 [17] D J N Limebeer, M Green, D Walker, Discrete-time H control, in Proc 28th Conf Decision Control, Tampa, FL, Dec 1989, pp [18] D J N Limebeer, B D O Anderson, P Khargonekar, M Green, A game theoretic approach to H control for time-varying systems, SIAM J Control Optim, vol 30, no 2, pp , 1992 [19] U Shaked, H - minimum error state estimation of linear stationary processes, IEEE Trans Autom Contr, vol AC-35, no 5, pp , May 1990 [20] C S Burrus, J H McClellan, A V Oppenheim, T W Parks, R W Schafer, H W Schuessler, Computer-Based Exercises for Signal Processing Using Matlab Englewood Cliffs, NJ: Prentice-Hall, 1994, pp [21] B D O Anderson J B Moore, Optimal Filtering Englewood Cliffs, NJ: Prentice-Hall, 1979 [22] U Shaked, A transfer function approach to the linear discrete stationary filtering the steady-state discrete optimal control problems, Int J Control, vol 29, pp , 1979 [23] A P Sage J L Melsa, Estimation Theory With Applications to Communications Control New York: McGraw-Hill, 1971, p 319 [24] R R Bitmead, M Gevers, V Wertz, Adaptive Optimal Control Sydney, Australia: Prentice-Hall, 1990, pp [25] T Söderström, Discrete-Time Stochastic Systems London, UK: Springer-Verlag, 2002, p 165 [26] G Freiling V Ionescu, Time-varying discrete Riccati equation: Some monotonicity results, Linear Algebra Its Appl, no 286, pp , 1999 [27] M-A Poubelle, I R Petersen, M R Gevers, R R Bitmead, A miscellany of results on an equation of Count J F Riccati, IEEE Trans Autom Control, vol 31, no 7, pp , Jul 1986 [28] G A Einicke, Robust filtering, PhD thesis, Dept of Electrical Electronic Engineering, Univ of Adelaide, Adelaide, Australia, Jun 1995 [29] S M Kay, Fundamentals of Statistical Signal Processing: Estimation Theory Englewood Cliffs, NJ: Prentice-Hall, 1993, ch 7, pp [30] L Besacier, S Grassi, A Dufaux, M Ansorge, F Pellini, GSM speech coding speaker recognition, in Proc Int Conf Acoustics, Speech, Signal Processing, vol 2, Jun 2000, pp [31] J Aisbett, Automatic modulation recognition using time domain parameters, Signal Process, vol 13, pp , 1987 Garry A Einicke (S 90 M 93 SM 05) received the Bachelor of Engineering, Master s of Engineering, PhD degrees from the University of Adelaide, South Australia, in 1979, 1991, 1996, respectively From 1980 to 1996, he was a Senior Research Scientist in the Signal Analysis Discipline with the Defence Science Technology Organization Since 1997, he has been with the Commonwealth Scientific Industrial Research Organization (CSIRO), Kenmore, Queensl, Australia, where he is a Principle Research Scientist leads mine communication research He also has been an Adjunct Associate Professor in the School of Information Technology Electrical Engineering at The University of Queensl

Riccati difference equations to non linear extended Kalman filter constraints

Riccati difference equations to non linear extended Kalman filter constraints International Journal of Scientific & Engineering Research Volume 3, Issue 12, December-2012 1 Riccati difference equations to non linear extended Kalman filter constraints Abstract Elizabeth.S 1 & Jothilakshmi.R

More information

The H infinity fixed-interval smoothing problem for continuous systems

The H infinity fixed-interval smoothing problem for continuous systems The H infinity fixed-interval smoothing problem for continuous systems Eric Blanco, Philippe Neveux, Gérard Thomas To cite this version: Eric Blanco, Philippe Neveux, Gérard Thomas. The H infinity fixed-interval

More information

Filter Design for Linear Time Delay Systems

Filter Design for Linear Time Delay Systems IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 49, NO. 11, NOVEMBER 2001 2839 ANewH Filter Design for Linear Time Delay Systems E. Fridman Uri Shaked, Fellow, IEEE Abstract A new delay-dependent filtering

More information

Lyapunov Stability of Linear Predictor Feedback for Distributed Input Delays

Lyapunov Stability of Linear Predictor Feedback for Distributed Input Delays IEEE TRANSACTIONS ON AUTOMATIC CONTROL VOL. 56 NO. 3 MARCH 2011 655 Lyapunov Stability of Linear Predictor Feedback for Distributed Input Delays Nikolaos Bekiaris-Liberis Miroslav Krstic In this case system

More information

Fixed-Order Robust H Filter Design for Markovian Jump Systems With Uncertain Switching Probabilities

Fixed-Order Robust H Filter Design for Markovian Jump Systems With Uncertain Switching Probabilities IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 54, NO. 4, APRIL 2006 1421 Fixed-Order Robust H Filter Design for Markovian Jump Systems With Uncertain Switching Probabilities Junlin Xiong and James Lam,

More information

Auxiliary signal design for failure detection in uncertain systems

Auxiliary signal design for failure detection in uncertain systems Auxiliary signal design for failure detection in uncertain systems R. Nikoukhah, S. L. Campbell and F. Delebecque Abstract An auxiliary signal is an input signal that enhances the identifiability of a

More information

Optimal Polynomial Control for Discrete-Time Systems

Optimal Polynomial Control for Discrete-Time Systems 1 Optimal Polynomial Control for Discrete-Time Systems Prof Guy Beale Electrical and Computer Engineering Department George Mason University Fairfax, Virginia Correspondence concerning this paper should

More information

Crib Sheet : Linear Kalman Smoothing

Crib Sheet : Linear Kalman Smoothing Crib Sheet : Linear Kalman Smoothing Gabriel A. Terejanu Department of Computer Science and Engineering University at Buffalo, Buffalo, NY 14260 terejanu@buffalo.edu 1 Introduction Smoothing can be separated

More information

Closed-Form Design of Maximally Flat IIR Half-Band Filters

Closed-Form Design of Maximally Flat IIR Half-Band Filters IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II: ANALOG AND DIGITAL SIGNAL PROCESSING, VOL. 49, NO. 6, JUNE 2002 409 Closed-Form Design of Maximally Flat IIR Half-B Filters Xi Zhang, Senior Member, IEEE,

More information

Lessons in Estimation Theory for Signal Processing, Communications, and Control

Lessons in Estimation Theory for Signal Processing, Communications, and Control Lessons in Estimation Theory for Signal Processing, Communications, and Control Jerry M. Mendel Department of Electrical Engineering University of Southern California Los Angeles, California PRENTICE HALL

More information

Discrete-Time H Gaussian Filter

Discrete-Time H Gaussian Filter Proceedings of the 17th World Congress The International Federation of Automatic Control Discrete-Time H Gaussian Filter Ali Tahmasebi and Xiang Chen Department of Electrical and Computer Engineering,

More information

MANY digital speech communication applications, e.g.,

MANY digital speech communication applications, e.g., 406 IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL. 15, NO. 2, FEBRUARY 2007 An MMSE Estimator for Speech Enhancement Under a Combined Stochastic Deterministic Speech Model Richard C.

More information

Order Selection for Vector Autoregressive Models

Order Selection for Vector Autoregressive Models IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 51, NO. 2, FEBRUARY 2003 427 Order Selection for Vector Autoregressive Models Stijn de Waele and Piet M. T. Broersen Abstract Order-selection criteria for vector

More information

H State-Feedback Controller Design for Discrete-Time Fuzzy Systems Using Fuzzy Weighting-Dependent Lyapunov Functions

H State-Feedback Controller Design for Discrete-Time Fuzzy Systems Using Fuzzy Weighting-Dependent Lyapunov Functions IEEE TRANSACTIONS ON FUZZY SYSTEMS, VOL 11, NO 2, APRIL 2003 271 H State-Feedback Controller Design for Discrete-Time Fuzzy Systems Using Fuzzy Weighting-Dependent Lyapunov Functions Doo Jin Choi and PooGyeon

More information

Design of FIR Smoother Using Covariance Information for Estimating Signal at Start Time in Linear Continuous Systems

Design of FIR Smoother Using Covariance Information for Estimating Signal at Start Time in Linear Continuous Systems Systems Science and Applied Mathematics Vol. 1 No. 3 2016 pp. 29-37 http://www.aiscience.org/journal/ssam Design of FIR Smoother Using Covariance Information for Estimating Signal at Start Time in Linear

More information

The Rationale for Second Level Adaptation

The Rationale for Second Level Adaptation The Rationale for Second Level Adaptation Kumpati S. Narendra, Yu Wang and Wei Chen Center for Systems Science, Yale University arxiv:1510.04989v1 [cs.sy] 16 Oct 2015 Abstract Recently, a new approach

More information

WE study the capacity of peak-power limited, single-antenna,

WE study the capacity of peak-power limited, single-antenna, 1158 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 56, NO. 3, MARCH 2010 Gaussian Fading Is the Worst Fading Tobias Koch, Member, IEEE, and Amos Lapidoth, Fellow, IEEE Abstract The capacity of peak-power

More information

FIR Filters for Stationary State Space Signal Models

FIR Filters for Stationary State Space Signal Models Proceedings of the 17th World Congress The International Federation of Automatic Control FIR Filters for Stationary State Space Signal Models Jung Hun Park Wook Hyun Kwon School of Electrical Engineering

More information

The Discrete Kalman Filtering of a Class of Dynamic Multiscale Systems

The Discrete Kalman Filtering of a Class of Dynamic Multiscale Systems 668 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II: ANALOG AND DIGITAL SIGNAL PROCESSING, VOL 49, NO 10, OCTOBER 2002 The Discrete Kalman Filtering of a Class of Dynamic Multiscale Systems Lei Zhang, Quan

More information

Risk-Sensitive Filtering and Smoothing via Reference Probability Methods

Risk-Sensitive Filtering and Smoothing via Reference Probability Methods IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 42, NO. 11, NOVEMBER 1997 1587 [5] M. A. Dahleh and J. B. Pearson, Minimization of a regulated response to a fixed input, IEEE Trans. Automat. Contr., vol.

More information

Prediction of ESTSP Competition Time Series by Unscented Kalman Filter and RTS Smoother

Prediction of ESTSP Competition Time Series by Unscented Kalman Filter and RTS Smoother Prediction of ESTSP Competition Time Series by Unscented Kalman Filter and RTS Smoother Simo Särkkä, Aki Vehtari and Jouko Lampinen Helsinki University of Technology Department of Electrical and Communications

More information

Deconvolution Filtering of 2-D Digital Systems

Deconvolution Filtering of 2-D Digital Systems IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 50, NO. 9, SEPTEMBER 2002 2319 H Deconvolution Filtering of 2-D Digital Systems Lihua Xie, Senior Member, IEEE, Chunling Du, Cishen Zhang, and Yeng Chai Soh

More information

Asymptotic Analysis of the Generalized Coherence Estimate

Asymptotic Analysis of the Generalized Coherence Estimate IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 49, NO. 1, JANUARY 2001 45 Asymptotic Analysis of the Generalized Coherence Estimate Axel Clausen, Member, IEEE, and Douglas Cochran, Senior Member, IEEE Abstract

More information

Performance Analysis of an Adaptive Algorithm for DOA Estimation

Performance Analysis of an Adaptive Algorithm for DOA Estimation Performance Analysis of an Adaptive Algorithm for DOA Estimation Assimakis K. Leros and Vassilios C. Moussas Abstract This paper presents an adaptive approach to the problem of estimating the direction

More information

Cooperative Communication with Feedback via Stochastic Approximation

Cooperative Communication with Feedback via Stochastic Approximation Cooperative Communication with Feedback via Stochastic Approximation Utsaw Kumar J Nicholas Laneman and Vijay Gupta Department of Electrical Engineering University of Notre Dame Email: {ukumar jnl vgupta}@ndedu

More information

Optimal Mean-Square Noise Benefits in Quantizer-Array Linear Estimation Ashok Patel and Bart Kosko

Optimal Mean-Square Noise Benefits in Quantizer-Array Linear Estimation Ashok Patel and Bart Kosko IEEE SIGNAL PROCESSING LETTERS, VOL. 17, NO. 12, DECEMBER 2010 1005 Optimal Mean-Square Noise Benefits in Quantizer-Array Linear Estimation Ashok Patel and Bart Kosko Abstract A new theorem shows that

More information

A Linear Matrix Inequality Approach to Robust Filtering

A Linear Matrix Inequality Approach to Robust Filtering 2338 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 45, NO. 9, SEPTEMBER 1997 A Linear Matrix Inequality Approach to Robust Filtering Huaizhong Li Minyue Fu, Senior Member, IEEE Abstract In this paper, we

More information

J. Liang School of Automation & Information Engineering Xi an University of Technology, China

J. Liang School of Automation & Information Engineering Xi an University of Technology, China Progress In Electromagnetics Research C, Vol. 18, 245 255, 211 A NOVEL DIAGONAL LOADING METHOD FOR ROBUST ADAPTIVE BEAMFORMING W. Wang and R. Wu Tianjin Key Lab for Advanced Signal Processing Civil Aviation

More information

SIMON FRASER UNIVERSITY School of Engineering Science

SIMON FRASER UNIVERSITY School of Engineering Science SIMON FRASER UNIVERSITY School of Engineering Science Course Outline ENSC 810-3 Digital Signal Processing Calendar Description This course covers advanced digital signal processing techniques. The main

More information

Elements of Multivariate Time Series Analysis

Elements of Multivariate Time Series Analysis Gregory C. Reinsel Elements of Multivariate Time Series Analysis Second Edition With 14 Figures Springer Contents Preface to the Second Edition Preface to the First Edition vii ix 1. Vector Time Series

More information

THIS paper deals with robust control in the setup associated

THIS paper deals with robust control in the setup associated IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL 50, NO 10, OCTOBER 2005 1501 Control-Oriented Model Validation and Errors Quantification in the `1 Setup V F Sokolov Abstract A priori information required for

More information

Research Article Weighted Measurement Fusion White Noise Deconvolution Filter with Correlated Noise for Multisensor Stochastic Systems

Research Article Weighted Measurement Fusion White Noise Deconvolution Filter with Correlated Noise for Multisensor Stochastic Systems Mathematical Problems in Engineering Volume 2012, Article ID 257619, 16 pages doi:10.1155/2012/257619 Research Article Weighted Measurement Fusion White Noise Deconvolution Filter with Correlated Noise

More information

An Iteration-Domain Filter for Controlling Transient Growth in Iterative Learning Control

An Iteration-Domain Filter for Controlling Transient Growth in Iterative Learning Control 21 American Control Conference Marriott Waterfront, Baltimore, MD, USA June 3-July 2, 21 WeC14.1 An Iteration-Domain Filter for Controlling Transient Growth in Iterative Learning Control Qing Liu and Douglas

More information

THE problem of phase noise and its influence on oscillators

THE problem of phase noise and its influence on oscillators IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II: EXPRESS BRIEFS, VOL. 54, NO. 5, MAY 2007 435 Phase Diffusion Coefficient for Oscillators Perturbed by Colored Noise Fergal O Doherty and James P. Gleeson Abstract

More information

Conditions for Suboptimal Filter Stability in SLAM

Conditions for Suboptimal Filter Stability in SLAM Conditions for Suboptimal Filter Stability in SLAM Teresa Vidal-Calleja, Juan Andrade-Cetto and Alberto Sanfeliu Institut de Robòtica i Informàtica Industrial, UPC-CSIC Llorens Artigas -, Barcelona, Spain

More information

Unbiased minimum variance estimation for systems with unknown exogenous inputs

Unbiased minimum variance estimation for systems with unknown exogenous inputs Unbiased minimum variance estimation for systems with unknown exogenous inputs Mohamed Darouach, Michel Zasadzinski To cite this version: Mohamed Darouach, Michel Zasadzinski. Unbiased minimum variance

More information

A NOVEL OPTIMAL PROBABILITY DENSITY FUNCTION TRACKING FILTER DESIGN 1

A NOVEL OPTIMAL PROBABILITY DENSITY FUNCTION TRACKING FILTER DESIGN 1 A NOVEL OPTIMAL PROBABILITY DENSITY FUNCTION TRACKING FILTER DESIGN 1 Jinglin Zhou Hong Wang, Donghua Zhou Department of Automation, Tsinghua University, Beijing 100084, P. R. China Control Systems Centre,

More information

IEEE Transactions on Automatic Control, 2013, v. 58 n. 6, p

IEEE Transactions on Automatic Control, 2013, v. 58 n. 6, p Title Sufficient and Necessary LMI Conditions for Robust Stability of Rationally Time-Varying Uncertain Systems Author(s) Chesi, G Citation IEEE Transactions on Automatic Control, 2013, v. 58 n. 6, p.

More information

Simulation studies of the standard and new algorithms show that a signicant improvement in tracking

Simulation studies of the standard and new algorithms show that a signicant improvement in tracking An Extended Kalman Filter for Demodulation of Polynomial Phase Signals Peter J. Kootsookos y and Joanna M. Spanjaard z Sept. 11, 1997 Abstract This letter presents a new formulation of the extended Kalman

More information

T ulation and demodulation. It has applications not only

T ulation and demodulation. It has applications not only IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT. VOL 39. NO 6. DECEMBER 1990 847 Optimal FIR and IIR Hilbert Transformer Design Via LS and Minimax Fitting ISTVAN KOLLAR, MEMBER, IEEE, RIK PINTELON,

More information

Article (peer-reviewed)

Article (peer-reviewed) Title Author(s) Influence of noise intensity on the spectrum of an oscillator Swain, Rabi Sankar; Gleeson, James P.; Kennedy, Michael Peter Publication date 2005-11 Original citation Type of publication

More information

Statistical and Adaptive Signal Processing

Statistical and Adaptive Signal Processing r Statistical and Adaptive Signal Processing Spectral Estimation, Signal Modeling, Adaptive Filtering and Array Processing Dimitris G. Manolakis Massachusetts Institute of Technology Lincoln Laboratory

More information

Expressions for the covariance matrix of covariance data

Expressions for the covariance matrix of covariance data Expressions for the covariance matrix of covariance data Torsten Söderström Division of Systems and Control, Department of Information Technology, Uppsala University, P O Box 337, SE-7505 Uppsala, Sweden

More information

Optimum Sampling Vectors for Wiener Filter Noise Reduction

Optimum Sampling Vectors for Wiener Filter Noise Reduction 58 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 50, NO. 1, JANUARY 2002 Optimum Sampling Vectors for Wiener Filter Noise Reduction Yukihiko Yamashita, Member, IEEE Absact Sampling is a very important and

More information

ThM06-2. Coprime Factor Based Closed-Loop Model Validation Applied to a Flexible Structure

ThM06-2. Coprime Factor Based Closed-Loop Model Validation Applied to a Flexible Structure Proceedings of the 42nd IEEE Conference on Decision and Control Maui, Hawaii USA, December 2003 ThM06-2 Coprime Factor Based Closed-Loop Model Validation Applied to a Flexible Structure Marianne Crowder

More information

Optimal State Estimators for Linear Systems with Unknown Inputs

Optimal State Estimators for Linear Systems with Unknown Inputs Optimal tate Estimators for Linear ystems with Unknown Inputs hreyas undaram and Christoforos N Hadjicostis Abstract We present a method for constructing linear minimum-variance unbiased state estimators

More information

THE NOTION of passivity plays an important role in

THE NOTION of passivity plays an important role in 2394 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 46, NO. 9, SEPTEMBER 1998 Passivity Analysis and Passification for Uncertain Signal Processing Systems Lihua Xie, Senior Member, IEEE, Minyue Fu, and Huaizhong

More information

CRC for Robust and Adaptive Systems. Peter J Kootsookos. Abstract. This paper develops an adaptive controller for active vibration control.

CRC for Robust and Adaptive Systems. Peter J Kootsookos. Abstract. This paper develops an adaptive controller for active vibration control. Closed-loop Frequency Tracking and Rejection Allan J Connolly CRC for Robust and Adaptive Systems Department of Systems Engineering The Australian National University, Canberra ACT 0200 Australia Barbara

More information

Small Gain Theorems on Input-to-Output Stability

Small Gain Theorems on Input-to-Output Stability Small Gain Theorems on Input-to-Output Stability Zhong-Ping Jiang Yuan Wang. Dept. of Electrical & Computer Engineering Polytechnic University Brooklyn, NY 11201, U.S.A. zjiang@control.poly.edu Dept. of

More information

Estimation, Detection, and Identification CMU 18752

Estimation, Detection, and Identification CMU 18752 Estimation, Detection, and Identification CMU 18752 Graduate Course on the CMU/Portugal ECE PhD Program Spring 2008/2009 Instructor: Prof. Paulo Jorge Oliveira pjcro @ isr.ist.utl.pt Phone: +351 21 8418053

More information

CONTROL SYSTEMS, ROBOTICS, AND AUTOMATION - Vol. V - Prediction Error Methods - Torsten Söderström

CONTROL SYSTEMS, ROBOTICS, AND AUTOMATION - Vol. V - Prediction Error Methods - Torsten Söderström PREDICTIO ERROR METHODS Torsten Söderström Department of Systems and Control, Information Technology, Uppsala University, Uppsala, Sweden Keywords: prediction error method, optimal prediction, identifiability,

More information

On the Behavior of Information Theoretic Criteria for Model Order Selection

On the Behavior of Information Theoretic Criteria for Model Order Selection IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 49, NO. 8, AUGUST 2001 1689 On the Behavior of Information Theoretic Criteria for Model Order Selection Athanasios P. Liavas, Member, IEEE, and Phillip A. Regalia,

More information

An Invariance Property of the Generalized Likelihood Ratio Test

An Invariance Property of the Generalized Likelihood Ratio Test 352 IEEE SIGNAL PROCESSING LETTERS, VOL. 10, NO. 12, DECEMBER 2003 An Invariance Property of the Generalized Likelihood Ratio Test Steven M. Kay, Fellow, IEEE, and Joseph R. Gabriel, Member, IEEE Abstract

More information

Piecewise Linear Quadratic Optimal Control

Piecewise Linear Quadratic Optimal Control IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 45, NO. 4, APRIL 2000 629 Piecewise Linear Quadratic Optimal Control Anders Rantzer and Mikael Johansson Abstract The use of piecewise quadratic cost functions

More information

ASIGNIFICANT research effort has been devoted to the. Optimal State Estimation for Stochastic Systems: An Information Theoretic Approach

ASIGNIFICANT research effort has been devoted to the. Optimal State Estimation for Stochastic Systems: An Information Theoretic Approach IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL 42, NO 6, JUNE 1997 771 Optimal State Estimation for Stochastic Systems: An Information Theoretic Approach Xiangbo Feng, Kenneth A Loparo, Senior Member, IEEE,

More information

Robust Gain Scheduling Synchronization Method for Quadratic Chaotic Systems With Channel Time Delay Yu Liang and Horacio J.

Robust Gain Scheduling Synchronization Method for Quadratic Chaotic Systems With Channel Time Delay Yu Liang and Horacio J. 604 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I: REGULAR PAPERS, VOL. 56, NO. 3, MARCH 2009 Robust Gain Scheduling Synchronization Method for Quadratic Chaotic Systems With Channel Time Delay Yu Liang

More information

The Kalman Filter ImPr Talk

The Kalman Filter ImPr Talk The Kalman Filter ImPr Talk Ged Ridgway Centre for Medical Image Computing November, 2006 Outline What is the Kalman Filter? State Space Models Kalman Filter Overview Bayesian Updating of Estimates Kalman

More information

Title without the persistently exciting c. works must be obtained from the IEE

Title without the persistently exciting c.   works must be obtained from the IEE Title Exact convergence analysis of adapt without the persistently exciting c Author(s) Sakai, H; Yang, JM; Oka, T Citation IEEE TRANSACTIONS ON SIGNAL 55(5): 2077-2083 PROCESS Issue Date 2007-05 URL http://hdl.handle.net/2433/50544

More information

Acomplex-valued harmonic with a time-varying phase is a

Acomplex-valued harmonic with a time-varying phase is a IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 46, NO. 9, SEPTEMBER 1998 2315 Instantaneous Frequency Estimation Using the Wigner Distribution with Varying and Data-Driven Window Length Vladimir Katkovnik,

More information

Xu, S; Lam, J; Zou, Y; Lin, Z; Paszke, W. IEEE Transactions on Signal Processing, 2005, v. 53 n. 5, p

Xu, S; Lam, J; Zou, Y; Lin, Z; Paszke, W. IEEE Transactions on Signal Processing, 2005, v. 53 n. 5, p Title Robust H filtering for Uncertain2-D continuous systems Author(s) Xu, S; Lam, J; Zou, Y; Lin, Z; Paszke, W Citation IEEE Transactions on Signal Processing, 2005, v. 53 n. 5, p. 1731-1738 Issue Date

More information

Research Article Indefinite LQ Control for Discrete-Time Stochastic Systems via Semidefinite Programming

Research Article Indefinite LQ Control for Discrete-Time Stochastic Systems via Semidefinite Programming Mathematical Problems in Engineering Volume 2012, Article ID 674087, 14 pages doi:10.1155/2012/674087 Research Article Indefinite LQ Control for Discrete-Time Stochastic Systems via Semidefinite Programming

More information

ESTIMATOR STABILITY ANALYSIS IN SLAM. Teresa Vidal-Calleja, Juan Andrade-Cetto, Alberto Sanfeliu

ESTIMATOR STABILITY ANALYSIS IN SLAM. Teresa Vidal-Calleja, Juan Andrade-Cetto, Alberto Sanfeliu ESTIMATOR STABILITY ANALYSIS IN SLAM Teresa Vidal-Calleja, Juan Andrade-Cetto, Alberto Sanfeliu Institut de Robtica i Informtica Industrial, UPC-CSIC Llorens Artigas 4-6, Barcelona, 88 Spain {tvidal, cetto,

More information

Optimal Decentralized Control of Coupled Subsystems With Control Sharing

Optimal Decentralized Control of Coupled Subsystems With Control Sharing IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 58, NO. 9, SEPTEMBER 2013 2377 Optimal Decentralized Control of Coupled Subsystems With Control Sharing Aditya Mahajan, Member, IEEE Abstract Subsystems that

More information

OPTIMAL CONTROL AND ESTIMATION

OPTIMAL CONTROL AND ESTIMATION OPTIMAL CONTROL AND ESTIMATION Robert F. Stengel Department of Mechanical and Aerospace Engineering Princeton University, Princeton, New Jersey DOVER PUBLICATIONS, INC. New York CONTENTS 1. INTRODUCTION

More information

PERIODIC signals are commonly experienced in industrial

PERIODIC signals are commonly experienced in industrial IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, VOL. 15, NO. 2, MARCH 2007 369 Repetitive Learning Control of Nonlinear Continuous-Time Systems Using Quasi-Sliding Mode Xiao-Dong Li, Tommy W. S. Chow,

More information

DATA receivers for digital transmission and storage systems

DATA receivers for digital transmission and storage systems IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II: EXPRESS BRIEFS, VOL. 52, NO. 10, OCTOBER 2005 621 Effect of Loop Delay on Phase Margin of First-Order Second-Order Control Loops Jan W. M. Bergmans, Senior

More information

ADAPTIVE FILTER THEORY

ADAPTIVE FILTER THEORY ADAPTIVE FILTER THEORY Fourth Edition Simon Haykin Communications Research Laboratory McMaster University Hamilton, Ontario, Canada Front ice Hall PRENTICE HALL Upper Saddle River, New Jersey 07458 Preface

More information

IN THIS PAPER, we consider a class of continuous-time recurrent

IN THIS PAPER, we consider a class of continuous-time recurrent IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II: EXPRESS BRIEFS, VOL. 51, NO. 4, APRIL 2004 161 Global Output Convergence of a Class of Continuous-Time Recurrent Neural Networks With Time-Varying Thresholds

More information

On Identification of Cascade Systems 1

On Identification of Cascade Systems 1 On Identification of Cascade Systems 1 Bo Wahlberg Håkan Hjalmarsson Jonas Mårtensson Automatic Control and ACCESS, School of Electrical Engineering, KTH, SE-100 44 Stockholm, Sweden. (bo.wahlberg@ee.kth.se

More information

Cramér-Rao Bounds for Estimation of Linear System Noise Covariances

Cramér-Rao Bounds for Estimation of Linear System Noise Covariances Journal of Mechanical Engineering and Automation (): 6- DOI: 593/jjmea Cramér-Rao Bounds for Estimation of Linear System oise Covariances Peter Matiso * Vladimír Havlena Czech echnical University in Prague

More information

WE EXAMINE the problem of controlling a fixed linear

WE EXAMINE the problem of controlling a fixed linear 596 IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL 43, NO 5, MAY 1998 Controller Switching Based on Output Prediction Errors Judith Hocherman-Frommer, Member, IEEE, Sanjeev R Kulkarni, Senior Member, IEEE,

More information

LMI Based Model Order Reduction Considering the Minimum Phase Characteristic of the System

LMI Based Model Order Reduction Considering the Minimum Phase Characteristic of the System LMI Based Model Order Reduction Considering the Minimum Phase Characteristic of the System Gholamreza Khademi, Haniyeh Mohammadi, and Maryam Dehghani School of Electrical and Computer Engineering Shiraz

More information

New Statistical Model for the Enhancement of Noisy Speech

New Statistical Model for the Enhancement of Noisy Speech New Statistical Model for the Enhancement of Noisy Speech Electrical Engineering Department Technion - Israel Institute of Technology February 22, 27 Outline Problem Formulation and Motivation 1 Problem

More information

Modeling with Itô Stochastic Differential Equations

Modeling with Itô Stochastic Differential Equations Modeling with Itô Stochastic Differential Equations 2.4-2.6 E. Allen presentation by T. Perälä 27.0.2009 Postgraduate seminar on applied mathematics 2009 Outline Hilbert Space of Stochastic Processes (

More information

A Modified Baum Welch Algorithm for Hidden Markov Models with Multiple Observation Spaces

A Modified Baum Welch Algorithm for Hidden Markov Models with Multiple Observation Spaces IEEE TRANSACTIONS ON SPEECH AND AUDIO PROCESSING, VOL. 9, NO. 4, MAY 2001 411 A Modified Baum Welch Algorithm for Hidden Markov Models with Multiple Observation Spaces Paul M. Baggenstoss, Member, IEEE

More information

RECENT advances in technology have led to increased activity

RECENT advances in technology have led to increased activity IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL 49, NO 9, SEPTEMBER 2004 1549 Stochastic Linear Control Over a Communication Channel Sekhar Tatikonda, Member, IEEE, Anant Sahai, Member, IEEE, and Sanjoy Mitter,

More information

A Log-Frequency Approach to the Identification of the Wiener-Hammerstein Model

A Log-Frequency Approach to the Identification of the Wiener-Hammerstein Model A Log-Frequency Approach to the Identification of the Wiener-Hammerstein Model The MIT Faculty has made this article openly available Please share how this access benefits you Your story matters Citation

More information

Gaussian Estimation under Attack Uncertainty

Gaussian Estimation under Attack Uncertainty Gaussian Estimation under Attack Uncertainty Tara Javidi Yonatan Kaspi Himanshu Tyagi Abstract We consider the estimation of a standard Gaussian random variable under an observation attack where an adversary

More information

Performance Bounds for Polynomial Phase Parameter Estimation with Nonuniform and Random Sampling Schemes

Performance Bounds for Polynomial Phase Parameter Estimation with Nonuniform and Random Sampling Schemes IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 48, NO. 2, FEBRUARY 2000 331 Performance Bounds for Polynomial Phase Parameter Estimation with Nonuniform Rom Sampling Schemes Jonathan A. Legg, Member, IEEE,

More information

Modifying Voice Activity Detection in Low SNR by correction factors

Modifying Voice Activity Detection in Low SNR by correction factors Modifying Voice Activity Detection in Low SNR by correction factors H. Farsi, M. A. Mozaffarian, H.Rahmani Department of Electrical Engineering University of Birjand P.O. Box: +98-9775-376 IRAN hfarsi@birjand.ac.ir

More information

Filtering for Linear Systems with Error Variance Constraints

Filtering for Linear Systems with Error Variance Constraints IEEE RANSACIONS ON SIGNAL PROCESSING, VOL. 48, NO. 8, AUGUS 2000 2463 application of the one-step extrapolation procedure of [3], it is found that the existence of signal z(t) is not valid in the space

More information

On Design of Reduced-Order H Filters for Discrete-Time Systems from Incomplete Measurements

On Design of Reduced-Order H Filters for Discrete-Time Systems from Incomplete Measurements Proceedings of the 47th IEEE Conference on Decision and Control Cancun, Mexico, Dec. 9-11, 2008 On Design of Reduced-Order H Filters for Discrete-Time Systems from Incomplete Measurements Shaosheng Zhou

More information

New Recursive-Least-Squares Algorithms for Nonlinear Active Control of Sound and Vibration Using Neural Networks

New Recursive-Least-Squares Algorithms for Nonlinear Active Control of Sound and Vibration Using Neural Networks IEEE TRANSACTIONS ON NEURAL NETWORKS, VOL. 12, NO. 1, JANUARY 2001 135 New Recursive-Least-Squares Algorithms for Nonlinear Active Control of Sound and Vibration Using Neural Networks Martin Bouchard,

More information

Volume 30, Issue 3. A note on Kalman filter approach to solution of rational expectations models

Volume 30, Issue 3. A note on Kalman filter approach to solution of rational expectations models Volume 30, Issue 3 A note on Kalman filter approach to solution of rational expectations models Marco Maria Sorge BGSE, University of Bonn Abstract In this note, a class of nonlinear dynamic models under

More information

Properties of Zero-Free Spectral Matrices Brian D. O. Anderson, Life Fellow, IEEE, and Manfred Deistler, Fellow, IEEE

Properties of Zero-Free Spectral Matrices Brian D. O. Anderson, Life Fellow, IEEE, and Manfred Deistler, Fellow, IEEE IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL 54, NO 10, OCTOBER 2009 2365 Properties of Zero-Free Spectral Matrices Brian D O Anderson, Life Fellow, IEEE, and Manfred Deistler, Fellow, IEEE Abstract In

More information

ADAPTIVE signal processing algorithms (ASPA s) are

ADAPTIVE signal processing algorithms (ASPA s) are IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 46, NO. 12, DECEMBER 1998 3315 Locally Optimum Adaptive Signal Processing Algorithms George V. Moustakides Abstract We propose a new analytic method for comparing

More information

Chapter 2 Wiener Filtering

Chapter 2 Wiener Filtering Chapter 2 Wiener Filtering Abstract Before moving to the actual adaptive filtering problem, we need to solve the optimum linear filtering problem (particularly, in the mean-square-error sense). We start

More information

2262 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 47, NO. 8, AUGUST A General Class of Nonlinear Normalized Adaptive Filtering Algorithms

2262 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 47, NO. 8, AUGUST A General Class of Nonlinear Normalized Adaptive Filtering Algorithms 2262 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 47, NO. 8, AUGUST 1999 A General Class of Nonlinear Normalized Adaptive Filtering Algorithms Sudhakar Kalluri, Member, IEEE, and Gonzalo R. Arce, Senior

More information

Adaptive and Robust Controls of Uncertain Systems With Nonlinear Parameterization

Adaptive and Robust Controls of Uncertain Systems With Nonlinear Parameterization IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 48, NO. 0, OCTOBER 003 87 Adaptive and Robust Controls of Uncertain Systems With Nonlinear Parameterization Zhihua Qu Abstract Two classes of partially known

More information

IN the multiagent systems literature, the consensus problem,

IN the multiagent systems literature, the consensus problem, IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II: EXPRESS BRIEFS, VOL. 63, NO. 7, JULY 206 663 Periodic Behaviors for Discrete-Time Second-Order Multiagent Systems With Input Saturation Constraints Tao Yang,

More information

DURING THE last two decades, many authors have

DURING THE last two decades, many authors have 614 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I: FUNDAMENTAL THEORY AND APPLICATIONS, VOL 44, NO 7, JULY 1997 Stability the Lyapunov Equation for -Dimensional Digital Systems Chengshan Xiao, David J Hill,

More information

RECURSIVE ESTIMATION AND KALMAN FILTERING

RECURSIVE ESTIMATION AND KALMAN FILTERING Chapter 3 RECURSIVE ESTIMATION AND KALMAN FILTERING 3. The Discrete Time Kalman Filter Consider the following estimation problem. Given the stochastic system with x k+ = Ax k + Gw k (3.) y k = Cx k + Hv

More information

Minimax MMSE Estimator for Sparse System

Minimax MMSE Estimator for Sparse System Proceedings of the World Congress on Engineering and Computer Science 22 Vol I WCE 22, October 24-26, 22, San Francisco, USA Minimax MMSE Estimator for Sparse System Hongqing Liu, Mandar Chitre Abstract

More information

Prediction-based adaptive control of a class of discrete-time nonlinear systems with nonlinear growth rate

Prediction-based adaptive control of a class of discrete-time nonlinear systems with nonlinear growth rate www.scichina.com info.scichina.com www.springerlin.com Prediction-based adaptive control of a class of discrete-time nonlinear systems with nonlinear growth rate WEI Chen & CHEN ZongJi School of Automation

More information

New Introduction to Multiple Time Series Analysis

New Introduction to Multiple Time Series Analysis Helmut Lütkepohl New Introduction to Multiple Time Series Analysis With 49 Figures and 36 Tables Springer Contents 1 Introduction 1 1.1 Objectives of Analyzing Multiple Time Series 1 1.2 Some Basics 2

More information

798 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II: ANALOG AND DIGITAL SIGNAL PROCESSING, VOL. 44, NO. 10, OCTOBER 1997

798 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II: ANALOG AND DIGITAL SIGNAL PROCESSING, VOL. 44, NO. 10, OCTOBER 1997 798 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II: ANALOG AND DIGITAL SIGNAL PROCESSING, VOL 44, NO 10, OCTOBER 1997 Stochastic Analysis of the Modulator Differential Pulse Code Modulator Rajesh Sharma,

More information

Mathematical Theory of Control Systems Design

Mathematical Theory of Control Systems Design Mathematical Theory of Control Systems Design by V. N. Afarias'ev, V. B. Kolmanovskii and V. R. Nosov Moscow University of Electronics and Mathematics, Moscow, Russia KLUWER ACADEMIC PUBLISHERS DORDRECHT

More information

Robust Variance Constrained Filter Design for Systems with Non-Gaussian Noises

Robust Variance Constrained Filter Design for Systems with Non-Gaussian Noises Robust Variance Constrained Filter Design for Systems with Non-Gaussian Noises Fuwen Yang, Yongmin Li, and Xiaohui Liu Abstract- In this paper, a variance constrained filtering problem is considered for

More information

Algorithm for Multiple Model Adaptive Control Based on Input-Output Plant Model

Algorithm for Multiple Model Adaptive Control Based on Input-Output Plant Model BULGARIAN ACADEMY OF SCIENCES CYBERNEICS AND INFORMAION ECHNOLOGIES Volume No Sofia Algorithm for Multiple Model Adaptive Control Based on Input-Output Plant Model sonyo Slavov Department of Automatics

More information

MULTIPLE-CHANNEL DETECTION IN ACTIVE SENSING. Kaitlyn Beaudet and Douglas Cochran

MULTIPLE-CHANNEL DETECTION IN ACTIVE SENSING. Kaitlyn Beaudet and Douglas Cochran MULTIPLE-CHANNEL DETECTION IN ACTIVE SENSING Kaitlyn Beaudet and Douglas Cochran School of Electrical, Computer and Energy Engineering Arizona State University, Tempe AZ 85287-576 USA ABSTRACT The problem

More information