Application of Unscented Transformation for Nonlinear State Smoothing

Size: px
Start display at page:

Download "Application of Unscented Transformation for Nonlinear State Smoothing"

Transcription

1 Application of Unscented Transformation for Nonlinear State Smoothing WANG Xiao-Xu 1 PAN Quan 1 LIANG Yan 1 ZHAO Chun-Hui 1 Abstract Motivated by the well-known fact that the state estimate of a smoother is more accurate than that of the corresponding filter, this paper is concerned with the state smoothing problem for a class of nonlinear stochastic discrete systems. Firstly, a novel type of optimal smoother, which provides a unified theoretical framework for the solution of state smoothing problem no matter that system is linear or nonlinear, is derived on the basis of minimum mean squared error (MMSE) estimation theory. Further, in the case that the dynamic model and measurement functions are all nonlinear, a new suboptimal smoother is developed by applying the unscented transformation for approximately computing the smoothing gain in the optimal smoothing framework. Finally, the superior performance of the proposed smoother to the existing extended Kalman smoother (EKS) is demonstrated through a simulation example. Key words Nonlinear, optimal smothering framework, minimum mean squared error (MMSE), unscented transformation, extended Kalman smoother (EKS) Citation Wang Xiao-Xu, Pan Quan, Liang Yan, Zhao Chun-Hui. Application of unscented transformation for nonlinear state smoothing. Acta Automatica Sinica, 2012, 38(7): DOI /S (11)60284-X Discrete-time filtering for nonlinear dynamic system is an important research area and has attracted considerable interest. Recently, a kind of optimal Gaussian recursive filter for nonlinear systems has been developed in 1] to achieve the whole posterior description (mean and covariance) of nonlinear state, which provided a unified theoretical framework for solving nonlinear filtering problem. However, such a complete description calls for infinite parameters and complex calculation, which results in that this optimal Gaussian filter is hard to be applied in practice. So, a large number of suboptimal schemes 2 4] to approximate the posterior distribution of nonlinear state are developed. As is well-known, the most widely used filter for nonlinear estimation problem is the extended Kalman filter (EKF) 2]. It is derived from Kalman filter based on the successive linearization of the nonlinear state-space model. Recently, a novel nonlinear filtering algorithm named unscented Kalman filter (UKF) 5] is proposed as an improvement to EKF. It utilizes the unscented transformation (UT) technique to approximate the posterior mean and covariance of the nonlinear state with a second order accuracy, while EKF uses the linearization technique to achieve only first order accuracy. Moreover, unlike EKF, UKF does not ask for computing Jacobian matrices of the nonlinear functions, hence it is easier in implementation than EKF. Under the multi-dimensional Taylor series, Julier et al. 6] gave the theoretical analysis of performance about UKF, e.g., the approximation of the mean and the covariance and the general rule of selecting sigma points. van der Merwe et al. 7] designed the square-root unscented Kalman filter (SR-UKF) to strengthen the filtering numerical stability. Cho et al. 8], through introducing the interacting multiple model algorithm 9] to the aided design of the sigma points Kalman filters, presented an adaptive IIR/FIR fusion filter, which showed robustness against model uncertainty, temporary disturbing noise, large initial estimation error, Manuscript received January 20, 2011; accepted January 10, 2012 Supported by National Natural Science Foundation of China ( , , , ) and the Postdoctoral Science Foundation of China ( ) Recommended by Associate Editor FANG Hai-Tao 1. Institute of Control and Information, School of Automation, Northwestern Polytechnical University, Xi an , P. R. China etc, compared with the standard UKF. Simandl et al. 10] derived the new relations among the Stirling sinterpolation and the unscented transformation, whose impact on the covariance of the state estimation was analyzed. Xiong et al. 11] showed that the design of noise covariance matrix played an important role in improving the stability of the UKF and proved that under certain condition of appropriate choice of the extra positive matrix, the estimation error of the UKF remained bounded without the requirement of small initial estimation error. Leven et al. 12] applied the UKF for multiple target tracking with symmetric measurement equations, and showed that the UKF algorithm had better performance and was simpler in implementation than the previous EKF. Hermoso-Carazo et al. 13] considered the filtering problem for a class of nonlinear discrete-time systems using measurements which can be randomly delayed by two sampling time; in this situation, a generalization of EKF and UKF algorithms based on twostep randomly delayed measurements has been proposed and a comparison made between the two filters. Bruno et al. 14] developed constrained unscented filtering algorithms to address the nonlinear state estimation problem in the case that prior knowledge is available in the form of interval constraints on the states. The similar problem was investigated in 15]. Saleh et al. 16] presented a modification on delay estimation and tracking using the unscented filter for an asynchronous CDMA system, and the simulation results showed that the modified UKF tracks the delay variations with less errors than the standard UKF. Meanwhile, in addition to target tracking 12, 17 18], UKF has also widespread applications including navigation 19 21], chemical process 22], communication 23], signal processing 24] and so on. Despite UKF and its improved algorithms 13 17] have been proved to be superior in different areas 18 24],itis necessary to emphasize that the unscented transformation is only applied for dealing with the state filtering problem of nonlinear systems while there are scarcely attempts made for using UT to solve the nonlinear state smoothing problem. In addition, up to the present, the solution for nonlinear state smoothing issue is seldom reported publicly. Furthermore, smoother can obtain better estimation

2 1108 ACTA AUTOMATICA SINICA Vol. 38 precision than filter, because smoother which is based on the measured data from step k = 0 to future can use more measurement information than filter which is only from k = 0 to present. Therefore, there is an urgent need to carry on this theoretical and practical research and to design a new nonlinear state smoother. The goal of this paper is the derivation of the nonlinear state smoother based on UT. Firstly, the minimum mean squared error (MMSE) estimation theory is introduced. Secondly, the optimal smoother for a class of discrete stochastic dynamic systems described by density functions on the basis of MMSE estimation is derived. Thirdly, we consider a general nonlinear stochastic discrete system and obtain nonlinear suboptimal smoother based on UT. Finally, the performance of the new smoother through a simulation example is demonstrated. 1 Problem formulation Consider state-space model of discrete stochastic dynamic system as the following two density functions: xk p(x k x k 1 ) (1) y k p(y k x k ) where x k R n and y k R m are the state and observation vectors at time k, respectively, p(x k x k 1 ) is the transition probability density function of the dynamic model, p(y k x k ) is the likelihood probability density function of the measurements. The purpose is to find the approximation to the smoothing distributions p(x k y 1:T ) for all k 0, 1,,T} based on the MMSE estimation and the measurements sequence y 1:T = y 1,y 2,,y k,,y T }, the smoothing distributions at time steps k and k + 1 are all assumed to be Gaussian, i.e. p(x k y 1:T )=N(m s k,pk s ) (2) p(x k+1 y 1:T )=N(m s k+1,p s k+1) (3) where the mean m s k+1 and the covariance P s k+1 are known. 2 Optimal smoother 2.1 MMSE estimation For deriving the optimal smoother for the state model (1), some standard results about the MMSE estimation 25] are recalled. Lemma 1. Assume that x and z are random vector variables with the second order moment, so the linear MMSE estimation of x based on z, which is marked as ˆx = Ê(x z), has the following form: ˆx = Ê(x z) =E(x)+cov(x, z)var(z)] 1 z E(z)] (4) where var(z) =Ez E(z)]z E(z)] T }, E denotes the mean. Lemma 2. Assume that x, y, andz are random variables with the second order moment, if A and B are nonrandom matrices, then Ê(Ax + By) z] =AÊ(x z)+bê(y z) (5) Lemma 3. Assume that x, z a,andz b are random variables with the second order moment, if z can be expressed as a set containing z a and z b, i.e., z = z a,z b }, then Ê(x z) =Ê(x za)+ê( x z b)= 1 Ê(x z a)+e x z b T ] E( z b z b )] T zb (6) where x = x Ê(x za), z b = z b Ê(z b z) (7) It has been proved that if the conditional distribution of x based on z is assumed to be Gaussian, the linear MMSE estimator of x based on z is equivalent to the conditional mean 26 27], i.e. ˆx = Ê(x z) =E(x z) = xp(x z)dx (8) 2.2 Optimal smoother based on the linear MMSE estimation It has been shown in (2) and (3) that the smoothing distributions are assumed to be Gaussian, then under the condition of Gaussian distributions, on the basis of equivalence between the linear MMSE estimator and the conditional mean, we can obtain m s k =E(x k y 1:T )=Ê(x k y 1:T ) Pk s =E m s k( m s k) T] =E (x k m s k)(x k m s k) T] = (x k m s k)(x k m s k) T p(x k y 1:T )dx k (9) m s k+1 =E(x k+1 y 1:T )=Ê(x k+1 y 1:T ) Pk+1 s =E m s k+1( m s k+1) T] = E (x k+1 m s k+1)(x k+1 m s k+1) T] = (x k+1 m s k+1)(x k+1 m s k+1) T p(x k+1 y 1:T )dx k+1 (10) where m s k+1 and P s k+1 are known while m s k and P s k are unknown, the goal of this paper is to derive the expression of m s k and P s k on the conditions of the known m s k+1 and P s k+1. In addition, assume that the filtering and prediction distributions are also Gaussian, i.e. p(x k y 1:k )=N(m k,p k ) (11) p(x k+1 y 1:k )=N(m k+1,p k+1) (12) Further, the joint distribution of x k and x k+1 can be written as (( ) ) (( ) ( )) xk mk Pk C k+1 p y x 1:k N k+1 m, k+1 Ck+1 T P k+1 (13) Therefore m k =E(x k y 1:k )=Ê(x k y 1:k ) P k =E m k ( m k ) T] =E (x k m k )(x k m k ) T] = (x k m k )(x k m k ) T p(x k y 1:k )dx k (14) m k+1 =E(x k+1 y 1:k )=Ê(x k+1 y 1:k ) P k+1 =E m k+1( m k+1) T] = E (x k+1 m k+1)(x k+1 m k+1) T] = (x k+1 m k+1)(x k+1 m k+1) T p(x k+1 y 1:k )dx k+1 (15)

3 No. 7 WANG Xiao-Xu et al.: Application of Unscented Transformation for Nonlinear State Smoothing 1109 C k+1 =E m k ( m k+1) T] = Obviously, on the basis of (19), it can be noticed that E (x k m k )(x k+1 m k+1) T] = E(x k x k+1,y 1:k )= x k p(x k x k+1,y 1:k )dx k = (x k m k )(x k+1 m k+1) T p(x k,x k+1 y 1:k )dx k dx k+1 (16) x k p(x k x k+1,y 1:T )dx k =E(x k x k+1,y 1:T ) Then, subtracting (17) from (21) gives (22) The derivation of optimal smoother for the state model (1) is shown as follows. m s k = m k + D k+1 (m s k+1 m k+1) (23) Step 1. Considering Gaussian properties in (2), (3), and Step 2. The following is the derivation of Pk s. From (13), on the basis of Lemma 3 and (8), it can be obtained (23), we have that m s k = x k m s k = x k m k D k+1 (m s k+1 m k+1) = E(x k x k+1,y 1:k )= x k p(x k x k+1,y 1:k )dx k = m k D k+1 m k+1 + D k+1 m s k+1 (24) Ê(x k x k+1,y 1:k )=Ê(x k y 1:k )+Ê( m k m k+1) = m k +E m k ( m k+1) T] E m k+1( m k+1) T]} 1 m k+1 = m k + C k+1 Pk+1] 1 (x k+1 m k+1) = m k + D k+1 (x k+1 m k+1) (17) E(x k x k+1,y 1:T )= x k p(x k x k+1,y 1:T )dx k = Ê(x k x k+1,y 1:T )=Ê(x k y 1:T )+Ê( ms k m s k+1) = m s k +E m s k( m s k+1) T] E m s k+1( m s k+1) T]} 1 m s k+1 = m s k +E m s k( m s k+1) T] Pk+1] s 1 (x k+1 m s k+1) (18) The following is the derivation of E m s k( m s k+1) T]. Due to the Markov properties 28] of the state-space model described by (1), we have p(x k x k+1,y 1:T )=p(x k x k+1,y 1:k ) (19) Using (19) and (17) yields E m s k( m s k+1) T] = m s k( m s k+1) T p(x k,x k+1 y 1:T )dx k dx k+1 = m s k( m s k+1) T p(x k x k+1,y 1:T )p(x k+1 y 1:T )dx k dx k+1 = ] m s kp(x k x k+1,y 1:T )dx k ( m s k+1) T p(x k+1 y 1:T )dx k+1 = E(x k x k+1,y 1:k ) m s k]( m s k+1) T p(x k+1 y 1:T )dx k+1 = mk m s k + D k+1 (m s k+1 m k+1)+d k+1 m s k+1] ( m s k+1) T p(x k+1 y 1:T )dx k+1 = D k+1 m s k+1( m s k+1) T p(x k+1 y 1:T )dx k+1 = D k+1 P s k+1 (20) Substituting (20) into (18), the equation becomes E(x k x k+1,y 1:T )=m s k + D k+1 (x k+1 m s k+1) (21) E m s k( m s k+1) T] = E ( m k D k+1 m k+1 + D k+1 m s k+1)( m s k+1) T] = E ( m k D k+1 m k+1)( m s k+1) T] + D k+1 Pk+1 s (25) According to (20) and (25), it can be derived that the first item of the right-hand side in (25) is zero, i.e. E ( m k D k+1 m k+1)( m s k+1) T] = 0 (26) On the basis of (26) and (24), the smoothing covariance matrix Pk s is computed as follows: Pk s =E m s k( m s k) T] = E ( m k D k+1 m k+1 + D k+1 m s k+1) ( m k D k+1 m k+1 + D k+1 m s k+1) T] = E ( m k D k+1 m k+1)( m k D k+1 m k+1) T] + D k+1 E m s k+1( m s k+1) T] Dk+1 T = P k + D k+1 P s k+1 P k+1]d T k+1 (27) From (23) and (27), we can conclude that the optimal smoother can be written as D k+1 = C k+1 P k+1] 1 (28) m s k = m k + D k+1 m s k+1 m k+1] (29) P s k = P k + D k+1 P s k+1 P k+1]d T k+1 (30) where D k (k>0) is the smoothing gain. It is not difficult to find that (29) and (30) give a unified theoretical framework for state smoothing, no matter the system (1) is linear or nonlinear. When the system (1) is linear, the smoothing gain D k can be computed accurately by linear transformation, and the well known smoother for linear system is Kalman smoother 29]. When the system (1) is nonlinear, its smoothing recursive formula will be discussed in the next section. 3 Nonlinear suboptimal smoother based on unscented transformation In this section, we shall consider the general nonlinear stochastic discrete-time system model: xk = f k 1 (x k 1 )+w k 1 y k = h k (x k )+v k (31)

4 1110 ACTA AUTOMATICA SINICA Vol. 38 where x k R n is the state vector, y k R m is the measurement vector, f k 1 ( ) is the dynamic model function, h k ( ) is the measurement function, the process noise w k N(q k,q k ) and the measurement noise v k N(r k,r k ) are uncorrelated Gaussian white noises respectively. Obviously, the model (31) is a special case of the model (1). With respect to the system model (31), if f k 1 ( ) and h k ( ) are both linear functions, D k is accurately computed by simple linear transformation. However, when f k 1 ( ) and h k ( ) are both nonlinear functions, obtaining a precise value of D k is very hard in most cases. This is because that if we want to obtain the accurate solution of D k,it has to achieve the whole posterior probability description of nonlinear state. But this whole description needs to calculate the complex multi-dimensional integral of the nonlinear function 1], which calls for infinite parameters and large calculation, so it is almost impossible to get the analytical solution of D k in most cases. For the above reasons, D k has to be calculated approximately through some suboptimal methods, for example the linearization of f k 1 ( ) and h k ( ), which yields extended Kalman smoother (EKS) 29], and the unscented transformation 3] which yields nonlinear suboptimal smoother based on UT, etc. The specific steps of the nonlinear suboptimal smoother based on the UT are given as follows. Step 1. Initialization At time step 0, there is no measurement, except the prior distribution x 0 N(m 0,P 0). Step 2. Sigma points calculation and propagation The n-dimensional random vector x k with the mean m k and the covariance P k is approximated by sigma points selected by using the following equations: ξ 0,k = m k, W 0 = κ n + κ ( ) 1 ξ i,k = m k + (n + κ)pk, W i = i 2(n + κ) ( ) 1 ξ i+n,k = m k (n + κ)pk, W i+n = i 2(n + κ) ( (32) (n ) where i =1, 2,,n, + κ)pk denotes the i-th column of the square-root of the matrix (n + κ)p k, κ is the scaling parameter which is usually set as κ =3 n for the Gaussian distribution, W i} is a set of scalar weights. Then, propagate the sigma points through the dynamic model function γ i,k+1 k = f k (ξ i,k )+q k, i =0, 1, 2,, 2n (33) Step 3. Computing the smoothing gain D k Firstly, the predicted mean m k+1, the predicted covariance P k+1, and the cross-covariance C k+1 can be computed as follows: m k+1 = P k+1 = C k+1 = W iγ i,k+1 k + q k = i W if k (ξ i,k )+q k (34) W i γ i,k+1 k m k+1]γ i,k+1 k m k+1] T} + Q k (35) W i ξ i,k m k ]γ i,k+1 k m k+1] T} (36) Then, the smoothing gain D k can be computed through (28). Substituting D k into (29) and (30) can obtain the nonlinear state smoother based on UT. The aforementioned procedure is a recursion, which can be used for computing the smoothing distribution of step k from the smoothing distribution of time step k+1. Because the smoothing distribution and filtering distribution of the last time step T are the same, we have m s T = m T and PT s = P T, and thus, the recursion can be used for computing the smoothing distributions of all time steps by starting from the last step k = T and proceeding backwards to the initial step k =0. In addition, for implementing the smoother (29) and (30), the approximate mean m k and the covariance P k of the filtering distribution in (14), as well as m k+1 and P k+1 of the predictive distribution in (15) must be known. For the model (31). m k, P k, m k+1,andp k+1 are assumed to have been computed by the standard UKF 3]. 4 Simulation analysis Consider a numerical example described as follows: x k+1 = x 1,k+1 x 2,k+1 = x 3,k+1 3sin(2x 2,k ) x 1,k +e 0.05x 3,k w k 0.2x 1,k (x 2,k + x 3,k ) 1 y k = x 1,k + x 2,k x 3,k + v k (37) where the process noise w k and the measurement noise v k are independent of each other and all Gaussian white noises have the following statistics: wk N(0.3, 0.7) v k N(0.5, 1.0) (38) The initial state x 0 is taken to be a Gaussian random variable, which has the following mean and variance: ˆx 0 = ] T P 0 = I (39) We select κ = 0.0 and time step k = 50 for filtering and smoothing estimation. Firstly, we use the standard EKF and UKF to estimate the state x 1 in (37) for the purpose of comparing with the existing EKS and the proposed nonlinear state smoother based on UT. The corresponding simulation results are given in Figs. 1 and 2, respectively. Moreover, the root mean square error (RMSE) curves of the estimated results using EKF and UKF are given in Fig. 3. As it can be seen from Figs. 1 3, despite the estimation of state x 1 with UKF and EKF fails to track the theoretical value, UKF is still superior to EKF in estimation precision, which can be proved by the fact that the estimation and the corresponding RMSE of UKF are bounded while those of EKF are divergent. This is because the unscented transformation for UKF can approximate the posterior mean and covariance of the nonlinear state with a second order accuracy; on contrary, the linearization technique applied for EKF can only achieve first order accuracy.

5 No. 7 WANG Xiao-Xu et al.: Application of Unscented Transformation for Nonlinear State Smoothing 1111 Fig. 1 Estimation of the state in UKF and nonlinear smoother basedonut Fig. 2 Fig. 3 Estimation of the state in EKF and EKS RMSE of the state in UKF and EKF Secondly, in order to improve estimation precision of the state x 1, EKS and the proposed nonlinear smoother based on UT in Section 3 are applied to estimating x 1. With a duplicate choice of κ =0.0 andk = 50, the estimation results of the state x 1 smoothed by using EKS and the proposed nonlinear smoother based on UT are shown in Figs. 1 and 2, respectively. Moreover, Fig. 4 gives the RMSE estimation of the state in UKF, EKS, and nonlinear smoother based on UT. Fig. 4 RMSE of the state in UKF, EKS, and nonlinear smoother based on UT In Figs. 1 and 2, the smoothing results follow the theoretical curve of the state x 1 while EKF and UKF are failures. Accordingly, it is obviously seen from Fig. 4 that despite the RMSE curves in three algorithms are all bounded and convergent, the steady errors of EKS and nonlinear smoother based on UT are all far less than that of UKF, which implies that they outperform UKF in precision of estimation. In addition, the steady RMSE of the proposed smoother is close to zero and less than that of EKS, because UT has at least the second order accuracy in capturing the posterior mean and covariance of the nonlinear state while the linearization applied for EKS can only achieve firstorder accuracy. This indicates that the proposed nonlinear smoother in the paper is feasible and effective in dealing with nonlinear state smoothing issue and has higher estimation accuracy than EKS and UKF. 5 Conclusion In this paper, the unified optimal framework for description of the linear or nonlinear state smoothers is derived according to the MMSE estimation theory. The proposed framework is only formal in the sense that it rarely can be directly used in practice since the model nonlinearity results in the intractability and infeasibility of analytically computing the smoothing gain. A novel type of suboptimal nonlinear state smoother is developed through applying the unscented transformation to compute approximately the smoothing gain appearing in the proposed optimal smoothing framework. The performance of the developed nonlinear smoother is demonstrated by a numerical example, and the simulation results show that its estimation accuracy is superior to that of the standard UKF and EKS. References 1 Ito K, Xiong K Q. Gaussian filters for nonlinear filtering problems. IEEE Transactions on Automatic Control, 2000, 45(5): Sorenson H W. Kalman Filtering: Theory and Application. New York: IEEE Press, Julier S, Uhlmann J, Durrant-Whyte H F. A new method for the nonlinear transformation of means and covariances in filters and estimators. IEEE Transactions on Automatic Control, 2000, 45(3): Nørgarrd M, Poulsen N K, Ravn O. New developments in state estimation for nonlinear systems. Automatica, 2000, 36(11): Julier S J, Uhlmann J K, Durrant-Whyte H F. A new approach for filtering nonlinear systems. In: Proceedings of American Control Conference. Soallle, Wuhlnglon, USA: IEEE, Julier S, Uhlmann Jeffrey K. A General Method for Approximating Nonlinear Transformations of Probability Distributions. Technical Report OX1 PJ, Robotics Research Group, Department of Engineering Science, University of Oxford, UK, van der Merwe R, Wan Eric A, Julier S J. Sigma-point Kalman filters for nonlinear estimation and sensor fusion: applications to integrated navigation. In: Proceedings of the AIAA Guidance Navigation and Control Conference. Providence, RI, USA: AIAA, Cho S Y, Kim B D. Adaptive IIR/FIR fusion filter and its application to the INS/GPS integrated system. Automatica, 2008, 44(8): Blom H A P, Bar-Shalom Y. The interacting multiple model algorithm for systems with Markovian switching coefficients. IEEE Transactions on Automatic Control, 1988, 33(8): Šimandl M, Duník J. Derivative-free estimation methods: new results and performance analysis. Automatica, 2009, 45(7): Xiong K, Zhang H Y, Chan C W. Performance evaluation of UKF-based nonlinear filtering. Automatica, 2006, 42(2):

6 1112 ACTA AUTOMATICA SINICA Vol Leven W E, Lanterman A D. Unscented Kalman filters for multiple target tracking with symmetric measurement equations. IEEE Transactions on Automatic Control, 2009, 54(2): Hermoso-Carazo A, Linares-Pérez J. Unscented filtering algorithm using two-step randomly delayed observations in nonlinear systems. Applied Mathematical Modelling, 2009, 33(9): Bruno O S T, Tôrres L A B, Aguirre L A A, Bernstein D S. On unscented Kalman filtering with state interval constraints. Journal of Process Control, 2010, 20(1): Kolås S, Fossa B A, Schei T S. Constrained nonlinear state estimation based on the UKF approach. Computers and Chemical Engineering, 2009, 33(8): Saleh O A, Mclernon D, Caffery J, Smadi M, Ghaeb J. A modified unscented filter for delay tracking in asynchronous CDMA systems. International Journal of Electronics and Communications, 2011, 65(1): Petsios M N, Alivizatos E G, Uzunoglu N K. Solving the association problem for a multistatic range-only radar target tracker. Signal Processing, 2008, 88(9): Katkuri J R, Jilkov V P, Li X R. A comparative study of nonlinear filters for target tracking in mixed coordinates. In: Proceedings of the 42nd Southeastern Symposium on System Theory. Tyler, USA: IEEE, Tang X J, Yan J, Zhong D D. Square-root sigma-point Kalman filtering for spacecraft relative navigation. Acta Astronautica, 2010, 66(5 6): Soken H E, Hajiyev C. Pico satellite attitude estimation via robust unscented Kalman filter in the presence of measurement faults. ISA Transactions, 2010, 49(3): Schopp P, Klingbeil L, Peters C, Manoli Y. Design, geometry evaluation, and calibration of a gyroscope-free inertial measurement unit. Sensors and Actuators, A: Physical, 2010, 162(2): Murshed A M, Huang B, Nandakumar K. Estimation and control of solid oxide fuel cell system. Computers and Chemical Engineering, 2010, 34(1): Kim J S, Shin D R, Serpedin E. Adaptive multiuser receiver with joint channel and time delay estimation of CDMA signals based on the square-root unscented filter. Digital Signal Processing, 2009, 19(3): van der Merwe R. Sigma-Point Kalman filters for probabilistic inference in dynamic state-space models Online]. available: January 15, Maybeck P S. Stochastic Models, Estimation and Control (Second edition). New York: Academic Press, Kalman R E. A new approach to linear filtering and prediction problems. Transactions of the ASME-Journal of Basic Engineering, 1960, 82(1): Kalman R E, Bucy R S. New results in linear filtering and prediction theory. Journal of Basic Engineering, 1961, 83(1): Fraser D C, Potter J E. The optimum linear smoother as a combination of two optimum linear filters. IEEE Transactions on Automatic Control, 1969, 14(4): Anderson B D O, Moore J B. Optimal Filtering. New South Wales: Prentice Hall, 1979 WANG Xiao-Xu Postdoctor at Northwestern Polytechnical University. He received his bachelor, master, and Ph. D. degrees from Harbin Engineering University in 2004, 2007, and 2010, respectively. His research interest covers state estimation, information fusion, inertial navigation, and integrated navigation. xuenvshen1982@163.com PAN Quan Professor at the School of Automation, Northwestern Polytechnical University. He received his bachelor degree from Huazhong Institute of Technology in 1982, and his master and Ph. D. degrees from Northwestern Polytechnical University in 1991 and 1997, respectively. His research interest covers information fusion, target tracking, hybrid system estimation theory, multi-scale estimation theory, and image processing. Corresponding author of this paper. quanpan@nwpu.edu.cn LIANG Yan Professor at the School of Automation, Northwestern Polytechnical University. He received his bachelor, master, and Ph. D. degrees from Northwestern Polytechnical University in 1993, 1998, and 2001, respectively. His research interest covers state estimation, information fusion, and target tracking. liangyan@nwpu.edu.cn ZHAO Chun-Hui Associated professor at the School of Automation, Northwestern Polytechnical University. He received his master and Ph. D. degrees from Polytechnical in 2003 and 2008, respectively. His research interest covers image processing and pattern recognition. zhaochunhui@nwpu.edu.cn

Introduction to Unscented Kalman Filter

Introduction to Unscented Kalman Filter Introduction to Unscented Kalman Filter 1 Introdution In many scientific fields, we use certain models to describe the dynamics of system, such as mobile robot, vision tracking and so on. The word dynamics

More information

Prediction of ESTSP Competition Time Series by Unscented Kalman Filter and RTS Smoother

Prediction of ESTSP Competition Time Series by Unscented Kalman Filter and RTS Smoother Prediction of ESTSP Competition Time Series by Unscented Kalman Filter and RTS Smoother Simo Särkkä, Aki Vehtari and Jouko Lampinen Helsinki University of Technology Department of Electrical and Communications

More information

A Comparison of the EKF, SPKF, and the Bayes Filter for Landmark-Based Localization

A Comparison of the EKF, SPKF, and the Bayes Filter for Landmark-Based Localization A Comparison of the EKF, SPKF, and the Bayes Filter for Landmark-Based Localization and Timothy D. Barfoot CRV 2 Outline Background Objective Experimental Setup Results Discussion Conclusion 2 Outline

More information

Lecture 7: Optimal Smoothing

Lecture 7: Optimal Smoothing Department of Biomedical Engineering and Computational Science Aalto University March 17, 2011 Contents 1 What is Optimal Smoothing? 2 Bayesian Optimal Smoothing Equations 3 Rauch-Tung-Striebel Smoother

More information

Lecture 2: From Linear Regression to Kalman Filter and Beyond

Lecture 2: From Linear Regression to Kalman Filter and Beyond Lecture 2: From Linear Regression to Kalman Filter and Beyond January 18, 2017 Contents 1 Batch and Recursive Estimation 2 Towards Bayesian Filtering 3 Kalman Filter and Bayesian Filtering and Smoothing

More information

Extension of the Sparse Grid Quadrature Filter

Extension of the Sparse Grid Quadrature Filter Extension of the Sparse Grid Quadrature Filter Yang Cheng Mississippi State University Mississippi State, MS 39762 Email: cheng@ae.msstate.edu Yang Tian Harbin Institute of Technology Harbin, Heilongjiang

More information

Adaptive Unscented Kalman Filter with Multiple Fading Factors for Pico Satellite Attitude Estimation

Adaptive Unscented Kalman Filter with Multiple Fading Factors for Pico Satellite Attitude Estimation Adaptive Unscented Kalman Filter with Multiple Fading Factors for Pico Satellite Attitude Estimation Halil Ersin Söken and Chingiz Hajiyev Aeronautics and Astronautics Faculty Istanbul Technical University

More information

UNSCENTED KALMAN FILTERING FOR SPACECRAFT ATTITUDE STATE AND PARAMETER ESTIMATION

UNSCENTED KALMAN FILTERING FOR SPACECRAFT ATTITUDE STATE AND PARAMETER ESTIMATION AAS-04-115 UNSCENTED KALMAN FILTERING FOR SPACECRAFT ATTITUDE STATE AND PARAMETER ESTIMATION Matthew C. VanDyke, Jana L. Schwartz, Christopher D. Hall An Unscented Kalman Filter (UKF) is derived in an

More information

EKF, UKF. Pieter Abbeel UC Berkeley EECS. Many slides adapted from Thrun, Burgard and Fox, Probabilistic Robotics

EKF, UKF. Pieter Abbeel UC Berkeley EECS. Many slides adapted from Thrun, Burgard and Fox, Probabilistic Robotics EKF, UKF Pieter Abbeel UC Berkeley EECS Many slides adapted from Thrun, Burgard and Fox, Probabilistic Robotics Kalman Filter Kalman Filter = special case of a Bayes filter with dynamics model and sensory

More information

EKF, UKF. Pieter Abbeel UC Berkeley EECS. Many slides adapted from Thrun, Burgard and Fox, Probabilistic Robotics

EKF, UKF. Pieter Abbeel UC Berkeley EECS. Many slides adapted from Thrun, Burgard and Fox, Probabilistic Robotics EKF, UKF Pieter Abbeel UC Berkeley EECS Many slides adapted from Thrun, Burgard and Fox, Probabilistic Robotics Kalman Filter Kalman Filter = special case of a Bayes filter with dynamics model and sensory

More information

Constrained State Estimation Using the Unscented Kalman Filter

Constrained State Estimation Using the Unscented Kalman Filter 16th Mediterranean Conference on Control and Automation Congress Centre, Ajaccio, France June 25-27, 28 Constrained State Estimation Using the Unscented Kalman Filter Rambabu Kandepu, Lars Imsland and

More information

Lecture 2: From Linear Regression to Kalman Filter and Beyond

Lecture 2: From Linear Regression to Kalman Filter and Beyond Lecture 2: From Linear Regression to Kalman Filter and Beyond Department of Biomedical Engineering and Computational Science Aalto University January 26, 2012 Contents 1 Batch and Recursive Estimation

More information

Research Article Weighted Measurement Fusion White Noise Deconvolution Filter with Correlated Noise for Multisensor Stochastic Systems

Research Article Weighted Measurement Fusion White Noise Deconvolution Filter with Correlated Noise for Multisensor Stochastic Systems Mathematical Problems in Engineering Volume 2012, Article ID 257619, 16 pages doi:10.1155/2012/257619 Research Article Weighted Measurement Fusion White Noise Deconvolution Filter with Correlated Noise

More information

State Estimation for Nonlinear Systems using Restricted Genetic Optimization

State Estimation for Nonlinear Systems using Restricted Genetic Optimization State Estimation for Nonlinear Systems using Restricted Genetic Optimization Santiago Garrido, Luis Moreno, and Carlos Balaguer Universidad Carlos III de Madrid, Leganés 28911, Madrid (Spain) Abstract.

More information

The Unscented Particle Filter

The Unscented Particle Filter The Unscented Particle Filter Rudolph van der Merwe (OGI) Nando de Freitas (UC Bereley) Arnaud Doucet (Cambridge University) Eric Wan (OGI) Outline Optimal Estimation & Filtering Optimal Recursive Bayesian

More information

SIGMA POINT GAUSSIAN SUM FILTER DESIGN USING SQUARE ROOT UNSCENTED FILTERS

SIGMA POINT GAUSSIAN SUM FILTER DESIGN USING SQUARE ROOT UNSCENTED FILTERS SIGMA POINT GAUSSIAN SUM FILTER DESIGN USING SQUARE ROOT UNSCENTED FILTERS Miroslav Šimandl, Jindřich Duní Department of Cybernetics and Research Centre: Data - Algorithms - Decision University of West

More information

ROBUST CONSTRAINED ESTIMATION VIA UNSCENTED TRANSFORMATION. Pramod Vachhani a, Shankar Narasimhan b and Raghunathan Rengaswamy a 1

ROBUST CONSTRAINED ESTIMATION VIA UNSCENTED TRANSFORMATION. Pramod Vachhani a, Shankar Narasimhan b and Raghunathan Rengaswamy a 1 ROUST CONSTRINED ESTIMTION VI UNSCENTED TRNSFORMTION Pramod Vachhani a, Shankar Narasimhan b and Raghunathan Rengaswamy a a Department of Chemical Engineering, Clarkson University, Potsdam, NY -3699, US.

More information

NON-LINEAR NOISE ADAPTIVE KALMAN FILTERING VIA VARIATIONAL BAYES

NON-LINEAR NOISE ADAPTIVE KALMAN FILTERING VIA VARIATIONAL BAYES 2013 IEEE INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING NON-LINEAR NOISE ADAPTIVE KALMAN FILTERING VIA VARIATIONAL BAYES Simo Särä Aalto University, 02150 Espoo, Finland Jouni Hartiainen

More information

Expectation Propagation in Dynamical Systems

Expectation Propagation in Dynamical Systems Expectation Propagation in Dynamical Systems Marc Peter Deisenroth Joint Work with Shakir Mohamed (UBC) August 10, 2012 Marc Deisenroth (TU Darmstadt) EP in Dynamical Systems 1 Motivation Figure : Complex

More information

Autonomous Mobile Robot Design

Autonomous Mobile Robot Design Autonomous Mobile Robot Design Topic: Extended Kalman Filter Dr. Kostas Alexis (CSE) These slides relied on the lectures from C. Stachniss, J. Sturm and the book Probabilistic Robotics from Thurn et al.

More information

Research Article Extended and Unscented Kalman Filtering Applied to a Flexible-Joint Robot with Jerk Estimation

Research Article Extended and Unscented Kalman Filtering Applied to a Flexible-Joint Robot with Jerk Estimation Hindawi Publishing Corporation Discrete Dynamics in Nature and Society Volume 21, Article ID 482972, 14 pages doi:1.1155/21/482972 Research Article Extended and Unscented Kalman Filtering Applied to a

More information

Combined Particle and Smooth Variable Structure Filtering for Nonlinear Estimation Problems

Combined Particle and Smooth Variable Structure Filtering for Nonlinear Estimation Problems 14th International Conference on Information Fusion Chicago, Illinois, USA, July 5-8, 2011 Combined Particle and Smooth Variable Structure Filtering for Nonlinear Estimation Problems S. Andrew Gadsden

More information

Using the Kalman Filter to Estimate the State of a Maneuvering Aircraft

Using the Kalman Filter to Estimate the State of a Maneuvering Aircraft 1 Using the Kalman Filter to Estimate the State of a Maneuvering Aircraft K. Meier and A. Desai Abstract Using sensors that only measure the bearing angle and range of an aircraft, a Kalman filter is implemented

More information

Sampling strong tracking nonlinear unscented Kalman filter and its application in eye tracking

Sampling strong tracking nonlinear unscented Kalman filter and its application in eye tracking Sampling strong tracking nonlinear unscented Kalman filter and its application in eye tracking Zhang Zu-Tao( 张祖涛 ) a)b) and Zhang Jia-Shu( 张家树 ) b) a) School of Mechanical Engineering, Southwest Jiaotong

More information

Lecture 6: Bayesian Inference in SDE Models

Lecture 6: Bayesian Inference in SDE Models Lecture 6: Bayesian Inference in SDE Models Bayesian Filtering and Smoothing Point of View Simo Särkkä Aalto University Simo Särkkä (Aalto) Lecture 6: Bayesian Inference in SDEs 1 / 45 Contents 1 SDEs

More information

A New Nonlinear Filtering Method for Ballistic Target Tracking

A New Nonlinear Filtering Method for Ballistic Target Tracking th International Conference on Information Fusion Seattle, WA, USA, July 6-9, 9 A New Nonlinear Filtering Method for Ballistic arget racing Chunling Wu Institute of Electronic & Information Engineering

More information

A new unscented Kalman filter with higher order moment-matching

A new unscented Kalman filter with higher order moment-matching A new unscented Kalman filter with higher order moment-matching KSENIA PONOMAREVA, PARESH DATE AND ZIDONG WANG Department of Mathematical Sciences, Brunel University, Uxbridge, UB8 3PH, UK. Abstract This

More information

Randomized Unscented Kalman Filter in Target Tracking

Randomized Unscented Kalman Filter in Target Tracking Randomized Unscented Kalman Filter in Target Tracking Ondřej Straka, Jindřich Duník and Miroslav Šimandl Department of Cybernetics, Faculty of Applied Sciences, University of West Bohemia, Univerzitní

More information

On Continuous-Discrete Cubature Kalman Filtering

On Continuous-Discrete Cubature Kalman Filtering On Continuous-Discrete Cubature Kalman Filtering Simo Särkkä Arno Solin Aalto University, P.O. Box 12200. FI-00076 AALTO, Finland. (Tel: +358 50 512 4393; e-mail: simo.sarkka@aalto.fi) Aalto University,

More information

Kalman filtering and friends: Inference in time series models. Herke van Hoof slides mostly by Michael Rubinstein

Kalman filtering and friends: Inference in time series models. Herke van Hoof slides mostly by Michael Rubinstein Kalman filtering and friends: Inference in time series models Herke van Hoof slides mostly by Michael Rubinstein Problem overview Goal Estimate most probable state at time k using measurement up to time

More information

FUNDAMENTAL FILTERING LIMITATIONS IN LINEAR NON-GAUSSIAN SYSTEMS

FUNDAMENTAL FILTERING LIMITATIONS IN LINEAR NON-GAUSSIAN SYSTEMS FUNDAMENTAL FILTERING LIMITATIONS IN LINEAR NON-GAUSSIAN SYSTEMS Gustaf Hendeby Fredrik Gustafsson Division of Automatic Control Department of Electrical Engineering, Linköpings universitet, SE-58 83 Linköping,

More information

RECURSIVE OUTLIER-ROBUST FILTERING AND SMOOTHING FOR NONLINEAR SYSTEMS USING THE MULTIVARIATE STUDENT-T DISTRIBUTION

RECURSIVE OUTLIER-ROBUST FILTERING AND SMOOTHING FOR NONLINEAR SYSTEMS USING THE MULTIVARIATE STUDENT-T DISTRIBUTION 1 IEEE INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING, SEPT. 3 6, 1, SANTANDER, SPAIN RECURSIVE OUTLIER-ROBUST FILTERING AND SMOOTHING FOR NONLINEAR SYSTEMS USING THE MULTIVARIATE STUDENT-T

More information

The Scaled Unscented Transformation

The Scaled Unscented Transformation The Scaled Unscented Transformation Simon J. Julier, IDAK Industries, 91 Missouri Blvd., #179 Jefferson City, MO 6519 E-mail:sjulier@idak.com Abstract This paper describes a generalisation of the unscented

More information

Wind-field Reconstruction Using Flight Data

Wind-field Reconstruction Using Flight Data 28 American Control Conference Westin Seattle Hotel, Seattle, Washington, USA June 11-13, 28 WeC18.4 Wind-field Reconstruction Using Flight Data Harish J. Palanthandalam-Madapusi, Anouck Girard, and Dennis

More information

Recursive LMMSE Filtering for Target Tracking with Range and Direction Cosine Measurements

Recursive LMMSE Filtering for Target Tracking with Range and Direction Cosine Measurements Recursive Filtering for Target Tracing with Range and Direction Cosine Measurements Zhansheng Duan Yu Liu X. Rong Li Department of Electrical Engineering University of New Orleans New Orleans, LA 748,

More information

Nonlinear Estimation Techniques for Impact Point Prediction of Ballistic Targets

Nonlinear Estimation Techniques for Impact Point Prediction of Ballistic Targets Nonlinear Estimation Techniques for Impact Point Prediction of Ballistic Targets J. Clayton Kerce a, George C. Brown a, and David F. Hardiman b a Georgia Tech Research Institute, Georgia Institute of Technology,

More information

A NEW NONLINEAR FILTER

A NEW NONLINEAR FILTER COMMUNICATIONS IN INFORMATION AND SYSTEMS c 006 International Press Vol 6, No 3, pp 03-0, 006 004 A NEW NONLINEAR FILTER ROBERT J ELLIOTT AND SIMON HAYKIN Abstract A discrete time filter is constructed

More information

State Estimation of Linear and Nonlinear Dynamic Systems

State Estimation of Linear and Nonlinear Dynamic Systems State Estimation of Linear and Nonlinear Dynamic Systems Part III: Nonlinear Systems: Extended Kalman Filter (EKF) and Unscented Kalman Filter (UKF) James B. Rawlings and Fernando V. Lima Department of

More information

NONLINEAR BAYESIAN FILTERING FOR STATE AND PARAMETER ESTIMATION

NONLINEAR BAYESIAN FILTERING FOR STATE AND PARAMETER ESTIMATION NONLINEAR BAYESIAN FILTERING FOR STATE AND PARAMETER ESTIMATION Kyle T. Alfriend and Deok-Jin Lee Texas A&M University, College Station, TX, 77843-3141 This paper provides efficient filtering algorithms

More information

Riccati difference equations to non linear extended Kalman filter constraints

Riccati difference equations to non linear extended Kalman filter constraints International Journal of Scientific & Engineering Research Volume 3, Issue 12, December-2012 1 Riccati difference equations to non linear extended Kalman filter constraints Abstract Elizabeth.S 1 & Jothilakshmi.R

More information

Stochastic Models, Estimation and Control Peter S. Maybeck Volumes 1, 2 & 3 Tables of Contents

Stochastic Models, Estimation and Control Peter S. Maybeck Volumes 1, 2 & 3 Tables of Contents Navtech Part #s Volume 1 #1277 Volume 2 #1278 Volume 3 #1279 3 Volume Set #1280 Stochastic Models, Estimation and Control Peter S. Maybeck Volumes 1, 2 & 3 Tables of Contents Volume 1 Preface Contents

More information

Nonlinear State Estimation! Particle, Sigma-Points Filters!

Nonlinear State Estimation! Particle, Sigma-Points Filters! Nonlinear State Estimation! Particle, Sigma-Points Filters! Robert Stengel! Optimal Control and Estimation, MAE 546! Princeton University, 2017!! Particle filter!! Sigma-Points Unscented Kalman ) filter!!

More information

Ground Moving Target Parameter Estimation for Stripmap SAR Using the Unscented Kalman Filter

Ground Moving Target Parameter Estimation for Stripmap SAR Using the Unscented Kalman Filter Ground Moving Target Parameter Estimation for Stripmap SAR Using the Unscented Kalman Filter Bhashyam Balaji, Christoph Gierull and Anthony Damini Radar Sensing and Exploitation Section, Defence Research

More information

Simultaneous Adaptation of the Process and Measurement Noise Covariances for the UKF Applied to Nanosatellite Attitude Estimation

Simultaneous Adaptation of the Process and Measurement Noise Covariances for the UKF Applied to Nanosatellite Attitude Estimation Preprints of the 9th World Congress The International Federation of Automatic Control Simultaneous Adaptation of the Process and Measurement Noise Covariances for the UKF Applied to Nanosatellite Attitude

More information

ROBOTICS 01PEEQW. Basilio Bona DAUIN Politecnico di Torino

ROBOTICS 01PEEQW. Basilio Bona DAUIN Politecnico di Torino ROBOTICS 01PEEQW Basilio Bona DAUIN Politecnico di Torino Probabilistic Fundamentals in Robotics Gaussian Filters Course Outline Basic mathematical framework Probabilistic models of mobile robots Mobile

More information

A Comparitive Study Of Kalman Filter, Extended Kalman Filter And Unscented Kalman Filter For Harmonic Analysis Of The Non-Stationary Signals

A Comparitive Study Of Kalman Filter, Extended Kalman Filter And Unscented Kalman Filter For Harmonic Analysis Of The Non-Stationary Signals International Journal of Scientific & Engineering Research, Volume 3, Issue 7, July-2012 1 A Comparitive Study Of Kalman Filter, Extended Kalman Filter And Unscented Kalman Filter For Harmonic Analysis

More information

L06. LINEAR KALMAN FILTERS. NA568 Mobile Robotics: Methods & Algorithms

L06. LINEAR KALMAN FILTERS. NA568 Mobile Robotics: Methods & Algorithms L06. LINEAR KALMAN FILTERS NA568 Mobile Robotics: Methods & Algorithms 2 PS2 is out! Landmark-based Localization: EKF, UKF, PF Today s Lecture Minimum Mean Square Error (MMSE) Linear Kalman Filter Gaussian

More information

Optimal Gaussian Filtering for Polynomial Systems Applied to Association-free Multi-Target Tracking

Optimal Gaussian Filtering for Polynomial Systems Applied to Association-free Multi-Target Tracking 4th International Conference on Information Fusion Chicago, Illinois, USA, July 5-8, Optimal Gaussian Filtering for Polynomial Systems Applied to Association-free Multi-Target Tracking Marcus Baum, Benjamin

More information

Nonlinear and/or Non-normal Filtering. Jesús Fernández-Villaverde University of Pennsylvania

Nonlinear and/or Non-normal Filtering. Jesús Fernández-Villaverde University of Pennsylvania Nonlinear and/or Non-normal Filtering Jesús Fernández-Villaverde University of Pennsylvania 1 Motivation Nonlinear and/or non-gaussian filtering, smoothing, and forecasting (NLGF) problems are pervasive

More information

Dual Estimation and the Unscented Transformation

Dual Estimation and the Unscented Transformation Dual Estimation and the Unscented Transformation Eric A. Wan ericwan@ece.ogi.edu Rudolph van der Merwe rudmerwe@ece.ogi.edu Alex T. Nelson atnelson@ece.ogi.edu Oregon Graduate Institute of Science & Technology

More information

MODELLING ANALYSIS & DESIGN OF DSP BASED NOVEL SPEED SENSORLESS VECTOR CONTROLLER FOR INDUCTION MOTOR DRIVE

MODELLING ANALYSIS & DESIGN OF DSP BASED NOVEL SPEED SENSORLESS VECTOR CONTROLLER FOR INDUCTION MOTOR DRIVE International Journal of Advanced Research in Engineering and Technology (IJARET) Volume 6, Issue 3, March, 2015, pp. 70-81, Article ID: IJARET_06_03_008 Available online at http://www.iaeme.com/ijaret/issues.asp?jtypeijaret&vtype=6&itype=3

More information

AN EFFICIENT TWO-STAGE SAMPLING METHOD IN PARTICLE FILTER. Qi Cheng and Pascal Bondon. CNRS UMR 8506, Université Paris XI, France.

AN EFFICIENT TWO-STAGE SAMPLING METHOD IN PARTICLE FILTER. Qi Cheng and Pascal Bondon. CNRS UMR 8506, Université Paris XI, France. AN EFFICIENT TWO-STAGE SAMPLING METHOD IN PARTICLE FILTER Qi Cheng and Pascal Bondon CNRS UMR 8506, Université Paris XI, France. August 27, 2011 Abstract We present a modified bootstrap filter to draw

More information

Fuzzy Adaptive Variational Bayesian Unscented Kalman Filter

Fuzzy Adaptive Variational Bayesian Unscented Kalman Filter Journal of Information Hiding and Multimedia Signal Processing c 215 ISSN 273-4212 Ubiquitous International Volume 6, Number 4, July 215 Fuzzy Adaptive Variational Bayesian Unscented Kalman Filter Guo-Yong

More information

An Introduction to the Kalman Filter

An Introduction to the Kalman Filter An Introduction to the Kalman Filter by Greg Welch 1 and Gary Bishop 2 Department of Computer Science University of North Carolina at Chapel Hill Chapel Hill, NC 275993175 Abstract In 1960, R.E. Kalman

More information

Simultaneous Localization and Mapping (SLAM) Corso di Robotica Prof. Davide Brugali Università degli Studi di Bergamo

Simultaneous Localization and Mapping (SLAM) Corso di Robotica Prof. Davide Brugali Università degli Studi di Bergamo Simultaneous Localization and Mapping (SLAM) Corso di Robotica Prof. Davide Brugali Università degli Studi di Bergamo Introduction SLAM asks the following question: Is it possible for an autonomous vehicle

More information

TSRT14: Sensor Fusion Lecture 8

TSRT14: Sensor Fusion Lecture 8 TSRT14: Sensor Fusion Lecture 8 Particle filter theory Marginalized particle filter Gustaf Hendeby gustaf.hendeby@liu.se TSRT14 Lecture 8 Gustaf Hendeby Spring 2018 1 / 25 Le 8: particle filter theory,

More information

Tracking an Accelerated Target with a Nonlinear Constant Heading Model

Tracking an Accelerated Target with a Nonlinear Constant Heading Model Tracking an Accelerated Target with a Nonlinear Constant Heading Model Rong Yang, Gee Wah Ng DSO National Laboratories 20 Science Park Drive Singapore 118230 yrong@dsoorgsg ngeewah@dsoorgsg Abstract This

More information

Generalized Linear Minimum Mean-Square Error Estimation

Generalized Linear Minimum Mean-Square Error Estimation Generalized Linear Minimum Mean-Square Error Estimation Yu Liu and X. Rong Li Department of Electrical Engineering University of New Orleans New Orleans, LA 7148, U.S.A. Email: {lyu2, xli}@uno.edu Abstract

More information

Efficient Monitoring for Planetary Rovers

Efficient Monitoring for Planetary Rovers International Symposium on Artificial Intelligence and Robotics in Space (isairas), May, 2003 Efficient Monitoring for Planetary Rovers Vandi Verma vandi@ri.cmu.edu Geoff Gordon ggordon@cs.cmu.edu Carnegie

More information

Gaussian Filters for Nonlinear Filtering Problems

Gaussian Filters for Nonlinear Filtering Problems 910 IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 45, NO. 5, MAY 2000 Gaussian Filters for Nonlinear Filtering Problems Kazufumi Ito Kaiqi Xiong Abstract In this paper we develop analyze real-time accurate

More information

Expectation propagation for signal detection in flat-fading channels

Expectation propagation for signal detection in flat-fading channels Expectation propagation for signal detection in flat-fading channels Yuan Qi MIT Media Lab Cambridge, MA, 02139 USA yuanqi@media.mit.edu Thomas Minka CMU Statistics Department Pittsburgh, PA 15213 USA

More information

ESTIMATION problem plays a key role in many fields,

ESTIMATION problem plays a key role in many fields, 1 Maximum Correntropy Unscented Filter Xi Liu, Badong Chen, Bin Xu, Zongze Wu and Paul Honeine arxiv:1608.07526v1 stat.ml 26 Aug 2016 Abstract The unscented transformation UT) is an efficient method to

More information

A New Nonlinear State Estimator Using the Fusion of Multiple Extended Kalman Filters

A New Nonlinear State Estimator Using the Fusion of Multiple Extended Kalman Filters 18th International Conference on Information Fusion Washington, DC - July 6-9, 2015 A New Nonlinear State Estimator Using the Fusion of Multiple Extended Kalman Filters Zhansheng Duan, Xiaoyun Li Center

More information

Lessons in Estimation Theory for Signal Processing, Communications, and Control

Lessons in Estimation Theory for Signal Processing, Communications, and Control Lessons in Estimation Theory for Signal Processing, Communications, and Control Jerry M. Mendel Department of Electrical Engineering University of Southern California Los Angeles, California PRENTICE HALL

More information

SQUARE-ROOT CUBATURE-QUADRATURE KALMAN FILTER

SQUARE-ROOT CUBATURE-QUADRATURE KALMAN FILTER Asian Journal of Control, Vol. 6, No. 2, pp. 67 622, March 204 Published online 8 April 203 in Wiley Online Library (wileyonlinelibrary.com) DOI: 0.002/asjc.704 SQUARE-ROO CUBAURE-QUADRAURE KALMAN FILER

More information

ENGR352 Problem Set 02

ENGR352 Problem Set 02 engr352/engr352p02 September 13, 2018) ENGR352 Problem Set 02 Transfer function of an estimator 1. Using Eq. (1.1.4-27) from the text, find the correct value of r ss (the result given in the text is incorrect).

More information

A NOVEL OPTIMAL PROBABILITY DENSITY FUNCTION TRACKING FILTER DESIGN 1

A NOVEL OPTIMAL PROBABILITY DENSITY FUNCTION TRACKING FILTER DESIGN 1 A NOVEL OPTIMAL PROBABILITY DENSITY FUNCTION TRACKING FILTER DESIGN 1 Jinglin Zhou Hong Wang, Donghua Zhou Department of Automation, Tsinghua University, Beijing 100084, P. R. China Control Systems Centre,

More information

Cramér-Rao Bounds for Estimation of Linear System Noise Covariances

Cramér-Rao Bounds for Estimation of Linear System Noise Covariances Journal of Mechanical Engineering and Automation (): 6- DOI: 593/jjmea Cramér-Rao Bounds for Estimation of Linear System oise Covariances Peter Matiso * Vladimír Havlena Czech echnical University in Prague

More information

9 Multi-Model State Estimation

9 Multi-Model State Estimation Technion Israel Institute of Technology, Department of Electrical Engineering Estimation and Identification in Dynamical Systems (048825) Lecture Notes, Fall 2009, Prof. N. Shimkin 9 Multi-Model State

More information

Kalman Filter. Predict: Update: x k k 1 = F k x k 1 k 1 + B k u k P k k 1 = F k P k 1 k 1 F T k + Q

Kalman Filter. Predict: Update: x k k 1 = F k x k 1 k 1 + B k u k P k k 1 = F k P k 1 k 1 F T k + Q Kalman Filter Kalman Filter Predict: x k k 1 = F k x k 1 k 1 + B k u k P k k 1 = F k P k 1 k 1 F T k + Q Update: K = P k k 1 Hk T (H k P k k 1 Hk T + R) 1 x k k = x k k 1 + K(z k H k x k k 1 ) P k k =(I

More information

6.4 Kalman Filter Equations

6.4 Kalman Filter Equations 6.4 Kalman Filter Equations 6.4.1 Recap: Auxiliary variables Recall the definition of the auxiliary random variables x p k) and x m k): Init: x m 0) := x0) S1: x p k) := Ak 1)x m k 1) +uk 1) +vk 1) S2:

More information

State estimation of linear dynamic system with unknown input and uncertain observation using dynamic programming

State estimation of linear dynamic system with unknown input and uncertain observation using dynamic programming Control and Cybernetics vol. 35 (2006) No. 4 State estimation of linear dynamic system with unknown input and uncertain observation using dynamic programming by Dariusz Janczak and Yuri Grishin Department

More information

Quadratic Extended Filtering in Nonlinear Systems with Uncertain Observations

Quadratic Extended Filtering in Nonlinear Systems with Uncertain Observations Applied Mathematical Sciences, Vol. 8, 2014, no. 4, 157-172 HIKARI Ltd, www.m-hiari.com http://dx.doi.org/10.12988/ams.2014.311636 Quadratic Extended Filtering in Nonlinear Systems with Uncertain Observations

More information

Reduced Sigma Point Filters for the Propagation of Means and Covariances Through Nonlinear Transformations

Reduced Sigma Point Filters for the Propagation of Means and Covariances Through Nonlinear Transformations 1 Reduced Sigma Point Filters for the Propagation of Means and Covariances Through Nonlinear Transformations Simon J. Julier Jeffrey K. Uhlmann IDAK Industries 91 Missouri Blvd., #179 Dept. of Computer

More information

A Novel Gaussian Sum Filter Method for Accurate Solution to Nonlinear Filtering Problem

A Novel Gaussian Sum Filter Method for Accurate Solution to Nonlinear Filtering Problem A Novel Gaussian Sum Filter Method for Accurate Solution to Nonlinear Filtering Problem Gabriel Terejanu a Puneet Singla b Tarunraj Singh b Peter D. Scott a Graduate Student Assistant Professor Professor

More information

Higher-Degree Stochastic Integration Filtering

Higher-Degree Stochastic Integration Filtering Higher-Degree Stochastic Integration Filtering Syed Safwan Khalid, Naveed Ur Rehman, and Shafayat Abrar Abstract arxiv:1608.00337v1 cs.sy 1 Aug 016 We obtain a class of higher-degree stochastic integration

More information

ESTIMATOR STABILITY ANALYSIS IN SLAM. Teresa Vidal-Calleja, Juan Andrade-Cetto, Alberto Sanfeliu

ESTIMATOR STABILITY ANALYSIS IN SLAM. Teresa Vidal-Calleja, Juan Andrade-Cetto, Alberto Sanfeliu ESTIMATOR STABILITY ANALYSIS IN SLAM Teresa Vidal-Calleja, Juan Andrade-Cetto, Alberto Sanfeliu Institut de Robtica i Informtica Industrial, UPC-CSIC Llorens Artigas 4-6, Barcelona, 88 Spain {tvidal, cetto,

More information

The Discrete Kalman Filtering of a Class of Dynamic Multiscale Systems

The Discrete Kalman Filtering of a Class of Dynamic Multiscale Systems 668 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II: ANALOG AND DIGITAL SIGNAL PROCESSING, VOL 49, NO 10, OCTOBER 2002 The Discrete Kalman Filtering of a Class of Dynamic Multiscale Systems Lei Zhang, Quan

More information

Research Article Stabilization Analysis and Synthesis of Discrete-Time Descriptor Markov Jump Systems with Partially Unknown Transition Probabilities

Research Article Stabilization Analysis and Synthesis of Discrete-Time Descriptor Markov Jump Systems with Partially Unknown Transition Probabilities Research Journal of Applied Sciences, Engineering and Technology 7(4): 728-734, 214 DOI:1.1926/rjaset.7.39 ISSN: 24-7459; e-issn: 24-7467 214 Maxwell Scientific Publication Corp. Submitted: February 25,

More information

MODEL BASED LEARNING OF SIGMA POINTS IN UNSCENTED KALMAN FILTERING. Ryan Turner and Carl Edward Rasmussen

MODEL BASED LEARNING OF SIGMA POINTS IN UNSCENTED KALMAN FILTERING. Ryan Turner and Carl Edward Rasmussen MODEL BASED LEARNING OF SIGMA POINTS IN UNSCENTED KALMAN FILTERING Ryan Turner and Carl Edward Rasmussen University of Cambridge Department of Engineering Trumpington Street, Cambridge CB PZ, UK ABSTRACT

More information

A Track-to-Track Fusion Method via Construction of Cross-Covariance Matrix for Tracks with Unknown Correlations

A Track-to-Track Fusion Method via Construction of Cross-Covariance Matrix for Tracks with Unknown Correlations A Track-to-Track Fusion Method via onstruction of ross-ovariance Matrix for Tracks with Unknown orrelations Mahboubeh Zarei-Jalalabadi a,b,, Solmaz S. Kia b, Seyed Mohammad-Bagher Malaek a a Aerospace

More information

Time Series Prediction by Kalman Smoother with Cross-Validated Noise Density

Time Series Prediction by Kalman Smoother with Cross-Validated Noise Density Time Series Prediction by Kalman Smoother with Cross-Validated Noise Density Simo Särkkä E-mail: simo.sarkka@hut.fi Aki Vehtari E-mail: aki.vehtari@hut.fi Jouko Lampinen E-mail: jouko.lampinen@hut.fi Abstract

More information

OPTIMAL TIME TRANSFER

OPTIMAL TIME TRANSFER OPTIMAL TIME TRANSFER James R. Wright and James Woodburn Analytical Graphics, Inc. 220 Valley Creek Blvd, Exton, PA 19341, USA Abstract We have designed an optimal time transfer algorithm using GPS carrier-phase

More information

Probabilistic Fundamentals in Robotics. DAUIN Politecnico di Torino July 2010

Probabilistic Fundamentals in Robotics. DAUIN Politecnico di Torino July 2010 Probabilistic Fundamentals in Robotics Gaussian Filters Basilio Bona DAUIN Politecnico di Torino July 2010 Course Outline Basic mathematical framework Probabilistic models of mobile robots Mobile robot

More information

Extended Kalman Filter Tutorial

Extended Kalman Filter Tutorial Extended Kalman Filter Tutorial Gabriel A. Terejanu Department of Computer Science and Engineering University at Buffalo, Buffalo, NY 14260 terejanu@buffalo.edu 1 Dynamic process Consider the following

More information

State Estimation using Moving Horizon Estimation and Particle Filtering

State Estimation using Moving Horizon Estimation and Particle Filtering State Estimation using Moving Horizon Estimation and Particle Filtering James B. Rawlings Department of Chemical and Biological Engineering UW Math Probability Seminar Spring 2009 Rawlings MHE & PF 1 /

More information

Linear Dynamical Systems

Linear Dynamical Systems Linear Dynamical Systems Sargur N. srihari@cedar.buffalo.edu Machine Learning Course: http://www.cedar.buffalo.edu/~srihari/cse574/index.html Two Models Described by Same Graph Latent variables Observations

More information

Factor Analysis and Kalman Filtering (11/2/04)

Factor Analysis and Kalman Filtering (11/2/04) CS281A/Stat241A: Statistical Learning Theory Factor Analysis and Kalman Filtering (11/2/04) Lecturer: Michael I. Jordan Scribes: Byung-Gon Chun and Sunghoon Kim 1 Factor Analysis Factor analysis is used

More information

We are IntechOpen, the world s leading publisher of Open Access books Built by scientists, for scientists. International authors and editors

We are IntechOpen, the world s leading publisher of Open Access books Built by scientists, for scientists. International authors and editors We are IntechOpen, the world s leading publisher of Open Access books Built by scientists, for scientists 3,900 116,000 120M Open access books available International authors and editors Downloads Our

More information

MULTI-MODEL FILTERING FOR ORBIT DETERMINATION DURING MANOEUVRE

MULTI-MODEL FILTERING FOR ORBIT DETERMINATION DURING MANOEUVRE MULTI-MODEL FILTERING FOR ORBIT DETERMINATION DURING MANOEUVRE Bruno CHRISTOPHE Vanessa FONDBERTASSE Office National d'etudes et de Recherches Aérospatiales (http://www.onera.fr) B.P. 72 - F-92322 CHATILLON

More information

Error analysis of dynamics model for satellite attitude estimation in Near Equatorial Orbit

Error analysis of dynamics model for satellite attitude estimation in Near Equatorial Orbit International Journal of Scientific and Research Publications, Volume 4, Issue 10, October 2014 1 Error analysis of dynamics model for satellite attitude estimation in Near Equatorial Orbit Nor HazaduraHamzah

More information

Recursive Noise Adaptive Kalman Filtering by Variational Bayesian Approximations

Recursive Noise Adaptive Kalman Filtering by Variational Bayesian Approximations PREPRINT 1 Recursive Noise Adaptive Kalman Filtering by Variational Bayesian Approximations Simo Särä, Member, IEEE and Aapo Nummenmaa Abstract This article considers the application of variational Bayesian

More information

Lecture Outline. Target Tracking: Lecture 3 Maneuvering Target Tracking Issues. Maneuver Illustration. Maneuver Illustration. Maneuver Detection

Lecture Outline. Target Tracking: Lecture 3 Maneuvering Target Tracking Issues. Maneuver Illustration. Maneuver Illustration. Maneuver Detection REGLERTEKNIK Lecture Outline AUTOMATIC CONTROL Target Tracking: Lecture 3 Maneuvering Target Tracking Issues Maneuver Detection Emre Özkan emre@isy.liu.se Division of Automatic Control Department of Electrical

More information

X. F. Wang, J. F. Chen, Z. G. Shi *, and K. S. Chen Department of Information and Electronic Engineering, Zhejiang University, Hangzhou , China

X. F. Wang, J. F. Chen, Z. G. Shi *, and K. S. Chen Department of Information and Electronic Engineering, Zhejiang University, Hangzhou , China Progress In Electromagnetics Research, Vol. 118, 1 15, 211 FUZZY-CONTROL-BASED PARTICLE FILTER FOR MANEUVERING TARGET TRACKING X. F. Wang, J. F. Chen, Z. G. Shi *, and K. S. Chen Department of Information

More information

On Underweighting Nonlinear Measurements

On Underweighting Nonlinear Measurements On Underweighting Nonlinear Measurements Renato Zanetti The Charles Stark Draper Laboratory, Houston, Texas 7758 Kyle J. DeMars and Robert H. Bishop The University of Texas at Austin, Austin, Texas 78712

More information

Gaussian Process Approximations of Stochastic Differential Equations

Gaussian Process Approximations of Stochastic Differential Equations Gaussian Process Approximations of Stochastic Differential Equations Cédric Archambeau Dan Cawford Manfred Opper John Shawe-Taylor May, 2006 1 Introduction Some of the most complex models routinely run

More information

CS 532: 3D Computer Vision 6 th Set of Notes

CS 532: 3D Computer Vision 6 th Set of Notes 1 CS 532: 3D Computer Vision 6 th Set of Notes Instructor: Philippos Mordohai Webpage: www.cs.stevens.edu/~mordohai E-mail: Philippos.Mordohai@stevens.edu Office: Lieb 215 Lecture Outline Intro to Covariance

More information

RECURSIVE ESTIMATION AND KALMAN FILTERING

RECURSIVE ESTIMATION AND KALMAN FILTERING Chapter 3 RECURSIVE ESTIMATION AND KALMAN FILTERING 3. The Discrete Time Kalman Filter Consider the following estimation problem. Given the stochastic system with x k+ = Ax k + Gw k (3.) y k = Cx k + Hv

More information

1 Kalman Filter Introduction

1 Kalman Filter Introduction 1 Kalman Filter Introduction You should first read Chapter 1 of Stochastic models, estimation, and control: Volume 1 by Peter S. Maybec (available here). 1.1 Explanation of Equations (1-3) and (1-4) Equation

More information

2D Image Processing. Bayes filter implementation: Kalman filter

2D Image Processing. Bayes filter implementation: Kalman filter 2D Image Processing Bayes filter implementation: Kalman filter Prof. Didier Stricker Kaiserlautern University http://ags.cs.uni-kl.de/ DFKI Deutsches Forschungszentrum für Künstliche Intelligenz http://av.dfki.de

More information