Bayesian Filters for Location Estimation and Tracking An Introduction

Size: px
Start display at page:

Download "Bayesian Filters for Location Estimation and Tracking An Introduction"

Transcription

1 Bayesian Filters for Location Estimation and Tracking An Introduction Traian E. Abrudan Instituto de Telecomunicações, Departamento de Engenharia Electrotécnica e Computadores, Universidade do Porto, Portugal Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 1

2 Outline Motivation Deterministic vs. probabilistic models Probabilistic models for location estimation and tracking Bayesian filters Kalman filter and its extensions Grid-based filter Particle filter Pros. and cons. Real-world results Conclusions Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 2

3 Motivation Many applications require estimating parameters that possess certain dynamic behavior fusing measurements originating from multiple (different) sensors Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 3

4 Motivation Indoor propagation environment is extremely harsh Signals experience deep fades in space, time and frequency As a results of all these effects, the propagation channel behaves randomly Measurements are subject to random errors due to random noise at the sensors device manufacturing imperfections imperfect calibration Dealing with uncertainties calls for probabilistic models Powerful statistical estimators may be derived They do not just provide an estimated value, they also provide reliability information Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 4

5 Deterministic vs. statistical models Deterministic models for location estimation are quite rough perform hard decisions (quantize the estimated parameters) discard valuable statistical information embedded in the data Probabilistic models exploit the available statistical information Parameters are modeled as random variables with the corresponding probability density functions (p.d.f. s) Prior knowledge on the errors (e.g. from the measurements) may be included in the model in order to improve the parameter estimation Optimality can be achieved w.r.t the assumed prior (in some practical cases just asymptotically) Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 5

6 Probabilistic models for localization and navigation applications Let x k denote the L S 1 true state vector at time instance k, with x k D x R L S (or C L S) x k may include the position (but also velocity, acceleration, heading, etc.) Let z k be the observation vector at time k (e.g. measured GPS position, received signal power, or combinations of those) Our goal is to estimate the sequence of states x k, k = 0, 1..., based on all available measurements up to time k (abbreviated z 1:k ) For this reason, the process is called filtering, and the corresponding estimators are called Bayesian filters The posterior p.d.f. we are interested in is p(x k z 1:k ) Assume that the (hidden) true states x k are connected in a 1st-order Markov chain Hidden Markov Model (HMM) Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 6

7 Probabilistic models for location estimation and tracking k 1 k k + 1 p(x k x k 1 ) x k 1 x k x k+1 time instance hidden states (cannot be observed and have to be estimated) p(z k x k ) z k 1 z k z k+1 observations (measurements) Figure 1: First-order Hidden Markov Model [Muh03] Markov model assumptions: The current true state is conditionally independent of all previous states given the last state: p(x k x 1:k 1 ) = p(x k x k 1 ) Observations z 1:k are conditionally independent provided that x 0,...,x k, are known: p(z k x 1:k ) = p(z k x k ) Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 7

8 Probabilistic models State-space model prediction equation: x k = f(x k 1,u k ) + w k p(x k x k 1 ) measurement equation: z k = h(x k ) + v k p(z k x k ) (1) (2) f,h are known functions u k is a known input (required only if a control input exists) w k is the state (process) noise v k is the measurement noise w k,v k are i.i.d., mutually independent, with known p.d.f. s prediction equation: dynamic model of the system that describes the mutual dependence of the true states we would like to estimate (for localization, this corresponds to a motion model) measurement equation: a model for the sensor(s) that describes how observations are related to the true states (e.g. RSSI, ToA, AoA, kinematic parameters, etc., or combinations) Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 8

9 Probabilistic models State-space model prediction equation: x k = f(x k 1,u k ) + w k p(x k x k 1 ) measurement equation: z k = h(x k ) + v k p(z k x k ) (3) (4) Question What to trust more: the prediction or the measurement? The Bayesian estimator solves this problem reliably using a predict-update mechanism We would like to derive a formula such that the new posterior p.d.f. at time k, p(x k z 1:k ) is obtained by updating the old posterior at time k 1, p(x k 1 z 1:k 1 ) This way, the filter can operate sequentially, in real-time (online) Moreover, we store only the parameters at the previous time instance and avoid memory growth Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 9

10 Probabilistic models for location estimation and tracking Assume that the old posterior p(x k 1 z 1:k 1 ) is available at time k Prediction step: p(x k 1 z 1:k 1 ) p(x k z 1:k 1 ) Using Chapman-Kolmogorov equation: p(x k z 1:k 1 ) = p(x k x k 1 )p(x k 1 z 1:k 1 )dx k 1 (5) D x This is the prior of the state x k without knowing the incoming measurement z k, knowing only the previous measurements z 1:k 1 The prediction step usually deforms / translates / spreads the p.d.f. due to noise Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 10

11 Probabilistic models for location estimation and tracking Update step: { p(x k z 1:k 1 ), z k } p(xk z 1:k ) p(x k z 1:k ) = p(z k x k )p(x k z 1:k 1 ), i.e., posterior = p(z k z 1:k 1 ) likelihood prior evidence (6) The denominator c = p(z k z 1:k 1 ) = D x p(z k x k )p(x k z 1:k 1 )dx k is just a normalization constant (independent of x k ) The update combines the likelihood of the received measurement with the predicted state The update step usually concentrates the p.d.f. A closed-form expression that relates the old posterior to the new posterior is obtained by replacing eq. (5) into eq. (6) Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 11

12 Probabilistic models for location estimation and tracking Sequential update of the posterior p(x k 1 z 1:k 1 ), z k p(x k z 1:k ): p(x k z 1:k ) = 1 }{{} c p(z k x k ) p(x k x k 1 ) }{{} D x }{{} posterior at time k from meas. eq. from pred. eq. p(x k 1 z 1:k 1 ) dx k 1 (7) }{{} posterior at time k 1 This theoretically allows an optimal Bayesian solution Minimum Mean Square Error (MMSE), Maximum a posteriori (MAP) estimators, etc. Unfortunately, this is just a conceptual solution, integrals are intractable In some cases (under restrictive assumptions), (close to) optimal tractable solutions are obtained: Kalman filter [Sin70, ParLee01, AbrPauBar11] grid-based filter [Muh03] Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 12

13 State-space model: Kalman filter (KF) prediction equation: x k = F k x k 1 + B k u k + G k w k (8) measurement equation: z k = H k x k + v k (9) where F k,b k,g k,h k are known matrices When noises are zero-mean jointly Gaussian, Kalman filter is optimal estimator in the mean-square error (MSE) sense Otherwise, KF is the best linear estimator It finds the posterior mean E{x k z 1:k } = ˆx k k and its covariance E{(x k ˆx k k )(x k ˆx k k ) T } and updates them sequentially ˆx k k = ˆx k k 1 K k [z k F kˆx k k 1 ] (10) where K k is the Kalman gain, and the subscript ( ) k k 1 denotes the a priori estimated state (before considering the measurement z k ) Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 13

14 Kalman filter and its extensions (EKF, UKF) Extended Kalman filter (EKF) an extension of KF to non-linear state-space equations either the process is non-linear, or the measurements are not a linear function of the states EKF linearizes the model about the new estimate (similar to Taylor series approximation) works well in many situations, but may diverge for highly non-linear models (covariance is propagated through linearization) Unscented Kalman filter (UKF) mean and covariance are projected via the so-called unscented transform picks up a minimal set of sample points around the mean called sigma points propagates those through the non-linearity UKF can deal with highly-nonlinear models often, UKF works better than EKF Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 14

15 Kalman filter and its extensions (EKF, UKF) KF, EKF, UKF do not work very well for p.d.f. s that have heavy-tails / high kurtosis They may totally fail for heavily skewed p.d.f. s bimodal/multimodal p.d.f. s We need more general filters to tackle these problems It is everything about approximating well integrals and the p.d.f. s in the optimal Bayes estimation of the posterior p(x k z 1:k ) = 1 }{{} c p(z k x k ) p(x k x k 1 ) }{{} D x }{{} posterior at time k from meas. eq. from pred. eq. p(x k 1 z 1:k 1 ) }{{} posterior at time k 1 dx k 1 The price we pay is the high complexity curse of dimensionality [DauHua03] Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 15

16 Grid-based filter Limit the total number of possible states to N S [AruMas02, Muh03] define a grid of discrete states x i (may also be different at each time instance) The p.d.f. s are discretized as well The conditional probability of state x i given the measurements z 1:k 1 is P(x k 1 = x i z 1:k 1 ) = ω i k 1 k 1 (11) Then, the old posterior may be written as a sum of Dirac pulses p(x k 1 z 1:k 1 ) = N S i=1 ω i k 1 k 1 δ(x k 1 x i ) (12) Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 16

17 Grid-based filter Both the new prior and the new posterior have the same structure: a sum of weighted and delayed Dirac impulses p(x k z 1:k 1 ) = p(x k z 1:k ) = N S i=1 N S i=1 ω i k k 1 δ(x k 1 x i ) (13) ω i k k δ(x k 1 x i ) (14) Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 17

18 Grid-based filter The prediction step: the Chapman-Kolmogorov equation for the prior (5) becomes: p(x k z 1:k 1 ) = = N S N S i=1 N S i=1 j=1 ω j k 1 k 1 p(xi x j )δ(x k 1 x i ) (15) ω i k k 1 δ(x k 1 x i ) (16) where N S ωk k 1 i = j=1 ω j k 1 k 1 p(xi x j ) (17) new prior weights = old posterior weights, reweighted using state transition probabilities Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 18

19 Grid-based filter The update step: equation (6) becomes: p(x k z 1:k ) = N S i=1 ω i k k δ(x k 1 x i ) (18) where ω i k k = ω i k k 1 p(z k x i ) NS j=1 ωj k k 1 p(z k x j ) (19) posterior weights = prior weights, reweighted using likelihoods Grid-based filters are computationally expensive Grid resolution needs to be sufficiently high Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 19

20 Particle filter Particle filters are sophisticated estimation techniques based on simulation Also known as Sequential Monte Carlo (SMC) methods [GusGun02, AruMas02, Muh03, Kar05, Ber99] Integrals involved in the Bayesian filter cannot be solved analytically The idea: represent the p.d.f. s by using a set of random particles (random = Monte Carlo method) Particles are just differently weighted samples of the distribution By increasing the number of samples, the representation almost sure converges to the true p.d.f. Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 20

21 Particle filter equal weight particles original p.d.f. representatation of the p.d.f non equal weight particles original p.d.f. representatation of the p.d.f Figure 2: Representation of the Gaussian p.d.f. N(1, 1) using particles (1-D case). The particle weight is represented by its size. Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 21

22 Particle filter 2 D Gaussian p.d.f. 4 equal weight particles 4 non equal weight particles Figure 3: Representation of the Gaussian p.d.f. using particles (1-D case). The particle weight is represented by its size. The p.d.f. is N([0.5; 1], [ ; ]) Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 22

23 Particle filter Sequential Importance Sampling (SIS) SIS is the basic framework for most particle filter algorithms Let {x i 0:k } be a set of points (particles), i = 1,...,N P This describes the whole trajectory in the state space for each particle i Let ωk i be the associated weights, normalized such that NP i=1 ωi k = 1 Then, the discrete weighted approximation of the posterior p.d.f. is p(x k z 1:k ) N P i=1 ω i kδ(x 0:k x i 0:k) (20) Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 23

24 Particle filter Sequential Importance Sampling (SIS) Usually, we cannot draw samples x i k from p( ) directly Assume we sample directly for a (different) importance density q( ) Our approximation is still correct (up to normalization) if ω i k p(xi 0:k z 1:k) q(x i 0:k z 1:k) (21) The benefit is that we can choose q( ) freely If the importance function is chosen to factorize such that q(x 0:k z 1:k ) = q(x k x 0:k 1,z 1:k )q(x 0:k 1 z 1:k 1 ) (22) then one can augment the old particles x i 0:k 1 by x k q(x k x 0:k 1,z 1:k ) to get the new particles x i 0:k Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 24

25 Particle filter Sequential Importance Sampling (SIS) The weight update is of form ωk i = ωk 1 i p(z k x i k )p(xi k xi k 1 ) q(x i k x 0:k 1,z 1:k ) (23) Furthermore, if q(x i k x 0:k 1,z 1:k ) = q(x i k x k 1,z 1:k ) (only dependent on the last state), then we do not need to preserve the full trajectory of the particles x 0:k 1, neither the observations z 1:k Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 25

26 Particle filter Degeneracy Problem The problem with SIS approach is that after few iterations, most particles have negligible weight The weight is concentrated on only few particles the one that closely match the measurements Solutions: brute force: huge number of particles too complex good choice of importance density resampling Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 26

27 Particle filter Optimal importance density It can be shown that the optimal importance density is given by Then q opt (x k x k 1,z k ) = p(x k x k 1,z k ) (24) ω i k = ω i k 1 D x p(z k x k)p(x k x i k 1)dx k (25) Drawing sample from the optimal distribution is not always possible One alternative is to choose the importance density to be the prior q(x k x k 1,z k ) = p(x k x k 1 ) (26) This is simple, but does not take into account the measurements Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 27

28 Basic idea of resampling: Particle filter Resampling Whenever the degeneracy exceeds some threshold, replace the old samples (+ weights) with a new set of samples (+ weights), such that the sample density reflects better the posterior p.d.f. This eliminates particles with low weights and chooses new particles in the more probable regions Complexity is possible in O(N P ) Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 28

29 Particle filter Resampling old posterior p.d.f. resampling prediction step measurement & update new posterior p.d.f. Figure 4: Illustration of the resampling process. Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 29

30 Particle filter Pseudo-code [Muh03, AruMas02] [{x i k, ωi k }N P i=1 ] = PF({xi k 1, ωi k 1 }N P i=1,zi k ) FOR i = 1 to N P draw x i k q(x k x i k 1,z k) update weights according to ωk i = ωk 1 i p(z k x i k )p(xi k xi k 1 ) q(x i k x 0:k 1,z 1:k ) END FOR normalize weights to N P i=1 ωi k = 1 IF degeneracy is too high resample {x i k, ωi k }N P i=1 END IF Knowledge of the initial posterior is required not possible, a proposal density is used Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 30

31 Particle filter Sample Impoverishment Problem No degeneracy problem, but new problem arises Particle with too high weight are selected more and more often The other ones will slowly die out This leads to a loss of diversity or sample impoverishment For small process noise, all particles can collapse into a single point within a few iterations Another problem: resampling limits the possibility to parallelize the algorithm Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 31

32 Particle filter There are various other kinds of particle filters in the literature sampling importance resampling auxiliary sampling importance resampling marginalized (or Rao-Blackwelized ) particle filter Gaussian sum particle filter kernel density estimation based... There are also Markov Chain Monte Carlo (MCMC) batch Bayesian methods They model the full posterior x k p(x 0,...,x k y k,...,y 0 ) not online, very complex Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 32

33 Bayesian filters Pros. and cons. close to optimal performance can deal with non-linearities, non-gaussian noise even multimodal distributions are not a problem PF can be implemented in O(N P ), mostly parallelizable in contrast to HMM filters (state space discretized to N S ) states, PF focus on probable regions of the state space Bayesian filters can reliably fuse data originating from different sensors (e.g. RF signals, kinematic sensors, cameras, etc.) As long as the sources of measurement error (randomness) are independent, fusing multiple sensors will always improve results might be too complex for some real-time applications degeneracy and sample impoverishment problems may arise choosing the importance density might be hard Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 33

34 Bayesian Filters Thesis: If you want to solve a problem, particle filters are the best filters you can use, much better than e.g. Kalman filters. Right or wrong? Very wrong! PF contain randomness only converge to the true posterior when number of particles N P (asymptotically optimal) If assumption for Kalman filters or grid-based filters hold, no particle filter can outperform them In case these assumptions hold approximately, other filters may perform reasonably well with much lower complexity than PF For location estimation and tracking, these assumptions do not hold, in general (multimodal p.d.f s arise easily) Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 34

35 Practical aspects for localization Motion model It is important to have an accurate description of the reality People s motion is subject to physical constraints position (accessible areas, transition between them) speed (stopped, walking, running) acceleration (changes in speed are limited) It is sensible to take into account these constraints when doing position tracking Motion models predict the next position based on the previous one Information about the building layout may be used as well Such information may improve drastically the location estimation and tracking There are many motion models in the literature: uniform linear motion, diffusion approach, angular p.d.f., multi-user motion models, etc. [AbrPauBar11, Roy11, KaiKhi11, QuiSta10] Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 35

36 Real-world results Work in Progress... We test a grid-based filter using real-world results, the same as in [AbrPauBar11] The sensor nodes are equipped with two RF front-ends operating at 433MHz and 2.4GHz, respectively RSSI on both frequency was used no knowledge about the building geometry unknown starting point (initial posterior based on the first measurement) the same linear motion model as in [AbrPauBar11] the true position was measured using a laser range meter Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 36

37 Real-world results Work in Progress Indoor location estimation and tracking South North axis [meters] A1 A2 ending point 8 1 A4 A3 starting point West East axis [meters] Figure 5: Location estimation and tracking office environment in Aveiro grid-based filter spatial grid resolution: 0.5 meters single user case (for better visualization) also because of limited amount of measurement data true user path gray solid line with circle markers anchor nodes: A 1,...,A 4 Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 37

38 Real-world results Work in Progress... p(x 1 r 1:1 ) 10 South North axis [meters] A1 A A2 A3 ending point 25 1 starting point Receive the very first measurement z 1 initial (proposal) posterior distribution p(x 1 z 1:1 ) continuou representation computed just using the first me surement z West East axis [meters] Figure 6: Location estimation and tracking Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 38

39 Real-world results Work in Progress... p(x 2 r 1:1 ) 10 South North axis [meters] A1 A2 ending point 8 1 A4 A3 starting point West East axis [meters] Prediction step get the prior: p(x 2 z 1:1 ) = D x p(x 2 x 1 )p(x 1 z 1:1 )dx p(x 2 x 1 ): based on the prediction equation p(x 1 z 1:1 ): the old posterior The spreading of the posterior aft the prediction step may be notice Figure 7: Location estimation and tracking Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 39

40 Real-world results Work in Progress... p(x 2 r 1:1 ) x p(r 2 x 2 ) 10 South North axis [meters] A1 A2 ending point 8 1 A4 A3 starting point West East axis [meters] receive new measurement z 2 Compute its likelihood p(z 2 x 2 ) based on the measurement equation (log-distance RSSI channel model) Multiply the likelihood with the pr p(x 2 z 1:1 ) and normalize to get t new posterior Figure 8: Location estimation and tracking Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 40

41 Real-world results Work in Progress... p(x 2 r 1:2 ) South North axis [meters] A1 A2 ending point 8 1 A4 A3 starting point West East axis [meters] Figure 9: Location estimation and tracking New posterior p(x 2 z 1:2 ) = p(z 2 x 2 )p(x 2 z 1:1 ) p(z 2 z 1:1 ) The denominator is just a normalization factor it does not need to be calculated Shrinking of the new posterior ma be noticed Calculate new position estimate ˆx as the dominant mode (maximum posteriori estimate) Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 41

42 Real-world results Work in Progress... x est (2) vs. x true (2) 10 South North axis [meters] A1 A A2 A3 ending point 25 1 starting point The estimated (red line) vs. the true position (gray line) Progress is shown by the orange line Repeat this procedure at eve step West East axis [meters] Figure 10: Location estimation and tracking Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 42

43 Real-world results Work in Progress... p(x 3 r 1:2 ) 10 South North axis [meters] A1 A A2 A3 ending point 25 1 starting point Prediction: p(x 3 z 1:2 ) West East axis [meters] Figure 11: Location estimation and tracking Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 43

44 Real-world results Work in Progress... p(x 3 r 1:2 ) x p(r 3 x 3 ) 10 South North axis [meters] A1 A A2 A3 ending point 25 1 starting point New measurement and its like hood p(z 3 z 3 ) to be multiplied w the prior West East axis [meters] Figure 12: Location estimation and tracking Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 44

45 Real-world results Work in Progress... p(x 3 r 1:3 ) 10 South North axis [meters] A1 A A2 A3 ending point 25 1 starting point New posterior p(x 3 z 1:3 ) West East axis [meters] Figure 13: Location estimation and tracking Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 45

46 Real-world results Work in Progress... x est (3) vs. x true (3) 10 South North axis [meters] A1 A A2 A3 ending point 25 1 starting point New position estimate ˆx 3 and so on West East axis [meters] Figure 14: Location estimation and tracking Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 46

47 Real-world results Work in Progress... x est (25) vs. x true (25) 10 South North axis [meters] A1 A A2 A3 ending point 25 1 starting point Tracked location (red solid line w circle markers) West East axis [meters] Figure 15: Location estimation and tracking Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 47

48 Real-world results Work in Progress... x est (25) vs. x true (25) 10 South North axis [meters] A1 A A2 A3 ending point 25 1 starting point The discretized position estimate West East axis [meters] Figure 16: Location estimation and tracking Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 48

49 Conclusions Bayesian filters represent powerful tools for location estimation and tracking They are able to reliably fuse information originating from multiple (possibly different kind) of sensors Various approaches exist (KF, EKF, UKF, grid-based filter, particle filters...) They have different degrees complexity/accuracy There is no best option, the choice depends on the application at hand Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 49

50 References [AbrPauBar11] T. E. Abrudan, L. M. Paula, J. Barros, J. P. S. Cunha, and N. B. Carvalho, Indoor Location Estimation and Tracking in Wireless Sensor Networks using a Dual Frequency Approach, 2011 IEEE International Conference on Indoor Positioning and Indoor Navigation (IPIN), Guimarães, Portugal, Sep [Sin70] R. A. Singer, Estimating optimal tracking filter performance for manned maneuvering targets, IEEE Transactions on Aerospace and Electronic Systems, vol. AES-6, pp , Jul [ParLee01] S.-T. Park and J. G. Lee, Improved Kalman filter design for three-dimensional radar tracking, IEEE Transactions on Aerospace and Electronic Systems, vol. 37, pp , Apr [Muh03] Matthias Mühlich, Particle filters. An overview, (tutorial presentation), Filter workshop, Bucharest, Romania, [AruMas02] M.S. Arulampalam, S. Maskell, N. Gordon, T.Clapp, A tutorial on particle filters for online nonlinear/non-gaussian Bayesian tracking, IEEE Transactions on Signal Processing, vol.50, no.2, pp , Feb [GusGun02] F. Gustafsson, F. Gunnarsson, N. Bergman, U. Forssell, J. Jansson, R. Karlsson, P.-J. Nordlund, Particle filters for positioning navigation and tracking, IEEE Transactions on Signal Processing, vol.50, no.2, pp , Feb [DouFre02] A. Doucet, N. de Freitas, N. Gordon (Eds.), Sequential Monte Carlo Methods in Practice, Springer Verlag, Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 50

51 References [FoxHig03] V. Fox, J. Hightower, Lin Liao, D. Schulz, G. Borriello, Bayesian filtering for location estimation, IEEE Pervasive Computing, vol.2, no.3, pp , Jul.-Sept [DauHua03] F. Daum, J. Huang, Curse of dimensionality and particle filters, Proceedings of the IEEE Aerospace Conference, 2003, vol.4, no., pp , Mar. 8 15, [DouJoh09] A. Doucet and A.M. Johansen, A tutorial on particle filtering and smoothing: fifteen years later, The Oxford Handbook of Nonlinear Filtering, Oxford University Press, [Hau05] A.J. Haug, A Tutorial on Bayesian Estimation and Tracking Techniques Applicable to Nonlinear and Non-Gaussian Processes, Mitre Corporation Technical Report, MTR 05W (public release), Jan [CarDav07] F. Caron, M. Davy, E. Duflos, P. Vanheeghe, Particle filtering for multiuser data fusion with switching observation models: Applications to land vehicle navigation, IEEE Transactions on Signal Processing, vol.50, no.2, pp , Feb [HueCad02] C. Hue, J.-P. Le Cadre, P. Pérez, Sequential Monte Carlo Methods for Multiple Target Tracking and Data Fusion, IEEE Transactions on Signal Processing, vol.50, no.2, pp , Feb [HenKar10] G. Hendeby, R. Karlsson, F. Gustafsson, The Rao-Blackwellized Particle Filter: A Filter Bank Implementation EURASIP Journal on Advances in Signal Processing. vol. 2010, Article ID , 10 pages, Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 51

52 References [SchGusNor05] T. B. Schön, F. Gustafsson and P.-J. Nordlund, Marginalized particle filters for mixed linear/nonlinear state-space models, IEEE Transactions on Signal Processing, vol. 53, no. 7, pp , Jul [Ber97] N. Bergman, Bayesian Inference in Terrain Navigation, Department of Electrical Engineering, Linköping University, Linköping Studies in Science and Technology. Licentiate Thesis No. 649, Nov [Ber99] N. Bergman, Recursive Bayesian Estimation, Department of Electrical Engineering, Linköping University, Linköping Studies in Science and Technology. Doctoral dissertation No. 579, [Kar05] R. Karlsson, Particle Filtering, Department of Electrical Engineering, Linköping University, Linköping Studies in Science and Technology. Doctoral dissertation No. 924, [Roy11] R. R. Roy, Handbook of Mobility Models and Mobile Ad Hoc Networks, Springer, [QuiSta10] M. Quigley, D. Stavens, A. Coates, and S. Thrun. Sub-Meter Indoor Localization in Unmodified Environments with Inexpensive Sensors. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems 2010 (IROS10), Taipei, Taiwan, [KaiKhi11] S. Kaiser, M. Khider, and P. Robertson, A maps-based angular PDF for navigation systems in indoor and outdoor environments, 2011 IEEE International Conference on Indoor Positioning and Indoor Navigation (IPIN), Guimarães, Portugal, Sep Bayes filters for location estimation and tracking - GETA Winter School: Short Course on Wireless Localization, Ruka, Feb , 2012 p 52

Sensor Fusion: Particle Filter

Sensor Fusion: Particle Filter Sensor Fusion: Particle Filter By: Gordana Stojceska stojcesk@in.tum.de Outline Motivation Applications Fundamentals Tracking People Advantages and disadvantages Summary June 05 JASS '05, St.Petersburg,

More information

Kalman filtering and friends: Inference in time series models. Herke van Hoof slides mostly by Michael Rubinstein

Kalman filtering and friends: Inference in time series models. Herke van Hoof slides mostly by Michael Rubinstein Kalman filtering and friends: Inference in time series models Herke van Hoof slides mostly by Michael Rubinstein Problem overview Goal Estimate most probable state at time k using measurement up to time

More information

2D Image Processing (Extended) Kalman and particle filter

2D Image Processing (Extended) Kalman and particle filter 2D Image Processing (Extended) Kalman and particle filter Prof. Didier Stricker Dr. Gabriele Bleser Kaiserlautern University http://ags.cs.uni-kl.de/ DFKI Deutsches Forschungszentrum für Künstliche Intelligenz

More information

L09. PARTICLE FILTERING. NA568 Mobile Robotics: Methods & Algorithms

L09. PARTICLE FILTERING. NA568 Mobile Robotics: Methods & Algorithms L09. PARTICLE FILTERING NA568 Mobile Robotics: Methods & Algorithms Particle Filters Different approach to state estimation Instead of parametric description of state (and uncertainty), use a set of state

More information

TSRT14: Sensor Fusion Lecture 8

TSRT14: Sensor Fusion Lecture 8 TSRT14: Sensor Fusion Lecture 8 Particle filter theory Marginalized particle filter Gustaf Hendeby gustaf.hendeby@liu.se TSRT14 Lecture 8 Gustaf Hendeby Spring 2018 1 / 25 Le 8: particle filter theory,

More information

2D Image Processing. Bayes filter implementation: Kalman filter

2D Image Processing. Bayes filter implementation: Kalman filter 2D Image Processing Bayes filter implementation: Kalman filter Prof. Didier Stricker Kaiserlautern University http://ags.cs.uni-kl.de/ DFKI Deutsches Forschungszentrum für Künstliche Intelligenz http://av.dfki.de

More information

Lecture 2: From Linear Regression to Kalman Filter and Beyond

Lecture 2: From Linear Regression to Kalman Filter and Beyond Lecture 2: From Linear Regression to Kalman Filter and Beyond January 18, 2017 Contents 1 Batch and Recursive Estimation 2 Towards Bayesian Filtering 3 Kalman Filter and Bayesian Filtering and Smoothing

More information

An introduction to particle filters

An introduction to particle filters An introduction to particle filters Andreas Svensson Department of Information Technology Uppsala University June 10, 2014 June 10, 2014, 1 / 16 Andreas Svensson - An introduction to particle filters Outline

More information

System identification and sensor fusion in dynamical systems. Thomas Schön Division of Systems and Control, Uppsala University, Sweden.

System identification and sensor fusion in dynamical systems. Thomas Schön Division of Systems and Control, Uppsala University, Sweden. System identification and sensor fusion in dynamical systems Thomas Schön Division of Systems and Control, Uppsala University, Sweden. The system identification and sensor fusion problem Inertial sensors

More information

RAO-BLACKWELLISED PARTICLE FILTERS: EXAMPLES OF APPLICATIONS

RAO-BLACKWELLISED PARTICLE FILTERS: EXAMPLES OF APPLICATIONS RAO-BLACKWELLISED PARTICLE FILTERS: EXAMPLES OF APPLICATIONS Frédéric Mustière e-mail: mustiere@site.uottawa.ca Miodrag Bolić e-mail: mbolic@site.uottawa.ca Martin Bouchard e-mail: bouchard@site.uottawa.ca

More information

SEQUENTIAL MONTE CARLO METHODS WITH APPLICATIONS TO COMMUNICATION CHANNELS. A Thesis SIRISH BODDIKURAPATI

SEQUENTIAL MONTE CARLO METHODS WITH APPLICATIONS TO COMMUNICATION CHANNELS. A Thesis SIRISH BODDIKURAPATI SEQUENTIAL MONTE CARLO METHODS WITH APPLICATIONS TO COMMUNICATION CHANNELS A Thesis by SIRISH BODDIKURAPATI Submitted to the Office of Graduate Studies of Texas A&M University in partial fulfillment of

More information

Lecture 7: Optimal Smoothing

Lecture 7: Optimal Smoothing Department of Biomedical Engineering and Computational Science Aalto University March 17, 2011 Contents 1 What is Optimal Smoothing? 2 Bayesian Optimal Smoothing Equations 3 Rauch-Tung-Striebel Smoother

More information

The Kalman Filter ImPr Talk

The Kalman Filter ImPr Talk The Kalman Filter ImPr Talk Ged Ridgway Centre for Medical Image Computing November, 2006 Outline What is the Kalman Filter? State Space Models Kalman Filter Overview Bayesian Updating of Estimates Kalman

More information

The Unscented Particle Filter

The Unscented Particle Filter The Unscented Particle Filter Rudolph van der Merwe (OGI) Nando de Freitas (UC Bereley) Arnaud Doucet (Cambridge University) Eric Wan (OGI) Outline Optimal Estimation & Filtering Optimal Recursive Bayesian

More information

AN EFFICIENT TWO-STAGE SAMPLING METHOD IN PARTICLE FILTER. Qi Cheng and Pascal Bondon. CNRS UMR 8506, Université Paris XI, France.

AN EFFICIENT TWO-STAGE SAMPLING METHOD IN PARTICLE FILTER. Qi Cheng and Pascal Bondon. CNRS UMR 8506, Université Paris XI, France. AN EFFICIENT TWO-STAGE SAMPLING METHOD IN PARTICLE FILTER Qi Cheng and Pascal Bondon CNRS UMR 8506, Université Paris XI, France. August 27, 2011 Abstract We present a modified bootstrap filter to draw

More information

PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 13: SEQUENTIAL DATA

PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 13: SEQUENTIAL DATA PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 13: SEQUENTIAL DATA Contents in latter part Linear Dynamical Systems What is different from HMM? Kalman filter Its strength and limitation Particle Filter

More information

Sequential Monte Carlo Methods for Bayesian Computation

Sequential Monte Carlo Methods for Bayesian Computation Sequential Monte Carlo Methods for Bayesian Computation A. Doucet Kyoto Sept. 2012 A. Doucet (MLSS Sept. 2012) Sept. 2012 1 / 136 Motivating Example 1: Generic Bayesian Model Let X be a vector parameter

More information

2D Image Processing. Bayes filter implementation: Kalman filter

2D Image Processing. Bayes filter implementation: Kalman filter 2D Image Processing Bayes filter implementation: Kalman filter Prof. Didier Stricker Dr. Gabriele Bleser Kaiserlautern University http://ags.cs.uni-kl.de/ DFKI Deutsches Forschungszentrum für Künstliche

More information

Robotics. Mobile Robotics. Marc Toussaint U Stuttgart

Robotics. Mobile Robotics. Marc Toussaint U Stuttgart Robotics Mobile Robotics State estimation, Bayes filter, odometry, particle filter, Kalman filter, SLAM, joint Bayes filter, EKF SLAM, particle SLAM, graph-based SLAM Marc Toussaint U Stuttgart DARPA Grand

More information

EVALUATING SYMMETRIC INFORMATION GAP BETWEEN DYNAMICAL SYSTEMS USING PARTICLE FILTER

EVALUATING SYMMETRIC INFORMATION GAP BETWEEN DYNAMICAL SYSTEMS USING PARTICLE FILTER EVALUATING SYMMETRIC INFORMATION GAP BETWEEN DYNAMICAL SYSTEMS USING PARTICLE FILTER Zhen Zhen 1, Jun Young Lee 2, and Abdus Saboor 3 1 Mingde College, Guizhou University, China zhenz2000@21cn.com 2 Department

More information

Lecture 2: From Linear Regression to Kalman Filter and Beyond

Lecture 2: From Linear Regression to Kalman Filter and Beyond Lecture 2: From Linear Regression to Kalman Filter and Beyond Department of Biomedical Engineering and Computational Science Aalto University January 26, 2012 Contents 1 Batch and Recursive Estimation

More information

9 Multi-Model State Estimation

9 Multi-Model State Estimation Technion Israel Institute of Technology, Department of Electrical Engineering Estimation and Identification in Dynamical Systems (048825) Lecture Notes, Fall 2009, Prof. N. Shimkin 9 Multi-Model State

More information

RAO-BLACKWELLIZED PARTICLE FILTER FOR MARKOV MODULATED NONLINEARDYNAMIC SYSTEMS

RAO-BLACKWELLIZED PARTICLE FILTER FOR MARKOV MODULATED NONLINEARDYNAMIC SYSTEMS RAO-BLACKWELLIZED PARTICLE FILTER FOR MARKOV MODULATED NONLINEARDYNAMIC SYSTEMS Saiat Saha and Gustaf Hendeby Linöping University Post Print N.B.: When citing this wor, cite the original article. 2014

More information

Content.

Content. Content Fundamentals of Bayesian Techniques (E. Sucar) Bayesian Filters (O. Aycard) Definition & interests Implementations Hidden Markov models Discrete Bayesian Filters or Markov localization Kalman filters

More information

A Brief Tutorial On Recursive Estimation With Examples From Intelligent Vehicle Applications (Part IV): Sampling Based Methods And The Particle Filter

A Brief Tutorial On Recursive Estimation With Examples From Intelligent Vehicle Applications (Part IV): Sampling Based Methods And The Particle Filter A Brief Tutorial On Recursive Estimation With Examples From Intelligent Vehicle Applications (Part IV): Sampling Based Methods And The Particle Filter Hao Li To cite this version: Hao Li. A Brief Tutorial

More information

Nonlinear and/or Non-normal Filtering. Jesús Fernández-Villaverde University of Pennsylvania

Nonlinear and/or Non-normal Filtering. Jesús Fernández-Villaverde University of Pennsylvania Nonlinear and/or Non-normal Filtering Jesús Fernández-Villaverde University of Pennsylvania 1 Motivation Nonlinear and/or non-gaussian filtering, smoothing, and forecasting (NLGF) problems are pervasive

More information

A new unscented Kalman filter with higher order moment-matching

A new unscented Kalman filter with higher order moment-matching A new unscented Kalman filter with higher order moment-matching KSENIA PONOMAREVA, PARESH DATE AND ZIDONG WANG Department of Mathematical Sciences, Brunel University, Uxbridge, UB8 3PH, UK. Abstract This

More information

AUTOMOTIVE ENVIRONMENT SENSORS

AUTOMOTIVE ENVIRONMENT SENSORS AUTOMOTIVE ENVIRONMENT SENSORS Lecture 5. Localization BME KÖZLEKEDÉSMÉRNÖKI ÉS JÁRMŰMÉRNÖKI KAR 32708-2/2017/INTFIN SZÁMÚ EMMI ÁLTAL TÁMOGATOTT TANANYAG Related concepts Concepts related to vehicles moving

More information

An Brief Overview of Particle Filtering

An Brief Overview of Particle Filtering 1 An Brief Overview of Particle Filtering Adam M. Johansen a.m.johansen@warwick.ac.uk www2.warwick.ac.uk/fac/sci/statistics/staff/academic/johansen/talks/ May 11th, 2010 Warwick University Centre for Systems

More information

FUNDAMENTAL FILTERING LIMITATIONS IN LINEAR NON-GAUSSIAN SYSTEMS

FUNDAMENTAL FILTERING LIMITATIONS IN LINEAR NON-GAUSSIAN SYSTEMS FUNDAMENTAL FILTERING LIMITATIONS IN LINEAR NON-GAUSSIAN SYSTEMS Gustaf Hendeby Fredrik Gustafsson Division of Automatic Control Department of Electrical Engineering, Linköpings universitet, SE-58 83 Linköping,

More information

L11. EKF SLAM: PART I. NA568 Mobile Robotics: Methods & Algorithms

L11. EKF SLAM: PART I. NA568 Mobile Robotics: Methods & Algorithms L11. EKF SLAM: PART I NA568 Mobile Robotics: Methods & Algorithms Today s Topic EKF Feature-Based SLAM State Representation Process / Observation Models Landmark Initialization Robot-Landmark Correlation

More information

Computer Intensive Methods in Mathematical Statistics

Computer Intensive Methods in Mathematical Statistics Computer Intensive Methods in Mathematical Statistics Department of mathematics johawes@kth.se Lecture 7 Sequential Monte Carlo methods III 7 April 2017 Computer Intensive Methods (1) Plan of today s lecture

More information

Using the Kalman Filter to Estimate the State of a Maneuvering Aircraft

Using the Kalman Filter to Estimate the State of a Maneuvering Aircraft 1 Using the Kalman Filter to Estimate the State of a Maneuvering Aircraft K. Meier and A. Desai Abstract Using sensors that only measure the bearing angle and range of an aircraft, a Kalman filter is implemented

More information

A Monte Carlo Sequential Estimation for Point Process Optimum Filtering

A Monte Carlo Sequential Estimation for Point Process Optimum Filtering 2006 International Joint Conference on Neural Networks Sheraton Vancouver Wall Centre Hotel, Vancouver, BC, Canada July 16-21, 2006 A Monte Carlo Sequential Estimation for Point Process Optimum Filtering

More information

Advanced Computational Methods in Statistics: Lecture 5 Sequential Monte Carlo/Particle Filtering

Advanced Computational Methods in Statistics: Lecture 5 Sequential Monte Carlo/Particle Filtering Advanced Computational Methods in Statistics: Lecture 5 Sequential Monte Carlo/Particle Filtering Axel Gandy Department of Mathematics Imperial College London http://www2.imperial.ac.uk/~agandy London

More information

PARTICLE FILTERS WITH INDEPENDENT RESAMPLING

PARTICLE FILTERS WITH INDEPENDENT RESAMPLING PARTICLE FILTERS WITH INDEPENDENT RESAMPLING Roland Lamberti 1, Yohan Petetin 1, François Septier, François Desbouvries 1 (1) Samovar, Telecom Sudparis, CNRS, Université Paris-Saclay, 9 rue Charles Fourier,

More information

Lecture 6: Bayesian Inference in SDE Models

Lecture 6: Bayesian Inference in SDE Models Lecture 6: Bayesian Inference in SDE Models Bayesian Filtering and Smoothing Point of View Simo Särkkä Aalto University Simo Särkkä (Aalto) Lecture 6: Bayesian Inference in SDEs 1 / 45 Contents 1 SDEs

More information

Bayesian Methods in Positioning Applications

Bayesian Methods in Positioning Applications Bayesian Methods in Positioning Applications Vedran Dizdarević v.dizdarevic@tugraz.at Graz University of Technology, Austria 24. May 2006 Bayesian Methods in Positioning Applications p.1/21 Outline Problem

More information

ECE276A: Sensing & Estimation in Robotics Lecture 10: Gaussian Mixture and Particle Filtering

ECE276A: Sensing & Estimation in Robotics Lecture 10: Gaussian Mixture and Particle Filtering ECE276A: Sensing & Estimation in Robotics Lecture 10: Gaussian Mixture and Particle Filtering Lecturer: Nikolay Atanasov: natanasov@ucsd.edu Teaching Assistants: Siwei Guo: s9guo@eng.ucsd.edu Anwesan Pal:

More information

Human Pose Tracking I: Basics. David Fleet University of Toronto

Human Pose Tracking I: Basics. David Fleet University of Toronto Human Pose Tracking I: Basics David Fleet University of Toronto CIFAR Summer School, 2009 Looking at People Challenges: Complex pose / motion People have many degrees of freedom, comprising an articulated

More information

ROBOTICS 01PEEQW. Basilio Bona DAUIN Politecnico di Torino

ROBOTICS 01PEEQW. Basilio Bona DAUIN Politecnico di Torino ROBOTICS 01PEEQW Basilio Bona DAUIN Politecnico di Torino Probabilistic Fundamentals in Robotics Gaussian Filters Course Outline Basic mathematical framework Probabilistic models of mobile robots Mobile

More information

Local Positioning with Parallelepiped Moving Grid

Local Positioning with Parallelepiped Moving Grid Local Positioning with Parallelepiped Moving Grid, WPNC06 16.3.2006, niilo.sirola@tut.fi p. 1/?? TA M P E R E U N I V E R S I T Y O F T E C H N O L O G Y M a t h e m a t i c s Local Positioning with Parallelepiped

More information

NONLINEAR STATISTICAL SIGNAL PROCESSING: A PARTI- CLE FILTERING APPROACH

NONLINEAR STATISTICAL SIGNAL PROCESSING: A PARTI- CLE FILTERING APPROACH NONLINEAR STATISTICAL SIGNAL PROCESSING: A PARTI- CLE FILTERING APPROACH J. V. Candy (tsoftware@aol.com) University of California, Lawrence Livermore National Lab. & Santa Barbara Livermore CA 94551 USA

More information

Efficient Monitoring for Planetary Rovers

Efficient Monitoring for Planetary Rovers International Symposium on Artificial Intelligence and Robotics in Space (isairas), May, 2003 Efficient Monitoring for Planetary Rovers Vandi Verma vandi@ri.cmu.edu Geoff Gordon ggordon@cs.cmu.edu Carnegie

More information

Rao-Blackwellized Particle Filter for Multiple Target Tracking

Rao-Blackwellized Particle Filter for Multiple Target Tracking Rao-Blackwellized Particle Filter for Multiple Target Tracking Simo Särkkä, Aki Vehtari, Jouko Lampinen Helsinki University of Technology, Finland Abstract In this article we propose a new Rao-Blackwellized

More information

Feedback Particle Filter:Application and Evaluation

Feedback Particle Filter:Application and Evaluation MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com Feedback Particle Filter:Application and Evaluation Berntorp, K. TR2015-074 July 2015 Abstract Recent research has provided several new methods

More information

From Bayes to Extended Kalman Filter

From Bayes to Extended Kalman Filter From Bayes to Extended Kalman Filter Michal Reinštein Czech Technical University in Prague Faculty of Electrical Engineering, Department of Cybernetics Center for Machine Perception http://cmp.felk.cvut.cz/

More information

Inferring biological dynamics Iterated filtering (IF)

Inferring biological dynamics Iterated filtering (IF) Inferring biological dynamics 101 3. Iterated filtering (IF) IF originated in 2006 [6]. For plug-and-play likelihood-based inference on POMP models, there are not many alternatives. Directly estimating

More information

The Particle Filter. PD Dr. Rudolph Triebel Computer Vision Group. Machine Learning for Computer Vision

The Particle Filter. PD Dr. Rudolph Triebel Computer Vision Group. Machine Learning for Computer Vision The Particle Filter Non-parametric implementation of Bayes filter Represents the belief (posterior) random state samples. by a set of This representation is approximate. Can represent distributions that

More information

Probability Map Building of Uncertain Dynamic Environments with Indistinguishable Obstacles

Probability Map Building of Uncertain Dynamic Environments with Indistinguishable Obstacles Probability Map Building of Uncertain Dynamic Environments with Indistinguishable Obstacles Myungsoo Jun and Raffaello D Andrea Sibley School of Mechanical and Aerospace Engineering Cornell University

More information

Auxiliary Particle Methods

Auxiliary Particle Methods Auxiliary Particle Methods Perspectives & Applications Adam M. Johansen 1 adam.johansen@bristol.ac.uk Oxford University Man Institute 29th May 2008 1 Collaborators include: Arnaud Doucet, Nick Whiteley

More information

Particle Filters. Outline

Particle Filters. Outline Particle Filters M. Sami Fadali Professor of EE University of Nevada Outline Monte Carlo integration. Particle filter. Importance sampling. Degeneracy Resampling Example. 1 2 Monte Carlo Integration Numerical

More information

Evolution Strategies Based Particle Filters for Fault Detection

Evolution Strategies Based Particle Filters for Fault Detection Evolution Strategies Based Particle Filters for Fault Detection Katsuji Uosaki, Member, IEEE, and Toshiharu Hatanaka, Member, IEEE Abstract Recent massive increase of the computational power has allowed

More information

State Estimation using Moving Horizon Estimation and Particle Filtering

State Estimation using Moving Horizon Estimation and Particle Filtering State Estimation using Moving Horizon Estimation and Particle Filtering James B. Rawlings Department of Chemical and Biological Engineering UW Math Probability Seminar Spring 2009 Rawlings MHE & PF 1 /

More information

Artificial Intelligence

Artificial Intelligence Artificial Intelligence Roman Barták Department of Theoretical Computer Science and Mathematical Logic Summary of last lecture We know how to do probabilistic reasoning over time transition model P(X t

More information

Kernel adaptive Sequential Monte Carlo

Kernel adaptive Sequential Monte Carlo Kernel adaptive Sequential Monte Carlo Ingmar Schuster (Paris Dauphine) Heiko Strathmann (University College London) Brooks Paige (Oxford) Dino Sejdinovic (Oxford) December 7, 2015 1 / 36 Section 1 Outline

More information

EKF and SLAM. McGill COMP 765 Sept 18 th, 2017

EKF and SLAM. McGill COMP 765 Sept 18 th, 2017 EKF and SLAM McGill COMP 765 Sept 18 th, 2017 Outline News and information Instructions for paper presentations Continue on Kalman filter: EKF and extension to mapping Example of a real mapping system:

More information

Improved Particle Filtering Based on Biogeography-based Optimization for UGV Navigation

Improved Particle Filtering Based on Biogeography-based Optimization for UGV Navigation Improved Particle Filtering Based on Biogeography-based Optimization for UGV Navigation A. Kuifeng Su 1,2, B. Zhidong Deng 1, and C. Zhen Huang 1 1 Department of Computer Science, State Key Laboratory

More information

Monte Carlo Approximation of Monte Carlo Filters

Monte Carlo Approximation of Monte Carlo Filters Monte Carlo Approximation of Monte Carlo Filters Adam M. Johansen et al. Collaborators Include: Arnaud Doucet, Axel Finke, Anthony Lee, Nick Whiteley 7th January 2014 Context & Outline Filtering in State-Space

More information

Sequential Monte Carlo and Particle Filtering. Frank Wood Gatsby, November 2007

Sequential Monte Carlo and Particle Filtering. Frank Wood Gatsby, November 2007 Sequential Monte Carlo and Particle Filtering Frank Wood Gatsby, November 2007 Importance Sampling Recall: Let s say that we want to compute some expectation (integral) E p [f] = p(x)f(x)dx and we remember

More information

Lecture Outline. Target Tracking: Lecture 3 Maneuvering Target Tracking Issues. Maneuver Illustration. Maneuver Illustration. Maneuver Detection

Lecture Outline. Target Tracking: Lecture 3 Maneuvering Target Tracking Issues. Maneuver Illustration. Maneuver Illustration. Maneuver Detection REGLERTEKNIK Lecture Outline AUTOMATIC CONTROL Target Tracking: Lecture 3 Maneuvering Target Tracking Issues Maneuver Detection Emre Özkan emre@isy.liu.se Division of Automatic Control Department of Electrical

More information

Target Tracking and Classification using Collaborative Sensor Networks

Target Tracking and Classification using Collaborative Sensor Networks Target Tracking and Classification using Collaborative Sensor Networks Xiaodong Wang Department of Electrical Engineering Columbia University p.1/3 Talk Outline Background on distributed wireless sensor

More information

SLAM Techniques and Algorithms. Jack Collier. Canada. Recherche et développement pour la défense Canada. Defence Research and Development Canada

SLAM Techniques and Algorithms. Jack Collier. Canada. Recherche et développement pour la défense Canada. Defence Research and Development Canada SLAM Techniques and Algorithms Jack Collier Defence Research and Development Canada Recherche et développement pour la défense Canada Canada Goals What will we learn Gain an appreciation for what SLAM

More information

Particle Filters. Pieter Abbeel UC Berkeley EECS. Many slides adapted from Thrun, Burgard and Fox, Probabilistic Robotics

Particle Filters. Pieter Abbeel UC Berkeley EECS. Many slides adapted from Thrun, Burgard and Fox, Probabilistic Robotics Particle Filters Pieter Abbeel UC Berkeley EECS Many slides adapted from Thrun, Burgard and Fox, Probabilistic Robotics Motivation For continuous spaces: often no analytical formulas for Bayes filter updates

More information

CIS 390 Fall 2016 Robotics: Planning and Perception Final Review Questions

CIS 390 Fall 2016 Robotics: Planning and Perception Final Review Questions CIS 390 Fall 2016 Robotics: Planning and Perception Final Review Questions December 14, 2016 Questions Throughout the following questions we will assume that x t is the state vector at time t, z t is the

More information

Exercises Tutorial at ICASSP 2016 Learning Nonlinear Dynamical Models Using Particle Filters

Exercises Tutorial at ICASSP 2016 Learning Nonlinear Dynamical Models Using Particle Filters Exercises Tutorial at ICASSP 216 Learning Nonlinear Dynamical Models Using Particle Filters Andreas Svensson, Johan Dahlin and Thomas B. Schön March 18, 216 Good luck! 1 [Bootstrap particle filter for

More information

Robotics 2 Target Tracking. Kai Arras, Cyrill Stachniss, Maren Bennewitz, Wolfram Burgard

Robotics 2 Target Tracking. Kai Arras, Cyrill Stachniss, Maren Bennewitz, Wolfram Burgard Robotics 2 Target Tracking Kai Arras, Cyrill Stachniss, Maren Bennewitz, Wolfram Burgard Slides by Kai Arras, Gian Diego Tipaldi, v.1.1, Jan 2012 Chapter Contents Target Tracking Overview Applications

More information

Blind Equalization via Particle Filtering

Blind Equalization via Particle Filtering Blind Equalization via Particle Filtering Yuki Yoshida, Kazunori Hayashi, Hideaki Sakai Department of System Science, Graduate School of Informatics, Kyoto University Historical Remarks A sequential Monte

More information

Robotics. Lecture 4: Probabilistic Robotics. See course website for up to date information.

Robotics. Lecture 4: Probabilistic Robotics. See course website   for up to date information. Robotics Lecture 4: Probabilistic Robotics See course website http://www.doc.ic.ac.uk/~ajd/robotics/ for up to date information. Andrew Davison Department of Computing Imperial College London Review: Sensors

More information

Probabilistic Fundamentals in Robotics. DAUIN Politecnico di Torino July 2010

Probabilistic Fundamentals in Robotics. DAUIN Politecnico di Torino July 2010 Probabilistic Fundamentals in Robotics Gaussian Filters Basilio Bona DAUIN Politecnico di Torino July 2010 Course Outline Basic mathematical framework Probabilistic models of mobile robots Mobile robot

More information

L06. LINEAR KALMAN FILTERS. NA568 Mobile Robotics: Methods & Algorithms

L06. LINEAR KALMAN FILTERS. NA568 Mobile Robotics: Methods & Algorithms L06. LINEAR KALMAN FILTERS NA568 Mobile Robotics: Methods & Algorithms 2 PS2 is out! Landmark-based Localization: EKF, UKF, PF Today s Lecture Minimum Mean Square Error (MMSE) Linear Kalman Filter Gaussian

More information

An introduction to Sequential Monte Carlo

An introduction to Sequential Monte Carlo An introduction to Sequential Monte Carlo Thang Bui Jes Frellsen Department of Engineering University of Cambridge Research and Communication Club 6 February 2014 1 Sequential Monte Carlo (SMC) methods

More information

arxiv: v1 [cs.ro] 1 May 2015

arxiv: v1 [cs.ro] 1 May 2015 215 IEEE International Conference on Robotics and Automation (ICRA) May 26-3, 215. Seattle, USA The Coordinate Particle Filter - A novel Particle Filter for High Dimensional Systems Manuel Wüthrich 1,

More information

State Estimation Based on Nested Particle Filters

State Estimation Based on Nested Particle Filters Cleveland State University EngagedScholarship@CSU ETD Archive 2013 State Estimation Based on Nested Particle Filters Swathi Srinivasan Cleveland State University How does access to this work benefit you?

More information

Tracking an Accelerated Target with a Nonlinear Constant Heading Model

Tracking an Accelerated Target with a Nonlinear Constant Heading Model Tracking an Accelerated Target with a Nonlinear Constant Heading Model Rong Yang, Gee Wah Ng DSO National Laboratories 20 Science Park Drive Singapore 118230 yrong@dsoorgsg ngeewah@dsoorgsg Abstract This

More information

Introduction to Particle Filters for Data Assimilation

Introduction to Particle Filters for Data Assimilation Introduction to Particle Filters for Data Assimilation Mike Dowd Dept of Mathematics & Statistics (and Dept of Oceanography Dalhousie University, Halifax, Canada STATMOS Summer School in Data Assimila5on,

More information

Particle lter for mobile robot tracking and localisation

Particle lter for mobile robot tracking and localisation Particle lter for mobile robot tracking and localisation Tinne De Laet K.U.Leuven, Dept. Werktuigkunde 19 oktober 2005 Particle lter 1 Overview Goal Introduction Particle lter Simulations Particle lter

More information

Autonomous Mobile Robot Design

Autonomous Mobile Robot Design Autonomous Mobile Robot Design Topic: Extended Kalman Filter Dr. Kostas Alexis (CSE) These slides relied on the lectures from C. Stachniss, J. Sturm and the book Probabilistic Robotics from Thurn et al.

More information

Combined Particle and Smooth Variable Structure Filtering for Nonlinear Estimation Problems

Combined Particle and Smooth Variable Structure Filtering for Nonlinear Estimation Problems 14th International Conference on Information Fusion Chicago, Illinois, USA, July 5-8, 2011 Combined Particle and Smooth Variable Structure Filtering for Nonlinear Estimation Problems S. Andrew Gadsden

More information

Terrain Navigation Using the Ambient Magnetic Field as a Map

Terrain Navigation Using the Ambient Magnetic Field as a Map Terrain Navigation Using the Ambient Magnetic Field as a Map Aalto University IndoorAtlas Ltd. August 30, 017 In collaboration with M. Kok, N. Wahlström, T. B. Schön, J. Kannala, E. Rahtu, and S. Särkkä

More information

Censoring and Fusion in Non-linear Distributed Tracking Systems with Application to 2D Radar

Censoring and Fusion in Non-linear Distributed Tracking Systems with Application to 2D Radar Virginia Commonwealth University VCU Scholars Compass Theses and Dissertations Graduate School 15 Censoring and Fusion in Non-linear Distributed Tracking Systems with Application to D Radar Armond S. Conte

More information

Probabilistic Robotics

Probabilistic Robotics University of Rome La Sapienza Master in Artificial Intelligence and Robotics Probabilistic Robotics Prof. Giorgio Grisetti Course web site: http://www.dis.uniroma1.it/~grisetti/teaching/probabilistic_ro

More information

IN particle filter (PF) applications, knowledge of the computational

IN particle filter (PF) applications, knowledge of the computational Complexity Analysis of the Marginalized Particle Filter Rickard Karlsson, Thomas Schön and Fredrik Gustafsson, Member IEEE Abstract In this paper the computational complexity of the marginalized particle

More information

Vlad Estivill-Castro. Robots for People --- A project for intelligent integrated systems

Vlad Estivill-Castro. Robots for People --- A project for intelligent integrated systems 1 Vlad Estivill-Castro Robots for People --- A project for intelligent integrated systems V. Estivill-Castro 2 Probabilistic Map-based Localization (Kalman Filter) Chapter 5 (textbook) Based on textbook

More information

Sequential Bayesian Inference for Dynamic State Space. Model Parameters

Sequential Bayesian Inference for Dynamic State Space. Model Parameters Sequential Bayesian Inference for Dynamic State Space Model Parameters Arnab Bhattacharya and Simon Wilson 1. INTRODUCTION Dynamic state-space models [24], consisting of a latent Markov process X 0,X 1,...

More information

Markov chain Monte Carlo methods for visual tracking

Markov chain Monte Carlo methods for visual tracking Markov chain Monte Carlo methods for visual tracking Ray Luo rluo@cory.eecs.berkeley.edu Department of Electrical Engineering and Computer Sciences University of California, Berkeley Berkeley, CA 94720

More information

A Tree Search Approach to Target Tracking in Clutter

A Tree Search Approach to Target Tracking in Clutter 12th International Conference on Information Fusion Seattle, WA, USA, July 6-9, 2009 A Tree Search Approach to Target Tracking in Clutter Jill K. Nelson and Hossein Roufarshbaf Department of Electrical

More information

Self Adaptive Particle Filter

Self Adaptive Particle Filter Self Adaptive Particle Filter Alvaro Soto Pontificia Universidad Catolica de Chile Department of Computer Science Vicuna Mackenna 4860 (143), Santiago 22, Chile asoto@ing.puc.cl Abstract The particle filter

More information

The Hierarchical Particle Filter

The Hierarchical Particle Filter and Arnaud Doucet http://go.warwick.ac.uk/amjohansen/talks MCMSki V Lenzerheide 7th January 2016 Context & Outline Filtering in State-Space Models: SIR Particle Filters [GSS93] Block-Sampling Particle

More information

Suppression of impulse noise in Track-Before-Detect Algorithms

Suppression of impulse noise in Track-Before-Detect Algorithms Computer Applications in Electrical Engineering Suppression of impulse noise in Track-Before-Detect Algorithms Przemysław Mazurek West-Pomeranian University of Technology 71-126 Szczecin, ul. 26. Kwietnia

More information

Linear Dynamical Systems

Linear Dynamical Systems Linear Dynamical Systems Sargur N. srihari@cedar.buffalo.edu Machine Learning Course: http://www.cedar.buffalo.edu/~srihari/cse574/index.html Two Models Described by Same Graph Latent variables Observations

More information

Implementation of Particle Filter-based Target Tracking

Implementation of Particle Filter-based Target Tracking of -based V. Rajbabu rajbabu@ee.iitb.ac.in VLSI Group Seminar Dept. of Electrical Engineering IIT Bombay November 15, 2007 Outline Introduction 1 Introduction 2 3 4 5 2 / 55 Outline Introduction 1 Introduction

More information

Distributed estimation in sensor networks

Distributed estimation in sensor networks in sensor networks A. Benavoli Dpt. di Sistemi e Informatica Università di Firenze, Italy. e-mail: benavoli@dsi.unifi.it Outline 1 An introduction to 2 3 An introduction to An introduction to In recent

More information

Dynamic System Identification using HDMR-Bayesian Technique

Dynamic System Identification using HDMR-Bayesian Technique Dynamic System Identification using HDMR-Bayesian Technique *Shereena O A 1) and Dr. B N Rao 2) 1), 2) Department of Civil Engineering, IIT Madras, Chennai 600036, Tamil Nadu, India 1) ce14d020@smail.iitm.ac.in

More information

Mini-Course 07 Kalman Particle Filters. Henrique Massard da Fonseca Cesar Cunha Pacheco Wellington Bettencurte Julio Dutra

Mini-Course 07 Kalman Particle Filters. Henrique Massard da Fonseca Cesar Cunha Pacheco Wellington Bettencurte Julio Dutra Mini-Course 07 Kalman Particle Filters Henrique Massard da Fonseca Cesar Cunha Pacheco Wellington Bettencurte Julio Dutra Agenda State Estimation Problems & Kalman Filter Henrique Massard Steady State

More information

Constrained State Estimation Using the Unscented Kalman Filter

Constrained State Estimation Using the Unscented Kalman Filter 16th Mediterranean Conference on Control and Automation Congress Centre, Ajaccio, France June 25-27, 28 Constrained State Estimation Using the Unscented Kalman Filter Rambabu Kandepu, Lars Imsland and

More information

Perception: objects in the environment

Perception: objects in the environment Zsolt Vizi, Ph.D. 2018 Self-driving cars Sensor fusion: one categorization Type 1: low-level/raw data fusion combining several sources of raw data to produce new data that is expected to be more informative

More information

Sensor Tasking and Control

Sensor Tasking and Control Sensor Tasking and Control Sensing Networking Leonidas Guibas Stanford University Computation CS428 Sensor systems are about sensing, after all... System State Continuous and Discrete Variables The quantities

More information

A Comparison of Mobile Robot Pose Estimation using Non-linear Filters: Simulation and Experimental Results

A Comparison of Mobile Robot Pose Estimation using Non-linear Filters: Simulation and Experimental Results 1 A Comparison of Mobile Robot Pose Estimation using Non-linear Filters: Simulation and Experimental Results Zongwen Xue and Howard Schwartz Department of System and Computer Engineering Carleton University

More information

Mini-course 07: Kalman and Particle Filters Particle Filters Fundamentals, algorithms and applications

Mini-course 07: Kalman and Particle Filters Particle Filters Fundamentals, algorithms and applications Mini-course 07: Kalman and Particle Filters Particle Filters Fundamentals, algorithms and applications Henrique Fonseca & Cesar Pacheco Wellington Betencurte 1 & Julio Dutra 2 Federal University of Espírito

More information