The Unscented Particle Filter
|
|
- David Shields
- 5 years ago
- Views:
Transcription
1 The Unscented Particle Filter Rudolph van der Merwe (OGI) Nando de Freitas (UC Bereley) Arnaud Doucet (Cambridge University) Eric Wan (OGI)
2 Outline Optimal Estimation & Filtering Optimal Recursive Bayesian Solution Practical Solutions Gaussian approximations (EKF, UKF) Sequential Monte Carlo methods (Particle Filters) The Unscented Particle Filter The Unscented Transformation and UKF Applications of UT/UKF to Particle Filters Experimental Results Conclusions
3 Filtering General problem statement y y 2 1 y Observed p( y x ) Unobserved x 2 x 1 p( x x ) 1 x Filtering is the problem of sequentially estimating the states (parameters or hidden variables) of a system as a set of observations become available on-line.
4 Filtering Solution of sequential estimation problem given by Posterior density : p( X Y ) X = { x, x,, x } 1 2 Y = { y, y,, y } 1 2 By recursively computing a marginal of the posterior, the filtering density, p( x Y ) one need not eep trac of the complete history of the states.
5 Filtering Given the filtering density, a number of estimates of the system state can be calculated: Mean (optimal MMSE estimate of state) xˆ E x Y x p( x Y ) dx [ ] = = Mode Median Confidence intervals Kurtosis, etc.
6 State Space Formulation of System General discrete-time nonlinear, non-gaussian dynamic system state x = f( x, u, v ) y = hx (, u, n ) process noise nown input noisy observation measurement noise Assumptions : 1) States follow a first order Marov process p( x x, x,, x ) = p( x x ) ) Observations independent given the states p( y x, A) = p( y x )
7 Recursive Bayesian Estimation Given this state space model, how do we recursively estimate the filtering density? p( x Y ) = = = = = p( Y x) p( x) p( Y ) p( y, Y 1 x) p( x) p( y, Y ) 1 p( y Y 1, x) p( Y 1 x) p( x) p( y Y ) p( Y ) 1 1 p( y Y 1, x) p( x Y 1) p( Y 1) p( x ) p( y Y ) p( Y ) p( x ) p( y 1 1 x) p( x Y 1) p( y Y ) 1
8 Recursive Bayesian Estimation lielihood prior posterior p( x Y ) = p( y x) p( x Y 1) p( y Y ) 1 evidence Prior : p( x Y ) = p( x x ) p( x Y ) dx transition density given by process model (Propagation of past state into future before new observation is made.) Lielihood : defined in terms of observation model Evidence : p( y Y ) = p( y x ) p( x Y ) dx 1 1
9 Practical Solutions Gaussian Approximations Perfect Monte Carlo Simulation Sequential Monte Carlo Methods : Particle Filters Bayesian Importance Sampling Sampling-importance resampling (SIR)
10 Gaussian Approximations Most common approach. Assume all RV statistics are Gaussian. Optimal recursive MMSE estimate is then given by xˆ = ( prediction of x ) + κ [( observation of y ) ( prediction of y )] Different implementations : Extended Kalman Filter (EKF) : optimal quantities approximated via first order Taylor series expansion (linearization) of process and measurement models. Unscented Kalman Filter (UKF) : optimal quantities calculated using the Unscented Transformation (accurate to second order for any nonlinearity). Drastic improvement over EKF [Wan, van der Merwe, Nelson 2000]. Problem : Gaussian approximation breas down for most nonlinear real-world applications (multi-modal distributions, non-gaussian noise sources, etc.)
11 Perfect Monte Carlo Simulation Allow for a complete representation of the posterior distribution. Map intractable integrals of optimal Bayesian solution to tractable discrete sums of weighted samples drawn from the posterior distribution. N 1 = N δ i= 1 ( () i ) pˆ ( x Y ) x x x p( x Y ) () i IID... So, any estimate of the form [ ] E f( x ) = f( x ) p( x Y ) dx may be approximated by : [ ] 1 ( () i ( x ) ) N f x E f N i= 1
12 Particle Filters Bayesian Importance Sampling It is often impossible to sample directly from the true posterior density. However, we can rather sample from a nown, easy-tosample, proposal distribution, q( x Y ) and mae use of the following substitution p( x Y ) [ ( )] = ( ) ( ) q( x Y ) E f x f x dx w x p( x ) ( x Y ) p( Y ) q q x Y = = ( x ) = ( Y x ) p( x ) ( Y ) q( x Y ) ( ) f ( x ) q x Y dx ( x) ( ) q Y ( ) p p w p f ( x ) x Y dx
13 Particle Filters 1 [ ( )] = ( ) ( ) ( ) ( ) E f x f x w x q x Y dx p Y = = = ( ) f( x ) w ( x ) q x Y dx p( Y x ) p( x ) q ( x Y) ( x Y ) q dx q ( ) ( ) ( ) w ( x ) q( x Y ) dx ( ) [ ( ) ( )] x x x Y Eq( x Y ) [ w( x) ] f x w x q x Y dx E w f
14 Particle Filters q( x Y ) So, by drawing samples from, we can approximate expectations of interest by the following: [ ( x )] E f 1 N () i () i N w ( ) ( ) 1 x f x i= 1 N () i N w ( ) i= 1 x N i= 1 w () i () i ( x ) f ( x ) Where the normalized importance weights are given by w () i () i w( x ) ( x ) = N ( j) w j= 1 x ( )
15 Particle Filters Using the state space assumptions (1 st order Marov / observational independence given state), the importance weights can be estimated recursively by [proof in De Freitas (2000)] w = w 1 p y x p x x ( ) ( ) q 1 x X, Y ( ) 1 Problem with SIS is that the variance of the importance weights increase stochastically over time [Kong et al. (1994), Doucet et al. (1999)] To solve this, we need to resample the particles eep / multiply particles with high importance weights discard particles with low importance weights Sampling-importance Resampling (SIR)
16 Particle Filters Sampling-importance Resampling Maps the N unequally weighted particles into a new set of N equally weighted samples. { () ()} { ( ) 1 x i, i j, } w x N Method proposed by Gordon, Salmond & Smith (1993) and proven mathematically by Gordon (1994). cdf 1 N 1 ( j ) w t j resampled index p(i)
17 Particle Filters
18 Particle Filters Choice of Proposal Distribution w = w 1 p ( y ) ( ) x p x x 1 q( x X, Y ) 1 critical design issue for successful particle filter samples/particles are drawn from this distribution used to evaluate importance weights Requirements 1) Support of proposal distribution must include support of true posterior distribution, i.e. heavy-tailed distributions are preferable. 2) Must include most recent observations.
19 Particle Filters Most popular choice of proposal distribution does not satisfy these requirements though: q x X, Y = p x x ( ) ( ) 1 1 [Isard and Blae 96, Kitagawa 96, Gordon et al. 93, Beadle and Djuric 97, Avitzour 95] Easy to implement : w = w 1 p y x p x x ( ) ( ) 1 p x ( ) x 1 = w p ( y x ) 1 Does not incorporate most recent observation though!
20 Improving Particle Filters Incorporate New Observations into Proposal Use Gaussian approximation (i.e. Kalman filter) to generate proposal by combining new observation with prior q x X, Y = p x X, Y ( ) ( ) 1 G 1 = N ˆ,cov[ ] ( x x )
21 Improving Particle Filters Extented Kalman Filter Proposal Generation De Freitas (1998), Doucet (1998), Pitt & Shephard (1999). Greatly improved performance compared to standard particle filter in problems with very accurate measurements, i.e. lielihood very peaed in comparison to prior. In highly nonlinear problems, the EKF tends to be very inaccurate and underestimates the true covariance of the state. This violates the distribution support requirement for the proposal distribution and can lead to poor performance and filter divergence. We propose the use of the Unscented Kalman Filter for proposal generation to address these problems!
22 Improving Particle Filters Unscented Kalman Filter Proposal Generation UKF is a recursive MMSE estimator based on the Unscented Transformation (UT). UT : Method for calculating the statistics of a RV that undergoes a nonlinear transformation (Julier and Uhlmann 1997) UT/UKF : - accurate to 3 rd order for Gaussians - higher order errors scaled by choice of transform parameters. More accurate estimates than EKF (Wan, van der Merwe, Nelson 2000) Have some control over higher order moments, i.e. urtosis, etc. heavy tailed distributions!
23 Unscented Transformation b i Weighted sample mean x y a + - f b g y i Weighted sample covariance P x P y b i l q = + - c x x a P x a P i x x 8
24 The Unscented Transformation Actual (sampling) UT Linearized (EKF) covariance sigma points mean y= f( x ) ψ = f ( χ ) i i T y = f ( x) Py = A P A x true mean UT mean true covariance UT covariance transformed sigma points A T P x A f ( x) 9
25 Unscented Particle Filter Particle Filter UKF Proposal + Unscented Particle Filter
26 Experimental Results Synthetic Experiment Time-series process model : x x v 1 1 sin ( ωπ ) + = + + φ + process noise (Gamma) nonstationary observation model : y 2 φ x + n = φ x 2 + n > measurement noise (Gaussian)
27 Experimental Results Synthetic Experiment : (100 independent runs) Filter Extended Kalman Filter (EKF) MSE mean variance Unscented Kalman Filter (UKF) Particle Filter : generic Particle Filter : EKF proposal Unscented Particle Filter
28 Experimental Results Synthetic Experiment
29 Experimental Results Pricing Financial Options Options : financial derivative that gives the holder the right (but not obligation) to do something in the future. Call option : - allow holder to buy an underlying cash product - at a specified future date ( maturity time ) - for a predetermined price ( strie price ) Put option : - allow holder to sell an underlying cash product Blac Scholes partial differential equation Main industry standard for pricing options ris-free interest rate 2 f f f rs + 2 σ S = rf 2 t S S volatility of cash product option value value of underlying cash product
30 Experimental Results Pricing Financial Options Blac & Scholes (1973) derived the following pricing solution: C = SN ( d ) Xe N ( d ) c rtm 1 c 2 rtm P= SN ( d1) + Xe N ( d ) c c 2 N c d 1 = ln( / ) + ( + 2σ ) d = d σ t S X r t σ m t m (.) = cumulative normal distribution m
31 Experimental Results Pricing Financial Options State-space representation to model system for particle filters Hidden states : Output observations: Known control signals: r C t m, σ, P, S Estimate call and put prices over a 204 day period on the FTSE-100 index. Performance : normalized square error for one-step-ahead predictions NSE = y ˆ ( y )
32 Experimental Results Options Pricing Experiment : (100 independent runs) Option Type Call Put Algorithm Trivial Extended Kalman Filter (EKF) Unscented Kalman Filter (UKF) Particle Filter : generic Particle Filter : EKF proposal Unscented Particle Filter Trivial Extended Kalman Filter (EKF) Unscented Kalman Filter (UKF) Particle Filter : generic Particle Filter : EKF proposal Unscented Particle Filter NSE mean var
33 Experimental Results Options Pricing Experiment : UPF one-step-ahead predictions
34 Experimental Results Options Pricing Experiment : Estimated interest rate and volatility
35 Experimental Results Options Pricing Experiment : Probability distributions of implied interest rate and volatility
36 Particle Filter Demos Visual Dynamics Group, Oxford. (Andrew Blae) Tracing agile motion Tracing motion against camouflage Mixed state tracing
37 Conclusions Particle filters allow for a practical but complete representation of posterior probability distribution. Applicable to general nonlinear, non-gaussian estimation problems where standard Gaussian approximations fail. Particle filters rely on importance sampling, so the proper choice of proposal distribution is very important: Standard approach (i.e. transition prior proposal) fails when lielihood of new data is very peaed (accurate sensors) or for heavy-tailed noise sources. EKF proposal : Incorporates new observations, but can diverge due to inaccurate and inconsistent state estimates. Unscented Particle Filter : UKF proposal More consistent and accurate state estimates. Larger support overlap, can have heavier tailed distributions. Theory predicts and experiments prove significantly better performance.
38 The End
Efficient Monitoring for Planetary Rovers
International Symposium on Artificial Intelligence and Robotics in Space (isairas), May, 2003 Efficient Monitoring for Planetary Rovers Vandi Verma vandi@ri.cmu.edu Geoff Gordon ggordon@cs.cmu.edu Carnegie
More informationIntroduction to Unscented Kalman Filter
Introduction to Unscented Kalman Filter 1 Introdution In many scientific fields, we use certain models to describe the dynamics of system, such as mobile robot, vision tracking and so on. The word dynamics
More informationDual Estimation and the Unscented Transformation
Dual Estimation and the Unscented Transformation Eric A. Wan ericwan@ece.ogi.edu Rudolph van der Merwe rudmerwe@ece.ogi.edu Alex T. Nelson atnelson@ece.ogi.edu Oregon Graduate Institute of Science & Technology
More informationMODEL BASED LEARNING OF SIGMA POINTS IN UNSCENTED KALMAN FILTERING. Ryan Turner and Carl Edward Rasmussen
MODEL BASED LEARNING OF SIGMA POINTS IN UNSCENTED KALMAN FILTERING Ryan Turner and Carl Edward Rasmussen University of Cambridge Department of Engineering Trumpington Street, Cambridge CB PZ, UK ABSTRACT
More informationin a Rao-Blackwellised Unscented Kalman Filter
A Rao-Blacwellised Unscented Kalman Filter Mar Briers QinetiQ Ltd. Malvern Technology Centre Malvern, UK. m.briers@signal.qinetiq.com Simon R. Masell QinetiQ Ltd. Malvern Technology Centre Malvern, UK.
More informationAN EFFICIENT TWO-STAGE SAMPLING METHOD IN PARTICLE FILTER. Qi Cheng and Pascal Bondon. CNRS UMR 8506, Université Paris XI, France.
AN EFFICIENT TWO-STAGE SAMPLING METHOD IN PARTICLE FILTER Qi Cheng and Pascal Bondon CNRS UMR 8506, Université Paris XI, France. August 27, 2011 Abstract We present a modified bootstrap filter to draw
More information2D Image Processing (Extended) Kalman and particle filter
2D Image Processing (Extended) Kalman and particle filter Prof. Didier Stricker Dr. Gabriele Bleser Kaiserlautern University http://ags.cs.uni-kl.de/ DFKI Deutsches Forschungszentrum für Künstliche Intelligenz
More informationA new unscented Kalman filter with higher order moment-matching
A new unscented Kalman filter with higher order moment-matching KSENIA PONOMAREVA, PARESH DATE AND ZIDONG WANG Department of Mathematical Sciences, Brunel University, Uxbridge, UB8 3PH, UK. Abstract This
More informationSEQUENTIAL MONTE CARLO METHODS FOR THE CALIBRATION OF STOCHASTIC RAINFALL-RUNOFF MODELS
XIX International Conference on Water Resources CMWR 2012 University of Illinois at Urbana-Champain June 17-22,2012 SEQUENTIAL MONTE CARLO METHODS FOR THE CALIBRATION OF STOCHASTIC RAINFALL-RUNOFF MODELS
More informationFUNDAMENTAL FILTERING LIMITATIONS IN LINEAR NON-GAUSSIAN SYSTEMS
FUNDAMENTAL FILTERING LIMITATIONS IN LINEAR NON-GAUSSIAN SYSTEMS Gustaf Hendeby Fredrik Gustafsson Division of Automatic Control Department of Electrical Engineering, Linköpings universitet, SE-58 83 Linköping,
More informationF denotes cumulative density. denotes probability density function; (.)
BAYESIAN ANALYSIS: FOREWORDS Notation. System means the real thing and a model is an assumed mathematical form for the system.. he probability model class M contains the set of the all admissible models
More informationLecture 2: From Linear Regression to Kalman Filter and Beyond
Lecture 2: From Linear Regression to Kalman Filter and Beyond Department of Biomedical Engineering and Computational Science Aalto University January 26, 2012 Contents 1 Batch and Recursive Estimation
More informationA Comparison of Particle Filters for Personal Positioning
VI Hotine-Marussi Symposium of Theoretical and Computational Geodesy May 9-June 6. A Comparison of Particle Filters for Personal Positioning D. Petrovich and R. Piché Institute of Mathematics Tampere University
More informationA Comparison of the EKF, SPKF, and the Bayes Filter for Landmark-Based Localization
A Comparison of the EKF, SPKF, and the Bayes Filter for Landmark-Based Localization and Timothy D. Barfoot CRV 2 Outline Background Objective Experimental Setup Results Discussion Conclusion 2 Outline
More informationTSRT14: Sensor Fusion Lecture 8
TSRT14: Sensor Fusion Lecture 8 Particle filter theory Marginalized particle filter Gustaf Hendeby gustaf.hendeby@liu.se TSRT14 Lecture 8 Gustaf Hendeby Spring 2018 1 / 25 Le 8: particle filter theory,
More informationRecursive Noise Adaptive Kalman Filtering by Variational Bayesian Approximations
PREPRINT 1 Recursive Noise Adaptive Kalman Filtering by Variational Bayesian Approximations Simo Särä, Member, IEEE and Aapo Nummenmaa Abstract This article considers the application of variational Bayesian
More informationNonlinear State Estimation! Particle, Sigma-Points Filters!
Nonlinear State Estimation! Particle, Sigma-Points Filters! Robert Stengel! Optimal Control and Estimation, MAE 546! Princeton University, 2017!! Particle filter!! Sigma-Points Unscented Kalman ) filter!!
More informationDensity Propagation for Continuous Temporal Chains Generative and Discriminative Models
$ Technical Report, University of Toronto, CSRG-501, October 2004 Density Propagation for Continuous Temporal Chains Generative and Discriminative Models Cristian Sminchisescu and Allan Jepson Department
More informationAutonomous Mobile Robot Design
Autonomous Mobile Robot Design Topic: Extended Kalman Filter Dr. Kostas Alexis (CSE) These slides relied on the lectures from C. Stachniss, J. Sturm and the book Probabilistic Robotics from Thurn et al.
More informationNONLINEAR STATISTICAL SIGNAL PROCESSING: A PARTI- CLE FILTERING APPROACH
NONLINEAR STATISTICAL SIGNAL PROCESSING: A PARTI- CLE FILTERING APPROACH J. V. Candy (tsoftware@aol.com) University of California, Lawrence Livermore National Lab. & Santa Barbara Livermore CA 94551 USA
More informationSensor Fusion: Particle Filter
Sensor Fusion: Particle Filter By: Gordana Stojceska stojcesk@in.tum.de Outline Motivation Applications Fundamentals Tracking People Advantages and disadvantages Summary June 05 JASS '05, St.Petersburg,
More informationEfficient Particle Filtering for Jump Markov Systems. Application to Time-Varying Autoregressions
1762 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 51, NO. 7, JULY 2003 Efficient Particle Filtering for Jump Markov Systems. Application to Time-Varying Autoregressions Christophe Andrieu, Manuel Davy,
More informationEKF, UKF. Pieter Abbeel UC Berkeley EECS. Many slides adapted from Thrun, Burgard and Fox, Probabilistic Robotics
EKF, UKF Pieter Abbeel UC Berkeley EECS Many slides adapted from Thrun, Burgard and Fox, Probabilistic Robotics Kalman Filter Kalman Filter = special case of a Bayes filter with dynamics model and sensory
More informationEKF, UKF. Pieter Abbeel UC Berkeley EECS. Many slides adapted from Thrun, Burgard and Fox, Probabilistic Robotics
EKF, UKF Pieter Abbeel UC Berkeley EECS Many slides adapted from Thrun, Burgard and Fox, Probabilistic Robotics Kalman Filter Kalman Filter = special case of a Bayes filter with dynamics model and sensory
More informationNonlinear and/or Non-normal Filtering. Jesús Fernández-Villaverde University of Pennsylvania
Nonlinear and/or Non-normal Filtering Jesús Fernández-Villaverde University of Pennsylvania 1 Motivation Nonlinear and/or non-gaussian filtering, smoothing, and forecasting (NLGF) problems are pervasive
More informationLecture 2: From Linear Regression to Kalman Filter and Beyond
Lecture 2: From Linear Regression to Kalman Filter and Beyond January 18, 2017 Contents 1 Batch and Recursive Estimation 2 Towards Bayesian Filtering 3 Kalman Filter and Bayesian Filtering and Smoothing
More informationNonlinear Estimation Techniques for Impact Point Prediction of Ballistic Targets
Nonlinear Estimation Techniques for Impact Point Prediction of Ballistic Targets J. Clayton Kerce a, George C. Brown a, and David F. Hardiman b a Georgia Tech Research Institute, Georgia Institute of Technology,
More informationState Estimation of Linear and Nonlinear Dynamic Systems
State Estimation of Linear and Nonlinear Dynamic Systems Part III: Nonlinear Systems: Extended Kalman Filter (EKF) and Unscented Kalman Filter (UKF) James B. Rawlings and Fernando V. Lima Department of
More informationComparison of Kalman Filter Estimation Approaches for State Space Models with Nonlinear Measurements
Comparison of Kalman Filter Estimation Approaches for State Space Models with Nonlinear Measurements Fredri Orderud Sem Sælands vei 7-9, NO-7491 Trondheim Abstract The Etended Kalman Filter (EKF) has long
More informationParticle Filters. Outline
Particle Filters M. Sami Fadali Professor of EE University of Nevada Outline Monte Carlo integration. Particle filter. Importance sampling. Degeneracy Resampling Example. 1 2 Monte Carlo Integration Numerical
More informationRECURSIVE OUTLIER-ROBUST FILTERING AND SMOOTHING FOR NONLINEAR SYSTEMS USING THE MULTIVARIATE STUDENT-T DISTRIBUTION
1 IEEE INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING, SEPT. 3 6, 1, SANTANDER, SPAIN RECURSIVE OUTLIER-ROBUST FILTERING AND SMOOTHING FOR NONLINEAR SYSTEMS USING THE MULTIVARIATE STUDENT-T
More informationCSC487/2503: Foundations of Computer Vision. Visual Tracking. David Fleet
CSC487/2503: Foundations of Computer Vision Visual Tracking David Fleet Introduction What is tracking? Major players: Dynamics (model of temporal variation of target parameters) Measurements (relation
More informationL06. LINEAR KALMAN FILTERS. NA568 Mobile Robotics: Methods & Algorithms
L06. LINEAR KALMAN FILTERS NA568 Mobile Robotics: Methods & Algorithms 2 PS2 is out! Landmark-based Localization: EKF, UKF, PF Today s Lecture Minimum Mean Square Error (MMSE) Linear Kalman Filter Gaussian
More informationA Note on Auxiliary Particle Filters
A Note on Auxiliary Particle Filters Adam M. Johansen a,, Arnaud Doucet b a Department of Mathematics, University of Bristol, UK b Departments of Statistics & Computer Science, University of British Columbia,
More informationNew Statistical Model for the Enhancement of Noisy Speech
New Statistical Model for the Enhancement of Noisy Speech Electrical Engineering Department Technion - Israel Institute of Technology February 22, 27 Outline Problem Formulation and Motivation 1 Problem
More informationA STATE ESTIMATOR FOR NONLINEAR STOCHASTIC SYSTEMS BASED ON DIRAC MIXTURE APPROXIMATIONS
A STATE ESTIMATOR FOR NONINEAR STOCHASTIC SYSTEMS BASED ON DIRAC MIXTURE APPROXIMATIONS Oliver C. Schrempf, Uwe D. Hanebec Intelligent Sensor-Actuator-Systems aboratory, Universität Karlsruhe (TH), Germany
More informationSigma-Point Kalman Filters for Probabilistic Inference in Dynamic State-Space Models
Sigma-Point Kalman Filters for Probabilistic Inference in Dynamic State-Space Models Rudolph van der Merwe & Eric Wan OGI School of Science & Engineering Oregon Health & Science University Beaverton, Oregon,
More informationAn Improved Particle Filter with Applications in Ballistic Target Tracking
Sensors & ransducers Vol. 72 Issue 6 June 204 pp. 96-20 Sensors & ransducers 204 by IFSA Publishing S. L. http://www.sensorsportal.co An Iproved Particle Filter with Applications in Ballistic arget racing
More informationLecture 7: Optimal Smoothing
Department of Biomedical Engineering and Computational Science Aalto University March 17, 2011 Contents 1 What is Optimal Smoothing? 2 Bayesian Optimal Smoothing Equations 3 Rauch-Tung-Striebel Smoother
More informationKalman filtering and friends: Inference in time series models. Herke van Hoof slides mostly by Michael Rubinstein
Kalman filtering and friends: Inference in time series models Herke van Hoof slides mostly by Michael Rubinstein Problem overview Goal Estimate most probable state at time k using measurement up to time
More informationLinear and nonlinear filtering for state space models. Master course notes. UdelaR 2010
Linear and nonlinear filtering for state space models Master course notes UdelaR 2010 Thierry CHONAVEL thierry.chonavel@telecom-bretagne.eu December 2010 Contents 1 Introduction 3 2 Kalman filter and non
More informationPATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 13: SEQUENTIAL DATA
PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 13: SEQUENTIAL DATA Contents in latter part Linear Dynamical Systems What is different from HMM? Kalman filter Its strength and limitation Particle Filter
More informationarxiv: v1 [cs.ro] 1 May 2015
215 IEEE International Conference on Robotics and Automation (ICRA) May 26-3, 215. Seattle, USA The Coordinate Particle Filter - A novel Particle Filter for High Dimensional Systems Manuel Wüthrich 1,
More informationChapter 9: Bayesian Methods. CS 336/436 Gregory D. Hager
Chapter 9: Bayesian Methods CS 336/436 Gregory D. Hager A Simple Eample Why Not Just Use a Kalman Filter? Recall Robot Localization Given Sensor readings y 1, y 2, y = y 1: Known control inputs u 0, u
More informationMMSE-Based Filtering for Linear and Nonlinear Systems in the Presence of Non-Gaussian System and Measurement Noise
MMSE-Based Filtering for Linear and Nonlinear Systems in the Presence of Non-Gaussian System and Measurement Noise I. Bilik 1 and J. Tabrikian 2 1 Dept. of Electrical and Computer Engineering, University
More informationMonte Carlo Approximation of Monte Carlo Filters
Monte Carlo Approximation of Monte Carlo Filters Adam M. Johansen et al. Collaborators Include: Arnaud Doucet, Axel Finke, Anthony Lee, Nick Whiteley 7th January 2014 Context & Outline Filtering in State-Space
More informationSIGMA POINT GAUSSIAN SUM FILTER DESIGN USING SQUARE ROOT UNSCENTED FILTERS
SIGMA POINT GAUSSIAN SUM FILTER DESIGN USING SQUARE ROOT UNSCENTED FILTERS Miroslav Šimandl, Jindřich Duní Department of Cybernetics and Research Centre: Data - Algorithms - Decision University of West
More informationA Gaussian Mixture PHD Filter for Nonlinear Jump Markov Models
A Gaussian Mixture PHD Filter for Nonlinear Jump Marov Models Ba-Ngu Vo Ahmed Pasha Hoang Duong Tuan Department of Electrical and Electronic Engineering The University of Melbourne Parville VIC 35 Australia
More information2D Image Processing. Bayes filter implementation: Kalman filter
2D Image Processing Bayes filter implementation: Kalman filter Prof. Didier Stricker Kaiserlautern University http://ags.cs.uni-kl.de/ DFKI Deutsches Forschungszentrum für Künstliche Intelligenz http://av.dfki.de
More informationSigma-Point Kalman Filters for Probabilistic Inference in Dynamic State-Space Models
Sigma-Point Kalman Filters for Probabilistic Inference in Dynamic State-Space Models Rudolph van der Merwe M.Eng., Electrical Engineering, University of Stellenbosch, 1998 B.Eng., Electrical Engineering,
More informationSequential Monte Carlo Methods for Bayesian Computation
Sequential Monte Carlo Methods for Bayesian Computation A. Doucet Kyoto Sept. 2012 A. Doucet (MLSS Sept. 2012) Sept. 2012 1 / 136 Motivating Example 1: Generic Bayesian Model Let X be a vector parameter
More informationA STUDY ON THE STATE ESTIMATION OF NONLINEAR ELECTRIC CIRCUITS BY UNSCENTED KALMAN FILTER
A STUDY ON THE STATE ESTIMATION OF NONLINEAR ELECTRIC CIRCUITS BY UNSCENTED KALMAN FILTER Esra SAATCI Aydın AKAN 2 e-mail: esra.saatci@iku.edu.tr e-mail: akan@istanbul.edu.tr Department of Electronic Eng.,
More informationAn introduction to Sequential Monte Carlo
An introduction to Sequential Monte Carlo Thang Bui Jes Frellsen Department of Engineering University of Cambridge Research and Communication Club 6 February 2014 1 Sequential Monte Carlo (SMC) methods
More informationAnalytically-Guided-Sampling Particle Filter Applied to Range-only Target Tracking
Analytically-Guided-Sampling Particle Filter Applied to Range-only Target Tracing Guoquan P. Huang and Stergios I. Roumeliotis Abstract Particle filtering (PF) is a popular nonlinear estimation technique
More informationLecture 6: Bayesian Inference in SDE Models
Lecture 6: Bayesian Inference in SDE Models Bayesian Filtering and Smoothing Point of View Simo Särkkä Aalto University Simo Särkkä (Aalto) Lecture 6: Bayesian Inference in SDEs 1 / 45 Contents 1 SDEs
More informationTest Volume 11, Number 2. December 2002
Sociedad Española de Estadística e Investigación Operativa Test Volume 11, Number 2. December 2002 Spatial-Temporal Nonlinear Filtering Based on Hierarchical Statistical Models Mark E. Irwin, Noel Cressie,
More informationROBOTICS 01PEEQW. Basilio Bona DAUIN Politecnico di Torino
ROBOTICS 01PEEQW Basilio Bona DAUIN Politecnico di Torino Probabilistic Fundamentals in Robotics Gaussian Filters Course Outline Basic mathematical framework Probabilistic models of mobile robots Mobile
More informationParticle Filtering for Data-Driven Simulation and Optimization
Particle Filtering for Data-Driven Simulation and Optimization John R. Birge The University of Chicago Booth School of Business Includes joint work with Nicholas Polson. JRBirge INFORMS Phoenix, October
More informationThe Kalman Filter ImPr Talk
The Kalman Filter ImPr Talk Ged Ridgway Centre for Medical Image Computing November, 2006 Outline What is the Kalman Filter? State Space Models Kalman Filter Overview Bayesian Updating of Estimates Kalman
More informationIntroduction to Particle Filters for Data Assimilation
Introduction to Particle Filters for Data Assimilation Mike Dowd Dept of Mathematics & Statistics (and Dept of Oceanography Dalhousie University, Halifax, Canada STATMOS Summer School in Data Assimila5on,
More informationExtended Object and Group Tracking with Elliptic Random Hypersurface Models
Extended Object and Group Tracing with Elliptic Random Hypersurface Models Marcus Baum Benjamin Noac and Uwe D. Hanebec Intelligent Sensor-Actuator-Systems Laboratory ISAS Institute for Anthropomatics
More informationGaussian Process Approximations of Stochastic Differential Equations
Gaussian Process Approximations of Stochastic Differential Equations Cédric Archambeau Dan Cawford Manfred Opper John Shawe-Taylor May, 2006 1 Introduction Some of the most complex models routinely run
More informationGaussian Mixtures Proposal Density in Particle Filter for Track-Before-Detect
12th International Conference on Information Fusion Seattle, WA, USA, July 6-9, 29 Gaussian Mixtures Proposal Density in Particle Filter for Trac-Before-Detect Ondřej Straa, Miroslav Šimandl and Jindřich
More informationMarkov Chain Monte Carlo Methods for Stochastic Optimization
Markov Chain Monte Carlo Methods for Stochastic Optimization John R. Birge The University of Chicago Booth School of Business Joint work with Nicholas Polson, Chicago Booth. JRBirge U of Toronto, MIE,
More informationMini-Course 07 Kalman Particle Filters. Henrique Massard da Fonseca Cesar Cunha Pacheco Wellington Bettencurte Julio Dutra
Mini-Course 07 Kalman Particle Filters Henrique Massard da Fonseca Cesar Cunha Pacheco Wellington Bettencurte Julio Dutra Agenda State Estimation Problems & Kalman Filter Henrique Massard Steady State
More informationParticle Filtering Approaches for Dynamic Stochastic Optimization
Particle Filtering Approaches for Dynamic Stochastic Optimization John R. Birge The University of Chicago Booth School of Business Joint work with Nicholas Polson, Chicago Booth. JRBirge I-Sim Workshop,
More informationLagrangian Data Assimilation and Manifold Detection for a Point-Vortex Model. David Darmon, AMSC Kayo Ide, AOSC, IPST, CSCAMM, ESSIC
Lagrangian Data Assimilation and Manifold Detection for a Point-Vortex Model David Darmon, AMSC Kayo Ide, AOSC, IPST, CSCAMM, ESSIC Background Data Assimilation Iterative process Forecast Analysis Background
More informationCombined Particle and Smooth Variable Structure Filtering for Nonlinear Estimation Problems
14th International Conference on Information Fusion Chicago, Illinois, USA, July 5-8, 2011 Combined Particle and Smooth Variable Structure Filtering for Nonlinear Estimation Problems S. Andrew Gadsden
More informationAn evaluation of the nonlinear/non-gaussian filters for the sequential data assimilation
Available online at www.sciencedirect.com Remote Sensing of Environment 112 (2008) 1434 1449 www.elsevier.com/locate/rse An evaluation of the nonlinear/non-gaussian filters for the sequential data assimilation
More informationData Assimilation for Dispersion Models
Data Assimilation for Dispersion Models K. V. Umamaheswara Reddy Dept. of Mechanical and Aerospace Engg. State University of New Yor at Buffalo Buffalo, NY, U.S.A. venatar@buffalo.edu Yang Cheng Dept.
More informationNON-LINEAR NOISE ADAPTIVE KALMAN FILTERING VIA VARIATIONAL BAYES
2013 IEEE INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING NON-LINEAR NOISE ADAPTIVE KALMAN FILTERING VIA VARIATIONAL BAYES Simo Särä Aalto University, 02150 Espoo, Finland Jouni Hartiainen
More informationRAO-BLACKWELLIZED PARTICLE FILTER FOR MARKOV MODULATED NONLINEARDYNAMIC SYSTEMS
RAO-BLACKWELLIZED PARTICLE FILTER FOR MARKOV MODULATED NONLINEARDYNAMIC SYSTEMS Saiat Saha and Gustaf Hendeby Linöping University Post Print N.B.: When citing this wor, cite the original article. 2014
More informationUsing the Kalman Filter to Estimate the State of a Maneuvering Aircraft
1 Using the Kalman Filter to Estimate the State of a Maneuvering Aircraft K. Meier and A. Desai Abstract Using sensors that only measure the bearing angle and range of an aircraft, a Kalman filter is implemented
More informationTHE well known Kalman filter [1], [2] is an optimal
1 Recursive Update Filtering for Nonlinear Estimation Renato Zanetti Abstract Nonlinear filters are often very computationally expensive and usually not suitable for real-time applications. Real-time navigation
More informationAn Introduction to Particle Filtering
An Introduction to Particle Filtering Author: Lisa Turner Supervisor: Dr. Christopher Sherlock 10th May 2013 Abstract This report introduces the ideas behind particle filters, looking at the Kalman filter
More informationThe Scaled Unscented Transformation
The Scaled Unscented Transformation Simon J. Julier, IDAK Industries, 91 Missouri Blvd., #179 Jefferson City, MO 6519 E-mail:sjulier@idak.com Abstract This paper describes a generalisation of the unscented
More informationEstimating the Shape of Targets with a PHD Filter
Estimating the Shape of Targets with a PHD Filter Christian Lundquist, Karl Granström, Umut Orguner Department of Electrical Engineering Linöping University 583 33 Linöping, Sweden Email: {lundquist, arl,
More informationRao-Blackwellized Particle Filter for Multiple Target Tracking
Rao-Blackwellized Particle Filter for Multiple Target Tracking Simo Särkkä, Aki Vehtari, Jouko Lampinen Helsinki University of Technology, Finland Abstract In this article we propose a new Rao-Blackwellized
More informationLearning Static Parameters in Stochastic Processes
Learning Static Parameters in Stochastic Processes Bharath Ramsundar December 14, 2012 1 Introduction Consider a Markovian stochastic process X T evolving (perhaps nonlinearly) over time variable T. We
More informationTARGET TRACKING BY USING PARTICLE FILTER IN SENSOR NETWORKS
TARGET TRACKING BY USING PARTICLE FILTER IN SENSOR NETWORKS D. Gu and H. Hu Department of Computing and Electronic Systems University of Essex, UK Abstract This paper presents a distributed particle filter
More informationMarkov Chain Monte Carlo Methods for Stochastic
Markov Chain Monte Carlo Methods for Stochastic Optimization i John R. Birge The University of Chicago Booth School of Business Joint work with Nicholas Polson, Chicago Booth. JRBirge U Florida, Nov 2013
More informationState Estimation using Moving Horizon Estimation and Particle Filtering
State Estimation using Moving Horizon Estimation and Particle Filtering James B. Rawlings Department of Chemical and Biological Engineering UW Math Probability Seminar Spring 2009 Rawlings MHE & PF 1 /
More information2D Image Processing. Bayes filter implementation: Kalman filter
2D Image Processing Bayes filter implementation: Kalman filter Prof. Didier Stricker Dr. Gabriele Bleser Kaiserlautern University http://ags.cs.uni-kl.de/ DFKI Deutsches Forschungszentrum für Künstliche
More informationConditional Posterior Cramér-Rao Lower Bounds for Nonlinear Sequential Bayesian Estimation
1 Conditional Posterior Cramér-Rao Lower Bounds for Nonlinear Sequential Bayesian Estimation Long Zuo, Ruixin Niu, and Pramod K. Varshney Abstract Posterior Cramér-Rao lower bounds (PCRLBs) 1] for sequential
More informationMarkov chain Monte Carlo methods for visual tracking
Markov chain Monte Carlo methods for visual tracking Ray Luo rluo@cory.eecs.berkeley.edu Department of Electrical Engineering and Computer Sciences University of California, Berkeley Berkeley, CA 94720
More informationROBUST CONSTRAINED ESTIMATION VIA UNSCENTED TRANSFORMATION. Pramod Vachhani a, Shankar Narasimhan b and Raghunathan Rengaswamy a 1
ROUST CONSTRINED ESTIMTION VI UNSCENTED TRNSFORMTION Pramod Vachhani a, Shankar Narasimhan b and Raghunathan Rengaswamy a a Department of Chemical Engineering, Clarkson University, Potsdam, NY -3699, US.
More informationTarget Localization using Multiple UAVs with Sensor Fusion via Sigma-Point Kalman Filtering
Target Localization using Multiple UAVs with Sensor Fusion via Sigma-Point Kalman Filtering Gregory L Plett, Pedro DeLima, and Daniel J Pack, United States Air Force Academy, USAFA, CO 884, USA This paper
More informationIntroduction to Machine Learning
Introduction to Machine Learning Brown University CSCI 1950-F, Spring 2012 Prof. Erik Sudderth Lecture 25: Markov Chain Monte Carlo (MCMC) Course Review and Advanced Topics Many figures courtesy Kevin
More informationWhy do we care? Measurements. Handling uncertainty over time: predicting, estimating, recognizing, learning. Dealing with time
Handling uncertainty over time: predicting, estimating, recognizing, learning Chris Atkeson 2004 Why do we care? Speech recognition makes use of dependence of words and phonemes across time. Knowing where
More informationEVALUATING SYMMETRIC INFORMATION GAP BETWEEN DYNAMICAL SYSTEMS USING PARTICLE FILTER
EVALUATING SYMMETRIC INFORMATION GAP BETWEEN DYNAMICAL SYSTEMS USING PARTICLE FILTER Zhen Zhen 1, Jun Young Lee 2, and Abdus Saboor 3 1 Mingde College, Guizhou University, China zhenz2000@21cn.com 2 Department
More informationExercises Tutorial at ICASSP 2016 Learning Nonlinear Dynamical Models Using Particle Filters
Exercises Tutorial at ICASSP 216 Learning Nonlinear Dynamical Models Using Particle Filters Andreas Svensson, Johan Dahlin and Thomas B. Schön March 18, 216 Good luck! 1 [Bootstrap particle filter for
More informationL09. PARTICLE FILTERING. NA568 Mobile Robotics: Methods & Algorithms
L09. PARTICLE FILTERING NA568 Mobile Robotics: Methods & Algorithms Particle Filters Different approach to state estimation Instead of parametric description of state (and uncertainty), use a set of state
More informationConstrained State Estimation Using the Unscented Kalman Filter
16th Mediterranean Conference on Control and Automation Congress Centre, Ajaccio, France June 25-27, 28 Constrained State Estimation Using the Unscented Kalman Filter Rambabu Kandepu, Lars Imsland and
More informationSEQUENTIAL MONTE CARLO METHODS WITH APPLICATIONS TO COMMUNICATION CHANNELS. A Thesis SIRISH BODDIKURAPATI
SEQUENTIAL MONTE CARLO METHODS WITH APPLICATIONS TO COMMUNICATION CHANNELS A Thesis by SIRISH BODDIKURAPATI Submitted to the Office of Graduate Studies of Texas A&M University in partial fulfillment of
More informationPrediction of ESTSP Competition Time Series by Unscented Kalman Filter and RTS Smoother
Prediction of ESTSP Competition Time Series by Unscented Kalman Filter and RTS Smoother Simo Särkkä, Aki Vehtari and Jouko Lampinen Helsinki University of Technology Department of Electrical and Communications
More informationUnscented Transformation of Vehicle States in SLAM
Unscented Transformation of Vehicle States in SLAM Juan Andrade-Cetto Teresa Vidal-Calleja Alberto Sanfeliu Institut de Robòtica I Informàtica Industrial, UPC-CSIC, SPAIN ICRA 2005, Barcelona 12/06/2005
More informationA comparison of estimation accuracy by the use of KF, EKF & UKF filters
Computational Methods and Eperimental Measurements XIII 779 A comparison of estimation accurac b the use of KF EKF & UKF filters S. Konatowski & A. T. Pieniężn Department of Electronics Militar Universit
More informationProbabilistic Fundamentals in Robotics. DAUIN Politecnico di Torino July 2010
Probabilistic Fundamentals in Robotics Gaussian Filters Basilio Bona DAUIN Politecnico di Torino July 2010 Course Outline Basic mathematical framework Probabilistic models of mobile robots Mobile robot
More informationAn Brief Overview of Particle Filtering
1 An Brief Overview of Particle Filtering Adam M. Johansen a.m.johansen@warwick.ac.uk www2.warwick.ac.uk/fac/sci/statistics/staff/academic/johansen/talks/ May 11th, 2010 Warwick University Centre for Systems
More informationCardinality Balanced Multi-Target Multi-Bernoulli Filtering Using Adaptive Birth Distributions
Cardinality Balanced Multi-Target Multi-Bernoulli Filtering Using Adaptive Birth Distributions Stephan Reuter, Daniel Meissner, Benjamin Wiling, and Klaus Dietmayer Institute of Measurement, Control, and
More information