Parameter identification using the skewed Kalman Filter
|
|
- Merilyn Joseph
- 5 years ago
- Views:
Transcription
1 Parameter identification using the sewed Kalman Filter Katrin Runtemund, Gerhard Müller, U München
2 Motivation and the investigated identification problem Problem: damped SDOF system excited by a sewed process wanted: estimation of the stiffness, damping paramter a 0 =/m and a 1 =c/m given: mathematical model of the system the statistical characteristics of the input force wind data was downloaded from the internet database: Database of Wind Characteristics located at DU, Denmar, from the Oa Cree wind farm site the true system response w(t) was simulated using the wind data
3 Wind speed measurement mast 1; heigth 79 m; frequency 8 Hz; duration 600s Statistics mean 0 m/s; variance 0,69 m/s; sewness -1,99 website: of DU
4 Overview Sewed Kalman Filter Extension of the sewed Kalman Filter for parameter identification problems Identification results of the application Conclusion
5 Sewed Kalman Filter
6 Sewed Kalman Filter (skf) rend & Noise Kalman Filter Sewed Kalman Filter introduced by P. Naveau, M. Genton and X. Shen Paper: A sewed Kalman Filter, Journal of Multivariate Analysis, 2004 based on the closed sew-normal distribution (CSN) introduced by G. González-Farías, J.A. Domínguez-Molina, A. K. Gupta (2004) Figure: M. G. Genton: Sew-Elliptical Distributions and their Applications A Journal Beyond Normality 1/19
7 Closed sew-normal distribution (CSN) family of distributions including the normal one, but with 3 additional parameters allows a continuous variation from a normal to a half-normal distribution closed under linear transformation marginalization conditioning summation* 2/19
8 Closed sew-normal distribution (CSN) CSN probability density function of a n-dimensional random vector X X ~ CSN n,m μ, Σ, D, ν, Δ p n,m x = φ n x; μ, Σ Φ m D x μ ; ν, Δ Φ m 0; ν, Δ + DΣD p n,m x = φ n x; μ, Σ Φ m D x μ ; ν, Δ mean values: Φ m 0; ν, μ ϵ Δ R+ n and DΣD ν ϵ R m φ n ; η, Ω = N η, Ω covariance matrices: Σ ϵ R n n and Δ ϵ R m m ΦΦ n n ; ; η, η, Ω Ω : : cumulative distribution distribution function function arbitrary matrix D ϵ R m n C = Φ m 0; ν, Δ + DΣD = const. D regulates sewness continuous variation from the normal (D = 0) to a half normal PDF μ, Σ location and scale parameters ν closure under conditioning Δ closure under marginalization C closure under summation 3/19
9 Standard Kalman Filter he standard KF is based on a linear state space model linear system equation: x x Bf Sw w ~ N 0, observation equation: z Ax the state follows a first order hidden Marov process represented as Bayesian Dynamic Networ 1 v v ~ N 0, v w 4/19
10 Implementation of sewness into the state space model Alternative 1: Introducing the sewness in the sytem equation by modeling the input force as additive CSN noise: f ~ CSN,,D,, x sewed x 1 noise Bf Sw sewed problem: the sum of two CSN of dimension (n, m) is of dimension (n, 2m) rapid increase of the dimension of the matrices step D, Δ at each time 5/19
11 Alternative 2: splitting up the state in a linear and a sewed part generation of the sewed process where D,,D,, ~ CSN D Y X D D D D, N ~ Y X 1 y y s Implementation of sewness into the state space model 1 Ly y x = u, s 6/19 noise sewed linear v s Au Gx w u S z S u 1 v Ax w f x z S B x 1
12 Alternative 2: splitting up the state in a linear and a sewed part generation of the sewed process step 1: time-update step 2: determine the joint distribution step 3: conditioning Implementation of sewness into the state space model noise sewed linear v s Au Gx w u S z S u 1 v Ax w f x z S B x 1 1 L y y 1 1 1, 1 1, 1 1 L L L L, L ~ N y y,,d,, ~ CSN D 1 y y s 7/19 x = u, s
13 Bayesian approach of the sewed Kalman filter 1. Initialising the filter using the prior PDF p u 1, y 1 z 1: 1 he filter is initialized by the multivariate norm ibuted 2. posterior Prediction: PDF of time-update u 1, y 1 z 1: 1 conditional nown previous from on time the observations step. In the up prediction to time step th estimate -1 of the using multivariate the system normal equations distributed p u variable, y, y 1 z 1: 1 conditional on the observ by 1: 1 the up multivariate to time normal 1 is distributed determined posterior using eq. PDF observing (4). of uafter 1 z,, y 1 the z 1: 1 measurement nown from lielihood the p, ythe, y3. prediction 1, zmeasurement 1: 1 step is the obtained prior update estimate from after the of observing error the Amultivariate eμ u, 1 = z : S normal Ε s z 1: 1 distributed between variable the predicte he onditional incoming from on measurement the the observations prediction using z 1: 1 error the conditional up e to = time z Ε expectation As z μ1 1: 1 u, 1 is determined of Bthe Ε priori s z using 1: 1 PDF. eq. Applying (4). After the Ba asurement e the posterior lielihood PDF of p the z, updated u, y, y 1 parameters, z 1: 1 uof is the zobtained 1: linear and the from using sewed the part error observation y ez 1: = can z be deriv his 1 between leads equation to the eq. predicted (6) and the incoming measurement using the conditional expectation ri PDF. Applying the Bayes rule the posterior PDF of the updated parameters of the linear part y4. z 1: Applying can be derived the Bayes [1]. his Rule leads leads to eq. (6) to the posterior PDF p u, y, y 1 z 1: = p z u, y, y 1 p u, y, y 1 z 1: 1 p z z 1: 1 8/19
14 Bayesian approach to the sewed Kalman filter p u, y, y 1 z 1: = p z u, y, y 1 p u, y, y 1 z 1: 1 p z z 1: 1 5. Marginalization leads to the posterior PDF of the linear part p u z 1: 6. Marginalization and Conditioning with respect to leads to the p u posterior PDF of the sewed, y, y part 1 z 1: = p z u, y, y 1 p u, y, y 1 z 1: p s z 1: p z z 1: 1 Advantages of the method: computationally efficient: the closure properties of the CSN allow to reduce the filter algorithm to the recursive calculation of the parameters At each time step a different sewness can be implemented by changing the matrix of the process y L y L 1 9/19
15 PREDICION (IME UPDAE) Project the state ahead (prior estimate) Linear part μ u, = μ u, 1 Σ uu, = Σ uu, 1 + S Σ ww, 1 S Sewed part μ y, = L μ y, 1 Σ yy, = L Σ yy, 1 L + Σ ηη, D = Σ yy, 1 L 1 Σ yy, ν = μ y, 1 D μ y, Δ = Σ yy, 1 D Σ yy, D CORRECION (MEASUREMEN UPDAE) Compute the Kalman gain matrix of the linear and sewed part K = Σ uu, A Σ vv, + A Σ uu, A + S Var[s z 1: 1 ]S 1 K s, = C S Σ vv, + A Σ uu, A + S Var[s z 1: 1 ]S 1 Update estimate with measurement (posterior estimate) e = z A μ u, S E s z 1: 1 Linear part μ y, = μ u, + K e Σ uu, = Σ uu, K A Σ uu, Sewed part μ y, = μ y, + K s, e Σ yy, = Σ yy, K s, S C D = Σ yy, L 1 Σ yy, ν = μ y, 1 +C 1 C 1 K s, e D μ y, Δ = Σ yy, D Σ yy, D 10/19
16 PREDICION (IME UPDAE) Project the state ahead (prior estimate) Linear part μ u, = μ u, 1 Σ uu, = Σ uu, 1 + S Σ ww, 1 S Sewed part μ y, = L μ y, 1 Σ yy, = L Σ yy, 1 L + Σ ηη, D = Σ yy, 1 L 1 Σ yy, ν = μ y, 1 D μ y, Δ = Σ yy, 1 D Σ yy, D CORRECION (MEASUREMEN UPDAE) Compute the Kalman gain matrix of the linear and sewed part K = Σ uu, A Σ vv, + A Σ uu, A + S Var[s z 1: 1 ]S 1 K s, = C S Σ vv, + A Σ uu, A + S Var[s z 1: 1 ]S 1 Update estimate with measurement (posterior estimate) e = z A μ u, S E s z 1: 1 Linear part μ y, = μ u, + K e Σ uu, = Σ uu, K A Σ uu, Sewed part μ y, = μ y, + K s, e Σ yy, = Σ yy, K s, S C D = Σ yy, L 1 Σ yy, ν = μ y, 1 +C 1 C 1 K s, e D μ y, Δ = Σ yy, D Σ yy, D Sewed Kalman Filter Kalman Filter 10/19
17 Extended sewed Kalman Filter (EsKF)
18 Parameter identification using the Extended Kalman Filter (EKF) Example: damped single degree of freedom system wanted: estimation of the stiffness, damping paramter a 0 =/m and a 1 =c/m u u Sw 1 Problem: he transfer matrices,-1, B,-1, S,-1 depend on the unnown parameters: = e δ t δ ω d sin ω d t + cos ω d t ω 0 2 ω d sin ω d t 1 ω d sin ω d t cos ω d t δ ω d sin ω d t a a m c 2 m d /19
19 Parameter identification using the Extended Kalman Filter (EKF) step 1: Extending the state by the parameter vector p to include the model parameters to be identified x ext, = x p = w v a 0, a 1, extended state space model x ext, = f x 1, p 1, u 1, w 1, w p, 1 z ext, = A ext, x ext, + v step 2: Approximation of the nonlinear function f by a first order aylor series near the current state estimate xˆ 1 x ext, f x 0, 1 + f x 0, 1 x 0i, 1 x 0i, 1 x 0i, 1 x 0i, 1 x 0, 1 = x 1 p 1 u 1 w 1 w p, 1 x 1 p 1 u = x 0, 1 12/19
20 Parameter identification using the Extended Kalman Filter (EKF) step 2: Approximation of the nonlinear function f by a first order aylor series near the current state estimate xˆ 1 x ext, f x 0, 1 + ext, x 1 x 1 p 1 p p, 1 ε ext,x, 1 + B ext, u 1 u 1 ε ext,u, 1 + S ext, w 1 w p, 1 ε ext,w, 1 ext, = p 1 J f, p 1 with J f, p I 1 = f x 0, B ext, = B p p 1 x0i, 1 S ext, = S p 1 J f, w p, 1 with J f, w p, 1 = f x 0, I 2 2 w p, 1 x 0i, 1 Jacobian Matrix w a J f p = 0 w a 1 v a 0 v a 1 13/19
21 Parameter identification using the Extended sewed Kalman Filter (EsKF) in case of the sewed state space model, the linearization is done around the current state of the linear part linear part : sewed part : u y ext, L ext, -1 y 1 u ext, 1 S ext, -1 s w ext, y y 1 D z Gx A ext u A ext S ext, -1 s v A ext the linearized extended state space model can now be investigated using the introduced sewed Kalman filter algorithm where the time-variante transfer matrices, S extended matrices ext,, S ext, are replaced by the 14/19
22 Identification results
23 Approximation of the PDF of the measurement wind data 15/19
24 Identification results identified identification true initial initial error parameters error values values EKF EsKF EKF EsKF a 0 [s 2 ] % 20,40 101,84 79,6 % 2 % a 1 [s 1 ] 0,2 0,3 50 % 1,18 0, % 5% 16/19
25 Predicted displacement and generated load 17/19
26 Conclusion he method is computational efficient he method wored well for the introduced identification problem he CSN allows to describe the characteristics of the regarded sewed wind data he form of the temperal evaluation of the wind data was approximated well, but the amplitude was wrong by a factor 100 Further wor Find the error.any comments? Investigate the sensitivity of the parameter identification results depending on the initial conditions Extending the method to a multi-degree of freedom system 19/19
27 hans! Any questions or comments? 19/19
28 PREDICION (IME UPDAE) Project the state ahead (prior estimate) Linear part μ u, = μ u, 1 Σ uu, = Σ uu, 1 + S Σ ww, 1 S Sewed part μ y, = L μ y, 1 Σ yy, = L Σ yy, 1 L + Σ ηη, D = Σ yy, 1 L 1 Σ yy, ν = μ y, 1 D μ y, Δ = Σ yy, 1 D Σ yy, D CORRECION (MEASUREMEN UPDAE) Compute the Kalman gain matrix of the linear and sewed part K = Σ uu, A Σ vv, + A Σ uu, A + S Var[s z 1: 1 ]S 1 K s, = C S Σ vv, + A Σ uu, A + S Var[s z 1: 1 ]S 1 Update estimate with measurement (posterior estimate) e = z A μ u, S E s z 1: 1 Linear part μ y, = μ u, + K e Σ uu, = Σ uu, K A Σ uu, Sewed part μ y, = μ y, + K s, e Σ yy, = Σ yy, K s, S C D = Σ yy, L 1 Σ yy, ν = μ y, 1 +C 1 C 1 K s, e D μ y, Δ = Σ yy, D Σ yy, D 18/19
Dynamic System Identification using HDMR-Bayesian Technique
Dynamic System Identification using HDMR-Bayesian Technique *Shereena O A 1) and Dr. B N Rao 2) 1), 2) Department of Civil Engineering, IIT Madras, Chennai 600036, Tamil Nadu, India 1) ce14d020@smail.iitm.ac.in
More informationF denotes cumulative density. denotes probability density function; (.)
BAYESIAN ANALYSIS: FOREWORDS Notation. System means the real thing and a model is an assumed mathematical form for the system.. he probability model class M contains the set of the all admissible models
More informationROBOTICS 01PEEQW. Basilio Bona DAUIN Politecnico di Torino
ROBOTICS 01PEEQW Basilio Bona DAUIN Politecnico di Torino Probabilistic Fundamentals in Robotics Gaussian Filters Course Outline Basic mathematical framework Probabilistic models of mobile robots Mobile
More informationThe Unscented Particle Filter
The Unscented Particle Filter Rudolph van der Merwe (OGI) Nando de Freitas (UC Bereley) Arnaud Doucet (Cambridge University) Eric Wan (OGI) Outline Optimal Estimation & Filtering Optimal Recursive Bayesian
More informationIntroduction to Probabilistic Graphical Models: Exercises
Introduction to Probabilistic Graphical Models: Exercises Cédric Archambeau Xerox Research Centre Europe cedric.archambeau@xrce.xerox.com Pascal Bootcamp Marseille, France, July 2010 Exercise 1: basics
More informationMini-Course 07 Kalman Particle Filters. Henrique Massard da Fonseca Cesar Cunha Pacheco Wellington Bettencurte Julio Dutra
Mini-Course 07 Kalman Particle Filters Henrique Massard da Fonseca Cesar Cunha Pacheco Wellington Bettencurte Julio Dutra Agenda State Estimation Problems & Kalman Filter Henrique Massard Steady State
More informationProbabilistic Fundamentals in Robotics. DAUIN Politecnico di Torino July 2010
Probabilistic Fundamentals in Robotics Gaussian Filters Basilio Bona DAUIN Politecnico di Torino July 2010 Course Outline Basic mathematical framework Probabilistic models of mobile robots Mobile robot
More informationRobotics 2 Target Tracking. Kai Arras, Cyrill Stachniss, Maren Bennewitz, Wolfram Burgard
Robotics 2 Target Tracking Kai Arras, Cyrill Stachniss, Maren Bennewitz, Wolfram Burgard Slides by Kai Arras, Gian Diego Tipaldi, v.1.1, Jan 2012 Chapter Contents Target Tracking Overview Applications
More informationCIS 390 Fall 2016 Robotics: Planning and Perception Final Review Questions
CIS 390 Fall 2016 Robotics: Planning and Perception Final Review Questions December 14, 2016 Questions Throughout the following questions we will assume that x t is the state vector at time t, z t is the
More informationKalman Filters. Derivation of Kalman Filter equations
Kalman Filters Derivation of Kalman Filter equations Mar Fiala CRV 10 Tutorial Day May 29/2010 Kalman Filters Predict x ˆ + = F xˆ 1 1 1 B u P F + 1 = F P 1 1 T Q Update S H + K ~ y P = H P 1 T T 1 = P
More informationGaussians. Pieter Abbeel UC Berkeley EECS. Many slides adapted from Thrun, Burgard and Fox, Probabilistic Robotics
Gaussians Pieter Abbeel UC Berkeley EECS Many slides adapted from Thrun, Burgard and Fox, Probabilistic Robotics Outline Univariate Gaussian Multivariate Gaussian Law of Total Probability Conditioning
More informationA Comparison of Particle Filters for Personal Positioning
VI Hotine-Marussi Symposium of Theoretical and Computational Geodesy May 9-June 6. A Comparison of Particle Filters for Personal Positioning D. Petrovich and R. Piché Institute of Mathematics Tampere University
More informationAvailable online at ScienceDirect. Energy Procedia 94 (2016 )
Available online at www.sciencedirect.com ScienceDirect Energy Procedia 94 (216 ) 191 198 13th Deep Sea Offshore Wind R&D Conference, EERA DeepWind 216, 2-22 January 216, Trondheim, Norway Vibration-based
More informationAutonomous Navigation for Flying Robots
Computer Vision Group Prof. Daniel Cremers Autonomous Navigation for Flying Robots Lecture 6.2: Kalman Filter Jürgen Sturm Technische Universität München Motivation Bayes filter is a useful tool for state
More informationAn introduction to particle filters
An introduction to particle filters Andreas Svensson Department of Information Technology Uppsala University June 10, 2014 June 10, 2014, 1 / 16 Andreas Svensson - An introduction to particle filters Outline
More informationNonlinear Parameter Estimation for State-Space ARCH Models with Missing Observations
Nonlinear Parameter Estimation for State-Space ARCH Models with Missing Observations SEBASTIÁN OSSANDÓN Pontificia Universidad Católica de Valparaíso Instituto de Matemáticas Blanco Viel 596, Cerro Barón,
More informationCramér-Rao Bounds for Estimation of Linear System Noise Covariances
Journal of Mechanical Engineering and Automation (): 6- DOI: 593/jjmea Cramér-Rao Bounds for Estimation of Linear System oise Covariances Peter Matiso * Vladimír Havlena Czech echnical University in Prague
More informationWavelet-Based Nonparametric Modeling of Hierarchical Functions in Colon Carcinogenesis
Wavelet-Based Nonparametric Modeling of Hierarchical Functions in Colon Carcinogenesis Jeffrey S. Morris University of Texas, MD Anderson Cancer Center Joint wor with Marina Vannucci, Philip J. Brown,
More information10-701/15-781, Machine Learning: Homework 4
10-701/15-781, Machine Learning: Homewor 4 Aarti Singh Carnegie Mellon University ˆ The assignment is due at 10:30 am beginning of class on Mon, Nov 15, 2010. ˆ Separate you answers into five parts, one
More informationPATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 13: SEQUENTIAL DATA
PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 13: SEQUENTIAL DATA Contents in latter part Linear Dynamical Systems What is different from HMM? Kalman filter Its strength and limitation Particle Filter
More informationUniversität Potsdam Institut für Informatik Lehrstuhl Maschinelles Lernen. Bayesian Learning. Tobias Scheffer, Niels Landwehr
Universität Potsdam Institut für Informatik Lehrstuhl Maschinelles Lernen Bayesian Learning Tobias Scheffer, Niels Landwehr Remember: Normal Distribution Distribution over x. Density function with parameters
More informationElliptically Contoured Distributions
Elliptically Contoured Distributions Recall: if X N p µ, Σ), then { 1 f X x) = exp 1 } det πσ x µ) Σ 1 x µ) So f X x) depends on x only through x µ) Σ 1 x µ), and is therefore constant on the ellipsoidal
More informationIntroduction to Mobile Robotics Probabilistic Robotics
Introduction to Mobile Robotics Probabilistic Robotics Wolfram Burgard 1 Probabilistic Robotics Key idea: Explicit representation of uncertainty (using the calculus of probability theory) Perception Action
More informationFor final project discussion every afternoon Mark and I will be available
Worshop report 1. Daniels report is on website 2. Don t expect to write it based on listening to one project (we had 6 only 2 was sufficient quality) 3. I suggest writing it on one presentation. 4. Include
More informationLinear Prediction Theory
Linear Prediction Theory Joseph A. O Sullivan ESE 524 Spring 29 March 3, 29 Overview The problem of estimating a value of a random process given other values of the random process is pervasive. Many problems
More informationProbabilistic Robotics
Probabilisic Roboics Bayes Filer Implemenaions Gaussian filers Bayes Filer Reminder Predicion bel p u bel d Correcion bel η p z bel Gaussians : ~ π e p N p - Univariae / / : ~ μ μ μ e p Ν p d π Mulivariae
More informationA new Hierarchical Bayes approach to ensemble-variational data assimilation
A new Hierarchical Bayes approach to ensemble-variational data assimilation Michael Tsyrulnikov and Alexander Rakitko HydroMetCenter of Russia College Park, 20 Oct 2014 Michael Tsyrulnikov and Alexander
More informationEKF and SLAM. McGill COMP 765 Sept 18 th, 2017
EKF and SLAM McGill COMP 765 Sept 18 th, 2017 Outline News and information Instructions for paper presentations Continue on Kalman filter: EKF and extension to mapping Example of a real mapping system:
More informationThe Kalman Filter ImPr Talk
The Kalman Filter ImPr Talk Ged Ridgway Centre for Medical Image Computing November, 2006 Outline What is the Kalman Filter? State Space Models Kalman Filter Overview Bayesian Updating of Estimates Kalman
More informationX t = a t + r t, (7.1)
Chapter 7 State Space Models 71 Introduction State Space models, developed over the past 10 20 years, are alternative models for time series They include both the ARIMA models of Chapters 3 6 and the Classical
More informationGaussian Process Approximations of Stochastic Differential Equations
Gaussian Process Approximations of Stochastic Differential Equations Cédric Archambeau Dan Cawford Manfred Opper John Shawe-Taylor May, 2006 1 Introduction Some of the most complex models routinely run
More informationBayesian Methods in Positioning Applications
Bayesian Methods in Positioning Applications Vedran Dizdarević v.dizdarevic@tugraz.at Graz University of Technology, Austria 24. May 2006 Bayesian Methods in Positioning Applications p.1/21 Outline Problem
More informationA Probability Review
A Probability Review Outline: A probability review Shorthand notation: RV stands for random variable EE 527, Detection and Estimation Theory, # 0b 1 A Probability Review Reading: Go over handouts 2 5 in
More information2D Image Processing (Extended) Kalman and particle filter
2D Image Processing (Extended) Kalman and particle filter Prof. Didier Stricker Dr. Gabriele Bleser Kaiserlautern University http://ags.cs.uni-kl.de/ DFKI Deutsches Forschungszentrum für Künstliche Intelligenz
More informationLinear-Quadratic-Gaussian (LQG) Controllers and Kalman Filters
Linear-Quadratic-Gaussian (LQG) Controllers and Kalman Filters Emo Todorov Applied Mathematics and Computer Science & Engineering University of Washington Winter 204 Emo Todorov (UW) AMATH/CSE 579, Winter
More informationECE276A: Sensing & Estimation in Robotics Lecture 10: Gaussian Mixture and Particle Filtering
ECE276A: Sensing & Estimation in Robotics Lecture 10: Gaussian Mixture and Particle Filtering Lecturer: Nikolay Atanasov: natanasov@ucsd.edu Teaching Assistants: Siwei Guo: s9guo@eng.ucsd.edu Anwesan Pal:
More informationBifurcation Analysis of Chaotic Systems using a Model Built on Artificial Neural Networks
Bifurcation Analysis of Chaotic Systems using a Model Built on Artificial Neural Networs Archana R, A Unnirishnan, and R Gopiaumari Abstract-- he analysis of chaotic systems is done with the help of bifurcation
More informationDynamic models 1 Kalman filters, linearization,
Koller & Friedman: Chapter 16 Jordan: Chapters 13, 15 Uri Lerner s Thesis: Chapters 3,9 Dynamic models 1 Kalman filters, linearization, Switching KFs, Assumed density filters Probabilistic Graphical Models
More informationConvergence of the Ensemble Kalman Filter in Hilbert Space
Convergence of the Ensemble Kalman Filter in Hilbert Space Jan Mandel Center for Computational Mathematics Department of Mathematical and Statistical Sciences University of Colorado Denver Parts based
More informationLagrangian Data Assimilation and Manifold Detection for a Point-Vortex Model. David Darmon, AMSC Kayo Ide, AOSC, IPST, CSCAMM, ESSIC
Lagrangian Data Assimilation and Manifold Detection for a Point-Vortex Model David Darmon, AMSC Kayo Ide, AOSC, IPST, CSCAMM, ESSIC Background Data Assimilation Iterative process Forecast Analysis Background
More informationKalman Filter. Predict: Update: x k k 1 = F k x k 1 k 1 + B k u k P k k 1 = F k P k 1 k 1 F T k + Q
Kalman Filter Kalman Filter Predict: x k k 1 = F k x k 1 k 1 + B k u k P k k 1 = F k P k 1 k 1 F T k + Q Update: K = P k k 1 Hk T (H k P k k 1 Hk T + R) 1 x k k = x k k 1 + K(z k H k x k k 1 ) P k k =(I
More informationSensor Tasking and Control
Sensor Tasking and Control Sensing Networking Leonidas Guibas Stanford University Computation CS428 Sensor systems are about sensing, after all... System State Continuous and Discrete Variables The quantities
More information(Extended) Kalman Filter
(Extended) Kalman Filter Brian Hunt 7 June 2013 Goals of Data Assimilation (DA) Estimate the state of a system based on both current and all past observations of the system, using a model for the system
More informationState-space Model. Eduardo Rossi University of Pavia. November Rossi State-space Model Fin. Econometrics / 53
State-space Model Eduardo Rossi University of Pavia November 2014 Rossi State-space Model Fin. Econometrics - 2014 1 / 53 Outline 1 Motivation 2 Introduction 3 The Kalman filter 4 Forecast errors 5 State
More informationCS491/691: Introduction to Aerial Robotics
CS491/691: Introduction to Aerial Robotics Topic: State Estimation Dr. Kostas Alexis (CSE) World state (or system state) Belief state: Our belief/estimate of the world state World state: Real state of
More information4. Distributions of Functions of Random Variables
4. Distributions of Functions of Random Variables Setup: Consider as given the joint distribution of X 1,..., X n (i.e. consider as given f X1,...,X n and F X1,...,X n ) Consider k functions g 1 : R n
More informationComparision of Probabilistic Navigation methods for a Swimming Robot
Comparision of Probabilistic Navigation methods for a Swimming Robot Anwar Ahmad Quraishi Semester Project, Autumn 2013 Supervisor: Yannic Morel BioRobotics Laboratory Headed by Prof. Aue Jan Ijspeert
More information1 EM algorithm: updating the mixing proportions {π k } ik are the posterior probabilities at the qth iteration of EM.
Université du Sud Toulon - Var Master Informatique Probabilistic Learning and Data Analysis TD: Model-based clustering by Faicel CHAMROUKHI Solution The aim of this practical wor is to show how the Classification
More informationA Robust Extended Kalman Filter for Discrete-time Systems with Uncertain Dynamics, Measurements and Correlated Noise
2009 American Control Conference Hyatt Regency Riverfront, St. Louis, MO, USA June 10-12, 2009 WeC16.6 A Robust Extended Kalman Filter for Discrete-time Systems with Uncertain Dynamics, Measurements and
More informationDual Estimation and the Unscented Transformation
Dual Estimation and the Unscented Transformation Eric A. Wan ericwan@ece.ogi.edu Rudolph van der Merwe rudmerwe@ece.ogi.edu Alex T. Nelson atnelson@ece.ogi.edu Oregon Graduate Institute of Science & Technology
More informationImplicit sampling for particle filters. Alexandre Chorin, Mathias Morzfeld, Xuemin Tu, Ethan Atkins
0/20 Implicit sampling for particle filters Alexandre Chorin, Mathias Morzfeld, Xuemin Tu, Ethan Atkins University of California at Berkeley 2/20 Example: Try to find people in a boat in the middle of
More informationPrognosis of Structural Health : Non-Destructive Methods
International Journal of Performability Engineering Vol. 6, No. 5, September 2010, pp. 487-498. RAMS Consultants Printed in India Prognosis of Structural Health : Non-Destructive Methods ACHINTYA HALDAR
More informationLecture 2: From Linear Regression to Kalman Filter and Beyond
Lecture 2: From Linear Regression to Kalman Filter and Beyond January 18, 2017 Contents 1 Batch and Recursive Estimation 2 Towards Bayesian Filtering 3 Kalman Filter and Bayesian Filtering and Smoothing
More informationSKEW-NORMALITY IN STOCHASTIC FRONTIER ANALYSIS
SKEW-NORMALITY IN STOCHASTIC FRONTIER ANALYSIS J. Armando Domínguez-Molina, Graciela González-Farías and Rogelio Ramos-Quiroga Comunicación Técnica No I-03-18/06-10-003 PE/CIMAT 1 Skew-Normality in Stochastic
More informationExtension of the Sparse Grid Quadrature Filter
Extension of the Sparse Grid Quadrature Filter Yang Cheng Mississippi State University Mississippi State, MS 39762 Email: cheng@ae.msstate.edu Yang Tian Harbin Institute of Technology Harbin, Heilongjiang
More informationState-space Model. Eduardo Rossi University of Pavia. November Rossi State-space Model Financial Econometrics / 49
State-space Model Eduardo Rossi University of Pavia November 2013 Rossi State-space Model Financial Econometrics - 2013 1 / 49 Outline 1 Introduction 2 The Kalman filter 3 Forecast errors 4 State smoothing
More information9 Multi-Model State Estimation
Technion Israel Institute of Technology, Department of Electrical Engineering Estimation and Identification in Dynamical Systems (048825) Lecture Notes, Fall 2009, Prof. N. Shimkin 9 Multi-Model State
More information2D Image Processing. Bayes filter implementation: Kalman filter
2D Image Processing Bayes filter implementation: Kalman filter Prof. Didier Stricker Kaiserlautern University http://ags.cs.uni-kl.de/ DFKI Deutsches Forschungszentrum für Künstliche Intelligenz http://av.dfki.de
More informationL06. LINEAR KALMAN FILTERS. NA568 Mobile Robotics: Methods & Algorithms
L06. LINEAR KALMAN FILTERS NA568 Mobile Robotics: Methods & Algorithms 2 PS2 is out! Landmark-based Localization: EKF, UKF, PF Today s Lecture Minimum Mean Square Error (MMSE) Linear Kalman Filter Gaussian
More informationStructural Dynamics Lecture 2. Outline of Lecture 2. Single-Degree-of-Freedom Systems (cont.)
Outline of Single-Degree-of-Freedom Systems (cont.) Linear Viscous Damped Eigenvibrations. Logarithmic decrement. Response to Harmonic and Periodic Loads. 1 Single-Degreee-of-Freedom Systems (cont.). Linear
More informationStochastic Dynamics of SDOF Systems (cont.).
Outline of Stochastic Dynamics of SDOF Systems (cont.). Weakly Stationary Response Processes. Equivalent White Noise Approximations. Gaussian Response Processes as Conditional Normal Distributions. Stochastic
More informationIntroduction to Mobile Robotics
Inroducion o Mobile Roboics Bayes Filer Kalman Filer Wolfram Burgard Cyrill Sachniss Giorgio Grisei Maren Bennewiz Chrisian Plagemann Bayes Filer Reminder Predicion bel p u bel d Correcion bel η p z bel
More informationTSRT14: Sensor Fusion Lecture 8
TSRT14: Sensor Fusion Lecture 8 Particle filter theory Marginalized particle filter Gustaf Hendeby gustaf.hendeby@liu.se TSRT14 Lecture 8 Gustaf Hendeby Spring 2018 1 / 25 Le 8: particle filter theory,
More informationExtended Object and Group Tracking with Elliptic Random Hypersurface Models
Extended Object and Group Tracing with Elliptic Random Hypersurface Models Marcus Baum Benjamin Noac and Uwe D. Hanebec Intelligent Sensor-Actuator-Systems Laboratory ISAS Institute for Anthropomatics
More informationDr.Vinod Hosur, Professor, Civil Engg.Dept., Gogte Institute of Technology, Belgaum
STRUCTURAL DYNAMICS Dr.Vinod Hosur, Professor, Civil Engg.Dept., Gogte Institute of Technology, Belgaum Overview of Structural Dynamics Structure Members, joints, strength, stiffness, ductility Structure
More informationIntroduction to Smoothing spline ANOVA models (metamodelling)
Introduction to Smoothing spline ANOVA models (metamodelling) M. Ratto DYNARE Summer School, Paris, June 215. Joint Research Centre www.jrc.ec.europa.eu Serving society Stimulating innovation Supporting
More informationConditional Posterior Cramér-Rao Lower Bounds for Nonlinear Sequential Bayesian Estimation
1 Conditional Posterior Cramér-Rao Lower Bounds for Nonlinear Sequential Bayesian Estimation Long Zuo, Ruixin Niu, and Pramod K. Varshney Abstract Posterior Cramér-Rao lower bounds (PCRLBs) 1] for sequential
More informationLecture 4: Probabilistic Learning. Estimation Theory. Classification with Probability Distributions
DD2431 Autumn, 2014 1 2 3 Classification with Probability Distributions Estimation Theory Classification in the last lecture we assumed we new: P(y) Prior P(x y) Lielihood x2 x features y {ω 1,..., ω K
More informationEstimation of state space models with skewed shocks
Estimation of state space models with skewed shocks Grzegorz Koloch April 30, 2012 Abstract This paper provides analytical formulae for the likelihood function, predictive densities and the filtration
More informationNonlinear and/or Non-normal Filtering. Jesús Fernández-Villaverde University of Pennsylvania
Nonlinear and/or Non-normal Filtering Jesús Fernández-Villaverde University of Pennsylvania 1 Motivation Nonlinear and/or non-gaussian filtering, smoothing, and forecasting (NLGF) problems are pervasive
More informationRecurrent Neural Network Training with the Extended Kalman Filter
Recurrent Neural Networ raining with the Extended Kalman Filter Peter REBAICKÝ Slova University of echnology Faculty of Informatics and Information echnologies Ilovičova 3, 842 16 Bratislava, Slovaia trebaticy@fiit.stuba.s
More informationLecture 2: From Linear Regression to Kalman Filter and Beyond
Lecture 2: From Linear Regression to Kalman Filter and Beyond Department of Biomedical Engineering and Computational Science Aalto University January 26, 2012 Contents 1 Batch and Recursive Estimation
More informationKernel Bayes Rule: Nonparametric Bayesian inference with kernels
Kernel Bayes Rule: Nonparametric Bayesian inference with kernels Kenji Fukumizu The Institute of Statistical Mathematics NIPS 2012 Workshop Confluence between Kernel Methods and Graphical Models December
More informationLecture 4: Extended Kalman filter and Statistically Linearized Filter
Lecture 4: Extended Kalman filter and Statistically Linearized Filter Department of Biomedical Engineering and Computational Science Aalto University February 17, 2011 Contents 1 Overview of EKF 2 Linear
More informationUniversity of Cambridge Engineering Part IIB Module 3F3: Signal and Pattern Processing Handout 2:. The Multivariate Gaussian & Decision Boundaries
University of Cambridge Engineering Part IIB Module 3F3: Signal and Pattern Processing Handout :. The Multivariate Gaussian & Decision Boundaries..15.1.5 1 8 6 6 8 1 Mark Gales mjfg@eng.cam.ac.uk Lent
More informationBasic concepts in estimation
Basic concepts in estimation Random and nonrandom parameters Definitions of estimates ML Maimum Lielihood MAP Maimum A Posteriori LS Least Squares MMS Minimum Mean square rror Measures of quality of estimates
More informationLinear MIMO model identification using an extended Kalman filter
Loughborough University Institutional Repository Linear MIMO model identification using an extended Kalman filter This item was submitted to Loughborough University's Institutional Repository by the/an
More informationBayes Filter Reminder. Kalman Filter Localization. Properties of Gaussians. Gaussians. Prediction. Correction. σ 2. Univariate. 1 2πσ e.
Kalman Filter Localization Bayes Filter Reminder Prediction Correction Gaussians p(x) ~ N(µ,σ 2 ) : Properties of Gaussians Univariate p(x) = 1 1 2πσ e 2 (x µ) 2 σ 2 µ Univariate -σ σ Multivariate µ Multivariate
More informationAn Improved Particle Filter with Applications in Ballistic Target Tracking
Sensors & ransducers Vol. 72 Issue 6 June 204 pp. 96-20 Sensors & ransducers 204 by IFSA Publishing S. L. http://www.sensorsportal.co An Iproved Particle Filter with Applications in Ballistic arget racing
More informationExtended Kalman Filter based State Estimation of Wind Turbine
Extended Kalman Filter based State Estimation of Wind Turbine Kavitha N*, Vijayachitra S# *PG Scholar,.E. Control and Instrumentation Engineering #Professor, Department of Electronics and Instrumentation
More informationRecursive Noise Adaptive Kalman Filtering by Variational Bayesian Approximations
PREPRINT 1 Recursive Noise Adaptive Kalman Filtering by Variational Bayesian Approximations Simo Särä, Member, IEEE and Aapo Nummenmaa Abstract This article considers the application of variational Bayesian
More informationAn Introduction to Bayesian Linear Regression
An Introduction to Bayesian Linear Regression APPM 5720: Bayesian Computation Fall 2018 A SIMPLE LINEAR MODEL Suppose that we observe explanatory variables x 1, x 2,..., x n and dependent variables y 1,
More informationIntroduction to Probability and Stocastic Processes - Part I
Introduction to Probability and Stocastic Processes - Part I Lecture 2 Henrik Vie Christensen vie@control.auc.dk Department of Control Engineering Institute of Electronic Systems Aalborg University Denmark
More informationarxiv: v1 [cs.sy] 12 Dec 2016
Approximate Recursive Identification of Autoregressive Systems with Sewed Innovations arxiv:161.03761v1 [cs.sy] 1 Dec 016 Henri Nurminen Dept. of Automation Science and Engineering Tampere University of
More informationEmpirical Bayes Estimation in Multiple Linear Regression with Multivariate Skew-Normal Distribution as Prior
Journal of Mathematical Extension Vol. 5, No. 2 (2, (2011, 37-50 Empirical Bayes Estimation in Multiple Linear Regression with Multivariate Skew-Normal Distribution as Prior M. Khounsiavash Islamic Azad
More informationHierarchical Bayes Ensemble Kalman Filter
Hierarchical Bayes Ensemble Kalman Filter M Tsyrulnikov and A Rakitko HydroMetCenter of Russia Wrocław, 7 Sep 2015 M Tsyrulnikov and A Rakitko (HMC) Hierarchical Bayes Ensemble Kalman Filter Wrocław, 7
More informationSimultaneous state and input estimation of non-linear process with unknown inputs using particle swarm optimization particle filter (PSO-PF) algorithm
Simultaneous state and input estimation of non-linear process with unknown inputs using particle swarm optimization particle filter (PSO-PF) algorithm Mohammad A. Khan, CSChe 2016 Outlines Motivations
More informationMobile Robot Localization
Mobile Robot Localization 1 The Problem of Robot Localization Given a map of the environment, how can a robot determine its pose (planar coordinates + orientation)? Two sources of uncertainty: - observations
More informationData Analysis and Manifold Learning Lecture 6: Probabilistic PCA and Factor Analysis
Data Analysis and Manifold Learning Lecture 6: Probabilistic PCA and Factor Analysis Radu Horaud INRIA Grenoble Rhone-Alpes, France Radu.Horaud@inrialpes.fr http://perception.inrialpes.fr/ Outline of Lecture
More informationA Comparison of Error Subspace Kalman Filters
Tellus 000, 000 000 (0000) Printed 4 February 2005 (Tellus LATEX style file v2.2) A Comparison of Error Subspace Kalman Filters By LARS NERGER, WOLFGANG HILLER and JENS SCHRÖTER Alfred Wegener Institute
More informationx. Figure 1: Examples of univariate Gaussian pdfs N (x; µ, σ 2 ).
.8.6 µ =, σ = 1 µ = 1, σ = 1 / µ =, σ =.. 3 1 1 3 x Figure 1: Examples of univariate Gaussian pdfs N (x; µ, σ ). The Gaussian distribution Probably the most-important distribution in all of statistics
More informationJoint input-response predictions in structural dynamics
Joint input-response predictions in structural dynamics Eliz-Mari Lourens, Geert Lombaert KU Leuven, Department of Civil Engineering, Leuven, Belgium Costas Papadimitriou University of Thessaly, Department
More informationFrom Bayes to Extended Kalman Filter
From Bayes to Extended Kalman Filter Michal Reinštein Czech Technical University in Prague Faculty of Electrical Engineering, Department of Cybernetics Center for Machine Perception http://cmp.felk.cvut.cz/
More informationTAKEHOME FINAL EXAM e iω e 2iω e iω e 2iω
ECO 513 Spring 2015 TAKEHOME FINAL EXAM (1) Suppose the univariate stochastic process y is ARMA(2,2) of the following form: y t = 1.6974y t 1.9604y t 2 + ε t 1.6628ε t 1 +.9216ε t 2, (1) where ε is i.i.d.
More informationBayesian Estimation of DSGE Models
Bayesian Estimation of DSGE Models Stéphane Adjemian Université du Maine, GAINS & CEPREMAP stephane.adjemian@univ-lemans.fr http://www.dynare.org/stepan June 28, 2011 June 28, 2011 Université du Maine,
More informationSensor Fusion: Particle Filter
Sensor Fusion: Particle Filter By: Gordana Stojceska stojcesk@in.tum.de Outline Motivation Applications Fundamentals Tracking People Advantages and disadvantages Summary June 05 JASS '05, St.Petersburg,
More informationLeast Squares. Ken Kreutz-Delgado (Nuno Vasconcelos) ECE 175A Winter UCSD
Least Squares Ken Kreutz-Delgado (Nuno Vasconcelos) ECE 75A Winter 0 - UCSD (Unweighted) Least Squares Assume linearity in the unnown, deterministic model parameters Scalar, additive noise model: y f (
More informationDetecting Parametric Signals in Noise Having Exactly Known Pdf/Pmf
Detecting Parametric Signals in Noise Having Exactly Known Pdf/Pmf Reading: Ch. 5 in Kay-II. (Part of) Ch. III.B in Poor. EE 527, Detection and Estimation Theory, # 5c Detecting Parametric Signals in Noise
More informationCourse on Inverse Problems
Stanford University School of Earth Sciences Course on Inverse Problems Albert Tarantola Third Lesson: Probability (Elementary Notions) Let u and v be two Cartesian parameters (then, volumetric probabilities
More information1 Kalman Filter Introduction
1 Kalman Filter Introduction You should first read Chapter 1 of Stochastic models, estimation, and control: Volume 1 by Peter S. Maybec (available here). 1.1 Explanation of Equations (1-3) and (1-4) Equation
More information