Biophysical Journal, Volume 98 Supporting Material Analysis of video-based Microscopic Particle Trajectories Using Kalman Filtering Pei-Hsun Wu,

Size: px
Start display at page:

Download "Biophysical Journal, Volume 98 Supporting Material Analysis of video-based Microscopic Particle Trajectories Using Kalman Filtering Pei-Hsun Wu,"

Transcription

1 Biophysical Journal, Volume 98 Supporting Material Analysis of video-based Microscopic Particle Trajectories Using Kalman Filtering Pei-Hsun Wu, Ashutosh Agarwal, Henry Hess, Pramod P Khargonekar, and Yiider Tseng 1

2 SUPPLIMENTAL MATERIAL A The Kalman filter applied to Video-based Particle Tracking The Kalman filter uses a recursive procedure to estimate the true state of a linear process It preserves the intrinsic fluctuations of the measured object while effectively removing the external noise Here we briefly discuss how to use this method to estimate the true trajectory from a measured trajectory obtained from the video-based particle tracking experiment In the Cartesian coordinate system, the x- and y-components of a particle trajectory moving in the x-y plane are theoretically independent from one another; therefore, the use of the Kalman filter on a typical video-based particle tracking experiment can be simplified to a one-dimensional model of particle motion in each direction Individual time steps of the Kalman filter process employ two distinct processing phases: predict and update The elapsed time after onset is represented by k t, where k represents the observation time step Any given variable with a subscript, k l, is at time step, k, and in phase, l When l = k 1 the variable is in its prediction phase, and when l = k the variable is in the update phase Using this format, the position at the current time step, x ˆ k k 1, is first predicted by the sum of the previous position, x ˆ k 1 k 1, and the displacement, u 0, from either the freely diffusive or directed motion of the particle: x ˆ k k 1 = x ˆ k 1 k 1 + u 0 (S1) Once the position, x ˆ k k 1, is predicted, it is updated to a more accurate current position, x ˆ k k, in the update phase This is achieved by adding a correction term that uses an adjustable factor, K k, to weigh the difference between the measured position, z k, and x ˆ k k 1 : x ˆ k k = x ˆ k k 1 + K k (z k ) (S) The factor K k is at its optimal value and referred to as the Kalman gain when the x ˆ k k reaches the minimal error covariance, P kk ( E(( x ˆ k k ) )) At this minimal value, ( ) 1, (S3) K k = P kk 1 P kk 1 + R k ( ) and R k ( E((z k ) )) are the magnitudes of the error covariance for ˆ where P kk 1 E(( x ˆ k k 1 ) ) x k k 1 and z k, respectively (S1) The thermal fluctuation, Q k, propagates during this recursive process; therefore, P k+1 k must also be updated at each time step: P k +1 k = P k k + Q k In addition, P kk is concurrently updated with x kk in subsequent time steps: P k k = P k k 1 K k P k k 1 Substituting Eq S5 into Eq S4, we obtain the discrete algebraic Riccati equation: P k+1 k = P k k 1 K k P k k 1 + Q k (S4) (S5) (S6) SUPPORTING REFERENCE S1 Kalman RE (1960) J Basic Eng 8, 35-45

3 B The value of Q/R determines the best estimation of particle trajectories using the Kalman filter In the one-dimensional particle tracking case, Q k and R k are considered to be independent of k, so that the number of variables is significantly reduced Therefore, P k k 1, P k k and K k can reach their steady state values quickly In a steady state, P k k 1 and P kk are independent of k, and equal to each other, which can be denoted as P Together, Eq S3 can be simplified as K = K k = P (P + R) -1 and be further substituted into the simplified form of Eq S6, which is expressed as KP = Q Therefore, we get P QP QR = 0 (S7) Since P is the error covariance, it possesses possess a positive value Thus, the solution of P in Eq S7 is which leads to P = Q/+ Q + 4QR /, (S8) K = (Q/R) + (Q/R) + 4(Q/R) + (Q/R) + (Q/R) + 4(Q/R) (S9) Thus, K is solely determined by the value of Q/R When the Kalman filter is at its best performance, ie, the correct Q/R value has been applied, the MSD value estimated by filtered position can be expressed as: MS ˆ D = E[( x ˆ k k x ˆ k 1 k 1 ) ] (S10) The expression of x ˆ k k and x ˆ k 1 k 1 in Eq S1 and Eq S, respectively, is subsequently substituted into Eq S10 and we obtain: MS ˆ D = E[(K(z k ) + u 0 ) ] = E[(K((z k ) + (x k )) + u 0 ) ] (S11) From Eq 3 of the main text, we know that z k = v k We further use x kk 1 to represent ( x k x ˆ kk 1 ) and obtain MS ˆ D = E[(K(v k ) + u 0 ) ] = K E[(v k ) ]+ u 0 KE[(v k )] + u 0 (S1) Here, v k and x kk 1 are both random variables with E( v k )= R and E( x kk 1 )= P kk 1 = P Further, v k is not correlated with x kk 1, so E( v k x kk )= 0 Therefore, the MS ˆ D can be further simplified to: MS ˆ D = K ( R + P)+ u 0 = Q + u 0, (S13) where the relation K ( R + P)= Q can be obtained from Eqs S3 and S7 Analytically, the true MSD at the shortest time lag can be calculated based on the true positions state, x k, and Eq 1 in the main text: MSD = E[(x k 1 ) ] = E[(w k + u 0 ) ] = Q + u 0 Therefore, the MSD calculated from a filtered trajectory using the correct values of Q and R in Eq S13 is equal to the true MSD in Eq S14 (S14) 3

4 C Simulations illustrate the Applicability of the Kalman filter to Particle Tracking This result can be demonstrated by the simulation of a one-dimensional particle tracking experiment A model trajectory with an assigned Q (= Q T ) and R (R T = 100 Q T ) was simulated The Kalman algorithm was applied to this model trajectory using 500 random sets of (Q, R), with both variables ranging between 10-4 and 10 4 This yielded 500 RMSE and their corresponding normalized MSD values (or MSD/MSD T values, where the subscript T is denoted the true value of MSD) The simulated trajectory with the assigned Q T but without any positioning error, R, is the true trajectory, and the MSD T is calculated based on this trajectory Two scatter plots were generated by this simulation: RMSE versus normalized Q/R (Fig S1 A), and normalized MSD versus normalized Q/R (Fig S1 B) The fact that these two scatter plots form a continuous curve is in agreement with the analytical derivation that the Kalman filter performance is solely dependent on the assigned Q/R value In addition, the minimal value of RMSE localizes at a normalized Q/R = 1 in the RMSE curve, while the normalized MSD = 1 also occurs at normalized Q/R = 1 in the normalized MSD curve Since the estimated MSD from filtered positions ( x ˆ k k ) is equivalent to the one calculated from true positions ( x k ), these simulation results demonstrate how the Kalman filter algorithm with the appropriate choice of Q and R can effectively restore the true MSD value Figure S1 The best estimation of the trajectory via Kalman filter is determined by the Q/R values (A) The relation between RMSE and normalized Q/R suggest that the best trajectory restoration by Kalman filter is obtained when the Q/R = (Q/R) T This also support that the Kalman filter is an appropriate tool to correct the noisy trajectory (B) The relationship between the normalized MSD and normalized Q/R value suggested that the normalized Q/R value determines the outcome of the MSD of the estimated trajectory When normalized Q/R = 1, the application of the Kalman filter to the trajectory can obtain an estimated trajectory that possesses the same MSD value compared to the true trajectory In (A) an (B), each curve is constructed by 500 Kalman filtering results derived from random sets of Q and R inputs, ranging from 10-4 to 10 4 The reference trajectory for the calculation of RMSE and MSD R is the simulated trajectory without R 4

5 D The estimation of the correct initial steps of the trajectory using the Kalman filter The current position in the Kalman filter process is estimated from the updated position in the preceding time step As earlier positions are updated to be more accurate, the later positions in the trajectory can be better estimated However, the real positions of the first several positions of the trajectory cannot be reasonably estimated since there are no or only a few preceding steps available When the MSD is calculated, these initial positions should be omitted since these initial steps are less accurate than the later ones The reliability of the Kalman filter in correcting the first position was evaluated to further assess this claim The RMSE values of the filtered positions were calculated from 300 independent simulations with an assigned Q/R = 001 (Fig S A) and the results indicate that the first ten positions contain larger errors than later positions These results are also in agreement with the error covariance, P k, which indicates the performance of Kalman algorithms (Fig S B) The error covariance was calculated as described in reference (S1) To identify the minimum number of steps (N) that is required for the Kalman filter to achieve the best performance, we define that N is equal to the minimal k, where (P k-1 /P k ) becomes less than 1005 The N as function of (Q/R) T plot (Fig S C) suggests that when the R-value increases relative to the Q-value, more initial steps should be omitted Figure S Error of filtered step depends on the position of the step in the trajectory (A) RMSE of each step is estimated from 300 independent simulations at Q/R = 001 RMSE values decrease with the proceeding steps to a plateau (B) The performance of Kalman filter accessed by the error covariance (P k ) is in agreement with the RMSE values Error covariance is plotted against the step number as SNR = 01 and it reduces with propagating steps to a plateau value A smaller P k represents a better prediction of position These results suggest the Kalman filter yields the optimum prediction after a certain number of steps from beginning (C) The N-Q T /R T plot shows N decrease with increments of (Q/R) T, where N is the first step from onset that (P k- 1/P k ) becomes less than

ENGR352 Problem Set 02

ENGR352 Problem Set 02 engr352/engr352p02 September 13, 2018) ENGR352 Problem Set 02 Transfer function of an estimator 1. Using Eq. (1.1.4-27) from the text, find the correct value of r ss (the result given in the text is incorrect).

More information

4 Derivations of the Discrete-Time Kalman Filter

4 Derivations of the Discrete-Time Kalman Filter Technion Israel Institute of Technology, Department of Electrical Engineering Estimation and Identification in Dynamical Systems (048825) Lecture Notes, Fall 2009, Prof N Shimkin 4 Derivations of the Discrete-Time

More information

Conditions for successful data assimilation

Conditions for successful data assimilation Conditions for successful data assimilation Matthias Morzfeld *,**, Alexandre J. Chorin *,**, Peter Bickel # * Department of Mathematics University of California, Berkeley ** Lawrence Berkeley National

More information

ROBUST CONSTRAINED ESTIMATION VIA UNSCENTED TRANSFORMATION. Pramod Vachhani a, Shankar Narasimhan b and Raghunathan Rengaswamy a 1

ROBUST CONSTRAINED ESTIMATION VIA UNSCENTED TRANSFORMATION. Pramod Vachhani a, Shankar Narasimhan b and Raghunathan Rengaswamy a 1 ROUST CONSTRINED ESTIMTION VI UNSCENTED TRNSFORMTION Pramod Vachhani a, Shankar Narasimhan b and Raghunathan Rengaswamy a a Department of Chemical Engineering, Clarkson University, Potsdam, NY -3699, US.

More information

Simulation studies of the standard and new algorithms show that a signicant improvement in tracking

Simulation studies of the standard and new algorithms show that a signicant improvement in tracking An Extended Kalman Filter for Demodulation of Polynomial Phase Signals Peter J. Kootsookos y and Joanna M. Spanjaard z Sept. 11, 1997 Abstract This letter presents a new formulation of the extended Kalman

More information

Time Series Analysis

Time Series Analysis Time Series Analysis hm@imm.dtu.dk Informatics and Mathematical Modelling Technical University of Denmark DK-2800 Kgs. Lyngby 1 Outline of the lecture State space models, 1st part: Model: Sec. 10.1 The

More information

Experimental test of an expression for the decay of an autocorrelation function

Experimental test of an expression for the decay of an autocorrelation function Supplemental Material for: Experimental test of an expression for the decay of an autocorrelation function Journal: Physical Review Letters Authors: Zach Haralson and J. Goree I. Experimental setup The

More information

Linear-Quadratic Optimal Control: Full-State Feedback

Linear-Quadratic Optimal Control: Full-State Feedback Chapter 4 Linear-Quadratic Optimal Control: Full-State Feedback 1 Linear quadratic optimization is a basic method for designing controllers for linear (and often nonlinear) dynamical systems and is actually

More information

Kalman Filter. Man-Wai MAK

Kalman Filter. Man-Wai MAK Kalman Filter Man-Wai MAK Dept. of Electronic and Information Engineering, The Hong Kong Polytechnic University enmwmak@polyu.edu.hk http://www.eie.polyu.edu.hk/ mwmak References: S. Gannot and A. Yeredor,

More information

State Estimation of Linear and Nonlinear Dynamic Systems

State Estimation of Linear and Nonlinear Dynamic Systems State Estimation of Linear and Nonlinear Dynamic Systems Part I: Linear Systems with Gaussian Noise James B. Rawlings and Fernando V. Lima Department of Chemical and Biological Engineering University of

More information

Kalman Filter. Predict: Update: x k k 1 = F k x k 1 k 1 + B k u k P k k 1 = F k P k 1 k 1 F T k + Q

Kalman Filter. Predict: Update: x k k 1 = F k x k 1 k 1 + B k u k P k k 1 = F k P k 1 k 1 F T k + Q Kalman Filter Kalman Filter Predict: x k k 1 = F k x k 1 k 1 + B k u k P k k 1 = F k P k 1 k 1 F T k + Q Update: K = P k k 1 Hk T (H k P k k 1 Hk T + R) 1 x k k = x k k 1 + K(z k H k x k k 1 ) P k k =(I

More information

Kalman Filter Computer Vision (Kris Kitani) Carnegie Mellon University

Kalman Filter Computer Vision (Kris Kitani) Carnegie Mellon University Kalman Filter 16-385 Computer Vision (Kris Kitani) Carnegie Mellon University Examples up to now have been discrete (binary) random variables Kalman filtering can be seen as a special case of a temporal

More information

Optimal control and estimation

Optimal control and estimation Automatic Control 2 Optimal control and estimation Prof. Alberto Bemporad University of Trento Academic year 2010-2011 Prof. Alberto Bemporad (University of Trento) Automatic Control 2 Academic year 2010-2011

More information

TSRT14: Sensor Fusion Lecture 8

TSRT14: Sensor Fusion Lecture 8 TSRT14: Sensor Fusion Lecture 8 Particle filter theory Marginalized particle filter Gustaf Hendeby gustaf.hendeby@liu.se TSRT14 Lecture 8 Gustaf Hendeby Spring 2018 1 / 25 Le 8: particle filter theory,

More information

Performance Analysis of Distributed Tracking with Consensus on Noisy Time-varying Graphs

Performance Analysis of Distributed Tracking with Consensus on Noisy Time-varying Graphs Performance Analysis of Distributed Tracking with Consensus on Noisy Time-varying Graphs Yongxiang Ruan, Sudharman K. Jayaweera and Carlos Mosquera Abstract This paper considers a problem of distributed

More information

ECONOMETRIC METHODS II: TIME SERIES LECTURE NOTES ON THE KALMAN FILTER. The Kalman Filter. We will be concerned with state space systems of the form

ECONOMETRIC METHODS II: TIME SERIES LECTURE NOTES ON THE KALMAN FILTER. The Kalman Filter. We will be concerned with state space systems of the form ECONOMETRIC METHODS II: TIME SERIES LECTURE NOTES ON THE KALMAN FILTER KRISTOFFER P. NIMARK The Kalman Filter We will be concerned with state space systems of the form X t = A t X t 1 + C t u t 0.1 Z t

More information

Local Positioning with Parallelepiped Moving Grid

Local Positioning with Parallelepiped Moving Grid Local Positioning with Parallelepiped Moving Grid, WPNC06 16.3.2006, niilo.sirola@tut.fi p. 1/?? TA M P E R E U N I V E R S I T Y O F T E C H N O L O G Y M a t h e m a t i c s Local Positioning with Parallelepiped

More information

Worksheet 1.1: Introduction to Vectors

Worksheet 1.1: Introduction to Vectors Boise State Math 275 (Ultman) Worksheet 1.1: Introduction to Vectors From the Toolbox (what you need from previous classes) Know how the Cartesian coordinates a point in the plane (R 2 ) determine its

More information

The Kalman Filter ImPr Talk

The Kalman Filter ImPr Talk The Kalman Filter ImPr Talk Ged Ridgway Centre for Medical Image Computing November, 2006 Outline What is the Kalman Filter? State Space Models Kalman Filter Overview Bayesian Updating of Estimates Kalman

More information

2D Image Processing. Bayes filter implementation: Kalman filter

2D Image Processing. Bayes filter implementation: Kalman filter 2D Image Processing Bayes filter implementation: Kalman filter Prof. Didier Stricker Kaiserlautern University http://ags.cs.uni-kl.de/ DFKI Deutsches Forschungszentrum für Künstliche Intelligenz http://av.dfki.de

More information

Basic Concepts in Data Reconciliation. Chapter 6: Steady-State Data Reconciliation with Model Uncertainties

Basic Concepts in Data Reconciliation. Chapter 6: Steady-State Data Reconciliation with Model Uncertainties Chapter 6: Steady-State Data with Model Uncertainties CHAPTER 6 Steady-State Data with Model Uncertainties 6.1 Models with Uncertainties In the previous chapters, the models employed in the DR were considered

More information

Kalman Filtering. Namrata Vaswani. March 29, Kalman Filter as a causal MMSE estimator

Kalman Filtering. Namrata Vaswani. March 29, Kalman Filter as a causal MMSE estimator Kalman Filtering Namrata Vaswani March 29, 2018 Notes are based on Vincent Poor s book. 1 Kalman Filter as a causal MMSE estimator Consider the following state space model (signal and observation model).

More information

Here represents the impulse (or delta) function. is an diagonal matrix of intensities, and is an diagonal matrix of intensities.

Here represents the impulse (or delta) function. is an diagonal matrix of intensities, and is an diagonal matrix of intensities. 19 KALMAN FILTER 19.1 Introduction In the previous section, we derived the linear quadratic regulator as an optimal solution for the fullstate feedback control problem. The inherent assumption was that

More information

Nonlinear Estimation Techniques for Impact Point Prediction of Ballistic Targets

Nonlinear Estimation Techniques for Impact Point Prediction of Ballistic Targets Nonlinear Estimation Techniques for Impact Point Prediction of Ballistic Targets J. Clayton Kerce a, George C. Brown a, and David F. Hardiman b a Georgia Tech Research Institute, Georgia Institute of Technology,

More information

The Kalman filter. Chapter 6

The Kalman filter. Chapter 6 Chapter 6 The Kalman filter In the last chapter, we saw that in Data Assimilation, we ultimately desire knowledge of the full a posteriori p.d.f., that is the conditional p.d.f. of the state given the

More information

Every real system has uncertainties, which include system parametric uncertainties, unmodeled dynamics

Every real system has uncertainties, which include system parametric uncertainties, unmodeled dynamics Sensitivity Analysis of Disturbance Accommodating Control with Kalman Filter Estimation Jemin George and John L. Crassidis University at Buffalo, State University of New York, Amherst, NY, 14-44 The design

More information

Deriva'on of The Kalman Filter. Fred DePiero CalPoly State University EE 525 Stochas'c Processes

Deriva'on of The Kalman Filter. Fred DePiero CalPoly State University EE 525 Stochas'c Processes Deriva'on of The Kalman Filter Fred DePiero CalPoly State University EE 525 Stochas'c Processes KF Uses State Predic'ons KF es'mates the state of a system Example Measure: posi'on State: [ posi'on velocity

More information

OPTIMAL CONTROL AND ESTIMATION

OPTIMAL CONTROL AND ESTIMATION OPTIMAL CONTROL AND ESTIMATION Robert F. Stengel Department of Mechanical and Aerospace Engineering Princeton University, Princeton, New Jersey DOVER PUBLICATIONS, INC. New York CONTENTS 1. INTRODUCTION

More information

State Observers and the Kalman filter

State Observers and the Kalman filter Modelling and Control of Dynamic Systems State Observers and the Kalman filter Prof. Oreste S. Bursi University of Trento Page 1 Feedback System State variable feedback system: Control feedback law:u =

More information

Tactical Ballistic Missile Tracking using the Interacting Multiple Model Algorithm

Tactical Ballistic Missile Tracking using the Interacting Multiple Model Algorithm Tactical Ballistic Missile Tracking using the Interacting Multiple Model Algorithm Robert L Cooperman Raytheon Co C 3 S Division St Petersburg, FL Robert_L_Cooperman@raytheoncom Abstract The problem of

More information

Steady State Kalman Filter for Periodic Models: A New Approach. 1 Steady state Kalman filter for periodic models

Steady State Kalman Filter for Periodic Models: A New Approach. 1 Steady state Kalman filter for periodic models Int. J. Contemp. Math. Sciences, Vol. 4, 2009, no. 5, 201-218 Steady State Kalman Filter for Periodic Models: A New Approach N. Assimakis 1 and M. Adam Department of Informatics with Applications to Biomedicine

More information

The Kalman Filter. Data Assimilation & Inverse Problems from Weather Forecasting to Neuroscience. Sarah Dance

The Kalman Filter. Data Assimilation & Inverse Problems from Weather Forecasting to Neuroscience. Sarah Dance The Kalman Filter Data Assimilation & Inverse Problems from Weather Forecasting to Neuroscience Sarah Dance School of Mathematical and Physical Sciences, University of Reading s.l.dance@reading.ac.uk July

More information

Diffusion/Inference geometries of data features, situational awareness and visualization. Ronald R Coifman Mathematics Yale University

Diffusion/Inference geometries of data features, situational awareness and visualization. Ronald R Coifman Mathematics Yale University Diffusion/Inference geometries of data features, situational awareness and visualization Ronald R Coifman Mathematics Yale University Digital data is generally converted to point clouds in high dimensional

More information

A New Approach to Tune the Vold-Kalman Estimator for Order Tracking

A New Approach to Tune the Vold-Kalman Estimator for Order Tracking A New Approach to Tune the Vold-Kalman Estimator for Order Tracking Amadou Assoumane, Julien Roussel, Edgard Sekko and Cécile Capdessus Abstract In the purpose to diagnose rotating machines using vibration

More information

SYSTEMTEORI - KALMAN FILTER VS LQ CONTROL

SYSTEMTEORI - KALMAN FILTER VS LQ CONTROL SYSTEMTEORI - KALMAN FILTER VS LQ CONTROL 1. Optimal regulator with noisy measurement Consider the following system: ẋ = Ax + Bu + w, x(0) = x 0 where w(t) is white noise with Ew(t) = 0, and x 0 is a stochastic

More information

1 Kalman Filter Introduction

1 Kalman Filter Introduction 1 Kalman Filter Introduction You should first read Chapter 1 of Stochastic models, estimation, and control: Volume 1 by Peter S. Maybec (available here). 1.1 Explanation of Equations (1-3) and (1-4) Equation

More information

TMA4285 Time Series Models Exam December

TMA4285 Time Series Models Exam December Norges teknisk-naturvitenskapelige universitet Institutt for matematiske fag TMA485 Time Series Models Solution Oppgave a) A process {z t } is invertible if it can be represented as an A( ) process, z

More information

Least Squares and Kalman Filtering Questions: me,

Least Squares and Kalman Filtering Questions:  me, Least Squares and Kalman Filtering Questions: Email me, namrata@ece.gatech.edu Least Squares and Kalman Filtering 1 Recall: Weighted Least Squares y = Hx + e Minimize Solution: J(x) = (y Hx) T W (y Hx)

More information

JOINT DETECTION-STATE ESTIMATION AND SECURE SIGNAL PROCESSING

JOINT DETECTION-STATE ESTIMATION AND SECURE SIGNAL PROCESSING Virginia Commonwealth University VCU Scholars Compass Theses and Dissertations Graduate School 2016 JOINT DETECTION-STATE ESTIMATION AND SECURE SIGNAL PROCESSING Mengqi Ren Virginia Commonwealth University

More information

DWI acquisition schemes and Diffusion Tensor estimation

DWI acquisition schemes and Diffusion Tensor estimation DWI acquisition schemes and Diffusion Tensor estimation A simulation based study Santiago Aja-Fernández, Antonio Tristán-Vega, Pablo Casaseca-de-la-Higuera Laboratory of Image Processing L A B O R A T

More information

STATISTICAL ORBIT DETERMINATION

STATISTICAL ORBIT DETERMINATION STATISTICAL ORBIT DETERMINATION Satellite Tracking Example of SNC and DMC ASEN 5070 LECTURE 6 4.08.011 1 We will develop a simple state noise compensation (SNC) algorithm. This algorithm adds process noise

More information

An Observer for Phased Microphone Array Signal Processing with Nonlinear Output

An Observer for Phased Microphone Array Signal Processing with Nonlinear Output 2010 Asia-Pacific International Symposium on Aerospace Technology An Observer for Phased Microphone Array Signal Processing with Nonlinear Output Bai Long 1,*, Huang Xun 2 1 Department of Mechanics and

More information

A Study of Covariances within Basic and Extended Kalman Filters

A Study of Covariances within Basic and Extended Kalman Filters A Study of Covariances within Basic and Extended Kalman Filters David Wheeler Kyle Ingersoll December 2, 2013 Abstract This paper explores the role of covariance in the context of Kalman filters. The underlying

More information

Kalman-Filter-Based Time-Varying Parameter Estimation via Retrospective Optimization of the Process Noise Covariance

Kalman-Filter-Based Time-Varying Parameter Estimation via Retrospective Optimization of the Process Noise Covariance 2016 American Control Conference (ACC) Boston Marriott Copley Place July 6-8, 2016. Boston, MA, USA Kalman-Filter-Based Time-Varying Parameter Estimation via Retrospective Optimization of the Process Noise

More information

X t = a t + r t, (7.1)

X t = a t + r t, (7.1) Chapter 7 State Space Models 71 Introduction State Space models, developed over the past 10 20 years, are alternative models for time series They include both the ARIMA models of Chapters 3 6 and the Classical

More information

Design of Nearly Constant Velocity Track Filters for Brief Maneuvers

Design of Nearly Constant Velocity Track Filters for Brief Maneuvers 4th International Conference on Information Fusion Chicago, Illinois, USA, July 5-8, 20 Design of Nearly Constant Velocity rack Filters for Brief Maneuvers W. Dale Blair Georgia ech Research Institute

More information

2D Image Processing. Bayes filter implementation: Kalman filter

2D Image Processing. Bayes filter implementation: Kalman filter 2D Image Processing Bayes filter implementation: Kalman filter Prof. Didier Stricker Dr. Gabriele Bleser Kaiserlautern University http://ags.cs.uni-kl.de/ DFKI Deutsches Forschungszentrum für Künstliche

More information

Ch6-Normalized Least Mean-Square Adaptive Filtering

Ch6-Normalized Least Mean-Square Adaptive Filtering Ch6-Normalized Least Mean-Square Adaptive Filtering LMS Filtering The update equation for the LMS algorithm is wˆ wˆ u ( n 1) ( n) ( n) e ( n) Step size Filter input which is derived from SD as an approximation

More information

Advanced ESM Angle Tracker: Volume I Theoretical Foundations

Advanced ESM Angle Tracker: Volume I Theoretical Foundations Naval Research Laboratory Washington, DC 075-50 NRL/FR/574--06-0,4 Advanced ESM Angle Tracker: Volume I Theoretical Foundations Edward N. Khoury Surface Electronic Warfare Systems Branch Tactical Electronic

More information

Supporting Information. Even Hard Sphere Colloidal Suspensions Display. Fickian yet Non-Gaussian Diffusion

Supporting Information. Even Hard Sphere Colloidal Suspensions Display. Fickian yet Non-Gaussian Diffusion Supporting Information Even Hard Sphere Colloidal Suspensions Display Fickian yet Non-Gaussian Diffusion Juan Guan, a Bo Wang, a and Steve Granick a,b,c,* Departments of Materials Science, a Chemistry,

More information

Sequential State Estimation (Crassidas and Junkins, Chapter 5)

Sequential State Estimation (Crassidas and Junkins, Chapter 5) Sequential State Estimation (Crassidas and Junkins, Chapter 5) Please read: 5.1, 5.3-5.6 5.3 The Discrete-Time Kalman Filter The discrete-time Kalman filter is used when the dynamics and measurements are

More information

y k = ( ) x k + v k. w q wk i 0 0 wk

y k = ( ) x k + v k. w q wk i 0 0 wk Four telling examples of Kalman Filters Example : Signal plus noise Measurement of a bandpass signal, center frequency.2 rad/sec buried in highpass noise. Dig out the quadrature part of the signal while

More information

OPTIMAL FUSION OF SENSOR DATA FOR DISCRETE KALMAN FILTERING Z. G. FENG, K. L. TEO, N. U. AHMED, Y. ZHAO, AND W. Y. YAN

OPTIMAL FUSION OF SENSOR DATA FOR DISCRETE KALMAN FILTERING Z. G. FENG, K. L. TEO, N. U. AHMED, Y. ZHAO, AND W. Y. YAN Dynamic Systems and Applications 16 (2007) 393-406 OPTIMAL FUSION OF SENSOR DATA FOR DISCRETE KALMAN FILTERING Z. G. FENG, K. L. TEO, N. U. AHMED, Y. ZHAO, AND W. Y. YAN College of Mathematics and Computer

More information

Parameter Estimation in a Moving Horizon Perspective

Parameter Estimation in a Moving Horizon Perspective Parameter Estimation in a Moving Horizon Perspective State and Parameter Estimation in Dynamical Systems Reglerteknik, ISY, Linköpings Universitet State and Parameter Estimation in Dynamical Systems OUTLINE

More information

unit; 1m The ONJUKU COAST Total number of nodes; 600 Total nimber of elements; 1097 Onjuku Port 5 Iwawada Port No.5 No.2 No.3 No.4 No.

unit; 1m The ONJUKU COAST Total number of nodes; 600 Total nimber of elements; 1097 Onjuku Port 5 Iwawada Port No.5 No.2 No.3 No.4 No. Estimation of Tidal Currents by Kalman Filter with FEM Using Parallel Computing Naeko TAKAHASHI Abstract The purpose of this research is to estimate of tidal currents using Kalman Filter combined with

More information

RECURSIVE ESTIMATION AND KALMAN FILTERING

RECURSIVE ESTIMATION AND KALMAN FILTERING Chapter 3 RECURSIVE ESTIMATION AND KALMAN FILTERING 3. The Discrete Time Kalman Filter Consider the following estimation problem. Given the stochastic system with x k+ = Ax k + Gw k (3.) y k = Cx k + Hv

More information

Optimization-Based Control

Optimization-Based Control Optimization-Based Control Richard M. Murray Control and Dynamical Systems California Institute of Technology DRAFT v1.7a, 19 February 2008 c California Institute of Technology All rights reserved. This

More information

Lecture 10 Linear Quadratic Stochastic Control with Partial State Observation

Lecture 10 Linear Quadratic Stochastic Control with Partial State Observation EE363 Winter 2008-09 Lecture 10 Linear Quadratic Stochastic Control with Partial State Observation partially observed linear-quadratic stochastic control problem estimation-control separation principle

More information

For final project discussion every afternoon Mark and I will be available

For final project discussion every afternoon Mark and I will be available Worshop report 1. Daniels report is on website 2. Don t expect to write it based on listening to one project (we had 6 only 2 was sufficient quality) 3. I suggest writing it on one presentation. 4. Include

More information

Analysis of incremental RLS adaptive networks with noisy links

Analysis of incremental RLS adaptive networks with noisy links Analysis of incremental RLS adaptive networs with noisy lins Azam Khalili, Mohammad Ali Tinati, and Amir Rastegarnia a) Faculty of Electrical and Computer Engineering, University of Tabriz Tabriz 51664,

More information

Least Squares Estimation Namrata Vaswani,

Least Squares Estimation Namrata Vaswani, Least Squares Estimation Namrata Vaswani, namrata@iastate.edu Least Squares Estimation 1 Recall: Geometric Intuition for Least Squares Minimize J(x) = y Hx 2 Solution satisfies: H T H ˆx = H T y, i.e.

More information

Linear Dynamical Systems

Linear Dynamical Systems Linear Dynamical Systems Sargur N. srihari@cedar.buffalo.edu Machine Learning Course: http://www.cedar.buffalo.edu/~srihari/cse574/index.html Two Models Described by Same Graph Latent variables Observations

More information

A fast introduction to the tracking and to the Kalman filter. Alberto Rotondi Pavia

A fast introduction to the tracking and to the Kalman filter. Alberto Rotondi Pavia A fast introduction to the tracking and to the Kalman filter Alberto Rotondi Pavia The tracking To reconstruct the particle path to find the origin (vertex) and the momentum The trajectory is usually curved

More information

Optimal Distributed Lainiotis Filter

Optimal Distributed Lainiotis Filter Int. Journal of Math. Analysis, Vol. 3, 2009, no. 22, 1061-1080 Optimal Distributed Lainiotis Filter Nicholas Assimakis Department of Electronics Technological Educational Institute (T.E.I.) of Lamia 35100

More information

EE 565: Position, Navigation, and Timing

EE 565: Position, Navigation, and Timing EE 565: Position, Navigation, and Timing Kalman Filtering Example Aly El-Osery Kevin Wedeward Electrical Engineering Department, New Mexico Tech Socorro, New Mexico, USA In Collaboration with Stephen Bruder

More information

Markov localization uses an explicit, discrete representation for the probability of all position in the state space.

Markov localization uses an explicit, discrete representation for the probability of all position in the state space. Markov Kalman Filter Localization Markov localization localization starting from any unknown position recovers from ambiguous situation. However, to update the probability of all positions within the whole

More information

Unbiased minimum variance estimation for systems with unknown exogenous inputs

Unbiased minimum variance estimation for systems with unknown exogenous inputs Unbiased minimum variance estimation for systems with unknown exogenous inputs Mohamed Darouach, Michel Zasadzinski To cite this version: Mohamed Darouach, Michel Zasadzinski. Unbiased minimum variance

More information

PERIODIC KALMAN FILTER: STEADY STATE FROM THE BEGINNING

PERIODIC KALMAN FILTER: STEADY STATE FROM THE BEGINNING Journal of Mathematical Sciences: Advances and Applications Volume 1, Number 3, 2008, Pages 505-520 PERIODIC KALMAN FILER: SEADY SAE FROM HE BEGINNING MARIA ADAM 1 and NICHOLAS ASSIMAKIS 2 1 Department

More information

ECE 102 Engineering Computation

ECE 102 Engineering Computation ECE 102 Engineering Computation Phillip Wong Error Analysis Accuracy vs. Precision Significant Figures Systematic and Random Errors Basic Error Analysis Physical measurements are never exact. Uncertainty

More information

M. LeBreux, M. Désilets & M. Lacroix Faculté de génie, Université de Sherbrooke, Canada. Abstract. 1 Introduction

M. LeBreux, M. Désilets & M. Lacroix Faculté de génie, Université de Sherbrooke, Canada. Abstract. 1 Introduction Advanced Computational Methods and Experiments in Heat Transfer XIII 517 Is the performance of a virtual sensor employed for the prediction of the ledge thickness inside a metallurgical reactor affected

More information

New Statistical Model for the Enhancement of Noisy Speech

New Statistical Model for the Enhancement of Noisy Speech New Statistical Model for the Enhancement of Noisy Speech Electrical Engineering Department Technion - Israel Institute of Technology February 22, 27 Outline Problem Formulation and Motivation 1 Problem

More information

Lecture 7: Optimal Smoothing

Lecture 7: Optimal Smoothing Department of Biomedical Engineering and Computational Science Aalto University March 17, 2011 Contents 1 What is Optimal Smoothing? 2 Bayesian Optimal Smoothing Equations 3 Rauch-Tung-Striebel Smoother

More information

Summary of lecture 8. FIR Wiener filter: computed by solving a finite number of Wiener-Hopf equations, h(i)r yy (k i) = R sy (k); k = 0; : : : ; m

Summary of lecture 8. FIR Wiener filter: computed by solving a finite number of Wiener-Hopf equations, h(i)r yy (k i) = R sy (k); k = 0; : : : ; m Summar of lecture 8 FIR Wiener filter: computed b solving a finite number of Wiener-Hopf equations, mx i= h(i)r (k i) = R s (k); k = ; : : : ; m Whitening filter: A filter that removes the correlation

More information

Kalman Filter and Parameter Identification. Florian Herzog

Kalman Filter and Parameter Identification. Florian Herzog Kalman Filter and Parameter Identification Florian Herzog 2013 Continuous-time Kalman Filter In this chapter, we shall use stochastic processes with independent increments w 1 (.) and w 2 (.) at the input

More information

2D Image Processing (Extended) Kalman and particle filter

2D Image Processing (Extended) Kalman and particle filter 2D Image Processing (Extended) Kalman and particle filter Prof. Didier Stricker Dr. Gabriele Bleser Kaiserlautern University http://ags.cs.uni-kl.de/ DFKI Deutsches Forschungszentrum für Künstliche Intelligenz

More information

Research Article Global Systems for Mobile Position Tracking Using Kalman and Lainiotis Filters

Research Article Global Systems for Mobile Position Tracking Using Kalman and Lainiotis Filters e Scientific World Journal, Article ID 352, 8 pages http://dx.doi.org/.55/24/352 Research Article Global Systems for Mobile Position Tracking Using Kalman and Lainiotis Filters Nicholas Assimakis and Maria

More information

SIMULTANEOUS STATE AND PARAMETER ESTIMATION USING KALMAN FILTERS

SIMULTANEOUS STATE AND PARAMETER ESTIMATION USING KALMAN FILTERS ECE5550: Applied Kalman Filtering 9 1 SIMULTANEOUS STATE AND PARAMETER ESTIMATION USING KALMAN FILTERS 9.1: Parameters versus states Until now, we have assumed that the state-space model of the system

More information

Recursive Least Squares Filtering Fundamentals of Kalman Filtering: A Practical Approach

Recursive Least Squares Filtering Fundamentals of Kalman Filtering: A Practical Approach Recursive Least Squares Filtering 3-1 Recursive Least Squares Filtering Overview Making zeroth-order least squares filter recursive Deriving properties of recursive zeroth-order filter First and second-order

More information

Design of Adaptive Filtering Algorithm for Relative Navigation

Design of Adaptive Filtering Algorithm for Relative Navigation Design of Adaptive Filtering Algorithm for Relative Navigation Je Young Lee, Hee Sung Kim, Kwang Ho Choi, Joonhoo Lim, Sung Jin Kang, Sebum Chun, and Hyung Keun Lee Abstract Recently, relative navigation

More information

CALIFORNIA INSTITUTE OF TECHNOLOGY Control and Dynamical Systems. CDS 110b

CALIFORNIA INSTITUTE OF TECHNOLOGY Control and Dynamical Systems. CDS 110b CALIFORNIA INSTITUTE OF TECHNOLOGY Control and Dynamical Systems CDS 110b R. M. Murray Kalman Filters 14 January 2007 Reading: This set of lectures provides a brief introduction to Kalman filtering, following

More information

Shallow Water Fluctuations and Communications

Shallow Water Fluctuations and Communications Shallow Water Fluctuations and Communications H.C. Song Marine Physical Laboratory Scripps Institution of oceanography La Jolla, CA 92093-0238 phone: (858) 534-0954 fax: (858) 534-7641 email: hcsong@mpl.ucsd.edu

More information

Design of Norm-Optimal Iterative Learning Controllers: The Effect of an Iteration-Domain Kalman Filter for Disturbance Estimation

Design of Norm-Optimal Iterative Learning Controllers: The Effect of an Iteration-Domain Kalman Filter for Disturbance Estimation Design of Norm-Optimal Iterative Learning Controllers: The Effect of an Iteration-Domain Kalman Filter for Disturbance Estimation Nicolas Degen, Autonomous System Lab, ETH Zürich Angela P. Schoellig, University

More information

5.1 2D example 59 Figure 5.1: Parabolic velocity field in a straight two-dimensional pipe. Figure 5.2: Concentration on the input boundary of the pipe. The vertical axis corresponds to r 2 -coordinate,

More information

Speaker Tracking and Beamforming

Speaker Tracking and Beamforming Speaker Tracking and Beamforming Dr. John McDonough Spoken Language Systems Saarland University January 13, 2010 Introduction Many problems in science and engineering can be formulated in terms of estimating

More information

Cramer-Rao Bound Fundamentals of Kalman Filtering: A Practical Approach

Cramer-Rao Bound Fundamentals of Kalman Filtering: A Practical Approach Cramer-Rao Bound 24-1 What is the Cramer-Rao Lower Bound (CRLB) and What Does it Mean? According to Bar Shalom* - The mean square error corresponding to the estimator of a parameter cannot be smaller than

More information

Nonlinear State Estimation! Particle, Sigma-Points Filters!

Nonlinear State Estimation! Particle, Sigma-Points Filters! Nonlinear State Estimation! Particle, Sigma-Points Filters! Robert Stengel! Optimal Control and Estimation, MAE 546! Princeton University, 2017!! Particle filter!! Sigma-Points Unscented Kalman ) filter!!

More information

Application of the Tuned Kalman Filter in Speech Enhancement

Application of the Tuned Kalman Filter in Speech Enhancement Application of the Tuned Kalman Filter in Speech Enhancement Orchisama Das, Bhaswati Goswami and Ratna Ghosh Department of Instrumentation and Electronics Engineering Jadavpur University Kolkata, India

More information

SF2943: Time Series Analysis Kalman Filtering

SF2943: Time Series Analysis Kalman Filtering SF2943: Time Series Analysis Kalman Filtering Timo Koski 09.05.2013 Timo Koski () Mathematisk statistik 09.05.2013 1 / 70 Contents The Prediction Problem State process AR(1), Observation Equation, PMKF(=

More information

Greg Welch and Gary Bishop. University of North Carolina at Chapel Hill Department of Computer Science.

Greg Welch and Gary Bishop. University of North Carolina at Chapel Hill Department of Computer Science. STC Lecture Series An Introduction to the Kalman Filter Greg Welch and Gary Bishop University of North Carolina at Chapel Hill Department of Computer Science http://www.cs.unc.edu/~welch/kalmanlinks.html

More information

Signal Processing - Lecture 7

Signal Processing - Lecture 7 1 Introduction Signal Processing - Lecture 7 Fitting a function to a set of data gathered in time sequence can be viewed as signal processing or learning, and is an important topic in information theory.

More information

q lm1 q lm2 q lm3 (1) m 1,m 2,m 3,m 1 +m 2 +m 3 =0 m 1 m 2 m 3 l l l

q lm1 q lm2 q lm3 (1) m 1,m 2,m 3,m 1 +m 2 +m 3 =0 m 1 m 2 m 3 l l l SUPPLEMENTARY INFORMATION Bond-orientational order parameters. We use a particle-level bond-orientational order parameter defined as follows. where the coefficients W l l l l q lm1 q lm2 q lm3 (1) m 1,m

More information

Crib Sheet : Linear Kalman Smoothing

Crib Sheet : Linear Kalman Smoothing Crib Sheet : Linear Kalman Smoothing Gabriel A. Terejanu Department of Computer Science and Engineering University at Buffalo, Buffalo, NY 14260 terejanu@buffalo.edu 1 Introduction Smoothing can be separated

More information

Mini-Course 07 Kalman Particle Filters. Henrique Massard da Fonseca Cesar Cunha Pacheco Wellington Bettencurte Julio Dutra

Mini-Course 07 Kalman Particle Filters. Henrique Massard da Fonseca Cesar Cunha Pacheco Wellington Bettencurte Julio Dutra Mini-Course 07 Kalman Particle Filters Henrique Massard da Fonseca Cesar Cunha Pacheco Wellington Bettencurte Julio Dutra Agenda State Estimation Problems & Kalman Filter Henrique Massard Steady State

More information

Cepstral Deconvolution Method for Measurement of Absorption and Scattering Coefficients of Materials

Cepstral Deconvolution Method for Measurement of Absorption and Scattering Coefficients of Materials Cepstral Deconvolution Method for Measurement of Absorption and Scattering Coefficients of Materials Mehmet ÇALIŞKAN a) Middle East Technical University, Department of Mechanical Engineering, Ankara, 06800,

More information

VARIANCE COMPUTATION OF MODAL PARAMETER ES- TIMATES FROM UPC SUBSPACE IDENTIFICATION

VARIANCE COMPUTATION OF MODAL PARAMETER ES- TIMATES FROM UPC SUBSPACE IDENTIFICATION VARIANCE COMPUTATION OF MODAL PARAMETER ES- TIMATES FROM UPC SUBSPACE IDENTIFICATION Michael Döhler 1, Palle Andersen 2, Laurent Mevel 1 1 Inria/IFSTTAR, I4S, Rennes, France, {michaeldoehler, laurentmevel}@inriafr

More information

Entropic Crystal-Crystal Transitions of Brownian Squares K. Zhao, R. Bruinsma, and T.G. Mason

Entropic Crystal-Crystal Transitions of Brownian Squares K. Zhao, R. Bruinsma, and T.G. Mason Entropic Crystal-Crystal Transitions of Brownian Squares K. Zhao, R. Bruinsma, and T.G. Mason This supplementary material contains the following sections: image processing methods, measurements of Brownian

More information

Robotics 2 Target Tracking. Kai Arras, Cyrill Stachniss, Maren Bennewitz, Wolfram Burgard

Robotics 2 Target Tracking. Kai Arras, Cyrill Stachniss, Maren Bennewitz, Wolfram Burgard Robotics 2 Target Tracking Kai Arras, Cyrill Stachniss, Maren Bennewitz, Wolfram Burgard Slides by Kai Arras, Gian Diego Tipaldi, v.1.1, Jan 2012 Chapter Contents Target Tracking Overview Applications

More information

Stochastic and Adaptive Optimal Control

Stochastic and Adaptive Optimal Control Stochastic and Adaptive Optimal Control Robert Stengel Optimal Control and Estimation, MAE 546 Princeton University, 2018! Nonlinear systems with random inputs and perfect measurements! Stochastic neighboring-optimal

More information

VISION TRACKING PREDICTION

VISION TRACKING PREDICTION VISION RACKING PREDICION Eri Cuevas,2, Daniel Zaldivar,2, and Raul Rojas Institut für Informati, Freie Universität Berlin, ausstr 9, D-495 Berlin, German el 0049-30-83852485 2 División de Electrónica Computación,

More information

Nonlinear State Estimation! Extended Kalman Filters!

Nonlinear State Estimation! Extended Kalman Filters! Nonlinear State Estimation! Extended Kalman Filters! Robert Stengel! Optimal Control and Estimation, MAE 546! Princeton University, 2017!! Deformation of the probability distribution!! Neighboring-optimal

More information