An recursive analytical technique to estimate time dependent physical parameters in the presence of noise processes

Similar documents
State-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter

L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS. NA568 Mobile Robotics: Methods & Algorithms

Notes on Kalman Filtering

Augmented Reality II - Kalman Filters - Gudrun Klinker May 25, 2004

Georey E. Hinton. University oftoronto. Technical Report CRG-TR February 22, Abstract

Linear Gaussian State Space Models

2.160 System Identification, Estimation, and Learning. Lecture Notes No. 8. March 6, 2006

References are appeared in the last slide. Last update: (1393/08/19)

Modeling Economic Time Series with Stochastic Linear Difference Equations

Zürich. ETH Master Course: L Autonomous Mobile Robots Localization II

Probabilistic Robotics

Two Popular Bayesian Estimators: Particle and Kalman Filters. McGill COMP 765 Sept 14 th, 2017

STATE-SPACE MODELLING. A mass balance across the tank gives:

CHAPTER 10 VALIDATION OF TEST WITH ARTIFICAL NEURAL NETWORK

The complexity of climate model drifts

Introduction to Mobile Robotics

Diebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles

hen found from Bayes rule. Specically, he prior disribuion is given by p( ) = N( ; ^ ; r ) (.3) where r is he prior variance (we add on he random drif

Ensamble methods: Bagging and Boosting

Y, where. 1 Estimate St.error

SEIF, EnKF, EKF SLAM. Pieter Abbeel UC Berkeley EECS

Tracking. Announcements

Modal identification of structures from roving input data by means of maximum likelihood estimation of the state space model

Robot Motion Model EKF based Localization EKF SLAM Graph SLAM

Estimation of Poses with Particle Filters

USNO MASTER CLOCK DESIGN ENHANCEMENTS

Linear-Optimal Estimation for Continuous-Time Systems Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 2018

Article from. Predictive Analytics and Futurism. July 2016 Issue 13

Recursive Least-Squares Fixed-Interval Smoother Using Covariance Information based on Innovation Approach in Linear Continuous Stochastic Systems

20. Applications of the Genetic-Drift Model

Probabilistic Robotics SLAM

Probabilistic Robotics SLAM

מקורות לחומר בשיעור ספר הלימוד: Forsyth & Ponce מאמרים שונים חומר באינטרנט! פרק פרק 18

Navneet Saini, Mayank Goyal, Vishal Bansal (2013); Term Project AML310; Indian Institute of Technology Delhi

Financial Econometrics Kalman Filter: some applications to Finance University of Evry - Master 2

Ensamble methods: Boosting

Stochastic Signals and Systems

An introduction to the theory of SDDP algorithm

The electromagnetic interference in case of onboard navy ships computers - a new approach

Independent component analysis for nonminimum phase systems using H filters

Stable block Toeplitz matrix for the processing of multichannel seismic data

UNIVERSITÀ DI PISA DIPARTIMENTO DI INGEGNERIA MECCANICA, NUCLEARE E DELLA PRODUZIONE VIA DIOTISALVI 2, PISA

Lecture 10 - Model Identification

Dimitri Solomatine. D.P. Solomatine. Data-driven modelling (part 2). 2

OBJECTIVES OF TIME SERIES ANALYSIS

2016 Possible Examination Questions. Robotics CSCE 574

Kriging Models Predicting Atrazine Concentrations in Surface Water Draining Agricultural Watersheds

Claudia Rangel! National institute of genomic medicine!

CE 395 Special Topics in Machine Learning

Speaker Adaptation Techniques For Continuous Speech Using Medium and Small Adaptation Data Sets. Constantinos Boulis

Sliding Mode Controller for Unstable Systems

Zhihan Xu, Matt Proctor, Ilia Voloh

Embedded Systems and Software. A Simple Introduction to Embedded Control Systems (PID Control)

Announcements. Recap: Filtering. Recap: Reasoning Over Time. Example: State Representations for Robot Localization. Particle Filtering

Nature Neuroscience: doi: /nn Supplementary Figure 1. Spike-count autocorrelations in time.

Simulation-Solving Dynamic Models ABE 5646 Week 2, Spring 2010

Estimation Uncertainty

CS 4495 Computer Vision Tracking 1- Kalman,Gaussian

Probabilistic Robotics The Sparse Extended Information Filter

A Reinforcement Learning Approach for Collaborative Filtering

An EM based training algorithm for recurrent neural networks

EKF SLAM vs. FastSLAM A Comparison

Non-parametric techniques. Instance Based Learning. NN Decision Boundaries. Nearest Neighbor Algorithm. Distance metric important

Numerical Dispersion

Problem Set on Differential Equations

( ) = Q 0. ( ) R = R dq. ( t) = I t

RESEARCH ON STABILITY ANALYSIS OF INTERNATIONAL PROTOTYPE KILOGRAM

Testing for a Single Factor Model in the Multivariate State Space Framework

ES 250 Practice Final Exam

CSE/NB 528 Lecture 14: From Supervised to Reinforcement Learning (Chapter 9) R. Rao, 528: Lecture 14

Lecture 1: Contents of the course. Advanced Digital Control. IT tools CCSDEMO

ACE 562 Fall Lecture 8: The Simple Linear Regression Model: R 2, Reporting the Results and Prediction. by Professor Scott H.

Physics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle

Energy Storage Benchmark Problems

Lecture 20: Riccati Equations and Least Squares Feedback Control

Delivering Better Time-of-Day Using Synchronous Ethernet and Yaakov (J) Stein, Alon Geva, Gabriel Zigelboim RAD Data Communications

WATER LEVEL TRACKING WITH CONDENSATION ALGORITHM

Model for forecasting expressway surface temperature in snowy areas

LAB 5: Computer Simulation of RLC Circuit Response using PSpice

A DELAY-DEPENDENT STABILITY CRITERIA FOR T-S FUZZY SYSTEM WITH TIME-DELAYS

HW6: MRI Imaging Pulse Sequences (7 Problems for 100 pts)

Excel-Based Solution Method For The Optimal Policy Of The Hadley And Whittin s Exact Model With Arma Demand

Non-parametric techniques. Instance Based Learning. NN Decision Boundaries. Nearest Neighbor Algorithm. Distance metric important

Lecture 3: Exponential Smoothing

New effective moduli of isotropic viscoelastic composites. Part I. Theoretical justification

Comparing Means: t-tests for One Sample & Two Related Samples

2.4 Cuk converter example

Solutions to Odd Number Exercises in Chapter 6

Optimal estimation of clock values and trends from finite data

Final Exam. Tuesday, December hours

Vectorautoregressive Model and Cointegration Analysis. Time Series Analysis Dr. Sevtap Kestel 1

State-Space Modeling with Correlated Measurements with Application to Small Area Estimation Under Benchmark Constraints

PROC NLP Approach for Optimal Exponential Smoothing Srihari Jaganathan, Cognizant Technology Solutions, Newbury Park, CA.

RL Lecture 7: Eligibility Traces. R. S. Sutton and A. G. Barto: Reinforcement Learning: An Introduction 1

SUPPLEMENTARY INFORMATION

Ecological Archives E A1. Meghan A. Duffy, Spencer R. Hall, Carla E. Cáceres, and Anthony R. Ives.

Institute for Mathematical Methods in Economics. University of Technology Vienna. Singapore, May Manfred Deistler

Deep Learning: Theory, Techniques & Applications - Recurrent Neural Networks -

( ) ( ) if t = t. It must satisfy the identity. So, bulkiness of the unit impulse (hyper)function is equal to 1. The defining characteristic is

Applications in Industry (Extended) Kalman Filter. Week Date Lecture Title

Transcription:

WHAT IS A KALMAN FILTER An recursive analyical echnique o esimae ime dependen physical parameers in he presence of noise processes Example of a ime and frequency applicaion: Offse beween wo clocks

PREDICTORS, FILTERS AND SMOOTHING ALGORITHMS A predicor provides esimaes of he physical parameer s curren values using previous measuremens A filer provides esimaes of he physical parameer s using previous and curren measuremens A smoohing algorihm provides esimaes of he physical parameer s curren values using previous, curren and fuure measuremens

WHY USE A KALMAN FILTER? Provides opimal esimaes when noise model is exac Compuaionally efficien, updae filer when adding new measuremens o he exising daa se Very simple o implemen Recursive algorihm

WHY USE A KALMAN FILTER? May be used as a predicor Easy o verify performance using simulaed daa Uncerainy esimaes are provided as par of he filer May be easily modified o provide a seering algorihm or oher applicaion

ELEMENTS OF THE KALMAN FILTER Physical parameers being esimaed represened by he componens of he sae vecor. xˆ is he sae vecor wih he curren measuremens include xˆ + is he sae vecor exrapolaed o nex daa poin where he nex se of measuremens have no ye been included Example of he elemens of a sae vecor (Phase offse, Normalised frequency offse, Linear frequency drif

DETERMINISTIC CLOCK CHARACTERISTICS (ACTIVE HYDROGEN MASERS 1 0 0 (Clock - Composie(ns 2 0 0 1 5 0 1 0 0 b5 0 - H M 1 - C o m p o s ie H M 2 - C o m p o s ie H M 3 - C o m p o s ie 0-5 0 5 3 0 2 0 5 3 0 6 0 5 3 1 0 0 5 3 1 4 0 5 3 1 8 0 M J D

ELEMENTS OF THE KALMAN FILTER y is he measuremen vecor. H is he design marix ha relaes he measuremens o he physical parameers being esimaed y =Hx. In our simple example we have phase measuremens and H = (1,0,0. K is he Kalman gain, he higher he weighing of curren measuremens used o esimaes he physical parameers. K is deermined by he Kalman filer.

STATE PROPAGATION MATRIX Sae propagaion marix is used o exrapolae curren esimae: Φ = 1 0 0 τ 1 0 τ 2 τ 1 2

COVARIANCE MATRICES Process covariance marix Q: Describes he process noise added a each measuremen. This is he clock noise R is he measuremen noise covariance marix. Noise is assumed o be whie and may be correlaed. P is he parameer covariance marix, describes he uncerainies in he sae vecor esimaes. P + and P - is he marix afer and before he measuremen updae

SIMPLE MEASUREMENT SET CURRENT POINT = 3 250 200 Measuremen 150 100 50 0 0 1 2 3 4 5 6 7 8 Poin No

HOW IT ALL WORKS Sae vecor exrapolaion (1 x ˆ ( = Φ( τ xˆ( 1 n n Parameer covariance marix exrapolaion (2 + P ( = Φ( τ P( Φ ( τ + Q( n n 1 n + T

HOW IT ALL WORKS Kalman gain deerminaion (3 Incorporaing curren measuremens (4 Parameer covariance marix updae (5 [ ] 1 ( ( ( ( + = n T n T n n R H H P H P K [ ] ˆ( ( ( ˆ( ˆ( + + = n n n n n H x y K x x [ ] ( ( ( + = n n n P H K I P

WHAT ARE THE PITFALLS? Lieraure is full of descripions of very badly consruced Kalman filers (including ime and frequency lieraure Require a reasonably accurae model of underlying physical processes Require a reasonably accurae model of he noise processes Physical parameers mus be observable Clock ensemble algorihm physical parameers are only parly observable. Problem repored 1987, problem solved 2002

PROPERTIES OF THE KALMAN FILTER Equaions 2, 3 and 5 may be run independenly of he res, and do no include acual measuremens Uncerainy of he sae vecor deerminaion depends only on he covariance marices Q and R, he measuremen marix H and he number of ieraions Kalman gain has similar properies

ASSUMPTIONS MADE WHEN USING THE KALMAN FILTER Process noise added on successive epochs does no correlae Measuremen noise is assumed o be whie, zero mean and disribued normally

WHERE DO WE USE KALMAN FILTER CLOCK ALGORITHMS? Clock ensemble algorihm Inpu from hree or more clock, oupus a composie ha should be more sable han any individual clock Clock predicor Predics he fuure offse beween wo clocks based on curren and previous measuremens

WHERE DO WE USE KALMAN FILTER CLOCK ALGORITHMS? Clock seering algorihm Seers a hardware or sofware clock o say close o a reference imescale. Trade-off of frequency sabiliy and ime offse Time ransfer combining algorihm Combines measuremens from several ime ransfer links beween he same wo clocks o form an opimal composie

APPLICATION TO NPL S CLOCK ENSEMBLE ALGORITHM Log 10 (σ y -1 4.2-1 4.4-1 4.6-1 4.8-1 5-1 5.2-1 5.4-1 5.6 C lo c k 1 (F F M C lo c k 2 (W F M C lo c k 3 (W F M C o m p o s ie S im p le C o m p o s ie O p im a l C o m p o s ie -1 5.8 2 2.5 3 3.5 4 4.5 5 L o g 1 0 (τ

APPLICATION TO NPL S CLOCK ENSEMBLE ALGORITHM -1 4-1 4.5 P lo s o f L o g ( σ a g a in s L o g ( τ (s 1 0 y 1 0 C lo c k 1 (F F M C lo c k 2 (W F M C lo c k 3 (W F M C o m p o s ie S im p le C o m p o s ie O p im a l C o m p o s ie Log 10 (σ y -1 5-1 5.5-1 6 2 2.5 3 3.5 4 4.5 5 L o g 1 0 ( τ

CLOCK PREDICTOR APPLICATION Predicion Error Variance 7 6 5 4 3 2 1 C lo c k P re d ic o r E rro r V a ria n c e O p im a l P E V K a lm a n file r P E V S im p le lin e a r p re d ic o r M S E K a lm a n file r p re d ic o r M S E S im p le lin e a r p re d ic o r P E V 0 0 2 0 0 4 0 0 6 0 0 8 0 0 1 0 0 0 P re d ic io n le n g h (s

CONCLUSIONS Kalman filers may be used as a very effecive in ime and frequency analysis Mus undersand heir limiaions Choice of noise models and he sae vecor componens is criical