Nonlinear State Estimation! Extended Kalman Filters!
|
|
- James Reynolds
- 6 years ago
- Views:
Transcription
1 Nonlinear State Estimation! Extended Kalman Filters! Robert Stengel! Optimal Control and Estimation, MAE 546! Princeton University, 2017!! Deformation of the probability distribution!! Neighboring-optimal estimator!! Extended Kalman-Bucy filter!! Hybrid extended Kalman filter!! Quasilinear extended Kalman filter Copyright 2017 by Robert Stengel. All rights reserved. For educational use only Linear Transformation of a Probability Distribution Shape of probability distribution is unchanged = y E y E y! y " " pr( x)dx = y!" = k x pr( x)dx = k x " 2!" y = kx % = 2 y = ( ( y! y ) 2 pr( x)dx! = k 2 ( ( x! x ) 2 pr( x)dx = k 2 2 x! y = k x 2
2 Linear Transformation of a Gaussian Probability Distribution Probability distribution of y is Gaussian as well pr(x) = 1 2! " x e ( x x ) 2 2" x 2 pr(y) = 1 2! " y e ( y y )2 2 2" y = 1 e ( y kx ) 2 2k 2 2 " x 2! k" x y = kx " 3 E y! y Skew is zero : = k 3 x! x! 3 % = y! y! 3 pr( x)dx pr( x)dx = 0 3 Nonlinear Transformation of a Probability Distribution y = f ( x) y( x) = y( x o ) +!y(!x) = f ( x o ) + " f!x +! "x x=xo!y(!x) " f!x "x x=xo Pr " y( x o ), y( x o +!x) % y x pr y( x o ) = Pr[ x o, x o +!x] f * " %!y = pr " y( x o ) % )!x ( x, x=xo + = pr [ x o ]!x!in the limit " x0 pr % y( x o ) ( = [ ] pr x o () f )x) x=xo 4
3 Nonlinear Transformation of a Gaussian Probability Distribution y = f ( x) " = y = y E y " pr( x)dx!" = f ( x) pr( x)dx! kx (in general)!" " 2 E y! y! y 2 = " f x %! 2 % = y! y! Skew : E y! y pr( x)dx pr( x)dx! k 2 ( x! x ) 2 (in general) " 3 3 % = y! y! ( 0 (in general) pr( x)dx Probability distribution of y is not Gaussian, but it has a mean and variance 5 State Propagation for Nonlinear Dynamic Systems = f C x t!x t Continuous-time system!",u( t),w( t),t, x 0 t k+1 x( t k+1 ) = x( t k ) + % f C x t t k " x( t k ) + x( t k,t k+1 ) given!",u( t),w( t),t dt Discrete-time system x( t k+1 ) = f D!" x( t k ),u( t k ),w( t k ),t, x( 0) given Explicit numerical x( t k+1 ) = x( t k ) + %f D!" x( t k ),u( t k ),w( t k ),t k summation! x( t k ) + %x( t k,t k+1 ) In both cases, the state propagation can be expressed as! x( t k ) +!x( t k,t k+1 ) x t k+1 Explicit numerical integration 6
4 Nonlinear Dynamic Systems with Random Inputs and Measurement Error Continuous-time system with random inputs and measurement error = f C x t!x t Structure, f(.), and parameters, p(t), of the nonlinear system are known without error Stochastic effects are additive and small!",u( t),w( t),t, E!" x( 0) given z( t) = h!" x( t),u( t),n( t) E " w( t)w T (! ) % = Q C t! E " n( t)n T (! ) % = R C t! E " w( t)n T (! ) % = 0 Discrete-time system with random inputs and measurement error = f D x( t k ),u t k z( t k ) = h x t k x t k+1!",w( t k ),t, E!" x( 0) given!",u( t k ),n( t k ) = Q k! jk = R k! jk = 0 E w j w k T E n j n k T E w j n k T 7 Nonlinear Propagation of the Mean Underlying deterministic model (either case) = x( t k ) +!f x t k = x( t k ) +!x( t k,t k+1 ) x t k+1 ",u( t k ),w( t k ),t k % Propagation of the mean (continuous- or discrete-time) E!" x( t k+1 )! x( t k+1 ) = E x( t k ) + %x( t k,t k+1 )!" = E!" x t k + E!" %x t k,t k+1! x t k + %x( t k,t k+1 ) State Estimate usually defined as estimate of the mean of associated Markov process 8
5 Probability Distribution Propagation for Nonlinear Dynamic Systems Consequently x( t k+n ) = x( t k ) +!x( t k ) +!x( t k+1 ) +!+!x( t k+n"1 ) Central limit theorem: probability distribution of x(t k+n ) approaches a Gaussian distribution for large k+n!even if pr "!x( t k +1,t k ) % is not Gaussian Mean and variance are dominant measures of the probability distribution of a system s state, x(t) 9 Nonlinear Propagation of the Covariance! E x( t k+1 )! x ( t ) k+1 P t k+1 = E " x t k %! " x t k % " % x ( k+1 )! x ( ) T { " k+1 % } { + x( t k ) + x( t k ) }{ x ( k ) + x( k ) + x( k ) } T = E! x( t k )! x T (" k )% + E! x( t k )! x(" k )% Second central moment! x( t k )! x( t k ) " x( t k ) = E! x( t k ) +! x( t k ) P t k+1 Covariance matrix " %! " x k % { }{! x (( k ) +! x(( k ) } T { } + E {! x( t k ) %! x T ( " )} + E {! x( t k k )%! x(" k ) }! P t k % + M( t k ) + M T ( t k ) + P( t k ) % % 10
6 Gaussian and Non-Gaussian Probability Distributions!! (Almost) all random variables have means and standard deviations!! Minimizing estimate error covariance tends to minimize the spread of the error in many (but not all) non- Gaussian cases!! Central Limit Theorem implies that estimate errors tend toward normal distribution 11 Neighboring-Optimal Estimator! 12
7 Neighboring-Optimal Estimator!x ( t) = f!" x( t),u( t),w( t),t Assume z( t) = h!" x( t) + n( t)! Nominal solution exists! Disturbance and measurement errors are small! State stays close to the nominal solution! Mean and variance are good approximators of probability distribution x o ( t),u o ( t),w o t!x o ( t) +!!x ( t) = f x o ( t),u o ( t),w o t ( t) +!z( t) = h x o ( t) z o known in! 0,t f ",t % + " F( t)!x( t) + G( t)!u( t) + L( t)!w( t) % " % + n o ( t) + " H( t)!x( t) +!n( t) % " Jacobian matrices evaluated along the nominal path F(t)!!f [!x x o(t),u o (t),w o (t)]; G(t)!!f [!u x o(t),u o (t),w o (t)]; L(t)!!f [!w x o(t),u o (t),w o (t)] 13 Neighboring-Optimal Estimator Estimate the perturbation from the nominal path!ˆ! x( t) = F(t)!ˆx ( t) + G(t)!u(t) + K C ( t)!z( t) " H t!ˆx ( t) % K C (t) is the LTV Kalman-Bucy gain matrix LTV Kalman filter could be used to estimate the state at discrete instants of time ˆx ( t)! x Nom ( t) +!ˆx ( t) 14
8 where Neighboring-Optimal Estimator Example (from Gelb, 1974) Radar tracking a falling body (one dimension)! "!x 1 t!x 2 t!x 3 t! x 2 ( t)! = d g ; % " 0 % " z t Drag = d =!V 2 ( t) 2" t x 1 x 2 x 3! altitude = velocity ballistic coefficient, ( % " % = x 1 ( t) + n( t) =!x 2 2 ( t) ( t) 2x 3 Density =! =! o e altitude/k =! o e x 1( t)/k 15 Estimate Error for Example (from Gelb, 1974) P( 0) = " w( t) = , !10 5 % Pre-computed nominal trajectory Filter gains also may be pre-computed Position and velocity errors diverge Ballistic coefficient estimate error exceeds filter estimate Example of parameter estimation 16
9 Extended Kalman-Bucy Filter! 17 Extended Kalman-Bucy Filter = f x t = h x( t)!x t z t!",u( t),w( t),t!" + n t Assume! No nominal solution is reliable or available! Disturbances and measurement errors may not be small F(t)!! f [! x x o(t),u o (t),w o (t)]; G(t)!! f [! u x o(t),u o (t),w o (t)]; L(t)!! f [! w x (t),u (t),w (t) o o o ]; H(t)!! h! x x (t),u (t),w (t) o o o [ ] 18
10 Extended Kalman-Bucy Filter In the estimator! Replace the linear dynamic model by the nonlinear model! Compute the filter gain matrix using the linearized model! Make linear update to the state estimate propagated by the nonlinear model 19 Extended Kalman- Bucy Filter State Estimate: Nonlinear propagation plus linear correction = f ˆx t ˆ!x t x( t k+1 ) = ˆx ( t k ) + f ˆx t K C!",u( t),t + K C t t k+1 t k!",u( t),t + K C t Filter Gain { } z( t) % h ˆx ( t)!" { } dt z( t) % h ˆx ( t) ( t) = P( t)h T [ ˆx(t),u(t) ]R!1 C ( t)!" 20
11 Extended Kalman- Bucy Filter Covariance Estimate!P ( t) = F[ ˆx(t),u(t) ]P( t) + P( t)f T [ ˆx(t),u(t) ] + L[ ˆx(t),u(t) ]Q C ( t)l T [ ˆx(t),u(t) ]! K C ( t)h[ ˆx(t),u(t) ]P t Linear Kalman-Bucy filter! State estimate is affected by the covariance estimate! Covariance estimate is not affected by the state estimate! Consequently, the covariance estimate is unaffected by the output, z(t) Extended Kalman-Bucy filter! State estimate is affected by the covariance estimate! Covariance estimate is affected by the state estimate! Therefore, the covariance estimate is affected by the output, z(t) 21 Extended Kalman-Bucy Filter Example (from Gelb, 1974) Early tracking error is large Position, velocity, and ballistic coefficient errors converge to estimated bounds Filter gains must be computed on-line 22
12 Hybrid Extended Kalman Filter Numerical integration of continuous-time propagation equations ˆx t k (!) State Estimate ( ) " % = x " t + k!1 % + f " ˆx " + %,u % d t k t k!1 P t k (!) Covariance Estimate ( ) t k " % = P" t ( + ) k!1 % + " F ( )P( ) + P ( FT ) + L ( )Q C ( )L T ( ) % d t k!1 Jacobian matrices must be calculated 23 K t k Hybrid Extended Kalman Filter = P t k (!) ˆx t k ( + ) Recursive discrete-time estimate updates " % HT t k H t k!" = ˆx!" t k % + K t k P t k ( + ) Filter Gain!1 " P" t k (!) % ( HT t k ) + R( t k ) % State Estimate (+) { } z( t k ) % h ˆx t k (%) Covariance Estimate (+)!" =!" I % K t n ( k )H( t k ) P!" t k (%)!" 24
13 Iterated Extended Kalman Filter (Gelb, 1974) Re-apply the update equations to the updated solution to improve the estimate before proceeding Re-linearize output matrix before each new update ˆx k,i+1 ( + ) = ˆx k (!) + K k,i z k! h ˆx k,i ( + ) ˆx k,0 ( + ) = ˆx k (!) Arbitrary of iterations: i = 0,1,! State Estimate (+) { " %! H k " ˆx k,i ( + ) % " ˆx k (!)! ˆx k,i ( + ) % }, Filter Gain { }!1 T K k,i = P k (!)H k " ˆx k,i ( + ) % H " k ˆx k,i ( + ) % P! T H k k " ˆx k,i ( + ) % + R k Covariance Estimate (+) P k,i+1 + { " % }P k! = I n! K k,i H k ˆx k,i ( + ) 25 z t k Two-Dimensional Example (from Gelb, 1974) Same falling sphere dynamics, with offset radar 2 { " % } 1/2 + n t = r 2 1 ( t k ) + x ( t )! r k 2 26
14 Comparison of Filter Results (from Gelb, 1974) Comparison of alternative nonlinear estimators 100-trial Monte Carlo evaluation Wishner, Automatica, 1969 Second-order filter includes additional terms in f[.] and h[.] 27 Quasilinearization (Describing Functions)! 28
15 Quasilinearization True linearization: slope of a nonlinear curve at the evaluation point Quasilinearization: amplitude-dependent slope of a nonlinear curve at the evaluation point Describing function: quasilinear function of affine form: Describing Function = Bias + Scale Factor( x! x o ) Saturation (Limiting) Nonlinearity 29 Comparison of Clipped Sine Wave with Describing Function Approximation 30
16 Deterministic Describing Function of the Saturation Function Describing function depends on wave form and amplitude of the input Saturation function y = f ( x) = % a, x! a x, " a < x < a "a, x "a Describing function input = Nonlinear function input Sinusoidal input Clipped sine wave x( t) = Asin!t y( t) = f [ Asin!t ] = % ( a, x " a Asin!t, a < x < a a, x a 31 Sinusoidal-Input Describing Function of the Saturation Function (from Graham and McRuer, 1961) Approximate nonlinear function by linear function f ( x)! d 0 + d 1 ( x " x o ) Most readily calculated as the first term of a Fourier series for y(t) For symmetric input (x 0 = 0) to symmetric nonlinearity, d 0 = 0, and d 1 = 2A ) a! sin"1 % A ( + a % A ( 1 " a + % A ( * + 2,. -. a : Saturation limit A : Input amplitude 32
17 Sinusoidal-Input Describing Function of the Saturation Function y D Describing function output 0 2 ( t) = d 1 sin!t = 2A * a " sin1 % A( ) + a % A ( ) 1 a 1, % A ( ) +, 32 See Describing Function Analysis of Nonlinear Simulink Models in Simulink Control Design / 5sin!t. / Nonlinearity Introduces Harmonics in Output Synthesized Cello Tone 34
18 y D Harmonic Describing Functions of Saturation Fourier series of symmetrically clipped sine wave includes symmetric harmonic terms ( t) = d 1 sin!t + d 3 sin 3!t + " 3 + d 5 sin( 5!t + " 5 ) +! Graham and McRuer, Describing Function Derived from Expected Values of Input and Output Describing Function = Bias + Scale Factor( x! x o ) Approximate nonlinear function by linear function f ( x)! d 0 + d 1 ( x " x o ) Statistical representation of fit error J = E f ( x)! d 0! d ( 1 x! x ) 2 {" o % } Minimize fit error to find d 0 and d 1!J!d 0 = 0;!J!d 1 = 0 36
19 Random-Input Describing Function Bias and scale factor f ( x) d 1 = E!xf ( x) [ ] d 0 = E!" % d 1 E!x!x " x! x o by elimination d 0 = E!"!x2 E!" f ( x) % E [!x ]E! "!xf ( x ) E!"!x 2 % E 2!x [ ] [ ]! " % d 0 E!x E!"!x 2 d 1 = E! "!xf ( x) % E [!x ]E! " f ( x) E!"!x 2 % E 2!x [ ] 37 Random-Input Describing Function!x f x If and both have zero mean d 0 = 0 d 1 = E! "!xf x = E xf x E!"!x 2 E!" x 2 Describing function for symmetric function Describing Function = d 0 + d 1 = E " xf x % x E " x 2 %! " ( x! x o ) = d 1 x 38
20 Random-Input Describing Function for the Saturation Function (from Graham and McRuer, 1961) Describing function input: White noise with standard deviation, x( t)! N ( 0,! )! Zero-mean white noise with standard deviation,!! y D Describing function output ( t) = E! "!xf x x t E!"!x 2 = d 1 x( t) = erf ( where the error function, erf(.), is erf z = 2, e-. 2 d. z / 0 a ) 2% * + x t 39 Comparison of Clipped White Noise with Describing Function Approximation 40
21 Random-Input and Sinusoidal Describing Functions of the Saturation Function Describing Function, db General shapes are similar x 1 substituted for a in the figures 41 Multivariate Describing Functions Let f(x) be a nonlinear vector function of a vector The quasilinear describing function approximation is! b + D( x " ˆx ) where ˆx = E( x) f x Cost function = Trace of the error covariance matrix J = E Tr " f ( x)! b! D ( x! ˆx ) % " f ( x)! b! D ( x! ˆx ) T " { % }% {! b! D ( x! ˆx )! b! D ( x! ˆx ) } = E " Tr " f x T % " f x % % Quasilinear extended Kalman-Bucy filter! F, G, and L replaced by describing function matrices 42
22 Describing Function Matrices for State Estimation Minimize fit error to find b and D!J!b = 0;!J!D = 0 Describing function bias (see text) b = E!" f x! ˆf x Describing function scaling matrix is a function of the covariance inverse (see text) D = E{!" f ( x)!x T % E!" f ( x)!x T }P %1 where!x = x % ˆx; P = E!x!x T 43 Monte Carlo Comparison of Quasilinear Filter with Extended Kalman Filter and Three Others (from Gelb, 1974) =!sin x( t) + w( t) = 0.5sin( 2x k ) + n k!x t z t Phaneuf, MIT PhD thesis, 1968) 44
23 Next Time:! Sigma Points (Unscented Kalman) Filters! plus Brief Introduction to Particle, Batch Least-Squares, Backward-Smoothing, Gaussian Mixture Filters! 45 Supplemental Material! 46
24 P t k (!) Quasilinear Filter Propagation Equations True linearization Jacobians replaced by quasilinear (describing function) Jacobians ˆx t k (!) " % = x " t k!1 + % + f " ˆx " + %,u % d t k D F : ( n! n) Stability matrix of f ( x) containing describing function elements t k t k!1 " % = P" t k!1 ( + ) % + " D F ( )P( ) + P ( )D T F ( ) + D L ( )Q C ( )D T L ( ) % d t k!1 Covariance propagation is state-dependent 47 Quasilinear System Stability Matrix True linearization of nonlinear system equation!x o ( t) +!!x ( t) " f x o t,u o ( t),t % + F x o ( t),u o ( t),t %!x t = f x o ( t),u o ( t),t % + F( t)!x( t) +" +" Quasilinearization of nonlinear system equation Some or all elements of stability matrix are state-dependent!x o ( t) +!!x ( t) " f x o t,u o ( t),t % + F x o ( t),u o ( t),t %!x t +" = f x o ( t),u o ( t),t % + D F E!x( t) %,x o ( t),u o ( t),t %!x t +" 48
25 Quasilinear Filter Gain and Updates = P t k (!) K t k " % D T H Filter Gain ( t k ) D H t k P" t k (!) % D T!1 " H ( t k ) + R( t k ) % ˆx t k ( + )!" = ˆx!" t k % + K t k P t k ( + ) State Estimate Update { } z( t k ) % h ˆx t k (%) Covariance Estimate Update!"!" =!" I % K t n ( k )D H ( t k ) P!" t k (%) D H : Output matrix of h( x) containing describing function elements 49
Nonlinear State Estimation! Particle, Sigma-Points Filters!
Nonlinear State Estimation! Particle, Sigma-Points Filters! Robert Stengel! Optimal Control and Estimation, MAE 546! Princeton University, 2017!! Particle filter!! Sigma-Points Unscented Kalman ) filter!!
More informationStochastic and Adaptive Optimal Control
Stochastic and Adaptive Optimal Control Robert Stengel Optimal Control and Estimation, MAE 546 Princeton University, 2018! Nonlinear systems with random inputs and perfect measurements! Stochastic neighboring-optimal
More informationOptimal Control and Estimation MAE 546, Princeton University Robert Stengel, Preliminaries!
Optimal Control and Estimation MAE 546, Princeton University Robert Stengel, 2018 Copyright 2018 by Robert Stengel. All rights reserved. For educational use only. http://www.princeton.edu/~stengel/mae546.html
More informationLecture 6: Bayesian Inference in SDE Models
Lecture 6: Bayesian Inference in SDE Models Bayesian Filtering and Smoothing Point of View Simo Särkkä Aalto University Simo Särkkä (Aalto) Lecture 6: Bayesian Inference in SDEs 1 / 45 Contents 1 SDEs
More informationLinear-Quadratic-Gaussian Controllers!
Linear-Quadratic-Gaussian Controllers! Robert Stengel! Optimal Control and Estimation MAE 546! Princeton University, 2017!! LTI dynamic system!! Certainty Equivalence and the Separation Theorem!! Asymptotic
More informationNonlinear and/or Non-normal Filtering. Jesús Fernández-Villaverde University of Pennsylvania
Nonlinear and/or Non-normal Filtering Jesús Fernández-Villaverde University of Pennsylvania 1 Motivation Nonlinear and/or non-gaussian filtering, smoothing, and forecasting (NLGF) problems are pervasive
More informationLinearized Equations of Motion!
Linearized Equations of Motion Robert Stengel, Aircraft Flight Dynamics MAE 331, 216 Learning Objectives Develop linear equations to describe small perturbational motions Apply to aircraft dynamic equations
More informationStochastic Optimal Control!
Stochastic Control! Robert Stengel! Robotics and Intelligent Systems, MAE 345, Princeton University, 2015 Learning Objectives Overview of the Linear-Quadratic-Gaussian (LQG) Regulator Introduction to Stochastic
More informationOptimal Control and Estimation MAE 546, Princeton University Robert Stengel, Preliminaries!
Optimal Control and Estimation MAE 546, Princeton University Robert Stengel, 2017 Copyright 2017 by Robert Stengel. All rights reserved. For educational use only. http://www.princeton.edu/~stengel/mae546.html
More informationLecture 2: From Linear Regression to Kalman Filter and Beyond
Lecture 2: From Linear Regression to Kalman Filter and Beyond January 18, 2017 Contents 1 Batch and Recursive Estimation 2 Towards Bayesian Filtering 3 Kalman Filter and Bayesian Filtering and Smoothing
More informationAdaptive State Estimation Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 2018
Adaptive State Estimation Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 218! Nonlinearity of adaptation! Parameter-adaptive filtering! Test for whiteness of the residual!
More information1 Kalman Filter Introduction
1 Kalman Filter Introduction You should first read Chapter 1 of Stochastic models, estimation, and control: Volume 1 by Peter S. Maybec (available here). 1.1 Explanation of Equations (1-3) and (1-4) Equation
More informationTime Series Analysis
Time Series Analysis hm@imm.dtu.dk Informatics and Mathematical Modelling Technical University of Denmark DK-2800 Kgs. Lyngby 1 Outline of the lecture State space models, 1st part: Model: Sec. 10.1 The
More informationOPTIMAL CONTROL AND ESTIMATION
OPTIMAL CONTROL AND ESTIMATION Robert F. Stengel Department of Mechanical and Aerospace Engineering Princeton University, Princeton, New Jersey DOVER PUBLICATIONS, INC. New York CONTENTS 1. INTRODUCTION
More informationOptimization-Based Control
Optimization-Based Control Richard M. Murray Control and Dynamical Systems California Institute of Technology DRAFT v1.7a, 19 February 2008 c California Institute of Technology All rights reserved. This
More informationKalman Filter. Predict: Update: x k k 1 = F k x k 1 k 1 + B k u k P k k 1 = F k P k 1 k 1 F T k + Q
Kalman Filter Kalman Filter Predict: x k k 1 = F k x k 1 k 1 + B k u k P k k 1 = F k P k 1 k 1 F T k + Q Update: K = P k k 1 Hk T (H k P k k 1 Hk T + R) 1 x k k = x k k 1 + K(z k H k x k k 1 ) P k k =(I
More informationTime Response of Dynamic Systems! Multi-Dimensional Trajectories Position, velocity, and acceleration are vectors
Time Response of Dynamic Systems Robert Stengel Robotics and Intelligent Systems MAE 345, Princeton University, 217 Multi-dimensional trajectories Numerical integration Linear and nonlinear systems Linearization
More informationLecture 7: Optimal Smoothing
Department of Biomedical Engineering and Computational Science Aalto University March 17, 2011 Contents 1 What is Optimal Smoothing? 2 Bayesian Optimal Smoothing Equations 3 Rauch-Tung-Striebel Smoother
More informationThe Kalman Filter (part 1) Definition. Rudolf Emil Kalman. Why do we need a filter? Definition. HCI/ComS 575X: Computational Perception.
The Kalman Filter (part 1) HCI/ComS 575X: Computational Perception Instructor: Alexander Stoytchev http://www.cs.iastate.edu/~alex/classes/2007_spring_575x/ March 5, 2007 HCI/ComS 575X: Computational Perception
More informationLecture 2: From Linear Regression to Kalman Filter and Beyond
Lecture 2: From Linear Regression to Kalman Filter and Beyond Department of Biomedical Engineering and Computational Science Aalto University January 26, 2012 Contents 1 Batch and Recursive Estimation
More informationStochastic Processes. M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno
Stochastic Processes M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno 1 Outline Stochastic (random) processes. Autocorrelation. Crosscorrelation. Spectral density function.
More informationExtended Kalman Filter Tutorial
Extended Kalman Filter Tutorial Gabriel A. Terejanu Department of Computer Science and Engineering University at Buffalo, Buffalo, NY 14260 terejanu@buffalo.edu 1 Dynamic process Consider the following
More informationGaussian Process Approximations of Stochastic Differential Equations
Gaussian Process Approximations of Stochastic Differential Equations Cédric Archambeau Dan Cawford Manfred Opper John Shawe-Taylor May, 2006 1 Introduction Some of the most complex models routinely run
More informationStochastic Processes
Elements of Lecture II Hamid R. Rabiee with thanks to Ali Jalali Overview Reading Assignment Chapter 9 of textbook Further Resources MIT Open Course Ware S. Karlin and H. M. Taylor, A First Course in Stochastic
More informationROBOTICS 01PEEQW. Basilio Bona DAUIN Politecnico di Torino
ROBOTICS 01PEEQW Basilio Bona DAUIN Politecnico di Torino Probabilistic Fundamentals in Robotics Gaussian Filters Course Outline Basic mathematical framework Probabilistic models of mobile robots Mobile
More information9 Multi-Model State Estimation
Technion Israel Institute of Technology, Department of Electrical Engineering Estimation and Identification in Dynamical Systems (048825) Lecture Notes, Fall 2009, Prof. N. Shimkin 9 Multi-Model State
More informationA new unscented Kalman filter with higher order moment-matching
A new unscented Kalman filter with higher order moment-matching KSENIA PONOMAREVA, PARESH DATE AND ZIDONG WANG Department of Mathematical Sciences, Brunel University, Uxbridge, UB8 3PH, UK. Abstract This
More informationA Comparitive Study Of Kalman Filter, Extended Kalman Filter And Unscented Kalman Filter For Harmonic Analysis Of The Non-Stationary Signals
International Journal of Scientific & Engineering Research, Volume 3, Issue 7, July-2012 1 A Comparitive Study Of Kalman Filter, Extended Kalman Filter And Unscented Kalman Filter For Harmonic Analysis
More informationELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process
Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Definition of stochastic process (random
More informationNonlinear Estimation Techniques for Impact Point Prediction of Ballistic Targets
Nonlinear Estimation Techniques for Impact Point Prediction of Ballistic Targets J. Clayton Kerce a, George C. Brown a, and David F. Hardiman b a Georgia Tech Research Institute, Georgia Institute of Technology,
More informationX t = a t + r t, (7.1)
Chapter 7 State Space Models 71 Introduction State Space models, developed over the past 10 20 years, are alternative models for time series They include both the ARIMA models of Chapters 3 6 and the Classical
More informationReturn Difference Function and Closed-Loop Roots Single-Input/Single-Output Control Systems
Spectral Properties of Linear- Quadratic Regulators Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 2018! Stability margins of single-input/singleoutput (SISO) systems! Characterizations
More informationProbabilistic Fundamentals in Robotics. DAUIN Politecnico di Torino July 2010
Probabilistic Fundamentals in Robotics Gaussian Filters Basilio Bona DAUIN Politecnico di Torino July 2010 Course Outline Basic mathematical framework Probabilistic models of mobile robots Mobile robot
More informationConstrained State Estimation Using the Unscented Kalman Filter
16th Mediterranean Conference on Control and Automation Congress Centre, Ajaccio, France June 25-27, 28 Constrained State Estimation Using the Unscented Kalman Filter Rambabu Kandepu, Lars Imsland and
More informationCALIFORNIA INSTITUTE OF TECHNOLOGY Control and Dynamical Systems. CDS 110b
CALIFORNIA INSTITUTE OF TECHNOLOGY Control and Dynamical Systems CDS 110b R. M. Murray Kalman Filters 14 January 2007 Reading: This set of lectures provides a brief introduction to Kalman filtering, following
More informationName of the Student: Problems on Discrete & Continuous R.Vs
Engineering Mathematics 05 SUBJECT NAME : Probability & Random Process SUBJECT CODE : MA6 MATERIAL NAME : University Questions MATERIAL CODE : JM08AM004 REGULATION : R008 UPDATED ON : Nov-Dec 04 (Scan
More informationData Fusion Kalman Filtering Self Localization
Data Fusion Kalman Filtering Self Localization Armando Jorge Sousa http://www.fe.up.pt/asousa asousa@fe.up.pt Faculty of Engineering, University of Porto, Portugal Department of Electrical and Computer
More informationDual Estimation and the Unscented Transformation
Dual Estimation and the Unscented Transformation Eric A. Wan ericwan@ece.ogi.edu Rudolph van der Merwe rudmerwe@ece.ogi.edu Alex T. Nelson atnelson@ece.ogi.edu Oregon Graduate Institute of Science & Technology
More informationKalman Filter. Man-Wai MAK
Kalman Filter Man-Wai MAK Dept. of Electronic and Information Engineering, The Hong Kong Polytechnic University enmwmak@polyu.edu.hk http://www.eie.polyu.edu.hk/ mwmak References: S. Gannot and A. Yeredor,
More informationLecture 6: Multiple Model Filtering, Particle Filtering and Other Approximations
Lecture 6: Multiple Model Filtering, Particle Filtering and Other Approximations Department of Biomedical Engineering and Computational Science Aalto University April 28, 2010 Contents 1 Multiple Model
More informationLagrangian data assimilation for point vortex systems
JOT J OURNAL OF TURBULENCE http://jot.iop.org/ Lagrangian data assimilation for point vortex systems Kayo Ide 1, Leonid Kuznetsov 2 and Christopher KRTJones 2 1 Department of Atmospheric Sciences and Institute
More informationTime-Invariant Linear Quadratic Regulators!
Time-Invariant Linear Quadratic Regulators Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 17 Asymptotic approach from time-varying to constant gains Elimination of cross weighting
More informationSystem Modeling and Identification CHBE 702 Korea University Prof. Dae Ryook Yang
System Modeling and Identification CHBE 702 Korea University Prof. Dae Ryook Yang 1-1 Course Description Emphases Delivering concepts and Practice Programming Identification Methods using Matlab Class
More informationMinimization with Equality Constraints
Path Constraints and Numerical Optimization Robert Stengel Optimal Control and Estimation, MAE 546, Princeton University, 2015 State and Control Equality Constraints Pseudoinverse State and Control Inequality
More informationSequential State Estimation (Crassidas and Junkins, Chapter 5)
Sequential State Estimation (Crassidas and Junkins, Chapter 5) Please read: 5.1, 5.3-5.6 5.3 The Discrete-Time Kalman Filter The discrete-time Kalman filter is used when the dynamics and measurements are
More informationin a Rao-Blackwellised Unscented Kalman Filter
A Rao-Blacwellised Unscented Kalman Filter Mar Briers QinetiQ Ltd. Malvern Technology Centre Malvern, UK. m.briers@signal.qinetiq.com Simon R. Masell QinetiQ Ltd. Malvern Technology Centre Malvern, UK.
More informationLecture 4: Numerical Solution of SDEs, Itô Taylor Series, Gaussian Process Approximations
Lecture 4: Numerical Solution of SDEs, Itô Taylor Series, Gaussian Process Approximations Simo Särkkä Aalto University Tampere University of Technology Lappeenranta University of Technology Finland November
More informationState-space Model. Eduardo Rossi University of Pavia. November Rossi State-space Model Fin. Econometrics / 53
State-space Model Eduardo Rossi University of Pavia November 2014 Rossi State-space Model Fin. Econometrics - 2014 1 / 53 Outline 1 Motivation 2 Introduction 3 The Kalman filter 4 Forecast errors 5 State
More informationControl Systems! Copyright 2017 by Robert Stengel. All rights reserved. For educational use only.
Control Systems Robert Stengel Robotics and Intelligent Systems MAE 345, Princeton University, 2017 Analog vs. digital systems Continuous- and Discretetime Dynamic Models Frequency Response Transfer Functions
More informationState-space Model. Eduardo Rossi University of Pavia. November Rossi State-space Model Financial Econometrics / 49
State-space Model Eduardo Rossi University of Pavia November 2013 Rossi State-space Model Financial Econometrics - 2013 1 / 49 Outline 1 Introduction 2 The Kalman filter 3 Forecast errors 4 State smoothing
More informationState estimation of linear dynamic system with unknown input and uncertain observation using dynamic programming
Control and Cybernetics vol. 35 (2006) No. 4 State estimation of linear dynamic system with unknown input and uncertain observation using dynamic programming by Dariusz Janczak and Yuri Grishin Department
More informationThe Kalman Filter ImPr Talk
The Kalman Filter ImPr Talk Ged Ridgway Centre for Medical Image Computing November, 2006 Outline What is the Kalman Filter? State Space Models Kalman Filter Overview Bayesian Updating of Estimates Kalman
More informationMachine Learning 4771
Machine Learning 4771 Instructor: ony Jebara Kalman Filtering Linear Dynamical Systems and Kalman Filtering Structure from Motion Linear Dynamical Systems Audio: x=pitch y=acoustic waveform Vision: x=object
More informationExtension of the Sparse Grid Quadrature Filter
Extension of the Sparse Grid Quadrature Filter Yang Cheng Mississippi State University Mississippi State, MS 39762 Email: cheng@ae.msstate.edu Yang Tian Harbin Institute of Technology Harbin, Heilongjiang
More informationNONLINEAR BAYESIAN FILTERING FOR STATE AND PARAMETER ESTIMATION
NONLINEAR BAYESIAN FILTERING FOR STATE AND PARAMETER ESTIMATION Kyle T. Alfriend and Deok-Jin Lee Texas A&M University, College Station, TX, 77843-3141 This paper provides efficient filtering algorithms
More informationECE276A: Sensing & Estimation in Robotics Lecture 10: Gaussian Mixture and Particle Filtering
ECE276A: Sensing & Estimation in Robotics Lecture 10: Gaussian Mixture and Particle Filtering Lecturer: Nikolay Atanasov: natanasov@ucsd.edu Teaching Assistants: Siwei Guo: s9guo@eng.ucsd.edu Anwesan Pal:
More informationNonlinear Observers. Jaime A. Moreno. Eléctrica y Computación Instituto de Ingeniería Universidad Nacional Autónoma de México
Nonlinear Observers Jaime A. Moreno JMorenoP@ii.unam.mx Eléctrica y Computación Instituto de Ingeniería Universidad Nacional Autónoma de México XVI Congreso Latinoamericano de Control Automático October
More informationName of the Student: Problems on Discrete & Continuous R.Vs
Engineering Mathematics 08 SUBJECT NAME : Probability & Random Processes SUBJECT CODE : MA645 MATERIAL NAME : University Questions REGULATION : R03 UPDATED ON : November 07 (Upto N/D 07 Q.P) (Scan the
More informationKalman Filters with Uncompensated Biases
Kalman Filters with Uncompensated Biases Renato Zanetti he Charles Stark Draper Laboratory, Houston, exas, 77058 Robert H. Bishop Marquette University, Milwaukee, WI 53201 I. INRODUCION An underlying assumption
More informationTime-Invariant Linear Quadratic Regulators Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 2015
Time-Invariant Linear Quadratic Regulators Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 15 Asymptotic approach from time-varying to constant gains Elimination of cross weighting
More informationBayes Filter Reminder. Kalman Filter Localization. Properties of Gaussians. Gaussians. Prediction. Correction. σ 2. Univariate. 1 2πσ e.
Kalman Filter Localization Bayes Filter Reminder Prediction Correction Gaussians p(x) ~ N(µ,σ 2 ) : Properties of Gaussians Univariate p(x) = 1 1 2πσ e 2 (x µ) 2 σ 2 µ Univariate -σ σ Multivariate µ Multivariate
More informationDynamic data processing recursive least-squares
Dynamic data processing recursive least-squares Dynamic data processing recursive least-squares Delft University of Technology Department of Mathematical Geodesy and Positioning VSSD Series on Mathematical
More informationSTATISTICAL ORBIT DETERMINATION
STATISTICAL ORBIT DETERMINATION Satellite Tracking Example of SNC and DMC ASEN 5070 LECTURE 6 4.08.011 1 We will develop a simple state noise compensation (SNC) algorithm. This algorithm adds process noise
More informationUNIVERSITY OF OSLO Fysisk Institutt. Tracking of an Airplane using EKF and SPF. Master thesis. Rune Jansberg
UNIVERSITY OF OSLO Fysisk Institutt Tracking of an Airplane using EKF and SPF Master thesis Rune Jansberg May 31, 2010 Problem Description Tracking of an Airplane using EKF and SPF. The theory behind
More informationLecture 4 - Spectral Estimation
Lecture 4 - Spectral Estimation The Discrete Fourier Transform The Discrete Fourier Transform (DFT) is the equivalent of the continuous Fourier Transform for signals known only at N instants separated
More informationIntroduction to Unscented Kalman Filter
Introduction to Unscented Kalman Filter 1 Introdution In many scientific fields, we use certain models to describe the dynamics of system, such as mobile robot, vision tracking and so on. The word dynamics
More informationA NONLINEARITY MEASURE FOR ESTIMATION SYSTEMS
AAS 6-135 A NONLINEARITY MEASURE FOR ESTIMATION SYSTEMS Andrew J. Sinclair,JohnE.Hurtado, and John L. Junkins The concept of nonlinearity measures for dynamical systems is extended to estimation systems,
More informationExpectation propagation for signal detection in flat-fading channels
Expectation propagation for signal detection in flat-fading channels Yuan Qi MIT Media Lab Cambridge, MA, 02139 USA yuanqi@media.mit.edu Thomas Minka CMU Statistics Department Pittsburgh, PA 15213 USA
More informationIntroduction to Optimization!
Introduction to Optimization! Robert Stengel! Robotics and Intelligent Systems, MAE 345, Princeton University, 2017 Optimization problems and criteria Cost functions Static optimality conditions Examples
More informationApproximate Inference Part 1 of 2
Approximate Inference Part 1 of 2 Tom Minka Microsoft Research, Cambridge, UK Machine Learning Summer School 2009 http://mlg.eng.cam.ac.uk/mlss09/ Bayesian paradigm Consistent use of probability theory
More informationIN particle filter (PF) applications, knowledge of the computational
Complexity Analysis of the Marginalized Particle Filter Rickard Karlsson, Thomas Schön and Fredrik Gustafsson, Member IEEE Abstract In this paper the computational complexity of the marginalized particle
More informationApproximate Inference Part 1 of 2
Approximate Inference Part 1 of 2 Tom Minka Microsoft Research, Cambridge, UK Machine Learning Summer School 2009 http://mlg.eng.cam.ac.uk/mlss09/ 1 Bayesian paradigm Consistent use of probability theory
More information2D Image Processing (Extended) Kalman and particle filter
2D Image Processing (Extended) Kalman and particle filter Prof. Didier Stricker Dr. Gabriele Bleser Kaiserlautern University http://ags.cs.uni-kl.de/ DFKI Deutsches Forschungszentrum für Künstliche Intelligenz
More informationFiltering and Likelihood Inference
Filtering and Likelihood Inference Jesús Fernández-Villaverde University of Pennsylvania July 10, 2011 Jesús Fernández-Villaverde (PENN) Filtering and Likelihood July 10, 2011 1 / 79 Motivation Introduction
More information1 h 9 e $ s i n t h e o r y, a p p l i c a t i a n
T : 99 9 \ E \ : \ 4 7 8 \ \ \ \ - \ \ T \ \ \ : \ 99 9 T : 99-9 9 E : 4 7 8 / T V 9 \ E \ \ : 4 \ 7 8 / T \ V \ 9 T - w - - V w w - T w w \ T \ \ \ w \ w \ - \ w \ \ w \ \ \ T \ w \ w \ w \ w \ \ w \
More informationMini-Course 07 Kalman Particle Filters. Henrique Massard da Fonseca Cesar Cunha Pacheco Wellington Bettencurte Julio Dutra
Mini-Course 07 Kalman Particle Filters Henrique Massard da Fonseca Cesar Cunha Pacheco Wellington Bettencurte Julio Dutra Agenda State Estimation Problems & Kalman Filter Henrique Massard Steady State
More informationANNEX A: ANALYSIS METHODOLOGIES
ANNEX A: ANALYSIS METHODOLOGIES A.1 Introduction Before discussing supplemental damping devices, this annex provides a brief review of the seismic analysis methods used in the optimization algorithms considered
More informationLessons in Estimation Theory for Signal Processing, Communications, and Control
Lessons in Estimation Theory for Signal Processing, Communications, and Control Jerry M. Mendel Department of Electrical Engineering University of Southern California Los Angeles, California PRENTICE HALL
More informationLecture 4: Numerical Solution of SDEs, Itô Taylor Series, Gaussian Approximations
Lecture 4: Numerical Solution of SDEs, Itô Taylor Series, Gaussian Approximations Simo Särkkä Aalto University, Finland November 18, 2014 Simo Särkkä (Aalto) Lecture 4: Numerical Solution of SDEs November
More informationNonlinear Filtering. With Polynomial Chaos. Raktim Bhattacharya. Aerospace Engineering, Texas A&M University uq.tamu.edu
Nonlinear Filtering With Polynomial Chaos Raktim Bhattacharya Aerospace Engineering, Texas A&M University uq.tamu.edu Nonlinear Filtering with PC Problem Setup. Dynamics: ẋ = f(x, ) Sensor Model: ỹ = h(x)
More informationCSC487/2503: Foundations of Computer Vision. Visual Tracking. David Fleet
CSC487/2503: Foundations of Computer Vision Visual Tracking David Fleet Introduction What is tracking? Major players: Dynamics (model of temporal variation of target parameters) Measurements (relation
More informationPartially Observable Markov Decision Processes (POMDPs)
Partially Observable Markov Decision Processes (POMDPs) Sachin Patil Guest Lecture: CS287 Advanced Robotics Slides adapted from Pieter Abbeel, Alex Lee Outline Introduction to POMDPs Locally Optimal Solutions
More informationA Novel Gaussian Sum Filter Method for Accurate Solution to Nonlinear Filtering Problem
A Novel Gaussian Sum Filter Method for Accurate Solution to Nonlinear Filtering Problem Gabriel Terejanu a Puneet Singla b Tarunraj Singh b Peter D. Scott a Graduate Student Assistant Professor Professor
More informationDesign of Norm-Optimal Iterative Learning Controllers: The Effect of an Iteration-Domain Kalman Filter for Disturbance Estimation
Design of Norm-Optimal Iterative Learning Controllers: The Effect of an Iteration-Domain Kalman Filter for Disturbance Estimation Nicolas Degen, Autonomous System Lab, ETH Zürich Angela P. Schoellig, University
More informationNonlinear Control Systems
Nonlinear Control Systems António Pedro Aguiar pedro@isr.ist.utl.pt 3. Fundamental properties IST-DEEC PhD Course http://users.isr.ist.utl.pt/%7epedro/ncs2012/ 2012 1 Example Consider the system ẋ = f
More informationBasic Concepts in Data Reconciliation. Chapter 6: Steady-State Data Reconciliation with Model Uncertainties
Chapter 6: Steady-State Data with Model Uncertainties CHAPTER 6 Steady-State Data with Model Uncertainties 6.1 Models with Uncertainties In the previous chapters, the models employed in the DR were considered
More informationPROBABILISTIC REASONING OVER TIME
PROBABILISTIC REASONING OVER TIME In which we try to interpret the present, understand the past, and perhaps predict the future, even when very little is crystal clear. Outline Time and uncertainty Inference:
More informationOrganization. I MCMC discussion. I project talks. I Lecture.
Organization I MCMC discussion I project talks. I Lecture. Content I Uncertainty Propagation Overview I Forward-Backward with an Ensemble I Model Reduction (Intro) Uncertainty Propagation in Causal Systems
More informationTopic 3: Fourier Series (FS)
ELEC264: Signals And Systems Topic 3: Fourier Series (FS) o o o o Introduction to frequency analysis of signals CT FS Fourier series of CT periodic signals Signal Symmetry and CT Fourier Series Properties
More informationLinear Discrete-time State Space Realization of a Modified Quadruple Tank System with State Estimation using Kalman Filter
Journal of Physics: Conference Series PAPER OPEN ACCESS Linear Discrete-time State Space Realization of a Modified Quadruple Tank System with State Estimation using Kalman Filter To cite this article:
More information2D Image Processing. Bayes filter implementation: Kalman filter
2D Image Processing Bayes filter implementation: Kalman filter Prof. Didier Stricker Kaiserlautern University http://ags.cs.uni-kl.de/ DFKI Deutsches Forschungszentrum für Künstliche Intelligenz http://av.dfki.de
More informationThe Scaled Unscented Transformation
The Scaled Unscented Transformation Simon J. Julier, IDAK Industries, 91 Missouri Blvd., #179 Jefferson City, MO 6519 E-mail:sjulier@idak.com Abstract This paper describes a generalisation of the unscented
More informationAdvanced Computational Methods in Statistics: Lecture 5 Sequential Monte Carlo/Particle Filtering
Advanced Computational Methods in Statistics: Lecture 5 Sequential Monte Carlo/Particle Filtering Axel Gandy Department of Mathematics Imperial College London http://www2.imperial.ac.uk/~agandy London
More informationGaussian Processes for Audio Feature Extraction
Gaussian Processes for Audio Feature Extraction Dr. Richard E. Turner (ret26@cam.ac.uk) Computational and Biological Learning Lab Department of Engineering University of Cambridge Machine hearing pipeline
More informationUWB Geolocation Techniques for IEEE a Personal Area Networks
MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com UWB Geolocation Techniques for IEEE 802.15.4a Personal Area Networks Sinan Gezici Zafer Sahinoglu TR-2004-110 August 2004 Abstract A UWB positioning
More informationLinear-Optimal State Estimation
Linear-Optimal State Estimation Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 218 Linear-optimal Gaussian estimator for discrete-time system (Kalman filter) 2 nd -order example
More informationAn insight into noise covariance estimation for Kalman filter design
Preprints of the 19th World Congress The International Federation of Automatic Control An insight into noise covariance estimation for Kalman filter design Simone Formentin, Sergio Bittanti (IFAC Fellow)
More informationAnalytical Non-Linear Uncertainty Propagation: Theory And Implementation
Analytical Non-Linear Uncertainty Propagation: Theory And Implementation Kohei Fujimoto 1), Daniel J. Scheeres 2), and K. Terry Alfriend 1) May 13, 2013 1) Texas A&M University 2) The University of Colorado
More informationLecture 10 Linear Quadratic Stochastic Control with Partial State Observation
EE363 Winter 2008-09 Lecture 10 Linear Quadratic Stochastic Control with Partial State Observation partially observed linear-quadratic stochastic control problem estimation-control separation principle
More informationStochastic Models, Estimation and Control Peter S. Maybeck Volumes 1, 2 & 3 Tables of Contents
Navtech Part #s Volume 1 #1277 Volume 2 #1278 Volume 3 #1279 3 Volume Set #1280 Stochastic Models, Estimation and Control Peter S. Maybeck Volumes 1, 2 & 3 Tables of Contents Volume 1 Preface Contents
More information