Sequential State Estimation (Crassidas and Junkins, Chapter 5)

Size: px
Start display at page:

Download "Sequential State Estimation (Crassidas and Junkins, Chapter 5)"

Transcription

1 Sequential State Estimation (Crassidas and Junkins, Chapter 5) Please read: 5.1, The Discrete-Time Kalman Filter The discrete-time Kalman filter is used when the dynamics and measurements are modeled using discrete difference equations and discrete algebraic equations. Design Model x k+1 = Φ k x k + Γ k u k + Υ k w k, w k N(0, Q k ) ỹ k = H k x k + v k, v k N(0, R k ) Initialization ˆP 0 = E[(x 0 ˆx 0 )(x 0 ˆx 0 ) T ] Kalman Gain Update Equations K k = P k HT k [H k P k HT k + R k ] 1 ˆx + k = ˆx k + K k[ỹ k H kˆx k ] P + k = [I K kh k ]P k Propagation Equations ˆx k+1 = Φ kˆx k + Γ k u k P k+1 = Φ k P k Φ T k + Υ k Q k Υ T k A slightly modified version of the above equations can be used when measurement noise is correlated to the process noise. The modifications are given in Section 5.3.5, Table

2 5.3.4 The Steady-State Discrete-Time Kalman Filter An alternate way to write down the previous discrete-time Kalman filter is to substitute the update equations directly into the propagation equations. This results in the following alternative form for the discrete-time Kalman filter Design Model x k+1 = Φ k x k + Γ k u k + Υ k w k, w k N(0, Q k ) ỹ k = H k x k + v k, v k N(0, R k ) Initialization Kalman Gain ˆP 0 = E[(x 0 ˆx 0 )(x 0 ˆx 0 ) T ] K k = P k H T k [H k P k H T k + R k ] 1 Calculate Covariance P k+1 = Φ k P k Φ T k Φ k P k H T k [H k P k H T k + R k ]H k P k Φ T k + Υ k Q k Υ T k Estimate State ˆx + k = ˆx k + Γ ku k + Φ k K k [ỹ k H kˆx k ] When the system above is time-invariant (i.e. Φ k = Φ, Γ k = Γ, Υ k = Υ, H k = H, Q k = Q, and R k = R), a steady state discrete time Kalman filter can be used Design Model Initialization Kalman Gain x k+1 = Φx k + Γu k + Υw k, w k N(0, Q) ỹ k = Hx k + v k, v k N(0, R) K = P H T [HP H T + R] 1 Calculate Covariance P = ΦP Φ T ΦP H T [HP H T + R] 1 HP Φ T + ΥQΥ T Estimate State ˆx k+1 = Φˆx k + Γ k u k + ΦK[ỹ k H ˆx k ] 2

3 5.4 The Continuous-Time Kalman Filter The continuous-time Kalman filter is used when the dynamics and the measurements are modeled using continuous differential and algebraic equations. Design Model ẋ = F (t)x(t) + B(t)u(t) + G(t)w(t), w(t) N(0, Q(t)) ỹ(t) = H(t)x(t) + v(t), v(t) N(0, R(t)) Initialization ˆP 0 = E[(x 0 ˆx 0 )(x 0 ˆx 0 ) T ] Kalman Gain K(t) = P (t)h(t) T R(t) 1 Covariance Calculations P = F (t)p (t) + P (t)f T (t) P (t)h T (t)r(t) 1 H(t)P (t) + G(t)Q(t)G T (t) State Estimation ˆx(t) = F (t)ˆx(t) + B(t)u(t) + K(t)[ỹ(t) H(t)ˆx(t)] A slightly modified version of the above equations can be used when measurement noise is correlated to the process noise. The modifications are given in Section 5.4.5, Table

4 5.4 The Steady-State Continuous-Time Kalman Filter When the system above is time-invariant (i.e. F (t) = F, B(t) = B, G(t) = G, H(t) = H, Q(t) = Q, and R(t) = R), a steady state discrete time Kalman filter can be used Design Model ẋ = F x(t) + Bu(t) + Gw(t), w(t) N(0, Q) ỹ(t) = Hx(t) + v(t), v(t) N(0, R) Initialization Kalman Gain K(t) = P H T R 1 Covariance Calculations 0 = F P + P F T P H T R 1 HP + GQG T State Estimation ˆx(t) = F ˆx(t) + Bu(t) + K[ỹ(t) H ˆx(t)] 4

5 5.5 The Continuous-Discrete Kalman Filter The continuous-discrete Kalman filter is used when the dynamics are are modeled using continuous differential equations and the measurements are modeled using discrete algebraic equations. Design Model ẋ = F (t)x(t) + B(t)u(t) + G(t)w(t), w(t) N(0, Q(t)) ỹ k = H k x k + v k, v k N(0, R k ) Initialization ˆP 0 = E[(x 0 ˆx 0 )(x 0 ˆx 0 ) T ] Kalman Gain K k = P k HT k [H k P k HT k + R k ] 1 State and Covariance Update Equations ˆx + k = ˆx k + K k[ỹ k H kˆx k ] P + k = [I K kh k ]P k State and Covariance Propagation Equations P = F (t)p (t) + P (t)f T (t) + G(t)Q(t)G T (t) ˆx(t) = F (t)ˆx(t) + B(t)u(t) 5

6 5.5 The Extended Kalman Filter The continuous-time extended Kalman filter is used when the dynamics and the measurements are modeled using continuous differential and algebraic equations. Design Model ẋ = f(x(t), u(t), t) + G(t)w(t), w(t) N(0, Q(t)) ỹ(t) = h(x(t), t) + v(t), v(t) N(0, R(t)) Initialization Kalman Gain ˆP 0 = E[(x 0 ˆx 0 )(x 0 ˆx 0 ) T ] K(t) = P (t)h(ˆx(t), t) T R(t) 1 Covariance Calculations State Estimation P = F (ˆx(t), t)p (t) + P (t)f T (ˆx(t), t) P (t)h T (ˆx(t), t)r(t) 1 H(ˆx(t), t)p (t) + G(t)Q(t)G T (t) F (ˆx(t), t) = f, H(ˆx(t), t) = h x ˆx(t) x ˆx(t) ˆx(t) = f(ˆx(t), u(t), t) + K(t)[ỹ(t) H(ˆx(t), t)] 6

7 5.5 The Extended Kalman Filter(continued) The continuous-discrete extended Kalman filter is used when the dynamics and the measurements are modeled using continuous differential equations and the measurements are modeled using discrete algebraic equations. Design Model ẋ = f(x(t), u(t), t) + G(t)w(t), w(t) N(0, Q(t)) ỹ k = h k (x k ) + v k, v k N(0, R k ) Initialization ˆP 0 = E[(x 0 ˆx 0 )(x 0 ˆx 0 ) T ] Kalman Gain K k = P k HT k (ˆx k )[H k(ˆx k )P k HT k (ˆx k ) + R k] 1 H(ˆx k ) = h x State and Covariance Update Equations ˆx k ˆx + k = ˆx k + K k[ỹ k h k (ˆx k )] P + k = [I K kh k (ˆx k )]P k State and Covariance Propagation Equations ˆx(t) = f(ˆx(t), u(t), t) P = F (ˆx(t), t)p (t) + P (t)f T (ˆx(t), t) + G(t)Q(t)G T (t) F (ˆx(t), t) = f x ˆx(t) 7

8 Shaping Filters and Colored Noise Our standard dynamics and measurement models have been driven by white noise. ẋ = f(x(t), u(t), t) + G(t)w(t), w(t) N(0, Q(t)) ỹ k = h k (x k ) + v k, v k N(0, R k ) What if our dynamics or measurements were being driven by some other kind of error source, like colored noise, or biases? We can introduce a shaping filter which is a linear system driven by white noise. ẋ sf = A sf x sf + B sf w sf, w sf N(0, Q sf ) The output of the shaping filter is the colored noise y sf = H sf x sf To us the color noise in out model, we augment our dynamics with the shaping filter dynamics ẋ = f(x(t), u(t), t) + G(t)w(t), w(t) N(0, Q(t)) ẋ sf = A sf x sf + B sf w sf, w sf N(0, Q sf ) and add the colored noise where appropriate, for example to our measurement model. ỹ k = h k (x k ) + H sf x sf + v k, v k N(0, R k ) Now we have a a measurement model that is driven by more than just white noise. The outputs of the shaping filters can be added to dynamics model as well. Below is an example of adding a bias and two colored noise processes. The dynamics are given by ẋ = f(x(t), u(t), t) + G(t)w(t) + H sf1 x sf1, w(t) N(0, Q(t)) and the measurement are given by ẋ sf1 = A sf1 x sf1 + B sf1 w sf1, w sf1 N(0, Q sf1 ) ẋ sf2 = A sf2 x sf2 + B sf2 w sf2, w sf2 N(0, Q sf2 ) ẋ bias = 0 ỹ k = h k (x k ) + H sf2 x sf2 + x bias + v k, v k N(0, R k ) The most simple and useful colored noise process is a 1st-order Markov Process, also known as an Exponentially Correlated random Variable (ECRV). See class notes for more information. 8

9 Batch State Estimation for Dynamic Systems Batch state estimation for dynamic systems is often achieved with non-linear least squares techniques. For parameter estimation, the non-linear least squares is applied as follows. For dynamics systems we can use a similar approach where we let the parameter be the initial state. Then, the non-linear least squares method will find an initial state that creates a trajectory that will best the measurement data. The dynamics and measurement models are given by ẋ = f(x(t), t) ỹ k = h k (x k ) + v k, v k N(0, R k ) Using the estimate ˆx 0 of the initial state, we can integrate the following differential equations to obtain ˆx(t), and Φ(t, t 0 ). ˆx = f(ˆx(t), t), ˆx 0 = given Φ(t, t 0 ) = F (t)φ(t, t 0 ), Φ(t 0, t 0 ) = I F (t) = f, x ˆx(t) Recall that for any time t k, the transition matrix Φ(t k, t 0 ) relates trajectory perturbations at t 0 to trajectory perorations at time t k δx(t k ) = Φ(t k, t 0 )δx(t 0 ) Next, the measurement equation can be linearized about ˆx(t i ) ỹ k = h k (ˆx k ) + h δx(t k ) + v k x ˆx(tk ) Subtracting h k (ˆx k ) from both sides of the equation gives us δỹ k = ỹ k h k (ˆx k ) = h δx(t k ) + v k x ˆx(tk ) = h k, t 0 )δx(t 0 ) + v k x ˆx(tk )Φ(t δỹ k = H k δx(t 0 ) + v k 9

10 where H k = h Φ(t k, t 0 ) x ˆx(tk ) Now, we have a measurement equation in terms of a parameter δx(t 0 ) and can apply the method of least squares. For m measurements, we compute Σ = R = m k=1 m k=1 H k R 1 k HT k H k R 1 k δỹ k The new best estiamte of the intial state is given by ˆx(t 0 ) = ˆx(t 0 ) + δx(t 0 ) where δx(t 0 ) = Σ 1 R The process can be repeated with the new ˆx(t 0 ) until δx(t 0 ) converges to zero. 10

11

12

13

14

15

16

= m(0) + 4e 2 ( 3e 2 ) 2e 2, 1 (2k + k 2 ) dt. m(0) = u + R 1 B T P x 2 R dt. u + R 1 B T P y 2 R dt +

= m(0) + 4e 2 ( 3e 2 ) 2e 2, 1 (2k + k 2 ) dt. m(0) = u + R 1 B T P x 2 R dt. u + R 1 B T P y 2 R dt + ECE 553, Spring 8 Posted: May nd, 8 Problem Set #7 Solution Solutions: 1. The optimal controller is still the one given in the solution to the Problem 6 in Homework #5: u (x, t) = p(t)x k(t), t. The minimum

More information

Every real system has uncertainties, which include system parametric uncertainties, unmodeled dynamics

Every real system has uncertainties, which include system parametric uncertainties, unmodeled dynamics Sensitivity Analysis of Disturbance Accommodating Control with Kalman Filter Estimation Jemin George and John L. Crassidis University at Buffalo, State University of New York, Amherst, NY, 14-44 The design

More information

Extension of Farrenkopf Steady-State Solutions with Estimated Angular Rate

Extension of Farrenkopf Steady-State Solutions with Estimated Angular Rate Extension of Farrenopf Steady-State Solutions with Estimated Angular Rate Andrew D. Dianetti and John L. Crassidis University at Buffalo, State University of New Yor, Amherst, NY 46-44 Steady-state solutions

More information

Kalman Filter and Parameter Identification. Florian Herzog

Kalman Filter and Parameter Identification. Florian Herzog Kalman Filter and Parameter Identification Florian Herzog 2013 Continuous-time Kalman Filter In this chapter, we shall use stochastic processes with independent increments w 1 (.) and w 2 (.) at the input

More information

Adaptive State Estimation Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 2018

Adaptive State Estimation Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 2018 Adaptive State Estimation Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 218! Nonlinearity of adaptation! Parameter-adaptive filtering! Test for whiteness of the residual!

More information

SYSTEMTEORI - KALMAN FILTER VS LQ CONTROL

SYSTEMTEORI - KALMAN FILTER VS LQ CONTROL SYSTEMTEORI - KALMAN FILTER VS LQ CONTROL 1. Optimal regulator with noisy measurement Consider the following system: ẋ = Ax + Bu + w, x(0) = x 0 where w(t) is white noise with Ew(t) = 0, and x 0 is a stochastic

More information

Stochastic Optimal Control!

Stochastic Optimal Control! Stochastic Control! Robert Stengel! Robotics and Intelligent Systems, MAE 345, Princeton University, 2015 Learning Objectives Overview of the Linear-Quadratic-Gaussian (LQG) Regulator Introduction to Stochastic

More information

1 Kalman Filter Introduction

1 Kalman Filter Introduction 1 Kalman Filter Introduction You should first read Chapter 1 of Stochastic models, estimation, and control: Volume 1 by Peter S. Maybec (available here). 1.1 Explanation of Equations (1-3) and (1-4) Equation

More information

The Kalman filter. Chapter 6

The Kalman filter. Chapter 6 Chapter 6 The Kalman filter In the last chapter, we saw that in Data Assimilation, we ultimately desire knowledge of the full a posteriori p.d.f., that is the conditional p.d.f. of the state given the

More information

Steady State Kalman Filter

Steady State Kalman Filter Steady State Kalman Filter Infinite Horizon LQ Control: ẋ = Ax + Bu R positive definite, Q = Q T 2Q 1 2. (A, B) stabilizable, (A, Q 1 2) detectable. Solve for the positive (semi-) definite P in the ARE:

More information

9 Multi-Model State Estimation

9 Multi-Model State Estimation Technion Israel Institute of Technology, Department of Electrical Engineering Estimation and Identification in Dynamical Systems (048825) Lecture Notes, Fall 2009, Prof. N. Shimkin 9 Multi-Model State

More information

Advanced Mechatronics Engineering

Advanced Mechatronics Engineering Advanced Mechatronics Engineering German University in Cairo 21 December, 2013 Outline Necessary conditions for optimal input Example Linear regulator problem Example Necessary conditions for optimal input

More information

Development of an Extended Operational States Observer of a Power Assist Wheelchair

Development of an Extended Operational States Observer of a Power Assist Wheelchair Development of an Extended Operational States Observer of a Power Assist Wheelchair Sehoon Oh Institute of Industrial Science Universit of Toko 4-6-, Komaba, Meguro, Toko, 53-855 Japan sehoon@horilab.iis.u-toko.ac.jp

More information

Kalman Filters with Uncompensated Biases

Kalman Filters with Uncompensated Biases Kalman Filters with Uncompensated Biases Renato Zanetti he Charles Stark Draper Laboratory, Houston, exas, 77058 Robert H. Bishop Marquette University, Milwaukee, WI 53201 I. INRODUCION An underlying assumption

More information

EE 565: Position, Navigation, and Timing

EE 565: Position, Navigation, and Timing EE 565: Position, Navigation, and Timing Kalman Filtering Example Aly El-Osery Kevin Wedeward Electrical Engineering Department, New Mexico Tech Socorro, New Mexico, USA In Collaboration with Stephen Bruder

More information

I. INTRODUCTION /01/$10.00 c 2001 IEEE IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS VOL. 37, NO. 1 JANUARY

I. INTRODUCTION /01/$10.00 c 2001 IEEE IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS VOL. 37, NO. 1 JANUARY Correspondence Comparison of Two Measurement Fusion Methods for Kalman-Filter-Based Multisensor Data Fusion Currently there exist two commonly used measurement fusion methods for Kalman-filter-based multisensor

More information

Kalman filter using the orthogonality principle

Kalman filter using the orthogonality principle Appendix G Kalman filter using the orthogonality principle This appendix presents derivation steps for obtaining the discrete Kalman filter equations using a method based on the orthogonality principle.

More information

Aalborg Universitet. Wind turbine state estimation Knudsen, Torben. Publication date: Document Version Early version, also known as pre-print

Aalborg Universitet. Wind turbine state estimation Knudsen, Torben. Publication date: Document Version Early version, also known as pre-print Aalborg Universitet Wind turbine state estimation Knudsen, Torben Publication date: 24 Document Version Early version, also known as pre-print Link to publication from Aalborg University Citation for published

More information

Model Based Smoothing of Linear and Nonlinear Processes. Arthur J. Krener Department of Mathematics University of California Davis, CA, 95616, USA

Model Based Smoothing of Linear and Nonlinear Processes. Arthur J. Krener Department of Mathematics University of California Davis, CA, 95616, USA . Model Based Smoothing of Linear and Nonlinear Processes Arthur J. Krener Department of Mathematics University of California Davis, CA, 95616, USA ajkrener@ucdavis.edu 1 Dynamic Models We assume that

More information

A Crash Course on Kalman Filtering

A Crash Course on Kalman Filtering A Crash Course on Kalman Filtering Dan Simon Cleveland State University Fall 2014 1 / 64 Outline Linear Systems Probability State Means and Covariances Least Squares Estimation The Kalman Filter Unknown

More information

A Tutorial on Recursive methods in Linear Least Squares Problems

A Tutorial on Recursive methods in Linear Least Squares Problems A Tutorial on Recursive methods in Linear Least Squares Problems by Arvind Yedla 1 Introduction This tutorial motivates the use of Recursive Methods in Linear Least Squares problems, specifically Recursive

More information

The Convergence of the Minimum Energy Estimator

The Convergence of the Minimum Energy Estimator The Convergence of the Minimum Energy Estimator Arthur J. Krener Department of Mathematics, University of California, Davis, CA 95616-8633, USA, ajkrener@ucdavis.edu Summary. We show that under suitable

More information

RECURSIVE ESTIMATION AND KALMAN FILTERING

RECURSIVE ESTIMATION AND KALMAN FILTERING Chapter 3 RECURSIVE ESTIMATION AND KALMAN FILTERING 3. The Discrete Time Kalman Filter Consider the following estimation problem. Given the stochastic system with x k+ = Ax k + Gw k (3.) y k = Cx k + Hv

More information

STATISTICAL ORBIT DETERMINATION

STATISTICAL ORBIT DETERMINATION STATISTICAL ORBIT DETERMINATION Satellite Tracking Example of SNC and DMC ASEN 5070 LECTURE 6 4.08.011 1 We will develop a simple state noise compensation (SNC) algorithm. This algorithm adds process noise

More information

Parameter Estimation and Adaptive Modeling Studies in Ocean Mixing. Eric Vincent Heubel

Parameter Estimation and Adaptive Modeling Studies in Ocean Mixing. Eric Vincent Heubel Multidisciplinary Simulation, Estimation, and Assimilation Systems Reports in Ocean Science and Engineering MSEAS-1 Parameter Estimation and Adaptive Modeling Studies in Ocean Mixing by Eric Vincent Heubel

More information

Lecture 7: Optimal Smoothing

Lecture 7: Optimal Smoothing Department of Biomedical Engineering and Computational Science Aalto University March 17, 2011 Contents 1 What is Optimal Smoothing? 2 Bayesian Optimal Smoothing Equations 3 Rauch-Tung-Striebel Smoother

More information

Nonlinear State Estimation! Extended Kalman Filters!

Nonlinear State Estimation! Extended Kalman Filters! Nonlinear State Estimation! Extended Kalman Filters! Robert Stengel! Optimal Control and Estimation, MAE 546! Princeton University, 2017!! Deformation of the probability distribution!! Neighboring-optimal

More information

Linear Discrete-time State Space Realization of a Modified Quadruple Tank System with State Estimation using Kalman Filter

Linear Discrete-time State Space Realization of a Modified Quadruple Tank System with State Estimation using Kalman Filter Journal of Physics: Conference Series PAPER OPEN ACCESS Linear Discrete-time State Space Realization of a Modified Quadruple Tank System with State Estimation using Kalman Filter To cite this article:

More information

Real-time Attitude Estimation Techniques Applied to a Four Rotor Helicopter

Real-time Attitude Estimation Techniques Applied to a Four Rotor Helicopter 43rd IEEE Conference on Decision and Control December 14-17, 4 Atlantis, Paradise Island, Bahamas ThC9.3 Real- Attitude Estimation Techniques Applied to a Four Rotor Helicopter Matthew G. Earl and Raffaello

More information

Optimal Decentralized Control with. Asymmetric One-Step Delayed Information Sharing

Optimal Decentralized Control with. Asymmetric One-Step Delayed Information Sharing Optimal Decentralized Control with 1 Asymmetric One-Step Delayed Information Sharing Naumaan Nayyar, Dileep Kalathil and Rahul Jain Abstract We consider optimal control of decentralized LQG problems for

More information

Kalman Filter. Predict: Update: x k k 1 = F k x k 1 k 1 + B k u k P k k 1 = F k P k 1 k 1 F T k + Q

Kalman Filter. Predict: Update: x k k 1 = F k x k 1 k 1 + B k u k P k k 1 = F k P k 1 k 1 F T k + Q Kalman Filter Kalman Filter Predict: x k k 1 = F k x k 1 k 1 + B k u k P k k 1 = F k P k 1 k 1 F T k + Q Update: K = P k k 1 Hk T (H k P k k 1 Hk T + R) 1 x k k = x k k 1 + K(z k H k x k k 1 ) P k k =(I

More information

Space Surveillance with Star Trackers. Part II: Orbit Estimation

Space Surveillance with Star Trackers. Part II: Orbit Estimation AAS -3 Space Surveillance with Star Trackers. Part II: Orbit Estimation Ossama Abdelkhalik, Daniele Mortari, and John L. Junkins Texas A&M University, College Station, Texas 7783-3 Abstract The problem

More information

Time Series Analysis

Time Series Analysis Time Series Analysis hm@imm.dtu.dk Informatics and Mathematical Modelling Technical University of Denmark DK-2800 Kgs. Lyngby 1 Outline of the lecture State space models, 1st part: Model: Sec. 10.1 The

More information

Lecture 2: From Linear Regression to Kalman Filter and Beyond

Lecture 2: From Linear Regression to Kalman Filter and Beyond Lecture 2: From Linear Regression to Kalman Filter and Beyond Department of Biomedical Engineering and Computational Science Aalto University January 26, 2012 Contents 1 Batch and Recursive Estimation

More information

STATE OBSERVERS FOR NONLINEAR SYSTEMS WITH SMOOTH/BOUNDED INPUT 1

STATE OBSERVERS FOR NONLINEAR SYSTEMS WITH SMOOTH/BOUNDED INPUT 1 K Y B E R N E T I K A V O L U M E 3 5 ( 1 9 9 9 ), N U M B E R 4, P A G E S 3 9 3 4 1 3 STATE OBSERVERS FOR NONLINEAR SYSTEMS WITH SMOOTH/BOUNDED INPUT 1 Alfredo Germani and Costanzo Manes It is known

More information

Multi-Robot Active SLAM with Relative Entropy Optimization

Multi-Robot Active SLAM with Relative Entropy Optimization Multi-Robot Active SLAM with Relative Entropy Optimization Michail Kontitsis, Evangelos A. Theodorou and Emanuel Todorov 3 Abstract This paper presents a new approach for Active Simultaneous Localization

More information

On perturbations in the leading coefficient matrix of time-varying index-1 DAEs

On perturbations in the leading coefficient matrix of time-varying index-1 DAEs On perturbations in the leading coefficient matrix of time-varying index-1 DAEs Institute of Mathematics, Ilmenau University of Technology Darmstadt, March 27, 2012 Institute of Mathematics, Ilmenau University

More information

Least Squares Estimation Namrata Vaswani,

Least Squares Estimation Namrata Vaswani, Least Squares Estimation Namrata Vaswani, namrata@iastate.edu Least Squares Estimation 1 Recall: Geometric Intuition for Least Squares Minimize J(x) = y Hx 2 Solution satisfies: H T H ˆx = H T y, i.e.

More information

Übersetzungshilfe / Translation aid (English) To be returned at the end of the exam!

Übersetzungshilfe / Translation aid (English) To be returned at the end of the exam! Prüfung Regelungstechnik I (Control Systems I) Prof. Dr. Lino Guzzella 3.. 24 Übersetzungshilfe / Translation aid (English) To be returned at the end of the exam! Do not mark up this translation aid -

More information

An insight into noise covariance estimation for Kalman filter design

An insight into noise covariance estimation for Kalman filter design Preprints of the 19th World Congress The International Federation of Automatic Control An insight into noise covariance estimation for Kalman filter design Simone Formentin, Sergio Bittanti (IFAC Fellow)

More information

Outline. 1 Full information estimation. 2 Moving horizon estimation - zero prior weighting. 3 Moving horizon estimation - nonzero prior weighting

Outline. 1 Full information estimation. 2 Moving horizon estimation - zero prior weighting. 3 Moving horizon estimation - nonzero prior weighting Outline Moving Horizon Estimation MHE James B. Rawlings Department of Chemical and Biological Engineering University of Wisconsin Madison SADCO Summer School and Workshop on Optimal and Model Predictive

More information

Moving Horizon Estimation (MHE)

Moving Horizon Estimation (MHE) Moving Horizon Estimation (MHE) James B. Rawlings Department of Chemical and Biological Engineering University of Wisconsin Madison Insitut für Systemtheorie und Regelungstechnik Universität Stuttgart

More information

Lecture 19 Observability and state estimation

Lecture 19 Observability and state estimation EE263 Autumn 2007-08 Stephen Boyd Lecture 19 Observability and state estimation state estimation discrete-time observability observability controllability duality observers for noiseless case continuous-time

More information

The Kalman Filter ImPr Talk

The Kalman Filter ImPr Talk The Kalman Filter ImPr Talk Ged Ridgway Centre for Medical Image Computing November, 2006 Outline What is the Kalman Filter? State Space Models Kalman Filter Overview Bayesian Updating of Estimates Kalman

More information

2 Introduction of Discrete-Time Systems

2 Introduction of Discrete-Time Systems 2 Introduction of Discrete-Time Systems This chapter concerns an important subclass of discrete-time systems, which are the linear and time-invariant systems excited by Gaussian distributed stochastic

More information

Linear-Quadratic-Gaussian Controllers!

Linear-Quadratic-Gaussian Controllers! Linear-Quadratic-Gaussian Controllers! Robert Stengel! Optimal Control and Estimation MAE 546! Princeton University, 2017!! LTI dynamic system!! Certainty Equivalence and the Separation Theorem!! Asymptotic

More information

Lecture 10 Linear Quadratic Stochastic Control with Partial State Observation

Lecture 10 Linear Quadratic Stochastic Control with Partial State Observation EE363 Winter 2008-09 Lecture 10 Linear Quadratic Stochastic Control with Partial State Observation partially observed linear-quadratic stochastic control problem estimation-control separation principle

More information

ME 132, Fall 2015, Quiz # 2

ME 132, Fall 2015, Quiz # 2 ME 132, Fall 2015, Quiz # 2 # 1 # 2 # 3 # 4 # 5 # 6 Total NAME 14 10 8 6 14 8 60 Rules: 1. 2 sheets of notes allowed, 8.5 11 inches. Both sides can be used. 2. Calculator is allowed. Keep it in plain view

More information

4 Derivations of the Discrete-Time Kalman Filter

4 Derivations of the Discrete-Time Kalman Filter Technion Israel Institute of Technology, Department of Electrical Engineering Estimation and Identification in Dynamical Systems (048825) Lecture Notes, Fall 2009, Prof N Shimkin 4 Derivations of the Discrete-Time

More information

Modeling nonlinear systems using multiple piecewise linear equations

Modeling nonlinear systems using multiple piecewise linear equations Nonlinear Analysis: Modelling and Control, 2010, Vol. 15, No. 4, 451 458 Modeling nonlinear systems using multiple piecewise linear equations G.K. Lowe, M.A. Zohdy Department of Electrical and Computer

More information

DISTRIBUTED ORBIT DETERMINATION VIA ESTIMATION CONSENSUS

DISTRIBUTED ORBIT DETERMINATION VIA ESTIMATION CONSENSUS AAS 11-117 DISTRIBUTED ORBIT DETERMINATION VIA ESTIMATION CONSENSUS Ran Dai, Unsik Lee, and Mehran Mesbahi This paper proposes an optimal algorithm for distributed orbit determination by using discrete

More information

State estimation and the Kalman filter

State estimation and the Kalman filter State estimation and the Kalman filter PhD, David Di Ruscio Telemark university college Department of Technology Systems and Control Engineering N-3914 Porsgrunn, Norway Fax: +47 35 57 52 50 Tel: +47 35

More information

Regularity and approximations of generalized equations; applications in optimal control

Regularity and approximations of generalized equations; applications in optimal control SWM ORCOS Operations Research and Control Systems Regularity and approximations of generalized equations; applications in optimal control Vladimir M. Veliov (Based on joint works with A. Dontchev, M. Krastanov,

More information

Homework: Ball Predictor for Robot Soccer

Homework: Ball Predictor for Robot Soccer Homework: Ball Predictor for Robot Soccer ECEn 483 November 17, 2004 1 Introduction The objective of this homework is to prepare you to implement a ball predictor in the lab An extended Kalman filter will

More information

Lecture 1: Pragmatic Introduction to Stochastic Differential Equations

Lecture 1: Pragmatic Introduction to Stochastic Differential Equations Lecture 1: Pragmatic Introduction to Stochastic Differential Equations Simo Särkkä Aalto University, Finland (visiting at Oxford University, UK) November 13, 2013 Simo Särkkä (Aalto) Lecture 1: Pragmatic

More information

Lecture 2: From Linear Regression to Kalman Filter and Beyond

Lecture 2: From Linear Regression to Kalman Filter and Beyond Lecture 2: From Linear Regression to Kalman Filter and Beyond January 18, 2017 Contents 1 Batch and Recursive Estimation 2 Towards Bayesian Filtering 3 Kalman Filter and Bayesian Filtering and Smoothing

More information

Least Squares and Kalman Filtering Questions: me,

Least Squares and Kalman Filtering Questions:  me, Least Squares and Kalman Filtering Questions: Email me, namrata@ece.gatech.edu Least Squares and Kalman Filtering 1 Recall: Weighted Least Squares y = Hx + e Minimize Solution: J(x) = (y Hx) T W (y Hx)

More information

Final Exam Solutions

Final Exam Solutions EE55: Linear Systems Final Exam SIST, ShanghaiTech Final Exam Solutions Course: Linear Systems Teacher: Prof. Boris Houska Duration: 85min YOUR NAME: (type in English letters) I Introduction This exam

More information

Topic # Feedback Control Systems

Topic # Feedback Control Systems Topic #17 16.31 Feedback Control Systems Deterministic LQR Optimal control and the Riccati equation Weight Selection Fall 2007 16.31 17 1 Linear Quadratic Regulator (LQR) Have seen the solutions to the

More information

Extension of minimum variance estimation for systems with unknown inputs

Extension of minimum variance estimation for systems with unknown inputs Extension of minimum variance estimation for systems with unknown inputs Mohamed Darouach, Michel Zasadzinski, Mohamed Boutayeb To cite this version: Mohamed Darouach, Michel Zasadzinski, Mohamed Boutayeb.

More information

Application of state observers in attitude estimation using low-cost sensors

Application of state observers in attitude estimation using low-cost sensors Application of state observers in attitude estimation using low-cost sensors Martin Řezáč Czech Technical University in Prague, Czech Republic March 26, 212 Introduction motivation for inertial estimation

More information

Geometric Optimal Control with Applications

Geometric Optimal Control with Applications Geometric Optimal Control with Applications Accelerated Graduate Course Institute of Mathematics for Industry, Kyushu University, Bernard Bonnard Inria Sophia Antipolis et Institut de Mathématiques de

More information

Lecture 6: Multiple Model Filtering, Particle Filtering and Other Approximations

Lecture 6: Multiple Model Filtering, Particle Filtering and Other Approximations Lecture 6: Multiple Model Filtering, Particle Filtering and Other Approximations Department of Biomedical Engineering and Computational Science Aalto University April 28, 2010 Contents 1 Multiple Model

More information

Dynamic measurement: application of system identification in metrology

Dynamic measurement: application of system identification in metrology 1 / 25 Dynamic measurement: application of system identification in metrology Ivan Markovsky Dynamic measurement takes into account the dynamical properties of the sensor 2 / 25 model of sensor as dynamical

More information

6 OUTPUT FEEDBACK DESIGN

6 OUTPUT FEEDBACK DESIGN 6 OUTPUT FEEDBACK DESIGN When the whole sate vector is not available for feedback, i.e, we can measure only y = Cx. 6.1 Review of observer design Recall from the first class in linear systems that a simple

More information

1. Find the solution of the following uncontrolled linear system. 2 α 1 1

1. Find the solution of the following uncontrolled linear system. 2 α 1 1 Appendix B Revision Problems 1. Find the solution of the following uncontrolled linear system 0 1 1 ẋ = x, x(0) =. 2 3 1 Class test, August 1998 2. Given the linear system described by 2 α 1 1 ẋ = x +

More information

Kalman Filter. Man-Wai MAK

Kalman Filter. Man-Wai MAK Kalman Filter Man-Wai MAK Dept. of Electronic and Information Engineering, The Hong Kong Polytechnic University enmwmak@polyu.edu.hk http://www.eie.polyu.edu.hk/ mwmak References: S. Gannot and A. Yeredor,

More information

Lecture 6: Bayesian Inference in SDE Models

Lecture 6: Bayesian Inference in SDE Models Lecture 6: Bayesian Inference in SDE Models Bayesian Filtering and Smoothing Point of View Simo Särkkä Aalto University Simo Särkkä (Aalto) Lecture 6: Bayesian Inference in SDEs 1 / 45 Contents 1 SDEs

More information

Observability and state estimation

Observability and state estimation EE263 Autumn 2015 S Boyd and S Lall Observability and state estimation state estimation discrete-time observability observability controllability duality observers for noiseless case continuous-time observability

More information

Empirical Gramians and Balanced Truncation for Model Reduction of Nonlinear Systems

Empirical Gramians and Balanced Truncation for Model Reduction of Nonlinear Systems Empirical Gramians and Balanced Truncation for Model Reduction of Nonlinear Systems Antoni Ras Departament de Matemàtica Aplicada 4 Universitat Politècnica de Catalunya Lecture goals To review the basic

More information

On Controllability of Linear Systems 1

On Controllability of Linear Systems 1 On Controllability of Linear Systems 1 M.T.Nair Department of Mathematics, IIT Madras Abstract In this article we discuss some issues related to the observability and controllability of linear systems.

More information

Intro. Computer Control Systems: F9

Intro. Computer Control Systems: F9 Intro. Computer Control Systems: F9 State-feedback control and observers Dave Zachariah Dept. Information Technology, Div. Systems and Control 1 / 21 dave.zachariah@it.uu.se F8: Quiz! 2 / 21 dave.zachariah@it.uu.se

More information

Vlad Estivill-Castro. Robots for People --- A project for intelligent integrated systems

Vlad Estivill-Castro. Robots for People --- A project for intelligent integrated systems 1 Vlad Estivill-Castro Robots for People --- A project for intelligent integrated systems V. Estivill-Castro 2 Probabilistic Map-based Localization (Kalman Filter) Chapter 5 (textbook) Based on textbook

More information

CALIFORNIA INSTITUTE OF TECHNOLOGY Control and Dynamical Systems. CDS 110b

CALIFORNIA INSTITUTE OF TECHNOLOGY Control and Dynamical Systems. CDS 110b CALIFORNIA INSTITUTE OF TECHNOLOGY Control and Dynamical Systems CDS 110b R. M. Murray Kalman Filters 25 January 2006 Reading: This set of lectures provides a brief introduction to Kalman filtering, following

More information

Linear-Quadratic-Gaussian (LQG) Controllers and Kalman Filters

Linear-Quadratic-Gaussian (LQG) Controllers and Kalman Filters Linear-Quadratic-Gaussian (LQG) Controllers and Kalman Filters Emo Todorov Applied Mathematics and Computer Science & Engineering University of Washington Winter 204 Emo Todorov (UW) AMATH/CSE 579, Winter

More information

Toward nonlinear tracking and rejection using LPV control

Toward nonlinear tracking and rejection using LPV control Toward nonlinear tracking and rejection using LPV control Gérard Scorletti, V. Fromion, S. de Hillerin Laboratoire Ampère (CNRS) MaIAGE (INRA) Fondation EADS International Workshop on Robust LPV Control

More information

ECE276A: Sensing & Estimation in Robotics Lecture 10: Gaussian Mixture and Particle Filtering

ECE276A: Sensing & Estimation in Robotics Lecture 10: Gaussian Mixture and Particle Filtering ECE276A: Sensing & Estimation in Robotics Lecture 10: Gaussian Mixture and Particle Filtering Lecturer: Nikolay Atanasov: natanasov@ucsd.edu Teaching Assistants: Siwei Guo: s9guo@eng.ucsd.edu Anwesan Pal:

More information

Integrodifferential Hyperbolic Equations and its Application for 2-D Rotational Fluid Flows

Integrodifferential Hyperbolic Equations and its Application for 2-D Rotational Fluid Flows Integrodifferential Hyperbolic Equations and its Application for 2-D Rotational Fluid Flows Alexander Chesnokov Lavrentyev Institute of Hydrodynamics Novosibirsk, Russia chesnokov@hydro.nsc.ru July 14,

More information

RECURSIVE IMPLEMENTATIONS OF THE SCHMIDT-KALMAN CONSIDER FILTER

RECURSIVE IMPLEMENTATIONS OF THE SCHMIDT-KALMAN CONSIDER FILTER RECURSIVE IMPLEMENTATIONS OF THE SCHMIDT-KALMAN CONSIDER FILTER Renato Zanetti and Christopher D Souza One method to account for parameters errors in the Kalman filter is to consider their effect in the

More information

Lecture 4: Numerical Solution of SDEs, Itô Taylor Series, Gaussian Process Approximations

Lecture 4: Numerical Solution of SDEs, Itô Taylor Series, Gaussian Process Approximations Lecture 4: Numerical Solution of SDEs, Itô Taylor Series, Gaussian Process Approximations Simo Särkkä Aalto University Tampere University of Technology Lappeenranta University of Technology Finland November

More information

MA 266 Review Topics - Exam # 2 (updated)

MA 266 Review Topics - Exam # 2 (updated) MA 66 Reiew Topics - Exam # updated Spring First Order Differential Equations Separable, st Order Linear, Homogeneous, Exact Second Order Linear Homogeneous with Equations Constant Coefficients The differential

More information

Statistics Homework #4

Statistics Homework #4 Statistics 910 1 Homework #4 Chapter 6, Shumway and Stoffer These are outlines of the solutions. If you would like to fill in other details, please come see me during office hours. 6.1 State-space representation

More information

Module 05 Introduction to Optimal Control

Module 05 Introduction to Optimal Control Module 05 Introduction to Optimal Control Ahmad F. Taha EE 5243: Introduction to Cyber-Physical Systems Email: ahmad.taha@utsa.edu Webpage: http://engineering.utsa.edu/ taha/index.html October 8, 2015

More information

ESTIMATION STRATEGIES FOR CONSTRAINED AND HYBRID DYNAMICAL SYSTEMS. A Dissertation JULIE MARIE JONES PARISH

ESTIMATION STRATEGIES FOR CONSTRAINED AND HYBRID DYNAMICAL SYSTEMS. A Dissertation JULIE MARIE JONES PARISH ESTIMATION STRATEGIES FOR CONSTRAINED AND HYBRID DYNAMICAL SYSTEMS A Dissertation by JULIE MARIE JONES PARISH Submitted to the Office of Graduate Studies of Texas A&M University in partial fulfillment

More information

Autonomous Underwater Vehicle Navigation

Autonomous Underwater Vehicle Navigation TECHNICAL REPORT 1968 February 2008 Autonomous Underwater Vehicle Navigation P. A. Miller SSC San Diego J. Farrell Y. Zhao V. Djapic University of California, Riverside Approved for public release; distribution

More information

Comparison of four state observer design algorithms for MIMO system

Comparison of four state observer design algorithms for MIMO system Archives of Control Sciences Volume 23(LIX), 2013 No. 2, pages 131 144 Comparison of four state observer design algorithms for MIMO system VINODH KUMAR. E, JOVITHA JEROME and S. AYYAPPAN A state observer

More information

Krylov Subspace Methods for Nonlinear Model Reduction

Krylov Subspace Methods for Nonlinear Model Reduction MAX PLANCK INSTITUT Conference in honour of Nancy Nichols 70th birthday Reading, 2 3 July 2012 Krylov Subspace Methods for Nonlinear Model Reduction Peter Benner and Tobias Breiten Max Planck Institute

More information

Observer Design for Nonlinear Systems

Observer Design for Nonlinear Systems Observer Design for Nonlinear Systems by Jürgen Pannek Lecture of G Besançon and G Bornant, EECi, 2005 Contents 1 Context and Motivation 3 2 Problem Formulation 5 21 Problem 5 22 Method for generating

More information

14 - Gaussian Stochastic Processes

14 - Gaussian Stochastic Processes 14-1 Gaussian Stochastic Processes S. Lall, Stanford 211.2.24.1 14 - Gaussian Stochastic Processes Linear systems driven by IID noise Evolution of mean and covariance Example: mass-spring system Steady-state

More information

Lecture 3: Functions of Symmetric Matrices

Lecture 3: Functions of Symmetric Matrices Lecture 3: Functions of Symmetric Matrices Yilin Mo July 2, 2015 1 Recap 1 Bayes Estimator: (a Initialization: (b Correction: f(x 0 Y 1 = f(x 0 f(x k Y k = αf(y k x k f(x k Y k 1, where ( 1 α = f(y k x

More information

Nonlinear Identification of Backlash in Robot Transmissions

Nonlinear Identification of Backlash in Robot Transmissions Nonlinear Identification of Backlash in Robot Transmissions G. Hovland, S. Hanssen, S. Moberg, T. Brogårdh, S. Gunnarsson, M. Isaksson ABB Corporate Research, Control Systems Group, Switzerland ABB Automation

More information

DATA FUSION III: Estimation Theory

DATA FUSION III: Estimation Theory DATA FUSION III: Estimation Theory Date: March 30, 2006 Time: 5:00 7:30 PM Location: B-300-2-3 (AAR-400) (Main Building, 2nd floor, near freight elevators) Instructor: Dr. James K Beard Credits: 1 Course

More information

Nonlinear Filtering. With Polynomial Chaos. Raktim Bhattacharya. Aerospace Engineering, Texas A&M University uq.tamu.edu

Nonlinear Filtering. With Polynomial Chaos. Raktim Bhattacharya. Aerospace Engineering, Texas A&M University uq.tamu.edu Nonlinear Filtering With Polynomial Chaos Raktim Bhattacharya Aerospace Engineering, Texas A&M University uq.tamu.edu Nonlinear Filtering with PC Problem Setup. Dynamics: ẋ = f(x, ) Sensor Model: ỹ = h(x)

More information

LQR, Kalman Filter, and LQG. Postgraduate Course, M.Sc. Electrical Engineering Department College of Engineering University of Salahaddin

LQR, Kalman Filter, and LQG. Postgraduate Course, M.Sc. Electrical Engineering Department College of Engineering University of Salahaddin LQR, Kalman Filter, and LQG Postgraduate Course, M.Sc. Electrical Engineering Department College of Engineering University of Salahaddin May 2015 Linear Quadratic Regulator (LQR) Consider a linear system

More information

Linear dynamical systems with inputs & outputs

Linear dynamical systems with inputs & outputs EE263 Autumn 215 S. Boyd and S. Lall Linear dynamical systems with inputs & outputs inputs & outputs: interpretations transfer function impulse and step responses examples 1 Inputs & outputs recall continuous-time

More information

ECE531 Lecture 11: Dynamic Parameter Estimation: Kalman-Bucy Filter

ECE531 Lecture 11: Dynamic Parameter Estimation: Kalman-Bucy Filter ECE531 Lecture 11: Dynamic Parameter Estimation: Kalman-Bucy Filter D. Richard Brown III Worcester Polytechnic Institute 09-Apr-2009 Worcester Polytechnic Institute D. Richard Brown III 09-Apr-2009 1 /

More information

Particle Filtered Modified-CS (PaFiMoCS) for tracking signal sequences

Particle Filtered Modified-CS (PaFiMoCS) for tracking signal sequences Particle Filtered Modified-CS (PaFiMoCS) for tracking signal sequences Samarjit Das and Namrata Vaswani Department of Electrical and Computer Engineering Iowa State University http://www.ece.iastate.edu/

More information

Index Theory and Periodic Solution of Delay Differential Systems

Index Theory and Periodic Solution of Delay Differential Systems Index Theory and Periodic Solution of Delay Differential Systems Liu Chungen School of Mathematics, Nankai University workshop on nonlinear PDE and calculus of variation, Chern Mathematical Institute 2013.9.16

More information

CALIFORNIA INSTITUTE OF TECHNOLOGY Control and Dynamical Systems. CDS 110b

CALIFORNIA INSTITUTE OF TECHNOLOGY Control and Dynamical Systems. CDS 110b CALIFORNIA INSTITUTE OF TECHNOLOGY Control and Dynamical Systems CDS 110b R. M. Murray Kalman Filters 14 January 2007 Reading: This set of lectures provides a brief introduction to Kalman filtering, following

More information

Statistics 910, #15 1. Kalman Filter

Statistics 910, #15 1. Kalman Filter Statistics 910, #15 1 Overview 1. Summary of Kalman filter 2. Derivations 3. ARMA likelihoods 4. Recursions for the variance Kalman Filter Summary of Kalman filter Simplifications To make the derivations

More information