Linear Gaussian State Space Models

Similar documents
State-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter

OBJECTIVES OF TIME SERIES ANALYSIS

Augmented Reality II - Kalman Filters - Gudrun Klinker May 25, 2004

Exponential Smoothing

Georey E. Hinton. University oftoronto. Technical Report CRG-TR February 22, Abstract

Lecture 3: Exponential Smoothing

Notes on Kalman Filtering

Linear Combinations of Volatility Forecasts for the WIG20 and Polish Exchange Rates

An recursive analytical technique to estimate time dependent physical parameters in the presence of noise processes

Estimation Uncertainty

Time series Decomposition method

3.1 More on model selection

Financial Econometrics Kalman Filter: some applications to Finance University of Evry - Master 2

Forecasting optimally

Smoothing. Backward smoother: At any give T, replace the observation yt by a combination of observations at & before T

Wisconsin Unemployment Rate Forecast Revisited

L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS. NA568 Mobile Robotics: Methods & Algorithms

Probabilistic Robotics

Testing for a Single Factor Model in the Multivariate State Space Framework

References are appeared in the last slide. Last update: (1393/08/19)

Distribution of Least Squares

Zürich. ETH Master Course: L Autonomous Mobile Robots Localization II

hen found from Bayes rule. Specically, he prior disribuion is given by p( ) = N( ; ^ ; r ) (.3) where r is he prior variance (we add on he random drif

Temporal probability models. Chapter 15, Sections 1 5 1

Two Popular Bayesian Estimators: Particle and Kalman Filters. McGill COMP 765 Sept 14 th, 2017

Applications in Industry (Extended) Kalman Filter. Week Date Lecture Title

Financial Econometrics Jeffrey R. Russell Midterm Winter 2009 SOLUTIONS

Diebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles

Introduction to Mobile Robotics

Maximum Likelihood Parameter Estimation in State-Space Models

Kalman filtering for maximum likelihood estimation given corrupted observations.

Recursive Least-Squares Fixed-Interval Smoother Using Covariance Information based on Innovation Approach in Linear Continuous Stochastic Systems

The complexity of climate model drifts

BOKDSGE: A DSGE Model for the Korean Economy

SEIF, EnKF, EKF SLAM. Pieter Abbeel UC Berkeley EECS

Institute for Mathematical Methods in Economics. University of Technology Vienna. Singapore, May Manfred Deistler

Temporal probability models

Data Assimilation. Alan O Neill National Centre for Earth Observation & University of Reading

Anno accademico 2006/2007. Davide Migliore

Affine term structure models

Modeling Economic Time Series with Stochastic Linear Difference Equations

Testing the Random Walk Model. i.i.d. ( ) r

Dynamic models for largedimensional. Yields on U.S. Treasury securities (3 months to 10 years) y t

Chapter 15. Time Series: Descriptive Analyses, Models, and Forecasting

Y, where. 1 Estimate St.error

CSE-473. A Gentle Introduction to Particle Filters

An EM algorithm for maximum likelihood estimation given corrupted observations. E. E. Holmes, National Marine Fisheries Service

Excel-Based Solution Method For The Optimal Policy Of The Hadley And Whittin s Exact Model With Arma Demand

Filtering Turbulent Signals Using Gaussian and non-gaussian Filters with Model Error

Chapter 5. Heterocedastic Models. Introduction to time series (2008) 1

Vector autoregression VAR. Case 1

Stochastic Signals and Systems

Recent Developments In Evolutionary Data Assimilation And Model Uncertainty Estimation For Hydrologic Forecasting Hamid Moradkhani

Lecture 10 - Model Identification

Kriging Models Predicting Atrazine Concentrations in Surface Water Draining Agricultural Watersheds

CS 4495 Computer Vision Tracking 1- Kalman,Gaussian

Types of Exponential Smoothing Methods. Simple Exponential Smoothing. Simple Exponential Smoothing

CptS 570 Machine Learning School of EECS Washington State University. CptS Machine Learning 1

(10) (a) Derive and plot the spectrum of y. Discuss how the seasonality in the process is evident in spectrum.

Hidden Markov Models

Robot Motion Model EKF based Localization EKF SLAM Graph SLAM

NBER Summer Institute Minicourse What s New in Econometrics: Time Series. Lecture 10. July 16, Forecast Assessment

Speaker Adaptation Techniques For Continuous Speech Using Medium and Small Adaptation Data Sets. Constantinos Boulis

Applied Time Series Notes White noise: e t mean 0, variance 5 2 uncorrelated Moving Average

CH Sean Han QF, NTHU, Taiwan BFS2010. (Joint work with T.-Y. Chen and W.-H. Liu)

Vectorautoregressive Model and Cointegration Analysis. Time Series Analysis Dr. Sevtap Kestel 1

Forecasting. Summary. Sample StatFolio: tsforecast.sgp. STATGRAPHICS Centurion Rev. 9/16/2013

Robert Kollmann. 6 September 2017

14 Autoregressive Moving Average Models

Ecological Archives E A1. Meghan A. Duffy, Spencer R. Hall, Carla E. Cáceres, and Anthony R. Ives.

Tracking. Announcements

Article from. Predictive Analytics and Futurism. July 2016 Issue 13

Data Fusion using Kalman Filter. Ioannis Rekleitis

EKF SLAM vs. FastSLAM A Comparison

EMS SCM joint meeting. On stochastic partial differential equations of parabolic type

Announcements. Recap: Filtering. Recap: Reasoning Over Time. Example: State Representations for Robot Localization. Particle Filtering

Time series model fitting via Kalman smoothing and EM estimation in TimeModels.jl

PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD

Lecture 10 Estimating Nonlinear Regression Models

Independent component analysis for nonminimum phase systems using H filters

m = 41 members n = 27 (nonfounders), f = 14 (founders) 8 markers from chromosome 19

Linear state-space models

PROC NLP Approach for Optimal Exponential Smoothing Srihari Jaganathan, Cognizant Technology Solutions, Newbury Park, CA.

Sequential Importance Resampling (SIR) Particle Filter

A Specification Test for Linear Dynamic Stochastic General Equilibrium Models

Copula-Based Factor Models for Multivariate Asset Returns

Volatility. Many economic series, and most financial series, display conditional volatility

III. Module 3. Empirical and Theoretical Techniques

Forecasting models for economic and environmental applications

Long Term Forecasting of El Niño Events via Dynamic Factor Simulations

GDP Advance Estimate, 2016Q4

Západočeská Univerzita v Plzni, Czech Republic and Groupe ESIEE Paris, France

Linear-Optimal Estimation for Continuous-Time Systems Robert Stengel Optimal Control and Estimation MAE 546 Princeton University, 2018

Modeling and Forecasting Volatility Autoregressive Conditional Heteroskedasticity Models. Economic Forecasting Anthony Tay Slide 1

V Time Varying Covariance and Correlation

REVIEW OF MAXIMUM LIKELIHOOD ESTIMATION

STAD57 Time Series Analysis. Lecture 17

STAD57 Time Series Analysis. Lecture 17

Tracking. Many slides adapted from Kristen Grauman, Deva Ramanan

ABSTRACT. Many Intelligent Transportation System (ITS) applications under the umbrella of

Transcription:

Linear Gaussian Sae Space Models Srucural Time Series Models Level and Trend Models Basic Srucural Model (BSM Dynamic Linear Models Sae Space Model Represenaion Level, Trend, and Seasonal Models Time Varying Regression Model Exensions Mulivariae Time Series Analysis Bayesian Time Series Analysis Time Series Daa Analysis Using R 1

Srucural Time Series Models Local level Model y v v N 1, ~ (0, v 1 w, w ~ N(0, w Local Trend Model y v v N 1, ~ (0, v 1 1 w,, w, ~ N(0, 1 w,, w, ~ N(0, Time Series Daa Analysis Using R

Srucural Time Series Models Basic Srucural Model (BSM y v v N 1 1, 1, ~ (0, v 1 1 w,, w, ~ N(0, 1 w,, w, ~ N(0, p1 1, j, 1 w,, w, ~ N(0, j, j,..., p1 j, j, 1 Forecasing yˆ a b s, 1,,..., n 1 1 p yˆ a hb s, h 1,,... p nh n n n nh p Time Series Daa Analysis Using R 3

Dynamic Linear Models Observaion Equaion y F v, v ~ iid N(0, V m1 m p p1 m1 m1 m1 mm Sae Equaion G w, w ~ iid N(0, W 1 p1 p p p1 p1 p1 p 1 p p Iniial Sae Disribuion ~ N( m, C 0 0 0 ' ' E( v0 E( w0 0 E v w ' ( s 0, m p s Time Series Daa Analysis Using R 4

Dynamic Linear Models Local Level Model y v v N, ~ (0, v 1 w, w ~ N(0, w Sae Space Model Represenaion y F v G w ( m 1, p 1 1, F 1, G 1, V, W v w Time Series Daa Analysis Using R 5

Dynamic Linear Models Local Trend Model y v v N, ~ (0, v 1 1 w,, w, ~ N(0, 1 w,, w, ~ N(0, Sae Space Model Represenaion y F v G w ( m 1, p 1 1 1 1, 0 1 w 1, 1 1 0, F 1 0, G, V v, W 0 1 0 w Time Series Daa Analysis Using R 6

Dynamic Linear Models Time Varying Regression Parameers y x v v N, ~ (0, v 1 w,, w, ~ N(0, 1 w,, w, ~ N(0, Sae Space Model Represenaion 1 0 y x v F x G V 0 1 1 1,, v 1 0 w 1, w, 0, w, W 0 1 w 1, w, 0 Time Series Daa Analysis Using R 7

Dynamic Linear Models Model Esimaion y F v { y} G 1 w Filering (filered esimae of E( I { y,..., y } 1 Smoohing (smoohed esimae of E( I { y,..., y } T 1 T Time Series Daa Analysis Using R 8

Model Esimaion The Kalman Filer is a se of recursion equaions for deermining he opimal esimaes of given I. The filer consiss of wo ses of equaions: Predicion Equaion Updae Equaion Using he following noaions m E( I opimal esimaor of based on I C E m m I MSE marix of m ' [( ( Time Series Daa Analysis Using R 9

Predicion Equaions Model Esimaion Given m -1 and C -1 a -1, he opimal predicor of and is MSE marix are m E( I G m 1 1 1 C E[( m ( m I G C G W ' ' 1 1 1 1 1 The corresponding opimal predicor of y a -1 is y E[ y I ] F m 1 1 1 The predicive error and is MSE marix are e y y y F m F ( m v 1 1 1 E e e Q FC F V ' ' ( 1 Time Series Daa Analysis Using R 10

Updae Equaions Model Esimaion When new observaion y become available, he opimal predicor m -1 and is MSE marix are updaed using m m C F Q ( y F m ' 1 1 1 1 m C F Q e ' 1 1 1 C C C F Q FC ' 1 1 1 1 Noe : K C F Q Kalman Gain Marix ' 1 1 Kalman Gain Marix gives he weigh on new informaion e in he updae equaion for m. Time Series Daa Analysis Using R 11

Kalman Smooher Model Esimaion Once all daa I T is observed, he opimal esimaors E( I T can be compued using he backwards Kalman smoohing recursions E( I m m C ( m G m * T T 1 T 1 E[( m ( m I C C ( C C C ' * *' T T T T 1 T 1 C C G C * ' 1 1 1 The algorihm sars by seing m T T = m T and C T T = C T and hen proceed backwards for = T-1,,1. Time Series Daa Analysis Using R 1

Maximum Likelihood Esimaion For a linear Gaussian sae space model, le y denoe he parameers of he model (embedded in he sysem marices F, G, V, and W. The predicion error decomposiion of he Gaussian log-likelihood funcion is y ~ N( F ( y m ( y, Q ( y 1 1 e ( y y y y F ( y m ( y ~ N(0, Q ( y 1 1 1/ 1 ' 1 f ( y 1; y ( Q ( y exp e ( y Q ( y e ( y T ln L( y y ln f ( y I ; y 1 1 NT 1 1 yˆ arg max ln L( y y MLE N N ' 1 ln( ln Q ( y e ( y Q ( y e ( y 1 1 y Time Series Daa Analysis Using R 13

Forecasing The Kalman filer predicion equaions produces insample 1-sep ahead forecass and MSE marices. Ou-of-sample h-sep ahead predicions and MSE marices can be compued from he predicion equaions by exending he daa se y 1,, y T wih a se of h missing values. When y is missing he Kalman filer reduces o he predicion sep so a sequence of h missing values a he end of he sample will produce a se of h-sep ahead forecass Time Series Daa Analysis Using R

Forecasing One-Sep Ahead Forecas a = p, p+1, yˆ a b s 1 1 p yˆ a b s 1 0 0 0 1 p yˆ a b s... 1 1 1 p yˆ a b s p p1 p1 p1 0 ˆ y 1 1 1 MAE mean( ˆ 1 MAPE 100 mean( ˆ / y MSE RMSE yˆ mean( ˆ 1 mean( ˆ 1 1 1 RMSPE mean ˆ y 100 [( 1 / 1 ] Time Series Daa Analysis Using R 15

Example 1 (Coninued China Shanghai Common Sock High Frequency Daily Index Monhly Index Time Series Trend, Seasonaliy Dynamic Linear Model Correlaion wih Exchange Rae? Time Series Daa Analysis Using R 16

Example Chinese Yuan vs. U.S. Dollar Exchange Rae Time Series Trend Inervenion Dynamic Linear Model Correlaion wih Sock Marke? ARMA Time Series Daa Analysis Using R 17