Lesson 2: Analysis of time series
|
|
- Imogene Cameron
- 5 years ago
- Views:
Transcription
1 Lesson 2: Analysis of time series
2 Time series Main aims of time series analysis choosing right model statistical testing forecast driving and optimalisation
3 Problems in analysis of time series time problems problems in methodology forecast problems
4 Problems with time choosing time points of observation - not too short intervals, but not too little points calendar - convention: 30 days (21 of them working) per month 360 days (252 of them working) standardization real number of days conventional number of days different scale during time (rising costs etc.)
5 Methodology Decomposition trend T t cyclic item C t season item S t residual (random) item E t Box-Jenkins method based on dependences among the observations (correlation analysis) basic models: moving averages MA(k): Y t = ɛ t + a 1 ɛ t a k ɛ t k auto-regression models AR(k): Y t = a 1 Y t a k Y t k + ɛ t
6 Forecast - point and interval forecast point forecast - one concrete value representing the best forecast (e.g. price of a given stock in 10 days will be EUR) interval forecast - confidence interval meaning that the future value will lie in this interval with given probability (e.g. 95%-interval for the price of a given stock in 10 days is (99.50,107.70))
7 Forecast in structural model or in the time series model? This problem occur when the values of the time series are given by two or more random values (e.g. financial portfolio consisting of more stocks) Forecast constructed from the driving values may differ from the forecast obtained by the series analysis our decision
8 Forecast - statical and dynamical forecast statical forecast - estimate Ŷt is constructed from the real values (e.g. Ŷ t = 0.78Y t 1 ) dynamical forecast - estimate Ŷt is constructed from the estimated values (e.g. Ŷ t = 0.78Ŷt 1) less precise used only in special cases, e.g. in the case of outlying or missing value Y t 1
9 Forecast - precision measures Definition Forecast error is defined as e t = Y t Ŷt. The most often used measures: sum of squared errors SSE = n+h (Y t Ŷt) 2 = n+1 n+h t=n+1 e 2 t mean squared error MSE = 1 h n+h t=n+1 (Y t Ŷt) 2 = 1 h n+h t=n+1 e 2 t
10 Forecast - precision measures root mean squared error RMSE = 1 h n+h (Y t Ŷt) 2 = 1 h n+h e 2 t t=n+1 t=n+1 mean absolute error MAE = 1 h n+h t=n+1 mean absolute percentage error MAP E = 100 h Y t Ŷt = 1 h n+h t=n+1 n+h t=n+1 Y t Ŷt Y t e t
11 I. Decomposition methods
12 items: Decomposition of the time series trend T t cyclic item C t season item S t residual (random) item E t usage: additive: Y t = T t + C t + S t + E t multiplicative: Y t = T t C t S t E t smoothed series: Y t = T t + C t + S t and Y t = T t C t S t, respectively
13 Trend in time series Subjective methods - graphical smoothing Mathematical curves possibility of mathematical forecast assumption: Y t = T t + E t
14 Constant trend Trend in time series T t = β 0, t = 1, 2,... estimation b 0 of β 0 : n b 0 = Ȳ = 1 n t=1 Y t forecast of future value: Ŷ T = b 0
15 Linear trend Trend in time series T t = β 0 + β 1 t, t = 1, 2,... estimations b 0, b 1 of β 0 and β 1 : least squares method (MLS) estimated values n t=1 b 1 = ty t n+1 n Y 2 t=1 t n(n 2 1) 12 forecast of future value: Ŷ T = b 0 + b 1 T, b 0 = Ȳ n + 1 b 1 2
16 Trend in time series Quadratic trend T t = β 0 + β 1 t + β 2 t 2, t = 1, 2,... estimation b 0, b 1 and b 2 of β 0, β 1 and β 2 : least squares forecast of future value: Ŷ T = b 0 + b 1 t + b 2 t 2
17 Trend in time series Exponential trend T t = αβ t, β > 0, t = 1, 2,..., i.e. T t+1 /T t = β if β > 1...rise, if β < 1...fall estimation a, b of α and β: 1. ln T t = ln α + t ln β linear trend 2. calculate estimation a and b of ln α and ln β 3. a = e a, b = e b forecast of future value: Ŷ T = ab T Remark Sometimes, we used weighted LSE with weights w t, i.e. a, b = argmin n t=1 w t(ln Y t ln α t ln β) 2.
18 Gompertz trend Trend in time series T t = exp{γ + αβ t }, β > 0, t = 1, 2,... model with α < 1 and 0 < β < 1: bounded above by γ in the time t = ln( α)/ ln β change inflection (from convex to concave) used for booms
19 Trend in time series - moving averages assumption: each part time series can be smoothed by a polynomial function y t is replaced by the smoothed value ŷ t given by a weighted average of 2m + 1 values around Y t Example: We want to smooth the series {Y t } by a polynomial function of the third order used 5 values, i.e. for all t, we look for the estimates b 0, b 1, b 2, b 3 = argmin 2 (Y τ= 2 t+τ β 0 β 1 τ β 2 τ 2 β 3 τ 3 ) 2. Solution: Ŷ t = b 0 = 1 35 ( 3Y t Y t Y t + 12Y t+1 + ( 3)Y t+2 ) = 1 35 ( 3, 12, 17, 12, 3)Y t
20 Moving averages - forecast 1. calculate also b 1, b 2, forecast in future time T n m+k = b 0 + b 1 k + b 2 k Example: In our example, we obtain ( b 1 = τy t+τ τ= 2 ) 2 τ 3 Y t+τ τ= 2 ( b 2 = 1 2 ) 2 τ 2 Y t+τ 2 Y t+τ 14 τ= 2 τ= 2 ( ) b 3 = τ 3 Y t+τ 17 τy t+τ 72 τ= 2 τ= 2
21 Moving averages - forecast Example: For k = 1, 2,... we have Ŷ n 2+k = b 0 + b 1 k + b 2 k 2 + b 3 k 3 = = 1 35 ( 3, 12, 17, 12, 3)Y n 2 + k 12 (1, 8, 0, 8, 1)Y n 2+ thus e.g. + k2 14 (2, 1, 2, 1, 2)Y n 2 + k3 12 ( 1, 2, 0, 2, 1)Y n 2, etc. Ŷ n+1 = Ŷn 2+3 = 1 5 ( 4, 11, 4, 14, 16)Y n 2
22 Moving averages Other types Simple averages: Ŷ t = 1 2m+1 m i= m Y t+i linear or constant trend Central averages: used when we need average from an even number of observation (12 month, 4 seasons etc.) Ȳ (2m) t = 1 4m (Y t m + 2Y t m Y t+m 1 + Y t+m )
23 Season item in time series Assumption: Y t = T t + S t + E t In order to do the previous analyses, we need to eliminate the season item S t. When having k seasons, the item S t consists of the season factors I 1,..., I k : for additive method we suppose I I k = 0, for multiplicative method we suppose I 1... I k = 1.
24 Additive method Season item in time series 1. Construct center averages Ȳ (2m) t (e.g. Ȳ (12) t ). 2. Set Yt = Y t Ȳ (2m) t (removing trend). 3. Calculate (non-centered) season factors Ii, i = 1,..., 2m as classical average of the values Yt corresponding to the i-th season. 4. Center the values I1,..., I2m by 5. Remove season item as when t is the i-th season. I i = I i Ī = I i I I2m. 2m Ŷ t = Y t I i,
25 Season item in time series Multiplicative method 1. Construct center averages Ȳ (2m) t (e.g. Ȳ (12) t ). 2. Set Yt = Y t /Ȳ (2m) t (removing trend). 3. Calculate (non-centered) season factors Ii, i = 1,..., 2m as classical average of the values Yt corresponding to the i-th season. 4. Center the values I1,..., I2m by 5. Remove season item as I i = I i Î = when t is the i-th season. I i 12 I 1... I 2m. Ŷ t = Y t I i,
26 II. Autocorrelation methods: Box-Jenkins methodology
27 Stationarity strict stationarity - the behavior of the time series is time-invariant, i.e. the joint distribution of (Y t1,..., Y tk ) is the same as the distribution of (Y t1 +h,..., Y tk +h) for arbitrary h. (weak) stationarity - for arbitrary s, t and h, we have EY t = µ and cov(y s, Y t ) = E(Y s µ)(y t µ) = cov(y s+h, Y t+h ), especially vary t = σ 2 Y = const. Remark We will assume weak stationary if it is not said otherwise.
28 Autocovariance and autocorrelation function Definition Autocovariance function (for a delay k) is defined as γ k = cov(y t, Y t k ), k =..., 1, 0, 1,.... Definition Autocorrelation function (for a delay k) is defined as ρ k = γ k γ 0, k =..., 1, 0, 1,.... Remark From weak stationarity, it holds that γ k = γ k.
29 Autocovariance and autocorrelation function - estimation Let n Ȳ = 1 n be the estimation of the mean value µ. Then estimation of the autocovariance function (for a delay k) is defined as c k = 1 n (Y t n k Ȳ )(Y t k Ȳ ), k = 0, 1,..., n 1, t=k+1 estimation of the autocorrelation function (for a delay k) is defined as r k = c k c 0, k = 0, 1,..., n 1. t=1 Y t
30 Breakpoint of autocorrelation function Definiton By the breakpoint of autocorrelation function we mean a point k 0 such that ρ k = 0 for all k > k 0. Bartlett approximation: If ρ k = 0 for all k > k 0, then r k N 0, 1 n ( k 0 j=1 r 2 j).
31 Partial autocorrelation function Definiton Partial autocorrelation function is defined as ρ kk = corr(y t, Y t k ) conditionally on the fixed known values Y t k+1,...,y t 1. Its estimation is given by r kk = r k k 1 r j=1 k 1,j r k j 1 k 1 r, j=1 k 1,j r j where r 11 = r 1 and r kj = r k 1,j r kk r k 1,k j for j = 1,..., k 1. 1 Quenouille approximation: Breakpoint k 0 is given by r kk N(0, ) n for k > k 0.
32 Process of moving averages MA(q) Warning! Different method than the moving averages from decomposition!!! Process MA(q) is defined as Y t = ɛ t + θ 1 ɛ t θ q ɛ t q, where θ 1,..., θ q are parameters and {ɛ t, t = 0, 1,..., n} is a white noise, i.e. a sequence of independent random variables with identical distribution N(0, σ 2 ).
33 Process of moving averages MA(q) Its main properties are: stationary µ = 0 and σ 2 Y = (1 + θ θ 2 q)σ 2 autocorrelation function ρ k = θ k + θ 1 θ k θ q k θ q 1 + θ θ 2 q for k = 1,..., q and ρ k = 0 for k > q.
34 Autoregression process AR(p) Process AR(p) is defined as Y t = φ 1 Y t φ p Y t p + ɛ t, where φ 1,..., φ p are parameters and {ɛ t, t = 0, 1,..., n} is a white noise.
35 Autoregression process AR(p) Its main properties are: stationary if for all roots x 1,..., x p of the equation 1 φ 1 x... φ p x p = 0, it holds that x 1 > 1,..., x p > 1 (in complex space) when stationary then µ = 0 and σy 2 = σ 2 /(1 φ 1 ρ 1... φ p ρ p ) autocorrelation function satisfies ρ k = φ 1 ρ k φ p ρ k p for k = 1,..., q and ρ k = 0 for k > q.
36 Mixed process ARMA(p,q) Process ARMA(p, q) is defined as Y t = φ 1 Y t φ p Y t p + ɛ t + θ 1 ɛ t θ q ɛ t q, where φ 1,..., φ p, θ 1,..., θ q are parameters and {ɛ t, t = 0, 1,..., n} is a white noise. When it is stationary then µ = 0 and autocorrelation function satisfies ρ k = φ 1 ρ k φ p ρ k p for k = 1,..., q and ρ k = 0 for k > q.
37 Model identification Shape of correlation functions AR(p) MA(q) ARMA(p,q) ρ k k 0 does not exist, k 0 = q k 0 does not exist, ρ k has U-shape ρ k has U-shape after q p values ρ kk k 0 = p k 0 does not exist, k 0 does not exist, ρ kk has U-shape ρ kk bounded by U-curve after q p values U-curve...curve of sinus type with decreasing amplitude, curve of decreasing geometrical series or their combination
38 Model identification Information criteria 1. Suppose ARMA(p, q) model. 2. Estimate the parameters for some grid of p and q. 3. Calculate (ˆp, ˆq) = argmina(k, l), where A(k, l) is a suitable criterium, e.g. A(k, l) = ˆσ k,l A(k, l) = ln ˆσ k,l + 2(k+l+1) A(k, l) = ln ˆσ k,l + n 2(k+l+1) ln n n
39 Estimating parameters from the relations among the parameters and the correlation functions, e.g. Yule-Walker equations: iterations ρ k = φ 1 ρ k φ p ρ k p, k = 1,..., p
40 stationarity control correlation functions properties of white noise Model control
41 Thank you for your attention! :-)
A time series is called strictly stationary if the joint distribution of every collection (Y t
5 Time series A time series is a set of observations recorded over time. You can think for example at the GDP of a country over the years (or quarters) or the hourly measurements of temperature over a
More informationReliability and Risk Analysis. Time Series, Types of Trend Functions and Estimates of Trends
Reliability and Risk Analysis Stochastic process The sequence of random variables {Y t, t = 0, ±1, ±2 } is called the stochastic process The mean function of a stochastic process {Y t} is the function
More informationModule 3. Descriptive Time Series Statistics and Introduction to Time Series Models
Module 3 Descriptive Time Series Statistics and Introduction to Time Series Models Class notes for Statistics 451: Applied Time Series Iowa State University Copyright 2015 W Q Meeker November 11, 2015
More informationUnivariate Time Series Analysis; ARIMA Models
Econometrics 2 Fall 24 Univariate Time Series Analysis; ARIMA Models Heino Bohn Nielsen of4 Outline of the Lecture () Introduction to univariate time series analysis. (2) Stationarity. (3) Characterizing
More informationAutoregressive Moving Average (ARMA) Models and their Practical Applications
Autoregressive Moving Average (ARMA) Models and their Practical Applications Massimo Guidolin February 2018 1 Essential Concepts in Time Series Analysis 1.1 Time Series and Their Properties Time series:
More informationChapter 4: Models for Stationary Time Series
Chapter 4: Models for Stationary Time Series Now we will introduce some useful parametric models for time series that are stationary processes. We begin by defining the General Linear Process. Let {Y t
More information3 Theory of stationary random processes
3 Theory of stationary random processes 3.1 Linear filters and the General linear process A filter is a transformation of one random sequence {U t } into another, {Y t }. A linear filter is a transformation
More informationChapter 6: Model Specification for Time Series
Chapter 6: Model Specification for Time Series The ARIMA(p, d, q) class of models as a broad class can describe many real time series. Model specification for ARIMA(p, d, q) models involves 1. Choosing
More informationEmpirical Market Microstructure Analysis (EMMA)
Empirical Market Microstructure Analysis (EMMA) Lecture 3: Statistical Building Blocks and Econometric Basics Prof. Dr. Michael Stein michael.stein@vwl.uni-freiburg.de Albert-Ludwigs-University of Freiburg
More information1 Linear Difference Equations
ARMA Handout Jialin Yu 1 Linear Difference Equations First order systems Let {ε t } t=1 denote an input sequence and {y t} t=1 sequence generated by denote an output y t = φy t 1 + ε t t = 1, 2,... with
More informationCovariance Stationary Time Series. Example: Independent White Noise (IWN(0,σ 2 )) Y t = ε t, ε t iid N(0,σ 2 )
Covariance Stationary Time Series Stochastic Process: sequence of rv s ordered by time {Y t } {...,Y 1,Y 0,Y 1,...} Defn: {Y t } is covariance stationary if E[Y t ]μ for all t cov(y t,y t j )E[(Y t μ)(y
More information6 NONSEASONAL BOX-JENKINS MODELS
6 NONSEASONAL BOX-JENKINS MODELS In this section, we will discuss a class of models for describing time series commonly referred to as Box-Jenkins models. There are two types of Box-Jenkins models, seasonal
More informationSome Time-Series Models
Some Time-Series Models Outline 1. Stochastic processes and their properties 2. Stationary processes 3. Some properties of the autocorrelation function 4. Some useful models Purely random processes, random
More informationIDENTIFICATION OF ARMA MODELS
IDENTIFICATION OF ARMA MODELS A stationary stochastic process can be characterised, equivalently, by its autocovariance function or its partial autocovariance function. It can also be characterised by
More informationSTAT Financial Time Series
STAT 6104 - Financial Time Series Chapter 4 - Estimation in the time Domain Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 1 / 46 Agenda 1 Introduction 2 Moment Estimates 3 Autoregressive Models (AR
More informationTime Series Analysis -- An Introduction -- AMS 586
Time Series Analysis -- An Introduction -- AMS 586 1 Objectives of time series analysis Data description Data interpretation Modeling Control Prediction & Forecasting 2 Time-Series Data Numerical data
More informationChapter 3 - Temporal processes
STK4150 - Intro 1 Chapter 3 - Temporal processes Odd Kolbjørnsen and Geir Storvik January 23 2017 STK4150 - Intro 2 Temporal processes Data collected over time Past, present, future, change Temporal aspect
More informationDiscrete time processes
Discrete time processes Predictions are difficult. Especially about the future Mark Twain. Florian Herzog 2013 Modeling observed data When we model observed (realized) data, we encounter usually the following
More informationUniversity of Oxford. Statistical Methods Autocorrelation. Identification and Estimation
University of Oxford Statistical Methods Autocorrelation Identification and Estimation Dr. Órlaith Burke Michaelmas Term, 2011 Department of Statistics, 1 South Parks Road, Oxford OX1 3TG Contents 1 Model
More informationLesson 9: Autoregressive-Moving Average (ARMA) models
Lesson 9: Autoregressive-Moving Average (ARMA) models Dipartimento di Ingegneria e Scienze dell Informazione e Matematica Università dell Aquila, umberto.triacca@ec.univaq.it Introduction We have seen
More informationTime Series: Theory and Methods
Peter J. Brockwell Richard A. Davis Time Series: Theory and Methods Second Edition With 124 Illustrations Springer Contents Preface to the Second Edition Preface to the First Edition vn ix CHAPTER 1 Stationary
More informationStat 5100 Handout #12.e Notes: ARIMA Models (Unit 7) Key here: after stationary, identify dependence structure (and use for forecasting)
Stat 5100 Handout #12.e Notes: ARIMA Models (Unit 7) Key here: after stationary, identify dependence structure (and use for forecasting) (overshort example) White noise H 0 : Let Z t be the stationary
More informationIntroduction to Stochastic processes
Università di Pavia Introduction to Stochastic processes Eduardo Rossi Stochastic Process Stochastic Process: A stochastic process is an ordered sequence of random variables defined on a probability space
More informationLecture 2: Univariate Time Series
Lecture 2: Univariate Time Series Analysis: Conditional and Unconditional Densities, Stationarity, ARMA Processes Prof. Massimo Guidolin 20192 Financial Econometrics Spring/Winter 2017 Overview Motivation:
More informationWeek 5 Quantitative Analysis of Financial Markets Characterizing Cycles
Week 5 Quantitative Analysis of Financial Markets Characterizing Cycles Christopher Ting http://www.mysmu.edu/faculty/christophert/ Christopher Ting : christopherting@smu.edu.sg : 6828 0364 : LKCSB 5036
More informationRoss Bettinger, Analytical Consultant, Seattle, WA
ABSTRACT DYNAMIC REGRESSION IN ARIMA MODELING Ross Bettinger, Analytical Consultant, Seattle, WA Box-Jenkins time series models that contain exogenous predictor variables are called dynamic regression
More informationForecasting. Simon Shaw 2005/06 Semester II
Forecasting Simon Shaw s.c.shaw@maths.bath.ac.uk 2005/06 Semester II 1 Introduction A critical aspect of managing any business is planning for the future. events is called forecasting. Predicting future
More informationLesson 13: Box-Jenkins Modeling Strategy for building ARMA models
Lesson 13: Box-Jenkins Modeling Strategy for building ARMA models Facoltà di Economia Università dell Aquila umberto.triacca@gmail.com Introduction In this lesson we present a method to construct an ARMA(p,
More informationTIME SERIES ANALYSIS AND FORECASTING USING THE STATISTICAL MODEL ARIMA
CHAPTER 6 TIME SERIES ANALYSIS AND FORECASTING USING THE STATISTICAL MODEL ARIMA 6.1. Introduction A time series is a sequence of observations ordered in time. A basic assumption in the time series analysis
More informationClass 1: Stationary Time Series Analysis
Class 1: Stationary Time Series Analysis Macroeconometrics - Fall 2009 Jacek Suda, BdF and PSE February 28, 2011 Outline Outline: 1 Covariance-Stationary Processes 2 Wold Decomposition Theorem 3 ARMA Models
More informationCh 6. Model Specification. Time Series Analysis
We start to build ARIMA(p,d,q) models. The subjects include: 1 how to determine p, d, q for a given series (Chapter 6); 2 how to estimate the parameters (φ s and θ s) of a specific ARIMA(p,d,q) model (Chapter
More informationUnivariate ARIMA Models
Univariate ARIMA Models ARIMA Model Building Steps: Identification: Using graphs, statistics, ACFs and PACFs, transformations, etc. to achieve stationary and tentatively identify patterns and model components.
More informationMODELING INFLATION RATES IN NIGERIA: BOX-JENKINS APPROACH. I. U. Moffat and A. E. David Department of Mathematics & Statistics, University of Uyo, Uyo
Vol.4, No.2, pp.2-27, April 216 MODELING INFLATION RATES IN NIGERIA: BOX-JENKINS APPROACH I. U. Moffat and A. E. David Department of Mathematics & Statistics, University of Uyo, Uyo ABSTRACT: This study
More informationA SARIMAX coupled modelling applied to individual load curves intraday forecasting
A SARIMAX coupled modelling applied to individual load curves intraday forecasting Frédéric Proïa Workshop EDF Institut Henri Poincaré - Paris 05 avril 2012 INRIA Bordeaux Sud-Ouest Institut de Mathématiques
More informationStatistics of stochastic processes
Introduction Statistics of stochastic processes Generally statistics is performed on observations y 1,..., y n assumed to be realizations of independent random variables Y 1,..., Y n. 14 settembre 2014
More informationClassic Time Series Analysis
Classic Time Series Analysis Concepts and Definitions Let Y be a random number with PDF f Y t ~f,t Define t =E[Y t ] m(t) is known as the trend Define the autocovariance t, s =COV [Y t,y s ] =E[ Y t t
More information{ } Stochastic processes. Models for time series. Specification of a process. Specification of a process. , X t3. ,...X tn }
Stochastic processes Time series are an example of a stochastic or random process Models for time series A stochastic process is 'a statistical phenomenon that evolves in time according to probabilistic
More informationEconometrics II Heij et al. Chapter 7.1
Chapter 7.1 p. 1/2 Econometrics II Heij et al. Chapter 7.1 Linear Time Series Models for Stationary data Marius Ooms Tinbergen Institute Amsterdam Chapter 7.1 p. 2/2 Program Introduction Modelling philosophy
More informationMGR-815. Notes for the MGR-815 course. 12 June School of Superior Technology. Professor Zbigniew Dziong
Modeling, Estimation and Control, for Telecommunication Networks Notes for the MGR-815 course 12 June 2010 School of Superior Technology Professor Zbigniew Dziong 1 Table of Contents Preface 5 1. Example
More informationFE570 Financial Markets and Trading. Stevens Institute of Technology
FE570 Financial Markets and Trading Lecture 5. Linear Time Series Analysis and Its Applications (Ref. Joel Hasbrouck - Empirical Market Microstructure ) Steve Yang Stevens Institute of Technology 9/25/2012
More informationIntroduction to ARMA and GARCH processes
Introduction to ARMA and GARCH processes Fulvio Corsi SNS Pisa 3 March 2010 Fulvio Corsi Introduction to ARMA () and GARCH processes SNS Pisa 3 March 2010 1 / 24 Stationarity Strict stationarity: (X 1,
More informationMidterm Suggested Solutions
CUHK Dept. of Economics Spring 2011 ECON 4120 Sung Y. Park Midterm Suggested Solutions Q1 (a) In time series, autocorrelation measures the correlation between y t and its lag y t τ. It is defined as. ρ(τ)
More informationEconometría 2: Análisis de series de Tiempo
Econometría 2: Análisis de series de Tiempo Karoll GOMEZ kgomezp@unal.edu.co http://karollgomez.wordpress.com Segundo semestre 2016 III. Stationary models 1 Purely random process 2 Random walk (non-stationary)
More informationTime Series Analysis
Time Series Analysis Christopher Ting http://mysmu.edu.sg/faculty/christophert/ christopherting@smu.edu.sg Quantitative Finance Singapore Management University March 3, 2017 Christopher Ting Week 9 March
More informationForecasting with ARMA
Forecasting with ARMA Eduardo Rossi University of Pavia October 2013 Rossi Forecasting Financial Econometrics - 2013 1 / 32 Mean Squared Error Linear Projection Forecast of Y t+1 based on a set of variables
More information5 Transfer function modelling
MSc Further Time Series Analysis 5 Transfer function modelling 5.1 The model Consider the construction of a model for a time series (Y t ) whose values are influenced by the earlier values of a series
More informationApplied Time. Series Analysis. Wayne A. Woodward. Henry L. Gray. Alan C. Elliott. Dallas, Texas, USA
Applied Time Series Analysis Wayne A. Woodward Southern Methodist University Dallas, Texas, USA Henry L. Gray Southern Methodist University Dallas, Texas, USA Alan C. Elliott University of Texas Southwestern
More informationSTAT 443 Final Exam Review. 1 Basic Definitions. 2 Statistical Tests. L A TEXer: W. Kong
STAT 443 Final Exam Review L A TEXer: W Kong 1 Basic Definitions Definition 11 The time series {X t } with E[X 2 t ] < is said to be weakly stationary if: 1 µ X (t) = E[X t ] is independent of t 2 γ X
More informationECON/FIN 250: Forecasting in Finance and Economics: Section 6: Standard Univariate Models
ECON/FIN 250: Forecasting in Finance and Economics: Section 6: Standard Univariate Models Patrick Herb Brandeis University Spring 2016 Patrick Herb (Brandeis University) Standard Univariate Models ECON/FIN
More informationLecture 4a: ARMA Model
Lecture 4a: ARMA Model 1 2 Big Picture Most often our goal is to find a statistical model to describe real time series (estimation), and then predict the future (forecasting) One particularly popular model
More informationat least 50 and preferably 100 observations should be available to build a proper model
III Box-Jenkins Methods 1. Pros and Cons of ARIMA Forecasting a) need for data at least 50 and preferably 100 observations should be available to build a proper model used most frequently for hourly or
More informationModule 4. Stationary Time Series Models Part 1 MA Models and Their Properties
Module 4 Stationary Time Series Models Part 1 MA Models and Their Properties Class notes for Statistics 451: Applied Time Series Iowa State University Copyright 2015 W. Q. Meeker. February 14, 2016 20h
More informationE 4101/5101 Lecture 6: Spectral analysis
E 4101/5101 Lecture 6: Spectral analysis Ragnar Nymoen 3 March 2011 References to this lecture Hamilton Ch 6 Lecture note (on web page) For stationary variables/processes there is a close correspondence
More informationElements of Multivariate Time Series Analysis
Gregory C. Reinsel Elements of Multivariate Time Series Analysis Second Edition With 14 Figures Springer Contents Preface to the Second Edition Preface to the First Edition vii ix 1. Vector Time Series
More informationLecture 3: Autoregressive Moving Average (ARMA) Models and their Practical Applications
Lecture 3: Autoregressive Moving Average (ARMA) Models and their Practical Applications Prof. Massimo Guidolin 20192 Financial Econometrics Winter/Spring 2018 Overview Moving average processes Autoregressive
More informationA Data-Driven Model for Software Reliability Prediction
A Data-Driven Model for Software Reliability Prediction Author: Jung-Hua Lo IEEE International Conference on Granular Computing (2012) Young Taek Kim KAIST SE Lab. 9/4/2013 Contents Introduction Background
More informationARMA Estimation Recipes
Econ. 1B D. McFadden, Fall 000 1. Preliminaries ARMA Estimation Recipes hese notes summarize procedures for estimating the lag coefficients in the stationary ARMA(p,q) model (1) y t = µ +a 1 (y t-1 -µ)
More informationProf. Dr. Roland Füss Lecture Series in Applied Econometrics Summer Term Introduction to Time Series Analysis
Introduction to Time Series Analysis 1 Contents: I. Basics of Time Series Analysis... 4 I.1 Stationarity... 5 I.2 Autocorrelation Function... 9 I.3 Partial Autocorrelation Function (PACF)... 14 I.4 Transformation
More informationTime Series Models and Inference. James L. Powell Department of Economics University of California, Berkeley
Time Series Models and Inference James L. Powell Department of Economics University of California, Berkeley Overview In contrast to the classical linear regression model, in which the components of the
More informationcovariance function, 174 probability structure of; Yule-Walker equations, 174 Moving average process, fluctuations, 5-6, 175 probability structure of
Index* The Statistical Analysis of Time Series by T. W. Anderson Copyright 1971 John Wiley & Sons, Inc. Aliasing, 387-388 Autoregressive {continued) Amplitude, 4, 94 case of first-order, 174 Associated
More informationBasic concepts and terminology: AR, MA and ARMA processes
ECON 5101 ADVANCED ECONOMETRICS TIME SERIES Lecture note no. 1 (EB) Erik Biørn, Department of Economics Version of February 1, 2011 Basic concepts and terminology: AR, MA and ARMA processes This lecture
More informationThe Identification of ARIMA Models
APPENDIX 4 The Identification of ARIMA Models As we have established in a previous lecture, there is a one-to-one correspondence between the parameters of an ARMA(p, q) model, including the variance of
More informationAR, MA and ARMA models
AR, MA and AR by Hedibert Lopes P Based on Tsay s Analysis of Financial Time Series (3rd edition) P 1 Stationarity 2 3 4 5 6 7 P 8 9 10 11 Outline P Linear Time Series Analysis and Its Applications For
More informationCh. 15 Forecasting. 1.1 Forecasts Based on Conditional Expectations
Ch 15 Forecasting Having considered in Chapter 14 some of the properties of ARMA models, we now show how they may be used to forecast future values of an observed time series For the present we proceed
More informationForecasting using R. Rob J Hyndman. 2.4 Non-seasonal ARIMA models. Forecasting using R 1
Forecasting using R Rob J Hyndman 2.4 Non-seasonal ARIMA models Forecasting using R 1 Outline 1 Autoregressive models 2 Moving average models 3 Non-seasonal ARIMA models 4 Partial autocorrelations 5 Estimation
More informationLecture 3: Autoregressive Moving Average (ARMA) Models and their Practical Applications
Lecture 3: Autoregressive Moving Average (ARMA) Models and their Practical Applications Prof. Massimo Guidolin 20192 Financial Econometrics Winter/Spring 2018 Overview Moving average processes Autoregressive
More informationModelling using ARMA processes
Modelling using ARMA processes Step 1. ARMA model identification; Step 2. ARMA parameter estimation Step 3. ARMA model selection ; Step 4. ARMA model checking; Step 5. forecasting from ARMA models. 33
More informationTHE ROYAL STATISTICAL SOCIETY 2009 EXAMINATIONS SOLUTIONS GRADUATE DIPLOMA MODULAR FORMAT MODULE 3 STOCHASTIC PROCESSES AND TIME SERIES
THE ROYAL STATISTICAL SOCIETY 9 EXAMINATIONS SOLUTIONS GRADUATE DIPLOMA MODULAR FORMAT MODULE 3 STOCHASTIC PROCESSES AND TIME SERIES The Society provides these solutions to assist candidates preparing
More informationCohort Effect Structure in the Lee-Carter Residual Term. Naoki Sunamoto, FIAJ. Fukoku Mutual Life Insurance Company
Cohort Effect Structure in the Lee-Carter Residual Term Naoki Sunamoto, FIAJ Fukoku Mutual Life Insurance Company 2-2 Uchisaiwaicho 2-chome, Chiyoda-ku, Tokyo, 100-0011, Japan Tel: +81-3-3593-7445, Fax:
More informationEconometrics of financial markets, -solutions to seminar 1. Problem 1
Econometrics of financial markets, -solutions to seminar 1. Problem 1 a) Estimate with OLS. For any regression y i α + βx i + u i for OLS to be unbiased we need cov (u i,x j )0 i, j. For the autoregressive
More informationStationary Stochastic Time Series Models
Stationary Stochastic Time Series Models When modeling time series it is useful to regard an observed time series, (x 1,x,..., x n ), as the realisation of a stochastic process. In general a stochastic
More informationCovariances of ARMA Processes
Statistics 910, #10 1 Overview Covariances of ARMA Processes 1. Review ARMA models: causality and invertibility 2. AR covariance functions 3. MA and ARMA covariance functions 4. Partial autocorrelation
More informationReview Session: Econometrics - CLEFIN (20192)
Review Session: Econometrics - CLEFIN (20192) Part II: Univariate time series analysis Daniele Bianchi March 20, 2013 Fundamentals Stationarity A time series is a sequence of random variables x t, t =
More information10. Time series regression and forecasting
10. Time series regression and forecasting Key feature of this section: Analysis of data on a single entity observed at multiple points in time (time series data) Typical research questions: What is the
More informationSingle Equation Linear GMM with Serially Correlated Moment Conditions
Single Equation Linear GMM with Serially Correlated Moment Conditions Eric Zivot October 28, 2009 Univariate Time Series Let {y t } be an ergodic-stationary time series with E[y t ]=μ and var(y t )
More information4. MA(2) +drift: y t = µ + ɛ t + θ 1 ɛ t 1 + θ 2 ɛ t 2. Mean: where θ(l) = 1 + θ 1 L + θ 2 L 2. Therefore,
61 4. MA(2) +drift: y t = µ + ɛ t + θ 1 ɛ t 1 + θ 2 ɛ t 2 Mean: y t = µ + θ(l)ɛ t, where θ(l) = 1 + θ 1 L + θ 2 L 2. Therefore, E(y t ) = µ + θ(l)e(ɛ t ) = µ 62 Example: MA(q) Model: y t = ɛ t + θ 1 ɛ
More informationLecture 1: Stationary Time Series Analysis
Syllabus Stationarity ARMA AR MA Model Selection Estimation Lecture 1: Stationary Time Series Analysis 222061-1617: Time Series Econometrics Spring 2018 Jacek Suda Syllabus Stationarity ARMA AR MA Model
More informationEstimating AR/MA models
September 17, 2009 Goals The likelihood estimation of AR/MA models AR(1) MA(1) Inference Model specification for a given dataset Why MLE? Traditional linear statistics is one methodology of estimating
More informationTime Series 2. Robert Almgren. Sept. 21, 2009
Time Series 2 Robert Almgren Sept. 21, 2009 This week we will talk about linear time series models: AR, MA, ARMA, ARIMA, etc. First we will talk about theory and after we will talk about fitting the models
More informationChapter 9: Forecasting
Chapter 9: Forecasting One of the critical goals of time series analysis is to forecast (predict) the values of the time series at times in the future. When forecasting, we ideally should evaluate the
More informationLecture 2: ARMA(p,q) models (part 2)
Lecture 2: ARMA(p,q) models (part 2) Florian Pelgrin University of Lausanne, École des HEC Department of mathematics (IMEA-Nice) Sept. 2011 - Jan. 2012 Florian Pelgrin (HEC) Univariate time series Sept.
More informationWe use the centered realization z t z in the computation. Also used in computing sample autocovariances and autocorrelations.
Stationary Time Series Models Part 1 MA Models and Their Properties Class notes for Statistics 41: Applied Time Series Ioa State University Copyright 1 W. Q. Meeker. Segment 1 ARMA Notation, Conventions,
More information3. ARMA Modeling. Now: Important class of stationary processes
3. ARMA Modeling Now: Important class of stationary processes Definition 3.1: (ARMA(p, q) process) Let {ɛ t } t Z WN(0, σ 2 ) be a white noise process. The process {X t } t Z is called AutoRegressive-Moving-Average
More informationLINEAR STOCHASTIC MODELS
LINEAR STOCHASTIC MODELS Let {x τ+1,x τ+2,...,x τ+n } denote n consecutive elements from a stochastic process. If their joint distribution does not depend on τ, regardless of the size of n, then the process
More informationESSE Mid-Term Test 2017 Tuesday 17 October :30-09:45
ESSE 4020 3.0 - Mid-Term Test 207 Tuesday 7 October 207. 08:30-09:45 Symbols have their usual meanings. All questions are worth 0 marks, although some are more difficult than others. Answer as many questions
More informationWe will only present the general ideas on how to obtain. follow closely the AR(1) and AR(2) cases presented before.
ACF and PACF of an AR(p) We will only present the general ideas on how to obtain the ACF and PACF of an AR(p) model since the details follow closely the AR(1) and AR(2) cases presented before. Recall that
More informationEconometrics I: Univariate Time Series Econometrics (1)
Econometrics I: Dipartimento di Economia Politica e Metodi Quantitativi University of Pavia Overview of the Lecture 1 st EViews Session VI: Some Theoretical Premises 2 Overview of the Lecture 1 st EViews
More informationCh 4. Models For Stationary Time Series. Time Series Analysis
This chapter discusses the basic concept of a broad class of stationary parametric time series models the autoregressive moving average (ARMA) models. Let {Y t } denote the observed time series, and {e
More informationChapter 12: An introduction to Time Series Analysis. Chapter 12: An introduction to Time Series Analysis
Chapter 12: An introduction to Time Series Analysis Introduction In this chapter, we will discuss forecasting with single-series (univariate) Box-Jenkins models. The common name of the models is Auto-Regressive
More informationSingle Equation Linear GMM with Serially Correlated Moment Conditions
Single Equation Linear GMM with Serially Correlated Moment Conditions Eric Zivot November 2, 2011 Univariate Time Series Let {y t } be an ergodic-stationary time series with E[y t ]=μ and var(y t )
More informationSTAT 520: Forecasting and Time Series. David B. Hitchcock University of South Carolina Department of Statistics
David B. University of South Carolina Department of Statistics What are Time Series Data? Time series data are collected sequentially over time. Some common examples include: 1. Meteorological data (temperatures,
More informationECON 616: Lecture 1: Time Series Basics
ECON 616: Lecture 1: Time Series Basics ED HERBST August 30, 2017 References Overview: Chapters 1-3 from Hamilton (1994). Technical Details: Chapters 2-3 from Brockwell and Davis (1987). Intuition: Chapters
More informationUniversità di Pavia. Forecasting. Eduardo Rossi
Università di Pavia Forecasting Eduardo Rossi Mean Squared Error Forecast of Y t+1 based on a set of variables observed at date t, X t : Yt+1 t. The loss function MSE(Y t+1 t ) = E[Y t+1 Y t+1 t ]2 The
More informationA lecture on time series
A lecture on time series Bernt Arne Ødegaard 15 November 2018 Contents 1 Survey of time series issues 1 1.1 Definition.............................. 2 1.2 Examples.............................. 2 1.3 Typical
More information1. Time-dependent data in general
Lecture 10 Program 1. Time-dependent data in general 2. Repeated Measurements 3. Time series 4. Time series that depend on covariate time-series 1 Time-dependent data: Outcomes that are measured at several
More informationEASTERN MEDITERRANEAN UNIVERSITY ECON 604, FALL 2007 DEPARTMENT OF ECONOMICS MEHMET BALCILAR ARIMA MODELS: IDENTIFICATION
ARIMA MODELS: IDENTIFICATION A. Autocorrelations and Partial Autocorrelations 1. Summary of What We Know So Far: a) Series y t is to be modeled by Box-Jenkins methods. The first step was to convert y t
More informationarxiv: v1 [stat.me] 5 Nov 2008
arxiv:0811.0659v1 [stat.me] 5 Nov 2008 Estimation of missing data by using the filtering process in a time series modeling Ahmad Mahir R. and Al-khazaleh A. M. H. School of Mathematical Sciences Faculty
More informationNon-Stationary Time Series and Unit Root Testing
Econometrics II Non-Stationary Time Series and Unit Root Testing Morten Nyboe Tabor Course Outline: Non-Stationary Time Series and Unit Root Testing 1 Stationarity and Deviation from Stationarity Trend-Stationarity
More informationProblem Set 2 Solution Sketches Time Series Analysis Spring 2010
Problem Set 2 Solution Sketches Time Series Analysis Spring 2010 Forecasting 1. Let X and Y be two random variables such that E(X 2 ) < and E(Y 2 )
More informationLecture 1: Stationary Time Series Analysis
Syllabus Stationarity ARMA AR MA Model Selection Estimation Forecasting Lecture 1: Stationary Time Series Analysis 222061-1617: Time Series Econometrics Spring 2018 Jacek Suda Syllabus Stationarity ARMA
More information