A SARIMAX coupled modelling applied to individual load curves intraday forecasting
|
|
- Deborah James
- 5 years ago
- Views:
Transcription
1 A SARIMAX coupled modelling applied to individual load curves intraday forecasting Frédéric Proïa Workshop EDF Institut Henri Poincaré - Paris 05 avril 2012 INRIA Bordeaux Sud-Ouest Institut de Mathématiques de Bordeaux 1 / 40
2 Plan 1 Introduction 2 On a SARIMAX coupled modelling Stationary ARMA processes Identification for stationary AR(p) and MA(q) processes Linear relationship between consumption and temperature The SARIMAX modelling Application to forecasting 3 Application to forecasting on a load curve Procedure Seasonality and stationarity ACF and PACF Selection criteria Selection on bayesian criteria Selection on bayesian criteria 4 Application on a huge dataset Technical issues Procedure Modelling Forecasting 5 Conclusion 2 / 40
3 Introduction Motivations. New energy meters to gather individual consumption with high frequencie. Economic issue for EDF : anticipate to optimize. Objectives. Distinguish nonthermosensitive from thermosensitive customers. Intraday daily forecasting. Introduce temperature as an exogenous contribution. 3 / 40
4 Introduction Detecting thermosensitivity. Deterministic criterion. Thermosensitivity if max Mt min t N t N Mt > δ where M t is the empirical median of ( C t... ) C t +1. = 1440 et δ = More pertinent than SR/DR. 70% of nonthermosensitive customers, only including 75% of SR. 4 / 40
5 Plan 1 Introduction 2 On a SARIMAX coupled modelling Stationary ARMA processes Identification for stationary AR(p) and MA(q) processes Linear relationship between consumption and temperature The SARIMAX modelling Application to forecasting 3 Application to forecasting on a load curve Procedure Seasonality and stationarity ACF and PACF Selection criteria Selection on bayesian criteria Selection on bayesian criteria 4 Application on a huge dataset Technical issues Procedure Modelling Forecasting 5 Conclusion 5 / 40
6 On a SARIMAX coupled modelling Stationary ARMA processes Stationary ARMA processes. Definition (Stationarity) A time series (Y t ) is said to be weakly stationary if, for all t Z, E[Y 2 t ] <, E[Y t ] = m and, for all s, t Z, Cov(Y t, Y s) = Cov(Y t s, Y 0 ). Definition (ARMA) Let (Y t ) be a stationary time series with zero mean. It is said to be an ARMA(p, q) process if, for every t Z, p q Y t a k Y t k = ε t + b k ε t k k=1 k=1 where (ε t ) is a white noise of variance σ 2 > 0, a R p and b R q. 6 / 40
7 On a SARIMAX coupled modelling Stationary ARMA processes Causality of ARMA processes. Compact expression, for all 1 t T, where the polynomials A(B)Y t = B(B)ε t A(z) = 1 a 1 z... a pz p and B(z) = 1 + b 1 z b qz q. Definition (Causality) Let (Y t ) be an ARMA(p, q) process for which the polynomials A and B have no common zeroes. Then, (Y t ) is causal if and only if A(z) 0 for all z C such that z 1. Implications. Causality implies the existence of a MA( ) structure for (Y t ). Causality implies stationarity of the process. On N, causality often coincides with stationarity. 7 / 40
8 On a SARIMAX coupled modelling Stationary ARMA processes Existence and unicity of a stationary solution. Proposition If A(z) 0 for all z C such that z 1, then the ARMA equation A(B)Y t = B(B)ε t have the unique stationary solution Y t = ψ k ε t k, k=0 and the coefficients (ψ k ) k N are determined by the relation A 1 (z)b(z) = ψ k z k k=0 with ψk 2 <. k=0 Explosive cases. On Z, no zeroes on the unit circle is a sufficient condition. Irrelevant for practical purposes. 8 / 40
9 On a SARIMAX coupled modelling Identification for stationary AR(p) and MA(q) processes Autocorrelation function. To identify q. Definition (ACF) Let (Y t ) be a stationary time series. The autocorrelation function ρ associated with (Y t ) is defined, for all t Z, as ρ(t) = γ(t) γ(0) where the autocovariance function γ(t) = Cov(Y t, Y 0 ). Proposition The stationary time series (Y t ) with zero mean is a MA(q) process such that b q 0 if and only if ρ(q) 0 and ρ(t) = 0 for all t > q. 9 / 40
10 On a SARIMAX coupled modelling Identification for stationary AR(p) and MA(q) processes Examples. MA(1) : only ρ(1) nonzero, exponential decay of α(t). MA(2) : only ρ(1) and ρ(2) nonzero, damped exponential and sine wave for α(t). 10 / 40
11 On a SARIMAX coupled modelling Identification for stationary AR(p) and MA(q) processes Partial autocorrelation function. To identify p. Definition (PACF) Let (Y t ) be a stationary time series with zero mean. The partial autocorrelation function α is defined as α(0) = 1, and, for all t N, as α(t) = φ t, t where (φ t, t ) t N are computed via the Durbin-Levinson recursion. Proposition If there exists a square-integrable sequence (ψ k ) k N such that (Y t ) has a MA( ) expression with ψ 0 = 1, then the stationary time series (Y t ) with zero mean is an AR(p) process such that a p 0 if and only if α(p) 0 and α(t) = 0 for all t > p. 11 / 40
12 On a SARIMAX coupled modelling Identification for stationary AR(p) and MA(q) processes Examples. AR(1) : only α(1) nonzero, exponential decay of ρ(t). AR(2) : only α(1) and α(2) nonzero, damped exponential and sine wave for ρ(t). 12 / 40
13 On a SARIMAX coupled modelling Identification for stationary AR(p) and MA(q) processes Examples. ARMA(1,1) : exponential decay of ρ(t) and α(t) from first lag. ARMA(2,2) : exponential decay of ρ(t) and α(t) from second lag. 13 / 40
14 On a SARIMAX coupled modelling Linear relationship between consumption and temperature Variance-stabilizing Box-Cox transformation. Logarithmic transform given, for all 1 t T, by Y t = log ( C t + e m) where m ensures that Y t = m when C t = / 40
15 On a SARIMAX coupled modelling Linear relationship between consumption and temperature Linear relationship between consumption and temperature. On a thermosensitive load curve, for all 1 t T, For all z C, Y t = c 0 + C(B)U t + ε t. r 1 C(z) = c k+1 z k. k=0 Unknown vector c R r+1 estimated by OLS. Seasonal residuals. Residuals (ε t ) regarded as a seasonal time series. 15 / 40
16 On a SARIMAX coupled modelling The SARIMAX modelling Residuals (ε t ) as a seasonal time series. SARIMA(p, d, q) (P, D, Q) s modelling, for all 1 t T, (1 B) d (1 B s ) D A(B)A s(b)ε t = B(B)B s(b)v t, where (V t ) is a white noise of variance σ 2 > 0. Polynomials defined, for all z C, as p A(z) = 1 a k z k, k=1 P A s(z) = 1 α k z sk, k=1 B(z) = 1 q b k z k, k=1 B s(z) = 1 Q β k z sk, Parameters a R p, b R q, α R P and β R Q estimated by GLS. A and A s are causal. k=1 16 / 40
17 On a SARIMAX coupled modelling The SARIMAX modelling The dynamic coupled modelling. Definition (SARIMAX) In the particular framework of the study, a random process (Y t ) will be said to follow a SARIMAX(p, d, q, r) (P, D, Q) s coupled modelling if, for all 1 t T, it satisfies { Yt = c 0 + C(B)U t + ε t, (1 B) d (1 B s ) D A(B)A s(b)ε t = B(B)B s(b)v t. As soon as d + D > 0, (1 B) d (1 B s ) D A(B)A s(b) (Y t C(B)U t ) = B(B)B s(b)v t. 17 / 40
18 On a SARIMAX coupled modelling The SARIMAX modelling Existence of a stationary solution. Let I be the identity matrix of order T and 1 U T U T 1... U T r+1 Y 1 1 U T 1 U T 2... U T r Y 2 U =, Y = U 1 U 0... U r+2 Y T Theorem Assume that U U is invertible. Then, the differenced process ( d D s εt ) where εt is given, for all 1 t T, by the vector form ( ε = I U(U U) 1 U ) Y is a stationary solution of the coupled model suitably specified. ADF and KPSS tests : d and D. Box and Jenkins methodology : p, q, r, P, Q, s. 18 / 40
19 On a SARIMAX coupled modelling Application to forecasting Forecasting using time series analysis. Let ε T +1 be the predictor of (ε t ) at stage T + 1. Let ĉ T be the OLS estimate of c. Assume that r has been evaluated. The predictor at horizon 1 is given by Ỹ T +1 = ĉ 0,T + The predictor at horizon H is given by Ỹ T +H = ĉ 0,T + r ĉ k,t U T k+2 + ε T +1. k=1 r ĉ k,t U T k+h+1 + ε T +H. k=1 19 / 40
20 Plan 1 Introduction 2 On a SARIMAX coupled modelling Stationary ARMA processes Identification for stationary AR(p) and MA(q) processes Linear relationship between consumption and temperature The SARIMAX modelling Application to forecasting 3 Application to forecasting on a load curve Procedure Seasonality and stationarity ACF and PACF Selection criteria Selection on bayesian criteria Selection on bayesian criteria 4 Application on a huge dataset Technical issues Procedure Modelling Forecasting 5 Conclusion 20 / 40
21 Application to forecasting on a load curve Procedure 21 / 40
22 Application to forecasting on a load curve Procedure Box and Jenkins methodology. For a given r, estimation of the residual set ( ε t ), for all 1 t T, ε t = Y t ĉ 0,T Select ŝ by investigating the seasonality of ( ε t ). r ĉ k,t U t k+1. Select d and D by investigating the stationarity of ( d Ḓ s εt ). Select p, q, P and Q by looking at ACF and PACF on ( d Ḓ s εt ). Adjust p, q, r, P and Q by minimizing bayesian or prediction criteria. Test of white noise on the fitted innovations. k=1 22 / 40
23 Application to forecasting on a load curve Seasonality and stationarity Seasonality. Fourier spectrogram on ( ε t ), ( 12 ε t ) and ( 24 ε t ), for T = and r = 1. Stationarity. ( ε t ) is not stationary. ( ε t ), ( 24 ε t ) and ( 24 ε t ) are stationary around a deterministic trend. 23 / 40
24 Application to forecasting on a load curve ACF and PACF Sample autocorrelations. On the estimated residuals ( ε t ). On the seasonally differenced residuals ( 24 ε t ). 24 / 40
25 Application to forecasting on a load curve ACF and PACF Sample autocorrelations. On the doubly differenced residuals ( 24 ε t ). Identified models. SARIMAX(p, 0, 0, r) (P, 1, Q) 24 with p 5, r 2, P 1 and Q = 1. SARIMAX(p, 1, q, r) (P, 1, Q) 24 with p 1, q = 2, r 2, P 1 and Q = / 40
26 Application to forecasting on a load curve Selection criteria Bayesian criteria. Akaike information criterion and Schwarz bayesian criterion, AIC = 2 log L + 2k and SBC = 2 log L + k log T where L is the model likelihood and k the number of parameters. Log-likelihood. Overall randomness of successive innovations. Prediction criteria. We define C A and C R as follows, C A = 1 NH ( NH NH C T +k C T +k and CR = k=1 k=1 C T +k ) 1 ( NH k=1 ) C T +k C T +k where ( C T +1,..., C T +NH ) are N consecutive predictions at horizon H from time T. 26 / 40
27 Application to forecasting on a load curve Selection on bayesian criteria Selection on bayesian criteria. p d q r P D Q s AIC SBC LL VAR WN SARIMAX SARIMAX SARIMAX SARIMAX SARIMAX SARIMAX SARIMAX SARIMAX SARIMAX Modelling with SARIMAX(3, 0, 2, 2) (0, 1, 1) 24 with T = / 40
28 Application to forecasting on a load curve Selection on bayesian criteria Selection on bayesian criteria. Modelling with SARIMAX(3, 0, 2, 2) (0, 1, 1) 24 with T = Least squares estimation, for all 28 t T, C t = exp ( ) ĉ 0 + ĉ 1 U t + ĉ 2 U t 1 + ε t exp(5), ε t = ε t 24 + â 1 (ε t 1 ε t 25 ) + â 2 (ε t 2 ε t 26 ) + â 3 (ε t 3 ε t 27 ) + (V t b 1 V t 1 b 2 V t 2 ) β 1 (V t 24 b 1 V t 25 b 2 V t 26 ), in which ĉ 0 = , ĉ 1 = , ĉ 2 = , â 1 = , â 2 = , â 3 = , b 1 = , b 2 = , β 1 = / 40
29 Application to forecasting on a load curve Selection on prediction criteria Selection on prediction criteria. p d q r P D Q s C A C R SARIMAX SARIMAX SARIMAX SARIMAX SARIMAX SARIMAX SARIMAX Forecasting with SARIMAX(1, 0, 1, 2) (0, 1, 1) 24 with T = / 40
30 Application to forecasting on a load curve Selection on prediction criteria Selection on prediction criteria. Forecasting with SARIMAX(1, 0, 1, 2) (0, 1, 1) 24 with T = Parsimony is a central issue in time series analysis. Results slightly improved with a sliding window of 2 months. Around 2% of relative error between (ỸT +1,..., Y T +NH ) and (Y T +1,..., ỸT +NH ). 30 / 40
31 Application to forecasting on a load curve Selection on prediction criteria Refining... Influence of r and the size of the sliding windows M on C R. M = 2 months is the optimal sliding window. No more influence of r as soon as r / 40
32 Plan 1 Introduction 2 On a SARIMAX coupled modelling Stationary ARMA processes Identification for stationary AR(p) and MA(q) processes Linear relationship between consumption and temperature The SARIMAX modelling Application to forecasting 3 Application to forecasting on a load curve Procedure Seasonality and stationarity ACF and PACF Selection criteria Selection on bayesian criteria Selection on bayesian criteria 4 Application on a huge dataset Technical issues Procedure Modelling Forecasting 5 Conclusion 32 / 40
33 Application on a huge dataset Technical issues Huge dataset. More than 2000 load curves. Around 70% nonthermosensitive. High quality : more than 9 months of data per curve, very little missing values. Technical problems. Exponential growth of computing time with parsimony. 33 / 40
34 Application on a huge dataset Procedure On a representative panel. Selection of 200 heterogeneous thermosensitive curves (size, peaks intensity, etc.) Massive statistical KPSS procedures and visual first conclusions. Bayesian criteria to select the best models on average. Application to forecasting. Prediction criteria to select the best models on average. All parameters vary in their neighborhood. Consider technical issues : a night of computation for some models. 2 more bayesian criteria. Reliability index. Percentage of significance of the first exogenous coefficient. Assess the relevance on large-scale. Caution : main assumptions for t-test not satisfied! 34 / 40
35 Application on a huge dataset Modelling Stationarity, for r = 1 and M = 3 months. Less than 30% of ( ε t ) stationary. 100% of ( 24 ε t ) and ( 24 ε t ) stationary. SARIMAX(p, 0, q, r) (P, 1, Q) 24 and SARIMAX(p, 1, q, r) (P, 1, Q) 24. Making r increase. Relative evolution of AIC and SBC with r. Clearly, r = 1. SARIMAX(3, 0, 2, 1) (0, 1, 1) 24, SARIMAX(3, 1, 2, 1) (0, 1, 1) 24. Gain over the naive model : 50%. Gain over the SARIMA model : 2%. 35 / 40
36 Application on a huge dataset Modelling Significance of c 1 for M = 6 months. Substantial on thermosensitive curves. 36 / 40
37 Application on a huge dataset Forecasting Evolution of C R. SARIMAX(1, 1, 1, 1) (0, 1, 1) 24 and SARIMAX(2, 0, 1, 1) (0, 1, 1) 24. M = 2 months. Gain over the naive model : 65%. Gain over the SARIMA model : 3%. 37 / 40
38 Application on a huge dataset Forecasting Examples. 38 / 40
39 Plan 1 Introduction 2 On a SARIMAX coupled modelling Stationary ARMA processes Identification for stationary AR(p) and MA(q) processes Linear relationship between consumption and temperature The SARIMAX modelling Application to forecasting 3 Application to forecasting on a load curve Procedure Seasonality and stationarity ACF and PACF Selection criteria Selection on bayesian criteria Selection on bayesian criteria 4 Application on a huge dataset Technical issues Procedure Modelling Forecasting 5 Conclusion 39 / 40
40 Conclusion Nonthermosensitive curves. SARIMA(1, 0, 1) (0, 1, 1) 24 Thermosensitive curves. SARIMAX(1, 1, 1, 1) (0, 1, 1) 24 and SARIMAX(2, 0, 1, 1) (0, 1, 1) 24. A careful study curve by curve would provide better results. Of course... Caution : technical issues for huge datasets. Is a computation time 1000 for a gain of 0.1% relevant? Engineering approach, corporate vision. Thank you for your attention. Comments or questions? 40 / 40
Univariate ARIMA Models
Univariate ARIMA Models ARIMA Model Building Steps: Identification: Using graphs, statistics, ACFs and PACFs, transformations, etc. to achieve stationary and tentatively identify patterns and model components.
More informationProblem Set 2: Box-Jenkins methodology
Problem Set : Box-Jenkins methodology 1) For an AR1) process we have: γ0) = σ ε 1 φ σ ε γ0) = 1 φ Hence, For a MA1) process, p lim R = φ γ0) = 1 + θ )σ ε σ ε 1 = γ0) 1 + θ Therefore, p lim R = 1 1 1 +
More informationA time series is called strictly stationary if the joint distribution of every collection (Y t
5 Time series A time series is a set of observations recorded over time. You can think for example at the GDP of a country over the years (or quarters) or the hourly measurements of temperature over a
More informationForecasting using R. Rob J Hyndman. 2.4 Non-seasonal ARIMA models. Forecasting using R 1
Forecasting using R Rob J Hyndman 2.4 Non-seasonal ARIMA models Forecasting using R 1 Outline 1 Autoregressive models 2 Moving average models 3 Non-seasonal ARIMA models 4 Partial autocorrelations 5 Estimation
More informationEmpirical Market Microstructure Analysis (EMMA)
Empirical Market Microstructure Analysis (EMMA) Lecture 3: Statistical Building Blocks and Econometric Basics Prof. Dr. Michael Stein michael.stein@vwl.uni-freiburg.de Albert-Ludwigs-University of Freiburg
More informationUnivariate Time Series Analysis; ARIMA Models
Econometrics 2 Fall 24 Univariate Time Series Analysis; ARIMA Models Heino Bohn Nielsen of4 Outline of the Lecture () Introduction to univariate time series analysis. (2) Stationarity. (3) Characterizing
More informationAdvanced Econometrics
Advanced Econometrics Marco Sunder Nov 04 2010 Marco Sunder Advanced Econometrics 1/ 25 Contents 1 2 3 Marco Sunder Advanced Econometrics 2/ 25 Music Marco Sunder Advanced Econometrics 3/ 25 Music Marco
More informationFORECASTING SUGARCANE PRODUCTION IN INDIA WITH ARIMA MODEL
FORECASTING SUGARCANE PRODUCTION IN INDIA WITH ARIMA MODEL B. N. MANDAL Abstract: Yearly sugarcane production data for the period of - to - of India were analyzed by time-series methods. Autocorrelation
More informationTIME SERIES ANALYSIS AND FORECASTING USING THE STATISTICAL MODEL ARIMA
CHAPTER 6 TIME SERIES ANALYSIS AND FORECASTING USING THE STATISTICAL MODEL ARIMA 6.1. Introduction A time series is a sequence of observations ordered in time. A basic assumption in the time series analysis
More informationAutoregressive Moving Average (ARMA) Models and their Practical Applications
Autoregressive Moving Average (ARMA) Models and their Practical Applications Massimo Guidolin February 2018 1 Essential Concepts in Time Series Analysis 1.1 Time Series and Their Properties Time series:
More informationLesson 13: Box-Jenkins Modeling Strategy for building ARMA models
Lesson 13: Box-Jenkins Modeling Strategy for building ARMA models Facoltà di Economia Università dell Aquila umberto.triacca@gmail.com Introduction In this lesson we present a method to construct an ARMA(p,
More informationCircle a single answer for each multiple choice question. Your choice should be made clearly.
TEST #1 STA 4853 March 4, 215 Name: Please read the following directions. DO NOT TURN THE PAGE UNTIL INSTRUCTED TO DO SO Directions This exam is closed book and closed notes. There are 31 questions. Circle
More informationat least 50 and preferably 100 observations should be available to build a proper model
III Box-Jenkins Methods 1. Pros and Cons of ARIMA Forecasting a) need for data at least 50 and preferably 100 observations should be available to build a proper model used most frequently for hourly or
More informationSTAT 443 Final Exam Review. 1 Basic Definitions. 2 Statistical Tests. L A TEXer: W. Kong
STAT 443 Final Exam Review L A TEXer: W Kong 1 Basic Definitions Definition 11 The time series {X t } with E[X 2 t ] < is said to be weakly stationary if: 1 µ X (t) = E[X t ] is independent of t 2 γ X
More informationQuantitative Finance I
Quantitative Finance I Linear AR and MA Models (Lecture 4) Winter Semester 01/013 by Lukas Vacha * If viewed in.pdf format - for full functionality use Mathematica 7 (or higher) notebook (.nb) version
More informationIDENTIFICATION OF ARMA MODELS
IDENTIFICATION OF ARMA MODELS A stationary stochastic process can be characterised, equivalently, by its autocovariance function or its partial autocovariance function. It can also be characterised by
More informationEconometrics I: Univariate Time Series Econometrics (1)
Econometrics I: Dipartimento di Economia Politica e Metodi Quantitativi University of Pavia Overview of the Lecture 1 st EViews Session VI: Some Theoretical Premises 2 Overview of the Lecture 1 st EViews
More informationCh 6. Model Specification. Time Series Analysis
We start to build ARIMA(p,d,q) models. The subjects include: 1 how to determine p, d, q for a given series (Chapter 6); 2 how to estimate the parameters (φ s and θ s) of a specific ARIMA(p,d,q) model (Chapter
More informationFE570 Financial Markets and Trading. Stevens Institute of Technology
FE570 Financial Markets and Trading Lecture 5. Linear Time Series Analysis and Its Applications (Ref. Joel Hasbrouck - Empirical Market Microstructure ) Steve Yang Stevens Institute of Technology 9/25/2012
More informationLecture 2: Univariate Time Series
Lecture 2: Univariate Time Series Analysis: Conditional and Unconditional Densities, Stationarity, ARMA Processes Prof. Massimo Guidolin 20192 Financial Econometrics Spring/Winter 2017 Overview Motivation:
More informationApplied time-series analysis
Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna October 18, 2011 Outline Introduction and overview Econometric Time-Series Analysis In principle,
More informationIntroduction to Time Series Analysis. Lecture 11.
Introduction to Time Series Analysis. Lecture 11. Peter Bartlett 1. Review: Time series modelling and forecasting 2. Parameter estimation 3. Maximum likelihood estimator 4. Yule-Walker estimation 5. Yule-Walker
More informationEconometrics II Heij et al. Chapter 7.1
Chapter 7.1 p. 1/2 Econometrics II Heij et al. Chapter 7.1 Linear Time Series Models for Stationary data Marius Ooms Tinbergen Institute Amsterdam Chapter 7.1 p. 2/2 Program Introduction Modelling philosophy
More informationTime Series I Time Domain Methods
Astrostatistics Summer School Penn State University University Park, PA 16802 May 21, 2007 Overview Filtering and the Likelihood Function Time series is the study of data consisting of a sequence of DEPENDENT
More informationTMA4285 December 2015 Time series models, solution.
Norwegian University of Science and Technology Department of Mathematical Sciences Page of 5 TMA4285 December 205 Time series models, solution. Problem a) (i) The slow decay of the ACF of z t suggest that
More information10. Time series regression and forecasting
10. Time series regression and forecasting Key feature of this section: Analysis of data on a single entity observed at multiple points in time (time series data) Typical research questions: What is the
More informationChapter 4: Models for Stationary Time Series
Chapter 4: Models for Stationary Time Series Now we will introduce some useful parametric models for time series that are stationary processes. We begin by defining the General Linear Process. Let {Y t
More informationProf. Dr. Roland Füss Lecture Series in Applied Econometrics Summer Term Introduction to Time Series Analysis
Introduction to Time Series Analysis 1 Contents: I. Basics of Time Series Analysis... 4 I.1 Stationarity... 5 I.2 Autocorrelation Function... 9 I.3 Partial Autocorrelation Function (PACF)... 14 I.4 Transformation
More informationMODELING INFLATION RATES IN NIGERIA: BOX-JENKINS APPROACH. I. U. Moffat and A. E. David Department of Mathematics & Statistics, University of Uyo, Uyo
Vol.4, No.2, pp.2-27, April 216 MODELING INFLATION RATES IN NIGERIA: BOX-JENKINS APPROACH I. U. Moffat and A. E. David Department of Mathematics & Statistics, University of Uyo, Uyo ABSTRACT: This study
More informationA Data-Driven Model for Software Reliability Prediction
A Data-Driven Model for Software Reliability Prediction Author: Jung-Hua Lo IEEE International Conference on Granular Computing (2012) Young Taek Kim KAIST SE Lab. 9/4/2013 Contents Introduction Background
More informationEconometrics for Policy Analysis A Train The Trainer Workshop Oct 22-28, 2016 Organized by African Heritage Institution
Econometrics for Policy Analysis A Train The Trainer Workshop Oct 22-28, 2016 Organized by African Heritage Institution Delivered by Dr. Nathaniel E. Urama Department of Economics, University of Nigeria,
More information3 Theory of stationary random processes
3 Theory of stationary random processes 3.1 Linear filters and the General linear process A filter is a transformation of one random sequence {U t } into another, {Y t }. A linear filter is a transformation
More informationNon-Stationary Time Series and Unit Root Testing
Econometrics II Non-Stationary Time Series and Unit Root Testing Morten Nyboe Tabor Course Outline: Non-Stationary Time Series and Unit Root Testing 1 Stationarity and Deviation from Stationarity Trend-Stationarity
More informationCircle the single best answer for each multiple choice question. Your choice should be made clearly.
TEST #1 STA 4853 March 6, 2017 Name: Please read the following directions. DO NOT TURN THE PAGE UNTIL INSTRUCTED TO DO SO Directions This exam is closed book and closed notes. There are 32 multiple choice
More informationRoss Bettinger, Analytical Consultant, Seattle, WA
ABSTRACT DYNAMIC REGRESSION IN ARIMA MODELING Ross Bettinger, Analytical Consultant, Seattle, WA Box-Jenkins time series models that contain exogenous predictor variables are called dynamic regression
More informationNon-Stationary Time Series and Unit Root Testing
Econometrics II Non-Stationary Time Series and Unit Root Testing Morten Nyboe Tabor Course Outline: Non-Stationary Time Series and Unit Root Testing 1 Stationarity and Deviation from Stationarity Trend-Stationarity
More informationClassic Time Series Analysis
Classic Time Series Analysis Concepts and Definitions Let Y be a random number with PDF f Y t ~f,t Define t =E[Y t ] m(t) is known as the trend Define the autocovariance t, s =COV [Y t,y s ] =E[ Y t t
More informationEASTERN MEDITERRANEAN UNIVERSITY ECON 604, FALL 2007 DEPARTMENT OF ECONOMICS MEHMET BALCILAR ARIMA MODELS: IDENTIFICATION
ARIMA MODELS: IDENTIFICATION A. Autocorrelations and Partial Autocorrelations 1. Summary of What We Know So Far: a) Series y t is to be modeled by Box-Jenkins methods. The first step was to convert y t
More informationModule 3. Descriptive Time Series Statistics and Introduction to Time Series Models
Module 3 Descriptive Time Series Statistics and Introduction to Time Series Models Class notes for Statistics 451: Applied Time Series Iowa State University Copyright 2015 W Q Meeker November 11, 2015
More informationUnivariate linear models
Univariate linear models The specification process of an univariate ARIMA model is based on the theoretical properties of the different processes and it is also important the observation and interpretation
More informationCHAPTER 8 FORECASTING PRACTICE I
CHAPTER 8 FORECASTING PRACTICE I Sometimes we find time series with mixed AR and MA properties (ACF and PACF) We then can use mixed models: ARMA(p,q) These slides are based on: González-Rivera: Forecasting
More informationNonlinear time series
Based on the book by Fan/Yao: Nonlinear Time Series Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna October 27, 2009 Outline Characteristics of
More informationAPPLIED ECONOMETRIC TIME SERIES 4TH EDITION
APPLIED ECONOMETRIC TIME SERIES 4TH EDITION Chapter 2: STATIONARY TIME-SERIES MODELS WALTER ENDERS, UNIVERSITY OF ALABAMA Copyright 2015 John Wiley & Sons, Inc. Section 1 STOCHASTIC DIFFERENCE EQUATION
More informationLecture 1: Fundamental concepts in Time Series Analysis (part 2)
Lecture 1: Fundamental concepts in Time Series Analysis (part 2) Florian Pelgrin University of Lausanne, École des HEC Department of mathematics (IMEA-Nice) Sept. 2011 - Jan. 2012 Florian Pelgrin (HEC)
More informationEstimating AR/MA models
September 17, 2009 Goals The likelihood estimation of AR/MA models AR(1) MA(1) Inference Model specification for a given dataset Why MLE? Traditional linear statistics is one methodology of estimating
More informationEconometría 2: Análisis de series de Tiempo
Econometría 2: Análisis de series de Tiempo Karoll GOMEZ kgomezp@unal.edu.co http://karollgomez.wordpress.com Segundo semestre 2016 III. Stationary models 1 Purely random process 2 Random walk (non-stationary)
More informationNon-Stationary Time Series and Unit Root Testing
Econometrics II Non-Stationary Time Series and Unit Root Testing Morten Nyboe Tabor Course Outline: Non-Stationary Time Series and Unit Root Testing 1 Stationarity and Deviation from Stationarity Trend-Stationarity
More informationMarcel Dettling. Applied Time Series Analysis SS 2013 Week 05. ETH Zürich, March 18, Institute for Data Analysis and Process Design
Marcel Dettling Institute for Data Analysis and Process Design Zurich University of Applied Sciences marcel.dettling@zhaw.ch http://stat.ethz.ch/~dettling ETH Zürich, March 18, 2013 1 Basics of Modeling
More informationThe Identification of ARIMA Models
APPENDIX 4 The Identification of ARIMA Models As we have established in a previous lecture, there is a one-to-one correspondence between the parameters of an ARMA(p, q) model, including the variance of
More informationTime Series Analysis -- An Introduction -- AMS 586
Time Series Analysis -- An Introduction -- AMS 586 1 Objectives of time series analysis Data description Data interpretation Modeling Control Prediction & Forecasting 2 Time-Series Data Numerical data
More informationReview Session: Econometrics - CLEFIN (20192)
Review Session: Econometrics - CLEFIN (20192) Part II: Univariate time series analysis Daniele Bianchi March 20, 2013 Fundamentals Stationarity A time series is a sequence of random variables x t, t =
More informationCovariances of ARMA Processes
Statistics 910, #10 1 Overview Covariances of ARMA Processes 1. Review ARMA models: causality and invertibility 2. AR covariance functions 3. MA and ARMA covariance functions 4. Partial autocorrelation
More informationCh 5. Models for Nonstationary Time Series. Time Series Analysis
We have studied some deterministic and some stationary trend models. However, many time series data cannot be modeled in either way. Ex. The data set oil.price displays an increasing variation from the
More informationLesson 2: Analysis of time series
Lesson 2: Analysis of time series Time series Main aims of time series analysis choosing right model statistical testing forecast driving and optimalisation Problems in analysis of time series time problems
More informationIntroduction to ARMA and GARCH processes
Introduction to ARMA and GARCH processes Fulvio Corsi SNS Pisa 3 March 2010 Fulvio Corsi Introduction to ARMA () and GARCH processes SNS Pisa 3 March 2010 1 / 24 Stationarity Strict stationarity: (X 1,
More informationSTAT Financial Time Series
STAT 6104 - Financial Time Series Chapter 4 - Estimation in the time Domain Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 1 / 46 Agenda 1 Introduction 2 Moment Estimates 3 Autoregressive Models (AR
More informationE 4101/5101 Lecture 6: Spectral analysis
E 4101/5101 Lecture 6: Spectral analysis Ragnar Nymoen 3 March 2011 References to this lecture Hamilton Ch 6 Lecture note (on web page) For stationary variables/processes there is a close correspondence
More informationChapter 6: Model Specification for Time Series
Chapter 6: Model Specification for Time Series The ARIMA(p, d, q) class of models as a broad class can describe many real time series. Model specification for ARIMA(p, d, q) models involves 1. Choosing
More informationLab: Box-Jenkins Methodology - US Wholesale Price Indicator
Lab: Box-Jenkins Methodology - US Wholesale Price Indicator In this lab we explore the Box-Jenkins methodology by applying it to a time-series data set comprising quarterly observations of the US Wholesale
More informationModelling Monthly Rainfall Data of Port Harcourt, Nigeria by Seasonal Box-Jenkins Methods
International Journal of Sciences Research Article (ISSN 2305-3925) Volume 2, Issue July 2013 http://www.ijsciences.com Modelling Monthly Rainfall Data of Port Harcourt, Nigeria by Seasonal Box-Jenkins
More informationExercises - Time series analysis
Descriptive analysis of a time series (1) Estimate the trend of the series of gasoline consumption in Spain using a straight line in the period from 1945 to 1995 and generate forecasts for 24 months. Compare
More informationMidterm Suggested Solutions
CUHK Dept. of Economics Spring 2011 ECON 4120 Sung Y. Park Midterm Suggested Solutions Q1 (a) In time series, autocorrelation measures the correlation between y t and its lag y t τ. It is defined as. ρ(τ)
More informationCh 4. Models For Stationary Time Series. Time Series Analysis
This chapter discusses the basic concept of a broad class of stationary parametric time series models the autoregressive moving average (ARMA) models. Let {Y t } denote the observed time series, and {e
More informationChapter 2: Unit Roots
Chapter 2: Unit Roots 1 Contents: Lehrstuhl für Department Empirische of Wirtschaftsforschung Empirical Research and undeconometrics II. Unit Roots... 3 II.1 Integration Level... 3 II.2 Nonstationarity
More informationFinancial Time Series Analysis: Part II
Department of Mathematics and Statistics, University of Vaasa, Finland Spring 2017 1 Unit root Deterministic trend Stochastic trend Testing for unit root ADF-test (Augmented Dickey-Fuller test) Testing
More information{ } Stochastic processes. Models for time series. Specification of a process. Specification of a process. , X t3. ,...X tn }
Stochastic processes Time series are an example of a stochastic or random process Models for time series A stochastic process is 'a statistical phenomenon that evolves in time according to probabilistic
More informationSTAT 443 (Winter ) Forecasting
Winter 2014 TABLE OF CONTENTS STAT 443 (Winter 2014-1141) Forecasting Prof R Ramezan University of Waterloo L A TEXer: W KONG http://wwkonggithubio Last Revision: September 3, 2014 Table of Contents 1
More informationStat 5100 Handout #12.e Notes: ARIMA Models (Unit 7) Key here: after stationary, identify dependence structure (and use for forecasting)
Stat 5100 Handout #12.e Notes: ARIMA Models (Unit 7) Key here: after stationary, identify dependence structure (and use for forecasting) (overshort example) White noise H 0 : Let Z t be the stationary
More informationForecasting. Simon Shaw 2005/06 Semester II
Forecasting Simon Shaw s.c.shaw@maths.bath.ac.uk 2005/06 Semester II 1 Introduction A critical aspect of managing any business is planning for the future. events is called forecasting. Predicting future
More information7. Forecasting with ARIMA models
7. Forecasting with ARIMA models 309 Outline: Introduction The prediction equation of an ARIMA model Interpreting the predictions Variance of the predictions Forecast updating Measuring predictability
More informationStationary Stochastic Time Series Models
Stationary Stochastic Time Series Models When modeling time series it is useful to regard an observed time series, (x 1,x,..., x n ), as the realisation of a stochastic process. In general a stochastic
More informationHomework 4. 1 Data analysis problems
Homework 4 1 Data analysis problems This week we will be analyzing a number of data sets. We are going to build ARIMA models using the steps outlined in class. It is also a good idea to read section 3.8
More informationECON/FIN 250: Forecasting in Finance and Economics: Section 6: Standard Univariate Models
ECON/FIN 250: Forecasting in Finance and Economics: Section 6: Standard Univariate Models Patrick Herb Brandeis University Spring 2016 Patrick Herb (Brandeis University) Standard Univariate Models ECON/FIN
More informationEconometrics I. Professor William Greene Stern School of Business Department of Economics 25-1/25. Part 25: Time Series
Econometrics I Professor William Greene Stern School of Business Department of Economics 25-1/25 Econometrics I Part 25 Time Series 25-2/25 Modeling an Economic Time Series Observed y 0, y 1,, y t, What
More informationLecture 3: Autoregressive Moving Average (ARMA) Models and their Practical Applications
Lecture 3: Autoregressive Moving Average (ARMA) Models and their Practical Applications Prof. Massimo Guidolin 20192 Financial Econometrics Winter/Spring 2018 Overview Moving average processes Autoregressive
More informationTime Series: Theory and Methods
Peter J. Brockwell Richard A. Davis Time Series: Theory and Methods Second Edition With 124 Illustrations Springer Contents Preface to the Second Edition Preface to the First Edition vn ix CHAPTER 1 Stationary
More informationA SEASONAL TIME SERIES MODEL FOR NIGERIAN MONTHLY AIR TRAFFIC DATA
www.arpapress.com/volumes/vol14issue3/ijrras_14_3_14.pdf A SEASONAL TIME SERIES MODEL FOR NIGERIAN MONTHLY AIR TRAFFIC DATA Ette Harrison Etuk Department of Mathematics/Computer Science, Rivers State University
More informationTime Series Models and Inference. James L. Powell Department of Economics University of California, Berkeley
Time Series Models and Inference James L. Powell Department of Economics University of California, Berkeley Overview In contrast to the classical linear regression model, in which the components of the
More informationCovariance Stationary Time Series. Example: Independent White Noise (IWN(0,σ 2 )) Y t = ε t, ε t iid N(0,σ 2 )
Covariance Stationary Time Series Stochastic Process: sequence of rv s ordered by time {Y t } {...,Y 1,Y 0,Y 1,...} Defn: {Y t } is covariance stationary if E[Y t ]μ for all t cov(y t,y t j )E[(Y t μ)(y
More information7. Integrated Processes
7. Integrated Processes Up to now: Analysis of stationary processes (stationary ARMA(p, q) processes) Problem: Many economic time series exhibit non-stationary patterns over time 226 Example: We consider
More informationSome Time-Series Models
Some Time-Series Models Outline 1. Stochastic processes and their properties 2. Stationary processes 3. Some properties of the autocorrelation function 4. Some useful models Purely random processes, random
More informationAR, MA and ARMA models
AR, MA and AR by Hedibert Lopes P Based on Tsay s Analysis of Financial Time Series (3rd edition) P 1 Stationarity 2 3 4 5 6 7 P 8 9 10 11 Outline P Linear Time Series Analysis and Its Applications For
More informationECONOMETRIA II. CURSO 2009/2010 LAB # 3
ECONOMETRIA II. CURSO 2009/2010 LAB # 3 BOX-JENKINS METHODOLOGY The Box Jenkins approach combines the moving average and the autorregresive models. Although both models were already known, the contribution
More information7. Integrated Processes
7. Integrated Processes Up to now: Analysis of stationary processes (stationary ARMA(p, q) processes) Problem: Many economic time series exhibit non-stationary patterns over time 226 Example: We consider
More informationNANYANG TECHNOLOGICAL UNIVERSITY SEMESTER II EXAMINATION MAS451/MTH451 Time Series Analysis TIME ALLOWED: 2 HOURS
NANYANG TECHNOLOGICAL UNIVERSITY SEMESTER II EXAMINATION 2012-2013 MAS451/MTH451 Time Series Analysis May 2013 TIME ALLOWED: 2 HOURS INSTRUCTIONS TO CANDIDATES 1. This examination paper contains FOUR (4)
More informationEconometrics for Policy Analysis A Train The Trainer Workshop Oct 22-28, 2016
Econometrics for Policy Analysis A Train The Trainer Workshop Delivered by Dr. Nathaniel E. Urama Department of Economics, University of Nigeria, Nsukka Loading Time Series data in E-views: Review For
More informationUsing Analysis of Time Series to Forecast numbers of The Patients with Malignant Tumors in Anbar Provinc
Using Analysis of Time Series to Forecast numbers of The Patients with Malignant Tumors in Anbar Provinc /. ) ( ) / (Box & Jenkins).(.(2010-2006) ARIMA(2,1,0). Abstract: The aim of this research is to
More informationProblem Set 2 Solution Sketches Time Series Analysis Spring 2010
Problem Set 2 Solution Sketches Time Series Analysis Spring 2010 Forecasting 1. Let X and Y be two random variables such that E(X 2 ) < and E(Y 2 )
More informationUnit root problem, solution of difference equations Simple deterministic model, question of unit root
Unit root problem, solution of difference equations Simple deterministic model, question of unit root (1 φ 1 L)X t = µ, Solution X t φ 1 X t 1 = µ X t = A + Bz t with unknown z and unknown A (clearly X
More informationTopic 4 Unit Roots. Gerald P. Dwyer. February Clemson University
Topic 4 Unit Roots Gerald P. Dwyer Clemson University February 2016 Outline 1 Unit Roots Introduction Trend and Difference Stationary Autocorrelations of Series That Have Deterministic or Stochastic Trends
More informationFinal Examination 7/6/2011
The Islamic University of Gaza Faculty of Commerce Department of Economics & Applied Statistics Time Series Analysis - Dr. Samir Safi Spring Semester 211 Final Examination 7/6/211 Name: ID: INSTRUCTIONS:
More informationMoving Average (MA) representations
Moving Average (MA) representations The moving average representation of order M has the following form v[k] = MX c n e[k n]+e[k] (16) n=1 whose transfer function operator form is MX v[k] =H(q 1 )e[k],
More information6 NONSEASONAL BOX-JENKINS MODELS
6 NONSEASONAL BOX-JENKINS MODELS In this section, we will discuss a class of models for describing time series commonly referred to as Box-Jenkins models. There are two types of Box-Jenkins models, seasonal
More information2. An Introduction to Moving Average Models and ARMA Models
. An Introduction to Moving Average Models and ARMA Models.1 White Noise. The MA(1) model.3 The MA(q) model..4 Estimation and forecasting of MA models..5 ARMA(p,q) models. The Moving Average (MA) models
More information4. MA(2) +drift: y t = µ + ɛ t + θ 1 ɛ t 1 + θ 2 ɛ t 2. Mean: where θ(l) = 1 + θ 1 L + θ 2 L 2. Therefore,
61 4. MA(2) +drift: y t = µ + ɛ t + θ 1 ɛ t 1 + θ 2 ɛ t 2 Mean: y t = µ + θ(l)ɛ t, where θ(l) = 1 + θ 1 L + θ 2 L 2. Therefore, E(y t ) = µ + θ(l)e(ɛ t ) = µ 62 Example: MA(q) Model: y t = ɛ t + θ 1 ɛ
More informationLecture 7: Model Building Bus 41910, Time Series Analysis, Mr. R. Tsay
Lecture 7: Model Building Bus 41910, Time Series Analysis, Mr R Tsay An effective procedure for building empirical time series models is the Box-Jenkins approach, which consists of three stages: model
More informationTime Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY
Time Series Analysis James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY & Contents PREFACE xiii 1 1.1. 1.2. Difference Equations First-Order Difference Equations 1 /?th-order Difference
More informationPart III Example Sheet 1 - Solutions YC/Lent 2015 Comments and corrections should be ed to
TIME SERIES Part III Example Sheet 1 - Solutions YC/Lent 2015 Comments and corrections should be emailed to Y.Chen@statslab.cam.ac.uk. 1. Let {X t } be a weakly stationary process with mean zero and let
More informationCh 8. MODEL DIAGNOSTICS. Time Series Analysis
Model diagnostics is concerned with testing the goodness of fit of a model and, if the fit is poor, suggesting appropriate modifications. We shall present two complementary approaches: analysis of residuals
More informationEconometrics of financial markets, -solutions to seminar 1. Problem 1
Econometrics of financial markets, -solutions to seminar 1. Problem 1 a) Estimate with OLS. For any regression y i α + βx i + u i for OLS to be unbiased we need cov (u i,x j )0 i, j. For the autoregressive
More information