Stat 5100 Handout #12.e Notes: ARIMA Models (Unit 7) Key here: after stationary, identify dependence structure (and use for forecasting)
|
|
- Lillian Douglas
- 6 years ago
- Views:
Transcription
1 Stat 5100 Handout #12.e Notes: ARIMA Models (Unit 7) Key here: after stationary, identify dependence structure (and use for forecasting) (overshort example) White noise H 0 : Let Z t be the stationary time series after transforming (including estimating out time trends and other covariates) the original time series Y 1,..., Y n Autocorrelation function (ACF or SACF) measure linear association between time series observations separated by a lag of m time units: r m = n m t=b SE of r m is S rm = (b = 1 unless use differencing) (Z t Z)(Z t+m Z) nt=b Z t nt=b (Z t Z), Z = 2 n b m 1 l=1 r2 l n b + 1 call r m the sample autocorrelation function: SACF (m) or ACF (m) sometimes used: t rm = r m /S rm Autocorrelation plot (or SAC): determine stationarity and identify MA(q) dependence structure bar-plot r m vs. m for various lags m (sketch) lines often added to represent 2 SE s (sketch) rough 95% confidence intervals if r m is more than 2 SE s away from zero, consider it significant compare t rm to 2 (for lags m 3, use 1.6 because low lags most important to pick up) SAC terminology: spike : r m is significant cuts off : no significant spikes after r m dies down : decreases in steady fashion 1
2 SAC & stationarity: 1. Z t stationary if SAC either cuts off fairly quickly or dies down fairly quickly; sometimes dyes down in damped exponential fashion (sketches) 2. Z t nonstationary if SAC dies down extremely slowly (sketch) 3. Ch. 9 of Bowerman & O Connell:... if the SAC cuts off fairly quickly, it will often [but not always] do so after a lag k that is less than or equal to 2. MA(q) dependence structure: moving average process of order q: model: Z t = δ + a t θ 1 a t 1 θ 2 a t 2... θ q a t q Z t : stationary transformed time series a t : random shocks θ i : unknown parameters δ : unknown parameter [only included if Z is statistically different from 0 identify using SAC: first q terms of SAC will be non-zero, then drop to zero (sketch) Partial Autocorrelation Function (PACF or SPACF) autocorrelation of time series observations separated by a lag of m, with the effects of the intervening observations eliminated: r m,m = r 1 if k = 1 r m,m = r m m 1 l=1 r m 1,lr m l 1 m 1 l=1 r if k 2 m 1,lr l where r m = SACF (m) and r m,l = r m 1,l r m,m r m 1,m l for l = 1,..., m 1 SE of r m,m is S rm,m = 1/ n b + 1 (b = 1 unless use differencing) call r m,m the sample partial autocorrelation function: SP ACF (m) or sometimes used: t rm,m = r m,m /S rm,m P ACF (m) Inverse Autocorrelation Function (IACF) is similar to PACF, and rarely discussed 2
3 Partial Autocorrelation Plot (or SPAC) bar-plot r m,m vs. m for various lags m (sketch) lines often added to represent 2 SE s; compare t rm,m to 2; (sketch) Use SPAC to identify AR(p) dependence structure: terminology as before: spike, cuts off, and dies down r m,m first p terms of SPAC will be non-zero, then drop to zero (sketch) AR(p) dependence structure: autoregressive process of order p: recall [special case] first-order autocorrelation: ε t = φε t 1 + a t generalize to account for error dependence structure where current time series value depends on past values: ε t = φ 1 ε t 1 + φ 2 ε t φ p ε t p + a t More common representation for AR(p): Z t = δ + φ 1 Z t 1 + φ 2 Z t φ p Z t p + a t φ i are unknown parameters; random shock a t iid N(0, σ 2 ) δ = µ(1 φ 1... φ p ); µ = E[Z t ] Z t are residuals µ 0 common to assume δ = 0 special case: Random Walk Model Z t = Z t 1 + a t AR(1) is a discrete time continuous Markov Chain (probability at time t depends only on state at time t 1) (GE investment example) Some convenient notation: backshift operator BZ t = Z t 1 B 2 Z t = BBZ t = BZ t 1 = Z t 2 AR(p): Z t = δ + φ 1 Z t φ p Z t p + a t = δ + φ 1 BZ t φ p B p Z t + a t = δ + (φ 1 B φ p B p )Z t + a t (1 φ 1 B... φ p B p )Z t δ = a t MA(q): Z t = δ + a t θ 1 a t 1... θ q a t q = δ + a t θ 1 Ba t... θ q B q a t = δ + (1 θ 1 B... θ q B q )a t (1 θ 1 B... θ q B q ) 1 (Z t δ) = a t 3
4 Interpreting and representing common dependence structures: AR(p) Autoregressive Process: current & future values (of Z t ) depend on previous p time series values (Z t ) (1 φ 1 B... φ p B p )Z t δ = a t MA(q) Moving Average Process: current & future values (of Z t ) depend on previous q random shocks (a t ) (less intuitive) (1 θ 1 B... θ q B q ) 1 (Z t δ) = a t (Gas price example) ARMA(p,q) dependence structure: mixed autoregressive-moving average model If AR and MA alone aren t enough, what about a composite (AR and MA) model? Z t = δ + φ 1 Z t φ p Z t p }{{} + a t θ 1 a t 1... θ q a t q }{{} AR(p) MA(q) in backshift notation, ARMA(p,q): (1 φ 1 B φ 2 B 2... φ p B p )Z t = δ + (1 θ 1 B θ 2 B 2... θ q B q )a t (1 θ 1 B... θ q B q ) 1 [(1 φ 1 B... φ p B p )Z t δ] = a t Invertibility model assumption (in addition to stationarity) intuitively, weights (φ l & θ l ) on past observations decrease for larger l Common Dependence Structures for Stationary Time Series SAC SPAC MA(1) cuts off after lag 1 dies down, dominated by damped exponential decay MA(2) cuts off after lag 2 dies down, in mixture of damped exp. decay & sine waves AR(1) dies down in damped cuts off after lag 1 exponential decay AR(2) dies down, in mixture of cuts off after lag 2 damped exp. decay & sine waves ARMA(1,1) dies down in damped exp. decay dies down in damped exp. decay 4
5 Several approaches exist to estimate φ l s, θ l s, and β j s, and deal with initial lag ULS (unconditional least squares): MA(q) & AR(p) also called nonlinear least squares minimize SS error YW (Yule-Walker): AR(p) generalized least squares using OLS residuals to estimate covariance across observations ARIMA(p,d,q) dependence structure: Autoregressive Integrated Moving Average Model a very flexible family of models useful prediction Recall differencing: First difference: Z t = Y t Y t 1, t = 2,..., n Second difference: W t = Z t Z t 1 = Y t 2Y t 1 + Y t 2, t = 3,..., n Pros: help make time series more stationary ( stubborn trends) Cons: can destroy cyclic behavior (harder to forecast) Useful when transformations and addition of time-related predictors (loworder polynomial, trigonometric, dummy) do not make time series stationary After differencing, AR and MA dependence structures may exist: ARIMA(p, d,q) p : AR(p) value at time t depends on previous p values) d : # of differences (need to take d th difference to make stationary) q : MA(q) value at time t depends on previous q random shocks) use SAC and SPAC to select p and q but how to select d? usually look at plots of time series choose lowest d to make stationary (also SAC) recall backshift notation: d = 1 : Z t = Y t Y t 1 = Y t BY t = (1 B)Y t general d: Z t = (1 B) d Y t ARIMA Forecasting & Goodness of Fit (note order in which SAS does this) (1 B) d }{{} Y t = β 0 + β 1 X t, β k 1 X t,k 1 }{{} Differencing Linear Model + (1 φ 1 B... φ p B p ) 1 }{{} (1 θ 1B... θ q B q ) }{{} a t, a t iid N(0, σ 2 ) }{{} Independence Autoregressive Moving Average (given p, d, and q, SAS estimates β j s, φ l s, and θ l s) 5
6 ARIMA(p,d,q) model rewritten, with t = 1,..., n: Y t = g 1 (Y 1,..., Y t 1 ) + g 2 (X t,1,..., X t,k 1 ) + g 3 (a 1,..., a t ) where g 1 = linear combination (LC) of previous observations (Differencing) g 2 = LC of predictors at time t, in terms of parameters β j (Linear Model) g 3 = function of random shocks in terms of parameters φ l & θ l (AR & MA dependence structures) fit model estimates & standard errors for β j s, φ l s, & θ l s Diagnostics for goodness of fit Predicted values (point forecast from Box-Jenkins model, even for times t > n): Ŷ t = g 1 (Y 1,..., Y t 1 ) + ĝ 2 (X t,1,..., X t,k 1 ) + ĝ 3 (â 1,..., â t ) }{{}}{{}}{{} Estimate Y l with Estimate β j with b j Estimate φ l & θ l Ŷ l if no obs. with ˆφ l & ˆθ l at time l (l > n) predictors Y 1,..., Y t 1, X t,1,..., X t,k 1 related multicollinearity Numerical diagnostics what are S and Q like for a better model? Standard Error measure of overall fit in SAS: Std Error Estimate n1 S = (Y t Ŷt) 2, n p = # parameters in model n n p Ljung-Box statistic diagnostic checking in SAS: lag 6 χ 2 for Autocorrelation Check of Residuals Residuals reflect model assumptions Check adequacy of overall Box-Jenkins model (for these data) M Q = n (n + 2) (n m) 1 rm(â) 2 (this is the Ljung-Box statistic) m=1 n = n d, d = degree of differencing r m (â) = RSAC: sample autocorrelation of residuals at lag m M = somewhat arbitrary number of lags to consider, usually multiple of 6; basic idea: look at local dependence among residuals in first M sample autocorrelations Under H 0 : model is adequate, Q χ 2 M n p (sketch) 6
7 Graphical assessment of model adequacy what dependence structure remains? look at Residual Sample Autocorrelation (RSAC) & Residual Sample Partial Autocorrelation (RSPAC) plots Interval Forecasting recall: Estimate ± (CriticalV alue) (StandardError) Note: get CriticalV alue from the sampling distribution (sketch) get point forecast Ŷt = Ŷn+τ (most interested in τ > 0) SE n+τ : standard error of Ŷn+τ depends on S usually, smaller S smaller SE n+τ Ŷn+τ ± ( t n np (1 α/2) ) SE n+τ Based on historical data and the selected Box-Jenkins model, we are (1 α)100% confident that the true value of Y at time n + τ will be inside this interval. General SAS code for ARIMA(p,d,q), Y in terms of X 1,..., X k 1 : proc arima data = a1; identify var = Y (d ) crosscorr = (X 1... X k 1 ) ; estimate p = p q = q input = (X 1... X k 1 ) method = uls plot; forecast lead = L alpha = a noprint out = fout; run; option description d, p, q differencing, AR, & MA settings (as before) plot adds RSAC & RSPAC plots L # times after last observed to forecast a set confidence limit; a =.10 90% conf. limits noprint optional, suppresses output out = fout optional, sends forecast data to fout data set AR model p Z t = δ + φ 1 Z t 1 + φ 2 Z t 2 + a t 2 Z t = δ + φ 1 Z t 1 + φ 3 Z t 3 + a t (1,3) MA model q Z t = δ + a t θ 1 a t 1 θ 2 a t 2 θ 3 a t 3 3 Z t = δ + a t θ 1 a t 1 θ 3 a t 3 θ 7 a t 7 (1,3,7) Differencing d First: Z t = Y t Y t 1 = (1 B)Y t 1 Second: Z t = (1 B)(1 B)Y t 1,1 Lagged : Z t = Y t Y t 7 7 For a =.10, data set fout will contain variables Y, forecast, std, l90, u90, residual what about time or X 1... X k 1? 7
8 (gas price example, continued) How to get forecast values? easiest to use backshift notation forecasting equation for ARIMA(1,1,1) with one covariate: (1 B)Y t = (β 0 + β 1 X t ) + (1 φ 1 B) 1 (1 θ 1 B) a t (1 φ 1 B) (1 B)Y t = (1 φ 1 B) (β 0 + β 1 X t ) + (1 θ 1 B) a t ( 1 (1 + φ1 )B + φ 1 B 2) Y t = β 0 (1 φ 1 ) + β 1 (1 φ 1 B) X t + (1 θ 1 B) a t Y t (1 + φ 1 )Y t 1 + φ 1 Y t 2 = β 0 (1 φ 1 ) + β 1 (X t φ 1 X t 1 ) + a t θ 1 a t 1 Ŷ t = ˆβ 0 ( 1 ˆφ1 ) + ˆβ1 ( Xt ˆφ 1 X t 1 ) +â t ˆθ 1 â t 1 +(1 + ˆφ 1 )Y t 1 ˆφ 1 Y t 2 Note: â t = 0, â l = Y l Ŷl for l < t, and â l = 0 for l > n Summary of Box-Jenkins Models - choosing a good model (choice of p, d, & q) for useful forecasts, meet model assumptions stationarity transform Y, add predictors, differencing (d) account for what influences Y : obvious effects: effects of predictors less obvious : dependence structure (SAC & SPAC together) previous values (autoregressive, p) previous errors (moving average, q) assess model adequacy RSAC & RSPAC die down quickly should have nothing left small standard error (S) & small Ljung-Box statistic (Q ) forecast (point & interval) with adequate model want tight forecasting intervals how far into future? (t = n + τ, τ > 0) good summary / comparison plot: forecast with confidence limits (sketch) Now a case study 8
at least 50 and preferably 100 observations should be available to build a proper model
III Box-Jenkins Methods 1. Pros and Cons of ARIMA Forecasting a) need for data at least 50 and preferably 100 observations should be available to build a proper model used most frequently for hourly or
More informationCh 6. Model Specification. Time Series Analysis
We start to build ARIMA(p,d,q) models. The subjects include: 1 how to determine p, d, q for a given series (Chapter 6); 2 how to estimate the parameters (φ s and θ s) of a specific ARIMA(p,d,q) model (Chapter
More informationTIME SERIES ANALYSIS AND FORECASTING USING THE STATISTICAL MODEL ARIMA
CHAPTER 6 TIME SERIES ANALYSIS AND FORECASTING USING THE STATISTICAL MODEL ARIMA 6.1. Introduction A time series is a sequence of observations ordered in time. A basic assumption in the time series analysis
More informationCircle a single answer for each multiple choice question. Your choice should be made clearly.
TEST #1 STA 4853 March 4, 215 Name: Please read the following directions. DO NOT TURN THE PAGE UNTIL INSTRUCTED TO DO SO Directions This exam is closed book and closed notes. There are 31 questions. Circle
More informationChapter 12: An introduction to Time Series Analysis. Chapter 12: An introduction to Time Series Analysis
Chapter 12: An introduction to Time Series Analysis Introduction In this chapter, we will discuss forecasting with single-series (univariate) Box-Jenkins models. The common name of the models is Auto-Regressive
More informationRoss Bettinger, Analytical Consultant, Seattle, WA
ABSTRACT DYNAMIC REGRESSION IN ARIMA MODELING Ross Bettinger, Analytical Consultant, Seattle, WA Box-Jenkins time series models that contain exogenous predictor variables are called dynamic regression
More informationUniversity of Oxford. Statistical Methods Autocorrelation. Identification and Estimation
University of Oxford Statistical Methods Autocorrelation Identification and Estimation Dr. Órlaith Burke Michaelmas Term, 2011 Department of Statistics, 1 South Parks Road, Oxford OX1 3TG Contents 1 Model
More informationModule 3. Descriptive Time Series Statistics and Introduction to Time Series Models
Module 3 Descriptive Time Series Statistics and Introduction to Time Series Models Class notes for Statistics 451: Applied Time Series Iowa State University Copyright 2015 W Q Meeker November 11, 2015
More informationFE570 Financial Markets and Trading. Stevens Institute of Technology
FE570 Financial Markets and Trading Lecture 5. Linear Time Series Analysis and Its Applications (Ref. Joel Hasbrouck - Empirical Market Microstructure ) Steve Yang Stevens Institute of Technology 9/25/2012
More informationEASTERN MEDITERRANEAN UNIVERSITY ECON 604, FALL 2007 DEPARTMENT OF ECONOMICS MEHMET BALCILAR ARIMA MODELS: IDENTIFICATION
ARIMA MODELS: IDENTIFICATION A. Autocorrelations and Partial Autocorrelations 1. Summary of What We Know So Far: a) Series y t is to be modeled by Box-Jenkins methods. The first step was to convert y t
More informationMODELING INFLATION RATES IN NIGERIA: BOX-JENKINS APPROACH. I. U. Moffat and A. E. David Department of Mathematics & Statistics, University of Uyo, Uyo
Vol.4, No.2, pp.2-27, April 216 MODELING INFLATION RATES IN NIGERIA: BOX-JENKINS APPROACH I. U. Moffat and A. E. David Department of Mathematics & Statistics, University of Uyo, Uyo ABSTRACT: This study
More information2. An Introduction to Moving Average Models and ARMA Models
. An Introduction to Moving Average Models and ARMA Models.1 White Noise. The MA(1) model.3 The MA(q) model..4 Estimation and forecasting of MA models..5 ARMA(p,q) models. The Moving Average (MA) models
More informationUnivariate ARIMA Models
Univariate ARIMA Models ARIMA Model Building Steps: Identification: Using graphs, statistics, ACFs and PACFs, transformations, etc. to achieve stationary and tentatively identify patterns and model components.
More informationARIMA Models. Jamie Monogan. January 16, University of Georgia. Jamie Monogan (UGA) ARIMA Models January 16, / 27
ARIMA Models Jamie Monogan University of Georgia January 16, 2018 Jamie Monogan (UGA) ARIMA Models January 16, 2018 1 / 27 Objectives By the end of this meeting, participants should be able to: Argue why
More informationChapter 6: Model Specification for Time Series
Chapter 6: Model Specification for Time Series The ARIMA(p, d, q) class of models as a broad class can describe many real time series. Model specification for ARIMA(p, d, q) models involves 1. Choosing
More informationThe ARIMA Procedure: The ARIMA Procedure
Page 1 of 120 Overview: ARIMA Procedure Getting Started: ARIMA Procedure The Three Stages of ARIMA Modeling Identification Stage Estimation and Diagnostic Checking Stage Forecasting Stage Using ARIMA Procedure
More informationSTAT 443 Final Exam Review. 1 Basic Definitions. 2 Statistical Tests. L A TEXer: W. Kong
STAT 443 Final Exam Review L A TEXer: W Kong 1 Basic Definitions Definition 11 The time series {X t } with E[X 2 t ] < is said to be weakly stationary if: 1 µ X (t) = E[X t ] is independent of t 2 γ X
More informationSTAT Financial Time Series
STAT 6104 - Financial Time Series Chapter 4 - Estimation in the time Domain Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 1 / 46 Agenda 1 Introduction 2 Moment Estimates 3 Autoregressive Models (AR
More informationUnivariate Time Series Analysis; ARIMA Models
Econometrics 2 Fall 24 Univariate Time Series Analysis; ARIMA Models Heino Bohn Nielsen of4 Outline of the Lecture () Introduction to univariate time series analysis. (2) Stationarity. (3) Characterizing
More informationWe will only present the general ideas on how to obtain. follow closely the AR(1) and AR(2) cases presented before.
ACF and PACF of an AR(p) We will only present the general ideas on how to obtain the ACF and PACF of an AR(p) model since the details follow closely the AR(1) and AR(2) cases presented before. Recall that
More informationFORECASTING SUGARCANE PRODUCTION IN INDIA WITH ARIMA MODEL
FORECASTING SUGARCANE PRODUCTION IN INDIA WITH ARIMA MODEL B. N. MANDAL Abstract: Yearly sugarcane production data for the period of - to - of India were analyzed by time-series methods. Autocorrelation
More informationClassic Time Series Analysis
Classic Time Series Analysis Concepts and Definitions Let Y be a random number with PDF f Y t ~f,t Define t =E[Y t ] m(t) is known as the trend Define the autocovariance t, s =COV [Y t,y s ] =E[ Y t t
More information1 Linear Difference Equations
ARMA Handout Jialin Yu 1 Linear Difference Equations First order systems Let {ε t } t=1 denote an input sequence and {y t} t=1 sequence generated by denote an output y t = φy t 1 + ε t t = 1, 2,... with
More informationARIMA Models. Jamie Monogan. January 25, University of Georgia. Jamie Monogan (UGA) ARIMA Models January 25, / 38
ARIMA Models Jamie Monogan University of Georgia January 25, 2012 Jamie Monogan (UGA) ARIMA Models January 25, 2012 1 / 38 Objectives By the end of this meeting, participants should be able to: Describe
More informationIntroduction to ARMA and GARCH processes
Introduction to ARMA and GARCH processes Fulvio Corsi SNS Pisa 3 March 2010 Fulvio Corsi Introduction to ARMA () and GARCH processes SNS Pisa 3 March 2010 1 / 24 Stationarity Strict stationarity: (X 1,
More informationEconometrics II Heij et al. Chapter 7.1
Chapter 7.1 p. 1/2 Econometrics II Heij et al. Chapter 7.1 Linear Time Series Models for Stationary data Marius Ooms Tinbergen Institute Amsterdam Chapter 7.1 p. 2/2 Program Introduction Modelling philosophy
More informationLecture 1: Fundamental concepts in Time Series Analysis (part 2)
Lecture 1: Fundamental concepts in Time Series Analysis (part 2) Florian Pelgrin University of Lausanne, École des HEC Department of mathematics (IMEA-Nice) Sept. 2011 - Jan. 2012 Florian Pelgrin (HEC)
More informationMarcel Dettling. Applied Time Series Analysis SS 2013 Week 05. ETH Zürich, March 18, Institute for Data Analysis and Process Design
Marcel Dettling Institute for Data Analysis and Process Design Zurich University of Applied Sciences marcel.dettling@zhaw.ch http://stat.ethz.ch/~dettling ETH Zürich, March 18, 2013 1 Basics of Modeling
More informationEconometría 2: Análisis de series de Tiempo
Econometría 2: Análisis de series de Tiempo Karoll GOMEZ kgomezp@unal.edu.co http://karollgomez.wordpress.com Segundo semestre 2016 III. Stationary models 1 Purely random process 2 Random walk (non-stationary)
More informationLecture 3: Autoregressive Moving Average (ARMA) Models and their Practical Applications
Lecture 3: Autoregressive Moving Average (ARMA) Models and their Practical Applications Prof. Massimo Guidolin 20192 Financial Econometrics Winter/Spring 2018 Overview Moving average processes Autoregressive
More informationChapter 8: Model Diagnostics
Chapter 8: Model Diagnostics Model diagnostics involve checking how well the model fits. If the model fits poorly, we consider changing the specification of the model. A major tool of model diagnostics
More informationAPPLIED ECONOMETRIC TIME SERIES 4TH EDITION
APPLIED ECONOMETRIC TIME SERIES 4TH EDITION Chapter 2: STATIONARY TIME-SERIES MODELS WALTER ENDERS, UNIVERSITY OF ALABAMA Copyright 2015 John Wiley & Sons, Inc. Section 1 STOCHASTIC DIFFERENCE EQUATION
More informationCh 8. MODEL DIAGNOSTICS. Time Series Analysis
Model diagnostics is concerned with testing the goodness of fit of a model and, if the fit is poor, suggesting appropriate modifications. We shall present two complementary approaches: analysis of residuals
More informationA Data-Driven Model for Software Reliability Prediction
A Data-Driven Model for Software Reliability Prediction Author: Jung-Hua Lo IEEE International Conference on Granular Computing (2012) Young Taek Kim KAIST SE Lab. 9/4/2013 Contents Introduction Background
More informationCircle the single best answer for each multiple choice question. Your choice should be made clearly.
TEST #1 STA 4853 March 6, 2017 Name: Please read the following directions. DO NOT TURN THE PAGE UNTIL INSTRUCTED TO DO SO Directions This exam is closed book and closed notes. There are 32 multiple choice
More informationLesson 13: Box-Jenkins Modeling Strategy for building ARMA models
Lesson 13: Box-Jenkins Modeling Strategy for building ARMA models Facoltà di Economia Università dell Aquila umberto.triacca@gmail.com Introduction In this lesson we present a method to construct an ARMA(p,
More information3 Theory of stationary random processes
3 Theory of stationary random processes 3.1 Linear filters and the General linear process A filter is a transformation of one random sequence {U t } into another, {Y t }. A linear filter is a transformation
More informationForecasting using R. Rob J Hyndman. 2.4 Non-seasonal ARIMA models. Forecasting using R 1
Forecasting using R Rob J Hyndman 2.4 Non-seasonal ARIMA models Forecasting using R 1 Outline 1 Autoregressive models 2 Moving average models 3 Non-seasonal ARIMA models 4 Partial autocorrelations 5 Estimation
More information6 NONSEASONAL BOX-JENKINS MODELS
6 NONSEASONAL BOX-JENKINS MODELS In this section, we will discuss a class of models for describing time series commonly referred to as Box-Jenkins models. There are two types of Box-Jenkins models, seasonal
More informationCh 9. FORECASTING. Time Series Analysis
In this chapter, we assume the model is known exactly, and consider the calculation of forecasts and their properties for both deterministic trend models and ARIMA models. 9.1 Minimum Mean Square Error
More informationLecture 2: Univariate Time Series
Lecture 2: Univariate Time Series Analysis: Conditional and Unconditional Densities, Stationarity, ARMA Processes Prof. Massimo Guidolin 20192 Financial Econometrics Spring/Winter 2017 Overview Motivation:
More informationarxiv: v1 [stat.me] 5 Nov 2008
arxiv:0811.0659v1 [stat.me] 5 Nov 2008 Estimation of missing data by using the filtering process in a time series modeling Ahmad Mahir R. and Al-khazaleh A. M. H. School of Mathematical Sciences Faculty
More information{ } Stochastic processes. Models for time series. Specification of a process. Specification of a process. , X t3. ,...X tn }
Stochastic processes Time series are an example of a stochastic or random process Models for time series A stochastic process is 'a statistical phenomenon that evolves in time according to probabilistic
More information5 Autoregressive-Moving-Average Modeling
5 Autoregressive-Moving-Average Modeling 5. Purpose. Autoregressive-moving-average (ARMA models are mathematical models of the persistence, or autocorrelation, in a time series. ARMA models are widely
More informationDecision 411: Class 9. HW#3 issues
Decision 411: Class 9 Presentation/discussion of HW#3 Introduction to ARIMA models Rules for fitting nonseasonal models Differencing and stationarity Reading the tea leaves : : ACF and PACF plots Unit
More informationTime Series I Time Domain Methods
Astrostatistics Summer School Penn State University University Park, PA 16802 May 21, 2007 Overview Filtering and the Likelihood Function Time series is the study of data consisting of a sequence of DEPENDENT
More informationAR(p) + I(d) + MA(q) = ARIMA(p, d, q)
AR(p) + I(d) + MA(q) = ARIMA(p, d, q) Outline 1 4.1: Nonstationarity in the Mean 2 ARIMA Arthur Berg AR(p) + I(d)+ MA(q) = ARIMA(p, d, q) 2/ 19 Deterministic Trend Models Polynomial Trend Consider the
More informationBasics: Definitions and Notation. Stationarity. A More Formal Definition
Basics: Definitions and Notation A Univariate is a sequence of measurements of the same variable collected over (usually regular intervals of) time. Usual assumption in many time series techniques is that
More informationQuantitative Finance I
Quantitative Finance I Linear AR and MA Models (Lecture 4) Winter Semester 01/013 by Lukas Vacha * If viewed in.pdf format - for full functionality use Mathematica 7 (or higher) notebook (.nb) version
More informationCHAPTER 8 FORECASTING PRACTICE I
CHAPTER 8 FORECASTING PRACTICE I Sometimes we find time series with mixed AR and MA properties (ACF and PACF) We then can use mixed models: ARMA(p,q) These slides are based on: González-Rivera: Forecasting
More informationScenario 5: Internet Usage Solution. θ j
Scenario : Internet Usage Solution Some more information would be interesting about the study in order to know if we can generalize possible findings. For example: Does each data point consist of the total
More informationAdvanced Econometrics
Advanced Econometrics Marco Sunder Nov 04 2010 Marco Sunder Advanced Econometrics 1/ 25 Contents 1 2 3 Marco Sunder Advanced Econometrics 2/ 25 Music Marco Sunder Advanced Econometrics 3/ 25 Music Marco
More informationSome Time-Series Models
Some Time-Series Models Outline 1. Stochastic processes and their properties 2. Stationary processes 3. Some properties of the autocorrelation function 4. Some useful models Purely random processes, random
More informationTime Series Analysis
Time Series Analysis hm@imm.dtu.dk Informatics and Mathematical Modelling Technical University of Denmark DK-2800 Kgs. Lyngby 1 Outline of the lecture Chapter 9 Multivariate time series 2 Transfer function
More informationSuan Sunandha Rajabhat University
Forecasting Exchange Rate between Thai Baht and the US Dollar Using Time Series Analysis Kunya Bowornchockchai Suan Sunandha Rajabhat University INTRODUCTION The objective of this research is to forecast
More informationLecture 4a: ARMA Model
Lecture 4a: ARMA Model 1 2 Big Picture Most often our goal is to find a statistical model to describe real time series (estimation), and then predict the future (forecasting) One particularly popular model
More informationApplied time-series analysis
Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna October 18, 2011 Outline Introduction and overview Econometric Time-Series Analysis In principle,
More informationModule 4. Stationary Time Series Models Part 1 MA Models and Their Properties
Module 4 Stationary Time Series Models Part 1 MA Models and Their Properties Class notes for Statistics 451: Applied Time Series Iowa State University Copyright 2015 W. Q. Meeker. February 14, 2016 20h
More informationProf. Dr. Roland Füss Lecture Series in Applied Econometrics Summer Term Introduction to Time Series Analysis
Introduction to Time Series Analysis 1 Contents: I. Basics of Time Series Analysis... 4 I.1 Stationarity... 5 I.2 Autocorrelation Function... 9 I.3 Partial Autocorrelation Function (PACF)... 14 I.4 Transformation
More informationLesson 2: Analysis of time series
Lesson 2: Analysis of time series Time series Main aims of time series analysis choosing right model statistical testing forecast driving and optimalisation Problems in analysis of time series time problems
More informationECON/FIN 250: Forecasting in Finance and Economics: Section 6: Standard Univariate Models
ECON/FIN 250: Forecasting in Finance and Economics: Section 6: Standard Univariate Models Patrick Herb Brandeis University Spring 2016 Patrick Herb (Brandeis University) Standard Univariate Models ECON/FIN
More informationTheoretical and Simulation-guided Exploration of the AR(1) Model
Theoretical and Simulation-guided Exploration of the AR() Model Overview: Section : Motivation Section : Expectation A: Theory B: Simulation Section : Variance A: Theory B: Simulation Section : ACF A:
More informationForecasting. Simon Shaw 2005/06 Semester II
Forecasting Simon Shaw s.c.shaw@maths.bath.ac.uk 2005/06 Semester II 1 Introduction A critical aspect of managing any business is planning for the future. events is called forecasting. Predicting future
More informationEstimation and application of best ARIMA model for forecasting the uranium price.
Estimation and application of best ARIMA model for forecasting the uranium price. Medeu Amangeldi May 13, 2018 Capstone Project Superviser: Dongming Wei Second reader: Zhenisbek Assylbekov Abstract This
More informationDynamic Time Series Regression: A Panacea for Spurious Correlations
International Journal of Scientific and Research Publications, Volume 6, Issue 10, October 2016 337 Dynamic Time Series Regression: A Panacea for Spurious Correlations Emmanuel Alphonsus Akpan *, Imoh
More informationCh 4. Models For Stationary Time Series. Time Series Analysis
This chapter discusses the basic concept of a broad class of stationary parametric time series models the autoregressive moving average (ARMA) models. Let {Y t } denote the observed time series, and {e
More informationAutoregressive Moving Average (ARMA) Models and their Practical Applications
Autoregressive Moving Average (ARMA) Models and their Practical Applications Massimo Guidolin February 2018 1 Essential Concepts in Time Series Analysis 1.1 Time Series and Their Properties Time series:
More informationTime Series Analysis -- An Introduction -- AMS 586
Time Series Analysis -- An Introduction -- AMS 586 1 Objectives of time series analysis Data description Data interpretation Modeling Control Prediction & Forecasting 2 Time-Series Data Numerical data
More information5 Transfer function modelling
MSc Further Time Series Analysis 5 Transfer function modelling 5.1 The model Consider the construction of a model for a time series (Y t ) whose values are influenced by the earlier values of a series
More informationModelling Monthly Rainfall Data of Port Harcourt, Nigeria by Seasonal Box-Jenkins Methods
International Journal of Sciences Research Article (ISSN 2305-3925) Volume 2, Issue July 2013 http://www.ijsciences.com Modelling Monthly Rainfall Data of Port Harcourt, Nigeria by Seasonal Box-Jenkins
More informationEmpirical Market Microstructure Analysis (EMMA)
Empirical Market Microstructure Analysis (EMMA) Lecture 3: Statistical Building Blocks and Econometric Basics Prof. Dr. Michael Stein michael.stein@vwl.uni-freiburg.de Albert-Ludwigs-University of Freiburg
More informationBox-Jenkins ARIMA Advanced Time Series
Box-Jenkins ARIMA Advanced Time Series www.realoptionsvaluation.com ROV Technical Papers Series: Volume 25 Theory In This Issue 1. Learn about Risk Simulator s ARIMA and Auto ARIMA modules. 2. Find out
More informationSeasonal Autoregressive Integrated Moving Average Model for Precipitation Time Series
Journal of Mathematics and Statistics 8 (4): 500-505, 2012 ISSN 1549-3644 2012 doi:10.3844/jmssp.2012.500.505 Published Online 8 (4) 2012 (http://www.thescipub.com/jmss.toc) Seasonal Autoregressive Integrated
More informationReview Session: Econometrics - CLEFIN (20192)
Review Session: Econometrics - CLEFIN (20192) Part II: Univariate time series analysis Daniele Bianchi March 20, 2013 Fundamentals Stationarity A time series is a sequence of random variables x t, t =
More informationThe Identification of ARIMA Models
APPENDIX 4 The Identification of ARIMA Models As we have established in a previous lecture, there is a one-to-one correspondence between the parameters of an ARMA(p, q) model, including the variance of
More informationProblem Set 2: Box-Jenkins methodology
Problem Set : Box-Jenkins methodology 1) For an AR1) process we have: γ0) = σ ε 1 φ σ ε γ0) = 1 φ Hence, For a MA1) process, p lim R = φ γ0) = 1 + θ )σ ε σ ε 1 = γ0) 1 + θ Therefore, p lim R = 1 1 1 +
More informationCh 5. Models for Nonstationary Time Series. Time Series Analysis
We have studied some deterministic and some stationary trend models. However, many time series data cannot be modeled in either way. Ex. The data set oil.price displays an increasing variation from the
More informationRead Section 1.1, Examples of time series, on pages 1-8. These example introduce the book; you are not tested on them.
TS Module 1 Time series overview (The attached PDF file has better formatting.)! Model building! Time series plots Read Section 1.1, Examples of time series, on pages 1-8. These example introduce the book;
More informationLecture 1: Stationary Time Series Analysis
Syllabus Stationarity ARMA AR MA Model Selection Estimation Lecture 1: Stationary Time Series Analysis 222061-1617: Time Series Econometrics Spring 2018 Jacek Suda Syllabus Stationarity ARMA AR MA Model
More informationA SEASONAL TIME SERIES MODEL FOR NIGERIAN MONTHLY AIR TRAFFIC DATA
www.arpapress.com/volumes/vol14issue3/ijrras_14_3_14.pdf A SEASONAL TIME SERIES MODEL FOR NIGERIAN MONTHLY AIR TRAFFIC DATA Ette Harrison Etuk Department of Mathematics/Computer Science, Rivers State University
More informationNote: The primary reference for these notes is Enders (2004). An alternative and more technical treatment can be found in Hamilton (1994).
Chapter 4 Analysis of a Single Time Series Note: The primary reference for these notes is Enders (4). An alternative and more technical treatment can be found in Hamilton (994). Most data used in financial
More informationSAS/ETS 14.1 User s Guide. The ARIMA Procedure
SAS/ETS 14.1 User s Guide The ARIMA Procedure This document is an individual chapter from SAS/ETS 14.1 User s Guide. The correct bibliographic citation for this manual is as follows: SAS Institute Inc.
More informationPart 1. Multiple Choice (50 questions, 1 point each) Part 2. Problems/Short Answer (10 questions, 5 points each)
GROUND RULES: This exam contains two parts: Part 1. Multiple Choice (50 questions, 1 point each) Part 2. Problems/Short Answer (10 questions, 5 points each) The maximum number of points on this exam is
More informationLecture 19 Box-Jenkins Seasonal Models
Lecture 19 Box-Jenkins Seasonal Models If the time series is nonstationary with respect to its variance, then we can stabilize the variance of the time series by using a pre-differencing transformation.
More informationLecture 3: Autoregressive Moving Average (ARMA) Models and their Practical Applications
Lecture 3: Autoregressive Moving Average (ARMA) Models and their Practical Applications Prof. Massimo Guidolin 20192 Financial Econometrics Winter/Spring 2018 Overview Moving average processes Autoregressive
More informationNANYANG TECHNOLOGICAL UNIVERSITY SEMESTER II EXAMINATION MAS451/MTH451 Time Series Analysis TIME ALLOWED: 2 HOURS
NANYANG TECHNOLOGICAL UNIVERSITY SEMESTER II EXAMINATION 2012-2013 MAS451/MTH451 Time Series Analysis May 2013 TIME ALLOWED: 2 HOURS INSTRUCTIONS TO CANDIDATES 1. This examination paper contains FOUR (4)
More informationECON/FIN 250: Forecasting in Finance and Economics: Section 7: Unit Roots & Dickey-Fuller Tests
ECON/FIN 250: Forecasting in Finance and Economics: Section 7: Unit Roots & Dickey-Fuller Tests Patrick Herb Brandeis University Spring 2016 Patrick Herb (Brandeis University) Unit Root Tests ECON/FIN
More informationFinal Examination 7/6/2011
The Islamic University of Gaza Faculty of Commerce Department of Economics & Applied Statistics Time Series Analysis - Dr. Samir Safi Spring Semester 211 Final Examination 7/6/211 Name: ID: INSTRUCTIONS:
More informationUnivariate, Nonstationary Processes
Univariate, Nonstationary Processes Jamie Monogan University of Georgia March 20, 2018 Jamie Monogan (UGA) Univariate, Nonstationary Processes March 20, 2018 1 / 14 Objectives By the end of this meeting,
More informationITSM-R Reference Manual
ITSM-R Reference Manual George Weigt February 11, 2018 1 Contents 1 Introduction 3 1.1 Time series analysis in a nutshell............................... 3 1.2 White Noise Variance.....................................
More informationTime Series Analysis
Time Series Analysis Christopher Ting http://mysmu.edu.sg/faculty/christophert/ christopherting@smu.edu.sg Quantitative Finance Singapore Management University March 3, 2017 Christopher Ting Week 9 March
More informationTime Series 2. Robert Almgren. Sept. 21, 2009
Time Series 2 Robert Almgren Sept. 21, 2009 This week we will talk about linear time series models: AR, MA, ARMA, ARIMA, etc. First we will talk about theory and after we will talk about fitting the models
More informationARMA (and ARIMA) models are often expressed in backshift notation.
Backshift Notation ARMA (and ARIMA) models are often expressed in backshift notation. B is the backshift operator (also called the lag operator ). It operates on time series, and means back up by one time
More informationA SARIMAX coupled modelling applied to individual load curves intraday forecasting
A SARIMAX coupled modelling applied to individual load curves intraday forecasting Frédéric Proïa Workshop EDF Institut Henri Poincaré - Paris 05 avril 2012 INRIA Bordeaux Sud-Ouest Institut de Mathématiques
More informationIntroduction to Time Series Analysis. Lecture 11.
Introduction to Time Series Analysis. Lecture 11. Peter Bartlett 1. Review: Time series modelling and forecasting 2. Parameter estimation 3. Maximum likelihood estimator 4. Yule-Walker estimation 5. Yule-Walker
More informationIDENTIFICATION OF ARMA MODELS
IDENTIFICATION OF ARMA MODELS A stationary stochastic process can be characterised, equivalently, by its autocovariance function or its partial autocovariance function. It can also be characterised by
More informationLecture note 2 considered the statistical analysis of regression models for time
DYNAMIC MODELS FOR STATIONARY TIME SERIES Econometrics 2 LectureNote4 Heino Bohn Nielsen March 2, 2007 Lecture note 2 considered the statistical analysis of regression models for time series data, and
More informationTMA4285 December 2015 Time series models, solution.
Norwegian University of Science and Technology Department of Mathematical Sciences Page of 5 TMA4285 December 205 Time series models, solution. Problem a) (i) The slow decay of the ACF of z t suggest that
More informationTIME SERIES ANALYSIS. Forecasting and Control. Wiley. Fifth Edition GWILYM M. JENKINS GEORGE E. P. BOX GREGORY C. REINSEL GRETA M.
TIME SERIES ANALYSIS Forecasting and Control Fifth Edition GEORGE E. P. BOX GWILYM M. JENKINS GREGORY C. REINSEL GRETA M. LJUNG Wiley CONTENTS PREFACE TO THE FIFTH EDITION PREFACE TO THE FOURTH EDITION
More informationγ 0 = Var(X i ) = Var(φ 1 X i 1 +W i ) = φ 2 1γ 0 +σ 2, which implies that we must have φ 1 < 1, and γ 0 = σ2 . 1 φ 2 1 We may also calculate for j 1
4.2 Autoregressive (AR) Moving average models are causal linear processes by definition. There is another class of models, based on a recursive formulation similar to the exponentially weighted moving
More information