ARIMA Models. Jamie Monogan. January 25, University of Georgia. Jamie Monogan (UGA) ARIMA Models January 25, / 38
|
|
- Arthur Lucas
- 6 years ago
- Views:
Transcription
1 ARIMA Models Jamie Monogan University of Georgia January 25, 2012 Jamie Monogan (UGA) ARIMA Models January 25, / 38
2 Objectives By the end of this meeting, participants should be able to: Describe the logic of the Box-Jenkins modeling strategy. Define stationarity and describe the processes of a stationary series. Solve for algebraic properties of difference equations of ARIMA processes. Explain why Maximum Likelihood Estimation is essential for ARIMA models and how MLE is tailored to time series needs. Identify, estimate, and diagnose ARIMA models. Perform a static time series regression with ARIMA errors. Jamie Monogan (UGA) ARIMA Models January 25, / 38
3 Structure, Error, and Procedure Modeling Form Regression y t = {β 0 + β 1 x 1 + β 2 X 2 + } + u t = {structure} + error The two components are structure and error: Y = structure + error Box-Jenkins y t = [transfer function] + ARIMA Model y t =f(x) + N t So we start out working on ARIMA models of error aggregation, the N t, and then later develop transfer functions as tests of theories we care about. (Opposite what we usually do.) The causal flow of the transfer function cannot be observed until we successfully model the error processes. Jamie Monogan (UGA) ARIMA Models January 25, / 38
4 Structure, Error, and Procedure How a Time Series is Produced We assume the data generating process is: a t Linear filter z t A white noise input is systematically filtered into the observed time series. Getting Back to White Noise a t Linear filter z t implies z t Inverse of Linear filter a t So, if we can solve for z= f(a), then we can invert f and produce a (which is white noise). Jamie Monogan (UGA) ARIMA Models January 25, / 38
5 Structure, Error, and Procedure The Box-Jenkins Procedure Identification What class of models probably produced z t? Estimation What are the model parameters? Diagnosis Are the residuals, a t, from the estimated model white noise? Empirically Identifying the Error Process We can infer the data generating process because knowing the mathematics, we know the empirical signature. We will develop the signatures of a family of error aggregation models that are autoregressive (AR), integrated (I), moving average (MA) and all combinations ARIMA(P,D,Q) Jamie Monogan (UGA) ARIMA Models January 25, / 38
6 Structure, Error, and Procedure AR(1) Example AR(1): A very important special case Notation: AR(1) means autoregressive, 1st order Only the first lag of z appears in the equation z t = θ 0 + φ 1 z t 1 + a t What is its signature? To answer that question it is useful to transform the equation into shock form, where z is a function of all previous a s. z t = θ 0 + a t + φ 1 a t 1 + φ 2 a t 2 + φ 3 a t 3 + φ t 1 a 1 Jamie Monogan (UGA) ARIMA Models January 25, / 38
7 Structure, Error, and Procedure AR(1) Example AR(1) That s an ugly equation that has T terms, but it has useful information about the expected association of each of the a s with z t. At lag 1: φ, that is φ 1 2: φ 2 3: φ 3 4: φ 4 k: φ k etc. Jamie Monogan (UGA) ARIMA Models January 25, / 38
8 AR(1) Structure, Error, and Procedure AR(1) Example Since φ is constrained to be <1.0, that means that each exponential power of φ is a progressively smaller number, looking like: Jamie Monogan (UGA) ARIMA Models January 25, / 38
9 Structure, Error, and Procedure AR(1) Example Next Steps If we observe an empirical series that shows this (very common) pattern of autocorrelation (and a couple other details), we judge it to be AR(1) This is the IDENTIFICATION stage: we re using empirical evidence such as correlograms to determine the error process. Once we ve tentatively judged the class of model, we estimate the parameters of such a model using MLE (ARIMA ESTIMATION, more later). After we estimate the model, calculate the residuals, a t. Now the really neat part: If our judgment was correct, a t, the estimated residuals must be white noise and we know how to test for that property! (DIAGNOSIS) If it is white noise, then we can use this filtered series for our analysis. Jamie Monogan (UGA) ARIMA Models January 25, / 38
10 Stationarity and Integration Stationarity and Integration A stationary series is one that tends to return to some equilibrium level after being disburbed. A nonstationary series, or an integrated series, has no equilibrium. The most common integrated series is the random walk (i.e., DJIA). Box-Jenkins models are defined only for stationary time series. The good news: Integrated series can be made stationary by differencing them. (Which you know how to do.) How to Know Stationarity The ACF of a stationary series tends to approach zero after just a few lags And stay there. Integrated series show systematic behavior over very long lag lengths. In the regression tradition, we will develop the Dickey-Fuller test for unit roots. Jamie Monogan (UGA) ARIMA Models January 25, / 38
11 Stationarity and Integration Macropartisanship: A Non-stationary Series Jamie Monogan (UGA) ARIMA Models January 25, / 38
12 Notation AR(1) Notation: Box-Jenkins and Econometrics Enders: y t = α 0 + α 1 y t 1 + ɛ t Box-Jenkins: z t = θ 0 + φ 1 z t 1 + a t For MA processes, α becomes β and φ becomes θ Jamie Monogan (UGA) ARIMA Models January 25, / 38
13 Notation Notation for the Random Walk Process (an I(1) series) z t = z t 1 + a t z t z t 1 = a t (subtracting z t 1 ) B 0 z t Bz t = a t (by definition of B) (B 0 B)z t = a t (factoring by z t ) (1 B)z t = a t (the result) (1 B)z = a Jamie Monogan (UGA) ARIMA Models January 25, / 38
14 Notation The General ARMA(P,Q) Model p q z t = θ 0 + φ i z t i + θ i a t i + a t i=1 i=1 In Enders (Regression) Notation: p q y t = α 0 + α i y t i + β i ɛ t i + ɛ t i=1 i=1 Jamie Monogan (UGA) ARIMA Models January 25, / 38
15 Notation The Shock Form of AR and I Models The AR(1) Model Functional: z t = φz t 1 + a t where -1 < φ < 1 Backshift: (1 - φb)z t = a t Shock form: z t = a t + φa t 1 + φ 2 a t 2 + φ 3 a t φ T a 0 Jamie Monogan (UGA) ARIMA Models January 25, / 38
16 Notation The Shock Form of AR and I Models The MA(1) Model Functional: z t = θ 0 + a t - θ 1 a t 1 Backshift: z t = θ 0 + (1 - θ 1 B)a t The shock form is MA, so there is no expansion Jamie Monogan (UGA) ARIMA Models January 25, / 38
17 Notation The Shock Form of AR and I Models AR(1) inverted to shock form z t = φz t 1 + a t z t 1 = φz t 2 + a t 1 (from stationarity) z t = φ(φz t 2 + a t 1 ) + a t substituting z t = φa t 1 + φ 2 z t 2 + a t z t = φa t 1 + φ 2 a t 2 + φ 3 z t 3 + a t... z t = a t + φa t 1 + φ 2 a t 2 + φ 3 a t φ T a t T thus the ACF we expect to see is exponential decay: 1+ φ + φ 2 + φ Jamie Monogan (UGA) ARIMA Models January 25, / 38
18 I(1) in shock form Notation The Shock Form of AR and I Models z t = a t + a t 1 + a t 2 + a t a 0 Note difference from AR(1): There are no decay parameters on the old shocks. Their influence persists forever. Jamie Monogan (UGA) ARIMA Models January 25, / 38
19 Notation The Shock Form of AR and I Models MA(1) is in shock form in normal notation z t = θ 0 + a t - θ 1 a t 1 ACF: E(ρ 1 ) = -θ 1 /(1 + θ 2 1 ) Crude empirical rule of thumb: ACF(1)= -θ 1 /2. Which implies ACF(1) negative and less than.5 in absolute value. Jamie Monogan (UGA) ARIMA Models January 25, / 38
20 Notation The Shock Form of AR and I Models The Partial Autocorrelation Function The PACF shows the autocorrelation at lag k controlling for all previous lags. Thus it shows the effects at lag k which could not have been predicted from lower lags. In effect then, it shows the independent effects of processes at lag k. PACF(1) = ACF(1) Jamie Monogan (UGA) ARIMA Models January 25, / 38
21 Identification Issues Some Low Order Models White noise z = a Random walk z t - z t 1 = a t (1 - B)z = a z = a [i.e., cumulated white noise] AR(1) z t = φz t 1 + a t (1 - φb)z = a Note that (1 - φb) = a for φ=1.0 is then exactly a random walk. φ = 1.0 is called a unit root. Jamie Monogan (UGA) ARIMA Models January 25, / 38
22 Identification Issues Low Order with MA Components MA(1) z t = a t - θa t 1 z = (1 - θb)a IMA(1,1) (1 - B)z = (1 - θb)a Thus an IMA(1,1) is simply a MA(1) operating on first differences. ARMA(1,1) (1 - φb)z = (1 - θb)a Jamie Monogan (UGA) ARIMA Models January 25, / 38
23 Identification Issues Cookbook Rules for Identification For More Detail: Enders 2010, 68 AR(P) Exponential decay in the ACF, P significant spikes in the PACF I(1) Slow decay in the ACF, 1 significant spike in the PACF MA(Q) Q significant spikes in the ACF, exponential decay in the PACF Jamie Monogan (UGA) ARIMA Models January 25, / 38
24 Least Squares and MLE Estimation Some ARIMA models, e.g., AR(1), are essentially linear and could be estimated by least squares. For example z t = φ 1 z t 1 + a t can be estimated by least squares regression if you just drop the first case. R: z <- ts(data$z1) l.z <- lag(z, -1) data2 <- ts.union(z, l.z) reg.1 <- lm(z l.z, data=data2) Stata: tsset month, then reg z l.z The coefficient on the lagged dependent variable is a LS estimate of φ 1 Jamie Monogan (UGA) ARIMA Models January 25, / 38
25 Estimation LS and MLE, cont. In practice ARIMA software uses a generalized maximum likelihood algorithm for all ARIMA models. The φ s estimated by LS and ML are not identical, but the difference is nearly always trivial. This is not a case like OLS, where LS and ML solutions are proven identical when OLS assumptions hold. Jamie Monogan (UGA) ARIMA Models January 25, / 38
26 Estimation Maximum Likelihood Unmasked Maximum Likelihood Estimation is really nothing more than efficient trial and error. It has three components: 1 A function to be maximized, the log of likelihood for the equation Why log instead of likelihood itself? 2 An algorithm for generating efficient guesses of parameter values 3 Starting values for the parameters. Jamie Monogan (UGA) ARIMA Models January 25, / 38
27 Estimation Maximum Likelihood Estimation for the Nonlinear MA(1) Case MA(1) Model: z t = θ 0 - θ 1 a t 1 + a t a t is Normal(0,σ 2 ) Assume: a 0 = 0 (Conditional maximum likelihood) Problem: Find θ 1 such that L(θ 1 z, a 0 = 0) is a maximum Jamie Monogan (UGA) ARIMA Models January 25, / 38
28 Estimation Log of Likelihood for ARIMA Estimation LL(θ) = T 2 log(2π) T 2 log(σ2 ) This applies to any ARIMA(P,D,Q) model. T t=1 a 2 t 2σ 2 When the likelihood is known, as here, the problem reduces to finding out how to estimate θ and a t. Jamie Monogan (UGA) ARIMA Models January 25, / 38
29 Estimation MA(1) illustration z t = -θ 1 a t 1 + a t + θ 0 Drop θ 0 for simplicity Note inherent nonlinearity of -θ 1 a t 1 Both θ and a t 1 are unobserved quantities to be estimated Step by step Presume for the moment that we somehow know θ How do we estimate a t? Except for the first case; just solve one case at a time: z t is given Jamie Monogan (UGA) ARIMA Models January 25, / 38
30 Estimation Solve the MA(1) Equation for a t Just Algebra 1 z t = -θa t 1 + a t 2 z t + θa t 1 = + a t (adding θa t 1 to both sides) 3 a t = z t + θa t 1 (reversing) So, beginning at time zero, if we know a 0, we can solve for a 1, if we know a 1, we can solve for a 2, if we know a 2, we can solve for a 3,recursive all the way to a T So assuming or computing a value for a 0 is the key to everything. Jamie Monogan (UGA) ARIMA Models January 25, / 38
31 Estimation Conditional Maximum Likelihood Conditional Maximum Likelihood E(a t )=0.0; therefore Assume a 0 = 0.0 Then maximize L conditional on that assumption The assumption will be false, but its effect is transient That is guaranteed by the stationarity condition Jamie Monogan (UGA) ARIMA Models January 25, / 38
32 Estimation Unconditional Maximum Likelihood with Backforecasting Unconditional Maximum Likelihood Backforecast a 0 Because the backforecast is a product of known z and maximum likelihood estimates of θ and a, it will be optimum. Hence full ML is preferred to Conditional ML Why is this optimal? Because backforecasting makes an assumption about unobservables at the end of a series, And because the error in that assumption is transient, The backward forecast at the origin of the series will be unaffected by the transient error. Jamie Monogan (UGA) ARIMA Models January 25, / 38
33 Estimation Unconditional Maximum Likelihood with Backforecasting Backforecasting for MA(1) Given: z t = -θ 1 a t 1 + a t Or: z t - a t = -θ 1 a t 1 Or: (z t - a t )/-θ 1 = a t 1 Or: a t 1 = (z t - a t )/-θ 1 Then if we let a T = 0, we can solve recursively for each previous a t 1, including a 0 Jamie Monogan (UGA) ARIMA Models January 25, / 38
34 Extending ARIMA to Static Regressions Extension: The Multivariate Case We can now consider a case where we have a static time series regression with ARIMA errors. Y = β 0 + β 1 x 1 + β 2 x β k x k + N t This is static because the causal flow from x to y is not a function of time, just β. Jamie Monogan (UGA) ARIMA Models January 25, / 38
35 Extending ARIMA to Static Regressions Software The arima commands in R and Stata can handle any number of right-hand-side regressors, and ARIMA errors. R: mod.1 <- arima(data$y, order=c(1,0,0), xreg=cbind(data$x1,data$x2)) Stata: arima y x1 x2,ar(1) Both of these are for the AR(1) case and will produce a ML regression with ML estimated φ 1 simultaneously. This is still a very limited extension, because static models are not often appropriate specifications for longitudinal causality. If they were, the course could terminate now. But this is the step Hibbs (1974) took. Jamie Monogan (UGA) ARIMA Models January 25, / 38
36 Extending ARIMA to Static Regressions Percent Identifying as Liberal Over Time A Real Example of a Static ARIMA Regression Citation: OLS MLE for AR(1) Estimate S.E. Estimate S.E. Great Society intervention Party control duration Post-intervention trend Intercept ˆφ Radj N=70 Ellis, Christopher & James A. Stimson On Symbolic Conservatism in America. Presented at the APSA Annual Meeting, Chicago, September Jamie Monogan (UGA) ARIMA Models January 25, / 38
37 Extending ARIMA to Static Regressions Two Issues in Time Series Regressions 1 Correlated errors in the residuals violate OLS assumptions, producing inefficient β and biased σ 2, t, and p. That s the one we ve solved. 2 Dynamics: y is likely to be caused by previous values of x and y. This is the big one, producing biased and inconsistent β. This is a violation of the Gauss-Markov assumption of proper functional form. That is the focus of much of the rest of the course. Jamie Monogan (UGA) ARIMA Models January 25, / 38
38 Extending ARIMA to Static Regressions For Next Time Bring me a copy of the article you want to replicate. Write down the shock form for an AR(1) process. If you replace every φ with a θ, what kind of MA process is it? Why might this be worth knowing? Data exercise: Download the simulated dataset posted at For series z1-z6, identify, estimate, and diagnose the ARIMA process. Write a sentence or two justifing your identification decision. Present the results and your sentences in some concise manner. Reading: Enders sections Gujarati & Porter sections Jamie Monogan (UGA) ARIMA Models January 25, / 38
ARIMA Models. Jamie Monogan. January 16, University of Georgia. Jamie Monogan (UGA) ARIMA Models January 16, / 27
ARIMA Models Jamie Monogan University of Georgia January 16, 2018 Jamie Monogan (UGA) ARIMA Models January 16, 2018 1 / 27 Objectives By the end of this meeting, participants should be able to: Argue why
More informationIntervention Models and Forecasting
Intervention Models and Forecasting Transfer Functions with Binary Inputs Jamie Monogan University of Georgia January 23, 2018 Jamie Monogan (UGA) Intervention Models and Forecasting January 23, 2018 1
More informationUnivariate, Nonstationary Processes
Univariate, Nonstationary Processes Jamie Monogan University of Georgia March 20, 2018 Jamie Monogan (UGA) Univariate, Nonstationary Processes March 20, 2018 1 / 14 Objectives By the end of this meeting,
More informationAutocorrelation. Jamie Monogan. Intermediate Political Methodology. University of Georgia. Jamie Monogan (UGA) Autocorrelation POLS / 20
Autocorrelation Jamie Monogan University of Georgia Intermediate Political Methodology Jamie Monogan (UGA) Autocorrelation POLS 7014 1 / 20 Objectives By the end of this meeting, participants should be
More informationChapter 12: An introduction to Time Series Analysis. Chapter 12: An introduction to Time Series Analysis
Chapter 12: An introduction to Time Series Analysis Introduction In this chapter, we will discuss forecasting with single-series (univariate) Box-Jenkins models. The common name of the models is Auto-Regressive
More informationat least 50 and preferably 100 observations should be available to build a proper model
III Box-Jenkins Methods 1. Pros and Cons of ARIMA Forecasting a) need for data at least 50 and preferably 100 observations should be available to build a proper model used most frequently for hourly or
More informationEmpirical Market Microstructure Analysis (EMMA)
Empirical Market Microstructure Analysis (EMMA) Lecture 3: Statistical Building Blocks and Econometric Basics Prof. Dr. Michael Stein michael.stein@vwl.uni-freiburg.de Albert-Ludwigs-University of Freiburg
More informationFE570 Financial Markets and Trading. Stevens Institute of Technology
FE570 Financial Markets and Trading Lecture 5. Linear Time Series Analysis and Its Applications (Ref. Joel Hasbrouck - Empirical Market Microstructure ) Steve Yang Stevens Institute of Technology 9/25/2012
More informationTime Series I Time Domain Methods
Astrostatistics Summer School Penn State University University Park, PA 16802 May 21, 2007 Overview Filtering and the Likelihood Function Time series is the study of data consisting of a sequence of DEPENDENT
More informationCircle a single answer for each multiple choice question. Your choice should be made clearly.
TEST #1 STA 4853 March 4, 215 Name: Please read the following directions. DO NOT TURN THE PAGE UNTIL INSTRUCTED TO DO SO Directions This exam is closed book and closed notes. There are 31 questions. Circle
More informationLecture 2: Univariate Time Series
Lecture 2: Univariate Time Series Analysis: Conditional and Unconditional Densities, Stationarity, ARMA Processes Prof. Massimo Guidolin 20192 Financial Econometrics Spring/Winter 2017 Overview Motivation:
More informationStat 5100 Handout #12.e Notes: ARIMA Models (Unit 7) Key here: after stationary, identify dependence structure (and use for forecasting)
Stat 5100 Handout #12.e Notes: ARIMA Models (Unit 7) Key here: after stationary, identify dependence structure (and use for forecasting) (overshort example) White noise H 0 : Let Z t be the stationary
More informationForecasting using R. Rob J Hyndman. 2.4 Non-seasonal ARIMA models. Forecasting using R 1
Forecasting using R Rob J Hyndman 2.4 Non-seasonal ARIMA models Forecasting using R 1 Outline 1 Autoregressive models 2 Moving average models 3 Non-seasonal ARIMA models 4 Partial autocorrelations 5 Estimation
More informationMODELING INFLATION RATES IN NIGERIA: BOX-JENKINS APPROACH. I. U. Moffat and A. E. David Department of Mathematics & Statistics, University of Uyo, Uyo
Vol.4, No.2, pp.2-27, April 216 MODELING INFLATION RATES IN NIGERIA: BOX-JENKINS APPROACH I. U. Moffat and A. E. David Department of Mathematics & Statistics, University of Uyo, Uyo ABSTRACT: This study
More informationExercises - Time series analysis
Descriptive analysis of a time series (1) Estimate the trend of the series of gasoline consumption in Spain using a straight line in the period from 1945 to 1995 and generate forecasts for 24 months. Compare
More informationTime Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY
Time Series Analysis James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY PREFACE xiii 1 Difference Equations 1.1. First-Order Difference Equations 1 1.2. pth-order Difference Equations 7
More informationTIME SERIES ANALYSIS. Forecasting and Control. Wiley. Fifth Edition GWILYM M. JENKINS GEORGE E. P. BOX GREGORY C. REINSEL GRETA M.
TIME SERIES ANALYSIS Forecasting and Control Fifth Edition GEORGE E. P. BOX GWILYM M. JENKINS GREGORY C. REINSEL GRETA M. LJUNG Wiley CONTENTS PREFACE TO THE FIFTH EDITION PREFACE TO THE FOURTH EDITION
More informationBasics: Definitions and Notation. Stationarity. A More Formal Definition
Basics: Definitions and Notation A Univariate is a sequence of measurements of the same variable collected over (usually regular intervals of) time. Usual assumption in many time series techniques is that
More informationFORECASTING SUGARCANE PRODUCTION IN INDIA WITH ARIMA MODEL
FORECASTING SUGARCANE PRODUCTION IN INDIA WITH ARIMA MODEL B. N. MANDAL Abstract: Yearly sugarcane production data for the period of - to - of India were analyzed by time-series methods. Autocorrelation
More informationTime Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY
Time Series Analysis James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY & Contents PREFACE xiii 1 1.1. 1.2. Difference Equations First-Order Difference Equations 1 /?th-order Difference
More informationEASTERN MEDITERRANEAN UNIVERSITY ECON 604, FALL 2007 DEPARTMENT OF ECONOMICS MEHMET BALCILAR ARIMA MODELS: IDENTIFICATION
ARIMA MODELS: IDENTIFICATION A. Autocorrelations and Partial Autocorrelations 1. Summary of What We Know So Far: a) Series y t is to be modeled by Box-Jenkins methods. The first step was to convert y t
More informationARMA (and ARIMA) models are often expressed in backshift notation.
Backshift Notation ARMA (and ARIMA) models are often expressed in backshift notation. B is the backshift operator (also called the lag operator ). It operates on time series, and means back up by one time
More informationDecision 411: Class 9. HW#3 issues
Decision 411: Class 9 Presentation/discussion of HW#3 Introduction to ARIMA models Rules for fitting nonseasonal models Differencing and stationarity Reading the tea leaves : : ACF and PACF plots Unit
More informationAdvanced Econometrics
Advanced Econometrics Marco Sunder Nov 04 2010 Marco Sunder Advanced Econometrics 1/ 25 Contents 1 2 3 Marco Sunder Advanced Econometrics 2/ 25 Music Marco Sunder Advanced Econometrics 3/ 25 Music Marco
More informationUnivariate ARIMA Models
Univariate ARIMA Models ARIMA Model Building Steps: Identification: Using graphs, statistics, ACFs and PACFs, transformations, etc. to achieve stationary and tentatively identify patterns and model components.
More informationTIME SERIES ANALYSIS AND FORECASTING USING THE STATISTICAL MODEL ARIMA
CHAPTER 6 TIME SERIES ANALYSIS AND FORECASTING USING THE STATISTICAL MODEL ARIMA 6.1. Introduction A time series is a sequence of observations ordered in time. A basic assumption in the time series analysis
More informationReview Session: Econometrics - CLEFIN (20192)
Review Session: Econometrics - CLEFIN (20192) Part II: Univariate time series analysis Daniele Bianchi March 20, 2013 Fundamentals Stationarity A time series is a sequence of random variables x t, t =
More informationRoss Bettinger, Analytical Consultant, Seattle, WA
ABSTRACT DYNAMIC REGRESSION IN ARIMA MODELING Ross Bettinger, Analytical Consultant, Seattle, WA Box-Jenkins time series models that contain exogenous predictor variables are called dynamic regression
More informationModule 3. Descriptive Time Series Statistics and Introduction to Time Series Models
Module 3 Descriptive Time Series Statistics and Introduction to Time Series Models Class notes for Statistics 451: Applied Time Series Iowa State University Copyright 2015 W Q Meeker November 11, 2015
More informationECON/FIN 250: Forecasting in Finance and Economics: Section 6: Standard Univariate Models
ECON/FIN 250: Forecasting in Finance and Economics: Section 6: Standard Univariate Models Patrick Herb Brandeis University Spring 2016 Patrick Herb (Brandeis University) Standard Univariate Models ECON/FIN
More informationA Data-Driven Model for Software Reliability Prediction
A Data-Driven Model for Software Reliability Prediction Author: Jung-Hua Lo IEEE International Conference on Granular Computing (2012) Young Taek Kim KAIST SE Lab. 9/4/2013 Contents Introduction Background
More informationIntroduction to ARMA and GARCH processes
Introduction to ARMA and GARCH processes Fulvio Corsi SNS Pisa 3 March 2010 Fulvio Corsi Introduction to ARMA () and GARCH processes SNS Pisa 3 March 2010 1 / 24 Stationarity Strict stationarity: (X 1,
More informationEstimation and application of best ARIMA model for forecasting the uranium price.
Estimation and application of best ARIMA model for forecasting the uranium price. Medeu Amangeldi May 13, 2018 Capstone Project Superviser: Dongming Wei Second reader: Zhenisbek Assylbekov Abstract This
More information3 Theory of stationary random processes
3 Theory of stationary random processes 3.1 Linear filters and the General linear process A filter is a transformation of one random sequence {U t } into another, {Y t }. A linear filter is a transformation
More informationESSE Mid-Term Test 2017 Tuesday 17 October :30-09:45
ESSE 4020 3.0 - Mid-Term Test 207 Tuesday 7 October 207. 08:30-09:45 Symbols have their usual meanings. All questions are worth 0 marks, although some are more difficult than others. Answer as many questions
More information{ } Stochastic processes. Models for time series. Specification of a process. Specification of a process. , X t3. ,...X tn }
Stochastic processes Time series are an example of a stochastic or random process Models for time series A stochastic process is 'a statistical phenomenon that evolves in time according to probabilistic
More informationCircle the single best answer for each multiple choice question. Your choice should be made clearly.
TEST #1 STA 4853 March 6, 2017 Name: Please read the following directions. DO NOT TURN THE PAGE UNTIL INSTRUCTED TO DO SO Directions This exam is closed book and closed notes. There are 32 multiple choice
More informationTime Series Analysis -- An Introduction -- AMS 586
Time Series Analysis -- An Introduction -- AMS 586 1 Objectives of time series analysis Data description Data interpretation Modeling Control Prediction & Forecasting 2 Time-Series Data Numerical data
More informationMGR-815. Notes for the MGR-815 course. 12 June School of Superior Technology. Professor Zbigniew Dziong
Modeling, Estimation and Control, for Telecommunication Networks Notes for the MGR-815 course 12 June 2010 School of Superior Technology Professor Zbigniew Dziong 1 Table of Contents Preface 5 1. Example
More informationBox-Jenkins ARIMA Advanced Time Series
Box-Jenkins ARIMA Advanced Time Series www.realoptionsvaluation.com ROV Technical Papers Series: Volume 25 Theory In This Issue 1. Learn about Risk Simulator s ARIMA and Auto ARIMA modules. 2. Find out
More informationChapter 6: Model Specification for Time Series
Chapter 6: Model Specification for Time Series The ARIMA(p, d, q) class of models as a broad class can describe many real time series. Model specification for ARIMA(p, d, q) models involves 1. Choosing
More informationARIMA Modelling and Forecasting
ARIMA Modelling and Forecasting Economic time series often appear nonstationary, because of trends, seasonal patterns, cycles, etc. However, the differences may appear stationary. Δx t x t x t 1 (first
More informationCh 5. Models for Nonstationary Time Series. Time Series Analysis
We have studied some deterministic and some stationary trend models. However, many time series data cannot be modeled in either way. Ex. The data set oil.price displays an increasing variation from the
More informationCh 6. Model Specification. Time Series Analysis
We start to build ARIMA(p,d,q) models. The subjects include: 1 how to determine p, d, q for a given series (Chapter 6); 2 how to estimate the parameters (φ s and θ s) of a specific ARIMA(p,d,q) model (Chapter
More informationSOME BASICS OF TIME-SERIES ANALYSIS
SOME BASICS OF TIME-SERIES ANALYSIS John E. Floyd University of Toronto December 8, 26 An excellent place to learn about time series analysis is from Walter Enders textbook. For a basic understanding of
More informationECON/FIN 250: Forecasting in Finance and Economics: Section 7: Unit Roots & Dickey-Fuller Tests
ECON/FIN 250: Forecasting in Finance and Economics: Section 7: Unit Roots & Dickey-Fuller Tests Patrick Herb Brandeis University Spring 2016 Patrick Herb (Brandeis University) Unit Root Tests ECON/FIN
More informationEconometrics II Heij et al. Chapter 7.1
Chapter 7.1 p. 1/2 Econometrics II Heij et al. Chapter 7.1 Linear Time Series Models for Stationary data Marius Ooms Tinbergen Institute Amsterdam Chapter 7.1 p. 2/2 Program Introduction Modelling philosophy
More informationUnivariate Time Series Analysis; ARIMA Models
Econometrics 2 Fall 24 Univariate Time Series Analysis; ARIMA Models Heino Bohn Nielsen of4 Outline of the Lecture () Introduction to univariate time series analysis. (2) Stationarity. (3) Characterizing
More informationUniversity of Oxford. Statistical Methods Autocorrelation. Identification and Estimation
University of Oxford Statistical Methods Autocorrelation Identification and Estimation Dr. Órlaith Burke Michaelmas Term, 2011 Department of Statistics, 1 South Parks Road, Oxford OX1 3TG Contents 1 Model
More information2. An Introduction to Moving Average Models and ARMA Models
. An Introduction to Moving Average Models and ARMA Models.1 White Noise. The MA(1) model.3 The MA(q) model..4 Estimation and forecasting of MA models..5 ARMA(p,q) models. The Moving Average (MA) models
More informationCointegrated VARIMA models: specification and. simulation
Cointegrated VARIMA models: specification and simulation José L. Gallego and Carlos Díaz Universidad de Cantabria. Abstract In this note we show how specify cointegrated vector autoregressive-moving average
More informationQuantitative Finance I
Quantitative Finance I Linear AR and MA Models (Lecture 4) Winter Semester 01/013 by Lukas Vacha * If viewed in.pdf format - for full functionality use Mathematica 7 (or higher) notebook (.nb) version
More informationIntroduction to Time Series Analysis. Lecture 11.
Introduction to Time Series Analysis. Lecture 11. Peter Bartlett 1. Review: Time series modelling and forecasting 2. Parameter estimation 3. Maximum likelihood estimator 4. Yule-Walker estimation 5. Yule-Walker
More informationLecture 4a: ARMA Model
Lecture 4a: ARMA Model 1 2 Big Picture Most often our goal is to find a statistical model to describe real time series (estimation), and then predict the future (forecasting) One particularly popular model
More informationEconometric Forecasting
Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna October 1, 2014 Outline Introduction Model-free extrapolation Univariate time-series models Trend
More informationγ 0 = Var(X i ) = Var(φ 1 X i 1 +W i ) = φ 2 1γ 0 +σ 2, which implies that we must have φ 1 < 1, and γ 0 = σ2 . 1 φ 2 1 We may also calculate for j 1
4.2 Autoregressive (AR) Moving average models are causal linear processes by definition. There is another class of models, based on a recursive formulation similar to the exponentially weighted moving
More informationLecture 6a: Unit Root and ARIMA Models
Lecture 6a: Unit Root and ARIMA Models 1 2 Big Picture A time series is non-stationary if it contains a unit root unit root nonstationary The reverse is not true. For example, y t = cos(t) + u t has no
More informationVector Autoregression
Vector Autoregression Jamie Monogan University of Georgia February 27, 2018 Jamie Monogan (UGA) Vector Autoregression February 27, 2018 1 / 17 Objectives By the end of these meetings, participants should
More informationThe Identification of ARIMA Models
APPENDIX 4 The Identification of ARIMA Models As we have established in a previous lecture, there is a one-to-one correspondence between the parameters of an ARMA(p, q) model, including the variance of
More information5 Autoregressive-Moving-Average Modeling
5 Autoregressive-Moving-Average Modeling 5. Purpose. Autoregressive-moving-average (ARMA models are mathematical models of the persistence, or autocorrelation, in a time series. ARMA models are widely
More informationA SEASONAL TIME SERIES MODEL FOR NIGERIAN MONTHLY AIR TRAFFIC DATA
www.arpapress.com/volumes/vol14issue3/ijrras_14_3_14.pdf A SEASONAL TIME SERIES MODEL FOR NIGERIAN MONTHLY AIR TRAFFIC DATA Ette Harrison Etuk Department of Mathematics/Computer Science, Rivers State University
More informationSome Time-Series Models
Some Time-Series Models Outline 1. Stochastic processes and their properties 2. Stationary processes 3. Some properties of the autocorrelation function 4. Some useful models Purely random processes, random
More informationLesson 13: Box-Jenkins Modeling Strategy for building ARMA models
Lesson 13: Box-Jenkins Modeling Strategy for building ARMA models Facoltà di Economia Università dell Aquila umberto.triacca@gmail.com Introduction In this lesson we present a method to construct an ARMA(p,
More informationSeasonal Autoregressive Integrated Moving Average Model for Precipitation Time Series
Journal of Mathematics and Statistics 8 (4): 500-505, 2012 ISSN 1549-3644 2012 doi:10.3844/jmssp.2012.500.505 Published Online 8 (4) 2012 (http://www.thescipub.com/jmss.toc) Seasonal Autoregressive Integrated
More informationProf. Dr. Roland Füss Lecture Series in Applied Econometrics Summer Term Introduction to Time Series Analysis
Introduction to Time Series Analysis 1 Contents: I. Basics of Time Series Analysis... 4 I.1 Stationarity... 5 I.2 Autocorrelation Function... 9 I.3 Partial Autocorrelation Function (PACF)... 14 I.4 Transformation
More informationAutoregressive and Moving-Average Models
Chapter 3 Autoregressive and Moving-Average Models 3.1 Introduction Let y be a random variable. We consider the elements of an observed time series {y 0,y 1,y2,...,y t } as being realizations of this randoms
More informationApplied time-series analysis
Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna October 18, 2011 Outline Introduction and overview Econometric Time-Series Analysis In principle,
More informationEmpirical Approach to Modelling and Forecasting Inflation in Ghana
Current Research Journal of Economic Theory 4(3): 83-87, 2012 ISSN: 2042-485X Maxwell Scientific Organization, 2012 Submitted: April 13, 2012 Accepted: May 06, 2012 Published: June 30, 2012 Empirical Approach
More information7. Forecasting with ARIMA models
7. Forecasting with ARIMA models 309 Outline: Introduction The prediction equation of an ARIMA model Interpreting the predictions Variance of the predictions Forecast updating Measuring predictability
More informationDynamic Time Series Regression: A Panacea for Spurious Correlations
International Journal of Scientific and Research Publications, Volume 6, Issue 10, October 2016 337 Dynamic Time Series Regression: A Panacea for Spurious Correlations Emmanuel Alphonsus Akpan *, Imoh
More informationUnivariate linear models
Univariate linear models The specification process of an univariate ARIMA model is based on the theoretical properties of the different processes and it is also important the observation and interpretation
More informationSTAT Financial Time Series
STAT 6104 - Financial Time Series Chapter 4 - Estimation in the time Domain Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 1 / 46 Agenda 1 Introduction 2 Moment Estimates 3 Autoregressive Models (AR
More informationThe ARIMA Procedure: The ARIMA Procedure
Page 1 of 120 Overview: ARIMA Procedure Getting Started: ARIMA Procedure The Three Stages of ARIMA Modeling Identification Stage Estimation and Diagnostic Checking Stage Forecasting Stage Using ARIMA Procedure
More informationFinal Examination 7/6/2011
The Islamic University of Gaza Faculty of Commerce Department of Economics & Applied Statistics Time Series Analysis - Dr. Samir Safi Spring Semester 211 Final Examination 7/6/211 Name: ID: INSTRUCTIONS:
More informationSTAT 443 Final Exam Review. 1 Basic Definitions. 2 Statistical Tests. L A TEXer: W. Kong
STAT 443 Final Exam Review L A TEXer: W Kong 1 Basic Definitions Definition 11 The time series {X t } with E[X 2 t ] < is said to be weakly stationary if: 1 µ X (t) = E[X t ] is independent of t 2 γ X
More informationClassic Time Series Analysis
Classic Time Series Analysis Concepts and Definitions Let Y be a random number with PDF f Y t ~f,t Define t =E[Y t ] m(t) is known as the trend Define the autocovariance t, s =COV [Y t,y s ] =E[ Y t t
More informationLecture 1: Fundamental concepts in Time Series Analysis (part 2)
Lecture 1: Fundamental concepts in Time Series Analysis (part 2) Florian Pelgrin University of Lausanne, École des HEC Department of mathematics (IMEA-Nice) Sept. 2011 - Jan. 2012 Florian Pelgrin (HEC)
More informationUNIVARIATE TIME SERIES ANALYSIS BRIEFING 1970
UNIVARIATE TIME SERIES ANALYSIS BRIEFING 1970 Joseph George Caldwell, PhD (Statistics) 1432 N Camino Mateo, Tucson, AZ 85745-3311 USA Tel. (001)(520)222-3446, E-mail jcaldwell9@yahoo.com (File converted
More informationAPPLIED ECONOMETRIC TIME SERIES 4TH EDITION
APPLIED ECONOMETRIC TIME SERIES 4TH EDITION Chapter 2: STATIONARY TIME-SERIES MODELS WALTER ENDERS, UNIVERSITY OF ALABAMA Copyright 2015 John Wiley & Sons, Inc. Section 1 STOCHASTIC DIFFERENCE EQUATION
More informationAR, MA and ARMA models
AR, MA and AR by Hedibert Lopes P Based on Tsay s Analysis of Financial Time Series (3rd edition) P 1 Stationarity 2 3 4 5 6 7 P 8 9 10 11 Outline P Linear Time Series Analysis and Its Applications For
More informationEconometría 2: Análisis de series de Tiempo
Econometría 2: Análisis de series de Tiempo Karoll GOMEZ kgomezp@unal.edu.co http://karollgomez.wordpress.com Segundo semestre 2016 III. Stationary models 1 Purely random process 2 Random walk (non-stationary)
More informationRead Section 1.1, Examples of time series, on pages 1-8. These example introduce the book; you are not tested on them.
TS Module 1 Time series overview (The attached PDF file has better formatting.)! Model building! Time series plots Read Section 1.1, Examples of time series, on pages 1-8. These example introduce the book;
More information1 Linear Difference Equations
ARMA Handout Jialin Yu 1 Linear Difference Equations First order systems Let {ε t } t=1 denote an input sequence and {y t} t=1 sequence generated by denote an output y t = φy t 1 + ε t t = 1, 2,... with
More informationProblem Set 2: Box-Jenkins methodology
Problem Set : Box-Jenkins methodology 1) For an AR1) process we have: γ0) = σ ε 1 φ σ ε γ0) = 1 φ Hence, For a MA1) process, p lim R = φ γ0) = 1 + θ )σ ε σ ε 1 = γ0) 1 + θ Therefore, p lim R = 1 1 1 +
More informationRoss Bettinger, Analytical Consultant, Seattle, WA
ABSTRACT USING PROC ARIMA TO MODEL TRENDS IN US HOME PRICES Ross Bettinger, Analytical Consultant, Seattle, WA We demonstrate the use of the Box-Jenkins time series modeling methodology to analyze US home
More informationMCMC analysis of classical time series algorithms.
MCMC analysis of classical time series algorithms. mbalawata@yahoo.com Lappeenranta University of Technology Lappeenranta, 19.03.2009 Outline Introduction 1 Introduction 2 3 Series generation Box-Jenkins
More informationRomanian Economic and Business Review Vol. 3, No. 3 THE EVOLUTION OF SNP PETROM STOCK LIST - STUDY THROUGH AUTOREGRESSIVE MODELS
THE EVOLUTION OF SNP PETROM STOCK LIST - STUDY THROUGH AUTOREGRESSIVE MODELS Marian Zaharia, Ioana Zaheu, and Elena Roxana Stan Abstract Stock exchange market is one of the most dynamic and unpredictable
More informationForecasting. Simon Shaw 2005/06 Semester II
Forecasting Simon Shaw s.c.shaw@maths.bath.ac.uk 2005/06 Semester II 1 Introduction A critical aspect of managing any business is planning for the future. events is called forecasting. Predicting future
More informationGranger Causality Testing
Granger Causality Testing Jamie Monogan University of Georgia April 4, 2012 Jamie Monogan (UGA) Granger Causality Testing April 4, 2012 1 / 19 Objectives By the end of this meeting, participants should
More informationEstimating AR/MA models
September 17, 2009 Goals The likelihood estimation of AR/MA models AR(1) MA(1) Inference Model specification for a given dataset Why MLE? Traditional linear statistics is one methodology of estimating
More informationBooth School of Business, University of Chicago Business 41914, Spring Quarter 2013, Mr. Ruey S. Tsay. Midterm
Booth School of Business, University of Chicago Business 41914, Spring Quarter 2013, Mr. Ruey S. Tsay Midterm Chicago Booth Honor Code: I pledge my honor that I have not violated the Honor Code during
More informationNon-Stationary Time Series and Unit Root Testing
Econometrics II Non-Stationary Time Series and Unit Root Testing Morten Nyboe Tabor Course Outline: Non-Stationary Time Series and Unit Root Testing 1 Stationarity and Deviation from Stationarity Trend-Stationarity
More informationModeling the Covariance
Modeling the Covariance Jamie Monogan University of Georgia February 3, 2016 Jamie Monogan (UGA) Modeling the Covariance February 3, 2016 1 / 16 Objectives By the end of this meeting, participants should
More informationMultivariate Time Series: VAR(p) Processes and Models
Multivariate Time Series: VAR(p) Processes and Models A VAR(p) model, for p > 0 is X t = φ 0 + Φ 1 X t 1 + + Φ p X t p + A t, where X t, φ 0, and X t i are k-vectors, Φ 1,..., Φ p are k k matrices, with
More informationEcon 623 Econometrics II Topic 2: Stationary Time Series
1 Introduction Econ 623 Econometrics II Topic 2: Stationary Time Series In the regression model we can model the error term as an autoregression AR(1) process. That is, we can use the past value of the
More informationPart 1. Multiple Choice (50 questions, 1 point each) Part 2. Problems/Short Answer (10 questions, 5 points each)
GROUND RULES: This exam contains two parts: Part 1. Multiple Choice (50 questions, 1 point each) Part 2. Problems/Short Answer (10 questions, 5 points each) The maximum number of points on this exam is
More informationECONOMETRIA II. CURSO 2009/2010 LAB # 3
ECONOMETRIA II. CURSO 2009/2010 LAB # 3 BOX-JENKINS METHODOLOGY The Box Jenkins approach combines the moving average and the autorregresive models. Although both models were already known, the contribution
More informationChristopher Dougherty London School of Economics and Political Science
Introduction to Econometrics FIFTH EDITION Christopher Dougherty London School of Economics and Political Science OXFORD UNIVERSITY PRESS Contents INTRODU CTION 1 Why study econometrics? 1 Aim of this
More informationG. S. Maddala Kajal Lahiri. WILEY A John Wiley and Sons, Ltd., Publication
G. S. Maddala Kajal Lahiri WILEY A John Wiley and Sons, Ltd., Publication TEMT Foreword Preface to the Fourth Edition xvii xix Part I Introduction and the Linear Regression Model 1 CHAPTER 1 What is Econometrics?
More informationCh 4. Models For Stationary Time Series. Time Series Analysis
This chapter discusses the basic concept of a broad class of stationary parametric time series models the autoregressive moving average (ARMA) models. Let {Y t } denote the observed time series, and {e
More information