ARIMA Modelling and Forecasting
|
|
- Phoebe Brooks
- 5 years ago
- Views:
Transcription
1 ARIMA Modelling and Forecasting Economic time series often appear nonstationary, because of trends, seasonal patterns, cycles, etc. However, the differences may appear stationary. Δx t x t x t 1 (first difference) Δ 2 x t Δx t Δx t 1 x t 2x t 1 x t 2 (second difference) etc. In the case of a seasonal pattern, the seasonal differences could be stationary. Define where S 4orS 12 say. Δ S x t x t x t S The ARIMA (autoregressive integrated moving average) model is LΔ S d x t L t where L 1 p L p, L 1 q L q and d 0,1 or (occasionally) 2. Assuming no seasonal pattern (S 1), we speak of the ARIMA(p,d, q) model where p, d, and q are integer values to be chosen. (c) James Davidson /05/2014
2 Box-Jenkins Methodology Box and Jenkins (Time Series Analysis: Forecasting and Control, 1970) advocated a forecasting technique based on the ARIMA model. The basic steps described by B-J are as follows: 1. Choose smallest d so that the series appears stationary. 2. Choose values for p and q, estimate ARMA model for series Δ d x t by ML. 3. Check correlogram of residuals for evidence of autocorrelation. 4. Repeat 2 and 3 as necessary to choose the most parsimonious model that accounts for autocorrelation. The procedure of choosing d, p and q is called (by B-J) model identification. B-J advocate using known autocorrelation patterns of AR and MA processes to choose p and q. Thus. correlogram of AR dies out exponentially as lag increases, while correlogram of MA cuts off at q1 lags. If correlogram does not die out fast enough (or estimated AR root close to 1) may need to increase d. (c) James Davidson /05/2014
3 Testing for Uncorrelatedness Recall the correlogram of a stationary process, j Covx t,x tj Varx t Suppose x t is an independent series. Then, j 0forallj 0. The sample counterparts are j 1,2, 3, r j T j x t1 t x x tj x 0 T x t x 2 t1 but these statistics should be small, on average. It can be shown that s.e.r j T 1/2 and that T r j d N0,1. When x t is serially independent, it can also be shown that r j and r k for j k are asymptotically independent of each other. Therefore, under the null hypothesis of independence, for any chosen m, Q T j1 m rj 2 d 2 m. The problem is to choose m large enough to detect all deviations from independence, but should not generally exceed T/3. (c) James Davidson /05/2014
4 Testing an ARIMA Specification Let t denote the residuals from ARIMA(p,d,q) estimation. Then let r j T j1 t1 t tj T t1 t 2 Let the null hypothesis be that the specification is correct that is, t iid0, 2 in LΔ S d x t L t Box and Pierce (1970) show that in this case, m r j2 d 2 m p q Q T j1 Ljung and Box (1978) suggest a small-sample correction: Q TT 2 j1 m r j 2 T j Since T while m is fixed, note that this has the same asymptotic distribution as Q. Simulations suggest that the small-sample distribution is closer to the limit case. (c) James Davidson /05/2014
5 Testing for Nonlinear Model Features Suppose model has uncorrelated disturbances. Does this mean that they are independent? Nonlinear dependence (given uncorrelateness of levels) can be tested by the Q statistic computed for the squares of the series. where r T j1 t1 j m Q T j1 r j2 t2 2 2 tj 2 T t t1 This statistic has the 2 m distribution in the limit, when the disturbances are independent. (see McLeod and Li (1983), Li and Mak (1994)) If the series is autocorrelated, this test will tend to reject whether or not there is nonlinear dependence. Thus, the test should be performed only if the usual Q test does not reject. Require at least 4th moments to exist for the test to be valid. (c) James Davidson /05/2014
6 Consistent Model Selection Criteria A consistent criterion is one that selects the correct model with probability 1 as T, when this is one of the alternatives examined. Suppose there are M models under consideration, indexed by k 1,,M. Let the maximized (quasi-) log likelihood be L T T 2 log T 1 t t2. Let L kt maximized log-likelihood for model k,andp k number of fitted parameters in model k. If we simply selected model k giving the largest L kt we should tend to over-fit, by including too many parameters. Some penalty for allowing extra parameters is necessary. Hence, for some sequence r T, choose k to maximize A kt L kt p k r T For consistency we require r T as T, but r T /T 0. (c) James Davidson /05/2014
7 Let L k plimt 1 L kt. T If the true model (case k m) is among those considered, we should find L k L m for all k. A consistent criterion should choose the case k m with probability 1asT. Cases: 1. If the kth model is incorrect in the sense L k L m then A mt pr L m 1. A kt L k 2. Suppose L k L m but p k p m (kth model correct but over-parameterized). By assumption, L kt L mt O p 1 while L kt O p T. Hence, A mt A kt L mt p m r T p 1 r k p m T L kt p k r T L kt p k r T 1 with probability 1asT. O p T 1 Note: the second r.h.s. term is O p r T /T and dominates the last one as T. In each case, the false model is rejected w.p. 1asT. Pmodel m selected can be made as near 1 as desired by taking T large enough. (c) James Davidson /05/2014
8 Three popular criteria: 1. Akaike criterion: maximize L T k 2. Schwarz criterion: maximize L T 1 2 klogt 3. Hannan-Quinn criterion: maximize L T klog logt When the number of parameters in the true model is finite, and it is included in the models compared: The Akaike criterion is not consistent. The Schwarz and H-Q are consistent. Schwarz criterion favours the most parsimonious models. The Akaike criterion tends to select larger (less parsimonious) models than the other two. It is argued that the Akaike criterion can be viewed as consistent when the class of models include infinite-parameter cases (e.g. AR( Caution: some books/software packages reverse the signs of the criteria, so that the rule is to choose the model that minimises the criterion. There is no accepted convention in this respect - read the small print! (c) James Davidson /05/2014
9 Forecasting: General Principles Given information represented by sigma field F t, we wish to forecast a variable Y (e.g. Y x tm ). If Z t is a F t -measurable forecast function, let EY Z t 2 the mean squared error of forecast (MSE) be the preferred loss function. The aim is to choose Z t to make the loss as small as possible. Note, other loss functions are possible - this one is symmetric, weighting positive and negative errors equally. As we know, setting Z t equal to EY F t gives the minimum MSE forecast. Therefore, consider the ARMA model: Note that x tm 1 x tm 1 p x tm p tm 1 tm 1 q tm q Ex tm F t 1 Ex tm 1 F t p Ex tm p F t m t q tm q The last terms vanish if m q. Ex tm j F t x tm j if j m. (c) James Davidson /05/2014
10 Forecasting using the ARIMA Let hats denote estimated parameters, residuals. Forecast of period T m from date T, form 1,2,3, is m 1 p x Tm T j1 jx Tm j T jm q jx Tm j jm j Tm j The first sum is empty if m 1. The second sum is empty if m p. The third sum is empty if m q. If d 1: Fit the ARMA in the differences. Compute the forecasts as m x Tm T x T j1 Δx Tj T Note that in this case the intercept is the coefficient of linear trend (drift). (c) James Davidson /05/2014
11 Forecast Confidence Intervals The forecast error variances can be calculated from the MA() form of the model. Ignoring errors in parameter estimates, the difference between the m-period-ahead forecast and the out-turn is found by putting the unknown future shocks to zero. Case 1: d 0. x Tm 1 L L Tm a Tm b 1 Tm 1 b 2 Tm 2 b m T (say, defining b 1, b 2, ). The forecast of x Tm (assuming parameters known) is x Tm T a b m T b m1 T 1 b m2 T 2 Hence, the forecast error is f Tm T x Tm x Tm T Tm b 1 Tm 1 b m 1 T1. Assuming that t iid0, 2, note that Ef Tm T 0 (unbiased forecasts) Varf Tm T 2 1 b b m 1 (c) James Davidson /05/2014
12 Case 2: d 1. and hence x Tm x T Δx T1 Δx Tm. and x Tm x Tm T f T1 f Tm Tm 1 b 1 Tm 1 1 b 1 b m 1 T1 where Notice the difference between the two cases. Varf Tm T 2 1 c c m 1 c j 1 i1 If d 0, the forecast error variance tends as m to the unconditional variance of the process: Varf Tm T 2 2 bj. j0 j b i If d 1, then Varf Tm T Om. (c) James Davidson /05/2014
13 State Space Modelling A formalized representation of model dynamics. Let y t m 1 represent a vector of observed variables, and t r 1 an unobserved state vector. The evolution of y t is described by two equations: State equation (or transition equation) t T t 1 v t, Measurement equation y t H t w t Ev t 0, Ev t v t Q Ew t 0, Ew t w t R Also assume Ev t w t 0. Optionally, the matrices T, H, Q and R can be time-dependent, and receive t subscripts. Optionally, either measurement equation or state equation can include explanatory variables ("control variables") treated as exogenous. An important motivation for the state-space form is that almost any linear time series model can be cast into this form. (c) James Davidson /05/2014
14 Example: the ARMA(p,q). Let m 1, r maxp,q 1, and consider the ARMA(r,r 1) case: extend the AR or MA orders as required, by specifying zero coefficients. Defining a scalar state variable z t, put t z t z t 1 z t r1, T 1 2 r 1 r , v t t 0 0 (basically, an application of the companion form) and also H 1 1 r 1, R 0, hence w t 0. Note that the state equation effectively takes the form Lz t t. The system resolves as or Ly t L t where 1. y t H t Lz t L L t (c) James Davidson /05/2014
15 The Kalman Filter This is a computer algorithm for solving a state space model recursively. It has uses in model simulation and forecasting. It can provide a convenient vehicle for evaluating the likelihood function in dynamic models, generating the sequence of residuals from the data. It is popular in applied work, since numerous software packages are available to compute it, having a wide range of applications. Consider the above state-space model. Suppose we wish to predict the sequence of states t, given a sequence of observations y 1,,y t. Assume that the matrices T, H, Q and R are fixed and known. (In the general formulation, they can depend on t.) Let the estimator of the state vector t at time t be a t. Let the covariance matrix of the state estimator be 2 P t Ea t t a t t. (c) James Davidson /05/2014
16 Given a t 1 and P t 1, the basic Kalman recursion for period t is now as follows: Prediction step: a t t 1 Ta t 1 Updating step: P t t 1 TP t 1 T Q a t a t t 1 P t t 1 HHP t t 1 H R 1 y t Ha t t 1 P t P t t 1 P t t 1 HHP t t 1 H R 1 H P t t 1 The matrix K t P t t 1 HHP t t 1 H R 1 is called the Kalman gain. Starting the iterations at initial values a 0,andP 0 satisfying the steady-state condition P 0 TP 0 T Q, the filter provides a sequence of one-step-ahead estimates of the state. The Kalman formulae are derived to minimise the mean squared error 2 P t, conditional on information up to date t. The forecast of y t, given information up to date t 1, is then ŷ t t 1 Ha t t 1. To forecast multiple steps ahead, simply iterate the prediction steps without updating. A smoothing recursion can also be used to estimate 1,, T from the full sample y 1,,y T. (c) James Davidson /05/2014
17 Illustration - the EWMA (exponentially weighted moving average) Consider the scalar Gaussian state-space model, sometimes called a local level model: t t 1 t t NID0, q 2 y t t t t NID0, 2 so that in this case T 1andH 1, R 1andQ q (all scalars). Note that this is an ARIMA(0,1,1). We may solve it as Δy t t Δ t. Observe that 0 E t Δ t 2 2 q 2 whereas j E t Δ t t j Δ t j 2 j 1 0 j 1. Hence Δy t is a MA(1) process, and the MA coefficient is found as a function of q by solving the quadratic q (c) James Davidson /05/2014
18 Kalman Recursion To start the recursion set a 1 y 1,andP 1 Ey / 2 1. The stationary form of the updating equation for P t is P P q P q 2 1 P q, which simplifies to P 2 P q q with solutions P 1 2 q q2 4q where the positive solution is the relevant one. The prediction and updating equations therefore yield a steady state form of P q a t a t 1 1 P q y t a t 1 which rearranges as a t 1 a t 1 y t where P q/1 P q. It is easy to see that this recursion has the solution t 1 a t j y t j j0 hence EWMA. (c) James Davidson /05/2014
19 Comment The Kalman filter has proved a very important tool in engineering applications, such as rocketry. (The Apollo missions were its first major application.) It is also much promoted as a method for econometrics. It is therefore worth bearing in mind: The Kalman filter is just a tool for doing certain recursive calculations, especially in ARIMA-type models. It s not a modelling paradigm of itself. There is nothing the Kalman filter can do that cannot be done by more direct means, coded for the problem at hand. It cannot handle nonlinear time series models, or long memory models - it is ultimately limited in scope. I m not sure that it deserves the prominence it often receives in econometrics time series syllabuses. (A personal view!) (c) James Davidson /05/2014
Box-Jenkins ARIMA Advanced Time Series
Box-Jenkins ARIMA Advanced Time Series www.realoptionsvaluation.com ROV Technical Papers Series: Volume 25 Theory In This Issue 1. Learn about Risk Simulator s ARIMA and Auto ARIMA modules. 2. Find out
More informationState-space Model. Eduardo Rossi University of Pavia. November Rossi State-space Model Fin. Econometrics / 53
State-space Model Eduardo Rossi University of Pavia November 2014 Rossi State-space Model Fin. Econometrics - 2014 1 / 53 Outline 1 Motivation 2 Introduction 3 The Kalman filter 4 Forecast errors 5 State
More informationat least 50 and preferably 100 observations should be available to build a proper model
III Box-Jenkins Methods 1. Pros and Cons of ARIMA Forecasting a) need for data at least 50 and preferably 100 observations should be available to build a proper model used most frequently for hourly or
More informationTIME SERIES ANALYSIS. Forecasting and Control. Wiley. Fifth Edition GWILYM M. JENKINS GEORGE E. P. BOX GREGORY C. REINSEL GRETA M.
TIME SERIES ANALYSIS Forecasting and Control Fifth Edition GEORGE E. P. BOX GWILYM M. JENKINS GREGORY C. REINSEL GRETA M. LJUNG Wiley CONTENTS PREFACE TO THE FIFTH EDITION PREFACE TO THE FOURTH EDITION
More informationUnivariate ARIMA Models
Univariate ARIMA Models ARIMA Model Building Steps: Identification: Using graphs, statistics, ACFs and PACFs, transformations, etc. to achieve stationary and tentatively identify patterns and model components.
More informationReview Session: Econometrics - CLEFIN (20192)
Review Session: Econometrics - CLEFIN (20192) Part II: Univariate time series analysis Daniele Bianchi March 20, 2013 Fundamentals Stationarity A time series is a sequence of random variables x t, t =
More informationElements of Multivariate Time Series Analysis
Gregory C. Reinsel Elements of Multivariate Time Series Analysis Second Edition With 14 Figures Springer Contents Preface to the Second Edition Preface to the First Edition vii ix 1. Vector Time Series
More informationAutoregressive Moving Average (ARMA) Models and their Practical Applications
Autoregressive Moving Average (ARMA) Models and their Practical Applications Massimo Guidolin February 2018 1 Essential Concepts in Time Series Analysis 1.1 Time Series and Their Properties Time series:
More informationARIMA Models. Richard G. Pierse
ARIMA Models Richard G. Pierse 1 Introduction Time Series Analysis looks at the properties of time series from a purely statistical point of view. No attempt is made to relate variables using a priori
More informationDynamic Time Series Regression: A Panacea for Spurious Correlations
International Journal of Scientific and Research Publications, Volume 6, Issue 10, October 2016 337 Dynamic Time Series Regression: A Panacea for Spurious Correlations Emmanuel Alphonsus Akpan *, Imoh
More informationTIME SERIES ANALYSIS AND FORECASTING USING THE STATISTICAL MODEL ARIMA
CHAPTER 6 TIME SERIES ANALYSIS AND FORECASTING USING THE STATISTICAL MODEL ARIMA 6.1. Introduction A time series is a sequence of observations ordered in time. A basic assumption in the time series analysis
More informationARIMA Models. Jamie Monogan. January 16, University of Georgia. Jamie Monogan (UGA) ARIMA Models January 16, / 27
ARIMA Models Jamie Monogan University of Georgia January 16, 2018 Jamie Monogan (UGA) ARIMA Models January 16, 2018 1 / 27 Objectives By the end of this meeting, participants should be able to: Argue why
More informationChapter 9: Forecasting
Chapter 9: Forecasting One of the critical goals of time series analysis is to forecast (predict) the values of the time series at times in the future. When forecasting, we ideally should evaluate the
More informationProblem Set 2: Box-Jenkins methodology
Problem Set : Box-Jenkins methodology 1) For an AR1) process we have: γ0) = σ ε 1 φ σ ε γ0) = 1 φ Hence, For a MA1) process, p lim R = φ γ0) = 1 + θ )σ ε σ ε 1 = γ0) 1 + θ Therefore, p lim R = 1 1 1 +
More informationLecture 4a: ARMA Model
Lecture 4a: ARMA Model 1 2 Big Picture Most often our goal is to find a statistical model to describe real time series (estimation), and then predict the future (forecasting) One particularly popular model
More informationVector Auto-Regressive Models
Vector Auto-Regressive Models Laurent Ferrara 1 1 University of Paris Nanterre M2 Oct. 2018 Overview of the presentation 1. Vector Auto-Regressions Definition Estimation Testing 2. Impulse responses functions
More informationLecture 2: Univariate Time Series
Lecture 2: Univariate Time Series Analysis: Conditional and Unconditional Densities, Stationarity, ARMA Processes Prof. Massimo Guidolin 20192 Financial Econometrics Spring/Winter 2017 Overview Motivation:
More informationVAR Models and Applications
VAR Models and Applications Laurent Ferrara 1 1 University of Paris West M2 EIPMC Oct. 2016 Overview of the presentation 1. Vector Auto-Regressions Definition Estimation Testing 2. Impulse responses functions
More informationTime Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY
Time Series Analysis James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY & Contents PREFACE xiii 1 1.1. 1.2. Difference Equations First-Order Difference Equations 1 /?th-order Difference
More informationState-space Model. Eduardo Rossi University of Pavia. November Rossi State-space Model Financial Econometrics / 49
State-space Model Eduardo Rossi University of Pavia November 2013 Rossi State-space Model Financial Econometrics - 2013 1 / 49 Outline 1 Introduction 2 The Kalman filter 3 Forecast errors 4 State smoothing
More informationTime Series Models and Inference. James L. Powell Department of Economics University of California, Berkeley
Time Series Models and Inference James L. Powell Department of Economics University of California, Berkeley Overview In contrast to the classical linear regression model, in which the components of the
More informationDifference equations. Definitions: A difference equation takes the general form. x t f x t 1,,x t m.
Difference equations Definitions: A difference equation takes the general form x t fx t 1,x t 2, defining the current value of a variable x as a function of previously generated values. A finite order
More informationFORECASTING SUGARCANE PRODUCTION IN INDIA WITH ARIMA MODEL
FORECASTING SUGARCANE PRODUCTION IN INDIA WITH ARIMA MODEL B. N. MANDAL Abstract: Yearly sugarcane production data for the period of - to - of India were analyzed by time-series methods. Autocorrelation
More informationECON/FIN 250: Forecasting in Finance and Economics: Section 8: Forecast Examples: Part 1
ECON/FIN 250: Forecasting in Finance and Economics: Section 8: Forecast Examples: Part 1 Patrick Herb Brandeis University Spring 2016 Patrick Herb (Brandeis University) Forecast Examples: Part 1 ECON/FIN
More informationEconometric Forecasting
Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna October 1, 2014 Outline Introduction Model-free extrapolation Univariate time-series models Trend
More informationX t = a t + r t, (7.1)
Chapter 7 State Space Models 71 Introduction State Space models, developed over the past 10 20 years, are alternative models for time series They include both the ARIMA models of Chapters 3 6 and the Classical
More informationForecasting using R. Rob J Hyndman. 2.4 Non-seasonal ARIMA models. Forecasting using R 1
Forecasting using R Rob J Hyndman 2.4 Non-seasonal ARIMA models Forecasting using R 1 Outline 1 Autoregressive models 2 Moving average models 3 Non-seasonal ARIMA models 4 Partial autocorrelations 5 Estimation
More informationUnivariate linear models
Univariate linear models The specification process of an univariate ARIMA model is based on the theoretical properties of the different processes and it is also important the observation and interpretation
More informationARMA MODELS Herman J. Bierens Pennsylvania State University February 23, 2009
1. Introduction Given a covariance stationary process µ ' E[ ], the Wold decomposition states that where U t ARMA MODELS Herman J. Bierens Pennsylvania State University February 23, 2009 with vanishing
More informationTime Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY
Time Series Analysis James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY PREFACE xiii 1 Difference Equations 1.1. First-Order Difference Equations 1 1.2. pth-order Difference Equations 7
More information13. Time Series Analysis: Asymptotics Weakly Dependent and Random Walk Process. Strict Exogeneity
Outline: Further Issues in Using OLS with Time Series Data 13. Time Series Analysis: Asymptotics Weakly Dependent and Random Walk Process I. Stationary and Weakly Dependent Time Series III. Highly Persistent
More informationEcon 623 Econometrics II Topic 2: Stationary Time Series
1 Introduction Econ 623 Econometrics II Topic 2: Stationary Time Series In the regression model we can model the error term as an autoregression AR(1) process. That is, we can use the past value of the
More informationProf. Dr. Roland Füss Lecture Series in Applied Econometrics Summer Term Introduction to Time Series Analysis
Introduction to Time Series Analysis 1 Contents: I. Basics of Time Series Analysis... 4 I.1 Stationarity... 5 I.2 Autocorrelation Function... 9 I.3 Partial Autocorrelation Function (PACF)... 14 I.4 Transformation
More informationAdvanced Econometrics
Advanced Econometrics Marco Sunder Nov 04 2010 Marco Sunder Advanced Econometrics 1/ 25 Contents 1 2 3 Marco Sunder Advanced Econometrics 2/ 25 Music Marco Sunder Advanced Econometrics 3/ 25 Music Marco
More informationVolatility. Gerald P. Dwyer. February Clemson University
Volatility Gerald P. Dwyer Clemson University February 2016 Outline 1 Volatility Characteristics of Time Series Heteroskedasticity Simpler Estimation Strategies Exponentially Weighted Moving Average Use
More informationSTAT Financial Time Series
STAT 6104 - Financial Time Series Chapter 4 - Estimation in the time Domain Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 1 / 46 Agenda 1 Introduction 2 Moment Estimates 3 Autoregressive Models (AR
More informationMGR-815. Notes for the MGR-815 course. 12 June School of Superior Technology. Professor Zbigniew Dziong
Modeling, Estimation and Control, for Telecommunication Networks Notes for the MGR-815 course 12 June 2010 School of Superior Technology Professor Zbigniew Dziong 1 Table of Contents Preface 5 1. Example
More informationStationary Stochastic Time Series Models
Stationary Stochastic Time Series Models When modeling time series it is useful to regard an observed time series, (x 1,x,..., x n ), as the realisation of a stochastic process. In general a stochastic
More informationVector autoregressions, VAR
1 / 45 Vector autoregressions, VAR Chapter 2 Financial Econometrics Michael Hauser WS17/18 2 / 45 Content Cross-correlations VAR model in standard/reduced form Properties of VAR(1), VAR(p) Structural VAR,
More informationLATVIAN GDP: TIME SERIES FORECASTING USING VECTOR AUTO REGRESSION
LATVIAN GDP: TIME SERIES FORECASTING USING VECTOR AUTO REGRESSION BEZRUCKO Aleksandrs, (LV) Abstract: The target goal of this work is to develop a methodology of forecasting Latvian GDP using ARMA (AutoRegressive-Moving-Average)
More informationDiagnostic Test for GARCH Models Based on Absolute Residual Autocorrelations
Diagnostic Test for GARCH Models Based on Absolute Residual Autocorrelations Farhat Iqbal Department of Statistics, University of Balochistan Quetta-Pakistan farhatiqb@gmail.com Abstract In this paper
More informationChapter 12: An introduction to Time Series Analysis. Chapter 12: An introduction to Time Series Analysis
Chapter 12: An introduction to Time Series Analysis Introduction In this chapter, we will discuss forecasting with single-series (univariate) Box-Jenkins models. The common name of the models is Auto-Regressive
More informationEconomic modelling and forecasting
Economic modelling and forecasting 2-6 February 2015 Bank of England he generalised method of moments Ole Rummel Adviser, CCBS at the Bank of England ole.rummel@bankofengland.co.uk Outline Classical estimation
More informationWhite Noise Processes (Section 6.2)
White Noise Processes (Section 6.) Recall that covariance stationary processes are time series, y t, such. E(y t ) = µ for all t. Var(y t ) = σ for all t, σ < 3. Cov(y t,y t-τ ) = γ(τ) for all t and τ
More informationStatistical Methods for Forecasting
Statistical Methods for Forecasting BOVAS ABRAHAM University of Waterloo JOHANNES LEDOLTER University of Iowa John Wiley & Sons New York Chichester Brisbane Toronto Singapore Contents 1 INTRODUCTION AND
More informationdistributed approximately according to white noise. Likewise, for general ARMA(p,q), the residuals can be expressed as
library(forecast) log_ap
More informationIf we want to analyze experimental or simulated data we might encounter the following tasks:
Chapter 1 Introduction If we want to analyze experimental or simulated data we might encounter the following tasks: Characterization of the source of the signal and diagnosis Studying dependencies Prediction
More informationTime Series Forecasting: A Tool for Out - Sample Model Selection and Evaluation
AMERICAN JOURNAL OF SCIENTIFIC AND INDUSTRIAL RESEARCH 214, Science Huβ, http://www.scihub.org/ajsir ISSN: 2153-649X, doi:1.5251/ajsir.214.5.6.185.194 Time Series Forecasting: A Tool for Out - Sample Model
More informationAPPLIED ECONOMETRIC TIME SERIES 4TH EDITION
APPLIED ECONOMETRIC TIME SERIES 4TH EDITION Chapter 2: STATIONARY TIME-SERIES MODELS WALTER ENDERS, UNIVERSITY OF ALABAMA Copyright 2015 John Wiley & Sons, Inc. Section 1 STOCHASTIC DIFFERENCE EQUATION
More informationMultivariate Time Series Analysis and Its Applications [Tsay (2005), chapter 8]
1 Multivariate Time Series Analysis and Its Applications [Tsay (2005), chapter 8] Insights: Price movements in one market can spread easily and instantly to another market [economic globalization and internet
More informationCh 6. Model Specification. Time Series Analysis
We start to build ARIMA(p,d,q) models. The subjects include: 1 how to determine p, d, q for a given series (Chapter 6); 2 how to estimate the parameters (φ s and θ s) of a specific ARIMA(p,d,q) model (Chapter
More informationEmpirical Market Microstructure Analysis (EMMA)
Empirical Market Microstructure Analysis (EMMA) Lecture 3: Statistical Building Blocks and Econometric Basics Prof. Dr. Michael Stein michael.stein@vwl.uni-freiburg.de Albert-Ludwigs-University of Freiburg
More informationG. S. Maddala Kajal Lahiri. WILEY A John Wiley and Sons, Ltd., Publication
G. S. Maddala Kajal Lahiri WILEY A John Wiley and Sons, Ltd., Publication TEMT Foreword Preface to the Fourth Edition xvii xix Part I Introduction and the Linear Regression Model 1 CHAPTER 1 What is Econometrics?
More informationARIMA Models. Jamie Monogan. January 25, University of Georgia. Jamie Monogan (UGA) ARIMA Models January 25, / 38
ARIMA Models Jamie Monogan University of Georgia January 25, 2012 Jamie Monogan (UGA) ARIMA Models January 25, 2012 1 / 38 Objectives By the end of this meeting, participants should be able to: Describe
More informationModelling using ARMA processes
Modelling using ARMA processes Step 1. ARMA model identification; Step 2. ARMA parameter estimation Step 3. ARMA model selection ; Step 4. ARMA model checking; Step 5. forecasting from ARMA models. 33
More information10. Time series regression and forecasting
10. Time series regression and forecasting Key feature of this section: Analysis of data on a single entity observed at multiple points in time (time series data) Typical research questions: What is the
More informationARMA Estimation Recipes
Econ. 1B D. McFadden, Fall 000 1. Preliminaries ARMA Estimation Recipes hese notes summarize procedures for estimating the lag coefficients in the stationary ARMA(p,q) model (1) y t = µ +a 1 (y t-1 -µ)
More informationNotes on Time Series Modeling
Notes on Time Series Modeling Garey Ramey University of California, San Diego January 17 1 Stationary processes De nition A stochastic process is any set of random variables y t indexed by t T : fy t g
More information7 Introduction to Time Series Time Series vs. Cross-Sectional Data Detrending Time Series... 15
Econ 495 - Econometric Review 1 Contents 7 Introduction to Time Series 3 7.1 Time Series vs. Cross-Sectional Data............ 3 7.2 Detrending Time Series................... 15 7.3 Types of Stochastic
More informationRead Section 1.1, Examples of time series, on pages 1-8. These example introduce the book; you are not tested on them.
TS Module 1 Time series overview (The attached PDF file has better formatting.)! Model building! Time series plots Read Section 1.1, Examples of time series, on pages 1-8. These example introduce the book;
More informationCHAPTER 8 MODEL DIAGNOSTICS. 8.1 Residual Analysis
CHAPTER 8 MODEL DIAGNOSTICS We have now discussed methods for specifying models and for efficiently estimating the parameters in those models. Model diagnostics, or model criticism, is concerned with testing
More informationFinancial Econometrics
Financial Econometrics Multivariate Time Series Analysis: VAR Gerald P. Dwyer Trinity College, Dublin January 2013 GPD (TCD) VAR 01/13 1 / 25 Structural equations Suppose have simultaneous system for supply
More informationLecture 2: ARMA(p,q) models (part 2)
Lecture 2: ARMA(p,q) models (part 2) Florian Pelgrin University of Lausanne, École des HEC Department of mathematics (IMEA-Nice) Sept. 2011 - Jan. 2012 Florian Pelgrin (HEC) Univariate time series Sept.
More informationFE570 Financial Markets and Trading. Stevens Institute of Technology
FE570 Financial Markets and Trading Lecture 5. Linear Time Series Analysis and Its Applications (Ref. Joel Hasbrouck - Empirical Market Microstructure ) Steve Yang Stevens Institute of Technology 9/25/2012
More informationStochastic Modelling Solutions to Exercises on Time Series
Stochastic Modelling Solutions to Exercises on Time Series Dr. Iqbal Owadally March 3, 2003 Solutions to Elementary Problems Q1. (i) (1 0.5B)X t = Z t. The characteristic equation 1 0.5z = 0 does not have
More informationApplied time-series analysis
Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna October 18, 2011 Outline Introduction and overview Econometric Time-Series Analysis In principle,
More information7 Introduction to Time Series
Econ 495 - Econometric Review 1 7 Introduction to Time Series 7.1 Time Series vs. Cross-Sectional Data Time series data has a temporal ordering, unlike cross-section data, we will need to changes some
More informationAR, MA and ARMA models
AR, MA and AR by Hedibert Lopes P Based on Tsay s Analysis of Financial Time Series (3rd edition) P 1 Stationarity 2 3 4 5 6 7 P 8 9 10 11 Outline P Linear Time Series Analysis and Its Applications For
More informationLecture note 2 considered the statistical analysis of regression models for time
DYNAMIC MODELS FOR STATIONARY TIME SERIES Econometrics 2 LectureNote4 Heino Bohn Nielsen March 2, 2007 Lecture note 2 considered the statistical analysis of regression models for time series data, and
More informationWeek 5 Quantitative Analysis of Financial Markets Characterizing Cycles
Week 5 Quantitative Analysis of Financial Markets Characterizing Cycles Christopher Ting http://www.mysmu.edu/faculty/christophert/ Christopher Ting : christopherting@smu.edu.sg : 6828 0364 : LKCSB 5036
More informationCh 9. FORECASTING. Time Series Analysis
In this chapter, we assume the model is known exactly, and consider the calculation of forecasts and their properties for both deterministic trend models and ARIMA models. 9.1 Minimum Mean Square Error
More informationEASTERN MEDITERRANEAN UNIVERSITY ECON 604, FALL 2007 DEPARTMENT OF ECONOMICS MEHMET BALCILAR ARIMA MODELS: IDENTIFICATION
ARIMA MODELS: IDENTIFICATION A. Autocorrelations and Partial Autocorrelations 1. Summary of What We Know So Far: a) Series y t is to be modeled by Box-Jenkins methods. The first step was to convert y t
More informationSection 2 NABE ASTEF 65
Section 2 NABE ASTEF 65 Econometric (Structural) Models 66 67 The Multiple Regression Model 68 69 Assumptions 70 Components of Model Endogenous variables -- Dependent variables, values of which are determined
More informationIntroduction to Stochastic processes
Università di Pavia Introduction to Stochastic processes Eduardo Rossi Stochastic Process Stochastic Process: A stochastic process is an ordered sequence of random variables defined on a probability space
More informationProblem Set 2 Solution Sketches Time Series Analysis Spring 2010
Problem Set 2 Solution Sketches Time Series Analysis Spring 2010 Forecasting 1. Let X and Y be two random variables such that E(X 2 ) < and E(Y 2 )
More informationRoss Bettinger, Analytical Consultant, Seattle, WA
ABSTRACT DYNAMIC REGRESSION IN ARIMA MODELING Ross Bettinger, Analytical Consultant, Seattle, WA Box-Jenkins time series models that contain exogenous predictor variables are called dynamic regression
More informationLecture 8: ARIMA Forecasting Please read Chapters 7 and 8 of MWH Book
Lecture 8: ARIMA Forecasting Please read Chapters 7 and 8 of MWH Book 1 Predicting Error 1. y denotes a random variable (stock price, weather, etc) 2. Sometimes we want to do prediction (guessing). Let
More informationTime Series I Time Domain Methods
Astrostatistics Summer School Penn State University University Park, PA 16802 May 21, 2007 Overview Filtering and the Likelihood Function Time series is the study of data consisting of a sequence of DEPENDENT
More informationEconometrics for Policy Analysis A Train The Trainer Workshop Oct 22-28, 2016 Organized by African Heritage Institution
Econometrics for Policy Analysis A Train The Trainer Workshop Oct 22-28, 2016 Organized by African Heritage Institution Delivered by Dr. Nathaniel E. Urama Department of Economics, University of Nigeria,
More informationEconometría 2: Análisis de series de Tiempo
Econometría 2: Análisis de series de Tiempo Karoll GOMEZ kgomezp@unal.edu.co http://karollgomez.wordpress.com Segundo semestre 2016 IX. Vector Time Series Models VARMA Models A. 1. Motivation: The vector
More informationUnivariate Time Series Analysis; ARIMA Models
Econometrics 2 Fall 24 Univariate Time Series Analysis; ARIMA Models Heino Bohn Nielsen of4 Outline of the Lecture () Introduction to univariate time series analysis. (2) Stationarity. (3) Characterizing
More informationMidterm Suggested Solutions
CUHK Dept. of Economics Spring 2011 ECON 4120 Sung Y. Park Midterm Suggested Solutions Q1 (a) In time series, autocorrelation measures the correlation between y t and its lag y t τ. It is defined as. ρ(τ)
More informationEconometrics II Heij et al. Chapter 7.1
Chapter 7.1 p. 1/2 Econometrics II Heij et al. Chapter 7.1 Linear Time Series Models for Stationary data Marius Ooms Tinbergen Institute Amsterdam Chapter 7.1 p. 2/2 Program Introduction Modelling philosophy
More informationTime Series Analysis -- An Introduction -- AMS 586
Time Series Analysis -- An Introduction -- AMS 586 1 Objectives of time series analysis Data description Data interpretation Modeling Control Prediction & Forecasting 2 Time-Series Data Numerical data
More informationTime Series 4. Robert Almgren. Oct. 5, 2009
Time Series 4 Robert Almgren Oct. 5, 2009 1 Nonstationarity How should you model a process that has drift? ARMA models are intrinsically stationary, that is, they are mean-reverting: when the value of
More informationStochastic Processes: I. consider bowl of worms model for oscilloscope experiment:
Stochastic Processes: I consider bowl of worms model for oscilloscope experiment: SAPAscope 2.0 / 0 1 RESET SAPA2e 22, 23 II 1 stochastic process is: Stochastic Processes: II informally: bowl + drawing
More informationLesson 13: Box-Jenkins Modeling Strategy for building ARMA models
Lesson 13: Box-Jenkins Modeling Strategy for building ARMA models Facoltà di Economia Università dell Aquila umberto.triacca@gmail.com Introduction In this lesson we present a method to construct an ARMA(p,
More information7. Forecasting with ARIMA models
7. Forecasting with ARIMA models 309 Outline: Introduction The prediction equation of an ARIMA model Interpreting the predictions Variance of the predictions Forecast updating Measuring predictability
More informationFinancial Time Series Analysis: Part II
Department of Mathematics and Statistics, University of Vaasa, Finland Spring 2017 1 Unit root Deterministic trend Stochastic trend Testing for unit root ADF-test (Augmented Dickey-Fuller test) Testing
More informationCh. 15 Forecasting. 1.1 Forecasts Based on Conditional Expectations
Ch 15 Forecasting Having considered in Chapter 14 some of the properties of ARMA models, we now show how they may be used to forecast future values of an observed time series For the present we proceed
More information{ } Stochastic processes. Models for time series. Specification of a process. Specification of a process. , X t3. ,...X tn }
Stochastic processes Time series are an example of a stochastic or random process Models for time series A stochastic process is 'a statistical phenomenon that evolves in time according to probabilistic
More informationTopic 4 Unit Roots. Gerald P. Dwyer. February Clemson University
Topic 4 Unit Roots Gerald P. Dwyer Clemson University February 2016 Outline 1 Unit Roots Introduction Trend and Difference Stationary Autocorrelations of Series That Have Deterministic or Stochastic Trends
More informationLecture 16: State Space Model and Kalman Filter Bus 41910, Time Series Analysis, Mr. R. Tsay
Lecture 6: State Space Model and Kalman Filter Bus 490, Time Series Analysis, Mr R Tsay A state space model consists of two equations: S t+ F S t + Ge t+, () Z t HS t + ɛ t (2) where S t is a state vector
More informationTesting for Regime Switching in Singaporean Business Cycles
Testing for Regime Switching in Singaporean Business Cycles Robert Breunig School of Economics Faculty of Economics and Commerce Australian National University and Alison Stegman Research School of Pacific
More informationArma-Arch Modeling Of The Returns Of First Bank Of Nigeria
Arma-Arch Modeling Of The Returns Of First Bank Of Nigeria Emmanuel Alphonsus Akpan Imoh Udo Moffat Department of Mathematics and Statistics University of Uyo, Nigeria Ntiedo Bassey Ekpo Department of
More informationCircle the single best answer for each multiple choice question. Your choice should be made clearly.
TEST #1 STA 4853 March 6, 2017 Name: Please read the following directions. DO NOT TURN THE PAGE UNTIL INSTRUCTED TO DO SO Directions This exam is closed book and closed notes. There are 32 multiple choice
More informationStat 5100 Handout #12.e Notes: ARIMA Models (Unit 7) Key here: after stationary, identify dependence structure (and use for forecasting)
Stat 5100 Handout #12.e Notes: ARIMA Models (Unit 7) Key here: after stationary, identify dependence structure (and use for forecasting) (overshort example) White noise H 0 : Let Z t be the stationary
More informationTIME SERIES DATA ANALYSIS USING EVIEWS
TIME SERIES DATA ANALYSIS USING EVIEWS I Gusti Ngurah Agung Graduate School Of Management Faculty Of Economics University Of Indonesia Ph.D. in Biostatistics and MSc. in Mathematical Statistics from University
More informationECON3327: Financial Econometrics, Spring 2016
ECON3327: Financial Econometrics, Spring 2016 Wooldridge, Introductory Econometrics (5th ed, 2012) Chapter 11: OLS with time series data Stationary and weakly dependent time series The notion of a stationary
More informationModel selection using penalty function criteria
Model selection using penalty function criteria Laimonis Kavalieris University of Otago Dunedin, New Zealand Econometrics, Time Series Analysis, and Systems Theory Wien, June 18 20 Outline Classes of models.
More information