Basic concepts and terminology: AR, MA and ARMA processes
|
|
- Gerard Carpenter
- 6 years ago
- Views:
Transcription
1 ECON 5101 ADVANCED ECONOMETRICS TIME SERIES Lecture note no. 1 (EB) Erik Biørn, Department of Economics Version of February 1, 2011 Basic concepts and terminology: AR, MA and ARMA processes This lecture note is related to Topic 2 in the lecture plan. 1. STOCHASTIC PROCESSES Consider a time series of a variable Y: {Y} = { Y 1,Y 0,Y 1,,Y T, }, wherey t is its value in periodt. If the Y t s are stochastic variables, we call {Y} a stochastic (random) process. A (model of a) univariate stochastic process involves only one variable. A (model of a) multivariate stochastic process involves more than one variable. 2. LAG OPERATOR, LAG POLYNOMIALS, LINEAR DIFFERENCE EQUATIONS The lag-operator, symbolized by L is defined by: Lz t = z t 1, for any t, where z t is an arbitrary time-series of a variable (observed or unobserved). The important thing with the lag-operator is that it, within certain limits, can be treated and operated as any usual algebraic entity. Applying the lag-operator twice, we get L 2 z t = L(Lz t ) = Lz t 1 = z t 2, and in general, (1) L n z t = z t n, n = 0,±1,±2,.... In particular, L 0 z t = z t, while L n z t = z t+n. The algebra for the lag-operator for linear functions of time series is elaborated in Hamilton: Section 2.1 and exemplified below: Example set 1: L(a 0 +a 1 z t ) = La 0 +L(a 1 z t ) = a 0 +a 1 Lz t = a 0 +a 1 z t 1, (1+a 1 L+a 2 L 2 )z t = z t +a 1 Lz t +a 2 L 2 z t = z t +a 1 z t 1 +a 2 z t 2, (1+a 1 L)(1+b 1 L)z t = [1+(a 1 +b 1 )L+a 1 b 1 L 2 ]z t = z t +(a 1 +b 1 )z t 1 +a 1 b 1 z t 2, where a 0,a 1,a 2 and b 1 are constants. 1
2 Example 2: The summation formula for an infinite, geometric succession implies, provided that b < 1 that 1/(1 b) = 1+b+b 2 +b 3 +. A similar property also holds if we multiply b with L, again assuming b < 1, i.e., a 0 = a 0 (1+bL+(bL)2 +(bl) 3 + ) = a 0 z t = a 0 [1+bL+(bL) 2 +(bl) 3 + ]z t = a 0 [z t +bz t 1 +b 2 z t 2 +b 3 z t 3 + ]. This expresses an infinitely long, geometric lag-distribution in z t, starting at a 0. Example 3: Assume again b < 1, then a 0 +a 1 L = a 0 + (a 1 +a 0 b)l = a 0 +(a 1 +a 0 b)(l+bl 2 +b 2 L 3 + ) = [ a 0 +a 1 L z t = a 0 + (a 1 +a 0 b)l ] z t = a 0 z t +(a 1 +a 0 b)(z t 1 +bz t 2 +b 2 z t 3 + ). This expresses an infinite lag-distribution in z t with the first coefficient free at a 0 and with geometrically declining coefficients, starting at the value a 1 +a 0 b from the second coefficient onwards. Example 4: Assume again b < 1, then a 0 +a 1 L+a 2 L 2 = a 0 + (a 1 +a 0 b)l+a 2 L2 = a 0 +(a 1 +a 0 b)l+ (a 2 +a 1 b+a 0 b2 )L 2 = a 0 +(a 1 +a 0 b)l+(a 2 +a 1 b+a o b 2 )(L 2 +bl 3 +b 2 L 4 + ) = a 0 +a 1 L+a 2 L 2 z t = [a 0 +(a 1 +a 0 b)l+ (a 2 +a 1 b+a 0 b2 )L 2 ] z t = a 0 z t +(a 1 +a 0 b)z t 1 +(a 2 +a 1 b+a o b 2 )(z t 2 +bz t 3 +b 2 z t 4 + ). This expresses an infinite lag-distribution with the first coefficient free at a 0, the second coefficient free at a 1 +a 0 b, and with geometrically declining coefficients starting at the value a 2 +a 1 b+a 0 b 2 from the third coefficient onwards. Examples 2, 3, 4 can be generalized straightforwardly by extending the polynomial in the numerator of Example 4 with higher-order terms. We next turn to linear difference equations (with constant coefficients). Consider first a linear first-order difference equation in z t with constant coefficients: (2) z t = bz t 1 +f t, 2
3 where f t is a given, arbitrary time function. The corresponding homogeneous difference equation is z t bz t 1 = 0. By recursive substitution, we find the time function for z t which solves (2), starting in period t n at z t n, is: n 1 z t = b(bz t 2 +f t 1 )+f t = = b n z t n + b i f t i, where z t n is the initial value of the process. For n=t we get in particular t 1 (3) z t = b t z 0 + b i f t i = b t z bt L t 1 b f t, i=0 since (1 b t )/(1 b)=1+b+b 2 + +b t 1 and hence (1 (bl) t )/()=1+bL+(bL) 2 + +(bl) t 1. If b <1 and we let n in (3), i.e., if we assume that the process had started an infinite number of periods ago, we get (4) z t = i=0 i=0 b i f t i = 1 f t, b < 1. Weseethatz t remembers the current and past values of the given time function, f t,f t 1,f t 2..., with geometrically declining weights. If b 1, the solution to the difference equation (2) explodes, since the absolute value of b i grows with i. Then the solution can still be written as (3), but not as (4). Stability condition, first-order difference equation: The homogeneous part of the difference equation (2), i.e., z t bz t 1 = 0, has a characteristic polynomial, m t bm t 1 = m t 1 (m b), whose root, m, after elimination of the common factor m t 1, shall be less than one in absolute value to ensure stability of the solution. The only root in this simple case is m=b, and hence m < 1 b < 1. Consider next a linear pth-order difference equation in z t with constant coefficients: (5) z t = b 1 z t 1 +b 2 z t 2 +b 3 z t 3 + +b p z t p +f t, where f t is a given, arbitrary time function. The corresponding homogeneous difference equation is z t b 1 z t 1 b 2 z t 2 b 3 z t 3 b p z t p = 0. We skip the solution of the difference equation (5), but turn to its stability condition. Stability condition, pth-order difference equation: The homogeneous part of the difference equation (5), has a characteristic polynomial, m t b 1 m t 1 b 2 m t 2 b 3 m t 3 b p m t p = m t p [m p b 1 m p 1 b 2 m p 2 b 3 m p 3 b p 1 m b p ]. 3
4 where the latter expression, according to the Fundamental Theorem of Algebra, can be written as m t p [m p b 1 m p 1 b 2 m p 2 b 3 m p 3 b p 1 m b p ] = m t p (m r 1 )(m r 2 )(m r 3 ) (m r p ) where r 1,r 2,r 3,,r p are the p roots of the polynomial, after elimination of the common factor m t p real or complex (conjugate), multiple roots being counted by their multiplicities. The stability condition generalizing m < 1 in the first-order example claims thatthese p roots (real or complex) shall all be inside the unit circle, i.e. the circle going through the points (+1,+i, 1, i), where i = 1. See Hamilton: Chapter 1 and RN s note on complex numbers (on web), for details. 3. STATIONARY AND NON-STATIONARY PROCESSES GENERALITIES Definition: A stochastic process {Y} is (strongly) stationary if {Y t,y t+1,,y t+h } has the same probability distribution as {Y t+t,y t+t+1,,y t+t+h } for all t, T and H, where H and T are finite. Intuitively, stationarity requires that the probability distribution does not change its form when we move the window through which we view realizations of the process. If this condition is NOT satisfied, the stochastic process{y} is said to be non-stationary. Intuitively, the form of the joint probability distribution of (Y t,y t+1,,y t+h ) changes over time. Implications of (strong) stationarity: All (existing) moments of the distribution of (Y t,y t+1,,y t+h ) of the first, second, and higher order are t-invariant, e.g., (6) (7) (8) but also E(Y t ) = µ, V(Y t ) = E[Y t µ] 2 = σ 00, C(Y t,y t+h ) = E[(Y t µ)(y t+h µ)] = σ 0h, t, t, t, h = 1,...,H, E[Y t µ] p = τ pp0, t, p = 3,4,..., { E[(Y t µ) q (Y t+h µ) r ] = τ qrh, t, q = 1,2,...; r = 2,3,..., q = 2,3,...; r = 1,2,.... Note: If at least one of conditions (6) (8) are violated, the process cannot be (strongly) stationary. 4
5 Weaker forms of stationarity: If (6), (7) and (8) are satisfied, the process {Y t } is said to be weakly stationary, or covariance stationary. If (6) is satisfied [but not necessarily (7) and (8)], the process {Y t } is said to be stationary in the mean. Many economic variables are non-stationary. They are not even stationary in the mean. In macro-economics examples abound (GDP, monetary stock, capital stock, consumer price index,...). On the other hand, non-stationary variables may be made stationary by transformations. Or linear combinations or other functions of non-stationary variables may be stationary. This will be elaborated in the second part of the course. Notable examples are: Y t may be non-stationary, while Y t is stationary. Y t and X t may both be non-stationary, while y t ax t is, for some a, stationary. 4. BASIC UNIVARIATE STOCHASTIC PROCESSES WITH ZERO MEAN White noise process: {ε t } T t=1 w.n.: (9) E(ε t ) = 0, E(ε t ε s ) = Alternatively (and somewhat stronger), ε t IID(0,σ 2 ε), { σ 2 ε, t = s 0, t s where IID denotes identically, independently distributed. Still stronger, ε t IIN(0,σε), 2 where IIN denotes normally, independently distributed. White noise processes are prominent examples of stationary processes. Random walk process: {u t } r.w.: (10) u t = u t 1 +ε t, where ε t w.n. Hence: A random walk process is a process whose first difference is white noise. t (11) {u t } r.w. = { u t } w.n. = u t = u 0 + ε s. E(u t u 0 ) = u 0, var(u t u 0 ) = tσ 2 ε. Random walk processes are prominent examples of non-stationary processes. Zero mean autoregressive (AR) process of order 1: {u t } AR(1): (12) u t = ρu t 1 +ε t, where ε t w.n. s=1 5
6 Zero mean autoregressive (AR) process of order p: {u t } AR(p): (13) u t = ρ 1 u t 1 +ρ 2 u t 2 + +ρ p u t p +ε t, where ε t w.n. Zero mean moving average (MA) process of order 1: {u t } MA(1): (14) u t = ε t +θε t 1, where ε t w.n. Zero mean moving average (MA) process of order q: {u t } MA(q): (15) u t = ε t +θ 1 ε t 1 + +θ q ε t q, where ε t w.n. Acronyms: AR=Auto-Regressive MA=Moving Average ARMA=Auto-Regressive-Moving Average Zero mean ARMA(1,1) process: {u t } ARMA(1,1) means: (16) u t = ρu t +ε t +θε t 1, where ε t w.n. This process combines AR(1) and MA(1). Hence its name. Zero mean ARMA(p,q) process: {u t } ARMA(p,q) means: (17) u t = ρ 1 u t 1 +ρ 2 u t 2 + +ρ p u t p +ε t +θ 1 ε t 1 + +θ q ε t q, where ε t w.n. This process combines AR(p) and MA(q). Hence its name. Special cases: 1. Zero mean AR(p) = Zero mean ARMA(p,0), 2. Zero mean MA(q) = Zero mean ARMA(0,q), 3. White noise = Zero mean AR(0) = Zero mean MA(0) = Zero mean ARMA(0,0) 4. Random walk = Zero mean AR(1) with ρ = 1 Notice: The zero mean processes discussed above may have interest by themselves or, often more interestingly, occur as disturbance processes in econometric time series models together with other (observable or unobservable) variables which we as economists/econometricians want to model. 5. AR, MA, AND ARMA PROCESSES WITH NON-ZERO MEAN We now extend the AM, MA and ARMA processes (12) (17), by including intercepts and, in doing this as a step towards including covariates allow for non-zero means and switching our variable of interest from u t (unobservable) to Y t (observable). Along the way, we introduce lag-polynomials, drawing on the results in Section 2. 6
7 Autoregressive (AR) process of order 1: (18) Y t = c+φy t 1 +ε t (1 φl)y t = c+ε t, where ε t w.n. This exemplifies a first-order linear, stochastic difference equation where c+ε t formally corresponds to the extraneously given time function, cf. f t above. Autoregressive (AR) process of order p: (19) Y t = c+φ 1 Y t 1 ++φ 2 Y t 2 + +φ p Y t p +ε t (1 φ 1 L φ 2 L 2 φ p L p )Y t = c+ε t [1 φ(l)]y t = k+ε t, φ(l) = φ 1 L+φ 2 L 2 + +φ p L p, where ε t w.n. This exemplifies a pth-order linear, stochastic difference equation where c+ε t formally corresponds to the extraneously given time function, cf. f t above. Moving average (MA) process of order 1: (20) Y t = k+ε t +θε t 1 Y t = k +(1+θL)ε t, where ε t w.n. It follows that this MA(1) process is stationary (at least covariance stationary), with { E(Y t ) = k, var(y t ) = (1+θ 2 )σε 2 θσ, cov(y 2 t,y t+h ) = ε, h = ±1 0 h = ±2,±3,.... y t = Y t k is zero mean stationary. Moving average (MA) process of order q: (21) Y t = k+ε t +θ 1 ε t 1 +θ 2 ε t 2 + +θ q ε t q Y t = k+(1+θ 1 L+θ 2 L 2 + +θ q L q )ε t Y t = c+[1+θ(l)]ε t, θ(l) = θ 1 L+θ 2 L 2 + +θ q L q, where ε t w.n. It follows that this MA(q) process is stationary (at least covariance stationary) with E(Y t ) = k, var(y t ) = (1+ { q i=1 θ2 i )σ2 ε, cov(y (θh + q h t,y t+h ) = i=1 θ h+iθ i )σε 2 h=1,...,q, 0 h > q. Its variance is finite provided that q s=1 θ2 s <. y t = Y t k is zero mean stationary. ARMA(1,1) process: (22) Y t = c+φy t 1 +ε t +θε t 1 (1 φl)y t = c+(1+θl)ε t, where ε t w.n. ARMA(p, q) process: (23) [1 φ(l)]y t = c+[1+θ(l)]ε t, where ε t w.n. φ(l) = φ 1 L+φ 2 L 2 + +φ p L p, θ(l) = θ 1 L+θ 2 L 2 + +θ q L q, 7
8 What about the stationarity properties of AR and ARMA processes? And if stationary prevails, what about their expectation? To answer these question, we will first have to introduce a new concept, invertibility, and explain its close association with some of the concepts introduced above: lag-polynomials, stability conditions of difference equations, their characteristic polynomials and the unit circle. 6. INVERTIBILITY CONDITIONS AND THE UNIT CIRCLE Invertibility condition, first-order equation: Let L be the lag operator. The difference equation (2) can then be expressed as (24) z t = blz t +f t ()z t = f t. Since b < 1, we are allowed to divide in (24) by (), to get (25) ()z t = f t z t = 1 f t, b < 1. Definition: We call the condition which allows us to derive the implication z t = [1/(1 bl)]f t from (1 bl)z t = f t the invertibility condition of the difference equation (24). The invertibility condition in this case is b < 1, which indeed coincides with the stability condition for the difference equation. See section 2 Since 1 = 1+bL+b2 L 2 +b 3 L 3 +, b < 1, we have that z t = 1 f t = (1+bL+b 2 L 2 +b 3 L 3 + )f t = b i f t i. This invertibility property shows an easy way of solving the difference equation (24) in the sense of expressing z t in terms of the past time path of f t by using the lag operator and the invertibility condition. Invertibility condition, first-order equation, alternative formulation. Replace now L in the lag-polynomial in (24) by the scalar x. This gives the polynomial 1 ax. The difference equation is invertible if the root of this equation is larger than one in absolute value. This means that x = 1/b must be strictly greater than one in absolute value. This coincides with the condition for stability of the first-order difference equation we have found earlier, because 1/b > 1 b < 1. Invertibility condition, pth order equation: Let L be the lag operator. The difference equation (5) can then be expressed as (26) z t = b(l)z t +f t [1 b(l)]z t = f t, b(l) = b 1 L+b 2 L 2 + +b p L p. Are we allowed to divide in (26) by [1 b(l)], to get (27) [1 b(l)]z t = f t z t = 1 1 b(l) f t, and if so, which conditions should be satisfied? As a generalization of the result for the first-order case above we have: i=0 8
9 Definition: We call the condition which allows us to derive the implication z t = {1/[1 b(l)]}f t from [1 b(l)]z t = f t the invertibility condition of the difference equation (26). Again, the invertibility conditions involve roots of the characteristic polynomial and coincide with the stability condition for the difference equation. See section 2. Invertibility condition, p lags precise formulation. Replace now L in the lagpolynomial in (26) by the scalar x. This gives the polynomial 1 b(x) = 1 b 1 x b 2 x 2 b 3 x 3. The difference equation is invertible if all roots (real or complex) of this polynomial, i.e., the solution values for x of 1 b(x) = 0, are outside the unit circle: All roots of the characteristic polynomial are inside the unit circle All roots of the lag polynomial are outside the unit circle It is incorrect to say that we want to find the values of the lag-operator for which the lag-polynomial is zero. The point is that the operator L should be replaced by an ordinary scalar entity, say x, to make this prescription work. The lag-operator cannot be a root of anything. 7. STATIONARITY CONDITIONS FOR AR- AND ARMA-PROCESSES It follows from the results in section 5 and 6 that: The AR(1)-process (18) and the ARMA(1,1)-process (22) may be either stationary and non-stationary. They are stationary if φ <1. They are non-stationary if φ 1. No restriction is placed on θ in the ARMA case. Under stationarity, we have in both cases: E(Y t ) = µ t = E(Y t ) = µ = c 1 φ, y t = Y t µ is a zero mean stationary process. See Hamilton, Figure 3.3 for an illustration. The AR(p)-process (19) and the ARMA(p,q)-process (23), with p and q finite, may be either stationary and non-stationary. They are stationary if all roots of 1 φ(x) = 0 are outside the unit circle. They are non-stationary if at least one root of 1 φ(x) = 0 is on or inside the unit circle. No restriction is placed on the coefficients of θ(l) in the ARMA case. Under stationarity, we have in both cases c E(Y t ) = µ t = E(Y t ) = µ = 1 p i=1 φ, y t = Y t µ is a zero mean stationary process. i 9
Class 1: Stationary Time Series Analysis
Class 1: Stationary Time Series Analysis Macroeconometrics - Fall 2009 Jacek Suda, BdF and PSE February 28, 2011 Outline Outline: 1 Covariance-Stationary Processes 2 Wold Decomposition Theorem 3 ARMA Models
More informationDiscrete time processes
Discrete time processes Predictions are difficult. Especially about the future Mark Twain. Florian Herzog 2013 Modeling observed data When we model observed (realized) data, we encounter usually the following
More informationAutoregressive and Moving-Average Models
Chapter 3 Autoregressive and Moving-Average Models 3.1 Introduction Let y be a random variable. We consider the elements of an observed time series {y 0,y 1,y2,...,y t } as being realizations of this randoms
More information1 Linear Difference Equations
ARMA Handout Jialin Yu 1 Linear Difference Equations First order systems Let {ε t } t=1 denote an input sequence and {y t} t=1 sequence generated by denote an output y t = φy t 1 + ε t t = 1, 2,... with
More informationUnivariate Time Series Analysis; ARIMA Models
Econometrics 2 Fall 24 Univariate Time Series Analysis; ARIMA Models Heino Bohn Nielsen of4 Outline of the Lecture () Introduction to univariate time series analysis. (2) Stationarity. (3) Characterizing
More informationCovariance Stationary Time Series. Example: Independent White Noise (IWN(0,σ 2 )) Y t = ε t, ε t iid N(0,σ 2 )
Covariance Stationary Time Series Stochastic Process: sequence of rv s ordered by time {Y t } {...,Y 1,Y 0,Y 1,...} Defn: {Y t } is covariance stationary if E[Y t ]μ for all t cov(y t,y t j )E[(Y t μ)(y
More informationIntroduction to Stochastic processes
Università di Pavia Introduction to Stochastic processes Eduardo Rossi Stochastic Process Stochastic Process: A stochastic process is an ordered sequence of random variables defined on a probability space
More informationCh. 14 Stationary ARMA Process
Ch. 14 Stationary ARMA Process A general linear stochastic model is described that suppose a time series to be generated by a linear aggregation of random shock. For practical representation it is desirable
More information3. ARMA Modeling. Now: Important class of stationary processes
3. ARMA Modeling Now: Important class of stationary processes Definition 3.1: (ARMA(p, q) process) Let {ɛ t } t Z WN(0, σ 2 ) be a white noise process. The process {X t } t Z is called AutoRegressive-Moving-Average
More informationPermanent Income Hypothesis (PIH) Instructor: Dmytro Hryshko
Permanent Income Hypothesis (PIH) Instructor: Dmytro Hryshko 1 / 36 The PIH Utility function is quadratic, u(c t ) = 1 2 (c t c) 2 ; borrowing/saving is allowed using only the risk-free bond; β(1 + r)
More informationIdentifiability, Invertibility
Identifiability, Invertibility Defn: If {ǫ t } is a white noise series and µ and b 0,..., b p are constants then X t = µ + b 0 ǫ t + b ǫ t + + b p ǫ t p is a moving average of order p; write MA(p). Q:
More informationCh. 15 Forecasting. 1.1 Forecasts Based on Conditional Expectations
Ch 15 Forecasting Having considered in Chapter 14 some of the properties of ARMA models, we now show how they may be used to forecast future values of an observed time series For the present we proceed
More information3 Theory of stationary random processes
3 Theory of stationary random processes 3.1 Linear filters and the General linear process A filter is a transformation of one random sequence {U t } into another, {Y t }. A linear filter is a transformation
More informationChapter 4: Models for Stationary Time Series
Chapter 4: Models for Stationary Time Series Now we will introduce some useful parametric models for time series that are stationary processes. We begin by defining the General Linear Process. Let {Y t
More informationLecture 2: Univariate Time Series
Lecture 2: Univariate Time Series Analysis: Conditional and Unconditional Densities, Stationarity, ARMA Processes Prof. Massimo Guidolin 20192 Financial Econometrics Spring/Winter 2017 Overview Motivation:
More informationProf. Dr. Roland Füss Lecture Series in Applied Econometrics Summer Term Introduction to Time Series Analysis
Introduction to Time Series Analysis 1 Contents: I. Basics of Time Series Analysis... 4 I.1 Stationarity... 5 I.2 Autocorrelation Function... 9 I.3 Partial Autocorrelation Function (PACF)... 14 I.4 Transformation
More informationTime Series 2. Robert Almgren. Sept. 21, 2009
Time Series 2 Robert Almgren Sept. 21, 2009 This week we will talk about linear time series models: AR, MA, ARMA, ARIMA, etc. First we will talk about theory and after we will talk about fitting the models
More informationE 4101/5101 Lecture 6: Spectral analysis
E 4101/5101 Lecture 6: Spectral analysis Ragnar Nymoen 3 March 2011 References to this lecture Hamilton Ch 6 Lecture note (on web page) For stationary variables/processes there is a close correspondence
More informationEmpirical Market Microstructure Analysis (EMMA)
Empirical Market Microstructure Analysis (EMMA) Lecture 3: Statistical Building Blocks and Econometric Basics Prof. Dr. Michael Stein michael.stein@vwl.uni-freiburg.de Albert-Ludwigs-University of Freiburg
More informationECON 616: Lecture 1: Time Series Basics
ECON 616: Lecture 1: Time Series Basics ED HERBST August 30, 2017 References Overview: Chapters 1-3 from Hamilton (1994). Technical Details: Chapters 2-3 from Brockwell and Davis (1987). Intuition: Chapters
More informationEASTERN MEDITERRANEAN UNIVERSITY ECON 604, FALL 2007 DEPARTMENT OF ECONOMICS MEHMET BALCILAR ARIMA MODELS: IDENTIFICATION
ARIMA MODELS: IDENTIFICATION A. Autocorrelations and Partial Autocorrelations 1. Summary of What We Know So Far: a) Series y t is to be modeled by Box-Jenkins methods. The first step was to convert y t
More informationAutoregressive Moving Average (ARMA) Models and their Practical Applications
Autoregressive Moving Average (ARMA) Models and their Practical Applications Massimo Guidolin February 2018 1 Essential Concepts in Time Series Analysis 1.1 Time Series and Their Properties Time series:
More informationEconometrics II Heij et al. Chapter 7.1
Chapter 7.1 p. 1/2 Econometrics II Heij et al. Chapter 7.1 Linear Time Series Models for Stationary data Marius Ooms Tinbergen Institute Amsterdam Chapter 7.1 p. 2/2 Program Introduction Modelling philosophy
More informationEcon 424 Time Series Concepts
Econ 424 Time Series Concepts Eric Zivot January 20 2015 Time Series Processes Stochastic (Random) Process { 1 2 +1 } = { } = sequence of random variables indexed by time Observed time series of length
More informationTime Series Analysis Fall 2008
MIT OpenCourseWare http://ocw.mit.edu 14.384 Time Series Analysis Fall 008 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms. Introduction 1 14.384 Time
More informationSome Time-Series Models
Some Time-Series Models Outline 1. Stochastic processes and their properties 2. Stationary processes 3. Some properties of the autocorrelation function 4. Some useful models Purely random processes, random
More information1 Class Organization. 2 Introduction
Time Series Analysis, Lecture 1, 2018 1 1 Class Organization Course Description Prerequisite Homework and Grading Readings and Lecture Notes Course Website: http://www.nanlifinance.org/teaching.html wechat
More informationTime Series Models and Inference. James L. Powell Department of Economics University of California, Berkeley
Time Series Models and Inference James L. Powell Department of Economics University of California, Berkeley Overview In contrast to the classical linear regression model, in which the components of the
More informationForecasting with ARMA
Forecasting with ARMA Eduardo Rossi University of Pavia October 2013 Rossi Forecasting Financial Econometrics - 2013 1 / 32 Mean Squared Error Linear Projection Forecast of Y t+1 based on a set of variables
More informationUniversità di Pavia. Forecasting. Eduardo Rossi
Università di Pavia Forecasting Eduardo Rossi Mean Squared Error Forecast of Y t+1 based on a set of variables observed at date t, X t : Yt+1 t. The loss function MSE(Y t+1 t ) = E[Y t+1 Y t+1 t ]2 The
More informationApplied time-series analysis
Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna October 18, 2011 Outline Introduction and overview Econometric Time-Series Analysis In principle,
More informationARMA (and ARIMA) models are often expressed in backshift notation.
Backshift Notation ARMA (and ARIMA) models are often expressed in backshift notation. B is the backshift operator (also called the lag operator ). It operates on time series, and means back up by one time
More informationTIME SERIES AND FORECASTING. Luca Gambetti UAB, Barcelona GSE Master in Macroeconomic Policy and Financial Markets
TIME SERIES AND FORECASTING Luca Gambetti UAB, Barcelona GSE 2014-2015 Master in Macroeconomic Policy and Financial Markets 1 Contacts Prof.: Luca Gambetti Office: B3-1130 Edifici B Office hours: email:
More information7. MULTIVARATE STATIONARY PROCESSES
7. MULTIVARATE STATIONARY PROCESSES 1 1 Some Preliminary Definitions and Concepts Random Vector: A vector X = (X 1,..., X n ) whose components are scalar-valued random variables on the same probability
More informationECON/FIN 250: Forecasting in Finance and Economics: Section 7: Unit Roots & Dickey-Fuller Tests
ECON/FIN 250: Forecasting in Finance and Economics: Section 7: Unit Roots & Dickey-Fuller Tests Patrick Herb Brandeis University Spring 2016 Patrick Herb (Brandeis University) Unit Root Tests ECON/FIN
More informationTrend-Cycle Decompositions
Trend-Cycle Decompositions Eric Zivot April 22, 2005 1 Introduction A convenient way of representing an economic time series y t is through the so-called trend-cycle decomposition y t = TD t + Z t (1)
More informationFE570 Financial Markets and Trading. Stevens Institute of Technology
FE570 Financial Markets and Trading Lecture 5. Linear Time Series Analysis and Its Applications (Ref. Joel Hasbrouck - Empirical Market Microstructure ) Steve Yang Stevens Institute of Technology 9/25/2012
More information5: MULTIVARATE STATIONARY PROCESSES
5: MULTIVARATE STATIONARY PROCESSES 1 1 Some Preliminary Definitions and Concepts Random Vector: A vector X = (X 1,..., X n ) whose components are scalarvalued random variables on the same probability
More informationEcon 623 Econometrics II Topic 2: Stationary Time Series
1 Introduction Econ 623 Econometrics II Topic 2: Stationary Time Series In the regression model we can model the error term as an autoregression AR(1) process. That is, we can use the past value of the
More information11. Further Issues in Using OLS with TS Data
11. Further Issues in Using OLS with TS Data With TS, including lags of the dependent variable often allow us to fit much better the variation in y Exact distribution theory is rarely available in TS applications,
More informationLecture 1: Fundamental concepts in Time Series Analysis (part 2)
Lecture 1: Fundamental concepts in Time Series Analysis (part 2) Florian Pelgrin University of Lausanne, École des HEC Department of mathematics (IMEA-Nice) Sept. 2011 - Jan. 2012 Florian Pelgrin (HEC)
More informationLecture note 2 considered the statistical analysis of regression models for time
DYNAMIC MODELS FOR STATIONARY TIME SERIES Econometrics 2 LectureNote4 Heino Bohn Nielsen March 2, 2007 Lecture note 2 considered the statistical analysis of regression models for time series data, and
More informationLINEAR STOCHASTIC MODELS
LINEAR STOCHASTIC MODELS Let {x τ+1,x τ+2,...,x τ+n } denote n consecutive elements from a stochastic process. If their joint distribution does not depend on τ, regardless of the size of n, then the process
More informationLECTURE 10 LINEAR PROCESSES II: SPECTRAL DENSITY, LAG OPERATOR, ARMA. In this lecture, we continue to discuss covariance stationary processes.
MAY, 0 LECTURE 0 LINEAR PROCESSES II: SPECTRAL DENSITY, LAG OPERATOR, ARMA In this lecture, we continue to discuss covariance stationary processes. Spectral density Gourieroux and Monfort 990), Ch. 5;
More informationEC402: Serial Correlation. Danny Quah Economics Department, LSE Lent 2015
EC402: Serial Correlation Danny Quah Economics Department, LSE Lent 2015 OUTLINE 1. Stationarity 1.1 Covariance stationarity 1.2 Explicit Models. Special cases: ARMA processes 2. Some complex numbers.
More informationStatistics of stochastic processes
Introduction Statistics of stochastic processes Generally statistics is performed on observations y 1,..., y n assumed to be realizations of independent random variables Y 1,..., Y n. 14 settembre 2014
More informationTime Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY
Time Series Analysis James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY PREFACE xiii 1 Difference Equations 1.1. First-Order Difference Equations 1 1.2. pth-order Difference Equations 7
More informationLesson 4: Stationary stochastic processes
Dipartimento di Ingegneria e Scienze dell Informazione e Matematica Università dell Aquila, umberto.triacca@univaq.it Stationary stochastic processes Stationarity is a rather intuitive concept, it means
More informationTime Series Econometrics 4 Vijayamohanan Pillai N
Time Series Econometrics 4 Vijayamohanan Pillai N Vijayamohan: CDS MPhil: Time Series 5 1 Autoregressive Moving Average Process: ARMA(p, q) Vijayamohan: CDS MPhil: Time Series 5 2 1 Autoregressive Moving
More informationγ 0 = Var(X i ) = Var(φ 1 X i 1 +W i ) = φ 2 1γ 0 +σ 2, which implies that we must have φ 1 < 1, and γ 0 = σ2 . 1 φ 2 1 We may also calculate for j 1
4.2 Autoregressive (AR) Moving average models are causal linear processes by definition. There is another class of models, based on a recursive formulation similar to the exponentially weighted moving
More informationLecture on ARMA model
Lecture on ARMA model Robert M. de Jong Ohio State University Columbus, OH 43210 USA Chien-Ho Wang National Taipei University Taipei City, 104 Taiwan ROC October 19, 2006 (Very Preliminary edition, Comment
More informationARMA Estimation Recipes
Econ. 1B D. McFadden, Fall 000 1. Preliminaries ARMA Estimation Recipes hese notes summarize procedures for estimating the lag coefficients in the stationary ARMA(p,q) model (1) y t = µ +a 1 (y t-1 -µ)
More informationTime Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY
Time Series Analysis James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY & Contents PREFACE xiii 1 1.1. 1.2. Difference Equations First-Order Difference Equations 1 /?th-order Difference
More informationLecture 1: Stationary Time Series Analysis
Syllabus Stationarity ARMA AR MA Model Selection Estimation Lecture 1: Stationary Time Series Analysis 222061-1617: Time Series Econometrics Spring 2018 Jacek Suda Syllabus Stationarity ARMA AR MA Model
More informationECON/FIN 250: Forecasting in Finance and Economics: Section 6: Standard Univariate Models
ECON/FIN 250: Forecasting in Finance and Economics: Section 6: Standard Univariate Models Patrick Herb Brandeis University Spring 2016 Patrick Herb (Brandeis University) Standard Univariate Models ECON/FIN
More informationA time series is called strictly stationary if the joint distribution of every collection (Y t
5 Time series A time series is a set of observations recorded over time. You can think for example at the GDP of a country over the years (or quarters) or the hourly measurements of temperature over a
More informationCh 4. Models For Stationary Time Series. Time Series Analysis
This chapter discusses the basic concept of a broad class of stationary parametric time series models the autoregressive moving average (ARMA) models. Let {Y t } denote the observed time series, and {e
More informationLecture 3: Autoregressive Moving Average (ARMA) Models and their Practical Applications
Lecture 3: Autoregressive Moving Average (ARMA) Models and their Practical Applications Prof. Massimo Guidolin 20192 Financial Econometrics Winter/Spring 2018 Overview Moving average processes Autoregressive
More informationMidterm Suggested Solutions
CUHK Dept. of Economics Spring 2011 ECON 4120 Sung Y. Park Midterm Suggested Solutions Q1 (a) In time series, autocorrelation measures the correlation between y t and its lag y t τ. It is defined as. ρ(τ)
More informationCovariances of ARMA Processes
Statistics 910, #10 1 Overview Covariances of ARMA Processes 1. Review ARMA models: causality and invertibility 2. AR covariance functions 3. MA and ARMA covariance functions 4. Partial autocorrelation
More informationUnivariate Nonstationary Time Series 1
Univariate Nonstationary Time Series 1 Sebastian Fossati University of Alberta 1 These slides are based on Eric Zivot s time series notes available at: http://faculty.washington.edu/ezivot Introduction
More informationStationary Stochastic Time Series Models
Stationary Stochastic Time Series Models When modeling time series it is useful to regard an observed time series, (x 1,x,..., x n ), as the realisation of a stochastic process. In general a stochastic
More informationNonlinear time series
Based on the book by Fan/Yao: Nonlinear Time Series Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna October 27, 2009 Outline Characteristics of
More informationStochastic Processes
Stochastic Processes Stochastic Process Non Formal Definition: Non formal: A stochastic process (random process) is the opposite of a deterministic process such as one defined by a differential equation.
More informationDifference equations. Definitions: A difference equation takes the general form. x t f x t 1,,x t m.
Difference equations Definitions: A difference equation takes the general form x t fx t 1,x t 2, defining the current value of a variable x as a function of previously generated values. A finite order
More informationat least 50 and preferably 100 observations should be available to build a proper model
III Box-Jenkins Methods 1. Pros and Cons of ARIMA Forecasting a) need for data at least 50 and preferably 100 observations should be available to build a proper model used most frequently for hourly or
More informationEconometric Forecasting
Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna October 1, 2014 Outline Introduction Model-free extrapolation Univariate time-series models Trend
More informationLesson 9: Autoregressive-Moving Average (ARMA) models
Lesson 9: Autoregressive-Moving Average (ARMA) models Dipartimento di Ingegneria e Scienze dell Informazione e Matematica Università dell Aquila, umberto.triacca@ec.univaq.it Introduction We have seen
More informationForecasting with ARMA Models
LECTURE 4 Forecasting with ARMA Models Minumum Mean-Square Error Prediction Imagine that y(t) is a stationary stochastic process with E{y(t)} = 0. We may be interested in predicting values of this process
More informationChapter 3 - Temporal processes
STK4150 - Intro 1 Chapter 3 - Temporal processes Odd Kolbjørnsen and Geir Storvik January 23 2017 STK4150 - Intro 2 Temporal processes Data collected over time Past, present, future, change Temporal aspect
More informationUniversity of Oxford. Statistical Methods Autocorrelation. Identification and Estimation
University of Oxford Statistical Methods Autocorrelation Identification and Estimation Dr. Órlaith Burke Michaelmas Term, 2011 Department of Statistics, 1 South Parks Road, Oxford OX1 3TG Contents 1 Model
More informationModule 4. Stationary Time Series Models Part 1 MA Models and Their Properties
Module 4 Stationary Time Series Models Part 1 MA Models and Their Properties Class notes for Statistics 451: Applied Time Series Iowa State University Copyright 2015 W. Q. Meeker. February 14, 2016 20h
More informationWe use the centered realization z t z in the computation. Also used in computing sample autocovariances and autocorrelations.
Stationary Time Series Models Part 1 MA Models and Their Properties Class notes for Statistics 41: Applied Time Series Ioa State University Copyright 1 W. Q. Meeker. Segment 1 ARMA Notation, Conventions,
More informationWeek 5 Quantitative Analysis of Financial Markets Characterizing Cycles
Week 5 Quantitative Analysis of Financial Markets Characterizing Cycles Christopher Ting http://www.mysmu.edu/faculty/christophert/ Christopher Ting : christopherting@smu.edu.sg : 6828 0364 : LKCSB 5036
More informationModule 3. Descriptive Time Series Statistics and Introduction to Time Series Models
Module 3 Descriptive Time Series Statistics and Introduction to Time Series Models Class notes for Statistics 451: Applied Time Series Iowa State University Copyright 2015 W Q Meeker November 11, 2015
More informationSingle Equation Linear GMM with Serially Correlated Moment Conditions
Single Equation Linear GMM with Serially Correlated Moment Conditions Eric Zivot October 28, 2009 Univariate Time Series Let {y t } be an ergodic-stationary time series with E[y t ]=μ and var(y t )
More informationLesson 2: Analysis of time series
Lesson 2: Analysis of time series Time series Main aims of time series analysis choosing right model statistical testing forecast driving and optimalisation Problems in analysis of time series time problems
More informationECON 4160: Econometrics-Modelling and Systems Estimation Lecture 7: Single equation models
ECON 4160: Econometrics-Modelling and Systems Estimation Lecture 7: Single equation models Ragnar Nymoen Department of Economics University of Oslo 25 September 2018 The reference to this lecture is: Chapter
More informationAdvanced Econometrics
Based on the textbook by Verbeek: A Guide to Modern Econometrics Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna May 2, 2013 Outline Univariate
More informationLecture 2: ARMA(p,q) models (part 2)
Lecture 2: ARMA(p,q) models (part 2) Florian Pelgrin University of Lausanne, École des HEC Department of mathematics (IMEA-Nice) Sept. 2011 - Jan. 2012 Florian Pelgrin (HEC) Univariate time series Sept.
More informationARMA Models: I VIII 1
ARMA Models: I autoregressive moving-average (ARMA) processes play a key role in time series analysis for any positive integer p & any purely nondeterministic process {X t } with ACVF { X (h)}, there is
More informationUnit Root and Cointegration
Unit Root and Cointegration Carlos Hurtado Department of Economics University of Illinois at Urbana-Champaign hrtdmrt@illinois.edu Oct 7th, 016 C. Hurtado (UIUC - Economics) Applied Econometrics On the
More informationChapter 1. Basics. 1.1 Definition. A time series (or stochastic process) is a function Xpt, ωq such that for
Chapter 1 Basics 1.1 Definition A time series (or stochastic process) is a function Xpt, ωq such that for each fixed t, Xpt, ωq is a random variable [denoted by X t pωq]. For a fixed ω, Xpt, ωq is simply
More information18.S096 Problem Set 4 Fall 2013 Time Series Due Date: 10/15/2013
18.S096 Problem Set 4 Fall 2013 Time Series Due Date: 10/15/2013 1. Covariance Stationary AR(2) Processes Suppose the discrete-time stochastic process {X t } follows a secondorder auto-regressive process
More informationTopic 4 Unit Roots. Gerald P. Dwyer. February Clemson University
Topic 4 Unit Roots Gerald P. Dwyer Clemson University February 2016 Outline 1 Unit Roots Introduction Trend and Difference Stationary Autocorrelations of Series That Have Deterministic or Stochastic Trends
More informationECONOMETRICS Part II PhD LBS
ECONOMETRICS Part II PhD LBS Luca Gambetti UAB, Barcelona GSE February-March 2014 1 Contacts Prof.: Luca Gambetti email: luca.gambetti@uab.es webpage: http://pareto.uab.es/lgambetti/ Description This is
More informationSTAT 443 Final Exam Review. 1 Basic Definitions. 2 Statistical Tests. L A TEXer: W. Kong
STAT 443 Final Exam Review L A TEXer: W Kong 1 Basic Definitions Definition 11 The time series {X t } with E[X 2 t ] < is said to be weakly stationary if: 1 µ X (t) = E[X t ] is independent of t 2 γ X
More informationESSE Mid-Term Test 2017 Tuesday 17 October :30-09:45
ESSE 4020 3.0 - Mid-Term Test 207 Tuesday 7 October 207. 08:30-09:45 Symbols have their usual meanings. All questions are worth 0 marks, although some are more difficult than others. Answer as many questions
More informationEstimating Moving Average Processes with an improved version of Durbin s Method
Estimating Moving Average Processes with an improved version of Durbin s Method Maximilian Ludwig this version: June 7, 4, initial version: April, 3 arxiv:347956v [statme] 6 Jun 4 Abstract This paper provides
More informationLecture 1: Stationary Time Series Analysis
Syllabus Stationarity ARMA AR MA Model Selection Estimation Forecasting Lecture 1: Stationary Time Series Analysis 222061-1617: Time Series Econometrics Spring 2018 Jacek Suda Syllabus Stationarity ARMA
More informationReliability and Risk Analysis. Time Series, Types of Trend Functions and Estimates of Trends
Reliability and Risk Analysis Stochastic process The sequence of random variables {Y t, t = 0, ±1, ±2 } is called the stochastic process The mean function of a stochastic process {Y t} is the function
More informationTime Series Analysis -- An Introduction -- AMS 586
Time Series Analysis -- An Introduction -- AMS 586 1 Objectives of time series analysis Data description Data interpretation Modeling Control Prediction & Forecasting 2 Time-Series Data Numerical data
More informationSTA 6857 Autocorrelation and Cross-Correlation & Stationary Time Series ( 1.4, 1.5)
STA 6857 Autocorrelation and Cross-Correlation & Stationary Time Series ( 1.4, 1.5) Outline 1 Announcements 2 Autocorrelation and Cross-Correlation 3 Stationary Time Series 4 Homework 1c Arthur Berg STA
More informationCointegration, Stationarity and Error Correction Models.
Cointegration, Stationarity and Error Correction Models. STATIONARITY Wold s decomposition theorem states that a stationary time series process with no deterministic components has an infinite moving average
More informationAPPLIED ECONOMETRIC TIME SERIES 4TH EDITION
APPLIED ECONOMETRIC TIME SERIES 4TH EDITION Chapter 2: STATIONARY TIME-SERIES MODELS WALTER ENDERS, UNIVERSITY OF ALABAMA Copyright 2015 John Wiley & Sons, Inc. Section 1 STOCHASTIC DIFFERENCE EQUATION
More informationEconometrics I. Professor William Greene Stern School of Business Department of Economics 25-1/25. Part 25: Time Series
Econometrics I Professor William Greene Stern School of Business Department of Economics 25-1/25 Econometrics I Part 25 Time Series 25-2/25 Modeling an Economic Time Series Observed y 0, y 1,, y t, What
More informationLecture 4a: ARMA Model
Lecture 4a: ARMA Model 1 2 Big Picture Most often our goal is to find a statistical model to describe real time series (estimation), and then predict the future (forecasting) One particularly popular model
More informationEconometría 2: Análisis de series de Tiempo
Econometría 2: Análisis de series de Tiempo Karoll GOMEZ kgomezp@unal.edu.co http://karollgomez.wordpress.com Segundo semestre 2016 III. Stationary models 1 Purely random process 2 Random walk (non-stationary)
More informationLECTURES 2-3 : Stochastic Processes, Autocorrelation function. Stationarity.
LECTURES 2-3 : Stochastic Processes, Autocorrelation function. Stationarity. Important points of Lecture 1: A time series {X t } is a series of observations taken sequentially over time: x t is an observation
More information7. Forecasting with ARIMA models
7. Forecasting with ARIMA models 309 Outline: Introduction The prediction equation of an ARIMA model Interpreting the predictions Variance of the predictions Forecast updating Measuring predictability
More information