Time Series 3. Robert Almgren. Sept. 28, 2009
|
|
- Veronica Flynn
- 6 years ago
- Views:
Transcription
1 Time Series 3 Robert Almgren Sept. 28, 2009 Last time we discussed two main categories of linear models, and their combination. Here w t denotes a white noise: a stationary process with E w t ) = 0, E w 2 t ) = σ 2, and E w t w s ) = 0 for s t. MAq) x t = µ + w t + q θ j w t j = µ + w t + θ 1 w t θ q w t q. j=1 x t is stationary with well-defined variance and covariances for any values of the coefficients θ 0,..., θ q, if q is finite. In the limit q, we require the rather weak condition that θ j exists. We are respecting the standard normalization condition that θ 0 = 1. ARp) p x t = c + w t + φ j x t j = c + w t + φ 1 x t φ p x t p. j=1 The process is stationary if and only if the characteristic polynomial Pz) = 1 φ 1 z φ p z p has all its roots outside the unit disk. Again we set φ 0 = 1. ARMAp,q) It is straightforward to combine the above as x t = c + p φ j x t j + j=1 1 q θ j w t j j=0
2 Robert Almgren: Time Series 3 Sept. 28, It is stationary if the coefficients of the AR part satisfy the condition above. With this model you can get reasonably rich behavior with fairly low orders of p and q. We would now like to answer two particular questions about linear time series: 1. When can we convert an MA model into an AR model or conversely? Answer: Any stationary ARp) model can easily be converted to an MA ) model. For any MAq) model, we can find an equivalent MA representation of the same sequence x t that can be represented by an AR ) model.) 2. Given a sequence of numbers γ l, can we always find a linear model whose autocovariance is that sequence? Answer: yes, if the given covariance sequence is positive definite and decays.) 1 Invertibility It is convenient to streamline our notation a bit. Let B denote the lag or back-shift operator acting on infinite sequences of numbers or random variables {x t } t= : y = B x means y t = x t 1 for each t. Powers of B mean repeated shifts: y = B k x means y t = x t k for each t, including the identity B 0 = I and negative powers: y = B 1 x means y t = x t+1 for each t. Then a general ARMAp,q) model may be written PB) x = c + QB) w where the characteristic polynomial of the MAq) model is Qz) = 1 + θ 1 z + + θ q z q These polynomials both have P0) = Q0) = 1, but so far only Pz) has conditions on the locations of its roots. We assume that Pz) and Qz) have no common roots.
3 Robert Almgren: Time Series 3 Sept. 28, There is a standard mathematical relaxation: Polynomial Complex function analytic near zero. Specifically, as the order of a polynomial tends to infinity, it may be interpreted as a power series representation of a more general function. If the coefficients decay reasonably rapidly then the function is analytic in a neighborhood of zero. For example, if the coefficients are absolutely summable, then the series converges for any z with z 1 and hence defines an analytic function in that disk. Conversely, any function that is analytic in the unit disk has a power series with summable coefficients, and may therefore be interpreted as a polynomial of infinite order. 1.1 AR MA For any stationary ARp) model, the polynomial function Pz) is nonzero for z 1. Therefore, the function Qz) = 1 Pz) is analytic for z 1 and has a power series representation Qz) = 1 + θ 1 z + θ 2 z 2 + with summable coefficients. Therefore, at least formally, we may rearrange the ARp) model as x = 1 ) c + w = µ + QB) w PB) with µ = c/p1) since B is the identity applied to a constant. Thus the coefficients in the power series expansion of Qz) are the coefficients in the MA ) model. Let us note for future reference that Qz) has no zeros in the unit disk, since Pz) is finite there. In fact this works not only formally but in reality, because B is a bounded operator or just because the manipulations with powers of B map exactly to shifts of the sequences.
4 Robert Almgren: Time Series 3 Sept. 28, Example Last time we did the calculations explicitly for the AR1) model taking Pz) = 1 φz with φ < 1. Then Qz) = 1 Pz) = 1 1 φz = 1 + φz + φ2 z 2 + for z < 1 in fact the sum would converge for z < 1/ φ ). So the MA ) model has θ j = φ j which is summable, and µ = c/1 φ). 1.2 MA AR In principle, the same procedure should work in reverse. Given an MAq) model defined by its polynomial Qz) and its mean µ, we simply invert the operator to write 1 QB) x = 1 µ + w or PB) x = c + w QB) where Pz) is the power series expansion of 1/Qz) and c = µ/q1). But for this to make sense, we need Pz) to be a generalisation of a polynomial with zeros outside the unit disk. In particular, it should be analytic in the unit disk, and this will be true if and only if the polynomial Qz) has no zeros in the unit disk. But we did not need to impose that condition on Q to get a well-defined MA model: many perfectly fine MAq) models will not satisfy this condition. Example Last time we studied the MA1) model with Qz) = 1+αz, which was well behaved for any value of α. We would like to invert Pz) = 1 Qz) = αz = 1 αz + α2 z 2 α 3 z 3 + which converges for z < 1/ α. Only if α < 1 does this include the unit disk and give us a reasonable AR ) model. However, remember that the white noise w t is only a device that we have used to create the series x t, so the precise relationship between the real x t and our particular definition of w t is not important. All that is important is the moments of x t, in particular the autocorrelation γ l = σ 2 q l j=0 θ jθ j+l. For this model we calculated γ 0 = 1 + α 2) σ 2, γ 1 = α σ 2
5 Robert Almgren: Time Series 3 Sept. 28, and all higher covariances are zero. If we find a new process that has the same set of covariances then we can consider it equivalent to the original, and if we can invert the new process we are happy. Thus we define a new MA1) process, with a different coefficient α and a different noise variance σ 2. We choose α and σ so that 1 + α 2 ) σ 2 = 1 + α 2) σ 2 and α σ 2 = α σ 2 Indeed, a solution to this besides α = α and σ = σ ) is α = 1 α and σ 2 = α 2 σ 2, The new process has the same moments γ 0 = γ 0 and γ 1 = γ 1 and is hence indistinguishable. It is a different representation of the same stochastic process x t. But if the original process had α > 1 and was thus non-invertible, the new one has α < 1 and is invertible. If we relax the normalization condition to allow θ 0 1, then we can write the new process even more simply: instead of θ 0, θ 1 ) = 1, α), we set θ 0, θ 1 ) = α, 1) using the same noise volatility σ. In general, consider a polynomial Qz), of order q with Q0) = 1. We factor Q as Qz) = 1 λ 1 z ) 1 λ q z ) where λ 1,..., λ q are the inverses of the roots in the complex plane. If all λ j < 1 then the model is invertible. Let us suppose λ j > 1 for j = 1,..., r the problem roots), and let us suppose λ j < 1 for j = r + 1,..., q, ignoring the possibility that any λ j = 1. Following the logic above, we simply invert the roots that cause the problems, constructing a new polynomial Qz) = 1 zλ1 ) 1 z λ r ) 1 λr +1 z ) 1 λ q z ) and using a new noise process w with variance E w t 2 ) = σ 2 = λ1 2 λ r 2 σ 2. This new model has all roots outside the unit circle and is invertible. The rescaling of the noise variance is necessary only because we are enforcing θ 0 = 1 so Q0) = 1. If we relax that, then we can write Qz) = λ 1 z ) λ r z ) 1 λ r +1 z ) 1 λ q z ) and use the same noise variance as in the original model.
6 Robert Almgren: Time Series 3 Sept. 28, Lemma: x = QB) w has the same covariances as x = QB)w. Proof: Let us write the two models as x = I λ 1 B ) I λ q B ) w x = λ 1 B ) λ r B ) 1 λ r +1 B ) 1 λ q B ) w where we use the same noise sequence w. We go from w to x in q steps: x q), x q 1),..., x 1), x 0), with x q) = w and x 0) = x, and similarly for x k). At each step, we set x j 1) = I λ j B ) x j) for j = 1,..., q and x j 1) = I λj B ) x j), j = r + 1,..., q λj B ) x j), j = 1,..., r. At the beginning of this process, x q) has the same covariance as x q) since both equal the same noise w. We want to show that each x j) has the same covariance as x j), so that finally x = x 0) and x = x 0) have the same covariance and are equivalent. Clearly, this is true as far as x r ). Streamlining notation somewhat, we need to show that if z has the same covariance as z, then ỹ = λ B ) z has the same covariance as y = I λb ) z This notation simply means that ỹ t = λ z t z t 1 and y t = z t λz t 1. Let us denote by χ l the common covariance of z and z. Then we easily calculate the covariances of y and of ỹ as ) ) ) ) γ l = E ỹ t ỹ t l = E λ zt z t 1 λ zt l z t l 1 = E λ 2 z ) t z t l λ z t z t l 1 λ z t 1 z t l + z t 1 z t l 1 = 1 + λ 2) χ l λ ) χ l 1 + χ l+1 and γ l ) zt ) ) = E y ) t y t l = E λz t 1 zt l λz t l 1 ) = E z t z t l λ z t 1 z t l λ z t z t l 1 + λ 2 z t 1 z t l 1 = 1 + λ 2) χ l λ ) χ l 1 + χ l+1 which are the same. QED
7 Robert Almgren: Time Series 3 Sept. 28, To summarize, if x and x are constructed from w using different formulas, then they will give different outputs if fed with the same realization of w. But considered as statistical processes over all the possible realizations of w, their statistical properties are equivalent and there is no possible way we could distinguish x from x by observation since w is not observed. For any proposed MAq) model, we may always choose to use an invertible representation, and then we may freely go back and forth between MA and AR models. 2 Reconstruction from covariance Suppose we are given a sequence of covariances {γ l } l=, with even symmetry so that γ l = γ l. Can we always determine coefficients θ 1, θ 2,..., and φ 1, φ 2,... of an ARMA model, along with the white noise variance σ 2, so that that model has the given covariances? As noticed above, the answer is yes, as long as the given covariances have the necessary property of positive definiteness. 2.1 Necessary condition: positive semidefiniteness A real-valued even sequence {γ l } l= is positive semi-definite if for all n 0 and all real-valued vectors z 1,..., z n, z i γ i j z j 0 Any sequence that is the covariance function of a stationary time series process x t must be positive semidefinite. For then, taking mean zero for convenience, we have γ i j = E ) x i x j and then z i γ i j z j = E ) z i x i z j x j = Var z i x i 0. i=1 Example Last time we considered the MA1) model x t = w t +αw t 1 with E wt 2 ) = σ 2 and we computed its autocovariance sequence 1 + α 2 )σ 2 for l = 0, γ l = ασ 2 for l = ±1, and 0 for l 2.
8 Robert Almgren: Time Series 3 Sept. 28, We observed that the correlation ρ 1 = γ 1 /γ 0 = α/1 + α 2 ) took the maximum absolute value ρ max = 1 2. If we are given γ 0 and γ 1, with γ 1 γ 0 /2 and γ l = 0 for l > 1), then we can determine α and σ so that this MA1) model has the specified covariance function. But if we are given this covariance sequence, but with γ 0 and γ 1 having 2γ 1 > γ 0 we must always have γ 0 0 by symmetry), might there be some more complicated ARMA model having this as its covariance sequence? The answer is no, because this covariance sequence is not positive semi-definite for γ 1 > γ 0 /2. For n > 0, consider the n-vector z = 1, 1,..., 1) n 1). Then z i γ i j z j = n γ 0 2n 1)γ 1 = n γ ) ) 2γ 1. n If 2γ 1 > γ 0 then this becomes negative for n large enough. And if 2γ 1 < γ 0, then we do the same calculation with z = 1, 1,..., 1 ). 2.2 Sufficiency Above, we showed that the covariance sequence of any stationary stochastic process is positive semidefinite. The more difficult question is the converse: is any positive semidefinite even sequence the covariance sequence of some stationary stochastic process? And if this is true, can we always write that stationary stochastic process as an ARMA model in terms of some white noise w t? The answer is yes to both, but we shall give only a slightly unsatisfying answer to the first question. Unsatisfying, because it uses the very general Kolmogorov s theorem. Kolmogorov s theorem applies to collections of n-variable cumulative distribution functions F x 1,..., x n ; t 1,..., t n ). Here t 1,..., t n are a collection of n integer-valued time points, x 1,..., x n are the process values at those points, and F is the cumulative probability function. Kolmogorov s theorem tells us that for any such family of cumulative distribution functions, there exists a stochastic process having these as its distribution functions if and only if the marginal distributions are correct at all orders: for all n 1, all x = x 1,..., x n ) and all t = t 1,..., t n ), lim x i F x; t ) = F x i) ; t i) ),
9 Robert Almgren: Time Series 3 Sept. 28, where x i) and t i) are the vectors after removing the ith component. We also need symmetry of the distribution functions under permutations but this is pretty clear.) To apply this theorem, we suppose we are given an even positive semi-definite sequence {γ l } l=. For each n, each t 1,..., t n ), and each x 1,..., x n ), consider the distribution function whose characteristic function is Φ ) u 1,..., u n ; t 1,..., t n = exp 1 2 u i γ ti t j u j Since γ is positive semi-definite, this is the characteristic function of a normal distribution with mean zero and covariance matrix Γ, Γ ij = γ ti t j. The consistency condition is easy to check by taking u i 0, and then Kolmogorov s theorem tells us that there exists a stochastic process, in fact a Gaussian process, with these distributions. I am still looking for a good way to show that there is in fact an ARMA process having the given distributions. We may make two relevant observations: 1. If we require that the ARMA process be of finite order finite values of p and q) then we must require that the covariance function decay exponentially as l ±. It would be possible to fit the behavior to any desired degree of precision, but with a finite number of parameters we will never be able to fit with complete precision. 2. If we admit processes of infinite order, then we may as well simply consider MA ) processes since stationary ARMAp,q) processes are always equivalent. Then the question is whether any stationary Gaussian random process can be represented as a linear sum of Gaussian white noises. I believe this to be true but do not have a concise proof. The question is less interesting than it might appear, since the MA coefficients {θ j } may decay less slowly than we would like.
Time Series 2. Robert Almgren. Sept. 21, 2009
Time Series 2 Robert Almgren Sept. 21, 2009 This week we will talk about linear time series models: AR, MA, ARMA, ARIMA, etc. First we will talk about theory and after we will talk about fitting the models
More informationTime Series 4. Robert Almgren. Oct. 5, 2009
Time Series 4 Robert Almgren Oct. 5, 2009 1 Nonstationarity How should you model a process that has drift? ARMA models are intrinsically stationary, that is, they are mean-reverting: when the value of
More information1 Linear Difference Equations
ARMA Handout Jialin Yu 1 Linear Difference Equations First order systems Let {ε t } t=1 denote an input sequence and {y t} t=1 sequence generated by denote an output y t = φy t 1 + ε t t = 1, 2,... with
More informationCh. 14 Stationary ARMA Process
Ch. 14 Stationary ARMA Process A general linear stochastic model is described that suppose a time series to be generated by a linear aggregation of random shock. For practical representation it is desirable
More informationLesson 9: Autoregressive-Moving Average (ARMA) models
Lesson 9: Autoregressive-Moving Average (ARMA) models Dipartimento di Ingegneria e Scienze dell Informazione e Matematica Università dell Aquila, umberto.triacca@ec.univaq.it Introduction We have seen
More information3. ARMA Modeling. Now: Important class of stationary processes
3. ARMA Modeling Now: Important class of stationary processes Definition 3.1: (ARMA(p, q) process) Let {ɛ t } t Z WN(0, σ 2 ) be a white noise process. The process {X t } t Z is called AutoRegressive-Moving-Average
More informationWe use the centered realization z t z in the computation. Also used in computing sample autocovariances and autocorrelations.
Stationary Time Series Models Part 1 MA Models and Their Properties Class notes for Statistics 41: Applied Time Series Ioa State University Copyright 1 W. Q. Meeker. Segment 1 ARMA Notation, Conventions,
More informationStochastic Processes: I. consider bowl of worms model for oscilloscope experiment:
Stochastic Processes: I consider bowl of worms model for oscilloscope experiment: SAPAscope 2.0 / 0 1 RESET SAPA2e 22, 23 II 1 stochastic process is: Stochastic Processes: II informally: bowl + drawing
More informationIntroduction to ARMA and GARCH processes
Introduction to ARMA and GARCH processes Fulvio Corsi SNS Pisa 3 March 2010 Fulvio Corsi Introduction to ARMA () and GARCH processes SNS Pisa 3 March 2010 1 / 24 Stationarity Strict stationarity: (X 1,
More informationLecture 3: Autoregressive Moving Average (ARMA) Models and their Practical Applications
Lecture 3: Autoregressive Moving Average (ARMA) Models and their Practical Applications Prof. Massimo Guidolin 20192 Financial Econometrics Winter/Spring 2018 Overview Moving average processes Autoregressive
More information3 Theory of stationary random processes
3 Theory of stationary random processes 3.1 Linear filters and the General linear process A filter is a transformation of one random sequence {U t } into another, {Y t }. A linear filter is a transformation
More informationChapter 6: Model Specification for Time Series
Chapter 6: Model Specification for Time Series The ARIMA(p, d, q) class of models as a broad class can describe many real time series. Model specification for ARIMA(p, d, q) models involves 1. Choosing
More informationModule 4. Stationary Time Series Models Part 1 MA Models and Their Properties
Module 4 Stationary Time Series Models Part 1 MA Models and Their Properties Class notes for Statistics 451: Applied Time Series Iowa State University Copyright 2015 W. Q. Meeker. February 14, 2016 20h
More informationNonlinear time series
Based on the book by Fan/Yao: Nonlinear Time Series Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna October 27, 2009 Outline Characteristics of
More informationForecasting with ARMA
Forecasting with ARMA Eduardo Rossi University of Pavia October 2013 Rossi Forecasting Financial Econometrics - 2013 1 / 32 Mean Squared Error Linear Projection Forecast of Y t+1 based on a set of variables
More informationCovariances of ARMA Processes
Statistics 910, #10 1 Overview Covariances of ARMA Processes 1. Review ARMA models: causality and invertibility 2. AR covariance functions 3. MA and ARMA covariance functions 4. Partial autocorrelation
More informationChapter 4: Models for Stationary Time Series
Chapter 4: Models for Stationary Time Series Now we will introduce some useful parametric models for time series that are stationary processes. We begin by defining the General Linear Process. Let {Y t
More informationat least 50 and preferably 100 observations should be available to build a proper model
III Box-Jenkins Methods 1. Pros and Cons of ARIMA Forecasting a) need for data at least 50 and preferably 100 observations should be available to build a proper model used most frequently for hourly or
More informationECON 616: Lecture 1: Time Series Basics
ECON 616: Lecture 1: Time Series Basics ED HERBST August 30, 2017 References Overview: Chapters 1-3 from Hamilton (1994). Technical Details: Chapters 2-3 from Brockwell and Davis (1987). Intuition: Chapters
More informationDiscrete time processes
Discrete time processes Predictions are difficult. Especially about the future Mark Twain. Florian Herzog 2013 Modeling observed data When we model observed (realized) data, we encounter usually the following
More informationCovariance Stationary Time Series. Example: Independent White Noise (IWN(0,σ 2 )) Y t = ε t, ε t iid N(0,σ 2 )
Covariance Stationary Time Series Stochastic Process: sequence of rv s ordered by time {Y t } {...,Y 1,Y 0,Y 1,...} Defn: {Y t } is covariance stationary if E[Y t ]μ for all t cov(y t,y t j )E[(Y t μ)(y
More informationUniversity of Oxford. Statistical Methods Autocorrelation. Identification and Estimation
University of Oxford Statistical Methods Autocorrelation Identification and Estimation Dr. Órlaith Burke Michaelmas Term, 2011 Department of Statistics, 1 South Parks Road, Oxford OX1 3TG Contents 1 Model
More informationLecture 2: ARMA(p,q) models (part 2)
Lecture 2: ARMA(p,q) models (part 2) Florian Pelgrin University of Lausanne, École des HEC Department of mathematics (IMEA-Nice) Sept. 2011 - Jan. 2012 Florian Pelgrin (HEC) Univariate time series Sept.
More informationChapter 3 - Temporal processes
STK4150 - Intro 1 Chapter 3 - Temporal processes Odd Kolbjørnsen and Geir Storvik January 23 2017 STK4150 - Intro 2 Temporal processes Data collected over time Past, present, future, change Temporal aspect
More informationDifference equations. Definitions: A difference equation takes the general form. x t f x t 1,,x t m.
Difference equations Definitions: A difference equation takes the general form x t fx t 1,x t 2, defining the current value of a variable x as a function of previously generated values. A finite order
More informationEcon 623 Econometrics II Topic 2: Stationary Time Series
1 Introduction Econ 623 Econometrics II Topic 2: Stationary Time Series In the regression model we can model the error term as an autoregression AR(1) process. That is, we can use the past value of the
More informationγ 0 = Var(X i ) = Var(φ 1 X i 1 +W i ) = φ 2 1γ 0 +σ 2, which implies that we must have φ 1 < 1, and γ 0 = σ2 . 1 φ 2 1 We may also calculate for j 1
4.2 Autoregressive (AR) Moving average models are causal linear processes by definition. There is another class of models, based on a recursive formulation similar to the exponentially weighted moving
More informationCh. 15 Forecasting. 1.1 Forecasts Based on Conditional Expectations
Ch 15 Forecasting Having considered in Chapter 14 some of the properties of ARMA models, we now show how they may be used to forecast future values of an observed time series For the present we proceed
More informationLecture 1: Fundamental concepts in Time Series Analysis (part 2)
Lecture 1: Fundamental concepts in Time Series Analysis (part 2) Florian Pelgrin University of Lausanne, École des HEC Department of mathematics (IMEA-Nice) Sept. 2011 - Jan. 2012 Florian Pelgrin (HEC)
More information{ } Stochastic processes. Models for time series. Specification of a process. Specification of a process. , X t3. ,...X tn }
Stochastic processes Time series are an example of a stochastic or random process Models for time series A stochastic process is 'a statistical phenomenon that evolves in time according to probabilistic
More informationLECTURE 10 LINEAR PROCESSES II: SPECTRAL DENSITY, LAG OPERATOR, ARMA. In this lecture, we continue to discuss covariance stationary processes.
MAY, 0 LECTURE 0 LINEAR PROCESSES II: SPECTRAL DENSITY, LAG OPERATOR, ARMA In this lecture, we continue to discuss covariance stationary processes. Spectral density Gourieroux and Monfort 990), Ch. 5;
More informationIntroduction to Stochastic processes
Università di Pavia Introduction to Stochastic processes Eduardo Rossi Stochastic Process Stochastic Process: A stochastic process is an ordered sequence of random variables defined on a probability space
More informationModule 3. Descriptive Time Series Statistics and Introduction to Time Series Models
Module 3 Descriptive Time Series Statistics and Introduction to Time Series Models Class notes for Statistics 451: Applied Time Series Iowa State University Copyright 2015 W Q Meeker November 11, 2015
More informationExercises - Time series analysis
Descriptive analysis of a time series (1) Estimate the trend of the series of gasoline consumption in Spain using a straight line in the period from 1945 to 1995 and generate forecasts for 24 months. Compare
More informationESSE Mid-Term Test 2017 Tuesday 17 October :30-09:45
ESSE 4020 3.0 - Mid-Term Test 207 Tuesday 7 October 207. 08:30-09:45 Symbols have their usual meanings. All questions are worth 0 marks, although some are more difficult than others. Answer as many questions
More information1 Class Organization. 2 Introduction
Time Series Analysis, Lecture 1, 2018 1 1 Class Organization Course Description Prerequisite Homework and Grading Readings and Lecture Notes Course Website: http://www.nanlifinance.org/teaching.html wechat
More informationTopic 4 Unit Roots. Gerald P. Dwyer. February Clemson University
Topic 4 Unit Roots Gerald P. Dwyer Clemson University February 2016 Outline 1 Unit Roots Introduction Trend and Difference Stationary Autocorrelations of Series That Have Deterministic or Stochastic Trends
More informationEC402: Serial Correlation. Danny Quah Economics Department, LSE Lent 2015
EC402: Serial Correlation Danny Quah Economics Department, LSE Lent 2015 OUTLINE 1. Stationarity 1.1 Covariance stationarity 1.2 Explicit Models. Special cases: ARMA processes 2. Some complex numbers.
More informationChapter 1. Basics. 1.1 Definition. A time series (or stochastic process) is a function Xpt, ωq such that for
Chapter 1 Basics 1.1 Definition A time series (or stochastic process) is a function Xpt, ωq such that for each fixed t, Xpt, ωq is a random variable [denoted by X t pωq]. For a fixed ω, Xpt, ωq is simply
More informationTime Series Analysis
Time Series Analysis Christopher Ting http://mysmu.edu.sg/faculty/christophert/ christopherting@smu.edu.sg Quantitative Finance Singapore Management University March 3, 2017 Christopher Ting Week 9 March
More informationIdentifiability, Invertibility
Identifiability, Invertibility Defn: If {ǫ t } is a white noise series and µ and b 0,..., b p are constants then X t = µ + b 0 ǫ t + b ǫ t + + b p ǫ t p is a moving average of order p; write MA(p). Q:
More informationFE570 Financial Markets and Trading. Stevens Institute of Technology
FE570 Financial Markets and Trading Lecture 5. Linear Time Series Analysis and Its Applications (Ref. Joel Hasbrouck - Empirical Market Microstructure ) Steve Yang Stevens Institute of Technology 9/25/2012
More informationUniversità di Pavia. Forecasting. Eduardo Rossi
Università di Pavia Forecasting Eduardo Rossi Mean Squared Error Forecast of Y t+1 based on a set of variables observed at date t, X t : Yt+1 t. The loss function MSE(Y t+1 t ) = E[Y t+1 Y t+1 t ]2 The
More informationSTAT STOCHASTIC PROCESSES. Contents
STAT 3911 - STOCHASTIC PROCESSES ANDREW TULLOCH Contents 1. Stochastic Processes 2 2. Classification of states 2 3. Limit theorems for Markov chains 4 4. First step analysis 5 5. Branching processes 5
More informationSome Time-Series Models
Some Time-Series Models Outline 1. Stochastic processes and their properties 2. Stationary processes 3. Some properties of the autocorrelation function 4. Some useful models Purely random processes, random
More information2. An Introduction to Moving Average Models and ARMA Models
. An Introduction to Moving Average Models and ARMA Models.1 White Noise. The MA(1) model.3 The MA(q) model..4 Estimation and forecasting of MA models..5 ARMA(p,q) models. The Moving Average (MA) models
More informationModelling using ARMA processes
Modelling using ARMA processes Step 1. ARMA model identification; Step 2. ARMA parameter estimation Step 3. ARMA model selection ; Step 4. ARMA model checking; Step 5. forecasting from ARMA models. 33
More informationPart III Example Sheet 1 - Solutions YC/Lent 2015 Comments and corrections should be ed to
TIME SERIES Part III Example Sheet 1 - Solutions YC/Lent 2015 Comments and corrections should be emailed to Y.Chen@statslab.cam.ac.uk. 1. Let {X t } be a weakly stationary process with mean zero and let
More informationChapter 8: Model Diagnostics
Chapter 8: Model Diagnostics Model diagnostics involve checking how well the model fits. If the model fits poorly, we consider changing the specification of the model. A major tool of model diagnostics
More information7. MULTIVARATE STATIONARY PROCESSES
7. MULTIVARATE STATIONARY PROCESSES 1 1 Some Preliminary Definitions and Concepts Random Vector: A vector X = (X 1,..., X n ) whose components are scalar-valued random variables on the same probability
More informationSTAD57 Time Series Analysis. Lecture 8
STAD57 Time Series Analysis Lecture 8 1 ARMA Model Will be using ARMA models to describe times series dynamics: ( B) X ( B) W X X X W W W t 1 t1 p t p t 1 t1 q tq Model must be causal (i.e. stationary)
More informationEconometría 2: Análisis de series de Tiempo
Econometría 2: Análisis de series de Tiempo Karoll GOMEZ kgomezp@unal.edu.co http://karollgomez.wordpress.com Segundo semestre 2016 III. Stationary models 1 Purely random process 2 Random walk (non-stationary)
More informationEASTERN MEDITERRANEAN UNIVERSITY ECON 604, FALL 2007 DEPARTMENT OF ECONOMICS MEHMET BALCILAR ARIMA MODELS: IDENTIFICATION
ARIMA MODELS: IDENTIFICATION A. Autocorrelations and Partial Autocorrelations 1. Summary of What We Know So Far: a) Series y t is to be modeled by Box-Jenkins methods. The first step was to convert y t
More informationA time series is called strictly stationary if the joint distribution of every collection (Y t
5 Time series A time series is a set of observations recorded over time. You can think for example at the GDP of a country over the years (or quarters) or the hourly measurements of temperature over a
More informationEmpirical Market Microstructure Analysis (EMMA)
Empirical Market Microstructure Analysis (EMMA) Lecture 3: Statistical Building Blocks and Econometric Basics Prof. Dr. Michael Stein michael.stein@vwl.uni-freiburg.de Albert-Ludwigs-University of Freiburg
More informationLecture 2: Univariate Time Series
Lecture 2: Univariate Time Series Analysis: Conditional and Unconditional Densities, Stationarity, ARMA Processes Prof. Massimo Guidolin 20192 Financial Econometrics Spring/Winter 2017 Overview Motivation:
More informationTMA4285 December 2015 Time series models, solution.
Norwegian University of Science and Technology Department of Mathematical Sciences Page of 5 TMA4285 December 205 Time series models, solution. Problem a) (i) The slow decay of the ACF of z t suggest that
More informationPermanent Income Hypothesis (PIH) Instructor: Dmytro Hryshko
Permanent Income Hypothesis (PIH) Instructor: Dmytro Hryshko 1 / 36 The PIH Utility function is quadratic, u(c t ) = 1 2 (c t c) 2 ; borrowing/saving is allowed using only the risk-free bond; β(1 + r)
More informationWeek 5 Quantitative Analysis of Financial Markets Characterizing Cycles
Week 5 Quantitative Analysis of Financial Markets Characterizing Cycles Christopher Ting http://www.mysmu.edu/faculty/christophert/ Christopher Ting : christopherting@smu.edu.sg : 6828 0364 : LKCSB 5036
More informationProblem Set 1 Solution Sketches Time Series Analysis Spring 2010
Problem Set 1 Solution Sketches Time Series Analysis Spring 2010 1. Construct a martingale difference process that is not weakly stationary. Simplest e.g.: Let Y t be a sequence of independent, non-identically
More information5: MULTIVARATE STATIONARY PROCESSES
5: MULTIVARATE STATIONARY PROCESSES 1 1 Some Preliminary Definitions and Concepts Random Vector: A vector X = (X 1,..., X n ) whose components are scalarvalued random variables on the same probability
More informationEcon 424 Time Series Concepts
Econ 424 Time Series Concepts Eric Zivot January 20 2015 Time Series Processes Stochastic (Random) Process { 1 2 +1 } = { } = sequence of random variables indexed by time Observed time series of length
More informationVolatility. Gerald P. Dwyer. February Clemson University
Volatility Gerald P. Dwyer Clemson University February 2016 Outline 1 Volatility Characteristics of Time Series Heteroskedasticity Simpler Estimation Strategies Exponentially Weighted Moving Average Use
More informationAutoregressive Moving Average (ARMA) Models and their Practical Applications
Autoregressive Moving Average (ARMA) Models and their Practical Applications Massimo Guidolin February 2018 1 Essential Concepts in Time Series Analysis 1.1 Time Series and Their Properties Time series:
More informationProblem Set 2: Box-Jenkins methodology
Problem Set : Box-Jenkins methodology 1) For an AR1) process we have: γ0) = σ ε 1 φ σ ε γ0) = 1 φ Hence, For a MA1) process, p lim R = φ γ0) = 1 + θ )σ ε σ ε 1 = γ0) 1 + θ Therefore, p lim R = 1 1 1 +
More informationCh 4. Models For Stationary Time Series. Time Series Analysis
This chapter discusses the basic concept of a broad class of stationary parametric time series models the autoregressive moving average (ARMA) models. Let {Y t } denote the observed time series, and {e
More informationECON/FIN 250: Forecasting in Finance and Economics: Section 6: Standard Univariate Models
ECON/FIN 250: Forecasting in Finance and Economics: Section 6: Standard Univariate Models Patrick Herb Brandeis University Spring 2016 Patrick Herb (Brandeis University) Standard Univariate Models ECON/FIN
More informationStat 5100 Handout #12.e Notes: ARIMA Models (Unit 7) Key here: after stationary, identify dependence structure (and use for forecasting)
Stat 5100 Handout #12.e Notes: ARIMA Models (Unit 7) Key here: after stationary, identify dependence structure (and use for forecasting) (overshort example) White noise H 0 : Let Z t be the stationary
More information11. Further Issues in Using OLS with TS Data
11. Further Issues in Using OLS with TS Data With TS, including lags of the dependent variable often allow us to fit much better the variation in y Exact distribution theory is rarely available in TS applications,
More informationTime Series Analysis -- An Introduction -- AMS 586
Time Series Analysis -- An Introduction -- AMS 586 1 Objectives of time series analysis Data description Data interpretation Modeling Control Prediction & Forecasting 2 Time-Series Data Numerical data
More informationWe will only present the general ideas on how to obtain. follow closely the AR(1) and AR(2) cases presented before.
ACF and PACF of an AR(p) We will only present the general ideas on how to obtain the ACF and PACF of an AR(p) model since the details follow closely the AR(1) and AR(2) cases presented before. Recall that
More informationExpressions for the covariance matrix of covariance data
Expressions for the covariance matrix of covariance data Torsten Söderström Division of Systems and Control, Department of Information Technology, Uppsala University, P O Box 337, SE-7505 Uppsala, Sweden
More informationTime Series Analysis Fall 2008
MIT OpenCourseWare http://ocw.mit.edu 14.384 Time Series Analysis Fall 008 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms. Introduction 1 14.384 Time
More information6.3 Forecasting ARMA processes
6.3. FORECASTING ARMA PROCESSES 123 6.3 Forecasting ARMA processes The purpose of forecasting is to predict future values of a TS based on the data collected to the present. In this section we will discuss
More informationUnivariate Time Series Analysis; ARIMA Models
Econometrics 2 Fall 24 Univariate Time Series Analysis; ARIMA Models Heino Bohn Nielsen of4 Outline of the Lecture () Introduction to univariate time series analysis. (2) Stationarity. (3) Characterizing
More informationLong-range dependence
Long-range dependence Kechagias Stefanos University of North Carolina at Chapel Hill May 23, 2013 Kechagias Stefanos (UNC) Long-range dependence May 23, 2013 1 / 45 Outline 1 Introduction to time series
More informationLINEAR STOCHASTIC MODELS
LINEAR STOCHASTIC MODELS Let {x τ+1,x τ+2,...,x τ+n } denote n consecutive elements from a stochastic process. If their joint distribution does not depend on τ, regardless of the size of n, then the process
More informationMidterm Suggested Solutions
CUHK Dept. of Economics Spring 2011 ECON 4120 Sung Y. Park Midterm Suggested Solutions Q1 (a) In time series, autocorrelation measures the correlation between y t and its lag y t τ. It is defined as. ρ(τ)
More informationARMA Models: I VIII 1
ARMA Models: I autoregressive moving-average (ARMA) processes play a key role in time series analysis for any positive integer p & any purely nondeterministic process {X t } with ACVF { X (h)}, there is
More informationTime series models in the Frequency domain. The power spectrum, Spectral analysis
ime series models in the Frequency domain he power spectrum, Spectral analysis Relationship between the periodogram and the autocorrelations = + = ( ) ( ˆ α ˆ ) β I Yt cos t + Yt sin t t= t= ( ( ) ) cosλ
More information7. Forecasting with ARIMA models
7. Forecasting with ARIMA models 309 Outline: Introduction The prediction equation of an ARIMA model Interpreting the predictions Variance of the predictions Forecast updating Measuring predictability
More informationNotes on Time Series Modeling
Notes on Time Series Modeling Garey Ramey University of California, San Diego January 17 1 Stationary processes De nition A stochastic process is any set of random variables y t indexed by t T : fy t g
More informationA SARIMAX coupled modelling applied to individual load curves intraday forecasting
A SARIMAX coupled modelling applied to individual load curves intraday forecasting Frédéric Proïa Workshop EDF Institut Henri Poincaré - Paris 05 avril 2012 INRIA Bordeaux Sud-Ouest Institut de Mathématiques
More informationApplied time-series analysis
Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna October 18, 2011 Outline Introduction and overview Econometric Time-Series Analysis In principle,
More information18.S096 Problem Set 4 Fall 2013 Time Series Due Date: 10/15/2013
18.S096 Problem Set 4 Fall 2013 Time Series Due Date: 10/15/2013 1. Covariance Stationary AR(2) Processes Suppose the discrete-time stochastic process {X t } follows a secondorder auto-regressive process
More informationStatistics 349(02) Review Questions
Statistics 349(0) Review Questions I. Suppose that for N = 80 observations on the time series { : t T} the following statistics were calculated: _ x = 10.54 C(0) = 4.99 In addition the sample autocorrelation
More informationTime Series Models and Inference. James L. Powell Department of Economics University of California, Berkeley
Time Series Models and Inference James L. Powell Department of Economics University of California, Berkeley Overview In contrast to the classical linear regression model, in which the components of the
More informationCh 6. Model Specification. Time Series Analysis
We start to build ARIMA(p,d,q) models. The subjects include: 1 how to determine p, d, q for a given series (Chapter 6); 2 how to estimate the parameters (φ s and θ s) of a specific ARIMA(p,d,q) model (Chapter
More informationTAKEHOME FINAL EXAM e iω e 2iω e iω e 2iω
ECO 513 Spring 2015 TAKEHOME FINAL EXAM (1) Suppose the univariate stochastic process y is ARMA(2,2) of the following form: y t = 1.6974y t 1.9604y t 2 + ε t 1.6628ε t 1 +.9216ε t 2, (1) where ε is i.i.d.
More information1 Introduction to Generalized Least Squares
ECONOMICS 7344, Spring 2017 Bent E. Sørensen April 12, 2017 1 Introduction to Generalized Least Squares Consider the model Y = Xβ + ɛ, where the N K matrix of regressors X is fixed, independent of the
More informationMath Tools: Stochastic Processes Revised: November 30, 2015
ECON-UB 233 Dave Backus @ NYU Math Tools: Stochastic Processes Revised: November 30, 2015 All of modern macroeconomics, and most of modern finance, is concerned with how randomness unfolds through time.
More information1 Teaching notes on structural VARs.
Bent E. Sørensen February 22, 2007 1 Teaching notes on structural VARs. 1.1 Vector MA models: 1.1.1 Probability theory The simplest (to analyze, estimation is a different matter) time series models are
More informationGaussian processes. Basic Properties VAG002-
Gaussian processes The class of Gaussian processes is one of the most widely used families of stochastic processes for modeling dependent data observed over time, or space, or time and space. The popularity
More informationChapter 6. Random Processes
Chapter 6 Random Processes Random Process A random process is a time-varying function that assigns the outcome of a random experiment to each time instant: X(t). For a fixed (sample path): a random process
More informationAutoregressive and Moving-Average Models
Chapter 3 Autoregressive and Moving-Average Models 3.1 Introduction Let y be a random variable. We consider the elements of an observed time series {y 0,y 1,y2,...,y t } as being realizations of this randoms
More informationQuantitative Finance I
Quantitative Finance I Linear AR and MA Models (Lecture 4) Winter Semester 01/013 by Lukas Vacha * If viewed in.pdf format - for full functionality use Mathematica 7 (or higher) notebook (.nb) version
More informationCircle a single answer for each multiple choice question. Your choice should be made clearly.
TEST #1 STA 4853 March 4, 215 Name: Please read the following directions. DO NOT TURN THE PAGE UNTIL INSTRUCTED TO DO SO Directions This exam is closed book and closed notes. There are 31 questions. Circle
More informationTrend-Cycle Decompositions
Trend-Cycle Decompositions Eric Zivot April 22, 2005 1 Introduction A convenient way of representing an economic time series y t is through the so-called trend-cycle decomposition y t = TD t + Z t (1)
More informationReview Session: Econometrics - CLEFIN (20192)
Review Session: Econometrics - CLEFIN (20192) Part II: Univariate time series analysis Daniele Bianchi March 20, 2013 Fundamentals Stationarity A time series is a sequence of random variables x t, t =
More informationThe autocorrelation and autocovariance functions - helpful tools in the modelling problem
The autocorrelation and autocovariance functions - helpful tools in the modelling problem J. Nowicka-Zagrajek A. Wy lomańska Institute of Mathematics and Computer Science Wroc law University of Technology,
More information