Chapter 1. Basics. 1.1 Definition. A time series (or stochastic process) is a function Xpt, ωq such that for
|
|
- Maximillian Hines
- 5 years ago
- Views:
Transcription
1 Chapter 1 Basics 1.1 Definition A time series (or stochastic process) is a function Xpt, ωq such that for each fixed t, Xpt, ωq is a random variable [denoted by X t pωq]. For a fixed ω, Xpt, ωq is simply a function of t and is called a realization of the stochastic process. $'& '% Time Domain Approach Frequency Domain Approach $'& '% Continuous Time Discrete Time 11
2 12 CHAPTER 1. BASICS 1.2 Characterization of a time series A time series is characterized by the joint distribution function of any subset X t1,, X tn that is F Xt1,, X tn px t1,, x tn q. Using the joint distribution function, define µ t EpX t q γ t,s CovpX t, X s q, provided that they exist. The first two monents, {µ t }, {γ t,s } completely characterize a Gaussian process. F Xt1,, X tn is in general, very difficult to analyze. In particular, estimation of {µ t }, {γ t,s } appears to be impossible unless a number of different realizations, i.e. repeated observations are available. 1.3 Stationarity Assume F Xt1,,X tn is invariant under transformation of the time indices, that is F Xt1 h,, X tn h px t1,, x tn q F Xt1,,X tn px t1,, x tn q p1q for all sets of indices (t 1,, t n ). This is called the strict stationarity.
3 1.3. STATIONARITY 13 Under this assumption, the joint distribution function depends only on the distance between the elements in the index set. If tx t u is strictly stationary and E X t 8, then EpX t q p2q CovpX t, X s q γ t s p3q tx t u is said to be weakly stationary (or covariance stationary or simply, stationary ) if (2) and (3) holds. REMARKS 1) (Weak) stationarity does not imply strict stationarity. Nor does strict stationarity imply (weak) stationarity. e.g. A strict stationary process may not possess finite moments (e.g. Cauchy). 2) For a Gaussian process, weak and strict stationarity are equivalent.
4 14 CHAPTER 1. BASICS µ and γ t s can be estimated by pµ s X 1 T pγ h c h 1 T Ţ X t t1 Ţ th 1 px t s XqpXt h s Xq, h 0, 1,. If the process is also ergodic (average asymptotic independence), s X and c h are consistent estimators of µ and γ h. 1.4 Autocovariance and Autocorrelation Functions The sequence tγ h u viewed as a function of h is called the autocovariance function. The autocorrelation function is defined by note ρ 0 1 ρ h γ h γ 0, Example 1. (White noise process) tx t u, X t iid p0, σ 2 q, 0 σ 2 8. µ 0, γ h $'& '% σ2 if h 0, 0 otherwise.
5 1.4. AUTOCOVARIANCE AND AUTOCORRELATION FUNCTIONS 15 Example 2. (MA(1) process) Let tε t u be a white noise process with finite variance σ 2. Let X t ε t θε t 1. Then µ EpX t q 0 γ 0 Epε t θε t 1 q 2 Epε 2 t q θ2 Epε 2 t 1 q p1 θ 2 qσ 2 γ h Erpε t θε t 1 qpε t h θε t h 1 qs $'& '% θσ2 if h 1, 0 if h 2. Therefore, ρ h $'& '% 1 if h 0, θ 1 θ 2 if h 1, 0 otherwise.
6 16 CHAPTER 1. BASICS Suppose θ 0.6. Then ρ ρ h h ρ h ρphq : the autocorrelation function. Sample mean of tx t u T t1 s XT Sample variance = c 0 pγ 0 Sample autocovariance = c h, h 1, 2, pγ h Sample autocorrelation = r h por pρ h q c h c 0, h 1, 2, Note r 0 1.
7 1.5. LAG OPERATOR 17 A plot of r h against h 0, 1, is called correlogram. r h h The sample autocorrelations are estimates of the corresponding theoretical autocorrelations and are therefore subject to sampling errors. 1.5 Lag Operator The operator L (sometimes denoted by B) is defined by LX t X t 1.
8 18 CHAPTER 1. BASICS Formally, L operates on the whole sequence... X t 1 X t 2 L : X t ÝÑ X t 1 X t 1. X t. The lead operator L 1 (sometimes denoted by F ) is defined by L 1 X t X t 1. Successive application of L yields L h X t X t h, h 1, 2, We define L 0 X t X t. The lag operator is a linear operator : LpcX t q clx t LpX t Y t q LX t LY t and can be manipulated like a usual algebraic quantity. For example, suppose y t φy t 1 ε t, and φ 1.
9 1.6. GENERAL LINEAR PROCESS 19 Then, p1 φlqy t ε t So, y t 8 ε t 1 φl pφlq j ε t 1 L is called the difference operator. 2 y t p1 Lq 2 y t p1 2L L 2 qy t = y t 2y t 1 y t 2 2 y t p y t q py t y t 1 q = py t y t 1 q py t 1 y t 2 q y t 2y t 1 y t General Linear Process y t ε t ψ 1 ε t 1 ψ 2 ε t 2 ψplqε t ÐÝ linear process where ε t iid p0, σ 2 q and ψplq 1 ψ 1 L ψ 2 L 2 polynomial in lag operators ψplq is sometimes called transfer function
10 20 CHAPTER 1. BASICS A time series ty t u can be viewed as the result of applying a backward (linear) filter to a white noise process. ε t input ÝÑ linear filter ψplq output ÝÑ Y t ψplqε t The sequence tψ j : j 0, 1, u can be finite or infinite. If it is finite of order q, we obtain MApqq process. This is clearly a stationary process. If 8 tψ j u is infinite, we usually assume it is absolutely summable. i.e. ψ j 8. Then the resulting process is stationary. To see this, µ 0 γ 0 σ 2 γ h σ 2 8 ψ j 0 8 ψj 2 σ ψ j 8 8 ψ j ψ j h 8 σ 2 ψ j ψ j h σ ψ j 8
11 1.7. AUTOREGRESSIVE PROCESS 21 The stationary condition is embodied in the condition that ψpzq must converge for z 1, i.e. for z on or within the unit circle. Note that absolute summability of tψ j u is sufficient but not necessary for stationarity. 7 8 ψ j z j 8 ψ j Autoregressive Process The process y t defined by y t φ 1 y t 1 φ p y t p ε t p q is called a p-th order autoregressive process and is denoted by y t ARppq The equation p q is sometimes called a stochastic difference equation.
12 22 CHAPTER 1. BASICS First - Order Autoregressive Process ARp1q is given by y t φy t 1 ε t. By successive substitution, y t ε t φy t 1 ε t φε t 1 φ 2 y t 2 ε t φε t 1 φ 2 ε t 2 φ 3 y t 3 J 1 φ j ε t j φ J y t J, implying Epy t y t J q φ J y t J If φ 1, the value of y t J can affect the prediction of future y t, no matter how far ahead. If φ 1, J 1 y t lim φ j ε t j JÑ8 8 φ j ε t j. lim JÑ8 φ J y t J 8 Note that φ j 8 φ j 1 1 φ 8, if φ 1,
13 1.7. AUTOREGRESSIVE PROCESS 23 so, tφ j u is absolutely summable and ty t u is a linear process. ψplq p1 φlq 1 8 φ j L j, or ψ j φ j Now, Epy 2 t q Epφ2 y 2 t 1 ε2 t 2φy t 1ε t q because Epy t 1 ε t q γ 0 φ 2 γ 0 σ 2 ErEpy t 1 ε t y t 1 qs Ery t 1 Epε t y t 1 qs Epy t 1 0q 0 Therefore, γ 0 σ2 1 φ 2 8, if φ Second - Order Autoregressive Process ARp2q is given by y t φ 1 y t 1 φ 2 y t 2 ε t or φplqy t ε t, where, φplq 1 φ 1 L φ 2 L 2.
14 24 CHAPTER 1. BASICS Now, suppose φpzq can be written as φpzq p1 λ 1 zqp1 λ 2 zq. Then ψpzq φ 1 pzq 1 p1 λ 1 zqp1 λ 2 zq K 1 1 λ 1 z where K 1 λ 1 λ 1 λ 2 and K 2 λ 2 λ 1 λ 2. K 2 1 λ 2 z, Therefore, ψpzq converges for z 1, iff λ 1 1 and λ 2 1. In other words, for ARp2q process to be stationary, the roots of φpzq 1 φ 1 z φ 2 z 2 must lie outside the unit circle. Note that φp0q 1 0. Let m 1 and m 2 be the roots. The necessary and sufficient condition for m 1 1 and m 2 1 are m 1 m 2 1 φ 2 1 ðñ φ 2 1 φp1q 1 φ 1 φ 2 0 φp 1q 1 φ 1 φ 2 0
15 1.7. AUTOREGRESSIVE PROCESS y y 1 φ 1 z φ 2 z 2 Õ z 1 To have real roots, φ 2 1 4φ φ 2 1 real roots Õ φ complex roots
16 26 CHAPTER 1. BASICS p - th Order Autoregressive Process ARppq is given by φplqy t ε t, where φplq 1 φ 1 L φ p L p. This process is stationary if all characteristic roots of φpzq 0 lie outside the unit circle. 1.8 Autocovariance and Autocorrelation Functions AR(1) Process y t φy t 1 ε t Then, Epy t 1 y t q Epφyt 1 2 ε ty t 1 q φepyt 1 2 q. So that γ 1 φγ 0, ρ 1 φρ 0 φ.
17 1.8. AUTOCOVARIANCE AND AUTOCORRELATION FUNCTIONS 27 we have Similarly, and noticing that Epy t h y t q Erφy t h y t 1 y t h ε t s φγ h 1, γ h φγ h 1 φ h γ 0 ρ h φ h ρ τ exponential decay φ 0.6 h ρ τ damped oscillation φ 0.6 h AR(2) Process y t φ 1 y t 1 φ 2 y t 2 ε t Then Epy t y t h q φ 1 Epy t 1 y t h q φ 2 Epy t 2 y t h q Epε t y t h q p1q γ h φ 1 γ h 1 φ 2 γ h 2, h 1, 2, ρ h φ 1 ρ h 1 φ 2 ρ h 2, h 1, 2,. p2q
18 28 CHAPTER 1. BASICS Setting h 1 in (2) yields ρ 1 φ 1 ρ 0 φ 2 ρ 1 ρ 2 φ 1 ρ 1 φ 2 φ 1 1 φ 2 φ2 1 1 φ 2 φ 2 Setting h 0 in (1) yields γ 0 φ 1 γ 1 φ 2 γ 2 σ 2 γ 0 p1 φ 1 ρ 1 φ 2 ρ 2 q σ 2 γ 0 p1 φ2 1 φ2 1φ 2 φ φ 2 1 φ q σ2 2 1 φ2 γ 0 rp1 φ 2 q 2 φ φ s σ2 2 6 γ 0 1 φ2 1 φ 2 σ 2 rp1 φ 2 q 2 φ 2 1s AR(p) Process Epy t y t 1 q Epφ 1 y 2 t 1 φ py t p y t 1 ε t y t 1 q. γ 1 φ 1 γ 0 φ p γ p 1 γ 0 φ 1 γ 1 φ p γ p σ 2.
19 1.9. MOVING AVERAGE PROCESS 29 If h p, γ h φ 1 γ h 1 φ p γ h p Note ρ h φ 1 ρ h 1 φ p ρ h p ρ h ÝÑ 0, as h ÝÑ 8 for AR(p) process. 1.9 Moving Average Process The process y t which is defined by y t ε t θ 1 ε t 1 θ q ε t q is called a q -th order moving average process or MApqq process. Write y t θplqε t, where, θplq 1 θ 1 L θ q L q Finite MA process can be regarded as the output y t from a linear filter with transfer function θplq when the input is WN (White Noise), ε t. Finite M A process is therefore stationary.
20 30 CHAPTER 1. BASICS The autocovariances are γ 0 Ey 2 t Epε t θ 1 ε t 1 θ q ε t q q 2 σ 2 p1 θ 2 1 θ2 q q σ2 q θ 2 j, (where θ 0 1). γ h Epy t y t h q Erpε t θ 1 ε t 1 θ q ε t q qpε t h θ 1 ε t h 1 θ q ε t h q qs σ 2 pθ h θ 1 θ h 1 θ q h θ q q, for h q σ 2 q jh θ j h θ j (convolution). γ h 0, for h q. Note that there is a cut off q. This contrasts with ARppq process, for which γ h 0, for any h. The h th order autocorrelation function ρ h θ h θ 1 θ h 1 θ q h θ q, for h 1 θ1 2 1, 2,, q θq 2 ρ h 0 for h q The autocorrelation function for MA process has a cut - off at h q. Write ΠpLqy t ε t y t θplqε t
21 1.9. MOVING AVERAGE PROCESS 31 If MA process is invertible, ΠpLq θplq 1. The invertiblity condition for M Apqq process is that all roots of characteristic equation θpzq 0 lie outside the unit circle. Write y t q¹ q¹ j1 If it is invertible, j1 p1 ω j Lqε t, p1 ω j L ω 2 j L 2 qy t ε t, that is, the finite order MA process is transformed into the infinite order AR process MA(1) Process y t ε t θε t 1 p1 θlqε t. θ must lie in the range (-1, 1) for the process to be invertible. γ 0 p1 θ 2 qσ 2 γ 1 θσ 2 γ h 0 for h 2, 3,
22 32 CHAPTER 1. BASICS ρ 1 θ 1 θ 2 ρ h 0 for h 2, 3, p q It follows from p q that θ 2 ρ 1 1 θ 1 0 which implies that if θ s θ is a solution, then so is θ s θ 1. So, if θ s θ satisfies the invertibility condition, the other root θ s θ 1 will not satisfy the condition Mixed Autoregressive - Moving Average Model The process y t which is defined by y t φ 1 y t 1 φ p y t p ε t θ 1 ε t 1 θ q ε t q p1q is called a (mixed) autoregressive - moving - average progress of p and q -th order, or ARMApp, qq process. This may be thought of as a p-th order autoregressive process, φplqy t e t, with e t following the q-th order moving average process, e t θplqε t, or alternatively, as an MApqq process y t θplqη t, with η t following ARppq process φplqη t ε t.
23 1.10. MIXED AUTOREGRESSIVE - MOVING AVERAGE MODEL 33 ARMApp, qq process (1) is stationary if φpzq 0 has all its roots lying outside the unit circle, and is invertible if all roots of θpzq 0 lie outside the unit circle. On multiplying throughout in (1) by y t h and taking expectations, we see that the autocovariance function satisfies the deterministic difference equation γ h φ 1 γ h 1 φ p γ h p γ yε phq θ 1 γ yε ph 1q θ q γ yε ph qq p2q where γ yε p q is the cross covariance function between y and ε, and is defined as γ yε phq Epy t h ε t q. It is easy to see γ yε phq 0, for h 0 γ yε phq 0, for h 0. Hence, γ h φ 1 γ h 1 φ p γ h p, for h q 1 and, ρ h φ 1 ρ h 1 φ p ρ h p, for h q 1 or, φplqρ h 0, for h q 1 ÐÝ look like ARppq p3q
24 34 CHAPTER 1. BASICS Setting h 0 in (2), we have γ 0 φ 1 γ 1 φ p γ p σ 2 θ 1 γ yε p 1q θ q γ yε p qq p4q From (3), we see that the autocorrelation function for the mixed process eventually takes the same shape as that of AR process φplqy t ε t ARMA(1, 1) process y t φy t 1 ε t θε t 1 p5q p1 φlqy t p1 θlqε t The process is stationary if φ 1, and invertible if θ 1. Using (2) and (4), we obtain γ 0 φγ 1 σ 2 θγ yε p 1q γ 1 φγ 0 θσ 2 γ h φγ h 1, for h 2, 3, Note that γ yε p 1q Epy t ε t 1 q Epy t 1 ε t q So, on multiplying throughout (5) by ε t 1, and taking expectations, we obtain γ yε p 1q pφ θqσ 2
25 1.10. MIXED AUTOREGRESSIVE - MOVING AVERAGE MODEL 35 Hence, γ 0 φpφγ 0 θσ 2 q σ 2 θpφ θqσ 2 1 θ2 2φθ 1 φ 2 σ 2 γ 1 φp1 θ2 2φθq θp1 φ 2 q 1 φ 2 σ 2 pφ θqp1 φθq 1 φ 2 σ 2 γ h φγ h 1, for h 2, 3, Ð look like ARp1q and so ρ 1 pφ θqp1 φθq 1 θ 2 2φθ ρ h φρ h 1, for h 2, 3, ρ h 1 exponential decay 0.5 φ 0.6 θ h [ρ , ρ , ρ , ρ , ρ ]
26 36 CHAPTER 1. BASICS Theorem (Granger s Lemma) If X t ARMApp, mq and Y t ARMApq, nq, if X t and Y t are independent, and if Z t X t Y t, then Z t ARMApr, lq, where r p q, and l maxpp n, q mq. P roof. Let a 1 plqx t b 1 plqε t and a 2 plqy t b 2 plqη t, where a 1, a 2, b 1, b 2 are polynomials in L of order p, q, m, n respectively, and ε t, η t are independent W N processes. Multiplying Z t X t Y t by a 1 plqa 2 plq, we obtain a 1 plqa 2 plqz t a 1 plqa 2 plqx t a 1 plqa 2 plqy t a 2 plqb 1 plqε t a 1 plqb 2 plqη t. Since a 2 plqb 1 plqε t MApq mq and a 1 plqb 2 plqη t MApp nq, RHS MAplq, where l maxpp n, q mq. The order of a 1 plqa 2 plq is not more than p q, and hence the theorem follows. The inequalities are needed in the theorem since a 1 plq and a 2 plq may contain common roots. REMARKS (1) The theorem implies that if the series analyzed is the sum of two independent ARp1q, then the series will be ARM Ap2, 1q,
27 1.11. AUTOCOVARIANCE GENERATING FUNCTION 37 for example. If the observed series is the sum of a true ARppq process plus a W N measurement error, then an ARMApp, pq process results. (2) Mixed model may achieve as good a fit as the AR model but using fewer parameters. Principle of parsimony (Box and Jenkins) 1.11 Autocovariance Generating Function A compact and convenient way of recording the information contained in a sequence ta j u is by means of the generating function : apzq j a j z j, where z is a possibly complex variable. The individual members of the sequence can easily be recovered from the coefficients associated with the z j s. The quantity z does not necessarily have any interpretation and should be simply considered as the carries of the information in the sequence. Now define γpzq ρpzq 8 8 h 8 h 8 mptq Epe tx q φptq Epe itx q γ h z h ρ h z h autocovariance generating function autocorrelation generating function Moment Generating Function Characteristic Function
28 38 CHAPTER 1. BASICS Useful properties of generating functions : (1) Additivity c j a j b j ÝÑ cpzq apzq bpzq (2) Convolution c j j k0 a k b j k apzq ÝÑ cpzq apzqbpzq 8 a j z j, j 0, 1, 2, Given X 1, X 2,, z - transform Xpzq ţ X t z t Now, let X T pzq Ţ t1 then, ErX T pzqx T pz 1 qs X t z t, Ţ h T pt h qγ h z h. Dividing by T and passing to the limit, we obtain, 1 γpzq lim T Ñ8 T ErX T pzqx T pz 1 qs. Let S t y t y N S N Ş ψ j ε N S j Ş ψ j ε S N j t N ψ j ε t j Ñ 8 ψ j ε t j as N ÝÑ 8 c 0 a 0 b 0 c 1 a 0 b 1 a 1 b 0 c 2 a 0 b 2 a 1 b 1 a 2 b 0 pa 0 a 1 z a 2 z 2 qpb 0 b 1 z b 2 z 2 q a 0 b 0 pa 0 b 1 a 1 b 0 qz pa 0 b 2 a 1 b 1 a 2 b 0 qz 2
29 1.11. AUTOCOVARIANCE GENERATING FUNCTION 39 y 0 ε 0 y 1 ε 1 ψ 1 ε 0 y 2 ε 2 ψ 1 ε 1 ψ 2 ε 0. y T Ţ ψ j ε t j Define, y T pzq ε T pzq ψ T pzq Ţ t0 Ţ t0 Ţ t0 y t z t ε t z t ψ t z t Suppose ty t u is a linear process. Then, Y pzq ψpzqεpzq. 1 Hence, γ Y pzq lim T Ñ8 T Erψ T pzqε T pzqψ T pz 1 qε T pz 1 qs ψpzqψpz 1 qσ MA(q) process y t θplqε t γpzq σ 2 θpzqθpz 1 q
30 40 CHAPTER 1. BASICS Note that θpzqθpz 1 q q q k0 q z h θ j θ k z j k q h q θ j θ j h by setting j k h, and taking θ j 0 for j q. For MA(1), y t ε t θε t 1 θpzqθpz 1 q σ 2 p1 θzqp1 θz 1 q $'& γ 0 p1 θ 2 qσ 2 $'& θ 0 1 σ 2 rp1 θ 2 q θz θz 1 s '% 1 γ 1 θσ 2 γ h 0, for h 2, 3, z h 1 h 1 q 1 '% θ 1 θ θ h 0 for h 0, h 1 θ j θ j h pθ 2 0 θ2 1 q pθ 0θ 1 θ 1 θ 2 qz pθ 0 θ 1 θ 1 θ 0 qz 1 p1 θ 2 q θz θz AR(p) process φplqy t ε t ùñ y t ψplqε t and in generating function form
31 1.11. AUTOCOVARIANCE GENERATING FUNCTION 41 φpzqypzq εpzq ùñ ypzq ψpzqεpzq, where, φpzqψpzq 1. Therefore, γpzq σ 2 ψpzqψpz 1 q σ 2 φpzqφpz 1 q For AR(1), y t φy t 1 ε t γpzq γ 0 σ 2 p1 φzqp1 φz 1 q p1 φz φ 2 z 2 qp1 φz 1 φ 2 z 2 qσ 2 rp1 φ 2 φ 4 q pφ φ 3 φ 5 qz sσ 2 σ2 1 φ 2, γ h φ h γ ARMA(p, q) process γpzq σ 2 θpzqθpz 1 q φpzqφpz 1 q
32 42 CHAPTER 1. BASICS
Ch. 14 Stationary ARMA Process
Ch. 14 Stationary ARMA Process A general linear stochastic model is described that suppose a time series to be generated by a linear aggregation of random shock. For practical representation it is desirable
More information1 Linear Difference Equations
ARMA Handout Jialin Yu 1 Linear Difference Equations First order systems Let {ε t } t=1 denote an input sequence and {y t} t=1 sequence generated by denote an output y t = φy t 1 + ε t t = 1, 2,... with
More informationDiscrete time processes
Discrete time processes Predictions are difficult. Especially about the future Mark Twain. Florian Herzog 2013 Modeling observed data When we model observed (realized) data, we encounter usually the following
More informationChapter 4: Models for Stationary Time Series
Chapter 4: Models for Stationary Time Series Now we will introduce some useful parametric models for time series that are stationary processes. We begin by defining the General Linear Process. Let {Y t
More informationCovariance Stationary Time Series. Example: Independent White Noise (IWN(0,σ 2 )) Y t = ε t, ε t iid N(0,σ 2 )
Covariance Stationary Time Series Stochastic Process: sequence of rv s ordered by time {Y t } {...,Y 1,Y 0,Y 1,...} Defn: {Y t } is covariance stationary if E[Y t ]μ for all t cov(y t,y t j )E[(Y t μ)(y
More informationClass 1: Stationary Time Series Analysis
Class 1: Stationary Time Series Analysis Macroeconometrics - Fall 2009 Jacek Suda, BdF and PSE February 28, 2011 Outline Outline: 1 Covariance-Stationary Processes 2 Wold Decomposition Theorem 3 ARMA Models
More informationIntroduction to Stochastic processes
Università di Pavia Introduction to Stochastic processes Eduardo Rossi Stochastic Process Stochastic Process: A stochastic process is an ordered sequence of random variables defined on a probability space
More informationLesson 9: Autoregressive-Moving Average (ARMA) models
Lesson 9: Autoregressive-Moving Average (ARMA) models Dipartimento di Ingegneria e Scienze dell Informazione e Matematica Università dell Aquila, umberto.triacca@ec.univaq.it Introduction We have seen
More informationForecasting with ARMA
Forecasting with ARMA Eduardo Rossi University of Pavia October 2013 Rossi Forecasting Financial Econometrics - 2013 1 / 32 Mean Squared Error Linear Projection Forecast of Y t+1 based on a set of variables
More information3. ARMA Modeling. Now: Important class of stationary processes
3. ARMA Modeling Now: Important class of stationary processes Definition 3.1: (ARMA(p, q) process) Let {ɛ t } t Z WN(0, σ 2 ) be a white noise process. The process {X t } t Z is called AutoRegressive-Moving-Average
More informationCh. 15 Forecasting. 1.1 Forecasts Based on Conditional Expectations
Ch 15 Forecasting Having considered in Chapter 14 some of the properties of ARMA models, we now show how they may be used to forecast future values of an observed time series For the present we proceed
More informationUniversità di Pavia. Forecasting. Eduardo Rossi
Università di Pavia Forecasting Eduardo Rossi Mean Squared Error Forecast of Y t+1 based on a set of variables observed at date t, X t : Yt+1 t. The loss function MSE(Y t+1 t ) = E[Y t+1 Y t+1 t ]2 The
More information7. MULTIVARATE STATIONARY PROCESSES
7. MULTIVARATE STATIONARY PROCESSES 1 1 Some Preliminary Definitions and Concepts Random Vector: A vector X = (X 1,..., X n ) whose components are scalar-valued random variables on the same probability
More informationTime Series 2. Robert Almgren. Sept. 21, 2009
Time Series 2 Robert Almgren Sept. 21, 2009 This week we will talk about linear time series models: AR, MA, ARMA, ARIMA, etc. First we will talk about theory and after we will talk about fitting the models
More informationCh 4. Models For Stationary Time Series. Time Series Analysis
This chapter discusses the basic concept of a broad class of stationary parametric time series models the autoregressive moving average (ARMA) models. Let {Y t } denote the observed time series, and {e
More informationIntroduction to ARMA and GARCH processes
Introduction to ARMA and GARCH processes Fulvio Corsi SNS Pisa 3 March 2010 Fulvio Corsi Introduction to ARMA () and GARCH processes SNS Pisa 3 March 2010 1 / 24 Stationarity Strict stationarity: (X 1,
More informationLecture 2: ARMA(p,q) models (part 2)
Lecture 2: ARMA(p,q) models (part 2) Florian Pelgrin University of Lausanne, École des HEC Department of mathematics (IMEA-Nice) Sept. 2011 - Jan. 2012 Florian Pelgrin (HEC) Univariate time series Sept.
More informationTime Series 3. Robert Almgren. Sept. 28, 2009
Time Series 3 Robert Almgren Sept. 28, 2009 Last time we discussed two main categories of linear models, and their combination. Here w t denotes a white noise: a stationary process with E w t ) = 0, E
More informationLECTURE 10 LINEAR PROCESSES II: SPECTRAL DENSITY, LAG OPERATOR, ARMA. In this lecture, we continue to discuss covariance stationary processes.
MAY, 0 LECTURE 0 LINEAR PROCESSES II: SPECTRAL DENSITY, LAG OPERATOR, ARMA In this lecture, we continue to discuss covariance stationary processes. Spectral density Gourieroux and Monfort 990), Ch. 5;
More informationEASTERN MEDITERRANEAN UNIVERSITY ECON 604, FALL 2007 DEPARTMENT OF ECONOMICS MEHMET BALCILAR ARIMA MODELS: IDENTIFICATION
ARIMA MODELS: IDENTIFICATION A. Autocorrelations and Partial Autocorrelations 1. Summary of What We Know So Far: a) Series y t is to be modeled by Box-Jenkins methods. The first step was to convert y t
More informationECON/FIN 250: Forecasting in Finance and Economics: Section 6: Standard Univariate Models
ECON/FIN 250: Forecasting in Finance and Economics: Section 6: Standard Univariate Models Patrick Herb Brandeis University Spring 2016 Patrick Herb (Brandeis University) Standard Univariate Models ECON/FIN
More informationECON 616: Lecture 1: Time Series Basics
ECON 616: Lecture 1: Time Series Basics ED HERBST August 30, 2017 References Overview: Chapters 1-3 from Hamilton (1994). Technical Details: Chapters 2-3 from Brockwell and Davis (1987). Intuition: Chapters
More informationApplied time-series analysis
Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna October 18, 2011 Outline Introduction and overview Econometric Time-Series Analysis In principle,
More informationCovariances of ARMA Processes
Statistics 910, #10 1 Overview Covariances of ARMA Processes 1. Review ARMA models: causality and invertibility 2. AR covariance functions 3. MA and ARMA covariance functions 4. Partial autocorrelation
More information5: MULTIVARATE STATIONARY PROCESSES
5: MULTIVARATE STATIONARY PROCESSES 1 1 Some Preliminary Definitions and Concepts Random Vector: A vector X = (X 1,..., X n ) whose components are scalarvalued random variables on the same probability
More informationSome Time-Series Models
Some Time-Series Models Outline 1. Stochastic processes and their properties 2. Stationary processes 3. Some properties of the autocorrelation function 4. Some useful models Purely random processes, random
More informationBasic concepts and terminology: AR, MA and ARMA processes
ECON 5101 ADVANCED ECONOMETRICS TIME SERIES Lecture note no. 1 (EB) Erik Biørn, Department of Economics Version of February 1, 2011 Basic concepts and terminology: AR, MA and ARMA processes This lecture
More informationAutoregressive Moving Average (ARMA) Models and their Practical Applications
Autoregressive Moving Average (ARMA) Models and their Practical Applications Massimo Guidolin February 2018 1 Essential Concepts in Time Series Analysis 1.1 Time Series and Their Properties Time series:
More informationEconometría 2: Análisis de series de Tiempo
Econometría 2: Análisis de series de Tiempo Karoll GOMEZ kgomezp@unal.edu.co http://karollgomez.wordpress.com Segundo semestre 2016 II. Basic definitions A time series is a set of observations X t, each
More informationA time series is called strictly stationary if the joint distribution of every collection (Y t
5 Time series A time series is a set of observations recorded over time. You can think for example at the GDP of a country over the years (or quarters) or the hourly measurements of temperature over a
More informationSTAT 443 Final Exam Review. 1 Basic Definitions. 2 Statistical Tests. L A TEXer: W. Kong
STAT 443 Final Exam Review L A TEXer: W Kong 1 Basic Definitions Definition 11 The time series {X t } with E[X 2 t ] < is said to be weakly stationary if: 1 µ X (t) = E[X t ] is independent of t 2 γ X
More information3 Theory of stationary random processes
3 Theory of stationary random processes 3.1 Linear filters and the General linear process A filter is a transformation of one random sequence {U t } into another, {Y t }. A linear filter is a transformation
More informationPart III Example Sheet 1 - Solutions YC/Lent 2015 Comments and corrections should be ed to
TIME SERIES Part III Example Sheet 1 - Solutions YC/Lent 2015 Comments and corrections should be emailed to Y.Chen@statslab.cam.ac.uk. 1. Let {X t } be a weakly stationary process with mean zero and let
More informationEcon 623 Econometrics II Topic 2: Stationary Time Series
1 Introduction Econ 623 Econometrics II Topic 2: Stationary Time Series In the regression model we can model the error term as an autoregression AR(1) process. That is, we can use the past value of the
More informationLecture 2: Univariate Time Series
Lecture 2: Univariate Time Series Analysis: Conditional and Unconditional Densities, Stationarity, ARMA Processes Prof. Massimo Guidolin 20192 Financial Econometrics Spring/Winter 2017 Overview Motivation:
More informationEmpirical Market Microstructure Analysis (EMMA)
Empirical Market Microstructure Analysis (EMMA) Lecture 3: Statistical Building Blocks and Econometric Basics Prof. Dr. Michael Stein michael.stein@vwl.uni-freiburg.de Albert-Ludwigs-University of Freiburg
More informationEconometrics II Heij et al. Chapter 7.1
Chapter 7.1 p. 1/2 Econometrics II Heij et al. Chapter 7.1 Linear Time Series Models for Stationary data Marius Ooms Tinbergen Institute Amsterdam Chapter 7.1 p. 2/2 Program Introduction Modelling philosophy
More informationProf. Dr. Roland Füss Lecture Series in Applied Econometrics Summer Term Introduction to Time Series Analysis
Introduction to Time Series Analysis 1 Contents: I. Basics of Time Series Analysis... 4 I.1 Stationarity... 5 I.2 Autocorrelation Function... 9 I.3 Partial Autocorrelation Function (PACF)... 14 I.4 Transformation
More informationTIME SERIES AND FORECASTING. Luca Gambetti UAB, Barcelona GSE Master in Macroeconomic Policy and Financial Markets
TIME SERIES AND FORECASTING Luca Gambetti UAB, Barcelona GSE 2014-2015 Master in Macroeconomic Policy and Financial Markets 1 Contacts Prof.: Luca Gambetti Office: B3-1130 Edifici B Office hours: email:
More information{ } Stochastic processes. Models for time series. Specification of a process. Specification of a process. , X t3. ,...X tn }
Stochastic processes Time series are an example of a stochastic or random process Models for time series A stochastic process is 'a statistical phenomenon that evolves in time according to probabilistic
More informationIdentifiability, Invertibility
Identifiability, Invertibility Defn: If {ǫ t } is a white noise series and µ and b 0,..., b p are constants then X t = µ + b 0 ǫ t + b ǫ t + + b p ǫ t p is a moving average of order p; write MA(p). Q:
More informationUnivariate Time Series Analysis; ARIMA Models
Econometrics 2 Fall 24 Univariate Time Series Analysis; ARIMA Models Heino Bohn Nielsen of4 Outline of the Lecture () Introduction to univariate time series analysis. (2) Stationarity. (3) Characterizing
More informationat least 50 and preferably 100 observations should be available to build a proper model
III Box-Jenkins Methods 1. Pros and Cons of ARIMA Forecasting a) need for data at least 50 and preferably 100 observations should be available to build a proper model used most frequently for hourly or
More informationLECTURES 2-3 : Stochastic Processes, Autocorrelation function. Stationarity.
LECTURES 2-3 : Stochastic Processes, Autocorrelation function. Stationarity. Important points of Lecture 1: A time series {X t } is a series of observations taken sequentially over time: x t is an observation
More informationTime Series Models and Inference. James L. Powell Department of Economics University of California, Berkeley
Time Series Models and Inference James L. Powell Department of Economics University of California, Berkeley Overview In contrast to the classical linear regression model, in which the components of the
More informationγ 0 = Var(X i ) = Var(φ 1 X i 1 +W i ) = φ 2 1γ 0 +σ 2, which implies that we must have φ 1 < 1, and γ 0 = σ2 . 1 φ 2 1 We may also calculate for j 1
4.2 Autoregressive (AR) Moving average models are causal linear processes by definition. There is another class of models, based on a recursive formulation similar to the exponentially weighted moving
More information1. Stochastic Processes and Stationarity
Massachusetts Institute of Technology Department of Economics Time Series 14.384 Guido Kuersteiner Lecture Note 1 - Introduction This course provides the basic tools needed to analyze data that is observed
More informationChapter 3 - Temporal processes
STK4150 - Intro 1 Chapter 3 - Temporal processes Odd Kolbjørnsen and Geir Storvik January 23 2017 STK4150 - Intro 2 Temporal processes Data collected over time Past, present, future, change Temporal aspect
More informationAutoregressive and Moving-Average Models
Chapter 3 Autoregressive and Moving-Average Models 3.1 Introduction Let y be a random variable. We consider the elements of an observed time series {y 0,y 1,y2,...,y t } as being realizations of this randoms
More informationARMA (and ARIMA) models are often expressed in backshift notation.
Backshift Notation ARMA (and ARIMA) models are often expressed in backshift notation. B is the backshift operator (also called the lag operator ). It operates on time series, and means back up by one time
More informationStationary Stochastic Time Series Models
Stationary Stochastic Time Series Models When modeling time series it is useful to regard an observed time series, (x 1,x,..., x n ), as the realisation of a stochastic process. In general a stochastic
More informationTrend-Cycle Decompositions
Trend-Cycle Decompositions Eric Zivot April 22, 2005 1 Introduction A convenient way of representing an economic time series y t is through the so-called trend-cycle decomposition y t = TD t + Z t (1)
More informationNonlinear time series
Based on the book by Fan/Yao: Nonlinear Time Series Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna October 27, 2009 Outline Characteristics of
More informationLINEAR STOCHASTIC MODELS
LINEAR STOCHASTIC MODELS Let {x τ+1,x τ+2,...,x τ+n } denote n consecutive elements from a stochastic process. If their joint distribution does not depend on τ, regardless of the size of n, then the process
More informationMidterm Suggested Solutions
CUHK Dept. of Economics Spring 2011 ECON 4120 Sung Y. Park Midterm Suggested Solutions Q1 (a) In time series, autocorrelation measures the correlation between y t and its lag y t τ. It is defined as. ρ(τ)
More informationStat 248 Lab 2: Stationarity, More EDA, Basic TS Models
Stat 248 Lab 2: Stationarity, More EDA, Basic TS Models Tessa L. Childers-Day February 8, 2013 1 Introduction Today s section will deal with topics such as: the mean function, the auto- and cross-covariance
More informationLecture 1: Fundamental concepts in Time Series Analysis (part 2)
Lecture 1: Fundamental concepts in Time Series Analysis (part 2) Florian Pelgrin University of Lausanne, École des HEC Department of mathematics (IMEA-Nice) Sept. 2011 - Jan. 2012 Florian Pelgrin (HEC)
More informationSingle Equation Linear GMM with Serially Correlated Moment Conditions
Single Equation Linear GMM with Serially Correlated Moment Conditions Eric Zivot October 28, 2009 Univariate Time Series Let {y t } be an ergodic-stationary time series with E[y t ]=μ and var(y t )
More informationTime Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY
Time Series Analysis James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY & Contents PREFACE xiii 1 1.1. 1.2. Difference Equations First-Order Difference Equations 1 /?th-order Difference
More information1 Class Organization. 2 Introduction
Time Series Analysis, Lecture 1, 2018 1 1 Class Organization Course Description Prerequisite Homework and Grading Readings and Lecture Notes Course Website: http://www.nanlifinance.org/teaching.html wechat
More informationStochastic Processes: I. consider bowl of worms model for oscilloscope experiment:
Stochastic Processes: I consider bowl of worms model for oscilloscope experiment: SAPAscope 2.0 / 0 1 RESET SAPA2e 22, 23 II 1 stochastic process is: Stochastic Processes: II informally: bowl + drawing
More informationSTAT STOCHASTIC PROCESSES. Contents
STAT 3911 - STOCHASTIC PROCESSES ANDREW TULLOCH Contents 1. Stochastic Processes 2 2. Classification of states 2 3. Limit theorems for Markov chains 4 4. First step analysis 5 5. Branching processes 5
More informationReview Session: Econometrics - CLEFIN (20192)
Review Session: Econometrics - CLEFIN (20192) Part II: Univariate time series analysis Daniele Bianchi March 20, 2013 Fundamentals Stationarity A time series is a sequence of random variables x t, t =
More informationStatistics of stochastic processes
Introduction Statistics of stochastic processes Generally statistics is performed on observations y 1,..., y n assumed to be realizations of independent random variables Y 1,..., Y n. 14 settembre 2014
More informationLecture 3: Autoregressive Moving Average (ARMA) Models and their Practical Applications
Lecture 3: Autoregressive Moving Average (ARMA) Models and their Practical Applications Prof. Massimo Guidolin 20192 Financial Econometrics Winter/Spring 2018 Overview Moving average processes Autoregressive
More informationPermanent Income Hypothesis (PIH) Instructor: Dmytro Hryshko
Permanent Income Hypothesis (PIH) Instructor: Dmytro Hryshko 1 / 36 The PIH Utility function is quadratic, u(c t ) = 1 2 (c t c) 2 ; borrowing/saving is allowed using only the risk-free bond; β(1 + r)
More informationTime Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY
Time Series Analysis James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY PREFACE xiii 1 Difference Equations 1.1. First-Order Difference Equations 1 1.2. pth-order Difference Equations 7
More informationEC402: Serial Correlation. Danny Quah Economics Department, LSE Lent 2015
EC402: Serial Correlation Danny Quah Economics Department, LSE Lent 2015 OUTLINE 1. Stationarity 1.1 Covariance stationarity 1.2 Explicit Models. Special cases: ARMA processes 2. Some complex numbers.
More informationSTA 6857 Autocorrelation and Cross-Correlation & Stationary Time Series ( 1.4, 1.5)
STA 6857 Autocorrelation and Cross-Correlation & Stationary Time Series ( 1.4, 1.5) Outline 1 Announcements 2 Autocorrelation and Cross-Correlation 3 Stationary Time Series 4 Homework 1c Arthur Berg STA
More informationLecture 1: Stationary Time Series Analysis
Syllabus Stationarity ARMA AR MA Model Selection Estimation Lecture 1: Stationary Time Series Analysis 222061-1617: Time Series Econometrics Spring 2018 Jacek Suda Syllabus Stationarity ARMA AR MA Model
More informationFE570 Financial Markets and Trading. Stevens Institute of Technology
FE570 Financial Markets and Trading Lecture 5. Linear Time Series Analysis and Its Applications (Ref. Joel Hasbrouck - Empirical Market Microstructure ) Steve Yang Stevens Institute of Technology 9/25/2012
More informationWeek 5 Quantitative Analysis of Financial Markets Characterizing Cycles
Week 5 Quantitative Analysis of Financial Markets Characterizing Cycles Christopher Ting http://www.mysmu.edu/faculty/christophert/ Christopher Ting : christopherting@smu.edu.sg : 6828 0364 : LKCSB 5036
More informationCalculation of ACVF for ARMA Process: I consider causal ARMA(p, q) defined by
Calculation of ACVF for ARMA Process: I consider causal ARMA(p, q) defined by φ(b)x t = θ(b)z t, {Z t } WN(0, σ 2 ) want to determine ACVF {γ(h)} for this process, which can be done using four complementary
More informationUniversity of Oxford. Statistical Methods Autocorrelation. Identification and Estimation
University of Oxford Statistical Methods Autocorrelation Identification and Estimation Dr. Órlaith Burke Michaelmas Term, 2011 Department of Statistics, 1 South Parks Road, Oxford OX1 3TG Contents 1 Model
More informationLecture on ARMA model
Lecture on ARMA model Robert M. de Jong Ohio State University Columbus, OH 43210 USA Chien-Ho Wang National Taipei University Taipei City, 104 Taiwan ROC October 19, 2006 (Very Preliminary edition, Comment
More information11. Further Issues in Using OLS with TS Data
11. Further Issues in Using OLS with TS Data With TS, including lags of the dependent variable often allow us to fit much better the variation in y Exact distribution theory is rarely available in TS applications,
More informationStochastic processes: basic notions
Stochastic processes: basic notions Jean-Marie Dufour McGill University First version: March 2002 Revised: September 2002, April 2004, September 2004, January 2005, July 2011, May 2016, July 2016 This
More informationStochastic Processes. A stochastic process is a function of two variables:
Stochastic Processes Stochastic: from Greek stochastikos, proceeding by guesswork, literally, skillful in aiming. A stochastic process is simply a collection of random variables labelled by some parameter:
More informationTime Series Analysis -- An Introduction -- AMS 586
Time Series Analysis -- An Introduction -- AMS 586 1 Objectives of time series analysis Data description Data interpretation Modeling Control Prediction & Forecasting 2 Time-Series Data Numerical data
More informationARMA Estimation Recipes
Econ. 1B D. McFadden, Fall 000 1. Preliminaries ARMA Estimation Recipes hese notes summarize procedures for estimating the lag coefficients in the stationary ARMA(p,q) model (1) y t = µ +a 1 (y t-1 -µ)
More informationModule 3. Descriptive Time Series Statistics and Introduction to Time Series Models
Module 3 Descriptive Time Series Statistics and Introduction to Time Series Models Class notes for Statistics 451: Applied Time Series Iowa State University Copyright 2015 W Q Meeker November 11, 2015
More informationEconometrics of financial markets, -solutions to seminar 1. Problem 1
Econometrics of financial markets, -solutions to seminar 1. Problem 1 a) Estimate with OLS. For any regression y i α + βx i + u i for OLS to be unbiased we need cov (u i,x j )0 i, j. For the autoregressive
More informationESSE Mid-Term Test 2017 Tuesday 17 October :30-09:45
ESSE 4020 3.0 - Mid-Term Test 207 Tuesday 7 October 207. 08:30-09:45 Symbols have their usual meanings. All questions are worth 0 marks, although some are more difficult than others. Answer as many questions
More informationECONOMETRICS Part II PhD LBS
ECONOMETRICS Part II PhD LBS Luca Gambetti UAB, Barcelona GSE February-March 2014 1 Contacts Prof.: Luca Gambetti email: luca.gambetti@uab.es webpage: http://pareto.uab.es/lgambetti/ Description This is
More informationCh. 19 Models of Nonstationary Time Series
Ch. 19 Models of Nonstationary Time Series In time series analysis we do not confine ourselves to the analysis of stationary time series. In fact, most of the time series we encounter are non stationary.
More informationClassic Time Series Analysis
Classic Time Series Analysis Concepts and Definitions Let Y be a random number with PDF f Y t ~f,t Define t =E[Y t ] m(t) is known as the trend Define the autocovariance t, s =COV [Y t,y s ] =E[ Y t t
More informationTime Series Analysis
Time Series Analysis Christopher Ting http://mysmu.edu.sg/faculty/christophert/ christopherting@smu.edu.sg Quantitative Finance Singapore Management University March 3, 2017 Christopher Ting Week 9 March
More informationSTAD57 Time Series Analysis. Lecture 8
STAD57 Time Series Analysis Lecture 8 1 ARMA Model Will be using ARMA models to describe times series dynamics: ( B) X ( B) W X X X W W W t 1 t1 p t p t 1 t1 q tq Model must be causal (i.e. stationary)
More informationLecture 1: Stationary Time Series Analysis
Syllabus Stationarity ARMA AR MA Model Selection Estimation Forecasting Lecture 1: Stationary Time Series Analysis 222061-1617: Time Series Econometrics Spring 2018 Jacek Suda Syllabus Stationarity ARMA
More informationEcon 424 Time Series Concepts
Econ 424 Time Series Concepts Eric Zivot January 20 2015 Time Series Processes Stochastic (Random) Process { 1 2 +1 } = { } = sequence of random variables indexed by time Observed time series of length
More informationLesson 2: Analysis of time series
Lesson 2: Analysis of time series Time series Main aims of time series analysis choosing right model statistical testing forecast driving and optimalisation Problems in analysis of time series time problems
More informationProblem Set 1 Solution Sketches Time Series Analysis Spring 2010
Problem Set 1 Solution Sketches Time Series Analysis Spring 2010 1. Construct a martingale difference process that is not weakly stationary. Simplest e.g.: Let Y t be a sequence of independent, non-identically
More informationGaussian processes. Basic Properties VAG002-
Gaussian processes The class of Gaussian processes is one of the most widely used families of stochastic processes for modeling dependent data observed over time, or space, or time and space. The popularity
More informationTime Series Examples Sheet
Lent Term 2001 Richard Weber Time Series Examples Sheet This is the examples sheet for the M. Phil. course in Time Series. A copy can be found at: http://www.statslab.cam.ac.uk/~rrw1/timeseries/ Throughout,
More information6 NONSEASONAL BOX-JENKINS MODELS
6 NONSEASONAL BOX-JENKINS MODELS In this section, we will discuss a class of models for describing time series commonly referred to as Box-Jenkins models. There are two types of Box-Jenkins models, seasonal
More informationStatistical signal processing
Statistical signal processing Short overview of the fundamentals Outline Random variables Random processes Stationarity Ergodicity Spectral analysis Random variable and processes Intuition: A random variable
More informationDifference equations. Definitions: A difference equation takes the general form. x t f x t 1,,x t m.
Difference equations Definitions: A difference equation takes the general form x t fx t 1,x t 2, defining the current value of a variable x as a function of previously generated values. A finite order
More informationModule 4. Stationary Time Series Models Part 1 MA Models and Their Properties
Module 4 Stationary Time Series Models Part 1 MA Models and Their Properties Class notes for Statistics 451: Applied Time Series Iowa State University Copyright 2015 W. Q. Meeker. February 14, 2016 20h
More informationWe use the centered realization z t z in the computation. Also used in computing sample autocovariances and autocorrelations.
Stationary Time Series Models Part 1 MA Models and Their Properties Class notes for Statistics 41: Applied Time Series Ioa State University Copyright 1 W. Q. Meeker. Segment 1 ARMA Notation, Conventions,
More information1. Fundamental concepts
. Fundamental concepts A time series is a sequence of data points, measured typically at successive times spaced at uniform intervals. Time series are used in such fields as statistics, signal processing
More information