ARMA Models: I VIII 1
|
|
- Ella Gregory
- 5 years ago
- Views:
Transcription
1 ARMA Models: I autoregressive moving-average (ARMA) processes play a key role in time series analysis for any positive integer p & any purely nondeterministic process {X t } with ACVF { X (h)}, there is an AR(p) process {Y t } with ACVF { Y (h)} such that Y (h) = X (h) for h apple p corresponding statement does not hold for MA(q) processes (cf. AR(1) and MA(1) processes), but adding MA component to form ARMA processes increases flexibility of models with small number of parameters will now extend notions introduced for ARMA(1,1) model to higher order ARMA models VIII 1
2 ARMA Models: II {X t } is said to be an ARMA(p, q) process if it is stationary and if, for t 2 Z, X 1X t 1 px t p = Z t + 1 Z t q Z t q, where {Z t } WN(0, 2 ), and the polynomials 1 1z pz p and z + + q z q have no common roots (factors) in above z is a complex-valued variable note: ARMA model sometimes written in 3 other ways: X 1X t 1 px t p = Z t 1 Z t 1 q Z t q X + 1 X t p X t p = Z t + 1 Z t q Z t q X + 1 X t p X t p = Z t 1 Z t 1 q Z t q BD 83, CC 77, SS 92 VIII 2
3 ARMA Models: III polynomial condition is sometimes stated in terms of 1 1z 1 pz p and z q z q having no common roots (as will be noted later, this formulation has one distinct advantage) to see why no common root is stipulated, recall ARMA(1,1) process X t = X t 1 + Z t + Z t 1, for which + 6= 0 was stipulated reason for this condition became clear when we considered causal stationary solution 1X X t = Z t + ( + ) j=1 j 1 Z t j and noted {X t } becomes simpler WN model when + = 0 BD 83, CC 78, SS 93 VIII 3
4 ARMA Models: IV ARMA(1,1) polynomial condition says 1 not have a common root z & 1 + z should 1 z = 0 & 1 + z = 0 yield roots of 1/ & 1/, and 1/ 6= 1/ is equivalent to + 6= 0 can write ARMA(p, q) model more compactly as (B)X t = (B)Z t, with (z) = 1 1z pz p & (z) = 1+ 1 z + + q z q (as before, B is the backward shift operator) needed conditions < 1 and < 1 on ARMA(1,1) parameters for process to be stationary, causal and invertible similarly, need conditions on j s and k s for ARMA(p,q) process to be such these can be stated as conditions on polynomials (z) and (z) BD 84, CC 78, 80, SS 94, 95 VIII 4
5 ARMA Models: V 1. there is a (unique) stationary solution to (B)X t = (B)Z t if and only if (z) 6= 0 for all z = 1 2. ARMA(p, q) process is causal, meaning that, for t 2 Z, 1X 1X 1X X t = jz t j = (B)Z t with (B) = jb j & j < 1, j=0 if (z) 6= 0 for all z apple 1 3. ARMA(p, q) process is invertible, meaning that, for t 2 Z, 1X 1X 1X Z t = j X t j = (B)X t with (B) = j B j & j < 1, j=0 if (z) 6= 0 for all z apple 1 j=0 j=0 j=0 j=0 BD 84, 85, 86, CC 78, 80, SS 94, 95 VIII 5
6 ARMA Models: VI conditions can be restated in terms of roots of (z) and (z), i.e., values z l and z m such that (z l ) = 0 and (z m ) = 0 1. stationarity: requires all roots z l of (z) be o the so-called unit circle; i.e., must have z l 6= 1 2. causality: requires all roots z l of (z) to be outside the unit circle; i.e., must have z l > 1 3. invertibility: requires all roots z m of (z) to be outside the unit circle; i.e., must have z m > 1 for complex variable z = x + iy, where i p 1, unit circle defined to be set of all z s such that z 2 = x 2 + y 2 = 1 unit circle handily described by e i! cos (!) + i sin (!) with 0 apple! < 2 (note that e i! 2 = cos 2 (!) + sin 2 (!) = 1) BD 84, 85, 86, CC 78, 80, SS 94, 95 VIII 6
7 y Unit Circle, Some Roots z and Their Reciprocals 1/z * * x VIII 7
8 causality condition on (B), namely, 1 1 (B) = X j=0 ARMA Models: VII jb j = (z) implies existence of inverse of filter (B), where 1X j < 1 j=0 likewise, invertibility condition on (z) implies existence of inverse of filter (B), namely, 1 1 (B) = X 1X j B j = (B), where j < 1 j=0 j=0 BD 85, 86, CC 78, 80, SS 94, 95 VIII 8
9 ARMA Models: VIII 1. definition of ARMA process says (B)X t = (B)Z t 2. causality of ARMA process says X t = (B)Z t 3. multiplication of above by (B) says (B)X t = (B) (B)Z t comparison of 3 & 1 says (B) (B) = (B) and hence (1 1B pb p )( B + ) = B + + q B q ( ) expanding out left-hand side (LHS) of ( ) yields B + 2 B B B 1 1 B B B B B 3 BD 85, CC 79, SS 101 VIII 9
10 now take ARMA Models: IX B + 2 B B B 1 1 B B B B B 3 collect together coe cients for B, B 2, B 3,... to get 0 + ( )B + ( )B 2 + ( )B 3 + and equate with B + 2 B B 3 + (RHS of ( )): 1 = 0 1 = = = BD 85, CC 79, SS 101 VIII 10
11 ARMA Models: X rewrite as 1 = 0 1 = = = = 1 1 = = = BD 85, CC 79, SS 101 VIII 11
12 stare at ARMA Models: XI 0 = 1 1 = = = to see recursive scheme for computing j s: px j = k j k + j, j = 0, 1, 2,..., k=1 for which we need to define 0 = 1, j = 0 for j > q and j = 0 for j < 0 (also P p k=1 k j k taken to be 0 if p = 0) BD 85, CC 79, SS 101 VIII 12
13 ARMA Models: XII now start with 1. definition of ARMA process: (B)Z t = (B)X t 2. invertibility of ARMA process: Z t = (B)X t 3. multiplication of above by (B): (B)Z t = (B) (B)X t comparison of 3 & 1 says (B) (B) = (B) and hence (1 + 1 B + + q B q )( B + ) = 1 1B pb p same argument as before leads to scheme for computing j s: qx j = k j k j, j = 0, 1, 2,..., k=1 for which we need to define 0 = 1, j = 0 for j > p and j = 0 for j < 0 (also P q k=1 k j k taken to be 0 if q = 0) BD 85, CC 79, SS 101 VIII 13
14 Example ARMA(1,1) Process: I note: already considered in overheads VII 20 to VII 27 process takes the form X t 1 X t 1 = Z t + 1 Z t 1 here (z) = 1 1z and (z) = z roots of (z) = 0 and (z) = 0 are 1/ 1 and 1/ 1 stationary, causal & invertible if 1/ 1 > 1 & 1/ 1 > 1, i.e., 1 < 1 and 1 < 1 (easily checked!) have already noted 0 = 1 and j = ( ) j 1 1 for j 1 also have 0 = 1 and j = ( )( 1 ) j 1 for j 1 next overheads show (1) plot of roots and their reciprocals and (2) one realization for specific ARMA(1,1) model X t 0.5X t 1 = Z t + 0.4Z t 1, {Z t } Gaussian WN(0, 1) BD 86, 87, CC 77, 78, SS 95, 96 VIII 14
15 y Root Plot ( / = AR/MA; red/blue = root/root 1 ) * * x VIII 15
16 Realization of ARMA(1,1) Process x t t VIII 16
17 Example B&D s AR(2) Process: I AR(2) process takes form X t 1 X t 1 2 X t 2 = Z t invertibility trivially true: Z t = X t 1 X t 1 2 X t 2 here (z) = 1 1z 2z 2 (note that j = j) need to find roots z 1 and z 2 to see if {X t } is stationary & causal B&D consider X t = 0.7X t 1 0.1X t 1 + Z t, for which (z) = 1 0.7z + 0.1z 2 = (1 0.5z)(1 0.2z) roots are thus z 1 = 2 and z 2 = 5 both z 1 and z 2 are outside the unit circle process is thus stationary & causal next overheads show plots of roots and one realization, for which {Z t } Gaussian WN(0, 1) BD 87 VIII 17
18 y Root Plot (red/blue = root/root 1 ) x VIII 18
19 Realization of B&D s AR(2) Process x t t VIII 19
20 Example B&D s AR(2) Process: II for AR(2) processes, recursive scheme for computing j s, namely, 2X j = k j k + j, j = 0, 1, 2,..., k=1 leads to 0 = 1, 1 = 1 & ( ) j = 1 j j 2, j 2 theory of homogeneous linear di erence equations says that, if roots z 1 and z 2 are distinct, have j = 1 z j z j 2, j 2 since ( ) says 2 = and 3 = , can solve for l s using 2 = 1 z z2 2 and 3 = 1 z z2 3 for B&D AR(2) process, get j = j j, j 2 BD 87 VIII 20
21 j s for B&D s AR(2) Process j j VIII 21
22 Example Second AR(2) Process: I now consider X t = 0.75X t 1 0.5X t 1 + Z t, for which (z) = z+0.5z 2 z p A i 3 4 roots z 1 and z 2 are 3 p 4 ± 23 4 i (complex conjugates) here z 1 = z 2 = p 2, so roots are outside the unit circle process is thus stationary & causal p 23 4 i can reexpress roots as p 2e ±i!, where! = radians (58.0 ) realizations will tend to fluctuate roughly with period 2.! = 6.2 next overheads show plots of roots and one realization, for which {Z t } Gaussian WN(0, 1) 1 A VIII 22
23 y Root Plot (red/blue = root/root 1 ) x VIII 23
24 Realization of Second AR(2) Process x t t VIII 24
25 Example Second AR(2) Process: II as before, 0 & 1 = 1, while j s for j 2 satisfy j = z j 1 + z j 2 = e i' z 1 j e i!j + e i' z 1 = 2 cos (!j ')/ z 1 j j e i!j (note: is complex conjugate of complex variable e i' ) letting x + iy, can also write j = 2[x cos (!j) + y sin (!j)]/ z 1 j as before, can get 2 and 3 from recursive scheme, yielding two equations to solve to get x and y (and hence and '): 2 = 2[x cos (2!)+y sin (2!)]/ z 1 2 & 3 = 2[x cos (3!)+y sin (3!)]/ z 1 3 here get x = 0.5, y. = 0.313, = 0.59 & '. = VIII 25
26 j s for Second AR(2) Process j j VIII 26
27 Example AR(4) Process now consider AR(4) process X t = X t X t X t X t 4 +Z t, where {Z t } Gaussian WN(0, 1) thus (z) = z z z z 4 polyroot function in R calculates roots as ± 0.786i and ± 0.650i, with corresponding magnitudes and thus {X t } is stationary and causal getting closed form expression for j s is tedious, so opt to just compute them using recursive scheme VIII 27
28 y Root Plot (red/blue = root/root 1 ) x VIII 28
29 Realization of AR(4) Process x t t VIII 29
30 j s for AR(4) Process j j VIII 30
31 Aside Harmonic Processes: I reconsider stationary process of Problem 3(b): X t = Z 1 cos (!t) + Z 2 sin (!t), where Z 1 and Z 2 are independent N (0, 1) RVs above is an example of a harmonic process realizations of harmonic processes are qualitatively very di erent from those for ARMA processes (see next overhead) homework exercise: given X 1 and X 2, can write X t = 2 cos (!)X t 1 X t 2, t 2 Z above resembles AR(2) process Y t = 1 Y t Y t 2 + Z t if we set 1 = 2 cos (!), 2 = 1 and Z t = 0 (can achieve by stipulating {Z t } WN(0, 0)) VIII 31
32 Three Realizations of Harmonic Process (! = /12) x t t VIII 32
33 Aside Harmonic Processes: II since X t = 2 cos (!)X t 1 X t 2, can perfectly predict X t given X t 1 & X t 2 (example of deterministic stationary process) taking {X t } to be AR(2) process, have (z) = 1 1z 2z 2 = 1 2 cos (!)z + z 2, which has roots e ±i! since (e i! ) = 1 2 cos (!)e i! + e i2! = 1 (e i! + e i! )e i! + e i2! = 0, where we have made use of 2 cos (!) = e i! + e i! since e ±i! 2 = cos 2 (!) + sin 2 (!) = 1, roots are on unit circle reconsider example! = /12, which has period 2! = 24 VIII 33
34 y Root Plot for Harmonic Process * * x VIII 34
Calculation of ACVF for ARMA Process: I consider causal ARMA(p, q) defined by
Calculation of ACVF for ARMA Process: I consider causal ARMA(p, q) defined by φ(b)x t = θ(b)z t, {Z t } WN(0, σ 2 ) want to determine ACVF {γ(h)} for this process, which can be done using four complementary
More informationLevinson Durbin Recursions: I
Levinson Durbin Recursions: I note: B&D and S&S say Durbin Levinson but Levinson Durbin is more commonly used (Levinson, 1947, and Durbin, 1960, are source articles sometimes just Levinson is used) recursions
More informationLevinson Durbin Recursions: I
Levinson Durbin Recursions: I note: B&D and S&S say Durbin Levinson but Levinson Durbin is more commonly used (Levinson, 1947, and Durbin, 1960, are source articles sometimes just Levinson is used) recursions
More informationClassical Decomposition Model Revisited: I
Classical Decomposition Model Revisited: I recall classical decomposition model for time series Y t, namely, Y t = m t + s t + W t, where m t is trend; s t is periodic with known period s (i.e., s t s
More informationLesson 9: Autoregressive-Moving Average (ARMA) models
Lesson 9: Autoregressive-Moving Average (ARMA) models Dipartimento di Ingegneria e Scienze dell Informazione e Matematica Università dell Aquila, umberto.triacca@ec.univaq.it Introduction We have seen
More informationStochastic Processes: I. consider bowl of worms model for oscilloscope experiment:
Stochastic Processes: I consider bowl of worms model for oscilloscope experiment: SAPAscope 2.0 / 0 1 RESET SAPA2e 22, 23 II 1 stochastic process is: Stochastic Processes: II informally: bowl + drawing
More informationCovariances of ARMA Processes
Statistics 910, #10 1 Overview Covariances of ARMA Processes 1. Review ARMA models: causality and invertibility 2. AR covariance functions 3. MA and ARMA covariance functions 4. Partial autocorrelation
More informationγ 0 = Var(X i ) = Var(φ 1 X i 1 +W i ) = φ 2 1γ 0 +σ 2, which implies that we must have φ 1 < 1, and γ 0 = σ2 . 1 φ 2 1 We may also calculate for j 1
4.2 Autoregressive (AR) Moving average models are causal linear processes by definition. There is another class of models, based on a recursive formulation similar to the exponentially weighted moving
More information3 ARIMA Models. 3.1 Introduction
3 ARIMA Models 3. Introduction In Chapters and, we introduced autocorrelation and cross-correlation functions (ACFs and CCFs) as tools for clarifying relations that may occur within and between time series
More informationMoving Average (MA) representations
Moving Average (MA) representations The moving average representation of order M has the following form v[k] = MX c n e[k n]+e[k] (16) n=1 whose transfer function operator form is MX v[k] =H(q 1 )e[k],
More informationTime Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY
Time Series Analysis James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY & Contents PREFACE xiii 1 1.1. 1.2. Difference Equations First-Order Difference Equations 1 /?th-order Difference
More informationSome Time-Series Models
Some Time-Series Models Outline 1. Stochastic processes and their properties 2. Stationary processes 3. Some properties of the autocorrelation function 4. Some useful models Purely random processes, random
More informationTime Series Models and Inference. James L. Powell Department of Economics University of California, Berkeley
Time Series Models and Inference James L. Powell Department of Economics University of California, Berkeley Overview In contrast to the classical linear regression model, in which the components of the
More informationSF2943: TIME SERIES ANALYSIS COMMENTS ON SPECTRAL DENSITIES
SF2943: TIME SERIES ANALYSIS COMMENTS ON SPECTRAL DENSITIES This document is meant as a complement to Chapter 4 in the textbook, the aim being to get a basic understanding of spectral densities through
More information3. ARMA Modeling. Now: Important class of stationary processes
3. ARMA Modeling Now: Important class of stationary processes Definition 3.1: (ARMA(p, q) process) Let {ɛ t } t Z WN(0, σ 2 ) be a white noise process. The process {X t } t Z is called AutoRegressive-Moving-Average
More informationChapter 3. ARIMA Models. 3.1 Autoregressive Moving Average Models
Chapter 3 ARIMA Models Classical regression is often insu cient for explaining all of the interesting dynamics of a time series. For example, the ACF of the residuals of the simple linear regression fit
More informationPart III Example Sheet 1 - Solutions YC/Lent 2015 Comments and corrections should be ed to
TIME SERIES Part III Example Sheet 1 - Solutions YC/Lent 2015 Comments and corrections should be emailed to Y.Chen@statslab.cam.ac.uk. 1. Let {X t } be a weakly stationary process with mean zero and let
More information1 Class Organization. 2 Introduction
Time Series Analysis, Lecture 1, 2018 1 1 Class Organization Course Description Prerequisite Homework and Grading Readings and Lecture Notes Course Website: http://www.nanlifinance.org/teaching.html wechat
More informationSTAT 443 Final Exam Review. 1 Basic Definitions. 2 Statistical Tests. L A TEXer: W. Kong
STAT 443 Final Exam Review L A TEXer: W Kong 1 Basic Definitions Definition 11 The time series {X t } with E[X 2 t ] < is said to be weakly stationary if: 1 µ X (t) = E[X t ] is independent of t 2 γ X
More information3 Theory of stationary random processes
3 Theory of stationary random processes 3.1 Linear filters and the General linear process A filter is a transformation of one random sequence {U t } into another, {Y t }. A linear filter is a transformation
More informationIdentifiability, Invertibility
Identifiability, Invertibility Defn: If {ǫ t } is a white noise series and µ and b 0,..., b p are constants then X t = µ + b 0 ǫ t + b ǫ t + + b p ǫ t p is a moving average of order p; write MA(p). Q:
More informationDifference equations. Definitions: A difference equation takes the general form. x t f x t 1,,x t m.
Difference equations Definitions: A difference equation takes the general form x t fx t 1,x t 2, defining the current value of a variable x as a function of previously generated values. A finite order
More informationEC402: Serial Correlation. Danny Quah Economics Department, LSE Lent 2015
EC402: Serial Correlation Danny Quah Economics Department, LSE Lent 2015 OUTLINE 1. Stationarity 1.1 Covariance stationarity 1.2 Explicit Models. Special cases: ARMA processes 2. Some complex numbers.
More information1 Linear Difference Equations
ARMA Handout Jialin Yu 1 Linear Difference Equations First order systems Let {ε t } t=1 denote an input sequence and {y t} t=1 sequence generated by denote an output y t = φy t 1 + ε t t = 1, 2,... with
More informationTime Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY
Time Series Analysis James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY PREFACE xiii 1 Difference Equations 1.1. First-Order Difference Equations 1 1.2. pth-order Difference Equations 7
More informationTime Series Analysis -- An Introduction -- AMS 586
Time Series Analysis -- An Introduction -- AMS 586 1 Objectives of time series analysis Data description Data interpretation Modeling Control Prediction & Forecasting 2 Time-Series Data Numerical data
More informationChapter 4: Models for Stationary Time Series
Chapter 4: Models for Stationary Time Series Now we will introduce some useful parametric models for time series that are stationary processes. We begin by defining the General Linear Process. Let {Y t
More informationCOMPLEX NUMBERS AND QUADRATIC EQUATIONS
Chapter 5 COMPLEX NUMBERS AND QUADRATIC EQUATIONS 5. Overview We know that the square of a real number is always non-negative e.g. (4) 6 and ( 4) 6. Therefore, square root of 6 is ± 4. What about the square
More informationBasic concepts and terminology: AR, MA and ARMA processes
ECON 5101 ADVANCED ECONOMETRICS TIME SERIES Lecture note no. 1 (EB) Erik Biørn, Department of Economics Version of February 1, 2011 Basic concepts and terminology: AR, MA and ARMA processes This lecture
More informationParametric Signal Modeling and Linear Prediction Theory 1. Discrete-time Stochastic Processes (cont d)
Parametric Signal Modeling and Linear Prediction Theory 1. Discrete-time Stochastic Processes (cont d) Electrical & Computer Engineering North Carolina State University Acknowledgment: ECE792-41 slides
More informationCh. 14 Stationary ARMA Process
Ch. 14 Stationary ARMA Process A general linear stochastic model is described that suppose a time series to be generated by a linear aggregation of random shock. For practical representation it is desirable
More informationARMA (and ARIMA) models are often expressed in backshift notation.
Backshift Notation ARMA (and ARIMA) models are often expressed in backshift notation. B is the backshift operator (also called the lag operator ). It operates on time series, and means back up by one time
More informationAkaike criterion: Kullback-Leibler discrepancy
Model choice. Akaike s criterion Akaike criterion: Kullback-Leibler discrepancy Given a family of probability densities {f ( ; ), 2 }, Kullback-Leibler s index of f ( ; ) relativetof ( ; ) is Z ( ) =E
More informationApplied Time. Series Analysis. Wayne A. Woodward. Henry L. Gray. Alan C. Elliott. Dallas, Texas, USA
Applied Time Series Analysis Wayne A. Woodward Southern Methodist University Dallas, Texas, USA Henry L. Gray Southern Methodist University Dallas, Texas, USA Alan C. Elliott University of Texas Southwestern
More informationNonparametric and Parametric Defined This text distinguishes between systems and the sequences (processes) that result when a WN input is applied
Linear Signal Models Overview Introduction Linear nonparametric vs. parametric models Equivalent representations Spectral flatness measure PZ vs. ARMA models Wold decomposition Introduction Many researchers
More informationDynamic models. Dependent data The AR(p) model The MA(q) model Hidden Markov models. 6 Dynamic models
6 Dependent data The AR(p) model The MA(q) model Hidden Markov models Dependent data Dependent data Huge portion of real-life data involving dependent datapoints Example (Capture-recapture) capture histories
More informationCh 4. Models For Stationary Time Series. Time Series Analysis
This chapter discusses the basic concept of a broad class of stationary parametric time series models the autoregressive moving average (ARMA) models. Let {Y t } denote the observed time series, and {e
More informationTime Series 3. Robert Almgren. Sept. 28, 2009
Time Series 3 Robert Almgren Sept. 28, 2009 Last time we discussed two main categories of linear models, and their combination. Here w t denotes a white noise: a stationary process with E w t ) = 0, E
More information11. Further Issues in Using OLS with TS Data
11. Further Issues in Using OLS with TS Data With TS, including lags of the dependent variable often allow us to fit much better the variation in y Exact distribution theory is rarely available in TS applications,
More informationDifferencing Revisited: I ARIMA(p,d,q) processes predicated on notion of dth order differencing of a time series {X t }: for d = 1 and 2, have X t
Differencing Revisited: I ARIMA(p,d,q) processes predicated on notion of dth order differencing of a time series {X t }: for d = 1 and 2, have X t 2 X t def in general = (1 B)X t = X t X t 1 def = ( X
More informationARIMA Models. Richard G. Pierse
ARIMA Models Richard G. Pierse 1 Introduction Time Series Analysis looks at the properties of time series from a purely statistical point of view. No attempt is made to relate variables using a priori
More informationFINITE DIFFERENCES. Lecture 1: (a) Operators (b) Forward Differences and their calculations. (c) Backward Differences and their calculations.
FINITE DIFFERENCES Lecture 1: (a) Operators (b) Forward Differences and their calculations. (c) Backward Differences and their calculations. 1. Introduction When a function is known explicitly, it is easy
More information7. MULTIVARATE STATIONARY PROCESSES
7. MULTIVARATE STATIONARY PROCESSES 1 1 Some Preliminary Definitions and Concepts Random Vector: A vector X = (X 1,..., X n ) whose components are scalar-valued random variables on the same probability
More information1. Definition of a Polynomial
1. Definition of a Polynomial What is a polynomial? A polynomial P(x) is an algebraic expression of the form Degree P(x) = a n x n + a n 1 x n 1 + a n 2 x n 2 + + a 3 x 3 + a 2 x 2 + a 1 x + a 0 Leading
More informationTime Series: Theory and Methods
Peter J. Brockwell Richard A. Davis Time Series: Theory and Methods Second Edition With 124 Illustrations Springer Contents Preface to the Second Edition Preface to the First Edition vn ix CHAPTER 1 Stationary
More informationNonlinear time series
Based on the book by Fan/Yao: Nonlinear Time Series Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna October 27, 2009 Outline Characteristics of
More informationLecture 3: Autoregressive Moving Average (ARMA) Models and their Practical Applications
Lecture 3: Autoregressive Moving Average (ARMA) Models and their Practical Applications Prof. Massimo Guidolin 20192 Financial Econometrics Winter/Spring 2018 Overview Moving average processes Autoregressive
More information2.5 The Fundamental Theorem of Algebra.
2.5. THE FUNDAMENTAL THEOREM OF ALGEBRA. 79 2.5 The Fundamental Theorem of Algebra. We ve seen formulas for the (complex) roots of quadratic, cubic and quartic polynomials. It is then reasonable to ask:
More informationNotes on Time Series Modeling
Notes on Time Series Modeling Garey Ramey University of California, San Diego January 17 1 Stationary processes De nition A stochastic process is any set of random variables y t indexed by t T : fy t g
More informationLECTURE 10 LINEAR PROCESSES II: SPECTRAL DENSITY, LAG OPERATOR, ARMA. In this lecture, we continue to discuss covariance stationary processes.
MAY, 0 LECTURE 0 LINEAR PROCESSES II: SPECTRAL DENSITY, LAG OPERATOR, ARMA In this lecture, we continue to discuss covariance stationary processes. Spectral density Gourieroux and Monfort 990), Ch. 5;
More informationDiscrete time processes
Discrete time processes Predictions are difficult. Especially about the future Mark Twain. Florian Herzog 2013 Modeling observed data When we model observed (realized) data, we encounter usually the following
More informationEconometría 2: Análisis de series de Tiempo
Econometría 2: Análisis de series de Tiempo Karoll GOMEZ kgomezp@unal.edu.co http://karollgomez.wordpress.com Segundo semestre 2016 III. Stationary models 1 Purely random process 2 Random walk (non-stationary)
More informationFE570 Financial Markets and Trading. Stevens Institute of Technology
FE570 Financial Markets and Trading Lecture 5. Linear Time Series Analysis and Its Applications (Ref. Joel Hasbrouck - Empirical Market Microstructure ) Steve Yang Stevens Institute of Technology 9/25/2012
More informationLecture 1: Fundamental concepts in Time Series Analysis (part 2)
Lecture 1: Fundamental concepts in Time Series Analysis (part 2) Florian Pelgrin University of Lausanne, École des HEC Department of mathematics (IMEA-Nice) Sept. 2011 - Jan. 2012 Florian Pelgrin (HEC)
More informationChapter 5: Models for Nonstationary Time Series
Chapter 5: Models for Nonstationary Time Series Recall that any time series that is a stationary process has a constant mean function. So a process that has a mean function that varies over time must be
More informationWe use the centered realization z t z in the computation. Also used in computing sample autocovariances and autocorrelations.
Stationary Time Series Models Part 1 MA Models and Their Properties Class notes for Statistics 41: Applied Time Series Ioa State University Copyright 1 W. Q. Meeker. Segment 1 ARMA Notation, Conventions,
More informationCOMPLEX NUMBERS
COMPLEX NUMBERS 1. Any number of the form x+iy where x, y R and i -1 is called a Complex Number.. In the complex number x+iy, x is called the real part and y is called the imaginary part of the complex
More informationSTAT 720 sp 2019 Lec 06 Karl Gregory 2/15/2019
STAT 720 sp 2019 Lec 06 Karl Gregory 2/15/2019 This lecture will make use of the tscourse package, which is installed with the following R code: library(devtools) devtools::install_github("gregorkb/tscourse")
More informationor i 2 = -1 i 4 = 1 Example : ( i ),, 7 i and 0 are complex numbers. and Imaginary part of z = b or img z = b
1 A- LEVEL MATHEMATICS P 3 Complex Numbers (NOTES) 1. Given a quadratic equation : x 2 + 1 = 0 or ( x 2 = -1 ) has no solution in the set of real numbers, as there does not exist any real number whose
More informationECON 616: Lecture 1: Time Series Basics
ECON 616: Lecture 1: Time Series Basics ED HERBST August 30, 2017 References Overview: Chapters 1-3 from Hamilton (1994). Technical Details: Chapters 2-3 from Brockwell and Davis (1987). Intuition: Chapters
More information2 Complex Functions and the Cauchy-Riemann Equations
2 Complex Functions and the Cauchy-Riemann Equations 2.1 Complex functions In one-variable calculus, we study functions f(x) of a real variable x. Likewise, in complex analysis, we study functions f(z)
More informationProblem Set 1 Solution Sketches Time Series Analysis Spring 2010
Problem Set 1 Solution Sketches Time Series Analysis Spring 2010 1. Construct a martingale difference process that is not weakly stationary. Simplest e.g.: Let Y t be a sequence of independent, non-identically
More informationTime Series 4. Robert Almgren. Oct. 5, 2009
Time Series 4 Robert Almgren Oct. 5, 2009 1 Nonstationarity How should you model a process that has drift? ARMA models are intrinsically stationary, that is, they are mean-reverting: when the value of
More informationUnivariate Time Series Analysis; ARIMA Models
Econometrics 2 Fall 24 Univariate Time Series Analysis; ARIMA Models Heino Bohn Nielsen of4 Outline of the Lecture () Introduction to univariate time series analysis. (2) Stationarity. (3) Characterizing
More informationFFTs in Graphics and Vision. Homogenous Polynomials and Irreducible Representations
FFTs in Graphics and Vision Homogenous Polynomials and Irreducible Representations 1 Outline The 2π Term in Assignment 1 Homogenous Polynomials Representations of Functions on the Unit-Circle Sub-Representations
More informationLINEAR STOCHASTIC MODELS
LINEAR STOCHASTIC MODELS Let {x τ+1,x τ+2,...,x τ+n } denote n consecutive elements from a stochastic process. If their joint distribution does not depend on τ, regardless of the size of n, then the process
More informationA time series is called strictly stationary if the joint distribution of every collection (Y t
5 Time series A time series is a set of observations recorded over time. You can think for example at the GDP of a country over the years (or quarters) or the hourly measurements of temperature over a
More informationModule 4. Stationary Time Series Models Part 1 MA Models and Their Properties
Module 4 Stationary Time Series Models Part 1 MA Models and Their Properties Class notes for Statistics 451: Applied Time Series Iowa State University Copyright 2015 W. Q. Meeker. February 14, 2016 20h
More informationAutoregressive Moving Average (ARMA) Models and their Practical Applications
Autoregressive Moving Average (ARMA) Models and their Practical Applications Massimo Guidolin February 2018 1 Essential Concepts in Time Series Analysis 1.1 Time Series and Their Properties Time series:
More informationEstimating trends using filters
Estimating trends using filters... contd. 3. Exponential smoothing of data to estimate the trend m[k] ˆm[k] = v[k]+(1 )ˆm[k 1], k =2,, n ˆm[1] = v[1] The choice of has to be fine tuned according to the
More informationITSM-R Reference Manual
ITSM-R Reference Manual George Weigt February 11, 2018 1 Contents 1 Introduction 3 1.1 Time series analysis in a nutshell............................... 3 1.2 White Noise Variance.....................................
More informationESSE Mid-Term Test 2017 Tuesday 17 October :30-09:45
ESSE 4020 3.0 - Mid-Term Test 207 Tuesday 7 October 207. 08:30-09:45 Symbols have their usual meanings. All questions are worth 0 marks, although some are more difficult than others. Answer as many questions
More informationIntroduction to Time Series Analysis. Lecture 7.
Last lecture: Introduction to Time Series Analysis. Lecture 7. Peter Bartlett 1. ARMA(p,q) models: stationarity, causality, invertibility 2. The linear process representation of ARMA processes: ψ. 3. Autocovariance
More informationARMA models with time-varying coefficients. Periodic case.
ARMA models with time-varying coefficients. Periodic case. Agnieszka Wy lomańska Hugo Steinhaus Center Wroc law University of Technology ARMA models with time-varying coefficients. Periodic case. 1 Some
More informationCHAPTER 2 RANDOM PROCESSES IN DISCRETE TIME
CHAPTER 2 RANDOM PROCESSES IN DISCRETE TIME Shri Mata Vaishno Devi University, (SMVDU), 2013 Page 13 CHAPTER 2 RANDOM PROCESSES IN DISCRETE TIME When characterizing or modeling a random variable, estimates
More information{ } Stochastic processes. Models for time series. Specification of a process. Specification of a process. , X t3. ,...X tn }
Stochastic processes Time series are an example of a stochastic or random process Models for time series A stochastic process is 'a statistical phenomenon that evolves in time according to probabilistic
More informationChapter 3 - Temporal processes
STK4150 - Intro 1 Chapter 3 - Temporal processes Odd Kolbjørnsen and Geir Storvik January 23 2017 STK4150 - Intro 2 Temporal processes Data collected over time Past, present, future, change Temporal aspect
More informationA SARIMAX coupled modelling applied to individual load curves intraday forecasting
A SARIMAX coupled modelling applied to individual load curves intraday forecasting Frédéric Proïa Workshop EDF Institut Henri Poincaré - Paris 05 avril 2012 INRIA Bordeaux Sud-Ouest Institut de Mathématiques
More informationMarcel Dettling. Applied Time Series Analysis SS 2013 Week 05. ETH Zürich, March 18, Institute for Data Analysis and Process Design
Marcel Dettling Institute for Data Analysis and Process Design Zurich University of Applied Sciences marcel.dettling@zhaw.ch http://stat.ethz.ch/~dettling ETH Zürich, March 18, 2013 1 Basics of Modeling
More informationStatistics of stochastic processes
Introduction Statistics of stochastic processes Generally statistics is performed on observations y 1,..., y n assumed to be realizations of independent random variables Y 1,..., Y n. 14 settembre 2014
More informationStochastic Processes. Monday, November 14, 11
Stochastic Processes 1 Definition and Classification X(, t): stochastic process: X : T! R (, t) X(, t) where is a sample space and T is time. {X(, t) is a family of r.v. defined on {, A, P and indexed
More informationAutoregressive and Moving-Average Models
Chapter 3 Autoregressive and Moving-Average Models 3.1 Introduction Let y be a random variable. We consider the elements of an observed time series {y 0,y 1,y2,...,y t } as being realizations of this randoms
More information3 + 4i 2 + 3i. 3 4i Fig 1b
The introduction of complex numbers in the 16th century was a natural step in a sequence of extensions of the positive integers, starting with the introduction of negative numbers (to solve equations of
More informationStructural Macroeconometrics. Chapter 4. Summarizing Time Series Behavior
Structural Macroeconometrics Chapter 4. Summarizing Time Series Behavior David N. DeJong Chetan Dave The sign of a truly educated man is to be deeply moved by statistics. George Bernard Shaw This chapter
More information5: MULTIVARATE STATIONARY PROCESSES
5: MULTIVARATE STATIONARY PROCESSES 1 1 Some Preliminary Definitions and Concepts Random Vector: A vector X = (X 1,..., X n ) whose components are scalarvalued random variables on the same probability
More informationStochastic processes: basic notions
Stochastic processes: basic notions Jean-Marie Dufour McGill University First version: March 2002 Revised: September 2002, April 2004, September 2004, January 2005, July 2011, May 2016, July 2016 This
More informationEmpirical Market Microstructure Analysis (EMMA)
Empirical Market Microstructure Analysis (EMMA) Lecture 3: Statistical Building Blocks and Econometric Basics Prof. Dr. Michael Stein michael.stein@vwl.uni-freiburg.de Albert-Ludwigs-University of Freiburg
More informationTIME SERIES ANALYSIS. Forecasting and Control. Wiley. Fifth Edition GWILYM M. JENKINS GEORGE E. P. BOX GREGORY C. REINSEL GRETA M.
TIME SERIES ANALYSIS Forecasting and Control Fifth Edition GEORGE E. P. BOX GWILYM M. JENKINS GREGORY C. REINSEL GRETA M. LJUNG Wiley CONTENTS PREFACE TO THE FIFTH EDITION PREFACE TO THE FOURTH EDITION
More informationQuantitative Finance I
Quantitative Finance I Linear AR and MA Models (Lecture 4) Winter Semester 01/013 by Lukas Vacha * If viewed in.pdf format - for full functionality use Mathematica 7 (or higher) notebook (.nb) version
More information= k xt-k+ j. If k is large and <1, then the first part of this expression is negligible, hence. t j
Let x be a zero-mean stochastic process. A roghly linear relationship between sccessive observations may be described by a simple atoregressive model of the form = + where is zero-mean white noise. A stationary
More informationE 4101/5101 Lecture 6: Spectral analysis
E 4101/5101 Lecture 6: Spectral analysis Ragnar Nymoen 3 March 2011 References to this lecture Hamilton Ch 6 Lecture note (on web page) For stationary variables/processes there is a close correspondence
More informationARMA Estimation Recipes
Econ. 1B D. McFadden, Fall 000 1. Preliminaries ARMA Estimation Recipes hese notes summarize procedures for estimating the lag coefficients in the stationary ARMA(p,q) model (1) y t = µ +a 1 (y t-1 -µ)
More informationChapter 1. Basics. 1.1 Definition. A time series (or stochastic process) is a function Xpt, ωq such that for
Chapter 1 Basics 1.1 Definition A time series (or stochastic process) is a function Xpt, ωq such that for each fixed t, Xpt, ωq is a random variable [denoted by X t pωq]. For a fixed ω, Xpt, ωq is simply
More informationClass 1: Stationary Time Series Analysis
Class 1: Stationary Time Series Analysis Macroeconometrics - Fall 2009 Jacek Suda, BdF and PSE February 28, 2011 Outline Outline: 1 Covariance-Stationary Processes 2 Wold Decomposition Theorem 3 ARMA Models
More informationCH5350: Applied Time-Series Analysis
CH5350: Applied Time-Series Analysis Arun K. Tangirala Department of Chemical Engineering, IIT Madras Spectral Representations of Random Signals Arun K. Tangirala (IIT Madras) Applied Time-Series Analysis
More informationElements of Multivariate Time Series Analysis
Gregory C. Reinsel Elements of Multivariate Time Series Analysis Second Edition With 14 Figures Springer Contents Preface to the Second Edition Preface to the First Edition vii ix 1. Vector Time Series
More informationLycée des arts Math Grade Algebraic expressions S.S.4
Lycée des arts Math Grade 9 015-016 lgebraic expressions S.S.4 Exercise I: Factorize each of the following algebraic expressions, and then determine its real roots. (x) = 4x (3x 1) (x + ) (3x 1) + 3x 1
More informationLecture 2: Univariate Time Series
Lecture 2: Univariate Time Series Analysis: Conditional and Unconditional Densities, Stationarity, ARMA Processes Prof. Massimo Guidolin 20192 Financial Econometrics Spring/Winter 2017 Overview Motivation:
More informationm We can similarly replace any pair of complex conjugate eigenvalues with 2 2 real blocks. = R
1 RODICA D. COSTIN Suppose that some eigenvalues are not real. Then the matrices S and are not real either, and the diagonalization of M must be done in C n. Suppose that we want to work in R n only. Recall
More informationCovariance Stationary Time Series. Example: Independent White Noise (IWN(0,σ 2 )) Y t = ε t, ε t iid N(0,σ 2 )
Covariance Stationary Time Series Stochastic Process: sequence of rv s ordered by time {Y t } {...,Y 1,Y 0,Y 1,...} Defn: {Y t } is covariance stationary if E[Y t ]μ for all t cov(y t,y t j )E[(Y t μ)(y
More information