Nonlinear time series
|
|
- Donald Thornton
- 6 years ago
- Views:
Transcription
1 Based on the book by Fan/Yao: Nonlinear Time Series Robert M. Kunst University of Vienna and Institute for Advanced Studies Vienna October 27, 2009
2 Outline Characteristics of Time Series Threshold models ARCH and GARCH models Bilinear models
3 What is a nonlinear time series? Formal definition: a nonlinear process is any stochastic process that is not linear. To this aim, a linear process must be defined. Realizations of time-series processes are called time series but the word is also often applied to the generating processes. Intuitive definition: nonlinear time series are generated by nonlinear dynamic equations. They display features that cannot be modelled by linear processes: time-changing variance, asymmetric cycles, higher-moment structures, thresholds and breaks.
4 Definition of a linear process Definition A stochastic process (X t, t Z) is said to be a linear process if for every t Z X t = a j ε t j, where a 0 = 1, (ε t, t Z) is iid with Eε t = 0, Eε 2 t <, and j=0 a j <. j=0
5 For comparison: the Wold theorem Theorem (Wold s Theorem) Any covariance-stationary process (X t ) has a unique representation as the sum of a purely deterministic component and an infinite sum of white-noise terms, in symbols X t = δ t + a j ε t j, with a 0 = 1, j=0 a2 j <, and the terms ε t defined as the linear innovations X t E (X t H t 1 ), where E denotes the linear expectation or projection on the space H t 1 that is generated by the observations X s, s t 1. j=0
6 Linear processes and the Wold representation There are many covariance-stationary processes that are not linear: either the innovations are not independent (though white noise) or the absolute coefficients do not converge. If it is just the absolute coefficients, the processes are long memory. Those are not really nonlinear, and we will not handle them here. Many nonlinear processes have a Wold representation that looks linear. It is correct but it just describes the autocovariance structure. It is an incomplete representation. If Eε 2 t < is violated, (X t ) becomes an infinite-variance linear process, conditions on coefficient series must be adjusted. Outside the scope here.
7 A simple example: an AR-ARCH model The dynamic generating law X t = 0.9X t 1 + u t, (1) u t = ht 0.5 ε t, (2) h t = ut 1, 2 ε t NID(0, 1), (3) defines a stable AR-ARCH process. It is an AR(1) model with Wold innovations u t, which are white noise but not independent.
8 A time series plot of 1000 observations Impression: not too nonlinear, but outlier patches point to fat-tailed distributions: variable has no finite kurtosis.
9 Correlograms Lag Lag Impression: AR-ARCH on the left inconspicuous, fairly identical to a standard AR(1) correlogram on the right.
10 Plots versus lags y x y( 1) x( 1) Impression: a bit more dispersed than the standard AR(1) plot on the right: leptokurtosis. Basically linear (as should be).
11 Plots of squares versus lagged squares y² x² y²( 1) x²( 1) Impression: even this device, suggested by Andrew A. Weiss allows no reliable discrimination to the standard AR case on the right.
12 I. Characteristics of Time Series The meaning of this section: This section corresponds to Section 2 of the book by Fan & Yao and is meant to review the basic concepts of (mostly linear) time-series analysis.
13 Stationarity Definition A time series (X t, t Z) is (weakly, covariance) stationary if (a) EX 2 t <, (b) EX t = µ t, and (c) cov(x t, X t+k ) is independent of t k. Remark. For k = 0, this definition yields time-constant finite variance. Definition A time series (X t, t Z) is strictly stationary if (X 1,...,X n ) and (X 1+k,...,X n+k ) have the same distribution for any n 1 and n, k Z. Remark. For nonlinear time series, often strict stationarity is the more natural concept.
14 ARMA processes The ARMA(p, q) model with p, q N X t = b 1 X t b p X t p + ε t + a 1 ε t a q ε t q, for (ε t ) white noise, is technically rewritten as b(b)x t = a(b)ε t, with polynomials a(z) and b(z) and the backshift operator B defined by B k X t = X t k. This is the most popular linear time-series model. Often, the expression ARMA process is reserved for stable polynomials.
15 Stationarity of ARMA processes Theorem The process defined by the ARMA(p, q) model is stationary if b(z) 0 for all z C with z 1, assuming that a(z) and b(z) have no common factors. Remark. Note that t Z. If t N, the ARMA process can be started from arbitrary conditions, and the usual distinction of stable and stationary applies. Clearly, here a pure MA process (p = 0) is always stationary.
16 Causal time series Definition A time series (X t ) is causal if for all t X t = with white noise (ε t ). d j ε t j, d j <, j=0 j=0 Remark. A causal process is always stationary. X t = 2X t 1 + ε t violates the ARMA stability conditions and nonetheless has a stationary non-causal solution. These are at odds with intuition and will be excluded.
17 Stationary Gaussian processes A process (X t ) is called Gaussian if all its finite-dimensional marginal distributions are normal. For Gaussian processes, the Wold representation holds with iid innovations. The purely nondeterministic part of a Gaussian process is linear. A Gaussian MA(q) process is q dependent, i.e. X t and X t+q+k are independent for all k 1. For a Gaussian AR process, X t is independent of X t k, k > p given X t 1,...,X t p.
18 Autocovariance and autocorrelation Definition Let (X t ) be stationary. The autocovariance function (ACVF) of (X t ) is γ(k) = cov(x t+k, X t ), k Z. The autocorrelation function (ACF) of (X t ) is ρ(k) = γ(k)/γ(0) = corr(x t+k, X t ), k Z. It follows that γ( k) = γ(k) and ρ( k) = ρ(k) (even functions).
19 Characterization of the ACVF Theorem A function γ(.) : Z R is the ACVF of a stationary time series if and only if it is even and nonnegative definite in the sense that n i=1 j=1 n a i a j γ(i j) 0 for all integer n 1 and arbitrary real a 1,...,a n. Remark. One direction is easy to show, as it uses the properties of a covariance matrix of X t,...,x t n+1. The reverse direction is hard to prove and needs a Theorem by Kolmogorov.
20 ACF of stationary ARMA processes Any ARMA process has an MA( ) representation X t = a j ε t j, j=0 with j=0 a j <. It follows that γ(k) = σ 2 a j a j+k, ρ(k) = j=0 j=0 j=0 a ja j+k. j=0 a2 j Clearly, for pure MA(q) processes, these expressions become 0 for k > q.
21 Properties of the ACF for ARMA processes Proposition 1. For causal ARMA processes, ρ(k) 0 like c k for c < 1 as k (exponential); 2. for MA(q) processes, ρ(k) = 0 for k > q. This proposition does not warrant a clear distinction between AR and general ARMA processes.
22 Estimating the ACF The sample ACF (the correlogram) is defined by ˆρ(k) = ˆγ(k)/ˆγ(0), where ˆγ(k) = 1 T T k (X t X T )(X t+k X T ), t=1 for small k, for example k T/4 or k 2 T, with X T = T 1 T t=1 X t.
23 Statistical properties of the mean estimate Theorem Let (X t ) is a linear stationary process defined by X t = µ + j=0 a jε t j, with (ε t ) iid(0, σ 2 ) and j=0 a j <. If j=0 a j 0, T( X T µ) N(0, ν1 2 ), where ν 2 1 = j= γ(j) = σ 2 j=0 a j 2. Remark. The variance of the mean estimate depends on the spectrum at 0 and may be called the long-run variance.
24 The long-run variance A stationary time-series process X t = a j ε t j has the variance varx t = γ(0) = σε 2 aj 2, j=0 which usually differs from the long-run variance σε( 2 a j ) 2. The long-run variance may also be seen as the spectrum at 0, j= γ(j), or as the limit variance n lim n n 1 var X t. j=0 t=0 For white noise (X t ), variance and long-run variance coincide.
25 Statistical properties of the variance estimate Theorem Let (X t ) is a linear stationary process defined by X t = µ + j=0 a jε t j, with (ε t ) iid(0, σ 2 ) and j=0 a j <. If Eε 4 t <, T {ˆγ(0) γ(0)} N(0, ν2 2 ), where ν 2 2 = 2σ 2 (1 + 2 ρ(j) 2 ). j=1 Remark. This is reminiscent of the portmanteau Q.
26 Statistical properties of the correlogram Theorem Let (X t ) is a linear stationary process defined by X t = µ + j=0 a jε t j, with (ε t ) iid(0, σ 2 ) and j=0 a j <. If Eε 4 t <, T {ˆ (k) (k)} N(0,W), where w ij = {ρ(t + i)ρ(t + j) + ρ(t i)ρ(t + j) + 2ρ(i)ρ(j)ρ(t) 2 t= 2ρ(i)ρ(t)ρ(t + j) 2ρ(j)ρ(t)ρ(t + i)}, where (k) = (ρ(1),..., ρ(k)). Remark. This is Bartlett s formula, impressive but not immediately useful. In simple cases, it allows determining confidence bands for the correlogram. White noise yields T ˆρ k N(0, 1) for k 0.
27 Partial autocorrelation function Definition (X t ) is a stationary process with EX t = 0. The partial autocorrelation function (PACF) π : N [ 1, 1] is defined by π(1) = ρ(1) and π(k) = corr(r 1 2,...,k, R k+1 2,...,k ), for k 2, where R j 2,...,k denotes residuals from regressing X j on X 2,...,X k by least squares. Remark. For non-gaussian processes, the thus defined PACF does not necessarily correspond to partial correlations, if partial correlations are defined via conditional expectations.
28 Properties of the PACF Proposition 1. For any stationary process, π(k) is a function of the ACVF values γ(1),...,γ(k); 2. For an AR(p) process, π(k) = 0 for k > p, i.e. the PACF cuts off at p. Remark. Mathematically, the PACF does not provide any new information on top of the ACVF. The sample PACF facilitates visual pattern recognition and may indicate AR models and their lag order.
29 Mixing White noise is usually insufficient for ergodic theorems such as laws of large numbers (LLN) or central limit theorems (CLT). For linear processes with iid innovations, some moment conditions will suffice. For nonlinear processes, more is needed. Generally, mixing conditions guarantee that X t and X t+h are more or less independent for large h. The metaphor is mixing drinks: a drop of a liquid will not remain close to its origin. If we mix two separate glasses, the outcome will be stationary but not mixing.
30 Five mixing coefficients α(n) = β(n) = E ρ(n) = φ(n) = ψ(n) = sup A F 0,B F n { sup B F n P(A)P(B) P(AB), P(B) P(B X 0, X 1, X 2,...) sup corr(x, Y ), X L 2 (F 0 ),Y L2 (Fn ) sup A F 0,B F n,p(a)>0 P(B) P(B A), sup 1 P(B A)/P(B). A F 0,B F n,p(a)p(b)>0 Here, F l k is the σ algebra generated by X t,k t l, and L 2 are square integrable functions. Good mixing coefficients converge to 0 as n. },
31 Mixing processes Definition A process (X t ) is α mixing ( strong mixing ) if α(n) 0 as n, and similarly for β mixing etc. A basic property is α(k) 1 4 ρ(k) 1 2 φ(k), and generally φ mixing implies ρ mixing (and β mixing), and ρ mixing (or β mixing) implies α mixing. ψ mixing implies φ mixing and thus all others. Even for simple examples, the mixing coefficients cannot be evaluated directly.
32 Some properties of mixing processes 1. If (X t ) is mixing (any definition) and m(.) is a measurable function, then (m(x t )) is again mixing. The property is hereditary. 2. If (X t ) is a linear ARMA process and ε t has a density, it is β mixing with β(n) 0 exponentially. 3. A strictly stationary process on Z is mixing iff its restriction to N is mixing (any definition). 4. Finite-dependent (such as strict MA) or independent processes are mixing. 5. Deterministic processes are not mixing.
33 A LLN for α mixing processes Proposition Assume (X t ) is strictly stationary and α mixing, and E X t <. Then, as n, S n /n EX t a.s., where S n = n t=1 X t. A comparable LLN with slightly stronger conditions guarantees convergence of n 1 vars t to the long-run variance.
34 A CLT for α mixing processes Theorem Assume (X t ) is strictly stationary with EX t = 0, the long-run variance σ 2 is positive, and one of the following conditions hold 1. E X t δ < and j=0 α(j)1 2/δ < for some δ > 2; 2. P( X t < c) = 1 for some c > 0 and j=1 α(j) <. Then, S n / n N(0, σ 2 ), with S n = n t=1 X t. Remark. The theorem cares for processes with bounded support (case 2) as well as for some quite fat-tailed ones (case 1 for δ = 2 + ǫ), which however need fast decrease of their mixing coefficients.
35
36
37
Applied time-series analysis
Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna October 18, 2011 Outline Introduction and overview Econometric Time-Series Analysis In principle,
More informationSTAT 248: EDA & Stationarity Handout 3
STAT 248: EDA & Stationarity Handout 3 GSI: Gido van de Ven September 17th, 2010 1 Introduction Today s section we will deal with the following topics: the mean function, the auto- and crosscovariance
More informationIntroduction to ARMA and GARCH processes
Introduction to ARMA and GARCH processes Fulvio Corsi SNS Pisa 3 March 2010 Fulvio Corsi Introduction to ARMA () and GARCH processes SNS Pisa 3 March 2010 1 / 24 Stationarity Strict stationarity: (X 1,
More informationEconometría 2: Análisis de series de Tiempo
Econometría 2: Análisis de series de Tiempo Karoll GOMEZ kgomezp@unal.edu.co http://karollgomez.wordpress.com Segundo semestre 2016 II. Basic definitions A time series is a set of observations X t, each
More informationIntroduction to Stochastic processes
Università di Pavia Introduction to Stochastic processes Eduardo Rossi Stochastic Process Stochastic Process: A stochastic process is an ordered sequence of random variables defined on a probability space
More informationSome Time-Series Models
Some Time-Series Models Outline 1. Stochastic processes and their properties 2. Stationary processes 3. Some properties of the autocorrelation function 4. Some useful models Purely random processes, random
More informationTIME SERIES AND FORECASTING. Luca Gambetti UAB, Barcelona GSE Master in Macroeconomic Policy and Financial Markets
TIME SERIES AND FORECASTING Luca Gambetti UAB, Barcelona GSE 2014-2015 Master in Macroeconomic Policy and Financial Markets 1 Contacts Prof.: Luca Gambetti Office: B3-1130 Edifici B Office hours: email:
More informationLecture 3: Autoregressive Moving Average (ARMA) Models and their Practical Applications
Lecture 3: Autoregressive Moving Average (ARMA) Models and their Practical Applications Prof. Massimo Guidolin 20192 Financial Econometrics Winter/Spring 2018 Overview Moving average processes Autoregressive
More informationEconometric Forecasting
Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna October 1, 2014 Outline Introduction Model-free extrapolation Univariate time-series models Trend
More information3. ARMA Modeling. Now: Important class of stationary processes
3. ARMA Modeling Now: Important class of stationary processes Definition 3.1: (ARMA(p, q) process) Let {ɛ t } t Z WN(0, σ 2 ) be a white noise process. The process {X t } t Z is called AutoRegressive-Moving-Average
More informationDiscrete time processes
Discrete time processes Predictions are difficult. Especially about the future Mark Twain. Florian Herzog 2013 Modeling observed data When we model observed (realized) data, we encounter usually the following
More informationSTAT 443 Final Exam Review. 1 Basic Definitions. 2 Statistical Tests. L A TEXer: W. Kong
STAT 443 Final Exam Review L A TEXer: W Kong 1 Basic Definitions Definition 11 The time series {X t } with E[X 2 t ] < is said to be weakly stationary if: 1 µ X (t) = E[X t ] is independent of t 2 γ X
More informationLECTURES 2-3 : Stochastic Processes, Autocorrelation function. Stationarity.
LECTURES 2-3 : Stochastic Processes, Autocorrelation function. Stationarity. Important points of Lecture 1: A time series {X t } is a series of observations taken sequentially over time: x t is an observation
More informationStat 248 Lab 2: Stationarity, More EDA, Basic TS Models
Stat 248 Lab 2: Stationarity, More EDA, Basic TS Models Tessa L. Childers-Day February 8, 2013 1 Introduction Today s section will deal with topics such as: the mean function, the auto- and cross-covariance
More informationStochastic processes: basic notions
Stochastic processes: basic notions Jean-Marie Dufour McGill University First version: March 2002 Revised: September 2002, April 2004, September 2004, January 2005, July 2011, May 2016, July 2016 This
More informationStochastic Processes: I. consider bowl of worms model for oscilloscope experiment:
Stochastic Processes: I consider bowl of worms model for oscilloscope experiment: SAPAscope 2.0 / 0 1 RESET SAPA2e 22, 23 II 1 stochastic process is: Stochastic Processes: II informally: bowl + drawing
More informationTime Series Models and Inference. James L. Powell Department of Economics University of California, Berkeley
Time Series Models and Inference James L. Powell Department of Economics University of California, Berkeley Overview In contrast to the classical linear regression model, in which the components of the
More informationProblem Set 1 Solution Sketches Time Series Analysis Spring 2010
Problem Set 1 Solution Sketches Time Series Analysis Spring 2010 1. Construct a martingale difference process that is not weakly stationary. Simplest e.g.: Let Y t be a sequence of independent, non-identically
More informationEcon 424 Time Series Concepts
Econ 424 Time Series Concepts Eric Zivot January 20 2015 Time Series Processes Stochastic (Random) Process { 1 2 +1 } = { } = sequence of random variables indexed by time Observed time series of length
More informationProf. Dr. Roland Füss Lecture Series in Applied Econometrics Summer Term Introduction to Time Series Analysis
Introduction to Time Series Analysis 1 Contents: I. Basics of Time Series Analysis... 4 I.1 Stationarity... 5 I.2 Autocorrelation Function... 9 I.3 Partial Autocorrelation Function (PACF)... 14 I.4 Transformation
More informationSingle Equation Linear GMM with Serially Correlated Moment Conditions
Single Equation Linear GMM with Serially Correlated Moment Conditions Eric Zivot October 28, 2009 Univariate Time Series Let {y t } be an ergodic-stationary time series with E[y t ]=μ and var(y t )
More informationLesson 7: Estimation of Autocorrelation and Partial Autocorrela
Lesson 7: Estimation of Autocorrelation and Partial Autocorrelation Function Dipartimento di Ingegneria e Scienze dell Informazione e Matematica Università dell Aquila, umberto.triacca@ec.univaq.it Estimation
More informationSTAT STOCHASTIC PROCESSES. Contents
STAT 3911 - STOCHASTIC PROCESSES ANDREW TULLOCH Contents 1. Stochastic Processes 2 2. Classification of states 2 3. Limit theorems for Markov chains 4 4. First step analysis 5 5. Branching processes 5
More informationTime Series 3. Robert Almgren. Sept. 28, 2009
Time Series 3 Robert Almgren Sept. 28, 2009 Last time we discussed two main categories of linear models, and their combination. Here w t denotes a white noise: a stationary process with E w t ) = 0, E
More informationTime Series Analysis -- An Introduction -- AMS 586
Time Series Analysis -- An Introduction -- AMS 586 1 Objectives of time series analysis Data description Data interpretation Modeling Control Prediction & Forecasting 2 Time-Series Data Numerical data
More informationNext tool is Partial ACF; mathematical tools first. The Multivariate Normal Distribution. e z2 /2. f Z (z) = 1 2π. e z2 i /2
Next tool is Partial ACF; mathematical tools first. The Multivariate Normal Distribution Defn: Z R 1 N(0,1) iff f Z (z) = 1 2π e z2 /2 Defn: Z R p MV N p (0, I) if and only if Z = (Z 1,..., Z p ) (a column
More informationAutoregressive Moving Average (ARMA) Models and their Practical Applications
Autoregressive Moving Average (ARMA) Models and their Practical Applications Massimo Guidolin February 2018 1 Essential Concepts in Time Series Analysis 1.1 Time Series and Their Properties Time series:
More informationMAT 3379 (Winter 2016) FINAL EXAM (SOLUTIONS)
MAT 3379 (Winter 2016) FINAL EXAM (SOLUTIONS) 15 April 2016 (180 minutes) Professor: R. Kulik Student Number: Name: This is closed book exam. You are allowed to use one double-sided A4 sheet of notes.
More informationEconometría 2: Análisis de series de Tiempo
Econometría 2: Análisis de series de Tiempo Karoll GOMEZ kgomezp@unal.edu.co http://karollgomez.wordpress.com Segundo semestre 2016 III. Stationary models 1 Purely random process 2 Random walk (non-stationary)
More informationLecture 2: Univariate Time Series
Lecture 2: Univariate Time Series Analysis: Conditional and Unconditional Densities, Stationarity, ARMA Processes Prof. Massimo Guidolin 20192 Financial Econometrics Spring/Winter 2017 Overview Motivation:
More informationTime Series 2. Robert Almgren. Sept. 21, 2009
Time Series 2 Robert Almgren Sept. 21, 2009 This week we will talk about linear time series models: AR, MA, ARMA, ARIMA, etc. First we will talk about theory and after we will talk about fitting the models
More informationModule 3. Descriptive Time Series Statistics and Introduction to Time Series Models
Module 3 Descriptive Time Series Statistics and Introduction to Time Series Models Class notes for Statistics 451: Applied Time Series Iowa State University Copyright 2015 W Q Meeker November 11, 2015
More informationEconometrics I: Univariate Time Series Econometrics (1)
Econometrics I: Dipartimento di Economia Politica e Metodi Quantitativi University of Pavia Overview of the Lecture 1 st EViews Session VI: Some Theoretical Premises 2 Overview of the Lecture 1 st EViews
More informationClass 1: Stationary Time Series Analysis
Class 1: Stationary Time Series Analysis Macroeconometrics - Fall 2009 Jacek Suda, BdF and PSE February 28, 2011 Outline Outline: 1 Covariance-Stationary Processes 2 Wold Decomposition Theorem 3 ARMA Models
More informationLecture 1: Fundamental concepts in Time Series Analysis (part 2)
Lecture 1: Fundamental concepts in Time Series Analysis (part 2) Florian Pelgrin University of Lausanne, École des HEC Department of mathematics (IMEA-Nice) Sept. 2011 - Jan. 2012 Florian Pelgrin (HEC)
More informationCovariances of ARMA Processes
Statistics 910, #10 1 Overview Covariances of ARMA Processes 1. Review ARMA models: causality and invertibility 2. AR covariance functions 3. MA and ARMA covariance functions 4. Partial autocorrelation
More informationStationary Stochastic Time Series Models
Stationary Stochastic Time Series Models When modeling time series it is useful to regard an observed time series, (x 1,x,..., x n ), as the realisation of a stochastic process. In general a stochastic
More informationStochastic process for macro
Stochastic process for macro Tianxiao Zheng SAIF 1. Stochastic process The state of a system {X t } evolves probabilistically in time. The joint probability distribution is given by Pr(X t1, t 1 ; X t2,
More informationA SARIMAX coupled modelling applied to individual load curves intraday forecasting
A SARIMAX coupled modelling applied to individual load curves intraday forecasting Frédéric Proïa Workshop EDF Institut Henri Poincaré - Paris 05 avril 2012 INRIA Bordeaux Sud-Ouest Institut de Mathématiques
More informationFE570 Financial Markets and Trading. Stevens Institute of Technology
FE570 Financial Markets and Trading Lecture 5. Linear Time Series Analysis and Its Applications (Ref. Joel Hasbrouck - Empirical Market Microstructure ) Steve Yang Stevens Institute of Technology 9/25/2012
More informationChapter 4: Models for Stationary Time Series
Chapter 4: Models for Stationary Time Series Now we will introduce some useful parametric models for time series that are stationary processes. We begin by defining the General Linear Process. Let {Y t
More informationPart III Example Sheet 1 - Solutions YC/Lent 2015 Comments and corrections should be ed to
TIME SERIES Part III Example Sheet 1 - Solutions YC/Lent 2015 Comments and corrections should be emailed to Y.Chen@statslab.cam.ac.uk. 1. Let {X t } be a weakly stationary process with mean zero and let
More informationCh. 14 Stationary ARMA Process
Ch. 14 Stationary ARMA Process A general linear stochastic model is described that suppose a time series to be generated by a linear aggregation of random shock. For practical representation it is desirable
More informationECON 616: Lecture 1: Time Series Basics
ECON 616: Lecture 1: Time Series Basics ED HERBST August 30, 2017 References Overview: Chapters 1-3 from Hamilton (1994). Technical Details: Chapters 2-3 from Brockwell and Davis (1987). Intuition: Chapters
More informationPermanent Income Hypothesis (PIH) Instructor: Dmytro Hryshko
Permanent Income Hypothesis (PIH) Instructor: Dmytro Hryshko 1 / 36 The PIH Utility function is quadratic, u(c t ) = 1 2 (c t c) 2 ; borrowing/saving is allowed using only the risk-free bond; β(1 + r)
More informationThe autocorrelation and autocovariance functions - helpful tools in the modelling problem
The autocorrelation and autocovariance functions - helpful tools in the modelling problem J. Nowicka-Zagrajek A. Wy lomańska Institute of Mathematics and Computer Science Wroc law University of Technology,
More informationReview Session: Econometrics - CLEFIN (20192)
Review Session: Econometrics - CLEFIN (20192) Part II: Univariate time series analysis Daniele Bianchi March 20, 2013 Fundamentals Stationarity A time series is a sequence of random variables x t, t =
More informationat least 50 and preferably 100 observations should be available to build a proper model
III Box-Jenkins Methods 1. Pros and Cons of ARIMA Forecasting a) need for data at least 50 and preferably 100 observations should be available to build a proper model used most frequently for hourly or
More information5: MULTIVARATE STATIONARY PROCESSES
5: MULTIVARATE STATIONARY PROCESSES 1 1 Some Preliminary Definitions and Concepts Random Vector: A vector X = (X 1,..., X n ) whose components are scalarvalued random variables on the same probability
More informationEC402: Serial Correlation. Danny Quah Economics Department, LSE Lent 2015
EC402: Serial Correlation Danny Quah Economics Department, LSE Lent 2015 OUTLINE 1. Stationarity 1.1 Covariance stationarity 1.2 Explicit Models. Special cases: ARMA processes 2. Some complex numbers.
More informationAR, MA and ARMA models
AR, MA and AR by Hedibert Lopes P Based on Tsay s Analysis of Financial Time Series (3rd edition) P 1 Stationarity 2 3 4 5 6 7 P 8 9 10 11 Outline P Linear Time Series Analysis and Its Applications For
More informationMAT 3379 (Winter 2016) FINAL EXAM (PRACTICE)
MAT 3379 (Winter 2016) FINAL EXAM (PRACTICE) 15 April 2016 (180 minutes) Professor: R. Kulik Student Number: Name: This is closed book exam. You are allowed to use one double-sided A4 sheet of notes. Only
More informationTime Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY
Time Series Analysis James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY PREFACE xiii 1 Difference Equations 1.1. First-Order Difference Equations 1 1.2. pth-order Difference Equations 7
More information1 Class Organization. 2 Introduction
Time Series Analysis, Lecture 1, 2018 1 1 Class Organization Course Description Prerequisite Homework and Grading Readings and Lecture Notes Course Website: http://www.nanlifinance.org/teaching.html wechat
More information1. Fundamental concepts
. Fundamental concepts A time series is a sequence of data points, measured typically at successive times spaced at uniform intervals. Time series are used in such fields as statistics, signal processing
More informationCovariance Stationary Time Series. Example: Independent White Noise (IWN(0,σ 2 )) Y t = ε t, ε t iid N(0,σ 2 )
Covariance Stationary Time Series Stochastic Process: sequence of rv s ordered by time {Y t } {...,Y 1,Y 0,Y 1,...} Defn: {Y t } is covariance stationary if E[Y t ]μ for all t cov(y t,y t j )E[(Y t μ)(y
More informationEcon 623 Econometrics II Topic 2: Stationary Time Series
1 Introduction Econ 623 Econometrics II Topic 2: Stationary Time Series In the regression model we can model the error term as an autoregression AR(1) process. That is, we can use the past value of the
More informationTime Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY
Time Series Analysis James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY & Contents PREFACE xiii 1 1.1. 1.2. Difference Equations First-Order Difference Equations 1 /?th-order Difference
More informationSTAT Financial Time Series
STAT 6104 - Financial Time Series Chapter 2 - Probability Models Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 1 / 34 Agenda 1 Introduction 2 Stochastic Process Definition 1 Stochastic Definition
More informationMultivariate Time Series
Multivariate Time Series Notation: I do not use boldface (or anything else) to distinguish vectors from scalars. Tsay (and many other writers) do. I denote a multivariate stochastic process in the form
More informationBasic concepts and terminology: AR, MA and ARMA processes
ECON 5101 ADVANCED ECONOMETRICS TIME SERIES Lecture note no. 1 (EB) Erik Biørn, Department of Economics Version of February 1, 2011 Basic concepts and terminology: AR, MA and ARMA processes This lecture
More informationNonlinear Time Series Modeling
Nonlinear Time Series Modeling Part II: Time Series Models in Finance Richard A. Davis Colorado State University (http://www.stat.colostate.edu/~rdavis/lectures) MaPhySto Workshop Copenhagen September
More informationReview of Statistics
Review of Statistics Topics Descriptive Statistics Mean, Variance Probability Union event, joint event Random Variables Discrete and Continuous Distributions, Moments Two Random Variables Covariance and
More information6. The econometrics of Financial Markets: Empirical Analysis of Financial Time Series. MA6622, Ernesto Mordecki, CityU, HK, 2006.
6. The econometrics of Financial Markets: Empirical Analysis of Financial Time Series MA6622, Ernesto Mordecki, CityU, HK, 2006. References for Lecture 5: Quantitative Risk Management. A. McNeil, R. Frey,
More informationEmpirical Market Microstructure Analysis (EMMA)
Empirical Market Microstructure Analysis (EMMA) Lecture 3: Statistical Building Blocks and Econometric Basics Prof. Dr. Michael Stein michael.stein@vwl.uni-freiburg.de Albert-Ludwigs-University of Freiburg
More informationLesson 9: Autoregressive-Moving Average (ARMA) models
Lesson 9: Autoregressive-Moving Average (ARMA) models Dipartimento di Ingegneria e Scienze dell Informazione e Matematica Università dell Aquila, umberto.triacca@ec.univaq.it Introduction We have seen
More information7. MULTIVARATE STATIONARY PROCESSES
7. MULTIVARATE STATIONARY PROCESSES 1 1 Some Preliminary Definitions and Concepts Random Vector: A vector X = (X 1,..., X n ) whose components are scalar-valued random variables on the same probability
More informationContents. 1 Time Series Analysis Introduction Stationary Processes State Space Modesl Stationary Processes 8
A N D R E W T U L L O C H T I M E S E R I E S A N D M O N T E C A R L O I N F E R E N C E T R I N I T Y C O L L E G E T H E U N I V E R S I T Y O F C A M B R I D G E Contents 1 Time Series Analysis 5
More informationGeneralised AR and MA Models and Applications
Chapter 3 Generalised AR and MA Models and Applications 3.1 Generalised Autoregressive Processes Consider an AR1) process given by 1 αb)x t = Z t ; α < 1. In this case, the acf is, ρ k = α k for k 0 and
More information1 Introduction to Generalized Least Squares
ECONOMICS 7344, Spring 2017 Bent E. Sørensen April 12, 2017 1 Introduction to Generalized Least Squares Consider the model Y = Xβ + ɛ, where the N K matrix of regressors X is fixed, independent of the
More informationLecture 2: ARMA(p,q) models (part 2)
Lecture 2: ARMA(p,q) models (part 2) Florian Pelgrin University of Lausanne, École des HEC Department of mathematics (IMEA-Nice) Sept. 2011 - Jan. 2012 Florian Pelgrin (HEC) Univariate time series Sept.
More informationLecture 3 Stationary Processes and the Ergodic LLN (Reference Section 2.2, Hayashi)
Lecture 3 Stationary Processes and the Ergodic LLN (Reference Section 2.2, Hayashi) Our immediate goal is to formulate an LLN and a CLT which can be applied to establish sufficient conditions for the consistency
More informationEconometrics II Heij et al. Chapter 7.1
Chapter 7.1 p. 1/2 Econometrics II Heij et al. Chapter 7.1 Linear Time Series Models for Stationary data Marius Ooms Tinbergen Institute Amsterdam Chapter 7.1 p. 2/2 Program Introduction Modelling philosophy
More informationγ 0 = Var(X i ) = Var(φ 1 X i 1 +W i ) = φ 2 1γ 0 +σ 2, which implies that we must have φ 1 < 1, and γ 0 = σ2 . 1 φ 2 1 We may also calculate for j 1
4.2 Autoregressive (AR) Moving average models are causal linear processes by definition. There is another class of models, based on a recursive formulation similar to the exponentially weighted moving
More informationMarcel Dettling. Applied Time Series Analysis SS 2013 Week 05. ETH Zürich, March 18, Institute for Data Analysis and Process Design
Marcel Dettling Institute for Data Analysis and Process Design Zurich University of Applied Sciences marcel.dettling@zhaw.ch http://stat.ethz.ch/~dettling ETH Zürich, March 18, 2013 1 Basics of Modeling
More informationEASTERN MEDITERRANEAN UNIVERSITY ECON 604, FALL 2007 DEPARTMENT OF ECONOMICS MEHMET BALCILAR ARIMA MODELS: IDENTIFICATION
ARIMA MODELS: IDENTIFICATION A. Autocorrelations and Partial Autocorrelations 1. Summary of What We Know So Far: a) Series y t is to be modeled by Box-Jenkins methods. The first step was to convert y t
More informationLong-range dependence
Long-range dependence Kechagias Stefanos University of North Carolina at Chapel Hill May 23, 2013 Kechagias Stefanos (UNC) Long-range dependence May 23, 2013 1 / 45 Outline 1 Introduction to time series
More information1. Stochastic Processes and Stationarity
Massachusetts Institute of Technology Department of Economics Time Series 14.384 Guido Kuersteiner Lecture Note 1 - Introduction This course provides the basic tools needed to analyze data that is observed
More informationA Data-Driven Model for Software Reliability Prediction
A Data-Driven Model for Software Reliability Prediction Author: Jung-Hua Lo IEEE International Conference on Granular Computing (2012) Young Taek Kim KAIST SE Lab. 9/4/2013 Contents Introduction Background
More informationTime Series I Time Domain Methods
Astrostatistics Summer School Penn State University University Park, PA 16802 May 21, 2007 Overview Filtering and the Likelihood Function Time series is the study of data consisting of a sequence of DEPENDENT
More information1 Linear Difference Equations
ARMA Handout Jialin Yu 1 Linear Difference Equations First order systems Let {ε t } t=1 denote an input sequence and {y t} t=1 sequence generated by denote an output y t = φy t 1 + ε t t = 1, 2,... with
More informationSTA 6857 Autocorrelation and Cross-Correlation & Stationary Time Series ( 1.4, 1.5)
STA 6857 Autocorrelation and Cross-Correlation & Stationary Time Series ( 1.4, 1.5) Outline 1 Announcements 2 Autocorrelation and Cross-Correlation 3 Stationary Time Series 4 Homework 1c Arthur Berg STA
More informationEconometrics of financial markets, -solutions to seminar 1. Problem 1
Econometrics of financial markets, -solutions to seminar 1. Problem 1 a) Estimate with OLS. For any regression y i α + βx i + u i for OLS to be unbiased we need cov (u i,x j )0 i, j. For the autoregressive
More informationA time series is called strictly stationary if the joint distribution of every collection (Y t
5 Time series A time series is a set of observations recorded over time. You can think for example at the GDP of a country over the years (or quarters) or the hourly measurements of temperature over a
More informationTime Series Analysis
Time Series Analysis Christopher Ting http://mysmu.edu.sg/faculty/christophert/ christopherting@smu.edu.sg Quantitative Finance Singapore Management University March 3, 2017 Christopher Ting Week 9 March
More informationChapter 6: Model Specification for Time Series
Chapter 6: Model Specification for Time Series The ARIMA(p, d, q) class of models as a broad class can describe many real time series. Model specification for ARIMA(p, d, q) models involves 1. Choosing
More informationCircle the single best answer for each multiple choice question. Your choice should be made clearly.
TEST #1 STA 4853 March 6, 2017 Name: Please read the following directions. DO NOT TURN THE PAGE UNTIL INSTRUCTED TO DO SO Directions This exam is closed book and closed notes. There are 32 multiple choice
More informationLecture 3: Autoregressive Moving Average (ARMA) Models and their Practical Applications
Lecture 3: Autoregressive Moving Average (ARMA) Models and their Practical Applications Prof. Massimo Guidolin 20192 Financial Econometrics Winter/Spring 2018 Overview Moving average processes Autoregressive
More informationStochastic Processes
Stochastic Processes Stochastic Process Non Formal Definition: Non formal: A stochastic process (random process) is the opposite of a deterministic process such as one defined by a differential equation.
More informationARMA (and ARIMA) models are often expressed in backshift notation.
Backshift Notation ARMA (and ARIMA) models are often expressed in backshift notation. B is the backshift operator (also called the lag operator ). It operates on time series, and means back up by one time
More informationStatistics of stochastic processes
Introduction Statistics of stochastic processes Generally statistics is performed on observations y 1,..., y n assumed to be realizations of independent random variables Y 1,..., Y n. 14 settembre 2014
More informationNote: The primary reference for these notes is Enders (2004). An alternative and more technical treatment can be found in Hamilton (1994).
Chapter 4 Analysis of a Single Time Series Note: The primary reference for these notes is Enders (4). An alternative and more technical treatment can be found in Hamilton (994). Most data used in financial
More informationModule 4. Stationary Time Series Models Part 1 MA Models and Their Properties
Module 4 Stationary Time Series Models Part 1 MA Models and Their Properties Class notes for Statistics 451: Applied Time Series Iowa State University Copyright 2015 W. Q. Meeker. February 14, 2016 20h
More informationSTOR 356: Summary Course Notes
STOR 356: Summary Course Notes Richard L. Smith Department of Statistics and Operations Research University of North Carolina Chapel Hill, NC 7599-360 rls@email.unc.edu February 19, 008 Course text: Introduction
More informationELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process
Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Definition of stochastic process (random
More informationTime Series: Theory and Methods
Peter J. Brockwell Richard A. Davis Time Series: Theory and Methods Second Edition With 124 Illustrations Springer Contents Preface to the Second Edition Preface to the First Edition vn ix CHAPTER 1 Stationary
More informationCh 4. Models For Stationary Time Series. Time Series Analysis
This chapter discusses the basic concept of a broad class of stationary parametric time series models the autoregressive moving average (ARMA) models. Let {Y t } denote the observed time series, and {e
More informationIdentifiability, Invertibility
Identifiability, Invertibility Defn: If {ǫ t } is a white noise series and µ and b 0,..., b p are constants then X t = µ + b 0 ǫ t + b ǫ t + + b p ǫ t p is a moving average of order p; write MA(p). Q:
More informationTime Series Examples Sheet
Lent Term 2001 Richard Weber Time Series Examples Sheet This is the examples sheet for the M. Phil. course in Time Series. A copy can be found at: http://www.statslab.cam.ac.uk/~rrw1/timeseries/ Throughout,
More informationGARCH Models. Eduardo Rossi University of Pavia. December Rossi GARCH Financial Econometrics / 50
GARCH Models Eduardo Rossi University of Pavia December 013 Rossi GARCH Financial Econometrics - 013 1 / 50 Outline 1 Stylized Facts ARCH model: definition 3 GARCH model 4 EGARCH 5 Asymmetric Models 6
More information