Nonlinear Time Series
|
|
- Lenard Thomas
- 5 years ago
- Views:
Transcription
1 Nonlinear Time Series Recall that a linear time series {X t } is one that follows the relation, X t = µ + i=0 ψ i A t i, where {A t } is iid with mean 0 and finite variance. A linear time series is stationary if i=0 ψ 2 i <. A time series that cannot be put in this form is nonlinear. 1
2 Tests for Nonlinearity What kinds of statistics would be useful in testing for nonlinearity? Null hypothesis: the data follow a linear time series model. One approach would be to fit some kind of general linear model to the data, and then use some statistic computed from the residuals. Another approach would be based on comparisons of transforms with known properties of transforms of data following the hypothesized model. For tests regarding time series specifically (and maybe a few other types of data) the transform could be into the frequency domain. A different approach would be to specify an alternative hypothesis and test against it specifically. 2
3 Tests for Autocorrelations of Squared Residuals Residuals of what? An ARMA(p, q) model is a pretty good approximation for linear time series. Before attempting to fit an ARMA model, we should do some exploratory analyses to make sure we re even in the right ballpark. Are there any obvious departures from stationarity? Trends? Would differencing help? When it appears that we may have a stationary process, we go through the usual motions to fit an ARMA(p, q) model. Is the model a good fit? What could go wrong? There may be an ARCH effect. 3
4 Tests for Autocorrelations of Squared Residuals The ARCH effect arises from autocorrelations of squared residuals from an ARMA model. The simplest test for autocorrelations is based on the asymptotic normality of ˆρ(h) under the null hypothesis of 0 autocorrelation at lag h. (Recall that the test would be a t test, where the denominator is h 1 i=1 The denominator is not obvious.) ˆρ 2 (i) /n. 4
5 Tests for Autocorrelations of Squared Residuals Of course, if ˆρ(h) is asymptotically normal, then ˆρ 2 (h) properly normalized is asymptotically chi-squared, and if ˆρ 2 (i) for i = 1,..., m are independent then the sum of them, each properly normalized, is asymptotically chi-squared with m degrees of freedom. These facts led to the Q (m) portmanteau test of Box and Pierce, and then led to the modified portmanteau test of Ljung and Box, using the statistic Q(m) = n(n + 2) m i=1 ˆρ 2 (i)(n i). This is asymptotically chi-squared with m degrees of freedom. 5
6 Tests for Autocorrelations of Squared Residuals As we have seen, the Q test applied to squared residuals can be used to detect an ARCH effect, as suggested by McLeod and Li. We choose a value of m. So this is one test for nonlinearity. A related test is the F test suggested by Engle. This is the usual F test of in the linear regression model H 0 : β 1 = = β m = 0 a 2 t = β 0 + β 1 a 2 t β ma 2 t m, where the a i are the residuals from the fitted ARMA model. 6
7 Stationary Processes in the Frequency Domain Time series models of the form X t = f(x t 1, X t 2,..., A t, A t 1,..., β), are said to be represented in the time domain. Representations of a time series as a composition of periodic behaviors are said to be in the frequency domain. Processes with strong periodic behavior and periodic processes with a small number of periodicities (audio signals, for example) are usually modeled better in the frequency domain than in the time domain. Financial time series are best analyzed in the time domain. Stationary processes (and of course, there aren t many of those in financial time series!) have an important relationship between a time-domain measure and a frequency-domain function. 7
8 Spectral Representation of the ACVF If we have a stationary process with autocovariance γ(h), then there exists a unique monotonically increasing function F(ω) on the closed interval [ 1/2,1/2], such that F( 1/2) = 0, and F(1/2) = γ(0) and γ(h) = 1/2 1/2 e2πiωh df(ω) The function F(ω) is called the spectral distribution function. The proof of this theorem, the spectral representation theorem, is available in many books, but we will not prove it in this class. Note that my notation for Fourier transforms may differ slightly from that in Tsay; the difference is whether or not frequencies are in radians or in π radians. 8
9 Spectral Density The derivative of the spectral distribution function F(ω), which we write as f(ω) is a measure of the intensity of any periodic component at the frequency ω. We call f(ω) the spectral density. The ACVF is essentially the Fourier transform of the spectral density. By the Inversion Theorem for the Fourier transform, we have, for 1/2 ω 1/2, or f(ω) = f(ω) = h= h= γ(h)e 2πiωh, E(X t X t+h )e 2πiωh. 9
10 Bispectral Density Now, if the third moment E(X t X t+u X t+v ) exists and is finite, in the linear time series we have X t = µ + E(X t X t+u X t+v ) = E i=0 ( X 3 t ψ i A t i, ) i=0 ψ i ψ i+u ψ i+v. Now by analogy, we call the double Fourier transform, the bispectral density: b(ω 1, ω 2 ) = u= v= E(X t X t+u X t+v )e 2πi(ω 1u+ω 2 v). 10
11 Spectral Densities Letting Ψ represent the polynomial formed in the usual way from the ψ i in the linear time series model, we have for the spectral density, f(ω) = E ( X 2 t ) Ψ ( e 2πiω 1 ) Ψ ( e 2πiω 2 ) ; and for the bispectral density, b(ω 1, ω 2 ) = E ( X 3 t ) Ψ ( e 2πiω 1 ) Ψ ( e 2πiω 2 ) Ψ ( e 2πi(ω 1 +ω 2 ) ). Now, note in this case that b(ω 1, ω 2 ) 2 f(ω 1 )f(ω 2 )f(ω 1 + ω 2 ) = ( E ( X 3 t )) 2 ( E ( X 2 t )) 3, which is constant. 11
12 Bispectral Test The constancy of the ratio on the previous slide provides the basis for a test of nonlinearity. How would you do that? Compute it for several subsequences. There are various nonparametric tests for constancy, and consequently there are various bispectral tests. Notice also that the numerator in the test statistic is 0, if the time series is linear and the errors have a normal distribution. 12
13 BDS Test The BDS test is names after Brock, Dechert, and Scheinkman, who proposed it. The test is for strict stationarity of the error process. For the data x 1,..., x n, it is based on the normalized counts of closeness of subsequences, X m i and X m j, where Xm i = (x i,..., x i+m 1 ). For fixed δ > 0, the closeness is measured by how many subsequences are with δ of each other in the supnorm. We define I δ (X m i, Xm j ) = { 1 if X m i X m j δ 0 otherwise 13
14 BDS Test We compare the counts for subsequences of length 1 and k: and 2 C 1 (δ, n) = n(n 1) i<j 2 C k (δ, n) = (n k + 1)(n k) I δ (X 1 i, X1 j ) i<j I δ (X k i, Xk j ). In the iid case, C k (δ, n) (C 1 (δ, n)) k, and asymptotically n(c k (δ, n) (C 1 (δ, n)) k ) is normal with mean 0 and known variance (see Tsay, page 208). The null hypothesis that the errors are iid, which is one of the properties of a linear time series is tested using extreme quantiles of the normal distribution. 14
15 BDS Test Notice that the BDS test depends on two quantities, δ and k. Obviously, k should be small relative to n. There is an R function, bds.test, in the tseries package that performs the computations for the BDS test. 15
16 RESET Test The Regression Equation Specification Error Test (RESET) test of Ramsey is a general test for misspecification of a linear model (not just a linear time series). It may detect omitted variables, incorrect functional form, and heteroscedasticity. For applications of the RESET test to linear time series, we assume that the linear model is an AR model. The test statistic is an F statistic computed from the residuals of a fitted AR model (see equation (4.44) in Tsay). Because of the omnibus nature of the alternative hypothesis, the performance of the test is highly variable, and often has very low power. There is an R function, resettest, in the lmtest package that performs the computations for the RESET test. 16
17 F Tests There are several variations on the F statistic used in the RESET test. Tsay mentions some of these, and you can probably think of other modifications of the basic ideas. 17
18 Threshold Test There are various types of tests that could be constructed based on dividing the time series into different regimes. Simple approaches would be based on regimes that are separated by fixed time points. Other approaches could be based on regimes in which either observed values or fitted residuals appear to be different. Obviously, if the data are used to identify possible thresholds the significance level of a test must take that fact into consideration. In general, the form of the test statistics, however they are constructed are F statistics. 18
19 Time Series Models I don t know of any other area of statistics that has so many different models as in the time domain of time series analysis. Each model has its own name and sometimes different name. The common linear models are of the AR and MA types. We combine AR and MA to get ARMA. Then we difference a time series to get an ARMA, and call the complete model ARIMA. Next, we from AR and MA relations at multiples of longer lags. This yields seasonal ARMA and ARIMA models. Most of the linear models in the time domain are of these types. Then we have the nonlinear time series models. 19
20 Nonlinear Time Series Four general types that are useful: models of squared quantities such as variances; these are often coupled with other models to allow stochastic volatility; ARIMA+GARCH, for example bilinear models X t = c + p i=1 φ i X t i q j=1 θ j A t j + m s i=1 j=1 β ij X t i A t j + A t random coefficients models X t = p i=1 (φ i + U (i) )X t i + A t threshold models Tsay describes a number of these in Chapters 3 and 4. Another general source of nonlinearity is local fitting of a general model. t 20
21 Nonlinear Time Series In the area of nonlinear time series models is where the small modifications with their specific names really proliferates. First, we have the basic ones that account for conditional heteroscedasticity: ARCH and GARCH. Then the modifications (Chapter 3): IGARCH, GARCH-M, EGARCH, TGARCH (also GJR), CHARMA (or RCA), LMSV Then further modifications (Chapter 4): TAR (similar to TGARCH, but for linear terms), SETAR ( self-exciting TAR; the regime depends on a lagged value), STAR, MSA (or MSAR), NAAR. Other models are local regression models. Finally, we have algorithmic models, such as neural nets. I am not going to consider all of these little variations. The most common method of fitting these models is by maximum likelihood. There are R functions for many of them. 21
22 Time Series Models The names of the wide variety of time series models that evolved from the basic ARCH and GARCH models can be rather confusing. Some models go by different names. Tsay sometimes refers to the TGARCH(m, s) model as the GJR model (see p. 149). ( GJR is not in the index for his book.) Most of the models that Tsay uses are special cases of the APARCH model of Ding, Grange, and Engle (1993). This model is as the basic ARCH model, and m σt δ = α 0 + α i ( A t i γ i A t i ) δ + i=1 A t = σ t ɛ t, (1) s β j σt j. δ (2) This model includes several of the other variations on the GARCH model. j=1 22
23 Transition or Threshold Models A two-regime transition model is of the general form X t = g 1 (x p t p 1, aq t q 1, β 1) + A t if condition 1 g 2 (x p t p 1, aq t q 1, β 2) + A t otherwise A threshold model usually depends on the past state and so is of the general form X t = g 1 (x p t p 1, aq t q 1, β 1) + A t if x p t p 1 R 1 g 2 (x p t p 1, aq t q 1, β 2) + A t otherwise For the specific case of an AR model, the g i functions above are linear functions of x p t p 1. Also, the condition x p t p 1 R 1 is usually simplified to a simple form x t d R 1. 23
24 Smooth Transition Autoregressive (STAR) Model An obvious modification is to make the transition smooth by using a smooth weighting function. If the linear functions are AR relationships, we have a simple instance, namely, the STAR(p) model: X t = φ 1,0 + p i=1 φ 1,i x t i +F ( ) xt d φ 2,0 + s p i=1 where F( ) is a smooth function going from 0 to 1. φ 2,i x t i +A t, Tsay gives an R function to fit a STAR model on page 186. I could not find this code anywhere, but if someone will key it in and send it to me, I ll post it. 24
25 Markov Switching Model Another simple transition model in which the underlying components are AR is the Markov switching model (MSA). Here, the regime is chosen as a Markov process. The model for a two-state MSA, as before is X t = φ 1,0 + p i=1 φ 1,ix t i + A 1t if state 1 φ 2,0 + p i=1 φ 2,ix t i + A 2t otherwise All we need to specify are the transition probabilities Pr(S t s t 1 ). Fitting this is a little harder, but again, can be done by maximum likelihood. The transition probabilities can be estimated by MCMC or by the EM algorithm. 25
26 The following slides are preliminary versions of the material we will discuss on April
27 Kernel Regression Local regression is another type of nonlinear modeling. A simple form of local regression is to use a filter or kernel function to provide local weighting of the observed data. This approach ensures that at a given point the observations close to that point influence the estimate at the point more strongly than more distant observations. A standard method in this approach is to convolve the observations with a unimodal function that decreases rapidly away from a central point. This function is the filter or the kernel. A kernel function has two arguments representing the two points in the convolution, but we typically use a single argument that represents the distance between the two points. 27
28 Choice of Kernels Standard normal densities have these properties described above, so the kernel is often chosen to be the standard normal density. As it turns out, the kernel density estimator is not very sensitive to the form of the kernel. Although the kernel may be from a parametric family of distributions, in kernel density estimation, we do not estimate those parameters; hence, the kernel method is a nonparametric method. 28
29 Choice of Kernels Sometimes, a kernel with finite support is easier to work with. In the univariate case, a useful general form of a compact kernel is K(t) = κ rs (1 t r ) s I [ 1,1] (t), where κ rs = r, for r > 0, s 0, 2B(1/r,s + 1) and B(a, b) is the complete beta function. 29
30 Choice of Kernels This general form leads to several simple specific cases: for r = 1 and s = 0, it is the rectangular or uniform kernel; for r = 1 and s = 1, it is the triangular kernel; for r = 2 and s = 1 (κ rs = 3/4), it is the Epanechnikov kernel, which yields the optimal rate of convergence of the MISE; for r = 2 and s = 2 (κ rs = 15/16), it is the biweight kernel. If r = 2 and s, we have the Gaussian kernel (with some rescaling). 30
31 Kernel Methods In kernel methods, the locality of influence is controlled by a window around the point of interest. The choice of the size of the window, or the bandwidth, is the most important issue in the use of kernel methods. In univariate applications, the window size is just a length, usually denoted by h (except maybe in time series applications). In practice, for a given choice of the size of the window, the argument of the kernel function is transformed to reflect the size. The transformation is accomplished using a positive definite matrix, V, whose determinant measures the volume (size) of the window. 31
32 Local Linear Regression Use of the kernel function is simple. When least squares is the basic criterion, the kernel just becomes the weight. 32
33 Choice of Bandwidth There are two ways to choose a bandwidth. One is based on the mean-integrated squared error (MISE). In this method, the MISE for an assumed model is determined, and then the bandwidth that minimizes this is determined. The other method is a data-based method. We use cross-validation to determine the optimal bandwidth. In cross-validation, for a given bandwidth, we fit a model using all of data except for a few points ( leave-out-d ), then determine the SSE using all of the data. We do this over a grid of bandwidths. Then we do this multiple times ( k-fold cross-validation ). The best bandwidth is the one that minimizes the SSE (from all data). 33
34 Nonparametric Smoothing Kernel methods may be parametric or nonparametric. In nonparametric methods, the kernels are generally simple. There are various methods, such as running medians or running (weighted) means. Running means are moving averages. The R function lowess does locally weighted smoothing using weighted running means. These methods are widely used for smoothing time series. The emphasis is on prediction, rather than model building. 34
35 General Additive Time Series Models A model of the form y i = β 0 + β 1 x 1i + + β m x mi + ɛ i can be generalized by replacing the constant (but unknown) coefficients by unknown functions (with specified forms): y i = f 1 (x)x 1i + + f m (x)x mi + ɛ i Hastie and Tibshirani have written extensively on such models. 35
36 Neural Networks When the emphasis is on prediction, we can form a black box algorithm that accepts a set of input values x, combines them into intermediate values (in a hidden layer ) and then combines the values of the hidden layer into a single output y. In a time series application, we have data r 1,..., r n, and for i = k,..., n, we choose a subsequence x i = (r i,..., r i k as an input to produce an output o i as a predictor of r i. We train the neural net so as to minimize (oi r i ) 2 The R function nnet in nnet can be used to do this. See Appendix B in Chapter 4 of Tsay. Watch out for the assignment statements! Never write R or S-Plus code like that! 36
37 Monte Carlo Forecasting Monte Carlo can be used for forecasting in any time series model ( parametric bootstrap ). At forecast origin t we forecast at the horizon t + h by use of the fitted (or assumed) model and simulated errors (or innovations ). Doing this many times, we get a sample of ˆr (j) t+h. The mean of this sample is the estimator, ˆr t+h, and the sample quantiles provide confidence limits. 37
38 Fitting Time Series Models in R There are a number of R functions that perform the computations to fit various time series models. ARMA / ARIMA arima(stats) ARMA order determination autofit(itsmr) ARMA + GARCH garchfit(fgarch) APARCH garchfit(fgarch) The APARCH model includes the TGARCH and GJR models, among others; see equation (2). Also see the help page for fgarch-package in fgarch. 38
39 Other R Functions for Time Series Models There are R functions for forecasting using different time series models that have been fitted. ARMA/ARIMA predict.arima(stats) APARCH (including ARMA + GARCH) predict(fgarch) There are also R functions for simulating data from different time series models. ARMA/ARIMA arima.sim(stats) APARCH (including ARMA + GARCH) garchsim(fgarch) 39
Financial Econometrics
Financial Econometrics Nonlinear time series analysis Gerald P. Dwyer Trinity College, Dublin January 2016 Outline 1 Nonlinearity Does nonlinearity matter? Nonlinear models Tests for nonlinearity Forecasting
More informationECONOMICS 7200 MODERN TIME SERIES ANALYSIS Econometric Theory and Applications
ECONOMICS 7200 MODERN TIME SERIES ANALYSIS Econometric Theory and Applications Yongmiao Hong Department of Economics & Department of Statistical Sciences Cornell University Spring 2019 Time and uncertainty
More informationEconometric Forecasting
Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna October 1, 2014 Outline Introduction Model-free extrapolation Univariate time-series models Trend
More informationVolatility. Gerald P. Dwyer. February Clemson University
Volatility Gerald P. Dwyer Clemson University February 2016 Outline 1 Volatility Characteristics of Time Series Heteroskedasticity Simpler Estimation Strategies Exponentially Weighted Moving Average Use
More informationSTAT 443 Final Exam Review. 1 Basic Definitions. 2 Statistical Tests. L A TEXer: W. Kong
STAT 443 Final Exam Review L A TEXer: W Kong 1 Basic Definitions Definition 11 The time series {X t } with E[X 2 t ] < is said to be weakly stationary if: 1 µ X (t) = E[X t ] is independent of t 2 γ X
More informationMultivariate Time Series: VAR(p) Processes and Models
Multivariate Time Series: VAR(p) Processes and Models A VAR(p) model, for p > 0 is X t = φ 0 + Φ 1 X t 1 + + Φ p X t p + A t, where X t, φ 0, and X t i are k-vectors, Φ 1,..., Φ p are k k matrices, with
More informationTime Series: Theory and Methods
Peter J. Brockwell Richard A. Davis Time Series: Theory and Methods Second Edition With 124 Illustrations Springer Contents Preface to the Second Edition Preface to the First Edition vn ix CHAPTER 1 Stationary
More informationMultivariate Time Series Analysis and Its Applications [Tsay (2005), chapter 8]
1 Multivariate Time Series Analysis and Its Applications [Tsay (2005), chapter 8] Insights: Price movements in one market can spread easily and instantly to another market [economic globalization and internet
More informationThomas J. Fisher. Research Statement. Preliminary Results
Thomas J. Fisher Research Statement Preliminary Results Many applications of modern statistics involve a large number of measurements and can be considered in a linear algebra framework. In many of these
More informationAR, MA and ARMA models
AR, MA and AR by Hedibert Lopes P Based on Tsay s Analysis of Financial Time Series (3rd edition) P 1 Stationarity 2 3 4 5 6 7 P 8 9 10 11 Outline P Linear Time Series Analysis and Its Applications For
More informationMultivariate Time Series
Multivariate Time Series Notation: I do not use boldface (or anything else) to distinguish vectors from scalars. Tsay (and many other writers) do. I denote a multivariate stochastic process in the form
More informationClassic Time Series Analysis
Classic Time Series Analysis Concepts and Definitions Let Y be a random number with PDF f Y t ~f,t Define t =E[Y t ] m(t) is known as the trend Define the autocovariance t, s =COV [Y t,y s ] =E[ Y t t
More informationGoodness-of-Fit Tests for Time Series Models: A Score-Marked Empirical Process Approach
Goodness-of-Fit Tests for Time Series Models: A Score-Marked Empirical Process Approach By Shiqing Ling Department of Mathematics Hong Kong University of Science and Technology Let {y t : t = 0, ±1, ±2,
More informationA Course in Time Series Analysis
A Course in Time Series Analysis Edited by DANIEL PENA Universidad Carlos III de Madrid GEORGE C. TIAO University of Chicago RUEY S. TSAY University of Chicago A Wiley-Interscience Publication JOHN WILEY
More informationDiagnostic Test for GARCH Models Based on Absolute Residual Autocorrelations
Diagnostic Test for GARCH Models Based on Absolute Residual Autocorrelations Farhat Iqbal Department of Statistics, University of Balochistan Quetta-Pakistan farhatiqb@gmail.com Abstract In this paper
More informationTime Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY
Time Series Analysis James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY & Contents PREFACE xiii 1 1.1. 1.2. Difference Equations First-Order Difference Equations 1 /?th-order Difference
More informationTime Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY
Time Series Analysis James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY PREFACE xiii 1 Difference Equations 1.1. First-Order Difference Equations 1 1.2. pth-order Difference Equations 7
More informationTime Series I Time Domain Methods
Astrostatistics Summer School Penn State University University Park, PA 16802 May 21, 2007 Overview Filtering and the Likelihood Function Time series is the study of data consisting of a sequence of DEPENDENT
More informationTIME SERIES ANALYSIS. Forecasting and Control. Wiley. Fifth Edition GWILYM M. JENKINS GEORGE E. P. BOX GREGORY C. REINSEL GRETA M.
TIME SERIES ANALYSIS Forecasting and Control Fifth Edition GEORGE E. P. BOX GWILYM M. JENKINS GREGORY C. REINSEL GRETA M. LJUNG Wiley CONTENTS PREFACE TO THE FIFTH EDITION PREFACE TO THE FOURTH EDITION
More informationWeek 5 Quantitative Analysis of Financial Markets Characterizing Cycles
Week 5 Quantitative Analysis of Financial Markets Characterizing Cycles Christopher Ting http://www.mysmu.edu/faculty/christophert/ Christopher Ting : christopherting@smu.edu.sg : 6828 0364 : LKCSB 5036
More informationGaussian Copula Regression Application
International Mathematical Forum, Vol. 11, 2016, no. 22, 1053-1065 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/10.12988/imf.2016.68118 Gaussian Copula Regression Application Samia A. Adham Department
More informationProblem Set 2 Solution Sketches Time Series Analysis Spring 2010
Problem Set 2 Solution Sketches Time Series Analysis Spring 2010 Forecasting 1. Let X and Y be two random variables such that E(X 2 ) < and E(Y 2 )
More informationSymmetric btw positive & negative prior returns. where c is referred to as risk premium, which is expected to be positive.
Advantages of GARCH model Simplicity Generates volatility clustering Heavy tails (high kurtosis) Weaknesses of GARCH model Symmetric btw positive & negative prior returns Restrictive Provides no explanation
More informationApplied Time. Series Analysis. Wayne A. Woodward. Henry L. Gray. Alan C. Elliott. Dallas, Texas, USA
Applied Time Series Analysis Wayne A. Woodward Southern Methodist University Dallas, Texas, USA Henry L. Gray Southern Methodist University Dallas, Texas, USA Alan C. Elliott University of Texas Southwestern
More informationcovariance function, 174 probability structure of; Yule-Walker equations, 174 Moving average process, fluctuations, 5-6, 175 probability structure of
Index* The Statistical Analysis of Time Series by T. W. Anderson Copyright 1971 John Wiley & Sons, Inc. Aliasing, 387-388 Autoregressive {continued) Amplitude, 4, 94 case of first-order, 174 Associated
More informationStatistics of stochastic processes
Introduction Statistics of stochastic processes Generally statistics is performed on observations y 1,..., y n assumed to be realizations of independent random variables Y 1,..., Y n. 14 settembre 2014
More informationEcon 423 Lecture Notes: Additional Topics in Time Series 1
Econ 423 Lecture Notes: Additional Topics in Time Series 1 John C. Chao April 25, 2017 1 These notes are based in large part on Chapter 16 of Stock and Watson (2011). They are for instructional purposes
More informationGARCH Models. Eduardo Rossi University of Pavia. December Rossi GARCH Financial Econometrics / 50
GARCH Models Eduardo Rossi University of Pavia December 013 Rossi GARCH Financial Econometrics - 013 1 / 50 Outline 1 Stylized Facts ARCH model: definition 3 GARCH model 4 EGARCH 5 Asymmetric Models 6
More informationITSM-R Reference Manual
ITSM-R Reference Manual George Weigt February 11, 2018 1 Contents 1 Introduction 3 1.1 Time series analysis in a nutshell............................... 3 1.2 White Noise Variance.....................................
More informationSTAD57 Time Series Analysis. Lecture 23
STAD57 Time Series Analysis Lecture 23 1 Spectral Representation Spectral representation of stationary {X t } is: 12 i2t Xt e du 12 1/2 1/2 for U( ) a stochastic process with independent increments du(ω)=
More informationIntroduction to Regression Analysis. Dr. Devlina Chatterjee 11 th August, 2017
Introduction to Regression Analysis Dr. Devlina Chatterjee 11 th August, 2017 What is regression analysis? Regression analysis is a statistical technique for studying linear relationships. One dependent
More informationStochastic Processes
Stochastic Processes Stochastic Process Non Formal Definition: Non formal: A stochastic process (random process) is the opposite of a deterministic process such as one defined by a differential equation.
More informationApplied time-series analysis
Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna October 18, 2011 Outline Introduction and overview Econometric Time-Series Analysis In principle,
More informationTAKEHOME FINAL EXAM e iω e 2iω e iω e 2iω
ECO 513 Spring 2015 TAKEHOME FINAL EXAM (1) Suppose the univariate stochastic process y is ARMA(2,2) of the following form: y t = 1.6974y t 1.9604y t 2 + ε t 1.6628ε t 1 +.9216ε t 2, (1) where ε is i.i.d.
More informationSF2943: TIME SERIES ANALYSIS COMMENTS ON SPECTRAL DENSITIES
SF2943: TIME SERIES ANALYSIS COMMENTS ON SPECTRAL DENSITIES This document is meant as a complement to Chapter 4 in the textbook, the aim being to get a basic understanding of spectral densities through
More informationSTOR 356: Summary Course Notes
STOR 356: Summary Course Notes Richard L. Smith Department of Statistics and Operations Research University of North Carolina Chapel Hill, NC 7599-360 rls@email.unc.edu February 19, 008 Course text: Introduction
More informationA time series is called strictly stationary if the joint distribution of every collection (Y t
5 Time series A time series is a set of observations recorded over time. You can think for example at the GDP of a country over the years (or quarters) or the hourly measurements of temperature over a
More informationProf. Dr. Roland Füss Lecture Series in Applied Econometrics Summer Term Introduction to Time Series Analysis
Introduction to Time Series Analysis 1 Contents: I. Basics of Time Series Analysis... 4 I.1 Stationarity... 5 I.2 Autocorrelation Function... 9 I.3 Partial Autocorrelation Function (PACF)... 14 I.4 Transformation
More informationRevisiting linear and non-linear methodologies for time series prediction - application to ESTSP 08 competition data
Revisiting linear and non-linear methodologies for time series - application to ESTSP 08 competition data Madalina Olteanu Universite Paris 1 - SAMOS CES 90 Rue de Tolbiac, 75013 Paris - France Abstract.
More informationIndex. Regression Models for Time Series Analysis. Benjamin Kedem, Konstantinos Fokianos Copyright John Wiley & Sons, Inc. ISBN.
Regression Models for Time Series Analysis. Benjamin Kedem, Konstantinos Fokianos Copyright 0 2002 John Wiley & Sons, Inc. ISBN. 0-471-36355-3 Index Adaptive rejection sampling, 233 Adjacent categories
More informationCh 8. MODEL DIAGNOSTICS. Time Series Analysis
Model diagnostics is concerned with testing the goodness of fit of a model and, if the fit is poor, suggesting appropriate modifications. We shall present two complementary approaches: analysis of residuals
More informationFE570 Financial Markets and Trading. Stevens Institute of Technology
FE570 Financial Markets and Trading Lecture 5. Linear Time Series Analysis and Its Applications (Ref. Joel Hasbrouck - Empirical Market Microstructure ) Steve Yang Stevens Institute of Technology 9/25/2012
More informationAutoregressive Moving Average (ARMA) Models and their Practical Applications
Autoregressive Moving Average (ARMA) Models and their Practical Applications Massimo Guidolin February 2018 1 Essential Concepts in Time Series Analysis 1.1 Time Series and Their Properties Time series:
More informationEconomics 618B: Time Series Analysis Department of Economics State University of New York at Binghamton
Problem Set #1 1. Generate n =500random numbers from both the uniform 1 (U [0, 1], uniformbetween zero and one) and exponential λ exp ( λx) (set λ =2and let x U [0, 1]) b a distributions. Plot the histograms
More informationStatistical Methods for Forecasting
Statistical Methods for Forecasting BOVAS ABRAHAM University of Waterloo JOHANNES LEDOLTER University of Iowa John Wiley & Sons New York Chichester Brisbane Toronto Singapore Contents 1 INTRODUCTION AND
More informationBasics: Definitions and Notation. Stationarity. A More Formal Definition
Basics: Definitions and Notation A Univariate is a sequence of measurements of the same variable collected over (usually regular intervals of) time. Usual assumption in many time series techniques is that
More informationIf we want to analyze experimental or simulated data we might encounter the following tasks:
Chapter 1 Introduction If we want to analyze experimental or simulated data we might encounter the following tasks: Characterization of the source of the signal and diagnosis Studying dependencies Prediction
More informationTIME SERIES DATA ANALYSIS USING EVIEWS
TIME SERIES DATA ANALYSIS USING EVIEWS I Gusti Ngurah Agung Graduate School Of Management Faculty Of Economics University Of Indonesia Ph.D. in Biostatistics and MSc. in Mathematical Statistics from University
More informationGARCH models. Erik Lindström. FMS161/MASM18 Financial Statistics
FMS161/MASM18 Financial Statistics Time series models Let r t be a stochastic process. µ t = E[r t F t 1 ] is the conditional mean modeled by an AR, ARMA, SETAR, STAR etc. model. Having a correctly specified
More informationEconometría 2: Análisis de series de Tiempo
Econometría 2: Análisis de series de Tiempo Karoll GOMEZ kgomezp@unal.edu.co http://karollgomez.wordpress.com Segundo semestre 2016 IX. Vector Time Series Models VARMA Models A. 1. Motivation: The vector
More informationModelling and forecasting of offshore wind power fluctuations with Markov-Switching models
Modelling and forecasting of offshore wind power fluctuations with Markov-Switching models 02433 - Hidden Markov Models Pierre-Julien Trombe, Martin Wæver Pedersen, Henrik Madsen Course week 10 MWP, compiled
More informationVariance stabilization and simple GARCH models. Erik Lindström
Variance stabilization and simple GARCH models Erik Lindström Simulation, GBM Standard model in math. finance, the GBM ds t = µs t dt + σs t dw t (1) Solution: S t = S 0 exp ) ) ((µ σ2 t + σw t 2 (2) Problem:
More informationG. S. Maddala Kajal Lahiri. WILEY A John Wiley and Sons, Ltd., Publication
G. S. Maddala Kajal Lahiri WILEY A John Wiley and Sons, Ltd., Publication TEMT Foreword Preface to the Fourth Edition xvii xix Part I Introduction and the Linear Regression Model 1 CHAPTER 1 What is Econometrics?
More informationA note on the specification of conditional heteroscedasticity using a TAR model
A note on the specification of conditional heteroscedasticity using a TAR model Fabio H. Nieto Universidad Nacional de Colombia Edna C. Moreno Universidad Santo Tomás, Bogotá, Colombia Reporte Interno
More informationNonlinear time series
Based on the book by Fan/Yao: Nonlinear Time Series Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna October 27, 2009 Outline Characteristics of
More informationLecture 2: Univariate Time Series
Lecture 2: Univariate Time Series Analysis: Conditional and Unconditional Densities, Stationarity, ARMA Processes Prof. Massimo Guidolin 20192 Financial Econometrics Spring/Winter 2017 Overview Motivation:
More informationLong memory in the R$/US$ exchange rate: A robust analysis
Long memory in the R$/US$ exchange rate: A robust analysis Márcio Poletti Laurini 1 Marcelo Savino Portugal 2 Abstract This article shows that the evidence of long memory for the daily R$/US$ exchange
More informationA test for improved forecasting performance at higher lead times
A test for improved forecasting performance at higher lead times John Haywood and Granville Tunnicliffe Wilson September 3 Abstract Tiao and Xu (1993) proposed a test of whether a time series model, estimated
More informationECON 616: Lecture 1: Time Series Basics
ECON 616: Lecture 1: Time Series Basics ED HERBST August 30, 2017 References Overview: Chapters 1-3 from Hamilton (1994). Technical Details: Chapters 2-3 from Brockwell and Davis (1987). Intuition: Chapters
More informationECON3327: Financial Econometrics, Spring 2016
ECON3327: Financial Econometrics, Spring 2016 Wooldridge, Introductory Econometrics (5th ed, 2012) Chapter 11: OLS with time series data Stationary and weakly dependent time series The notion of a stationary
More informationLecture 14: Conditional Heteroscedasticity Bus 41910, Time Series Analysis, Mr. R. Tsay
Lecture 14: Conditional Heteroscedasticity Bus 41910, Time Series Analysis, Mr. R. Tsay The introduction of conditional heteroscedastic autoregressive (ARCH) models by Engle (198) popularizes conditional
More informationEmpirical Market Microstructure Analysis (EMMA)
Empirical Market Microstructure Analysis (EMMA) Lecture 3: Statistical Building Blocks and Econometric Basics Prof. Dr. Michael Stein michael.stein@vwl.uni-freiburg.de Albert-Ludwigs-University of Freiburg
More informationTHE UNIVERSITY OF CHICAGO Graduate School of Business Business 41202, Spring Quarter 2003, Mr. Ruey S. Tsay
THE UNIVERSITY OF CHICAGO Graduate School of Business Business 41202, Spring Quarter 2003, Mr. Ruey S. Tsay Solutions to Homework Assignment #4 May 9, 2003 Each HW problem is 10 points throughout this
More informationPart II. Time Series
Part II Time Series 12 Introduction This Part is mainly a summary of the book of Brockwell and Davis (2002). Additionally the textbook Shumway and Stoffer (2010) can be recommended. 1 Our purpose is to
More informationGARCH Models Estimation and Inference
GARCH Models Estimation and Inference Eduardo Rossi University of Pavia December 013 Rossi GARCH Financial Econometrics - 013 1 / 1 Likelihood function The procedure most often used in estimating θ 0 in
More informationDo Markov-Switching Models Capture Nonlinearities in the Data? Tests using Nonparametric Methods
Do Markov-Switching Models Capture Nonlinearities in the Data? Tests using Nonparametric Methods Robert V. Breunig Centre for Economic Policy Research, Research School of Social Sciences and School of
More informationModel Specification Testing in Nonparametric and Semiparametric Time Series Econometrics. Jiti Gao
Model Specification Testing in Nonparametric and Semiparametric Time Series Econometrics Jiti Gao Department of Statistics School of Mathematics and Statistics The University of Western Australia Crawley
More informationLong-range dependence
Long-range dependence Kechagias Stefanos University of North Carolina at Chapel Hill May 23, 2013 Kechagias Stefanos (UNC) Long-range dependence May 23, 2013 1 / 45 Outline 1 Introduction to time series
More informationA nonparametric test for seasonal unit roots
Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna To be presented in Innsbruck November 7, 2007 Abstract We consider a nonparametric test for the
More informationOutline. STA 6857 Cross Spectra, Linear Filters, and Parametric Spectral Estimation ( 4.6, 4.7, & 4.8) Summary Statistics of Midterm Scores
STA 6857 Cross Spectra, Linear Filters, and Parametric Spectral Estimation ( 4.6, 4.7, & 4.8) Outline 1 Midterm Results 2 Multiple Series and Cross-Spectra 3 Linear Filters Arthur Berg STA 6857 Cross Spectra,
More informationArma-Arch Modeling Of The Returns Of First Bank Of Nigeria
Arma-Arch Modeling Of The Returns Of First Bank Of Nigeria Emmanuel Alphonsus Akpan Imoh Udo Moffat Department of Mathematics and Statistics University of Uyo, Nigeria Ntiedo Bassey Ekpo Department of
More informationdistributed approximately according to white noise. Likewise, for general ARMA(p,q), the residuals can be expressed as
library(forecast) log_ap
More informationTheodore Panagiotidis*^ and Gianluigi Pelloni**
Free University of Bozen - Bolzano School of Economics Bolzano, Italy Working Paper No. 13 IS NON-LINEAR SERIAL DEPENDENCE PRESENT IN THE US UNEMPLOYMENT RATE AND THE GROWTH RATES OF EMPLOYMENT SECTORAL
More informationThe autocorrelation and autocovariance functions - helpful tools in the modelling problem
The autocorrelation and autocovariance functions - helpful tools in the modelling problem J. Nowicka-Zagrajek A. Wy lomańska Institute of Mathematics and Computer Science Wroc law University of Technology,
More informationIntroduction to ARMA and GARCH processes
Introduction to ARMA and GARCH processes Fulvio Corsi SNS Pisa 3 March 2010 Fulvio Corsi Introduction to ARMA () and GARCH processes SNS Pisa 3 March 2010 1 / 24 Stationarity Strict stationarity: (X 1,
More information1 Linear Difference Equations
ARMA Handout Jialin Yu 1 Linear Difference Equations First order systems Let {ε t } t=1 denote an input sequence and {y t} t=1 sequence generated by denote an output y t = φy t 1 + ε t t = 1, 2,... with
More informationSTA 6857 Cross Spectra, Linear Filters, and Parametric Spectral Estimation ( 4.6, 4.7, & 4.8)
STA 6857 Cross Spectra, Linear Filters, and Parametric Spectral Estimation ( 4.6, 4.7, & 4.8) Outline 1 Midterm Results 2 Multiple Series and Cross-Spectra 3 Linear Filters Arthur Berg STA 6857 Cross Spectra,
More informationSome Time-Series Models
Some Time-Series Models Outline 1. Stochastic processes and their properties 2. Stationary processes 3. Some properties of the autocorrelation function 4. Some useful models Purely random processes, random
More informationA Test of the GARCH(1,1) Specification for Daily Stock Returns
A Test of the GARCH(1,1) Specification for Daily Stock Returns Richard A. Ashley Department of Economics Virginia Tech (VPI) ashleyr@vt.edu Douglas M. Patterson Department of Finance Virginia Tech (VPI)
More informationChapter 12: An introduction to Time Series Analysis. Chapter 12: An introduction to Time Series Analysis
Chapter 12: An introduction to Time Series Analysis Introduction In this chapter, we will discuss forecasting with single-series (univariate) Box-Jenkins models. The common name of the models is Auto-Regressive
More informationMAT 3379 (Winter 2016) FINAL EXAM (PRACTICE)
MAT 3379 (Winter 2016) FINAL EXAM (PRACTICE) 15 April 2016 (180 minutes) Professor: R. Kulik Student Number: Name: This is closed book exam. You are allowed to use one double-sided A4 sheet of notes. Only
More informationKernel-based portmanteau diagnostic test for ARMA time series models
STATISTICS RESEARCH ARTICLE Kernel-based portmanteau diagnostic test for ARMA time series models Esam Mahdi 1 * Received: 01 October 2016 Accepted: 07 February 2017 First Published: 21 February 2017 *Corresponding
More informationThe Size and Power of Four Tests for Detecting Autoregressive Conditional Heteroskedasticity in the Presence of Serial Correlation
The Size and Power of Four s for Detecting Conditional Heteroskedasticity in the Presence of Serial Correlation A. Stan Hurn Department of Economics Unversity of Melbourne Australia and A. David McDonald
More informationIntroduction to Signal Processing
to Signal Processing Davide Bacciu Dipartimento di Informatica Università di Pisa bacciu@di.unipi.it Intelligent Systems for Pattern Recognition Signals = Time series Definitions Motivations A sequence
More informationinterval forecasting
Interval Forecasting Based on Chapter 7 of the Time Series Forecasting by Chatfield Econometric Forecasting, January 2008 Outline 1 2 3 4 5 Terminology Interval Forecasts Density Forecast Fan Chart Most
More informationISSN Article. Selection Criteria in Regime Switching Conditional Volatility Models
Econometrics 2015, 3, 289-316; doi:10.3390/econometrics3020289 OPEN ACCESS econometrics ISSN 2225-1146 www.mdpi.com/journal/econometrics Article Selection Criteria in Regime Switching Conditional Volatility
More informationAPPLIED TIME SERIES ECONOMETRICS
APPLIED TIME SERIES ECONOMETRICS Edited by HELMUT LÜTKEPOHL European University Institute, Florence MARKUS KRÄTZIG Humboldt University, Berlin CAMBRIDGE UNIVERSITY PRESS Contents Preface Notation and Abbreviations
More informationEcon 582 Nonparametric Regression
Econ 582 Nonparametric Regression Eric Zivot May 28, 2013 Nonparametric Regression Sofarwehaveonlyconsideredlinearregressionmodels = x 0 β + [ x ]=0 [ x = x] =x 0 β = [ x = x] [ x = x] x = β The assume
More informationDynamic Time Series Regression: A Panacea for Spurious Correlations
International Journal of Scientific and Research Publications, Volume 6, Issue 10, October 2016 337 Dynamic Time Series Regression: A Panacea for Spurious Correlations Emmanuel Alphonsus Akpan *, Imoh
More informationChapter 3: Regression Methods for Trends
Chapter 3: Regression Methods for Trends Time series exhibiting trends over time have a mean function that is some simple function (not necessarily constant) of time. The example random walk graph from
More informationModelling using ARMA processes
Modelling using ARMA processes Step 1. ARMA model identification; Step 2. ARMA parameter estimation Step 3. ARMA model selection ; Step 4. ARMA model checking; Step 5. forecasting from ARMA models. 33
More informationDefect Detection using Nonparametric Regression
Defect Detection using Nonparametric Regression Siana Halim Industrial Engineering Department-Petra Christian University Siwalankerto 121-131 Surabaya- Indonesia halim@petra.ac.id Abstract: To compare
More informationMGR-815. Notes for the MGR-815 course. 12 June School of Superior Technology. Professor Zbigniew Dziong
Modeling, Estimation and Control, for Telecommunication Networks Notes for the MGR-815 course 12 June 2010 School of Superior Technology Professor Zbigniew Dziong 1 Table of Contents Preface 5 1. Example
More informationTime Series and Forecasting Lecture 4 NonLinear Time Series
Time Series and Forecasting Lecture 4 NonLinear Time Series Bruce E. Hansen Summer School in Economics and Econometrics University of Crete July 23-27, 2012 Bruce Hansen (University of Wisconsin) Foundations
More informationAdvanced Econometrics
Advanced Econometrics Marco Sunder Nov 04 2010 Marco Sunder Advanced Econometrics 1/ 25 Contents 1 2 3 Marco Sunder Advanced Econometrics 2/ 25 Music Marco Sunder Advanced Econometrics 3/ 25 Music Marco
More informationARIMA Modelling and Forecasting
ARIMA Modelling and Forecasting Economic time series often appear nonstationary, because of trends, seasonal patterns, cycles, etc. However, the differences may appear stationary. Δx t x t x t 1 (first
More informationGeneralised AR and MA Models and Applications
Chapter 3 Generalised AR and MA Models and Applications 3.1 Generalised Autoregressive Processes Consider an AR1) process given by 1 αb)x t = Z t ; α < 1. In this case, the acf is, ρ k = α k for k 0 and
More informationNonlinear Characterization of Activity Dynamics in Online Collaboration Websites
Nonlinear Characterization of Activity Dynamics in Online Collaboration Websites Tiago Santos 1 Simon Walk 2 Denis Helic 3 1 Know-Center, Graz, Austria 2 Stanford University 3 Graz University of Technology
More informationElements of Multivariate Time Series Analysis
Gregory C. Reinsel Elements of Multivariate Time Series Analysis Second Edition With 14 Figures Springer Contents Preface to the Second Edition Preface to the First Edition vii ix 1. Vector Time Series
More informationLECTURES 2-3 : Stochastic Processes, Autocorrelation function. Stationarity.
LECTURES 2-3 : Stochastic Processes, Autocorrelation function. Stationarity. Important points of Lecture 1: A time series {X t } is a series of observations taken sequentially over time: x t is an observation
More information