An alternative estimator for the number of factors for high-dimensional time series. A robust approach.

Size: px
Start display at page:

Download "An alternative estimator for the number of factors for high-dimensional time series. A robust approach."

Transcription

1 An alternative estimator for the number of factors for high-dimensional time series. A robust approach. Valdério A. Reisen DEST-CCE/PPGEA/PPGECON - Federal University of Espírito Santo, Brazil valderioanselmoreisen@gmail.com CentraleSupélec, Gif-Sur-Yvette

2 Summary Time Domain: A robust estimator of the ACF 5 Factor Analysis - Simulation cases 6 7

3 Abstract This paper considers the factor modeling for high-dimensional time series with short and long-memory properties and in the presence of additive outliers. The factor model studied by Lam and Yao (2012) is extended to the presence of additive outliers. The estimators of the number of factors are obtained by the robust covariance matrix. The methodology is analyzed in terms of the convergence rate of the number factors and by means of Monte Carlo simulations. with the aiming to reduce the dimensionality of the data set: The pollutant PM 10 in the Greater Vitória region (ES, Brazil).

4 : Main topics of this talk : Main topics of this talk : MOTIVATIONS FROM REAL APPLICATION. : MOTIVATIONS FROM REAL APPLICATION. Factor Analysis (FA) for multivariate time series with long-memory and short-memory properties and outliers; A robust dimension reduction estimator for the number of components in FA is proposed (an extension Lam and Yao (2012)); A simulation study to show the perfomance of the method for TS under additive outliers The application of the suggested estimator to a real data set. The pollutant PM 10 in the Greater Vitória region (ES, Brazil).

5 The RAMQAr - The location Figure 1: Geographical location of RAMQAr s stations.

6 : POLLUTION CONCENTRATIONS VARIABLES PM 10 concentrations (µg/m 3 ) Sua Camburi Carapina Laranjeiras Cariacica VVCentro Ibes VixCentro Time Time Figure 2: PM 10 concentrations of RAMQAr s stations

7 : Main topics of this talk : MOTIVATIONS FROM REAL APPLICATION. : MOTIVATIONS FROM REAL APPLICATION. There are some high levels of concentrations and long dependence among the air pollution data from AAQMN of Greater Vitória Region. High level of concentrations health impact. High level of concentrations may be outliers.

8 : Main topics of this talk : MOTIVATIONS FROM REAL APPLICATION. : MOTIVATIONS FROM REAL APPLICATION. Lemma 1 (Fajardo et al. (2009)) Suppose that y 1, y 2,..., y n is a set of time series observations and let ρ y (h) = γ y (h)/ γ y (0), then i. For m = 1 ( one outlier), lim n lim ρ y (h) = 0. ω ii. For m = 2 and T 2 = T 1 + l, such that h < T 1 < T 2 < n h, we have { { } lim limω 1 ρ 0, if h l, y (h) = n ω 2 ± ±0.5, if h = l.

9 : Main topics of this talk : MOTIVATIONS FROM REAL APPLICATION. : MOTIVATIONS FROM REAL APPLICATION. Proposition 1 (Cotta et al. (2017)) Suppose that Z 1,t, Z 2,t,..., Z n,t is a set of k-dimensional time series observations of Model 15 and m is the expected number of additive outliers as stated in (15). Let ˆρ Z ij (h) = γz ij (h)/( γii γ Z (0) jj Z (0)), for i, j = 1,..., k, then a. For m = 1 (one outlier occurring only at Z i,t ), lim plim ˆρ Z n ij (h) = 0. ω i

10 : Main topics of this talk : MOTIVATIONS FROM REAL APPLICATION. : MOTIVATIONS FROM REAL APPLICATION. Proposition 1 (cont.) b. For m = 2 (two outliers occurring at Z i,t or/and at Z j,t ) and assuming that ˆγ Z ij (h) 0, for Z i,t and Z j,t, it follows lim plim n ω i and/or ω j ˆρ Z ij (h) = 0. In (a.) and (b.), w i and w j are the magnitudes of the additive outliers occurring at position i and j.

11 A robust estimator of ACF Rousseeuw & Croux (1993) proposed a robust scale estimator function which is based on the kth order statistic of ( n 2) distances { y i y j, i < j}, and can be written as Q n (y) = c { y i y j ; i < j} (k), (1) where y = (y 1, y 2,..., y n ), c is a constant used to guarantee consistency (c = for the normal distribution), and ( n k = + 1. Rousseeuw & Croux (1993) showed that the 2)+2 4 asymptotic breakdown point of Q n ( ) is 50%, which means that the time series can be contaminated by up to half of the observations with outliers and Q n ( ) will still yield sensible estimates.

12 Robust Sample autocovariance Ma & Genton (2000) suggested the following robust sample autocovariance function γ Q (h) = 1 4 [ Q 2 n h (u + v) Q 2 n h (u v)], (2) where u and v are vectors containing the initial n h and the final n h observations, respectively. Note that, the above ACF is not necessarily positive semi-definite.

13 Robust Sample autocovariance The references below are background works which present theoretical and applied results related to the robust ACF γ Q (h) MOLINARES F. A. M., REISEN, V. A., CRIBARI NETO, Francisco. Robust estimation in Long-memory processes under additive outliers. Journal of Statistical Planning and Inference,139, , C. LÉVY-LEDUC, H. BOISTARD,, MOULINES, E. MURAD S TAQQU and REISEN, V. A. Robust estimation of the scale and the autocovariance functions in short and long-range dependence. Journal of Time Series Analysis,32 (2), Souza, I., REISEN, V. A. Franco,G. Bondon, P. The estimation and testing of the cointegration order based on the frequency domain. IN Journal of Business & Economic Statistics, REISEN, V. A., MONTE, E. Z. A.,A. M., G.C.FRANCO, SGRANCIO, MOLINARES F., BONDON, P., ZIELGELMANN, F.A. ABRAHAM,B. Fractional seasonal process with outliers to model and forecast daily average SO 2 concentrations. IN Mathematical and Computers in simulation COTTA, H., REISEN, V., BONDON, P., STUMMER, WOLFGANG. Robust estimation of covariance and correlation functions of a stationary multivariate process. IN EUSIPCO

14 Estimation Estimation and number of factor Factor Analysis - ROBUST Estimation for P and r Factor Analysis - Theoretical results : Base references Let Z t, t Z, be a k-dimensional zero-mean vector of an observed time series. Also, let x t be an unobserved r-dimensional vector of common factors. It is assumed that these series are generated by r (r k) factors, x t, plus a measurement error ɛ t as z t = Px t + ɛ t, (3) where P is a k r matrix of parameters of rank r ( factor loading matrix), and ɛ t is a k-dimensional white-noise sequence with full-rank covariance matrix Σ ɛ. Thus, all the common dynamic structure comes through the common factors, x t. Assumes that P P = I. When r is much smaller than k an effective dimension-reduction is achieved. Z t is driven by a much lower-dimension process x t.

15 Estimation Estimation Estimation and number of factor Factor Analysis - ROBUST Estimation for P and r Factor Analysis - Theoretical results : Base references The key to the inference for the model in Equation (3) is to determine the number of factors r and to estimate the k r factor loading matrix P, or more precisely the factor loading space Ω(P). Once an estimator is obtained, say, P, a natural estimator for the factor process is and the resulting residuals are x t = P z t, (4) ɛ t = (I d P P )z t. (5) The estimation of P is suggested by Lam & Yao (2012).

16 Estimation Estimation and number of factor Factor Analysis - ROBUST Estimation for P and r Factor Analysis - Theoretical results : Base references Suppose that the vector of common factors x t = (x 1,t,..., x r,t ), t Z, follows a zero-mean r-dimensional stationary vector Fractional Autoregressive Moving Average process (VARFIMA(p x, d x, q x )) given by where φ x (B)Dx [(1 B) d ]xt = θ x (B)at, (6) φ x (B) = I φ 1 B φ pb p θ x (B) = I + θ 1 B + + θ qb q are matrix polynomials in the backshift operator B, the φ s and the θ s are r r matrices, the roots of the determinant polynomial φ x (B) are all outside the unit circle, and those of θ x (B) are all outside the unit circle. In addition, a t is a sequence of r r vector Gaussian White noise with zero mean and covariance matrix Σ a.

17 Estimation Estimation and number of factor Factor Analysis - ROBUST Estimation for P and r Factor Analysis - Theoretical results : Base references Remark 1 The VARFIMA process x t, t Z, can be written as an infinite stationary second-order moving average representation as follows: x t = Ψ j a t j, (7) j=0 where the innovations a t = [a 1,t,..., a r,t] are r-dimensional martingale differences with respect to an increasing sequence of σ-fields {Ϝ t} such that for some λ > 0, sup te( a i,t 2+λ Ϝ t 1 ) <, a.s., for all i = 1,..., r. Let E(a ta t Ϝ t 1) = Σ a, a.s. The r r matrix coefficients Ψ j are often referred to as impulse responses. The main characterization of the process x t considered in this paper is that impulses responses Ψ j converge at slow hyperbolic rates as j. More precisely, there are r memory parameters d 1, d 2,..., d r, whose values lie in (0, 0.5) such that the impulse responses Ψ j can be approximated by

18 Estimation Estimation and number of factor Factor Analysis - ROBUST Estimation for P and r Factor Analysis - Theoretical results : Base references Remark 1 (cont.) Ψ j D [ ] 1 Γ(d) jd 1 Π, as j, (8) where Γ( ) is a gamma function and Π is a nonsingular r r matrix of constants that are independent of j and may be functions of a smaller set of unknown parameters. The notation D[j d 1 /Γ(j)] represents a r r diagonal matrix with j d 1 1 /Γ(d 1 ),..., j dr 1 /Γ(d r ) on the diagonal. In fact, for any univariate function f of a single variable, the notation D[f (d)] represents r r diagonal matrix with f (d 1 ),..., f (d r ) on the diagonal. Also, the notation is defined as follows: given two sequences of matrices U j and V j, as j, for i and r, where u i,r,j and v i,r,j are the (i, r)th elements of U j and of V j, respectively. Let ψ i,j and π i be the ith rows of Ψ j and Π, respectively; then Equation (8) implies that ψ i,j j d 1 1 Γ(d i ) 1 π i, as j, for all i = 1,..., r. Note that the conditions on the memory parameters d i (0, 0.5), for i = 1,..., r, ensure that the impulse responses are square-summable and the infinite sum in Equation (7) exists.

19 Estimation Estimation and number of factor Factor Analysis - ROBUST Estimation for P and r Factor Analysis - Theoretical results : Base references Remark 2 The autocovariances Γ(j) Cov(x t, x t+j ) of the process x t must also converge at hyperbolic rates as follows (Chung (2002)). Γ(j) D(j d 0.5 ).A.D(j d 0.5 ), as j, (9) where the (i, r)th element of the r r matrix A is Gamma(1 d i d r )/[Γ(d r ) Γ(1 d r )].π i Σ aπ r.

20 Estimation Estimation and number of factor Factor Analysis - ROBUST Estimation for P and r Factor Analysis - Theoretical results : Base references Remark 2 (Cont.) Hence, as j, not only do the autocovariances γ i,i (j) of each x i,t die out slowly at a hyperbolic rate, i.e, γ i,i (j) j 2d i 1.Γ(1 2d i )/[Γ(d i )Γ(1 d i )].π i Σ aπ i, the covariances γ i,r (j) between the current x i,t and the future x r,t+j, for i r, also vanish at hyperbolic rates, i.e., γ i,r (j) j d i +d r 1 Γ(1 d i d r )/[Γ(d r ) Γ(1 d r )].π i Σ aπ r. Hosking (1996) presents the result for the univariate case.

21 Estimation Estimation and number of factor Factor Analysis - ROBUST Estimation for P and r Factor Analysis - Theoretical results : Base references Lemma 2 Let z t = Px t + ɛ t as defined in Equations (3) and (6) and assume that Γ z (h) = E[z t h z t] are the covariance matrices of the process z t and Γ x (h) = E[x t h x t] are the covariance matrices for the generating vector x t. Then Γ z (0) = PΓ x (0)P + Σ ɛ, (10) Γ z (h) = PΓ x (h)p, h 1, (11) where rank(γ z (h)) = rank(γ x (h)), as h 1.

22 Estimation Estimation and number of factor Factor Analysis - ROBUST Estimation for P and r Factor Analysis - Theoretical results : Base references Lemma 3 If the factors are independent for all lags and the matrix Σ ɛ is diagonal, then a) All of the covariance matrices Γ x (h) are diagonal; b) The matrices Γ z (h) are symmetric for h 1; c) By Spectral Decomposition, the columns of P will be eigenvectors of Γ z (h) with eigenvalues γ i (h), where γ i (h) are the diagonal elements of Γ x (h).

23 Estimation Estimation and number of factor Factor Analysis - ROBUST Estimation for P and r Factor Analysis - Theoretical results : Base references Proposition 2 Suppose z t = Px t + ɛ t, where x t is a r-dimensional VARFIMA(p x, d x, q x ) process, P is a k r matrix (k r) of rank r, and ɛ t is a k-dimensional white noise sequence with covariance Σ ɛ. Then z t follows a k-dimensional VARFIMA(p z, d z, q z ) with p z = p x, d z = d x and q z = max(p x, q x ).

24 Estimation Estimation and number of factor Factor Analysis - ROBUST Estimation for P and r Factor Analysis - Theoretical results : Base references Remark 3 In Equation (6), consider y t = D x [(1 B) d ]x t. Then, if the parameters of long memory (d i ) are all equal to zero, the model presented in Equation 6 becomes the short memory model described by Peña & Box (1987), i.e., a VARMA(p, q). Thus, φ x (B)D x [(1 B) d ]x t = θ x (B)a t becomes φ y (B)y t = θ y (B)a t.

25 Estimation Estimation and number of factor Factor Analysis - ROBUST Estimation for P and r Factor Analysis - Theoretical results : Base references Estimation and test Following the same line as Lam & Yao (2012), the estimation of P if performed by an eigenanalysis on h 0 ˆM = ˆΓ z (h)ˆγ z (h), (12) h=1 where h 0 is a prescribed integer and ˆΓ z (h) denotes the sample covariance matrix of z t at lag h. ratio-based estimator for r. The estimator for the number of factors r is given by: r = argmin ˆλ i+1 /ˆλ i, (13) 1 i R where ˆλ 1... ˆλ k are the eigenvalues of M, and r < R < k is a constant. As suggested in Lam and Yao (2012), in practice, R = p/2 can be the starting point.

26 ROBUST Estimation for P and r Estimation Estimation and number of factor Factor Analysis - ROBUST Estimation for P and r Factor Analysis - Theoretical results : Base references Based on Equation 12 and on the robust ACF estimator, the robust M estimator is here suggested as M Qn = h 0 h=1 Γ z,qn (h) Γ z,qn (h). (14) where Γ z,qn (h) denotes the sample robust covariance matrix of z t at lag h. Therefore, the estimator r Qn for the number of factors is similarly obtained from Equation (13). Note that M Qn is positive semi-definite.

27 Theoretical results Estimation Estimation and number of factor Factor Analysis - ROBUST Estimation for P and r Factor Analysis - Theoretical results : Base references Proposition 3 Let h be a fixed positive integer and ( ΓQ (h)) 1 i,j p ) = ( γ Qi,j (h) 1 i,j p where γ Q i,j (h) is Robust ACF function defined previosuly. Assume that the process is short-memory, then n sup λ Q j λ j = Op (1), as n, 1 j p where ( λ Q j ) 1 j p and (λ j ) 1 j p denote the eigenvalues of ( h0 Γ ) ( h=1 Q (h) Γ Q (h) h0 and h=1 ), Γ(h)Γ(h) respectively, where (Γ(h)) 1 i,j p = (γ i,j (h)) 1 i,j p and h 0 is a fixed integer larger than 1.,

28 Theoretical results Estimation Estimation and number of factor Factor Analysis - ROBUST Estimation for P and r Factor Analysis - Theoretical results : Base references Proposition 4 Let h be a fixed positive integer and ( ΓQ (h)) 1 i,j p ) = ( γ Qi,j (h) 1 i,j p where γ Q i,j (h) is defined previously. Assume that the vector process has long-memory property, then (i) If, for all i in {1,..., k}, D i > 1/2(d i < 1/4), n sup λ Q j λ j = Op (1), as n, 1 j p (ii) If, there exists i 0 in {1,..., k} such that D i0 < 1/2(d i > 1/4), n D i 0 sup λ Q j λ j = Op (1), as n, 1 j p,

29 ( background): Estimation Estimation and number of factor Factor Analysis - ROBUST Estimation for P and r Factor Analysis - Theoretical results : Base references SGRANCIO, A., REISEN, V.A,LEVY-LEDUC, C., PASCAL, B. ZIELGELMANN, F.A., ZAMBOM, E, COTTA, H,, Robust Factor Modeling for High-Dimensional Time Series: an to Air Pollution Data. Submitted COTTA, H., REISEN, V.A., BONDON, P., STUMMER, W. Robust principal component analysis with air pollution data: EUSIPCO. Reisen, V. A, Lévy-Leduc, C., Zambon, E. Robust Factor Model for long-memory multivariate time series with application to stock market. IN REVISION. Bottoni, J Reisen, V. A, Spanny, Franco, G. E., Pascal, B. Generalized additive model with principal component analysis: An application to time series of respiratory disease and air pollution data JRSS. Zamprogno. B., Reisen, V. A,, Cotta, Bondon, P.The use of PCA in time correlated processes with short and long-memory property. An application to Air pollution data Submitted. Erik Vanhataloa and Murat Kulahcia. Impact of Autocorrelation on Principal Components and Their Use in Statistical Process Control. Quality and Reliability Engineering International

30 Simulation: Monte Carlo studies - Models Simulation: Monte Carlo studies - Models Monte Carlo experiments were conducted to analyze the effect of high-dimensional time series with additive outliers on the factor modeling and time series with long and short-memory dependency. The empirical study is divided into two cases of x t (Equation 6), which follows a VARFIMA model with r = 3: (1) short-memory process that is, x t is a VARMA process; (2) long-memory process; d = (d 1, d 2, d 3 ), for at least one d 1, d 2, d 3 (0, 0.5). The VARFIMA model was generated with independent a t from N(0, I ) and Φ coefficients, which are displayed in Table 1. The sample size is n = 50, 100, 200, 400, 800 and 1600, and k = 0.2n, 0.5n, 0.8n. Here, an only one case is presented all k r elements of matrix P were generated as independent observations from the uniform distribution on the interval [-1,1] ( simulation method was according to Lam and Yao (2012).

31 Factor Analysis - Simulations Simulation: Monte Carlo studies - Models The empirical study is divided into two cases of x t (Equation 6), which follows a VARFIMA model with r = 3: (1) short-memory process where d = (0, 0, 0) ; that is, x t is a VARMA process; (2) long-memory process where d = (d 1, d 2, d 3 ), for at least one d 1, d 2, d 3 (0, 0.5). The VARFIMA model was generated with independent a t from N(0, I ) and Φ coefficients, which are displayed in Table 1. The sample size is n = 50, 100, 200, 400, 800 and 1600, and k = 0.2n, 0.5n, 0.8n and 1.2n. Table 1: Φ matrices for VARFI(1,d ) process. Φ 1 (Model 1) Φ 1 (Model 2) Φ 1 (Model 3)

32 Factor Analysis - Simulations Simulation: Monte Carlo studies - Models Let {z t }, t = 1,..., t Z, be a vector process contaminated by additive outliers defined as follows: z t = Px t + ω δ t, (15) where is the Hadamard product. ω = [ω 1,..., ω k ] is a magnitude vector of additive outliers. δ t = [δ 1t,..., δ kt ] is a random vector indicating the occurrence of an outlier at time t, in variable k, such as P(δ k,t = 1) = P(δ k,t = 1) = p/2 and P(δ k,t = 0) = 1 p, where E[δ k,t ] = 0 and E[δ 2 k,t ] = Var(δ k,t) = p. The model described above assumes that {Z t } and {δ t } are independent processes. Also, it is assumed that the elements of δ t are not correlated and temporally uncorrelated, i.e, E(δ t δ t) = Σ δ = diag(p,..., p) and E(δ t δ t+h ) = 0 for h 0.

33 Factor Analysis - Simulations Simulation: Monte Carlo studies - Models Table 2: Relative frequency estimates for f rel. (r = 3) in the simulation with 200 replications - Model 1. ( Classical ACF): simlar results of Lam and Yao (2012) n δ = 0 k = 0.2n k = 0.5n k = 0.8n

34 Simulation: Monte Carlo studies - Simulation: Monte Carlo studies - Models Table 3: Relative frequency estimates for dimensional reduction - d = [0.1, 0.2, 0.4] and Model 1 s Φ coefficients, r=3. Γz Γz Γz,Qn Γz,Qn p = 0 p = 0.05 and ω = 15 p = 0 p = 0.05 and ω = 15 n = 100 n = 100 n = 100 n = 100 r = 1 r = 2 r = 3 r = 1 r = 2 r = 3 rqn = 1 rqn = 2 rqn = 3 rqn = 1 rqn = 2 rqn = 3 k = 0.2n k = 0.5n k = 0.8n The third column gives the simulation results using Γ z,qn when p = 0. As one can see, the r estimates using Γ z,qn present similar results of Γ z when p = 0. Both methods have the same asymptotical properties. The presence of atypical observations in the data leads to a reduction of the estimated frequencies when r = 3 for all values of k in the classical method. This does not occur when the robust estimator is utilized, the results are quite close to the ones from the first column.

35 The RAMQAr - The data to real data - Descriptive statistics to real data - Time series to real data - FA s results The application of the proposed methodology consists of applying the PCA to cluster stations with the same behavior of measured pollutants. This section presents an application of the methodology for PM 10 concentrations measured at the Air Quality Automatic Monitoring Network (AQAMN) of the Greater Vitória Region (GVR). The application was divided into two parts: 1) reduction of the dimensions, and 2) forecasting. The data are: PM 10 measured in µg/m 3 ; Daily average; The period: January 2005 to December 2009; All eight RAMQAr s stations.

36 The RAMQAr - Time series to real data - Descriptive statistics to real data - Time series to real data - FA s results Sua Cariacica Camburi VVCentro Carapina Ibes Laranjeiras VixCentro Time Time Figure 3: PM 10 s concentrations of RAMQAr s stations

37 The RAMQAr - Descriptive statistics to real data - Descriptive statistics to real data - Time series to real data - FA s results Boxplot of PM 10 concentrations (µg/m 3 ) Laranjeiras Camburi Sua VixCentro Ibes VVCentro Figure 4: Boxplot of PM 10 s of RAMQAr s stations.

38 Lag Lag Lag Lag Lag Lag Lag Lag The RAMQAr - ACFs to real data - Descriptive statistics to real data - Time series to real data - FA s results Laranjeiras Carapina Camburi Sua Robust ACF Robust ACF Robust ACF Robust ACF VixCentro Ibes VVCentro Cariacica Robust ACF Robust ACF Robust ACF Robust ACF Figure 5: PM 10 ρ Z,Qn (h) function for RAMQAr s Stations

39 to real data - Descriptive statistics to real data - Time series to real data - FA s results The RAMQAr - The Robust ACF X ACF- IBIS Robust ACF Classical ACF

40 The RAMQAr - FA s Classical ACF to real data - Descriptive statistics to real data - Time series to real data - FA s results λ i+1 λi λ i i i (a) (b) Figure 6: Plots of estimated eigenvalues (a) and ratios of estimated eigenvalues of ˆM (b). The test indicated 1 factor.

41 The RAMQAr - FA s ROBUST to real data - Descriptive statistics to real data - Time series to real data - FA s results λ i+1 λi λ i i i (a) (b) Figure 7: Plots of estimated eigenvalues (a) and the ratios of estimated eigenvalues of M Q (b). The Robust indicated 2 factors

42 to real data - Descriptive statistics to real data - Time series to real data - FA s results The RAMQAr - THE FINAL ESTIMATED MODEL The AF analysis suggests the following model for Z t (the daily PM 10 concentrations of the stations): Z t = p 1 w t + p 2 v t + ε t, where w t denotes the first factor, v t is the second factor of solution Ẑ = ˆP ˆX, and εt is a vector white-noise process.

43 Main A robust factor model for high-dimensional time series with short and long-memory and additive outliers is proposed. This study considered the effects of different correlation structures and additive outliers on a vector linear process and its implication in the analysis and interpretation of Factor Analysis calculated from the correlation matrix of this process; It was shown that the existence of outliers destroys the correlation and cross-correlation of a vector time series; This article applied the proposed methodology to identify pollution behavior for the pollutant PM 10 in the Greater Region of Vitória to enable better management of the local monitoring network. The results in this paper will hopefully stimulate further research on using robust estimation methods and long-memory models to represent and forecast environmental time series.

44 Thanks!!!

45 Chung, C. (2002), Sample means, sample autocovariances, and linear regression of stationary multivariate long memory processes, Econometric Theory 18, Cotta, H. H. A., Reisen, V. A., Bondon, P., Stummer, W. & Lévy-Leduc, C. (2017), Robust estimation of covariance and correlation functions of a stationary multivariate process, in to apper insignal Processing Conference (EUSIPCO), rd European, IEEE. Fajardo, F., Reisen, V. A. & Cribari-Neto, F. (2009), Robust estimation in long-memory processes under additive outliers, Journal of Statistical Planning and Inference 139, Hosking, J. R. (1996), Asymptotic distributions of the sample mean, autocovariances, and autocorrelations of long-memory time series, Journal of Econometrics 73(1), Lam, C. & Yao, Q. (2012), Factor modeling for high-dimensional time series: Inference for the number of factors, Ann. Statist. 40(2), URL: Ma, Y. & Genton, M. G. (2000), Highly robust estimation of the autocovariance function, Journal of Time Series Analysis 21(6), Peña, D. & Box, G. E. P. (1987), Identifying a simplifying structure in time series, Journal of the American Statistical Association 82(399), pp URL:

Robust estimation in time series

Robust estimation in time series Robust estimation in time series V. A. Reisen NuMes, D.E; Universidade Federal do Espirito Santo, Brazil. 20 de setembro de 2011 Contents Abstract Introduction-Co-authors references Introduction-Examples

More information

An application of the GAM-PCA-VAR model to respiratory disease and air pollution data

An application of the GAM-PCA-VAR model to respiratory disease and air pollution data An application of the GAM-PCA-VAR model to respiratory disease and air pollution data Márton Ispány 1 Faculty of Informatics, University of Debrecen Hungary Joint work with Juliana Bottoni de Souza, Valdério

More information

PERIODIC ARMA MODELS: APPLICATION TO PARTICULATE MATTER CONCENTRATIONS

PERIODIC ARMA MODELS: APPLICATION TO PARTICULATE MATTER CONCENTRATIONS PERIODIC ARMA MODELS: APPLICATION TO PARTICULATE MATTER CONCENTRATIONS A. J. Q. Sarnaglia, V. A. Reisen, P. Bondon Federal University of Espírito Santo, Department of Statistics, Vitória, ES, Brazil Federal

More information

LARGE SAMPLE BEHAVIOR OF SOME WELL-KNOWN ROBUST ESTIMATORS UNDER LONG-RANGE DEPENDENCE

LARGE SAMPLE BEHAVIOR OF SOME WELL-KNOWN ROBUST ESTIMATORS UNDER LONG-RANGE DEPENDENCE LARGE SAMPLE BEHAVIOR OF SOME WELL-KNOWN ROBUST ESTIMATORS UNDER LONG-RANGE DEPENDENCE C. LÉVY-LEDUC, H. BOISTARD, E. MOULINES, M. S. TAQQU, AND V. A. REISEN Abstract. The paper concerns robust location

More information

Long-range dependence

Long-range dependence Long-range dependence Kechagias Stefanos University of North Carolina at Chapel Hill May 23, 2013 Kechagias Stefanos (UNC) Long-range dependence May 23, 2013 1 / 45 Outline 1 Introduction to time series

More information

Factor Modelling for Time Series: a dimension reduction approach

Factor Modelling for Time Series: a dimension reduction approach Factor Modelling for Time Series: a dimension reduction approach Clifford Lam and Qiwei Yao Department of Statistics London School of Economics q.yao@lse.ac.uk p.1 Econometric factor models: a brief survey

More information

STAT 443 Final Exam Review. 1 Basic Definitions. 2 Statistical Tests. L A TEXer: W. Kong

STAT 443 Final Exam Review. 1 Basic Definitions. 2 Statistical Tests. L A TEXer: W. Kong STAT 443 Final Exam Review L A TEXer: W Kong 1 Basic Definitions Definition 11 The time series {X t } with E[X 2 t ] < is said to be weakly stationary if: 1 µ X (t) = E[X t ] is independent of t 2 γ X

More information

ECON 4160, Spring term Lecture 12

ECON 4160, Spring term Lecture 12 ECON 4160, Spring term 2013. Lecture 12 Non-stationarity and co-integration 2/2 Ragnar Nymoen Department of Economics 13 Nov 2013 1 / 53 Introduction I So far we have considered: Stationary VAR, with deterministic

More information

Multivariate Time Series Analysis and Its Applications [Tsay (2005), chapter 8]

Multivariate Time Series Analysis and Its Applications [Tsay (2005), chapter 8] 1 Multivariate Time Series Analysis and Its Applications [Tsay (2005), chapter 8] Insights: Price movements in one market can spread easily and instantly to another market [economic globalization and internet

More information

Notes on Time Series Modeling

Notes on Time Series Modeling Notes on Time Series Modeling Garey Ramey University of California, San Diego January 17 1 Stationary processes De nition A stochastic process is any set of random variables y t indexed by t T : fy t g

More information

ECON 4160, Lecture 11 and 12

ECON 4160, Lecture 11 and 12 ECON 4160, 2016. Lecture 11 and 12 Co-integration Ragnar Nymoen Department of Economics 9 November 2017 1 / 43 Introduction I So far we have considered: Stationary VAR ( no unit roots ) Standard inference

More information

Thomas J. Fisher. Research Statement. Preliminary Results

Thomas J. Fisher. Research Statement. Preliminary Results Thomas J. Fisher Research Statement Preliminary Results Many applications of modern statistics involve a large number of measurements and can be considered in a linear algebra framework. In many of these

More information

Econometría 2: Análisis de series de Tiempo

Econometría 2: Análisis de series de Tiempo Econometría 2: Análisis de series de Tiempo Karoll GOMEZ kgomezp@unal.edu.co http://karollgomez.wordpress.com Segundo semestre 2016 IX. Vector Time Series Models VARMA Models A. 1. Motivation: The vector

More information

Single Equation Linear GMM with Serially Correlated Moment Conditions

Single Equation Linear GMM with Serially Correlated Moment Conditions Single Equation Linear GMM with Serially Correlated Moment Conditions Eric Zivot November 2, 2011 Univariate Time Series Let {y t } be an ergodic-stationary time series with E[y t ]=μ and var(y t )

More information

Assessing the dependence of high-dimensional time series via sample autocovariances and correlations

Assessing the dependence of high-dimensional time series via sample autocovariances and correlations Assessing the dependence of high-dimensional time series via sample autocovariances and correlations Johannes Heiny University of Aarhus Joint work with Thomas Mikosch (Copenhagen), Richard Davis (Columbia),

More information

On the robustness of cointegration tests when series are fractionally integrated

On the robustness of cointegration tests when series are fractionally integrated On the robustness of cointegration tests when series are fractionally integrated JESUS GONZALO 1 &TAE-HWYLEE 2, 1 Universidad Carlos III de Madrid, Spain and 2 University of California, Riverside, USA

More information

Multivariate Time Series: VAR(p) Processes and Models

Multivariate Time Series: VAR(p) Processes and Models Multivariate Time Series: VAR(p) Processes and Models A VAR(p) model, for p > 0 is X t = φ 0 + Φ 1 X t 1 + + Φ p X t p + A t, where X t, φ 0, and X t i are k-vectors, Φ 1,..., Φ p are k k matrices, with

More information

5: MULTIVARATE STATIONARY PROCESSES

5: MULTIVARATE STATIONARY PROCESSES 5: MULTIVARATE STATIONARY PROCESSES 1 1 Some Preliminary Definitions and Concepts Random Vector: A vector X = (X 1,..., X n ) whose components are scalarvalued random variables on the same probability

More information

Cointegrated VARIMA models: specification and. simulation

Cointegrated VARIMA models: specification and. simulation Cointegrated VARIMA models: specification and simulation José L. Gallego and Carlos Díaz Universidad de Cantabria. Abstract In this note we show how specify cointegrated vector autoregressive-moving average

More information

An algorithm for robust fitting of autoregressive models Dimitris N. Politis

An algorithm for robust fitting of autoregressive models Dimitris N. Politis An algorithm for robust fitting of autoregressive models Dimitris N. Politis Abstract: An algorithm for robust fitting of AR models is given, based on a linear regression idea. The new method appears to

More information

FACTOR MODELING FOR HIGH-DIMENSIONAL TIME SERIES: INFERENCE FOR THE NUMBER OF FACTORS 1

FACTOR MODELING FOR HIGH-DIMENSIONAL TIME SERIES: INFERENCE FOR THE NUMBER OF FACTORS 1 The Annals of Statistics 2012, Vol. 40, No. 2, 694 726 DOI: 10.1214/12-AOS970 Institute of Mathematical Statistics, 2012 FACTOR MODELING FOR HIGH-DIMENSIONAL TIME SERIES: INFERENCE FOR THE NUMBER OF FACTORS

More information

TIME SERIES AND FORECASTING. Luca Gambetti UAB, Barcelona GSE Master in Macroeconomic Policy and Financial Markets

TIME SERIES AND FORECASTING. Luca Gambetti UAB, Barcelona GSE Master in Macroeconomic Policy and Financial Markets TIME SERIES AND FORECASTING Luca Gambetti UAB, Barcelona GSE 2014-2015 Master in Macroeconomic Policy and Financial Markets 1 Contacts Prof.: Luca Gambetti Office: B3-1130 Edifici B Office hours: email:

More information

Vector autoregressions, VAR

Vector autoregressions, VAR 1 / 45 Vector autoregressions, VAR Chapter 2 Financial Econometrics Michael Hauser WS17/18 2 / 45 Content Cross-correlations VAR model in standard/reduced form Properties of VAR(1), VAR(p) Structural VAR,

More information

Detection of structural breaks in multivariate time series

Detection of structural breaks in multivariate time series Detection of structural breaks in multivariate time series Holger Dette, Ruhr-Universität Bochum Philip Preuß, Ruhr-Universität Bochum Ruprecht Puchstein, Ruhr-Universität Bochum January 14, 2014 Outline

More information

LECTURE 10 LINEAR PROCESSES II: SPECTRAL DENSITY, LAG OPERATOR, ARMA. In this lecture, we continue to discuss covariance stationary processes.

LECTURE 10 LINEAR PROCESSES II: SPECTRAL DENSITY, LAG OPERATOR, ARMA. In this lecture, we continue to discuss covariance stationary processes. MAY, 0 LECTURE 0 LINEAR PROCESSES II: SPECTRAL DENSITY, LAG OPERATOR, ARMA In this lecture, we continue to discuss covariance stationary processes. Spectral density Gourieroux and Monfort 990), Ch. 5;

More information

Nonlinear time series

Nonlinear time series Based on the book by Fan/Yao: Nonlinear Time Series Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna October 27, 2009 Outline Characteristics of

More information

Time Series Analysis

Time Series Analysis Time Series Analysis hm@imm.dtu.dk Informatics and Mathematical Modelling Technical University of Denmark DK-2800 Kgs. Lyngby 1 Outline of the lecture Chapter 9 Multivariate time series 2 Transfer function

More information

Single Equation Linear GMM with Serially Correlated Moment Conditions

Single Equation Linear GMM with Serially Correlated Moment Conditions Single Equation Linear GMM with Serially Correlated Moment Conditions Eric Zivot October 28, 2009 Univariate Time Series Let {y t } be an ergodic-stationary time series with E[y t ]=μ and var(y t )

More information

Statistics of stochastic processes

Statistics of stochastic processes Introduction Statistics of stochastic processes Generally statistics is performed on observations y 1,..., y n assumed to be realizations of independent random variables Y 1,..., Y n. 14 settembre 2014

More information

Advanced Econometrics

Advanced Econometrics Based on the textbook by Verbeek: A Guide to Modern Econometrics Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna May 2, 2013 Outline Univariate

More information

ECO 513 Fall 2009 C. Sims CONDITIONAL EXPECTATION; STOCHASTIC PROCESSES

ECO 513 Fall 2009 C. Sims CONDITIONAL EXPECTATION; STOCHASTIC PROCESSES ECO 513 Fall 2009 C. Sims CONDIIONAL EXPECAION; SOCHASIC PROCESSES 1. HREE EXAMPLES OF SOCHASIC PROCESSES (I) X t has three possible time paths. With probability.5 X t t, with probability.25 X t t, and

More information

7. MULTIVARATE STATIONARY PROCESSES

7. MULTIVARATE STATIONARY PROCESSES 7. MULTIVARATE STATIONARY PROCESSES 1 1 Some Preliminary Definitions and Concepts Random Vector: A vector X = (X 1,..., X n ) whose components are scalar-valued random variables on the same probability

More information

Lecture 1: Fundamental concepts in Time Series Analysis (part 2)

Lecture 1: Fundamental concepts in Time Series Analysis (part 2) Lecture 1: Fundamental concepts in Time Series Analysis (part 2) Florian Pelgrin University of Lausanne, École des HEC Department of mathematics (IMEA-Nice) Sept. 2011 - Jan. 2012 Florian Pelgrin (HEC)

More information

Part III Example Sheet 1 - Solutions YC/Lent 2015 Comments and corrections should be ed to

Part III Example Sheet 1 - Solutions YC/Lent 2015 Comments and corrections should be  ed to TIME SERIES Part III Example Sheet 1 - Solutions YC/Lent 2015 Comments and corrections should be emailed to Y.Chen@statslab.cam.ac.uk. 1. Let {X t } be a weakly stationary process with mean zero and let

More information

1 Teaching notes on structural VARs.

1 Teaching notes on structural VARs. Bent E. Sørensen February 22, 2007 1 Teaching notes on structural VARs. 1.1 Vector MA models: 1.1.1 Probability theory The simplest (to analyze, estimation is a different matter) time series models are

More information

Multivariate modelling of long memory processes with common components

Multivariate modelling of long memory processes with common components Multivariate modelling of long memory processes with common components Claudio Morana University of Piemonte Orientale, International Centre for Economic Research (ICER), and Michigan State University

More information

Cointegrated VAR s. Eduardo Rossi University of Pavia. November Rossi Cointegrated VAR s Financial Econometrics / 56

Cointegrated VAR s. Eduardo Rossi University of Pavia. November Rossi Cointegrated VAR s Financial Econometrics / 56 Cointegrated VAR s Eduardo Rossi University of Pavia November 2013 Rossi Cointegrated VAR s Financial Econometrics - 2013 1 / 56 VAR y t = (y 1t,..., y nt ) is (n 1) vector. y t VAR(p): Φ(L)y t = ɛ t The

More information

Robust Dickey-Fuller tests based on ranks for time series with additive outliers

Robust Dickey-Fuller tests based on ranks for time series with additive outliers Robust Dickey-Fuller tests based on ranks for time series with additive outliers V. A. Reisen, C. Lévy-Leduc, M. Bourguignon, H. Boistard July 3, 0 Abstract In this paper the unit root tests proposed by

More information

Asymptotic distribution of GMM Estimator

Asymptotic distribution of GMM Estimator Asymptotic distribution of GMM Estimator Eduardo Rossi University of Pavia Econometria finanziaria 2010 Rossi (2010) GMM 2010 1 / 45 Outline 1 Asymptotic Normality of the GMM Estimator 2 Long Run Covariance

More information

1 Linear Difference Equations

1 Linear Difference Equations ARMA Handout Jialin Yu 1 Linear Difference Equations First order systems Let {ε t } t=1 denote an input sequence and {y t} t=1 sequence generated by denote an output y t = φy t 1 + ε t t = 1, 2,... with

More information

Multivariate Time Series

Multivariate Time Series Multivariate Time Series Notation: I do not use boldface (or anything else) to distinguish vectors from scalars. Tsay (and many other writers) do. I denote a multivariate stochastic process in the form

More information

Multivariate ARMA Processes

Multivariate ARMA Processes LECTURE 8 Multivariate ARMA Processes A vector y(t) of n elements is said to follow an n-variate ARMA process of orders p and q if it satisfies the equation (1) A 0 y(t) + A 1 y(t 1) + + A p y(t p) = M

More information

Time Series Outlier Detection

Time Series Outlier Detection Time Series Outlier Detection Tingyi Zhu July 28, 2016 Tingyi Zhu Time Series Outlier Detection July 28, 2016 1 / 42 Outline Time Series Basics Outliers Detection in Single Time Series Outlier Series Detection

More information

Vector Auto-Regressive Models

Vector Auto-Regressive Models Vector Auto-Regressive Models Laurent Ferrara 1 1 University of Paris Nanterre M2 Oct. 2018 Overview of the presentation 1. Vector Auto-Regressions Definition Estimation Testing 2. Impulse responses functions

More information

3. ARMA Modeling. Now: Important class of stationary processes

3. ARMA Modeling. Now: Important class of stationary processes 3. ARMA Modeling Now: Important class of stationary processes Definition 3.1: (ARMA(p, q) process) Let {ɛ t } t Z WN(0, σ 2 ) be a white noise process. The process {X t } t Z is called AutoRegressive-Moving-Average

More information

Heteroskedasticity; Step Changes; VARMA models; Likelihood ratio test statistic; Cusum statistic.

Heteroskedasticity; Step Changes; VARMA models; Likelihood ratio test statistic; Cusum statistic. 47 3!,57 Statistics and Econometrics Series 5 Febrary 24 Departamento de Estadística y Econometría Universidad Carlos III de Madrid Calle Madrid, 126 2893 Getafe (Spain) Fax (34) 91 624-98-49 VARIANCE

More information

Covariance Stationary Time Series. Example: Independent White Noise (IWN(0,σ 2 )) Y t = ε t, ε t iid N(0,σ 2 )

Covariance Stationary Time Series. Example: Independent White Noise (IWN(0,σ 2 )) Y t = ε t, ε t iid N(0,σ 2 ) Covariance Stationary Time Series Stochastic Process: sequence of rv s ordered by time {Y t } {...,Y 1,Y 0,Y 1,...} Defn: {Y t } is covariance stationary if E[Y t ]μ for all t cov(y t,y t j )E[(Y t μ)(y

More information

VAR Models and Applications

VAR Models and Applications VAR Models and Applications Laurent Ferrara 1 1 University of Paris West M2 EIPMC Oct. 2016 Overview of the presentation 1. Vector Auto-Regressions Definition Estimation Testing 2. Impulse responses functions

More information

If we want to analyze experimental or simulated data we might encounter the following tasks:

If we want to analyze experimental or simulated data we might encounter the following tasks: Chapter 1 Introduction If we want to analyze experimental or simulated data we might encounter the following tasks: Characterization of the source of the signal and diagnosis Studying dependencies Prediction

More information

Empirical properties of large covariance matrices in finance

Empirical properties of large covariance matrices in finance Empirical properties of large covariance matrices in finance Ex: RiskMetrics Group, Geneva Since 2010: Swissquote, Gland December 2009 Covariance and large random matrices Many problems in finance require

More information

A time series is called strictly stationary if the joint distribution of every collection (Y t

A time series is called strictly stationary if the joint distribution of every collection (Y t 5 Time series A time series is a set of observations recorded over time. You can think for example at the GDP of a country over the years (or quarters) or the hourly measurements of temperature over a

More information

Time Series Models and Inference. James L. Powell Department of Economics University of California, Berkeley

Time Series Models and Inference. James L. Powell Department of Economics University of California, Berkeley Time Series Models and Inference James L. Powell Department of Economics University of California, Berkeley Overview In contrast to the classical linear regression model, in which the components of the

More information

X t = a t + r t, (7.1)

X t = a t + r t, (7.1) Chapter 7 State Space Models 71 Introduction State Space models, developed over the past 10 20 years, are alternative models for time series They include both the ARIMA models of Chapters 3 6 and the Classical

More information

2. Multivariate ARMA

2. Multivariate ARMA 2. Multivariate ARMA JEM 140: Quantitative Multivariate Finance IES, Charles University, Prague Summer 2018 JEM 140 () 2. Multivariate ARMA Summer 2018 1 / 19 Multivariate AR I Let r t = (r 1t,..., r kt

More information

B y t = γ 0 + Γ 1 y t + ε t B(L) y t = γ 0 + ε t ε t iid (0, D) D is diagonal

B y t = γ 0 + Γ 1 y t + ε t B(L) y t = γ 0 + ε t ε t iid (0, D) D is diagonal Structural VAR Modeling for I(1) Data that is Not Cointegrated Assume y t =(y 1t,y 2t ) 0 be I(1) and not cointegrated. That is, y 1t and y 2t are both I(1) and there is no linear combination of y 1t and

More information

Exercises - Time series analysis

Exercises - Time series analysis Descriptive analysis of a time series (1) Estimate the trend of the series of gasoline consumption in Spain using a straight line in the period from 1945 to 1995 and generate forecasts for 24 months. Compare

More information

On singular values distribution of a matrix large auto-covariance in the ultra-dimensional regime. Title

On singular values distribution of a matrix large auto-covariance in the ultra-dimensional regime. Title itle On singular values distribution of a matrix large auto-covariance in the ultra-dimensional regime Authors Wang, Q; Yao, JJ Citation Random Matrices: heory and Applications, 205, v. 4, p. article no.

More information

1 Data Arrays and Decompositions

1 Data Arrays and Decompositions 1 Data Arrays and Decompositions 1.1 Variance Matrices and Eigenstructure Consider a p p positive definite and symmetric matrix V - a model parameter or a sample variance matrix. The eigenstructure is

More information

LECTURES 2-3 : Stochastic Processes, Autocorrelation function. Stationarity.

LECTURES 2-3 : Stochastic Processes, Autocorrelation function. Stationarity. LECTURES 2-3 : Stochastic Processes, Autocorrelation function. Stationarity. Important points of Lecture 1: A time series {X t } is a series of observations taken sequentially over time: x t is an observation

More information

New Introduction to Multiple Time Series Analysis

New Introduction to Multiple Time Series Analysis Helmut Lütkepohl New Introduction to Multiple Time Series Analysis With 49 Figures and 36 Tables Springer Contents 1 Introduction 1 1.1 Objectives of Analyzing Multiple Time Series 1 1.2 Some Basics 2

More information

Econ 623 Econometrics II Topic 2: Stationary Time Series

Econ 623 Econometrics II Topic 2: Stationary Time Series 1 Introduction Econ 623 Econometrics II Topic 2: Stationary Time Series In the regression model we can model the error term as an autoregression AR(1) process. That is, we can use the past value of the

More information

Intro VEC and BEKK Example Factor Models Cond Var and Cor Application Ref 4. MGARCH

Intro VEC and BEKK Example Factor Models Cond Var and Cor Application Ref 4. MGARCH ntro VEC and BEKK Example Factor Models Cond Var and Cor Application Ref 4. MGARCH JEM 140: Quantitative Multivariate Finance ES, Charles University, Prague Summer 2018 JEM 140 () 4. MGARCH Summer 2018

More information

You must continuously work on this project over the course of four weeks.

You must continuously work on this project over the course of four weeks. The project Five project topics are described below. You should choose one the projects. Maximum of two people per project is allowed. If two people are working on a topic they are expected to do double

More information

High Dimensional Covariance and Precision Matrix Estimation

High Dimensional Covariance and Precision Matrix Estimation High Dimensional Covariance and Precision Matrix Estimation Wei Wang Washington University in St. Louis Thursday 23 rd February, 2017 Wei Wang (Washington University in St. Louis) High Dimensional Covariance

More information

Chapter 4: Factor Analysis

Chapter 4: Factor Analysis Chapter 4: Factor Analysis In many studies, we may not be able to measure directly the variables of interest. We can merely collect data on other variables which may be related to the variables of interest.

More information

Title. Description. var intro Introduction to vector autoregressive models

Title. Description. var intro Introduction to vector autoregressive models Title var intro Introduction to vector autoregressive models Description Stata has a suite of commands for fitting, forecasting, interpreting, and performing inference on vector autoregressive (VAR) models

More information

1. Fundamental concepts

1. Fundamental concepts . Fundamental concepts A time series is a sequence of data points, measured typically at successive times spaced at uniform intervals. Time series are used in such fields as statistics, signal processing

More information

Problem Set 1 Solution Sketches Time Series Analysis Spring 2010

Problem Set 1 Solution Sketches Time Series Analysis Spring 2010 Problem Set 1 Solution Sketches Time Series Analysis Spring 2010 1. Construct a martingale difference process that is not weakly stationary. Simplest e.g.: Let Y t be a sequence of independent, non-identically

More information

1.4 Properties of the autocovariance for stationary time-series

1.4 Properties of the autocovariance for stationary time-series 1.4 Properties of the autocovariance for stationary time-series In general, for a stationary time-series, (i) The variance is given by (0) = E((X t µ) 2 ) 0. (ii) (h) apple (0) for all h 2 Z. ThisfollowsbyCauchy-Schwarzas

More information

The largest eigenvalues of the sample covariance matrix. in the heavy-tail case

The largest eigenvalues of the sample covariance matrix. in the heavy-tail case The largest eigenvalues of the sample covariance matrix 1 in the heavy-tail case Thomas Mikosch University of Copenhagen Joint work with Richard A. Davis (Columbia NY), Johannes Heiny (Aarhus University)

More information

Forecasting 1 to h steps ahead using partial least squares

Forecasting 1 to h steps ahead using partial least squares Forecasting 1 to h steps ahead using partial least squares Philip Hans Franses Econometric Institute, Erasmus University Rotterdam November 10, 2006 Econometric Institute Report 2006-47 I thank Dick van

More information

Robust scale estimation with extensions

Robust scale estimation with extensions Robust scale estimation with extensions Garth Tarr, Samuel Müller and Neville Weber School of Mathematics and Statistics THE UNIVERSITY OF SYDNEY Outline The robust scale estimator P n Robust covariance

More information

Akaike criterion: Kullback-Leibler discrepancy

Akaike criterion: Kullback-Leibler discrepancy Model choice. Akaike s criterion Akaike criterion: Kullback-Leibler discrepancy Given a family of probability densities {f ( ; ψ), ψ Ψ}, Kullback-Leibler s index of f ( ; ψ) relative to f ( ; θ) is (ψ

More information

1 Teaching notes on structural VARs.

1 Teaching notes on structural VARs. Bent E. Sørensen November 8, 2016 1 Teaching notes on structural VARs. 1.1 Vector MA models: 1.1.1 Probability theory The simplest to analyze, estimation is a different matter time series models are the

More information

AR, MA and ARMA models

AR, MA and ARMA models AR, MA and AR by Hedibert Lopes P Based on Tsay s Analysis of Financial Time Series (3rd edition) P 1 Stationarity 2 3 4 5 6 7 P 8 9 10 11 Outline P Linear Time Series Analysis and Its Applications For

More information

A Multiple Testing Approach to the Regularisation of Large Sample Correlation Matrices

A Multiple Testing Approach to the Regularisation of Large Sample Correlation Matrices A Multiple Testing Approach to the Regularisation of Large Sample Correlation Matrices Natalia Bailey 1 M. Hashem Pesaran 2 L. Vanessa Smith 3 1 Department of Econometrics & Business Statistics, Monash

More information

Stochastic Processes

Stochastic Processes Stochastic Processes Stochastic Process Non Formal Definition: Non formal: A stochastic process (random process) is the opposite of a deterministic process such as one defined by a differential equation.

More information

Understanding Regressions with Observations Collected at High Frequency over Long Span

Understanding Regressions with Observations Collected at High Frequency over Long Span Understanding Regressions with Observations Collected at High Frequency over Long Span Yoosoon Chang Department of Economics, Indiana University Joon Y. Park Department of Economics, Indiana University

More information

Time Series Analysis. Correlated Errors in the Parameters Estimation of the ARFIMA Model: A Simulated Study

Time Series Analysis. Correlated Errors in the Parameters Estimation of the ARFIMA Model: A Simulated Study Communications in Statistics Simulation and Computation, 35: 789 802, 2006 Copyright Taylor & Francis Group, LLC ISSN: 0361-0918 print/1532-4141 online DOI: 10.1080/03610910600716928 Time Series Analysis

More information

CONTROL CHARTS FOR MULTIVARIATE NONLINEAR TIME SERIES

CONTROL CHARTS FOR MULTIVARIATE NONLINEAR TIME SERIES REVSTAT Statistical Journal Volume 13, Number, June 015, 131 144 CONTROL CHARTS FOR MULTIVARIATE NONLINEAR TIME SERIES Authors: Robert Garthoff Department of Statistics, European University, Große Scharrnstr.

More information

Unit Roots in White Noise?!

Unit Roots in White Noise?! Unit Roots in White Noise?! A.Onatski and H. Uhlig September 26, 2008 Abstract We show that the empirical distribution of the roots of the vector auto-regression of order n fitted to T observations of

More information

A Modified Fractionally Co-integrated VAR for Predicting Returns

A Modified Fractionally Co-integrated VAR for Predicting Returns A Modified Fractionally Co-integrated VAR for Predicting Returns Xingzhi Yao Marwan Izzeldin Department of Economics, Lancaster University 13 December 215 Yao & Izzeldin (Lancaster University) CFE (215)

More information

Econometric Forecasting

Econometric Forecasting Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna October 1, 2014 Outline Introduction Model-free extrapolation Univariate time-series models Trend

More information

The autocorrelation and autocovariance functions - helpful tools in the modelling problem

The autocorrelation and autocovariance functions - helpful tools in the modelling problem The autocorrelation and autocovariance functions - helpful tools in the modelling problem J. Nowicka-Zagrajek A. Wy lomańska Institute of Mathematics and Computer Science Wroc law University of Technology,

More information

Booth School of Business, University of Chicago Business 41914, Spring Quarter 2017, Mr. Ruey S. Tsay Midterm

Booth School of Business, University of Chicago Business 41914, Spring Quarter 2017, Mr. Ruey S. Tsay Midterm Booth School of Business, University of Chicago Business 41914, Spring Quarter 2017, Mr. Ruey S. Tsay Midterm Chicago Booth Honor Code: I pledge my honor that I have not violated the Honor Code during

More information

Nonlinear Time Series Modeling

Nonlinear Time Series Modeling Nonlinear Time Series Modeling Part II: Time Series Models in Finance Richard A. Davis Colorado State University (http://www.stat.colostate.edu/~rdavis/lectures) MaPhySto Workshop Copenhagen September

More information

Stochastic volatility models: tails and memory

Stochastic volatility models: tails and memory : tails and memory Rafa l Kulik and Philippe Soulier Conference in honour of Prof. Murad Taqqu 19 April 2012 Rafa l Kulik and Philippe Soulier Plan Model assumptions; Limit theorems for partial sums and

More information

Lecture 2: ARMA(p,q) models (part 2)

Lecture 2: ARMA(p,q) models (part 2) Lecture 2: ARMA(p,q) models (part 2) Florian Pelgrin University of Lausanne, École des HEC Department of mathematics (IMEA-Nice) Sept. 2011 - Jan. 2012 Florian Pelgrin (HEC) Univariate time series Sept.

More information

9. Multivariate Linear Time Series (II). MA6622, Ernesto Mordecki, CityU, HK, 2006.

9. Multivariate Linear Time Series (II). MA6622, Ernesto Mordecki, CityU, HK, 2006. 9. Multivariate Linear Time Series (II). MA6622, Ernesto Mordecki, CityU, HK, 2006. References for this Lecture: Introduction to Time Series and Forecasting. P.J. Brockwell and R. A. Davis, Springer Texts

More information

Long Memory through Marginalization

Long Memory through Marginalization Long Memory through Marginalization Hidden & Ignored Cross-Section Dependence Guillaume Chevillon ESSEC Business School (CREAR) and CREST joint with Alain Hecq and Sébastien Laurent Maastricht University

More information

Estimating Econometric Models through Matrix Equations

Estimating Econometric Models through Matrix Equations Estimating Econometric Models through Matrix Equations Federico Poloni 1 Giacomo Sbrana 2 1 U Pisa, Dept of Computer Science 2 Rouen Business School, France No Free Lunch Seminar SNS, Pisa, February 2013

More information

Part II. Time Series

Part II. Time Series Part II Time Series 12 Introduction This Part is mainly a summary of the book of Brockwell and Davis (2002). Additionally the textbook Shumway and Stoffer (2010) can be recommended. 1 Our purpose is to

More information

Time Series I Time Domain Methods

Time Series I Time Domain Methods Astrostatistics Summer School Penn State University University Park, PA 16802 May 21, 2007 Overview Filtering and the Likelihood Function Time series is the study of data consisting of a sequence of DEPENDENT

More information

Econometrics II. Seppo Pynnönen. Spring Department of Mathematics and Statistics, University of Vaasa, Finland

Econometrics II. Seppo Pynnönen. Spring Department of Mathematics and Statistics, University of Vaasa, Finland Department of Mathematics and Statistics, University of Vaasa, Finland Spring 218 Part VI Vector Autoregression As of Feb 21, 218 1 Vector Autoregression (VAR) Background The Model Defining the order of

More information

Bootstrapping high dimensional vector: interplay between dependence and dimensionality

Bootstrapping high dimensional vector: interplay between dependence and dimensionality Bootstrapping high dimensional vector: interplay between dependence and dimensionality Xianyang Zhang Joint work with Guang Cheng University of Missouri-Columbia LDHD: Transition Workshop, 2014 Xianyang

More information

Dynamic Time Series Regression: A Panacea for Spurious Correlations

Dynamic Time Series Regression: A Panacea for Spurious Correlations International Journal of Scientific and Research Publications, Volume 6, Issue 10, October 2016 337 Dynamic Time Series Regression: A Panacea for Spurious Correlations Emmanuel Alphonsus Akpan *, Imoh

More information

Unit roots in vector time series. Scalar autoregression True model: y t 1 y t1 2 y t2 p y tp t Estimated model: y t c y t1 1 y t1 2 y t2

Unit roots in vector time series. Scalar autoregression True model: y t 1 y t1 2 y t2 p y tp t Estimated model: y t c y t1 1 y t1 2 y t2 Unit roots in vector time series A. Vector autoregressions with unit roots Scalar autoregression True model: y t y t y t p y tp t Estimated model: y t c y t y t y t p y tp t Results: T j j is asymptotically

More information

NOTES AND PROBLEMS IMPULSE RESPONSES OF FRACTIONALLY INTEGRATED PROCESSES WITH LONG MEMORY

NOTES AND PROBLEMS IMPULSE RESPONSES OF FRACTIONALLY INTEGRATED PROCESSES WITH LONG MEMORY Econometric Theory, 26, 2010, 1855 1861. doi:10.1017/s0266466610000216 NOTES AND PROBLEMS IMPULSE RESPONSES OF FRACTIONALLY INTEGRATED PROCESSES WITH LONG MEMORY UWE HASSLER Goethe-Universität Frankfurt

More information

A Non-Parametric Approach of Heteroskedasticity Robust Estimation of Vector-Autoregressive (VAR) Models

A Non-Parametric Approach of Heteroskedasticity Robust Estimation of Vector-Autoregressive (VAR) Models Journal of Finance and Investment Analysis, vol.1, no.1, 2012, 55-67 ISSN: 2241-0988 (print version), 2241-0996 (online) International Scientific Press, 2012 A Non-Parametric Approach of Heteroskedasticity

More information

Statistics 910, #5 1. Regression Methods

Statistics 910, #5 1. Regression Methods Statistics 910, #5 1 Overview Regression Methods 1. Idea: effects of dependence 2. Examples of estimation (in R) 3. Review of regression 4. Comparisons and relative efficiencies Idea Decomposition Well-known

More information