Robust Testing and Variable Selection for High-Dimensional Time Series
|
|
- Lillian Horton
- 5 years ago
- Views:
Transcription
1 Robust Testing and Variable Selection for High-Dimensional Time Series Ruey S. Tsay Booth School of Business, University of Chicago May, 2017 Ruey S. Tsay HTS 1 / 36
2 Outline 1 Focus on high-dimensional linear time series 2 Basic theory: Extreme value theory in the domain of Gumble distribution 3 Testing for serial correlations 4 Finite-sample adjustments and simulations 5 A simple example 6 Variable selection: statistics and procedure 7 Simulation and comparison Ruey S. Tsay HTS 2 / 36
3 Objectives Part of an ongoing project on analysis of big dependent data 1 Develop statistical methods for analysis of high-dimensional time series 2 Focus on simple methods if possible 3 Make analysis of big dependent data easy, including statistical inference. Ruey S. Tsay HTS 3 / 36
4 Basic Theory Extreme Value Theory: (Maximum and minimum) Let x 1,..., x k be a random sample (iid) from a standard Gaussian distribution. Define the order statistics x k,k x k 1,k x 2,k x 1,k. Also, define the norming constants c k = 1 2 ln(k), d k = ln(4π) + ln(ln(k)) 2 ln(k) 2. 2 ln(k) Then, as k T 1,k = x 1,k d k c k d X, T k,k = x k,k d k c k d X, and T 1,k and T k,k are asymptotically independent, where the CDF of X is Λ(x) = exp( e x ). See, for instance, the classical book by Embrechts, et al. (2001). Ruey S. Tsay HTS 4 / 36
5 Basic tool and its property Spearman s rank correlation: Consider two random variables X and Y with continuous marginal distributions. Let {(x i, y i )} be a sample of size n from (X, Y ). Let ri x be the rank of x i and r y i be the rank of y i in the sample. The Spearman s rank correlation is defined as ˆρ = n i=1 (r i x r)(r y i r) n(n 2, 1)/12 where r = (n + 1)/2. Limiting property: nˆρ d N(0, 1) as n, if X and Y are independent. Ruey S. Tsay HTS 5 / 36
6 High-dimensional time series Let X t = (x 1t,..., x pt ) be a p-dimensional stationary time series. Let {x 1,..., x n } be a realization of n observations of X t. Let r t = (r 1t,..., r pt ) be the corresponding tth observation of ranks. That is, r it denotes the rank series of x it. The lag-l Spearman s rank cross-correlation matrix is defined by 12 n Γ l = [ Γ l,ij ] = n(n 2 (r t r)(r t l r), 1) t=l+1 where r denotes the constant vector of (n + 1)/2. The robustness of the rank correlation has been widely studied in the literature. Ruey S. Tsay HTS 6 / 36
7 A fundamenal question Are there serial correlations in a given high-dimensional time series? H 0 : Γ 1 = = Γ m = 0 vs H 1 : Γ i 0 for some i, where, for simplicity, Γ l = E[ Γ l ]. The question also applies to the residuals of a fitted model, e.g. Is the model adequate for the data? The well-known Ljung-Box Q(m) statistic is not useful as the dimension p increases. Some work available, e.g. Chang, Yao and Zhou (2016) and Li et al. (2016). Ruey S. Tsay HTS 7 / 36
8 Basic properties of rank correlations: A theorem Conditions: Continuous random varaibles (no moment requirements) 1 X t is a white noise (no serial correlations) 2 Components are independent: X it and X jt are independent for i j. Ruey S. Tsay HTS 8 / 36
9 Theorem continued The rank cross-correlation matrix Γ l satisfies (a) E( Γ l,ii ) = n l n(n 1), 1 l n 1, (b) E( Γ l,ij ) = 0, i j, (c) Var( Γ l,ii ) = 5(n l) 4 5n 2 + O(n 3 ), (d) Cov( Γ l,ii, Γ h,ii ) = 2 n 2 + O(n 3 ), 1 l < h n 1, (e) Var( Γ l,ij ) = 1 n + O(n 2 ), i j, (f) Cov( Γ l,ij, Γ l,uv ) = 0 + O(n 2 ), (i, j) (u, v), where 1 i, j p. (a), (c), and (d) are shown by Dufour and Roy (1986). Others by independence condition. Ruey S. Tsay HTS 9 / 36
10 Summary of the theorem Let vec(a) be the column-stacking vector of matrix A. Then, n vec( Γl ) d N(0, I), n, where N(0, I) denotes the p 2 -dimensional standard Gaussian distribution, provided that the conditions hold. Ruey S. Tsay HTS 10 / 36
11 Testing: single cross-correlation matrix H 0 : Γ l = 0 versus H 1 : Γ l 0. Define T l,max = n max{ Γ l } T l,min = n min{ Γ l }. Let c p and d p be the norming constants with k = p 2. Under H 0, T l,max = T l,max d p c p d X, T l,min = T l,min d p c p d X, where X denotes the Gumble distribution, if n and p. For type-i error α, H 0 is rejected if either T l,max v α or T l,min v α, where v α = ln( ln(1 α 2 )). Ruey S. Tsay HTS 11 / 36
12 Single test statistic Define T l = n max{t l,max, T l,min } = n max Γ l. Then, under H 0, (T l d p )/c p d max{x 1, X 2 } as n and p, where X 1 and X 2 are two independent Gumble random variates. The limiting distribution of T l is available. Ruey S. Tsay HTS 12 / 36
13 Joint test for multiple lags H 0 : Γ 1 = = Γ m = 0 versus H 1 : Γ i 0 for some 1 i m. Define T max (m) = max{t l,max l = 1,..., m} T min (m) = max{t l,min l = 1,..., m} and the norming constants c p,m and d p,m as before with k = mp 2. Then, T max d m,p c m,p d X, T min d m,p c m,p d X. Ruey S. Tsay HTS 13 / 36
14 Empirical sizes: 10,000 realizations Test p = 300, n = 3000 p = 300, n = 5000 p = 500, n = 5000 Statistic 10% 5% 1% 10% 5% 1% 10% 5% 1% (a) Standard Gaussian distribution T T T T T T T (5) T (10) Ruey S. Tsay HTS 14 / 36
15 Empirical sizes continued Test p = 300, n = 3000 p = 300, n = 5000 p = 500, n = 5000 Statistic 10% 5% 1% 10% 5% 1% 10% 5% 1% (b) Cauchy distribution, i.e. t 1 T T T T T T T (5) T (10) Ruey S. Tsay HTS 15 / 36
16 Finite-sample adjustments Adjust for actual data used: Γ l = 12 (n l)[(n l) 2 1] n (r t r)(r t l r), t=l+1 where r is a p-dimensional constant vector of (n l + 1)/2, r t is the rank matrix of X[(l + 1) : n, ] and r t l is the rank matrix of X[1 : (n l), ]. Bias adjustment of auto-correlations Γa l,ii = Γ l,ii + n l n(n 1), i = 1,..., p Ruey S. Tsay HTS 16 / 36
17 Finite-sample adjustments continued Variance adjustment 5n 2 /[5(n l) 4] vec( Γ a l ) d N(0, I), n. The test statistic for a single lag matrix T a l = 5n 2 /[5(n l) 4] max{ Γ a l,ij }. Ruey S. Tsay HTS 17 / 36
18 Block size adjustment: for n < 3000 Adjustmented norming constants: c a p = [2 ln(p 2 ξ)] 1/2, d a p = where ξ = where η = min{5, (n + p)/n}. 2 ln(p 2 ξ) ln(4π) + ln ln(p2 ξ) 2[2 ln(p 2 ξ)] 1/2, { 0.78 η if n < 3000, 1 otherwise, Ruey S. Tsay HTS 18 / 36
19 Empircal sizes: individual lag, 30,000 realizations n = 100 n = 300 n = 500 p 10% 5% 1% 10% 5% 1% 10% 5% 1% (a) Lag (b) Lag Ruey S. Tsay HTS 19 / 36
20 Empircal sizes: individual lag continued n = 100 n = 300 n = 500 p 10% 5% 1% 10% 5% 1% 10% 5% 1% (c) Lag (d) Lag Ruey S. Tsay HTS 20 / 36
21 Number of lags adjustment: for p < 300 Effective lags used { m m 0.9 (n+p)/n if p < 300, = m otherwise, and adjust the scale and location parameters as cp,m a = [2 ln(p 2 ξm )] 1/2 dp,m a = 2 ln(p 2 ξm ) ln(4π) + ln ln(p2 ξm ) 2[2 ln(p 2 ξm )] 1/2. Ruey S. Tsay HTS 21 / 36
22 Empirical sizes: joint test, 30,000 realizations n = 100 n = 300 n = 500 p 10% 5% 1% 10% 5% 1% 10% 5% 1% (a) m = 5, the first 5 lags (b) m = 10, the first 10 lags Ruey S. Tsay HTS 22 / 36
23 General covariance matrix 1 p < n: Apply PCA to x t. Apply tests to the principal component series 2 p n: Select p = 0.75n series for testing Selection: H 0 : Γ 1 = = Γ m = 0. For each Γ l, define a p-dimensional weight vector w l = (w l,1,..., w l,p ) such that w l,i = max 1 j p Γ l,i. The weights for each component x it is w i = m w l,i, i = 1,..., p. l=1 Select the p sub-series with the highest weights. Ruey S. Tsay HTS 23 / 36
24 Correlated series x t = A 1/2 ɛ t where A is a symmetric matrix with A ij = 0.9 i j and elements of ɛ t are iid t 3 random variates. The results are based on 10,000 realizations. Ruey S. Tsay HTS 24 / 36
25 General covariance matrix: size simulation n = 100 n = 300 n = 500 p 10% 5% 1% 10% 5% 1% 10% 5% 1% (a) Lag (b) Lag Ruey S. Tsay HTS 25 / 36
26 General covariance matrix: size simulation continued n = 100 n = 300 n = 500 p 10% 5% 1% 10% 5% 1% 10% 5% 1% (c) Lag (d) Lag Ruey S. Tsay HTS 26 / 36
27 Joint tests n = 100 n = 300 n = 500 p 10% 5% 1% 10% 5% 1% 10% 5% 1% (a) m = 5, the first 5 lags (b) m = 10, the first 10 lags Ruey S. Tsay HTS 27 / 36
28 Power study Two data generating processes 1 VAR(1): x t = Φx t 1 + e t 2 VMA(1): x t = e t Θe t 1 where e t are iid N(0, I), x 0 = 0. For VAR(1) models, let ζ is the sparsity parameter. Non-zero elements of Φ is N = p 2 ζ. For each realization, Φ is obtained using Random sample N from 1 : p 2 without replacement Draw N uniform random variates from [ 0.95, 0.95] Assign (ii) to the N positions in vec(φ). Ruey S. Tsay HTS 28 / 36
29 Power of VAR(1) processes, 10,000 realizations n = 100 n = 300 n = 500 p ζ 10% 5% ζ 10% 5% ζ 10% 5% (a) Individual test: T1 a (b) Individual test: T2 a Ruey S. Tsay HTS 29 / 36
30 Power study: Joint statistics n = 100 n = 300 n = 500 p ζ 10% 5% ζ 10% 5% ζ 10% 5% (c) Joint test: T a (5) (d) Joint test: T a (10) Ruey S. Tsay HTS 30 / 36
31 VMA(1) models: power study Θ = [Θ ij ] matrix is defined as { 0 if i j > 1 Θ ij = Otherwise g ij with { g ij = 0 with prob 1 ω U[ 0.95, 0.95] with prob ω Ruey S. Tsay HTS 31 / 36
32 n = 100, ω = 0.3 n = 300, ω = 0.2 n = 500, ω = 0.1 p 10% 5% 1% 10% 5% 1% 10% 5% 1% (a) Indivudal test: T1 a (b) Individual test: T2 a Ruey S. Tsay HTS 32 / 36
33 Joint test: power n = 100, ω = 0.3 n = 300, ω = 0.2 n = 500, ω = 0.1 p 10% 5% 1% 10% 5% 1% 10% 5% 1% (c) Joint test: T a (5) (d) Joint test: T a (10) Ruey S. Tsay HTS 33 / 36
34 An example Daily returns, in percentages, of 92 component series of the S&P 100 index from January 2, 2004 to December 31, Sample size n = 2517 Ruey S. Tsay HTS 34 / 36
35 rtn year Ruey S. Tsay HTS 35 / 36
36 Individual Test Joint test T1 a T2 a T3 a T4 a T5 a T a (5) T a (10) (a) Original return series (b) Residuals of the VAR(1) model critical values: (10%,5%,1%) 1 Individual lag: 4.34, 4.51, Joint 5 lags: 4.65, 4.81, Joint 10 lags: 4.79, 4.94, Ruey S. Tsay HTS 36 / 36
Booth School of Business, University of Chicago Business 41914, Spring Quarter 2017, Mr. Ruey S. Tsay. Solutions to Midterm
Booth School of Business, University of Chicago Business 41914, Spring Quarter 017, Mr Ruey S Tsay Solutions to Midterm Problem A: (51 points; 3 points per question) Answer briefly the following questions
More informationBooth School of Business, University of Chicago Business 41914, Spring Quarter 2013, Mr. Ruey S. Tsay. Midterm
Booth School of Business, University of Chicago Business 41914, Spring Quarter 2013, Mr. Ruey S. Tsay Midterm Chicago Booth Honor Code: I pledge my honor that I have not violated the Honor Code during
More informationBooth School of Business, University of Chicago Business 41914, Spring Quarter 2017, Mr. Ruey S. Tsay Midterm
Booth School of Business, University of Chicago Business 41914, Spring Quarter 2017, Mr. Ruey S. Tsay Midterm Chicago Booth Honor Code: I pledge my honor that I have not violated the Honor Code during
More informationTHE UNIVERSITY OF CHICAGO Booth School of Business Business 41912, Spring Quarter 2016, Mr. Ruey S. Tsay
THE UNIVERSITY OF CHICAGO Booth School of Business Business 41912, Spring Quarter 2016, Mr. Ruey S. Tsay Lecture 5: Multivariate Multiple Linear Regression The model is Y n m = Z n (r+1) β (r+1) m + ɛ
More informationTHE UNIVERSITY OF CHICAGO Graduate School of Business Business 41202, Spring Quarter 2003, Mr. Ruey S. Tsay
THE UNIVERSITY OF CHICAGO Graduate School of Business Business 41202, Spring Quarter 2003, Mr. Ruey S. Tsay Solutions to Homework Assignment #4 May 9, 2003 Each HW problem is 10 points throughout this
More informationMultivariate Time Series
Multivariate Time Series Notation: I do not use boldface (or anything else) to distinguish vectors from scalars. Tsay (and many other writers) do. I denote a multivariate stochastic process in the form
More informationEnd-Semester Examination MA 373 : Statistical Analysis on Financial Data
End-Semester Examination MA 373 : Statistical Analysis on Financial Data Instructor: Dr. Arabin Kumar Dey, Department of Mathematics, IIT Guwahati Note: Use the results in Section- III: Data Analysis using
More informationAR, MA and ARMA models
AR, MA and AR by Hedibert Lopes P Based on Tsay s Analysis of Financial Time Series (3rd edition) P 1 Stationarity 2 3 4 5 6 7 P 8 9 10 11 Outline P Linear Time Series Analysis and Its Applications For
More informationChapter 2: Fundamentals of Statistics Lecture 15: Models and statistics
Chapter 2: Fundamentals of Statistics Lecture 15: Models and statistics Data from one or a series of random experiments are collected. Planning experiments and collecting data (not discussed here). Analysis:
More informationHigh-Dimensional Time Series Analysis
High-Dimensional Time Series Analysis Ruey S. Tsay Booth School of Business University of Chicago December 2015 Outline Analysis of high-dimensional time-series data (or dependent big data) Problem and
More informationBootstrapping high dimensional vector: interplay between dependence and dimensionality
Bootstrapping high dimensional vector: interplay between dependence and dimensionality Xianyang Zhang Joint work with Guang Cheng University of Missouri-Columbia LDHD: Transition Workshop, 2014 Xianyang
More informationCentral Limit Theorem ( 5.3)
Central Limit Theorem ( 5.3) Let X 1, X 2,... be a sequence of independent random variables, each having n mean µ and variance σ 2. Then the distribution of the partial sum S n = X i i=1 becomes approximately
More informationPh.D. Qualifying Exam Friday Saturday, January 6 7, 2017
Ph.D. Qualifying Exam Friday Saturday, January 6 7, 2017 Put your solution to each problem on a separate sheet of paper. Problem 1. (5106) Let X 1, X 2,, X n be a sequence of i.i.d. observations from a
More informationRobust Backtesting Tests for Value-at-Risk Models
Robust Backtesting Tests for Value-at-Risk Models Jose Olmo City University London (joint work with Juan Carlos Escanciano, Indiana University) Far East and South Asia Meeting of the Econometric Society
More informationFinancial Econometrics and Quantitative Risk Managenent Return Properties
Financial Econometrics and Quantitative Risk Managenent Return Properties Eric Zivot Updated: April 1, 2013 Lecture Outline Course introduction Return definitions Empirical properties of returns Reading
More information2. Multivariate ARMA
2. Multivariate ARMA JEM 140: Quantitative Multivariate Finance IES, Charles University, Prague Summer 2018 JEM 140 () 2. Multivariate ARMA Summer 2018 1 / 19 Multivariate AR I Let r t = (r 1t,..., r kt
More informationAsymptotic Statistics-III. Changliang Zou
Asymptotic Statistics-III Changliang Zou The multivariate central limit theorem Theorem (Multivariate CLT for iid case) Let X i be iid random p-vectors with mean µ and and covariance matrix Σ. Then n (
More informationf (1 0.5)/n Z =
Math 466/566 - Homework 4. We want to test a hypothesis involving a population proportion. The unknown population proportion is p. The null hypothesis is p = / and the alternative hypothesis is p > /.
More informationEcon 423 Lecture Notes: Additional Topics in Time Series 1
Econ 423 Lecture Notes: Additional Topics in Time Series 1 John C. Chao April 25, 2017 1 These notes are based in large part on Chapter 16 of Stock and Watson (2011). They are for instructional purposes
More informationProf. Dr. Roland Füss Lecture Series in Applied Econometrics Summer Term Introduction to Time Series Analysis
Introduction to Time Series Analysis 1 Contents: I. Basics of Time Series Analysis... 4 I.1 Stationarity... 5 I.2 Autocorrelation Function... 9 I.3 Partial Autocorrelation Function (PACF)... 14 I.4 Transformation
More informationReview. DS GA 1002 Statistical and Mathematical Models. Carlos Fernandez-Granda
Review DS GA 1002 Statistical and Mathematical Models http://www.cims.nyu.edu/~cfgranda/pages/dsga1002_fall16 Carlos Fernandez-Granda Probability and statistics Probability: Framework for dealing with
More informationELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process
Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Definition of stochastic process (random
More informationVector Autoregressive Model. Vector Autoregressions II. Estimation of Vector Autoregressions II. Estimation of Vector Autoregressions I.
Vector Autoregressive Model Vector Autoregressions II Empirical Macroeconomics - Lect 2 Dr. Ana Beatriz Galvao Queen Mary University of London January 2012 A VAR(p) model of the m 1 vector of time series
More information6. The econometrics of Financial Markets: Empirical Analysis of Financial Time Series. MA6622, Ernesto Mordecki, CityU, HK, 2006.
6. The econometrics of Financial Markets: Empirical Analysis of Financial Time Series MA6622, Ernesto Mordecki, CityU, HK, 2006. References for Lecture 5: Quantitative Risk Management. A. McNeil, R. Frey,
More information9. Multivariate Linear Time Series (II). MA6622, Ernesto Mordecki, CityU, HK, 2006.
9. Multivariate Linear Time Series (II). MA6622, Ernesto Mordecki, CityU, HK, 2006. References for this Lecture: Introduction to Time Series and Forecasting. P.J. Brockwell and R. A. Davis, Springer Texts
More informationOn the Estimation and Application of Max-Stable Processes
On the Estimation and Application of Max-Stable Processes Zhengjun Zhang Department of Statistics University of Wisconsin Madison, WI 53706, USA Co-author: Richard Smith EVA 2009, Fort Collins, CO Z. Zhang
More informationEfficient and Robust Scale Estimation
Efficient and Robust Scale Estimation Garth Tarr, Samuel Müller and Neville Weber School of Mathematics and Statistics THE UNIVERSITY OF SYDNEY Outline Introduction and motivation The robust scale estimator
More informationOutline lecture 2 2(30)
Outline lecture 2 2(3), Lecture 2 Linear Regression it is our firm belief that an understanding of linear models is essential for understanding nonlinear ones Thomas Schön Division of Automatic Control
More informationLarge sample distribution for fully functional periodicity tests
Large sample distribution for fully functional periodicity tests Siegfried Hörmann Institute for Statistics Graz University of Technology Based on joint work with Piotr Kokoszka (Colorado State) and Gilles
More informationAn Efficient Estimation Method for Longitudinal Surveys with Monotone Missing Data
An Efficient Estimation Method for Longitudinal Surveys with Monotone Missing Data Jae-Kwang Kim 1 Iowa State University June 28, 2012 1 Joint work with Dr. Ming Zhou (when he was a PhD student at ISU)
More informationSymmetric btw positive & negative prior returns. where c is referred to as risk premium, which is expected to be positive.
Advantages of GARCH model Simplicity Generates volatility clustering Heavy tails (high kurtosis) Weaknesses of GARCH model Symmetric btw positive & negative prior returns Restrictive Provides no explanation
More informationLocation Multiplicative Error Model. Asymptotic Inference and Empirical Analysis
: Asymptotic Inference and Empirical Analysis Qian Li Department of Mathematics and Statistics University of Missouri-Kansas City ql35d@mail.umkc.edu October 29, 2015 Outline of Topics Introduction GARCH
More informationReview (Probability & Linear Algebra)
Review (Probability & Linear Algebra) CE-725 : Statistical Pattern Recognition Sharif University of Technology Spring 2013 M. Soleymani Outline Axioms of probability theory Conditional probability, Joint
More informationStatistics (1): Estimation
Statistics (1): Estimation Marco Banterlé, Christian Robert and Judith Rousseau Practicals 2014-2015 L3, MIDO, Université Paris Dauphine 1 Table des matières 1 Random variables, probability, expectation
More information7. MULTIVARATE STATIONARY PROCESSES
7. MULTIVARATE STATIONARY PROCESSES 1 1 Some Preliminary Definitions and Concepts Random Vector: A vector X = (X 1,..., X n ) whose components are scalar-valued random variables on the same probability
More informationTHE UNIVERSITY OF CHICAGO Graduate School of Business Business 41912, Spring Quarter 2008, Mr. Ruey S. Tsay. Solutions to Final Exam
THE UNIVERSITY OF CHICAGO Graduate School of Business Business 41912, Spring Quarter 2008, Mr. Ruey S. Tsay Solutions to Final Exam 1. (13 pts) Consider the monthly log returns, in percentages, of five
More informationAdvanced Statistics II: Non Parametric Tests
Advanced Statistics II: Non Parametric Tests Aurélien Garivier ParisTech February 27, 2011 Outline Fitting a distribution Rank Tests for the comparison of two samples Two unrelated samples: Mann-Whitney
More informationRearrangement Algorithm and Maximum Entropy
University of Illinois at Chicago Joint with Carole Bernard Vrije Universiteit Brussel and Steven Vanduffel Vrije Universiteit Brussel R/Finance, May 19-20, 2017 Introduction An important problem in Finance:
More informationEstimation of large dimensional sparse covariance matrices
Estimation of large dimensional sparse covariance matrices Department of Statistics UC, Berkeley May 5, 2009 Sample covariance matrix and its eigenvalues Data: n p matrix X n (independent identically distributed)
More informationAssessing the dependence of high-dimensional time series via sample autocovariances and correlations
Assessing the dependence of high-dimensional time series via sample autocovariances and correlations Johannes Heiny University of Aarhus Joint work with Thomas Mikosch (Copenhagen), Richard Davis (Columbia),
More informationEcon 424 Time Series Concepts
Econ 424 Time Series Concepts Eric Zivot January 20 2015 Time Series Processes Stochastic (Random) Process { 1 2 +1 } = { } = sequence of random variables indexed by time Observed time series of length
More information4.1 Order Specification
THE UNIVERSITY OF CHICAGO Booth School of Business Business 41914, Spring Quarter 2009, Mr Ruey S Tsay Lecture 7: Structural Specification of VARMA Models continued 41 Order Specification Turn to data
More informationInference for High Dimensional Robust Regression
Department of Statistics UC Berkeley Stanford-Berkeley Joint Colloquium, 2015 Table of Contents 1 Background 2 Main Results 3 OLS: A Motivating Example Table of Contents 1 Background 2 Main Results 3 OLS:
More informationTime Series 2. Robert Almgren. Sept. 21, 2009
Time Series 2 Robert Almgren Sept. 21, 2009 This week we will talk about linear time series models: AR, MA, ARMA, ARIMA, etc. First we will talk about theory and after we will talk about fitting the models
More informationNon-parametric Inference and Resampling
Non-parametric Inference and Resampling Exercises by David Wozabal (Last update. Juni 010) 1 Basic Facts about Rank and Order Statistics 1.1 10 students were asked about the amount of time they spend surfing
More informationVector Auto-Regressive Models
Vector Auto-Regressive Models Laurent Ferrara 1 1 University of Paris Nanterre M2 Oct. 2018 Overview of the presentation 1. Vector Auto-Regressions Definition Estimation Testing 2. Impulse responses functions
More informationVAR Models and Applications
VAR Models and Applications Laurent Ferrara 1 1 University of Paris West M2 EIPMC Oct. 2016 Overview of the presentation 1. Vector Auto-Regressions Definition Estimation Testing 2. Impulse responses functions
More informationGARCH Models Estimation and Inference
GARCH Models Estimation and Inference Eduardo Rossi University of Pavia December 013 Rossi GARCH Financial Econometrics - 013 1 / 1 Likelihood function The procedure most often used in estimating θ 0 in
More informationMultivariate Time Series Analysis and Its Applications [Tsay (2005), chapter 8]
1 Multivariate Time Series Analysis and Its Applications [Tsay (2005), chapter 8] Insights: Price movements in one market can spread easily and instantly to another market [economic globalization and internet
More informationReview (probability, linear algebra) CE-717 : Machine Learning Sharif University of Technology
Review (probability, linear algebra) CE-717 : Machine Learning Sharif University of Technology M. Soleymani Fall 2012 Some slides have been adopted from Prof. H.R. Rabiee s and also Prof. R. Gutierrez-Osuna
More informationECE276A: Sensing & Estimation in Robotics Lecture 10: Gaussian Mixture and Particle Filtering
ECE276A: Sensing & Estimation in Robotics Lecture 10: Gaussian Mixture and Particle Filtering Lecturer: Nikolay Atanasov: natanasov@ucsd.edu Teaching Assistants: Siwei Guo: s9guo@eng.ucsd.edu Anwesan Pal:
More informationMultivariate Time Series: VAR(p) Processes and Models
Multivariate Time Series: VAR(p) Processes and Models A VAR(p) model, for p > 0 is X t = φ 0 + Φ 1 X t 1 + + Φ p X t p + A t, where X t, φ 0, and X t i are k-vectors, Φ 1,..., Φ p are k k matrices, with
More informationPlug-in Measure-Transformed Quasi Likelihood Ratio Test for Random Signal Detection
Plug-in Measure-Transformed Quasi Likelihood Ratio Test for Random Signal Detection Nir Halay and Koby Todros Dept. of ECE, Ben-Gurion University of the Negev, Beer-Sheva, Israel February 13, 2017 1 /
More informationThomas J. Fisher. Research Statement. Preliminary Results
Thomas J. Fisher Research Statement Preliminary Results Many applications of modern statistics involve a large number of measurements and can be considered in a linear algebra framework. In many of these
More informationRobust Principal Component Analysis
ELE 538B: Mathematics of High-Dimensional Data Robust Principal Component Analysis Yuxin Chen Princeton University, Fall 2018 Disentangling sparse and low-rank matrices Suppose we are given a matrix M
More informationA Multiple Testing Approach to the Regularisation of Large Sample Correlation Matrices
A Multiple Testing Approach to the Regularisation of Large Sample Correlation Matrices Natalia Bailey 1 M. Hashem Pesaran 2 L. Vanessa Smith 3 1 Department of Econometrics & Business Statistics, Monash
More informationUnit roots in vector time series. Scalar autoregression True model: y t 1 y t1 2 y t2 p y tp t Estimated model: y t c y t1 1 y t1 2 y t2
Unit roots in vector time series A. Vector autoregressions with unit roots Scalar autoregression True model: y t y t y t p y tp t Estimated model: y t c y t y t y t p y tp t Results: T j j is asymptotically
More informationLecture 4: Heteroskedasticity
Lecture 4: Heteroskedasticity Econometric Methods Warsaw School of Economics (4) Heteroskedasticity 1 / 24 Outline 1 What is heteroskedasticity? 2 Testing for heteroskedasticity White Goldfeld-Quandt Breusch-Pagan
More informationEconomics 582 Random Effects Estimation
Economics 582 Random Effects Estimation Eric Zivot May 29, 2013 Random Effects Model Hence, the model can be re-written as = x 0 β + + [x ] = 0 (no endogeneity) [ x ] = = + x 0 β + + [x ] = 0 [ x ] = 0
More information5: MULTIVARATE STATIONARY PROCESSES
5: MULTIVARATE STATIONARY PROCESSES 1 1 Some Preliminary Definitions and Concepts Random Vector: A vector X = (X 1,..., X n ) whose components are scalarvalued random variables on the same probability
More informationStatistical Inference of Covariate-Adjusted Randomized Experiments
1 Statistical Inference of Covariate-Adjusted Randomized Experiments Feifang Hu Department of Statistics George Washington University Joint research with Wei Ma, Yichen Qin and Yang Li Email: feifang@gwu.edu
More informationZhaoxing Gao and Ruey S Tsay Booth School of Business, University of Chicago. August 23, 2018
Supplementary Material for Structural-Factor Modeling of High-Dimensional Time Series: Another Look at Approximate Factor Models with Diverging Eigenvalues Zhaoxing Gao and Ruey S Tsay Booth School of
More informationConfidence Intervals for Low-dimensional Parameters with High-dimensional Data
Confidence Intervals for Low-dimensional Parameters with High-dimensional Data Cun-Hui Zhang and Stephanie S. Zhang Rutgers University and Columbia University September 14, 2012 Outline Introduction Methodology
More informationBayesian Semiparametric GARCH Models
Bayesian Semiparametric GARCH Models Xibin (Bill) Zhang and Maxwell L. King Department of Econometrics and Business Statistics Faculty of Business and Economics xibin.zhang@monash.edu Quantitative Methods
More informationWeek 5 Quantitative Analysis of Financial Markets Characterizing Cycles
Week 5 Quantitative Analysis of Financial Markets Characterizing Cycles Christopher Ting http://www.mysmu.edu/faculty/christophert/ Christopher Ting : christopherting@smu.edu.sg : 6828 0364 : LKCSB 5036
More informationBayesian Semiparametric GARCH Models
Bayesian Semiparametric GARCH Models Xibin (Bill) Zhang and Maxwell L. King Department of Econometrics and Business Statistics Faculty of Business and Economics xibin.zhang@monash.edu Quantitative Methods
More information1 Exercises for lecture 1
1 Exercises for lecture 1 Exercise 1 a) Show that if F is symmetric with respect to µ, and E( X )
More informationTime Series Modeling of Financial Data. Prof. Daniel P. Palomar
Time Series Modeling of Financial Data Prof. Daniel P. Palomar The Hong Kong University of Science and Technology (HKUST) MAFS6010R- Portfolio Optimization with R MSc in Financial Mathematics Fall 2018-19,
More informationEstimation of Operational Risk Capital Charge under Parameter Uncertainty
Estimation of Operational Risk Capital Charge under Parameter Uncertainty Pavel V. Shevchenko Principal Research Scientist, CSIRO Mathematical and Information Sciences, Sydney, Locked Bag 17, North Ryde,
More informationSliced Inverse Regression
Sliced Inverse Regression Ge Zhao gzz13@psu.edu Department of Statistics The Pennsylvania State University Outline Background of Sliced Inverse Regression (SIR) Dimension Reduction Definition of SIR Inversed
More informationPCA with random noise. Van Ha Vu. Department of Mathematics Yale University
PCA with random noise Van Ha Vu Department of Mathematics Yale University An important problem that appears in various areas of applied mathematics (in particular statistics, computer science and numerical
More informationAn application of the GAM-PCA-VAR model to respiratory disease and air pollution data
An application of the GAM-PCA-VAR model to respiratory disease and air pollution data Márton Ispány 1 Faculty of Informatics, University of Debrecen Hungary Joint work with Juliana Bottoni de Souza, Valdério
More informationEfficient estimation of a semiparametric dynamic copula model
Efficient estimation of a semiparametric dynamic copula model Christian Hafner Olga Reznikova Institute of Statistics Université catholique de Louvain Louvain-la-Neuve, Blgium 30 January 2009 Young Researchers
More informationState-space Model. Eduardo Rossi University of Pavia. November Rossi State-space Model Financial Econometrics / 49
State-space Model Eduardo Rossi University of Pavia November 2013 Rossi State-space Model Financial Econometrics - 2013 1 / 49 Outline 1 Introduction 2 The Kalman filter 3 Forecast errors 4 State smoothing
More informationSpring 2012 Math 541B Exam 1
Spring 2012 Math 541B Exam 1 1. A sample of size n is drawn without replacement from an urn containing N balls, m of which are red and N m are black; the balls are otherwise indistinguishable. Let X denote
More informationNegative Association, Ordering and Convergence of Resampling Methods
Negative Association, Ordering and Convergence of Resampling Methods Nicolas Chopin ENSAE, Paristech (Joint work with Mathieu Gerber and Nick Whiteley, University of Bristol) Resampling schemes: Informal
More informationBrief Review on Estimation Theory
Brief Review on Estimation Theory K. Abed-Meraim ENST PARIS, Signal and Image Processing Dept. abed@tsi.enst.fr This presentation is essentially based on the course BASTA by E. Moulines Brief review on
More information2 Statistical Estimation: Basic Concepts
Technion Israel Institute of Technology, Department of Electrical Engineering Estimation and Identification in Dynamical Systems (048825) Lecture Notes, Fall 2009, Prof. N. Shimkin 2 Statistical Estimation:
More informationMethods for sparse analysis of high-dimensional data, II
Methods for sparse analysis of high-dimensional data, II Rachel Ward May 23, 2011 High dimensional data with low-dimensional structure 300 by 300 pixel images = 90, 000 dimensions 2 / 47 High dimensional
More informationGARCH Models. Eduardo Rossi University of Pavia. December Rossi GARCH Financial Econometrics / 50
GARCH Models Eduardo Rossi University of Pavia December 013 Rossi GARCH Financial Econometrics - 013 1 / 50 Outline 1 Stylized Facts ARCH model: definition 3 GARCH model 4 EGARCH 5 Asymmetric Models 6
More informationState-space Model. Eduardo Rossi University of Pavia. November Rossi State-space Model Fin. Econometrics / 53
State-space Model Eduardo Rossi University of Pavia November 2014 Rossi State-space Model Fin. Econometrics - 2014 1 / 53 Outline 1 Motivation 2 Introduction 3 The Kalman filter 4 Forecast errors 5 State
More informationVariations. ECE 6540, Lecture 10 Maximum Likelihood Estimation
Variations ECE 6540, Lecture 10 Last Time BLUE (Best Linear Unbiased Estimator) Formulation Advantages Disadvantages 2 The BLUE A simplification Assume the estimator is a linear system For a single parameter
More informationFall 2017 STAT 532 Homework Peter Hoff. 1. Let P be a probability measure on a collection of sets A.
1. Let P be a probability measure on a collection of sets A. (a) For each n N, let H n be a set in A such that H n H n+1. Show that P (H n ) monotonically converges to P ( k=1 H k) as n. (b) For each n
More informationVector autoregressions, VAR
1 / 45 Vector autoregressions, VAR Chapter 2 Financial Econometrics Michael Hauser WS17/18 2 / 45 Content Cross-correlations VAR model in standard/reduced form Properties of VAR(1), VAR(p) Structural VAR,
More informationA note on a Marčenko-Pastur type theorem for time series. Jianfeng. Yao
A note on a Marčenko-Pastur type theorem for time series Jianfeng Yao Workshop on High-dimensional statistics The University of Hong Kong, October 2011 Overview 1 High-dimensional data and the sample covariance
More informationLecture Note 1: Probability Theory and Statistics
Univ. of Michigan - NAME 568/EECS 568/ROB 530 Winter 2018 Lecture Note 1: Probability Theory and Statistics Lecturer: Maani Ghaffari Jadidi Date: April 6, 2018 For this and all future notes, if you would
More informationStatistical Data Analysis
DS-GA 0 Lecture notes 8 Fall 016 1 Descriptive statistics Statistical Data Analysis In this section we consider the problem of analyzing a set of data. We describe several techniques for visualizing the
More informationAutoregressive Moving Average (ARMA) Models and their Practical Applications
Autoregressive Moving Average (ARMA) Models and their Practical Applications Massimo Guidolin February 2018 1 Essential Concepts in Time Series Analysis 1.1 Time Series and Their Properties Time series:
More informationLecture 4: Dynamic models
linear s Lecture 4: s Hedibert Freitas Lopes The University of Chicago Booth School of Business 5807 South Woodlawn Avenue, Chicago, IL 60637 http://faculty.chicagobooth.edu/hedibert.lopes hlopes@chicagobooth.edu
More informationGauge Plots. Gauge Plots JAPANESE BEETLE DATA MAXIMUM LIKELIHOOD FOR SPATIALLY CORRELATED DISCRETE DATA JAPANESE BEETLE DATA
JAPANESE BEETLE DATA 6 MAXIMUM LIKELIHOOD FOR SPATIALLY CORRELATED DISCRETE DATA Gauge Plots TuscaroraLisa Central Madsen Fairways, 996 January 9, 7 Grubs Adult Activity Grub Counts 6 8 Organic Matter
More informationWhen is a copula constant? A test for changing relationships
When is a copula constant? A test for changing relationships Fabio Busetti and Andrew Harvey Bank of Italy and University of Cambridge November 2007 usetti and Harvey (Bank of Italy and University of Cambridge)
More informationA Probability Review
A Probability Review Outline: A probability review Shorthand notation: RV stands for random variable EE 527, Detection and Estimation Theory, # 0b 1 A Probability Review Reading: Go over handouts 2 5 in
More informationBootstrapping Heteroskedasticity Consistent Covariance Matrix Estimator
Bootstrapping Heteroskedasticity Consistent Covariance Matrix Estimator by Emmanuel Flachaire Eurequa, University Paris I Panthéon-Sorbonne December 2001 Abstract Recent results of Cribari-Neto and Zarkos
More informationLabor-Supply Shifts and Economic Fluctuations. Technical Appendix
Labor-Supply Shifts and Economic Fluctuations Technical Appendix Yongsung Chang Department of Economics University of Pennsylvania Frank Schorfheide Department of Economics University of Pennsylvania January
More informationParameter Estimation
Parameter Estimation Consider a sample of observations on a random variable Y. his generates random variables: (y 1, y 2,, y ). A random sample is a sample (y 1, y 2,, y ) where the random variables y
More informationDSGE Methods. Estimation of DSGE models: GMM and Indirect Inference. Willi Mutschler, M.Sc.
DSGE Methods Estimation of DSGE models: GMM and Indirect Inference Willi Mutschler, M.Sc. Institute of Econometrics and Economic Statistics University of Münster willi.mutschler@wiwi.uni-muenster.de Summer
More informationCovariance function estimation in Gaussian process regression
Covariance function estimation in Gaussian process regression François Bachoc Department of Statistics and Operations Research, University of Vienna WU Research Seminar - May 2015 François Bachoc Gaussian
More information2. (a) What is gaussian random variable? Develop an equation for guassian distribution
Code No: R059210401 Set No. 1 II B.Tech I Semester Supplementary Examinations, February 2007 PROBABILITY THEORY AND STOCHASTIC PROCESS ( Common to Electronics & Communication Engineering, Electronics &
More informationModelling using ARMA processes
Modelling using ARMA processes Step 1. ARMA model identification; Step 2. ARMA parameter estimation Step 3. ARMA model selection ; Step 4. ARMA model checking; Step 5. forecasting from ARMA models. 33
More informationCointegration Lecture I: Introduction
1 Cointegration Lecture I: Introduction Julia Giese Nuffield College julia.giese@economics.ox.ac.uk Hilary Term 2008 2 Outline Introduction Estimation of unrestricted VAR Non-stationarity Deterministic
More information