Comments on New Approaches in Period Analysis of Astronomical Time Series by Pavlos Protopapas (Or: A Pavlosian Response ) Don Percival
|
|
- Edmund Ellis
- 5 years ago
- Views:
Transcription
1 Comments on New Approaches in Period Analysis of Astronomical Time Series by Pavlos Protopapas (Or: A Pavlosian Response ) Don Percival Applied Physics Laboratory Department of Statistics University of Washington Seattle, Washington, USA
2 Background: I let s set the stage by considering some background suppose we have observations y j of brightness of a star at times x j, to be modeled as where y j = g(x j ) + j, j = 1, 2,..., n, g(x) is a periodic function with unknown period p 0 j represents observational noise problem of estimating p 0 and g(x) has received considerable attention in statistical and astronomical literature (Hall, 2008, has good review of statistical approaches) 1
3 Background: II toy parametric version of problem: assume g(x) = A cos (2π 1 p 0 x + φ) x j = j (i.e., regular sampling) with 2 < p 0 j s are realizations of independent and identically distributed (IID) random variables (RVs) with finite variance σ 2 consider example with A = 1, p 0 = 1, φ = 0.72, σ = 0.5, = 1/15.3 and n = 50 2
4 g(x) Toy Parametric Model x 3
5 Toy Parametric Model with Regular Sampling g(x j ) x j 4
6 Toy Parametric Model with Additive Noise y j x j 5
7 Toy Parametric Model with Additive Noise y j x j 6
8 Background: III one solution to toy problem: form periodogram I(f) = nx 2 n x j e i2πfj Ø Ø j=1 (direct function of frequency f; indirect function of period 1/f) let ˆf be frequency at which I(f) is maximized over (0, 1/[2 ]) so that 1/ ˆf is estimate of period p 0 7
9 I(f) Periodogram for Example of Toy Parametric Model f 8
10 Background: IV here ˆf = 0.98, which is very close to truth f 0 = 1/p 0 = 1 Q: with just n = 50 observations, did we just get lucky? Whittle (1952) and Walker (1971) show E{ ˆf} f 0 and var { ˆf} C n 3, where C = 6σ2 (Aπ ) 2, with approximations improving with increasing n contrast with problem of estimating mean of IID RVs ζ j with variance σ 2 ζ using sample mean ˆζ = P j ζ j/n, for which var {ˆζ} = σ2 ζ n note: can also estimate g(x) in obvious ways 9
11 Background: V more realistic nonparametric version of problem: assume g(x) has r bounded derivatives x 1 x 2 x n are irregularly spaced, but with spacing dictated by IID nonnegative RVs (some conditions needed) j s same as in toy problem consider same example as before, with sample points dictated by uniform distribution 10
12 g(x) Toy Parametric Model x 11
13 Toy Parametric Model with Irregular Sampling g(x j ) x j 12
14 Toy Parametric Model with Additive Noise y j x j 13
15 Toy Parametric Model with Additive Noise y j x j 14
16 Background: VI for given p, let x j = x j pbx j /pc, where bxc is largest integer strictly less than x; i.e., wrap x j s circularly to get x j s 15
17 Example of Nonparametric Model (p = 0.8) y j x j 16
18 Example of Nonparametric Model (p = 0.8) y j x j 17
19 Example of Nonparametric Model (p = 1.0) y j x j 18
20 Example of Nonparametric Model (p = 1.0) y j x j 19
21 Example of Nonparametric Model (p = 1.2) y j x j 20
22 Example of Nonparametric Model (p = 1.2) y j x j 21
23 Example of Nonparametric Model (p = 0.8) y j x j 22
24 Example of Nonparametric Model (p = 1.0) y j x j 23
25 Example of Nonparametric Model (p = 1.2) y j x j 24
26 Background: VII define Nadaraya Watson estimator: P j ĝ(x p) = y jk j (x p) Pj K j(x p), where K j(x p) = K([x x j ]/h), K is a kernel (smoother), and h is its bandwidth define squared-error criterion: nx S(p) = yj ĝ(x j p) 2 j=1 ˆp = argmin S(p) is a consistent estimator of p 0 under regularity conditions, E{ˆp} p 0 and var {ˆp} C n 3 25
27 Background: VIII same n 3 convergence rate as in toy parametric problem (!), and yields estimate of g(x) also mission accomplished... or is it? many questions/issues: computationally feasible with data explosion? nonlinear optimization? choice of bandwidth? asymptotics versus finite sample? outliers? correlation? multivariate? highly irregular?... apologizes needed for advocating a non-bayesian approach!? bottom line: room for other procedures, but Hall et al. (2000) is serious competition (ain t sexy, but snickers will be ignored!) 26
28 Two New Approaches correntropy approach is similar in spirit to Hall et al. in use of circular wrapping, but has different procedure for selecting p 0 heuristic approach whose theoretical underlinings need further exploration Gaussian processes fundamentally different from circular wrapping adapts technique originally designed for 2D spatial processes to irregularly sampled time series incorporates Bayesian ideas, so has firmer theoretical backing bottom line: both approaches are of interest! 27
29 Correntropy: I for regularly sampled time series (i.e., x j = j ), periodogram I(f) = nx 2 n x j e i2πfj Ø Ø j=1 is Fourier transform of biased estimator of autocovariance sequence: ŝ τ = 1 n n τ X j=1 x j x j+τ, 0 τ n 1, with ŝ τ = 0 for τ n, and ŝ τ = ŝ τ. regarding x j as realization of RV X j, ŝ τ is estimate of s τ = E{X j X j+τ } for second-order stationary process 28
30 Correntropy: II correntropy idea is to consider E{κ(X j, X j+τ )}, where 1 κ(x j, x k ) = p exp (x j x k ) 2! 2πσ 2 κ 2σκ 2 σ κ is user-settable parameter controlling influence of higherorder moments (25 settings entertained in IEEE SPL paper) assume E{κ(X j, X j+τ )} is independent of j (sufficient condition is strict stationarity) unbiased estimator of V τ = E{κ(X j, X j+τ )} is bv τ = 1 n τ n τ X j=1 κ(x j, x j+τ ), 0 τ n 1, with b V τ = b V τ (note: biased estimator performs poorly) 29
31 Correntropy: III correntropy spectral density (CSD) is taken to be where P (f) = V = n 1 X τ= (n 1) 1 2n 1 ( b V τ V )e i2πfτ n 1 X τ= (n 1) as with periodogram, search for peaks in P (f) as a first test, reconsider regularly sampled toy time series bv τ y j = cos (2πj ) + j 30
32 I(f) Periodogram for Example of Toy Parametric Model f 31
33 P(f) CSD for Example of Toy Parametric Model, σ κ = f 32
34 P(f) CSD for Example of Toy Parametric Model, σ κ = f 33
35 P(f) CSD for Example of Toy Parametric Model, σ κ = f 34
36 P(f) CSD for Example of Toy Parametric Model, σ κ = f 35
37 P(f) CSD for Example of Toy Parametric Model, σ κ = f 36
38 P(f) CSD for Example of Toy Parametric Model, σ κ = f 37
39 P(f) CSD for Example of Toy Parametric Model, σ κ = f 38
40 P(f) CSD for Example of Toy Parametric Model, σ κ = f 39
41 P(f) CSD for Example of Toy Parametric Model, σ κ = f 40
42 estimated frequency from P(f) Estimation of f 0 : CSD P (f) vs. Periodogram I(f) P (f) I(f) bias SD RMSE (10,000 replications) estimated frequency from I(f) 41
43 Correntropy: IV Q: what is best way to pick σ κ? Q: how are peaks in CSD related to harmonic variations? Q: evidently P (f) can be negative, so in what sense can it be regarded as a density function? for irregularly sampled series, must resort to slotting procedure (unappealing, but necessary) note: locations of peaks in CSD refined through maximization of information potential (IP) metric, so inaccuracies in CSD might be irrelevant Q: computational issues? Q: robustness? 42
44 Gaussian Processes Approach: I similar to before, let y j = g(x j ) + j be model for observations y j of brightness of a star at times x j letting y = [y 1,..., y n ] T & g = [g(x 1 ),..., g(x n )] T, consider y N (g, σ 2 I n ), while g θ N (0, K θ ), where K θ is an n n covariance matrix whose (j, k)th element is given by K θ,j,k = β exp sin 2 (2πf 0 [x j x k ])/l 2 with θ = [β, f 0, l] T K θ is covariance matrix for samples from a continuous parameter stationary process with autocovariance function γ(τ) = β exp sin 2 (2πf 0 τ)/l 2 43
45 Gaussian Processes Approach: II to estimate f 0, need to compute potentially messy likelihood: 1 2 yt K θ + σ 2 I n 1 y 1 2 log Ø ØØ K θ + σ 2 I n Ø ØØ + C, alternatively, could specify Gaussian process capturing periodic or quasi-periodic variations indirectly within a state-space framework, thus allowing use of Kalman filter (KF) can adjust basic structural model (BSM) used in econometrics, which assumes regular sampling, to work with irregular sampling (can be handled readily by state space models and KF) BSM has terms for periodic variations (seasonal component γ j ) and quasi-periodic variations (business cycle ψ j ): y j = µ j + γ j + ψ j + j, where µ j is trend, and j is an error term 44
46 Gaussian Processes Approach: III dynamics of seasonal component dictated by pair(s) of state variables patterned as follows: µ µ µ µ γj+1 cos (λs ) sin (λ = s ) γj ωj +, sin (λ s ) cos (λ s ) where γ j+1 with ω j and ω j µ ωj ω j N (0, σ 2 ωi 2 ), γ j ω j being uncorrelated with previous disturbances σ 2 ω = 0 yields harmonic process with frequency dictated by λ s, which can be treated as known or estimated σ 2 ω > 0 yields nonstationary process; i.e., amplitudes & phases can evolve 45
47 Gaussian Processes Approach: IV business cycle dictated by single pair of state variables: µ µ µ ψj+1 cos (λc ) sin (λ ψj+1 = ρ c ) ψj sin (λ c ) cos (λ c ) ψj + where µ κj N (0, σκi 2 2 ), κ j µ κj κ j, with κ j and κ j being uncorrelated with previous disturbances for ρ < 1, component is a stationary ARMA(2,1) process with associated period 2π/λ c above can (presumably!!!) be adjusted to work with irregular sampling, thus providing a Gaussian process with covariance matrix implicitly defined by ρ, λ c and σκ 2 (have interpretations analogous to those for l, f 0 and β in γ(τ) dictating K θ ) 46
48 Gaussian Processes Approach: V for problem of interest here, entertain either y j = γ j + j or y j = ψ j + j as appropriate models for capturing periodicity advantage is ability to evaluate likelihood function in a computationally easy manner (maintains Bayesian framework) Gaussian process approach does not appear to have any computational advantages over Hall et al. (2000) 47
49 Conclusions period estimation is in theory an easy statistical problem (n 3 rate of convergence), so could entertain strategy of trading efficiency for computation speed-up (direction for future research?) correntropy and Gaussian process approaches are of interest, but need to compare carefully with existing methods looking forward to new developments from Protopapas et al.! 48
50 Thanks to... Eric and Jogesh for the invitation to participate and for their considerable efforts in putting SCMA V together 49
51 References J. Durbin and S. J. Koopman (2001), Time Series Analysis by State Space Models, Oxford, England: Oxford University Press P. Hall (2008), Nonparametric Methods for Estimating Periodic Functions, with Applications in Astronomy, in COMPSTAT 2008: Proceedings in Computational Statistics, 18th Symposium, Porto, Portugal, Paula Brito, editor, Physica-Verlag, Heidelberg, 2008 pp P. Hall, J. Reimann and J. Rice (2000), Nonparametric Estimation of a Periodic Function, Biometrika, 87, pp A. C. Harvey (1989), Forecasting, Structural Time Series Models and the Kalman Filter, Cambridge, England: Cambridge University Press P. Huijse, P. A. Estévez, P. Zegers, J. C. Principe and P. Protopapas (2011), Period Estimation in Astronomical Time Series Using Slotted Correntropy, IEEE Signal Processing Letters, 18, pp S. J. Koopman and K. M. Lee (2009), Seasonality with Trend and Cycle Interactions in Unobserved Components Models, Journal of the Royal Statistical Society Series C (Applied Statistics), 58, pp
TREND ESTIMATION AND THE HODRICK-PRESCOTT FILTER
J. Japan Statist. Soc. Vol. 38 No. 1 2008 41 49 TREND ESTIMATION AND THE HODRICK-PRESCOTT FILTER Andrew Harvey* and Thomas Trimbur** The article analyses the relationship between unobserved component trend-cycle
More informationWavelet Methods for Time Series Analysis. Motivating Question
Wavelet Methods for Time Series Analysis Part VII: Wavelet-Based Bootstrapping start with some background on bootstrapping and its rationale describe adjustments to the bootstrap that allow it to work
More informationTime Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY
Time Series Analysis James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY & Contents PREFACE xiii 1 1.1. 1.2. Difference Equations First-Order Difference Equations 1 /?th-order Difference
More informationSTRUCTURAL TIME-SERIES MODELLING
1: Structural Time-Series Modelling STRUCTURAL TIME-SERIES MODELLING Prajneshu Indian Agricultural Statistics Research Institute, New Delhi-11001 1. Introduction. ARIMA time-series methodology is widely
More informationTime Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY
Time Series Analysis James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY PREFACE xiii 1 Difference Equations 1.1. First-Order Difference Equations 1 1.2. pth-order Difference Equations 7
More informationWavelet Methods for Time Series Analysis. Part IX: Wavelet-Based Bootstrapping
Wavelet Methods for Time Series Analysis Part IX: Wavelet-Based Bootstrapping start with some background on bootstrapping and its rationale describe adjustments to the bootstrap that allow it to work with
More informationStochastic Processes. M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno
Stochastic Processes M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno 1 Outline Stochastic (random) processes. Autocorrelation. Crosscorrelation. Spectral density function.
More informationTIME SERIES ANALYSIS. Forecasting and Control. Wiley. Fifth Edition GWILYM M. JENKINS GEORGE E. P. BOX GREGORY C. REINSEL GRETA M.
TIME SERIES ANALYSIS Forecasting and Control Fifth Edition GEORGE E. P. BOX GWILYM M. JENKINS GREGORY C. REINSEL GRETA M. LJUNG Wiley CONTENTS PREFACE TO THE FIFTH EDITION PREFACE TO THE FOURTH EDITION
More information{ } Stochastic processes. Models for time series. Specification of a process. Specification of a process. , X t3. ,...X tn }
Stochastic processes Time series are an example of a stochastic or random process Models for time series A stochastic process is 'a statistical phenomenon that evolves in time according to probabilistic
More informationWavelet-Based Bootstrapping for Non-Gaussian Time Series. Don Percival
Wavelet-Based Bootstrapping for Non-Gaussian Time Series Don Percival Applied Physics Laboratory Department of Statistics University of Washington Seattle, Washington, USA overheads for talk available
More informationWavelet Methods for Time Series Analysis. Part IV: Wavelet-Based Decorrelation of Time Series
Wavelet Methods for Time Series Analysis Part IV: Wavelet-Based Decorrelation of Time Series DWT well-suited for decorrelating certain time series, including ones generated from a fractionally differenced
More informationLevinson Durbin Recursions: I
Levinson Durbin Recursions: I note: B&D and S&S say Durbin Levinson but Levinson Durbin is more commonly used (Levinson, 1947, and Durbin, 1960, are source articles sometimes just Levinson is used) recursions
More informationResiduals in Time Series Models
Residuals in Time Series Models José Alberto Mauricio Universidad Complutense de Madrid, Facultad de Económicas, Campus de Somosaguas, 83 Madrid, Spain. (E-mail: jamauri@ccee.ucm.es.) Summary: Three types
More informationState-space Model. Eduardo Rossi University of Pavia. November Rossi State-space Model Fin. Econometrics / 53
State-space Model Eduardo Rossi University of Pavia November 2014 Rossi State-space Model Fin. Econometrics - 2014 1 / 53 Outline 1 Motivation 2 Introduction 3 The Kalman filter 4 Forecast errors 5 State
More informationStochastic Processes: I. consider bowl of worms model for oscilloscope experiment:
Stochastic Processes: I consider bowl of worms model for oscilloscope experiment: SAPAscope 2.0 / 0 1 RESET SAPA2e 22, 23 II 1 stochastic process is: Stochastic Processes: II informally: bowl + drawing
More informationAn estimate of the long-run covariance matrix, Ω, is necessary to calculate asymptotic
Chapter 6 ESTIMATION OF THE LONG-RUN COVARIANCE MATRIX An estimate of the long-run covariance matrix, Ω, is necessary to calculate asymptotic standard errors for the OLS and linear IV estimators presented
More informationTime Series Examples Sheet
Lent Term 2001 Richard Weber Time Series Examples Sheet This is the examples sheet for the M. Phil. course in Time Series. A copy can be found at: http://www.statslab.cam.ac.uk/~rrw1/timeseries/ Throughout,
More informationLevinson Durbin Recursions: I
Levinson Durbin Recursions: I note: B&D and S&S say Durbin Levinson but Levinson Durbin is more commonly used (Levinson, 1947, and Durbin, 1960, are source articles sometimes just Levinson is used) recursions
More informationEcon 582 Nonparametric Regression
Econ 582 Nonparametric Regression Eric Zivot May 28, 2013 Nonparametric Regression Sofarwehaveonlyconsideredlinearregressionmodels = x 0 β + [ x ]=0 [ x = x] =x 0 β = [ x = x] [ x = x] x = β The assume
More informationLocal Whittle Likelihood Estimators and Tests for non-gaussian Linear Processes
Local Whittle Likelihood Estimators and Tests for non-gaussian Linear Processes By Tomohito NAITO, Kohei ASAI and Masanobu TANIGUCHI Department of Mathematical Sciences, School of Science and Engineering,
More informationcovariance function, 174 probability structure of; Yule-Walker equations, 174 Moving average process, fluctuations, 5-6, 175 probability structure of
Index* The Statistical Analysis of Time Series by T. W. Anderson Copyright 1971 John Wiley & Sons, Inc. Aliasing, 387-388 Autoregressive {continued) Amplitude, 4, 94 case of first-order, 174 Associated
More information6.3 Forecasting ARMA processes
6.3. FORECASTING ARMA PROCESSES 123 6.3 Forecasting ARMA processes The purpose of forecasting is to predict future values of a TS based on the data collected to the present. In this section we will discuss
More informationARIMA Modelling and Forecasting
ARIMA Modelling and Forecasting Economic time series often appear nonstationary, because of trends, seasonal patterns, cycles, etc. However, the differences may appear stationary. Δx t x t x t 1 (first
More informationTesting for Regime Switching in Singaporean Business Cycles
Testing for Regime Switching in Singaporean Business Cycles Robert Breunig School of Economics Faculty of Economics and Commerce Australian National University and Alison Stegman Research School of Pacific
More informationTime Series: Theory and Methods
Peter J. Brockwell Richard A. Davis Time Series: Theory and Methods Second Edition With 124 Illustrations Springer Contents Preface to the Second Edition Preface to the First Edition vn ix CHAPTER 1 Stationary
More informationEconometría 2: Análisis de series de Tiempo
Econometría 2: Análisis de series de Tiempo Karoll GOMEZ kgomezp@unal.edu.co http://karollgomez.wordpress.com Segundo semestre 2016 II. Basic definitions A time series is a set of observations X t, each
More information6.435, System Identification
System Identification 6.435 SET 3 Nonparametric Identification Munther A. Dahleh 1 Nonparametric Methods for System ID Time domain methods Impulse response Step response Correlation analysis / time Frequency
More informationState-space Model. Eduardo Rossi University of Pavia. November Rossi State-space Model Financial Econometrics / 49
State-space Model Eduardo Rossi University of Pavia November 2013 Rossi State-space Model Financial Econometrics - 2013 1 / 49 Outline 1 Introduction 2 The Kalman filter 3 Forecast errors 4 State smoothing
More informationGMM, HAC estimators, & Standard Errors for Business Cycle Statistics
GMM, HAC estimators, & Standard Errors for Business Cycle Statistics Wouter J. Den Haan London School of Economics c Wouter J. Den Haan Overview Generic GMM problem Estimation Heteroskedastic and Autocorrelation
More informationEconometric Forecasting
Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna October 1, 2014 Outline Introduction Model-free extrapolation Univariate time-series models Trend
More informationQuantiles, Expectiles and Splines
Quantiles, Expectiles and Splines Andrew Harvey University of Cambridge December 2007 Harvey (University of Cambridge) QES December 2007 1 / 40 Introduction The movements in a time series may be described
More informationSF2943: TIME SERIES ANALYSIS COMMENTS ON SPECTRAL DENSITIES
SF2943: TIME SERIES ANALYSIS COMMENTS ON SPECTRAL DENSITIES This document is meant as a complement to Chapter 4 in the textbook, the aim being to get a basic understanding of spectral densities through
More informationIf we want to analyze experimental or simulated data we might encounter the following tasks:
Chapter 1 Introduction If we want to analyze experimental or simulated data we might encounter the following tasks: Characterization of the source of the signal and diagnosis Studying dependencies Prediction
More informationClass: Trend-Cycle Decomposition
Class: Trend-Cycle Decomposition Macroeconometrics - Spring 2011 Jacek Suda, BdF and PSE June 1, 2011 Outline Outline: 1 Unobserved Component Approach 2 Beveridge-Nelson Decomposition 3 Spectral Analysis
More informationModel-based trend-cycle decompositions. with time-varying parameters
Model-based trend-cycle decompositions with time-varying parameters Siem Jan Koopman Kai Ming Lee Soon Yip Wong s.j.koopman@ klee@ s.wong@ feweb.vu.nl Department of Econometrics Vrije Universiteit Amsterdam
More informationINTRODUCTION: WHAT IS A TREND?
INTRODUCTION: WHAT IS A TREND? The question of defining a trend is one which has exercised the minds of statisticians for many years. Most people would claim to be able to recognize a trend when they saw
More informationStatistical signal processing
Statistical signal processing Short overview of the fundamentals Outline Random variables Random processes Stationarity Ergodicity Spectral analysis Random variable and processes Intuition: A random variable
More informationWeek 5 Quantitative Analysis of Financial Markets Characterizing Cycles
Week 5 Quantitative Analysis of Financial Markets Characterizing Cycles Christopher Ting http://www.mysmu.edu/faculty/christophert/ Christopher Ting : christopherting@smu.edu.sg : 6828 0364 : LKCSB 5036
More informationDefect Detection using Nonparametric Regression
Defect Detection using Nonparametric Regression Siana Halim Industrial Engineering Department-Petra Christian University Siwalankerto 121-131 Surabaya- Indonesia halim@petra.ac.id Abstract: To compare
More informationLocal Polynomial Modelling and Its Applications
Local Polynomial Modelling and Its Applications J. Fan Department of Statistics University of North Carolina Chapel Hill, USA and I. Gijbels Institute of Statistics Catholic University oflouvain Louvain-la-Neuve,
More informationY t = φ t,t = s t,y t 1
Simulating Gaussian Random Processes with Specified Spectra * Donald B. Percival Applied Physics Laboratory, HN-10 niversity ofwashington Seattle, WA 98195 Abstract Abstract We discuss the problem ofgenerating
More informationTime series models in the Frequency domain. The power spectrum, Spectral analysis
ime series models in the Frequency domain he power spectrum, Spectral analysis Relationship between the periodogram and the autocorrelations = + = ( ) ( ˆ α ˆ ) β I Yt cos t + Yt sin t t= t= ( ( ) ) cosλ
More informationGaussian Processes. Le Song. Machine Learning II: Advanced Topics CSE 8803ML, Spring 2012
Gaussian Processes Le Song Machine Learning II: Advanced Topics CSE 8803ML, Spring 01 Pictorial view of embedding distribution Transform the entire distribution to expected features Feature space Feature
More informationCointegrating Regressions with Messy Regressors: J. Isaac Miller
NASMES 2008 June 21, 2008 Carnegie Mellon U. Cointegrating Regressions with Messy Regressors: Missingness, Mixed Frequency, and Measurement Error J. Isaac Miller University of Missouri 1 Messy Data Example
More informationTesting Restrictions and Comparing Models
Econ. 513, Time Series Econometrics Fall 00 Chris Sims Testing Restrictions and Comparing Models 1. THE PROBLEM We consider here the problem of comparing two parametric models for the data X, defined by
More informationProf. Dr. Roland Füss Lecture Series in Applied Econometrics Summer Term Introduction to Time Series Analysis
Introduction to Time Series Analysis 1 Contents: I. Basics of Time Series Analysis... 4 I.1 Stationarity... 5 I.2 Autocorrelation Function... 9 I.3 Partial Autocorrelation Function (PACF)... 14 I.4 Transformation
More informationA test for improved forecasting performance at higher lead times
A test for improved forecasting performance at higher lead times John Haywood and Granville Tunnicliffe Wilson September 3 Abstract Tiao and Xu (1993) proposed a test of whether a time series model, estimated
More informationOn Moving Average Parameter Estimation
On Moving Average Parameter Estimation Niclas Sandgren and Petre Stoica Contact information: niclas.sandgren@it.uu.se, tel: +46 8 473392 Abstract Estimation of the autoregressive moving average (ARMA)
More informationSTAT 520: Forecasting and Time Series. David B. Hitchcock University of South Carolina Department of Statistics
David B. University of South Carolina Department of Statistics What are Time Series Data? Time series data are collected sequentially over time. Some common examples include: 1. Meteorological data (temperatures,
More informationTrend Analysis. By Andrew Harvey. Keywords: component. global warming, outlier, prediction, signal extraction, stochastic trend, unit root, unobserved
Trend Analysis By Andrew Harvey Keywords: component global warming, outlier, prediction, signal extraction, stochastic trend, unit root, unobserved Abstract: The question of defining a trend is one which
More informationCh.10 Autocorrelated Disturbances (June 15, 2016)
Ch10 Autocorrelated Disturbances (June 15, 2016) In a time-series linear regression model setting, Y t = x tβ + u t, t = 1, 2,, T, (10-1) a common problem is autocorrelation, or serial correlation of the
More informationGaussian processes. Basic Properties VAG002-
Gaussian processes The class of Gaussian processes is one of the most widely used families of stochastic processes for modeling dependent data observed over time, or space, or time and space. The popularity
More informationModelling Non-linear and Non-stationary Time Series
Modelling Non-linear and Non-stationary Time Series Chapter 2: Non-parametric methods Henrik Madsen Advanced Time Series Analysis September 206 Henrik Madsen (02427 Adv. TS Analysis) Lecture Notes September
More informationECON 616: Lecture 1: Time Series Basics
ECON 616: Lecture 1: Time Series Basics ED HERBST August 30, 2017 References Overview: Chapters 1-3 from Hamilton (1994). Technical Details: Chapters 2-3 from Brockwell and Davis (1987). Intuition: Chapters
More informationStatistics: Learning models from data
DS-GA 1002 Lecture notes 5 October 19, 2015 Statistics: Learning models from data Learning models from data that are assumed to be generated probabilistically from a certain unknown distribution is a crucial
More informationGeneralised AR and MA Models and Applications
Chapter 3 Generalised AR and MA Models and Applications 3.1 Generalised Autoregressive Processes Consider an AR1) process given by 1 αb)x t = Z t ; α < 1. In this case, the acf is, ρ k = α k for k 0 and
More informationAsymptotic inference for a nonstationary double ar(1) model
Asymptotic inference for a nonstationary double ar() model By SHIQING LING and DONG LI Department of Mathematics, Hong Kong University of Science and Technology, Hong Kong maling@ust.hk malidong@ust.hk
More informationFORECASTING SUGARCANE PRODUCTION IN INDIA WITH ARIMA MODEL
FORECASTING SUGARCANE PRODUCTION IN INDIA WITH ARIMA MODEL B. N. MANDAL Abstract: Yearly sugarcane production data for the period of - to - of India were analyzed by time-series methods. Autocorrelation
More informationSpectral Analysis. Jesús Fernández-Villaverde University of Pennsylvania
Spectral Analysis Jesús Fernández-Villaverde University of Pennsylvania 1 Why Spectral Analysis? We want to develop a theory to obtain the business cycle properties of the data. Burns and Mitchell (1946).
More informationMINIMUM EXPECTED RISK PROBABILITY ESTIMATES FOR NONPARAMETRIC NEIGHBORHOOD CLASSIFIERS. Maya Gupta, Luca Cazzanti, and Santosh Srivastava
MINIMUM EXPECTED RISK PROBABILITY ESTIMATES FOR NONPARAMETRIC NEIGHBORHOOD CLASSIFIERS Maya Gupta, Luca Cazzanti, and Santosh Srivastava University of Washington Dept. of Electrical Engineering Seattle,
More informationMeasurement Error and Linear Regression of Astronomical Data. Brandon Kelly Penn State Summer School in Astrostatistics, June 2007
Measurement Error and Linear Regression of Astronomical Data Brandon Kelly Penn State Summer School in Astrostatistics, June 2007 Classical Regression Model Collect n data points, denote i th pair as (η
More informationTime Series Analysis -- An Introduction -- AMS 586
Time Series Analysis -- An Introduction -- AMS 586 1 Objectives of time series analysis Data description Data interpretation Modeling Control Prediction & Forecasting 2 Time-Series Data Numerical data
More informationStochastic Processes. A stochastic process is a function of two variables:
Stochastic Processes Stochastic: from Greek stochastikos, proceeding by guesswork, literally, skillful in aiming. A stochastic process is simply a collection of random variables labelled by some parameter:
More informationSTAD57 Time Series Analysis. Lecture 23
STAD57 Time Series Analysis Lecture 23 1 Spectral Representation Spectral representation of stationary {X t } is: 12 i2t Xt e du 12 1/2 1/2 for U( ) a stochastic process with independent increments du(ω)=
More informationCOMPUTER ALGEBRA DERIVATION OF THE BIAS OF LINEAR ESTIMATORS OF AUTOREGRESSIVE MODELS
COMPUTER ALGEBRA DERIVATION OF THE BIAS OF LINEAR ESTIMATORS OF AUTOREGRESSIVE MODELS Y. ZHANG and A.I. MCLEOD Acadia University and The University of Western Ontario May 26, 2005 1 Abstract. A symbolic
More informationTime Series Examples Sheet
Lent Term 2001 Richard Weber Time Series Examples Sheet This is the examples sheet for the M. Phil. course in Time Series. A copy can be found at: http://www.statslab.cam.ac.uk/~rrw1/timeseries/ Throughout,
More informationStatistics of Stochastic Processes
Prof. Dr. J. Franke All of Statistics 4.1 Statistics of Stochastic Processes discrete time: sequence of r.v...., X 1, X 0, X 1, X 2,... X t R d in general. Here: d = 1. continuous time: random function
More informationSingle Equation Linear GMM with Serially Correlated Moment Conditions
Single Equation Linear GMM with Serially Correlated Moment Conditions Eric Zivot October 28, 2009 Univariate Time Series Let {y t } be an ergodic-stationary time series with E[y t ]=μ and var(y t )
More informationwhere r n = dn+1 x(t)
Random Variables Overview Probability Random variables Transforms of pdfs Moments and cumulants Useful distributions Random vectors Linear transformations of random vectors The multivariate normal distribution
More informationAR, MA and ARMA models
AR, MA and AR by Hedibert Lopes P Based on Tsay s Analysis of Financial Time Series (3rd edition) P 1 Stationarity 2 3 4 5 6 7 P 8 9 10 11 Outline P Linear Time Series Analysis and Its Applications For
More informationAutoregressive Moving Average (ARMA) Models and their Practical Applications
Autoregressive Moving Average (ARMA) Models and their Practical Applications Massimo Guidolin February 2018 1 Essential Concepts in Time Series Analysis 1.1 Time Series and Their Properties Time series:
More informationChapter 3 - Temporal processes
STK4150 - Intro 1 Chapter 3 - Temporal processes Odd Kolbjørnsen and Geir Storvik January 23 2017 STK4150 - Intro 2 Temporal processes Data collected over time Past, present, future, change Temporal aspect
More informationSTAT 443 Final Exam Review. 1 Basic Definitions. 2 Statistical Tests. L A TEXer: W. Kong
STAT 443 Final Exam Review L A TEXer: W Kong 1 Basic Definitions Definition 11 The time series {X t } with E[X 2 t ] < is said to be weakly stationary if: 1 µ X (t) = E[X t ] is independent of t 2 γ X
More informationX t = a t + r t, (7.1)
Chapter 7 State Space Models 71 Introduction State Space models, developed over the past 10 20 years, are alternative models for time series They include both the ARIMA models of Chapters 3 6 and the Classical
More informationGeneralized Autoregressive Score Smoothers
Generalized Autoregressive Score Smoothers Giuseppe Buccheri 1, Giacomo Bormetti 2, Fulvio Corsi 3,4, and Fabrizio Lillo 2 1 Scuola Normale Superiore, Italy 2 University of Bologna, Italy 3 University
More informationLinear models. Chapter Overview. Linear process: A process {X n } is a linear process if it has the representation.
Chapter 2 Linear models 2.1 Overview Linear process: A process {X n } is a linear process if it has the representation X n = b j ɛ n j j=0 for all n, where ɛ n N(0, σ 2 ) (Gaussian distributed with zero
More informationIS THE NORTH ATLANTIC OSCILLATION A RANDOM WALK? A COMMENT WITH FURTHER RESULTS
INTERNATIONAL JOURNAL OF CLIMATOLOGY Int. J. Climatol. 24: 377 383 (24) Published online 11 February 24 in Wiley InterScience (www.interscience.wiley.com). DOI: 1.12/joc.13 IS THE NORTH ATLANTIC OSCILLATION
More informationEconomic modelling and forecasting
Economic modelling and forecasting 2-6 February 2015 Bank of England he generalised method of moments Ole Rummel Adviser, CCBS at the Bank of England ole.rummel@bankofengland.co.uk Outline Classical estimation
More informationTime series and spectral analysis. Peter F. Craigmile
Time series and spectral analysis Peter F. Craigmile http://www.stat.osu.edu/~pfc/ Summer School on Extreme Value Modeling and Water Resources Universite Lyon 1, France. 13-24 Jun 2016 Thank you to The
More informationStatistical Inference and Methods
Department of Mathematics Imperial College London d.stephens@imperial.ac.uk http://stats.ma.ic.ac.uk/ das01/ 31st January 2006 Part VI Session 6: Filtering and Time to Event Data Session 6: Filtering and
More informationA time series is a set of observations made sequentially in time.
Time series and spectral analysis Peter F. Craigmile Analyzing time series A time series is a set of observations made sequentially in time. R. A. Fisher: One damned thing after another. Time series analysis
More informationTIME SERIES AND FORECASTING. Luca Gambetti UAB, Barcelona GSE Master in Macroeconomic Policy and Financial Markets
TIME SERIES AND FORECASTING Luca Gambetti UAB, Barcelona GSE 2014-2015 Master in Macroeconomic Policy and Financial Markets 1 Contacts Prof.: Luca Gambetti Office: B3-1130 Edifici B Office hours: email:
More informationLecture 2: Univariate Time Series
Lecture 2: Univariate Time Series Analysis: Conditional and Unconditional Densities, Stationarity, ARMA Processes Prof. Massimo Guidolin 20192 Financial Econometrics Spring/Winter 2017 Overview Motivation:
More informationYou must continuously work on this project over the course of four weeks.
The project Five project topics are described below. You should choose one the projects. Maximum of two people per project is allowed. If two people are working on a topic they are expected to do double
More informationDifferencing Revisited: I ARIMA(p,d,q) processes predicated on notion of dth order differencing of a time series {X t }: for d = 1 and 2, have X t
Differencing Revisited: I ARIMA(p,d,q) processes predicated on notion of dth order differencing of a time series {X t }: for d = 1 and 2, have X t 2 X t def in general = (1 B)X t = X t X t 1 def = ( X
More informationStatistics of stochastic processes
Introduction Statistics of stochastic processes Generally statistics is performed on observations y 1,..., y n assumed to be realizations of independent random variables Y 1,..., Y n. 14 settembre 2014
More informationELEMENTS OF PROBABILITY THEORY
ELEMENTS OF PROBABILITY THEORY Elements of Probability Theory A collection of subsets of a set Ω is called a σ algebra if it contains Ω and is closed under the operations of taking complements and countable
More informationSingle Index Quantile Regression for Heteroscedastic Data
Single Index Quantile Regression for Heteroscedastic Data E. Christou M. G. Akritas Department of Statistics The Pennsylvania State University SMAC, November 6, 2015 E. Christou, M. G. Akritas (PSU) SIQR
More informationAn Efficient and Fast Algorithm for Estimating the Parameters of Sinusoidal Signals
An Efficient and Fast Algorithm for Estimating the Parameters of Sinusoidal Signals Swagata Nandi 1 Debasis Kundu Abstract A computationally efficient algorithm is proposed for estimating the parameters
More informationResearch Article Optimal Portfolio Estimation for Dependent Financial Returns with Generalized Empirical Likelihood
Advances in Decision Sciences Volume 2012, Article ID 973173, 8 pages doi:10.1155/2012/973173 Research Article Optimal Portfolio Estimation for Dependent Financial Returns with Generalized Empirical Likelihood
More informationGARCH Models Estimation and Inference
Università di Pavia GARCH Models Estimation and Inference Eduardo Rossi Likelihood function The procedure most often used in estimating θ 0 in ARCH models involves the maximization of a likelihood function
More informationA new covariance function for spatio-temporal data analysis with application to atmospheric pollution and sensor networking
A new covariance function for spatio-temporal data analysis with application to atmospheric pollution and sensor networking György Terdik and Subba Rao Tata UofD, HU & UofM, UK January 30, 2015 Laboratoire
More informationAutomatic Local Smoothing for Spectral Density. Abstract. This article uses local polynomial techniques to t Whittle's likelihood for spectral density
Automatic Local Smoothing for Spectral Density Estimation Jianqing Fan Department of Statistics University of North Carolina Chapel Hill, N.C. 27599-3260 Eva Kreutzberger Department of Mathematics University
More informationThe Spectral Density Estimation of Stationary Time Series with Missing Data
The Spectral Density Estimation of Stationary Time Series with Missing Data Jian Huang and Finbarr O Sullivan Department of Statistics University College Cork Ireland Abstract The spectral estimation of
More informationSingle Equation Linear GMM with Serially Correlated Moment Conditions
Single Equation Linear GMM with Serially Correlated Moment Conditions Eric Zivot November 2, 2011 Univariate Time Series Let {y t } be an ergodic-stationary time series with E[y t ]=μ and var(y t )
More informationFourier Analysis of Stationary and Non-Stationary Time Series
Fourier Analysis of Stationary and Non-Stationary Time Series September 6, 2012 A time series is a stochastic process indexed at discrete points in time i.e X t for t = 0, 1, 2, 3,... The mean is defined
More informationModel Selection and Geometry
Model Selection and Geometry Pascal Massart Université Paris-Sud, Orsay Leipzig, February Purpose of the talk! Concentration of measure plays a fundamental role in the theory of model selection! Model
More informationIntegrated Likelihood Estimation in Semiparametric Regression Models. Thomas A. Severini Department of Statistics Northwestern University
Integrated Likelihood Estimation in Semiparametric Regression Models Thomas A. Severini Department of Statistics Northwestern University Joint work with Heping He, University of York Introduction Let Y
More informationTime Series. Anthony Davison. c
Series Anthony Davison c 2008 http://stat.epfl.ch Periodogram 76 Motivation............................................................ 77 Lutenizing hormone data..................................................
More informationPATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 13: SEQUENTIAL DATA
PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 13: SEQUENTIAL DATA Contents in latter part Linear Dynamical Systems What is different from HMM? Kalman filter Its strength and limitation Particle Filter
More information