Figure 18: Top row: example of a purely continuous spectrum (left) and one realization

Similar documents
Additional exercises in Stationary Stochastic Processes

The Discrete Fourier Transform (DFT) Properties of the DFT DFT-Specic Properties Power spectrum estimate. Alex Sheremet.

Practical Spectral Estimation

Automatic Autocorrelation and Spectral Analysis

FGN 1.0 PPL 1.0 FD

covariance function, 174 probability structure of; Yule-Walker equations, 174 Moving average process, fluctuations, 5-6, 175 probability structure of

Chapter 4: Models for Stationary Time Series

Time Series Examples Sheet

Advanced Digital Signal Processing -Introduction

CONTENTS NOTATIONAL CONVENTIONS GLOSSARY OF KEY SYMBOLS 1 INTRODUCTION 1

Fourier Analysis of Stationary and Non-Stationary Time Series

Lecture 4 - Spectral Estimation

Statistics 349(02) Review Questions

Harmonic Analysis: I. consider following two part stationary process: X t = µ + D l cos (2πf l t t + φ l ) {z }

Lecture 11: Spectral Analysis

Chapter 6: Model Specification for Time Series

Figure 3.1 Effect on frequency spectrum of increasing period T 0. Consider the amplitude spectrum of a periodic waveform as shown in Figure 3.2.

Module 3. Descriptive Time Series Statistics and Introduction to Time Series Models

Lecture 3: Autoregressive Moving Average (ARMA) Models and their Practical Applications

CHAPTER 8 ANALYSIS OF AVERAGE SQUARED DIFFERENCE SURFACES

Review of spectral analysis methods applied to sea level anomaly signals

(a)

Linear models. Chapter Overview. Linear process: A process {X n } is a linear process if it has the representation.

Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science : Discrete-Time Signal Processing

IV. Covariance Analysis

SF2943: TIME SERIES ANALYSIS COMMENTS ON SPECTRAL DENSITIES

TLT-5200/5206 COMMUNICATION THEORY, Exercise 3, Fall TLT-5200/5206 COMMUNICATION THEORY, Exercise 3, Fall Problem 1.

In many diverse fields physical data is collected or analysed as Fourier components.

STAD57 Time Series Analysis. Lecture 23

Time Series: Theory and Methods

Signal processing Frequency analysis

Part III Spectrum Estimation

( x) f = where P and Q are polynomials.

Autoregressive tracking of vortex shedding. 2. Autoregression versus dual phase-locked loop

Lecture 7 Random Signal Analysis

ENSC327 Communications Systems 2: Fourier Representations. School of Engineering Science Simon Fraser University

Some Time-Series Models

Time series models in the Frequency domain. The power spectrum, Spectral analysis

Autoregressive Models Fourier Analysis Wavelets

3 Theory of stationary random processes

Heteroskedasticity and Autocorrelation Consistent Standard Errors

Econometría 2: Análisis de series de Tiempo

Module 29.3: nag tsa spectral Time Series Spectral Analysis. Contents

TIME SERIES ANALYSIS. Forecasting and Control. Wiley. Fifth Edition GWILYM M. JENKINS GEORGE E. P. BOX GREGORY C. REINSEL GRETA M.

Covariances of ARMA Processes

SIO 210: Data analysis

SIO 210: Data analysis methods L. Talley, Fall Sampling and error 2. Basic statistical concepts 3. Time series analysis

Biomedical Signal Processing and Signal Modeling

Treatment and analysis of data Applied statistics Lecture 6: Bayesian estimation

Classic Time Series Analysis

SOLUTIONS BSc and MSci EXAMINATIONS (MATHEMATICS) MAY JUNE 2002 This paper is also taken for the relevant examination for the Associateship.

EEM 409. Random Signals. Problem Set-2: (Power Spectral Density, LTI Systems with Random Inputs) Problem 1: Problem 2:

We will only present the general ideas on how to obtain. follow closely the AR(1) and AR(2) cases presented before.

Notes on Wavelets- Sandra Chapman (MPAGS: Time series analysis) # $ ( ) = G f. y t

Time Series Solutions HT 2009

2.161 Signal Processing: Continuous and Discrete Fall 2008

THE PROCESSING of random signals became a useful

Time Series Examples Sheet

SIO 211B, Rudnick. We start with a definition of the Fourier transform! ĝ f of a time series! ( )

4.5 Nonparametric Spectral Estimation

Visualising the spectral analysis of time series

Minitab Project Report Assignment 3

Data Processing and Analysis

ADSP ADSP ADSP ADSP. Advanced Digital Signal Processing (18-792) Spring Fall Semester, Department of Electrical and Computer Engineering

Marcel Dettling. Applied Time Series Analysis SS 2013 Week 05. ETH Zürich, March 18, Institute for Data Analysis and Process Design

SIO 210 CSP: Data analysis methods L. Talley, Fall Sampling and error 2. Basic statistical concepts 3. Time series analysis

3. ARMA Modeling. Now: Important class of stationary processes

Longitudinal Waves. Reading: Chapter 17, Sections 17-7 to Sources of Musical Sound. Pipe. Closed end: node Open end: antinode

Applied Time. Series Analysis. Wayne A. Woodward. Henry L. Gray. Alan C. Elliott. Dallas, Texas, USA

Homework 2. For the homework, be sure to give full explanations where required and to turn in any relevant plots.

A Fourier Transform Model in Excel #1

Autoregressive (AR) spectral estimates for Frequency- Wavenumber (F-k) analysis of strong-motion data

NOTES AND CORRESPONDENCE. A Quantitative Estimate of the Effect of Aliasing in Climatological Time Series

Additional Pointers. Introduction to Computer Vision. Convolution. Area operations: Linear filtering

STATISTICS. 1. Measures of Central Tendency

Chapter 3: Regression Methods for Trends

Notes on Random Processes

E 4101/5101 Lecture 6: Spectral analysis

IDENTIFICATION OF ARMA MODELS

7. MULTIVARATE STATIONARY PROCESSES

Supplement To: Search for Tensor, Vector, and Scalar Polarizations in the Stochastic Gravitational-Wave Background

Ch 4. Models For Stationary Time Series. Time Series Analysis

Advanced Econometrics

Reliability and Risk Analysis. Time Series, Types of Trend Functions and Estimates of Trends

Time Series. Anthony Davison. c

LECTURE ON HAC COVARIANCE MATRIX ESTIMATION AND THE KVB APPROACH

Asymptote. 2 Problems 2 Methods

An introduction to volatility models with indices

Functions Modeling Change A Preparation for Calculus Third Edition

Contents. Digital Signal Processing, Part II: Power Spectrum Estimation

Elec4621 Advanced Digital Signal Processing Chapter 11: Time-Frequency Analysis

1. How can you tell if there is serial correlation? 2. AR to model serial correlation. 3. Ignoring serial correlation. 4. GLS. 5. Projects.

Booth School of Business, University of Chicago Business 41914, Spring Quarter 2017, Mr. Ruey S. Tsay Midterm

Module 4. Stationary Time Series Models Part 1 MA Models and Their Properties

The Fourier Transform

Stochastic Processes: I. consider bowl of worms model for oscilloscope experiment:

On Moving Average Parameter Estimation

Lecture 17: variance in a band = log(s xx (f)) df (2) If we want to plot something that is more directly representative of variance, we can try this:

BME 50500: Image and Signal Processing in Biomedicine. Lecture 5: Correlation and Power-Spectrum CCNY

Covariance Stationary Time Series. Example: Independent White Noise (IWN(0,σ 2 )) Y t = ε t, ε t iid N(0,σ 2 )

Transcription:

1..5 S(). -.2 -.5 -.25..25.5 64 128 64 128 16 32 requency time time Lag 1..5 S(). -.5-1. -.5 -.1.1.5 64 128 64 128 16 32 requency time time Lag Figure 18: Top row: example o a purely continuous spectrum (let) and one realization o length 128 (right). Bottom row: example o a purely discrete spectrum (let) and one realization o length 128 (right). Figure 19: Top row: realization o process with purely continuous spectrum (let) and sample autocorrelation (right). Bottom row: realization o process with purely discrete spectrum (let) and sample autocorrelation (right). 19 2

sd () acvs..1.2.3.4.5 1 2 3 4 5 Lag sd () acvs..1.2.3.4.5 1 2 3 4 5 Lag 1 2 3 4 5 6 7 8 t Figure 2: Two spectral density unctions (let) and their corresponding autocovariance sequences (right). Figure 21: Illustration o the aliasing eect. The dotted curves above show cos(t) versus t. The solid curves show cos([1 + 2kπ]t) versus t or (rom top to bottom) k = 1, 2 and 3. The solid black squares show the common value o all our sinusoids when sampled at t =, 1,..., 8. 21 22

Fig 21a: The concept o aliasing illustrated or two dierent sample intervals. In each picture the thin black line is the continuous spectrum, and the thick black line is the resulting spectrum or the discrete process (which is periodic, as shown by its continuation with the thick grey line).!"#$..25.5!"#%..25.5! "#$..25.5! "#%..25.5 Figure 22: Examples o MA(1) spectra when θ 1,1 is positive we have a high requency spectrum and when θ 1,1 is negative we have a low requency spectrum 23

!"#$! "#$!"#$%&#$%' (#$%( (#$%)!" #$% #$%' (" #$%)( (" #$%))..25.5..25.5..25.5!"#%! "#%..25.5!"#$% #$*' ("#$%)( (" #$*)!" #$%&#$*' (" #$%)( ("#$*))..25.5..25.5..25.5..25.5 Figure 23: Examples o AR(1) spectra when φ 1,1 is positive we have a low requency spectrum and when φ 1,1 is negative we have a high requency spectrum Figure 24: Examples o AR(2) spectra with real characteristic reciprocal roots, a = r 1 and b = r 2, giving AR parameter values o: φ 1,2 = r 1 + r 2 and φ 2,2 = r 1 r 2 24 25

!"#$%&'(#)# '%*+'$#,!"#$%$--#)# '%.*#, 2 1-1 -2-3 -4..2.4..2.4 2 1!"# $%&'(#)# '%*+'$#,!"# $%$--#)# '%.*#, -1-2 -3-4 2 1-1..2.4..2.4-2 -3-4..1.2.3.4.5 Figure 25: Examples o AR(2) spectra with complex characteristic reciprocal roots, re ±i2π, with r =.99 or the plots in the let column and r =.7 or the plots in the right column, and =.1 or the plots in the irst row, and =.4 or the plots in the second row, the AR parameter values (as shown in the titles) can be calculated rom φ 1,2 = 2r cos(2π) and φ 2,2 = r 2 Figure 26: Inconsistency o the periodogram. The plots show the periodogram (on a decibel scale) o a unit variance white noise process o length (rom top to bottom) N = 128, 256 and 124. The horizontal dashed line indicates the true sd. 26 27

2 1 1-1 -2-3 -4-1 2 1-1 -2-3 1-4 2 1-1 -1-2 -3..1.2.3.4.5-4 -.5 -.25..25.5 Figure 27: Fejér s kernel or sample sizes N = 8, 32 and 128 Figure 28: Bias properties o the periodogram or an AR(2) process with low dynamic range. The thick curves are the true sd S(), while the thin curves are E{Ŝ(p) ()} or sample sizes (rom top to bottom) N = 16 and 64. 28 29

6 4 2-2 -4 6 4 2-2 -4 6 4 2 h h h.3 2.2-2 -4.1-6. -8.3 2.2-2 -4.1-6. -8-2.3 2-4.2 6-2 4 2-2.1. -4-6 -8-4..1.2.3.4.5 32 64..1.2.3.4.5 Figure 29: Bias properties o the periodogram or an AR(4) process with high dynamic range. The thick curves are the true sd S(), while the thin curves are E{Ŝ(p) ()} or sample sizes (rom top to bottom) N = 16, 64, 256 and 124. Figure 3: Dierent data tapers (let column) and associated spectral windows H() (right column), or N = 64. The tapers are a rectangular taper (top), a 2% (middle) and 5% (bottom) split cosine bell taper. 3 31

6 6 N=64, original data N=64, tapered data 4 4 2 2-2 -4 6 4 2-2 -4 6 4 2-2 -4 16 32 48 64 16 32 48 64 6 N=256, original data N=256, tapered data 4 2-2 -4 64 128 192 256 64 128 192 256 6 N=124, original data N=124, tapered data 4 2-2 -2-4 -4 256 512 768 124 256 512 768 124..1.2.3.4.5..1.2.3.4.5 Figure 31: Bias properties o direct spectral estimators or an AR(4) process with high dynamic range, using a 2% (let column) and 5% (right column) split cosine bell taper. The thick curves are the true sd S(), while the thin curves are E{Ŝ(p) ()} or sample sizes (rom top to bottom) N = 16, 64 and 256. Figure 32: The let column shows simulations rom the AR(4) model: X t = 2.767X t 1 3.816X t 2 + 2.6535X t 3.9258X t 4 + t For (rom top to bottom) N = 64, 256 and 124. The right column shows {X t h t } where {h t } is the appropriate length 5% split cosine bell taper. 32 33

6 N=64, Yule-Walker AR(4) 6 N=64, Yule-Walker AR(8) 4 4 2 2-2 -4 6 N=256, Yule-Walker AR(4) 4 2-2 -4 6 N=124, Yule-Walker AR(4) 4 2-2 -4 6 N=256, Yule-Walker AR(8) 4 2-2 -4 6 N=124, Yule-Walker AR(8) 4 2-2 -2-4 -4..1.2.3.4.5..1.2.3.4.5 Figure 33: The thick line shows the spectrum o the AR(4) process associated with the Yule-Walker estimates o φ 1,4,..., φ 4,4, or the sequences shown in the let column o Figure 32 (i.e. untapered). The thin line shows the true spectrum. Figure 34: The thick line shows the spectrum o the AR(8) process associated with the Yule-Walker estimates o φ 1,8,..., φ 8,8, or the sequences shown in the let column o Figure 32 (i.e. untapered). The thin line shows the true spectrum. 34 35

6 N=64, Tapered Yule-Walker AR(4) 4 2-2 -4 6 N=256, Tapered Yule-Walker AR(4) 4 2-2 -4 6 N=124, Tapered Yule-Walker AR(4) 4 2-2 -4..1.2.3.4.5 Figure 35: The thick line shows the spectrum o the AR(4) process associated with the Yule-Walker estimates o φ 1,4,..., φ 4,4, or the sequences shown in the right column o Figure 32 (i.e. tapered). The thin line shows the true spectrum. 36