Lecture 11: Spectral Analysis
|
|
- Juliana Richard
- 6 years ago
- Views:
Transcription
1 Lecture 11: Spectral Analysis Methods For Estimating The Spectrum Walid Sharabati Purdue University Latest Update October 27, 2016 Professor Sharabati (Purdue University) Time Series Analysis October 27, / 24
2 Methods for Estimating the Spectrum Fourier Analysis The approximation of a function by taking sum of sine and cosine terms, is called the Fourier series representation and, for a function f(t), is given by f(t) = a (a k cos kt + b k sin kt), where a 0 = 1 π π π f(t) dt. a k = 1 π b k = 1 π converges to π π π π k=1 f(t) cos kt dt, k = 1, 2,. f(t) sin kt dt, k = 1, 2,. Fourier series f(t) as k except at points of discontinuity, where it converges to halfway up the step change 1 2 [f(t 0) + f(t + 0)] (the average of the limit from below and the limit from above). Professor Sharabati (Purdue University) Time Series Analysis October 27, / 24
3 Methods for Estimating the Spectrum Traditional Method Consider a simple deterministic sinusoidal function at ω, together with a random error term Z t. X t = µ + α cos ωt + β sin ωt + Z t, where Z t is pure random process. Then, X 1 = µ + α cos ω + β sin ω + Z 1, X 2 = µ + α cos 2ω + β sin 2ω + Z 2,. X = µ + α cos ω + β sin ω + Z, where is the total number of observations. Professor Sharabati (Purdue University) Time Series Analysis October 27, / 24
4 Methods for Estimating the Spectrum Traditional Method X = Y i = β 0 + β 1 X 1,i + β 2 X 2,i + ɛ i. 1 cos ω sin ω µ., θ = α 1 cos 2ω sin 2ω, A = β cos ω sin ω X 1 X is the least squares estimator. ˆθ = ( A T A ) 1 A T X, These formulae hold for any value of ω, but only make practical sense for ω that are not too high or too low. Professor Sharabati (Purdue University) Time Series Analysis October 27, / 24
5 Methods for Estimating the Spectrum Types of Frequencies yquist Frequency The highest frequency we can uniquely fit to the data is the yquist frequency, given by ω = π, which completes one cycle every two observations (T = 2). ω = π, f = ω 2π = 1 2, T = 2π ω = 1 f = 2. Fundamental Frequency The frequency at which the whole length of the time series completes only one cycle, i.e. T =, is called the fundamental frequency. T =, f = 1 T = 1, ω = 2π T = 2πf = 2π. For simplicity, we restrict ω to one of the values. Professor Sharabati (Purdue University) Time Series Analysis October 27, / 24
6 Methods for Estimating the Spectrum Harmonies This means that ω p is between 2π ω p = 2π p, p = 1,, 2. and π, and equally spaced. X t = µ + α cos ω p t + β sin ω p t + Z t. p 2 ˆµ = X, ˆα = 2 2 Xt cos ω p t, ˆβ = Xt sin ω p t. If p = 2, ω p = π and sin πt = 0. Then, p = 2 ˆµ = X, ˆα = ( 1) t X t, ˆβ = 0. Professor Sharabati (Purdue University) Time Series Analysis October 27, / 24
7 Methods for Estimating the Spectrum Time series with three harmonic components. x1 <- 2 * cos(2*pi * 1 : 100 * 6/100) + 3 * sin(2*pi * 1 : 100 x2 <- 4 * cos(2*pi * 1 : 100 * 10/100) + 5 * sin(2*pi * 1 : 10 x3 <- 6 * cos(2*pi * 1 : 100 * 40/100) + 7 * sin(2*pi * 1 : 10 x <- x1 + x2 + x3 par( mfrow=c(2,2) ) plot.ts(x1, ylim=c(-10,10), main=expression(omega==6/100~~~ A2 plot.ts(x2, ylim=c(-10,10), main=expression(omega==10/100~~~ A plot.ts(x3, ylim=c(-10,10), main=expression(omega==40/100~~~ A plot.ts(x, ylim=c(-16,16), main= sum ) Professor Sharabati (Purdue University) Time Series Analysis October 27, / 24
8 Methods for Estimating the Spectrum yquist vs Fundamental Frequency If the observations are taken at equal intervals of time t, then yquist (highest) frequency is ω = π t corresponds to f = ω 2π = 1 2 t and T = 2 t. T = 2, completes one cycle every two observations. Fundamental (lowest) frequency is ω = 2π 1 t corresponds to f = t and T = t. T =, it takes the whole length of time series to complete one cycle. Harmonies are ω p = 2πp t, p = 1, 2,, 2. Figure : Frequency vs Cycle. Professor Sharabati (Purdue University) Time Series Analysis October 27, / 24
9 Methods for Estimating the Spectrum yquist vs Fundamental Frequency yquist ω = π t only depends on sampling frequency. The higher the frequency of interest, the more frequently to take observations. Example Daily temperature series cannot give you the variation of temperature within a day. 2π Fundamental ω = t depends on or t, i.e. the length. The lower the frequency of interest, the longer the time period to take observations. Example Half year (6 months) winter temperature cannot help decide the trend of the year. Professor Sharabati (Purdue University) Time Series Analysis October 27, / 24
10 Periodic Function f(t) is periodic with period T if f(t + nt ) = f(t) for all n. If f(t) is periodic then then f = 1 T, ω = 2π T and ω p = 2πp T is harmonies. is the fundamental frequency The Fourier series representation of a periodic function f(t) is a sum of harmonies f(t) = X t = a 0 + Alternatively, we may get... 2 p=1 a p ˆα p cos 2πp ω p 2πp t + b p sin ˆβ p ω p t. Professor Sharabati (Purdue University) Time Series Analysis October 27, / 24
11 X t = µ + α p cos 2πp ω p t + β p sin 2πp ω p t + Z t. Repeat the analysis to find α p, β p at all frequencies 2π, 4π,, π for p = 1, 2,, 2. We end up with finite Fourier series representation of X t πp X t = a 0 + a p cos t + b 2πp p sin t +a cos πt, for t = 1, 2,,. 2 p=1 ˆα p ˆβ p If p = 2, ω p = π, sin πt = 0. a 0 = X, a 2 a p = 2 ( 2πpt X t cos t b p = 2 ( 2πpt X t sin t This is called Fourier analysis or harmonic analysis. = 1 t ( 1)t X t. ), for p = 1, 2,, 2 1. ), for p = 1, 2,, 2 1. Professor Sharabati (Purdue University) Time Series Analysis October 27, / 24
12 Harmonic Analysis The overall effect of the Fourier analysis is to partition the variability of the series into components at frequencies 2π, 4π,, π. The p th harmonic is given by where R p = a p cos ω p t + b p sin ω p t = R p cos(ω p t + φ p ), a 2 p + b 2 p is the amplitude, and φ p = tan 1 ( bp phase of the p th harmonic. R 2 p = a 2 p + b 2 p. a p ) is the Professor Sharabati (Purdue University) Time Series Analysis October 27, / 24
13 Scaled Periodogram We define a scaled periodogram as ( p ) P = [ 2 ( )] 2πpt 2 [ 2 Xt cos + = a 2 p + b 2 p. ( )] 2πpt 2 Xt sin Think of it as a measure of square correlation between the data and the sinusoids oscillating at the frequency p =. P (p/) = P (1 p/) - the mirror effect; that is why 1 2 is the highest folding frequency. Computed using the fast Fourier transform (FFT). Professor Sharabati (Purdue University) Time Series Analysis October 27, / 24
14 Periodogram Theorem Parseval s theorem: The total variance of X t is given by (Xt X) 2 = 2 1 p=1 R 2 p 2 + a R2 p is the contribution of the p th harmonic to the variance. The total variance is partitioned. Plot 1 2 R2 p against ω p = 2πp line spectrum. Professor Sharabati (Purdue University) Time Series Analysis October 27, / 24
15 Take 1 2 R2 p as the contribution to the variance in the range ω p ± π Figure : Last rectangle is a R2 p = area of histogram rectangle = I(ω p ) 2π = 1 2 R2 p, where I(ω p ) denote the height of the histogram at ω p. So, I(ω p ) = 1 2 R2 p 2π = R2 p 4π, for p = 1, 2,, 2 1. Professor Sharabati (Purdue University) Time Series Analysis October 27, / 24
16 For p = 2, ω p = π I(ω p ) π [ ] in the range ( 1) π, π so that ( I ω 2 = a2 2 I(ω p ) vs ω p is called the periodogram. ) = I(π) = π a2. 2 is the contribution to variance Figure : Periodogram. Total area = Var(X t ). Professor Sharabati (Purdue University) Time Series Analysis October 27, / 24
17 Periodogram I(ω p ) = R2 p 4π = (a2 p + b 2 p) 4π { [ = 1 ( )] 2πpt 2 [ ( )] } 2πpt 2 π Xt cos + Xt sin, for p = 1, 2,, 2. I(ω p ) appears to be a natural way of estimating f(ω). Professor Sharabati (Purdue University) Time Series Analysis October 27, / 24
18 Relationship Between I(ω p ) and c k Let c k be the empirical acv.f. ( I(ω p ) = f(ω) = ( c γ k=1 c k cos ω p k ) /π. ) γ k cos ωk /π. k=1 I(ω p ) and f(ω) are similar, in a sense replace γ k by c k for k up to 1. Although E(I(ω)) f(ω), which means it s unbiased. Var[I(ω)] 0 as. If X estimates µ, we have E( X) = µ, and Var( X) = σ 2 0 as. X is a good unbiased estimator for µ. Thus, I(ω) is not a consistent estimator, it is a bad estimator. Consistent estimators can be obtained by smoothing the periodogram (average). Professor Sharabati (Purdue University) Time Series Analysis October 27, / 24
19 Spectral Density Estimation: Transforming the Truncated ACF For a set of weights λ k, and a number M <, introduce { } ˆf(ω) = 1 M λ 0 c λ k c k cos ωk π k=1 c k s are downweighted as M gets closer to while M = O() as. Possible windows: Tukey window: λ k = 1 2 ( ) 1 + cos πk M. Parzen window: λ k = 1 6 ( k M ) ( k M ) 3 if 0 k M 2 and λ k = 2 ( 1 k M ) 3 if M 2 k M. Bartlett window: λ k = 1 k M. Tukey is probably the most commonly used while Bartlett is the least common today. The choice of M relies on the balance of resolution vs variance : the larger M - the rougher the result; commonly, M is selected to be M = 2. Professor Sharabati (Purdue University) Time Series Analysis October 27, / 24
20 Spectral Density Estimation: Smoothing the Periodogram Basic smoothing: ˆf(ω) = 1 I(ω p ), m where ω p = 2πp and p = 1, 2,, m. It is assumed that ω p are symmetric around ω the frequency of interest. The choice of group size m is also about the balance of bias vs variance only now the larger m is the smoother the result. Popular value of m = 2. A somewhat better option is to use a weighted average, e.g. m ( ˆf(ω) = w k I ω p + k ) n k= m with positive weights w k such that m k= m w k = 1; weights usually decrease as distance from the center weight w 0 increases. Professor Sharabati (Purdue University) Time Series Analysis October 27, / 24 p
21 Confidence Intervals for the Spectrum For the lag window estimators, define the number of degrees of freedom 2 df = M. k= M λ2 k Then, the (1 α) 100% confidence interval is ( df ˆf(ω) ) ˆf(ω), df. χ 2 df,α/2 χ 2 df,1 α/2 For the smoothed periodogram, the situation is similar except that the number of degrees of freedom is df = 2m. Professor Sharabati (Purdue University) Time Series Analysis October 27, / 24
22 2*soi.per$spec[10]/L 2*soi.per$spec[10]/U 2*soi.per$spec[40]/L 2*soi.per$spec[40]/U Professor Sharabati (Purdue University) Time Series Analysis October 27, / 24 Computing and Plotting the Periodogram in R library(astsa) par( mfrow=c(2,1) ) soi.per <- spec.pgram(soi, taper=0, log= no ) abline(v=1/4, lty= dotted ) rec.pre <- spec.pgram(rec, taper=0, log= no ) abline(v=1/4, lty= dotted ) soi.per$spec[40] soi.per$spec[10] U <- qchisq(0.025, 2) L <- qchisq(0.975, 2)
23 Confidence Intervals for the Smoothed Periodogram library(astsa) par( mfrow=c(2,1) ) k <- kernel( daniell, 4) soi.ave <- spec.pgram(soi, k, taper=0, log= no ) abline( v=c(0.25, 1, 3), lty=12 ) ## Repeat using rec instead of soi df <- soi.ave$df U <- qchisq(0.025, df) L <- qchisq(0.975, df) Professor Sharabati (Purdue University) Time Series Analysis October 27, / 24
24 soi.ave$spec[10] soi.ave$spec[40] ## Intervals df*soi.ave$spec[10]/l df*soi.ave$spec[10]/u df*soi.ave$spec[40]/l df*soi.ave$spec[40]/u Professor Sharabati (Purdue University) Time Series Analysis October 27, / 24
Time Series Analysis. Solutions to problems in Chapter 7 IMM
Time Series Analysis Solutions to problems in Chapter 7 I Solution 7.1 Question 1. As we get by subtraction kx t = 1 + B + B +...B k 1 )ǫ t θb) = 1 + B +... + B k 1 ), and BθB) = B + B +... + B k ), 1
More information8.2 Harmonic Regression and the Periodogram
Chapter 8 Spectral Methods 8.1 Introduction Spectral methods are based on thining of a time series as a superposition of sinusoidal fluctuations of various frequencies the analogue for a random process
More informationMassachusetts Institute of Technology Department of Electrical Engineering and Computer Science : Discrete-Time Signal Processing
Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science 6.34: Discrete-Time Signal Processing OpenCourseWare 006 ecture 8 Periodogram Reading: Sections 0.6 and 0.7
More informationUnstable Oscillations!
Unstable Oscillations X( t ) = [ A 0 + A( t ) ] sin( ω t + Φ 0 + Φ( t ) ) Amplitude modulation: A( t ) Phase modulation: Φ( t ) S(ω) S(ω) Special case: C(ω) Unstable oscillation has a broader periodogram
More information5. THE CLASSES OF FOURIER TRANSFORMS
5. THE CLASSES OF FOURIER TRANSFORMS There are four classes of Fourier transform, which are represented in the following table. So far, we have concentrated on the discrete Fourier transform. Table 1.
More information4.5 Nonparametric Spectral Estimation
4.5 Nonparametric Spectral Estimation 195 The confidence intervals for the SOI series at the yearly cycle,! =1/1 = 40/480, and the possible El Niño cycle of four years! =1/48 = 10/480 can be computed in
More informationSignals & Systems. Lecture 5 Continuous-Time Fourier Transform. Alp Ertürk
Signals & Systems Lecture 5 Continuous-Time Fourier Transform Alp Ertürk alp.erturk@kocaeli.edu.tr Fourier Series Representation of Continuous-Time Periodic Signals Synthesis equation: x t = a k e jkω
More informationTime Series. Anthony Davison. c
Series Anthony Davison c 2008 http://stat.epfl.ch Periodogram 76 Motivation............................................................ 77 Lutenizing hormone data..................................................
More informationFigure 18: Top row: example of a purely continuous spectrum (left) and one realization
1..5 S(). -.2 -.5 -.25..25.5 64 128 64 128 16 32 requency time time Lag 1..5 S(). -.5-1. -.5 -.1.1.5 64 128 64 128 16 32 requency time time Lag Figure 18: Top row: example o a purely continuous spectrum
More informationEE 435. Lecture 30. Data Converters. Spectral Performance
EE 435 Lecture 30 Data Converters Spectral Performance . Review from last lecture. INL Often Not a Good Measure of Linearity Four identical INL with dramatically different linearity X OUT X OUT X REF X
More informationVariable and Periodic Signals in Astronomy
Lecture 14: Variability and Periodicity Outline 1 Variable and Periodic Signals in Astronomy 2 Lomb-Scarle diagrams 3 Phase dispersion minimisation 4 Kolmogorov-Smirnov tests 5 Fourier Analysis Christoph
More informationPeriodogram of a sinusoid + spike Single high value is sum of cosine curves all in phase at time t 0 :
Periodogram of a sinusoid + spike Single high value is sum of cosine curves all in phase at time t 0 : X(t) = µ + Asin(ω 0 t)+ Δ δ ( t t 0 ) ±σ N =100 Δ =100 χ ( ω ) Raises the amplitude uniformly at all
More informationTime series models in the Frequency domain. The power spectrum, Spectral analysis
ime series models in the Frequency domain he power spectrum, Spectral analysis Relationship between the periodogram and the autocorrelations = + = ( ) ( ˆ α ˆ ) β I Yt cos t + Yt sin t t= t= ( ( ) ) cosλ
More informationVariable and Periodic Signals in Astronomy
Lecture 14: Variability and Periodicity Outline 1 Variable and Periodic Signals in Astronomy 2 Lomb-Scarle diagrams 3 Phase dispersion minimisation 4 Kolmogorov-Smirnov tests 5 Fourier Analysis Christoph
More informationLecture 7 ELE 301: Signals and Systems
Lecture 7 ELE 30: Signals and Systems Prof. Paul Cuff Princeton University Fall 20-2 Cuff (Lecture 7) ELE 30: Signals and Systems Fall 20-2 / 22 Introduction to Fourier Transforms Fourier transform as
More informationModule 29.3: nag tsa spectral Time Series Spectral Analysis. Contents
Time Series Analysis Module Contents Module 29.3: nag tsa spectral Time Series Spectral Analysis nag tsa spectral calculates the smoothed sample spectrum of a univariate and bivariate time series. Contents
More informationCHAPTER 4 FOURIER SERIES S A B A R I N A I S M A I L
CHAPTER 4 FOURIER SERIES 1 S A B A R I N A I S M A I L Outline Introduction of the Fourier series. The properties of the Fourier series. Symmetry consideration Application of the Fourier series to circuit
More informationProblem Set 2 Solution Sketches Time Series Analysis Spring 2010
Problem Set 2 Solution Sketches Time Series Analysis Spring 2010 Forecasting 1. Let X and Y be two random variables such that E(X 2 ) < and E(Y 2 )
More informationFourier Analysis of Stationary and Non-Stationary Time Series
Fourier Analysis of Stationary and Non-Stationary Time Series September 6, 2012 A time series is a stochastic process indexed at discrete points in time i.e X t for t = 0, 1, 2, 3,... The mean is defined
More informationAutoregressive Models Fourier Analysis Wavelets
Autoregressive Models Fourier Analysis Wavelets BFR Flood w/10yr smooth Spectrum Annual Max: Day of Water year Flood magnitude vs. timing Jain & Lall, 2000 Blacksmith Fork, Hyrum, UT Analyses of Flood
More information4 Spectral Analysis and Filtering
4 Spectral Analysis and Filtering 4.1 Introduction The notion that a time series exhibits repetitive or regular behavior over time is of fundamental importance because it distinguishes time series analysis
More informationFundamentals of the Discrete Fourier Transform
Seminar presentation at the Politecnico di Milano, Como, November 12, 2012 Fundamentals of the Discrete Fourier Transform Michael G. Sideris sideris@ucalgary.ca Department of Geomatics Engineering University
More information23.4. Convergence. Introduction. Prerequisites. Learning Outcomes
Convergence 3.4 Introduction In this Section we examine, briefly, the convergence characteristics of a Fourier series. We have seen that a Fourier series can be found for functions which are not necessarily
More informationTime Series Analysis
Time Series Analysis Theory: Time Series Analysis Probability distribution Correlation and Autocorrelation Spectrum and spectral analysis Autoregressive-Moving Average (ARMA) modeling Spectral analysis
More informationSNR Calculation and Spectral Estimation [S&T Appendix A]
SR Calculation and Spectral Estimation [S&T Appendix A] or, How not to make a mess of an FFT Make sure the input is located in an FFT bin 1 Window the data! A Hann window works well. Compute the FFT 3
More informationTHE FOURIER TRANSFORM (Fourier series for a function whose period is very, very long) Reading: Main 11.3
THE FOURIER TRANSFORM (Fourier series for a function whose period is very, very long) Reading: Main 11.3 Any periodic function f(t) can be written as a Fourier Series a 0 2 + a n cos( nωt) + b n sin n
More informationPeriodogram of a sinusoid + spike Single high value is sum of cosine curves all in phase at time t 0 :
Periodogram of a sinusoid + spike Single high value is sum of cosine curves all in phase at time t 0 : ( ) ±σ X(t) = µ + Asin(ω 0 t)+ Δ δ t t 0 N =100 Δ =100 χ ( ω ) Raises the amplitude uniformly at all
More informationStatistics of Stochastic Processes
Prof. Dr. J. Franke All of Statistics 4.1 Statistics of Stochastic Processes discrete time: sequence of r.v...., X 1, X 0, X 1, X 2,... X t R d in general. Here: d = 1. continuous time: random function
More informationSpectral Analysis of Random Processes
Spectral Analysis of Random Processes Spectral Analysis of Random Processes Generally, all properties of a random process should be defined by averaging over the ensemble of realizations. Generally, all
More informationFourier Series Tutorial
Fourier Series Tutorial INTRODUCTION This document is designed to overview the theory behind the Fourier series and its alications. It introduces the Fourier series and then demonstrates its use with a
More informationEE 435. Lecture 28. Data Converters Linearity INL/DNL Spectral Performance
EE 435 Lecture 8 Data Converters Linearity INL/DNL Spectral Performance Performance Characterization of Data Converters Static characteristics Resolution Least Significant Bit (LSB) Offset and Gain Errors
More informationINDIAN INSTITUTE OF SCIENCE STOCHASTIC HYDROLOGY. Lecture -12 Course Instructor : Prof. P. P. MUJUMDAR Department of Civil Engg., IISc.
INDIAN INSTITUTE OF SCIENCE STOCHASTIC HYDROLOGY Lecture -12 Course Instructor : Prof. P. P. MUJUMDAR Department of Civil Engg., IISc. Summary of the previous lecture Data Extension & Forecasting Moving
More informationIntroduction to Fourier Transforms. Lecture 7 ELE 301: Signals and Systems. Fourier Series. Rect Example
Introduction to Fourier ransforms Lecture 7 ELE 3: Signals and Systems Fourier transform as a limit of the Fourier series Inverse Fourier transform: he Fourier integral theorem Prof. Paul Cuff Princeton
More informationNon-parametric identification
Non-parametric Non-parametric Transient Step-response using Spectral Transient Correlation Frequency function estimate Spectral System Identification, SSY230 Non-parametric 1 Non-parametric Transient Step-response
More informationSEISMIC WAVE PROPAGATION. Lecture 2: Fourier Analysis
SEISMIC WAVE PROPAGATION Lecture 2: Fourier Analysis Fourier Series & Fourier Transforms Fourier Series Review of trigonometric identities Analysing the square wave Fourier Transform Transforms of some
More informationA=randn(500,100); mu=mean(a); sigma_a=std(a); std_a=sigma_a/sqrt(500); [std(mu) mean(std_a)] % compare standard deviation of means % vs standard error
UCSD SIOC 221A: (Gille) 1 Reading: Bendat and Piersol, Ch. 5.2.1 Lecture 10: Recap Last time we looked at the sinc function, windowing, and detrending with an eye to reducing edge effects in our spectra.
More informationIntroduction to Time Series Analysis. Lecture 21.
Introduction to Time Series Analysis. Lecture 21. 1. Review: The periodogram, the smoothed periodogram. 2. Other smoothed spectral estimators. 3. Consistency. 4. Asymptotic distribution. 1 Review: Periodogram
More informationSTAD57 Time Series Analysis. Lecture 23
STAD57 Time Series Analysis Lecture 23 1 Spectral Representation Spectral representation of stationary {X t } is: 12 i2t Xt e du 12 1/2 1/2 for U( ) a stochastic process with independent increments du(ω)=
More informationFourier Analysis of Signals Using the DFT
Fourier Analysis of Signals Using the DFT ECE 535 Lecture April 29, 23 Overview: Motivation Many applications require analyzing the frequency content of signals Speech processing study resonances of vocal
More informationData Processing and Analysis
Data Processing and Analysis Rick Aster and Brian Borchers September 10, 2013 Energy and Power Spectra It is frequently valuable to study the power distribution of a signal in the frequency domain. For
More informationCOMPARING SPECTRAL DENSITIES IN REPLICATED TIME SERIES BY SMOOTHING SPLINE ANOVA
COMPARING SPECTRAL DENSITIES IN REPLICATED TIME SERIES BY SMOOTHING SPLINE ANOVA by Sangdae Han BS, Hallym University, 1996 MS, Michigan State University, 1998 MA, University of Pittsburgh, 2005 Submitted
More informationExperimental Fourier Transforms
Chapter 5 Experimental Fourier Transforms 5.1 Sampling and Aliasing Given x(t), we observe only sampled data x s (t) = x(t)s(t; T s ) (Fig. 5.1), where s is called sampling or comb function and can be
More informationChapter 3: Regression Methods for Trends
Chapter 3: Regression Methods for Trends Time series exhibiting trends over time have a mean function that is some simple function (not necessarily constant) of time. The example random walk graph from
More informationInterval estimation. October 3, Basic ideas CLT and CI CI for a population mean CI for a population proportion CI for a Normal mean
Interval estimation October 3, 2018 STAT 151 Class 7 Slide 1 Pandemic data Treatment outcome, X, from n = 100 patients in a pandemic: 1 = recovered and 0 = not recovered 1 1 1 0 0 0 1 1 1 0 0 1 0 1 0 0
More informationX(t)e 2πi nt t dt + 1 T
HOMEWORK 31 I) Use the Fourier-Euler formulae to show that, if X(t) is T -periodic function which admits a Fourier series decomposition X(t) = n= c n exp (πi n ) T t, then (1) if X(t) is even c n are all
More informationAkaike criterion: Kullback-Leibler discrepancy
Model choice. Akaike s criterion Akaike criterion: Kullback-Leibler discrepancy Given a family of probability densities {f ( ; ψ), ψ Ψ}, Kullback-Leibler s index of f ( ; ψ) relative to f ( ; θ) is (ψ
More information6.435, System Identification
System Identification 6.435 SET 3 Nonparametric Identification Munther A. Dahleh 1 Nonparametric Methods for System ID Time domain methods Impulse response Step response Correlation analysis / time Frequency
More informationTraveling Harmonic Waves
Traveling Harmonic Waves 6 January 2016 PHYC 1290 Department of Physics and Atmospheric Science Functional Form for Traveling Waves We can show that traveling waves whose shape does not change with time
More informationSignals and Systems. Lecture 14 DR TANIA STATHAKI READER (ASSOCIATE PROFESSOR) IN SIGNAL PROCESSING IMPERIAL COLLEGE LONDON
Signals and Systems Lecture 14 DR TAIA STATHAKI READER (ASSOCIATE PROFESSOR) I SIGAL PROCESSIG IMPERIAL COLLEGE LODO Introduction. Time sampling theorem resume. We wish to perform spectral analysis using
More informationPeriodicity. Discrete-Time Sinusoids. Continuous-time Sinusoids. Discrete-time Sinusoids
Periodicity Professor Deepa Kundur Recall if a signal x(t) is periodic, then there exists a T > 0 such that x(t) = x(t + T ) University of Toronto If no T > 0 can be found, then x(t) is non-periodic. Professor
More informationcovariance function, 174 probability structure of; Yule-Walker equations, 174 Moving average process, fluctuations, 5-6, 175 probability structure of
Index* The Statistical Analysis of Time Series by T. W. Anderson Copyright 1971 John Wiley & Sons, Inc. Aliasing, 387-388 Autoregressive {continued) Amplitude, 4, 94 case of first-order, 174 Associated
More informationEE1 and ISE1 Communications I
EE1 and ISE1 Communications I Pier Luigi Dragotti Lecture two Lecture Aims To introduce signals, Classifications of signals, Some particular signals. 1 Signals A signal is a set of information or data.
More informationRegression #3: Properties of OLS Estimator
Regression #3: Properties of OLS Estimator Econ 671 Purdue University Justin L. Tobias (Purdue) Regression #3 1 / 20 Introduction In this lecture, we establish some desirable properties associated with
More informationECG782: Multidimensional Digital Signal Processing
Professor Brendan Morris, SEB 3216, brendan.morris@unlv.edu ECG782: Multidimensional Digital Signal Processing Spring 2014 TTh 14:30-15:45 CBC C313 Lecture 05 Image Processing Basics 13/02/04 http://www.ee.unlv.edu/~b1morris/ecg782/
More informationCh3. TRENDS. Time Series Analysis
3.1 Deterministic Versus Stochastic Trends The simulated random walk in Exhibit 2.1 shows a upward trend. However, it is caused by a strong correlation between the series at nearby time points. The true
More informationEA2.3 - Electronics 2 1
In the previous lecture, I talked about the idea of complex frequency s, where s = σ + jω. Using such concept of complex frequency allows us to analyse signals and systems with better generality. In this
More informationFourier Series and Fourier Transforms
Fourier Series and Fourier Transforms EECS2 (6.082), MIT Fall 2006 Lectures 2 and 3 Fourier Series From your differential equations course, 18.03, you know Fourier s expression representing a T -periodic
More informationApplied Time Series Topics
Applied Time Series Topics Ivan Medovikov Brock University April 16, 2013 Ivan Medovikov, Brock University Applied Time Series Topics 1/34 Overview 1. Non-stationary data and consequences 2. Trends and
More informationVibrations: Second Order Systems with One Degree of Freedom, Free Response
Single Degree of Freedom System 1.003J/1.053J Dynamics and Control I, Spring 007 Professor Thomas Peacock 5//007 Lecture 0 Vibrations: Second Order Systems with One Degree of Freedom, Free Response Single
More informationFourier Series and Integrals
Fourier Series and Integrals Fourier Series et f(x) beapiece-wiselinearfunctionon[, ] (Thismeansthatf(x) maypossessa finite number of finite discontinuities on the interval). Then f(x) canbeexpandedina
More informationTime-Dependent Statistical Mechanics A1. The Fourier transform
Time-Dependent Statistical Mechanics A1. The Fourier transform c Hans C. Andersen November 5, 2009 1 Definition of the Fourier transform and its inverse. Suppose F (t) is some function of time. Then its
More informationHomework 2. For the homework, be sure to give full explanations where required and to turn in any relevant plots.
Homework 2 1 Data analysis problems For the homework, be sure to give full explanations where required and to turn in any relevant plots. 1. The file berkeley.dat contains average yearly temperatures for
More informationThe Discrete Fourier Transform (DFT) Properties of the DFT DFT-Specic Properties Power spectrum estimate. Alex Sheremet.
4. April 2, 27 -order sequences Measurements produce sequences of numbers Measurement purpose: characterize a stochastic process. Example: Process: water surface elevation as a function of time Parameters:
More informationFrequency estimation by DFT interpolation: A comparison of methods
Frequency estimation by DFT interpolation: A comparison of methods Bernd Bischl, Uwe Ligges, Claus Weihs March 5, 009 Abstract This article comments on a frequency estimator which was proposed by [6] and
More informationThe Fourier Transform (and more )
The Fourier Transform (and more ) imrod Peleg ov. 5 Outline Introduce Fourier series and transforms Introduce Discrete Time Fourier Transforms, (DTFT) Introduce Discrete Fourier Transforms (DFT) Consider
More informationIn this Lecture. Frequency domain analysis
In this Lecture Frequency domain analysis Introduction In most cases we want to know the frequency content of our signal Why? Most popular analysis in frequency domain is based on work of Joseph Fourier
More informationStatistics: Learning models from data
DS-GA 1002 Lecture notes 5 October 19, 2015 Statistics: Learning models from data Learning models from data that are assumed to be generated probabilistically from a certain unknown distribution is a crucial
More informationHandout 11: AC circuit. AC generator
Handout : AC circuit AC generator Figure compares the voltage across the directcurrent (DC) generator and that across the alternatingcurrent (AC) generator For DC generator, the voltage is constant For
More informationThis is the number of cycles per unit time, and its units are, for example,
16 4. Sinusoidal solutions Many things in nature are periodic, even sinusoidal. We will begin by reviewing terms surrounding periodic functions. If an LTI system is fed a periodic input signal, we have
More informationDiscrete Fourier Transform
Discrete Fourier Transform Valentina Hubeika, Jan Černocký DCGM FIT BUT Brno, {ihubeika,cernocky}@fit.vutbr.cz Diskrete Fourier transform (DFT) We have just one problem with DFS that needs to be solved.
More informationPeriodic functions: simple harmonic oscillator
Periodic functions: simple harmonic oscillator Recall the simple harmonic oscillator (e.g. mass-spring system) d 2 y dt 2 + ω2 0y = 0 Solution can be written in various ways: y(t) = Ae iω 0t y(t) = A cos
More informationOSE801 Engineering System Identification. Lecture 09: Computing Impulse and Frequency Response Functions
OSE801 Engineering System Identification Lecture 09: Computing Impulse and Frequency Response Functions 1 Extracting Impulse and Frequency Response Functions In the preceding sections, signal processing
More informationGeorge Mason University Signals and Systems I Spring 2016
George Mason University Signals and Systems I Spring 206 Problem Set #6 Assigned: March, 206 Due Date: March 5, 206 Reading: This problem set is on Fourier series representations of periodic signals. The
More informationLecture 7: Interpolation
Lecture 7: Interpolation ECE 401: Signal and Image Analysis University of Illinois 2/9/2017 1 Sampling Review 2 Interpolation and Upsampling 3 Spectrum of Interpolated Signals Outline 1 Sampling Review
More informationa k cos kω 0 t + b k sin kω 0 t (1) k=1
MOAC worksheet Fourier series, Fourier transform, & Sampling Working through the following exercises you will glean a quick overview/review of a few essential ideas that you will need in the moac course.
More informationPractical Spectral Estimation
Digital Signal Processing/F.G. Meyer Lecture 4 Copyright 2015 François G. Meyer. All Rights Reserved. Practical Spectral Estimation 1 Introduction The goal of spectral estimation is to estimate how the
More informationFourier Analysis Linear transformations and lters. 3. Fourier Analysis. Alex Sheremet. April 11, 2007
Stochastic processes review 3. Data Analysis Techniques in Oceanography OCP668 April, 27 Stochastic processes review Denition Fixed ζ = ζ : Function X (t) = X (t, ζ). Fixed t = t: Random Variable X (ζ)
More informationAssignment 3 Solutions
Assignment Solutions Networks and systems August 8, 7. Consider an LTI system with transfer function H(jw) = input is sin(t + π 4 ), what is the output? +jw. If the Solution : C For an LTI system with
More informationThe Spectral Density Estimation of Stationary Time Series with Missing Data
The Spectral Density Estimation of Stationary Time Series with Missing Data Jian Huang and Finbarr O Sullivan Department of Statistics University College Cork Ireland Abstract The spectral estimation of
More information(Refer Slide Time: 01:30)
Networks and Systems Prof V.G K.Murti Department of Electrical Engineering Indian Institute of Technology, Madras Lecture - 11 Fourier Series (5) Continuing our discussion of Fourier series today, we will
More informationProblem Sheet 1 Examples of Random Processes
RANDOM'PROCESSES'AND'TIME'SERIES'ANALYSIS.'PART'II:'RANDOM'PROCESSES' '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''Problem'Sheets' Problem Sheet 1 Examples of Random Processes 1. Give
More informationEE 505 Lecture 10. Spectral Characterization. Part 2 of 2
EE 505 Lecture 10 Spectral Characterization Part 2 of 2 Review from last lecture Spectral Analysis If f(t) is periodic f(t) alternately f(t) = = A A ( kω t + ) 0 + Aksin θk k= 1 0 + a ksin t k= 1 k= 1
More informationω 0 = 2π/T 0 is called the fundamental angular frequency and ω 2 = 2ω 0 is called the
he ime-frequency Concept []. Review of Fourier Series Consider the following set of time functions {3A sin t, A sin t}. We can represent these functions in different ways by plotting the amplitude versus
More informationLinear and Nonlinear Oscillators (Lecture 2)
Linear and Nonlinear Oscillators (Lecture 2) January 25, 2016 7/441 Lecture outline A simple model of a linear oscillator lies in the foundation of many physical phenomena in accelerator dynamics. A typical
More informationMATH 3150: PDE FOR ENGINEERS FINAL EXAM (VERSION A)
MAH 35: PDE FOR ENGINEERS FINAL EXAM VERSION A). Draw the graph of 2. y = tan x labelling all asymptotes and zeros. Include at least 3 periods in your graph. What is the period of tan x? See figure. Asymptotes
More informationFILTERING IN THE FREQUENCY DOMAIN
1 FILTERING IN THE FREQUENCY DOMAIN Lecture 4 Spatial Vs Frequency domain 2 Spatial Domain (I) Normal image space Changes in pixel positions correspond to changes in the scene Distances in I correspond
More informationJim Lambers ENERGY 281 Spring Quarter Lecture 5 Notes
Jim ambers ENERGY 28 Spring Quarter 27-8 ecture 5 Notes These notes are based on Rosalind Archer s PE28 lecture notes, with some revisions by Jim ambers. Fourier Series Recall that in ecture 2, when we
More informationDigital Signal Processing
Digital Signal Processing Introduction Moslem Amiri, Václav Přenosil Embedded Systems Laboratory Faculty of Informatics, Masaryk University Brno, Czech Republic amiri@mail.muni.cz prenosil@fi.muni.cz February
More informationFOURIER ANALYSIS. (a) Fourier Series
(a) Fourier Series FOURIER ANAYSIS (b) Fourier Transforms Useful books: 1. Advanced Mathematics for Engineers and Scientists, Schaum s Outline Series, M. R. Spiegel - The course text. We follow their notation
More informationLecture 7 January 26, 2016
MATH 262/CME 372: Applied Fourier Analysis and Winter 26 Elements of Modern Signal Processing Lecture 7 January 26, 26 Prof Emmanuel Candes Scribe: Carlos A Sing-Long, Edited by E Bates Outline Agenda:
More information1 Simple Harmonic Oscillator
Physics 1a Waves Lecture 3 Caltech, 10/09/18 1 Simple Harmonic Oscillator 1.4 General properties of Simple Harmonic Oscillator 1.4.4 Superposition of two independent SHO Suppose we have two SHOs described
More informationChapter 2: Complex numbers
Chapter 2: Complex numbers Complex numbers are commonplace in physics and engineering. In particular, complex numbers enable us to simplify equations and/or more easily find solutions to equations. We
More informationEE 435. Lecture 32. Spectral Performance Windowing
EE 435 Lecture 32 Spectral Performance Windowing . Review from last lecture. Distortion Analysis T 0 T S THEOREM?: If N P is an integer and x(t) is band limited to f MAX, then 2 Am Χ mnp 1 0 m h N and
More informationCentral to this is two linear transformations: the Fourier Transform and the Laplace Transform. Both will be considered in later lectures.
In this second lecture, I will be considering signals from the frequency perspective. This is a complementary view of signals, that in the frequency domain, and is fundamental to the subject of signal
More informationA1 Time-Frequency Analysis
A 20 / A Time-Frequency Analysis David Murray david.murray@eng.ox.ac.uk www.robots.ox.ac.uk/ dwm/courses/2tf Hilary 20 A 20 2 / Content 8 Lectures: 6 Topics... From Signals to Complex Fourier Series 2
More informationCMPT 889: Lecture 2 Sinusoids, Complex Exponentials, Spectrum Representation
CMPT 889: Lecture 2 Sinusoids, Complex Exponentials, Spectrum Representation Tamara Smyth, tamaras@cs.sfu.ca School of Computing Science, Simon Fraser University September 26, 2005 1 Sinusoids Sinusoids
More informationII. Nonparametric Spectrum Estimation for Stationary Random Signals - Non-parametric Methods -
II. onparametric Spectrum Estimation for Stationary Random Signals - on-parametric Methods - - [p. 3] Periodogram - [p. 12] Periodogram properties - [p. 23] Modified periodogram - [p. 25] Bartlett s method
More informationOSE801 Engineering System Identification. Lecture 05: Fourier Analysis
OSE81 Engineering System Identification Lecture 5: Fourier Analysis What we will study in this lecture: A short introduction of Fourier analysis Sampling the data Applications Example 1 Fourier Analysis
More information(Refer Slide Time: 01:28 03:51 min)
Digital Signal Processing Prof. S. C. Dutta Roy Department of Electrical Engineering Indian Institute of Technology, Delhi Lecture 40 FIR Design by Windowing This is the 40 th lecture and our topic for
More informationEE 435. Lecture 29. Data Converters. Linearity Measures Spectral Performance
EE 435 Lecture 9 Data Converters Linearity Measures Spectral Performance Linearity Measurements (testing) Consider ADC V IN (t) DUT X IOUT V REF Linearity testing often based upon code density testing
More information