X. Cross Spectral Analysis

Size: px
Start display at page:

Download "X. Cross Spectral Analysis"

Transcription

1 X. Cross Spectral Analysis

2 Cross Spectrum We have already dealt with the crosscovariance function (ccvf): ˆ 1 C (k) = X(i)Y(i + k) N N k i= 0

3 The Fourier transform of the ccvf is called the cross spectrum. It provides a statement of how common activity between two processes is distributed across frequency. N ˆ 1 Z ˆ (n) = C k t e N k= 1 ( ) jnω Δ 0 The cross spectrum is a complex-valued function. This is because, unlike the autocovariance function, which is even, the crosscovariance function is not symmetric around τ = 0. This means that the sine terms of the exponential do not cancel as for the power spectrum. kδt

4 The same procedures and problems apply to estimating cross spectra as were discussed for power spectra. The cross spectrum can be estimated from the ccvf or from the Fourier transforms of the two time series.

5 In the frequency domain, we compute the cross spectrum as: = ˆ ˆ ˆ * Z (n) = Z (n)z (n) X Y [ AX(n) - jb X(n)] [ AY(n) + jby(n)] = [ AX(n) AY(n) + BX(n) BY(n)] - j [ BX(n) AY(n) - BY(n) AX(n)] 4 = Co ˆ (n) - jqu ˆ (n) where Co (n) is called the cospectrum and Qu (n) is called the quadrature spectrum.

6 Then we define the cross-power as the sum of the real and imaginary parts squared: Z ˆ ˆ ˆ (n) = Co (n ) + Qu (n )

7 Coherence The coherence function is a measure based upon the auto- and cross-spectral properties of two processes. Its definition is identical in form to the square of a correlation coefficient between the spectral components of the processes at a particular frequency f. Note that two factors contribute to a significant value of the cross-spectrum at a particular frequency. One is a significant coupling between the two processes at that frequency. The other is a significant concentration of power at that frequency in one or both processes.

8 The coherence function, or squared coherence, is defined as: where: ˆ γ ( n) = Z (n) Zˆ n Zˆ n XX ( ) ( ) YY ( ) + ( ) ˆ A ( ) XX n BXX n ZXX n =, 4 Zˆ YY = YY ( ) + ( ) A n B n 4 YY

9 ˆ γ = Z (n) Zˆ n Zˆ n XX ( ) ( ) YY The cross-power in the numerator ranges from 0 to the product of the two autospectra in the denominator. In other words, the coherence is a normalization of the cross power spectrum by the product of the two autospectra. The normalization of the coherence compensates for large values in the cross spectrum that result solely from large power, and thus isolates the influence of coupling.

10 If X and Y are identical processes, then their power spectra are equal to each other and to the cross spectrum. In this case, the coherence is 1 at all frequencies. If X and Y are completely independent processes, then the cross spectrum is 0 for all frequencies and so is the coherence. Between these two extremes lies a range of possible relationships between the two processes that can be measured by the coherence function.

11 Example 1 X and Y may be closely related, but only over a limited range of frequencies. If, for example, two regions of the hippocampus are independent of each other for a large part of the time, but are both intermittently driven by septal input within the narrow theta frequency band. In this case, coherence between the time series of the two regions would be near unity over the theta band, and zero elsewhere.

12 Example A similar situation would occur when comparing the left and right motor cortices. At rest or during unsynchronized movements, their EEGs might be largely independent. During synchronized bilateral movement, there could arise a component in each EEG at the frequency of the movement. The coherence of the EEGs during the synchronized movement would then be large over the frequencies of synchronization, and small elsewhere.

13 A meaningful estimate of coherence cannot be obtained directly from single samples of auto- and cross-spectra of the processes. Consider what would result from using these raw spectra: = Z bg n YY Z n Z n XX b g = Co (n) + Qu (n) Z (n) Z (n) ( AX A Y ) + AX AYBX B Y + (BX B Y ) + (BX A Y ) + (BY A X ) - A A B B 16 ( A + B )( A X X Y + BY ) 4 4 b g = A X A Y + BX B Y + AY B X + AX BY AX A Y + BX B Y + AY B X + AX BY = 1 XX YY x Y X Y The coherence function is thus an estimate that must be derived after first estimating the co-spectrum, quadrature spectrum, and the auto-spectra. The same bias-resolution and variance considerations apply as for the power spectrum.

14 Generally, small values of coherence are encountered in dealing with the EEG. Electrode sites usually do not have large correlations, unless they are near each other. Example: Consider a simple model in which two processes are each composed of a common quasiperiodic signal process embedded in independent wide-band noise processes. Suppose the quasiperiodic signals are due to a common phenomenon so that they are closely related. The wide band noise processes, on the other hand, are due to random fluctuations that are unique to each process and so are unrelated.

15 The cross spectrum of the two processes would be relatively large in the frequency band of the shared, quasiperiodic signal and small at other frequencies, since the wide band noise processes are independent and not shared activity.

16 This can be expressed mathematically as: x(t) = n (t) + s(t) 1 y(t) = n (t) + s(t) The power spectral representation is: S (n) = S (n) + S (n) xx nn ss 1 1 S yy(n) = S nn(n) + S ss(n) S xy(n) = Z xy (n)

17 However, the cross power, which is the Fourier transform of the ccvf, solely depends on the signal since the only covariance between X and Y is that caused by the presence of the signal in both. Based on this assumption, the cross power is: Z xy(n) = Co xy(n) + Qu xy(n) x y x y y x x y = ( A (n) A (n) ) + (B (n) B (n) ) + (A (n) B (n) ) + (A (n) B (n) ) 16 s s = ( A (n) + B (n) ) = S ss(n) 4

18 γ xy (n) = The coherence function is then: S ss(n) [ S (n) + S (n)][ S (n) + S (n)] nn ss nn ss 1 1 If we let n1 and n have identical spectra, then the coherence becomes: γ xy (n) = = S ss(n) [ S nn(n) + S ss(n)] 1 nn [1 + S (n) S ss(n) ]

19 γ xy (n) = = nn S ss(n) [ S (n) + S (n)] 1 nn [1 + S (n) S ss(n) ] ss If SNR = 1, coherence =.5. If SNR =.5, coherence =.11.

20 Coherence estimates have been devised and their 95% confidence limits determined as a function of the number of segments used in Bartlett smoothing. The graph shows not only the 95% confidence range, but also the minimum coherence value needed to confirm any coherence with 95% confidence. Large estimation errors are likely when the coherence value is low.

21 Relative Phase The coherence does not include any phase information concerning the two processes. Rather, it considers their relationship only in terms of the power at a given frequency. The relative phase spectrum can be derived from the cross spectrum as: $ θ (n) = arctan( Qu $ (n) Co $ (n) ) where the denominator is the real part (co-spectrum) of the cross spectrum, and the numerator is the imaginary part (quadrature spectrum).

22 If the processes X and Y are uncorrelated, then no particular relative phase relationship is to be expected at any frequency. Relative phase will be a random variable with 0 mean and uniformly distributed over the range -90 to +90 degrees. When there is a correlation between the two processes, the relative phase relation will show up as a preferred relative phase angle related to frequency.

23 The relative phase spectrum, like the coherence spectrum, is only useful as an estimate. Furthermore, it is only valid at frequencies where there is a significant coherence value. This is because the coherence is an indicator of the amount of dispersion around the mean relative phase of the distribution of phase values of the ensemble of data realizations. A significant coherence value indicates that the relative phase is concentrated around the mean. If it is not significant, then the relative phase distribution is not significantly concentrated, and the mean relative phase will not be meaningful.

IV. Covariance Analysis

IV. Covariance Analysis IV. Covariance Analysis Autocovariance Remember that when a stochastic process has time values that are interdependent, then we can characterize that interdependency by computing the autocovariance function.

More information

Amplitude and Phase A(0) 2. We start with the Fourier series representation of X(t) in real notation: n=1

Amplitude and Phase A(0) 2. We start with the Fourier series representation of X(t) in real notation: n=1 VI. Power Spectra Amplitude and Phase We start with the Fourier series representation of X(t) in real notation: A() X(t) = + [ A(n) cos(nωt) + B(n) sin(nωt)] 2 n=1 he waveform of the observed segment exactly

More information

Communication Theory II

Communication Theory II Communication Theory II Lecture 8: Stochastic Processes Ahmed Elnakib, PhD Assistant Professor, Mansoura University, Egypt March 5 th, 2015 1 o Stochastic processes What is a stochastic process? Types:

More information

Massachusetts Institute of Technology

Massachusetts Institute of Technology Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science 6.011: Introduction to Communication, Control and Signal Processing QUIZ, April 1, 010 QUESTION BOOKLET Your

More information

VIII. Coherence and Transfer Function Applications A. Coherence Function Estimates

VIII. Coherence and Transfer Function Applications A. Coherence Function Estimates VIII. Coherence and Transfer Function Applications A. Coherence Function Estimates Consider the application of these ideas to the specific problem of atmospheric turbulence measurements outlined in Figure

More information

Stochastic Processes. M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno

Stochastic Processes. M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno Stochastic Processes M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno 1 Outline Stochastic (random) processes. Autocorrelation. Crosscorrelation. Spectral density function.

More information

ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process

ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Definition of stochastic process (random

More information

EAS 305 Random Processes Viewgraph 1 of 10. Random Processes

EAS 305 Random Processes Viewgraph 1 of 10. Random Processes EAS 305 Random Processes Viewgraph 1 of 10 Definitions: Random Processes A random process is a family of random variables indexed by a parameter t T, where T is called the index set λ i Experiment outcome

More information

P 1.5 X 4.5 / X 2 and (iii) The smallest value of n for

P 1.5 X 4.5 / X 2 and (iii) The smallest value of n for DHANALAKSHMI COLLEGE OF ENEINEERING, CHENNAI DEPARTMENT OF ELECTRONICS AND COMMUNICATION ENGINEERING MA645 PROBABILITY AND RANDOM PROCESS UNIT I : RANDOM VARIABLES PART B (6 MARKS). A random variable X

More information

Definition of a Stochastic Process

Definition of a Stochastic Process Definition of a Stochastic Process Balu Santhanam Dept. of E.C.E., University of New Mexico Fax: 505 277 8298 bsanthan@unm.edu August 26, 2018 Balu Santhanam (UNM) August 26, 2018 1 / 20 Overview 1 Stochastic

More information

Stochastic Processes

Stochastic Processes Elements of Lecture II Hamid R. Rabiee with thanks to Ali Jalali Overview Reading Assignment Chapter 9 of textbook Further Resources MIT Open Course Ware S. Karlin and H. M. Taylor, A First Course in Stochastic

More information

Probability Space. J. McNames Portland State University ECE 538/638 Stochastic Signals Ver

Probability Space. J. McNames Portland State University ECE 538/638 Stochastic Signals Ver Stochastic Signals Overview Definitions Second order statistics Stationarity and ergodicity Random signal variability Power spectral density Linear systems with stationary inputs Random signal memory Correlation

More information

6.435, System Identification

6.435, System Identification System Identification 6.435 SET 3 Nonparametric Identification Munther A. Dahleh 1 Nonparametric Methods for System ID Time domain methods Impulse response Step response Correlation analysis / time Frequency

More information

D.S.G. POLLOCK: BRIEF NOTES

D.S.G. POLLOCK: BRIEF NOTES BIVARIATE SPECTRAL ANALYSIS Let x(t) and y(t) be two stationary stochastic processes with E{x(t)} = E{y(t)} =. These processes have the following spectral representations: (1) x(t) = y(t) = {cos(ωt)da

More information

Problem Sheet 1 Examples of Random Processes

Problem Sheet 1 Examples of Random Processes RANDOM'PROCESSES'AND'TIME'SERIES'ANALYSIS.'PART'II:'RANDOM'PROCESSES' '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''Problem'Sheets' Problem Sheet 1 Examples of Random Processes 1. Give

More information

System Identification & Parameter Estimation

System Identification & Parameter Estimation System Identification & Parameter Estimation Wb3: SIPE lecture Correlation functions in time & frequency domain Alfred C. Schouten, Dept. of Biomechanical Engineering (BMechE), Fac. 3mE // Delft University

More information

Module 29.3: nag tsa spectral Time Series Spectral Analysis. Contents

Module 29.3: nag tsa spectral Time Series Spectral Analysis. Contents Time Series Analysis Module Contents Module 29.3: nag tsa spectral Time Series Spectral Analysis nag tsa spectral calculates the smoothed sample spectrum of a univariate and bivariate time series. Contents

More information

for valid PSD. PART B (Answer all five units, 5 X 10 = 50 Marks) UNIT I

for valid PSD. PART B (Answer all five units, 5 X 10 = 50 Marks) UNIT I Code: 15A04304 R15 B.Tech II Year I Semester (R15) Regular Examinations November/December 016 PROBABILITY THEY & STOCHASTIC PROCESSES (Electronics and Communication Engineering) Time: 3 hours Max. Marks:

More information

SRI VIDYA COLLEGE OF ENGINEERING AND TECHNOLOGY UNIT 3 RANDOM PROCESS TWO MARK QUESTIONS

SRI VIDYA COLLEGE OF ENGINEERING AND TECHNOLOGY UNIT 3 RANDOM PROCESS TWO MARK QUESTIONS UNIT 3 RANDOM PROCESS TWO MARK QUESTIONS 1. Define random process? The sample space composed of functions of time is called a random process. 2. Define Stationary process? If a random process is divided

More information

2A1H Time-Frequency Analysis II Bugs/queries to HT 2011 For hints and answers visit dwm/courses/2tf

2A1H Time-Frequency Analysis II Bugs/queries to HT 2011 For hints and answers visit   dwm/courses/2tf Time-Frequency Analysis II (HT 20) 2AH 2AH Time-Frequency Analysis II Bugs/queries to david.murray@eng.ox.ac.uk HT 20 For hints and answers visit www.robots.ox.ac.uk/ dwm/courses/2tf David Murray. A periodic

More information

2. (a) What is gaussian random variable? Develop an equation for guassian distribution

2. (a) What is gaussian random variable? Develop an equation for guassian distribution Code No: R059210401 Set No. 1 II B.Tech I Semester Supplementary Examinations, February 2007 PROBABILITY THEORY AND STOCHASTIC PROCESS ( Common to Electronics & Communication Engineering, Electronics &

More information

Properties of LTI Systems

Properties of LTI Systems Properties of LTI Systems Properties of Continuous Time LTI Systems Systems with or without memory: A system is memory less if its output at any time depends only on the value of the input at that same

More information

Fourier Methods in Digital Signal Processing Final Exam ME 579, Spring 2015 NAME

Fourier Methods in Digital Signal Processing Final Exam ME 579, Spring 2015 NAME Fourier Methods in Digital Signal Processing Final Exam ME 579, Instructions for this CLOSED BOOK EXAM 2 hours long. Monday, May 8th, 8-10am in ME1051 Answer FIVE Questions, at LEAST ONE from each section.

More information

1. Fundamental concepts

1. Fundamental concepts . Fundamental concepts A time series is a sequence of data points, measured typically at successive times spaced at uniform intervals. Time series are used in such fields as statistics, signal processing

More information

STAT 111 Recitation 7

STAT 111 Recitation 7 STAT 111 Recitation 7 Xin Lu Tan xtan@wharton.upenn.edu October 25, 2013 1 / 13 Miscellaneous Please turn in homework 6. Please pick up homework 7 and the graded homework 5. Please check your grade and

More information

Name of the Student: Problems on Discrete & Continuous R.Vs

Name of the Student: Problems on Discrete & Continuous R.Vs Engineering Mathematics 05 SUBJECT NAME : Probability & Random Process SUBJECT CODE : MA6 MATERIAL NAME : University Questions MATERIAL CODE : JM08AM004 REGULATION : R008 UPDATED ON : Nov-Dec 04 (Scan

More information

A Probability Review

A Probability Review A Probability Review Outline: A probability review Shorthand notation: RV stands for random variable EE 527, Detection and Estimation Theory, # 0b 1 A Probability Review Reading: Go over handouts 2 5 in

More information

Biological Signal Analysis Data acquisition and analysis for life scientists. Didier A Depireux

Biological Signal Analysis Data acquisition and analysis for life scientists. Didier A Depireux Biological Signal Analysis Data acquisition and analysis for life scientists Didier A Depireux October 23, 2011 2 This accompanies the teaching of NACS/MPHY 615 Biological Signal Analysis (3). The course

More information

Introduction to Probability and Stochastic Processes I

Introduction to Probability and Stochastic Processes I Introduction to Probability and Stochastic Processes I Lecture 3 Henrik Vie Christensen vie@control.auc.dk Department of Control Engineering Institute of Electronic Systems Aalborg University Denmark Slides

More information

Lecture notes on Waves/Spectra Noise, Correlations and.

Lecture notes on Waves/Spectra Noise, Correlations and. Lecture notes on Waves/Spectra Noise, Correlations and. References: Random Data 3 rd Ed, Bendat and Piersol,Wiley Interscience Beall, Kim and Powers, J. Appl. Phys, 53, 3923 (982) W. Gekelman Lecture 6,

More information

A6523 Modeling, Inference, and Mining Jim Cordes, Cornell University

A6523 Modeling, Inference, and Mining Jim Cordes, Cornell University A6523 Modeling, Inference, and Mining Jim Cordes, Cornell University Lecture 19 Modeling Topics plan: Modeling (linear/non- linear least squares) Bayesian inference Bayesian approaches to spectral esbmabon;

More information

3. ESTIMATION OF SIGNALS USING A LEAST SQUARES TECHNIQUE

3. ESTIMATION OF SIGNALS USING A LEAST SQUARES TECHNIQUE 3. ESTIMATION OF SIGNALS USING A LEAST SQUARES TECHNIQUE 3.0 INTRODUCTION The purpose of this chapter is to introduce estimators shortly. More elaborated courses on System Identification, which are given

More information

13. Power Spectrum. For a deterministic signal x(t), the spectrum is well defined: If represents its Fourier transform, i.e., if.

13. Power Spectrum. For a deterministic signal x(t), the spectrum is well defined: If represents its Fourier transform, i.e., if. For a deterministic signal x(t), the spectrum is well defined: If represents its Fourier transform, i.e., if jt X ( ) = xte ( ) dt, (3-) then X ( ) represents its energy spectrum. his follows from Parseval

More information

Higher order correlation detection in nonlinear aerodynamic systems using wavelet transforms

Higher order correlation detection in nonlinear aerodynamic systems using wavelet transforms Higher order correlation detection in nonlinear aerodynamic systems using wavelet transforms K. Gurley Department of Civil and Coastal Engineering, University of Florida, USA T. Kijewski & A. Kareem Department

More information

EEM 409. Random Signals. Problem Set-2: (Power Spectral Density, LTI Systems with Random Inputs) Problem 1: Problem 2:

EEM 409. Random Signals. Problem Set-2: (Power Spectral Density, LTI Systems with Random Inputs) Problem 1: Problem 2: EEM 409 Random Signals Problem Set-2: (Power Spectral Density, LTI Systems with Random Inputs) Problem 1: Consider a random process of the form = + Problem 2: X(t) = b cos(2π t + ), where b is a constant,

More information

Lecture 17: variance in a band = log(s xx (f)) df (2) If we want to plot something that is more directly representative of variance, we can try this:

Lecture 17: variance in a band = log(s xx (f)) df (2) If we want to plot something that is more directly representative of variance, we can try this: UCSD SIOC 221A: (Gille) 1 Lecture 17: Recap We ve now spent some time looking closely at coherence and how to assign uncertainties to coherence. Can we think about coherence in a different way? There are

More information

Chapter 2 Random Processes

Chapter 2 Random Processes Chapter 2 Random Processes 21 Introduction We saw in Section 111 on page 10 that many systems are best studied using the concept of random variables where the outcome of a random experiment was associated

More information

MA6451 PROBABILITY AND RANDOM PROCESSES

MA6451 PROBABILITY AND RANDOM PROCESSES MA6451 PROBABILITY AND RANDOM PROCESSES UNIT I RANDOM VARIABLES 1.1 Discrete and continuous random variables 1. Show that the function is a probability density function of a random variable X. (Apr/May

More information

Statistics 349(02) Review Questions

Statistics 349(02) Review Questions Statistics 349(0) Review Questions I. Suppose that for N = 80 observations on the time series { : t T} the following statistics were calculated: _ x = 10.54 C(0) = 4.99 In addition the sample autocorrelation

More information

Redacted for Privacy

Redacted for Privacy AN ABSTRACT OF THE THESIS OF FREDERICK WILLIAM MIRANDA for the MASTER OF SCIENCE (Name of student) (Degree) in Electrical and Electronics Engineering presented on (Major) at ) Title: SYSTEM IDENTIFICATION

More information

Final Exam January 31, Solutions

Final Exam January 31, Solutions Final Exam January 31, 014 Signals & Systems (151-0575-01) Prof. R. D Andrea & P. Reist Solutions Exam Duration: Number of Problems: Total Points: Permitted aids: Important: 150 minutes 7 problems 50 points

More information

A=randn(500,100); mu=mean(a); sigma_a=std(a); std_a=sigma_a/sqrt(500); [std(mu) mean(std_a)] % compare standard deviation of means % vs standard error

A=randn(500,100); mu=mean(a); sigma_a=std(a); std_a=sigma_a/sqrt(500); [std(mu) mean(std_a)] % compare standard deviation of means % vs standard error UCSD SIOC 221A: (Gille) 1 Reading: Bendat and Piersol, Ch. 5.2.1 Lecture 10: Recap Last time we looked at the sinc function, windowing, and detrending with an eye to reducing edge effects in our spectra.

More information

Fourier Analysis of Stationary and Non-Stationary Time Series

Fourier Analysis of Stationary and Non-Stationary Time Series Fourier Analysis of Stationary and Non-Stationary Time Series September 6, 2012 A time series is a stochastic process indexed at discrete points in time i.e X t for t = 0, 1, 2, 3,... The mean is defined

More information

Stochastic Processes. A stochastic process is a function of two variables:

Stochastic Processes. A stochastic process is a function of two variables: Stochastic Processes Stochastic: from Greek stochastikos, proceeding by guesswork, literally, skillful in aiming. A stochastic process is simply a collection of random variables labelled by some parameter:

More information

covariance function, 174 probability structure of; Yule-Walker equations, 174 Moving average process, fluctuations, 5-6, 175 probability structure of

covariance function, 174 probability structure of; Yule-Walker equations, 174 Moving average process, fluctuations, 5-6, 175 probability structure of Index* The Statistical Analysis of Time Series by T. W. Anderson Copyright 1971 John Wiley & Sons, Inc. Aliasing, 387-388 Autoregressive {continued) Amplitude, 4, 94 case of first-order, 174 Associated

More information

PROBABILITY AND RANDOM PROCESSESS

PROBABILITY AND RANDOM PROCESSESS PROBABILITY AND RANDOM PROCESSESS SOLUTIONS TO UNIVERSITY QUESTION PAPER YEAR : JUNE 2014 CODE NO : 6074 /M PREPARED BY: D.B.V.RAVISANKAR ASSOCIATE PROFESSOR IT DEPARTMENT MVSR ENGINEERING COLLEGE, NADERGUL

More information

Atmospheric Flight Dynamics Example Exam 1 Solutions

Atmospheric Flight Dynamics Example Exam 1 Solutions Atmospheric Flight Dynamics Example Exam 1 Solutions 1 Question Figure 1: Product function Rūū (τ) In figure 1 the product function Rūū (τ) of the stationary stochastic process ū is given. What can be

More information

BME 50500: Image and Signal Processing in Biomedicine. Lecture 5: Correlation and Power-Spectrum CCNY

BME 50500: Image and Signal Processing in Biomedicine. Lecture 5: Correlation and Power-Spectrum CCNY 1 BME 50500: Image and Signal Processing in Biomedicine Lecture 5: Correlation and Power-Spectrum Lucas C. Parra Biomedical Engineering Department CCNY http://bme.ccny.cuny.edu/faculty/parra/teaching/signal-and-image/

More information

Section 2.4: Add and Subtract Rational Expressions

Section 2.4: Add and Subtract Rational Expressions CHAPTER Section.: Add and Subtract Rational Expressions Section.: Add and Subtract Rational Expressions Objective: Add and subtract rational expressions with like and different denominators. You will recall

More information

System Modeling and Identification CHBE 702 Korea University Prof. Dae Ryook Yang

System Modeling and Identification CHBE 702 Korea University Prof. Dae Ryook Yang System Modeling and Identification CHBE 702 Korea University Prof. Dae Ryook Yang 1-1 Course Description Emphases Delivering concepts and Practice Programming Identification Methods using Matlab Class

More information

Generalized Sidelobe Canceller and MVDR Power Spectrum Estimation. Bhaskar D Rao University of California, San Diego

Generalized Sidelobe Canceller and MVDR Power Spectrum Estimation. Bhaskar D Rao University of California, San Diego Generalized Sidelobe Canceller and MVDR Power Spectrum Estimation Bhaskar D Rao University of California, San Diego Email: brao@ucsd.edu Reference Books 1. Optimum Array Processing, H. L. Van Trees 2.

More information

ENSC327 Communications Systems 19: Random Processes. Jie Liang School of Engineering Science Simon Fraser University

ENSC327 Communications Systems 19: Random Processes. Jie Liang School of Engineering Science Simon Fraser University ENSC327 Communications Systems 19: Random Processes Jie Liang School of Engineering Science Simon Fraser University 1 Outline Random processes Stationary random processes Autocorrelation of random processes

More information

Fourier Series and Fourier Transforms

Fourier Series and Fourier Transforms Fourier Series and Fourier Transforms EECS2 (6.082), MIT Fall 2006 Lectures 2 and 3 Fourier Series From your differential equations course, 18.03, you know Fourier s expression representing a T -periodic

More information

Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science : Discrete-Time Signal Processing

Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science : Discrete-Time Signal Processing Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science 6.34: Discrete-Time Signal Processing OpenCourseWare 006 ecture 8 Periodogram Reading: Sections 0.6 and 0.7

More information

Time series models in the Frequency domain. The power spectrum, Spectral analysis

Time series models in the Frequency domain. The power spectrum, Spectral analysis ime series models in the Frequency domain he power spectrum, Spectral analysis Relationship between the periodogram and the autocorrelations = + = ( ) ( ˆ α ˆ ) β I Yt cos t + Yt sin t t= t= ( ( ) ) cosλ

More information

ECE-340, Spring 2015 Review Questions

ECE-340, Spring 2015 Review Questions ECE-340, Spring 2015 Review Questions 1. Suppose that there are two categories of eggs: large eggs and small eggs, occurring with probabilities 0.7 and 0.3, respectively. For a large egg, the probabilities

More information

Atmospheric Flight Dynamics Example Exam 2 Solutions

Atmospheric Flight Dynamics Example Exam 2 Solutions Atmospheric Flight Dynamics Example Exam Solutions 1 Question Given the autocovariance function, C x x (τ) = 1 cos(πτ) (1.1) of stochastic variable x. Calculate the autospectrum S x x (ω). NOTE Assume

More information

Modern Navigation. Thomas Herring

Modern Navigation. Thomas Herring 12.215 Modern Navigation Thomas Herring Estimation methods Review of last class Restrict to basically linear estimation problems (also non-linear problems that are nearly linear) Restrict to parametric,

More information

Higher-order statistics: improved event resolution?

Higher-order statistics: improved event resolution? Higher-order statistics: improved event resolution? David C. Henley and Arnim B. Haase Higher-order statistics ABSTRACT In any area where near-surface earth structure causes one or more small time delays

More information

Lecture - 30 Stationary Processes

Lecture - 30 Stationary Processes Probability and Random Variables Prof. M. Chakraborty Department of Electronics and Electrical Communication Engineering Indian Institute of Technology, Kharagpur Lecture - 30 Stationary Processes So,

More information

Statistical signal processing

Statistical signal processing Statistical signal processing Short overview of the fundamentals Outline Random variables Random processes Stationarity Ergodicity Spectral analysis Random variable and processes Intuition: A random variable

More information

ADAPTIVE ANTENNAS. SPATIAL BF

ADAPTIVE ANTENNAS. SPATIAL BF ADAPTIVE ANTENNAS SPATIAL BF 1 1-Spatial reference BF -Spatial reference beamforming may not use of embedded training sequences. Instead, the directions of arrival (DoA) of the impinging waves are used

More information

Measurement Theory. Reliability. Error Sources. = XY r XX. r XY. r YY

Measurement Theory. Reliability. Error Sources. = XY r XX. r XY. r YY Y -3 - -1 0 1 3 X Y -10-5 0 5 10 X Measurement Theory t & X 1 X X 3 X k Reliability e 1 e e 3 e k 1 The Big Picture Measurement error makes it difficult to identify the true patterns of relationships between

More information

16.584: Random (Stochastic) Processes

16.584: Random (Stochastic) Processes 1 16.584: Random (Stochastic) Processes X(t): X : RV : Continuous function of the independent variable t (time, space etc.) Random process : Collection of X(t, ζ) : Indexed on another independent variable

More information

ECE 636: Systems identification

ECE 636: Systems identification ECE 636: Systems identification Lectures 3 4 Random variables/signals (continued) Random/stochastic vectors Random signals and linear systems Random signals in the frequency domain υ ε x S z + y Experimental

More information

Fourier Analysis Linear transformations and lters. 3. Fourier Analysis. Alex Sheremet. April 11, 2007

Fourier Analysis Linear transformations and lters. 3. Fourier Analysis. Alex Sheremet. April 11, 2007 Stochastic processes review 3. Data Analysis Techniques in Oceanography OCP668 April, 27 Stochastic processes review Denition Fixed ζ = ζ : Function X (t) = X (t, ζ). Fixed t = t: Random Variable X (ζ)

More information

DATA IN SERIES AND TIME I. Several different techniques depending on data and what one wants to do

DATA IN SERIES AND TIME I. Several different techniques depending on data and what one wants to do DATA IN SERIES AND TIME I Several different techniques depending on data and what one wants to do Data can be a series of events scaled to time or not scaled to time (scaled to space or just occurrence)

More information

Copula Regression RAHUL A. PARSA DRAKE UNIVERSITY & STUART A. KLUGMAN SOCIETY OF ACTUARIES CASUALTY ACTUARIAL SOCIETY MAY 18,2011

Copula Regression RAHUL A. PARSA DRAKE UNIVERSITY & STUART A. KLUGMAN SOCIETY OF ACTUARIES CASUALTY ACTUARIAL SOCIETY MAY 18,2011 Copula Regression RAHUL A. PARSA DRAKE UNIVERSITY & STUART A. KLUGMAN SOCIETY OF ACTUARIES CASUALTY ACTUARIAL SOCIETY MAY 18,2011 Outline Ordinary Least Squares (OLS) Regression Generalized Linear Models

More information

[ ], [ ] [ ] [ ] = [ ] [ ] [ ]{ [ 1] [ 2]

[ ], [ ] [ ] [ ] = [ ] [ ] [ ]{ [ 1] [ 2] 4. he discrete Fourier transform (DF). Application goal We study the discrete Fourier transform (DF) and its applications: spectral analysis and linear operations as convolution and correlation. We use

More information

The statistics of ocean-acoustic ambient noise

The statistics of ocean-acoustic ambient noise The statistics of ocean-acoustic ambient noise Nicholas C. Makris Naval Research Laboratory, Washington, D.C. 0375, USA Abstract With the assumption that the ocean-acoustic ambient noise field is a random

More information

CHAPTER 2 RANDOM PROCESSES IN DISCRETE TIME

CHAPTER 2 RANDOM PROCESSES IN DISCRETE TIME CHAPTER 2 RANDOM PROCESSES IN DISCRETE TIME Shri Mata Vaishno Devi University, (SMVDU), 2013 Page 13 CHAPTER 2 RANDOM PROCESSES IN DISCRETE TIME When characterizing or modeling a random variable, estimates

More information

2A1H Time-Frequency Analysis II

2A1H Time-Frequency Analysis II 2AH Time-Frequency Analysis II Bugs/queries to david.murray@eng.ox.ac.uk HT 209 For any corrections see the course page DW Murray at www.robots.ox.ac.uk/ dwm/courses/2tf. (a) A signal g(t) with period

More information

CMPT 318: Lecture 5 Complex Exponentials, Spectrum Representation

CMPT 318: Lecture 5 Complex Exponentials, Spectrum Representation CMPT 318: Lecture 5 Complex Exponentials, Spectrum Representation Tamara Smyth, tamaras@cs.sfu.ca School of Computing Science, Simon Fraser University January 23, 2006 1 Exponentials The exponential is

More information

Name of the Student: Problems on Discrete & Continuous R.Vs

Name of the Student: Problems on Discrete & Continuous R.Vs Engineering Mathematics 08 SUBJECT NAME : Probability & Random Processes SUBJECT CODE : MA645 MATERIAL NAME : University Questions REGULATION : R03 UPDATED ON : November 07 (Upto N/D 07 Q.P) (Scan the

More information

Regression Analysis. y t = β 1 x t1 + β 2 x t2 + β k x tk + ϵ t, t = 1,..., T,

Regression Analysis. y t = β 1 x t1 + β 2 x t2 + β k x tk + ϵ t, t = 1,..., T, Regression Analysis The multiple linear regression model with k explanatory variables assumes that the tth observation of the dependent or endogenous variable y t is described by the linear relationship

More information

Music 270a: Complex Exponentials and Spectrum Representation

Music 270a: Complex Exponentials and Spectrum Representation Music 270a: Complex Exponentials and Spectrum Representation Tamara Smyth, trsmyth@ucsd.edu Department of Music, University of California, San Diego (UCSD) October 24, 2016 1 Exponentials The exponential

More information

Problems on Discrete & Continuous R.Vs

Problems on Discrete & Continuous R.Vs 013 SUBJECT NAME SUBJECT CODE MATERIAL NAME MATERIAL CODE : Probability & Random Process : MA 61 : University Questions : SKMA1004 Name of the Student: Branch: Unit I (Random Variables) Problems on Discrete

More information

Time Series Examples Sheet

Time Series Examples Sheet Lent Term 2001 Richard Weber Time Series Examples Sheet This is the examples sheet for the M. Phil. course in Time Series. A copy can be found at: http://www.statslab.cam.ac.uk/~rrw1/timeseries/ Throughout,

More information

9.4 Enhancing the SNR of Digitized Signals

9.4 Enhancing the SNR of Digitized Signals 9.4 Enhancing the SNR of Digitized Signals stepping and averaging compared to ensemble averaging creating and using Fourier transform digital filters removal of Johnson noise and signal distortion using

More information

A polynomial expression is the addition or subtraction of many algebraic terms with positive integer powers.

A polynomial expression is the addition or subtraction of many algebraic terms with positive integer powers. LEAVING CERT Honours Maths notes on Algebra. A polynomial expression is the addition or subtraction of many algebraic terms with positive integer powers. The degree is the highest power of x. 3x 2 + 2x

More information

SOLUTIONS FOR PROBLEMS 1-30

SOLUTIONS FOR PROBLEMS 1-30 . Answer: 5 Evaluate x x + 9 for x SOLUTIONS FOR PROBLEMS - 0 When substituting x in x be sure to do the exponent before the multiplication by to get (). + 9 5 + When multiplying ( ) so that ( 7) ( ).

More information

Two Posts to Fill On School Board

Two Posts to Fill On School Board Y Y 9 86 4 4 qz 86 x : ( ) z 7 854 Y x 4 z z x x 4 87 88 Y 5 x q x 8 Y 8 x x : 6 ; : 5 x ; 4 ( z ; ( ) ) x ; z 94 ; x 3 3 3 5 94 ; ; ; ; 3 x : 5 89 q ; ; x ; x ; ; x : ; ; ; ; ; ; 87 47% : () : / : 83

More information

(a)

(a) Chapter 8 Subspace Methods 8. Introduction Principal Component Analysis (PCA) is applied to the analysis of time series data. In this context we discuss measures of complexity and subspace methods for

More information

Spectral Analysis. Jesús Fernández-Villaverde University of Pennsylvania

Spectral Analysis. Jesús Fernández-Villaverde University of Pennsylvania Spectral Analysis Jesús Fernández-Villaverde University of Pennsylvania 1 Why Spectral Analysis? We want to develop a theory to obtain the business cycle properties of the data. Burns and Mitchell (1946).

More information

EE4601 Communication Systems

EE4601 Communication Systems EE4601 Communication Systems Week 4 Ergodic Random Processes, Power Spectrum Linear Systems 0 c 2011, Georgia Institute of Technology (lect4 1) Ergodic Random Processes An ergodic random process is one

More information

Extrema of Functions of Several Variables

Extrema of Functions of Several Variables Extrema of Functions of Several Variables MATH 311, Calculus III J. Robert Buchanan Department of Mathematics Fall 2011 Background (1 of 3) In single-variable calculus there are three important results

More information

t 2 + 2t dt = (t + 1) dt + 1 = arctan t x + 6 x(x 3)(x + 2) = A x +

t 2 + 2t dt = (t + 1) dt + 1 = arctan t x + 6 x(x 3)(x + 2) = A x + MATH 06 0 Practice Exam #. (0 points) Evaluate the following integrals: (a) (0 points). t +t+7 This is an irreducible quadratic; its denominator can thus be rephrased via completion of the square as a

More information

Name of the Student: Problems on Discrete & Continuous R.Vs

Name of the Student: Problems on Discrete & Continuous R.Vs SUBJECT NAME : Probability & Random Processes SUBJECT CODE : MA645 MATERIAL NAME : Additional Problems MATERIAL CODE : JM08AM004 REGULATION : R03 UPDATED ON : March 05 (Scan the above QR code for the direct

More information

ω 0 = 2π/T 0 is called the fundamental angular frequency and ω 2 = 2ω 0 is called the

ω 0 = 2π/T 0 is called the fundamental angular frequency and ω 2 = 2ω 0 is called the he ime-frequency Concept []. Review of Fourier Series Consider the following set of time functions {3A sin t, A sin t}. We can represent these functions in different ways by plotting the amplitude versus

More information

Stochastic Process II Dr.-Ing. Sudchai Boonto

Stochastic Process II Dr.-Ing. Sudchai Boonto Dr-Ing Sudchai Boonto Department of Control System and Instrumentation Engineering King Mongkuts Unniversity of Technology Thonburi Thailand Random process Consider a random experiment specified by the

More information

TSKS01 Digital Communication Lecture 1

TSKS01 Digital Communication Lecture 1 TSKS01 Digital Communication Lecture 1 Introduction, Repetition, and Noise Modeling Emil Björnson Department of Electrical Engineering (ISY) Division of Communication Systems Emil Björnson Course Director

More information

Reliability and Risk Analysis. Time Series, Types of Trend Functions and Estimates of Trends

Reliability and Risk Analysis. Time Series, Types of Trend Functions and Estimates of Trends Reliability and Risk Analysis Stochastic process The sequence of random variables {Y t, t = 0, ±1, ±2 } is called the stochastic process The mean function of a stochastic process {Y t} is the function

More information

Chapter 7: The z-transform

Chapter 7: The z-transform Chapter 7: The -Transform ECE352 1 The -Transform - definition Continuous-time systems: e st H(s) y(t) = e st H(s) e st is an eigenfunction of the LTI system h(t), and H(s) is the corresponding eigenvalue.

More information

ECE 636: Systems identification

ECE 636: Systems identification ECE 636: Systems identification Lectures 7 8 onparametric identification (continued) Important distributions: chi square, t distribution, F distribution Sampling distributions ib i Sample mean If the variance

More information

Lecture 7 Random Signal Analysis

Lecture 7 Random Signal Analysis Lecture 7 Random Signal Analysis 7. Introduction to Probability 7. Amplitude Distributions 7.3 Uniform, Gaussian, and Other Distributions 7.4 Power and Power Density Spectra 7.5 Properties of the Power

More information

Basic Descriptions and Properties

Basic Descriptions and Properties CHAPTER 1 Basic Descriptions and Properties This first chapter gives basic descriptions and properties of deterministic data and random data to provide a physical understanding for later material in this

More information

NOISE ROBUST RELATIVE TRANSFER FUNCTION ESTIMATION. M. Schwab, P. Noll, and T. Sikora. Technical University Berlin, Germany Communication System Group

NOISE ROBUST RELATIVE TRANSFER FUNCTION ESTIMATION. M. Schwab, P. Noll, and T. Sikora. Technical University Berlin, Germany Communication System Group NOISE ROBUST RELATIVE TRANSFER FUNCTION ESTIMATION M. Schwab, P. Noll, and T. Sikora Technical University Berlin, Germany Communication System Group Einsteinufer 17, 1557 Berlin (Germany) {schwab noll

More information

Subject: Combining data from separate regions to improve the detection probability

Subject: Combining data from separate regions to improve the detection probability DEUTERIUM ARRAY MEMO #6 MASSACHUSETTS INSTITUTE OF TECHNOLOGY HAYSTACK OBSERVATORY WESTFORD, MASSACHUSETTS 886 November, 4 Telephone: 978-69-4764 Fax: 78-98-59 To: From: Deuterium Array Group Alan E.E.

More information

Quadratic Formula: - another method for solving quadratic equations (ax 2 + bx + c = 0)

Quadratic Formula: - another method for solving quadratic equations (ax 2 + bx + c = 0) In the previous lesson we showed how to solve quadratic equations that were not factorable and were not perfect squares by making perfect square trinomials using a process called completing the square.

More information

ECE-S Introduction to Digital Signal Processing Lecture 3C Properties of Autocorrelation and Correlation

ECE-S Introduction to Digital Signal Processing Lecture 3C Properties of Autocorrelation and Correlation ECE-S352-701 Introduction to Digital Signal Processing Lecture 3C Properties of Autocorrelation and Correlation Assuming we have two sequences x(n) and y(n) from which we form a linear combination: c(n)

More information