Lecture 13: Applications of Fourier transforms (Recipes, Chapter 13)

Similar documents
In many diverse fields physical data is collected or analysed as Fourier components.

Notes on Wavelets- Sandra Chapman (MPAGS: Time series analysis) # $ ( ) = G f. y t

Introduction to Analog And Digital Communications

Midterm Summary Fall 08. Yao Wang Polytechnic University, Brooklyn, NY 11201

Lecture 7. Fourier Analysis

SIO 211B, Rudnick. We start with a definition of the Fourier transform! ĝ f of a time series! ( )

TLT-5200/5206 COMMUNICATION THEORY, Exercise 3, Fall TLT-5200/5206 COMMUNICATION THEORY, Exercise 3, Fall Problem 1.

ENSC327 Communications Systems 2: Fourier Representations. School of Engineering Science Simon Fraser University

Mixed Signal IC Design Notes set 6: Mathematics of Electrical Noise

Figure 3.1 Effect on frequency spectrum of increasing period T 0. Consider the amplitude spectrum of a periodic waveform as shown in Figure 3.2.

Systems & Signals 315

Example: When describing where a function is increasing, decreasing or constant we use the x- axis values.

EEO 401 Digital Signal Processing Prof. Mark Fowler

EECE 301 Signals & Systems Prof. Mark Fowler

The Fourier Transform

CHAPTER 1: INTRODUCTION. 1.1 Inverse Theory: What It Is and What It Does

Products and Convolutions of Gaussian Probability Density Functions

Digital Image Processing. Lecture 6 (Enhancement) Bu-Ali Sina University Computer Engineering Dep. Fall 2009

A Fourier Transform Model in Excel #1

2 Frequency-Domain Analysis

13.1 Convolution and Deconvolution Using the FFT

IMPROVED NOISE CANCELLATION IN DISCRETE COSINE TRANSFORM DOMAIN USING ADAPTIVE BLOCK LMS FILTER

ESS Finite Impulse Response Filters and the Z-transform

RATIONAL FUNCTIONS. Finding Asymptotes..347 The Domain Finding Intercepts Graphing Rational Functions

Treatment and analysis of data Applied statistics Lecture 6: Bayesian estimation

Additional exercises in Stationary Stochastic Processes

Chapter 4 Imaging. Lecture 21. d (110) Chem 793, Fall 2011, L. Ma

The Continuous Time Fourier Transform

CHAPTER 8 ANALYSIS OF AVERAGE SQUARED DIFFERENCE SURFACES

Lab 3: The FFT and Digital Filtering. Slides prepared by: Chun-Te (Randy) Chu

References Ideal Nyquist Channel and Raised Cosine Spectrum Chapter 4.5, 4.11, S. Haykin, Communication Systems, Wiley.

Homework 4. May An LTI system has an input, x(t) and output y(t) related through the equation y(t) = t e (t t ) x(t 2)dt

Parametrization of the Local Scattering Function Estimator for Vehicular-to-Vehicular Channels

27. The Fourier Transform in optics, II

Nyquist sampling a bandlimited function. Sampling: The connection from CT to DT. Impulse Train sampling. Interpolation: Signal Reconstruction

Information and Communications Security: Encryption and Information Hiding

Fourier Series. (Com S 477/577 Notes) Yan-Bin Jia. Nov 29, 2016

Estimation and detection of a periodic signal

WORCESTER POLYTECHNIC INSTITUTE

Probabilistic Model of Error in Fixed-Point Arithmetic Gaussian Pyramid

SPOC: An Innovative Beamforming Method

Therefore the new Fourier coefficients are. Module 2 : Signals in Frequency Domain Problem Set 2. Problem 1

BME 50500: Image and Signal Processing in Biomedicine. Lecture 5: Correlation and Power-Spectrum CCNY

Computer Vision. Filtering in the Frequency Domain

Ultra Fast Calculation of Temperature Profiles of VLSI ICs in Thermal Packages Considering Parameter Variations

Continuous Fourier transform of a Gaussian Function

PROBLEM SET 1 (Solutions) (MACROECONOMICS cl. 15)

Quality Improves with More Rays

MHF 4U Unit 7: Combining Functions May 29, Review Solutions

SEISMIC WAVE PROPAGATION. Lecture 2: Fourier Analysis

Computed Tomography Notes, Part 1. The equation that governs the image intensity in projection imaging is:

A Class of Fast Methods for Processing Irregularly Sampled. or Otherwise Inhomogeneous One-Dimensional Data. Abstract

Convolution and Linear Systems

Correlator I. Basics. Chapter Introduction. 8.2 Digitization Sampling. D. Anish Roshi

Presenters. Time Domain and Statistical Model Development, Simulation and Correlation Methods for High Speed SerDes

Asymptote. 2 Problems 2 Methods

The Discrete Fourier transform

Chapter 4 Image Enhancement in the Frequency Domain

BME 50500: Image and Signal Processing in Biomedicine. Lecture 2: Discrete Fourier Transform CCNY

Enhancement Using Local Histogram

CAP 5415 Computer Vision Fall 2011

Least-Squares Spectral Analysis Theory Summary

Ex x xf xdx. Ex+ a = x+ a f x dx= xf x dx+ a f xdx= xˆ. E H x H x H x f x dx ˆ ( ) ( ) ( ) μ is actually the first moment of the random ( )

Computed Tomography Notes, Part 1. The equation that governs the image intensity in projection imaging is:

Image Enhancement (Spatial Filtering 2)

CAP 5415 Computer Vision

Review: Continuous Fourier Transform

27. The Fourier Transform in optics, II

EE123 Digital Signal Processing

Roberto s Notes on Differential Calculus Chapter 8: Graphical analysis Section 1. Extreme points

System Identification & Parameter Estimation

SNR Calculation and Spectral Estimation [S&T Appendix A]

Discrete-Time Fourier Transform (DTFT)

The achievable limits of operational modal analysis. * Siu-Kui Au 1)

Chapter 6 Frequency Response, Bode Plots and Resonance

26. The Fourier Transform in optics

Fourier Analysis of Signals Using the DFT

Two-step self-tuning phase-shifting interferometry

Numerical Methods - Lecture 2. Numerical Methods. Lecture 2. Analysis of errors in numerical methods

Gravitational-Wave Data Analysis: Lecture 2

! Circular Convolution. " Linear convolution with circular convolution. ! Discrete Fourier Transform. " Linear convolution through circular

5.5 Sampling. The Connection Between: Continuous Time & Discrete Time

IB Paper 6: Signal and Data Analysis

Phys460.nb Back to our example. on the same quantum state. i.e., if we have initial condition (5.241) ψ(t = 0) = χ n (t = 0)

Signals & Linear Systems Analysis Chapter 2&3, Part II

Fall 2011, EE123 Digital Signal Processing

ANALOG AND DIGITAL SIGNAL PROCESSING CHAPTER 3 : LINEAR SYSTEM RESPONSE (GENERAL CASE)

Lecture : Feedback Linearization

Probability, Statistics, and Reliability for Engineers and Scientists MULTIPLE RANDOM VARIABLES

A523 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Spring 2011

ANALOG AND DIGITAL SIGNAL PROCESSING ADSP - Chapter 8

Categories and Natural Transformations

Correlation, discrete Fourier transforms and the power spectral density

ELEG 3124 SYSTEMS AND SIGNALS Ch. 5 Fourier Transform

8. THEOREM If the partial derivatives f x. and f y exist near (a, b) and are continuous at (a, b), then f is differentiable at (a, b).

Communication Systems Lecture 21, 22. Dong In Kim School of Information & Comm. Eng. Sungkyunkwan University

Figure 18: Top row: example of a purely continuous spectrum (left) and one realization

Chapter 8 The Discrete Fourier Transform

New Functions from Old Functions

Signal Processing COS 323

Transcription:

Lecture 13: Applications o Fourier transorms (Recipes, Chapter 13 There are many applications o FT, some o which involve the convolution theorem (Recipes 13.1: The convolution o h(t and r(t is deined by s(t = h* r = dt h(t r(t t = dt h(t r(t t It is trivial to show that S( = [h* r](t exp (πit dt = H( R( 93

Instrumental response unction A classic example o a convolution results rom the inite resolution o a measuring instrument. Example: a spectrograph has inite wavelength resolution, which smears the observed spectrum: even a delta unction is smeared out to a eature o inite width Flux λ 94

Instrumental response unction The instrumental response is characterized by a resolution unction r, which describes how an intrinsically very narrow unction will be broadened The unction r is usually peaked at zero r 0 95

Convolution o a signal with a resolution unction Suppose we have discretely sampled our resolution unction r(t and our signal h(t to obtain r k and h k Suppose h is periodic and has been sampled at N points: k = 0, N 1 r is usually sampled (almost symmetrically about 0: r k = r(kδt with k = ½N+1,, 0,, ½N 96

Convolution o a signal with a resolution unction The convolution can then be written N / (h* r k = r j h k j j= 1 N / To avoid aliasing, r j must also be periodic with period N r j = r j+n so we can shit the indexing rom k = ½N+1,, 0,, ½N to k = 0 to N 1 97

Convolution o a signal with a resolution unction The reordering changes the r k rom to 0 0 N and the convolution becomes N 1 (h* r k = r j h k j j= 0 98

Convolution o a signal with a resolution unction The convolution theorem tells us that the discrete Fourier transorm o s k = (h * r k is S n = H n R n suggesting that we can compute the convolution by obtaining the discrete FTs o h and r, multiplying them, and taking the inverse Fourier transorm o the product 99

Computational expense o convolution Thanks to the Fast Fourier Transorm (FFT, this can save a lot o computational expense N 1 Direct calculation o (h* r k = r j h k j takes N j= 0 operations 300

Computational expense o convolution Calculation with FFT method takes N log N operations or H n N log N operations or R n N operations to multiply H n and R n N log N operations to take the inverse FT o S n or a total o N(1+3 log N operations.. 301

Computational expense o convolution. which can yield a huge savings e.g. or N = 10 5 : N = x 10 10 N(1+3 log N = 5 x 10 6 (although note that i the resolution unction is narrowly peaked, r k may have only M non-zero values, where M << N, and the direct calculation only costs NM 30

Deconvolution A key application, o course, is the deconvolution: i.e. given the measurements s k, and knowing the resolution unction r k, we estimate the signal h k A direct solution o s k = r j h k j h, requires O(N 3 j 0 operations, given s and (or O(N M in the limit where r k has only M nonzero elements N 1 = 303

Deconvolution Using FFT, the procedure entails Compute S n : Compute R n : Compute H n = S n /R n : Inverse FT o H n : N log N operations N log N operations N operations N log N operations again or a total o N(1+3 log N operations.. 304

Problems with deconvolution Two key issues arise: 1 R n (and S n may be zero (or very small at some requencies so that H n is undeined (smearing leads to unavoidable loss o inormation at high requencies Noise can enter and spoil the precision 305

Eect o noise Instead o measuring a perect convolved signal, s(t = h * r, we actually measure c(t = s(t + n(t, where n(t is the noise at time t How do we extract a good estimate o h in the presence o noise? 306

Filtering (Recipes 13. We can attempt to correct or the presence o noise by multiplying C( by a ilter unction, Φ(, which we will take as real: i.e. we write our best estimate o H( ~ H ( = C( Φ( / R( [instead o H( = S( / R(] Q: what ilter unction yields the best estimate o H(? 307

308 Filtering The optimal ilter unction is chosen to minimize the mean square deviation d R N S R S d H H dt t h t h P MSD ( ] ( ( [ ( ( ( ( ~ ( ( ~ ( + Φ = = =

Filtering This becomes P MSD 1 Φ( S( = R( + Φ( N( ] d plus terms involving N*(S(, which average to zero i the noise is uncorrelated with the signal 309

Wiener iltering The mean square deviation is minimized or 0 = dp MSD / dφ = [1 Φ( ] S( R( + Φ( N( ] d Φ( = S( S( + N( 310

Wiener iltering O course, S( is not directly measurable All we measure is c(t = s(t + n(t, or which the Fourier transorm is C( I the signal and the noise are uncorrelated, the power spectrum o c(t is C( = S( + N( = S( + N( 311

Power spectrum o c(t The power spectrum o the real data then looks like this: 31

Power spectrum o c(t rom which Φ( = S( / ( S( + N( can oten be inerred Alternatively, N( can be characterized independently in a separate measurement where the signal is absent 313