In many diverse fields physical data is collected or analysed as Fourier components.
|
|
- Gervase Richardson
- 5 years ago
- Views:
Transcription
1 1. Fourier Methods In many diverse ields physical data is collected or analysed as Fourier components. In this section we briely discuss the mathematics o Fourier series and Fourier transorms. 1. Fourier Series (x) Any well-behaved unction can be expanded in terms o an ininite sum o sines and cosines. The expansion takes the orm: ( x) 1 a + a cosnx+ b sin nx n n 1 n 1 n Joseph Fourier ( ) SUPA Advanced Data Analysis Course, 18
2 The Fourier coeicients are given by the ormulae: 1 a ( x) dx a n 1 ( x) cosnxdx b n 1 ( x) sin nxdx These ormulae ollow rom the orthogonality properties o sin and cos: sin mxsin nxdx δ mn cosmxcosnxdx δ mn sin mxcosnxdx SUPA Advanced Data Analysis Course, 18
3 Some examples rom Mathworld, approximating unctions with a inite number o Fourier series terms
4 The Fourier series can also be written in complex orm: ( x) n A n e inx where 1 An ( x) e inx dx and recall that e inx e inx cos nx+ isin nx cosnx isin nx Fourier's Theorem is not only one o the most beautiul results o modern analysis, but it is said to urnish an indispensable instrument in the treatment o nearly every recondite question in modern physics
5 Fourier Transorm: Basic Deinition The Fourier transorm can be thought o simply as extending the idea o a Fourier series rom an ininite sum over discrete, integer Fourier modes to an ininite integral over continuous Fourier modes. Consider, or example, a physical process that is varying in the time domain, i.e. it is described by some unction o time. Alternatively we can describe the physical process in the requency domain by deining the Fourier Transorm unction. h (t) H( ) H( It is useul to think o and as two dierent representations o the same unction; the inormation they convey about the underlying physical process should be equivalent. ) SUPA Advanced Data Analysis Course, 18
6 We deine the Fourier transorm as H( ) it h( t) e dt and the corresponding inverse Fourier transorm as h( t) t H( ) e i d I time is measured in seconds then requency is measured in cycles per second, or Hertz. SUPA Advanced Data Analysis Course, 18
7 In many physical applications it is common to deine the requency domain behaviour o the unction in terms o angular requency This changes the previous relations accordingly: ω H( ω) iωt h( t) e dt h( t) 1 ω i t H( ω) e dω Thus the symmetry o the previous expressions is broken. SUPA Advanced Data Analysis Course, 18
8 Fourier Transorm: Further properties The FT is a linear operation: (1) the FT o the sum o two unctions is equal to the sum o their FTs () the FT o a constant times a unction is equal to the constant times the FT o the unction. I the time domain unction is a real unction, then its FT is complex. However, more generally we can consider the case where is also a complex unction i.e. we can write h( t) h ( t) ih ( t) R + I Real part Imaginary part may also possess certain symmetries: even unction odd unction h( t) h( t) h( t) h( t)
9 The ollowing properties then hold: See umerical Recipes, Section 1. ote that in the above table a star (*) denotes the complex conjugate, i.e. i z x + i y then z* x i y SUPA Advanced Data Analysis Course, 18
10 For convenience we will denote the FT pair by It is then straightorward to show that h( t) H( ) 1 h( at) H( a) time scaling a 1 b h( t b) H( b ) requency scaling h( t t ) H( ) e i t time shiting ( ) i t h t e H( ) requency scaling SUPA Advanced Data Analysis Course, 18
11 Suppose we have two unctions and Their convolution is deined as g (t) ( h) ( t) g g( s) h( t s) ds We can prove the Convolution Theorem ( g h) ( t) G( ) H( ) i.e. the FT o the convolution o the two unctions is equal to the product o their individual FTs. SUPA Advanced Data Analysis Course, 18
12 Example application: the observed spectrum o light rom a galaxy is a convolution o stellar spectral templates smeared out by the line o sight velocity distribution and the G( u) F d ( vlos) S( u vlos) vlos Galaxy spectrum LOSVD stellar spectra This is a particular type o integral equation: g( y) ( x) s( y x)dx Data unction Source unction Kernel unction
13 So by the convolution theorem: ~ G ( k) ~ F( k) ~ S( k) and F ~ ( ) ( 1 G k v F LOS ~ ~ ) S( k) Inverse Fourier transorm Hence, we can in principle invert the integral equation and ( ) v LOS reconstruct the LOSVD,. F In practice, this method is vulnerable to noise on the observed G (u) S(u) galaxy spectrum,, and uncertainties in the kernel. eed to ilter out high requency (k) noise SUPA Advanced Data Analysis Course, 18
14 Filter, denoting range o wavenumberswhich give reliable inversion Ratio o two small quantities: very noisy SUPA Advanced Data Analysis Course, 18
15 Suppose we have two unctions and Their convolution is deined as g (t) ( h) ( t) g g( s) h( t s) ds We can prove the Convolution Theorem ( g h) ( t) G( ) H( ) i.e. the FT o the convolution o the two unctions is equal to the product o their individual FTs. Known as the lag Also their correlation, which is also a unction o t, is deined as Corr( g, h) g( s+ t) h( s) ds SUPA Advanced Data Analysis Course, 18
16 We can prove the Correlation Theorem Corr( g, h) G( ) H ( ) i.e. the FT o the irst time domain unction, multiplied by the complex conjugate o the FT o the second time domain unction, is equal to the FT o their correlation. The correlation o a unction with itsel is called the auto-correlation In this case Corr( g, g) G( ) G( ) The unction is known as the power spectral density, or (more loosely) as the power spectrum. Hence, the power spectrum is equal to the Fourier Transorm o the auto-correlation unction or the time domain unction g(t) SUPA Advanced Data Analysis Course, 18
17 The power spectral density The power spectral density is analogous to the pd we deined in previous sections. In order to know how much power is contained in a given interval o requency, we need to integrate the power spectral density over that interval. The total power in a signal is the same, regardless o whether we measure it in the time domain or the requency domain: Total Power dt - - H() d Parseval s Theorem SUPA Advanced Data Analysis Course, 18
18 Oten we will want to know how much power is contained in a requency interval without distinguishing between positive and negative values. In this case we deine the one-sided power spectral density: P h ( ) H( ) + H( ) < And Total Power P h ( ) d When is a real unction P h ( ) H( ) With the proper normalisation, the total power (i.e. the integrated area under the relevant curve) is the same regardless o whether we are working with the time domain signal, the power spectral density or the one-sided power spectral density.
19 From umerical Recipes, Chapter 1. Time domain One-sided PSD Two-sided PSD
20 Examples (1) h( t) const. Dirac Delta unction H( ) δd() H( ) t () i t h( t) e H( ) δd( ) H( ) t Imaginary part Real part
21 H( ) sinc( ) (3) 1 h( t) or 1 t otherwise 1 H( ) Imaginary part t y sincx The sinc unction occurs requently in many areas o physics y1 sinc x sin x x 1 st zeroat x 1 st zeroat x x x ±m The unction has a maximum at and the zeros occur at or positive integer m x
22 (4) h( t) ( t) H( ) sinc ( ) H( ) 1 1-1/ 1/ t Re [ H( ) ] a a + 4 (5) h( t) e at Im [ H( ) ] a ( a + 4 ) H( ) Real part t Imaginary part
23 (6) h( t) exp( a t ) ( / ) H( ) exp a t i.e. the FT o a Gaussian unction in the time domain is also a Gaussian in the requency domain. SUPA Advanced Data Analysis Course, 18
24 Question : I the variance o a Gaussian is doubled in the time domain A the variance o its Fourier transorm will be doubled in the requency domain B the variance o its Fourier transorm will be halved in the requency domain C the standard deviation o its Fourier transorm will be doubled in the requency domain D the standard deviation o its Fourier transorm will be halved in the requency domain
25 (6) h( t) exp( a t ) ( / ) H( ) exp a t i.e. the FT o a Gaussian unction in the time domain is also a Gaussian in the requency domain. The broader the Gaussian is in the time domain, then the narrower the Gaussian FT in the requency domain, and vice versa. SUPA Advanced Data Analysis Course, 18
26 Discrete Fourier Transorms Although we have discussed FTs so ar in the context o a continuous, analytic unction,, in many practical situations we must work instead with observational data which are sampled at a discrete set o times. Suppose that we sample in total times at evenly spaced time intervals, i.e. (or even) +1 h k h ( t k ) where t k k, k,...,,..., [ I is non-zero over only a inite interval o time, then we +1 suppose that the sampled points contain this interval. Or i has an ininite range, then we at least suppose that the sampled points cover a suicient range to be representative o the behaviour o ]. SUPA Advanced Data Analysis Course, 18
27 We thereore approximate the FT as H( ) k t h( t) e i dt h k k e i t k + 1 Since we are sampling at discrete timesteps, in view o the symmetry o the FT and inverse FT it makes sense also to compute +1 only at a set o discrete requencies: H( ) n n, n,...,,..., c 1 (The requency is known as the yquist (critical) requency and it is a very important value. We discuss its signiicance later). SUPA Advanced Data Analysis Course, 18
28 Then ote that Hence, there are only independent values. Also, note that So we can re-deine the Discrete FT as: n k ik n k n H e h H 1 / ) ( in in e e k in ikn in ikn e e e )/ ( / / + + / ) ( k k ikn k k k t i k n e h e h H k n Discrete Fourier Transorm o the k h SUPA Advanced Data Analysis Course, 18
29 The discrete inverse FT, which recovers the set o rom the set o H n 's is h k 1 1 k H n e ikn/ h k 's Parseval s theorem or discrete FTs takes the orm 1 k h k 1 1 n H n There are also discrete analogues to the convolution and correlation theorems. SUPA Advanced Data Analysis Course, 18
30 Fast Fourier Transorms Consider again the ormula or the discrete FT. We can write it as H n 1 k e ikn/ h k 1 k W nk h k This is a matrix equation: we compute the ( 1) vector o H n ' s nk by multiplying the ( ) matrix W by the ( 1) vector o. [ ] h k 's In general, this requires o order multiplications (and the may be complex numbers). h k ' s e.g. suppose. Even i a computer can perorm (say) 1 billion multiplications per second, it would still require more than 115 days to calculate the FT.
31 Fortunately, there is a way around this problem. Suppose (as we assumed beore) is an even number. Then we can write where So we have turned an FT with points into the weighted sum o two FTs with points. This would reduce our computing time by a actor o two / 1 / 1) ( 1 / / ) ( 1 / j j n j i j j n j i k k ikn n h e h e h e H Even values o k Odd values o k / 1 / M j j M jn i n M j j M jn i h e W h e / M /
32 Why stop there, however?... M I is also even, we can repeat the process and re-write the FTs o M M / length as the weighted sum o two FTs o length. I is a power o two (e.g. 14, 48, etc) then we can repeat iteratively the process o splitting each longer FT into two FTs hal as long. The inal step in this iteration consists o computing FTs o length unity: H ik e hk h k i.e. the FT o each discretely sampled data value is just the data value itsel. SUPA Advanced Data Analysis Course, 18
33 This iterative process converts multiplications into O ( log ) operations. O( ) This notation means o the order o So our operations are reduced to about operations. The Fast Fourier Transorm (FFT) has revolutionised our ability to tackle problems in Fourier analysis on a desktop PC which would otherwise be impractical, even on the largest supercomputers. SUPA Advanced Data Analysis Course, 18
34 Data Acquisition Earlier we approximated the continuous unction and its FT H( ) +1 by a inite set o discretely sampled values. How good is this approximation? The answer depends on the orm o H( ) and. In this short section we will consider: 1. under what conditions we can reconstruct and exactly rom a set o discretely sampled points? h (t) H( ). what is the minimum sampling rate (or density, i is a spatially varying unction) required to achieve this exact reconstruction? h h (t) H( ) 3. what is the eect on our reconstructed and i our data acquisition does not achieve this minimum sampling rate? SUPA Advanced Data Analysis Course, 18
35 The yquist Shannon Sampling Theorem Suppose the unction is bandwidth limited. This means that the FT o is non-zero over a inite range o requencies. i.e. there exists a critical requency c such that H( ) or all c The yquist Shannon Sampling Theorem (SST) is a very important result rom inormation theory. It concerns the representation o by a set o discretely sampled values h k h ( t k ) where t k k, k...,, 1,,1,,... SUPA Advanced Data Analysis Course, 18
36 The SST states that, provided the sampling interval satisies 1 c or less then we can exactly reconstruct the unction rom the discrete { } h k samples. It can be shown that h( t) sin [ c( t k ) ] ( t k ) + hk k - c is also known as the yquist requency and is known as the yquist rate. 1 c SUPA Advanced Data Analysis Course, 18
37 We can re-write this as h( t) sin [ ( t k ) ] [( t k ) ] + hk k - So the unction is the sum o the sampled values, weighted by the normalised sinc unction, scaled so that its zeroes lie at those sampled values. h k h (t) { } ormalised sinc unction sinc(x) (compare with previous section) x ( t ) k t k h ( t) since sinc ( ) 1 ote that when then h k Sampled values SUPA Advanced Data Analysis Course, 18
38 The SST is a very powerul result. We can think o the interpolating sinc unctions, centred on each sampled point, as illing in the gaps in our data. The remarkable act is that they do this job perectly, provided is bandwidth limited. i.e. the h (t) H( ) discrete sampling incurs no loss o inormation about and. Suppose, or example, that. Then we need only sample twice every period in order to be able to reconstruct the entire unction exactly. h( t) sin ( t) c (ote that ormally we do need to sample an ininite number o { h } { } discretely spaced values,. I we only sample the over a k inite time interval, then our interpolated will be approximate). h k SUPA Advanced Data Analysis Course, 18
39 y sin ( t) c x c t 1 c Sampling at (ininitely many o) the red points is suicient to reconstruct the unction or all values o t, with no loss o inormation. SUPA Advanced Data Analysis Course, 18
40 Aliasing There is a downside, however. I is not bandwidth limited (or, equivalently, i we don t sample 1 < c requently enough i.e. i the sampling rate ) then our h (t) H( ) reconstruction o and is badly aected by aliasing. This means that all o the power spectral density which lies outside the < < H ( ) range is spuriously moved inside that range, so that the FT o will be computed incorrectly rom the discretely sampled data. c c Any requency component outside the range is alsely translated ( aliased ) into that range. (, ) c c SUPA Advanced Data Analysis Course, 18
41 Consider as shown. Suppose is zero outside the range T. This means that extends to ±. H( ) sampled at regular intervals The contribution to the true FT rom outside the ( ) range 1,1 gets aliased into this range, appearing as a mirror image. Thus, at our computed value o is equal to twice the true value. ± 1 H( ) From umerical Recipes, Chapter 1.1
42 How do we combat aliasing? c > o Enorce some chosen e.g. by iltering to remove the high requency components. (Also known as anti-aliasing) 1 c o Sample at a high enough rate so that - i.e. at least two samples per cycle o the highest requency present c 1 To check or / eliminate aliasing without pre-iltering: o Given a sampling interval, compute lim 1 o Check i discrete FT o is approaching zero as lim o I not, then requencies outside the range 1,1 are probably being olded back into this range. o Try increasing the sampling rate, and repeat ( )
43 And inally. Mock Data Challenge Part 1 1 (x,y) data pairs, generated rom an unknown model plus Gaussian noise. y Data posted on my.supa and on Moodle (or MSc course) Three-stage challenge: x 1. Fit a linear model to these data, using ordinary least squares;. Compute Bayesian credible regions or the model parameters, using a bivariate normal model or the likelihood unction; 3. Write an MCMC code to sample rom the posterior pdo the model parameters, and compare their sample estimates with the LS its;
44 And inally. Mock Data Challenge Part 1 (x,y) newdata pairs, generated rom an unknown model plus Gaussian noise. y Data posted on my.supa and on Moodle (or MSc course) 1. Fit a quadraticmodel to these data, using e.g. an MCMC code to sample rom the posterior pd o the model parameters,presenting plots o the marginal posterior or each pair o parameters; x
6. Advanced Numerical Methods. Monte Carlo Methods
6. Advanced Numerical Methods Part 1: Part : Monte Carlo Methods Fourier Methods Part 1: Monte Carlo Methods 1. Uniform random numbers Generating uniform random numbers, drawn from the pdf U[0,1], is fairly
More informationENSC327 Communications Systems 2: Fourier Representations. School of Engineering Science Simon Fraser University
ENSC37 Communications Systems : Fourier Representations School o Engineering Science Simon Fraser University Outline Chap..5: Signal Classiications Fourier Transorm Dirac Delta Function Unit Impulse Fourier
More informationSIO 211B, Rudnick. We start with a definition of the Fourier transform! ĝ f of a time series! ( )
SIO B, Rudnick! XVIII.Wavelets The goal o a wavelet transorm is a description o a time series that is both requency and time selective. The wavelet transorm can be contrasted with the well-known and very
More informationLecture 13: Applications of Fourier transforms (Recipes, Chapter 13)
Lecture 13: Applications o Fourier transorms (Recipes, Chapter 13 There are many applications o FT, some o which involve the convolution theorem (Recipes 13.1: The convolution o h(t and r(t is deined by
More informationFigure 3.1 Effect on frequency spectrum of increasing period T 0. Consider the amplitude spectrum of a periodic waveform as shown in Figure 3.2.
3. Fourier ransorm From Fourier Series to Fourier ransorm [, 2] In communication systems, we oten deal with non-periodic signals. An extension o the time-requency relationship to a non-periodic signal
More informationIntroduction to Analog And Digital Communications
Introduction to Analog And Digital Communications Second Edition Simon Haykin, Michael Moher Chapter Fourier Representation o Signals and Systems.1 The Fourier Transorm. Properties o the Fourier Transorm.3
More information2 Frequency-Domain Analysis
2 requency-domain Analysis Electrical engineers live in the two worlds, so to speak, o time and requency. requency-domain analysis is an extremely valuable tool to the communications engineer, more so
More informationThe Fourier Transform
The Fourier Transorm Fourier Series Fourier Transorm The Basic Theorems and Applications Sampling Bracewell, R. The Fourier Transorm and Its Applications, 3rd ed. New York: McGraw-Hill, 2. Eric W. Weisstein.
More informationProducts and Convolutions of Gaussian Probability Density Functions
Tina Memo No. 003-003 Internal Report Products and Convolutions o Gaussian Probability Density Functions P.A. Bromiley Last updated / 9 / 03 Imaging Science and Biomedical Engineering Division, Medical
More information10. Joint Moments and Joint Characteristic Functions
10. Joint Moments and Joint Characteristic Functions Following section 6, in this section we shall introduce various parameters to compactly represent the inormation contained in the joint p.d. o two r.vs.
More informationLeast-Squares Spectral Analysis Theory Summary
Least-Squares Spectral Analysis Theory Summary Reerence: Mtamakaya, J. D. (2012). Assessment o Atmospheric Pressure Loading on the International GNSS REPRO1 Solutions Periodic Signatures. Ph.D. dissertation,
More informationNotes on Wavelets- Sandra Chapman (MPAGS: Time series analysis) # $ ( ) = G f. y t
Wavelets Recall: we can choose! t ) as basis on which we expand, ie: ) = y t ) = G! t ) y t! may be orthogonal chosen or appropriate properties. This is equivalent to the transorm: ) = G y t )!,t )d 2
More informationSEISMIC WAVE PROPAGATION. Lecture 2: Fourier Analysis
SEISMIC WAVE PROPAGATION Lecture 2: Fourier Analysis Fourier Series & Fourier Transforms Fourier Series Review of trigonometric identities Analysing the square wave Fourier Transform Transforms of some
More informationThe achievable limits of operational modal analysis. * Siu-Kui Au 1)
The achievable limits o operational modal analysis * Siu-Kui Au 1) 1) Center or Engineering Dynamics and Institute or Risk and Uncertainty, University o Liverpool, Liverpool L69 3GH, United Kingdom 1)
More informationEEO 401 Digital Signal Processing Prof. Mark Fowler
EEO 401 Digital Signal Processing Pro. Mark Fowler Note Set #10 Fourier Analysis or DT Signals eading Assignment: Sect. 4.2 & 4.4 o Proakis & Manolakis Much o Ch. 4 should be review so you are expected
More informationA Fourier Transform Model in Excel #1
A Fourier Transorm Model in Ecel # -This is a tutorial about the implementation o a Fourier transorm in Ecel. This irst part goes over adjustments in the general Fourier transorm ormula to be applicable
More informationTLT-5200/5206 COMMUNICATION THEORY, Exercise 3, Fall TLT-5200/5206 COMMUNICATION THEORY, Exercise 3, Fall Problem 1.
TLT-5/56 COMMUNICATION THEORY, Exercise 3, Fall Problem. The "random walk" was modelled as a random sequence [ n] where W[i] are binary i.i.d. random variables with P[W[i] = s] = p (orward step with probability
More informationFourier Series & The Fourier Transform
Fourier Series & The Fourier Transform What is the Fourier Transform? Anharmonic Waves Fourier Cosine Series for even functions Fourier Sine Series for odd functions The continuous limit: the Fourier transform
More information2. ETA EVALUATIONS USING WEBER FUNCTIONS. Introduction
. ETA EVALUATIONS USING WEBER FUNCTIONS Introduction So ar we have seen some o the methods or providing eta evaluations that appear in the literature and we have seen some o the interesting properties
More informationSignals & Linear Systems Analysis Chapter 2&3, Part II
Signals & Linear Systems Analysis Chapter &3, Part II Dr. Yun Q. Shi Dept o Electrical & Computer Engr. New Jersey Institute o echnology Email: shi@njit.edu et used or the course:
More informationThe Discrete Fourier Transform (DFT) Properties of the DFT DFT-Specic Properties Power spectrum estimate. Alex Sheremet.
4. April 2, 27 -order sequences Measurements produce sequences of numbers Measurement purpose: characterize a stochastic process. Example: Process: water surface elevation as a function of time Parameters:
More informationEECE 301 Signals & Systems Prof. Mark Fowler
EECE 3 Signals & Systems Pro. Mark Fowler Discussion #9 Illustrating the Errors in DFT Processing DFT or Sonar Processing Example # Illustrating The Errors in DFT Processing Illustrating the Errors in
More informationAPPENDIX 1 ERROR ESTIMATION
1 APPENDIX 1 ERROR ESTIMATION Measurements are always subject to some uncertainties no matter how modern and expensive equipment is used or how careully the measurements are perormed These uncertainties
More informationMixed Signal IC Design Notes set 6: Mathematics of Electrical Noise
ECE45C /8C notes, M. odwell, copyrighted 007 Mied Signal IC Design Notes set 6: Mathematics o Electrical Noise Mark odwell University o Caliornia, Santa Barbara rodwell@ece.ucsb.edu 805-893-344, 805-893-36
More informationCHAPTER 1: INTRODUCTION. 1.1 Inverse Theory: What It Is and What It Does
Geosciences 567: CHAPTER (RR/GZ) CHAPTER : INTRODUCTION Inverse Theory: What It Is and What It Does Inverse theory, at least as I choose to deine it, is the ine art o estimating model parameters rom data
More informationThe Poisson summation formula, the sampling theorem, and Dirac combs
The Poisson summation ormula, the sampling theorem, and Dirac combs Jordan Bell jordanbell@gmailcom Department o Mathematics, University o Toronto April 3, 24 Poisson summation ormula et S be the set o
More informationCategories and Natural Transformations
Categories and Natural Transormations Ethan Jerzak 17 August 2007 1 Introduction The motivation or studying Category Theory is to ormalise the underlying similarities between a broad range o mathematical
More information8.4 Inverse Functions
Section 8. Inverse Functions 803 8. Inverse Functions As we saw in the last section, in order to solve application problems involving eponential unctions, we will need to be able to solve eponential equations
More informationSEPARATED AND PROPER MORPHISMS
SEPARATED AND PROPER MORPHISMS BRIAN OSSERMAN The notions o separatedness and properness are the algebraic geometry analogues o the Hausdor condition and compactness in topology. For varieties over the
More informationElec4621 Advanced Digital Signal Processing Chapter 11: Time-Frequency Analysis
Elec461 Advanced Digital Signal Processing Chapter 11: Time-Frequency Analysis Dr. D. S. Taubman May 3, 011 In this last chapter of your notes, we are interested in the problem of nding the instantaneous
More informationDefinition: Let f(x) be a function of one variable with continuous derivatives of all orders at a the point x 0, then the series.
2.4 Local properties o unctions o several variables In this section we will learn how to address three kinds o problems which are o great importance in the ield o applied mathematics: how to obtain the
More informationEstimation and detection of a periodic signal
Estimation and detection o a periodic signal Daniel Aronsson, Erik Björnemo, Mathias Johansson Signals and Systems Group, Uppsala University, Sweden, e-mail: Daniel.Aronsson,Erik.Bjornemo,Mathias.Johansson}@Angstrom.uu.se
More informationLecture 8 Optimization
4/9/015 Lecture 8 Optimization EE 4386/5301 Computational Methods in EE Spring 015 Optimization 1 Outline Introduction 1D Optimization Parabolic interpolation Golden section search Newton s method Multidimensional
More informationInformation and Communications Security: Encryption and Information Hiding
Short Course on Information and Communications Security: Encryption and Information Hiding Tuesday, 10 March Friday, 13 March, 2015 Lecture 5: Signal Analysis Contents The complex exponential The complex
More informationFourier Series. Fourier Transform
Math Methods I Lia Vas Fourier Series. Fourier ransform Fourier Series. Recall that a function differentiable any number of times at x = a can be represented as a power series n= a n (x a) n where the
More informationScattered Data Approximation of Noisy Data via Iterated Moving Least Squares
Scattered Data Approximation o Noisy Data via Iterated Moving Least Squares Gregory E. Fasshauer and Jack G. Zhang Abstract. In this paper we ocus on two methods or multivariate approximation problems
More informationChapter 4 Image Enhancement in the Frequency Domain
Chapter 4 Image Enhancement in the Frequency Domain 3. Fourier transorm -D Let be a unction o real variable,the ourier transorm o is F { } F u ep jπu d j F { F u } F u ep[ jπ u ] du F u R u + ji u or F
More informationOutline. Approximate sampling theorem (AST) recall Lecture 1. P. L. Butzer, G. Schmeisser, R. L. Stens
Outline Basic relations valid or the Bernstein space B and their extensions to unctions rom larger spaces in terms o their distances rom B Part 3: Distance unctional approach o Part applied to undamental
More informationCHAPTER 8 ANALYSIS OF AVERAGE SQUARED DIFFERENCE SURFACES
CAPTER 8 ANALYSS O AVERAGE SQUARED DERENCE SURACES n Chapters 5, 6, and 7, the Spectral it algorithm was used to estimate both scatterer size and total attenuation rom the backscattered waveorms by minimizing
More informationf (t) K(t, u) d t. f (t) K 1 (t, u) d u. Integral Transform Inverse Fourier Transform
Integral Transforms Massoud Malek An integral transform maps an equation from its original domain into another domain, where it might be manipulated and solved much more easily than in the original domain.
More informationCS711008Z Algorithm Design and Analysis
CS711008Z Algorithm Design and Analysis Lecture 5 FFT and Divide and Conquer Dongbo Bu Institute of Computing Technology Chinese Academy of Sciences, Beijing, China 1 / 56 Outline DFT: evaluate a polynomial
More informationPeriodic functions: simple harmonic oscillator
Periodic functions: simple harmonic oscillator Recall the simple harmonic oscillator (e.g. mass-spring system) d 2 y dt 2 + ω2 0y = 0 Solution can be written in various ways: y(t) = Ae iω 0t y(t) = A cos
More informationFourier Transform Chapter 10 Sampling and Series
Fourier Transform Chapter 0 Sampling and Series Sampling Theorem Sampling Theorem states that, under a certain condition, it is in fact possible to recover with full accuracy the values intervening between
More informationSupplementary material for Continuous-action planning for discounted infinite-horizon nonlinear optimal control with Lipschitz values
Supplementary material or Continuous-action planning or discounted ininite-horizon nonlinear optimal control with Lipschitz values List o main notations x, X, u, U state, state space, action, action space,
More information3. Several Random Variables
. Several Random Variables. Two Random Variables. Conditional Probabilit--Revisited. Statistical Independence.4 Correlation between Random Variables. Densit unction o the Sum o Two Random Variables. Probabilit
More informationFigure 18: Top row: example of a purely continuous spectrum (left) and one realization
1..5 S(). -.2 -.5 -.25..25.5 64 128 64 128 16 32 requency time time Lag 1..5 S(). -.5-1. -.5 -.1.1.5 64 128 64 128 16 32 requency time time Lag Figure 18: Top row: example o a purely continuous spectrum
More informationBasic properties of limits
Roberto s Notes on Dierential Calculus Chapter : Limits and continuity Section Basic properties o its What you need to know already: The basic concepts, notation and terminology related to its. What you
More informationELEG 3143 Probability & Stochastic Process Ch. 4 Multiple Random Variables
Department o Electrical Engineering University o Arkansas ELEG 3143 Probability & Stochastic Process Ch. 4 Multiple Random Variables Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Two discrete random variables
More informationCommunication Signals (Haykin Sec. 2.4 and Ziemer Sec Sec. 2.4) KECE321 Communication Systems I
Communication Signals (Haykin Sec..4 and iemer Sec...4-Sec..4) KECE3 Communication Systems I Lecture #3, March, 0 Prof. Young-Chai Ko 년 3 월 일일요일 Review Signal classification Phasor signal and spectra Representation
More informationEx x xf xdx. Ex+ a = x+ a f x dx= xf x dx+ a f xdx= xˆ. E H x H x H x f x dx ˆ ( ) ( ) ( ) μ is actually the first moment of the random ( )
Fall 03 Analysis o Eperimental Measurements B Eisenstein/rev S Errede The Epectation Value o a Random Variable: The epectation value E[ ] o a random variable is the mean value o, ie ˆ (aa μ ) For discrete
More informationChapter 4 Imaging. Lecture 21. d (110) Chem 793, Fall 2011, L. Ma
Chapter 4 Imaging Lecture 21 d (110) Imaging Imaging in the TEM Diraction Contrast in TEM Image HRTEM (High Resolution Transmission Electron Microscopy) Imaging or phase contrast imaging STEM imaging a
More informationSPOC: An Innovative Beamforming Method
SPOC: An Innovative Beamorming Method Benjamin Shapo General Dynamics Ann Arbor, MI ben.shapo@gd-ais.com Roy Bethel The MITRE Corporation McLean, VA rbethel@mitre.org ABSTRACT The purpose o a radar or
More informationThe Deutsch-Jozsa Problem: De-quantization and entanglement
The Deutsch-Jozsa Problem: De-quantization and entanglement Alastair A. Abbott Department o Computer Science University o Auckland, New Zealand May 31, 009 Abstract The Deustch-Jozsa problem is one o the
More informationAdditional exercises in Stationary Stochastic Processes
Mathematical Statistics, Centre or Mathematical Sciences Lund University Additional exercises 8 * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * *
More informationLecture 7. Fourier Analysis
Lecture 7 Fourier Analysis Summary Lecture 6 Minima and maxima 1 dimension : Bracket minima : 3 values of f(x) : f(2) < f(1) and f(2)
More informationRATIONAL FUNCTIONS. Finding Asymptotes..347 The Domain Finding Intercepts Graphing Rational Functions
RATIONAL FUNCTIONS Finding Asymptotes..347 The Domain....350 Finding Intercepts.....35 Graphing Rational Functions... 35 345 Objectives The ollowing is a list o objectives or this section o the workbook.
More informationNew Functions from Old Functions
.3 New Functions rom Old Functions In this section we start with the basic unctions we discussed in Section. and obtain new unctions b shiting, stretching, and relecting their graphs. We also show how
More informationReceived: 30 July 2017; Accepted: 29 September 2017; Published: 8 October 2017
mathematics Article Least-Squares Solution o Linear Dierential Equations Daniele Mortari ID Aerospace Engineering, Texas A&M University, College Station, TX 77843, USA; mortari@tamu.edu; Tel.: +1-979-845-734
More informationOn a Closed Formula for the Derivatives of e f(x) and Related Financial Applications
International Mathematical Forum, 4, 9, no. 9, 41-47 On a Closed Formula or the Derivatives o e x) and Related Financial Applications Konstantinos Draais 1 UCD CASL, University College Dublin, Ireland
More informationAnalog Computing Technique
Analog Computing Technique by obert Paz Chapter Programming Principles and Techniques. Analog Computers and Simulation An analog computer can be used to solve various types o problems. It solves them in
More informationMethods of Mathematical Physics X1 Homework 3 Solutions
Methods of Mathematical Physics - 556 X Homework 3 Solutions. (Problem 2.. from Keener.) Verify that l 2 is an inner product space. Specifically, show that if x, y l 2, then x, y x k y k is defined and
More informationTwo-step self-tuning phase-shifting interferometry
Two-step sel-tuning phase-shiting intererometry J. Vargas, 1,* J. Antonio Quiroga, T. Belenguer, 1 M. Servín, 3 J. C. Estrada 3 1 Laboratorio de Instrumentación Espacial, Instituto Nacional de Técnica
More informationOn High-Rate Cryptographic Compression Functions
On High-Rate Cryptographic Compression Functions Richard Ostertág and Martin Stanek Department o Computer Science Faculty o Mathematics, Physics and Inormatics Comenius University Mlynská dolina, 842 48
More information( x) f = where P and Q are polynomials.
9.8 Graphing Rational Functions Lets begin with a deinition. Deinition: Rational Function A rational unction is a unction o the orm ( ) ( ) ( ) P where P and Q are polynomials. Q An eample o a simple rational
More information1. Interference condition. 2. Dispersion A B. As shown in Figure 1, the path difference between interfering rays AB and A B is a(sin
asic equations or astronomical spectroscopy with a diraction grating Jeremy Allington-Smith, University o Durham, 3 Feb 000 (Copyright Jeremy Allington-Smith, 000). Intererence condition As shown in Figure,
More informationNumerical Solution of Ordinary Differential Equations in Fluctuationlessness Theorem Perspective
Numerical Solution o Ordinary Dierential Equations in Fluctuationlessness Theorem Perspective NEJLA ALTAY Bahçeşehir University Faculty o Arts and Sciences Beşiktaş, İstanbul TÜRKİYE TURKEY METİN DEMİRALP
More informationAn Ensemble Kalman Smoother for Nonlinear Dynamics
1852 MONTHLY WEATHER REVIEW VOLUME 128 An Ensemble Kalman Smoother or Nonlinear Dynamics GEIR EVENSEN Nansen Environmental and Remote Sensing Center, Bergen, Norway PETER JAN VAN LEEUWEN Institute or Marine
More informationSupplement To: Search for Tensor, Vector, and Scalar Polarizations in the Stochastic Gravitational-Wave Background
Supplement To: Search or Tensor, Vector, and Scalar Polarizations in the Stochastic GravitationalWave Background B. P. Abbott et al. (LIGO Scientiic Collaboration & Virgo Collaboration) This documents
More informationThe Clifford algebra and the Chevalley map - a computational approach (detailed version 1 ) Darij Grinberg Version 0.6 (3 June 2016). Not proofread!
The Cliord algebra and the Chevalley map - a computational approach detailed version 1 Darij Grinberg Version 0.6 3 June 2016. Not prooread! 1. Introduction: the Cliord algebra The theory o the Cliord
More informationLecture 4 Filtering in the Frequency Domain. Lin ZHANG, PhD School of Software Engineering Tongji University Spring 2016
Lecture 4 Filtering in the Frequency Domain Lin ZHANG, PhD School of Software Engineering Tongji University Spring 2016 Outline Background From Fourier series to Fourier transform Properties of the Fourier
More informationConsider the function f(x, y). Recall that we can approximate f(x, y) with a linear function in x and y:
Taylor s Formula Consider the unction (x, y). Recall that we can approximate (x, y) with a linear unction in x and y: (x, y) (a, b)+ x (a, b)(x a)+ y (a, b)(y b) Notice that again this is just a linear
More informationRoberto s Notes on Differential Calculus Chapter 8: Graphical analysis Section 1. Extreme points
Roberto s Notes on Dierential Calculus Chapter 8: Graphical analysis Section 1 Extreme points What you need to know already: How to solve basic algebraic and trigonometric equations. All basic techniques
More informationNumerical Methods - Lecture 2. Numerical Methods. Lecture 2. Analysis of errors in numerical methods
Numerical Methods - Lecture 1 Numerical Methods Lecture. Analysis o errors in numerical methods Numerical Methods - Lecture Why represent numbers in loating point ormat? Eample 1. How a number 56.78 can
More informationIntrinsic Small-Signal Equivalent Circuit of GaAs MESFET s
Intrinsic Small-Signal Equivalent Circuit o GaAs MESFET s M KAMECHE *, M FEHAM M MELIANI, N BENAHMED, S DALI * National Centre o Space Techniques, Algeria Telecom Laboratory, University o Tlemcen, Algeria
More informationQuality Improves with More Rays
Recap Quality Improves with More Rays Area Area 1 shadow ray 16 shadow rays CS348b Lecture 8 Pat Hanrahan / Matt Pharr, Spring 2018 pixelsamples = 1 jaggies pixelsamples = 16 anti-aliased Sampling and
More informationProbabilistic Model of Error in Fixed-Point Arithmetic Gaussian Pyramid
Probabilistic Model o Error in Fixed-Point Arithmetic Gaussian Pyramid Antoine Méler John A. Ruiz-Hernandez James L. Crowley INRIA Grenoble - Rhône-Alpes 655 avenue de l Europe 38 334 Saint Ismier Cedex
More information(C) The rationals and the reals as linearly ordered sets. Contents. 1 The characterizing results
(C) The rationals and the reals as linearly ordered sets We know that both Q and R are something special. When we think about about either o these we usually view it as a ield, or at least some kind o
More informationmultiply both sides of eq. by a and projection overlap
Fourier Series n x n x f xa ancos bncos n n periodic with period x consider n, sin x x x March. 3, 7 Any function with period can be represented with a Fourier series Examples (sawtooth) (square wave)
More informationSpecial types of Riemann sums
Roberto s Notes on Subject Chapter 4: Deinite integrals and the FTC Section 3 Special types o Riemann sums What you need to know already: What a Riemann sum is. What you can learn here: The key types o
More informationPower Spectral Analysis of Elementary Cellular Automata
Power Spectral Analysis o Elementary Cellular Automata Shigeru Ninagawa Division o Inormation and Computer Science, Kanazawa Institute o Technology, 7- Ohgigaoka, Nonoichi, Ishikawa 92-850, Japan Spectral
More informationCHAPTER 4 Reactor Statics. Table of Contents
CHAPTER 4 Reactor Statics Prepared by Dr. Benjamin Rouben, & Consulting, Adjunct Proessor, McMaster University & University o Ontario Institute o Technology (UOIT) and Dr. Eleodor Nichita, Associate Proessor,
More informationComputational Methods for Astrophysics: Fourier Transforms
Computational Methods for Astrophysics: Fourier Transforms John T. Whelan (filling in for Joshua Faber) April 27, 2011 John T. Whelan April 27, 2011 Fourier Transforms 1/13 Fourier Analysis Outline: Fourier
More information1. Definition: Order Statistics of a sample.
AMS570 Order Statistics 1. Deinition: Order Statistics o a sample. Let X1, X2,, be a random sample rom a population with p.d.. (x). Then, 2. p.d.. s or W.L.O.G.(W thout Loss o Ge er l ty), let s ssu e
More informationObjectives. By the time the student is finished with this section of the workbook, he/she should be able
FUNCTIONS Quadratic Functions......8 Absolute Value Functions.....48 Translations o Functions..57 Radical Functions...61 Eponential Functions...7 Logarithmic Functions......8 Cubic Functions......91 Piece-Wise
More informationEEO 401 Digital Signal Processing Prof. Mark Fowler
EEO 4 Digital Signal Processing Pro. Mark Fowler ote Set # Using the DFT or Spectral Analysis o Signals Reading Assignment: Sect. 7.4 o Proakis & Manolakis Ch. 6 o Porat s Book /9 Goal o Practical Spectral
More informationJim Lambers ENERGY 281 Spring Quarter Lecture 5 Notes
Jim ambers ENERGY 28 Spring Quarter 27-8 ecture 5 Notes These notes are based on Rosalind Archer s PE28 lecture notes, with some revisions by Jim ambers. Fourier Series Recall that in ecture 2, when we
More information( 1) ( 2) ( 1) nan integer, since the potential is no longer simple harmonic.
. Anharmonic Oscillators Michael Fowler Landau (para 8) considers a simple harmonic oscillator with added small potential energy terms mα + mβ. We ll simpliy slightly by dropping the term, to give an equation
More informationUNCERTAINTY EVALUATION OF SINUSOIDAL FORCE MEASUREMENT
XXI IMEKO World Congress Measurement in Research and Industry August 30 eptember 4, 05, Prague, Czech Republic UNCERTAINTY EVALUATION OF INUOIDAL FORCE MEAUREMENT Christian chlegel, Gabriela Kiekenap,Rol
More informationSyllabus Objective: 2.9 The student will sketch the graph of a polynomial, radical, or rational function.
Precalculus Notes: Unit Polynomial Functions Syllabus Objective:.9 The student will sketch the graph o a polynomial, radical, or rational unction. Polynomial Function: a unction that can be written in
More informationNotes on Fourier Series and Integrals Fourier Series
Notes on Fourier Series and Integrals Fourier Series et f(x) be a piecewise linear function on [, ] (This means that f(x) may possess a finite number of finite discontinuities on the interval). Then f(x)
More informationMEASUREMENT UNCERTAINTIES
MEASUREMENT UNCERTAINTIES What distinguishes science rom philosophy is that it is grounded in experimental observations. These observations are most striking when they take the orm o a quantitative measurement.
More information9.3 Graphing Functions by Plotting Points, The Domain and Range of Functions
9. Graphing Functions by Plotting Points, The Domain and Range o Functions Now that we have a basic idea o what unctions are and how to deal with them, we would like to start talking about the graph o
More informationA universal symmetry detection algorithm
DOI 10.1186/s40064-015-1156-7 RESEARCH Open Access A universal symmetry detection algorithm Peter M Maurer * *Correspondence: Peter_Maurer@Baylor.edu Department o Computer Science, Baylor University, Waco,
More informationReferences Ideal Nyquist Channel and Raised Cosine Spectrum Chapter 4.5, 4.11, S. Haykin, Communication Systems, Wiley.
Baseand Data Transmission III Reerences Ideal yquist Channel and Raised Cosine Spectrum Chapter 4.5, 4., S. Haykin, Communication Systems, iley. Equalization Chapter 9., F. G. Stremler, Communication Systems,
More informationRotational Equilibrium and Rotational Dynamics
8 Rotational Equilibrium and Rotational Dynamics Description: Reasoning with rotational inertia. Question CLICKER QUESTIONS Question E.0 The rotational inertia o the dumbbell (see igure) about axis A is
More informationMidterm Summary Fall 08. Yao Wang Polytechnic University, Brooklyn, NY 11201
Midterm Summary Fall 8 Yao Wang Polytechnic University, Brooklyn, NY 2 Components in Digital Image Processing Output are images Input Image Color Color image image processing Image Image restoration Image
More informationPhysics 2B Chapter 17 Notes - First Law of Thermo Spring 2018
Internal Energy o a Gas Work Done by a Gas Special Processes The First Law o Thermodynamics p Diagrams The First Law o Thermodynamics is all about the energy o a gas: how much energy does the gas possess,
More informationSEPARATED AND PROPER MORPHISMS
SEPARATED AND PROPER MORPHISMS BRIAN OSSERMAN Last quarter, we introduced the closed diagonal condition or a prevariety to be a prevariety, and the universally closed condition or a variety to be complete.
More informationFourier Series and Integrals
Fourier Series and Integrals Fourier Series et f(x) beapiece-wiselinearfunctionon[, ] (Thismeansthatf(x) maypossessa finite number of finite discontinuities on the interval). Then f(x) canbeexpandedina
More informationVALUATIVE CRITERIA BRIAN OSSERMAN
VALUATIVE CRITERIA BRIAN OSSERMAN Intuitively, one can think o separatedness as (a relative version o) uniqueness o limits, and properness as (a relative version o) existence o (unique) limits. It is not
More information