Fourier Series. (Com S 477/577 Notes) Yan-Bin Jia. Nov 29, 2016
|
|
- Candice Hensley
- 6 years ago
- Views:
Transcription
1 Fourier Series (Com S 477/577 otes) Yan-Bin Jia ov 9, Introduction Many functions in nature are periodic, that is, f(x+τ) = f(x), for some fixed τ, which is called the period of f. Though function approximation using orthogonal polynomials is very convenient, there is only one kind of periodic polynomial, that is, a constant. So, polynomials are not good for approximating periodic functions. In this case, trigonometric functions are quite useful. A large class of important computational problems falls under the category of Fourier transform methods or spectral methods. For some of these problems, the Fourier transform is simply an efficient computational tool for data manipulation. For other problems, the Fourier transform is itself of intrinsic interest. Fourier methods have revolutionized fields of science and engineering, from radio astronomy to medical imaging, from seismology to spectroscopy. The wide application of Fourier methods is credited principally to the existence of the fast Fourier transform (FFT). The most direct applications of the FFT are to the convolution or deconvolution of data, correlation and autocorrelation, optimal filtering, power spectrum estimation, and the computational of Fourier integrals. A physical process can be described either in the time domain, by the values of some quantity h as a function of time t, or else in the frequency domain, where the process is specified by giving its amplitude H as a function of frequency ξ with < ξ <. For many purposes it is useful to think of h(t) and H(ξ) as being two different representations of the same function. These two representations are related to each other by the Fourier transform equations, Fourier Series H(ξ) = h(t) = h(t)e iξt dt, H(ξ)e iξt dξ, i = 1. A trigonometric polynomial of order n is any function of the form p(x) = a n 0 + (a j cosjx+b j sinjx), (1) 1
2 where a 0,...,a n and b 1,...,b n are real or complex numbers. Such a trigonometric polynomial has period. When approximating a function f(x) with period τ, we have to make some adjustment by considering instead the function ( ) g(x) = f τx/(), which has period. Having constructed a trigonometric polynomial approximation p(x) to g(x), we obtain a τ-periodic polynomial approximation p(x/τ) to f(x). For this reason we will from now on assume that the function f(x) to be approximated is already -periodic. The trigonometric polynomial (1) has an equivalent complex form p(x) = n j= n c j e ijx, where i = 1, () under Euler s formula We then expand (): e ix = cosx+isinx. p(x) = c 0 + n (c j +c j )cosjx+i A comparison between the above and (1) yields a j = c j +c j, n (c j c j )sinjx. b j = i(c j c j ), j = 0,...,n. Solution of each pair of such equations gives us, for j = 0,...,n, c j = a j ib j, c j = a j +ib j. The functions 1, e ±ix,e ±ix,..., form an orthonormal basis with respect to the inner product g,h = 1 where h(x) is the complex conjugate of h(x). More specifically, { e ijx,e ikx 1, if j = k, = 0, if j k. The Fourier series for a function f(x) is given by 0 g(x)h(x) dx, (3) f(x) j= ˆf(j)e ijx, (4)
3 where ˆf(j) = f(x),e ijx = 1 0 f(x)e ijx dx. are the Fourier coefficients. From the above definition we easily see that ˆf( j) = ˆf(j). In (4), means that the Fourier series converges to f(x) under rather mild conditions. For example, the series converges uniformly if f(x) is continuous and f (x) is piecewise continuous. Theorem 1 The partial sum n j= n ˆf(j)e ijx of the Fourier series for f(x) is the best approximation to f(x) by trigonometric polynomials of order n under the inner product defined in (3); that is, with respect to the norm 1 g = g(x) dx. Furthermore, it can be shown that Parseval s relation j= 0 ˆf(j) = 1 f(x) dx 0 holds. The Fourier coefficients ˆf(j) can help us understand the function f(x). Suppose f(x) is a real function with period. It can be viewed as the motion of a point at time x on a line. Substitute the polar form ˆf(j) = ˆf(j) e iθ j into the Fourier series (4) and use the fact that ˆf(j) and ˆf( j) are complex conjugates: f(x) ˆf(0) cosθ 0 + ˆf(j) cos(θ j +jx). Thus we have obtained a representation of the periodic motion as a superposition of simple harmonic oscillations. The jth such motion (with j > 0), ˆf(j) cos(θ j +jx), has amplitude: frequency: angular frequency: j, ˆf(j), j, period or wavelength: j, phase angle: θ j. 3
4 The number ˆf(j) measures the strength of the presence of a simple harmonic motion of frequency j in the total motion. It can be shown that ( ˆf(j) = O j l 1), (5) when the lth derivative of f(x) exists and is piecewise continuous. The sequence ˆf(0), ˆf(1),... is called the spectrum of f(x) over which the total energy f is distributed. A noisy function will have sizeable ˆf(j) for large j. For a smooth function, the spectrum will decrease rapidly as j increases. The method of smoothing often consists in generating the Fourier coefficients of f(x) from data, filtering these coefficients to suppress high frequencies (which usually correspond to noise), and then reconstructing the function as a Fourier series with purified or filtered coefficients. The figure 1 below shows two -periodic functions and their power spetrums. The second function is obtained from the first by filtering out its higher frequencies. Since it is generally difficult or impossible to compute the Fourier coefficients {ˆf(j)} exactly, we use their discrete approximations that result from sampling f at the points x k = k for k = 0,..., 1. They are ˆf (j) = f,e ijx, j = 0,..., 1 (6) = 1 Here the discrete inner product, is defined as 1 From [1, p. 71]. g,h = 1 f(x k )e ijx k. (7) i=0 g(x i )h(x i ), 4
5 Under this inner product, the functions 1,e ±ix,e ±ix,... are still orthogonal, namely, { e ikx,e ijx 1, if k = j (mod ), = 0, otherwise. But now we have Equation (8) immediately implies that ˆf (j) = f,e ijx = ˆf(k)e ikx,e ijx by (4) = = k= k= k=j (mod ) ˆf(k) e ikx,e ijx ˆf(k). (8) = ˆf (j ) = ˆf (j) = ˆf (j +) =. The points x 0,...,x are called the sampling points, f(x 0 ),...,f(x ) the sampling values, the sampling interval, and the sampling frequency. From equation (8) we see that all the Fourier coefficients ˆf(k), k = j mod, get mashed together and show up indistinguishably in the discrete Fourier series. This is referred to as aliasing. We cannot tell the difference between two basis functions e ik and e ij, k = j (mod ), because they agree at all sampling point x 0,...,x. Aliasing is illustrated 3 on the next page on a continuous function in (a) which is nonzero only for a finite time interval T. The Fourier transform of the function, shown in (b), has no limited bandwidth but rather finite amplitude for all frequencies. Suppose the original function is sampled with a sampling interval, then the resulting Fourier transform in(c) is defined between frequencies 1 and 1. Power outside that frequency range is folded over or aliased into the range.4 To eliminate this effect, the original function should go through low-pass filtering before sampling. Plugging (5) into (8) yields ˆf (j) = O ( k l 1) k=j (mod ) = ˆf (ĵ ) +O ( ( ) ) l 1, where ĵ = { j mod, if 0 j mod ; (j mod ), if j mod >. To generalize, for a function with period τ, the sampling frequency is. 3 τ The figure is from [3, p. 507]. 4 This folding effect is in part created by H( f) = H(f). 5
6 So we see that the Fourier coefficients ˆf(j) with j dominate other coefficients. For this reason, ˆf (j) is usually taken only as an approximation to ˆf(j) with j. Thus when we sample a real function at equally spaced points, in the interval [0, ), the aliasing effect prevents the observation of periodic phenomena in f(x) with frequencies higher than (/)/. Phrased differently, we have the following result. (c) Theorem (Sampling Theorem) If we wish to observe a certain periodic phenomenon of frequency v, then we must sample at a frequency at least as large as v. Observe that ˆf ( j) is a conjugate of ˆf (j), for all j, since ˆf ( j) = f,e i( j)x by (6) = 1 = 1 f(x k )e i( j)x k by (7) f(x k )e ijx k = ˆf (j). by (7) The corresponding trigonometric polynomial approximant of f(x) has the form: p(x) = ˆf (j)e ijx +Re (ˆf (/)e i(/)x) j </ 6
7 = ˆf (0)+Re / 1 ˆf (j)e ijx +Re(ˆf (/)e i(/)x). The last term is present only when is even. Having mentioned it for completeness s sake, we will now discuss the case when is odd, that, is = n+1 for some integer n. In this case, the functions 1, e ±ix,...,e ±inx are orthonormal with respect to the discrete inner product,. By virtually the same reasoning of least-squares approximation by orthogonal polynomials, we have the following theorem. Theorem 3 For any m n =, the mth order trigonometric polynomial m p m (x) = ˆf (j)e ijx j= m is the best approximation to f(x) by trigonometric polynomials of order m with respect to the discrete mean-square norm g = ( g,g )1 = 1 ( ( k ) ) 1 g. 3 Fast Computation FFT We are interested in the frequencies present in f(x) and their strength (or magnitude). But due to aliasing, ˆf (j), defined in (7), is good as an approximation to f(j) only for < j. Thus, for very large we want to be able to calculate ˆf (j), for 0 j, or equivalently, for 0 j 1, from f(x 0 ),...,f(x ), where x k = k. A straightforward calculation would take time O( ). A significant improvement can be achieved by reducing the above problem to a discrete Fourier transform (DFT). DFT is the mapping z 0 ẑ 0 z 1 z =. ẑ = ẑ 1. such that ẑ j = z ẑ z k ω jk, j = 0,..., 1, where ω is an th root of 1, that is, ω = e i. The mapping can also be written as a matrix equation: z 0 ẑ 0 1 ω ω ω z = ẑ ω ω () ω () 7 z ẑ
8 If we take z j = f(x j ), 0 j 1, then ˆf (j) = 1 ẑj, j = 0,1,..., 1. To verify, by definition (7) we have ˆf (j) = 1 = 1 = 1 f(x k )e ijx k k ij f(x k )e ( ) k f(x k ) ω j = 1 ẑj. Fast Fourier transformallows usto computethediscretefourier coefficients intime O( log). With = 10 6, for example, the improvement is from roughly two weeks of CPU time to 30 seconds! References [1] S. D. Conte and C de Boor. Elementary umerical Analysis: An Algorithmic Approach. McGraw-Hill, Inc., 3rd edition, [] M. Erdmann. Lecture notes for Mathematical Fundamentals for Robotics. The Robotics Institute, Carnegie Mellon University, [3] W. H. Press, et al. umerical Recipes in C++: The Art of Scientific Computing. Cambridge University Press, nd edition, 00. 8
Jim Lambers ENERGY 281 Spring Quarter Lecture 5 Notes
Jim ambers ENERGY 28 Spring Quarter 27-8 ecture 5 Notes These notes are based on Rosalind Archer s PE28 lecture notes, with some revisions by Jim ambers. Fourier Series Recall that in ecture 2, when we
More informationMARN 5898 Fourier Analysis.
MAR 5898 Fourier Analysis. Dmitriy Leykekhman Spring 2010 Goals Fourier Series. Discrete Fourier Transforms. D. Leykekhman - MAR 5898 Parameter estimation in marine sciences Linear Least Squares 1 Complex
More informationVectors in Function Spaces
Jim Lambers MAT 66 Spring Semester 15-16 Lecture 18 Notes These notes correspond to Section 6.3 in the text. Vectors in Function Spaces We begin with some necessary terminology. A vector space V, also
More informationThe discrete and fast Fourier transforms
The discrete and fast Fourier transforms Marcel Oliver Revised April 7, 1 1 Fourier series We begin by recalling the familiar definition of the Fourier series. For a periodic function u: [, π] C, we define
More informationPolynomial Interpolation
Polynomial Interpolation (Com S 477/577 Notes) Yan-Bin Jia Sep 1, 017 1 Interpolation Problem In practice, often we can measure a physical process or quantity (e.g., temperature) at a number of points
More informationSolution of Nonlinear Equations
Solution of Nonlinear Equations (Com S 477/577 Notes) Yan-Bin Jia Sep 14, 017 One of the most frequently occurring problems in scientific work is to find the roots of equations of the form f(x) = 0. (1)
More informationScientific Computing: An Introductory Survey
Scientific Computing: An Introductory Survey Chapter 12 Prof. Michael T. Heath Department of Computer Science University of Illinois at Urbana-Champaign Copyright c 2002. Reproduction permitted for noncommercial,
More informationTopics in Fourier analysis - Lecture 2.
Topics in Fourier analysis - Lecture 2. Akos Magyar 1 Infinite Fourier series. In this section we develop the basic theory of Fourier series of periodic functions of one variable, but only to the extent
More informationbe the set of complex valued 2π-periodic functions f on R such that
. Fourier series. Definition.. Given a real number P, we say a complex valued function f on R is P -periodic if f(x + P ) f(x) for all x R. We let be the set of complex valued -periodic functions f on
More informationOutline of Fourier Series: Math 201B
Outline of Fourier Series: Math 201B February 24, 2011 1 Functions and convolutions 1.1 Periodic functions Periodic functions. Let = R/(2πZ) denote the circle, or onedimensional torus. A function f : C
More informationNumerical Methods I Orthogonal Polynomials
Numerical Methods I Orthogonal Polynomials Aleksandar Donev Courant Institute, NYU 1 donev@courant.nyu.edu 1 Course G63.2010.001 / G22.2420-001, Fall 2010 Nov. 4th and 11th, 2010 A. Donev (Courant Institute)
More informationPoisson summation and the discrete Fourier transform John Kerl University of Arizona, Math 523B April 14, 2006
Poisson summation and the discrete Fourier transform John Kerl University of Arizona, Math 523B April 4, 2006 In Euclidean space, given a vector,... 2 ... we can put down a coordinate frame (say an orthonormal
More informationFourier Transforms For additional information, see the classic book The Fourier Transform and its Applications by Ronald N. Bracewell (which is on the shelves of most radio astronomers) and the Wikipedia
More informationUniversity of Houston, Department of Mathematics Numerical Analysis, Fall 2005
4 Interpolation 4.1 Polynomial interpolation Problem: LetP n (I), n ln, I := [a,b] lr, be the linear space of polynomials of degree n on I, P n (I) := { p n : I lr p n (x) = n i=0 a i x i, a i lr, 0 i
More informationFourier Series and Fourier Transform
Fourier Series and Fourier Transform An Introduction Michael Figl Center for Medical Physics and Biomedical Engineering Medical University of Vienna 1 / 36 Introduction 2 / 36 Introduction We want to recall
More informationMath 121A: Homework 6 solutions
Math A: Homework 6 solutions. (a) The coefficients of the Fourier sine series are given by b n = π f (x) sin nx dx = x(π x) sin nx dx π = (π x) cos nx dx nπ nπ [x(π x) cos nx]π = n ( )(sin nx) dx + π n
More informationRoots of Polynomials
Roots of Polynomials (Com S 477/577 Notes) Yan-Bin Jia Sep 26, 2017 A direct corollary of the fundamental theorem of algebra is that p(x) can be factorized over the complex domain into a product a n (x
More informationFOURIER SERIES, HAAR WAVELETS AND FAST FOURIER TRANSFORM
FOURIER SERIES, HAAR WAVELETS AD FAST FOURIER TRASFORM VESA KAARIOJA, JESSE RAILO AD SAMULI SILTAE Abstract. This handout is for the course Applications of matrix computations at the University of Helsinki
More informationIndeed, the family is still orthogonal if we consider a complex valued inner product ( or an inner product on complex vector space)
Fourier series of complex valued functions Suppose now f is a piecewise continuous complex valued function on [, π], that is f(x) = u(x)+iv(x) such that both u and v are real valued piecewise continuous
More informationMA3232 Summary 5. d y1 dy1. MATLAB has a number of built-in functions for solving stiff systems of ODEs. There are ode15s, ode23s, ode23t, ode23tb.
umerical solutions of higher order ODE We can convert a high order ODE into a system of first order ODEs and then apply RK method to solve it. Stiff ODEs Stiffness is a special problem that can arise in
More informationAnalysis II: Fourier Series
.... Analysis II: Fourier Series Kenichi Maruno Department of Mathematics, The University of Texas - Pan American May 3, 011 K.Maruno (UT-Pan American) Analysis II May 3, 011 1 / 16 Fourier series were
More informationMath 489AB A Very Brief Intro to Fourier Series Fall 2008
Math 489AB A Very Brief Intro to Fourier Series Fall 8 Contents Fourier Series. The coefficients........................................ Convergence......................................... 4.3 Convergence
More informationMathematical Methods for Computer Science
Mathematical Methods for Computer Science Computer Laboratory Computer Science Tripos, Part IB Michaelmas Term 2016/17 Professor J. Daugman Exercise problems Fourier and related methods 15 JJ Thomson Avenue
More informationMath 115 ( ) Yum-Tong Siu 1. Derivation of the Poisson Kernel by Fourier Series and Convolution
Math 5 (006-007 Yum-Tong Siu. Derivation of the Poisson Kernel by Fourier Series and Convolution We are going to give a second derivation of the Poisson kernel by using Fourier series and convolution.
More informationAdvanced Computational Fluid Dynamics AA215A Lecture 2 Approximation Theory. Antony Jameson
Advanced Computational Fluid Dynamics AA5A Lecture Approximation Theory Antony Jameson Winter Quarter, 6, Stanford, CA Last revised on January 7, 6 Contents Approximation Theory. Least Squares Approximation
More informationCompensation. June 29, Arizona State University. Edge Detection from Nonuniform Data via. Convolutional Gridding with Density.
Arizona State University June 29, 2012 Overview gridding with density compensation is a common method for function reconstruction nonuniform Fourier data. It is computationally inexpensive compared with
More informationFig. 1: Fourier series Examples
FOURIER SERIES AND ITS SOME APPLICATIONS P. Sathyabama Assistant Professor, Department of Mathematics, Bharath collage of Science and Management, Thanjavur, Tamilnadu Abstract: The Fourier series, the
More informationConstructing Approximation Kernels for Non-Harmonic Fourier Data
Constructing Approximation Kernels for Non-Harmonic Fourier Data Aditya Viswanathan aditya.v@caltech.edu California Institute of Technology SIAM Annual Meeting 2013 July 10 2013 0 / 19 Joint work with
More informationLectures notes. Rheology and Fluid Dynamics
ÉC O L E P O L Y T E C H N IQ U E FÉ DÉR A L E D E L A U S A N N E Christophe Ancey Laboratoire hydraulique environnementale (LHE) École Polytechnique Fédérale de Lausanne Écublens CH-05 Lausanne Lectures
More informationChapter 6: Fast Fourier Transform and Applications
Chapter 6: Fast Fourier Transform and Applications Michael Hanke Mathematical Models, Analysis and Simulation, Part I Read: Strang, Ch. 4. Fourier Sine Series In the following, every function f : [,π]
More informationω 0 = 2π/T 0 is called the fundamental angular frequency and ω 2 = 2ω 0 is called the
he ime-frequency Concept []. Review of Fourier Series Consider the following set of time functions {3A sin t, A sin t}. We can represent these functions in different ways by plotting the amplitude versus
More informationSolution of Linear Equations
Solution of Linear Equations (Com S 477/577 Notes) Yan-Bin Jia Sep 7, 07 We have discussed general methods for solving arbitrary equations, and looked at the special class of polynomial equations A subclass
More informationChapter 5: Bases in Hilbert Spaces
Orthogonal bases, general theory The Fourier basis in L 2 (T) Applications of Fourier series Chapter 5: Bases in Hilbert Spaces I-Liang Chern Department of Applied Mathematics National Chiao Tung University
More informationTopic 3: Fourier Series (FS)
ELEC264: Signals And Systems Topic 3: Fourier Series (FS) o o o o Introduction to frequency analysis of signals CT FS Fourier series of CT periodic signals Signal Symmetry and CT Fourier Series Properties
More informationSEISMIC WAVE PROPAGATION. Lecture 2: Fourier Analysis
SEISMIC WAVE PROPAGATION Lecture 2: Fourier Analysis Fourier Series & Fourier Transforms Fourier Series Review of trigonometric identities Analysing the square wave Fourier Transform Transforms of some
More informationIntroduction to Fourier Analysis
Lecture Introduction to Fourier Analysis Jan 7, 2005 Lecturer: Nati Linial Notes: Atri Rudra & Ashish Sabharwal. ext he main text for the first part of this course would be. W. Körner, Fourier Analysis
More informationNumerical Approximation Methods for Non-Uniform Fourier Data
Numerical Approximation Methods for Non-Uniform Fourier Data Aditya Viswanathan aditya@math.msu.edu 2014 Joint Mathematics Meetings January 18 2014 0 / 16 Joint work with Anne Gelb (Arizona State) Guohui
More informationProblem Set 8 - Solution
Problem Set 8 - Solution Jonasz Słomka Unless otherwise specified, you may use MATLAB to assist with computations. provide a print-out of the code used and its output with your assignment. Please 1. More
More informationMathematics for Chemists 2 Lecture 14: Fourier analysis. Fourier series, Fourier transform, DFT/FFT
Mathematics for Chemists 2 Lecture 14: Fourier analysis Fourier series, Fourier transform, DFT/FFT Johannes Kepler University Summer semester 2012 Lecturer: David Sevilla Fourier analysis 1/25 Remembering
More informationLecture 2: Basics of Harmonic Analysis. 1 Structural properties of Boolean functions (continued)
CS 880: Advanced Complexity Theory 1/25/2008 Lecture 2: Basics of Harmonic Analysis Instructor: Dieter van Melkebeek Scribe: Priyananda Shenoy In the last lecture, we mentioned one structural property
More informationThe Bernstein and Nikolsky inequalities for trigonometric polynomials
he ernstein and Nikolsky ineualities for trigonometric polynomials Jordan ell jordanbell@gmailcom Department of Mathematics, University of oronto January 28, 2015 1 Introduction Let = R/2πZ For a function
More informationCS711008Z Algorithm Design and Analysis
CS711008Z Algorithm Design and Analysis Lecture 5 FFT and Divide and Conquer Dongbo Bu Institute of Computing Technology Chinese Academy of Sciences, Beijing, China 1 / 56 Outline DFT: evaluate a polynomial
More informationEXAMINATION: MATHEMATICAL TECHNIQUES FOR IMAGE ANALYSIS
EXAMINATION: MATHEMATICAL TECHNIQUES FOR IMAGE ANALYSIS Course code: 8D Date: Thursday April 8 th, Time: 4h 7h Place: AUD 3 Read this first! Write your name and student identification number on each paper
More informationLecture 7 January 26, 2016
MATH 262/CME 372: Applied Fourier Analysis and Winter 26 Elements of Modern Signal Processing Lecture 7 January 26, 26 Prof Emmanuel Candes Scribe: Carlos A Sing-Long, Edited by E Bates Outline Agenda:
More informationPhysics 342 Lecture 2. Linear Algebra I. Lecture 2. Physics 342 Quantum Mechanics I
Physics 342 Lecture 2 Linear Algebra I Lecture 2 Physics 342 Quantum Mechanics I Wednesday, January 27th, 21 From separation of variables, we move to linear algebra Roughly speaking, this is the study
More informationENSC327 Communications Systems 2: Fourier Representations. Jie Liang School of Engineering Science Simon Fraser University
ENSC327 Communications Systems 2: Fourier Representations Jie Liang School of Engineering Science Simon Fraser University 1 Outline Chap 2.1 2.5: Signal Classifications Fourier Transform Dirac Delta Function
More informationPolynomials. p n (x) = a n x n + a n 1 x n 1 + a 1 x + a 0, where
Polynomials Polynomials Evaluation of polynomials involve only arithmetic operations, which can be done on today s digital computers. We consider polynomials with real coefficients and real variable. p
More information12.1 Fourier Transform of Discretely Sampled Data
494 Chapter 12. Fast Fourier Transform now is: The PSD-per-unit-time converges to finite values at all frequencies except those where h(t) has a discrete sine-wave (or cosine-wave) component of finite
More informationLecture 1 Numerical methods: principles, algorithms and applications: an introduction
Lecture 1 Numerical methods: principles, algorithms and applications: an introduction Weinan E 1,2 and Tiejun Li 2 1 Department of Mathematics, Princeton University, weinan@princeton.edu 2 School of Mathematical
More informationMP463 QUANTUM MECHANICS
MP463 QUANTUM MECHANICS Introduction Quantum theory of angular momentum Quantum theory of a particle in a central potential - Hydrogen atom - Three-dimensional isotropic harmonic oscillator (a model of
More informationIntroduction to the FFT
Introduction to the FFT 1 Introduction Assume that we have a signal fx where x denotes time. We would like to represent fx as a linear combination of functions e πiax or, equivalently, sinπax and cosπax
More informationThe Pseudospectral Method
The Pseudospectral Method Heiner Igel Department of Earth and Environmental Sciences Ludwig-Maximilians-University Munich Heiner Igel Computational Seismology 1 / 43 Outline 1 Introduction Motivation History
More informationConvergence Rates on Root Finding
Convergence Rates on Root Finding Com S 477/577 Oct 5, 004 A sequence x i R converges to ξ if for each ǫ > 0, there exists an integer Nǫ) such that x l ξ > ǫ for all l Nǫ). The Cauchy convergence criterion
More informationDiscrete Fourier Transform
Discrete Fourier Transform Virtually all practical signals have finite length (e.g., sensor data, audio records, digital images, stock values, etc). Rather than considering such signals to be zero-padded
More informationLecture 34. Fourier Transforms
Lecture 34 Fourier Transforms In this section, we introduce the Fourier transform, a method of analyzing the frequency content of functions that are no longer τ-periodic, but which are defined over the
More informationFrequency Response and Continuous-time Fourier Series
Frequency Response and Continuous-time Fourier Series Recall course objectives Main Course Objective: Fundamentals of systems/signals interaction (we d like to understand how systems transform or affect
More informationDiscrete Fourier Transform
Last lecture I introduced the idea that any function defined on x 0,..., N 1 could be written a sum of sines and cosines. There are two different reasons why this is useful. The first is a general one,
More informationConformal maps. Lent 2019 COMPLEX METHODS G. Taylor. A star means optional and not necessarily harder.
Lent 29 COMPLEX METHODS G. Taylor A star means optional and not necessarily harder. Conformal maps. (i) Let f(z) = az + b, with ad bc. Where in C is f conformal? cz + d (ii) Let f(z) = z +. What are the
More informationHarmonic Analysis on the Cube and Parseval s Identity
Lecture 3 Harmonic Analysis on the Cube and Parseval s Identity Jan 28, 2005 Lecturer: Nati Linial Notes: Pete Couperus and Neva Cherniavsky 3. Where we can use this During the past weeks, we developed
More informationDiscrete Simulation of Power Law Noise
Discrete Simulation of Power Law Noise Neil Ashby 1,2 1 University of Colorado, Boulder, CO 80309-0390 USA 2 National Institute of Standards and Technology, Boulder, CO 80305 USA ashby@boulder.nist.gov
More information256 Summary. D n f(x j ) = f j+n f j n 2n x. j n=1. α m n = 2( 1) n (m!) 2 (m n)!(m + n)!. PPW = 2π k x 2 N + 1. i=0?d i,j. N/2} N + 1-dim.
56 Summary High order FD Finite-order finite differences: Points per Wavelength: Number of passes: D n f(x j ) = f j+n f j n n x df xj = m α m dx n D n f j j n= α m n = ( ) n (m!) (m n)!(m + n)!. PPW =
More informationCOMPACTLY SUPPORTED ORTHONORMAL COMPLEX WAVELETS WITH DILATION 4 AND SYMMETRY
COMPACTLY SUPPORTED ORTHONORMAL COMPLEX WAVELETS WITH DILATION 4 AND SYMMETRY BIN HAN AND HUI JI Abstract. In this paper, we provide a family of compactly supported orthonormal complex wavelets with dilation
More informationTheory and Problems of Signals and Systems
SCHAUM'S OUTLINES OF Theory and Problems of Signals and Systems HWEI P. HSU is Professor of Electrical Engineering at Fairleigh Dickinson University. He received his B.S. from National Taiwan University
More informationTransform methods. and its inverse can be used to analyze certain time-dependent PDEs. f(x) sin(sxπ/(n + 1))
AMSC/CMSC 661 Scientific Computing II Spring 2010 Transforms and Wavelets Dianne P. O Leary c 2005,2010 Some motivations: Transform methods The Fourier transform Fv(ξ) = ˆv(ξ) = v(x)e ix ξ dx, R d and
More informationThe Fourier Transform
The Fourier Transorm Fourier Series Fourier Transorm The Basic Theorems and Applications Sampling Bracewell, R. The Fourier Transorm and Its Applications, 3rd ed. New York: McGraw-Hill, 2. Eric W. Weisstein.
More informationNov : Lecture 18: The Fourier Transform and its Interpretations
3 Nov. 04 2005: Lecture 8: The Fourier Transform and its Interpretations Reading: Kreyszig Sections: 0.5 (pp:547 49), 0.8 (pp:557 63), 0.9 (pp:564 68), 0.0 (pp:569 75) Fourier Transforms Expansion of a
More informationZygmund s Fourier restriction theorem and Bernstein s inequality
Zygmund s Fourier restriction theorem and Bernstein s inequality Jordan Bell jordanbell@gmailcom Department of Mathematics, University of Toronto February 13, 2015 1 Zygmund s restriction theorem Write
More informationPhysics 342 Lecture 2. Linear Algebra I. Lecture 2. Physics 342 Quantum Mechanics I
Physics 342 Lecture 2 Linear Algebra I Lecture 2 Physics 342 Quantum Mechanics I Wednesday, January 3th, 28 From separation of variables, we move to linear algebra Roughly speaking, this is the study of
More informationFOURIER TRANSFORMS. f n = 1 N. ie. cyclic. dw = F k 2 = N 1. See Brault & White 1971, A&A, , for a tutorial introduction.
FOURIER TRANSFORMS F(w) = T 0 f(t) e iwt dt f(t) = 1 2π wn w N F(w) e iwt dw F k = N 1 n=0 f n e 2πikn/N f n = 1 N N 1 k=0 F k e 2πikn/N Properties 1. Shift origin by t F F e iw t F invariant F 2 = power
More informationMath 56 Homework 5 Michael Downs
1. (a) Since f(x) = cos(6x) = ei6x 2 + e i6x 2, due to the orthogonality of each e inx, n Z, the only nonzero (complex) fourier coefficients are ˆf 6 and ˆf 6 and they re both 1 2 (which is also seen from
More informationLES of Turbulent Flows: Lecture 3
LES of Turbulent Flows: Lecture 3 Dr. Jeremy A. Gibbs Department of Mechanical Engineering University of Utah Fall 2016 1 / 53 Overview 1 Website for those auditing 2 Turbulence Scales 3 Fourier transforms
More informationWe have to prove now that (3.38) defines an orthonormal wavelet. It belongs to W 0 by Lemma and (3.55) with j = 1. We can write any f W 1 as
88 CHAPTER 3. WAVELETS AND APPLICATIONS We have to prove now that (3.38) defines an orthonormal wavelet. It belongs to W 0 by Lemma 3..7 and (3.55) with j =. We can write any f W as (3.58) f(ξ) = p(2ξ)ν(2ξ)
More informationLecture 13: Applications of Fourier transforms (Recipes, Chapter 13)
Lecture 13: Applications o Fourier transorms (Recipes, Chapter 13 There are many applications o FT, some o which involve the convolution theorem (Recipes 13.1: The convolution o h(t and r(t is deined by
More informationAssignment for next week
Assignment for next week Due: 6:30 PM Monday April 11 th (2016) -> PDF by email only 5 points: Pose two questions based on this lecture 5 points: what (and why) is sinc(0)? 5 points: ketch (by hand okay)
More information17 The functional equation
18.785 Number theory I Fall 16 Lecture #17 11/8/16 17 The functional equation In the previous lecture we proved that the iemann zeta function ζ(s) has an Euler product and an analytic continuation to the
More informationENT 315 Medical Signal Processing CHAPTER 2 DISCRETE FOURIER TRANSFORM. Dr. Lim Chee Chin
ENT 315 Medical Signal Processing CHAPTER 2 DISCRETE FOURIER TRANSFORM Dr. Lim Chee Chin Outline Introduction Discrete Fourier Series Properties of Discrete Fourier Series Time domain aliasing due to frequency
More informationCONVERGENCE OF THE FOURIER SERIES
CONVERGENCE OF THE FOURIER SERIES SHAW HAGIWARA Abstract. The Fourier series is a expression of a periodic, integrable function as a sum of a basis of trigonometric polynomials. In the following, we first
More information1 Assignment 1: Nonlinear dynamics (due September
Assignment : Nonlinear dynamics (due September 4, 28). Consider the ordinary differential equation du/dt = cos(u). Sketch the equilibria and indicate by arrows the increase or decrease of the solutions.
More informationFOURIER TRANSFORMS. 1. Fourier series 1.1. The trigonometric system. The sequence of functions
FOURIER TRANSFORMS. Fourier series.. The trigonometric system. The sequence of functions, cos x, sin x,..., cos nx, sin nx,... is called the trigonometric system. These functions have period π. The trigonometric
More informationFourier Reconstruction from Non-Uniform Spectral Data
School of Electrical, Computer and Energy Engineering, Arizona State University aditya.v@asu.edu With Profs. Anne Gelb, Doug Cochran and Rosemary Renaut Research supported in part by National Science Foundation
More informationREAL AND COMPLEX ANALYSIS
REAL AND COMPLE ANALYSIS Third Edition Walter Rudin Professor of Mathematics University of Wisconsin, Madison Version 1.1 No rights reserved. Any part of this work can be reproduced or transmitted in any
More informationPoularikas A. D. Fourier Transform The Handbook of Formulas and Tables for Signal Processing. Ed. Alexander D. Poularikas Boca Raton: CRC Press LLC,
Poularikas A. D. Fourier Transform The Handbook of Formulas and Tables for Signal Processing. Ed. Alexander D. Poularikas Boca Raton: CRC Press LLC, 999 3 Fourier Transform 3. One-Dimensional Fourier Transform
More informationNonlinear Optimization
Nonlinear Optimization (Com S 477/577 Notes) Yan-Bin Jia Nov 7, 2017 1 Introduction Given a single function f that depends on one or more independent variable, we want to find the values of those variables
More informationBochner s Theorem on the Fourier Transform on R
Bochner s heorem on the Fourier ransform on Yitao Lei October 203 Introduction ypically, the Fourier transformation sends suitable functions on to functions on. his can be defined on the space L ) + L
More informationLecture #8: Quantum Mechanical Harmonic Oscillator
5.61 Fall, 013 Lecture #8 Page 1 Last time Lecture #8: Quantum Mechanical Harmonic Oscillator Classical Mechanical Harmonic Oscillator * V(x) = 1 kx (leading term in power series expansion of most V(x)
More informationLecture 6 January 21, 2016
MATH 6/CME 37: Applied Fourier Analysis and Winter 06 Elements of Modern Signal Processing Lecture 6 January, 06 Prof. Emmanuel Candes Scribe: Carlos A. Sing-Long, Edited by E. Bates Outline Agenda: Fourier
More informationFinite-dimensional spaces. C n is the space of n-tuples x = (x 1,..., x n ) of complex numbers. It is a Hilbert space with the inner product
Chapter 4 Hilbert Spaces 4.1 Inner Product Spaces Inner Product Space. A complex vector space E is called an inner product space (or a pre-hilbert space, or a unitary space) if there is a mapping (, )
More informationn 1 f n 1 c 1 n+1 = c 1 n $ c 1 n 1. After taking logs, this becomes
Root finding: 1 a The points {x n+1, }, {x n, f n }, {x n 1, f n 1 } should be co-linear Say they lie on the line x + y = This gives the relations x n+1 + = x n +f n = x n 1 +f n 1 = Eliminating α and
More informationMATH 220 solution to homework 4
MATH 22 solution to homework 4 Problem. Define v(t, x) = u(t, x + bt), then v t (t, x) a(x + u bt) 2 (t, x) =, t >, x R, x2 v(, x) = f(x). It suffices to show that v(t, x) F = max y R f(y). We consider
More informationFiltering and Edge Detection
Filtering and Edge Detection Local Neighborhoods Hard to tell anything from a single pixel Example: you see a reddish pixel. Is this the object s color? Illumination? Noise? The next step in order of complexity
More informationThere are two things that are particularly nice about the first basis
Orthogonality and the Gram-Schmidt Process In Chapter 4, we spent a great deal of time studying the problem of finding a basis for a vector space We know that a basis for a vector space can potentially
More informationAdvanced Digital Signal Processing -Introduction
Advanced Digital Signal Processing -Introduction LECTURE-2 1 AP9211- ADVANCED DIGITAL SIGNAL PROCESSING UNIT I DISCRETE RANDOM SIGNAL PROCESSING Discrete Random Processes- Ensemble Averages, Stationary
More informationPolynomial Approximation: The Fourier System
Polynomial Approximation: The Fourier System Charles B. I. Chilaka CASA Seminar 17th October, 2007 Outline 1 Introduction and problem formulation 2 The continuous Fourier expansion 3 The discrete Fourier
More informationDISCRETE FOURIER TRANSFORM
DD2423 Image Processing and Computer Vision DISCRETE FOURIER TRANSFORM Mårten Björkman Computer Vision and Active Perception School of Computer Science and Communication November 1, 2012 1 Terminology:
More informationSpectral Analysis. Jesús Fernández-Villaverde University of Pennsylvania
Spectral Analysis Jesús Fernández-Villaverde University of Pennsylvania 1 Why Spectral Analysis? We want to develop a theory to obtain the business cycle properties of the data. Burns and Mitchell (1946).
More informationLecture 27 Frequency Response 2
Lecture 27 Frequency Response 2 Fundamentals of Digital Signal Processing Spring, 2012 Wei-Ta Chu 2012/6/12 1 Application of Ideal Filters Suppose we can generate a square wave with a fundamental period
More informationHamburger Beiträge zur Angewandten Mathematik
Hamburger Beiträge zur Angewandten Mathematik Error Estimates for Filtered Back Projection Matthias Beckmann and Armin Iske Nr. 2015-03 January 2015 Error Estimates for Filtered Back Projection Matthias
More informationFourier Series. 1. Review of Linear Algebra
Fourier Series In this section we give a short introduction to Fourier Analysis. If you are interested in Fourier analysis and would like to know more detail, I highly recommend the following book: Fourier
More informationFrom Fourier to Wavelets in 60 Slides
From Fourier to Wavelets in 60 Slides Bernhard G. Bodmann Math Department, UH September 20, 2008 B. G. Bodmann (UH Math) From Fourier to Wavelets in 60 Slides September 20, 2008 1 / 62 Outline 1 From Fourier
More informationAbout solving time dependent Schrodinger equation
About solving time dependent Schrodinger equation (Griffiths Chapter 2 Time Independent Schrodinger Equation) Given the time dependent Schrodinger Equation: Ψ Ψ Ψ 2 1. Observe that Schrodinger time dependent
More information