Wavelet Analysis. Willy Hereman. Department of Mathematical and Computer Sciences Colorado School of Mines Golden, CO Sandia Laboratories

Size: px
Start display at page:

Download "Wavelet Analysis. Willy Hereman. Department of Mathematical and Computer Sciences Colorado School of Mines Golden, CO Sandia Laboratories"

Transcription

1 Wavelet Analysis Willy Hereman Department of Mathematical and Computer Sciences Colorado School of Mines Golden, CO Sandia Laboratories December 0, 998

2 Coordinate-Coordinate Formulations CC and CC2 Integral formulation of the Dirichlet problem (ψ T (x s ) = 0) leads to F i (x) = L 2 L 2 Z D p (x, x )N T (x )dx N T is the normal derivative of the field on the surface (surface current) F i a linear combination of the incident field ψ i (x s ) and the normal derivative N i evaluated on the surface F i (x) = βψ i (x s ) + αn i (x s ). Note that F i comes from a linear combination of two equations: ψ i (x s ) = (SN T )(x s ) and 2 N T (x s ) = N i (x s ) PV n (SN T )(x s ). The impedance kernel (D=Dirichlet) is Z D p (x, x ) = 2 αδ(x x ) + α PV G p (x, x ) + βg p (x, x ) involves a Dirac delta function term, the periodic Green s function G p (x, x ) = i λ 4π L and its normal derivative j= β j e ik [α j (x x )+β j s(x) s(x ) ] G p (x, x ) = [n j j G p (x, x )] z=s(x) z =s(x ) n j is the (non-unit) surface normal PV represents Cauchy Principal Value

3 Discretization of F i (x) = L 2 L 2 Z D p (x, x )N T (x )dx yields a matrix whose row and column entries both result from sampling in coordinate space (coordinate-coordinate method, CC for short). The real parameters α and β in specify the type of equation: For α = 0 first kind integral equation referred to as CC For β = 0 second kind integral referred to as CC2 For β = and α arbitrary ZN T = F i. F i (x) = βψ i (x s ) + αn i (x s ) combined field integral equation (CFIE) Solution of the unknown N T yields the amplitudes A n. The amplitudes lead to the energy (normalized): n A n 2 Re(β n ) β 0. We will always test how close this is to.

4 Daubechies Orthogonal Wavelets with Compact Support Example: DAUB4 (2 vanishing moments) Scaling and wavelet function families: φ j,k (x) = 2 j 2φ(2 j x k) ψ j,k (x) = 2 j 2ψ(2 j x k). The two-scale difference equations for φ(x) and ψ(x) : φ(x) = 2 3 ψ(x) = 2 3 h k φ(2x k) g k φ(2x k) The functions φ(x) and ψ(x) are supported on interval [0, 3]. The scaling function φ(x) is orthogonal to all its integer translates. The scaling function φ(x) is properly normalized φ(x)dx =. The wavelet function ψ(x) has two vanishing moments ψ(x)dx = xψ(x)dx = 0. In the Fourier space, the low pass filter with M = 2 vanishing moments H(z) = 3 h k z k = 2( + z 2 )2 Q(z), with z = exp ( 2πiω) with Q(z) is polynomial of degree.

5 H(z) satisfies the quadrature mirror filter (QMF) condition H(z)H( z ) + H( z)h( z ) = 2. The polynomial Q(z) for M = 2 is computed from factorization of Q(z)Q( z ) = M ( ) k (M + k)! ( z) 2k (4z) k = 2 k!(m )! 2z z 2. The averaging (low pass) filter H = {h 0, h, h 2, h 3 }, where h 0 = 4 2 ( + 3) = h = 4 2 (3 + 3) = h 2 = 4 2 (3 3) = h 3 = 4 2 ( 3) = The differencing (high pass) filter G = {g 0, g, g 2, g 3 } = {h 3, h 2, h, h 0 }. Both H and G have L = 4 filter taps. The high pass filter annihilates constant and linear trends: g 0 + g + g 2 + g 3 = 0 and 0g 0 + g + 2g 2 + 3g 3 = 0.

6 Example: DAUB6 (3 vanishing moments) Scaling and wavelet function families: φ j,k (x) = 2 j 2φ(2 j x k) ψ j,k (x) = 2 j 2ψ(2 j x k). The two-scale difference equations for φ(x) and ψ(x) : φ(x) = 2 5 ψ(x) = 2 5 h k φ(2x k) g k φ(2x k) The functions φ(x) and ψ(x) are supported on interval [0, 5]. The scaling function φ(x) is orthogonal to all its integer translates. The scaling function φ(x) is properly normalized φ(x)dx =. The wavelet function ψ(x) has three vanishing moments ψ(x)dx = xψ(x)dx = x2 ψ(x)dx = 0. In the Fourier space, the low pass filter with M = 3 vanishing moments H(z) = 5 h k z k = 2( + z 2 )3 Q(z), with z = exp ( 2πiω). Q(z) for M = 3 is polynomial of degree 2 and computed via Q(z)Q( z ) = M ( ) k (M + k)! ( z) 2k (4z) k k!(m )! = z z 2 9z 4 9 4z.

7 The averaging (low pass) filter H = {h 0, h, h 2, h 3, h 4, h 5 }, where h 0 = h = h 2 = h 3 = h 4 = h 5 = 6 2 ( ) = ( ) = ( ) = ( ) = ( ) = ( ) = The differencing (high pass) filter G = {g 0, g, g 2, g 3, g 4, g 5 } = {h 5, h 4, h 3, h 2, h, h 0 }. Both H and G have L = 6 filter taps. The high pass filter annihilates constant, linear and quadratic trends: and g 0 + g + g 2 + g 3 + g 4 + g 5 = 0 0g 0 + g + 2g 2 + 3g 3 + 4g 4 + 5g 5 = 0 0g 0 + g + 4g 2 + 9g 3 + 6g 4 + 5g 5 = 0

8 The Wavelet Transform For CC, SC or SS formulations: we have to solve a linear system Ax = b x is the vector of unknowns, A and b are given. Apply wavelets to: the integral equations, the matrix equations. Wavelet transform methods are applied to: sparsify the matrix, make the matrix inversion faster, speed up the solution process for x. Different types of wavelets can be used, e.g. Daubechies wavelets. The wavelet transform is described as a similarity transform (implemented as convolution). If W is the orthogonal matrix which performs the wavelet transform on the columns of a matrix, then the wavelet transform à of A is à = WAW T since W = W T (similarity transform). Applying this transformation to Ax = b we get or where x = Wx and b = Wb. WAW T Wx = Wb à x = b,

9 Pick a threshold τ and replace à by Ã(t) as follows à (t) ij = Solve the new system for x. 0, Ãij τ max Ãmn, m,n à ij otherwise. à (t) x = b Then compute x = W T x, which is the thresholded solution Ax = b. Observations: Cost: the times necessary to apply the wavelet transform and its inverse, and to do a matrix search to threshold can be many times the inversion time of the untransformed impedance matrix. This is particularly true for the SC and SS methods whose small matrix sizes make the inversion much faster. We can not reach a sparsity of 0 % (only 0 % of the matrix elements remain after thresholding). A 0 % level of sparsity our matrices become singular unless we dramatically oversampled to begin with. The accuracy decreased dramatically as sparsity increased. Sparsification may help iterative techniques. We have control over sampling. Proponents of wavelets go immediately to large matrices which are often the result of oversampling. We achieved better results with small dense matrices and no wavelet techniques.

A Tutorial on Wavelets and their Applications. Martin J. Mohlenkamp

A Tutorial on Wavelets and their Applications. Martin J. Mohlenkamp A Tutorial on Wavelets and their Applications Martin J. Mohlenkamp University of Colorado at Boulder Department of Applied Mathematics mjm@colorado.edu This tutorial is designed for people with little

More information

Wavelets in Scattering Calculations

Wavelets in Scattering Calculations Wavelets in Scattering Calculations W. P., Brian M. Kessler, Gerald L. Payne polyzou@uiowa.edu The University of Iowa Wavelets in Scattering Calculations p.1/43 What are Wavelets? Orthonormal basis functions.

More information

Lectures notes. Rheology and Fluid Dynamics

Lectures notes. Rheology and Fluid Dynamics ÉC O L E P O L Y T E C H N IQ U E FÉ DÉR A L E D E L A U S A N N E Christophe Ancey Laboratoire hydraulique environnementale (LHE) École Polytechnique Fédérale de Lausanne Écublens CH-05 Lausanne Lectures

More information

Course and Wavelets and Filter Banks

Course and Wavelets and Filter Banks Course 18.327 and 1.130 Wavelets and Filter Bans Numerical solution of PDEs: Galerin approximation; wavelet integrals (projection coefficients, moments and connection coefficients); convergence Numerical

More information

From Fourier to Wavelets in 60 Slides

From Fourier to Wavelets in 60 Slides From Fourier to Wavelets in 60 Slides Bernhard G. Bodmann Math Department, UH September 20, 2008 B. G. Bodmann (UH Math) From Fourier to Wavelets in 60 Slides September 20, 2008 1 / 62 Outline 1 From Fourier

More information

Wavelets. Lecture 28

Wavelets. Lecture 28 Wavelets. Lecture 28 Just like the FFT, the wavelet transform is an operation that can be performed in a fast way. Operating on an input vector representing a sampled signal, it can be viewed, just like

More information

Chapter 7 Wavelets and Multiresolution Processing

Chapter 7 Wavelets and Multiresolution Processing Chapter 7 Wavelets and Multiresolution Processing Background Multiresolution Expansions Wavelet Transforms in One Dimension Wavelet Transforms in Two Dimensions Image Pyramids Subband Coding The Haar

More information

Lecture 7 Multiresolution Analysis

Lecture 7 Multiresolution Analysis David Walnut Department of Mathematical Sciences George Mason University Fairfax, VA USA Chapman Lectures, Chapman University, Orange, CA Outline Definition of MRA in one dimension Finding the wavelet

More information

On the fast algorithm for multiplication of functions in the wavelet bases

On the fast algorithm for multiplication of functions in the wavelet bases Published in Proceedings of the International Conference Wavelets and Applications, Toulouse, 1992; Y. Meyer and S. Roques, edt., Editions Frontieres, 1993 On the fast algorithm for multiplication of functions

More information

MGA Tutorial, September 08, 2004 Construction of Wavelets. Jan-Olov Strömberg

MGA Tutorial, September 08, 2004 Construction of Wavelets. Jan-Olov Strömberg MGA Tutorial, September 08, 2004 Construction of Wavelets Jan-Olov Strömberg Department of Mathematics Royal Institute of Technology (KTH) Stockholm, Sweden Department of Numerical Analysis and Computer

More information

1 Introduction to Wavelet Analysis

1 Introduction to Wavelet Analysis Jim Lambers ENERGY 281 Spring Quarter 2007-08 Lecture 9 Notes 1 Introduction to Wavelet Analysis Wavelets were developed in the 80 s and 90 s as an alternative to Fourier analysis of signals. Some of the

More information

1 The Continuous Wavelet Transform The continuous wavelet transform (CWT) Discretisation of the CWT... 2

1 The Continuous Wavelet Transform The continuous wavelet transform (CWT) Discretisation of the CWT... 2 Contents 1 The Continuous Wavelet Transform 1 1.1 The continuous wavelet transform (CWT)............. 1 1. Discretisation of the CWT...................... Stationary wavelet transform or redundant wavelet

More information

1 Continuity Classes C m (Ω)

1 Continuity Classes C m (Ω) 0.1 Norms 0.1 Norms A norm on a linear space X is a function : X R with the properties: Positive Definite: x 0 x X (nonnegative) x = 0 x = 0 (strictly positive) λx = λ x x X, λ C(homogeneous) x + y x +

More information

Quantum Computing Lecture 2. Review of Linear Algebra

Quantum Computing Lecture 2. Review of Linear Algebra Quantum Computing Lecture 2 Review of Linear Algebra Maris Ozols Linear algebra States of a quantum system form a vector space and their transformations are described by linear operators Vector spaces

More information

Space-Frequency Atoms

Space-Frequency Atoms Space-Frequency Atoms FREQUENCY FREQUENCY SPACE SPACE FREQUENCY FREQUENCY SPACE SPACE Figure 1: Space-frequency atoms. Windowed Fourier Transform 1 line 1 0.8 0.6 0.4 0.2 0-0.2-0.4-0.6-0.8-1 0 100 200

More information

LECTURE 5: THE METHOD OF STATIONARY PHASE

LECTURE 5: THE METHOD OF STATIONARY PHASE LECTURE 5: THE METHOD OF STATIONARY PHASE Some notions.. A crash course on Fourier transform For j =,, n, j = x j. D j = i j. For any multi-index α = (α,, α n ) N n. α = α + + α n. α! = α! α n!. x α =

More information

( nonlinear constraints)

( nonlinear constraints) Wavelet Design & Applications Basic requirements: Admissibility (single constraint) Orthogonality ( nonlinear constraints) Sparse Representation Smooth functions well approx. by Fourier High-frequency

More information

Chapter III Beyond L 2 : Fourier transform of distributions

Chapter III Beyond L 2 : Fourier transform of distributions Chapter III Beyond L 2 : Fourier transform of distributions 113 1 Basic definitions and first examples In this section we generalize the theory of the Fourier transform developed in Section 1 to distributions.

More information

We have to prove now that (3.38) defines an orthonormal wavelet. It belongs to W 0 by Lemma and (3.55) with j = 1. We can write any f W 1 as

We have to prove now that (3.38) defines an orthonormal wavelet. It belongs to W 0 by Lemma and (3.55) with j = 1. We can write any f W 1 as 88 CHAPTER 3. WAVELETS AND APPLICATIONS We have to prove now that (3.38) defines an orthonormal wavelet. It belongs to W 0 by Lemma 3..7 and (3.55) with j =. We can write any f W as (3.58) f(ξ) = p(2ξ)ν(2ξ)

More information

Lecture Notes 5: Multiresolution Analysis

Lecture Notes 5: Multiresolution Analysis Optimization-based data analysis Fall 2017 Lecture Notes 5: Multiresolution Analysis 1 Frames A frame is a generalization of an orthonormal basis. The inner products between the vectors in a frame and

More information

Boundary functions for wavelets and their properties

Boundary functions for wavelets and their properties Graduate Theses and Dissertations Iowa State University Capstones, Theses and Dissertations 009 Boundary functions for wavelets and their properties Ahmet Alturk Iowa State University Follow this and additional

More information

Chapter 7 Wavelets and Multiresolution Processing. Subband coding Quadrature mirror filtering Pyramid image processing

Chapter 7 Wavelets and Multiresolution Processing. Subband coding Quadrature mirror filtering Pyramid image processing Chapter 7 Wavelets and Multiresolution Processing Wavelet transform vs Fourier transform Basis functions are small waves called wavelet with different frequency and limited duration Multiresolution theory:

More information

Wavelets and Filter Banks

Wavelets and Filter Banks Wavelets and Filter Banks Inheung Chon Department of Mathematics Seoul Woman s University Seoul 139-774, Korea Abstract We show that if an even length filter has the same length complementary filter in

More information

Two Channel Subband Coding

Two Channel Subband Coding Two Channel Subband Coding H1 H1 H0 H0 Figure 1: Two channel subband coding. In two channel subband coding A signal is convolved with a highpass filter h 1 and a lowpass filter h 0. The two halfband signals

More information

Space-Frequency Atoms

Space-Frequency Atoms Space-Frequency Atoms FREQUENCY FREQUENCY SPACE SPACE FREQUENCY FREQUENCY SPACE SPACE Figure 1: Space-frequency atoms. Windowed Fourier Transform 1 line 1 0.8 0.6 0.4 0.2 0-0.2-0.4-0.6-0.8-1 0 100 200

More information

Polynomial Approximation: The Fourier System

Polynomial Approximation: The Fourier System Polynomial Approximation: The Fourier System Charles B. I. Chilaka CASA Seminar 17th October, 2007 Outline 1 Introduction and problem formulation 2 The continuous Fourier expansion 3 The discrete Fourier

More information

Application of wavelets to singular integral scattering equations

Application of wavelets to singular integral scattering equations Application of wavelets to singular integral scattering equations B. M. Kessler, G. L. Payne, and W. N. Polyzou Department of Physics and Astronomy, The University of Iowa Iowa City, IA 52242 (Dated: July

More information

Lecture 16: Multiresolution Image Analysis

Lecture 16: Multiresolution Image Analysis Lecture 16: Multiresolution Image Analysis Harvey Rhody Chester F. Carlson Center for Imaging Science Rochester Institute of Technology rhody@cis.rit.edu November 9, 2004 Abstract Multiresolution analysis

More information

Wavelets, Multiresolution Analysis and Fast Numerical Algorithms. G. Beylkin 1

Wavelets, Multiresolution Analysis and Fast Numerical Algorithms. G. Beylkin 1 A draft of INRIA lectures, May 1991 Wavelets, Multiresolution Analysis Fast Numerical Algorithms G. Beylkin 1 I Introduction These lectures are devoted to fast numerical algorithms their relation to a

More information

12. Cholesky factorization

12. Cholesky factorization L. Vandenberghe ECE133A (Winter 2018) 12. Cholesky factorization positive definite matrices examples Cholesky factorization complex positive definite matrices kernel methods 12-1 Definitions a symmetric

More information

Fourier analysis, measures, and distributions. Alan Haynes

Fourier analysis, measures, and distributions. Alan Haynes Fourier analysis, measures, and distributions Alan Haynes 1 Mathematics of diffraction Physical diffraction As a physical phenomenon, diffraction refers to interference of waves passing through some medium

More information

TD 1: Hilbert Spaces and Applications

TD 1: Hilbert Spaces and Applications Université Paris-Dauphine Functional Analysis and PDEs Master MMD-MA 2017/2018 Generalities TD 1: Hilbert Spaces and Applications Exercise 1 (Generalized Parallelogram law). Let (H,, ) be a Hilbert space.

More information

An Adaptive Pseudo-Wavelet Approach for Solving Nonlinear Partial Differential Equations

An Adaptive Pseudo-Wavelet Approach for Solving Nonlinear Partial Differential Equations An Adaptive Pseudo-Wavelet Approach for Solving Nonlinear Partial Differential Equations Gregory Beylkin and James M. Keiser Wavelet Analysis and Applications, v.6, 1997, Academic Press. Contents 1 Introduction

More information

Toward a Realization of Marr s Theory of Primal Sketches via Autocorrelation Wavelets: Image Representation using Multiscale Edge Information

Toward a Realization of Marr s Theory of Primal Sketches via Autocorrelation Wavelets: Image Representation using Multiscale Edge Information Toward a Realization of Marr s Theory of Primal Sketches via Autocorrelation Wavelets: Image Representation using Multiscale Edge Information Naoki Saito 1 Department of Mathematics University of California,

More information

Construction of Multivariate Compactly Supported Orthonormal Wavelets

Construction of Multivariate Compactly Supported Orthonormal Wavelets Construction of Multivariate Compactly Supported Orthonormal Wavelets Ming-Jun Lai Department of Mathematics The University of Georgia Athens, GA 30602 April 30, 2004 Dedicated to Professor Charles A.

More information

Wavelets and Image Compression Augusta State University April, 27, Joe Lakey. Department of Mathematical Sciences. New Mexico State University

Wavelets and Image Compression Augusta State University April, 27, Joe Lakey. Department of Mathematical Sciences. New Mexico State University Wavelets and Image Compression Augusta State University April, 27, 6 Joe Lakey Department of Mathematical Sciences New Mexico State University 1 Signals and Images Goal Reduce image complexity with little

More information

DAVID FERRONE. s k s k 2j = δ 0j. s k = 1

DAVID FERRONE. s k s k 2j = δ 0j. s k = 1 FINITE BIORTHOGONAL TRANSFORMS AND MULTIRESOLUTION ANALYSES ON INTERVALS DAVID FERRONE 1. Introduction Wavelet theory over the entire real line is well understood and elegantly presented in various textboos

More information

Kernel Method: Data Analysis with Positive Definite Kernels

Kernel Method: Data Analysis with Positive Definite Kernels Kernel Method: Data Analysis with Positive Definite Kernels 2. Positive Definite Kernel and Reproducing Kernel Hilbert Space Kenji Fukumizu The Institute of Statistical Mathematics. Graduate University

More information

Hilbert Space Problems

Hilbert Space Problems Hilbert Space Problems Prescribed books for problems. ) Hilbert Spaces, Wavelets, Generalized Functions and Modern Quantum Mechanics by Willi-Hans Steeb Kluwer Academic Publishers, 998 ISBN -7923-523-9

More information

Scientific Computing: An Introductory Survey

Scientific Computing: An Introductory Survey Scientific Computing: An Introductory Survey Chapter 12 Prof. Michael T. Heath Department of Computer Science University of Illinois at Urbana-Champaign Copyright c 2002. Reproduction permitted for noncommercial,

More information

Homework I, Solutions

Homework I, Solutions Homework I, Solutions I: (15 points) Exercise on lower semi-continuity: Let X be a normed space and f : X R be a function. We say that f is lower semi - continuous at x 0 if for every ε > 0 there exists

More information

Matrices: 2.1 Operations with Matrices

Matrices: 2.1 Operations with Matrices Goals In this chapter and section we study matrix operations: Define matrix addition Define multiplication of matrix by a scalar, to be called scalar multiplication. Define multiplication of two matrices,

More information

October 7, :8 WSPC/WS-IJWMIP paper. Polynomial functions are renable

October 7, :8 WSPC/WS-IJWMIP paper. Polynomial functions are renable International Journal of Wavelets, Multiresolution and Information Processing c World Scientic Publishing Company Polynomial functions are renable Henning Thielemann Institut für Informatik Martin-Luther-Universität

More information

Nonseparable multivariate wavelets. Ghan Shyam Bhatt. A dissertation submitted to the graduate faculty

Nonseparable multivariate wavelets. Ghan Shyam Bhatt. A dissertation submitted to the graduate faculty Nonseparable multivariate wavelets by Ghan Shyam Bhatt A dissertation submitted to the graduate faculty in partial fulfillment of the requirements for the degree of DOCTOR OF PHILOSOPHY Major: Applied

More information

Digital Image Processing

Digital Image Processing Digital Image Processing Wavelets and Multiresolution Processing () Christophoros Nikou cnikou@cs.uoi.gr University of Ioannina - Department of Computer Science 2 Contents Image pyramids Subband coding

More information

Math 671: Tensor Train decomposition methods

Math 671: Tensor Train decomposition methods Math 671: Eduardo Corona 1 1 University of Michigan at Ann Arbor December 8, 2016 Table of Contents 1 Preliminaries and goal 2 Unfolding matrices for tensorized arrays The Tensor Train decomposition 3

More information

Denoising and Compression Using Wavelets

Denoising and Compression Using Wavelets Denoising and Compression Using Wavelets December 15,2016 Juan Pablo Madrigal Cianci Trevor Giannini Agenda 1 Introduction Mathematical Theory Theory MATLAB s Basic Commands De-Noising: Signals De-Noising:

More information

Linear Algebra (Review) Volker Tresp 2018

Linear Algebra (Review) Volker Tresp 2018 Linear Algebra (Review) Volker Tresp 2018 1 Vectors k, M, N are scalars A one-dimensional array c is a column vector. Thus in two dimensions, ( ) c1 c = c 2 c i is the i-th component of c c T = (c 1, c

More information

Lecture 15 Review of Matrix Theory III. Dr. Radhakant Padhi Asst. Professor Dept. of Aerospace Engineering Indian Institute of Science - Bangalore

Lecture 15 Review of Matrix Theory III. Dr. Radhakant Padhi Asst. Professor Dept. of Aerospace Engineering Indian Institute of Science - Bangalore Lecture 15 Review of Matrix Theory III Dr. Radhakant Padhi Asst. Professor Dept. of Aerospace Engineering Indian Institute of Science - Bangalore Matrix An m n matrix is a rectangular or square array of

More information

Schemes. Philipp Keding AT15, San Antonio, TX. Quarklet Frames in Adaptive Numerical. Schemes. Philipp Keding. Philipps-University Marburg

Schemes. Philipp Keding AT15, San Antonio, TX. Quarklet Frames in Adaptive Numerical. Schemes. Philipp Keding. Philipps-University Marburg AT15, San Antonio, TX 5-23-2016 Joint work with Stephan Dahlke and Thorsten Raasch Let H be a Hilbert space with its dual H. We are interested in the solution u H of the operator equation Lu = f, with

More information

Harmonic Analysis: from Fourier to Haar. María Cristina Pereyra Lesley A. Ward

Harmonic Analysis: from Fourier to Haar. María Cristina Pereyra Lesley A. Ward Harmonic Analysis: from Fourier to Haar María Cristina Pereyra Lesley A. Ward Department of Mathematics and Statistics, MSC03 2150, 1 University of New Mexico, Albuquerque, NM 87131-0001, USA E-mail address:

More information

1. Fourier Transform (Continuous time) A finite energy signal is a signal f(t) for which. f(t) 2 dt < Scalar product: f(t)g(t)dt

1. Fourier Transform (Continuous time) A finite energy signal is a signal f(t) for which. f(t) 2 dt < Scalar product: f(t)g(t)dt 1. Fourier Transform (Continuous time) 1.1. Signals with finite energy A finite energy signal is a signal f(t) for which Scalar product: f(t) 2 dt < f(t), g(t) = 1 2π f(t)g(t)dt The Hilbert space of all

More information

Development and Applications of Wavelets in Signal Processing

Development and Applications of Wavelets in Signal Processing Development and Applications of Wavelets in Signal Processing Mathematics 097: Senior Conference Paper Published May 014 David Nahmias dnahmias1@gmailcom Abstract Wavelets have many powerful applications

More information

Adaptive Nonparametric Density Estimators

Adaptive Nonparametric Density Estimators Adaptive Nonparametric Density Estimators by Alan J. Izenman Introduction Theoretical results and practical application of histograms as density estimators usually assume a fixed-partition approach, where

More information

Matrices A brief introduction

Matrices A brief introduction Matrices A brief introduction Basilio Bona DAUIN Politecnico di Torino Semester 1, 2014-15 B. Bona (DAUIN) Matrices Semester 1, 2014-15 1 / 44 Definitions Definition A matrix is a set of N real or complex

More information

Numerical Approximation Methods for Non-Uniform Fourier Data

Numerical Approximation Methods for Non-Uniform Fourier Data Numerical Approximation Methods for Non-Uniform Fourier Data Aditya Viswanathan aditya@math.msu.edu 2014 Joint Mathematics Meetings January 18 2014 0 / 16 Joint work with Anne Gelb (Arizona State) Guohui

More information

Chapter 1: Systems of Linear Equations and Matrices

Chapter 1: Systems of Linear Equations and Matrices : Systems of Linear Equations and Matrices Multiple Choice Questions. Which of the following equations is linear? (A) x + 3x 3 + 4x 4 3 = 5 (B) 3x x + x 3 = 5 (C) 5x + 5 x x 3 = x + cos (x ) + 4x 3 = 7.

More information

3 (Maths) Linear Algebra

3 (Maths) Linear Algebra 3 (Maths) Linear Algebra References: Simon and Blume, chapters 6 to 11, 16 and 23; Pemberton and Rau, chapters 11 to 13 and 25; Sundaram, sections 1.3 and 1.5. The methods and concepts of linear algebra

More information

8.1 Concentration inequality for Gaussian random matrix (cont d)

8.1 Concentration inequality for Gaussian random matrix (cont d) MGMT 69: Topics in High-dimensional Data Analysis Falll 26 Lecture 8: Spectral clustering and Laplacian matrices Lecturer: Jiaming Xu Scribe: Hyun-Ju Oh and Taotao He, October 4, 26 Outline Concentration

More information

University of Illinois at Chicago Department of Physics. Quantum Mechanics Qualifying Examination. January 7, 2013 (Tuesday) 9:00 am - 12:00 noon

University of Illinois at Chicago Department of Physics. Quantum Mechanics Qualifying Examination. January 7, 2013 (Tuesday) 9:00 am - 12:00 noon University of Illinois at Chicago Department of Physics Quantum Mechanics Qualifying Examination January 7, 13 Tuesday 9: am - 1: noon Full credit can be achieved from completely correct answers to 4 questions

More information

MATH 590: Meshfree Methods

MATH 590: Meshfree Methods MATH 590: Meshfree Methods Chapter 34: Improving the Condition Number of the Interpolation Matrix Greg Fasshauer Department of Applied Mathematics Illinois Institute of Technology Fall 2010 fasshauer@iit.edu

More information

Wavelets For Computer Graphics

Wavelets For Computer Graphics {f g} := f(x) g(x) dx A collection of linearly independent functions Ψ j spanning W j are called wavelets. i J(x) := 6 x +2 x + x + x Ψ j (x) := Ψ j (2 j x i) i =,..., 2 j Res. Avge. Detail Coef 4 [9 7

More information

Short-time Fourier transform for quaternionic signals

Short-time Fourier transform for quaternionic signals Short-time Fourier transform for quaternionic signals Joint work with Y. Fu and U. Kähler P. Cerejeiras Departamento de Matemática Universidade de Aveiro pceres@ua.pt New Trends and Directions in Harmonic

More information

Cuntz algebras, generalized Walsh bases and applications

Cuntz algebras, generalized Walsh bases and applications Cuntz algebras, generalized Walsh bases and applications Gabriel Picioroaga November 9, 2013 INFAS 1 / 91 Basics H, separable Hilbert space, (e n ) n N ONB in H: e n, e m = δ n,m span{e n } = H v = k=1

More information

AN INTRODUCTION TO COMPRESSIVE SENSING

AN INTRODUCTION TO COMPRESSIVE SENSING AN INTRODUCTION TO COMPRESSIVE SENSING Rodrigo B. Platte School of Mathematical and Statistical Sciences APM/EEE598 Reverse Engineering of Complex Dynamical Networks OUTLINE 1 INTRODUCTION 2 INCOHERENCE

More information

Digital Image Processing

Digital Image Processing Digital Image Processing Wavelets and Multiresolution Processing (Wavelet Transforms) Christophoros Nikou cnikou@cs.uoi.gr University of Ioannina - Department of Computer Science 2 Contents Image pyramids

More information

Lecture 6. Numerical methods. Approximation of functions

Lecture 6. Numerical methods. Approximation of functions Lecture 6 Numerical methods Approximation of functions Lecture 6 OUTLINE 1. Approximation and interpolation 2. Least-square method basis functions design matrix residual weighted least squares normal equation

More information

Math 304 (Spring 2010) - Lecture 2

Math 304 (Spring 2010) - Lecture 2 Math 304 (Spring 010) - Lecture Emre Mengi Department of Mathematics Koç University emengi@ku.edu.tr Lecture - Floating Point Operation Count p.1/10 Efficiency of an algorithm is determined by the total

More information

A matrix over a field F is a rectangular array of elements from F. The symbol

A matrix over a field F is a rectangular array of elements from F. The symbol Chapter MATRICES Matrix arithmetic A matrix over a field F is a rectangular array of elements from F The symbol M m n (F ) denotes the collection of all m n matrices over F Matrices will usually be denoted

More information

ARCS IN FINITE PROJECTIVE SPACES. Basic objects and definitions

ARCS IN FINITE PROJECTIVE SPACES. Basic objects and definitions ARCS IN FINITE PROJECTIVE SPACES SIMEON BALL Abstract. These notes are an outline of a course on arcs given at the Finite Geometry Summer School, University of Sussex, June 26-30, 2017. Let K denote an

More information

Georgia Tech PHYS 6124 Mathematical Methods of Physics I

Georgia Tech PHYS 6124 Mathematical Methods of Physics I Georgia Tech PHYS 612 Mathematical Methods of Physics I Instructor: Predrag Cvitanović Fall semester 2012 Homework Set #5 due October 2, 2012 == show all your work for maximum credit, == put labels, title,

More information

A Novel Fast Computing Method for Framelet Coefficients

A Novel Fast Computing Method for Framelet Coefficients American Journal of Applied Sciences 5 (11): 15-157, 008 ISSN 1546-939 008 Science Publications A Novel Fast Computing Method for Framelet Coefficients Hadeel N. Al-Taai Department of Electrical and Electronic

More information

Wavelets and applications

Wavelets and applications Chapter 3 Wavelets and applications 3. Multiresolution analysis 3.. The limits of Fourier analysis Although along this chapter the underlying Hilbert space will be L 2 (R), we start with a completely explicit

More information

Transformations from R m to R n.

Transformations from R m to R n. Transformations from R m to R n 1 Differentiablity First of all because of an unfortunate combination of traditions (the fact that we read from left to right and the way we define matrix multiplication

More information

MATH 205C: STATIONARY PHASE LEMMA

MATH 205C: STATIONARY PHASE LEMMA MATH 205C: STATIONARY PHASE LEMMA For ω, consider an integral of the form I(ω) = e iωf(x) u(x) dx, where u Cc (R n ) complex valued, with support in a compact set K, and f C (R n ) real valued. Thus, I(ω)

More information

A trigonometric orthogonality with respect to a nonnegative Borel measure

A trigonometric orthogonality with respect to a nonnegative Borel measure Filomat 6:4 01), 689 696 DOI 10.98/FIL104689M Published by Faculty of Sciences and Mathematics, University of Niš, Serbia Available at: http://www.pmf.ni.ac.rs/filomat A trigonometric orthogonality with

More information

1. Let m 1 and n 1 be two natural numbers such that m > n. Which of the following is/are true?

1. Let m 1 and n 1 be two natural numbers such that m > n. Which of the following is/are true? . Let m and n be two natural numbers such that m > n. Which of the following is/are true? (i) A linear system of m equations in n variables is always consistent. (ii) A linear system of n equations in

More information

Subband Coding and Wavelets. National Chiao Tung University Chun-Jen Tsai 12/04/2014

Subband Coding and Wavelets. National Chiao Tung University Chun-Jen Tsai 12/04/2014 Subband Coding and Wavelets National Chiao Tung Universit Chun-Jen Tsai /4/4 Concept of Subband Coding In transform coding, we use N (or N N) samples as the data transform unit Transform coefficients are

More information

Graph Signal Processing

Graph Signal Processing Graph Signal Processing Rahul Singh Data Science Reading Group Iowa State University March, 07 Outline Graph Signal Processing Background Graph Signal Processing Frameworks Laplacian Based Discrete Signal

More information

The Closed Form Reproducing Polynomial Particle Shape Functions for Meshfree Particle Methods

The Closed Form Reproducing Polynomial Particle Shape Functions for Meshfree Particle Methods The Closed Form Reproducing Polynomial Particle Shape Functions for Meshfree Particle Methods by Hae-Soo Oh Department of Mathematics, University of North Carolina at Charlotte, Charlotte, NC 28223 June

More information

Sparse linear models

Sparse linear models Sparse linear models Optimization-Based Data Analysis http://www.cims.nyu.edu/~cfgranda/pages/obda_spring16 Carlos Fernandez-Granda 2/22/2016 Introduction Linear transforms Frequency representation Short-time

More information

Wavelets and multiresolution representations. Time meets frequency

Wavelets and multiresolution representations. Time meets frequency Wavelets and multiresolution representations Time meets frequency Time-Frequency resolution Depends on the time-frequency spread of the wavelet atoms Assuming that ψ is centred in t=0 Signal domain + t

More information

MLISP: Machine Learning in Signal Processing Spring Lecture 10 May 11

MLISP: Machine Learning in Signal Processing Spring Lecture 10 May 11 MLISP: Machine Learning in Signal Processing Spring 2018 Lecture 10 May 11 Prof. Venia Morgenshtern Scribe: Mohamed Elshawi Illustrations: The elements of statistical learning, Hastie, Tibshirani, Friedman

More information

EXPOSITORY NOTES ON DISTRIBUTION THEORY, FALL 2018

EXPOSITORY NOTES ON DISTRIBUTION THEORY, FALL 2018 EXPOSITORY NOTES ON DISTRIBUTION THEORY, FALL 2018 While these notes are under construction, I expect there will be many typos. The main reference for this is volume 1 of Hörmander, The analysis of liner

More information

Compactly Supported Wavelets Based on Almost Interpolating and Nearly Linear Phase Filters (Coiflets)

Compactly Supported Wavelets Based on Almost Interpolating and Nearly Linear Phase Filters (Coiflets) Applied and Computational Harmonic Analysis 7, 184 210 (1999) Article ID acha.1998.0266, available online at http://www.idealibrary.com on Compactly Supported Wavelets Based on Almost Interpolating and

More information

be the set of complex valued 2π-periodic functions f on R such that

be the set of complex valued 2π-periodic functions f on R such that . Fourier series. Definition.. Given a real number P, we say a complex valued function f on R is P -periodic if f(x + P ) f(x) for all x R. We let be the set of complex valued -periodic functions f on

More information

POINT VALUES AND NORMALIZATION OF TWO-DIRECTION MULTIWAVELETS AND THEIR DERIVATIVES

POINT VALUES AND NORMALIZATION OF TWO-DIRECTION MULTIWAVELETS AND THEIR DERIVATIVES November 1, 1 POINT VALUES AND NORMALIZATION OF TWO-DIRECTION MULTIWAVELETS AND THEIR DERIVATIVES FRITZ KEINERT AND SOON-GEOL KWON,1 Abstract Two-direction multiscaling functions φ and two-direction multiwavelets

More information

Construction of Multivariate Compactly Supported Tight Wavelet Frames

Construction of Multivariate Compactly Supported Tight Wavelet Frames Construction of Multivariate Compactly Supported Tight Wavelet Frames Ming-Jun Lai and Joachim Stöckler April 5, 2006 Abstract Two simple constructive methods are presented to compute compactly supported

More information

An Introduction to Wavelets and some Applications

An Introduction to Wavelets and some Applications An Introduction to Wavelets and some Applications Milan, May 2003 Anestis Antoniadis Laboratoire IMAG-LMC University Joseph Fourier Grenoble, France An Introduction to Wavelets and some Applications p.1/54

More information

Conformal maps. Lent 2019 COMPLEX METHODS G. Taylor. A star means optional and not necessarily harder.

Conformal maps. Lent 2019 COMPLEX METHODS G. Taylor. A star means optional and not necessarily harder. Lent 29 COMPLEX METHODS G. Taylor A star means optional and not necessarily harder. Conformal maps. (i) Let f(z) = az + b, with ad bc. Where in C is f conformal? cz + d (ii) Let f(z) = z +. What are the

More information

Assignment #10: Diagonalization of Symmetric Matrices, Quadratic Forms, Optimization, Singular Value Decomposition. Name:

Assignment #10: Diagonalization of Symmetric Matrices, Quadratic Forms, Optimization, Singular Value Decomposition. Name: Assignment #10: Diagonalization of Symmetric Matrices, Quadratic Forms, Optimization, Singular Value Decomposition Due date: Friday, May 4, 2018 (1:35pm) Name: Section Number Assignment #10: Diagonalization

More information

Basic Postulates of Quantum Mechanics

Basic Postulates of Quantum Mechanics Chapter 3 Basic Postulates of Quantum Mechanics 3. Basic Postulates of Quantum Mechanics We have introduced two concepts: (i the state of a particle or a quantum mechanical system is described by a wave

More information

Orthogonality of hat functions in Sobolev spaces

Orthogonality of hat functions in Sobolev spaces 1 Orthogonality of hat functions in Sobolev spaces Ulrich Reif Technische Universität Darmstadt A Strobl, September 18, 27 2 3 Outline: Recap: quasi interpolation Recap: orthogonality of uniform B-splines

More information

Linear Algebra Practice Problems

Linear Algebra Practice Problems Linear Algebra Practice Problems Page of 7 Linear Algebra Practice Problems These problems cover Chapters 4, 5, 6, and 7 of Elementary Linear Algebra, 6th ed, by Ron Larson and David Falvo (ISBN-3 = 978--68-78376-2,

More information

Digital Image Processing

Digital Image Processing Digital Image Processing, 2nd ed. Digital Image Processing Chapter 7 Wavelets and Multiresolution Processing Dr. Kai Shuang Department of Electronic Engineering China University of Petroleum shuangkai@cup.edu.cn

More information

Generalized pointwise Hölder spaces

Generalized pointwise Hölder spaces Generalized pointwise Hölder spaces D. Kreit & S. Nicolay Nord-Pas de Calais/Belgium congress of Mathematics October 28 31 2013 The idea A function f L loc (Rd ) belongs to Λ s (x 0 ) if there exists a

More information

ABSTRACT. Title: Wavelet-space solution of the Poisson equation: An algorithm for use in particle-incell simulations

ABSTRACT. Title: Wavelet-space solution of the Poisson equation: An algorithm for use in particle-incell simulations ABSTRACT Name: Benjamin Sprague Department: Physics Title: Wavelet-space solution of the Poisson equation: An algorithm for use in particle-incell simulations Major: Physics Degree: Master of Science Approved

More information

Module 4 MULTI- RESOLUTION ANALYSIS. Version 2 ECE IIT, Kharagpur

Module 4 MULTI- RESOLUTION ANALYSIS. Version 2 ECE IIT, Kharagpur Module 4 MULTI- RESOLUTION ANALYSIS Lesson Theory of Wavelets Instructional Objectives At the end of this lesson, the students should be able to:. Explain the space-frequency localization problem in sinusoidal

More information

20. Gaussian Measures

20. Gaussian Measures Tutorial 20: Gaussian Measures 1 20. Gaussian Measures M n (R) isthesetofalln n-matrices with real entries, n 1. Definition 141 AmatrixM M n (R) is said to be symmetric, if and only if M = M t. M is orthogonal,

More information

Free Probability Theory and Non-crossing Partitions. Roland Speicher Queen s University Kingston, Canada

Free Probability Theory and Non-crossing Partitions. Roland Speicher Queen s University Kingston, Canada Free Probability Theory and Non-crossing Partitions Roland Speicher Queen s University Kingston, Canada Freeness Definition [Voiculescu 1985]: Let (A, ϕ) be a non-commutative probability space, i.e. A

More information