Wavelets and differential operators: from fractals to Marr!s primal sketch
|
|
- Melina Kelly
- 5 years ago
- Views:
Transcription
1 Wavelets and differential operators: from fractals to Marrs primal sketch Michael Unser Biomedical Imaging Group EPFL, Lausanne, Switzerland Joint work with Pouya Tafti and Dimitri Van De Ville Plenary talk, SMAI 2009, La Colle sur Loup, Mai, 2009 The quest for invariance Invariance to coordinate transformations Primary transformations (X): translation (T), scaling (S), rotation (R), affine (similarity) (A=S+R) A continuous-domain operator L is X-invariant iff. it commutes with X; i.e, f L 2 (R d ), XLf = C X LXf C X : normalization constant All classical physical laws are TSR-invariant Classical signal/image processing operators are invariant (to various extents) Filters (linear or non-linear): T-invariant Differentiators, wavelet transform: TS-invariant Contour/ridge detectors (Gradient, Laplacian, Hessian): TSR-invariant Steerable filters: TR-invariant 2
2 Invariant signals Natural signals/images often exhibit some degree of invariance (at least locally, if not globally) Stationarity, texture: T-invariance Isotropy (no preferred orientation): R-invariance Self-similarity, fractality: S-invariance (Pentland 1984; Mumford, 2001) 3 OUTLINE Splines and T-invariant operators Green functions as elementary building blocks Existence of a local B-spline basis Link with stochastic processes Imposing affine (TSR) invariance Fractional Laplace operator & polyharmonic splines Fractal processes Laplacian-like, quasi-isotropic wavelets Polyharmonic spline wavelet bases Analysis of fractal processes The Marr wavelet Complex Laplace/gradient operator Steerable complex wavelets Wavelet primal sketch Directional wavelet analysis 4
3 General concept of an L-spline L{ }: differential operator (translation-invariant) δ(x) = d i=1 δ(x i): multidimensional Dirac distribution Definition The continuous-domain function s(x) is a cardinal L-spline iff. L{s}(x) = k Z d a[k]δ(x k) Cardinality: the knots (or spline singularities) are on the (multi-)integers Generalization: includes polynomial splines as particular case (L = dn dx N ) 5 Example: piecewise-constant splines Spline-defining operators Continuous-domain derivative: D = d dx jω Discrete derivative: + { } 1 e jω Piecewise-constant or D-spline s(x) = k Z s[k]β 0 +(x k) D{s}(x) = k Z + s(k) {}}{ a[k] δ(x k) B-spline function β 0 +(x) = + D 1 {δ}(x) 1 e jω jω 6
4 Splines and Greens functions Definition ρ(x) is a Green function of the shift-invariant operator L iff L{ρ} = δ ρ(x) L{ } δ(x) δ(x) L 1 { } ρ(x) (+ null-space component?) Cardinal L-spline: L{s}(x) = k Z d a[k]δ(x k) Formal integration a[k]δ(x k) k Z d L 1 { } s(x) = k Z d a[k]ρ(x k) V L = span {ρ(x k)} k Z d 7 Example of spline synthesis δ(x) L= d dx =D L 1 : integrator L 1 { } ρ(x) δ(x x 0 ) Translation invariance L 1 { } Green function = Impulse response ρ(x x 0 ) a[k]δ(x k) k Z Linearity L 1 { } s(x) = k Z a[k]ρ(x k) 8
5 Existence of a local, shift-invariant basis? Space of cardinal L-splines V L = s(x) : L{s}(x) = a[k]δ(x k) L 2(R d ) k Z d Generalized B-spline representation A localized function ϕ(x) V L is called generalized B-spline if it generates a Riesz basis of V L ; i.e., iff. there exists (A > 0, B < ) s.t. A c l2 (Z d ) k Z c[k]ϕ(x k) B c d L2 (R d l 2 (Z ) d ) V L = s(x) = c[k]ϕ(x k) : x R d, c l 2 (Z d ) k Z d continuous-domain signal discrete signal (B-spline coefficients) 9 Link with stochastic processes Splines are in direct correspondence with stochastic processes (stationary or fractals) that are solution of the same partial differential equation, but with a random driving term. Defining operator equation: L{s( )}(x) = r(x) Specific driving terms r(x) =δ(x) s(x) =L 1 {δ}(x) : Green function r(x) = k Z d a[k]δ(x k) s(x) : Cardinal L-spline r(x): white Gaussian noise s(x): generalized stochastic process non-empty null space of L, boundary conditions References: stationary proc. (U.-Blu, IEEE-SP 2006), fractals (Blu-U., IEEE-SP 2007) 10
6 Example: Brownian motion vs. spline synthesis L= d dx white noise or stream of Diracs L 1 : integrator L 1 { } Brownian motion Cardinal spline (Schoenberg, 1946) 11 IMPOSING SCALE INVARIANCE Affine-invariant operators Polyharmonic splines Associated fractal random fields: fbms 12
7 Scale- and rotation-invariant operators Definition: An operator L is affine-invariant (or SR-invariant) iff. s(x), L{s( )}(Rθ x/a) = Ca L{s(Rθ /a)}(x) where Rθ is an arbitrary d d unitary matrix and Ca a constant Invariance theorem The complete family of real, scale- and rotation-invariant convolution operators is given by the fractional Laplacians F γ ( ) 2 $ω$γ Invariant Green functions (a.k.a. RBF) ρ(x) = (Duchon, 1979) xγ d log x, if γ d is even xγ d, otherwise 14
8 Polyharmonic splines Spline functions associated with fractional Laplace operator ( ) γ/2 Distributional definition [Madych-Nelson, 1990] s(x) is a cardinal polyharmonic spline of order γ iff. ( ) γ/2 s(x) = k Z 2 d[k]δ(x k) Explicit Shannon-like characterization { V 0 = s(x) = } s[k]φ γ (x k) k Z 2 φ γ (x): Unique polyharmonic spline interpolator s.t. φ γ (k) = δ k F ˆφγ (ω) = k Z d \{0} ( ) γ ω ω+2πk 15 Construction of polyharmonic B-splines Laplacian operator: Discrete Laplacian: d F ω 2 F d 4 sin 2 (ω i /2) = 2 sin(ω/2) 2 i= Polyharmonic B-splines (Rabut, 1992) Discrete operator: localization filter Q(e jω ) 2 sin(ω/2) γ ω γ 1 F β γ (x) Continuous-domain operator: ˆL(ω) 16
9 Polyharmonic B-splines properties Stable representation of polyharmonic splines (Riesz basis) V Condition: γ > d γ = ( 2 ) 2 s(x) = c[k]β γ (x k) :c[k] l 2 (Z d ) k Z d Two-scale relation: β γ (x/2) = k Z d h γ [k]βγ(x k) Order of approximation γ (possibly fractional) Reproduction of polynomials The polyharmonic B-splines {ϕ γ (x k)} k Z d reproduce the polynomials of degree n = γ 1. In particular, ϕ γ (x k) = 1 (partition of unity) k Z d (Rabut, 1992; Van De Ville, 2005) 17 Associated random field: multi-d fbm Formalism: Gelfands theory of generalized stochastic processes White noise fractional Brownian field ( ) γ 2 fractional integrator (appropriate boundary conditions) ( ) γ 2 Whitening (fractional Laplacian) Hurst exponent: H = γ d 2 (Tafti et al., IEEE-IP 2009) 18
10 LAPLACIAN-LIKE WAVELET BASES Operator-like wavelet design Fractional Laplacian-like wavelet basis Improving shift-invariance and isotropy Wavelet analysis of fractal processes (multidimensional generalization of pioneering work of Flandrin and Abry) 19 Multiresolution analysis of L2(R d ) s V (0) ( ) Multiresolution basis functions: ϕ i,k (x) = 2 id/2 x 2 ϕ i k 2 i Subspace at resolution i: V (i) = span {ϕ i,k } k Z d s 1 V (1) s 2 V (2) s 3 V (3) Two-scale relation V (i) V (j), for i j Partition of unity i Z V (i) = L 2 (R d ) 20
11 General operator-like wavelet design Search for a single wavelet that generates a basis of L 2 (R d ) and that is a multi-scale version of the operator L; i.e., ψ = L φ where φ is a suitable smoothing kernel General operator-based construction Basic space V 0 generated by the integer shifts of the Green function ρ of L: V 0 = span{ρ(x k)} k Z d with Lρ = δ Orthogonality between V 0 and W 0 = span{ψ(x 1 2 k)} k Z d \2Z d ψ( x 0 ), ρ( k) = φ, Lρ( k + x 0 ) = φ, δ( k + x 0 ) = φ(k x 0 ) = 0 (can be enforced via a judicious choice of φ (interpolator) and x 0 ) Works in arbitrary dimensions and for any dilation matrix D 21 Fractional Laplacian-like wavelet basis ψ γ (x) = ( ) γ 2 φ2γ (Dx) φ 2γ (x): polyharmonic spline interpolator of order 2γ > 1 D: admissible dilation matrix ( Wavelet basis functions: ψ (i,k) (x) det(d) i/2 ψ γ D i x D 1 k ) {ψ (i,k) } (i Z, k Z2 \DZ 2 ) forms a semi-orthogonal basis of L 2 (R 2 ) f L 2 (R 2 ), f = f, ψ (i,k) ψ (i,k) = f, ψ (i,k) ψ (i,k) i Z k Z 2 \DZ 2 i Z k Z 2 \DZ 2 where { ψ (i,k) } is the dual wavelet basis of {ψ (i,k) } The wavelets ψ (i,k) and ψ (i,k) have γ vanishing moments The wavelet analysis implements a multiscale version of the Laplace operator and is perfectly reversible (one-to-one transform) The wavelet transform has a fast filterbank algorithm (based on FFT) [Van De Ville, IEEE-IP, 2005] 22
12 Laplacian-like wavelet decomposition Nonredundant transform f(x) d i [k] = f,ψ (i,k) dyadic sampling pattern D = [ ] first decomposition level (one-to-one) β γ (D 1 x k) scaling functions (dilated by 2) ψ γ (D 1 x k) wavelets (dilated by 2) 23 Improving shift-invariance and isotropy Wavelet subspace at resolution i Wavelet sampling patterns W i = span {ψ i,k } (k Z 2 \DZ 2 ) Non-redundant (basis) Augmented wavelet subspace at resolution i W + i = span { ψ (i,k) }(k Z 2 ) = span{ψ iso,(i,k)} (k Z2 ) Mildly redundant (frame) Admissible polyharmonic spline wavelets Operator-like generator: ψ γ (x) = ( ) γ/2 φ 2γ (Dx) More isotropic wavelet: ψ iso (x) = ( ) γ/2 β 2γ (Dx) Quasi-isotropic polyharmonic B-spline [Van De Ville, 2005] β 2γ (x) C γ exp( x 2 /(γ/6)) 24
13 Building Mexican-Hat-like wavelets ψ γ (x) = ( ) γ/2 φ 2γ (2x) ψ iso (x) = ( ) γ/2 β 2γ (2x) Gaussian-like smoothing kernel: β 2γ (2x) 25 Mexican-Hat multiresolution analysis Pyramid decomposition: redundancy 4/3 ψ iso (x) = ( ) γ/2 β 2γ (Dx) Dyadic sampling pattern First decomposition level: ϕ(d 1 x k) Scaling functions (U.-Van De Ville, IEEE-IP 2008) ψ(d 1 (x k)) Wavelets (redundant by 4/3) 26
14 Wavelet analysis of fbm: whitening revisited Operator-like behavior of wavelet Analysis wavelet: ψ γ =( ) γ 2 φ(x) =( ) H 2 + d 4 ψ γ (x) Reduced-order wavelet: ψ γ γ (x) = ( ) 2 φ(x) with γ = γ (H + d 2 ) > 0 Stationarizing effect of wavelet analysis Analysis of fractional Brownian field with exponent H: ( B H, ψ x0 ) H ( γ a ( ) 2 + d 4 B H, ψ γ x0 ) ( a = W, ψ x0 ) γ a Equivalent spectral noise shaping: S wave (e jω )= n Z d ˆψ γ(ω +2πn) 2 Extent of wavelet-domain whitening depends on flatness of S wave (e jω ) Whitening effect is the same at all scales up to a proportionality factor fractal exponent can be deduced from the log-log plot of the variance (Tafti et al., IEEE-IP 2009) 27 Wavelet analysis of fractional Brownian fields Theoretical scaling law : Var{w a [k]} = σ 2 0 a (2H+d) log-log plot of variance 40 H est =0.31 log 2 (Var{w log 2 w2 n[k] a}) Scale scale [n] a
15 Fractals in bioimaging: fibrous tissue DDSM: University of Florida (Digital Database for Screening Mammography) (Laine, 1993; Li et al., 1997) 29 Wavelet analysis of mammograms log-log plot of variance H est = log log 2 (Var{w 2 w2 n[k] a}) Scale scale [n] a Fractal dimension: D = 1 + d H = 2.56 with d = 2 (topological dimension) 30
16 Brain as a biofractal (Bullmore, 1994) 1mm Courtesy R. Mueller ETHZ 31 Wavelet analysis of fmri data log 2 w2 n[k] H est = scale [n] Brain: courtesy of Jan Kybic Fractal dimension: D = 1 + d H = 2.65 with d = 2 (topological dimension) 32
17 ...and some non-biomedical images... He s t = w 2 [k]" log log n a }) 2 2 (Var{w scalea[n] Scale THE MARR WAVELET Laplace/gradient operator Steerable Marr wavelets Wavelet primal sketch Directional wavelet analysis 34
18 Complex TRS-invariant operators in 2D Invariance theorem The complete family of complex, translation-, scale- and rotationinvariant 2D operators is given by the fractional complex Laplacegradient operators L γ,n =( ) γ N 2 with N N and γ N R ( + j ) N x 1 x 2 F ω γ N (jω 1 ω 2 ) N Key property: steerability L γ,n {δ}(r θ x)=e jnθ L γ,n {δ}(x) 35 Simplifying the maths: Unitary Riesz mapping Complex Laplace-gradient operator ( L γ,n =( ) γ N 2 + j ) N =( ) γ 2 R N x 1 x 2 F where R =L1 2,1 ( jω1 ω 2 ω ) Property of Riesz operator R R is shift- and scale-invariant R is rotation covariant (a.k.a. steerable) R is unitary in particular, R will map a Laplace-like wavelet basis into a complex Marr-like wavelet basis 36
19 Complex Laplace-gradient wavelet basis ψ γ(x) =( ) γ 1 2 ( + j ) φ 2γ (Dx) =Rψ γ (x) x 1 x 2 φ 2γ (x): polyharmonic spline interpolator of order 2γ > 1 D: admissible dilation matrix Wavelet basis functions: ψ (i,k) (x) =Rψ ( (i,k)(x) = det(d) i/2 ψ γ D i x D 1 k ) {ψ (i,k) } (i Z, k Z 2 \DZ 2 ) forms a complex semi-orthogonal basis of L 2 (R 2 ) f L 2 (R 2 ), f = f,ψ(i,k) ψ (i,k) = f, ψ (i,k) ψ (i,k) i Z k Z 2 \DZ 2 i Z k Z 2 \DZ 2 where { ψ (i,k) } is the dual wavelet basis of {ψ (i,k) } The wavelet analysis implements a multiscale version of the Gradient-Laplace (or Marr) operator and is perfectly reversible (one-to-one transform) The wavelet transform has a fast filterbank algorithm [Van De Ville-U., IEEE-IP, 2008] 37 Wavelet frequency responses Laplacian-like / Mexican hat Marr pyramid (steerable) ˆψ iso,i (ω) ˆψRe,i (ω) ˆψIm,i (ω) Unitary mapping (Riesz transform) γ = 4 38
20 Marr wavelet pyramid Steerable pyramid-like decomposition: redundancy ψ Re (x) = x β 2γ(2x) ψ Im (x) = y β 2γ(2x) Basic dyadic sampling cell ψ 1 ψ 0 ψ 1 ψ 2 ψ 3 ψ 2 ψ 3 ϕ( /2) ϕ( /2) Wavelet basis Overcomplete by 1/3 39 Processing in early vision - primal sketch Wavelet primal sketch [Van De Ville-U., IEEE-IP, 2008] blurring smoothing kernel φ Laplacian filtering zero-crossings and orientation segment detection and grouping Canny edge detection scheme image Marr-like wavelet pyramid Canny edge detector wavelet primal sketch 40
21 Edge detection in wavelet domain Edge map (using Canny s edge detector) Key visual information (Marr s theory of vision) Similar to Mallats representation from wavelet modulus maxima [Mallat-Zhong, 1992]... but much less redundant 41 Iterative reconstruction Reconstruction from information on edge map only Better than 30dB PSNR 31.4dB [Van De Ville-U., IEEE-IP, 2008] 42
22 Directional wavelet analysis: Fingerprint Modulus Wavenumber Modulus Orientation Orientation Wavelet-domain structure tensor γ = 2, σ = 2 43 Marr wavelet pyramid - discussion Comparison against state-of-the-art Steerable Complex Marr wavelet pyramid dual-tree pyramid Translation invariance Steerability Number of orientations 2K 6 2 Vanishing moments no yes, 1D γ Implementation filterbank/fft filterbank FFT Decomposition type tight frame frame complex frame Redundancy 8K/ /3 Localization slow decay filterbank design fast decay Analytical formulas no no yes Primal sketch - - yes Gradient/structure tensor - - yes [Simoncelli, Freeman, 1995] [Kingsbury, 2001] [Selesnick et al, 2005] 44
23 CONCLUSION Unifying operator-based paradigm Operator identification based on invariance principles (TSR) Specification of corresponding spline and wavelet families Characterization of stochastic processes (fractals) Isotropic and steerable wavelet transforms Riesz basis, analytical formulaes Mildly redundant frame extension for improved TR invariance Fractal and/or directional analyses Fast filterbank algorithm (fully reversible) Marr wavelet pyramid Multiresolution Marr-type analysis; wavelet primal sketch Reconstruction from multiscale edge map Implementation will be available very soon (Matlab) 45 References D. Van De Ville, T. Blu, M. Unser, Isotropic Polyharmonic B-Splines: Scaling Functions and Wavelets, IEEE Trans. Image Processing, vol. 14, no. 11, pp , November M. Unser, D. Van De Ville, The pairing of a wavelet basis with a mildly redundant analysis with subband regression, IEEE Trans. Image Processing, Vol. 17, no. 11, pp , November D. Van De Ville, M. Unser, Complex wavelet bases, steerability, and the Marr-like pyramid, IEEE Trans. Image Processing, Vol. 17, no. 11, pp , November P.D. Tafti, D. Van De Ville, M. Unser, Invariances, Laplacian-Like Wavelet Bases, and the Whitening of Fractal Processes, IEEE Trans. Image Processing, vol. 18, no. 4, pp , April EPFLs Biomedical Imaging Group Preprints and demos: 46
SCALE and directionality are key considerations for visual
636 IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 19, NO. 3, MARCH 2010 Wavelet Steerability and the Higher-Order Riesz Transform Michael Unser, Fellow, IEEE, and Dimitri Van De Ville, Member, IEEE Abstract
More informationGabor wavelet analysis and the fractional Hilbert transform
Gabor wavelet analysis and the fractional Hilbert transform Kunal Narayan Chaudhury and Michael Unser (presented by Dimitri Van De Ville) Biomedical Imaging Group, Ecole Polytechnique Fédérale de Lausanne
More informationMultiresolution analysis & wavelets (quick tutorial)
Multiresolution analysis & wavelets (quick tutorial) Application : image modeling André Jalobeanu Multiresolution analysis Set of closed nested subspaces of j = scale, resolution = 2 -j (dyadic wavelets)
More information2D Wavelets. Hints on advanced Concepts
2D Wavelets Hints on advanced Concepts 1 Advanced concepts Wavelet packets Laplacian pyramid Overcomplete bases Discrete wavelet frames (DWF) Algorithme à trous Discrete dyadic wavelet frames (DDWF) Overview
More informationWavelets demystified THE WAVELET TRANSFORM. Michael Unser Biomedical Imaging Group EPFL, Lausanne Switzerland. Eindhoven, June i.
Wavelets demystified Michael Unser Biomedical Imaging Group EPFL, Lausanne Switzerland Eindhoven, June 2006 THE WAVELET TRANSFORM Wavelet basis functions Dilation and translation of a single prototype
More informationOn fractals, fractional splines and wavelets
On fractals, fractional splines and wavelets Michael Unser Biomedical Imaging Group EPFL, Lausanne Switzerland WAMA, Cargèse, July 2004 Report Documentation Page Form Approved OMB No. 0704-0188 Public
More informationWE begin by briefly reviewing the fundamentals of the dual-tree transform. The transform involves a pair of
Gabor wavelet analysis and the fractional Hilbert transform Kunal Narayan Chaudhury and Michael Unser Biomedical Imaging Group, Ecole Polytechnique Fédérale de Lausanne (EPFL), Switzerland ABSTRACT We
More information1 The Continuous Wavelet Transform The continuous wavelet transform (CWT) Discretisation of the CWT... 2
Contents 1 The Continuous Wavelet Transform 1 1.1 The continuous wavelet transform (CWT)............. 1 1. Discretisation of the CWT...................... Stationary wavelet transform or redundant wavelet
More informationRepresentation: Fractional Splines, Wavelets and related Basis Function Expansions. Felix Herrmann and Jonathan Kane, ERL-MIT
Representation: Fractional Splines, Wavelets and related Basis Function Expansions Felix Herrmann and Jonathan Kane, ERL-MIT Objective: Build a representation with a regularity that is consistent with
More informationToward a Realization of Marr s Theory of Primal Sketches via Autocorrelation Wavelets: Image Representation using Multiscale Edge Information
Toward a Realization of Marr s Theory of Primal Sketches via Autocorrelation Wavelets: Image Representation using Multiscale Edge Information Naoki Saito 1 Department of Mathematics University of California,
More informationA Unified Formulation of Gaussian Versus Sparse Stochastic Processes
A Unified Formulation of Gaussian Versus Sparse Stochastic Processes Michael Unser, Pouya Tafti and Qiyu Sun EPFL, UCF Appears in IEEE Trans. on Information Theory, 2014 Presented by Liming Wang M. Unser,
More informationSymmetric Wavelet Tight Frames with Two Generators
Symmetric Wavelet Tight Frames with Two Generators Ivan W. Selesnick Electrical and Computer Engineering Polytechnic University 6 Metrotech Center, Brooklyn, NY 11201, USA tel: 718 260-3416, fax: 718 260-3906
More informationMultiscale Image Transforms
Multiscale Image Transforms Goal: Develop filter-based representations to decompose images into component parts, to extract features/structures of interest, and to attenuate noise. Motivation: extract
More informationWhich wavelet bases are the best for image denoising?
Which wavelet bases are the best for image denoising? Florian Luisier a, Thierry Blu a, Brigitte Forster b and Michael Unser a a Biomedical Imaging Group (BIG), Ecole Polytechnique Fédérale de Lausanne
More informationStochastic Models for Sparse and Piecewise-Smooth Signals
IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 59, NO. 3, MARCH 2011 989 Stochastic Models for Sparse and Piecewise-Smooth Signals Michael Unser, Fellow, IEEE, and Pouya Dehghani Tafti, Member, IEEE Abstract
More informationOn the Hilbert Transform of Wavelets
On the Hilbert Transform of Wavelets Kunal Narayan Chaudhury and Michael Unser Abstract A wavelet is a localized function having a prescribed number of vanishing moments. In this correspondence, we provide
More informationMultiresolution schemes
Multiresolution schemes Fondamenti di elaborazione del segnale multi-dimensionale Multi-dimensional signal processing Stefano Ferrari Università degli Studi di Milano stefano.ferrari@unimi.it Elaborazione
More informationMultiresolution schemes
Multiresolution schemes Fondamenti di elaborazione del segnale multi-dimensionale Stefano Ferrari Università degli Studi di Milano stefano.ferrari@unimi.it Elaborazione dei Segnali Multi-dimensionali e
More informationRKHS, Mercer s theorem, Unbounded domains, Frames and Wavelets Class 22, 2004 Tomaso Poggio and Sayan Mukherjee
RKHS, Mercer s theorem, Unbounded domains, Frames and Wavelets 9.520 Class 22, 2004 Tomaso Poggio and Sayan Mukherjee About this class Goal To introduce an alternate perspective of RKHS via integral operators
More informationInvariant Scattering Convolution Networks
Invariant Scattering Convolution Networks Joan Bruna and Stephane Mallat Submitted to PAMI, Feb. 2012 Presented by Bo Chen Other important related papers: [1] S. Mallat, A Theory for Multiresolution Signal
More informationFrames. Hongkai Xiong 熊红凯 Department of Electronic Engineering Shanghai Jiao Tong University
Frames Hongkai Xiong 熊红凯 http://ivm.sjtu.edu.cn Department of Electronic Engineering Shanghai Jiao Tong University 2/39 Frames 1 2 3 Frames and Riesz Bases Translation-Invariant Dyadic Wavelet Transform
More informationSparse stochastic processes
Sparse stochastic processes Part II: Functional characterization of sparse stochastic processes Prof. Michael Unser, LIB Ecole CIMPA, Analyse et Probabilité, Abidjan 204 oad map for theory of sparse processes
More informationSparse stochastic processes: A statistical framework for modern signal processing
Sparse stochastic processes: A statistical framework for modern signal processing Michael Unser Biomedical Imaging Group EPFL, Lausanne, Switzerland Plenary talk, Int. Conf. Syst. Sig. Im. Proc. (IWSSIP),
More informationLittlewood Paley Spline Wavelets
Proceedings of the 6th WSEAS International Conference on Wavelet Analysis & Multirate Systems, Bucharest, Romania, October 6-8, 26 5 Littlewood Paley Spline Wavelets E. SERRANO and C.E. D ATTELLIS Escuela
More informationSteerable pyramids and tight wavelet frames in L 2 (R d )
IEEE TRANSACTIONS ON IMAGE PROCESSING, IN PRESS 1 Steerable pyramids and tight wavelet frames in L 2 (R d ) Michael Unser, Fellow, IEEE, Nicolas Chenouard, Member, IEEE, and Dimitri Van De Ville, Member,
More informationAdaptive wavelet decompositions of stochastic processes and some applications
Adaptive wavelet decompositions of stochastic processes and some applications Vladas Pipiras University of North Carolina at Chapel Hill SCAM meeting, June 1, 2012 (joint work with G. Didier, P. Abry)
More informationSINGULARITY DETECTION AND PROCESSING WITH WAVELETS
SINGULARITY DETECTION AND PROCESSING WITH WAVELETS Stephane Mallat and Wen Liang Hwang Courant Institute of Mathematical Sciences New York University, New York, NY 10012 Technical Report March 1991 Abstract
More informationSpace-Frequency Atoms
Space-Frequency Atoms FREQUENCY FREQUENCY SPACE SPACE FREQUENCY FREQUENCY SPACE SPACE Figure 1: Space-frequency atoms. Windowed Fourier Transform 1 line 1 0.8 0.6 0.4 0.2 0-0.2-0.4-0.6-0.8-1 0 100 200
More informationWavelets and multiresolution representations. Time meets frequency
Wavelets and multiresolution representations Time meets frequency Time-Frequency resolution Depends on the time-frequency spread of the wavelet atoms Assuming that ψ is centred in t=0 Signal domain + t
More informationDigital Image Processing
Digital Image Processing, 2nd ed. Digital Image Processing Chapter 7 Wavelets and Multiresolution Processing Dr. Kai Shuang Department of Electronic Engineering China University of Petroleum shuangkai@cup.edu.cn
More informationMultiresolution image processing
Multiresolution image processing Laplacian pyramids Some applications of Laplacian pyramids Discrete Wavelet Transform (DWT) Wavelet theory Wavelet image compression Bernd Girod: EE368 Digital Image Processing
More informationDirectionlets. Anisotropic Multi-directional Representation of Images with Separable Filtering. Vladan Velisavljević Deutsche Telekom, Laboratories
Directionlets Anisotropic Multi-directional Representation of Images with Separable Filtering Vladan Velisavljević Deutsche Telekom, Laboratories Google Inc. Mountain View, CA October 2006 Collaborators
More information( nonlinear constraints)
Wavelet Design & Applications Basic requirements: Admissibility (single constraint) Orthogonality ( nonlinear constraints) Sparse Representation Smooth functions well approx. by Fourier High-frequency
More informationChapter 7 Wavelets and Multiresolution Processing
Chapter 7 Wavelets and Multiresolution Processing Background Multiresolution Expansions Wavelet Transforms in One Dimension Wavelet Transforms in Two Dimensions Image Pyramids Subband Coding The Haar
More informationSparse stochastic processes
BIOMEDICAL IMAGING GROUP (BIG) LABORATOIRE D IMAGERIE BIOMEDICALE EPFL LIB Bât. BM 4.127 CH 115 Lausanne Switzerland Téléphone : Fax : E-mail : Site web : + 4121 693 51 5 + 4121 693 37 1 Michael.Unser@epfl.ch
More informationSpace-Frequency Atoms
Space-Frequency Atoms FREQUENCY FREQUENCY SPACE SPACE FREQUENCY FREQUENCY SPACE SPACE Figure 1: Space-frequency atoms. Windowed Fourier Transform 1 line 1 0.8 0.6 0.4 0.2 0-0.2-0.4-0.6-0.8-1 0 100 200
More informationImage Denoising using Uniform Curvelet Transform and Complex Gaussian Scale Mixture
EE 5359 Multimedia Processing Project Report Image Denoising using Uniform Curvelet Transform and Complex Gaussian Scale Mixture By An Vo ISTRUCTOR: Dr. K. R. Rao Summer 008 Image Denoising using Uniform
More informationA Higher-Density Discrete Wavelet Transform
A Higher-Density Discrete Wavelet Transform Ivan W. Selesnick Abstract In this paper, we describe a new set of dyadic wavelet frames with three generators, ψ i (t), i =,, 3. The construction is simple,
More informationIntroduction to Wavelets and Wavelet Transforms
Introduction to Wavelets and Wavelet Transforms A Primer C. Sidney Burrus, Ramesh A. Gopinath, and Haitao Guo with additional material and programs by Jan E. Odegard and Ivan W. Selesnick Electrical and
More informationChapter 7 Wavelets and Multiresolution Processing. Subband coding Quadrature mirror filtering Pyramid image processing
Chapter 7 Wavelets and Multiresolution Processing Wavelet transform vs Fourier transform Basis functions are small waves called wavelet with different frequency and limited duration Multiresolution theory:
More informationLecture Notes 5: Multiresolution Analysis
Optimization-based data analysis Fall 2017 Lecture Notes 5: Multiresolution Analysis 1 Frames A frame is a generalization of an orthonormal basis. The inner products between the vectors in a frame and
More informationLecture 16: Multiresolution Image Analysis
Lecture 16: Multiresolution Image Analysis Harvey Rhody Chester F. Carlson Center for Imaging Science Rochester Institute of Technology rhody@cis.rit.edu November 9, 2004 Abstract Multiresolution analysis
More informationImage representation with multi-scale gradients
Image representation with multi-scale gradients Eero P Simoncelli Center for Neural Science, and Courant Institute of Mathematical Sciences New York University http://www.cns.nyu.edu/~eero Visual image
More informationAnalysis of Fractals, Image Compression and Entropy Encoding
Analysis of Fractals, Image Compression and Entropy Encoding Myung-Sin Song Southern Illinois University Edwardsville Jul 10, 2009 Joint work with Palle Jorgensen. Outline 1. Signal and Image processing,
More informationIsotropic Multiresolution Analysis: Theory and Applications
Isotropic Multiresolution Analysis: Theory and Applications Saurabh Jain Department of Mathematics University of Houston March 17th 2009 Banff International Research Station Workshop on Frames from first
More information446 SCIENCE IN CHINA (Series F) Vol. 46 introduced in refs. [6, ]. Based on this inequality, we add normalization condition, symmetric conditions and
Vol. 46 No. 6 SCIENCE IN CHINA (Series F) December 003 Construction for a class of smooth wavelet tight frames PENG Lizhong (Λ Π) & WANG Haihui (Ξ ) LMAM, School of Mathematical Sciences, Peking University,
More informationMGA Tutorial, September 08, 2004 Construction of Wavelets. Jan-Olov Strömberg
MGA Tutorial, September 08, 2004 Construction of Wavelets Jan-Olov Strömberg Department of Mathematics Royal Institute of Technology (KTH) Stockholm, Sweden Department of Numerical Analysis and Computer
More informationDigital Image Processing
Digital Image Processing Wavelets and Multiresolution Processing () Christophoros Nikou cnikou@cs.uoi.gr University of Ioannina - Department of Computer Science 2 Contents Image pyramids Subband coding
More informationLectures notes. Rheology and Fluid Dynamics
ÉC O L E P O L Y T E C H N IQ U E FÉ DÉR A L E D E L A U S A N N E Christophe Ancey Laboratoire hydraulique environnementale (LHE) École Polytechnique Fédérale de Lausanne Écublens CH-05 Lausanne Lectures
More informationSatellite image deconvolution using complex wavelet packets
Satellite image deconvolution using complex wavelet packets André Jalobeanu, Laure Blanc-Féraud, Josiane Zerubia ARIANA research group INRIA Sophia Antipolis, France CNRS / INRIA / UNSA www.inria.fr/ariana
More informationImage enhancement. Why image enhancement? Why image enhancement? Why image enhancement? Example of artifacts caused by image encoding
13 Why image enhancement? Image enhancement Example of artifacts caused by image encoding Computer Vision, Lecture 14 Michael Felsberg Computer Vision Laboratory Department of Electrical Engineering 12
More informationFrequency-Domain Design and Implementation of Overcomplete Rational-Dilation Wavelet Transforms
Frequency-Domain Design and Implementation of Overcomplete Rational-Dilation Wavelet Transforms Ivan Selesnick and Ilker Bayram Polytechnic Institute of New York University Brooklyn, New York 1 Rational-Dilation
More informationORTHONORMAL SAMPLING FUNCTIONS
ORTHONORMAL SAMPLING FUNCTIONS N. KAIBLINGER AND W. R. MADYCH Abstract. We investigate functions φ(x) whose translates {φ(x k)}, where k runs through the integer lattice Z, provide a system of orthonormal
More informationImage Gradients and Gradient Filtering Computer Vision
Image Gradients and Gradient Filtering 16-385 Computer Vision What is an image edge? Recall that an image is a 2D function f(x) edge edge How would you detect an edge? What kinds of filter would you use?
More informationVARIOUS types of wavelet transform are available for
IEEE TRANSACTIONS ON SIGNAL PROCESSING A Higher-Density Discrete Wavelet Transform Ivan W. Selesnick, Member, IEEE Abstract This paper describes a new set of dyadic wavelet frames with two generators.
More informationA Novel Fast Computing Method for Framelet Coefficients
American Journal of Applied Sciences 5 (11): 15-157, 008 ISSN 1546-939 008 Science Publications A Novel Fast Computing Method for Framelet Coefficients Hadeel N. Al-Taai Department of Electrical and Electronic
More information6.869 Advances in Computer Vision. Bill Freeman, Antonio Torralba and Phillip Isola MIT Oct. 3, 2018
6.869 Advances in Computer Vision Bill Freeman, Antonio Torralba and Phillip Isola MIT Oct. 3, 2018 1 Sampling Sampling Pixels Continuous world 3 Sampling 4 Sampling 5 Continuous image f (x, y) Sampling
More informationSparse Multidimensional Representation using Shearlets
Sparse Multidimensional Representation using Shearlets Demetrio Labate a, Wang-Q Lim b, Gitta Kutyniok c and Guido Weiss b, a Department of Mathematics, North Carolina State University, Campus Box 8205,
More informationWavelet Footprints: Theory, Algorithms, and Applications
1306 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 51, NO. 5, MAY 2003 Wavelet Footprints: Theory, Algorithms, and Applications Pier Luigi Dragotti, Member, IEEE, and Martin Vetterli, Fellow, IEEE Abstract
More informationWavelet Bi-frames with Uniform Symmetry for Curve Multiresolution Processing
Wavelet Bi-frames with Uniform Symmetry for Curve Multiresolution Processing Qingtang Jiang Abstract This paper is about the construction of univariate wavelet bi-frames with each framelet being symmetric.
More informationConstruction of Orthonormal Quasi-Shearlets based on quincunx dilation subsampling
Construction of Orthonormal Quasi-Shearlets based on quincunx dilation subsampling Rujie Yin Department of Mathematics Duke University USA Email: rujie.yin@duke.edu arxiv:1602.04882v1 [math.fa] 16 Feb
More informationMultiresolution Analysis
Multiresolution Analysis DS-GA 1013 / MATH-GA 2824 Optimization-based Data Analysis http://www.cims.nyu.edu/~cfgranda/pages/obda_fall17/index.html Carlos Fernandez-Granda Frames Short-time Fourier transform
More informationIntroduction to Linear Image Processing
Introduction to Linear Image Processing 1 IPAM - UCLA July 22, 2013 Iasonas Kokkinos Center for Visual Computing Ecole Centrale Paris / INRIA Saclay Image Sciences in a nutshell 2 Image Processing Image
More informationApproximation by Conditionally Positive Definite Functions with Finitely Many Centers
Approximation by Conditionally Positive Definite Functions with Finitely Many Centers Jungho Yoon Abstract. The theory of interpolation by using conditionally positive definite function provides optimal
More informationChapter Introduction
Chapter 4 4.1. Introduction Time series analysis approach for analyzing and understanding real world problems such as climatic and financial data is quite popular in the scientific world (Addison (2002),
More informationEdge Detection. CS 650: Computer Vision
CS 650: Computer Vision Edges and Gradients Edge: local indication of an object transition Edge detection: local operators that find edges (usually involves convolution) Local intensity transitions are
More informationMachine vision. Summary # 4. The mask for Laplacian is given
1 Machine vision Summary # 4 The mask for Laplacian is given L = 0 1 0 1 4 1 (6) 0 1 0 Another Laplacian mask that gives more importance to the center element is L = 1 1 1 1 8 1 (7) 1 1 1 Note that the
More informationarxiv: v1 [cs.cv] 10 Feb 2016
GABOR WAVELETS IN IMAGE PROCESSING David Bařina Doctoral Degree Programme (2), FIT BUT E-mail: xbarin2@stud.fit.vutbr.cz Supervised by: Pavel Zemčík E-mail: zemcik@fit.vutbr.cz arxiv:162.338v1 [cs.cv]
More informationB. Vedel Joint work with P.Abry (ENS Lyon), S.Roux (ENS Lyon), M. Clausel LJK, Grenoble),
Hyperbolic wavelet analysis of textures : global regularity and multifractal formalism B. Vedel Joint work with P.Abry (ENS Lyon), S.Roux (ENS Lyon), M. Clausel LJK, Grenoble), S.Jaffard(Créteil) Harmonic
More information1 Introduction to Wavelet Analysis
Jim Lambers ENERGY 281 Spring Quarter 2007-08 Lecture 9 Notes 1 Introduction to Wavelet Analysis Wavelets were developed in the 80 s and 90 s as an alternative to Fourier analysis of signals. Some of the
More information3-D Directional Filter Banks and Surfacelets INVITED
-D Directional Filter Bans and Surfacelets INVITED Yue Lu and Minh N. Do Department of Electrical and Computer Engineering Coordinated Science Laboratory University of Illinois at Urbana-Champaign, Urbana
More informationKernel B Splines and Interpolation
Kernel B Splines and Interpolation M. Bozzini, L. Lenarduzzi and R. Schaback February 6, 5 Abstract This paper applies divided differences to conditionally positive definite kernels in order to generate
More informationFinite-dimensional spaces. C n is the space of n-tuples x = (x 1,..., x n ) of complex numbers. It is a Hilbert space with the inner product
Chapter 4 Hilbert Spaces 4.1 Inner Product Spaces Inner Product Space. A complex vector space E is called an inner product space (or a pre-hilbert space, or a unitary space) if there is a mapping (, )
More informationCOMPLEX WAVELET TRANSFORM IN SIGNAL AND IMAGE ANALYSIS
COMPLEX WAVELET TRANSFORM IN SIGNAL AND IMAGE ANALYSIS MUSOKO VICTOR, PROCHÁZKA ALEŠ Institute of Chemical Technology, Department of Computing and Control Engineering Technická 905, 66 8 Prague 6, Cech
More informationThe Application of Legendre Multiwavelet Functions in Image Compression
Journal of Modern Applied Statistical Methods Volume 5 Issue 2 Article 3 --206 The Application of Legendre Multiwavelet Functions in Image Compression Elham Hashemizadeh Department of Mathematics, Karaj
More informationUNIVERSITY OF WISCONSIN-MADISON CENTER FOR THE MATHEMATICAL SCIENCES. Tight compactly supported wavelet frames of arbitrarily high smoothness
UNIVERSITY OF WISCONSIN-MADISON CENTER FOR THE MATHEMATICAL SCIENCES Tight compactly supported wavelet frames of arbitrarily high smoothness Karlheinz Gröchenig Amos Ron Department of Mathematics U-9 University
More informationMachine vision, spring 2018 Summary 4
Machine vision Summary # 4 The mask for Laplacian is given L = 4 (6) Another Laplacian mask that gives more importance to the center element is given by L = 8 (7) Note that the sum of the elements in the
More informationExponential-spline-based Features for Ultrasound Signal Characterization
1 / 29 Exponential-spline-based Features for Ultrasound Signal Characterization Simona Maggio Department of Electronics, Computer Science and Systems (DEIS) University of Bologna Scuola di Dottorato: Scienze
More informationComputational Harmonic Analysis (Wavelet Tutorial) Part II
Computational Harmonic Analysis (Wavelet Tutorial) Part II Understanding Many Particle Systems with Machine Learning Tutorials Matthew Hirn Michigan State University Department of Computational Mathematics,
More informationOptimized Compact-support Interpolation Kernels
Optimized Compact-support Interpolation Kernels Ramtin Madani, Student Member, IEEE, Ali Ayremlou, Student Member, IEEE, Arash Amini, Farrokh Marvasti, Senior Member, IEEE, Abstract In this paper, we investigate
More informationRoadmap. Introduction to image analysis (computer vision) Theory of edge detection. Applications
Edge Detection Roadmap Introduction to image analysis (computer vision) Its connection with psychology and neuroscience Why is image analysis difficult? Theory of edge detection Gradient operator Advanced
More informationMATH 590: Meshfree Methods
MATH 590: Meshfree Methods Chapter 14: The Power Function and Native Space Error Estimates Greg Fasshauer Department of Applied Mathematics Illinois Institute of Technology Fall 2010 fasshauer@iit.edu
More informationMATH 590: Meshfree Methods
MATH 590: Meshfree Methods Chapter 34: Improving the Condition Number of the Interpolation Matrix Greg Fasshauer Department of Applied Mathematics Illinois Institute of Technology Fall 2010 fasshauer@iit.edu
More informationHarmonic Analysis: from Fourier to Haar. María Cristina Pereyra Lesley A. Ward
Harmonic Analysis: from Fourier to Haar María Cristina Pereyra Lesley A. Ward Department of Mathematics and Statistics, MSC03 2150, 1 University of New Mexico, Albuquerque, NM 87131-0001, USA E-mail address:
More information1. Fourier Transform (Continuous time) A finite energy signal is a signal f(t) for which. f(t) 2 dt < Scalar product: f(t)g(t)dt
1. Fourier Transform (Continuous time) 1.1. Signals with finite energy A finite energy signal is a signal f(t) for which Scalar product: f(t) 2 dt < f(t), g(t) = 1 2π f(t)g(t)dt The Hilbert space of all
More informationFiltering and Edge Detection
Filtering and Edge Detection Local Neighborhoods Hard to tell anything from a single pixel Example: you see a reddish pixel. Is this the object s color? Illumination? Noise? The next step in order of complexity
More informationThe Analog Formulation of Sparsity Implies Infinite Divisibility and Rules Out Bernoulli-Gaussian Priors
The Analog Formulation of Sparsity Implies Infinite Divisibility and ules Out Bernoulli-Gaussian Priors Arash Amini, Ulugbek S. Kamilov, and Michael Unser Biomedical Imaging Group BIG) École polytechnique
More informationSimulation of stationary fractional Ornstein-Uhlenbeck process and application to turbulence
Simulation of stationary fractional Ornstein-Uhlenbeck process and application to turbulence Georg Schoechtel TU Darmstadt, IRTG 1529 Japanese-German International Workshop on Mathematical Fluid Dynamics,
More informationA Tutorial on Wavelets and their Applications. Martin J. Mohlenkamp
A Tutorial on Wavelets and their Applications Martin J. Mohlenkamp University of Colorado at Boulder Department of Applied Mathematics mjm@colorado.edu This tutorial is designed for people with little
More informationVector extension of monogenic wavelets for geometric representation of color images
Vector extension of monogenic wavelets for geometric representation of color images Raphaël Soulard, Philippe Carré, Christine Fernandez-Maloigne To cite this version: Raphaël Soulard, Philippe Carré,
More informationWavelets and Multiresolution Processing
Wavelets and Multiresolution Processing Wavelets Fourier transform has it basis functions in sinusoids Wavelets based on small waves of varying frequency and limited duration In addition to frequency,
More informationAn Investigation of 3D Dual-Tree Wavelet Transform for Video Coding
MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com An Investigation of 3D Dual-Tree Wavelet Transform for Video Coding Beibei Wang, Yao Wang, Ivan Selesnick and Anthony Vetro TR2004-132 December
More informationTwo-Dimensional Orthogonal Filter Banks with Directional Vanishing Moments
Two-imensional Orthogonal Filter Banks with irectional Vanishing Moments Jianping Zhou and Minh N. o epartment of Electrical and Computer Engineering University of Illinois at Urbana-Champaign, Urbana,
More informationWavelets Marialuce Graziadei
Wavelets Marialuce Graziadei 1. A brief summary 2. Vanishing moments 3. 2D-wavelets 4. Compression 5. De-noising 1 1. A brief summary φ(t): scaling function. For φ the 2-scale relation hold φ(t) = p k
More informationIndex. p, lip, 78 8 function, 107 v, 7-8 w, 7-8 i,7-8 sine, 43 Bo,94-96
p, lip, 78 8 function, 107 v, 7-8 w, 7-8 i,7-8 sine, 43 Bo,94-96 B 1,94-96 M,94-96 B oro!' 94-96 BIro!' 94-96 I/r, 79 2D linear system, 56 2D FFT, 119 2D Fourier transform, 1, 12, 18,91 2D sinc, 107, 112
More informationSparsity Measure and the Detection of Significant Data
Sparsity Measure and the Detection of Significant Data Abdourrahmane Atto, Dominique Pastor, Grégoire Mercier To cite this version: Abdourrahmane Atto, Dominique Pastor, Grégoire Mercier. Sparsity Measure
More informationMultiscale Geometric Analysis: Thoughts and Applications (a summary)
Multiscale Geometric Analysis: Thoughts and Applications (a summary) Anestis Antoniadis, University Joseph Fourier Assimage 2005,Chamrousse, February 2005 Classical Multiscale Analysis Wavelets: Enormous
More informationWe have to prove now that (3.38) defines an orthonormal wavelet. It belongs to W 0 by Lemma and (3.55) with j = 1. We can write any f W 1 as
88 CHAPTER 3. WAVELETS AND APPLICATIONS We have to prove now that (3.38) defines an orthonormal wavelet. It belongs to W 0 by Lemma 3..7 and (3.55) with j =. We can write any f W as (3.58) f(ξ) = p(2ξ)ν(2ξ)
More informationEEE4001F EXAM DIGITAL SIGNAL PROCESSING. University of Cape Town Department of Electrical Engineering PART A. June hours.
EEE400F EXAM DIGITAL SIGNAL PROCESSING PART A Basic digital signal processing theory.. A sequencex[n] has a zero-phase DTFT X(e jω ) given below: X(e jω ) University of Cape Town Department of Electrical
More informationL. Levaggi A. Tabacco WAVELETS ON THE INTERVAL AND RELATED TOPICS
Rend. Sem. Mat. Univ. Pol. Torino Vol. 57, 1999) L. Levaggi A. Tabacco WAVELETS ON THE INTERVAL AND RELATED TOPICS Abstract. We use an abstract framework to obtain a multilevel decomposition of a variety
More information