A Friendly Guide to the Frame Theory. and Its Application to Signal Processing
|
|
- Sybil Turner
- 6 years ago
- Views:
Transcription
1 A Friendly uide to the Frame Theory and Its Application to Signal Processing inh N. Do Department of Electrical and Computer Engineering University of Illinois at Urbana-Champaign minhdo
2 A Basic Problem Consider the following linear inverse problem: Ax = b placements where A R m n is fixed, b R m is given, and x R n is unknown. x b ˆb ˆx A S b Examples: Deconvolution, computerized tomography, transform coding,... Possible noise due to: model mismatch, measurement and/or transmission error, quantization, thresholding,... 1
3 Two Basic Questions placements Ax = b x b ˆb ˆx A S b We have two questions: 1. Can we reconstruct x in a numerically stable way from b? 2. Which is the optimal reconstruction algorithm in the presence of noise? 2
4 Linear Inverse Problem Ax = b: First Question Question: Can we reconstruct x in a numerically stable way from b? Answer: It depends on the condition number of A: κ(a) = σ 1(A) σ n (A). The smaller κ(a) (κ(a) 1), the more stable (or well-conditioned) the problem is. Intuition: σ 1 and σ n are the largest and smallest singular values of A. Thus, for all x: σ n x 2 Ax 2 σ 1 x 2 That means A should behavior modestly with respect to 2-norm! 3
5 Linear Inverse Problem Ax = b: Second Question Question: When the system A is overcomplete, there are many (infinite) ways to reconstruct x from b. Which one is optimal? Answer: Use the pseudo-inverse A = (A T A) 1 A T ˆx = A b Special properties of the pseudo-inverse: A provides the least-squares solution Eliminates the influence of errors orthogonal to the range of A. A has a minimum spectral norm among all left inverse of A Recovers x and but doesn t blow up the noise. 4
6 Frames: eneralize to Hilbert Spaces Consider A as a linear operator, A : R n R m, then Ax = b b i = x, a i, i = 1, 2,..., m where a T i are the rows of A. Def: A sequence {φ k } k Γ in a Hilbert space H is a frame if there exist two constants (frame bounds) α > 0 and β < such that for any x H α x 2 k Γ x, φ k 2 β x 2. Best case: α = β = tight frame Significance: {φ k } k Γ is a frame one can recover x H from { x, φ k } k Γ. 5
7 Dual Frame Frame operator: A : H l 2 (Γ) (Ax) k = x, φ k, for k Γ. Pseudo inverse: A = (A A) 1 A exists and bounded because {φ k } k Γ is a frame. Result: Reconstruction using pseudo inverse is related to a dual frame x = A Ax = k Γ x, φ k φ k where the dual frame is defined as φ k = (A A) 1 φ k. Easiest case: Tight frame (α = β), φ k = α 1 φ k. 6
8 Iterative Frame Reconstruction Algorithm Both pseudo-inverse and dual frame computations need the inversion of A A, where A Ax = k Γ x, φ k φ k Consider R = I 2 αβ A A, then because α I A A β I Thus, Iterative reconstruction: R β α β α 1. (A A) 1 = 2 α β (I R) 1 = 2 α β x n = x n 1 2 α β i=0 R i ( x, φ k x n 1, φ k )φ k k Γ 7
9 Application to eneralized Sampling Sampled data: s[k] = x, φ k, where φ k is the point spreading function (PSF) of the sensoring device at location t k. Sampling theorem : Function x(t) H can be recovered in a numerically stable way from samples s[k] if and only if {φ k } k Γ is a frame of H. Classical sampling: H = BL([ π, π]) and {φ k } = {sinc(t k)} k Z 8
10 Laplacian Pyramid: Burt Adelson,
11 Why Laplacian Pyramid Instead of Orthogonal Filter Banks? (2,2) Wavelet FB Laplacian Pyramid (2,2) (2,2) (2,2) (2,2) Even in higher dimensions, the Laplacian pyramid (LP) only generates one isometric detailed signal at each level. highpass (HP) LP has no frequency scrambling due to downsamplingpsfrag of thereplacements highpass channel: π downsampled HP π π π 10
12 eplacements Decomposition in the Laplacian Pyramid c x H p _ d H Coarse: Residual: c = Hx d = x Hx = (I H)x. Combining gives ( ) c d }{{} y = ( ) H x. I H }{{} A 11
13 Usual Reconstruction in the Laplacian Pyramid PSfrag replacements c ˆx d ˆx = ( I ) ( ) c }{{} d S 1 }{{} y Note that S 1 A = I (perfect reconstruction) for any H and. But... what about noisy pyramids: ŷ = y e? The most serious disadvantage of the LP for coding applications [Simoncelli & Adelson, 1991]:...the errors from highpass subbands of a multilevel LP do not remain in these subbands but appear as broadband noise in the reconstructed signal
14 Frame Analysis LP is a frame operator (A) with redundancy. It admits an infinite number of left inverses. Let S be an arbitrary left inverse of A, ˆx = Sŷ = S(y e) = x Se. The optimal left inverse (minimizing S ) is the pseudo-inverse of A: A = (A T A) 1 A T. If the noise is white, then among all left inverses, the pseudo-inverse minimizes the reconstruction SE. But... reconstruction using the pseudo-inverse might be computationally expensive, unless we have a tight frame. 13
15 A Tight Frame Case Orthogonal filters: g[ ], g[ n] = δ[n], and h[n] = g[ n], or H = T. Theorem. The Laplacian pyramid with orthogonal filters is a tight frame. Proof: Under the orthogonality condition: p[n] = x[ ], g[ k] PSfrag g[n replacements k]. }{{} k Z d c[k] Using the Pythagorean theorem: x 2 = p 2 d 2 = c 2 d 2. x p d V 14
16 Inspiring New Reconstruction Filter Bank As a result, pseudo-inverse of A is simply its transpose A = A T = ( H I T ) T = ( I T ). So the optimal reconstruction is eplacements ˆx = A y = c (I T )d = (c Hd) d. c x d p H _ ˆx 15
17 eneral Cases eplacements Consider the following filter bank for reconstruction c x d p H _ ˆx Theorem. 1. It is an inverse of the LP if and only if H and are biorthogonal filters, or H is a projector. 2. It is the pseudo-inverse if and only if H is an orthogonal projector. Recall: A linear operator P is a projector if P 2 = P. Furthermore, if P = P T then P is an orthogonal projector. 16
18 H H x Comparing Two Reconstruction ethods H xc pc ˆx pd H _ ˆx d Usual reconstruction: PSfrag New reconstruction: replacements x 1 = c d x 2 = c (I H) d }{{} P W W P W ˆd ˆd ˆx 2 ˆx 1 d x p V 17
19 replacements Laplacian Pyramid as an Oversampled Filter Bank H c x K 0 d 0 F 0 ˆx K 1 d 1 F 1 d For the usual reconstruction method, synthesis filters F [1] i (delay) filters: F [1] i (z) = z k i For the proposed reconstruction method, synthesis filters F [1] i filters: F [2] i (z) = z k i (z)h i (z ). are all-pass are high-pass 18
20 ultilevel Laplacian Pyramids frag replacements 2 2 ˆx 2 2 F 0 2 F 0 F 1 2 F 1 Comparing frequency responses of equivalent synthesis filters (REC-1 vs. REC-2) agnitude agnitude Normalized Frequency ( π rad/sample) Normalized Frequency ( π rad/sample) 19
21 PSfrag replacements Experimental Results x LP dec. y e ŷ usual rec. new rec. ˆx 1 ˆx 2 With additive uniform white noise in [0, 0.1] (non-zero mean)... usual rec. SNR = 6.28 db new rec. SNR = db 20
22 Summary Frames are a powerful tool... eneralizes matrix inversions for general (possible infinite dimensional) vector spaces. eneralizes bases for overcomplete (redundant) systems. Framing pyramids lead to... New reconstruction algorithm with significant improvement over the usual method. Complete characterization of left inverses and the pseudo-inverse. Frames are everywhere... ive me a linear operator with a bounded inverse, I ll frame it! If you have to deal with an overcomplete system, consider the frame theory! 21
Multiresolution image processing
Multiresolution image processing Laplacian pyramids Some applications of Laplacian pyramids Discrete Wavelet Transform (DWT) Wavelet theory Wavelet image compression Bernd Girod: EE368 Digital Image Processing
More informationMultiscale Image Transforms
Multiscale Image Transforms Goal: Develop filter-based representations to decompose images into component parts, to extract features/structures of interest, and to attenuate noise. Motivation: extract
More informationLecture 16: Multiresolution Image Analysis
Lecture 16: Multiresolution Image Analysis Harvey Rhody Chester F. Carlson Center for Imaging Science Rochester Institute of Technology rhody@cis.rit.edu November 9, 2004 Abstract Multiresolution analysis
More informationDigital Image Processing
Digital Image Processing, 2nd ed. Digital Image Processing Chapter 7 Wavelets and Multiresolution Processing Dr. Kai Shuang Department of Electronic Engineering China University of Petroleum shuangkai@cup.edu.cn
More informationWavelets and Multiresolution Processing
Wavelets and Multiresolution Processing Wavelets Fourier transform has it basis functions in sinusoids Wavelets based on small waves of varying frequency and limited duration In addition to frequency,
More informationA Novel Fast Computing Method for Framelet Coefficients
American Journal of Applied Sciences 5 (11): 15-157, 008 ISSN 1546-939 008 Science Publications A Novel Fast Computing Method for Framelet Coefficients Hadeel N. Al-Taai Department of Electrical and Electronic
More informationCOMPLEX WAVELET TRANSFORM IN SIGNAL AND IMAGE ANALYSIS
COMPLEX WAVELET TRANSFORM IN SIGNAL AND IMAGE ANALYSIS MUSOKO VICTOR, PROCHÁZKA ALEŠ Institute of Chemical Technology, Department of Computing and Control Engineering Technická 905, 66 8 Prague 6, Cech
More informationA Higher-Density Discrete Wavelet Transform
A Higher-Density Discrete Wavelet Transform Ivan W. Selesnick Abstract In this paper, we describe a new set of dyadic wavelet frames with three generators, ψ i (t), i =,, 3. The construction is simple,
More informationDesign of Image Adaptive Wavelets for Denoising Applications
Design of Image Adaptive Wavelets for Denoising Applications Sanjeev Pragada and Jayanthi Sivaswamy Center for Visual Information Technology International Institute of Information Technology - Hyderabad,
More informationIntroduction to Compressed Sensing
Introduction to Compressed Sensing Alejandro Parada, Gonzalo Arce University of Delaware August 25, 2016 Motivation: Classical Sampling 1 Motivation: Classical Sampling Issues Some applications Radar Spectral
More information1 The Continuous Wavelet Transform The continuous wavelet transform (CWT) Discretisation of the CWT... 2
Contents 1 The Continuous Wavelet Transform 1 1.1 The continuous wavelet transform (CWT)............. 1 1. Discretisation of the CWT...................... Stationary wavelet transform or redundant wavelet
More informationContents. 0.1 Notation... 3
Contents 0.1 Notation........................................ 3 1 A Short Course on Frame Theory 4 1.1 Examples of Signal Expansions............................ 4 1.2 Signal Expansions in Finite-Dimensional
More informationNoise Reduction in Oversampled Filter Banks Using Predictive Quantization
IEEE TRANSACTIONS ON INFORMATION THEORY, VOL 47, NO 1, JANUARY 2001 155 Noise Reduction in Oversampled Filter Banks Using Predictive Quantization Helmut Bölcskei, Member, IEEE, Franz Hlawatsch, Member,
More informationFrames. Hongkai Xiong 熊红凯 Department of Electronic Engineering Shanghai Jiao Tong University
Frames Hongkai Xiong 熊红凯 http://ivm.sjtu.edu.cn Department of Electronic Engineering Shanghai Jiao Tong University 2/39 Frames 1 2 3 Frames and Riesz Bases Translation-Invariant Dyadic Wavelet Transform
More informationMULTIRATE DIGITAL SIGNAL PROCESSING
MULTIRATE DIGITAL SIGNAL PROCESSING Signal processing can be enhanced by changing sampling rate: Up-sampling before D/A conversion in order to relax requirements of analog antialiasing filter. Cf. audio
More informationWavelet Footprints: Theory, Algorithms, and Applications
1306 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 51, NO. 5, MAY 2003 Wavelet Footprints: Theory, Algorithms, and Applications Pier Luigi Dragotti, Member, IEEE, and Martin Vetterli, Fellow, IEEE Abstract
More information3-D Directional Filter Banks and Surfacelets INVITED
-D Directional Filter Bans and Surfacelets INVITED Yue Lu and Minh N. Do Department of Electrical and Computer Engineering Coordinated Science Laboratory University of Illinois at Urbana-Champaign, Urbana
More informationLecture 5 Least-squares
EE263 Autumn 2008-09 Stephen Boyd Lecture 5 Least-squares least-squares (approximate) solution of overdetermined equations projection and orthogonality principle least-squares estimation BLUE property
More informationMultiresolution analysis & wavelets (quick tutorial)
Multiresolution analysis & wavelets (quick tutorial) Application : image modeling André Jalobeanu Multiresolution analysis Set of closed nested subspaces of j = scale, resolution = 2 -j (dyadic wavelets)
More informationVARIOUS types of wavelet transform are available for
IEEE TRANSACTIONS ON SIGNAL PROCESSING A Higher-Density Discrete Wavelet Transform Ivan W. Selesnick, Member, IEEE Abstract This paper describes a new set of dyadic wavelet frames with two generators.
More informationChapter 7 Wavelets and Multiresolution Processing. Subband coding Quadrature mirror filtering Pyramid image processing
Chapter 7 Wavelets and Multiresolution Processing Wavelet transform vs Fourier transform Basis functions are small waves called wavelet with different frequency and limited duration Multiresolution theory:
More informationImage Denoising using Uniform Curvelet Transform and Complex Gaussian Scale Mixture
EE 5359 Multimedia Processing Project Report Image Denoising using Uniform Curvelet Transform and Complex Gaussian Scale Mixture By An Vo ISTRUCTOR: Dr. K. R. Rao Summer 008 Image Denoising using Uniform
More informationAn Introduction to Filterbank Frames
An Introduction to Filterbank Frames Brody Dylan Johnson St. Louis University October 19, 2010 Brody Dylan Johnson (St. Louis University) An Introduction to Filterbank Frames October 19, 2010 1 / 34 Overview
More informationc 2010 Melody I. Bonham
c 2010 Melody I. Bonham A NEAR-OPTIMAL WAVELET-BASED ESTIMATION TECHNIQUE FOR VIDEO SEQUENCES BY MELODY I. BONHAM THESIS Submitted in partial fulfillment of the requirements for the degree of Master of
More informationMultiresolution schemes
Multiresolution schemes Fondamenti di elaborazione del segnale multi-dimensionale Multi-dimensional signal processing Stefano Ferrari Università degli Studi di Milano stefano.ferrari@unimi.it Elaborazione
More informationMultiresolution schemes
Multiresolution schemes Fondamenti di elaborazione del segnale multi-dimensionale Stefano Ferrari Università degli Studi di Milano stefano.ferrari@unimi.it Elaborazione dei Segnali Multi-dimensionali e
More informationDigital Image Processing
Digital Image Processing Wavelets and Multiresolution Processing () Christophoros Nikou cnikou@cs.uoi.gr University of Ioannina - Department of Computer Science 2 Contents Image pyramids Subband coding
More informationA Mapping-Based Design for Nonsubsampled Hourglass Filter Banks in Arbitrary Dimensions
IEEE TRANSACTIONS ON SIGNAL PROCESSING A Mapping-Based Design for Nonsubsampled Hourglass Filter Banks in Arbitrary Dimensions Yue M. Lu, Member, IEEE, and Minh N. Do, Senior Member, IEEE Abstract Multidimensional
More informationLecture Notes 5: Multiresolution Analysis
Optimization-based data analysis Fall 2017 Lecture Notes 5: Multiresolution Analysis 1 Frames A frame is a generalization of an orthonormal basis. The inner products between the vectors in a frame and
More informationA Short Course on Frame Theory
A Short Course on Frame Theory Veniamin I. Morgenshtern and Helmut Bölcskei ETH Zurich, 8092 Zurich, Switzerland E-mail: {vmorgens, boelcskei}@nari.ee.ethz.ch April 2, 20 Hilbert spaces [, Def. 3.-] and
More informationMultirate signal processing
Multirate signal processing Discrete-time systems with different sampling rates at various parts of the system are called multirate systems. The need for such systems arises in many applications, including
More informationDenoising via Recursive Wavelet Thresholding. Alyson Kerry Fletcher. A thesis submitted in partial satisfaction of the requirements for the degree of
Denoising via Recursive Wavelet Thresholding by Alyson Kerry Fletcher A thesis submitted in partial satisfaction of the requirements for the degree of Master of Science in Electrical Engineering in the
More information6.869 Advances in Computer Vision. Bill Freeman, Antonio Torralba and Phillip Isola MIT Oct. 3, 2018
6.869 Advances in Computer Vision Bill Freeman, Antonio Torralba and Phillip Isola MIT Oct. 3, 2018 1 Sampling Sampling Pixels Continuous world 3 Sampling 4 Sampling 5 Continuous image f (x, y) Sampling
More informationTwo-Dimensional Orthogonal Filter Banks with Directional Vanishing Moments
Two-imensional Orthogonal Filter Banks with irectional Vanishing Moments Jianping Zhou and Minh N. o epartment of Electrical and Computer Engineering University of Illinois at Urbana-Champaign, Urbana,
More informationSparse linear models
Sparse linear models Optimization-Based Data Analysis http://www.cims.nyu.edu/~cfgranda/pages/obda_spring16 Carlos Fernandez-Granda 2/22/2016 Introduction Linear transforms Frequency representation Short-time
More informationRapid, Robust, and Reliable Blind Deconvolution via Nonconvex Optimization
Rapid, Robust, and Reliable Blind Deconvolution via Nonconvex Optimization Shuyang Ling Department of Mathematics, UC Davis Oct.18th, 2016 Shuyang Ling (UC Davis) 16w5136, Oaxaca, Mexico Oct.18th, 2016
More informationCourse and Wavelets and Filter Banks. Filter Banks (contd.): perfect reconstruction; halfband filters and possible factorizations.
Course 18.327 and 1.130 Wavelets and Filter Banks Filter Banks (contd.): perfect reconstruction; halfband filters and possible factorizations. Product Filter Example: Product filter of degree 6 P 0 (z)
More informationWavelets, Filter Banks and Multiresolution Signal Processing
Wavelets, Filter Banks and Multiresolution Signal Processing It is with logic that one proves; it is with intuition that one invents. Henri Poincaré Introduction - 1 A bit of history: from Fourier to Haar
More informationModule 4 MULTI- RESOLUTION ANALYSIS. Version 2 ECE IIT, Kharagpur
Module MULTI- RESOLUTION ANALYSIS Version ECE IIT, Kharagpur Lesson Multi-resolution Analysis: Theory of Subband Coding Version ECE IIT, Kharagpur Instructional Objectives At the end of this lesson, the
More informationAnalytic discrete cosine harmonic wavelet transform(adchwt) and its application to signal/image denoising
Analytic discrete cosine harmonic wavelet transform(adchwt) and its application to signal/image denoising M. Shivamurti and S. V. Narasimhan Digital signal processing and Systems Group Aerospace Electronic
More informationRedundant Wavelet Processing on the Half-Axis with Applications to Signal Denoising with Small Delays: Theory and Experiments
Redundant Wavelet Processing on the Half-Axis with Applications to Signal Denoising with Small Delays: Theory and Experiments François Chaplais, Panagiotis Tsiotras, Senior Member, IEEE, and Dongwon Jung
More informationIntroduction to Wavelets and Wavelet Transforms
Introduction to Wavelets and Wavelet Transforms A Primer C. Sidney Burrus, Ramesh A. Gopinath, and Haitao Guo with additional material and programs by Jan E. Odegard and Ivan W. Selesnick Electrical and
More informationObservability and state estimation
EE263 Autumn 2015 S Boyd and S Lall Observability and state estimation state estimation discrete-time observability observability controllability duality observers for noiseless case continuous-time observability
More informationDiscrete Signal Processing on Graphs: Sampling Theory
IEEE TRANS. SIGNAL PROCESS. TO APPEAR. 1 Discrete Signal Processing on Graphs: Sampling Theory Siheng Chen, Rohan Varma, Aliaksei Sandryhaila, Jelena Kovačević arxiv:153.543v [cs.it] 8 Aug 15 Abstract
More informationA NEW BASIS SELECTION PARADIGM FOR WAVELET PACKET IMAGE CODING
A NEW BASIS SELECTION PARADIGM FOR WAVELET PACKET IMAGE CODING Nasir M. Rajpoot, Roland G. Wilson, François G. Meyer, Ronald R. Coifman Corresponding Author: nasir@dcs.warwick.ac.uk ABSTRACT In this paper,
More informationFinite Frame Quantization
Finite Frame Quantization Liam Fowl University of Maryland August 21, 2018 1 / 38 Overview 1 Motivation 2 Background 3 PCM 4 First order Σ quantization 5 Higher order Σ quantization 6 Alternative Dual
More informationImage representation with multi-scale gradients
Image representation with multi-scale gradients Eero P Simoncelli Center for Neural Science, and Courant Institute of Mathematical Sciences New York University http://www.cns.nyu.edu/~eero Visual image
More informationNew Design of Orthogonal Filter Banks Using the Cayley Transform
New Design of Orthogonal Filter Banks Using the Cayley Transform Jianping Zhou, Minh N. Do and Jelena Kovačević Department of Electrical and Computer Engineering University of Illinois at Urbana-Champaign,
More informationCS 323: Numerical Analysis and Computing
CS 323: Numerical Analysis and Computing MIDTERM #1 Instructions: This is an open notes exam, i.e., you are allowed to consult any textbook, your class notes, homeworks, or any of the handouts from us.
More informationWavelet Bi-frames with Uniform Symmetry for Curve Multiresolution Processing
Wavelet Bi-frames with Uniform Symmetry for Curve Multiresolution Processing Qingtang Jiang Abstract This paper is about the construction of univariate wavelet bi-frames with each framelet being symmetric.
More informationLecture 19 Observability and state estimation
EE263 Autumn 2007-08 Stephen Boyd Lecture 19 Observability and state estimation state estimation discrete-time observability observability controllability duality observers for noiseless case continuous-time
More informationLecture 6. Regularized least-squares and minimum-norm methods 6 1
Regularized least-squares and minimum-norm methods 6 1 Lecture 6 Regularized least-squares and minimum-norm methods EE263 Autumn 2004 multi-objective least-squares regularized least-squares nonlinear least-squares
More informationThe Dual-Tree Complex Wavelet Transform A Coherent Framework for Multiscale Signal and Image Processing
The Dual-Tree Complex Wavelet Transform A Coherent Framework for Multiscale Signal and Image Processing Ivan W. Selesnick Electrical and Computer Engineering Polytechnic University 6 Metrotech Center,
More informationDenosing Using Wavelets and Projections onto the l 1 -Ball
1 Denosing Using Wavelets and Projections onto the l 1 -Ball October 6, 2014 A. Enis Cetin, M. Tofighi Dept. of Electrical and Electronic Engineering, Bilkent University, Ankara, Turkey cetin@bilkent.edu.tr,
More informationAn Investigation of 3D Dual-Tree Wavelet Transform for Video Coding
MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com An Investigation of 3D Dual-Tree Wavelet Transform for Video Coding Beibei Wang, Yao Wang, Ivan Selesnick and Anthony Vetro TR2004-132 December
More informationA BRIEF INTRODUCTION TO HILBERT SPACE FRAME THEORY AND ITS APPLICATIONS AMS SHORT COURSE: JOINT MATHEMATICS MEETINGS SAN ANTONIO, 2015 PETER G. CASAZZA Abstract. This is a short introduction to Hilbert
More informationDigital Image Processing Lectures 15 & 16
Lectures 15 & 16, Professor Department of Electrical and Computer Engineering Colorado State University CWT and Multi-Resolution Signal Analysis Wavelet transform offers multi-resolution by allowing for
More informationOverview. Optimization-Based Data Analysis. Carlos Fernandez-Granda
Overview Optimization-Based Data Analysis http://www.cims.nyu.edu/~cfgranda/pages/obda_spring16 Carlos Fernandez-Granda 1/25/2016 Sparsity Denoising Regression Inverse problems Low-rank models Matrix completion
More informationDigital Image Processing
Digital Image Processing Wavelets and Multiresolution Processing (Wavelet Transforms) Christophoros Nikou cnikou@cs.uoi.gr University of Ioannina - Department of Computer Science 2 Contents Image pyramids
More informationSparse molecular image representation
Sparse molecular image representation Sofia Karygianni a, Pascal Frossard a a Ecole Polytechnique Fédérale de Lausanne (EPFL), Signal Processing Laboratory (LTS4), CH-115, Lausanne, Switzerland Abstract
More informationEstimation Error Bounds for Frame Denoising
Estimation Error Bounds for Frame Denoising Alyson K. Fletcher and Kannan Ramchandran {alyson,kannanr}@eecs.berkeley.edu Berkeley Audio-Visual Signal Processing and Communication Systems group Department
More informationQuadrature-Mirror Filter Bank
Quadrature-Mirror Filter Bank In many applications, a discrete-time signal x[n] is split into a number of subband signals { v k [ n]} by means of an analysis filter bank The subband signals are then processed
More informationTHE SINGULAR VALUE DECOMPOSITION MARKUS GRASMAIR
THE SINGULAR VALUE DECOMPOSITION MARKUS GRASMAIR 1. Definition Existence Theorem 1. Assume that A R m n. Then there exist orthogonal matrices U R m m V R n n, values σ 1 σ 2... σ p 0 with p = min{m, n},
More informationEUSIPCO
EUSIPCO 013 1569746769 SUBSET PURSUIT FOR ANALYSIS DICTIONARY LEARNING Ye Zhang 1,, Haolong Wang 1, Tenglong Yu 1, Wenwu Wang 1 Department of Electronic and Information Engineering, Nanchang University,
More informationCambridge University Press The Mathematics of Signal Processing Steven B. Damelin and Willard Miller Excerpt More information
Introduction Consider a linear system y = Φx where Φ can be taken as an m n matrix acting on Euclidean space or more generally, a linear operator on a Hilbert space. We call the vector x a signal or input,
More informationAnalysis of Redundant-Wavelet Multihypothesis for Motion Compensation
Analysis of Redundant-Wavelet Multihypothesis for Motion Compensation James E. Fowler Department of Electrical and Computer Engineering GeoResources Institute GRI Mississippi State University, Starville,
More informationCO350 Linear Programming Chapter 8: Degeneracy and Finite Termination
CO350 Linear Programming Chapter 8: Degeneracy and Finite Termination 27th June 2005 Chapter 8: Finite Termination 1 The perturbation method Recap max c T x (P ) s.t. Ax = b x 0 Assumption: B is a feasible
More informationChapter 7 Wavelets and Multiresolution Processing
Chapter 7 Wavelets and Multiresolution Processing Background Multiresolution Expansions Wavelet Transforms in One Dimension Wavelet Transforms in Two Dimensions Image Pyramids Subband Coding The Haar
More informationFilter Bank Frame Expansions With Erasures
IEEE TRANSACTIONS ON INFORMATION THEORY, VOL 48, NO 6, JUNE 2002 1439 Filter Bank Frame Expansions With Erasures Jelena Kovačević, Fellow, IEEE, Pier Luigi Dragotti, Student Member, IEEE, and Vivek K Goyal,
More information2D Wavelets for Different Sampling Grids and the Lifting Scheme
D Wavelets for Different Sampling Grids and the Lifting Scheme Miroslav Vrankić University of Zagreb, Croatia Presented by: Atanas Gotchev Lecture Outline 1D wavelets and FWT D separable wavelets D nonseparable
More informationLinear Inverse Problems
Linear Inverse Problems Ajinkya Kadu Utrecht University, The Netherlands February 26, 2018 Outline Introduction Least-squares Reconstruction Methods Examples Summary Introduction 2 What are inverse problems?
More informationSparse signal representation and the tunable Q-factor wavelet transform
Sparse signal representation and the tunable Q-factor wavelet transform Ivan Selesnick Polytechnic Institute of New York University Brooklyn, New York Introduction Problem: Decomposition of a signal into
More informationWavelet Decomposition in Laplacian Pyramid for Image Fusion
International Journal of Signal Processing Systems Vol. 4, No., February 06 Wavelet Decomposition in Laplacian Pyramid for Image Fusion I. S. Wahyuni Laboratory Lei, University of Burgundy, Dijon, France
More informationDesigning Information Devices and Systems I Discussion 13B
EECS 6A Fall 7 Designing Information Devices and Systems I Discussion 3B. Orthogonal Matching Pursuit Lecture Orthogonal Matching Pursuit (OMP) algorithm: Inputs: A set of m songs, each of length n: S
More informationA primer on the theory of frames
A primer on the theory of frames Jordy van Velthoven Abstract This report aims to give an overview of frame theory in order to gain insight in the use of the frame framework as a unifying layer in the
More informationIEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 47, NO. 2, FEBRUARY
IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 47, NO. 2, FEBRUARY 1999 389 Oversampling PCM Techniques and Optimum Noise Shapers for Quantizing a Class of Nonbandlimited Signals Jamal Tuqan, Member, IEEE
More informationSCALABLE 3-D WAVELET VIDEO CODING
SCALABLE 3-D WAVELET VIDEO CODING ZONG WENBO School of Electrical and Electronic Engineering A thesis submitted to the Nanyang Technological University in fulfillment of the requirement for the degree
More informationSignal Analysis. Filter Banks and. One application for filter banks is to decompose the input signal into different bands or channels
Filter banks Multi dimensional Signal Analysis A common type of processing unit for discrete signals is a filter bank, where some input signal is filtered by n filters, producing n channels Channel 1 Lecture
More informationAnalysis of Fractals, Image Compression and Entropy Encoding
Analysis of Fractals, Image Compression and Entropy Encoding Myung-Sin Song Southern Illinois University Edwardsville Jul 10, 2009 Joint work with Palle Jorgensen. Outline 1. Signal and Image processing,
More informationLet x be an approximate solution for Ax = b, e.g., obtained by Gaussian elimination. Let x denote the exact solution. Call. r := b A x.
ESTIMATION OF ERROR Let x be an approximate solution for Ax = b, e.g., obtained by Gaussian elimination. Let x denote the exact solution. Call the residual for x. Then r := b A x r = b A x = Ax A x = A
More informationINTRODUCTION TO. Adapted from CS474/674 Prof. George Bebis Department of Computer Science & Engineering University of Nevada (UNR)
INTRODUCTION TO WAVELETS Adapted from CS474/674 Prof. George Bebis Department of Computer Science & Engineering University of Nevada (UNR) CRITICISM OF FOURIER SPECTRUM It gives us the spectrum of the
More informationDUAL TREE COMPLEX WAVELETS
DUAL TREE COMPLEX WAVELETS Signal Processing Group, Dept. of Engineering University of Cambridge, Cambridge CB2 1PZ, UK. ngk@eng.cam.ac.uk www.eng.cam.ac.uk/~ngk September 24 UNIVERSITY OF CAMBRIDGE Dual
More informationA new class of morphological pyramids for multiresolution image analysis
new class of morphological pyramids for multiresolution image analysis Jos B.T.M. Roerdink Institute for Mathematics and Computing Science University of Groningen P.O. Box 800, 9700 V Groningen, The Netherlands
More informationEfficient Equalization for Wireless Communications in Hostile Environments
Efficient Equalization for Wireless Communications in Hostile Environments Thomas Strohmer Department of Mathematics University of California, Davis, USA strohmer@math.ucdavis.edu http://math.ucdavis.edu/
More informationModule 4. Multi-Resolution Analysis. Version 2 ECE IIT, Kharagpur
Module 4 Multi-Resolution Analysis Lesson Multi-resolution Analysis: Discrete avelet Transforms Instructional Objectives At the end of this lesson, the students should be able to:. Define Discrete avelet
More informationPseudoinverse and Adjoint Operators
ECE 275AB Lecture 5 Fall 2008 V1.1 c K. Kreutz-Delgado, UC San Diego p. 1/1 Lecture 5 ECE 275A Pseudoinverse and Adjoint Operators ECE 275AB Lecture 5 Fall 2008 V1.1 c K. Kreutz-Delgado, UC San Diego p.
More information6.02 Fall 2012 Lecture #10
6.02 Fall 2012 Lecture #10 Linear time-invariant (LTI) models Convolution 6.02 Fall 2012 Lecture 10, Slide #1 Modeling Channel Behavior codeword bits in generate x[n] 1001110101 digitized modulate DAC
More informationSparse Directional Image Representations using the Discrete Shearlet Transform
Sparse Directional Image Representations using the Discrete Shearlet Transform Glenn Easley System Planning Corporation, Arlington, VA 22209, USA Demetrio Labate,1 Department of Mathematics, North Carolina
More information- An Image Coding Algorithm
- An Image Coding Algorithm Shufang Wu http://www.sfu.ca/~vswu vswu@cs.sfu.ca Friday, June 14, 2002 22-1 Agenda Overview Discrete Wavelet Transform Zerotree Coding of Wavelet Coefficients Successive-Approximation
More informationSubsampling and image pyramids
Subsampling and image pyramids http://www.cs.cmu.edu/~16385/ 16-385 Computer Vision Spring 2018, Lecture 3 Course announcements Homework 0 and homework 1 will be posted tonight. - Homework 0 is not required
More informationFilter Banks II. Prof. Dr.-Ing. G. Schuller. Fraunhofer IDMT & Ilmenau University of Technology Ilmenau, Germany
Filter Banks II Prof. Dr.-Ing. G. Schuller Fraunhofer IDMT & Ilmenau University of Technology Ilmenau, Germany Page Modulated Filter Banks Extending the DCT The DCT IV transform can be seen as modulated
More informationLecture notes: Applied linear algebra Part 1. Version 2
Lecture notes: Applied linear algebra Part 1. Version 2 Michael Karow Berlin University of Technology karow@math.tu-berlin.de October 2, 2008 1 Notation, basic notions and facts 1.1 Subspaces, range and
More informationApproximately dual frames in Hilbert spaces and applications to Gabor frames
Approximately dual frames in Hilbert spaces and applications to Gabor frames Ole Christensen and Richard S. Laugesen October 22, 200 Abstract Approximately dual frames are studied in the Hilbert space
More informationFrequency-Domain Design and Implementation of Overcomplete Rational-Dilation Wavelet Transforms
Frequency-Domain Design and Implementation of Overcomplete Rational-Dilation Wavelet Transforms Ivan Selesnick and Ilker Bayram Polytechnic Institute of New York University Brooklyn, New York 1 Rational-Dilation
More informationPart III Super-Resolution with Sparsity
Aisenstadt Chair Course CRM September 2009 Part III Super-Resolution with Sparsity Stéphane Mallat Centre de Mathématiques Appliquées Ecole Polytechnique Super-Resolution with Sparsity Dream: recover high-resolution
More informationPerfect Reconstruction Two- Channel FIR Filter Banks
Perfect Reconstruction Two- Channel FIR Filter Banks A perfect reconstruction two-channel FIR filter bank with linear-phase FIR filters can be designed if the power-complementary requirement e jω + e jω
More information2D Wavelets. Hints on advanced Concepts
2D Wavelets Hints on advanced Concepts 1 Advanced concepts Wavelet packets Laplacian pyramid Overcomplete bases Discrete wavelet frames (DWF) Algorithme à trous Discrete dyadic wavelet frames (DDWF) Overview
More informationIntroduction to Sparsity in Signal Processing
1 Introduction to Sparsity in Signal Processing Ivan Selesnick Polytechnic Institute of New York University Brooklyn, New York selesi@poly.edu 212 2 Under-determined linear equations Consider a system
More informationSparse Approximation of Signals with Highly Coherent Dictionaries
Sparse Approximation of Signals with Highly Coherent Dictionaries Bishnu P. Lamichhane and Laura Rebollo-Neira b.p.lamichhane@aston.ac.uk, rebollol@aston.ac.uk Support from EPSRC (EP/D062632/1) is acknowledged
More informationComputational Methods. Eigenvalues and Singular Values
Computational Methods Eigenvalues and Singular Values Manfred Huber 2010 1 Eigenvalues and Singular Values Eigenvalues and singular values describe important aspects of transformations and of data relations
More information