Hexagonal QMF Banks and Wavelets. A chapter within Time-Frequency and Wavelet Transforms in Biomedical Engineering,

Similar documents
size within a local area. Using the image as a matched lter, a nite number of scales are searched within a local window to nd the wavelet coecients th

Multiscale Image Transforms

Module 4 MULTI- RESOLUTION ANALYSIS. Version 2 ECE IIT, Kharagpur

Multidimensional digital signal processing

ONE-DIMENSIONAL (1-D) two-channel FIR perfect-reconstruction

Basic Multi-rate Operations: Decimation and Interpolation

Filter Banks for Image Coding. Ilangko Balasingham and Tor A. Ramstad

Examples. 2-input, 1-output discrete-time systems: 1-input, 1-output discrete-time systems:

Digital Image Processing

Multiresolution image processing

Filter Banks with Variable System Delay. Georgia Institute of Technology. Atlanta, GA Abstract

2D Wavelets for Different Sampling Grids and the Lifting Scheme

COMPLEX WAVELET TRANSFORM IN SIGNAL AND IMAGE ANALYSIS

The DFT as Convolution or Filtering

October 7, :8 WSPC/WS-IJWMIP paper. Polynomial functions are renable

Wavelets and Multiresolution Processing

6.869 Advances in Computer Vision. Bill Freeman, Antonio Torralba and Phillip Isola MIT Oct. 3, 2018

Digital Speech Processing Lecture 10. Short-Time Fourier Analysis Methods - Filter Bank Design

Two-Dimensional Orthogonal Filter Banks with Directional Vanishing Moments

IEEE Transactions on Information Theory, Vol. 41, pp. 2094{2100, Nov Information Theoretic Performance of Quadrature Mirror Filters.

An Introduction to Filterbank Frames

Advanced Digital Signal Processing -Introduction

Elec4621 Advanced Digital Signal Processing Chapter 11: Time-Frequency Analysis

Digital Signal Processing, Homework 1, Spring 2013, Prof. C.D. Chung

The basic structure of the L-channel QMF bank is shown below

Lecture 16: Multiresolution Image Analysis

A REVIEW ON DIRECTIONAL FILTER BANK FOR THEIR APPLICATION IN BLOOD VESSEL DETECTION IN IMAGES

Chapter 7 Wavelets and Multiresolution Processing. Subband coding Quadrature mirror filtering Pyramid image processing

Image Denoising using Uniform Curvelet Transform and Complex Gaussian Scale Mixture

ELEN 4810 Midterm Exam

V j+1 W j+1 Synthesis. ψ j. ω j. Ψ j. V j

A Friendly Guide to the Frame Theory. and Its Application to Signal Processing

MULTIRATE DIGITAL SIGNAL PROCESSING

Lapped Unimodular Transform and Its Factorization

New Design of Orthogonal Filter Banks Using the Cayley Transform

MATRICES. a m,1 a m,n A =

Subband Coding and Wavelets. National Chiao Tung University Chun-Jen Tsai 12/04/2014

(z) UN-1(z) PN-1(z) Pn-1(z) - z k. 30(z) 30(z) (a) (b) (c) x y n ...

The Application of Legendre Multiwavelet Functions in Image Compression

Magnitude F y. F x. Magnitude

3-D Directional Filter Banks and Surfacelets INVITED

Sirak Belayneh Master of Science George Mason University, 1990 Bachelor of Science Addis Ababa University, 1976

Multirate signal processing

Quadrature-Mirror Filter Bank

A Novel Fast Computing Method for Framelet Coefficients

The Fast Wavelet Transform 1. Beyond Fourier transforms. Mac A. Cody 2

DESIGN OF ALIAS-FREE LINEAR PHASE QUADRATURE MIRROR FILTER BANKS USING EIGENVALUE-EIGENVECTOR APPROACH

Frequency-Domain Design and Implementation of Overcomplete Rational-Dilation Wavelet Transforms

Boxlets: a Fast Convolution Algorithm for. Signal Processing and Neural Networks. Patrice Y. Simard, Leon Bottou, Patrick Haner and Yann LeCun

Linear Algebra (part 1) : Vector Spaces (by Evan Dummit, 2017, v. 1.07) 1.1 The Formal Denition of a Vector Space

Calculus and linear algebra for biomedical engineering Week 3: Matrices, linear systems of equations, and the Gauss algorithm

Introduction to Wavelets and Wavelet Transforms

EQUIVALENCE OF DFT FILTER BANKS AND GABOR EXPANSIONS. Helmut Bolcskei and Franz Hlawatsch

Convolution Algorithms

Logarithmic quantisation of wavelet coefficients for improved texture classification performance

Filter-Generating Systems

Module 4. Multi-Resolution Analysis. Version 2 ECE IIT, Kharagpur

Multiresolution schemes

Automatica, 33(9): , September 1997.

On the Frequency-Domain Properties of Savitzky-Golay Filters

Wavelets and Filter Banks

Multiresolution schemes

Chapter 7 Wavelets and Multiresolution Processing

Lecture 19 IIR Filters

ECE538 Final Exam Fall 2017 Digital Signal Processing I 14 December Cover Sheet

Discrete Time Fourier Transform (DTFT)

Phase Factor Influence on Amplitude Distortion and Aliasing of Pseudo-QMF Banks

Lecture 11: Two Channel Filter Bank

Digital Image Processing

Multi-rate Signal Processing 3. The Polyphase Representation

1 The Continuous Wavelet Transform The continuous wavelet transform (CWT) Discretisation of the CWT... 2

Communications and Signal Processing Spring 2017 MSE Exam

A general theory of discrete ltering. for LES in complex geometry. By Oleg V. Vasilyev AND Thomas S. Lund

FOR two-dimensional (2-D) signal processing applications,

MATH2210 Notebook 2 Spring 2018

! Downsampling/Upsampling. ! Practical Interpolation. ! Non-integer Resampling. ! Multi-Rate Processing. " Interchanging Operations

OVER the last decade, the theory and applications of

Relation of Pure Minimum Cost Flow Model to Linear Programming

arxiv: v1 [cs.it] 26 Sep 2018

Introduction p. 1 Compression Techniques p. 3 Lossless Compression p. 4 Lossy Compression p. 5 Measures of Performance p. 5 Modeling and Coding p.

THEORY OF MIMO BIORTHOGONAL PARTNERS AND THEIR APPLICATION IN CHANNEL EQUALIZATION. Bojan Vrcelj and P. P. Vaidyanathan

Digital Image Processing Lectures 15 & 16

VECTORIZED signals are often considered to be rich if

Filter Banks II. Prof. Dr.-Ing. G. Schuller. Fraunhofer IDMT & Ilmenau University of Technology Ilmenau, Germany

UNIVERSITY OF OSLO. Faculty of mathematics and natural sciences. Forslag til fasit, versjon-01: Problem 1 Signals and systems.

EE 225D LECTURE ON DIGITAL FILTERS. University of California Berkeley

IB Paper 6: Signal and Data Analysis

- An Image Coding Algorithm

Wavelet Filter Transforms in Detail

Lecture 10, Multirate Signal Processing Transforms as Filter Banks. Equivalent Analysis Filters of a DFT

Twisted Filter Banks

2 Tikhonov Regularization and ERM

Contents. Acknowledgments

2 W. LAWTON, S. L. LEE AND ZUOWEI SHEN is called the fundamental condition, and a sequence which satises the fundamental condition will be called a fu

Fraction-free Row Reduction of Matrices of Skew Polynomials

Graph Signal Processing

2D Wavelets. Hints on advanced Concepts

Sequential Filter Trees for Ecient D 3D and 4D Orientation Estimation Mats ndersson Johan Wiklund Hans Knutsson omputer Vision Laboratory Linkoping Un

A Mapping-Based Design for Nonsubsampled Hourglass Filter Banks in Arbitrary Dimensions

Course and Wavelets and Filter Banks. Filter Banks (contd.): perfect reconstruction; halfband filters and possible factorizations.

Transcription:

Hexagonal QMF Banks and Wavelets A chapter within Time-Frequency and Wavelet Transforms in Biomedical Engineering, M. Akay (Editor), New York, NY: IEEE Press, 99. Sergio Schuler and Andrew Laine Computer and Information Science and Engineering Department University offlorida Gainesville, FL

Hexagonal QMF Banks and Wavelets Sergio Schuler and Andrew Laine Department of Computer and Information Science and Engineering University of Florida Gainesville, FL Introduction In this chapter we shalllay bare the theory and implementation details of hexagonal sampling systems and hexagonal quadrature mirror lters (HQMF). Hexagonal sampling systems are of particular interest because they exhibit the tightest packing of all regular two-dimensional sampling systems and for a circularly band-limited waveform, hexagonal sampling requires.4 percent fewer samples than rectangular sampling []. In addition, hexagonal sampling systems also lead to nonseparable quadrature mirror lters in which all basis functions are localized in space, spatial frequency and orientation []. This chapter is organized in two sections. Section I describes the theoretical aspects of hexagonal sampling systems while Section II covers important implementation details. I. Hexagonal sampling system This section presents the theoretical foundation of hexagonal sampling systems and hexagonal quadrature mirror lters. Most of this material has appeared elsewhere in [], [], [4], [5], [], [] but is described here under a unied notation for completeness. In addition, it will provide continuity and a foundation for the original material that follows in Section II. The rest of the section is organized as follows. Section I-A covers the general formulation of a hexagonal sampling system. Section I-B introduces up-sampling and down-sampling in hexagonal sampling systems. Section I-C reviews the theory of hexagonal quadrature mirror lters. Section I-D describes redundant analysis/synthesis lter banks in hexagonal systems. Finally, Section I-E covers the formulation of the discrete Fourier transform in hexagonal sampling systems.

A. Hexagonal systems Let x a (t) x a (t t ) be a -D analog waveform, then a sampling operation in -D can be represented by a lattice formed by taking all integer linear combinations of a set of two linearly independent vectors v [v v ] T and v [v v ] T. Using vector notation we can represent the lattice as the set of all vectors t [t t ] T generated by t Vn () where n [n n ] T is an integer-valued vector and V [v v ]isa matrix, known as the sampling matrix. Because v and v are chosen to be linearly independent, the determinant of V is nonzero. Note that V is not unique for a given sampling pattern and that two matrices representing the same sampling process are related by a linear transformation represented by a unimodular matrix []. Sampling an analog signal x a (t) on the lattice dened by () produces the discrete signal x(n) x a (Vn): Figure (a) shows a hexagonal sampling lattice dened by the pair of sampling vectors v 4 T 5 and v 4 ;T T 5 () where T and T p. The lattice is hexagonal since each sample location has exactly six nearest neighbors when T T p. Let the Fourier transform of x a (t) be dened by a () Z + ; x a (t)exp(;j T t)dt where [ ] T. Similarly, let the Fourier transform of the sequence x(n) be dened as (!) n x(n)exp(;j! T n) () where! [!! ] T. Mersereau [4] showed that the spectrum of the sequence x(n) and the spectrum of the signal x a (t) are related by (!) jdet Vj a (V ;T (! ; k)) (4) k

4 v t, n Ω v u u n t Ω (a) (b) Fig.. (a) A hexagonal sampling lattice in the spatial domain. (b) Hexagonal sampling lattice in the frequency domain. where k is an integer-valued vector and V ;T denotes (V ; ) T. Alternatively,we can dene the Fourier transform of the sequence x(n) as V () n x(n) exp(;j T Vn) then Equation (4) may be written as where (V T ) (5) V () jdet Vj a ( ; Uk) () k U V ;T : () Thus, Equation () can be interpreted as a periodic extension of a () with periodicity vectors u [u u ] T and u [u u ] T, where U [u u ]. The set of all vectors generated by Un denes a lattice in the frequency domain known as the modulation or reciprocal lattice. Thus, the spectrum of a sequence x(n) can be viewed as the convolution of the spectrum of x a (t) with a modulation lattice dened by U. Figure (b) shows the reciprocal lattice corresponding to the sampling vectors dened in Equation (), that is the lattice dened by the pair of modulation vectors u 4 T T 5 and u 4 T 5 :

5 Λ Λ n n n n (a) (b) Fig.. (a) Integer sampling lattice. (b) Sampling sublattice. B. Up-sampling and down-sampling in hexagonal systems Let denote the integer lattice dened by the set of integer vectors n, and let denote the sampling sublattice generated by the subsampling matrix, that is the set of integer vectors m such that m n. Note that in order to properly dene a sublattice of, a subsampling matrix must be nonsingular with integer-valued entries. In general, a sublattice of is called separable if it can be represented by a diagonal matrix, otherwise it is called nonseparable. Figure shows an integer sampling lattice and a sampling sublattice, for the separable subsampling matrix With and down-sampling as described below. 4 5 : (8) dened in this way, we can view the operations of up-sampling and The process of up-sampling maps a signal on to a new signal that is nonzero only at points on the sampling sublattice. The output of an up-sampler is related to the input by y(n) 8 >< >: x( ; n) if ; n, otherwise. It is easy to show [5] that the Fourier transform relates the output and input of an up-sampler by Y (!) ( T!)

(a) n n x x x x x x x x x x x x x x x x x x x x n n (b) Fig.. (a) Up-sample operator. (b) Mapping of samples under up-sampling: (left) input signal, (right) output signal. where (!)isdenedby Equation (). Figure shows the block diagram of an up-sampler and the process of up-sampling for the subsampling matrix dened by Equation (8). The process of down-sampling maps points on the sublattice to according to and discards all other points. y(n) x(n) (9) The Fourier transform relation between the output and input of a down-sampler can be derived by introducing the concept of a sampling function s (n) associated with the sampling matrix [5], that is, s (n) 8 >< >: if n, otherwise. Since s (n) can be interpreted as a periodic sequence, with periodicity matrix, i.e. s (n) s (n + m), it may be expressed as a Fourier series s (n) jdet j jdet j; l exp(;jk T l ; n) () where each ofthejdet j vectors k l [k l k l ] T is associated with one of the cosets of T. Notice that a coset of a sublattice is dened as the set of points obtained by shifting the entire sublattice by an integer shift vector k. There are exactly jdet j distinct cosets

of, and their union is the integer lattice. Each shift vector k l certain coset is known as a coset vector. For example, one choice for the k l sampling sublattice dened by Equation (8) is k 4 5 k 4 5 k 4 5 and k 4 associated with a given the 5 : () Let w(n) x(n)s (n) () then it is easy to see from (9) that a down-sampled signal y(n) can be written as y(n) w(n) since w(n) equals x(n) on. Therefore, the Fourier transform of the sequence y(n) may be written as Y (!) w(n)exp(;j! T n): () n Since w(n) is zero for n not in wemay write () as Y (!) n w(n)exp(;j! T ; n) W ( ;T!) where W (!) is the Fourier transform of the sequence w(n). From () and () it is easy to show that W (!) jdet j; jdet j l (! + ;T k l ) therefore, the Fourier transform relation between the output and input of a down-sampler is given by Y (!) jdet j; ( ;T (! +k l )): jdet j l Figure 4 shows the block diagram of a down-sampler and the process of down-sampling for the subsampling matrix dened on (8). Note that the relations derived above are based on the Fourier transform dened in Equation (). However, a more general denition is described in Equation (5). This formulation takes into account the lattice structure used to sample the original -D analog

8 (a) n n x x x x x x x 4 x x x x x x x x 4 x x x x x x 4 x 4 x 44 x 4 x x x x x x x 4 x n n (b) Fig. 4. (a) Down-sample operator. (b) Mapping of samples under down-sampling: (left) input signal, (right) output signal. waveform and allows the Fourier transform relation between the input and output of an up-sampler and a down-sampler to be written as and Y V () Y V () ( T V T ) (4) jdet j; ( ;T (V T +k l )): (5) jdet j l Therefore, if we assume as dened in (8) we may write Equations (4) and (5) as Y V () V ( T ) () and respectively, where Y V () jdet j jdet j; l V ( ;T + ~k l ) () ~k l U ;T k l : (8) C. Analysis/synthesis lter banks in hexagonal systems This section focuses on perfect reconstruction lter banks in hexagonal sampling systems and wavelets that can be obtained by iterating such lter banks. Parts of this material are described in Simoncelli [], but are reviewed here for completeness of presentation.

9 F(Ω) y(n) G(Ω) x(n) F(Ω) y(n) G(Ω) x(n) ^ F(Ω) y(n) G(Ω) F(Ω) y(n) G(Ω) Fig. 5. A two-dimensional 4-channel analysis/synthesis lter bank. There are a wide variety of analysis/synthesis (A/S) lter banks for two dimensional systems. We restrict our focus to analysis/synthesis lter banks in which each channel shares the same subsampling matrix and the number of channels equals jdet j. Figure 5 shows a 4-channel analysis/synthesis lter bank. We further restrict our study to the separable sublattice dened in Equation (8) since this choice will enable us to apply the A/S lter bank recursively to each of the subband signals y i (n) shown in Figure 5 as described in []. Consider a 4-channel analysis/synthesis lter bank with dened by Equation (8), then using () we can show thatthefourier transform of y i (n) may be written as Y i () jdet j jdet j; l F i ( ;T + ~k l )( ;T + ~k l ) (9) where the subindex V has been suppressed for simplicity. Similarly, using () we have that the Fourier transform of ^x(n) is given by ^() jdetj; i G i ()Y i ( T ): () Therefore, combining Equations (9) and () we obtain an overall lter bank response of ^() jdet j; jdet j; G i () F i ( + ~k l )( + ~k l ) jdet j i l jdet j; ( + ~k l ) jdet j l 4 jdet j; i G i ()F i ( + ~k l ) 5 : ()

Combining Equations (), () and (8) for the values of T and T in Equation () yields the following set of vectors ~k l, that is, ~k 4 5 ~k 4 p 5 ~k 4 p 5 and ~k 4 p 5 : () From Equation () it is clear that one term of the sum in Equation () corresponds to the linear shift invariant (LSI) system response, and the remaining terms correspond to the system alias. The analysis/synthesis lter bank for which the system aliasing terms in Equation () are canceled is generally known as a quadrature mirror lter (QMF) bank. We can choose the lters to eliminate the aliasing terms in Equation () as follows F () G (;) H() H(;) F () G (;) exp(j T s )H( + ~k ) F () G (;) exp(j T s )H( + ~k ) F () G (;) exp(j T s )H( + ~k ) () where s, s and s must satisfy the following equations +e j~ k T s e j~ k T s + e j~ k T s +e j~ k T s e j~ k T s + e j~ k T s +e j~ k T s e j~ k T s + e j~ k T s : Therefore, a suitable choice for the vectors s l given the vectors ~k l in Equation () is s 4 5 s 4 p 5 and s 4 ; p 5 : (4) After canceling all of the aliasing terms in Equation () the remaining LSI system response becomes ^() 4 () G i ()F i () i 4 () H( + ~k i )H(; + ~k i ) i 4 () jh( + ~k i )j : i

j k l l k j k g h i h g k l h e f f e h l l i f c d c f i l k h f d b b d f h k j g e c b a b c e g t, n k h f d b b d f d k l i f c d c f d l l h e f f e d l k g h i h g k n k l t l k j Fig.. Region of support of a 5-ring hexagonally symmetric lter. The parameters a through l refer to the low-pass lter coecients h(n). Note that the aliasing cancellation is exact, and independent ofthechoice of H(), and the design problem is reduced to nding a lter satisfying the constraint jh( + ~k i )j 4: (5) i Alow-pass solution for H() in the above equation results in a band-splitting system which may be cascaded hierarchically through the low-pass band of the QMF bank to produce a multiresolution decomposition in two dimensions. Simoncelli [] describes a simple frequency-sampling design method that produces hexagonally symmetric QMFs with small regions of support for which perfect reconstruction was well approximated. Figure shows the region of support of a 5-ring hexagonally symmetric lter. Notice that the size of the lter is measured in terms of the number of hexagonal rings it contains. The parameters a through l in Figure refer to the lter coecients of the low-pass solution h(n) computed in []. Figure (a) shows an idealized diagram of the partition of the frequency domain resulting from a -level hexagonal multiresolution decomposition.

F(Ω) y(n) G(Ω) F(Ω) y(n) G(Ω) F(Ω) y(n) G(Ω) Level F(Ω) y(n) G(Ω) F(Ω) G(Ω) Level x(n) F(Ω) F(Ω) y(n) y(n) G(Ω) G(Ω) x(n) ^ F(Ω) y(n) G(Ω) (a) (b) Fig.. (a) Partitions of the frequency domain resulting from a -level multiresolution decomposition of hexagonal lters. The upper left frequency diagram represents the spectrum of the original image. (b) A two-stage 4-channel analysis/synthesis lter bank. D. Redundant analysis/synthesis lter banks in hexagonal systems In this section we discuss the mathematical formulation of redundant analysis/synthesis lter banks in hexagonal systems. In particular, we would like to nd equivalent lters for the i th stage of the traditional A/S system shown in Figure (b). It can be easily shown that subsampling by followed by ltering with F () is equivalent to ltering by F () followed by subsampling. Hence, the rst two steps of low-pass ltering in Figure (b) can be replaced by alterwithfourier transform F ()F (), followed by subsampling by. In general, equivalent lters for the i th given by i; Y F i() F ( i; ) stage (i ) of a cascade of analysis lters are l i; Y F i() F ( i; ) l i; Y F i() F ( i; ) l i; Y F i() F ( i; ) l F ( l ) F ( l ) F ( l ) F ( l ) followed by subsampling by i. The synthesis lters are obtained in a similar way. ()

j j j j i i Fig. 8. Analyzing lters F i j for levels and. By removing the operations of down-sampling and up-sampling from the resulting equivalent A/S system we obtain an overcomplete hexagonal multiresolution representation. From Equation (5), perfect reconstruction is also accomplished in this case. Figure 8 shows the magnitude of the equivalent hexagonal lters F i for levels and for the 4-ring lter coecients computed in []. E. The discrete Fourier transform in hexagonal systems Let ~x(n) be a periodic sequence with periodicity matrix N, that is ~x(n) ~x(n + Nr) for any integer vector r. Thenitiseasytoverify [4] that the following Fourier series relations hold, ~x(n) and, j det Nj kj ~(k)exp(jk T (N ; )n) () ~(k) ~x(n) exp(;jk T (N ; )n) (8) ni where, I and J denote nite-extent regions (consisting of j det Nj samples) in the n-domain and k-domain, respectively.

4 Let x(n) be any nite-extent sequence conned to a region I containing S samples. We say that the sequence x(n) admits a periodic extension ~x(n) with periodicity matrix N if and S j det Nj. ~x(n) ~x(n + Nr) ~x(n) x(n) for n I If x(n) admits a periodic extension with periodicity matrix N then the Fourier series relation in Equation (8) can be used to dene its discrete Fourier transform (DFT) as follows, ^(k) ~ (k) k J ni x(n)exp(;jk T (N ; )n) k J: Similarly, the Fourier series relation in Equation () can be used to recover the sequence x(n) from its DFT as follows, x(n) ~x(n) n I ^(k) exp(jk T (N ; )n) n I: j det Nj kj Suppose x(n) is a hexagonally sampled signal with support conned to a region I containing (N + N )N samples. In addition suppose that x(n) admits a periodic extension with periodicity matrix N 4 N + N N N N (9) () 5 : () Then, we say that x(n) admits a hexagonally periodic extension. Notice that x(n) may admit more than one periodic extension and that each periodic extension denes a dierent DFT. It is easy to show that the DFT of each admissible periodic extension of x(n) corresponds to a sampled version of its Fourier transform, and that the sampling lattice is controlled through the periodicity matrix N. This result is a consequence of the following relation between the Fourier transform () and the discrete Fourier transform (9) of x(n), ^(k) (!)j! N ;T k : Using the more general denition of the Fourier transform (5) that accounts for the sampling lattice used to sample the original -D analog signal we can write ^(k) V ()j (VN) ;T k : ()

5 It then follows from Equations () and () that for N N N, that is, for N 4 N N N N 5 () the DFT of x(n) corresponds to a hexagonal sampled version of its Fourier transform. In this case Equation (9) is referred to as the hexagonal discrete Fourier transform (HDFT) of x(n). It is easy to verify from (9) and () that the HDFT of x(n) isgiven by ^(k k ) x(n n ) exp ;j N ((n ; n )k +(n ; n )k ) (n n )I x(n n ) exp ;j (n n )I N (n ; n )(k ; k )+ N n k : Mersereau [4] showed that ecient algorithms for the implementation of the discrete Fourier transform (9) exist if the periodicity matrix N is composite (i.e., if N can be factored into a nontrivial product of integer matrices.) For N l l we observe that the periodicity matrix N in () can be factored as, N 4 5 4 l 5 (4) : (5) This factorization leads to an ecient implementation of (4) known as the hexagonal fast Fourier transform (HFFT). Implementation details of the HFFT can be found in []. II. Implementation Next, we present implementation details of hexagonal multiresolution representations. Section II-A describes the selection of image support for ecient signal processing with hexagonal systems. Section II-B describes ltering in hexagonal sampling systems using a HFFT based strategy and the computation of hexagonal multiresolution representations. Finally, Section II-C describes the computation of overcomplete hexagonal multiresolution representations. A listing of Matlab functions implementing hexagonal multiresolution representations is available at http://www.iprg.cise.ufl.edu/. A. Image support in hexagonal systems Ecient discrete signal processing in hexagonal sampling systems can be achieved by using the hexagonal fast Fourier transform but at the cost of restricting sequences to

those that admit a hexagonally periodic extension with N N N and N l l. Systematic application of the HFFT to image processing further restricts sequences to rectangular regions. It is easy to verify that for any N l l it is possible to nd a rectangular region I l such thatany sequence with support conned to I l admits a hexagonally periodic extension. Figure 9 shows such a sequence conned to region I and its hexagonally periodic extension. For any l, region I l+ may be obtained from I l by doubling the number of rows and the number of samples per rows in I l. Notice that given the periodic sequence shown in Figure 9 there exists more than one fundamental period such that when extended periodically in a hexagonal fashion results in the same periodic sequence. In particular, Figure 9 shows a parallelogram P containing an alternative set of samples that could be used to dene the same periodic sequence but greatly simplies the HFFT computation. The simplication comes from the fact that samples contained in the parallelogram can be stored in an array ofsizenn where the indices of the array directly correspond to the coordinates (n n ) of the samples. It is straight forward to verify that for any sequence conned to I l lthere exists a parallelogram P l containing an alternative set of samples that denes the same periodic sequence. For any l, P l+ is obtained from P l in the same way I l+ was obtained from I l.itfollows that computation of the HFFT for a sequence conned to I l can be accomplished by using Equation (4) where I corresponds to a region dened by P l. Although there are certain image processing applications in which image samples are acquired in a hexagonal fashion, most digital detectors (e.g., CCDs) sample images rectangularly with the same sampling rate along both directions. Processing a rectangularly sampled image with a hexagonal sampling system requires that the rectangularly sampled image be mapped into a hexagonal sampling lattice [], []. For square images whose size is apower of two we describe a strategy that maps a rectangularly sampled image conned to a square region consisting of N N samples (N l l) into a hexagonally sampled image conned to a rectangular region for which it is possible to compute its HFFT. This mapping may be accomplished in two distinctways. If the original image is oversampled, we rst interpolate horizontally by a factor of and then mask the result with the masking function M (n h n v ) h)(+(;) 4 (+(;)n n h +nv )asshown in Figure. The resulting

x x x t, n x x x P x x x N x x x 4 I N n t Fig. 9. Hexagonally sampled sequence conned to a rectangular region I and its hexagonally periodic extension. Parallelogram P contains an alternative set of samples that denes the same periodic sequence.

8 t x, n x 9 t x, n h 4 8 t x, n h t y, n y t y, n v t y, n v (a) (b) (c) Fig.. Mapping a rectangularly sampled image into a hexagonal sampling lattice. (a) Rectangular lattice, (b) Intermediate lattice with interpolated samples, (c) Sampling function. (a) (b) (c) Fig.. (a) A 5 5 rectangularly sampled radiograph of the breast, (b) Image with interpolated samples, (c) Hexagonally sampled image conned to P 9 { Axes n and n are shown at 9 degrees. image is conned to region I l and consists of N samples (5% fewer samples than the original). In this case, it is assumed that oversampling of the original image accounts for the reduction of the number of samples in the resulting image. Alternatively, if the original image is critically sampled, we interpolate horizontally by a factor of and vertically by a factor of and mask the result with the masking function M (n h n v ) ( + (;)n h +n v ). In this case the resulting image is conned to region I l+ and consists of (N) samples. In each case the resulting sampling lattice gives a reasonable geometric approximation to a hexagonal sampling lattice. Note that the oversampled method or the critically sampled method, together with the equivalence between I l and P l can be used to map a N N rectangularly sampled image into P l or P l+, respectively. Figure shows a 5 5 rectangularly sampled image and its mapping into P 9 using the critically sampled strategy described above.

9 Input Image - Interpolate by horizontally Mapping from Rectangular to Hexagonal lattice Masking by Mapping from - - - HFFT M (n h n v ) I l+ to P l+ and byvertically? i Filter - HFFT Output Image Mapping from Hexagonal to Rectangular lattice Mapping from P l+ to I l+ IHFFT Fig.. Filtering a rectangularly sampled image of size N N N l with a hexagonally sampled system by means of the HFFT. Critically sampled case shown. B. Multiresolution representations in hexagonal systems Filtering an image with a hexagonal lter may be accomplished by computing the product of the HFFTs of the image and the lter kernel and taking the inverse hexagonal fast Fourier transform (IHFFT) of the result. This approach requires that both the image and the lter kernel be supported in the same region I l. Again, computation of the HFFT can be accomplished using P l instead of I l due to periodicity. Figure shows a block diagram of the ltering process described above for a rectangularly sampled signal conned to a square region of size N N N l. Here, we are interested in ltering an image with the quadrature mirror lters in equation () given the low-pass solution h(n n ) computed in []. Replacing equations () and (4) in () and using relations (5) and () we obtain the following HDFT relations for

the lters, ^F (k) ^G (;k) ni h (n) exp(;jk T (N ; )n) ^F (k) ^G (;k) exp ^F (k) ^G (;k) exp ^F (k) ^G (;k) exp j N (k ; k ) ni j h (n) exp(;jk T (N ; )n) h (n) exp(;jk T (N ; )n) N (k + k ) ni j N (k ; k ) h (n) exp(;jk T (N ; )n) ni () where h (n) h(n n ), h (n) (;) n h(n n ), h (n) (;) n h(n n ), h (n) (;) n +n h(n n ), and I is the region of support of the lter kernels. It follows from the equations above that the HFFT of lters f k (n) can be obtained by modulating the HFFTs of the kernels h k (n) with complex exponentials. Notice that ltering an image conned to a region I l with an r-ring lter kernel f k (n) using the HFFT-ltering strategy described above requires that the region of support of the kernel be conned to I l to P l ). Indeed, this requirement is satised as long as l dlog (r +)e;. (or equivalently A one-level multiresolution decomposition of an image can be obtained by ltering the image with the lters kernels f k (n) followed by down-sampling (as shown in Figure 5.) This can be accomplished using the HFFT-ltering strategy described above if the image is conned to I l or P l. Notice that if we work with sequences conned to P l then the downsampling operation is equivalent to taking every other row and every other column of the array storing the sequence. An (L + )-level multiresolution decomposition can then be obtained recursively by cascading an analysis section through the low-pass branch ofanllevel multiresolution decomposition. Notice that the maximum number of levels is limited by the smallest P l supporting the lter kernels. Figure shows a two-level hexagonal multiresolution decomposition and reconstruction using the -ring low-pass solution to () computed in []. An algorithm for the multiresolution reconstruction follows directly from its decomposition. C. Overcomplete multiresolution representations in hexagonal systems An overcomplete hexagonal multiresolution representation is computed by ltering an image with the equivalent lters introduced in Section I-D. strategy described previously it follows that the equivalent lters F i k Using the HFFT-ltering can be computed

(a) (b) Fig.. Two-level hexagonal multiresolution representation. (a) Decomposition. (b) Reconstruction. Both images are displayed on their original sampling lattice. taking the product of the HFFTs of lter kernels f k l (n) where F k l () F k ( l ). It is easy to show that the following HDFT relation holds for f k l (n), ^F k l (k) ^F k ( l k): This result combined with equation () leads to the following HDFT relations for the lters, where ^F l (k) ^G l (;k) ni h l (n) exp(;jk T (N ; )n) ^F l (k) ^G l (;k) exp j l+ N (k ; k ) ^F l (k) ^G l (;k) exp j l+ N (k + k ) ^F l (k) ^G l (;k) exp j l+ N (k ; k ) h k l (n) 8 >< >:!! ni! ni ni h l (n) exp(;jk T (N ; )n) h l (n) exp(;jk T (N ; )n) h l (n) exp(;jk T (N ; )n) h (l ) ; n if ( l ) ; n is an integer vector, otherwise. ()

Note that in the above derivation we used the fact that dened a separable subsampling matrix. It follows from the equation above that the HFFT of the lter kernels f k l (n) can be obtained by modulating the HFFTs of the kernels h k l (n) with complex exponentials. The lters h k l (n) can be constructed by up-sampling h k (n) with sampling matrix l. The lters F i k can then be computed following equation () with the lters given in (). Notice that it is possible to discard the complex exponentials and still obtain perfect reconstruction. However, this will dene a dierent set of lters. A hexagonal overcomplete multiresolution representation of an image can be obtained by ltering the image with the lters f i k derived above. Figure 4 shows an example of hexagonal overcomplete multiresolution representations applied to a digitized radiograph of the breast. Contrast enhancement was accomplished adaptively based on the location of multiscale edges derived from the hexagonal overcomplete multiresolution representation. Figure 5 shows another example of this technique applied to a region of interest of a digitized radiograph of the chest. Please refer to [8] for a complete description of this enhancement algorithm and other possible methods of enhancement. Acknowledgments Original digitized mammogram shown in Figure was provided courtesy of the Center for Engineering and Medical Image Analysis and the H. Lee Mott Cancer Center and Research Institute at the University of South Florida, Tampa. Original digitized radiograph shown in Figure 5 was provided courtesy of the Department of Radiology and the J. Hillis Miller Health Science Center at the University of Florida, Gainesville.

(a) (b) (c) (d) Fig. 4. (a) Mathematical phantom. (b) Mammogram blended with phantom. (c) Combined orientations of hexagonal edges obtained from level coecients. (d) Contrast enhancement by multiscale edges obtained from a hexagonal overcomplete multiresolution representation.

4 (a) (b) (c) Fig. 5. (a) Original image. (b) Region of interest. (c) Enhanced region of interest via multiscale analysis.

5 References [] R.M. Mersereau, \The processing of hexagonally sampled two-dimensional signals", Proceedings of the IEEE, vol., no., pp. 9{949, June 99. [] E.P. Simoncelli and E.H. Adelson, \Non-separable extensions of quadrature mirror lters to multiple dimensions", Proceedings of the IEEE, vol. 8, no. 4, pp. 5{, Apr. 99. [] R.M. Mersereau and T.C. Speake, \The processing of periodically sampled multidimensional signals", IEEE Transactions on Acoustics, Speech, and Signal Processing, vol., no., pp. 88{94, Feb. 98. [4] R.M. Mersereau and D.E. Dudgeon, Multidimensional Digital Signal Processing, Prentice-Hall, Inc., Englewood Clis, New Jersey, 984. [5] E. Viscito and J.P. Allebach, \The analysis and design of multidimensional r perfect reconstruction lter banks for arbitrary sampling lattices", IEEE Transactions on Circuits and Systems, vol. 8, no., pp. 9{4, Jan. 98. [] A. Laine and S. Schuler, \Hexagonal wavelet processing of digital mammography", in Medical Imaging 99, Newport Beach, California, Feb. 99, Part of SPIE's Thematic Applied Science and Engineering Series. [] M. Newman, Integral Matrices, Academic Press, New York, 9. [8] A. Laine, S. Schuler, J. Fan, and W. Huda, \Mammographic feature enhancement bymultiscale analysis", IEEE Transaction on Medical Imaging, vol., no. 4, pp. 5{4, Dec. 994.