Sheng, Y. Wavelet Transform. The Transforms and Applications Handbook: Second Edition. Ed. Alexander D. Poularikas Boca Raton: CRC Press LLC, 2000

Size: px
Start display at page:

Download "Sheng, Y. Wavelet Transform. The Transforms and Applications Handbook: Second Edition. Ed. Alexander D. Poularikas Boca Raton: CRC Press LLC, 2000"

Transcription

1 Sheg, Y. Wavelet Trasform. The Trasforms ad Applicatios Hadboo: Secod Editio. Ed. Alexader D. Poularias Boca Rato: CRC Press LLC,

2 Wavelet Trasform Yulog Sheg Laval Uiversity. Itroductio Cotiuous Wavelet Trasform Time-Frequecy Space Aalysis Short-Time Fourier Trasform Wiger Distributio ad Ambiguity Fuctios. Properties of the Wavelets Admissible Coditio Regularity Multiresolutio Wavelet Aalysis Liear Trasform Property Examples of the Wavelets.3 Discrete Wavelet Trasform Time-Scale Space Lattices Wavelet Frame.4 Multiresolutio Sigal Aalysis Laplacia Pyramid Subbad Codig Scale ad Resolutio.5 Orthoormal Wavelet Trasform Multiresolutio Aalysis Bases Orthoormal Bases Orthoormal Subspaces Wavelet Series Decompositio Recostructio Biorthogoal Wavelet Bases.6 Filter Ba FIR Filter Ba Perfect Recostructio Orthoormal Filter Ba Orthoormal Filters i Time Domai Biorthogoal Filter Ba.7 Wavelet Theory Orthoormality Two-Scale Relatios i Frequecy Domai Orthoormal Filters i Time Domai Wavelet ad Subbad Filters Regularity.8 Some Orthoormal Wavelet Bases B-Splie Bases Lemarie ad Battle Wavelet Basis Daubechies Basis.9 Fast Wavelet Trasform Wavelet Matrices Number of Operatios Time Badwidth Product. Applicatios of the Wavelet Trasform Multiresolutio Sigal Aalysis Sigal Detectio Image Edge Detectio Image Compressio ABSTRACT The wavelet trasform is a ew mathematical tool developed maily sice the middle of the 98 s. It is efficiet for local aalysis of ostatioary ad fast trasiet wide-bad sigals. The wavelet trasform is a mappig of a time sigal to the time-scale joit represetatio that is similar to the short-time Fourier trasform, the Wiger distributio ad the ambiguity fuctio. The temporal aspect of the sigals is preserved. The wavelet trasform provides multiresolutio aalysis with dilated widows. The high frequecy aalysis is doe usig arrow widows ad the low frequecy aalysis is doe usig wide widows. The wavelet trasform is a costat-q aalysis. by CRC Press LLC

3 The base of the wavelet trasform, the wavelets, are geerated from a basic wavelet fuctio by dilatios ad traslatios. They satisfy a admissible coditio so that the origial sigal ca be recostructed by the iverse wavelet trasform. The wavelets also satisfy the regularity coditio so that the wavelet coefficiets decrease fast with decreases of the scale. The wavelet trasform is ot oly local i time but also i frequecy. To reduce the time badwidth product of the wavelet trasform output, the discrete wavelet trasform with discrete dilatios ad traslatios of the cotiuous wavelets ca be used. The orthoormal wavelet trasform is implemeted i the multiresolutio sigal aalysis framewor, which is based o the scalig fuctios. The discrete traslates of the scalig fuctios form a orthoormal basis at each resolutio level. The wavelet basis is geerated from the scalig fuctio basis. The two bases are mutually orthogoal at each resolutio level. The scalig fuctio is a averagig fuctio. The orthogoal projectio of a fuctio oto the scalig fuctio basis is a averaged approximatio. The orthogoal projectio oto the wavelet basis is the differece betwee two approximatios at two adjacet resolutio levels. Both the scalig fuctios ad the wavelets satisfy the orthoormality coditios ad the regularity coditios. The discrete orthoormal wavelet series decompositio ad recostructio are computed i the multiresolutio aalysis framewor with recurrig two discrete low-pass ad high-pass filters, that are, i fact, the -bad parauitary perfect recostructio quadrature mirror filters, developed i the subbad codig theory, with the additioal regularity. The tree algorithm operatig the discrete wavelet trasform requires oly O(L) operatios where L is the legth of the data vector. The time badwidth product of the wavelet trasform output is oly slightly icreased with respect to that of the sigal. The wavelet trasform is powerful for multiresolutio local spectrum aalysis of ostatioary sigals, such as the soud, radar, soar, seismic, electrocardiographic sigals, ad for image compressio, image processig, ad patter recogitio. I this chapter all itegratios exted from to, if ot stated otherwise. The formulatio of the wavelet trasform i this chapter is oe-dimesioal. The wavelet trasform ca be easily geeralized to ay dimesios.. Itroductio.. Cotiuous Wavelet Trasform Defiitio Let L deote the vector space of measurable, square-itegrable fuctios. The cotiuous wavelet trasform of a fuctio f(t) Z is a decompositio of f(t) ito a set of erel fuctios h s,τ (t) called the wavelets: f(, )= () s, τ () W s τ * f t h t dt (..) where * deotes the complex cojugate. However, most wavelets are real valued. The wavelets are geerated from a sigle basic wavelet (mother wavelet) h(t) by scalig ad traslatio: h s,τ ()= t (..) where s is the scale factor ad τ is the traslatio factor. We usually cosider oly positive scale factor s >. The wavelets are dilated whe the scale s > ad are cotracted whe s <. The wavelets h s,τ (t) geerated from the same basic wavelet have differet scales s ad locatios τ, but all have the idetical shape. The costat s / i the expressio (..) of the wavelets is for eergy ormalizatio. The wavelets are ormalized as s h t τ s h t dt h t dt s,τ () = () = by CRC Press LLC

4 so that all the wavelets scaled by the factor s have the same eergy. The wavelets ca also be ormalized i terms of the amplitude: hs,τ () t dt = I this case, the ormalizatio costat is s istead of s /, ad the wavelets are geerated from the basic wavelet as h s,τ t s h t τ ()= s (..3) I this chapter, we cosider mostly the ormalizatio of the wavelet i terms of eergy. O substitutig (..) ito (..) we write the wavelet trasform of f(t) as a correlatio betwee the sigal ad the scaled wavelets h(t/s): = () Wf s,τ s * f t h t τ dt s (..4) Wavelet Trasform i Frequecy Domai The Fourier trasform of the wavelet is H ω s h t τ τ = exp jωt dt s s, = sh( sω) exp( jωτ) (..5) where H(ω) is the Fourier trasform of the basic wavelet h(t). I the frequecy domai the wavelet is scaled by /s, multiplied by a phase factor exp( jωτ) ad by the ormalizatio factor s /. The amplitude of the scaled wavelet is proportioal to s / i the time domai ad is proportioal to s / i the frequecy domai. Whe the wavelets are ormalized i terms of amplitude, the Fourier trasforms of the wavelets with differet scales will have the same amplitude, that is suitable for implemetatio of the cotiuous wavelet trasform usig the frequecy domai filterig. Equatio (..5) shows a well ow cocept that a dilatatio t/s (s > ) of a fuctio i the time domai produces a cotractio sω of its Fourier trasform. The term /s has a dimesio of frequecy ad is equivalet to the frequecy. However, we prefer the term scale to the term frequecy for the wavelet trasform. The term frequecy is reserved for the Fourier trasform. The correlatio betwee the sigal ad the wavelets, i the time domai ca be writte as the iverse Fourier trasform of the product of the cojugate Fourier trasforms of the wavelets ad the Fourier trasform of the sigal: = Wf s,τ s π * F ω H sω exp jωτ dω (..6) The Fourier trasforms of the wavelets are referred to as the wavelet trasform filters. The impulse respose of the wavelet trasform filter, sh( sω), is the scaled wavelet s / h(t/s). Therefore, the wavelet trasform is a ba of wavelet trasform filters with differet scales, s. by CRC Press LLC

5 I the defiitio of the wavelet trasform, the erel fuctio, wavelet, is ot specified. This is a differece betwee the wavelet trasform ad other trasforms such as the Fourier trasform. The theory of wavelet trasform deals with geeral properties of the wavelet ad the wavelet trasform, such as the admissibility, regularity, ad orthogoality. The wavelet basis is built to satisfy those basic coditios. The wavelets ca be give as aalytical or umerical fuctios. They ca be orthoormal or oorthoormal, cotiuous or discrete. Oe ca choose or eve build himself a proper wavelet basis for a specific applicatio. Therefore, whe talig about the wavelet trasform oe used to specify what wavelet is used i the trasform. The most importat properties of the wavelets are the admissibility ad regularity. As we shall see below, accordig to the admissible coditio, the wavelet must oscillate to have its mea value equal to zero. Accordig to the regularity coditio, the wavelet has expoetial decay so that its first low order momets are equal to zero. Therefore, i the time domai the wavelet is just lie a small wave that oscillates ad vaishes, as that described by the ame wavelet. The wavelet trasform is a local operator i the time domai. The orthoormality is a property that belogs to the discrete wavelet trasform. We discuss the discrete orthoormal ad bi-orthoormal wavelet trasforms i Sectios.3 to.9... Time-Frequecy Space Aalysis The wavelet trasform of a oe-dimesioal sigal is a two-dimesioal fuctio of the scale, s, ad the time shift, τ, that represets the sigal i the time-scale space ad is referred to as the time-scale joit represetatio. The time-scale wavelet represetatio is equivalet to the time-frequecy joit represetatio, which is familiar i the aalysis of ostatioary ad fast trasiet sigals. Nostatioary Sigals The wavelet trasform is of particular iterest for aalysis of ostatioary ad fast trasiet sigals. Sigals are statioary if their properties do ot chage durig the course of sigals. The cocept of the statioarity is well defied i the theory of stochastic processes. A stochastic process is called strict-sese statioary if its statistical properties are ivariat to a shift of the origi of the time axis. A stochastic process is called wide-sese (or wea) statioary if its secod order statistics is ivariat to shift i time ad depeds oly o time differece. Most sigals i ature are ostatioary. Examples of ostatioary sigals are speech, radar, soar, seismic, electrocardiographic sigals ad music. Two-dimesioal images are also ostatioary because the edges, textures, ad determiistic objects are distributed at differet locatios ad orietatios. The ostatioary sigals are i geeral characterized by their local features rather tha by their global features. Time-Frequecy Joit Represetatio A example of the ostatioary sigal is music. The frequecy spectrum of a music sigal chages with the time. At a specific time, for istace, a piao ey is oced, which the gives rise to a soud which has a specific frequecy spectrum. At aother time, aother ey will be oced geeratig aother spectrum. The otatio of music score is a example of the time-frequecy joit represetatio. A piece of music ca be described accurately by air pressure as a fuctio of time. It ca be equally accurately described by the Fourier trasform of the pressure fuctio. However, either of those two sigal represetatios would be useful for a musicia, who wats to perform a certai piece. Musicias prefer a two-dimesioal plot, with time ad logarithmic frequecy as axes. The music scores tell them whe ad what otes should be played. Fourier Aalysis of Nostatioary Sigals The Fourier trasform is widely used i sigal aalysis ad processig. Whe the sigal is periodic ad sufficietly regular, the Fourier coefficiets decay quicly with the icreasig of the frequecy. by CRC Press LLC

6 For operiodic sigals, the Fourier itegral gives a cotiuous spectrum. The Fast Fourier trasform (FFT) permits efficiet umerical Fourier aalysis. The Fourier trasform is ot satisfactory for aalyzig sigals whose spectra vary with time. The Fourier trasform is a decompositio of a sigal ito two series of orthogoal fuctios cosωt ad jsiωt with j = ( ) /. The Fourier bases are of ifiite duratio alog the time axis. They are perfectly local i frequecy, but are global i time. A sigal may be recostructed from its Fourier compoets, which are the Fourier base of ifiite duratio multiplied by the correspodig Fourier coefficiets of the sigal. Ay sigal that we are iterested i is, however, of fiite extet. Outside that fiite duratio, the Fourier compoets of the sigal, which are ozero, must be cacelled by their ow summatio. A short pulse that is local i time is ot local i frequecy. Its Fourier coefficiets decay slowly with frequecy. The recostructio of the pulse from its Fourier compoets depeds heavily o the cacellatio of high frequecy Fourier compoets ad, therefore, is sesitive to high frequecy oise. The Fourier spectrum aalysis is global i time ad is basically ot suitable to aalyze ostatioary ad fast varyig trasiet sigals. May temporal aspects of the sigal, such as the start ad ed of a fiite sigal ad the istat of appearace of a sigularity i a trasiet sigal, are ot preserved i the Fourier spectrum. The Fourier trasform does ot provide ay iformatio regardig the time evolutio of spectral characteristics of the sigal. The short-time Fourier trasform, or called the Gabor trasform, the Wiger distributio, ad the ambiguity fuctio are usually used to overcome the drawbac of the Fourier aalysis for ostatioary ad fast trasiet sigals. The Wiger distributio ad the ambiguity fuctio are ot liear, but are biliear trasforms...3 Short-Time Fourier Trasform Defiitio A ituitive way to aalyze a ostatioary sigal is to perform a time-depedet spectral aalysis. A ostatioary sigal is divided ito a sequece of time segmets i which the sigal may be cosidered as quasistatioary. The, the Fourier trasform is applied to each of the local segmets of the sigal. The short-time Fourier trasform is associated with a widow of fixed width. Gabor i 946 was the first to itroduce the short-time Fourier trasform which is ow as the slidig widow Fourier trasform. The trasform is defied as = () ( ) ( ) * S ω, τ f t g t τ exp jω t dt f where g(t) is a square itegrable short-time widow, which has a fixed width ad is shifted alog the time axis by a factor τ. Gabor Fuctios The Gabor trasform may also be regarded as a ier product betwee the sigal ad a set of erel fuctios, called the Gabor fuctios: g(t τ) exp(jω t). The Gabor basis is geerated from a basic widow fuctio g(t) by traslatios alog the time axis by τ. The phase modulatios exp(jω t) correspod to traslatios of the Gabor fuctio spectrum alog the frequecy axis by ω. The Fourier trasform of the basic Gabor fuctio g(t)exp(jω t) is expressed as gt () exp( jω t) exp( jωtdt ) = Gω ω The Fourier trasform G(ω) of the basic widow fuctio g(t) is shifted alog the frequecy axis by ω. The short-time Fourier trasform of a oe-dimesioal sigal is a complex valued fuctio of two real parameters: time τ ad frequecy ω i the two-dimesioal time-frequecy space. by CRC Press LLC

7 Iverse Short-Time Fourier Trasform Whe τ ad ω are cotiuous variables, the sigal f(t) may be recostructed completely by itegratig the Gabor fuctios multiplied by the short-time Fourier trasform coefficiets: ad this holds for ay chose widow g(t). The iverse short-time Fourier trasform may be proved by the followig calculatio: provided that the widow fuctio is ormalized as Time ad Frequecy Resolutio f ()= t S f ( ω, τ) g( t τ) exp( jω t) dω dτ π ( ) ( ) S ω, τ g t τ exp jω t dω dτ f ( ) ( ) ( ) ( ) * = f t g t τ exp jω t g t τ exp jω t dω dτdt ( ) ( ) ( ) = () ( ) = () * = πδ t t f t g t τ g t τ dτdt πf t g t τ dτ πf t gt () dt= (..7) I the short-time Fourier trasform, the sigal is multiplied by a slidig widow that localizes the sigal i time domai, but results i a covolutio betwee the sigal spectrum ad the widow spectrum; that is, a blurrig of the sigal i the frequecy domai. The arrower the widow, the better we localize the sigal ad the poorer we localize its spectrum. The width t of the widow g(t) i time domai ad the badwidth ω of the widow G(ω) i frequecy domai are defied respectively as t = () () t g t dt gt dt ω = (..8) where the deomiator is the eergy of the widow i time ad frequecy domais. The two siusoidal sigals ca be discrimiated oly if they are more tha ω apart. Thus, ω is the resolutio i the frequecy domai of the short-time Fourier trasform. Similarly, two pulses i time domai ca be discrimiated oly if they are more tha t apart. Note that oce a widow has bee chose for the short-time Fourier trasform, the time ad frequecy resolutios give by (..8) are fixed over the etire time-frequecy plae. The short-time Fourier trasform is a fixed widow Fourier trasform. Ucertaity Priciple The time-frequecy joit represetatio has a itrisic limitatio, the product of the resolutios i time ad frequecy is limited by the ucertaity priciple: ω G ω dω G ω dω t ω (..9) This is also referred to as the Heiseberg iequality, familiar i quatum mechaics ad importat for time-frequecy joit represetatio. A sigal ca ot be represeted as a poit i the time frequecy space. Oe ca oly determie its positio i the time-frequecy space withi a rectagle of t ω. by CRC Press LLC

8 Gaussia Widow The time-badwidth product t ω must obey the ucertaity priciple. We ca oly trade time resolutio for frequecy resolutio or vice versa. Gabor proposed the Gaussia fuctio as the widow fuctio. The Gaussia fuctio has the miimum time-badwidth product determied by the ucertaity priciple (..9). The Fourier trasform of the Gaussia widow is still a Gaussia as gt which have a miimum spread. A simple calculatio shows that which satisfies the ucertaity priciple (..9) ad achieves the miimum time-badwidth product t ω = /. The short-time Fourier aalysis depeds critically o the choice of the widow. Its applicatio requires a priori iformatio cocerig the time evolutio of the sigal properties i order to mae a priori choice of the widow fuctio. Oce a widow is chose, the width of the widow alog both time ad frequecy axes are fixed i the etire time-frequecy plae. Discrete Short-Time Fourier Trasform Whe the traslatio factors of the Gabor fuctios alog the time ad the frequecy axes, τ ad ω, tae discrete values, τ = τ ad ω = mω with m ad Z, the discrete Gabor fuctios are writte as: ad their Fourier trasforms are The discrete Gabor trasform is t exp ad G( ω)= exp s ω π s s ()= t s = ad ω = s ()= ( ) g m, t g t τ exp jmωt [ ] Gm, ( ω)= G( ω mω) exp j( ω mω) τ = () ( ) ( ) * S m f t g t τ exp jmω t dt f, The sigal f(t) ca still be recovered from the coefficiets S f (m,), provided that τ ad ω are suitably chose. Gabor s origial choice was ω τ = π. Regular Lattice If the widow fuctio is ormalized as show i (..7) ad is cetered to the origi i the timefrequecy space, so that: () = = tg t dt ωgω dω the the locatios of the Gabor fuctios i the time-frequecy space are determied by: = tg m, () t dt= tg t τ dt τ by CRC Press LLC

9 ad, = ( ) = ωg ω dω ωg ω mω dω mω The discrete Gabor fuctio set will be represeted by a regular lattice with the equal itervals τ ad ω i the time-frequecy space, as will be show i Figure.a...4 Wiger Distributio ad Ambiguity Fuctios m The Wiger distributio fuctio ad the ambiguity fuctio are secod-order trasform or biliear trasforms that perform the mappig of sigals ito the time-frequecy space. Wiger Distributio Fuctio The Wiger distributio fuctio is a alterative to the short-time Fourier trasform for ostatioary ad trasiet sigal aalysis. The Wiger distributio of a fuctio f(t) is defied i the time domai as t * t Wf ( τω, )= f τ + f τ exp jωt dt (..) that is the Fourier trasform of the product, f(τ + t/)f * (τ t/), betwee the dilated fuctio f(t/) ad the dilated ad iverted fuctio f * ( t/). The product is shifted alog the time axis by τ. The Wiger distributio is a complex valued fuctio i the time-frequecy space ad is a time-frequecy joit represetatio of the sigal. I the frequecy domai the Wiger distributio fuctio is expressed as Wf τω F ω ξ * (, )= + F ω ξ exp( jτξ) dξ π (..) where F(ω) is the Fourier trasform of f(t). The iverse relatios of the Wiger distributio fuctio ca be obtaied from the iverse Fourier trasforms of (..) ad (..). With the chages of variables t = τ + t/ ad t = τ t/, the iverse Fourier trasform of the Wiger distributio of (..) gives [ ] f t f t W t t + * = f jt t d, ω exp ( ) ω ω π (..) Similarly, with the chages of variables ω = ω + (ξ/) ad ω = ω (ξ/) the iverse Fourier trasform of (..) gives [ ] F ω F ω Wf τ ω ω + * =, j ω ω τ dτ exp ( ) The sigal f(t) ca be recovered from the iverse Wiger distributio fuctio. Let t = t ad t =, (..) becomes () = f t f W t * f, ω exp jωt dω π where f * () is a costat. Hece, the fuctio f(t) is recostructed from the iverse Fourier trasform of the Wiger distributio fuctio, W f (t/,ω), dilated i the time domai. by CRC Press LLC

10 For the basic properties of the Wiger distributio fuctio we metio that the projectios of W f (τ,ω) alog the τ-axis i the time-frequecy space gives the square modulus of F(ω), because accordig to (..) the projectio alog the τ-axis is = + Wf τωdτ F ω ξ * F ω ζ, exp jτξ dτdξ F ω π = The projectio of W f (τ,ω) alog the ω-axis gives the square modulus of f(t), because accordig to (..) the projectio alog the ω-axis is = + = () t * t Wf τω, dω f τ f τ exp jωt dtdω π f t Also, there is the coservatio of eergy of the Wiger distributio i the time-frequecy joit represetatio: π W f ( τω, ) dτω d = F( ω) dω = f () t dt π Ambiguity Fuctio The ambiguity fuctio is also a mappig of a trasiet time fuctio f(t) ito the time-frequecy space. The ambiguity fuctio is defied i the time domai as: 3 t * t Af ( t,ω)= f τ + f τ exp jωτ dτ (..3) I the frequecy domai, the ambiguity fuctio is expressed as Af t,ω F ξ ω * = + F ξ ω exp( jτξ) dξ π The ambiguity fuctio ca be viewed as a time-frequecy auto-correlatio fuctio of the sigal with the time delay t ad the Doppler frequecy shift, ω. The ambiguity fuctio has foud wide applicatios for radar sigal processig. Accordig to the defiitios (..) ad (..3) the double Fourier trasform of the product f(τ + t/)f * (τ t/) with respect to both variables t ad τ gives the relatio betwee the Wiger distributio fuctio ad the ambiguity fuctio: A t, ω exp jωt dt W τ, ω exp jωτ dτ f = f The cross ambiguity fuctio is defied as the Fourier trasform of the product, f(τ)g * (τ) of two fuctios f(τ) ad g(τ): t * t At (,ω)= f τ + g τ jωτ dτ exp High values of A(t,ω) mea that the two fuctios are ambiguous. The fuctio g(τ) ca also be cosidered as a widow fuctio of fixed width that is shifted alog the time axis by t. Hece, the cross by CRC Press LLC

11 ambiguity fuctio is the fixed-widow, short-time Fourier trasform. The cross Wiger distributio fuctio is defied as that ca be see as the Fourier trasform of the sigal f(t) dilated by a factor of two ad multiplied with a iverted widow g( t) which is also dilated by a factor of two ad shifted by τ. Both the ambiguity fuctio ad the Wiger distributio fuctio are useful for active ad passive trasiet sigal aalysis. Both trasforms are biliear trasform. However, the mappig of a summatio of sigals f (t) + f (t) ito the time-frequecy space with the ambiguity fuctio or with the Wiger distributio fuctio produces cross-product iterferece terms that might be a uisace i the projectios i the time-frequecy space ad i the recostructio of the sigal.. Properties of the Wavelets I this sectio we discuss some basic properties of the wavelets. Oe of them is related to the fact that we must be able to recostruct the sigal from its wavelet trasform. This property ivolves the resolutio of idetity, the eergy coservatio i the time-scale space ad the wavelet admissible coditio. Ay square itegrable fuctio which has fiite eergy ad satisfies the wavelets admissible coditio ca be a wavelet. The secod basic property is related to the fact that the wavelet trasform should be a local operator i both time ad frequecy domais. Hece, the regularity coditio is usually imposed o the wavelets. The third basic property is related to the fact that the wavelet trasform is a multiresolutio sigal aalysis... Admissible Coditio t * t W( τω, )= f τ + g τ jωt dt exp Resolutio of Idetity The wavelet trasform of a oe-dimesioal sigal is a two-dimesioal time-scale joit represetatio. No iformatio should be lost durig the wavelet trasform. Hece, the resolutio of idetity must be satisfied, that is expressed as = ds dτ f h h f c f f (..), s, τ s, τ, h, s where <, > deotes the ier product ad c h is a costat. I the left-had side of (..) the extra factor /s i the itegral is the Haar ivariat measure, owig to the time-scale space differetial elemets, dτd(/s) = dτds/s. We have assumed positive dilatio s > ; usig (..6) for wavelet trasform i the Fourier domai, we have: ds s dτ f, h h, f s, τ s, τ 4π ds s * * jτω ( ω) dτ sf ω H sω F ω H sω e dω ω = * ds = F F H s s d ( ω ) ( ω ) ( ω ) ω π c h = F( ω) F * ( π ω ) d ω by CRC Press LLC

12 where we used the chage of variables ω = sω ad ds = dω/ ω, so that ds ad dω are of the same sig. Because s >, we have ds/s = dω/ ω, the we defied the costat: c = h H( ω ) dω ω Accordig to the Parseval s equality i the Fourier trasform, we have: π F ω F ω dω f t f t dt f, f * * Hece, the resolutio of idetity is satisfied o the coditio that = () () = H ( c = ω) h ω dω <+ (..) Admissible Coditio The coditio (..) is the admissible coditio of the wavelet, which implies that the Fourier trasform of the wavelet must be equal to zero at the zero frequecy: = H ω ω = (..3) Equivaletly, i the time domai the wavelet must be oscillatory, lie a wave, to have a zero-itegrated area, or a zero-mea value: htdt () = (..4) Eergy Coservatio Whe f = f, the resolutio of idetity, (..) becomes: W s d ds (..5) f(,τ) τ = c f t dt h () s This is the eergy coservatio relatio of the wavelet trasform, equivalet to the Parseval eergy relatio i the Fourier trasform. Iverse Wavelet Trasform By withdrawig from the both sides of the resolutio of idetity (..), we have directly: f f t W s c s h t τ d ds f,τ τ s s ()= h (..6) This is the iverse wavelet trasform. The fuctio f(t) is recovered from the iverse wavelet trasform by the itegratig i the time-scale space the wavelets h s,τ (t) weighted by the wavelet trasform coefficiets, W f (s,τ). The wavelet trasform is a decompositio of a fuctio ito a liear combiatio of the wavelets. The wavelet trasform coefficiets W f (s,τ) are the ier products betwee the fuctio ad the wavelets, which idicate how close the fuctio f(t) is to a particular wavelet h s,τ (t). by CRC Press LLC

13 Reproducig Kerel The iverse wavelet trasform shows that the origial sigal may be sythesized by summig up all the projectios of the sigal oto the wavelet basis. I this sese, the cotiuous wavelet trasform behaves lie a orthogoal trasform. We refer to this property of the cotiuous wavelet trasform as the quasiorthogoality. Obviously, the set of the wavelet erel fuctios h s,τ (t) with cotiuously varyig scalig ad shift is ot orthogoal, but is heavily redudat. Applyig the wavelet trasforms i the two sides of (..6) yields: where the reproducig erel: W s W s K s s d ds f(, τ)= f(, τ) (, ; τ, τ) τ s Ks (,; s τ, τ)= c h ss t τ h h t τ dt * s s is ot zero with cotiuously varyig factors s, s, ω, ad ω that describes the itrisic redudacy betwee the values of the wavelets at (s,τ) ad at (s,τ ). Ay square itegrable fuctio satisfyig the admissible coditio may be a wavelet. Whe the wavelets satisfy the admissible coditio, the sigal ca be recovered by the iverse wavelet trasform. No sigal iformatio is lost... Regularity The wavelets should be local i both time ad frequecy domais. This is achieved by applyig the regularity coditio to the wavelet. The regularity is ot a obligated coditio, but is usually required as a importat property of the wavelet. Regularity of Wavelet For the sae of simplicity, let the traslatio of the wavelet τ = ad cosider the covergece to zero of the wavelet trasform coefficiets with icreasig of /s ad decreasig of s. The sigal f(t) is expaded ito the Taylor series at t = util order. The wavelet trasform coefficiets become 4 W ( s, )= f() t h s where the remaider i the Taylor series is f t s dt p f s p = * p t p h t s dt R t h t! + () s dt (..7) Rt ()= t ( t t )! ( + ) f t dt ad f (p) () deotes the pth derivative. Deotig the momets of the wavelets by M p : M P = () p t h t dt by CRC Press LLC

14 it is easy to show that the last term i the right-had side of (..7) which is the wavelet trasform of the remaider, decreases as s +. We the have a fiite developmet as: f f f W f ( s, )= f ( ) M s+ Ms + Ms + K+ M s s!!! + O( s ) (..8) Accordig to the admissible coditio of the wavelet, M =, the first term i the right-had side of (..8) must be zero. The speed of covergece to zero of the wavelet trasform coefficiets W f (s,τ) with decreasig of the scale s or icreasig of /s is the determied by the first ozero momet of the basic wavelet h(t). It is i geeral required that the wavelets have the first + momets util order, equal to zero: p M p = t h() t dt = for p =,,, K, (..9) The, accordig to (..8) the wavelet trasform coefficiet W f (s,τ) decays as fast as s +(/) for a smooth sigal f(t). The regularity leads to localizatio of the wavelet trasform i the frequecy domai. The wavelet satisfyig the coditio (..9) is called the wavelet of order. I frequecy domai, this coditio is equivalet to the derivatives of the Fourier trasform of the wavelet h(t) up to order to be zero at the zero frequecy ω = : H ( p ) ( )= for p =,,, K. (..) The Fourier trasform of the wavelet has a zero of order +. The order (+) is a measure of the flatess of the wavelet i the frequecy domai about ω =. Time Badwidth Product While the wavelet trasform of a oe-dimesioal fuctio is two-dimesioal, the wavelet trasform of a two-dimesioal fuctio is four-dimesioal. As a cosequece, we would have a explosio of the time badwidth product with the wavelet trasform, which is i cotradictio with the restrictios of may applicatios, such as data compressio ad patter classificatio, where the sigals eed to be characterized efficietly by fewer trasform coefficiets. We usually impose the regularity property to the wavelets such that the wavelet trasform coefficiets decrease fast with decreasig of the scale, s ad icreasig of /s. For this purpose, the Fourier trasform, H(ω), of the basic wavelet should have some smoothess ad cocetratio i frequecy domais, accordig to the wavelet trasform i the frequecy domai (..6). The wavelet trasform should be a local operator i frequecy domai...3 Multiresolutio Wavelet Aalysis The wavelet trasform performs the multiresolutio sigal aalysis with the varyig scale factor, s. The purpose of the multiresolutio sigal aalysis is decomposig the sigal i multiple frequecy bads, i order to process the sigal i multiple frequecy bads differetly ad idepedetly. Hece, we eed the wavelet to be local i both time ad frequecy domais. Historically, looig for a erel fuctio which is local i both time ad frequecy domais has bee a hard research topic ad was coducted to ivet the wavelet trasform. Example Figure. shows a typical wavelet multiresolutio aalysis for a electrical power system trasiet sigal. The sigal is decomposed with differet resolutios correspodig to differet scale factors of the by CRC Press LLC

15 FIGURE. Multiresolutio wavelet aalysis of a trasiet sigal i the electrical power system. (From Robertso, D. C. et al., Proc. SPIE, 4, 474, 994. With permissio.) wavelets. The sigal compoets i multiple frequecy bads ad the times of occurrece of those compoets are well preseted i the figure. This figure is a time-scale joit represetatio, with the vertical axis i each discrete scale represetig the amplitude of wavelet compoets. More detailed discussio will be give i Sectio... Localizatio i Time Domai Accordig to the admissible coditio, the wavelet must oscillate to have a zero mea. Accordig to the regularity coditio the wavelet of order has first + vaishig momets ad decays as fast as t. Therefore, i the time domai, the wavelet must be a small wave that oscillates ad vaishes, as that described by the ame wavelet. The wavelet is localized i the time domai. Localizatio i Frequecy Domai Accordig to the regularity coditio the wavelet trasform with a wavelet of order,, decays with s, as s +(/), for a smooth sigal. Accordig to the frequecy domai wavelet trasform, (..6) whe the scale s decreases the wavelet, H(sω) i the frequecy domai is dilated to cover a large frequecy bad of the sigal Fourier spectrum. Therefore, the decay with s as s +(/) of the wavelet trasform coefficiet by CRC Press LLC

16 implies that the Fourier trasform of the wavelet must decay fast with the frequecy, ω. The wavelet must be local i frequecy domai. Bad-Pass Filters I the frequecy domai, the wavelet is localized accordig to the regularity coditio, ad is equal to zero at the zero frequecy accordig to the admissible coditio. Therefore, the wavelet is itrisically a bad-pass filter. Ba of Multiresolutio Filters The wavelet trasform is the correlatio betwee the sigal ad the dilated wavelets. The Fourier trasform of the wavelet is a filter i the frequecy domai. For a give scale, the wavelet trasform is performed with a wavelet trasform filter sh( sω) i the frequecy domai, whose impulse respose is the scaled wavelet, h(t/s). Whe the scale s varies, the wavelet trasform performs a multiscale sigal aalysis. I the time-scale joit represetatio, the horizotal stripes of the wavelet trasform coefficiets are the correlatios betwee the sigal ad the wavelets h(t/s) at give scales. Whe the scale is small, the wavelet is cocetrated i time ad the wavelet aalysis gives a detailed view of the sigal. Whe the scale icreases, the wavelet becomes spread out i time ad the wavelet aalysis gives a global view ad taes ito accout the log-time behavior of the sigal. Hece, the wavelet trasform is a ba of multiresolutio filters. The wavelet trasform is a ba of multiresolutio bad-pass filters. Costat Fidelity Aalysis Scale chage of the wavelets permits the wavelet aalysis to zoom i o discotiuities, sigularities, ad edges ad to zoom out for a global view. This is a uique property of the wavelet trasform, importat for ostatioary ad fast trasiet sigal aalysis. The fixed widow short-time Fourier trasform does ot have this ability. With the ba of multiresolutio wavelet trasform filters, the sigal is divided ito differet frequecy subbads. I each subbad the sigal is aalyzed with a resolutio matched to the scales of the wavelets. Whe the scale chages, the badwidth, ( ω) s, of the wavelet trasform filter becomes, accordig to the defiitio of the badwidth (..8): ( ω) = s ω Hsω dω = Hsω dω = ( ω) sω H sω d sω s H( sω) d( sω) s The fidelity factor, Q, refers to, i geeral, the cetral frequecy divided by the badwidth of a filter. By this defiitio, the fidelity factor, Q, is the iverse of the relative badwidth. The relative badwidths of the wavelet trasform filters are costat because: Q ω s = = ( ω) s (..) which is idepedet of the scale, s. Hece, the wavelet trasform is a costat-q aalysis. At low frequecy, correspodig to a large scale factor, s, the wavelet trasform filter has a small badwidth, which implies a broad time widow with a low time resolutio. At high frequecy, correspodig to a small scale factor, s, the wavelet trasform filter has a wide badwidth, which implies a arrow time widow with high-time resolutio. The time resolutio of the wavelet aalysis icreases with decreases of the widow size. This adaptive widow property is desirable for time-frequecy aalysis. by CRC Press LLC

17 FIGURE. Coverage of the time-frequecy space with (a) the short-time Fourier trasform, where ω ad t are fixed i the whole plae; (b) the wavelet trasform, where the frequecy badwidth ω icreases ad the time resolutio t improves with icrease of (/s). Whe the costat-q relatio (..) is satisfied, the frequecy badwidth ω chages with the ceter frequecy, /s, of the wavelet trasform filter. The product ω t still satisfies the ucertaity priciple (..9). I the wavelet trasform, the time widow size t ca be arbitrarily small at small scale ad the frequecy widow size, ω, ca be arbitrarily small at large scale. Figure. shows the coverage of the time-scale space for the wavelet trasform ad, as a compariso, that for the short-time Fourier trasform. Scale ad Resolutio The scale is related to the widow size of the wavelet. A large scale meas a global view ad a small scale meas a detailed view. The resolutio is related to the frequecy of the wavelet oscillatio. For some wavelets, such as the Gabor wavelets, the scale ad frequecy may be chose separately. For a give wavelet fuctio, reducig the scale will reduce the widow size ad icrease the resolutio i the same time. Example Figure.3a shows the cos-gaussia wavelets i compariso with the real part of the Gabor trasform basis. Both fuctios cosist of a cosie erel with a Gaussia widow. The cos-gaussia wavelet is t ht ()= cos( ω t) exp π where ω = 5. The wavelets h m, (t) are geerated from h(t) by dilatio ad traslatio: h s,τ = s h t τ s with the discrete scale factor, s = m, ad the discrete traslatio factor, (τ/s) =. The discrete Gabor fuctio g m, (t) is defied as: ()= ( ) g m, t g t τ exp jmωt where g(t) is the Gaussia widow with a fixed width ad ω = π. by CRC Press LLC

18 I Figure.3a we see that the wavelets are with the dilated widow. All the dilated wavelets cotai the same umber of oscillatios. The wavelet trasform performs multiresolutio aalysis with high frequecy aalysis for arrow widowed sigals ad low frequecy aalysis for wide widowed sigals. This costat-q aalysis property maes the wavelet trasform surpass the fixed-widow short-time Fourier trasform for aalysis of the local property of sigals. FIGURE.3 (a) The cos-gaussia wavelets h m, (t) ad the real part of the Gabor fuctios g m, (t), with the scale factor s = m ad the traslatio factor τ = s for differet values of m. The wavelets have a dilated widow. The Gabor fuctios have a widow with fixed width. (b) Time-scale joit represetatio of the wavelet trasform ad time-frequecy joit represetatio of the Gabor trasform for a step fuctio. (From Szu, H. et al. Appl. Optics, 3(7), 99. Freema, M.O. Photoics New, August 995, 8-4. With permissio.) by CRC Press LLC

19 Figure.3b shows a compariso betwee the wavelet trasform ad the Gabor trasform for a step fuctio iput. The wavelets are with the dilated widows. The Gabor fuctios are with widows of fixed width. The time-scale joit represetatio, log s t, of the wavelet trasform ad the time-frequecy joit represetatio, log ω t, of the Gabor trasform are also show. The wavelet trasform with a very small scale, s, ad a very arrow widow is able to zoom i o the discotiuity ad to idicate the arrival time of the step sigal...4 Liear Trasform Property By defiitio the wavelet trasform is a liear operatio. Give a fuctio f(t), its wavelet trasform W f (s,τ), satisfies the followig relatios: Liear superpositio without the cross terms: Traslatio: Rescale: W s, τ W s, τ W s, τ f f f f + = + W s W s t f( t t )(, τ)= f( t), τ = W s, τ W αs ατ α f( αt) f( t), Differet from the stadard Fourier trasform ad other trasforms, the wavelet trasform is ot ready for closed form solutio apart from some very simple fuctios such as:. For f(t) =, from the defiitio (..4) ad the admissible coditio of the wavelets, (..4) we have W f ( s,τ )= The wavelet trasform of a costat is equal to zero.. For a siusoidal fuctio f(t) = exp(jω t), we have directly from the Fourier trasform of the wavelets (..6) that = ( ) ( ) * Wf s,τ sh sω exp jω τ The wavelet trasform of a siusoidal fuctio is a siusoidal fuctio of the time shift, τ. Its modulus W f (s,τ) depeds oly o the scale, s. 3. For a liear fuctio f(t) = t, we have Wf ( s,τ )= s th * t τ dt s = 3 * = s th t τ dt Hece, if the wavelet h(t) is regular ad of order so that its derivatives of first order is equal to zero at ω =, the wavelet trasform of f(t) = t is equal to zero. s j 3 dh * dω ( ω) ω = by CRC Press LLC

20 For most fuctios the wavelet trasforms have o closed aalytical solutios ad ca be calculated oly by umerical computer or by optical aalog computer. The optical cotiuous wavelet trasform is based o the explicit defiitio of the wavelet trasform ad implemeted usig a ba of optical wavelet trasform filters i the Fourier plae i a optical correlator. FIGURE.4 Haar basic wavelet h(t) ad its Fourier trasform H(ω). (From Sheg, Y. et al. Opt. Eg., 3, 84, 99. With permissio.) Wavelet Trasform of Regular Sigals Accordig to what was discussed above, the wavelet trasform of a costat is zero, ad the wavelet trasform of a liear sigal is zero, if the wavelet has the first order vaishig momet: M =. The wavelet trasform of a quadratic sigal could be zero, if the wavelet has the first ad secod order vaishig momets: M = M =. The wavelet trasform of a polyomial sigal of degree m could be equal to zero, if the wavelet has the vaishig momets up to the order m. The wavelet trasform is efficiet for detectig sigularities ad aalyzig ostatioary, trasiet sigals...5 Examples of the Wavelets I this sectio we give some examples of the wavelets, useful maily for the cotiuous wavelet trasform. Examples of the wavelets for the discrete orthoormal wavelet trasform will be give i Sectio.8. Haar Wavelet The Haar wavelet was historically itroduced by Haar 5 i 9. It is a bipolar step fuctio: The Haar wavelet ca be writte as a correlatio betwee a dilated rectagle fuctio rect(t) ad two delta fuctios: The rectagular fuctio is defied as: ht ()= whe < t < whe < t < otherwise ht ()= t t 3 rect rect = rect( t) δ t δ t 4 4 rect t ()= whe < t < otherwise by CRC Press LLC

21 The Haar wavelet is real-valued ad atisymmetric with respect to t = /, as show i Figure.4. The wavelet admissible coditio (..4) is satisfied. The Fourier trasform of the Haar wavelet is complex valued ad is equal to the product of a sie fuctio ad a sic fuctio. ω ω ω H( ω)= j exp j sic si 4 4 ω ω = j cos 4 exp j ω (..) whose amplitude is eve ad symmetric to ω =. That is a bad-pass filter, as show i Figure.4. The phase factor exp( jω/) is related oly to the shift of h(t) to t = /, which is ecessary for the causal filterig of time sigals. The Haar wavelet trasform ivolves a ba of multiresolutio filters that yield the correlatios betwee the sigal ad the Haar wavelets scaled by factor, s. The Haar wavelet trasform is a local operatio i the time domai. The time resolutio depeds o the scale, s. Whe the sigal is costat, the Haar wavelet trasform is equal to zero. The amplitude of the Haar wavelet trasform has high pea values whe there are discotiuities of the sigal. The Haar wavelet is also irregular. It is discotiuous ad its first order momet is ot zero. Accordig to (..), the amplitude of the Fourier spectrum of the Haar wavelet coverges to zero very slowly as /ω. Accordig to (..8), the Haar wavelet trasform decays with icreasig of /s as (/s) 3/. The set of discrete dilatios ad traslatios of the Haar wavelets costitute the simplest discrete orthoormal wavelet basis. We shall use the Haar wavelets as a example of the orthoormal wavelet basis i Sectios.5 ad.7. However, the Haar wavelet trasform has ot foud may practical applicatios because of its poor localizatio property i the frequecy domai. Gaussia Wavelet The Gaussia fuctio is perfectly local i both time ad frequecy domais ad is ifiitely derivable. I fact, a derivative of ay order,, of the Gaussia fuctio may be a wavelet. The Fourier trasform of the th order derivative of the Gaussia fuctio is ω H( ω)= ( jω) exp that is the Gaussia fuctio multiplied by (jω), so that H() =. The wavelet admissible coditio is satisfied. Its derivatives up to th order H ( ) () =. The Gaussia wavelet is a regular wavelet of order. Both h(t) ad H(ω) are ifiitely derivable. The wavelet trasform coefficiets decay with icreasig of /s as fast as (/s) (/). Mexica Hat Wavelet The Mexica hat-lie wavelet was first itroduced by Gabor. It is the secod order derivative of the Gaussia fuctio: 7 ht ()= t ( t ) exp by CRC Press LLC

22 The Mexica hat wavelet is eve ad real valued. The wavelet admissible coditio is satisfied. The Fourier trasform of the Mexica hat wavelet is ω H ( ω)= ω exp that is also eve ad real valued, as show i Figure.5. The two-dimesioal Mexica hat wavelet is well ow as the Laplacia operator, widely used for zero-crossig image edge detectio. FIGURE.5 Mexica hat wavelet h(t) ad its Fourier trasform H(ω). (From Sheg, Y. et al. Opt. Eg., 3, 84, 99. With permissio.) Gabor Wavelet The Gabor fuctio i the short time Fourier trasform with Gaussia widow is t ht ()= ( j t) τ exp ω exp Its real part is a cosie-gaussia ad the imagiary part is a sie-gaussia fuctio. The Gaussia widow has a fixed width ad is shifted alog the time axis by τ. The Fourier trasform of the Gabor fuctio is a Gaussia widow which is shifted alog the frequecy axis by ω, as discussed i Subsectio..3. The Gabor fuctio ca also have a dilated widow as: ht exp j t ()= exp t s ω where s is the scale factor ad is the width of the Gaussia widow, exp(jω t) itroduces a traslatio of the spectrum of the Gabor fuctio. The Gabor fuctio with the dilatio of both widow ad Fourier erel is the Gabor wavelet. This wavelet was used by Martiet, Morlet, ad Grossma for aalysis of soud patters. The Morlet s basic wavelet fuctio is a multiplicatio of the Fourier basis with a Gaussia widow. Its real part is the Cosie-Gaussia wavelet, whose Fourier trasform cosists of two Gaussia fuctios shifted to ω ad ω, respectively: by CRC Press LLC

23 ω ω ω ω H ( ω)= ππ + + exp exp that are real positive-valued, eve, ad symmetric to the origi ω =. The Gaussia widow is perfectly local i both time ad frequecy domais ad achieves the miimum time-badwidth product determied by the ucertaity priciple, as show by (..9). The cosie-gaussia wavelets are bad-pass filters i frequecy domai. They coverge to zero lie the Gaussia fuctio as the frequecy icreases. Figure.6 shows the cosie-gaussia wavelet ad its Fourier spectrum. FIGURE.6 Cos-Gaussia wavelet h(t) ad its Fourier trasform H(ω). (From Sheg, Y. et al. Opt. Eg., 3, 84, 99. With permissio.) The Gabor wavelets do ot satisfy the wavelet admissible coditio, because: H that leads to c h = +. But the value of H() is very close to zero provided that the ω is sufficietly large. Whe ω = 5, for example, 3 = exp H π that is of 5 order of magitude ad ca be practically cosidered as zero i umerical computatios..3 Discrete Wavelet Trasform The cotiuous wavelet trasform maps a oe-dimesioal time sigal to a two dimesioal time-scale joit represetatio. The time badwidth product of the cotiuous wavelet trasform output is the square of that of the sigal. For most applicatios, however, the goal of sigal processig is to represet the sigal efficietly with fewer parameters. The use of the discrete wavelet trasform ca reduce the time badwidth product of the wavelet trasform output. By the term discrete wavelet trasform, we mea, i fact, the cotiuous wavelets with the discrete scale ad traslatio factors. The wavelet trasform is the evaluated at discrete scales ad traslatios. The discrete scale is expressed as s = s i, where i is iteger ad s > is a fixed dilatio step. The discrete traslatio factor is expressed as τ = τ s i, where is a iteger. The traslatio depeds o the dilatio step, s i. The correspodig discrete wavelets are writte as: 5 by CRC Press LLC

24 h t s h s t τ s i i i i, ()= ( ) ( ) i i = s h s t τ (.3.) The discrete wavelet trasform with the dyadic scalig factor of s =, is effective i the computer implemetatio..3. Time-Scale Space Lattices The discrete wavelet trasform is evaluated at discrete times ad scales that correspod to a samplig i the time-scale space. The time-scale joit represetatio of a discrete wavelet trasform is a grid alog the scale ad time axes. To show this, we cosider localizatio poits of the discrete wavelets i the time-scale space. FIGURE.7 Localizatio of the discrete wavelets i the time-scale space. The samplig alog the time axis has the iterval, τ s i, that is proportioal to the scale, s i. The time samplig step is small for small-scale wavelet aalysis ad is large for large-scale wavelet aalysis. With the varyig scale, the wavelet aalysis will be able to zoom i o sigularities of the sigal usig more cocetrated wavelets of very small scale. For this detailed aalysis the time samplig step is very small. Because oly the sigal detail is of iterest, oly a few small time traslatio steps would be eeded. Therefore, the wavelet aalysis provides a more efficiet way to represet trasiet sigals. There is a aalogy betwee the wavelet aalysis ad the microscope. The scale factor s i correspods to the magificatio or the resolutio of a microscope. The traslatio factor, τ, correspods to the locatio where oe maes observatio with the microscope. If oe loos at very small details, the magificatio ad the resolutio must be large ad that correspods to a large ad egative i. The wavelet is very cocetrated. The step of traslatio is small, that justifies the choice, τ = τ s i. For large ad positive i, the wavelet is spread out, ad the large traslatio steps, τ s i are adapted to this wide width of the wavelet aalysis fuctio. This is aother iterpretatio of the costat-q aalysis property of the wavelet trasform, discussed i Sectio..3. The behavior of the discrete wavelets depeds o the steps, s ad τ. Whe s is close to ad τ is small, the discrete wavelets are close to the cotiuous wavelets. For a fixed scale step s, the localizatio poits of the discrete wavelets alog the scale axis are logarithmic as log s = i log s, as show i Figure.7. The uit of the frequecy samplig iterval is called a octave i music. Oe octave is the iterval betwee two frequecies havig a ratio of two. Oe octave frequecy bad has the badwidth equal to oe octave. The discrete time step is τ s i. We choose usually τ =. Hece, the time samplig step is a fuctio of the scale ad is equal to i for the dyadic wavelets. Alog the τ-axis, the localizatio poits of the discrete wavelets depeds o the scale. The itervals betwee the localizatio poits at the same scale by CRC Press LLC

25 are equal ad are proportioal to the scale s i. The traslatio steps are small for small positive values of i with the small scale wavelets, ad are large for large positive values of i with large scale wavelets. The localizatio of the discrete wavelets i the time-scale space is show i Figure.7, where the scale axis is logarithmic, log s = i log, ad the localizatio is uiform alog the time axis τ with the time steps proportioal to the scale factor s = i..3. Wavelet Frame With the discrete wavelet basis a cotiuous fuctio f(t) is decomposed ito a sequece of wavelet coefficiets: = () () = * W i, fth tdt fh, f i, i, (.3.) A questio for the discrete wavelet trasform is how well the fuctio f(t) ca be recostructed from the discrete wavelet coefficiets: f t A W f i, hi, t ()= i (.3.3) where A is a costat that does ot deped o f(t). Obviously, if s is close eough to ad τ is small eough, the wavelets approach as a cotiuum. The recostructio (.3.3) is the close to the iverse cotiuous wavelet trasform. The sigal recostructio taes place without orestrictive coditios other tha the admissible coditio o the wavelet h(t). O the other had, if the samplig is sparse, s = ad τ =, the recostructio (.3.3) ca be achieved oly for very special choices of the wavelet h(t). The theory of wavelet frames provides a geeral framewor that covers the above metioed two extreme situatios. It permits oe to balace betwee the redudacy, i.e., the samplig desity i the scale-time space, ad the restrictio o the wavelet h(t) for the recostructio scheme (.3.3) to wor. If the redudacy is large with high over-samplig, the oly mild restrictios are put o the wavelet basis. If the redudacy is small with critical samplig, the the wavelet base are very costraied. Daubechies 8 has prove that the ecessary ad sufficiet coditio for the stable recostructio of a fuctio f(t) from its wavelet coefficiets, W f (i,), is that the eergy, which is the sum of square moduli of W f (i,), must lie betwee two positive bouds: Af f, hi, Bf j, (.3.4) where f is the eergy of f(t), A >, B < ad A, B are idepedet of f(t). Whe A = B, the eergy of the wavelet trasform is proportioal to the eergy of the sigal. This is similar to the eergy coservatio relatio (..5) of the cotiuous wavelet trasform. Whe A B, there is still some proportioal relatio betwee the two eergies. Whe (.3.4) is satisfied, the family of erel fuctios {h i, (t)} with i, Z is referred to as a frame ad A, B are termed frame bouds. Hece, whe proportioality betwee the eergy of the fuctio ad the eergy of its discrete trasform fuctio is bouded betwee somethig greater tha zero ad less tha ifiity for all possible square itegrable fuctios, the the trasform is complete. No iformatio is lost ad the sigal ca be recostructed from its decompositio. Daubechies has show that the accuracy of the recostructio is govered by the frame bouds A ad B. The frame bouds A ad B ca be computed from s, τ ad the wavelet basis, h(t). The closer A ad B, the more accurate the recostructio. Whe A = B the frame is tight ad the discrete wavelets behave exactly lie a orthoormal basis. Whe A = B =, (.3.4) is simply the eergy coservatio equivalet by CRC Press LLC

Filter banks. Separately, the lowpass and highpass filters are not invertible. removes the highest frequency 1/ 2and

Filter banks. Separately, the lowpass and highpass filters are not invertible. removes the highest frequency 1/ 2and Filter bas Separately, the lowpass ad highpass filters are ot ivertible T removes the highest frequecy / ad removes the lowest frequecy Together these filters separate the sigal ito low-frequecy ad high-frequecy

More information

Orthogonal Gaussian Filters for Signal Processing

Orthogonal Gaussian Filters for Signal Processing Orthogoal Gaussia Filters for Sigal Processig Mark Mackezie ad Kiet Tieu Mechaical Egieerig Uiversity of Wollogog.S.W. Australia Abstract A Gaussia filter usig the Hermite orthoormal series of fuctios

More information

Olli Simula T / Chapter 1 3. Olli Simula T / Chapter 1 5

Olli Simula T / Chapter 1 3. Olli Simula T / Chapter 1 5 Sigals ad Systems Sigals ad Systems Sigals are variables that carry iformatio Systemstake sigals as iputs ad produce sigals as outputs The course deals with the passage of sigals through systems T-6.4

More information

Signal Processing in Mechatronics. Lecture 3, Convolution, Fourier Series and Fourier Transform

Signal Processing in Mechatronics. Lecture 3, Convolution, Fourier Series and Fourier Transform Sigal Processig i Mechatroics Summer semester, 1 Lecture 3, Covolutio, Fourier Series ad Fourier rasform Dr. Zhu K.P. AIS, UM 1 1. Covolutio Covolutio Descriptio of LI Systems he mai premise is that the

More information

The z-transform. 7.1 Introduction. 7.2 The z-transform Derivation of the z-transform: x[n] = z n LTI system, h[n] z = re j

The z-transform. 7.1 Introduction. 7.2 The z-transform Derivation of the z-transform: x[n] = z n LTI system, h[n] z = re j The -Trasform 7. Itroductio Geeralie the complex siusoidal represetatio offered by DTFT to a represetatio of complex expoetial sigals. Obtai more geeral characteristics for discrete-time LTI systems. 7.

More information

Frequency Response of FIR Filters

Frequency Response of FIR Filters EEL335: Discrete-Time Sigals ad Systems. Itroductio I this set of otes, we itroduce the idea of the frequecy respose of LTI systems, ad focus specifically o the frequecy respose of FIR filters.. Steady-state

More information

Chapter 7: The z-transform. Chih-Wei Liu

Chapter 7: The z-transform. Chih-Wei Liu Chapter 7: The -Trasform Chih-Wei Liu Outlie Itroductio The -Trasform Properties of the Regio of Covergece Properties of the -Trasform Iversio of the -Trasform The Trasfer Fuctio Causality ad Stability

More information

Discrete-Time Signals and Systems. Signals and Systems. Digital Signals. Discrete-Time Signals. Operations on Sequences: Basic Operations

Discrete-Time Signals and Systems. Signals and Systems. Digital Signals. Discrete-Time Signals. Operations on Sequences: Basic Operations -6.3 Digital Sigal Processig ad Filterig..8 Discrete-ime Sigals ad Systems ime-domai Represetatios of Discrete-ime Sigals ad Systems ime-domai represetatio of a discrete-time sigal as a sequece of umbers

More information

Chapter 7 z-transform

Chapter 7 z-transform Chapter 7 -Trasform Itroductio Trasform Uilateral Trasform Properties Uilateral Trasform Iversio of Uilateral Trasform Determiig the Frequecy Respose from Poles ad Zeros Itroductio Role i Discrete-Time

More information

ADVANCED DIGITAL SIGNAL PROCESSING

ADVANCED DIGITAL SIGNAL PROCESSING ADVANCED DIGITAL SIGNAL PROCESSING PROF. S. C. CHAN (email : sccha@eee.hku.hk, Rm. CYC-702) DISCRETE-TIME SIGNALS AND SYSTEMS MULTI-DIMENSIONAL SIGNALS AND SYSTEMS RANDOM PROCESSES AND APPLICATIONS ADAPTIVE

More information

3. Z Transform. Recall that the Fourier transform (FT) of a DT signal xn [ ] is ( ) [ ] = In order for the FT to exist in the finite magnitude sense,

3. Z Transform. Recall that the Fourier transform (FT) of a DT signal xn [ ] is ( ) [ ] = In order for the FT to exist in the finite magnitude sense, 3. Z Trasform Referece: Etire Chapter 3 of text. Recall that the Fourier trasform (FT) of a DT sigal x [ ] is ω ( ) [ ] X e = j jω k = xe I order for the FT to exist i the fiite magitude sese, S = x [

More information

Infinite Sequences and Series

Infinite Sequences and Series Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet

More information

2D DSP Basics: 2D Systems

2D DSP Basics: 2D Systems - Digital Image Processig ad Compressio D DSP Basics: D Systems D Systems T[ ] y = T [ ] Liearity Additivity: If T y = T [ ] The + T y = y + y Homogeeity: If The T y = T [ ] a T y = ay = at [ ] Liearity

More information

Optimum LMSE Discrete Transform

Optimum LMSE Discrete Transform Image Trasformatio Two-dimesioal image trasforms are extremely importat areas of study i image processig. The image output i the trasformed space may be aalyzed, iterpreted, ad further processed for implemetig

More information

Image pyramid example

Image pyramid example Multiresolutio image processig Laplacia pyramids Discrete Wavelet Trasform (DWT) Quadrature mirror filters ad cojugate quadrature filters Liftig ad reversible wavelet trasform Wavelet theory Berd Girod:

More information

Chapter 2 Systems and Signals

Chapter 2 Systems and Signals Chapter 2 Systems ad Sigals 1 Itroductio Discrete-Time Sigals: Sequeces Discrete-Time Systems Properties of Liear Time-Ivariat Systems Liear Costat-Coefficiet Differece Equatios Frequecy-Domai Represetatio

More information

FIR Filter Design: Part II

FIR Filter Design: Part II EEL335: Discrete-Time Sigals ad Systems. Itroductio I this set of otes, we cosider how we might go about desigig FIR filters with arbitrary frequecy resposes, through compositio of multiple sigle-peak

More information

Chapter 6 Infinite Series

Chapter 6 Infinite Series Chapter 6 Ifiite Series I the previous chapter we cosidered itegrals which were improper i the sese that the iterval of itegratio was ubouded. I this chapter we are goig to discuss a topic which is somewhat

More information

The Discrete Fourier Transform

The Discrete Fourier Transform The iscrete Fourier Trasform The discrete-time Fourier trasform (TFT) of a sequece is a cotiuous fuctio of!, ad repeats with period. I practice we usually wat to obtai the Fourier compoets usig digital

More information

Run-length & Entropy Coding. Redundancy Removal. Sampling. Quantization. Perform inverse operations at the receiver EEE

Run-length & Entropy Coding. Redundancy Removal. Sampling. Quantization. Perform inverse operations at the receiver EEE Geeral e Image Coder Structure Motio Video (s 1,s 2,t) or (s 1,s 2 ) Natural Image Samplig A form of data compressio; usually lossless, but ca be lossy Redudacy Removal Lossless compressio: predictive

More information

Wavelet Transform and its relation to multirate filter banks

Wavelet Transform and its relation to multirate filter banks Wavelet Trasform ad its relatio to multirate filter bas Christia Walliger ASP Semiar th Jue 007 Graz Uiversity of Techology, Austria Professor Georg Holzma, Horst Cerja, Christia 9..005 Walliger.06.07

More information

EE / EEE SAMPLE STUDY MATERIAL. GATE, IES & PSUs Signal System. Electrical Engineering. Postal Correspondence Course

EE / EEE SAMPLE STUDY MATERIAL. GATE, IES & PSUs Signal System. Electrical Engineering. Postal Correspondence Course Sigal-EE Postal Correspodece Course 1 SAMPLE STUDY MATERIAL Electrical Egieerig EE / EEE Postal Correspodece Course GATE, IES & PSUs Sigal System Sigal-EE Postal Correspodece Course CONTENTS 1. SIGNAL

More information

Apply change-of-basis formula to rewrite x as a linear combination of eigenvectors v j.

Apply change-of-basis formula to rewrite x as a linear combination of eigenvectors v j. Eigevalue-Eigevector Istructor: Nam Su Wag eigemcd Ay vector i real Euclidea space of dimesio ca be uiquely epressed as a liear combiatio of liearly idepedet vectors (ie, basis) g j, j,,, α g α g α g α

More information

6.3 Testing Series With Positive Terms

6.3 Testing Series With Positive Terms 6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial

More information

Discrete-Time Systems, LTI Systems, and Discrete-Time Convolution

Discrete-Time Systems, LTI Systems, and Discrete-Time Convolution EEL5: Discrete-Time Sigals ad Systems. Itroductio I this set of otes, we begi our mathematical treatmet of discrete-time s. As show i Figure, a discrete-time operates or trasforms some iput sequece x [

More information

We are mainly going to be concerned with power series in x, such as. (x)} converges - that is, lims N n

We are mainly going to be concerned with power series in x, such as. (x)} converges - that is, lims N n Review of Power Series, Power Series Solutios A power series i x - a is a ifiite series of the form c (x a) =c +c (x a)+(x a) +... We also call this a power series cetered at a. Ex. (x+) is cetered at

More information

Linear time invariant systems

Linear time invariant systems Liear time ivariat systems Alejadro Ribeiro Dept. of Electrical ad Systems Egieerig Uiversity of Pesylvaia aribeiro@seas.upe.edu http://www.seas.upe.edu/users/~aribeiro/ February 25, 2016 Sigal ad Iformatio

More information

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + 62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of

More information

Definition 4.2. (a) A sequence {x n } in a Banach space X is a basis for X if. unique scalars a n (x) such that x = n. a n (x) x n. (4.

Definition 4.2. (a) A sequence {x n } in a Banach space X is a basis for X if. unique scalars a n (x) such that x = n. a n (x) x n. (4. 4. BASES I BAACH SPACES 39 4. BASES I BAACH SPACES Sice a Baach space X is a vector space, it must possess a Hamel, or vector space, basis, i.e., a subset {x γ } γ Γ whose fiite liear spa is all of X ad

More information

The Growth of Functions. Theoretical Supplement

The Growth of Functions. Theoretical Supplement The Growth of Fuctios Theoretical Supplemet The Triagle Iequality The triagle iequality is a algebraic tool that is ofte useful i maipulatig absolute values of fuctios. The triagle iequality says that

More information

Chapter 8. DFT : The Discrete Fourier Transform

Chapter 8. DFT : The Discrete Fourier Transform Chapter 8 DFT : The Discrete Fourier Trasform Roots of Uity Defiitio: A th root of uity is a complex umber x such that x The th roots of uity are: ω, ω,, ω - where ω e π /. Proof: (ω ) (e π / ) (e π )

More information

L = n i, i=1. dp p n 1

L = n i, i=1. dp p n 1 Exchageable sequeces ad probabilities for probabilities 1996; modified 98 5 21 to add material o mutual iformatio; modified 98 7 21 to add Heath-Sudderth proof of de Fietti represetatio; modified 99 11

More information

Introduction to Signals and Systems, Part V: Lecture Summary

Introduction to Signals and Systems, Part V: Lecture Summary EEL33: Discrete-Time Sigals ad Systems Itroductio to Sigals ad Systems, Part V: Lecture Summary Itroductio to Sigals ad Systems, Part V: Lecture Summary So far we have oly looked at examples of o-recursive

More information

Lesson 10: Limits and Continuity

Lesson 10: Limits and Continuity www.scimsacademy.com Lesso 10: Limits ad Cotiuity SCIMS Academy 1 Limit of a fuctio The cocept of limit of a fuctio is cetral to all other cocepts i calculus (like cotiuity, derivative, defiite itegrals

More information

CHAPTER 10 INFINITE SEQUENCES AND SERIES

CHAPTER 10 INFINITE SEQUENCES AND SERIES CHAPTER 10 INFINITE SEQUENCES AND SERIES 10.1 Sequeces 10.2 Ifiite Series 10.3 The Itegral Tests 10.4 Compariso Tests 10.5 The Ratio ad Root Tests 10.6 Alteratig Series: Absolute ad Coditioal Covergece

More information

Practical Spectral Anaysis (continue) (from Boaz Porat s book) Frequency Measurement

Practical Spectral Anaysis (continue) (from Boaz Porat s book) Frequency Measurement Practical Spectral Aaysis (cotiue) (from Boaz Porat s book) Frequecy Measuremet Oe of the most importat applicatios of the DFT is the measuremet of frequecies of periodic sigals (eg., siusoidal sigals),

More information

Wave Phenomena Physics 15c

Wave Phenomena Physics 15c Wave Pheomea Physics 5c Lecture Fourier Aalysis (H&L Sectios 3. 4) (Georgi Chapter ) Admiistravia! Midterm average 68! You did well i geeral! May got the easy parts wrog, e.g. Problem (a) ad 3(a)! erm

More information

Time-Domain Representations of LTI Systems

Time-Domain Representations of LTI Systems 2.1 Itroductio Objectives: 1. Impulse resposes of LTI systems 2. Liear costat-coefficiets differetial or differece equatios of LTI systems 3. Bloc diagram represetatios of LTI systems 4. State-variable

More information

PRELIM PROBLEM SOLUTIONS

PRELIM PROBLEM SOLUTIONS PRELIM PROBLEM SOLUTIONS THE GRAD STUDENTS + KEN Cotets. Complex Aalysis Practice Problems 2. 2. Real Aalysis Practice Problems 2. 4 3. Algebra Practice Problems 2. 8. Complex Aalysis Practice Problems

More information

FFTs in Graphics and Vision. The Fast Fourier Transform

FFTs in Graphics and Vision. The Fast Fourier Transform FFTs i Graphics ad Visio The Fast Fourier Trasform 1 Outlie The FFT Algorithm Applicatios i 1D Multi-Dimesioal FFTs More Applicatios Real FFTs 2 Computatioal Complexity To compute the movig dot-product

More information

Module 18 Discrete Time Signals and Z-Transforms Objective: Introduction : Description: Discrete Time Signal representation

Module 18 Discrete Time Signals and Z-Transforms Objective: Introduction : Description: Discrete Time Signal representation Module 8 Discrete Time Sigals ad Z-Trasforms Objective:To uderstad represetig discrete time sigals, apply z trasform for aalyzigdiscrete time sigals ad to uderstad the relatio to Fourier trasform Itroductio

More information

Frequency Domain Filtering

Frequency Domain Filtering Frequecy Domai Filterig Raga Rodrigo October 19, 2010 Outlie Cotets 1 Itroductio 1 2 Fourier Represetatio of Fiite-Duratio Sequeces: The Discrete Fourier Trasform 1 3 The 2-D Discrete Fourier Trasform

More information

x[0] x[1] x[2] Figure 2.1 Graphical representation of a discrete-time signal.

x[0] x[1] x[2] Figure 2.1 Graphical representation of a discrete-time signal. x[ ] x[ ] x[] x[] x[] x[] 9 8 7 6 5 4 3 3 4 5 6 7 8 9 Figure. Graphical represetatio of a discrete-time sigal. From Discrete-Time Sigal Processig, e by Oppeheim, Schafer, ad Buck 999- Pretice Hall, Ic.

More information

Describing Function: An Approximate Analysis Method

Describing Function: An Approximate Analysis Method Describig Fuctio: A Approximate Aalysis Method his chapter presets a method for approximately aalyzig oliear dyamical systems A closed-form aalytical solutio of a oliear dyamical system (eg, a oliear differetial

More information

Signal Processing. Lecture 02: Discrete Time Signals and Systems. Ahmet Taha Koru, Ph. D. Yildiz Technical University.

Signal Processing. Lecture 02: Discrete Time Signals and Systems. Ahmet Taha Koru, Ph. D. Yildiz Technical University. Sigal Processig Lecture 02: Discrete Time Sigals ad Systems Ahmet Taha Koru, Ph. D. Yildiz Techical Uiversity 2017-2018 Fall ATK (YTU) Sigal Processig 2017-2018 Fall 1 / 51 Discrete Time Sigals Discrete

More information

Singular Continuous Measures by Michael Pejic 5/14/10

Singular Continuous Measures by Michael Pejic 5/14/10 Sigular Cotiuous Measures by Michael Peic 5/4/0 Prelimiaries Give a set X, a σ-algebra o X is a collectio of subsets of X that cotais X ad ad is closed uder complemetatio ad coutable uios hece, coutable

More information

Chapter 10 Advanced Topics in Random Processes

Chapter 10 Advanced Topics in Random Processes ery Stark ad Joh W. Woods, Probability, Statistics, ad Radom Variables for Egieers, 4th ed., Pearso Educatio Ic.,. ISBN 978--3-33-6 Chapter Advaced opics i Radom Processes Sectios. Mea-Square (m.s.) Calculus

More information

Chapter 4 : Laplace Transform

Chapter 4 : Laplace Transform 4. Itroductio Laplace trasform is a alterative to solve the differetial equatio by the complex frequecy domai ( s = σ + jω), istead of the usual time domai. The DE ca be easily trasformed ito a algebraic

More information

CEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering

CEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio

More information

1.3 Convergence Theorems of Fourier Series. k k k k. N N k 1. With this in mind, we state (without proof) the convergence of Fourier series.

1.3 Convergence Theorems of Fourier Series. k k k k. N N k 1. With this in mind, we state (without proof) the convergence of Fourier series. .3 Covergece Theorems of Fourier Series I this sectio, we preset the covergece of Fourier series. A ifiite sum is, by defiitio, a limit of partial sums, that is, a cos( kx) b si( kx) lim a cos( kx) b si(

More information

Sequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence

Sequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece 1, 1, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet

More information

(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3

(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3 MATH 337 Sequeces Dr. Neal, WKU Let X be a metric space with distace fuctio d. We shall defie the geeral cocept of sequece ad limit i a metric space, the apply the results i particular to some special

More information

Chapter 10: Power Series

Chapter 10: Power Series Chapter : Power Series 57 Chapter Overview: Power Series The reaso series are part of a Calculus course is that there are fuctios which caot be itegrated. All power series, though, ca be itegrated because

More information

Solutions. Number of Problems: 4. None. Use only the prepared sheets for your solutions. Additional paper is available from the supervisors.

Solutions. Number of Problems: 4. None. Use only the prepared sheets for your solutions. Additional paper is available from the supervisors. Quiz November 4th, 23 Sigals & Systems (5-575-) P. Reist & Prof. R. D Adrea Solutios Exam Duratio: 4 miutes Number of Problems: 4 Permitted aids: Noe. Use oly the prepared sheets for your solutios. Additioal

More information

FIR Filter Design: Part I

FIR Filter Design: Part I EEL3: Discrete-Time Sigals ad Systems FIR Filter Desig: Part I. Itroductio FIR Filter Desig: Part I I this set o otes, we cotiue our exploratio o the requecy respose o FIR ilters. First, we cosider some

More information

Appendix: The Laplace Transform

Appendix: The Laplace Transform Appedix: The Laplace Trasform The Laplace trasform is a powerful method that ca be used to solve differetial equatio, ad other mathematical problems. Its stregth lies i the fact that it allows the trasformatio

More information

Discrete Orthogonal Moment Features Using Chebyshev Polynomials

Discrete Orthogonal Moment Features Using Chebyshev Polynomials Discrete Orthogoal Momet Features Usig Chebyshev Polyomials R. Mukuda, 1 S.H.Og ad P.A. Lee 3 1 Faculty of Iformatio Sciece ad Techology, Multimedia Uiversity 75450 Malacca, Malaysia. Istitute of Mathematical

More information

Fall 2011, EE123 Digital Signal Processing

Fall 2011, EE123 Digital Signal Processing Lecture 5 Miki Lustig, UCB September 14, 211 Miki Lustig, UCB Motivatios for Discrete Fourier Trasform Sampled represetatio i time ad frequecy umerical Fourier aalysis requires a Fourier represetatio that

More information

The Riemann Zeta Function

The Riemann Zeta Function Physics 6A Witer 6 The Riema Zeta Fuctio I this ote, I will sketch some of the mai properties of the Riema zeta fuctio, ζ(x). For x >, we defie ζ(x) =, x >. () x = For x, this sum diverges. However, we

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

M2.The Z-Transform and its Properties

M2.The Z-Transform and its Properties M2.The Z-Trasform ad its Properties Readig Material: Page 94-126 of chapter 3 3/22/2011 I. Discrete-Time Sigals ad Systems 1 What did we talk about i MM1? MM1 - Discrete-Time Sigal ad System 3/22/2011

More information

A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence

A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece,, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet as

More information

Math 155 (Lecture 3)

Math 155 (Lecture 3) Math 55 (Lecture 3) September 8, I this lecture, we ll cosider the aswer to oe of the most basic coutig problems i combiatorics Questio How may ways are there to choose a -elemet subset of the set {,,,

More information

PAPER : IIT-JAM 2010

PAPER : IIT-JAM 2010 MATHEMATICS-MA (CODE A) Q.-Q.5: Oly oe optio is correct for each questio. Each questio carries (+6) marks for correct aswer ad ( ) marks for icorrect aswer.. Which of the followig coditios does NOT esure

More information

Signal Processing in Mechatronics

Signal Processing in Mechatronics Sigal Processig i Mechatroics Zhu K.P. AIS, UM. Lecture, Brief itroductio to Sigals ad Systems, Review of Liear Algebra ad Sigal Processig Related Mathematics . Brief Itroductio to Sigals What is sigal

More information

Abstract Vector Spaces. Abstract Vector Spaces

Abstract Vector Spaces. Abstract Vector Spaces Astract Vector Spaces The process of astractio is critical i egieerig! Physical Device Data Storage Vector Space MRI machie Optical receiver 0 0 1 0 1 0 0 1 Icreasig astractio 6.1 Astract Vector Spaces

More information

Problem Cosider the curve give parametrically as x = si t ad y = + cos t for» t» ß: (a) Describe the path this traverses: Where does it start (whe t =

Problem Cosider the curve give parametrically as x = si t ad y = + cos t for» t» ß: (a) Describe the path this traverses: Where does it start (whe t = Mathematics Summer Wilso Fial Exam August 8, ANSWERS Problem 1 (a) Fid the solutio to y +x y = e x x that satisfies y() = 5 : This is already i the form we used for a first order liear differetial equatio,

More information

Chapter 4. Fourier Series

Chapter 4. Fourier Series Chapter 4. Fourier Series At this poit we are ready to ow cosider the caoical equatios. Cosider, for eample the heat equatio u t = u, < (4.) subject to u(, ) = si, u(, t) = u(, t) =. (4.) Here,

More information

Analog and Digital Signals. Introduction to Digital Signal Processing. Discrete-time Sinusoids. Analog and Digital Signals

Analog and Digital Signals. Introduction to Digital Signal Processing. Discrete-time Sinusoids. Analog and Digital Signals Itroductio to Digital Sigal Processig Chapter : Itroductio Aalog ad Digital Sigals aalog = cotiuous-time cotiuous amplitude digital = discrete-time discrete amplitude cotiuous amplitude discrete amplitude

More information

Chapter 6 Principles of Data Reduction

Chapter 6 Principles of Data Reduction Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a

More information

An Introduction to Randomized Algorithms

An Introduction to Randomized Algorithms A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis

More information

Spectral Analysis. This week in lab. Next classes: 3/26 and 3/28. Your next experiment Homework is to prepare

Spectral Analysis. This week in lab. Next classes: 3/26 and 3/28. Your next experiment Homework is to prepare Spectral Aalysis This week i lab Your ext experimet Homework is to prepare Next classes: 3/26 ad 3/28 Aero Testig, Fracture Toughess Testig Read the Experimets 5 ad 7 sectios of the course maual Spectral

More information

1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a real-valued radom variable

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science. BACKGROUND EXAM September 30, 2004.

MASSACHUSETTS INSTITUTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science. BACKGROUND EXAM September 30, 2004. MASSACHUSETTS INSTITUTE OF TECHNOLOGY Departmet of Electrical Egieerig ad Computer Sciece 6.34 Discrete Time Sigal Processig Fall 24 BACKGROUND EXAM September 3, 24. Full Name: Note: This exam is closed

More information

TEACHER CERTIFICATION STUDY GUIDE

TEACHER CERTIFICATION STUDY GUIDE COMPETENCY 1. ALGEBRA SKILL 1.1 1.1a. ALGEBRAIC STRUCTURES Kow why the real ad complex umbers are each a field, ad that particular rigs are ot fields (e.g., itegers, polyomial rigs, matrix rigs) Algebra

More information

Multiresolution coding and wavelets. Interpolation error coding, I

Multiresolution coding and wavelets. Interpolation error coding, I Multiresolutio codig ad wavelets Predictive (closed-loop) pyramids Ope-loop ( Laplacia ) pyramids Discrete Wavelet Trasform (DWT) Quadrature mirror filters ad cojugate quadrature filters Liftig ad reversible

More information

The z-transform can be used to obtain compact transform-domain representations of signals and systems. It

The z-transform can be used to obtain compact transform-domain representations of signals and systems. It 3 4 5 6 7 8 9 10 CHAPTER 3 11 THE Z-TRANSFORM 31 INTRODUCTION The z-trasform ca be used to obtai compact trasform-domai represetatios of sigals ad systems It provides ituitio particularly i LTI system

More information

ENGI Series Page 6-01

ENGI Series Page 6-01 ENGI 3425 6 Series Page 6-01 6. Series Cotets: 6.01 Sequeces; geeral term, limits, covergece 6.02 Series; summatio otatio, covergece, divergece test 6.03 Stadard Series; telescopig series, geometric series,

More information

Week 10. f2 j=2 2 j k ; j; k 2 Zg is an orthonormal basis for L 2 (R). This function is called mother wavelet, which can be often constructed

Week 10. f2 j=2 2 j k ; j; k 2 Zg is an orthonormal basis for L 2 (R). This function is called mother wavelet, which can be often constructed Wee 0 A Itroductio to Wavelet regressio. De itio: Wavelet is a fuctio such that f j= j ; j; Zg is a orthoormal basis for L (R). This fuctio is called mother wavelet, which ca be ofte costructed from father

More information

Sequences. Notation. Convergence of a Sequence

Sequences. Notation. Convergence of a Sequence Sequeces A sequece is essetially just a list. Defiitio (Sequece of Real Numbers). A sequece of real umbers is a fuctio Z (, ) R for some real umber. Do t let the descriptio of the domai cofuse you; it

More information

Discrete-Time Signals and Systems. Discrete-Time Signals and Systems. Signal Symmetry. Elementary Discrete-Time Signals.

Discrete-Time Signals and Systems. Discrete-Time Signals and Systems. Signal Symmetry. Elementary Discrete-Time Signals. Discrete-ime Sigals ad Systems Discrete-ime Sigals ad Systems Dr. Deepa Kudur Uiversity of oroto Referece: Sectios. -.5 of Joh G. Proakis ad Dimitris G. Maolakis, Digital Sigal Processig: Priciples, Algorithms,

More information

Advanced Stochastic Processes.

Advanced Stochastic Processes. Advaced Stochastic Processes. David Gamarik LECTURE 2 Radom variables ad measurable fuctios. Strog Law of Large Numbers (SLLN). Scary stuff cotiued... Outlie of Lecture Radom variables ad measurable fuctios.

More information

Riesz-Fischer Sequences and Lower Frame Bounds

Riesz-Fischer Sequences and Lower Frame Bounds Zeitschrift für Aalysis ud ihre Aweduge Joural for Aalysis ad its Applicatios Volume 1 (00), No., 305 314 Riesz-Fischer Sequeces ad Lower Frame Bouds P. Casazza, O. Christese, S. Li ad A. Lider Abstract.

More information

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i

More information

Digital Signal Processing, Fall 2006

Digital Signal Processing, Fall 2006 Digital Sigal Processig, Fall 26 Lecture 1: Itroductio, Discrete-time sigals ad systems Zheg-Hua Ta Departmet of Electroic Systems Aalborg Uiversity, Demark zt@kom.aau.dk 1 Part I: Itroductio Itroductio

More information

Principle Of Superposition

Principle Of Superposition ecture 5: PREIMINRY CONCEP O RUCUR NYI Priciple Of uperpositio Mathematically, the priciple of superpositio is stated as ( a ) G( a ) G( ) G a a or for a liear structural system, the respose at a give

More information

Lecture 2: Monte Carlo Simulation

Lecture 2: Monte Carlo Simulation STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?

More information

MAT1026 Calculus II Basic Convergence Tests for Series

MAT1026 Calculus II Basic Convergence Tests for Series MAT026 Calculus II Basic Covergece Tests for Series Egi MERMUT 202.03.08 Dokuz Eylül Uiversity Faculty of Sciece Departmet of Mathematics İzmir/TURKEY Cotets Mootoe Covergece Theorem 2 2 Series of Real

More information

Ma 4121: Introduction to Lebesgue Integration Solutions to Homework Assignment 5

Ma 4121: Introduction to Lebesgue Integration Solutions to Homework Assignment 5 Ma 42: Itroductio to Lebesgue Itegratio Solutios to Homework Assigmet 5 Prof. Wickerhauser Due Thursday, April th, 23 Please retur your solutios to the istructor by the ed of class o the due date. You

More information

Most text will write ordinary derivatives using either Leibniz notation 2 3. y + 5y= e and y y. xx tt t

Most text will write ordinary derivatives using either Leibniz notation 2 3. y + 5y= e and y y. xx tt t Itroductio to Differetial Equatios Defiitios ad Termiolog Differetial Equatio: A equatio cotaiig the derivatives of oe or more depedet variables, with respect to oe or more idepedet variables, is said

More information

Math 113 Exam 3 Practice

Math 113 Exam 3 Practice Math Exam Practice Exam 4 will cover.-., 0. ad 0.. Note that eve though. was tested i exam, questios from that sectios may also be o this exam. For practice problems o., refer to the last review. This

More information

Math 2784 (or 2794W) University of Connecticut

Math 2784 (or 2794W) University of Connecticut ORDERS OF GROWTH PAT SMITH Math 2784 (or 2794W) Uiversity of Coecticut Date: Mar. 2, 22. ORDERS OF GROWTH. Itroductio Gaiig a ituitive feel for the relative growth of fuctios is importat if you really

More information

Beurling Integers: Part 2

Beurling Integers: Part 2 Beurlig Itegers: Part 2 Isomorphisms Devi Platt July 11, 2015 1 Prime Factorizatio Sequeces I the last article we itroduced the Beurlig geeralized itegers, which ca be represeted as a sequece of real umbers

More information

A. Basics of Discrete Fourier Transform

A. Basics of Discrete Fourier Transform A. Basics of Discrete Fourier Trasform A.1. Defiitio of Discrete Fourier Trasform (8.5) A.2. Properties of Discrete Fourier Trasform (8.6) A.3. Spectral Aalysis of Cotiuous-Time Sigals Usig Discrete Fourier

More information

Zeros of Polynomials

Zeros of Polynomials Math 160 www.timetodare.com 4.5 4.6 Zeros of Polyomials I these sectios we will study polyomials algebraically. Most of our work will be cocered with fidig the solutios of polyomial equatios of ay degree

More information

Random Variables, Sampling and Estimation

Random Variables, Sampling and Estimation Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig

More information

3.2 Properties of Division 3.3 Zeros of Polynomials 3.4 Complex and Rational Zeros of Polynomials

3.2 Properties of Division 3.3 Zeros of Polynomials 3.4 Complex and Rational Zeros of Polynomials Math 60 www.timetodare.com 3. Properties of Divisio 3.3 Zeros of Polyomials 3.4 Complex ad Ratioal Zeros of Polyomials I these sectios we will study polyomials algebraically. Most of our work will be cocered

More information

ECE-S352 Introduction to Digital Signal Processing Lecture 3A Direct Solution of Difference Equations

ECE-S352 Introduction to Digital Signal Processing Lecture 3A Direct Solution of Difference Equations ECE-S352 Itroductio to Digital Sigal Processig Lecture 3A Direct Solutio of Differece Equatios Discrete Time Systems Described by Differece Equatios Uit impulse (sample) respose h() of a DT system allows

More information

x x x Using a second Taylor polynomial with remainder, find the best constant C so that for x 0,

x x x Using a second Taylor polynomial with remainder, find the best constant C so that for x 0, Math Activity 9( Due with Fial Eam) Usig first ad secod Taylor polyomials with remaider, show that for, 8 Usig a secod Taylor polyomial with remaider, fid the best costat C so that for, C 9 The th Derivative

More information

Bayesian Methods: Introduction to Multi-parameter Models

Bayesian Methods: Introduction to Multi-parameter Models Bayesia Methods: Itroductio to Multi-parameter Models Parameter: θ = ( θ, θ) Give Likelihood p(y θ) ad prior p(θ ), the posterior p proportioal to p(y θ) x p(θ ) Margial posterior ( θ, θ y) is Iterested

More information