Proc. IEEE Workshop on Signal Processing Systems (SIPS), Tampere, Finland, Oct. 7-9, 2009

Size: px
Start display at page:

Download "Proc. IEEE Workshop on Signal Processing Systems (SIPS), Tampere, Finland, Oct. 7-9, 2009"

Transcription

1 Proc IEEE Workshop o Sigal Processig Systems (SIPS), Tampere, Filad, Oct 7-9, 09 SOFTWAE DESIGNS OF IMAGE POCESSING TASKS WITH INCEMENTAL EFINEMENT OF COMPUTATION Davide Aastasia ad Yiais Adreopoulos Departmet of Electroic ad Electrical Egieerig, Uiversity College Lodo, UK ABSTACT We propose software desigs that perform icremetal computatio with mootoic distortio reductio for twodimesioal covolutio ad frame-by-frame block-matchig tasks I order to reduce the ru time of the proposed desigs, we combie plae-based computatio with a packig techique proposed recetly I the case of block matchig, we also utilize previously-computed motio vectors to perform localized search whe icremetig the precisio of the iput video frames The applicability of the proposed approach is demostrated by executio time measuremets o the xo-laptop ( 100$ laptop ) ad o a maistream laptop; our software is also made available olie I compariso to the covetioal (o-icremetal) software realizatio, the proposed approach leads to scalable computatio per iput frame while producig idetical (or comparable) precisio for the output results of each operatig poit I additio, the executio of the proposed desigs ca be arrarily termiated for each frame with the output beig available at the already-computed precisio Idex Terms complexity-scalable image processig, icremetal refiemet of computatio, programmable processors 1 INTODUCTION Several popular applicatios, such as media players, image ad video post-processig, ad motio estimatio ad compesatio, are beig implemeted today via software solutios i geeral-purpose processors New geeratios of processors are icreasigly powerful ad eable more dedicated resource allocatio to such real-time multimedia tasks due to multicore desigs [1] At the same time, ew geeratios of software compilers ow automatically geerate platform-specific optimized assembly code from C++ code [2], thereby eablig platform-idepedet C++ software solutios to achieve high processor utilizatio factors Existig algorithmic-orieted research focuses o complexity reductio [3]-[5] or complexity scalability for image processig tasks [6]-[8], where computatioal complexity is decreased ad approximate results are produced Implemetatio-orieted research focuses o multimediadrive eergy scalig of processors via dyamic voltage scalig [9] [10] i a attempt to provide computatioal scalability with approximate results However, previous approaches ca oly obtai oe operatioal poit i the complexity-distortio curve [3] [7], without beig able to icremet the quality of the output with icreased computatio I additio, i practical image ad video codig systems, complexity does ot scale dow sigificatly with decreased source precisio (decreased rate) [7] Fially, existig image processig realizatios produce a all or othig output: oe caot iterrupt the computatio whe system resources suddely become uavailable (or whe delay costraits are about to be violated) ad retrieve a meaigful approximatio of the fial result 1 A exceptio is foud i proposals for icremetal computatio of trasforms ad saliet poit detectio algorithms [11] [12], where the mai priciple is: uder a refiemet of the source descriptio, the computatio of the image processig task refies the previously-computed result However, existig work [11] [12] is usig arithmetic complexity estimates ad o practical realizatios are give I this paper we address this aspect by proposig a practical software framework for image processig tasks exhiig icremetal refiemet of computatio Our software desigs of two-dimesioal (2D) covolutio ad block-matchig operatios combie icremetal computatio with a recetlyproposed packig approach that eables the calculatio of multiple limited-dyamic-rage iteger operatios via oe 32- or 64- arithmetic operatio The proposed software desigs are validated i two differet systems ad are also provided olie [13] Sectio 2 presets the overall framework of icremetal refiemet of image processig operatios i software Sectios 3 ad 4 preset the proposed algorithms, while Sectio 5 presets the experimetal comparisos ad Sectio 6 cocludes the paper 2 IMAGE POCESSING TASKS USING INCEMENTAL PACKING AND UNPACKING A geeral depictio of the proposed framework for icremetal computatio based o source refiemets is preseted i Figure 1 I the followig subsectio we discuss this framework i more detail, while Subsectio 22 presets 1 Oe could potetially obtai a partial computatio of the fial result, eg parts of the covolutio or some block matchig results, but ot the etirety of the result with graceful degradatio

2 Proc IEEE Workshop o Sigal Processig Systems (SIPS), Tampere, Filad, Oct 7-9, 09 the basic tradeoffs of the proposed packig approach Two useful defiitios of quatities used i the remaider of the paper are give below Defiitio 1: For ay quatity a used i the computatio of a algorithm, a, 0 < N, is the computed value of a whe the iput cosists of plaes N 1 dow to (ad icludig) plae Defiitio 2: For ay quatity a used i the computatio of a algorithm, a, 0 < N, is the computed value of a whe oly plae of the iput is used The otatioal covetios of Defiitio 1 ad Defiitio 2 are exteded to matrices 2, eg A is the matrix cotaiig the computed coefficiets of A whe oly plae of the iput image is used 21 Overall Framework As show i Figure 1, a iput image is iitially partitioed ito M of o-overlappig blocks, whose biary (plae-byplae) represetatio is show i the middle of the figure, from the most-sigificat s (MSBs) to the least-sigificat s (LSBs) A total of N icremet layers are formed by groupig together the s of all blocks belogig to the same plae, where = N 1 correspods to the MSBs ad = 0 correspods to the LSBs Hece, oe ca have maximally N = 8 icremet layers for a 8- iput image Each icremet layer is also a layer of computatio ad we calculate the results of M blocks of each layer together usig a icremetal packig approach I particular, M blocks B1,,, B M, of oe layer are placed together i oe block D by: M λ ( m 1) ρ D [, i j] = B 1 m,[, i j]2, (1) m= where Bm, [, i j ] is the (, ij) th value of block B m, (1 m M ) that cotais parts of icremet layer belogig to the m th spatial block ad λ = 1 if 64- floatig-poit arithmetic is used, or λ = 1 if 32- usiged iteger arithmetic is used The last equatio shows that the th plae of the m th block is scaled by λ 2 ( m 1) ρ, ρ > 0, ad is the added to the sum of the previous blocks 1,, m 1 of the same icremet layer This leads to a packed icremet layer havig all M blocks placed o oe block D ad usig iteger or floatig-poit arithmetic The best choice for the utilized arithmetic is system depedet, as it will be show by our experimets After the packig approach, the desired image processig task op is applied to D for each layer, 0 < N, eg covolutio with kerel K is performed by: ( ) = op D K (2) Depedig o the algorithm of iterest, oe could localize the 2 Boldface capital letters idicate matrices; the correspodig italicized letters idicate idividual matrix elemets, eg A ad Ai [, j ]; all idexes are itegers; superscripts i matrices or scalars idicate the plae umber ad the frame idex, the distictio betwee the two is idetifiable from the cotext calculatio of (2) aroud areas of iterest based o the previously-computed icremet layers (as idicated i Figure 1) This will be used i the block matchig task If a appropriate coefficiet ρ is chose for (1), it ca be show [14] that the results of all the blocks withi icremet layer ca be extracted from if: the processig kerel K cotais itegers; op is a liear operatio This is based o the so-called ivaders approach [14], where ay iteger liear operatio ca be performed by packig multiple operatios together [see (1)], ad the upackig them by the reverse operatio performed recursively for all values of all blocks For floatig-poit arithmetic ( λ = 1 ): 1, m = U i j = [ i, j ] + 05 (3) ρ m {2, M} : [ i, j] 2 ( [ i, j] Um 1,[ i, j] ) Um,[ i, j] = [ i, j] + 05 (4) where U m, is the output icremet of the result for block m, a + 05 performs roudig to the earest iteger, ad a f() a assigs fa () to a For iteger arithmetic ( λ = 1 ), the upackig is performed by: m = 1 : U [ i, j ] = mod [ i, j ],2 ρ (5) 1, ρ m, = ρ ρ ρ ( ) m {2, M} : [ i, j] 2 [ i, j] (6) ρ U [ i, j] mod ( [ i, j],2 ) where mod( a,2 ) = a a 2 2 is the modulo operatio The selectio of the appropriate packig coefficiet ρ depeds o the specific algorithm beig cosidered I additio, eve though Figure 1 shows all blocks of the iput image beig packed together, i practice the value of M depeds o the dyamic rage of the result of each icremet layer These aspects are elaborated further i the followig sectios As show i Figure 1, after upackig, the fial stage of the proposed computatio icremets the previously-computed results of icremet layers N 1,, + 1 by addig to them the results of the curret layer, U1,,, U M, : + 1 m {1, M} : Um, = Um, + U m,, (7) N with Um, 0 This leads to computatio of the processig task with icreasig precisio for icreasig icremet layers, as show i the visual examples of Figure 1 Due to the utilizatio of the packig techique, the results of all M blocks are computed simultaeously by (2) Depedig o the overhead of the packig ad upackig, we expect to save operatios i compariso to the direct computatio of each layer 22 Discussio The parameters cotrollig the proposed approach of Figure 1 are: the total umber of icremet layers ( N ), the total umber of blocks ( M ), ad parameter ρ that affects the packig of multiple icremet layers i oe operad D [, i j ] Ideally, we would like to maximize the packig capability i order to perform as may operatios simultaeously as possible [14]

3 Proc IEEE Workshop o Sigal Processig Systems (SIPS), Tampere, Filad, Oct 7-9, 09 Iput image S p a t i a l I m a g e P a r t i t i o i g Image block plaes Image block 1 Image block M Icremet layer Packig esults from previous layers: N-1,N-2,,+1 Upackig Algorithm computatio usig layer esults of layer Processed iput image up to layer =6 =4 + =2 Figure 1 Icremetal refiemet of computatio usig packig ad upackig of icremet layers extracted progressively from the iput image data The output result is progressively refied via the computatio of more icremet layers The computatio of each layer ca also utilize results from previous layers to reduce complexity As aalyzed i the origial ivaders algorithm, the packig capability depeds o the dyamic rage of the operatios Furthermore, if packig with iteger arithmetic is desired, ρ has to be iteger The maximum packig coefficiet caot be smaller tha 2 for 64- floatig-poit arithmetic [14], ad it caot be larger tha 2 31 for 32- usiged iteger arithmetic, which leads to M 05( λ 1) + ρ = ω, with ω = or ω = 31, respectively If the rage of all outputs ( Bm, op K ) (for every plae ad block m ) is cotaied i the iterval [ Amax, Amax ], the, for loose packig, ρ log2a max + 1 Selectig the miimum value of ρ satisfyig the iequality, we reach ω M 05( λ 1) log2a max + 1 (8) As expected, the umber of packed blocks decreases with the icrease of the output s dyamic rage The output dyamic rage of each layer depeds o the algorithm of iterest ad it will be discussed i the followig sectio Fially, i order to esure there is o umerical error i the calculatio whe packig with floatig-poit arithmetic, the magitude of the maximum possible error [14] must allow for correct roudig of the fial results, ie: ω ( M 1) ρ Amax 2 2 < 05 (9) I our desigs, M is iitially derived by (8) ad the decreased (if eeded) so that (9) holds 3 INCEMENTAL 2D CONVOLUTION For a image cosistig of i C i pixels, the block partitioig of this case separates the image ito M partially overlappig horizotal stripes, each of which is the 0 cosidered to be the iput block of samples, B m (1 m M ), havig C i colums The umber of rows i each block is cotrolled by the iput image rows ad the packig capability (ie the value of M ) The covolutio filter is give by a V kerel C -coefficiet kerel kerel T ad cov covolutio of the m th block is performed by: 0 0,, cov m {1, M} : Um = Bm T (10) I order to produce the correct result with the block-based calculatio of (10), cosecutive blocks share a commo subset of rows V overlap = V kerel 2, ie the first block ( stripe ) is overlappig with the secod block vertically by V overlap rows, all subsequet blocks overlap with their previous ad ext blocks by V overlap rows (above ad below the block), ad the last block overlaps with its previous block by V overlap rows Whe plaes of the iput are used, the process ca be performed for each plae of the m th block by: m, m, cov m {1, M} : U = B T (11) ad the results are added to the previous oes by (7) If we cosider packig the results i order to accelerate the icremetal computatio, the D is formed by (1) ad it is used to compute the packed result of all M blocks by: = cov D T (12) The results are upacked from usig (3) ad (4) ad the fial results per plae are derived by (7) Visual examples of Gaussia filterig whe {6, 4, 2} are give i Figure 1 The packig capability depeds o the worst-case dyamic rage A max of the calculatio of oe icremet layer This ca be pre-calculated whe the covolutio kerel is kow to the system by isertig as iput the worst-case sub-block: 0 i < V q kerel 1, if ( 1) Tcov[ i, j] > 0 : Bmax, q[, i j] = (13) 0 j < Ckerel 0, q if ( 1) Tcov[ i, j] 0 for q = {0,1} ad the: Vkerel kerel { 1 C 1 i= 0 j= 0 q } A = max B [ i, j ] T [ i, j ] max max, cov q

4 Proc IEEE Workshop o Sigal Processig Systems (SIPS), Tampere, Filad, Oct 7-9, 09 Kerels with o-iteger coefficiets ca be approximated by a fixed-poit (FXP) represetatio with the appropriate umber of fractioal s Hece, they ca be computed by covolutio with a iteger kerel followed by iverse scalig after the termiatio of the calculatio ad ca be accommodated by our framework Fially, whe usig packig with iteger arithmetic, the icremetal approach preseted i this sectio oly covers the use of covolutio kerels with o-egative coefficiets Some additioal calculatios are required i order to preserve the sig iformatio correctly whe packig with iteger arithmetic (this is ot a issue with floatig-poit [14]) This will be detailed i future work 4 INCEMENTAL BLOCK MATCHING The problem of block matchig betwee two successive images 0, t 1 I ad I 0, t (of C pixels) ca be abstracted as i i follows Give the m th o-overlappig block of C C pixels i 0, t I (1 m M ) ad a search area of 2W 2W overlappig blocks i 0, t I 1, fid the C C block i the search area that is closest to the m th block Covetioal search algorithms are usig o-liear distace criteria, such as the mea-square error or the sum of absolute differeces [5] Hece, they caot be performed based o the proposed packig framework However, previous research [4] [] has show that approximatios of the highly-complex SAD-based -search motio estimatio usig simpler wise criteria ca derive block matchig schemes with comparable matchig accuracy but with much lower complexity Sice a wise distace criterio is a atural fit for the proposed plae-based computatio, i this paper we focus o icremetal approximatios of -search block matchig uder such frameworks I particular, we cosider here the popular oe- motio estimatio of Nataraja et al [4], where a biarizatio of the iput image is performed prior to block matchig ad the exclusive-o (XO) fuctio is used as a matchig criterio This block matchig method starts with the applicatio of a iteger high-pass 2D mask T high to the iput images: τ { t 1, t} : high, = I T high, (14) where we use the 19x19 mask proposed by Erturk []: 1 16, if ( ij, ) {(0, 9),(3, 6),(3,12),(6, 3), (6, 9),(6,),(9, 0),(9, 6), T (9,12),(9,18),(12, 3),(12, 9), high[, i j] = (12,),(, 6),(,12),(18, 9) } 0, otherwise After filterig, the oe- represetatio of the filtered image is formed by thresholdig the high-frequecy images [4]: 0 i < i 1,if high,[ i, j] I[ i j] : bi,[ i, j]= () 0 j < C i 0, otherwise The, block matchig is performed betwee all M ooverlappig blocks of C C (biarized) pixels i 0, t bi, (1 m M ) ad their correspodig (biarized) search t For each block m at positio ( ) areas i 0, 1 bi, im, j m withi image 0, t bi,, this derives the optimal locatio { x 0,* 0,* m,, y m, } of the matchig block withi its search area 0, t 1 ( W x, y < W ) i frame by: bi, C 1C 1 0,* 0,* 0, t m, m, bi, m m xy, i = 0 j = 0 0, t 1 bi, m m { } { x, y =argmi [ i + i, j + j] (16) [ i + i+ x, j + j+ y] The distace fuctio of (16) is simply the summatio of the result of the XO operatio betwee the curret block ad each block of the search area, which is the Hammig weight This ca be parallelized by packig 32 values of 0, t bi, ad 0, t 1 bi, i two usiged 32- operads ad usig a specific processor istructio or a few low-cost operatios for the calculatio of their Hammig weight [4] Whe all plaes { N 1, N 2,,0} of the iput images I are processed idepedetly, the first part ca be performed by the icremetal covolutio approach of the, τ previous sectio Oce the results high, of the covolutio have bee produced, the biarizatio of () is applied i order, τ to produce The, for every, the best match per bi,, τ bi, block is foud by (16) usig ad 32- iteger packig However, the above techique is expected to icrease the executio time for the icremetal block matchig process, as each icremet layer applies the search algorithm I order to accelerate this case, we utilize the kowledge of the best match foud for each block durig the previous icremet layers N 1,, + 1 This is performed as follows For the first icremet layer = N 1, we perform a fast search usig logarithmic-step search [5] Subsequetly, for each block m we oly search i the eighborhood of the previously-foud best match for this block The localized search patter is a spiral search with a fixed distace limit of W spiral pixels horizotally ad vertically (see [13] for more details) The use of log-search ad the localizatio of the search aroud the previously-foud best match will produce approximate results per icremet layer Comparisos agaist the o-icremetal search algorithm i terms of predictio quality (via block matchig) vs complexity are show i the ext sectio 5 EXPEIMENTAL ESULTS For our experimets we used the xo-laptop of the OLPC foudatio ruig its ative Liux operatig system (deoted as low-ed profile) ad a Dell Latitude D6 maistream laptop with a Itel Core 2 Duo processor (at 22GHz ad with 2Gb AM) ruig Microsoft Widows XP (deoted as maistream profile) All programs were writte i C++ ad compiled with the gcc412 compiler i Liux ad with the Microsoft Visual Studio 08 compiler i Widows, with all default optimizatios of -o2 (maximize speed) mode i both cases To achieve stable executio-time measuremets with high precisio i both platforms, we used the Widows QueryPerformaceCouter() fuctio ad the Liux gettimeofday() fuctio ad ru all programs i highest priority Oly the executio time required for the computatio }

5 Proc IEEE Workshop o Sigal Processig Systems (SIPS), Tampere, Filad, Oct 7-9, 09 was measured (ad coverted to millisecods based o systemspecific timig measuremet) We excluded all I/O time from/to the disk, sice it produced fixed overhead We utilized three CIF video sequeces of 0 frames each For the low-ed profile, we dowsampled the sequeces to QCIF format at 10Hz i order to achieve real-time (or ear real-time) processig with the xo-laptop For each task, the results preset either the sigal-to-oise ratio (SN) or the peak-sigal-to-oise ratio (PSN) for the CIF sequeces (similar SN/PSN results were obtaied for the QCIF sequeces) SN was measured for all covolutio experimets usig as referece (oise-free) the result whe processig up to the LSBs of each frame ( = 0 ) PSN was measured for the block matchig experimet by usig the predictio error of frame-by-frame motio compesatio (usig the origial frames) with the produced motio vectors of each algorithm 51 Icremetal 2D Covolutio Experimets We preset results with 12x12 ad 6x6 Gaussia kerels with their coefficiets approximated by FXP represetatio with fractioal part set to 8 s ad 6 s, respectively The small kerel is applied i the low-ed profile ad the large oe i the maistream profile We also performed a experimet of block cross-correlatio usig radom image blocks of 8x8 ad 4x4 pixels as kerel T cov for the two profiles Idicative results are show i Figure 2 ad Figure 3, where we also report the umber of packed blocks ( M ) achieved by the icremetal approach esults for the covetioal approach are show whe usig floatig-poit ad iteger arithmetic I this way we demostrate that the low-ed profile has better performace with 32- usiged itegers, while the maistream profile is faster with 64- floatig-poit arithmetic For the results of the icremetal approach, istead of isertig each plae separately i the icremetal computatio, we iserted pairs of plaes together Per video frame, this provides four termiatio poits for the algorithm s executio, which are idicated by the termiatig plaes of the figures The covetioal (o-icremetal) approach was executed four times, each time usig the source precisio idicated by the termiatig plaes i the figures The experimets of Figure 2 ad Figure 3 idicate that, ulike the covetioal approach, icremetal computatio ca achieve extremely scalable complexity with varyig source precisio Idetical SN results were obtaied for both covetioal ad icremetal algorithms Importatly, the icremetal approach ca produce all executio-time vs distortio measuremets via oe sigle executio I other words, if, for ay frame, the computatio is termiated arrarily at a give poit by a task scheduler, the results based o the already computed plaes of that frame are readily available i the program s allocated memory Whe computatio is performed for all plaes ( = 0 ), the icremetal approach is less efficiet i compariso to the best case for the covetioal approach Our experimets demostrate that the overhead is miimized whe the umber of termiatig plaes is smaller or equal to the umber of packed blocks M ; this is achieved i the maistream profile If more termiatig plaes tha M are requested, the the proposed approach becomes less efficiet at precisio 52 Icremetal Block Matchig Experimets Idicative results of the block matchig algorithms are show i Figure 4 We preset the case of C = W = 16 Sice the covolutio kerel T high of Erturk [] oly requires 16 additios, it was foud experimetally that i the icremetal algorithm ca perform the covolutio directly per iput set of plaes (rather tha use the packig approach) without sigificat overhead Similar to the previous case, istead of always isertig idividual plaes, we iserted the last plaes together (as idicated by the termiatig plaes of Figure 4) This occurred because the results demostrate that the predictio quality icreases margially whe < 5 Executio Time (ms) Executio Time (ms) Average time per frame for 6x6 covolutio (low-ed, M=3) Executio Time (ms) Covetioal (it) Covetioal (it) 10 Icremetal 10 Icremetal Covetioal (float) Covetioal (float) Termiatig Bitplae Termiatig Bitplae Average time per frame for 12x12 covolutio (maistream, M=4) SN (db) - agaist ref at = Average SN per frame for 12x12 covolutio All Algorithms Termiatig Bitplae Figure 2 Executio times for FXP covolutio ad correspodig SN per CIF frame i fuctio of termiatig plaes Average time per frame for 4x4 cross-correlatio (low-ed, M=3) Executio Time (ms) Covetioal (it) 10 Icremetal Covetioal (float) Termiatig Bitplae Termiatig Bitplae Average time per frame for 8x8 cross-correlatio (maisteam, M=4) SN (db) - agaist ref at = Covetioal (it) 18 Icremetal 14 Covetioal (float) 10 Average SN per frame for 8x8 cross-correlatio All Algorithms Termiatig Bitplae Figure 3 Executio times for cross-correlatio ad correspodig SN per CIF frame i fuctio of termiatig plaes

6 Proc IEEE Workshop o Sigal Processig Systems (SIPS), Tampere, Filad, Oct 7-9, 09 The experimets demostrate that the log-search performed for the first termiatig biplae ( = 7 ) provides sigificatly iferior predictio result for the icremetal method as compared to the covetioal approach that performs search However, the predictio quality of the icremetal algorithm becomes comparable to the covetioal approach oce more plaes are processed ad the spiral search refies the motio vector per block (06dB iferior at = 0 ) Sice the performace seems to saturate whe < 5, this ca be exploited by the proposed approach to termiate the computatio earlier ad achieve ear real-time performace for both profiles, somethig that the covetioal approach caot take advatage of, sice its executio time does ot scale dow sigificatly with decreased source precisio Our approach presets successively-refied precisio of block matchig with additioal computatio as more plaes are processed, without the eed to re-compute the result for each ew plae This eables the arrary termiatio of block matchig per frame whe delay costraits are met (or whe resources suddely become uavailable) ad retaiig the vectors of all blocks with the already-computed precisio 6 CONCLUSION A ovel, software-based, icremetal computatio approach for 2D covolutio ad block matchig algorithms was proposed ad made available olie [13] The measured rutime of the proposed desigs decreases five-fold (or more) with decreased iput/output SN or PSN, by utilizig a plaebased packig techique ad reusig previously-computed results The covetioal computatio does ot achieve such quality vs complexity scalability, as show by experimetal results o two differet platforms Our method also allows for early termiatio with graceful degradatio ad has these features without platform-specific customizatio Well-kow techiques, eg multithreadig, ca be applied to our approach to improve its executio time without affectig its scalability 7 ACKNOWLEDGEMENT This work was supported by EPSC, grat EP/F00/1 EFEENCES [1] D Geer, Chip makers tur to multicore processors, IEEE Computer, vol 38, o 5, pp 11-13, May 05 [2] A J C Bik, D L Kreitzer, ad X Tia, A case study o compiler optimizatios for the Itel Core 2 Duo processor, It J Parallel Prog, vol 36, Apr 08 [3] V K Goyal, ad M Vetterli, Computatio-distortio characteristics of block trasform codig, Proc IEEE It Cof o Accoust, Speech, ad Sigal Proc, vol 4, pp , April 1997 [4] B Nataraja, et al, Low-complexity block-based motio estimatio via oe- trasforms, IEEE Tras Circ ad Syst Video Techol, vol 7, o 4, Aug 1997 [5] B Zeg, et al, Optimizatio of fast block motio estimatio algorithms, IEEE Tras Circ ad Syst Video Techol, vol 7, o 6, Dec 1997 [6] K Legwehasatit ad A Ortega, Scalable variable complexity approximate forward DCT, IEEE Tras Circ ad Syst Video Techol, vol 14, o 11, pp , Nov 04 [7] D Turaga, M va der Schaar, ad B Pesquet-Popescu, Complexity scalable motio compesated wavelet video ecodig, IEEE Tras Circ Syst Video Techol, vol, o 8, Aug 05 [8] S H Nawab, A V Oppeheim, A Chadrakasa, J Wiograd, ad J T Ludwig, Approximate Sigal Processig, J of VLSI Sigal Process, vol, o pp 177-0, 1997 [9] W Yua ad K Nahrstedt, Practical voltage scalig for mobile multimedia devices, ACM Iterat Cof Multimedia, pp , 04 [10] E Akyol ad M va der Schaar, Complexity model based proactive dyamic voltage scalig for video decodig systems, IEEE Tras o Multimedia, vol 9, o 7, pp , Nov 07 [11] J Wiograd ad S H Nawab, Icremetal refiemet of DFT ad STFT approximatios, IEEE Sigal Process Letters, vol 2, o 2, pp -27, Feb 1995 [12] Y Adreopoulos ad I Patras, "Icremetal refiemet of image saliet-poit detectio," IEEE Tras o Image Process, vol 17, o 9, pp , Sept 08 [13] [14] A Kadyrov ad M Petrou, The Ivaders algorithm: rage of values modulatio for accelerated correlatio, IEEE Tras PAMI, vol 28, o 11, pp , Nov 06 [] S Erturk, Multiplicatio-free oe- trasform for lowcomplexity block-based motio estimatio, IEEE Sigal Process Letters, vol 14, o 2, Feb 07 Executio Time (ms) Average time per frame for 16x16 block matchig (low-ed) Covetioal Icremetal Termiatig Bitplae Executio Time (ms) Average time per frame for 16x16 block matchig (maistream) Covetioal Icremetal Termiatig Bitplae PSN (db) Average PSN per frame for 16x16 block matchig Covetioal Icremetal Termiatig Bitplae Figure 4 Executio times for block matchig ad average PSN per predicted CIF frame i fuctio of termiatig plaes

w (1) ˆx w (1) x (1) /ρ and w (2) ˆx w (2) x (2) /ρ.

w (1) ˆx w (1) x (1) /ρ and w (2) ˆx w (2) x (2) /ρ. 2 5. Weighted umber of late jobs 5.1. Release dates ad due dates: maximimizig the weight of o-time jobs Oce we add release dates, miimizig the umber of late jobs becomes a sigificatly harder problem. For

More information

Run-length & Entropy Coding. Redundancy Removal. Sampling. Quantization. Perform inverse operations at the receiver EEE

Run-length & Entropy Coding. Redundancy Removal. Sampling. Quantization. Perform inverse operations at the receiver EEE Geeral e Image Coder Structure Motio Video (s 1,s 2,t) or (s 1,s 2 ) Natural Image Samplig A form of data compressio; usually lossless, but ca be lossy Redudacy Removal Lossless compressio: predictive

More information

Module 5 EMBEDDED WAVELET CODING. Version 2 ECE IIT, Kharagpur

Module 5 EMBEDDED WAVELET CODING. Version 2 ECE IIT, Kharagpur Module 5 EMBEDDED WAVELET CODING Versio ECE IIT, Kharagpur Lesso 4 SPIHT algorithm Versio ECE IIT, Kharagpur Istructioal Objectives At the ed of this lesso, the studets should be able to:. State the limitatios

More information

Optimum LMSE Discrete Transform

Optimum LMSE Discrete Transform Image Trasformatio Two-dimesioal image trasforms are extremely importat areas of study i image processig. The image output i the trasformed space may be aalyzed, iterpreted, ad further processed for implemetig

More information

Introduction to Signals and Systems, Part V: Lecture Summary

Introduction to Signals and Systems, Part V: Lecture Summary EEL33: Discrete-Time Sigals ad Systems Itroductio to Sigals ad Systems, Part V: Lecture Summary Itroductio to Sigals ad Systems, Part V: Lecture Summary So far we have oly looked at examples of o-recursive

More information

1 Hash tables. 1.1 Implementation

1 Hash tables. 1.1 Implementation Lecture 8 Hash Tables, Uiversal Hash Fuctios, Balls ad Bis Scribes: Luke Johsto, Moses Charikar, G. Valiat Date: Oct 18, 2017 Adapted From Virgiia Williams lecture otes 1 Hash tables A hash table is a

More information

Definitions and Theorems. where x are the decision variables. c, b, and a are constant coefficients.

Definitions and Theorems. where x are the decision variables. c, b, and a are constant coefficients. Defiitios ad Theorems Remember the scalar form of the liear programmig problem, Miimize, Subject to, f(x) = c i x i a 1i x i = b 1 a mi x i = b m x i 0 i = 1,2,, where x are the decisio variables. c, b,

More information

IP Reference guide for integer programming formulations.

IP Reference guide for integer programming formulations. IP Referece guide for iteger programmig formulatios. by James B. Orli for 15.053 ad 15.058 This documet is iteded as a compact (or relatively compact) guide to the formulatio of iteger programs. For more

More information

On Random Line Segments in the Unit Square

On Random Line Segments in the Unit Square O Radom Lie Segmets i the Uit Square Thomas A. Courtade Departmet of Electrical Egieerig Uiversity of Califoria Los Ageles, Califoria 90095 Email: tacourta@ee.ucla.edu I. INTRODUCTION Let Q = [0, 1] [0,

More information

CS284A: Representations and Algorithms in Molecular Biology

CS284A: Representations and Algorithms in Molecular Biology CS284A: Represetatios ad Algorithms i Molecular Biology Scribe Notes o Lectures 3 & 4: Motif Discovery via Eumeratio & Motif Represetatio Usig Positio Weight Matrix Joshua Gervi Based o presetatios by

More information

Invariability of Remainder Based Reversible Watermarking

Invariability of Remainder Based Reversible Watermarking Joural of Network Itelligece c 16 ISSN 21-8105 (Olie) Taiwa Ubiquitous Iformatio Volume 1, Number 1, February 16 Ivariability of Remaider Based Reversible Watermarkig Shao-Wei Weg School of Iformatio Egieerig

More information

Discrete-Time Systems, LTI Systems, and Discrete-Time Convolution

Discrete-Time Systems, LTI Systems, and Discrete-Time Convolution EEL5: Discrete-Time Sigals ad Systems. Itroductio I this set of otes, we begi our mathematical treatmet of discrete-time s. As show i Figure, a discrete-time operates or trasforms some iput sequece x [

More information

Orthogonal Gaussian Filters for Signal Processing

Orthogonal Gaussian Filters for Signal Processing Orthogoal Gaussia Filters for Sigal Processig Mark Mackezie ad Kiet Tieu Mechaical Egieerig Uiversity of Wollogog.S.W. Australia Abstract A Gaussia filter usig the Hermite orthoormal series of fuctios

More information

Analysis of Algorithms. Introduction. Contents

Analysis of Algorithms. Introduction. Contents Itroductio The focus of this module is mathematical aspects of algorithms. Our mai focus is aalysis of algorithms, which meas evaluatig efficiecy of algorithms by aalytical ad mathematical methods. We

More information

Practical Spectral Anaysis (continue) (from Boaz Porat s book) Frequency Measurement

Practical Spectral Anaysis (continue) (from Boaz Porat s book) Frequency Measurement Practical Spectral Aaysis (cotiue) (from Boaz Porat s book) Frequecy Measuremet Oe of the most importat applicatios of the DFT is the measuremet of frequecies of periodic sigals (eg., siusoidal sigals),

More information

The Discrete Fourier Transform

The Discrete Fourier Transform The iscrete Fourier Trasform The discrete-time Fourier trasform (TFT) of a sequece is a cotiuous fuctio of!, ad repeats with period. I practice we usually wat to obtai the Fourier compoets usig digital

More information

THE KALMAN FILTER RAUL ROJAS

THE KALMAN FILTER RAUL ROJAS THE KALMAN FILTER RAUL ROJAS Abstract. This paper provides a getle itroductio to the Kalma filter, a umerical method that ca be used for sesor fusio or for calculatio of trajectories. First, we cosider

More information

Olli Simula T / Chapter 1 3. Olli Simula T / Chapter 1 5

Olli Simula T / Chapter 1 3. Olli Simula T / Chapter 1 5 Sigals ad Systems Sigals ad Systems Sigals are variables that carry iformatio Systemstake sigals as iputs ad produce sigals as outputs The course deals with the passage of sigals through systems T-6.4

More information

6.3 Testing Series With Positive Terms

6.3 Testing Series With Positive Terms 6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial

More information

Filter banks. Separately, the lowpass and highpass filters are not invertible. removes the highest frequency 1/ 2and

Filter banks. Separately, the lowpass and highpass filters are not invertible. removes the highest frequency 1/ 2and Filter bas Separately, the lowpass ad highpass filters are ot ivertible T removes the highest frequecy / ad removes the lowest frequecy Together these filters separate the sigal ito low-frequecy ad high-frequecy

More information

4.3 Growth Rates of Solutions to Recurrences

4.3 Growth Rates of Solutions to Recurrences 4.3. GROWTH RATES OF SOLUTIONS TO RECURRENCES 81 4.3 Growth Rates of Solutios to Recurreces 4.3.1 Divide ad Coquer Algorithms Oe of the most basic ad powerful algorithmic techiques is divide ad coquer.

More information

Classification of problem & problem solving strategies. classification of time complexities (linear, logarithmic etc)

Classification of problem & problem solving strategies. classification of time complexities (linear, logarithmic etc) Classificatio of problem & problem solvig strategies classificatio of time complexities (liear, arithmic etc) Problem subdivisio Divide ad Coquer strategy. Asymptotic otatios, lower boud ad upper boud:

More information

THE ASYMPTOTIC COMPLEXITY OF MATRIX REDUCTION OVER FINITE FIELDS

THE ASYMPTOTIC COMPLEXITY OF MATRIX REDUCTION OVER FINITE FIELDS THE ASYMPTOTIC COMPLEXITY OF MATRIX REDUCTION OVER FINITE FIELDS DEMETRES CHRISTOFIDES Abstract. Cosider a ivertible matrix over some field. The Gauss-Jorda elimiatio reduces this matrix to the idetity

More information

Vector Quantization: a Limiting Case of EM

Vector Quantization: a Limiting Case of EM . Itroductio & defiitios Assume that you are give a data set X = { x j }, j { 2,,, }, of d -dimesioal vectors. The vector quatizatio (VQ) problem requires that we fid a set of prototype vectors Z = { z

More information

Number Representation

Number Representation Number Represetatio 1 Number System :: The Basics We are accustomed to usig the so-called decimal umber system Te digits :: 0,1,2,3,4,5,6,7,8,9 Every digit positio has a weight which is a power of 10 Base

More information

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + 62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of

More information

Signals & Systems Chapter3

Signals & Systems Chapter3 Sigals & Systems Chapter3 1.2 Discrete-Time (D-T) Sigals Electroic systems do most of the processig of a sigal usig a computer. A computer ca t directly process a C-T sigal but istead eeds a stream of

More information

Infinite Sequences and Series

Infinite Sequences and Series Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet

More information

REGRESSION (Physics 1210 Notes, Partial Modified Appendix A)

REGRESSION (Physics 1210 Notes, Partial Modified Appendix A) REGRESSION (Physics 0 Notes, Partial Modified Appedix A) HOW TO PERFORM A LINEAR REGRESSION Cosider the followig data poits ad their graph (Table I ad Figure ): X Y 0 3 5 3 7 4 9 5 Table : Example Data

More information

Discrete-Time Signals and Systems. Signals and Systems. Digital Signals. Discrete-Time Signals. Operations on Sequences: Basic Operations

Discrete-Time Signals and Systems. Signals and Systems. Digital Signals. Discrete-Time Signals. Operations on Sequences: Basic Operations -6.3 Digital Sigal Processig ad Filterig..8 Discrete-ime Sigals ad Systems ime-domai Represetatios of Discrete-ime Sigals ad Systems ime-domai represetatio of a discrete-time sigal as a sequece of umbers

More information

Structuring Element Representation of an Image and Its Applications

Structuring Element Representation of an Image and Its Applications Iteratioal Joural of Cotrol Structurig Automatio Elemet ad Represetatio Systems vol. of a o. Image 4 pp. ad 50955 Its Applicatios December 004 509 Structurig Elemet Represetatio of a Image ad Its Applicatios

More information

It is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function.

It is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function. MATH 532 Measurable Fuctios Dr. Neal, WKU Throughout, let ( X, F, µ) be a measure space ad let (!, F, P ) deote the special case of a probability space. We shall ow begi to study real-valued fuctios defied

More information

OBJECTIVES. Chapter 1 INTRODUCTION TO INSTRUMENTATION FUNCTION AND ADVANTAGES INTRODUCTION. At the end of this chapter, students should be able to:

OBJECTIVES. Chapter 1 INTRODUCTION TO INSTRUMENTATION FUNCTION AND ADVANTAGES INTRODUCTION. At the end of this chapter, students should be able to: OBJECTIVES Chapter 1 INTRODUCTION TO INSTRUMENTATION At the ed of this chapter, studets should be able to: 1. Explai the static ad dyamic characteristics of a istrumet. 2. Calculate ad aalyze the measuremet

More information

ADVANCED DIGITAL SIGNAL PROCESSING

ADVANCED DIGITAL SIGNAL PROCESSING ADVANCED DIGITAL SIGNAL PROCESSING PROF. S. C. CHAN (email : sccha@eee.hku.hk, Rm. CYC-702) DISCRETE-TIME SIGNALS AND SYSTEMS MULTI-DIMENSIONAL SIGNALS AND SYSTEMS RANDOM PROCESSES AND APPLICATIONS ADAPTIVE

More information

x a x a Lecture 2 Series (See Chapter 1 in Boas)

x a x a Lecture 2 Series (See Chapter 1 in Boas) Lecture Series (See Chapter i Boas) A basic ad very powerful (if pedestria, recall we are lazy AD smart) way to solve ay differetial (or itegral) equatio is via a series expasio of the correspodig solutio

More information

Frequency Domain Filtering

Frequency Domain Filtering Frequecy Domai Filterig Raga Rodrigo October 19, 2010 Outlie Cotets 1 Itroductio 1 2 Fourier Represetatio of Fiite-Duratio Sequeces: The Discrete Fourier Trasform 1 3 The 2-D Discrete Fourier Trasform

More information

CS / MCS 401 Homework 3 grader solutions

CS / MCS 401 Homework 3 grader solutions CS / MCS 401 Homework 3 grader solutios assigmet due July 6, 016 writte by Jāis Lazovskis maximum poits: 33 Some questios from CLRS. Questios marked with a asterisk were ot graded. 1 Use the defiitio of

More information

UC Berkeley CS 170: Efficient Algorithms and Intractable Problems Handout 17 Lecturer: David Wagner April 3, Notes 17 for CS 170

UC Berkeley CS 170: Efficient Algorithms and Intractable Problems Handout 17 Lecturer: David Wagner April 3, Notes 17 for CS 170 UC Berkeley CS 170: Efficiet Algorithms ad Itractable Problems Hadout 17 Lecturer: David Wager April 3, 2003 Notes 17 for CS 170 1 The Lempel-Ziv algorithm There is a sese i which the Huffma codig was

More information

t distribution [34] : used to test a mean against an hypothesized value (H 0 : µ = µ 0 ) or the difference

t distribution [34] : used to test a mean against an hypothesized value (H 0 : µ = µ 0 ) or the difference EXST30 Backgroud material Page From the textbook The Statistical Sleuth Mea [0]: I your text the word mea deotes a populatio mea (µ) while the work average deotes a sample average ( ). Variace [0]: The

More information

Information-based Feature Selection

Information-based Feature Selection Iformatio-based Feature Selectio Farza Faria, Abbas Kazeroui, Afshi Babveyh Email: {faria,abbask,afshib}@staford.edu 1 Itroductio Feature selectio is a topic of great iterest i applicatios dealig with

More information

FIR Filter Design: Part II

FIR Filter Design: Part II EEL335: Discrete-Time Sigals ad Systems. Itroductio I this set of otes, we cosider how we might go about desigig FIR filters with arbitrary frequecy resposes, through compositio of multiple sigle-peak

More information

Oblivious Transfer using Elliptic Curves

Oblivious Transfer using Elliptic Curves Oblivious Trasfer usig Elliptic Curves bhishek Parakh Louisiaa State Uiversity, ato Rouge, L May 4, 006 bstract: This paper proposes a algorithm for oblivious trasfer usig elliptic curves lso, we preset

More information

Output Analysis (2, Chapters 10 &11 Law)

Output Analysis (2, Chapters 10 &11 Law) B. Maddah ENMG 6 Simulatio Output Aalysis (, Chapters 10 &11 Law) Comparig alterative system cofiguratio Sice the output of a simulatio is radom, the comparig differet systems via simulatio should be doe

More information

Chapter 9: Numerical Differentiation

Chapter 9: Numerical Differentiation 178 Chapter 9: Numerical Differetiatio Numerical Differetiatio Formulatio of equatios for physical problems ofte ivolve derivatives (rate-of-chage quatities, such as velocity ad acceleratio). Numerical

More information

CALCULATION OF FIBONACCI VECTORS

CALCULATION OF FIBONACCI VECTORS CALCULATION OF FIBONACCI VECTORS Stuart D. Aderso Departmet of Physics, Ithaca College 953 Daby Road, Ithaca NY 14850, USA email: saderso@ithaca.edu ad Dai Novak Departmet of Mathematics, Ithaca College

More information

6 Integers Modulo n. integer k can be written as k = qn + r, with q,r, 0 r b. So any integer.

6 Integers Modulo n. integer k can be written as k = qn + r, with q,r, 0 r b. So any integer. 6 Itegers Modulo I Example 2.3(e), we have defied the cogruece of two itegers a,b with respect to a modulus. Let us recall that a b (mod ) meas a b. We have proved that cogruece is a equivalece relatio

More information

ECE 564/645 - Digital Communication Systems (Spring 2014) Final Exam Friday, May 2nd, 8:00-10:00am, Marston 220

ECE 564/645 - Digital Communication Systems (Spring 2014) Final Exam Friday, May 2nd, 8:00-10:00am, Marston 220 ECE 564/645 - Digital Commuicatio Systems (Sprig 014) Fial Exam Friday, May d, 8:00-10:00am, Marsto 0 Overview The exam cosists of four (or five) problems for 100 (or 10) poits. The poits for each part

More information

Discrete Orthogonal Moment Features Using Chebyshev Polynomials

Discrete Orthogonal Moment Features Using Chebyshev Polynomials Discrete Orthogoal Momet Features Usig Chebyshev Polyomials R. Mukuda, 1 S.H.Og ad P.A. Lee 3 1 Faculty of Iformatio Sciece ad Techology, Multimedia Uiversity 75450 Malacca, Malaysia. Istitute of Mathematical

More information

Encoding-Assisted Temporal Direct Mode Decision for B Pictures in H.264/AVC

Encoding-Assisted Temporal Direct Mode Decision for B Pictures in H.264/AVC Ecodig-Assisted Temporal Direct Mode Decisio for B Pictures i H.64/AVC Ya-Neg Fag ad Yiyi Li Hui-Jae Hsieh Departmet of Commuicatio Egieerig Departmet of Iformatio Maagemet Natioal Cetral Uiversity, Taiwa

More information

The multiplicative structure of finite field and a construction of LRC

The multiplicative structure of finite field and a construction of LRC IERG6120 Codig for Distributed Storage Systems Lecture 8-06/10/2016 The multiplicative structure of fiite field ad a costructio of LRC Lecturer: Keeth Shum Scribe: Zhouyi Hu Notatios: We use the otatio

More information

On a Smarandache problem concerning the prime gaps

On a Smarandache problem concerning the prime gaps O a Smaradache problem cocerig the prime gaps Felice Russo Via A. Ifate 7 6705 Avezzao (Aq) Italy felice.russo@katamail.com Abstract I this paper, a problem posed i [] by Smaradache cocerig the prime gaps

More information

SOME TRIBONACCI IDENTITIES

SOME TRIBONACCI IDENTITIES Mathematics Today Vol.7(Dec-011) 1-9 ISSN 0976-38 Abstract: SOME TRIBONACCI IDENTITIES Shah Devbhadra V. Sir P.T.Sarvajaik College of Sciece, Athwalies, Surat 395001. e-mail : drdvshah@yahoo.com The sequece

More information

Sequences, Mathematical Induction, and Recursion. CSE 2353 Discrete Computational Structures Spring 2018

Sequences, Mathematical Induction, and Recursion. CSE 2353 Discrete Computational Structures Spring 2018 CSE 353 Discrete Computatioal Structures Sprig 08 Sequeces, Mathematical Iductio, ad Recursio (Chapter 5, Epp) Note: some course slides adopted from publisher-provided material Overview May mathematical

More information

4.1 Sigma Notation and Riemann Sums

4.1 Sigma Notation and Riemann Sums 0 the itegral. Sigma Notatio ad Riema Sums Oe strategy for calculatig the area of a regio is to cut the regio ito simple shapes, calculate the area of each simple shape, ad the add these smaller areas

More information

Chapter 7 z-transform

Chapter 7 z-transform Chapter 7 -Trasform Itroductio Trasform Uilateral Trasform Properties Uilateral Trasform Iversio of Uilateral Trasform Determiig the Frequecy Respose from Poles ad Zeros Itroductio Role i Discrete-Time

More information

Optimally Sparse SVMs

Optimally Sparse SVMs A. Proof of Lemma 3. We here prove a lower boud o the umber of support vectors to achieve geeralizatio bouds of the form which we cosider. Importatly, this result holds ot oly for liear classifiers, but

More information

SEQUENCES AND SERIES

SEQUENCES AND SERIES Sequeces ad 6 Sequeces Ad SEQUENCES AND SERIES Successio of umbers of which oe umber is desigated as the first, other as the secod, aother as the third ad so o gives rise to what is called a sequece. Sequeces

More information

Chapter 9 - CD companion 1. A Generic Implementation; The Common-Merge Amplifier. 1 τ is. ω ch. τ io

Chapter 9 - CD companion 1. A Generic Implementation; The Common-Merge Amplifier. 1 τ is. ω ch. τ io Chapter 9 - CD compaio CHAPTER NINE CD-9.2 CD-9.2. Stages With Voltage ad Curret Gai A Geeric Implemetatio; The Commo-Merge Amplifier The advaced method preseted i the text for approximatig cutoff frequecies

More information

A statistical method to determine sample size to estimate characteristic value of soil parameters

A statistical method to determine sample size to estimate characteristic value of soil parameters A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig

More information

Sensitivity Analysis of Daubechies 4 Wavelet Coefficients for Reduction of Reconstructed Image Error

Sensitivity Analysis of Daubechies 4 Wavelet Coefficients for Reduction of Reconstructed Image Error Proceedigs of the 6th WSEAS Iteratioal Coferece o SIGNAL PROCESSING, Dallas, Texas, USA, March -4, 7 67 Sesitivity Aalysis of Daubechies 4 Wavelet Coefficiets for Reductio of Recostructed Image Error DEVINDER

More information

SECTION 1.5 : SUMMATION NOTATION + WORK WITH SEQUENCES

SECTION 1.5 : SUMMATION NOTATION + WORK WITH SEQUENCES SECTION 1.5 : SUMMATION NOTATION + WORK WITH SEQUENCES Read Sectio 1.5 (pages 5 9) Overview I Sectio 1.5 we lear to work with summatio otatio ad formulas. We will also itroduce a brief overview of sequeces,

More information

TEACHER CERTIFICATION STUDY GUIDE

TEACHER CERTIFICATION STUDY GUIDE COMPETENCY 1. ALGEBRA SKILL 1.1 1.1a. ALGEBRAIC STRUCTURES Kow why the real ad complex umbers are each a field, ad that particular rigs are ot fields (e.g., itegers, polyomial rigs, matrix rigs) Algebra

More information

Properties and Hypothesis Testing

Properties and Hypothesis Testing Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.

More information

Analysis of Experimental Measurements

Analysis of Experimental Measurements Aalysis of Experimetal Measuremets Thik carefully about the process of makig a measuremet. A measuremet is a compariso betwee some ukow physical quatity ad a stadard of that physical quatity. As a example,

More information

arxiv: v1 [math.nt] 10 Dec 2014

arxiv: v1 [math.nt] 10 Dec 2014 A DIGITAL BINOMIAL THEOREM HIEU D. NGUYEN arxiv:42.38v [math.nt] 0 Dec 204 Abstract. We preset a triagle of coectios betwee the Sierpisi triagle, the sum-of-digits fuctio, ad the Biomial Theorem via a

More information

EE260: Digital Design, Spring n MUX Gate n Rudimentary functions n Binary Decoders. n Binary Encoders n Priority Encoders

EE260: Digital Design, Spring n MUX Gate n Rudimentary functions n Binary Decoders. n Binary Encoders n Priority Encoders EE260: Digital Desig, Sprig 2018 EE 260: Itroductio to Digital Desig MUXs, Ecoders, Decoders Yao Zheg Departmet of Electrical Egieerig Uiversity of Hawaiʻi at Māoa Overview of Ecoder ad Decoder MUX Gate

More information

Discrete-Time Signals and Systems. Discrete-Time Signals and Systems. Signal Symmetry. Elementary Discrete-Time Signals.

Discrete-Time Signals and Systems. Discrete-Time Signals and Systems. Signal Symmetry. Elementary Discrete-Time Signals. Discrete-ime Sigals ad Systems Discrete-ime Sigals ad Systems Dr. Deepa Kudur Uiversity of oroto Referece: Sectios. -.5 of Joh G. Proakis ad Dimitris G. Maolakis, Digital Sigal Processig: Priciples, Algorithms,

More information

2D DSP Basics: 2D Systems

2D DSP Basics: 2D Systems - Digital Image Processig ad Compressio D DSP Basics: D Systems D Systems T[ ] y = T [ ] Liearity Additivity: If T y = T [ ] The + T y = y + y Homogeeity: If The T y = T [ ] a T y = ay = at [ ] Liearity

More information

OPTIMAL ALGORITHMS -- SUPPLEMENTAL NOTES

OPTIMAL ALGORITHMS -- SUPPLEMENTAL NOTES OPTIMAL ALGORITHMS -- SUPPLEMENTAL NOTES Peter M. Maurer Why Hashig is θ(). As i biary search, hashig assumes that keys are stored i a array which is idexed by a iteger. However, hashig attempts to bypass

More information

TMA4205 Numerical Linear Algebra. The Poisson problem in R 2 : diagonalization methods

TMA4205 Numerical Linear Algebra. The Poisson problem in R 2 : diagonalization methods TMA4205 Numerical Liear Algebra The Poisso problem i R 2 : diagoalizatio methods September 3, 2007 c Eiar M Røquist Departmet of Mathematical Scieces NTNU, N-749 Trodheim, Norway All rights reserved A

More information

subject to A 1 x + A 2 y b x j 0, j = 1,,n 1 y j = 0 or 1, j = 1,,n 2

subject to A 1 x + A 2 y b x j 0, j = 1,,n 1 y j = 0 or 1, j = 1,,n 2 Additioal Brach ad Boud Algorithms 0-1 Mixed-Iteger Liear Programmig The brach ad boud algorithm described i the previous sectios ca be used to solve virtually all optimizatio problems cotaiig iteger variables,

More information

The picture in figure 1.1 helps us to see that the area represents the distance traveled. Figure 1: Area represents distance travelled

The picture in figure 1.1 helps us to see that the area represents the distance traveled. Figure 1: Area represents distance travelled 1 Lecture : Area Area ad distace traveled Approximatig area by rectagles Summatio The area uder a parabola 1.1 Area ad distace Suppose we have the followig iformatio about the velocity of a particle, how

More information

Physics 324, Fall Dirac Notation. These notes were produced by David Kaplan for Phys. 324 in Autumn 2001.

Physics 324, Fall Dirac Notation. These notes were produced by David Kaplan for Phys. 324 in Autumn 2001. Physics 324, Fall 2002 Dirac Notatio These otes were produced by David Kapla for Phys. 324 i Autum 2001. 1 Vectors 1.1 Ier product Recall from liear algebra: we ca represet a vector V as a colum vector;

More information

Morphological Image Processing

Morphological Image Processing Morphological Image Processig Biary dilatio ad erosio Set-theoretic iterpretatio Opeig, closig, morphological edge detectors Hit-miss filter Morphological filters for gray-level images Cascadig dilatios

More information

The z-transform. 7.1 Introduction. 7.2 The z-transform Derivation of the z-transform: x[n] = z n LTI system, h[n] z = re j

The z-transform. 7.1 Introduction. 7.2 The z-transform Derivation of the z-transform: x[n] = z n LTI system, h[n] z = re j The -Trasform 7. Itroductio Geeralie the complex siusoidal represetatio offered by DTFT to a represetatio of complex expoetial sigals. Obtai more geeral characteristics for discrete-time LTI systems. 7.

More information

Revision Topic 1: Number and algebra

Revision Topic 1: Number and algebra Revisio Topic : Number ad algebra Chapter : Number Differet types of umbers You eed to kow that there are differet types of umbers ad recogise which group a particular umber belogs to: Type of umber Symbol

More information

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n. Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator

More information

Hashing and Amortization

Hashing and Amortization Lecture Hashig ad Amortizatio Supplemetal readig i CLRS: Chapter ; Chapter 7 itro; Sectio 7.. Arrays ad Hashig Arrays are very useful. The items i a array are statically addressed, so that isertig, deletig,

More information

Problem Set 2 Solutions

Problem Set 2 Solutions CS271 Radomess & Computatio, Sprig 2018 Problem Set 2 Solutios Poit totals are i the margi; the maximum total umber of poits was 52. 1. Probabilistic method for domiatig sets 6pts Pick a radom subset S

More information

Algorithm Analysis. Chapter 3

Algorithm Analysis. Chapter 3 Data Structures Dr Ahmed Rafat Abas Computer Sciece Dept, Faculty of Computer ad Iformatio, Zagazig Uiversity arabas@zu.edu.eg http://www.arsaliem.faculty.zu.edu.eg/ Algorithm Aalysis Chapter 3 3. Itroductio

More information

Lesson 10: Limits and Continuity

Lesson 10: Limits and Continuity www.scimsacademy.com Lesso 10: Limits ad Cotiuity SCIMS Academy 1 Limit of a fuctio The cocept of limit of a fuctio is cetral to all other cocepts i calculus (like cotiuity, derivative, defiite itegrals

More information

There is no straightforward approach for choosing the warmup period l.

There is no straightforward approach for choosing the warmup period l. B. Maddah INDE 504 Discrete-Evet Simulatio Output Aalysis () Statistical Aalysis for Steady-State Parameters I a otermiatig simulatio, the iterest is i estimatig the log ru steady state measures of performace.

More information

Chapter 6 Infinite Series

Chapter 6 Infinite Series Chapter 6 Ifiite Series I the previous chapter we cosidered itegrals which were improper i the sese that the iterval of itegratio was ubouded. I this chapter we are goig to discuss a topic which is somewhat

More information

Random Variables, Sampling and Estimation

Random Variables, Sampling and Estimation Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig

More information

Principle Of Superposition

Principle Of Superposition ecture 5: PREIMINRY CONCEP O RUCUR NYI Priciple Of uperpositio Mathematically, the priciple of superpositio is stated as ( a ) G( a ) G( ) G a a or for a liear structural system, the respose at a give

More information

BER results for a narrowband multiuser receiver based on successive subtraction for M-PSK modulated signals

BER results for a narrowband multiuser receiver based on successive subtraction for M-PSK modulated signals results for a arrowbad multiuser receiver based o successive subtractio for M-PSK modulated sigals Gerard J.M. Jasse Telecomm. ad Traffic-Cotrol Systems Group Dept. of Iformatio Techology ad Systems Delft

More information

Linear Regression Demystified

Linear Regression Demystified Liear Regressio Demystified Liear regressio is a importat subject i statistics. I elemetary statistics courses, formulae related to liear regressio are ofte stated without derivatio. This ote iteds to

More information

Parallel Vector Algorithms David A. Padua

Parallel Vector Algorithms David A. Padua Parallel Vector Algorithms 1 of 32 Itroductio Next, we study several algorithms where parallelism ca be easily expressed i terms of array operatios. We will use Fortra 90 to represet these algorithms.

More information

Fall 2011, EE123 Digital Signal Processing

Fall 2011, EE123 Digital Signal Processing Lecture 5 Miki Lustig, UCB September 14, 211 Miki Lustig, UCB Motivatios for Discrete Fourier Trasform Sampled represetatio i time ad frequecy umerical Fourier aalysis requires a Fourier represetatio that

More information

DIGITAL FILTER ORDER REDUCTION

DIGITAL FILTER ORDER REDUCTION DIGITAL FILTER RDER REDUTI VAHID RAISSI DEHKRDI, McGILL UIVERSITY, AADA, vahid@cim.mcgill.ca AMIR G. AGHDAM, RDIA UIVERSITY, AADA, aghdam@ece.cocordia.ca ABSTRAT I this paper, a method is proposed to reduce

More information

End-of-Year Contest. ERHS Math Club. May 5, 2009

End-of-Year Contest. ERHS Math Club. May 5, 2009 Ed-of-Year Cotest ERHS Math Club May 5, 009 Problem 1: There are 9 cois. Oe is fake ad weighs a little less tha the others. Fid the fake coi by weighigs. Solutio: Separate the 9 cois ito 3 groups (A, B,

More information

Let us consider the following problem to warm up towards a more general statement.

Let us consider the following problem to warm up towards a more general statement. Lecture 4: Sequeces with repetitios, distributig idetical objects amog distict parties, the biomial theorem, ad some properties of biomial coefficiets Refereces: Relevat parts of chapter 15 of the Math

More information

2.004 Dynamics and Control II Spring 2008

2.004 Dynamics and Control II Spring 2008 MIT OpeCourseWare http://ocw.mit.edu 2.004 Dyamics ad Cotrol II Sprig 2008 For iformatio about citig these materials or our Terms of Use, visit: http://ocw.mit.edu/terms. Massachusetts Istitute of Techology

More information

Warped, Chirp Z-Transform: Radar Signal Processing

Warped, Chirp Z-Transform: Radar Signal Processing arped, Chirp Z-Trasform: Radar Sigal Processig by Garimella Ramamurthy Report o: IIIT/TR// Cetre for Commuicatios Iteratioal Istitute of Iformatio Techology Hyderabad - 5 3, IDIA Jauary ARPED, CHIRP Z

More information

EE260: Digital Design, Spring n Binary Addition. n Complement forms. n Subtraction. n Multiplication. n Inputs: A 0, B 0. n Boolean equations:

EE260: Digital Design, Spring n Binary Addition. n Complement forms. n Subtraction. n Multiplication. n Inputs: A 0, B 0. n Boolean equations: EE260: Digital Desig, Sprig 2018 EE 260: Itroductio to Digital Desig Arithmetic Biary Additio Complemet forms Subtractio Multiplicatio Overview Yao Zheg Departmet of Electrical Egieerig Uiversity of Hawaiʻi

More information

Rank Modulation with Multiplicity

Rank Modulation with Multiplicity Rak Modulatio with Multiplicity Axiao (Adrew) Jiag Computer Sciece ad Eg. Dept. Texas A&M Uiversity College Statio, TX 778 ajiag@cse.tamu.edu Abstract Rak modulatio is a scheme that uses the relative order

More information

Algebra of Least Squares

Algebra of Least Squares October 19, 2018 Algebra of Least Squares Geometry of Least Squares Recall that out data is like a table [Y X] where Y collects observatios o the depedet variable Y ad X collects observatios o the k-dimesioal

More information

Problem Set 4 Due Oct, 12

Problem Set 4 Due Oct, 12 EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios

More information

FIR Filter Design: Part I

FIR Filter Design: Part I EEL3: Discrete-Time Sigals ad Systems FIR Filter Desig: Part I. Itroductio FIR Filter Desig: Part I I this set o otes, we cotiue our exploratio o the requecy respose o FIR ilters. First, we cosider some

More information

SEQUENCES AND SERIES

SEQUENCES AND SERIES 9 SEQUENCES AND SERIES INTRODUCTION Sequeces have may importat applicatios i several spheres of huma activities Whe a collectio of objects is arraged i a defiite order such that it has a idetified first

More information