Memory ecient adaptation of vector quantizers to time-varying channels

Size: px
Start display at page:

Download "Memory ecient adaptation of vector quantizers to time-varying channels"

Transcription

1 Sgnal Processng 83 (3) Memory ecent adaptaton of vector quantzers to tme-varyng channels orbert Gortz a;,jorg Klewer b a Insttute for Communcatons Engneerng (LT), Munch Unversty of Technology (TUM), 89 Munch, Germany b Insttute for Crcuts and Systems Theory, Unversty of Kel, Kaserstr., 443 Kel, Germany Receved 9 September ; receved n revsed form 6 February 3 Abstract Channel-optmzed vector quantzaton (COVQ) s approxmated by the novel channel-adaptve scaled vector quantzaton (CASVQ). Ths new method uses a reference codebook that s optmal for one specc channel condton. However, for a bt-error rate beng derent from the desgn assumpton for the reference codebook, all codevectors are scaled by a common factor, whch depends on the channel condton. It s shown by smulatons that a performance close to that of COVQ can be acheved n many practcally mportant stuatons. Wthout a sgncant ncrease n complexty, the new CASVQ-scheme can be adapted to tme-varyng channels by adjustng the scalng factor to the current bt-error probablty. Another advantage s that only one codebook needs to be stored for all error probabltes, whle for COVQ ether the performance degrades sgncantly due to channel msmatch, or a large set of codebooks must be avalable at the encoder and the decoder.? 3 Elsever Scence B.V. All rghts reserved. Keywords: Jont source-channel codng; Channel-optmzed vector quantzaton; Tme-varyng channels; Complexty and memory requrements. Introducton Channel-optmzed vector quantzaton (COVQ) [4,5] acheves strong qualty-mprovements over conventonal vector quantzaton (VQ) f the transmsson channel s nosy. Varatons of COVQ n whch smulated and determnstc annealng are used have been proposed, e.g., n [6,]; the algorthms work Ths paper was presented n part at the IEEE Internatonal Symposum on Informaton Theory, Washngton, DC, USA, June. Correspondng author. Tel.: ; fax: E-mal address: norbert.goertz@e.tum.de (. Gortz). superor to normal COVQ due to mprovements n the codebook desgn that avod gettng stuck n poor local optma. Although a great deal of the work on COVQ has been done for the bnary symmetrc channel, the codebook tranng and the desgn of optmal encoder-decoder pars for soft source decodng after the transmsson wth soft-decson demodulaton have also been consdered, e.g., n [,]. Recently, the adaptaton of COVQ to tme-varyng channels has become a subject of nterest [8], where COVQ desgn approaches are proposed for derent types of mssng channel nformaton. In ths paper a new memory-ecent COVQ approxmaton for tme-varyng channels s presented. More precsely, we address the problem how to /3/$ - see front matter? 3 Elsever Scence B.V. All rghts reserved. do:.6/s65-684(3)7-9

2 5. Gortz, J. Klewer / Sgnal Processng 83 (3) lmt the memory and complexty requrements n a COVQ-framework such that these are almost the same as n the conventonal VQ case, whle keepng good performance for all (tme-varyng) channel condtons. It s shown that ths goal can be acheved by smply scalng a COVQ reference codebook dependng on the actual channel bt error rate, whch leads to a strong reducton of the overall memory and complexty requrements compared to the COVQ approach. A closely related method has been stated n [], where scalng s ntroduced to decrease the dstances between the codewords and thus to allevate the qualty decrease at the decoder output due to ndex permutatons caused by bt errors. In our work, however, we employ codevector-scalng to obtan a memory ecent COVQ codebook approxmaton whch s desgned for a bt-error probablty beng derent from that used for the reference codebook. Ths paper s organzed as follows. After a dscusson of complexty and memory ssues for VQ and COVQ n Secton, the new approxmaton of COVQ called channel-adaptve scaled vector quantzaton (CASVQ) s ntroduced n Secton 3. In Secton 4 the performance of the new scheme s compared wth COVQ.. Memory and complexty ssues for VQ and COVQ Fg. shows the model of the used transmsson system. It conssts of a channel-optmzed vector quantzer wth the codebook C, a bnary symmetrc transmsson channel that causes ndex-permutatons by bt errors, and a decoder that essentally performs a table-lookup. The bt-error probablty s assumed to be known at both the encoder and the decoder. The dea of channel-optmzed vector quantzaton (COVQ) s to explot the knowledge about the channel n the desgn of the codebook and n the encodng algorthm. The COVQ codebook desgn algorthm [4] can be regarded as an extenson of the classcal LBG-algorthm [9] for noseless channels. In the followng, we use the performance of COVQ [4] asa reference for the approxmatons that are nvestgated n ths paper. ote that the COVQ dstance measure, whch s used n both the codebook desgn procedure and the encodng operaton, s derent from that n x COVQ Encoder Codebook C b Bts Channel (BSC) j b Bts C ={y, =,,..., b } y : codevector, dmenson Decoder Codebook C Fg.. Transmsson system wth a channel-optmzed vector quantzer. conventonal VQ. Ths s due to the fact that transtons from the transmtted ndces to some ndces j at the recever occur wth probabltes P j that depend on the channel. For nstance, f we transmt over a bnary-symmetrc channel (BSC) wth bt-error probablty, the transton probabltes are gven by P j = p h(;j) e ( ) b h(;j) ; () where b s the number of bts requred to encode the ndex and h(; j) s the Hammng dstance between the transmtted and the receved ndex,.e., h(; j) s the number of bt errors nserted by the channel. The probabltes P j are used n the COVQ-encoder to mnmze the expected dstorton at the recever output due to the quantzaton decson. The expected dstorton, the COVQ dstance measure, s gven by [4] C d covq (x; y )= P j d vq (x; y j ); () j= where x s the data-vector to be quantzed and y the codevector wth the ndex =; ;:::; C. : The number of codevectors s denoted as C = b (sze of the codebook), and d vq (x; y j ) s the dstance measure that would be used n conventonal VQ. In COVQ-encodng, () s computed for each codevector y, and the ndex opt correspondng to the codevector that produces the mnmum value d covq (x; y opt ) s selected for the transmsson over the channel. Besdes, () s also used n the codebook tranng process. Often (and therefore also n ths paper) the meansquared error d vq (x; y )= (x l y ;l ) (3) y j

3 . Gortz, J. Klewer / Sgnal Processng 83 (3) s used as the VQ dstance measure. The vector dmenson s denoted by and the vector components of y and x are ndexed by l. The computaton of (3) requres 3 oatng-pont operatons per codevector of dmenson, where oatng-pont operaton wll be used as a generc term for addton, subtracton, multplcaton, or dvson n the followng. It s a standard technque to smplfy the mplementaton by expandng the sum n (3) as follows: d vq (x; y )= xl x l y ;l + y;l = xl + d vq(x; y ): (4) The rst term s non-negatve and does not depend on the codevector. Snce, furthermore, = s a constant factor t s sucent to mnmze d vq(x; y )=w(y ) x l y ;l (5) wth w(y ) = : y;l (6) by a proper selecton of the codevector ndex. In what follows, d vq(x; y ) wll be referred to as the smpled VQ dstance measure. The (halves of the) energes w(y ) of the codevectors can be precomputed and stored n advance (snce they do not depend on the data x), so by use of C addtonal scalar memory locatons we may reduce the complexty of the codebook search to oatng-pont operatons per codevector. For COVQ, the calculaton of the expected dstorton () for each of the codevectors requres the values of the VQ dstance measure (3) for all codevectors and the correspondng ndex transton probabltes P j. Smpled mplementatons, whch are algorthmcally equvalent to the mnmzaton of (), have been stated n [5]: whle the decoder uses the COVQ-codebook drectly, the encoder uses a transformed codebook that ncludes the ndex transton probabltes. We wll brey descrbe the method here: f we nsert (3) nto () and expand the sums we obtan C d covq (x; y )= P j d vq (x; y j ) j= C = j= P j (x l y j;l ) = xl + C P j yj;l j= }{{} j= w(y ) C x l P j y j;l : (7) }{{} Thus, smlar as n the VQ-case, t s sucent to mnmze the smpled COVQ dstance measure d covq(x; y )=w(y ) x l y ;l ; (8) wth w(y ) : = and C j= P j y ; l C yj;l = j= P j w(y j ) (9) : C y ;l = P j y j;l ; () j= nstead of the mnmzaton of (). The transformed codevectors y = {y ;l ; l =;:::; } from (), whch can be nterpreted as the expectaton of the codevector at the recever condtoned on the possbly transmtted ndex, and the energes w(y ) from (9) may be stored at the encoder n place of the actual codebook, whch s only requred at the decoder. Thus, the memory requrements and the complexty of COVQ encodng by mnmzaton of (8) over

4 5. Gortz, J. Klewer / Sgnal Processng 83 (3) are not larger than n the conventonal VQ-case (where (5) s mnmzed) as long as the channel s tme-nvarant. If the channel s tme-varyng the channel-optmzed codebook mght not be matched to the current channel statstcs (channel msmatch),.e., the performance degrades, compared to the optmal case. If the assumpton of the bt-error probablty for COVQ-codebook tranng ders only slghtly from ts true value on the channel, the performance of unmatched COVQ s not sgncantly worse compared to optmally matched COVQ [4]. But f, for nstance, a COVQ-codebook desgned for a bt-error probablty of =:5 s used on an uncorrupted channel ( = ), a sgncant loss n the clean-channel performance can be observed. One way to mprove the performance n such a stuaton s to swtch between a nte number of codebooks at the encoder and the decoder dependng on the current channel state [7]; the codebooks can cover the range of possble channel varatons (although no perfect match s possble snce, n general, s a real number). The robustness of COVQ aganst small varatons of preserves close-to-optmum performance f the number of codebooks s hgh enough. However, ths strategy requres the storage of several codebooks at both the encoder and the decoder, whch may be qute memory consumng. In the next secton a new algorthm s stated that does not show ths dsadvantage by reducng the number of requred codebooks to just one for all channel condtons. 3. Channel-adaptve scaled vector quantzaton (CASVQ) 3.. Basc prncple In Fg. codebooks wth C = 3 two-dmensonal codevectors are depcted that were traned for a Gauss Markov source wth a correlaton coecent of For COVQ on very nosy channels (e.g., bt-error probabltes :5) empty encodng regons (correspondng to mplct error control codng) can be observed: certan ndexes are never selected by the encoder for transmsson,.e., the correspondng transformed codevectors do not need to be consdered n the dstance computaton (8). If many empty regons occur, ths can lead to a sgncantly lower complexty [5] compared to the standard VQ-case. =:9. Such a source model s representatve for the long-term statstcs of many source sgnals such as speech, audo, and mages but also for the parameters that are extracted from a block of nput samples by advanced source codng schemes. The expected mean-squared error () was used as a dstance measure for COVQ-codebook tranng. The plots show the codevectors (marked by ) that result from the tranng procedure for the COVQ-codebooks [5] (wth splttng for the ntalzaton) for several assumptons of the bt-error probablty on a bnary symmetrc channel (BSC). For = the codebook s equal to a conventonal VQ-codebook (Fg. (a)). Fg. shows that the codevectors are placed closer to the all-zero vector (.e. the average of all tranng-data vectors) when the channel qualty gets worse. Ths s because a permutaton of a transmtted ndex (whch, for nstance, may quantze the data pont Z ) to some other ndex j (caused by channel errors) leads to a large dstorton, f the assocated codevectors have a large dstance n the sgnal space; ths s the case for the codevectors marked by and j n Fg. (a). The dstance between the vectors ndexed by and j n Fg. (b) s smaller,.e., the dstorton caused by channel errors that permute both vectors s also smaller. On the other hand, the quantzaton of data-ponts wth large dstance from the orgn (e.g., Z ) s less accurate n Fg. (b); thus, we have a loss n clean-channel performance ( =) usng COVQ-codebooks optmzed for. In other words: a qualty decrease due to hgher quantzer overload-dstorton s traded for the qualty mprovement due to a hgher robustness aganst ndex permutatons. A precse analyss of the postons of the codevectors reveals (Fg. (c) and (d)) that the codevectors form clusters,.e., the codevectors are not only shrunken f ncreases but they also have new relatve locatons. Ths clusterng corresponds to empty codng regons that cause an mplct error control codng (redundant codng levels) as reported n [5]. However, a COVQ-codebook for = p may be vewed as a shrunken verson of COVQ-codebook It s known from lterature [3] that the splttng method n VQ-codebook tranng leads to a relatvely good ndex assgnment. In case of COVQ-codebook tranng wth the ndex assgnment s automatcally optmzed.

5 . Gortz, J. Klewer / Sgnal Processng 83 (3) y,, =,,...,3.5 pe=. α=. * Z (data pont) j j * * Z (data pont) Z (data pont) (a) y,, =,,...,3 (b) y,, =,,...,3 y,, =,,...,3.5 pe=. α=.75 y,, =,,..., pe=.5 α=.57 y,, =,,..., pe=. α=.5 (c) y, =,,...,3, (d) y, =,,...,3, Fg.. Comparson of COVQ-codebooks ( ) and CASVQ-codebooks ( ), both wth C = 3 codevectors. The codebooks n plot (a) are dentcal to a conventonal VQ-codebook desgned by the LBG algorthm [9] (wth splttng ). optmzed for p, f only the rough shape s consdered. Ths observaton leads to the basc dea of channel-adaptve scaled vector quantzaton (CASVQ): the codevectors y (r) from a reference COVQ-codebook are scaled by a channel dependent factor ( ), where ( ) f the channel does not match the tranng assumpton of the reference codebook. ote that ( ) fthe reference codebook s obtaned for a smaller BER compared to the actual one (as n the examples of Fg. ) and ( ) f a larger BER s used for the desgn of the COVQ reference codebook. Thus, the channel-matched COVQ-codevectors y ( ) are approxmated by the CASVQ-codevectors y (p e )=( ) y (r) : () For the sake of brevty we omt the dependence on for y (p e ) and ( ) n the followng. As an example, CASVQ-codevectors (marked by ) are ncluded n Fg.. They have been derved from the VQ reference codebook (COVQ-codebook wth = as the desgn assumpton) n Fg. (a) by the scalng factors stated n the legends. It s obvous that the rough shape of the COVQ-codebooks (marked by ) can be approxmated by the CASVQ-codebooks qute well. 3.. Optmzaton of CASVQ The queston arses, how to nd approprate scalng factors for each channel condton,.e., the functon = f( ) s requred. Unfortunately, there s no way to nd the optmal factor analytcally by varatonal technques, because the average dstorton for a tranng-set of source vectors depends on the ndvdual quantzaton decsons that agan depend on the scalng factor. Hence, the quantzaton decsons change, as the scalng factor s vared to mnmze the average dstorton. However, snce the functon = f( ) s ndvdual for a codebook and ts source sgnal, t may be determned n advance before the system s used. Thus, we can accept some computatonal complexty n the o-lne optmzaton of the CASVQ-codebook for a reasonable number of samples from and. As an example, let us thnk of a correlated Gaussan source sgnal, whch s vector-quantzed by a codebook wth c = 3 two-dmensonal codevectors; () s used as a dstance measure for the quantzaton

6 54. Gortz, J. Klewer / Sgnal Processng 83 (3) SR n db p. e α Fg. 3. Performance of CASVQ for codebooks wth C =3 two-dmensonal codevectors whch are used to encode a strongly correlated Gauss Markov source (correlaton coecent = :9). The SR-value s plotted versus the bt-error probablty and the scalng factor. A COVQ-codebook for = (.e., a conventonal VQ-codebook) s used as a reference codebook. and a conventonal VQ codebook s used as a reference codebook for CASVQ. Thus, the range of the scalng factors s lmted to 6 n ths case. The SR-values, measured between the nput of the quantzer and the output of a table-lookup decoder, are depcted n Fg. 3 n a three-dmensonal plot, for a smulaton of several (; )-pars. Fg. 3 shows that the SR-surface s qute smooth,.e., a lmted number of (; )-pars s sucent to acheve a good approxmaton of the best possble performance. The dashed curve on the SR-surface ndcates the best SR (and the assocated -value) for each smulated value of ; the requred functon = f( )s gven by the projecton of the dashed curve nto the -plane. The projecton of the dashed curve nto the SR- -plane ndcates the best SR-values achevable by CASVQ for each value of. Ths curve appears agan n the smulaton results n Fg. 5 (labeled CASVQ, covq-dst. ). ote that the smooth behavor of the SR surface n Fg. 3 and the functon = f( ), resp., holds for arbtrary nput source processes. Ths s due to the fact that the COVQ codevectors may be nterpreted as pre-computed mean-square estmates of the vector-quantzed transmtted source symbols. If the channel s strongly dstorted the mean-square estmate at the output of the decoder tends to zero for any zero-mean nput source, snce the COVQ code vector locatons approach the zero vector. The CASVQ approach approxmates ths behavor for large by ( ). Snce the mean-square error between the source sgnal ponts and the CASVQ codevector locatons s a contnuous functon n the SR surface and thus also = f( ) are smooth functons. By means of a smulaton as descrbed above, a close approxmaton of the functon = f( ) can be found for any practcally relevant codebook n reasonable tme Complexty and memory requrements of CASVQ on tme-varyng channels If the CASVQ-codebook s used, the smpled COVQ dstance measure (8) corresponds to d covq(x;y (r) wth C w(y (r) )= and C y (r) ;l = )=w(y (r) j= P j ) x l y (r) ;l ; () (y (r) j;l ) C = P j w(y (r) j )= w(y (r) ) (3) j= j= P j y (r) j;l C = P j y (r) j;l = y(r) ;l ; (4) j= where (9) and () have been used. ote that both and P j are functons of the current bt-error probablty, whch s dstnct from the reference bt-error probablty. Thus, () may be wrtten as d covq(x;y (r) )= w(y (r) ) x l y (r) ;l : (5) As we can observe from (5) t s possble to adapt CASVQ to any value of by use of an approprate

7 . Gortz, J. Klewer / Sgnal Processng 83 (3) Reference Codebook C (r) C (r) ={y (r), =,,..., b } y (r) : reference codevector Reference Codebook C (r) x x α VQ Encoder b Bts Channel (BSC) j b Bts Decoder y (r) j α y (r) j α( ) α ( ) Fg. 4. CASVQ system wth VQ dstance measure for encodng. factor and only one reference codebook for calculatng the transformed reference codevectors y (r) and the energes w(y (r) )n(5). Whenever changes, y (r) and w(y (r) ) have to be recomputed from the reference codebook by applyng (9) and (), respectvely. Thus, the proposed CASVQ method wth COVQ dstance measure for encodng, whch wll be denoted wth CASVQ, covq-dst. n the followng, s more complex than conventonal VQ. Furthermore, memory for two codebooks, the reference codebook y (r) and the current transformed codebook y (r) used for encodng, s requred at the encoder. ote that the energes w(y (r) ) only need to be stored for the current bt-error probablty, so here, no addtonal memory s requred for tme-varant channels. In contrast, for perfectly channel-matched COVQ a new codebook has to be traned and stored n both the encoder and the decoder for each value of. In order to save the complexty for the recomputatons (due to a change of ) and the memory for the second codebook n the CASVQ approach, one may use the conventonal VQ dstance measure nstead of the COVQ dstance measure for encodng. Certanly, ths s another approxmaton that wll decrease the performance compared to the optmal COVQ; however, the degradaton s only moderate but the smplcaton of the encodng s sgncant as we wll see n the followng. From (5) and (6) we obtan d vq(x;y (r) )= (y (r) ;l ) } {{ } w(y (r) ) x l y (r) ;l ( ) = w(y (r) x l ) y(r) ;l : (6) Snce n (6) s equal for each codevector, t s sucent to mnmze vq(x;y (r) ) = : ( w(y (r) xl ) ) y (r) ;l (7) d over n place of (6). ow, all we have to do addtonally (compared wth conventonal VQ) s to scale the components of the nput data vector x by = and to rescale the output codevector y (r) j by ; a small table to represent the functon = f( ) s also requred. The rest s the same as n conventonal VQ ncludng the memory and complexty requrements. The CASVQ-system wth the VQ-dstance measure for encodng s depcted n Fg. 4. If ths system s used, the correspondng smulaton results are labeled CASVQ, vq-dst.. However, the smulaton results n Secton 4 show that the qualty decrease obtaned by replacng the COVQ dstance measure wth the smple VQ dstance measure s only small. ote that a change of due to varyng channel statstcs aects both the encoder and decoder codebook. Therefore, we assume that a backward channel s avalable (whch holds true for many wreless and wrelne communcaton systems) such that the estmated bt-error rate at the decoder can be communcated to the encoder. 4. Smulaton results In Fg. 5 the performances of COVQ and CASVQ for the transmsson of a strongly autocorrelated

8 56. Gortz, J. Klewer / Sgnal Processng 83 (3) COVQ, covq dst. CASVQ, covq dst. CASVQ, vq dst. VQ, vq dst. 8 6 COVQ, covq dst CASVQ, covq dst CASVQ, vq dst VQ, vq dst SR n db 8 6 SR n db Fg. 5. Performance of COVQ, CASVQ, and VQ for the quantzaton of a strongly correlated Gauss Markov source; codebooks wth C = 3 two-dmensonal codevectors are used. Fg. 6. Performance of COVQ, CASVQ, and VQ for the quantzaton of a strongly correlated Gauss Markov source; codebooks wth C = 8 three-dmensonal codevectors are used. Gauss Markov source sgnal (correlaton coecent =:9) over a bnary symmetrc channel are depcted; the quantzatons are carred out by codebooks wth 3 two-dmensonal codevectors. The COVQ-codebooks are optmally matched to the true value of on the channel; the scalng factor ( )of the CASVQ-codebooks s adapted to as descrbed n Secton 3. As expected, the COVQ codebook wth COVQdstance measure for encodng (curve labeled COVQ, covq-dst. ) works best of all, but there s only a moderate loss for CASVQ, covq-dst.. Moreover, the performance of CASVQ wth the conventonal VQ dstance measure for encodng ( CASVQ, vq-dst. ) s only slghtly nferor to CASVQ, covq-dst.,.e., the better dstance measure does not sgncantly mprove the performance of CASVQ. The results for conventonal VQ wth VQ dstance measure for encodng ( VQ, vq-dst. ) have also been ncluded n Fg. 5 to evaluate the derence between COVQ and CASVQ: when a moderate loss n performance compared to optmally channel-matched COVQ can be accepted, t s possble to apply a CASVQ-codebook wth the smple VQ dstance measure for encodng. Ths allows a very smple and memory-ecent adaptaton of the codng scheme to tme-varyng channels whle keepng most of the performance-gan of optmally matched COVQ. SR n db COVQ, covq dst. CASVQ, covq dst. CASVQ, vq dst. VQ, vq dst Fg. 7. Performance of COVQ, CASVQ, and VQ for the quantzaton of an uncorrelated Gaussan source; codebooks wth C =3 two-dmensonal codevectors are used. Qualtatvely, the same mplcatons hold for the second smulaton, whch agan was carred out for the correlated Gaussan source sgnal, but wth codebooks contanng 8 three-dmensonal codevectors. The results are depcted n Fg. 6. The performances for an uncorrelated Gaussan source sgnal quantzed wth 3 two-dmensonal codevectors are shown n Fg. 7. As above, CASVQ wth the conventonal VQ dstance measure performs close to COVQ.

9 . Gortz, J. Klewer / Sgnal Processng 83 (3) =.5, C =64 codevectors 9 =.5, vector dmenson = SR n db SR n db COVQ, corr. CASVQ, corr. COVQ, uncorr. CASVQ, uncorr. VQ, corr. VQ, uncorr (vector dmenson) 3 COVQ, corr. CASVQ, corr. COVQ, uncorr. CASVQ, uncorr. VQ, corr. VQ, uncorr b (number of quantzer bts) Fg. 8. Performance of COVQ, CASVQ (wth VQ dstance measure), and conventonal VQ for the quantzaton of strongly correlated and uncorrelated Gaussan sources for varous codevector dmensons ; codebooks wth C = 64 codevectors are used; the bt-error probablty s =:5. Fg. 9. Performance of COVQ, CASVQ (wth VQ dstance measure), and conventonal VQ for the quantzaton of strongly correlated and uncorrelated Gaussan sources for varous codebook szes C = b; codevectors wth dmenson = are used; the bt-error probablty s =:5. Fg. 8 shows the performance dependences of COVQ and CASVQ on the codevector dmenson for a xed number C = 64 of codevectors and a bt-error probablty of =:5. Snce s recprocally proportonal to the source codng rate t s clear that the SR s essentally decreasng for ncreasng. However, the largest gan of COVQ and CASVQ over conventonal VQ s obtaned for small vector dmensons. For strongly correlated ( = :9) source sgnals (where the use of vector quantzaton really pays o) the gan of CASVQ over VQ remans sgncant also for moderate vector dmensons. For uncorrelated source sgnals and hgh vector dmensons there s no sgncant gan by CASVQ over VQ, but n ths case even COVQ works only moderately better than conventonal VQ. In Fg. 9, n contrast to the prevous smulaton, the vector dmenson s xed ( =) but now the number b of quantzer ndex bts (and thus the codebook sze C = b ) s varable, agan for a bt-error probablty of =:5. For both strongly correlated (=:9) and uncorrelated sources the gans of COVQ and CASVQ over VQ ncrease wth the codebook sze. In summary, CASVQ works sgncantly better than conventonal VQ, especally f the source sgnal s correlated and the bt-rate s hgh or, equvalently, when the vector dmenson s small and the number of codevectors s large. The loss of CASVQ compared to COVQ gets larger wth an ncreasng number of codevectors, but at the same tme the gan of CASVQ over conventonal VQ ncreases. 5. Conclusons As a new result we have proposed channel-adaptve scaled vector quantzaton (CASVQ) as a substtute for channel-optmzed vector quantzaton. The advantage of CASVQ s that on tme-varyng channels the memory- and complexty requrements are practcally the same as for conventonal VQ, but, especally for correlated source sgnals, the performance s close to that of optmally channel-matched COVQ, whch would requre to store several codebooks for the adaptaton to tme-varyng channels. The CASVQ codebook s generated by scalng all the codevectors n a reference codebook wth a channel-dependent factor, whch approxmates the shape of the COVQ codebook for the current bt-error probablty. If, addtonally, the conventonal VQ dstance measure s used for encodng, the scalng may be moved from the codevectors to the nput source sgnal, yeldng a further complexty reducton as the normal VQ encodng algorthm can be used

10 58. Gortz, J. Klewer / Sgnal Processng 83 (3) afterwards. The overhead nduced by CASVQ wth the VQ dstance measure (compared wth conventonal VQ) s neglgble, because CASVQ addtonally requres just the scalng of the nput source vector, rescalng after the transmsson, and a small table to store approprate scalng factors for the bt-error probabltes. Thus, CASVQ s very attractve for the transmsson of multmeda sgnals over tme-varant channels, where lmtatons for complexty and memory exst, whch do not allow the applcaton of optmally channel-matched COVQ. References [] F. Alajaj,. Phamdo, Soft-decson COVQ for Raylegh-fadng channels, IEEE Commun. Lett. (6) (June 998) [] G. Ben-Davd, D. Malah, Smple adaptaton of vectorquantzers to combat channel errors, n: Proceedngs of the 6th DSP Workshop, Yosemte, Calforna, USA, October 994, pp [3].-T. Cheng,. Kngsbury, Robust zero-redundancy vector quantzaton for nosy channels, n: Proceedngs of the IEEE Internatonal Conference on Communcatons (ICC), 989, pp [4]. Farvardn, A study of vector quantzaton for nosy channels, IEEE Trans. Inform. Theory 36 (4) (July 99) [5]. Farvardn, V. Vashampayan, On the performance and complexty of channel-optmzed vector quantzers, IEEE Trans. Inform. Theory 37 () (January 99) [6] S. Gadkar, K. Rose, Robust vector quantzer desgn by nosy channel relaxaton, IEEE Trans. Commun. 47 (8) (August 999) 3 6. [7] H. Jafarkhan,. Farvardn, Channel-matched herarchcal table-lookup vector quantzaton for transmsson of vdeo over wreless channels, n: Proceedngs of the IEEE Internatonal Conference on Image Processng (ICIP), September 996, pp [8] H. Jafarkhan,. Farvardn, Desgn of channel-optmzed vector quantzers n the presence of channel msmatch, IEEE Trans. Commun. 48 () (January ) 8 4. [9] Y. Lnde, A. Buzo, R.M. Gray, An algorthm for vector quantzer desgn, IEEE Trans. Commun. COM-8 () (January 98) [] D. Mller, K. Rose, Combned source-channel vector quantzaton usng determnstc annealng, IEEE Trans. Commun. 4 (/3/4) (February Aprl 994) [] M. Skoglund, Soft decodng for vector quantzaton over nosy channels wth memory, IEEE Trans. Inform. Theory 45 (4) (May 999)

VQ widely used in coding speech, image, and video

VQ widely used in coding speech, image, and video at Scalar quantzers are specal cases of vector quantzers (VQ): they are constraned to look at one sample at a tme (memoryless) VQ does not have such constrant better RD perfomance expected Source codng

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

Lecture 3: Shannon s Theorem

Lecture 3: Shannon s Theorem CSE 533: Error-Correctng Codes (Autumn 006 Lecture 3: Shannon s Theorem October 9, 006 Lecturer: Venkatesan Guruswam Scrbe: Wdad Machmouch 1 Communcaton Model The communcaton model we are usng conssts

More information

Hiding data in images by simple LSB substitution

Hiding data in images by simple LSB substitution Pattern Recognton 37 (004) 469 474 www.elsever.com/locate/patcog Hdng data n mages by smple LSB substtuton Ch-Kwong Chan, L.M. Cheng Department of Computer Engneerng and Informaton Technology, Cty Unversty

More information

Error Probability for M Signals

Error Probability for M Signals Chapter 3 rror Probablty for M Sgnals In ths chapter we dscuss the error probablty n decdng whch of M sgnals was transmtted over an arbtrary channel. We assume the sgnals are represented by a set of orthonormal

More information

Low Complexity Soft-Input Soft-Output Hamming Decoder

Low Complexity Soft-Input Soft-Output Hamming Decoder Low Complexty Soft-Input Soft-Output Hammng Der Benjamn Müller, Martn Holters, Udo Zölzer Helmut Schmdt Unversty Unversty of the Federal Armed Forces Department of Sgnal Processng and Communcatons Holstenhofweg

More information

ECE559VV Project Report

ECE559VV Project Report ECE559VV Project Report (Supplementary Notes Loc Xuan Bu I. MAX SUM-RATE SCHEDULING: THE UPLINK CASE We have seen (n the presentaton that, for downlnk (broadcast channels, the strategy maxmzng the sum-rate

More information

Transform Coding. Transform Coding Principle

Transform Coding. Transform Coding Principle Transform Codng Prncple of block-wse transform codng Propertes of orthonormal transforms Dscrete cosne transform (DCT) Bt allocaton for transform coeffcents Entropy codng of transform coeffcents Typcal

More information

Lecture 14 (03/27/18). Channels. Decoding. Preview of the Capacity Theorem.

Lecture 14 (03/27/18). Channels. Decoding. Preview of the Capacity Theorem. Lecture 14 (03/27/18). Channels. Decodng. Prevew of the Capacty Theorem. A. Barg The concept of a communcaton channel n nformaton theory s an abstracton for transmttng dgtal (and analog) nformaton from

More information

Suppose that there s a measured wndow of data fff k () ; :::; ff k g of a sze w, measured dscretely wth varable dscretzaton step. It s convenent to pl

Suppose that there s a measured wndow of data fff k () ; :::; ff k g of a sze w, measured dscretely wth varable dscretzaton step. It s convenent to pl RECURSIVE SPLINE INTERPOLATION METHOD FOR REAL TIME ENGINE CONTROL APPLICATIONS A. Stotsky Volvo Car Corporaton Engne Desgn and Development Dept. 97542, HA1N, SE- 405 31 Gothenburg Sweden. Emal: astotsky@volvocars.com

More information

Application of Nonbinary LDPC Codes for Communication over Fading Channels Using Higher Order Modulations

Application of Nonbinary LDPC Codes for Communication over Fading Channels Using Higher Order Modulations Applcaton of Nonbnary LDPC Codes for Communcaton over Fadng Channels Usng Hgher Order Modulatons Rong-Hu Peng and Rong-Rong Chen Department of Electrcal and Computer Engneerng Unversty of Utah Ths work

More information

Markov Chain Monte Carlo Lecture 6

Markov Chain Monte Carlo Lecture 6 where (x 1,..., x N ) X N, N s called the populaton sze, f(x) f (x) for at least one {1, 2,..., N}, and those dfferent from f(x) are called the tral dstrbutons n terms of mportance samplng. Dfferent ways

More information

Copyright 2017 by Taylor Enterprises, Inc., All Rights Reserved. Adjusted Control Limits for P Charts. Dr. Wayne A. Taylor

Copyright 2017 by Taylor Enterprises, Inc., All Rights Reserved. Adjusted Control Limits for P Charts. Dr. Wayne A. Taylor Taylor Enterprses, Inc. Control Lmts for P Charts Copyrght 2017 by Taylor Enterprses, Inc., All Rghts Reserved. Control Lmts for P Charts Dr. Wayne A. Taylor Abstract: P charts are used for count data

More information

Flexible Quantization

Flexible Quantization wb 06/02/21 1 Flexble Quantzaton Bastaan Klejn KTH School of Electrcal Engneerng Stocholm wb 06/02/21 2 Overvew Motvaton for codng technologes Basc quantzaton and codng Hgh-rate quantzaton theory wb 06/02/21

More information

Kernel Methods and SVMs Extension

Kernel Methods and SVMs Extension Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general

More information

Consider the following passband digital communication system model. c t. modulator. t r a n s m i t t e r. signal decoder.

Consider the following passband digital communication system model. c t. modulator. t r a n s m i t t e r. signal decoder. PASSBAND DIGITAL MODULATION TECHNIQUES Consder the followng passband dgtal communcaton system model. cos( ω + φ ) c t message source m sgnal encoder s modulator s () t communcaton xt () channel t r a n

More information

Novel Pre-Compression Rate-Distortion Optimization Algorithm for JPEG 2000

Novel Pre-Compression Rate-Distortion Optimization Algorithm for JPEG 2000 Novel Pre-Compresson Rate-Dstorton Optmzaton Algorthm for JPEG 2000 Yu-We Chang, Hung-Ch Fang, Chung-Jr Lan, and Lang-Gee Chen DSP/IC Desgn Laboratory, Graduate Insttute of Electroncs Engneerng Natonal

More information

Chapter 7 Channel Capacity and Coding

Chapter 7 Channel Capacity and Coding Wreless Informaton Transmsson System Lab. Chapter 7 Channel Capacty and Codng Insttute of Communcatons Engneerng atonal Sun Yat-sen Unversty Contents 7. Channel models and channel capacty 7.. Channel models

More information

Power Allocation for Distributed BLUE Estimation with Full and Limited Feedback of CSI

Power Allocation for Distributed BLUE Estimation with Full and Limited Feedback of CSI Power Allocaton for Dstrbuted BLUE Estmaton wth Full and Lmted Feedback of CSI Mohammad Fanae, Matthew C. Valent, and Natala A. Schmd Lane Department of Computer Scence and Electrcal Engneerng West Vrgna

More information

Generalized Linear Methods

Generalized Linear Methods Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set

More information

On balancing multiple video streams with distributed QoS control in mobile communications

On balancing multiple video streams with distributed QoS control in mobile communications On balancng multple vdeo streams wth dstrbuted QoS control n moble communcatons Arjen van der Schaaf, José Angel Lso Arellano, and R. (Inald) L. Lagendjk TU Delft, Mekelweg 4, 68 CD Delft, The Netherlands

More information

ROBUST ENCODING OF THE FS1016 LSF PARAMETERS : APPLICATION OF THE CHANNEL OPTIMIZED TRELLIS CODED VECTOR QUANTIZATION

ROBUST ENCODING OF THE FS1016 LSF PARAMETERS : APPLICATION OF THE CHANNEL OPTIMIZED TRELLIS CODED VECTOR QUANTIZATION ROBUST ENCODING OF THE FS6 LSF PARAMETERS : APPLICATION OF THE CHANNEL OPTIMIZED TRELLIS CODED VECTOR QUANTIZATION BOUZID Merouane Speech Communcaton and Sgnal Processng Laboratory, Electroncs Faculty,

More information

Lecture 12: Classification

Lecture 12: Classification Lecture : Classfcaton g Dscrmnant functons g The optmal Bayes classfer g Quadratc classfers g Eucldean and Mahalanobs metrcs g K Nearest Neghbor Classfers Intellgent Sensor Systems Rcardo Guterrez-Osuna

More information

MAXIMUM A POSTERIORI TRANSDUCTION

MAXIMUM A POSTERIORI TRANSDUCTION MAXIMUM A POSTERIORI TRANSDUCTION LI-WEI WANG, JU-FU FENG School of Mathematcal Scences, Peng Unversty, Bejng, 0087, Chna Center for Informaton Scences, Peng Unversty, Bejng, 0087, Chna E-MIAL: {wanglw,

More information

Lossy Compression. Compromise accuracy of reconstruction for increased compression.

Lossy Compression. Compromise accuracy of reconstruction for increased compression. Lossy Compresson Compromse accuracy of reconstructon for ncreased compresson. The reconstructon s usually vsbly ndstngushable from the orgnal mage. Typcally, one can get up to 0:1 compresson wth almost

More information

where the sums are over the partcle labels. In general H = p2 2m + V s(r ) V j = V nt (jr, r j j) (5) where V s s the sngle-partcle potental and V nt

where the sums are over the partcle labels. In general H = p2 2m + V s(r ) V j = V nt (jr, r j j) (5) where V s s the sngle-partcle potental and V nt Physcs 543 Quantum Mechancs II Fall 998 Hartree-Fock and the Self-consstent Feld Varatonal Methods In the dscusson of statonary perturbaton theory, I mentoned brey the dea of varatonal approxmaton schemes.

More information

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography CSc 6974 and ECSE 6966 Math. Tech. for Vson, Graphcs and Robotcs Lecture 21, Aprl 17, 2006 Estmatng A Plane Homography Overvew We contnue wth a dscusson of the major ssues, usng estmaton of plane projectve

More information

Pulse Coded Modulation

Pulse Coded Modulation Pulse Coded Modulaton PCM (Pulse Coded Modulaton) s a voce codng technque defned by the ITU-T G.711 standard and t s used n dgtal telephony to encode the voce sgnal. The frst step n the analog to dgtal

More information

Asymptotic Quantization: A Method for Determining Zador s Constant

Asymptotic Quantization: A Method for Determining Zador s Constant Asymptotc Quantzaton: A Method for Determnng Zador s Constant Joyce Shh Because of the fnte capacty of modern communcaton systems better methods of encodng data are requred. Quantzaton refers to the methods

More information

Uncertainty and auto-correlation in. Measurement

Uncertainty and auto-correlation in. Measurement Uncertanty and auto-correlaton n arxv:1707.03276v2 [physcs.data-an] 30 Dec 2017 Measurement Markus Schebl Federal Offce of Metrology and Surveyng (BEV), 1160 Venna, Austra E-mal: markus.schebl@bev.gv.at

More information

On the correction of the h-index for career length

On the correction of the h-index for career length 1 On the correcton of the h-ndex for career length by L. Egghe Unverstet Hasselt (UHasselt), Campus Depenbeek, Agoralaan, B-3590 Depenbeek, Belgum 1 and Unverstet Antwerpen (UA), IBW, Stadscampus, Venusstraat

More information

Speeding up Computation of Scalar Multiplication in Elliptic Curve Cryptosystem

Speeding up Computation of Scalar Multiplication in Elliptic Curve Cryptosystem H.K. Pathak et. al. / (IJCSE) Internatonal Journal on Computer Scence and Engneerng Speedng up Computaton of Scalar Multplcaton n Ellptc Curve Cryptosystem H. K. Pathak Manju Sangh S.o.S n Computer scence

More information

Simulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests

Simulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests Smulated of the Cramér-von Mses Goodness-of-Ft Tests Steele, M., Chaselng, J. and 3 Hurst, C. School of Mathematcal and Physcal Scences, James Cook Unversty, Australan School of Envronmental Studes, Grffth

More information

A NEW DISCRETE WAVELET TRANSFORM

A NEW DISCRETE WAVELET TRANSFORM A NEW DISCRETE WAVELET TRANSFORM ALEXANDRU ISAR, DORINA ISAR Keywords: Dscrete wavelet, Best energy concentraton, Low SNR sgnals The Dscrete Wavelet Transform (DWT) has two parameters: the mother of wavelets

More information

FUZZY GOAL PROGRAMMING VS ORDINARY FUZZY PROGRAMMING APPROACH FOR MULTI OBJECTIVE PROGRAMMING PROBLEM

FUZZY GOAL PROGRAMMING VS ORDINARY FUZZY PROGRAMMING APPROACH FOR MULTI OBJECTIVE PROGRAMMING PROBLEM Internatonal Conference on Ceramcs, Bkaner, Inda Internatonal Journal of Modern Physcs: Conference Seres Vol. 22 (2013) 757 761 World Scentfc Publshng Company DOI: 10.1142/S2010194513010982 FUZZY GOAL

More information

Société de Calcul Mathématique SA

Société de Calcul Mathématique SA Socété de Calcul Mathématque SA Outls d'ade à la décson Tools for decson help Probablstc Studes: Normalzng the Hstograms Bernard Beauzamy December, 202 I. General constructon of the hstogram Any probablstc

More information

On an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1

On an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1 On an Extenson of Stochastc Approxmaton EM Algorthm for Incomplete Data Problems Vahd Tadayon Abstract: The Stochastc Approxmaton EM (SAEM algorthm, a varant stochastc approxmaton of EM, s a versatle tool

More information

The Synchronous 8th-Order Differential Attack on 12 Rounds of the Block Cipher HyRAL

The Synchronous 8th-Order Differential Attack on 12 Rounds of the Block Cipher HyRAL The Synchronous 8th-Order Dfferental Attack on 12 Rounds of the Block Cpher HyRAL Yasutaka Igarash, Sej Fukushma, and Tomohro Hachno Kagoshma Unversty, Kagoshma, Japan Emal: {garash, fukushma, hachno}@eee.kagoshma-u.ac.jp

More information

Chapter 8 SCALAR QUANTIZATION

Chapter 8 SCALAR QUANTIZATION Outlne Chapter 8 SCALAR QUANTIZATION Yeuan-Kuen Lee [ CU, CSIE ] 8.1 Overvew 8. Introducton 8.4 Unform Quantzer 8.5 Adaptve Quantzaton 8.6 Nonunform Quantzaton 8.7 Entropy-Coded Quantzaton Ch 8 Scalar

More information

A new construction of 3-separable matrices via an improved decoding of Macula s construction

A new construction of 3-separable matrices via an improved decoding of Macula s construction Dscrete Optmzaton 5 008 700 704 Contents lsts avalable at ScenceDrect Dscrete Optmzaton journal homepage: wwwelsevercom/locate/dsopt A new constructon of 3-separable matrces va an mproved decodng of Macula

More information

Numerical Heat and Mass Transfer

Numerical Heat and Mass Transfer Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and

More information

An Application of Fuzzy Hypotheses Testing in Radar Detection

An Application of Fuzzy Hypotheses Testing in Radar Detection Proceedngs of the th WSES Internatonal Conference on FUZZY SYSEMS n pplcaton of Fuy Hypotheses estng n Radar Detecton.K.ELSHERIF, F.M.BBDY, G.M.BDELHMID Department of Mathematcs Mltary echncal Collage

More information

Using Immune Genetic Algorithm to Optimize BP Neural Network and Its Application Peng-fei LIU1,Qun-tai SHEN1 and Jun ZHI2,*

Using Immune Genetic Algorithm to Optimize BP Neural Network and Its Application Peng-fei LIU1,Qun-tai SHEN1 and Jun ZHI2,* Advances n Computer Scence Research (ACRS), volume 54 Internatonal Conference on Computer Networks and Communcaton Technology (CNCT206) Usng Immune Genetc Algorthm to Optmze BP Neural Network and Its Applcaton

More information

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg prnceton unv. F 17 cos 521: Advanced Algorthm Desgn Lecture 7: LP Dualty Lecturer: Matt Wenberg Scrbe: LP Dualty s an extremely useful tool for analyzng structural propertes of lnear programs. Whle there

More information

Chapter 7 Channel Capacity and Coding

Chapter 7 Channel Capacity and Coding Chapter 7 Channel Capacty and Codng Contents 7. Channel models and channel capacty 7.. Channel models Bnary symmetrc channel Dscrete memoryless channels Dscrete-nput, contnuous-output channel Waveform

More information

Department of Electrical & Electronic Engineeing Imperial College London. E4.20 Digital IC Design. Median Filter Project Specification

Department of Electrical & Electronic Engineeing Imperial College London. E4.20 Digital IC Design. Median Filter Project Specification Desgn Project Specfcaton Medan Flter Department of Electrcal & Electronc Engneeng Imperal College London E4.20 Dgtal IC Desgn Medan Flter Project Specfcaton A medan flter s used to remove nose from a sampled

More information

Learning Theory: Lecture Notes

Learning Theory: Lecture Notes Learnng Theory: Lecture Notes Lecturer: Kamalka Chaudhur Scrbe: Qush Wang October 27, 2012 1 The Agnostc PAC Model Recall that one of the constrants of the PAC model s that the data dstrbuton has to be

More information

Quantum and Classical Information Theory with Disentropy

Quantum and Classical Information Theory with Disentropy Quantum and Classcal Informaton Theory wth Dsentropy R V Ramos rubensramos@ufcbr Lab of Quantum Informaton Technology, Department of Telenformatc Engneerng Federal Unversty of Ceara - DETI/UFC, CP 6007

More information

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS Avalable onlne at http://sck.org J. Math. Comput. Sc. 3 (3), No., 6-3 ISSN: 97-537 COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

More information

A Fast Fractal Image Compression Algorithm Using Predefined Values for Contrast Scaling

A Fast Fractal Image Compression Algorithm Using Predefined Values for Contrast Scaling Proceedngs of the World Congress on Engneerng and Computer Scence 007 WCECS 007, October 4-6, 007, San Francsco, USA A Fast Fractal Image Compresson Algorthm Usng Predefned Values for Contrast Scalng H.

More information

The Order Relation and Trace Inequalities for. Hermitian Operators

The Order Relation and Trace Inequalities for. Hermitian Operators Internatonal Mathematcal Forum, Vol 3, 08, no, 507-57 HIKARI Ltd, wwwm-hkarcom https://doorg/0988/mf088055 The Order Relaton and Trace Inequaltes for Hermtan Operators Y Huang School of Informaton Scence

More information

Average Decision Threshold of CA CFAR and excision CFAR Detectors in the Presence of Strong Pulse Jamming 1

Average Decision Threshold of CA CFAR and excision CFAR Detectors in the Presence of Strong Pulse Jamming 1 Average Decson hreshold of CA CFAR and excson CFAR Detectors n the Presence of Strong Pulse Jammng Ivan G. Garvanov and Chrsto A. Kabachev Insttute of Informaton echnologes Bulgaran Academy of Scences

More information

This column is a continuation of our previous column

This column is a continuation of our previous column Comparson of Goodness of Ft Statstcs for Lnear Regresson, Part II The authors contnue ther dscusson of the correlaton coeffcent n developng a calbraton for quanttatve analyss. Jerome Workman Jr. and Howard

More information

Real-Time Systems. Multiprocessor scheduling. Multiprocessor scheduling. Multiprocessor scheduling

Real-Time Systems. Multiprocessor scheduling. Multiprocessor scheduling. Multiprocessor scheduling Real-Tme Systems Multprocessor schedulng Specfcaton Implementaton Verfcaton Multprocessor schedulng -- -- Global schedulng How are tasks assgned to processors? Statc assgnment The processor(s) used for

More information

Feature Selection: Part 1

Feature Selection: Part 1 CSE 546: Machne Learnng Lecture 5 Feature Selecton: Part 1 Instructor: Sham Kakade 1 Regresson n the hgh dmensonal settng How do we learn when the number of features d s greater than the sample sze n?

More information

Structure and Drive Paul A. Jensen Copyright July 20, 2003

Structure and Drive Paul A. Jensen Copyright July 20, 2003 Structure and Drve Paul A. Jensen Copyrght July 20, 2003 A system s made up of several operatons wth flow passng between them. The structure of the system descrbes the flow paths from nputs to outputs.

More information

Microwave Diversity Imaging Compression Using Bioinspired

Microwave Diversity Imaging Compression Using Bioinspired Mcrowave Dversty Imagng Compresson Usng Bonspred Neural Networks Youwe Yuan 1, Yong L 1, Wele Xu 1, Janghong Yu * 1 School of Computer Scence and Technology, Hangzhou Danz Unversty, Hangzhou, Zhejang,

More information

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers Psychology 282 Lecture #24 Outlne Regresson Dagnostcs: Outlers In an earler lecture we studed the statstcal assumptons underlyng the regresson model, ncludng the followng ponts: Formal statement of assumptons.

More information

A New Design of Multiplier using Modified Booth Algorithm and Reversible Gate Logic

A New Design of Multiplier using Modified Booth Algorithm and Reversible Gate Logic Internatonal Journal of Computer Applcatons Technology and Research A New Desgn of Multpler usng Modfed Booth Algorthm and Reversble Gate Logc K.Nagarjun Department of ECE Vardhaman College of Engneerng,

More information

A Bayes Algorithm for the Multitask Pattern Recognition Problem Direct Approach

A Bayes Algorithm for the Multitask Pattern Recognition Problem Direct Approach A Bayes Algorthm for the Multtask Pattern Recognton Problem Drect Approach Edward Puchala Wroclaw Unversty of Technology, Char of Systems and Computer etworks, Wybrzeze Wyspanskego 7, 50-370 Wroclaw, Poland

More information

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS HCMC Unversty of Pedagogy Thong Nguyen Huu et al. A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS Thong Nguyen Huu and Hao Tran Van Department of mathematcs-nformaton,

More information

Research Article Green s Theorem for Sign Data

Research Article Green s Theorem for Sign Data Internatonal Scholarly Research Network ISRN Appled Mathematcs Volume 2012, Artcle ID 539359, 10 pages do:10.5402/2012/539359 Research Artcle Green s Theorem for Sgn Data Lous M. Houston The Unversty of

More information

Durban Watson for Testing the Lack-of-Fit of Polynomial Regression Models without Replications

Durban Watson for Testing the Lack-of-Fit of Polynomial Regression Models without Replications Durban Watson for Testng the Lack-of-Ft of Polynomal Regresson Models wthout Replcatons Ruba A. Alyaf, Maha A. Omar, Abdullah A. Al-Shha ralyaf@ksu.edu.sa, maomar@ksu.edu.sa, aalshha@ksu.edu.sa Department

More information

Global Sensitivity. Tuesday 20 th February, 2018

Global Sensitivity. Tuesday 20 th February, 2018 Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values

More information

/ n ) are compared. The logic is: if the two

/ n ) are compared. The logic is: if the two STAT C141, Sprng 2005 Lecture 13 Two sample tests One sample tests: examples of goodness of ft tests, where we are testng whether our data supports predctons. Two sample tests: called as tests of ndependence

More information

CS : Algorithms and Uncertainty Lecture 17 Date: October 26, 2016

CS : Algorithms and Uncertainty Lecture 17 Date: October 26, 2016 CS 29-128: Algorthms and Uncertanty Lecture 17 Date: October 26, 2016 Instructor: Nkhl Bansal Scrbe: Mchael Denns 1 Introducton In ths lecture we wll be lookng nto the secretary problem, and an nterestng

More information

Inductance Calculation for Conductors of Arbitrary Shape

Inductance Calculation for Conductors of Arbitrary Shape CRYO/02/028 Aprl 5, 2002 Inductance Calculaton for Conductors of Arbtrary Shape L. Bottura Dstrbuton: Internal Summary In ths note we descrbe a method for the numercal calculaton of nductances among conductors

More information

Hopfield networks and Boltzmann machines. Geoffrey Hinton et al. Presented by Tambet Matiisen

Hopfield networks and Boltzmann machines. Geoffrey Hinton et al. Presented by Tambet Matiisen Hopfeld networks and Boltzmann machnes Geoffrey Hnton et al. Presented by Tambet Matsen 18.11.2014 Hopfeld network Bnary unts Symmetrcal connectons http://www.nnwj.de/hopfeld-net.html Energy functon The

More information

Outline. Communication. Bellman Ford Algorithm. Bellman Ford Example. Bellman Ford Shortest Path [1]

Outline. Communication. Bellman Ford Algorithm. Bellman Ford Example. Bellman Ford Shortest Path [1] DYNAMIC SHORTEST PATH SEARCH AND SYNCHRONIZED TASK SWITCHING Jay Wagenpfel, Adran Trachte 2 Outlne Shortest Communcaton Path Searchng Bellmann Ford algorthm Algorthm for dynamc case Modfcatons to our algorthm

More information

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton

More information

Chapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise.

Chapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise. Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where y + = β + β e for =,..., y and are observable varables e s a random error How can an estmaton rule be constructed for the

More information

P R. Lecture 4. Theory and Applications of Pattern Recognition. Dept. of Electrical and Computer Engineering /

P R. Lecture 4. Theory and Applications of Pattern Recognition. Dept. of Electrical and Computer Engineering / Theory and Applcatons of Pattern Recognton 003, Rob Polkar, Rowan Unversty, Glassboro, NJ Lecture 4 Bayes Classfcaton Rule Dept. of Electrcal and Computer Engneerng 0909.40.0 / 0909.504.04 Theory & Applcatons

More information

What would be a reasonable choice of the quantization step Δ?

What would be a reasonable choice of the quantization step Δ? CE 108 HOMEWORK 4 EXERCISE 1. Suppose you are samplng the output of a sensor at 10 KHz and quantze t wth a unform quantzer at 10 ts per sample. Assume that the margnal pdf of the sgnal s Gaussan wth mean

More information

EGR 544 Communication Theory

EGR 544 Communication Theory EGR 544 Communcaton Theory. Informaton Sources Z. Alyazcoglu Electrcal and Computer Engneerng Department Cal Poly Pomona Introducton Informaton Source x n Informaton sources Analog sources Dscrete sources

More information

Chapter Newton s Method

Chapter Newton s Method Chapter 9. Newton s Method After readng ths chapter, you should be able to:. Understand how Newton s method s dfferent from the Golden Secton Search method. Understand how Newton s method works 3. Solve

More information

NUMERICAL DIFFERENTIATION

NUMERICAL DIFFERENTIATION NUMERICAL DIFFERENTIATION 1 Introducton Dfferentaton s a method to compute the rate at whch a dependent output y changes wth respect to the change n the ndependent nput x. Ths rate of change s called the

More information

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also

More information

Analytical Gradient Evaluation of Cost Functions in. General Field Solvers: A Novel Approach for. Optimization of Microwave Structures

Analytical Gradient Evaluation of Cost Functions in. General Field Solvers: A Novel Approach for. Optimization of Microwave Structures IMS 2 Workshop Analytcal Gradent Evaluaton of Cost Functons n General Feld Solvers: A Novel Approach for Optmzaton of Mcrowave Structures P. Harscher, S. Amar* and R. Vahldeck and J. Bornemann* Swss Federal

More information

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U) Econ 413 Exam 13 H ANSWERS Settet er nndelt 9 deloppgaver, A,B,C, som alle anbefales å telle lkt for å gøre det ltt lettere å stå. Svar er gtt . Unfortunately, there s a prntng error n the hnt of

More information

Problem Set 9 Solutions

Problem Set 9 Solutions Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem

More information

Linear Approximation with Regularization and Moving Least Squares

Linear Approximation with Regularization and Moving Least Squares Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...

More information

A Lower Bound on SINR Threshold for Call Admission Control in Multiple-Class CDMA Systems with Imperfect Power-Control

A Lower Bound on SINR Threshold for Call Admission Control in Multiple-Class CDMA Systems with Imperfect Power-Control A ower Bound on SIR Threshold for Call Admsson Control n Multple-Class CDMA Systems w Imperfect ower-control Mohamed H. Ahmed Faculty of Engneerng and Appled Scence Memoral Unversty of ewfoundland St.

More information

EEE 241: Linear Systems

EEE 241: Linear Systems EEE : Lnear Systems Summary #: Backpropagaton BACKPROPAGATION The perceptron rule as well as the Wdrow Hoff learnng were desgned to tran sngle layer networks. They suffer from the same dsadvantage: they

More information

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons

More information

CSE4210 Architecture and Hardware for DSP

CSE4210 Architecture and Hardware for DSP 4210 Archtecture and Hardware for DSP Lecture 1 Introducton & Number systems Admnstratve Stuff 4210 Archtecture and Hardware for DSP Text: VLSI Dgtal Sgnal Processng Systems: Desgn and Implementaton. K.

More information

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin Proceedngs of the 007 Wnter Smulaton Conference S G Henderson, B Bller, M-H Hseh, J Shortle, J D Tew, and R R Barton, eds LOW BIAS INTEGRATED PATH ESTIMATORS James M Calvn Department of Computer Scence

More information

Regularized Discriminant Analysis for Face Recognition

Regularized Discriminant Analysis for Face Recognition 1 Regularzed Dscrmnant Analyss for Face Recognton Itz Pma, Mayer Aladem Department of Electrcal and Computer Engneerng, Ben-Guron Unversty of the Negev P.O.Box 653, Beer-Sheva, 845, Israel. Abstract Ths

More information

DC-Free Turbo Coding Scheme Using MAP/SOVA Algorithms

DC-Free Turbo Coding Scheme Using MAP/SOVA Algorithms Proceedngs of the 5th WSEAS Internatonal Conference on Telecommuncatons and Informatcs, Istanbul, Turkey, May 27-29, 26 (pp192-197 DC-Free Turbo Codng Scheme Usng MAP/SOVA Algorthms Prof. Dr. M. Amr Mokhtar

More information

Switched Quasi-Logarithmic Quantizer with Golomb Rice Coding

Switched Quasi-Logarithmic Quantizer with Golomb Rice Coding http://dx.do.org/10.5755/j01.ee.3.4.1877 Swtched Quas-Logarthmc Quantzer wth Golomb Rce Codng Nkola Vucc 1, Zoran Perc 1, Mlan Dncc 1 1 Faculty of Electronc Engneerng, Unversty of Ns, Aleksandar Medvedev

More information

Workshop: Approximating energies and wave functions Quantum aspects of physical chemistry

Workshop: Approximating energies and wave functions Quantum aspects of physical chemistry Workshop: Approxmatng energes and wave functons Quantum aspects of physcal chemstry http://quantum.bu.edu/pltl/6/6.pdf Last updated Thursday, November 7, 25 7:9:5-5: Copyrght 25 Dan Dll (dan@bu.edu) Department

More information

O-line Temporary Tasks Assignment. Abstract. In this paper we consider the temporary tasks assignment

O-line Temporary Tasks Assignment. Abstract. In this paper we consider the temporary tasks assignment O-lne Temporary Tasks Assgnment Yoss Azar and Oded Regev Dept. of Computer Scence, Tel-Avv Unversty, Tel-Avv, 69978, Israel. azar@math.tau.ac.l??? Dept. of Computer Scence, Tel-Avv Unversty, Tel-Avv, 69978,

More information

CONTRAST ENHANCEMENT FOR MIMIMUM MEAN BRIGHTNESS ERROR FROM HISTOGRAM PARTITIONING INTRODUCTION

CONTRAST ENHANCEMENT FOR MIMIMUM MEAN BRIGHTNESS ERROR FROM HISTOGRAM PARTITIONING INTRODUCTION CONTRAST ENHANCEMENT FOR MIMIMUM MEAN BRIGHTNESS ERROR FROM HISTOGRAM PARTITIONING N. Phanthuna 1,2, F. Cheevasuvt 2 and S. Chtwong 2 1 Department of Electrcal Engneerng, Faculty of Engneerng Rajamangala

More information

Tornado and Luby Transform Codes. Ashish Khisti Presentation October 22, 2003

Tornado and Luby Transform Codes. Ashish Khisti Presentation October 22, 2003 Tornado and Luby Transform Codes Ashsh Khst 6.454 Presentaton October 22, 2003 Background: Erasure Channel Elas[956] studed the Erasure Channel β x x β β x 2 m x 2 k? Capacty of Noseless Erasure Channel

More information

Pop-Click Noise Detection Using Inter-Frame Correlation for Improved Portable Auditory Sensing

Pop-Click Noise Detection Using Inter-Frame Correlation for Improved Portable Auditory Sensing Advanced Scence and Technology Letters, pp.164-168 http://dx.do.org/10.14257/astl.2013 Pop-Clc Nose Detecton Usng Inter-Frame Correlaton for Improved Portable Audtory Sensng Dong Yun Lee, Kwang Myung Jeon,

More information

e i is a random error

e i is a random error Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where + β + β e for,..., and are observable varables e s a random error How can an estmaton rule be constructed for the unknown

More information

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have

More information

FREQUENCY DISTRIBUTIONS Page 1 of The idea of a frequency distribution for sets of observations will be introduced,

FREQUENCY DISTRIBUTIONS Page 1 of The idea of a frequency distribution for sets of observations will be introduced, FREQUENCY DISTRIBUTIONS Page 1 of 6 I. Introducton 1. The dea of a frequency dstrbuton for sets of observatons wll be ntroduced, together wth some of the mechancs for constructng dstrbutons of data. Then

More information

Markov Chain Monte Carlo (MCMC), Gibbs Sampling, Metropolis Algorithms, and Simulated Annealing Bioinformatics Course Supplement

Markov Chain Monte Carlo (MCMC), Gibbs Sampling, Metropolis Algorithms, and Simulated Annealing Bioinformatics Course Supplement Markov Chan Monte Carlo MCMC, Gbbs Samplng, Metropols Algorthms, and Smulated Annealng 2001 Bonformatcs Course Supplement SNU Bontellgence Lab http://bsnuackr/ Outlne! Markov Chan Monte Carlo MCMC! Metropols-Hastngs

More information

One-sided finite-difference approximations suitable for use with Richardson extrapolation

One-sided finite-difference approximations suitable for use with Richardson extrapolation Journal of Computatonal Physcs 219 (2006) 13 20 Short note One-sded fnte-dfference approxmatons sutable for use wth Rchardson extrapolaton Kumar Rahul, S.N. Bhattacharyya * Department of Mechancal Engneerng,

More information

Analysis of Queuing Delay in Multimedia Gateway Call Routing

Analysis of Queuing Delay in Multimedia Gateway Call Routing Analyss of Queung Delay n Multmeda ateway Call Routng Qwe Huang UTtarcom Inc, 33 Wood Ave. outh Iseln, NJ 08830, U..A Errol Lloyd Computer Informaton cences Department, Unv. of Delaware, Newark, DE 976,

More information