A Novel Approach to Eliminating the Permutation and Scaling Indeterminacies of Block BSS

Size: px
Start display at page:

Download "A Novel Approach to Eliminating the Permutation and Scaling Indeterminacies of Block BSS"

Transcription

1 We Zhao, Yuehong Shen, Pengcheng Xu, Zhgang Yuan, Ymn We, We Jan A ovel Approach to Elmnatng the Permutaton and Scalng Indetermnaces of Block BSS WEI ZAO, YUEOG SE, PEGCEG XU, ZIGAG YUA, YIMI WEI, WEI JIA College of Communcatons Engneerng PLA Unversty of Scence and Technology oubaoyng Road o.88, Qnhua Dstrct, 4, anng CIA gmaye@6.com Abstract: - Ths paper consders the permutaton and scalng ndetermnacy problem of blnd source separaton (BSS) n the case that the contnuously mxng sgnals are splt n tme and processed block by block. When tyng the separated sgnals n each tme block, the recovered whole sgnals dffer from the orgnal sources up to permutaton and scalng ndetermnaces. Inspred by prevous Permutaton Method of reconstructng source sgnals n tme doman, a novel approach s proposed to elmnate the nherent permutaton and scalng ndetermnaces when the block BSS s consdered. Ths new method reformulates the mxng sgnals by overlappng adacent sgnal blocks partally and utlzes the dependent correlaton of the overlappng sgnals n each adacent block to adust the permutaton and scalng parameters. Compared wth the Permutaton Method, ths new method s more effcent n terms of separaton qualty and s much qucker n terms of executon speed. The performance of ths novel approach s confrmed by computer smulatons and realstc experments performed on wreless communcaton system. Key-Words: - blnd source separaton; ndependent component analyss; permutaton and scalng ndetermnaces; adacent tme blocks; overlappng sgnals; permutaton method Introducton For the recent decades, blnd source separaton (BSS) has receved consderable attenton, manly due to ts wde panel of potental applcatons such as mage recognton, audo processng, bology, wreless communcatons, etc []. BSS shows sgnfcant advantages n recovery of unknown source sgnals over other frameworks where technques strongly depend on the nformaton of sgnal dversty, transfer functons and so on. In the case where source sgnals are lnearly and nstantaneously mxed, BSS corresponds to ndependent component analyss (ICA). The core assumpton n ICA s reduced to the statstcal mutually ndependence between sources []. owever, for BSS one problem s nhered from the property of the followng ambgutes as presented n [3]. The frst ambguty s the exstence of the unknown complex scalng factor, whch results n the ambguous phase and ampltude n separated sgnals. The other ambguty s the permutaton of the separated sgnals. These ambgutes cause problems when contnuously ncomng measurement data s splt n tme and when they are processed block by block. Tyng components at adacent blocks wthout permutaton and rescalng does not recover the orgnal sgnals correctly. In order to solve the problem, several methods have been contrved as follows. DOA type [3], [4] methods te sgnal blocks wth smlar DOA and requre an array manfold. Snce t requres an array manfold, t degrades permutaton accuracy by calbraton error. Correlaton based methods [], [6] compute the correlaton coeffcent of all possble combnaton of separated sgnals n adacent blocks. But they are not approprately used n practcal applcaton n terms of computatonal resource. Recently, a permutaton algnment scheme based on mcrophone array drectvty patterns for speech sgnals s proposed n [7], where nterestng connectons between BSS and deal beamformng s explored. A permutaton method based upon the smlarty of the column vectors of the mxng matrx and trackng flters s proposed to concatenate ICA separated source sgnal tme blocks [8]. owever, the trackng flter s dffcult to control and complex to desgn. A contrast functon for ICA wthout permutaton ambguty s proposed n [9], []. It s proved that a lnear combnaton of the separator output fourth-order margnal cumulants s a vald contrast functon for ICA under E-ISS: Volume,

2 We Zhao, Yuehong Shen, Pengcheng Xu, Zhgang Yuan, Ymn We, We Jan prewhtenng f the weghts have the same sgn as the source kurtoss []. If, n addton, the source kurtoss are dfferent and so are the lnear combnaton weghts, the contrast elmnates the permutaton ambguty typcal to ICA, as the estmated sources are sorted at the separator output accordng to ther kurtoss values n the same order as the weghts. Inspred from the Permutaton Method n [8], n ths paper, we propose a novel approach to elmnate the permutaton and scalng ndetermnaces of BSS n the case where contnuously mxng measurement data s splt n tme and processed block by block. We artfcally reformulate the mxng sgnals by makng adacent sgnal blocks overlap partally. Takng advantage of the dependent correlaton of separated components n the overlappng part of correspondng adacent blocks, the permutaton and scalng of the latter blocks are adusted to be dentcal to that of the former blocks. Computer smulatons and realstc experments are performed to valdate the performance of our new method. Ths paper s organzed as follows. The system model and assumptons are presented n Secton. Our novel approach s ntroduced n Secton 3. Computer smulatons and realstc experments are performed n Secton 4. Secton concludes ths paper. Model and Assumptons. System model In ths paper, the BSS system model we consder s shown n Fg.. The source sgnals are denoted by s() t = [ s (), t, s ()] t T, where T means the transpose. The mxng sgnals are denoted by x() t = [ x (), t, x ()] T M t. The relatonshp between source and mxture sgnals can be descrbed as s () t s () t s () t A x () t x () t x () t M W Fg.. BSS system model yt () y () t y () t x() t = As() t () where A s the mxng matrx of M, whch s composed of M row vectors,.e., Α = [ a, a,, a ] T M. Smlarly, the recovered sgnals are denoted by y () t = [ y () t,, y () t ] T. The relatonshp between mxture and separaton sgnals can be descrbed as y( t) = W x( t ) () where W s the separatng matrx of M, whch contans column,.e., W= [ w, w,, w ]. W means the ermtan of W, that s W s transposed and conugated. Wthout loss of generalty and for smplcty, we assume the number of sources equal to that of observed sgnals,.e., = M n ths paper.. Assumptons on the model In order to recover the source sgnals blndly and successfully, we make two assumptons on the BSS system model. A. The source sgnals are statonary and statstcally ndependent, and they have zero-mean and unt varance. A. The mxng system s lnear and nstantaneous. 3 ew Permutaton and Scalng Elmnaton Approach 3. Permutaton and scalng ndetermnaces Frst, we set the global matrx as G = W A. In fact, the recovered sgnals are the estmatons of sources up to permutaton and scalng ndetermnaces,.e., y = Gs y g g g s y g g g s = (3) y g g g s g where y = g s = g e s,, =,,,. ϕ The permutaton ndetermnacy exsts when and the scalng ndetermnacy, ampltude and phase, exst when g or ϕg. The ndetermnaces are common to all BSS methods; fortunately, they are nsgnfcant n most applcatons. owever, when the mxng data s splt n tme and processed block by block, tyng the separated sgnals n each tme block may not recover the orgnal sources correctly. More precsely, the separated sgnals of each adacent block may dffer n permutaton, ampltude and phase, whch may lead to ndetermnacy when they are ted together. As shown n Fg., t can be seen obvously that the ambguty problem exsts E-ISS: Volume,

3 We Zhao, Yuehong Shen, Pengcheng Xu, Zhgang Yuan, Ymn We, We Jan between source sgnals and recovered sgnals when tyng recovered sgnals block by block. Source sgnals Separated sgnals Tme Fg.. Ambgutes between source sgnals and recovered sgnals 3. Overlappng sgnals Second, we reformulate the mxng sgnals by overlappng adacent tme blocks partally, whch s called the overlappng sgnals. When the samples rate s fxed, we assume the samples of each block are T. The -th and (+)-th block of mxture sgnals are denoted by x = x (: T) = [ x (), x (),, x ( T)] and x = x (: T) = [ x (), x (),, x ( T)] = [ x ( T L+ ), x ( T L+ ),, x ( T), x ( L+ ), x ( L+ ),, x ( T)] (4) In (4), we can see clearly the frst L samples x ( T L+ ), x ( T L+ ),, x ( T) n the (+)- th block are the overlappng part between the -th and (+)-th block,.e., the overlappng sgnals. For smplcty, we assume T s dvsble by L n ths paper. The structural model of the -th and (+)-th mxture blocks and correspondng overlappng sgnals s shown n Fg. 3, n whch the length of overlappng sgnals s artfcally set by L. Fg. 3. The -th and (+)-th mxture blocks and correspondng overlappng sgnals wth length of L. For the sake of convenence, we denote the separated sgnals of the -th block of mxture sgnals by y = y (: T) = [ y (), y (),, y ( T)] Gs,.e., y g g g s y s g g g = () y s g g g 3.3 Our proposed method Thrd, based on the assumpton A, all the sources are zero-mean and wth unt varance. ence, we can elmnate the ampltude ndetermnacy by normalzng the ampltude of all the separated block sgnals. The remanng permutaton and phase ndetermnaces are elmnated by usng our proposed method shown as follows: For =,,. ( ), + BSS BSS( + y = x y = x ) +. Φ = ( y ( T L+ : T).*( y (: L)) ) L 3. For =,,, (a). [ temp, mark] = max( abs( Φ (,:))) (b). ψ = y, y = y, y = ψ mark mark + ( ( : ) (: )) norm y T L + T y L > (c). If norm( y ( T L : T) y (: L)) + + y = y end; end; 4. If + B Go back to step. end; In ths new method, BSS( x ) n Step means to separate mxng sgnals usng BSS algorthms. In ths paper, we choose the fast fxed-pont algorthms for complex-valued sgnals based on negentropc contrast crteron n [], whch s used n [8]. Ths s convenent to compare the performance of our new method wth the Permutaton Method n [8]. The correlaton matrx of overlappng sgnals Φ n Step s L L, whch results from the wdely accepted concept that the expectaton value of random varable can be approxmately represented by the mean value of all samples for one realzaton n tme doman when the varable s statonary. Therefore, accordng to the assumptons A and A, E-ISS: Volume,

4 We Zhao, Yuehong Shen, Pengcheng Xu, Zhgang Yuan, Ymn We, We Jan we have followng approxmate estmaton. g s = Δ g s Φ= E = g s gs g s = = = gs = + + gs ( g s) gs ( g s) = = = = = E + + s ( g s ) gs ( g s ) g = = = = (6) In Step 3, [ temp, mark] = max( abs( Φ (,:))) n (a) s the MATLAB functon that s used to fnd the maxmzaton value of each row n abs( Φ (,:)) and return the value and correspondng column ndex, n whch abs means the absolute value or norm value when t corresponds to complex-valued varable. The purpose of (a) s to search for the dependent component n the next block, whch s based on the fact that E{ ss } =, and Ess { } =, =. (b) ams to elmnate the permutaton ndetermnacy. When there doesn t exst permutaton ndetermnacy, Φ can be smplfed as + g( g ) s Δ + g( g ) s Φ= E + g ( g ) s + g( g ) + g( g ) = + g( g ) (7) (c) ams to elmnate the phase ndetermnacy. ote that we ust consder to change the phase by π, whch can be seen clearly n (c). More precsely, we only consder the case g ( g + ) =±, whch may not satsfy the practcal needs absolutely. owever, note that t s well acceptable and sutable n the case that our system model and assumptons are consdered n ths paper. As for the case g ( g + ) ±, we postpone t to our future work. When there aren t permutaton and scalng ndetermnaces, the correlaton matrx Φ can be smplfed to be dentty matrx,.e., Φ =I. 4 Smulaton and Experment Results 4. Computer smulatons 4.. Smulaton In ths secton, we choose the sne sgnal, square sgnal and random sgnal as sources. The number of mxng sgnal block B s, n whch sources are randomly mxed. The number of samples of each mxng sgnal block T s and the number sze of correspondng overlappng sgnals L s set. The classcal algorthm n [] s chosen as the separaton method, whch s smlar to that n [8]. The smulaton results are shown n Fg Source Source Source umber of samples wth fve blocks Separaton wthout usng our method Separaton wthout usng our method Separaton 3 wthout usng our method umber of samples wth fve blocks Separaton wth usng our method Separaton wth usng our method Separaton 3 wth usng our method umber of samples wth fve blocks Fg. 4. Smulaton results wth the sne sgnal, square sgnal and random sgnal. The frst column s source sgnal, the second column s the separaton sgnal concatenated wthout usng our method and the thrd column s the separaton sgnal concatenated wth usng our method. As shown n Fg. 4, t can be seen clearly that the connected separaton sgnals n each adacent sgnal block n the second column are dfferent from correspondng source sgnals. Ths means that the source sgnals are not recovered successfully, whch s caused by the ndetermnaces n BSS. owever, n the thrd column, t can be observed obvously that the separated components between adacent sgnal blocks are concatenated successfully by usng our proposed method. Therefore, our new approach s very effcent n terms of solvng the permutaton and scalng ndetermnaces n BSS when the mxng sgnals are processed block by block. 4.. Smulaton In ths secton, we choose three speech sgnals as sources because speech sgnals are usually not contnuous n tme doman. Gven the fact that our new method utlzes the dependent correlaton between the overlappng sgnals n tme doman, we consder to perform smulatons to valdate the performance of our approach wth speech sgnals. Moreover, the speech sgnals are wdely used n the E-ISS: Volume,

5 We Zhao, Yuehong Shen, Pengcheng Xu, Zhgang Yuan, Ymn We, We Jan realstc applcaton, especally n the wreless and moble communcaton. The number of mxng sgnal block B s, n whch sources are randomly mxed. The number of samples of each mxng sgnal block T s and the number sze of correspondng overlappng sgnals L s set. The classcal algorthm n [] s chosen as the separaton method, whch s smlar to that n [8]. The smulaton results are shown n Fg.. Source -... x 4 Source -... x 4 Source umber of samples wth fve blocks4 x Separaton wthout usng our method -... x 4 Separaton wthout usng our method -... x 4 Separaton 3 wthout usng our method -... umber of samples wth fve blocks4 x Separaton wth usng our method -... x 4 Separaton wth usng our method -... x 4 Separaton 3 wth usng our method umber of samples wth fve blocks x Fg.. Smulaton results wth speech sgnals. The frst column s source sgnal, the second column s the separaton sgnal concatenated wthout usng our method and the thrd column s the separaton sgnal concatenated wth usng our method. Compared the concatenated separaton sgnals n the second column wth the source sgnals n the frst column, t can be observed clearly that the separated sgnals n each adacent block are not connected correctly. When our proposed method s used, the concatenated separaton sgnals n the thrd column are almost the same wth the sources. Ths means that our method succeeds n elmnatng the permutaton and scalng ndetermnaces n the case that mxng sgnals are splt n block and processed block by block Smulaton 3 In ths secton, we perform smulatons to analyze the performance of our ndetermnacy elmnaton method, whch s manly compared wth that n [8]. We choose the sgnals n Smulaton secton as sources. In order to mprove the tme effcency of our method, we set the number of samples of each block T=4 and the number of blocks B vares from to. The length of overlappng sgnals changes from to 4,.e., L=, 4,, 4. For convenence and smplcty, we choose α = T L wth α =,, 4, and as the donaton. The classcal algorthm n [] s chosen as the separaton method. The mean value of mean square error (MSE) between concatenated separaton sgnals and sources s chosen as the measure crteron for separaton qualty. And the executon tme of concatenatng all separated sgnal blocks s chosen as the measurement of effcency n terms of computatonal speed, for whch the computer s Intel (R) Core Duo CPU, 3.Gz,.99Gz, 3. GB RAM. To ensure the valdty and relablty of smulaton data, Monte-Carlo runs are performed ndependently. The smulaton results are llustrated n Fg. 6 and Fg. 7. Average MSE Average executon tme (s) 6 x Permutaton method Our proposed method wth α= Our proposed method wth α= Our proposed method wth α=4 Our proposed method wth α= Our proposed method wth α= x umber of blocks Fg. 6. MSE between sources and connected separatons for Permutaton Method n [8] and our proposed method wth α =,, 4, and averaged over Monte-Carlo runs Permutaton method Our proposed method wth α= Our proposed method wth α= Our proposed method wth α=4 Our proposed method wth α= Our proposed method wth α= umber of blocks Fg. 7. Executon tme of concatenatng the separated sources n dfferent number of blocks for Permutaton Method and our proposed method wth α =,, 4, and averaged over Monte- Carlo runs. As shown n Fg. 6, t can be observed clearly that the MSE value of Permutaton Method and our proposed method decreases wth the number of blocks ncreasng. When the block sze s fxed, the MSE of our approach dffers wth the length of overlappng sgnals changng. More precsely, when B vares from to, our proposed method outperforms Permutaton Method wth α =,, 4,, and the performance of our approach becomes slghtly better and better wth α decreasng. owever, when α =, our method performs worse than Permutaton Method, whch s caused by the fact that the number of samples of the overlappng sgnals s not many enough. ence, t can be E-ISS: Volume,

6 We Zhao, Yuehong Shen, Pengcheng Xu, Zhgang Yuan, Ymn We, We Jan predcted that, n the same condton, the performance of our method wll be worse and worse when α s larger than. Snce the choce of α relates to the length of sgnal blocks, t s dffcult to determne the exact α such that our approach performs better or worse than Permutaton Method. From Fg. 7, we can see obvously that the executon tme of our proposed approach wth α =,, 4,, s less than that of Permutaton Method. The advantage of our method becomes more and more apparent when the number of blocks ncreases and the length of overlappng sgnals decreasng. For nstance, when B=3, the executon tme of Permutaton Method s about 77s, whle our method needs about 74s, 7s, 67s, 6s, 63s, respectvely, for α =,, 4,,. Furthermore, when B=4, the tme of the former s about s, whle the latter needs about 97s, 9s, 9s, 86, 84s. And t can be predcted that, when α ncreases, the tme of our method wll be less, whch s not llustrated n Fg. 7. Combned Fg. 6 and Fg. 7, we can draw the concluson that, when the block sze and correspondng length of overlappng sgnals are chosen approprately, our proposed method s more effcent than Permutaton Method n terms of separaton qualty and computatonal speed. For example, when B= and α =, the performance of our approach s not only better than Permutaton Method but also only needs much less tme of the latter. owever, when B= and α =, our approach needs much less tme than Permutaton Method but the performance of t s worse than the latter. Therefore, the performance of our proposed method wth respect to separaton qualty and computatonal speed can be adusted accordng to the choce of block sze and correspondng length of overlappng sgnals. More analyss about the exact relatonshp between them n detal wll be ncluded n our latter work. In general, when the number of samples of sgnal blocks s about, α = to 4 s recommended. 4. Realstc experments 4.. Realstc wreless communcaton model In ths secton, a wreless communcaton system wth two transmttng and recevng antennas s constructed n ths paper, whch s shown n Fg. 8. For smplcty, we assume the carrer and local frequences are the same,.e., ω = ω = ω3 = ω4 = ω = 3Mz. And the synchronous and carrer frequency offset problems are not consdered n ths paper. I Q I Q cos( ωt ) sn(ω t) cos( ωt) sn( ωt) cos( ω3t) sn(ω t) 3 cos(ω t) 4 sn( ω4t) I Q I Q Fg. 8. Wreless communcaton system model The transmtted source sgnals are complexvalued, denoted by s s I+ Q = = s I + Q (8) As shown n Fg. 8, the sources are modulated on carrer frequences, whch s send out through transmttng antennas. At the recever, the receved sgnals are demodulatng through local frequences. After low flterng, the mxng sgnals can be approxmately seen as the mxture of sources, whch are represented as x I + Q a a s x = = = x I + Q a a s (9) x= As where A denotes the wreless channel, whch s unknown. The separatng operator s gven as y w w x y = = y w w x () y = W x In order to satsfy the assumptons A and A, we use two E4438C [3] as the transmtters, whch can send rado sgnals n the form of sngle, AM, BPSK, speech and so on. At the recever, we use the USRP wth GU Rado [4] devce to receve the RF sgnals. To satsfy A, we set the dstance of two transmtters about meters away and make sure that they transmt sgnals ndependently. In ths way, the source sgnals are statstcally ndependent, even though they are not absolutely ndependent. owever, the approxmate ndependence between sources s accepted, whch s verfed by our expermental results n the followng. To satsfy A, we set the dstance between transmtters and recevers about meters away, whch ensures that the wreless channel s as approxmately lnear and nstantaneous as possble. Although the mxng system s not absolutely lnear E-ISS: Volume,

7 We Zhao, Yuehong Shen, Pengcheng Xu, Zhgang Yuan, Ymn We, We Jan and nstantaneous, t s so approxmate that the expermental results prove that t works well. 4.. Experment In ths secton, we choose two sngle sgnals as sources. When the sample rate s fxed, we set the number of samples of each block T= and the number of blocks B=. ere we set the length of the overlappng sgnals L=T/=. The transmtted power s dbm and the classcal algorthm n [] s chosen as the separaton method. The expermental results are shown n Fg. 9, Fg. and Fg x 4 Mxture - 3 umber of samples.. x 7 Mxture Mxture - 3 umber of samples. x 6.. Mxture Fg. 9. Mxng sgnals wth fve blocks n tme and frequency doman Separaton wthout concantenatng -. 3 umber of samples Separaton wthout concantenatng Separaton wthout concantenatng -. 3 umber of samples Separaton wthout concantenatng Fg.. Separatng sgnals wthout usng our proposed approach n tme and frequency doman Separaton wth concatenatng -. 3 umber of samples Separaton wth concatenatng Separaton wth concatenatng -. 3 umber of samples Separaton wth concatenatng Fg.. Separatng sgnals usng our proposed approach n tme and frequency doman As shown n Fg., the concatenated sgnals after separatng don t recover the orgnal sources correctly, whch s more obvous n the frequency doman. Compared the frequency doman of Fg. 9 and Fg., we can see that the permutaton and scalng ndetermnaces affect the separaton qualty serously when tyng each separated adacent block together. owever, note that the sgnals n Fg. usng our new approach successfully recover the orgnal source waveform. It can be observed clearly n the frequency doman that two sngle sgnals are totally separated. Compared the tme doman sgnals n Fg. and Fg., we can see that the connecton ambguty caused by permutaton and scalng ndetermnaces are elmnated by usng our new method. In order to verfy the performance of our method further, we analyze the correlaton matrces of the overlappng sgnals brefly as follows Φ = Φ = Φ = Φ = As for Φ, when =, [ temp, mark ] = [.3,], whch means that frst separated sgnal n the -th block corresponds to the second separated component n the (+)-th block. Then the second sgnal n the -th block corresponds to the frst n the (+)-th block, whch can be drawn from [ temp, mark ] = [.7,] wth = Experment In ths secton, we nvestgate the effect of the transmtted power of sources on the separaton qualty of our proposed method and Permutaton Method n [8]. We choose the number of blocks B=, for whch the number of samples of each block T=. The length of overlappng sgnals changes from to 4,.e., L=, 4,, 4. For convenence and smplcty, we choose α = T L wth α =,, 4, and as the donaton. The transmtted power ranges from - dbm to dbm, and the classcal algorthm n [] s chosen as the separaton method. The expermental results are shown n Fg.. E-ISS: Volume,

8 We Zhao, Yuehong Shen, Pengcheng Xu, Zhgang Yuan, Ymn We, We Jan Average MSE Permutaton method Our proposed method wth α= Our proposed method wth α= Our proposed method wth α=4 Our proposed method wth α= Our proposed method wth α= x The transmtted power of sources (dbm) Fg.. MSE between sources and connected separatons for Permutaton Method n [8] and our proposed method wth α =,, 4, and when the transmtted power ranges from - dbm to dbm averaged over Monte-Carlo runs. From Fg., we can see clearly that the performance of our method and Permutaton Method changes wth the transmtted power ncreasng, whch s dfferent from the computer smulatons. In fact, when the transmtted power ncreases, the performance of two methods doesn t become better and better monotonously. Ths s a specal and nterestng phenomenon for practcal applcaton. More precsely, when the transmtted power s low such as - dbm, the nose and nterference domnate n the receved sgnals so that the source sgnals can t be dstngushed obvously. owever, when the transmtted power s too hgh such as dbm, the transmtters produce many other nonlnear frequency components,.e., harmonc wave, whch s caused by the nonlnear dstorton of amplfers n the transmtted devces. owever, when the transmtted power s controlled approprately such as dbm, our method provdes good performance. Most mportantly, our method shows better performance n terms of separaton qualty than Permutaton Method when the transmtted power changes, whch can be seen clearly n Fg.. Although these experments are easy and smple, we beleve the expermental results are very sgnfcant, especally for future correspondng practcal applcatons. Concluson Ths paper deals wth the permutaton and scalng ndetermnaces problem of BSS n the case where the contnuously mxng sgnals are splt n tme and processed block by block. Due to the nherent ndetermnaces of BSS, tyng the separated sgnals n each adacent tme block can t recover the orgnal sources correctly. Ths paper proposes a novel approach to elmnate the permutaton and scalng ndetermnaces by overlappng adacent sgnal blocks. Smulatons and realstc experments are performed to valdate the performance of our new approach. Future work ncludes the extenson of mxture channel to convoluton and nonlnear, for whch more complcated realstc experments wll be performed. Acknowledgment Ths work s supported by the atonal atural Scence Foundaton of Chna under Grant o References: [] A. Yeredor, Performance Analyss of the Strong Uncorrelatng Transformaton n Blnd Separaton of Complex-valued Sources, IEEE Transactons on Sgnal Processng, Vol. 6, o.,, pp [] M. S. Alreza and D. R. Bhaskar, An ICA- SCT-PD Flter Approach for Trackng and Separaton of Unknown Tme-varyng umber of Sources, IEEE Transactons on Audo, Speech, and Language Processng, Vol., o. 4,, pp [3] F. Yn, T. Me and J. Wang, Blnd Source Separaton based on Decorrelaton and onstatonarty, IEEE Transactons on Crcuts and Systems I, Vol. 4, o., 7, pp [4] M. Z. Ikram and D. R. Morgan, A Beamformng Approach to Permutaton Algnment for Multchannel Frequency- Doman Blnd Speech Separaton, n Proceedngs of the ICASSP, Florda,, pp [] J. Anem uller and B. Kollmeer, Modulaton Decorrelaton for Convolutve Blnd Source Separaton, n Proceedngs of the ICA, ong Kong,, pp. -. [6]. Murata, S. Ikeda and A. Zehe, An Approach to Blnd Source Separaton based on Temporal Structure of Speech Sgnals, eurocomputng, Vol. 4, o. -4,, pp. -4. [7] M. Z. Ikram D. R. and Morgan, Permutaton Inconsstency n Blnd Speech Separaton: Investgaton and Solutons, IEEE Transactons on Speech and Audo Processng, Vol. 3, o.,, pp. -3. [8] T. Amshma, A. Okamura, S. Morta and T. Krmoto, Permutaton Method for ICA Separated Source Sgnal Blocks n Tme Doman, IEEE Transacton on Aerospace and Electronc Systems, Vol. 46, o.,, pp E-ISS: Volume,

9 We Zhao, Yuehong Shen, Pengcheng Xu, Zhgang Yuan, Ymn We, We Jan [9]. Saruwatar, T. Takatan,. Yamao, T. shkawa and K. Shkano, Blnd Separaton and Deconvoluton for Real Convolutve Mxture of Temporally Correlated Acoustc Sgnals usng SIMO Model-based ICA, Proceedngs of the 4th Internatonal Symposum on Independent Component Analyss and Blnd Sgnal Separaton, 3, pp []. Sawada, R. Muka, S. Arak and S. Makno, A Robust and Precse Method for Solvng the Permutaton Problem of Frequency-doman Blnd Source Separaton, Proceedngs of the 4th Internatonal Symposum on Independent Component Analyss and Blnd Sgnal Separaton, 3, pp. -. [] V. Zarzoso, P. Comon and R. Phlypo, A Contrast Functon for Independent Component Analyss wthout Permutaton Ambguty, IEEE Transacton on eural etworks, Vol., o.,, pp [] E. Bngham and A. yvarnen, A Fast Fxed- Pont Algorthm for Independent Component Analyss for Complex Valued Sgnals, Internatonal Journal of eural System, Vol., o.,, pp. -8. [3] [4] wk/usrp E-ISS: Volume,

arxiv:cs.cv/ Jun 2000

arxiv:cs.cv/ Jun 2000 Correlaton over Decomposed Sgnals: A Non-Lnear Approach to Fast and Effectve Sequences Comparson Lucano da Fontoura Costa arxv:cs.cv/0006040 28 Jun 2000 Cybernetc Vson Research Group IFSC Unversty of São

More information

Pop-Click Noise Detection Using Inter-Frame Correlation for Improved Portable Auditory Sensing

Pop-Click Noise Detection Using Inter-Frame Correlation for Improved Portable Auditory Sensing Advanced Scence and Technology Letters, pp.164-168 http://dx.do.org/10.14257/astl.2013 Pop-Clc Nose Detecton Usng Inter-Frame Correlaton for Improved Portable Audtory Sensng Dong Yun Lee, Kwang Myung Jeon,

More information

OPTIMAL COMBINATION OF FOURTH ORDER STATISTICS FOR NON-CIRCULAR SOURCE SEPARATION. Christophe De Luigi and Eric Moreau

OPTIMAL COMBINATION OF FOURTH ORDER STATISTICS FOR NON-CIRCULAR SOURCE SEPARATION. Christophe De Luigi and Eric Moreau OPTIMAL COMBINATION OF FOURTH ORDER STATISTICS FOR NON-CIRCULAR SOURCE SEPARATION Chrstophe De Lug and Erc Moreau Unversty of Toulon LSEET UMR CNRS 607 av. G. Pompdou BP56 F-8362 La Valette du Var Cedex

More information

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have

More information

Report on Image warping

Report on Image warping Report on Image warpng Xuan Ne, Dec. 20, 2004 Ths document summarzed the algorthms of our mage warpng soluton for further study, and there s a detaled descrpton about the mplementaton of these algorthms.

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

Comparison of the Population Variance Estimators. of 2-Parameter Exponential Distribution Based on. Multiple Criteria Decision Making Method

Comparison of the Population Variance Estimators. of 2-Parameter Exponential Distribution Based on. Multiple Criteria Decision Making Method Appled Mathematcal Scences, Vol. 7, 0, no. 47, 07-0 HIARI Ltd, www.m-hkar.com Comparson of the Populaton Varance Estmators of -Parameter Exponental Dstrbuton Based on Multple Crtera Decson Makng Method

More information

The relationship between the die signals and the mixed sensor signals can be generally defined as (1). I D I D T

The relationship between the die signals and the mixed sensor signals can be generally defined as (1). I D I D T Analyss of Indvdual e Tonnage Usng Multple Tonnage Sensors for Multple Operaton Forgng Processes Qngyu Yang, Qang L, and Judy Jn epartment of Industral and Operatons Engneerng The Unversty of Mchgan, Ann

More information

Hongyi Miao, College of Science, Nanjing Forestry University, Nanjing ,China. (Received 20 June 2013, accepted 11 March 2014) I)ϕ (k)

Hongyi Miao, College of Science, Nanjing Forestry University, Nanjing ,China. (Received 20 June 2013, accepted 11 March 2014) I)ϕ (k) ISSN 1749-3889 (prnt), 1749-3897 (onlne) Internatonal Journal of Nonlnear Scence Vol.17(2014) No.2,pp.188-192 Modfed Block Jacob-Davdson Method for Solvng Large Sparse Egenproblems Hongy Mao, College of

More information

Power law and dimension of the maximum value for belief distribution with the max Deng entropy

Power law and dimension of the maximum value for belief distribution with the max Deng entropy Power law and dmenson of the maxmum value for belef dstrbuton wth the max Deng entropy Bngy Kang a, a College of Informaton Engneerng, Northwest A&F Unversty, Yanglng, Shaanx, 712100, Chna. Abstract Deng

More information

NON-LINEAR CONVOLUTION: A NEW APPROACH FOR THE AURALIZATION OF DISTORTING SYSTEMS

NON-LINEAR CONVOLUTION: A NEW APPROACH FOR THE AURALIZATION OF DISTORTING SYSTEMS NON-LINEAR CONVOLUTION: A NEW APPROAC FOR TE AURALIZATION OF DISTORTING SYSTEMS Angelo Farna, Alberto Belln and Enrco Armellon Industral Engneerng Dept., Unversty of Parma, Va delle Scenze 8/A Parma, 00

More information

Appendix B: Resampling Algorithms

Appendix B: Resampling Algorithms 407 Appendx B: Resamplng Algorthms A common problem of all partcle flters s the degeneracy of weghts, whch conssts of the unbounded ncrease of the varance of the mportance weghts ω [ ] of the partcles

More information

A Robust Method for Calculating the Correlation Coefficient

A Robust Method for Calculating the Correlation Coefficient A Robust Method for Calculatng the Correlaton Coeffcent E.B. Nven and C. V. Deutsch Relatonshps between prmary and secondary data are frequently quantfed usng the correlaton coeffcent; however, the tradtonal

More information

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons

More information

Grover s Algorithm + Quantum Zeno Effect + Vaidman

Grover s Algorithm + Quantum Zeno Effect + Vaidman Grover s Algorthm + Quantum Zeno Effect + Vadman CS 294-2 Bomb 10/12/04 Fall 2004 Lecture 11 Grover s algorthm Recall that Grover s algorthm for searchng over a space of sze wors as follows: consder the

More information

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS Avalable onlne at http://sck.org J. Math. Comput. Sc. 3 (3), No., 6-3 ISSN: 97-537 COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

More information

Structure and Drive Paul A. Jensen Copyright July 20, 2003

Structure and Drive Paul A. Jensen Copyright July 20, 2003 Structure and Drve Paul A. Jensen Copyrght July 20, 2003 A system s made up of several operatons wth flow passng between them. The structure of the system descrbes the flow paths from nputs to outputs.

More information

De-noising Method Based on Kernel Adaptive Filtering for Telemetry Vibration Signal of the Vehicle Test Kejun ZENG

De-noising Method Based on Kernel Adaptive Filtering for Telemetry Vibration Signal of the Vehicle Test Kejun ZENG 6th Internatonal Conference on Mechatroncs, Materals, Botechnology and Envronment (ICMMBE 6) De-nosng Method Based on Kernel Adaptve Flterng for elemetry Vbraton Sgnal of the Vehcle est Kejun ZEG PLA 955

More information

Chapter 9: Statistical Inference and the Relationship between Two Variables

Chapter 9: Statistical Inference and the Relationship between Two Variables Chapter 9: Statstcal Inference and the Relatonshp between Two Varables Key Words The Regresson Model The Sample Regresson Equaton The Pearson Correlaton Coeffcent Learnng Outcomes After studyng ths chapter,

More information

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4) I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes

More information

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also

More information

Supplementary material: Margin based PU Learning. Matrix Concentration Inequalities

Supplementary material: Margin based PU Learning. Matrix Concentration Inequalities Supplementary materal: Margn based PU Learnng We gve the complete proofs of Theorem and n Secton We frst ntroduce the well-known concentraton nequalty, so the covarance estmator can be bounded Then we

More information

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography CSc 6974 and ECSE 6966 Math. Tech. for Vson, Graphcs and Robotcs Lecture 21, Aprl 17, 2006 Estmatng A Plane Homography Overvew We contnue wth a dscusson of the major ssues, usng estmaton of plane projectve

More information

Parametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010

Parametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010 Parametrc fractonal mputaton for mssng data analyss Jae Kwang Km Survey Workng Group Semnar March 29, 2010 1 Outlne Introducton Proposed method Fractonal mputaton Approxmaton Varance estmaton Multple mputaton

More information

Convexity preserving interpolation by splines of arbitrary degree

Convexity preserving interpolation by splines of arbitrary degree Computer Scence Journal of Moldova, vol.18, no.1(52), 2010 Convexty preservng nterpolaton by splnes of arbtrary degree Igor Verlan Abstract In the present paper an algorthm of C 2 nterpolaton of dscrete

More information

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur Analyss of Varance and Desgn of Experment-I MODULE VII LECTURE - 3 ANALYSIS OF COVARIANCE Dr Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Any scentfc experment s performed

More information

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA 4 Analyss of Varance (ANOVA) 5 ANOVA 51 Introducton ANOVA ANOVA s a way to estmate and test the means of multple populatons We wll start wth one-way ANOVA If the populatons ncluded n the study are selected

More information

RBF Neural Network Model Training by Unscented Kalman Filter and Its Application in Mechanical Fault Diagnosis

RBF Neural Network Model Training by Unscented Kalman Filter and Its Application in Mechanical Fault Diagnosis Appled Mechancs and Materals Submtted: 24-6-2 ISSN: 662-7482, Vols. 62-65, pp 2383-2386 Accepted: 24-6- do:.428/www.scentfc.net/amm.62-65.2383 Onlne: 24-8- 24 rans ech Publcatons, Swtzerland RBF Neural

More information

829. An adaptive method for inertia force identification in cantilever under moving mass

829. An adaptive method for inertia force identification in cantilever under moving mass 89. An adaptve method for nerta force dentfcaton n cantlever under movng mass Qang Chen 1, Mnzhuo Wang, Hao Yan 3, Haonan Ye 4, Guola Yang 5 1,, 3, 4 Department of Control and System Engneerng, Nanng Unversty,

More information

The Minimum Universal Cost Flow in an Infeasible Flow Network

The Minimum Universal Cost Flow in an Infeasible Flow Network Journal of Scences, Islamc Republc of Iran 17(2): 175-180 (2006) Unversty of Tehran, ISSN 1016-1104 http://jscencesutacr The Mnmum Unversal Cost Flow n an Infeasble Flow Network H Saleh Fathabad * M Bagheran

More information

High resolution entropy stable scheme for shallow water equations

High resolution entropy stable scheme for shallow water equations Internatonal Symposum on Computers & Informatcs (ISCI 05) Hgh resoluton entropy stable scheme for shallow water equatons Xaohan Cheng,a, Yufeng Ne,b, Department of Appled Mathematcs, Northwestern Polytechncal

More information

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin Proceedngs of the 007 Wnter Smulaton Conference S G Henderson, B Bller, M-H Hseh, J Shortle, J D Tew, and R R Barton, eds LOW BIAS INTEGRATED PATH ESTIMATORS James M Calvn Department of Computer Scence

More information

Notes on Frequency Estimation in Data Streams

Notes on Frequency Estimation in Data Streams Notes on Frequency Estmaton n Data Streams In (one of) the data streamng model(s), the data s a sequence of arrvals a 1, a 2,..., a m of the form a j = (, v) where s the dentty of the tem and belongs to

More information

MULTICHANNEL AUDIO SIGNAL SOURCE SEPARATION BASED ON AN INTERCHANNEL LOUDNESS VECTOR SUM. Taejin Park and Taejin Lee

MULTICHANNEL AUDIO SIGNAL SOURCE SEPARATION BASED ON AN INTERCHANNEL LOUDNESS VECTOR SUM. Taejin Park and Taejin Lee MUTICHAE AUDIO SIGA SOUCE SEPAATIO BASED O A ITECHAE OUDESS VECTO SUM Taejn Park and Taejn ee Electroncs and Telecommuncatons esearch Insttute, epublc of Korea ABSTACT In ths paper, a Blnd Source Separaton

More information

Testing for seasonal unit roots in heterogeneous panels

Testing for seasonal unit roots in heterogeneous panels Testng for seasonal unt roots n heterogeneous panels Jesus Otero * Facultad de Economía Unversdad del Rosaro, Colomba Jeremy Smth Department of Economcs Unversty of arwck Monca Gulett Aston Busness School

More information

n α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0

n α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0 MODULE 2 Topcs: Lnear ndependence, bass and dmenson We have seen that f n a set of vectors one vector s a lnear combnaton of the remanng vectors n the set then the span of the set s unchanged f that vector

More information

ECE559VV Project Report

ECE559VV Project Report ECE559VV Project Report (Supplementary Notes Loc Xuan Bu I. MAX SUM-RATE SCHEDULING: THE UPLINK CASE We have seen (n the presentaton that, for downlnk (broadcast channels, the strategy maxmzng the sum-rate

More information

A NEW DISCRETE WAVELET TRANSFORM

A NEW DISCRETE WAVELET TRANSFORM A NEW DISCRETE WAVELET TRANSFORM ALEXANDRU ISAR, DORINA ISAR Keywords: Dscrete wavelet, Best energy concentraton, Low SNR sgnals The Dscrete Wavelet Transform (DWT) has two parameters: the mother of wavelets

More information

Copyright 2017 by Taylor Enterprises, Inc., All Rights Reserved. Adjusted Control Limits for P Charts. Dr. Wayne A. Taylor

Copyright 2017 by Taylor Enterprises, Inc., All Rights Reserved. Adjusted Control Limits for P Charts. Dr. Wayne A. Taylor Taylor Enterprses, Inc. Control Lmts for P Charts Copyrght 2017 by Taylor Enterprses, Inc., All Rghts Reserved. Control Lmts for P Charts Dr. Wayne A. Taylor Abstract: P charts are used for count data

More information

Odd/Even Scroll Generation with Inductorless Chua s and Wien Bridge Oscillator Circuits

Odd/Even Scroll Generation with Inductorless Chua s and Wien Bridge Oscillator Circuits Watcharn Jantanate, Peter A. Chayasena, Sarawut Sutorn Odd/Even Scroll Generaton wth Inductorless Chua s and Wen Brdge Oscllator Crcuts Watcharn Jantanate, Peter A. Chayasena, and Sarawut Sutorn * School

More information

Progress In Electromagnetics Research M, Vol. 20, , 2011

Progress In Electromagnetics Research M, Vol. 20, , 2011 Progress In Electromagnetcs Research M, Vol. 20, 143 153, 2011 DETECTION AND ESTIMATION OF MULTI- COMPONENT POLYNOMIAL PHASE SIGNALS BY CONSTRUCTING REGULAR CROSS TERMS X. Zhang *, J. Ca, L. Lu, and Y.

More information

ANOMALIES OF THE MAGNITUDE OF THE BIAS OF THE MAXIMUM LIKELIHOOD ESTIMATOR OF THE REGRESSION SLOPE

ANOMALIES OF THE MAGNITUDE OF THE BIAS OF THE MAXIMUM LIKELIHOOD ESTIMATOR OF THE REGRESSION SLOPE P a g e ANOMALIES OF THE MAGNITUDE OF THE BIAS OF THE MAXIMUM LIKELIHOOD ESTIMATOR OF THE REGRESSION SLOPE Darmud O Drscoll ¹, Donald E. Ramrez ² ¹ Head of Department of Mathematcs and Computer Studes

More information

Chapter 11: Simple Linear Regression and Correlation

Chapter 11: Simple Linear Regression and Correlation Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests

More information

The Order Relation and Trace Inequalities for. Hermitian Operators

The Order Relation and Trace Inequalities for. Hermitian Operators Internatonal Mathematcal Forum, Vol 3, 08, no, 507-57 HIKARI Ltd, wwwm-hkarcom https://doorg/0988/mf088055 The Order Relaton and Trace Inequaltes for Hermtan Operators Y Huang School of Informaton Scence

More information

Scroll Generation with Inductorless Chua s Circuit and Wien Bridge Oscillator

Scroll Generation with Inductorless Chua s Circuit and Wien Bridge Oscillator Latest Trends on Crcuts, Systems and Sgnals Scroll Generaton wth Inductorless Chua s Crcut and Wen Brdge Oscllator Watcharn Jantanate, Peter A. Chayasena, and Sarawut Sutorn * Abstract An nductorless Chua

More information

Non-linear Canonical Correlation Analysis Using a RBF Network

Non-linear Canonical Correlation Analysis Using a RBF Network ESANN' proceedngs - European Smposum on Artfcal Neural Networks Bruges (Belgum), 4-6 Aprl, d-sde publ., ISBN -97--, pp. 57-5 Non-lnear Canoncal Correlaton Analss Usng a RBF Network Sukhbnder Kumar, Elane

More information

Natural Images, Gaussian Mixtures and Dead Leaves Supplementary Material

Natural Images, Gaussian Mixtures and Dead Leaves Supplementary Material Natural Images, Gaussan Mxtures and Dead Leaves Supplementary Materal Danel Zoran Interdscplnary Center for Neural Computaton Hebrew Unversty of Jerusalem Israel http://www.cs.huj.ac.l/ danez Yar Wess

More information

Estimating the Fundamental Matrix by Transforming Image Points in Projective Space 1

Estimating the Fundamental Matrix by Transforming Image Points in Projective Space 1 Estmatng the Fundamental Matrx by Transformng Image Ponts n Projectve Space 1 Zhengyou Zhang and Charles Loop Mcrosoft Research, One Mcrosoft Way, Redmond, WA 98052, USA E-mal: fzhang,cloopg@mcrosoft.com

More information

Department of Statistics University of Toronto STA305H1S / 1004 HS Design and Analysis of Experiments Term Test - Winter Solution

Department of Statistics University of Toronto STA305H1S / 1004 HS Design and Analysis of Experiments Term Test - Winter Solution Department of Statstcs Unversty of Toronto STA35HS / HS Desgn and Analyss of Experments Term Test - Wnter - Soluton February, Last Name: Frst Name: Student Number: Instructons: Tme: hours. Ads: a non-programmable

More information

Some modelling aspects for the Matlab implementation of MMA

Some modelling aspects for the Matlab implementation of MMA Some modellng aspects for the Matlab mplementaton of MMA Krster Svanberg krlle@math.kth.se Optmzaton and Systems Theory Department of Mathematcs KTH, SE 10044 Stockholm September 2004 1. Consdered optmzaton

More information

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS HCMC Unversty of Pedagogy Thong Nguyen Huu et al. A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS Thong Nguyen Huu and Hao Tran Van Department of mathematcs-nformaton,

More information

Computation of Higher Order Moments from Two Multinomial Overdispersion Likelihood Models

Computation of Higher Order Moments from Two Multinomial Overdispersion Likelihood Models Computaton of Hgher Order Moments from Two Multnomal Overdsperson Lkelhood Models BY J. T. NEWCOMER, N. K. NEERCHAL Department of Mathematcs and Statstcs, Unversty of Maryland, Baltmore County, Baltmore,

More information

COMPUTATIONALLY EFFICIENT WAVELET AFFINE INVARIANT FUNCTIONS FOR SHAPE RECOGNITION. Erdem Bala, Dept. of Electrical and Computer Engineering,

COMPUTATIONALLY EFFICIENT WAVELET AFFINE INVARIANT FUNCTIONS FOR SHAPE RECOGNITION. Erdem Bala, Dept. of Electrical and Computer Engineering, COMPUTATIONALLY EFFICIENT WAVELET AFFINE INVARIANT FUNCTIONS FOR SHAPE RECOGNITION Erdem Bala, Dept. of Electrcal and Computer Engneerng, Unversty of Delaware, 40 Evans Hall, Newar, DE, 976 A. Ens Cetn,

More information

VQ widely used in coding speech, image, and video

VQ widely used in coding speech, image, and video at Scalar quantzers are specal cases of vector quantzers (VQ): they are constraned to look at one sample at a tme (memoryless) VQ does not have such constrant better RD perfomance expected Source codng

More information

CONTRAST ENHANCEMENT FOR MIMIMUM MEAN BRIGHTNESS ERROR FROM HISTOGRAM PARTITIONING INTRODUCTION

CONTRAST ENHANCEMENT FOR MIMIMUM MEAN BRIGHTNESS ERROR FROM HISTOGRAM PARTITIONING INTRODUCTION CONTRAST ENHANCEMENT FOR MIMIMUM MEAN BRIGHTNESS ERROR FROM HISTOGRAM PARTITIONING N. Phanthuna 1,2, F. Cheevasuvt 2 and S. Chtwong 2 1 Department of Electrcal Engneerng, Faculty of Engneerng Rajamangala

More information

Yong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 )

Yong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 ) Kangweon-Kyungk Math. Jour. 4 1996), No. 1, pp. 7 16 AN ITERATIVE ROW-ACTION METHOD FOR MULTICOMMODITY TRANSPORTATION PROBLEMS Yong Joon Ryang Abstract. The optmzaton problems wth quadratc constrants often

More information

Suppose that there s a measured wndow of data fff k () ; :::; ff k g of a sze w, measured dscretely wth varable dscretzaton step. It s convenent to pl

Suppose that there s a measured wndow of data fff k () ; :::; ff k g of a sze w, measured dscretely wth varable dscretzaton step. It s convenent to pl RECURSIVE SPLINE INTERPOLATION METHOD FOR REAL TIME ENGINE CONTROL APPLICATIONS A. Stotsky Volvo Car Corporaton Engne Desgn and Development Dept. 97542, HA1N, SE- 405 31 Gothenburg Sweden. Emal: astotsky@volvocars.com

More information

Parameter Estimation for Dynamic System using Unscented Kalman filter

Parameter Estimation for Dynamic System using Unscented Kalman filter Parameter Estmaton for Dynamc System usng Unscented Kalman flter Jhoon Seung 1,a, Amr Atya F. 2,b, Alexander G.Parlos 3,c, and Klto Chong 1,4,d* 1 Dvson of Electroncs Engneerng, Chonbuk Natonal Unversty,

More information

DETERMINATION OF TEMPERATURE DISTRIBUTION FOR ANNULAR FINS WITH TEMPERATURE DEPENDENT THERMAL CONDUCTIVITY BY HPM

DETERMINATION OF TEMPERATURE DISTRIBUTION FOR ANNULAR FINS WITH TEMPERATURE DEPENDENT THERMAL CONDUCTIVITY BY HPM Ganj, Z. Z., et al.: Determnaton of Temperature Dstrbuton for S111 DETERMINATION OF TEMPERATURE DISTRIBUTION FOR ANNULAR FINS WITH TEMPERATURE DEPENDENT THERMAL CONDUCTIVITY BY HPM by Davood Domr GANJI

More information

Regularized Discriminant Analysis for Face Recognition

Regularized Discriminant Analysis for Face Recognition 1 Regularzed Dscrmnant Analyss for Face Recognton Itz Pma, Mayer Aladem Department of Electrcal and Computer Engneerng, Ben-Guron Unversty of the Negev P.O.Box 653, Beer-Sheva, 845, Israel. Abstract Ths

More information

CHAPTER 4 SPEECH ENHANCEMENT USING MULTI-BAND WIENER FILTER. In real environmental conditions the speech signal may be

CHAPTER 4 SPEECH ENHANCEMENT USING MULTI-BAND WIENER FILTER. In real environmental conditions the speech signal may be 55 CHAPTER 4 SPEECH ENHANCEMENT USING MULTI-BAND WIENER FILTER 4.1 Introducton In real envronmental condtons the speech sgnal may be supermposed by the envronmental nterference. In general, the spectrum

More information

ISSN: ISO 9001:2008 Certified International Journal of Engineering and Innovative Technology (IJEIT) Volume 3, Issue 1, July 2013

ISSN: ISO 9001:2008 Certified International Journal of Engineering and Innovative Technology (IJEIT) Volume 3, Issue 1, July 2013 ISSN: 2277-375 Constructon of Trend Free Run Orders for Orthogonal rrays Usng Codes bstract: Sometmes when the expermental runs are carred out n a tme order sequence, the response can depend on the run

More information

Relationship between Refractive Index and Molar Concentration of Multi-Component Solutions Zhu Xingyu 1, a, Mai Tiancheng 2, b and Zhao Zilong 2, c

Relationship between Refractive Index and Molar Concentration of Multi-Component Solutions Zhu Xingyu 1, a, Mai Tiancheng 2, b and Zhao Zilong 2, c Advances n Computer Scence Research, volume 71 4th Internatonal Conference on Machnery, Materals and Informaton Technology Applcatons (ICMMITA 2016) Relatonshp between Refractve Index and Molar Concentraton

More information

Comparison of Wiener Filter solution by SVD with decompositions QR and QLP

Comparison of Wiener Filter solution by SVD with decompositions QR and QLP Proceedngs of the 6th WSEAS Int Conf on Artfcal Intellgence, Knowledge Engneerng and Data Bases, Corfu Island, Greece, February 6-9, 007 7 Comparson of Wener Flter soluton by SVD wth decompostons QR and

More information

MMA and GCMMA two methods for nonlinear optimization

MMA and GCMMA two methods for nonlinear optimization MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons

More information

A New Scrambling Evaluation Scheme based on Spatial Distribution Entropy and Centroid Difference of Bit-plane

A New Scrambling Evaluation Scheme based on Spatial Distribution Entropy and Centroid Difference of Bit-plane A New Scramblng Evaluaton Scheme based on Spatal Dstrbuton Entropy and Centrod Dfference of Bt-plane Lang Zhao *, Avshek Adhkar Kouch Sakura * * Graduate School of Informaton Scence and Electrcal Engneerng,

More information

Fuzzy Boundaries of Sample Selection Model

Fuzzy Boundaries of Sample Selection Model Proceedngs of the 9th WSES Internatonal Conference on ppled Mathematcs, Istanbul, Turkey, May 7-9, 006 (pp309-34) Fuzzy Boundares of Sample Selecton Model L. MUHMD SFIIH, NTON BDULBSH KMIL, M. T. BU OSMN

More information

CHARACTERISTICS OF COMPLEX SEPARATION SCHEMES AND AN ERROR OF SEPARATION PRODUCTS OUTPUT DETERMINATION

CHARACTERISTICS OF COMPLEX SEPARATION SCHEMES AND AN ERROR OF SEPARATION PRODUCTS OUTPUT DETERMINATION Górnctwo Geonżynera Rok 0 Zeszyt / 006 Igor Konstantnovch Mladetskj * Petr Ivanovch Plov * Ekaterna Nkolaevna Kobets * Tasya Igorevna Markova * CHARACTERISTICS OF COMPLEX SEPARATION SCHEMES AND AN ERROR

More information

Fundamental loop-current method using virtual voltage sources technique for special cases

Fundamental loop-current method using virtual voltage sources technique for special cases Fundamental loop-current method usng vrtual voltage sources technque for specal cases George E. Chatzaraks, 1 Marna D. Tortorel 1 and Anastasos D. Tzolas 1 Electrcal and Electroncs Engneerng Departments,

More information

A Particle Filter Algorithm based on Mixing of Prior probability density and UKF as Generate Importance Function

A Particle Filter Algorithm based on Mixing of Prior probability density and UKF as Generate Importance Function Advanced Scence and Technology Letters, pp.83-87 http://dx.do.org/10.14257/astl.2014.53.20 A Partcle Flter Algorthm based on Mxng of Pror probablty densty and UKF as Generate Importance Functon Lu Lu 1,1,

More information

One-sided finite-difference approximations suitable for use with Richardson extrapolation

One-sided finite-difference approximations suitable for use with Richardson extrapolation Journal of Computatonal Physcs 219 (2006) 13 20 Short note One-sded fnte-dfference approxmatons sutable for use wth Rchardson extrapolaton Kumar Rahul, S.N. Bhattacharyya * Department of Mechancal Engneerng,

More information

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton

More information

Semi-supervised Classification with Active Query Selection

Semi-supervised Classification with Active Query Selection Sem-supervsed Classfcaton wth Actve Query Selecton Jao Wang and Swe Luo School of Computer and Informaton Technology, Beng Jaotong Unversty, Beng 00044, Chna Wangjao088@63.com Abstract. Labeled samples

More information

The lower and upper bounds on Perron root of nonnegative irreducible matrices

The lower and upper bounds on Perron root of nonnegative irreducible matrices Journal of Computatonal Appled Mathematcs 217 (2008) 259 267 wwwelsevercom/locate/cam The lower upper bounds on Perron root of nonnegatve rreducble matrces Guang-Xn Huang a,, Feng Yn b,keguo a a College

More information

8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS

8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS SECTION 8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS 493 8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS All the vector spaces you have studed thus far n the text are real vector spaces because the scalars

More information

Tracking with Kalman Filter

Tracking with Kalman Filter Trackng wth Kalman Flter Scott T. Acton Vrgna Image and Vdeo Analyss (VIVA), Charles L. Brown Department of Electrcal and Computer Engneerng Department of Bomedcal Engneerng Unversty of Vrgna, Charlottesvlle,

More information

Multi-user Detection Based on Weight approaching particle filter in Impulsive Noise

Multi-user Detection Based on Weight approaching particle filter in Impulsive Noise Internatonal Symposum on Computers & Informatcs (ISCI 2015) Mult-user Detecton Based on Weght approachng partcle flter n Impulsve Nose XIAN Jn long 1, a, LI Sheng Je 2,b 1 College of Informaton Scence

More information

Chapter 8 Indicator Variables

Chapter 8 Indicator Variables Chapter 8 Indcator Varables In general, e explanatory varables n any regresson analyss are assumed to be quanttatve n nature. For example, e varables lke temperature, dstance, age etc. are quanttatve n

More information

Linear Feature Engineering 11

Linear Feature Engineering 11 Lnear Feature Engneerng 11 2 Least-Squares 2.1 Smple least-squares Consder the followng dataset. We have a bunch of nputs x and correspondng outputs y. The partcular values n ths dataset are x y 0.23 0.19

More information

System in Weibull Distribution

System in Weibull Distribution Internatonal Matheatcal Foru 4 9 no. 9 94-95 Relablty Equvalence Factors of a Seres-Parallel Syste n Webull Dstrbuton M. A. El-Dacese Matheatcs Departent Faculty of Scence Tanta Unversty Tanta Egypt eldacese@yahoo.co

More information

BACKGROUND SUBTRACTION WITH EIGEN BACKGROUND METHODS USING MATLAB

BACKGROUND SUBTRACTION WITH EIGEN BACKGROUND METHODS USING MATLAB BACKGROUND SUBTRACTION WITH EIGEN BACKGROUND METHODS USING MATLAB 1 Ilmyat Sar 2 Nola Marna 1 Pusat Stud Komputas Matematka, Unverstas Gunadarma e-mal: lmyat@staff.gunadarma.ac.d 2 Pusat Stud Komputas

More information

On a direct solver for linear least squares problems

On a direct solver for linear least squares problems ISSN 2066-6594 Ann. Acad. Rom. Sc. Ser. Math. Appl. Vol. 8, No. 2/2016 On a drect solver for lnear least squares problems Constantn Popa Abstract The Null Space (NS) algorthm s a drect solver for lnear

More information

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng

More information

LINEAR REGRESSION ANALYSIS. MODULE VIII Lecture Indicator Variables

LINEAR REGRESSION ANALYSIS. MODULE VIII Lecture Indicator Variables LINEAR REGRESSION ANALYSIS MODULE VIII Lecture - 7 Indcator Varables Dr. Shalabh Department of Maematcs and Statstcs Indan Insttute of Technology Kanpur Indcator varables versus quanttatve explanatory

More information

A Hybrid Variational Iteration Method for Blasius Equation

A Hybrid Variational Iteration Method for Blasius Equation Avalable at http://pvamu.edu/aam Appl. Appl. Math. ISSN: 1932-9466 Vol. 10, Issue 1 (June 2015), pp. 223-229 Applcatons and Appled Mathematcs: An Internatonal Journal (AAM) A Hybrd Varatonal Iteraton Method

More information

Microwave Diversity Imaging Compression Using Bioinspired

Microwave Diversity Imaging Compression Using Bioinspired Mcrowave Dversty Imagng Compresson Usng Bonspred Neural Networks Youwe Yuan 1, Yong L 1, Wele Xu 1, Janghong Yu * 1 School of Computer Scence and Technology, Hangzhou Danz Unversty, Hangzhou, Zhejang,

More information

Global Sensitivity. Tuesday 20 th February, 2018

Global Sensitivity. Tuesday 20 th February, 2018 Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values

More information

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number

More information

CHAPTER-5 INFORMATION MEASURE OF FUZZY MATRIX AND FUZZY BINARY RELATION

CHAPTER-5 INFORMATION MEASURE OF FUZZY MATRIX AND FUZZY BINARY RELATION CAPTER- INFORMATION MEASURE OF FUZZY MATRI AN FUZZY BINARY RELATION Introducton The basc concept of the fuzz matr theor s ver smple and can be appled to socal and natural stuatons A branch of fuzz matr

More information

Supporting Information

Supporting Information Supportng Informaton The neural network f n Eq. 1 s gven by: f x l = ReLU W atom x l + b atom, 2 where ReLU s the element-wse rectfed lnear unt, 21.e., ReLUx = max0, x, W atom R d d s the weght matrx to

More information

Clock-Gating and Its Application to Low Power Design of Sequential Circuits

Clock-Gating and Its Application to Low Power Design of Sequential Circuits Clock-Gatng and Its Applcaton to Low Power Desgn of Sequental Crcuts ng WU Department of Electrcal Engneerng-Systems, Unversty of Southern Calforna Los Angeles, CA 989, USA, Phone: (23)74-448 Massoud PEDRAM

More information

Multigradient for Neural Networks for Equalizers 1

Multigradient for Neural Networks for Equalizers 1 Multgradent for Neural Netorks for Equalzers 1 Chulhee ee, Jnook Go and Heeyoung Km Department of Electrcal and Electronc Engneerng Yonse Unversty 134 Shnchon-Dong, Seodaemun-Ku, Seoul 1-749, Korea ABSTRACT

More information

j) = 1 (note sigma notation) ii. Continuous random variable (e.g. Normal distribution) 1. density function: f ( x) 0 and f ( x) dx = 1

j) = 1 (note sigma notation) ii. Continuous random variable (e.g. Normal distribution) 1. density function: f ( x) 0 and f ( x) dx = 1 Random varables Measure of central tendences and varablty (means and varances) Jont densty functons and ndependence Measures of assocaton (covarance and correlaton) Interestng result Condtonal dstrbutons

More information

Performing Modulation Scheme of Chaos Shift Keying with Hyperchaotic Chen System

Performing Modulation Scheme of Chaos Shift Keying with Hyperchaotic Chen System 6 th Internatonal Advanced echnologes Symposum (IAS 11), 16-18 May 011, Elazığ, urkey Performng Modulaton Scheme of Chaos Shft Keyng wth Hyperchaotc Chen System H. Oğraş 1, M. ürk 1 Unversty of Batman,

More information

Speeding up Computation of Scalar Multiplication in Elliptic Curve Cryptosystem

Speeding up Computation of Scalar Multiplication in Elliptic Curve Cryptosystem H.K. Pathak et. al. / (IJCSE) Internatonal Journal on Computer Scence and Engneerng Speedng up Computaton of Scalar Multplcaton n Ellptc Curve Cryptosystem H. K. Pathak Manju Sangh S.o.S n Computer scence

More information

Lecture 10 Support Vector Machines II

Lecture 10 Support Vector Machines II Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed

More information

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud Resource Allocaton wth a Budget Constrant for Computng Independent Tasks n the Cloud Wemng Sh and Bo Hong School of Electrcal and Computer Engneerng Georga Insttute of Technology, USA 2nd IEEE Internatonal

More information

CIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M

CIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M CIS56: achne Learnng Lecture 3 (Sept 6, 003) Preparaton help: Xaoyng Huang Lnear Regresson Lnear regresson can be represented by a functonal form: f(; θ) = θ 0 0 +θ + + θ = θ = 0 ote: 0 s a dummy attrbute

More information

Salmon: Lectures on partial differential equations. Consider the general linear, second-order PDE in the form. ,x 2

Salmon: Lectures on partial differential equations. Consider the general linear, second-order PDE in the form. ,x 2 Salmon: Lectures on partal dfferental equatons 5. Classfcaton of second-order equatons There are general methods for classfyng hgher-order partal dfferental equatons. One s very general (applyng even to

More information

An Improved multiple fractal algorithm

An Improved multiple fractal algorithm Advanced Scence and Technology Letters Vol.31 (MulGraB 213), pp.184-188 http://dx.do.org/1.1427/astl.213.31.41 An Improved multple fractal algorthm Yun Ln, Xaochu Xu, Jnfeng Pang College of Informaton

More information