Broadcast Channel with Transmitter Noncausal Interference and Receiver Side Information

Size: px
Start display at page:

Download "Broadcast Channel with Transmitter Noncausal Interference and Receiver Side Information"

Transcription

1 IEEE ICC 04 - Commucatos Theory Broadcast Chael wth Trasmtter Nocausal Iterferece ad Recever Sde Iformato Hayag X, Xaoju Yua ad Soug Chag Lew Dept. of Iformato Egeerg, The Chese Uversty of Hog Kog, Hog Kog Abstract Ths work vestgates the broadcast chael wth the kowledge of ocausal terferece at the trasmtter ad sde formato at the recevers. The system studed volves oe trasmtter sedg prvate formato to two recevers. We frst obta a achevable rate rego of ths system by extedg Gelfad ad Psker s GP s) radom bg method, orgally desged for pot-to-pot commucatos. We the apply the result to Gaussa scalar ad vector chaels, ad cosder the desg of the auxlary radom varable used GP s approach. Asymptotc aalyss shows that the proposed scheme both scalar ad vector chaels s asymptotcally capacty-achevg at hgh sgal-to-ose rato SNR). We further vestgate the system optmzato the fte SNR regme. For the scalar chael, we derve the optmal auxlary factor that maxmzes the weghed sum-rate. For the vector chael, two kds of suboptmal desgg methods for the auxlary matrx are proposed. Numercal results show that the proposed scheme ca acheve a sum-rate close to the cut-set boud the etre SNR regme, ad sgfcatly outperforms the schemes that do ot explot the kowledge of ocausal terferece kow at the trasmtter. I. INTRODUCTION The two-way relay chael TWRC), whch two users exchage formato va the help of the relay, has bee tesvely studed both theoretcal aalyss ad practcal mplemetato ]-5]. Physcal-layer etwork codg PNC) ] ad aalogue etwork codg ANC) ] are promsg techques proposed to effcetly utlze the sde formato at the user eds. Partcularly, t was show ] that PNC ca acheve the capacty of the TWRC wth 0.5 bt. A atural exteso of TWRC s mult-par TWRCs, where oe relay supports formato swtchg betwee multple users a parwse maer 6]-8]. Each par of users forms a TWRC, ad a user exchages formato oly wth hs couterpart the same par. Our tal work o mult-par TWRCs 8] focused o the uplk trasmsso. For the dowlk trasmsso, three types of messages are embedded the sgal receved by each user: the parter s message teded formato), the self-message recever sde formato) ad messages of the other user pars terferece). Each user s oly terested hs parter s message. Suppose that the relay geerates the sgals for user pars a sequetal order. The, the sgals ecoded frst become the ocausal terferece for the remag sgals,.e., the ecoder kows such terferece pror to the ecodg of the remag sgals. Hece, the dowlk trasmsso ca be modeled as a broadcast chael wth ocausal terferece at the trasmtter.e., the relay) ad sde formato at the recevers.e., the users). There are two ma streams of research work related to the cosdered broadcast chael the lterature. Oe stream s cocered wth hadlg the terferece at the trasmtter. The problem of ocausal terferece kow at the trasmtter was frst cosdered ad solved by Gelfad ad Psker GP) 9], usg the techque of radom bg 0]. Later, Costa proposed drty paper codg DPC) ], a realzato of GP s approach, to acheve the capacty of the Gaussa scalar chael as f there s o terferece. Further, the case of the Gaussa vector chael was cosdered ]. Ad the cases of Gaussa broadcast chael wth commomessage ad prvate-message are studed ] ad 4], respectvely. The other stream of research focuses o hadlg the sde formato of the recevers 5]-7]. It was show that each recever ca acheve the capacty of the dvdual chael lk. However, to the best of our kowledge, the broadcast chael wth both trasmtter ocausal terferece ad recever sde formato has ot bee well studed. The challege s how to desg a effcet codg scheme that ca jotly hadle the ocausal terferece kow at the trasmtter ad sde formato kow at the recever. I ths paper, we propose a ovel codg scheme for the cosdered broadcast chael. We frst derve achevable rates by extedg GP s radom bg approach, so as to explot the recever sde formato. We further cosder the desg of the auxlary radom varable used the GP approach to mprove system performace. For the Gaussa scalar chael, we provde a asymptotcally optmal soluto that ca acheve the capacty the hgh sgal-to-ose rato SNR) regme, ad derve the optmal auxlary factor for maxmzg the weghted sum-rate at geeral SNR. For the Gaussa vector chael, we also derve the asymptotcally optmal auxlary matrx at hgh SNR. However, the optmal desg of the auxlary matrx for the geeral SNR s a dffcult problem. We propose two suboptmal approaches. Smulato results demostrate the superorty of our proposed scheme compared wth tradtoal schemes 5]-7] wthout utlzg the kowledge of trasmtter terferece. Notato: The captal letter X ad the correspodg lowercase letter x deote the radom varable ad ts realzato, respectvely. The bold captal letter A ad the bold lowercase letter a deote the matrx ad the vector, respectvely. x deotes legth- sequece wth the jth symbol of x j.pra] s the probablty of evet A. P US ) s the jot probablty dstrbuto of U ad S. P U S ) s the probablty dstrbuto of U codtoed o S. u,s ) T ε P US ) meas that sequeces u ad s are jotly typcal wth respect to P US ) ad some small postve ε 8]. a] + deotes max{a, 0}. A deotes the determat of A. ad deote the Modulo- arthmetc ad Kroecker product, respectvely. For a matrx /4/$ IEEE 947

2 IEEE ICC 04 - Commucatos Theory W W Mapper W Ecoder PS S X Chael PYY XS Y Y W Decoder Decoder Wˆ Wˆ Sk Sk cosdered). We modfy the approach 9] to corporate the ew gredets cosdered our scheme. Our ma result s preseted below. Theorem : For the broadcast chael Fg., ay rate par R,R ) satsfyg the followg equaltes are smultaeously achevable: Fg.. Broadcast chael wth the kowledge of ocausal terferece at the trasmtter ad the kowledge of sde formato at the recevers. A, vec{a} s the vector obtaed by sequetally stackg the colums of A, ad vec { } s the reverse operato. II. SYSTEM MODEL The system model s show Fg., where there s oe trasmtter ad two recevers. W ad W are the orgal messages teded for recever ad recever, respectvely. These two messages frst go through a jectve fucto wth output W : f : W W W. ) The fucto f s ot ecessarly bjectve. For ay gve W, deote f W W )=fw,w ). We requre that, for ay gve W, the verse fucto of f W, deoted by f W : W W, {, } ) exsts. That s, f W s a bjectve mappg. The ecoder maps W to a strg X =X,X,..., X ad the seds t. Besdes put X, the chael P YY XS has the terferece S ad two outputs Y ad Y. The sequece S s output from a dscrete memoryless source P S ). The ecoder has access to S a ocausal fasho,.e., the ecoder kows S a pror. Decoder does ot kow S, but has the sde formato of W. After decodg, Ŵ s output to sk. The goal s ] to desg the ecoder ad decoders to esure that Pr Ŵ W, {, }, ca be made arbtrarly small. Example: Cosder the dowlk trasmsso of the multpar TWRC, whch multple users exchage formato a parwse maer va a sgle relay. There are stuatos where a par of users resposble for producg W ad W the uplk, the relay e.g., the ecoder) oly kows a etworkcoded message e.g., W = W W ), but ot the exact messages W ad W 8]. For the cases that the relay kows W ad W, we ca also frst map them to W before ecodg. I ecodg W, the relay perfectly kows the coded sgals for the other user pars.e., S ) that are ecoded before W, ad geerates a codeword vector X. X eeds to be forwarded to the two users the teded user par. At the recever sde, each user.e., decoder ) ams to decode W.e., the message from the other user) wth the kowledge of W.e., the self-formato of user ), {, }. III. AN ACHIEVABLE RATE REGION I ths secto, we establsh a achevable rate rego for the scheme Fg.. Our approach s based o the radom bg method developed by Gelfad ad Psker 9] whch a pot-to-pot chael wthout recever sde formato s W R < I U; Y ) I U; S)] +, {, } ) where U s a auxlary radom varable wth the jot probablty fucto P U, S). Sketch of Proof: Let w, u, s, x ad y be the orgal message, the auxlary sequece, the terferece sequece, the trasmtted sequece ad the receved sequece for decoder, {, }, respectvely. The jth symbols of the above sequeces,.e., u j, s j, x j ad y,j, are chose from the fte alphabets U, S, X ad Y, respectvely. Defe gu j,s j )=x j for j {,..., } that maps symbols U S to X, ad let ḡu,s ) be the sequece mappg of {u,s } to x. Code Costructo: Geerate R bs, dexed by w, where w =,..., R. Geerate R+R ) legth- codewords u wth each symbol each codeword radomly ad depedetly chose accordg to P U ). The throw these codewords radomly to the R bs such that each b has exactly R codewords. The vth codeword b w s deoted by u w, v). Ecoder: Gvew ad s, try to fd a codeword u w, v) b w, such that u w, v) ad s are jotly typcal,.e., u w, v),s ) Tε P US ). That s, the message w chooses the b umber, ad the terferece s chooses the codeword u w, v) from ths b. If oe fds a approprate codeword u w, v), trasmt x =ḡu w, v),s ). If ot, trasmt x = ḡu w, ),s ). Decoder: For each recever, based o the receved vector y ad the kowledge of w, try to fd a trplet ŵ,w, ˆv) such that u fŵ,w ), ˆv),y ) Tε P UY ). If there s oe or more such pars, the radomly choose oe of them, otherwse set ŵ =. Aalyss: We frst cosder decoder. The decoder makes a error oly f oe or more of the followg evets occur: E ={s / T ε P S )} 4) E ={u w, v),s ) / T ε P US )} 5) E ={u w, v),y ) / T ε P UY )} 6) E 4 ={u f ŵ,w ), ˆv),y ) Tε P UY )& ŵ w } 7) ) E s the evet of the terferece sequece s ot beg a typcal sequece. The probablty of E approaches zero as goes to fty by the law of large umber. ) E s the evet that there s o codeword b w that s jotly typcal wth s. Suppose that s Tε P S ). To make the probablty of E approach zero, s requred to be large ad R >I U; S). ) E s the evet that the codeword u s ot jotly typcal wth the receved sequece y. We ext show that the probablty of E goes to zero as. To ths ed, we frst ote that U S,X] Y forms a Markov cha, as U s depedet of Y gve S ad X. Note that u w, v),s ) Tε P US ) probablty, as 948

3 IEEE ICC 04 - Commucatos Theory the probablty of E vashes as. The we have u w, v),s,x ) Tε P USX ) by otg x =ḡu,s ). Together wth the factor that s,x ],y ) Tε P SXY ) as, we coclude from the Markov lemma 9, Lemma.] that Pr u,s,x,y ) Tε P USXY )] approaches oe as. So the probablty of E approaches zero as. v) E 4 s the evet that, although the decoded codeword u s jotly typcal wth y, ŵ s ot the correct message. The probablty of y Tε P Y ) approaches oe as. The probablty that a radomly geerated codeword u s jotly typcal wth y s upper bouded by IU;Y) ε) accordg to the jot asymptotc equpartto property 8, Theorem 8.6.]. Recall that decoder has the pror kowledge of w, ad that f w s a bjectve fucto. There are oly R vald bs the decodg codebook. Hece there are R R codewords the decodg codebook. Usg the uo boud, we see that the probablty of E 4.e., there exsts a codeword u that s jotly typcal wth y ad that s from a b other tha b w ) s bouded by R ) R IU;Y) ε).to esure ths probablty goes to zero, eeds to be large ad R +R <I U; Y ). Combg the cases of E ad E 4,wehave R < I U; Y ) I U; S)] +. 8) Smlarly, we have R <IU; Y ) IU; S)] + for decoder. Ths completes the proof of Theorem. Theorem ca be exteded to memoryless chaels wth cotuous alphabets by dscretzg cotuous radom varables followg the approaches 0, Chapter 7]. We wll apply Theorem to Gaussa scalar ad vector chaels the followg sectos. Clearly, the achevable rate par ) depeds o the choce of the auxlary radom varable U. We wll dscuss the desg of U what follows. IV. GAUSSIAN SCALAR CHANNEL A. Chael Model Cosder a system of oe base stato ad two users, each equpped wth a sgle atea. The chael s assumed to be real-valued. The receved sgal at user s gve by y = h x + h s + 9) where h s the chael ga betwee the base stato ad user, x s the trasmtted sgal wth E x ] p x, s s the Gaussa terferece wth E s ] = p s, ad s the zero-mea..d. addtve Gaussa ose wth E ] =σ, {, }. The cut-set boud of the chael 9) s gve by R cs log + h p x σ ), {, } 0) whch gves a outer boud of the achevable rate rego of the cosdered broadcast chael. We choose Gaussa sgalg,.e. x N 0,p x ). Followg DPC ], we set the auxlary radom varable u=x+αs, where α s a costat factor to be determed. The I U; Y )=h U)+h Y ) h U, Y ) px +α p s ) h p x +h p s+σ ) = log p x +α p s )h p x+h p s+σ ) p x+αh p s ) ) ad I U; S) = log p x + α p s. ) p x Substtutg ) ad ) to ), we obta a achevable rate par: R < log p x p x +α p s ) h p x +αh p s ) h p x+h p s+σ ) ) for {, }. For a decoder, we may choose α to be the mmum mea-square error MMSE) factor,.e., α = h Px. The, h Px+σ wth straghtforward ) mapulatos, the rght had sde of ) s log + h px, whch s the Shao capacty of the σ chael lk of user. Ths agrees wth the DPC result ]. However, as h h σ geeral, we ca ot set α to be σ the MMSE factor of both chael lks. We ext descrbe the detaled desg of α. B. Hgh-SNR Asymptotc Aalyss We start wth the hgh SNR regme,.e., p x +, p s + wth the rato ps p x fxed to be a costat, where c s a costat. The rght had sde of ) ca be rewrtte as ) ] + log p x px +p s +σ /h p x p s α). 4) +p x +α p s ) σ /h Clearly, f α, the rate 4) s bouded as p x + ; otherwse, ths rate goes to fty as p x +. Therefore the hgh SNR regme, the optmal α s α =. Wth α =, ) reduces to R < log px + h p )] + x p x + p s σ. 5) I the hgh SNR regme, ) the rate 5) s approxmately gve by log h px, ad approaches the cut-set boud σ 0). Thus, the proposed scheme s asymptotcally capactyachevg at hgh SNR. C. Weghted Sum-rate Maxmzato We ow cosder the optmzato of α for geeral SNR. We are terested fdg the optmal α for the followg weghted sum-rate problem: maxmze θ R + θ R 6) α subject to the rate costrats ), where θ ad θ are weghtg factors satsfyg θ,θ 0 ad θ +θ =. We frst assume cosder the case that R ad R are both postve. The the problem 6) ca be equvaletly wrtte as mmze α G α). 7) ] + 949

4 IEEE ICC 04 - Commucatos Theory sum-ratebts/chael use) cut-set boud proposed wth optmal α proposed wth α = terferece-oblvous proposed wth optmal α proposed wth α = terferece-oblvous INR=SNR+0dB) INR=SNR+0dB) INR=SNR+0dB) SNR db) Fg.. Sum-rate performace of the Gaussa scalar chael wth SNR, whe INR=SNR or INR=SNR+0dB. where G α)= ) α θ ) θ, λ α+μ α λ α+μ wth λ = p x p x+σ /, μ = pxps+σ / h ) h p sp x+σ / h ). To mmze G α), we set G α)=0, yeldg the followg equato: where α +aα +bα+c=0 8) a = λ +λ ) θ +λ +λ ) θ θ +θ ) b = μ + λ λ ) θ +μ + λ λ ) θ θ +θ ) c = λ μ θ λ μ θ. θ +θ ) For the real model 9), α s lmted to be real. Otherwse, f α s a complex umber, the we see from u = x + αs that IU; S) approaches fty by otg that the ose x s real-valued). Ths mples that the achevable rates of the scheme are always zero. The the optmal α s gve by the uque real soluto to 8): α= q q ) + p + ) ) q + q + p ) ) ) a, 9) where p=b a ad q = 7 a ab+c. We ext cosder the case that oly oe rate s postve ad the other rate s zero. Wthout loss of geeralty, we assume h > h, mplyg that R 0 ad R =0. I ths case, the optmal α s gve by the MMSE factor α = h px. h px+σ Maxmum weghted sum-rate of 6) s gve by the maxmum over the above two cases. D. Numercal Results Numercal results are provded to demostrate the rate performace of the proposed scheme the Gaussa scalar chael. The terferece-to-ose rato INR) s gve by ps σ ad SNR s gve by px. For smplcty, we always assume σ σ = σ smulato. I Fg., we compare the achevable sum-rates of the proposed scheme wth the cut-set boud. Two cases are studed: INR = SNR ad INR = SNR +0dB. We see that the sum-rate curve of the proposed scheme wth the optmal α gve by 9) s close to the cut-set boud closely for all SNR values. For both cases of INR, the sum-rates wth the optmal α ad α = coverge to the cut-set boud at hgh SNR. The sum-rate of the terferece-oblvous scheme whch the approach 5]-7] are drectly appled to the chael 9), wthout explotg the kowledge of trasmtter terferece) s also cluded Fg. for comparso. Note that the achevable rates of the terferece-oblvous ) scheme are gve by log + h px for {, }. We see that the h ps+σ sum-rates of the terferece-oblvous scheme are bouded at hgh SNR, whch demostrates the advatage of our proposed scheme. V. GAUSSIAN VECTOR CHANNEL A. Chael Model We exted the system model Secto IV to allow the use of multple ateas. Let m be the umber of ateas at each ode. The sgal receved at user s gve by y = H x + H s + 0) where x R m s the Gaussa sgal vector wth the covarace matrx of Q x, s R m s the Gaussa terferece vector wth the covarace matrx of Q s, H R m m s the chael lk betwee the base stato ad user, ad R m s the whte Gaussa ose vector at user, wth the covarace matrx of Q,, {, }. For ths chael, the cut-set boud s gve by R cs log H Q x H T +Q, {, }. ) Q Ths gves a outer boud of the achevable rate rego of the cosdered broadcast chael. We ow descrbe the achevable rates of the proposed scheme. Smlar to the scalar case, we troduce the auxlary radom vector u = x+fs, where F s a m m real-valued matrx to be determed. The, the rates ) ca be wrtte as R < I u; y ) I u; s)] +, {, }. ) We have I u; y )=hu)+hy ) h u, y ) = log Q x +FQ s F T H Q x H T +H Q s H T +Q Q x +FQ s F T Q x H T +FQ sh T ) H Q x +H Q s F T H Q x H T +H Q s H T +Q ad I u; s) = log Q x + FQ s F T. 4) Q x 950

5 IEEE ICC 04 - Commucatos Theory Substtutg ) ad 4) to ), we obta a achevable rate par: ] + R < log Q x FA F T +B F T +FB T +C for {, } 5) where A =Q s Q s H T H Q x H T +H Q s H T ) H +Q Q s B = Q x H T H Q x H T +H Q s H T ) H +Q Q s C =Q x Q x H T H Q x H T +H Q s H T ) H +Q Q x. I the Gaussa vector chael, for ) decoder, the optmal F s gve by Q x H T Q +H Q x H T H. Ths choce of F ca approach the Shao capacty of the chael lk of user,.e., log H Q xh T +Q Q ]. However two decoders are volved our scheme. Smlar to the scalar chael case, geeral, we ca ot fd a sgle F that s optmal for both decoders. B. Hgh SNR Asymptotc Aalyss If we choose F = I, after mapulatos, 5) reduces to R < log Q x H Q x H T +H Q s H T +Q ] +. 6) Q Q x +Q s I the hgh SNR regme, the rght had sde of 6) ca be approxmated as log H Q xh T Q, the asymptotc capacty of the chael lk of user wthout terferece. Thus, the choce of F = I s asymptotcally optmal the hgh SNR regme. C. Weghted Sum-rate Maxmzato We cosder the desg of F for maxmzg the weghted sum-rate the geeral SNR regme. Ths problem s formulated as follows: maxmze θ R + θ R 7) F subject to the rate costrats 5), where θ 0 ad θ 0 are weghtg factors satsfyg θ +θ =. The problem 7) s dffcult to solve geeral. I what follows, we propose two suboptmal solutos: oe based o the Ky Fa Iequalty amed as the o-teratve method), ad the other based o a teratve algorthm amed as the teratve method). Note that, smlar to the scalar chael case, the followg methods assume both R ad R are postve. Note that f oly oe rate s postve, the optmal F s chose to be the MMSE factor of the user wth the postve rate. ) No-teratve method: Maxmzg θ R +θ R s equvalet to maxmzg log Q x θ = FA F T +B F T +FB T +C. 8) θ From the Ky Fa Iequalty ], we have det X θ det X θ det θ X + θ X ). 9) where X ad X are two postve defte matrces. Applyg 9) to 8), we obta a lower boud of the weghted sum-rate as θ R +θ R log Q θ Q θ θ FA F T +B F T +FB T +C ). = 0) Deote Φ =θ A +θ A ), ) Ψ = θ B +θ B )θ A +θ A ), ) Θ = θ C +θ C ΨΨ T. ) We have that θ FA F T +B F T +FB T ) +C =FΦ Ψ)FΦ Ψ) T +Θ. = 4) The the choce of F that maxmzes the rght had sde of 0) s gve by F = ΨΦ = θ B +θ B )θ A +θ A ). 5) ) Iteratve method: The maxmzato of 8) occurs whe FA F T +B F T +FB T +C θ s mmzed. The, = to maxmze 8), t suffces to solve FA F T +B F T +FB T +C θ = = 0. 6) F After straghtforward mapulatos, we ca rewrte 6) as θ FA F T +B F T +FB T ) FA +C +B ) = θ FA F T +B F T +FB T ) FA +C +B ). 7) The closed-form soluto of F to 7) s dffcult to obta. Here we propose a teratve algorthm to umercally solve 7) as show Algorthm. Algorthm Iteratve Algorthm. : calculate A, B ad C, {, }; : talze F=I, t =, R sum ) = R + R, ɛ =0 ; : do 4: t=t +; ) ; 5: G =θ FA F T +B F T +FB T +C ) ; 6: G = θ FA F T +B F T +FB T +C { A ) } 7: F= vec T G +A T vec{g G B +G B } ; 8: R sum t)=r +R ; 9: whle R sum t) R sum t )>ɛ 0: retur R sum t). Emprcally, we observe that Algorthm always coverges. We are ow seekg for a rgorous proof for ths covergece. 95

6 IEEE ICC 04 - Commucatos Theory sum-ratebts/chael use) cut-set boud proposed teratve method proposed o-teratve method proposed wth F = I terferece-oblvous proposed teratve method proposed o-teratve method proposed wth F =I terferece-oblvous INR=SNR+0dB) INR=SNR+0dB) INR=SNR+0dB) INR=SNR+0dB) SNRdB) Fg.. Sum-rate performace of the Gaussa vector chael m=) wth SNR, whe INR=SNR or INR=SNR+0dB. D. Numercal Results Numercal results are provded to demostrate the rate performace of the proposed scheme the Gaussa vector TrQ chael wth m =. INR ad SNR are defed as s) TrQ,) ad TrQx) TrQ,), respectvely. For smplcty, we assume that Q, = Q, = σpi ad Q s s chose as a scaled detty matrx. I Fg., we compare the achevable sum-rates of the proposed scheme wth the cut-set boud. Three dfferet choces of F are cosdered: F = I, the o-teratve method, ad the teratve method. Two INR cases are studed: INR=SNR ad INR=SNR+0dB. Note that whe INR=SNR, the sum-rate curve of the teratve method s close to the cut-set boud for geeral SNR. For both cases of INR, the sum-rate curves for the o-teratve method ad the choce of F = I coverge to the cut-set boud at low ad hgh SNR, respectvely. We also cosder the terferece-oblvous approach for comparso Fg.. Note that the achevable rate of the terferece-oblvous approach s gve by log H Q x+q s)h T +Q H Q sh T+Q for {, }. Smlar to the scalar case, the terferece-oblvous approach has a bouded sumrate at hgh SNR, ad s sgfcatly outperformed by our proposed scheme. VI. CONCLUSION I ths paper, we studed the broadcast chael wth ocausal terferece kow at the trasmtter ad sde formato kow at the recevers. We exteded the Gelfad ad Psker approach by corporatg the recever sde formato, ad appled the results Gaussa scalar ad vector chaels. Asymptotc aalyss showed that the proposed scheme s capacty-achevg at hgh SNR. The sum-rate performaces were also evaluated through umercal smulato, ad show to be close to the cut-set boud the etre SNR rego. Gog forward, there are may exctg drectos for further explorato. For example, for the Gaussa vector chael, ths paper has oly cosdered the desg of the auxlary matrx wth equal atea cofgurato. The jot optmzato of the auxlary matrx ad trasmt covarace matrx wth uequal atea cofgurato s terestg. I addto, for the dowlk trasmsso of two-par TWRCs, The work ths paper oly cosders the codg desg for oe par of users by treatg the sgal of the other par as terferece. I practce, we are more terested the jot codg desg of the two user pars. We wll address ths ssue the future work. ACKNOWLEDGMENT Ths work s partally supported by the Cha 97 Program, Project No. 0CB5904. Ths work s partally supported by the Geeral Research Fuds Project No. 447 ad No. 487) ad AoE grat E-0/08, establshed uder the Uversty Grat Commttee of the Hog Kog Specal Admstratve Rego, Cha. REFERENCES ] S. Zhag, S. C. Lew, ad P. P. Lam, Hot topc: physcal-layer etwork codg, Proc. of ACM Mobcom, 006. ] S. Katt, S. Gollakota, ad D. Katab, Embracg wreless terferece: aalog etwork codg, Proc. of ACM SIGCOMM, 007. ] W. Nam, S. Chug ad Y. H. Lee, Capacty of the Gaussa two-way relay chael to wth / bt, IEEE Tras. If. Theory, vol. 56, o., Nov ] S. C. Lew, S. Zhag ad L. Lu, Physcal-layer etwork codg: tutoral, survey, ad beyod, vted paper, Elsever Phycom, 6), 0. 5] L. Lu, L. You, Q. Yag, T. Wag, M. Zhag, S. Zhag ad S. C Lew, Real-tme mplemetato of physcal-layer etwork codg, Proc. of ACM SRIF, 0. 6] H. X, Y. Peg, C. Wag, Y. Yag ad W. Wag, Coordated ege beamformg for mult-par MIMO two-way relay Network, Proc. of IEEE GLOBECOM, Dec. 0. 7] A. Sezg, A. Avestmehr, M. Khajehejad ad B. Hassb, Dvde-adcoquer: approachg the capacty of the two-par bdrectoal Gaussa relay etwork, IEEE Tras. Iform. Theory, vol. 58, o. 4, A Apr. 0. 8] H. X, X. Yua ad S. C. Lew Space-dvso approach for mult-par MIMO two-way relayg: a prcpal-agle perspectve, Proc. of IEEE GLOBECOM, Dec. 0. 9] S. I. Gelfad ad M. S. Psker, Codg for chaels wth radom parameters, Problems of Cotrol ad Iformato Theory, vol. 9, o., ] D. Slepa ad J. K. Wolf, Noseless codg of correlated formato sources, IEEE Tras. If. Theory, vol. 9, o. 9, July 97. ] M. H. M. Costa, Wrtg o drty paper, IEEE Tras. If. Theory, vol. 9, o., May 98. ] W. Yu, A. Sutvog, D. Jula, T. M. Cover, ad M. Chag, Wrtg o colored paper, Proc. of IEEE ISIT, 00. ] Y. Steberg ad S. Shama, Achevable rates for the broadcast chael wth states kow at the trasmtter, Proc. of IEEE ISIT, ] A. Khst, U. Erez, A. Lapdoth, ad G. W. Worell, Carbo copyg oto drty paper, IEEE Tras. If. Theory, vol. 5, o. 5, pp. May ] L.-L. Xe, Network codg ad radom bg for mult-user chaels, Proc. of Ca. Workshop If. Theory CWIT), ] T. J. Oechterg, C. Schurr, I. Bjelakovc, ad H. Boche, Broadcast capacty rego of two-phase bdrectoal relayg, IEEE Tras. If. Theory, vol. 54, o., Ja ] G. Kramer ad S. Shama, Capacty for classes of broadcast chaels wth recever sde formato, Proc. of IEEE ITW, ] T. Cover ad J. Thomas, Elemets of Iformato Theory, New York: Wley ad Sos, 99. 9] A. E. Gamal ad Y.-H. Km, Network Iformato Theory, Cambrdge Uversty Press, 0. 0] R. Gallager, Iformato Theory ad Relable Commucatos, Joh Wley ad Sos, Ic., N.Y ] M. S. Mosleha, Ky Fa Iequaltes,

ECE 559: Wireless Communication Project Report Diversity Multiplexing Tradeoff in MIMO Channels with partial CSIT. Hoa Pham

ECE 559: Wireless Communication Project Report Diversity Multiplexing Tradeoff in MIMO Channels with partial CSIT. Hoa Pham ECE 559: Wreless Commucato Project Report Dversty Multplexg Tradeoff MIMO Chaels wth partal CSIT Hoa Pham. Summary I ths project, I have studed the performace ga of MIMO systems. There are two types of

More information

Introduction to local (nonparametric) density estimation. methods

Introduction to local (nonparametric) density estimation. methods Itroducto to local (oparametrc) desty estmato methods A slecture by Yu Lu for ECE 66 Sprg 014 1. Itroducto Ths slecture troduces two local desty estmato methods whch are Parze desty estmato ad k-earest

More information

Functions of Random Variables

Functions of Random Variables Fuctos of Radom Varables Chapter Fve Fuctos of Radom Varables 5. Itroducto A geeral egeerg aalyss model s show Fg. 5.. The model output (respose) cotas the performaces of a system or product, such as weght,

More information

Solving Constrained Flow-Shop Scheduling. Problems with Three Machines

Solving Constrained Flow-Shop Scheduling. Problems with Three Machines It J Cotemp Math Sceces, Vol 5, 2010, o 19, 921-929 Solvg Costraed Flow-Shop Schedulg Problems wth Three Maches P Pada ad P Rajedra Departmet of Mathematcs, School of Advaced Sceces, VIT Uversty, Vellore-632

More information

Bayes (Naïve or not) Classifiers: Generative Approach

Bayes (Naïve or not) Classifiers: Generative Approach Logstc regresso Bayes (Naïve or ot) Classfers: Geeratve Approach What do we mea by Geeratve approach: Lear p(y), p(x y) ad the apply bayes rule to compute p(y x) for makg predctos Ths s essetally makg

More information

Basics of Information Theory: Markku Juntti. Basic concepts and tools 1 Introduction 2 Entropy, relative entropy and mutual information

Basics of Information Theory: Markku Juntti. Basic concepts and tools 1 Introduction 2 Entropy, relative entropy and mutual information : Maru Jutt Overvew he propertes of adlmted Gaussa chaels are further studed, parallel Gaussa chaels ad Gaussa chaels wth feedac are solved. Source he materal s maly ased o Sectos.4.6 of the course oo

More information

18.413: Error Correcting Codes Lab March 2, Lecture 8

18.413: Error Correcting Codes Lab March 2, Lecture 8 18.413: Error Correctg Codes Lab March 2, 2004 Lecturer: Dael A. Spelma Lecture 8 8.1 Vector Spaces A set C {0, 1} s a vector space f for x all C ad y C, x + y C, where we take addto to be compoet wse

More information

Channel Polarization and Polar Codes; Capacity Achieving

Channel Polarization and Polar Codes; Capacity Achieving Chael Polarzato ad Polar Codes; Capacty chevg Peyma Hesam Tutoral of Iformato Theory Course Uversty of otre Dame December, 9, 009 bstract: ew proposed method for costructg codes that acheves the symmetrc

More information

Feature Selection: Part 2. 1 Greedy Algorithms (continued from the last lecture)

Feature Selection: Part 2. 1 Greedy Algorithms (continued from the last lecture) CSE 546: Mache Learg Lecture 6 Feature Selecto: Part 2 Istructor: Sham Kakade Greedy Algorthms (cotued from the last lecture) There are varety of greedy algorthms ad umerous amg covetos for these algorthms.

More information

{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution:

{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution: Chapter 4 Exercses Samplg Theory Exercse (Smple radom samplg: Let there be two correlated radom varables X ad A sample of sze s draw from a populato by smple radom samplg wthout replacemet The observed

More information

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Postpoed exam: ECON430 Statstcs Date of exam: Jauary 0, 0 Tme for exam: 09:00 a.m. :00 oo The problem set covers 5 pages Resources allowed: All wrtte ad prted

More information

Econometric Methods. Review of Estimation

Econometric Methods. Review of Estimation Ecoometrc Methods Revew of Estmato Estmatg the populato mea Radom samplg Pot ad terval estmators Lear estmators Ubased estmators Lear Ubased Estmators (LUEs) Effcecy (mmum varace) ad Best Lear Ubased Estmators

More information

Part 4b Asymptotic Results for MRR2 using PRESS. Recall that the PRESS statistic is a special type of cross validation procedure (see Allen (1971))

Part 4b Asymptotic Results for MRR2 using PRESS. Recall that the PRESS statistic is a special type of cross validation procedure (see Allen (1971)) art 4b Asymptotc Results for MRR usg RESS Recall that the RESS statstc s a specal type of cross valdato procedure (see Alle (97)) partcular to the regresso problem ad volves fdg Y $,, the estmate at the

More information

Lecture 3 Probability review (cont d)

Lecture 3 Probability review (cont d) STATS 00: Itroducto to Statstcal Iferece Autum 06 Lecture 3 Probablty revew (cot d) 3. Jot dstrbutos If radom varables X,..., X k are depedet, the ther dstrbuto may be specfed by specfyg the dvdual dstrbuto

More information

Point Estimation: definition of estimators

Point Estimation: definition of estimators Pot Estmato: defto of estmators Pot estmator: ay fucto W (X,..., X ) of a data sample. The exercse of pot estmato s to use partcular fuctos of the data order to estmate certa ukow populato parameters.

More information

Chapter 5 Properties of a Random Sample

Chapter 5 Properties of a Random Sample Lecture 6 o BST 63: Statstcal Theory I Ku Zhag, /0/008 Revew for the prevous lecture Cocepts: t-dstrbuto, F-dstrbuto Theorems: Dstrbutos of sample mea ad sample varace, relatoshp betwee sample mea ad sample

More information

A tighter lower bound on the circuit size of the hardest Boolean functions

A tighter lower bound on the circuit size of the hardest Boolean functions Electroc Colloquum o Computatoal Complexty, Report No. 86 2011) A tghter lower boud o the crcut sze of the hardest Boolea fuctos Masak Yamamoto Abstract I [IPL2005], Fradse ad Mlterse mproved bouds o the

More information

A Robust Total Least Mean Square Algorithm For Nonlinear Adaptive Filter

A Robust Total Least Mean Square Algorithm For Nonlinear Adaptive Filter A Robust otal east Mea Square Algorthm For Nolear Adaptve Flter Ruxua We School of Electroc ad Iformato Egeerg X'a Jaotog Uversty X'a 70049, P.R. Cha rxwe@chare.com Chogzhao Ha, azhe u School of Electroc

More information

Research Article A New Iterative Method for Common Fixed Points of a Finite Family of Nonexpansive Mappings

Research Article A New Iterative Method for Common Fixed Points of a Finite Family of Nonexpansive Mappings Hdaw Publshg Corporato Iteratoal Joural of Mathematcs ad Mathematcal Sceces Volume 009, Artcle ID 391839, 9 pages do:10.1155/009/391839 Research Artcle A New Iteratve Method for Commo Fxed Pots of a Fte

More information

Homework 1: Solutions Sid Banerjee Problem 1: (Practice with Asymptotic Notation) ORIE 4520: Stochastics at Scale Fall 2015

Homework 1: Solutions Sid Banerjee Problem 1: (Practice with Asymptotic Notation) ORIE 4520: Stochastics at Scale Fall 2015 Fall 05 Homework : Solutos Problem : (Practce wth Asymptotc Notato) A essetal requremet for uderstadg scalg behavor s comfort wth asymptotc (or bg-o ) otato. I ths problem, you wll prove some basc facts

More information

X ε ) = 0, or equivalently, lim

X ε ) = 0, or equivalently, lim Revew for the prevous lecture Cocepts: order statstcs Theorems: Dstrbutos of order statstcs Examples: How to get the dstrbuto of order statstcs Chapter 5 Propertes of a Radom Sample Secto 55 Covergece

More information

Chapter 4 (Part 1): Non-Parametric Classification (Sections ) Pattern Classification 4.3) Announcements

Chapter 4 (Part 1): Non-Parametric Classification (Sections ) Pattern Classification 4.3) Announcements Aoucemets No-Parametrc Desty Estmato Techques HW assged Most of ths lecture was o the blacboard. These sldes cover the same materal as preseted DHS Bometrcs CSE 90-a Lecture 7 CSE90a Fall 06 CSE90a Fall

More information

Discrete Mathematics and Probability Theory Fall 2016 Seshia and Walrand DIS 10b

Discrete Mathematics and Probability Theory Fall 2016 Seshia and Walrand DIS 10b CS 70 Dscrete Mathematcs ad Probablty Theory Fall 206 Sesha ad Walrad DIS 0b. Wll I Get My Package? Seaky delvery guy of some compay s out delverg packages to customers. Not oly does he had a radom package

More information

Chapter 2 - Free Vibration of Multi-Degree-of-Freedom Systems - II

Chapter 2 - Free Vibration of Multi-Degree-of-Freedom Systems - II CEE49b Chapter - Free Vbrato of Mult-Degree-of-Freedom Systems - II We ca obta a approxmate soluto to the fudametal atural frequecy through a approxmate formula developed usg eergy prcples by Lord Raylegh

More information

Logistic regression (continued)

Logistic regression (continued) STAT562 page 138 Logstc regresso (cotued) Suppose we ow cosder more complex models to descrbe the relatoshp betwee a categorcal respose varable (Y) that takes o two (2) possble outcomes ad a set of p explaatory

More information

CS286.2 Lecture 4: Dinur s Proof of the PCP Theorem

CS286.2 Lecture 4: Dinur s Proof of the PCP Theorem CS86. Lecture 4: Dur s Proof of the PCP Theorem Scrbe: Thom Bohdaowcz Prevously, we have prove a weak verso of the PCP theorem: NP PCP 1,1/ (r = poly, q = O(1)). Wth ths result we have the desred costat

More information

Simulation Output Analysis

Simulation Output Analysis Smulato Output Aalyss Summary Examples Parameter Estmato Sample Mea ad Varace Pot ad Iterval Estmato ermatg ad o-ermatg Smulato Mea Square Errors Example: Sgle Server Queueg System x(t) S 4 S 4 S 3 S 5

More information

ECE 729 Introduction to Channel Coding

ECE 729 Introduction to Channel Coding chaelcodg.tex May 4, 2006 ECE 729 Itroducto to Chael Codg Cotets Fudametal Cocepts ad Techques. Chaels.....................2 Ecoders.....................2. Code Rates............... 2.3 Decoders....................

More information

Mu Sequences/Series Solutions National Convention 2014

Mu Sequences/Series Solutions National Convention 2014 Mu Sequeces/Seres Solutos Natoal Coveto 04 C 6 E A 6C A 6 B B 7 A D 7 D C 7 A B 8 A B 8 A C 8 E 4 B 9 B 4 E 9 B 4 C 9 E C 0 A A 0 D B 0 C C Usg basc propertes of arthmetc sequeces, we fd a ad bm m We eed

More information

TESTS BASED ON MAXIMUM LIKELIHOOD

TESTS BASED ON MAXIMUM LIKELIHOOD ESE 5 Toy E. Smth. The Basc Example. TESTS BASED ON MAXIMUM LIKELIHOOD To llustrate the propertes of maxmum lkelhood estmates ad tests, we cosder the smplest possble case of estmatg the mea of the ormal

More information

Chapter 4 Multiple Random Variables

Chapter 4 Multiple Random Variables Revew for the prevous lecture: Theorems ad Examples: How to obta the pmf (pdf) of U = g (, Y) ad V = g (, Y) Chapter 4 Multple Radom Varables Chapter 44 Herarchcal Models ad Mxture Dstrbutos Examples:

More information

The Mathematical Appendix

The Mathematical Appendix The Mathematcal Appedx Defto A: If ( Λ, Ω, where ( λ λ λ whch the probablty dstrbutos,,..., Defto A. uppose that ( Λ,,..., s a expermet type, the σ-algebra o λ λ λ are defed s deoted by ( (,,...,, σ Ω.

More information

PTAS for Bin-Packing

PTAS for Bin-Packing CS 663: Patter Matchg Algorthms Scrbe: Che Jag /9/00. Itroducto PTAS for B-Packg The B-Packg problem s NP-hard. If we use approxmato algorthms, the B-Packg problem could be solved polyomal tme. For example,

More information

Bounds on the expected entropy and KL-divergence of sampled multinomial distributions. Brandon C. Roy

Bounds on the expected entropy and KL-divergence of sampled multinomial distributions. Brandon C. Roy Bouds o the expected etropy ad KL-dvergece of sampled multomal dstrbutos Brado C. Roy bcroy@meda.mt.edu Orgal: May 18, 2011 Revsed: Jue 6, 2011 Abstract Iformato theoretc quattes calculated from a sampled

More information

2006 Jamie Trahan, Autar Kaw, Kevin Martin University of South Florida United States of America

2006 Jamie Trahan, Autar Kaw, Kevin Martin University of South Florida United States of America SOLUTION OF SYSTEMS OF SIMULTANEOUS LINEAR EQUATIONS Gauss-Sedel Method 006 Jame Traha, Autar Kaw, Kev Mart Uversty of South Florda Uted States of Amerca kaw@eg.usf.edu Itroducto Ths worksheet demostrates

More information

The number of observed cases The number of parameters. ith case of the dichotomous dependent variable. the ith case of the jth parameter

The number of observed cases The number of parameters. ith case of the dichotomous dependent variable. the ith case of the jth parameter LOGISTIC REGRESSION Notato Model Logstc regresso regresses a dchotomous depedet varable o a set of depedet varables. Several methods are mplemeted for selectg the depedet varables. The followg otato s

More information

Chapter 9 Jordan Block Matrices

Chapter 9 Jordan Block Matrices Chapter 9 Jorda Block atrces I ths chapter we wll solve the followg problem. Gve a lear operator T fd a bass R of F such that the matrx R (T) s as smple as possble. f course smple s a matter of taste.

More information

Estimation of Stress- Strength Reliability model using finite mixture of exponential distributions

Estimation of Stress- Strength Reliability model using finite mixture of exponential distributions Iteratoal Joural of Computatoal Egeerg Research Vol, 0 Issue, Estmato of Stress- Stregth Relablty model usg fte mxture of expoetal dstrbutos K.Sadhya, T.S.Umamaheswar Departmet of Mathematcs, Lal Bhadur

More information

Lecture 9: Tolerant Testing

Lecture 9: Tolerant Testing Lecture 9: Tolerat Testg Dael Kae Scrbe: Sakeerth Rao Aprl 4, 07 Abstract I ths lecture we prove a quas lear lower boud o the umber of samples eeded to do tolerat testg for L dstace. Tolerat Testg We have

More information

D. VQ WITH 1ST-ORDER LOSSLESS CODING

D. VQ WITH 1ST-ORDER LOSSLESS CODING VARIABLE-RATE VQ (AKA VQ WITH ENTROPY CODING) Varable-Rate VQ = Quatzato + Lossless Varable-Legth Bary Codg A rage of optos -- from smple to complex A. Uform scalar quatzato wth varable-legth codg, oe

More information

L5 Polynomial / Spline Curves

L5 Polynomial / Spline Curves L5 Polyomal / Sple Curves Cotets Coc sectos Polyomal Curves Hermte Curves Bezer Curves B-Sples No-Uform Ratoal B-Sples (NURBS) Mapulato ad Represetato of Curves Types of Curve Equatos Implct: Descrbe a

More information

best estimate (mean) for X uncertainty or error in the measurement (systematic, random or statistical) best

best estimate (mean) for X uncertainty or error in the measurement (systematic, random or statistical) best Error Aalyss Preamble Wheever a measuremet s made, the result followg from that measuremet s always subject to ucertaty The ucertaty ca be reduced by makg several measuremets of the same quatty or by mprovg

More information

On the Delay-Throughput Tradeoff in Distributed Wireless Networks

On the Delay-Throughput Tradeoff in Distributed Wireless Networks SUBMITTED TO IEEE TRANSACTIONS ON INFORMATION THEORY, OCTOBER 2009 O the Delay-Throughput Tradeoff Dstrbuted Wreless Networks Jamshd Aboue, Alreza Bayesteh, ad Amr K. Khada Codg ad Sgal Trasmsso Laboratory

More information

CIS 800/002 The Algorithmic Foundations of Data Privacy October 13, Lecture 9. Database Update Algorithms: Multiplicative Weights

CIS 800/002 The Algorithmic Foundations of Data Privacy October 13, Lecture 9. Database Update Algorithms: Multiplicative Weights CIS 800/002 The Algorthmc Foudatos of Data Prvacy October 13, 2011 Lecturer: Aaro Roth Lecture 9 Scrbe: Aaro Roth Database Update Algorthms: Multplcatve Weghts We ll recall aga) some deftos from last tme:

More information

Rademacher Complexity. Examples

Rademacher Complexity. Examples Algorthmc Foudatos of Learg Lecture 3 Rademacher Complexty. Examples Lecturer: Patrck Rebesch Verso: October 16th 018 3.1 Itroducto I the last lecture we troduced the oto of Rademacher complexty ad showed

More information

Investigation of Partially Conditional RP Model with Response Error. Ed Stanek

Investigation of Partially Conditional RP Model with Response Error. Ed Stanek Partally Codtoal Radom Permutato Model 7- vestgato of Partally Codtoal RP Model wth Respose Error TRODUCTO Ed Staek We explore the predctor that wll result a smple radom sample wth respose error whe a

More information

Capacity Bounds for Backhaul-Supported Wireless Multicast Relay Networks with Cross-Links

Capacity Bounds for Backhaul-Supported Wireless Multicast Relay Networks with Cross-Links Capacty Bouds for Backhaul-Supported Wreless Multcast Relay Networks wth Cross-Lks Proc. of IEEE ICC, Ju. 0. c 0 IEEE. Persoal use of ths materal s permtted. However, permsso to reprt/republsh ths materal

More information

8.1 Hashing Algorithms

8.1 Hashing Algorithms CS787: Advaced Algorthms Scrbe: Mayak Maheshwar, Chrs Hrchs Lecturer: Shuch Chawla Topc: Hashg ad NP-Completeess Date: September 21 2007 Prevously we looked at applcatos of radomzed algorthms, ad bega

More information

ESS Line Fitting

ESS Line Fitting ESS 5 014 17. Le Fttg A very commo problem data aalyss s lookg for relatoshpetwee dfferet parameters ad fttg les or surfaces to data. The smplest example s fttg a straght le ad we wll dscuss that here

More information

STK4011 and STK9011 Autumn 2016

STK4011 and STK9011 Autumn 2016 STK4 ad STK9 Autum 6 Pot estmato Covers (most of the followg materal from chapter 7: Secto 7.: pages 3-3 Secto 7..: pages 3-33 Secto 7..: pages 35-3 Secto 7..3: pages 34-35 Secto 7.3.: pages 33-33 Secto

More information

Lecture Note to Rice Chapter 8

Lecture Note to Rice Chapter 8 ECON 430 HG revsed Nov 06 Lecture Note to Rce Chapter 8 Radom matrces Let Y, =,,, m, =,,, be radom varables (r.v. s). The matrx Y Y Y Y Y Y Y Y Y Y = m m m s called a radom matrx ( wth a ot m-dmesoal dstrbuto,

More information

ρ < 1 be five real numbers. The

ρ < 1 be five real numbers. The Lecture o BST 63: Statstcal Theory I Ku Zhag, /0/006 Revew for the prevous lecture Deftos: covarace, correlato Examples: How to calculate covarace ad correlato Theorems: propertes of correlato ad covarace

More information

Class 13,14 June 17, 19, 2015

Class 13,14 June 17, 19, 2015 Class 3,4 Jue 7, 9, 05 Pla for Class3,4:. Samplg dstrbuto of sample mea. The Cetral Lmt Theorem (CLT). Cofdece terval for ukow mea.. Samplg Dstrbuto for Sample mea. Methods used are based o CLT ( Cetral

More information

Multivariate Transformation of Variables and Maximum Likelihood Estimation

Multivariate Transformation of Variables and Maximum Likelihood Estimation Marquette Uversty Multvarate Trasformato of Varables ad Maxmum Lkelhood Estmato Dael B. Rowe, Ph.D. Assocate Professor Departmet of Mathematcs, Statstcs, ad Computer Scece Copyrght 03 by Marquette Uversty

More information

Strong Convergence of Weighted Averaged Approximants of Asymptotically Nonexpansive Mappings in Banach Spaces without Uniform Convexity

Strong Convergence of Weighted Averaged Approximants of Asymptotically Nonexpansive Mappings in Banach Spaces without Uniform Convexity BULLETIN of the MALAYSIAN MATHEMATICAL SCIENCES SOCIETY Bull. Malays. Math. Sc. Soc. () 7 (004), 5 35 Strog Covergece of Weghted Averaged Appromats of Asymptotcally Noepasve Mappgs Baach Spaces wthout

More information

Bayes Estimator for Exponential Distribution with Extension of Jeffery Prior Information

Bayes Estimator for Exponential Distribution with Extension of Jeffery Prior Information Malaysa Joural of Mathematcal Sceces (): 97- (9) Bayes Estmator for Expoetal Dstrbuto wth Exteso of Jeffery Pror Iformato Hadeel Salm Al-Kutub ad Noor Akma Ibrahm Isttute for Mathematcal Research, Uverst

More information

Consensus Control for a Class of High Order System via Sliding Mode Control

Consensus Control for a Class of High Order System via Sliding Mode Control Cosesus Cotrol for a Class of Hgh Order System va Sldg Mode Cotrol Chagb L, Y He, ad Aguo Wu School of Electrcal ad Automato Egeerg, Taj Uversty, Taj, Cha, 300072 Abstract. I ths paper, cosesus problem

More information

Chapter 14 Logistic Regression Models

Chapter 14 Logistic Regression Models Chapter 4 Logstc Regresso Models I the lear regresso model X β + ε, there are two types of varables explaatory varables X, X,, X k ad study varable y These varables ca be measured o a cotuous scale as

More information

(b) By independence, the probability that the string 1011 is received correctly is

(b) By independence, the probability that the string 1011 is received correctly is Soluto to Problem 1.31. (a) Let A be the evet that a 0 s trasmtted. Usg the total probablty theorem, the desred probablty s P(A)(1 ɛ ( 0)+ 1 P(A) ) (1 ɛ 1)=p(1 ɛ 0)+(1 p)(1 ɛ 1). (b) By depedece, the probablty

More information

Pseudo-random Functions

Pseudo-random Functions Pseudo-radom Fuctos Debdeep Mukhopadhyay IIT Kharagpur We have see the costructo of PRG (pseudo-radom geerators) beg costructed from ay oe-way fuctos. Now we shall cosder a related cocept: Pseudo-radom

More information

KLT Tracker. Alignment. 1. Detect Harris corners in the first frame. 2. For each Harris corner compute motion between consecutive frames

KLT Tracker. Alignment. 1. Detect Harris corners in the first frame. 2. For each Harris corner compute motion between consecutive frames KLT Tracker Tracker. Detect Harrs corers the frst frame 2. For each Harrs corer compute moto betwee cosecutve frames (Algmet). 3. Lk moto vectors successve frames to get a track 4. Itroduce ew Harrs pots

More information

Complete Convergence and Some Maximal Inequalities for Weighted Sums of Random Variables

Complete Convergence and Some Maximal Inequalities for Weighted Sums of Random Variables Joural of Sceces, Islamc Republc of Ira 8(4): -6 (007) Uversty of Tehra, ISSN 06-04 http://sceces.ut.ac.r Complete Covergece ad Some Maxmal Iequaltes for Weghted Sums of Radom Varables M. Am,,* H.R. Nl

More information

On generalized fuzzy mean code word lengths. Department of Mathematics, Jaypee University of Engineering and Technology, Guna, Madhya Pradesh, India

On generalized fuzzy mean code word lengths. Department of Mathematics, Jaypee University of Engineering and Technology, Guna, Madhya Pradesh, India merca Joural of ppled Mathematcs 04; (4): 7-34 Publshed ole ugust 30, 04 (http://www.scecepublshggroup.com//aam) do: 0.648/.aam.04004.3 ISSN: 330-0043 (Prt); ISSN: 330-006X (Ole) O geeralzed fuzzy mea

More information

Dimensionality Reduction and Learning

Dimensionality Reduction and Learning CMSC 35900 (Sprg 009) Large Scale Learg Lecture: 3 Dmesoalty Reducto ad Learg Istructors: Sham Kakade ad Greg Shakharovch L Supervsed Methods ad Dmesoalty Reducto The theme of these two lectures s that

More information

CHAPTER 4 RADICAL EXPRESSIONS

CHAPTER 4 RADICAL EXPRESSIONS 6 CHAPTER RADICAL EXPRESSIONS. The th Root of a Real Number A real umber a s called the th root of a real umber b f Thus, for example: s a square root of sce. s also a square root of sce ( ). s a cube

More information

D KL (P Q) := p i ln p i q i

D KL (P Q) := p i ln p i q i Cheroff-Bouds 1 The Geeral Boud Let P 1,, m ) ad Q q 1,, q m ) be two dstrbutos o m elemets, e,, q 0, for 1,, m, ad m 1 m 1 q 1 The Kullback-Lebler dvergece or relatve etroy of P ad Q s defed as m D KL

More information

5 Short Proofs of Simplified Stirling s Approximation

5 Short Proofs of Simplified Stirling s Approximation 5 Short Proofs of Smplfed Strlg s Approxmato Ofr Gorodetsky, drtymaths.wordpress.com Jue, 20 0 Itroducto Strlg s approxmato s the followg (somewhat surprsg) approxmato of the factoral,, usg elemetary fuctos:

More information

Lecture 4 Sep 9, 2015

Lecture 4 Sep 9, 2015 CS 388R: Radomzed Algorthms Fall 205 Prof. Erc Prce Lecture 4 Sep 9, 205 Scrbe: Xagru Huag & Chad Voegele Overvew I prevous lectures, we troduced some basc probablty, the Cheroff boud, the coupo collector

More information

VARIABLE-RATE VQ (AKA VQ WITH ENTROPY CODING)

VARIABLE-RATE VQ (AKA VQ WITH ENTROPY CODING) VARIABLE-RATE VQ (AKA VQ WITH ENTROPY CODING) Varable-Rate VQ = Quatzato + Lossless Varable-Legth Bary Codg A rage of optos -- from smple to complex a. Uform scalar quatzato wth varable-legth codg, oe

More information

3. Basic Concepts: Consequences and Properties

3. Basic Concepts: Consequences and Properties : 3. Basc Cocepts: Cosequeces ad Propertes Markku Jutt Overvew More advaced cosequeces ad propertes of the basc cocepts troduced the prevous lecture are derved. Source The materal s maly based o Sectos.6.8

More information

THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA

THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA THE ROYAL STATISTICAL SOCIETY 3 EXAMINATIONS SOLUTIONS GRADUATE DIPLOMA PAPER I STATISTICAL THEORY & METHODS The Socety provdes these solutos to assst caddates preparg for the examatos future years ad

More information

Ordinary Least Squares Regression. Simple Regression. Algebra and Assumptions.

Ordinary Least Squares Regression. Simple Regression. Algebra and Assumptions. Ordary Least Squares egresso. Smple egresso. Algebra ad Assumptos. I ths part of the course we are gog to study a techque for aalysg the lear relatoshp betwee two varables Y ad X. We have pars of observatos

More information

We have already referred to a certain reaction, which takes place at high temperature after rich combustion.

We have already referred to a certain reaction, which takes place at high temperature after rich combustion. ME 41 Day 13 Topcs Chemcal Equlbrum - Theory Chemcal Equlbrum Example #1 Equlbrum Costats Chemcal Equlbrum Example #2 Chemcal Equlbrum of Hot Bured Gas 1. Chemcal Equlbrum We have already referred to a

More information

Hard Core Predicates: How to encrypt? Recap

Hard Core Predicates: How to encrypt? Recap Hard Core Predcates: How to ecrypt? Debdeep Mukhopadhyay IIT Kharagpur Recap A ecrypto scheme s secured f for every probablstc adversary A carryg out some specfed kd of attack ad for every polyomal p(.),

More information

CHAPTER VI Statistical Analysis of Experimental Data

CHAPTER VI Statistical Analysis of Experimental Data Chapter VI Statstcal Aalyss of Expermetal Data CHAPTER VI Statstcal Aalyss of Expermetal Data Measuremets do ot lead to a uque value. Ths s a result of the multtude of errors (maly radom errors) that ca

More information

The Occupancy and Coupon Collector problems

The Occupancy and Coupon Collector problems Chapter 4 The Occupacy ad Coupo Collector problems By Sarel Har-Peled, Jauary 9, 08 4 Prelmares [ Defto 4 Varace ad Stadard Devato For a radom varable X, let V E [ X [ µ X deote the varace of X, where

More information

X X X E[ ] E X E X. is the ()m n where the ( i,)th. j element is the mean of the ( i,)th., then

X X X E[ ] E X E X. is the ()m n where the ( i,)th. j element is the mean of the ( i,)th., then Secto 5 Vectors of Radom Varables Whe workg wth several radom varables,,..., to arrage them vector form x, t s ofte coveet We ca the make use of matrx algebra to help us orgaze ad mapulate large umbers

More information

Stochastic control viewpoint in coding and information theory for communications

Stochastic control viewpoint in coding and information theory for communications Stochastc cotrol vewpot codg ad formato theory for commucatos ECSE 506 Stochastc Cotrol ad Decso Theory (Wter 202) Project Report Studet ame: Y Feg Studet ID: 260647 Table of cotet. Itroducto... 3 2. Stochastc

More information

Decomposition of Hadamard Matrices

Decomposition of Hadamard Matrices Chapter 7 Decomposto of Hadamard Matrces We hae see Chapter that Hadamard s orgal costructo of Hadamard matrces states that the Kroecer product of Hadamard matrces of orders m ad s a Hadamard matrx of

More information

Non-uniform Turán-type problems

Non-uniform Turán-type problems Joural of Combatoral Theory, Seres A 111 2005 106 110 wwwelsevercomlocatecta No-uform Turá-type problems DhruvMubay 1, Y Zhao 2 Departmet of Mathematcs, Statstcs, ad Computer Scece, Uversty of Illos at

More information

BERNSTEIN COLLOCATION METHOD FOR SOLVING NONLINEAR DIFFERENTIAL EQUATIONS. Aysegul Akyuz Dascioglu and Nese Isler

BERNSTEIN COLLOCATION METHOD FOR SOLVING NONLINEAR DIFFERENTIAL EQUATIONS. Aysegul Akyuz Dascioglu and Nese Isler Mathematcal ad Computatoal Applcatos, Vol. 8, No. 3, pp. 293-300, 203 BERNSTEIN COLLOCATION METHOD FOR SOLVING NONLINEAR DIFFERENTIAL EQUATIONS Aysegul Ayuz Dascoglu ad Nese Isler Departmet of Mathematcs,

More information

Multi Objective Fuzzy Inventory Model with. Demand Dependent Unit Cost and Lead Time. Constraints A Karush Kuhn Tucker Conditions.

Multi Objective Fuzzy Inventory Model with. Demand Dependent Unit Cost and Lead Time. Constraints A Karush Kuhn Tucker Conditions. It. Joural of Math. Aalyss, Vol. 8, 204, o. 4, 87-93 HIKARI Ltd, www.m-hkar.com http://dx.do.org/0.2988/jma.204.30252 Mult Objectve Fuzzy Ivetory Model wth Demad Depedet Ut Cost ad Lead Tme Costrats A

More information

Special Instructions / Useful Data

Special Instructions / Useful Data JAM 6 Set of all real umbers P A..d. B, p Posso Specal Istructos / Useful Data x,, :,,, x x Probablty of a evet A Idepedetly ad detcally dstrbuted Bomal dstrbuto wth parameters ad p Posso dstrbuto wth

More information

Third handout: On the Gini Index

Third handout: On the Gini Index Thrd hadout: O the dex Corrado, a tala statstca, proposed (, 9, 96) to measure absolute equalt va the mea dfferece whch s defed as ( / ) where refers to the total umber of dvduals socet. Assume that. The

More information

Application of Legendre Bernstein basis transformations to degree elevation and degree reduction

Application of Legendre Bernstein basis transformations to degree elevation and degree reduction Computer Aded Geometrc Desg 9 79 78 www.elsever.com/locate/cagd Applcato of Legedre Berste bass trasformatos to degree elevato ad degree reducto Byug-Gook Lee a Yubeom Park b Jaechl Yoo c a Dvso of Iteret

More information

Block-Based Compact Thermal Modeling of Semiconductor Integrated Circuits

Block-Based Compact Thermal Modeling of Semiconductor Integrated Circuits Block-Based Compact hermal Modelg of Semcoductor Itegrated Crcuts Master s hess Defese Caddate: Jg Ba Commttee Members: Dr. Mg-Cheg Cheg Dr. Daqg Hou Dr. Robert Schllg July 27, 2009 Outle Itroducto Backgroud

More information

Chapter 8. Inferences about More Than Two Population Central Values

Chapter 8. Inferences about More Than Two Population Central Values Chapter 8. Ifereces about More Tha Two Populato Cetral Values Case tudy: Effect of Tmg of the Treatmet of Port-We tas wth Lasers ) To vestgate whether treatmet at a youg age would yeld better results tha

More information

Pseudo-random Functions. PRG vs PRF

Pseudo-random Functions. PRG vs PRF Pseudo-radom Fuctos Debdeep Muhopadhyay IIT Kharagpur PRG vs PRF We have see the costructo of PRG (pseudo-radom geerators) beg costructed from ay oe-way fuctos. Now we shall cosder a related cocept: Pseudo-radom

More information

Unimodality Tests for Global Optimization of Single Variable Functions Using Statistical Methods

Unimodality Tests for Global Optimization of Single Variable Functions Using Statistical Methods Malaysa Umodalty Joural Tests of Mathematcal for Global Optmzato Sceces (): of 05 Sgle - 5 Varable (007) Fuctos Usg Statstcal Methods Umodalty Tests for Global Optmzato of Sgle Varable Fuctos Usg Statstcal

More information

Lecture 2 - What are component and system reliability and how it can be improved?

Lecture 2 - What are component and system reliability and how it can be improved? Lecture 2 - What are compoet ad system relablty ad how t ca be mproved? Relablty s a measure of the qualty of the product over the log ru. The cocept of relablty s a exteded tme perod over whch the expected

More information

PROJECTION PROBLEM FOR REGULAR POLYGONS

PROJECTION PROBLEM FOR REGULAR POLYGONS Joural of Mathematcal Sceces: Advaces ad Applcatos Volume, Number, 008, Pages 95-50 PROJECTION PROBLEM FOR REGULAR POLYGONS College of Scece Bejg Forestry Uversty Bejg 0008 P. R. Cha e-mal: sl@bjfu.edu.c

More information

1 Lyapunov Stability Theory

1 Lyapunov Stability Theory Lyapuov Stablty heory I ths secto we cosder proofs of stablty of equlbra of autoomous systems. hs s stadard theory for olear systems, ad oe of the most mportat tools the aalyss of olear systems. It may

More information

1 Mixed Quantum State. 2 Density Matrix. CS Density Matrices, von Neumann Entropy 3/7/07 Spring 2007 Lecture 13. ψ = α x x. ρ = p i ψ i ψ i.

1 Mixed Quantum State. 2 Density Matrix. CS Density Matrices, von Neumann Entropy 3/7/07 Spring 2007 Lecture 13. ψ = α x x. ρ = p i ψ i ψ i. CS 94- Desty Matrces, vo Neuma Etropy 3/7/07 Sprg 007 Lecture 3 I ths lecture, we wll dscuss the bascs of quatum formato theory I partcular, we wll dscuss mxed quatum states, desty matrces, vo Neuma etropy

More information

ECON 5360 Class Notes GMM

ECON 5360 Class Notes GMM ECON 560 Class Notes GMM Geeralzed Method of Momets (GMM) I beg by outlg the classcal method of momets techque (Fsher, 95) ad the proceed to geeralzed method of momets (Hase, 98).. radtoal Method of Momets

More information

Random Variables and Probability Distributions

Random Variables and Probability Distributions Radom Varables ad Probablty Dstrbutos * If X : S R s a dscrete radom varable wth rage {x, x, x 3,. } the r = P (X = xr ) = * Let X : S R be a dscrete radom varable wth rage {x, x, x 3,.}.If x r P(X = x

More information

Convergence of the Desroziers scheme and its relation to the lag innovation diagnostic

Convergence of the Desroziers scheme and its relation to the lag innovation diagnostic Covergece of the Desrozers scheme ad ts relato to the lag ovato dagostc chard Méard Evromet Caada, Ar Qualty esearch Dvso World Weather Ope Scece Coferece Motreal, August 9, 04 o t t O x x x y x y Oservato

More information

ENGI 4421 Joint Probability Distributions Page Joint Probability Distributions [Navidi sections 2.5 and 2.6; Devore sections

ENGI 4421 Joint Probability Distributions Page Joint Probability Distributions [Navidi sections 2.5 and 2.6; Devore sections ENGI 441 Jot Probablty Dstrbutos Page 7-01 Jot Probablty Dstrbutos [Navd sectos.5 ad.6; Devore sectos 5.1-5.] The jot probablty mass fucto of two dscrete radom quattes, s, P ad p x y x y The margal probablty

More information

Analysis of Lagrange Interpolation Formula

Analysis of Lagrange Interpolation Formula P IJISET - Iteratoal Joural of Iovatve Scece, Egeerg & Techology, Vol. Issue, December 4. www.jset.com ISS 348 7968 Aalyss of Lagrage Iterpolato Formula Vjay Dahya PDepartmet of MathematcsMaharaja Surajmal

More information

Parameter, Statistic and Random Samples

Parameter, Statistic and Random Samples Parameter, Statstc ad Radom Samples A parameter s a umber that descrbes the populato. It s a fxed umber, but practce we do ot kow ts value. A statstc s a fucto of the sample data,.e., t s a quatty whose

More information

F. Inequalities. HKAL Pure Mathematics. 進佳數學團隊 Dr. Herbert Lam 林康榮博士. [Solution] Example Basic properties

F. Inequalities. HKAL Pure Mathematics. 進佳數學團隊 Dr. Herbert Lam 林康榮博士. [Solution] Example Basic properties 進佳數學團隊 Dr. Herbert Lam 林康榮博士 HKAL Pure Mathematcs F. Ieualtes. Basc propertes Theorem Let a, b, c be real umbers. () If a b ad b c, the a c. () If a b ad c 0, the ac bc, but f a b ad c 0, the ac bc. Theorem

More information