Linköping University Post Print. Combining Long-Term and Low-Rate Short- Term Channel State Information over Correlated MIMO Channels

Size: px
Start display at page:

Download "Linköping University Post Print. Combining Long-Term and Low-Rate Short- Term Channel State Information over Correlated MIMO Channels"

Transcription

1 Lnköpng Unversty Post Prnt Combnng Long-Term and Low-Rate Short- Term Channel State Informaton over Correlated MIMO Channels Tùng T. Km, Mats Bengtsson, Erk G. Larsson and Mkael Skoglund N.B.: When ctng ths work, cte the orgnal artcle. 009 IEEE. Personal use of ths materal s permtted. However, permsson to reprnt/republsh ths materal for advertsng or promotonal purposes or for creatng new collectve works for resale or redstrbuton to servers or lsts, or to reuse any copyrghted component of ths work n other works must be obtaned from the IEEE. Tùng T. Km, Mats Bengtsson, Erk G. Larsson and Mkael Skoglund, Combnng Long- Term and Low-Rate Short-Term Channel State Informaton over Correlated MIMO Channels, 008, IEEE Transactons on Wreless Communcatons, (7), 7, Postprnt avalable at: Lnköpng Unversty Electronc Press

2 IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, VOL. 7, NO. 7, JULY Transactons Letters Combnng Long-Term and Low-Rate Short-Term Channel State Informaton over Correlated MIMO Channels Tùng T. Km, Mats Bengtsson, Erk G. Larsson, and Mkael Skoglund Abstract A smple structure to explot both long-term and partal short-term channel state nformaton at the transmtter (CSIT) over a famly of correlated multple-antenna channels s proposed. Partal short-term CSIT n the form of a weghtng matrx s combned wth a untary transformaton based on the long-term channel statstcs. The heavly quantzed feedback lnk s drectly optmzed to mze the expected achevable rate under dfferent power constrants, usng vector quantzaton and convex optmzaton technques on a sample channel dstrbuton. Robustness aganst errors n the feedback lnk s also pursued wth tools n channel optmzed vector quantzaton. Smulatons ndcate the benefts of the proposed scheme. Index Terms MIMO systems, fadng channels, nformaton rates, feedback communcaton, adaptve systems. I. INTRODUCTION THE use of multple antennas at the transmtter and the recever s a well recognzed technque to acheve hgh data rates n wreless communcatons. A multtude of dfferent transmsson technques have been proposed n the lterature, especally for the specal cases of full channel state nformaton at the transmtter (CSIT) and no CSIT, respectvely. At least when usng a small number of antennas, the throughput can be sgnfcantly mproved f CSIT s avalable. However, n practce ths ether requres carefully calbrated rado chans and duplex tmes lower than the channel coherence tme, f the channel recprocty s exploted n tme-dvson duplex systems, or that a sgnfcant bandwdth s allocated to feed back channel estmates from the recever. Ths has led to a great deal of nterest n low-rate feedback schemes, see for Manuscrpt receved November 6, 006; revsed June 3, 007; accepted August 3, 007. The assocate edtor coordnatng the revew of ths paper and approvng t for publcaton was Y. Zheng. Ths work was supported n part by the Wreless World Intatve New Rado (WINNER) project n the European Unon Sxth Framework Programme (FP6) and by the Swedsh Research Councl (VR). The materal n ths paper was presented n part at the 006 IEEE Internatonal Conference on Acoustc, Speech, and Sgnal Processng, May 006. E. Larsson s a Royal Swedsh Academy of Scences Research Fellow supported by a grant from the Knut and Alce Wallenberg Foundaton. T. T. Km, M. Bengtsson, and M. Skoglund are wth the ACCESS Lnneaus Center, School of Electrcal Engneerng, Royal Insttute of Technology, SE-0044 Stockholm, Sweden (e-mal: {tung.km, mats.bengtsson, mkael.skoglund}@ee.kth.se). E. Larsson was wth Royal Insttute of Technology. He s now wth the Dept. of Electrcal Engneerng, Lnköpng Unversty (e-mal: erk.larsson@sy.lu.se). Dgtal Object Identfer 0.09/TWC /08$5.00 c 008 IEEE example [] [9], that can acheve a sgnfcant porton of the full-csit performance usng only a few bts of feedback for each fadng state. The fadng n wreless communcatons s generally governed by two components: A slowly-varyng component caused by, e.g., shadowng, and a short-tme varaton caused by multpath-fadng. Even f t s mpossble to obtan accurate short-term CSIT, the long-term channel characterstcs can often be estmated wth good accuracy. For fxed long-term channel statstcs, short-term feedback desgns to mze the ergodc capacty usng vector quantzaton technques are studed n []. The present work, by contrast, proposes a smple scheme that successfully combnes both long-term and quantzed short-term CSIT over a famly of multple-nput multple-output (MIMO) channels. The dea presented here s related to [4], [5] whch propose to combne a codebook based on Grassmanan lne packng wth nformaton from the channel covarance matrx. Our approach dffers fundamentally n that t uses a mutual nformaton crteron whereas [4], [5] mnmze a bound on the CSIT error and s lmted to beamformng. Our proposed transmsson scheme ncludes a untary transformaton nfluenced by the avalable knowledge of the channel statstcs. Such a transformaton can be motvated by the Karhunen-Loève transformaton n vector quantzaton [0], and also by ts optmalty n the absence of short-term feedback [] [3]. The short-term CSIT s exploted n the form of a weghtng matrx, whch s desgned usng a modfed verson of the Lloyd algorthm. Unlke n [] where approxmatons are requred, leadng to possble dvergence, we show that a major step n the desgn procedure can be cast as a varaton of the determnant mzaton problem [4], whch can be solved effcently. In contrast to [4] [6], our approach wll sometmes lead to spatal multplexng solutons. Smulaton results confrm the benefts of the proposed scheme. The results also ndcate that temporal power control yelds lttle extra gan over a system that only allocates power over spatal modes. Fnally, a robust desgn wth respect to errors n the feedback lnk s proposed under the framework of channel optmzed vector quantzaton. II. SYSTEM MODEL Consder the dscrete-tme complex-baseband equvalent model of a MIMO communcaton system wth N t transmt

3 40 IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, VOL. 7, NO. 7, JULY 008 x Encoder W(I) s U I s H I( H) H n y Decoder postve nteger. In other words, we consder a resolutonconstraned quantzer. For convenence, let W = W(), and Δ Δ Q = W W H, =,...,K. The system model () can then be wrtten n the form y = HUW x + n. () Fg.. System model. Condtoned on a feedback ndex I =, the average transmt power s antennas and N r receve antennas. The receved sgnal at tme nstant k of block l can be wrtten as y l (k) =H l (k)s l (k)+n l (k) () where H l (k) denotes the channel matrx and s l (k) s the transmtted vector. The components of the temporally and spatally whte nose n l (k) are complex Gaussan wth zero mean and unt varance. A block conssts of N consecutve channel uses, durng whch the vector vec[h l (k)] s assumed to be ndependent and dentcally dstrbuted (..d.) zeromean complex Gaussan wth covarance matrx R l,.e., vec[h l (k)] CN(0, R l ). Heren vec[ ] denotes vectorzaton. The channel covarance matrx R l, however, changes ndependently from one block to the next accordng to some statonary and ergodc dstrbuton. A transmtted codeword s assumed to span a sngle block. We study the system n the lmt of a very large block length N. Ths models a communcaton system where a codeword s suffcently long to capture the ergodcty of short-term changes, but stll short enough to experence a sngle R l. For readablty, we wll omt the block ndex l and the tme ndex k whenever ths s unambguous. Snce R s a slowlyvaryng parameter, we assume that R s perfectly known at both sdes of the lnk. Such nformaton may be obtaned from collected uplnk measurements or usng a low-rate feedback channel [5]. We further assume that H s fully known at the recever. For a system wth fxed long-term channel statstcs, a transmtter usng an..d. Gaussan codebook and a weghtng matrx whch depends only on short-term feedback nformaton s optmal n a capacty sense under certan assumptons [], [6]. However, over a famly of channels, ths would requre nfntely many quantzaton codebooks, one for each realzaton of R. We therefore propose a smple alternatve, llustrated n Fg.. The transmtter frst weghs the symbols x, taken from a Gaussan codebook, wth E[xx H ] = I Nt,byW(I), producng s. The notaton [ ] H denotes conjugate and transpose. Heren W s a mappng from a feedback ndex I to a fnte set of weghtng matrces. Such an ndex s obtaned va a noseless, zero-delay dedcated feedback lnk. The weghted sgnals s are then lnearly transformed by a untary matrx nfluenced only by long-term channel statstcs U U(R). To produce the feedback ndex, the recever employs an ndex mappng from the current effectve channel realzaton H = HU to an nteger I I( H). We assume that I takes a value n the set {,...,K} where K s a constant Takng the nose n the feedback lnk nto the desgn s also possble, as wll be demonstrated n Secton VI. Etr(ss H )=Etr( s s H )=Etr(W xx H W H )=trq, where tr X denotes the trace of a matrx X. We consder two dfferent types of power constrants. A short-term power constrant requres that the transmt power does not exceed P for any feedback ndex: tr Q I( H) P, H. (3) Ths models a system where temporal power control s not possble. Under the more relaxed long-term power constrant, the transmtter can vary the power over the transmsson of nfntely many codewords so that E R E H [tr Q I( H) R] P. (4) Note that the dstrbuton of H depends on the dstrbuton of R. Let I(R) denote the expected value of the mutual nformaton between the transmtted and receved sgnals, condtoned on R and for a fxed feedback scheme. We are nterested n the desgn of a feedback scheme that mzes the expected rate over nfntely many blocks,.e., I( H),{Q } E R I(R) s.t. (3) or (4). (5) The objectve functon n (5) can be nterpreted as the achevable rate by codng over a famly of nformaton stable channels, where each member of the famly s parameterzed by a covarance matrx R. In practce, the dstrbuton of R has to be known beforehand. However, as wll be shown n Secton IV, our proposed desgn approach does not requre the exact dstrbuton, but only an emprcal dstrbuton of R. III. DECORRELATING LINEAR TRANSFORMATION We propose to choose the untary transformaton U as the egenvectors of the transmt sde covarance matrx. As s shown below, ths wll decorrelate the channel coeffcents before the quantzaton. We emphasze the smplcty and ntutve appeal of such a decorrelaton, but do not clam ts optmalty, because unlke n [] [3], partal short-term CSIT s avalable n our model. For smplcty, we begn wth the case of a sngle receve antenna, where we use the notaton h = H H,andR Tx = R. Thus the receved sgnal can be wrtten as y = h H s + n wth h CN(0, R Tx ). Introduce the egendecomposton U Tx D Tx (U Tx ) H = R Tx wth untary U Tx and dagonal D Tx. Now f we choose U = U Tx,thenI(R) = E h R log( + h H Q h), where h = (U Tx ) H h s a vector of decorrelated varables,.e., h CN(0, D Tx ). Ths can be vewed as a property of the untary-ndependent-untary model [7]. Such

4 IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, VOL. 7, NO. 7, JULY Karhunen-Loève transformatons are commonly used n vector quantzaton [0]. The same deas can be appled to a MIMO channel, but t s n general mpossble to fnd a untary precodng matrx U that fully decorrelates the channel coeffcents. To proceed, we assume here that the second-order statstcs of the channel follows the so-called Kronecker model [8],.e., vec[h] CN(0, R), wherer =(R Tx ) T R Rx. Heren [ ] T denotes transpose and denotes the Kronecker product. Introduce the egendecomposton U Tx D Tx (U Tx ) H = R Tx and let us choose U = U Tx. Recallng that H = HU, wethenhave I(R) =E H R (I Nr + HQ H H), wth vec[ H] CN(0, D Tx R Rx ). IV. FEEDBACK LINK DESIGN A. Short-term Power Constrant The feedback lnk s desgned usng a modfed verson of the Lloyd algorthm [], [0]. However, nstead of usng an ad-hoc approxmaton that does not necessarly guarantee convergence as n [], we heren explot some results n determnant mzaton [4]. We frst dscretze the problem (5) and consder (I Nr + HQ I( H),{Q } I( H) H H ) s.t. (3) H H (6) where H s a set of samples drawn from the dstrbuton of H, whch s used to approxmate the contnuous dstrbuton of H [0]. The desgn procedure teratvely optmzes the ndex mappng I( H) and the weght codebook {Q } K =.Snce each optmzaton subproblem s solved exactly, the desgn guarantees convergence to a local optmum, but not necessarly to a global one. We summarze the two teraton steps as follows, where n ndcates the teraton ndex. Frst, gven a set {Q (n) satsfyng tr Q(n) P,, the } K = optmal ndex mappng s gven by I (n) ( H) = arg ( I Nr + (n) HQ H H). Next, fx I (n) ( H) and defne the quantzaton regons H (n) Δ = { H H: I (n) ( H) =}. The elements of the weght codebook can then be optmzed ndvdually: Q (n+) =arg (I Nr + HQ H H) Q 0 H (n) H H (n) s.t. tr Q P. Ths convex problem s a slghtly modfed verson of the standard determnant mzaton problem. In our numercal examples, we have for smplcty solved ths mzaton usng a drect generalzaton of the fxed-reducton algorthm n [4]. We have observed numercally that the objectve functon does not always ncrease n every teraton when usng []. B. Long-term Power Constrant The technque outlned n Secton IV-A can also be appled to the long-term power constrant case. The desgn however becomes more nvolved as we have to optmze the elements of the codebook {Q } K = jontly. Usng a sample dstrbuton H, we can reformulate the problem as (I Nr + HQ I( H),{Q 0} I( H) H H) H H (7) s.t. tr Q I( H) P. H H We wll teratvely solve the dual problem of (7). Gven a fxed {Q (n) } K = and a Lagrange multpler assocated wth the power constrant λ (n), we assume that a constrant qualfcaton holds so that the optmal ndex mappng solves I( H) { (I Nr + HQ (n) H H ) = H R Ths can be rewrtten as I( H) = H H λ (n) K = H ( (I Nr + HQ (n) tr Q(n) H H ) }. ) λ (n) tr Q (n). Note that the mzaton can also be seen as one performed over all possble ways of parttonng H nto K subsets H,...,H K. The soluton s readly gven by { ( I (n) ( H) = arg I Nr + HQ (n) H H) } λ (n) tr Q (n). In the ntal step, we can select Q (0) so that tr Q (0) = = tr Q (0) K, to remove the dependence of I(0) ( H) on λ (0). Next, gven the quantzaton regons H (n) Δ = { H H: I (n) ( H) =}, the optmal weght codebook {Q (n+) } s the soluton to {Q 0} s.t. = = H H (n) (I Nr + HQ H H) H (n) tr Q P. We solve also ths convex optmzaton usng a barrer method wth Newton steps. The optmal Lagrange multpler can be shown to be λ (n+) = tr H H X Q H tr Q = = tr H H K X K Q K H K tr Q K, where X X ( H) Δ = H H (I Nr + HQ H H ) H.

5 4 IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, VOL. 7, NO. 7, JULY 008 Expected Rate (bts/channel use) Full CSIT K=4 & Proposed U K= & Proposed U K=4 & ref. [4] K= & ref. [4] Long term CSIT only K=4 & U = I K= & U = I Expected Rate (bts/channel use) Full CSIT Long term CSIT only K= & Proposed U K=4 & Proposed U Fg.. Performance of the proposed scheme over a famly of 4 channels. A short-term power constrant s assumed. V. NUMERICAL RESULTS In ths secton we present smulaton results for a specfc class of correlated channels. For smplcty, the famly of R Tx s taken as Toepltz matrces wth [,ρ,ρ,...,ρ Nt ] as the top row, where ρ s a complex-valued random varable wth phase unformly dstrbuted n [0, π] and modulus dstrbuted as f( ρ ) =C exp ( λ( ρ )) f ρ < and f( ρ ) =0 otherwse, where λ > 0 and C = λ/( exp( λ)) s a normalzaton factor. The goal s to study the general behavors of the systems when the channels vary from hghly correlated to fully uncorrelated, rather than to smulate a specfc scenaro. All the smulatons are obtaned wth λ = log(0.0), modelng a famly of channels where ρ s greater than 0.5 more than 90 percent of the tme. A desgn for practcal applcatons may rely on more realstc channel models. Snce the nose varance s normalzed to unty, we defne the sgnalto-nose rato as SNR Δ = P. The feedback lnk s traned wth 00 realzatons of R and 000 channel realzatons for each R, usng 0 random startng ponts and 5 teratons n the Lloyd algorthm. Further ncreasng the number of channel realzatons does not seem to change the performance. The performance of the proposed scheme under a short-term power constrant over a famly of 4 channels s plotted n Fg.. For comparson, we tred a system that only uses shortterm feedback but gnores the correlaton propertes of the channel, usng exactly the same vector quantzaton technque except that U = I Nt. Clearly, the long-term nformaton provdes a consstent gan. For example, wth K =or one bt of feedback, the proposed approach provdes nearly a 3 db gan at an expected rate of 4 bts per channel use. We also plot the performance of the CSI quantzaton scheme proposed n [4], combned wth beamformng. Interestngly enough, ths scheme performs almost dentcally to our proposed scheme, even though t s not specfcally optmzed to mze the Fg. 3. Performance of the proposed scheme over a famly of 4 channels. A short-term power constrant s assumed. Expected Rate (bts/channel use) Full CSIT. Short term power constrant. Full CSIT. Long term power constrant. K= Short term power constrant. K= Long term power constrant Fg. 4. Performance of the proposed scheme over a famly of channels under dfferent power constrants. expected rate and always wll correspond to Q matrces of rank. 3 On the other hand, [4] explots some nformaton also from the egenvalues of R, not only the egenvectors. Fnally, for comparson, the fgure shows the performance of usng full CSIT (.e. beamformng) and of usng only long-term CSIT [] [3], [9], where the transmt covarance matrx s optmzed for each R,.e., for each fadng block, usng sample dstrbutons. At an expected rate of 4 bts per channel use, combnng bts of short-term CSIT (K =4) wth long-term statstcs yelds a gan of roughly db over usng only longterm statstcs. A smlar behavor, but wth less pronounced gans, can be seen n the 4 MIMO case, as llustrated n 3 For MISO channels, our scheme has always resulted n Q matrces of rank, but for MIMO most Q matrces were hgh rank.

6 IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, VOL. 7, NO. 7, JULY Fg. 3. Other experments (not reported n the fgures) have shown that the resultng desgn s extremely nsenstve to the SNR and also to the assumed channel statstcal dstrbuton. Also, we have tred to explot knowledge of the egenvalues of R to select between dfferent code books, but the addtonal gan was extremely small. Fg. 4 compares the performance of the proposed scheme under dfferent power constrants over a famly of channels. The results ndcate that temporal power control provdes a neglgble gan for moderate and hgh SNRs, consstent wth some results under the assumpton of perfect CSIT [0]. At low SNR, however, a long-term power-constraned system outperforms a short-term one by a wde margn. For nstance, at SNR = 5 db, a long-term power controlled system usng one bt of feedback nformaton even outperforms a perfect- CSIT system wthout temporal power control. However, the valdty of the assumpton about perfect channel knowledge at the recever at so low SNR-values may be questoned. VI. ROBUST DESIGN TO ERRONEOUS FEEDBACK LINKS Nose and delays n the feedback lnk may lead to erroneous feedback,.e., the feedback ndex receved at the transmtter s not dentcal to the one sent by the recever. In ths secton, we demonstrate how such defects n the feedback lnk can be explctly taken nto account n the system desgn. We exclusvely focus on the short-term power constrant case. The desgn under a long-term power constrant problem can be handled under a smlar prncple, but does not necessarly gve any addtonal nsght nto the system behavor. The key tool n our robust desgn s channel optmzed vector quantzaton (COVQ) [7], []. To dstngush the feedback ndex from the one actually seen at the transmtter, let us denote J ( H) as the ndex mappng used by the recever that takes the erroneous feedback lnk nto account. Thus, upon knowng H, the recever sends back j = J ( H) {,...,K}, and the transmtter receves some ndex {,...,K}, potentally dfferent from j. We model the feedback lnk as a dscrete-nput dscrete-output memoryless channel wth transton probabltes p( j). In practce, the values of the transton probabltes may need to be estmated based on e.g., the SNR of the feedback lnk. Note that even f the ndex s not correctly receved, the effectve channel matrx s stll assumed to be perfectly tracked at the recever. That s, the errors n the feedback lnk only affect the weghtng matrx used at the transmtter. The desgn problem can be reformulated as J ( H), {Q } H = p( J ( H)) (I Nr + HQ H H) (8) where we agan approxmate the true dstrbuton of H wth a sample dstrbuton. An teratve procedure, whch essentally follows the methodologes n Secton IV wth some slght modfcatons, can be appled to the extended desgn problem (8). The teratve steps are descrbed n the followng, where we omt the teraton ndex n to mprove readablty. Gven the covarance matrces {Q } K =, the optmal ndex Expected Rate (bts/channel use) ε=0 ε=0. robust.5 ε=0. robust Long term only ε=0., non robust ε=0., non robust Fg. 5. Performance of the proposed schemes desgned takng nto account error probablty n the feedback lnk over a famly of 4 channels. The feedback resoluton s K =. mappng s gven by J ( H) = arg j {,...,K} = ( p( j)logdet I Nr + HQ H H). That s, the optmal ndex mappng also takes nto account the possbltes of dfferent outcomes of the random feedback lnk. Next, gven the ndex mappng J ( H), then for each value of, the optmal transmt covarance matrx Q solves the followng problem Q 0 p( j) (I Nr + HQ H H) j= H H j s.t. tr Q P, where we defne the quantzaton regon j as H j = { H H : J ( H) =j}. Clearly, ntroducng the weghtng factors p( j) does not change the concavty of the cost functon; thus the optmzaton can be solved numercally for the global optmum. We plot the performance of the robust desgn over a famly of 4 channels (generated as descrbed n Secton V) n Fg. 5. In ths example, the feedback lnk s modeled as a K-nput K-output memoryless channel wth transton probabltes p( j) = ɛ f = j and p( j) =ɛ/(k ) f j,.e., the error probablty n the feedback lnk s ɛ and the errors are unformly dstrbuted over all possble erroneous outcomes. A fner error model on the bt level can also be used. As can be seen, the robust desgn successfully takes nto account the errors n the feedback lnk and strctly mproves the performance compared to that obtaned wth only longterm statstcs, even f the error probablty n the feedback lnk s relatvely hgh (up to ɛ =0.). Ths of course comes at the prce of a hgher complexty n the desgn. The curves marked by crcles are the ones obtaned by drectly usng an

7 44 IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, VOL. 7, NO. 7, JULY 008 error-free codebook over a nosy feedback lnk. Notce that n ths case, not usng a robust codebook even gves worse performance than relyng on long-term statstcs only. Such a senstvty to error n the feedback lnk s somewhat reduced at hgher values of the feedback level K (not plotted heren for readablty). VII. CONCLUSION We have presented a smple transcever structure that successfully combnes short-term, fast feedback based on actual channel realzatons and long-term, slowly-varyng CSI contanng the second-order statstcs of the MIMO channel. Whle the proposed structure s not clamed to be optmal, we emphasze ts smplcty and versatlty, as well as ts excellent performance. We have also studed an mportant extenson from the basc setup, whch allows the desgn to take nto account errors n the feedback lnk. REFERENCES [] A. Narula, M. J. Lopez, M. D. Trott, and G. W. Wornell, Effcent use of sde nformaton n multple-antenna data transmsson over fadng channels, IEEE J. Select. Areas Commun., vol. 6, pp , Oct [] V. Lau, Y. Lu, and T.-A. Chen, On the desgn of MIMO block-fadng channels wth feedback-lnk capacty constrant, IEEE Trans. Commun., vol. 5, pp. 6 70, Jan [3] K. K. Mukkavll, A. Sabharwal, E. Erkp, and B. Aazhang, On beamformng wth fnte rate feedback n multple-antenna systems, IEEE Trans. Inform. Theory, vol. 49, pp , Oct [4] D. J. Love and R. W. Heath, Jr., Lmted feedback dversty technques for correlated channels, IEEE Trans. Veh. Technol., vol. 55, pp. 78 7, Mar [5] D. J. Love and R. W. Heath Jr, Grassmannan beamformng on correlated MIMO channels, n Proc. GLOBECOM, vol., pp. 06 0, 004. [6] D. J. Love, R. W. Heath, Jr., and T. Strohmer, Grassmannan beamformng for multple-nput multple-output wreless systems, IEEE Trans. Inform. Theory, vol. 49, pp , Oct [7] G. Jöngren and M. Skoglund, Quantzed feedback nformaton n orthogonal space-tme block codng, IEEE Trans. Inform. Theory, vol. 50, pp , Oct [8] A. D. Dabbagh and D. J. Love, Feedback rate-capacty loss tradeoff for lmted feedback MIMO systems, IEEE Trans. Inform. Theory, vol. 5, pp. 90 0, May 006. [9] J. C. Roh and B. D. Rao, Transmt beamformng n multple-antenna systems wth fnte rate feedback: a VQ-based approach, IEEE Trans. Inform. Theory, vol. 5, pp. 0, Mar [0] A. Gersho and R. M. Gray, Vector Quantzaton and Sgnal Compresson. Norwell, MA: Kluwer Academc, 99. [] E. Vsotsky and U. Madhow, Space-tme transmt precodng wth mperfect feedback, IEEE Trans. Inform. Theory, vol. 47, pp , Sept. 00. [] S. A. Jafar and A. Goldsmth, Transmtter optmzaton and optmalty of beamformng for multple antenna systems, IEEE Trans. Wreless Commun., vol. 3, no. 4, pp , July 004. [3] E. Jorsweck and H. Boche, Channel capacty and capacty-range of beamformng n MIMO wreless systems under correlated fadng wth covarance feedback, IEEE Trans. Wreless Commun., vol. 3, no. 5, pp , Sept [4] L. Vandenberghe, S. Boyd, and S.-P. Wu, Determnant mzaton wth lnear matrx nequalty constrants, SIAM J. Matrx Anal. Appl., vol. 9, no., pp , 998. [5] M. Bengtsson and B. Ottersten, Optmal and suboptmal transmt beamformng, n Handbook of Antennas n Wreless Communcatons, L. C. Godara, Ed. CRC Press, Aug. 00, ch. 8. [6] M. Skoglund and G. Jöngren, On the capacty of a multple-antenna communcaton lnk wth channel sde nformaton, IEEE J. Select. Areas Commun., vol., pp , Apr [7] A. M. Tulno, A. Lozano, and S. Verdú, Impact of antenna correlaton on the capacty of multantenna channels, IEEE Trans. Inform. Theory, vol. 5, no. 7, pp , July 005. [8] J. P. Kermoal, L. Schumacher, K. I. Pedersen, P. E. Mogensen, and F. Frederksen, A stochastc MIMO rado channel model wth expermental valdaton, IEEE J. Select. Areas Commun., vol. 0, no. 6, pp. 6, Aug. 00. [9] S. Zhou and G. B. Gannaks, Optmal transmtter egen-beamformng and space-tme block codng based on channel mean feedback, IEEE Trans. Sgnal Processng, vol. 50, no. 0, pp , Oct. 00. [0] A. J. Goldsmth and P. P. Varaya, Capacty of fadng channels wth channel sde nformaton, IEEE Trans. Inform. Theory, vol. 43, pp , Nov [] N. Farvardn, A study of vector quantzaton for nosy channels, IEEE Trans. Inform. Theory, vol. 36, no. 4, pp , July 990.

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

ECE559VV Project Report

ECE559VV Project Report ECE559VV Project Report (Supplementary Notes Loc Xuan Bu I. MAX SUM-RATE SCHEDULING: THE UPLINK CASE We have seen (n the presentaton that, for downlnk (broadcast channels, the strategy maxmzng the sum-rate

More information

VQ widely used in coding speech, image, and video

VQ widely used in coding speech, image, and video at Scalar quantzers are specal cases of vector quantzers (VQ): they are constraned to look at one sample at a tme (memoryless) VQ does not have such constrant better RD perfomance expected Source codng

More information

Chapter 7 Channel Capacity and Coding

Chapter 7 Channel Capacity and Coding Wreless Informaton Transmsson System Lab. Chapter 7 Channel Capacty and Codng Insttute of Communcatons Engneerng atonal Sun Yat-sen Unversty Contents 7. Channel models and channel capacty 7.. Channel models

More information

Lossy Compression. Compromise accuracy of reconstruction for increased compression.

Lossy Compression. Compromise accuracy of reconstruction for increased compression. Lossy Compresson Compromse accuracy of reconstructon for ncreased compresson. The reconstructon s usually vsbly ndstngushable from the orgnal mage. Typcally, one can get up to 0:1 compresson wth almost

More information

Power Allocation for Distributed BLUE Estimation with Full and Limited Feedback of CSI

Power Allocation for Distributed BLUE Estimation with Full and Limited Feedback of CSI Power Allocaton for Dstrbuted BLUE Estmaton wth Full and Lmted Feedback of CSI Mohammad Fanae, Matthew C. Valent, and Natala A. Schmd Lane Department of Computer Scence and Electrcal Engneerng West Vrgna

More information

Chapter 7 Channel Capacity and Coding

Chapter 7 Channel Capacity and Coding Chapter 7 Channel Capacty and Codng Contents 7. Channel models and channel capacty 7.. Channel models Bnary symmetrc channel Dscrete memoryless channels Dscrete-nput, contnuous-output channel Waveform

More information

MIMO Systems and Channel Capacity

MIMO Systems and Channel Capacity MIMO Systems and Channel Capacty Consder a MIMO system wth m Tx and n Rx antennas. x y = Hx ξ Tx H Rx The power constrant: the total Tx power s x = P t. Component-wse representaton of the system model,

More information

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg prnceton unv. F 17 cos 521: Advanced Algorthm Desgn Lecture 7: LP Dualty Lecturer: Matt Wenberg Scrbe: LP Dualty s an extremely useful tool for analyzng structural propertes of lnear programs. Whle there

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

Error Probability for M Signals

Error Probability for M Signals Chapter 3 rror Probablty for M Sgnals In ths chapter we dscuss the error probablty n decdng whch of M sgnals was transmtted over an arbtrary channel. We assume the sgnals are represented by a set of orthonormal

More information

Composite Hypotheses testing

Composite Hypotheses testing Composte ypotheses testng In many hypothess testng problems there are many possble dstrbutons that can occur under each of the hypotheses. The output of the source s a set of parameters (ponts n a parameter

More information

Numerical Heat and Mass Transfer

Numerical Heat and Mass Transfer Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and

More information

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number

More information

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS HCMC Unversty of Pedagogy Thong Nguyen Huu et al. A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS Thong Nguyen Huu and Hao Tran Van Department of mathematcs-nformaton,

More information

A Feedback Reduction Technique for MIMO Broadcast Channels

A Feedback Reduction Technique for MIMO Broadcast Channels A Feedback Reducton Technque for MIMO Broadcast Channels Nhar Jndal Department of Electrcal and Computer Engneerng Unversty of Mnnesota Mnneapols, MN 55455, USA Emal: nhar@umn.edu Abstract A multple antenna

More information

MMA and GCMMA two methods for nonlinear optimization

MMA and GCMMA two methods for nonlinear optimization MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons

More information

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin Proceedngs of the 007 Wnter Smulaton Conference S G Henderson, B Bller, M-H Hseh, J Shortle, J D Tew, and R R Barton, eds LOW BIAS INTEGRATED PATH ESTIMATORS James M Calvn Department of Computer Scence

More information

EGR 544 Communication Theory

EGR 544 Communication Theory EGR 544 Communcaton Theory. Informaton Sources Z. Alyazcoglu Electrcal and Computer Engneerng Department Cal Poly Pomona Introducton Informaton Source x n Informaton sources Analog sources Dscrete sources

More information

Problem Set 9 Solutions

Problem Set 9 Solutions Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem

More information

Structure and Drive Paul A. Jensen Copyright July 20, 2003

Structure and Drive Paul A. Jensen Copyright July 20, 2003 Structure and Drve Paul A. Jensen Copyrght July 20, 2003 A system s made up of several operatons wth flow passng between them. The structure of the system descrbes the flow paths from nputs to outputs.

More information

Power Allocation/Beamforming for DF MIMO Two-Way Relaying: Relay and Network Optimization

Power Allocation/Beamforming for DF MIMO Two-Way Relaying: Relay and Network Optimization Power Allocaton/Beamformng for DF MIMO Two-Way Relayng: Relay and Network Optmzaton Je Gao, Janshu Zhang, Sergy A. Vorobyov, Ha Jang, and Martn Haardt Dept. of Electrcal & Computer Engneerng, Unversty

More information

Pulse Coded Modulation

Pulse Coded Modulation Pulse Coded Modulaton PCM (Pulse Coded Modulaton) s a voce codng technque defned by the ITU-T G.711 standard and t s used n dgtal telephony to encode the voce sgnal. The frst step n the analog to dgtal

More information

x i1 =1 for all i (the constant ).

x i1 =1 for all i (the constant ). Chapter 5 The Multple Regresson Model Consder an economc model where the dependent varable s a functon of K explanatory varables. The economc model has the form: y = f ( x,x,..., ) xk Approxmate ths by

More information

Lecture 3: Shannon s Theorem

Lecture 3: Shannon s Theorem CSE 533: Error-Correctng Codes (Autumn 006 Lecture 3: Shannon s Theorem October 9, 006 Lecturer: Venkatesan Guruswam Scrbe: Wdad Machmouch 1 Communcaton Model The communcaton model we are usng conssts

More information

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009 College of Computer & Informaton Scence Fall 2009 Northeastern Unversty 20 October 2009 CS7880: Algorthmc Power Tools Scrbe: Jan Wen and Laura Poplawsk Lecture Outlne: Prmal-dual schema Network Desgn:

More information

Antenna Combining for the MIMO Downlink Channel

Antenna Combining for the MIMO Downlink Channel Antenna Combnng for the IO Downlnk Channel arxv:0704.308v [cs.it] 0 Apr 2007 Nhar Jndal Department of Electrcal and Computer Engneerng Unversty of nnesota nneapols, N 55455, USA Emal: nhar@umn.edu Abstract

More information

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud Resource Allocaton wth a Budget Constrant for Computng Independent Tasks n the Cloud Wemng Sh and Bo Hong School of Electrcal and Computer Engneerng Georga Insttute of Technology, USA 2nd IEEE Internatonal

More information

The Order Relation and Trace Inequalities for. Hermitian Operators

The Order Relation and Trace Inequalities for. Hermitian Operators Internatonal Mathematcal Forum, Vol 3, 08, no, 507-57 HIKARI Ltd, wwwm-hkarcom https://doorg/0988/mf088055 The Order Relaton and Trace Inequaltes for Hermtan Operators Y Huang School of Informaton Scence

More information

Lecture 12: Discrete Laplacian

Lecture 12: Discrete Laplacian Lecture 12: Dscrete Laplacan Scrbe: Tanye Lu Our goal s to come up wth a dscrete verson of Laplacan operator for trangulated surfaces, so that we can use t n practce to solve related problems We are mostly

More information

Generalized Linear Methods

Generalized Linear Methods Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set

More information

Memory ecient adaptation of vector quantizers to time-varying channels

Memory ecient adaptation of vector quantizers to time-varying channels Sgnal Processng 83 (3) 59 58 www.elsever.com/locate/sgpro Memory ecent adaptaton of vector quantzers to tme-varyng channels orbert Gortz a;,jorg Klewer b a Insttute for Communcatons Engneerng (LT), Munch

More information

Markov Chain Monte Carlo Lecture 6

Markov Chain Monte Carlo Lecture 6 where (x 1,..., x N ) X N, N s called the populaton sze, f(x) f (x) for at least one {1, 2,..., N}, and those dfferent from f(x) are called the tral dstrbutons n terms of mportance samplng. Dfferent ways

More information

x = x 1 + :::+ x K and the nput covarance matrces are of the form ± = E[x x y ]. 3.2 Dualty Next, we ntroduce the concept of dualty wth the followng t

x = x 1 + :::+ x K and the nput covarance matrces are of the form ± = E[x x y ]. 3.2 Dualty Next, we ntroduce the concept of dualty wth the followng t Sum Power Iteratve Water-fllng for Mult-Antenna Gaussan Broadcast Channels N. Jndal, S. Jafar, S. Vshwanath and A. Goldsmth Dept. of Electrcal Engg. Stanford Unversty, CA, 94305 emal: njndal,syed,srram,andrea@wsl.stanford.edu

More information

OPTIMAL COMBINATION OF FOURTH ORDER STATISTICS FOR NON-CIRCULAR SOURCE SEPARATION. Christophe De Luigi and Eric Moreau

OPTIMAL COMBINATION OF FOURTH ORDER STATISTICS FOR NON-CIRCULAR SOURCE SEPARATION. Christophe De Luigi and Eric Moreau OPTIMAL COMBINATION OF FOURTH ORDER STATISTICS FOR NON-CIRCULAR SOURCE SEPARATION Chrstophe De Lug and Erc Moreau Unversty of Toulon LSEET UMR CNRS 607 av. G. Pompdou BP56 F-8362 La Valette du Var Cedex

More information

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have

More information

Lecture 10 Support Vector Machines II

Lecture 10 Support Vector Machines II Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed

More information

Transform Coding. Transform Coding Principle

Transform Coding. Transform Coding Principle Transform Codng Prncple of block-wse transform codng Propertes of orthonormal transforms Dscrete cosne transform (DCT) Bt allocaton for transform coeffcents Entropy codng of transform coeffcents Typcal

More information

Chapter 8 Indicator Variables

Chapter 8 Indicator Variables Chapter 8 Indcator Varables In general, e explanatory varables n any regresson analyss are assumed to be quanttatve n nature. For example, e varables lke temperature, dstance, age etc. are quanttatve n

More information

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS Avalable onlne at http://sck.org J. Math. Comput. Sc. 3 (3), No., 6-3 ISSN: 97-537 COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

More information

Hidden Markov Models & The Multivariate Gaussian (10/26/04)

Hidden Markov Models & The Multivariate Gaussian (10/26/04) CS281A/Stat241A: Statstcal Learnng Theory Hdden Markov Models & The Multvarate Gaussan (10/26/04) Lecturer: Mchael I. Jordan Scrbes: Jonathan W. Hu 1 Hdden Markov Models As a bref revew, hdden Markov models

More information

Assortment Optimization under MNL

Assortment Optimization under MNL Assortment Optmzaton under MNL Haotan Song Aprl 30, 2017 1 Introducton The assortment optmzaton problem ams to fnd the revenue-maxmzng assortment of products to offer when the prces of products are fxed.

More information

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4) I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes

More information

Low Complexity Soft-Input Soft-Output Hamming Decoder

Low Complexity Soft-Input Soft-Output Hamming Decoder Low Complexty Soft-Input Soft-Output Hammng Der Benjamn Müller, Martn Holters, Udo Zölzer Helmut Schmdt Unversty Unversty of the Federal Armed Forces Department of Sgnal Processng and Communcatons Holstenhofweg

More information

Time-Varying Systems and Computations Lecture 6

Time-Varying Systems and Computations Lecture 6 Tme-Varyng Systems and Computatons Lecture 6 Klaus Depold 14. Januar 2014 The Kalman Flter The Kalman estmaton flter attempts to estmate the actual state of an unknown dscrete dynamcal system, gven nosy

More information

Asymptotic Quantization: A Method for Determining Zador s Constant

Asymptotic Quantization: A Method for Determining Zador s Constant Asymptotc Quantzaton: A Method for Determnng Zador s Constant Joyce Shh Because of the fnte capacty of modern communcaton systems better methods of encodng data are requred. Quantzaton refers to the methods

More information

Linear Approximation with Regularization and Moving Least Squares

Linear Approximation with Regularization and Moving Least Squares Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...

More information

SIO 224. m(r) =(ρ(r),k s (r),µ(r))

SIO 224. m(r) =(ρ(r),k s (r),µ(r)) SIO 224 1. A bref look at resoluton analyss Here s some background for the Masters and Gubbns resoluton paper. Global Earth models are usually found teratvely by assumng a startng model and fndng small

More information

Errors for Linear Systems

Errors for Linear Systems Errors for Lnear Systems When we solve a lnear system Ax b we often do not know A and b exactly, but have only approxmatons  and ˆb avalable. Then the best thng we can do s to solve ˆx ˆb exactly whch

More information

Lecture 3: Probability Distributions

Lecture 3: Probability Distributions Lecture 3: Probablty Dstrbutons Random Varables Let us begn by defnng a sample space as a set of outcomes from an experment. We denote ths by S. A random varable s a functon whch maps outcomes nto the

More information

Digital Modems. Lecture 2

Digital Modems. Lecture 2 Dgtal Modems Lecture Revew We have shown that both Bayes and eyman/pearson crtera are based on the Lkelhood Rato Test (LRT) Λ ( r ) < > η Λ r s called observaton transformaton or suffcent statstc The crtera

More information

A Robust Method for Calculating the Correlation Coefficient

A Robust Method for Calculating the Correlation Coefficient A Robust Method for Calculatng the Correlaton Coeffcent E.B. Nven and C. V. Deutsch Relatonshps between prmary and secondary data are frequently quantfed usng the correlaton coeffcent; however, the tradtonal

More information

I + HH H N 0 M T H = UΣV H = [U 1 U 2 ] 0 0 E S. X if X 0 0 if X < 0 (X) + = = M T 1 + N 0. r p + 1

I + HH H N 0 M T H = UΣV H = [U 1 U 2 ] 0 0 E S. X if X 0 0 if X < 0 (X) + = = M T 1 + N 0. r p + 1 Homework 4 Problem Capacty wth CSI only at Recever: C = log det I + E )) s HH H N M T R SS = I) SVD of the Channel Matrx: H = UΣV H = [U 1 U ] [ Σr ] [V 1 V ] H Capacty wth CSI at both transmtter and

More information

Research Article Green s Theorem for Sign Data

Research Article Green s Theorem for Sign Data Internatonal Scholarly Research Network ISRN Appled Mathematcs Volume 2012, Artcle ID 539359, 10 pages do:10.5402/2012/539359 Research Artcle Green s Theorem for Sgn Data Lous M. Houston The Unversty of

More information

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton

More information

Winter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan

Winter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan Wnter 2008 CS567 Stochastc Lnear/Integer Programmng Guest Lecturer: Xu, Huan Class 2: More Modelng Examples 1 Capacty Expanson Capacty expanson models optmal choces of the tmng and levels of nvestments

More information

The Geometry of Logit and Probit

The Geometry of Logit and Probit The Geometry of Logt and Probt Ths short note s meant as a supplement to Chapters and 3 of Spatal Models of Parlamentary Votng and the notaton and reference to fgures n the text below s to those two chapters.

More information

Kernel Methods and SVMs Extension

Kernel Methods and SVMs Extension Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general

More information

Convergence of random processes

Convergence of random processes DS-GA 12 Lecture notes 6 Fall 216 Convergence of random processes 1 Introducton In these notes we study convergence of dscrete random processes. Ths allows to characterze phenomena such as the law of large

More information

EEE 241: Linear Systems

EEE 241: Linear Systems EEE : Lnear Systems Summary #: Backpropagaton BACKPROPAGATION The perceptron rule as well as the Wdrow Hoff learnng were desgned to tran sngle layer networks. They suffer from the same dsadvantage: they

More information

Pop-Click Noise Detection Using Inter-Frame Correlation for Improved Portable Auditory Sensing

Pop-Click Noise Detection Using Inter-Frame Correlation for Improved Portable Auditory Sensing Advanced Scence and Technology Letters, pp.164-168 http://dx.do.org/10.14257/astl.2013 Pop-Clc Nose Detecton Usng Inter-Frame Correlaton for Improved Portable Audtory Sensng Dong Yun Lee, Kwang Myung Jeon,

More information

Lecture 12: Classification

Lecture 12: Classification Lecture : Classfcaton g Dscrmnant functons g The optmal Bayes classfer g Quadratc classfers g Eucldean and Mahalanobs metrcs g K Nearest Neghbor Classfers Intellgent Sensor Systems Rcardo Guterrez-Osuna

More information

Solutions to exam in SF1811 Optimization, Jan 14, 2015

Solutions to exam in SF1811 Optimization, Jan 14, 2015 Solutons to exam n SF8 Optmzaton, Jan 4, 25 3 3 O------O -4 \ / \ / The network: \/ where all lnks go from left to rght. /\ / \ / \ 6 O------O -5 2 4.(a) Let x = ( x 3, x 4, x 23, x 24 ) T, where the varable

More information

Negative Binomial Regression

Negative Binomial Regression STATGRAPHICS Rev. 9/16/2013 Negatve Bnomal Regresson Summary... 1 Data Input... 3 Statstcal Model... 3 Analyss Summary... 4 Analyss Optons... 7 Plot of Ftted Model... 8 Observed Versus Predcted... 10 Predctons...

More information

Tracking with Kalman Filter

Tracking with Kalman Filter Trackng wth Kalman Flter Scott T. Acton Vrgna Image and Vdeo Analyss (VIVA), Charles L. Brown Department of Electrcal and Computer Engneerng Department of Bomedcal Engneerng Unversty of Vrgna, Charlottesvlle,

More information

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur Analyss of Varance and Desgn of Experment-I MODULE VII LECTURE - 3 ANALYSIS OF COVARIANCE Dr Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Any scentfc experment s performed

More information

Scroll Generation with Inductorless Chua s Circuit and Wien Bridge Oscillator

Scroll Generation with Inductorless Chua s Circuit and Wien Bridge Oscillator Latest Trends on Crcuts, Systems and Sgnals Scroll Generaton wth Inductorless Chua s Crcut and Wen Brdge Oscllator Watcharn Jantanate, Peter A. Chayasena, and Sarawut Sutorn * Abstract An nductorless Chua

More information

The Prncpal Component Transform The Prncpal Component Transform s also called Karhunen-Loeve Transform (KLT, Hotellng Transform, oregenvector Transfor

The Prncpal Component Transform The Prncpal Component Transform s also called Karhunen-Loeve Transform (KLT, Hotellng Transform, oregenvector Transfor Prncpal Component Transform Multvarate Random Sgnals A real tme sgnal x(t can be consdered as a random process and ts samples x m (m =0; ;N, 1 a random vector: The mean vector of X s X =[x0; ;x N,1] T

More information

MAXIMUM A POSTERIORI TRANSDUCTION

MAXIMUM A POSTERIORI TRANSDUCTION MAXIMUM A POSTERIORI TRANSDUCTION LI-WEI WANG, JU-FU FENG School of Mathematcal Scences, Peng Unversty, Bejng, 0087, Chna Center for Informaton Scences, Peng Unversty, Bejng, 0087, Chna E-MIAL: {wanglw,

More information

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons

More information

ECE 534: Elements of Information Theory. Solutions to Midterm Exam (Spring 2006)

ECE 534: Elements of Information Theory. Solutions to Midterm Exam (Spring 2006) ECE 534: Elements of Informaton Theory Solutons to Mdterm Eam (Sprng 6) Problem [ pts.] A dscrete memoryless source has an alphabet of three letters,, =,, 3, wth probabltes.4,.4, and., respectvely. (a)

More information

STAT 309: MATHEMATICAL COMPUTATIONS I FALL 2018 LECTURE 16

STAT 309: MATHEMATICAL COMPUTATIONS I FALL 2018 LECTURE 16 STAT 39: MATHEMATICAL COMPUTATIONS I FALL 218 LECTURE 16 1 why teratve methods f we have a lnear system Ax = b where A s very, very large but s ether sparse or structured (eg, banded, Toepltz, banded plus

More information

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also

More information

Secret Communication using Artificial Noise

Secret Communication using Artificial Noise Secret Communcaton usng Artfcal Nose Roht Neg, Satashu Goel C Department, Carnege Mellon Unversty, PA 151, USA {neg,satashug}@ece.cmu.edu Abstract The problem of secret communcaton between two nodes over

More information

On an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1

On an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1 On an Extenson of Stochastc Approxmaton EM Algorthm for Incomplete Data Problems Vahd Tadayon Abstract: The Stochastc Approxmaton EM (SAEM algorthm, a varant stochastc approxmaton of EM, s a versatle tool

More information

Queueing Networks II Network Performance

Queueing Networks II Network Performance Queueng Networks II Network Performance Davd Tpper Assocate Professor Graduate Telecommuncatons and Networkng Program Unversty of Pttsburgh Sldes 6 Networks of Queues Many communcaton systems must be modeled

More information

On the correction of the h-index for career length

On the correction of the h-index for career length 1 On the correcton of the h-ndex for career length by L. Egghe Unverstet Hasselt (UHasselt), Campus Depenbeek, Agoralaan, B-3590 Depenbeek, Belgum 1 and Unverstet Antwerpen (UA), IBW, Stadscampus, Venusstraat

More information

Lecture 21: Numerical methods for pricing American type derivatives

Lecture 21: Numerical methods for pricing American type derivatives Lecture 21: Numercal methods for prcng Amercan type dervatves Xaoguang Wang STAT 598W Aprl 10th, 2014 (STAT 598W) Lecture 21 1 / 26 Outlne 1 Fnte Dfference Method Explct Method Penalty Method (STAT 598W)

More information

Multigradient for Neural Networks for Equalizers 1

Multigradient for Neural Networks for Equalizers 1 Multgradent for Neural Netorks for Equalzers 1 Chulhee ee, Jnook Go and Heeyoung Km Department of Electrcal and Electronc Engneerng Yonse Unversty 134 Shnchon-Dong, Seodaemun-Ku, Seoul 1-749, Korea ABSTRACT

More information

Durban Watson for Testing the Lack-of-Fit of Polynomial Regression Models without Replications

Durban Watson for Testing the Lack-of-Fit of Polynomial Regression Models without Replications Durban Watson for Testng the Lack-of-Ft of Polynomal Regresson Models wthout Replcatons Ruba A. Alyaf, Maha A. Omar, Abdullah A. Al-Shha ralyaf@ksu.edu.sa, maomar@ksu.edu.sa, aalshha@ksu.edu.sa Department

More information

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography CSc 6974 and ECSE 6966 Math. Tech. for Vson, Graphcs and Robotcs Lecture 21, Aprl 17, 2006 Estmatng A Plane Homography Overvew We contnue wth a dscusson of the major ssues, usng estmaton of plane projectve

More information

Singular Value Decomposition: Theory and Applications

Singular Value Decomposition: Theory and Applications Sngular Value Decomposton: Theory and Applcatons Danel Khashab Sprng 2015 Last Update: March 2, 2015 1 Introducton A = UDV where columns of U and V are orthonormal and matrx D s dagonal wth postve real

More information

A Hybrid Variational Iteration Method for Blasius Equation

A Hybrid Variational Iteration Method for Blasius Equation Avalable at http://pvamu.edu/aam Appl. Appl. Math. ISSN: 1932-9466 Vol. 10, Issue 1 (June 2015), pp. 223-229 Applcatons and Appled Mathematcs: An Internatonal Journal (AAM) A Hybrd Varatonal Iteraton Method

More information

Eigenvalues of Random Graphs

Eigenvalues of Random Graphs Spectral Graph Theory Lecture 2 Egenvalues of Random Graphs Danel A. Spelman November 4, 202 2. Introducton In ths lecture, we consder a random graph on n vertces n whch each edge s chosen to be n the

More information

Some modelling aspects for the Matlab implementation of MMA

Some modelling aspects for the Matlab implementation of MMA Some modellng aspects for the Matlab mplementaton of MMA Krster Svanberg krlle@math.kth.se Optmzaton and Systems Theory Department of Mathematcs KTH, SE 10044 Stockholm September 2004 1. Consdered optmzaton

More information

Boostrapaggregating (Bagging)

Boostrapaggregating (Bagging) Boostrapaggregatng (Baggng) An ensemble meta-algorthm desgned to mprove the stablty and accuracy of machne learnng algorthms Can be used n both regresson and classfcaton Reduces varance and helps to avod

More information

Joint Source-Channel Coding for the MIMO Broadcast Channel

Joint Source-Channel Coding for the MIMO Broadcast Channel Jont Source-Channel Codng for the MIMO Broadcast Channel Danel Persson, Johannes Kron, Mkael Skoglund and Erk G. Larsson Lnköpng Unversty Post Prnt N.B.: When ctng ths work, cte the orgnal artcle. 2012

More information

Chapter 11: Simple Linear Regression and Correlation

Chapter 11: Simple Linear Regression and Correlation Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests

More information

Linear dispersion code with an orthogonal row structure for simplifying sphere decoding

Linear dispersion code with an orthogonal row structure for simplifying sphere decoding tle Lnear dsperson code wth an orthogonal row structure for smplfyng sphere decodng Author(s) Da XG; Cheung SW; Yuk I Ctaton he 0th IEEE Internatonal Symposum On Personal Indoor and Moble Rado Communcatons

More information

j) = 1 (note sigma notation) ii. Continuous random variable (e.g. Normal distribution) 1. density function: f ( x) 0 and f ( x) dx = 1

j) = 1 (note sigma notation) ii. Continuous random variable (e.g. Normal distribution) 1. density function: f ( x) 0 and f ( x) dx = 1 Random varables Measure of central tendences and varablty (means and varances) Jont densty functons and ndependence Measures of assocaton (covarance and correlaton) Interestng result Condtonal dstrbutons

More information

Unified Subspace Analysis for Face Recognition

Unified Subspace Analysis for Face Recognition Unfed Subspace Analyss for Face Recognton Xaogang Wang and Xaoou Tang Department of Informaton Engneerng The Chnese Unversty of Hong Kong Shatn, Hong Kong {xgwang, xtang}@e.cuhk.edu.hk Abstract PCA, LDA

More information

Hongyi Miao, College of Science, Nanjing Forestry University, Nanjing ,China. (Received 20 June 2013, accepted 11 March 2014) I)ϕ (k)

Hongyi Miao, College of Science, Nanjing Forestry University, Nanjing ,China. (Received 20 June 2013, accepted 11 March 2014) I)ϕ (k) ISSN 1749-3889 (prnt), 1749-3897 (onlne) Internatonal Journal of Nonlnear Scence Vol.17(2014) No.2,pp.188-192 Modfed Block Jacob-Davdson Method for Solvng Large Sparse Egenproblems Hongy Mao, College of

More information

Entropy Coding. A complete entropy codec, which is an encoder/decoder. pair, consists of the process of encoding or

Entropy Coding. A complete entropy codec, which is an encoder/decoder. pair, consists of the process of encoding or Sgnal Compresson Sgnal Compresson Entropy Codng Entropy codng s also known as zero-error codng, data compresson or lossless compresson. Entropy codng s wdely used n vrtually all popular nternatonal multmeda

More information

The Concept of Beamforming

The Concept of Beamforming ELG513 Smart Antennas S.Loyka he Concept of Beamformng Generc representaton of the array output sgnal, 1 where w y N 1 * = 1 = w x = w x (4.1) complex weghts, control the array pattern; y and x - narrowband

More information

Consider the following passband digital communication system model. c t. modulator. t r a n s m i t t e r. signal decoder.

Consider the following passband digital communication system model. c t. modulator. t r a n s m i t t e r. signal decoder. PASSBAND DIGITAL MODULATION TECHNIQUES Consder the followng passband dgtal communcaton system model. cos( ω + φ ) c t message source m sgnal encoder s modulator s () t communcaton xt () channel t r a n

More information

The Gaussian classifier. Nuno Vasconcelos ECE Department, UCSD

The Gaussian classifier. Nuno Vasconcelos ECE Department, UCSD he Gaussan classfer Nuno Vasconcelos ECE Department, UCSD Bayesan decson theory recall that we have state of the world X observatons g decson functon L[g,y] loss of predctng y wth g Bayes decson rule s

More information

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix Lectures - Week 4 Matrx norms, Condtonng, Vector Spaces, Lnear Independence, Spannng sets and Bass, Null space and Range of a Matrx Matrx Norms Now we turn to assocatng a number to each matrx. We could

More information

High resolution entropy stable scheme for shallow water equations

High resolution entropy stable scheme for shallow water equations Internatonal Symposum on Computers & Informatcs (ISCI 05) Hgh resoluton entropy stable scheme for shallow water equatons Xaohan Cheng,a, Yufeng Ne,b, Department of Appled Mathematcs, Northwestern Polytechncal

More information

Quantum and Classical Information Theory with Disentropy

Quantum and Classical Information Theory with Disentropy Quantum and Classcal Informaton Theory wth Dsentropy R V Ramos rubensramos@ufcbr Lab of Quantum Informaton Technology, Department of Telenformatc Engneerng Federal Unversty of Ceara - DETI/UFC, CP 6007

More information

CS : Algorithms and Uncertainty Lecture 17 Date: October 26, 2016

CS : Algorithms and Uncertainty Lecture 17 Date: October 26, 2016 CS 29-128: Algorthms and Uncertanty Lecture 17 Date: October 26, 2016 Instructor: Nkhl Bansal Scrbe: Mchael Denns 1 Introducton In ths lecture we wll be lookng nto the secretary problem, and an nterestng

More information