Joint Source-Channel Coding for the MIMO Broadcast Channel

Size: px
Start display at page:

Download "Joint Source-Channel Coding for the MIMO Broadcast Channel"

Transcription

1 Jont Source-Channel Codng for the MIMO Broadcast Channel Danel Persson, Johannes Kron, Mkael Skoglund and Erk G. Larsson Lnköpng Unversty Post Prnt N.B.: When ctng ths work, cte the orgnal artcle IEEE. Personal use of ths materal s permtted. However, permsson to reprnt/republsh ths materal for advertsng or promotonal purposes or for creatng new collectve works for resale or redstrbuton to servers or lsts, or to reuse any copyrghted component of ths work n other works must be obtaned from the IEEE. Danel Persson, Johannes Kron, Mkael Skoglund and Erk G. Larsson, Jont Source-Channel Codng for the MIMO Broadcast Channel, 2012, accepted IEEE Transactons on Sgnal Processng. Postprnt avalable at: Lnköpng Unversty Electronc Press

2 Manuscrpt for IEEE Transactons on Sgnal Processng, (Correspondence Item) Jont Source-Channel Codng for the MIMO Broadcast Channel Danel Persson *, Johannes Kron, Mkael Skoglund, and Erk G. Larsson Malng address: Danel Persson, Erk G. Larsson, Department of Electrcal Engneerng, Lnköpng Unversty, SE Lnköpng, Sweden Emal: Phone: , Fax: Malng address: Johannes Kron, Mkael Skoglund, School of Electrcal Engneerng, Royal Insttute of Technology, Osquldas väg 10, SE Stockholm, Sweden Emal: Phone: , Fax: * Correspondng author SOFTWARE: Ubuntu Lnux, TeX, BbTeX, Kle COPYRIGHT: Copyrght (c) 2011 IEEE. Personal use of ths materal s permtted. However, permsson to use ths materal for any other purposes must be obtaned from the IEEE by sendng a request to pubs-permssons@eee.org. Abstract: We nvestgate the problem of broadcastng analog sources to several users usng short codes, employng several antennas at both the transmtter and the recever, and channel-optmzed quantzaton. Our man objectve s to mnmze the sum mean square error dstorton. A jont mult-user encoder, as well as a structured encoder wth separate encoders for the dfferent users, are proposed. The frst encoder outperforms the latter, whch n turn offers large mprovements compared to state-of-the-art, over a wde range of channel sgnal-to-nose ratos. Our proposed methods handle bandwdth expanson,.e., usage of more channel than source dmensons, automatcally. We also derve a lower bound on the dstorton.

3 Jont Source-Channel Codng for the MIMO Broadcast Channel Danel Persson, Johannes Kron, Mkael Skoglund, and Erk G. Larsson Abstract We nvestgate the problem of broadcastng analog sources to several users usng short codes, employng several antennas at both the transmtter and the recever, and channel-optmzed quantzaton. Our man objectve s to mnmze the sum mean square error dstorton. A jont mult-user encoder, as well as a structured encoder wth separate encoders for the dfferent users, are proposed. The frst encoder outperforms the latter, whch n turn offers large mprovements compared to state-of-the-art, over a wde range of channel sgnal-to-nose ratos. Our proposed methods handle bandwdth expanson,.e., usage of more channel than source dmensons, automatcally. We also derve a lower bound on the dstorton. Index Terms Short codes, multple-nput multple-output (MIMO), mult-user, broadcast, downlnk, jont sourcechannel codng (JSCC), low latency. I. INTRODUCTION We study the multple-nput multple-output (MIMO) broadcast problem wth short codes, wth the end-to-end sum mean square error (MSE) dstorton as performance measure. Ths nvestgaton can be motvated by low-latency applcatons, where long codes are not sutable. Our study s both of fundamental nterest, and relevant for applcatons. D. Persson and E. G. Larsson are wth the Department of Electrcal Engneerng, Lnköpng Unversty, SE Lnköpng, Sweden (e-mal: danelp@sy.lu.se; egl@sy.lu.se). J. Kron and M. Skoglund are wth the School of Electrcal Engneerng, Royal Insttute of Technology, Osquldas väg 10, SE Stockholm, Sweden (e-mal: johk@ee.kth.se; skoglund@ee.kth.se). Ths work has been supported n part by the Swedsh Research Councl (VR) and the Swedsh Foundaton for Strategc Research (SSF). E.G. Larsson s a Royal Swedsh Academy of Scences (KVA) Research Fellow supported by a grant from the Knut and Alce Wallenberg Foundaton.

4 2 A. Background MIMO technology mproves both capacty and robustness n tradtonal communcatons [1]. Recently, Wengarten et al. [2] found the capacty regon for the MIMO broadcast channel, and t was establshed that drty-paper codng (DPC) s optmal n the sense that technques based on DPC can acheve any rate-tuple n ths regon. However, DPC reles on nfntely long codewords, and s therefore not sutable for a low-delay scenaro. In a scenaro wth short codes, the source-channel separaton theorem n general does not apply, and the optmal soluton conssts of jont optmzaton of the source and the channel code. Tradtonal dgtal communcaton systems consst of several separate unts: quantzer, channel encoder, precoder, and modulator. Jont source-channel codng (JSCC) strateges, where these unts are co-desgned, should be consdered for the case of short codes. Many treatments of JSCC exst, e.g., characterzaton of the dstorton regons for the problems of sendng a bvarate Gaussan source over bandwdth-matched Gaussan broadcast channels [3] and multple-access channels [4], nformaton-theoretc analyss of separaton of source and channel codng over several multuser channels [5], transmsson over non-ergodc channels based on nstantaneous capacty-achevng codes [6], dstorton-exponents-based analyss for hgh channel sgnal-to-nose rato (CSNR) [7], lnear source-channel mappngs for the broadcast channel [8], and other parametrc mappngs for Gaussan multple-access relay channels [9]. Channel-optmzed quantzaton s a way to perform JSCC, that does not depend on the assumptons of nstantaneous capacty-achevng codes, hgh CSNR approxmatons, and lnear and other mappng parametrzatons. Ths s a tandem approach where channel code usage and modulaton format are frst decded, and where the quantzer, and the mappng of quantzer ndexes to channel codewords, are optmzed n a second step dependng on the channel transton probabltes determned after the frst step. The algorthm n [10] determnes channel-optmzed vector quantzer reconstructon vectors and encodng regons, for sngle-user communcatons. Ths algorthm can be seen as an extenson to nosy channels of the generalzed Lloyd algorthm (GLA) [11]. A beneft of the algorthm n [10] s that t chooses the tradeoff between quantzaton dstorton and channel-nduced dstorton automatcally, and t can thus be seen as an adaptve quantzaton and channel codng scheme. Numerous extensons of the scheme n [10] have been found. Some recent developments are, e.g., the study of mappngs of a scalar source to several channel dmensons,.e., bandwdth expanson [12], channel-optmzed source mappngs for the relay channel [13], and channel-optmzed quantzaton for

5 3 sources wth memory [14], [15]. Some of these schemes were ntended for tradtonal dgtal communcatons [12], [14], [15], whle [13] focuses on analog communcaton. Ths s however only a matter of presentaton of the works, and all schemes based on [10] are vald for both dgtal and analog domanbased communcatons. More modulaton ponts result n a lower source reconstructon dstorton, but also a hgher computatonal complexty. B. Our scope and contrbuton In contrast to the channel-optmzed quantzaton approaches stemmng from [10] and descrbed n Sec. I-A, we study channel-optmzed quantzaton for nterferng mult-user channels n ths paper. More precsely, we nvestgate the MIMO broadcast scenaro, where dfferent streams are smultaneously sent to dfferent users, and where all streams nterfere at each user. The employed codes are short, and we utlze several antennas at both the transmtter and the recever sdes. Our man objectve s to mnmze the sum end-to-end dstorton. Our JSCC schemes employ the vector perturbaton precoder (VPP) scheme [16] as a buldng block. The basc dea of VPP s to reduce power consumpton through expandng the orgnal sgnalng constellaton. VPP has been documented to reduce the error probablty sgnfcantly compared to lnear methods and scalar Tomlnson-Harashma precodng [17], see [16]. However, our proposed JSCC schemes can deal wth MIMO nterference by proper modelng of the transton probabltes between codewords, for any precoder, modulaton, and detector scheme. Our proposed methods handle bandwdth expanson,.e., usage of more channel than source dmensons, automatcally. Our man contrbutons are: We propose a jont mult-user encoder whch outperforms the methods of comparson. Ths encoder has exponental complexty n the number of users. A transmtter wth separate encoders for the dfferent users, and lnear complexty n the number of users, s developed. Despte beng based on the separate user approxmaton, ths encoder lowers dstorton sgnfcantly compared to state-of-the-art. In our experments we further note that the proposed JSCC approach contrbutes more to lowerng the dstorton than the VPP approach. We derve a lower bound on the dstorton. II. MIMO BROADCAST TRANSMISSION WITH SHORT CODES In ths secton, we present two new optmzed low-latency codng strateges for communcaton over a MIMO broadcast channel, as well as a dervaton of a lower bound on the dstorton. Real-valued

6 4 H 1 u 1 τˆl 1 y 1 τl B ỹ 1 β 1 ˆx 1 x 1 α 1 x α y 2 ỹ 2 β 2 ˆx 2 x 2 α1 H 2 u 2 (a) τˆl 2 (b) Fg. 1. In (a), the proposed JSCC system s pctured. In (b), the proposed smplfed encoder n Sec. II-B s shown. sgnalng per antenna s consdered n ths paper for smplcty. However, complex-valued sgnalng can be represented n ths format, by approprately treatng a complex number as a vector of two real numbers. Our goal s to mnmze the sum end-to-end MSE dstorton. We assume perfect channel state nformaton (CSI) at the transmtter and at the recevers. For each channel realzaton, a new coder has to be desgned. In order to keep the notaton smple, we consder two users, see Fg. 1(a). It s conceptually straghtforward to generalze the developments to any number of termnals, though no fundamental aspects are added by such an extenson. The source varables x 1 R and x 2 R are ndependent and dentcally dstrbuted (..d.) zeromean Gaussan wth unt varance (a non-zero mean s handled by smply removng the mean at the transmtter and addng t back at the recever), and wll be delvered to users 1 and 2 respectvely. We defne x = [x 1,x 2 ] T. User s channel conssts of a mxng matrx H R NR NT, and addtve nose u R NR whose components are..d. Gaussan wth zero mean and unt varance, for = 1,2, where N T s the total number of transmt antennas, and N R s the number of receve antennas per user. We also wrte H = [H T 1 HT 2 ]T and u = [u T 1 ut 2 ]T. We defne our analog communcaton system as follows. We use VPP [16] wth the precodng matrx B = [B 1 B 2 ], where B R NT NR, for = 1,2. Followng the orgnal development n [16], we constran B to beng of regularzed nverse-type B = H T (HH T + η NT P I) 1, where P s the mean total transmt power per realzaton of x, and η [0, ). The encoder mappng s α(x) : R 2 R 2NR Ω 2NR, where Ω 2NR s a 2N R -dmensonal cube wth sde less than τ, centered at orgo. The perturbaton vectors are τl(α), wth l(α) L, and L = {l : l k { L, L + 1,...,L} for k = 1,...,2N R }, obtaned by calculatng l (α) = argmn B(α(x) + τl ) 2. Fnally, we wrte the receved sgnals as l L y = HB(α(x)+τl(α))+u, where y = [y T 1 yt 2 ]T, and y R NR, for = 1,2. Estmatesˆl 1 = [ˆl 1,...,ˆl NR ] T of the elements l 1,...,l NR are retreved and subtracted at user 1 s decoder,

7 5 and estmates ˆl 2 = [ˆl NR+1,...,ˆl 2NR ] T of the elements l NR+1,...,l 2NR are retreved and subtracted at user 2 s decoder. The standard estmates [16] are y + (HB) k,kτ 2 ˆl k =, k = 1,...,2N R, (1) (HB) k,k τ where s the floorng operaton. The decoder mappngs are β (y ) : R NR Ω NR R, for = 1,2. Transmttng x 1 over H 1 B 1 s motvated by B beng of regularzed nverse-type, so that H 1 B 1 contans more energy than H 1 B 2 (ths reasonng s smlar for x 2 ). It s dffcult to optmze B and τ n order to mnmze the sum end-to-end dstorton, and smple closed form expressons for B and τ may not exst. We defer a more detaled dscusson on how we set B, τ, and L to Sec. III-A. We further assume a mean power constrant E x [ B(α(x)+τl(α)) 2 ] P, (2) whch s fulflled by assumng α to be unformly dstrbuted over Ω 2NR, and adjustng the sze of Ω 2NR, pror to optmzng the mappngs α(x), β 1 (y 1 ), and β 2 (y 2 ). The rest of ths secton wll be dedcated to the desgn of optmzed source-channel mappngs α(x), β 1 (y 1 ), and β 2 (y 2 ), gven ths channel-codng scheme. We defne a cost functon We thus want to solve J(α(x),β 1 (y 1 ),β 2 (y 2 )) [ ] 1 2 = E x,u1,u 2 (x β (y 2 )) 2 (3) =1 [ ] 1 2 = E x,y1,y 2 (x β (y 2 )) 2. (4) =1 {α (x), β 1 (y 1), β 2 (y 2)} = arg mn J(α(x),β 1 (y 1 ),β 2 (y 2 )). (5) {α(x), β 1(y 1 ), β 2(y 2 )} Throughout our treatment, we wll contnue to use ( ) to denote optmal mappngs. The optmzaton problem n (5) s very complcated. More precsely, the optmal mappngs could be general non-lnear mappngs wth no closed-form soluton, and t s dffcult to acheve both the encoder and the decoders smultaneously. We therefore employ a sub-optmal strategy, namely, we ntroduce a dscretzaton of the

8 6 channel space, and solve teratvely for the optmal encoders gven the decoders, and for the optmal decoders gven the encoders, n Sec. II-A and II-B. We frst dscretzeω 2NR wthm ponts along each dmensons = {( m M 1 2 and restrct α(x) : R 2 S 2NR. Moreover, y s least squares-decoded to yeld ỹ ), m = 0,...,M 1 }, ỹ = argmn y H B (s+τˆl ) 2, = 1,2. (6) s S N R The decoder (6) s a maxmum lkelhood (ML) decoder n the lmt where the non-gaussan MIMO nterference s weak, and where τ s bg enough compared to the sze of S and the nose power, so that l s seldom ms-detected. The standard tandem approach from [16] that we have appled here, where ˆl s frst estmated by (1), and where ỹ s subsequently obtaned by (6), could be replaced by a jont estmaton of ˆl and ỹ, for = 1,2. The decoder mappngs β now operate on ỹ, β (ỹ ) : S NR R for = 1,2. As long as 2 s small compared to the nose varance, and M s bg enough so that S 2NR spans over the whole volume of Ω 2NR, the dscretzaton s a good approxmaton [13]. We descrbe how to choose n Sec. III-A n order to meet the mean power constrant (2). We now rewrte (5) as {α (x), β 1(ỹ 1 ), β 2(ỹ 2 )} = arg mn J(α(x),β 1 (ỹ 1 ),β 2 (ỹ 2 )). (7) {α(x), β 1(ỹ 1 ), β 2(ỹ 2 )} We note that whle the state-of-the-art VPP detector wth (1) and (6) s sub-optmal, the optmzaton problem (7) takes transtons probabltes between codewords, whch ncorporate the MIMO nterference, as well as artfacts from the channel decodng by means of (1) and (6), nto consderaton. We can vew our dscretzaton approach as a dgtal communcaton system. As already stated n the dscusson followng (5), wth the dscretzaton n (7), t s stll dffcult to obtan both the encoder and the decoders smultaneously. Therefore, we further ntroduce two suboptmal strateges. In Sec. II-A, we present a jont consderaton of the two users at the encoder, and no other approxmatons than the teratve Lloyd approach that conssts of encoder optmzaton for a gven decoder, and decoder optmzaton for a gven encoder. In Sec. II-B, we further approxmate by separatng the jont mult-user encoder from Sec. II-A nto ndvdual encoders for the users n order to lower the computatonal complexty.

9 7 A. Jont mult-user encoder Channel transton probabltes between transmt and receve constellaton ponts are frst determned by means of Monte Carlo smulaton, and the decoders are ntalzed by β (0) at teraton step 0, for = 1,2. Thereafter, at teraton step k, k = 1,...,K, the optmal encoder mappng α (k) for gven decoder mappngs β (k 1), and optmal decoder mappngs β (k) decded by means of α (k) (x) = argmn s S 2N R 2 =1 Eỹ s for gven encoder mappngs α (k), are [ ( ) ] x β (k 1) 2 (ỹ ), (8) β (k) (ỹ ) = E x ỹ [x ], = 1,2. (9) The update equatons (8) and (9) yeld lower dstorton at each teraton step k, k = 1,...,K. The teratve approach may however end up at a local mnmum, and does not necessarly solve (7). When solvng (9) n practce, the expectaton s substtuted by the emprcal mean. Encodng by means of (8) n the general mult-user case wth N U users requres on the order of N U M (NU+1)NR operatons. Snce ths number does not scale well wth N U, we wll propose a low-complexty method n the next secton. B. Separate encoders for the dfferent users We separate the problem (7) by constranng the source mappng α(x) to have two ndependent parts α(x) = [α T 1 (x 1) α T 2 (x 2)] T where α (x ) : R S NR for = 1,2, see Fg. 1(b). The receve mappngs are defned as before. Ideally, we would now lke to solve the problem {α 1 (x 1 ), α 2 (x 2 ), β 1(ỹ 1 ), β 2(ỹ 2 )} = arg mn {α 1(x 1), α 2(x 2), β 1(ỹ 1 ), β 2(ỹ 2 )} J([α T 1 (x 1) α T 2 (x 2)] T,β 1 (ỹ 1 ),β 2 (ỹ 2 )), (10) but agan, as wth (7), the global optmal soluton s hard to acheve. Instead, we solve (10) teratvely for the optmal encoders gven the decoders, and for the optmal decoders gven the encoders, by use of the equatons [ ( ) ] α (k) (x) = arg mn Eỹ s x β (k 1) 2 (ỹ ), (11) s S N R β (k) (ỹ ) = E x ỹ [x ], (12)

10 8 for =1,2, where (11) and (12) reduces dstorton at each teraton step k, for k = 1,...,K. Smlarly to the algorthm n Sec. II-A, the teratve approach may however end up n a local mnmum, and does not necessarly solve (10). For encodng by means of (11) n the general mult-user case wth N U users, the computatonal complexty ncreases as N U M 2NR, whch s lnear n N U nstead of exponental, cf. the encoder (8) n Sec. II-A. It should also be noted that both proposed encoders have an extra complexty term (2L + 1) NUNR stemmng from the VPP encodng, as well as a complexty contrbuton stemmng from the calculaton of transton probabltes, whch s exponental n the number of users. Dfferently from the encoder, whch s defned for an analog x, these terms are straghtforward to pre-process n slow fadng. C. A lower bound on the dstorton In order to obtan a lower bound on the dstorton, we employ the source-channel separaton theorem, calculate the maxmum sum-rate, and dstrbute ths rate among the sources n an optmal manner. 1 The concept of uplnk-downlnk dualty [20], [21] s employed, and the convex optmzaton problem R 1 = max S 1,S 2 4 log 2 I +HT S 1 0 H, 0 S 2 S 1, S 2 symmetrc and postve defnte, Tr(S 1 )+Tr(S 2 ) P, (13) s solved n order to fnd the maxmum rate R per user, n bts per channel use. Observng that the optmal rate allocaton to two..d. sources s equal, and that the maxmum rate that can be conveyed over the channel s 2R, we have the bound J 2 2R. Ths bound s not achevable n general, snce we are not able to dstrbute the rate n (13) equally to the two users. A related result, a characterzaton of the achevable dstorton regon for the problem of sendng two correlated scalar Gaussan sources over a bandwdth-matched Gaussan broadcast channel, was recently presented n [3]. 1 The source-channel separaton theorem does not hold when we have correlated sources. Ths s so because the nterference becomes lower when the correlaton between the sources ncreases [18, p. 71], [19, p. 448]. In our case, we have uncorrelated sources.

11 9 III. EXPERIMENTS A. Expermental prerequstes The experment parameters are chosen as follows, n order to supply relevant expermental settngs, and not favor any scheme: Proposed systems: Assumng that α s equdstrbuted over the constellaton ponts, the dstance between the constellaton ponts n one dmenson,, s adjusted by bsecton so that the mean energy of the VPP constellaton s P ±0.005P, cf. (2). As already dscussed n Sec. II, smple closed form expressons for B and τ that mnmze the sum end-to-end dstorton may not exst. The MMSE precodng matrx,.e., η = 1, was chosen for the experments presented n the fgures, cf. [22]. Wth ZF precodng,.e., η = 0, our proposed JSCC schemes n Sec. II-A and Sec. II-B performed the same snce there s no mult-user nterference, and they stll ncreased performance compared to the methods of comparson, though the MMSE precoder results were better. For smplcty, we chose τ by assumng that α s equdstrbuted over the constellaton ponts, that only α on the edges of the constellaton contrbutes to msdetecton of the perturbaton vector, and that the nterference s Gaussan and ndependent for each dmenson, ( ( ))) and we obtan τ = max 2σ (HB), Q 1 M 2 (1 (1 P Err ) 1 2N R + (M 1), where σ 2 = P 2NR 2N R j=1,j (HB)2,j +1. The error probablty assocated wth a msdetected perturbaton vector s set to be less than P Err = Prelmnary nvestgatons showed that ncreasng L beyond 1 dd not lower dstorton sgnfcantly. Channel transtons probabltes for use wth the channel-optmzed coders are calculated by means of Monte Carlo smulatons, takng MIMO nterference as well as artfacts from the channel decodng by means of (1) and (6), nto account. Monte Carlo smulatons are run wth vectors per possble realzaton of α for the case of N T = 2 and N R = 1; and wth 300 vectors per possble realzaton of α for the case of N T = 4 and N R = 2. Intal β 1 and β 2 are chosen by generatng decoder source codebooks wth GLA, and mappng these codewords to constellaton ponts ordered lexcographcally accordng to ther dmensons. For coder optmzaton wth (8) and (9), as well as wth (11) and (12), a tranng set that s dfferent from the evaluaton set and consstng of realzatons, s used. The number of teratons K = 15. In the experments wth a MIMO channel of dmenson N T = 2 and N R = 1, we use M = 32; and for the experments wth N T = 4 and N R = 2, we use M = 16. Source and channel evaluaton data: The elements of H are..d. Gaussan wth zero mean and

12 10 unt varance. We consder slow fadng channels. In partcular, H s constant for consecutve realzatons of x. Results are calculated as means over channel realzatons, whch are evaluated n the Monte-Carlo sense usng 90 realzatons of H. The channel sgnal-to-nose rato (CSNR) s defned as the mean transmtted power P dvded by the mean nose power. The code used for generatng the results can be found at [23]. B. Results The man purpose of Fg. 2(a) s to show a comparson between the proposed jont mult-user coder n Sec. II-A and the proposed low-complexty system wth separate coders for all users n Sec. II-B for L = 0 and L = 1. We use a MIMO channel wth N T = 2, and N R = 1. A lnear ZF-based analog,.e., quantzaton-free, coder wth MMSE recevers and ts theoretcal performance predcton, and the lower bound from Sec. II-C, are added as well for comparson. We see that the mult-user coder n Sec. II-A wth L = 1 outperforms the other coders, for a large range of CSNR values. We can also conclude that the mprovement gven by the mult-user coder n Sec. II-A compared to the system wth separate coders n Sec. II-B s bgger than the mprovement from usng VPP wth L = 1. The relatvely large gap to the lower bound s explaned by the nablty of the short codes to acheve capacty and rate-dstorton optmalty. The purpose of Fg. 2(b) s to show how the system wth separate coders for all users n Sec. II-B compares wth state-of-the-art systems n a scenaro wth more antennas, N T = 4, and N R = 2. A comparson s gven between the system n Sec. II-B for L = 0 and L = 1; a standard separate source-channel codng (SSCC) approach wth GLA-based vector quantzaton, largest mnmum Hammng dstance-optmal lnear block codes wth dfferent rates (the number of nformaton and channel bts are gven for each method n the fgure), Gray mappng of bts to symbols, VPP wth L = 1, and 16 constellaton ponts per real dmenson; analog ZF-precoder-based repetton codng wth MMSE recevers, and ts theoretcal performance predcton; as well as the lower bound from Sec. II-C. One should further note that the range of optmal separate codng schemes wth varyng block code length consttutes an adaptve codng scheme. The proposed low-complexty system wth separate coders for all users from Sec. II-B and L = 1 outperforms the separate codng approaches and the repetton coder, for a wde range of CSNR values. By comparng the proposed JSCC system wth L = 0 and the SSCC systems, we note that JSCC contrbutes more than VPP to mprovng the soluton.

13 11 Source reconstructon MSE per user 10 0 Analog ln. Analog ln., theory Sec. II-B, L = 0 Sec. II-B, L = 1 Sec. II-A, L = 0 Sec. II-A, L = Lower bound CSNR (db) Source reconstructon MSE per user 10 0 SSCC, (2,8) SSCC, (4,8) SSCC, (6,8) SSCC, (8,8) Analog rep. Analog rep., theory Sec. II-B, L = 0 Sec. II-B, L = 1 Lower bound CSNR (db) (a) N T = 2, and N R = 1. (b) N T = 4, and N R = 2. Fg. 2. Comparsons between proposed schemes n Sec. II-A, Sec. II-B, and other methods, for dfferent channel sgnal-to-nose ratos (CSNR). Detals of the compared methods are gven n the man text. The repetton coder does not use a quantzer, and thus, t beats all other methods at extremely hgh CSNR. At extremely hgh CSNR, the separate source and channel coder system wthout a block-code, and the JSCC system wth L = 0, perform as well as the JSCC system wth L = 1. Ths should be so, snce only the source encoder matters, and our proposed scheme becomes the tradtonal GLA algorthm, n ths regme. We observe that the measured CSNR may devate from the target CSNR related to P. The reason for ths s that some transmt constellaton ponts are chosen more often than others. Ths practcal ssue could be taken care of by feedng a modfed mean energy target to the -optmzaton. IV. CONCLUSION We have studed source transmsson over the MIMO broadcast channel, usng short codes and wth end-to-end sum-mse as the performance measure. Two channel-optmzed quantzaton-type systems, one wth a jont mult-user encoder, and one wth separate encoders for the dfferent users, were proposed. The frst encoder, whch has exponental computatonal complexty n the number of users, outperforms the latter, whch has lnear computatonal complexty n the number of users. The latter encoder n turn has been shown to outperform state-of-the-art. REFERENCES [1] D. Tse and P. Vswanath, Fundamentals of Wreless Communcaton. Cambrdge, U.K.: Cambrdge Unv. Press, 2005.

14 12 [2] H. Wengarten, Y. Stenberg, and S. Shama, The capacty regon of the Gaussan multple-nput multple-output broadcast channel, IEEE Trans. Inform. Theory, vol. 52, no. 9, pp , Sep [3] C. Tan, S. Dggav, and S. Shama, The achevable dstorton regon of bvarate Gaussan source on Gaussan broadcast channel, n Proc. IEEE Int. Symp. Inform. Theory, Jun. 2010, pp [4] A. Lapdoth and S. Tnguely, Sendng a bvarate Gaussan over a Gaussan MAC, IEEE Trans. Inform. Theory, vol. 56, no. 6, pp , Jun [5] D. Gündüz, E. Erkp, A. Goldsmth, and H. Poor, Source and channel codng for correlated sources over multuser channels, IEEE Trans. Inform. Theory, vol. 55, no. 9, pp , Sep [6] C. T. K. Ng, D. Gündüz, A. J. Goldsmth, and E. Erkp, Mnmum expected dstorton n Gaussan layered broadcast codng wth successve refnement, n Proc. IEEE Int. Symp. Inform. Theory, Jun. 2007, pp [7] D. Gündüz and E. Erkp, Jont source-channel codes for MIMO block-fadng channels, IEEE Trans. Inform. Theory, vol. 54, no. 1, pp , Jan [8] J. Kron, D. Persson, M. Skoglund, and E. Larsson, Closed-form sum-mse mnmzaton for the two-user Gaussan MIMO broadcast channel, IEEE Commun. Letters, vol. 15, no. 9, pp , Sep [9] S. Yao and M. Skoglund, Analog network codng mappngs n Gaussan multple-access relay channels, IEEE Trans. Commun., vol. 58, no. 7, pp , Jul [10] N. Farvardn, A study of vector quantzaton for nosy channels, IEEE Trans. Inform. Theory, vol. 36, no. 4, pp , Jul [11] Y. Lnde, A. Buzo, and R. Gray, An algorthm for vector quantzer desgn, IEEE Trans. Commun., vol. 28, no. 1, pp , Jan [12] P. Floor, T. Ramstad, and N. Wernersson, Power constraned channel optmzed vector quantzers used for bandwdth expanson, n IEEE Int. Symp. on Wreless Communcaton Systems, 2007, pp [13] J. Karlsson and M. Skoglund, Optmzed low-delay source-channel-relay mappngs, IEEE Trans. Commun., vol. 58, no. 5, pp , May [14] D. Persson and T. Erksson, Power seres quantzaton for nosy channels, IEEE Trans. Commun., vol. 58, no. 5, pp , May [15], On multple descrpton codng of sources wth memory, vol. 58, no. 8, pp , Aug [16] B. Hochwald, C. Peel, and A. Swndlehurst, A vector-perturbaton technque for near-capacty multantenna multuser communcaton-part II: perturbaton, IEEE Trans. Commun., vol. 53, no. 3, pp , Mar [17] C. Wndpassnger, R. Fscher, T. Vencel, and J. Huber, Precodng n multantenna and multuser communcatons, IEEE Trans. Wreless Commun., vol. 3, no. 4, pp , Jul [18] T. Berger, Rate-Dstorton Theory. Englewood Clffs, NJ: Prentce-Hall, [19] T. Cover and J. Thomas, Elements of nformaton theory. New York, NY: John Wley & Sons, [20] S. Vshwanath, N. Jndal, and A. Goldsmth, Dualty, achevable rates, and sum-rate capacty of Gaussan MIMO broadcast channels, IEEE Trans. Inform. Theory, vol. 49, no. 10, pp , Oct [21] W. Yu, Sum-capacty computaton for the Gaussan vector broadcast channel va dual decomposton, IEEE Trans. Inform. Theory, vol. 52, no. 2, pp , Feb [22] C. Peel, B. Hochwald, and A. Swndlehurst, A vector-perturbaton technque for near-capacty multantenna multuser communcaton-part I: channel nverson and regularzaton, IEEE Trans. Commun., vol. 53, no. 1, pp , Jan

15 13 [23] Code repostory, Dvson of Communcaton Systems, Lnköpng Unversty. [Onlne]. Avalable: sy.lu.se/en/publcatons

VQ widely used in coding speech, image, and video

VQ widely used in coding speech, image, and video at Scalar quantzers are specal cases of vector quantzers (VQ): they are constraned to look at one sample at a tme (memoryless) VQ does not have such constrant better RD perfomance expected Source codng

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

ECE559VV Project Report

ECE559VV Project Report ECE559VV Project Report (Supplementary Notes Loc Xuan Bu I. MAX SUM-RATE SCHEDULING: THE UPLINK CASE We have seen (n the presentaton that, for downlnk (broadcast channels, the strategy maxmzng the sum-rate

More information

x = x 1 + :::+ x K and the nput covarance matrces are of the form ± = E[x x y ]. 3.2 Dualty Next, we ntroduce the concept of dualty wth the followng t

x = x 1 + :::+ x K and the nput covarance matrces are of the form ± = E[x x y ]. 3.2 Dualty Next, we ntroduce the concept of dualty wth the followng t Sum Power Iteratve Water-fllng for Mult-Antenna Gaussan Broadcast Channels N. Jndal, S. Jafar, S. Vshwanath and A. Goldsmth Dept. of Electrcal Engg. Stanford Unversty, CA, 94305 emal: njndal,syed,srram,andrea@wsl.stanford.edu

More information

Lossy Compression. Compromise accuracy of reconstruction for increased compression.

Lossy Compression. Compromise accuracy of reconstruction for increased compression. Lossy Compresson Compromse accuracy of reconstructon for ncreased compresson. The reconstructon s usually vsbly ndstngushable from the orgnal mage. Typcally, one can get up to 0:1 compresson wth almost

More information

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons

More information

Power Allocation for Distributed BLUE Estimation with Full and Limited Feedback of CSI

Power Allocation for Distributed BLUE Estimation with Full and Limited Feedback of CSI Power Allocaton for Dstrbuted BLUE Estmaton wth Full and Lmted Feedback of CSI Mohammad Fanae, Matthew C. Valent, and Natala A. Schmd Lane Department of Computer Scence and Electrcal Engneerng West Vrgna

More information

Lecture 3: Shannon s Theorem

Lecture 3: Shannon s Theorem CSE 533: Error-Correctng Codes (Autumn 006 Lecture 3: Shannon s Theorem October 9, 006 Lecturer: Venkatesan Guruswam Scrbe: Wdad Machmouch 1 Communcaton Model The communcaton model we are usng conssts

More information

The Geometry of Logit and Probit

The Geometry of Logit and Probit The Geometry of Logt and Probt Ths short note s meant as a supplement to Chapters and 3 of Spatal Models of Parlamentary Votng and the notaton and reference to fgures n the text below s to those two chapters.

More information

Error Probability for M Signals

Error Probability for M Signals Chapter 3 rror Probablty for M Sgnals In ths chapter we dscuss the error probablty n decdng whch of M sgnals was transmtted over an arbtrary channel. We assume the sgnals are represented by a set of orthonormal

More information

Power Allocation/Beamforming for DF MIMO Two-Way Relaying: Relay and Network Optimization

Power Allocation/Beamforming for DF MIMO Two-Way Relaying: Relay and Network Optimization Power Allocaton/Beamformng for DF MIMO Two-Way Relayng: Relay and Network Optmzaton Je Gao, Janshu Zhang, Sergy A. Vorobyov, Ha Jang, and Martn Haardt Dept. of Electrcal & Computer Engneerng, Unversty

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton

More information

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS Avalable onlne at http://sck.org J. Math. Comput. Sc. 3 (3), No., 6-3 ISSN: 97-537 COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

More information

Low Complexity Soft-Input Soft-Output Hamming Decoder

Low Complexity Soft-Input Soft-Output Hamming Decoder Low Complexty Soft-Input Soft-Output Hammng Der Benjamn Müller, Martn Holters, Udo Zölzer Helmut Schmdt Unversty Unversty of the Federal Armed Forces Department of Sgnal Processng and Communcatons Holstenhofweg

More information

Consider the following passband digital communication system model. c t. modulator. t r a n s m i t t e r. signal decoder.

Consider the following passband digital communication system model. c t. modulator. t r a n s m i t t e r. signal decoder. PASSBAND DIGITAL MODULATION TECHNIQUES Consder the followng passband dgtal communcaton system model. cos( ω + φ ) c t message source m sgnal encoder s modulator s () t communcaton xt () channel t r a n

More information

Problem Set 9 Solutions

Problem Set 9 Solutions Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem

More information

Chapter 7 Channel Capacity and Coding

Chapter 7 Channel Capacity and Coding Wreless Informaton Transmsson System Lab. Chapter 7 Channel Capacty and Codng Insttute of Communcatons Engneerng atonal Sun Yat-sen Unversty Contents 7. Channel models and channel capacty 7.. Channel models

More information

Application of Nonbinary LDPC Codes for Communication over Fading Channels Using Higher Order Modulations

Application of Nonbinary LDPC Codes for Communication over Fading Channels Using Higher Order Modulations Applcaton of Nonbnary LDPC Codes for Communcaton over Fadng Channels Usng Hgher Order Modulatons Rong-Hu Peng and Rong-Rong Chen Department of Electrcal and Computer Engneerng Unversty of Utah Ths work

More information

P R. Lecture 4. Theory and Applications of Pattern Recognition. Dept. of Electrical and Computer Engineering /

P R. Lecture 4. Theory and Applications of Pattern Recognition. Dept. of Electrical and Computer Engineering / Theory and Applcatons of Pattern Recognton 003, Rob Polkar, Rowan Unversty, Glassboro, NJ Lecture 4 Bayes Classfcaton Rule Dept. of Electrcal and Computer Engneerng 0909.40.0 / 0909.504.04 Theory & Applcatons

More information

Memory ecient adaptation of vector quantizers to time-varying channels

Memory ecient adaptation of vector quantizers to time-varying channels Sgnal Processng 83 (3) 59 58 www.elsever.com/locate/sgpro Memory ecent adaptaton of vector quantzers to tme-varyng channels orbert Gortz a;,jorg Klewer b a Insttute for Communcatons Engneerng (LT), Munch

More information

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4) I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes

More information

Composite Hypotheses testing

Composite Hypotheses testing Composte ypotheses testng In many hypothess testng problems there are many possble dstrbutons that can occur under each of the hypotheses. The output of the source s a set of parameters (ponts n a parameter

More information

Pulse Coded Modulation

Pulse Coded Modulation Pulse Coded Modulaton PCM (Pulse Coded Modulaton) s a voce codng technque defned by the ITU-T G.711 standard and t s used n dgtal telephony to encode the voce sgnal. The frst step n the analog to dgtal

More information

Generalized Linear Methods

Generalized Linear Methods Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set

More information

Antenna Combining for the MIMO Downlink Channel

Antenna Combining for the MIMO Downlink Channel Antenna Combnng for the IO Downlnk Channel arxv:0704.308v [cs.it] 0 Apr 2007 Nhar Jndal Department of Electrcal and Computer Engneerng Unversty of nnesota nneapols, N 55455, USA Emal: nhar@umn.edu Abstract

More information

Singular Value Decomposition: Theory and Applications

Singular Value Decomposition: Theory and Applications Sngular Value Decomposton: Theory and Applcatons Danel Khashab Sprng 2015 Last Update: March 2, 2015 1 Introducton A = UDV where columns of U and V are orthonormal and matrx D s dagonal wth postve real

More information

Linear Approximation with Regularization and Moving Least Squares

Linear Approximation with Regularization and Moving Least Squares Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...

More information

Chapter 7 Channel Capacity and Coding

Chapter 7 Channel Capacity and Coding Chapter 7 Channel Capacty and Codng Contents 7. Channel models and channel capacty 7.. Channel models Bnary symmetrc channel Dscrete memoryless channels Dscrete-nput, contnuous-output channel Waveform

More information

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud Resource Allocaton wth a Budget Constrant for Computng Independent Tasks n the Cloud Wemng Sh and Bo Hong School of Electrcal and Computer Engneerng Georga Insttute of Technology, USA 2nd IEEE Internatonal

More information

MAXIMUM A POSTERIORI TRANSDUCTION

MAXIMUM A POSTERIORI TRANSDUCTION MAXIMUM A POSTERIORI TRANSDUCTION LI-WEI WANG, JU-FU FENG School of Mathematcal Scences, Peng Unversty, Bejng, 0087, Chna Center for Informaton Scences, Peng Unversty, Bejng, 0087, Chna E-MIAL: {wanglw,

More information

Lecture 10 Support Vector Machines II

Lecture 10 Support Vector Machines II Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed

More information

On balancing multiple video streams with distributed QoS control in mobile communications

On balancing multiple video streams with distributed QoS control in mobile communications On balancng multple vdeo streams wth dstrbuted QoS control n moble communcatons Arjen van der Schaaf, José Angel Lso Arellano, and R. (Inald) L. Lagendjk TU Delft, Mekelweg 4, 68 CD Delft, The Netherlands

More information

Time-Varying Systems and Computations Lecture 6

Time-Varying Systems and Computations Lecture 6 Tme-Varyng Systems and Computatons Lecture 6 Klaus Depold 14. Januar 2014 The Kalman Flter The Kalman estmaton flter attempts to estmate the actual state of an unknown dscrete dynamcal system, gven nosy

More information

Numerical Heat and Mass Transfer

Numerical Heat and Mass Transfer Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and

More information

An Improved multiple fractal algorithm

An Improved multiple fractal algorithm Advanced Scence and Technology Letters Vol.31 (MulGraB 213), pp.184-188 http://dx.do.org/1.1427/astl.213.31.41 An Improved multple fractal algorthm Yun Ln, Xaochu Xu, Jnfeng Pang College of Informaton

More information

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography CSc 6974 and ECSE 6966 Math. Tech. for Vson, Graphcs and Robotcs Lecture 21, Aprl 17, 2006 Estmatng A Plane Homography Overvew We contnue wth a dscusson of the major ssues, usng estmaton of plane projectve

More information

x = , so that calculated

x = , so that calculated Stat 4, secton Sngle Factor ANOVA notes by Tm Plachowsk n chapter 8 we conducted hypothess tests n whch we compared a sngle sample s mean or proporton to some hypotheszed value Chapter 9 expanded ths to

More information

OPTIMAL COMBINATION OF FOURTH ORDER STATISTICS FOR NON-CIRCULAR SOURCE SEPARATION. Christophe De Luigi and Eric Moreau

OPTIMAL COMBINATION OF FOURTH ORDER STATISTICS FOR NON-CIRCULAR SOURCE SEPARATION. Christophe De Luigi and Eric Moreau OPTIMAL COMBINATION OF FOURTH ORDER STATISTICS FOR NON-CIRCULAR SOURCE SEPARATION Chrstophe De Lug and Erc Moreau Unversty of Toulon LSEET UMR CNRS 607 av. G. Pompdou BP56 F-8362 La Valette du Var Cedex

More information

Parametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010

Parametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010 Parametrc fractonal mputaton for mssng data analyss Jae Kwang Km Survey Workng Group Semnar March 29, 2010 1 Outlne Introducton Proposed method Fractonal mputaton Approxmaton Varance estmaton Multple mputaton

More information

Linköping University Post Print. Combining Long-Term and Low-Rate Short- Term Channel State Information over Correlated MIMO Channels

Linköping University Post Print. Combining Long-Term and Low-Rate Short- Term Channel State Information over Correlated MIMO Channels Lnköpng Unversty Post Prnt Combnng Long-Term and Low-Rate Short- Term Channel State Informaton over Correlated MIMO Channels Tùng T. Km, Mats Bengtsson, Erk G. Larsson and Mkael Skoglund N.B.: When ctng

More information

CIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M

CIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M CIS56: achne Learnng Lecture 3 (Sept 6, 003) Preparaton help: Xaoyng Huang Lnear Regresson Lnear regresson can be represented by a functonal form: f(; θ) = θ 0 0 +θ + + θ = θ = 0 ote: 0 s a dummy attrbute

More information

Feature Selection: Part 1

Feature Selection: Part 1 CSE 546: Machne Learnng Lecture 5 Feature Selecton: Part 1 Instructor: Sham Kakade 1 Regresson n the hgh dmensonal settng How do we learn when the number of features d s greater than the sample sze n?

More information

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009 College of Computer & Informaton Scence Fall 2009 Northeastern Unversty 20 October 2009 CS7880: Algorthmc Power Tools Scrbe: Jan Wen and Laura Poplawsk Lecture Outlne: Prmal-dual schema Network Desgn:

More information

MMA and GCMMA two methods for nonlinear optimization

MMA and GCMMA two methods for nonlinear optimization MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons

More information

Rate-Memory Trade-off for the Two-User Broadcast Caching Network with Correlated Sources

Rate-Memory Trade-off for the Two-User Broadcast Caching Network with Correlated Sources Rate-Memory Trade-off for the Two-User Broadcast Cachng Network wth Correlated Sources Parsa Hassanzadeh, Antona M. Tulno, Jame Llorca, Elza Erkp arxv:705.0466v [cs.it] May 07 Abstract Ths paper studes

More information

Basic Statistical Analysis and Yield Calculations

Basic Statistical Analysis and Yield Calculations October 17, 007 Basc Statstcal Analyss and Yeld Calculatons Dr. José Ernesto Rayas Sánchez 1 Outlne Sources of desgn-performance uncertanty Desgn and development processes Desgn for manufacturablty A general

More information

COGNITIVE RADIO NETWORKS BASED ON OPPORTUNISTIC BEAMFORMING WITH QUANTIZED FEEDBACK

COGNITIVE RADIO NETWORKS BASED ON OPPORTUNISTIC BEAMFORMING WITH QUANTIZED FEEDBACK COGNITIVE RADIO NETWORKS BASED ON OPPORTUNISTIC BEAMFORMING WITH QUANTIZED FEEDBACK Ayman MASSAOUDI, Noura SELLAMI 2, Mohamed SIALA MEDIATRON Lab., Sup Com Unversty of Carthage 283 El Ghazala Arana, Tunsa

More information

1 Convex Optimization

1 Convex Optimization Convex Optmzaton We wll consder convex optmzaton problems. Namely, mnmzaton problems where the objectve s convex (we assume no constrants for now). Such problems often arse n machne learnng. For example,

More information

FUZZY GOAL PROGRAMMING VS ORDINARY FUZZY PROGRAMMING APPROACH FOR MULTI OBJECTIVE PROGRAMMING PROBLEM

FUZZY GOAL PROGRAMMING VS ORDINARY FUZZY PROGRAMMING APPROACH FOR MULTI OBJECTIVE PROGRAMMING PROBLEM Internatonal Conference on Ceramcs, Bkaner, Inda Internatonal Journal of Modern Physcs: Conference Seres Vol. 22 (2013) 757 761 World Scentfc Publshng Company DOI: 10.1142/S2010194513010982 FUZZY GOAL

More information

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017 U.C. Berkeley CS94: Beyond Worst-Case Analyss Handout 4s Luca Trevsan September 5, 07 Summary of Lecture 4 In whch we ntroduce semdefnte programmng and apply t to Max Cut. Semdefnte Programmng Recall that

More information

Chapter 13: Multiple Regression

Chapter 13: Multiple Regression Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to

More information

JAB Chain. Long-tail claims development. ASTIN - September 2005 B.Verdier A. Klinger

JAB Chain. Long-tail claims development. ASTIN - September 2005 B.Verdier A. Klinger JAB Chan Long-tal clams development ASTIN - September 2005 B.Verder A. Klnger Outlne Chan Ladder : comments A frst soluton: Munch Chan Ladder JAB Chan Chan Ladder: Comments Black lne: average pad to ncurred

More information

Lecture 14 (03/27/18). Channels. Decoding. Preview of the Capacity Theorem.

Lecture 14 (03/27/18). Channels. Decoding. Preview of the Capacity Theorem. Lecture 14 (03/27/18). Channels. Decodng. Prevew of the Capacty Theorem. A. Barg The concept of a communcaton channel n nformaton theory s an abstracton for transmttng dgtal (and analog) nformaton from

More information

Supporting Information

Supporting Information Supportng Informaton The neural network f n Eq. 1 s gven by: f x l = ReLU W atom x l + b atom, 2 where ReLU s the element-wse rectfed lnear unt, 21.e., ReLUx = max0, x, W atom R d d s the weght matrx to

More information

Linear dispersion code with an orthogonal row structure for simplifying sphere decoding

Linear dispersion code with an orthogonal row structure for simplifying sphere decoding tle Lnear dsperson code wth an orthogonal row structure for smplfyng sphere decodng Author(s) Da XG; Cheung SW; Yuk I Ctaton he 0th IEEE Internatonal Symposum On Personal Indoor and Moble Rado Communcatons

More information

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin Proceedngs of the 007 Wnter Smulaton Conference S G Henderson, B Bller, M-H Hseh, J Shortle, J D Tew, and R R Barton, eds LOW BIAS INTEGRATED PATH ESTIMATORS James M Calvn Department of Computer Scence

More information

DC-Free Turbo Coding Scheme Using MAP/SOVA Algorithms

DC-Free Turbo Coding Scheme Using MAP/SOVA Algorithms Proceedngs of the 5th WSEAS Internatonal Conference on Telecommuncatons and Informatcs, Istanbul, Turkey, May 27-29, 26 (pp192-197 DC-Free Turbo Codng Scheme Usng MAP/SOVA Algorthms Prof. Dr. M. Amr Mokhtar

More information

Kernel Methods and SVMs Extension

Kernel Methods and SVMs Extension Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general

More information

Module 9. Lecture 6. Duality in Assignment Problems

Module 9. Lecture 6. Duality in Assignment Problems Module 9 1 Lecture 6 Dualty n Assgnment Problems In ths lecture we attempt to answer few other mportant questons posed n earler lecture for (AP) and see how some of them can be explaned through the concept

More information

10-701/ Machine Learning, Fall 2005 Homework 3

10-701/ Machine Learning, Fall 2005 Homework 3 10-701/15-781 Machne Learnng, Fall 2005 Homework 3 Out: 10/20/05 Due: begnnng of the class 11/01/05 Instructons Contact questons-10701@autonlaborg for queston Problem 1 Regresson and Cross-valdaton [40

More information

A Feedback Reduction Technique for MIMO Broadcast Channels

A Feedback Reduction Technique for MIMO Broadcast Channels A Feedback Reducton Technque for MIMO Broadcast Channels Nhar Jndal Department of Electrcal and Computer Engneerng Unversty of Mnnesota Mnneapols, MN 55455, USA Emal: nhar@umn.edu Abstract A multple antenna

More information

CONTRAST ENHANCEMENT FOR MIMIMUM MEAN BRIGHTNESS ERROR FROM HISTOGRAM PARTITIONING INTRODUCTION

CONTRAST ENHANCEMENT FOR MIMIMUM MEAN BRIGHTNESS ERROR FROM HISTOGRAM PARTITIONING INTRODUCTION CONTRAST ENHANCEMENT FOR MIMIMUM MEAN BRIGHTNESS ERROR FROM HISTOGRAM PARTITIONING N. Phanthuna 1,2, F. Cheevasuvt 2 and S. Chtwong 2 1 Department of Electrcal Engneerng, Faculty of Engneerng Rajamangala

More information

Research Article Green s Theorem for Sign Data

Research Article Green s Theorem for Sign Data Internatonal Scholarly Research Network ISRN Appled Mathematcs Volume 2012, Artcle ID 539359, 10 pages do:10.5402/2012/539359 Research Artcle Green s Theorem for Sgn Data Lous M. Houston The Unversty of

More information

SIO 224. m(r) =(ρ(r),k s (r),µ(r))

SIO 224. m(r) =(ρ(r),k s (r),µ(r)) SIO 224 1. A bref look at resoluton analyss Here s some background for the Masters and Gubbns resoluton paper. Global Earth models are usually found teratvely by assumng a startng model and fndng small

More information

Bayesian predictive Configural Frequency Analysis

Bayesian predictive Configural Frequency Analysis Psychologcal Test and Assessment Modelng, Volume 54, 2012 (3), 285-292 Bayesan predctve Confgural Frequency Analyss Eduardo Gutérrez-Peña 1 Abstract Confgural Frequency Analyss s a method for cell-wse

More information

Two-Way and Multiple-Access Energy Harvesting Systems with Energy Cooperation

Two-Way and Multiple-Access Energy Harvesting Systems with Energy Cooperation Two-Way and Multple-Access Energy Harvestng Systems wth Energy Cooperaton Berk Gurakan, Omur Ozel, Jng Yang 2, and Sennur Ulukus Department of Electrcal and Computer Engneerng, Unversty of Maryland, College

More information

The optimal delay of the second test is therefore approximately 210 hours earlier than =2.

The optimal delay of the second test is therefore approximately 210 hours earlier than =2. THE IEC 61508 FORMULAS 223 The optmal delay of the second test s therefore approxmately 210 hours earler than =2. 8.4 The IEC 61508 Formulas IEC 61508-6 provdes approxmaton formulas for the PF for smple

More information

= z 20 z n. (k 20) + 4 z k = 4

= z 20 z n. (k 20) + 4 z k = 4 Problem Set #7 solutons 7.2.. (a Fnd the coeffcent of z k n (z + z 5 + z 6 + z 7 + 5, k 20. We use the known seres expanson ( n+l ( z l l z n below: (z + z 5 + z 6 + z 7 + 5 (z 5 ( + z + z 2 + z + 5 5

More information

Rethinking MIMO for Wireless Networks: Linear Throughput Increases with Multiple Receive Antennas

Rethinking MIMO for Wireless Networks: Linear Throughput Increases with Multiple Receive Antennas Retnng MIMO for Wreless etwors: Lnear Trougput Increases wt Multple Receve Antennas ar Jndal Unversty of Mnnesota Unverstat Pompeu Fabra Jont wor wt Jeff Andrews & Steven Weber MIMO n Pont-to-Pont Cannels

More information

Asymptotic Quantization: A Method for Determining Zador s Constant

Asymptotic Quantization: A Method for Determining Zador s Constant Asymptotc Quantzaton: A Method for Determnng Zador s Constant Joyce Shh Because of the fnte capacty of modern communcaton systems better methods of encodng data are requred. Quantzaton refers to the methods

More information

Tornado and Luby Transform Codes. Ashish Khisti Presentation October 22, 2003

Tornado and Luby Transform Codes. Ashish Khisti Presentation October 22, 2003 Tornado and Luby Transform Codes Ashsh Khst 6.454 Presentaton October 22, 2003 Background: Erasure Channel Elas[956] studed the Erasure Channel β x x β β x 2 m x 2 k? Capacty of Noseless Erasure Channel

More information

Cognitive Access Algorithms For Multiple Access Channels

Cognitive Access Algorithms For Multiple Access Channels 203 IEEE 4th Workshop on Sgnal Processng Advances n Wreless Communcatons SPAWC) Cogntve Access Algorthms For Multple Access Channels Ychuan Hu and Alejandro Rbero, Department of Electrcal and Systems Engneerng,

More information

Computing MLE Bias Empirically

Computing MLE Bias Empirically Computng MLE Bas Emprcally Kar Wa Lm Australan atonal Unversty January 3, 27 Abstract Ths note studes the bas arses from the MLE estmate of the rate parameter and the mean parameter of an exponental dstrbuton.

More information

Lab 2e Thermal System Response and Effective Heat Transfer Coefficient

Lab 2e Thermal System Response and Effective Heat Transfer Coefficient 58:080 Expermental Engneerng 1 OBJECTIVE Lab 2e Thermal System Response and Effectve Heat Transfer Coeffcent Warnng: though the experment has educatonal objectves (to learn about bolng heat transfer, etc.),

More information

Introduction to information theory and data compression

Introduction to information theory and data compression Introducton to nformaton theory and data compresson Adel Magra, Emma Gouné, Irène Woo March 8, 207 Ths s the augmented transcrpt of a lecture gven by Luc Devroye on March 9th 207 for a Data Structures

More information

Lecture 12: Classification

Lecture 12: Classification Lecture : Classfcaton g Dscrmnant functons g The optmal Bayes classfer g Quadratc classfers g Eucldean and Mahalanobs metrcs g K Nearest Neghbor Classfers Intellgent Sensor Systems Rcardo Guterrez-Osuna

More information

For now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results.

For now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results. Neural Networks : Dervaton compled by Alvn Wan from Professor Jtendra Malk s lecture Ths type of computaton s called deep learnng and s the most popular method for many problems, such as computer vson

More information

The Gaussian classifier. Nuno Vasconcelos ECE Department, UCSD

The Gaussian classifier. Nuno Vasconcelos ECE Department, UCSD he Gaussan classfer Nuno Vasconcelos ECE Department, UCSD Bayesan decson theory recall that we have state of the world X observatons g decson functon L[g,y] loss of predctng y wth g Bayes decson rule s

More information

Chapter - 2. Distribution System Power Flow Analysis

Chapter - 2. Distribution System Power Flow Analysis Chapter - 2 Dstrbuton System Power Flow Analyss CHAPTER - 2 Radal Dstrbuton System Load Flow 2.1 Introducton Load flow s an mportant tool [66] for analyzng electrcal power system network performance. Load

More information

State Amplification and State Masking for the Binary Energy Harvesting Channel

State Amplification and State Masking for the Binary Energy Harvesting Channel State Amplfcaton and State Maskng for the Bnary Energy Harvestng Channel Kaya Tutuncuoglu, Omur Ozel 2, Ayln Yener, and Sennur Ulukus 2 Department of Electrcal Engneerng, The Pennsylvana State Unversty,

More information

Prof. Dr. I. Nasser Phys 630, T Aug-15 One_dimensional_Ising_Model

Prof. Dr. I. Nasser Phys 630, T Aug-15 One_dimensional_Ising_Model EXACT OE-DIMESIOAL ISIG MODEL The one-dmensonal Isng model conssts of a chan of spns, each spn nteractng only wth ts two nearest neghbors. The smple Isng problem n one dmenson can be solved drectly n several

More information

Sum Capacity of Multiuser MIMO Broadcast Channels with Block Diagonalization

Sum Capacity of Multiuser MIMO Broadcast Channels with Block Diagonalization Sum Capacty of Multuser MIMO Broadcast Channels wth Block Dagonalzaton Zukang Shen, Runhua Chen, Jeffrey G. Andrews, Robert W. Heath, Jr., and Bran L. Evans The Unversty of Texas at Austn, Austn, Texas

More information

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS HCMC Unversty of Pedagogy Thong Nguyen Huu et al. A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS Thong Nguyen Huu and Hao Tran Van Department of mathematcs-nformaton,

More information

Queueing Networks II Network Performance

Queueing Networks II Network Performance Queueng Networks II Network Performance Davd Tpper Assocate Professor Graduate Telecommuncatons and Networkng Program Unversty of Pttsburgh Sldes 6 Networks of Queues Many communcaton systems must be modeled

More information

On Information Theoretic Games for Interference Networks

On Information Theoretic Games for Interference Networks On Informaton Theoretc Games for Interference Networks Suvarup Saha and Randall A. Berry Dept. of EECS Northwestern Unversty e-mal: suvarups@u.northwestern.edu rberry@eecs.northwestern.edu Abstract The

More information

EEE 241: Linear Systems

EEE 241: Linear Systems EEE : Lnear Systems Summary #: Backpropagaton BACKPROPAGATION The perceptron rule as well as the Wdrow Hoff learnng were desgned to tran sngle layer networks. They suffer from the same dsadvantage: they

More information

Hongyi Miao, College of Science, Nanjing Forestry University, Nanjing ,China. (Received 20 June 2013, accepted 11 March 2014) I)ϕ (k)

Hongyi Miao, College of Science, Nanjing Forestry University, Nanjing ,China. (Received 20 June 2013, accepted 11 March 2014) I)ϕ (k) ISSN 1749-3889 (prnt), 1749-3897 (onlne) Internatonal Journal of Nonlnear Scence Vol.17(2014) No.2,pp.188-192 Modfed Block Jacob-Davdson Method for Solvng Large Sparse Egenproblems Hongy Mao, College of

More information

Improvement of Histogram Equalization for Minimum Mean Brightness Error

Improvement of Histogram Equalization for Minimum Mean Brightness Error Proceedngs of the 7 WSEAS Int. Conference on Crcuts, Systems, Sgnal and elecommuncatons, Gold Coast, Australa, January 7-9, 7 3 Improvement of Hstogram Equalzaton for Mnmum Mean Brghtness Error AAPOG PHAHUA*,

More information

Linear Regression Analysis: Terminology and Notation

Linear Regression Analysis: Terminology and Notation ECON 35* -- Secton : Basc Concepts of Regresson Analyss (Page ) Lnear Regresson Analyss: Termnology and Notaton Consder the generc verson of the smple (two-varable) lnear regresson model. It s represented

More information

Approximately achieving Gaussian relay network capacity with lattice codes

Approximately achieving Gaussian relay network capacity with lattice codes Approxmately achevng Gaussan relay network capacty wth lattce codes Ayfer Özgür EFL, Lausanne, Swtzerland ayfer.ozgur@epfl.ch Suhas Dggav UCLA, USA and EFL, Swtzerland suhas@ee.ucla.edu Abstract Recently,

More information

One-sided finite-difference approximations suitable for use with Richardson extrapolation

One-sided finite-difference approximations suitable for use with Richardson extrapolation Journal of Computatonal Physcs 219 (2006) 13 20 Short note One-sded fnte-dfference approxmatons sutable for use wth Rchardson extrapolaton Kumar Rahul, S.N. Bhattacharyya * Department of Mechancal Engneerng,

More information

Boostrapaggregating (Bagging)

Boostrapaggregating (Bagging) Boostrapaggregatng (Baggng) An ensemble meta-algorthm desgned to mprove the stablty and accuracy of machne learnng algorthms Can be used n both regresson and classfcaton Reduces varance and helps to avod

More information

xp(x µ) = 0 p(x = 0 µ) + 1 p(x = 1 µ) = µ

xp(x µ) = 0 p(x = 0 µ) + 1 p(x = 1 µ) = µ CSE 455/555 Sprng 2013 Homework 7: Parametrc Technques Jason J. Corso Computer Scence and Engneerng SUY at Buffalo jcorso@buffalo.edu Solutons by Yngbo Zhou Ths assgnment does not need to be submtted and

More information

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U) Econ 413 Exam 13 H ANSWERS Settet er nndelt 9 deloppgaver, A,B,C, som alle anbefales å telle lkt for å gøre det ltt lettere å stå. Svar er gtt . Unfortunately, there s a prntng error n the hnt of

More information

An Interactive Optimisation Tool for Allocation Problems

An Interactive Optimisation Tool for Allocation Problems An Interactve Optmsaton ool for Allocaton Problems Fredr Bonäs, Joam Westerlund and apo Westerlund Process Desgn Laboratory, Faculty of echnology, Åbo Aadem Unversty, uru 20500, Fnland hs paper presents

More information

The Second Anti-Mathima on Game Theory

The Second Anti-Mathima on Game Theory The Second Ant-Mathma on Game Theory Ath. Kehagas December 1 2006 1 Introducton In ths note we wll examne the noton of game equlbrum for three types of games 1. 2-player 2-acton zero-sum games 2. 2-player

More information

Scroll Generation with Inductorless Chua s Circuit and Wien Bridge Oscillator

Scroll Generation with Inductorless Chua s Circuit and Wien Bridge Oscillator Latest Trends on Crcuts, Systems and Sgnals Scroll Generaton wth Inductorless Chua s Crcut and Wen Brdge Oscllator Watcharn Jantanate, Peter A. Chayasena, and Sarawut Sutorn * Abstract An nductorless Chua

More information

Notes on Frequency Estimation in Data Streams

Notes on Frequency Estimation in Data Streams Notes on Frequency Estmaton n Data Streams In (one of) the data streamng model(s), the data s a sequence of arrvals a 1, a 2,..., a m of the form a j = (, v) where s the dentty of the tem and belongs to

More information

Lecture 3 Stat102, Spring 2007

Lecture 3 Stat102, Spring 2007 Lecture 3 Stat0, Sprng 007 Chapter 3. 3.: Introducton to regresson analyss Lnear regresson as a descrptve technque The least-squares equatons Chapter 3.3 Samplng dstrbuton of b 0, b. Contnued n net lecture

More information