SUCCESSIVE INTERFERENCE CANCELLATION DECODING FOR THE K -USER CYCLIC INTERFERENCE CHANNEL

Size: px
Start display at page:

Download "SUCCESSIVE INTERFERENCE CANCELLATION DECODING FOR THE K -USER CYCLIC INTERFERENCE CHANNEL"

Transcription

1 Joural of Theoretical ad Applied Iformatio Techology 31 st December 212 Vol 46 No JATIT & LLS All rights reserved ISSN: wwwatitorg E-ISSN: SCCESSIVE INTERFERENCE CANCELLATION DECODING FOR THE -SER CYCLIC INTERFERENCE CHANNEL 12 YONG LI 14 BO ZHANG 3 IAOIA SONG BAOMING BAI 1 1 State ey Lab of ISN idia iversity i a 7171 Shaaxi Chia 2 School of Educatio Sciece & Techology Shaxi Datog iversity Datog 379 Shaxi Chia 3 School of Physical & Electroics Shaxi Datog iversity Datog 379 Shaxi Chia 4 No No 9641 troop Baoi 7217 Shaaxi Chia ABSTRACT The -user cyclic iterferece chael ca model oe sceario i vehicular etwors where all the base statios are arraged alog a highway The th user is iterfered oly by the (( 1) mod ) th user i the -user cyclic iterferece chael The Ha-obayashi scheme based rate regio the best ier boud ow to date for the two-user iterferece chael is exteded to the -user cyclic iterferece chael which is obtaied by simultaeously decodig the iteded messages ad a part of the iterfered messages at the receiver I this paper we show that the simple successive iterferece cacellatio decodig ca also achieve this rate regio eywords: Iterferece Chael Cyclic Iterferece Chael Achievable Rate Regio Successive Iterferece Cacellatio Decodig Multi-level Ecodig 1 INTRODCTION The iterferece chael first itroduced by Shao i 1961 [1] models a commuicatio sceario where all user pairs share the same physical medium ad the commuicatio of each user pair will be iterfered with that of aother user pairs A user pair is usually amed a user for short The iterferece chael is useful for determiig the performace limits of may practical systems such as the wireless etwors However the capacity regio of the two-user iterferece chael is still uow except for the followig several cases For the two-user discrete memoryless iterferece chael its capacity regio is ow if the itesity of the iterferece is strog [234] if the chael outputs are some determiistic fuctios of the chael iputs [5] ad if the chael satisfies a class of degraded form [67] For the two-user Gaussia iterferece chael the capacity regios of very strog ad strog iterferece chaels [489] ad the same capacities of oisy iterferece [11112] mixed iterferece [1113] ad oe-sided [14] iterferece chaels are ow So far the best achievable rate regio for the two-user iterferece chael is provided by Ha ad obayashi (H) [8] usig superpositio codig i couctio with simultaeous decodig A simplified descriptio of the H rate regio amed the CMG rate regio is give i [15] via multi-level ecodig ad simultaeous decodig I this paper we refer to these ier bouds as the H scheme based ier bouds Recetly a special iterferece chael amed the cyclic iterferece chael was itroduced to study the codig problem of a special sceario may appear i vehicular etwors where all the base statios are arraged alog a highway or high-speed rail The cyclic iterferece chael is motivated by the modified Wyer model that is used to depict the soft hadoff sceario of a cellular etwor [16] I the -user cyclic iterferece chael depicted i Figure 1 the commuicatio of the th user pair is iterfered oly by that of the (( 1) mod )th user pair I [17] the H scheme based ier bouds for the two-user iterferece chael are exteded to the -user cyclic iterferece chael ad its all operatig poits are poited out to be achieved by successive iterferece cacellatio decodig via taig a geometric viewpoit ad usig rate-splittig argumets Ispired by this we also focus o the -user 961

2 Joural of Theoretical ad Applied Iformatio Techology 31 st December 212 Vol 46 No JATIT & LLS All rights reserved ISSN: wwwatitorg E-ISSN: discrete memoryless cyclic iterferece chael i this paper ad show that the H scheme based ier boud of the -user cyclic iterferece chael ca be achieved by successive iterferece cacellatio decodig via a rigorous ad complete achievability proof usig radom codig argumets The ey idea of the proof is motivated by the equivalece of simultaeous decodig ad successive iterferece cacellatio decodig i achievig the capacity regio of the multiple access chael (MAC) Throughout the paper we use x ad to deote a radom variable its realizatio ad rage respectively Moreover a sequece is described = = as ( 1 2 ) 1 ( ) ad = ( ) CHANNEL MODEL The -user discrete memoryless cyclic iterferece chael is show i Figure 1 which cosists of iput ad output alphabets Y = ad a collectio of coditioal probability mass fuctios p ( y y x x ) o L Y Y Specially the margial distributios of the chael outputs satisfy p ( y x x 1 ) = p ( y x x ( 1) ) mod It is assumed that trasmitter ( = ) wats to sed a idepedet message W uiformly distributed over (( 2 R ) ) 2 R 1 W to its iteded receiver A code for the -user discrete memoryless cyclic iterferece chael cosists of R message sets W = { 122 } ecodig fuctios f : W performed by the correspodig ecoder ad decodig fuctios g : Y W performed by the correspodig decoder The average probability of error over the codeboo is defied P = Pr W ˆ Wˆ W W A rate as e {( ) ( )} R R 1 is said to be achievable for the -user discrete memoryless cyclic iterferece chael if there exists a sequece of tuple (( 2 R ) ) 2 R 1 codes with P e as The capacity regio of the -user discrete memoryless cyclic iterferece chael is the closure of the set of achievable rate tuples ( R R ) W W 1 W 1 Ecoder Ecoder 1 Ecoder -1 1 Y Y1 Y Decoder Decoder 1 W 2 2 Y 2 Ecoder -2 Decoder -2 Decoder -1 Wˆ Wˆ 1 ˆ 2 W ˆ W Figure 1: The -ser Cyclic Iterferece Chael 3 MAIN RESLT I this sectio we will show that the H scheme based ier boud of the -user discrete memoryless cyclic iterferece chael ca be achieved by multi-level ecodig i couctio with successive iterferece cacellatio decodig We rewrite the achievable rate regio of the - user discrete memoryless cyclic iterferece chael i [17] as follows Give a -user discrete memoryless cyclic iterferece chael the radom variables tae values i Q respectively Ad let 1 Y Y 1 tae values i chael iput alphabets ad chael output alphabets Y Y respectively Let P be the set of all probability distributios o ( Q 1 1) that factor as ( q u x ) ( q) ( u q) ( x u q) = p p p p = Give a fixed value p P cosider ( q u 1 1 ) ( 1 1 ) ( 1 1 x y q u x = y x ) p p p ( Q Y ) o ( ) ( ) ( ) rate tuples ( p c (( 1) mod ) c ) R ad let R p be the set of R R R that satisfy R I ( (1) p ( 1) mod R R I ( (2) c p ( 1) mod ( ; ) R I Y Q p (( 1) mod ) c ( 1) mod (3) R R R I ( c p (( 1) mod ) c ( 1) mod (4) 962

3 Joural of Theoretical ad Applied Iformatio Techology 31 st December 212 Vol 46 No JATIT & LLS All rights reserved ISSN: wwwatitorg E-ISSN: Let R ( p) deote the rate tuples R R such that R = R R where ( ) p c R R R(( 1) mod ) R for each = 1 Lemma 1: The set p c c p = R R p P ( p) is a achievable rate regio for the -user discrete memoryless cyclic iterferece chael Proof: We use the coded time sharig techique multi-level ecodig ad successive iterferece cacellatio decodig The formal proof usig radom codig argumets is give below: a) Radom codeboo costructio p q p u x q p u x q Fix ( ) ( ( 1) mod ( 1) mod ) Radomly geerate a sequece accordig to p ( q ) For i= 1 Q i q draw ad = ( 1) mod radomly ad q coditioally idepedetly geerate R 2 R sequeces u ( w ) w 1 : 2 each accordig to i= 1 p ( u q ) For each u ( w ) Q radomly ad coditioally idepedetly geerate R 2 p i R sequeces x ( w w p ) w 1 : 2 p p each i= 1 Q accordig to ( i i ) i p x u w q b) Ecodig To sed w =( w w p ) trasmitter = ( 1) mod seds the correspodig codeword x ( w w ) p c) Decodig At each receiver a virtual three-user MAC is formed because there are three messages icludig its ow commo messages w private messages w ad the rival s commo p messages w (( 1) mod ) c to be decoded It is performed i three steps via successive iterferece cacellatio decodig So we have six decodig orders to decode these three messages Four decodig orders are left because we ca get rid of two meaigless decodig orders where the rival s commo messages are decoded at last at the receiver Also due to the use of the multi-level ecodig techique we have to decode the commo message of each user before decodig its private message So we oly have two decodig c orders ie the rival s commo messages the user s commo messages ad its ow private messages ( w(( 1) mod ) w w ) ad the user s commo c c p messages the rival s commo messages ad the user s private messages ( wc w(( 1) mod ) c w p ) Each decodig order determies a rate regio amed sub-regio The covex hull of the uio of these two sub-regios costitutes the rate regio of the virtual three-user MAC at each receiver Ad the rate regio of the -user discrete memoryless cyclic iterferece chael is the itersectio of the rate regios of these virtual three-user MACs Without loss of geerality we oly give the proof of oe decodig order w(( 1) mod ) w w The c c p proof of the other decodig order w w w is similar c (( 1) mod ) c p ŵ The decoder declares that (( 1) mod ) c is set if it is the uique message such that ( q u ( wˆ ) y ) T ò c otherwise it declares a error If such ŵ (( 1) mod ) c is foud the decoder fids the uique message w ˆ c such that ( u ( wˆ ) u ˆ ( w ) y ) c c q T ò otherwise it declares a error If such ŵ (( 1) mod ) c ad wˆ c are foud the decoder fids the uique message w ˆ p such that ( ˆ u ˆ ( 1) mod ( w(( 1) mod ) ) x ( w w ) y ) c c p q T ò otherwise it declares a error d) Aalysis of the probability of error We boud the probability of error averaged over codeboos ad messages By symmetry of the radom code geeratio the probability of error does ot deped o which codeword was set So without loss of geerality we assume that the message 11 W were set pairs W = ad ( 1) mod = 11 The the coditioal probability of a evet give 11 W were set is that W = ad defied as P ( 1) mod = 11 ( ( 1) mod ) = P = ( 11 ) = ( 11) ε ε W W A decodig error occurs oly if {( Q (11) (1) Y ) } ò T ε 1 963

4 Joural of Theoretical ad Applied Iformatio Techology 31 st December 212 Vol 46 No JATIT & LLS All rights reserved ISSN: wwwatitorg E-ISSN: ( c ) Tò Q ˆ ( w ) Y 2 (( 1) mod ) c ( c ) Tò Q ( wˆ ) (1) Y 3 c Q (1 wˆ ) (1) Y 4 p ( p ) Tò The by the uio boud of evets we P ε P ε P ε P ε P ε By the have ( 1) ( 2 ) ( 3 ) ( 4 ) law of large umbers (LLN) ( ε1) By the pacig lemma [18] P ( ε 2 ) as ad (( 1) mod ) c < ( ( 1) mod ; δ P ( ε3 ) if Rc I( ( 1) mod Q ) δ ( ò ) ad ad ( ε 4 ) ( ; δ P as R I Y ò hold p ( 1) mod P as if R I Y ò Hece if the followig iequalities are satisfied the total average probability of decodig error P ( ε ) as Actually that describes a rate sub-regio whe Q is fixed: R I ( (5) p ( 1) mod R (6) c ( 1) mod R(( 1) mod ) c ( 1) mod (7) R R I ( (8) c p ( 1) mod Rc R(( 1) mod ) c ( 1) mod (9) R R I ( p (( 1) mod ) c ( 1) mod I ( ( 1) mod (1) R R R I ( c p (( 1) mod ) c ( 1) mod c (( 1) mod ) c p (11) Similarly accordig to the other decodig order w w w we have the other rate subregio for a giveq : R I ( (12) p ( 1) mod R (13) c R(( 1) mod ) c ( 1) mod (14) R R c p I ( ( 1) mod (15) Rc R(( 1) mod ) c ( 1) mod (16) R R p (( 1) mod ) c ( 1) mod (17) R R R I ( c p (( 1) mod ) c ( 1) mod (18) e) Rate regio Accordig to the covex hull of the uio of these two sub-regios we obtai a rate regio of a virtual three-user MAC at receiver The rate regio of the -user discrete memoryless cyclic iterferece chael is the itersectio of these rate regios which ca be described as follows R I ( (19) p ( 1) mod R (2) c ( 1) mod R(( 1) mod ) c ( 1) mod (21) R R I ( (22) c p ( 1) mod Rc R(( 1) mod ) c ( 1) mod (23) R ; p R(( 1) mod ) c ( 1) mod Y Q ) (24) R R R I ( c p (( 1) mod ) c ( 1) mod where = (25) Accordig to [15] we get rid of those redudat iequalities ad the have the simplified iequalities as below R R I ( (26) p ( 1) mod R R I ( (27) c p ( 1) mod ( ) R I Q p (( 1) mod ) c ( 1) mod (28) R R R I ( c p (( 1) mod ) c ( 1) mod (29) With this we complete the proof of the achievability of the rate regio for the -user discrete memoryless cyclic iterferece chael via multi-level ecodig i couctio with successive iterferece cacellatio decodig 4 CONCLSION The cyclic iterferece chael models a special sceario that may appear i vehicular etwors where all the base statios are arraged alog a highway or high-speed rail To determie the performace limit of this commuicatio system the -user cyclic iterferece chael is ofte cosidered by the iformatio theory researchers It 964

5 Joural of Theoretical ad Applied Iformatio Techology 31 st December 212 Vol 46 No JATIT & LLS All rights reserved ISSN: wwwatitorg E-ISSN: is o woder that the Ha-obayashi scheme based ier boud is exteded to the -user cyclic iterferece chael ad this Ha-obayashi scheme based ier boud is obtaied by superpositio codig or multi-level ecodig i couctio with simultaeous decodig I this paper we give a rigorous achievability proof usig radom codig argumets to show that successive iterferece cacellatio decodig ca also achieve the Ha-obayashi scheme based ier boud of the -user cyclic iterferece chael which is helpful for us to uderstad ad determie the Ha- obayashi scheme based ier boud ACNOWLEDGEMENTS This wor was supported i part by the NSFC of Chia uder grat the 973 Program of Chia uder grat 212CB31613 ad the PCSIRT of Chia uder grat IRT852 REFERENCES: [1] CE Shao Two-way commuicatio chaels Proceedigs of the 4th Bereley Symp Mathematical ad Statistical Probability Bereley CA 1961 pp [2] H Sato O the capacity regio of a discrete two-user chael for strog iterferece IEEE Tras If Theory Vol 24 No 3 May 1978 pp [3] M H M Costa ad A A E Gamal The capacity regio of the discrete memoryless iterferece chael with strog iterferece IEEE Tras If Theory Vol 33 No 5 Sept 1987 pp [4] A B Carleial A case where iterferece does ot reduce capacity IEEE Tras If Theory Vol 21 No 5 Sept 1975 pp [5] A A E Gamal ad M H M Costa The capacity regio of a class of determiistic iterferece chaels IEEE Tras If Theory Vol 28 No 2 Mar 1982 pp [6] N Liu ad S luus The capacity regio of a class of discrete degraded iterferece chaels IEEE Tras If Theory Vol 54 No 9 Sept 28 pp [7] R Bezel The capacity regio of a class of discrete additive degraded iterferece chaels IEEE Tras If Theory Vol 25 No 2 Mar 1979 pp [8] T Ha ad obayashi A ew achievable rate regio for the iterferece chael IEEE Tras If Theory Vol 27 No 1 Ja 1981 pp 49-6 [9] H Sato The capacity of the gaussia iterferece chael uder strog iterferece IEEE Tras If Theory Vol 27 No 6 Nov 1981 pp [1] Shag G ramer ad B Che A ew outer boud ad the oisy-iterferece sumrate capacity for Gaussia iterferece chaels IEEE Tras If Theory Vol 55 No 2 Feb 29 pp [11] A S Motahari ad A hadai Capacity bouds for the Gaussia iterferece chael IEEE Tras If Theory Vol 55 No 2 Feb 29 pp [12] V S Aapureddy ad V V Veeravalli Gaussia iterferece etwors: sum capacity i the low-iterferece regime ad ew outer bouds o the capacity regio IEEE Tras If Theory Vol 55 No 7 July 29 pp [13] D Tuietti ad Y Weg O gaussia mixed iterferece chaels Proceedigs of the IEEE Iteratioal Symposium Iformatio Theory Toroto Caada July 28 [14] I Saso O achievable rate regios for the gaussia iterferece chael IEEE Tras If Theory Vol 5 No 6 Jue 24 pp [15] HFChog MMotai HGarg ad H El Gamal O the Ha obayashi regio for the iterferece chael IEEE Tras If Theory Vol54 No7 28 pp [16] OSomeh BMZaidel ad SShamai Sum rate characterizatio of oit multiple cell-site processig IEEE Tras If Theory Vol 53 No 12 Dec 27 pp [17] ESasoglu Successive cacellatio for cyclic iterferece chaels Proceedigs of Iformatio Theory Worshop Porto May 28 pp 36-4 [18] A A El Gamal ad YH imlecture Notes o Networ Iformatio Theory

arxiv: v1 [cs.it] 13 Jul 2012

arxiv: v1 [cs.it] 13 Jul 2012 O the Sum Capacity of the Discrete Memoryless Iterferece Chael with Oe-Sided Weak Iterferece ad Mixed Iterferece Fagfag Zhu ad Biao Che Syracuse Uiversity Departmet of EECS Syracuse, NY 3244 Email: fazhu{biche}@syr.edu

More information

Symmetric Two-User Gaussian Interference Channel with Common Messages

Symmetric Two-User Gaussian Interference Channel with Common Messages Symmetric Two-User Gaussia Iterferece Chael with Commo Messages Qua Geg CSL ad Dept. of ECE UIUC, IL 680 Email: geg5@illiois.edu Tie Liu Dept. of Electrical ad Computer Egieerig Texas A&M Uiversity, TX

More information

A Partial Decode-Forward Scheme For A Network with N relays

A Partial Decode-Forward Scheme For A Network with N relays A Partial Decode-Forward Scheme For A etwork with relays Yao Tag ECE Departmet, McGill Uiversity Motreal, QC, Caada Email: yaotag2@mailmcgillca Mai Vu ECE Departmet, Tufts Uiversity Medford, MA, USA Email:

More information

Lecture 7: Channel coding theorem for discrete-time continuous memoryless channel

Lecture 7: Channel coding theorem for discrete-time continuous memoryless channel Lecture 7: Chael codig theorem for discrete-time cotiuous memoryless chael Lectured by Dr. Saif K. Mohammed Scribed by Mirsad Čirkić Iformatio Theory for Wireless Commuicatio ITWC Sprig 202 Let us first

More information

Overview of Gaussian MIMO (Vector) BC

Overview of Gaussian MIMO (Vector) BC Overview of Gaussia MIMO (Vector) BC Gwamo Ku Adaptive Sigal Processig ad Iformatio Theory Research Group Nov. 30, 2012 Outlie / Capacity Regio of Gaussia MIMO BC System Structure Kow Capacity Regios -

More information

Multiterminal source coding with complementary delivery

Multiterminal source coding with complementary delivery Iteratioal Symposium o Iformatio Theory ad its Applicatios, ISITA2006 Seoul, Korea, October 29 November 1, 2006 Multitermial source codig with complemetary delivery Akisato Kimura ad Tomohiko Uyematsu

More information

Cooperative Communication Fundamentals & Coding Techniques

Cooperative Communication Fundamentals & Coding Techniques 3 th ICACT Tutorial Cooperative commuicatio fudametals & codig techiques Cooperative Commuicatio Fudametals & Codig Techiques 0..4 Electroics ad Telecommuicatio Research Istitute Kiug Jug 3 th ICACT Tutorial

More information

Information Theory Tutorial Communication over Channels with memory. Chi Zhang Department of Electrical Engineering University of Notre Dame

Information Theory Tutorial Communication over Channels with memory. Chi Zhang Department of Electrical Engineering University of Notre Dame Iformatio Theory Tutorial Commuicatio over Chaels with memory Chi Zhag Departmet of Electrical Egieerig Uiversity of Notre Dame Abstract A geeral capacity formula C = sup I(; Y ), which is correct for

More information

The Likelihood Encoder with Applications to Lossy Compression and Secrecy

The Likelihood Encoder with Applications to Lossy Compression and Secrecy The Likelihood Ecoder with Applicatios to Lossy Compressio ad Secrecy Eva C. Sog Paul Cuff H. Vicet Poor Dept. of Electrical Eg., Priceto Uiversity, NJ 8544 {csog, cuff, poor}@priceto.edu Abstract A likelihood

More information

Capacity Theorems for the Finite-State Broadcast Channel with Feedback

Capacity Theorems for the Finite-State Broadcast Channel with Feedback Capacity Theorems for the Fiite-State Broadcast Chael with Feedback Ro abora ad Adrea Goldsmith ept of Electrical Egieerig, Staford Uiversity Abstract We cosider the discrete, time-varyig broadcast chael

More information

ECE 564/645 - Digital Communication Systems (Spring 2014) Final Exam Friday, May 2nd, 8:00-10:00am, Marston 220

ECE 564/645 - Digital Communication Systems (Spring 2014) Final Exam Friday, May 2nd, 8:00-10:00am, Marston 220 ECE 564/645 - Digital Commuicatio Systems (Sprig 014) Fial Exam Friday, May d, 8:00-10:00am, Marsto 0 Overview The exam cosists of four (or five) problems for 100 (or 10) poits. The poits for each part

More information

Information Theory and Coding

Information Theory and Coding Sol. Iformatio Theory ad Codig. The capacity of a bad-limited additive white Gaussia (AWGN) chael is give by C = Wlog 2 ( + σ 2 W ) bits per secod(bps), where W is the chael badwidth, is the average power

More information

Lecture 11: Channel Coding Theorem: Converse Part

Lecture 11: Channel Coding Theorem: Converse Part EE376A/STATS376A Iformatio Theory Lecture - 02/3/208 Lecture : Chael Codig Theorem: Coverse Part Lecturer: Tsachy Weissma Scribe: Erdem Bıyık I this lecture, we will cotiue our discussio o chael codig

More information

Inequalities for Entropies of Sets of Subsets of Random Variables

Inequalities for Entropies of Sets of Subsets of Random Variables Iequalities for Etropies of Sets of Subsets of Radom Variables Chao Tia AT&T Labs-Research Florham Par, NJ 0792, USA. tia@research.att.com Abstract Ha s iequality o the etropy rates of subsets of radom

More information

The Gaussian Multiple Access Wire-Tap Channel with Collective Secrecy Constraints

The Gaussian Multiple Access Wire-Tap Channel with Collective Secrecy Constraints IIT 6, eattle, UA, July 9-4, 6 The Gaussia Multiple Access Wire-Tap Chael with Collective ecrecy Costraits Eder Tei tei@psu.edu Ayli Yeer yeer@ee.psu.edu Wireless Commuicatios ad Networig Laboratory Electrical

More information

The Maximum-Likelihood Decoding Performance of Error-Correcting Codes

The Maximum-Likelihood Decoding Performance of Error-Correcting Codes The Maximum-Lielihood Decodig Performace of Error-Correctig Codes Hery D. Pfister ECE Departmet Texas A&M Uiversity August 27th, 2007 (rev. 0) November 2st, 203 (rev. ) Performace of Codes. Notatio X,

More information

THE interference channel problem describes a setup where multiple pairs of transmitters and receivers share a communication

THE interference channel problem describes a setup where multiple pairs of transmitters and receivers share a communication Trade-off betwee Commuicatio ad Cooperatio i the Iterferece Chael Farhad Shirai EECS Departmet Uiversity of Michiga A Arbor,USA Email: fshirai@umich.edu S. Sadeep Pradha EECS Departmet Uiversity of Michiga

More information

The multiplicative structure of finite field and a construction of LRC

The multiplicative structure of finite field and a construction of LRC IERG6120 Codig for Distributed Storage Systems Lecture 8-06/10/2016 The multiplicative structure of fiite field ad a costructio of LRC Lecturer: Keeth Shum Scribe: Zhouyi Hu Notatios: We use the otatio

More information

IET Commun., 2009, Vol. 3, Iss. 1, pp doi: /iet-com: & The Institution of Engineering and Technology 2009

IET Commun., 2009, Vol. 3, Iss. 1, pp doi: /iet-com: & The Institution of Engineering and Technology 2009 Published i IET Commuicatios Received o 4th Jue 28 Revised o 3th July 28 doi: 1.149/iet-com:28373 ISSN 1751-8628 Symmetric relayig based o partial decodig ad the capacity of a class of relay etworks L.

More information

Distortion Bounds for Source Broadcast. Problem

Distortion Bounds for Source Broadcast. Problem Distortio Bouds for Source Broadcast 1 Problem Lei Yu, Houqiag Li, Seior Member, IEEE, ad Weipig Li, Fellow, IEEE Abstract This paper ivestigates the joit source-chael codig problem of sedig a memoryless

More information

A New Achievability Scheme for the Relay Channel

A New Achievability Scheme for the Relay Channel A New Achievability Scheme for the Relay Chael Wei Kag Seur Ulukus Departmet of Electrical ad Computer Egieerig Uiversity of Marylad, College Park, MD 20742 wkag@umd.edu ulukus@umd.edu October 4, 2007

More information

On The Han Kobayashi Region for the Interference Channel

On The Han Kobayashi Region for the Interference Channel 3188 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 54, NO. 7, JULY 008 [9]. Zarrikhat ad A. H. Baihashemi, Hybrid hard-decisio iterative decodig of irregular low-desity parity-check codes, IEEE Tras Commu.,

More information

z-interference Channel

z-interference Channel ISIT 2009, Seoul, Korea, Jue 28 - July 3, 2009 Bouds ad Capacity Results for the Cogitive z-iterferece Chael Na Liu Staford Uiversity Staford, CA aliu@staford.edu Ivaa Maric Staford Uiversity Staford,

More information

Increasing timing capacity using packet coloring

Increasing timing capacity using packet coloring 003 Coferece o Iformatio Scieces ad Systems, The Johs Hopkis Uiversity, March 4, 003 Icreasig timig capacity usig packet colorig Xi Liu ad R Srikat[] Coordiated Sciece Laboratory Uiversity of Illiois e-mail:

More information

Binary Fading Interference Channel with No CSIT

Binary Fading Interference Channel with No CSIT Biary Fadig Iterferece Chael with No CSIT Alireza Vahid, Mohammad Ali Maddah-Ali, A. Salma Avestimehr, ad Ya Zhu arxiv:405.003v3 [cs.it] 4 Mar 07 Abstract We study the capacity regio of the two-user Biary

More information

On the Capacity of Symmetric Gaussian Interference Channels with Feedback

On the Capacity of Symmetric Gaussian Interference Channels with Feedback O the Capacity of Symmetric Gaussia Iterferece Chaels with Feedback La V Truog Iformatio Techology Specializatio Departmet ITS FPT Uiversity, Haoi, Vietam E-mail: latv@fpteduv Hirosuke Yamamoto Dept of

More information

Entropies & Information Theory

Entropies & Information Theory Etropies & Iformatio Theory LECTURE I Nilajaa Datta Uiversity of Cambridge,U.K. For more details: see lecture otes (Lecture 1- Lecture 5) o http://www.qi.damtp.cam.ac.uk/ode/223 Quatum Iformatio Theory

More information

The Capacity Region of the Degraded Finite-State Broadcast Channel

The Capacity Region of the Degraded Finite-State Broadcast Channel The Capacity Regio of the Degraded Fiite-State Broadcast Chael Ro Dabora ad Adrea Goldsmith Dept. of Electrical Egieerig, Staford Uiversity, Staford, CA Abstract We cosider the discrete, time-varyig broadcast

More information

Multiterminal Source Coding with an Entropy-Based Distortion Measure

Multiterminal Source Coding with an Entropy-Based Distortion Measure 20 IEEE Iteratioal Symposium o Iformatio Theory Proceedigs Multitermial Source Codig with a Etropy-Based Distortio Measure Thomas A. Courtade ad Richard D. Wesel Departmet of Electrical Egieerig Uiversity

More information

Lecture 7: October 18, 2017

Lecture 7: October 18, 2017 Iformatio ad Codig Theory Autum 207 Lecturer: Madhur Tulsiai Lecture 7: October 8, 207 Biary hypothesis testig I this lecture, we apply the tools developed i the past few lectures to uderstad the problem

More information

Hybrid Coding for Gaussian Broadcast Channels with Gaussian Sources

Hybrid Coding for Gaussian Broadcast Channels with Gaussian Sources Hybrid Codig for Gaussia Broadcast Chaels with Gaussia Sources Rajiv Soudararaja Departmet of Electrical & Computer Egieerig Uiversity of Texas at Austi Austi, TX 7871, USA Email: rajivs@mailutexasedu

More information

Daniela Tuninetti University of Illinois, Chicago, IL (USA),

Daniela Tuninetti University of Illinois, Chicago, IL (USA), 1 The IterFerece Chael with Geeralized Feedback IFC-GF) Daiela Tuietti Uiversity of Illiois, Chicago, IL USA), daiela@ece.uic.edu Abstract This work itroduces cooperative commuicatio strategies for IterFerece

More information

Lossy Compression with Near-uniform Encoder Outputs

Lossy Compression with Near-uniform Encoder Outputs 016 IEEE Iteratioal Symposium o Iformatio Theory Lossy Compressio with Near-uiform Ecoder Outputs Badri N. Vellambi, Jörg Kliewer New Jersey Istitute of Techology, Newar, NJ 0710 Email: badri..vellambi@ieee.org,

More information

On Random Line Segments in the Unit Square

On Random Line Segments in the Unit Square O Radom Lie Segmets i the Uit Square Thomas A. Courtade Departmet of Electrical Egieerig Uiversity of Califoria Los Ageles, Califoria 90095 Email: tacourta@ee.ucla.edu I. INTRODUCTION Let Q = [0, 1] [0,

More information

Non-Asymptotic Achievable Rates for Gaussian Energy-Harvesting Channels: Best-Effort and Save-and-Transmit

Non-Asymptotic Achievable Rates for Gaussian Energy-Harvesting Channels: Best-Effort and Save-and-Transmit No-Asymptotic Achievable Rates for Gaussia Eergy-Harvestig Chaels: Best-Effort ad Save-ad-Trasmit Silas L. Fog, Jig Yag, ad Ayli Yeer arxiv:805.089v [cs.it] 30 May 08 Abstract A additive white Gaussia

More information

Lecture 15: Strong, Conditional, & Joint Typicality

Lecture 15: Strong, Conditional, & Joint Typicality EE376A/STATS376A Iformatio Theory Lecture 15-02/27/2018 Lecture 15: Strog, Coditioal, & Joit Typicality Lecturer: Tsachy Weissma Scribe: Nimit Sohoi, William McCloskey, Halwest Mohammad I this lecture,

More information

Supplementary Material for Fast Stochastic AUC Maximization with O(1/n)-Convergence Rate

Supplementary Material for Fast Stochastic AUC Maximization with O(1/n)-Convergence Rate Supplemetary Material for Fast Stochastic AUC Maximizatio with O/-Covergece Rate Migrui Liu Xiaoxua Zhag Zaiyi Che Xiaoyu Wag 3 iabao Yag echical Lemmas ized versio of Hoeffdig s iequality, ote that We

More information

Asymptotic Coupling and Its Applications in Information Theory

Asymptotic Coupling and Its Applications in Information Theory Asymptotic Couplig ad Its Applicatios i Iformatio Theory Vicet Y. F. Ta Joit Work with Lei Yu Departmet of Electrical ad Computer Egieerig, Departmet of Mathematics, Natioal Uiversity of Sigapore IMS-APRM

More information

Non-Asymptotic Achievable Rates for Gaussian Energy-Harvesting Channels: Best-Effort and Save-and-Transmit

Non-Asymptotic Achievable Rates for Gaussian Energy-Harvesting Channels: Best-Effort and Save-and-Transmit 08 IEEE Iteratioal Symposium o Iformatio Theory ISIT No-Asymptotic Achievable Rates for Gaussia Eergy-Harvestig Chaels: Best-Effort ad Save-ad-Trasmit Silas L Fog Departmet of Electrical ad Computer Egieerig

More information

Covert Communication with Noncausal Channel-State Information at the Transmitter

Covert Communication with Noncausal Channel-State Information at the Transmitter Covert Commuicatio with Nocausal Chael-State Iformatio at the Trasmitter Si-Hyeo Lee, Ligog Wag, Ashish Khisti, ad Gregory W. Worell POSTECH, Pohag, South Korea (e-mail:sihyeo@postech.ac.kr ETIS Uiversité

More information

Lecture 14: Graph Entropy

Lecture 14: Graph Entropy 15-859: Iformatio Theory ad Applicatios i TCS Sprig 2013 Lecture 14: Graph Etropy March 19, 2013 Lecturer: Mahdi Cheraghchi Scribe: Euiwoog Lee 1 Recap Bergma s boud o the permaet Shearer s Lemma Number

More information

On the Dispersions of the Discrete Memoryless Interference Channel

On the Dispersions of the Discrete Memoryless Interference Channel O the Dispersios of the Discrete Memoryless Iterferece Chael Sy-Quoc Le, Vicet Y. F. Ta,2, ad Mehul Motai Departmet of ECE, Natioal Uiversity of Sigapore, Sigapore 2 Istitute for Ifocomm Research (I 2

More information

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + 62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of

More information

ECE 6980 An Algorithmic and Information-Theoretic Toolbox for Massive Data

ECE 6980 An Algorithmic and Information-Theoretic Toolbox for Massive Data ECE 6980 A Algorithmic ad Iformatio-Theoretic Toolbo for Massive Data Istructor: Jayadev Acharya Lecture # Scribe: Huayu Zhag 8th August, 017 1 Recap X =, ε is a accuracy parameter, ad δ is a error parameter.

More information

An Introduction to Randomized Algorithms

An Introduction to Randomized Algorithms A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis

More information

Channel coding, linear block codes, Hamming and cyclic codes Lecture - 8

Channel coding, linear block codes, Hamming and cyclic codes Lecture - 8 Digital Commuicatio Chael codig, liear block codes, Hammig ad cyclic codes Lecture - 8 Ir. Muhamad Asial, MSc., PhD Ceter for Iformatio ad Commuicatio Egieerig Research (CICER) Electrical Egieerig Departmet

More information

Inseparability of the Multiple Access Wiretap Channel

Inseparability of the Multiple Access Wiretap Channel Iseparability of the Multiple Access Wiretap Chael Jiawei Xie Seur Ulukus Departmet of Electrical ad Computer Egieerig Uiversity of Marylad, College Park, MD 074 xiejw@umd.edu ulukus@umd.edu Abstract We

More information

The Capacity Region of the. Degraded Finite-State Broadcast Channel

The Capacity Region of the. Degraded Finite-State Broadcast Channel Submitted to the IEEE Trasactios o Iformatio Theory, 2008. The Capacity Regio of the Degraded Fiite-State Broadcast Chael Ro Dabora ad Adrea Goldsmith Wireless Systems Lab Departmet of Electrical Egieerig

More information

Supplementary Material for Fast Stochastic AUC Maximization with O(1/n)-Convergence Rate

Supplementary Material for Fast Stochastic AUC Maximization with O(1/n)-Convergence Rate Supplemetary Material for Fast Stochastic AUC Maximizatio with O/-Covergece Rate Migrui Liu Xiaoxua Zhag Zaiyi Che Xiaoyu Wag 3 iabao Yag echical Lemmas ized versio of Hoeffdig s iequality, ote that We

More information

A Non-Asymptotic Achievable Rate for the AWGN Energy-Harvesting Channel using Save-and-Transmit

A Non-Asymptotic Achievable Rate for the AWGN Energy-Harvesting Channel using Save-and-Transmit 016 IEEE Iteratioal Symposium o Iformatio Theory A No-Asymptotic Achievable Rate for the AWGN Eergy-Harvestig Chael usig Save-ad-Trasmit Silas L. Fog, Vicet Y. F. Ta, ad Jig Yag Departmet of Electrical

More information

Second-Order Rate of Constant-Composition Codes for the Gel fand-pinsker Channel

Second-Order Rate of Constant-Composition Codes for the Gel fand-pinsker Channel Research Collectio Coferece aper Secod-Order Rate of Costat-Compositio Codes for the Gel fad-isker Chael Author(s: Scarlett, Joatha ublicatio Date: 204 ermaet ik: https://doi.org/0.3929/ethz-a-0009456

More information

Finite Block-Length Gains in Distributed Source Coding

Finite Block-Length Gains in Distributed Source Coding Decoder Fiite Block-Legth Gais i Distributed Source Codig Farhad Shirai EECS Departmet Uiversity of Michiga A Arbor,USA Email: fshirai@umichedu S Sadeep Pradha EECS Departmet Uiversity of Michiga A Arbor,USA

More information

Confidence interval for the two-parameter exponentiated Gumbel distribution based on record values

Confidence interval for the two-parameter exponentiated Gumbel distribution based on record values Iteratioal Joural of Applied Operatioal Research Vol. 4 No. 1 pp. 61-68 Witer 2014 Joural homepage: www.ijorlu.ir Cofidece iterval for the two-parameter expoetiated Gumbel distributio based o record values

More information

On the Dispersions of the Gel fand-pinsker Channel and Dirty Paper Coding

On the Dispersions of the Gel fand-pinsker Channel and Dirty Paper Coding O the Dispersios of the Gel fad-isker Chael ad Dirty aper Codig Joatha Scarlett Abstract This paper studies secod-order codig rates for memoryless chaels with a state sequece kow o-causally at the ecoder.

More information

IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 64, NO. 3, MARCH

IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 64, NO. 3, MARCH IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 64, NO. 3, MARCH 08 48 Lattice Codes Achieve the Capacity of Commo Message Gaussia Broadcast Chaels With Coded Side Iformatio Lakshmi Nataraja, Yi Hog, Seior

More information

Capacity of Compound State-Dependent Channels with States Known at the Transmitter

Capacity of Compound State-Dependent Channels with States Known at the Transmitter Capacity of Compoud State-Depedet Chaels with States Kow at the Trasmitter Pablo Piataida Departmet of Telecommuicatios SUPELEC Plateau de Moulo, 992 Gif-sur-Yvette, Frace Email: pablo.piataida@supelec.fr

More information

Multiaccess Communication in the Finite Blocklength Regime

Multiaccess Communication in the Finite Blocklength Regime Multiaccess Commuicatio i the Fiite Blocklegth Regime Ebrahim MolaviaJazi ad J. Nicholas Laema Departmet of Electrical Egierrig Uiversity of Notre Dame Notre Dame IN 46556 USA Email: {emolaviajl}@d.edu

More information

Complexity Analysis of Highly Improved Hybrid Turbo Codes

Complexity Analysis of Highly Improved Hybrid Turbo Codes I J C T A, 8(5, 015, pp. 433-439 Iteratioal Sciece Press Complexity Aalysis of Highly Improved Hybrid Turbo Codes M. Jose Ra* ad Sharmii Eoch** Abstract: Moder digital commuicatio systems eed efficiet

More information

A note on log-concave random graphs

A note on log-concave random graphs A ote o log-cocave radom graphs Ala Frieze ad Tomasz Tocz Departmet of Mathematical Scieces, Caregie Mello Uiversity, Pittsburgh PA53, USA Jue, 08 Abstract We establish a threshold for the coectivity of

More information

Convergence of random variables. (telegram style notes) P.J.C. Spreij

Convergence of random variables. (telegram style notes) P.J.C. Spreij Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space

More information

Resilient Source Coding

Resilient Source Coding Resiliet Source Codig Maël Le Treust Laboratoire des Sigaux et Systèmes CNRS - Supélec - Uiv. Paris Sud 11 91191, Gif-sur-Yvette, Frace Email: mael.letreust@lss.supelec.fr Samso Lasaulce Laboratoire des

More information

Generalized Semi- Markov Processes (GSMP)

Generalized Semi- Markov Processes (GSMP) Geeralized Semi- Markov Processes (GSMP) Summary Some Defiitios Markov ad Semi-Markov Processes The Poisso Process Properties of the Poisso Process Iterarrival times Memoryless property ad the residual

More information

New Results in Coding and Communication Theory. Communication Systems Laboratory. Rick Wesel

New Results in Coding and Communication Theory. Communication Systems Laboratory.  Rick Wesel New Results i Codig ad Commuicatio Theory http://www.ee.ucla.edu/~csl/ Rick Wesel At the Aerospace Corporatio August, 008 Miguel Griot Bike ie Yua-Mao Chag Tom Courtade Jiadog Wag Recet Results A more

More information

Lecture 27. Capacity of additive Gaussian noise channel and the sphere packing bound

Lecture 27. Capacity of additive Gaussian noise channel and the sphere packing bound Lecture 7 Ageda for the lecture Gaussia chael with average power costraits Capacity of additive Gaussia oise chael ad the sphere packig boud 7. Additive Gaussia oise chael Up to this poit, we have bee

More information

On Successive Refinement for the Wyner-Ziv Problem with Partially Cooperating Decoders

On Successive Refinement for the Wyner-Ziv Problem with Partially Cooperating Decoders ISIT 2008, Toroto, Caada, July 6-11, 2008 O Successive Refiemet for the Wyer-Ziv Problem with Partially Cooperatig Decoders Shraga I. Bross ad Tsachy Weissma, School of Egieerig, Bar-Ila Uiversity, Ramat-Ga

More information

First Year Quantitative Comp Exam Spring, Part I - 203A. f X (x) = 0 otherwise

First Year Quantitative Comp Exam Spring, Part I - 203A. f X (x) = 0 otherwise First Year Quatitative Comp Exam Sprig, 2012 Istructio: There are three parts. Aswer every questio i every part. Questio I-1 Part I - 203A A radom variable X is distributed with the margial desity: >

More information

Are Slepian-Wolf Rates Necessary for Distributed Parameter Estimation?

Are Slepian-Wolf Rates Necessary for Distributed Parameter Estimation? Are Slepia-Wolf Rates Necessary for Distributed Parameter Estimatio? Mostafa El Gamal ad Lifeg Lai Departmet of Electrical ad Computer Egieerig Worcester Polytechic Istitute {melgamal, llai}@wpi.edu arxiv:1508.02765v2

More information

OPTIMAL PIECEWISE UNIFORM VECTOR QUANTIZATION OF THE MEMORYLESS LAPLACIAN SOURCE

OPTIMAL PIECEWISE UNIFORM VECTOR QUANTIZATION OF THE MEMORYLESS LAPLACIAN SOURCE Joural of ELECTRICAL EGIEERIG, VOL. 56, O. 7-8, 2005, 200 204 OPTIMAL PIECEWISE UIFORM VECTOR QUATIZATIO OF THE MEMORYLESS LAPLACIA SOURCE Zora H. Perić Veljo Lj. Staović Alesadra Z. Jovaović Srdja M.

More information

Fixed-Threshold Polar Codes

Fixed-Threshold Polar Codes Fixed-Threshold Polar Codes Jig Guo Uiversity of Cambridge jg582@cam.ac.uk Albert Guillé i Fàbregas ICREA & Uiversitat Pompeu Fabra Uiversity of Cambridge guille@ieee.org Jossy Sayir Uiversity of Cambridge

More information

Generalization of Contraction Principle on G-Metric Spaces

Generalization of Contraction Principle on G-Metric Spaces Global Joural of Pure ad Applied Mathematics. ISSN 0973-1768 Volume 14, Number 9 2018), pp. 1159-1165 Research Idia Publicatios http://www.ripublicatio.com Geeralizatio of Cotractio Priciple o G-Metric

More information

Lecture 6: Source coding, Typicality, and Noisy channels and capacity

Lecture 6: Source coding, Typicality, and Noisy channels and capacity 15-859: Iformatio Theory ad Applicatios i TCS CMU: Sprig 2013 Lecture 6: Source codig, Typicality, ad Noisy chaels ad capacity Jauary 31, 2013 Lecturer: Mahdi Cheraghchi Scribe: Togbo Huag 1 Recap Uiversal

More information

A Rate-Distortion Based Secrecy System with Side Information at the Decoders

A Rate-Distortion Based Secrecy System with Side Information at the Decoders A Rate-Distortio Based Secrecy System with Side Iformatio at the Decoders Eva C. Sog Paul Cuff H. Vicet Poor Dept. of Electrical Eg., Priceto Uiversity, NJ 8544 {csog, cuff, poor}@priceto.edu arxiv:4.2v

More information

It is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function.

It is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function. MATH 532 Measurable Fuctios Dr. Neal, WKU Throughout, let ( X, F, µ) be a measure space ad let (!, F, P ) deote the special case of a probability space. We shall ow begi to study real-valued fuctios defied

More information

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f. Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,

More information

Disjoint Systems. Abstract

Disjoint Systems. Abstract Disjoit Systems Noga Alo ad Bey Sudaov Departmet of Mathematics Raymod ad Beverly Sacler Faculty of Exact Scieces Tel Aviv Uiversity, Tel Aviv, Israel Abstract A disjoit system of type (,,, ) is a collectio

More information

ACO Comprehensive Exam 9 October 2007 Student code A. 1. Graph Theory

ACO Comprehensive Exam 9 October 2007 Student code A. 1. Graph Theory 1. Graph Theory Prove that there exist o simple plaar triagulatio T ad two distict adjacet vertices x, y V (T ) such that x ad y are the oly vertices of T of odd degree. Do ot use the Four-Color Theorem.

More information

Lecture 2: April 3, 2013

Lecture 2: April 3, 2013 TTIC/CMSC 350 Mathematical Toolkit Sprig 203 Madhur Tulsiai Lecture 2: April 3, 203 Scribe: Shubhedu Trivedi Coi tosses cotiued We retur to the coi tossig example from the last lecture agai: Example. Give,

More information

The Three-Terminal Interactive. Lossy Source Coding Problem

The Three-Terminal Interactive. Lossy Source Coding Problem The Three-Termial Iteractive 1 Lossy Source Codig Problem Leoardo Rey Vega, Pablo Piataida ad Alfred O. Hero III arxiv:1502.01359v3 cs.it] 18 Ja 2016 Abstract The three-ode multitermial lossy source codig

More information

Lecture 2. The Lovász Local Lemma

Lecture 2. The Lovász Local Lemma Staford Uiversity Sprig 208 Math 233A: No-costructive methods i combiatorics Istructor: Ja Vodrák Lecture date: Jauary 0, 208 Origial scribe: Apoorva Khare Lecture 2. The Lovász Local Lemma 2. Itroductio

More information

Infinite Sequences and Series

Infinite Sequences and Series Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet

More information

Online hypergraph matching: hiring teams of secretaries

Online hypergraph matching: hiring teams of secretaries Olie hypergraph matchig: hirig teams of secretaries Rafael M. Frogillo Advisor: Robert Kleiberg May 29, 2008 Itroductio The goal of this paper is to fid a competitive algorithm for the followig problem.

More information

Randomized Algorithms I, Spring 2018, Department of Computer Science, University of Helsinki Homework 1: Solutions (Discussed January 25, 2018)

Randomized Algorithms I, Spring 2018, Department of Computer Science, University of Helsinki Homework 1: Solutions (Discussed January 25, 2018) Radomized Algorithms I, Sprig 08, Departmet of Computer Sciece, Uiversity of Helsiki Homework : Solutios Discussed Jauary 5, 08). Exercise.: Cosider the followig balls-ad-bi game. We start with oe black

More information

Chapter 6 Infinite Series

Chapter 6 Infinite Series Chapter 6 Ifiite Series I the previous chapter we cosidered itegrals which were improper i the sese that the iterval of itegratio was ubouded. I this chapter we are goig to discuss a topic which is somewhat

More information

Arithmetic Distribution Matching

Arithmetic Distribution Matching Arithmetic Distributio Matchig Sebastia Baur ad Georg Böcherer Istitute for Commuicatios Egieerig Techische Uiversität Müche, Germay Email: baursebastia@mytum.de,georg.boecherer@tum.de arxiv:48.393v [cs.it]

More information

Axioms of Measure Theory

Axioms of Measure Theory MATH 532 Axioms of Measure Theory Dr. Neal, WKU I. The Space Throughout the course, we shall let X deote a geeric o-empty set. I geeral, we shall ot assume that ay algebraic structure exists o X so that

More information

UC Berkeley CS 170: Efficient Algorithms and Intractable Problems Handout 17 Lecturer: David Wagner April 3, Notes 17 for CS 170

UC Berkeley CS 170: Efficient Algorithms and Intractable Problems Handout 17 Lecturer: David Wagner April 3, Notes 17 for CS 170 UC Berkeley CS 170: Efficiet Algorithms ad Itractable Problems Hadout 17 Lecturer: David Wager April 3, 2003 Notes 17 for CS 170 1 The Lempel-Ziv algorithm There is a sese i which the Huffma codig was

More information

Capacity Regions of Two-User Broadcast Erasure Channels with Feedback and Hidden Memory

Capacity Regions of Two-User Broadcast Erasure Channels with Feedback and Hidden Memory Capacity Regios of Two-User Broadcast Erasure Chaels with Feedback ad Hidde Memory Michael Heidlmaier, Shiri Saeedi Bidokhti Istitute for Commuicatios Egieerig, Techische Uiversität Müche, Muich, Germay

More information

Universal source coding for complementary delivery

Universal source coding for complementary delivery SITA2006 i Hakodate 2005.2. p. Uiversal source codig for complemetary delivery Akisato Kimura, 2, Tomohiko Uyematsu 2, Shigeaki Kuzuoka 2 Media Iformatio Laboratory, NTT Commuicatio Sciece Laboratories,

More information

Shannon s noiseless coding theorem

Shannon s noiseless coding theorem 18.310 lecture otes May 4, 2015 Shao s oiseless codig theorem Lecturer: Michel Goemas I these otes we discuss Shao s oiseless codig theorem, which is oe of the foudig results of the field of iformatio

More information

Lossy Compression via Sparse Linear Regression: Computationally Efficient Encoding and Decoding

Lossy Compression via Sparse Linear Regression: Computationally Efficient Encoding and Decoding ossy Compressio via Sparse iear Regressio: Computatioally Efficiet Ecodig ad Decodig Ramji Vekataramaa Dept of Egieerig, Uiv of Cambridge ramjiv@egcamacuk Tuhi Sarkar Dept of EE, IIT Bombay tuhi91@gmailcom

More information

Binary codes from graphs on triples and permutation decoding

Binary codes from graphs on triples and permutation decoding Biary codes from graphs o triples ad permutatio decodig J. D. Key Departmet of Mathematical Scieces Clemso Uiversity Clemso SC 29634 U.S.A. J. Moori ad B. G. Rodrigues School of Mathematics Statistics

More information

Capacity Bounds for Networks of Broadcast Channels

Capacity Bounds for Networks of Broadcast Channels Capacity Bouds for Networks of Broadcast Chaels Michelle Effros Departmet of Electrical Egieerig Califoria Istitute of Techology Abstract This paper derives ew outer bouds o the capacities of etworks comprised

More information

Notes on Snell Envelops and Examples

Notes on Snell Envelops and Examples Notes o Sell Evelops ad Examples Example (Secretary Problem): Coside a pool of N cadidates whose qualificatios are represeted by ukow umbers {a > a 2 > > a N } from best to last. They are iterviewed sequetially

More information

Posterior Matching Scheme for Gaussian Multiple Access Channel with Feedback

Posterior Matching Scheme for Gaussian Multiple Access Channel with Feedback 1 Posterior Matchig Scheme for Gaussia Multiple Access Chael with Feedback La V. Truog, Member, IEEE, Iformatio Techology Specializatio Departmet ITS, FPT Uiversity, Haoi, Vietam E-mail: latv@fpt.edu.v

More information

Strong Coordination over a Three-Terminal Relay Network

Strong Coordination over a Three-Terminal Relay Network Strog Coordiatio over a Three-Termial Relay Network atthieu R. Bloch School of lectrical ad Computer gieerig Georgia Istitute of Techology Atlata, Georgia 30332 0250 mail: matthieu.bloch@ece.gatech.edu

More information

Sum-Capacity of Multiple-Write Noisy Memory

Sum-Capacity of Multiple-Write Noisy Memory 2011 IEEE Iteratioal Symposium o Iformatio Theory Proceedigs Sum-Capacity of Multiple-Write Noisy Memory Lele Wag ad Youg-Ha Kim Departmet of Electrical ad Computer Egieerig Uiversity of Califoria, Sa

More information

Introduction to Probability. Ariel Yadin

Introduction to Probability. Ariel Yadin Itroductio to robability Ariel Yadi Lecture 2 *** Ja. 7 ***. Covergece of Radom Variables As i the case of sequeces of umbers, we would like to talk about covergece of radom variables. There are may ways

More information

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n. Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator

More information

A Simple Probabilistic Explanation of Term Frequency-Inverse Document Frequency (tf-idf) Heuristic (and Variations Motivated by This Explanation)

A Simple Probabilistic Explanation of Term Frequency-Inverse Document Frequency (tf-idf) Heuristic (and Variations Motivated by This Explanation) Uiversity of Texas at El Paso DigitalCommos@UTEP Departmetal Techical Reports (CS) Departmet of Computer Sciece 5-2014 A Simple Probabilistic Explaatio of Term Frequecy-Iverse Documet Frequecy (tf-idf)

More information

A Block Cipher Using Linear Congruences

A Block Cipher Using Linear Congruences Joural of Computer Sciece 3 (7): 556-560, 2007 ISSN 1549-3636 2007 Sciece Publicatios A Block Cipher Usig Liear Cogrueces 1 V.U.K. Sastry ad 2 V. Jaaki 1 Academic Affairs, Sreeidhi Istitute of Sciece &

More information