arxiv: v1 [cs.it] 13 Jul 2012

Transcription

1 O the Sum Capacity of the Discrete Memoryless Iterferece Chael with Oe-Sided Weak Iterferece ad Mixed Iterferece Fagfag Zhu ad Biao Che Syracuse Uiversity Departmet of EECS Syracuse, NY arxiv: v [cs.it] 3 Jul 202 Abstract The sum capacity of a class of discrete memoryless iterferece chaels is determied. This class of chaels is defied aalogous to the Gaussia Z-iterferece chael with weak iterferece; as a result, the sum capacity is achieved by lettig the trasceiver pair subject to the iterferece commuicates at a rate such that its message ca be decoded at the uiteded receiver usig sigle user detectio. Moreover, this class of discrete memoryless iterferece chaels is equivalet i capacity regio to certai discrete degraded iterferece chaels. This allows the costructio of a capacity outerboud usig the capacity regio of associated degraded broadcast chaels. The same techique is the used to determie the sum capacity of the discrete memoryless iterferece chael with mixed iterferece. The above results allow oe to determie sum capacities or capacity regios of several ew discrete memoryless iterferece chaels. I. INTRODUCTION The iterferece chael IC models the situatio where the trasmitters commuicate with their iteded receivers while geeratig iterferece to uiteded receivers. Despite decades of itese research, the capacity regio of IC remais ukow except for a few special cases. These iclude iterferece chaels with strog ad very strog iterferece [] [5]; classes of determiistic ad semi-determiistic ICs [6], [7]; ad classes of discrete degraded ICs [8], [9]. Parallel capacity results exist for the discrete memoryless IC DMIC ad the Gaussia IC GIC. Carleial first obtaied capacity regio for GIC with very strog iterferece []. This result was subsequetly exteded by Sato [2] to that of DMICs with very strog iterferece. Note that the defiitio of DMIC with very strog iterferece ca actually be broadeed to be more cosistet with its Gaussia couterpart [0]. Sato [3] ad Ha ad Kobayashi [4] idepedetly established i 98 the capacity regio of GIC with strog iterferece, where the capacity is the same as that of a compoud multiple access chael. I [3] Sato also cojectured the coditios of DMICs uder strog iterferce, which was evetually proved by Costa ad El Gamal [5] i 987. While the capacity regio for the geeral GIC remais ukow, there have bee recet progress i characterizig the sum capacity of certai GICs, icludig: GICs with oesided weak iterferece [], oisy iterferece [2] [4], ad mixed iterferece [3]. This paper attempts to derive parallel sum capacity results for DMICs with weak oe-sided ad mixed iferece. Our defiitios of oe-sided, weak, or mixed iterferece are motivated by properties associated with the correspodig Gaussia chaels. Some of those defiitios are itimately related to those itroduced i [5] which studies the capacity regio of the discrete memoryless Z-chael. The rest of the paper is orgaized as follows. Sectio II presets the chael model ad relevat previous results. Sectio III defies DMICs with oe-sided weak iterferece ad derives their sum capacities. We refer to those DMICs with oe-sided iterferece as DMZIC i.e., discrete memoryless Z iterferece chael for ease of presetatio. The equivalece betwee the DMZIC with weak iterferece ad the discrete degraded iterferece chael DMDIC is established which allows oe to costruct a capacity outer-boud for the DMZIC usig the capacity regio of the associated degraded broadcast chael. Sectio IV defies DMICs with mixed iterferece ad derives the sum capapcity for this class of chaels. Sectio V cocludes this paper. II. PRELIMINARIES A. Discrete Memoryless Iterferece Chaels A DMIC is specified by its iput alphabets X ad X 2, output alphabets Y ad Y 2, ad the chael trasitio matrices: py x x 2 y 2 Y 2 py y 2 x x 2, py 2 x x 2 y Y py y 2 x x 2. 2 The DMIC is said to be memoryless if py y 2 x x 2 py i y 2i x i x 2i. 3 A,2 R,2 R2,λ,λ 2 code for a DMIC with idepedet iformatio cosists of two message sets M {,2,,2 R } ad M 2 {,2,,2 R2 } for seders ad 2 respectively, two ecodig fuctios: f : M X, f 2 : M 2 X 2, two decodig fuctios: ϕ : Y M, ϕ 2 : Y 2 M 2,

2 ad the average probabilities of error: λ M M 2 λ 2 M M 2 2 R 2 R 2 w w 2 2 R 2 R 2 w w 2 Pr{ϕ y w W w,w 2 w 2}, Pr{ϕ 2y 2 w 2 W w,w 2 w 2}. A rate pair R,R 2 is said to be achievable for the DMZIC if ad oly if there exist a sequece of 2 R,2 R2,,λ,λ 2 codes such that λ,λ 2 0 as. The capacity regio of a DMZIC is defied as the closure of the set of all achievable rate pairs. B. Existig Results for GICs The received sigals of a GIC i its stadard form are Y X + ax 2 +Z, 4 Y 2 bx +X 2 +Z 2, 5 whereaadbare the chael coefficiets correspodig to the iterferece liks, X i ad Y i are the trasmitted ad received sigals, ad the chael iput sequece X i,x i2,,x i is subject to the power costrait Xij 2 P i, i,2, Z j ad Z 2 are Gaussia oises with zero mea ad uit variace, idepedet of X,X 2. Saso i [] proved that the sum capacity for GICs with oe-sided weak iterferece a < ad b 0 is 2 log+p 2+ 2 log + P +ap 2. Motahari ad Khadai i [3] established that the sum capacity for GICs with mixed iterferece a ad b IU;Y 2 IU;Y X, 0 is for all iput distributios px pupx 2 u. { mi 2 log + P, } +ap 2 2 log + bp + The chael trasitio probability py y 2 x x 2 becomes +P 2 2 log+p2. We attempt to exted these results to DMICs with appropriately defied oe-sided weak iterferece ad mixed iterferece. C. Useful Properties of Markov Chais The followig properties of Markov chais are useful throughout the paper: Decompositio: X Y ZW X Y Z; Weak Uio: X Y ZW X YW Z; Cotractio: X Y Z ad X YZ W X Y ZW. III. THE DMZIC WITH WEAK INTERFERENCE A. Discrete Memoryless Z-Iterferece Chael Defiitio : For the DMIC defied i Sectio II-A, if py 2 x 2 py 2 x x 2, 6 for all x, x 2, y 2, or equivaletly, X X 2 Y 2 7 forms a Markov chai, this DMIC is said to have oe-sided iterferece. We refer to such DMIC as simply DMZIC. The defiitio is a atural extesio of that for Gaussia ZIC where X 2 causes iterferece o Y. From the defiitio, it follows that X ad Y 2 are idepedet for all iput distributio px px 2. To defie DMZIC with weak iterferece, we first revisit some properties of Gaussia ZIC with weak iterferece. Similar to that established i [5], it is straightforward to show that a Gaussia ZIC with weak iterferece is equivalet i its capacity regio to a degraded Gaussia ZIC satisfyig the Markov chai X 2 X,Y 2 Y. 8 This is referred i [5] as degraded Gaussia Z chael of type-i. This motivates us to defie DMZIC with weak iterferece as follows. Defiitio 2: A DMZIC is said to have weak iterferece if the chael trasitio probability factorizes as py y 2 x x 2 py 2 x 2 p y x y 2, 9 for some p y x y 2, or, equivaletly, the chael is stochastically degraded. I the absece of receiver cooperatio, a stochastically degraded iterferece chael is equivalet i its capacity to a physically degraded iterferece chael. As such, we will assume i the followig that the chael is physically degraded, i.e., the DMZIC admits the Markov chai X 2 X,Y 2 Y. As a cosequece, the followig iequality holds py y 2 x x 2 py 2 x x 2 py x x 2 y 2 py 2 x 2 py x y 2. The above defiitio of weak iterferece leads to the followig sum capacity result. Theorem : The sum capacity of a DMZIC with weak iterferece as defied above is C sum max px px 2 {IX ;Y +IX 2 ;Y 2 }. Proof: This sum rate is achieved by two receivers decodig their ow messages while treatig ay iterferece, if preset, as oise. For the coverse, a R +R 2 ǫ IX;Y +IX2;Y b 2 HY i Y i HY i Y i X +HY 2i Y i 2 HY 2i Y i 2 X2

3 c d e f g HY i HY i Y i X Y i 2 +HY 2i Y i 2 HY 2i Y i 2 X 2i HY i HY i XY i 2 +IX 2i;Y 2i U i HY i HY i X iy i 2 +IX 2i;Y 2i U i IU ix i;y i+ix 2i;Y 2i U i IX i;y i+iu i;y i X i+ix 2i;Y 2i U i IX i;y i+iu i;y 2i+IX 2i;Y 2i U i IX i;y i+iu ix 2i;Y 2i IX i;y i+ix 2i;Y 2i, where U i Y2 i for all i, a follows the Fao s Iequality, b is from the chai rule ad the defiitio of mutual iformatio, c is because of the fact that coditioig reduces etropy, ad that Y 2i is idepedet of ay other radom variables give X 2i, d is due to the memoryless property of the chael ad the fact that Y i is idepedet of ay other radom variables give X i ad Y 2i, the X,i,Y i X i,y2 i Y i forms a Markov chai. By the weak uio property, the Markov chai Y i X i,y2 Y i holds; e is because of the Markov chai X i,x,i+ X i,y2 i Y i. The easiest way to prove it is usig the Idepedece Graph. Alteratively, we first ote that the Markov chai X i,x,i+,y i 2 X i,y 2i Y i holds, sice give X i ad Y 2i, Y i is idepedet of X i,x,i+ i,y2. By the weak uio property, the followig Markov chai is obtaied: X i,x,i+ X i,y i 2 Y i. Together with the Markov chai X i,x,i+ X i Y2 i because of the idepedece betwee Y2 ad X, we get the Markov chai: X i,x,i+ X i Y i,y i 2 by the cotractio property. Agai, usig the weak uio property ad the the decompositio property, we obtai the Markov chai X i,x,i+ X i,y i 2 Y i as desired. Sice U i ad X i are idepedet, the px x 2 u px pu,x 2, thus f comes from 0. Fially, g follows from the Markov chai U i X 2i Y 2i. At last, by itroducig a time-sharig radom variable Q, oe obtais R +R 2 IX ;Y Q+IX 2 ;Y 2 Q+ǫ max {IX ;Y +IX 2 ;Y 2 }+ǫ. px px 2 Remark : The Markov chai 8 is a sufficiet, but ot ecessary, coditio for the mutual iformatio coditio IX 2 ;Y X IX 2 ;Y 2, 2 for all product iput distributio o X X 2. Oe ca fid examples such that the mutual iformatio coditio holds but the Markov chai is ot valid. This is differet from that of the Gaussia case; it ca be show that the coefficiet a i a Gaussia ZIC is a sufficiet ad ecessary coditio for 2 to hold. It is yet ukow if coditio 2 is sufficiet for the sum capacity result to hold for DMZIC with weak iterferece. B. Capacity Outer-boud for DMZIC with Weak Iterferece For Gaussia ZICs with weak iterferece, Sato [2] obtaied a outer-boud usig the capacity regio of a related Gaussia broadcast chael costructed due to the equivalece i capacity betwee a GZIC with weak iterferece ad a degraded GIC. The same techique ca be used to obtai a capacity outer-boud for DMZIC with weak iterferece, i.e., that satisfies the Markov chaix 2 X,Y 2 Y. Specifically, for ay such DMZIC with weak iterferece, oe ca fid a equivalet i capacity regio DMDIC whose capacity regio is bouded by that of a associated degraded broadcast chael. Theorem 2: For a DMZIC that satisfies the Markov chai X 2 X Y 2 Y, the capacity regio is outer-bouded by R OB co pupx x 2 u R,R 2 R IU;Y, R 2 IX X 2;Y 2 U, where U X X 2 Y 2 Y forms a Markov chai ad U mi{ Y, Y 2, X X 2 }. Proof: Suppose that the DMZIC with weak iterferece has iputs ad outputs X, X 2 ad Y, Y 2 respectively. Let us deote by X, X 2 ad Y, Y 2 the iputs ad outputs of aother DMIC. Set X X, X 2 X 2, ad Y Y but defie Y 2 to be a bijectio of X ad Y 2, deoted as Y 2 fx,y 2. As the Markov chai X,X 2 Y 2 Y the DMIC specified by the iput pair X,X 2 holds,, ad the output pair Y,Y 2 is ideed a DMDIC. The proof that this DMDIC has the same capacity regio as the specified DMZIC, ad hece is outer-bouded by the associated broadcast chael follows i exactly the same fashio as Costa s proof for the Gaussia case [6], hece is omitted here. Remark2: The outputy 2 eed ot ecessarily be a bijectio fuctio of X ad Y 2 ; istead, depedig o the trasitio probabilitypy x y 2, other Y 2 ca be costructed. However, the associated broadcast chaels would have the same the capacity regio. It will become clear i the followig example.

4 C. Numerical Example Example : Let X X 2 Y Y 2 2 ad the chael trasitio probability be give by py y 2 x x 2 py 2 x 2 py x y 2, where py 2 x 2 ad py x y 2 are specified i Table I Broadcast chael outerboud Previous outer boud TABLE I CHANNEL TRANSITION PROBABILITIES py 2 x 2 y 2 0 y 2 py x y 2 y 0 y x x y 2 00 or x 2.9. x y 2 0 or 0 0 R By Theorem, the sum capacity is C sum max px px 2 IX ;Y +IX 2 ;Y Moreover, oe ca costruct Y 2 Y 2 as follows: { 0, if x y 2 00 or,, otherwise. The py 2 x x 2 is give i Table II. TABLE II PY 2 X X 2 py 2 x x 2 y 2 0 y 2 x x x x x x x x 2..9 Usig Theorem 2, the capacity regio of the DMZIC is outer-bouded by that of the associated DMDBC: R OB co R,R 2 R IU;Y, R 2 IX X 2 ;Y 2 U pupx x 2 u If oe takes the bijectio fuctio to costruct Y 2, it will lead to the same outer-boud. If we fix R 2 to be x, the max R max R 2x HY 2 Ux+h2.HY HY U log Y f T x+h 2., where f T is a fuctio defied by Witsehause ad Wyer [7]. Fig. depicts the ew outer-boud specified by R OB {R,R 2 R log Y f T x+h 2.,R 2 x}. This ew outer-boud sigificatly improves upo the followig boud R IX ;Y X 2, R 2 IX 2 ;Y 2, R +R 2 IX ;Y +IX 2 ;Y 2., R Fig.. Compariso of the outer-bouds. IV. THE DMIC WITH MIXED INTERFERENCE Defiitio 3: A DMIC is said to have mixed iterferece if it satisfies the Markov chai ad X 2 X,Y 2 Y 3 IX ;Y X 2 IX ;Y 2 X 2 4 for all possible product distributios o X X 2. This defiitio is motivated by GIC with mixed iterferece, which ca be show to be equivalet i capacity regio to a degraded GIC satisfyig 3 by settig py y 2 x x 2 py 2 x x 2 p y x y 2, where p y x y 2 is ormal distributio with mea abx + ay 2 ad variace a. The sum capacity for GIC with mixed iterferece was established i [3]. We obtai a parallel result for the DMIC with mixed iterferece as defied above. Theorem 3: The sum capacity of the DMIC with mixed iterferece satisfyig the two coditios 3 ad 4 is max {IX 2;Y 2 X +mi{ix ;Y,IX ;Y 2}}. 5 px px 2 Proof: I order to achieve this sum rate, user trasmits its message at a rate such that both receivers ca decode it by treatig the sigal from user 2 as oise; user 2 trasmits at the iterferece-free rate sice receiver 2 is able to subtract the iterferece from user X. For the coverse, we prove the followig two sum rate bouds separately: R +R 2 IX ix 2i;Y 2i, 6 R +R 2 IX i;y i+ix 2i;Y 2i X i. 7 For 6, the derivatio follows the same steps as Costa ad El Gamal s result [5]. For 7, we use similar techiques for establishig the sum capacity of the DMZIC with weak iterferece i Sectio III. First, otice that 3 implies IU;Y X IU;Y 2 X 8

5 for ay U whose joit distributio with X,X 2,Y,Y 2 is The, a pu,x,x 2,y,y 2 pupx x 2 upy y 2 x x 2. 9 R +R 2 ǫ IX;Y +IX2;Y 2 X HY i Y i HY i Y i X+HY 2i Y i 2 X b c d HY 2i Y i 2 X2X HY i HY i Y i XY i 2 +HY 2i U ix i HY 2i X 2iX iu i IU ix i;y i+ix 2i;Y 2i U ix i IX i;y i+iu i;y i X i+ix 2i;Y 2i U ix i IX i;y i+iu i;y 2i X i+ix 2i;Y 2i U ix i IX i;y i+ix 2i;Y 2i X i, where a is because of the idepedece betwee X X ad 2 ; b is from the fact that coditioig reduces etropy ad U i X i X,i+ i,y2 ; c is from 8; ad d is because the memoryless property of the chael ad 9. Fially, from 6 ad 7, we have R +R 2 max IX X 2;Y 2, px px 2 R +R 2 max px px 2 IX ;Y +IX 2;Y 2 X, respectively. We give the followig example where the obtaied sum capacity helps determie the capacity regio of a DMIC. Example 2: Cosider the followig determiistic chael: Y X X 2, Y 2 X X 2, where the iput ad output alphabets X, X 2, Y ad Y 2 {0, }. Notice that this chael does ot satisfy the coditio of the determiistic iterferece chael i [6]. Obviously, the Markov chai 3 holds. Moreover, Therefore, IX ;Y X 2HY X 2 px 2 HX, IX ;Y 2 X 2HY 2 X 2 HX. IX ;Y X 2 IX ;Y 2 X 2, for all possible iput product distributios o X X 2. Therefore, this is a DMIC with mixed iterferece. Apply Theorem 3, we compute the sum capacity is C sum max [miix X 2;Y 2,IX ;Y +IX 2;Y 2 X ] px px 2. Give that,0 ad 0, are both trivially achievable, the above sum capacity leads to the capacity regio for this DMIC to be {R,R 2 : R +R 2 }. V. CONCLUSION I this paper, we derived the sum capacity for the DMZICs with weak iterferece where weak iterferece is defied usig a Markov coditio. Similar techiques are the applied to derive the sum capacity for DMIC with mixed iterferece. Both results are aalogous to the sum capacity results for the correspodig Gaussia chael, both i the expressio of the capacity ad i the ecodig schemes that achieve the capacity. The weak iterferece coditio is defied usig a Markov chai, as opposed to that usig the mutual iformatio iequality. While it appears to be somewhat restrictive, it is ot kow whether the defiitio usig the mutual iformatio coditio will lead to the same sum capacity result. REFERENCES [] A. B. Carleial, A case where iterferece does ot reduce capacity, IEEE Tras. If. Theory, vol. 2, o. 5, pp , Sep [2] H. Sato, O the capacity regio of a discrete two-user chael for strog iterferece, IEEE Tras. If. Theory, vol. 24, o. 3, pp , May 978. [3] H. Sato, The capacity of the Gaussia iterferece chael uder strog iterferece, IEEE Tras. If. Theory, vol. 27, pp , Nov. 98. [4] T. S. Ha ad K. Kobayashi, A ew achievable rate regio for the iterferece chael, IEEE Tras. If. Theory, vol. 27, pp , Ja. 98. [5] M. H. M. Costa ad A. El Gamal, The capacity regio of the discrete memoryless iterferece chael with strog iterferece, IEEE Tras. If. Theory, vol. 33, pp. 70-7, Sep [6] A. El Gamal ad M. H. M. Costa, The capacity regio of a class of determiistic iterferece chaels, IEEE Tras. If. Theory, vol. 28, o. 2, pp , Mar [7] H. F. Chog ad M. Motai, The capacity regio of a class of semidetermiistic iterferece chaels, IEEE Tras. If. Theory, vol. 55, o.2,pp , Feb [8] R. Bezel, The capacity regio of a class of discrete additive degraded iterferece chaels, IEEE Tras. If. Theory, vol. 25, o. 2, pp , Mar [9] N. Liu ad S. Ulukus, The capacity regio of a class of discrete degraded iterferece chaels, IEEE Tras. If. Theory, vol. 54, o. 9, pp , Sep [0] J. Xu, H. Che ad B. Che, New observatio o iterferece chaels uder strog/very strog iterferece, i Proc. IEEE Global Commuicatios Coferece Clobecom 200, Miami, FL, December 200. [] I. Saso, O achievable rate regios for the Gaussia iterferece chaels, IEEE Tras. If. Theory, vol. 50, o. 6, pp , Ju [2] X. Shag, G. Kramer ad B. Che, A ew outer boud ad the oisyiterferece sum-rate capacity for Gaussia iterferece chaels, IEEE Tras. If. Theory, vol. 55, o. 2, pp , Feb [3] A. S. Motahari ad A. K. Khadai, Capacity bouds for the Gaussia iterferece chael, IEEE Tras. If. Theory, vol. 55, o. 2, pp , Feb [4] V. S. Aapureddy ad V. V. Veeravalli, Gaussia iterferece etworks: sum capacity i the low-iterferece regime ad ew outer bouds o the capacity regio, IEEE Tras. If. Theory, vol. 55, o. 7, pp , Ju [5] H. F. Chog, M. Motai, ad H. K. Garg, Capacity theorems for the Z chael, IEEE Tras. If. Theory, vol. 53, o. 4, pp , Apr [6] M. H. M. Costa, O the Gaussia iterferece chael, IEEE Tras. If. Thoery, vol. IT-3, o.5, pp , Sep [7] H. S. Witsehause ad A. D. Wyer, A coditioal etropy boud for a pair of discrete radom variables, IEEE Tras. If. Theory, vol. 2, o. 5, pp , Sep. 975.