THE classical noiseless index coding problem consists of. Lattice Index Coding. arxiv: v3 [cs.it] 7 Oct 2015

Transcription

1 Lattie Index Coding Lakshmi Natarajan, Yi Hong, Senior Member, IEEE, and Emanuele Viterbo, Fellow, IEEE arxiv: v3 [s.it] 7 Ot 05 Abstrat The index oding problem involves a sender with K messages to be transmitted aross a broadast hannel, and a set of reeivers eah of whih demands a subset of the K messages while having prior knowledge of a different subset as side information. We onsider the speifi ase of noisy index oding where the broadast hannel is Gaussian and every reeiver demands all the messages from the soure. Instanes of this ommuniation problem arise in wireless relay networks, sensor networks, and retransmissions in broadast hannels. We onstrut lattie index odes for this hannel by enoding the K messages individually using K modulo lattie onstellations and transmitting their sum modulo a oarse lattie. We introdue a design metri alled side information gain that measures the advantage of a ode in utilizing the side information at the reeivers, and hene, its goodness as an index ode. Based on the Chinese remainder theorem, we then onstrut lattie index odes with large side information gains using latties over the following prinipal ideal domains: rational integers, Gaussian integers, Eisenstein integers, and the Hurwitz quaternions. Among all lattie index odes onstruted using any densest lattie of a given dimension, our odes ahieve the maximum side information gain. Finally, using an example, we illustrate how the proposed lattie index odes an benefit Gaussian broadast hannels with more general message demands. Index Terms Chinese remainder theorem, Gaussian broadast hannel, index oding, lattie odes, prinipal ideal domain, side information. I. INTRODUCTION THE lassial noiseless index oding problem onsists of a sender with K independent messages w,..., w K, and a noiseless broadast hannel, where eah reeiver demands a subset of the messages, while knowing the values of a different subset of messages as side information. The transmitter is required to broadast a oded paket, with the least possible length, to meet the demands of all the reeivers see [] [6] and referenes therein. In the noisy version of this problem, the messages are to be transmitted aross a broadast hannel with additive white Gaussian noise AWGN at the reeivers see [7] [5] and referenes therein. The exat apaity region the ahievable rates of the K messages with general message demands and side informations is known only for the two-reeiver ase [7], [8]. We onsider the speial ase of noisy index oding where every reeiver demands all the messages at the soure. Instanes of this ommuniation problem are enountered in This work was supported by the Australian Researh Counil ARC Disovery Projet ARC DP The material in this paper was presented in part at the IEEE Information Theory Workshop, Jerusalem, April 6 May 0, 05. The authors are with the Department of Eletrial and Computer System Engineering, Monash University, VIC 3800, Australia {lakshmi.natarajan, yi.hong, emanuele.viterbo}@monash.edu. Copyright 04 IEEE. Personal use of this material is permitted. However, permission to use this material for any other purposes must be obtained from the IEEE by sending a request to pubs-permissions@ieee.org. wireless relay networks [8] [0], retransmissions in broadast hannels [], and ommuniations in sensor networks [5]. Fig. illustrates a wireless version of the butterfly network where noisy index oding is useful. Two data pakets w and w, whih are available at the base stations BS and BS, respetively, are to be broadast to all three users U, U, U 3 in the network through a deode-and-forward helper node BS 3. The nodes U and BS 3 are within the range of BS, U and BS 3 are within the range of BS, and all three users are in the range of BS 3. In the first phase of the protool, both BS and BS simultaneously broadast their orresponding data pakets. While U and U deode w and w, respetively, the helper node BS 3 experienes a multiple-aess hannel and deodes both the messages. In the seond phase of the protool, BS 3 broadasts w and w to all three users. While U and U are aided by the data pakets reeived in the first phase of the protool, no suh side information is available at U 3. The traditional approah of broadasting the bit-wise XOR of w and w in the seond phase is not useful, sine it does not satisfy the demands of U 3. On the other hand, performing index oding at the physial layer will allow us to onvert the side informations at U and U into performane gains while meeting the demands of all three reeivers. Noisy index oding for broadasting ommon messages is also useful in the retransmission phase of satellite broadasting servies, whih was the original motivation for onsidering noiseless index odes []. Consider a satellite downlink, as shown in Fig., where a ommon message onsisting of K data pakets is broadast to multiple terrestrial reeivers. Due to varying hannel onditions, eah reeiver suessfully deodes possibly different parts of the transmitted frame. In the retransmission phase of the protool, the satellite an use a noisy index ode to simultaneously broadast the K pakets while exploiting the side informations at all the reeivers. A. Bakground The apaity region of the ommon message Gaussian broadast hannel with reeiver side information follows from the results in [5]. Denote a reeiver by SNR, S, where SNR is the signal-to-noise ratio, and S {,..., K} is the index set of the messages w S = w k, k S whose values are known at the reeiver as side information. Note that this terminology inludes the ase S =, i.e., no side information. Let R,..., R K be the rates of the individual messages in bits per dimension b/dim, i.e., the number of bits to be transmitted per eah use of the broadast hannel. The soure entropy is R = R + + R K, and the side information rate at SNR, S is defined as R S k S R k. The rate tuple

2 a Phase : BS and BS transmit files w and w. b Phase : BS 3 transmits w and w using noisy index oding. Fig.. Common message broadast with reeiver side information in the wireless butterfly network: a BS and BS simultaneously broadast files w and w. At the end of Phase, U reeives w, U reeives w, and BS 3 reeives both. b In Phase, BS 3 transmits w, w using noisy index oding to utilize side information at U and U while being intelligible to U 3. R,..., R K is ahievable if and only if [5] log + SNR > Hw,..., w K w S = R R S, for every reeiver SNR, S. Consequently, at high message rates, the presene of the side information orresponding to S at a reeiver redues the minimum required SNR from approximately R to R R S, or equivalently, by a fator of R S 0 log 0 db 6R S db. Hene, a apaity-ahieving index ode allows a reeiver to transform eah bit per dimension of side information into an apparent SNR gain of approximately 6 db. The notion of multiple interpretation was introdued in [6] as a property of error orreting odes that allows the reeiver performane to improve with the availability of side information. Binary multiple interpretation odes based on nested onvolutional and yli odes were onstruted in [7] and [8], respetively. These odes an be viewed as index odes for the noisy binary broadast hannel. To the best of our knowledge, there has been no prior work in designing index odes for the AWGN broadast hannel. B. Contributions In this work, we propose lattie index odes C for the AWGN broadast hannel, in whih the K messages are individually mapped to K modulo lattie onstellations, and the transmit symbol is generated as the sum of the individual symbols modulo a oarse lattie. Given the value of w S as side information, the optimal deoder restrits its hoie of symbols to a subset of C, thereby inreasing the minimum squared Eulidean distane between the valid odewords. We use this squared distane gain, normalized by the side information rate R S, as the design metri, and all it the side information gain of the ode C. We first motivate our results using a simple onedimensional lattie ode over Z Setion II, and then show that 0 log 0 6 db/b/dim is an upper bound on the side information gain of lattie index odes onstruted from densest latties Setion III. Note that this upper bound haraterizes the maximum squared distane gain, and is independent of the information theoreti result of [5] whih haraterizes the SNR gain asymptotially in both the ode dimension and probability of error. Based on the Chinese remainder theorem, we onstrut index odes for the AWGN hannel using latties over the following prinipal ideal domains PIDs: rational integers Z, Gaussian integers Z[i], Eisenstein integers Z[ω], and the Hurwitz quaternion integers H Setions IV and V. All the proposed lattie index odes provide a side information gain of 0 log 0 db/b/dim. Among all lattie index odes onstruted using the densest latties in any given dimension, our odes provide the optimal side information gain. Finally, using the example of a three reeiver Gaussian broadast hannel with private message requests, we illustrate how the proposed lattie index odes an be utilized under more general message demands Setion VI. C. Reent results Sine the submission of the initial version of this paper, further results on index odes for the ommon message Gaussian broadast hannel have been reported. The lattie index odes presented in this paper are designed using tuples of distint prime numbers, and hene, the resulting rates of the K messages are not all equal to eah other, and the alphabet sizes of the messages are not powers of. New lattie index odes are reported in [9] that generalize the Z[i] and Z[ω] based onstrutions of Setion IV to arbitrary algebrai number fields. Further, [9] onstruts sequenes of lattie index odes, that onsist of one ode for eah value of K, for enoding all the K messages at the same rate. Index odes based on multidimensional pulse amplitude modulation PAM onstellations have been obtained in [0] that enode all the messages at the same rate and allow alphabet sizes that are powers of. In [], the ahievable rate region of a onatenated oding sheme that uses an inner index ode for modulation and K independent outer hannel odes for noise

3 3 a Original broadast phase. b Retransmission phase: reeivers have side information. Fig.. Common message broadast with reeiver side information in satellite ommuniations: a The satellite broadasts a ommon message ontaining K data pakets to multiple terrestrial reeivers. Due to intermittent hannel variations, eah reeiver suessfully deodes only a subset of the K pakets. Here, the first reeiver deodes w, w, the seond w 3, and the third w, w K. b In the retransmission phase the satellite performs noisy index oding to exploit this side information at the reeivers. resiliene has been analyzed. This onatenated sheme has been shown to onvert the noisy index oding hannel into a multiple-aess hannel and perform lose to the hannel apaity. Notation: We use i = and ω = exp iπ 3. The symbol S denotes the omplement of the set S, and is the empty set. For a omplex number m, the symbols m, Rem and Imm denote the onjugate, the real part, and the imaginary part of m, respetively. The operator is the transpose of a matrix or a vetor, and is the Eulidean norm of a vetor. II. MOTIVATING EXAMPLE The lattie index odes proposed in Setions IV and V ahieve a large side information gain by providing a squared distane gain that is exponential in the side information rate R S for S {,..., K}. In this setion, we illustrate the key idea behind our onstrution using a simple one-dimensional lattie index ode Example. Let w,..., w K be K independent messages at the soure with alphabets W,..., W K, respetively. The transmitter jointly enodes the information symbols w,..., w K, to a odeword x C, where C R n is an n-dimensional onstellation. The rate of the k th message is R k = n log W k b/dim, k =,..., K. Given the hannel output y = x + z, where z is the additive white Gaussian noise, and the side information w S = a S, i.e., w k = a k for k S, the maximum-likelihood deoder at the reeiver SNR, S restrits its searh to the subode C as C obtained by expurgating all the odewords in C that orrespond to w S a S. Denote the minimum distane between any two points in C by d 0. Let d as be the minimum distane of the subode C as, and d S be the minimum of d as over all possible values a S of side information w S. Then the minimum squared distane gain orresponding to the side d S information index set S is 0 log 0 db. d 0 The performane improvement at the reeiver due to S is observed as a shift in the probability of error urve versus d S SNR to the left. The squared distane gain 0 log 0 db d 0 is a first-order estimate of this apparent SNR gain. Normalizing with respet to the side information rate R S = k S R k, and minimizing over all subsets S, we see that eah bit per dimension of side information provides a squared distane gain of at least d S 0 log 0 d ΓC min 0. S R S We all ΓC the side information gain of the ode C, and its unit is db/b/dim. For a given ode C, the gain available from S is at least R S ΓC db with respet to the baseline performane of C in the lassial point-to-point AWGN hannel, i.e., with no side information. For C to be a good index ode for the AWGN broadast hannel, we require that C be a good point-to-point AWGN ode, in order to minimize the SNR requirement at the reeiver with no side information; and ΓC be large, so as to maximize the minimum gain from the availability of side information at the other reeivers. An additional desirable property is that the normalized d S gain 0 log 0 /R d S provided by the lattie index ode be 0 onstant for every S, i.e., Γ C = d S 0 log 0 d 0 for every S {,..., K}. R S We say that a lattie index ode provides uniform gain if it satisfies. A neessary and suffiient ondition for a lattie index ode to be a uniform gain ode is that d S is exponential in R S. All the index odes onstruted in Setions IV and V are uniform gain lattie index odes with ΓC 6 db/b/dim. Example. Consider K = 3 independent messages w, w and w 3 assuming values from W = {0, }, W = {0,, } and W 3 = {0,,, 3, 4}, respetively. The three messages are enoded to a ode C Z using the funtion x = 5w + 0w + 6w 3 mod 30,

4 4 Fig. 3. Performane of the ode of Example for three different reeivers. where the operation a mod 30 gives the unique remainder in C = { 5, 4,..., 3, 4} when the integer a is divided by 30. Using Chinese remainder theorem [], it is easy to verify that C is the set of all possible values that the transmit symbol x an assume. Sine the dimension of C is n =, the rate of the k th message is R k = log W k b/dim, i.e., R =, R = log 3, and R 3 = log 5 b/dim. With no side information, a reeiver deodes the hannel output to the nearest point in C, with the orresponding minimum inter-odeword distane d 0 =. With S = {}, the reeiver knows the value of the first message w = a. The deoder of this reeiver restrits the hoie of transmit symbols to the subode C a = {5a + 0w + 6w 3 mod 30 w W, w 3 W 3 }. Any two points in this subode differ by 0 w + 6 w 3, where w and w 3 are integers, not both equal to zero. Sine the greatest ommon divisor gd of 0 and 6 is gd0, 6 =, the minimum non-zero magnitude of 0 w + 6 w 3 is []. Hene, the minimum distane orresponding to the side information index set S = {} is d S =. The side information rate is R S = R = b/dim, whih equals log d S. When S = {, }, the set of possible transmit symbols is C a,a = {5a + 0a + 6w 3 mod 30 w 3 W 3 }, where w = a and w = a are known. The minimum distane of this subode is d S = 6, and the side information rate is R S = R + R = log 6 = log d S b/dim. Similarly, for every hoie of S {,, 3}, we have R S = log d S, i.e., the minimum distane d S is exponential in the side information rate R S. As will be shown in Setions IV and V, this property is satisfied by all the proposed lattie index odes. Using R S = log d S in, we see that the side information gain is uniform, and Γ = 0 log 0 6 db/b/dim. In Setion III-C we show that this is the maximum side information gain ahievable by any index ode C Z in whih the messages are linearly enoded. Fig. 3 shows the performane of the ode with S =, S = {} and S = {, }. At the probability of error of 0 4, the side informations orresponding to S = {} and S = {, } provide SNR gains of 6 db and 5.6 db over S =. This is lose to the orresponding squared distane gains of 0 log 0 db and 0 log 0 6 db, respetively. We now give an example of a non-uniform gain index ode with Γ > 0 log 0 db/b/dim based on a non-lattie onstellation. This example also highlights the notion that, given a onstellation C, the task of designing a good index ode is equivalent to designing a good labelling sheme. Example A -message index ode using 6-PSK. We enode K = messages with alphabets W = W = {0,,, 3} to the 6-PSK onstellation C. The enoder ρ : W W C is represented as a labelling sheme in Fig. 4a where eah of the 6 onstellation points x is labelled with the orresponding message tuple w, w = ρ x. The dimension of the ode is n =, and the message rates are R = R = log 4 = b/dim. A reeiver with no side information, i.e., with S =, deodes the reeived hannel vetor to the nearest 6-PSK onstellation point. The error performane at this reeiver is equal to that of the 6-PSK signal set. Assuming that the onstellation points have unit energy, the orresponding minimum Eulidean distane at this reeiver is d 0 = sin π 6.

5 a The 6-PSK index ode represented as a labelling sheme Fig. 4. b The filled irles denote the odewords orresponding to w = 0. The 6-PSK index ode of Example that enodes two 4-ary messages and provides Γ = 9. db/b/dim. The filled irles denote the odewords orresponding to w = 0. If S = {}, the reeiver has the knowledge of the value of the first message w. For example, if w = 0, this reeiver knows that the transmitted vetor is one of the four points in the set {ρ0, w w W }; see Fig. 4b. The minimum Eulidean distane of this subode is sin π 4 =. The minimum Eulidean distane orresponding to the other three values of w is also. Hene, for S = {}, we have d S = and the normalized squared distane gain is d S 0 log 0 /R d S =. db/b/dim. 0 A reeiver with S = {} deodes its hannel output to one of the four subodes of C determined by the value of w obtained as side information. The subode for w = 0 is shown in Fig. 4. All four subodes have minimum Eulidean distane d S = sin 3π 6. The squared distane gain for S = {} normalized by R S is 9. db/b/dim. To onlude, this 6-PSK index ode does not have uniform gain, and has Γ = min{., 9.} = 9. db/b/dim. Example 3 A bad index ode. Labelling a given onstellation C by set partitioning [3] is apparently a related problem, but it does not neessarily provide good index odes. In set partitioning with binary labels w,..., w K, the onstellation C is reursively partitioned into two smaller signal sets with larger minimum distane. For any S = {,,..., k}, k < K, the set of points with a given label w S = a S forms one of the k k th -level partitions of C. The minimum distane of the partition improves with inreasing k. Fig. 5 shows one suh labelling of 6-QAM, with K = 4, where the knowledge of the values of the first k bits w,..., w k inreases the minimum distane from d 0 = to d S = k. However, this does not guarantee squared distane gain for every side information index set S {,..., K}. For instane, the side information w, w 3, w 4 = 0, 0, 0, orresponding to S = {, 3, 4}, does not provide any improvement in minimum distane. The performane of the ode of Fig. 5 for S =, S = {, } and S = {, 3, 4} is shown in Fig. 6. When the error rate is P e = 0 4, the knowledge of the first two bits provides an SNR gain of 6. db. However, the SNR gain with S = {, 3, 4} is only db at P e = 0 4 and is smaller for diminishing P e. Set partition labelling is designed to provide squared distane gain when S is of the form {,,..., k} for k < K. When restrited to suh side information index sets, set partitioning provides side information gain 6 db/b/dim. The odes in Examples and allow us to ahieve side information

6 Fig. 5. A set partition labelling of 6-QAM. The two points marked with irles form the subode for the side information w, w 3, w 4 = 0, 0, 0. gains when S is any subset of {,..., K}. III. LATTICE INDEX CODES We first review the neessary bakground on latties and lattie odes, based on [4] [6] Setion III-A, introdue lattie index odes Setion III-B, and then derive an upper bound on the side information gain of suh odes onstruted from the densest latties Setion III-C. A. Latties and lattie odes An n-dimensional lattie in R n is a disrete additive subgroup Λ = {Gz z Z n }, where the full-ranked matrix G R n n is alled the generator matrix of Λ. Sine the differene between any two lattie points is also a lattie point, the minimum distane d min Λ between any two points in Λ is the Eulidean length of the shortest non-zero vetor of Λ. The losest lattie point quantizer Q Λ : R n Λ is Q Λ x = λ if x λ x λ for every λ Λ, where x R n, λ Λ, and ties if any between ompeting lattie points are broken systematially. The fundamental Voronoi region V Λ is the set of all points in R n that are mapped to 0 under Q Λ. The volume of the fundamental region VolΛ = V Λ dx is related to the generator matrix G as VolΛ = det G. The paking radius r pak Λ = dminλ is the radius of the largest n-dimensional sphere ontained in the Voronoi region V Λ. The enter density of Λ is δλ = r pakλ n VolΛ = dminλ VolΛ n. 3 The enter density of a lattie is invariant to saling, i.e., δλ = δαλ for any non-zero α R. If Λ is saled by α = d, then r minλ pak αλ = and δ = VolαΛ is the average number of points in αλ per unit volume in R n, i.e., δ is the density of the lattie points in R n when saled to unit paking radius. For the same average transmit power onstraint and minimum distane, a onstellation arved from a lattie with a higher value of δ has a larger size, and hene, a higher oding gain. The densest latties are known for dimensions n =,,..., 8 and n = 4 [4], [7]. For n =,..., 8, the densest latties are Z, A, D 3, D 4, D 5, E 6, E 7 and E 8, respetively, while the Leeh lattie Λ 4 is densest in 4 dimensions. The lattie D 4 is equivalent to its dual lattie D4 up to saling and orthogonal transformation. Hene, D4 too has the highest density in 4 dimensions. The modulo-λ operation x mod Λ = x Q Λ x V Λ, is the differene between a vetor and its losest lattie point, and it satisfies the relation x + x mod Λ = x mod Λ + x mod Λ 4 for all x, x R n. Let Λ Λ be a sub-lattie of Λ, and Λ/Λ be the quotient group of the osets of Λ in Λ. Eah oset of Λ/Λ an be identified by its representative ontained in V Λ. We will identify the group Λ/Λ with the group of oset leaders Λ V Λ = Λ mod Λ, where addition is performed modulo Λ. Further, Λ/Λ = Λ mod Λ = VolΛ VolΛ. The onstellation Λ/Λ is alled a nested lattie ode, and Λ is alled the oarse lattie or the shaping lattie [5], [6].

7 7 Fig. 6. Performane of set partition labelling of Example 3. B. Lattie index odes Consider K latties Λ,..., Λ K, with a ommon sub-lattie Λ Λ k, k =,..., K. We will use the lattie onstellations Λ /Λ,..., Λ K /Λ as the alphabets W,..., W K of the K messages at the soure. Definition. A lattie index ode for K messages onsists of K lattie onstellations Λ /Λ,..., Λ K /Λ, and the injetive linear enoder map ρ : Λ /Λ Λ K /Λ C given by ρ x,..., x K = x + + x K mod Λ, 5 where x k Λ k /Λ and C is the set of all possible values of the transmit symbol x = ρx,..., x K. We require that ρ be injetive so that no two message tuples are mapped to the same transmit symbol. We now relate some properties of a lattie index ode to those of its omponent lattie onstellations Λ /Λ,..., Λ K /Λ. The transmit odebook C : Let Λ = Λ + + Λ K be the lattie generated by the union of the latties Λ,..., Λ K. It follows from 5 that x + + x K Λ, and hene x Λ/Λ. On the other hand, every point in Λ is the sum of K lattie points, one eah from Λ,..., Λ K. It follows from 4 that every point in the lattie onstellation Λ/Λ is the mod Λ sum of K points, from Λ /Λ,..., Λ K /Λ, respetively. Hene, the transmit odebook is C = Λ/Λ. Message rates: If Λ is an n-dimensional lattie, the rate of the k th message is R k = n log W k = n log Λ k /Λ = n log VolΛ VolΛ k b/dim. Minimum distane: Sine C = Λ/Λ is arved from the lattie Λ, the minimum inter-odeword distane with no side information is d 0 = d min Λ. 6 Now suppose that a reeiver has side information of the messages with indies in S, say x S = a S i.e., x k = a k, k S. The subode C as deoded by the reeiver is { k S k S a k + k S x k xk Λ k /Λ, k S } mod Λ = a k + Λ k /Λ mod Λ k S = a k + Λ k mod Λ, k S k S where we have used 4. Thus, C as is a lattie ode arved from a translate of the lattie k S Λ k, and hene its minimum distane is d S = d min Λ k. 7 k S Example 4. The ode in Example is a lattie index ode with K = 3, Λ = 5Z, Λ = 0Z, Λ 3 = 6Z, Λ = 30Z and Λ = 5Z + 0Z + 6Z = Z. The transmit odebook C = Λ/Λ of a lattie index ode is a ommutative group under addition modulo Λ, and Λ /Λ,..., Λ K /Λ are subgroups of C. It follows from Definition that the enoding map ρ is a group isomorphism between C and the diret produt Λ /Λ Λ K /Λ of the subgroups Λ /Λ,..., Λ K /Λ, i.e., C is a diret sum

8 8 of these K subgroups. Thus, the problem of designing a good lattie index ode is to onstrut a pair Λ Λ of nested latties, and to find a deomposition of Λ/Λ into K subgroups, suh that d S = d min k S Λ k is large for every hoie of S {,..., K}. While onstrutions of pairs Λ Λ of latties [5], [6] and hains Λ Λ Λ of nested latties [6] are well known in the literature, we require a lattie ode Λ/Λ and a set of its generating subodes Λ /Λ,..., Λ K /Λ suh that all non-trivial diret sums k S Λ k/λ, S {,..., K}, of the K subodes have large minimum Eulidean distanes. In Setions IV and V, we onstrut index odes using latties that possess the multipliative struture of a prinipal ideal domain PID or that of a module over a PID, besides the additive struture of a ommutative group. The struture of a PID or a module over a PID enables us to ontrol the minimum Eulidean distane d S, and hene the side information gain Γ, of the resulting odes. When the underlying PID is ommutative Setion IV, we use the Chinese remainder theorem to onstrut pairs Λ Λ of nested latties and deompose the resulting ode Λ/Λ into a diret sum of K lattie subodes. We then onstrut lattie index odes using the Hurwitz integral quaternions as the base PID Setion V. The Chinese remainder theorem does not apply to quaternions due to the tehnial reason that they are non-ommutative and their ideals are not two-sided. Nevertheless, we design a family of quaternioni lattie index odes by identifying the essential onstituents of the tehniques used in Setion IV and extending them to the non-ommutative ase. C. An upper bound on the side information gain Consider the side information index set S = {,..., K }. The minimum distane is d S = d min k S Λ k = d min Λ K, and the side information rate is R S = R + + R K = n log C R K = n log Λ/Λ n log Λ K /Λ = n log VolΛ VolΛ n log VolΛ VolΛ K = n log VolΛ K VolΛ. Representing the volume of the fundamental region in terms of the minimum distane d min and the enter density δ see 3, R S = n n log dmin Λ K + d min Λ n log δλ δλ K d S = log + d 0 n log δλ δλ K, 8 If Λ is the densest lattie in n dimensions, then δλ δλ K, and hene R S log d0. Thus the side information gain of C an be upper bounded as follows 0 log 0 d 0 0 log 0 d0 ΓC = min S R S R S 0 log 0 d0 = 0 log 0 6 db/b/dim. log d0 This upper bound on the side information gain holds only for the family of lattie index odes in whih the underlying lattie Λ has the highest density in its dimension, suh as when Λ is Z, A or D4. This upper bound is independent of the information-theoreti result of [5] whih guarantees the existene of odes that provide an SNR gain of 6 db for eah b/dim of side information at the reeiver. The SNR gain of 6 db/b/dim of [5] holds for apaity-approahing noisy index odes at finite values of SNR in the asymptoti regime where the ode dimension goes to infinity and the probability of error is arbitrarily small. On the other hand, Γ measures the squared distane gain at a finite ode dimension, and approximates the SNR gain due to reeiver side information in the high SNR regime. When Λ is not the densest lattie in R n, for example when Λ = Z, it is possible to have δλ K > δλ. In suh ases, from 8, R S < log d0, and Γ may exeed 6 db/b/dim. Note that Γ is a relative gain measured with respet to the performane of C = Λ/Λ with no side information. Any amount of side information gain available over and above 6 db/b/dim is due to the lower paking effiieny of Λ when ompared to Λ K, and hene due to the ineffiieny of C as a ode in the point-to-point AWGN hannel. We now give an example of suh a lattie index ode with side information gain more than 6 db/b/dim. Example 5. Consider K = latties Λ and Λ with generator matries G = and G 0 3 =, 9 4 respetively, and the oarse lattie Λ = Z. The above latties have been arefully hosen so that the densities of Λ and Λ are greater than that of their sum lattie Λ = Λ + Λ. In order to prove that this hoie of Λ, Λ and Λ indeed defines a valid lattie index ode, we first show that Λ is a sub-lattie of Λ and Λ, we then identify the transmit lattie Λ and the odebook C, and then show that the enoding map ρ is injetive. Finally, we ompute the minimum distanes of Λ, Λ and Λ, and the side information gain Γ. The following identities show that the basis vetors, 0 and 0, of Λ = Z an be expressed as integer linear ombinations of the olumns of G, and hene, Λ Λ : = , and 0 = Similarly, the proof for Λ Λ follows from the observation = + 4, and =

9 9 In order to identify the lattie Λ = Λ + Λ, we first note that Λ, Λ Z, and hene, Λ Z. The following expressions show that the basis vetors, 0 and 0, of Z are integer linear ombinations of the olumns of G and G : =, = We onlude that Λ Z, and therefore, Λ = Z. The transmit odebook C = Λ/Λ is Z /Z. Thus, the enoding map ρ has domain Λ /Λ Λ /Λ and range C. The ardinality of the domain is Λ /Λ Λ /Λ = VolΛ VolΛ VolΛ VolΛ = = 44, and that of the range is C = Λ/Λ = VolΛ VolΛ = 44 = 44. Sine the domain and range are of the same ardinality, ρ is injetive, and onsequently, C is a lattie index ode. The dimension of this ode is n =, and the message rates are R = R = log b/dim. To alulate the side information gain of this ode we require the values of d 0 and d S, S = {}, {}. From 6, d 0 = d min Λ = d min Z =. From 7, d S = d min Λ for S = {}, and d S = d min Λ for S = {}. We now show that d min Λ = 3. The proof for d min Λ = 3 is similar. From 9, we observe that every non-zero vetor x Λ is of the form 4a + b, 3b for some a, b Z, both not equal to zero. The squared Eulidean length of x is x = 4a + b + 9b. We now lower bound the value of x based on the value of b. If b = 0, x = 4a 6. If b is non-zero and even, we have x = 4a+b +9b 9b 9 = 36. When b is non-zero and odd, we have a + b, and hene, x = 4a+b +9b = 4a+b +9b 4+9b 3. We onlude that x 3 for every non-zero x Λ. On the other hand, the hoie of a = 0, b = yields a vetor x with x = 3. It follows that d min Λ = 3. The non-trivial subsets of {,..., K} = {, } are S = {} and S = {}. For both these hoies of S, we have d S 0 log 0 d 0 = 0 log 0 3 R S log = 0 log 0 log 0 3 log 0 6. db/b/dim. Sine the normalized squared distane gain is the same for all hoies of S {,..., K}, we onlude that C is a uniform gain lattie index ode with Γ 6. db/b/dim. The reason for Γ to be more than 6 db/b/dim is that the latties Λ and Λ have a larger enter density than Λ. For both k =,, δλ k = dminλ k while δλ = δz = 4. VolΛ k n = 3 = 3 48, IV. CONSTRUCTION OF LATTICE INDEX CODES USING COMMUTATIVE PIDS In this setion, we onstrut uniform gain index odes using latties over ommutative PIDs Z, Z[i] and Z[ω] with Γ 6 db/b/dim. This inludes the lattie Z, and the hexagonal lattie A with generator matrix 0 3 whih an be identified with Z[i] and Z[ω], respetively. In Setion V we onsider latties over the Hurwitz integers whih form a non-ommutative PID. A. Review of ommutative PIDs and omplex latties We assume that the reader is familiar with the notions of ideals and prinipal ideal domains. We now briefly reall some basi definitions and properties related to ommutative PIDs and omplex latties. We refer the reader to [4] and [8] for further details. Commutative PIDs: Let D be a ommutative ring with 0. An ideal I in D is an additive subgroup of D with the property that ab I for every a I and b D. The ideal generated by an element a is the smallest ideal ontaining a, and is given by ad = {ab b D}. An ideal I is prinipal if it is generated by a single element of D, i.e., I = ad for some a D. If the produt of any two non-zero elements of D is non-zero, D is said to be an integral domain. If every ideal of an integral domain D is prinipal, then D is a prinipal ideal domain PID. In the rest of this setion we will assume that D is a ommutative PID. For a, b D we say that a is a divisor of b, i.e., a b if b = da for some d D. The units of D are the divisors of, i.e., they are the elements with a multipliative inverse. Two elements a, b D are assoiates if a = ub or equivalently, b = u a for some unit u. The gd of a and b is the generator of the smallest ideal ontaining a and b, i.e., ad + bd = gda, bd. The gd is unique up to multipliation by a unit. If d a and d b, then d gda, b. Two elements a and b are relatively prime if gda, b is a unit. A non-unit φ D is prime if φ ab implies that either φ a or φ b. A prime an not be expressed as a produt of two non-units. Any two non-assoiate primes are relatively prime. Every PID is a unique fatorization domain, i.e., every non-zero element of D an be fatored as a produt of primes, uniquely up to multipliation by units. If a = φ e φe K K, is the fatorization of a as a produt of nonassoiate primes φ,..., φ K, and d a, then d = uφ e φe K K, where u is a unit and e k e k for k =,..., K. Complex latties: Let D be either Z[i] or Z[ω]. A D-lattie Λ is a disrete subgroup of a omplex Eulidean spae that is losed under multipliation by elements m D. Sine every D-lattie is isomorphi to a real lattie of twie its dimension, we will denote its omplex dimension by n, where the even integer n is the real dimension. Let { } n Λ = Gz z D

10 0 be a D-lattie with the full-rank generator matrix G C n n. Let Ψ : C n R n be the isomorphism that maps the omplex vetor v,..., v n to the real vetor Rev,..., Rev n, Imv,..., Imv n. The real lattie assoiated with Λ is { Λ = Ψ Λ = Ψv v Λ } R n. The lattie Λ is alled Gaussian if D = Z[i], and Eisenstein if D = Z[ω]. The hexagonal lattie A, the root lattie E 6, and the Coxeter-Todd lattie K an be viewed as Eisenstein latties, while the hekerboard lattie D 4, the Gosset lattie E 8, the laminated latties Λ max, Λ 6, and the Leeh lattie Λ 4 an be viewed as both Gaussian and Eisenstein latties. If D = Z[i], the real generator matrix G of Λ is related to the omplex generator matrix G as Re G Im G G = Im G Re G, 0 and if D = Z[ω], Re G Re G + 3Im G G = Im G Im G 3Re G. Sine Ψ preserves addition, for any two omplex latties Λ, Λ, we have Ψ Λ + Λ = Ψ Λ + Ψ Λ. Also, Λ Λ if and only if Ψ Λ Ψ Λ. We will use the symbols Vol Λ and d min Λ to denote the volume and the length of the shortest vetor of the assoiated real lattie Λ, i.e., Vol Λ Vol Ψ Λ and d min Λ d min Ψ Λ. For both Gaussian and Eisenstein latties, saling Λ by a omplex number m C is equivalent to left-multiplying the real generator matrix G by Rem I Imm I Mm =, Imm I Rem I where I is the identity matrix of dimension n n. Observing that Mm is an orthogonal matrix with determinant m n, we have Volm Λ = det Mm det G = m n VolΛ, and d min m Λ = m d min Λ. B. Constrution of index odes using ommutative PIDs Let D C be a ommutative PID. Consider K nonassoiate primes φ,..., φ K D, and their produt M = K k= φ k. The Chinese remainder theorem [, page 59] states that the diret produt D/φ D D/φ K D is isomorphi to the quotient ring D/M D. The one-to-one orrespondene between them is obtained using the map w,..., w K w M + w M + + w K M K mod MD, where w k D/φ k D and M k = M φ k. Sine w k M k is an element of M k D/MD, we observe that enoding the K soure messages individually using the onstellations M D/MD,..., M K D/MD, and generating the transmit symbol as their modulo-md sum gives an injetive enoding map. Further, given the side information w S = a S, orresponding to the index set S {,..., K}, the minimum distane d S between the valid odewords an be readily obtained as the magnitude of gdm k, k S f. Example. The odebook D/MD an be thought of as a lattie index ode built over the one-dimensional D-lattie Λ = D. In this setion, we apply this enoding tehnique to arbitrary D-latties and show that the resulting lattie index odes provide large side information gains. We first desribe our onstrution with omplex latties, i.e., D = Z[i] and Z[ω], and prove that it provides a uniform side information gain Γ 6 db/b/dim. We then briefly desribe the ase D = Z, the proof of whih follows from simple modifiations of the proofs of Lemmas and 3 below. Constrution of index odes using omplex latties Let D be Z[i] or Z[ω], and φ,..., φ K be any K distint non-assoiate primes in D. Let M = K k= φ k, and M k = M φ k = φ l for k =,..., K. Let Λ be any D-lattie of real dimension n, and Λ = Ψ Λ be its real version. We onstrut our lattie index ode by setting Λ = ΨM Λ, and Λ k = ΨM k Λ, k =,..., K. 3 Sine M k M, we have M Λ M k Λ, and hene, the oarse lattie Λ is a sub-lattie of eah Λ k, k =,..., K. Using, the message size of the k th symbol is Λ k /Λ = and its rate is VolM Λ = M n VolΛ VolM k Λ M k n VolΛ = φ k n, R k = n log φ k n = log φ k b/dim. Tables I and II list the first few non-assoiate Gaussian and Eisenstein primes, respetively. These are unique up to unit multipliation. In Table II, ω = ω is the omplex onjugate of ω = exp iπ 3. The tables also show the norm φ of the prime φ, and the orresponding message rate log φ in b/dim. Example 6. The lattie Λ = D 4 is a Gaussian lattie with the omplex generator matrix 0 G =. + i

11 TABLE I ALL NON-ASSOCIATE GAUSSIAN PRIMES OF NORM UP TO 53 Norm Prime Rate φ φ log φ + i i, i i, 3i i, 4i i, 5i i, 6i i, 4 5i i, 7i.86 TABLE II ALL NON-ASSOCIATE EISENSTEIN PRIMES OF NORM UP TO 6 Norm Prime Rate φ φ log φ 3 ω ω, + 3ω ω, + 4ω ω, + 5ω ω, + 6ω ω, 3 + 7ω ω, + 7ω ω, 4 + 9ω.97 Using 0, we obtain the 4 4 real generator matrix G = Let K =, φ = + i and φ = + i. Then M = + 3i, M = + i and M = + i. The real generator matrix of Ψm Λ is Mm G. The generator matries of Λ = ΨM Λ, Λ = ΨM Λ and Λ = ΨM Λ, thus obtained, are G = 3 0 0, G = and G = , 3 4 respetively. The message sizes are Λ /Λ = 4, Λ /Λ = 5, and the rates are R = log + i = b/dim and R = log + i = log 5 b/dim. The following lemma will be useful in deriving the side information gain of the proposed lattie index odes. Lemma. For every index set S, we have gdm k, k S = l S φ l. Proof: Let d = gdm k, k S. Sine eah M k is a produt of a subset of the primes φ,..., φ K, d = gdm k, k S is of the form φ e φe K K with e k {0, }. If k S, we have d M k, and sine φ k is not a fator of M k, we obtain e k = 0. It follows that d l S φ l. On the other hand, it is easy to verify that l S φ l M k for every k S, implying that l S φ l d. Hene, d = l S φ l. We now show, in Lemma, that the lattie index ode C is Λ/Λ and the enoding map ρ is injetive. Part ii of Lemma will later allow us to show that the minimum distane d S with side information index set S is exponential in R S. Lemma. With the latties Λ,..., Λ K and Λ defined as 3, i the enoding map ρ in Definition generates a lattie index ode with transmit odebook C = Λ/Λ ; and ii for any S, we have k S Λ k = Ψ l S φ Λ l. Proof: See Appendix I-A Lemma 3. For every hoie of S, R S = log d0, and hene the side information gain is uniform. Proof: Using 7, and Part ii of Lemma, we have d S = d min Λ k = d min Ψ φ l Λ k S = l S l S The side information rate orresponding to S is R S = k S R k = k S log φ k = log k S φ l d 0. 4 φ k. 5 From 4 and 5, we see that R S = log for every d S hoie of S, and 0 log 0 /R S is independent of S. d 0 d0 Using the relation R S = log with, we obtain ΓC 6 db/b/dim. Thus, when Λ is the densest lattie in its dimension, the proposed onstrution ahieves the optimal side information gain over all lattie index odes onstruted based on Λ. Note that this optimality with respet to Γ holds only among the family of lattie index odes of Definition, and when Λ is densest in its dimension. While Example 5 gives a lattie index ode with Γ > 6 db/b/dim using a lattie Λ that does not have highest density, Example shows an index ode with Γ > 6 db/b/dim using a non-lattie onstellation. d0 Example 7 A -message onstellation using 5-QAM. Consider the non-assoiate primes φ = + i and φ = i in D = Z[i]. Setting Λ = Z[i], we obtain a onstellation C arved from Λ = ΨZ[i] = Z. We have M = φ φ = 5, M = i and M = + i. The

12 Fig. 7. The onstellation of Example 7. The dots onstitute the ode C = 5-QAM, the squares and irles orrespond to Λ /Λ and Λ /Λ, respetively. oarse lattie Ψ5Z[i] = 5Z, and the lattie index ode C = Ψ Z[i] /Ψ 5Z[i] = Z /5Z is the 5-QAM onstellation. The generator matries of the latties Λ = ΨM Z[i] and Λ = ΨM Z[i] are and, respetively. The onstellations Λ /Λ and Λ /Λ onsist of 5 points eah see Fig. 7, Λ /Λ = {0,,,,,,,, }, Λ /Λ = {0,,,,,,,, }. The minimum squared distane of Λ is, while that of Λ and Λ is 5. When the side information index set is S = {} or {}, the squared distane gain is 0 log 0 5 db, and the side information rate R S = log 5 b/dim, yielding a side information gain of Γ 6 db/b/dim. Fig. 8 shows the performane of the three different reeivers with S = no side information, S = {}, and S = {}, respetively. The performane for S = {} and S = {} were obtained by simulations, while that for S = was obtained through the losed form expression for the error rate of 5-QAM [9]. From the simulation result, we observe that at the error rate of 0 5, the knowledge of either of the two transmitted messages provides an SNR gain of 6.95 db. When normalized by the side information rate log 5 b/dim, we have a normalized SNR gain of 5.98 db/b/dim, whih is a good math with Γ 6 db/b/dim. Constrution with D = Z Let p,..., p K Z be distint rational primes, M = p p K be their produt and M k = M p k, k =,..., K. Let Λ R n be any n-dimensional lattie. We let Λ = MΛ and Λ k = M k Λ. The rate of the k th message is R k = Vol MΛ n log = Vol M k Λ n log p n k = log p k. Similar to Lemmas and 3, we an show that C = Λ/Λ, ρ is injetive, R S = log d0, and hene, Γ 6 db/b/dim. Example 8. The ode of Example an be obtained by using D = Z, Λ = Z, and the tuple of prime numbers φ, φ, φ 3 =, 3, 5. A onstrution of lattie odes using tuples of prime integers in Z[i] and Z[ω] is reported in [30] for low omplexity multilevel enoding and multistage deoding in ompute-andforward appliations. When Λ is a Gaussian or Eisenstein lattie, the message rates available from the proposed lattie index odes are log φ b/dim, where φ D is prime see Tables I and II. When D = Z, the odes allow one message of rate log p b/dim for every rational prime p Z. In Setion V we onstrut a family of lattie index odes from a lass of quaternioni latties, whih inludes D 4 and E 8, that allow enoding two messages, of rate log p b/dim eah, for every odd rational prime p Z. The odes of Setion V thus provide

13 3 Fig. 8. Performane of the ode of Example 7 for three different reeivers. further hoies in terms of message rates at the soure and side information rates at the reeivers. V. CONSTRUCTION OF LATTICE INDEX CODES USING HURWITZ INTEGERS We onstrut lattie index odes using quaternioni latties by exploiting the fat that the Hurwitz integral quaternions H form a non-ommutative PID. Sine the ideals in H are not two-sided in general, the Chinese remainder theorem does not apply to H. However, we identify a set of ideals that lead to uniform gain lattie index odes with side information gain 6 db/b/dim. We first onsider the one dimensional H-lattie D4 in Setion V-B, and then extend the results to a lass of higher dimensional H-latties in Setion V-C. We now briefly review some properties of the Hurwitz integers H. We refer the reader to [3] for more details. A. Review of Hurwitz integers The set of Hurwitz integers H is the subring of quaternions onsisting of those elements whose oordinates are either all in Z or all in Z +, i.e., H = { a + bi + j + dk } a, b,, d Z { a + bi + j + dk a, b,, d Z + }. Addition in H is omponent-wise, and multipliation is defined by the relations i = j = and ij = ji = k. This makes H non-ommutative. For A = a + bi + j + dk H, the onjugate of A is A = a bi j dk, and the norm is NA = AA = AA = a + b + + d Z. The real part of A is ReA = a, and the trae is A + A = a. The four-square theorem of Lagrange states that every positive integer is a sum of four integer-squares, i.e., every positive integer is the norm of some Hurwitz integer. The units of H are the elements with norm. There are preisely 4 units in H, eight of them ±, ±i, ±j, ±k have integer oordinates, and the remaining 6 units ± ± i ± j ± k have half-integer oordinates. The ring H is a Eulidean domain, and hene it is a nonommutative PID. Every left ideal I of H is generated by a single element, and is of the form I = HA for some A H. Similarly every right ideal is of the form I = AH. In the rest of this setion we will use only the left ideals in H to onstrut our onstellations. Similar results an be obtained from right ideals. The generator of a left ideal is unique up to left multipliation by a unit of H. When viewed as a 4-dimensional lattie, in the basis {, i, j, k}, H yields D4, and its generator matrix is G = For A = a + bi + j + dk, let vea = a, b,, d be the vetor of the oordinates of A in the basis {, i, j, k}. For

14 4 any B H, we have veba = MAveB, where a b d MA = b a d d a b. 6 d b a Note that MA is an orthogonal matrix, and its determinant is a + b + + d = NA. The ideal HA generated by A is a sub-lattie of D 4, and its generator matrix is MAG, where G is the generator matrix of D 4, and MA orresponds to left multipliation of a quaternion by A. Thus, the volume of the fundamental region of the lattie HA is Vol HA = det MA det G = NA. 7 The norm operation is multipliative on H, i.e., NAB = NANB for every A, B H. The units of H are the elements with the shortest norm, and NA for A H. Let I = HD be the ideal generated by the element D, and B I. Then, B = AD for some A H, and its norm satisfies NB = NAD = NAND ND. Hene, the generator of I is a shortest vetor in the lattie I, and the minimum squared distane between any two points in I = HD equals the norm ND of the generator. For A, B H, we say that A B if B HA, i.e., if B belongs to the ideal generated by A. If A B, we have B = DA for some D H and hene NA NB. The gd of two elements A and B is the generator of the ideal generated by A and B, i.e., HA + HB = H gda, B. If D = gda, B, we have ND NA and ND NB in Z, hene ND gdna, NB in Z. B. Constrution of lattie index odes based on D4 Consider L distint odd rational primes p,..., p L Z. From the four-square theorem [3], there exist P,..., P L H suh that p i = NP i. In order to prove the injetivity of ρ, we further require that the real parts of the P i s be powers of this tehnial assumption is used in the proof of Lemma 4. Using Legendre s three-square theorem [3], we prove in Appendix II that for every odd rational prime p there exists a Hurwitz integer P suh that p = NP and ReP is a power of. In partiular, the proof only requires that p be a positive odd rational integer not neessarily a prime, and shows that P an be hosen suh that ReP {, }. Define K = L elements M,..., M K, as M k = P k p l, and M k+l = M k = P k p l, for k =,..., L. Let M = p p L be the generator of the ideal I = HM. Note that for eah k =,..., L, we have M k M and M k+l M sine M = p p L = p k p l = P k P k p l = P k P k p l, i.e., M = P k M k = P k M k+l. TABLE III EXAMPLES OF HURWITZ INTEGERS WITH ODD-PRIME NORM AND REAL PART A POWER OF Norm Hurwitz integer Rate NP = p P log p 3 + i + j i i + j + k.40 + i + 3j i i i + 3j. 3 + i + 3j + 3k i i + j + 5k.48 Hene, I = HM is a sub-ideal of HM k, k =,..., K. We use Λ = I, and Λ k = HM k, k =,..., K, in Definition to onstrut our lattie index ode. Using 7, HM k /HM = Vol HM Vol HM k = NM NM k = { p k, k L, p k L, k > L. 8 Sine H is a 4-dimensional lattie, the rate of the k th message is { R k = log HM k /HM = log p k, k L, 4 log p k L, k > L. The side information rate for S {,..., K} is R S = R k = 4 log HM k /HM b/dim. k S k S Table III provides one instane among many possible of Hurwitz integer P with NP = p and ReP = m for eah of the first ten odd primes p. Table III also lists the message rate log p b/dim available from using eah Hurwitz integer P. Example 9. Consider L = and the odd primes p = 3 and p = 5. With P = + i + j and P = + i, we have p k = NP k and ReP k = = 0. We have K = L = 4 information symbols with onstellations HM k /HM, where M = p p = 5, M = P p = 5 + i + j, M = P p = 3 + i M 3 = M = 5 i j, and M 4 = M = 3 i. The ardinalities of the four onstellations are 9, 5, 9 and 5, respetively, and their rates are log 3, log 5, log 3, and log 5 b/dim. In the rest of this sub-setion we show that the hoie Λ = I = HM and Λ k = HM k, k =,..., K, produes a uniform gain lattie index ode with side information gain 6 db/b/dim. We show that the transmit odebook C equals H/I Lemma 4, the enoding map ρ