arxiv:cs/ v1 [cs.it] 10 Feb 2005

Transcription

1 On quasi-cyclic interleavers for parallel turbo codes Joseph J. Boutros and Gilles Zémor arxiv:cs/ v1 [cs.it] 10 Feb 2005 January 31, 2005 Abstract We present an interleaving scheme that yields quasi-cyclic turbo codes. We prove that randomly chosen members of this family yield with probability almost 1 turbo codes with asymptotically optimum minimum distance, i.e. growing as a logarithm of the interleaver size. These interleavers are also very practical in terms of memory requirements and their decoding error probabilities for small block lengths compare favorably with previous interleaving schemes. Index Terms: quasi-cyclic codes, convolutional codes, turbo codes, minimum distance, iterative decoding. 1 Introduction It is now well known that the behaviour of turbo codes, although very powerful under high noise, exhibits an error floor phenomenon that can be explained by poor minimum distance properties. More specifically, it can be shown that for randomly chosen interleavers, the expected minimum distance of a classical two-level turbo code remains constant [20][18], i.e. does not grow with block length. Can the error floor behaviour of turbo codes be improved by designing the interleaver in a way that differs from pure random choice? This question has been addressed by many authors and the answer has been shown to be affirmative. Two types of approaches have been used in trying to find improved interleavers: the first tries to modify as little as possible a randomly chosen interleaver by combinatorially avoiding configurations that yield small-weight codewords. This is in principle manageable since the expected number of codewords of constant weight in a turbo code remains constant (does not grow with block length). Indeed, this approach has met with significant success: perhaps the most widely known design of this type is the S-random interleaver [13], that focuses on eliminating codewords of low weight corresponding to information sequences of weight 2. A more recent scheme of Truhachev et al. [27] weeds out all small-weight turbocodewords in a way that is reminiscent of Gallager s method of excluding small cycles when constructing the parity-check matrix of an LDPC code, see also [3] for a similar result. They obtain turbo codes whose minimum distance grows proportionally to log N where N denotes the interleaver size. This asymptotic result is essentially the best possible since it was shown Presented in part at the 2004 IEEE International Symposium on Information Theory, Chicago, Illinois, USA. J.J. Boutros and G. Zémor are with École Nationale Supérieure des Télécommunications, 46 rue Barrault, Paris 13, France. {boutros,zemor}@enst.fr 1

2 by Breiling [8] that D/logN must be upper bounded by a constant, where D and N denote respectively the minimum distance and interleaver size of the turbo code. The second approach tries to find interleavers with structure, in particular algebraic structure, rather than mimic random choice. Besides enhanced performance, an additional motivation is to have a permutation with a short description that will save on the memory required to store the interleaver connections. With this last feature in mind, a particularly promising family of interleavers was proposed by Tanner in [26] and consists of quasi-cyclic permutations that yield quasi-cyclic turbo codes. Encouraging simulation results for the simpler RA codes were obtained in [25], hinting at good minimum distance properties of quasi-cyclic turbo-like codes. To quote from the conclusion of [26]: We conjecture that the class of quasi-cyclic permutations that will create quasi-cyclic turbo codes is rich, rich enough to contain codes that will perform as well or better than random interleavers. In the present work we take up this challenge and study random quasi-cyclic permutations. Our approach borrows from both the unstructured, almost random, and the algebraic, structured, design strategies: our interleavers have structure, and the inherent advantageous storage properties, and yet involve a certain amount of random choice. Our main result is to show that the typical minimum distance of the associated turbo code grows linearly with log N, i.e. has optimal growth, thus justifying Tanner s conjecture. Furthermore, for moderate lengths these interleavers turn out to be not only practical, but very efficient, comparing favorably with random, S-random, and all known interleavers in a number of instances. The paper is organized as follows. In section 2 we give a short summary of previous work on interleaver design. In section 3 we describe our family of quasi-cyclic interleavers. Section 4 is devoted to proving that a randomly chosen interleaver from this family will have asymptotically optimal minimum distance with high probability (Theorem 9). Section 5 gives experimental results for short lengths (N = 400 and N = 1600). 2 Previous work on interleaver design Classical channel coding systems using a serial concatenation of Reed-Solomon codes and binary convolutional codes include a matrix interleaver (also called block interleaver) which enables one to split the error bursts generated by the Viterbi decoder before applying an algebraic Berlekamp-Massey decoding [7][19]. The early research on interleavers for digital communications has been preceded by the invention of burst-error-correcting cyclic and bursterror-correcting convolutional codes [21]. Although the low density parity check codes developed by R. Gallager [15] integrated random interleaving of the parity-check matrix columns, no serious study on interleavers was known until the work by Ramsey on optimum interleavers for infinite length sequences [23]. For example, a type I Ramsey interleaver guarantees an input separation n 1 and an output separation n 2 with a minimum delay equal to n 2 (n 1 1), wheren 1 andn 2 aretwopositive integers satisfyingn 2 < n 1 < 2n 2, n 1 andn 2 +1arerelatively prime. The separation guaranteed by Ramsey interleavers has been named spreading after the invention of parallel turbo codes based on binary systematic recursive convolutional constituents [5][6]. Finite length interleavers or permutations designed for parallel turbo codes have been extensively studied during the last decade. The amount of publications on the subject ranges in the hundreds and cannot be listed here in full. The following selection of 2

3 interleaver families is an attempt to give a meaningful picture of the state of research and to summarize the main techniques. As mentioned earlier they can be crudely partitioned into two categories: mostly random interleavers with a weak structure, requiring an exhaustive description of the permutation, or strongly structured with short representations. Purely random interleavers. These interleavers are built from permutations on N integers selected at random. Here, N denotes the interleaver size. The original turbo codes (N = bits) were designed with purely random interleavers. Without any interleaver optimization, the error rate performance of parallel turbo codes can be enhanced via primitive feedback polynomials in the turbo code convolutional constituents [4]. Random interleavers with a weak deterministic structure. This family includes the S-random or spread interleaver proposed by Divsalar and Pollara [13]. The S-random interleaver π is constructed at random, it must satisfy the constraint π(i) π(j) > S for all i j < S, where the maximal theoretical value of the spreads is N. Highspreadrandom(HSR)interleavers proposedbycrozier[11]belong to this family. They rely on the maximization of the spread S = min{ i j + π(i) π(j) } (also defined in [2] for arithmetic and random interleavers). The spread of HSR interleavers is upper bounded by 2N. The permutation described by Truhachev et.al. [27] that guarantees an asymptotically optimal minimum distance is mostly random with a weak deterministic structure. Deterministic algebraic/arithmetic interleavers. Many algebraic permutations have been suggested or specifically developed for parallel turbo codes. In spite of (or perhaps because of) their very low memory, they tend to exhibit intermediate or poor error rate performance. A short selection consists of the interleavers described by Berrou and Glavieux [6], by Andrews et.al. [2], Sadjadpour et.al. [24], Bravo and Kumar [9]. The Relative Prime and the Golden interleavers described by Crozier et.al. [10] belong to this family of deterministic interleavers. Deterministic interleavers with a weak random structure. We mention two types of deterministic interleavers where randomness has been added in order to unbalance somewhat the algebraic structure. Dithered golden interleavers [10] and dithered relative prime (DRP) interleavers [12]. DRP interleavers exhibit excellent error rate performance. They are obtained in 3 steps: 1- application of a small permutation (input dithering) to the interleaver input, e.g., a size 8 permutation applied N/8 times, 2- a relative prime permutation j = s+ip, where j is the read position, i is the write position, s is a shift and p is prime relative to N, 3- an output dithering similar to the input one. Interleavers from the graphical structure of codes. Cayley-Katz graphs with large girth have been used to design Generalized Low Density (GLD) codes with binary BCH constituents [22]. Similar application was made by Vontobel [28] to design turbo code interleavers from large girth graphs. Interleavers based on large girth graphs are all deterministic. Yu et.al. [29] also designed good interleavers 3

4 by looking at the loop distribution in the turbo code structure. Such interleavers are random with a weak deterministic structure. Interleavers by other criteria. Abbasfar and Yao [1] recently proposed good interleavers that eliminate codewords with Hamming weight less than a certain distance. The construction algorithm is based on a two dimensional representation of the permutation. This representation previously inspired Crozier [11] in his design of dithered-diagonal interleavers. The interleaver design by distance spectrum shaping can be classified in the class of random interleavers with a weak deterministic structure. Finally, we mention the interleavers designed by Hokfelt et.al. [17] via the minimization of the correlation between extrinsic informations under iterative decoding. The bi-dimensional quasi-cyclic interleaver described in the next section combines randomness and determinism in an almost equal manner. When designed from a square matrix, its quasi-cyclicity period is N, meaning that a set of 2 N integers is needed to save the bidimensional interleaver into memory, rather than the N integers needed for a purely random permutation. 3 Bi-dimensional, or quasi-cyclic interleavers For simplicity, we restrict ourselves to the classical turbo code construction with a fixed constituent convolutional code C 0 of rate R 0 = 1/2. The turbo encoder takes an information sequence s of N bits, produces a firstsequence of N check bits by submittings = s 0,s 1,...s N 1 to an encoder for C 0, and a second sequence of a further N check bits by submitting a permuted version s π(0),s π(1),...,s π(n 1), of s to the encoder for C 0. The overall turbo code rate is R = 1/3 and the interleaver is the permutation π on the ordered set of information coordinates N = {0,1,...,N 1}. There will be a 2-dimensional structure inherent to our choice of permutation π, therefore we shall restrict ourselves to the case when N = n 1 n 2 is a composite integer. Let π be a permutation on N = {0,1,...,N 1} defined as follows. For any (i,j) {0,1,...,n 1 1} {0,1,...,n 2 1} define the function φ : {0,1,...,n 1 1} {0,1,...,n 2 1} N (i,j) i n 2 +j Let σ be a permutation of {0,1,...,n 2 1} and let (X j ) j=0...n2 1 be a family of integers mod n 1. Define the permutation Π on {0,1,...,n 1 1} {0,1,...,n 2 1} by Π(i,j) = (i+x j mod n 1,σ(j)). Finally definethe permutation π = φπφ 1 on the set N. A small example is given in Figure 1. The quasi-cyclic nature of the permutation π just defined is stressed in the following Lemma, a direct consequence of the definition. Lemma 1 A permutation π belonging to the class defined above satisfies, for any x,x N such that x = x+n 2 mod N, π(x ) = π(x)+n 2 mod N. 4

5 σ = ( ) X 0 = 0,X 1 = 3,X 2 = 4,X 3 = 2,X 4 = A B C (π(0),π(1),π(2),...,π(24)) = (3,12,5,19,21,8,17,10,24,1,13,22,15,4,6,18,2,20,9,11,23,7,0,14,16). Figure 1: Example: construction of π, N = 25, n 1 = n 2 = 5. Write 0,1,...,N 1 in a square array A, apply σ to permute columns, giving B, and rotate column j cyclically, by X j mod 5, giving array C. Read off the rows to get π(0),π(1),π(2),... If we make the trellis of the constituent convolutional code tail-biting, and if we write the check bits of the turbo code in the proper order, we obtain a quasi-cyclic turbo code [26]. For this reason, permutations of the above type will be called (n 1,n 2 )-quasi-cyclic (or simply quasi-cyclic). We shall take instances of (n 1,n 2 )-quasi-cyclic permutations π by choosing the permutation σ randomly, with uniform distribution, among permutations of {0,1,...,n 2 1}, and by choosing the X i,i = 0...n 1 1 randomly, with uniform distribution, among the set of integers mod n 1. We choose the X i to be independent of each other and of σ. This is a way of choosing π uniformly in the class of (n 1,n 2 )-quasi-cyclic permutations. As a first comment, we may note that π has quite a lot more structure than a totally random permutation. A certain amount of randomness remains however; to quantify it somewhat, suppose for example that n 1 = n 2 = n = N (we shall see experimentally in section 5 that n 1 = n 2 is a good choice), we see that π is defined by logn!+nlogn N logn random bits as opposed to the N log N bits that define an otherwise unstructured permutation. Our strategy will be probabilistic, i.e. we will estimate the probability that the permutation π produces turbo code words of small weight w << logn and show that this probability must be vanishingly small. Interestingly, over all permutations π, the expected number of turbo codewords of small weight w does not vanish with N. This is because of an all-ornothing phenomenon. Permutations of the above type produce either no turbo codewords of small weight, or relatively many (at least n = N). 4 Minimum distance analysis For any two integers x and y of N let us denote by d(x,y) the circular distance between x and y, i.e. the smallest non-negative integer d such that x+d = y mod N or x d = y mod N. Let us draw an edge between x and y whenever d(x,y) = 1, giving N a circular structure: by an interval of N we shall mean a sub-path of N. Let s = s 0,...,s N 1 be an information sequence, and let v N be the support of s. The information sequence s generates a path in the (tail-biting) trellis of the convolutional 5

6 Rate 1/2 RSC codes Octal Generators Number of States Parameter λ (7, 5) 4 1/2 (13, 15) 8 2/5 (17, 15) 8 1/2 (37, 21) 16 1/4 (23, 35) 16 4/11 Table 1: Rate 1/2 recursive systematic convolutional codes. The parameter λ is the minimal ratio of Hamming weight to trellis length among all codewords. code C 0. Consider the partition N = Z T where Z is defined as the set of coordinates i for which the path associated to s goes from the zero state to the zero state. For every i Z we have s i = 0 and the corresponding check bit is also 0. The complement T of Z is a union of intervals T = [a 1,b 1 ] [a 2,b 2 ]... [a m,b m ]. The intervals [a j,b j ] are sometimes called simple trellis paths, or simple error events in the convolutional coding terminology. The trellis of a recursive convolutional code has the property that the zero state can only be left at time t if s t = 1 and it can only be reached from a nonzero state at time t if s t = 1. This means that v T and every interval [a j,b j ],j = 1...m starts and ends with an element of the support v of s. A recursive convolutional code also has the property of outputting a steady stream of non-zero symbols during the time it goes through a simple trellis path, i.e. during the time it is fed the information bits s t for t [a j,b j ]. In other words, there exists a constant λ, depending only on C 0, such that the total weight of the convolutional codeword associated to the information sequence s is at least λ m j=1 d(a j,b j ). Some numerical values of λ are given in Table 1 by way of illustration. Summarizing: Facts: Associated to any information sequence s of support v there is a subset T(s) N such that 1. T(s) = [a 1,b 1 ] [a 2,b 2 ]... [a m,b m ] is a union of intervals of N 2. v T(s) 3. for any j = 1...m, v [a j,b j ] 2 4. on input s the convolutional encoder outputs at least λ m j=1 d(a j,b j ) nonzero symbols, for some positive constant λ Let us call the trellis weight of s the quantity m j=1 d(a j,b j ) defined above, denote it by W T (s). Now the turbo code word associated to s has its weight lower-bounded by both convolutional codewords corresponding to the input s and to the permuted input s π. Since the maximum is lower-bounded by half the sum, Fact 4 above implies: Lemma 2 If the information sequence s produces a turbo codeword of Hamming weight w, then W T (s)+w T (s π ) 2w/λ. This last lemma says that low-weight turbo codewords can only exist if there is an information sequence s such that both s and s π have small trellis weight. Now the decomposition 6

7 of the supports of s and s π into simple trellis paths is rather awkward to handle probabilistically, so we shall introduce a related concept that will be easier to deal with. The following definition is purely combinatorial. Definition 3 Let x = x 0,x 1,...x l, l odd, be an even-numbered sequence of elements of N. Let y i = π(x i ),i = 0...l for some permutation π of N. Let us call the π-weight of x the quantity: w π (x) = d(x 2i 1,x 2i )+d(x 0,x l )+ d(y 2i,y 2i+1 ). 1 i,2i<l 0 i,2i+1 l The reason for introducing the above definition lies in the following lemma. Lemma 4 If there exists a codeword of weight w in the turbo code with interleaver π, then there exists an even-numbered sequence x of distinct elements of N of π-weight w π (x) 2w/λ. Proof : Let s be the information sequence corresponding to the turbo codeword of weight w and let v be its support. Note that the support of s π is u = π 1 (v). Let T(s) = [a 1,b 1 ] [a 2,b 2 ]... [a m,b m ] be the decomposition of T(s) into m intervals given by Fact 1 and let T(s π ) = [a 1,b 1 ] [a 2,b 2 ]... [a k,b k ] be the corresponding decomposition for the permuted version s π of the information sequence. Now consider the bipartite graph whose vertex set is made up of the two sets A and B where A is the set of the k intervals [a i,b i ],j = 1...k, and B is the set of the m intervals [a j,b j ],j = 1...m. Put an edge between interval [a i,b i ] and [a j,b j ] for every x π 1 (v) [a i,b i ] such that π(x) [a j,b j ] (multiple edges may occur). Fact 2 implies that the minimum degree of the bipartite graph is at least 2. Therefore there exists an (even-length) elementary cycle in the graph, i.e. a string of distinct vertices V 0,V 1,...V l, l odd, where the interval V i belongs to A (respectively B) for i even (respectively odd) and where there is an edge between V i and V j whenever i j = ±1 mod l+1. For 0 i,2i < l the edge between V 2i and V 2i+1 is defined by an element of V 2i u that we denote x 2i, and an element of V 2i+1 v that we denote y 2i and that equals y 2i = π(x 2i ). Similarly, for 1 i = 1,2i < l, every edge between V 2i and V 2i 1 is associated to x 2i 1 V 2i and y 2i 1 V 2i 1 with y 2i 1 = π(x 2i 1 ). Finally let x l V 0 and y l = π(x l ) V l correspond to the edge between V 0 and V l. We have constructed a sequence x = x 0,x 1,...,x l of elements of the support u = π 1 (v) of s π such that {x 2i 1,x 2i } V 2i, 1 i,2i l, {x l,x 0 } V 0, and {y 2i,y 2i+1 } V 2i+1, 0 i,2i+1 l: see Figure 2. Therefore, denoting by L(V) the length of an interval V, we have l w π (x) L(V i ) W T (s)+w T (s π ) which proves the result by Lemma 2. i=0 We shall now study the probability that a sequence of small π-weight exists. We need some more notation. Let r = r 1,r 2,...,r l, l odd, be a sequence of integers modulo N. Let r i denote the smallest absolute value of a (possibly negative) integer equal to r i modulo N, and let r = r 1 + r r l. Let x 0 N. Together x 0 and r uniquely define the (l +1)-sequence x = x(r,x 0 ) = x 0,x 1,...,x l and y = y(r,x 0 ) = y 0,...,y l such that 1. y i = π(x i ),i = 0...l, 2. for all i 0 such that 2i+1 l, y 2i+1 = y 2i +r 2i+1 mod N 3. for all i 1 such that 2i < l, x 2i = x 2i 1 +r 2i mod N 7

8 V x 0 x 0 V 3 x 1 x 2 2 r 2 π N r 1 y 0 y 1 r 3 V 1 y 3 y 2 V 3 N Figure 2: l = 3. The cycle V 0,V 1,V 2,V 3 defined in the proof of Lemma 4, the associated sequences x = x 0,x 1,x 2,x 3, y = y 0,y 1,y 2,y 3, r = r 1,r 2,r π Figure 3: Let π be the same as in Figure 1. The sequence r = 1,1,1 together with x 0 = 0 define x = x(r,x 0 ) = 0,13,14,21. We have w π (x) = d(0,21) = 7. Note that Finally, let us say that the sequence r M-cycles at x 0 if w π (x(r,x 0 )) = r +d(x 0,x l ). (1) w π (x(r,x 0 )) M. The definitions are illustrated in Figure 3. Lemma 4 translates directly into the following, given that the x i are distinct only if all the r i are non-zero. Lemma 5 If there exists a turbo codeword of weight w then there exists x 0 N and a nonzero sequence r = r 1,...,r l, r i 0,i = 1...l, l is odd, that 2w/λ-cycles at x 0. We now have everything in place for doing the probabilistic analysis. Let Z r,x0 be the Bernoulli randomvariableequal to1ifthesequencerm-cycles at x 0 andequal to0otherwise. The set of all permutations π of the set N is endowed with two probability measures, namely: the uniform probability measure P r, in other words P r (π) = 1/N! for all π. the quasi-cyclic probability measure P q defined by P q (π) = 1/(n n 2 1 n 2!) if π is (n 1,n 2 )- quasi-cyclic and P q (π) = 0 otherwise. Note that, as mentioned in section 3, this is equivalent to choosing the permutation σ randomly, with uniform distribution, among permutations of {0,1,...,n 2 1}, and by choosing the X i,i = 0...n 1 1 randomly, independently of each other and of σ, and with uniform distribution, among the set of integers mod n 1. Lemma 6 Let M < N, x 0 and r = r 1,...,r l be given, r i 0,i = 1...l, l is odd. We have: 8

9 1. If r M then P r [Z r,x0 = 1] = P q [Z r,x0 = 1] = If r < M then P r [Z r,x0 = 1] 2M/(N 1). 3. If r < M < n 2, then P q [Z r,x0 = 1] 2M n 1 (n 2 1). 4. If r < M and r i = 0 mod n 2 for every i = 1...l, then P q [Z r,x0 = 1] = 1. Proof : Point 1 is a direct consequence of (1). To see Point 2, consider x 1,...,x l as random variables. Conditional on the position of x l 1, i.e. on the event x l 1 = k, the distribution of x l is, since r l 0, uniform on the set N\{k}. Therefore P r (Z r,x0 = 1) = k P r [d(x l,x 0 ) M r x l 1 = k]p r [x l 1 = k] 1+2(M r ) P r [x l 1 = k] = N 1 k 2M N (M r ) N 1 To see Point 3 argue as follows: write d(x 0,x l ) = qn 2 +ρ, 0 ρ < n 2. Since M < n 2 we have Z r,x0 = 1 if and only if (a) q = 0 (b) ρ M r. Since r l 0 and M < n 2 imply that r l 0 mod n 2, we can argue as in point 3, replacing the randompermutationπ of{0,1,...,n 1}bytherandompermutationσ of{0,1,...,n 2 1}, to obtain that the event (b) occurs with probability not more than 2M/(n 2 1). By construction of the quasi-cyclic permutation the event (a) is independent of (b) and occurs with probability 1/n 1. Point 4 is simply due to the fact that for quasi-cyclic π we have π(x 0 + n 2 ) = π(x 0 ) + n 2 mod N for any x 0 N, therefore d(x 0,x l ) = 1 i l r i < M. Next, we shall study the expected number of couples (r,x 0 ) for which r M-cycles at x 0, i.e. the expectation of the random variable Z = Z r,x0. (2) x 0 N,r i 0, r <M Since r must have only non-zero terms, its length l cannot exceed its norm r. The number of sequences of given norm m, length l and non-negative terms is exactly ( m l), so that the number of terms in the sum (2) is not more than N ( ) m 2 l = N 3 m N3 M /2. l 1 m<m 0 l m 1 m<m From this and Point 3 of Lemma 6 we obtain therefore: 9

10 Lemma 7 Let M < n 2. The expected number E q [Z] of couples (r,x 0 ) such that r M-cycles at x 0 satisfies, for the probability measure P q, E q [Z] M3 M (1 1/n 2 ) 1. Notice that Point 2 of Lemma 6 would give essentially the same estimate of the expected value of Z for uniformly random π. However, the crucial property of the class of quasicyclic permutations that will make a big difference between choosing π uniformly random and quasi-cyclic-random is the following direct consequence of Lemma 1: Lemma 8 If the sequence r M-cycles at x 0 for a quasi-cyclic π, then r M-cycles at x 0 + n 2 mod N for π. In particular, Z is a multiple of n 1 for every quasi-cyclic permutation π. This means that E q [Z] = z n 1 zp q [Z = z] n 1 P q [Z > 0]. We have therefore that whenever the quantity E q [Z]/n 1 is made to be vanishing with N, the probability that there exists a sequence x of π-weight not more than M tends to zero. Putting together Lemma 7 and Lemma 4 we obtain this section s main result : Theorem 9 For any constant C < λ/2 and block length N = n 1 n 2 chosen to satisfy n 2 > 2C λ log 3n 1, the minimum distance of the random quasi-cyclic turbo code satisfies D Clog 3 n 1 with probability that tends to 1 as n 1 tends to infinity. 5 Experimental results for practical lengths In this section, we provide computer simulation results for the word error rate (WER) of parallel turbo codes using our new family of interleavers and comparing it with S-random and random interleavers. The output of the turbo encoder is modulated via a binary phase shift keying (BPSK) modulation and transmitted over an ideal additive white gaussian noise (AWGN) channel. The turbo decoder performs iterative a posteriori probability estimation by applying the forward-backward algorithm to each convolutional constituent. Word error rate versus signal-to-noise ratio results are depicted in Figures 4 and 5. In the first example, Fig. 4 illustrates the performance of a rate 1/2 turbo code with an 8-state recursive systematic convolutional constituent (13,15) 8. These octal generators have been adopted in the European third generation mobile radio standard UMTS [14]. The interleaver size is N = 400, n 1 = n 2 = 20, and the exact permutation is given in Table 2. As shown in Fig. 4, the bi-dimensional interleaver clearly outperforms the spread interleaver. The increase in minimum distance can also be validated numerically by measuring the turbo code minimum distance using the algorithm proposed by Garello et.al. [16]. In the second example, the rate 1/2 turbo code has a recursive systematic convolutional constituent (37,21) 8, the octal generators proposed in the original turbo code by Berrou et.al. [5]. The interleaver size is N = 1600, n 1 = n 2 = 40, and the exact permutation is given in Table 3. As shown in Fig. 5, we get a significant improvement over the S-random interleaver. 10

11 Square Bi-dimensional Quasi-cyclic Interleaver of Size 400 σ X Table 2: Bi-dimensional interleaver of size 400 = The first row defines the column permutation σ and the second row defines the column cyclic shift X. This square interleaver is used in conjunction with RSC(13,15) in Fig. 4. Square Bi-dimensional Quasi-cyclic Interleaver of Size 1600 σ X Table 3: Bi-dimensional interleaver of size 1600 = The first two rows define the column permutation σ and the last two rows define the column cyclic shift X. This interleaver is used in conjunction with RSC(37,21) in Fig. 5. References [1] A. Abbasfar and K. Yao, Interleaver design for turbo codes by distance spectrum shaping, in Proc. IEEE Wireless Comm. and Net. Conf. (WCNC 04), vol. 3, pp , Atlanta, March [2] K.S. Andrews, C. Heegard and D. Kozen, Interleaver design methods for turbo codes, in Proc. IEEE Int. Symp. Information Theory (ISIT 98), pp. 420, Cambridge, MA, Aug [3] L. Bazzi, M. Mahdian and D. Spielman, The minimum distance of turbo-like codes, Submitted to the IEEE Transactions on Information Theory, May Downloadable from spielman/research/mindist.html [4] S. Benedetto and G. Montorsi, Design of parallel concatenated convolutional codes, IEEE Trans. on Communications, vol. 44, no. 5, pp , May [5] C. Berrou, A. Glavieux, and P. Thitimajshima, Near Shannon limit error-correcting coding and decoding : turbo-codes, Proceedings of ICC 93, Geneva, pp , May [6] C. Berrou and A. Glavieux, Near optimum error correcting coding and decoding: Turbocodes, IEEE Trans. on Communications, vol. 44, pp , Oct [7] R.E. Blahut, Algebraic Codes for Data Transmission, Cambridge University Press, [8] M. Breiling, A Logarithmic Upper Bound on the Minimum Distance of Turbo Codes, Submitted to the IEEE Transactions on Information Theory, April Downloadable from breiling/research/publications/ 11

12 [9] C.J. Corrada Bravo and P.V. Kumar, Permutation polynomials for interleavers in turbo codes, in Proc. IEEE Int. Symp. Information Theory (ISIT 03), pp. 318, Yokohama, Japan, Jul [10] S.N. Crozier, J. Lodge, P. Guinand, and A. Hunt, Performance of turbo codes with relative prime and golden interleaving strategies, in Proc. of the 6th Int. Mobile Satellite Conf. (IMSC 99), Ottawa, Ontario, pp , June [11] S.N. Crozier, New high-spread high-distance interleavers for turbo-codes, in Proc. of the 20th Biennial Symp. on Communications, Queen s University, Kingston, Ontario, Canada, pp. 3-7, May [12] S.N. Crozier and P. Guinand, High-performance low-memory interleaver banks for turbo-codes, in Proc. of the 54th IEEE Veh. Tech. Conf. (VTC 01), Atlantic City, NJ, pp , Oct [13] D. Divsalar, F. Pollara, Turbo codes for PCS applications, in Proc. IEEE Int. Conf. on Communications (ICC 95), vol. 1, pp , Seattle, June [14] European Telecommunications Standards Institute, Universal mobile telecommunication system(umts); multiplexing and channel coding(fdd), 3GPP TS , version 6.2.0, Release 6, [15] R.G. Gallager, Low-density parity-check codes, MIT Press, [16] R. Garello, P. Pierleoni and S. Benedetto, Computing the free distance of turbo codes and serially concatenated codes with interleavers: Algorithms and applications, IEEE Journal on Sel. Areas in Communications, vol. 19, no. 5, pp , May [17] J. Hokfelt, O. Edfors and T. Maseng, Interleaver design for turbo codes based on the performance of iterative decoding, in Proc. IEEE Int. Conf. on Communications (ICC 99), vol. 1, pp , Vancouver, June [18] N. Kahale and R. Ürbanke, On the minimum distance of parallel and serially concatenated codes, Downloadable from [19] S. Lin and D.J. Costello, Error Control Coding: Fundamentals and Applications, Prentice Hall, [20] L.C. Perez, J. Seghers, D.J. Costello, A distance spectrum interpretation of turbo codes, IEEE Trans. on Inf. Theory, vol. 42, no. 6, pp , Nov [21] W.W. Peterson and E.J. Weldon, Jr., Error-correcting codes, The MIT Press, 2nd edition, [22] O. Pothier, Compound codes based on graphs and their iterative decoding, PhD thesis in communications and electronics, ENST, Paris, Jan Downloadable from boutros/coding [23] J.L. Ramsey, Realization of optimum interleavers, IEEE Trans. Inform. Theory, vol. IT-16, no. 3, May

13 [24] H.R. Sadjadpour, N.J.A. Sloane, M. Salehi and G. Nebe, Interleaver design for turbo codes, IEEE Journal on Sel. Areas in Communications, vol. 19, no. 5, pp , May [25] R. M. Tanner, On Quasi-Cyclic Repeat-Accumulate Codes, Proc. of the 37th Annual Allerton Conference on Communication, Control, and Computing, Monticello, Illinois, Sept [26] R. M. Tanner, Toward an algebraic theory for turbo codes, in Proc. of the 2nd International Symposium on Turbo Codes and Related Topics, Brest, France, Sept [27] D. V. Truhachev, M. Lentmaier and K. S. Zigangirov, Some results concerning design and decoding of turbo codes, Problemy Peredachi Informatsii, vol. 37, No. 3, 2001, pp [28] P.O. Vontobel, On the construction of turbo code interleavers based on graphs with large girth, in Proc. IEEE Int. Conf. on Communications (ICC 02), vol. 3, pp , New York, May [29] J. Yu, M.-L. Boucheret and R. Vallet, Design of turbo codes interleaver by loop distributions, in Proc. IEEE Int. Symp. Information Theory (ISIT 02), pp. 54, Lausanne, Jul

14 1E+00 Pseudo-Random S-Random Spread S=13 Bidimensional (quasi-cyclic) 20*20 1E-01 Word Error Probability 1E-02 1E-03 P-Rand 1E Decoding iterations UMTS octal generators 13,15 S-Rand 1E Eb/N0 (db) Bidim Figure 4: Performance of rate 1/2 turbo code for different interleavers of size 400 bits. Octal generators (13,15), coding rate is raised from 1/3 to 1/2 by puncturing parity bits, 32 decoding iterations, additive white gaussian noise channel, binary phase shift keying modulation. For all points drawn above, at least 100 block errors and 500 bit errors have been measured during Monte Carlo simulation to estimate the word error probability. 14

15 1E+00 Pseudo-Random S-Random Spread S=24 Bidimensional (quasi-cyclic) 40*40 1E-01 Word Error Probability 1E-02 P-Rand 1E-03 S-Rand 40 Decoding iterations Berrou-Glavieux octal generators 37,21 1E Eb/N0 (db) Figure 5: Performance of rate 1/2 turbo code for different interleavers of size 1600 bits. Octal generators (37,21), coding rate is raised from 1/3 to 1/2 by puncturing parity bits, 40 decoding iterations, additive white gaussian noise channel, binary phase shift keying modulation. For all points drawn above, at least 100 block errors and 500 bit errors have been measured during Monte Carlo simulation to estimate the word error probability. Bidim 15