Message-Passing Decoding for Low-Density Parity-Check Codes Harish Jethanandani and R. Aravind, IIT Madras
|
|
- Barrie Webster
- 5 years ago
- Views:
Transcription
1 Message-Passing Decoding for Low-Density Parity-Check Codes Harish Jethanandani and R. Aravind, IIT Madras Abstract Low-density parity-check (LDPC) codes are discussed as practical, capacity-approaching error correction codes owing to their less complex and possibly parallel decoding. The LDPC decoder is represented as a normal graph and decoding using the message-passing algorithm (MPA) for BPSK and M- ary QAM is studied. The decoders are discussed and an approximate function is evaluated to make the decoding more practical at the cost of slightly degraded performance H = Introduction Low-density parity-check codes were introduced by Gallager [1] in 1963 and were recently rediscovered with the advent of turbo codes, which employ the soft iterative decoding paradigm. LDPC codes are linear block codes with very sparse paritycheck matrices. Codes based on such matrices that have a small, fixed number of 1 s in each row and column are called regular LDPC codes while matrices that have varying, small number of 1 s in the rows and columns are called irregular LDPC codes. Irregular large blocklength LDPC codes can achieve better performance than Turbo codes as shown in [3]. A regular (n,j,m) binary LDPC code has blocklength n, while the parity-check matrix has fixed column weight j and fixed row weight m. The number of rows is (n*j)/m. Thus the designed rate of the code is 1-(j/m). An equivalent systematic parity-check matrix H sys is constructed from H by performing Gaussian elimination. The number of rows in the matrix H sys may be less than what it was designed for, i.e., (n*j)/m, because some of the rows of the sparse H matrix may be linearly dependent which are removed in Gaussian elimination. The rate of the code then increases. A systematic generator matrix G sys can be obtained from H sys for encoding data bits to code bits. For decoding, the original sparse H matrix is used. 2. LDPC codes modeled as normal graphs Any parity-check matrix can be represented by a normal graph. The parity-check matrix for a (7,4) Hamming code and its associated normal graph is shown in Fig 1. Fig 1 - Normal graph for H of (7,4) Hamming code Such graphs can also be drawn for LDPC codes. There are two main types of nodes shown above: the bit nodes (or equality nodes) denoted B i represent code bits and the parity-check nodes denoted C j represent parity-checks (the rows of H matrix). The edges from a particular bit node B i joining the check nodes show the parity-checks a bit participates in. The edges from a check node C j joining the bit nodes shows the bits checked by that parity-check. There are also present edges from some conveniently introduced nodes N i (decoder input nodes) to the bit nodes, which input the intrinsic probabilities of bits from the demodulator to the bit nodes. The intrinsic probabilities P int (x i =b), where (b ε {0,1}), and x i are code bits, are probabilities of the bits being a 1 or a 0 as seen at the demodulator input. For received input y i = x i + n i, where x i are BPSK modulated bits (1,-1) and n i is AWGN of variance σ 2, these are given by: P int (x i =1) = P(x i =1 y i ) = P(y i x i =1).P(x i =1)/P(y i ) = exp ( 2y i /σ 2 ) / {1+exp ( 2y i /σ 2 )}.
2 P int (x i =0) = 1 P int (x i =1) = 1/{1+exp(2y i /σ 2 )}. The intrinsic probabilities are dependent only on the soft input to the decoder. The bit nodes and paritycheck nodes represent constraints on the possible values that can be taken by the code vector x, whose individual bits are represented here as edge-variables x i of the edges. The bit node constrains the edgevariables connected to it to be equal, hence the edgevariables e ij connected to B i represent the bits x i of x. The parity-check node constrains the edge-variables connected to it to be in even parity. The edges between N i and B i are called external edges while those between B i and C j are called internal edges. 3. Message-passing Consider a node as shown in Fig 2. all possible combinations of the edge-variables x 1, x 2,.., x, then P post (x i =b) = c. P int (x i =b). Σ { Π P int (x j )} (1) { x1,.. x } ε S j=1 N ~{xi } j i where 1/c = P(N) = Σ { Π P int (x j )} { x1,.. x } ε S j=1 N where the summation in (1) is over all values of x 1,.. x (except x i ) such that they are in the constraint set of N. Define extrinsic probabilities as: P ext (x i =b) = c. Σ { Π P(x j =b)} (2) {x1,.. x } ε S j=1 N ~{xi } j i where c is such that P ext (x i =0) + P ext (x i =1) = 1. Fig 2 A single node x 0, x 1 and x 2 are the edge-variables (along the 3 edges) which belong to the alphabet {0,1}, and let N be an equality node. Then, N is a constraint on the edgevariables requiring them to be equal. The intrinsic probabilities P int (x i =b), (b ε 0,1), for i = 0,1,2, are probabilities without the constraint imposed by node N. Given the intrinsic probabilities, one can find the posterior probabilities (i.e. the probabilities of the edge-variables of being 1 or 0 conditional on the constraint imposed by N) as: P post (x i =b) = P(x i =b N) = P(N x i =b).p int (x i =b)/p(n) where P(N) = Σ P(N x i =b). P int (x i =b) { xi } In Fig 2, P(N x 0 =0) = P int (x 1 =0). P int (x 2 =0) P post (x 0 =0) = c.p int (x 1 =0). P int (x 2 =0). P int (x 0 =0) where c = 1/P(N) = 1/{P int (x 1 =0) P int (x 2 =0) P int (x 0 =0) + P int (x 1 =1) P int (x 2 =1) P int (x 0 =1)} In general, if the constraint set of edge-variables allowed by a node N is S N ε S, where S is the set of Hence, the extrinsic probabilities when N in Fig 2 is an equality node are: 2 P ext (x i =b) = c. Π P int (x j =b). (3) j=0 j i where c is such that P ext (x i =0) + P ext (x i =1) = 1. In Fig 2, if N is considered to be a parity-check node, i.e. when N allows x 0, x 1 and x 2 such that x 0 + x 1 + x 2 = 0 mod 2, it is shown in [2] that: 2 P ext (x i =0) = (1 + Π (1 2p j )) / 2 (4) j=0 j i P ext (x i =1) = (1 P ext (x i =0)) where p j = P int (x j = 1). It is shown in [2] that for a graph with 2 or more nodes, the posterior probabilities of a bit being equal to a 1 or a 0, can be calculated as a distributed computation by passing extrinsic probabilities (or messages μ) along the edges in the graph. This procedure, also known as the Message-passing algorithm (MPA) or the sum-product algorithm, gives the exact posterior probabilities if the graph is cycle-free. By a cycle, we mean a path along the edges of the graph that starts and ends at the same node. The length of a cycle is the number of nodes a
3 path traverses before completing the cycle. It has been found in practice that for many situations of graphs with cycles, such as those for the parity-check matrices of LDPC codes, the message-passing algorithm, though only approximate, gives very good estimates of the posterior probabilities of the code bits of being a 1 or a 0 with much lower complexity than an exact decoding, i.e. estimating the codeword as: x = argmax P(x j y), j where x j are all possible codewords and y is received soft vector. It is known that the MPA performs well if the normal graph of the parity-check matrix does not contain cycles of small length. A properly constructed sparse parity-check matrix for an LDPC code can be represented as a normal graph with cycles of large length and small number of edges joined to any single node, hence the message-passing algorithm results in very efficient and accurate decoding of LDPC codes. With large blocklength and same j and m, the LDPC decoder works better because of the increased sparseness of the H matrix. 4. Message-passing algorithm for LDPC decoder The decoder works iteratively by passing messages (μ), which are the extrinsic probabilities as defined in (2), along the edges of the graph. For example, μ X Y (x=b) means the extrinsic probability of the bit represented by x being equal to b which is calculated at node X and being used by node Y for its own calculation of probabilities. So, it is in some sense a message being passed from X to Y. The extrinsic probabilities or messages outgoing from X to Y act as intrinsic probabilities for Y, as shown in [2]. The message-passing algorithm is summaried as: 1. Initialie. The algorithm starts with the following initialiation: μ Ni Bi (x i = b) = P int (x i = b), and uniform distributions for μ Cj Bi (e ij = 0) = μ Cj Bi (e ij = 1) = ½, as there is no knowledge about them a priori. 2. Message-passing and update rule. Let M(i) denote the set of parity checks in which bit x i participates. Let L(j) denote the set of bits checked by parity-check j. Then, the updated values of messages from bit nodes B i to the parity-check nodes C j are given by (a simple extension of (2)): μ Bi Cj (e ij = 0) = c. μ Ni Bi (x i = 0). Π μ Cj Bi (e ij = 0) μ Bi Cj (e ij = 1) = c.μ Ni Bi (x i = 1). Π μ Cj Bi (e ij = 1) where M(i)\{j} is the set M(i) with element j omitted and c is such that μ Bi Cj (e ij = 0) + μ Bi Cj (e ij = 0) = 1. The messages from the check node C j to the bit nodes B i are given by (an extension of (4)): μ Cj Bi (e ij = 0) = ½.(1 + Π(1 2μ Bi Cj (e i j = 1))) (5) μ Cj Bi (e ij = 1) = ½.(1- Π(1 2μ Bi Cj (e i j = 1))) (6) 3. Calculate output. The posterior probability which is used to decode individual bits of x after each iteration is given by: q i 0 = c. P int (x i =0) Π μ Cj Bi (e ij = 0) q i 1 = c. P int (x i =1) Π μ Cj Bi (e ij = 1) The bits x i are decoded as: If q i 0 > q i 1, bit x i is decoded as 0 otherwise as 1. The steps 1-3 comprise of a single iteration of the message-passing algorithm. Such iterations are repeated using updated values of messages till a correct codeword is found (i.e. if xh T = 0) or a prefixed maximum number of iterations is reached. A decoding failure may be reported if a codeword cannot be found within the allowed number of iterations. 5. Decoding with Log-Likelihood Ratios The Log-likelihood ratio (LLR) of a probability is LLR(P(x)) = ln{p(x=0)/p(x=1)} where P can be intrinsic, extrinsic or posterior probability of a binary variable x. Also, let p i = μ Ni Bi q ij = μ Bi Cj r ij = μ Cj Bi The message-passing algorithm is now modified as: Initialie. Start with LLR(r ij ) = 0 and LLR(p i ) = ln{1/exp(2y i /σ 2 )} = 2y i /σ 2. Message-passing and update. At each iteration, calculate: LLR(q ij ) = Σ LLR(r ij ) + LLR(p i )
4 LLR(r ij ) = 2 tanh -1 (Π tanh (½ LLR(q i j ))) (7) i ε L(i)\{j} where we note that, for any Probability of a binary variable x and for y ε (-1,1): 1 2P(x=1) = tanh( ½ LLR(P(x))) (8) 2tanh -1 (y) = ln{(1+y) / (1 y)} (9) Applying (8) and (9) to (5) and (6) gives (7). Calculate output. The posterior LLR is given by summing over all the checks that contain the i th bit and the intrinsic LLR: LLR(q i ) = Σ LLR(r ij ) + LLR(p i ) The bits q i can now be decoded as: If LLR(q i ) > 0 decode x i = 0 else x i = 1. It can be noted that any product of real numbers can be written as follows: Π a i = ( Π sgn(a i ) ). exp( Σ ln ( a i ) ). i i i Let Ψ (x) = ln(tanh(x/2)) = ln[(1 + exp(-x)) / (1 exp(-x))], where Ψ(x) is defined for x > 0 and is plotted in Fig 3. Noting that Ψ(x) is its own inverse, we can write: LLR(r ij ) = s ij. Ψ ( Σ Ψ ( LLR(q i j ) ) ) constellation with Gray coding (Fig 4), where each symbol represents 4 bits as [b1 b2 b3 b4], the intrinsic probability of bit1 is: LLR(P int (bit1) = ln{p(bit1=0 x,y) P(bit1=1 x,y)} = ln [P(symbol ε {0011, 0010,, 0101} x,y) P(symbol ε {1001, 1000,, 1111} x,y)]. Here, the numerator = [ exp{-((y-3) 2 + (x+3) 2 )/(2*σ 2 )} + exp{-((y-3) 2 + (x+1) 2 )/(2*σ 2 )} + + exp{-((y-1) 2 + (x-3) 2 )/(2*σ 2 )}], the denominator = [ exp{-((y+1) 2 + (x+3) 2 )/(2*σ 2 )} + exp{-((y+1) 2 + (x+1) 2 )/(2*σ 2 )} + + exp{-((y+3) 2 + (x-3) 2 )/(2*σ 2 )}], x and y are respectively the received values of the in-phase and quadrature components of the signal from the demodulator and σ 2 is the noise variance. Similarly, the intrinsic probabilities for bit2, bit3 and bit4 can be calculated. For each symbol received in 16-QAM, intrinsic probabilities for four bits are calculated. The rest of the decoding is done as before taking these intrinsic probabilities as inputs. where sign s ij = Π sgn(llr(q i j )). Fig 4 16-QAM constellation with Gray coding 6. Practicality of decoding Fig 3 - Ψ(x) (= Si(x)) vs x Decoding for multilevel modulation. The calculation of intrinsic probabilities is extended for multilevel modulation. For example, for the 16-QAM The concept of using sparse matrices for decoding using the MPA leads to practical decoding in the following ways: a. Decoding with LLRs, the multiplications required for computation of q ij get converted to additions making it suitable for hardware implementation. Also, the calculation of r ij requires a single mapping Ψ(x) and a few bit operations.
5 b. It can be observed [2] in Figure 3 that the dominant term in the calculation of LLR(r ij ) is the minimum of the terms LLR(q i j ) for. Thus, LLR(r ij ) can be calculated as: LLR(r ij ) = s ij. ( min ( LLR(q i j ) ) ) This requires a few comparisons and bit-operations. c. The decoding time increases only linearly with the blocklength. The implementation of decoding with Ψ(x) requires a large number of calculations for calculating ln(tanh(x/2)) whereas the min approximation requires only comparisons. The probability of undetected errors is very low, since the blocklength is large. There were no undetected errors in our simulations. This is one more advantage of large blocklengths, apart from improved performance. Uncoded BPSK has a BER of 10e-5 at 9.6 db. Coding gain at a BER of 10^-5 for BPSK is about 6.9 db when decoding is done with the Si(x) function and is about 6.6 db with the min approximation. Simulation results for QPSK and 16-QAM for the above rate half irregular LDPC code (decoding with the Si(x) function) are plotted in Fig 6. Coding gain for QPSK at a BER of 3*10^-5 is about 6.6 db. For 16-QAM, it is about 7 db at a BER of 3.5*10e-5. d. The biggest advantage of the LDPC decoder is that parallel processing is possible, i.e. the calculations for all nodes can be done in parallel. 7. Simulation Results Fig 5 gives the results of our BPSK simulations. As can be seen in Fig 1, cycles of length 4 are formed when any two columns of H have more than one 1 at same row positions. Cycles of length 4 were avoided completely in our construction of H matrix by taking care that any pair of columns of H matrix did not have more than one 1 bit at a common row position. These results are for rate ½ irregular LDPC code, blocklength n = 1000 and the simulations were averaged over 5000 runs for different values of Eb/No. The H matrix was constructed with variable row weight (mean weight 6) and column weight was Fig 6 Eb/No vs BER for QPSK and 16-QAM References 1. R.G.Gallager, Low-Density Parity-Check Codes, MIT Press, John L. Fan, Constrained Coding and Soft Iterative Decoding, K.A. Publishers, Richardson et al, Design of Capacityapproaching Irregular Low-Density Parity-Check Codes, IEEE Trans.Info.Theory, Feb Fig 5 Eb/No vs BER for BPSK fixed to j = 3. The maximum number of iterations allowed was 50. When the decoder failed to converge at a codeword after 50 iterations, the x vector, though not a codeword, was taken to be the decoded output.
An Introduction to Low Density Parity Check (LDPC) Codes
An Introduction to Low Density Parity Check (LDPC) Codes Jian Sun jian@csee.wvu.edu Wireless Communication Research Laboratory Lane Dept. of Comp. Sci. and Elec. Engr. West Virginia University June 3,
More informationPerformance Analysis and Code Optimization of Low Density Parity-Check Codes on Rayleigh Fading Channels
Performance Analysis and Code Optimization of Low Density Parity-Check Codes on Rayleigh Fading Channels Jilei Hou, Paul H. Siegel and Laurence B. Milstein Department of Electrical and Computer Engineering
More informationABSTRACT. The original low-density parity-check (LDPC) codes were developed by Robert
ABSTRACT Title of Thesis: OPTIMIZATION OF PERMUTATION KEY FOR π-rotation LDPC CODES Nasim Vakili Pourtaklo, Master of Science, 2006 Dissertation directed by: Associate Professor Steven Tretter Department
More informationLDPC Codes. Slides originally from I. Land p.1
Slides originally from I. Land p.1 LDPC Codes Definition of LDPC Codes Factor Graphs to use in decoding Decoding for binary erasure channels EXIT charts Soft-Output Decoding Turbo principle applied to
More informationLDPC Codes. Intracom Telecom, Peania
LDPC Codes Alexios Balatsoukas-Stimming and Athanasios P. Liavas Technical University of Crete Dept. of Electronic and Computer Engineering Telecommunications Laboratory December 16, 2011 Intracom Telecom,
More informationCHAPTER 3 LOW DENSITY PARITY CHECK CODES
62 CHAPTER 3 LOW DENSITY PARITY CHECK CODES 3. INTRODUCTION LDPC codes were first presented by Gallager in 962 [] and in 996, MacKay and Neal re-discovered LDPC codes.they proved that these codes approach
More informationIntroduction to Low-Density Parity Check Codes. Brian Kurkoski
Introduction to Low-Density Parity Check Codes Brian Kurkoski kurkoski@ice.uec.ac.jp Outline: Low Density Parity Check Codes Review block codes History Low Density Parity Check Codes Gallager s LDPC code
More informationIterative Encoding of Low-Density Parity-Check Codes
Iterative Encoding of Low-Density Parity-Check Codes David Haley, Alex Grant and John Buetefuer Institute for Telecommunications Research University of South Australia Mawson Lakes Blvd Mawson Lakes SA
More informationConstruction of low complexity Array based Quasi Cyclic Low density parity check (QC-LDPC) codes with low error floor
Construction of low complexity Array based Quasi Cyclic Low density parity check (QC-LDPC) codes with low error floor Pravin Salunkhe, Prof D.P Rathod Department of Electrical Engineering, Veermata Jijabai
More informationLower Bounds on the Graphical Complexity of Finite-Length LDPC Codes
Lower Bounds on the Graphical Complexity of Finite-Length LDPC Codes Igal Sason Department of Electrical Engineering Technion - Israel Institute of Technology Haifa 32000, Israel 2009 IEEE International
More informationCodes on Graphs. Telecommunications Laboratory. Alex Balatsoukas-Stimming. Technical University of Crete. November 27th, 2008
Codes on Graphs Telecommunications Laboratory Alex Balatsoukas-Stimming Technical University of Crete November 27th, 2008 Telecommunications Laboratory (TUC) Codes on Graphs November 27th, 2008 1 / 31
More informationExpectation propagation for symbol detection in large-scale MIMO communications
Expectation propagation for symbol detection in large-scale MIMO communications Pablo M. Olmos olmos@tsc.uc3m.es Joint work with Javier Céspedes (UC3M) Matilde Sánchez-Fernández (UC3M) and Fernando Pérez-Cruz
More informationConstructions of Nonbinary Quasi-Cyclic LDPC Codes: A Finite Field Approach
Constructions of Nonbinary Quasi-Cyclic LDPC Codes: A Finite Field Approach Shu Lin, Shumei Song, Lan Lan, Lingqi Zeng and Ying Y Tai Department of Electrical & Computer Engineering University of California,
More informationLecture 4 : Introduction to Low-density Parity-check Codes
Lecture 4 : Introduction to Low-density Parity-check Codes LDPC codes are a class of linear block codes with implementable decoders, which provide near-capacity performance. History: 1. LDPC codes were
More informationLow-Density Parity-Check codes An introduction
Low-Density Parity-Check codes An introduction c Tilo Strutz, 2010-2014,2016 June 9, 2016 Abstract Low-density parity-check codes (LDPC codes) are efficient channel coding codes that allow transmission
More informationLow-density parity-check (LDPC) codes
Low-density parity-check (LDPC) codes Performance similar to turbo codes Do not require long interleaver to achieve good performance Better block error performance Error floor occurs at lower BER Decoding
More informationMaking Error Correcting Codes Work for Flash Memory
Making Error Correcting Codes Work for Flash Memory Part I: Primer on ECC, basics of BCH and LDPC codes Lara Dolecek Laboratory for Robust Information Systems (LORIS) Center on Development of Emerging
More informationOn the minimum distance of LDPC codes based on repetition codes and permutation matrices 1
Fifteenth International Workshop on Algebraic and Combinatorial Coding Theory June 18-24, 216, Albena, Bulgaria pp. 168 173 On the minimum distance of LDPC codes based on repetition codes and permutation
More informationLecture 12. Block Diagram
Lecture 12 Goals Be able to encode using a linear block code Be able to decode a linear block code received over a binary symmetric channel or an additive white Gaussian channel XII-1 Block Diagram Data
More informationMapper & De-Mapper System Document
Mapper & De-Mapper System Document Mapper / De-Mapper Table of Contents. High Level System and Function Block. Mapper description 2. Demodulator Function block 2. Decoder block 2.. De-Mapper 2..2 Implementation
More informationLow-density parity-check codes
Low-density parity-check codes From principles to practice Dr. Steve Weller steven.weller@newcastle.edu.au School of Electrical Engineering and Computer Science The University of Newcastle, Callaghan,
More informationAn Introduction to Low-Density Parity-Check Codes
An Introduction to Low-Density Parity-Check Codes Paul H. Siegel Electrical and Computer Engineering University of California, San Diego 5/ 3/ 7 Copyright 27 by Paul H. Siegel Outline Shannon s Channel
More informationInformation Theoretic Imaging
Information Theoretic Imaging WU Faculty: J. A. O Sullivan WU Doctoral Student: Naveen Singla Boeing Engineer: James Meany First Year Focus: Imaging for Data Storage Image Reconstruction Data Retrieval
More informationCapacity-approaching codes
Chapter 13 Capacity-approaching codes We have previously discussed codes on graphs and the sum-product decoding algorithm in general terms. In this chapter we will give a brief overview of some particular
More informationECEN 655: Advanced Channel Coding
ECEN 655: Advanced Channel Coding Course Introduction Henry D. Pfister Department of Electrical and Computer Engineering Texas A&M University ECEN 655: Advanced Channel Coding 1 / 19 Outline 1 History
More information5. Density evolution. Density evolution 5-1
5. Density evolution Density evolution 5-1 Probabilistic analysis of message passing algorithms variable nodes factor nodes x1 a x i x2 a(x i ; x j ; x k ) x3 b x4 consider factor graph model G = (V ;
More information6.451 Principles of Digital Communication II Wednesday, May 4, 2005 MIT, Spring 2005 Handout #22. Problem Set 9 Solutions
6.45 Principles of Digital Communication II Wednesda, Ma 4, 25 MIT, Spring 25 Hand #22 Problem Set 9 Solutions Problem 8.3 (revised) (BCJR (sum-product) decoding of SPC codes) As shown in Problem 6.4 or
More informationStructured Low-Density Parity-Check Codes: Algebraic Constructions
Structured Low-Density Parity-Check Codes: Algebraic Constructions Shu Lin Department of Electrical and Computer Engineering University of California, Davis Davis, California 95616 Email:shulin@ece.ucdavis.edu
More informationState-of-the-Art Channel Coding
Institut für State-of-the-Art Channel Coding Prof. Dr.-Ing. Volker Kühn Institute of Communications Engineering University of Rostock, Germany Email: volker.kuehn@uni-rostock.de http://www.int.uni-rostock.de/
More informationCoding Techniques for Data Storage Systems
Coding Techniques for Data Storage Systems Thomas Mittelholzer IBM Zurich Research Laboratory /8 Göttingen Agenda. Channel Coding and Practical Coding Constraints. Linear Codes 3. Weight Enumerators and
More informationECC for NAND Flash. Osso Vahabzadeh. TexasLDPC Inc. Flash Memory Summit 2017 Santa Clara, CA 1
ECC for NAND Flash Osso Vahabzadeh TexasLDPC Inc. 1 Overview Why Is Error Correction Needed in Flash Memories? Error Correction Codes Fundamentals Low-Density Parity-Check (LDPC) Codes LDPC Encoding and
More informationAN INTRODUCTION TO LOW-DENSITY PARITY-CHECK CODES
AN INTRODUCTION TO LOW-DENSITY PARITY-CHECK CODES Item Type text; Proceedings Authors Moon, Todd K.; Gunther, Jacob H. Publisher International Foundation for Telemetering Journal International Telemetering
More informationSub-Gaussian Model Based LDPC Decoder for SαS Noise Channels
Sub-Gaussian Model Based LDPC Decoder for SαS Noise Channels Iulian Topor Acoustic Research Laboratory, Tropical Marine Science Institute, National University of Singapore, Singapore 119227. iulian@arl.nus.edu.sg
More informationMessage Passing Algorithm and Linear Programming Decoding for LDPC and Linear Block Codes
Message Passing Algorithm and Linear Programming Decoding for LDPC and Linear Block Codes Institute of Electronic Systems Signal and Information Processing in Communications Nana Traore Shashi Kant Tobias
More informationLow-Density Parity-Check Codes
Department of Computer Sciences Applied Algorithms Lab. July 24, 2011 Outline 1 Introduction 2 Algorithms for LDPC 3 Properties 4 Iterative Learning in Crowds 5 Algorithm 6 Results 7 Conclusion PART I
More informationModern Coding Theory. Daniel J. Costello, Jr School of Information Theory Northwestern University August 10, 2009
Modern Coding Theory Daniel J. Costello, Jr. Coding Research Group Department of Electrical Engineering University of Notre Dame Notre Dame, IN 46556 2009 School of Information Theory Northwestern University
More informationGraph-based Codes for Quantize-Map-and-Forward Relaying
20 IEEE Information Theory Workshop Graph-based Codes for Quantize-Map-and-Forward Relaying Ayan Sengupta, Siddhartha Brahma, Ayfer Özgür, Christina Fragouli and Suhas Diggavi EPFL, Switzerland, UCLA,
More informationIntroducing Low-Density Parity-Check Codes
Introducing Low-Density Parity-Check Codes Sarah J. Johnson School of Electrical Engineering and Computer Science The University of Newcastle Australia email: sarah.johnson@newcastle.edu.au Topic 1: Low-Density
More informationGraph-based codes for flash memory
1/28 Graph-based codes for flash memory Discrete Mathematics Seminar September 3, 2013 Katie Haymaker Joint work with Professor Christine Kelley University of Nebraska-Lincoln 2/28 Outline 1 Background
More informationLow Density Parity Check (LDPC) Codes and the Need for Stronger ECC. August 2011 Ravi Motwani, Zion Kwok, Scott Nelson
Low Density Parity Check (LDPC) Codes and the Need for Stronger ECC August 2011 Ravi Motwani, Zion Kwok, Scott Nelson Agenda NAND ECC History Soft Information What is soft information How do we obtain
More informationChapter 7: Channel coding:convolutional codes
Chapter 7: : Convolutional codes University of Limoges meghdadi@ensil.unilim.fr Reference : Digital communications by John Proakis; Wireless communication by Andreas Goldsmith Encoder representation Communication
More informationDesign of Non-Binary Quasi-Cyclic LDPC Codes by Absorbing Set Removal
Design of Non-Binary Quasi-Cyclic LDPC Codes by Absorbing Set Removal Behzad Amiri Electrical Eng. Department University of California, Los Angeles Los Angeles, USA Email: amiri@ucla.edu Jorge Arturo Flores
More informationLDPC codes based on Steiner quadruple systems and permutation matrices
Fourteenth International Workshop on Algebraic and Combinatorial Coding Theory September 7 13, 2014, Svetlogorsk (Kaliningrad region), Russia pp. 175 180 LDPC codes based on Steiner quadruple systems and
More informationConstruction and Performance Evaluation of QC-LDPC Codes over Finite Fields
MEE10:83 Construction and Performance Evaluation of QC-LDPC Codes over Finite Fields Ihsan Ullah Sohail Noor This thesis is presented as part of the Degree of Master of Sciences in Electrical Engineering
More informationUTA EE5362 PhD Diagnosis Exam (Spring 2011)
EE5362 Spring 2 PhD Diagnosis Exam ID: UTA EE5362 PhD Diagnosis Exam (Spring 2) Instructions: Verify that your exam contains pages (including the cover shee. Some space is provided for you to show your
More informationIterative Solutions Coded Modulation Library Theory of Operation
Iterative Solutions Coded Modulation Library Theory of Operation Oct. 3, 2005 Matthew Valenti Associate Professor West Virginia University Morgantown, WV 26506-6109 mvalenti@wvu.edu Noisy Channel Coding
More informationEnhancing Binary Images of Non-Binary LDPC Codes
Enhancing Binary Images of Non-Binary LDPC Codes Aman Bhatia, Aravind R Iyengar, and Paul H Siegel University of California, San Diego, La Jolla, CA 92093 0401, USA Email: {a1bhatia, aravind, psiegel}@ucsdedu
More informationThe New Multi-Edge Metric-Constrained PEG/QC-PEG Algorithms for Designing the Binary LDPC Codes With Better Cycle-Structures
HE et al.: THE MM-PEGA/MM-QC-PEGA DESIGN THE LDPC CODES WITH BETTER CYCLE-STRUCTURES 1 arxiv:1605.05123v1 [cs.it] 17 May 2016 The New Multi-Edge Metric-Constrained PEG/QC-PEG Algorithms for Designing the
More informationEE229B - Final Project. Capacity-Approaching Low-Density Parity-Check Codes
EE229B - Final Project Capacity-Approaching Low-Density Parity-Check Codes Pierre Garrigues EECS department, UC Berkeley garrigue@eecs.berkeley.edu May 13, 2005 Abstract The class of low-density parity-check
More informationResearch Letter Design of Short, High-Rate DVB-S2-Like Semi-Regular LDPC Codes
Research Letters in Communications Volume 2008, Article ID 324503, 4 pages doi:0.55/2008/324503 Research Letter Design of Short, High-Rate DVB-S2-Like Semi-Regular LDPC Codes Luca Barletta and Arnaldo
More informationOn Generalized EXIT Charts of LDPC Code Ensembles over Binary-Input Output-Symmetric Memoryless Channels
2012 IEEE International Symposium on Information Theory Proceedings On Generalied EXIT Charts of LDPC Code Ensembles over Binary-Input Output-Symmetric Memoryless Channels H Mamani 1, H Saeedi 1, A Eslami
More informationNon-binary Hybrid LDPC Codes: structure, decoding and optimization
Non-binary Hybrid LDPC Codes: structure, decoding and optimization Lucile Sassatelli and David Declercq ETIS - ENSEA/UCP/CNRS UMR-8051 95014 Cergy-Pontoise, France {sassatelli, declercq}@ensea.fr Abstract
More informationRCA Analysis of the Polar Codes and the use of Feedback to aid Polarization at Short Blocklengths
RCA Analysis of the Polar Codes and the use of Feedback to aid Polarization at Short Blocklengths Kasra Vakilinia, Dariush Divsalar*, and Richard D. Wesel Department of Electrical Engineering, University
More informationThe Turbo Principle in Wireless Communications
The Turbo Principle in Wireless Communications Joachim Hagenauer Institute for Communications Engineering () Munich University of Technology (TUM) D-80290 München, Germany Nordic Radio Symposium, Oulu,
More informationThe PPM Poisson Channel: Finite-Length Bounds and Code Design
August 21, 2014 The PPM Poisson Channel: Finite-Length Bounds and Code Design Flavio Zabini DEI - University of Bologna and Institute for Communications and Navigation German Aerospace Center (DLR) Balazs
More informationDecoding of LDPC codes with binary vector messages and scalable complexity
Downloaded from vbn.aau.dk on: marts 7, 019 Aalborg Universitet Decoding of LDPC codes with binary vector messages and scalable complexity Lechner, Gottfried; Land, Ingmar; Rasmussen, Lars Published in:
More informationBelief-Propagation Decoding of LDPC Codes
LDPC Codes: Motivation Belief-Propagation Decoding of LDPC Codes Amir Bennatan, Princeton University Revolution in coding theory Reliable transmission, rates approaching capacity. BIAWGN, Rate =.5, Threshold.45
More informationA Simplified Min-Sum Decoding Algorithm. for Non-Binary LDPC Codes
IEEE TRANSACTIONS ON COMMUNICATIONS 1 A Simplified Min-Sum Decoding Algorithm for Non-Binary LDPC Codes Chung-Li (Jason) Wang, Xiaoheng Chen, Zongwang Li, and Shaohua Yang arxiv:1207.5555v1 [cs.it] 23
More informationPipeline processing in low-density parity-check codes hardware decoder
BULLETIN OF THE POLISH ACADEMY OF SCIENCES TECHNICAL SCIENCES, Vol. 59, No. 2, 2011 DOI: 10.2478/v10175-011-0019-9 Pipeline processing in low-density parity-check codes hardware decoder. SUŁEK Institute
More informationAdaptive Cut Generation for Improved Linear Programming Decoding of Binary Linear Codes
Adaptive Cut Generation for Improved Linear Programming Decoding of Binary Linear Codes Xiaojie Zhang and Paul H. Siegel University of California, San Diego, La Jolla, CA 9093, U Email:{ericzhang, psiegel}@ucsd.edu
More informationA low complexity Soft-Input Soft-Output MIMO detector which combines a Sphere Decoder with a Hopfield Network
A low complexity Soft-Input Soft-Output MIMO detector which combines a Sphere Decoder with a Hopfield Network Daniel J. Louw, Philip R. Botha, B.T. Maharaj Department of Electrical, Electronic and Computer
More informationTHE seminal paper of Gallager [1, p. 48] suggested to evaluate
IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 50, NO. 11, NOVEMBER 2004 2657 Extrinsic Information Transfer Functions: Model and Erasure Channel Properties Alexei Ashikhmin, Member, IEEE, Gerhard Kramer,
More informationConvergence of the Sum-Product Algorithm for Short Low-Density Parity-Check Codes
DIPLOMA THESIS Convergence of the Sum-Product Algorithm for Short Low-Density Parity-Check Codes Institut of Communications and Radio-Frequency Engineering Vienna University of Technology (TU Wien) Telecommunications
More informationPractical Polar Code Construction Using Generalised Generator Matrices
Practical Polar Code Construction Using Generalised Generator Matrices Berksan Serbetci and Ali E. Pusane Department of Electrical and Electronics Engineering Bogazici University Istanbul, Turkey E-mail:
More informationError Floors of LDPC Coded BICM
Electrical and Computer Engineering Conference Papers, Posters and Presentations Electrical and Computer Engineering 2007 Error Floors of LDPC Coded BICM Aditya Ramamoorthy Iowa State University, adityar@iastate.edu
More information1.6: Solutions 17. Solution to exercise 1.6 (p.13).
1.6: Solutions 17 A slightly more careful answer (short of explicit computation) goes as follows. Taking the approximation for ( N K) to the next order, we find: ( N N/2 ) 2 N 1 2πN/4. (1.40) This approximation
More informationExpected Error Based MMSE Detection Ordering for Iterative Detection-Decoding MIMO Systems
Expected Error Based MMSE Detection Ordering for Iterative Detection-Decoding MIMO Systems Lei Zhang, Chunhui Zhou, Shidong Zhou, Xibin Xu National Laboratory for Information Science and Technology, Tsinghua
More informationChapter 7 Reed Solomon Codes and Binary Transmission
Chapter 7 Reed Solomon Codes and Binary Transmission 7.1 Introduction Reed Solomon codes named after Reed and Solomon [9] following their publication in 1960 have been used together with hard decision
More informationSlepian-Wolf Code Design via Source-Channel Correspondence
Slepian-Wolf Code Design via Source-Channel Correspondence Jun Chen University of Illinois at Urbana-Champaign Urbana, IL 61801, USA Email: junchen@ifpuiucedu Dake He IBM T J Watson Research Center Yorktown
More informationConstellation Shaping for Communication Channels with Quantized Outputs
Constellation Shaping for Communication Channels with Quantized Outputs, Dr. Matthew C. Valenti and Xingyu Xiang Lane Department of Computer Science and Electrical Engineering West Virginia University
More informationConstellation Shaping for Communication Channels with Quantized Outputs
Constellation Shaping for Communication Channels with Quantized Outputs Chandana Nannapaneni, Matthew C. Valenti, and Xingyu Xiang Lane Department of Computer Science and Electrical Engineering West Virginia
More informationOn Turbo-Schedules for LDPC Decoding
On Turbo-Schedules for LDPC Decoding Alexandre de Baynast, Predrag Radosavljevic, Victor Stolpman, Joseph R. Cavallaro, Ashutosh Sabharwal Department of Electrical and Computer Engineering Rice University,
More informationOn the Typicality of the Linear Code Among the LDPC Coset Code Ensemble
5 Conference on Information Sciences and Systems The Johns Hopkins University March 16 18 5 On the Typicality of the Linear Code Among the LDPC Coset Code Ensemble C.-C. Wang S.R. Kulkarni and H.V. Poor
More informationJoint Equalization and Decoding for Nonlinear Two-Dimensional Intersymbol Interference Channels with Application to Optical Storage
Joint Equalization and Decoding for Nonlinear Two-Dimensional Intersymbol Interference Channels with Application to Optical Storage 1 arxiv:cs/0509008v1 [cs.it] 4 Sep 2005 Naveen Singla and Joseph A. O
More informationA Short Length Low Complexity Low Delay Recursive LDPC Code
A Short Length Low Complexity Low Delay Recursive LDPC Code BASHAR M. MANSOOR, TARIQ Z. ISMAEEL Department of Electrical Engineering College of Engineering, University of Baghdad, IRAQ bmml77@yahoo.com
More information16.36 Communication Systems Engineering
MIT OpenCourseWare http://ocw.mit.edu 16.36 Communication Systems Engineering Spring 2009 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms. 16.36: Communication
More informationThe Concept of Soft Channel Encoding and its Applications in Wireless Relay Networks
The Concept of Soft Channel Encoding and its Applications in Wireless Relay Networks Gerald Matz Institute of Telecommunications Vienna University of Technology institute of telecommunications Acknowledgements
More informationLOW-density parity-check (LDPC) codes were invented
IEEE TRANSACTIONS ON INFORMATION THEORY, VOL 54, NO 1, JANUARY 2008 51 Extremal Problems of Information Combining Yibo Jiang, Alexei Ashikhmin, Member, IEEE, Ralf Koetter, Senior Member, IEEE, and Andrew
More informationAn algorithm to improve the error rate performance of Accumulate-Repeat-Accumulate codes Tae-Ui Kim
An algorithm to improve the error rate performance of Accumulate-Repeat-Accumulate codes Tae-Ui Kim The Graduate School Yonsei University Department of Electrical and Electronic Engineering An algorithm
More informationIntegrated Code Design for a Joint Source and Channel LDPC Coding Scheme
Integrated Code Design for a Joint Source and Channel LDPC Coding Scheme Hsien-Ping Lin Shu Lin and Khaled Abdel-Ghaffar Department of Electrical and Computer Engineering University of California Davis
More informationBounds on Mutual Information for Simple Codes Using Information Combining
ACCEPTED FOR PUBLICATION IN ANNALS OF TELECOMM., SPECIAL ISSUE 3RD INT. SYMP. TURBO CODES, 003. FINAL VERSION, AUGUST 004. Bounds on Mutual Information for Simple Codes Using Information Combining Ingmar
More informationEfficient LLR Calculation for Non-Binary Modulations over Fading Channels
Efficient LLR Calculation for Non-Binary Modulations over Fading Channels Raman Yazdani, Student Member, IEEE, and arxiv:12.2164v1 [cs.it] 1 Feb 21 Masoud Ardaani, Senior Member, IEEE Department of Electrical
More informationLDPC Decoder LLR Stopping Criterion
International Conference on Innovative Trends in Electronics Communication and Applications 1 International Conference on Innovative Trends in Electronics Communication and Applications 2015 [ICIECA 2015]
More informationSTUDY OF PERMUTATION MATRICES BASED LDPC CODE CONSTRUCTION
EE229B PROJECT REPORT STUDY OF PERMUTATION MATRICES BASED LDPC CODE CONSTRUCTION Zhengya Zhang SID: 16827455 zyzhang@eecs.berkeley.edu 1 MOTIVATION Permutation matrices refer to the square matrices with
More informationQuasi-cyclic Low Density Parity Check codes with high girth
Quasi-cyclic Low Density Parity Check codes with high girth, a work with Marta Rossi, Richard Bresnan, Massimilliano Sala Summer Doctoral School 2009 Groebner bases, Geometric codes and Order Domains Dept
More informationRandom Redundant Soft-In Soft-Out Decoding of Linear Block Codes
Random Redundant Soft-In Soft-Out Decoding of Linear Block Codes Thomas R. Halford and Keith M. Chugg Communication Sciences Institute University of Southern California Los Angeles, CA 90089-2565 Abstract
More informationCodes on graphs and iterative decoding
Codes on graphs and iterative decoding Bane Vasić Error Correction Coding Laboratory University of Arizona Funded by: National Science Foundation (NSF) Seagate Technology Defense Advanced Research Projects
More informationOn the minimum distance of LDPC codes based on repetition codes and permutation matrices
On the minimum distance of LDPC codes based on repetition codes and permutation matrices Fedor Ivanov Email: fii@iitp.ru Institute for Information Transmission Problems, Russian Academy of Science XV International
More informationCompressed Sensing and Linear Codes over Real Numbers
Compressed Sensing and Linear Codes over Real Numbers Henry D. Pfister (joint with Fan Zhang) Texas A&M University College Station Information Theory and Applications Workshop UC San Diego January 31st,
More informationFountain Uncorrectable Sets and Finite-Length Analysis
Fountain Uncorrectable Sets and Finite-Length Analysis Wen Ji 1, Bo-Wei Chen 2, and Yiqiang Chen 1 1 Beijing Key Laboratory of Mobile Computing and Pervasive Device Institute of Computing Technology, Chinese
More informationSIPCom8-1: Information Theory and Coding Linear Binary Codes Ingmar Land
SIPCom8-1: Information Theory and Coding Linear Binary Codes Ingmar Land Ingmar Land, SIPCom8-1: Information Theory and Coding (2005 Spring) p.1 Overview Basic Concepts of Channel Coding Block Codes I:
More informationConstruction of Protographs for QC LDPC Codes With Girth Larger Than 12 1
Construction of Protographs for QC LDPC Codes With Girth Larger Than 12 1 Sunghwan Kim, Jong-Seon No School of Electrical Eng. & Com. Sci. Seoul National University, Seoul, Korea Email: {nodoubt, jsno}@snu.ac.kr
More informationJOINT ITERATIVE DETECTION AND DECODING IN THE PRESENCE OF PHASE NOISE AND FREQUENCY OFFSET
JOINT ITERATIVE DETECTION AND DECODING IN THE PRESENCE OF PHASE NOISE AND FREQUENCY OFFSET Alan Barbieri, Giulio Colavolpe and Giuseppe Caire Università di Parma Institut Eurecom Dipartimento di Ingegneria
More informationDistributed Source Coding Using LDPC Codes
Distributed Source Coding Using LDPC Codes Telecommunications Laboratory Alex Balatsoukas-Stimming Technical University of Crete May 29, 2010 Telecommunications Laboratory (TUC) Distributed Source Coding
More informationSPA decoding on the Tanner graph
SPA decoding on the Tanner graph x,(i) q j,l = P(v l = x check sums A l \ {h j } at the ith iteration} x,(i) σ j,l = Σ P(s = 0 v = x,{v : t B(h )\{l}}) q {vt : t B(h j )\{l}} j l t j t B(h j )\{l} j,t
More informationDr. Cathy Liu Dr. Michael Steinberger. A Brief Tour of FEC for Serial Link Systems
Prof. Shu Lin Dr. Cathy Liu Dr. Michael Steinberger U.C.Davis Avago SiSoft A Brief Tour of FEC for Serial Link Systems Outline Introduction Finite Fields and Vector Spaces Linear Block Codes Cyclic Codes
More informationOn Accuracy of Gaussian Assumption in Iterative Analysis for LDPC Codes
ISIT 26, Seattle, USA, July 9-4, 26 On Accuracy of Gaussian Assumption in Iterative Analysis for LDPC Codes Kai Xie Electrical and Computer Engineering Dept, Lehigh University, Bethlehem, PA 85, USA Email:
More informationThe Design of Rate-Compatible Structured Low-Density Parity-Check Codes
The Design of Rate-Compatible Structured Low-Density Parity-Check Codes A Thesis Presented to The Academic Faculty by Jaehong Kim In Partial Fulfillment of the Requirements for the Degree Doctor of Philosophy
More informationEfficient Log Likelihood Ratio Estimation for Polar Codes
Efficient Log Likelihood Ratio Estimation for Polar Codes by Alaa Abdulameer Hasan, M. Sc. A dissertation submitted to the Faculty of Graduate Studies and Research in partial fulfillment of the requirements
More informationON THE MINIMUM DISTANCE OF NON-BINARY LDPC CODES. Advisor: Iryna Andriyanova Professor: R.. udiger Urbanke
ON THE MINIMUM DISTANCE OF NON-BINARY LDPC CODES RETHNAKARAN PULIKKOONATTU ABSTRACT. Minimum distance is an important parameter of a linear error correcting code. For improved performance of binary Low
More information