State-of-the-Art Channel Coding
|
|
- Cecilia Reed
- 6 years ago
- Views:
Transcription
1 Institut für State-of-the-Art Channel Coding Prof. Dr.-Ing. Volker Kühn Institute of Communications Engineering University of Rostock, Germany September 2 Volker Kühn - State-of-the-Art Channel Coding UNIVERSITÄT ROSTOCK FAKULTÄT INFORMATIK UND ELEKTROTECHNIK
2 Outline of Lectures Lesson : One Lesson of Information Theory Principle structure of communication systems Definitions of entropy, mutual information, Channel coding theorem of Shannon Lesson 2: Introduction to Error Correcting Codes Basics of error correcting codes Linear block codes Convolutional codes (if time permits) Lesson 3: State-of-the-art channel coding Coding strategies to approach the capacity limits Definition of soft-information and turbo decoding principle Examples for state-of-the-art error correcting codes 2
3 Shorty Review of Milestones 948: Shannon defines his information theory Definition of entropy and mutual information Channel coding theorem 963: Robert G. Gallager: Low Density Parity Check Codes 966: G. David Forney: Concatenated Codes Computers to that time not strong enough to demonstrate potential of investigated coding schemes Turbo decoding was implicitly already invented 993: First presentation of Turbo-Codes by Berrou, Glavieux, et al. Approaching Shannon s capacity for half-rate code by.5 db 2: Stephan ten Brink: EXIT Chart Analysis Leads to further understanding of iterative decoding principles Allows design / optimization of powerful concatenated codes Repeat Accumulate Code approaches capacity up to.8 db 3
4 Potential of Turbo Codes P b Comparison conv. codes / turbo codes for R c =/2 Lc=3 Lc=5 - Lc=7 Lc=9 TC db db log E / N b Optimized interleaver of length 256 x 256 = bit For this interleaver gain of nearly 3 db over conv. code with L c = 9 Gap to Shannon s channel capacity only.5 db Tremendous performance loss for smaller interleavers World record:. db gap to Shannon capacity by Stephan ten Brink 4
5 Serial and Parallel Code Concatenation Serial Code Concatenation Example: Repeat Accumulate Codes inner code outer code D 2 D C C 2 D 2 D Parallel Code Concatenation Example: Turbo Codes C P C 2 C q S 5
6 Interleaving Simple block interleaver write x x 3 x 6 x 9 x 2 read interleaving depth: 5 x x 4 x 7 x x 3 x 2 x 5 x 8 x x 4 Input sequence: x, x, x 2, x 3, x 4, x 5, x 6, x 7, x 8, x 9, x, x, x 2, x 3, x 4 Output sequence: x, x 3, x 6, x 9, x 2, x, x 4, x 7, x, x 3, x 2, x 5, x 8, x, x 4 Convolutional interleaver Random interleaver 6
7 Simple Example of Serial Concatenation Concatenation of (3,2,2)-SPC and (4,3,2)-SPC code C C Total code rate: R c = 2/4 =.5 u c c 2 w H (c 2 ) d min = 2 Minimum Hamming distance is not improved by code concatenation 7
8 Another Example of Serial Concatenation Concatenation of (4,3,2)-SPC and (7,4,3)-Hamming code Total code rate: Rc = 3/7 C C uc c c 2 c 2 w H (c 2 ) w H (c 2 ) c 2 w H (c 2 ) original concatenation: d min = 3 optimized concatenation: d min = 4 Minimum Hamming distance can only be improved by careful selection of subset of inner code 8
9 Serial Code Concatenation: Product Codes k n -k Information bits arranged in (k,k - )-matrix k u p C Row-wise encoding with code C - of rate k - / n - Column-wise encoding with code C of rate k / n n -k p C p + Entire code rate: R c = k k n n = R c R c Minimum Hamming distance: d min = d min d min 9
10 Examples of Product Codes () (2,6,4) product code x x 4 x 8 x x 5 x 9 x 2 x 6 x x 3 x 7 x Horizontal: (3,2,2)-SPC code no error correction possible Vertical: (4,3,2)-SPC code no error correction possible Code rate: /2 d min = 2 2 = 4 Correction of error possible
11 Examples of Product Codes (2) (28,2,6) product code x x 7 x 4 x 2 x x 7 x 4 x 2 x x x x 5 x 8 x 5 x 22 x x 8 x 5 x 22 x 2 x 9 x 6 x 23 x 2 x 9 x 6 x 23 x 3 x x 7 x 24 x 3 x x 7 x 24 x 4 x x 8 x 25 x 4 x x 8 x 25 x 5 x 2 x 9 x 26 x 5 x 2 x 9 x 26 x 6 x 3 x 2 x 27 x 6 x 3 x 2 x 27 Horizontal: (4,3,2)-SPC code no error correction possible Vertical: (7,4,3)-Hamming code single error correction possible d min = 2 3 = 6 2 errors correctable
12 Parallel Code Concatenation n -k k k - n - -k - u p C p - Information bits u row-wise encoded with C - column-wise encoded with C Parity check bits of component codes not encoded (no checks on checks) C - Entire code rate R c k k n n ( n k ) ( n k ) R R / c / c Minimum Hamming distance: d d d min min min 2
13 Example of Turbo Code 2 systematic, recursive convolutional encoders (L c = 3) Constituent code rates R c = 2/3 total code rate R c = /2 u c c u T T C u 2 T T c 2 P C 2 3
14 Turbo Code from Berrou and Glavieux 2 systematic, recursive convolutional encoders (L c = 5) Constituent code rates R c = 2/3 total code rate R c = /2 Pseudo random interleaver of length bits u c c u T T T T C c 2 u 2 C 2 T T T T P 4
15 Repeat Accumulate Code from ten Brink Outer half-rate repetition code Inner convolutional code (scrambler) of rate total code rate R c = /2 Random interleaver of different lengths Code doping: replace a few code bits (%) by information bits for improving the convergence of iterative decoding process u repetition encoder repetition encoder T T T inner convolutional code 5
16 Outline of Lectures Lesson : One Lesson of Information Theory Principle structure of communication systems Definitions of entropy, mutual information, Channel coding theorem of Shannon Lesson 2: Introduction to Error Correcting Codes Basics of error correcting codes Linear block codes Convolutional codes (if time permits) Lesson 3: State-of-the-art channel coding Coding strategies to approach the capacity limits Definition of soft-information and turbo decoding principle Examples for state-of-the-art error correcting codes 6
17 Log-Likelihood Ratios (LLRs) Definition log-likelihood ratio: Sign determines hard decision Magnitude represents reliability of hard decision 8 Probability of correct decision: P correct = e L(x) + e L(x) Expectation of LLR (soft bit) E{x} = Pr{x = +} Pr{x = } = el(x) + e L(x) + e µ L(x) L(x) = tanh 2 L(x) L(x) = log Pr{x = +} Pr{x = } Pr{x = +}
18 Log-Likelihood Ratios at AWGN Channel Output Scaled matched filter output equals LLR p(y x = +) L(y x) = log p(y x = ) = log exp[ (y )2 /2/σN 2 ] exp[ (y + ) 2 /2/σN 2 ] = 2 6 σ 2 N y 4 L(y x) 2-2 db 2 db -4 4 db 6 db 8dB y 8
19 Example for Soft-Output Decoding Single parity check code: u u 2 p p = u u 2 Question: What is the LLR of u given the LLRs of u 2 and p? Resolving parity check equation w.r.t. u : Extrinsic LLR does not depend on u itself: u = u 2 p L e (u ) = log Pr{u 2 p = } Pr{u 2 p = } = log Pr{u 2 =, p = } + Pr{u 2 =, p = } Pr{u 2 =, p = } + Pr{u 2 =, p = } = log Pr{u 2 = } Pr{p = } + Pr{u 2 = } Pr{p = } Pr{u 2 = } Pr{p = } + Pr{u 2 = } Pr{p = }. = 2 atanh tanh µ L(u2 ) 2 µ L(p) tanh = 2 atanh E{u 2 } E{p} 2 9
20 L-Algebra mod-2-sum of 2 statistical h independent random variables: L(x x 2 ) = 2 atanh sgn tanh L(x ) L(x sgn )/2 L(x 2 ) tanh ³L(x min 2 )/2 i L(x ), L(x 2 ) ª L(x ) L(x 2 ) tanh(x/2) + - tanh(x/2) mod-2-sum of n variables: 2 artanh(x) - + " Y n µ # L(xi ) L(x x n ) = 2artanh tanh 2 i= ny sgn L(x i ) min L(xi ) ª i 2 i= L(x x 2 )
21 General Approach for Soft-Output Decoding For systematic encoders, soft-output of decoder can be split into 3 statistically independent parts: L(û i ) = log p(u i =, y) p(u i =, y) = log P P c Γ () i c Γ () i L ch y i L a (u i ) p(y x) Pr{c} p(y x) Pr{c} = log p(y i x i = +) p(y i x i = ) + log Pr{u i = } Pr{u i = } + log P c Γ () i P c Γ () i nq j= j6=i nq j= j6=i p(y j x j ) p(y j x j ) kq j= j6=i kq j= j6=i Pr{c j } Pr{c j } Intrinsic LLR (systematic part) A-priori LLR L e (û i ) Extrinsic LLR 2
22 Outline of Lectures Lesson : One Lesson of Information Theory Principle structure of communication systems Definitions of entropy, mutual information, Channel coding theorem of Shannon Lesson 2: Introduction to Error Correcting Codes Basics of error correcting codes Linear block codes Convolutional codes (if time permits) Lesson 3: State-of-the-art channel coding Coding strategies to approach the capacity limits Definition of soft-information and turbo decoding principle Examples for state-of-the-art error correcting codes 22
23 Soft-Output Decoding for (4,3,2)-SPC-Code E s /N = 2dB u L ch y encoding + approximation c L e (û) Pr{û correct} BPSK x = L ch y+ L e (û) L(û) HD AWGN error corrected y HD error detected. but not corrected 23
24 Turbo Decoding of (24,6,3)-Produktcode () u x LLR encoding AWGN BPSK SNR=2 db L a, (û) = L e, (û). vertical extrinsic decoding information L (û) L e, (û) L ch y L e, (û)
25 Turbo Decoding of (24,6,3)-Produktcode (2) L 2.5 e, (û) L (û) L ch y + L a, (û) horizontal L y + ch decoding L e, (û) + L a, (û) L ch y + L a,2 (u) L e, (û) = L a,2 (û) û
26 Turbo Decoding of (24,6,3)-Produktcode (3) L ch y + L a,2 (u) û 2 L 2 (û) x x vertical decoding L ch y + L a,2 (u) L ch y + L e,2 (û) + L a,2 (û) e,2 (û) L ch y + L ch y + L 2 (û) horizontal L e,2 (û) L a,2 (û) L e,2 (û) + L a,2 (û) decoding
27 Turbo Decoding of (24,6,3)-Produktcode (4). 3.4 L ch y + L a,3 (u) û 3 L 2 (û) vertical decoding L ch y + L a,3 (u) L ch y + L e,3 (û) + L a,3 (û) e,3 (û) L 3 (û) L e,3 (û) L ch y + L ch y horizontal L a,3 (û) L e,3 (û) + L a,3 (û) decoding
28 General Concept of Turbo Decoding L 2 ˆ a u Le ( ) ( u) Lch y D D 2 L ( u ˆ) L L ch e L 2 e y ( u ˆ) ( uˆ ) s L ( u) L y L ( uˆ ) 2 a ch s e L 2 ( uˆ ) L L ch e L 2 e y ( uˆ ) ( uˆ ) s Each decoder supplies extrinsic information as a priori information to other decoder L e (û) is incorporated in L(û) for systematic encoders Improvement by additional decoding iteration with a-priori knowledge if L e (û), L a (û) and L ch y s are statistically independent 28
29 Simulation Results for Product Code (7,4,3)-Hamming Codes, parallel concatenation It. It.2 It.3 analyt. -2 P b log E / N b 29
30 Simulation Results for Product Codes (5,,3)-Hamming-Codes, parallel concatenation It. It.2 It.3 analyt. -2 P b log E / N 3 b
31 Simulation Results for Product Codes (3,26,3)-Hamming-Codes, parallel concatenation It. It.2 It.3 analyt. -2 P b log E / N b 3
32 Simulation Results for Turbo Codes (L c = 3) Simple Block Interleaver No significant improvements after third decoding iteration P b x Block-Interleaver - -2 It. It. 2 It. 3 It. 4 It. 5 It. 6 P b 3x3 Block-Interleaver - -2 It. It. 2 It. 3 It. 4 It. 5 It log E / N b log E / N b 32
33 Simulation Results for Turbo Codes (L c = 3) P b Block and Random Interleavers Iterative process gains significantly even after sixth iteration Increasing interleaver size improves performance remarkably 9-Random-Interleaver, Rc=/ It. It. 2 It. 3 It. 4 It. 6 It. P b Comparison of different interleavers - -2 FC, Lc=9 BIL- BIL-4 BIL-9 RIL-9 RIL-9,Rc=/ E b / N in db Eb / N in db 33
34 Repeat Accumulate Code by ten Brink Half-rate outer repetition encoder Rate-one inner recursive convolutional encoder Approximately decoding iterations are needed - -2 BER E b /N in db 34
35 Repeat Accumulate Code by ten Brink 35
36 Application Areas of Turbo Detection Application of turbo processing not restricted to concatenated codes Applicable for any concatenated system Concatenation of source and channel coding (exploitation of residual redundancy from source coding) Concatenation of coding and modulation (bit-interleaved coded modulation) Channel equalization and decoding can be performed iteratively Multi-user detection and decoding can be performed iteratively 36
37 Institut für Thanks for your attention! September 2 Volker Kühn - State-of-the-Art Channel Coding UNIVERSITÄT ROSTOCK FAKULTÄT INFORMATIK UND ELEKTROTECHNIK
One Lesson of Information Theory
Institut für One Lesson of Information Theory Prof. Dr.-Ing. Volker Kühn Institute of Communications Engineering University of Rostock, Germany Email: volker.kuehn@uni-rostock.de http://www.int.uni-rostock.de/
More informationThe Turbo Principle in Wireless Communications
The Turbo Principle in Wireless Communications Joachim Hagenauer Institute for Communications Engineering () Munich University of Technology (TUM) D-80290 München, Germany Nordic Radio Symposium, Oulu,
More informationTHE EFFECT OF PUNCTURING ON THE CONVOLUTIONAL TURBO-CODES PERFORMANCES
THE EFFECT OF PUNCTURING ON THE CONVOLUTIONAL TURBO-COES PERFORMANCES Horia BALTA 1, Lucian TRIFINA, Anca RUSINARU 1 Electronics and Telecommunications Faculty, Bd. V. Parvan, 1900 Timisoara, ROMANIA,
More informationDigital Communications
Digital Communications Chapter 8: Trellis and Graph Based Codes Saeedeh Moloudi May 7, 2014 Outline 1 Introduction 2 Convolutional Codes 3 Decoding of Convolutional Codes 4 Turbo Codes May 7, 2014 Proakis-Salehi
More informationLDPC Codes. Slides originally from I. Land p.1
Slides originally from I. Land p.1 LDPC Codes Definition of LDPC Codes Factor Graphs to use in decoding Decoding for binary erasure channels EXIT charts Soft-Output Decoding Turbo principle applied to
More informationModern Coding Theory. Daniel J. Costello, Jr School of Information Theory Northwestern University August 10, 2009
Modern Coding Theory Daniel J. Costello, Jr. Coding Research Group Department of Electrical Engineering University of Notre Dame Notre Dame, IN 46556 2009 School of Information Theory Northwestern University
More informationBounds on Mutual Information for Simple Codes Using Information Combining
ACCEPTED FOR PUBLICATION IN ANNALS OF TELECOMM., SPECIAL ISSUE 3RD INT. SYMP. TURBO CODES, 003. FINAL VERSION, AUGUST 004. Bounds on Mutual Information for Simple Codes Using Information Combining Ingmar
More informationTurbo Compression. Andrej Rikovsky, Advisor: Pavol Hanus
Turbo Compression Andrej Rikovsky, Advisor: Pavol Hanus Abstract Turbo codes which performs very close to channel capacity in channel coding can be also used to obtain very efficient source coding schemes.
More informationIntroduction to Low-Density Parity Check Codes. Brian Kurkoski
Introduction to Low-Density Parity Check Codes Brian Kurkoski kurkoski@ice.uec.ac.jp Outline: Low Density Parity Check Codes Review block codes History Low Density Parity Check Codes Gallager s LDPC code
More informationTurbo Codes for xdsl modems
Turbo Codes for xdsl modems Juan Alberto Torres, Ph. D. VOCAL Technologies, Ltd. (http://www.vocal.com) John James Audubon Parkway Buffalo, NY 14228, USA Phone: +1 716 688 4675 Fax: +1 716 639 0713 Email:
More informationTurbo Codes for Deep-Space Communications
TDA Progress Report 42-120 February 15, 1995 Turbo Codes for Deep-Space Communications D. Divsalar and F. Pollara Communications Systems Research Section Turbo codes were recently proposed by Berrou, Glavieux,
More informationECEN 655: Advanced Channel Coding
ECEN 655: Advanced Channel Coding Course Introduction Henry D. Pfister Department of Electrical and Computer Engineering Texas A&M University ECEN 655: Advanced Channel Coding 1 / 19 Outline 1 History
More informationA Relation between Conditional and Unconditional Soft Bit Densities of Binary Input Memoryless Symmetric Channels
A Relation between Conditional and Unconditional Soft Bit Densities of Binary Input Memoryless Symmetric Channels Wolfgang Rave Vodafone Chair Mobile Communications Systems, Technische Universität Dresden
More informationOptimized Symbol Mappings for Bit-Interleaved Coded Modulation with Iterative Decoding
Optimized Symbol Mappings for Bit-nterleaved Coded Modulation with terative Decoding F. Schreckenbach, N. Görtz, J. Hagenauer nstitute for Communications Engineering (LNT) Munich University of Technology
More informationAn Introduction to Low Density Parity Check (LDPC) Codes
An Introduction to Low Density Parity Check (LDPC) Codes Jian Sun jian@csee.wvu.edu Wireless Communication Research Laboratory Lane Dept. of Comp. Sci. and Elec. Engr. West Virginia University June 3,
More informationSIPCom8-1: Information Theory and Coding Linear Binary Codes Ingmar Land
SIPCom8-1: Information Theory and Coding Linear Binary Codes Ingmar Land Ingmar Land, SIPCom8-1: Information Theory and Coding (2005 Spring) p.1 Overview Basic Concepts of Channel Coding Block Codes I:
More informationTHE seminal paper of Gallager [1, p. 48] suggested to evaluate
IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 50, NO. 11, NOVEMBER 2004 2657 Extrinsic Information Transfer Functions: Model and Erasure Channel Properties Alexei Ashikhmin, Member, IEEE, Gerhard Kramer,
More informationChannel Coding I. Exercises SS 2017
Channel Coding I Exercises SS 2017 Lecturer: Dirk Wübben Tutor: Shayan Hassanpour NW1, Room N 2420, Tel.: 0421/218-62387 E-mail: {wuebben, hassanpour}@ant.uni-bremen.de Universität Bremen, FB1 Institut
More informationMessage-Passing Decoding for Low-Density Parity-Check Codes Harish Jethanandani and R. Aravind, IIT Madras
Message-Passing Decoding for Low-Density Parity-Check Codes Harish Jethanandani and R. Aravind, IIT Madras e-mail: hari_jethanandani@yahoo.com Abstract Low-density parity-check (LDPC) codes are discussed
More informationTHE EXIT CHART INTRODUCTION TO EXTRINSIC INFORMATION TRANSFER IN ITERATIVE PROCESSING
THE EXIT CHART ITRODUCTIO TO EXTRISIC IFORMATIO TRASFER I ITERATIVE PROCESSIG Joachim Hagenauer Institute of Communications Engineering (LT), Munich University of Technology (TUM) Arcisstraße 2, D-829
More informationLDPC Codes. Intracom Telecom, Peania
LDPC Codes Alexios Balatsoukas-Stimming and Athanasios P. Liavas Technical University of Crete Dept. of Electronic and Computer Engineering Telecommunications Laboratory December 16, 2011 Intracom Telecom,
More informationAalborg Universitet. Bounds on information combining for parity-check equations Land, Ingmar Rüdiger; Hoeher, A.; Huber, Johannes
Aalborg Universitet Bounds on information combining for parity-check equations Land, Ingmar Rüdiger; Hoeher, A.; Huber, Johannes Published in: 2004 International Seminar on Communications DOI link to publication
More informationEfficient Computation of EXIT Functions for Non-Binary Iterative Decoding
TO BE PUBLISHED IN IEEE TRANSACTIONS ON COMMUNCATIONS, DECEMBER 2006 Efficient Computation of EXIT Functions for Non-Binary Iterative Decoding Jörg Kliewer, Senior Member, IEEE, Soon Xin Ng, Member, IEEE,
More informationNew Puncturing Pattern for Bad Interleavers in Turbo-Codes
SERBIAN JOURNAL OF ELECTRICAL ENGINEERING Vol. 6, No. 2, November 2009, 351-358 UDK: 621.391.7:004.052.4 New Puncturing Pattern for Bad Interleavers in Turbo-Codes Abdelmounaim Moulay Lakhdar 1, Malika
More informationLow-Density Parity-Check codes An introduction
Low-Density Parity-Check codes An introduction c Tilo Strutz, 2010-2014,2016 June 9, 2016 Abstract Low-density parity-check codes (LDPC codes) are efficient channel coding codes that allow transmission
More informationCommunication by Regression: Sparse Superposition Codes
Communication by Regression: Sparse Superposition Codes Department of Statistics, Yale University Coauthors: Antony Joseph and Sanghee Cho February 21, 2013, University of Texas Channel Communication Set-up
More informationOn the Computation of EXIT Characteristics for Symbol-Based Iterative Decoding
On the Computation of EXIT Characteristics for Symbol-Based Iterative Decoding Jörg Kliewer, Soon Xin Ng 2, and Lajos Hanzo 2 University of Notre Dame, Department of Electrical Engineering, Notre Dame,
More informationPOLAR CODES FOR ERROR CORRECTION: ANALYSIS AND DECODING ALGORITHMS
ALMA MATER STUDIORUM UNIVERSITÀ DI BOLOGNA CAMPUS DI CESENA SCUOLA DI INGEGNERIA E ARCHITETTURA CORSO DI LAUREA MAGISTRALE IN INGEGNERIA ELETTRONICA E TELECOMUNICAZIONI PER L ENERGIA POLAR CODES FOR ERROR
More informationCapacity-approaching codes
Chapter 13 Capacity-approaching codes We have previously discussed codes on graphs and the sum-product decoding algorithm in general terms. In this chapter we will give a brief overview of some particular
More informationTurbo Codes. Manjunatha. P. Professor Dept. of ECE. June 29, J.N.N. College of Engineering, Shimoga.
Turbo Codes Manjunatha. P manjup.jnnce@gmail.com Professor Dept. of ECE J.N.N. College of Engineering, Shimoga June 29, 2013 [1, 2, 3, 4, 5, 6] Note: Slides are prepared to use in class room purpose, may
More informationLecture 4 : Introduction to Low-density Parity-check Codes
Lecture 4 : Introduction to Low-density Parity-check Codes LDPC codes are a class of linear block codes with implementable decoders, which provide near-capacity performance. History: 1. LDPC codes were
More informationUnequal Error Protection Turbo Codes
Unequal Error Protection Turbo Codes Diploma Thesis Neele von Deetzen Arbeitsbereich Nachrichtentechnik School of Engineering and Science Bremen, February 28th, 2005 Unequal Error Protection Turbo Codes
More informationHybrid Concatenated Codes with Asymptotically Good Distance Growth
Hybrid Concatenated Codes with Asymptotically Good Distance Growth Christian Koller, Alexandre Graell i Amat,Jörg Kliewer, Francesca Vatta, and Daniel J. Costello, Jr. Department of Electrical Engineering,
More informationPerformance of Multi Binary Turbo-Codes on Nakagami Flat Fading Channels
Buletinul Ştiinţific al Universităţii "Politehnica" din Timişoara Seria ELECTRONICĂ şi TELECOMUNICAŢII TRANSACTIONS on ELECTRONICS and COMMUNICATIONS Tom 5(65), Fascicola -2, 26 Performance of Multi Binary
More informationPUNCTURED 8-PSK TURBO-TCM TRANSMISSIONS USING RECURSIVE SYSTEMATIC CONVOLUTIONAL GF ( 2 N ) ENCODERS
19th European Signal Processing Conference (EUSIPCO 2011) Barcelona, Spain, August 29 - September 2, 2011 PUCTURED 8-PSK TURBO-TCM TRASMISSIOS USIG RECURSIVE SYSTEMATIC COVOLUTIOAL GF ( 2 ) ECODERS Calin
More informationGraph-based Codes and Iterative Decoding
Graph-based Codes and Iterative Decoding Thesis by Aamod Khandekar In Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy California Institute of Technology Pasadena, California
More informationA NEW CHANNEL CODING TECHNIQUE TO APPROACH THE CHANNEL CAPACITY
A NEW CHANNEL CODING TECHNIQUE TO APPROACH THE CHANNEL CAPACITY Mahesh Patel 1 and A. Annamalai 1 1 Department of Electrical and Computer Engineering, Prairie View A & M University, TX 77446, United States
More informationJoint Iterative Decoding of LDPC Codes and Channels with Memory
Joint Iterative Decoding of LDPC Codes and Channels with Memory Henry D. Pfister and Paul H. Siegel University of California, San Diego 3 rd Int l Symposium on Turbo Codes September 1, 2003 Outline Channels
More information1 1 0, g Exercise 1. Generator polynomials of a convolutional code, given in binary form, are g
Exercise Generator polynomials of a convolutional code, given in binary form, are g 0, g 2 0 ja g 3. a) Sketch the encoding circuit. b) Sketch the state diagram. c) Find the transfer function TD. d) What
More informationPolar Code Construction for List Decoding
1 Polar Code Construction for List Decoding Peihong Yuan, Tobias Prinz, Georg Böcherer arxiv:1707.09753v1 [cs.it] 31 Jul 2017 Abstract A heuristic construction of polar codes for successive cancellation
More informationConvolutional Codes ddd, Houshou Chen. May 28, 2012
Representation I, II Representation III, IV trellis of Viterbi decoding Turbo codes Convolutional Codes ddd, Houshou Chen Department of Electrical Engineering National Chung Hsing University Taichung,
More informationSuccessive Cancellation Decoding of Single Parity-Check Product Codes
Successive Cancellation Decoding of Single Parity-Check Product Codes Mustafa Cemil Coşkun, Gianluigi Liva, Alexandre Graell i Amat and Michael Lentmaier Institute of Communications and Navigation, German
More informationSoft-Output Decision-Feedback Equalization with a Priori Information
Soft-Output Decision-Feedback Equalization with a Priori Information Renato R. opes and John R. Barry School of Electrical and Computer Engineering Georgia Institute of Technology, Atlanta, Georgia 333-5
More informationBounds on the Error Probability of ML Decoding for Block and Turbo-Block Codes
Bounds on the Error Probability of ML Decoding for Block and Turbo-Block Codes Igal Sason and Shlomo Shamai (Shitz) Department of Electrical Engineering Technion Israel Institute of Technology Haifa 3000,
More informationLOW-density parity-check (LDPC) codes were invented
IEEE TRANSACTIONS ON INFORMATION THEORY, VOL 54, NO 1, JANUARY 2008 51 Extremal Problems of Information Combining Yibo Jiang, Alexei Ashikhmin, Member, IEEE, Ralf Koetter, Senior Member, IEEE, and Andrew
More informationCommunication Theory II
Communication Theory II Lecture 24: Error Correction Techniques Ahmed Elnakib, PhD Assistant Professor, Mansoura University, Egypt May 14 th, 2015 1 Error Correction Techniques olinear Block Code Cyclic
More informationPolar Coding for the Large Hadron Collider: Challenges in Code Concatenation
Polar Coding for the Large Hadron Collider: Challenges in Code Concatenation Alexios Balatsoukas-Stimming, Tomasz Podzorny, Jan Uythoven {alexios.balatsoukas, tomasz.podzorny, jan.uythoven}@cern.ch European
More informationEncoder. Encoder 2. ,...,u N-1. 0,v (0) ,u 1. ] v (0) =[v (0) 0,v (1) v (1) =[v (1) 0,v (2) v (2) =[v (2) (a) u v (0) v (1) v (2) (b) N-1] 1,...
Chapter 16 Turbo Coding As noted in Chapter 1, Shannon's noisy channel coding theorem implies that arbitrarily low decoding error probabilities can be achieved at any transmission rate R less than the
More information16.36 Communication Systems Engineering
MIT OpenCourseWare http://ocw.mit.edu 16.36 Communication Systems Engineering Spring 2009 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms. 16.36: Communication
More informationInterleaver Design for Turbo Codes
1 Interleaver Design for Turbo Codes H. R. Sadjadpour, N. J. A. Sloane, M. Salehi, and G. Nebe H. Sadjadpour and N. J. A. Sloane are with AT&T Shannon Labs, Florham Park, NJ. E-mail: sadjadpour@att.com
More informationOn the minimum distance of LDPC codes based on repetition codes and permutation matrices
On the minimum distance of LDPC codes based on repetition codes and permutation matrices Fedor Ivanov Email: fii@iitp.ru Institute for Information Transmission Problems, Russian Academy of Science XV International
More informationChannel Coding I. Exercises SS 2017
Channel Coding I Exercises SS 2017 Lecturer: Dirk Wübben Tutor: Shayan Hassanpour NW1, Room N 2420, Tel.: 0421/218-62387 E-mail: {wuebben, hassanpour}@ant.uni-bremen.de Universität Bremen, FB1 Institut
More informationMessage Passing Algorithm and Linear Programming Decoding for LDPC and Linear Block Codes
Message Passing Algorithm and Linear Programming Decoding for LDPC and Linear Block Codes Institute of Electronic Systems Signal and Information Processing in Communications Nana Traore Shashi Kant Tobias
More informationBelief-Propagation Decoding of LDPC Codes
LDPC Codes: Motivation Belief-Propagation Decoding of LDPC Codes Amir Bennatan, Princeton University Revolution in coding theory Reliable transmission, rates approaching capacity. BIAWGN, Rate =.5, Threshold.45
More informationPerformance Analysis and Code Optimization of Low Density Parity-Check Codes on Rayleigh Fading Channels
Performance Analysis and Code Optimization of Low Density Parity-Check Codes on Rayleigh Fading Channels Jilei Hou, Paul H. Siegel and Laurence B. Milstein Department of Electrical and Computer Engineering
More informationSymbol Interleaved Parallel Concatenated Trellis Coded Modulation
Symbol Interleaved Parallel Concatenated Trellis Coded Modulation Christine Fragouli and Richard D. Wesel Electrical Engineering Department University of California, Los Angeles christin@ee.ucla. edu,
More informationBifurcations and Chaos in Turbo Decoding Algorithms
Bifurcations and Chaos in Turbo Decoding Algorithms Z. Tasev 1, P. Popovski 2, G.M. Maggio 3, and L. Kocarev 1 1 Institute for Nonlinear Science, University of California, San Diego, 9500 Gilman Drive,
More informationLecture 12. Block Diagram
Lecture 12 Goals Be able to encode using a linear block code Be able to decode a linear block code received over a binary symmetric channel or an additive white Gaussian channel XII-1 Block Diagram Data
More informationThe Super-Trellis Structure of Turbo Codes
2212 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL 46, NO 6, SEPTEMBER 2000 The Super-Trellis Structure of Turbo Codes Marco Breiling, Student Member, IEEE, and Lajos Hanzo, Senior Member, IEEE Abstract
More informationThe Concept of Soft Channel Encoding and its Applications in Wireless Relay Networks
The Concept of Soft Channel Encoding and its Applications in Wireless Relay Networks Gerald Matz Institute of Telecommunications Vienna University of Technology institute of telecommunications Acknowledgements
More informationLow Density Parity Check (LDPC) Codes and the Need for Stronger ECC. August 2011 Ravi Motwani, Zion Kwok, Scott Nelson
Low Density Parity Check (LDPC) Codes and the Need for Stronger ECC August 2011 Ravi Motwani, Zion Kwok, Scott Nelson Agenda NAND ECC History Soft Information What is soft information How do we obtain
More informationChapter 7: Channel coding:convolutional codes
Chapter 7: : Convolutional codes University of Limoges meghdadi@ensil.unilim.fr Reference : Digital communications by John Proakis; Wireless communication by Andreas Goldsmith Encoder representation Communication
More informationLow-density parity-check codes
Low-density parity-check codes From principles to practice Dr. Steve Weller steven.weller@newcastle.edu.au School of Electrical Engineering and Computer Science The University of Newcastle, Callaghan,
More informationOptimum Soft Decision Decoding of Linear Block Codes
Optimum Soft Decision Decoding of Linear Block Codes {m i } Channel encoder C=(C n-1,,c 0 ) BPSK S(t) (n,k,d) linear modulator block code Optimal receiver AWGN Assume that [n,k,d] linear block code C is
More informationMinimum Distance Bounds for Multiple-Serially Concatenated Code Ensembles
Minimum Distance Bounds for Multiple-Serially Concatenated Code Ensembles Christian Koller,Jörg Kliewer, Kamil S. Zigangirov,DanielJ.Costello,Jr. ISIT 28, Toronto, Canada, July 6 -, 28 Department of Electrical
More informationCoherentDetectionof OFDM
Telematics Lab IITK p. 1/50 CoherentDetectionof OFDM Indo-UK Advanced Technology Centre Supported by DST-EPSRC K Vasudevan Associate Professor vasu@iitk.ac.in Telematics Lab Department of EE Indian Institute
More informationEXIT-Chart Aided Code Design for Symbol-Based Entanglement-Assisted Classical Communication over Quantum Channels
EXIT-Chart Aided Code Design for Symbol-Based Entanglement-Assisted Classical Communication over Quantum Channels Zunaira Babar, Student Member, IEEE, Soon Xin Ng, Senior Member, IEEE, and Lajos Hanzo,
More informationTrellis-based Detection Techniques
Chapter 2 Trellis-based Detection Techniques 2.1 Introduction In this chapter, we provide the reader with a brief introduction to the main detection techniques which will be relevant for the low-density
More informationLow-density parity-check (LDPC) codes
Low-density parity-check (LDPC) codes Performance similar to turbo codes Do not require long interleaver to achieve good performance Better block error performance Error floor occurs at lower BER Decoding
More informationABSTRACT. The original low-density parity-check (LDPC) codes were developed by Robert
ABSTRACT Title of Thesis: OPTIMIZATION OF PERMUTATION KEY FOR π-rotation LDPC CODES Nasim Vakili Pourtaklo, Master of Science, 2006 Dissertation directed by: Associate Professor Steven Tretter Department
More informationDecoding of LDPC codes with binary vector messages and scalable complexity
Downloaded from vbn.aau.dk on: marts 7, 019 Aalborg Universitet Decoding of LDPC codes with binary vector messages and scalable complexity Lechner, Gottfried; Land, Ingmar; Rasmussen, Lars Published in:
More informationLow-Density Parity-Check Codes
Department of Computer Sciences Applied Algorithms Lab. July 24, 2011 Outline 1 Introduction 2 Algorithms for LDPC 3 Properties 4 Iterative Learning in Crowds 5 Algorithm 6 Results 7 Conclusion PART I
More informationChannel Coding I. Exercises SS 2016
Channel Coding I Exercises SS 2016 Lecturer: Dirk Wübben, Carsten Bockelmann Tutor: Ahmed Emara, Matthias Woltering NW1, Room N 2400, Tel.: 0421/218-62392 E-mail: {wuebben, bockelmann, emara, woltering}@ant.uni-bremen.de
More informationReed-Solomon codes. Chapter Linear codes over finite fields
Chapter 8 Reed-Solomon codes In the previous chapter we discussed the properties of finite fields, and showed that there exists an essentially unique finite field F q with q = p m elements for any prime
More informationECE Information theory Final (Fall 2008)
ECE 776 - Information theory Final (Fall 2008) Q.1. (1 point) Consider the following bursty transmission scheme for a Gaussian channel with noise power N and average power constraint P (i.e., 1/n X n i=1
More informationMinimum Distance and Convergence Analysis of Hamming-Accumulate-Acccumulate Codes
1 Minimum Distance and Convergence Analysis of Hamming-Accumulate-Acccumulate Codes Alexandre Graell i Amat and Raphaël Le Bidan arxiv:0905.4545v1 [cs.it] 28 May 2009 Abstract In this letter we consider
More informationIntroduction to Convolutional Codes, Part 1
Introduction to Convolutional Codes, Part 1 Frans M.J. Willems, Eindhoven University of Technology September 29, 2009 Elias, Father of Coding Theory Textbook Encoder Encoder Properties Systematic Codes
More informationKite Codes: Design, Analysis and Generalizations
Kite Codes: Design, Analysis and Generalizations Xiao Ma maxiao@mail.sysu.edu.cn Dept. of ECE, Sun Yat-sen University The Chinese University of Hong Kong, Sept. 2011 Xiao Ma (SYSU) Kite Codes Hong Kong,
More informationFactor Graphs and Message Passing Algorithms Part 1: Introduction
Factor Graphs and Message Passing Algorithms Part 1: Introduction Hans-Andrea Loeliger December 2007 1 The Two Basic Problems 1. Marginalization: Compute f k (x k ) f(x 1,..., x n ) x 1,..., x n except
More informationIterative Solutions Coded Modulation Library Theory of Operation
Iterative Solutions Coded Modulation Library Theory of Operation Oct. 3, 2005 Matthew Valenti Associate Professor West Virginia University Morgantown, WV 26506-6109 mvalenti@wvu.edu Noisy Channel Coding
More informationThe PPM Poisson Channel: Finite-Length Bounds and Code Design
August 21, 2014 The PPM Poisson Channel: Finite-Length Bounds and Code Design Flavio Zabini DEI - University of Bologna and Institute for Communications and Navigation German Aerospace Center (DLR) Balazs
More informationIntroduction to Wireless & Mobile Systems. Chapter 4. Channel Coding and Error Control Cengage Learning Engineering. All Rights Reserved.
Introduction to Wireless & Mobile Systems Chapter 4 Channel Coding and Error Control 1 Outline Introduction Block Codes Cyclic Codes CRC (Cyclic Redundancy Check) Convolutional Codes Interleaving Information
More informationCommunication by Regression: Achieving Shannon Capacity
Communication by Regression: Practical Achievement of Shannon Capacity Department of Statistics Yale University Workshop Infusing Statistics and Engineering Harvard University, June 5-6, 2011 Practical
More informationShort Polar Codes. Peihong Yuan. Chair for Communications Engineering. Technische Universität München
Short Polar Codes Peihong Yuan Chair for Communications Engineering July 26, 2016 LNT & DLR Summer Workshop on Coding 1 / 23 Outline 1 Motivation 2 Improve the Distance Property 3 Simulation Results 4
More informationResearch on Unequal Error Protection with Punctured Turbo Codes in JPEG Image Transmission System
SERBIAN JOURNAL OF ELECTRICAL ENGINEERING Vol. 4, No. 1, June 007, 95-108 Research on Unequal Error Protection with Punctured Turbo Codes in JPEG Image Transmission System A. Moulay Lakhdar 1, R. Méliani,
More informationIntroducing Low-Density Parity-Check Codes
Introducing Low-Density Parity-Check Codes Sarah J. Johnson School of Electrical Engineering and Computer Science The University of Newcastle Australia email: sarah.johnson@newcastle.edu.au Topic 1: Low-Density
More informationA New Performance Evaluation Metric for Sub-Optimal Iterative Decoders
A New Performance Evaluation Metric for Sub-Optimal Iterative Decoders Ashwani Singh, Ali Al-Ghouwayel, G. Masera, Emmanuel Boutillon To cite this version: Ashwani Singh, Ali Al-Ghouwayel, G. Masera, Emmanuel
More informationRCA Analysis of the Polar Codes and the use of Feedback to aid Polarization at Short Blocklengths
RCA Analysis of the Polar Codes and the use of Feedback to aid Polarization at Short Blocklengths Kasra Vakilinia, Dariush Divsalar*, and Richard D. Wesel Department of Electrical Engineering, University
More informationQPP Interleaver Based Turbo-code For DVB-RCS Standard
212 4th International Conference on Computer Modeling and Simulation (ICCMS 212) IPCSIT vol.22 (212) (212) IACSIT Press, Singapore QPP Interleaver Based Turbo-code For DVB-RCS Standard Horia Balta, Radu
More informationNAME... Soc. Sec. #... Remote Location... (if on campus write campus) FINAL EXAM EE568 KUMAR. Sp ' 00
NAME... Soc. Sec. #... Remote Location... (if on campus write campus) FINAL EXAM EE568 KUMAR Sp ' 00 May 3 OPEN BOOK exam (students are permitted to bring in textbooks, handwritten notes, lecture notes
More informationTurbo Codes are Low Density Parity Check Codes
Turbo Codes are Low Density Parity Check Codes David J. C. MacKay July 5, 00 Draft 0., not for distribution! (First draft written July 5, 998) Abstract Turbo codes and Gallager codes (also known as low
More informationNon-Linear Turbo Codes for Interleaver-Division Multiple Access on the OR Channel.
UCLA Graduate School of Engineering - Electrical Engineering Program Non-Linear Turbo Codes for Interleaver-Division Multiple Access on the OR Channel. Miguel Griot, Andres I. Vila Casado, and Richard
More informationIEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 53, NO. 8, AUGUST Linear Turbo Equalization Analysis via BER Transfer and EXIT Charts
IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 53, NO. 8, AUGUST 2005 2883 Linear Turbo Equalization Analysis via BER Transfer and EXIT Charts Seok-Jun Lee, Andrew C. Singer, Member, IEEE, and Naresh R.
More informationPhysical Layer and Coding
Physical Layer and Coding Muriel Médard Professor EECS Overview A variety of physical media: copper, free space, optical fiber Unified way of addressing signals at the input and the output of these media:
More informationLinear Block Codes. Saravanan Vijayakumaran Department of Electrical Engineering Indian Institute of Technology Bombay
1 / 26 Linear Block Codes Saravanan Vijayakumaran sarva@ee.iitb.ac.in Department of Electrical Engineering Indian Institute of Technology Bombay July 28, 2014 Binary Block Codes 3 / 26 Let F 2 be the set
More informationNonlinear Turbo Codes for the broadcast Z Channel
UCLA Electrical Engineering Department Communication Systems Lab. Nonlinear Turbo Codes for the broadcast Z Channel Richard Wesel Miguel Griot Bike ie Andres Vila Casado Communication Systems Laboratory,
More informationCS6304 / Analog and Digital Communication UNIT IV - SOURCE AND ERROR CONTROL CODING PART A 1. What is the use of error control coding? The main use of error control coding is to reduce the overall probability
More informationGraph-based codes for flash memory
1/28 Graph-based codes for flash memory Discrete Mathematics Seminar September 3, 2013 Katie Haymaker Joint work with Professor Christine Kelley University of Nebraska-Lincoln 2/28 Outline 1 Background
More informationAn Introduction to Low-Density Parity-Check Codes
An Introduction to Low-Density Parity-Check Codes Paul H. Siegel Electrical and Computer Engineering University of California, San Diego 5/ 3/ 7 Copyright 27 by Paul H. Siegel Outline Shannon s Channel
More informationThese outputs can be written in a more convenient form: with y(i) = Hc m (i) n(i) y(i) = (y(i); ; y K (i)) T ; c m (i) = (c m (i); ; c m K(i)) T and n
Binary Codes for synchronous DS-CDMA Stefan Bruck, Ulrich Sorger Institute for Network- and Signal Theory Darmstadt University of Technology Merckstr. 25, 6428 Darmstadt, Germany Tel.: 49 65 629, Fax:
More information