Information Theoretic Imaging
|
|
- Iris Page
- 6 years ago
- Views:
Transcription
1 Information Theoretic Imaging WU Faculty: J. A. O Sullivan WU Doctoral Student: Naveen Singla Boeing Engineer: James Meany First Year Focus: Imaging for Data Storage Image Reconstruction Data Retrieval
2 Information Theoretic Imaging Theoretical and Implementation Issues in Image formation Image deblurring Automatic target recognition Data modeling Data Storage Systems Channel coding problems Graphical models for available data Binary rather than continuous data Cross-Fertilization Imaging approach to data storage Graphical models for image formation, ATR
3 Joint Detection and Decoding Schemes for 2D Recording J. A. O Sullivan, N. Singla, Y. Wu, R. S. Indeck Electronics Systems and Signals Research Laboratory Magnetic Information Science Center Washington University
4 Enabling Technology: Disk Drives ~,,x increase in 45 years! Magnetic disk storage areal density vs. year of IBM product introduction (From D. A. Thompson)
5 Problem Description Reliable data retrieval from channels having 2-D ISI Advanced storage media: Patterned media As bit aspect ratio reduces inter-track interference becomes significant Optical memories
6 Science enables: 6 million-million bits/square inch!
7 Conventional PRML System Timing & Tap Updating xn Magnetic Recording Channel Wide-Band Noise Receive Filter (low pass) nt+τ e Adaptive Filter yn ŷn Viterbi Detector xˆ n n P ( D ) = ( D )( + D ), n =,2,3,... No generalization to 2D
8 Joint Equalization and Decoding General 2D ISI Schemes Using 2D MMSE equalization and decoding Using novel message-passing algorithms that take advantage of the 2D dependence Separable 2D ISI Using turbo equalization Singla et al., Iterative decoding and equalization for 2-D recording channels, IEEE Trans. Magn., Sept. 22.
9 Channel Model a ( i, j) x ( i, j) r ( i, j) x ( i, j) ( i, j) LDPC Encoder Channel ISI Channel w( i, j) Equalizer x(i,j) {+,-} Channel ISI is 2D and linear Noise assumed to be AWGN LDPC Decoder a
10 2D Intersymbol Interference Λ Λ Λ Μ Ο Μ Μ Ο Λ Λ Λ kk k k k x x x x x x x k k k k k k kk kk k k k k k k r r r r r r r r r r r r r r r r Λ Λ Λ Λ Μ Ο Μ Μ Μ Ο Μ Λ Λ Λ Λ Λ GUARD BAND ), ( ), ( ), ( ), ( 2, j w i m n h n j m i x j i r m n + = = ), ( j w i = c b c b a b c b c h
11 MMSE Equalization and Decoding a ( i, j) x ( i, j) r ( i, j) x ( i, j) ( i, j) LDPC Encoder Channel ISI w( i, j) Equalizer LDPC Decoder a Equalizer designed assuming inputs to be Gaussian
12 Performance MMSE Equalization and Decoding Bit Error Rate, Log Base h = BIAWGN Capacity LDPC No ISI Wiener SNR (db)
13 Iterative MMSE Equalization and Decoding a ( i, j) x ( i, j) r ( i, j) x ( i, j) ( i, j) LDPC Encoder Channel ISI Equalizer LDPC Decoder a w( i, j) Extrinsic Information Soft information, estimated mean of the codeword, passed from LDPC decoder to equalizer E[ x] x = Pr( x = ) Pr( x = ) = E[ x] + W **[ r h** E[ x]]
14 Performance Iterative MMSE Equalization and Decoding Bit Error Rate, Log Base h = BIAWGN Capacity LDPC No ISI Itrw iener_ Wiener SNR (db)
15 Full Graph Message-Passing Check Nodes Codeword Bit Nodes Data Nodes h = r i, j = xi, j +.5xi, j +.5xi, j +. 25xi, j + w i, j
16 Full Graph x(i,j) x(i,j+) x(i,j+2) From Check Nodes x(i+,j) r(i,j) r(i+,j) x(i+,j+) r(i,j+) r(i+,j+) x(i+,j+2) x(i+2,j) x(i+2,j+) x(i+2,j+2)
17 Performance Full Graph Message-Passing Bit Error Rate, Log Base h = BIAWGN Capacity LDPC No ISI Full graph_5 Itrw iener_ Wiener SNR (db)
18 Full Graph Analysis Length 4 cycles present which degrade performance of message-passing algorithm x(i,j) x(i,j+) x(i,j+2) From Check Nodes x(i+,j) r(i,j) r(i+,j) x(i+,j+) r(i,j+) r(i+,j+) x(i+,j+2) x(i+2,j) x(i+2,j+) x(i+2,j+2) Kschischang et al., Factor graphs and the sum-product algorithm, IEEE Trans. Inform. Theory, Feb. 2.
19 Ordered Subsets Message-Passing From Imaging Data set is grouped into subsets to increase rate of convergence For Decoding Observed data is grouped into subsets to eliminate short length cycles in the Channel ISI graph H. M. Hudson, and R. S. Larkin, Accelerated image reconstruction using ordered subsets of projection data, IEEE Trans. Medical Imaging, Dec. 994
20 Grouped ISI Graph Labeling of data nodes into 4 subsets For each iteration use data nodes of one label only J. A. O Sullivan, and N. Singla, Ordered subsets message-passing, Submitted to Int l Symp. Inform. Theory 23.
21 Performance Ordered Subsets Message-Passing Bit Error Rate, Log Base h = BIAWGN Capacity LDPC No ISI Ord Subsets_ Full graph_5 Itrw iener_ Wiener SNR (db)
22 Performance Joint Equalization and Decoding Schemes Bit Error Rate, Log Base h = BIAWGN Capacity LDPC No ISI Ord Subsets_ Full graph_5 Itrw iener_ Wiener SNR (db)
23 Performance Joint Equalization and Decoding Schemes Bit Error Rate, Log Base h = BIAWGN Capacity LDPC No ISI Ord Subsets_ Full graph_5 Itrw iener_ Wiener SNR (db)
24 Performance Joint Equalization and Decoding Schemes Bit Error Rate, Log Base h = BIAWGN Capacity LDPC No ISI Ord Subsets_ Full graph_5 Itrw iener_ Wiener SNR (db)
25 Consider Separable 2D ISI Wu et al., Iterative detection and decoding for separable two-dimensional intersymbol interference Submitted to IEEE Trans. Magn., June. 22.
26 A Separable 2D ISI x(i, j) Row ISI y(i, j) Column ISI r(i, j) Channel Detector Separable Channel Response w(i,j) h =.5.5 =.25.5 (.5) Advantages of Separable 2D ISI Apply existing one-dimensional equalization methods Reduced Detector Complexity Tüchler et al., Turbo equalization: principles and new results, IEEE Trans. On Comm., May 22.
27 Row-by-Row Decoder r(i, j) Column Equalization MAP Detector LDPC Decoder Hard Decision Extrinsic Information Conventional One-Dimensional Iterative Decoder MMSE and Zero-forcing criteria used for Equalization
28 Performance Bit-Error-Rate In log Row-by-Row Decoder.5 h =.5.25 LDPC No ISI Row -by-row : MMSE_iter Row -by-row : ZF_iter SNR (db)
29 Row-and-Column Decoder r(i, j) Column MAP Detector Row MAP Detector LDPC Decoder Hard Decision Extrinsic Information Conventional One-Dimensional Iterative Detector Inputs to column detector are not binary
30 Performance - Row-and-Column Decoder h = Bit Error Rate, Log Base LDPC No ISI Row -and-column_ Ordered Subsets_ Full Graph_5 Itrw iener_ Wiener Row -by-row : ZF_iter SNR (db)
31 Conclusions MMSE equalization and decoding Good Performance with Iterative Equalization Message-passing algorithms Full graph algorithm performance deteriorated due to short cycles Ordered subsets message-passing gives best performance for general 2D ISI Separable ISI decoding Best performance for separable 2D ISI Low complexity Approximate channel response by separable response
32 Performance Block length regular (3,6) LDPC code Ignoring ISI Bit Error Rate in log ISI-free ISI ignored SNR [db]
33 Performance MMSE Equalization and Decoding Bit Error Rate in log ISI-free Wiener ISI ignored SNR [db]
34 Performance Iterative MMSE and Decoding Bit Error Rate in log ISI-free Itr Wiener_ Wiener SNR [db]
35 Performance Full Graph Message-Passing Bit Error Rate in log ISI-free Full Graph_5 Itr Wiener_ Wiener SNR [db]
36 Performance Ordered Subsets Message-Passing Bit Error Rate in log ISI-free Ordered Subsets_ Full Graph_5 Itr Wiener_ Wiener SNR [db]
37 Advanced Media
2D Coding and Iterative Detection Schemes
2D Coding and Iterative Detection Schemes J. A. O Sullivan, N. Singla, Y. Wu, and R. S. Indeck Washington University Magnetics and Information Science Center Nanoimprinting and Switching of Patterned Media
More informationJoint Equalization and Decoding for Nonlinear Two-Dimensional Intersymbol Interference Channels with Application to Optical Storage
Joint Equalization and Decoding for Nonlinear Two-Dimensional Intersymbol Interference Channels with Application to Optical Storage 1 arxiv:cs/0509008v1 [cs.it] 4 Sep 2005 Naveen Singla and Joseph A. O
More informationGraph-based codes for flash memory
1/28 Graph-based codes for flash memory Discrete Mathematics Seminar September 3, 2013 Katie Haymaker Joint work with Professor Christine Kelley University of Nebraska-Lincoln 2/28 Outline 1 Background
More informationAn Introduction to Low Density Parity Check (LDPC) Codes
An Introduction to Low Density Parity Check (LDPC) Codes Jian Sun jian@csee.wvu.edu Wireless Communication Research Laboratory Lane Dept. of Comp. Sci. and Elec. Engr. West Virginia University June 3,
More informationSoft-Output Decision-Feedback Equalization with a Priori Information
Soft-Output Decision-Feedback Equalization with a Priori Information Renato R. opes and John R. Barry School of Electrical and Computer Engineering Georgia Institute of Technology, Atlanta, Georgia 333-5
More informationIntroduction to Low-Density Parity Check Codes. Brian Kurkoski
Introduction to Low-Density Parity Check Codes Brian Kurkoski kurkoski@ice.uec.ac.jp Outline: Low Density Parity Check Codes Review block codes History Low Density Parity Check Codes Gallager s LDPC code
More informationMessage-Passing Decoding for Low-Density Parity-Check Codes Harish Jethanandani and R. Aravind, IIT Madras
Message-Passing Decoding for Low-Density Parity-Check Codes Harish Jethanandani and R. Aravind, IIT Madras e-mail: hari_jethanandani@yahoo.com Abstract Low-density parity-check (LDPC) codes are discussed
More informationLDPC Codes. Slides originally from I. Land p.1
Slides originally from I. Land p.1 LDPC Codes Definition of LDPC Codes Factor Graphs to use in decoding Decoding for binary erasure channels EXIT charts Soft-Output Decoding Turbo principle applied to
More informationA REDUCED COMPLEXITY TWO-DIMENSIONAL BCJR DETECTOR FOR HOLOGRAPHIC DATA STORAGE SYSTEMS WITH PIXEL MISALIGNMENT
A REDUCED COMPLEXITY TWO-DIMENSIONAL BCJR DETECTOR FOR HOLOGRAPHIC DATA STORAGE SYSTEMS WITH PIXEL MISALIGNMENT 1 S. Iman Mossavat, 2 J.W.M.Bergmans 1 iman@nus.edu.sg 1 National University of Singapore,
More informationAdaptive Cut Generation for Improved Linear Programming Decoding of Binary Linear Codes
Adaptive Cut Generation for Improved Linear Programming Decoding of Binary Linear Codes Xiaojie Zhang and Paul H. Siegel University of California, San Diego, La Jolla, CA 9093, U Email:{ericzhang, psiegel}@ucsd.edu
More informationCodes on graphs and iterative decoding
Codes on graphs and iterative decoding Bane Vasić Error Correction Coding Laboratory University of Arizona Funded by: National Science Foundation (NSF) Seagate Technology Defense Advanced Research Projects
More informationPerformance Analysis and Code Optimization of Low Density Parity-Check Codes on Rayleigh Fading Channels
Performance Analysis and Code Optimization of Low Density Parity-Check Codes on Rayleigh Fading Channels Jilei Hou, Paul H. Siegel and Laurence B. Milstein Department of Electrical and Computer Engineering
More informationBelief-Propagation Decoding of LDPC Codes
LDPC Codes: Motivation Belief-Propagation Decoding of LDPC Codes Amir Bennatan, Princeton University Revolution in coding theory Reliable transmission, rates approaching capacity. BIAWGN, Rate =.5, Threshold.45
More informationConstruction of low complexity Array based Quasi Cyclic Low density parity check (QC-LDPC) codes with low error floor
Construction of low complexity Array based Quasi Cyclic Low density parity check (QC-LDPC) codes with low error floor Pravin Salunkhe, Prof D.P Rathod Department of Electrical Engineering, Veermata Jijabai
More informationSingle-Gaussian Messages and Noise Thresholds for Low-Density Lattice Codes
Single-Gaussian Messages and Noise Thresholds for Low-Density Lattice Codes Brian M. Kurkoski, Kazuhiko Yamaguchi and Kingo Kobayashi kurkoski@ice.uec.ac.jp Dept. of Information and Communications Engineering
More informationCoding and Detection for Multi-track Digital Data Storage
Coding and Detection for Multi-track Digital Data Storage Tom Conway ECE Dept, University of Limerick, Ireland thomas.conway@ul.ie 1 Outline Multi-track Digital Data Storage Detection Coding Performance
More informationLow-density parity-check codes
Low-density parity-check codes From principles to practice Dr. Steve Weller steven.weller@newcastle.edu.au School of Electrical Engineering and Computer Science The University of Newcastle, Callaghan,
More informationAn analysis of the computational complexity of sequential decoding of specific tree codes over Gaussian channels
An analysis of the computational complexity of sequential decoding of specific tree codes over Gaussian channels B. Narayanaswamy, Rohit Negi and Pradeep Khosla Department of ECE Carnegie Mellon University
More informationLDPC Decoding Strategies for Two-Dimensional Magnetic Recording
SUBMITTED TO IEEE GLOBAL COMMUNICATIONS CONFERENCE, HONOLULU, HI, USA, NOV. 3-DEC. 4 29, 1 LDPC Decoding Strategies for Two-Dimensional Magnetic Recording Anantha Raman Krishnan, Rathnakumar Radhakrishnan,
More informationOrdered Subsets Message- Passing
Odeed Subsets Message- Passing Joseph A. O Suivan, Naveen Singa Eectonic Systes and Signas Reseach aboatoy ESSR) Depatent of Eectica Engineeing Washington Univesity in St. ouis 7/3/2003 Intoduction Systes
More informationPerformance Analysis of Low-Density Parity-Check Codes over 2D Interference Channels via Density Evolution
Performance Analysis of Low-Density Parity-Check Codes over 2D Interference Channels via Density Evolution 1 Jun Yao, Kah Chan Teh, Senior Member, IEEE, and Kwok Hung Li, Senior arxiv:1701.03840v1 [cs.it]
More informationCodes on graphs and iterative decoding
Codes on graphs and iterative decoding Bane Vasić Error Correction Coding Laboratory University of Arizona Prelude Information transmission 0 0 0 0 0 0 Channel Information transmission signal 0 0 threshold
More informationJoint Channel Estimation and Co-Channel Interference Mitigation in Wireless Networks Using Belief Propagation
Joint Channel Estimation and Co-Channel Interference Mitigation in Wireless Networks Using Belief Propagation Yan Zhu, Dongning Guo and Michael L. Honig Northwestern University May. 21, 2008 Y. Zhu, D.
More informationIterative Encoding of Low-Density Parity-Check Codes
Iterative Encoding of Low-Density Parity-Check Codes David Haley, Alex Grant and John Buetefuer Institute for Telecommunications Research University of South Australia Mawson Lakes Blvd Mawson Lakes SA
More informationNAME... Soc. Sec. #... Remote Location... (if on campus write campus) FINAL EXAM EE568 KUMAR. Sp ' 00
NAME... Soc. Sec. #... Remote Location... (if on campus write campus) FINAL EXAM EE568 KUMAR Sp ' 00 May 3 OPEN BOOK exam (students are permitted to bring in textbooks, handwritten notes, lecture notes
More informationExpectation propagation for symbol detection in large-scale MIMO communications
Expectation propagation for symbol detection in large-scale MIMO communications Pablo M. Olmos olmos@tsc.uc3m.es Joint work with Javier Céspedes (UC3M) Matilde Sánchez-Fernández (UC3M) and Fernando Pérez-Cruz
More informationShannon meets Wiener II: On MMSE estimation in successive decoding schemes
Shannon meets Wiener II: On MMSE estimation in successive decoding schemes G. David Forney, Jr. MIT Cambridge, MA 0239 USA forneyd@comcast.net Abstract We continue to discuss why MMSE estimation arises
More informationthe target and equalizer design for highdensity Bit-Patterned Media Recording
128 ECTI TRANSACTIONS ON COMPUTER AND INFORMATION TECHNOLOGY VOL.6, NO.2 November 2012 Target and Equalizer Design for High-Density Bit-Patterned Media Recording Santi Koonkarnkhai 1, Phongsak Keeratiwintakorn
More informationSub-Gaussian Model Based LDPC Decoder for SαS Noise Channels
Sub-Gaussian Model Based LDPC Decoder for SαS Noise Channels Iulian Topor Acoustic Research Laboratory, Tropical Marine Science Institute, National University of Singapore, Singapore 119227. iulian@arl.nus.edu.sg
More informationInterleave Division Multiple Access. Li Ping, Department of Electronic Engineering City University of Hong Kong
Interleave Division Multiple Access Li Ping, Department of Electronic Engineering City University of Hong Kong 1 Outline! Introduction! IDMA! Chip-by-chip multiuser detection! Analysis and optimization!
More informationIterative Timing Recovery
Iterative Timing Recovery John R. Barry School of Electrical and Computer Engineering, Georgia Tech Atlanta, Georgia U.S.A. barry@ece.gatech.edu 0 Outline Timing Recovery Tutorial Problem statement TED:
More informationECEN 655: Advanced Channel Coding
ECEN 655: Advanced Channel Coding Course Introduction Henry D. Pfister Department of Electrical and Computer Engineering Texas A&M University ECEN 655: Advanced Channel Coding 1 / 19 Outline 1 History
More informationOne-Bit LDPC Message Passing Decoding Based on Maximization of Mutual Information
One-Bit LDPC Message Passing Decoding Based on Maximization of Mutual Information ZOU Sheng and Brian M. Kurkoski kurkoski@ice.uec.ac.jp University of Electro-Communications Tokyo, Japan University of
More informationSignal Processing for Digital Data Storage (11)
Outline Signal Processing for Digital Data Storage (11) Assist.Prof. Piya Kovintavewat, Ph.D. Data Storage Technology Research Unit Nahon Pathom Rajabhat University Partial-Response Maximum-Lielihood (PRML)
More informationCoding theory: Applications
INF 244 a) Textbook: Lin and Costello b) Lectures (Tu+Th 12.15-14) covering roughly Chapters 1,9-12, and 14-18 c) Weekly exercises: For your convenience d) Mandatory problem: Programming project (counts
More informationRANDOM DISCRETE MEASURE OF THE PHASE POSTERIOR PDF IN TURBO SYNCHRONIZATION
RANDOM DISCRETE MEASURE OF THE PHASE POSTERIOR PDF IN TURBO SYNCHRONIZATION Nicolas Paul, Didier Le Ruyet, Tanya Bertozzi * Michel Terre Electronique et Communications, CNAM, 292 rue Saint Martin, 75141
More informationANALYSIS OF A PARTIAL DECORRELATOR IN A MULTI-CELL DS/CDMA SYSTEM
ANAYSIS OF A PARTIA DECORREATOR IN A MUTI-CE DS/CDMA SYSTEM Mohammad Saquib ECE Department, SU Baton Rouge, A 70803-590 e-mail: saquib@winlab.rutgers.edu Roy Yates WINAB, Rutgers University Piscataway
More informationDoes soft-decision ECC improve endurance?
Flash Memory Summit 2015 Does soft-decision ECC improve endurance? Thomas Parnell IBM Research - Zurich Outline Motivation Why do we need more endurance? Capacity What is channel capacity? How can it be
More informationInvestigation into Harmful Patterns over Multi-Track Shingled Magnetic Detection Using the Voronoi Model
1 Investigation into Harmful Patterns over Multi-Track Shingled Magnetic Detection Using the Voronoi Model Mohsen Bahrami 1, Chaitanya Kumar Matcha, Seyed Mehrdad Khatami 1, Shounak Roy, Shayan Garani
More informationLow-density parity-check (LDPC) codes
Low-density parity-check (LDPC) codes Performance similar to turbo codes Do not require long interleaver to achieve good performance Better block error performance Error floor occurs at lower BER Decoding
More informationIterative Detection and Decoding for the Four-Rectangular-Grain TDMR Model
Iterative Detection and Decoding for the Four-Rectangular-Grain TDMR Model arxiv:1309.7518v1 [cs.it] 29 Sep 2013 Michael Carosino School of Electrical Engineering and Computer Science Washington State
More informationOn the Joint Decoding of LDPC Codes and Finite-State Channels via Linear Programming
On the Joint Decoding of LDPC Codes and Finite-State Channels via Linear Programming Byung-Hak Kim (joint with Henry D. Pfister) Texas A&M University College Station International Symposium on Information
More informationCHAPTER 3 LOW DENSITY PARITY CHECK CODES
62 CHAPTER 3 LOW DENSITY PARITY CHECK CODES 3. INTRODUCTION LDPC codes were first presented by Gallager in 962 [] and in 996, MacKay and Neal re-discovered LDPC codes.they proved that these codes approach
More informationDesign of Non-Binary Quasi-Cyclic LDPC Codes by Absorbing Set Removal
Design of Non-Binary Quasi-Cyclic LDPC Codes by Absorbing Set Removal Behzad Amiri Electrical Eng. Department University of California, Los Angeles Los Angeles, USA Email: amiri@ucla.edu Jorge Arturo Flores
More informationAn Efficient Algorithm for Finding Dominant Trapping Sets of LDPC Codes
An Efficient Algorithm for Finding Dominant Trapping Sets of LDPC Codes Mehdi Karimi, Student Member, IEEE and Amir H. Banihashemi, Senior Member, IEEE Abstract arxiv:1108.4478v2 [cs.it] 13 Apr 2012 This
More informationGraph-based Codes for Quantize-Map-and-Forward Relaying
20 IEEE Information Theory Workshop Graph-based Codes for Quantize-Map-and-Forward Relaying Ayan Sengupta, Siddhartha Brahma, Ayfer Özgür, Christina Fragouli and Suhas Diggavi EPFL, Switzerland, UCLA,
More informationThe Continuing Miracle of Information Storage Technology Paul H. Siegel Director, CMRR University of California, San Diego
The Continuing Miracle of Information Storage Technology Paul H. Siegel Director, CMRR University of California, San Diego 10/15/01 1 Outline The Shannon Statue A Miraculous Technology Information Theory
More information6.451 Principles of Digital Communication II Wednesday, May 4, 2005 MIT, Spring 2005 Handout #22. Problem Set 9 Solutions
6.45 Principles of Digital Communication II Wednesda, Ma 4, 25 MIT, Spring 25 Hand #22 Problem Set 9 Solutions Problem 8.3 (revised) (BCJR (sum-product) decoding of SPC codes) As shown in Problem 6.4 or
More informationLower Bounds on the Graphical Complexity of Finite-Length LDPC Codes
Lower Bounds on the Graphical Complexity of Finite-Length LDPC Codes Igal Sason Department of Electrical Engineering Technion - Israel Institute of Technology Haifa 32000, Israel 2009 IEEE International
More informationAn Introduction to Low-Density Parity-Check Codes
An Introduction to Low-Density Parity-Check Codes Paul H. Siegel Electrical and Computer Engineering University of California, San Diego 5/ 3/ 7 Copyright 27 by Paul H. Siegel Outline Shannon s Channel
More informationIEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 53, NO. 8, AUGUST Linear Turbo Equalization Analysis via BER Transfer and EXIT Charts
IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 53, NO. 8, AUGUST 2005 2883 Linear Turbo Equalization Analysis via BER Transfer and EXIT Charts Seok-Jun Lee, Andrew C. Singer, Member, IEEE, and Naresh R.
More informationJoint Iterative Decoding of LDPC Codes and Channels with Memory
Joint Iterative Decoding of LDPC Codes and Channels with Memory Henry D. Pfister and Paul H. Siegel University of California, San Diego 3 rd Int l Symposium on Turbo Codes September 1, 2003 Outline Channels
More informationStructured Low-Density Parity-Check Codes: Algebraic Constructions
Structured Low-Density Parity-Check Codes: Algebraic Constructions Shu Lin Department of Electrical and Computer Engineering University of California, Davis Davis, California 95616 Email:shulin@ece.ucdavis.edu
More informationMaking Error Correcting Codes Work for Flash Memory
Making Error Correcting Codes Work for Flash Memory Part I: Primer on ECC, basics of BCH and LDPC codes Lara Dolecek Laboratory for Robust Information Systems (LORIS) Center on Development of Emerging
More informationGraph-Based Decoding in the Presence of ISI
1 Graph-Based Decoding in the Presence of ISI Mohammad H. Taghavi and Paul H. Siegel Center for Magnetic Recording Research University of California, San Diego La Jolla, CA 92093-0401, USA Email: (mtaghavi,
More informationPhysical Layer and Coding
Physical Layer and Coding Muriel Médard Professor EECS Overview A variety of physical media: copper, free space, optical fiber Unified way of addressing signals at the input and the output of these media:
More informationSENS'2006 Second Scientific Conference with International Participation SPACE, ECOLOGY, NANOTECHNOLOGY, SAFETY June 2006, Varna, Bulgaria
SENS'6 Second Scientific Conference with International Participation SPACE, ECOLOGY, NANOTECHNOLOGY, SAFETY 4 6 June 6, Varna, Bulgaria SIMULATION ANALYSIS OF THE VITERBI CONVOLUTIONAL DECODING ALGORITHM
More informationLecture 8: MIMO Architectures (II) Theoretical Foundations of Wireless Communications 1. Overview. Ragnar Thobaben CommTh/EES/KTH
MIMO : MIMO Theoretical Foundations of Wireless Communications 1 Wednesday, May 25, 2016 09:15-12:00, SIP 1 Textbook: D. Tse and P. Viswanath, Fundamentals of Wireless Communication 1 / 20 Overview MIMO
More informationInformation Theory. Lecture 10. Network Information Theory (CT15); a focus on channel capacity results
Information Theory Lecture 10 Network Information Theory (CT15); a focus on channel capacity results The (two-user) multiple access channel (15.3) The (two-user) broadcast channel (15.6) The relay channel
More informationEstimation-Theoretic Representation of Mutual Information
Estimation-Theoretic Representation of Mutual Information Daniel P. Palomar and Sergio Verdú Department of Electrical Engineering Princeton University Engineering Quadrangle, Princeton, NJ 08544, USA {danielp,verdu}@princeton.edu
More informationDecision-Point Signal to Noise Ratio (SNR)
Decision-Point Signal to Noise Ratio (SNR) Receiver Decision ^ SNR E E e y z Matched Filter Bound error signal at input to decision device Performance upper-bound on ISI channels Achieved on memoryless
More informationPerformance of Optimal Digital Page Detection in a Two-Dimensional ISI/AWGN Channel
c IEEE 1996 Presented at Asilomar Conf. on Signals, Systems and Comp., Nov. 1996 Performance of Optimal Digital Page Detection in a Two-Dimensional ISI/AWGN Channel Keith M. Chugg Department of Electrical
More informationECC for NAND Flash. Osso Vahabzadeh. TexasLDPC Inc. Flash Memory Summit 2017 Santa Clara, CA 1
ECC for NAND Flash Osso Vahabzadeh TexasLDPC Inc. 1 Overview Why Is Error Correction Needed in Flash Memories? Error Correction Codes Fundamentals Low-Density Parity-Check (LDPC) Codes LDPC Encoding and
More informationOn the Design of Raptor Codes for Binary-Input Gaussian Channels
1 On the Design of Raptor Codes for Binary-Input Gaussian Channels Zhong Cheng, Jeff Castura, and Yongyi Mao, Member, IEEE Abstract This paper studies the problem of Raptor-code design for binary-input
More informationIterative Equalization using Improved Block DFE for Synchronous CDMA Systems
Iterative Equalization using Improved Bloc DFE for Synchronous CDMA Systems Sang-Yic Leong, Kah-ing Lee, and Yahong Rosa Zheng Abstract Iterative equalization using optimal multiuser detector and trellis-based
More informationPolar Code Construction for List Decoding
1 Polar Code Construction for List Decoding Peihong Yuan, Tobias Prinz, Georg Böcherer arxiv:1707.09753v1 [cs.it] 31 Jul 2017 Abstract A heuristic construction of polar codes for successive cancellation
More informationDecoding of LDPC codes with binary vector messages and scalable complexity
Downloaded from vbn.aau.dk on: marts 7, 019 Aalborg Universitet Decoding of LDPC codes with binary vector messages and scalable complexity Lechner, Gottfried; Land, Ingmar; Rasmussen, Lars Published in:
More informationRalf Koetter, Andrew C. Singer, and Michael Tüchler
Ralf Koetter, Andrew C. Singer, and Michael Tüchler Capitalizing on the tremendous performance gains of turbo codes and the turbo decoding algorithm, turbo equalization is an iterative equalization and
More informationLow Density Parity Check (LDPC) Codes and the Need for Stronger ECC. August 2011 Ravi Motwani, Zion Kwok, Scott Nelson
Low Density Parity Check (LDPC) Codes and the Need for Stronger ECC August 2011 Ravi Motwani, Zion Kwok, Scott Nelson Agenda NAND ECC History Soft Information What is soft information How do we obtain
More informationNew reduced state space BCJR algorithms for the ISI channel
New reduced state space BCJR algorithms for the ISI channel Anderson, John B; Prlja, Adnan; Rusek, Fredrik Published in: Proceedings, International Symp. on Information Theory 2009 Link to publication
More informationRandom Redundant Soft-In Soft-Out Decoding of Linear Block Codes
Random Redundant Soft-In Soft-Out Decoding of Linear Block Codes Thomas R. Halford and Keith M. Chugg Communication Sciences Institute University of Southern California Los Angeles, CA 90089-2565 Abstract
More informationConstellation Shaping for Communication Channels with Quantized Outputs
Constellation Shaping for Communication Channels with Quantized Outputs Chandana Nannapaneni, Matthew C. Valenti, and Xingyu Xiang Lane Department of Computer Science and Electrical Engineering West Virginia
More informationExtended MinSum Algorithm for Decoding LDPC Codes over GF (q)
Extended MinSum Algorithm for Decoding LDPC Codes over GF (q) David Declercq ETIS ENSEA/UCP/CNRS UMR-8051, 95014 Cergy-Pontoise, (France), declercq@ensea.fr Marc Fossorier Dept. Electrical Engineering,
More informationA New Performance Evaluation Metric for Sub-Optimal Iterative Decoders
A New Performance Evaluation Metric for Sub-Optimal Iterative Decoders Ashwani Singh, Ali Al-Ghouwayel, G. Masera, Emmanuel Boutillon To cite this version: Ashwani Singh, Ali Al-Ghouwayel, G. Masera, Emmanuel
More informationUNIT I INFORMATION THEORY. I k log 2
UNIT I INFORMATION THEORY Claude Shannon 1916-2001 Creator of Information Theory, lays the foundation for implementing logic in digital circuits as part of his Masters Thesis! (1939) and published a paper
More informationarxiv:cs/ v2 [cs.it] 1 Oct 2006
A General Computation Rule for Lossy Summaries/Messages with Examples from Equalization Junli Hu, Hans-Andrea Loeliger, Justin Dauwels, and Frank Kschischang arxiv:cs/060707v [cs.it] 1 Oct 006 Abstract
More informationThe E8 Lattice and Error Correction in Multi-Level Flash Memory
The E8 Lattice and Error Correction in Multi-Level Flash Memory Brian M. Kurkoski kurkoski@ice.uec.ac.jp University of Electro-Communications Tokyo, Japan ICC 2011 IEEE International Conference on Communications
More informationUtilizing Correct Prior Probability Calculation to Improve Performance of Low-Density Parity- Check Codes in the Presence of Burst Noise
Utah State University DigitalCommons@USU All Graduate Theses and Dissertations Graduate Studies 5-2012 Utilizing Correct Prior Probability Calculation to Improve Performance of Low-Density Parity- Check
More informationTHIS paper is aimed at designing efficient decoding algorithms
IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 45, NO. 7, NOVEMBER 1999 2333 Sort-and-Match Algorithm for Soft-Decision Decoding Ilya Dumer, Member, IEEE Abstract Let a q-ary linear (n; k)-code C be used
More informationCode design: Computer search
Code design: Computer search Low rate codes Represent the code by its generator matrix Find one representative for each equivalence class of codes Permutation equivalences? Do NOT try several generator
More informationOn Generalized EXIT Charts of LDPC Code Ensembles over Binary-Input Output-Symmetric Memoryless Channels
2012 IEEE International Symposium on Information Theory Proceedings On Generalied EXIT Charts of LDPC Code Ensembles over Binary-Input Output-Symmetric Memoryless Channels H Mamani 1, H Saeedi 1, A Eslami
More informationAPPLICATIONS. Quantum Communications
SOFT PROCESSING TECHNIQUES FOR QUANTUM KEY DISTRIBUTION APPLICATIONS Marina Mondin January 27, 2012 Quantum Communications In the past decades, the key to improving computer performance has been the reduction
More informationAnalysis of Sum-Product Decoding of Low-Density Parity-Check Codes Using a Gaussian Approximation
IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 47, NO. 2, FEBRUARY 2001 657 Analysis of Sum-Product Decoding of Low-Density Parity-Check Codes Using a Gaussian Approximation Sae-Young Chung, Member, IEEE,
More informationOn Accuracy of Gaussian Assumption in Iterative Analysis for LDPC Codes
ISIT 26, Seattle, USA, July 9-4, 26 On Accuracy of Gaussian Assumption in Iterative Analysis for LDPC Codes Kai Xie Electrical and Computer Engineering Dept, Lehigh University, Bethlehem, PA 85, USA Email:
More information5. Density evolution. Density evolution 5-1
5. Density evolution Density evolution 5-1 Probabilistic analysis of message passing algorithms variable nodes factor nodes x1 a x i x2 a(x i ; x j ; x k ) x3 b x4 consider factor graph model G = (V ;
More informationExpected Error Based MMSE Detection Ordering for Iterative Detection-Decoding MIMO Systems
Expected Error Based MMSE Detection Ordering for Iterative Detection-Decoding MIMO Systems Lei Zhang, Chunhui Zhou, Shidong Zhou, Xibin Xu National Laboratory for Information Science and Technology, Tsinghua
More informationFEEDBACK does not increase the capacity of a discrete
1 Sequential Differential Optimization of Incremental Redundancy Transmission Lengths: An Example with Tail-Biting Convolutional Codes Nathan Wong, Kasra Vailinia, Haobo Wang, Sudarsan V. S. Ranganathan,
More informationSoft-Decision Demodulation Design for COVQ over White, Colored, and ISI Gaussian Channels
IEEE TRANSACTIONS ON COMMUNICATIONS, VOL 48, NO 9, SEPTEMBER 2000 1499 Soft-Decision Demodulation Design for COVQ over White, Colored, and ISI Gaussian Channels Nam Phamdo, Senior Member, IEEE, and Fady
More informationSPA decoding on the Tanner graph
SPA decoding on the Tanner graph x,(i) q j,l = P(v l = x check sums A l \ {h j } at the ith iteration} x,(i) σ j,l = Σ P(s = 0 v = x,{v : t B(h )\{l}}) q {vt : t B(h j )\{l}} j l t j t B(h j )\{l} j,t
More informationLecture 4 : Introduction to Low-density Parity-check Codes
Lecture 4 : Introduction to Low-density Parity-check Codes LDPC codes are a class of linear block codes with implementable decoders, which provide near-capacity performance. History: 1. LDPC codes were
More informationSC-Fano Decoding of Polar Codes
SC-Fano Decoding of Polar Codes Min-Oh Jeong and Song-Nam Hong Ajou University, Suwon, Korea, email: {jmo0802, snhong}@ajou.ac.kr arxiv:1901.06791v1 [eess.sp] 21 Jan 2019 Abstract In this paper, we present
More informationGirth Analysis of Polynomial-Based Time-Invariant LDPC Convolutional Codes
IWSSIP 212, 11-13 April 212, Vienna, Austria ISBN 978-3-2-2328-4 Girth Analysis of Polynomial-Based Time-Invariant LDPC Convolutional Codes Hua Zhou and Norbert Goertz Institute of Telecommunications Vienna
More informationCoding Techniques for Data Storage Systems
Coding Techniques for Data Storage Systems Thomas Mittelholzer IBM Zurich Research Laboratory /8 Göttingen Agenda. Channel Coding and Practical Coding Constraints. Linear Codes 3. Weight Enumerators and
More informationEXTENDING THE DORSCH DECODER FOR EFFICIENT SOFT DECISION DECODING OF LINEAR BLOCK CODES SEAN MICHAEL COLLISON
EXTENDING THE DORSCH DECODER FOR EFFICIENT SOFT DECISION DECODING OF LINEAR BLOCK CODES By SEAN MICHAEL COLLISON A thesis submitted in partial fulfillment of the requirements for the degree of MASTER OF
More informationNUMERICAL COMPUTATION OF THE CAPACITY OF CONTINUOUS MEMORYLESS CHANNELS
NUMERICAL COMPUTATION OF THE CAPACITY OF CONTINUOUS MEMORYLESS CHANNELS Justin Dauwels Dept. of Information Technology and Electrical Engineering ETH, CH-8092 Zürich, Switzerland dauwels@isi.ee.ethz.ch
More informationError Floors of LDPC Coded BICM
Electrical and Computer Engineering Conference Papers, Posters and Presentations Electrical and Computer Engineering 2007 Error Floors of LDPC Coded BICM Aditya Ramamoorthy Iowa State University, adityar@iastate.edu
More informationCodes on Graphs. Telecommunications Laboratory. Alex Balatsoukas-Stimming. Technical University of Crete. November 27th, 2008
Codes on Graphs Telecommunications Laboratory Alex Balatsoukas-Stimming Technical University of Crete November 27th, 2008 Telecommunications Laboratory (TUC) Codes on Graphs November 27th, 2008 1 / 31
More informationQuasi-cyclic Low Density Parity Check codes with high girth
Quasi-cyclic Low Density Parity Check codes with high girth, a work with Marta Rossi, Richard Bresnan, Massimilliano Sala Summer Doctoral School 2009 Groebner bases, Geometric codes and Order Domains Dept
More informationOne Lesson of Information Theory
Institut für One Lesson of Information Theory Prof. Dr.-Ing. Volker Kühn Institute of Communications Engineering University of Rostock, Germany Email: volker.kuehn@uni-rostock.de http://www.int.uni-rostock.de/
More informationA Discrete Channel Model for Capturing Memory and Soft-Decision Information: A Capacity Study
A Discrete Channel Model for Capturing Memory and Soft-Decision Information: A Capacity Study Cecilio Pimentel Department of Electronics and Systems Federal University of Pernambuco Recife, PE, 507-970,
More information