Error-Correction Coding for Digital Communications

Size: px

Start display at page:

Download "Error-Correction Coding for Digital Communications"

Bernice Craig
5 years ago
Views:

1 Error-Correction Coding for Digital Communications

2 Applications of Communications Theory Series Editor: R. W. Lucky, Bell Laboratories INTRODUCTION TO COMMUNICATION SCIENCE AND SYSTEMS John R. Pierce and Edward C. Posner OPTICAL FIBER TRANSMISSION SYSTEMS Stewart D. Personick TELECOMMUNICATIONS SWITCHING J. Gordon Pearce ERROR-CORRECTION CODING FOR DIGITAL COMMUNICATIONS George C. Clark, Jr., and J. Bibb Cain A Continuation Order Plan is available for this series. A continuation order will bring delivery of each new volume immediately upon publication. Volumes are billed only upon actual shipment. For further information please contact the publisher.

3 Error-Correction Coding for Digital Communications George C. Clark, Jr. and J. Bibb Cain Harris Corporation Melbourne, Florida SPRINGER SCIENCE+BUSINESS MEDIA, LLC

4 Library of Congress Cataloging in Publication Data Oark, George C. (George Cyril), Error-correction coding for digital communications. Bibliography: p. Includes index. 1. Data transmission systems. 2. Error-correcting codes (Information theory). I. Cain, J. Bibb. II. Title. TK C '0413 ISBN ISBN (ebook) DOI / AACR Springer Science+Business Media New York Originally published by Plenum Press, New York in 1981 Softcover reprint of the hardcover 1st edition 1981 All rights reserved No part of this book may be reproduced, stored in a retrieval system, or transmitted, in any form or by any means, electronic, mechanical, photocopying, microfilming, recording, or otherwise, without written permission from the Publisher

5 Preface Error-correction coding is being used on an almost routine basis in most new communication systems. Not only is coding equipment being used to increase the energy efficiency of communication links, but coding ideas are also providing innovative solutions to many related communication problems. Among these are the elimination of intersymbol interference caused by filtering and multipath and the improved demodulation of certain frequency modulated signals by taking advantage of the "natural" coding provided by a continuous phase. Although several books and numerous articles have been written on coding theory, there are still noticeable deficiencies. First, the practical aspects of translating a specific decoding algorithm into actual hardware have been largely ignored. The information that is available is sketchy and is widely dispersed. Second, the information required to evaluate a particular technique under situations that are encountered in practice is available for the most part only in private company reports. This book is aimed at correcting both of these problems. It is written for the design engineer who must build the coding and decoding equipment and for the communication system engineer who must incorporate this equipment into a system. It is also suitable as a senior-level or first-year graduate text for an introductory one-semester course in coding theory. The book U"Ses a minimum of mathematics and entirely avoids the classical theorem/proof approach that is often seen in coding texts. Whenever possible heuristic arguments are advanced and concepts are developed by drawing analogies. We have intentionally constrained the level of mathematical rigor used in presenting error-correction concepts. Notwithstanding, coding is an extremely mathematical subject. and it would be an impossible task to attempt to present the material with no mathematics at all. The assumption is made that the practicing engineer is mostly interv

6 vi Preface ested in using the mathematics and not in constructing rigorous proofs. Thus, the goal is to develop a manipulative and intuitive understanding through numerous examples. Although there are many perils in this approach, a capable engineer can usually verify that a particular procedure is correct by trying it on a few test cases. The serious student may later wish to round out his or her understanding by pursuing the subject to its very roots. In addition to the large number of papers in the open literature. the excellent texts by Peterson and Weldon,< 'l Berlekamp, <ll and Gallager. <Jl are highly recommended for this purpose. Not all aspects of coding theory are treated in equal depth. Some topics, such as coding bounds, are treated very lightly while some others, such as certain classes of rarely used codes, are omitted entirely. Numerous classes of codes of practical interest are discussed in terms of methods of construction and code properties. However, there exist additional interesting properties of these codes as well as other code classes which we have chosen to omit for reasons of brevity. Instead, we have chosen to emphasize the formulation and implementation of decoding algorithms. The viewpoint, the selection of topics, and the degree of emphasis largely reflects the authors' personal preference and is based upon 15 years of practical experience in designing and evaluating coding equipment. However. we feel that the approach we have taken will also provide the reader with the insight and motivation to undertake some of the more difficult topics in other texts. In this book the application of error-correction coding is presented in the context of communication system design. Again, this reflects the authors' personal preferences. These techniques may also be used in other applications such as in computer memory systems. We have attempted to develop the tools necessary to enable the reader to evaluate such applications and to select an appropriate coding/decoding technique. An introduction to the use of error-correction coding in digital communication systems is presented in Chapter 1. Following this, the next four chapters are devoted to block codes and the associated decoding techniques. Fundamental concepts of linear codes (parity check matrix, syndrome, shift-register encoders, etc.) are developed in Chapter 2. and several useful classes of codes are presented. The simple hard decision decoding techniques for block codes are discussed in Chapter 3. These include Meggitt decoders, information-set decoders, and threshold decoders. Special attention is given to those features which result in minimum implementation complexity. Chapter 4 presents a collection of techniques for decoding block codes utilizing demodulator "soft" decisions. These include techniques developed by Massey, Hartmann and Rudolph. Chase, and Weldon. Various hardware realizations are presented, and performance/ complexity considerations are discussed. Algebraic techniques for multiple-

7 Preface vii error correction are developed in Chapter 5. The theory is developed using a transform approach. Numerous examples are used, and various hardware configurations are discussed. Convolutional coding techniques are presented in the next two chapters. Basic structural properties of convolutional codes and the Viterbi algorithm are developed in Chapter 6. Numerous performance curves are presented, and special attention is given to performance/ complexity tradeoffs. A similar treatment is provided in Chapter 7 for the table look-up, threshold, and sequential decoding techniques. Finally, in Chapter 8 we discuss a number of important system applications including concatenated codes, coding for the white Gaussian noise channel, interleaver structures, burst-noise channels, coding for spread spectrum systems, and coding for bandwidth-constrained channels. By including an extensive treatment of applications, we believe this book will be extremely useful to the communication system engineer. Numerous lists of good codes are provided in Appendices A and B. There are a number of acknowledgments which we should make. A book of this nature relies heavily on the pioneering work of the many researchers in this field. We have tried to adequately acknowledge this work in the references cited throughout the text. The authors are grateful for having had the opportunity to work for the Harris Corporation, Government Systems Group where they have been able to develop errorcorrection hardware and to apply coding techniques in a variety of communication systems. We would also like to thank C. J. Palermo and R. E. Totty for their encouragement during the writing of this book. Finally, we would like to acknowledge the technical contributions provided by our colleagues J. M. Geist, R. C. Davis, R. W. Boyd, and G. H. Thaker, the reviews provided by D. B. Bradley, A. M. Bush, and L. D. Rudolph, and the long hours of assistance in preparation of the manuscript provided by Barbara Snow and Sandra Wilson. Special thanks must also go to our wives Ann and Sissie for their encouragement and support during the past year. Harris Corporation George C. Clark, 1 r. J. Bibb Cain

8 Contents 1. Fundamental Concepts of Coding Basic 1020 Practical 1030 Performance 1.40 Coding 1.50 Remarks Principles 0 Constraints Data Encoder Modulator Waveform Demodulator Decoder Discrete Source Channel II Data Channel 0 Computations 0 Computation of Error Rate 0 Bound Computation of Error Rate 0 of Error Detection Systems 0 Decision Decoding 0 Effects 0 of Noncoherent Combining 0 Gain 0 Bounds 0 on Minimum Distance Exact Union Performance Soft Quantization Effect Coding Bounds Random Problems Coding Bound Group Codes Generalized Parity Check Codes 0 Check Matrix 0 Distance Considerations 0 Codes Parity Minimum Hamming ix

9 X Contents Generator Matrix Dual Codes The Syndrome The Penny-Weighing Problem A Simple Iterated Code Polynomial Codes Finite Field Arithmetic Generation of Polynomial Codes Cyclic Codes Alternate Encoder for Cyclic Codes Additional Properties of Polynomials and Galois Field Elements Codes Specified by Roots Syndrome Polynomials Modifications of Codes Important Classes of Group Codes BCH Codes Golay Codes Maximal-Length Codes Reed-Muller Codes Quadratic Residue Codes Remarks Problem~ Simple Nonalgebraic Decoding Techniques for Group Codes Meggitt Decoders Information Set Decoding General Decoding Algorithm Information Set Decoding Using the H Matrix Predetermined Covering Sets Random Search Techniques Threshold Decoding Remarks Problem~ Soft Decision Decoding of Block Codes APP Threshold Decoding Derivation of the APP Decoding Rule Computation of the Weighting Terms Approximate Computation of wi Implementation of the APP Decoder Optimum Symbol-by-Symbol Decoding Derivation of the Hartmann-Rudolph Algorithm An Alternate Form of the HR Algorithm A Design Example Greenberger Approximation to the HR Algorithm

10 Cootents xi 4.3. The Weldon Algorithm The Chase Algorithm Standard Chase Algorithms Variations on the Chase Algorithms Information-Set-Decoding Algorithms Information-Set-Only Algorithms Omura-Type Algorithms Partial Syndrome Decoding Some Performance Predictions Problems I Algebraic Techniques for Multiple Error Correction Finite-Field Transforms BCH Codes BCH Decoding Techniques Frequency Domain Decoding Time Domain Decoding Solution of the Key Equation Euclid's Algorithm Berlekamp's Algorithm Implementation Considerations Correction of Errors and Erasures Performance Results Remarks Problems Convolutional Code Structure and Viterbi Decoding Binary Rate- I /2 Convolutional Codes Viterbi Decoding Algorithm Rate-m/n Convolutional Codes Finite-State Machine Description and Distance Properties of Convolutional Codes Performance of Convolutional Codes with Viterbi Decoding Union Bounds Optimum Codes Performance with Coherent PSK Performance with Orthogonal Signaling and Noncoherent Detection Implementation Considerations Synchronizer Branch Metric Computer Path Metric Storage and Updating Storage and Updating of Hypothesized Information Sequences Output Device Demodulator Quantization and AGC Remarks Problems

11 xii Contents 7. Other Convolutional Decoding Techniques Syndrome Decoding Techniques Basic Concepts Table Look-up Decoding Threshold Decoding Sequential Decoding Techniques Sequential Decoding via the Fano Algorithm Selection of Sequential Decoding Metric Code Selection Sequential Decoder Computational Problem Performance of Sequential Decoders Implementation Considerations Stack Sequential Decoding.. ~~ Problems System Applications Concatenated Codes Concatenated Coding Concepts Reed-Solomon/Orthogonal Code Systems Reed-Solomon/Short-Block Code Systems Reed-Solomon/Convolutional Code Systems Coding for the White Gaussian Noise Channel Interleaver Structures for Coded Systems Periodic Interleavers Pseudorandom Interleavers Coding for Burst Noise Channels Burst Noise Processes Convolutional Code Performance with Random Erasures Convolutional Code Performance with Periodic Burst Erasures Performance Degradation Due to Random Erasure Burst Interleaving Implications Coding for Spread Spectrum Systems Direct Sequence PN Spread Systems Frequency Hop Systems Coding for Bandwidth-Constrained Channels Problems Appendix A. Code Generators for BCH Codes Appendix B. Code Generators for Convolutional Codes B.l. Viterbi Decoding B.2. Table Look-up Decoding Threshold Decoding B.4. Sequential Decoding References Index

12 Error-Correction Coding for Digital Communications

Probability Theory, Random Processes and Mathematical Statistics

Probability Theory, Random Processes and Mathematical Statistics Mathematics and Its Applications Managing Editor: M.HAZEWINKEL Centre for Mathematics and Computer Science, Amsterdam, The Netherlands Volume