392D: Coding for the AWGN Channel Wednesday, January 24, 2007 Stanford, Winter 2007 Handout #6. Problem Set 2 Solutions
|
|
- Emily Greer
- 5 years ago
- Views:
Transcription
1 392D: Coding for the AWGN Channel Wednesday, January 24, 2007 Stanford, Winter 2007 Handout #6 Problem Set 2 Solutions Problem 2.1 (Cartesian-product constellations) (a) Show that if A is a K-fold Cartesian product of A, A = A K, then the parameters N, log 2,E(A ) and K min (A ) of A are K times as large as the corresponding parameters of A, whereas the normalized parameters ρ,e s,e b and d 2 min(a) of A are the same as those of A. Verify that these relations hold for ( )-QA constellations. There are possibilities for each of the n components of A, so the total number of possibilities is A = K. The number of bits supported by A is therefore log 2 A = K log 2, K times the number for A. The number of dimensions in A is KN, so its nominal spectral efficiency is ρ = (log 2 )/N, the same as that of A. The average energy of A is E A = a a a K 2 = KE A. The average energy per bit is E b = E A / log 2 A = E A /(log 2 ), and the average energy per two dimensions is E s = 2E A /KN = 2E A /N, which for both are the same as for A. Two distinct points in A must differ in at least one component. The minimum squared distance is therefore the minimum squared distance in any component, which is d 2 min(a). The number of nearest neighbors to any point (a 1,a 2,...,a K ) A is the sum of the numbers of nearest neighbors to a 1,a 2,...,a K, respectively, since there is a nearest neighbor for each such nearest neighbor to each component. The average number K min (A ) of nearest neighbors to A is therefore the sum of the average number of nearest neighbors in each component, which is K min (A ) = KK min (A). An ( )-QA constellation A is equal to the 2-fold Cartesian product A 2, where A is an -PA constellation. Therefore all the above results hold with K = 2. In particular, the QA constellation has the same d 2 min as the PA constellation, but twice the number K min of nearest neighbors. (b) Show that if the signal constellation A is a Cartesian product A K, then D detection can be performed by performing independent D detection on each of the K components of the received KN-tuple y = (y 1,y 2,...,y K ). Using this result, sketch the decision regions of a (4 4)-QA signal set. Given a received signal (y 1,y 2,...,y K ), to minimize the squared distance y 1 a y 2 a y K a K 2 over A, we may minimize each component y j a j 2 separately, since choice of one component a j imposes no restrictions on the choices of other components. The D decision regions of a (4 4)-QA signal set A = A 2 are thus simply those of a 4-PA signal set A, independently for each coordinate. Such decision regions are sketched in the Problem Set 1 solutions, Problem 1.3(b). 1
2 (c) Show that if Pr(E) is the probability of error for D detection of A, then the probability of error for D detection of A = A K is Pr(E) = 1 (1 Pr(E)) K, Show that Pr(E) K Pr(E) if Pr(E) is small. A signal in A is received correctly if and only if each component is received correctly. The probability of correct decision is therefore the product of the probabilities of correct decision for each of the components separately, which is (1 Pr(E)) K. The probability of error for A is therefore Pr(E ) = 1 (1 Pr(E)) K. When Pr(E) is small, (1 Pr(E)) K 1 K Pr(E), so Pr(E ) K Pr(E). Problem 2.2 (Pr(E) invariance to translation, orthogonal transformations, or scaling) Let Pr(E a j ) be the probability of error when a signal a j is selected equiprobably from an N-dimensional signal set A and transmitted over a discrete-time AWGN channel, and the channel output Y = a j +N is mapped to a signal â j A by a minimum-distance decision rule. An error event E occurs if â j a j. Pr(E) denotes the average error probability. (a) Show that the probabilities of error Pr(E a j ) are unchanged if A is translated by any vector v; i.e., the constellation A = A + v has the same Pr(E) as A. If all signals are equiprobable and the noise is iid Gaussian, then the optimum detector is a minimum-distance detector. In this case the received sequence Y = a j+n may be mapped reversibly to Y = Y v = a j + N, and then an D detector for A based on Y is equivalent to an D detector for A based on Y. In particular, it has the same probabilities of error Pr(E a j ). (b) Show that Pr(E) is invariant under orthogonal transformations; i.e., A = UA has the same Pr(E) as A when U is any orthogonal N N matrix (i.e., U 1 = U T ). In this case the received sequence Y = a j+n may be mapped reversibly to Y = U 1 Y = a j +U 1 N. Since the noise distribution depends only on the squared norm n 2, which is not affected by orthogonal transformations, the noise sequence N = U 1 N has the same distribution as N, so again the probability of error Pr(E) is unaffected. (c) Show that Pr(E) is unchanged if both A and N are scaled by α > 0. In this case the received sequence Y = a j + αn may be mapped reversibly to Y = α 1 Y = a j + N, which again reduces the model to the original scenario. Problem 2.3 (optimality of zero-mean constellations) Consider an arbitrary signal set A = {a j, 1 j }. Assume that all signals are equiprobable. Let m(a) = 1 j a j be the average signal, and let A be A translated by m(a) so that the mean of A is zero: A = A m(a) = {a j m(a), 1 j }. Let E(A) and E(A ) denote the average energies of A and A, respectively. (a) Show that the error probability of an D detector is the same for A as it is for A. This follows from Problem 2.2(a) 2
3 (b) Show that E(A ) = E(A) m(a) 2. Conclude that removing the mean m(a) is always a good idea. Let A be the random variable with alphabet A that is equal to a j with probability 1/ for all j, and let A = A m(a) be the fluctuation of A. Then E(A) = A 2, m(a) = A, and E(A ) = A A 2 = A 2 2 A,A + A 2 = A 2 A 2 = E(A) m(a) 2. Thus the second moment of A is greater than or equal to the variance of A, with equality if and only if the mean of A is zero. This result and that of part (a) imply that if m(a) 0, then by replacing A with A = A m(a), the average energy can be reduced without changing the probability of error. Therefore A is always preferable to A; i.e., an optimum constellation must have zero mean. (c) Show that a binary antipodal signal set A = {±a} is always optimal for = 2. A two-point constellation with zero mean must have a 1 +a 2 = 0, which implies a 2 = a 1. Problem 2.4 (UBE for -PA constellations). For an -PA constellation A, show that K min (A) = 2( 1)/. Conclude that the union bound estimate of Pr(E) is ( ) ( ) 1 d Pr(E) 2 Q. 2σ Observe that in this case the union bound estimate is exact. Explain why. The 2 interior points have 2 nearest neighbors, while the 2 boundary points have 1 nearest neighbor, so the average number of nearest neighbors is K min (A) = 1 (( 2)(2) + (2)(1)) = 2 2. In general the union bound estimate is Pr(E) K min (A)Q(d min (A)/2σ). Plugging in d min (A) = d and the above expression for K min (A), we get the desired expression. For the 2 interior points, the exact error probability is 2Q(d/2σ). For the 2 boundary points, the exact error probability is Q(d/2σ). If all points are equiprobable, then the average Pr(E) is exactly the UBE given above. In general, we can see that the union bound is exact for one-dimensional constellations, and only for one-dimensional constellations. The union bound estimate is therefore exact only for equi-spaced one-dimensional constellations; i.e., essentially only for -PA. 3
4 Problem 2.5 (Invariance of coding gain) Show that in the power-limited regime the nominal coding gain γ c (A) of (5.9), the UBE (5.10) of P b (E), and the effective coding gain γ eff (A) are invariant to scaling, orthogonal transformations and Cartesian products. In the power-limited regime, the nominal coding gain is defined as γ c (A) = d2 min(a) 4E b (A). Scaling A by α > 0 multiplies both d 2 min(a) and E b (A) by α 2, and therefore leaves γ c (A) unchanged. Orthogonal transformations of A do not change either d 2 min(a) or E b (A). As we have seen in Problem 2.1, taking Cartesian products also does not change either d 2 min(a) or E b (A). Therefore γ c (A) is invariant under all these operations. The UBE of P b (E) involves γ c (A) and K b (A) = K min (A)/( log A ). K min (A) is also obviously unchanged under scaling or orthogonal transformations. Problem 2.1 showed that K min (A) increases by a factor of K under a K-fold Cartesian product, but so does log A, so K b (A) is also unchanged under Cartesian products. The effective coding gain is a function of the UBE of P b (E), and therefore it is invariant also. Problem 2.6 (Orthogonal signal sets) An orthogonal signal set is a set A = {a j, 1 j } of orthogonal vectors in R with equal energy E(A); i.e., a j,a j = E(A)δ jj (Kronecker delta). (a) Compute the nominal spectral efficiency ρ of A in bits per two dimensions. Compute the average energy E b per information bit. The rate of A is log 2 bits per dimensions, so the nominal spectral efficiency is ρ = (2/) log 2 bits per two dimensions. The average energy per symbol is E(A), so the average energy per bit is E b = E(A) log 2. (b) Compute the minimum squared distance d 2 min(a). K min (A) = 1 nearest neighbors. The squared distance between any two distinct vectors is Show that every signal has a j a j 2 = a j 2 2 a j,a j + a j 2 = E(A) 0 + E(A) = 2E(A), so d 2 min(a) = 2E(A), and every vector has all other vectors as nearest neighbors, so K min (A) = 1. (c) Let the noise variance be σ 2 = N 0 /2 per dimension. Show that the probability of error of an optimum detector is bounded by the UBE Pr(E) ( 1)Q (E(A)/N 0 ). 4
5 The pairwise error probability between any two distinct vectors is Pr{a j a j } = Q ( a j a j 2 /4σ 2 ) = Q (2E(A)/2N 0 ) = Q (E(A)/N 0 ). By the union bound, for any a j A, Pr(E a j ) Pr{a j a j } = ( 1)Q (E(A)/N 0 ), j j so the average Pr(E) also satisfies this upper bound. (d) Let with E b held constant. Using an asymptotically accurate upper bound for the Q ( ) function (see Appendix), show that Pr(E) 0 provided that E b /N 0 > 2 ln 2 (1.42 db). How close is this to the ultimate Shannon limit on E b /N 0? What is the nominal spectral efficiency ρ in the limit? By the Chernoff bound of the Appendix of Chapter 5, Q (x 2 ) e x2 /2. Therefore Pr(E) ( 1)e E(A)/2N 0 < e (ln ) e (E b log 2 )/2N 0. Since ln = (log 2 )(ln 2), as this bound goes to zero provided that or equivalently E b /N 0 > 2 ln 2 (1.42 db). E b /2N 0 > ln 2, The ultimate Shannon limit on E b /N 0 is E b /N 0 > ln 2 (-1.59 db), so this shows that we can get to within 3 db of the ultimate Shannon limit with orthogonal signalling. (It can be shown that orthogonal signalling can actually achieve Pr(E) 0 for any E b /N 0 > ln 2, the ultimate Shannon limit.) Unfortunately, the nominal spectral efficiency ρ = (2 log 2 )/ goes to 0 as. Problem 2.7 (Simplex signal sets) Let A be an orthogonal signal set as above. (a) Denote the mean of A by m(a). Show that m(a) 0, and compute m(a) 2. By definition, Therefore, using orthogonality, we have m(a) = 1 a j. m(a) 2 = 1 a 2 j 2 = E(A) 0. j By the strict non-negativity of the Euclidean norm, m(a) 2 0 implies that m(a) 0. The zero-mean set A = A m(a) is called a simplex signal set. It is universally believed to be the optimum set of signals in AWGN in the absence of bandwidth constraints, except at ridiculously low SNRs. 5 j
6 (b) For = 2, 3, 4, sketch A and A. For = 2, 3, 4, A consists of orthogonal vectors in -space (hard to sketch for = 4). For = 2, A consists of two antipodal signals in a 1-dimensional subspace of 2-space; for = 3, A consists of three vertices of an equilateral triangle in a 2- dimensional subspace of 3-space; and for = 4, A consists of four vertices of a regular tetrahedron in a 3-dimensional subspace of 4-space. (c) Show that all signals in A have the same energy E(A ). Compute E(A ). Compute the inner products a j,a j for all a j,a j A. The inner product of m(a) with any a j is m(a),a j = 1 The energy of a j = a j m(a) is therefore j a j,a j = E A. a j 2 = a j 2 2 m(a),a j + m(a) 2 = E(A) E(A) = 1 E(A). For j j, the inner product a j,a j is a j,a j = a j m(a),a j m(a) = 0 2 E(A) + E(A) = E(A). In other words, the inner product is equal to 1 E(A) if j = j and 1 E(A) for j j. (d) [Optional]. Show that for ridiculously low SNR, a signal set consisting of 2 zero signals and two antipodal signals {±a} has a lower Pr(E) than a simplex signal set. [Hint: see. Steiner, The strong simplex conjecture is false, IEEE Transactions on Information Theory, pp , ay 1994.] See the cited article. Problem 2.8 (Biorthogonal signal sets) The set A = ±A of size 2 consisting of the signals in an orthogonal signal set A with symbol energy E(A) and their negatives is called a biorthogonal signal set. (a) Show that the mean of A is m(a ) = 0, and that the average energy is E(A). The mean is and every vector has energy E(A). m(a ) = j (a j a j ) = 0, (b) How much greater is the nominal spectral efficiency ρ of A than that of A? The rate of A is log 2 2 = 1 + log 2 bits per dimensions, so its nominal spectral efficiency is ρ = (2/)(1 + log 2 ) b/2d, which is 2/ b/2d greater than for A. This is helpful for small, but negligible as. 6
7 (c) Show that the probability of error of A is approximately the same as that of an orthogonal signal set with the same size and average energy, for large. Each vector in A has 2 2 nearest neighbors at squared distance 2E(A), and one antipodal vector at squared distance 4E(A). The union bound estimate is therefore Pr(E) (2 2)Q (E(A)/N 0 ) A Q (E(A)/N 0 ), which is approximately the same as the estimate Pr(E) (2 1)Q (E(A)/N 0 ) A Q (E(A)/N 0 ) for an orthogonal signal set A of size A = 2. (d) Let the number of signals be a power of 2: 2 = 2 k. Show that the nominal spectral efficiency is ρ(a ) = 4k2 k b/2d, and that the nominal coding gain is γ c (A ) = k/2. Show that the number of nearest neighbors is K min (A ) = 2 k 2. If = 2 k 1, then the nominal spectral efficiency is ρ(a ) = (2/)(1 + log 2 ) = 2 2 k k = 4k2 k b/2d. We are in the power-limited regime, so the nominal coding gain is γ c (A ) = d2 min(a ) 4E b = 2E(A ) 4E(A )/k = k 2. The number of nearest neighbors is K min (A ) = 2 2 = 2 k 2. 7
Performance of small signal sets
42 Chapter 5 Performance of small signal sets In this chapter, we show how to estimate the performance of small-to-moderate-sized signal constellations on the discrete-time AWGN channel. With equiprobable
More informationIntroduction to binary block codes
58 Chapter 6 Introduction to binary block codes In this chapter we begin to study binary signal constellations, which are the Euclidean-space images of binary block codes. Such constellations have nominal
More informationEE4304 C-term 2007: Lecture 17 Supplemental Slides
EE434 C-term 27: Lecture 17 Supplemental Slides D. Richard Brown III Worcester Polytechnic Institute, Department of Electrical and Computer Engineering February 5, 27 Geometric Representation: Optimal
More informationDigital Transmission Methods S
Digital ransmission ethods S-7.5 Second Exercise Session Hypothesis esting Decision aking Gram-Schmidt method Detection.K.K. Communication Laboratory 5//6 Konstantinos.koufos@tkk.fi Exercise We assume
More informationa) Find the compact (i.e. smallest) basis set required to ensure sufficient statistics.
Digital Modulation and Coding Tutorial-1 1. Consider the signal set shown below in Fig.1 a) Find the compact (i.e. smallest) basis set required to ensure sufficient statistics. b) What is the minimum Euclidean
More informationModulation & Coding for the Gaussian Channel
Modulation & Coding for the Gaussian Channel Trivandrum School on Communication, Coding & Networking January 27 30, 2017 Lakshmi Prasad Natarajan Dept. of Electrical Engineering Indian Institute of Technology
More informationProblem 7.7 : We assume that P (x i )=1/3, i =1, 2, 3. Then P (y 1 )= 1 ((1 p)+p) = P (y j )=1/3, j=2, 3. Hence : and similarly.
(b) We note that the above capacity is the same to the capacity of the binary symmetric channel. Indeed, if we considerthe grouping of the output symbols into a = {y 1,y 2 } and b = {y 3,y 4 } we get a
More informationρ = sin(2π ft) 2π ft To find the minimum value of the correlation, we set the derivative of ρ with respect to f equal to zero.
Problem 5.1 : The correlation of the two signals in binary FSK is: ρ = sin(π ft) π ft To find the minimum value of the correlation, we set the derivative of ρ with respect to f equal to zero. Thus: ϑρ
More informationSummary: SER formulation. Binary antipodal constellation. Generic binary constellation. Constellation gain. 2D constellations
TUTORIAL ON DIGITAL MODULATIONS Part 8a: Error probability A [2011-01-07] 07] Roberto Garello, Politecnico di Torino Free download (for personal use only) at: www.tlc.polito.it/garello 1 Part 8a: Error
More information16.36 Communication Systems Engineering
MIT OpenCourseWare http://ocw.mit.edu 16.36 Communication Systems Engineering Spring 2009 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms. 16.36: Communication
More informationComputing Probability of Symbol Error
Computing Probability of Symbol Error I When decision boundaries intersect at right angles, then it is possible to compute the error probability exactly in closed form. I The result will be in terms of
More informationMITOCW ocw-6-451_ feb k_512kb-mp4
MITOCW ocw-6-451_4-261-09feb2005-220k_512kb-mp4 And what we saw was the performance was quite different in the two regimes. In power-limited regime, typically our SNR is much smaller than one, whereas
More informationLecture 12. Block Diagram
Lecture 12 Goals Be able to encode using a linear block code Be able to decode a linear block code received over a binary symmetric channel or an additive white Gaussian channel XII-1 Block Diagram Data
More informationLecture 15: Thu Feb 28, 2019
Lecture 15: Thu Feb 28, 2019 Announce: HW5 posted Lecture: The AWGN waveform channel Projecting temporally AWGN leads to spatially AWGN sufficiency of projection: irrelevancy theorem in waveform AWGN:
More informationECE 564/645 - Digital Communications, Spring 2018 Homework #2 Due: March 19 (In Lecture)
ECE 564/645 - Digital Communications, Spring 018 Homework # Due: March 19 (In Lecture) 1. Consider a binary communication system over a 1-dimensional vector channel where message m 1 is sent by signaling
More informationINFORMATION PROCESSING ABILITY OF BINARY DETECTORS AND BLOCK DECODERS. Michael A. Lexa and Don H. Johnson
INFORMATION PROCESSING ABILITY OF BINARY DETECTORS AND BLOCK DECODERS Michael A. Lexa and Don H. Johnson Rice University Department of Electrical and Computer Engineering Houston, TX 775-892 amlexa@rice.edu,
More informationCapacity of AWGN channels
Chapter 3 Capacity of AWGN channels In this chapter we prove that the capacity of an AWGN channel with bandwidth W and signal-tonoise ratio SNR is W log 2 (1+SNR) bits per second (b/s). The proof that
More informationOn the Optimum Asymptotic Multiuser Efficiency of Randomly Spread CDMA
On the Optimum Asymptotic Multiuser Efficiency of Randomly Spread CDMA Ralf R. Müller Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU) Lehrstuhl für Digitale Übertragung 13 December 2014 1. Introduction
More informationHandout 12: Error Probability Analysis of Binary Detection
ENGG 230-B: Principles of Communication Systems 207 8 First Term Handout 2: Error Probability Analysis of Binary Detection Instructor: Wing-Kin Ma November 4, 207 Suggested Reading: Chapter 8 of Simon
More informationSOLUTIONS TO ECE 6603 ASSIGNMENT NO. 6
SOLUTIONS TO ECE 6603 ASSIGNMENT NO. 6 PROBLEM 6.. Consider a real-valued channel of the form r = a h + a h + n, which is a special case of the MIMO channel considered in class but with only two inputs.
More informationGEORGIA INSTITUTE OF TECHNOLOGY SCHOOL OF ELECTRICAL AND COMPUTER ENGINEERING Final Examination - Fall 2015 EE 4601: Communication Systems
GEORGIA INSTITUTE OF TECHNOLOGY SCHOOL OF ELECTRICAL AND COMPUTER ENGINEERING Final Examination - Fall 2015 EE 4601: Communication Systems Aids Allowed: 2 8 1/2 X11 crib sheets, calculator DATE: Tuesday
More informationSchur-convexity of the Symbol Error Rate in Correlated MIMO Systems with Precoding and Space-time Coding
Schur-convexity of the Symbol Error Rate in Correlated MIMO Systems with Precoding and Space-time Coding RadioVetenskap och Kommunikation (RVK 08) Proceedings of the twentieth Nordic Conference on Radio
More informationA Simple Example Binary Hypothesis Testing Optimal Receiver Frontend M-ary Signal Sets Message Sequences. possible signals has been transmitted.
Introduction I We have focused on the problem of deciding which of two possible signals has been transmitted. I Binary Signal Sets I We will generalize the design of optimum (MPE) receivers to signal sets
More information44 CHAPTER 5. PERFORMACE OF SMALL SIGAL SETS In digital communications, we usually focus entirely on the code, and do not care what encoding ma is use
Performance of small signal sets Chater 5 In this chater, we show how to estimate the erformance of small-to-moderate-sized signal constellations on the discrete-time AWG channel. With equirobable signal
More informationLecture Notes 1: Vector spaces
Optimization-based data analysis Fall 2017 Lecture Notes 1: Vector spaces In this chapter we review certain basic concepts of linear algebra, highlighting their application to signal processing. 1 Vector
More informationLecture 18: Gaussian Channel
Lecture 18: Gaussian Channel Gaussian channel Gaussian channel capacity Dr. Yao Xie, ECE587, Information Theory, Duke University Mona Lisa in AWGN Mona Lisa Noisy Mona Lisa 100 100 200 200 300 300 400
More informationPSK bit mappings with good minimax error probability
PSK bit mappings with good minimax error probability Erik Agrell Department of Signals and Systems Chalmers University of Technology 4196 Göteborg, Sweden Email: agrell@chalmers.se Erik G. Ström Department
More informationVector spaces. DS-GA 1013 / MATH-GA 2824 Optimization-based Data Analysis.
Vector spaces DS-GA 1013 / MATH-GA 2824 Optimization-based Data Analysis http://www.cims.nyu.edu/~cfgranda/pages/obda_fall17/index.html Carlos Fernandez-Granda Vector space Consists of: A set V A scalar
More informationOn Design Criteria and Construction of Non-coherent Space-Time Constellations
On Design Criteria and Construction of Non-coherent Space-Time Constellations Mohammad Jaber Borran, Ashutosh Sabharwal, and Behnaam Aazhang ECE Department, MS-366, Rice University, Houston, TX 77005-89
More information3F1: Signals and Systems INFORMATION THEORY Examples Paper Solutions
Engineering Tripos Part IIA THIRD YEAR 3F: Signals and Systems INFORMATION THEORY Examples Paper Solutions. Let the joint probability mass function of two binary random variables X and Y be given in the
More informationThe E8 Lattice and Error Correction in Multi-Level Flash Memory
The E8 Lattice and Error Correction in Multi-Level Flash Memory Brian M Kurkoski University of Electro-Communications Tokyo, Japan kurkoski@iceuecacjp Abstract A construction using the E8 lattice and Reed-Solomon
More informationSupplementary Figure 1: Scheme of the RFT. (a) At first, we separate two quadratures of the field (denoted by and ); (b) then, each quadrature
Supplementary Figure 1: Scheme of the RFT. (a At first, we separate two quadratures of the field (denoted by and ; (b then, each quadrature undergoes a nonlinear transformation, which results in the sine
More informationEE 121: Introduction to Digital Communication Systems. 1. Consider the following discrete-time communication system. There are two equallly likely
EE 11: Introduction to Digital Communication Systems Midterm Solutions 1. Consider the following discrete-time communication system. There are two equallly likely messages to be transmitted, and they are
More informationElectrical Engineering Written PhD Qualifier Exam Spring 2014
Electrical Engineering Written PhD Qualifier Exam Spring 2014 Friday, February 7 th 2014 Please do not write your name on this page or any other page you submit with your work. Instead use the student
More informationLecture 7 MIMO Communica2ons
Wireless Communications Lecture 7 MIMO Communica2ons Prof. Chun-Hung Liu Dept. of Electrical and Computer Engineering National Chiao Tung University Fall 2014 1 Outline MIMO Communications (Chapter 10
More informationECE 564/645 - Digital Communications, Spring 2018 Midterm Exam #1 March 22nd, 7:00-9:00pm Marston 220
ECE 564/645 - Digital Communications, Spring 08 Midterm Exam # March nd, 7:00-9:00pm Marston 0 Overview The exam consists of four problems for 0 points (ECE 564) or 5 points (ECE 645). The points for each
More informationTrellis Coded Modulation
Trellis Coded Modulation Trellis coded modulation (TCM) is a marriage between codes that live on trellises and signal designs We have already seen that trellises are the preferred way to view convolutional
More informationSummary II: Modulation and Demodulation
Summary II: Modulation and Demodulation Instructor : Jun Chen Department of Electrical and Computer Engineering, McMaster University Room: ITB A1, ext. 0163 Email: junchen@mail.ece.mcmaster.ca Website:
More informationCHAPTER 14. Based on the info about the scattering function we know that the multipath spread is T m =1ms, and the Doppler spread is B d =0.2 Hz.
CHAPTER 4 Problem 4. : Based on the info about the scattering function we know that the multipath spread is T m =ms, and the Doppler spread is B d =. Hz. (a) (i) T m = 3 sec (ii) B d =. Hz (iii) ( t) c
More informationChapter 2 Signal Processing at Receivers: Detection Theory
Chapter Signal Processing at Receivers: Detection Theory As an application of the statistical hypothesis testing, signal detection plays a key role in signal processing at receivers of wireless communication
More informationDigital Modulation 1
Digital Modulation 1 Lecture Notes Ingmar Land and Bernard H. Fleury Navigation and Communications () Department of Electronic Systems Aalborg University, DK Version: February 5, 27 i Contents I Basic
More informationThe Capacity of Finite Abelian Group Codes Over Symmetric Memoryless Channels Giacomo Como and Fabio Fagnani
IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 55, NO. 5, MAY 2009 2037 The Capacity of Finite Abelian Group Codes Over Symmetric Memoryless Channels Giacomo Como and Fabio Fagnani Abstract The capacity
More informationLecture 4: Proof of Shannon s theorem and an explicit code
CSE 533: Error-Correcting Codes (Autumn 006 Lecture 4: Proof of Shannon s theorem and an explicit code October 11, 006 Lecturer: Venkatesan Guruswami Scribe: Atri Rudra 1 Overview Last lecture we stated
More informationBlock 2: Introduction to Information Theory
Block 2: Introduction to Information Theory Francisco J. Escribano April 26, 2015 Francisco J. Escribano Block 2: Introduction to Information Theory April 26, 2015 1 / 51 Table of contents 1 Motivation
More information8 PAM BER/SER Monte Carlo Simulation
xercise.1 8 PAM BR/SR Monte Carlo Simulation - Simulate a 8 level PAM communication system and calculate bit and symbol error ratios (BR/SR). - Plot the calculated and simulated SR and BR curves. - Plot
More informationList Decoding: Geometrical Aspects and Performance Bounds
List Decoding: Geometrical Aspects and Performance Bounds Maja Lončar Department of Information Technology Lund University, Sweden Summer Academy: Progress in Mathematics for Communication Systems Bremen,
More informationLattices and Lattice Codes
Lattices and Lattice Codes Trivandrum School on Communication, Coding & Networking January 27 30, 2017 Lakshmi Prasad Natarajan Dept. of Electrical Engineering Indian Institute of Technology Hyderabad
More informationSIPCom8-1: Information Theory and Coding Linear Binary Codes Ingmar Land
SIPCom8-1: Information Theory and Coding Linear Binary Codes Ingmar Land Ingmar Land, SIPCom8-1: Information Theory and Coding (2005 Spring) p.1 Overview Basic Concepts of Channel Coding Block Codes I:
More informationLeech Constellations of Construction-A Lattices
Leech Constellations of Construction-A Lattices Joseph J. Boutros Talk at Nokia Bell Labs, Stuttgart Texas A&M University at Qatar In collaboration with Nicola di Pietro. March 7, 2017 Thanks Many Thanks
More informationLecture 4. Capacity of Fading Channels
1 Lecture 4. Capacity of Fading Channels Capacity of AWGN Channels Capacity of Fading Channels Ergodic Capacity Outage Capacity Shannon and Information Theory Claude Elwood Shannon (April 3, 1916 February
More informationUTA EE5362 PhD Diagnosis Exam (Spring 2011)
EE5362 Spring 2 PhD Diagnosis Exam ID: UTA EE5362 PhD Diagnosis Exam (Spring 2) Instructions: Verify that your exam contains pages (including the cover shee. Some space is provided for you to show your
More informationUniversity of Siena. Multimedia Security. Watermark extraction. Mauro Barni University of Siena. M. Barni, University of Siena
Multimedia Security Mauro Barni University of Siena : summary Optimum decoding/detection Additive SS watermarks Decoding/detection of QIM watermarks The dilemma of de-synchronization attacks Geometric
More informationAppendix B Information theory from first principles
Appendix B Information theory from first principles This appendix discusses the information theory behind the capacity expressions used in the book. Section 8.3.4 is the only part of the book that supposes
More informationImpact of channel-state information on coded transmission over fading channels with diversity reception
Impact of channel-state information on coded transmission over fading channels with diversity reception Giorgio Taricco Ezio Biglieri Giuseppe Caire September 4, 1998 Abstract We study the synergy between
More informationChapter 4: Continuous channel and its capacity
meghdadi@ensil.unilim.fr Reference : Elements of Information Theory by Cover and Thomas Continuous random variable Gaussian multivariate random variable AWGN Band limited channel Parallel channels Flat
More informationPart 1a: Inner product, Orthogonality, Vector/Matrix norm
Part 1a: Inner product, Orthogonality, Vector/Matrix norm September 19, 2018 Numerical Linear Algebra Part 1a September 19, 2018 1 / 16 1. Inner product on a linear space V over the number field F A map,
More informationADDITIVE noise is most often represented by a fixed
IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 44, NO. 3, MAY 1998 947 Maximin Performance of Binary-Input Channels with Uncertain Noise Distributions Andrew L. McKellips, Student Member, IEEE, Sergio Verdú,
More informationA First Course in Digital Communications
A First Course in Digital Communications Ha H. Nguyen and E. Shwedyk February 9 A First Course in Digital Communications 1/46 Introduction There are benefits to be gained when M-ary (M = 4 signaling methods
More informationBASICS OF DETECTION AND ESTIMATION THEORY
BASICS OF DETECTION AND ESTIMATION THEORY 83050E/158 In this chapter we discuss how the transmitted symbols are detected optimally from a noisy received signal (observation). Based on these results, optimal
More informationOptimized Symbol Mappings for Bit-Interleaved Coded Modulation with Iterative Decoding
Optimized Symbol Mappings for Bit-nterleaved Coded Modulation with terative Decoding F. Schreckenbach, N. Görtz, J. Hagenauer nstitute for Communications Engineering (LNT) Munich University of Technology
More informationAnd for polynomials with coefficients in F 2 = Z/2 Euclidean algorithm for gcd s Concept of equality mod M(x) Extended Euclid for inverses mod M(x)
Outline Recall: For integers Euclidean algorithm for finding gcd s Extended Euclid for finding multiplicative inverses Extended Euclid for computing Sun-Ze Test for primitive roots And for polynomials
More information4488 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 54, NO. 10, OCTOBER /$ IEEE
4488 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 54, NO. 10, OCTOBER 2008 List Decoding of Biorthogonal Codes the Hadamard Transform With Linear Complexity Ilya Dumer, Fellow, IEEE, Grigory Kabatiansky,
More informationDiversity Performance of a Practical Non-Coherent Detect-and-Forward Receiver
Diversity Performance of a Practical Non-Coherent Detect-and-Forward Receiver Michael R. Souryal and Huiqing You National Institute of Standards and Technology Advanced Network Technologies Division Gaithersburg,
More informationPerformance of Optimal Digital Page Detection in a Two-Dimensional ISI/AWGN Channel
c IEEE 1996 Presented at Asilomar Conf. on Signals, Systems and Comp., Nov. 1996 Performance of Optimal Digital Page Detection in a Two-Dimensional ISI/AWGN Channel Keith M. Chugg Department of Electrical
More information2318 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 54, NO. 6, JUNE Mai Vu, Student Member, IEEE, and Arogyaswami Paulraj, Fellow, IEEE
2318 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 54, NO. 6, JUNE 2006 Optimal Linear Precoders for MIMO Wireless Correlated Channels With Nonzero Mean in Space Time Coded Systems Mai Vu, Student Member,
More informationOn Comparability of Multiple Antenna Channels
On Comparability of Multiple Antenna Channels Majid Fozunbal, Steven W. McLaughlin, and Ronald W. Schafer School of Electrical and Computer Engineering Georgia Institute of Technology Atlanta, GA 30332-0250
More informationOne Lesson of Information Theory
Institut für One Lesson of Information Theory Prof. Dr.-Ing. Volker Kühn Institute of Communications Engineering University of Rostock, Germany Email: volker.kuehn@uni-rostock.de http://www.int.uni-rostock.de/
More informationThese outputs can be written in a more convenient form: with y(i) = Hc m (i) n(i) y(i) = (y(i); ; y K (i)) T ; c m (i) = (c m (i); ; c m K(i)) T and n
Binary Codes for synchronous DS-CDMA Stefan Bruck, Ulrich Sorger Institute for Network- and Signal Theory Darmstadt University of Technology Merckstr. 25, 6428 Darmstadt, Germany Tel.: 49 65 629, Fax:
More informationCommunication Over MIMO Broadcast Channels Using Lattice-Basis Reduction 1
Communication Over MIMO Broadcast Channels Using Lattice-Basis Reduction 1 Mahmoud Taherzadeh, Amin Mobasher, and Amir K. Khandani Coding & Signal Transmission Laboratory Department of Electrical & Computer
More informationBandwidth Efficient and Rate-Matched Low-Density Parity-Check Coded Modulation
Bandwidth Efficient and Rate-Matched Low-Density Parity-Check Coded Modulation Georg Böcherer, Patrick Schulte, Fabian Steiner Chair for Communications Engineering patrick.schulte@tum.de April 29, 2015
More informationNearest Neighbor Decoding in MIMO Block-Fading Channels With Imperfect CSIR
IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 58, NO. 3, MARCH 2012 1483 Nearest Neighbor Decoding in MIMO Block-Fading Channels With Imperfect CSIR A. Taufiq Asyhari, Student Member, IEEE, Albert Guillén
More informationAlgebraic Soft-Decision Decoding of Reed Solomon Codes
IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 49, NO. 11, NOVEMBER 2003 2809 Algebraic Soft-Decision Decoding of Reed Solomon Codes Ralf Koetter, Member, IEEE, Alexer Vardy, Fellow, IEEE Abstract A polynomial-time
More informationANALYSIS OF A PARTIAL DECORRELATOR IN A MULTI-CELL DS/CDMA SYSTEM
ANAYSIS OF A PARTIA DECORREATOR IN A MUTI-CE DS/CDMA SYSTEM Mohammad Saquib ECE Department, SU Baton Rouge, A 70803-590 e-mail: saquib@winlab.rutgers.edu Roy Yates WINAB, Rutgers University Piscataway
More informationProblem Set 3 Due Oct, 5
EE6: Random Processes in Systems Lecturer: Jean C. Walrand Problem Set 3 Due Oct, 5 Fall 6 GSI: Assane Gueye This problem set essentially reviews detection theory. Not all eercises are to be turned in.
More informationLimits to List Decoding Random Codes
Limits to List Decoding Random Codes Atri Rudra Department of Computer Science and Engineering, University at Buffalo, The State University of New York, Buffalo, NY, 14620. atri@cse.buffalo.edu Abstract
More informationEE6604 Personal & Mobile Communications. Week 13. Multi-antenna Techniques
EE6604 Personal & Mobile Communications Week 13 Multi-antenna Techniques 1 Diversity Methods Diversity combats fading by providing the receiver with multiple uncorrelated replicas of the same information
More informationChapter 9 Fundamental Limits in Information Theory
Chapter 9 Fundamental Limits in Information Theory Information Theory is the fundamental theory behind information manipulation, including data compression and data transmission. 9.1 Introduction o For
More informationEuclidean Spaces. Euclidean Spaces. Chapter 10 -S&B
Chapter 10 -S&B The Real Line: every real number is represented by exactly one point on the line. The plane (i.e., consumption bundles): Pairs of numbers have a geometric representation Cartesian plane
More informationDiversity Multiplexing Tradeoff in ISI Channels Leonard H. Grokop, Member, IEEE, and David N. C. Tse, Senior Member, IEEE
IEEE TRANSACTIONS ON INFORMATION THEORY, VOL 55, NO 1, JANUARY 2009 109 Diversity Multiplexing Tradeoff in ISI Channels Leonard H Grokop, Member, IEEE, and David N C Tse, Senior Member, IEEE Abstract The
More informationChannel Estimation with Low-Precision Analog-to-Digital Conversion
Channel Estimation with Low-Precision Analog-to-Digital Conversion Onkar Dabeer School of Technology and Computer Science Tata Institute of Fundamental Research Mumbai India Email: onkar@tcs.tifr.res.in
More informationResidual Versus Suppressed-Carrier Coherent Communications
TDA Progress Report -7 November 5, 996 Residual Versus Suppressed-Carrier Coherent Communications M. K. Simon and S. Million Communications and Systems Research Section This article addresses the issue
More informationOn the Low-SNR Capacity of Phase-Shift Keying with Hard-Decision Detection
On the Low-SNR Capacity of Phase-Shift Keying with Hard-Decision Detection ustafa Cenk Gursoy Department of Electrical Engineering University of Nebraska-Lincoln, Lincoln, NE 68588 Email: gursoy@engr.unl.edu
More informationPrinciples of Communications
Principles of Communications Weiyao Lin Shanghai Jiao Tong University Chapter 10: Information Theory Textbook: Chapter 12 Communication Systems Engineering: Ch 6.1, Ch 9.1~ 9. 92 2009/2010 Meixia Tao @
More informationA t super-channel. trellis code and the channel. inner X t. Y t. S t-1. S t. S t+1. stages into. group two. one stage P 12 / 0,-2 P 21 / 0,2
Capacity Approaching Signal Constellations for Channels with Memory Λ Aleksandar Kav»cić, Xiao Ma, Michael Mitzenmacher, and Nedeljko Varnica Division of Engineering and Applied Sciences Harvard University
More informationLattices for Communication Engineers
Lattices for Communication Engineers Jean-Claude Belfiore Télécom ParisTech CNRS, LTCI UMR 5141 February, 22 2011 Nanyang Technological University - SPMS Part I Introduction Signal Space The transmission
More informationMaximum Likelihood Decoding of Codes on the Asymmetric Z-channel
Maximum Likelihood Decoding of Codes on the Asymmetric Z-channel Pål Ellingsen paale@ii.uib.no Susanna Spinsante s.spinsante@univpm.it Angela Barbero angbar@wmatem.eis.uva.es May 31, 2005 Øyvind Ytrehus
More informationThis examination consists of 10 pages. Please check that you have a complete copy. Time: 2.5 hrs INSTRUCTIONS
THE UNIVERSITY OF BRITISH COLUMBIA Department of Electrical and Computer Engineering EECE 564 Detection and Estimation of Signals in Noise Final Examination 08 December 2009 This examination consists of
More informationELEG 5633 Detection and Estimation Signal Detection: Deterministic Signals
ELEG 5633 Detection and Estimation Signal Detection: Deterministic Signals Jingxian Wu Department of Electrical Engineering University of Arkansas Outline Matched Filter Generalized Matched Filter Signal
More informationOn the Limits of Communication with Low-Precision Analog-to-Digital Conversion at the Receiver
1 On the Limits of Communication with Low-Precision Analog-to-Digital Conversion at the Receiver Jaspreet Singh, Onkar Dabeer, and Upamanyu Madhow, Abstract As communication systems scale up in speed and
More informationApplications of Lattices in Telecommunications
Applications of Lattices in Telecommunications Dept of Electrical and Computer Systems Engineering Monash University amin.sakzad@monash.edu Oct. 2013 1 Sphere Decoder Algorithm Rotated Signal Constellations
More informationC.M. Liu Perceptual Signal Processing Lab College of Computer Science National Chiao-Tung University
Quantization C.M. Liu Perceptual Signal Processing Lab College of Computer Science National Chiao-Tung University http://www.csie.nctu.edu.tw/~cmliu/courses/compression/ Office: EC538 (03)5731877 cmliu@cs.nctu.edu.tw
More informationECE Information theory Final (Fall 2008)
ECE 776 - Information theory Final (Fall 2008) Q.1. (1 point) Consider the following bursty transmission scheme for a Gaussian channel with noise power N and average power constraint P (i.e., 1/n X n i=1
More informationUC Riverside UC Riverside Previously Published Works
UC Riverside UC Riverside Previously Published Works Title Soft-decision decoding of Reed-Muller codes: A simplied algorithm Permalink https://escholarship.org/uc/item/5v71z6zr Journal IEEE Transactions
More informationCommunication Theory II
Communication Theory II Lecture 15: Information Theory (cont d) Ahmed Elnakib, PhD Assistant Professor, Mansoura University, Egypt March 29 th, 2015 1 Example: Channel Capacity of BSC o Let then: o For
More informationPerformance of DS-CDMA Systems With Optimal Hard-Decision Parallel Interference Cancellation
2918 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 49, NO. 11, NOVEMBER 2003 Performance of DS-CDMA Systems With Optimal Hard-Decision Parallel Interference Cancellation Remco van der Hofstad Marten J.
More informationFlat Rayleigh fading. Assume a single tap model with G 0,m = G m. Assume G m is circ. symmetric Gaussian with E[ G m 2 ]=1.
Flat Rayleigh fading Assume a single tap model with G 0,m = G m. Assume G m is circ. symmetric Gaussian with E[ G m 2 ]=1. The magnitude is Rayleigh with f Gm ( g ) =2 g exp{ g 2 } ; g 0 f( g ) g R(G m
More informationUNIVERSITY OF DUBLIN
UNIVERSITY OF DUBLIN TRINITY COLLEGE FACULTY OF ENGINEERING, MATHEMATICS & SCIENCE SCHOOL OF ENGINEERING Electronic & Electrical Engineering Junior Sophister Engineering Trinity Term, 2015 Annual Examinations
More informationA Systematic Description of Source Significance Information
A Systematic Description of Source Significance Information Norbert Goertz Institute for Digital Communications School of Engineering and Electronics The University of Edinburgh Mayfield Rd., Edinburgh
More informationThis research was partially supported by the Faculty Research and Development Fund of the University of North Carolina at Wilmington
LARGE SCALE GEOMETRIC PROGRAMMING: AN APPLICATION IN CODING THEORY Yaw O. Chang and John K. Karlof Mathematical Sciences Department The University of North Carolina at Wilmington This research was partially
More informationPerformance Analysis and Code Optimization of Low Density Parity-Check Codes on Rayleigh Fading Channels
Performance Analysis and Code Optimization of Low Density Parity-Check Codes on Rayleigh Fading Channels Jilei Hou, Paul H. Siegel and Laurence B. Milstein Department of Electrical and Computer Engineering
More information