A Simple Example Binary Hypothesis Testing Optimal Receiver Frontend M-ary Signal Sets Message Sequences. possible signals has been transmitted.
|
|
- Dustin Johnston
- 5 years ago
- Views:
Transcription
1 Introduction I We have focused on the problem of deciding which of two possible signals has been transmitted. I Binary Signal Sets I We will generalize the design of optimum (MPE) receivers to signal sets with M signals. I M-ary signal sets. I With binary signal sets one bit can be transmitted in each signal period T. I With M-ary signal sets, log (M) bits are transmitted simultaneously per T seconds. I Example (M = 4): 00! s 0 01! s 1 10! s 11! s 3 018, B.-P. Paris ECE 630: Statistical Communication Theory 191
2 M-ary Hypothesis Testing Problem I We can formulate the optimum receiver design problem as a hypothesis testing problem: H 0 : R t = s 0 +N t H 1 : R t = s 1 +N t. H M 1 : R t = s M 1 +N t with a priori probabilities p i = Pr{H i }, i = 0, 1,..., M 1. I Note: I With more than two hypotheses, it is no longer helpful to consider the (likelihood) ratio of pdfs. I Instead, we focus on the hypothesis with the maximum a posteriori (MAP) probability or the maximum likelihood (ML). 018, B.-P. Paris ECE 630: Statistical Communication Theory 19
3 AWGN Channels I Of most interest in communications are channels where N t is a white Gaussian noise process. I Spectral height N 0. I For these channels, the optimum receivers can be found by arguments completely analogous to those for the binary case. I Note that with M-ary signal sets, the subspace containing all signals will have up to M dimensions. I We will determine the optimum receivers by generalizing the optimum binary receivers for AWGN channels. 018, B.-P. Paris ECE 630: Statistical Communication Theory 193
4 Starting Point: Binary MPE Decision Rule I We have shown, that the binary MPE decision rule can be expressed equivalently as I either hr t, (s 1 s 0 )i H 1 N? 0 H 0 ln p0 + ks 1k ks 0 k p 1 I or kr t s 0 k N 0 ln(p 0 ) H 1? H 0 kr t s 1 k N 0 ln(p 1 ) I The first expression is most useful for deriving the structure of the optimum receiver. I The second form is helpful for interpreting the decision rule in signal space. 018, B.-P. Paris ECE 630: Statistical Communication Theory 194
5 M-ary MPE Receiver I The decision rule hr t, (s 1 s 0 )i H 1 N? 0 H 0 ln p0 + ks 1k ks 0 k p 1 can be rewritten as z } { N Z 1 = hr t, s 1 i+ 0 ln(p ks 1 k 1) g 1 H 1? H 0 hr t, s 0 i + N 0 ln(p ks 0 k 0) = Z 0 {z } g 0 018, B.-P. Paris ECE 630: Statistical Communication Theory 195
6 M-ary MPE Receiver I The decision rule is easily generalized to M signals: ˆm = arg max n=0,...,m 1 Z n z } { hr t, s n i + N 0 ln(p ks n k n) {z } g n I The optimum detector selects the hypothesis with the largest decision statistic Z n. 018, B.-P. Paris ECE 630: Statistical Communication Theory 196
7 M-ary MPE Receiver I The bias terms g n account for unequal priors and for differences in signal energy E n = ks n k. I Common terms can be omitted I For equally likely signals, I g n = ks nk. For equal energy signals, g n = N 0 ln(p n) I For equally likely, equal energy signal, g n = 0 018, B.-P. Paris ECE 630: Statistical Communication Theory 197
8 M-ary MPE Receiver M-ary Correlator Receiver R T 0 dt Z 0 s 0 R t. R T 0 dt g 0. Z M 1 arg max ˆm s M 1 g M 1 018, B.-P. Paris ECE 630: Statistical Communication Theory 198
9 Decision Statistics I The optimum receiver computes the decision statistics Z n = hr t, s n i + N 0 ln(p n) ks n k. I Conditioned on the m-th signal having been transmitted, I I All Z n are Gaussian random variables. Expected value: I E[Z n H m ]=hs m, s n i + N 0 ln(p n) (Co)Variance: ks n k E[Z j Z k H m ] E[Z j H m ]E[Z k H m ]=hs j, s k i N 0 018, B.-P. Paris ECE 630: Statistical Communication Theory 199
10 Exercise: QPSK Receiver I Find the optimum receiver for the following signal set with M = 4 signals: s n = r E T cos(pt/t + np/) for 0 apple t apple T and n = 0,..., 018, B.-P. Paris ECE 630: Statistical Communication Theory 00
11 Decision Regions I The decision regions G n and error probabilities are best understood by generalizing the binary decision rule: kr t s 0 k N 0 ln(p 0 ) H 1? H 0 kr t s 1 k N 0 ln(p 1 ) I For M-ary signal sets, the decision rule generalizes to ˆm = arg min kr t s n k N 0 ln(p n ). n=0,...,m 1 I I This simplifies to ˆm = arg min kr t s n k n=0,...,m 1 for equally likely signals. The optimum receiver decides in favor of the signal s n that is closest to the received signal. 018, B.-P. Paris ECE 630: Statistical Communication Theory 01
12 Decision Regions (equally likely signals) I For discussing decision regions, it is best to express the decision rule in terms of the representation obtained with the orthonormal basis {F k }, where I basis signals F k span the space that contains all signals s n, with n = 0,..., M 1. I I Recall that we can obtain these basis signals via the Gram-Schmidt procedure from the signal set. There are at most M orthonormal bases. I Because of Parseval s relationship, an equivalent decision rule is ˆm = arg min k ~ R ~s n k, n=0,...,m 1 where ~ R has elements Rk = hr t, F k i and~s n has element s n,k = hs n, F k i. 018, B.-P. Paris ECE 630: Statistical Communication Theory 0
13 Decision Regions I The decision region G n where the detector decides that the n-th signal was sent is G n = {~r : k~r ~s n k < k~r ~s m kfor all m 6= n}. I The decision region G n is the set of all points~r that are closer to~s n than to any other signal point. I The decision regions are formed by linear segments that are perpendicular bisectors between pairs of signal points. I The resulting partition is also called a Voronoi partition. 018, B.-P. Paris ECE 630: Statistical Communication Theory 03
14 Example: QPSK s 1 s Φ s s Φ 0 s n = p /T cos(pf c t + n p/ + p/4), for n = 0,..., , B.-P. Paris ECE 630: Statistical Communication Theory 04
15 Example: 8-PSK 1 s s 3 s Φ 1 0 s 4 s s 5 s s Φ 0 s n = p /T cos(pf c t + n p/4), for n = 0,..., , B.-P. Paris ECE 630: Statistical Communication Theory 05
16 Example: 16-QAM 4 3 s 3 s 7 s 11 s 15 1 s s 6 s 10 s 14 Φ s 1 s 5 s 9 s s 0 s 4 s 8 s Φ 0 s n = p /T (A I cos(pf c t)+a Q sin(pf c t)) with A I, A Q { 3, 1, 1, 3}. 018, B.-P. Paris ECE 630: Statistical Communication Theory 06
17 Symbol Energy and Bit Energy I We have seen that error probabilities decrease when the signal energy increases. I Because the distance between signals increase. I We will see further that error rates in AWGN channels depend only on I the signal-to-noise ratio E b N, where E 0 b is the average energy per bit, and I the geometry of the signal constellation. I To focus on the impact of the signal geometry, we will fix either I the average energy per symbol E s = M 1 ÂM 1 n=0 ks nk or I the average energy per bit E b = E s log (M) 018, B.-P. Paris ECE 630: Statistical Communication Theory 07
18 Example: QPSK I QPSK signals are given by s n = r Es T cos(pf ct + n p/ + p/4), for n = 0,..., 3. I Each of the four signals s n has energy E n = ks n k = E s. I Hence, I the average symbol energy is E s I the average bit energy is E b = E s log (4) = E s 018, B.-P. Paris ECE 630: Statistical Communication Theory 08
19 Example: 8-PSK I 8-PSK signals are given by s n = p E s /T cos(pf c t + n p/4), for n = 0,..., 7. I Each of the eight signals s n has energy E n = ks n k = E s. I Hence, I the average symbol energy is E s I the average bit energy is E b = E s log (8) = E s 3 018, B.-P. Paris ECE 630: Statistical Communication Theory 09
20 Example: 16-QAM I 16-QAM signals can be written as s n = r E0 T (a I cos(pf c t)+a Q sin(pf c t)) with a I, a Q { 3, 1, 1, 3}. I There are I Hence, I 4 signals with energy (1 + 1 )E 0 = E 0 I 8 signals with energy (3 + 1 )E 0 = 10E 0 I 4 signals with energy ((3 + 3 )E 0 = 18E 0 I the average symbol energy is 10E 0 I the average bit energy is E b = E s log (16) = 5E 0 018, B.-P. Paris ECE 630: Statistical Communication Theory 10
21 Energy Efficiency I We will see that the influence of the signal geometry is captured by the energy efficiency h P = d min E b where d min is the smallest distance between any pair of signals in the constellation. I Examples: I QPSK: d min = p E s and E b = E s, thus h P = 4. q p I 8-PSK: d min = ( )Es and E b = E s 3, thus p h P = 3 ( ) I 16-QAM: d min = p E 0 and E b = 5E 0, thus h P = 8 5. I Note that energy efficiency decreases with the size of the constellation for -dimensional constellations. 018, B.-P. Paris ECE 630: Statistical Communication Theory 11
22 Computing Probability of Symbol Error I When decision boundaries intersect at right angles, then it is possible to compute the error probability exactly in closed form. I The result will be in terms of the Q-function. I This happens whenever the signal points form a rectangular grid in signal space. I Examples: QPSK and 16-QAM I When decision regions are not rectangular, then closed form expressions are not available. I Computation requires integrals over the Q-function. I We will derive good bounds on the error rate for these cases. I For exact results, numerical integration is required. 018, B.-P. Paris ECE 630: Statistical Communication Theory 1
23 Illustration: -dimensional Rectangle I Assume that the n-th signal was transmitted and that the representation for this signal is~s n =(s n,0, s n,1 ) 0. I Assume that the decision region G n is a rectangle G n = {~r =(r 0, r 1 ) 0 :s n,0 a 1 < r 0 < s n,0 + a and s n,1 b 1 < r 1 < s n,1 + b }. I I Note: we have assumed that the sides of the rectangle are parallel to the axes in signal space. Since rotation and translation of signal space do not affect distances this can be done without affecting the error probability. I Question: What is the conditional error probability, assuming that s n was sent. 018, B.-P. Paris ECE 630: Statistical Communication Theory 13
24 Illustration: -dimensional Rectangle I In terms of the random variables R k = hr t, F k i, with k = 0, 1, an error occurs if z error event 1 } { (R 0 apple s n,0 a 1 or R 0 s n,0 + a ) or (R 1 apple s n,1 b 1 or R {z 1 s n,1 + b ). } error event I Note that the two error events are not mutually exclusive. I Therefore, it is better to consider correct decisions instead, i.e., ~ R Gn : s n,0 a 1 < R 0 < s n,0 + a and s n,1 b 1 < R 1 < s n,1 + b 018, B.-P. Paris ECE 630: Statistical Communication Theory 14
25 Illustration: -dimensional Rectangle I We know that R 0 and R 1 are I independent - because F k are orthogonal I with means s n,0 and s n,1, respectively I variance N 0. I Hence, the probability of a correct decision is Pr{c s n } = Pr{ a 1 < N 0 < a } Pr{ b 1 < N 1 < b } Z a = p R0 s n (r 0 ) dr 0 a 1 a1 =(1 Q p N0 / b1 (1 Q p N0 / Z b p R1 s n (r 1 ) dr 1 b 1 a Q p ) N0 / b Q p ). N0 / 018, B.-P. Paris ECE 630: Statistical Communication Theory 15
26 Exercise: QPSK I Find the error rate for the signal set s n = p E s /T cos(pf c t + n p/ + p/4), for n = 0,..., 3. I Answer: (Recall h P = d min E b = 4 for QPSK) s! s E s Pr{e} = Q Q N 0 = Q = Q s s E b N 0 h P E b N 0!! Q Q E s N 0! s! E b s N 0 h P E b N 0!. 018, B.-P. Paris ECE 630: Statistical Communication Theory 16
27 Exercise: 16-QAM = 8 5 (Recall h P = d min E b for 16-QAM) I Find the error rate for the signal set (a I, a Q { 3, 1, 1, 3}) s n = p E 0 /Ta I cos(pf c t)+ p E 0 /Ta Q sin(pf c t) I Answer: (h P = d min E b = 4) s! E Pr{e} = 0 3Q N 0 s! 4E = b 3Q 5N 0 s! h = P E b 3Q N Q 9 4 Q 9 4 Q s! E 0 N 0 s! 4E b 5N 0 s h P E b N 0!. 018, B.-P. Paris ECE 630: Statistical Communication Theory 17
Computing Probability of Symbol Error
Computing Probability of Symbol Error I When decision boundaries intersect at right angles, then it is possible to compute the error probability exactly in closed form. I The result will be in terms of
More informationECE 564/645 - Digital Communications, Spring 2018 Homework #2 Due: March 19 (In Lecture)
ECE 564/645 - Digital Communications, Spring 018 Homework # Due: March 19 (In Lecture) 1. Consider a binary communication system over a 1-dimensional vector channel where message m 1 is sent by signaling
More informationA Hilbert Space for Random Processes
Gaussian Basics Random Processes Filtering of Random Processes Signal Space Concepts A Hilbert Space for Random Processes I A vector space for random processes X t that is analogous to L 2 (a, b) is of
More informationDigital Transmission Methods S
Digital ransmission ethods S-7.5 Second Exercise Session Hypothesis esting Decision aking Gram-Schmidt method Detection.K.K. Communication Laboratory 5//6 Konstantinos.koufos@tkk.fi Exercise We assume
More informationA First Course in Digital Communications
A First Course in Digital Communications Ha H. Nguyen and E. Shwedyk February 9 A First Course in Digital Communications 1/46 Introduction There are benefits to be gained when M-ary (M = 4 signaling methods
More informationList Decoding: Geometrical Aspects and Performance Bounds
List Decoding: Geometrical Aspects and Performance Bounds Maja Lončar Department of Information Technology Lund University, Sweden Summer Academy: Progress in Mathematics for Communication Systems Bremen,
More informationECE 564/645 - Digital Communications, Spring 2018 Midterm Exam #1 March 22nd, 7:00-9:00pm Marston 220
ECE 564/645 - Digital Communications, Spring 08 Midterm Exam # March nd, 7:00-9:00pm Marston 0 Overview The exam consists of four problems for 0 points (ECE 564) or 5 points (ECE 645). The points for each
More informationPerformance of small signal sets
42 Chapter 5 Performance of small signal sets In this chapter, we show how to estimate the performance of small-to-moderate-sized signal constellations on the discrete-time AWGN channel. With equiprobable
More informationChapter 2 Signal Processing at Receivers: Detection Theory
Chapter Signal Processing at Receivers: Detection Theory As an application of the statistical hypothesis testing, signal detection plays a key role in signal processing at receivers of wireless communication
More informationSummary: SER formulation. Binary antipodal constellation. Generic binary constellation. Constellation gain. 2D constellations
TUTORIAL ON DIGITAL MODULATIONS Part 8a: Error probability A [2011-01-07] 07] Roberto Garello, Politecnico di Torino Free download (for personal use only) at: www.tlc.polito.it/garello 1 Part 8a: Error
More informationProblem Set 7 Due March, 22
EE16: Probability and Random Processes SP 07 Problem Set 7 Due March, Lecturer: Jean C. Walrand GSI: Daniel Preda, Assane Gueye Problem 7.1. Let u and v be independent, standard normal random variables
More informationPSK bit mappings with good minimax error probability
PSK bit mappings with good minimax error probability Erik Agrell Department of Signals and Systems Chalmers University of Technology 4196 Göteborg, Sweden Email: agrell@chalmers.se Erik G. Ström Department
More informationEE4304 C-term 2007: Lecture 17 Supplemental Slides
EE434 C-term 27: Lecture 17 Supplemental Slides D. Richard Brown III Worcester Polytechnic Institute, Department of Electrical and Computer Engineering February 5, 27 Geometric Representation: Optimal
More informationModulation & Coding for the Gaussian Channel
Modulation & Coding for the Gaussian Channel Trivandrum School on Communication, Coding & Networking January 27 30, 2017 Lakshmi Prasad Natarajan Dept. of Electrical Engineering Indian Institute of Technology
More informationDigital Modulation 1
Digital Modulation 1 Lecture Notes Ingmar Land and Bernard H. Fleury Navigation and Communications () Department of Electronic Systems Aalborg University, DK Version: February 5, 27 i Contents I Basic
More informationDigital Band-pass Modulation PROF. MICHAEL TSAI 2011/11/10
Digital Band-pass Modulation PROF. MICHAEL TSAI 211/11/1 Band-pass Signal Representation a t g t General form: 2πf c t + φ t g t = a t cos 2πf c t + φ t Envelope Phase Envelope is always non-negative,
More informationRandom Processes Why we Care
Random Processes Why we Care I Random processes describe signals that change randomly over time. I Compare: deterministic signals can be described by a mathematical expression that describes the signal
More informationUTA EE5362 PhD Diagnosis Exam (Spring 2011)
EE5362 Spring 2 PhD Diagnosis Exam ID: UTA EE5362 PhD Diagnosis Exam (Spring 2) Instructions: Verify that your exam contains pages (including the cover shee. Some space is provided for you to show your
More informationSection 6.2, 6.3 Orthogonal Sets, Orthogonal Projections
Section 6. 6. Orthogonal Sets Orthogonal Projections Main Ideas in these sections: Orthogonal set = A set of mutually orthogonal vectors. OG LI. Orthogonal Projection of y onto u or onto an OG set {u u
More informationLecture 8: Signal Detection and Noise Assumption
ECE 830 Fall 0 Statistical Signal Processing instructor: R. Nowak Lecture 8: Signal Detection and Noise Assumption Signal Detection : X = W H : X = S + W where W N(0, σ I n n and S = [s, s,..., s n ] T
More informationEE 574 Detection and Estimation Theory Lecture Presentation 8
Lecture Presentation 8 Aykut HOCANIN Dept. of Electrical and Electronic Engineering 1/14 Chapter 3: Representation of Random Processes 3.2 Deterministic Functions:Orthogonal Representations For a finite-energy
More informationSummary II: Modulation and Demodulation
Summary II: Modulation and Demodulation Instructor : Jun Chen Department of Electrical and Computer Engineering, McMaster University Room: ITB A1, ext. 0163 Email: junchen@mail.ece.mcmaster.ca Website:
More informationThis examination consists of 11 pages. Please check that you have a complete copy. Time: 2.5 hrs INSTRUCTIONS
THE UNIVERSITY OF BRITISH COLUMBIA Department of Electrical and Computer Engineering EECE 564 Detection and Estimation of Signals in Noise Final Examination 6 December 2006 This examination consists of
More informationMapper & De-Mapper System Document
Mapper & De-Mapper System Document Mapper / De-Mapper Table of Contents. High Level System and Function Block. Mapper description 2. Demodulator Function block 2. Decoder block 2.. De-Mapper 2..2 Implementation
More informationProblem Set 3 Due Oct, 5
EE6: Random Processes in Systems Lecturer: Jean C. Walrand Problem Set 3 Due Oct, 5 Fall 6 GSI: Assane Gueye This problem set essentially reviews detection theory. Not all eercises are to be turned in.
More informationLecture 7. Union bound for reducing M-ary to binary hypothesis testing
Lecture 7 Agenda for the lecture M-ary hypothesis testing and the MAP rule Union bound for reducing M-ary to binary hypothesis testing Introduction of the channel coding problem 7.1 M-ary hypothesis testing
More information8 Basics of Hypothesis Testing
8 Basics of Hypothesis Testing 4 Problems Problem : The stochastic signal S is either 0 or E with equal probability, for a known value E > 0. Consider an observation X = x of the stochastic variable X
More informationProblem Set 2. MAS 622J/1.126J: Pattern Recognition and Analysis. Due: 5:00 p.m. on September 30
Problem Set 2 MAS 622J/1.126J: Pattern Recognition and Analysis Due: 5:00 p.m. on September 30 [Note: All instructions to plot data or write a program should be carried out using Matlab. In order to maintain
More informationa) Find the compact (i.e. smallest) basis set required to ensure sufficient statistics.
Digital Modulation and Coding Tutorial-1 1. Consider the signal set shown below in Fig.1 a) Find the compact (i.e. smallest) basis set required to ensure sufficient statistics. b) What is the minimum Euclidean
More informationSTOCHASTIC PROCESSES, DETECTION AND ESTIMATION Course Notes
STOCHASTIC PROCESSES, DETECTION AND ESTIMATION 6.432 Course Notes Alan S. Willsky, Gregory W. Wornell, and Jeffrey H. Shapiro Department of Electrical Engineering and Computer Science Massachusetts Institute
More information392D: Coding for the AWGN Channel Wednesday, January 24, 2007 Stanford, Winter 2007 Handout #6. Problem Set 2 Solutions
392D: Coding for the AWGN Channel Wednesday, January 24, 2007 Stanford, Winter 2007 Handout #6 Problem Set 2 Solutions Problem 2.1 (Cartesian-product constellations) (a) Show that if A is a K-fold Cartesian
More informationEE6604 Personal & Mobile Communications. Week 15. OFDM on AWGN and ISI Channels
EE6604 Personal & Mobile Communications Week 15 OFDM on AWGN and ISI Channels 1 { x k } x 0 x 1 x x x N- 2 N- 1 IDFT X X X X 0 1 N- 2 N- 1 { X n } insert guard { g X n } g X I n { } D/A ~ si ( t) X g X
More informationECE531 Lecture 2b: Bayesian Hypothesis Testing
ECE531 Lecture 2b: Bayesian Hypothesis Testing D. Richard Brown III Worcester Polytechnic Institute 29-January-2009 Worcester Polytechnic Institute D. Richard Brown III 29-January-2009 1 / 39 Minimizing
More informationThis examination consists of 10 pages. Please check that you have a complete copy. Time: 2.5 hrs INSTRUCTIONS
THE UNIVERSITY OF BRITISH COLUMBIA Department of Electrical and Computer Engineering EECE 564 Detection and Estimation of Signals in Noise Final Examination 08 December 2009 This examination consists of
More informationEstimation techniques
Estimation techniques March 2, 2006 Contents 1 Problem Statement 2 2 Bayesian Estimation Techniques 2 2.1 Minimum Mean Squared Error (MMSE) estimation........................ 2 2.1.1 General formulation......................................
More informationBASICS OF DETECTION AND ESTIMATION THEORY
BASICS OF DETECTION AND ESTIMATION THEORY 83050E/158 In this chapter we discuss how the transmitted symbols are detected optimally from a noisy received signal (observation). Based on these results, optimal
More informationDiversity Performance of a Practical Non-Coherent Detect-and-Forward Receiver
Diversity Performance of a Practical Non-Coherent Detect-and-Forward Receiver Michael R. Souryal and Huiqing You National Institute of Standards and Technology Advanced Network Technologies Division Gaithersburg,
More informationChapter 7: Channel coding:convolutional codes
Chapter 7: : Convolutional codes University of Limoges meghdadi@ensil.unilim.fr Reference : Digital communications by John Proakis; Wireless communication by Andreas Goldsmith Encoder representation Communication
More informationGEORGIA INSTITUTE OF TECHNOLOGY SCHOOL OF ELECTRICAL AND COMPUTER ENGINEERING Final Examination - Fall 2015 EE 4601: Communication Systems
GEORGIA INSTITUTE OF TECHNOLOGY SCHOOL OF ELECTRICAL AND COMPUTER ENGINEERING Final Examination - Fall 2015 EE 4601: Communication Systems Aids Allowed: 2 8 1/2 X11 crib sheets, calculator DATE: Tuesday
More informationChapter 7. Error Control Coding. 7.1 Historical background. Mikael Olofsson 2005
Chapter 7 Error Control Coding Mikael Olofsson 2005 We have seen in Chapters 4 through 6 how digital modulation can be used to control error probabilities. This gives us a digital channel that in each
More informationAnalysis of Minimum Hellinger Distance Identification for Digital Phase Modulation
Analysis of Minimum Hellinger Distance Identification for Digital Phase Modulation Kenta Umebayashi, Janne Lehtomäki and Keijo Ruotsalainen Centre for Wireless Communications, University of Oulu P. O.
More informationThe Gram Schmidt Process
u 2 u The Gram Schmidt Process Now we will present a procedure, based on orthogonal projection, that converts any linearly independent set of vectors into an orthogonal set. Let us begin with the simple
More informationThe Gram Schmidt Process
The Gram Schmidt Process Now we will present a procedure, based on orthogonal projection, that converts any linearly independent set of vectors into an orthogonal set. Let us begin with the simple case
More informationParameter Estimation
1 / 44 Parameter Estimation Saravanan Vijayakumaran sarva@ee.iitb.ac.in Department of Electrical Engineering Indian Institute of Technology Bombay October 25, 2012 Motivation System Model used to Derive
More informationECE 521. Lecture 11 (not on midterm material) 13 February K-means clustering, Dimensionality reduction
ECE 521 Lecture 11 (not on midterm material) 13 February 2017 K-means clustering, Dimensionality reduction With thanks to Ruslan Salakhutdinov for an earlier version of the slides Overview K-means clustering
More informationMath 261 Lecture Notes: Sections 6.1, 6.2, 6.3 and 6.4 Orthogonal Sets and Projections
Math 6 Lecture Notes: Sections 6., 6., 6. and 6. Orthogonal Sets and Projections We will not cover general inner product spaces. We will, however, focus on a particular inner product space the inner product
More informationChapter [4] "Operations on a Single Random Variable"
Chapter [4] "Operations on a Single Random Variable" 4.1 Introduction In our study of random variables we use the probability density function or the cumulative distribution function to provide a complete
More informationSupplementary Figure 1: Scheme of the RFT. (a) At first, we separate two quadratures of the field (denoted by and ); (b) then, each quadrature
Supplementary Figure 1: Scheme of the RFT. (a At first, we separate two quadratures of the field (denoted by and ; (b then, each quadrature undergoes a nonlinear transformation, which results in the sine
More information8 PAM BER/SER Monte Carlo Simulation
xercise.1 8 PAM BR/SR Monte Carlo Simulation - Simulate a 8 level PAM communication system and calculate bit and symbol error ratios (BR/SR). - Plot the calculated and simulated SR and BR curves. - Plot
More informationFundamentals of Statistical Signal Processing Volume II Detection Theory
Fundamentals of Statistical Signal Processing Volume II Detection Theory Steven M. Kay University of Rhode Island PH PTR Prentice Hall PTR Upper Saddle River, New Jersey 07458 http://www.phptr.com Contents
More informationLecture 5: Likelihood ratio tests, Neyman-Pearson detectors, ROC curves, and sufficient statistics. 1 Executive summary
ECE 830 Spring 207 Instructor: R. Willett Lecture 5: Likelihood ratio tests, Neyman-Pearson detectors, ROC curves, and sufficient statistics Executive summary In the last lecture we saw that the likelihood
More informationEE456 Digital Communications
EE456 Digital Communications Professor Ha Nguyen September 5 EE456 Digital Communications Block Diagram of Binary Communication Systems m ( t { b k } b k = s( t b = s ( t k m ˆ ( t { bˆ } k r( t Bits in
More informationChapter 2. Binary and M-ary Hypothesis Testing 2.1 Introduction (Levy 2.1)
Chapter 2. Binary and M-ary Hypothesis Testing 2.1 Introduction (Levy 2.1) Detection problems can usually be casted as binary or M-ary hypothesis testing problems. Applications: This chapter: Simple hypothesis
More information2. What are the tradeoffs among different measures of error (e.g. probability of false alarm, probability of miss, etc.)?
ECE 830 / CS 76 Spring 06 Instructors: R. Willett & R. Nowak Lecture 3: Likelihood ratio tests, Neyman-Pearson detectors, ROC curves, and sufficient statistics Executive summary In the last lecture we
More informationLecture 12. Block Diagram
Lecture 12 Goals Be able to encode using a linear block code Be able to decode a linear block code received over a binary symmetric channel or an additive white Gaussian channel XII-1 Block Diagram Data
More informationDetection and Estimation Theory
ESE 524 Detection and Estimation Theory Joseph A. O Sullivan Samuel C. Sachs Professor Electronic Systems and Signals Research Laboratory Electrical and Systems Engineering Washington University 2 Urbauer
More informationBayesian Decision Theory
Bayesian Decision Theory Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr CS 551, Fall 2017 CS 551, Fall 2017 c 2017, Selim Aksoy (Bilkent University) 1 / 46 Bayesian
More informationρ = sin(2π ft) 2π ft To find the minimum value of the correlation, we set the derivative of ρ with respect to f equal to zero.
Problem 5.1 : The correlation of the two signals in binary FSK is: ρ = sin(π ft) π ft To find the minimum value of the correlation, we set the derivative of ρ with respect to f equal to zero. Thus: ϑρ
More informationThese outputs can be written in a more convenient form: with y(i) = Hc m (i) n(i) y(i) = (y(i); ; y K (i)) T ; c m (i) = (c m (i); ; c m K(i)) T and n
Binary Codes for synchronous DS-CDMA Stefan Bruck, Ulrich Sorger Institute for Network- and Signal Theory Darmstadt University of Technology Merckstr. 25, 6428 Darmstadt, Germany Tel.: 49 65 629, Fax:
More informationGaussian Random Variables Why we Care
Gaussian Random Variables Why we Care I Gaussian random variables play a critical role in modeling many random phenomena. I By central limit theorem, Gaussian random variables arise from the superposition
More informationRapport technique #INRS-EMT Exact Expression for the BER of Rectangular QAM with Arbitrary Constellation Mapping
Rapport technique #INRS-EMT-010-0604 Exact Expression for the BER of Rectangular QAM with Arbitrary Constellation Mapping Leszek Szczeciński, Cristian González, Sonia Aïssa Institut National de la Recherche
More informationElectrical Engineering Written PhD Qualifier Exam Spring 2014
Electrical Engineering Written PhD Qualifier Exam Spring 2014 Friday, February 7 th 2014 Please do not write your name on this page or any other page you submit with your work. Instead use the student
More informationEE6604 Personal & Mobile Communications. Week 13. Multi-antenna Techniques
EE6604 Personal & Mobile Communications Week 13 Multi-antenna Techniques 1 Diversity Methods Diversity combats fading by providing the receiver with multiple uncorrelated replicas of the same information
More informationANALYSIS OF A PARTIAL DECORRELATOR IN A MULTI-CELL DS/CDMA SYSTEM
ANAYSIS OF A PARTIA DECORREATOR IN A MUTI-CE DS/CDMA SYSTEM Mohammad Saquib ECE Department, SU Baton Rouge, A 70803-590 e-mail: saquib@winlab.rutgers.edu Roy Yates WINAB, Rutgers University Piscataway
More informationLecture 15: Thu Feb 28, 2019
Lecture 15: Thu Feb 28, 2019 Announce: HW5 posted Lecture: The AWGN waveform channel Projecting temporally AWGN leads to spatially AWGN sufficiency of projection: irrelevancy theorem in waveform AWGN:
More informationEs e j4φ +4N n. 16 KE s /N 0. σ 2ˆφ4 1 γ s. p(φ e )= exp 1 ( 2πσ φ b cos N 2 φ e 0
Problem 6.15 : he received signal-plus-noise vector at the output of the matched filter may be represented as (see (5-2-63) for example) : r n = E s e j(θn φ) + N n where θ n =0,π/2,π,3π/2 for QPSK, and
More informationECE531 Screencast 9.2: N-P Detection with an Infinite Number of Possible Observations
ECE531 Screencast 9.2: N-P Detection with an Infinite Number of Possible Observations D. Richard Brown III Worcester Polytechnic Institute Worcester Polytechnic Institute D. Richard Brown III 1 / 7 Neyman
More informationSolutions to Selected Problems
Solutions to Selected Problems from Madhow: Fundamentals of Digital Communication and from Johannesson & Zigangirov: Fundamentals of Convolutional Coding Saif K. Mohammed Department of Electrical Engineering
More information[y i α βx i ] 2 (2) Q = i=1
Least squares fits This section has no probability in it. There are no random variables. We are given n points (x i, y i ) and want to find the equation of the line that best fits them. We take the equation
More informationON DECREASING THE COMPLEXITY OF LATTICE-REDUCTION-AIDED K-BEST MIMO DETECTORS.
17th European Signal Processing Conference (EUSIPCO 009) Glasgow, Scotland, August 4-8, 009 ON DECREASING THE COMPLEXITY OF LATTICE-REDUCTION-AIDED K-BEST MIMO DETECTORS. Sandra Roger, Alberto Gonzalez,
More informationCHANNEL CAPACITY CALCULATIONS FOR M ARY N DIMENSIONAL SIGNAL SETS
THE UNIVERSITY OF SOUTH AUSTRALIA SCHOOL OF ELECTRONIC ENGINEERING CHANNEL CAPACITY CALCULATIONS FOR M ARY N DIMENSIONAL SIGNAL SETS Philip Edward McIllree, B.Eng. A thesis submitted in fulfilment of the
More informationDS-GA 1002 Lecture notes 10 November 23, Linear models
DS-GA 2 Lecture notes November 23, 2 Linear functions Linear models A linear model encodes the assumption that two quantities are linearly related. Mathematically, this is characterized using linear functions.
More informationData Detection for Controlled ISI. h(nt) = 1 for n=0,1 and zero otherwise.
Data Detection for Controlled ISI *Symbol by symbol suboptimum detection For the duobinary signal pulse h(nt) = 1 for n=0,1 and zero otherwise. The samples at the output of the receiving filter(demodulator)
More informationarxiv:cs/ v1 [cs.it] 11 Sep 2006
0 High Date-Rate Single-Symbol ML Decodable Distributed STBCs for Cooperative Networks arxiv:cs/0609054v1 [cs.it] 11 Sep 2006 Zhihang Yi and Il-Min Kim Department of Electrical and Computer Engineering
More informationApplications of Lattices in Telecommunications
Applications of Lattices in Telecommunications Dept of Electrical and Computer Systems Engineering Monash University amin.sakzad@monash.edu Oct. 2013 1 Sphere Decoder Algorithm Rotated Signal Constellations
More informationDETECTION theory deals primarily with techniques for
ADVANCED SIGNAL PROCESSING SE Optimum Detection of Deterministic and Random Signals Stefan Tertinek Graz University of Technology turtle@sbox.tugraz.at Abstract This paper introduces various methods for
More informationTrellis Coded Modulation
Trellis Coded Modulation Trellis coded modulation (TCM) is a marriage between codes that live on trellises and signal designs We have already seen that trellises are the preferred way to view convolutional
More informationExercise 1. = P(y a 1)P(a 1 )
Chapter 7 Channel Capacity Exercise 1 A source produces independent, equally probable symbols from an alphabet {a 1, a 2 } at a rate of one symbol every 3 seconds. These symbols are transmitted over a
More informationChapter 6: Orthogonality
Chapter 6: Orthogonality (Last Updated: November 7, 7) These notes are derived primarily from Linear Algebra and its applications by David Lay (4ed). A few theorems have been moved around.. Inner products
More informationLayered Orthogonal Lattice Detector for Two Transmit Antenna Communications
Layered Orthogonal Lattice Detector for Two Transmit Antenna Communications arxiv:cs/0508064v1 [cs.it] 12 Aug 2005 Massimiliano Siti Advanced System Technologies STMicroelectronics 20041 Agrate Brianza
More informationEE 121: Introduction to Digital Communication Systems. 1. Consider the following discrete-time communication system. There are two equallly likely
EE 11: Introduction to Digital Communication Systems Midterm Solutions 1. Consider the following discrete-time communication system. There are two equallly likely messages to be transmitted, and they are
More informationE&CE 358, Winter 2016: Solution #2. Prof. X. Shen
E&CE 358, Winter 16: Solution # Prof. X. Shen Email: xshen@bbcr.uwaterloo.ca Prof. X. Shen E&CE 358, Winter 16 ( 1:3-:5 PM: Solution # Problem 1 Problem 1 The signal g(t = e t, t T is corrupted by additive
More informationRevision of Lecture 5
Revision of Lecture 5 Information transferring across channels Channel characteristics and binary symmetric channel Average mutual information Average mutual information tells us what happens to information
More informationLecture 10: Vector Algebra: Orthogonal Basis
Lecture 0: Vector Algebra: Orthogonal Basis Orthogonal Basis of a subspace Computing an orthogonal basis for a subspace using Gram-Schmidt Orthogonalization Process Orthogonal Set Any set of vectors that
More informationLattices and Lattice Codes
Lattices and Lattice Codes Trivandrum School on Communication, Coding & Networking January 27 30, 2017 Lakshmi Prasad Natarajan Dept. of Electrical Engineering Indian Institute of Technology Hyderabad
More informationRepresenting Group Codes as Permutation Codes
Representing Group Codes as Permutation Codes Ezio Biglieri John K. Karlof Emanuele Viterbo November 19, 001 Abstract Given an abstract group G, an N dimensional orthogonal matrix representation G of G,
More informationNotes on a posteriori probability (APP) metrics for LDPC
Notes on a posteriori probability (APP) metrics for LDPC IEEE 802.3an Task Force November, 2004 Raju Hormis, Xiaodong Wang Columbia University, NY e-mail: raju@ee.columbia.edu Outline Section 55.3.11.3
More informationAppendix B Information theory from first principles
Appendix B Information theory from first principles This appendix discusses the information theory behind the capacity expressions used in the book. Section 8.3.4 is the only part of the book that supposes
More informationIntroduction to Machine Learning Spring 2018 Note 18
CS 189 Introduction to Machine Learning Spring 2018 Note 18 1 Gaussian Discriminant Analysis Recall the idea of generative models: we classify an arbitrary datapoint x with the class label that maximizes
More informationUCSD ECE153 Handout #40 Prof. Young-Han Kim Thursday, May 29, Homework Set #8 Due: Thursday, June 5, 2011
UCSD ECE53 Handout #40 Prof. Young-Han Kim Thursday, May 9, 04 Homework Set #8 Due: Thursday, June 5, 0. Discrete-time Wiener process. Let Z n, n 0 be a discrete time white Gaussian noise (WGN) process,
More informationDetection and Estimation Theory
ESE 54 Detection and Estimation heory Joseph A. O Sullivan Samuel C. Sachs Professor Electronic Systems and Signals Research Laboratory Electrical and Systems Engineering Washington University Urbauer
More information2. SPECTRAL ANALYSIS APPLIED TO STOCHASTIC PROCESSES
2. SPECTRAL ANALYSIS APPLIED TO STOCHASTIC PROCESSES 2.0 THEOREM OF WIENER- KHINTCHINE An important technique in the study of deterministic signals consists in using harmonic functions to gain the spectral
More informationLECTURE 16 AND 17. Digital signaling on frequency selective fading channels. Notes Prepared by: Abhishek Sood
ECE559:WIRELESS COMMUNICATION TECHNOLOGIES LECTURE 16 AND 17 Digital signaling on frequency selective fading channels 1 OUTLINE Notes Prepared by: Abhishek Sood In section 2 we discuss the receiver design
More informationThe Performance of Quaternary Amplitude Modulation with Quaternary Spreading in the Presence of Interfering Signals
Clemson University TigerPrints All Theses Theses 1-015 The Performance of Quaternary Amplitude Modulation with Quaternary Spreading in the Presence of Interfering Signals Allison Manhard Clemson University,
More informationMITOCW ocw-6-451_ feb k_512kb-mp4
MITOCW ocw-6-451_4-261-09feb2005-220k_512kb-mp4 And what we saw was the performance was quite different in the two regimes. In power-limited regime, typically our SNR is much smaller than one, whereas
More informationMTH 2310, FALL Introduction
MTH 2310, FALL 2011 SECTION 6.2: ORTHOGONAL SETS Homework Problems: 1, 5, 9, 13, 17, 21, 23 1, 27, 29, 35 1. Introduction We have discussed previously the benefits of having a set of vectors that is linearly
More informationSOLUTIONS TO ECE 6603 ASSIGNMENT NO. 6
SOLUTIONS TO ECE 6603 ASSIGNMENT NO. 6 PROBLEM 6.. Consider a real-valued channel of the form r = a h + a h + n, which is a special case of the MIMO channel considered in class but with only two inputs.
More informationELEG 5633 Detection and Estimation Signal Detection: Deterministic Signals
ELEG 5633 Detection and Estimation Signal Detection: Deterministic Signals Jingxian Wu Department of Electrical Engineering University of Arkansas Outline Matched Filter Generalized Matched Filter Signal
More informationLinear Models Review
Linear Models Review Vectors in IR n will be written as ordered n-tuples which are understood to be column vectors, or n 1 matrices. A vector variable will be indicted with bold face, and the prime sign
More informationECE 630: Statistical Communication Theory
ECE 630: Statistical Communication Theory Dr. B.-P. Paris Dept. Electrical and Comp. Engineering George Mason University Last updated: April 6, 2017 2017, B.-P. Paris ECE 630: Statistical Communication
More information