Detection theory 101 ELEC-E5410 Signal Processing for Communications

Similar documents
Detection Theory. Chapter 3. Statistical Decision Theory I. Isael Diaz Oct 26th 2010

Detection theory. H 0 : x[n] = w[n]

Introduction to Statistical Inference

PATTERN RECOGNITION AND MACHINE LEARNING

Fundamentals of Statistical Signal Processing Volume II Detection Theory

DETECTION theory deals primarily with techniques for

F2E5216/TS1002 Adaptive Filtering and Change Detection. Course Organization. Lecture plan. The Books. Lecture 1

10. Composite Hypothesis Testing. ECE 830, Spring 2014

Composite Hypotheses and Generalized Likelihood Ratio Tests

Estimation and Detection

Detection Theory. Composite tests

ECE531 Lecture 6: Detection of Discrete-Time Signals with Random Parameters

Lecture 8: Information Theory and Statistics

SYDE 372 Introduction to Pattern Recognition. Probability Measures for Classification: Part I

Definition 3.1 A statistical hypothesis is a statement about the unknown values of the parameters of the population distribution.

Introduction to Detection Theory

STONY BROOK UNIVERSITY. CEAS Technical Report 829

An Invariance Property of the Generalized Likelihood Ratio Test

Introduction to Signal Detection and Classification. Phani Chavali

Chapter 2. Binary and M-ary Hypothesis Testing 2.1 Introduction (Levy 2.1)

Lecture 5: Likelihood ratio tests, Neyman-Pearson detectors, ROC curves, and sufficient statistics. 1 Executive summary

APPENDIX 1 NEYMAN PEARSON CRITERIA

Bayesian Decision Theory

Detection and Estimation Theory

Lecture 8: Information Theory and Statistics

2. What are the tradeoffs among different measures of error (e.g. probability of false alarm, probability of miss, etc.)?

Hypothesis Testing - Frequentist

ELEG 5633 Detection and Estimation Signal Detection: Deterministic Signals

EIE6207: Estimation Theory

Parametric Models. Dr. Shuang LIANG. School of Software Engineering TongJi University Fall, 2012

Digital Transmission Methods S

Novel spectrum sensing schemes for Cognitive Radio Networks

Detection and Estimation Theory

ECE531 Lecture 4b: Composite Hypothesis Testing

Detecting Parametric Signals in Noise Having Exactly Known Pdf/Pmf

Two results in statistical decision theory for detecting signals with unknown distributions and priors in white Gaussian noise.

Algorithmisches Lernen/Machine Learning

Signal Detection Basics - CFAR

Use of Wijsman's Theorem for the Ratio of Maximal Invariant Densities in Signal Detection Applications

Lecture 8: Signal Detection and Noise Assumption

Detection and Estimation Theory

University of Cambridge Engineering Part IIB Module 3F3: Signal and Pattern Processing Handout 2:. The Multivariate Gaussian & Decision Boundaries

Chapter 2 Signal Processing at Receivers: Detection Theory

Lecture 22: Error exponents in hypothesis testing, GLRT

Problem Set 2. MAS 622J/1.126J: Pattern Recognition and Analysis. Due: 5:00 p.m. on September 30

EECS564 Estimation, Filtering, and Detection Exam 2 Week of April 20, 2015

EIE6207: Maximum-Likelihood and Bayesian Estimation

Detection and Estimation Chapter 1. Hypothesis Testing

Introduction to Machine Learning

UNIFORMLY MOST POWERFUL CYCLIC PERMUTATION INVARIANT DETECTION FOR DISCRETE-TIME SIGNALS

Lecture 3. STAT161/261 Introduction to Pattern Recognition and Machine Learning Spring 2018 Prof. Allie Fletcher

If there exists a threshold k 0 such that. then we can take k = k 0 γ =0 and achieve a test of size α. c 2004 by Mark R. Bell,

Outline. Detection Theory. NonGaussian NoiseCharacteristics. Example: Kurtosis: Chapter 10: NonGaussian Noise Reza Meraji Dec. 14, 2010.

Bayesian Decision Theory

TUTORIAL 8 SOLUTIONS #

Topic 3: Hypothesis Testing

Asymptotically Optimal Detection of Low Probability of Intercept Signals using Distributed Sensors

Machine Learning Linear Classification. Prof. Matteo Matteucci

Lecture 7 Introduction to Statistical Decision Theory

Bayesian Decision Theory

Hypothesis Testing: The Generalized Likelihood Ratio Test

Introduction to Machine Learning. Maximum Likelihood and Bayesian Inference. Lecturers: Eran Halperin, Yishay Mansour, Lior Wolf

ECE521 Lecture7. Logistic Regression

Introduction to Machine Learning

Fundamental limits on detection in low SNR. Rahul Tandra. B.tech. (Indian Institute of Technology, Bombay) 2003

Rowan University Department of Electrical and Computer Engineering

Ch. 5 Hypothesis Testing

Chapter 9: Hypothesis Testing Sections

Announcements. Proposals graded

Multimodal Moving Target Detection and Data Processing Via Distributed Sensors

ECE531 Screencast 11.4: Composite Neyman-Pearson Hypothesis Testing

EXTENDED GLRT DETECTORS OF CORRELATION AND SPHERICITY: THE UNDERSAMPLED REGIME. Xavier Mestre 1, Pascal Vallet 2

Machine Learning, Midterm Exam: Spring 2009 SOLUTION

Minimum Error-Rate Discriminant

ECE531 Lecture 13: Sequential Detection of Discrete-Time Signals

ORF 245 Fundamentals of Statistics Chapter 9 Hypothesis Testing

Detection & Estimation Lecture 1

Optimum Joint Detection and Estimation

COM336: Neural Computing

CFAR TARGET DETECTION IN TREE SCATTERING INTERFERENCE

CS281 Section 4: Factor Analysis and PCA

Primer on statistics:

Review. December 4 th, Review

Maximum Likelihood Estimation. only training data is available to design a classifier

Performance Evaluation and Comparison

Maximum Likelihood Estimation

Bayesian inference J. Daunizeau

Error Rates. Error vs Threshold. ROC Curve. Biometrics: A Pattern Recognition System. Pattern classification. Biometrics CSE 190 Lecture 3

ADAPTIVE CLUSTERING ALGORITHM FOR COOPERATIVE SPECTRUM SENSING IN MOBILE ENVIRONMENTS. Jesus Perez and Ignacio Santamaria

Introduction to Machine Learning. Maximum Likelihood and Bayesian Inference. Lecturers: Eran Halperin, Lior Wolf

Signal Activity Detection of Phase-Shift Keying Signals

A6523 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Spring

Detection & Estimation Lecture 1

STATS 200: Introduction to Statistical Inference. Lecture 29: Course review

Learning P-maps Param. Learning

Evidence Theory based Cooperative Energy Detection under Noise Uncertainty

40.530: Statistics. Professor Chen Zehua. Singapore University of Design and Technology

Hypothesis Testing. Testing Hypotheses MIT Dr. Kempthorne. Spring MIT Testing Hypotheses

TARGET DETECTION WITH FUNCTION OF COVARIANCE MATRICES UNDER CLUTTER ENVIRONMENT

CONSIDER two companion problems: Separating Function Estimation Tests: A New Perspective on Binary Composite Hypothesis Testing

Transcription:

Detection theory 101 ELEC-E5410 Signal Processing for Communications

Binary hypothesis testing Null hypothesis H 0 : e.g. noise only Alternative hypothesis H 1 : signal + noise p(x;h 0 ) γ p(x;h 1 ) Trade-off between Probability of false alarm (decide H 1 when H 0 is true) Miss Both depend on threshold γ P FA Inspired by S.M. Kay, Fundamentals of statistical signal processing. Detection theory, Prentice-Hall, 1998

Likelihood ratio/neyman-pearson test For a given false alarm rate P FA, the probability of detection P D is maximized with the likelihood ratio test where the threshold γ is Assumes that the PDFs p(.) are completely known R.W. 3

Detection of constant signal level in white Gaussian noise (WGN) using N samples Formulas to calculate detection and false alarm probabilities R.W. 4

Receiver operation characteristics (ROC) Way to measure the performance of detectors The performance of a detector is always above the diagonal, because the diagonal is the same as guessing ROC for a constant signal in WGN R.W. 5

Bayesian detector Another, probabilistic, approach for detection Assign prior probabilities to events (if possible) and minimize the probability of error Bayesian detector becomes R.W. 6

Bayesian detector Assign costs to the decisions and minimize Bayes risk where C ij is the cost of deciding H i when H j is the true event Bayesian detector Assumes perfect knowledge of PDFs, probabilities and risks 7

Generalized likelihood ratio test (GLRT) Decide between H 1 and H 0 when parameters of the PDFs depend on the set of unknown parameters θ i Unknown parameters are estimated by maximum-likelihood estimation and substituted in the generalized likelihood ratio There is no optimality associated to GLRT, but it works often well in practise 8

Generalized likelihood ratio test (GLRT) Another form of GLRT is Special case when the PDF under H 0 is completely known (e.g. H 0 is noise only hypothesis and noise power is known) L G (x) =max 1 p(x; ˆ 1, H 1 ) p(x; 0, H 0 ) > 9

Uniformly most powerful test (UMP) Uniformly most powerful test (UMP) yields the highest probability of detection for any signal parameter, say, A For UMP, test statistic and threshold must be found without the knowledge of A For UMP to exist the parameter test must be one-sided One-sided: Two-sided: 10

Bayesian approach Unknown parameters are considered as realizations of random variables and prior PDFs are assigned to them Requires prior knowledge of unknown parameters whereas GLRT does not Requires multidimensional integration over unknown parameters 11

Example: unknown signal in WGN GLRT approach: MLE estimate of the unknown signal s[n] is clearly x[n] The test becomes This is simply the energy detector 12

Example: known signal in WGN with unknown amplitude The detector becomes The detector is simply a correlator 13

Example: known in signal in WGN with unknown amplitude Threshold seems to depend on the amplitude so th test does not look UMP However H 0 is noise only and therefore Given P FA the threshold is independent of A If the sign of the amplitude is known, the test is UMP If the sign is unknown the test is GLRT and MLE of A is 14

Example: sinusoidal signal in WGN Unknown amplitude, known frequency and phase: Unknown amplitude, known frequency and unknown phase: P P Unknown arrival time: Determine MLE of the timing NX 1 max s[n]x[n ] n=0 Unknown frequency: Estimate frequency as the max. peak of the periodogram 15