Plug-in Measure-Transformed Quasi Likelihood Ratio Test for Random Signal Detection

Size: px
Start display at page:

Download "Plug-in Measure-Transformed Quasi Likelihood Ratio Test for Random Signal Detection"

Transcription

1 Plug-in Measure-Transformed Quasi Likelihood Ratio Test for Random Signal Detection Nir Halay and Koby Todros Dept. of ECE, Ben-Gurion University of the Negev, Beer-Sheva, Israel February 13, / 20

2 Outline Detection problem formulation Existing detectors Proposed detector Simulation studies Summary 2 / 20

3 Detection Problem Formulation H 0 : H 1 : { Xn = W n, n = 1,..., N Y m = W m (s), m = 1,..., M { Xn = S n a + W n, n = 1,..., N Y m = W m (s), m = 1,..., M, {X n C p }, {Y m C p }: Primary and secondary data {S n C}: i.i.d. zero-mean signal with unknown distribution a C p : Known steering vector {W n }, {W (s) m }: i.i.d. zero-mean symmetrically distributed homogeneous noise processes with unknown distribution {S n }, {W n } and {W (s) m } are mutually independent 3 / 20

4 Existing detectors Gauss-Gauss detector [Jin & Friedlander 2005] GLRT-based detector Assumes normally distributed signal and noise Simple implementation and tractable performance analysis Sensitive to deviation from normality (e.g., in the case of heavy-tailed noise that produces outliers) 4 / 20

5 Existing detectors CG-GLRT [Gerlach 1999, Shuai et. al. 2010] Assumes elliptical compound-gaussian noise Resilient against heavy-tailed noise outliers Iterative ML-estimation of the noise scatter matrix Converges under some regularity conditions Each iteration involves matrix inversion Does not reject large norm outliers Can be sensitive to non-elliptical noise 5 / 20

6 Proposed Detector General operation principle Selects a Gaussian model that best empirically fits a transformed probability distribution of the data Advantages Resilient to outliers (rejects large-norm outliers) Involves higher-order statistical moments Significant mitigation of the model mismatch effect Computational and implementation simplicity 6 / 20

7 Probability Measure Transform Definition Given a non-negative function u : X R + satisfying A transform T u : P X;H Q (u) X;H 0 < E [u (X) ; P X;H ] <. T u [P X;H ] (A) = Q (u) X;H (A) is defined as: ϕ u (x; H)dP X;H (x), A where ϕ u (x; H) u (x) E [u (X) ; P X;H ]. The function u ( ) is called the MT-function. 7 / 20

8 Probability Measure Transform The measure transformed mean and covariance µ (u) X;H = E [Xϕ u (X; H); P X;H ] where Σ (u) X;H = E [ XX H ] (u) ϕ u (X; H); P X;H µ X;Hµ (u)h X;H u (x) ϕ u (x; H) E [u (X) ; P X;H ] = dq(u) X;H dp X;H Conclusion The mean and covariance under Q (u) X;H only samples from P X;H. can be estimated using u (x) non-constant & analytic the mean and covariance under Q (u) X;H involve higher-order statistical moments of P X;H. 8 / 20

9 Probability Measure Transform Proposition (Consistent empirical MT mean and covariance) Let X n, n = 1,..., N denote a sequence of i.i.d. samples from P X;H, and define the empirical mean and covariance estimates: ˆΣ (u) X where ˆϕ u (X n ) ˆµ (u) X N n=1 N X n ˆϕ u (X n ) n=1 X n X H n ˆϕ u (X n ) ˆµ (u) x ˆµ (u)h x u(xn) N If n=1 u(xn). ] E [ X 2 u (X) ; P X;H <, then ˆµ (u) X w.p.1 µ (u) X;H and ˆΣ (u) X w.p.1 Σ (u) X;H as N. 9 / 20

10 Probability Measure Transform Proposition (Robustness to outliers) If the MT-function u(x) and u(x) x 2 are bounded, then the influence functions [Hampel, 1974] of ˆµ (u) X and ˆΣ (u) X Remark Condition is satisfied when u (x) Gaussian family are bounded. IF IF Σ (u) x (y) IF µ (u) x (y) y 10 / 20

11 Measure Transformed Gaussian Quasi LRT MT-GQLRT [Todros & Hero, 2016] Compares the empirical KLDs between Q (u) X;H and two Gaussian measures Φ(µ (u), X;H0 Σ(u) ) and Φ(µ(u), X;H0 X;H1 Σ(u) ) X;H1 [ ] T u = D ˆΣ(u) LD X Σ (u) X;H0 [ ] D ˆΣ(u) LD X Σ (u) X;H1 + ˆµ (u) X ˆµ (u) X µ (u) X;H0 µ (u) X;H1 2 (Σ (u) x;h 0 ) 1 2 (Σ (u) x;h 1 ) 1 H 1 H 0 τ, 11 / 20

12 Measure Transformed Gaussian Quasi LRT MT-GQLRT for the considered detection problem Class of MT-functions: { ( ) } u (x) = v P a x, v : C p R +, v(x) = v( x) MT-mean and MT-covariance under H 0 and H 1 : Σ (u) = X;H0 Σ(u) W Equivalent test statistic: µ (u) = 0, k = 0, 1 X;Hk T u = a H ( Σ (u) W and Σ (u) = X;H1 σ2 Saa H + Σ (u) W ) 1 Ĉ(u) X ( Σ (u) W ) 1 a 12 / 20

13 Plug-in Measure Transformed Gaussian Quasi LRT Plug-in MT-GQLRT Plug-in the empirical MT-covariance of the noise obtained from noise-only secondary data {Y m } ( T u a H ˆΣ(u) Y ) 1 Ĉ(u) X ( ) 1 H 1 ˆΣ(u) Y a t, H 0 Theorem (Asymptotic normality) Assume that 1. σs 2 > 0, Σ(u) W is non-singular 2. E [ u 2 ] [ ] (X) ; P X;H, E X 4 u 2 (X) ; P X;H are finite Then ( ) ( ) N T u η (u) D H N 0, λ (u) H N for H = H 0, H 1 13 / 20

14 Plug-in Measure Transformed Gaussian Quasi LRT Threshold determination t = ˆη (u) H0 + Q 1 (α) ˆλ (u), H0 Guarantees asymptotic CFAR= α ˆη (u) H0 ( ) 1 ah ˆΣ(u) Y a ˆλ(u) H0 M N M m=1 ˆϕ 2 u (Y m ) ( ( ah ˆΣ(u) Y ) 1 Ym 2 ˆη (u) H0 ) 2 14 / 20

15 Plug-in Measure Transformed Gaussian Quasi LRT Selection of the MT-function to induce outlier resilience Gaussian MT-function: u G (x; ω) = exp ( P a x 2 /ω 2) Define the Asymptotic Relative Local Power Sensitivity to change in σs 2 (under nominal Gaussian distribution): R (ω, Σ W ) β u G σs 2 / β LRT σs 2 = σ 2 S =0 NG (ω, ΣW ) + Q 1 (α) N + Q 1 (α) Select the lowest ω such that R (ω, Σ W ) r, 0 << r < 1 In practice Σ W is replaced by: ˆΣ W (ω) = ( ˆΣ(u G ) Y (ω) P a /ω 2 ) 1 15 / 20

16 Simulation Studies Setup BPSK signal with variance σ 2 S Steering vector: a 1 p [ 1, e iπ sin(θ),..., e iπ(p 1) sin(θ)] T, p = 8, θ = 60 Sample size in primary and secondary data: N = 1000, M = 5000 False alarm rate α = 0.05 Asymptotic Relative Local Power Sensitivity: r = / 20

17 Simulation Studies Detection in Gaussian noise Zero-mean Gaussian noise with Toeplitz structured covariance Σ: { σ 2 [Σ] i,j Wb j i, i j ( ) b i j, b < 1,, i > j σ 2 W Power Omniscient LRT Gauss-Gauss detector 0.2 CG-GLRT Plug-in MT-GQLRT (empirical) Plug-in MT-GQLRT (asymptotic) SNR [db] 17 / 20

18 Simulation Studies Detection in elliptical CG noise Elliptical t-distributed noise with λ = 0.2 degrees of freedom and dispersion matrix Σ Power Omniscient LRT Gauss-Gauss detector CG-GLRT Plug-in MT-GQLRT (empirical) Plug-in MT-GQLRT (asymptotic) SNR [db] 18 / 20

19 Simulation Studies Detection in non-elliptical noise Elliptical t-distributed noise + BPSK interference (SIR = 5 [db]) Power Omniscient LRT Gauss-Gauss detector CG-GLRT Plug-in MT-GQLRT (empirical) Plug-in MT-GQLRT (asymptotic) SNR [db] 19 / 20

20 Conclusions Plug-in MT-GQLRT for detection of a random signal that lies on a known rank-one subspace Simple implementation and tractable performance analysis Less sensitive to model mismatch as compared to other model based detectors Extension to non-homogeneous noise environment 20 / 20

MEASURE TRANSFORMED QUASI LIKELIHOOD RATIO TEST

MEASURE TRANSFORMED QUASI LIKELIHOOD RATIO TEST MEASURE TRANSFORMED QUASI LIKELIHOOD RATIO TEST Koby Todros Ben-Gurion University of the Negev Alfred O. Hero University of Michigan ABSTRACT In this paper, a generalization of the Gaussian quasi likelihood

More information

Measure-Transformed Quasi Maximum Likelihood Estimation

Measure-Transformed Quasi Maximum Likelihood Estimation Measure-Transformed Quasi Maximum Likelihood Estimation 1 Koby Todros and Alfred O. Hero Abstract In this paper, we consider the problem of estimating a deterministic vector parameter when the likelihood

More information

Passive Sonar Detection Performance Prediction of a Moving Source in an Uncertain Environment

Passive Sonar Detection Performance Prediction of a Moving Source in an Uncertain Environment Acoustical Society of America Meeting Fall 2005 Passive Sonar Detection Performance Prediction of a Moving Source in an Uncertain Environment Vivek Varadarajan and Jeffrey Krolik Duke University Department

More information

Composite Hypotheses and Generalized Likelihood Ratio Tests

Composite Hypotheses and Generalized Likelihood Ratio Tests Composite Hypotheses and Generalized Likelihood Ratio Tests Rebecca Willett, 06 In many real world problems, it is difficult to precisely specify probability distributions. Our models for data may involve

More information

MEASURE TRANSFORMED QUASI SCORE TEST WITH APPLICATION TO LOCATION MISMATCH DETECTION. Koby Todros. Ben-Gurion University of the Negev

MEASURE TRANSFORMED QUASI SCORE TEST WITH APPLICATION TO LOCATION MISMATCH DETECTION. Koby Todros. Ben-Gurion University of the Negev MEASURE TRASFORME QUASI SCORE TEST WITH ALICATIO TO LOCATIO MISMATCH ETECTIO Koby Todros Ben-Gurion University of the egev ABSTRACT In this paper, we develop a generalization of the Gaussian quasi score

More information

CFAR TARGET DETECTION IN TREE SCATTERING INTERFERENCE

CFAR TARGET DETECTION IN TREE SCATTERING INTERFERENCE CFAR TARGET DETECTION IN TREE SCATTERING INTERFERENCE Anshul Sharma and Randolph L. Moses Department of Electrical Engineering, The Ohio State University, Columbus, OH 43210 ABSTRACT We have developed

More information

Applications of Information Geometry to Hypothesis Testing and Signal Detection

Applications of Information Geometry to Hypothesis Testing and Signal Detection CMCAA 2016 Applications of Information Geometry to Hypothesis Testing and Signal Detection Yongqiang Cheng National University of Defense Technology July 2016 Outline 1. Principles of Information Geometry

More information

10. Composite Hypothesis Testing. ECE 830, Spring 2014

10. Composite Hypothesis Testing. ECE 830, Spring 2014 10. Composite Hypothesis Testing ECE 830, Spring 2014 1 / 25 In many real world problems, it is difficult to precisely specify probability distributions. Our models for data may involve unknown parameters

More information

Robust covariance matrices estimation and applications in signal processing

Robust covariance matrices estimation and applications in signal processing Robust covariance matrices estimation and applications in signal processing F. Pascal SONDRA/Supelec GDR ISIS Journée Estimation et traitement statistique en grande dimension May 16 th, 2013 FP (SONDRA/Supelec)

More information

Antonio De Maio, Maria S. Greco, and Danilo Orlando. 1.1 Historical Background and Terminology Symbols Detection Theory 6

Antonio De Maio, Maria S. Greco, and Danilo Orlando. 1.1 Historical Background and Terminology Symbols Detection Theory 6 Contents 1 Introduction to Radar Detection 1 Antonio De Maio, Maria S. Greco, and Danilo Orlando 1.1 Historical Background and Terminology 1 1.2 Symbols 5 1.3 Detection Theory 6 1.3.1 Signal and Interference

More information

Detection of Anomalies in Texture Images using Multi-Resolution Features

Detection of Anomalies in Texture Images using Multi-Resolution Features Detection of Anomalies in Texture Images using Multi-Resolution Features Electrical Engineering Department Supervisor: Prof. Israel Cohen Outline Introduction 1 Introduction Anomaly Detection Texture Segmentation

More information

A GLRT FOR RADAR DETECTION IN THE PRESENCE OF COMPOUND-GAUSSIAN CLUTTER AND ADDITIVE WHITE GAUSSIAN NOISE. James H. Michels. Bin Liu, Biao Chen

A GLRT FOR RADAR DETECTION IN THE PRESENCE OF COMPOUND-GAUSSIAN CLUTTER AND ADDITIVE WHITE GAUSSIAN NOISE. James H. Michels. Bin Liu, Biao Chen A GLRT FOR RADAR DETECTION IN THE PRESENCE OF COMPOUND-GAUSSIAN CLUTTER AND ADDITIVE WHITE GAUSSIAN NOISE Bin Liu, Biao Chen Syracuse University Dept of EECS, Syracuse, NY 3244 email : biliu{bichen}@ecs.syr.edu

More information

EECS564 Estimation, Filtering, and Detection Exam 2 Week of April 20, 2015

EECS564 Estimation, Filtering, and Detection Exam 2 Week of April 20, 2015 EECS564 Estimation, Filtering, and Detection Exam Week of April 0, 015 This is an open book takehome exam. You have 48 hours to complete the exam. All work on the exam should be your own. problems have

More information

A SIRV-CFAR Adaptive Detector Exploiting Persymmetric Clutter Covariance Structure

A SIRV-CFAR Adaptive Detector Exploiting Persymmetric Clutter Covariance Structure A SIRV-CFAR Adaptive Detector Exploiting Persymmetric Clutter Covariance Structure Guilhem Pailloux 2 Jean-Philippe Ovarlez Frédéric Pascal 3 and Philippe Forster 2 ONERA - DEMR/TSI Chemin de la Hunière

More information

Signal Processing for MIMO Radars. under Gaussian and non-gaussian environments and application to STAP

Signal Processing for MIMO Radars. under Gaussian and non-gaussian environments and application to STAP Signal processing for MIMO radars: Detection under Gaussian and non-gaussian environments and application to STAP CHONG Chin Yuan Thesis Director: Marc LESTURGIE (ONERA/SONDRA) Supervisor: Frédéric PASCAL

More information

Robust adaptive detection of buried pipes using GPR

Robust adaptive detection of buried pipes using GPR Robust adaptive detection of buried pipes using GPR Q. Hoarau, G. Ginolhac, A. M. Atto, J.-P. Ovarlez, J.-M. Nicolas Université Savoie Mont Blanc - Centrale Supelec - Télécom ParisTech 12 th July 2016

More information

Adaptive Array Detection, Estimation and Beamforming

Adaptive Array Detection, Estimation and Beamforming Adaptive Array Detection, Estimation and Beamforming Christ D. Richmond Workshop on Stochastic Eigen-Analysis and its Applications 3:30pm, Monday, July 10th 2006 C. D. Richmond-1 *This work was sponsored

More information

Multivariate Distributions

Multivariate Distributions IEOR E4602: Quantitative Risk Management Spring 2016 c 2016 by Martin Haugh Multivariate Distributions We will study multivariate distributions in these notes, focusing 1 in particular on multivariate

More information

A NEW BAYESIAN LOWER BOUND ON THE MEAN SQUARE ERROR OF ESTIMATORS. Koby Todros and Joseph Tabrikian

A NEW BAYESIAN LOWER BOUND ON THE MEAN SQUARE ERROR OF ESTIMATORS. Koby Todros and Joseph Tabrikian 16th European Signal Processing Conference EUSIPCO 008) Lausanne Switzerland August 5-9 008 copyright by EURASIP A NEW BAYESIAN LOWER BOUND ON THE MEAN SQUARE ERROR OF ESTIMATORS Koby Todros and Joseph

More information

Lecture 8: Signal Detection and Noise Assumption

Lecture 8: Signal Detection and Noise Assumption ECE 830 Fall 0 Statistical Signal Processing instructor: R. Nowak Lecture 8: Signal Detection and Noise Assumption Signal Detection : X = W H : X = S + W where W N(0, σ I n n and S = [s, s,..., s n ] T

More information

ADAPTIVE ARRAY DETECTION ALGORITHMS WITH STEERING VECTOR MISMATCH

ADAPTIVE ARRAY DETECTION ALGORITHMS WITH STEERING VECTOR MISMATCH ADAPTIVE ARRAY DETECTIO ALGORITHMS WITH STEERIG VECTOR MISMATCH LIM Chin Heng, Elias Aboutanios Bernard Mulgrew Institute for Digital Communications School of Engineering & Electronics, University of Edinburgh

More information

Independent Component (IC) Models: New Extensions of the Multinormal Model

Independent Component (IC) Models: New Extensions of the Multinormal Model Independent Component (IC) Models: New Extensions of the Multinormal Model Davy Paindaveine (joint with Klaus Nordhausen, Hannu Oja, and Sara Taskinen) School of Public Health, ULB, April 2008 My research

More information

Robust Principal Component Analysis

Robust Principal Component Analysis ELE 538B: Mathematics of High-Dimensional Data Robust Principal Component Analysis Yuxin Chen Princeton University, Fall 2018 Disentangling sparse and low-rank matrices Suppose we are given a matrix M

More information

Outline of GLMs. Definitions

Outline of GLMs. Definitions Outline of GLMs Definitions This is a short outline of GLM details, adapted from the book Nonparametric Regression and Generalized Linear Models, by Green and Silverman. The responses Y i have density

More information

Structured signal recovery from non-linear and heavy-tailed measurements

Structured signal recovery from non-linear and heavy-tailed measurements Structured signal recovery from non-linear and heavy-tailed measurements Larry Goldstein* Stanislav Minsker* Xiaohan Wei # *Department of Mathematics # Department of Electrical Engineering UniversityofSouthern

More information

Robust Testing and Variable Selection for High-Dimensional Time Series

Robust Testing and Variable Selection for High-Dimensional Time Series Robust Testing and Variable Selection for High-Dimensional Time Series Ruey S. Tsay Booth School of Business, University of Chicago May, 2017 Ruey S. Tsay HTS 1 / 36 Outline 1 Focus on high-dimensional

More information

F2E5216/TS1002 Adaptive Filtering and Change Detection. Course Organization. Lecture plan. The Books. Lecture 1

F2E5216/TS1002 Adaptive Filtering and Change Detection. Course Organization. Lecture plan. The Books. Lecture 1 Adaptive Filtering and Change Detection Bo Wahlberg (KTH and Fredrik Gustafsson (LiTH Course Organization Lectures and compendium: Theory, Algorithms, Applications, Evaluation Toolbox and manual: Algorithms,

More information

CFAR DETECTION OF SPATIALLY DISTRIBUTED TARGETS IN K- DISTRIBUTED CLUTTER WITH UNKNOWN PARAMETERS

CFAR DETECTION OF SPATIALLY DISTRIBUTED TARGETS IN K- DISTRIBUTED CLUTTER WITH UNKNOWN PARAMETERS CFAR DETECTION OF SPATIALLY DISTRIBUTED TARGETS IN K- DISTRIBUTED CLUTTER WITH UNKNOWN PARAMETERS N. Nouar and A.Farrouki SISCOM Laboratory, Department of Electrical Engineering, University of Constantine,

More information

Lecture 5: Likelihood ratio tests, Neyman-Pearson detectors, ROC curves, and sufficient statistics. 1 Executive summary

Lecture 5: Likelihood ratio tests, Neyman-Pearson detectors, ROC curves, and sufficient statistics. 1 Executive summary ECE 830 Spring 207 Instructor: R. Willett Lecture 5: Likelihood ratio tests, Neyman-Pearson detectors, ROC curves, and sufficient statistics Executive summary In the last lecture we saw that the likelihood

More information

Detection theory 101 ELEC-E5410 Signal Processing for Communications

Detection theory 101 ELEC-E5410 Signal Processing for Communications Detection theory 101 ELEC-E5410 Signal Processing for Communications Binary hypothesis testing Null hypothesis H 0 : e.g. noise only Alternative hypothesis H 1 : signal + noise p(x;h 0 ) γ p(x;h 1 ) Trade-off

More information

MULTICHANNEL SIGNAL PROCESSING USING SPATIAL RANK COVARIANCE MATRICES

MULTICHANNEL SIGNAL PROCESSING USING SPATIAL RANK COVARIANCE MATRICES MULTICHANNEL SIGNAL PROCESSING USING SPATIAL RANK COVARIANCE MATRICES S. Visuri 1 H. Oja V. Koivunen 1 1 Signal Processing Lab. Dept. of Statistics Tampere Univ. of Technology University of Jyväskylä P.O.

More information

Probabilistic & Unsupervised Learning

Probabilistic & Unsupervised Learning Probabilistic & Unsupervised Learning Week 2: Latent Variable Models Maneesh Sahani maneesh@gatsby.ucl.ac.uk Gatsby Computational Neuroscience Unit, and MSc ML/CSML, Dept Computer Science University College

More information

Statement: With my signature I confirm that the solutions are the product of my own work. Name: Signature:.

Statement: With my signature I confirm that the solutions are the product of my own work. Name: Signature:. MATHEMATICAL STATISTICS Homework assignment Instructions Please turn in the homework with this cover page. You do not need to edit the solutions. Just make sure the handwriting is legible. You may discuss

More information

Multivariate Statistics

Multivariate Statistics Multivariate Statistics Chapter 2: Multivariate distributions and inference Pedro Galeano Departamento de Estadística Universidad Carlos III de Madrid pedro.galeano@uc3m.es Course 2016/2017 Master in Mathematical

More information

Stat 579: Generalized Linear Models and Extensions

Stat 579: Generalized Linear Models and Extensions Stat 579: Generalized Linear Models and Extensions Mixed models Yan Lu March, 2018, week 8 1 / 32 Restricted Maximum Likelihood (REML) REML: uses a likelihood function calculated from the transformed set

More information

Uncertainty. Jayakrishnan Unnikrishnan. CSL June PhD Defense ECE Department

Uncertainty. Jayakrishnan Unnikrishnan. CSL June PhD Defense ECE Department Decision-Making under Statistical Uncertainty Jayakrishnan Unnikrishnan PhD Defense ECE Department University of Illinois at Urbana-Champaign CSL 141 12 June 2010 Statistical Decision-Making Relevant in

More information

REGRESSION WITH SPATIALLY MISALIGNED DATA. Lisa Madsen Oregon State University David Ruppert Cornell University

REGRESSION WITH SPATIALLY MISALIGNED DATA. Lisa Madsen Oregon State University David Ruppert Cornell University REGRESSION ITH SPATIALL MISALIGNED DATA Lisa Madsen Oregon State University David Ruppert Cornell University SPATIALL MISALIGNED DATA 10 X X X X X X X X 5 X X X X X 0 X 0 5 10 OUTLINE 1. Introduction 2.

More information

Solving Corrupted Quadratic Equations, Provably

Solving Corrupted Quadratic Equations, Provably Solving Corrupted Quadratic Equations, Provably Yuejie Chi London Workshop on Sparse Signal Processing September 206 Acknowledgement Joint work with Yuanxin Li (OSU), Huishuai Zhuang (Syracuse) and Yingbin

More information

Minimum Message Length Analysis of the Behrens Fisher Problem

Minimum Message Length Analysis of the Behrens Fisher Problem Analysis of the Behrens Fisher Problem Enes Makalic and Daniel F Schmidt Centre for MEGA Epidemiology The University of Melbourne Solomonoff 85th Memorial Conference, 2011 Outline Introduction 1 Introduction

More information

Sub-Gaussian Estimators of the Mean of a Random Matrix with Entries Possessing Only Two Moments

Sub-Gaussian Estimators of the Mean of a Random Matrix with Entries Possessing Only Two Moments Sub-Gaussian Estimators of the Mean of a Random Matrix with Entries Possessing Only Two Moments Stas Minsker University of Southern California July 21, 2016 ICERM Workshop Simple question: how to estimate

More information

TARGET DETECTION WITH FUNCTION OF COVARIANCE MATRICES UNDER CLUTTER ENVIRONMENT

TARGET DETECTION WITH FUNCTION OF COVARIANCE MATRICES UNDER CLUTTER ENVIRONMENT TARGET DETECTION WITH FUNCTION OF COVARIANCE MATRICES UNDER CLUTTER ENVIRONMENT Feng Lin, Robert C. Qiu, James P. Browning, Michael C. Wicks Cognitive Radio Institute, Department of Electrical and Computer

More information

Exponential Family and Maximum Likelihood, Gaussian Mixture Models and the EM Algorithm. by Korbinian Schwinger

Exponential Family and Maximum Likelihood, Gaussian Mixture Models and the EM Algorithm. by Korbinian Schwinger Exponential Family and Maximum Likelihood, Gaussian Mixture Models and the EM Algorithm by Korbinian Schwinger Overview Exponential Family Maximum Likelihood The EM Algorithm Gaussian Mixture Models Exponential

More information

Multivariate Regression

Multivariate Regression Multivariate Regression The so-called supervised learning problem is the following: we want to approximate the random variable Y with an appropriate function of the random variables X 1,..., X p with the

More information

Physical Layer Binary Consensus. Study

Physical Layer Binary Consensus. Study Protocols: A Study Venugopalakrishna Y. R. and Chandra R. Murthy ECE Dept., IISc, Bangalore 23 rd Nov. 2013 Outline Introduction to Consensus Problem Setup Protocols LMMSE-based scheme Co-phased combining

More information

The Effect of Spatial Correlations on MIMO Capacity: A (not so) Large N Analytical Approach: Aris Moustakas 1, Steven Simon 1 & Anirvan Sengupta 1,2

The Effect of Spatial Correlations on MIMO Capacity: A (not so) Large N Analytical Approach: Aris Moustakas 1, Steven Simon 1 & Anirvan Sengupta 1,2 The Effect of Spatial Correlations on MIMO Capacity: A (not so) Large N Analytical Approach: Aris Moustakas 1, Steven Simon 1 & Anirvan Sengupta 1, 1, Rutgers University Outline Aim: Calculate statistics

More information

Sparse regression. Optimization-Based Data Analysis. Carlos Fernandez-Granda

Sparse regression. Optimization-Based Data Analysis.   Carlos Fernandez-Granda Sparse regression Optimization-Based Data Analysis http://www.cims.nyu.edu/~cfgranda/pages/obda_spring16 Carlos Fernandez-Granda 3/28/2016 Regression Least-squares regression Example: Global warming Logistic

More information

Empirical likelihood and self-weighting approach for hypothesis testing of infinite variance processes and its applications

Empirical likelihood and self-weighting approach for hypothesis testing of infinite variance processes and its applications Empirical likelihood and self-weighting approach for hypothesis testing of infinite variance processes and its applications Fumiya Akashi Research Associate Department of Applied Mathematics Waseda University

More information

Exogeneity tests and weak identification

Exogeneity tests and weak identification Cireq, Cirano, Départ. Sc. Economiques Université de Montréal Jean-Marie Dufour Cireq, Cirano, William Dow Professor of Economics Department of Economics Mcgill University June 20, 2008 Main Contributions

More information

Appendix to Portfolio Construction by Mitigating Error Amplification: The Bounded-Noise Portfolio

Appendix to Portfolio Construction by Mitigating Error Amplification: The Bounded-Noise Portfolio Appendix to Portfolio Construction by Mitigating Error Amplification: The Bounded-Noise Portfolio Long Zhao, Deepayan Chakrabarti, and Kumar Muthuraman McCombs School of Business, University of Texas,

More information

high-dimensional inference robust to the lack of model sparsity

high-dimensional inference robust to the lack of model sparsity high-dimensional inference robust to the lack of model sparsity Jelena Bradic (joint with a PhD student Yinchu Zhu) www.jelenabradic.net Assistant Professor Department of Mathematics University of California,

More information

Robust Subspace DOA Estimation for Wireless Communications

Robust Subspace DOA Estimation for Wireless Communications Robust Subspace DOA Estimation for Wireless Communications Samuli Visuri Hannu Oja ¾ Visa Koivunen Laboratory of Signal Processing Computer Technology Helsinki Univ. of Technology P.O. Box 3, FIN-25 HUT

More information

2. What are the tradeoffs among different measures of error (e.g. probability of false alarm, probability of miss, etc.)?

2. What are the tradeoffs among different measures of error (e.g. probability of false alarm, probability of miss, etc.)? ECE 830 / CS 76 Spring 06 Instructors: R. Willett & R. Nowak Lecture 3: Likelihood ratio tests, Neyman-Pearson detectors, ROC curves, and sufficient statistics Executive summary In the last lecture we

More information

MULTIPLE-CHANNEL DETECTION IN ACTIVE SENSING. Kaitlyn Beaudet and Douglas Cochran

MULTIPLE-CHANNEL DETECTION IN ACTIVE SENSING. Kaitlyn Beaudet and Douglas Cochran MULTIPLE-CHANNEL DETECTION IN ACTIVE SENSING Kaitlyn Beaudet and Douglas Cochran School of Electrical, Computer and Energy Engineering Arizona State University, Tempe AZ 85287-576 USA ABSTRACT The problem

More information

An introduction to G-estimation with sample covariance matrices

An introduction to G-estimation with sample covariance matrices An introduction to G-estimation with sample covariance matrices Xavier estre xavier.mestre@cttc.cat Centre Tecnològic de Telecomunicacions de Catalunya (CTTC) "atrices aleatoires: applications aux communications

More information

PASSIVE array signal processing has gained considerable

PASSIVE array signal processing has gained considerable IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 50, NO. 11, NOVEMBER 2002 2617 General Asymptotic Analysis of the Generalized Likelihood Ratio Test for a Gaussian Point Source Under Statistical or Spatial

More information

Sliced Inverse Regression

Sliced Inverse Regression Sliced Inverse Regression Ge Zhao gzz13@psu.edu Department of Statistics The Pennsylvania State University Outline Background of Sliced Inverse Regression (SIR) Dimension Reduction Definition of SIR Inversed

More information

Brief Review on Estimation Theory

Brief Review on Estimation Theory Brief Review on Estimation Theory K. Abed-Meraim ENST PARIS, Signal and Image Processing Dept. abed@tsi.enst.fr This presentation is essentially based on the course BASTA by E. Moulines Brief review on

More information

UNIFORMLY MOST POWERFUL CYCLIC PERMUTATION INVARIANT DETECTION FOR DISCRETE-TIME SIGNALS

UNIFORMLY MOST POWERFUL CYCLIC PERMUTATION INVARIANT DETECTION FOR DISCRETE-TIME SIGNALS UNIFORMLY MOST POWERFUL CYCLIC PERMUTATION INVARIANT DETECTION FOR DISCRETE-TIME SIGNALS F. C. Nicolls and G. de Jager Department of Electrical Engineering, University of Cape Town Rondebosch 77, South

More information

Regularized PCA to denoise and visualise data

Regularized PCA to denoise and visualise data Regularized PCA to denoise and visualise data Marie Verbanck Julie Josse François Husson Laboratoire de statistique, Agrocampus Ouest, Rennes, France CNAM, Paris, 16 janvier 2013 1 / 30 Outline 1 PCA 2

More information

DETECTION theory deals primarily with techniques for

DETECTION theory deals primarily with techniques for ADVANCED SIGNAL PROCESSING SE Optimum Detection of Deterministic and Random Signals Stefan Tertinek Graz University of Technology turtle@sbox.tugraz.at Abstract This paper introduces various methods for

More information

MODEL ORDER ESTIMATION FOR ADAPTIVE RADAR CLUTTER CANCELLATION. Kelly Hall, 4 East Alumni Ave. Kingston, RI 02881

MODEL ORDER ESTIMATION FOR ADAPTIVE RADAR CLUTTER CANCELLATION. Kelly Hall, 4 East Alumni Ave. Kingston, RI 02881 MODEL ORDER ESTIMATION FOR ADAPTIVE RADAR CLUTTER CANCELLATION Muralidhar Rangaswamy 1, Steven Kay 2, Cuichun Xu 2, and Freeman C. Lin 3 1 Air Force Research Laboratory, Sensors Directorate, 80 Scott Drive,

More information

Lecture 7 Introduction to Statistical Decision Theory

Lecture 7 Introduction to Statistical Decision Theory Lecture 7 Introduction to Statistical Decision Theory I-Hsiang Wang Department of Electrical Engineering National Taiwan University ihwang@ntu.edu.tw December 20, 2016 1 / 55 I-Hsiang Wang IT Lecture 7

More information

Chapter 9: Hypothesis Testing Sections

Chapter 9: Hypothesis Testing Sections Chapter 9: Hypothesis Testing Sections 9.1 Problems of Testing Hypotheses 9.2 Testing Simple Hypotheses 9.3 Uniformly Most Powerful Tests Skip: 9.4 Two-Sided Alternatives 9.6 Comparing the Means of Two

More information

Lecture 7 MIMO Communica2ons

Lecture 7 MIMO Communica2ons Wireless Communications Lecture 7 MIMO Communica2ons Prof. Chun-Hung Liu Dept. of Electrical and Computer Engineering National Chiao Tung University Fall 2014 1 Outline MIMO Communications (Chapter 10

More information

The outline for Unit 3

The outline for Unit 3 The outline for Unit 3 Unit 1. Introduction: The regression model. Unit 2. Estimation principles. Unit 3: Hypothesis testing principles. 3.1 Wald test. 3.2 Lagrange Multiplier. 3.3 Likelihood Ratio Test.

More information

DS-GA 1002 Lecture notes 10 November 23, Linear models

DS-GA 1002 Lecture notes 10 November 23, Linear models DS-GA 2 Lecture notes November 23, 2 Linear functions Linear models A linear model encodes the assumption that two quantities are linearly related. Mathematically, this is characterized using linear functions.

More information

Signal Detection Basics - CFAR

Signal Detection Basics - CFAR Signal Detection Basics - CFAR Types of noise clutter and signals targets Signal separation by comparison threshold detection Signal Statistics - Parameter estimation Threshold determination based on the

More information

Maximum Achievable Diversity for MIMO-OFDM Systems with Arbitrary. Spatial Correlation

Maximum Achievable Diversity for MIMO-OFDM Systems with Arbitrary. Spatial Correlation Maximum Achievable Diversity for MIMO-OFDM Systems with Arbitrary Spatial Correlation Ahmed K Sadek, Weifeng Su, and K J Ray Liu Department of Electrical and Computer Engineering, and Institute for Systems

More information

A PARAMETRIC MOVING TARGET DETECTOR FOR DISTRIBUTED MIMO RADAR IN NON-HOMOGENEOUS ENVIRONMENT

A PARAMETRIC MOVING TARGET DETECTOR FOR DISTRIBUTED MIMO RADAR IN NON-HOMOGENEOUS ENVIRONMENT A PARAMETRIC MOVING TARGET DETECTOR FOR DISTRIBUTED MIMO RADAR IN NON-OMOGENEOUS ENVIRONMENT Pu Wang, ongbin Li, and Braham imed ECE DEPT, Stevens Institute of Technology, oboken, NJ 73, USA AFRL/RYMD,

More information

Hypothesis Testing Based on the Maximum of Two Statistics from Weighted and Unweighted Estimating Equations

Hypothesis Testing Based on the Maximum of Two Statistics from Weighted and Unweighted Estimating Equations Hypothesis Testing Based on the Maximum of Two Statistics from Weighted and Unweighted Estimating Equations Takeshi Emura and Hisayuki Tsukuma Abstract For testing the regression parameter in multivariate

More information

System Identification, Lecture 4

System Identification, Lecture 4 System Identification, Lecture 4 Kristiaan Pelckmans (IT/UU, 2338) Course code: 1RT880, Report code: 61800 - Spring 2012 F, FRI Uppsala University, Information Technology 30 Januari 2012 SI-2012 K. Pelckmans

More information

MFM Practitioner Module: Quantitiative Risk Management. John Dodson. October 14, 2015

MFM Practitioner Module: Quantitiative Risk Management. John Dodson. October 14, 2015 MFM Practitioner Module: Quantitiative Risk Management October 14, 2015 The n-block maxima 1 is a random variable defined as M n max (X 1,..., X n ) for i.i.d. random variables X i with distribution function

More information

Nonlinear Signal Processing ELEG 833

Nonlinear Signal Processing ELEG 833 Nonlinear Signal Processing ELEG 833 Gonzalo R. Arce Department of Electrical and Computer Engineering University of Delaware arce@ee.udel.edu May 5, 2005 8 MYRIAD SMOOTHERS 8 Myriad Smoothers 8.1 FLOM

More information

System Identification, Lecture 4

System Identification, Lecture 4 System Identification, Lecture 4 Kristiaan Pelckmans (IT/UU, 2338) Course code: 1RT880, Report code: 61800 - Spring 2016 F, FRI Uppsala University, Information Technology 13 April 2016 SI-2016 K. Pelckmans

More information

ANALYSIS OF A PARTIAL DECORRELATOR IN A MULTI-CELL DS/CDMA SYSTEM

ANALYSIS OF A PARTIAL DECORRELATOR IN A MULTI-CELL DS/CDMA SYSTEM ANAYSIS OF A PARTIA DECORREATOR IN A MUTI-CE DS/CDMA SYSTEM Mohammad Saquib ECE Department, SU Baton Rouge, A 70803-590 e-mail: saquib@winlab.rutgers.edu Roy Yates WINAB, Rutgers University Piscataway

More information

MMSE-Based Filtering for Linear and Nonlinear Systems in the Presence of Non-Gaussian System and Measurement Noise

MMSE-Based Filtering for Linear and Nonlinear Systems in the Presence of Non-Gaussian System and Measurement Noise MMSE-Based Filtering for Linear and Nonlinear Systems in the Presence of Non-Gaussian System and Measurement Noise I. Bilik 1 and J. Tabrikian 2 1 Dept. of Electrical and Computer Engineering, University

More information

Finite Singular Multivariate Gaussian Mixture

Finite Singular Multivariate Gaussian Mixture 21/06/2016 Plan 1 Basic definitions Singular Multivariate Normal Distribution 2 3 Plan Singular Multivariate Normal Distribution 1 Basic definitions Singular Multivariate Normal Distribution 2 3 Multivariate

More information

Notes on the Multivariate Normal and Related Topics

Notes on the Multivariate Normal and Related Topics Version: July 10, 2013 Notes on the Multivariate Normal and Related Topics Let me refresh your memory about the distinctions between population and sample; parameters and statistics; population distributions

More information

Introduction to Rare Event Simulation

Introduction to Rare Event Simulation Introduction to Rare Event Simulation Brown University: Summer School on Rare Event Simulation Jose Blanchet Columbia University. Department of Statistics, Department of IEOR. Blanchet (Columbia) 1 / 31

More information

Maximum Likelihood Methods in Radar Array Signal Processing

Maximum Likelihood Methods in Radar Array Signal Processing Maximum Likelihood Methods in Radar Array Signal Processing A. LEE SWINDLEHURST, MEMBER, IEEE, AND PETRE STOICA, FELLOW, IEEE We consider robust and computationally efficient maximum likelihood algorithms

More information

Random Matrix Theory Lecture 1 Introduction, Ensembles and Basic Laws. Symeon Chatzinotas February 11, 2013 Luxembourg

Random Matrix Theory Lecture 1 Introduction, Ensembles and Basic Laws. Symeon Chatzinotas February 11, 2013 Luxembourg Random Matrix Theory Lecture 1 Introduction, Ensembles and Basic Laws Symeon Chatzinotas February 11, 2013 Luxembourg Outline 1. Random Matrix Theory 1. Definition 2. Applications 3. Asymptotics 2. Ensembles

More information

Ph.D. Qualifying Exam Friday Saturday, January 6 7, 2017

Ph.D. Qualifying Exam Friday Saturday, January 6 7, 2017 Ph.D. Qualifying Exam Friday Saturday, January 6 7, 2017 Put your solution to each problem on a separate sheet of paper. Problem 1. (5106) Let X 1, X 2,, X n be a sequence of i.i.d. observations from a

More information

A Probability Review

A Probability Review A Probability Review Outline: A probability review Shorthand notation: RV stands for random variable EE 527, Detection and Estimation Theory, # 0b 1 A Probability Review Reading: Go over handouts 2 5 in

More information

Performance Analysis of the Nonhomogeneity Detector for STAP Applications

Performance Analysis of the Nonhomogeneity Detector for STAP Applications Performance Analysis of the Nonhomogeneity Detector for STAP Applications uralidhar Rangaswamy ARCON Corporation 6 Bear ill Rd. Waltham, assachusetts, USA Braham imed AFRL/SNRT 6 Electronic Parway Rome,

More information

Statistics and Data Analysis

Statistics and Data Analysis Statistics and Data Analysis The Crash Course Physics 226, Fall 2013 "There are three kinds of lies: lies, damned lies, and statistics. Mark Twain, allegedly after Benjamin Disraeli Statistics and Data

More information

Efficient and Robust Scale Estimation

Efficient and Robust Scale Estimation Efficient and Robust Scale Estimation Garth Tarr, Samuel Müller and Neville Weber School of Mathematics and Statistics THE UNIVERSITY OF SYDNEY Outline Introduction and motivation The robust scale estimator

More information

Generalized Linear Models. Kurt Hornik

Generalized Linear Models. Kurt Hornik Generalized Linear Models Kurt Hornik Motivation Assuming normality, the linear model y = Xβ + e has y = β + ε, ε N(0, σ 2 ) such that y N(μ, σ 2 ), E(y ) = μ = β. Various generalizations, including general

More information

ALARGE class of modern array processing techniques are

ALARGE class of modern array processing techniques are IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 52, NO. 6, JUNE 2004 1537 Detection of Distributed Sources Using Sensor Arrays Yuanwei Jin, Member, IEEE, and Benjamin Friedlander, Fellow, IEEE Abstract In

More information

Model Fitting. Jean Yves Le Boudec

Model Fitting. Jean Yves Le Boudec Model Fitting Jean Yves Le Boudec 0 Contents 1. What is model fitting? 2. Linear Regression 3. Linear regression with norm minimization 4. Choosing a distribution 5. Heavy Tail 1 Virus Infection Data We

More information

Lecture 12 Robust Estimation

Lecture 12 Robust Estimation Lecture 12 Robust Estimation Prof. Dr. Svetlozar Rachev Institute for Statistics and Mathematical Economics University of Karlsruhe Financial Econometrics, Summer Semester 2007 Copyright These lecture-notes

More information

STAT 200C: High-dimensional Statistics

STAT 200C: High-dimensional Statistics STAT 200C: High-dimensional Statistics Arash A. Amini May 30, 2018 1 / 57 Table of Contents 1 Sparse linear models Basis Pursuit and restricted null space property Sufficient conditions for RNS 2 / 57

More information

Lecture 15. Hypothesis testing in the linear model

Lecture 15. Hypothesis testing in the linear model 14. Lecture 15. Hypothesis testing in the linear model Lecture 15. Hypothesis testing in the linear model 1 (1 1) Preliminary lemma 15. Hypothesis testing in the linear model 15.1. Preliminary lemma Lemma

More information

Summary: the confidence interval for the mean (σ 2 known) with gaussian assumption

Summary: the confidence interval for the mean (σ 2 known) with gaussian assumption Summary: the confidence interval for the mean (σ known) with gaussian assumption on X Let X be a Gaussian r.v. with mean µ and variance σ. If X 1, X,..., X n is a random sample drawn from X then the confidence

More information

Adaptive beamforming for uniform linear arrays with unknown mutual coupling. IEEE Antennas and Wireless Propagation Letters.

Adaptive beamforming for uniform linear arrays with unknown mutual coupling. IEEE Antennas and Wireless Propagation Letters. Title Adaptive beamforming for uniform linear arrays with unknown mutual coupling Author(s) Liao, B; Chan, SC Citation IEEE Antennas And Wireless Propagation Letters, 2012, v. 11, p. 464-467 Issued Date

More information

EUSIPCO

EUSIPCO EUSIPCO 3 569736677 FULLY ISTRIBUTE SIGNAL ETECTION: APPLICATION TO COGNITIVE RAIO Franc Iutzeler Philippe Ciblat Telecom ParisTech, 46 rue Barrault 753 Paris, France email: firstnamelastname@telecom-paristechfr

More information

Estimation of large dimensional sparse covariance matrices

Estimation of large dimensional sparse covariance matrices Estimation of large dimensional sparse covariance matrices Department of Statistics UC, Berkeley May 5, 2009 Sample covariance matrix and its eigenvalues Data: n p matrix X n (independent identically distributed)

More information

Lecture 3. Inference about multivariate normal distribution

Lecture 3. Inference about multivariate normal distribution Lecture 3. Inference about multivariate normal distribution 3.1 Point and Interval Estimation Let X 1,..., X n be i.i.d. N p (µ, Σ). We are interested in evaluation of the maximum likelihood estimates

More information

Multivariate Statistical Analysis

Multivariate Statistical Analysis Multivariate Statistical Analysis Fall 2011 C. L. Williams, Ph.D. Lecture 9 for Applied Multivariate Analysis Outline Addressing ourliers 1 Addressing ourliers 2 Outliers in Multivariate samples (1) For

More information

Statistical Inference On the High-dimensional Gaussian Covarianc

Statistical Inference On the High-dimensional Gaussian Covarianc Statistical Inference On the High-dimensional Gaussian Covariance Matrix Department of Mathematical Sciences, Clemson University June 6, 2011 Outline Introduction Problem Setup Statistical Inference High-Dimensional

More information

Testing Algebraic Hypotheses

Testing Algebraic Hypotheses Testing Algebraic Hypotheses Mathias Drton Department of Statistics University of Chicago 1 / 18 Example: Factor analysis Multivariate normal model based on conditional independence given hidden variable:

More information