Plug-in Measure-Transformed Quasi Likelihood Ratio Test for Random Signal Detection
|
|
- Hilda Jones
- 6 years ago
- Views:
Transcription
1 Plug-in Measure-Transformed Quasi Likelihood Ratio Test for Random Signal Detection Nir Halay and Koby Todros Dept. of ECE, Ben-Gurion University of the Negev, Beer-Sheva, Israel February 13, / 20
2 Outline Detection problem formulation Existing detectors Proposed detector Simulation studies Summary 2 / 20
3 Detection Problem Formulation H 0 : H 1 : { Xn = W n, n = 1,..., N Y m = W m (s), m = 1,..., M { Xn = S n a + W n, n = 1,..., N Y m = W m (s), m = 1,..., M, {X n C p }, {Y m C p }: Primary and secondary data {S n C}: i.i.d. zero-mean signal with unknown distribution a C p : Known steering vector {W n }, {W (s) m }: i.i.d. zero-mean symmetrically distributed homogeneous noise processes with unknown distribution {S n }, {W n } and {W (s) m } are mutually independent 3 / 20
4 Existing detectors Gauss-Gauss detector [Jin & Friedlander 2005] GLRT-based detector Assumes normally distributed signal and noise Simple implementation and tractable performance analysis Sensitive to deviation from normality (e.g., in the case of heavy-tailed noise that produces outliers) 4 / 20
5 Existing detectors CG-GLRT [Gerlach 1999, Shuai et. al. 2010] Assumes elliptical compound-gaussian noise Resilient against heavy-tailed noise outliers Iterative ML-estimation of the noise scatter matrix Converges under some regularity conditions Each iteration involves matrix inversion Does not reject large norm outliers Can be sensitive to non-elliptical noise 5 / 20
6 Proposed Detector General operation principle Selects a Gaussian model that best empirically fits a transformed probability distribution of the data Advantages Resilient to outliers (rejects large-norm outliers) Involves higher-order statistical moments Significant mitigation of the model mismatch effect Computational and implementation simplicity 6 / 20
7 Probability Measure Transform Definition Given a non-negative function u : X R + satisfying A transform T u : P X;H Q (u) X;H 0 < E [u (X) ; P X;H ] <. T u [P X;H ] (A) = Q (u) X;H (A) is defined as: ϕ u (x; H)dP X;H (x), A where ϕ u (x; H) u (x) E [u (X) ; P X;H ]. The function u ( ) is called the MT-function. 7 / 20
8 Probability Measure Transform The measure transformed mean and covariance µ (u) X;H = E [Xϕ u (X; H); P X;H ] where Σ (u) X;H = E [ XX H ] (u) ϕ u (X; H); P X;H µ X;Hµ (u)h X;H u (x) ϕ u (x; H) E [u (X) ; P X;H ] = dq(u) X;H dp X;H Conclusion The mean and covariance under Q (u) X;H only samples from P X;H. can be estimated using u (x) non-constant & analytic the mean and covariance under Q (u) X;H involve higher-order statistical moments of P X;H. 8 / 20
9 Probability Measure Transform Proposition (Consistent empirical MT mean and covariance) Let X n, n = 1,..., N denote a sequence of i.i.d. samples from P X;H, and define the empirical mean and covariance estimates: ˆΣ (u) X where ˆϕ u (X n ) ˆµ (u) X N n=1 N X n ˆϕ u (X n ) n=1 X n X H n ˆϕ u (X n ) ˆµ (u) x ˆµ (u)h x u(xn) N If n=1 u(xn). ] E [ X 2 u (X) ; P X;H <, then ˆµ (u) X w.p.1 µ (u) X;H and ˆΣ (u) X w.p.1 Σ (u) X;H as N. 9 / 20
10 Probability Measure Transform Proposition (Robustness to outliers) If the MT-function u(x) and u(x) x 2 are bounded, then the influence functions [Hampel, 1974] of ˆµ (u) X and ˆΣ (u) X Remark Condition is satisfied when u (x) Gaussian family are bounded. IF IF Σ (u) x (y) IF µ (u) x (y) y 10 / 20
11 Measure Transformed Gaussian Quasi LRT MT-GQLRT [Todros & Hero, 2016] Compares the empirical KLDs between Q (u) X;H and two Gaussian measures Φ(µ (u), X;H0 Σ(u) ) and Φ(µ(u), X;H0 X;H1 Σ(u) ) X;H1 [ ] T u = D ˆΣ(u) LD X Σ (u) X;H0 [ ] D ˆΣ(u) LD X Σ (u) X;H1 + ˆµ (u) X ˆµ (u) X µ (u) X;H0 µ (u) X;H1 2 (Σ (u) x;h 0 ) 1 2 (Σ (u) x;h 1 ) 1 H 1 H 0 τ, 11 / 20
12 Measure Transformed Gaussian Quasi LRT MT-GQLRT for the considered detection problem Class of MT-functions: { ( ) } u (x) = v P a x, v : C p R +, v(x) = v( x) MT-mean and MT-covariance under H 0 and H 1 : Σ (u) = X;H0 Σ(u) W Equivalent test statistic: µ (u) = 0, k = 0, 1 X;Hk T u = a H ( Σ (u) W and Σ (u) = X;H1 σ2 Saa H + Σ (u) W ) 1 Ĉ(u) X ( Σ (u) W ) 1 a 12 / 20
13 Plug-in Measure Transformed Gaussian Quasi LRT Plug-in MT-GQLRT Plug-in the empirical MT-covariance of the noise obtained from noise-only secondary data {Y m } ( T u a H ˆΣ(u) Y ) 1 Ĉ(u) X ( ) 1 H 1 ˆΣ(u) Y a t, H 0 Theorem (Asymptotic normality) Assume that 1. σs 2 > 0, Σ(u) W is non-singular 2. E [ u 2 ] [ ] (X) ; P X;H, E X 4 u 2 (X) ; P X;H are finite Then ( ) ( ) N T u η (u) D H N 0, λ (u) H N for H = H 0, H 1 13 / 20
14 Plug-in Measure Transformed Gaussian Quasi LRT Threshold determination t = ˆη (u) H0 + Q 1 (α) ˆλ (u), H0 Guarantees asymptotic CFAR= α ˆη (u) H0 ( ) 1 ah ˆΣ(u) Y a ˆλ(u) H0 M N M m=1 ˆϕ 2 u (Y m ) ( ( ah ˆΣ(u) Y ) 1 Ym 2 ˆη (u) H0 ) 2 14 / 20
15 Plug-in Measure Transformed Gaussian Quasi LRT Selection of the MT-function to induce outlier resilience Gaussian MT-function: u G (x; ω) = exp ( P a x 2 /ω 2) Define the Asymptotic Relative Local Power Sensitivity to change in σs 2 (under nominal Gaussian distribution): R (ω, Σ W ) β u G σs 2 / β LRT σs 2 = σ 2 S =0 NG (ω, ΣW ) + Q 1 (α) N + Q 1 (α) Select the lowest ω such that R (ω, Σ W ) r, 0 << r < 1 In practice Σ W is replaced by: ˆΣ W (ω) = ( ˆΣ(u G ) Y (ω) P a /ω 2 ) 1 15 / 20
16 Simulation Studies Setup BPSK signal with variance σ 2 S Steering vector: a 1 p [ 1, e iπ sin(θ),..., e iπ(p 1) sin(θ)] T, p = 8, θ = 60 Sample size in primary and secondary data: N = 1000, M = 5000 False alarm rate α = 0.05 Asymptotic Relative Local Power Sensitivity: r = / 20
17 Simulation Studies Detection in Gaussian noise Zero-mean Gaussian noise with Toeplitz structured covariance Σ: { σ 2 [Σ] i,j Wb j i, i j ( ) b i j, b < 1,, i > j σ 2 W Power Omniscient LRT Gauss-Gauss detector 0.2 CG-GLRT Plug-in MT-GQLRT (empirical) Plug-in MT-GQLRT (asymptotic) SNR [db] 17 / 20
18 Simulation Studies Detection in elliptical CG noise Elliptical t-distributed noise with λ = 0.2 degrees of freedom and dispersion matrix Σ Power Omniscient LRT Gauss-Gauss detector CG-GLRT Plug-in MT-GQLRT (empirical) Plug-in MT-GQLRT (asymptotic) SNR [db] 18 / 20
19 Simulation Studies Detection in non-elliptical noise Elliptical t-distributed noise + BPSK interference (SIR = 5 [db]) Power Omniscient LRT Gauss-Gauss detector CG-GLRT Plug-in MT-GQLRT (empirical) Plug-in MT-GQLRT (asymptotic) SNR [db] 19 / 20
20 Conclusions Plug-in MT-GQLRT for detection of a random signal that lies on a known rank-one subspace Simple implementation and tractable performance analysis Less sensitive to model mismatch as compared to other model based detectors Extension to non-homogeneous noise environment 20 / 20
MEASURE TRANSFORMED QUASI LIKELIHOOD RATIO TEST
MEASURE TRANSFORMED QUASI LIKELIHOOD RATIO TEST Koby Todros Ben-Gurion University of the Negev Alfred O. Hero University of Michigan ABSTRACT In this paper, a generalization of the Gaussian quasi likelihood
More informationMeasure-Transformed Quasi Maximum Likelihood Estimation
Measure-Transformed Quasi Maximum Likelihood Estimation 1 Koby Todros and Alfred O. Hero Abstract In this paper, we consider the problem of estimating a deterministic vector parameter when the likelihood
More informationPassive Sonar Detection Performance Prediction of a Moving Source in an Uncertain Environment
Acoustical Society of America Meeting Fall 2005 Passive Sonar Detection Performance Prediction of a Moving Source in an Uncertain Environment Vivek Varadarajan and Jeffrey Krolik Duke University Department
More informationComposite Hypotheses and Generalized Likelihood Ratio Tests
Composite Hypotheses and Generalized Likelihood Ratio Tests Rebecca Willett, 06 In many real world problems, it is difficult to precisely specify probability distributions. Our models for data may involve
More informationMEASURE TRANSFORMED QUASI SCORE TEST WITH APPLICATION TO LOCATION MISMATCH DETECTION. Koby Todros. Ben-Gurion University of the Negev
MEASURE TRASFORME QUASI SCORE TEST WITH ALICATIO TO LOCATIO MISMATCH ETECTIO Koby Todros Ben-Gurion University of the egev ABSTRACT In this paper, we develop a generalization of the Gaussian quasi score
More informationCFAR TARGET DETECTION IN TREE SCATTERING INTERFERENCE
CFAR TARGET DETECTION IN TREE SCATTERING INTERFERENCE Anshul Sharma and Randolph L. Moses Department of Electrical Engineering, The Ohio State University, Columbus, OH 43210 ABSTRACT We have developed
More informationApplications of Information Geometry to Hypothesis Testing and Signal Detection
CMCAA 2016 Applications of Information Geometry to Hypothesis Testing and Signal Detection Yongqiang Cheng National University of Defense Technology July 2016 Outline 1. Principles of Information Geometry
More information10. Composite Hypothesis Testing. ECE 830, Spring 2014
10. Composite Hypothesis Testing ECE 830, Spring 2014 1 / 25 In many real world problems, it is difficult to precisely specify probability distributions. Our models for data may involve unknown parameters
More informationRobust covariance matrices estimation and applications in signal processing
Robust covariance matrices estimation and applications in signal processing F. Pascal SONDRA/Supelec GDR ISIS Journée Estimation et traitement statistique en grande dimension May 16 th, 2013 FP (SONDRA/Supelec)
More informationAntonio De Maio, Maria S. Greco, and Danilo Orlando. 1.1 Historical Background and Terminology Symbols Detection Theory 6
Contents 1 Introduction to Radar Detection 1 Antonio De Maio, Maria S. Greco, and Danilo Orlando 1.1 Historical Background and Terminology 1 1.2 Symbols 5 1.3 Detection Theory 6 1.3.1 Signal and Interference
More informationDetection of Anomalies in Texture Images using Multi-Resolution Features
Detection of Anomalies in Texture Images using Multi-Resolution Features Electrical Engineering Department Supervisor: Prof. Israel Cohen Outline Introduction 1 Introduction Anomaly Detection Texture Segmentation
More informationA GLRT FOR RADAR DETECTION IN THE PRESENCE OF COMPOUND-GAUSSIAN CLUTTER AND ADDITIVE WHITE GAUSSIAN NOISE. James H. Michels. Bin Liu, Biao Chen
A GLRT FOR RADAR DETECTION IN THE PRESENCE OF COMPOUND-GAUSSIAN CLUTTER AND ADDITIVE WHITE GAUSSIAN NOISE Bin Liu, Biao Chen Syracuse University Dept of EECS, Syracuse, NY 3244 email : biliu{bichen}@ecs.syr.edu
More informationEECS564 Estimation, Filtering, and Detection Exam 2 Week of April 20, 2015
EECS564 Estimation, Filtering, and Detection Exam Week of April 0, 015 This is an open book takehome exam. You have 48 hours to complete the exam. All work on the exam should be your own. problems have
More informationA SIRV-CFAR Adaptive Detector Exploiting Persymmetric Clutter Covariance Structure
A SIRV-CFAR Adaptive Detector Exploiting Persymmetric Clutter Covariance Structure Guilhem Pailloux 2 Jean-Philippe Ovarlez Frédéric Pascal 3 and Philippe Forster 2 ONERA - DEMR/TSI Chemin de la Hunière
More informationSignal Processing for MIMO Radars. under Gaussian and non-gaussian environments and application to STAP
Signal processing for MIMO radars: Detection under Gaussian and non-gaussian environments and application to STAP CHONG Chin Yuan Thesis Director: Marc LESTURGIE (ONERA/SONDRA) Supervisor: Frédéric PASCAL
More informationRobust adaptive detection of buried pipes using GPR
Robust adaptive detection of buried pipes using GPR Q. Hoarau, G. Ginolhac, A. M. Atto, J.-P. Ovarlez, J.-M. Nicolas Université Savoie Mont Blanc - Centrale Supelec - Télécom ParisTech 12 th July 2016
More informationAdaptive Array Detection, Estimation and Beamforming
Adaptive Array Detection, Estimation and Beamforming Christ D. Richmond Workshop on Stochastic Eigen-Analysis and its Applications 3:30pm, Monday, July 10th 2006 C. D. Richmond-1 *This work was sponsored
More informationMultivariate Distributions
IEOR E4602: Quantitative Risk Management Spring 2016 c 2016 by Martin Haugh Multivariate Distributions We will study multivariate distributions in these notes, focusing 1 in particular on multivariate
More informationA NEW BAYESIAN LOWER BOUND ON THE MEAN SQUARE ERROR OF ESTIMATORS. Koby Todros and Joseph Tabrikian
16th European Signal Processing Conference EUSIPCO 008) Lausanne Switzerland August 5-9 008 copyright by EURASIP A NEW BAYESIAN LOWER BOUND ON THE MEAN SQUARE ERROR OF ESTIMATORS Koby Todros and Joseph
More informationLecture 8: Signal Detection and Noise Assumption
ECE 830 Fall 0 Statistical Signal Processing instructor: R. Nowak Lecture 8: Signal Detection and Noise Assumption Signal Detection : X = W H : X = S + W where W N(0, σ I n n and S = [s, s,..., s n ] T
More informationADAPTIVE ARRAY DETECTION ALGORITHMS WITH STEERING VECTOR MISMATCH
ADAPTIVE ARRAY DETECTIO ALGORITHMS WITH STEERIG VECTOR MISMATCH LIM Chin Heng, Elias Aboutanios Bernard Mulgrew Institute for Digital Communications School of Engineering & Electronics, University of Edinburgh
More informationIndependent Component (IC) Models: New Extensions of the Multinormal Model
Independent Component (IC) Models: New Extensions of the Multinormal Model Davy Paindaveine (joint with Klaus Nordhausen, Hannu Oja, and Sara Taskinen) School of Public Health, ULB, April 2008 My research
More informationRobust Principal Component Analysis
ELE 538B: Mathematics of High-Dimensional Data Robust Principal Component Analysis Yuxin Chen Princeton University, Fall 2018 Disentangling sparse and low-rank matrices Suppose we are given a matrix M
More informationOutline of GLMs. Definitions
Outline of GLMs Definitions This is a short outline of GLM details, adapted from the book Nonparametric Regression and Generalized Linear Models, by Green and Silverman. The responses Y i have density
More informationStructured signal recovery from non-linear and heavy-tailed measurements
Structured signal recovery from non-linear and heavy-tailed measurements Larry Goldstein* Stanislav Minsker* Xiaohan Wei # *Department of Mathematics # Department of Electrical Engineering UniversityofSouthern
More informationRobust Testing and Variable Selection for High-Dimensional Time Series
Robust Testing and Variable Selection for High-Dimensional Time Series Ruey S. Tsay Booth School of Business, University of Chicago May, 2017 Ruey S. Tsay HTS 1 / 36 Outline 1 Focus on high-dimensional
More informationF2E5216/TS1002 Adaptive Filtering and Change Detection. Course Organization. Lecture plan. The Books. Lecture 1
Adaptive Filtering and Change Detection Bo Wahlberg (KTH and Fredrik Gustafsson (LiTH Course Organization Lectures and compendium: Theory, Algorithms, Applications, Evaluation Toolbox and manual: Algorithms,
More informationCFAR DETECTION OF SPATIALLY DISTRIBUTED TARGETS IN K- DISTRIBUTED CLUTTER WITH UNKNOWN PARAMETERS
CFAR DETECTION OF SPATIALLY DISTRIBUTED TARGETS IN K- DISTRIBUTED CLUTTER WITH UNKNOWN PARAMETERS N. Nouar and A.Farrouki SISCOM Laboratory, Department of Electrical Engineering, University of Constantine,
More informationLecture 5: Likelihood ratio tests, Neyman-Pearson detectors, ROC curves, and sufficient statistics. 1 Executive summary
ECE 830 Spring 207 Instructor: R. Willett Lecture 5: Likelihood ratio tests, Neyman-Pearson detectors, ROC curves, and sufficient statistics Executive summary In the last lecture we saw that the likelihood
More informationDetection theory 101 ELEC-E5410 Signal Processing for Communications
Detection theory 101 ELEC-E5410 Signal Processing for Communications Binary hypothesis testing Null hypothesis H 0 : e.g. noise only Alternative hypothesis H 1 : signal + noise p(x;h 0 ) γ p(x;h 1 ) Trade-off
More informationMULTICHANNEL SIGNAL PROCESSING USING SPATIAL RANK COVARIANCE MATRICES
MULTICHANNEL SIGNAL PROCESSING USING SPATIAL RANK COVARIANCE MATRICES S. Visuri 1 H. Oja V. Koivunen 1 1 Signal Processing Lab. Dept. of Statistics Tampere Univ. of Technology University of Jyväskylä P.O.
More informationProbabilistic & Unsupervised Learning
Probabilistic & Unsupervised Learning Week 2: Latent Variable Models Maneesh Sahani maneesh@gatsby.ucl.ac.uk Gatsby Computational Neuroscience Unit, and MSc ML/CSML, Dept Computer Science University College
More informationStatement: With my signature I confirm that the solutions are the product of my own work. Name: Signature:.
MATHEMATICAL STATISTICS Homework assignment Instructions Please turn in the homework with this cover page. You do not need to edit the solutions. Just make sure the handwriting is legible. You may discuss
More informationMultivariate Statistics
Multivariate Statistics Chapter 2: Multivariate distributions and inference Pedro Galeano Departamento de Estadística Universidad Carlos III de Madrid pedro.galeano@uc3m.es Course 2016/2017 Master in Mathematical
More informationStat 579: Generalized Linear Models and Extensions
Stat 579: Generalized Linear Models and Extensions Mixed models Yan Lu March, 2018, week 8 1 / 32 Restricted Maximum Likelihood (REML) REML: uses a likelihood function calculated from the transformed set
More informationUncertainty. Jayakrishnan Unnikrishnan. CSL June PhD Defense ECE Department
Decision-Making under Statistical Uncertainty Jayakrishnan Unnikrishnan PhD Defense ECE Department University of Illinois at Urbana-Champaign CSL 141 12 June 2010 Statistical Decision-Making Relevant in
More informationREGRESSION WITH SPATIALLY MISALIGNED DATA. Lisa Madsen Oregon State University David Ruppert Cornell University
REGRESSION ITH SPATIALL MISALIGNED DATA Lisa Madsen Oregon State University David Ruppert Cornell University SPATIALL MISALIGNED DATA 10 X X X X X X X X 5 X X X X X 0 X 0 5 10 OUTLINE 1. Introduction 2.
More informationSolving Corrupted Quadratic Equations, Provably
Solving Corrupted Quadratic Equations, Provably Yuejie Chi London Workshop on Sparse Signal Processing September 206 Acknowledgement Joint work with Yuanxin Li (OSU), Huishuai Zhuang (Syracuse) and Yingbin
More informationMinimum Message Length Analysis of the Behrens Fisher Problem
Analysis of the Behrens Fisher Problem Enes Makalic and Daniel F Schmidt Centre for MEGA Epidemiology The University of Melbourne Solomonoff 85th Memorial Conference, 2011 Outline Introduction 1 Introduction
More informationSub-Gaussian Estimators of the Mean of a Random Matrix with Entries Possessing Only Two Moments
Sub-Gaussian Estimators of the Mean of a Random Matrix with Entries Possessing Only Two Moments Stas Minsker University of Southern California July 21, 2016 ICERM Workshop Simple question: how to estimate
More informationTARGET DETECTION WITH FUNCTION OF COVARIANCE MATRICES UNDER CLUTTER ENVIRONMENT
TARGET DETECTION WITH FUNCTION OF COVARIANCE MATRICES UNDER CLUTTER ENVIRONMENT Feng Lin, Robert C. Qiu, James P. Browning, Michael C. Wicks Cognitive Radio Institute, Department of Electrical and Computer
More informationExponential Family and Maximum Likelihood, Gaussian Mixture Models and the EM Algorithm. by Korbinian Schwinger
Exponential Family and Maximum Likelihood, Gaussian Mixture Models and the EM Algorithm by Korbinian Schwinger Overview Exponential Family Maximum Likelihood The EM Algorithm Gaussian Mixture Models Exponential
More informationMultivariate Regression
Multivariate Regression The so-called supervised learning problem is the following: we want to approximate the random variable Y with an appropriate function of the random variables X 1,..., X p with the
More informationPhysical Layer Binary Consensus. Study
Protocols: A Study Venugopalakrishna Y. R. and Chandra R. Murthy ECE Dept., IISc, Bangalore 23 rd Nov. 2013 Outline Introduction to Consensus Problem Setup Protocols LMMSE-based scheme Co-phased combining
More informationThe Effect of Spatial Correlations on MIMO Capacity: A (not so) Large N Analytical Approach: Aris Moustakas 1, Steven Simon 1 & Anirvan Sengupta 1,2
The Effect of Spatial Correlations on MIMO Capacity: A (not so) Large N Analytical Approach: Aris Moustakas 1, Steven Simon 1 & Anirvan Sengupta 1, 1, Rutgers University Outline Aim: Calculate statistics
More informationSparse regression. Optimization-Based Data Analysis. Carlos Fernandez-Granda
Sparse regression Optimization-Based Data Analysis http://www.cims.nyu.edu/~cfgranda/pages/obda_spring16 Carlos Fernandez-Granda 3/28/2016 Regression Least-squares regression Example: Global warming Logistic
More informationEmpirical likelihood and self-weighting approach for hypothesis testing of infinite variance processes and its applications
Empirical likelihood and self-weighting approach for hypothesis testing of infinite variance processes and its applications Fumiya Akashi Research Associate Department of Applied Mathematics Waseda University
More informationExogeneity tests and weak identification
Cireq, Cirano, Départ. Sc. Economiques Université de Montréal Jean-Marie Dufour Cireq, Cirano, William Dow Professor of Economics Department of Economics Mcgill University June 20, 2008 Main Contributions
More informationAppendix to Portfolio Construction by Mitigating Error Amplification: The Bounded-Noise Portfolio
Appendix to Portfolio Construction by Mitigating Error Amplification: The Bounded-Noise Portfolio Long Zhao, Deepayan Chakrabarti, and Kumar Muthuraman McCombs School of Business, University of Texas,
More informationhigh-dimensional inference robust to the lack of model sparsity
high-dimensional inference robust to the lack of model sparsity Jelena Bradic (joint with a PhD student Yinchu Zhu) www.jelenabradic.net Assistant Professor Department of Mathematics University of California,
More informationRobust Subspace DOA Estimation for Wireless Communications
Robust Subspace DOA Estimation for Wireless Communications Samuli Visuri Hannu Oja ¾ Visa Koivunen Laboratory of Signal Processing Computer Technology Helsinki Univ. of Technology P.O. Box 3, FIN-25 HUT
More information2. What are the tradeoffs among different measures of error (e.g. probability of false alarm, probability of miss, etc.)?
ECE 830 / CS 76 Spring 06 Instructors: R. Willett & R. Nowak Lecture 3: Likelihood ratio tests, Neyman-Pearson detectors, ROC curves, and sufficient statistics Executive summary In the last lecture we
More informationMULTIPLE-CHANNEL DETECTION IN ACTIVE SENSING. Kaitlyn Beaudet and Douglas Cochran
MULTIPLE-CHANNEL DETECTION IN ACTIVE SENSING Kaitlyn Beaudet and Douglas Cochran School of Electrical, Computer and Energy Engineering Arizona State University, Tempe AZ 85287-576 USA ABSTRACT The problem
More informationAn introduction to G-estimation with sample covariance matrices
An introduction to G-estimation with sample covariance matrices Xavier estre xavier.mestre@cttc.cat Centre Tecnològic de Telecomunicacions de Catalunya (CTTC) "atrices aleatoires: applications aux communications
More informationPASSIVE array signal processing has gained considerable
IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 50, NO. 11, NOVEMBER 2002 2617 General Asymptotic Analysis of the Generalized Likelihood Ratio Test for a Gaussian Point Source Under Statistical or Spatial
More informationSliced Inverse Regression
Sliced Inverse Regression Ge Zhao gzz13@psu.edu Department of Statistics The Pennsylvania State University Outline Background of Sliced Inverse Regression (SIR) Dimension Reduction Definition of SIR Inversed
More informationBrief Review on Estimation Theory
Brief Review on Estimation Theory K. Abed-Meraim ENST PARIS, Signal and Image Processing Dept. abed@tsi.enst.fr This presentation is essentially based on the course BASTA by E. Moulines Brief review on
More informationUNIFORMLY MOST POWERFUL CYCLIC PERMUTATION INVARIANT DETECTION FOR DISCRETE-TIME SIGNALS
UNIFORMLY MOST POWERFUL CYCLIC PERMUTATION INVARIANT DETECTION FOR DISCRETE-TIME SIGNALS F. C. Nicolls and G. de Jager Department of Electrical Engineering, University of Cape Town Rondebosch 77, South
More informationRegularized PCA to denoise and visualise data
Regularized PCA to denoise and visualise data Marie Verbanck Julie Josse François Husson Laboratoire de statistique, Agrocampus Ouest, Rennes, France CNAM, Paris, 16 janvier 2013 1 / 30 Outline 1 PCA 2
More informationDETECTION theory deals primarily with techniques for
ADVANCED SIGNAL PROCESSING SE Optimum Detection of Deterministic and Random Signals Stefan Tertinek Graz University of Technology turtle@sbox.tugraz.at Abstract This paper introduces various methods for
More informationMODEL ORDER ESTIMATION FOR ADAPTIVE RADAR CLUTTER CANCELLATION. Kelly Hall, 4 East Alumni Ave. Kingston, RI 02881
MODEL ORDER ESTIMATION FOR ADAPTIVE RADAR CLUTTER CANCELLATION Muralidhar Rangaswamy 1, Steven Kay 2, Cuichun Xu 2, and Freeman C. Lin 3 1 Air Force Research Laboratory, Sensors Directorate, 80 Scott Drive,
More informationLecture 7 Introduction to Statistical Decision Theory
Lecture 7 Introduction to Statistical Decision Theory I-Hsiang Wang Department of Electrical Engineering National Taiwan University ihwang@ntu.edu.tw December 20, 2016 1 / 55 I-Hsiang Wang IT Lecture 7
More informationChapter 9: Hypothesis Testing Sections
Chapter 9: Hypothesis Testing Sections 9.1 Problems of Testing Hypotheses 9.2 Testing Simple Hypotheses 9.3 Uniformly Most Powerful Tests Skip: 9.4 Two-Sided Alternatives 9.6 Comparing the Means of Two
More informationLecture 7 MIMO Communica2ons
Wireless Communications Lecture 7 MIMO Communica2ons Prof. Chun-Hung Liu Dept. of Electrical and Computer Engineering National Chiao Tung University Fall 2014 1 Outline MIMO Communications (Chapter 10
More informationThe outline for Unit 3
The outline for Unit 3 Unit 1. Introduction: The regression model. Unit 2. Estimation principles. Unit 3: Hypothesis testing principles. 3.1 Wald test. 3.2 Lagrange Multiplier. 3.3 Likelihood Ratio Test.
More informationDS-GA 1002 Lecture notes 10 November 23, Linear models
DS-GA 2 Lecture notes November 23, 2 Linear functions Linear models A linear model encodes the assumption that two quantities are linearly related. Mathematically, this is characterized using linear functions.
More informationSignal Detection Basics - CFAR
Signal Detection Basics - CFAR Types of noise clutter and signals targets Signal separation by comparison threshold detection Signal Statistics - Parameter estimation Threshold determination based on the
More informationMaximum Achievable Diversity for MIMO-OFDM Systems with Arbitrary. Spatial Correlation
Maximum Achievable Diversity for MIMO-OFDM Systems with Arbitrary Spatial Correlation Ahmed K Sadek, Weifeng Su, and K J Ray Liu Department of Electrical and Computer Engineering, and Institute for Systems
More informationA PARAMETRIC MOVING TARGET DETECTOR FOR DISTRIBUTED MIMO RADAR IN NON-HOMOGENEOUS ENVIRONMENT
A PARAMETRIC MOVING TARGET DETECTOR FOR DISTRIBUTED MIMO RADAR IN NON-OMOGENEOUS ENVIRONMENT Pu Wang, ongbin Li, and Braham imed ECE DEPT, Stevens Institute of Technology, oboken, NJ 73, USA AFRL/RYMD,
More informationHypothesis Testing Based on the Maximum of Two Statistics from Weighted and Unweighted Estimating Equations
Hypothesis Testing Based on the Maximum of Two Statistics from Weighted and Unweighted Estimating Equations Takeshi Emura and Hisayuki Tsukuma Abstract For testing the regression parameter in multivariate
More informationSystem Identification, Lecture 4
System Identification, Lecture 4 Kristiaan Pelckmans (IT/UU, 2338) Course code: 1RT880, Report code: 61800 - Spring 2012 F, FRI Uppsala University, Information Technology 30 Januari 2012 SI-2012 K. Pelckmans
More informationMFM Practitioner Module: Quantitiative Risk Management. John Dodson. October 14, 2015
MFM Practitioner Module: Quantitiative Risk Management October 14, 2015 The n-block maxima 1 is a random variable defined as M n max (X 1,..., X n ) for i.i.d. random variables X i with distribution function
More informationNonlinear Signal Processing ELEG 833
Nonlinear Signal Processing ELEG 833 Gonzalo R. Arce Department of Electrical and Computer Engineering University of Delaware arce@ee.udel.edu May 5, 2005 8 MYRIAD SMOOTHERS 8 Myriad Smoothers 8.1 FLOM
More informationSystem Identification, Lecture 4
System Identification, Lecture 4 Kristiaan Pelckmans (IT/UU, 2338) Course code: 1RT880, Report code: 61800 - Spring 2016 F, FRI Uppsala University, Information Technology 13 April 2016 SI-2016 K. Pelckmans
More informationANALYSIS OF A PARTIAL DECORRELATOR IN A MULTI-CELL DS/CDMA SYSTEM
ANAYSIS OF A PARTIA DECORREATOR IN A MUTI-CE DS/CDMA SYSTEM Mohammad Saquib ECE Department, SU Baton Rouge, A 70803-590 e-mail: saquib@winlab.rutgers.edu Roy Yates WINAB, Rutgers University Piscataway
More informationMMSE-Based Filtering for Linear and Nonlinear Systems in the Presence of Non-Gaussian System and Measurement Noise
MMSE-Based Filtering for Linear and Nonlinear Systems in the Presence of Non-Gaussian System and Measurement Noise I. Bilik 1 and J. Tabrikian 2 1 Dept. of Electrical and Computer Engineering, University
More informationFinite Singular Multivariate Gaussian Mixture
21/06/2016 Plan 1 Basic definitions Singular Multivariate Normal Distribution 2 3 Plan Singular Multivariate Normal Distribution 1 Basic definitions Singular Multivariate Normal Distribution 2 3 Multivariate
More informationNotes on the Multivariate Normal and Related Topics
Version: July 10, 2013 Notes on the Multivariate Normal and Related Topics Let me refresh your memory about the distinctions between population and sample; parameters and statistics; population distributions
More informationIntroduction to Rare Event Simulation
Introduction to Rare Event Simulation Brown University: Summer School on Rare Event Simulation Jose Blanchet Columbia University. Department of Statistics, Department of IEOR. Blanchet (Columbia) 1 / 31
More informationMaximum Likelihood Methods in Radar Array Signal Processing
Maximum Likelihood Methods in Radar Array Signal Processing A. LEE SWINDLEHURST, MEMBER, IEEE, AND PETRE STOICA, FELLOW, IEEE We consider robust and computationally efficient maximum likelihood algorithms
More informationRandom Matrix Theory Lecture 1 Introduction, Ensembles and Basic Laws. Symeon Chatzinotas February 11, 2013 Luxembourg
Random Matrix Theory Lecture 1 Introduction, Ensembles and Basic Laws Symeon Chatzinotas February 11, 2013 Luxembourg Outline 1. Random Matrix Theory 1. Definition 2. Applications 3. Asymptotics 2. Ensembles
More informationPh.D. Qualifying Exam Friday Saturday, January 6 7, 2017
Ph.D. Qualifying Exam Friday Saturday, January 6 7, 2017 Put your solution to each problem on a separate sheet of paper. Problem 1. (5106) Let X 1, X 2,, X n be a sequence of i.i.d. observations from a
More informationA Probability Review
A Probability Review Outline: A probability review Shorthand notation: RV stands for random variable EE 527, Detection and Estimation Theory, # 0b 1 A Probability Review Reading: Go over handouts 2 5 in
More informationPerformance Analysis of the Nonhomogeneity Detector for STAP Applications
Performance Analysis of the Nonhomogeneity Detector for STAP Applications uralidhar Rangaswamy ARCON Corporation 6 Bear ill Rd. Waltham, assachusetts, USA Braham imed AFRL/SNRT 6 Electronic Parway Rome,
More informationStatistics and Data Analysis
Statistics and Data Analysis The Crash Course Physics 226, Fall 2013 "There are three kinds of lies: lies, damned lies, and statistics. Mark Twain, allegedly after Benjamin Disraeli Statistics and Data
More informationEfficient and Robust Scale Estimation
Efficient and Robust Scale Estimation Garth Tarr, Samuel Müller and Neville Weber School of Mathematics and Statistics THE UNIVERSITY OF SYDNEY Outline Introduction and motivation The robust scale estimator
More informationGeneralized Linear Models. Kurt Hornik
Generalized Linear Models Kurt Hornik Motivation Assuming normality, the linear model y = Xβ + e has y = β + ε, ε N(0, σ 2 ) such that y N(μ, σ 2 ), E(y ) = μ = β. Various generalizations, including general
More informationALARGE class of modern array processing techniques are
IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 52, NO. 6, JUNE 2004 1537 Detection of Distributed Sources Using Sensor Arrays Yuanwei Jin, Member, IEEE, and Benjamin Friedlander, Fellow, IEEE Abstract In
More informationModel Fitting. Jean Yves Le Boudec
Model Fitting Jean Yves Le Boudec 0 Contents 1. What is model fitting? 2. Linear Regression 3. Linear regression with norm minimization 4. Choosing a distribution 5. Heavy Tail 1 Virus Infection Data We
More informationLecture 12 Robust Estimation
Lecture 12 Robust Estimation Prof. Dr. Svetlozar Rachev Institute for Statistics and Mathematical Economics University of Karlsruhe Financial Econometrics, Summer Semester 2007 Copyright These lecture-notes
More informationSTAT 200C: High-dimensional Statistics
STAT 200C: High-dimensional Statistics Arash A. Amini May 30, 2018 1 / 57 Table of Contents 1 Sparse linear models Basis Pursuit and restricted null space property Sufficient conditions for RNS 2 / 57
More informationLecture 15. Hypothesis testing in the linear model
14. Lecture 15. Hypothesis testing in the linear model Lecture 15. Hypothesis testing in the linear model 1 (1 1) Preliminary lemma 15. Hypothesis testing in the linear model 15.1. Preliminary lemma Lemma
More informationSummary: the confidence interval for the mean (σ 2 known) with gaussian assumption
Summary: the confidence interval for the mean (σ known) with gaussian assumption on X Let X be a Gaussian r.v. with mean µ and variance σ. If X 1, X,..., X n is a random sample drawn from X then the confidence
More informationAdaptive beamforming for uniform linear arrays with unknown mutual coupling. IEEE Antennas and Wireless Propagation Letters.
Title Adaptive beamforming for uniform linear arrays with unknown mutual coupling Author(s) Liao, B; Chan, SC Citation IEEE Antennas And Wireless Propagation Letters, 2012, v. 11, p. 464-467 Issued Date
More informationEUSIPCO
EUSIPCO 3 569736677 FULLY ISTRIBUTE SIGNAL ETECTION: APPLICATION TO COGNITIVE RAIO Franc Iutzeler Philippe Ciblat Telecom ParisTech, 46 rue Barrault 753 Paris, France email: firstnamelastname@telecom-paristechfr
More informationEstimation of large dimensional sparse covariance matrices
Estimation of large dimensional sparse covariance matrices Department of Statistics UC, Berkeley May 5, 2009 Sample covariance matrix and its eigenvalues Data: n p matrix X n (independent identically distributed)
More informationLecture 3. Inference about multivariate normal distribution
Lecture 3. Inference about multivariate normal distribution 3.1 Point and Interval Estimation Let X 1,..., X n be i.i.d. N p (µ, Σ). We are interested in evaluation of the maximum likelihood estimates
More informationMultivariate Statistical Analysis
Multivariate Statistical Analysis Fall 2011 C. L. Williams, Ph.D. Lecture 9 for Applied Multivariate Analysis Outline Addressing ourliers 1 Addressing ourliers 2 Outliers in Multivariate samples (1) For
More informationStatistical Inference On the High-dimensional Gaussian Covarianc
Statistical Inference On the High-dimensional Gaussian Covariance Matrix Department of Mathematical Sciences, Clemson University June 6, 2011 Outline Introduction Problem Setup Statistical Inference High-Dimensional
More informationTesting Algebraic Hypotheses
Testing Algebraic Hypotheses Mathias Drton Department of Statistics University of Chicago 1 / 18 Example: Factor analysis Multivariate normal model based on conditional independence given hidden variable:
More information