REVEAL. Receiver Exploiting Variability in Estimated Acoustic Levels Project Review 16 Sept 2008

Similar documents
Parametric Models. Dr. Shuang LIANG. School of Software Engineering TongJi University Fall, 2012

An Invariance Property of the Generalized Likelihood Ratio Test

SYDE 372 Introduction to Pattern Recognition. Probability Measures for Classification: Part I

Classification CE-717: Machine Learning Sharif University of Technology. M. Soleymani Fall 2012

Expectation Propagation for Approximate Bayesian Inference

Detection theory 101 ELEC-E5410 Signal Processing for Communications

Part 1: Expectation Propagation

Detection Theory. Chapter 3. Statistical Decision Theory I. Isael Diaz Oct 26th 2010

Fundamentals of Statistical Signal Processing Volume II Detection Theory

GAMINGRE 8/1/ of 7

Yellow Sea Thermohaline and Acoustic Variability

Naïve Bayes classification

Bayesian Regression Linear and Logistic Regression

Introduction to Systems Analysis and Decision Making Prepared by: Jakub Tomczak

PATTERN RECOGNITION AND MACHINE LEARNING

Optimum Passive Beamforming in Relation to Active-Passive Data Fusion

What does Bayes theorem give us? Lets revisit the ball in the box example.

OPTIMAL ADAPTIVE TRANSMIT BEAMFORMING FOR COGNITIVE MIMO SONAR IN A SHALLOW WATER WAVEGUIDE

2D Image Processing (Extended) Kalman and particle filter

Bayesian Learning (II)

Acoustic Scattering from a Poro-Elastic Sediment

STONY BROOK UNIVERSITY. CEAS Technical Report 829

Sensitivity Considerations in Compressed Sensing

Robust Range-rate Estimation of Passive Narrowband Sources in Shallow Water

Learning features by contrasting natural images with noise

Naïve Bayes classification. p ij 11/15/16. Probability theory. Probability theory. Probability theory. X P (X = x i )=1 i. Marginal Probability

EEL 851: Biometrics. An Overview of Statistical Pattern Recognition EEL 851 1

A Variance Modeling Framework Based on Variational Autoencoders for Speech Enhancement

Uncertainty. Jayakrishnan Unnikrishnan. CSL June PhD Defense ECE Department

BAYESIAN PROCESSOR OF ENSEMBLE (BPE): PRIOR DISTRIBUTION FUNCTION

A Modified Baum Welch Algorithm for Hidden Markov Models with Multiple Observation Spaces

Introduction to Bayesian Inference

Lecture 2: From Linear Regression to Kalman Filter and Beyond

Bayesian Decision Theory

Bayesian Decision and Bayesian Learning

Probability Map Building of Uncertain Dynamic Environments with Indistinguishable Obstacles

Marine and Physical Acoustics Division Overview

Variational inference

Parametric Techniques Lecture 3

COURSE INTRODUCTION. J. Elder CSE 6390/PSYC 6225 Computational Modeling of Visual Perception

Modifying Voice Activity Detection in Low SNR by correction factors

Probabilistic classification CE-717: Machine Learning Sharif University of Technology. M. Soleymani Fall 2016

MULTIPLE-CHANNEL DETECTION IN ACTIVE SENSING. Kaitlyn Beaudet and Douglas Cochran

Parametric Techniques

Efficient Likelihood-Free Inference

A Bound on Mean-Square Estimation Error Accounting for System Model Mismatch

Lecture 2: From Linear Regression to Kalman Filter and Beyond

Learning with Noisy Labels. Kate Niehaus Reading group 11-Feb-2014

Sensor Tasking and Control

ESTIMATING INDEPENDENT-SCATTERER DENSITY FROM ACTIVE SONAR REVERBERATION

UNIFORMLY MOST POWERFUL CYCLIC PERMUTATION INVARIANT DETECTION FOR DISCRETE-TIME SIGNALS

Passive Sonar Detection Performance Prediction of a Moving Source in an Uncertain Environment

Waveguide invariant analysis for modeling time frequency striations in a range dependent environment.

BLIND SEPARATION OF INSTANTANEOUS MIXTURES OF NON STATIONARY SOURCES

Engineering Part IIB: Module 4F10 Statistical Pattern Processing Lecture 5: Single Layer Perceptrons & Estimating Linear Classifiers

QUANTIZATION FOR DISTRIBUTED ESTIMATION IN LARGE SCALE SENSOR NETWORKS

Bayesian Methods in Positioning Applications

A Unifying View of Image Similarity

EVALUATING SYMMETRIC INFORMATION GAP BETWEEN DYNAMICAL SYSTEMS USING PARTICLE FILTER

Human Pose Tracking I: Basics. David Fleet University of Toronto

Lecture 5: Bayes pt. 1

Bayesian X-ray Computed Tomography using a Three-level Hierarchical Prior Model

10. Composite Hypothesis Testing. ECE 830, Spring 2014

BROADBAND MIMO SONAR SYSTEM: A THEORETICAL AND EXPERIMENTAL APPROACH

Probabilistic Graphical Networks: Definitions and Basic Results

Support Vector Machines

Sparse Bayesian Logistic Regression with Hierarchical Prior and Variational Inference

Introduction to Statistical Inference

Machine Learning Overview

Lecture : Probabilistic Machine Learning

Introduction to Machine Learning

THE problem of phase noise and its influence on oscillators

Chapter 3: Maximum-Likelihood & Bayesian Parameter Estimation (part 1)

Sound Source Tracking Using Microphone Arrays

MIT Spring 2016

Intro. ANN & Fuzzy Systems. Lecture 15. Pattern Classification (I): Statistical Formulation

Linear Classification: Probabilistic Generative Models

Virtual Array Processing for Active Radar and Sonar Sensing

Accelerated MRI Image Reconstruction

Sparse Sensing for Statistical Inference

Pattern Recognition. Parameter Estimation of Probability Density Functions

Scalable robust hypothesis tests using graphical models

Sequential Bayesian Estimation of the Probability of Detection for Tracking

Stat 535 C - Statistical Computing & Monte Carlo Methods. Arnaud Doucet.

Multivariate statistical methods and data mining in particle physics

Ch 4. Linear Models for Classification

Jayalath Ekanayake Jonas Tappolet Harald Gall Abraham Bernstein. Time variance and defect prediction in software projects: additional figures

Lecture 4: Probabilistic Learning. Estimation Theory. Classification with Probability Distributions

Chapter 2. Binary and M-ary Hypothesis Testing 2.1 Introduction (Levy 2.1)

Detection in reverberation using space time adaptive prewhiteners

Advanced statistical methods for data analysis Lecture 1

Lecture 6: Model Checking and Selection

Active Sonar Target Classification Using Classifier Ensembles

Fusion of Decisions Transmitted Over Fading Channels in Wireless Sensor Networks

Overview. Probabilistic Interpretation of Linear Regression Maximum Likelihood Estimation Bayesian Estimation MAP Estimation

σ(a) = a N (x; 0, 1 2 ) dx. σ(a) = Φ(a) =

computation of the algorithms it is useful to introduce some sort of mapping that reduces the dimension of the data set before applying signal process

ECE531 Lecture 6: Detection of Discrete-Time Signals with Random Parameters

Bayesian Dropout. Tue Herlau, Morten Morup and Mikkel N. Schmidt. Feb 20, Discussed by: Yizhe Zhang

A Monte Carlo Sequential Estimation for Point Process Optimum Filtering

Transcription:

REVEAL Receiver Exploiting Variability in Estimated Acoustic Levels Project Review 16 Sept 2008 Presented to Program Officers: Drs. John Tague and Keith Davidson Undersea Signal Processing Team, Office of Naval Research Penn State Team: Faculty: R. Lee Culver 1 and Nirmal K. Bose 2 Students: Colin W. Jemmott 3, Jeremy Joseph 3, Brett Bissinger 2, and Alex Sell 3 1 Applied Research Lab, 2 Department of Electrical Engineering, and 3 Penn State University, State College, PA Contact info: 814 865-3383 rlc5@psu.edu 16 September 2008 REVEAL Overview and Progress 1

REVEAL Long Range Goals Develop a signal processing structure that exploits environmental knowledge by incorporating signal and noise predictions. Use this SP structure to develop improved detectors and classifiers which remain robust to variable and random signal and noise. No specific system application, but focus on passive sonar and frequency 1 khz. Train the future generation of ocean acousticians and signal processors. 16 September 2008 REVEAL Overview and Progress 2

REVEAL Project focus Since FY05, the project goal has been to work at the interface between OA and SP in order to apply and transition OA products to SP algorithms. Ocean acoustics REVEAL focus Sonar signal processing transition 16 September 2008 REVEAL Overview and Progress 3

REVEAL approach Ocean acoustic models and knowledge Compute signal and noise parameter statistics (also called prior statistics or training data) Passive beamformed sonar data M-ary detector or classifier decision Estimated Ocean Detector (composite Likelihood Ratio) Kullback-Leibler divergence (et. al.) Bayesian (histogram) filter 16 September 2008 REVEAL Overview and Progress 4

Classification using discriminant functions Signal parameters Discriminant functions 16 September 2008 REVEAL Overview and Progress 5

Typical problem The signal is affected by propagation through the ocean, and we have knowledge and models for the oceanic properties and processes that affect acoustic propagation. Our approach is to use Monte Carlo simulation to obtain many realizations of the signal from statistically-valid realizations of the environment in order to classify the signal source. p 1 (s(θ)) pdf of signal from near-surface source (H 1 ) Source near the surface Receive array p 2 (s(θ)) pdf of signal from near-bottom source (H 2 ) Source near the bottom 16 September 2008 REVEAL Overview and Progress 6

Composite LR Consider observation r = s( θ ) + n. A composite Likelihood Ratio (LR) incorporates statistical knowledge of random parameter θ : ( r) ( H1) ( ) p r Λ = = [ H, ] ( H ) pr θ pθ dθ 1 1 H 2 H 2, H 2 [ ] ( ) p r pr θ pθ dθ Since the noise is additive, the likelihood function is the pdf of the noise: ( ) [ θ] = ( θ) θ = ( θ) pr H, pr s H, p r s H If the noise is Gaussian, the likelihood function is then : 1 1 n 1 1 pn ( r s( θ) H, θ) = exp r s ( θ ) 1 1 2 2 2σ 2σ 1 1 16 September 2008 REVEAL Overview and Progress 7 2

Composite LR (cont) and the Likelihood Ratio (LR) is : 2 ( r s1 ) exp 2 p( θ H1 ) dθ 2σ 1 Λ ( r) = 2 ( r s2 ) exp p 2 ( θ H2 ) dθ 2σ 2 The Estimator-Correlator (EC) provides an expression for the LR in the more general case where the noise pdf belongs to the exponential class. Jeff Ballard formulated the EC for Gaussian signals in FY07 and sinusoids in FY08. 1. Schwartz, S. C., The Estimator-Correlator for Discrete-Time Problems, IEEE Trans. on Inf. Theory, Vol. 23, No. 1, Jan 1977, pp. 93-100. 2. Ballard and Culver, The Estimated Signal Parameter Detector: Incorporating signal parameter statistics in the signal processor, submitted to JOE (2008). 16 September 2008 REVEAL Overview and Progress 8

Signal Parameter pdf ( 1 ( θ) ) p pθ H 1 Signal Parameter pdf Estimated Ocean Detector (EOD) p Conditional Moment Function Received Signal, r ( r θ ) 1( ) h r h 2( r ) G G B 1 2 1 B 2 Noise pdf ( r ) ( r ) ( r ) ( r ) ln c 1 c 2 - H Σ ( ) > 1 r - Noise only data < ln η H 2 H 1 H 2 ( p ( θ )) p θ H 2 16 2September 2008 REVEAL Overview and Progress 9

Neglecting noise When the noise is neglibly small, the likelihood function becomes ( r) ( H, θ) = ( θ) H, θ δ ( θ) p r 1 p r s 1 r s and the Likelihood Ratio is then p r s( θ) H 1, θ p s( θ) H 1 dθ p s( θ ) H 1 p r s( θ) H 2, θ p s( θ) H 2 dθ p s ( θ ) H2 Λ = We have made this assumption in applying the composite LR to the 1996 Strait of Gibraltar and Swellex-96 data, respectively. 1. Culver, R. L. and H. J. Camin, Dependence of probabilistic acoustic signal models on statistical ocean environmental models, submitted to JASA (2008). 2. Jemmott, C.W., R. L. Culver, and N. K. Bose, Passive sonar depth classification using model based amplitude statistics, (in preparation). 16 September 2008 REVEAL Overview and Progress 10

The Bayes Filter The Bayes filter is an alternative to the LR in which we use Bayes rule ( H, θ) ( H θ) = (,H θ) = ( H, θ) ( θ) p r p p r p r p r i i i i to convert the likelihood function to the posterior pdf ( θ,h i) p( θ Hi) p( r θ ) p r = ( r θ ) H,. We select the hypothesis with the highest posterior probability. The histogram filter is the discrete implementation of the Bayesian filter. Colin will compare a recursive histogram filter to the LR receiver. p i 16 September 2008 REVEAL Overview and Progress 11

Distance measures The Kullback-Leibler divergence (among others) provides a measure of the distance between two multidimensional surfaces, e.g. pdfs. Using a distance measure to classify signals: Predict signal parameter pdfs for difference classes Estimate signal parameters from observations; compute signal parameter pdfs from observations Pick the class whose pdf is closest to the observed signal parameter pdf Brett will present his work on this approach 16 September 2008 REVEAL Overview and Progress 12

Noise whitening The EOD requires that the noise pdf belong to the exponential class. Not necessarily Gaussian. How to whiten or decorrelate? So-called higher order whitening has been investigated in the image processing literature. Whitening is closely related to distance measures and to compressive sampling. Dr. Bose will present his work. 1. J. Gluckman, Higher order whitening of natural images, Proc. of the IEEE Conference on Computer Vision and Pattern Recognition, 2005. 2. N.K. Bose, U. Srinivas and R.L. Culver (2008). Wavelength diversity based infrared super-resolution and condition-based maintenance, INSIGHT, British Institute for Non-Destructive Testing, Vol. 50, No. 8. 16 September 2008 REVEAL Overview and Progress 13

Predicting signal parameter pdfs Rough surface PE acoustic propagation model obtained from Rosenberg (APL/JHU); based upon Range-dependent Acoustic Model (RAM), but adds capability for acoustic propagation with time- and spatially-varying rough surface. We want to determine if this simulation can predict surface interaction effects on signal frequency and amplitude pdfs. Jeremy Joseph will present his work. 16 September 2008 REVEAL Overview and Progress 14

REVEAL FY08 Talks Acoust. Soc. Am. Nov 07 (New Orleans) Culver: Likelihood func. & signal param. pdfs for sonar signal processing Joseph: Effect of rough surface on received signals Apr 08 PSU College of Engr. Research Symposium (CERS) Jemmott: Passive sonar source classification based on received signal amplitude variation statistics Acoust. Soc. Am. June - July 08 (Paris) Bissinger: Application of statistical methods in uw signal classification Joseph: Effects of volume and boundary variability on the statistics of received signal frequency Culver: Detection and classification using the Estimated Ocean Detector Distributed Detection and Est. Workshop (VA Tech, July 08) Bissinger: Statistical Distance Based Signal Classification Culver: Detection and classification using the Estimated Ocean Detector Jemmott: Passive Sonar Model-Based Source Location Classification Joseph: Effect of rough surface on received signals 16 September 2008 REVEAL Overview and Progress 15

REVEAL FY08 Papers N.K. Bose, U. Srinivas and R.L. Culver (2008). Wavelength diversity based infrared super-resolution and condition-based maintenance, INSIGHT, British Institute for Non-Destructive Testing, Vol. 50, No. 8. J.A. Ballard and R. L. Culver (2008). The Estimated Signal Parameter Detector: Incorporating signal parameter statistics into the signal processor submitted to IEEE J. Oceanographic Engr. Dec 07 Comments received June 08 Manuscript revised and resubmitted Sept 08 R.L. Culver and H.J. Camin (Dependence of probabilistic acoustic signal models on statistical ocean environmental models submitted to J. Acoust. Soc. Am. Nov 07 Comments received May 08 Manuscript under revision; will re-submit by 30 Sep 08 16 September 2008 REVEAL Overview and Progress 16

Planned FY09 Talks and Papers Present at Asilomar (Oct 08), CISS (Mar 09), and UASP (Oct 09) signal processing meetings. Present as ASA (Nov 09) and (May 09) Publish papers on: depth classification using the Swellex-96 data higher order whitening application of distance measure to uw acoustics predicting uw acoustic signal parameter statistics 16 September 2008 REVEAL Overview and Progress 17

REVEAL Project FY09 Plans Apply classifiers to South Florida range data Bottom-mounted line arrays Surface ships and a towed, submerged source Move from high SNR to moderate SNR cases Incorporate noise whitening for EOD Robustness of distance measures and histogram filter Address correlation in extracted parameter values Incorporate the rough surface RAM simulation into the signal processing architecture 16 September 2008 REVEAL Overview and Progress 18

REVEAL Project Ocean environment ocean models In-situ measurements environ. realizations acoustic propagation model Monte Carlo simulation signal realizations sonar data noise pdf Classifier Detection/classification decision Signal parameter pdf s (MaxEnt method) 16 September 2008 REVEAL Overview and Progress 19

REVEAL Project Ocean environment ocean models In-situ measurements environ. realizations acoustic propagation model Monte Carlo simulation signal realizations sonar data noise pdf Colin and Brett Classifier Detection/classification decision Signal parameter pdf s (MaxEnt method) 16 September 2008 REVEAL Overview and Progress 20

REVEAL Project Ocean environment ocean models In-situ measurements environ. realizations acoustic propagation model Monte Carlo simulation signal realizations sonar data noise pdf Dr. Bose Classifier Detection/classification decision Signal parameter pdf s (MaxEnt method) 16 September 2008 REVEAL Overview and Progress 21

REVEAL Project Ocean environment ocean models In-situ measurements environ. realizations Jeremy acoustic propagation model Monte Carlo simulation signal realizations sonar data noise pdf Classifier Detection/classification decision Signal parameter pdf s (MaxEnt method) 16 September 2008 REVEAL Overview and Progress 22