A Step Towards the Cognitive Radar: Target Detection under Nonstationary Clutter
|
|
- Winfred Hampton
- 5 years ago
- Views:
Transcription
1 A Step Towards the Cognitive Radar: Target Detection under Nonstationary Clutter Murat Akcakaya Department of Electrical and Computer Engineering University of Pittsburgh Satyabrata Sen *, Yijian Xiang, and Arye Nehorai Oak Ridge National Laboratory * Washington University in St. Louis International Conference on InfoSymbiotics/DDDAS August 7-9,
2 Acknowledgement This material is based upon the work supported by the Air Force Office of Scientific Research (AFOSR), the DDDAS Program, under Grant No. FA We thank AFOSR/DDDAS for supporting this project. 2
3 Outline Introduction Challenges Motivations Our approach Relevance to DDDAS Target Detection Method Change point detection CUSUM Extended CUSUM Numerical Results Conclusions and Future Work 3
4 Introduction 4
5 Problem Description Goal: Improve target detection capability in the presence of nonstationary clutter. Challenges: Characteristics of the clutter can vary enormously depending on radar-operational scenarios (e.g., weather change, dynamic target, and changes in the environment). However, most existing radar algorithms assume stationary, parametric distributions for the clutter and noise processes, consider the availability of a dictionary of possible probability density functions (pdfs), do not address the problem of estimating the time instant when the characteristics of the clutter changes. Therefore, the radar performance can severely deteriorate when the inherent nonstationary characteristics are not accounted for. 5
6 Problem Description (cont.) radar Sea Sea clutter Land clutter Land Characteristics of sea-clutter is starkly different than land-clutter An illustrative example of target detection in nonstationary environment 6
7 Motivation Cognitive radar framework conceptualizes an advanced radar system that senses its scenario effectively, learns from its experience, adapts to the changes. Thus, in a nonstationary environment, a cognitive radar provides a unifying approach by autonomously learning and estimating the change-point in the statistical characteristics of the scenario, incorporating the newly learned environment statistics into the target detection algorithm. 7
8 Our Approach Employ a data-driven active drift detection algorithm to detect changes of statistical characteristics of the environment. Environment with targets Apply incremental learning (i.e., learning under concept drift) algorithms to learn the new statistical characteristics of the environment. Transmitter Transmitted signal Receiver Detection Algorithms Measurements Integrate the newly learned environment characteristics in the detection algorithm to adapt to the changes in the environment. Model Parameters Update Environment / Target Learning Module 8
9 Relevance to DDDAS Our proposed technique with adaptive learning and cognitive augmentation is of high relevance to remotely piloted radar systems for substantially better intelligence, surveillance, and reconnaissance (ISR) capability It is also germane to the key science and technology frontiers of DDDAS: Applications modeling Developing data-driven learning algorithms to detect any significant change in the underlying distribution of the model Jointly combining newly measured data with the previously-stored calibration data to learn the environment model Advances in Mathematical and Statistical Algorithms Incorporating learned model parameters into radar algorithms to provide robust and improved detection performance Application Measurement Systems and Methods [on-going work, not part of this presentation] Synthesizing the next transmit waveforms based on the updated model parameters Using the designed waveforms as control-agents to dynamically steer the next received measurements Software Infrastructures and other systems software [future work, not part of this presentation] Addressing the near real-time implementation issues of the proposed signal processing algorithms. 9
10 Target Detection Method 10
11 Data-Driven Active Drift Detection A typical change point detection problem: At current time NN, decide from two hypotheses: DD 0 : DD 1 : yy 1, yy 2,, yy NN ~ pp θθ0 yy 1, yy 2,, yy kk0 ~ pp θθ0, yy kk0 +1,, yy NN ~ pp θθ1 where yy nn : observed data at time nn; kk 0 : change point; pp θθ0, pp θθ1 : two different distributions before and after the change point. pp θθ0 pp θθ1 Stopping time (ττ) Change point Estimation delay 11
12 Data-Driven Active Drift Detection (cont.) Change point detection formulation for radar detection problem: where ττ = argmin ττ sup nn 1 ess sup EE nn such that EE ττ αα ττ nn + YY cc cc 0,, YY nn 1 CC cc, cc 0,1 : two classes representing the absence and presence of the target; YY 0 = yy 0,tt, rr 0,tt, tt = 1,, TT 0 : calibration data set for two classes, yy 0,tt : tt th radar measurement rr 0,tt = 0 if yy 0,tt CC 0 and rr 0,tt = 1 if yy 0,tt CC 1 TT 0 : number of measurements in the calibration data; YY nn c : radar data observed at measurement time nn from class cc; ττ : stopping time; xx + = max 0, xx ; EE nn [ ] : expectation with respect to pp nn cc, pp nn cc : probability distribution when the change occurs at nn; EE [ττ] : mean time between false alarms, assuming that change never happens; ess sup : essential supremum of a set of random variables XX; it is a random variable ZZ such that (i) PP ZZ XX = 1 XX XX; and (ii) PP YY XX = 1, XX XX PP YY ZZ = 1, XX XX. (1) 12
13 Data-Driven Active Drift Detection (cont.) CUmulative SUM (CUSUM) algorithm: provides the optimum stopping time ττ for the problem in (1) ττ = inf nn 1: gg YY 0 cc,, YY nn cc where RR kk = kk ii=1 nn : batch index ln pp cc θθ cc YY 1 ii cc pp θθ0 cc YY ii bb : a predefined threshold Parameter training procedure: = RR nn min 1 kk nn RR kk bb i. Find an estimate of θθ 0 cc using ii. iii. iv. a) calibration data YY cc 0, cc 0, 1 b) knowledge of the parametric distribution underlying the data Compute the confidence intervals for θθ 0 cc Assign the confidence interval extremas to θθ 1 cc Assign bb = max 1 tt TT 0 gg YY 0 cc, where YY 0 cc = yy 0,tt rr 0,tt = cc, tt = 1,, TT 0 13
14 Data-Driven Active Drift Detection (cont.) Extended CUSUM algorithm: when no prior knowledge is available about the distribution of YY nn cc, cc 0, 1 Convert measurements into new samples (take YY 0 cc as an example): zz 0,tt,ii = 1 MM iiii yy 0,tt,vv Convert ZZ 0 cc zz 0,tt NN MM Convert vv= ii 1 MM+1 zz 0,tt = zz 0,tt,1,, zz 0,tt,NN/MM TT MM YY 0 cc = yy 0,tt rr tt = cc ZZ 0 cc = zz 0,tt rr tt = cc NN where yy 0,tt,vv and zz 0,tt,ii are vv th and ii th entries of vectors yy 0,tt and zz 0,tt, respectively. YY 0 cc yy 0,tt 14
15 Data-Driven Active Drift Detection (cont.) Extended CUSUM algorithm (cont.): Use new samples to employ CUSUM algorithm: where ττ = inf nn 1: gg ZZ 0 cc,, ZZ nn cc kk RR kk = ii=1 ln pp cc θθ cc ZZ 1 ii cc pp θθ0 cc ZZ ii nn is the batch index = RR nn min 1 kk nn RR kk bb bb is a predefined threshold Parameter training procedure: i. Find an estimate of θθ 0 cc using the calibration data ZZ 0 cc, cc 0, 1 ii. iii. iv. Compute the confidence intervals for θθ 0 cc Assign the confidence interval extremas to θθ 1 cc Assign bb = max 1 tt TT 0 gg ZZ 0 cc, where ZZ 0 cc = zz 0,tt rr 0,tt = cc, tt = 1,, TT 0 15
16 Numerical Results 16
17 Simulation Setup Assumptions: Radar collects measurements from multiple range cells (indexed by jj) over a sequence of coherent processing intervals (CPIs) (indexed by kk) Radar receives and processes NN temporal samples in each CPI Target is assumed to be present in the jj = 1 range cell Target remains in a cell during the entire processing of kk = 1, 2,, KK CPIs Target response is considered to be known and constant (denoted as aa) Detection problem (of jj th range cell at kk th CPI): H 0: yy kk jj = nn kk jj H 1 : yy kk jj = aa11 + nn kk jj, for kk = 1,2,, KK, jj = 0,1,2, where each vector is of dimension NN 1. Nonstationary modeling: For kk = 1, 2,, kk 0, we have nn jj kk ~pp nn,θθ0, i.e., yy jj kk ~pp θθ0 cc For kk = kk 0 + 1,, KK, we have nn jj kk ~pp nn,θθ1, i.e., yy jj kk ~pp θθ1 cc 17
18 Simulation Setup (cont.) Parameter training procedure: Suppose we have TT cc 0 training data for class cc, i.e., YY cc cc 0 = yy 0,tt for tt = 1,, TT cc 0. If the noise before change point is known as nn kk jj ~NN 0, σσ 2 II, then 1. θθ 1 0 = aa, σσ 2, θθ 0 0 = 0, σσ 2 2. Compute sample mean μμ cc and sample variance TT 0 cc μμ cc = 1 TT cc 0 NN tt=1 11 TT cc yy 0,tt ss 2cc = 1 TT 0 cc TT 0 cc NN 1 tt=1 ss 2cc cc yy 0,tt μμ cc 11 TT cc yy 0,tt μμ cc Take the lower/upper limits on the 95% confidence intervals of mean and variance aa cc llll = μμ cc 1.96 σσ llll 2cc = TT 0 cc NN 1 2 XX TT0 cc NN 1 σσ TT 0 cc NN ss 2cc αα/2 aa cc uuuu σσ llll 2cc = = μμ cc 1.96 TT 0 cc NN 1 2 XX TT0 cc NN 1 4. Evaluate gg nn = RR nn min RR kk, with RR kk = kk tt=1 1 kk nn σσ TT 0 cc NN ss 2cc 1 αα/2 ln pp cc θθ cc yy 0,tt 1 pp θθ0 cc yycc 0,tt where αα = 0.05 having parameters from θθ cc 0 to either θθ cc 1 = aa cc llll, σσ 2cc llll, θθ cc 1 = aa cc llll, σσ 2cc uull, θθ cc 1 = aa cc uull, σσ 2cc llll, or θθ cc 1 = aa cc 2cc uull, σσ uull 5. Let bb = max 1 nn TT 0 cc gg nn 18
19 Simulation Setup (cont.) Parameter training procedure (cont.): If the noise nn kk jj distribution is unknown, then the conversion for the extended CUSUM algorithm is used: θθ cc 0 = μμ cc zz, ss 2cc zz, where μμ cc zz and ss zz 2cc are sample mean and variance of ZZ cc 0 = zz 0,tt (training data after the conversion) under H cc θθ cc 1 and bb can be trained similar to the above. Change Point Detection: Once θθ 0 cc, θθ 1 cc, and bb are obtained, then CUSUM (or extended CUSUM) algorithm is used to detect the change point. Adaptive Target Detection: Once a change in the clutter distribution is detected, the proposed radar accordingly modifies the log-likelihood ratio ln pp θθ 0 cc jj yy kk H1 pp θθ0 cc yy kk jj H0 ln pp θθ 1 cc yy kk jj H1 pp θθ1 cc yy kk jj H0 cc before change point after change point 19
20 Simulation Setup (cont.) We consider four clutter distributions: Gaussian distribution Student-t distribution K distribution Weibull distribution Based on the proposed framework, 12 cases are included in the simulation results for target detection under nonstationary clutter as follows: TABLE I: Distributions of Clutter in Target Detection Before Change Point After Change Point Gaussian Student-t K Weibull Student-t Gaussian K Weibull K Gaussian Student-t Weibull Weibull Gaussian Student-t K CUSUM Extended CUSUM We present the results in terms of the (i) change point estimation delay and (ii) adaptive detection performance. 20
21 Numerical Results Gaussian Student-t Change point detection (CUSUM) Observation: Change in clutter distribution is detected within one processing interval for more than 96.5% of the time ROC curves (10dB and 20dB) Observation: Detection performance improves substantially (PD increased by 0.4) due to the incorporation of the modified clutter characteristics 21
22 Numerical Results (cont.) Gaussian K Change point detection (CUSUM) Observation: Change in clutter distribution is detected within one processing interval for more than 95.5% of the time ROC curves (10dB and 20dB) Observation: Detection performance improves substantially (PD increased by > 0.5) due to the incorporation of the modified clutter characteristics 22
23 Numerical Results (cont.) Weibull K Change point detection (extended CUSUM) Observation: Change in clutter distribution is detected within one processing interval for more than 99.6% of the time ROC curves (-10dB and -20dB) Observation: Detection performance improves substantially (PD increased by 0.4) due to the incorporation of the modified clutter characteristics 23
24 Numerical Results (cont.) Change Point Detection Performance Summary: Clutter before change point Gaussian (G) Student-t (T) K Weibull (W) Clutter after change point Probability of change detection in one step delay Estimation delay when probability of change detection 99% T 96.85% 7 K 95.85% 10 W 97.10% 6 G 91.80% 2 K 99.40% 1 W 98.90% 2 G 98.90% 3 T 98.60% 2 W 93.05% 2 G 97.20% 14 T 97.00% 2 K 99.75% 1 24
25 Numerical Results (cont.) Improved Detection Performance Summary: Clutter before change point Gaussian (G) Student-t (T) K Weibull (W) Clutter after change point Improved PP D when PP FA = 0.01 SNR= 10dB SNR= 20dB T 40.9% 42.1% K 0.8% 34.4% W 1.6% 48.7% SNR= -10dB SNR= -20dB G 4.0% 24.8% K 56.0% 11.7% W 64.4% 2.5% G * * T * * W 86.3% 27.4% G * * T * * K 13.4% 1.6% 25 * No comparable data exist since the case likelihood ratio=0/0 arise too often in conventional radar.
26 Conclusions and Future Work 26
27 Conclusions and Future Work Conclusions: We developed a data-driven algorithm to detect a target in the presence of nonstationary environment (clutter). Applied an active drift learning technique to detect and estimate any change-point (if present) in the clutter distribution. Employed the incremental learning and drift detection algorithms to incrementally learn the environment and update the system parameters on the fly. Demonstrated with numerical examples that the proposed algorithm quickly detects a change in the underlying clutter distribution, significantly improves the target detection performance. Future Work: Extend the model to include a Bayesian formulation of the change point parameter. Explore the active drift learning under noisy labels and passive drift leaning methodologies. Validate the performance of our proposed technique with real data. Incorporate waveform design and other adaptive techniques to further improve the detection and tracking performance under nonstationary environment. 27
28 Thank you! 28
29 Appendix 29
30 More Numerical Results Gaussian->Weibull Change point detection (CUSUM) ROC curve (10dB and 20dB) 30
31 More Numerical Results Student-t->Gaussian Change point detection (extended CUSUM) ROC curve (-10dB and -20dB) 31
32 More Numerical Results Student-t->K Change point detection (extended CUSUM) ROC curve (-10dB and -20dB) 32
33 More Numerical Results Student-t->Weibull Change point detection (extended CUSUM) ROC curve (-10dB and -20dB) 33
34 More Numerical Results Weibull->Gaussian Change point detection (extended CUSUM) ROC curve (-10dB and -20dB) 34
35 More Numerical Results Weibull->Student-t Change point detection (extended CUSUM) ROC curve (-10dB and -20dB) 35
36 More Numerical Results K->Gaussian Change point detection (extended CUSUM) ROC curve (-10dB and -20dB) 36
37 More Numerical Results K->Student-t Change point detection (extended CUSUM) ROC curve (-10dB and -20dB) 37
38 More Numerical Results K->Weibull Change point detection (extended CUSUM) ROC curve (-10dB and -20dB) 38
39 Numerical Results (cont.) Improved Detection Performance Summary: Clutter before change point Gaussian (G) Student-t (T) K Weibull (W) Clutter after change point Improved PP D when PP FA = 0.01 Improved PP D when PP FA = SNR=10dB SNR=20dB SNR=10dB SNR=20dB T 40.9% 42.1% 20.8% 43.0% K 0.8% 34.4% 0.3% 3.2% W 1.6% 48.7% 0% 48% SNR=-10dB SNR=-20dB SNR=-10dB SNR=-20dB G 4.0% 24.8% 4.8% 10.6% K 56.0% 11.7% 56.5% 2.2% W 64.4% 2.5% 25.0% 0.5% G * * * * T * * * * W 86.3% 27.4% 64.5% 10.1% G * * * * T * * * * K 13.4% 1.6% 3.4% 0.4% 39 * No comparable data exist since the case likelihood ratio=0/0 arise too often in conventional radar.
Lecture 3. STAT161/261 Introduction to Pattern Recognition and Machine Learning Spring 2018 Prof. Allie Fletcher
Lecture 3 STAT161/261 Introduction to Pattern Recognition and Machine Learning Spring 2018 Prof. Allie Fletcher Previous lectures What is machine learning? Objectives of machine learning Supervised and
More informationVariations. ECE 6540, Lecture 02 Multivariate Random Variables & Linear Algebra
Variations ECE 6540, Lecture 02 Multivariate Random Variables & Linear Algebra Last Time Probability Density Functions Normal Distribution Expectation / Expectation of a function Independence Uncorrelated
More informationKinetic Model Parameter Estimation for Product Stability: Non-uniform Finite Elements and Convexity Analysis
Kinetic Model Parameter Estimation for Product Stability: Non-uniform Finite Elements and Convexity Analysis Mark Daichendt, Lorenz Biegler Carnegie Mellon University Pittsburgh, PA 15217 Ben Weinstein,
More informationWork, Energy, and Power. Chapter 6 of Essential University Physics, Richard Wolfson, 3 rd Edition
Work, Energy, and Power Chapter 6 of Essential University Physics, Richard Wolfson, 3 rd Edition 1 With the knowledge we got so far, we can handle the situation on the left but not the one on the right.
More informationECE 6540, Lecture 06 Sufficient Statistics & Complete Statistics Variations
ECE 6540, Lecture 06 Sufficient Statistics & Complete Statistics Variations Last Time Minimum Variance Unbiased Estimators Sufficient Statistics Proving t = T(x) is sufficient Neyman-Fischer Factorization
More informationSatellite and gauge rainfall merging using geographically weighted regression
132 Remote Sensing and GIS for Hydrology and Water Resources (IAHS Publ. 368, 2015) (Proceedings RSHS14 and ICGRHWE14, Guangzhou, China, August 2014). Satellite and gauge rainfall merging using geographically
More informationGeneral Strong Polarization
General Strong Polarization Madhu Sudan Harvard University Joint work with Jaroslaw Blasiok (Harvard), Venkatesan Gurswami (CMU), Preetum Nakkiran (Harvard) and Atri Rudra (Buffalo) December 4, 2017 IAS:
More informationBIOE 198MI Biomedical Data Analysis. Spring Semester Lab 4: Introduction to Probability and Random Data
BIOE 98MI Biomedical Data Analysis. Spring Semester 209. Lab 4: Introduction to Probability and Random Data A. Random Variables Randomness is a component of all measurement data, either from acquisition
More informationWorksheets for GCSE Mathematics. Quadratics. mr-mathematics.com Maths Resources for Teachers. Algebra
Worksheets for GCSE Mathematics Quadratics mr-mathematics.com Maths Resources for Teachers Algebra Quadratics Worksheets Contents Differentiated Independent Learning Worksheets Solving x + bx + c by factorisation
More informationCHAPTER 5 Wave Properties of Matter and Quantum Mechanics I
CHAPTER 5 Wave Properties of Matter and Quantum Mechanics I 1 5.1 X-Ray Scattering 5.2 De Broglie Waves 5.3 Electron Scattering 5.4 Wave Motion 5.5 Waves or Particles 5.6 Uncertainty Principle Topics 5.7
More informationTime Domain Analysis of Linear Systems Ch2. University of Central Oklahoma Dr. Mohamed Bingabr
Time Domain Analysis of Linear Systems Ch2 University of Central Oklahoma Dr. Mohamed Bingabr Outline Zero-input Response Impulse Response h(t) Convolution Zero-State Response System Stability System Response
More informationSignal Detection Basics - CFAR
Signal Detection Basics - CFAR Types of noise clutter and signals targets Signal separation by comparison threshold detection Signal Statistics - Parameter estimation Threshold determination based on the
More informationLecture 3. Linear Regression
Lecture 3. Linear Regression COMP90051 Statistical Machine Learning Semester 2, 2017 Lecturer: Andrey Kan Copyright: University of Melbourne Weeks 2 to 8 inclusive Lecturer: Andrey Kan MS: Moscow, PhD:
More informationRadial Basis Function (RBF) Networks
CSE 5526: Introduction to Neural Networks Radial Basis Function (RBF) Networks 1 Function approximation We have been using MLPs as pattern classifiers But in general, they are function approximators Depending
More informationSECTION 5: POWER FLOW. ESE 470 Energy Distribution Systems
SECTION 5: POWER FLOW ESE 470 Energy Distribution Systems 2 Introduction Nodal Analysis 3 Consider the following circuit Three voltage sources VV sss, VV sss, VV sss Generic branch impedances Could be
More informationControl of Mobile Robots
Control of Mobile Robots Regulation and trajectory tracking Prof. Luca Bascetta (luca.bascetta@polimi.it) Politecnico di Milano Dipartimento di Elettronica, Informazione e Bioingegneria Organization and
More informationTARGET DETECTION WITH FUNCTION OF COVARIANCE MATRICES UNDER CLUTTER ENVIRONMENT
TARGET DETECTION WITH FUNCTION OF COVARIANCE MATRICES UNDER CLUTTER ENVIRONMENT Feng Lin, Robert C. Qiu, James P. Browning, Michael C. Wicks Cognitive Radio Institute, Department of Electrical and Computer
More informationInferring the origin of an epidemic with a dynamic message-passing algorithm
Inferring the origin of an epidemic with a dynamic message-passing algorithm HARSH GUPTA (Based on the original work done by Andrey Y. Lokhov, Marc Mézard, Hiroki Ohta, and Lenka Zdeborová) Paper Andrey
More informationNon-Parametric Weighted Tests for Change in Distribution Function
American Journal of Mathematics Statistics 03, 3(3: 57-65 DOI: 0.593/j.ajms.030303.09 Non-Parametric Weighted Tests for Change in Distribution Function Abd-Elnaser S. Abd-Rabou *, Ahmed M. Gad Statistics
More information10.4 The Cross Product
Math 172 Chapter 10B notes Page 1 of 9 10.4 The Cross Product The cross product, or vector product, is defined in 3 dimensions only. Let aa = aa 1, aa 2, aa 3 bb = bb 1, bb 2, bb 3 then aa bb = aa 2 bb
More informationGeneral Strong Polarization
General Strong Polarization Madhu Sudan Harvard University Joint work with Jaroslaw Blasiok (Harvard), Venkatesan Gurswami (CMU), Preetum Nakkiran (Harvard) and Atri Rudra (Buffalo) May 1, 018 G.Tech:
More informationWorksheets for GCSE Mathematics. Algebraic Expressions. Mr Black 's Maths Resources for Teachers GCSE 1-9. Algebra
Worksheets for GCSE Mathematics Algebraic Expressions Mr Black 's Maths Resources for Teachers GCSE 1-9 Algebra Algebraic Expressions Worksheets Contents Differentiated Independent Learning Worksheets
More informationCS249: ADVANCED DATA MINING
CS249: ADVANCED DATA MINING Vector Data: Clustering: Part II Instructor: Yizhou Sun yzsun@cs.ucla.edu May 3, 2017 Methods to Learn: Last Lecture Classification Clustering Vector Data Text Data Recommender
More informationChapter 5: Spectral Domain From: The Handbook of Spatial Statistics. Dr. Montserrat Fuentes and Dr. Brian Reich Prepared by: Amanda Bell
Chapter 5: Spectral Domain From: The Handbook of Spatial Statistics Dr. Montserrat Fuentes and Dr. Brian Reich Prepared by: Amanda Bell Background Benefits of Spectral Analysis Type of data Basic Idea
More informationMultiple Regression Analysis: Inference ECONOMETRICS (ECON 360) BEN VAN KAMMEN, PHD
Multiple Regression Analysis: Inference ECONOMETRICS (ECON 360) BEN VAN KAMMEN, PHD Introduction When you perform statistical inference, you are primarily doing one of two things: Estimating the boundaries
More informationLesson 24: True and False Number Sentences
NYS COMMON CE MATHEMATICS CURRICULUM Lesson 24 6 4 Student Outcomes Students identify values for the variables in equations and inequalities that result in true number sentences. Students identify values
More informationIntroduction to Statistical Inference
Structural Health Monitoring Using Statistical Pattern Recognition Introduction to Statistical Inference Presented by Charles R. Farrar, Ph.D., P.E. Outline Introduce statistical decision making for Structural
More informationME5286 Robotics Spring 2017 Quiz 2
Page 1 of 5 ME5286 Robotics Spring 2017 Quiz 2 Total Points: 30 You are responsible for following these instructions. Please take a minute and read them completely. 1. Put your name on this page, any other
More informationMath 171 Spring 2017 Final Exam. Problem Worth
Math 171 Spring 2017 Final Exam Problem 1 2 3 4 5 6 7 8 9 10 11 Worth 9 6 6 5 9 8 5 8 8 8 10 12 13 14 15 16 17 18 19 20 21 22 Total 8 5 5 6 6 8 6 6 6 6 6 150 Last Name: First Name: Student ID: Section:
More informationCSC 578 Neural Networks and Deep Learning
CSC 578 Neural Networks and Deep Learning Fall 2018/19 3. Improving Neural Networks (Some figures adapted from NNDL book) 1 Various Approaches to Improve Neural Networks 1. Cost functions Quadratic Cross
More informationIT 403 Statistics and Data Analysis Final Review Guide
IT 403 Statistics and Data Analysis Final Review Guide Exam Schedule and Format Date: 11/15 (Wed) for Section 702 (Loop); between 11/15 (Wed) and 11/18 (Sat) for Section 711 (Online). Location: CDM 224
More informationIntroduction to Signal Detection and Classification. Phani Chavali
Introduction to Signal Detection and Classification Phani Chavali Outline Detection Problem Performance Measures Receiver Operating Characteristics (ROC) F-Test - Test Linear Discriminant Analysis (LDA)
More informationHopfield Network for Associative Memory
CSE 5526: Introduction to Neural Networks Hopfield Network for Associative Memory 1 The next few units cover unsupervised models Goal: learn the distribution of a set of observations Some observations
More informationEstimate by the L 2 Norm of a Parameter Poisson Intensity Discontinuous
Research Journal of Mathematics and Statistics 6: -5, 24 ISSN: 242-224, e-issn: 24-755 Maxwell Scientific Organization, 24 Submied: September 8, 23 Accepted: November 23, 23 Published: February 25, 24
More informationDan Roth 461C, 3401 Walnut
CIS 519/419 Applied Machine Learning www.seas.upenn.edu/~cis519 Dan Roth danroth@seas.upenn.edu http://www.cis.upenn.edu/~danroth/ 461C, 3401 Walnut Slides were created by Dan Roth (for CIS519/419 at Penn
More informationSequential Detection. Changes: an overview. George V. Moustakides
Sequential Detection of Changes: an overview George V. Moustakides Outline Sequential hypothesis testing and Sequential detection of changes The Sequential Probability Ratio Test (SPRT) for optimum hypothesis
More informationNovel spectrum sensing schemes for Cognitive Radio Networks
Novel spectrum sensing schemes for Cognitive Radio Networks Cantabria University Santander, May, 2015 Supélec, SCEE Rennes, France 1 The Advanced Signal Processing Group http://gtas.unican.es The Advanced
More informationGroup-Sequential Tests for One Proportion in a Fleming Design
Chapter 126 Group-Sequential Tests for One Proportion in a Fleming Design Introduction This procedure computes power and sample size for the single-arm group-sequential (multiple-stage) designs of Fleming
More informationHaar Basis Wavelets and Morlet Wavelets
Haar Basis Wavelets and Morlet Wavelets September 9 th, 05 Professor Davi Geiger. The Haar transform, which is one of the earliest transform functions proposed, was proposed in 90 by a Hungarian mathematician
More informationReal-Time Weather Hazard Assessment for Power System Emergency Risk Management
Real-Time Weather Hazard Assessment for Power System Emergency Risk Management Tatjana Dokic, Mladen Kezunovic Texas A&M University CIGRE 2017 Grid of the Future Symposium Cleveland, OH, October 24, 2017
More informationSpecialist Mathematics 2019 v1.2
181314 Mensuration circumference of a circle area of a parallelogram CC = ππππ area of a circle AA = ππrr AA = h area of a trapezium AA = 1 ( + )h area of a triangle AA = 1 h total surface area of a cone
More informationPhoton Interactions in Matter
Radiation Dosimetry Attix 7 Photon Interactions in Matter Ho Kyung Kim hokyung@pusan.ac.kr Pusan National University References F. H. Attix, Introduction to Radiological Physics and Radiation Dosimetry,
More informationLecture 11. Kernel Methods
Lecture 11. Kernel Methods COMP90051 Statistical Machine Learning Semester 2, 2017 Lecturer: Andrey Kan Copyright: University of Melbourne This lecture The kernel trick Efficient computation of a dot product
More informationQuantum Mechanics. An essential theory to understand properties of matter and light. Chemical Electronic Magnetic Thermal Optical Etc.
Quantum Mechanics An essential theory to understand properties of matter and light. Chemical Electronic Magnetic Thermal Optical Etc. Fall 2018 Prof. Sergio B. Mendes 1 CHAPTER 3 Experimental Basis of
More informationIntroduction to Density Estimation and Anomaly Detection. Tom Dietterich
Introduction to Density Estimation and Anomaly Detection Tom Dietterich Outline Definition and Motivations Density Estimation Parametric Density Estimation Mixture Models Kernel Density Estimation Neural
More informationLecture 3 Optimization methods for econometrics models
Lecture 3 Optimization methods for econometrics models Cinzia Cirillo University of Maryland Department of Civil and Environmental Engineering 06/29/2016 Summer Seminar June 27-30, 2016 Zinal, CH 1 Overview
More informationCSE 5526: Introduction to Neural Networks Hopfield Network for Associative Memory
CSE 5526: Introduction to Neural Networks Hopfield Network for Associative Memory Part VII 1 The basic task Store a set of fundamental memories {ξξ 1, ξξ 2,, ξξ MM } so that, when presented a new pattern
More informationChapter 6: Classification
Ludwig-Maximilians-Universität München Institut für Informatik Lehr- und Forschungseinheit für Datenbanksysteme Knowledge Discovery in Databases SS 2016 Chapter 6: Classification Lecture: Prof. Dr. Thomas
More informationCharge carrier density in metals and semiconductors
Charge carrier density in metals and semiconductors 1. Introduction The Hall Effect Particles must overlap for the permutation symmetry to be relevant. We saw examples of this in the exchange energy in
More informationSimultaneous state and input estimation of non-linear process with unknown inputs using particle swarm optimization particle filter (PSO-PF) algorithm
Simultaneous state and input estimation of non-linear process with unknown inputs using particle swarm optimization particle filter (PSO-PF) algorithm Mohammad A. Khan, CSChe 2016 Outlines Motivations
More informationA GLRT FOR RADAR DETECTION IN THE PRESENCE OF COMPOUND-GAUSSIAN CLUTTER AND ADDITIVE WHITE GAUSSIAN NOISE. James H. Michels. Bin Liu, Biao Chen
A GLRT FOR RADAR DETECTION IN THE PRESENCE OF COMPOUND-GAUSSIAN CLUTTER AND ADDITIVE WHITE GAUSSIAN NOISE Bin Liu, Biao Chen Syracuse University Dept of EECS, Syracuse, NY 3244 email : biliu{bichen}@ecs.syr.edu
More information7.3 The Jacobi and Gauss-Seidel Iterative Methods
7.3 The Jacobi and Gauss-Seidel Iterative Methods 1 The Jacobi Method Two assumptions made on Jacobi Method: 1.The system given by aa 11 xx 1 + aa 12 xx 2 + aa 1nn xx nn = bb 1 aa 21 xx 1 + aa 22 xx 2
More informationLecture 6. Notes on Linear Algebra. Perceptron
Lecture 6. Notes on Linear Algebra. Perceptron COMP90051 Statistical Machine Learning Semester 2, 2017 Lecturer: Andrey Kan Copyright: University of Melbourne This lecture Notes on linear algebra Vectors
More informationReview for Exam Hyunse Yoon, Ph.D. Assistant Research Scientist IIHR-Hydroscience & Engineering University of Iowa
57:020 Fluids Mechanics Fall2013 1 Review for Exam3 12. 11. 2013 Hyunse Yoon, Ph.D. Assistant Research Scientist IIHR-Hydroscience & Engineering University of Iowa 57:020 Fluids Mechanics Fall2013 2 Chapter
More informationTerms of Use. Copyright Embark on the Journey
Terms of Use All rights reserved. No part of this packet may be reproduced, stored in a retrieval system, or transmitted in any form by any means - electronic, mechanical, photo-copies, recording, or otherwise
More informationOptimization of Multistatic Cloud Radar with Multiple-Access Wireless Backhaul
1 Optimization of Multistatic Cloud Radar with Multiple-Access Wireless Backhaul Seongah Jeong, Osvaldo Simeone, Alexander Haimovich, Joonhyuk Kang Department of Electrical Engineering, KAIST, Daejeon,
More informationLecture 3: Autoregressive Moving Average (ARMA) Models and their Practical Applications
Lecture 3: Autoregressive Moving Average (ARMA) Models and their Practical Applications Prof. Massimo Guidolin 20192 Financial Econometrics Winter/Spring 2018 Overview Moving average processes Autoregressive
More informationDetection Theory. Chapter 3. Statistical Decision Theory I. Isael Diaz Oct 26th 2010
Detection Theory Chapter 3. Statistical Decision Theory I. Isael Diaz Oct 26th 2010 Outline Neyman-Pearson Theorem Detector Performance Irrelevant Data Minimum Probability of Error Bayes Risk Multiple
More informationImpact of Chamber Pressure on Sputtered Particle Energy
Wilmert De Bosscher Chief Technology Officer +32 9381 6177 wilmert.debosscher@soleras.com Impact of Chamber Pressure on Sputtered Particle Energy Tampa, October 18 th, 2017 Background Why Sputtering at
More informationSupport Vector Machines. CSE 4309 Machine Learning Vassilis Athitsos Computer Science and Engineering Department University of Texas at Arlington
Support Vector Machines CSE 4309 Machine Learning Vassilis Athitsos Computer Science and Engineering Department University of Texas at Arlington 1 A Linearly Separable Problem Consider the binary classification
More informationLecture 10: Logistic Regression
BIOINF 585: Machine Learning for Systems Biology & Clinical Informatics Lecture 10: Logistic Regression Jie Wang Department of Computational Medicine & Bioinformatics University of Michigan 1 Outline An
More informationHeteroskedasticity ECONOMETRICS (ECON 360) BEN VAN KAMMEN, PHD
Heteroskedasticity ECONOMETRICS (ECON 360) BEN VAN KAMMEN, PHD Introduction For pedagogical reasons, OLS is presented initially under strong simplifying assumptions. One of these is homoskedastic errors,
More informationSome examples of radical equations are. Unfortunately, the reverse implication does not hold for even numbers nn. We cannot
40 RD.5 Radical Equations In this section, we discuss techniques for solving radical equations. These are equations containing at least one radical expression with a variable, such as xx 2 = xx, or a variable
More informationDecentralized Sequential Hypothesis Testing. Change Detection
Decentralized Sequential Hypothesis Testing & Change Detection Giorgos Fellouris, Columbia University, NY, USA George V. Moustakides, University of Patras, Greece Outline Sequential hypothesis testing
More informationAtomic fluorescence. The intensity of a transition line can be described with a transition probability inversely
Atomic fluorescence 1. Introduction Transitions in multi-electron atoms Energy levels of the single-electron hydrogen atom are well-described by EE nn = RR nn2, where RR = 13.6 eeee is the Rydberg constant.
More informationSECTION 7: FAULT ANALYSIS. ESE 470 Energy Distribution Systems
SECTION 7: FAULT ANALYSIS ESE 470 Energy Distribution Systems 2 Introduction Power System Faults 3 Faults in three-phase power systems are short circuits Line-to-ground Line-to-line Result in the flow
More informationA linear operator of a new class of multivalent harmonic functions
International Journal of Scientific Research Publications, Volume 7, Issue 8, August 2017 278 A linear operator of a new class of multivalent harmonic functions * WaggasGalibAtshan, ** Ali Hussein Battor,
More informationRotational Motion. Chapter 10 of Essential University Physics, Richard Wolfson, 3 rd Edition
Rotational Motion Chapter 10 of Essential University Physics, Richard Wolfson, 3 rd Edition 1 We ll look for a way to describe the combined (rotational) motion 2 Angle Measurements θθ ss rr rrrrrrrrrrrrrr
More informationSecondary 3H Unit = 1 = 7. Lesson 3.3 Worksheet. Simplify: Lesson 3.6 Worksheet
Secondary H Unit Lesson Worksheet Simplify: mm + 2 mm 2 4 mm+6 mm + 2 mm 2 mm 20 mm+4 5 2 9+20 2 0+25 4 +2 2 + 2 8 2 6 5. 2 yy 2 + yy 6. +2 + 5 2 2 2 0 Lesson 6 Worksheet List all asymptotes, holes and
More information(2) Orbital angular momentum
(2) Orbital angular momentum Consider SS = 0 and LL = rr pp, where pp is the canonical momentum Note: SS and LL are generators for different parts of the wave function. Note: from AA BB ii = εε iiiiii
More informationKalman Filters for Mapping and Localization
Kalman Filters for Mapping and Localization Sensors If you can t model the world, then sensors are the robot s link to the external world (obsession with depth) Laser Kinect IR rangefinder sonar rangefinder
More informationEvaluating Classifiers. Lecture 2 Instructor: Max Welling
Evaluating Classifiers Lecture 2 Instructor: Max Welling Evaluation of Results How do you report classification error? How certain are you about the error you claim? How do you compare two algorithms?
More informationGrover s algorithm. We want to find aa. Search in an unordered database. QC oracle (as usual) Usual trick
Grover s algorithm Search in an unordered database Example: phonebook, need to find a person from a phone number Actually, something else, like hard (e.g., NP-complete) problem 0, xx aa Black box ff xx
More informationModels of collective inference
Models of collective inference Laurent Massoulié (Microsoft Research-Inria Joint Centre) Mesrob I. Ohannessian (University of California, San Diego) Alexandre Proutière (KTH Royal Institute of Technology)
More informationAir Force Research Laboratory
Air Force Research Laboratory AE9/AP9 Radiation Belt Models: An Introduction for Scientists 28 July 2016 T. P. O Brien 1, T. B. Guild 1 W. R. Johnston 2, and S. L. Huston 3 1 Aerospace Corporation Integrity
More informationTranslator Design Lecture 16 Constructing SLR Parsing Tables
SLR Simple LR An LR(0) item (item for short) of a grammar G is a production of G with a dot at some position of the right se. Thus, production A XYZ yields the four items AA XXXXXX AA XX YYYY AA XXXX ZZ
More informationEntropy Enhanced Covariance Matrix Adaptation Evolution Strategy (EE_CMAES)
1 Entropy Enhanced Covariance Matrix Adaptation Evolution Strategy (EE_CMAES) Developers: Main Author: Kartik Pandya, Dept. of Electrical Engg., CSPIT, CHARUSAT, Changa, India Co-Author: Jigar Sarda, Dept.
More informationTECHNICAL NOTE AUTOMATIC GENERATION OF POINT SPRING SUPPORTS BASED ON DEFINED SOIL PROFILES AND COLUMN-FOOTING PROPERTIES
COMPUTERS AND STRUCTURES, INC., FEBRUARY 2016 TECHNICAL NOTE AUTOMATIC GENERATION OF POINT SPRING SUPPORTS BASED ON DEFINED SOIL PROFILES AND COLUMN-FOOTING PROPERTIES Introduction This technical note
More informationMathematical Methods 2019 v1.2
Problem-solving and modelling task (20%) This sample has been compiled by the QCAA to assist and support teachers to match evidence in student responses to the characteristics described in the instrument-specific
More informationLesson 13: More Factoring Strategies for Quadratic Equations & Expressions
: More Factoring Strategies for Quadratic Equations & Expressions Opening Exploration Looking for Signs In the last lesson, we focused on quadratic equations where all the terms were positive. Juan s examples
More informationWatermark Extraction Optimization Using PSO Algorithm
Research Journal of Applied Sciences, Engineering and Technology 5(12): 3312-3319, 2013 ISS: 2040-7459; e-iss: 2040-7467 Maxwell Scientific Organization, 2013 Submitted: June 09, 2012 Accepted: July 18,
More informationMultilayer Perceptrons (MLPs)
CSE 5526: Introduction to Neural Networks Multilayer Perceptrons (MLPs) 1 Motivation Multilayer networks are more powerful than singlelayer nets Example: XOR problem x 2 1 AND x o x 1 x 2 +1-1 o x x 1-1
More informationTime Reversal Transmission in MIMO Radar
Time Reversal Transmission in MIMO Radar Yuanwei Jin, José M.F. Moura, and Nicholas O Donoughue Electrical and Computer Engineering Carnegie Mellon University Pittsburgh, PA 53 Abstract Time reversal explores
More informationIntegrating Rational functions by the Method of Partial fraction Decomposition. Antony L. Foster
Integrating Rational functions by the Method of Partial fraction Decomposition By Antony L. Foster At times, especially in calculus, it is necessary, it is necessary to express a fraction as the sum of
More informationPassing-Bablok Regression for Method Comparison
Chapter 313 Passing-Bablok Regression for Method Comparison Introduction Passing-Bablok regression for method comparison is a robust, nonparametric method for fitting a straight line to two-dimensional
More informationAngular Momentum, Electromagnetic Waves
Angular Momentum, Electromagnetic Waves Lecture33: Electromagnetic Theory Professor D. K. Ghosh, Physics Department, I.I.T., Bombay As before, we keep in view the four Maxwell s equations for all our discussions.
More informationSECTION 8: ROOT-LOCUS ANALYSIS. ESE 499 Feedback Control Systems
SECTION 8: ROOT-LOCUS ANALYSIS ESE 499 Feedback Control Systems 2 Introduction Introduction 3 Consider a general feedback system: Closed-loop transfer function is KKKK ss TT ss = 1 + KKKK ss HH ss GG ss
More informationRevision : Thermodynamics
Revision : Thermodynamics Formula sheet Formula sheet Formula sheet Thermodynamics key facts (1/9) Heat is an energy [measured in JJ] which flows from high to low temperature When two bodies are in thermal
More information10.4 Controller synthesis using discrete-time model Example: comparison of various controllers
10. Digital 10.1 Basic principle of digital control 10.2 Digital PID controllers 10.2.1 A 2DOF continuous-time PID controller 10.2.2 Discretisation of PID controllers 10.2.3 Implementation and tuning 10.3
More informationOverview of Beamforming
Overview of Beamforming Arye Nehorai Preston M. Green Department of Electrical and Systems Engineering Washington University in St. Louis March 14, 2012 CSSIP Lab 1 Outline Introduction Spatial and temporal
More informationNotes on Noncoherent Integration Gain
Notes on Noncoherent Integration Gain Mark A. Richards July 2014 1 Noncoherent Integration Gain Consider threshold detection of a radar target in additive complex Gaussian noise. To achieve a certain probability
More informationEureka Lessons for 6th Grade Unit FIVE ~ Equations & Inequalities
Eureka Lessons for 6th Grade Unit FIVE ~ Equations & Inequalities These 2 lessons can easily be taught in 2 class periods. If you like these lessons, please consider using other Eureka lessons as well.
More information(1) Correspondence of the density matrix to traditional method
(1) Correspondence of the density matrix to traditional method New method (with the density matrix) Traditional method (from thermal physics courses) ZZ = TTTT ρρ = EE ρρ EE = dddd xx ρρ xx ii FF = UU
More information1. The graph of a function f is given above. Answer the question: a. Find the value(s) of x where f is not differentiable. Ans: x = 4, x = 3, x = 2,
1. The graph of a function f is given above. Answer the question: a. Find the value(s) of x where f is not differentiable. x = 4, x = 3, x = 2, x = 1, x = 1, x = 2, x = 3, x = 4, x = 5 b. Find the value(s)
More informationOptimum CUSUM Tests for Detecting Changes in Continuous Time Processes
Optimum CUSUM Tests for Detecting Changes in Continuous Time Processes George V. Moustakides INRIA, Rennes, France Outline The change detection problem Overview of existing results Lorden s criterion and
More informationParametric Models. Dr. Shuang LIANG. School of Software Engineering TongJi University Fall, 2012
Parametric Models Dr. Shuang LIANG School of Software Engineering TongJi University Fall, 2012 Today s Topics Maximum Likelihood Estimation Bayesian Density Estimation Today s Topics Maximum Likelihood
More informationAcceleration due to Gravity
1. Object Acceleration due to Gravity To determine the acceleration due to gravity by different methods. 2. Apparatus Balance, ball bearing, clamps, electric timers, meter stick, paper strips, precision
More informationUncertain Compression & Graph Coloring. Madhu Sudan Harvard
Uncertain Compression & Graph Coloring Madhu Sudan Harvard Based on joint works with: (1) Adam Kalai (MSR), Sanjeev Khanna (U.Penn), Brendan Juba (WUStL) (2) Elad Haramaty (Harvard) (3) Badih Ghazi (MIT),
More informationA new procedure for sensitivity testing with two stress factors
A new procedure for sensitivity testing with two stress factors C.F. Jeff Wu Georgia Institute of Technology Sensitivity testing : problem formulation. Review of the 3pod (3-phase optimal design) procedure
More informationChapter 22 : Electric potential
Chapter 22 : Electric potential What is electric potential? How does it relate to potential energy? How does it relate to electric field? Some simple applications What does it mean when it says 1.5 Volts
More information