Spectrum Opportunity Detection with Weak and Correlated Signals
|
|
- Matthew McCoy
- 5 years ago
- Views:
Transcription
1 Specum Opportunity Detection with Weak and Correlated Signals Yao Xie Department of Elecical and Computer Engineering Duke University orth Carolina David Siegmund Department of Statistics Stanford University California Asact We present a novel score detector for temporal specum opportunity detection in cognitive radio y exploiting the differences in oth energy and correlation of the empty and and the occupied and Motivated y the challenge of detecting a weak primary user s signal without precise knowledge of the signal where the conventional energy detector faces the limit of SR wall we assume a simple model which captures a key difference etween noise and primary user s signal their correlation suctures Besides the merit of incorporating signal correlation our score detector also avoids the computational complexity of covariance maix inversion incurred y the corresponding imum likelihood statistic assuming signal correlation We provide a theoretical approximation to the false-alarm-rate of the score detector which can e used to determine the threshold efficiently We demonsate that our approximation is quite accurate and that our score detector has an advantage when the signal is weak and correlated I ITRODUCTIO Cognitive radio is an emerging technology which has a great potential to increase specum efficiency A key challenge in cognitive radio is specum opportunity detection Recently temporal specum opportunity detection via change-point detection approach has atacted much interest [] ecause the change-point formulation fits well with the temporal opportunity detection ojective Also there is a wealth of tools for changepoint detection from the statistics literature Existing methods for specum opportunity detection primarily use three signal processing techniques: matched filtering of the specum of the received signal with that of the primary user cyclostationary feature detection and energy detection exploiting the difference etween received signal power and noise power The matched filtering and feature detector require detailed knowledge of primary user s signal When such knowledge is not availale energy detector is a popular choice However there is a fundamental limit with the energy detector the SR wall when the signal-to-ratio SR is low error for energy detector is very high In wireless environment however due to fading SR of the primary user s signal can e quite low Hence in cognitive radio there is a need for developing weak signal detector which also requires little priori knowledge aout the primary user s signal Motivated y the challenge of detecting weak signals in this paper we propose a novel score detector y exploiting differences etween signal and noise in oth energy and correlation We assume a simple model for the primary user s signal which captures a key difference etween signal and noise: their correlation sucture Based on this model we develop a detector using the score statistic which avoids the computationally intensive inversion of covariance maix in the corresponding imum likelihood statistic assuming signal correlation In conast to the matched filtering detector our model does not require precise knowledge aout primary user s signal We derive a theoretical approximation to the false-alarm-rate of our score detector which can e used to determine the threshold efficiently We demonsate using numerical simulation that our approximation is quite accurate We also show that the score detector has etter performance than the energy detector and the imum likelihood detector [] that only assumes power change Sections are organized as follows Section II presents formulation Section III derives the score detector Section IV contains a theorem that approximates the proaility-of-falsealarm for the score detector Section V demonsates that our approximation is accurate and the score detector has good performance Finally VI concludes the paper II FORMULATIO Consider a cognitive radio system with a primary user and a secondary user A secondary user tunes to a frequency and and starts to take samples y n n = where is the numer of samples If the and is not occupied the samples are white noise If the and is occupied the samples consist white noise and a primary user s signal Assume that the primary user s signal emerges at an unknown time k k Using these samples our goal is to detect whether or not the and is occupied This prolem can e formulated as the following hypothesis test H : y n = w n n = yn = w H : n n = k; y n = x n + w n n = k + where w n σ ie it is iid Gaussian white noise with zero mean and variance σ and x n is the primary user s signal seen y the secondary user Typically x n is temporally correlated due to dispersion of wireless channel and modulation scheme used y the ansmitter Let denote the anspose of a vector or maix We assume the covariance maix of the signal vector x k [x k+ x ] is Ex k x k V kθ
2 where is the signal power and V kθ R k k is the normalized covariance maix parameterized y θ Θ R d For example when x n has weak temporal correlation we can model it using the first-order autoregressive process AR- which corresponds to d = Hence under H the covariance maix of the received signal vector y k [y k+ y ] is E H y k y k Σ = σ I k + V kθ 3 We assume the signal correlation model eg AR- is known ut parameters k and θ are unknown The energy detector detects the primary user y comparing the receive energy with a threshold > yn n= In [] the imum likelihood ML detector exploiting power difference without assuming signal correlation sucture is studied For fixed sample size it corresponds to the following detector: + σ k + σ y T σ k y k k log σ [ ] for some threshold where the unknown is assumed to e within the range of [ ] and is a parameter that specifies the minimum numer of samples needed detection The log likelihood ratio of hypothesis H versus H for given k and θ is : L k θ = I y k Σ y k log Σ 4 σ σ k The imum likelihood detector assuming signal correlation sucture detects when: L k θ 5 k θ Θ for some threshold > It has a major drawack that it requires computing a maix inversion Σ for each and all possile values of k θ and III SCORE DETECTOR We present a imum score detector that can avoid the covariance maix inversion in the imum likelihood formulation 5 Maximum score is an alternative to imum likelihood that is frequently used in deriving efficient test especially when the parameter for H only contains one single point In our case H corresponds to = in 3 and hence we can derive an efficient score detector The score detector is derived as follows Consider the derivative of L in 4 with respect to and evaluated at = : L = [V kθ y k y k σ I] 6 = σ 4 where A denotes the ace of a square maix A In the following E and var denote the proaility mean and variance under the null hypothesis We can verify the mean of the derivative under the null hypothesis is zero: E L = = The covariance of 6 under null hypothesis can e shown to e L var = = σ 4 V kθ V kθ 7 The score statistics is L = normalized y its mean and variance: Zk θ = V kθ yk+ y k+ V kθ V σ kθ I k 8 ote that Zk θ is a two dimensional random field in k and θ Θ with zero mean and unit variance The second expression shows that Zk θ can e interpreted as a matched-filter : matching the theoretical covariance maix with the sample covariance maix The score detector detects a signal when: Zk θ 9 k θ Θ for some threshold > We consider two performance meics for the detectors presented aove: the proaility-of-false-detection e H T and the proaility-of-detection under H : d H T f α where T is the statistic of the corresponding detector Assume that e is related to the threshold y some function f: e = f We will otain this function in Theorem roaility of Detection Energy ML ower Score False Alarm Rate Fig : roaility-of-detection versus proaility-of-false-detection for the energy detector ML power detector and the score detector for θ = 7 and σ s = 7 The noise variance is σ = IV AROXIMATIO OF ROBABILITY-OF-FALSE-DETECTIO We prove the following theorem that approximates the proaility-of-false-detection e of the score detector for a
3 given threshold which can e used to determine the threshold efficiently Theorem : When under H the proaility-offalse-detection of the score detector 9 is e H Zk θ where = π d k θ Θ k= gk θ Hk θ Ṽ = θ Θ [ξ k θ] d ξ k θ µk θ k ν V kθ µk θ k V kθ V kθ ξ k θ > is the solution to [ hξ I k ξ Ṽ Ṽ var ξ Z = ] Ṽ dθ + o = ] [ I k ξ Ṽ Ṽ I ξ Ṽ Ṽ ψξ = ξṽ log I ξṽ gk θ = exp ξ k θ + ψξ k θ πvarξ Z the Hessian of the covariance maix Fisher information maix is Hk θ = E Zk θzk s s s=θ µk θ = k V k+θ V k+θ V kθ V T kθ and special function Corollary 844 of [] or in [3]: [ x Φ x ] νx x Φ x + φ x 3 where φx and Φx are the density and disiution function of respectively The proof of this theorem is provided in Appendix V UMERICAL EXAMLES In this section we first verify that our approximation in Theorem is very accurate and then demonsate that the score detect compares favoraly with other detectors that do not exploit signal correlation A Approximation accuracy of Theorem for e Consider the first-order autoregressive process AR with d = θ [ 5] = = 3 The AR process evolves according to x n+ = θx n + ε n 4 where θ < and the process noise ε n are iid The covariance maix for AR is θ θ θ k V kθ = θ θ θ k 5 To demonsate that our approximation in Theorem is also accurate for d > we also consider a first-order autoregressive moving-average process ARMA with d = parameters θ and φ The AR process evolves according x n+ + φx n = θε n + ε n+ where ε n The corresponding covariance maix is V kθ = + θ φθ φ θ φθ φφ θ φθ φ θ φθ + θ φθ φ θ φθ φφ θ φθ In Tale I for AR and Tale II for AR the Monte Carlo results are all otained from ials ote that our approximation in Theorem is very close to the corresponding Monte Carlo result in oth examples TABLE I: Approximate of e for AR Monte Carlo Theorem TABLE II: Approximate e for ARMA Monte Carlo Theorem B Comparison of proaility-of-detection d We compare our score detector with the energy detector and the imum likelihood ML power detector [] We simulate the signal as an AR process 4 with θ = θ and process noise with variance σs The signal power of the AR process can e estimated using the variance of the steady state = σs/ θ Assume = the primary user emerges at k = 5 with = and consider various ue signal correlation θ The proaility-of-detection is simulated via 5 Monte Carlo ials For the score statistic we set θ [3 8] Fig demonsates that the score detector has the highest proaility-of-detection among the three detectors over a wide range of proaility-of-false-detection false-alarm rate when θ = 7 and σs = 7 Tale III further demonsates that the score detector has the est performance among the three detectors different θ and σs values 3
4 TABLE III: d for a fixed e = α = Each cell of the tale corresponds to score detector / ML power detector / energy detector The old numers correspond to score detector θ σs /68/6 9/76/6 9/75/ /79/7 95/83/73 98/86/79 VI COCLUSIOS We have present a novel score detector to detect weak signal exploiting oth the signal temporal correlation and power Here we consider cognitive radio specum detection evertheless our formulation of the score detector is general and it can e used for similar prolems We provide a theoretical approximation to the false-alarm-rate of the score detector which can e used to determine the threshold efficiently We demonsate that our approximation is quite accurate and that the score detector has an advantage when signal is weak and correlated AEDIX In the following we prove Theorem for d = Last Hitting Time Formula: We discretize the parameter θ θ θ k y rectangular mesh grid of size of times where > is a small numer The size of the mesh is chosen to alance the difference in the order of the variance in these two coordinates Then e of the score detector can e approximated as Z ij D i j 6 where the index set D = i j : i θ j θ 7 covers the parameter space Let the index set Ji j denotes everything to the future of the current index i j upper and to the right of i j in the random field Ji j = i j D : j j or j = j and i i Using the last hitting time decomposition [5] we can rewrite 6 as Z i j ij D Z i j i j i j D = i j D Z ij Ji j ij Ji j Z Z i j = + x dx i j Z i j = + x 8 ext we will find approximations for the proaility Z i j = + x dx 9 and the conditional proaility Z i j ij Ji j Z i j = + x respectively Skewness Correction: ote that Zk θ is a quadratic function in a Gaussian random vector so Gaussian disiution is not likely to e a good approximation for Zk θ Moreover since is smaller than 9 in magnitude getting an accurate approximate for is important On the other hand Gaussian approximation is etter for the mean than for the tail of the disiution To otain a etter approximation we use the change-of-measure technique to shift the mean of the random field to the threshold and use complete cumulative generating function ote that 9 can e written as Z i j = + x dx g i j exp ξ dx x where g and ξ are defined in and respectively 3 Local Analysis of Covariance: Consider the covariance E Zn θ Zm θ for scores at change-points n and m and with parameters θ and θ respectively Assume the covariance maix associated with y n is V nθ and that associated with y m is V mθ respectively Also assume n > m so the dimension of the covariance maix for y m is larger than that for y n Also note that y n and y m have overlapping samples so V nθ is a su-lock maix of V mθ Based on these oservations after some derivations we find the covariance of Zk θ under H to e E Zn θ Zm θ V nθ V nθ = [ ] / V nθ V nθ V mθ V mθ A special case is when θ = θ n = m then ecomes E Zn θ = which is consistent with the unit variance of Zk θ To study the local covariance of the random field set θ = θ θ = θ + δ n = k and m = k i i = k in We have to run the index k for the change point ackwards ecause the smaller the k the more post-change samples we have and hence the larger the dimension of the covariance maix V nθ Assume δ and i are small relative to θ and k respectively We will expand everything in terms of θ k δ and i Using the first order approximation keeping only the first order terms the local covariance is give y E Zk θzk i θ + δ γ k θδ µk θ k i + oδ + oi 3 When d = the Hessian maix Hk θ is a scalar and is 4
5 γk θ = V kθv kθ V kθ V kθ 4 where the prime f denotes fθ θ ote that γk θ is independent of i The µθ k defined in is the ratio of the average sum-of-squares of the additional terms when we decrease k y a small amount over the average sum-of-squares of the original terms in the covariance maix V kθ 4 Local Random Field Decomposition: ote that the first order expansion of the covariance does not have cross product terms This implies that if we assume Zk θ to e Gaussian it can e decomposed as a sum of two independent one dimensional random processes Using the local covariance we just found we have the following Lemma: Lemma : Assume ξ n with ξ and d where d > is some constant The discretized [ ] process Z k i θ + j ξ i Z j conditioned on Z k θ = ξ can e written as sum of two independent processes: [ Z k i θ + j ξ] Z k θ = ξ = S i + V j where S i = i l= a l with µk θ µk θ a l k k and V j = γ jv γ j with V By Lemma using the techniques in [5] and [4] we have the conditional proaility can e written in terms of decomposed random processes: [ Z i j ij Ji j Z i j = + x S i x i Z ] i j x i S i + j V j x 5 A similar argument for 5 can e found in [5] and [4] 5 Limit y Shrinking : ut this together with approximation for 9 in the approximate significant level ecomes Z i j ij D g i j i j D exp ξ x S i + V j x i j S i x i dx 6 The following Lemma which is an extension of Lemma in [4] enales us to find an expression for integration over x in 8: Lemma 3: Assume x x iid µ σ with µ > Define the random walk S = S i = i l= x l i = and the smooth varying random process V j = βjv β j for some constants > β > As for some constant α > we have = e αx S i x i S i + V j x i j β µ µ ν π σ σ dx 7 where νx is defined in 3 Finally using Lemma 3 for 6 with α = ξ β = γ µ = µkθ k and σ = µkθ k we have the approximate significance level g i j µi j π i i j D ν µ i j i γ i j 8 As the Riemann sum 8 converges to the approximation in Theorem The proof is more complex when the numer of parameters d > and we have to use different techniques such as computing a Mill s ratio type of expression y decomposing the process as a random walk plus a smooth Gaussian field The complete proof can e found in [6] REFERECES [] L Lai Y Fan and H V oor Quickest detection in cognitive radio: a sequential change detection framework IEEE GLOBECOM 8 [] D Siegmund Sequential Analysis: Tests and Confidence Intervals Springer Series in Statistics Springer 985 [3] D Siegmund and B Yakir The statistics of gene mapping Springer 7 [4] H-J Kim and D Siegmund The likelihood ratio test for a change-point in simple linear regression Biomeica vol 76 no 3 pp [5] D Siegmund Approximate tail proailities for the ima of some random fields The Annuals of roaility vol 6 no pp [6] Y Xie and D Siegmund Change-point detection of weak signals: How to use signal correlation? tech rep 5
Luis Manuel Santana Gallego 100 Investigation and simulation of the clock skew in modern integrated circuits. Clock Skew Model
Luis Manuel Santana Gallego 100 Appendix 3 Clock Skew Model Xiaohong Jiang and Susumu Horiguchi [JIA-01] 1. Introduction The evolution of VLSI chips toward larger die sizes and faster clock speeds makes
More informationFinQuiz Notes
Reading 9 A time series is any series of data that varies over time e.g. the quarterly sales for a company during the past five years or daily returns of a security. When assumptions of the regression
More informationA Sufficient Condition for Optimality of Digital versus Analog Relaying in a Sensor Network
A Sufficient Condition for Optimality of Digital versus Analog Relaying in a Sensor Network Chandrashekhar Thejaswi PS Douglas Cochran and Junshan Zhang Department of Electrical Engineering Arizona State
More informationSimple Examples. Let s look at a few simple examples of OI analysis.
Simple Examples Let s look at a few simple examples of OI analysis. Example 1: Consider a scalar prolem. We have one oservation y which is located at the analysis point. We also have a ackground estimate
More informationROBUST MINIMUM DISTANCE NEYMAN-PEARSON DETECTION OF A WEAK SIGNAL IN NON-GAUSSIAN NOISE
17th European Signal Processing Conference EUSIPCO 2009) Glasgow, Scotland, August 24-28, 2009 ROBUST MIIMUM DISTACE EYMA-PEARSO DETECTIO OF A WEAK SIGAL I O-GAUSSIA OISE Georgy Shevlyakov, Kyungmin Lee,
More informationLecture 5: Likelihood ratio tests, Neyman-Pearson detectors, ROC curves, and sufficient statistics. 1 Executive summary
ECE 830 Spring 207 Instructor: R. Willett Lecture 5: Likelihood ratio tests, Neyman-Pearson detectors, ROC curves, and sufficient statistics Executive summary In the last lecture we saw that the likelihood
More informationBrief Review on Estimation Theory
Brief Review on Estimation Theory K. Abed-Meraim ENST PARIS, Signal and Image Processing Dept. abed@tsi.enst.fr This presentation is essentially based on the course BASTA by E. Moulines Brief review on
More informationAn Estimation Based Allocation Rule with Super-linear Regret and Finite Lock-on Time for Time-dependent Multi-armed Bandit Processes
An Estimation Based Allocation Rule with Super-linear Regret and Finite Lock-on Time for Time-dependent Multi-armed Bandit Processes Prokopis C. Prokopiou, Peter E. Caines, and Aditya Mahajan McGill University
More informationLecture 2: From Linear Regression to Kalman Filter and Beyond
Lecture 2: From Linear Regression to Kalman Filter and Beyond January 18, 2017 Contents 1 Batch and Recursive Estimation 2 Towards Bayesian Filtering 3 Kalman Filter and Bayesian Filtering and Smoothing
More informationA732: Exercise #7 Maximum Likelihood
A732: Exercise #7 Maximum Likelihood Due: 29 Novemer 2007 Analytic computation of some one-dimensional maximum likelihood estimators (a) Including the normalization, the exponential distriution function
More informationADAPTIVE ARRAY DETECTION ALGORITHMS WITH STEERING VECTOR MISMATCH
ADAPTIVE ARRAY DETECTIO ALGORITHMS WITH STEERIG VECTOR MISMATCH LIM Chin Heng, Elias Aboutanios Bernard Mulgrew Institute for Digital Communications School of Engineering & Electronics, University of Edinburgh
More informationInformation in a Two-Stage Adaptive Optimal Design
Information in a Two-Stage Adaptive Optimal Design Department of Statistics, University of Missouri Designed Experiments: Recent Advances in Methods and Applications DEMA 2011 Isaac Newton Institute for
More informationROBUST FREQUENCY DOMAIN ARMA MODELLING. Jonas Gillberg Fredrik Gustafsson Rik Pintelon
ROBUST FREQUENCY DOMAIN ARMA MODELLING Jonas Gillerg Fredrik Gustafsson Rik Pintelon Department of Electrical Engineering, Linköping University SE-581 83 Linköping, Sweden Email: gillerg@isy.liu.se, fredrik@isy.liu.se
More informationPHY451, Spring /5
PHY451, Spring 2011 Notes on Optical Pumping Procedure & Theory Procedure 1. Turn on the electronics and wait for the cell to warm up: ~ ½ hour. The oven should already e set to 50 C don t change this
More informationElements of Multivariate Time Series Analysis
Gregory C. Reinsel Elements of Multivariate Time Series Analysis Second Edition With 14 Figures Springer Contents Preface to the Second Edition Preface to the First Edition vii ix 1. Vector Time Series
More information10. Composite Hypothesis Testing. ECE 830, Spring 2014
10. Composite Hypothesis Testing ECE 830, Spring 2014 1 / 25 In many real world problems, it is difficult to precisely specify probability distributions. Our models for data may involve unknown parameters
More informationMinimum Feedback Rates for Multi-Carrier Transmission With Correlated Frequency Selective Fading
Minimum Feedback Rates for Multi-Carrier Transmission With Correlated Frequency Selective Fading Yakun Sun and Michael L. Honig Department of ECE orthwestern University Evanston, IL 60208 Abstract We consider
More informationBayesian Estimation of DSGE Models 1 Chapter 3: A Crash Course in Bayesian Inference
1 The views expressed in this paper are those of the authors and do not necessarily reflect the views of the Federal Reserve Board of Governors or the Federal Reserve System. Bayesian Estimation of DSGE
More informationComment about AR spectral estimation Usually an estimate is produced by computing the AR theoretical spectrum at (ˆφ, ˆσ 2 ). With our Monte Carlo
Comment aout AR spectral estimation Usually an estimate is produced y computing the AR theoretical spectrum at (ˆφ, ˆσ 2 ). With our Monte Carlo simulation approach, for every draw (φ,σ 2 ), we can compute
More informationExpansion formula using properties of dot product (analogous to FOIL in algebra): u v 2 u v u v u u 2u v v v u 2 2u v v 2
Least squares: Mathematical theory Below we provide the "vector space" formulation, and solution, of the least squares prolem. While not strictly necessary until we ring in the machinery of matrix algera,
More informationMaster s Written Examination
Master s Written Examination Option: Statistics and Probability Spring 016 Full points may be obtained for correct answers to eight questions. Each numbered question which may have several parts is worth
More informationDistributed Spectrum Sensing for Cognitive Radio Networks Based on the Sphericity Test
This article h been accepted for publication in a future issue of this journal, but h not been fully edited. Content may change prior to final publication. Citation information: DOI 0.09/TCOMM.208.2880902,
More information2. What are the tradeoffs among different measures of error (e.g. probability of false alarm, probability of miss, etc.)?
ECE 830 / CS 76 Spring 06 Instructors: R. Willett & R. Nowak Lecture 3: Likelihood ratio tests, Neyman-Pearson detectors, ROC curves, and sufficient statistics Executive summary In the last lecture we
More informationStochastic Proximal Gradient Algorithm
Stochastic Institut Mines-Télécom / Telecom ParisTech / Laboratoire Traitement et Communication de l Information Joint work with: Y. Atchade, Ann Arbor, USA, G. Fort LTCI/Télécom Paristech and the kind
More informationEUSIPCO
EUSIPCO 3 569736677 FULLY ISTRIBUTE SIGNAL ETECTION: APPLICATION TO COGNITIVE RAIO Franc Iutzeler Philippe Ciblat Telecom ParisTech, 46 rue Barrault 753 Paris, France email: firstnamelastname@telecom-paristechfr
More informationIf we want to analyze experimental or simulated data we might encounter the following tasks:
Chapter 1 Introduction If we want to analyze experimental or simulated data we might encounter the following tasks: Characterization of the source of the signal and diagnosis Studying dependencies Prediction
More informationAppendix A: The time series behavior of employment growth
Unpublished appendices from The Relationship between Firm Size and Firm Growth in the U.S. Manufacturing Sector Bronwyn H. Hall Journal of Industrial Economics 35 (June 987): 583-606. Appendix A: The time
More informationThe Mean Version One way to write the One True Regression Line is: Equation 1 - The One True Line
Chapter 27: Inferences for Regression And so, there is one more thing which might vary one more thing aout which we might want to make some inference: the slope of the least squares regression line. The
More informationTesting near or at the Boundary of the Parameter Space (Job Market Paper)
Testing near or at the Boundary of the Parameter Space (Jo Market Paper) Philipp Ketz Brown University Novemer 7, 24 Statistical inference aout a scalar parameter is often performed using the two-sided
More informationZ-estimators (generalized method of moments)
Z-estimators (generalized method of moments) Consider the estimation of an unknown parameter θ in a set, based on data x = (x,...,x n ) R n. Each function h(x, ) on defines a Z-estimator θ n = θ n (x,...,x
More informationTechnical Appendix: Imperfect information and the business cycle
Technical Appendix: Imperfect information and the usiness cycle Farice Collard Harris Dellas Frank Smets March 29 We would like to thank Marty Eichenaum, Jesper Lindé, Thomas Luik, Frank Schorfheide and
More informationOn the Expected Rate of Slowly Fading Channels with Quantized Side Information
On the Expected Rate of Slowly Fading Channels with Quantized Side Information Thanh Tùng Kim and Mikael Skoglund 2005-10-30 IR S3 KT 0515 c 2005 IEEE. Personal use of this material is permitted. However,
More informationIN this paper, we consider the estimation of the frequency
Iterative Frequency Estimation y Interpolation on Fourier Coefficients Elias Aoutanios, MIEEE, Bernard Mulgrew, MIEEE Astract The estimation of the frequency of a complex exponential is a prolem that is
More information1. Define the following terms (1 point each): alternative hypothesis
1 1. Define the following terms (1 point each): alternative hypothesis One of three hypotheses indicating that the parameter is not zero; one states the parameter is not equal to zero, one states the parameter
More informationEach element of this set is assigned a probability. There are three basic rules for probabilities:
XIV. BASICS OF ROBABILITY Somewhere out there is a set of all possile event (or all possile sequences of events which I call Ω. This is called a sample space. Out of this we consider susets of events which
More informationComposite Hypotheses and Generalized Likelihood Ratio Tests
Composite Hypotheses and Generalized Likelihood Ratio Tests Rebecca Willett, 06 In many real world problems, it is difficult to precisely specify probability distributions. Our models for data may involve
More informationTesting Restrictions and Comparing Models
Econ. 513, Time Series Econometrics Fall 00 Chris Sims Testing Restrictions and Comparing Models 1. THE PROBLEM We consider here the problem of comparing two parametric models for the data X, defined by
More informationApplications of Robust Optimization in Signal Processing: Beamforming and Power Control Fall 2012
Applications of Robust Optimization in Signal Processing: Beamforg and Power Control Fall 2012 Instructor: Farid Alizadeh Scribe: Shunqiao Sun 12/09/2012 1 Overview In this presentation, we study the applications
More informationFixed-b Inference for Testing Structural Change in a Time Series Regression
Fixed- Inference for esting Structural Change in a ime Series Regression Cheol-Keun Cho Michigan State University imothy J. Vogelsang Michigan State University August 29, 24 Astract his paper addresses
More informationSelection of Smoothing Parameter for One-Step Sparse Estimates with L q Penalty
Journal of Data Science 9(2011), 549-564 Selection of Smoothing Parameter for One-Step Sparse Estimates with L q Penalty Masaru Kanba and Kanta Naito Shimane University Abstract: This paper discusses the
More informationGARCH Models Estimation and Inference. Eduardo Rossi University of Pavia
GARCH Models Estimation and Inference Eduardo Rossi University of Pavia Likelihood function The procedure most often used in estimating θ 0 in ARCH models involves the maximization of a likelihood function
More informationSequential Change-Point Approach for Online Community Detection
Sequential Change-Point Approach for Online Community Detection Yao Xie Joint work with David Marangoni-Simonsen H. Milton Stewart School of Industrial and Systems Engineering Georgia Institute of Technology
More informationMULTIPLE-CHANNEL DETECTION IN ACTIVE SENSING. Kaitlyn Beaudet and Douglas Cochran
MULTIPLE-CHANNEL DETECTION IN ACTIVE SENSING Kaitlyn Beaudet and Douglas Cochran School of Electrical, Computer and Energy Engineering Arizona State University, Tempe AZ 85287-576 USA ABSTRACT The problem
More informationEssential Maths 1. Macquarie University MAFC_Essential_Maths Page 1 of These notes were prepared by Anne Cooper and Catriona March.
Essential Maths 1 The information in this document is the minimum assumed knowledge for students undertaking the Macquarie University Masters of Applied Finance, Graduate Diploma of Applied Finance, and
More informationNovel spectrum sensing schemes for Cognitive Radio Networks
Novel spectrum sensing schemes for Cognitive Radio Networks Cantabria University Santander, May, 2015 Supélec, SCEE Rennes, France 1 The Advanced Signal Processing Group http://gtas.unican.es The Advanced
More informationProbabilistic Modelling and Reasoning: Assignment Modelling the skills of Go players. Instructor: Dr. Amos Storkey Teaching Assistant: Matt Graham
Mechanics Proailistic Modelling and Reasoning: Assignment Modelling the skills of Go players Instructor: Dr. Amos Storkey Teaching Assistant: Matt Graham Due in 16:00 Monday 7 th March 2016. Marks: This
More informationNormalising constants and maximum likelihood inference
Normalising constants and maximum likelihood inference Jakob G. Rasmussen Department of Mathematics Aalborg University Denmark March 9, 2011 1/14 Today Normalising constants Approximation of normalising
More informationEcon 623 Econometrics II Topic 2: Stationary Time Series
1 Introduction Econ 623 Econometrics II Topic 2: Stationary Time Series In the regression model we can model the error term as an autoregression AR(1) process. That is, we can use the past value of the
More informationGARCH Models Estimation and Inference
Università di Pavia GARCH Models Estimation and Inference Eduardo Rossi Likelihood function The procedure most often used in estimating θ 0 in ARCH models involves the maximization of a likelihood function
More informationSELECTIVE ANGLE MEASUREMENTS FOR A 3D-AOA INSTRUMENTAL VARIABLE TMA ALGORITHM
SELECTIVE ANGLE MEASUREMENTS FOR A 3D-AOA INSTRUMENTAL VARIABLE TMA ALGORITHM Kutluyıl Doğançay Reza Arablouei School of Engineering, University of South Australia, Mawson Lakes, SA 595, Australia ABSTRACT
More informationLTI Systems, Additive Noise, and Order Estimation
LTI Systems, Additive oise, and Order Estimation Soosan Beheshti, Munther A. Dahleh Laboratory for Information and Decision Systems Department of Electrical Engineering and Computer Science Massachusetts
More informationLecture 7 Introduction to Statistical Decision Theory
Lecture 7 Introduction to Statistical Decision Theory I-Hsiang Wang Department of Electrical Engineering National Taiwan University ihwang@ntu.edu.tw December 20, 2016 1 / 55 I-Hsiang Wang IT Lecture 7
More informationChange-Point Detection and Copy Number Variation
Change-Point Detection and Copy Number Variation Department of Statistics The Hebrew University IMS, Singapore, 2009 Outline 1 2 3 (CNV) Classical change-point detection At each monitoring period we observe
More informationTAKEHOME FINAL EXAM e iω e 2iω e iω e 2iω
ECO 513 Spring 2015 TAKEHOME FINAL EXAM (1) Suppose the univariate stochastic process y is ARMA(2,2) of the following form: y t = 1.6974y t 1.9604y t 2 + ε t 1.6628ε t 1 +.9216ε t 2, (1) where ε is i.i.d.
More informationCHANGE DETECTION WITH UNKNOWN POST-CHANGE PARAMETER USING KIEFER-WOLFOWITZ METHOD
CHANGE DETECTION WITH UNKNOWN POST-CHANGE PARAMETER USING KIEFER-WOLFOWITZ METHOD Vijay Singamasetty, Navneeth Nair, Srikrishna Bhashyam and Arun Pachai Kannu Department of Electrical Engineering Indian
More informationLecture 8: Signal Detection and Noise Assumption
ECE 830 Fall 0 Statistical Signal Processing instructor: R. Nowak Lecture 8: Signal Detection and Noise Assumption Signal Detection : X = W H : X = S + W where W N(0, σ I n n and S = [s, s,..., s n ] T
More informationThe Admixture Model in Linkage Analysis
The Admixture Model in Linkage Analysis Jie Peng D. Siegmund Department of Statistics, Stanford University, Stanford, CA 94305 SUMMARY We study an appropriate version of the score statistic to test the
More informationDeterminants of generalized binary band matrices
Determinants of generalized inary and matrices Dmitry Efimov arxiv:17005655v1 [mathra] 18 Fe 017 Department of Mathematics, Komi Science Centre UrD RAS, Syktyvkar, Russia Astract Under inary matrices we
More informationarxiv: v3 [stat.me] 12 Jul 2015
Derivative-Free Estimation of the Score Vector and Observed Information Matrix with Application to State-Space Models Arnaud Doucet 1, Pierre E. Jacob and Sylvain Rubenthaler 3 1 Department of Statistics,
More informationTime Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY
Time Series Analysis James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY & Contents PREFACE xiii 1 1.1. 1.2. Difference Equations First-Order Difference Equations 1 /?th-order Difference
More informationMATH 131P: PRACTICE FINAL SOLUTIONS DECEMBER 12, 2012
MATH 3P: PRACTICE FINAL SOLUTIONS DECEMBER, This is a closed ook, closed notes, no calculators/computers exam. There are 6 prolems. Write your solutions to Prolems -3 in lue ook #, and your solutions to
More informationINTRODUCTION. 2. Characteristic curve of rain intensities. 1. Material and methods
Determination of dates of eginning and end of the rainy season in the northern part of Madagascar from 1979 to 1989. IZANDJI OWOWA Landry Régis Martial*ˡ, RABEHARISOA Jean Marc*, RAKOTOVAO Niry Arinavalona*,
More informationA REVERSE TO THE JEFFREYS LINDLEY PARADOX
PROBABILITY AND MATHEMATICAL STATISTICS Vol. 38, Fasc. 1 (2018), pp. 243 247 doi:10.19195/0208-4147.38.1.13 A REVERSE TO THE JEFFREYS LINDLEY PARADOX BY WIEBE R. P E S T M A N (LEUVEN), FRANCIS T U E R
More information9. Model Selection. statistical models. overview of model selection. information criteria. goodness-of-fit measures
FE661 - Statistical Methods for Financial Engineering 9. Model Selection Jitkomut Songsiri statistical models overview of model selection information criteria goodness-of-fit measures 9-1 Statistical models
More informationE cient Importance Sampling
E cient David N. DeJong University of Pittsburgh Spring 2008 Our goal is to calculate integrals of the form Z G (Y ) = ϕ (θ; Y ) dθ. Special case (e.g., posterior moment): Z G (Y ) = Θ Θ φ (θ; Y ) p (θjy
More informationBayesian Inference for DSGE Models. Lawrence J. Christiano
Bayesian Inference for DSGE Models Lawrence J. Christiano Outline State space-observer form. convenient for model estimation and many other things. Bayesian inference Bayes rule. Monte Carlo integation.
More informationNotes, March 4, 2013, R. Dudley Maximum likelihood estimation: actual or supposed
18.466 Notes, March 4, 2013, R. Dudley Maximum likelihood estimation: actual or supposed 1. MLEs in exponential families Let f(x,θ) for x X and θ Θ be a likelihood function, that is, for present purposes,
More informationDistributed detection of topological changes in communication networks. Riccardo Lucchese, Damiano Varagnolo, Karl H. Johansson
1 Distributed detection of topological changes in communication networks Riccardo Lucchese, Damiano Varagnolo, Karl H. Johansson Thanks to... 2 The need: detecting changes in topological networks 3 The
More informationLecture 2: Univariate Time Series
Lecture 2: Univariate Time Series Analysis: Conditional and Unconditional Densities, Stationarity, ARMA Processes Prof. Massimo Guidolin 20192 Financial Econometrics Spring/Winter 2017 Overview Motivation:
More informationF2E5216/TS1002 Adaptive Filtering and Change Detection. Course Organization. Lecture plan. The Books. Lecture 1
Adaptive Filtering and Change Detection Bo Wahlberg (KTH and Fredrik Gustafsson (LiTH Course Organization Lectures and compendium: Theory, Algorithms, Applications, Evaluation Toolbox and manual: Algorithms,
More information1 Hoeffding s Inequality
Proailistic Method: Hoeffding s Inequality and Differential Privacy Lecturer: Huert Chan Date: 27 May 22 Hoeffding s Inequality. Approximate Counting y Random Sampling Suppose there is a ag containing
More informationTesting equality of autocovariance operators for functional time series
Testing equality of autocovariance operators for functional time series Dimitrios PILAVAKIS, Efstathios PAPARODITIS and Theofanis SAPATIAS Department of Mathematics and Statistics, University of Cyprus,
More informationAdaptive Spectrum Sensing
Adaptive Spectrum Sensing Wenyi Zhang, Ahmed K. Sadek, Cong Shen, and Stephen J. Shellhammer Abstract A challenge met in realizing spectrum sensing for cognitive radio is how to identify occupied channels
More informationVector Auto-Regressive Models
Vector Auto-Regressive Models Laurent Ferrara 1 1 University of Paris Nanterre M2 Oct. 2018 Overview of the presentation 1. Vector Auto-Regressions Definition Estimation Testing 2. Impulse responses functions
More informationVAR Models and Applications
VAR Models and Applications Laurent Ferrara 1 1 University of Paris West M2 EIPMC Oct. 2016 Overview of the presentation 1. Vector Auto-Regressions Definition Estimation Testing 2. Impulse responses functions
More informationBrandon C. Kelly (Harvard Smithsonian Center for Astrophysics)
Brandon C. Kelly (Harvard Smithsonian Center for Astrophysics) Probability quantifies randomness and uncertainty How do I estimate the normalization and logarithmic slope of a X ray continuum, assuming
More informationDS-GA 1002 Lecture notes 10 November 23, Linear models
DS-GA 2 Lecture notes November 23, 2 Linear functions Linear models A linear model encodes the assumption that two quantities are linearly related. Mathematically, this is characterized using linear functions.
More informationEECS564 Estimation, Filtering, and Detection Exam 2 Week of April 20, 2015
EECS564 Estimation, Filtering, and Detection Exam Week of April 0, 015 This is an open book takehome exam. You have 48 hours to complete the exam. All work on the exam should be your own. problems have
More informationACCURATE ASYMPTOTIC ANALYSIS FOR JOHN S TEST IN MULTICHANNEL SIGNAL DETECTION
ACCURATE ASYMPTOTIC ANALYSIS FOR JOHN S TEST IN MULTICHANNEL SIGNAL DETECTION Yu-Hang Xiao, Lei Huang, Junhao Xie and H.C. So Department of Electronic and Information Engineering, Harbin Institute of Technology,
More informationBLIND SEPARATION OF TEMPORALLY CORRELATED SOURCES USING A QUASI MAXIMUM LIKELIHOOD APPROACH
BLID SEPARATIO OF TEMPORALLY CORRELATED SOURCES USIG A QUASI MAXIMUM LIKELIHOOD APPROACH Shahram HOSSEII, Christian JUTTE Laboratoire des Images et des Signaux (LIS, Avenue Félix Viallet Grenoble, France.
More informationANOVA 3/12/2012. Two reasons for using ANOVA. Type I Error and Multiple Tests. Review Independent Samples t test
// ANOVA Lectures - Readings: GW Review Independent Samples t test Placeo Treatment 7 7 7 Mean... Review Independent Samples t test Placeo Treatment 7 7 7 Mean.. t (). p. C. I.: p t tcrit s pt crit s t
More informationBayesian Inference for DSGE Models. Lawrence J. Christiano
Bayesian Inference for DSGE Models Lawrence J. Christiano Outline State space-observer form. convenient for model estimation and many other things. Preliminaries. Probabilities. Maximum Likelihood. Bayesian
More informationStudent-t Process as Alternative to Gaussian Processes Discussion
Student-t Process as Alternative to Gaussian Processes Discussion A. Shah, A. G. Wilson and Z. Gharamani Discussion by: R. Henao Duke University June 20, 2014 Contributions The paper is concerned about
More informationGARCH Models Estimation and Inference
GARCH Models Estimation and Inference Eduardo Rossi University of Pavia December 013 Rossi GARCH Financial Econometrics - 013 1 / 1 Likelihood function The procedure most often used in estimating θ 0 in
More informationStatistics & Data Sciences: First Year Prelim Exam May 2018
Statistics & Data Sciences: First Year Prelim Exam May 2018 Instructions: 1. Do not turn this page until instructed to do so. 2. Start each new question on a new sheet of paper. 3. This is a closed book
More informationBandits : optimality in exponential families
Bandits : optimality in exponential families Odalric-Ambrym Maillard IHES, January 2016 Odalric-Ambrym Maillard Bandits 1 / 40 Introduction 1 Stochastic multi-armed bandits 2 Boundary crossing probabilities
More informationTesting composite hypotheses applied to AR-model order estimation; the Akaike-criterion revised
MODDEMEIJER: TESTING COMPOSITE HYPOTHESES; THE AKAIKE-CRITERION REVISED 1 Testing composite hypotheses applied to AR-model order estimation; the Akaike-criterion revised Rudy Moddemeijer Abstract Akaike
More informationResearch Article Degenerate-Generalized Likelihood Ratio Test for One-Sided Composite Hypotheses
Mathematical Problems in Engineering Volume 2012, Article ID 538342, 11 pages doi:10.1155/2012/538342 Research Article Degenerate-Generalized Likelihood Ratio Test for One-Sided Composite Hypotheses Dongdong
More informationMATHEMATICAL ENGINEERING TECHNICAL REPORTS. Polynomial Time Perfect Sampler for Discretized Dirichlet Distribution
MATHEMATICAL ENGINEERING TECHNICAL REPORTS Polynomial Time Perfect Sampler for Discretized Dirichlet Distriution Tomomi MATSUI and Shuji KIJIMA METR 003 7 April 003 DEPARTMENT OF MATHEMATICAL INFORMATICS
More informationIEEE C80216m-09/0079r1
Project IEEE 802.16 Broadband Wireless Access Working Group Title Efficient Demodulators for the DSTTD Scheme Date 2009-01-05 Submitted M. A. Khojastepour Ron Porat Source(s) NEC
More informationEstimation of Operational Risk Capital Charge under Parameter Uncertainty
Estimation of Operational Risk Capital Charge under Parameter Uncertainty Pavel V. Shevchenko Principal Research Scientist, CSIRO Mathematical and Information Sciences, Sydney, Locked Bag 17, North Ryde,
More informationPosterior Covariance vs. Analysis Error Covariance in Data Assimilation
Posterior Covariance vs. Analysis Error Covariance in Data Assimilation F.-X. Le Dimet(1), I. Gejadze(2), V. Shutyaev(3) (1) Université de Grenole (2)University of Strathclyde, Glasgow, UK (3) Institute
More informationHIGH-DIMENSIONAL GRAPHS AND VARIABLE SELECTION WITH THE LASSO
The Annals of Statistics 2006, Vol. 34, No. 3, 1436 1462 DOI: 10.1214/009053606000000281 Institute of Mathematical Statistics, 2006 HIGH-DIMENSIONAL GRAPHS AND VARIABLE SELECTION WITH THE LASSO BY NICOLAI
More informationStatistics: Learning models from data
DS-GA 1002 Lecture notes 5 October 19, 2015 Statistics: Learning models from data Learning models from data that are assumed to be generated probabilistically from a certain unknown distribution is a crucial
More informationOnline Supplementary Appendix B
Online Supplementary Appendix B Uniqueness of the Solution of Lemma and the Properties of λ ( K) We prove the uniqueness y the following steps: () (A8) uniquely determines q as a function of λ () (A) uniquely
More informationParticle Filter Track Before Detect Algorithms
Particle Filter Track Before Detect Algorithms Theory and Applications Y. Boers and J.N. Driessen JRS-PE-FAA THALES NEDERLAND Hengelo The Netherlands Email: {yvo.boers,hans.driessen}@nl.thalesgroup.com
More informationReview. DS GA 1002 Statistical and Mathematical Models. Carlos Fernandez-Granda
Review DS GA 1002 Statistical and Mathematical Models http://www.cims.nyu.edu/~cfgranda/pages/dsga1002_fall16 Carlos Fernandez-Granda Probability and statistics Probability: Framework for dealing with
More informationFirst Year Examination Department of Statistics, University of Florida
First Year Examination Department of Statistics, University of Florida August 20, 2009, 8:00 am - 2:00 noon Instructions:. You have four hours to answer questions in this examination. 2. You must show
More informationNew Constructions of Sonar Sequences
INTERNATIONAL JOURNAL OF BASIC & APPLIED SCIENCES IJBAS-IJENS VOL.:14 NO.:01 12 New Constructions of Sonar Sequences Diego F. Ruiz 1, Carlos A. Trujillo 1, and Yadira Caicedo 2 1 Department of Mathematics,
More informationExtreme Value Analysis and Spatial Extremes
Extreme Value Analysis and Department of Statistics Purdue University 11/07/2013 Outline Motivation 1 Motivation 2 Extreme Value Theorem and 3 Bayesian Hierarchical Models Copula Models Max-stable Models
More information