Data-Efficient Quickest Change Detection
|
|
- Merry Armstrong
- 6 years ago
- Views:
Transcription
1 Data-Efficient Quickest Change Detection Venu Veeravalli ECE Department & Coordinated Science Lab University of Illinois at Urbana-Champaign (joint work with Taposh Banerjee) C 3 Seminar January 11, 2013
2 Quickest Change Detection (QCD) X 1,,X γ 1 X γ,x γ +1, i.i.d. f 1 i.i.d. f 0 Observation sequence Stopping time τ at which change is declared Tradeoff between o Detection delay o Frequency of false alarms Applications Veeravalli C3 1/11/13 2
3 Manufacturing Systems QCD can be used for quality control Veeravalli C3 1/11/13 3
4 Critical Infrastructure Monitoring QCD can be used to detect impending failure Veeravalli C3 1/11/13 4
5 Environmental Monitoring QCD can be used to detect abrupt increase in pollutants Veeravalli C3 1/11/13 5
6 Bio-Engineering QCD to detect onset of seizures in epilepsy characterized by EEG signature changes Veeravalli C3 1/11/13 6
7 Change in Distribution 4 f 0 =N(0,1) f 1 =N(0.1,1) Samples Time Veeravalli C3 1/11/13 7
8 Change in Distribution Shiryaev s Algorithm 0.3 Change Point= ,000 1,200 Time Veeravalli C3 1/11/13 8
9 Bayesian Quickest Change Detection Proposed by Shiryaev (1963): X 1,,X Γ 1 i.i.d. f 0 Test is stopping time τ on observations ADD(τ ) = E Goal: ( ) + X Γ,X Γ+1, i.i.d. f 1 τ Γ PFA(τ ) = P {τ < Γ} min ADD(τ ) τ subj to PFA(τ ) α Γ Geom(ρ) P{Γ = m} = ρ(1 ρ) m 1,m 1 Veeravalli C3 1/11/13 9
10 Dynamic Programming Solution a posteriori probability of change p n = P (Γ n X 1,,X n ) is sufficient statistic p n has simple recursion p n+1 = p n L(X n+1 ) p n L(X n+1 ) + (1 p n ), p n = p n + (1 p n )ρ L(X n+1 ) = f 1 (X n+1 ) f 0 (X n+1 ) Veeravalli C3 1/11/13 10
11 1 Shiryaev Test Optimal policy (Shiryaev test) is threshold based where A is chosen so that PFA = { } τ S = min n 1: p n > A α ρ = 0.01 f 0 = N(0,1) f 1 = N(0.75,1) p n Threshold A =0.99 PFA path ADD path Veeravalli C3 1/11/13 Γ 11
12 Performance of Shiryaev test Simple bound on PFA: PFA(τ S ) = P {τ S < Γ} = E [1 p τ S ] 1 A K-L Divergence: D(f 1 f 0 ) = f (x) log f (x) 1 1 f 0 (x) dx Asymptotic performance: as PFA(τ S ) 0 ADD (τ S ) ~ log PFA(τ s ) D(f 1 f 0 )+ log(1 ρ) [Tartakovsky&VVV 2005] Veeravalli C3 1/11/13 12
13 Tradeoff between ADD and PFA ρ = 0.01 f 0 = N(0,1) f 1 = N(0.75,1) Slope = [D(f f )+ log(1 ρ) ] Veeravalli C3 1/11/13 13
14 Lorden s Minimax Formulation [1971] X 1,,X γ 1 X γ,x γ +1, i.i.d. f 1 i.i.d. f 0 Delay: WADD(τ ) = sup n 1 ess sup E n (τ n) + X 1,,X n 1 False Alarm: FAR(τ ) = 1 E [τ ] Goal: min WADD(τ ) τ subj to FAR(τ ) α Veeravalli C3 1/11/13 14
15 Pollak s Minimax Formulation [1985] X 1,,X γ 1 X γ,x γ +1, i.i.d. f 1 i.i.d. f 0 Delay: CADD(τ ) = sup n 1 E n (τ n) τ n False Alarm: FAR(τ ) = 1 E [τ ] Goal: min CADD(τ ) τ subj to FAR(τ ) α Veeravalli C3 1/11/13 15
16 At time n CuSum Test [Page 1954] o log-likelihood of no change: log[ f 0 o log-likelihood of change at time k: n (X i ) ] i =1 k 1 CuSum statistic (Maximum Likelihood): W n = max 1 k n+1 k 1 log[ f 0 (X i ) f 1 i =1 n n (X i )] log[ f 0 (X i ) ] i =k log[ f 0 (X i ) f 1 i =1 i =1 n (X i )] i =k CuSum Test: τ C = min {n 1:W n d} Recursion: W n+1 = ( W n + logl(x n )) +, W 0 = 0 Veeravalli C3 1/11/13 16
17 CuSuM Test Evolution 9 8 Threshold = false alarm path delay path W γ Veeravalli C3 1/11/13 17
18 Optimality of CuSUM Test optimal under Lorden s minimax criterion [Moustakides 1986] asymptotically optimal under Pollak s criterion as FAR goes to 0 [Lai 1998] Veeravalli C3 1/11/13 18
19 Asymptotic Performance CuSum Test: W n+1 = max( 0, W n + logl(x n )), W 0 = 0 τ C = min {n 1:W n d} False Alarm Rate: d = logα FAR(τ C ) α Detection Delay: as FAR(τ C ) 0 CADD(τ C )~ logfar (τ ) C D(f 1 f 0 ) Veeravalli C3 1/11/13 19
20 CuSum Performance Tradeoff 26 f 0 =N(0,1) f 1 =N(0.75,1) CUSUM CADD Slope = 1/ D(f 1 f 0 ) log(far) Veeravalli C3 1/11/13 20
21 Data-Efficient Quickest Change Detection
22 Data-Efficient QCD (DE-QCD) Cost associated with acquiring observations cost of data in process control energy in wireless sensor networks DE-QCD: three-fold decision-making stop and decide change continue and take next observation continue without taking next observation Veeravalli C3 1/11/13 22
23 Data-Efficient QCD (DE-QCD) S k = 1 if is used for decision making X k Information Vector: DE-QCD Policy: S k = µ k (I k 1 ) {0,1} k 0 (S I k = S 1,,S k,x ) 1 (S 1,,X k ) k Stopping time τ on { I } k φ = {τ,µ 1,,µ τ } At time k use I to decide to stop or continue k If decision is continue use X k+1 if S = µ (I ) = 1 k+1 k+1 k Veeravalli C3 1/11/13 23
24 Data-Efficient Bayesian Quickest Change Detection
25 Bayesian Data-Efficient QCD Extending Shiryaev s formulation to dataefficient setting: i.i.d. { X } Γ Geom(ρ) n Metric for data-efficiency: Average Number of Observations used before change Objective: ANO(φ)= E min φ min{τ,γ 1} S k k=1 ADD(φ) subj to PFA(φ) α and ANO(φ) β Veeravalli C3 1/11/13 25
26 DE-Shiryaev: Two-Threshold Algorithm 0 B A S k+1 = 1 if p k [B,A) S k+1 = 0 if p k < B Stop and declare change if p k A Veeravalli C3 1/11/13 26
27 DE-Shiryaev: Two-Threshold Algorithm If If S k+1 = 1 p k+1 = S k+1 = 0 update using Shiryaev recursion p k f 1 (X k+1 ) p k f 1 (X k+1 ) + (1 p k )f 0 (X k+1 ) p k = p k + (1 p k )ρ update using prior p k+1 = p k + (1 p k )ρ Stopping time τ DE-S = inf { k 1: p k > A} Veeravalli C3 1/11/13 27
28 Evolution of DE-Shiryaev algorithm Veeravalli C3 1/11/13 28
29 Asymptotic Optimality of DE-Shiryaev Justification: Dynamic Programming solution to min ADD(φ) + λ φ f PFA(φ)+λ e ANO(φ) Asymptotic optimality: For each fixed β, as α 0 PFA(φ DE-S ) PFA(τ S ) ADD(φ DE-S ) ADD(τ S ) Thresholds A and B can be set independent of each other for small PFA, with A controlling PFA and B controlling ANO Veeravalli C3 1/11/13 29
30 Tradeoff Curves f 0 ~ N (0,1), f 1 ~ N (0.75,1), ρ = 0.1 ANO=75% or 50% of Shiryaev ANO Shiryaev ANO at 75% ANO at 50% ADD Veeravalli C3 1/11/13 30
31 Comparison with Fractional Sampling Significant performance gain over fractional sampling 80 f 0 =N(0,1) f 1 =N(0.75,1) ρ= % samples dropped 70 Fractional Sampling DE Shiryaev Shiryaev 60 ADD log(pfa) Veeravalli C3 1/11/13 31
32 Data-Efficient Minimax Quickest Change Detection
33 Minimax Data-Efficient QCD No prior on change point Goal: Extend Pollak s and Lorden s formulation to data-efficient setting But o need new metric to capture cost of observations o Need substitute for ρ when we skip observations Approach o use insights from Bayesian setting o modify CuSum algorithm to look like DE-Shiryaev Veeravalli C3 1/11/13 33
34 Bayesian Data-Efficient QCD Information Vector: Policy for DE-QCD: (S I k = S 1,,S k,x ) 1 (S 1,,X k ) k φ = {τ,µ 1,,µ τ } S k = µ k (I k 1 ) Stopping time τ on { I } k Metric for data-efficiency: Objective: ANO(φ)= E min φ min{τ,γ 1} k=1 ADD(φ) S k subj to PFA(φ) α and ANO(φ) β Veeravalli C3 1/11/13 34
35 Data-Efficient Minimax QCD Information Vector: Policy for DE-QCD: (S I k = S 1,,S k,x ) 1 (S 1,,X k ) k φ = {τ,µ 1,,µ τ } S k = µ k (I k 1 ) Stopping time τ on { I } k Pre-change Duty Cycle (PDC) to replace ANO PDC(φ) = lim sup n 1 E n n n 1 k=1 S k τ n o lim sup cannot be replaced by sup as typically (an initial wait cannot be justified) o also change is generally rare S 1 = 1 Veeravalli C3 1/11/13 35
36 Data-Efficient Minimax QCD Data-efficient extension of Pollak : Data-efficient extension of Lorden: where min φ subj to FAR(φ) α min φ subj to FAR(φ) α WADD(φ) = sup n 1 CADD(φ) and PDC(φ) β WADD(φ) ess sup E n and PDC(φ) β (τ n) + I n 1 Veeravalli C3 1/11/13 36
37 DE-Shiryaev Algorithm S k+1 = 1 if p k [B,A) S k+1 = 0 if p k < B If S k+1 = 1 update using Shiryaev recursion p k+1 = p k f 1 (X k+1 ) p k f 1 (X k+1 ) + (1 p k )f 0 (X k+1 ) p k = p k + (1 p k )ρ If S k+1 = 0 update using prior p k+1 = p k + (1 p k )ρ Stopping time τ DE-S = inf { k 1: p k > A} Veeravalli C3 1/11/13 37
38 DE-Shiryaev Evolution Veeravalli C3 1/11/13 38
39 CuSuM Evolution W k+1 = ( W k + logl(x k+1 )) + W 0 = 0 τ C = inf { k 1:W k > d} 9 8 Threshold d= Wk Veeravalli C3 1/11/13 39
40 DE-CUSUM Algorithm S k+1 = 1 if W k (0,d) S k+1 = 0 if W k < 0 If If S k+1 = 1 S k+1 = 0 update using CUSUM recursion W k+1 = W k + logl(x k+1 ) update using parameter µ W k+1 = (W k + µ) h+ Stopping time { } τ DE-C = inf k 1:W k > d Veeravalli C3 1/11/13 40
41 Evolution of DE-CUSUM algorithm f 0 = N(0,1), f 1 = N(0.75,1), µ=0.1, h=1.1 d 4 W k γ=40 50 τ DE C 70 h Veeravalli C3 1/11/13 41
42 Asymptotic Optimality of DE-CUSUM DE-CUSUM is asymptotically optimal For each fixed d, h, and µ τ DE-C τ C FAR(φ DE-C ) FAR(τ C ) For each fixed d, h, and µ CADD(φ DE-C ) CADD(τ C ) + K 1 For each fixed d, h <, and µ WADD(φ DE-C ) WADD(τ C ) + K 2 Veeravalli C3 1/11/13 42
43 Designing DE-CuSuM Parameters PDC controlled by µ,h PDC(φ DE-C ) FAR controlled primarily by d independent of d D = logα FAR(φ DE-C ) α µ µ + D(f 0 f 1 ) µ β 1 β D(f f ) PDC(φ ) β 0 1 DE-C Veeravalli C3 1/11/13 43
44 Trade-off Curves f 0 ~ N (0,1), f 1 ~ N (0.75,1) Veeravalli C3 1/11/13 44
45 Trade-off Curves Veeravalli C3 1/11/13 45
46 Data-Efficient Quickest Change Detection in Sensor Networks
47 Data-Efficient QCD in Sensor Networks Seek data-efficient schemes that reduce average observation cost per sensor Fusion center queries sensors for observations Special case of controlled sensing for inference Veeravalli C3 1/11/13 47
48 Data-Efficient QCD in Sensor Networks Bayesian (DP) analysis gives complex multithreshold structure [Premkumar and Kumar 08] DE-QCD for single sensor provides insights: Use likelihood ratio for stopping as well as observation control Propose algorithms that retain structure of classical QCD counterparts Have good performance and are asymptotically equivalent to their classical counterparts Can we obtain similar results for distributed QCD in sensor networks? Veeravalli C3 1/11/13 48
49 Data-Efficient QCD in Sensor Networks Problem formulation: recall PDC(φ) = lim sup n 1 E n n n 1 k=1 S k τ n Let PDC be PDC of sensor min CADD(φ) φ subj to FAR(φ) α and PDC (φ) β for = 1,,L Veeravalli C3 1/11/13 49
50 DE-QCD Algorithms for Sensor Networks Two data-efficient schemes for sensor networks o Centralized: Serialized DE-CUSUM o Distributed: DE-DIST Centralized: Serialized DE-CUSUM o Serialize observations and use DE-CUSUM o Equal PDC constraint per sensor is achieved o Asymptotically optimal: performance approaches that of centralized CUSUM scheme o Good trade-off curves Veeravalli C3 1/11/13 50
51 Evolution of Serialized DE-CUSUM 5 L = 10, f 0 ~ N (0,1), f 1 ~ N (0.75,1),d = d 3 2 W k γ h Veeravalli C3 1/11/13 51
52 Distributed: DE-DIST Algorithm Use DE-CUSUM at sensors to meet individual PDC constraint but only to decide whether or not to take observations If observation taken, transmit to fusion center Fusion center uses standard CUSUM to fuse information transmitted from sensors and makes the final decision to stop and decide change Veeravalli C3 1/11/13 52
53 Performance of Algorithms L = 10, f 0 ~ N (0,1), f 1 ~ N (0.2,1), PDC= Frac Sample DE DIST Serialized DE CuSum CuSum CADD log(far) Veeravalli C3 1/11/13 53
54 Conclusions Introduced problem of data-efficient quickest change detection Useful in many applications Bayesian and minimax formulations Data-efficient procedures are simple extensions of classical counterparts First-order asymptotic optimality Substantial improvement over fractional sampling Extension to distributed sensor networks Work in progress: extensions to non-i.i.d. case, unknown/partially known distributions Veeravalli C3 1/11/13 54
55 References T. Banerjee and V. V. Veeravalli, Data-efficient quickest change detection with on-off observation control, Sequential Analysis, vol. 31, no. 1, pp , T. Banerjee and V. V. Veeravalli, Data-efficient quickest change detection in minimax settings Submitted to IEEE Transactions on Information Theory, Nov Available on ArXiv. T. Banerjee and V. V. Veeravalli, Data-efficient minimax quickest change detection, in IEEE Conference on Acoustics, Speech, and Signal Processing (ICASSP), pp , Mar T. Banerjee and V. V. Veeravalli, Energy-Efficient Quickest Change Detection in Sensor Networks, in IEEE Statistical Signal Processing (SSP) Workshop, Ann Arbor, Michigan, Aug Veeravalli C3 1/11/13 55
56 Insights from Bayesian Setting DE-Shiryaev has an initial wait based on prior information This is followed by a sequence of two-sided tests intercepted by sleep times Each two-sided test is for sequential hypothesis testing between pre-change and post-change Samples are skipped if two-sided test stops with decision pre-change Change is declared first time a two-sided test stops with decision post-change Veeravalli C3 1/11/13 56
57 Insights from Bayesian Setting Two-sided test has upper threshold A and lower threshold B If the two-sided test stops below B then samples are skipped based on the likelihood ratio of all the observations taken (undershoot) n k 1 ρ ρ * (1 ) L ( Xi ) pn k= 1 i= k = 1 p P( Γ > n) n * L ( X ) = 1 if X is not used i The number of samples skipped is also a function of the geometric parameter ρ i n Veeravalli C3 1/11/13 57
58 Insights from Bayesian Setting p n When the statistic crosses from below p = + ρ n 1 pn (1 pn) ρ ρ For small the two-sided tests are roughly statistically independent B Constraint on the observation cost is met using an initial wait and the fraction of time samples are taken before change Veeravalli C3 1/11/13 58
59 Insights from DE-Shiryaev Evolution DE-Shiryaev has an initial wait based on prior information change is declared first time two-sided test stops with decision post-change samples skipped if two-sided test stops with decision pre-change sequence of two-sided tests intercepted by sleep times Veeravalli C3 1/11/13 59
60 DE-CUSUM Algorithm µ is substitute for ρ ρ is treated as a design parameter h controls the maximum gap between any two sampling times DE-CuSum can be seen as a sequence of SPRTs (two sided tests) intercepted with sleep times Sleep times are a function of h, µ, and the likelihood of observations used in the SPRTs A change is declared the first time an SPRT stops with a decision of post-change Veeravalli C3 1/11/13 60
61 Centralized: DE-CENT Algorithm Based on the interpretation of DE-CUSUM as a sequence of two-sided (SPRT type) tests Use SPRT (d,h) over space of sensors d is upper threshold and h is lower threshold If SPRT ( dh, ) stops below at use only m sensors in that slot Carry forward statistic if positive, else reset to zero L h m L Stop the first time SPRT ( dh, ) ends above d PDC constraint/sensor achieved by randomization Can show asymptotic optimality Veeravalli C3 1/11/13 61
62 Evolution of DE-CENT L = 10, f 0 ~ N (0,1), f 1 ~ N (0.75,1),d = 4.0, h = 2 Veeravalli C3 1/11/13 62
Uncertainty. Jayakrishnan Unnikrishnan. CSL June PhD Defense ECE Department
Decision-Making under Statistical Uncertainty Jayakrishnan Unnikrishnan PhD Defense ECE Department University of Illinois at Urbana-Champaign CSL 141 12 June 2010 Statistical Decision-Making Relevant in
More informationData-Efficient Quickest Change Detection in Minimax Settings
IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 59, NO. 10, OCTOBER 2013 6917 Data-Efficient Quickest Change Detection in Minimax Settings Taposh Banerjee, Student Member, IEEE, and Venugopal V. Veeravalli,
More informationStatistical Models and Algorithms for Real-Time Anomaly Detection Using Multi-Modal Data
Statistical Models and Algorithms for Real-Time Anomaly Detection Using Multi-Modal Data Taposh Banerjee University of Texas at San Antonio Joint work with Gene Whipps (US Army Research Laboratory) Prudhvi
More informationBayesian Quickest Change Detection Under Energy Constraints
Bayesian Quickest Change Detection Under Energy Constraints Taposh Banerjee and Venugopal V. Veeravalli ECE Department and Coordinated Science Laboratory University of Illinois at Urbana-Champaign, Urbana,
More informationSequential Detection. Changes: an overview. George V. Moustakides
Sequential Detection of Changes: an overview George V. Moustakides Outline Sequential hypothesis testing and Sequential detection of changes The Sequential Probability Ratio Test (SPRT) for optimum hypothesis
More informationCHANGE DETECTION WITH UNKNOWN POST-CHANGE PARAMETER USING KIEFER-WOLFOWITZ METHOD
CHANGE DETECTION WITH UNKNOWN POST-CHANGE PARAMETER USING KIEFER-WOLFOWITZ METHOD Vijay Singamasetty, Navneeth Nair, Srikrishna Bhashyam and Arun Pachai Kannu Department of Electrical Engineering Indian
More informationLeast Favorable Distributions for Robust Quickest Change Detection
Least Favorable Distributions for Robust Quickest hange Detection Jayakrishnan Unnikrishnan, Venugopal V. Veeravalli, Sean Meyn Department of Electrical and omputer Engineering, and oordinated Science
More informationCOMPARISON OF STATISTICAL ALGORITHMS FOR POWER SYSTEM LINE OUTAGE DETECTION
COMPARISON OF STATISTICAL ALGORITHMS FOR POWER SYSTEM LINE OUTAGE DETECTION Georgios Rovatsos*, Xichen Jiang*, Alejandro D. Domínguez-García, and Venugopal V. Veeravalli Department of Electrical and Computer
More informationc 2014 Taposh Banerjee
c 2014 Taposh Banerjee DATA-EFFICIENT QUICKEST CHANGE DETECTION BY TAPOSH BANERJEE DISSERTATION Submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy in Electrical
More informationAsymptotically Optimal Quickest Change Detection in Distributed Sensor Systems
This article was downloaded by: [University of Illinois at Urbana-Champaign] On: 23 May 2012, At: 16:03 Publisher: Taylor & Francis Informa Ltd Registered in England and Wales Registered Number: 1072954
More informationDecentralized Sequential Hypothesis Testing. Change Detection
Decentralized Sequential Hypothesis Testing & Change Detection Giorgos Fellouris, Columbia University, NY, USA George V. Moustakides, University of Patras, Greece Outline Sequential hypothesis testing
More informationQuickest Detection With Post-Change Distribution Uncertainty
Quickest Detection With Post-Change Distribution Uncertainty Heng Yang City University of New York, Graduate Center Olympia Hadjiliadis City University of New York, Brooklyn College and Graduate Center
More informationSimultaneous and sequential detection of multiple interacting change points
Simultaneous and sequential detection of multiple interacting change points Long Nguyen Department of Statistics University of Michigan Joint work with Ram Rajagopal (Stanford University) 1 Introduction
More informationQuickest Anomaly Detection: A Case of Active Hypothesis Testing
Quickest Anomaly Detection: A Case of Active Hypothesis Testing Kobi Cohen, Qing Zhao Department of Electrical Computer Engineering, University of California, Davis, CA 95616 {yscohen, qzhao}@ucdavis.edu
More informationAnalysis of DualCUSUM: a Distributed Energy Efficient Algorithm for Change Detection
NCC 29, January 6-8, IIT Guwahati 29 of DualCUSUM: a Distributed Energy Efficient Algorithm for Change Detection Taposh Banerjee and Vinod Sharma Electrical Communication Engineering, Indian Institute
More informationChange-point models and performance measures for sequential change detection
Change-point models and performance measures for sequential change detection Department of Electrical and Computer Engineering, University of Patras, 26500 Rion, Greece moustaki@upatras.gr George V. Moustakides
More informationarxiv: v2 [eess.sp] 20 Nov 2017
Distributed Change Detection Based on Average Consensus Qinghua Liu and Yao Xie November, 2017 arxiv:1710.10378v2 [eess.sp] 20 Nov 2017 Abstract Distributed change-point detection has been a fundamental
More informationEarly Detection of a Change in Poisson Rate After Accounting For Population Size Effects
Early Detection of a Change in Poisson Rate After Accounting For Population Size Effects School of Industrial and Systems Engineering, Georgia Institute of Technology, 765 Ferst Drive NW, Atlanta, GA 30332-0205,
More informationOptimum CUSUM Tests for Detecting Changes in Continuous Time Processes
Optimum CUSUM Tests for Detecting Changes in Continuous Time Processes George V. Moustakides INRIA, Rennes, France Outline The change detection problem Overview of existing results Lorden s criterion and
More informationA New Algorithm for Nonparametric Sequential Detection
A New Algorithm for Nonparametric Sequential Detection Shouvik Ganguly, K. R. Sahasranand and Vinod Sharma Department of Electrical Communication Engineering Indian Institute of Science, Bangalore, India
More informationAccuracy and Decision Time for Decentralized Implementations of the Sequential Probability Ratio Test
21 American Control Conference Marriott Waterfront, Baltimore, MD, USA June 3-July 2, 21 ThA1.3 Accuracy Decision Time for Decentralized Implementations of the Sequential Probability Ratio Test Sra Hala
More informationIntroduction to Bayesian Statistics
Bayesian Parameter Estimation Introduction to Bayesian Statistics Harvey Thornburg Center for Computer Research in Music and Acoustics (CCRMA) Department of Music, Stanford University Stanford, California
More informationMonitoring actuarial assumptions in life insurance
Monitoring actuarial assumptions in life insurance Stéphane Loisel ISFA, Univ. Lyon 1 Joint work with N. El Karoui & Y. Salhi IAALS Colloquium, Barcelona, 17 LoLitA Typical paths with change of regime
More informationQuantization Effect on the Log-Likelihood Ratio and Its Application to Decentralized Sequential Detection
1536 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 61, NO. 6, MARCH 15, 2013 Quantization Effect on the Log-Likelihood Ratio Its Application to Decentralized Sequential Detection Yan Wang Yajun Mei Abstract
More informationLarge-Scale Multi-Stream Quickest Change Detection via Shrinkage Post-Change Estimation
Large-Scale Multi-Stream Quickest Change Detection via Shrinkage Post-Change Estimation Yuan Wang and Yajun Mei arxiv:1308.5738v3 [math.st] 16 Mar 2016 July 10, 2015 Abstract The quickest change detection
More informationChange Detection Algorithms
5 Change Detection Algorithms In this chapter, we describe the simplest change detection algorithms. We consider a sequence of independent random variables (y k ) k with a probability density p (y) depending
More informationSpace-Time CUSUM for Distributed Quickest Detection Using Randomly Spaced Sensors Along a Path
Space-Time CUSUM for Distributed Quickest Detection Using Randomly Spaced Sensors Along a Path Daniel Egea-Roca, Gonzalo Seco-Granados, José A López-Salcedo, Sunwoo Kim Dpt of Telecommunications and Systems
More informationAn Effective Approach to Nonparametric Quickest Detection and Its Decentralized Realization
University of Tennessee, Knoxville Trace: Tennessee Research and Creative Exchange Doctoral Dissertations Graduate School 5-2010 An Effective Approach to Nonparametric Quickest Detection and Its Decentralized
More informationSurveillance of BiometricsAssumptions
Surveillance of BiometricsAssumptions in Insured Populations Journée des Chaires, ILB 2017 N. El Karoui, S. Loisel, Y. Sahli UPMC-Paris 6/LPMA/ISFA-Lyon 1 with the financial support of ANR LoLitA, and
More informationA CUSUM approach for online change-point detection on curve sequences
ESANN 22 proceedings, European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning. Bruges Belgium, 25-27 April 22, i6doc.com publ., ISBN 978-2-8749-49-. Available
More informationOn robust stopping times for detecting changes in distribution
On robust stopping times for detecting changes in distribution by Yuri Golubev, Mher Safarian No. 116 MAY 2018 WORKING PAPER SERIES IN ECONOMICS KIT Die Forschungsuniversität in der Helmholtz-Gemeinschaft
More informationSEQUENTIAL CHANGE-POINT DETECTION WHEN THE PRE- AND POST-CHANGE PARAMETERS ARE UNKNOWN. Tze Leung Lai Haipeng Xing
SEQUENTIAL CHANGE-POINT DETECTION WHEN THE PRE- AND POST-CHANGE PARAMETERS ARE UNKNOWN By Tze Leung Lai Haipeng Xing Technical Report No. 2009-5 April 2009 Department of Statistics STANFORD UNIVERSITY
More informationSequential Change-Point Approach for Online Community Detection
Sequential Change-Point Approach for Online Community Detection Yao Xie Joint work with David Marangoni-Simonsen H. Milton Stewart School of Industrial and Systems Engineering Georgia Institute of Technology
More informationX 1,n. X L, n S L S 1. Fusion Center. Final Decision. Information Bounds and Quickest Change Detection in Decentralized Decision Systems
1 Information Bounds and Quickest Change Detection in Decentralized Decision Systems X 1,n X L, n Yajun Mei Abstract The quickest change detection problem is studied in decentralized decision systems,
More informationarxiv: v2 [math.st] 20 Jul 2016
arxiv:1603.02791v2 [math.st] 20 Jul 2016 Asymptotically optimal, sequential, multiple testing procedures with prior information on the number of signals Y. Song and G. Fellouris Department of Statistics,
More informationThe Shiryaev-Roberts Changepoint Detection Procedure in Retrospect - Theory and Practice
The Shiryaev-Roberts Changepoint Detection Procedure in Retrospect - Theory and Practice Department of Statistics The Hebrew University of Jerusalem Mount Scopus 91905 Jerusalem, Israel msmp@mscc.huji.ac.il
More informationAsymptotically Optimal and Bandwith-efficient Decentralized Detection
Asymptotically Optimal and Bandwith-efficient Decentralized Detection Yasin Yılmaz and Xiaodong Wang Electrical Engineering Department, Columbia University New Yor, NY 10027 Email: yasin,wangx@ee.columbia.edu
More informationActive Sequential Hypothesis Testing with Application to a Visual Search Problem
202 IEEE International Symposium on Information Theory Proceedings Active Sequential Hypothesis Testing with Application to a Visual Search Problem Nidhin Koshy Vaidhiyan nidhinkv@ece.iisc.ernet.in Department
More informationDecentralized Sequential Change Detection Using Physical Layer Fusion
Decentralized Sequential Change Detection Using hysical Layer Fusion Leena Zacharias ECE Department Indian Institute of Science Bangalore, India Email: zleena@ece.iisc.ernet.in ajesh Sundaresan ECE Department
More informationEnergy-Efficient Noncoherent Signal Detection for Networked Sensors Using Ordered Transmissions
Energy-Efficient Noncoherent Signal Detection for Networked Sensors Using Ordered Transmissions Ziad N. Rawas, Student Member, IEEE, Qian He, Member, IEEE, and Rick S. Blum, Fellow, IEEE Abstract Energy
More informationEARLY DETECTION OF A CHANGE IN POISSON RATE AFTER ACCOUNTING FOR POPULATION SIZE EFFECTS
Statistica Sinica 21 (2011), 597-624 EARLY DETECTION OF A CHANGE IN POISSON RATE AFTER ACCOUNTING FOR POPULATION SIZE EFFECTS Yajun Mei, Sung Won Han and Kwok-Leung Tsui Georgia Institute of Technology
More informationQuickest Changepoint Detection: Optimality Properties of the Shiryaev Roberts-Type Procedures
Quickest Changepoint Detection: Optimality Properties of the Shiryaev Roberts-Type Procedures Alexander Tartakovsky Department of Statistics a.tartakov@uconn.edu Inference for Change-Point and Related
More informationEfficient scalable schemes for monitoring a large number of data streams
Biometrika (2010, 97, 2,pp. 419 433 C 2010 Biometrika Trust Printed in Great Britain doi: 10.1093/biomet/asq010 Advance Access publication 16 April 2010 Efficient scalable schemes for monitoring a large
More informationAsynchronous Multi-Sensor Change-Point Detection for Seismic Tremors
Asynchronous Multi-Sensor Change-Point Detection for Seismic Tremors Liyan Xie, Yao Xie, George V. Moustakides School of Industrial & Systems Engineering, Georgia Institute of Technology, {lxie49, yao.xie}@isye.gatech.edu
More informationSequential Procedure for Testing Hypothesis about Mean of Latent Gaussian Process
Applied Mathematical Sciences, Vol. 4, 2010, no. 62, 3083-3093 Sequential Procedure for Testing Hypothesis about Mean of Latent Gaussian Process Julia Bondarenko Helmut-Schmidt University Hamburg University
More informationApplications of Optimal Stopping and Stochastic Control
Applications of and Stochastic Control YRM Warwick 15 April, 2011 Applications of and Some problems Some technology Some problems The secretary problem Bayesian sequential hypothesis testing the multi-armed
More informationHypothesis Testing with Communication Constraints
Hypothesis Testing with Communication Constraints Dinesh Krithivasan EECS 750 April 17, 2006 Dinesh Krithivasan (EECS 750) Hyp. testing with comm. constraints April 17, 2006 1 / 21 Presentation Outline
More informationThreshold Considerations in Distributed Detection in a Network of Sensors.
Threshold Considerations in Distributed Detection in a Network of Sensors. Gene T. Whipps 1,2, Emre Ertin 2, and Randolph L. Moses 2 1 US Army Research Laboratory, Adelphi, MD 20783 2 Department of Electrical
More informationarxiv:math/ v2 [math.st] 15 May 2006
The Annals of Statistics 2006, Vol. 34, No. 1, 92 122 DOI: 10.1214/009053605000000859 c Institute of Mathematical Statistics, 2006 arxiv:math/0605322v2 [math.st] 15 May 2006 SEQUENTIAL CHANGE-POINT DETECTION
More informationPerformance of Certain Decentralized Distributed Change Detection Procedures
Performance of Certain Decentralized Distributed Change Detection Procedures Alexander G. Tartakovsky Center for Applied Mathematical Sciences and Department of Mathematics University of Southern California
More informationDecentralized decision making with spatially distributed data
Decentralized decision making with spatially distributed data XuanLong Nguyen Department of Statistics University of Michigan Acknowledgement: Michael Jordan, Martin Wainwright, Ram Rajagopal, Pravin Varaiya
More informationChapter 2. Binary and M-ary Hypothesis Testing 2.1 Introduction (Levy 2.1)
Chapter 2. Binary and M-ary Hypothesis Testing 2.1 Introduction (Levy 2.1) Detection problems can usually be casted as binary or M-ary hypothesis testing problems. Applications: This chapter: Simple hypothesis
More informationEECS 750. Hypothesis Testing with Communication Constraints
EECS 750 Hypothesis Testing with Communication Constraints Name: Dinesh Krithivasan Abstract In this report, we study a modification of the classical statistical problem of bivariate hypothesis testing.
More informationNonparametric Distributed Sequential Detection via Universal Source Coding
onparametric Distributed Sequential Detection via Universal Source Coding Jithin K. Sreedharan and Vinod Sharma Department of Electrical Communication Engineering Indian Institute of Science Bangalore
More informationDynamic spectrum access with learning for cognitive radio
1 Dynamic spectrum access with learning for cognitive radio Jayakrishnan Unnikrishnan and Venugopal V. Veeravalli Department of Electrical and Computer Engineering, and Coordinated Science Laboratory University
More informationCooperative Spectrum Sensing for Cognitive Radios under Bandwidth Constraints
Cooperative Spectrum Sensing for Cognitive Radios under Bandwidth Constraints Chunhua Sun, Wei Zhang, and haled Ben Letaief, Fellow, IEEE Department of Electronic and Computer Engineering The Hong ong
More information6196 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 57, NO. 9, SEPTEMBER 2011
6196 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 57, NO. 9, SEPTEMBER 2011 On the Structure of Real-Time Encoding and Decoding Functions in a Multiterminal Communication System Ashutosh Nayyar, Student
More informationUniversal Outlier Hypothesis Testing
Universal Outlier Hypothesis Testing Venu Veeravalli ECE Dept & CSL & ITI University of Illinois at Urbana-Champaign http://www.ifp.illinois.edu/~vvv (with Sirin Nitinawarat and Yun Li) NSF Workshop on
More informationA Novel Asynchronous Communication Paradigm: Detection, Isolation, and Coding
A Novel Asynchronous Communication Paradigm: Detection, Isolation, and Coding The MIT Faculty has made this article openly available. Please share how this access benefits you. Your story matters. Citation
More informationLecture 8: Information Theory and Statistics
Lecture 8: Information Theory and Statistics Part II: Hypothesis Testing and Estimation I-Hsiang Wang Department of Electrical Engineering National Taiwan University ihwang@ntu.edu.tw December 22, 2015
More informationEXTENDED GLRT DETECTORS OF CORRELATION AND SPHERICITY: THE UNDERSAMPLED REGIME. Xavier Mestre 1, Pascal Vallet 2
EXTENDED GLRT DETECTORS OF CORRELATION AND SPHERICITY: THE UNDERSAMPLED REGIME Xavier Mestre, Pascal Vallet 2 Centre Tecnològic de Telecomunicacions de Catalunya, Castelldefels, Barcelona (Spain) 2 Institut
More informationLecture 8: Information Theory and Statistics
Lecture 8: Information Theory and Statistics Part II: Hypothesis Testing and I-Hsiang Wang Department of Electrical Engineering National Taiwan University ihwang@ntu.edu.tw December 23, 2015 1 / 50 I-Hsiang
More informationDetection Performance Limits for Distributed Sensor Networks in the Presence of Nonideal Channels
1 Detection Performance imits for Distributed Sensor Networks in the Presence of Nonideal Channels Qi Cheng, Biao Chen and Pramod K Varshney Abstract Existing studies on the classical distributed detection
More informationDecentralized Detection In Wireless Sensor Networks
Decentralized Detection In Wireless Sensor Networks Milad Kharratzadeh Department of Electrical & Computer Engineering McGill University Montreal, Canada April 2011 Statistical Detection and Estimation
More informationQuickest detection & classification of transient stability status for power systems
Quickest detection & classification of transient stability status for power systems Jhonny Gonzalez Joint work with: Jovica Milanović, Panagiotis Papadopoulos, Goran Peskir, & John Moriarty The University
More informationReal-Time Detection of Hybrid and Stealthy Cyber-Attacks in Smart Grid
1 Real-Time Detection of Hybrid and Stealthy Cyber-Attacks in Smart Grid Mehmet Necip Kurt, Yasin Yılmaz, Member, IEEE, and Xiaodong Wang, Fellow, IEEE Abstract For a safe and reliable operation of the
More informationQUANTIZATION FOR DISTRIBUTED ESTIMATION IN LARGE SCALE SENSOR NETWORKS
QUANTIZATION FOR DISTRIBUTED ESTIMATION IN LARGE SCALE SENSOR NETWORKS Parvathinathan Venkitasubramaniam, Gökhan Mergen, Lang Tong and Ananthram Swami ABSTRACT We study the problem of quantization for
More informationSCALABLE ROBUST MONITORING OF LARGE-SCALE DATA STREAMS. By Ruizhi Zhang and Yajun Mei Georgia Institute of Technology
Submitted to the Annals of Statistics SCALABLE ROBUST MONITORING OF LARGE-SCALE DATA STREAMS By Ruizhi Zhang and Yajun Mei Georgia Institute of Technology Online monitoring large-scale data streams has
More informationSolving the Poisson Disorder Problem
Advances in Finance and Stochastics: Essays in Honour of Dieter Sondermann, Springer-Verlag, 22, (295-32) Research Report No. 49, 2, Dept. Theoret. Statist. Aarhus Solving the Poisson Disorder Problem
More informationCompressive and Coded Change Detection: Theory and Application to Structural Health Monitoring
University of Central Florida Electronic Theses and Dissertations Masters Thesis (Open Access) Compressive and Coded Change Detection: Theory and Application to Structural Health Monitoring 2016 Omid Sarayanibafghi
More informationDistributed Structures, Sequential Optimization, and Quantization for Detection
IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL., NO., JANUARY Distributed Structures, Sequential Optimization, and Quantization for Detection Michael A. Lexa, Student Member, IEEE and Don H. Johnson, Fellow,
More informationResearch Article Degenerate-Generalized Likelihood Ratio Test for One-Sided Composite Hypotheses
Mathematical Problems in Engineering Volume 2012, Article ID 538342, 11 pages doi:10.1155/2012/538342 Research Article Degenerate-Generalized Likelihood Ratio Test for One-Sided Composite Hypotheses Dongdong
More informationCensoring for Type-Based Multiple Access Scheme in Wireless Sensor Networks
Censoring for Type-Based Multiple Access Scheme in Wireless Sensor Networks Mohammed Karmoose Electrical Engineering Department Alexandria University Alexandria 1544, Egypt Email: mhkarmoose@ieeeorg Karim
More informationOptimal Design and Analysis of the Exponentially Weighted Moving Average Chart for Exponential Data
Sri Lankan Journal of Applied Statistics (Special Issue) Modern Statistical Methodologies in the Cutting Edge of Science Optimal Design and Analysis of the Exponentially Weighted Moving Average Chart for
More informationVoI for Learning and Inference! in Sensor Networks!
ARO MURI on Value-centered Information Theory for Adaptive Learning, Inference, Tracking, and Exploitation VoI for Learning and Inference in Sensor Networks Gene Whipps 1,2, Emre Ertin 2, Randy Moses 2
More informationWHEELS COATING PROCESS MONITORING IN THE PRESENCE OF NUISANCE PARAMETERS USING SEQUENTIAL CHANGE-POINT DETECTION METHOD
WHEELS COATING PROCESS MONITORING IN THE PRESENCE OF NUISANCE PARAMETERS USING SEQUENTIAL CHANGE-POINT DETECTION METHOD Karim Tout, Florent Retraint and Rémi Cogranne LM2S - ICD - UMR 6281 STMR CNRS -
More informationOptimal and asymptotically optimal CUSUM rules for change point detection in the Brownian Motion model with multiple alternatives
INSTITUT NATIONAL DE RECHERCHE EN INFORMATIQUE ET EN AUTOMATIQUE Optimal and asymptotically optimal CUSUM rules for change point detection in the Brownian Motion model with multiple alternatives Olympia
More informationDirectionally Sensitive Multivariate Statistical Process Control Methods
Directionally Sensitive Multivariate Statistical Process Control Methods Ronald D. Fricker, Jr. Naval Postgraduate School October 5, 2005 Abstract In this paper we develop two directionally sensitive statistical
More informationA Binning Approach to Quickest Change Detection with Unknown Post-Change Distribution
1 A Binning Approach to Quickest Change Detection with Unknown Post-Change Distribution arxiv:1801.04756v3 [stat.ap] 16 Aug 2018 Tze Siong Lau, Wee Peng Tay, Senior Member, IEEE, and Venugopal V. Veeravalli,
More informationA Decentralized Bayesian Attack Detection Algorithm for Network Security
A Decentralized Bayesian Attack Detection Algorithm for Network Security Kien C. Nguyen, Tansu Alpcan, and Tamer Başar Abstract Decentralized detection has been an active area of research since the late
More informationQuality of Information Aware Scheduling in Task Processing Networks
Resource Allocation on Wireless Networks and Wireless Networks - Communication, Cooperation and Competition Quality of Information Aware Scheduling in Task Processing Networks Rahul Urgaonkar, Ertugrul
More informationMinimax Estimation of Kernel Mean Embeddings
Minimax Estimation of Kernel Mean Embeddings Bharath K. Sriperumbudur Department of Statistics Pennsylvania State University Gatsby Computational Neuroscience Unit May 4, 2016 Collaborators Dr. Ilya Tolstikhin
More informationIEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 60, NO. 9, SEPTEMBER
IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 60, NO. 9, SEPTEMBER 2012 4509 Cooperative Sequential Spectrum Sensing Based on Level-Triggered Sampling Yasin Yilmaz,StudentMember,IEEE, George V. Moustakides,SeniorMember,IEEE,and
More informationc 2009 Joshua David Isom
c 2009 Joshua David Isom EXACT SOLUTION OF BAYES AND MINIMAX CHANGE-DETECTION PROBLEMS BY JOSHUA DAVID ISOM B.S., Yale University, 2000 M.S., Rensselaer at Hartford, 2002 M.S., University of Illinois at
More informationDISTRIBUTED GENERALIZED LIKELIHOOD RATIO TESTS : FUNDAMENTAL LIMITS AND TRADEOFFS. Anit Kumar Sahu and Soummya Kar
DISTRIBUTED GENERALIZED LIKELIHOOD RATIO TESTS : FUNDAMENTAL LIMITS AND TRADEOFFS Anit Kumar Sahu and Soummya Kar Department of Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh
More informationLecture 22: Error exponents in hypothesis testing, GLRT
10-704: Information Processing and Learning Spring 2012 Lecture 22: Error exponents in hypothesis testing, GLRT Lecturer: Aarti Singh Scribe: Aarti Singh Disclaimer: These notes have not been subjected
More informationcertain class of distributions, any SFQ can be expressed as a set of thresholds on the sufficient statistic. For distributions
Score-Function Quantization for Distributed Estimation Parvathinathan Venkitasubramaniam and Lang Tong School of Electrical and Computer Engineering Cornell University Ithaca, NY 4853 Email: {pv45, lt35}@cornell.edu
More informationRobust Detection of Unobservable Disorder Time in Poisson Rate
Robust Detection of Unobservable Disorder Time in Poisson Rate Angers, Septembre 2015 Nicole El Karoui (LPMA UPMC/Paris 6) Stéphane Loisel and Yahia Salhi (ISFA Actuarial School, Lyon 1) with the financial
More informationSEQUENTIAL CHANGE DETECTION REVISITED. BY GEORGE V. MOUSTAKIDES University of Patras
The Annals of Statistics 28, Vol. 36, No. 2, 787 87 DOI: 1.1214/95367938 Institute of Mathematical Statistics, 28 SEQUENTIAL CHANGE DETECTION REVISITED BY GEORGE V. MOUSTAKIDES University of Patras In
More informationREPORT DOCUMENTATION PAGE
REPORT DOCUMENTATION PAGE Form Approved OMB NO. 0704-088 The public reporting burden for this collection of information is estimated to average hour per response, including the time for reviewing instructions,
More informationDistributed Optimization over Networks Gossip-Based Algorithms
Distributed Optimization over Networks Gossip-Based Algorithms Angelia Nedić angelia@illinois.edu ISE Department and Coordinated Science Laboratory University of Illinois at Urbana-Champaign Outline Random
More informationDecentralized Detection in Sensor Networks
IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL 51, NO 2, FEBRUARY 2003 407 Decentralized Detection in Sensor Networks Jean-François Chamberland, Student Member, IEEE, and Venugopal V Veeravalli, Senior Member,
More informationQuickest Line Outage Detection and Identification
1 Quickest Line Outage Detection and Identification Yu Christine Chen, Student Member, IEEE, Taposh Banerjee, Student Member, IEEE, Alejandro D. Domínguez-García, Member, IEEE, and Venugopal V. Veeravalli,
More informationبسم الله الرحمن الرحيم
بسم الله الرحمن الرحيم Reliability Improvement of Distributed Detection in Clustered Wireless Sensor Networks 1 RELIABILITY IMPROVEMENT OF DISTRIBUTED DETECTION IN CLUSTERED WIRELESS SENSOR NETWORKS PH.D.
More informationThe Modified Keifer-Weiss Problem, Revisited
The Modified Keifer-Weiss Problem, Revisited Bob Keener Department of Statistics University of Michigan IWSM, 2013 Bob Keener (University of Michigan) Keifer-Weiss Problem IWSM 2013 1 / 15 Outline 1 Symmetric
More informationRATE ANALYSIS FOR DETECTION OF SPARSE MIXTURES
RATE ANALYSIS FOR DETECTION OF SPARSE MIXTURES Jonathan G. Ligo, George V. Moustakides and Venugopal V. Veeravalli ECE and CSL, University of Illinois at Urbana-Champaign, Urbana, IL 61801 University of
More informationDetection Performance and Energy Efficiency of Sequential Detection in a Sensor Network
Detection Performance and Energy Efficiency of Sequential Detection in a Sensor Network Lige Yu, Student Member, IEEE and Anthony Ephremides, Fellow, IEEE Department of Electrical and Computer Engineering
More informationSpectrum Sensing in Cognitive Radios using Distributed Sequential Detection
Spectrum Sensing in Cognitive Radios using Distributed Sequential Detection Jithin K. S. Research Supervisor: Prof. Vinod Sharma External Examiner: Prof. Shankar Prakriya, IIT Delhi ECE Dept., Indian Institute
More informationIN MOST problems pertaining to hypothesis testing, one
1602 IEEE SIGNAL PROCESSING LETTERS, VOL. 23, NO. 11, NOVEMBER 2016 Joint Detection and Decoding in the Presence of Prior Information With Uncertainty Suat Bayram, Member, IEEE, Berkan Dulek, Member, IEEE,
More information