Lessons learned from the theory and practice of. change detection. Introduction. Content. Simulated data - One change (Signal and spectral densities)

Similar documents
Uncertainty Quantification for Stochastic Subspace Identification of Multi-Setup Measurements

SISTHEM. Inférence Statistique pour la Surveillance d Intégrité de Structures. 5th April 2004

Données, SHM et analyse statistique

Subspace-based damage detection on steel frame structure under changing excitation

Change Detection Algorithms

Automated Modal Parameter Estimation For Operational Modal Analysis of Large Systems

A CUSUM approach for online change-point detection on curve sequences

Uncertainty. Jayakrishnan Unnikrishnan. CSL June PhD Defense ECE Department

GARCH Models Estimation and Inference

2. What are the tradeoffs among different measures of error (e.g. probability of false alarm, probability of miss, etc.)?

Vibration Based Health Monitoring for a Thin Aluminum Plate: Experimental Assessment of Several Statistical Time Series Methods

Analysis of the AIC Statistic for Optimal Detection of Small Changes in Dynamic Systems

Composite Hypotheses and Generalized Likelihood Ratio Tests

Project-Team sigma2. Signaux, modèles et algorithmes

Detection and Estimation of Multiple Fault Profiles Using Generalized Likelihood Ratio Tests: A Case Study

Handling parametric and non-parametric additive faults in LTV Systems

Asynchronous Multi-Sensor Change-Point Detection for Seismic Tremors

Lecture 5: Likelihood ratio tests, Neyman-Pearson detectors, ROC curves, and sufficient statistics. 1 Executive summary

Introduction to General and Generalized Linear Models

Multi-Order Covariance Computation for Estimates in Stochastic Subspace Identification Using QR Decompositions

Detection theory 101 ELEC-E5410 Signal Processing for Communications

MATH5745 Multivariate Methods Lecture 07

Machine Learning Linear Classification. Prof. Matteo Matteucci

P U B L I C A T I O N I N T E R N E N o MERGING SENSOR DATA FROM MULTIPLE TEMPERATURE SCENARIOS FOR VIBRATION MONITORING OF CIVIL STRUCTURES

Lecture 7 Introduction to Statistical Decision Theory

Machine Learning. Lecture 3: Logistic Regression. Feng Li.

10. Composite Hypothesis Testing. ECE 830, Spring 2014

Brandon C. Kelly (Harvard Smithsonian Center for Astrophysics)

Bayesian inference. Justin Chumbley ETH and UZH. (Thanks to Jean Denizeau for slides)

GARCH Models Estimation and Inference. Eduardo Rossi University of Pavia

ON THE APPLICATION OF A SUBSPACE-BASED FAULT DETECTION METHOD *

Parameter Estimation and Fitting to Data

Parametric Output Error Based Identification and Fault Detection in Structures Under Earthquake Excitation

Parameter estimation! and! forecasting! Cristiano Porciani! AIfA, Uni-Bonn!

APPLICATION OF A SUBSPACE-BASED FAULT DETECTION METHOD TO INDUSTRIAL STRUCTURES

EECS564 Estimation, Filtering, and Detection Exam 2 Week of April 20, 2015

Novel spectrum sensing schemes for Cognitive Radio Networks

VARIANCE COMPUTATION OF MODAL PARAMETER ES- TIMATES FROM UPC SUBSPACE IDENTIFICATION

NONUNIFORM SAMPLING FOR DETECTION OF ABRUPT CHANGES*

Bayesian inference J. Daunizeau

A Dynamic Threshold Based Algorithm for Change Detection in Autonomous Systems

A Simple Example Binary Hypothesis Testing Optimal Receiver Frontend M-ary Signal Sets Message Sequences. possible signals has been transmitted.

On the Complexity of Best Arm Identification with Fixed Confidence

Monitoring Wafer Geometric Quality using Additive Gaussian Process

Variance estimation of modal parameters from input/output covariance-driven subspace identification

Confidence Intervals of Modal Parameters during Progressive Damage Test

GPS Multipath Detection Based on Sequence of Successive-Time Double-Differences

COMS 4721: Machine Learning for Data Science Lecture 19, 4/6/2017

Introduction to Statistical Inference

Linear Models for Regression CS534

Surveillance of Infectious Disease Data using Cumulative Sum Methods

Hierarchical sparse Bayesian learning for structural health monitoring. with incomplete modal data

Practical Statistics

Sequential Detection. Changes: an overview. George V. Moustakides

Parameter estimation and forecasting. Cristiano Porciani AIfA, Uni-Bonn

Elements of Multivariate Time Series Analysis

Bayesian inference J. Daunizeau

PATTERN RECOGNITION AND MACHINE LEARNING

TMA 4275 Lifetime Analysis June 2004 Solution

Hypothesis testing for Stochastic PDEs. Igor Cialenco

Data-Driven Anomaly Detection based on a Bias Change

Lecture 8: Information Theory and Statistics

Applications of Information Geometry to Hypothesis Testing and Signal Detection

Scalar and Vector Time Series Methods for Vibration Based Damage Diagnosis in a Scale Aircraft Skeleton Structure

P Values and Nuisance Parameters

Online Seismic Event Picking via Sequential Change-Point Detection

Real-Time Detection of Hybrid and Stealthy Cyber-Attacks in Smart Grid

LECTURE 10: NEYMAN-PEARSON LEMMA AND ASYMPTOTIC TESTING. The last equality is provided so this can look like a more familiar parametric test.

Testing for Anomalous Periods in Time Series Data. Graham Elliott

Model-based Fault Diagnosis Techniques Design Schemes, Algorithms, and Tools

Lecture 2 Machine Learning Review

Digital Transmission Methods S

Identification Methods for Structural Systems

Sparsity Models. Tong Zhang. Rutgers University. T. Zhang (Rutgers) Sparsity Models 1 / 28

Machine Learning. Lecture 4: Regularization and Bayesian Statistics. Feng Li.

ELEG 5633 Detection and Estimation Signal Detection: Deterministic Signals

Prompt Network Anomaly Detection using SSA-Based Change-Point Detection. Hao Chen 3/7/2014

WHEN IS A MAXIMAL INVARIANT HYPOTHESIS TEST BETTER THAN THE GLRT? Hyung Soo Kim and Alfred O. Hero

Some New Aspects of Dose-Response Models with Applications to Multistage Models Having Parameters on the Boundary

Parametric Unsupervised Learning Expectation Maximization (EM) Lecture 20.a

Linear Models for Regression CS534

An introduction to Bayesian inference and model comparison J. Daunizeau

CMU-Q Lecture 24:

Exercises Chapter 4 Statistical Hypothesis Testing

Notes on the Multivariate Normal and Related Topics

F2E5216/TS1002 Adaptive Filtering and Change Detection. Course Organization. Lecture plan. The Books. Lecture 1

Variations. ECE 6540, Lecture 10 Maximum Likelihood Estimation

Modeling the Goodness-of-Fit Test Based on the Interval Estimation of the Probability Distribution Function

Likelihood-Based Methods

Decentralized Sequential Hypothesis Testing. Change Detection

Statistics 203: Introduction to Regression and Analysis of Variance Course review

Parameter Estimation in a Moving Horizon Perspective

Multi-Baseline SAR interferometry

Introduction to Signal Detection and Classification. Phani Chavali

Gaussian with mean ( µ ) and standard deviation ( σ)

Hyung So0 Kim and Alfred 0. Hero

SIGNAL AND IMAGE RESTORATION: SOLVING

SEQUENTIAL CHANGE-POINT DETECTION WHEN THE PRE- AND POST-CHANGE PARAMETERS ARE UNKNOWN. Tze Leung Lai Haipeng Xing

Appendix A: The time series behavior of employment growth

Hypothesis Testing. Robert L. Wolpert Department of Statistical Science Duke University, Durham, NC, USA

Transcription:

Lessons learned from the theory and practice of change detection Simulated data - One change (Signal and spectral densities) - Michèle Basseville - 4 6 8 4 6 8 IRISA / CNRS, Rennes, France michele.basseville@irisa.fr -- http://www.irisa.fr/sisthem/ - - -3-4.5 - - -3-4.5 Introduction Detection of changes Content Stochastic models (static, dynamic) uncertainties Parameterized models (physical interpretation, diagnostics) Damage deviation in the parameter vector Changes in the mean Changes in the spectrum Many changes of interest are small Changes in the system dynamics and vibration-based SHM Early detection of (small) deviations is useful Key issue (): which function of the data should be handled? Example: flutter monitoring Key issue (): how to make the decision? 3 4

Changes in the mean Hypothesis testing Key concepts - Independent data Likelihood p θ (y i ) Log-likelihood ratio s i = ln p θ (y i ) p θ (y i ) E θ (s i ) < E θ (s i ) > p θ (Y N Likelihood ratio Λ N = ) p θ (Y N) = i p θ (y i ) i p θ (y i ) Log-likelihood ratio S N = ln ΛN = N i= s i Hypotheses H H Simple θ θ Known parameter values Composite Θ Θ Unknown parameter values Simple hypotheses : Likelihood ratio test If Λ N λ/s N h : decide H, H otherwise Composite hypotheses : Generalized likelihood ratio (GLR) Λ N = sup θ Θ p θ (Y N) sup θ Θ p θ (Y N) = p θ (Y N ) p θ (Y N ) Maximize the likelihoods w.r.t. unknown values of θ and θ 6 5 On-line change detection, unknown onset time Simple case: Known θ - CUSUM algorithm θ o t o θ? n Ratio of likelihoods under H and H : t i= p θ (y i ) ki= p θ (y i ) ki=t p θ (y i ) = ki=t p θ (y i ) ki=t p θ (y i ) = Λk t Hypothesis H θ = θ known ( i k) Hypothesis H t s.t. θ = θ ( i<t ) θ (t i k) Alarm time t a : t a =min{k :g k h} decision function Maximize over the unknown onset time t : ( t ) k = arg max j k = arg max j k = arg max j k j i= p θ (y i ) Λ k j S k j, k i=j p θ (y i ) Sk j =ln Λk j Estimated onset time: t g k = max j k Sk j = lnλ kˆt 7 8

CUSUM algorithm (Contd.) Lesson CUSUM algorithm (Contd.) - Gaussian example g k = max j k Sk j = S k min j k Sj = Sk m k, m k = min j k Sj N (µ, σ ), θ = µ, p θ (y) = σ π exp (y i µ) σ s i = ln p µ (y i ) p µ (y i ) t a = min{k :S k m k + h} Adaptative threshold = ( (yi σ µ ) (y i µ ) ) g k = (g k + s k ) + g k = ( S k k N k +) +, Nk = Nk I(g k )+ = ν σ y i µ ν, ν = µ µ ( t ) k = t a N ta + Sliding window with adaptive size 9 S k involves k i= y i : Integrator (with adaptive threshold) CUSUM algorithm - Gaussian example (Contd.) Composite case: Unknown θ 7 6 5 4 Modified CUSUM algorithms 3 - - y k -3 5 5 5 3 35 4 45 5 Minimum magnitude of change Weighted CUSUM - - -3 GLR algorithm -4 S k -5 5 5 5 3 35 4 45 5 9 Double maximization 8 7 6 5 4 3 g k = max j k sup θ S k j (θ ) g k 5 5 5 3 35 4 45 5 Gaussian case, additive faults: second maximization explicit.

Unknown θ - Gaussian example (Contd.) Changes in the spectrum Minimum magnitude of change ν m Lesson Key concepts - Dependent data Decreasing mean T k = k i= y i µ + ν m Increasing mean U k = k i= y i µ ν m Conditional likelihood p θ (y i Y i ) Log-likelihood ratio s i = ln p θ (y i Y i ) p θ (y i Y i ) E θ (s i ) < M k = max j k T j m k = min j k U j t a =min{k :M k T k h} t a =min{k :U k m k h} E θ (s i ) > p θ (Y N Likelihood ratio Λ N = ) p θ (Y N) = i p θ (y i Y i ) i p θ (y i Y i ) Log-likelihood ratio S N = ln ΛN = N i= s i 3 4 Key concepts - Dependent data (Contd.) Key concepts - Dependent data (Contd.) θ : reference parameter, known (or identified) Which residuals? Lesson 3 Y k : N-size sample of new measurements Likelihood ratio computationally complex Build a residual ζ significantly non zero when damage Efficient score : likelihood sensitivity w.r.t. parameter vector Other estimating fonctions Residual Estimating function ζ N (θ, Y N ) Characterized by: E θ ζ N (θ, Y N )= θ = θ Innovation not sufficient for monitoring the dynamics. Mean sensitivity J (θ ) and covariance Σ(θ ) of ζ N (θ ) 5 6

Key concepts - Dependent data (Contd.) Changes in the dynamics and vibration-based SHM The residual is asymptotically Gaussian ζ N (θ ) N (, Σ(θ )) if P θ N ( J (θ ) δθ, Σ(θ )) if P θ + δθ N (On-board) χ -test in the residual small deviations Structural monitoring : Eigenstructure monitoring X k+ = F X k + V k F Φ λ = λ Φ λ Y k = H X k ϕ λ = H Φλ ζ T N Σ J (J T Σ J ) J T Σ ζ N h Canonical parameter : θ = Λ vec Φ modes mode shapes Noises and uncertainty on θ taken into account. 7 8 Example: flutter monitoring Detecting structural changes Monitoring a damping coefficient Reference data covariances Hankel matrix H Left null space S s.t. S T H = (S T O(θ )=) Fresh data covariances Hankel matrix H Check if ζ = S T H ζ asympt. Gaussian, test: χ in ζ Test ρ ρ c against ρ<ρ c Write the subspace-based residual ζ as a cumulative sum Introduce a minimum change magnitude (actual change magnitude unknown) 9 Run two CUSUM tests in parallel (actual change direction unknown)

Flutter monitoring (Contd) Application to real datasets Ariane booster launcher during a launch scenario on the ground (not during a real flight test) Running the test with critical values With Laurent Mével, Maurice Goursat, Albert Benveniste Free COSMAD Toolbox to used with Scilab http://www.irisa.fr/sisthem/cosmad/ Automatic identification. Each symbol: processing 5 sec. data. Conclusion Advanced statistical signal processing mandatory for SHM On-line test for ρ c = ρ = ρ () c. A statistical framework enlightens the meaning and increases the power of a number of familiar operations integration, averaging, sensitivity, adaptive thresholds & windows Change detection useful for (vibration-based) SHM On-line test for ρ c = ρ = ρ () c <ρ () c. Bottom: g n reflects ρ<ρ c. Top: g + n reflects ρ>ρ c. Current investigations flutter monitoring (with Dassault, Airbus), handling the temperature effect on civil structures (with LCPC) 3 4