Surveillance of BiometricsAssumptions

Similar documents
Monitoring actuarial assumptions in life insurance

Robust Detection of Unobservable Disorder Time in Poisson Rate

Sequential Detection. Changes: an overview. George V. Moustakides

Quickest Detection With Post-Change Distribution Uncertainty

Optimum CUSUM Tests for Detecting Changes in Continuous Time Processes

Early Detection of a Change in Poisson Rate After Accounting For Population Size Effects

Uncertainty. Jayakrishnan Unnikrishnan. CSL June PhD Defense ECE Department

Statistical Models and Algorithms for Real-Time Anomaly Detection Using Multi-Modal Data

SEQUENTIAL CHANGE DETECTION REVISITED. BY GEORGE V. MOUSTAKIDES University of Patras

Bayesian quickest detection problems for some diffusion processes

Least Favorable Distributions for Robust Quickest Change Detection

Data-Efficient Quickest Change Detection

A CUSUM approach for online change-point detection on curve sequences

The Shiryaev-Roberts Changepoint Detection Procedure in Retrospect - Theory and Practice

EARLY DETECTION OF A CHANGE IN POISSON RATE AFTER ACCOUNTING FOR POPULATION SIZE EFFECTS

Solving the Poisson Disorder Problem

Asymptotically Optimal Quickest Change Detection in Distributed Sensor Systems

Asynchronous Multi-Sensor Change-Point Detection for Seismic Tremors

MORTALITY: A STATISTICAL APPROACH TO DETECT MODEL MISSPECIFICATION

Surveillance of Infectious Disease Data using Cumulative Sum Methods

Poisson Disorder Problem with Exponential Penalty for Delay

Sequential Change-Point Approach for Online Community Detection

Compound Poisson disorder problem

EFFICIENT CHANGE DETECTION METHODS FOR BIO AND HEALTHCARE SURVEILLANCE

Change detection problems in branching processes

Stochastic Areas and Applications in Risk Theory

Decentralized Sequential Hypothesis Testing. Change Detection

Point Process Control

SEQUENTIAL CHANGE-POINT DETECTION WHEN THE PRE- AND POST-CHANGE PARAMETERS ARE UNKNOWN. Tze Leung Lai Haipeng Xing

Applications of Optimal Stopping and Stochastic Control

Hypothesis testing for Stochastic PDEs. Igor Cialenco

Change-point models and performance measures for sequential change detection

Introduction to repairable systems STK4400 Spring 2011

A Dynamic Contagion Process with Applications to Finance & Insurance

The Modified Keifer-Weiss Problem, Revisited

Modelling the risk process

Change Detection Algorithms

Information and Credit Risk

On robust stopping times for detecting changes in distribution

Statistics for extreme & sparse data

SEQUENTIAL TESTING OF SIMPLE HYPOTHESES ABOUT COMPOUND POISSON PROCESSES. 1. Introduction (1.2)

Revision Moment for the Retail Decision-Making System

Early Detection of Epidemics as a Sequential Change-Point Problem

Directionally Sensitive Multivariate Statistical Process Control Methods

INSTITUTE AND FACULTY OF ACTUARIES. Curriculum 2019 SPECIMEN SOLUTIONS

PhD course in Advanced survival analysis. One-sample tests. Properties. Idea: (ABGK, sect. V.1.1) Counting process N(t)

Point Processes, and Populations Dynamics. in longevity, credit, HFT modelling

Regenerative Likelihood Ratio control schemes

Minimization of ruin probabilities by investment under transaction costs

Short-time expansions for close-to-the-money options under a Lévy jump model with stochastic volatility

Quickest Changepoint Detection: Optimality Properties of the Shiryaev Roberts-Type Procedures

Quickest Anomaly Detection: A Case of Active Hypothesis Testing

Asymptotical distribution free test for parameter change in a diffusion model (joint work with Y. Nishiyama) Ilia Negri

Limit theorems for Hawkes processes

Order book modeling and market making under uncertainty.

Stochastic modelling and equilibrium in mathematical finance and statistical sequential analysis

Sequential Procedure for Testing Hypothesis about Mean of Latent Gaussian Process

Introduction to Reliability Theory (part 2)

CHANGE DETECTION WITH UNKNOWN POST-CHANGE PARAMETER USING KIEFER-WOLFOWITZ METHOD

A new iterated filtering algorithm

Statistics 262: Intermediate Biostatistics Non-parametric Survival Analysis

Practice Exam 1. (A) (B) (C) (D) (E) You are given the following data on loss sizes:

arxiv:math/ v2 [math.st] 15 May 2006

Optimal and asymptotically optimal CUSUM rules for change point detection in the Brownian Motion model with multiple alternatives

A novel repair model for imperfect maintenance

Bayesian Quickest Detection with Observation-Changepoint Feedback

Contagious default: application of methods of Statistical Mechanics in Finance

Mortality Surface by Means of Continuous Time Cohort Models

Dynamic Pricing for Non-Perishable Products with Demand Learning

Density models for credit risk

On the sequential testing and quickest change-pointdetection problems for Gaussian processes

SCALABLE ROBUST MONITORING OF LARGE-SCALE DATA STREAMS. By Ruizhi Zhang and Yajun Mei Georgia Institute of Technology

MICHAEL LUDKOVSKI AND SEMIH O. SEZER

Optimal maintenance for minimal and imperfect repair models

Optimal Design and Analysis of the Exponentially Weighted Moving Average Chart for Exponential Data

Efficient scalable schemes for monitoring a large number of data streams

Individual reserving a survey. R in Insurance, Paris 08-June-2017 Alexandre Boumezoued, joint work with Laurent Devineau

Lecture 22 Girsanov s Theorem

Brownian Motion. 1 Definition Brownian Motion Wiener measure... 3

EXTENSIONS TO THE EXPONENTIALLY WEIGHTED MOVING AVERAGE PROCEDURES

arxiv: v2 [math.pr] 4 Feb 2009

Space-Time CUSUM for Distributed Quickest Detection Using Randomly Spaced Sensors Along a Path

A Step Towards the Cognitive Radar: Target Detection under Nonstationary Clutter

Discussion on Change-Points: From Sequential Detection to Biology and Back by David Siegmund

Simulation estimators in a dynamic model for food contaminant exposure

Quickest detection & classification of transient stability status for power systems

Introduction to Bayesian Statistics

PROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS

Exponential martingales: uniform integrability results and applications to point processes

Computational and Monte-Carlo Aspects of Systems for Monitoring Reliability Data. Emmanuel Yashchin IBM Research, Yorktown Heights, NY

EXPERIENCE-BASED LONGEVITY ASSESSMENT

Econometric Analysis of Cross Section and Panel Data

POMP inference via iterated filtering

On Stopping Times and Impulse Control with Constraint

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 22 12/09/2013. Skorokhod Mapping Theorem. Reflected Brownian Motion

Lecture 8: Information Theory and Statistics

On the sequential testing problem for some diffusion processes

Lecture 21 Representations of Martingales

Affine Processes. Econometric specifications. Eduardo Rossi. University of Pavia. March 17, 2009

Preface Introduction to Statistics and Data Analysis Overview: Statistical Inference, Samples, Populations, and Experimental Design The Role of

Transcription:

Surveillance of BiometricsAssumptions in Insured Populations Journée des Chaires, ILB 2017 N. El Karoui, S. Loisel, Y. Sahli UPMC-Paris 6/LPMA/ISFA-Lyon 1 with the financial support of ANR LoLitA, and Chair Risques financiers ILB, 20 October 2017 1/27 N.El Karoui-S.Loisel-Y.Salhi ILB, 20 Oct 2017

Figure: Longevity Risk Thank you, Alexandre Boumezoued

Longevity purpose Mortality evolution Mainly concerned with mortality evolution which may change over a projection period Mortality profile/level/trend : Heterogeneity and other factors Interest in experienced mortality : Deaths can be observed sequentially Model risk, parameter uncertainty: Long-term projection Risk Management of Mortality evolution Sequential information on death occurrences Monitoring and surveillance of mortality dynamics Updating mortality assumptions 3/27 N.El Karoui-S.Loisel-Y.Salhi ILB, 20 Oct 2017

What is the Disorder Problem? The Poisson disorder problem is less formally stated as follows Observe a trajectory of the Poisson process (N t ) whose intensity changes from λ to ρλ at some (unknown) time θ. The problem is to find a rule to detect θ as quickly as possible with a limited number of false alarms 0 θ Disorder time 4/27 N.El Karoui-S.Loisel-Y.Salhi ILB, 20 Oct 2017

Where do the disorder problems arise Insurance compagnies: Recalculate the premiums for the future sales of insurance policies when the risk structure changes (ρ > 1) Pension funds: Large exposure to change in mortality risk : ρ < 1 Quality control and maintenance: Inspect, recalibrate, or repair as soon a manufacturing process goes out of control Fraud and computer intrusion detection: Alert the inspectors for an immediate investigation as soon as abnormal activity in credit card, cell phone calls, or computer network traffic are detected. 5/27 N.El Karoui-S.Loisel-Y.Salhi ILB, 20 Oct 2017

How to choose the parameter ρ for pensions 6/27 N.El Karoui-S.Loisel-Y.Salhi ILB, 20 Oct 2017

Overview of change detection The observation process Let N = (N t ) t 0 be a counting process (of claims, or deaths) with stochastic intensity λ = (λ t ) t 0, Cox process A change in the intensity occurs at an unobservable date θ, from λ t to ρλ t, ρ > 0. Proportional hazard models Change of Point θ=model-risk Random with known prior (Bayesian) Deterministic but unknown (Non-Bayesian but Robust) Change of Probability measures: Known statistics P and P Under P, no change, (λ t ) holds (θ = ) Under P, immediate change, (ρλ t ) holds (θ = 0) Under P θ, λ θ t = 1 t<θ λ t + 1 t θ ρλ t 7/27 N.El Karoui-S.Loisel-Y.Salhi ILB, 20 Oct 2017

Bayesian setup for random change-point Brownian framework with abrupt change in the drift Based on the conditional distribution of the time of change, Formulated as an optimal stopping problem for partially observable process Page(1954), Shiryaev(1963), Roberts(1966), Beibel(1988), Moustakides (2004), and Dayanik (2006),... Poisson framework with abrupt change in intensity Based on the conditional distribution of the time of change, with exponential or geometric prior distribution More recent studies : Gal (1971), Gapeev (2005), Bayraktar (2005, 2006), Dayanik (2006) for compound Poisson, Peskir, Shyriaev(2009) and others New methods using particle filters Andrieu, Legland, Zhang ( 2005) 8/27 N.El Karoui-S.Loisel-Y.Salhi ILB, 20 Oct 2017

Robust Detection Problem, Page (1954) Robust Detection Non-Bayesian framework, mainly motivated by the lack of any priors on the statistical behavior of change-point. Concerned with general counting process, in particular inhomogeneous Poisson process The problem Detect the change-point θ as quick as possible τ While avoiding false alarms Optimality criteria, Lorden (1971)-Like Detection delay estimate: E θ [ (Nτ N θ ) + F θ ] Frequence of false alarm E [ Nτ ] 9/27 N.El Karoui-S.Loisel-Y.Salhi ILB, 20 Oct 2017

The robust problem Robust criterium C(τ) = A min-max problem under constraint [ sup esssup ω E θ (Nτ N θ ) + ] Fθ θ [0, ] Find τ such that C = C(τ ) = min C(τ), under control of the error of the second type, ( sound the alarm when there is not change (θ = ) ) is small or equivalently if E [N τ ] π. The rule is stable by time rescaling and so the same for all intensity structure such that 0 λ s ds = and N =, a.s.. 10/27 N.El Karoui-S.Loisel-Y.Salhi ILB, 20 Oct 2017

Likelihood formulation Conditional probability ratio between P =no change, P= immediate change. The conditional probability ratio process of P w.r to P is d P/dP = E t = exp ( log(ρ)n t (ρ 1)Λ t ) Put U ρ t = N t β(ρ)λ t, so ρ Uρ t is a P-martingale. Then the CPR of P w.r to P is : ρ Uρ t = (1/ρ) Uρ t The β coefficient where β(ρ) = ρ 1 log(ρ), with β(ρ) = 1 0 ρu du.= Laplace transform of U[0, 1]. Put β(ρ) = β(1/ρ) = β(ρ)/ρ, and ρ = 1/ρ. 11/27 N.El Karoui-S.Loisel-Y.Salhi ILB, 20 Oct 2017

Likelihood formulation and Cusum process Sequential conditional probability ratio: The log ρ ratio of density processes on F t of P θ w.r to P is log ρ (dp θ /dp) = U ρ t θ Uρ θ where U ρ t = N t β(ρ)λ t The Cumulative Sum rule (cusum)= Log Max Likelihood in time Based on max s t (ρ Ut Us ), ( sign of ln(ρ)) Depend on the sign of ρ 1 Cusum stopping time, τ m = inf{t ; cusum t m} Main question: The optimality of τ m, if the false alarm constraint is achieved, E(N τ π m ) = π. 12/27 N.El Karoui-S.Loisel-Y.Salhi ILB, 20 Oct 2017

Reflected Counting process with drift Running supremum Running supremum Z t = sup s t Z s Put X t = U t = N t + βλ t. So, X t is continuous. Ū t is not continuous and increases only at jumps of N, such that Ūt = U t Reflected processes and Cusum processes Cusum rule based on max s t ρ Ut Us ρ > 1: Reflected process X at its maximum, V t = sup θ t (U t U θ ) = X t X t ρ < 1 Reflected process U process at its maximum: Y t = sup θ t (X t X θ ) = Ū t U t, 3/27 N.El Karoui-S.Loisel-Y.Salhi ILB, 20 Oct 2017

Typical paths for ρ > 1 Figure: Sample paths of the processes U(x), V (x) and L(x) when λ is time-homogeneous. 14/27 N.El Karoui-S.Loisel-Y.Salhi ILB, 20 Oct 2017

Typical paths with change of regime at date 3 t t 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 9 50 10 15 Vt 8 7 6 5 4 3 2 N t 45 40 35 30 25 20 15 10 Nt Vt 9 8 7 6 5 4 3 2 N t Y t 10 5 Nt 1 V t 5 1 0 0 0 1 2 3 4 5 6 7 8 9 t (a) Processes N and V ρ t 0 0 0 1 2 3 4 5 6 7 8 9 t (b) Processes N and Y ρ t Figure: Sample paths, for ρ > 1, of the cusum processes N, V ρ (left) and N, Y 1/ρ t (right ). 15/27 N.El Karoui-S.Loisel-Y.Salhi ILB, 20 Oct 2017

Detection Procedure Algorithm Step 1: Fix the input parameters: The post-change intensity through the specification of ρ and the false alarm constraint π. Step 2: Determine the threshold m as the solution of the equation E [N τm ] = π. Step 3: For each new observation at time t compute the value of the CUSUM process V given by the iterative relation V t+1 = (V t 1 + U t ) +. Step 4: Compare the current value of V to the threshold m and stop the procedure once V t m and sound an alarm. Hence τ m (0) = t. 16/27 N.El Karoui-S.Loisel-Y.Salhi ILB, 20 Oct 2017

Optimality results Optimality in decrease in intensity Let T be a stopping times with finite cusum bound, such that E(N T ) = E(N τ Y m ) = g m (0)., then E ( T 0 ρ1 Y s dn s ) h m (0) E ( ρ Y T ), Optimality in increase in intensity Let T be a stopping times with finite cusum bound,such that E(N T ) = E(N τ V m ) = h m (0)., then E ( T 0 ρvs dn s ) h m (0) E ( ρ V T ), 7/27 N.El Karoui-S.Loisel-Y.Salhi ILB, 20 Oct 2017

MonteCarlo simulation Evolution of the global population λ t = a ( 1 + exp( (t b)/c) ) 1, t 0, where a, b and c are some constant parameters given in a b c σ 13.80 11.85 26.40 0.0907 10000 simulations for ρ = 1.1, 1.5, 2 ρ 1.1 1.5 2 m = 5 h 0 (0) 25.01 17.77 () 14.15 h (0) 32.92 () 58.52 () 116.82 m = 10 h 0 (0) 81.48 () 44.49 () 31.97 h (0) 147.73 () 643.29 () 4174.49 18/27 N.El Karoui-S.Loisel-Y.Salhi ILB, 20 Oct 2017

Detection Procedure Real World We consider the Continuous Mortality Investigation assured lives dataset and England & Wales national population. We split data into two periods: We consider the period 1947-1969 as a training period. The Cox model is estimated over this period using the MLE. It is not easy to estimate the post change coefficient ρ Hence we monitor sequentially the dataset over the period 1970-2005 and look for changes on the mortality of assured lives. 19/27 N.El Karoui-S.Loisel-Y.Salhi ILB, 20 Oct 2017

Detection Procedure Real World Cusum process 0 2 4 6 8 10 12 Cusum process 0 2 4 6 8 10 12 1970 1980 1990 2000 Time in year 1970 1980 1990 2000 Time in year Figure: Detection scheme for age groups 50 59 (right) and 80 89 (left). The post-change is set to ρ = 1.15% and the false alarm constraint to π = 100 λ. 20/27 N.El Karoui-S.Loisel-Y.Salhi ILB, 20 Oct 2017

Detection Procedure Real World τ m Age ρ = 1.50 ρ = 1.15 50 59 1984 1978 60 69 1991 1985 70 79 1988 1984 80 89 1983 1978 Table: Detection of mortality change with a post-change ratio of ρ = 1.15 and an average run length (false alarm) constraint of 100. The right column reports the detected change-point using an off-line procedure. When ρ is larger the detection delay is longer Difficile to disctinct effective change or false alarm Other results mention that a breakpoint on the data on the 1980. 21/27 N.El Karoui-S.Loisel-Y.Salhi ILB, 20 Oct 2017

Monitoring Mortality 22/27 N.El Karoui-S.Loisel-Y.Salhi ILB, 20 Oct 2017

Monitoring MortalityII 23/27 N.El Karoui-S.Loisel-Y.Salhi ILB, 20 Oct 2017

Monitoring Mortality III 24/27 N.El Karoui-S.Loisel-Y.Salhi ILB, 20 Oct 2017

Monitoring Mortality 25/27 N.El Karoui-S.Loisel-Y.Salhi ILB, 20 Oct 2017

Age pyramids multi-portolios 26/27 N.El Karoui-S.Loisel-Y.Salhi ILB, 20 Oct 2017

Cusum multi-portolios 27/27 N.El Karoui-S.Loisel-Y.Salhi ILB, 20 Oct 2017

Conclusion The cusum detection rule is optimal in the case of non-homogeneous Poisson process with a modified Lorden criterion Very easy to implement Non asymptotic criterium Based on fine properties of scale functions, easy to extend to Levy processes The proof provide lower bound for some conditional ratio (Basseville) Applications in non-life insurance Further research on possible extensions 28/27 N.El Karoui-S.Loisel-Y.Salhi ILB, 20 Oct 2017

With the indulgence of Sau, Gold of health and longevity Thank you 29/27 N.El Karoui-S.Loisel-Y.Salhi ILB, 20 Oct 2017