Lecture 7. Poisson and lifetime processes in risk analysis

Similar documents
Lecture 7. Testing for Poisson cdf - Poisson regression - Random points in space 1

Exponential Distribution and Poisson Process

Manual for SOA Exam MLC.

HW7 Solutions. f(x) = 0 otherwise. 0 otherwise. The density function looks like this: = 20 if x [10, 90) if x [90, 100]

Examination paper for TMA4275 Lifetime Analysis

Continuous case Discrete case General case. Hazard functions. Patrick Breheny. August 27. Patrick Breheny Survival Data Analysis (BIOS 7210) 1/21

Reliability Engineering I

Lecture 8. Poisson models for counts

Statistics 262: Intermediate Biostatistics Non-parametric Survival Analysis

Survival Analysis. Stat 526. April 13, 2018

Continuous-time Markov Chains

4 Testing Hypotheses. 4.1 Tests in the regression setting. 4.2 Non-parametric testing of survival between groups

Estimation for Modified Data

Estimation of Quantiles

Cox s proportional hazards model and Cox s partial likelihood

The exponential distribution and the Poisson process

STAT 430/510 Probability Lecture 12: Central Limit Theorem and Exponential Distribution

Survival Models. Lecture: Weeks 2-3. Lecture: Weeks 2-3 (Math 3630) Survival Models Fall Valdez 1 / 31

Statistics for Engineers Lecture 4 Reliability and Lifetime Distributions

Modelling the risk process

System Simulation Part II: Mathematical and Statistical Models Chapter 5: Statistical Models

Multistate Modeling and Applications

STAT 509 Section 3.4: Continuous Distributions. Probability distributions are used a bit differently for continuous r.v. s than for discrete r.v. s.

STAT 380 Markov Chains

Lecture 4a: Continuous-Time Markov Chain Models

Fundamentals of Reliability Engineering and Applications

3. Poisson Processes (12/09/12, see Adult and Baby Ross)

Chapter 2. Poisson Processes. Prof. Shun-Ren Yang Department of Computer Science, National Tsing Hua University, Taiwan

In contrast, parametric techniques (fitting exponential or Weibull, for example) are more focussed, can handle general covariates, but require

Ching-Han Hsu, BMES, National Tsing Hua University c 2015 by Ching-Han Hsu, Ph.D., BMIR Lab. = a + b 2. b a. x a b a = 12

Poisson Processes. Stochastic Processes. Feb UC3M

Survival Analysis. STAT 526 Professor Olga Vitek

CDA5530: Performance Models of Computers and Networks. Chapter 3: Review of Practical

(Ch 3.4.1, 3.4.2, 4.1, 4.2, 4.3)

Multivariate random variables

Introduction to repairable systems STK4400 Spring 2011

EDRP lecture 7. Poisson process. Pawe J. Szab owski

(Ch 3.4.1, 3.4.2, 4.1, 4.2, 4.3)

Chapter 2. 1 From Equation 2.10: P(A 1 F) ˆ P(A 1)P(F A 1 ) S i P(F A i )P(A i ) The denominator is

Probability Plots. Summary. Sample StatFolio: probplots.sgp

Reliability analysis of power systems EI2452. Lifetime analysis 7 May 2015

Optional Stopping Theorem Let X be a martingale and T be a stopping time such

Survival Analysis. Lu Tian and Richard Olshen Stanford University

Lectures 16-17: Poisson Approximation. Using Lemma (2.4.3) with θ = 1 and then Lemma (2.4.4), which is valid when max m p n,m 1/2, we have

1. Reliability and survival - basic concepts

An Integral Measure of Aging/Rejuvenation for Repairable and Non-repairable Systems

10 Introduction to Reliability

BMIR Lecture Series on Probability and Statistics Fall, 2015 Uniform Distribution

PROBABILITY DISTRIBUTIONS

STAT2201. Analysis of Engineering & Scientific Data. Unit 3

2DI90 Probability & Statistics. 2DI90 Chapter 4 of MR

Lecture 3. Conditional distributions with applications

TMA 4275 Lifetime Analysis June 2004 Solution

Northwestern University Department of Electrical Engineering and Computer Science

Reliability of Technical Systems

PoissonprocessandderivationofBellmanequations

3 Continuous Random Variables

Nonparametric Model Construction

1 Poisson processes, and Compound (batch) Poisson processes

Frailty Modeling for clustered survival data: a simulation study

Poisson Processes. Particles arriving over time at a particle detector. Several ways to describe most common model.

CDA6530: Performance Models of Computers and Networks. Chapter 3: Review of Practical Stochastic Processes

Recap. Probability, stochastic processes, Markov chains. ELEC-C7210 Modeling and analysis of communication networks

Lecture 2: Discrete Probability Distributions

System Simulation Part II: Mathematical and Statistical Models Chapter 5: Statistical Models

Comparative Distributions of Hazard Modeling Analysis

Power and Sample Size Calculations with the Additive Hazards Model

Engineering Risk Benefit Analysis

Stat 475 Life Contingencies I. Chapter 2: Survival models

1 Glivenko-Cantelli type theorems

Part III. Hypothesis Testing. III.1. Log-rank Test for Right-censored Failure Time Data

Lecture 22 Survival Analysis: An Introduction

Censoring and Truncation - Highlighting the Differences

Chapter 4 Parametric Families of Lifetime Distributions

Qualifying Exam CS 661: System Simulation Summer 2013 Prof. Marvin K. Nakayama

errors every 1 hour unless he falls asleep, in which case he just reports the total errors

Lecture 6 PREDICTING SURVIVAL UNDER THE PH MODEL

Probability Distributions Columns (a) through (d)

CAS Exam MAS-1. Howard Mahler. Stochastic Models

DS-GA 1002 Lecture notes 2 Fall Random variables

CIVL 7012/8012. Continuous Distributions

Introduction to Reliability Theory (part 2)

ST495: Survival Analysis: Maximum likelihood

EE126: Probability and Random Processes

EE126: Probability and Random Processes

Semiparametric Regression

Random variables. DS GA 1002 Probability and Statistics for Data Science.

Lecture 2. Distributions and Random Variables

Economic Reliability Test Plans using the Generalized Exponential Distribution

Lecture 5 Models and methods for recurrent event data

11 Survival Analysis and Empirical Likelihood

Modeling and Performance Analysis with Discrete-Event Simulation

STAT 479: Short Term Actuarial Models

Failure rate in the continuous sense. Figure. Exponential failure density functions [f(t)] 1

Computer Science, Informatik 4 Communication and Distributed Systems. Simulation. Discrete-Event System Simulation. Dr.

Special distributions

Notes on Continuous Random Variables

Statistical Quality Control IE 3255 Spring 2005 Solution HomeWork #2

Chapter 1 Statistical Reasoning Why statistics? Section 1.1 Basics of Probability Theory

Exercises. (a) Prove that m(t) =

Transcription:

Lecture 7. Poisson and lifetime processes in risk analysis Jesper Rydén Department of Mathematics, Uppsala University jesper.ryden@math.uu.se Statistical Risk Analysis Spring 2014

Example: Life times of ball bearings In an experiment, the life times of ball bearings were recorded (million revolutions). The 22 observations, sorted in order: 17.88, 28.92, 33.00, 41.52, 42.12, 45.60, 48.48, 51.84, 51.96, 54.12, 55.56, 67.80, 68.64, 68.88, 84.12, 93.12, 98.64, 105.12, 105.84, 127.92, 128.04, 173.40.

Example: Life times of ball bearings 1 0.9 0.8 0.7 0.6 0.5 0.4 0.3 0.2 0.1 0 0 20 40 60 80 100 120 140 160 180 Millions of cycles to fatigue Empirical distribution function, 22 observations of lifetimes for ball bearings. Parametric model: Weibull distribution?

Failure-intensity function Definition. For a r.v. T 0 there is a function Λ(t), called the cumulative failure-intensity function, such that R(t) := P(T > t) = e Λ(t), t 0. If T has a density, then R(t) = P(T > t) = 1 F (t) = exp ( t λ(s) ds ), 0 where the function λ(s), called the failure-intensity function, satisfies Λ(t) = t 0 λ(s) ds.

Failure-intensity function If the distribution of T is continuous, with pdf f (t), the failure intensity can be calculated as It can also be shown that λ(s) = f (s) 1 F (s). P(T s + t T > s) λ(s) = lim, t 0 t that is, for small values of t, λ(s)t is approximately the probability that an item of age s will break within the time period t. Classification of failure-intensity functions: IFR (Increasing Failure Rate), DFR (Decreasing Failure Rate), both mechanisms: Bathtube curve.

Examples, failure-intensity functions

Example 7.4: Life insurance Let T be a lifetime for a human being. In practice, R(t) is specified by standard tables, based on observed lifetimes of a huge number of people. One example is the Norwegian N-1963 standard. In life-insurance mathematics, a popular choice of λ(s) is the Gompertz-Makeham distribution with the failure-rate function λ(s) = α + βc s, where s is measured in years. For example, for N-1963, the estimates are α = 9 10 4, β = 4.4 10 5, ĉ = 10 0.042. We want to solve the following problems: (i) Calculate the probability that a person will reach the age of at least seventy. (ii) A person is alive on the day he is thirty. Calculate the conditional probability that he will live to be seventy.

Estimation procedures The Nelson Aalen estimator estimates the cumulative failure-intensity function Λ(t) = t 0 λ(s) ds. Introduce the following notation: t i : time points for failures, d i : number of failures at time t i, n i : number of items at risk at time t i, i.e. number of items not yet failed prior to failure time t i. The estimator is given by and thus Λ (t) = t i t d i n i, R (t) = exp( Λ (t)). Note that R (t) 1 F n (t). If censoring is present, the values of n i are affected.

Log-rank test The log-rank test compares intensities, λ 1 (t) and λ 2 (t), in two groups (1 and 2). The aim is to test the hypothesis H 0 : λ 1 (t) = λ 2 (t). Consider the time points for events t 1, t 2,..., t D, both groups considered. Introduce the following notation: d i1 : number of events in group 1 at times t i, d i2 : number of events in group 2 at times t i, d i : d i = d i1 + d i2, n i1 : number of items in group 1 at risk at time t i, i.e. number of items not yet failed prior to failure time t i, n i2 : number of items in group 2 at risk at time t i, i.e. number of items not yet failed prior to failure time t i, n i : n i = n i1 + n i2.

Log-rank test, ctd. Test quantity: where ( Q = 1 D s 2 d i1 i=1 s 2 = D i=1 D i=1 d i n i ni d i n i d i n i1 n i ) 2, ni1n i2 n i 1. The test is similar to the χ 2 test and is as follows: If Q χ 2 α(1), reject H 0. (Note that since for X N(0, 1), X 2 χ 2 (1); hence, χ 2 α(1) = λ 2 α/2.)

Poisson Point Process (PPP) Definition. If the time intervals, T 1, T 2,..., between occurences of an event are independent, exponentially distributed variables with common failure intensity λ, then the times 0 < S 1 < S 2 <... when the event occurs form a Poisson point-process with intensity λ. S 1 S 2 S 3 S 4 T 1 T 2 T 3 T 4 t

Properties of a PPP Let λ be the intensity of a PPP. Then The time to the first event, T, is exponentially distributed: P(T > t) = e λt. The times between events, T i, are independent and exponentially distributed: P(T i > t) = e λt. The number of events, N(s, t), is Poisson distributed: P(N(s, t) = n) = (λt)n e λt. n! The number of events in disjoint time intervals are independent and (obviously) Poisson distributed.

A general Poisson process Let N(B) denote the number of events (or accidents) occuring in a region B. Consider the following list of assumptions: (A) More than one event can not happen simultaneously. (B) N(B 1 ) is independent of N(B 2 ) if B 1 and B 2 are disjoint. (C) Events happen in a stationary (in time) and homogeneous (in space) way, more precisely, the distribution of N(B) depends only on the size B of the region; for example N(B) Po(λ B ). The process for which we can motivate that (A B) are true is called a Poisson process. It is a stationary process with constant intensity λ if (A C) holds.

Poisson process in the plane B 2 B 1 B N(B) = 11, N(B 1 ) = 2, N(B 2 ) = 3.

Example 7.20: Pines Consider Japanese black pines in a square sampling region in a natural region. Area: 5.7 5.7 m 2. In this area, 65 pines were found. Estimation of intensity? Poisson distribution valid?

Superposition (decomposition) of Poisson processes + Superpos. Decompos.

Superposition theorem Assume that we have two independent Poisson point-processes, Si I and Si II, with intensities λ I and λ II, respectively. Consider a point process S i which is a union of the point processes Si I and Si II. The point process of S i is a superposition of the two processes and is a PPP itself, with intensity λ = λ I + λ II.

Example: Transports (Problem 7.13) Lorries travel over a bridge. Assume that the times S i of arrivals form a Poisson process with intensity 2 000 per day. Consider a scenario B = A lorry transports hazardous material. Let s assume that the scenario is independent of the stream of lorries. (This would not be the case if a chemical company is usually sending a convoy of lorries with hazardous material to the same destination). Statistics: with probability p = 0.08, a lorry transports hazardous material; with probability q = 0.92, other material is transported. 1. Find the probability that during a week (Monday Friday), more than 10 300 lorries will travel over the bridge. 2. Find the probability that during a week (Monday Friday), there are more than 820 transports of hazardous materials.