Simulation of Max Stable Processes

Similar documents
Conditional Sampling for Max Stable Random Fields

Max stable Processes & Random Fields: Representations, Models, and Prediction

Extreme Value Analysis and Spatial Extremes

Modelling spatial extremes using max-stable processes

Max-stable processes: Theory and Inference

The Poisson storm process Extremal coefficients and simulation

Max-stable processes and annual maximum snow depth

Joint Gaussian Graphical Model Review Series I

Covariance. Lecture 20: Covariance / Correlation & General Bivariate Normal. Covariance, cont. Properties of Covariance

The extremal elliptical model: Theoretical properties and statistical inference

Models for Spatial Extremes. Dan Cooley Department of Statistics Colorado State University. Work supported in part by NSF-DMS

Statistical modelling of spatial extremes using the SpatialExtremes package

A User s Guide to the SpatialExtremes Package

arxiv:math/ v1 [math.st] 16 May 2006

Extreme value statistics: from one dimension to many. Lecture 1: one dimension Lecture 2: many dimensions

CRPS M-ESTIMATION FOR MAX-STABLE MODELS WORKING MANUSCRIPT DO NOT DISTRIBUTE. By Robert A. Yuen and Stilian Stoev University of Michigan

Estimation of spatial max-stable models using threshold exceedances

Modelling Multivariate Peaks-over-Thresholds using Generalized Pareto Distributions

Max stable processes: representations, ergodic properties and some statistical applications

Bivariate generalized Pareto distribution

Conditional simulations of max-stable processes

Random Vectors 1. STA442/2101 Fall See last slide for copyright information. 1 / 30

Reliability Theory of Dynamic Loaded Structures (cont.) Calculation of Out-Crossing Frequencies Approximations to the Failure Probability.

Extremogram and ex-periodogram for heavy-tailed time series

Fall 2017 STAT 532 Homework Peter Hoff. 1. Let P be a probability measure on a collection of sets A.

Bivariate Paired Numerical Data

ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process

EEL 5544 Noise in Linear Systems Lecture 30. X (s) = E [ e sx] f X (x)e sx dx. Moments can be found from the Laplace transform as

Gauge Plots. Gauge Plots JAPANESE BEETLE DATA MAXIMUM LIKELIHOOD FOR SPATIALLY CORRELATED DISCRETE DATA JAPANESE BEETLE DATA

Dependence. Practitioner Course: Portfolio Optimization. John Dodson. September 10, Dependence. John Dodson. Outline.

Chapter 5. Chapter 5 sections

Modelling Dependent Credit Risks

. Find E(V ) and var(v ).

The largest eigenvalues of the sample covariance matrix. in the heavy-tail case

Estimating Bivariate Tail: a copula based approach

COMS 4721: Machine Learning for Data Science Lecture 10, 2/21/2017

Stochastic Spectral Approaches to Bayesian Inference

Statistical Physics on Sparse Random Graphs: Mathematical Perspective

A Framework for Daily Spatio-Temporal Stochastic Weather Simulation

Chapter 2. Discrete Distributions

Dependence. MFM Practitioner Module: Risk & Asset Allocation. John Dodson. September 11, Dependence. John Dodson. Outline.

Handbook of Spatial Statistics Chapter 2: Continuous Parameter Stochastic Process Theory by Gneiting and Guttorp

Geostatistics of Extremes

A Note on Hilbertian Elliptically Contoured Distributions

Bayesian spatial quantile regression

Copula modeling for discrete data

Introduction to Machine Learning CMU-10701

Chapter 6: Random Processes 1

ON EXTREME VALUE ANALYSIS OF A SPATIAL PROCESS

Tail empirical process for long memory stochastic volatility models

PROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS

Statistical Methods in Particle Physics

Supermodular ordering of Poisson arrays

On estimating extreme tail. probabilities of the integral of. a stochastic process

Karhunen-Loeve Expansion and Optimal Low-Rank Model for Spatial Processes

Concentration of Measures by Bounded Couplings

Max-stable Processes for Threshold Exceedances in Spatial Extremes

MAS223 Statistical Inference and Modelling Exercises

Multivariate Heavy Tails, Asymptotic Independence and Beyond

Stable Process. 2. Multivariate Stable Distributions. July, 2006

Lect4: Exact Sampling Techniques and MCMC Convergence Analysis

conditional cdf, conditional pdf, total probability theorem?

STAT 992 Paper Review: Sure Independence Screening in Generalized Linear Models with NP-Dimensionality J.Fan and R.Song

Extremogram and Ex-Periodogram for heavy-tailed time series

The Poisson Channel with Side Information

arxiv: v2 [math.pr] 21 Apr 2017

Clustering. Professor Ameet Talwalkar. Professor Ameet Talwalkar CS260 Machine Learning Algorithms March 8, / 26

Probability Space. J. McNames Portland State University ECE 538/638 Stochastic Signals Ver

Communication Theory II

The Multivariate Normal Distribution 1

Threshold estimation in marginal modelling of spatially-dependent non-stationary extremes

1: PROBABILITY REVIEW

Introduction to Normal Distribution

Random Variables and Their Distributions

Neighbourhoods of Randomness and Independence

Multiple Random Variables

Assessing the dependence of high-dimensional time series via sample autocovariances and correlations

n! (k 1)!(n k)! = F (X) U(0, 1). (x, y) = n(n 1) ( F (y) F (x) ) n 2

Ph.D. Qualifying Exam Friday Saturday, January 6 7, 2017

The Multivariate Gaussian Distribution

Lecture 6: Linear models and Gauss-Markov theorem

Conditional simulation of max-stable processes

Marshall-Olkin Bivariate Exponential Distribution: Generalisations and Applications

Joint Probability Distributions and Random Samples (Devore Chapter Five)

Risk Aggregation with Dependence Uncertainty

Fast Direct Methods for Gaussian Processes

ECON 3150/4150, Spring term Lecture 6

Simulation of multivariate distributions with fixed marginals and correlations

Formulas for probability theory and linear models SF2941

Overview of Extreme Value Theory. Dr. Sawsan Hilal space

ELEMENTS OF PROBABILITY THEORY

Gaussian processes for inference in stochastic differential equations

Cheng Soon Ong & Christian Walder. Canberra February June 2018

Discrete solid-on-solid models

A PRACTICAL WAY FOR ESTIMATING TAIL DEPENDENCE FUNCTIONS

Clustering K-means. Clustering images. Machine Learning CSE546 Carlos Guestrin University of Washington. November 4, 2014.

Stochastic Processes. M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno

ESTIMATING BIVARIATE TAIL

E[X n ]= dn dt n M X(t). ). What is the mgf? Solution. Found this the other day in the Kernel matching exercise: 1 M X (t) =

Sequential Monte Carlo Samplers for Applications in High Dimensions

Transcription:

Simulation of Max Stable Processes Whitney Huang Department of Statistics Purdue University November 6, 2013 1 / 30

Outline 1 Max-Stable Processes 2 Unconditional Simulations 3 Conditional Simulations 4 Simulations in R 2 / 30

Max-Stable Processes Definition: Max-stable processes A stochastic process {Y (x)} x X is max-stable if there exist functions {a n (x)} x X > 0 and {b n (x)} x X such that { M n(x) b n (x) d } x X = {Y (x)}x X, n 1 (1) a n (x) where M n (x) = max i=1,,n Y i (x), Y 1,, Y n be the independent copies of Y Remarks: X is a finite set Y is a multivarite extreme value distribution For any fixed x X Y is Generalized Extreme Value distribution (GEV) with parameters {µ(x), σ(x), ξ(x)} 3 / 30

Max-Stable Processes Max-stable Processes Without loss of generality we assume each margin follow unit Fréchet distribution i.e. P(Z z) = exp( 1 z ) z > 0 this can be achieved by applying the monotone transformation Z (x) = [ 1 + ξ(x)(y (x) µ(x)) σ(x) ] 1 ξ(x) x X In such case, a n (x) = n and b n (x) = 0 x X i.e. { n i=1 Z i(x)} x X d = {nz (x)}x X, n 1 4 / 30

Max-Stable Processes Max-stable Processes Without loss of generality we assume each margin follow unit Fréchet distribution i.e. P(Z z) = exp( 1 z ) z > 0 this can be achieved by applying the monotone transformation Z (x) = [ 1 + ξ(x)(y (x) µ(x)) σ(x) ] 1 ξ(x) x X In such case, a n (x) = n and b n (x) = 0 x X i.e. { n i=1 Z i(x)} x X d = {nz (x)}x X, n 1 4 / 30

Max-Stable Processes Max-stable Processes Without loss of generality we assume each margin follow unit Fréchet distribution i.e. P(Z z) = exp( 1 z ) z > 0 this can be achieved by applying the monotone transformation Z (x) = [ 1 + ξ(x)(y (x) µ(x)) σ(x) ] 1 ξ(x) x X In such case, a n (x) = n and b n (x) = 0 x X i.e. { n i=1 Z i(x)} x X d = {nz (x)}x X, n 1 4 / 30

Max-Stable Processes Spectral Representations I Theorem (de Haan, 1984) Let {(ζ i, U i )} i 1 be the points of a Poisson process on (0, ] R d with intensity dλ(ζ, u) = ζ 2 dζν(du), ν a σ-finite measure on R d. Let {Z (x)} x R d be a max-stable process with unit Fréchet margins, then there exist non-negative continuous functions {f x (y) : x, y R d } such that R d f x (y) ν(dy) = 1 x R d, then {Z (x)} x R d d = ζ i f x (U i ) i 1 x R d 5 / 30

Max-Stable Processes Storm Interpretation de Haan s spectral representation has a storm interpretation : {ζ i } i 1 storm ferocities {U i } i 1 storm center ζ i f x (U i ) quantity of rain at x for the i th storm 6 / 30

Max-Stable Processes Storm Interpretation cont d de Haan s spectral representation has a storm interpretation : {ζ i } i 1 storm ferocities {U i } i 1 storm center ζ i f x (U i ) quantity of rain at x for the i th storm 7 / 30

Max-Stable Processes Spectral Representations II Theorem (Schlather, 2002) Let {ζ i } i 1 be the points of Poisson process on (0, ] with intensity dλ(ζ) = ζ 2 dζ and Y 1, Y 2, be independent copies of a non-negative stochastic process {Y (x)} x R d such that E[Y (x)] = 1 x R d. Suppose {ζ i } i 1 independent of Y i s. Then d {Z (x)} x R d = ζ i Y i (x) i 1 x R d is max-stable process with unit Fréchet marginals 8 / 30

Max-Stable Processes Schlather s spectral representation There is no storm" interpretation in Schlather s representation It allows a random shapes for the storms" since {Y (x)} x R d is a stochastic process 9 / 30

Max-Stable Processes Schlather s spectral representation cont d There is no storm" interpretation in Schlather s representation It allows a random shapes for the storms" since {Y (x)} x R d is a stochastic process 10 / 30

Max-Stable Processes Smith Model The first max-stable model in spatial extremes literature was introduced by R. Smith by utilizing de Haan s spectral representation: {Z (x)} x R 2 = max i 1 ζ iφ(x U i ; 0, Σ), x R 2 where φ( ; 0, Σ) is the bivariate normal density with mean 0 and covariance matrix Σ 11 / 30

Max-Stable Processes Schlather Model The second model in spatial extremes literature was due to M. Schlather: {Z (x)} x R 2 = max ζ i 2[Yi (x)] +, x R 2 i 1 where {Y i (x)} x R 2 i is the independent copies of a standard Gaussian Process with correlation function ρ 12 / 30

Unconditional Simulations Recall the spectral representation: Z (x) = max i 1 ζ iy i (x), x X R 2 In order to simulate Z (x) x X we need to simulate Points of Poisson process with intensity ζ 2 dζ on (0, ] Y (x) at some fixed locations We need infinite number of these! 13 / 30

Unconditional Simulations Recall the spectral representation: Z (x) = max i 1 ζ iy i (x), x X R 2 In order to simulate Z (x) x X we need to simulate Points of Poisson process with intensity ζ 2 dζ on (0, ] Y (x) at some fixed locations We need infinite number of these! 13 / 30

Unconditional Simulations Recall the spectral representation: Z (x) = max i 1 ζ iy i (x), x X R 2 In order to simulate Z (x) x X we need to simulate Points of Poisson process with intensity ζ 2 dζ on (0, ] Y (x) at some fixed locations We need infinite number of these! 13 / 30

Unconditional Simulations Recall the spectral representation: Z (x) = max i 1 ζ iy i (x), x X R 2 In order to simulate Z (x) x X we need to simulate Points of Poisson process with intensity ζ 2 dζ on (0, ] Y (x) at some fixed locations We need infinite number of these! 13 / 30

Unconditional Simulations Notice that the points of Poisson process with intensity ζ 2 dζ on (0, ] can be simulated as a strictly decreasing sequence by { } d 1 i.i.d. {ζ i } i 1 = i j=1 E, E i Exp(1) i It implies that if {Y (x)} x X is uniformly bounded by C (0, ) then ζ i Y i (x) will not contribute to Z (x) for i i 0 we only need to simulate i 0 (finite number) of these! i 1 14 / 30

Unconditional Simulations 15 / 30

Unconditional Simulations 16 / 30

Unconditional Simulations 17 / 30

Unconditional Simulations 18 / 30

Conditional Simulations Goal: Given {Z (x 1 ) = z 1,, Z (x n ) = z n } want to get the (regular) conditional distribution of Z (x) x X It plays an important role for interpolating the spatial extremal surface If {Z (x)} x X is a Gaussian process, then the conditional simulation can be thought as the interpolation of spatial mean surface Other than Gaussian process, the conditional distribution is difficult 19 / 30

Conditional Simulations Max-Linear Approximation for Max-Stable Processes Approximate {Z (x)} x X with a Max-Linear models {Z (x)} x X p a i,j Z j := A Z Z j i.i.d. α-fréchet, a i,j deterministic (known) such that a i,j 0 j=1 Max-Linear models approximate arbitrary max-stable processes with p sufficiently large 20 / 30

Conditional Simulations Conditional sampling for Max-Linear models Wang & Stoev, 2011 derive the explicit formula of conditional distribution for max-linear models The structure of max-linear models imposes some constraints, namely z i Z j min i=1,,n a i,j := ẑ j, inequality constraints Z J = ẑ J for some J {1,, p}, hitting constraints 21 / 30

Conditional Simulations A Toy Example on Max-Linear models Suppose n = p = 3 and z 1 = Z 1 i.e. z 2 = Z 1 Z2 z 3 = Z 1 Z2 Z3 A = 1 0 0 1 1 0 1 1 1 22 / 30

Conditional Simulations A Toy Example cont d (i) If z = (z 1, z 2, z 3 ) T = (1, 2, 3) T Z = (1, 2, 3) T The hitting constraints hold for Z 1, Z 2, and Z 3, hence J = (1, 2, 3), (ii) If z = (z 1, z 2, z 3 ) T = (1, 1, 3) T Z = (Z 1 = 1, Z 2 1, Z 3 = 3) T The hitting constraints hold for Z 1, Z 3, while the inequality constraint hold for Z 2 i.e. 0 < Z 2 1, hence J = (1, 3) 23 / 30

Conditional Simulations Algorithm 1 Compute ẑ j, j = 1,, p 2 Determine all hitting scenarios J, and the distribution of Z J for each hitting scenarios 3 Sample the conditional distribution from the mixture distribution of each hitting scenarios Remarks: To identify all hitting scenarios is NP-hard By the max-linear structure, with probability 1, the hitting scenarios has a nice structure which leads to an efficient algorithm 24 / 30

Simulations in R Package SpatialExtremes SpatialExtremes is a R package written by M. Ribatet Statistical models for spatial extremes based on latent variables, on copulas and on max-stable processes are implemented It also provides unconditional/conditional simulations on max-stable processes 25 / 30

Simulations in R rmaxstab: Unconditional simulations on max-stable processes (a) Smith Model (b) Schlather Model 26 / 30

Z Z Simulations in R x y x y 27 / 30

Simulations in R condrmaxlin: Conditional sampling for Max-Linear models Figure: Four conditional simulations for Smith model, p = 10000. 28 / 30

Simulations in R 29 / 30

References de Haan, L. A spectral representation for max-stable processes The Annals of Probability, 1194 1204, 1984 Schlather, M. Models for stationary max-stable random fields Extremes, 5(1), 33:44, 2002 Smith, R. L. Max-stable processes and spatial extremes Unpublished manuscript, 1990 Wang, Y. & Stoev, S. A. Conditional sampling for spectrally discrete max-stable random fields Adv. Appl. Prob., 43, 461 483, 2011 30 / 30