Spatial smoothing using Gaussian processes

Transcription

1 Spatial smoothing using Gaussian processes Chris Paciorek August 5,

2 OUTLINE Spatial smoothing and Gaussian processes Covariance modelling Nonstationary covariance modelling Eamples with simulated and real data 2

3 SPATIAL DATA latgridvals longridvals Colorado annual precipitation monthly PM

4 SPATIAL DATA AND MODELS Features of spatial data highly interactive, comple surfaces high df:n; heterogeneous coverage possible nonstationarity spatial model is often a component of a larger model spatiotemporal model with covariates possibly replicated Some standard models Thin-plate splines Basis function models with penalized coefficients Gaussian processes (kriging or Bayesian) 4

5 GAUSSIAN PROCESS DISTRIBUTION Infinite-dimensional joint distribution for f(), X : Eample: f( ) a spatial process, X = R 2 f( ) GP(µ( ), C(, )) Finite-dimensional marginals are normal Types of covariance functions, C(f( i ), f( j )): stationary, isotropic stationary, anisotropic nonstationary X j j i i 5

6 GAUSSIAN PROCESS DISTRIBUTION Infinite-dimensional joint distribution for f(), X : Eample: f( ) a spatial process, X = R 2 f( ) GP(µ( ), C(, )) Finite-dimensional marginals are normal Types of covariance functions, C(f( i ), f( j )): stationary, isotropic stationary, anisotropic nonstationary X j j i i 6

7 GAUSSIAN PROCESS DISTRIBUTION Infinite-dimensional joint distribution for f(), X : Eample: f( ) a spatial process, X = R 2 f( ) GP(µ( ), C(, )) Finite-dimensional marginals are normal Types of covariance functions, C(f( i ), f( j )): stationary, isotropic stationary, anisotropic nonstationary X j j i i 7

8 CORRELATION MODELLING R(f( i ), f( j )) = R ( ) τij 2 τ 2 ij = ( i j ) T ( i j ) ρ 2 Correlation ρ = 0.2 ρ = Distance Correlation scale Nonstationarity: correlation a function of location

9 NONSTATIONARY COVARIANCE spatial deformation (Sampson, Guttorp & co-workers) mitures of Gaussian processes (Fuentes) or splines (Wood et al.) kernel convolution method (Higdon, Swall, and Kern) R NS (f( i ), f( j )) = c ij R P k i (u)k j (u)du Guaranteed positive definite Gaussian kernels: ( ) k i (u) ep (u i ) T Σ 1 i (u i ) R NS (f( i ), f( j )) = c ij ep f( ) GP(µ, σ 2 R NS (, )) ( ( i j ) T ( Σi +Σ j 2 ) 1 (i j ) 9

10 NONSTATIONARY GPS IN 2D Kernel Structure Sample Function y z y

11 GENERALIZING THE HSK KERNEL METHOD Squared eponential form: ( ( ) ) 2 τij ep c ρ ij ep ( ( ) 1 ( i j ) T Σi +Σ j (i 2 j )) Theorem 1: if R(τ ) is positive definite for R P, P = 1, 2,..., then R NS (f( i ), f( j )) = c ij R ( Q ij ) is positive definite for R P, P = 1, 2,... Theorem 2: Smoothness properties of original stationary correlation retained Specific case of Matérn nonstationary covariance ( ) ν ( ) 1 2 ντij 2 2 ντij K 2 Γ(ν)2 ν 1 ρ ν ρ 1 Γ(ν)2 ν 1 ( 2 νqij ) ν Kν ( 2 νqij ) More fleible form, differentiability not constrained, possible asymptotic advantages 11

12 A BASIC BAYESIAN SPATIAL MODEL Model: Y i N(f( i ), η 2 ), i R 2 f( ) GP(µ, σ 2 R NS (, ; ν, Σ ( ) )) Let R NS be the nonstationary Matérn correlation Kernels (Σ ) constructed based on stationary GP priors Define multiple kernel matrices, Σ, X Smoothly-varying (element-wise) in covariate space Positive definite MCMC sampling of all parameters including those determining Σ ( ) 12

13 1 EMPIRICAL ASSESSMENT - SIMULATED FUNCTIONS z z krige tps GAM sgp nsgp fks nn test MSE krige tps GAM sgp nsgp fks nn test MSE

14 COLORADO PRECIPITATION CHARACTERIZATION

15 COLORADO PRECIPITATION SURFACES stationary form nonstationary form

16 EMPIRICAL ASSESSMENT - COLORADO PRECIPITATION krige krige2 GAM GAM2 sgp nsgp fks nn test MSE Comments surface is comple relative to number of obs; high df:n ratio bias-variance tradeoff simple two-region nonstationary models offer little improvement 16

17 FUTURE WORK Further implementation of nonstationary model: Approaches for constraining hyperparameters for better fits and miing Computationally tractable approaches for multiple realizations Ad hoc approaches for fitting the nonstationary covariance structure criteria for choosing a spatial smoother based on data spacing, df:n, signal to noise ratio Fourier basis representation for spatial processes for fast Bayesian estimation with non-normal data or complicated models 17

18 NONSTATIONARY GPS IN 1D Kernel standard deviation y Some sample functions y Some kernels y y

19 SMOOTHLY-VARYING KERNEL MATRICES Spectral decomposition (R P ): Σ = Γ T Λ Γ in R 2, stationary GP priors on unnormalized eigenvector coordinates (a, b ) and on logarithm of second eigenvalue (λ,2 ) efficient parameterizations of Φ( ) {a( ), b( ), λ 2 ( )} using basis function approimation to a stationary GP a, b λ 2 λ 1 19

20 DEGREE OF SMOOTHING ρ = 0.2 ρ = 0.04 y y y y