Spatial smoothing over complex domain

Similar documents
Multivariate Gaussian Random Fields with SPDEs

Spatial Statistics with Image Analysis. Outline. A Statistical Approach. Johan Lindström 1. Lund October 6, 2016

Spatial Statistics with Image Analysis. Lecture L08. Computer exercise 3. Lecture 8. Johan Lindström. November 25, 2016

Data are collected along transect lines, with dense data along. Spatial modelling using GMRFs. 200m. Today? Spatial modelling using GMRFs

Spatial smoothing using Gaussian processes

Hierarchical Modeling for Univariate Spatial Data

Fast approximations for the Expected Value of Partial Perfect Information using R-INLA

arxiv: v4 [stat.me] 14 Sep 2015

Multi-resolution models for large data sets

Hierarchical Modelling for Univariate Spatial Data

Spatial Statistics with Image Analysis. Lecture L02. Computer exercise 0 Daily Temperature. Lecture 2. Johan Lindström.

Latent Gaussian Processes and Stochastic Partial Differential Equations

Hierarchical Nearest-Neighbor Gaussian Process Models for Large Geo-statistical Datasets

Computer model calibration with large non-stationary spatial outputs: application to the calibration of a climate model

The Bayesian approach to inverse problems

Fast algorithms that utilise the sparsity of Q exist (c-package ( Q 1. GMRFlib) Seattle February 3, 2009

State Space Representation of Gaussian Processes

Spatial point processes in the modern world an

Handbook of Spatial Statistics Chapter 2: Continuous Parameter Stochastic Process Theory by Gneiting and Guttorp

Point-Referenced Data Models

Hierarchical Modeling for Spatio-temporal Data

Hierarchical Modelling for Univariate Spatial Data

Bayesian computation using INLA. 5: Spatial Markovian models The SPDE approach

Probabilistic Graphical Models

Basics of Point-Referenced Data Models

Markov random fields. The Markov property

A multi-resolution Gaussian process model for the analysis of large spatial data sets.

CBMS Lecture 1. Alan E. Gelfand Duke University

Computation fundamentals of discrete GMRF representations of continuous domain spatial models

Gaussian Random Fields: Geometric Properties and Extremes

STAT 518 Intro Student Presentation

Gaussian Processes (10/16/13)

Hierarchical Modelling for Multivariate Spatial Data

Markov Random Fields

Hierarchical Modeling for Multivariate Spatial Data

Douglas Nychka, Soutir Bandyopadhyay, Dorit Hammerling, Finn Lindgren, and Stephan Sain. October 10, 2012

Bayesian inference & process convolution models Dave Higdon, Statistical Sciences Group, LANL

Monte Carlo simulation inspired by computational optimization. Colin Fox Al Parker, John Bardsley MCQMC Feb 2012, Sydney

Sliced Inverse Regression

A spatio-temporal model for extreme precipitation simulated by a climate model

Models for spatial data (cont d) Types of spatial data. Types of spatial data (cont d) Hierarchical models for spatial data

Introduction to Geostatistics

An explicit link between Gaussian fields and Gaussian Markov random fields: the stochastic partial differential equation approach

Spatio-temporal prediction of site index based on forest inventories and climate change scenarios

8.1 Concentration inequality for Gaussian random matrix (cont d)

INLA for Spatial Statistics

Modelling Non-linear and Non-stationary Time Series

Multivariate modelling and efficient estimation of Gaussian random fields with application to roller data

6. The econometrics of Financial Markets: Empirical Analysis of Financial Time Series. MA6622, Ernesto Mordecki, CityU, HK, 2006.

R-INLA. Sam Clifford Su-Yun Kang Jeff Hsieh. 30 August Bayesian Research and Analysis Group 1 / 14

A short introduction to INLA and R-INLA

EE226a - Summary of Lecture 13 and 14 Kalman Filter: Convergence

Gaussian Process Regression

Gaussian Processes 1. Schedule

Introduction to Functional Data Analysis A CSCU Workshop. Giles Hooker Biological Statistics and Computational Biology

A Framework for Daily Spatio-Temporal Stochastic Weather Simulation

NORGES TEKNISK-NATURVITENSKAPELIGE UNIVERSITET

A new covariance function for spatio-temporal data analysis with application to atmospheric pollution and sensor networking

Statistics for analyzing and modeling precipitation isotope ratios in IsoMAP

Covariance Matrix Simplification For Efficient Uncertainty Management

Reduction of Model Complexity and the Treatment of Discrete Inputs in Computer Model Emulation

Non-gaussian spatiotemporal modeling

STAT 200C: High-dimensional Statistics

Efficient spatial modelling using the SPDE approach with bivariate splines

Nearest Neighbor Gaussian Processes for Large Spatial Data

scrna-seq Differential expression analysis methods Olga Dethlefsen NBIS, National Bioinformatics Infrastructure Sweden October 2017

Gaussian with mean ( µ ) and standard deviation ( σ)

A Multi-resolution Gaussian process model for the analysis of large spatial data sets.

An EM algorithm for Gaussian Markov Random Fields

Spatial Lasso with Application to GIS Model Selection. F. Jay Breidt Colorado State University

Gaussian Markov Random Fields: Theory and Applications

Laplacian Eigenmaps for Dimensionality Reduction and Data Representation

A Process over all Stationary Covariance Kernels

GRAPH SIGNAL PROCESSING: A STATISTICAL VIEWPOINT

Gaussian predictive process models for large spatial data sets.

Nonstationary spatial process modeling Part II Paul D. Sampson --- Catherine Calder Univ of Washington --- Ohio State University

Introduction to Design and Analysis of Computer Experiments

Hierarchical Matérn fields and Cauchy difference priors for Bayesian inversion

Regression, Ridge Regression, Lasso

9 Multi-Model State Estimation

A Divide-and-Conquer Bayesian Approach to Large-Scale Kriging

Bayesian Hierarchical Models

Chapter 4 - Fundamentals of spatial processes Lecture notes

Motivation Sparse Signal Recovery is an interesting area with many potential applications. Methods developed for solving sparse signal recovery proble

Bayesian SAE using Complex Survey Data Lecture 4A: Hierarchical Spatial Bayes Modeling

Nonparametric Bayesian Methods - Lecture I

NORGES TEKNISK-NATURVITENSKAPELIGE UNIVERSITET. Directional Metropolis Hastings updates for posteriors with nonlinear likelihoods

Compressed Sensing Using Bernoulli Measurement Matrices

Face Recognition Using Laplacianfaces He et al. (IEEE Trans PAMI, 2005) presented by Hassan A. Kingravi

Learning Graphs from Data: A Signal Representation Perspective

Cross-covariance Functions for Tangent Vector Fields on the Sphere

Missing Data Issues in the Studies of Neurodegenerative Disorders: the Methodology

spbayes: An R Package for Univariate and Multivariate Hierarchical Point-referenced Spatial Models

Lecture 9 Point Processes

Bayesian Methods for Machine Learning

Models for models. Douglas Nychka Geophysical Statistics Project National Center for Atmospheric Research

Rice method for the maximum of Gaussian fields

STA 4273H: Sta-s-cal Machine Learning

ISSN Article. Simulation Study of Direct Causality Measures in Multivariate Time Series

Spatial Smoothing in Stan: Conditional Auto-Regressive Models

Transcription:

Spatial smoothing over complex domain Alessandro Ottavi NTNU Department of Mathematical Science August 16-20 2010

Outline Spatial smoothing Complex domain The SPDE approch Manifold Some tests

Spatial smoothing Outline Spatial smoothing Complex domain The SPDE approch Manifold Some tests

Spatial smoothing What is smoothing To smooth a data set is to create an approximating function that attempts to capture important patterns in the data, while leaving out noise. This technique is used in many different field as geology biology insurance medicine...

Spatial smoothing Standard approach: Gaussian Field A standard approach is trough Gaussian Field. We say that x(s) s D R 2 is a Gaussian Field (GF) if all finite collection x(s i ) are jointly Gaussian. A GF is usually specify trough: a mean function µ(.) that lead to a mean vector µ(s i ) a covariance function C(.,.) that lead to a covariance matrix Σ = C(s i, s j )

Spatial smoothing Advantages: Intuitive approach Easy to use in many cases Easy to parametrize Problems: Can be computationally heavy Not good results when far away from standard cases (for example when the shape of the domain is important)

Complex domain Outline Spatial smoothing Complex domain The SPDE approch Manifold Some tests

Complex domain Complex domain and boundaries Spatial smoothing methods often assume the region of interest is R 2 but we can be in different situations: We might have a river, lake or a mountain, which, at least physically, prevents smoothing over the river, lake or mountain. In other cases topological caracteristics of the domain may play an important role and is important to introduce this aspects in the model.

Spatial smoothing over complex domain Complex domain Figure: example of a complex domain Fig 1 Distribution of flower and non-flowering S. leprosula in the alluvial (blue) and mudstone (brown) forest Fig 2 as above for S. johorensis Fig 3 as above for P tomentella Fig 4 as above for S. xanthophylla 2007 In the figure on the left there is an example where introducing information about the domain can improve the quality of the smoothing procedure: is showed the distribution of flowering and non flowering for three different spices of flowers over 2 different possible regions: alluvial and mud stone areas.

Complex domain In the figure on the right there is another possible example of complex domain, when there is the necessity to smooth for example over see region strictly connected over earth region and when is not feasible to do that then... may be. Figure: Cost of Norway

Complex domain Proposed methodology Non isotropic/ non stationary Gaussian Fields can be used to mimic the presence of complex boundaries; the strategy is to consider the distance between two points as length of the minimum arc not crossing the constrain. More recently Simon Wood (2008) 1 proposed a method based on spline able to be incorporated in GAM or mixed models. 1 Wood, S. N., Bravington, M. V. and Hedley, S. L. (2008), Soap film smoothing. Journal of the Royal Statistical Society

The SPDE approach Outline Spatial smoothing Complex domain The SPDE approch Manifold Some tests

3.5" Spatial smoothing over complex domain The SPDE approach We want to use the relation between Gaussian Field, SPDE Gaussian Markov Random Field and 2. 9 2 " 2.92" Stochastic Differential Equation GF GMRF in order to include in our (Bayesian) models information about the physical constrain.

The SPDE approach Gaussian Markov Random Field A Gaussian Markov Random Field is a Gaussian field x(s i ) s i D R 2 where the full conditionals only depends on a set of neighbors: π(x i x i ) = π(x i x δi ) With the property that the precision matrix is sparse due to: Q ij 0 i δ j A GMRF is discretized version of GF over a set of location s i where Q 1 = Σ.

The SPDE approach Second order differential equation We define a second order partial differential equation: Where: (κ 2 )x(s) = ɛ(s) s D (1) κ : is a range parameter, : is the Laplacian operator, in R 2 it results as ɛ : is a White Noise on D D : is a smooth surface f = 2 f x 2 + 2 f y 2

The SPDE approach SPDE and GF Is possible to prove that: The solution x(s) of the differential equation is Gaussian Whittle in 1963 2 prove that if D = R 2 the solution is a Gaussian field with Matérn covariance function given by: r(h) σ 2 (κh) 3 K 3 (κh) where K is a Bessel function of second order and the relation between the parameter κ and the effective range ρ in the corresponding GF is given by ρ = 24/κ 2 Whittle P., Stochastic processes in several dimensions, Statistics in Physical Sciences 1963

The SPDE approach SPDE and GMRF Is it possible to obtain the precision matrix Q for the process x i directly from the solution of the SPDE. Proceed to a triangularization of the region Express the SPDE in weak formulation < φ, ( + χ 2 )x >=< φ, ɛ > Approximate x i as a combination of basic functions ˆx = n φ i w i i=1 Find the precision matrix of x i

Manifold Outline Spatial smoothing Complex domain The SPDE approch Manifold Some tests

z z Spatial smoothing over complex domain Manifold What is a Manifold? A manifold is a space D that behaves locally as R d. Property: D is locally planar. 8 6 4 2 10 Y 0 2 10 5 5 0 Y X X 0 5 5 10 10

Some tests Outline Spatial smoothing Complex domain The SPDE approch Manifold Some tests

Some tests Correlation around an obstacle Correlation around lake, alpha=2, chi=0.2 Correlation around lake, alpha=2, chi=0.2 Correlation around lake, alpha=2, chi=0.2 Correlation around lake, alpha=2, chi=0.2

Some tests correlation 0.4 0.6 0.8 1.0 The correlation function across the obstacle (dots line) decrease much faster then the correlation away from the obstacle (continuous line). 0 2 4 6 8 10 distance

Some tests Correlation across obstacle and bottleneck

Some tests

Some tests Correlation across bottleneck Correlation trough tunnel, alpha=2, chi=0.2 Correlation trough tunnel, alpha=2, chi=0.2 Correlation trough tunnel, alpha=2, chi=0.2 Correlation trough tunnel, alpha=2, chi=0.2

Some tests Last example