A Complete Spatial Downscaler

Size: px
Start display at page:

Download "A Complete Spatial Downscaler"

Transcription

1 A Complete Spatial Downscaler Yen-Ning Huang, Brian J Reich, Montserrat Fuentes 1 Sankar Arumugam 2 1 Department of Statistics, NC State University 2 Department of Civil, Construction, and Environmental Engineering, NC State University April 28 th, 2016 A Complete Spatial Downscaler 1 / 30

2 Outline Introduction Complete spatial downscaler Marginal distributions Spatial correlation Calibration Application A Complete Spatial Downscaler 2 / 30

3 Introduction Computer models are essential for environmental science to evaluate climate/emission scenarios and make predictions where data are not available. Calibration Evaluation of the performance of physical models is needed to obtain reliable forecasts Model calibration is challenging when the process of interest is dynamic across space and time Reproducing the spatial behavior of the physical process of interest is important Downscaler Combine disparate spatial data sources to improve the spatial prediction A Complete Spatial Downscaler 3 / 30

4 Challenges Comparing monitor data and computer output is difficult because they often measure different spatial scales Computer models notoriously struggle to explain extreme behaviour Models run at coarse scales have trouble capturing local phenomenon, as thus may have different spatial correlation from monitor data A Complete Spatial Downscaler 4 / 30

5 Data sources Our motivating example is a study of summer temperatures in the US. Climate model output: a 30-year Hindcast model of monthly average temperature in summer (Jun-Aug) from 1981 to 2010 Monitor data: monthly average temperature in summer from 1950 to 1999 (interpolated to the same grid points as model output) Our goal is not to match data sources for individual months, but rather to match their distributions. A Complete Spatial Downscaler 5 / 30

6 Monitor observations (top) and model output (bottom) means A Complete Spatial Downscaler 6 / 30

7 Monitor observations (top) and model output (bottom) standard deviations A Complete Spatial Downscaler 7 / 30

8 Variograms for monitor observations and model outputs Semi variogram Monitor observations Model outputs Distance (km) A Complete Spatial Downscaler 8 / 30

9 Complete spatial downscaler We propose a Bayesian approach to adjust for biases of the marginal distribution as well as the spatial correlation of computer model outputs Our approach has the following three components: (1) Model the spatially varying and potentially non-gaussian marginal distributions of the model outputs and monitor data (2) Model the spatial covariance of both data sources (3) Perform calibration to rectify differences between the two data sources These three components are implemented simultaneously using Bayesian hierarchical modeling A Complete Spatial Downscaler 9 / 30

10 Marginal distributions X t (s): computer model output Y t (s): monitor observations Let Fs(x) and Gs(y) be the CDF of X t (s) and Y t (s), respectively We can transform both processes to standard normal distribution: Z Xt (s) = Φ 1 {Fs[X t (s)]} and Z Yt (s) = Φ 1 {Gs[Y t (s)]} Similarly, X t (s) = Fs 1 Xt(s)]} and Y t (s) = Gs 1 Yt(s)]} A Complete Spatial Downscaler 10 / 30

11 Assuming normality When both processes and are Gaussian, X t (s) = µ X (s)+σ X (s)z Xt (s) and Y t (s) = µ Y (s)+σ Y (s)z Yt (s) where µ X (s) and σ X (s) > 0 are spatially-varying mean and standard deviation of X t (s) µ Y (s) and σ Y (s) > 0 are spatially-varying mean and standard deviation of Y t (s) A Complete Spatial Downscaler 11 / 30

12 Normal Q-Q plots for monitor observations ( 111.5, 31.5) ( 82.5, 32.5) ( 120.5, 40.5) ( 103.5, 46.5) A Complete Spatial Downscaler 12 / 30

13 Normal Q-Q plots for model outputs ( 111.5, 31.5) ( 82.5, 32.5) ( 120.5, 40.5) ( 103.5, 46.5) A Complete Spatial Downscaler 13 / 30

14 Skew-t model The Gaussian model fails to fit the tails For a richer class of marginal distributions we also consider the spatial skew-t process (Jones and Faddy 2003; Azzalini and Capitanio 2003): X t (s) = µ X (s) + ξ X r Xt + σ Xt σ X (s)z Xt (s) (1) indep where r Xt N(0, σ 2 Xt ), σ2 Xt iid InvGamma(νX /2, ν X /2) In this setting the marginal distribution of X t (s) follow skew-t distribution with parameters {µ X (s), σ X (s), ν X, ξ X } A skew-t model also permits asymptotic spatial dependence A Complete Spatial Downscaler 14 / 30

15 Skew t Q-Q plots for monitor observations ( 111.5, 31.5) ( 82.5, 32.5) ( 120.5, 40.5) ( 103.5, 46.5) A Complete Spatial Downscaler 15 / 30

16 Skew t Q-Q plots for model outputs ( 111.5, 31.5) ( 82.5, 32.5) ( 120.5, 40.5) ( 103.5, 46.5) A Complete Spatial Downscaler 16 / 30

17 Spatial correlation Assume Z Xt (s) and Z Yt (s) have mean zero and variance one Expand the two processes using Karhunen-Loéve decomposition: Z Xt (s) = L φ l (s)x tl and Z Yt (s) = l=1 L φ l (s)y tl (2) l=1 where φ l (s) are orthonormal functions x tl and y tl are pairwise independence with mean zero and Var(x tl ) = f l and Var(y tl ) = g l A Complete Spatial Downscaler 17 / 30

18 Spatial covariance The covariance functions can be written as: Cov[Z Xt (s i ), Z Xt (s j )] = L φ l (s i )φ l (s j )f l l=1 L Cov[Z Yt (s i ), Z Yt (s j )] = φ l (s i )φ l (s j )g l In particular, the basis functions we consider in data analysis are { cos(s φ l (s) = ω l/2 ) l is even sin(s ω l/2 ) l is odd. where ω = (ω 1,..., ω n ) is the set of Fourier frequencies l=1 A Complete Spatial Downscaler 18 / 30

19 Matérn spectral density function For the covariances f l and g l we consider the spectral density of Matérn covariance on lattice (Guinness et al. 2014): f l (ω) = f l (ω 1, ω 2 ) = σ 2 f ( 1 + ( α f ) ( ( 2 δ sin 2 δω 1 2 ) ( ))) + sin 2 νf +1 δω 2 2 evaluated over the set of Fourier frequencies ω A Complete Spatial Downscaler 19 / 30

20 Calibration Conditional on the parameters in the marginal distributions Fs and Gs, the covariances f and g, and the latent x tl and y tl, the standardized computer model output is calibrated as Z Xt (s) = L w l φ l (s)x tl l=1 w l = g l /f l is the ratio of spectral densities which is used to calibrate the spatial correlation of the model output The covariance of Z Xt (s) matches with Z Yt (s) since Cov[ Z Xt (s i ), Z Xt (s j )] = L l=1 w 2 l φ l(s i )φ l (s j )f l = Cov[Z Yt (s i ), Z Yt (s j )] A Complete Spatial Downscaler 20 / 30

21 Calibration The calibrated computer model output X t (s) = G 1 s {Φ[ Z Xt (s)]} has Y t (s) s marginal distribution and spatial correlation If both data sources follow skew-t distribution, then the calibrated computer model output is X t (s) = µ Y (s) + ξ Y r Yt + σ Yt σ Y (s) L w l φ l (s)x tl (3) l=1 A Complete Spatial Downscaler 21 / 30

22 Calibration for skew-t model If skew-t assumption is appropriate, then we can have X t N(µ X + ξ X r Xt, σ 2 Xt (ΦF Φ + τ 2 X I n)) and Y t N(µ Y + ξ Y r Yt, σ 2 Yt (ΦGΦ + τ 2 Y I n)) where r Xt N(0, σ 2 Xt ) and σ2 Xt InvGamma( ν X 2, ν X 2 ). Each MCMC iteration gives a sample for all model parameters (µ X, σ 2 X, etc), as well as random effects x tl This gives a posterior predictive distribution of X t (s) in (3) A Complete Spatial Downscaler 22 / 30

23 Monitor observations (top) and calibrated model output (bottom) means A Complete Spatial Downscaler 23 / 30

24 Monitor observations (top) and calibrated model output (bottom) standard deviations A Complete Spatial Downscaler 24 / 30

25 Calibrated quantiles (skew t) ( 111.5, 31.5) ( 82.5, 32.5) Monitor observations Model outputs Calibrated model outputs probs probs ( 120.5, 40.5) probs ( 103.5, 46.5) probs A Complete Spatial Downscaler 25 / 30

26 Calibrated variograms (skew t) Semi variogram Monitor observations Model outputs Calibrated model outputs Distance (km) A Complete Spatial Downscaler 26 / 30

27 Representative Concentration Pathways (RCPs) The RCPs are greenhouse gas concentration trajectories adopted by the IPCC in 2014 for climate modeling and research Depending on how much greenhouse gases are emitted in the years to come, RCPs can be used to describe different possible future climates. We apply our downscaler to summer monthly temperature data from RCP8.5 ( ) A Complete Spatial Downscaler 27 / 30

28 Future RCP8.5 means before and after calibration A Complete Spatial Downscaler 28 / 30

29 Acknowledgment This work was supported by grants DOI ( ), NIH (R21ES A1, 5R01ES ), and NSF (DMS ). A Complete Spatial Downscaler 29 / 30

30 Thank you! For comments or questions, please contact me at A Complete Spatial Downscaler 30 / 30

Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes

Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes Andrew O. Finley 1 and Sudipto Banerjee 2 1 Department of Forestry & Department of Geography, Michigan

More information

Bayesian spatial quantile regression

Bayesian spatial quantile regression Brian J. Reich and Montserrat Fuentes North Carolina State University and David B. Dunson Duke University E-mail:reich@stat.ncsu.edu Tropospheric ozone Tropospheric ozone has been linked with several adverse

More information

Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes

Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes Sudipto Banerjee 1 and Andrew O. Finley 2 1 Biostatistics, School of Public Health, University of Minnesota,

More information

Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes

Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes Andrew O. Finley Department of Forestry & Department of Geography, Michigan State University, Lansing

More information

Downscaled Climate Change Projection for the Department of Energy s Savannah River Site

Downscaled Climate Change Projection for the Department of Energy s Savannah River Site Downscaled Climate Change Projection for the Department of Energy s Savannah River Site Carolinas Climate Resilience Conference Charlotte, North Carolina: April 29 th, 2014 David Werth Atmospheric Technologies

More information

Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes

Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes Alan Gelfand 1 and Andrew O. Finley 2 1 Department of Statistical Science, Duke University, Durham, North

More information

Bruno Sansó. Department of Applied Mathematics and Statistics University of California Santa Cruz bruno

Bruno Sansó. Department of Applied Mathematics and Statistics University of California Santa Cruz   bruno Bruno Sansó Department of Applied Mathematics and Statistics University of California Santa Cruz http://www.ams.ucsc.edu/ bruno Climate Models Climate Models use the equations of motion to simulate changes

More information

Gaussian Multiscale Spatio-temporal Models for Areal Data

Gaussian Multiscale Spatio-temporal Models for Areal Data Gaussian Multiscale Spatio-temporal Models for Areal Data (University of Missouri) Scott H. Holan (University of Missouri) Adelmo I. Bertolde (UFES) Outline Motivation Multiscale factorization The multiscale

More information

Karhunen-Loeve Expansion and Optimal Low-Rank Model for Spatial Processes

Karhunen-Loeve Expansion and Optimal Low-Rank Model for Spatial Processes TTU, October 26, 2012 p. 1/3 Karhunen-Loeve Expansion and Optimal Low-Rank Model for Spatial Processes Hao Zhang Department of Statistics Department of Forestry and Natural Resources Purdue University

More information

Climate Change: the Uncertainty of Certainty

Climate Change: the Uncertainty of Certainty Climate Change: the Uncertainty of Certainty Reinhard Furrer, UZH JSS, Geneva Oct. 30, 2009 Collaboration with: Stephan Sain - NCAR Reto Knutti - ETHZ Claudia Tebaldi - Climate Central Ryan Ford, Doug

More information

Gaussian processes for spatial modelling in environmental health: parameterizing for flexibility vs. computational efficiency

Gaussian processes for spatial modelling in environmental health: parameterizing for flexibility vs. computational efficiency Gaussian processes for spatial modelling in environmental health: parameterizing for flexibility vs. computational efficiency Chris Paciorek March 11, 2005 Department of Biostatistics Harvard School of

More information

Spatial Statistics with Image Analysis. Lecture L08. Computer exercise 3. Lecture 8. Johan Lindström. November 25, 2016

Spatial Statistics with Image Analysis. Lecture L08. Computer exercise 3. Lecture 8. Johan Lindström. November 25, 2016 C3 Repetition Creating Q Spectral Non-grid Spatial Statistics with Image Analysis Lecture 8 Johan Lindström November 25, 216 Johan Lindström - johanl@maths.lth.se FMSN2/MASM25L8 1/39 Lecture L8 C3 Repetition

More information

Spatial smoothing using Gaussian processes

Spatial smoothing using Gaussian processes Spatial smoothing using Gaussian processes Chris Paciorek paciorek@hsph.harvard.edu August 5, 2004 1 OUTLINE Spatial smoothing and Gaussian processes Covariance modelling Nonstationary covariance modelling

More information

Karhunen-Loève decomposition of Gaussian measures on Banach spaces

Karhunen-Loève decomposition of Gaussian measures on Banach spaces Karhunen-Loève decomposition of Gaussian measures on Banach spaces Jean-Charles Croix jean-charles.croix@emse.fr Génie Mathématique et Industriel (GMI) First workshop on Gaussian processes at Saint-Etienne

More information

BAYESIAN PROCESSOR OF ENSEMBLE (BPE): PRIOR DISTRIBUTION FUNCTION

BAYESIAN PROCESSOR OF ENSEMBLE (BPE): PRIOR DISTRIBUTION FUNCTION BAYESIAN PROCESSOR OF ENSEMBLE (BPE): PRIOR DISTRIBUTION FUNCTION Parametric Models and Estimation Procedures Tested on Temperature Data By Roman Krzysztofowicz and Nah Youn Lee University of Virginia

More information

Climate Projections and Energy Security

Climate Projections and Energy Security NOAA Research Earth System Research Laboratory Physical Sciences Division Climate Projections and Energy Security Andy Hoell and Jim Wilczak Research Meteorologists, Physical Sciences Division 7 June 2016

More information

A weather generator for simulating multivariate climatic series

A weather generator for simulating multivariate climatic series A weather generator for simulating multivariate climatic series Denis Allard, with Nadine Brisson (AgroClim, INRA), Cédric Flecher (MetNext) and Philippe Naveau (LSCE, CNRS) Biostatistics and Spatial Processes

More information

Chapter 4 - Fundamentals of spatial processes Lecture notes

Chapter 4 - Fundamentals of spatial processes Lecture notes TK4150 - Intro 1 Chapter 4 - Fundamentals of spatial processes Lecture notes Odd Kolbjørnsen and Geir Storvik January 30, 2017 STK4150 - Intro 2 Spatial processes Typically correlation between nearby sites

More information

A spatio-temporal model for extreme precipitation simulated by a climate model

A spatio-temporal model for extreme precipitation simulated by a climate model A spatio-temporal model for extreme precipitation simulated by a climate model Jonathan Jalbert Postdoctoral fellow at McGill University, Montréal Anne-Catherine Favre, Claude Bélisle and Jean-François

More information

Bayesian hierarchical modelling for data assimilation of past observations and numerical model forecasts

Bayesian hierarchical modelling for data assimilation of past observations and numerical model forecasts Bayesian hierarchical modelling for data assimilation of past observations and numerical model forecasts Stan Yip Exeter Climate Systems, University of Exeter c.y.yip@ex.ac.uk Joint work with Sujit Sahu

More information

Bayesian linear regression

Bayesian linear regression Bayesian linear regression Linear regression is the basis of most statistical modeling. The model is Y i = X T i β + ε i, where Y i is the continuous response X i = (X i1,..., X ip ) T is the corresponding

More information

Bayesian hierarchical space time model applied to highresolution hindcast data of significant wave height

Bayesian hierarchical space time model applied to highresolution hindcast data of significant wave height Bayesian hierarchical space time model applied to highresolution hindcast data of Presented at Wave workshop 2013, Banff, Canada Erik Vanem Introduction The Bayesian hierarchical space-time models were

More information

Bayesian spatial quantile regression

Bayesian spatial quantile regression Bayesian spatial quantile regression Brian J. Reich a1, Montserrat Fuentes a, and David B. Dunson b a Department of Statistics, North Carolina State University b Department of Statistical Science, Duke

More information

Symmetry and Separability In Spatial-Temporal Processes

Symmetry and Separability In Spatial-Temporal Processes Symmetry and Separability In Spatial-Temporal Processes Man Sik Park, Montserrat Fuentes Symmetry and Separability In Spatial-Temporal Processes 1 Motivation In general, environmental data have very complex

More information

Extreme Value Analysis and Spatial Extremes

Extreme Value Analysis and Spatial Extremes Extreme Value Analysis and Department of Statistics Purdue University 11/07/2013 Outline Motivation 1 Motivation 2 Extreme Value Theorem and 3 Bayesian Hierarchical Models Copula Models Max-stable Models

More information

Reduced Overdispersion in Stochastic Weather Generators for Statistical Downscaling of Seasonal Forecasts and Climate Change Scenarios

Reduced Overdispersion in Stochastic Weather Generators for Statistical Downscaling of Seasonal Forecasts and Climate Change Scenarios Reduced Overdispersion in Stochastic Weather Generators for Statistical Downscaling of Seasonal Forecasts and Climate Change Scenarios Yongku Kim Institute for Mathematics Applied to Geosciences National

More information

Using Model Selection and Prior Specification to Improve Regime-switching Asset Simulations

Using Model Selection and Prior Specification to Improve Regime-switching Asset Simulations Using Model Selection and Prior Specification to Improve Regime-switching Asset Simulations Brian M. Hartman, PhD ASA Assistant Professor of Actuarial Science University of Connecticut BYU Statistics Department

More information

Flexible Regression Modeling using Bayesian Nonparametric Mixtures

Flexible Regression Modeling using Bayesian Nonparametric Mixtures Flexible Regression Modeling using Bayesian Nonparametric Mixtures Athanasios Kottas Department of Applied Mathematics and Statistics University of California, Santa Cruz Department of Statistics Brigham

More information

Stable Limit Laws for Marginal Probabilities from MCMC Streams: Acceleration of Convergence

Stable Limit Laws for Marginal Probabilities from MCMC Streams: Acceleration of Convergence Stable Limit Laws for Marginal Probabilities from MCMC Streams: Acceleration of Convergence Robert L. Wolpert Institute of Statistics and Decision Sciences Duke University, Durham NC 778-5 - Revised April,

More information

Hierarchical Modelling for Univariate Spatial Data

Hierarchical Modelling for Univariate Spatial Data Hierarchical Modelling for Univariate Spatial Data Sudipto Banerjee 1 and Andrew O. Finley 2 1 Biostatistics, School of Public Health, University of Minnesota, Minneapolis, Minnesota, U.S.A. 2 Department

More information

E X A M. Probability Theory and Stochastic Processes Date: December 13, 2016 Duration: 4 hours. Number of pages incl.

E X A M. Probability Theory and Stochastic Processes Date: December 13, 2016 Duration: 4 hours. Number of pages incl. E X A M Course code: Course name: Number of pages incl. front page: 6 MA430-G Probability Theory and Stochastic Processes Date: December 13, 2016 Duration: 4 hours Resources allowed: Notes: Pocket calculator,

More information

CGE TRAINING MATERIALS ON VULNERABILITY AND ADAPTATION ASSESSMENT. Climate change scenarios

CGE TRAINING MATERIALS ON VULNERABILITY AND ADAPTATION ASSESSMENT. Climate change scenarios CGE TRAINING MATERIALS ON VULNERABILITY AND ADAPTATION ASSESSMENT Climate change scenarios Outline Climate change overview Observed climate data Why we use scenarios? Approach to scenario development Climate

More information

Chapter 4 - Fundamentals of spatial processes Lecture notes

Chapter 4 - Fundamentals of spatial processes Lecture notes Chapter 4 - Fundamentals of spatial processes Lecture notes Geir Storvik January 21, 2013 STK4150 - Intro 2 Spatial processes Typically correlation between nearby sites Mostly positive correlation Negative

More information

E(x i ) = µ i. 2 d. + sin 1 d θ 2. for d < θ 2 0 for d θ 2

E(x i ) = µ i. 2 d. + sin 1 d θ 2. for d < θ 2 0 for d θ 2 1 Gaussian Processes Definition 1.1 A Gaussian process { i } over sites i is defined by its mean function and its covariance function E( i ) = µ i c ij = Cov( i, j ) plus joint normality of the finite

More information

Geostatistical Modeling for Large Data Sets: Low-rank methods

Geostatistical Modeling for Large Data Sets: Low-rank methods Geostatistical Modeling for Large Data Sets: Low-rank methods Whitney Huang, Kelly-Ann Dixon Hamil, and Zizhuang Wu Department of Statistics Purdue University February 22, 2016 Outline Motivation Low-rank

More information

Bayesian non-parametric model to longitudinally predict churn

Bayesian non-parametric model to longitudinally predict churn Bayesian non-parametric model to longitudinally predict churn Bruno Scarpa Università di Padova Conference of European Statistics Stakeholders Methodologists, Producers and Users of European Statistics

More information

Chapter 5: Spectral Domain From: The Handbook of Spatial Statistics. Dr. Montserrat Fuentes and Dr. Brian Reich Prepared by: Amanda Bell

Chapter 5: Spectral Domain From: The Handbook of Spatial Statistics. Dr. Montserrat Fuentes and Dr. Brian Reich Prepared by: Amanda Bell Chapter 5: Spectral Domain From: The Handbook of Spatial Statistics Dr. Montserrat Fuentes and Dr. Brian Reich Prepared by: Amanda Bell Background Benefits of Spectral Analysis Type of data Basic Idea

More information

Modeling conditional distributions with mixture models: Theory and Inference

Modeling conditional distributions with mixture models: Theory and Inference Modeling conditional distributions with mixture models: Theory and Inference John Geweke University of Iowa, USA Journal of Applied Econometrics Invited Lecture Università di Venezia Italia June 2, 2005

More information

Karhunen-Loève decomposition of Gaussian measures on Banach spaces

Karhunen-Loève decomposition of Gaussian measures on Banach spaces Karhunen-Loève decomposition of Gaussian measures on Banach spaces Jean-Charles Croix GT APSSE - April 2017, the 13th joint work with Xavier Bay. 1 / 29 Sommaire 1 Preliminaries on Gaussian processes 2

More information

The Laplace driven moving average a non-gaussian stationary process

The Laplace driven moving average a non-gaussian stationary process The Laplace driven moving average a non-gaussian stationary process 1, Krzysztof Podgórski 2, Igor Rychlik 1 1 Mathematical Sciences, Mathematical Statistics, Chalmers 2 Centre for Mathematical Sciences,

More information

Cross-covariance Functions for Tangent Vector Fields on the Sphere

Cross-covariance Functions for Tangent Vector Fields on the Sphere Cross-covariance Functions for Tangent Vector Fields on the Sphere Minjie Fan 1 Tomoko Matsuo 2 1 Department of Statistics University of California, Davis 2 Cooperative Institute for Research in Environmental

More information

Bayesian Non-parametric Modeling With Skewed and Heavy-Tailed Data 1

Bayesian Non-parametric Modeling With Skewed and Heavy-Tailed Data 1 Bayesian Non-parametric Modeling With Skewed and Heavy-tailed Data David Draper (joint work with Milovan Krnjajić, Thanasis Kottas and John Wallerius) Department of Applied Mathematics and Statistics University

More information

Bayesian variable selection via. Penalized credible regions. Brian Reich, NCSU. Joint work with. Howard Bondell and Ander Wilson

Bayesian variable selection via. Penalized credible regions. Brian Reich, NCSU. Joint work with. Howard Bondell and Ander Wilson Bayesian variable selection via penalized credible regions Brian Reich, NC State Joint work with Howard Bondell and Ander Wilson Brian Reich, NCSU Penalized credible regions 1 Motivation big p, small n

More information

Hierarchical Modelling for Univariate Spatial Data

Hierarchical Modelling for Univariate Spatial Data Spatial omain Hierarchical Modelling for Univariate Spatial ata Sudipto Banerjee 1 and Andrew O. Finley 2 1 Biostatistics, School of Public Health, University of Minnesota, Minneapolis, Minnesota, U.S.A.

More information

Non-gaussian spatiotemporal modeling

Non-gaussian spatiotemporal modeling Dec, 2008 1/ 37 Non-gaussian spatiotemporal modeling Thais C O da Fonseca Joint work with Prof Mark F J Steel Department of Statistics University of Warwick Dec, 2008 Dec, 2008 2/ 37 1 Introduction Motivation

More information

Default Priors and Effcient Posterior Computation in Bayesian

Default Priors and Effcient Posterior Computation in Bayesian Default Priors and Effcient Posterior Computation in Bayesian Factor Analysis January 16, 2010 Presented by Eric Wang, Duke University Background and Motivation A Brief Review of Parameter Expansion Literature

More information

Consistent high-dimensional Bayesian variable selection via penalized credible regions

Consistent high-dimensional Bayesian variable selection via penalized credible regions Consistent high-dimensional Bayesian variable selection via penalized credible regions Howard Bondell bondell@stat.ncsu.edu Joint work with Brian Reich Howard Bondell p. 1 Outline High-Dimensional Variable

More information

ASSESSING THE ECONOMIC IMPACT OF CLIMATE CHANGE (MAXIMUM AND MINIMUM TEMPERATURE) ON PRODUCTIVITY OF SORGHUM CROP IN GADARIF STATE, SUDAN

ASSESSING THE ECONOMIC IMPACT OF CLIMATE CHANGE (MAXIMUM AND MINIMUM TEMPERATURE) ON PRODUCTIVITY OF SORGHUM CROP IN GADARIF STATE, SUDAN DOI http://dx.doi.org/10.18551/rjoas.2016-06.05 ASSESSING THE ECONOMIC IMPACT OF CLIMATE CHANGE (MAXIMUM AND MINIMUM TEMPERATURE) ON PRODUCTIVITY OF SORGHUM CROP IN GADARIF STATE, SUDAN Asma khalifa Elkhatim,

More information

Wavelet-Based Nonparametric Modeling of Hierarchical Functions in Colon Carcinogenesis

Wavelet-Based Nonparametric Modeling of Hierarchical Functions in Colon Carcinogenesis Wavelet-Based Nonparametric Modeling of Hierarchical Functions in Colon Carcinogenesis Jeffrey S. Morris University of Texas, MD Anderson Cancer Center Joint wor with Marina Vannucci, Philip J. Brown,

More information

Modelling trends in the ocean wave climate for dimensioning of ships

Modelling trends in the ocean wave climate for dimensioning of ships Modelling trends in the ocean wave climate for dimensioning of ships STK1100 lecture, University of Oslo Erik Vanem Motivation and background 2 Ocean waves and maritime safety Ships and other marine structures

More information

Spatial Statistics with Image Analysis. Outline. A Statistical Approach. Johan Lindström 1. Lund October 6, 2016

Spatial Statistics with Image Analysis. Outline. A Statistical Approach. Johan Lindström 1. Lund October 6, 2016 Spatial Statistics Spatial Examples More Spatial Statistics with Image Analysis Johan Lindström 1 1 Mathematical Statistics Centre for Mathematical Sciences Lund University Lund October 6, 2016 Johan Lindström

More information

Dependence. MFM Practitioner Module: Risk & Asset Allocation. John Dodson. September 11, Dependence. John Dodson. Outline.

Dependence. MFM Practitioner Module: Risk & Asset Allocation. John Dodson. September 11, Dependence. John Dodson. Outline. MFM Practitioner Module: Risk & Asset Allocation September 11, 2013 Before we define dependence, it is useful to define Random variables X and Y are independent iff For all x, y. In particular, F (X,Y

More information

Financial Econometrics and Quantitative Risk Managenent Return Properties

Financial Econometrics and Quantitative Risk Managenent Return Properties Financial Econometrics and Quantitative Risk Managenent Return Properties Eric Zivot Updated: April 1, 2013 Lecture Outline Course introduction Return definitions Empirical properties of returns Reading

More information

State-space Model. Eduardo Rossi University of Pavia. November Rossi State-space Model Fin. Econometrics / 53

State-space Model. Eduardo Rossi University of Pavia. November Rossi State-space Model Fin. Econometrics / 53 State-space Model Eduardo Rossi University of Pavia November 2014 Rossi State-space Model Fin. Econometrics - 2014 1 / 53 Outline 1 Motivation 2 Introduction 3 The Kalman filter 4 Forecast errors 5 State

More information

Hierarchical Modeling for Univariate Spatial Data

Hierarchical Modeling for Univariate Spatial Data Hierarchical Modeling for Univariate Spatial Data Geography 890, Hierarchical Bayesian Models for Environmental Spatial Data Analysis February 15, 2011 1 Spatial Domain 2 Geography 890 Spatial Domain This

More information

Gaussian Processes. Le Song. Machine Learning II: Advanced Topics CSE 8803ML, Spring 2012

Gaussian Processes. Le Song. Machine Learning II: Advanced Topics CSE 8803ML, Spring 2012 Gaussian Processes Le Song Machine Learning II: Advanced Topics CSE 8803ML, Spring 01 Pictorial view of embedding distribution Transform the entire distribution to expected features Feature space Feature

More information

A STATISTICAL APPROACH TO OPERATIONAL ATTRIBUTION

A STATISTICAL APPROACH TO OPERATIONAL ATTRIBUTION A STATISTICAL APPROACH TO OPERATIONAL ATTRIBUTION Richard L. Smith Department of Statistics and Operations Research University of North Carolina Chapel Hill, NC 27599-3260, USA rls@email.unc.edu IDAG Meeting

More information

Bayesian Inference on Joint Mixture Models for Survival-Longitudinal Data with Multiple Features. Yangxin Huang

Bayesian Inference on Joint Mixture Models for Survival-Longitudinal Data with Multiple Features. Yangxin Huang Bayesian Inference on Joint Mixture Models for Survival-Longitudinal Data with Multiple Features Yangxin Huang Department of Epidemiology and Biostatistics, COPH, USF, Tampa, FL yhuang@health.usf.edu January

More information

Comparing Non-informative Priors for Estimation and Prediction in Spatial Models

Comparing Non-informative Priors for Estimation and Prediction in Spatial Models Environmentrics 00, 1 12 DOI: 10.1002/env.XXXX Comparing Non-informative Priors for Estimation and Prediction in Spatial Models Regina Wu a and Cari G. Kaufman a Summary: Fitting a Bayesian model to spatial

More information

Generating gridded fields of extreme precipitation for large domains with a Bayesian hierarchical model

Generating gridded fields of extreme precipitation for large domains with a Bayesian hierarchical model Generating gridded fields of extreme precipitation for large domains with a Bayesian hierarchical model Cameron Bracken Department of Civil, Environmental and Architectural Engineering University of Colorado

More information

Approximate Bayesian computation for spatial extremes via open-faced sandwich adjustment

Approximate Bayesian computation for spatial extremes via open-faced sandwich adjustment Approximate Bayesian computation for spatial extremes via open-faced sandwich adjustment Ben Shaby SAMSI August 3, 2010 Ben Shaby (SAMSI) OFS adjustment August 3, 2010 1 / 29 Outline 1 Introduction 2 Spatial

More information

Dependence. Practitioner Course: Portfolio Optimization. John Dodson. September 10, Dependence. John Dodson. Outline.

Dependence. Practitioner Course: Portfolio Optimization. John Dodson. September 10, Dependence. John Dodson. Outline. Practitioner Course: Portfolio Optimization September 10, 2008 Before we define dependence, it is useful to define Random variables X and Y are independent iff For all x, y. In particular, F (X,Y ) (x,

More information

Bayesian Modeling of Conditional Distributions

Bayesian Modeling of Conditional Distributions Bayesian Modeling of Conditional Distributions John Geweke University of Iowa Indiana University Department of Economics February 27, 2007 Outline Motivation Model description Methods of inference Earnings

More information

Luke B Smith and Brian J Reich North Carolina State University May 21, 2013

Luke B Smith and Brian J Reich North Carolina State University May 21, 2013 BSquare: An R package for Bayesian simultaneous quantile regression Luke B Smith and Brian J Reich North Carolina State University May 21, 2013 BSquare in an R package to conduct Bayesian quantile regression

More information

Wrapped Gaussian processes: a short review and some new results

Wrapped Gaussian processes: a short review and some new results Wrapped Gaussian processes: a short review and some new results Giovanna Jona Lasinio 1, Gianluca Mastrantonio 2 and Alan Gelfand 3 1-Università Sapienza di Roma 2- Università RomaTRE 3- Duke University

More information

Machine learning: Hypothesis testing. Anders Hildeman

Machine learning: Hypothesis testing. Anders Hildeman Location of trees 0 Observed trees 50 100 150 200 250 300 350 400 450 500 0 100 200 300 400 500 600 700 800 900 1000 Figur: Observed points pattern of the tree specie Beilschmiedia pendula. Location of

More information

Threshold estimation in marginal modelling of spatially-dependent non-stationary extremes

Threshold estimation in marginal modelling of spatially-dependent non-stationary extremes Threshold estimation in marginal modelling of spatially-dependent non-stationary extremes Philip Jonathan Shell Technology Centre Thornton, Chester philip.jonathan@shell.com Paul Northrop University College

More information

A Framework for Daily Spatio-Temporal Stochastic Weather Simulation

A Framework for Daily Spatio-Temporal Stochastic Weather Simulation A Framework for Daily Spatio-Temporal Stochastic Weather Simulation, Rick Katz, Balaji Rajagopalan Geophysical Statistics Project Institute for Mathematics Applied to Geosciences National Center for Atmospheric

More information

Probabilistic assessment of regional climate change: a Bayesian approach to combining. predictions from multi-model ensembles

Probabilistic assessment of regional climate change: a Bayesian approach to combining. predictions from multi-model ensembles Probabilistic assessment of regional climate change: a Bayesian approach to combining predictions from multi-model ensembles Claudia Tebaldi (ESIG/NCAR), Richard L. Smith (UNC-Chapel Hill) Doug Nychka

More information

Overview of Spatial Statistics with Applications to fmri

Overview of Spatial Statistics with Applications to fmri with Applications to fmri School of Mathematics & Statistics Newcastle University April 8 th, 2016 Outline Why spatial statistics? Basic results Nonstationary models Inference for large data sets An example

More information

ON THE CONSEQUENCES OF MISSPECIFING ASSUMPTIONS CONCERNING RESIDUALS DISTRIBUTION IN A REPEATED MEASURES AND NONLINEAR MIXED MODELLING CONTEXT

ON THE CONSEQUENCES OF MISSPECIFING ASSUMPTIONS CONCERNING RESIDUALS DISTRIBUTION IN A REPEATED MEASURES AND NONLINEAR MIXED MODELLING CONTEXT ON THE CONSEQUENCES OF MISSPECIFING ASSUMPTIONS CONCERNING RESIDUALS DISTRIBUTION IN A REPEATED MEASURES AND NONLINEAR MIXED MODELLING CONTEXT Rachid el Halimi and Jordi Ocaña Departament d Estadística

More information

Research Collection. Basics of structural reliability and links with structural design codes FBH Herbsttagung November 22nd, 2013.

Research Collection. Basics of structural reliability and links with structural design codes FBH Herbsttagung November 22nd, 2013. Research Collection Presentation Basics of structural reliability and links with structural design codes FBH Herbsttagung November 22nd, 2013 Author(s): Sudret, Bruno Publication Date: 2013 Permanent Link:

More information

Simple example of analysis on spatial-temporal data set

Simple example of analysis on spatial-temporal data set Simple example of analysis on spatial-temporal data set I used the ground level ozone data in North Carolina (from Suhasini Subba Rao s website) The original data consists of 920 days of data over 72 locations

More information

of the 7 stations. In case the number of daily ozone maxima in a month is less than 15, the corresponding monthly mean was not computed, being treated

of the 7 stations. In case the number of daily ozone maxima in a month is less than 15, the corresponding monthly mean was not computed, being treated Spatial Trends and Spatial Extremes in South Korean Ozone Seokhoon Yun University of Suwon, Department of Applied Statistics Suwon, Kyonggi-do 445-74 South Korea syun@mail.suwon.ac.kr Richard L. Smith

More information

Bayesian inference & process convolution models Dave Higdon, Statistical Sciences Group, LANL

Bayesian inference & process convolution models Dave Higdon, Statistical Sciences Group, LANL 1 Bayesian inference & process convolution models Dave Higdon, Statistical Sciences Group, LANL 2 MOVING AVERAGE SPATIAL MODELS Kernel basis representation for spatial processes z(s) Define m basis functions

More information

Hilbert Space Methods for Reduced-Rank Gaussian Process Regression

Hilbert Space Methods for Reduced-Rank Gaussian Process Regression Hilbert Space Methods for Reduced-Rank Gaussian Process Regression Arno Solin and Simo Särkkä Aalto University, Finland Workshop on Gaussian Process Approximation Copenhagen, Denmark, May 2015 Solin &

More information

Part 6: Multivariate Normal and Linear Models

Part 6: Multivariate Normal and Linear Models Part 6: Multivariate Normal and Linear Models 1 Multiple measurements Up until now all of our statistical models have been univariate models models for a single measurement on each member of a sample of

More information

Identifiability problems in some non-gaussian spatial random fields

Identifiability problems in some non-gaussian spatial random fields Chilean Journal of Statistics Vol. 3, No. 2, September 2012, 171 179 Probabilistic and Inferential Aspects of Skew-Symmetric Models Special Issue: IV International Workshop in honour of Adelchi Azzalini

More information

14 - Gaussian Stochastic Processes

14 - Gaussian Stochastic Processes 14-1 Gaussian Stochastic Processes S. Lall, Stanford 211.2.24.1 14 - Gaussian Stochastic Processes Linear systems driven by IID noise Evolution of mean and covariance Example: mass-spring system Steady-state

More information

EVA for large spatial data sets

EVA for large spatial data sets EVA for large spatial data sets Brian Reich (NCSU) S Morris (Google), E Thibaud and D Cooley (CSU) October 24-25, 2016 Reich et al EVA for large spatial data sets 1 / 54 Sam Morris Reich et al EVA for

More information

Chapter 1 Handout: Descriptive Statistics

Chapter 1 Handout: Descriptive Statistics Preview Chapter 1 Handout: Descriptive Statistics Describing a Single Data Variable o Introduction to Distributions o Measure of the Distribution Center: Mean (Average) o Measures of the Distribution Spread:

More information

FUNCTIONAL DATA ANALYSIS. Contribution to the. International Handbook (Encyclopedia) of Statistical Sciences. July 28, Hans-Georg Müller 1

FUNCTIONAL DATA ANALYSIS. Contribution to the. International Handbook (Encyclopedia) of Statistical Sciences. July 28, Hans-Georg Müller 1 FUNCTIONAL DATA ANALYSIS Contribution to the International Handbook (Encyclopedia) of Statistical Sciences July 28, 2009 Hans-Georg Müller 1 Department of Statistics University of California, Davis One

More information

A new covariance function for spatio-temporal data analysis with application to atmospheric pollution and sensor networking

A new covariance function for spatio-temporal data analysis with application to atmospheric pollution and sensor networking A new covariance function for spatio-temporal data analysis with application to atmospheric pollution and sensor networking György Terdik and Subba Rao Tata UofD, HU & UofM, UK January 30, 2015 Laboratoire

More information

Modeling conditional distributions with mixture models: Applications in finance and financial decision-making

Modeling conditional distributions with mixture models: Applications in finance and financial decision-making Modeling conditional distributions with mixture models: Applications in finance and financial decision-making John Geweke University of Iowa, USA Journal of Applied Econometrics Invited Lecture Università

More information

Kriging models with Gaussian processes - covariance function estimation and impact of spatial sampling

Kriging models with Gaussian processes - covariance function estimation and impact of spatial sampling Kriging models with Gaussian processes - covariance function estimation and impact of spatial sampling François Bachoc former PhD advisor: Josselin Garnier former CEA advisor: Jean-Marc Martinez Department

More information

Robust and accurate inference via a mixture of Gaussian and terrors

Robust and accurate inference via a mixture of Gaussian and terrors Robust and accurate inference via a mixture of Gaussian and terrors Hyungsuk Tak ICTS/SAMSI Time Series Analysis for Synoptic Surveys and Gravitational Wave Astronomy 22 March 2017 Joint work with Justin

More information

Summary STK 4150/9150

Summary STK 4150/9150 STK4150 - Intro 1 Summary STK 4150/9150 Odd Kolbjørnsen May 22 2017 Scope You are expected to know and be able to use basic concepts introduced in the book. You knowledge is expected to be larger than

More information

Likelihood-Based Methods

Likelihood-Based Methods Likelihood-Based Methods Handbook of Spatial Statistics, Chapter 4 Susheela Singh September 22, 2016 OVERVIEW INTRODUCTION MAXIMUM LIKELIHOOD ESTIMATION (ML) RESTRICTED MAXIMUM LIKELIHOOD ESTIMATION (REML)

More information

The Wishart distribution Scaled Wishart. Wishart Priors. Patrick Breheny. March 28. Patrick Breheny BST 701: Bayesian Modeling in Biostatistics 1/11

The Wishart distribution Scaled Wishart. Wishart Priors. Patrick Breheny. March 28. Patrick Breheny BST 701: Bayesian Modeling in Biostatistics 1/11 Wishart Priors Patrick Breheny March 28 Patrick Breheny BST 701: Bayesian Modeling in Biostatistics 1/11 Introduction When more than two coefficients vary, it becomes difficult to directly model each element

More information

Basics of Point-Referenced Data Models

Basics of Point-Referenced Data Models Basics of Point-Referenced Data Models Basic tool is a spatial process, {Y (s), s D}, where D R r Chapter 2: Basics of Point-Referenced Data Models p. 1/45 Basics of Point-Referenced Data Models Basic

More information

Multivariate Regression Model Results

Multivariate Regression Model Results Updated: August, 0 Page of Multivariate Regression Model Results 4 5 6 7 8 This exhibit provides the results of the load model forecast discussed in Schedule. Included is the forecast of short term system

More information

Partial factor modeling: predictor-dependent shrinkage for linear regression

Partial factor modeling: predictor-dependent shrinkage for linear regression modeling: predictor-dependent shrinkage for linear Richard Hahn, Carlos Carvalho and Sayan Mukherjee JASA 2013 Review by Esther Salazar Duke University December, 2013 Factor framework The factor framework

More information

Tests for separability in nonparametric covariance operators of random surfaces

Tests for separability in nonparametric covariance operators of random surfaces Tests for separability in nonparametric covariance operators of random surfaces Shahin Tavakoli (joint with John Aston and Davide Pigoli) April 19, 2016 Analysis of Multidimensional Functional Data Shahin

More information

Bayesian Dynamic Linear Modelling for. Complex Computer Models

Bayesian Dynamic Linear Modelling for. Complex Computer Models Bayesian Dynamic Linear Modelling for Complex Computer Models Fei Liu, Liang Zhang, Mike West Abstract Computer models may have functional outputs. With no loss of generality, we assume that a single computer

More information

Southern New England s Changing Climate. Raymond S. Bradley and Liang Ning Northeast Climate Science Center University of Massachusetts, Amherst

Southern New England s Changing Climate. Raymond S. Bradley and Liang Ning Northeast Climate Science Center University of Massachusetts, Amherst Southern New England s Changing Climate Raymond S. Bradley and Liang Ning Northeast Climate Science Center University of Massachusetts, Amherst Historical perspective (instrumental data) IPCC scenarios

More information

Estimation Theory. as Θ = (Θ 1,Θ 2,...,Θ m ) T. An estimator

Estimation Theory. as Θ = (Θ 1,Θ 2,...,Θ m ) T. An estimator Estimation Theory Estimation theory deals with finding numerical values of interesting parameters from given set of data. We start with formulating a family of models that could describe how the data were

More information

Climate Change Adaptation for ports and navigation infrastructure

Climate Change Adaptation for ports and navigation infrastructure Climate Change Adaptation for ports and navigation infrastructure The application of climate projections and observations to address climate risks in ports Iñigo Losada Research Director IHCantabria Universidad

More information

BAYESIAN HIERARCHICAL MODELS FOR EXTREME EVENT ATTRIBUTION

BAYESIAN HIERARCHICAL MODELS FOR EXTREME EVENT ATTRIBUTION BAYESIAN HIERARCHICAL MODELS FOR EXTREME EVENT ATTRIBUTION Richard L Smith University of North Carolina and SAMSI (Joint with Michael Wehner, Lawrence Berkeley Lab) IDAG Meeting Boulder, February 1-3,

More information

STAT/MATH 395 PROBABILITY II

STAT/MATH 395 PROBABILITY II STAT/MATH 395 PROBABILITY II Bivariate Distributions Néhémy Lim University of Washington Winter 2017 Outline Distributions of Two Random Variables Distributions of Two Discrete Random Variables Distributions

More information

HB Methods for Combining Estimates from Multiple Surveys

HB Methods for Combining Estimates from Multiple Surveys Hierarchical Bayesian Methods for Combining Estimates from Multiple Surveys Adrijo Chakraborty NORC at the University of Chicago January 30, 2015 Joint work with Gauri Sankar Datta and Yang Cheng Outline

More information