Generating gridded fields of extreme precipitation for large domains with a Bayesian hierarchical model

Size: px
Start display at page:

Download "Generating gridded fields of extreme precipitation for large domains with a Bayesian hierarchical model"

Transcription

1 Generating gridded fields of extreme precipitation for large domains with a Bayesian hierarchical model Cameron Bracken Department of Civil, Environmental and Architectural Engineering University of Colorado at Boulder Vannes, France May 19, / 24

2 Coauthors Balaji Rajagopalan - University of Colorado Will Kleiber - University of Colorado Linyin Cheng - NOAA Subhrendu Gangopadhyay - Bureau of Reclamation 2 / 24

3 This talk Motivation - Link to weather generation Bayesian hierarchical model (BHM) for spatial extremes Application to the Western US Simuion procedure using the BHM 3 / 24

4 Introduction Background BHM Application Simuion References Motivation - Extremes in the western US? I From the Western States (WA, OR, CA, ID, NV, UT, AZ, MT, WY, CO, NM, ND, SD, NE, KS, OK, and TX) experienced $24.7 billion in flood damages, $1.5 billion annually. I California, Washington, and Oregon alone accounted for $10.6 billion (46 percent) [Ralph et al., 2014, Pielke et al., 2002] Boulder Flood, 2013 Research into hydroclimate extremes can provide more accurate and localized estimates of flood risk. 4 / 24

5 More Motivation How are simued fields of extremes linked to weather generation? May not need a full weather generator extremes may be the only quantity of interest Preserve spatial dependence of simued extremes Downscaling 5 / 24

6 What are BHM Spatial Extremes models typically used for? Return Levels 100 year return level [cm] year return level 90% CI [cm] lon lon 6 / 24

7 Background on Bayesian Statistics From Bayes rule: θ Parameters y Dependent data (response) p(θ y, x) p(y θ, x) p(θ, x) }{{}}{{}}{{} Posterior Likelihood Prior x Independent data (covariates/predictors/constants) Posterior: The answer, probability distributions of parameters Likelihood: A computable function of the parameters, model specific Prior: Probability distribution, incorporates existing knowledge of the system, model specific 7 / 24

8 Bayesian Hierarchical Model In a hierarchical Bayesian model, expand terms using conditional distributions where θ = (θ 1, θ 2 ): p(θ y) p(y θ 1 ) }{{}}{{} Posterior p(θ 1 θ 2 ) }{{} Data Likelihood Process Liklihood p(θ 2 ) }{{} Prior Data Likelihood Rees observed data to distribution parameters Process Likelihood Rees distribution parameters of the to each other 8 / 24

9 Statistics of Extremes Given daily data, if we select the maximum value in each year, those data follow a generalized extreme value (GEV) distribution: b = 1 + ξ GEV(y; µ, σ, ξ) = 1 σ b( 1/ξ) 1 exp { b 1/ξ} ( ) x µ σ, µ: Location, σ: Scale, ξ: Shape. Return Level (quantile function): 0.4 GEV(0,1,-0.5) GEV(0,1,0) GEV(0,1,0.5) z r = µ + σ ξ [( log(1 1/r)) ξ 1] Where r is the return period in years (100 years for example). f(y) y 9 / 24

10 Hierarchical spatial model (Y(s 1, t),..., Y(s n, t)) C g [Σ; {µ(s), σ(s), ξ(s)}] Y(s, t) GEV[µ(s), σ(s), ξ(s)] 10 / 24

11 Hierarchical spatial model (Y(s 1, t),..., Y(s n, t)) C g [Σ; {µ(s), σ(s), ξ(s)}] Y(s, t) GEV[µ(s), σ(s), ξ(s)] µ(s) = β µ,0 + xµ(s)β T µ (s) + w µ (s) σ(s) = β σ,0 + xσ(s)β T σ (s) + w σ (s) ξ(s) = β ξ,0 + xξ T(s)β ξ (s) + w ξ(s) 10 / 24

12 Hierarchical spatial model (Y(s 1, t),..., Y(s n, t)) C g [Σ; {µ(s), σ(s), ξ(s)}] Y(s, t) GEV[µ(s), σ(s), ξ(s)] µ(s) = β µ,0 + xµ(s)β T µ (s) + w µ (s) σ(s) = β σ,0 + xσ(s)β T σ (s) + w σ (s) ξ(s) = β ξ,0 + xξ T(s)β ξ (s) + w ξ(s) w µ (s) GP(0, C(θ µ )) w σ (s) GP(0, C(θ σ )) w ξ (s) GP(0, C(θ ξ )) 10 / 24

13 Hierarchical spatial model (Y(s 1, t),..., Y(s n, t)) C g [Σ; {µ(s), σ(s), ξ(s)}] Y(s, t) GEV[µ(s), σ(s), ξ(s)] µ(s) = β µ,0 + xµ(s)β T µ (s) + w µ (s) σ(s) = β σ,0 + xσ(s)β T σ (s) + w σ (s) ξ(s) = β ξ,0 + xξ T(s)β ξ (s) + w ξ(s) w µ (s) GP(0, C(θ µ )) w σ (s) GP(0, C(θ σ )) w ξ (s) GP(0, C(θ ξ )) Covariates: x T (s) = (Elevation, Mean Seasonal Precip) T C: Stationary, isotropic, exponential covariance model 10 / 24

14 Spatially varying regression coefficients β µ (s) = β σ (s) = β ξ (s) = k c µ i ηµ i (s) i=1 k ci σ ησ i (s) i=1 k c ξ i ηξ i (s) i=1 η i (s) = exp(d i /φ i ) 11 / 24

15 Elliptical copula for data dependence The Gaussian elliptical copula constructs the joint cdf of of a random vector (V 1,..., V n ) as F C (v 1,..., v n ) = Φ Σ (u 1,..., u n ) (1) where Φ Σ ( ) is the joint cdf of an n-dimensional multivariate normal distribution with covariance matrix Σ, u i = φ 1 (F i [v i ]), φ 1 is the inverse cdf (quantile function) of the standard normal distribution and F i ( ) is the marginal GEV cdf of variable i. V V 1 F2(V2) Cumued probability F 1(V 1) Normalized X Gaussian transformation Normalized X 1 Normalized X Multivariate Gaussian model Normalized X 1 12 / 24

16 Elliptical copula for data dependence The corresponding joint pdf is f C (y 1,..., y m ) = m i=1 m i=1 f i [y i ] Ψ Σ (u 1,...u m ) (2) ψ[u i ] where f i is the marginal GEV pdf at site i, ψ is the standard normal pdf and Ψ Σ is the joint pdf of an m-dimensional multivariate normal distribution. Exponential dependence matrix for spatial data: Σ(i, j) = exp( s i s j /a 0 ) (3) a 0 is the copula range parameter. Termed the dependogram since values are not covariances [Renard, 2011]. 13 / 24

17 Pros and Cons of Gaussian elliptical copulas Benefits: Easy to implement Few parameters Flexible (can use any marginal distribution) Requires checking two conditions in application: Asymptotic independence (dependence is hard to find in practice) Multivariate normality after transformation (usually satisfied) 14 / 24

18 Composite Likelihood (CL) Evaluating the full GP likelihood for 2500 stations is infeasible in a Bayesian model One inversion (or Cholesky decomposition) of the covariance matrix takes seconds CL is an approximation of the full likelihood Stations are broken up into G groups each with n g stations L c (θ y 1,..., y G ) = G L g (θ y g ) (4) g=1 CL Requires O(Gn 3 g) computations as opposed to O(n 3 ). This approximation is applied to the copula as well as each of the GEV parameter residuals. 15 / 24

19 Precipitation Data Global Historical Climatology Network (GHCN), daily total precip data 2500 stations with near complete data from day aggregation window Fall maxima Very large region/dataset for typical Bayesian spatial model Complete Incomplete Knot lon Co Inc 16 / 24

20 Simuion procedure Draw posterior sample Fit the model Compute ent regression coefficient surfaces Unconditional unit Fréchet copula simuion Compute ent parameter means Conditionally simue ent parameter residuals GEV Transformation Latent GEV parameter fields Extreme value simuion! 17 / 24

21 Regression coefficient surfaces - one posterior sample Location Scale Shape Mean seasonal precip lon lon lon Elevation lon lon lon 18 / 24

22 GEV Parameter simuion = conditional sim + mean (covariates + betas) µ(s) = β µ,0 + x T µ(s)β µ (s) + w µ (s) Location Scale Shape lon lon lon 19 / 24

23 Unit Fréchet Copula Simuions lon lon 20 / 24

24 GEV from unit Fréchet If Y is a random variable with a GEV distribution with location µ, scale σ and shape ξ. Then, Z = [1 + ξ(y µ)/σ] 1/ξ is unit Fréchet distributed i.e. Z GEV(1,1,1). If Z is a unit Fréchet random variable. Then, Y = µ + σ(z ξ 1)/ξ is unit GEV distributed with location, scale and shape parameters equal to µ, σ and ξ respectively. 21 / 24

25 Extreme precipitation simuions Precip [mm] sim1 sim2 sim lon Threshold of 1 cm. 22 / 24

26 Discussion and Contributions Discussion: MCMC sampling takes 3+ days! Conditional simuion is expensive Gaussian elliptical copula is an alternative to a max stable process when some conditions hold 23 / 24

27 Discussion and Contributions Discussion: MCMC sampling takes 3+ days! Conditional simuion is expensive Gaussian elliptical copula is an alternative to a max stable process when some conditions hold Conclusions: Bayesian spatial extremes model for return levels Can be used for simuions of extremes on a grid at arbitrary resolution Composite likelihood and spatially varying regression coefficients make it feasible for larger regions 23 / 24

28 Discussion and Contributions Discussion: MCMC sampling takes 3+ days! Conditional simuion is expensive Gaussian elliptical copula is an alternative to a max stable process when some conditions hold Conclusions: Bayesian spatial extremes model for return levels Can be used for simuions of extremes on a grid at arbitrary resolution Composite likelihood and spatially varying regression coefficients make it feasible for larger regions Thanks! 23 / 24

29 References I R A Pielke, M W Downton, and JZB Miller. Flood damage in the United States, : a reanalysis of National Weather Service estimates, F M Ralph, M Dettinger, A White, D Reynolds, D Cayan, T Schneider, R Cifelli, K Redmond, M Anderson, F Gherke, J Jones, K Mahoney, L Johnson, S Gutman, V Chandrasekar, J Lundquist, N Molotch, L Brekke, R Pulwarty, J Horel, L Schick, A Edman, P Mote, J Abatzoglou, R Pierce, and G Wick. A Vision for Future Observations for Western U.S. Extreme Precipitation and Flooding. Journal of Contemporary Water Research & Education, 153(1):16 32, April B Renard. A Bayesian hierarchical approach to regional frequency analysis. Water Resources Research, 47 (W11513):1 21, / 24

A Framework for Daily Spatio-Temporal Stochastic Weather Simulation

A Framework for Daily Spatio-Temporal Stochastic Weather Simulation A Framework for Daily Spatio-Temporal Stochastic Weather Simulation, Rick Katz, Balaji Rajagopalan Geophysical Statistics Project Institute for Mathematics Applied to Geosciences National Center for Atmospheric

More information

Models for Spatial Extremes. Dan Cooley Department of Statistics Colorado State University. Work supported in part by NSF-DMS

Models for Spatial Extremes. Dan Cooley Department of Statistics Colorado State University. Work supported in part by NSF-DMS Models for Spatial Extremes Dan Cooley Department of Statistics Colorado State University Work supported in part by NSF-DMS 0905315 Outline 1. Introduction Statistics for Extremes Climate and Weather 2.

More information

A spatio-temporal model for extreme precipitation simulated by a climate model

A spatio-temporal model for extreme precipitation simulated by a climate model A spatio-temporal model for extreme precipitation simulated by a climate model Jonathan Jalbert Postdoctoral fellow at McGill University, Montréal Anne-Catherine Favre, Claude Bélisle and Jean-François

More information

Spatial Extremes in Atmospheric Problems

Spatial Extremes in Atmospheric Problems Spatial Extremes in Atmospheric Problems Eric Gilleland Research Applications Laboratory (RAL) National Center for Atmospheric Research (NCAR), Boulder, Colorado, U.S.A. http://www.ral.ucar.edu/staff/ericg

More information

EVA Tutorial #2 PEAKS OVER THRESHOLD APPROACH. Rick Katz

EVA Tutorial #2 PEAKS OVER THRESHOLD APPROACH. Rick Katz 1 EVA Tutorial #2 PEAKS OVER THRESHOLD APPROACH Rick Katz Institute for Mathematics Applied to Geosciences National Center for Atmospheric Research Boulder, CO USA email: rwk@ucar.edu Home page: www.isse.ucar.edu/staff/katz/

More information

Richard L. Smith Department of Statistics and Operations Research University of North Carolina Chapel Hill, NC

Richard L. Smith Department of Statistics and Operations Research University of North Carolina Chapel Hill, NC EXTREME VALUE THEORY Richard L. Smith Department of Statistics and Operations Research University of North Carolina Chapel Hill, NC 27599-3260 rls@email.unc.edu AMS Committee on Probability and Statistics

More information

STATISTICAL METHODS FOR RELATING TEMPERATURE EXTREMES TO LARGE-SCALE METEOROLOGICAL PATTERNS. Rick Katz

STATISTICAL METHODS FOR RELATING TEMPERATURE EXTREMES TO LARGE-SCALE METEOROLOGICAL PATTERNS. Rick Katz 1 STATISTICAL METHODS FOR RELATING TEMPERATURE EXTREMES TO LARGE-SCALE METEOROLOGICAL PATTERNS Rick Katz Institute for Mathematics Applied to Geosciences National Center for Atmospheric Research Boulder,

More information

Extreme Value Analysis and Spatial Extremes

Extreme Value Analysis and Spatial Extremes Extreme Value Analysis and Department of Statistics Purdue University 11/07/2013 Outline Motivation 1 Motivation 2 Extreme Value Theorem and 3 Bayesian Hierarchical Models Copula Models Max-stable Models

More information

Hierarchical Modeling for Univariate Spatial Data

Hierarchical Modeling for Univariate Spatial Data Hierarchical Modeling for Univariate Spatial Data Geography 890, Hierarchical Bayesian Models for Environmental Spatial Data Analysis February 15, 2011 1 Spatial Domain 2 Geography 890 Spatial Domain This

More information

Approximate Bayesian computation for spatial extremes via open-faced sandwich adjustment

Approximate Bayesian computation for spatial extremes via open-faced sandwich adjustment Approximate Bayesian computation for spatial extremes via open-faced sandwich adjustment Ben Shaby SAMSI August 3, 2010 Ben Shaby (SAMSI) OFS adjustment August 3, 2010 1 / 29 Outline 1 Introduction 2 Spatial

More information

Lecture 2 APPLICATION OF EXREME VALUE THEORY TO CLIMATE CHANGE. Rick Katz

Lecture 2 APPLICATION OF EXREME VALUE THEORY TO CLIMATE CHANGE. Rick Katz 1 Lecture 2 APPLICATION OF EXREME VALUE THEORY TO CLIMATE CHANGE Rick Katz Institute for Study of Society and Environment National Center for Atmospheric Research Boulder, CO USA email: rwk@ucar.edu Home

More information

Semi-parametric estimation of non-stationary Pickands functions

Semi-parametric estimation of non-stationary Pickands functions Semi-parametric estimation of non-stationary Pickands functions Linda Mhalla 1 Joint work with: Valérie Chavez-Demoulin 2 and Philippe Naveau 3 1 Geneva School of Economics and Management, University of

More information

Hierarchical Modelling for Univariate Spatial Data

Hierarchical Modelling for Univariate Spatial Data Hierarchical Modelling for Univariate Spatial Data Sudipto Banerjee 1 and Andrew O. Finley 2 1 Biostatistics, School of Public Health, University of Minnesota, Minneapolis, Minnesota, U.S.A. 2 Department

More information

EXTREMAL MODELS AND ENVIRONMENTAL APPLICATIONS. Rick Katz

EXTREMAL MODELS AND ENVIRONMENTAL APPLICATIONS. Rick Katz 1 EXTREMAL MODELS AND ENVIRONMENTAL APPLICATIONS Rick Katz Institute for Study of Society and Environment National Center for Atmospheric Research Boulder, CO USA email: rwk@ucar.edu Home page: www.isse.ucar.edu/hp_rick/

More information

Bayesian spatial hierarchical modeling for temperature extremes

Bayesian spatial hierarchical modeling for temperature extremes Bayesian spatial hierarchical modeling for temperature extremes Indriati Bisono Dr. Andrew Robinson Dr. Aloke Phatak Mathematics and Statistics Department The University of Melbourne Maths, Informatics

More information

Multivariate Non-Normally Distributed Random Variables

Multivariate Non-Normally Distributed Random Variables Multivariate Non-Normally Distributed Random Variables An Introduction to the Copula Approach Workgroup seminar on climate dynamics Meteorological Institute at the University of Bonn 18 January 2008, Bonn

More information

Models for spatial data (cont d) Types of spatial data. Types of spatial data (cont d) Hierarchical models for spatial data

Models for spatial data (cont d) Types of spatial data. Types of spatial data (cont d) Hierarchical models for spatial data Hierarchical models for spatial data Based on the book by Banerjee, Carlin and Gelfand Hierarchical Modeling and Analysis for Spatial Data, 2004. We focus on Chapters 1, 2 and 5. Geo-referenced data arise

More information

Nearest Neighbor Gaussian Processes for Large Spatial Data

Nearest Neighbor Gaussian Processes for Large Spatial Data Nearest Neighbor Gaussian Processes for Large Spatial Data Abhi Datta 1, Sudipto Banerjee 2 and Andrew O. Finley 3 July 31, 2017 1 Department of Biostatistics, Bloomberg School of Public Health, Johns

More information

Bayesian spatial quantile regression

Bayesian spatial quantile regression Brian J. Reich and Montserrat Fuentes North Carolina State University and David B. Dunson Duke University E-mail:reich@stat.ncsu.edu Tropospheric ozone Tropospheric ozone has been linked with several adverse

More information

Hierarchical Modelling for Univariate and Multivariate Spatial Data

Hierarchical Modelling for Univariate and Multivariate Spatial Data Hierarchical Modelling for Univariate and Multivariate Spatial Data p. 1/4 Hierarchical Modelling for Univariate and Multivariate Spatial Data Sudipto Banerjee sudiptob@biostat.umn.edu University of Minnesota

More information

Overview of Extreme Value Analysis (EVA)

Overview of Extreme Value Analysis (EVA) Overview of Extreme Value Analysis (EVA) Brian Reich North Carolina State University July 26, 2016 Rossbypalooza Chicago, IL Brian Reich Overview of Extreme Value Analysis (EVA) 1 / 24 Importance of extremes

More information

A Fully Nonparametric Modeling Approach to. BNP Binary Regression

A Fully Nonparametric Modeling Approach to. BNP Binary Regression A Fully Nonparametric Modeling Approach to Binary Regression Maria Department of Applied Mathematics and Statistics University of California, Santa Cruz SBIES, April 27-28, 2012 Outline 1 2 3 Simulation

More information

Bayesian data analysis in practice: Three simple examples

Bayesian data analysis in practice: Three simple examples Bayesian data analysis in practice: Three simple examples Martin P. Tingley Introduction These notes cover three examples I presented at Climatea on 5 October 0. Matlab code is available by request to

More information

Nonparametric Spatial Models for Extremes: Application to Extreme Temperature Data.

Nonparametric Spatial Models for Extremes: Application to Extreme Temperature Data. Nonparametric Spatial Models for Extremes: Application to Extreme Temperature Data. Montserrat Fuentes, John Henry, and Brian Reich SUMMARY Estimating the probability of extreme temperature events is difficult

More information

RISK AND EXTREMES: ASSESSING THE PROBABILITIES OF VERY RARE EVENTS

RISK AND EXTREMES: ASSESSING THE PROBABILITIES OF VERY RARE EVENTS RISK AND EXTREMES: ASSESSING THE PROBABILITIES OF VERY RARE EVENTS Richard L. Smith Department of Statistics and Operations Research University of North Carolina Chapel Hill, NC 27599-3260 rls@email.unc.edu

More information

Drought Monitoring Capability of the Oklahoma Mesonet. Gary McManus Oklahoma Climatological Survey Oklahoma Mesonet

Drought Monitoring Capability of the Oklahoma Mesonet. Gary McManus Oklahoma Climatological Survey Oklahoma Mesonet Drought Monitoring Capability of the Oklahoma Mesonet Gary McManus Oklahoma Climatological Survey Oklahoma Mesonet Mesonet History Commissioned in 1994 Atmospheric measurements with 5-minute resolution,

More information

Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes

Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes Alan Gelfand 1 and Andrew O. Finley 2 1 Department of Statistical Science, Duke University, Durham, North

More information

Practical Bayesian Optimization of Machine Learning. Learning Algorithms

Practical Bayesian Optimization of Machine Learning. Learning Algorithms Practical Bayesian Optimization of Machine Learning Algorithms CS 294 University of California, Berkeley Tuesday, April 20, 2016 Motivation Machine Learning Algorithms (MLA s) have hyperparameters that

More information

Continuous Spatial Process Models for Spatial Extreme Values

Continuous Spatial Process Models for Spatial Extreme Values Continuous Spatial Process Models for Spatial Extreme Values HUIYAN SANG AND ALAN E. GELFAND We propose a hierarchical modeling approach for explaining a collection of point-referenced extreme values.

More information

Extreme Values on Spatial Fields p. 1/1

Extreme Values on Spatial Fields p. 1/1 Extreme Values on Spatial Fields Daniel Cooley Department of Applied Mathematics, University of Colorado at Boulder Geophysical Statistics Project, National Center for Atmospheric Research Philippe Naveau

More information

ICML Scalable Bayesian Inference on Point processes. with Gaussian Processes. Yves-Laurent Kom Samo & Stephen Roberts

ICML Scalable Bayesian Inference on Point processes. with Gaussian Processes. Yves-Laurent Kom Samo & Stephen Roberts ICML 2015 Scalable Nonparametric Bayesian Inference on Point Processes with Gaussian Processes Machine Learning Research Group and Oxford-Man Institute University of Oxford July 8, 2015 Point Processes

More information

Flexible Regression Modeling using Bayesian Nonparametric Mixtures

Flexible Regression Modeling using Bayesian Nonparametric Mixtures Flexible Regression Modeling using Bayesian Nonparametric Mixtures Athanasios Kottas Department of Applied Mathematics and Statistics University of California, Santa Cruz Department of Statistics Brigham

More information

Characterizing and modeling hydroclimate extremes in the Western US

Characterizing and modeling hydroclimate extremes in the Western US Characterizing and modeling hydroclimate extremes in the Western US by C. W. Bracken B.S., Humboldt State University, 2009 M.S., University of Colorado at Boulder, 2011 A thesis submitted to the Faculty

More information

Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes

Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes Sudipto Banerjee 1 and Andrew O. Finley 2 1 Biostatistics, School of Public Health, University of Minnesota,

More information

PENULTIMATE APPROXIMATIONS FOR WEATHER AND CLIMATE EXTREMES. Rick Katz

PENULTIMATE APPROXIMATIONS FOR WEATHER AND CLIMATE EXTREMES. Rick Katz PENULTIMATE APPROXIMATIONS FOR WEATHER AND CLIMATE EXTREMES Rick Katz Institute for Mathematics Applied to Geosciences National Center for Atmospheric Research Boulder, CO USA Email: rwk@ucar.edu Web site:

More information

Hidden Markov Models for precipitation

Hidden Markov Models for precipitation Hidden Markov Models for precipitation Pierre Ailliot Université de Brest Joint work with Peter Thomson Statistics Research Associates (NZ) Page 1 Context Part of the project Climate-related risks for

More information

Cross-covariance Functions for Tangent Vector Fields on the Sphere

Cross-covariance Functions for Tangent Vector Fields on the Sphere Cross-covariance Functions for Tangent Vector Fields on the Sphere Minjie Fan 1 Tomoko Matsuo 2 1 Department of Statistics University of California, Davis 2 Cooperative Institute for Research in Environmental

More information

Hierarchical Modelling for Univariate Spatial Data

Hierarchical Modelling for Univariate Spatial Data Spatial omain Hierarchical Modelling for Univariate Spatial ata Sudipto Banerjee 1 and Andrew O. Finley 2 1 Biostatistics, School of Public Health, University of Minnesota, Minneapolis, Minnesota, U.S.A.

More information

Applications of Tail Dependence II: Investigating the Pineapple Express. Dan Cooley Grant Weller Department of Statistics Colorado State University

Applications of Tail Dependence II: Investigating the Pineapple Express. Dan Cooley Grant Weller Department of Statistics Colorado State University Applications of Tail Dependence II: Investigating the Pineapple Express Dan Cooley Grant Weller Department of Statistics Colorado State University Joint work with: Steve Sain, Melissa Bukovsky, Linda Mearns,

More information

Machine learning: Hypothesis testing. Anders Hildeman

Machine learning: Hypothesis testing. Anders Hildeman Location of trees 0 Observed trees 50 100 150 200 250 300 350 400 450 500 0 100 200 300 400 500 600 700 800 900 1000 Figur: Observed points pattern of the tree specie Beilschmiedia pendula. Location of

More information

Threshold estimation in marginal modelling of spatially-dependent non-stationary extremes

Threshold estimation in marginal modelling of spatially-dependent non-stationary extremes Threshold estimation in marginal modelling of spatially-dependent non-stationary extremes Philip Jonathan Shell Technology Centre Thornton, Chester philip.jonathan@shell.com Paul Northrop University College

More information

Extremes Analysis for Climate Models. Dan Cooley Department of Statistics

Extremes Analysis for Climate Models. Dan Cooley Department of Statistics Extremes Analysis for Climate Models Dan Cooley Department of Statistics In collaboration with Miranda Fix, Grant Weller, Steve Sain, Melissa Bukovsky, and Linda Mearns. CMIP Analysis Workshop NCAR, August

More information

Introduction to Systems Analysis and Decision Making Prepared by: Jakub Tomczak

Introduction to Systems Analysis and Decision Making Prepared by: Jakub Tomczak Introduction to Systems Analysis and Decision Making Prepared by: Jakub Tomczak 1 Introduction. Random variables During the course we are interested in reasoning about considered phenomenon. In other words,

More information

Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes

Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes Andrew O. Finley Department of Forestry & Department of Geography, Michigan State University, Lansing

More information

Towards a more physically based approach to Extreme Value Analysis in the climate system

Towards a more physically based approach to Extreme Value Analysis in the climate system N O A A E S R L P H Y S IC A L S C IE N C E S D IV IS IO N C IR E S Towards a more physically based approach to Extreme Value Analysis in the climate system Prashant Sardeshmukh Gil Compo Cecile Penland

More information

Weather generators for studying climate change

Weather generators for studying climate change Weather generators for studying climate change Assessing climate impacts Generating Weather (WGEN) Conditional models for precip Douglas Nychka, Sarah Streett Geophysical Statistics Project, National Center

More information

RISK ANALYSIS AND EXTREMES

RISK ANALYSIS AND EXTREMES RISK ANALYSIS AND EXTREMES Richard L. Smith Department of Statistics and Operations Research University of North Carolina Chapel Hill, NC 27599-3260 rls@email.unc.edu Opening Workshop SAMSI program on

More information

Beyond MCMC in fitting complex Bayesian models: The INLA method

Beyond MCMC in fitting complex Bayesian models: The INLA method Beyond MCMC in fitting complex Bayesian models: The INLA method Valeska Andreozzi Centre of Statistics and Applications of Lisbon University (valeska.andreozzi at fc.ul.pt) European Congress of Epidemiology

More information

Introduction to Probabilistic Graphical Models: Exercises

Introduction to Probabilistic Graphical Models: Exercises Introduction to Probabilistic Graphical Models: Exercises Cédric Archambeau Xerox Research Centre Europe cedric.archambeau@xrce.xerox.com Pascal Bootcamp Marseille, France, July 2010 Exercise 1: basics

More information

Nonparametric Bayesian Methods (Gaussian Processes)

Nonparametric Bayesian Methods (Gaussian Processes) [70240413 Statistical Machine Learning, Spring, 2015] Nonparametric Bayesian Methods (Gaussian Processes) Jun Zhu dcszj@mail.tsinghua.edu.cn http://bigml.cs.tsinghua.edu.cn/~jun State Key Lab of Intelligent

More information

Introduction to Bayes and non-bayes spatial statistics

Introduction to Bayes and non-bayes spatial statistics Introduction to Bayes and non-bayes spatial statistics Gabriel Huerta Department of Mathematics and Statistics University of New Mexico http://www.stat.unm.edu/ ghuerta/georcode.txt General Concepts Spatial

More information

A comparison of U.S. precipitation extremes under two climate change scenarios

A comparison of U.S. precipitation extremes under two climate change scenarios A comparison of U.S. precipitation extremes under two climate change scenarios Miranda Fix 1 Dan Cooley 1 Steve Sain 2 Claudia Tebaldi 3 1 Department of Statistics, Colorado State University 2 The Climate

More information

Modeling daily precipitation in Space and Time

Modeling daily precipitation in Space and Time Space and Time SWGen - Hydro Berlin 20 September 2017 temporal - dependence Outline temporal - dependence temporal - dependence Stochastic Weather Generator Stochastic Weather Generator (SWG) is a stochastic

More information

Ensemble Copula Coupling: Towards Physically Consistent, Calibrated Probabilistic Forecasts of Spatio-Temporal Weather Trajectories

Ensemble Copula Coupling: Towards Physically Consistent, Calibrated Probabilistic Forecasts of Spatio-Temporal Weather Trajectories Ensemble Copula Coupling: Towards Physically Consistent, Calibrated Probabilistic Forecasts of Spatio-Temporal Weather Trajectories Tilmann Gneiting and Roman Schefzik Institut für Angewandte Mathematik

More information

Chapter 4 - Fundamentals of spatial processes Lecture notes

Chapter 4 - Fundamentals of spatial processes Lecture notes Chapter 4 - Fundamentals of spatial processes Lecture notes Geir Storvik January 21, 2013 STK4150 - Intro 2 Spatial processes Typically correlation between nearby sites Mostly positive correlation Negative

More information

Statistics for extreme & sparse data

Statistics for extreme & sparse data Statistics for extreme & sparse data University of Bath December 6, 2018 Plan 1 2 3 4 5 6 The Problem Climate Change = Bad! 4 key problems Volcanic eruptions/catastrophic event prediction. Windstorms

More information

Disease mapping with Gaussian processes

Disease mapping with Gaussian processes EUROHEIS2 Kuopio, Finland 17-18 August 2010 Aki Vehtari (former Helsinki University of Technology) Department of Biomedical Engineering and Computational Science (BECS) Acknowledgments Researchers - Jarno

More information

Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes

Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes Andrew O. Finley 1 and Sudipto Banerjee 2 1 Department of Forestry & Department of Geography, Michigan

More information

Markov Chain Monte Carlo methods

Markov Chain Monte Carlo methods Markov Chain Monte Carlo methods Tomas McKelvey and Lennart Svensson Signal Processing Group Department of Signals and Systems Chalmers University of Technology, Sweden November 26, 2012 Today s learning

More information

Assessing Dependence in Extreme Values

Assessing Dependence in Extreme Values 02/09/2016 1 Motivation Motivation 2 Comparison 3 Asymptotic Independence Component-wise Maxima Measures Estimation Limitations 4 Idea Results Motivation Given historical flood levels, how high should

More information

Modeling conditional distributions with mixture models: Applications in finance and financial decision-making

Modeling conditional distributions with mixture models: Applications in finance and financial decision-making Modeling conditional distributions with mixture models: Applications in finance and financial decision-making John Geweke University of Iowa, USA Journal of Applied Econometrics Invited Lecture Università

More information

Gaussian processes for spatial modelling in environmental health: parameterizing for flexibility vs. computational efficiency

Gaussian processes for spatial modelling in environmental health: parameterizing for flexibility vs. computational efficiency Gaussian processes for spatial modelling in environmental health: parameterizing for flexibility vs. computational efficiency Chris Paciorek March 11, 2005 Department of Biostatistics Harvard School of

More information

FORECAST VERIFICATION OF EXTREMES: USE OF EXTREME VALUE THEORY

FORECAST VERIFICATION OF EXTREMES: USE OF EXTREME VALUE THEORY 1 FORECAST VERIFICATION OF EXTREMES: USE OF EXTREME VALUE THEORY Rick Katz Institute for Study of Society and Environment National Center for Atmospheric Research Boulder, CO USA Email: rwk@ucar.edu Web

More information

Advances in Statistical Downscaling of Meteorological Data:

Advances in Statistical Downscaling of Meteorological Data: Advances in Statistical Downscaling of Meteorological Data: Development, Validation and Applications John Abatzoglou University of Idaho Department t of Geography EPSCoR Western Tri-State Consortium 7

More information

HIERARCHICAL MODELS IN EXTREME VALUE THEORY

HIERARCHICAL MODELS IN EXTREME VALUE THEORY HIERARCHICAL MODELS IN EXTREME VALUE THEORY Richard L. Smith Department of Statistics and Operations Research, University of North Carolina, Chapel Hill and Statistical and Applied Mathematical Sciences

More information

Tutorial on Gaussian Processes and the Gaussian Process Latent Variable Model

Tutorial on Gaussian Processes and the Gaussian Process Latent Variable Model Tutorial on Gaussian Processes and the Gaussian Process Latent Variable Model (& discussion on the GPLVM tech. report by Prof. N. Lawrence, 06) Andreas Damianou Department of Neuro- and Computer Science,

More information

Bayesian Point Process Modeling for Extreme Value Analysis, with an Application to Systemic Risk Assessment in Correlated Financial Markets

Bayesian Point Process Modeling for Extreme Value Analysis, with an Application to Systemic Risk Assessment in Correlated Financial Markets Bayesian Point Process Modeling for Extreme Value Analysis, with an Application to Systemic Risk Assessment in Correlated Financial Markets Athanasios Kottas Department of Applied Mathematics and Statistics,

More information

Statistical modelling of spatial extremes using the SpatialExtremes package

Statistical modelling of spatial extremes using the SpatialExtremes package Statistical modelling of spatial extremes using the SpatialExtremes package M. Ribatet University of Montpellier TheSpatialExtremes package Mathieu Ribatet 1 / 39 Rationale for thespatialextremes package

More information

Hierarchical Modelling for Multivariate Spatial Data

Hierarchical Modelling for Multivariate Spatial Data Hierarchical Modelling for Multivariate Spatial Data Geography 890, Hierarchical Bayesian Models for Environmental Spatial Data Analysis February 15, 2011 1 Point-referenced spatial data often come as

More information

Adaptation for global application of calibration and downscaling methods of medium range ensemble weather forecasts

Adaptation for global application of calibration and downscaling methods of medium range ensemble weather forecasts Adaptation for global application of calibration and downscaling methods of medium range ensemble weather forecasts Nathalie Voisin Hydrology Group Seminar UW 11/18/2009 Objective Develop a medium range

More information

Hierarchical Nearest-Neighbor Gaussian Process Models for Large Geo-statistical Datasets

Hierarchical Nearest-Neighbor Gaussian Process Models for Large Geo-statistical Datasets Hierarchical Nearest-Neighbor Gaussian Process Models for Large Geo-statistical Datasets Abhirup Datta 1 Sudipto Banerjee 1 Andrew O. Finley 2 Alan E. Gelfand 3 1 University of Minnesota, Minneapolis,

More information

spbayes: An R Package for Univariate and Multivariate Hierarchical Point-referenced Spatial Models

spbayes: An R Package for Univariate and Multivariate Hierarchical Point-referenced Spatial Models spbayes: An R Package for Univariate and Multivariate Hierarchical Point-referenced Spatial Models Andrew O. Finley 1, Sudipto Banerjee 2, and Bradley P. Carlin 2 1 Michigan State University, Departments

More information

Hierarchical Modeling for Multivariate Spatial Data

Hierarchical Modeling for Multivariate Spatial Data Hierarchical Modeling for Multivariate Spatial Data Sudipto Banerjee 1 and Andrew O. Finley 2 1 Biostatistics, School of Public Health, University of Minnesota, Minneapolis, Minnesota, U.S.A. 2 Department

More information

Bruno Sansó. Department of Applied Mathematics and Statistics University of California Santa Cruz bruno

Bruno Sansó. Department of Applied Mathematics and Statistics University of California Santa Cruz   bruno Bruno Sansó Department of Applied Mathematics and Statistics University of California Santa Cruz http://www.ams.ucsc.edu/ bruno Climate Models Climate Models use the equations of motion to simulate changes

More information

Probability and Estimation. Alan Moses

Probability and Estimation. Alan Moses Probability and Estimation Alan Moses Random variables and probability A random variable is like a variable in algebra (e.g., y=e x ), but where at least part of the variability is taken to be stochastic.

More information

STAT Advanced Bayesian Inference

STAT Advanced Bayesian Inference 1 / 32 STAT 625 - Advanced Bayesian Inference Meng Li Department of Statistics Jan 23, 218 The Dirichlet distribution 2 / 32 θ Dirichlet(a 1,...,a k ) with density p(θ 1,θ 2,...,θ k ) = k j=1 Γ(a j) Γ(

More information

Bayesian Semiparametric GARCH Models

Bayesian Semiparametric GARCH Models Bayesian Semiparametric GARCH Models Xibin (Bill) Zhang and Maxwell L. King Department of Econometrics and Business Statistics Faculty of Business and Economics xibin.zhang@monash.edu Quantitative Methods

More information

Bayesian Semiparametric GARCH Models

Bayesian Semiparametric GARCH Models Bayesian Semiparametric GARCH Models Xibin (Bill) Zhang and Maxwell L. King Department of Econometrics and Business Statistics Faculty of Business and Economics xibin.zhang@monash.edu Quantitative Methods

More information

Plausible Values for Latent Variables Using Mplus

Plausible Values for Latent Variables Using Mplus Plausible Values for Latent Variables Using Mplus Tihomir Asparouhov and Bengt Muthén August 21, 2010 1 1 Introduction Plausible values are imputed values for latent variables. All latent variables can

More information

Generalized additive modelling of hydrological sample extremes

Generalized additive modelling of hydrological sample extremes Generalized additive modelling of hydrological sample extremes Valérie Chavez-Demoulin 1 Joint work with A.C. Davison (EPFL) and Marius Hofert (ETHZ) 1 Faculty of Business and Economics, University of

More information

Bayesian hierarchical modelling of rainfall extremes

Bayesian hierarchical modelling of rainfall extremes Bayesian hierarchical modelling of rainfall extremes E.A. Lehmann a, A. Phatak a, S. Soltyk b, J. Chia a, R. Lau a and M. Palmer c a CSIRO Computational Informatics, Perth, WA, AUSTRALIA b Curtin University

More information

Gaussian kernel GARCH models

Gaussian kernel GARCH models Gaussian kernel GARCH models Xibin (Bill) Zhang and Maxwell L. King Department of Econometrics and Business Statistics Faculty of Business and Economics 7 June 2013 Motivation A regression model is often

More information

UNDERSTANDING DATA ASSIMILATION APPLICATIONS TO HIGH-LATITUDE IONOSPHERIC ELECTRODYNAMICS

UNDERSTANDING DATA ASSIMILATION APPLICATIONS TO HIGH-LATITUDE IONOSPHERIC ELECTRODYNAMICS Monday, June 27, 2011 CEDAR-GEM joint workshop: DA tutorial 1 UNDERSTANDING DATA ASSIMILATION APPLICATIONS TO HIGH-LATITUDE IONOSPHERIC ELECTRODYNAMICS Tomoko Matsuo University of Colorado, Boulder Space

More information

Sharp statistical tools Statistics for extremes

Sharp statistical tools Statistics for extremes Sharp statistical tools Statistics for extremes Georg Lindgren Lund University October 18, 2012 SARMA Background Motivation We want to predict outside the range of observations Sums, averages and proportions

More information

The Mixture Approach for Simulating New Families of Bivariate Distributions with Specified Correlations

The Mixture Approach for Simulating New Families of Bivariate Distributions with Specified Correlations The Mixture Approach for Simulating New Families of Bivariate Distributions with Specified Correlations John R. Michael, Significance, Inc. and William R. Schucany, Southern Methodist University The mixture

More information

Parameter estimation and forecasting. Cristiano Porciani AIfA, Uni-Bonn

Parameter estimation and forecasting. Cristiano Porciani AIfA, Uni-Bonn Parameter estimation and forecasting Cristiano Porciani AIfA, Uni-Bonn Questions? C. Porciani Estimation & forecasting 2 Temperature fluctuations Variance at multipole l (angle ~180o/l) C. Porciani Estimation

More information

20: Gaussian Processes

20: Gaussian Processes 10-708: Probabilistic Graphical Models 10-708, Spring 2016 20: Gaussian Processes Lecturer: Andrew Gordon Wilson Scribes: Sai Ganesh Bandiatmakuri 1 Discussion about ML Here we discuss an introduction

More information

Nonparameteric Regression:

Nonparameteric Regression: Nonparameteric Regression: Nadaraya-Watson Kernel Regression & Gaussian Process Regression Seungjin Choi Department of Computer Science and Engineering Pohang University of Science and Technology 77 Cheongam-ro,

More information

A STATISTICAL APPROACH TO OPERATIONAL ATTRIBUTION

A STATISTICAL APPROACH TO OPERATIONAL ATTRIBUTION A STATISTICAL APPROACH TO OPERATIONAL ATTRIBUTION Richard L. Smith Department of Statistics and Operations Research University of North Carolina Chapel Hill, NC 27599-3260, USA rls@email.unc.edu IDAG Meeting

More information

Bayesian Modelling of Extreme Rainfall Data

Bayesian Modelling of Extreme Rainfall Data Bayesian Modelling of Extreme Rainfall Data Elizabeth Smith A thesis submitted for the degree of Doctor of Philosophy at the University of Newcastle upon Tyne September 2005 UNIVERSITY OF NEWCASTLE Bayesian

More information

A new Hierarchical Bayes approach to ensemble-variational data assimilation

A new Hierarchical Bayes approach to ensemble-variational data assimilation A new Hierarchical Bayes approach to ensemble-variational data assimilation Michael Tsyrulnikov and Alexander Rakitko HydroMetCenter of Russia College Park, 20 Oct 2014 Michael Tsyrulnikov and Alexander

More information

Modelling Multivariate Peaks-over-Thresholds using Generalized Pareto Distributions

Modelling Multivariate Peaks-over-Thresholds using Generalized Pareto Distributions Modelling Multivariate Peaks-over-Thresholds using Generalized Pareto Distributions Anna Kiriliouk 1 Holger Rootzén 2 Johan Segers 1 Jennifer L. Wadsworth 3 1 Université catholique de Louvain (BE) 2 Chalmers

More information

Creating Non-Gaussian Processes from Gaussian Processes by the Log-Sum-Exp Approach. Radford M. Neal, 28 February 2005

Creating Non-Gaussian Processes from Gaussian Processes by the Log-Sum-Exp Approach. Radford M. Neal, 28 February 2005 Creating Non-Gaussian Processes from Gaussian Processes by the Log-Sum-Exp Approach Radford M. Neal, 28 February 2005 A Very Brief Review of Gaussian Processes A Gaussian process is a distribution over

More information

Introduction to Bayesian Inference

Introduction to Bayesian Inference University of Pennsylvania EABCN Training School May 10, 2016 Bayesian Inference Ingredients of Bayesian Analysis: Likelihood function p(y φ) Prior density p(φ) Marginal data density p(y ) = p(y φ)p(φ)dφ

More information

Solutions of the Financial Risk Management Examination

Solutions of the Financial Risk Management Examination Solutions of the Financial Risk Management Examination Thierry Roncalli January 9 th 03 Remark The first five questions are corrected in TR-GDR and in the document of exercise solutions, which is available

More information

A Complete Spatial Downscaler

A Complete Spatial Downscaler A Complete Spatial Downscaler Yen-Ning Huang, Brian J Reich, Montserrat Fuentes 1 Sankar Arumugam 2 1 Department of Statistics, NC State University 2 Department of Civil, Construction, and Environmental

More information

Bayesian hierarchical modelling for data assimilation of past observations and numerical model forecasts

Bayesian hierarchical modelling for data assimilation of past observations and numerical model forecasts Bayesian hierarchical modelling for data assimilation of past observations and numerical model forecasts Stan Yip Exeter Climate Systems, University of Exeter c.y.yip@ex.ac.uk Joint work with Sujit Sahu

More information

Lecture: Gaussian Process Regression. STAT 6474 Instructor: Hongxiao Zhu

Lecture: Gaussian Process Regression. STAT 6474 Instructor: Hongxiao Zhu Lecture: Gaussian Process Regression STAT 6474 Instructor: Hongxiao Zhu Motivation Reference: Marc Deisenroth s tutorial on Robot Learning. 2 Fast Learning for Autonomous Robots with Gaussian Processes

More information

CLIMATE EXTREMES AND GLOBAL WARMING: A STATISTICIAN S PERSPECTIVE

CLIMATE EXTREMES AND GLOBAL WARMING: A STATISTICIAN S PERSPECTIVE CLIMATE EXTREMES AND GLOBAL WARMING: A STATISTICIAN S PERSPECTIVE Richard L. Smith Department of Statistics and Operations Research University of North Carolina, Chapel Hill rls@email.unc.edu Statistics

More information

Data. Climate model data from CMIP3

Data. Climate model data from CMIP3 Data Observational data from CRU (Climate Research Unit, University of East Anglia, UK) monthly averages on 5 o x5 o grid boxes, aggregated to JJA average anomalies over Europe: spatial averages over 10

More information