Advanced uncertainty evaluation of climate models by Monte Carlo methods
|
|
- Brooke Hood
- 6 years ago
- Views:
Transcription
1 Advanced uncertainty evaluation of climate models by Monte Carlo methods Marko Laine Pirkka Ollinaho, Janne Hakkarainen, Johanna Tamminen, Heikki Järvinen (FMI) Antti Solonen, Heikki Haario (LUT) Alexander Ilin, Erkki Oja (Aalto) FMI Finnish Meteorological Institute LUT Lappeenranta University of Technology SIAM UQ 212
2 M.Laine: Advanced uncertainty evaluation of climate models by Monte Carlo methods 2/27 Contents Adaptive Markov chain Monte Carlo method Efficient MCMC for short chains Parallel chains Early rejection MCMC for ECHAM5 climate model Formulating the cost function Stochastic Lorenz 95 test case EPPES ensemble prediction and parameter estimation Lorenz 95 experiment with EPPES ECHAM5 experiment with EPPES
3 Adaptive MCMC The current work is based on our success on applying and developing adaptive Markov chain Monte Carlo (MCMC) for chemical kinetics, ecological models, and satellite retrieval. In 21 we started a project on applying MCMC for climate model closure parameter uncertainty evaluation. Haario H., Saksman E., Tamminen J.: An adaptive Metropolis algorithm. Bernoulli 7(2), pp , 21. Haario H., M. Laine, M. Lehtinen, E. Saksman, J. Tamminen: Markov chain Monte Carlo methods for high dimensional inversion in remote sensing, with discussion, J.R. Statist. Soc. B, 66, part 3 pp , 24. Haario H., M. Laine, A. Mira, E. Saksman: DRAM: Efficient adaptive MCMC. Stat. Comput. 16, pp , ISSN , 26. Laine, M., J. Tamminen: Aerosol model selection and uncertainty modelling by adaptive MCMC technique. Atmos. Chem. Phys., 8, 28. M.Laine: Advanced uncertainty evaluation of climate models by Monte Carlo methods 3/27
4 M.Laine: Advanced uncertainty evaluation of climate models by Monte Carlo methods 4/27 Terminology for modeling with MCMC methods The observation model in general form is y = f (x θ) + ɛ, observations = model + error. Likelihood function for Gaussian errors corresponds to a quadratic cost function, with { } p(y θ) exp 1 i n (y i f (x i θ)) 2 2 σ 2 { = exp 1 } SS(θ) 2 σ 2, where SS(θ) = 2 log(p(y θ)), the log-likelihood in "sum-of-squares" cost function format. For calculating the posterior, we also need to account SS pri (θ) = 2 log(p(θ)), the prior "sum-of-squares".
5 M.Laine: Advanced uncertainty evaluation of climate models by Monte Carlo methods 5/27 Metropolis-Hastings algorithm Random walk Metropolis-Hastings algorithm with Gaussian proposal distribution (and Gaussian likelihood). Propose new parameter value θ prop = θ curr + ξ, where ξ N(, Σ prop ) is drawn from the proposal distribution. Accept θ prop with probability α, { α(θ curr, θ prop ) = 1 exp 1 2 ( ) SS(θprop ) SS(θ curr ) 1 2 σ 2 ( SS pri (θ prop ) SS pri (θ curr ) )} Efficient proposal distribution adaptive tuning of Σ prop, AM, DRAM algorithms.
6 M.Laine: Advanced uncertainty evaluation of climate models by Monte Carlo methods 6/27 Short chains and adaptation It is important to make short chains as efficient as possible. Efficient: produce estimates with small Monte Carlo error..5.4 mean of the 1. parameter mh am dram ram % quantile mh am dram ram simulation index simulation index Short MCMC chain repeated 1 times with different algorithms. Gaussian 1 dimensional target, too large initial covariance.
7 M.Laine: Advanced uncertainty evaluation of climate models by Monte Carlo methods 7/27 Short chains and adaptation But, adaptation might slow the convergence mean of the 1. parameter mh am dram ram % quantile mh am dram ram simulation index simulation index Same as in the previous slide, but now with more optimal initial proposal. Gaussian 1 dimensional target, near optimal initial covariance.
8 M.Laine: Advanced uncertainty evaluation of climate models by Monte Carlo methods 8/27 Faster MCMC: parallel chains Random walk MCMC is by nature sequential, and it is generally more efficient to run one long chain than many short independent chains. In parallel adaptive MCMC, the adaptation is done over the points in all chains and they share one common adapted proposal covariance. Communication between the chains can be asynchronous. θi+1 N(θi, Σi) π(θi+1) p(θi+1)l(y θi+1) θi+1 N(θi, Σi) π(θi+1) p(θi+1)l(y θi+1) θi+1 N(θi, Σi) π(θi+1) p(θi+1)l(y θi+1) α =min(1, π(θi+1)/π(θi)) α =min(1, π(θi+1)/π(θi)) α =min(1, π(θi+1)/π(θi)) θi+1 = θi + 1 (θi θi) i +1 Σi+1 = i 1 Σi + 1 (θi θi)(θi θi)t i i
9 M.Laine: Advanced uncertainty evaluation of climate models by Monte Carlo methods 9/27 Faster MCMC: early rejection Idea: evaluate the likelihood in parts and check after each part if the proposed parameter value can be rejected. Cumulative cost function evaluated after each month during one year climate model simulation COST FUNCTION VALUE MONTH Early rejection month time to stop the simulation proportion of stopped runs by month This simple trick saved 1% 8% of CPU time in different test cases.
10 M.Laine: Advanced uncertainty evaluation of climate models by Monte Carlo methods 1/27 Early rejection In many cases SS(θ) is a monotonically increasing function wrt. adding new observations or simulating the model further in time. With the acceptance probability α(θ curr, θ prop ) defined in previous slides, we draw u U(, 1), and accept if 2 log(u) < SS(θ prop) SS(θ curr ) σ 2 + SS pri (θ prop ) SS pri (θ curr ). If we write this as SS crit = 2 log(u) + SS(θ curr )/σ 2 + SS pri (θ curr ) < SS(θ prop )/σ 2 + SS pri (θ prop ), then we can stop evaluating the model when SS(θ prop ) (SS crit SS pri (θ prop ))σ 2.
11 MCMC for ECHAM5 climate model Studies on feasibility of MCMC for large scale climate models, on the formulation of the likelihood and on the problem of chaotic behaviour of the models. H. Järvinen, P. Räisänen, M. Laine, J. Tamminen, A. Ilin, E. Oja, A. Solonen, H. Haario: Estimation of ECHAM5 climate model closure parameters with adaptive MCMC, Atmospheric Chemistry and Physics, 1(1), pages , 21. doi:1.5194/acp J. Hakkarainen, A. Ilin, A. Solonen, M. Laine, H. Haario, J. Tamminen, E. Oja, H. Järvinen: On closure parameter estimation in chaotic systems, Nonlinear Processes in Geophysics, 19(1), pages , 212. doi:1.5194/npg A. Solonen, P. Ollinaho, M. Laine, H. Haario, J. Tamminen, H. Järvinen: Efficient MCMC for climate model parameter estimation: parallel adaptive chains and early rejection, Bayesian Analysis, 7(2), M.Laine: Advanced uncertainty evaluation of climate models by Monte Carlo methods 11/27
12 Climate model parametrization In climate models, the atmosphere is divided into cells. The scale of many important processes is smaller than a single cell (e.g. clouds and rain). These processes are parametrized: for example clouds and rain are calculated based on the knowledge of the 2.3. Performance and Metricshumidity for Climate Models Chapter 2. Modeling Climate temperature in the cell. Figure 2.2: The grid points that ECHAM5 uses in horizontal resolution T21. M.Laine: Advanced uncertainty evaluation of climate models by Monte Carlo methods 12/27
13 M.Laine: Advanced uncertainty evaluation of climate models by Monte Carlo methods 13/27 Stochastic Lorenz 95 test case We have 4 slow state variables - - and 32 fast state variables - -, whose effect is parametrized in the forecast model. Good test case to study: Estimation methodologies. Different parameterizations g(x k, θ). Modeling error. Filtering and ensemble methods. dxk dt NATURE: = xk 1 (xk 2 xk+1) xk + F hc b Jk j=j(k 1)+1 dyj dt = cbyj+1 (yj+2 yj 1) cyj + c hc Fy + b b x 1+ j 1 J FORECAST MODEL: dxk = xk 1 (xk 2 xk+1) xk + F g(xk, θ) dt yj Wilks, D.: Effects of stochastic parametrizations in the Lorenz 96 system, Quart. J. Roy. Meteor. Soc., 131(66), , 25. doi:1.1256/qj.4.3
14 M.Laine: Advanced uncertainty evaluation of climate models by Monte Carlo methods 14/27 Lorenz 95 true forcing vs. parameterization forcing due to fast variables slow variables The true effect of the fast variables wrt. the values of the slow variables in full model simulation. Red lines give estimated optimal linear parameterization and its uncertainty.
15 M.Laine: Advanced uncertainty evaluation of climate models by Monte Carlo methods 15/27 Climate model parametrization Currently, best expert knowledge is used to define the optimal closure parameter values, based on observations, process studies, etc. Closure parameters act as tuning handles of the simulated climate. Our goal is to come up with an objective, algorithmic way to determine the closure parameters. ECHAM5 parameters estimated by MCMC and ensemble methods: Parameter Description CAULOC A parameter influencing the accretion of cloud droplets by precipitation (rain formation in stratiform clouds). CMFCTOP Relative cloud mass flux at the level above non-buoyancy (in cumulus mass flux scheme). CPRCON A coefficient for determining conversion from cloud water to rain (in convective clouds). ENTRSCV Entrainment rate for shallow convection.
16 M.Laine: Advanced uncertainty evaluation of climate models by Monte Carlo methods 16/27 Cost function - likelihood For climate model parameter estimation, it is essential to define a metric with which we can measure the goodness of the parameters. In our MCMC experiments, we have specified different cost functions based on the net radiation at the top of the atmosphere. Example: global F and zonal F t,x modeled mean fluxes are compared to the observed ones, F o and F o t,x. J(θ) = (F Fo ) 2 σ t=1 y (F t,x F o t,x )2 σ 2 t,x
17 ECHAM5 MCMC results chain histograms pairwise chains CAULOC CAULOC CMFCTOP CMFCTOP CPRCON ENTRSCV CPRCON x CMFCTOP sqrt(costf.) x 1 3 sqrt(costf.) ENTRSCV x CPRCON ENTRSCV x 1 3 x 1 3 Conducting a MCMC experiment of about 3 one year climate model runs (ECHAM5 in T21 resolution), required 3 months worth of super computer time. M.Laine: Advanced uncertainty evaluation of climate models by Monte Carlo methods 17/27
18 EPPES ensemble prediction and parameter estimation system Estimating closure parameters using ensemble runs. Initially aimed for estimating numerical weather prediction (NWP) model closure parameters using existing operational ensemble prediction (EPS) infra-structure. But usable for climate model uncertainty analysis, too. M. Laine, A. Solonen, H. Haario, H. Järvinen: Ensemble prediction and parameter estimation system: the method, Quarterly Journal of the Royal Meteorological Society, 138(663), 212. doi:1.12/qj.922 H. Järvinen, M. Laine, A. Solonen, H. Haario: Ensemble prediction and parameter estimation system: the concept, Quarterly Journal of the Royal Meteorological Society, 138(663), 212. doi:1.12/qj.923 P. Ollinaho, H. Järvinen, M. Laine, A. Solonen, H. Haario: NWP model forecast skill optimization via closure parameter variations, Quarterly Journal of the Royal Meteorological Society, in revision, 212. M.Laine: Advanced uncertainty evaluation of climate models by Monte Carlo methods 18/27
19 M.Laine: Advanced uncertainty evaluation of climate models by Monte Carlo methods 19/27 The EPPES concept for NWP EPPES = EPS + parameter estimation. In addition to initial value perturbations, model parameters θ are sampled from a proposal distribution. The parameters are weighted according to a cost function that depends on forecast skill. The background uncertainty in θ is modeled as Gaussian θ N(µ, Σ) with µ and Σ estimated sequentially. 2 model space * * parameter space *
20 Cost function and likelihood Cost function for model F, observations y k, initial values x k, and parameter θ k for forecast time window k: (y k F(x k ; θ k )) Σ 1 obs (y k F(x k ; θ k )) + (θ k µ) Σ 1 (θ k µ) interpreted as a statistical inverse problem: = J obs + J pri, p(θ k y k ) exp( 1 2 J obs) exp( 1 2 J pri) p(y k θ k )p(θ k ) = likelihood prior. In EPPES we are estimating local parameters θ k by importance sampling for p(θ k y k ), and also the optimal global hyper parameters µ and Σ that describe the variability in θ between the time windows by sequential updates. M.Laine: Advanced uncertainty evaluation of climate models by Monte Carlo methods 2/27
21 M.Laine: Advanced uncertainty evaluation of climate models by Monte Carlo methods 21/27 Random effect model The true value of the parameter θ is treated as random. The distribution generating individual θ k for each forecast time window is assumed Gaussian and the parameters of this "meta" distribution are estimated sequentially. The model: θ k N(µ k, Σ k ) µ k N(µ k 1, W k 1 ) Σ k iwish(σ k 1, n k 1 ). with the following update formulas: ( ) 1 W k = W 1 k 1 + Σ 1 k 1 ( ) µ k = W k W 1 k 1 µ k 1 + Σ 1 k 1 θ k n k = n k Σ k = ( n k 1 Σ k 1 + (θ i µ k )(θ k µ k ) ) /n k
22 Stochastic Lorenz 95 test case We parameterize the effect of the fast states - - using linear model with two closure parameters in g(x k, θ) of the forecast model. We run 5 member ensembles sequentially by perturbing both the initial values and the closure parameters. We observe some of the slow variables every 2nd "day" of the truth run with added observation error. Cost function is constructed using 6 day forecast skill. dxk dt NATURE: = xk 1 (xk 2 xk+1) xk + F hc b Jk j=j(k 1)+1 dyj dt = cbyj+1 (yj+2 yj 1) cyj + c hc Fy + b b x 1+ j 1 J FORECAST MODEL: dxk = xk 1 (xk 2 xk+1) xk + F g(xk, θ) dt yj M.Laine: Advanced uncertainty evaluation of climate models by Monte Carlo methods 22/27
23 Stochastic Lorenz 95 experiment Evolution of two parameters in the L95 experiment. On left, each column of points corresponds to proposed parameter values in one time window of the sequential estimation procedure. On right, forecast skill is calculated over a grid, with an ellipse and dot showing the final estimated Σ and µ. parameter evolution "6 day" forecast skill θ Ensemble number θ M.Laine: Advanced uncertainty evaluation of climate models by Monte Carlo methods 23/27
24 M.Laine: Advanced uncertainty evaluation of climate models by Monte Carlo methods 24/27 ECHAM5 climate model experiment ECHAM5 atmospheric general circulation model was run in ensemble prediction (EPS) mode to estimate of 4 closure parameters related to cloud formation. Control run and 5 perturbed members. Initial states from ECMWF EPS system, with data from Jan 211 to March 211, and 12UTC daily. Model resolution: T42 truncation with 31 levels. Total of = 918 parameter sample points. Cost function: RMS of 5 hpa geopotential height 1 days forecast error.
25 M.Laine: Advanced uncertainty evaluation of climate models by Monte Carlo methods 25/27 ECHAM5 experiment First iteration vs. last iteration as 2 dimensional plots showing the proposed parameter values, the weights they have received, and the matrices Σ and W of the EPPES algorithm. CMFCTOP 1: :: CMFCTOP 1: :: CPRCON.1.5 CPRCON x x 1 3 ENTRSCV ENTRSCV CAULOC.5 1 CMFCTOP.1.2 CPRCON 2 4 CAULOC.5 1 CMFCTOP.1.2 CPRCON
26 M.Laine: Advanced uncertainty evaluation of climate models by Monte Carlo methods 26/27 ECHAM5 ECHAM5 validation validation RMSE variability using default parameters in blue and using RMS variability using default parameters in blue and using the the EPPES optimized parameter values in red. Independent EPPES optimised parameter values in red. Independentdatabut data with but the with same the cost same function cost function as in optimization. as in the optimization. 211, April 211 a hPa geopotential height RMSE default parameters forecast length (days) about 6 hour increase in the forecast skill optimized parameters M.Laine: Numerical weather prediction model tuning via ensemble prediction system 1/14
27 M.Laine: Advanced uncertainty evaluation of climate models by Monte Carlo methods 27/27 Conclusions and ongoing research MCMC can be applied to climate models with the help of adaptation and other speed up tricks, but the problem lies in the formulation of the cost function. Existing ensemble run infrastructures can be used to infer about model parameters in NWP and this methodology can be used with climate models, also. MCMC runs, even short ones, are useful to pinpoint problems in parametrizations, formulation of the cost function, etc. Which climate model fields to include in the cost function and how to scale and weight multi-criteria cost function terms? Can filtering method be used in defining climate model cost function? How well do locally tuned parameter work in longer simulations?
Model parameters of chaotic dynamics: metrics for comparing trajectories
Model parameters of chaotic dynamics: metrics for comparing trajectories H. Haario 1,2, L.Kalachev 3, J. Hakkarainen 2, A. Bibov 1, FMI people June 25, 215 1 Lappeenranta University of Technology, Finland
More informationNWP model forecast skill optimization via closure parameter variations
Quarterly Journal of the Royal Meteorological Society Q. J. R. Meteorol. Soc. 139: 1520 1532, July 2013 B NWP model forecast skill optimization via closure parameter variations Pirkka Ollinaho, a,b * Marko
More informationCorrelation integral likelihood for stochastic differential equations
Correlation integral likelihood for stochastic differential equations Heikki Haario, Janne Hakkarainen, Ramona Maraia, Sebastian Springer Abstract A new approach was recently introduced for the task of
More informationAEROSOL MODEL SELECTION AND UNCERTAINTY MODELLING BY RJMCMC TECHNIQUE
AEROSOL MODEL SELECTION AND UNCERTAINTY MODELLING BY RJMCMC TECHNIQUE Marko Laine 1, Johanna Tamminen 1, Erkki Kyrölä 1, and Heikki Haario 2 1 Finnish Meteorological Institute, Helsinki, Finland 2 Lappeenranta
More informationJanne Hakkarainen ON STATE AND PARAMETER ESTIMATION IN CHAOTIC SYSTEMS. Acta Universitatis Lappeenrantaensis 545
Janne Hakkarainen ON STATE AND PARAMETER ESTIMATION IN CHAOTIC SYSTEMS Thesis for the degree of Doctor of Philosophy to be presented with due permission for public examination and criticism in the Auditorium
More informationComputer Practical: Metropolis-Hastings-based MCMC
Computer Practical: Metropolis-Hastings-based MCMC Andrea Arnold and Franz Hamilton North Carolina State University July 30, 2016 A. Arnold / F. Hamilton (NCSU) MH-based MCMC July 30, 2016 1 / 19 Markov
More informationMarkov chain Monte Carlo methods in atmospheric remote sensing
1 / 45 Markov chain Monte Carlo methods in atmospheric remote sensing Johanna Tamminen johanna.tamminen@fmi.fi ESA Summer School on Earth System Monitoring and Modeling July 3 Aug 11, 212, Frascati July,
More informationParameter variations in prediction skill optimization at ECMWF
https://helda.helsinki.fi Parameter variations in prediction skill optimization at ECMWF Ollinaho, P. 03 Ollinaho, P, Bechtold, P, Leutbecher, M, Laine, M, Solonen, A, Haario, H & Järvinen, H 03, ' Parameter
More informationEstimation of ECHAM5 climate model closure parameters with adaptive MCMC
doi:10.5194/acp-10-9993-2010 Author(s) 2010. CC Attribution 3.0 License. Atmospheric Chemistry and Physics Estimation of ECHAM5 climate model closure parameters with adaptive MCMC H. Järvinen 1, P. Räisänen
More informationStochastic methods for representing atmospheric model uncertainties in ECMWF's IFS model
Stochastic methods for representing atmospheric model uncertainties in ECMWF's IFS model Sarah-Jane Lock Model Uncertainty, Research Department, ECMWF With thanks to Martin Leutbecher, Simon Lang, Pirkka
More informationA dilemma of the uniqueness of weather and climate model closure parameters
https://helda.helsinki.fi A dilemma of the uniqueness of weather and climate model closure parameters Hakkarainen, Janne 2013 Hakkarainen, J, Solonen, A, Ilin, A, Susiluoto, J, Laine, M, Haario, H & Järvinen,
More informationEMPIRICAL EVALUATION OF BAYESIAN OPTIMIZATION IN PARAMETRIC TUNING OF CHAOTIC SYSTEMS
Pre-print submitted to the International Journal for Uncertainty Quantification, 6 EMPIRICAL EVALUATION OF BAYESIAN OPTIMIZATION IN PARAMETRIC TUNING OF CHAOTIC SYSTEMS Mudassar Abbas,, Alexander Ilin,
More informationGaussian Process Approximations of Stochastic Differential Equations
Gaussian Process Approximations of Stochastic Differential Equations Cédric Archambeau Dan Cawford Manfred Opper John Shawe-Taylor May, 2006 1 Introduction Some of the most complex models routinely run
More informationRandomize-Then-Optimize: A Method for Sampling from Posterior Distributions in Nonlinear Inverse Problems
Randomize-Then-Optimize: A Method for Sampling from Posterior Distributions in Nonlinear Inverse Problems The MIT Faculty has made this article openly available. Please share how this access benefits you.
More informationExercises Tutorial at ICASSP 2016 Learning Nonlinear Dynamical Models Using Particle Filters
Exercises Tutorial at ICASSP 216 Learning Nonlinear Dynamical Models Using Particle Filters Andreas Svensson, Johan Dahlin and Thomas B. Schön March 18, 216 Good luck! 1 [Bootstrap particle filter for
More informationDevelopment of Stochastic Artificial Neural Networks for Hydrological Prediction
Development of Stochastic Artificial Neural Networks for Hydrological Prediction G. B. Kingston, M. F. Lambert and H. R. Maier Centre for Applied Modelling in Water Engineering, School of Civil and Environmental
More informationOn closure parameter estimation in chaotic systems
Nonlin. Processes Geophys., 19, 17 143, 1 www.nonlin-processes-geophys.net/19/17/1/ doi:1.5194/npg-19-17-1 Author(s) 1. CC Attribution 3. License. Nonlinear Processes in Geophysics On closure parameter
More informationReminder of some Markov Chain properties:
Reminder of some Markov Chain properties: 1. a transition from one state to another occurs probabilistically 2. only state that matters is where you currently are (i.e. given present, future is independent
More informationDRAGON ADVANCED TRAINING COURSE IN ATMOSPHERE REMOTE SENSING. Inversion basics. Erkki Kyrölä Finnish Meteorological Institute
Inversion basics y = Kx + ε x ˆ = (K T K) 1 K T y Erkki Kyrölä Finnish Meteorological Institute Day 3 Lecture 1 Retrieval techniques - Erkki Kyrölä 1 Contents 1. Introduction: Measurements, models, inversion
More informationconvective parameterization in an
PANDOWAE (Predictability and Dynamics of Weather Systems in the Atlantic-European Sector) is a research group of the Deutsche Forschungsgemeinschaft. Using the Plant Craig stochastic convective parameterization
More informationBayesian Methods and Uncertainty Quantification for Nonlinear Inverse Problems
Bayesian Methods and Uncertainty Quantification for Nonlinear Inverse Problems John Bardsley, University of Montana Collaborators: H. Haario, J. Kaipio, M. Laine, Y. Marzouk, A. Seppänen, A. Solonen, Z.
More informationTESTING GEOMETRIC BRED VECTORS WITH A MESOSCALE SHORT-RANGE ENSEMBLE PREDICTION SYSTEM OVER THE WESTERN MEDITERRANEAN
TESTING GEOMETRIC BRED VECTORS WITH A MESOSCALE SHORT-RANGE ENSEMBLE PREDICTION SYSTEM OVER THE WESTERN MEDITERRANEAN Martín, A. (1, V. Homar (1, L. Fita (1, C. Primo (2, M. A. Rodríguez (2 and J. M. Gutiérrez
More informationLecture 2: From Linear Regression to Kalman Filter and Beyond
Lecture 2: From Linear Regression to Kalman Filter and Beyond Department of Biomedical Engineering and Computational Science Aalto University January 26, 2012 Contents 1 Batch and Recursive Estimation
More informationEnsemble forecasting and flow-dependent estimates of initial uncertainty. Martin Leutbecher
Ensemble forecasting and flow-dependent estimates of initial uncertainty Martin Leutbecher acknowledgements: Roberto Buizza, Lars Isaksen Flow-dependent aspects of data assimilation, ECMWF 11 13 June 2007
More informationOperational and research activities at ECMWF now and in the future
Operational and research activities at ECMWF now and in the future Sarah Keeley Education Officer Erland Källén Director of Research ECMWF An independent intergovernmental organisation established in 1975
More informationBayesian parameter estimation in predictive engineering
Bayesian parameter estimation in predictive engineering Damon McDougall Institute for Computational Engineering and Sciences, UT Austin 14th August 2014 1/27 Motivation Understand physical phenomena Observations
More informationCPSC 540: Machine Learning
CPSC 540: Machine Learning MCMC and Non-Parametric Bayes Mark Schmidt University of British Columbia Winter 2016 Admin I went through project proposals: Some of you got a message on Piazza. No news is
More informationComputational statistics
Computational statistics Markov Chain Monte Carlo methods Thierry Denœux March 2017 Thierry Denœux Computational statistics March 2017 1 / 71 Contents of this chapter When a target density f can be evaluated
More informationErgodicity in data assimilation methods
Ergodicity in data assimilation methods David Kelly Andy Majda Xin Tong Courant Institute New York University New York NY www.dtbkelly.com April 15, 2016 ETH Zurich David Kelly (CIMS) Data assimilation
More information4. DATA ASSIMILATION FUNDAMENTALS
4. DATA ASSIMILATION FUNDAMENTALS... [the atmosphere] "is a chaotic system in which errors introduced into the system can grow with time... As a consequence, data assimilation is a struggle between chaotic
More informationClimate Change: the Uncertainty of Certainty
Climate Change: the Uncertainty of Certainty Reinhard Furrer, UZH JSS, Geneva Oct. 30, 2009 Collaboration with: Stephan Sain - NCAR Reto Knutti - ETHZ Claudia Tebaldi - Climate Central Ryan Ford, Doug
More informationBayesian Methods for Machine Learning
Bayesian Methods for Machine Learning CS 584: Big Data Analytics Material adapted from Radford Neal s tutorial (http://ftp.cs.utoronto.ca/pub/radford/bayes-tut.pdf), Zoubin Ghahramni (http://hunch.net/~coms-4771/zoubin_ghahramani_bayesian_learning.pdf),
More informationEdward Lorenz: Predictability
Edward Lorenz: Predictability Master Literature Seminar, speaker: Josef Schröttle Edward Lorenz in 1994, Northern Hemisphere, Lorenz Attractor I) Lorenz, E.N.: Deterministic Nonperiodic Flow (JAS, 1963)
More informationA Statistical Input Pruning Method for Artificial Neural Networks Used in Environmental Modelling
A Statistical Input Pruning Method for Artificial Neural Networks Used in Environmental Modelling G. B. Kingston, H. R. Maier and M. F. Lambert Centre for Applied Modelling in Water Engineering, School
More informationA nested sampling particle filter for nonlinear data assimilation
Quarterly Journal of the Royal Meteorological Society Q. J. R. Meteorol. Soc. : 14, July 2 A DOI:.2/qj.224 A nested sampling particle filter for nonlinear data assimilation Ahmed H. Elsheikh a,b *, Ibrahim
More informationExploring stochastic model uncertainty representations
Exploring stochastic model uncertainty representations with relevance to the greyzone Sarah-Jane Lock, Martin Leutbecher, Peter Bechtold, Richard Forbes Research Department, ECMWF ECMWF November 15, 2017
More informationCalibration of Stochastic Volatility Models using Particle Markov Chain Monte Carlo Methods
Calibration of Stochastic Volatility Models using Particle Markov Chain Monte Carlo Methods Jonas Hallgren 1 1 Department of Mathematics KTH Royal Institute of Technology Stockholm, Sweden BFS 2012 June
More informationShort tutorial on data assimilation
Mitglied der Helmholtz-Gemeinschaft Short tutorial on data assimilation 23 June 2015 Wolfgang Kurtz & Harrie-Jan Hendricks Franssen Institute of Bio- and Geosciences IBG-3 (Agrosphere), Forschungszentrum
More informationBayesian Estimation of Input Output Tables for Russia
Bayesian Estimation of Input Output Tables for Russia Oleg Lugovoy (EDF, RANE) Andrey Polbin (RANE) Vladimir Potashnikov (RANE) WIOD Conference April 24, 2012 Groningen Outline Motivation Objectives Bayesian
More informationForecasting and data assimilation
Supported by the National Science Foundation DMS Forecasting and data assimilation Outline Numerical models Kalman Filter Ensembles Douglas Nychka, Thomas Bengtsson, Chris Snyder Geophysical Statistics
More informationMonte Carlo in Bayesian Statistics
Monte Carlo in Bayesian Statistics Matthew Thomas SAMBa - University of Bath m.l.thomas@bath.ac.uk December 4, 2014 Matthew Thomas (SAMBa) Monte Carlo in Bayesian Statistics December 4, 2014 1 / 16 Overview
More informationTutorial on Approximate Bayesian Computation
Tutorial on Approximate Bayesian Computation Michael Gutmann https://sites.google.com/site/michaelgutmann University of Helsinki Aalto University Helsinki Institute for Information Technology 16 May 2016
More informationStability of Ensemble Kalman Filters
Stability of Ensemble Kalman Filters Idrissa S. Amour, Zubeda Mussa, Alexander Bibov, Antti Solonen, John Bardsley, Heikki Haario and Tuomo Kauranne Lappeenranta University of Technology University of
More informationAn introduction to Bayesian statistics and model calibration and a host of related topics
An introduction to Bayesian statistics and model calibration and a host of related topics Derek Bingham Statistics and Actuarial Science Simon Fraser University Cast of thousands have participated in the
More informationEnvironment Canada s Regional Ensemble Kalman Filter
Environment Canada s Regional Ensemble Kalman Filter May 19, 2014 Seung-Jong Baek, Luc Fillion, Kao-Shen Chung, and Peter Houtekamer Meteorological Research Division, Environment Canada, Dorval, Quebec
More informationTC/PR/RB Lecture 3 - Simulation of Random Model Errors
TC/PR/RB Lecture 3 - Simulation of Random Model Errors Roberto Buizza (buizza@ecmwf.int) European Centre for Medium-Range Weather Forecasts http://www.ecmwf.int Roberto Buizza (buizza@ecmwf.int) 1 ECMWF
More informationUpgrade of JMA s Typhoon Ensemble Prediction System
Upgrade of JMA s Typhoon Ensemble Prediction System Masayuki Kyouda Numerical Prediction Division, Japan Meteorological Agency and Masakazu Higaki Office of Marine Prediction, Japan Meteorological Agency
More informationExploring and extending the limits of weather predictability? Antje Weisheimer
Exploring and extending the limits of weather predictability? Antje Weisheimer Arnt Eliassen s legacy for NWP ECMWF is an independent intergovernmental organisation supported by 34 states. ECMWF produces
More informationLecture 2: From Linear Regression to Kalman Filter and Beyond
Lecture 2: From Linear Regression to Kalman Filter and Beyond January 18, 2017 Contents 1 Batch and Recursive Estimation 2 Towards Bayesian Filtering 3 Kalman Filter and Bayesian Filtering and Smoothing
More informationA new Hierarchical Bayes approach to ensemble-variational data assimilation
A new Hierarchical Bayes approach to ensemble-variational data assimilation Michael Tsyrulnikov and Alexander Rakitko HydroMetCenter of Russia College Park, 20 Oct 2014 Michael Tsyrulnikov and Alexander
More informationUnified Cloud and Mixing Parameterizations of the Marine Boundary Layer: EDMF and PDF-based cloud approaches
DISTRIBUTION STATEMENT A. Approved for public release; distribution is unlimited. Unified Cloud and Mixing Parameterizations of the Marine Boundary Layer: EDMF and PDF-based cloud approaches Joao Teixeira
More informationA new iterated filtering algorithm
A new iterated filtering algorithm Edward Ionides University of Michigan, Ann Arbor ionides@umich.edu Statistics and Nonlinear Dynamics in Biology and Medicine Thursday July 31, 2014 Overview 1 Introduction
More informationThe Canadian approach to ensemble prediction
The Canadian approach to ensemble prediction ECMWF 2017 Annual seminar: Ensemble prediction : past, present and future. Pieter Houtekamer Montreal, Canada Overview. The Canadian approach. What are the
More informationInferring biomarkers for Mycobacterium avium subsp. paratuberculosis infection and disease progression in cattle using experimental data
Inferring biomarkers for Mycobacterium avium subsp. paratuberculosis infection and disease progression in cattle using experimental data 1,2,4, Gesham Magombedze, Tinevimbo Shiri, Shigetoshi Eda 4, 5,
More informationMarkov Chain Monte Carlo
Markov Chain Monte Carlo Recall: To compute the expectation E ( h(y ) ) we use the approximation E(h(Y )) 1 n n h(y ) t=1 with Y (1),..., Y (n) h(y). Thus our aim is to sample Y (1),..., Y (n) from f(y).
More informationBayesian Estimation of DSGE Models 1 Chapter 3: A Crash Course in Bayesian Inference
1 The views expressed in this paper are those of the authors and do not necessarily reflect the views of the Federal Reserve Board of Governors or the Federal Reserve System. Bayesian Estimation of DSGE
More informationLearning the hyper-parameters. Luca Martino
Learning the hyper-parameters Luca Martino 2017 2017 1 / 28 Parameters and hyper-parameters 1. All the described methods depend on some choice of hyper-parameters... 2. For instance, do you recall λ (bandwidth
More informationIntroduction to Machine Learning
Introduction to Machine Learning Brown University CSCI 1950-F, Spring 2012 Prof. Erik Sudderth Lecture 25: Markov Chain Monte Carlo (MCMC) Course Review and Advanced Topics Many figures courtesy Kevin
More informationDirect assimilation of all-sky microwave radiances at ECMWF
Direct assimilation of all-sky microwave radiances at ECMWF Peter Bauer, Alan Geer, Philippe Lopez, Deborah Salmond European Centre for Medium-Range Weather Forecasts Reading, Berkshire, UK Slide 1 17
More informationBayesian Inference and MCMC
Bayesian Inference and MCMC Aryan Arbabi Partly based on MCMC slides from CSC412 Fall 2018 1 / 18 Bayesian Inference - Motivation Consider we have a data set D = {x 1,..., x n }. E.g each x i can be the
More informationPrinciples of Bayesian Inference
Principles of Bayesian Inference Sudipto Banerjee University of Minnesota July 20th, 2008 1 Bayesian Principles Classical statistics: model parameters are fixed and unknown. A Bayesian thinks of parameters
More information(5) Multi-parameter models - Gibbs sampling. ST440/540: Applied Bayesian Analysis
Summarizing a posterior Given the data and prior the posterior is determined Summarizing the posterior gives parameter estimates, intervals, and hypothesis tests Most of these computations are integrals
More informationHorizontal resolution impact on short- and long-range forecast error
Quarterly Journal of the Royal Meteorological Society Q. J. R. Meteorol. Soc. :, April Part B Horizontal resolution impact on short- and long-range forecast error Roberto Buizza European Centre for Medium-Range
More informationMarkov Chain Monte Carlo, Numerical Integration
Markov Chain Monte Carlo, Numerical Integration (See Statistics) Trevor Gallen Fall 2015 1 / 1 Agenda Numerical Integration: MCMC methods Estimating Markov Chains Estimating latent variables 2 / 1 Numerical
More informationClustering Techniques and their applications at ECMWF
Clustering Techniques and their applications at ECMWF Laura Ferranti European Centre for Medium-Range Weather Forecasts Training Course NWP-PR: Clustering techniques and their applications at ECMWF 1/32
More informationAnswers and expectations
Answers and expectations For a function f(x) and distribution P(x), the expectation of f with respect to P is The expectation is the average of f, when x is drawn from the probability distribution P E
More informationApproximate Bayesian Computation
Approximate Bayesian Computation Michael Gutmann https://sites.google.com/site/michaelgutmann University of Helsinki and Aalto University 1st December 2015 Content Two parts: 1. The basics of approximate
More informationSeamless Prediction. Hannah Christensen & Judith Berner. Climate and Global Dynamics Division National Center for Atmospheric Research, Boulder, CO
Seamless Prediction Can we use shorter timescale forecasts to calibrate climate change projections? Hannah Christensen & Judith Berner Climate and Global Dynamics Division National Center for Atmospheric
More informationF denotes cumulative density. denotes probability density function; (.)
BAYESIAN ANALYSIS: FOREWORDS Notation. System means the real thing and a model is an assumed mathematical form for the system.. he probability model class M contains the set of the all admissible models
More informationPart 1: Expectation Propagation
Chalmers Machine Learning Summer School Approximate message passing and biomedicine Part 1: Expectation Propagation Tom Heskes Machine Learning Group, Institute for Computing and Information Sciences Radboud
More informationBayesian Calibration of Simulators with Structured Discretization Uncertainty
Bayesian Calibration of Simulators with Structured Discretization Uncertainty Oksana A. Chkrebtii Department of Statistics, The Ohio State University Joint work with Matthew T. Pratola (Statistics, The
More informationMonte Carlo methods for sampling-based Stochastic Optimization
Monte Carlo methods for sampling-based Stochastic Optimization Gersende FORT LTCI CNRS & Telecom ParisTech Paris, France Joint works with B. Jourdain, T. Lelièvre, G. Stoltz from ENPC and E. Kuhn from
More informationSome Results on the Ergodicity of Adaptive MCMC Algorithms
Some Results on the Ergodicity of Adaptive MCMC Algorithms Omar Khalil Supervisor: Jeffrey Rosenthal September 2, 2011 1 Contents 1 Andrieu-Moulines 4 2 Roberts-Rosenthal 7 3 Atchadé and Fort 8 4 Relationship
More informationA Global Atmospheric Model. Joe Tribbia NCAR Turbulence Summer School July 2008
A Global Atmospheric Model Joe Tribbia NCAR Turbulence Summer School July 2008 Outline Broad overview of what is in a global climate/weather model of the atmosphere Spectral dynamical core Some results-climate
More informationData Assimilation Research Testbed Tutorial
Data Assimilation Research Testbed Tutorial Section 2: How should observations of a state variable impact an unobserved state variable? Multivariate assimilation. Single observed variable, single unobserved
More informationImproved analyses and forecasts with AIRS retrievals using the Local Ensemble Transform Kalman Filter
Improved analyses and forecasts with AIRS retrievals using the Local Ensemble Transform Kalman Filter Hong Li, Junjie Liu, and Elana Fertig E. Kalnay I. Szunyogh, E. J. Kostelich Weather and Chaos Group
More informationInverse problems and uncertainty quantification in remote sensing
1 / 38 Inverse problems and uncertainty quantification in remote sensing Johanna Tamminen Finnish Meterological Institute johanna.tamminen@fmi.fi ESA Earth Observation Summer School on Earth System Monitoring
More informationMCMC and Gibbs Sampling. Kayhan Batmanghelich
MCMC and Gibbs Sampling Kayhan Batmanghelich 1 Approaches to inference l Exact inference algorithms l l l The elimination algorithm Message-passing algorithm (sum-product, belief propagation) The junction
More informationApproximate Bayesian Computation and Particle Filters
Approximate Bayesian Computation and Particle Filters Dennis Prangle Reading University 5th February 2014 Introduction Talk is mostly a literature review A few comments on my own ongoing research See Jasra
More informationDART_LAB Tutorial Section 2: How should observations impact an unobserved state variable? Multivariate assimilation.
DART_LAB Tutorial Section 2: How should observations impact an unobserved state variable? Multivariate assimilation. UCAR 2014 The National Center for Atmospheric Research is sponsored by the National
More informationBayesian Dynamic Linear Modelling for. Complex Computer Models
Bayesian Dynamic Linear Modelling for Complex Computer Models Fei Liu, Liang Zhang, Mike West Abstract Computer models may have functional outputs. With no loss of generality, we assume that a single computer
More informationData assimilation in high dimensions
Data assimilation in high dimensions David Kelly Courant Institute New York University New York NY www.dtbkelly.com February 12, 2015 Graduate seminar, CIMS David Kelly (CIMS) Data assimilation February
More informationEXPERIMENTAL ASSIMILATION OF SPACE-BORNE CLOUD RADAR AND LIDAR OBSERVATIONS AT ECMWF
EXPERIMENTAL ASSIMILATION OF SPACE-BORNE CLOUD RADAR AND LIDAR OBSERVATIONS AT ECMWF Marta Janisková, Sabatino Di Michele, Edouard Martins ECMWF, Shinfield Park, Reading, U.K. Abstract Space-borne active
More informationLearning Static Parameters in Stochastic Processes
Learning Static Parameters in Stochastic Processes Bharath Ramsundar December 14, 2012 1 Introduction Consider a Markovian stochastic process X T evolving (perhaps nonlinearly) over time variable T. We
More informationAssessing Potential Impact of Air Pollutant Observations from the Geostationary Satellite on Air Quality Prediction through OSSEs
Assessing Potential Impact of Air Pollutant Observations from the Geostationary Satellite on Air Quality Prediction through OSSEs Ebony Lee 1,2, Seon Ki Park 1,2,3, and Milija Županski4 1 Department of
More informationRecent Data Assimilation Activities at Environment Canada
Recent Data Assimilation Activities at Environment Canada Major upgrade to global and regional deterministic prediction systems (now in parallel run) Sea ice data assimilation Mark Buehner Data Assimilation
More informationPoint, Interval, and Density Forecast Evaluation of Linear versus Nonlinear DSGE Models
Point, Interval, and Density Forecast Evaluation of Linear versus Nonlinear DSGE Models Francis X. Diebold Frank Schorfheide Minchul Shin University of Pennsylvania May 4, 2014 1 / 33 Motivation The use
More informationMCMC Sampling for Bayesian Inference using L1-type Priors
MÜNSTER MCMC Sampling for Bayesian Inference using L1-type Priors (what I do whenever the ill-posedness of EEG/MEG is just not frustrating enough!) AG Imaging Seminar Felix Lucka 26.06.2012 , MÜNSTER Sampling
More informationA Bayesian approach to non-gaussian model error modeling
A Bayesian approach to non-gaussian model error modeling Michael Tsyrulnikov and Dmitry Gayfulin HydroMetCenter of Russia München, 5 March 2018 Bayesian approach to non-gaussian model error modeling München,
More informationMultimodal Nested Sampling
Multimodal Nested Sampling Farhan Feroz Astrophysics Group, Cavendish Lab, Cambridge Inverse Problems & Cosmology Most obvious example: standard CMB data analysis pipeline But many others: object detection,
More informationOn Bayesian Computation
On Bayesian Computation Michael I. Jordan with Elaine Angelino, Maxim Rabinovich, Martin Wainwright and Yun Yang Previous Work: Information Constraints on Inference Minimize the minimax risk under constraints
More informationSeminar: Data Assimilation
Seminar: Data Assimilation Jonas Latz, Elisabeth Ullmann Chair of Numerical Mathematics (M2) Technical University of Munich Jonas Latz, Elisabeth Ullmann (TUM) Data Assimilation 1 / 28 Prerequisites Bachelor:
More informationBayesian Gaussian Process Regression
Bayesian Gaussian Process Regression STAT8810, Fall 2017 M.T. Pratola October 7, 2017 Today Bayesian Gaussian Process Regression Bayesian GP Regression Recall we had observations from our expensive simulator,
More information3.23 IMPROVING VERY-SHORT-TERM STORM PREDICTIONS BY ASSIMILATING RADAR AND SATELLITE DATA INTO A MESOSCALE NWP MODEL
3.23 IMPROVING VERY-SHORT-TERM STORM PREDICTIONS BY ASSIMILATING RADAR AND SATELLITE DATA INTO A MESOSCALE NWP MODEL Q. Zhao 1*, J. Cook 1, Q. Xu 2, and P. Harasti 3 1 Naval Research Laboratory, Monterey,
More informationLECTURE 15 Markov chain Monte Carlo
LECTURE 15 Markov chain Monte Carlo There are many settings when posterior computation is a challenge in that one does not have a closed form expression for the posterior distribution. Markov chain Monte
More informationEstimating the intermonth covariance between rainfall and the atmospheric circulation
ANZIAM J. 52 (CTAC2010) pp.c190 C205, 2011 C190 Estimating the intermonth covariance between rainfall and the atmospheric circulation C. S. Frederiksen 1 X. Zheng 2 S. Grainger 3 (Received 27 January 2011;
More informationBayes Nets: Sampling
Bayes Nets: Sampling [These slides were created by Dan Klein and Pieter Abbeel for CS188 Intro to AI at UC Berkeley. All CS188 materials are available at http://ai.berkeley.edu.] Approximate Inference:
More informationBayesian Inverse problem, Data assimilation and Localization
Bayesian Inverse problem, Data assimilation and Localization Xin T Tong National University of Singapore ICIP, Singapore 2018 X.Tong Localization 1 / 37 Content What is Bayesian inverse problem? What is
More informationModel Uncertainty Quantification for Data Assimilation in partially observed Lorenz 96
Model Uncertainty Quantification for Data Assimilation in partially observed Lorenz 96 Sahani Pathiraja, Peter Jan Van Leeuwen Institut für Mathematik Universität Potsdam With thanks: Sebastian Reich,
More informationRiemann Manifold Methods in Bayesian Statistics
Ricardo Ehlers ehlers@icmc.usp.br Applied Maths and Stats University of São Paulo, Brazil Working Group in Statistical Learning University College Dublin September 2015 Bayesian inference is based on Bayes
More information