Bayesian Hierarchical Modelling: Incorporating spatial information in water resources assessment and accounting

Size: px
Start display at page:

Download "Bayesian Hierarchical Modelling: Incorporating spatial information in water resources assessment and accounting"

Transcription

1 Bayesian Hierarchical Modelling: Incorporating spatial information in water resources assessment and accounting Grace Chiu & Eric Lehmann (CSIRO Mathematics, Informatics and Statistics) A water information R & D alliance between the Bureau of Meteorology and CSIRO s Water for a Healthy Country Flagship

2 Presentation outline Background National water accounting WIRADA research alliance Model-data fusion Soil moisture data Soil moisture in the Murrumbidgee River Catchment Ground probes vs. remote sensing vs. modelled estimates Data assimilation Bayesian hierarchical model Rationale Model structure definition Results: data blending & evaluation Summary & conclusions

3 Background National water accounting and assessment under WIRADA / AWRA Water Information Research and Development Alliance Alliance between CSIRO and the Bureau of Meteorology (BoM) Monitor status of Australia s water resources + forecasting of availability Australian Water Resources Assessment (AWRA): BoM activity component, system of models, model-data fusion Observational data in AWRA-L: used in model development, (global) parameter estimation, forcing (e.g. precipitation) Additional datasets exist with new/other characteristics Need to reconcile or integrate observed and modelled estimates.

4 Focus of this Research Soil moisture (SM) one of the possible variables of interest in WIRADA / AWRA availability of SM products: ground-based remote sensing case-study: could be replaced with any other variable... Murrumbidgee River Catchment (MRC) km 2, southern NSW, Australia availability of ground probes for benchmark SM measurements (OzNet monitoring network) case-study with aim to up-scale nationally

5 Measuring Soil Moisture 1) In-situ ground probes: OzNet, point-level SM at depth of ~ 0 5cm 2) Remote sensors, e.g. AMSR-E, ASCAT, ASAR, etc.: deterministic retrievals from brightness temperature, SM at depth of ~1 2cm 3) Physics models: e.g. AWRA-L, CABLE, etc.... not considered in our preliminary model... different temporal & spatial resolutions!

6 Data Assimilation How to reconcile/consolidate SM products and assess uncertainty? Data assimilation: via Kalman filter, particle filter, 3D-KF, etc. model-based temporal smoothing typically ignore spatial correlation (no spatial smoothing), or use nonmodel-based estimation of spatial correlation usually require manual alignment of pixels (space) and time intervals

7 Bayesian Hierarchical Modelling How to reconcile/consolidate SM products and assess uncertainty? Proposed approach: statistical spatio-temporal modelling model-based temporal smoothing model-based spatial smoothing model-based spatial alignment model-based imputation for missing data single hierarchical model for unified inference... temporal aspect not considered in current work preliminary model!

8 Proposed Bayesian Hierarchical Model Model-based spatial smoothing: at fixed time t Product q ground probes Product p AMSR-E Covariate x (driver of SM) AWAP (precip.) time 08/01/2007

9 Proposed Bayesian Hierarchical Model Model-based spatial alignment (preliminary model): linking the spatial datasets at different resolutions Product q RESPONSE Product p INFLUENCE State s Aim: benchmark AMSR-E product vs. probes... Covariate x

10 Proposed Bayesian Hierarchical Model Preliminary spatial model for SM (Murrumbidgee Catchment): every quantity is related to each other through a single model ground probes: AMSR-E SM: latent SM: AWAP: spatial patterns: explicit modelling of spatial correlation

11 Proposed Bayesian Hierarchical Model Conditional auto-regression (CAR): a form of 5 th nearestneighbour dependence with exponential decay models spatial dependence beyond one but less than two AMSR-E pixels (so that SM state is representative of AMSR-E pixels) AWAP pixel AMSR-E pixel

12 Proposed Bayesian Hierarchical Model Given model structure, the latent soil moisture (and other variables) is estimated / fitted via MCMC Gibbs sampling: ~ iterations average over last 2500 iterations basic convergence diagnostics runs in ~3.5 4 hours on standard PC (non-optimised code) implementation can be heavily parallelised

13 Spatial Model Fit: 18/01/2007 Model hierarchy (at fixed time): (p,q) s x φ Model fit for OzNet ground probes: q and

14 Spatial Model Fit: 18/01/2007 Model hierarchy (at fixed time): (p,q) s x φ p, estimate of latent SM : influence of AMSR-E, AWAP & OzNet inferring missing AMSR-E pixels : some residual bias apparent (due to influence of precipitation) posterior mean of spatial random effects : spatial autocorrelation clearly visible (motivation for proposed framework) x

15 Spatial Model Fit: 20/01/2007 Latent soil moisture: 95% credible interval (CI): (for white pixels above)... issue with SM<0 in CI due to assumptions of instruments specs (e.g. probe accuracy of ± X units)

16 Evaluating AMSR-E vs. Ground Probes model-based comparison of AMSR-E performance vs. benchmark: interpret as: AMSR-E is less precise than m-th probe by factor R m conditional variance is from a single level of model hierarchy 08/01/ /01/2007 AMSR-E is more precise...

17 Summary Preliminary Bayesian hierarchical model for SM over Murrumbidgee River Catchment:... work in progress... demonstration of statistical modelling framework unified model-based inference for SM assimilation & evaluation currently under research: investigation of bias issues review of assumptions leading to SM<0 need for additional / different covariates Future developments: addition of temporal component look at further / other datasets (OzNet contribution to SM map is minimal), including modelled estimates (e.g., AWRA-L) extension to larger and/or national scale parallelisation of implementation code

18 CSIRO Mathematics, Informatics and Statistics Eric Lehmann (presenter) Research Scientist Phone: eric.lehmann@csiro.au Web: CSIRO Mathematics, Informatics and Statistics Grace Chiu (corresponding author) Senior Research Scientist Phone: grace.chiu@csiro.au Web: Thank you Contact Us Phone: or Enquiries@csiro.au Web:

Journal of Environmental Statistics

Journal of Environmental Statistics jes Journal of Environmental Statistics February 013, Volume 4, Issue 9. http://www.jenvstat.org A Spatial Modelling Approach for the Blending and Error Characterization of Remotely Sensed Soil Moisture

More information

QPE and QPF in the Bureau of Meteorology

QPE and QPF in the Bureau of Meteorology QPE and QPF in the Bureau of Meteorology Current and future real-time rainfall products Carlos Velasco (BoM) Alan Seed (BoM) and Luigi Renzullo (CSIRO) OzEWEX 2016, 14-15 December 2016, Canberra Why do

More information

Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes

Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes Andrew O. Finley 1 and Sudipto Banerjee 2 1 Department of Forestry & Department of Geography, Michigan

More information

Can assimilating remotely-sensed surface soil moisture data improve root-zone soil moisture predictions in the CABLE land surface model?

Can assimilating remotely-sensed surface soil moisture data improve root-zone soil moisture predictions in the CABLE land surface model? 19th International Congress on Modelling and Simulation, Perth, Australia, 12 16 December 2011 http://mssanz.org.au/modsim2011 Can assimilating remotely-sensed surface soil moisture data improve root-zone

More information

Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes

Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes Sudipto Banerjee 1 and Andrew O. Finley 2 1 Biostatistics, School of Public Health, University of Minnesota,

More information

Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes

Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes Andrew O. Finley Department of Forestry & Department of Geography, Michigan State University, Lansing

More information

Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes

Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes Alan Gelfand 1 and Andrew O. Finley 2 1 Department of Statistical Science, Duke University, Durham, North

More information

Seasonal soil moisture forecasting using the AWRA landscape water balance model

Seasonal soil moisture forecasting using the AWRA landscape water balance model 22nd International Congress on Modelling and Simulation, Hobart, Tasmania, Australia, 3 to 8 December 2017 mssanz.org.au/modsim2017 Seasonal soil moisture forecasting using the AWRA landscape water balance

More information

Assimilation of satellite derived soil moisture for weather forecasting

Assimilation of satellite derived soil moisture for weather forecasting Assimilation of satellite derived soil moisture for weather forecasting www.cawcr.gov.au Imtiaz Dharssi and Peter Steinle February 2011 SMOS/SMAP workshop, Monash University Summary In preparation of the

More information

NOAA Soil Moisture Operational Product System (SMOPS): Version 2

NOAA Soil Moisture Operational Product System (SMOPS): Version 2 CICS-MD Science Meeting (November 12-13, 2014) NOAA Soil Moisture Operational Product System (SMOPS): Version 2 Jicheng Liu 1, 2, Xiwu Zhan 2, Limin Zhao 3, Christopher R. Hain 1, 2, Li Fang 1,2, Jifu

More information

Spatio-temporal precipitation modeling based on time-varying regressions

Spatio-temporal precipitation modeling based on time-varying regressions Spatio-temporal precipitation modeling based on time-varying regressions Oleg Makhnin Department of Mathematics New Mexico Tech Socorro, NM 87801 January 19, 2007 1 Abstract: A time-varying regression

More information

Land Data Assimilation for operational weather forecasting

Land Data Assimilation for operational weather forecasting Land Data Assimilation for operational weather forecasting Brett Candy Richard Renshaw, JuHyoung Lee & Imtiaz Dharssi * *Centre Australian Weather and Climate Research Contents An overview of the Current

More information

Bayesian hierarchical modelling of rainfall extremes

Bayesian hierarchical modelling of rainfall extremes Bayesian hierarchical modelling of rainfall extremes E.A. Lehmann a, A. Phatak a, S. Soltyk b, J. Chia a, R. Lau a and M. Palmer c a CSIRO Computational Informatics, Perth, WA, AUSTRALIA b Curtin University

More information

Making rating curves - the Bayesian approach

Making rating curves - the Bayesian approach Making rating curves - the Bayesian approach Rating curves what is wanted? A best estimate of the relationship between stage and discharge at a given place in a river. The relationship should be on the

More information

The Canadian Land Data Assimilation System (CaLDAS)

The Canadian Land Data Assimilation System (CaLDAS) The Canadian Land Data Assimilation System (CaLDAS) Marco L. Carrera, Stéphane Bélair, Bernard Bilodeau and Sheena Solomon Meteorological Research Division, Environment Canada Dorval, QC, Canada 2 nd Workshop

More information

Data Integration Model for Air Quality: A Hierarchical Approach to the Global Estimation of Exposures to Ambient Air Pollution

Data Integration Model for Air Quality: A Hierarchical Approach to the Global Estimation of Exposures to Ambient Air Pollution Data Integration Model for Air Quality: A Hierarchical Approach to the Global Estimation of Exposures to Ambient Air Pollution Matthew Thomas 9 th January 07 / 0 OUTLINE Introduction Previous methods for

More information

DRAGON ADVANCED TRAINING COURSE IN ATMOSPHERE REMOTE SENSING. Inversion basics. Erkki Kyrölä Finnish Meteorological Institute

DRAGON ADVANCED TRAINING COURSE IN ATMOSPHERE REMOTE SENSING. Inversion basics. Erkki Kyrölä Finnish Meteorological Institute Inversion basics y = Kx + ε x ˆ = (K T K) 1 K T y Erkki Kyrölä Finnish Meteorological Institute Day 3 Lecture 1 Retrieval techniques - Erkki Kyrölä 1 Contents 1. Introduction: Measurements, models, inversion

More information

Multilevel Statistical Models: 3 rd edition, 2003 Contents

Multilevel Statistical Models: 3 rd edition, 2003 Contents Multilevel Statistical Models: 3 rd edition, 2003 Contents Preface Acknowledgements Notation Two and three level models. A general classification notation and diagram Glossary Chapter 1 An introduction

More information

Land data assimilation in the NASA GEOS-5 system: Status and challenges

Land data assimilation in the NASA GEOS-5 system: Status and challenges Blueprints for Next-Generation Data Assimilation Systems Boulder, CO, USA 8-10 March 2016 Land data assimilation in the NASA GEOS-5 system: Status and challenges Rolf Reichle Clara Draper, Ricardo Todling,

More information

De-noising of passive and active microwave satellite soil moisture time series

De-noising of passive and active microwave satellite soil moisture time series See discussions, stats, and author profiles for this publication at: https://www.researchgate.net/publication/6461315 De-noising of passive and active microwave ellite soil moisture time series Article

More information

Parameter Estimation in the Spatio-Temporal Mixed Effects Model Analysis of Massive Spatio-Temporal Data Sets

Parameter Estimation in the Spatio-Temporal Mixed Effects Model Analysis of Massive Spatio-Temporal Data Sets Parameter Estimation in the Spatio-Temporal Mixed Effects Model Analysis of Massive Spatio-Temporal Data Sets Matthias Katzfuß Advisor: Dr. Noel Cressie Department of Statistics The Ohio State University

More information

A temporal stability analysis of the Australian SMAP mission validation site

A temporal stability analysis of the Australian SMAP mission validation site 20th International Congress on Modelling and Simulation, Adelaide, Australia, 1 6 December 2013 www.mssanz.org.au/modsim2013 A temporal stability analysis of the Australian SMAP mission validation site

More information

Predicting daily total phosphorus and suspended solids across Wisconsin stream reaches for impairment assessment

Predicting daily total phosphorus and suspended solids across Wisconsin stream reaches for impairment assessment Predicting daily total phosphorus and suspended solids across Wisconsin stream reaches for impairment assessment Alex Latzka & Matt Diebel AWRA WI 10 March 2017 Alexander.Latzka@wisconsin.gov Matthew.Diebel@wisconsin.gov

More information

Satellite Soil Moisture in Research Applications

Satellite Soil Moisture in Research Applications Satellite Soil Moisture in Research Applications Richard de Jeu richard.de.jeu@falw.vu.nl Thomas Holmes, Hylke Beck, Guojie Wang, Han Dolman (VUA) Manfred Owe (NASA-GSFC) Albert Van Dijk, Yi Liu (CSIRO)

More information

Performance evaluation of the national 7-day water forecast service

Performance evaluation of the national 7-day water forecast service 22nd International Congress on Modelling and Simulation, Hobart, Tasmania, Australia, 3 to 8 December 2017 mssanz.org.au/modsim2017 Performance evaluation of the national 7-day water forecast service H.A.P.

More information

BUREAU OF METEOROLOGY

BUREAU OF METEOROLOGY BUREAU OF METEOROLOGY Building an Operational National Seasonal Streamflow Forecasting Service for Australia progress to-date and future plans Dr Narendra Kumar Tuteja Manager Extended Hydrological Prediction

More information

Spatial Statistics with Image Analysis. Outline. A Statistical Approach. Johan Lindström 1. Lund October 6, 2016

Spatial Statistics with Image Analysis. Outline. A Statistical Approach. Johan Lindström 1. Lund October 6, 2016 Spatial Statistics Spatial Examples More Spatial Statistics with Image Analysis Johan Lindström 1 1 Mathematical Statistics Centre for Mathematical Sciences Lund University Lund October 6, 2016 Johan Lindström

More information

Gaussian Process Approximations of Stochastic Differential Equations

Gaussian Process Approximations of Stochastic Differential Equations Gaussian Process Approximations of Stochastic Differential Equations Cédric Archambeau Dan Cawford Manfred Opper John Shawe-Taylor May, 2006 1 Introduction Some of the most complex models routinely run

More information

Towards global water and energy balance monitoring using GCOM-W1 in the Australian Murray-Darling basin

Towards global water and energy balance monitoring using GCOM-W1 in the Australian Murray-Darling basin FY2013 Progress Report To: the Japan Aerospace Exploration Agency Project title: Towards global water and energy balance monitoring using GCOM-W1 in the Australian Murray-Darling basin Specification No:

More information

A Cotton Irrigator s Decision Support System Using National, Regional and Local Data

A Cotton Irrigator s Decision Support System Using National, Regional and Local Data A Cotton Irrigator s Decision Support System Using National, Regional and Local Data ISESS 2015, Melbourne Jamie Vleeshouwer, Nicholas J. Car, John Hornbuckle 26 March 2015 LAND & WATER FLAGSHIP / AGRICULTURE

More information

European High-Resolution Soil Moisture Analysis (EHRSOMA)

European High-Resolution Soil Moisture Analysis (EHRSOMA) European High-Resolution Soil Moisture Analysis (EHRSOMA) Jasmin Vural EUMETSAT Fellow Day, 05.03.2018 European High-Resolution Soil Moisture Analysis (EHRSOMA) Jasmin Vural EUMETSAT Fellow Day, 05.03.2018

More information

State-space calibration of radar rainfall and stochastic flow forecasting for use in real-time Control of urban drainage systems

State-space calibration of radar rainfall and stochastic flow forecasting for use in real-time Control of urban drainage systems State-space calibration of radar rainfall and stochastic flow forecasting for use in real-time Control of urban drainage systems 9th Int. Conf. On Urban Drainage Modeling Roland Löwe *, Peter Steen Mikkelsen,

More information

Enhancing Weather Forecasts via Assimilating SMAP Soil Moisture and NRT GVF

Enhancing Weather Forecasts via Assimilating SMAP Soil Moisture and NRT GVF CICS Science Meeting, ESSIC, UMD, 2016 Enhancing Weather Forecasts via Assimilating SMAP Soil Moisture and NRT GVF Li Fang 1,2, Christopher Hain 1,2, Xiwu Zhan 2, Min Huang 1,2 Jifu Yin 1,2, Weizhong Zheng

More information

REQUIREMENTS FOR WEATHER RADAR DATA. Review of the current and likely future hydrological requirements for Weather Radar data

REQUIREMENTS FOR WEATHER RADAR DATA. Review of the current and likely future hydrological requirements for Weather Radar data WORLD METEOROLOGICAL ORGANIZATION COMMISSION FOR BASIC SYSTEMS OPEN PROGRAMME AREA GROUP ON INTEGRATED OBSERVING SYSTEMS WORKSHOP ON RADAR DATA EXCHANGE EXETER, UK, 24-26 APRIL 2013 CBS/OPAG-IOS/WxR_EXCHANGE/2.3

More information

The sbgcop Package. March 9, 2007

The sbgcop Package. March 9, 2007 The sbgcop Package March 9, 2007 Title Semiparametric Bayesian Gaussian copula estimation Version 0.95 Date 2007-03-09 Author Maintainer This package estimates parameters of

More information

Development of Stochastic Artificial Neural Networks for Hydrological Prediction

Development of Stochastic Artificial Neural Networks for Hydrological Prediction Development of Stochastic Artificial Neural Networks for Hydrological Prediction G. B. Kingston, M. F. Lambert and H. R. Maier Centre for Applied Modelling in Water Engineering, School of Civil and Environmental

More information

Land Data Assimilation and the (Coordinated) National Soil Moisture Network

Land Data Assimilation and the (Coordinated) National Soil Moisture Network Land Data Assimilation and the (Coordinated) National Soil Moisture Network Wade Crow USDA ARS Hydrology and Remote Sensing Laboratory Alexander Gruber, Wouter Dorigo TU-Wien, Department of Geodesy and

More information

Evaluation of remotely sensed and modelled soil moisture products using global ground-based in situ observations

Evaluation of remotely sensed and modelled soil moisture products using global ground-based in situ observations Evaluation of remotely sensed and modelled soil moisture products using global ground-based in situ observations C. Albergel (1), P. de Rosnay (1), G. Balsamo (1),J. Muñoz-Sabater(1 ), C. Gruhier (2),

More information

Global Assimilation of Multi-Angle and Multi-Polarization SMOS. Brightness Temperature Observations into the GEOS-5

Global Assimilation of Multi-Angle and Multi-Polarization SMOS. Brightness Temperature Observations into the GEOS-5 Generated using version 3.1.2 of the official AMS L A TEX template 1 Global Assimilation of Multi-Angle and Multi-Polarization SMOS 2 Brightness Temperature Observations into the GEOS-5 3 Catchment Land

More information

Assimilation of passive and active microwave soil moisture retrievals

Assimilation of passive and active microwave soil moisture retrievals GEOPHYSICAL RESEARCH LETTERS, VOL. 39,, doi:10.1029/2011gl050655, 2012 Assimilation of passive and active microwave soil moisture retrievals C. S. Draper, 1,2 R. H. Reichle, 1 G. J. M. De Lannoy, 1,2,3

More information

The effect of spatial rainfall variability on streamflow prediction for a south-eastern Australian catchment

The effect of spatial rainfall variability on streamflow prediction for a south-eastern Australian catchment 19th International Congress on Modelling and Simulation, Perth, Australia, 12 16 December 2011 http://mssanz.org.au/modsim2011 The effect of spatial rainfall variability on streamflow prediction for a

More information

A new mesoscale NWP system for Australia

A new mesoscale NWP system for Australia A new mesoscale NWP system for Australia www.cawcr.gov.au Peter Steinle on behalf of : Earth System Modelling (ESM) and Weather&Environmental Prediction (WEP) Research Programs, CAWCR Data Assimilation

More information

Towards a probabilistic hydrological forecasting and data assimilation system. Henrik Madsen DHI, Denmark

Towards a probabilistic hydrological forecasting and data assimilation system. Henrik Madsen DHI, Denmark Towards a probabilistic hydrological forecasting and data assimilation system Henrik Madsen DHI, Denmark Outline Hydrological forecasting Data assimilation framework Data assimilation experiments Concluding

More information

Recap on Data Assimilation

Recap on Data Assimilation Concluding Thoughts Recap on Data Assimilation FORECAST ANALYSIS Kalman Filter Forecast Analysis Analytical projection of the ANALYSIS mean and cov from t-1 to the FORECAST mean and cov for t Update FORECAST

More information

Bayesian spatial hierarchical modeling for temperature extremes

Bayesian spatial hierarchical modeling for temperature extremes Bayesian spatial hierarchical modeling for temperature extremes Indriati Bisono Dr. Andrew Robinson Dr. Aloke Phatak Mathematics and Statistics Department The University of Melbourne Maths, Informatics

More information

THE ROLE OF MICROSTRUCTURE IN FORWARD MODELING AND DATA ASSIMILATION SCHEMES: A CASE STUDY IN THE KERN RIVER, SIERRA NEVADA, USA

THE ROLE OF MICROSTRUCTURE IN FORWARD MODELING AND DATA ASSIMILATION SCHEMES: A CASE STUDY IN THE KERN RIVER, SIERRA NEVADA, USA MICHAEL DURAND (DURAND.8@OSU.EDU), DONGYUE LI, STEVE MARGULIS Photo: Danielle Perrot THE ROLE OF MICROSTRUCTURE IN FORWARD MODELING AND DATA ASSIMILATION SCHEMES: A CASE STUDY IN THE KERN RIVER, SIERRA

More information

Fundamentals of Data Assimila1on

Fundamentals of Data Assimila1on 014 GSI Community Tutorial NCAR Foothills Campus, Boulder, CO July 14-16, 014 Fundamentals of Data Assimila1on Milija Zupanski Cooperative Institute for Research in the Atmosphere Colorado State University

More information

Investigating alternative techniques for incorporating remote sensing, gridded climate and terrain data into a semi-distributed modelling framework

Investigating alternative techniques for incorporating remote sensing, gridded climate and terrain data into a semi-distributed modelling framework Investigating alternative techniques for incorporating remote sensing, gridded climate and terrain data into a semi-distributed modelling framework Tim R. McVicar, Tom G. Van Niel and Albert Van Dijk July

More information

An Efficient Ensemble Data Assimilation Approach To Deal With Range Limited Observation

An Efficient Ensemble Data Assimilation Approach To Deal With Range Limited Observation An Efficient Ensemble Data Assimilation Approach To Deal With Range Limited Observation A. Shah 1,2, M. E. Gharamti 1, L. Bertino 1 1 Nansen Environmental and Remote Sensing Center 2 University of Bergen

More information

A Statistical Framework for Analysing Big Data Global Conference on Big Data for Official Statistics October, 2015 by S Tam, Chief

A Statistical Framework for Analysing Big Data Global Conference on Big Data for Official Statistics October, 2015 by S Tam, Chief A Statistical Framework for Analysing Big Data Global Conference on Big Data for Official Statistics 20-22 October, 2015 by S Tam, Chief Methodologist Australian Bureau of Statistics 1 Big Data (BD) Issues

More information

2D Image Processing. Bayes filter implementation: Kalman filter

2D Image Processing. Bayes filter implementation: Kalman filter 2D Image Processing Bayes filter implementation: Kalman filter Prof. Didier Stricker Kaiserlautern University http://ags.cs.uni-kl.de/ DFKI Deutsches Forschungszentrum für Künstliche Intelligenz http://av.dfki.de

More information

Predictive spatio-temporal models for spatially sparse environmental data. Umeå University

Predictive spatio-temporal models for spatially sparse environmental data. Umeå University Seminar p.1/28 Predictive spatio-temporal models for spatially sparse environmental data Xavier de Luna and Marc G. Genton xavier.deluna@stat.umu.se and genton@stat.ncsu.edu http://www.stat.umu.se/egna/xdl/index.html

More information

Remotely Sensed Soil Moisture over Australia from AMSR-E

Remotely Sensed Soil Moisture over Australia from AMSR-E Remotely Sensed Soil Moisture over Australia from AMSR-E Draper, C. S. 1,2, J.P. Walker 1, P.J. Steinle 2, R.A.M. de Jeu 3, and T.R.H. Holmes 3 1 Department of Civil and Environmental Engineering, University

More information

Integrated Non-Factorized Variational Inference

Integrated Non-Factorized Variational Inference Integrated Non-Factorized Variational Inference Shaobo Han, Xuejun Liao and Lawrence Carin Duke University February 27, 2014 S. Han et al. Integrated Non-Factorized Variational Inference February 27, 2014

More information

Spatial bias modeling with application to assessing remotely-sensed aerosol as a proxy for particulate matter

Spatial bias modeling with application to assessing remotely-sensed aerosol as a proxy for particulate matter Spatial bias modeling with application to assessing remotely-sensed aerosol as a proxy for particulate matter Chris Paciorek Department of Biostatistics Harvard School of Public Health application joint

More information

On the use of radar rainfall estimates and nowcasts in an operational heavy rainfall warning service

On the use of radar rainfall estimates and nowcasts in an operational heavy rainfall warning service On the use of radar rainfall estimates and nowcasts in an operational heavy rainfall warning service Alan Seed, Ross Bunn, Aurora Bell Bureau of Meteorology Australia The Centre for Australian Weather

More information

Statistical Inference for Food Webs

Statistical Inference for Food Webs Statistical Inference for Food Webs Part I: Bayesian Melding Grace Chiu and Josh Gould Department of Statistics & Actuarial Science CMAR-Hobart Science Seminar, March 6, 2009 1 Outline CMAR-Hobart Science

More information

H-SAF future developments on Convective Precipitation Retrieval

H-SAF future developments on Convective Precipitation Retrieval H-SAF future developments on Convective Precipitation Retrieval Francesco Zauli 1, Daniele Biron 1, Davide Melfi 1, Antonio Vocino 1, Massimiliano Sist 2, Michele De Rosa 2, Matteo Picchiani 2, De Leonibus

More information

Lecture 14 Bayesian Models for Spatio-Temporal Data

Lecture 14 Bayesian Models for Spatio-Temporal Data Lecture 14 Bayesian Models for Spatio-Temporal Data Dennis Sun Stats 253 August 13, 2014 Outline of Lecture 1 Recap of Bayesian Models 2 Empirical Bayes 3 Case 1: Long-Lead Forecasting of Sea Surface Temperatures

More information

STATISTICAL ANALYSIS WITH MISSING DATA

STATISTICAL ANALYSIS WITH MISSING DATA STATISTICAL ANALYSIS WITH MISSING DATA SECOND EDITION Roderick J.A. Little & Donald B. Rubin WILEY SERIES IN PROBABILITY AND STATISTICS Statistical Analysis with Missing Data Second Edition WILEY SERIES

More information

Gapfilling of EC fluxes

Gapfilling of EC fluxes Gapfilling of EC fluxes Pasi Kolari Department of Forest Sciences / Department of Physics University of Helsinki EddyUH training course Helsinki 23.1.2013 Contents Basic concepts of gapfilling Example

More information

STEPS-BE: an ensemble radar rainfall nowcasting system for urban hydrology in Belgium

STEPS-BE: an ensemble radar rainfall nowcasting system for urban hydrology in Belgium STEPS-BE: an ensemble radar rainfall nowcasting system for urban hydrology in Belgium Loris Foresti 1,2, Maarten Reyniers 2, Lesley De Cruz 2, Alan Seed 3 and Laurent Delobbe 2 with contributions from

More information

A Comparison of Rainfall Estimation Techniques

A Comparison of Rainfall Estimation Techniques A Comparison of Rainfall Estimation Techniques Barry F. W. Croke 1,2, Juliet K. Gilmour 2 and Lachlan T. H. Newham 2 SUMMARY: This study compares two techniques that have been developed for rainfall and

More information

Development of an ensemble-based volcanic ash dispersion model for operations at Darwin VAAC

Development of an ensemble-based volcanic ash dispersion model for operations at Darwin VAAC Development of an ensemble-based volcanic ash dispersion model for operations at Darwin VAAC Rodney Potts Bureau of Meteorology Australia [C Lucas, R Dare, M Manickam, A Wain, M Zidikheri, A Bear-Crozier]

More information

Gaussian Models

Gaussian Models Gaussian Models ddebarr@uw.edu 2016-04-28 Agenda Introduction Gaussian Discriminant Analysis Inference Linear Gaussian Systems The Wishart Distribution Inferring Parameters Introduction Gaussian Density

More information

TIME SERIES ANALYSIS. Forecasting and Control. Wiley. Fifth Edition GWILYM M. JENKINS GEORGE E. P. BOX GREGORY C. REINSEL GRETA M.

TIME SERIES ANALYSIS. Forecasting and Control. Wiley. Fifth Edition GWILYM M. JENKINS GEORGE E. P. BOX GREGORY C. REINSEL GRETA M. TIME SERIES ANALYSIS Forecasting and Control Fifth Edition GEORGE E. P. BOX GWILYM M. JENKINS GREGORY C. REINSEL GRETA M. LJUNG Wiley CONTENTS PREFACE TO THE FIFTH EDITION PREFACE TO THE FOURTH EDITION

More information

Multi-variate hydrological data assimilation opportunities and challenges. Henrik Madsen DHI, Denmark

Multi-variate hydrological data assimilation opportunities and challenges. Henrik Madsen DHI, Denmark Multi-variate hydrological data assimilation opportunities and challenges Henrik Madsen DHI, Denmark Outline Introduction to multi-variate hydrological data assimilation Opportunities and challenges Data

More information

Assimilation of Snow and Ice Data (Incomplete list)

Assimilation of Snow and Ice Data (Incomplete list) Assimilation of Snow and Ice Data (Incomplete list) Snow/ice Sea ice motion (sat): experimental, climate model Sea ice extent (sat): operational, U.S. Navy PIPs model; Canada; others? Sea ice concentration

More information

Plausible Values for Latent Variables Using Mplus

Plausible Values for Latent Variables Using Mplus Plausible Values for Latent Variables Using Mplus Tihomir Asparouhov and Bengt Muthén August 21, 2010 1 1 Introduction Plausible values are imputed values for latent variables. All latent variables can

More information

3850 IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, VOL. 10, NO. 9, SEPTEMBER 2017

3850 IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, VOL. 10, NO. 9, SEPTEMBER 2017 3850 IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, VOL. 10, NO. 9, SEPTEMBER 2017 Comparison of X-Band and L-Band Soil Moisture Retrievals for Land Data Assimilation

More information

Water Balance in the Murray-Darling Basin and the recent drought as modelled with WRF

Water Balance in the Murray-Darling Basin and the recent drought as modelled with WRF 18 th World IMACS / MODSIM Congress, Cairns, Australia 13-17 July 2009 http://mssanz.org.au/modsim09 Water Balance in the Murray-Darling Basin and the recent drought as modelled with WRF Evans, J.P. Climate

More information

2D Image Processing. Bayes filter implementation: Kalman filter

2D Image Processing. Bayes filter implementation: Kalman filter 2D Image Processing Bayes filter implementation: Kalman filter Prof. Didier Stricker Dr. Gabriele Bleser Kaiserlautern University http://ags.cs.uni-kl.de/ DFKI Deutsches Forschungszentrum für Künstliche

More information

Air sea satellite flux datasets and what they do (and don't) tell us about the air sea interface in the Southern Ocean

Air sea satellite flux datasets and what they do (and don't) tell us about the air sea interface in the Southern Ocean Air sea satellite flux datasets and what they do (and don't) tell us about the air sea interface in the Southern Ocean Carol Anne Clayson Woods Hole Oceanographic Institution Southern Ocean Workshop Seattle,

More information

New Intensity-Frequency- Duration (IFD) Design Rainfalls Estimates

New Intensity-Frequency- Duration (IFD) Design Rainfalls Estimates New Intensity-Frequency- Duration (IFD) Design Rainfalls Estimates Janice Green Bureau of Meteorology 17 April 2013 Current IFDs AR&R87 Current IFDs AR&R87 Current IFDs - AR&R87 Options for estimating

More information

Wrapped Gaussian processes: a short review and some new results

Wrapped Gaussian processes: a short review and some new results Wrapped Gaussian processes: a short review and some new results Giovanna Jona Lasinio 1, Gianluca Mastrantonio 2 and Alan Gelfand 3 1-Università Sapienza di Roma 2- Università RomaTRE 3- Duke University

More information

Exploring Spatial Dependency of Meteorological Attributes for Multivariate Analysis: A Granger Causality Test Approach

Exploring Spatial Dependency of Meteorological Attributes for Multivariate Analysis: A Granger Causality Test Approach Exploring Spatial Depency of Meteorological Attributes for Multivariate Analysis: A Granger Causality Test Approach Shrutilipi Bhattacharjee, Soumya K. Ghosh School of Information Technology Indian Institute

More information

3880 IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, VOL. 7, NO. 9, SEPTEMBER 2014

3880 IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, VOL. 7, NO. 9, SEPTEMBER 2014 3880 IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, VOL. 7, NO. 9, SEPTEMBER 2014 How do Spatial Scale, Noise, and Reference Data affect Empirical Estimates of Error

More information

A Facility for Producing Consistent Remotely Sensed Biophysical Data Products of Australia

A Facility for Producing Consistent Remotely Sensed Biophysical Data Products of Australia TERRESTRIAL ECOSYSTEM RESEARCH NETWORK - AusCover - A Facility for Producing Consistent Remotely Sensed Biophysical Data Products of Australia June, 2011 Mervyn Lynch Professor of Remote Sensing Curtin

More information

Fusing point and areal level space-time data. data with application to wet deposition

Fusing point and areal level space-time data. data with application to wet deposition Fusing point and areal level space-time data with application to wet deposition Alan Gelfand Duke University Joint work with Sujit Sahu and David Holland Chemical Deposition Combustion of fossil fuel produces

More information

Part 8: GLMs and Hierarchical LMs and GLMs

Part 8: GLMs and Hierarchical LMs and GLMs Part 8: GLMs and Hierarchical LMs and GLMs 1 Example: Song sparrow reproductive success Arcese et al., (1992) provide data on a sample from a population of 52 female song sparrows studied over the course

More information

The South Eastern Australian Climate Initiative

The South Eastern Australian Climate Initiative The South Eastern Australian Climate Initiative Phase 2 of the South Eastern Australian Climate Initiative (SEACI) is a three-year (2009 2012), $9 million research program investigating the causes and

More information

Default Priors and Effcient Posterior Computation in Bayesian

Default Priors and Effcient Posterior Computation in Bayesian Default Priors and Effcient Posterior Computation in Bayesian Factor Analysis January 16, 2010 Presented by Eric Wang, Duke University Background and Motivation A Brief Review of Parameter Expansion Literature

More information

ASimultaneousRadiometricand Gravimetric Framework

ASimultaneousRadiometricand Gravimetric Framework Towards Multisensor Snow Assimilation: ASimultaneousRadiometricand Gravimetric Framework Assistant Professor, University of Maryland Department of Civil and Environmental Engineering September 8 th, 2014

More information

Advanced Machine Learning

Advanced Machine Learning Advanced Machine Learning Nonparametric Bayesian Models --Learning/Reasoning in Open Possible Worlds Eric Xing Lecture 7, August 4, 2009 Reading: Eric Xing Eric Xing @ CMU, 2006-2009 Clustering Eric Xing

More information

Bayesian Networks BY: MOHAMAD ALSABBAGH

Bayesian Networks BY: MOHAMAD ALSABBAGH Bayesian Networks BY: MOHAMAD ALSABBAGH Outlines Introduction Bayes Rule Bayesian Networks (BN) Representation Size of a Bayesian Network Inference via BN BN Learning Dynamic BN Introduction Conditional

More information

Summary STK 4150/9150

Summary STK 4150/9150 STK4150 - Intro 1 Summary STK 4150/9150 Odd Kolbjørnsen May 22 2017 Scope You are expected to know and be able to use basic concepts introduced in the book. You knowledge is expected to be larger than

More information

F O U N D A T I O N A L C O U R S E

F O U N D A T I O N A L C O U R S E F O U N D A T I O N A L C O U R S E December 6, 2018 Satellite Foundational Course for JPSS (SatFC-J) F O U N D A T I O N A L C O U R S E Introduction to Microwave Remote Sensing (with a focus on passive

More information

Using Temporal Hierarchies to Predict Tourism Demand

Using Temporal Hierarchies to Predict Tourism Demand Using Temporal Hierarchies to Predict Tourism Demand International Symposium on Forecasting 29 th June 2015 Nikolaos Kourentzes Lancaster University George Athanasopoulos Monash University n.kourentzes@lancaster.ac.uk

More information

Models to carry out inference vs. Models to mimic (spatio-temporal) systems 5/5/15

Models to carry out inference vs. Models to mimic (spatio-temporal) systems 5/5/15 Models to carry out inference vs. Models to mimic (spatio-temporal) systems 5/5/15 Ring-Shaped Hotspot Detection: A Summary of Results, IEEE ICDM 2014 (w/ E. Eftelioglu et al.) Where is a crime source?

More information

Urban Water Security Research Alliance

Urban Water Security Research Alliance Urban Water Security Research Alliance Drought Frequency and Duration Projections for South East Queensland David Kent, Wenju Cai, Kim Nguyen Climate and Water 29 September 2010 Outline Previous projections

More information

Assimilation of ASCAT soil wetness

Assimilation of ASCAT soil wetness EWGLAM, October 2010 Assimilation of ASCAT soil wetness Bruce Macpherson, on behalf of Imtiaz Dharssi, Keir Bovis and Clive Jones Contents This presentation covers the following areas ASCAT soil wetness

More information

1. How can you tell if there is serial correlation? 2. AR to model serial correlation. 3. Ignoring serial correlation. 4. GLS. 5. Projects.

1. How can you tell if there is serial correlation? 2. AR to model serial correlation. 3. Ignoring serial correlation. 4. GLS. 5. Projects. 1. How can you tell if there is serial correlation? 2. AR to model serial correlation. 3. Ignoring serial correlation. 4. GLS. 5. Projects. 1) Identifying serial correlation. Plot Y t versus Y t 1. See

More information

Different Methods of Monitoring PM

Different Methods of Monitoring PM Different Methods of Monitoring PM Melita Keywood Improving PM10 Monitoring in NZ 10 October 2005 CSIRO Marine and Atmospheric Research www.csiro.au Methods Integrated filter sampling Impactor or cyclone

More information

Bayesian linear regression

Bayesian linear regression Bayesian linear regression Linear regression is the basis of most statistical modeling. The model is Y i = X T i β + ε i, where Y i is the continuous response X i = (X i1,..., X ip ) T is the corresponding

More information

Variational soil assimilation at DWD

Variational soil assimilation at DWD Variational soil assimilation at DWD Werner Wergen, Reinhold Hess and Martin Lange Deutscher Wetterdienst Offenbach am Main, Germany The soil moisture assimilation scheme (SMA) at DWD Full description

More information

Short-Term Irradiance Forecasting Using an Irradiance Sensor Network, Satellite Imagery, and Data Assimilation

Short-Term Irradiance Forecasting Using an Irradiance Sensor Network, Satellite Imagery, and Data Assimilation Short-Term Irradiance Forecasting Using an Irradiance Sensor Network, Satellite Imagery, and Data Assimilation Antonio Lorenzo Dissertation Defense April 14, 2017 Problem & Hypothesis Hypothesis 1: ground

More information

Multivariate modelling and efficient estimation of Gaussian random fields with application to roller data

Multivariate modelling and efficient estimation of Gaussian random fields with application to roller data Multivariate modelling and efficient estimation of Gaussian random fields with application to roller data Reinhard Furrer, UZH PASI, Búzios, 14-06-25 NZZ.ch Motivation Microarray data: construct alternative

More information

On the relative importance of Argo, SST and altimetry for an ocean reanalysis

On the relative importance of Argo, SST and altimetry for an ocean reanalysis Document prepared on February 20, 2007 for the Argo Steering Team Meeting (AST-8), Paris March 7-9 On the relative importance of Argo, SST and altimetry for an ocean reanalysis Peter R. Oke and Andreas

More information

Understanding Recent Tropical Expansion and its Impacts

Understanding Recent Tropical Expansion and its Impacts Understanding Recent Tropical Expansion and its Impacts www.cawcr.gov.au Chris Lucas Hanh Nguyen The Centre for Australian Weather and Climate Research A partnership between CSIRO and the Bureau of Meteorology

More information

Bayesian Methods in Multilevel Regression

Bayesian Methods in Multilevel Regression Bayesian Methods in Multilevel Regression Joop Hox MuLOG, 15 september 2000 mcmc What is Statistics?! Statistics is about uncertainty To err is human, to forgive divine, but to include errors in your design

More information