DARE team and partners

Similar documents
Flood inundation data assimilation and big data

Using COSMO-SkyMed images to improve river flood monitoring and forecasting.

Improving Inundation Forecasting using Data Assimilation

New Applications and Challenges In Data Assimilation

Towards a probabilistic hydrological forecasting and data assimilation system. Henrik Madsen DHI, Denmark

Prospects for river discharge and depth estimation through assimilation of swath altimetry into a raster-based hydraulics model

Relative Merits of 4D-Var and Ensemble Kalman Filter

Response. 3.1 Derivation of water level observations. 3.2 Model and data assimilation. 3.3 Quality control and data thinning.

Cross-validation methods for quality control, cloud screening, etc.

Multi-variate hydrological data assimilation opportunities and challenges. Henrik Madsen DHI, Denmark

Environment Canada s Regional Ensemble Kalman Filter

Convective-scale data assimilation at the UK Met Office

4DEnVar. Four-Dimensional Ensemble-Variational Data Assimilation. Colloque National sur l'assimilation de données

Lagrangian Data Assimilation and Its Application to Geophysical Fluid Flows

Model error and parameter estimation

Modelling coastal flood risk in the data poor Bay of Bengal region

Improving global coastal inundation forecasting WMO Panel, UR2014, London, 2 July 2014

QPE and QPF in the Bureau of Meteorology

Multi-modelling, multi-scenarios, hypothesis rejection and model diagnostics challenges and bottlenecks for uncertainty analysis frameworks Jim Freer

1. Current atmospheric DA systems 2. Coupling surface/atmospheric DA 3. Trends & ideas

Uncertainty propagation in a sequential model for flood forecasting

Improved ensemble representation of soil moisture in SWAT for data assimilation applications

Data assimilation in the MIKE 11 Flood Forecasting system using Kalman filtering

Nurture Nature Center Receives Grant From National Oceanic and Atmospheric Administration To Study Flood Forecast and Warning Tools

Prof. Stephen G. Penny University of Maryland NOAA/NCEP, RIKEN AICS, ECMWF US CLIVAR Summit, 9 August 2017

An Overview of Operations at the West Gulf River Forecast Center Gregory Waller Service Coordination Hydrologist NWS - West Gulf River Forecast Center

Coupled atmosphere-ocean variational data assimilation in the presence of model error

The Canadian approach to ensemble prediction

Stochastic Hydrology. a) Data Mining for Evolution of Association Rules for Droughts and Floods in India using Climate Inputs

Assimilating cloud information from satellite cloud products with an Ensemble Kalman Filter at the convective scale

Impact of an improved Backgrund-error covariance matrix with AROME 3Dvar system over Tunisia

Nowcasting for the London Olympics 2012 Brian Golding, Susan Ballard, Nigel Roberts & Ken Mylne Met Office, UK. Crown copyright Met Office

Prediction uncertainty in elevation and its effect on flood inundation modelling

Can hybrid-4denvar match hybrid-4dvar?

WRF-LETKF The Present and Beyond

Generating climatological forecast error covariance for Variational DAs with ensemble perturbations: comparison with the NMC method

Error (E) Covariance Diagnostics. in Ensemble Data Assimilation. Kayo Ide, Daryl Kleist, Adam Kubaryk University of Maryland

An Efficient Ensemble Data Assimilation Approach To Deal With Range Limited Observation

The Local Ensemble Transform Kalman Filter (LETKF) Eric Kostelich. Main topics

Adaptive ensemble Kalman filtering of nonlinear systems

Applications of an ensemble Kalman Filter to regional ocean modeling associated with the western boundary currents variations

Gaussian Process Approximations of Stochastic Differential Equations

Satellite data for hydrological forecasting

WRF Modeling System Overview

Delft-FEWS User Days 2 nd & 3 rd November 2011

Current Issues and Challenges in Ensemble Forecasting

Dual-Frequency Ku- Band Radar Mission Concept for Snow Mass

Alexander Barth, Aida Alvera-Azc. Azcárate, Robert H. Weisberg, University of South Florida. George Halliwell RSMAS, University of Miami

Data assimilation with and without a model

Practical Aspects of Ensemble-based Kalman Filters

Prospects for river discharge and depth estimation through assimilation of swath-altimetry into a raster-based hydrodynamics model

Assimilating SAR-derived water level data into a hydraulic model: a case study

Comparisons between 4DEnVar and 4DVar on the Met Office global model

Data assimilation in high dimensions

Enhancing information transfer from observations to unobserved state variables for mesoscale radar data assimilation

Ocean data assimilation for reanalysis

Comparing Local Ensemble Transform Kalman Filter with 4D-Var in a Quasi-geostrophic model

Towards operationalizing ensemble DA in hydrologic forecasting

EnKF Review. P.L. Houtekamer 7th EnKF workshop Introduction to the EnKF. Challenges. The ultimate global EnKF algorithm

Ensemble Kalman Filter based snow data assimilation

Building Ensemble-Based Data Assimilation Systems. for High-Dimensional Models

New developments in data assimilation in MIKE 21/3 FM Assimilation of along-track altimetry data with correlated measurement errors

Lagrangian Data Assimilation and Manifold Detection for a Point-Vortex Model. David Darmon, AMSC Kayo Ide, AOSC, IPST, CSCAMM, ESSIC

Update on the KENDA project

SPECIAL PROJECT PROGRESS REPORT

Convective-scale NWP for Singapore

Numerical Weather Prediction: Data assimilation. Steven Cavallo

Innovative Ways to Monitor Land Displacement

Quantifying observation error correlations in remotely sensed data

FLORA: FLood estimation and forecast in complex Orographic areas for Risk mitigation in the Alpine space

Gaussian Filtering Strategies for Nonlinear Systems

SANGOMA: Stochastic Assimilation for the Next Generation Ocean Model Applications EU FP7 SPACE project

University of Miami/RSMAS

Introduction to Data Assimilation

DATA ASSIMILATION FOR FLOOD FORECASTING

Introduction to Ensemble Kalman Filters and the Data Assimilation Research Testbed

Background and observation error covariances Data Assimilation & Inverse Problems from Weather Forecasting to Neuroscience

WMO Guide on Integrated Urban Weather, Environment and Climate Services for Cities (IUWECS) Hong Kong- an experience from a high-density city

Flood Finder Chad 2017

Geostatistical History Matching coupled with Adaptive Stochastic Sampling: A zonation-based approach using Direct Sequential Simulation

STA 4273H: Statistical Machine Learning

Probability and climate change UK/Russia Climate Workshop, October, 2003

DIAGNOSING OBSERVATION ERROR STATISTICS FOR NUMERICAL WEATHER PREDICTION

Copernicus Overview. Major Emergency Management Conference Athlone 2017

DATA ASSIMILATION IN A COMBINED 1D-2D FLOOD MODEL

Hydrological forecasting and decision making in Australia

JOINT WMO TECHNICAL PROGRESS REPORT ON THE GLOBAL DATA PROCESSING AND FORECASTING SYSTEM AND NUMERICAL WEATHER PREDICTION RESEARCH ACTIVITIES FOR 2007

State of the art of wind forecasting and planned improvements for NWP Helmut Frank (DWD), Malte Mülller (met.no), Clive Wilson (UKMO)

Improving Gap Flow Simulations Near Coastal Areas of Continental Portugal

A comparison of sequential data assimilation schemes for. Twin Experiments

New COST Action: Towards a European Network on Chemical Weather Forecasting and Information Systems

Data Assimilation of Satellite Lidar Aerosol Observations

An Ensemble Kalman Filter for NWP based on Variational Data Assimilation: VarEnKF

Ensemble Kalman filter assimilation of transient groundwater flow data via stochastic moment equations

The Impacts of GPS Radio Occultation Data on the Analysis and Prediction of Tropical Cyclones. Bill Kuo, Xingqin Fang, and Hui Liu UCAR COSMIC

Aurora Bell*, Alan Seed, Ross Bunn, Bureau of Meteorology, Melbourne, Australia

Haiti and Dominican Republic Flash Flood Initial Planning Meeting

Recent Data Assimilation Activities at Environment Canada

Overview on Data Assimilation Activities in COSMO

Introduction to Data Assimilation. Saroja Polavarapu Meteorological Service of Canada University of Toronto

Transcription:

DARE team and partners

Complex and vulnerable city Miami Beach, Florida, September 2015 Manhattan after Superstorm Sandy, 2012. Photo: Allison Joyce/Getty Images. Chennai Airport, India, December 2015; Photo: Indian Air Force Latvia, July 2017 Population Growth + Climate Change + Urbanisation

What can we do - the DARE project The aims of the DARE project are: to improve urban flood prediction through data assimilation using novel and standard observations of urban floods; to produce algorithm and working code for SAR delineation in urban areas; to understand error structures of urban weather observations; to network and achieve goals through collaboration. DARE is funded by EPSRC Senior Fellowship in Digital Technology for Living with Environmental Change (EPSRC EP/P002331/1).

What can we do - DARE project The aims of the DARE project are: to improve urban flood prediction through data assimilation using novel and standard observations of urban floods; to produce algorithm and working code for SAR delineation in urban areas; to understand error structures of urban weather observations; to network and achieve goals through collaboration. DARE is funded by EPSRC Senior Fellowship in Digital Technology for Living with Environmental Change (EPSRC EP/P002331/1).

What is data assimilation? All models have errors and inundation models have a number of error sources e.g. inflow errors, bathymetry parameters, model errors, etc.

How DA works? On one hand we have a discrete MODEL: where x R Nx is a state vector; x n+1 = M (x n ) + e n+1 m e m R Nx is the model error distributed according to the covariance matrix Q. On the other hand we have discrete OBSERVATIONS of the system: y R Ny which also have an associated observation error distributed according to the covariance matrix R. We map between model and observation spaces using observation operator: y m = H (x). (1)

How DA works? On one hand we have a discrete MODEL: where x R Nx is a state vector; x n+1 = M (x n ) + e n+1 m e m R Nx is the model error distributed according to the covariance matrix Q. On the other hand we have discrete OBSERVATIONS of the system: y R Ny which also have an associated observation error distributed according to the covariance matrix R. We map between model and observation spaces using observation operator: y m = H (x). (2)

How DA works? On one hand we have a discrete MODEL: where x n+1 = M (x n ) + e n+1 m x R Nx is a state vector with associated error covariance matrix P; e m R Nx is the model error distributed according to the covariance matrix Q. On the other hand we have discrete OBSERVATIONS of the system: y R Ny which also have an associated observation error distributed according to the covariance matrix R. We map between model and observation spaces using observation operator: y m = H (x). (3)

How DA works? We combine MODEL and OBSERVATIONS as follows: where Kalman gain matrix ( ) x a = x f + K y H(x f ) (4) ( ) P a = I KH T P f (5) ( ) 1 K = P f H HP f H T + R weighs forecast/state errors against observation errors. Above are known as Kalman Filter equations and all ensemble data assimilation methods are based on these equations approximating eq. (5). Other popular data assimilation methods include variational methods (e.g. 3DVar or 4DVar), particle filters, and a growing list of hybrid forms between the mentioned methods.

How DA works?

Why use data assimilation in urban flooding? Using available observations along with the uncertain model forecast allows us to: produce more accurate flood forecasts analysis; produce more accurate flood forecasts uncertainties; improve model; assess observation network; estimate uncertain model parameters/inputs.

Why use data assimilation in urban flooding? Using available observations along with the uncertain model forecast allows us to: produce more accurate flood forecasts analysis; produce more accurate flood forecasts uncertainties; improve model; assess observation network; estimate uncertain model parameters/inputs.

Urban observations + river gauges (sparse in space, frequent in time); + SAR satellite images (frequent in time and space, but have some issues); + CCTV cameras (varied spatial distribution, frequent in time); + rivercams (sparse in space, frequent in time); + surface water road sensors (where available); + other crowdsourced data (e.g. Twitter).

Assimilation of SAR images Model: LISFLOOD-FP (2D); Inflow BC: ensemble from hydrological model; Domain: 30 x 50 km (75m resolution) 15000 flooded cells; Tributaries: Severn, Avon,... ; Water Level Observations: Delivered from 7 COSMO-Skymed overpasses [X-band SAR] in Nov 2012 event.

Assimilation of SAR images

Assimilation of SAR images Figure: Water level forecast at Worcester, whose major inflows come from Bewdley (river Severn), Kidder Callows (river Stour), and Harford Hill (river Salwarpe). The plot is for a filter configuration involving along-network localisation and inflow and parameter estimation. Gray lines are the forecast ensemble, the red line is the mean forecast and the blue line is the gauged water level, used here as a reference and not for modelling or assimilation. Vertical dashed lines indicate the times of the CSK overpasses/assimilation. Horizontal lines indicate the bank level (labeled as dtmd ), and the mean channel bottom level (labeled as SGCz ) (after Garcia-Pintado et al., 2015).

Assimilation of SAR images Garcia-Pintado et al. (2013, 2015) have shown that: + It is possible to assimilate SAR images into flood modelling; + Joint simultaneous estimation of uncertain parameters improves the forecast; + Joint simultaneous estimation of uncertain parameters further stabilises the ensemble-based covariance; However, in urban areas SAR images have problems due to building shadows and backscattering which renders large part of SAR observations in urban areas useless.

DARE to use CCTV images to improve urban flood prediction Our aim is to use CCTV images (both traffic and river cameras) to complement SAR observations in urban areas and assimilate them in the model using ensemble methods to improve the flood forecasts in cities.

CCTV observations All big cities have a dense network of various CCTV cameras including traffic management cameras. Selected cities: London, Bristol, Glasgow, Exeter, Leeds, Newcastle, Tewkesbury.

Captured surface flooding in London

Only the beginning... DARE project has just started and will run till summer of 2021. There is so much to do: complete the observation network; test DA + CCTV obs. in a simplified environment using LisFLOOD-FP hydrological model; set up DA system with urban hydrological model; asses CCTV observation impact using complex system; use new SAR delineation algorithm to also test SAR images in urban areas; lots more to do...

Keep up-to-date with DARE blog For more information and regular updates please visit DARE blog: http://blogs.reading.ac.uk/dare/

Free Data Assimilation tools: EMPIRE EMPIRE: Employing Message Passing Interface for Researching Ensembles www.met.reading.ac.uk/~darc/empire/ EMPIRE is: a DA system easily connected to any dynamical model. EMPIRE uses: MPI calls to setup communication and transfer data between the model and DA methods. EMPIRE is: continuously developed at UoR.

Free Data Assimilation tools: SANGOMA SANGOMA: Stochastic Assimilation for the Next Generation Ocean Model Applications http://www.data-assimilation.net/ SANGOMA is: a collection of open source data assimilation tools in both Matlab and Fortran (C compatible) languages including tools for: diagnostics, analysis methods, perturbations, utilities, transformations, etc. The open source code can be found here: https://sourceforge.net/p/sangoma/code/head/tree/tools/trunk/

Bibliography 1 Cooper E.S., Dance S.L., Garcia-Pintado J., Nichols N.K., Smith P.J. (In preparation) Observation impact, domain length and parameter estimation in data assimilation for flood forecasting. 2 Garcia-Pintado, J., Neal, J., Mason, D., Dance, S. and Bates, P. (2013) Scheduling satellite-based SAR acquisition for sequential assimilation of water level observations into flood modelling. Journal of Hydrology, 495. pp. 252-266. 3 Garcia-Pintado, J., Mason, D., Dance, S. L., Cloke, H., Neal, J. C., Freer, J. and Bates, P. D. (2015) Satellite-supported flood forecasting in river networks: a real case study. Journal of Hydrology, 523. pp. 706-724.