Estimation of positive sum-to-one constrained parameters with ensemble-based Kalman filters: application to an ocean ecosystem model

Size: px
Start display at page:

Download "Estimation of positive sum-to-one constrained parameters with ensemble-based Kalman filters: application to an ocean ecosystem model"

Transcription

1 Estimation of positive sum-to-one constrained parameters with ensemble-based Kalman filters: application to an ocean ecosystem model Ehouarn Simon 1, Annette Samuelsen 1, Laurent Bertino 1 Dany Dumont 2 1 Nansen Environmental and Remote Sensing Center, Norway 2 Institut des sciences de la mer, Université du Québec à Rimouski, Canada 16 November 212

2 Outline 1 Estimation of positive sum-to-one constrained parameters with ensemble-based Kalman filters 2 Numerical results in GOTM-NORWECOM

3 3 Assimilation of ocean color data Time evolution of the errors CHLA: forecast mean ( ) CHLA: observations ( ) RMS error and standard deviations (mg/m 3 ) RMS Ensemble STD Ensemble 1 Jan 27 1 Jan 28 1 Jan 29 1 Jan 21 Difficulties Nonlinear dynamics and positive variables (tracer concentration). Numerous poorly known parameters. Seasonal lack of observations (Arctic) and large error (satellite), few in-situ data. Diet of the herbivorous / predators? Zooplankton grazing preferences (relative diet). No prior knowledge, one set of values for the whole domain. Adaptation of zooplankton to their local environment?

4 Non-Gaussianity and parameter estimation with the EnKF Truncations of negative values (d!1 ) Potential depletion of components of the ensemble Large corrections on parameters in erroneous directions. Grazing efficiency f (d!1 ) Grazing efficiency f Gaussian anamorphosis extension of ensemble-based Kalman filters Analysis with transformed variables and observations (Bertino et al., 23) Applicability of the methods in large systems Effectiveness of the Gaussian anamorphosis extension of the EnKF to estimate parameters in nonlinear frameworks of positive variables.

5 Outline 1 Estimation of positive sum-to-one constrained parameters with ensemble-based Kalman filters 2 Numerical results in GOTM-NORWECOM

6 Positive sum-to-one constrained parameters (π i ) i NN Estimation Constraints: i = 1 : N, π i and NX π i = 1 i=1 Cannot be handled by the EnKF in that form. Dirichlet distribution of order N i = 1 : N, π i = φ i with φ i Γ(θ i, 1) NX φ k k=1 Gelman s formulation (1995) i = 1 : N, π i = eφ i NX k=1 e φ k with φ i N (θ i, Σ i )

7 7 Positive sum-to-one constrained parameters (π i ) i NN Hyperspherical coordinates: N 1 parameters 8 π 1 = cos 2 ( π 2 φ 1) >< >: i = 2 : N 1, π i = π N = i 1 Y sin 2 ( π 2 φ k) cos 2 ( π 2 φ i ) k=1 N 2 Y k=1 sin 2 ( π 2 φ k) sin 2 ( π 2 φ N 1) with (φ i ) i=1=n 1 distributed on the segment line [, 1] Inversion of the hyperspherical coordinate system Recursively. Information on the distribution of the (π i ) i=1:n or available samples: Prior values for the (φ i ) i=1:n 1.

8 8 Expected values and variances of the (π i ) i=1:n Tuning of the parameters of the distributions of the (φ i ) i=1:n 1 i = 1 : N 1, E[π i ] = m i, var(π i ) = σ 2 i Assumption: (φ i ) i=1:n 1 (D i ([, 1], Θ i )) i=1:n 1 are independent. Expected values of the (π i ) i=1:n (E[ejπφ 1 ] + E[e jπφ 1 ]) = m >< >: i = 2 : N 1, 1 4 (E[ejπφ i ] + E[e jπφ m i i ]) = Xi 1 1 m k Variances of the (π i ) i=1:n (E[e2jπφ 1 ] + E[e 2jπφ 1 ]) = σ2 1 + m (E[ejπφ 1 ] + E[e jπφ 1 ]) >< >: 1 i = 2 : N 1, 16 (E[e2jπφ i ] + E[e 2jπφ i ]) = (E[ejπφ i ] + E[e jπφ i ]) σi 2 + mi 2 + ix k 1 ( 2) k 1 (σi k 2 + m2 i k ) Y 1 4 (E[ejπφ i l ] + E[e jπφ i l ]) k=1 l=1 k=1 1 2

9 9 Example with the triangular distribution Triangular distribution: φ i T (, 1, c i ) Tuning of the mode c i. Characteristic function: t R, E[e jtφ i ] = 2 (1 c i ) e jc i t + c i e jt π 2 c i (1 c i ) Equal preferences: E[π i ] = 1 N A system of N 1 nonlinear equations: i = 1 : N 1, cos(πc i ) + 2c i 1 π 2 c i (1 c i ) + N i 1 2(N i + 1) =. N > 3: non existence of solutions.

10 Outline 1 Estimation of positive sum-to-one constrained parameters with ensemble-based Kalman filters 2 Numerical results in GOTM-NORWECOM

11 11 GOTM-NORWECOM-ASSIM Assimilation Deterministic ensemble Kalman filter (DEnKF, Sakov and Oke, 28). State vector: biogeochemical state vector and parameters. 1 members. Gaussian anamorphosis (Bertino et al., 23) for the biogeochemical state variables (and parameters for the spherical formulation). Reference solution x t Deterministic simulation with different preferences: Mesozooplankton: π dia =.6, π mic =.15, π den =.25. Microzooplankton: π fla =.6, π den =.15, π dia =.25. Chlorophyll Nitrate

12 The data assimilation system Configuration of the experiments One year to warm up the ensemble, then four years with assimilation. Observations: y = x t 1 P G, with G Γ( σo 2, σo 2 ), σo =.3. Surface chlorophyll (2 first layers) every seven days. Truncated-Gaussian perturbations in the whole water column every twelve hours: phytoplankton and zooplankton only. Robustness of the estimation: experiments repeated 2 times. Chlorophyll concentration (mg/m 3 ) Layer 1 Reference Reference (observation time) Observations Chlorophyll concentration (mg/m 3 ) Layer 2 Jan Jan1 Jan2 Jan3 Jan4 Jan Jan1 Jan2 Jan3 Jan4

13 13 Preferences: Gelman s formulation π i = e φ i P N k=1 eφ k MesoZ π dia MesoZooplankton: diatoms MesoZ π mic MesoZooplankton: MicroZooplankton MesoZ π den MesoZooplankton: detritus (N) !.2 Jan Jan1 Jan2 Jan3 Jan4!.2 Jan Jan1 Jan2 Jan3 Jan4!.2 Jan Jan1 Jan2 Jan3 Jan4 MicroZ π fla MicroZooplankton: flagellates MicroZ π den MicroZooplankton: detritus (N) MicroZ π dia MicroZooplankton: diatoms !.2 Jan Jan1 Jan2 Jan3 Jan4!.2 Jan Jan1 Jan2 Jan3 Jan4!.2 Jan Jan1 Jan2 Jan3 Jan4

14 14 Preferences: spherical formulation MesoZ π dia MesoZooplankton: diatoms MesoZ π mic MesoZooplankton: MicroZooplankton MesoZ π den MesoZooplankton: detritus (N) !.2 Jan Jan1 Jan2 Jan3 Jan4!.2 Jan Jan1 Jan2 Jan3 Jan4!.2 Jan Jan1 Jan2 Jan3 Jan4 MicroZ π fla MicroZooplankton: flagellates MicroZ π den MicroZooplankton: detritus (N) MicroZ π dia MicroZooplankton: diatoms !.2 Jan Jan1 Jan2 Jan3 Jan4!.2 Jan Jan1 Jan2 Jan3 Jan4!.2 Jan Jan1 Jan2 Jan3 Jan4

15 Preferences: ternary plots of the final estimates Gelman s formulation Diatoms Mesozooplankton Detritus Mesozooplankton True Initial DEnKF MicroZ Flagellates Microzooplankton Diatoms Microzooplankton Detritus Spherical formulation Detritus Diatoms Diatoms MicroZ Flagellates Detritus

16 Spherical formulation: asymmetry of the transformation Robustness of the results to the matching preferences/transformed parameters Same 2 experiments (observation, prior ensembles) Microzooplankton: permutation in the assignment preferences/transformed parameters every four experiments. 8 >< >: Mesozooplankton π DIA = cos 2 ( π 2 φ 1) π MIC = sin 2 ( π 2 φ 1) cos 2 ( π 2 φ 2) π DET = sin 2 ( π 2 φ 1) sin 2 ( π 2 φ 2) 8 >< >: Microzooplankton π DET = cos 2 ( π 2 φ 1) π FLA = sin 2 ( π 2 φ 1) cos 2 ( π 2 φ 2) π DIA = sin 2 ( π 2 φ 1) sin 2 ( π 2 φ 2) Microzooplankton: marginal improvement of the estimates of the preferences. Mesozooplankton: slight degradation of the estimation. Mesozooplankton RMS error (Mesozooplankton.) Detritus Initial DEnKF True 16 Diet Diatoms MicroZ Detritus Prior (%) Gelman Spherical Spher. + perm Diatoms MicroZ

17 17 Conclusion and perspectives Two approaches for estimating positive sum-to-one constrained parameters. Gelman s formulation: Gaussian parameters, symmetry of the transformation, N transformed parameters. Spherical formulation: N 1 parameters to estimate, asymmetry of the transformation, distribution of the transformed parameters? Preliminary experiments indicate that the zooplankton grazing preferences could be estimated with both approaches. Quite simple framework. Further investigations have to be done. Distribution. Additional parameters to estimate. Real observations (Mike station).

18 18 Thank you!

19 Bibliography Bertino L., Evensen G. and Wackernagel H.: Sequential Data Assimilation Techniques in Oceanography, International Statistical Reviews, 71, , 23. Bocquet M., Pires C.A. and Wu L.: Beyond Gaussian statistical modeling in geophysical data assimilation, Monthly Weather Review, 138, 8, , 21. Doron M., Brasseur P. and Brankart J.-M.: Stochastic estimation of biogeochemical parameters of a 3D ocean coupled physical-biogeochemical model: Twin experiments. Journal of Marine Systems, 87 (3-4), , 211. Gelman A.: Method of Moments Using Monte Carlo Simulation. Journal of Computational and Graphical Statistics, 4, 1, 36-54, Gelman A., Bois F. and Jiang J.: Physiological Pharmacokinetic Analysis Using Population Modeling and Informative Prior Distributions. Journal of the American Statistical Association, 91, 436, , Simon E. and Bertino L: Gaussian anamorphosis extension of the DEnKF for combined state and parameter estimation: application to a 1D ocean ecosystem model, Journal of Marine Systems, 89, 1-18, 212. Simon E., Samuelsen A., Bertino L. and Dumont D.: Estimation of positive sum-to-one constrained zooplankton grazing preferences with the DEnKF: a twin experiments, Ocean Science, 8, , 212.

20 Construction of a monovariate anamorphosis: Z(x) = ψ(y (x)) Empirical anamorphosis Empirical marginal distribution of Z(x): sample (z i ) i=1:n. Cumulative distribution function of Y (x): G. ψ(y) = NX i=1 z i 1 ]G 1 ( i 1 N ),G 1 ( N i )](y) 1- Empirical anamorphosis Interpolation 3- Definition of the tails 3 Physical values (mg/m 3 ) Physical values (mg/m 3 ) Physical values (mg/m 3 ) !1!5 5 Gaussian values!1!5 5 Gaussian values!1! Gaussian values 2 Major issues Choice of the physical data set: specification of the likely and unlikely values. Dependance on a reference model run (model bias, extreme events).

Gaussian anamorphosis extension of the DEnKF for combined state and parameter estimation: application to a 1D ocean ecosystem model.

Gaussian anamorphosis extension of the DEnKF for combined state and parameter estimation: application to a 1D ocean ecosystem model. Gaussian anamorphosis extension of the DEnKF for combined state and parameter estimation: application to a D ocean ecosystem model. Ehouarn Simon a,, Laurent Bertino a a Nansen Environmental and Remote

More information

Ensemble Kalman Filter

Ensemble Kalman Filter Ensemble Kalman Filter Geir Evensen and Laurent Bertino Hydro Research Centre, Bergen, Norway, Nansen Environmental and Remote Sensing Center, Bergen, Norway The Ensemble Kalman Filter (EnKF) Represents

More information

c 2015.This manuscript version is made available under the CC-BY-NC- ND 4.0 license.

c 2015.This manuscript version is made available under the CC-BY-NC- ND 4.0 license. c 2015.This manuscript version is made available under the CC-BY-NC- ND 4.0 license. http://creativecommons.org/licences/by-nc-nd/4.0/ Experiences in multiyear combined state-parameter estimation with

More information

The PML data assimilation system For the North East Atlantic and ocean colour. Stefano Ciavatta, Ricardo Torres, Stephane Saux-Picart, Icarus Allen

The PML data assimilation system For the North East Atlantic and ocean colour. Stefano Ciavatta, Ricardo Torres, Stephane Saux-Picart, Icarus Allen The PML data assimilation system For the North East Atlantic and ocean colour Stefano Ciavatta, Ricardo Torres, Stephane Saux-Picart, Icarus Allen OPEC, Dartington, 11-12 December 2012 Outline Main features

More information

Biogeochemical modelling and data assimilation: status in Australia

Biogeochemical modelling and data assimilation: status in Australia Biogeochemical modelling and data assimilation: status in Australia Richard Matear, Andrew Lenton, Matt Chamberlain, Mathieu Mongin, Emlyn Jones, Mark Baird www.cmar.csiro.au/staff/oke/ Biogeochemical

More information

Asynchronous data assimilation

Asynchronous data assimilation Ensemble Kalman Filter, lecture 2 Asynchronous data assimilation Pavel Sakov Nansen Environmental and Remote Sensing Center, Norway This talk has been prepared in the course of evita-enkf project funded

More information

The Ensemble Kalman Filter:

The Ensemble Kalman Filter: p.1 The Ensemble Kalman Filter: Theoretical formulation and practical implementation Geir Evensen Norsk Hydro Research Centre, Bergen, Norway Based on Evensen 23, Ocean Dynamics, Vol 53, No 4 p.2 The Ensemble

More information

Aspects of the practical application of ensemble-based Kalman filters

Aspects of the practical application of ensemble-based Kalman filters Aspects of the practical application of ensemble-based Kalman filters Lars Nerger Alfred Wegener Institute for Polar and Marine Research Bremerhaven, Germany and Bremen Supercomputing Competence Center

More information

The Ensemble Kalman Filter:

The Ensemble Kalman Filter: p.1 The Ensemble Kalman Filter: Theoretical formulation and practical implementation Geir Evensen Norsk Hydro Research Centre, Bergen, Norway Based on Evensen, Ocean Dynamics, Vol 5, No p. The Ensemble

More information

EnKF Review. P.L. Houtekamer 7th EnKF workshop Introduction to the EnKF. Challenges. The ultimate global EnKF algorithm

EnKF Review. P.L. Houtekamer 7th EnKF workshop Introduction to the EnKF. Challenges. The ultimate global EnKF algorithm Overview 1 2 3 Review of the Ensemble Kalman Filter for Atmospheric Data Assimilation 6th EnKF Purpose EnKF equations localization After the 6th EnKF (2014), I decided with Prof. Zhang to summarize progress

More information

Smoothers: Types and Benchmarks

Smoothers: Types and Benchmarks Smoothers: Types and Benchmarks Patrick N. Raanes Oxford University, NERSC 8th International EnKF Workshop May 27, 2013 Chris Farmer, Irene Moroz Laurent Bertino NERSC Geir Evensen Abstract Talk builds

More information

Gaussian Filtering Strategies for Nonlinear Systems

Gaussian Filtering Strategies for Nonlinear Systems Gaussian Filtering Strategies for Nonlinear Systems Canonical Nonlinear Filtering Problem ~u m+1 = ~ f (~u m )+~ m+1 ~v m+1 = ~g(~u m+1 )+~ o m+1 I ~ f and ~g are nonlinear & deterministic I Noise/Errors

More information

Practical Aspects of Ensemble-based Kalman Filters

Practical Aspects of Ensemble-based Kalman Filters Practical Aspects of Ensemble-based Kalman Filters Lars Nerger Alfred Wegener Institute for Polar and Marine Research Bremerhaven, Germany and Bremen Supercomputing Competence Center BremHLR Bremen, Germany

More information

Primary Production using Ocean Color Remote Sensing. Watson Gregg NASA/Global Modeling and Assimilation Office

Primary Production using Ocean Color Remote Sensing. Watson Gregg NASA/Global Modeling and Assimilation Office Primary Production using Ocean Color Remote Sensing Watson Gregg NASA/Global Modeling and Assimilation Office watson.gregg@nasa.gov Classification of Ocean Color Primary Production Methods Carr, M.-E.,

More information

Biogeochemical modelling and data assimilation: status in Australia and internationally

Biogeochemical modelling and data assimilation: status in Australia and internationally Biogeochemical modelling and data assimilation: status in Australia and internationally Richard Matear, Andrew Lenton, Matt Chamberlain, Mathieu Mongin, Mark Baird CSIRO Marine and Atmospheric Research,

More information

Addressing the nonlinear problem of low order clustering in deterministic filters by using mean-preserving non-symmetric solutions of the ETKF

Addressing the nonlinear problem of low order clustering in deterministic filters by using mean-preserving non-symmetric solutions of the ETKF Addressing the nonlinear problem of low order clustering in deterministic filters by using mean-preserving non-symmetric solutions of the ETKF Javier Amezcua, Dr. Kayo Ide, Dr. Eugenia Kalnay 1 Outline

More information

Comparing the SEKF with the DEnKF on a land surface model

Comparing the SEKF with the DEnKF on a land surface model Comparing the SEKF with the DEnKF on a land surface model David Fairbairn, Alina Barbu, Emiliano Gelati, Jean-Francois Mahfouf and Jean-Christophe Caret CNRM - Meteo France Partly funded by European Union

More information

Sequential data assimilation techniques in oceanography

Sequential data assimilation techniques in oceanography Sequential data assimilation techniques in oceanography Laurent BERTINO, Geir EVENSEN, Hans WACKERNAGEL Nansen Environmental and Remote Sensing Center, Norway Centre de Géostatistique, Ecole des Mines

More information

An Efficient Ensemble Data Assimilation Approach To Deal With Range Limited Observation

An Efficient Ensemble Data Assimilation Approach To Deal With Range Limited Observation An Efficient Ensemble Data Assimilation Approach To Deal With Range Limited Observation A. Shah 1,2, M. E. Gharamti 1, L. Bertino 1 1 Nansen Environmental and Remote Sensing Center 2 University of Bergen

More information

State Space Models for Wind Forecast Correction

State Space Models for Wind Forecast Correction for Wind Forecast Correction Valérie 1 Pierre Ailliot 2 Anne Cuzol 1 1 Université de Bretagne Sud 2 Université de Brest MAS - 2008/28/08 Outline 1 2 Linear Model : an adaptive bias correction Non Linear

More information

Performance of a 23 years TOPAZ reanalysis

Performance of a 23 years TOPAZ reanalysis Performance of a 23 years TOPAZ reanalysis L. Bertino, F. Counillon, J. Xie,, NERSC LOM meeting, Copenhagen, 2 nd -4 th June 2015 Outline Presentation of the TOPAZ4 system Choice of modeling and assimilation

More information

Towards a probabilistic hydrological forecasting and data assimilation system. Henrik Madsen DHI, Denmark

Towards a probabilistic hydrological forecasting and data assimilation system. Henrik Madsen DHI, Denmark Towards a probabilistic hydrological forecasting and data assimilation system Henrik Madsen DHI, Denmark Outline Hydrological forecasting Data assimilation framework Data assimilation experiments Concluding

More information

A data assimilation approach for reconstructing sea ice volume in the Southern Hemisphere

A data assimilation approach for reconstructing sea ice volume in the Southern Hemisphere Harmony on Ice 2 meeting Paris, 28-29 Nov. 2011 A data assimilation approach for reconstructing sea ice volume in the Southern Hemisphere F. Massonnet, P. Mathiot, T. Fichefet, H. Goosse, C. König Beatty,

More information

Particle Filters. Outline

Particle Filters. Outline Particle Filters M. Sami Fadali Professor of EE University of Nevada Outline Monte Carlo integration. Particle filter. Importance sampling. Degeneracy Resampling Example. 1 2 Monte Carlo Integration Numerical

More information

T2.2: Development of assimilation techniques for improved use of surface observations

T2.2: Development of assimilation techniques for improved use of surface observations WP2 T2.2: Development of assimilation techniques for improved use of surface observations Matt Martin, Rob King, Dan Lea, James While, Charles-Emmanuel Testut November 2014, ECMWF, Reading, UK. Contents

More information

Sequential data assimilation techniques in oceanography

Sequential data assimilation techniques in oceanography Sequential data assimilation techniques in oceanography Laurent BERTINO ½, Geir EVENSEN ½, Hans WACKERNAGEL ¾ ½ Nansen Environmental and Remote Sensing Center, Norway ¾ Centre de Géostatistique, Ecole

More information

An Ensemble Kalman Filter with a 1{D Marine Ecosystem Model Mette Eknes and Geir Evensen Nansen Environmental and Remote Sensing Center, Bergen, Norwa

An Ensemble Kalman Filter with a 1{D Marine Ecosystem Model Mette Eknes and Geir Evensen Nansen Environmental and Remote Sensing Center, Bergen, Norwa An Ensemble Kalman Filter with a 1{D Marine Ecosystem Model Mette Eknes and Geir Evensen Nansen Environmental and Remote Sensing Center, Bergen, Norway Journal of Marine Systems, submitted, 1999 Mette

More information

Robust Ensemble Filtering With Improved Storm Surge Forecasting

Robust Ensemble Filtering With Improved Storm Surge Forecasting Robust Ensemble Filtering With Improved Storm Surge Forecasting U. Altaf, T. Buttler, X. Luo, C. Dawson, T. Mao, I.Hoteit Meteo France, Toulouse, Nov 13, 2012 Project Ensemble data assimilation for storm

More information

6 Sequential Data Assimilation for Nonlinear Dynamics: The Ensemble Kalman Filter

6 Sequential Data Assimilation for Nonlinear Dynamics: The Ensemble Kalman Filter 6 Sequential Data Assimilation for Nonlinear Dynamics: The Ensemble Kalman Filter GEIR EVENSEN Nansen Environmental and Remote Sensing Center, Bergen, Norway 6.1 Introduction Sequential data assimilation

More information

Analysis Scheme in the Ensemble Kalman Filter

Analysis Scheme in the Ensemble Kalman Filter JUNE 1998 BURGERS ET AL. 1719 Analysis Scheme in the Ensemble Kalman Filter GERRIT BURGERS Royal Netherlands Meteorological Institute, De Bilt, the Netherlands PETER JAN VAN LEEUWEN Institute or Marine

More information

Norwegian Climate Prediction Model (NorCPM) getting ready for CMIP6 DCPP

Norwegian Climate Prediction Model (NorCPM) getting ready for CMIP6 DCPP Norwegian Climate Prediction Model (NorCPM) getting ready for CMIP6 DCPP Francois Counillon, Noel Keenlyside, Mats Bentsen, Ingo Bethke, Laurent Bertino, Teferi Demissie, Tor Eldevik, Shunya Koseki, Camille

More information

A Unification of Ensemble Square Root Kalman Filters. and Wolfgang Hiller

A Unification of Ensemble Square Root Kalman Filters. and Wolfgang Hiller Generated using version 3.0 of the official AMS L A TEX template A Unification of Ensemble Square Root Kalman Filters Lars Nerger, Tijana Janjić, Jens Schröter, and Wolfgang Hiller Alfred Wegener Institute

More information

Modeling Marine Microbes: Past, Present and Prospects Mick Follows MIT

Modeling Marine Microbes: Past, Present and Prospects Mick Follows MIT Modeling Marine Microbes: Past, Present and Prospects Mick Follows MIT What do we mean by models? Concepts Statistical relationships Mathematical descriptions Numerical models Why theory and numerical

More information

DATA ASSIMILATION FOR FLOOD FORECASTING

DATA ASSIMILATION FOR FLOOD FORECASTING DATA ASSIMILATION FOR FLOOD FORECASTING Arnold Heemin Delft University of Technology 09/16/14 1 Data assimilation is the incorporation of measurement into a numerical model to improve the model results

More information

On the relative importance of Argo, SST and altimetry for an ocean reanalysis

On the relative importance of Argo, SST and altimetry for an ocean reanalysis Document prepared on February 20, 2007 for the Argo Steering Team Meeting (AST-8), Paris March 7-9 On the relative importance of Argo, SST and altimetry for an ocean reanalysis Peter R. Oke and Andreas

More information

Lagrangian Data Assimilation and Manifold Detection for a Point-Vortex Model. David Darmon, AMSC Kayo Ide, AOSC, IPST, CSCAMM, ESSIC

Lagrangian Data Assimilation and Manifold Detection for a Point-Vortex Model. David Darmon, AMSC Kayo Ide, AOSC, IPST, CSCAMM, ESSIC Lagrangian Data Assimilation and Manifold Detection for a Point-Vortex Model David Darmon, AMSC Kayo Ide, AOSC, IPST, CSCAMM, ESSIC Background Data Assimilation Iterative process Forecast Analysis Background

More information

Particle Markov Chain Monte Carlo Methods in Marine Biogeochemistry. Lawrence Murray and Emlyn Jones CSIRO Mathematics, Informatics and Statistics

Particle Markov Chain Monte Carlo Methods in Marine Biogeochemistry. Lawrence Murray and Emlyn Jones CSIRO Mathematics, Informatics and Statistics Particle Markov Chain Monte Carlo Methods in Marine Biogeochemistry Lawrence Murray and Emlyn Jones CSIRO Mathematics, Informatics and Statistics Outline Case studies in marine biogeochemistry and generic

More information

Bayesian statistical data assimilation for ecosystem models using Markov Chain Monte Carlo

Bayesian statistical data assimilation for ecosystem models using Markov Chain Monte Carlo Available online at www.sciencedirect.com Journal of Marine Systems 68 (2007) 439 456 www.elsevier.com/locate/jmarsys Bayesian statistical data assimilation for ecosystem models using Markov Chain Monte

More information

Numerical Weather Prediction: Data assimilation. Steven Cavallo

Numerical Weather Prediction: Data assimilation. Steven Cavallo Numerical Weather Prediction: Data assimilation Steven Cavallo Data assimilation (DA) is the process estimating the true state of a system given observations of the system and a background estimate. Observations

More information

OPEC Annual Meeting Zhenwen Wan. Center for Ocean and Ice, DMI, Denmark

OPEC Annual Meeting Zhenwen Wan. Center for Ocean and Ice, DMI, Denmark OPEC Annual Meeting 2012 Zhenwen Wan Center for Ocean and Ice, DMI, Denmark Outlines T2.1 Meta forcing and river loadings. Done, Tian T2.3 Observation data for 20 years. Done, Zhenwen T2.4.1 ERGOM upgrade:

More information

Combining geostatistics and Kalman filtering for data assimilation in an estuarine system

Combining geostatistics and Kalman filtering for data assimilation in an estuarine system INSTITUTE OF PHYSICS PUBLISHING Inverse Problems 18 (2002) 1 23 INVERSE PROBLEMS PII: S0266-5611(02)20832-1 Combining geostatistics and Kalman filtering for data assimilation in an estuarine system Laurent

More information

A comparison of sequential data assimilation schemes for. Twin Experiments

A comparison of sequential data assimilation schemes for. Twin Experiments A comparison of sequential data assimilation schemes for ocean prediction with HYCOM Twin Experiments A. Srinivasan, University of Miami, Miami, FL E. P. Chassignet, COAPS, Florida State University, Tallahassee,

More information

Data Assimilation for Dispersion Models

Data Assimilation for Dispersion Models Data Assimilation for Dispersion Models K. V. Umamaheswara Reddy Dept. of Mechanical and Aerospace Engg. State University of New Yor at Buffalo Buffalo, NY, U.S.A. venatar@buffalo.edu Yang Cheng Dept.

More information

EcoFish WP2 work and Wind, NAO and ecosystemselected

EcoFish WP2 work and Wind, NAO and ecosystemselected EcoFish WP2 work and Wind, NAO and ecosystemselected articles Solfrid Sætre Hjøllo Meeting point ECOFISH March 8, 2007 Description of EcoFish WP2-work Run, analyze & validate numerical ocean/biology models,

More information

Lagrangian Data Assimilation and Its Application to Geophysical Fluid Flows

Lagrangian Data Assimilation and Its Application to Geophysical Fluid Flows Lagrangian Data Assimilation and Its Application to Geophysical Fluid Flows Laura Slivinski June, 3 Laura Slivinski (Brown University) Lagrangian Data Assimilation June, 3 / 3 Data Assimilation Setup:

More information

The Canadian approach to ensemble prediction

The Canadian approach to ensemble prediction The Canadian approach to ensemble prediction ECMWF 2017 Annual seminar: Ensemble prediction : past, present and future. Pieter Houtekamer Montreal, Canada Overview. The Canadian approach. What are the

More information

Data assimilation in high dimensions

Data assimilation in high dimensions Data assimilation in high dimensions David Kelly Courant Institute New York University New York NY www.dtbkelly.com February 12, 2015 Graduate seminar, CIMS David Kelly (CIMS) Data assimilation February

More information

Environment Canada s Regional Ensemble Kalman Filter

Environment Canada s Regional Ensemble Kalman Filter Environment Canada s Regional Ensemble Kalman Filter May 19, 2014 Seung-Jong Baek, Luc Fillion, Kao-Shen Chung, and Peter Houtekamer Meteorological Research Division, Environment Canada, Dorval, Quebec

More information

Introduction to data assimilation and least squares methods

Introduction to data assimilation and least squares methods Introduction to data assimilation and least squares methods Eugenia Kalnay and many friends University of Maryland October 008 (part 1 Contents (1 Forecasting the weather - we are really getting better!

More information

Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics

Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics JOURNAL OF GEOPHYSICAL RESEARCH, VOL. 99, NO. C, PAGES,143,162, MAY, 1994 Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics Geir

More information

A State Space Model for Wind Forecast Correction

A State Space Model for Wind Forecast Correction A State Space Model for Wind Forecast Correction Valrie Monbe, Pierre Ailliot 2, and Anne Cuzol 1 1 Lab-STICC, Université Européenne de Bretagne, France (e-mail: valerie.monbet@univ-ubs.fr, anne.cuzol@univ-ubs.fr)

More information

Jeffrey Polovina 1, John Dunne 2, Phoebe Woodworth 1, and Evan Howell 1

Jeffrey Polovina 1, John Dunne 2, Phoebe Woodworth 1, and Evan Howell 1 Projected expansion of the subtropical biome and contraction of the temperate and equatorial upwelling biomes in the North Pacific under global warming Jeffrey Polovina 1, John Dunne 2, Phoebe Woodworth

More information

Objective localization of ensemble covariances: theory and applications

Objective localization of ensemble covariances: theory and applications Institutionnel Grand Public Objective localization of ensemble covariances: theory and applications Yann Michel1, B. Me ne trier2 and T. Montmerle1 Professionnel (1) Me te o-france & CNRS, Toulouse, France

More information

Relative Merits of 4D-Var and Ensemble Kalman Filter

Relative Merits of 4D-Var and Ensemble Kalman Filter Relative Merits of 4D-Var and Ensemble Kalman Filter Andrew Lorenc Met Office, Exeter International summer school on Atmospheric and Oceanic Sciences (ISSAOS) "Atmospheric Data Assimilation". August 29

More information

SPECIAL PROJECT PROGRESS REPORT

SPECIAL PROJECT PROGRESS REPORT SPECIAL PROJECT PROGRESS REPORT Progress Reports should be 2 to 10 pages in length, depending on importance of the project. All the following mandatory information needs to be provided. Reporting year

More information

Forecasting and data assimilation

Forecasting and data assimilation Supported by the National Science Foundation DMS Forecasting and data assimilation Outline Numerical models Kalman Filter Ensembles Douglas Nychka, Thomas Bengtsson, Chris Snyder Geophysical Statistics

More information

Superparameterization and Dynamic Stochastic Superresolution (DSS) for Filtering Sparse Geophysical Flows

Superparameterization and Dynamic Stochastic Superresolution (DSS) for Filtering Sparse Geophysical Flows SP and DSS for Filtering Sparse Geophysical Flows Superparameterization and Dynamic Stochastic Superresolution (DSS) for Filtering Sparse Geophysical Flows Presented by Nan Chen, Michal Branicki and Chenyue

More information

A Note on the Particle Filter with Posterior Gaussian Resampling

A Note on the Particle Filter with Posterior Gaussian Resampling Tellus (6), 8A, 46 46 Copyright C Blackwell Munksgaard, 6 Printed in Singapore. All rights reserved TELLUS A Note on the Particle Filter with Posterior Gaussian Resampling By X. XIONG 1,I.M.NAVON 1,2 and

More information

Data Assimilation with the Ensemble Kalman Filter and the SEIK Filter applied to a Finite Element Model of the North Atlantic

Data Assimilation with the Ensemble Kalman Filter and the SEIK Filter applied to a Finite Element Model of the North Atlantic Data Assimilation with the Ensemble Kalman Filter and the SEIK Filter applied to a Finite Element Model of the North Atlantic L. Nerger S. Danilov, G. Kivman, W. Hiller, and J. Schröter Alfred Wegener

More information

Ensembles and Particle Filters for Ocean Data Assimilation

Ensembles and Particle Filters for Ocean Data Assimilation DISTRIBUTION STATEMENT A. Approved for public release; distribution is unlimited. Ensembles and Particle Filters for Ocean Data Assimilation Robert N. Miller College of Oceanic and Atmospheric Sciences

More information

Coupled Global-Regional Data Assimilation Using Joint States

Coupled Global-Regional Data Assimilation Using Joint States DISTRIBUTION STATEMENT A. Approved for public release; distribution is unlimited. Coupled Global-Regional Data Assimilation Using Joint States Istvan Szunyogh Texas A&M University, Department of Atmospheric

More information

OOPC-GODAE workshop on OSE/OSSEs Paris, IOCUNESCO, November 5-7, 2007

OOPC-GODAE workshop on OSE/OSSEs Paris, IOCUNESCO, November 5-7, 2007 OOPC-GODAE workshop on OSE/OSSEs Paris, IOCUNESCO, November 5-7, 2007 Design of ocean observing systems: strengths and weaknesses of approaches based on assimilative systems Pierre Brasseur CNRS / LEGI

More information

2001 State of the Ocean: Chemical and Biological Oceanographic Conditions in the Newfoundland Region

2001 State of the Ocean: Chemical and Biological Oceanographic Conditions in the Newfoundland Region Stock Status Report G2-2 (2) 1 State of the Ocean: Chemical and Biological Oceanographic Conditions in the Background The Altantic Zone Monitoring Program (AZMP) was implemented in 1998 with the aim of

More information

Inter-comparison of 4D-Var and EnKF systems for operational deterministic NWP

Inter-comparison of 4D-Var and EnKF systems for operational deterministic NWP Inter-comparison of 4D-Var and EnKF systems for operational deterministic NWP Project eam: Mark Buehner Cecilien Charette Bin He Peter Houtekamer Herschel Mitchell WWRP/HORPEX Workshop on 4D-VAR and Ensemble

More information

Fundamentals of Data Assimilation

Fundamentals of Data Assimilation National Center for Atmospheric Research, Boulder, CO USA GSI Data Assimilation Tutorial - June 28-30, 2010 Acknowledgments and References WRFDA Overview (WRF Tutorial Lectures, H. Huang and D. Barker)

More information

An Iterative EnKF for Strongly Nonlinear Systems

An Iterative EnKF for Strongly Nonlinear Systems 1988 M O N T H L Y W E A T H E R R E V I E W VOLUME 140 An Iterative EnKF for Strongly Nonlinear Systems PAVEL SAKOV Nansen Environmental and Remote Sensing Center, Bergen, Norway DEAN S. OLIVER Uni Centre

More information

A new unscented Kalman filter with higher order moment-matching

A new unscented Kalman filter with higher order moment-matching A new unscented Kalman filter with higher order moment-matching KSENIA PONOMAREVA, PARESH DATE AND ZIDONG WANG Department of Mathematical Sciences, Brunel University, Uxbridge, UB8 3PH, UK. Abstract This

More information

Bayesian Inverse problem, Data assimilation and Localization

Bayesian Inverse problem, Data assimilation and Localization Bayesian Inverse problem, Data assimilation and Localization Xin T Tong National University of Singapore ICIP, Singapore 2018 X.Tong Localization 1 / 37 Content What is Bayesian inverse problem? What is

More information

The Canadian Land Data Assimilation System (CaLDAS)

The Canadian Land Data Assimilation System (CaLDAS) The Canadian Land Data Assimilation System (CaLDAS) Marco L. Carrera, Stéphane Bélair, Bernard Bilodeau and Sheena Solomon Meteorological Research Division, Environment Canada Dorval, QC, Canada 2 nd Workshop

More information

Ensemble Kalman Filtering for State and Parameter Estimation on a Reservoir Model

Ensemble Kalman Filtering for State and Parameter Estimation on a Reservoir Model Ensemble Kalman Filtering for State and Parameter Estimation on a Reservoir Model John Petter Jensen Master of Science in Engineering Cybernetics Submission date: June 27 Supervisor: Bjarne Anton Foss,

More information

Constrained State Estimation Using the Unscented Kalman Filter

Constrained State Estimation Using the Unscented Kalman Filter 16th Mediterranean Conference on Control and Automation Congress Centre, Ajaccio, France June 25-27, 28 Constrained State Estimation Using the Unscented Kalman Filter Rambabu Kandepu, Lars Imsland and

More information

Demonstration and Comparison of of Sequential Approaches for Altimeter Data Assimilation in in HYCOM

Demonstration and Comparison of of Sequential Approaches for Altimeter Data Assimilation in in HYCOM Demonstration and Comparison of of Sequential Approaches for Altimeter Data Assimilation in in HYCOM A. Srinivasan, E. P. Chassignet, O. M. Smedstad, C. Thacker, L. Bertino, P. Brasseur, T. M. Chin,, F.

More information

Ensemble Kalman filter assimilation of transient groundwater flow data via stochastic moment equations

Ensemble Kalman filter assimilation of transient groundwater flow data via stochastic moment equations Ensemble Kalman filter assimilation of transient groundwater flow data via stochastic moment equations Alberto Guadagnini (1,), Marco Panzeri (1), Monica Riva (1,), Shlomo P. Neuman () (1) Department of

More information

A Moment Matching Particle Filter for Nonlinear Non-Gaussian. Data Assimilation. and Peter Bickel

A Moment Matching Particle Filter for Nonlinear Non-Gaussian. Data Assimilation. and Peter Bickel Generated using version 3.0 of the official AMS L A TEX template A Moment Matching Particle Filter for Nonlinear Non-Gaussian Data Assimilation Jing Lei and Peter Bickel Department of Statistics, University

More information

Enhanced Ocean Prediction using Ensemble Kalman Filter Techniques

Enhanced Ocean Prediction using Ensemble Kalman Filter Techniques Enhanced Ocean Prediction using Ensemble Kalman Filter Techniques Dr Peter R. Oke CSIRO Marine and Atmospheric Research and Wealth from Oceans Flagship Program GPO Box 1538 Hobart TAS 7001 Australia phone:

More information

Local Ensemble Transform Kalman Filter: An Efficient Scheme for Assimilating Atmospheric Data

Local Ensemble Transform Kalman Filter: An Efficient Scheme for Assimilating Atmospheric Data Local Ensemble Transform Kalman Filter: An Efficient Scheme for Assimilating Atmospheric Data John Harlim and Brian R. Hunt Department of Mathematics and Institute for Physical Science and Technology University

More information

Representation of inhomogeneous, non-separable covariances by sparse wavelet-transformed matrices

Representation of inhomogeneous, non-separable covariances by sparse wavelet-transformed matrices Representation of inhomogeneous, non-separable covariances by sparse wavelet-transformed matrices Andreas Rhodin, Harald Anlauf German Weather Service (DWD) Workshop on Flow-dependent aspects of data assimilation,

More information

Comparison of of Assimilation Schemes for HYCOM

Comparison of of Assimilation Schemes for HYCOM Comparison of of Assimilation Schemes for HYCOM Ashwanth Srinivasan, C. Thacker, Z. Garraffo, E. P. Chassignet, O. M. Smedstad, J. Cummings, F. Counillon, L. Bertino, T. M. Chin, P. Brasseur and C. Lozano

More information

Localization and Correlation in Ensemble Kalman Filters

Localization and Correlation in Ensemble Kalman Filters Localization and Correlation in Ensemble Kalman Filters Jeff Anderson NCAR Data Assimilation Research Section The National Center for Atmospheric Research is sponsored by the National Science Foundation.

More information

Convergence of the Ensemble Kalman Filter in Hilbert Space

Convergence of the Ensemble Kalman Filter in Hilbert Space Convergence of the Ensemble Kalman Filter in Hilbert Space Jan Mandel Center for Computational Mathematics Department of Mathematical and Statistical Sciences University of Colorado Denver Parts based

More information

Ergodicity in data assimilation methods

Ergodicity in data assimilation methods Ergodicity in data assimilation methods David Kelly Andy Majda Xin Tong Courant Institute New York University New York NY www.dtbkelly.com April 15, 2016 ETH Zurich David Kelly (CIMS) Data assimilation

More information

How does 4D-Var handle Nonlinearity and non-gaussianity?

How does 4D-Var handle Nonlinearity and non-gaussianity? How does 4D-Var handle Nonlinearity and non-gaussianity? Mike Fisher Acknowledgements: Christina Tavolato, Elias Holm, Lars Isaksen, Tavolato, Yannick Tremolet Slide 1 Outline of Talk Non-Gaussian pdf

More information

MERSEA Marine Environment and Security for the European Area

MERSEA Marine Environment and Security for the European Area MERSEA Marine Environment and Security for the European Area Development of a European system for operational monitoring and forecasting of the ocean physics, biogeochemistry, and ecosystems, on global

More information

Liverpool NEMO Shelf Arctic Ocean modelling

Liverpool NEMO Shelf Arctic Ocean modelling St. Andrews 22 July 2013 ROAM @ Liverpool NEMO Shelf Arctic Ocean modelling Maria Luneva, Jason Holt, Sarah Wakelin NEMO shelf Arctic Ocean model About 50% of the Arctic is shelf sea (

More information

A Dressed Ensemble Kalman Filter Using the Hybrid Coordinate Ocean Model in the Pacific

A Dressed Ensemble Kalman Filter Using the Hybrid Coordinate Ocean Model in the Pacific ADVANCES IN ATMOSPHERIC SCIENCES, VOL. 26, NO. 5, 2009, 1042 1052 A Dressed Ensemble Kalman Filter Using the Hybrid Coordinate Ocean Model in the Pacific WAN Liying 1 (!"#), ZHU Jiang 2 ($%), WANG Hui

More information

Geir Evensen Data Assimilation

Geir Evensen Data Assimilation Geir Evensen Data Assimilation Geir Evensen Data Assimilation The Ensemble Kalman Filter With 63 Figures PROF.GEIR EVENSEN Hydro Research Centre, Bergen PO Box 7190 N 5020 Bergen Norway and Mohn-Sverdrup

More information

arxiv: v1 [physics.ao-ph] 23 Jan 2009

arxiv: v1 [physics.ao-ph] 23 Jan 2009 A Brief Tutorial on the Ensemble Kalman Filter Jan Mandel arxiv:0901.3725v1 [physics.ao-ph] 23 Jan 2009 February 2007, updated January 2009 Abstract The ensemble Kalman filter EnKF) is a recursive filter

More information

SANGOMA: Stochastic Assimilation for the Next Generation Ocean Model Applications EU FP7 SPACE project

SANGOMA: Stochastic Assimilation for the Next Generation Ocean Model Applications EU FP7 SPACE project SANGOMA: Stochastic Assimilation for the Next Generation Ocean Model Applications EU FP7 SPACE-2011-1 project 283580 Instructions for Equivalent Weights Particle Filter code Delivery date: November 7,

More information

A data-driven method for improving the correlation estimation in serial ensemble Kalman filter

A data-driven method for improving the correlation estimation in serial ensemble Kalman filter A data-driven method for improving the correlation estimation in serial ensemble Kalman filter Michèle De La Chevrotière, 1 John Harlim 2 1 Department of Mathematics, Penn State University, 2 Department

More information

Development of a land data assimilation system at NILU

Development of a land data assimilation system at NILU Development of a land data assimilation system at NILU W.A. Lahoz, wal@nilu.no 10 th June 2009, 2 nd Workshop on Remote Sensing and Modeling of Surface Properties, Toulouse, France Thanks to S.-E. Walker

More information

Lessons in Estimation Theory for Signal Processing, Communications, and Control

Lessons in Estimation Theory for Signal Processing, Communications, and Control Lessons in Estimation Theory for Signal Processing, Communications, and Control Jerry M. Mendel Department of Electrical Engineering University of Southern California Los Angeles, California PRENTICE HALL

More information

Using the Mercator ocean forecasting system to compute coastal maritime pollution risk indicators on the Atlantic European coasts

Using the Mercator ocean forecasting system to compute coastal maritime pollution risk indicators on the Atlantic European coasts Environmental Problems in Coastal Regions VI 437 Using the Mercator ocean forecasting system to compute coastal maritime pollution risk indicators on the Atlantic European coasts S. Besnard 1, E. Dombrowsky

More information

Four-dimensional ensemble Kalman filtering

Four-dimensional ensemble Kalman filtering Tellus (24), 56A, 273 277 Copyright C Blackwell Munksgaard, 24 Printed in UK. All rights reserved TELLUS Four-dimensional ensemble Kalman filtering By B. R. HUNT 1, E. KALNAY 1, E. J. KOSTELICH 2,E.OTT

More information

A Stochastic Collocation based. for Data Assimilation

A Stochastic Collocation based. for Data Assimilation A Stochastic Collocation based Kalman Filter (SCKF) for Data Assimilation Lingzao Zeng and Dongxiao Zhang University of Southern California August 11, 2009 Los Angeles Outline Introduction SCKF Algorithm

More information

Data assimilation in the geosciences An overview

Data assimilation in the geosciences An overview Data assimilation in the geosciences An overview Alberto Carrassi 1, Olivier Talagrand 2, Marc Bocquet 3 (1) NERSC, Bergen, Norway (2) LMD, École Normale Supérieure, IPSL, France (3) CEREA, joint lab École

More information

Data Assimilation Research Testbed Tutorial

Data Assimilation Research Testbed Tutorial Data Assimilation Research Testbed Tutorial Section 2: How should observations of a state variable impact an unobserved state variable? Multivariate assimilation. Single observed variable, single unobserved

More information

A statistical overview and perspectives on data assimilation for marine biogeochemical models

A statistical overview and perspectives on data assimilation for marine biogeochemical models Special Issue Paper Received: 6 October 2013, Revised: 22 January 2014, Accepted: 24 January 2014, Published online in Wiley Online Library (wileyonlinelibrary.com) DOI: 10.1002/env.2264 A statistical

More information

New developments in data assimilation in MIKE 21/3 FM Assimilation of along-track altimetry data with correlated measurement errors

New developments in data assimilation in MIKE 21/3 FM Assimilation of along-track altimetry data with correlated measurement errors New developments in data assimilation in MIKE 21/3 FM Assimilation of along-track altimetry data with correlated measurement errors EnKF Workshop 2016-06-20 Jesper Sandvig Mariegaard Henrik Andersson DHI

More information

A Moment Matching Ensemble Filter for Nonlinear Non-Gaussian Data Assimilation

A Moment Matching Ensemble Filter for Nonlinear Non-Gaussian Data Assimilation 3964 M O N T H L Y W E A T H E R R E V I E W VOLUME 139 A Moment Matching Ensemble Filter for Nonlinear Non-Gaussian Data Assimilation JING LEI AND PETER BICKEL Department of Statistics, University of

More information

Finite-size ensemble Kalman filters (EnKF-N)

Finite-size ensemble Kalman filters (EnKF-N) Finite-size ensemble Kalman filters (EnKF-N) Marc Bocquet (1,2), Pavel Sakov (3,4) (1) Université Paris-Est, CEREA, joint lab École des Ponts ParisTech and EdF R&D, France (2) INRIA, Paris-Rocquencourt

More information