Application of the Ensemble Kalman Filter to History Matching

Size: px
Start display at page:

Download "Application of the Ensemble Kalman Filter to History Matching"

Transcription

1 Application of the Ensemble Kalman Filter to History Matching Presented at Texas A&M, November 16,2010

2 Outline Philosophy EnKF for Data Assimilation Field History Match Using EnKF with Covariance Localization

3 History Matching-Philosophical Generating multiple history-matched models is desirable but without a formal definition of probabilities, it is difficult to know how to interpret the uncertainty in reservoir description and future performance predictions. It is impossible to correctly estimate all the parameters of a model from inaccurate, inconsistent, and insufficient, data and most practitioners select a reduced parameterization of the model. Reducing parameters reduces ill-conditioning of the inverse problem, but reducing the number of parameters results in an under estimation of uncertainty, which may be dangerous for performance predictions especially when mechanisms or operating conditions change. Bayesian framework, apply randomized maximum likelihood (RML) for sampling posterior pdf for m. Requires minimization of a sequence of obective functions which is done with a quasi-newton method with the gradient computed by an adoint method.

4 Gradient Based History Matching Bayesian framework, apply randomized maximum likelihood (RML) for sampling posterior pdf for reservoir model parameters. Requires minimization of a sequence of obective functions: quasi-newton with adoint gradient. f (m d obs ) = a exp O(m)). O(m) = 1 2 (m m prior) T C 1 M (m m prior) (d f (m) d obs ) T C 1 D (d f (m) d obs ) m uc, N(m prior, C M ) d uc, N(d obs, C D ) then, minimize O (m) = 1 2 (m m uc, ) T C 1 M (m m uc,) (d f (m) d uc, ) T C 1 D (d f (m) d uc, )

5 Commercial simulators have little or no capability of computing gradients with the adoint method. Difficult to attach adoint code to simulator without detailed knowledge of simulator numerics. Thus, our more recent focus is has been on gradient free optimization algorithms or at least algorithms that use the simulator as a black box, e.g., SPSA, the ensemble Kalman filter, quadratic interpolation, ensemble optimization.

6 Ensemble Kalman Filter We start at time zero with a ensemble of models (N e realizations) and then assimilate data sequentially in time. For linear problems with measurement errors uncorrelated in time, sequential data assimilation is equivalent to matching all data simultaneously. Every time we have new production data, we integrate the data into each model in the ensemble to obtain a new history-matched model. Moreover, we also update the primary variables of the simulator to attempt to make them consistent with the values we would have obtained if we reran the simulator from time zero using the updated vectors of model parameters. In gradient-based history matching algorithms, we match all historical data simultaneously. Every time we update the model we run the simulator from time zero to update the simulation primary (state) variables.

7 Ensemble Kalman Filter After updating both parameters and states, we continue to run the simulator forward until we reach a time where we want to match new measured data. (Thus, EnKF fits perfectly into the real-time reservoir management concept.) KF Data Mean 0.4 Data Time

8 Ensemble Kalman Filter Equations Comment: Similar to doing one iteration of the Gauss-Newton method with an average sensitivity matrix, Reynolds et al. (ECMOR, 2006). y n,a = y n, f 1 + C Y n,f D n, f CD n + C D n, f D n,f d n uc, d n,f, x 1 C D n + C D n,f D n, f d n uc, d n, f. C Y n,f D n,f x = 1 N e 1 N e =1 y n, f y n, f d n, f 1 N e 1 d n,f T x N e =1 y n, f y n, f b Important Comment: Each updated y n,a is a linear combination of the ensemble of forecasts. Each m n,a is a linear combination of the initial ensemble of reservoir models.

9 Ensemble Kalman Filter Equations For notational simplicity, assume reservoir simulation steps coincide with data assimilation steps. m n,a = m n,f = m n 1,a + 1 N e 1 m y n, f n, f m n 1,a = = g(p n 1,a, m n 1,a ) p n, f 1 + C M n,f,d n, f CD n + C D n, f,d n, f d n uc, d n,f = m n 1,a + C M n 1,a,D n,f x n N e =1 m n,f m n, f d n, f d n,f T x n N e = =1 a n mn 1,a Important Comment: Applying the preceding equation recursively shows that for every n, m n,a is a linear combination of the initial ensemble of vectors of model parameters. Thus, if we cannot match data with a linear combination of this ensemble, EnKF cannot give a good data match.

10 Problems with EnKF Because each updated vector of reservoir model parameters is a linear combination of the initial set, there are a limited number of degrees of freedom to assimilate data. Sampling error in approximating covariances with a small ensembles of realizations. Leads (a) spurious correlations between data and states which causes changes in components of model and state vectors far distances far from observations even though data are insensitive to these components; (b) underestimation of variances (uncertainty). Can lead to ensemble collapse where all ensemble members become essentially the same. Occurs because of loss of rank. Common solution is covariance localization. Effectively kills off long distance spurious correlations and updates individual entries of the combined state vector using different linear combinations of corresponding entries of initial ensemble. Similar to using only data near a component of y to update that component.

11 Problems with EnKF Can only show that EnKF samples the correct pdf when the dynamical system (reservoir simulator) is linear, predicted data are linearly related to the state vector, the random vector of predicted states is Gaussian and the size of the ensemble goes to infinity. In this situation, EnKF is identical to RML. For highly nonlinear problems, the consistency between updated state vector and updated vector of model parameters can occasionally break down. Crude Fix: Periodic reruns from time zero, or some other iterative method, reduces computational efficiency, but computational experiments indicate that often we can get by with only a few reruns. Samples generated with EnKF are only from a local region of the pdf and are relatively low probability as they correspond to relatively high values of O(m).

12 Ensemble Size=100 text=ensemble size =100

13 Ensemble Size=10 text=ensemble size=10

14 Covariance Localization C f Y n ρ = ρ n C f Y n where denotes the Schur product. Hamill (2001) showed that a covariance matrix becomes full rank when this Schur product is employed as long as rho n is real symmetric positive definite. In history matching applications of the EnKF, it is not feasible to explicitly form the covariance C f Y n or the Schur product involving this matrix. Instead, we partition C f Y n and ρ n and after extensive algebra (Emerick and Reynolds, Comp. Geosciences 2010) the EnKF analysis equation with covariance localization becomes y n,a = y n, f + ρ Y n D n C Y n,f D n, f (C Dn + ρ D n D n C D n, f D n,f ) 1 (d n uc, d n,f ). (1)

15 Covariance Localization As in standard implementations of EnKF, we can avoid direct formation of the matrices such as C f Y n D n and ρ Y n D n C f Y n D n. Once the vector x (C Dn + ρ D n D n C f D n D ) 1 (d n n uc, d n, f ) has been formed, calculation of ρ Y n D n C f Y n D n x requires only vector inner products and vector sums. Here, ρ M n,f,d n, f, ρ P n, f D n, f correlation function. and ρ D n Dn, are based on the same

16 Calculation of correlation matrix We use the fifth-order compact correlation function defined by Gaspari and Cohn (1999) to calculate the elements of correlation matrix 1 ( δ 4 L )5 + 1 ( δ 2 L )4 + 5 ( δ 8 L )3 5 ( δ 3 L ) δ L 1 ρ = ( δ 12 L )5 1 ( δ 2 L )4 + 5 ( δ 8 L )3 + 5 ( δ 3 L )2 5( δ ) ( δ L 3 L ) 1 L δ 2L 0 δ > 2L, where L is the length scale of the correlation function, and δ is the Euclidean distance between any grid point and an observation location. Throughout, we refer to L as the critical length. Note that ρ is zero for δ 2L, and when δ = L, ρ For an anisotropic two-dimensional model, we assume that the shape of the area correlated to the data is an elliptical area determined by two critical lengths, L x and L y, rotated by θ as illustrated in the following figure.

17 Correlation Function y L x L y θ x Figure: Anisotropic correlation function.

18 Emerick and Reynolds, Comp. Geosciences, Region of correlation should be equal to geometric sum of region of sensitivity and prior correlation region. (a) Sensitivity (G). (b) Prior covariance (c) Product C (C f M n). f M n GT. Figure: Example illustrating that the ranges of the product C f M n GT are equal to the sum of the radius of influence of the sensitivity matrix and the correlation lengths of the prior covariance.

19 Drainage areas Damiani (2007) proposed a method based on calculation of a pseudo-tracer concentration to define drainage areas associated with each well. The computations are performed as a postprocessing of results of a reservoir simulation using the velocity fields stored during the simulation. Drainage areas obtained with this procedure are equivalent to the ones obtained by tracing the streamlines. Streamlines Pseudo-tracer concentration (Damiani, 2007) Figure: Streamlines versus pseudotracer.

20 Well P4 Time: days Drainage area versus sensitivities Permeability (True model) P4 Drainage area P4 I1 I1 P4 Oil rate P4 Water rate q o lnk I1 q w lnk I1 Figure: True sensitivities versus drainage areas from streamlines

21 Field Example Description Upper zone of a turbidite reservoir in Campos Basis Grid 165 x 86 x 4 and 20,258 active gridblocks Observed data: water rate in producer wells Well controls: Producers: oil rate Inectors: water rate Current model (manual history matching): match data fairly well but it is very artificial (several patches) Total history ~10 years. We used 7.6 years for history matching and 2.4 years to compare predictions

22 Initial ensemble: 200 models. Sequential Gaussian Simulation. Hard data permeabilities from well tests. Cases Description EnKF. EnKF with localization (drainage + prior). Horizontal permeabilities. Vertical permeability is calculated using kv/kh = 0.3.

23 Turbidite systems

24 Permeability Manual history-matched model Producer Water inector Layer 4

25 Localization Prior correlation Drainage region Ellipse obtained from drainage region Localization (Gaspari-Cohn)

26 Permeability initial ensemble mean Producer Water inector Layer 4

27 Permeability ensemble mean EnKF Producer Water inector Layer 4

28 Permeability ensemble mean EnKF with localization Producer Water inector Layer 4

29 Standard deviation of ln(k) Initial ensemble EnKF EnKF + localization

30 Obective function Data mismatch considering the history part only. Normalized: O N = O d /N d EnKF EnKF + localization (manual history match) 100% (manual history match) 100% Relative freq Mean: % 60% 40% 20% Cumulative freq. Relative freq Mean: % 60% 40% 20% Cumulative freq O N 0% O N 0%

31 Obective function Data mismatch considering the prediction part only. Normalized: O N = O d /N d EnKF EnKF + localization (manual history match) 100% (manual history match) 100% Relative freq Mean: % 60% 40% 20% Cumulative freq. Relative freq Mean: % 60% 40% 20% Cumulative freq O N 0% O N 0%

Gaussian Filtering Strategies for Nonlinear Systems

Gaussian Filtering Strategies for Nonlinear Systems Gaussian Filtering Strategies for Nonlinear Systems Canonical Nonlinear Filtering Problem ~u m+1 = ~ f (~u m )+~ m+1 ~v m+1 = ~g(~u m+1 )+~ o m+1 I ~ f and ~g are nonlinear & deterministic I Noise/Errors

More information

4. DATA ASSIMILATION FUNDAMENTALS

4. DATA ASSIMILATION FUNDAMENTALS 4. DATA ASSIMILATION FUNDAMENTALS... [the atmosphere] "is a chaotic system in which errors introduced into the system can grow with time... As a consequence, data assimilation is a struggle between chaotic

More information

Kalman Filter and Ensemble Kalman Filter

Kalman Filter and Ensemble Kalman Filter Kalman Filter and Ensemble Kalman Filter 1 Motivation Ensemble forecasting : Provides flow-dependent estimate of uncertainty of the forecast. Data assimilation : requires information about uncertainty

More information

Fundamentals of Data Assimila1on

Fundamentals of Data Assimila1on 014 GSI Community Tutorial NCAR Foothills Campus, Boulder, CO July 14-16, 014 Fundamentals of Data Assimila1on Milija Zupanski Cooperative Institute for Research in the Atmosphere Colorado State University

More information

Ergodicity in data assimilation methods

Ergodicity in data assimilation methods Ergodicity in data assimilation methods David Kelly Andy Majda Xin Tong Courant Institute New York University New York NY www.dtbkelly.com April 15, 2016 ETH Zurich David Kelly (CIMS) Data assimilation

More information

(Extended) Kalman Filter

(Extended) Kalman Filter (Extended) Kalman Filter Brian Hunt 7 June 2013 Goals of Data Assimilation (DA) Estimate the state of a system based on both current and all past observations of the system, using a model for the system

More information

Parameter Estimation in Reservoir Engineering Models via Data Assimilation Techniques

Parameter Estimation in Reservoir Engineering Models via Data Assimilation Techniques Parameter Estimation in Reservoir Engineering Models via Data Assimilation Techniques Mariya V. Krymskaya TU Delft July 6, 2007 Ensemble Kalman Filter (EnKF) Iterative Ensemble Kalman Filter (IEnKF) State

More information

The Inversion Problem: solving parameters inversion and assimilation problems

The Inversion Problem: solving parameters inversion and assimilation problems The Inversion Problem: solving parameters inversion and assimilation problems UE Numerical Methods Workshop Romain Brossier romain.brossier@univ-grenoble-alpes.fr ISTerre, Univ. Grenoble Alpes Master 08/09/2016

More information

Relative Merits of 4D-Var and Ensemble Kalman Filter

Relative Merits of 4D-Var and Ensemble Kalman Filter Relative Merits of 4D-Var and Ensemble Kalman Filter Andrew Lorenc Met Office, Exeter International summer school on Atmospheric and Oceanic Sciences (ISSAOS) "Atmospheric Data Assimilation". August 29

More information

Numerical computation II. Reprojection error Bundle adjustment Family of Newtonʼs methods Statistical background Maximum likelihood estimation

Numerical computation II. Reprojection error Bundle adjustment Family of Newtonʼs methods Statistical background Maximum likelihood estimation Numerical computation II Reprojection error Bundle adjustment Family of Newtonʼs methods Statistical background Maximum likelihood estimation Reprojection error Reprojection error = Distance between the

More information

Data assimilation in high dimensions

Data assimilation in high dimensions Data assimilation in high dimensions David Kelly Courant Institute New York University New York NY www.dtbkelly.com February 12, 2015 Graduate seminar, CIMS David Kelly (CIMS) Data assimilation February

More information

Fundamentals of Data Assimila1on

Fundamentals of Data Assimila1on 2015 GSI Community Tutorial NCAR Foothills Campus, Boulder, CO August 11-14, 2015 Fundamentals of Data Assimila1on Milija Zupanski Cooperative Institute for Research in the Atmosphere Colorado State University

More information

Bayesian Inverse problem, Data assimilation and Localization

Bayesian Inverse problem, Data assimilation and Localization Bayesian Inverse problem, Data assimilation and Localization Xin T Tong National University of Singapore ICIP, Singapore 2018 X.Tong Localization 1 / 37 Content What is Bayesian inverse problem? What is

More information

Assisted History Matching

Assisted History Matching The University of Tulsa Petroleum Reservoir Exploitation Projects (TUPREP) Assisted History Matching Al Reynolds Tutorial Lecture on Assisted History Matching IPAM Workship III, Data Assimilation, Uncertainty

More information

Localization in the ensemble Kalman Filter

Localization in the ensemble Kalman Filter Department of Meteorology Localization in the ensemble Kalman Filter Ruth Elizabeth Petrie A dissertation submitted in partial fulfilment of the requirement for the degree of MSc. Atmosphere, Ocean and

More information

Ensemble Kalman filter assimilation of transient groundwater flow data via stochastic moment equations

Ensemble Kalman filter assimilation of transient groundwater flow data via stochastic moment equations Ensemble Kalman filter assimilation of transient groundwater flow data via stochastic moment equations Alberto Guadagnini (1,), Marco Panzeri (1), Monica Riva (1,), Shlomo P. Neuman () (1) Department of

More information

Performance of ensemble Kalman filters with small ensembles

Performance of ensemble Kalman filters with small ensembles Performance of ensemble Kalman filters with small ensembles Xin T Tong Joint work with Andrew J. Majda National University of Singapore Sunday 28 th May, 2017 X.Tong EnKF performance 1 / 31 Content Ensemble

More information

arxiv: v1 [physics.ao-ph] 23 Jan 2009

arxiv: v1 [physics.ao-ph] 23 Jan 2009 A Brief Tutorial on the Ensemble Kalman Filter Jan Mandel arxiv:0901.3725v1 [physics.ao-ph] 23 Jan 2009 February 2007, updated January 2009 Abstract The ensemble Kalman filter EnKF) is a recursive filter

More information

New Fast Kalman filter method

New Fast Kalman filter method New Fast Kalman filter method Hojat Ghorbanidehno, Hee Sun Lee 1. Introduction Data assimilation methods combine dynamical models of a system with typically noisy observations to obtain estimates of the

More information

A new Hierarchical Bayes approach to ensemble-variational data assimilation

A new Hierarchical Bayes approach to ensemble-variational data assimilation A new Hierarchical Bayes approach to ensemble-variational data assimilation Michael Tsyrulnikov and Alexander Rakitko HydroMetCenter of Russia College Park, 20 Oct 2014 Michael Tsyrulnikov and Alexander

More information

Lagrangian Data Assimilation and Manifold Detection for a Point-Vortex Model. David Darmon, AMSC Kayo Ide, AOSC, IPST, CSCAMM, ESSIC

Lagrangian Data Assimilation and Manifold Detection for a Point-Vortex Model. David Darmon, AMSC Kayo Ide, AOSC, IPST, CSCAMM, ESSIC Lagrangian Data Assimilation and Manifold Detection for a Point-Vortex Model David Darmon, AMSC Kayo Ide, AOSC, IPST, CSCAMM, ESSIC Background Data Assimilation Iterative process Forecast Analysis Background

More information

Assessing the Value of Information from Inverse Modelling for Optimising Long-Term Oil Reservoir Performance

Assessing the Value of Information from Inverse Modelling for Optimising Long-Term Oil Reservoir Performance Assessing the Value of Information from Inverse Modelling for Optimising Long-Term Oil Reservoir Performance Eduardo Barros, TU Delft Paul Van den Hof, TU Eindhoven Jan Dirk Jansen, TU Delft 1 Oil & gas

More information

A Stochastic Collocation based. for Data Assimilation

A Stochastic Collocation based. for Data Assimilation A Stochastic Collocation based Kalman Filter (SCKF) for Data Assimilation Lingzao Zeng and Dongxiao Zhang University of Southern California August 11, 2009 Los Angeles Outline Introduction SCKF Algorithm

More information

In the derivation of Optimal Interpolation, we found the optimal weight matrix W that minimizes the total analysis error variance.

In the derivation of Optimal Interpolation, we found the optimal weight matrix W that minimizes the total analysis error variance. hree-dimensional variational assimilation (3D-Var) In the derivation of Optimal Interpolation, we found the optimal weight matrix W that minimizes the total analysis error variance. Lorenc (1986) showed

More information

A Note on the Particle Filter with Posterior Gaussian Resampling

A Note on the Particle Filter with Posterior Gaussian Resampling Tellus (6), 8A, 46 46 Copyright C Blackwell Munksgaard, 6 Printed in Singapore. All rights reserved TELLUS A Note on the Particle Filter with Posterior Gaussian Resampling By X. XIONG 1,I.M.NAVON 1,2 and

More information

DART_LAB Tutorial Section 5: Adaptive Inflation

DART_LAB Tutorial Section 5: Adaptive Inflation DART_LAB Tutorial Section 5: Adaptive Inflation UCAR 14 The National Center for Atmospheric Research is sponsored by the National Science Foundation. Any opinions, findings and conclusions or recommendations

More information

Robust Ensemble Filtering With Improved Storm Surge Forecasting

Robust Ensemble Filtering With Improved Storm Surge Forecasting Robust Ensemble Filtering With Improved Storm Surge Forecasting U. Altaf, T. Buttler, X. Luo, C. Dawson, T. Mao, I.Hoteit Meteo France, Toulouse, Nov 13, 2012 Project Ensemble data assimilation for storm

More information

What do we know about EnKF?

What do we know about EnKF? What do we know about EnKF? David Kelly Kody Law Andrew Stuart Andrew Majda Xin Tong Courant Institute New York University New York, NY April 10, 2015 CAOS seminar, Courant. David Kelly (NYU) EnKF April

More information

Bayesian Dynamic Linear Modelling for. Complex Computer Models

Bayesian Dynamic Linear Modelling for. Complex Computer Models Bayesian Dynamic Linear Modelling for Complex Computer Models Fei Liu, Liang Zhang, Mike West Abstract Computer models may have functional outputs. With no loss of generality, we assume that a single computer

More information

Fundamentals of Data Assimilation

Fundamentals of Data Assimilation National Center for Atmospheric Research, Boulder, CO USA GSI Data Assimilation Tutorial - June 28-30, 2010 Acknowledgments and References WRFDA Overview (WRF Tutorial Lectures, H. Huang and D. Barker)

More information

Interpretation of two error statistics estimation methods: 1 - the Derozier s method 2 the NMC method (lagged forecast)

Interpretation of two error statistics estimation methods: 1 - the Derozier s method 2 the NMC method (lagged forecast) Interpretation of two error statistics estimation methods: 1 - the Derozier s method 2 the NMC method (lagged forecast) Richard Ménard, Yan Yang and Yves Rochon Air Quality Research Division Environment

More information

Convergence of Square Root Ensemble Kalman Filters in the Large Ensemble Limit

Convergence of Square Root Ensemble Kalman Filters in the Large Ensemble Limit Convergence of Square Root Ensemble Kalman Filters in the Large Ensemble Limit Evan Kwiatkowski, Jan Mandel University of Colorado Denver December 11, 2014 OUTLINE 2 Data Assimilation Bayesian Estimation

More information

Structural Surface Uncertainty Modeling and Updating Using the Ensemble Kalman Filter

Structural Surface Uncertainty Modeling and Updating Using the Ensemble Kalman Filter Structural Surface Uncertainty Modeling and Updating Using the Ensemble Kalman Filter A. Seiler, Nansen Environmental and Remote Sensing Center and Statoil; S.I. Aanonsen, Center for Integrated Petroleum

More information

Bayesian Statistics and Data Assimilation. Jonathan Stroud. Department of Statistics The George Washington University

Bayesian Statistics and Data Assimilation. Jonathan Stroud. Department of Statistics The George Washington University Bayesian Statistics and Data Assimilation Jonathan Stroud Department of Statistics The George Washington University 1 Outline Motivation Bayesian Statistics Parameter Estimation in Data Assimilation Combined

More information

Quarterly Journal of the Royal Meteorological Society

Quarterly Journal of the Royal Meteorological Society Quarterly Journal of the Royal Meteorological Society Effects of sequential or simultaneous assimilation of observations and localization methods on the performance of the ensemble Kalman filter Journal:

More information

The Ensemble Kalman Filter:

The Ensemble Kalman Filter: p.1 The Ensemble Kalman Filter: Theoretical formulation and practical implementation Geir Evensen Norsk Hydro Research Centre, Bergen, Norway Based on Evensen 23, Ocean Dynamics, Vol 53, No 4 p.2 The Ensemble

More information

Gaussian Process Approximations of Stochastic Differential Equations

Gaussian Process Approximations of Stochastic Differential Equations Gaussian Process Approximations of Stochastic Differential Equations Cédric Archambeau Dan Cawford Manfred Opper John Shawe-Taylor May, 2006 1 Introduction Some of the most complex models routinely run

More information

An Efficient Ensemble Data Assimilation Approach To Deal With Range Limited Observation

An Efficient Ensemble Data Assimilation Approach To Deal With Range Limited Observation An Efficient Ensemble Data Assimilation Approach To Deal With Range Limited Observation A. Shah 1,2, M. E. Gharamti 1, L. Bertino 1 1 Nansen Environmental and Remote Sensing Center 2 University of Bergen

More information

Adaptive Data Assimilation and Multi-Model Fusion

Adaptive Data Assimilation and Multi-Model Fusion Adaptive Data Assimilation and Multi-Model Fusion Pierre F.J. Lermusiaux, Oleg G. Logoutov and Patrick J. Haley Jr. Mechanical Engineering and Ocean Science and Engineering, MIT We thank: Allan R. Robinson

More information

EnKF Review. P.L. Houtekamer 7th EnKF workshop Introduction to the EnKF. Challenges. The ultimate global EnKF algorithm

EnKF Review. P.L. Houtekamer 7th EnKF workshop Introduction to the EnKF. Challenges. The ultimate global EnKF algorithm Overview 1 2 3 Review of the Ensemble Kalman Filter for Atmospheric Data Assimilation 6th EnKF Purpose EnKF equations localization After the 6th EnKF (2014), I decided with Prof. Zhang to summarize progress

More information

Brian J. Etherton University of North Carolina

Brian J. Etherton University of North Carolina Brian J. Etherton University of North Carolina The next 90 minutes of your life Data Assimilation Introit Different methodologies Barnes Analysis in IDV NWP Error Sources 1. Intrinsic Predictability Limitations

More information

Ensemble Data Assimilation and Uncertainty Quantification

Ensemble Data Assimilation and Uncertainty Quantification Ensemble Data Assimilation and Uncertainty Quantification Jeff Anderson National Center for Atmospheric Research pg 1 What is Data Assimilation? Observations combined with a Model forecast + to produce

More information

Local Ensemble Transform Kalman Filter

Local Ensemble Transform Kalman Filter Local Ensemble Transform Kalman Filter Brian Hunt 11 June 2013 Review of Notation Forecast model: a known function M on a vector space of model states. Truth: an unknown sequence {x n } of model states

More information

The Kalman Filter ImPr Talk

The Kalman Filter ImPr Talk The Kalman Filter ImPr Talk Ged Ridgway Centre for Medical Image Computing November, 2006 Outline What is the Kalman Filter? State Space Models Kalman Filter Overview Bayesian Updating of Estimates Kalman

More information

B008 COMPARISON OF METHODS FOR DOWNSCALING OF COARSE SCALE PERMEABILITY ESTIMATES

B008 COMPARISON OF METHODS FOR DOWNSCALING OF COARSE SCALE PERMEABILITY ESTIMATES 1 B8 COMPARISON OF METHODS FOR DOWNSCALING OF COARSE SCALE PERMEABILITY ESTIMATES Alv-Arne Grimstad 1 and Trond Mannseth 1,2 1 RF-Rogaland Research 2 Now with CIPR - Centre for Integrated Petroleum Research,

More information

The Kalman Filter. Data Assimilation & Inverse Problems from Weather Forecasting to Neuroscience. Sarah Dance

The Kalman Filter. Data Assimilation & Inverse Problems from Weather Forecasting to Neuroscience. Sarah Dance The Kalman Filter Data Assimilation & Inverse Problems from Weather Forecasting to Neuroscience Sarah Dance School of Mathematical and Physical Sciences, University of Reading s.l.dance@reading.ac.uk July

More information

A Spectral Approach to Linear Bayesian Updating

A Spectral Approach to Linear Bayesian Updating A Spectral Approach to Linear Bayesian Updating Oliver Pajonk 1,2, Bojana V. Rosic 1, Alexander Litvinenko 1, and Hermann G. Matthies 1 1 Institute of Scientific Computing, TU Braunschweig, Germany 2 SPT

More information

Ensemble Kalman filter for automatic history matching of geologic facies

Ensemble Kalman filter for automatic history matching of geologic facies Journal of Petroleum Science and Engineering 47 (2005) 147 161 www.elsevier.com/locate/petrol Ensemble Kalman filter for automatic history matching of geologic facies Ning LiuT, Dean S. Oliver School of

More information

Data Assimilation Research Testbed Tutorial

Data Assimilation Research Testbed Tutorial Data Assimilation Research Testbed Tutorial Section 2: How should observations of a state variable impact an unobserved state variable? Multivariate assimilation. Single observed variable, single unobserved

More information

Forecasting and data assimilation

Forecasting and data assimilation Supported by the National Science Foundation DMS Forecasting and data assimilation Outline Numerical models Kalman Filter Ensembles Douglas Nychka, Thomas Bengtsson, Chris Snyder Geophysical Statistics

More information

Short tutorial on data assimilation

Short tutorial on data assimilation Mitglied der Helmholtz-Gemeinschaft Short tutorial on data assimilation 23 June 2015 Wolfgang Kurtz & Harrie-Jan Hendricks Franssen Institute of Bio- and Geosciences IBG-3 (Agrosphere), Forschungszentrum

More information

The Ensemble Kalman Filter:

The Ensemble Kalman Filter: p.1 The Ensemble Kalman Filter: Theoretical formulation and practical implementation Geir Evensen Norsk Hydro Research Centre, Bergen, Norway Based on Evensen, Ocean Dynamics, Vol 5, No p. The Ensemble

More information

Review of Covariance Localization in Ensemble Filters

Review of Covariance Localization in Ensemble Filters NOAA Earth System Research Laboratory Review of Covariance Localization in Ensemble Filters Tom Hamill NOAA Earth System Research Lab, Boulder, CO tom.hamill@noaa.gov Canonical ensemble Kalman filter update

More information

Lagrangian Data Assimilation and Its Application to Geophysical Fluid Flows

Lagrangian Data Assimilation and Its Application to Geophysical Fluid Flows Lagrangian Data Assimilation and Its Application to Geophysical Fluid Flows Laura Slivinski June, 3 Laura Slivinski (Brown University) Lagrangian Data Assimilation June, 3 / 3 Data Assimilation Setup:

More information

Ensemble square-root filters

Ensemble square-root filters Ensemble square-root filters MICHAEL K. TIPPETT International Research Institute for climate prediction, Palisades, New Yor JEFFREY L. ANDERSON GFDL, Princeton, New Jersy CRAIG H. BISHOP Naval Research

More information

Data assimilation in high dimensions

Data assimilation in high dimensions Data assimilation in high dimensions David Kelly Kody Law Andy Majda Andrew Stuart Xin Tong Courant Institute New York University New York NY www.dtbkelly.com February 3, 2016 DPMMS, University of Cambridge

More information

LARGE-SCALE TRAFFIC STATE ESTIMATION

LARGE-SCALE TRAFFIC STATE ESTIMATION Hans van Lint, Yufei Yuan & Friso Scholten A localized deterministic Ensemble Kalman Filter LARGE-SCALE TRAFFIC STATE ESTIMATION CONTENTS Intro: need for large-scale traffic state estimation Some Kalman

More information

DATA ASSIMILATION FOR FLOOD FORECASTING

DATA ASSIMILATION FOR FLOOD FORECASTING DATA ASSIMILATION FOR FLOOD FORECASTING Arnold Heemin Delft University of Technology 09/16/14 1 Data assimilation is the incorporation of measurement into a numerical model to improve the model results

More information

Generalized Randomized Maximum Likelihood

Generalized Randomized Maximum Likelihood Generalized Randomized Maximum Likelihood Andreas S. Stordal & Geir Nævdal ISAPP, Delft 2015 Why Bayesian history matching doesn t work, cont d Previous talk: Why Bayesian history matching doesn t work,

More information

EnKF Applications to Thermal Petroleum Reservoir Characterization

EnKF Applications to Thermal Petroleum Reservoir Characterization EnKF Applications to Thermal Petroleum Reservoir Characterization Yevgeniy Zagayevskiy and Clayton V. Deutsch This paper presents a summary of the application of the ensemble Kalman filter (EnKF) to petroleum

More information

Benjamin L. Pence 1, Hosam K. Fathy 2, and Jeffrey L. Stein 3

Benjamin L. Pence 1, Hosam K. Fathy 2, and Jeffrey L. Stein 3 2010 American Control Conference Marriott Waterfront, Baltimore, MD, USA June 30-July 02, 2010 WeC17.1 Benjamin L. Pence 1, Hosam K. Fathy 2, and Jeffrey L. Stein 3 (1) Graduate Student, (2) Assistant

More information

Truncated Conjugate Gradient Method for History Matching in Reservoir Simulation

Truncated Conjugate Gradient Method for History Matching in Reservoir Simulation Trabalho apresentado no CNAC, Gramado - RS, 2016. Proceeding Series of the Brazilian Society of Computational and Applied athematics Truncated Conjugate Gradient ethod for History atching in Reservoir

More information

Hierarchical Bayes Ensemble Kalman Filter

Hierarchical Bayes Ensemble Kalman Filter Hierarchical Bayes Ensemble Kalman Filter M Tsyrulnikov and A Rakitko HydroMetCenter of Russia Wrocław, 7 Sep 2015 M Tsyrulnikov and A Rakitko (HMC) Hierarchical Bayes Ensemble Kalman Filter Wrocław, 7

More information

A008 THE PROBABILITY PERTURBATION METHOD AN ALTERNATIVE TO A TRADITIONAL BAYESIAN APPROACH FOR SOLVING INVERSE PROBLEMS

A008 THE PROBABILITY PERTURBATION METHOD AN ALTERNATIVE TO A TRADITIONAL BAYESIAN APPROACH FOR SOLVING INVERSE PROBLEMS A008 THE PROAILITY PERTURATION METHOD AN ALTERNATIVE TO A TRADITIONAL AYESIAN APPROAH FOR SOLVING INVERSE PROLEMS Jef AERS Stanford University, Petroleum Engineering, Stanford A 94305-2220 USA Abstract

More information

Comparison of of Assimilation Schemes for HYCOM

Comparison of of Assimilation Schemes for HYCOM Comparison of of Assimilation Schemes for HYCOM Ashwanth Srinivasan, C. Thacker, Z. Garraffo, E. P. Chassignet, O. M. Smedstad, J. Cummings, F. Counillon, L. Bertino, T. M. Chin, P. Brasseur and C. Lozano

More information

Methods of Data Assimilation and Comparisons for Lagrangian Data

Methods of Data Assimilation and Comparisons for Lagrangian Data Methods of Data Assimilation and Comparisons for Lagrangian Data Chris Jones, Warwick and UNC-CH Kayo Ide, UCLA Andrew Stuart, Jochen Voss, Warwick Guillaume Vernieres, UNC-CH Amarjit Budiraja, UNC-CH

More information

5.1 2D example 59 Figure 5.1: Parabolic velocity field in a straight two-dimensional pipe. Figure 5.2: Concentration on the input boundary of the pipe. The vertical axis corresponds to r 2 -coordinate,

More information

University of Oklahoma, Norman Oklahoma Monthly Weather Review Submitted June 2017 Accepted November 2017

University of Oklahoma, Norman Oklahoma Monthly Weather Review Submitted June 2017 Accepted November 2017 Development of a Hybrid En3DVar Data Assimilation System and Comparisons with 3DVar and EnKF for Radar Data Assimilation with Observing System Simulation Experiments Rong Kong 1,2, Ming Xue 1,2, and Chengsi

More information

Using Observations at Different Spatial. Scales in Data Assimilation for. Environmental Prediction. Joanne A. Waller

Using Observations at Different Spatial. Scales in Data Assimilation for. Environmental Prediction. Joanne A. Waller UNIVERSITY OF READING DEPARTMENT OF MATHEMATICS AND STATISTICS Using Observations at Different Spatial Scales in Data Assimilation for Environmental Prediction Joanne A. Waller Thesis submitted for the

More information

DART_LAB Tutorial Section 2: How should observations impact an unobserved state variable? Multivariate assimilation.

DART_LAB Tutorial Section 2: How should observations impact an unobserved state variable? Multivariate assimilation. DART_LAB Tutorial Section 2: How should observations impact an unobserved state variable? Multivariate assimilation. UCAR 2014 The National Center for Atmospheric Research is sponsored by the National

More information

Stochastic Collocation Methods for Polynomial Chaos: Analysis and Applications

Stochastic Collocation Methods for Polynomial Chaos: Analysis and Applications Stochastic Collocation Methods for Polynomial Chaos: Analysis and Applications Dongbin Xiu Department of Mathematics, Purdue University Support: AFOSR FA955-8-1-353 (Computational Math) SF CAREER DMS-64535

More information

OPTIMAL ESTIMATION of DYNAMIC SYSTEMS

OPTIMAL ESTIMATION of DYNAMIC SYSTEMS CHAPMAN & HALL/CRC APPLIED MATHEMATICS -. AND NONLINEAR SCIENCE SERIES OPTIMAL ESTIMATION of DYNAMIC SYSTEMS John L Crassidis and John L. Junkins CHAPMAN & HALL/CRC A CRC Press Company Boca Raton London

More information

Covariance Matrix Simplification For Efficient Uncertainty Management

Covariance Matrix Simplification For Efficient Uncertainty Management PASEO MaxEnt 2007 Covariance Matrix Simplification For Efficient Uncertainty Management André Jalobeanu, Jorge A. Gutiérrez PASEO Research Group LSIIT (CNRS/ Univ. Strasbourg) - Illkirch, France *part

More information

A data-driven method for improving the correlation estimation in serial ensemble Kalman filter

A data-driven method for improving the correlation estimation in serial ensemble Kalman filter A data-driven method for improving the correlation estimation in serial ensemble Kalman filter Michèle De La Chevrotière, 1 John Harlim 2 1 Department of Mathematics, Penn State University, 2 Department

More information

Demonstration and Comparison of of Sequential Approaches for Altimeter Data Assimilation in in HYCOM

Demonstration and Comparison of of Sequential Approaches for Altimeter Data Assimilation in in HYCOM Demonstration and Comparison of of Sequential Approaches for Altimeter Data Assimilation in in HYCOM A. Srinivasan, E. P. Chassignet, O. M. Smedstad, C. Thacker, L. Bertino, P. Brasseur, T. M. Chin,, F.

More information

Data assimilation in the geosciences An overview

Data assimilation in the geosciences An overview Data assimilation in the geosciences An overview Alberto Carrassi 1, Olivier Talagrand 2, Marc Bocquet 3 (1) NERSC, Bergen, Norway (2) LMD, École Normale Supérieure, IPSL, France (3) CEREA, joint lab École

More information

Inter-comparison of 4D-Var and EnKF systems for operational deterministic NWP

Inter-comparison of 4D-Var and EnKF systems for operational deterministic NWP Inter-comparison of 4D-Var and EnKF systems for operational deterministic NWP Project eam: Mark Buehner Cecilien Charette Bin He Peter Houtekamer Herschel Mitchell WWRP/HORPEX Workshop on 4D-VAR and Ensemble

More information

4DEnVar. Four-Dimensional Ensemble-Variational Data Assimilation. Colloque National sur l'assimilation de données

4DEnVar. Four-Dimensional Ensemble-Variational Data Assimilation. Colloque National sur l'assimilation de données Four-Dimensional Ensemble-Variational Data Assimilation 4DEnVar Colloque National sur l'assimilation de données Andrew Lorenc, Toulouse France. 1-3 décembre 2014 Crown copyright Met Office 4DEnVar: Topics

More information

Convergence of the Ensemble Kalman Filter in Hilbert Space

Convergence of the Ensemble Kalman Filter in Hilbert Space Convergence of the Ensemble Kalman Filter in Hilbert Space Jan Mandel Center for Computational Mathematics Department of Mathematical and Statistical Sciences University of Colorado Denver Parts based

More information

Geostatistical History Matching coupled with Adaptive Stochastic Sampling: A zonation-based approach using Direct Sequential Simulation

Geostatistical History Matching coupled with Adaptive Stochastic Sampling: A zonation-based approach using Direct Sequential Simulation Geostatistical History Matching coupled with Adaptive Stochastic Sampling: A zonation-based approach using Direct Sequential Simulation Eduardo Barrela* Instituto Superior Técnico, Av. Rovisco Pais 1,

More information

EnKF and filter divergence

EnKF and filter divergence EnKF and filter divergence David Kelly Andrew Stuart Kody Law Courant Institute New York University New York, NY dtbkelly.com December 12, 2014 Applied and computational mathematics seminar, NIST. David

More information

Comparisons between 4DEnVar and 4DVar on the Met Office global model

Comparisons between 4DEnVar and 4DVar on the Met Office global model Comparisons between 4DEnVar and 4DVar on the Met Office global model David Fairbairn University of Surrey/Met Office 26 th June 2013 Joint project by David Fairbairn, Stephen Pring, Andrew Lorenc, Neill

More information

Data assimilation with and without a model

Data assimilation with and without a model Data assimilation with and without a model Tim Sauer George Mason University Parameter estimation and UQ U. Pittsburgh Mar. 5, 2017 Partially supported by NSF Most of this work is due to: Tyrus Berry,

More information

Localization and Correlation in Ensemble Kalman Filters

Localization and Correlation in Ensemble Kalman Filters Localization and Correlation in Ensemble Kalman Filters Jeff Anderson NCAR Data Assimilation Research Section The National Center for Atmospheric Research is sponsored by the National Science Foundation.

More information

Frequentist-Bayesian Model Comparisons: A Simple Example

Frequentist-Bayesian Model Comparisons: A Simple Example Frequentist-Bayesian Model Comparisons: A Simple Example Consider data that consist of a signal y with additive noise: Data vector (N elements): D = y + n The additive noise n has zero mean and diagonal

More information

EnKF-based particle filters

EnKF-based particle filters EnKF-based particle filters Jana de Wiljes, Sebastian Reich, Wilhelm Stannat, Walter Acevedo June 20, 2017 Filtering Problem Signal dx t = f (X t )dt + 2CdW t Observations dy t = h(x t )dt + R 1/2 dv t.

More information

SPE History Matching Using the Ensemble Kalman Filter on a North Sea Field Case

SPE History Matching Using the Ensemble Kalman Filter on a North Sea Field Case SPE- 1243 History Matching Using the Ensemble Kalman Filter on a North Sea Field Case Vibeke Haugen, SPE, Statoil ASA, Lars-Jørgen Natvik, Statoil ASA, Geir Evensen, Hydro, Aina Berg, IRIS, Kristin Flornes,

More information

X t = a t + r t, (7.1)

X t = a t + r t, (7.1) Chapter 7 State Space Models 71 Introduction State Space models, developed over the past 10 20 years, are alternative models for time series They include both the ARIMA models of Chapters 3 6 and the Classical

More information

Data assimilation with and without a model

Data assimilation with and without a model Data assimilation with and without a model Tyrus Berry George Mason University NJIT Feb. 28, 2017 Postdoc supported by NSF This work is in collaboration with: Tim Sauer, GMU Franz Hamilton, Postdoc, NCSU

More information

Assessment of Sequential and Simultaneous Ensemble-based History Matching Methods for Weakly Non-linear Problems

Assessment of Sequential and Simultaneous Ensemble-based History Matching Methods for Weakly Non-linear Problems Assessment of Sequential and Simultaneous Ensemble-based History Matching Methods for Weakly Non-linear Problems Kristian Fossum Dissertation for the degree of Philosophiae Doctor (PhD) Department of Mathematics

More information

ROBOTICS 01PEEQW. Basilio Bona DAUIN Politecnico di Torino

ROBOTICS 01PEEQW. Basilio Bona DAUIN Politecnico di Torino ROBOTICS 01PEEQW Basilio Bona DAUIN Politecnico di Torino Probabilistic Fundamentals in Robotics Gaussian Filters Course Outline Basic mathematical framework Probabilistic models of mobile robots Mobile

More information

Last updated: Oct 22, 2012 LINEAR CLASSIFIERS. J. Elder CSE 4404/5327 Introduction to Machine Learning and Pattern Recognition

Last updated: Oct 22, 2012 LINEAR CLASSIFIERS. J. Elder CSE 4404/5327 Introduction to Machine Learning and Pattern Recognition Last updated: Oct 22, 2012 LINEAR CLASSIFIERS Problems 2 Please do Problem 8.3 in the textbook. We will discuss this in class. Classification: Problem Statement 3 In regression, we are modeling the relationship

More information

A Short Note on the Proportional Effect and Direct Sequential Simulation

A Short Note on the Proportional Effect and Direct Sequential Simulation A Short Note on the Proportional Effect and Direct Sequential Simulation Abstract B. Oz (boz@ualberta.ca) and C. V. Deutsch (cdeutsch@ualberta.ca) University of Alberta, Edmonton, Alberta, CANADA Direct

More information

Geostatistical History Matching coupled with Adaptive Stochastic Sampling

Geostatistical History Matching coupled with Adaptive Stochastic Sampling Geostatistical History Matching coupled with Adaptive Stochastic Sampling A Geologically consistent approach using Stochastic Sequential Simulation Eduardo Barrela Nº 79909 Project Thesis Presentation

More information

Ensemble Kalman Filter

Ensemble Kalman Filter Ensemble Kalman Filter Geir Evensen and Laurent Bertino Hydro Research Centre, Bergen, Norway, Nansen Environmental and Remote Sensing Center, Bergen, Norway The Ensemble Kalman Filter (EnKF) Represents

More information

A Comparison between the 4DVAR and the Ensemble Kalman Filter Techniques for Radar Data Assimilation

A Comparison between the 4DVAR and the Ensemble Kalman Filter Techniques for Radar Data Assimilation NOVEMBER 2005 C A Y A E T A L. 3081 A Comparison between the 4DVAR and the Ensemble Kalman Filter Techniques for Radar Data Assimilation A. CAYA, J.SUN, AND C. SNYDER National Center for Atmospheric Research,*

More information

Reducing the Impact of Sampling Errors in Ensemble Filters

Reducing the Impact of Sampling Errors in Ensemble Filters Reducing the Impact of Sampling Errors in Ensemble Filters Jeffrey Anderson NCAR Data Assimilation Research Section The National Center for Atmospheric Research is sponsored by the National Science Foundation.

More information

Numerical Weather Prediction: Data assimilation. Steven Cavallo

Numerical Weather Prediction: Data assimilation. Steven Cavallo Numerical Weather Prediction: Data assimilation Steven Cavallo Data assimilation (DA) is the process estimating the true state of a system given observations of the system and a background estimate. Observations

More information

Non-linear least squares

Non-linear least squares Non-linear least squares Concept of non-linear least squares We have extensively studied linear least squares or linear regression. We see that there is a unique regression line that can be determined

More information

Introduction to Ensemble Kalman Filters and the Data Assimilation Research Testbed

Introduction to Ensemble Kalman Filters and the Data Assimilation Research Testbed Introduction to Ensemble Kalman Filters and the Data Assimilation Research Testbed Jeffrey Anderson, Tim Hoar, Nancy Collins NCAR Institute for Math Applied to Geophysics pg 1 What is Data Assimilation?

More information