arxiv: v2 [stat.ap] 22 Dec 2016

Transcription

1 Localizing the Ensemble Kalman Particle Filter Sylain Robert and Hans R. Künsch Seminar für Statistik, ETH Zürich, Switzerland December 23, 2016 arxi: [stat.ap] 22 Dec 2016 Abstract Ensemble methods sch as the Ensemble Kalman Filter (enkf) are widely sed for data assimilation in large-scale geophysical applications, as for example in nmerical weather prediction (nwp). There is a growing interest for physical models with higher and higher resoltion, which brings new challenges for data assimilation techniqes becase of the presence of non-linear and non-gassian featres that are not adeqately treated by the enkf. We propose two new localized algorithms based on the Ensemble Kalman Particle Filter (enkpf), a hybrid method combining the enkf and the Particle Filter (pf) in a way that maintains scalability and sample diersity. Localization is a key element of the sccess of enkfs in practice, bt it is mch more challenging to apply to pfs. The algorithms that we introdce in the present paper proide a compromise between the enkf and the pf while aoiding some of the problems of localization for pre pfs. Nmerical experiments with a simplified model of cmls conection based on a modified shallow water eqation show that the proposed algorithms perform better than the local enkf. In particlar, the pf natre of the method allows to captre non-gassian characteristics of the estimated fields sch as the location of wet and dry areas. 1 Introdction In many large-scale enironmental applications, estimating the eoltion of a geophysical system, sch as the atmosphere, is of tmost interest. Data assimilation soles this problem iteratiely by alternating between a forecasting step and an pdating step. In the former, information abot the dynamic of the system is incorporated, while in the latter, also called analysis, partial and noisy obserations are sed to correct the crrent estimate. The optimal combination of the information from these two steps reqires an estimate of their associated ncertainty. In statistics, one represents the ncertainty abot the state of a system after the forecasting step with a prior distribtion, and the ncertainty de to the obserations errors with a likelihood. The analysis consists then in deriing the posterior distribtion of the crrent state of the system, combining the prior distribtion and the new obserations, which can be done with Bayes rle. 1

2 In geophysical applications, sch as nmerical weather prediction (nwp), the dimension of the system is extremely large and the forecasting step comptationally heay, therefore the focs is on deeloping efficient methods with reasonable approximations. Een in the simplest case of a linear system with linear Gassian obserations, the optimal method, namely the Kalman filter (Kalman, 1960; Kalman and Bcy, 1961), is difficlt to se becase of the size of the matrices inoled. Ensemble, or Monte-Carlo, methods, are elegant techniqes to deal with nonlinear dynamical systems. They se finite samples, or ensembles of particles, to represent the ncertainty abot the state of the system associated with the prior and posterior distribtions. The forecasting step consists then simply in integrating each particle according to the law of the system. Ensemble methods were introdced in the geosciences by the Ensemble Kalman Filter (enkf) of Eensen (1994, 2009) as a Monte-Carlo approximation of the Kalman filter and hae shown great sccess in practice. Howeer, the analysis step of all enkf methods implicitly relies on the assmption that the prior ncertainty abot the state of the system is Gassian, which is an acceptable approximation in some cases, bt is nlikely to hold with highly non-linear dynamics. Particle Filters (pfs) (Gordon et al., 1993; Pitt and Shephard, 1999; Docet et al., 2001) are a more general class of ensemble methods which differ from the enkf in the way the analysis step is implemented. They can handle flly non-linear and non-gassian systems and are therefore ery attractie. Unfortnately, it has been shown that the nmber of particles needed to aoid sample degeneracy and collapse of the filter increases exponentially with the size of the problem, in a sense made precise in Snyder et al. (2008). Adapting pfs for large-scale enironmental applications is an actie field of research and there are many propositions of algorithms (see an Leewen (2009) for a reiew, and an Leewen (2010); Papadakis et al. (2010); Ades and an Leewen (2013); Nakano (2014) for more recent deelopments). Here we focs on the Ensemble Kalman Particle Filter (enkpf), introdced in Frei and Künsch (2013), which consists in a combination of the pf with the enkf. Compared to other similar algorithms, the enkpf has the distinct adantage of being dependent on a single tning parameter which defines a continos interpolation between the enkf and the pf. Moreoer, no approximation of the prior distribtion or the transition probability is reqired. Recently, there has been a tendency towards sing physical models with higher and higher resoltion. For example in nwp, regional models are starting to be rn with a grid length of the order of 1 kilometer, which allows to resole explicitly highly non-linear phenomena sch as cmls conection. In general, with non-linear dynamical systems, the ncertainty after the forecasting step can become highly non-gassian. Therefore there is a growing need for data assimilation methods which can handle non-linear and non-gassian systems while being comptationally efficient to be applied to large-scale problems (Baer et al., 2015). The enkf implicitly assmes Gassian ncertainty while the pf reqires an exponentially large nmber of particles. The enkpf is a compromise between both, bt it still reqires too many particles for practical 2

3 applications. The main goal of this article is to contribte towards a fll soltion to the non-linear and non-gassian large-scale data assimilation problem. The methods proposed in this article expand on the enkpf by introdcing localization. The idea of localizing the analysis was first proposed by Hotekamer and Mitchell (1998) as a deice to redce dimensions and ths to allow for smaller ensemble sizes. While localization has been widely sed within the enkf family of algorithms, e.g. the Local Ensemble Transform Kalman Filter (letkf) of Hnt et al. (2007), applications to the pf are mch rarer. The reason for this is that pf methods introdce a discrete component in the analysis by resampling particles, which breaks the necessary smoothness of the fields to be estimated. In the literatre, the main approaches to this problem hae been either to aoid resampling altogether, or to correct the introdced discontinities. The moment-matching filter of Lei and Bickel (2011) aoids resampling and can be localized straightforwardly as it depends on the first two moments of the distribtion only. Attempts to replace resampling by deterministic transport maps from prior to posterior distribtions are a promising way to reformlate pfs sch that they can be easily localized (Reich, 2013). An early example of algorithm which keeps resampling while localizing the analysis is the locallocal ensf (llensf) of Bengtsson et al. (2003), with which or new algorithm share many similarities. In the recent local pf of Poterjoy (2016) resampling is applied locally by progressiely merging resampled particles with prior particles, followed by a higher-order correction sing a deterministic probability mapping. In this article, we propose two new localized algorithms based on the enkpf: the naie-local enkpf (naie-lenkpf) and the block-local enkpf (blocklenkpf). In the naie-lenkpf, assimilation is done independently at each location, ignoring potential problems associated with discontinities; in the block-lenkpf, data are assimilated by blocks, whose inflence is limited to a neighborhood, and discontinities are smoothed ot in a transition area by conditional resampling. The first method is easier to implement as it mirrors the behaior of the letkf, bt the second one deals better with the specific problems associated with localized pfs. The localization of the enkpf or any pf method is highly non-triial, bt it can potentially bring remarkable improement in terms of their applicability to large-scale applications (Snyder et al., 2015). The original enkpf has been shown in Frei and Künsch (2013) to perform well on the Lorenz 96 model (Lorenz and Emanel, 1998) and other rather simple setps. The extensions that we propose in the present paper shold allow the algorithm to work on more complex and larger models. Here, we test the feasibility of or methods with some nmerical experiments on an artificial model of cmls conection based on a modified shallow water eqation (sweq) (Würsch and Craig, 2014) and show that we obtain similar or better reslts than the enkf. In Section 2 we briefly reiew ensemble data assimilation and the enkf, the pf and the enkpf. Then we discss localization and explain the two new localized enkpfs algorithms in Section 3. The nmerical experiments are described 3

4 and reslts discssed in Section 4 before a few conclsie remarks in Section 5. 2 Ensemble data assimilation Consider the problem of estimating the state of a system at time t, x t, gien a seqence of partial and noisy obserations y 1:t = (y 1,..., y t ). The nderlying process (x t ) is nobsered and represents the eoltion of the system, described typically by partial differential eqations. The obserations are assmed to be conditionally independent gien the states and are characterized by the likelihood l(x t y t ). This problem fits in the framework of general state space models and is generally known as filtering in the statistics and engineering commnity, and as data assimilation in the geosciences. Mathematically, the goal is to compte the conditional distribtions of x t gien y 1:t, called the filtering or analysis distribtion πt a. There exists a recrsie algorithm which alternates between compting the analysis distribtions and the conditional distribtions of x t gien y 1:t 1, called the predictie or backgrond distribtion πt b. In the forecast step, the backgrond distribtion at time t is deried from the analysis distribtion at time t 1, sing the dynamical laws of the system. In the analysis or pdate step, the analysis distribtion at time t is deried from the backgrond distribtion at the same time t, sing Bayes theorem: πt a (x) πt b (x) l(x y t ). Howeer, there is no analytically tractable soltion to this recrsion except in the case of a discrete state space or a linear and Gassian system. In the latter case, the soltion is known as the Kalman filter. One of the problems that arise when trying to apply this theoretical framework to large-scale systems sch as in nwp is that the forecast step is not gien by an explicit eqation bt comes from the nmerical integration of the state ector according to the dynamical laws of the system. Ensemble or Monte Carlo methods address this problem by representing the distribtions πt b and πt a by finite samples or ensembles of particles: x b,i t πt b and x a,i t πt a for i = 1,..., k, where k is the size of the ensemble. The forecast step prodces the backgrond ensemble members x b,i t by propagating the analysis ensemble members x a,i t 1 according to the dynamics of the system. The analysis step, that is the transformation of the backgrond ensemble (x b,i t ) into the analysis ensemble, is howeer more challenging for ensemble methods. There are arios soltions to this problem, depending on the assmptions abot the distribtion π b and the obseration process and the heristic approximations that are sed. Henceforth we drop the time index t and consider the analysis step only. We also assme that the obserations are Gassian and linear with mean Hx and coariance R, where H is the obseration operator applied on a state ector x and R is a alid coariance matrix. We now reiew the enkf and the pf in this context and describe the enkpf, before discssing in more detail the problem of localization and introdcing new algorithms. 4

5 2.1 The Ensemble Kalman Filter If one assmes that the backgrond distribtion π b is Gassian and that the obserations are linear and Gassian, then the analysis distribtion π a is again Gassian with a new mean and coariance gien by simple formlae. All enkf methods are based on this reslt and apply it by ignoring non-gassian featres of π b. They se the backgrond ensemble to estimate the mean and coariance of π b and draw the analysis sample to match the mean and coariance of π a nder Gassian assmptions. Sqare-root filters sch as the letkf transform the backgrond ensemble so that the first and second moments match exactly those of the estimated analysis distribtion, whereas the stochastic enkf applies a Kalman filter pdate with some stochastically pertrbed obserations to each ensemble member. More precisely, in the stochastic enkf an ensemble member from the analysis distribtion is prodced as follows: x a,i = x b,i + K(P b )(y Hx b,i + ɛ i ), (1) where P b is an estimate of the backgrond coariance matrix and ɛ i N (0, R) is a ector of obseration pertrbations. K(P ) denotes the Kalman gain compted sing the coariance matrix P and is eqal to P H (HP H + R) 1. Conditional on the backgrond ensemble (x b,i ), x a,i is ths normal with mean x b,i + K(P b )(y Hx b,i ) and coariance K(P b )RK(P b ). A key idea for the enkpf is that, conditional on the backgrond ensemble, the analysis ensemble is a balanced sample of size k from the Gassian mixtre k i=1 1 k N ( x b,i + K(P b )(y Hx b,i ), K(P b )RK(P b ) ), (2) where balanced sample means that each component of the mixtre is selected exactly once. 2.2 The Particle Filter The pf does not make any assmption abot π b, bt applies Bayes formla to the empirical distribtion proided by the backgrond ensemble. In its simplest ersion it represents the backgrond and analysis distribtions by weighted samples of particles, whose weights are pdated at each time step by a factor proportional to the likelihood of the obserations. That is, if π b is represented by the weighted sample (x b,i, α b,i ), then π a is represented by the weighted sample (x a,i, α a,i ), where x a,i = x b,i, α a,i = α b,i l(x b,i y) k j=1 αb,j l(x b,j y). In the forecast step, weights remain nchanged. Howeer, when iterated this leads to sample degeneracy, that is the weights are effectiely concentrated on 5

6 fewer and fewer ensemble members. To aoid this, a resampling step is introdced, where the particles are resampled with probability proportional to their weight. This means that the analysis sample contains x b,i N i times where E(N i ) = kα a,i and N i = k. In this way particles which fit the data well are replicated and the others eliminated, ths allowing to explore adaptiely the filtering distribtion by ptting more mass in regions of high probability. There are balanced sampling schemes, where N i kα a,i < 1, which redce the error de to resampling as mch as possible (discssion of balanced sampling can be fond in Carpenter et al. (1999); Crisan (2001) or Künsch (2005)). Bt resampling also has problems with sample depletion if the likelihood ales l(x b,i y) are ery nbalanced or the dynamical system is deterministic. In that case one has to add some kind of pertrbations to the analysis particles, bt it is not clear how to choose the coariance of this noise. Using a ector of resampled indices I, sch that P (I(i) = j) α j and #{I(i) = j, i = 1,..., k} = N j for all j, we can write the pf algorithm sccinctly as follows: 1. Compte the weights α j l(x b,j y). 2. Choose the ector of resampled indices I, sch that P (I(i) = j) α j and N j kα j < For i = 1,..., k, set x a,i = x b,i(i). 2.3 The Ensemble Kalman Particle Filter The enkpf (Frei and Künsch, 2013) is a hybrid algorithm that combines the enkf and the pf with a single parameter γ [0, 1] controlling the balance between both. Its core idea is to split the analysis in two stages, following the progressie correction principle of Msso et al. (2001). In a ntshell, the algorithm consists in plling" the ensemble members towards the obserations with a partial enkf analysis sing the dampened likelihood l(x y) γ, and then applying a partial pf with the remaining part of the likelihood, l(x y) 1 γ. In this way the algorithm can captre some non-gassian featres of the distribtion (by resampling), while maintaining sample diersity. For any fixed γ > 0, it does not conerge to the tre posterior distribtion as the nmber of particles tends to infinity, nless the backgrond distribtion is Gassian. The jstification of the EnKPF is rather that, for non-gassian backgrond distribtions, it redces the ariance of the PF at the expense of a small bias. We now reiew the deriation of the algorithm briefly bt refer to Frei and Künsch (2013) for more detail. Assming linear and Gassian obserations, dampening the likelihood with the exponent γ is eqialent to inflating the error coariance R by the factor γ 1, and it is easily seen that this is also eqialent to sing the Kalman gain with the original error coariance R and a dampened backgrond coariance γp b. From the Gassian mixtre representation of the enkf analysis described in Eq. (2), we can see that the first step of the algorithm prodces the partial analysis distribtion 6

7 π γ = k i=1 1 k N (νa,i, Q), (3) where ν a,i = x b,i + K(γP b )(y Hx b,i ), (4) Q = 1 γ K(γP b )RK(γP b ). (5) For the second step, we hae to apply Bayes formla sing π γ as the prior and l(x y) 1 γ as the likelihood. This has a closed form soltion (Alspach and Sorenson, 1972), namely a Gassian mixtre with new centroids µ a,i, coariance P a,γ, and neqal weights α i : where π a enkpf = k α i N (µ a,i, P a,γ ), (6) i=1 µ a,i = ν a,i + K((1 γ)q)(y Hν a,i ), (7) P a,γ = ( I K((1 γ)q)h ) Q, (8) α i φ{y; Hν a,i, HQH + R/(1 γ)}, (9) and φ{y; µ, Σ} denotes the density of a Gassian with mean µ and coariance matrix Σ ealated at y. One can rewrite the eqation for the µ a,i components directly from the backgrond ensemble as: µ a,i = x b,i + L γ (y Hx b,i ), where (10) ( ) L γ = K(γP b ) + K((1 γ)q) I HK(γP b ). The final analysis sample is obtained as a sample from the Gassian mixtre (6), which can be done at a comptational cost comparable to the enkf. A short description of the algorithm is gien as follows: 1. Compte all the µ a,j as in Eq. (7). 2. Compte all the weights α j. 3. Choose the ector of resampled indices I, sch that P (I(i) = j) α j and N j kα j < For i = 1,..., k: a) Generate ɛ a,i N (0, P a,γ ). 7

8 b) Set x a,i = µ a,i(i) + ɛ a,i. The step 4.a) can be done efficiently, withot compting P a,γ explicitly, as described in Frei and Künsch (2013). A schematic illstration of the algorithm can be seen in Fig. 1. In the extreme case of γ = 0, the enkpf is eqialent to a pre pf, whereas for γ = 1 it is eqialent to the stochastic enkf. γ is therefore a tning parameter which determines the proportion of enkf and pf pdate to se. In practice it is chosen adaptiely sch that the ensemble is as close as possible to the pf soltion while consering enogh diersity. Diersity of the mixtre weights α j can be qantified by the Effectie Sample Size (ess) (Li, 1996). The enkpf has been shown to work well with the Lorenz 96 models and with other simple examples (Frei and Künsch, 2013). Howeer, becase it has a pf component, it cannot be directly applied to large-scale systems withot sffering from sample degeneracy. In the following section we discss the techniqe of localization and introdce two new localized algorithms based on the enkpf. Backgrond x t 1 x t EnKF mixtre enkf γ (1 γ) pf Analysis PF mixtre Resample x t x t+1 Figre 1: Schematic illstration of the enkpf. Upper left: Backgrond ensemble (ble dots) and obseration (red dot). Upper right: Intermediate analysis distribtion π γ (3). Each ellipse coers 50% of one component in the mixtre. Lower right: Final analysis distribtion Eq. (6). Ellipses again represent 50% of each component, and the color intensity represents the weights α i. Lower left: Analysis sample obtained by drawing from Eq. (6). The mixtre component closest to the obseration has been resam pled 3 times, while the two components farthest away hae been discarded. 8

9 3 Local algorithms One of the key element for the sccess of the enkf in practice is localization, either by backgrond coariance tapering as in Hamill et al. (2001), or by doing the analysis independently at each grid point, sing only nearby obserations, as in Ott et al. (2004). Localization sppresses sprios correlations at long distances and generally increases the statistical accracy of the estimates by redcing the size of the problem to sole. Its drawback, howeer, is that it can easily introdce non-physical featres in the global analysis fields. For the Local Ensemble Kalman Filter (lenkf) sch problems are redced by ensring with some means that the analysis aries smoothly in space. It shold be noted that physical properties of the global fields cannot be garanteed in a strong sense withot incorporating some explicit constraints. Withot Gassian assmptions localization becomes een more crcial bt also more difficlt, as the analysis does not anymore depend on the backgrond mean and coariance only. The collapse of the pf with small ensemble sizes cold be aoided by sing a ery strong localization. Howeer, a pre local pf wold probably not be practical as it wold introdce arbitrarily large discontinities in the analysis since different particles can be resampled at neighboring grid points and need to be gled together. Localizing the enkpf is easier than for a pre pf bt it still reqires some care de to the resampling step. We propose two different localized algorithms based on the enkpf: the first one is based on the same principle as the lenkf of Ott et al. (2004), while the second one is closer to the idea of coariance tapering of Hamill et al. (2001) and serial assimilation of Hotekamer and Mitchell (2001), bt adapted to the pf context. 3.1 The naie-local enkpf In the naie-lenkpf, we apply the exact same approach as in the lenkf of Ott et al. (2004) and do an independent analysis at each grid point. We call the reslting algorithm naie becase it ignores dependencies between grid points. More precisely, the analysis at a gien site is prodced by sampling from a local analysis distribtion which has the same form as Eq. (6), bt which is compted only sing obserations close to this site. As in the lenkf, some leel of smoothness is ensred by sing the same pertrbed obserations at eery grid point and by choosing a local window large enogh sch that the obserations assimilated do not change too abrptly between neighboring grid points. In order to mitigate the problem of discontinities frther, we introdce some basic dependency by sing a balanced sampling scheme with the same random component for eery grid point and by reordering the resampling indices sch that the occrrence of sch breaks is minimized. This does not remoe all discontinities, bt essentially limits them to regions where the resampling weights of the particles change qickly. In conclsion, the naie-lenkpf has the adantage to be straightforward to implement, following closely the model of the lenkf, bt it is not completely 9

10 satisfactory as it introdces potential discontinities in the global analysis fields. We now consider a second algorithm which is a bit more complicated bt aoids this problem. 3.2 The block-local enkpf In the naie-lenkpf, localization consists in doing a separate analysis at each grid point, sing the obserations at nearby locations. We now consider another approach to localization, in which the inflence of each obseration is limited to state ales at nearby locations. This seemingly innocos change of perspectie leads to the deelopment of a new algorithm, the block-lenkpf. Assming that R is diagonal or block-diagonal, the obserations y can be partitioned into disjoint blocks y 1,..., y B and then assimilated seqentially, as for example in the enkf of Hotekamer and Mitchell (2001). The way that localization is implemented for the block-lenkpf is similar in spirit to the global-to-local adjstment of the llensf of Bengtsson et al. (2003), bt the deriation and the reslting algorithms are not identical. In the case of the enkf, the inflence of one block of obserations can be limited to a local area by sing a tapered backgrond coariance matrix (Hamill et al., 2001). Howeer, only in the Gassian case, setting correlations to zero implies independence, bt for general π b this is not tre. The pf and enkpf maintain higher-order dependencies by resampling particles globally, bt with a local algorithm some dependencies will necessarily be broken. The blocklenkpf maintains these dependencies when it is possible, bt falls back on a conditional enkf and implicitly relies on Gassian assmptions to bridge discontinities when they are naoidable. We now describe in more detail how to derie the algorithm for one block of obserations and then discss the general method and parallel assimilation. Assimilation of one block of obserations Let s say we partitioned the obserations into B blocks and want to assimilate y 1. If we assme that the obseration operator is local, then only a few elements of the state ector inflence the block y 1 directly (i.e. hae non-zero entry in H for a linear operator). We denote their indices by with corresponding state ector x. Hereafter we se sbscripts to denote sbectors or sbmatrices. Let s assme also that we se a alid tapering matrix C, for example the one indced by the correlation fnction gien in Gaspari and Cohn (1999). We denote by x the sbector of elements that do not inflence y 1, bt are correlated with some elements of x (i.e. correspond to non-zero entries in the tapering matrix C). Additionally, we define as x w the sbector of all remaining elements. The principle of the algorithm is to first pdate x with the enkpf while keeping x w nchanged. In a second step, x is pdated conditionally on x and x w, sch that potential discontinities are smoothed ot. If x and x w are not only ncorrelated, bt also independent, the backgrond distribtion can be 10

11 factored as: π b (x, x, x w ) = π b (x )π b (x x, x w )π b (x w ). (11) By constrction, only x inflences y 1 so that one can write l(y 1 x, x, x w ) = l(y 1 x ). Applying Bayes rle, the analysis distribtion is π a (x, x, x w y 1 ) π a (x y 1 )π b (x x, x w )π b (x w ). A natral way to sample from this distribtion goes as follows: (i) sample x a,i from the analysis distribtion π a (x y 1 ), (ii) keep x a,i w = x b,i w nchanged and (iii) sample x a,i from π b (x x, x w ), conditionally on x a,i and (iii) are clear, bt (ii) reqires more discssion. and x a,i w. Steps (i) One cold assme normality and sample x a,i as a random draw from a normal distribtion with the conditional mean and coariance compted from the backgrond sample moments. Howeer this wold add nnecessary randomness and it is more jdicios to sample x a,i as a correction to the backgrond ensemble member x b,i, as is done in the enkf. Using this sampling scheme, we can show that the analysis of x b,i conditioned on x a,i and x a,i w is gien by the following simple expression: x a,i = x b,i + P b (P b ) 1 (x a,i x b,i ), (12) where the matrix inerse is well defined if a tapered estimate of P b is sed, and shold be nderstood as a generalized inerse otherwise. At first sight it is pzzling that x a,i w does not appear in the formla, bt the correlation between x and x w is present in the backgrond sample x b,i and ths does not need to be explicitly taken into accont in the analysis. Note that x a,i depends on x b,i(i). In cases where I(i) = i, the entire particle x a,i is therefore obtained as a correction of the entire particle x b,i, according to the original enkpf algorithm. In cases where I(i) i, x a,i will depend on two backgrond particles x b,i(i) and the analysis relies on additional Gassian assmptions of the backgrond sample. Formla (12) then makes sre that the correlation between x a,i and x a,i is neertheless correct. In order to stay as close as possible to the and x b,i EnKPF, we permte the resampling indices I(i) sch that the nmber of cases with I(i) = i is maximal. More details abot the deriation of the algorithm are proided in Appendix A. Ptting eerything together, the assimilation of one block of obserations in the block-lenkpf algorithm can be smmarized as follows: 1. Compte all the µ a,j. 2. Compte all the weights α j. 3. Choose the ector of resampled indices I, sch that P (I(i) = j) α j and N j kα j < Permte I sch that #{j, I(j) = j} is maximal. 11

12 a) state w w b) state w w c) state w w Figre 2: Illstration of the assimilation of one obseration (red cross in panel a)) with the block-lenkpf. Each particle is shown in a different color, the dotted lines being the backgrond and the solid lines the analysis. In panel b) x is pdated while x w is nchanged. In panel c) we see how the pdate in x makes a transition between x and x w. For the orange and green particles, which are not resampled in x, the analysis has to bridge between two different particles by relying on Gassian assmptions as described in Appendix A. 5. For i = 1,..., k: a) Generate ɛ a,i N (0, P a,γ ). b) Set x a,i c) Set x a,i d) Set x a,i w = µ a,i(i) + ɛ a,i. = x b,i = x b,i w. + P b (P b ) 1 (x a,i The algorithm is illstrated in Fig. 2. Parallel assimilation of obserations x b,i ). In the preios paragraph we described how one block of obserations is assimilated in the block-lenkpf. Now let s consider the case of two blocks of obserations to be assimilated, say y 1 and y 2. Defining the corresponding state ector indices as aboe and sing an additional sbscript for the block, we can see that if ( 1, 1 ) ( 2, 2 ) =, then in principle parallel instead of serial assimilation of y 1 and y 2 is possible. In the case where 1 and 2 are contigos, one might worry abot discontinities at the bondary between 1 and 2. Howeer, the tapering matrix C ensres that the correlations between sites near this bondary and sites in 1 and 2 is small and ths the parallel assimilation of y 1 and y 2 throgh Eq. (12) makes only small changes near this bondary. 12

13 The procedre cold howeer introdce some discontinities in higher-order dependence between x a,i 1 and x a,i 2. To aoid this, one cold reqire an additional bffer area between 1 and 2, bt it wold slow down the algorithm and most likely not bring mch improement. We can therefore assimilate all blocks of obserations where the corresponding sets are well separated in parallel. Howeer, blocks where the corresponding sets are close hae to be assimilated serially. In theory, each assimilation of one block increases the correlation length becase the analysis coariance becomes the new backgrond coariance, bt we neglect this increase and contine sing the same taper matrix C ntil all obserations hae been assimilated. This additional approximation is necessary to keep the filter local and it is also sed in the serial lenkf of Hotekamer and Mitchell (2001). The reslting algorithm can be described more precisely as follows: 1. Partition the obserations in B blocks y 1,..., y B and determine the sets j and j (j = 1,..., B). 2. Choose a block i which has not been assimilated so far or exit if none is left. 3. Assimilate in parallel y i and all y j sch that ( j, j ) ( i, i ) =. 4. Go to step 2. The nmber of times that the algorithm has to loop between sccessie pdates depends on the specific geometry of the problem and on the partitioning of obserations in y 1,..., y B. In general one shold try to partition the obserations sch that as many blocks as possible can be assimilated in parallel, bt it is not necessary to find the global optimm to this combinatorial problem. To recapitlate, the block-lenkpf consists in assimilating data by blocks and in limiting their inflence to a local area. The analysis at sites that do not directly inflence the obserations in the crrent block bt are correlated with x is done by drawing from the conditional backgrond distribtion. For cases where resampling does not occr, doing so is eqialent to applying enkpf in the local window, whereas for cases where it does occr, the algorithm aoids to introdce harmfl discontinities and prodces a smoothed analysis. The block-lenkpf satisfies all or desiderata for a sccessfl localized algorithm based on the enkpf. Its disadantage, howeer, is that it reqires more oerhead for the partitioning of obserations and its implementation in an operational setting is more complicated. Now that we introdced two new localized algorithms based on the enkpf, we will proceed to nmerical experiments in order to better nderstand their properties and test their alidity by comparing their performance to the lenkf. 4 Nmerical experiments The algorithms introdced in the present paper can be applied to any task of data assimilation for large-scale systems. Howeer we expect that relaxation 13

14 of Gassian assmptions will be most beneficial when the dynamical system is strongly non-linear. Sch an application is data assimilation for nwp at conectie scale. Würsch and Craig (2014) introdced a simple model of clod conection which allows one to qickly test and deelop new algorithms for data assimilation at conectie scale (as for example in Haslehner et al. (2016)). We first briefly introdce the model and the mechanism to generate artificial obserations. Then we present reslts of two cycled data assimilation experiments. 4.1 The modified shallow water eqation model The model is based on a modified sweq on a one-dimensional domain to generate patterns that are similar to the creation of conectie precipitations in the hot months of smmer. The conectie cells are triggered by plmes of ascending hot air generated at random times and locations. The sweq is modified in sch a way that if h, the height of the flid, in the present case hmid air, reaches a gien threshold (h c ) the conection is reinforced and leads to the creation of a clod. The conection mechanism is maintained ntil the flid reaches a new threshold (h r ), aboe which the clod starts to prodce rain at a gien rate and then slowly disappears. The state of the system can ths be described by three ariables: the flid height h, the rain content r and the horizontal wind speed. We do not se any nits as the scales are arbitrary. The parameters (flid height thresholds, precipitation rate, etc.) are the same as for the model rn described in (Würsch (2014), Chap. 5) except for the clod formation threshold set to H c = as in (Würsch and Craig, 2014). They hae been tned so that the system exhibits characteristics similar to real conection (fraction of clods, life-time of precipitation, etc). The random pertrbations are introdced at a rate of m 1 min 1. We se a domain size of 150 km with periodic bondary conditions and a resoltion of 500 m. From this system we generate artificial obserations that imitate radar measrements. In order to make the experiment realistic, we se a non-linear and non-gassian mechanism for generating the obserations, bt consider them as linear and Gassian dring the assimilation. The rain field is obsered at eery grid point, bt set to zero if below a threshold (r c ), and with some skewed error whose scatter increases with the aerage amont of rain otherwise. Or obseration mechanism is different from the one of (Würsch and Craig, 2014), where simple trncated Gassian errors were sed, and is intended to be more realistic and challenging than the latter. In more detail, the rain obserations y r are generated as follows: y r = { 0 if r rc or 1 2 ɛ r r c ( r r c ɛ)2 otherwise, where ɛ N (0, σ 2 r), independently at eery grid point. Sch a skewed error distribtion for rain obserations is a common choice (see for example Sigrist et al. (2012); Stidd (1973)). It consists in applying a Box-Cox transform (with parameter λ = 0.5), adding some white noise and then transforming back to 14

15 flid height rain content wind Distance [km] Figre 3: Typical example of the modified sweq model with artificial radar obserations (red dots) and critical ales (h c, h r and r c ) as dashed lines. the original scale. Besides rain, wind speed is also obsered with some additie Gassian noise (with ariance σ 2 ), bt only at grid points where the obsered rain is positie (y r r c ). For the present experiment σ 2 r = and σ 2 = Sch artificial obserations make data assimilation realistic and challenging de to the non-linearity and sparsity of the obseration operator and the non- Gassian errors. One cold consider transforming the obserations to obtain a more normal distribtion, bt we want to test if or algorithms can handle sch difficlt sitations. A typical example of a field prodced with the model and some artificial obserations is displayed in Fig. 3. The bmps in flid height represent clods which start to appear if the first threshold is reached (lower dashed line) and are associated with precipitation if they reach the second threshold (pper dashed line), after which they start to decay. Rain can remain for some time after a clod has reached its peak. The sharp pertrbations in the wind field are the random triggering plmes. 4.2 Assimilation setp An initial ensemble of 50 members is generated by letting the model eole withot assimilating any obserations and taking each member at 200 days interal from each other sch that they are not correlated. We consider only perfect model experiments and do not take into accont model error; in particlar we do not se any form of coariance inflation. All the obserations are assmed to be Gassian, with a diagonal coariance matrix R with non-zero elements R r or R, depending on which type of obserations it corresponds to. For wind obserations the error is the same as for the tre generating process, that is we 15

16 set R = σ. 2 Rain and no-rain obserations are both assimilated and assmed to hae the same error. The tre rain distribtion is non-gassian, so R r is not straightforward to choose, especially becase it depends on the rain leel. We set R r = dring the assimilation, which is eqialent to the error obsered for a rain leel of (relatiely big, bt in the range of obsered ales). In general more cold be done to treat rain obserations properly, bt it is beyond the scope of the present stdy. We se one localization parameter l set to 5 km. Eery method ses a taper of the coariance matrix as defined in Gaspari and Cohn (1999) with half correlation length l. For lenkf and naie-lenkpf, the size of the local window is set to l in each direction, for a total of approximately 10 km or 21 grid points. Similarly, the obseration blocks for the block-lenkpf are defined from segments of 10 km in the domain (one block contains all the rain obserations falling in a specific 10 km segment and the associated wind obserations, if any). The enkpf has one free parameter, γ, which controls the balance between enkf and pf. We choose it adaptiely sch that the ess at the resampling step is between 50 and 80% of the ensemble size. A different γ can be selected for each site in the case of the naie-lenkpf, or for each block of obserations for the block-lenkpf, which allows the method to be closer to the pf in regions where non-gassian featres are present and to fall back closer to the enkf when it is necessary. In general the criterion for adaptie γ cold be refined and tned more closely, bt it is beyond the scope of the present paper. The two new local algorithms are compared against the lenkf of Ott et al. (2004) and not the letkf of Hnt et al. (2007), becase both the enkpf and the lenkf are based on the stochastic enkf and ths are more comparable. Frthermore or reslts cannot be directly compared to the ones in Haslehner et al. (2016) as or experimental setp is sbstantially different from theirs. 4.3 Reslts In order to highlight some key properties of the new proposed algorithms, we start with an example where high-freqency obserations are assimilated and stdy the reslting analysis ensembles isally. In a second step, repeating this experiment many times, we can ealate the performance of the algorithms and their differences. In a third step we discss longer assimilation periods with lower freqency obserations. We show the reslts as figres only as we beliee that they are only indicatie of some possible adantages bt shold not be taken too literally as the system nder stdy is ery artificial and the reslts can ary with different choice of parameters. The qality of assimilation is assessed with the continos ranked probability score (crps) (Gneiting and Raftery, 2007) commonly defined as: CRPS(F, x) = (F (x ) 1 (x x)dx ), where F ( ) is the predictie cmlatie probability fnction, in or case gien by the empirical distribtion of the ensemble. Becase we hae a perfect model 16

17 rain content lenkf naie-lenkpf block-lenkpf Distance [km] Figre 4: Typical example of analysis ensembles for the rain field after 1 hor of high-freqency obserations assimilation. Each of the red line is one ensemble member. On top is the lenkf, followed by the naie-lenkpf and the block-lenkpf. scenario we can directly ealate the crps of the one-step ahead forecast ensemble compared to the nderlying tre state of the system. The crps is a strictly proper scoring rle, which implies that sing sch a score allows one to control calibration and sharpness at the same time, contrary to the more commonly sed rmse (see Gneiting and Katzfss (2014) for a general discssion of probabilistic forecasting). High-freqency obserations In this first scenario we are interested in seeing if it is possible to se highfreqency radar data, especially for short term prediction. To do so we rn a cycled experiment where data are assimilated eery 5 min for a total of 1 hor. Starting from an initial ensemble which has no information abot the crrent meteorological sitation, the goal of the filter is to qickly captre areas of rain from the obserations. The analysis ensembles of the different algorithms for the rain field show that the local enkpfs are better able to identify dry areas. In Fig. 4 we can see the analysis ensembles after one hor of assimilation in the same typical sitation as in Fig. 3. All methods recoer the zones of heay precipitation relatiely well, with some minor differences in terms of maximm intensity. One shold not conclde too mch from an isolated case, bt there is one interesting trait which is not pecliar to this example and illstrates how the local enkpf algorithms are able to model non-gassian featres: the lenkf maintains some medim leel of rain at almost all sites, while both naie-lenkpf and block-lenkpf are better at sing the no-rain obserations to sppress sprios precipitation. Going beyond this particlar example, we now consider a simlation stdy 17

18 where we repeated the aboe experiment 1000 times and compted the aerage crps of each algorithm for eery assimilation cycle. To make the reslts more nderstandable and to remoe some natral ariability, we always compte the performance relatie to a free forecast rn. The latter is based on the same initial ensemble sed by all algorithms, bt does not assimilate any obseration, and is ths eqialent to a climatological forecast. Both new algorithms achiee good performances compared to the lenkf for the first hor of assimilation, as can be seen in Fig. 5. The gains are in terms of rain content, probably becase it is the field with the most non-gassian featres. The block-lenkpf seems to hae a slight adantage oer the naielenkpf for the flid height and the other way rond for the rain field, bt otherwise their performance is ery similar. Interestingly, if one looks at the eoltion of the crps for an assimilation period of six hors instead of only one hor in Fig. 6, some isses start to become apparent. After an initial drop, the crps for the flid height field increases again and gets worse than the free forecast reference, which means that obserations actally hamper the algorithms. The effect is greatest for the flid height bt also slightly isible for the rain for the naie-lenkpf. Physically, the problem comes from the fact that there is a delay between the formation of a clod and the appearance of rain. Haing assimilated many no-rain obserations the algorithm can become oerconfident that an area is dry and cannot adapt when new rain starts to appear. The lenkf is a bit less ssceptible to this problem, for the simple reason that it is less good at identifying dry areas and ths maintains more spread in the ensemble while the local enkpfs are too sre that no rain is present. Sch an effect can be nderstood as a form of sample degeneracy coming from the fact that a large nmber of obserations are assimilated, which will be confirmed in the next experimental setp. To assess the calibration of the algorithms we also look at the rank histograms of all fields in the first hor of assimilation for the block-lenkpf in Fig. 7. The one-step ahead forecast is more or less calibrated, except for a non-negligible fraction of cases where the trth lies otside the range of the ensemble. These problems can be attribted to the inherent difficlty coming from the fndamentally random natre of the system. Indeed, attempts at improing the calibration with coariance inflation and tning of the R matrix hae not been sccessfl. The histograms for the flid leel and the rain content reeal that some newly appeared clods are missed, while some sprios clods are sometimes created. The histogram for the absolte wind speed is generally niform except for a slight nderestimation, which comes from the random pertrbations of the wind field. Conclsions are similar for other algorithms and no clear differences can be identified. Therefore the improements in crps can be interpreted mainly as better sharpness while keeping calibration the same. Low-freqency obserations In a second scenario we consider the assimilation of lower freqency obserations (eery 30 min) bt for a longer period (three days). It wold be in principle 18

19 crps flid height rain content wind lenkf naie-lenkpf block-lenkpf time (min) Figre 5: Eoltion of the crps in the first hor with high-freqency obserations. The ale is gien as a percentage relatie to a free forecast rn. Notice the trncated y-axis. 125 flid height rain content crps lenkf naie-lenkpf block-lenkpf time (min) Figre 6: Eoltion of the crps (relatie to a free forecast rn) for the flid height and rain fields in the first 6 hors with high-freqency obserations. It becomes obios that after the first initial improement, all algorithms deteriorate in term of their ability to captre the nderlying flid height. Notice the trncated y-axis. freqency flid height rain content wind rank Figre 7: Rank histograms compted at one-step ahead forecast for the blocklenkpf in the high-freqency obserations experiment. Only eery 10 grid points and eery 30 mintes are sed to increase independence between obserations. 19

20 125 flid height rain content wind crps lenkf naie-lenkpf block-lenkpf lenkf naie-lenkpf block-lenkpf lenkf naie-lenkpf block-lenkpf Figre 8: Low-freqency obserations assimilated for a period of 3 days. Boxplot of the crps for the different algorithms and fields considered. The ales are gien relatie to a free forecast. Notice the trncated y-axis. possible to rn one long cycled experiment and to compte the aerage performance of the algorithms, bt we decided to rn 100 repetitions of a three days assimilation period instead, becase it can be done in parallel and it is more falt tolerant. In this scenario the U-shape pattern highlighted in Fig. 6 is not present anymore, as more diersity is introdced between each assimilation cycle and the ensemble does not become oerconfident. In term of calibration, the reslts are similar to the high-freqency scenario, bt with less tendency to create sprios clods and rain bt a slight bias towards too small clods. The boxplots of Fig. 8 show that block-lenkpf otperforms the other methods for the rain field, while the naie-lenkpf shows most difficlties, especially for the flid height where it gets sometimes worse than the free forecast. One can notice that the flid height and the wind fields are the most difficlt to captre, which comes as no srprise as they are not obsered. Frthermore, it shold be noted that there is a lot of ariability from experiment to experiment, and the crps gets reglarly worse than the free forecast. The relatiely less good performance of the naie-lenkpf compared to the block-lenkpf in this scenario might come from the added discontinities in the analysis. In the high-freqency scenario the problem was not apparent as the system only eoled for a short time before new obserations were assimilated. With low-freqency obserations, howeer, the discontinities introdced by the naie-lenkpf hae more time to prodce a detrimental effect on the dynamical eoltion of the system, which reslts in a poorer performance. 5 Smmary and discssion We introdced two new localized algorithms based on the enkpf in order to address the problem of non-linear and non-gassian data assimilation, which is becoming increasingly releant in large-scale applications with higher resoltion. The algorithms that we propose combine the enkf with the pf in a way 20

21 that aoids sample degeneracy. We took particlar care to localize the analysis withot introdcing harmfl discontinities, which is an inherent problem of local pfs. The reslts of the nmerical experiments with a modified sweq model confirm that the proposed algorithms are promising candidates for application to conectie scale data assimilation problems and hae some distinct adantages compared to the lenkf. The two local enkpfs proide better estimates of the rain field, which has non-gassian characteristics and ths benefits greatly from the pf component of the algorithms. This adantage is the strongest either in the high-freqency scenario for short assimilation periods, or in the lowfreqency scenario on longer time scales for the block-lenkpf. Calibration is not perfect as can be seen from the rank histograms, bt the improements in crps indicate that the new algorithms are better in terms of sharpness while keeping calibration the same. In general the naie-lenkpf performs a little worse than the block-lenkpf, bt it is more straightforward to implement and might ths be sitable for large scale applications. Assimilating high-freqency obserations oer long periods of time seems to be problematic for all algorithms, as they grow oerconfident and are not able to adapt when new clods appear in the field. Indeed, if one does not assimilate other types of obserations the filter is not able to correctly captre the nobsered flid height field before it prodces rain and performances deteriorate qickly after an initial improement. It is not certain if sch a behaior is particlar to the present sweq model or if it is an inherent characteristic of conectie scale assimilation, bt it indicates some potential limits of sch scenarios. One possible path to tackle this isse wold be to properly accont for model error. Indeed, the present case stdy is not a perfect model experiment, as we assme that the obserations are linear and Gassians where in fact they are not. The typical approach to accont for model error is to inflate the coariance, bt there is a lot of research to do to nderstand how to apply sch ideas in the context of pf like algorithms. In many applications, the se of a sqare-root filter sch as the letkf has been shown to be of great benefit. Therefore, we are crrently inestigating possibilities to reformlate the enkpf in this framework. In order to stdy the impact of localization on the qality of the analysis, we applied the two new localized enkpfs to some simpler setps than in the present paper, where it is possible to analyze more closely the problem of discontinities (Robert and Künsch, 2016). Gien the promising reslts of the localized enkpfs, we are collaborating with Meteoswiss and Detscher Wetterdienst on adapting or algorithms to cosmo, a conectie scale, non-hydrostatic nwp model. 6 Acknowledgments We are ery thankfl to Daniel Leenberger from Meteoswiss for fritfl discssions and comments, to Michael Würsch for his spport for implementing and interpreting his modified sweq model, and to the reiewers for their alable 21