arxiv: v1 [math.na] 26 Sep 2017

Transcription

1 Ineracing paricle filers for simulaneous sae and parameer esimaion Angwenyi David, Insiu für ahemaik Universiä Posdam Jana de Wiljes, Insiu für ahemaik Universiä Posdam arxiv: v1 [mah.na] 26 Sep 217 Simulaneous sae and parameer esimaion arises from various applicaional areas bu presens a major compuaional challenge. os available arkov chain or sequenial one Carlo echniques are applicable o relaively low dimensional problems only. Alernaive mehods, such as he ensemble Kalman filer or oher ensemble ransform filers have, on he oher hand, been successfully applied o high dimensional sae esimaion problems. In his paper, we propose an exension of hese echniques o high dimensional sae space models which depend on a few unknown parameers. ore specifically, we combine he ensemble Kalman- Bucy filer for he coninuous-ime filering problem wih a generalized ensemble ransform paricle filer for inermien parameer updaes. We demonsrae he performance of his wo sage updae filer for a wave equaion wih unknown wave velociy parameer. 1 Inroducion There is a high demand across differen disciplines for mehods ha allow for efficien and reliable sae-parameer esimaion for high-dimensional and nonlinear evoluion equaions. While he heoreical foundaion of sae and parameer esimaion for sochasic differenial equaions (SDEs) is well esablished (see, for example, [1, 11] and efficien compuaional mehods for low dimensional problems are available (see, for example, [9, 12]), join sae-parameer esimaion for high dimensional problems remains an area of acive research. A major breakhrough in ha direcion has been achieved hrough he developmen of he ensemble Kalman filer (EnKF) for sae esimaion of discreized parial differenial equaion models arising, for example, from meeorology and oil reservoir exploraion [1, 13, 16]. The success of he EnKF has riggered he developmen of a large Sebasian Reich, Insiu für ahemaik Universiä Posdam and Deparmen of ahemaics and Saisics Universiy of Reading sereich@uni-posdam.de variey of relaed ensemble ransform filers wih he aim of removing he underlying Gaussian disribuional assumpions of he EnKF. Here we wish o menion in paricular he work of [2,4,5,17,2] on he coninuous-ime filering problem and [8, 15, 18, 19] on he inermien filering problem. In his paper, we propose an exension of he ensemble ransform filering approach o he coninuous-ime combined sae and parameer esimaion problem. Insead of applying an ensemble ransform filering approach direcly o he exended sae-parameer phase space, we propose o exploi he paricular srucure of he join condiional disribuion and approximae i via a hybrid ansaz combining wo differen ineracing paricle filers; namely he ensemble Kalman-Bucy filer (EnKBF) [2] for sae esimaion and he ensemble ransform paricle filer (ETPF) [15, 16] for he parameer updaes. Such an approach is advanageous provided he disribuion in he saes given model parameers is nearly Gaussian while he disribuion in he parameers may be non-gaussian. Furhermore, he main addiional compuaional complexiy arises from he updae of he parameers hrough an appropriae exension of he ETPF. Here we assume ha he number of unknown parameers is much smaller han he dimension of sae space of he underlying SDE model. The remainder of he paper is srucured as follows. In Secion 2, we will discuss he heoreical foundaion of he considered Bayesian inference problem and formulae he basic algorihmic approach. Our proposed approach for a sequenial updae of he model parameers and he required exension of he ETPF is provided in Secion 3. A summary of he overall algorihm is provided in Secion 4 and numerical resuls for a sochasic wave equaion in Secion 5. Our conclusions can be found in Secion 6.

2 2 Problem formulaion and proposed ansaz We consider he following ime-coninuous filering problem: esimae a reference rajecory x ref () R N x and [,T ] and a vecor of unknown reference parameers λ ref R N λ of a SDE dx = f (x,λ)d + Q 1/2 dw (1) from coninuous-ime observaions dy = h(x )d + R 1/2 dv. (2) Here boh W R N x and V R N y denoe sandard mulidimensional Brownian moions. A common approach o joined parameer and sae esimaion is o augmen he SDE (1) by he rivial dynamics dλ = (3) in he parameers λ. Then he disribuion of ineres is he condiional densiy π (z) := π (z y [,] ) in he augmened sae variable z = (x,λ ) R N z. The ime evoluion of he condiional densiy π is described by he Kushner-Sraonovich equaion [1, 11], which we sae in he form π (g) = π (g) + + where h s := π s (h) and π s ( g)ds ( πs (gh) π s (g) h s ) T R 1 ( dy s h s ds ), g := f x g N x Q kl k,l=1 2 g. x k x l Analyical soluions of (4) are generally no available and sequenial one Carlo (SC) mehods are ofen employed in order o approximae he marginal densiy by empirical measures. Here we follow recenly developed SC mehods which rely on appropriaely defined modified evoluion equaions for paricles z l, l = 1,...,, such ha π (z) 1 N N l=1 (4) δ(z z l ). (5) The feedback paricle filer (FPF) [2, 21] is one of hese, so called, paricle flow filers, which is characerized by he modified SDE dz l = [ f (z l )d + Q 1/2 dw l ] + K l di l (6) wih gain facors K l = K (z l ) and innovaion di l = dy h(xl ) + h d. (7) 2 Here he Sraonovich inerpreaion of he SDE (6) should be used [14]. The gain funcion K is deermined by he ellipic parial differenial equaion z ( π K ) = π R 1 (h h ) T. (8) Noe ha π is unknown and needs o be approximaed by (5). In oher words, K is ypically found as a weak approximaion o (8). Differen numerical approaches for solving (8) can be found in [17]. We menion ha he innovaion (7) can be replaced by he alernaive form di l = dy h(x l )d + R 1/2 du l, (9) where U l denoe sandard N y -dimensional Brownian moion independen of W and V. The saisical equivalence can be shown following he argumens of Appendix A in [17]. While (6) is very appealing, is numerical implemenaion can be demanding for high-dimensional sysems which require a large number,, of paricles z l. In order o address his issue we propose o rewrie he join disribuion π in is desinegraed form, i.e. π (z) = ˆπ (x λ) ˆπ (λ). (1) A corresponding paricle approximaion can be defined as follows: π (z) δ(λ w i ˆλ i ) 1 δ(x ˆx i, j ), (11) where ˆλ i ˆπ (λ), i = 1,...,, are consan parameer values drawn from he prior parameer disribuion wih imedependen weighs w, i i = 1,...,. There is also a se of ime-dependen saes { ˆx i, j } for each parameer vecor ˆλ i, i {1,...,}. The evoluion equaions for hese saes are given by he FPF wih he parameers ˆλ i held fixed, i.e., d ˆx i, j = f ( ˆx i, j, ˆλ i )d + Q1/2 dw i, j + ˆK i, j di i, j, (12) where ˆK i, j = K ( ˆx i, j, ˆλ i ) is deermined by an appropriae numerical approximaion o x ( ˆπ ˆK ) = ˆπ R 1 (h h i ) T (13)

3 and di i, j denoes he innovaion, i.e., or di i, j di i, j = dy h( ˆxi, j ) + h i d (14) 2 = dy h( ˆx i, j )d + R 1/2 du i, j, (15) respecively. The ime evoluion of he normalized imporance weighs w i are calculaed according o dw i = w i ( h i h ) T R 1 (dy h d) (16) wih w i := 1/ iniially and h i = 1 h( ˆx i, j ), h = 1 h i. (17) Noe again ha he parameer values are kep consan in (11), i.e., ˆλ i n = ˆλ i. A special case of he FPF scheme arises when he gain facor is assumed o be consan, which resuls in he popular EnKBF: d ˆx i, j = f ( ˆx i, j, ˆλ i )d + Q1/2 dw i, j +CR i 1 di i, j, (18) where he covariance marix C i is deermined empirically, i.e., C i = 1 1 ( x i, j x )(h( i ˆx i, j ) h ) i, x i = 1 ˆx i, j, and he innovaion di i, j is eiher given by (14) or (15), respecively. The EnKBF produces asympoically correc resuls in a linear model seing when he poserior is a Gaussian disribuion bu is also successfully employed for sae esimaion in he conex of srongly nonlinear model scenarios [2]. In his paper, we employ he EnKBF o forward sae samples, ˆx i, j, in ime. In oher words, we inerpre (11) as a weighed Gaussian mixure approximaion o he condiional filering disribuion, π. The effecive mixure size, defined by eff 1 = (wi ) 2, (19) will deeriorae as ime progresses, in general. A classic approach would be o resample he parameer values ˆλ i joinly wih heir sae samples { ˆx i, j }, i {1,...,} a an appropriae insance = of ime according o heir weighs w i in order o produce an equally weighed mixure (11). However, resampling wih replacemen would produce idenical ses of parameers and associaed sae samples. Hence, we propose an exension of he ETPF [15, 16] o (11). Conrary o he EnKBF, he ETPF produces a consisen approximaion of he gain facor of he FPF on he basis of an opimal ranspor problem [17]. The ETPF has also been shown o work well under relaively small number of paricles and high dimensional sysems when combined wih localizaion [3, 8]. 3 Ensemble ransform paricle filer As menioned above, he ETPF is an numerical approximaion of he feedback conrol law of he FPF induced by a linear ranspor problem [17]. A differen inerpreaion is ha he ETPF replaces he resampling sep of he classical paricle filer wih a linear ransformaion [15, 16]. The key idea is o choose a linear ransformaion ha connecs he empirical measure of he weighed prior ensemble wih an equally weighed poserior ensemble in he sense of opimal ransporaion. Inuiively, one would like o achieve a high correlaion beween he prior and poserior samples. ore generally, he opimal ranspor problem beween wo weighed empirical measures ν 1 and ν 2, given by ν 1 (y) = w i 1 δ(y yi 1 ), ν 2(y) = w i 2 δ(y yi 2 ), can be formulaed as follows [16]. Inroduce he se U(W 1,W 2 ) = {T R : i j, i j w i 1, i j = w j 2 } of admissible bi-sochasic marices T and he marix of muually disances Y1,Y 2 wih enries ( Y1,Y 2 ) i j = y i 1 y j 2 2. Then he Wassersein disance beween ν 1 and ν 2 is defined by W2 2 (ν 1,ν 2 ) = min r ( T T ) Y1,Y 2. (2) T U(W 1,W 2 ) The marix T U(W 1,W 2 ), which achieves he minimum in (2), is called he opimal coupling beween ν 1 and ν 2. The ETPF relies on he special siuaion ha he vecor W 1 = (w 1 1,...,w 1 )T represens he imporance weighs of he prior samples y i, i {1,...,}, and W 2 = (1/,...,1/) T. Furhermore, he ETPF also uses Y 1 =Y 2 =Y := (y 1,...,y ) T and he desired equally weighed poserior samples are defined by ỹ j = y i i j.

4 Solving an opimal ranspor problem is compuaionally demanding for large sample sizes. This issue has been addressed in [6, 7] via a Sinkhorn approximaion which reduces he complexiy of he opimal ranspor problem from O( 3 log()) o O( 2 ). I is shown in [8] how his approximaion can be employed successfully in he conex of sequenial filering. In case of he weighed mixure approximaion (11), he ETPF is implemened a an appropriae insance = of ime as follow. Firs, we define he disance marix Y1,Y 2. There are wo choices. Eiher one ses Y 1 = Y 2 = (ˆλ 1,..., ˆλ )T or one uses he exended vecors ẑ i = ((ˆλ i)t,( x ) i T ) T R N z insead of ˆλ i in boh Y 1 and Y 2. Second, he weigh vecor W 1 is defined by W 1 = (w 1,...,w ) T. Denoing he soluion of he opimal ranspor problem again by T, equally weighed parameer values are finally provided by ˆλ j = ˆλ i i j. (21) We also need o ransform he associaed sae samples ˆx i, j. The obvious choice is ˆx i, j + = l=1 ˆx l, j il j {1,...,}. (22) This requires, however, ha he sae samples ˆx i, j are opimally correlaed for each fixed index i {1,...,}. This can be achieved eiher hrough an appropriae iniializaion of he sae samples or hrough finding an appropriae permuaion marix P i R for each se of sae samples { ˆx i, j } via an associaed Wassersein barycener problem [7]. ore specifically, inroduce equally weighed empirical measures ν i (x) = 1 and he empirical measure ν(x) = 1 δ(x ˆx i, j ) δ(x x j ) wih is locaions x j, j = 1,...,, deermined as he minimizer of he funcional f (ν) = W 2 2 (ν,ν i ). (23) The desired permuaion marices are now given by P i = T i, i {1,...,}, where T i denoes he opimal coupling marix associaed o W 2 2 (ν,ν i). Efficien numerical mehods for solving Wassersein barycener problems for empirical measures have been discussed in [7]. These permuaion marices P i are now used o rearrange he sae samples prior o he applicaion of (22). While he ransformaion seps (21) (22) in he parameers and he sae samples is relaively complex, we emphasize ha i only needs o be conduced whenever he effecive sample size (19) drops below a cerain hreshold such as = 3/4, for example. 4 Algorihmic summary The deails of he proposed hybrid mixure model are laid ou in form of pseudocode in Algorihm (1). In paricular, he saes ˆx i, j are evolved numerically via a forward Euler discreizaion of he EnKBF (18) wih sep-size and he weigh updae formula (16) is discreized as w i n+1 wi n exp 1 2 ( h i n) R 1 h i n ( h i n) R 1 y n (24) in order o preven negaive weighs. Here subscrip n denoes approximaions a ime-level n = n. Whenever he effecive sample size (19) drops below a hreshold value <, he parameers and he sae samples are updaed via he exended ETPF as described in Secion 3 and he weighs are rese o 1/. This sep requires o solve a linear ranspor problem, i.e., T = argmin T R subjec o he consrains ik = 1/, k=1 i,k=1 ik ˆλ i n ˆλ k n 2 (25) ik = w i n and ik (26) and, if necessary, he Wassersein barycener problem (23). 5 Numerical example The proposed mixure ansaz is now numerically invesigaed for he sochasic wave equaion v = c u + γ v + δẇ (x), (27) u = v, (28) wih unknown wave velociy parameer c = e λ, δ =.2, γ =.1 and space-ime whie noise Ẇ (x). Noe ha a more general case han discussed earlier is considered here, i.e., u (x) and v (x) are funcions wih respec o he spaial domain x [,2π] a any given ime. We assume periodic boundary condiions and generae iniial fields from a

5 Algorihm 1 Two sep EnKF-ETPF updae Inpu: ˆx i, j, ˆλ i, w i := 1/, i {1,...,} j {1,...,}, y [,] Oupu: λ [,], x [,] i, i {1,...,} 1: for n = 1 o do 2: for j = 1 o do 3: Calculae ˆx i, j according o eq. (18) 4: end for 5: for i = 1 o do 6: Compue weighs weighs w i n via (24) 7: if eff hen 8: Solve minimizaion linear ranspor problem (25) o find T 9: If required, solve he Wassersein Barycener problem (23) and rearrange saes ˆx i, j 1: Updae samples ˆx i, j and ˆλ i n via (22) and (21) where V denoes space-ime whie noise and R =.1. The hreshold for he effecive sample size is se o = 3/4. The ensemble size of saes is = 1 for each parameer c i = eˆλ i and we use = 2 differen realizaions of he unknown parameer λ, which is assumed o Gaussian disribued a iniial ime. As shown in Figure 1, he proposed mehodology yields a correc esimae for he rue parameer value (displayed in yellow) afer a relaively shor assimilaion window. We also display an esimae using an EnKFB for boh he sae and parameer updaes for comparison. Since all = 2 differen models where iniialized wih he same ensemble of saes and he daa assimilaion window is relaively shor, he soluion of a Wassersein barycener problem was no necessary in order o keep he differen ensembles of saes sufficienly correlaed. I is no surprising ha he EnKBF performs well for his sae-parameer esimaion problem since he condiional densiy π is close o Gaussian. The ETPF parameer updae should provide more appropriae for non-gaussian disribuions in he parameer values. 11: Se weighs w i n := 1 12: end if 13: end for 14: Deermine λ n = 1 ˆλ n i n 15: Compue x n i = 1 ˆxi, n j n i 16: end for parameer esimae ETPF EnKF rue value ime Fig. 1: Time evoluion of he esimaed wave velociy parameer, c, is displayed for wo differen echniques for updaing he parameer values, namely he EnKBF (red) and he ETPF (blue). The rue parameer value is shown in yellow. In boh cases, he EnKFB is used for updaing he ensembles of saes. 6 Conclusions We have presened a sequenial sae-parameer esimaion algorihm suiable for high-dimensional sae space models which depend on a relaively small number of parameers. In comparison o a direc approach based on he FPF formulaion (6) for an exended sae space model, he proposed mehodology can be implemened as a parallel updae of sandard sae esimaion problems for given parameers using eiher he FPF, he EnKBF or oher ensemble ransform paricle filer. If necessary, echniques such localizaion and ensemble inflaion [1,16] can also be used. The parameers, on he oher hand, are adjused using an exended version of he ETPF once he effecive sample size of he parameers drops below a cerain hreshold value. This par of he algorihm is compuaionally more demanding han a sandard resampling approach. However, i allows again for an applicaion of localizaion o he esimaion of spaially dependen parameers. A pracical exploraion of such an exension of he presened algorihm will be explored for sochasic wave equaion (27) (28) and spaially dependen wave velociies c(x) in fuure work. Furhermore, he compuaional complexiy of he parameer updae sep can be reduced by using alernaive implemenaions of he ETPF such as provided by he Sinkhorn algorihm for he underlying linear ranspor problem [8]. Gaussian process prior. The spaial domain is discreized by means of a se of 1 equidisan poins and he resuling finie-dimensional SDE is inegraed over he ime inerval [,4] wih sep-size =.1 (i.e., 4 ime seps). We observe he velociy field v (x) coninuously in ime ẏ = v + R 1/2 V, (29) Acknowledgmens This research has been funded by he Deusche Forschungsgemeinschaf (DFG) hrough gran CRC 1294 Daa Assimilaion, Projec (A2) ong-ime sabiliy and accuracy of ensemble ransform filer algorihms and Projec (A6) Approximaive Bayesian inference and model selecion for sochasic differenial equaions.

6 References [1] A. BAIN AND D. CRISAN, Fundamenals of sochasic filering, vol. 6 of Sochasic modelling and applied probabiliy, Springer-Verlag, New-York, 28. [2] K. BERGEANN AND S. REICH, An ensemble Kalman-Bucy filer for coninuous daa assimilaion, eeorolog. Zeischrif, 21 (212), pp [3] N. CHUSTAGUPRO, S. REICH, AND. REIN- HARDT, A hybrid ensemble ransform filer for nonlinear and spaially exended dynamical sysems, SIA/ASA J Uncerainy Quanificaion, 4 (216), pp [4] D. CRISAN AND J. XIONG, Approximae ckean-vlasov represenaion for a class of SPDEs, Sochasics, 82 (21), pp [5], Numerical soluion for a class of SPDEs over bounded domains, submied, (211). [6]. CUTURI, Sinkhorn disances: ighspeed compuaion of opimal ranspor, in Advances in Neural Informaion Processing Sysems 26, C. Burges,. Boou,. Welling, Z. Ghahramani, and K. Weinberger, eds., Curran Associaes, Inc., 213, pp [7]. CUTURI AND A. DOUCET, Fas compuaion of Wassersein baryceners, in Proceedings of he 31s Inernaional Conference on achine earning, E. P. Xing and T. Jebara, eds., vol. 32 of Proceedings of achine earning Research, Bejing, China, Jun 214, PR, pp [8] J. DE WIJES, W. ACEVEDO, AND S. REICH, A second-order accurae ensemble ransform paricle filer, acceped in SIA Journal on Scienific Compuing, (217). [9] A. DOUCET, N. DE FREITAS, AND N. G. (EDS.), Sequenial one Carlo mehods in pracice, Springer- Verlag, Berlin Heidelberg New York, 21. [1] G. EVENSEN, Daa assimilaion. The ensemble Kalman filer, Springer-Verlag, New York, 26. [11] A. JAZWINSKI, Sochasic processes and filering heory, Academic Press, New York, 197. [12] N. KANTAS, A. DOUCET, S. SINGH, J. A- CIEJOWSKI, AND N. CHOPIN, On paricle mehods for parameer esimaion in sae-space models, Saisical Science, 3 (215), pp [13] K. AW, A. STUART, AND K. ZYGAAKIS, Daa Assimilaion: A ahemaical Inroducion, Springer- Verlag, New York, 215. [14] G. PAVIOTIS, Sochasic Processes and Applicaions, Springer-Verlag, 214. [15] S. REICH, A nonparameric ensemble ransform mehod for Bayesian inference, SIA J. Sci. Compu., 35 (213), pp. A213 A224. [16] S. REICH AND C. COTTER, Probabilisic Forecasing and Bayesian Daa Assimilaion, Cambridge Universiy Press, 215. [17] A. TAGHVAEI, J. DE WIJES, P. G. EHTA, AND S. REICH, Kalman filer and is modern exensions for he coninuous-ime nonlinear filering problem, Tech. Rep. hp://arxiv.org/abs/ , Acceped a J. Dyn. Sys., eas., Conrol., 217. [18] J. TÖDTER AND B. AHRENS, A second-order exac ensemble square roo filer for nonlinear daa assimilaion, on. Wea. Rev., 143 (215), pp [19] X. XIONG, I. NAVON, AND B. UZUNGOGU, A noe on he paricle filer wih poserior Gaussian resampling, Tellus, 85A (26), pp [2] T. YANG, P. EHTA, AND S. EYN, Feedback paricle filer, IEEE Trans. Auomaic Conrol, 58 (213), pp [21] C. ZHANG, A. TAGHVAEI, AND P. G. EHTA, Feedback paricle filer on marix ie groups, in American Conrol Conference (ACC), 216, IEEE, 216, pp