arxiv: v1 [math.pr] 16 Jan 2019

Transcription

1 ON HE CONINUOUS IME LIMI OF HE ENSEMBLE KALMAN FILER HERESA LANGE, WILHELM SANNA riv:9.54v [mh.pr] 6 Jn 9 Absrc. We presen recen resuls on he exisence o coninuous ime limi or Ensemble Klmn Filer lgorihms. In he seing o coninuous signl nd observion processes, we pply he originl Ensemble Klmn Filer lgorihm proposed by [] s well s recen vrin [6] o he respecive discreizions nd show h in he limi o decresing sepsize he iler equions converge o n ensemble o inercing sochsic dierenil equions in he ensemble-men-squre sense. Our nlysis lso llows or he derivion o convergence res wih respec o he sepsize. An pplicion o our nlysis is he rigorous derivion o coninuous ensemble ilering lgorihms consisen wih discree pproximion schemes. Conversely, he coninuous ime limi llows or beer quliive nd quniive nlysis o he ime-discree counerprs using he rich heory o dynmicl sysems in coninuous ime.. Inroducion In his pper, we im o give rigorous derivion o coninuous ime limi o he Ensemble Klmn Filer. he Ensemble Klmn Filer EnKF, or Ensemble Klmn-Bucy Filer EnKBF when considered in coninuous ime, is d ssimilion echnique which since is invenion in he 99s gined wide populriy in mny scieniic ields such s ocenogrphy or meeorology. he generl ide is he ollowing: d-dimensionl Mrkovin signl described by d = d Q dw, is unknown bu cn be observed hrough p-dimensionl process Y dy = g d C dv where W nd V re independen Brownin moions. Bsed on he model ssumpions nd he rel-ime mesuremens, iler clcules n esime o he signl he curren ime. In cse o he EnKBF, he signl is esimed in Mone-Crlo shion, i.e. n ensemble o iniil condiions i, i =,..., M, is propged ccording o nd Mhemics Subjec Clssiicion. 6H35, 93E, 6F99. Key words nd phrses. Ensemble Klmn Filer, Coninuous ime limi.

2 HERESA LANGE, WILHELM SANNA such h is ensemble men 3 x := M i yields n esime or he rue signl ime. In [], he uhors give coninuous-ime ormulion o hese equions in he cse o liner observions which we generlize s ollows: d i 4 where 5 6 wih = i i d Q dw E G C dy C i dv 7 ḡ := M E := [ i x ],...,M Rd M, G := [ g i ] ḡ,...,m Rp M g i. g i d, he coninuous ormulion is o gre use when invesiging he mhemicl properies o he iler by mens o he rich heory o sochsic dierenil equions nd coninuous ime dynmicl sysems. In he numericl pplicion, however, only he discree lgorihm cn be implemened. o rele boh ormulions o ech oher one nlyzes he coninuous ime limi whose exisence implies h he coninuous ormulion is n inrinsic resul o he discree iler. his mens h ech propery we derive or he coninuous ormulion is lso propery o he discree scheme independen o he discreizion sep. he bove coninuous ormulion ws chieved by considering he clssicl EnKF lgorihm c. [] nd rerrnging erms such h he resul resembled n Euler-Mruym scheme o sochsic dierenil equion yielding 4. A similr soluion cn be ound in [3] in he conex o inverse problems where he uhors derive med Euler- Mruym ype discreizion using n EnKF lgorihm given in [4]. As known rom clssicl resuls, he Euler-Mruym scheme srongly converges o he soluion o he underlying sochsic dierenil equion under some regulriy ssumpions on he coeiciens c. [5]. Neverheless, rigorous nlysis o he convergence o he Euler-Mruym discreizion is sill required o veriy he ore menioned consisency. A irs emp o rigorously show coninuous ime limi or he EnKF in he conex o inverse problems is given in [7] bu only or simpliied exmple. In his work, we invesige he limi or more generl seing nd explicily show convergence o 4 wih eecive res in erms o he sepsize in heorem 4. nd Corollry 4. or explici res.

3 I urns ou h ssuring he ddiionl inegrbiliy condiion or he explici res is no h esy. he reson or his origines in he sochsic perurbion o he observion in he upde sep o he iler. In [], he uhors showed h omiing his perurbion yields n underesimion o he resuling covrince o he ensemble. Since his ddiionl source o noise complices he emps o chieving beer res, one my consider dieren ilering pproches voiding his priculr sep. For insnce consider he so clled deerminisic ilering lgorihms such s he Ensemble Squre Roo Filers EnSRF, see e.g. [] h im rnsorming he ensemble wihou ddiionl noise nd in such wy h he correc ensemble sisics re obined. Recenly in [6], modiied version o 4 ws nlyzed: d i = i d QP i 8 E G C dy wih he ensemble covrince mrix 9 P := i x d g i i ḡ d g d x i x. In his ormulion which we will cll modiied ormulion s opposed o he clssicl ormulion 4, he noise erms re replced by Q i dw i QP x d, C dv i i g ḡ d. Noe h wih his choice he evoluion equions or he ensemble men x nd he covrince mrix P red d x = d E G C dy ḡ d nd d d P = Q i i x i E G C G E, i x which in he liner cse coincide wih he Klmn-Bucy equions explining he priculr choice o perurbion. For 8, he uhors o [6] were ble o prove long-ime sbiliy nd ccurcy properies o he EnKBF. We hereore lso give coninuous 3

4 4 HERESA LANGE, WILHELM SANNA ime limi nlysis or 8 which migh be irs conribuion especilly o uure discussions on how o re he noise numericlly in conex o chieving beer pproximion resuls. he pper is orgnized s ollows: er speciying in Secion he seing we consider hroughou his pper, we shorly review in Secion 3 he EnKF lgorihm or he bove menioned versions. In Secion 4, we urn o he coninuous ime limi nlysis nd discuss our resuls boh on he clssicl nd he modiied ormulion s given in heorem 4. nd heorem 4.4, respecively. he proos will hen be given in Secion 5 where we use vrious properies o he coninuous nd he discree ime processes involved which we give in Appendix A nd Appendix B, respecively.. Seing Consider he d-dimensionl signl process modeled by 3 d = d Q dw, R d wih dri : R d R d, Q R d d symmeric, posiive deinie, nd W = W d-dimensionl sndrd Brownin moion. he signl is observed vi p-dimensionl process Y R p modeled by 4 dy = g d C dv, Y R p wih orwrd mp g : R d R p, C R p p symmeric, posiive deinie, nd V = V p-dimensionl sndrd Brownin moion. Furher, W nd V re muully independen. hroughou his pper we ssume h boh nd g re Lipschiz-coninuous wih Lipschiz-consns Lip nd g Lip, nd bounded by nd g, respecively, wih he usul supremum norm, s well s h ll rndom eniies re deined on given probbiliy spce Ω, F, P. In some ime horizon we consider he priion = < < < L = wih sep-size h >, i.e. k = k h = k h. he Euler-Mruym scheme yields ime-discreizion o he signl nd observion process s ollows: 5 k = k h k Q Wk W k 6 Y k = Y k hg k C Vk V k 7 Y k := Y k Y k = hg k C Vk V k. hus Y is he discree-ime observion process or he bove imediscreizion o.

5 3. Ensemble Klmn Filer lgorihms 3.. he clssicl ormulion. We dop he ormulion in [8] s ollows: ssume h ime k, we hve n ensemble o M nlyzed ensemble members i, k. he orecs sep yields new ensemble consising o he orecsed members, i.e. or ech i =,..., M,...,M obin 8 i, k = i, k h i, k Q W i k where i W k is n i.i.d. sequence o smples o N, hid. he,...,m ensemble men is hen given by 9 x k = M i, k. In he upde sep we sochsiclly perurb he new observion, i.e. deine Y i k := Y k C Ṽ i k, where Ṽ i k is n i.i.d. sequence o smples o N, hid, nd,...,m ormule n nlyzed ensemble i, k = i, i k K k Y k hg i, k wih Klmn gin mrix K k = E k where 3 4 E k = [ i, k G k = [ g i, k x k ] G k C h G k,...,m, ] ḡ k,,...,m ḡ k = M G k g i, k. In ol, he lgorihm or he ensemble members s well s cenered ensemble members reds: Algorihm 3.. Forecs sep: 5 i, k = i, k h i, i k Q W k, i, k i, k x k = i, k x k h i, k k Q Upde sep: 6 i, k = i, k K k Yk C Ṽ i k hg i, k, x k K Ṽ i k C k x k = i, k v k h g i, k 5 W i k w k ḡ k

6 6 HERESA LANGE, WILHELM SANNA Remrk 3.. In he cse o liner observion operor, i.e. gx = Gx, n lernive inerpreion o he Klmn gin mrix is obined rom he ollowing opimizion problem see Proposiion 3. in []: minimizing he men-squre disnce o he ensemble members o he orecs s well s he inormion provided by he innovion, i.e. minimizing he uncionl 7 J i k := Y i k hg i, C k P k where or posiive deinie mrix A we use he Mhlnobis norm 8 x A := A x, x = x A x, leds o he minimizer given by or ech i =,..., M wih gin 9 K k = P k G C hgp k G, P k = E k E k. In he generl nonliner cse, however, we cnno employ such derivion since he bove minimizion problem cnno be solved nlyiclly or generl g. hus we choose similr srucure o he gin mrix o obin Equion by replcing P k G E k G k, 3 GP k G G k G k. 3.. he modiied ormulion. In discree ime, he choice rnsles ino he ddiion o similrly moived erms o he orm Q i W k := h 3 Q Pk i, k x k, C Ṽ i k := h i, g k ḡ k. his in ol yields discree-ime lgorihm or he ensemble members s well s he cenered ensemble members: Algorihm 3.. Forecs sep: 3 i, k i, k Upde sep: 33 = i, k h i, h k Q Pk i, k x k, x k = i, k x k h i, k h k Q Pk i, k i, k = i, k K k Y k h x k = i, k x k h K k k i, g k ḡ, g i, k ḡ k i, k x k

7 4. he coninuous ime limi Similr o [7], inroduce or [ k, k ] he noion 34 η = k, η = k, ν = k, ν = k. For he clssicl ormulion we obin he ollowing coninuous ime limi resul: heorem 4.. Consider Algorihm 3.. I he iniil ensemble sisies he ollowing properies [ i, E i 35 ] O h γ, 36 [ i, E x ] <, M E i, x < where γ < is he Hölder-coeicien coming rom W, V, nd Y, hen here exiss coninuous process Ls s such h [ 37 sup E e M ] Lsds i, η i O h γ. [, ] Assuming urher n inegrbiliy ssumpion on L we lso obin n explici convergence re: Corollry 4.. I, moreover, here exiss δ > such h 38 sup E [e ] δ Lsds <, [, ] hen M 39 sup E i, η δ i [, ] δ O h γ δ δ. o esblish he exponenil momen esime 38 urns ou o be rher diicul. he reson or h lies in he ollowing c: L is n ine liner uncionl o 4 V := i x which reduces he problem o inding exponenil momen esimes o Lsds o he sme problem or V sds. However, V sisies he ollowing dierenil inequliy see Lemm A. 4 dv L V d rqd dn where 4 L := sup x =y x y, x y x y 7

8 8 HERESA LANGE, WILHELM SANNA nd 43 dn = i x, Q i dw E G C i dv hence he bove problem requires he conrol o he sochsic inegrl wih respec o N. Bu noe h he qudric vriion o N sisies d 44 d N 4 Q 4M g C V V which gives no eecive conrol on he growh o N nd hence on V. Remrk 4.3. Whihou he use o sochsic perurbion o he observion in he clssicl EnKF ormulion 4, however, he sregy o he proo o Lemm in [6] is indeed pplicble o our seing hence we cn ind δ > such h or he corresponding process L i holds 45 sup E [, ] [e δ Lsds ] <. As lredy menioned in he Inroducion we obin beer error esimes or he modiied ormulion: heorem 4.4. Consider Algorihm 3.. I he iniil ensemble sisies [ i, 46 E i ] O h nd hs bounded inverse covrince mrix, hen [ ] 47 E sup i, O h. [, ] η i Noe h his semen is sronger hn he resul in heorem 4. which is due o he c h he coeiciens o 8 re bounded s will be shown in Secion 5. In priculr, his yields h or ll [, ] 48 i η i C η ρ or some ρ <, hus we my concenre our nlysis on he ime poins k o he ime inervl priion. 5. Proos o heorem 4. nd heorem Preliminries. For he clssicl ormulion we inroduce he coninuous embedding o he upde sep 49 i := i, η η η K ν sdy s i, ηs ds η η Q dw i s K ν sc dv i s η K ν sg i, η s ds

9 nd consider he decomposiion 5 i, i, η i where 5 i i = i, η i η η η η η η i, ηs η K ν s K ν s i s i ds K ν sg i, η s E sg s C g i i η i s E sgs C dy s E sgs C C dv i s E sgs C g i s g i s In he modiied ormulion consider he decomposiion 5 i, i, i where 53 i, η i η = i, i η η η η η i i, ηs Furher noe h 54 K ν sgx i s ds η i η P Q νs i, ηs x νs K ν s E sgs C dy s i, K ν s g η s ḡ ν s E sg s C gy 9 i s ds i s ds ds. η i P s i s x s ds E sg s C g s i ḡs ds. = K ν s gx gy K ν s E sgs C gy = K ν s E sgs C gx E sgs C gx gy.

10 HERESA LANGE, WILHELM SANNA An essenil ool in he nlysis is he uniorm conrol o he Lipschiz consns o he coeiciens. he coeiciens h boh he clssicl nd he modiied ormulion hve in common re K ν E G C 55, 56 K ν, E G C 57, hus we provide he ollowing preliminry esimes: Lemm 5.. here exis consns C, C, C 3 independen o h such h or boh Algorihms 3. nd 3. i holds 58 K ν E G C C h V ν V i, 59 K ν C V ν, E G 6 C C 3 V where V ν := i, η x ν 6 V := i x. In boh he clssicl nd he modiied ormulion, we cn conrol V s well s V ν in sense mde precise in Appendix A nd Appendix B, respecively. Proo. On 58: 6 55 = E ν G ν C E ν G ν E G E ν G ν C E ν G ν E G η i h G ν G ν C C h G ν G ν C C.,

11 For his we esime by boundedness o g 63 E ν G i, ν = η x i, ν g η ḡ ν M g V ν. Furher 64 C = C = C h G ν G ν C h G ν G ν Id C h G ν G ν C h G ν G ν h G ν G ν C h C G ν G ν h 4 g C M. Finlly 65 = E ν G ν E G i, η x i i, ν x g η g x ν i i, η x ν x i g i, η M g g Lip V i, x g η g i x ν g g x i x g x ν g i, η i g g x i, η i. g x ν

12 HERESA LANGE, WILHELM SANNA In ol we obin 66 K ν E G C 6 C h 8 g 4 g Lip C M V ν 4 g M g LipV On 59: using 63 we obin K ν E ν 67 C M g i.e. 68 G ν C i, η i. V ν, K ν 4 g C M V ν. On 6: similr o 63 we obin 69 E G C 4 g C M V. 5.. Proo o heorem 4.. Noe h phwise i holds by Hölderconinuiy o W i, V i, nd Y 7 i, η i where γ <, nd hus 7 i, η i h Kν g h γ Q W i Kν Höl Y Höl 5 h g K ν Q h γ W i Y Höl Höl C V i C K ν V i Kν Höl K ν. Höl By Lemm 5. nd Appendix B, K k is bounded in expecion or ny k nd we ge [ i, i 7 E η ] O h γ.

13 3 Furher observe h he observion process Y cn be wrien s 73 dy = g re d C dv where re is he reerence rjecory h generes he observions. Using his in 5 we obin by he Iô ormul 74 d i i i i = i i, d i i, E G C i g i g d i i, i, η i K ν E G C K ν g i, η E G C i g d r K ν E G C C K ν E G C d i i, K ν E G C C dv dv i Lip g Lip C V i i Lip i, i η g Lip K ν d i, 4 g C K ν E G C i i, K ν E G C C Observe h η F i d dv dv i. g re 75 i, i η = i, i η M 3 i, η i h i, i η Q W h M ν Q M i W ν by boundedness o. Wih his nd Lemm 5. we obin in ol 76 M d i i L i i d Rd dn

14 4 HERESA LANGE, WILHELM SANNA where 77 L := 4 g Lip g Lip C V κ M g LipV, R := Lip 6 g Lip K ν 4 g κ M g Lip V M dn := 6h M 6 Q M i W ν κ h g 4 g Lip C M V ν 4 g M g LipV h M i i, K ν E G C C Q i, η i M i W ν, dv dv i wih κ := 64 C 4 g C M. By he Iô produc rule M 78 de M Lsds i i e Lsds Rd dn [ E e M ] Lsds i i [ M ] E i i [ ] E e s Lrdr Rsds [ M ] E i i E [Rs] ds. Now use 7 s well s Appendix B. nd Remrk A. or Kν 79 V V K ν 4 o deduce h i holds 8 sup E [R] O h γ. [, ] By he ssumpion on he iniil condiions his hen yields [ 8 sup E e M ] Lsds i i O h γ [, ] nd hence he clim [ 8 sup E e Lsds M [, ] i, η i ] O h γ.

15 5.3. Proo o heorem 4.4. Firs o ll observe rom i η i = = η η η η i s QPs i E sgs C dy s s i 5 s x s E sg s C g s i ḡs ds QPs i s x s E sgs C g s re E sg s C g s i ḡs ds E sgs C dvs. Wih his we obin 84 i η M =: I II. η i η i s QPs i s x s E sgs C g s re E sgs C g s i ḡs ds E sgs C dvs Using he esime 6 in combinion wih Appendix A. s well s boundedness o nd g we deduce 85 I O h. Furher we obin h he process E sg s C dvs is Hölder-coninuous wih coeicien ρ < c. [9]. In ol, his yields 86 i η i O h ρ. Now le k L, hen by using he semimringle represenion o Y nd pplying he Cuchy-Schwrz-inequliy, we obin

16 6 HERESA LANGE, WILHELM SANNA 87 = 6 i, k i k i, i k i, ηs i s ds k P Q νs i, ηs x νs k K ν s E sgs C g s re ds k K ν s E sgs C C dvs k i, Kν s g η s ḡ ν s E sgs C g s i ḡs ds i, i P s i s x s ds erm cn be esimed by using he Lipschiz-coninuiy o. In, he inegrnd cn be decomposed in he ollowing wy: 88 P i, νs P i = P νs = P νs ηs x νs P s i, ηs x νs s s x s P s P νs P s P i, s ηs x νs I holds wih V s deined in 7 i, ηs x νs i P s i, ηs x νs s x s i s x s. 89 P νs P s 8 V νs V s i, νs i s which yields by Appendix A nd Appendix B. 9 k Q v, v, v k λ p i, ηs i s ds. erm 3, 4 nd 5 cn be esimed vi Lemm 5. where in 4 we pply he Burkholder-Dvis-Gundy inequliy o obin or ny [, ]

17 7 9 E sup s [,] s C C BDG K ν r E rgr C C dvr E [ K ν s E sgs C ] ds C 6C BDG C h 8 g 6 C v, M 3 g 3 Lip v, v Furher i holds by he orecs sep 3 9 i, η s i s 3 i, ηs i s =: 3 i, ηs i s sup r [,s] [ E 3h M Q 4p v, 3h r. In ol we obin [ ] E sup i, η [, ] i η [ ] 93 6E i, i [ L E where 94 L := 8 g Lip 95 v, v R := 48h C M 3 g C BDG ] i, ηr i r 6 Lip Q C 3 g g Lip v r. λ v, ds R h v, ] i, η s i s ds. v p 4 g C M g Lip 6v, 7v, 6 g 6 C M 3 v, 3 6 g Lip v, v r

18 8 HERESA LANGE, WILHELM SANNA Now since by he iniil discussion o his subsecion nd he Burkholder- Dvis-Gundy inequliy i holds [ ] 96 E i η i Oh, sup [, ] sup [, ] we obin by ssumpion on he iniil condiions nd by Gronwll rgumen consn C > such h [ ] 97 E i, η i C h which concludes he proo. 6. Conclusion nd Oulook he Ensemble Klmn Filer is powerul ool in he ield o d ssimilion, nd is numerics re widely explored when pplied o vriey o high-dimensionl models s such rising in he geosciences. Our undersnding o is heoreicl properies, however, is sill rher limied. Some invesigions in his direcion used he coninuous version o he Ensemble Klmn Filer in conex o observions rriving wih high-requency, nd presen irs resuls on sbiliy nd ccurcy. In his work, we invesiged how he discree ilering scheme used in he numerics nd he coninuous ilering scheme used or he mhemicl nlysis rele o ech oher in h we conduced coninuous ime limi rgumen. In he lierure, irs resuls on his cn be ound in [], s well s [3] nd [7] in he conex o inverse problems, bu hese lck rigorous proo nd eecive res or he limi. Similr o [], we irs considered he clssicl Ensemble Klmn Filer ormulion which uses sochsiclly perurbed observion ensemble, nd our resul reds s ollows: Choosing he Euler-Mruym pproximion o he signl nd he observion s heir respecive ime-discreizion, he expeced ensemblemen-squre error o he corresponding Ensemble Klmn Filer ormulion nd he clssicl coninuous version converges o zero uniormly in ime wih convergence re given in heorem 4.. In he emp o proving beer res, he sochsic perurbion o he observions posed serious problem. When omiing his perurbion sep he convergence speed cn be improved; ccording o [], however, such perurbion is necessry or he lgorihm o give he correc sisics o he ensemble. hese indings led us o consider lernive versions o he Ensemble Klmn Filer h do no rely on he sochsic perurbion sep nd sill produce he correc sisics. Recenly in [6], he uhors nlyzed modiied coninuous Ensemble Klmn Filer scheme origining rom deerminisic rnsormions o he ensemble. he very promising

19 sbiliy nd ccurcy properies shown in [6] proposed his ormulion s n pproprie cndide or our invesigions. We summrize our resul o: Choosing he Euler-Mruym pproximion o he signl nd he observion s heir respecive ime-discreizion, he ensemble-mensqure error o he corresponding modiied Ensemble Klmn Filer ormulion nd he modiied coninuous version converges o zero loclly uniormly in ime in expecion wih convergence re given in heorem 4.4. One my urher consider invesiging he convergence o mixure o boh ormulions s menioned in [] where he clssicl orecs sep is combined wih he modiied upde sep. he exension o unbounded observion mps g remins n open problem presen. Work is in progress hough on he liner cse. Acknowlegdemen his reserch hs been unded by Deusche Forschungsgemeinsch DFG hrough grn CRC 94 "D Assimilion", Projec A "Long-ime sbiliy nd ccurcy o ensemble rnsorm iler lgorihms". Reerences [] Kelly, Dvid. B., Lw, Kody J., Sur, Andrew M., Well-posedness nd ccurcy o he ensemble Klmn iler in discree nd coninuous ime. Nonlineriy, Vol. 7, , 4, 6, 8 [] Burgers, Gerri, vn Leeuwen, Peer J., Evensen, Geir, Anlysis Scheme in he Ensemble Klmn Filer. Monhly Weher Review, Vol. 6, 79 74, 998,, 3, 8 [3] Schillings, Cludi, Sur, Andrew M., Anlysis o he Ensemble Klmn Filer or Inverse Problems. SIAM J. Numericl Anlysis, Vol. 55, 64 9, 7, 8 [4] Iglesis, Mrco A., Lw, Kody J., Sur, Andrew M., Ensemble Klmn mehods or inverse problems. Inverse Problems, Vol. 9, No. 4, 45, 3 [5] Kloeden, Peer E., Plen, Eckhrd, Numericl Soluion o Sochsic Dierenil Equions. Applicions o Mhemics, Springer-Verlg, Berlin, Vol. 3, 99 [6] de Wiljes, Jn, Reich, Sebsin, Snn, Wilhelm, Long-ime sbiliy nd ccurcy o he ensemble Klmn-Bucy iler or ully observed processes nd smll mesuremen noise. SIAM J. Appl. Dyn. Sys., Vol. 7, No., 5 8, 8, 3, 8, 8, 9, 3 [7] Blömker, Dirk, Schillings, Cludi, Wcker, Phillip, A srongly convergen numericl scheme rom Ensemble Klmn inversion. riv preprin riv: v3, 8, 7, 8 [8] Lw, Kody J., Sur, Andrew M., Zyglkis, Konsninos, D ssimilion: mhemicl inroducion. Springer-Verlg, Berlin, 5 5 [9] Roynee, Bernrd, Mouvemen brownien e espces de besov. Sochsics nd Sochsic Repors, Vol. 43, No. 3-4, 6, [] Bergemnn, Ky, Reich, Sebsin, An ensemble Klmn-Bucy iler or coninuous d ssimilion. Meeorologische Zeischri, Vol., No. 3, 3 9, 9 9

20 HERESA LANGE, WILHELM SANNA [] Whiker, Jerey S., Hmill, homs M., Ensemble D Assimilion wihou Perurbed Observions. Monhly Weher Review, Vol. 3, No. 7, 93 94, 3 Appendix A. Conrol o he coninuous-ime processes A.. Clssicl ormulion. Lemm A.. V cn be conrolled ω-wise loclly in ime. Precisely, i holds 98 sup V e A V C e A sup e As dn s [, ] [, ] or consns A = A nd C = CQ,,, nd mringle N. Proo. Firs observe he ollowing: since W i,...,m nd V i,...,m re independen sndrd Brownin moions, he qudric vriion or ech i =,..., M reds 99 W i w = M = V i v. By he Iô ormul we hus obin dv = d i x = rqd Observe now h nd hus i i x, i d dw i d w i x, Q i x, E G C i x, i dv E G C g i d. r E G C G E x, i i x, x = = M i d v ḡ d x, i x.

21 Furher i holds 3 hus 4 i x, = = E G C g i ḡ r i r E G C G E dv = i i x g ḡ C G E = E G C. F x, i x d dw i d w i x, Q i x, E G C rqd E G C d. hereore wih he mringle N wih 5 dn = we esime i x, Q i dw F i dv E G C 6 dv L V d rqd dn. Applying he Iô produc rule yields 7 d e L V e L rqd dn nd hereore i holds 8 V e A V rq L e L d v i dv e L s dn s. Noe h e L s dn s is coninuous mringle nd hus loclly bounded in ime. Hence we cn conrol V ω-wise loclly in, since or ny > we ge 9 sup V e L V rq e L L e sup e L s dn s. [, ] L [, ]

22 HERESA LANGE, WILHELM SANNA Remrk A.. Since one cn esime by boundedness o g d d N 4 Q 4M g C V V, one cn urher show by using Equion 8 nd Gronwll rgumen h sup E [ V ] <. [, ] A.. Modiied ormulion. Lemm A.3. V is bounded or ll [, ], i.e. V v := el V rq L e L. Proo. I holds d d V = = = i i x, i i i i QP x x, x, E G C g i ḡ x, i x rq r E G C G E i L V rq x, i x rq which yields he clim er pplying Gronwll rgumen. E G C F Recll he evoluion equion o P 3 d d P = Q Furher le λ min i i i x E G C G E. i x denoe he smlles eigenvlue o P or ech [, ].

23 Lemm A.4. I λ min is bounded wy rom, hen here exiss consn λ > bounded wy rom such h 4 λ min λ [, ]. Noe h, consequenly, P is bounded rom bove by λ. Proo. Firs o ll observe h or ny v R d i holds 5 P v, v = i x, v. 3 We proceed s in he proo o Lemm 6 in [6]. Consider digonlizion o P, i.e. orhogonl mrices U nd digonl mrices Λ such h 6 P = U Λ U. hen by Equion 3 7 d d Λ = dig U dig U QU i i x dig U i E G C G E i x U. U Noe h or ny mrix A R d d 8 dig U AU = ll e l U AU e l nd U e l = wih el he sndrd orhonorml bsis in R d. Le v l = U e l, hen v l = nd we esime 9 i i dig U x U = i i x, v l x, v l Lip V P v l, v l. i x, v l ll i x, v l

24 4 HERESA LANGE, WILHELM SANNA Furher dig U E G C G E U = C G ll E v l, G E v l C G E v l C g i g x i x, v l C g Lip V P v l, v l. hus by Young s inequliy we obin or some ǫ > d d Λ ll Lip v P v l, v l λ min Q g Lip C v P v l, v l λ min Q Lip v ǫ ǫ g Lip C v P v l, v l. Choose ǫ > smll enough such h q ǫ := λ min Q Lip v ǫ >. Now since P v l, v l = Λ ll, i holds or l such h λ min wih 3 α ǫ := ǫ g Lip C v = Λ ll nd h 4 d d λmin q ǫ α ǫ λ min, hus by Gronwll rgumen here exiss λ,ǫ > such h i λ min > i holds 5 λ min λ,ǫ. Appendix B. Conrol o he discree-ime processes B.. Clssicl ormulion. By Algorihm 3. we obin or ny k

25 5 6 V i, k = hus or 7 = V k := i, k x k i, k x k h i, k i, k x k, Q i W x k, i, k x k k w k h i, k k h i, k x k, Q i W k w k Q W i k w k. i, k x k, W k := W i k w k his gives by he Cuchy-Schwrz-inequliy 8 V k hl 5h Lip V k 3 Q W k which yields wih he esime 68 9 K k 4 g C M hl 5h Lip V k 3 : K K hvk Q W k. Q By king expecion in Equion 6, we urhermore esime 3 E [ Vk] hl 4h Lip E [V k ] Q E [W k ] by independence o i, k holds nd 3 W i k w k N nd hus E [W k ] = h, i.e. i W k. Similr o he coninuous cse i, M hid 3 E [ V k] hl 4h Lip E [V k ] nd 33 Q h E [ K k ] 4 g C M hl 4h Lip E [V k ] =: K 3 K4 he [Vk ] Q h. W k Q h

26 6 HERESA LANGE, WILHELM SANNA hus E [ K k ] s well s E [ K k 4] re loclly bounded in k ccording o he ollowing lemm: Lemm B.. I E [V ] < nd E [ V ] <, hen irs nd second momen o V k re loclly bounded in k, i.e. i or h here exis consns C, C, C 3, nd C 4, ll independen o h, such h 34 E [V k ] ec E [V ] C s well s 35 E [ V k ] C 3 exp C 4. Proo. Using he Cuchy-Schwrz inequliy s well s 9 yields wih Algorihm 3. he ollowing esime 36 Vk V k = i, k x k i, k x k = i, k x i, k k x i, k, k x i, k k x k h hl 5h 8h hm Lip g K K h Vk wih h 8h hm 37 V k := nd he mringle 38 N k := d = i, k Q g K W k K k C V k N k Ṽ i k v k x k h i, k i k, Q W k w k i, k x k h i, k i, k hkk g k ḡ Ṽ K k C i k v k k k k k i, k i, k x k h i, k k, Q dw i s k, x k h i, k i, k hkk g k ḡ. K k C dv i s k,

27 7 hus by independence o V k, W k nd Vk E [W k ] = h = E [V k ] or ech k we obin or ech k nd since 39 E [ V k] hc h E [V k] hc h where 4 C h := L 5h Lip 4 C h := Q h 8h hm hereore by Gronwll rgumen 8 hm 4 E [Vk ] hc h k E [V k ] g K j= g K h K h C K3 K4 h, C K3 h. hc h j hc h nd since h =, we chieve or h he inl esime L 43 E [V k ] e C E [V ] C or ll k L. hus E [V k] is bounded or ll k L since E [V ] <. Now consider he resul o pplying Gronwll rgumen o Equion 36: inroduce C h := L 5h 8 hm Lip g K K h, C h := Q 8h hm h g K, hen 46 Vk h C h k k V h C h k j C hw j K j C V j N j. j= By he Cuchy-Schwrz inequliy we obin 47 Vk 4 h C h k k V 4 h C h k j C hw j j= k 6 h C h k j Kj C k V j 6 h C h k j Nj j= j= =: I II III IV.

28 8 HERESA LANGE, WILHELM SANNA Agin we esime or h 48 h C h k e C which gives 49 E [I] e C E [ V ]. Since W i k N, hid his yields by 99 [ i 4 5 E W ] k w k = 3 M h nd hus E [ W k ] 3h, hereore we obin 5 E [II] he C C. For III we use h lso E [ V k ] 3h nd by 9 5 K j 4 K K h Vj Q 4 W j. hus by independence o K j nd V j or ny j his yields 53 E [III] 96h C 4 k [ V e C ] K K h E j 3h j= Q 4 Now on IV : recll h Ṽ i i W k nd k re i.i.d. sequences independen o ech oher. hen by independence o Brownin incremens, he Iô isomery s well s 9 i holds 54 k E N j k = j= = k j= E [ j [ j E E [ N j ] j= Q i, j x j h i, j j {s [j, j ]}, dw s i ] C K j i, j x j h i, j j hk j g i, j ḡ j. ] {s [j, j ]}, dv s i

29 k j= k j= h h C Q Q [ ] hl 4h Lip E V j C [ hl 4h Lip E Kj ] Vj 4h g M E [ K j 4] K K h hl 4h Lip 8h g M E hl 4h Lip C K h 48h 4 C g K Q 4 M. hus by he Cuchy-Schwrz inequliy we obin n esime o he orm 55 E [ k Vk ] Ĉh [ V ] hĉh E j j= which or h nd by Gronwll rgumen leds o 56 E [ V k ] Ĉexp Ĉ 9 [ V ] j nd his concludes he proo. B.. Modiied ormulion. Lemm B.. I or he smlles eigenvlue o P 57 λ min P >, hen here exiss consn p > such h 58 Pk p nd consns v, h such h, v, 59 V k v, i holds > depending on λ min P bu independen o nd V k v, see 73 nd 74 or ll k L. Proo. Firs o ll noe h Pk = λ min Pk where λ min Pk, he smlles eigenvlue o Pk, sisies 6 λ min Pk = in P k v, v. v, v =

30 3 HERESA LANGE, WILHELM SANNA hus le v R d wih v =. By he ollowing recursive ormul 6 P k = i, k x i, k k x k = P k h h i, k x k i, k x k i, k x k i, k x k hq i, k k Q P k i, k i, k x k k Q P k i, k x k, we obin by he Young s inequliy or some ǫ > 6 P kv, v Pk i, v, v h k x k, v i, k x k, v h Qv, v Pk v, v h Lip Vk P k v, v h Qv, v h ǫ P k v, v h λ min Q ǫ Lip V k. By he speciic srucure o he Klmn gin mrix we obin he ollowing recursive orm or he nlyzed ensemble covrince mrix 63 P k = = P k h h 4 i, k x i, k k x k i, k x i, k g k ḡ k K k K k g i, k ḡ k g i, k ḡ k K k

31 hus 64 P k v, v P kv, v h P kv, v h P k v, v h ǫ 3 i, k x k, v i, K k g k ḡ k, v i, Kk g k ḡ k, v P k v, v hǫ 6 g 4 C M V k. Furher we obin wih Algorihm V k = i, k x k hl 4h Lip h Lip Q Pk V k hrq h Pk 4 r Q nd 66 V k = i, k x k h 6 g 4 C M Now ssume h here exiss consn D > such h 67 λ min P k Dh. hen 68 V k exp hc h, D V k hc D where 69 V k. C h, D := h 6 g 4 C M L 4h Lip Lip Q, D 7 C D := rq r Q 4D. We mke he nsz k 7 Vk exp hc h, Dk l hc D. l=

32 3 HERESA LANGE, WILHELM SANNA hen k 7 Vk exp hc h, Dk l hc D l= nd or h 73 Vk C D e C,D s ds =: vd,., Using 65 in combinion wih Assumpion 67 nd he uniorm bound on Vk, we lso obin he exisence o consn v, D, such h 74 V k v, D,. his yields wih Equions 6 nd P k v, v h Pk v, v ǫ h h ǫ λ min Q ǫ Lipv, D, 6 g 4 C M v, D, Choose ǫ > such h or some ĥ > 76 h ǫ λmin Q ǫ Lip v, D, 6 g 4 C M v, D, λmin Q or ll h < ĥ, hen 77 P k v, v h Pk ǫ v, v h λmin Q h λmin Q Dh. ǫ D Observe h 78 lim h h ǫ λmin Q D = λmin Q D >, hus here exiss n h > such h or ll h < h i holds 79 h λmin Q ǫ D = λmin Q D nd P kv, v Dh. Since v ws chosen rbirrily we my hus conclude 8 λ min P k Dh. In ol his yields h i 8 λ min P Dh, hen 8 λ min P k Dh.

33 or ll k L nd h < h wih h > smll enough. Furher i holds 83 P k v, v h k P ǫ v, v λmin Q k h k l h. ǫ l= Observe h or some h < ǫ here exiss β > such h 84 h ǫ exp ǫ β h or ll h < h. hus 85 P k v, v exp ǫ β hk P v, v λmin Q exp ǫ β exp ǫ β P v, v. P v, v λmin Q kh exp k l= 33 exp ǫ β k lh h hereore i h is smll enough nd λ min P >, hen 86 λ min Pk exp ǫ β λ min P > ǫ β kh s ds nd hence here exiss consn p > such h 87 Pk p or ll k L. Insiu ür Mhemik, echnische Universiä Berlin, Srße des 7. Juni 36, D-63 Berlin, nd, Bernsein Cener or Compuionl Neuroscience, Philippsr. 3, D-5 Berlin, Germny E-mil ddress: lnge@mh.u-berlin.de, snn@mh.u-berlin.de