An iterative ensemble Kalman smoother
|
|
- Matilda Phillips
- 5 years ago
- Views:
Transcription
1 An ieraive ensemble Kalman smooher Marc Bocque 1,2, Pavel Sakov 3 1 Universié Paris-Es, CEREA, join lab École des Pons ParisTech and EdF R&D, France 2 INRIA, Paris-Rocquencour Research cener, France 3 Bureau of Meeorolog, Ausralia (bocque@cerea.enpc.fr) M. Bocque 6 h WMO Smposium on Daa Assimilaion, College Park, Marland, USA, 7-11 Ocober / 16
2 Conex Ensemble variaional mehods New mehods called ensemble variaional mehods ha mix variaional and ensemble approaches (see Lorenc, 2013 for an almos perfec definiion): Hbrid mehods, 4D-Var-Ben, 4D-En-Var, Ensemble of daa assimilaion (EDA) and IEnKF/IEnKS. The IEnKF/IEnKS differ from he oher ones in ha he are more naural (simple?), regardless of he numerical cos. Lorenc A Recommended nomenclaure for EnVar daa assimilaion mehods. In Research Aciviies in Amospheric and Oceanic Modelling, WGNE. M. Bocque 6 h WMO Smposium on Daa Assimilaion, College Park, Marland, USA, 7-11 Ocober / 16
3 Conex The IEnKS: a he crossroad beween he EnKF and 4D-Var The IEnKS follows he scheme of he EnKF: Analsis in ensemble space Poserior ensemble generaion Ensemble forecas Excep ha The analsis in ensemble space is variaional [e.g. Zupanski, 2005] over a finie ime windows. I ma require several ieraions in srongl nonlinear condiions [Gu & Oliver, 2007; Sakov e al., 2012; Bocque and Sakov, ]. The gradien of he 4D cos funcion is compued wih he ensemble [Gu & Oliver, 2007;Liu e al., 2008]: no need for he angen linear/adjoin. I generalises he ieraive exended Kalman filer/smooher [Wishner e al., 1969; Jazwinski, 1970;Bell, 1994] o ensemble mehods. I is a unified/sraighforward scheme (no hbridizaion so o speak). M. Bocque 6 h WMO Smposium on Daa Assimilaion, College Park, Marland, USA, 7-11 Ocober / 16
4 The ieraive ensemble Kalman smooher The IEnKS: he ccling L: lengh of he daa assimilaion window, S: shif of he daa assimilaion window in beween wo updaes. L 1 L S 0 1 L 3 L 3 L 2 L 2 L 1 L L 1 L L+1 S L+1 L+1 L+2 L+2 L M. Bocque 6 h WMO Smposium on Daa Assimilaion, College Park, Marland, USA, 7-11 Ocober / 16
5 The ieraive ensemble Kalman smooher The IEnKS: a variaional sandpoin Analsis IEnKS cos funcion in sae space p(x 0 L ) exp( J(x 0 )): L 1 J(x 0 )= 2 ( k H k M k 0 (x 0 )) T β k R 1 k ( k H k M k 0 (x 0 )) k= (x 0 x 0 )P 1 0 (x 0 x 0 ). (1) {β 0,β 1,...,β L } weigh he observaions impac wihin he window. Reduced scheme in ensemble space, x 0 =x 0 +A 0 w, where A 0 is he ensemble anomal marix: J(w)=J(x 0 +A 0 w). (2) IEnKS cos funcion in ensemble space [Hun e al., 2007; Bocque and Sakov, 2012]: J(w)= 1 L 2 ( k H k M k 0 (x 0 +A 0 w)) T β k R 1 k ( k H k M k 0 (x 0 +A 0 w)) k= (N 1)wT w. (3) M. Bocque 6 h WMO Smposium on Daa Assimilaion, College Park, Marland, USA, 7-11 Ocober / 16
6 The ieraive ensemble Kalman smooher The IEnKS: minimisaion scheme As a variaional reduced mehod, one can use Gauss-Newon [Sakov e al., 2012], Levenberg-Marquard [Bocque and Sakov, 2012; Chen and Oliver, 2013], quasi-newon, ec., minimisaion schemes. Gauss-Newon scheme (he Hessian is approximae): w (p+1) =w (p) x (p) 0 =x (0) 0 +A 0 w (p), J L (p) = k=1 H 1 (p) J (p) (w (p) ), Y T k,(p) β kr 1 k L H (p) =(N 1)I N + Yk,(p) T β kr 1 L Y (p), k=1 ( k H k M k 0 (x (p) 0 ) )+(N 1)w (p), Y k,(p) =[H k M k 0 ] A x (p) 0. (4) 0 One soluion o compue he 4D sensiiviies: he bundle scheme. I simpl mimics he acion of he angen linear b finie difference: Y k,(p) 1 ( ) ( ) ε H k M k 0 x (p) 1 T + εa 0 I N 11T. (5) N M. Bocque 6 h WMO Smposium on Daa Assimilaion, College Park, Marland, USA, 7-11 Ocober / 16
7 The ieraive ensemble Kalman smooher The IEnKS: ensemble updae and he forecas sep Generae an updaed ensemble from he previous analsis: E 0 =x 0 1T + N 1A 0 H 1/2 U where U1=1. (6) Jus propagae he updaed ensemble from 0 o S : In he quasi-saic case: S =1. E S = M S 0 (E 0 ). (7) M. Bocque 6 h WMO Smposium on Daa Assimilaion, College Park, Marland, USA, 7-11 Ocober / 16
8 The ieraive ensemble Kalman smooher IEnKS: single vs muliple daa assimilaion L 1 L β0 2 S β L 3 βl 1 L 3 L 2 βl L 2 βl 1 L 1 L 1 L βl L L+1 S β0 2 βl 1 L+1 L+1 L+2 βl L+2 L SDA IEnKS: The observaion vecor are assimilaed once and for all. Exac scheme. MDA IEnKS: The observaion vecor are assimilaed several imes and poundered wih weighs β k wihin he window. Exac scheme in he linear/gaussian limi. More sable for long windows han he SDA scheme. M. Bocque 6 h WMO Smposium on Daa Assimilaion, College Park, Marland, USA, 7-11 Ocober / 16
9 Numerical experimens Applicaion o he Lorenz 95 model Seup: Lorenz 95, M =40, N =20, =0.05, R=I. Lin-IEnKS IEnKS wih a single ieraion (linearised IEnKS). Comparison of EnKF-N, MDA IEnKS-N, MDA Lin-IEnKS-N, EnKS-N, wih L = Re-analsis rmse EnKF-N EnKS-N Lin-IEnKS-N IEnKS-N Lag (number of ccles) M. Bocque 6 h WMO Smposium on Daa Assimilaion, College Park, Marland, USA, 7-11 Ocober / 16
10 Numerical experimens Applicaion o he Lorenz 95 model Seup: Lorenz 95, M =40, N =20, =0.20, R=I. Comparison of EnKF-N, IEnKF-N, MDA IEnKS-N, ETKS-N, wih L=10. Lin-IEnKS-N underperforms (because of he mild nonlineari) EnKF-N IEnKF-N EnKS-N Lin-IEnKS-N IEnKS-N Re-analsis rmse Lag (number of ccles) M. Bocque 6 h WMO Smposium on Daa Assimilaion, College Park, Marland, USA, 7-11 Ocober / 16
11 Localisaion IEnKF/IEnKS: Localisaion Localisaion in an EnVar conex is non-rivial because localisaion and he evoluion model do no commue: ) M k 0 (C B 0 )M T k 0 (M C k 0 B 0 M T k 0. (8) Local analsis of IEnKF, and comparison wih a non-scalable opimal approach Analsis rmse CL IEnKF (bundle, op. infl., c=10, non-scalable) N=10 IEnKF-N (bundle) N=20 LA IEnKF-N (bundle, c=10, ε N =1) N= Time inerval beween updaes M. Bocque 6 h WMO Smposium on Daa Assimilaion, College Park, Marland, USA, 7-11 Ocober / 16
12 Localisaion IEnKF/IEnKS: Localisaion Local analsis of IEnKS, and comparison wih a non-scalable opimal approach (filering performance) Analsis RMSE SDA IEnKS-N filering N=20 MDA IEnKS-N filering N=20 LA EnKS-N filering N=10 l=10 LA MDA IEnKS-N filering N=10 l=10 NSCL SDA IEnKS op.infl. filering N=10 l=10 LA SDA IEnKS-N filering N=10 l=10 EnKS-N filering N= DAW lengh L M. Bocque 6 h WMO Smposium on Daa Assimilaion, College Park, Marland, USA, 7-11 Ocober / 16
13 Localisaion IEnKF/IEnKS: Localisaion Localisaion of he IEnKF works fine on a forced 2D-urbulence model ( ) Forced 2D urbulence model 256x256 Local IEnKF, N=16, pariall observed grid (1/16) Analsis roo mean square error # ieraions IEnKF filering rmse IEnKF smoohing rmse Localisaion lengh True vorici q, =25 0 Analsed vorici q, =25 0 Vorici error q, = M. Bocque 6 h WMO Smposium on Daa Assimilaion, College Park, Marland, USA, 7-11 Ocober / 16
14 Parameer esimaion IEnKS: parameer esimaion The augmened sae formalism is convenien for he IEnKS, and offers an eas implemenaion of echnicall challenging daa assimilaion problems. Lorenz 95 wih join esimaion of he forcing parameer F (41 variables): RMSEs. Mehod / F profile Sinusoidal Sep-wise EnKF-N EnKS-N L= D-Var L= MDA IEnKS-N L= Rerospecive analsis of parameer F 8,8 8,6 8,4 8,2 8 7,8 7,6 EnKF-N EnKS-N L=50 4D-Var L=50 MDA IEnKS-N L=50 Truh Rerospecive analsis of parameer F 9 8,5 8 7,5 EnKF-N L=50 EnKS-N L=50 4D-Var L=50 MDA IEnKS-N L=50 Truh 7, Time Time M. Bocque 6 h WMO Smposium on Daa Assimilaion, College Park, Marland, USA, 7-11 Ocober / 16
15 Conclusions Conclusions The ieraive ensemble Kalman smooher (IEnKS) is a wa o eleganl combine he advanages of variaional and ensemble Kalman filering. The IEnKS is a generalisaion of he ieraive ensemble Kalman filer (IEnKF). I is an EnVar mehod. I is flow-dependen, angen linear and adjoin free. Though based on Gaussian assumpions, i can offer (much) beer rerospecive analsis han sandard Kalman smoohers in weak and mildl nonlinear condiions. Much more performing han oher Kalman filer/smoohers in srongl non-linear condiions. Properl defined muliple assimilaion of observaions can sabilise he smooher over ver large daa assimilaion window (20 das of Lorenz 95). More generall he IEnKF/IEnKS have he poenial o ouperform boh he EnKF and he 4D-Var (IEnKS alread does so wih o-models). Localisaion remains a fundamenal issue in his conex (work in progress). Weak-consrain formalism no reall explored e (work in progress). M. Bocque 6 h WMO Smposium on Daa Assimilaion, College Park, Marland, USA, 7-11 Ocober / 16
16 References References Bocque, M., Sakov, P., Combining inflaion-free and ieraive ensemble Kalman filers for srongl nonlinear ssems. Nonlin. Processes Geophs. 19, Bocque, M., Sakov, P., An ieraive ensemble Kalman smooher. Q. J. R. Meeorol. Soc., in press, doi: /qj Bocque, M., Sakov, P., Join sae and parameer esimaion wih an ieraive ensemble Kalman smooher. Nonlin. Processes Geophs., in press. Gu, Y., Oliver, D. S., An ieraive ensemble Kalman filer for muliphase fluid flow daa assimilaion. SPE Journal 12, Hun, B. R., Koselich, E. J., Szunogh, I., Efficien daa assimilaion for spaioemporal chaos: A local ensemble ransform Kalman filer. Phsica D 230, Sakov, P., Oliver, D., Berino, L., An ieraive EnKF for srongl nonlinear ssems. Mon. Wea. Rev. 140, Yang, S.-C., E. Kalna, and B. Hun, Handling nonlineari and non-gaussiani in he Ensemble Kalman Filer: Experimens wih he hree-variable Lorenz model. Mon. Wea. Rev., 140, M. Bocque 6 h WMO Smposium on Daa Assimilaion, College Park, Marland, USA, 7-11 Ocober / 16
Joint state and parameter estimation with an iterative ensemble Kalman smoother
Join sae and parameer esimaion wih an ieraive ensemble Kalman smooher Marc Bocque 1,2, Pavel Sakov 3 1 Universié Paris-Es, CEREA, join lab École des Pons ParisTech and EdF R&D, France 2 INRIA, Paris-Rocquencour
More informationAn iterative ensemble Kalman smoother
An ieraive ensemble Kalman smooher Marc Bocque 1,2 Pavel Sakov 3 1 Universié Paris-Es, CEREA, join lab École des Pons ParisTech and EdF R&D, France 2 INRIA, Paris-Rocquencour Research cener, France 3 Bureau
More informationAndrew C Lorenc 07/20/14. Met Oce Prepared for DAOS meeting, August 2014, Montreal.
Ensemble Forecas Sensiiviy o Observaions EFSO) and Flow-Following Localisaion in 4DEnVar Andrew C Lorenc 07/20/14 Me Oce andrew.lorenc@meoce.gov.uk Prepared for DAOS meeing, Augus 2014, Monreal. Inroducion
More informationFinite-size ensemble Kalman filters (EnKF-N)
Finite-size ensemble Kalman filters (EnKF-N) Marc Bocquet (1,2), Pavel Sakov (3,4) (1) Université Paris-Est, CEREA, joint lab École des Ponts ParisTech and EdF R&D, France (2) INRIA, Paris-Rocquencourt
More informationExtended ensemble Kalman filters for high-dimensional hierarchical state-space models
Exended ensemble Kalman filers for high-dimensional hierarchical sae-space models Jonahan Sroud McDonough School of Business Georgeown Universiy Join work wih Mahias Kazfuss (Texas A&M) and Chris Wikle
More informationData assimilation for local rainfall near Tokyo on 18 July 2013 using EnVAR with observation space localization
Daa assimilaion for local rainfall near Tokyo on 18 July 2013 using EnVAR wih observaion space localizaion *1 Sho Yokoa, 1 Masaru Kunii, 1 Kazumasa Aonashi, 1 Seiji Origuchi, 2,1 Le Duc, 1 Takuya Kawabaa,
More informationRecent Developments In Evolutionary Data Assimilation And Model Uncertainty Estimation For Hydrologic Forecasting Hamid Moradkhani
Feb 6-8, 208 Recen Developmens In Evoluionary Daa Assimilaion And Model Uncerainy Esimaion For Hydrologic Forecasing Hamid Moradkhani Cener for Complex Hydrosysems Research Deparmen of Civil, Consrucion
More informationMaximum Likelihood Parameter Estimation in State-Space Models
Maximum Likelihood Parameer Esimaion in Sae-Space Models Arnaud Douce Deparmen of Saisics, Oxford Universiy Universiy College London 4 h Ocober 212 A. Douce (UCL Maserclass Oc. 212 4 h Ocober 212 1 / 32
More informationLinear Gaussian State Space Models
Linear Gaussian Sae Space Models Srucural Time Series Models Level and Trend Models Basic Srucural Model (BSM Dynamic Linear Models Sae Space Model Represenaion Level, Trend, and Seasonal Models Time Varying
More informationSmoothing. Backward smoother: At any give T, replace the observation yt by a combination of observations at & before T
Smoohing Consan process Separae signal & noise Smooh he daa: Backward smooher: A an give, replace he observaion b a combinaion of observaions a & before Simple smooher : replace he curren observaion wih
More informationNotes on Kalman Filtering
Noes on Kalman Filering Brian Borchers and Rick Aser November 7, Inroducion Daa Assimilaion is he problem of merging model predicions wih acual measuremens of a sysem o produce an opimal esimae of he curren
More informationFiltering Turbulent Signals Using Gaussian and non-gaussian Filters with Model Error
Filering Turbulen Signals Using Gaussian and non-gaussian Filers wih Model Error June 3, 3 Nan Chen Cener for Amosphere Ocean Science (CAOS) Couran Insiue of Sciences New York Universiy / I. Ouline Use
More informationL07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS. NA568 Mobile Robotics: Methods & Algorithms
L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS NA568 Mobile Roboics: Mehods & Algorihms Today s Topic Quick review on (Linear) Kalman Filer Kalman Filering for Non-Linear Sysems Exended Kalman Filer (EKF)
More informationAn recursive analytical technique to estimate time dependent physical parameters in the presence of noise processes
WHAT IS A KALMAN FILTER An recursive analyical echnique o esimae ime dependen physical parameers in he presence of noise processes Example of a ime and frequency applicaion: Offse beween wo clocks PREDICTORS,
More informationAugmented Reality II - Kalman Filters - Gudrun Klinker May 25, 2004
Augmened Realiy II Kalman Filers Gudrun Klinker May 25, 2004 Ouline Moivaion Discree Kalman Filer Modeled Process Compuing Model Parameers Algorihm Exended Kalman Filer Kalman Filer for Sensor Fusion Lieraure
More informationMulti-scale 2D acoustic full waveform inversion with high frequency impulsive source
Muli-scale D acousic full waveform inversion wih high frequency impulsive source Vladimir N Zubov*, Universiy of Calgary, Calgary AB vzubov@ucalgaryca and Michael P Lamoureux, Universiy of Calgary, Calgary
More informationMonitoring and data filtering II. Dynamic Linear Models
Ouline Monioring and daa filering II. Dynamic Linear Models (Wes and Harrison, chaper 2 Updaing equaions: Kalman Filer Discoun facor as an aid o choose W Incorporae exernal informaion: Inervenion General
More informationReferences are appeared in the last slide. Last update: (1393/08/19)
SYSEM IDEIFICAIO Ali Karimpour Associae Professor Ferdowsi Universi of Mashhad References are appeared in he las slide. Las updae: 0..204 393/08/9 Lecure 5 lecure 5 Parameer Esimaion Mehods opics o be
More informationTom Heskes and Onno Zoeter. Presented by Mark Buller
Tom Heskes and Onno Zoeer Presened by Mark Buller Dynamic Bayesian Neworks Direced graphical models of sochasic processes Represen hidden and observed variables wih differen dependencies Generalize Hidden
More information20. Applications of the Genetic-Drift Model
0. Applicaions of he Geneic-Drif Model 1) Deermining he probabiliy of forming any paricular combinaion of genoypes in he nex generaion: Example: If he parenal allele frequencies are p 0 = 0.35 and q 0
More informationEcon107 Applied Econometrics Topic 7: Multicollinearity (Studenmund, Chapter 8)
I. Definiions and Problems A. Perfec Mulicollineariy Econ7 Applied Economerics Topic 7: Mulicollineariy (Sudenmund, Chaper 8) Definiion: Perfec mulicollineariy exiss in a following K-variable regression
More informationComputer Vision. Motion Extraction
Comuer Moion Eracion Comuer Alicaions of moion eracion Change / sho cu deecion Surveillance / raffic monioring Moion caure / gesure analsis HC image sabilisaion Moion comensaion e.g. medical roboics Feaure
More informationMarginalized Particle Filtering Framework for Tuning of Ensemble Filters
NOVEMBER 2011 Š M Í D L A N D H O F M A N 3589 Marginalized Paricle Filering Framework for Tuning of Ensemble Filers VÁCLAV ŠMÍDL AND RADEK HOFMAN Insiue of Informaion Theory and Auomaion, Prague, Czech
More informationA variational radial basis function approximation for diffusion processes.
A variaional radial basis funcion approximaion for diffusion processes. Michail D. Vreas, Dan Cornford and Yuan Shen {vreasm, d.cornford, y.shen}@ason.ac.uk Ason Universiy, Birmingham, UK hp://www.ncrg.ason.ac.uk
More informationKriging Models Predicting Atrazine Concentrations in Surface Water Draining Agricultural Watersheds
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 Kriging Models Predicing Arazine Concenraions in Surface Waer Draining Agriculural Waersheds Paul L. Mosquin, Jeremy Aldworh, Wenlin Chen Supplemenal Maerial Number
More informationData Assimilation. Alan O Neill National Centre for Earth Observation & University of Reading
Daa Assimilaion Alan O Neill Naional Cenre for Earh Observaion & Universiy of Reading Conens Moivaion Univariae scalar) daa assimilaion Mulivariae vecor) daa assimilaion Opimal Inerpoleion BLUE) 3d-Variaional
More informationELE 538B: Large-Scale Optimization for Data Science. Quasi-Newton methods. Yuxin Chen Princeton University, Spring 2018
ELE 538B: Large-Scale Opimizaion for Daa Science Quasi-Newon mehods Yuxin Chen Princeon Universiy, Spring 208 00 op ff(x (x)(k)) f p 2 L µ f 05 k f (xk ) k f (xk ) =) f op ieraions converges in only 5
More informationCS 4495 Computer Vision Tracking 1- Kalman,Gaussian
CS 4495 Compuer Vision A. Bobick CS 4495 Compuer Vision - KalmanGaussian Aaron Bobick School of Ineracive Compuing CS 4495 Compuer Vision A. Bobick Adminisrivia S5 will be ou his Thurs Due Sun Nov h :55pm
More informationRobust estimation based on the first- and third-moment restrictions of the power transformation model
h Inernaional Congress on Modelling and Simulaion, Adelaide, Ausralia, 6 December 3 www.mssanz.org.au/modsim3 Robus esimaion based on he firs- and hird-momen resricions of he power ransformaion Nawaa,
More informationProbabilistic Robotics
Probabilisic Roboics Bayes Filer Implemenaions Gaussian filers Bayes Filer Reminder Predicion bel p u bel d Correcion bel η p z bel Gaussians : ~ π e p N p - Univariae / / : ~ μ μ μ e p Ν p d π Mulivariae
More informationAn introduction to the theory of SDDP algorithm
An inroducion o he heory of SDDP algorihm V. Leclère (ENPC) Augus 1, 2014 V. Leclère Inroducion o SDDP Augus 1, 2014 1 / 21 Inroducion Large scale sochasic problem are hard o solve. Two ways of aacking
More informationState-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter
Sae-Space Models Iniializaion, Esimaion and Smoohing of he Kalman Filer Iniializaion of he Kalman Filer The Kalman filer shows how o updae pas predicors and he corresponding predicion error variances when
More informationCourse Notes for EE227C (Spring 2018): Convex Optimization and Approximation
Course Noes for EE7C Spring 018: Convex Opimizaion and Approximaion Insrucor: Moriz Hard Email: hard+ee7c@berkeley.edu Graduae Insrucor: Max Simchowiz Email: msimchow+ee7c@berkeley.edu Ocober 15, 018 3
More informationLecture 20: Riccati Equations and Least Squares Feedback Control
34-5 LINEAR SYSTEMS Lecure : Riccai Equaions and Leas Squares Feedback Conrol 5.6.4 Sae Feedback via Riccai Equaions A recursive approach in generaing he marix-valued funcion W ( ) equaion for i for he
More informationAPPENDIX AVAILABLE ON THE HEI WEB SITE
APPENDIX AVAILABLE ON HE HEI WEB SIE Research Repor 83 Developmen of Saisical Mehods for Mulipolluan Research Par. Developmen of Enhanced Saisical Mehods for Assessing Healh Effecs Associaed wih an Unknown
More informationGMM - Generalized Method of Moments
GMM - Generalized Mehod of Momens Conens GMM esimaion, shor inroducion 2 GMM inuiion: Maching momens 2 3 General overview of GMM esimaion. 3 3. Weighing marix...........................................
More informationLinear Dynamic Models
Linear Dnamic Models and Forecasing Reference aricle: Ineracions beween he muliplier analsis and he principle of acceleraion Ouline. The sae space ssem as an approach o working wih ssems of difference
More informationSequential Importance Resampling (SIR) Particle Filter
Paricle Filers++ Pieer Abbeel UC Berkeley EECS Many slides adaped from Thrun, Burgard and Fox, Probabilisic Roboics 1. Algorihm paricle_filer( S -1, u, z ): 2. Sequenial Imporance Resampling (SIR) Paricle
More informationarxiv: v1 [math.na] 26 Sep 2017
Ineracing paricle filers for simulaneous sae and parameer esimaion Angwenyi David, Insiu für ahemaik Universiä Posdam Email: kipkoej@gmail.com Jana de Wiljes, Insiu für ahemaik Universiä Posdam Email:
More informationAn iterative ensemble Kalman smoother
Quarterly Journalof the RoyalMeteorologicalSociety Q. J. R. Meteorol. Soc. 140: 1521 1535, July 2014 A DOI:10.1002/qj.2236 An iterative ensemble Kalman smoother M. Bocquet a,b * and P. Saov c a Université
More informationAn EM algorithm for maximum likelihood estimation given corrupted observations. E. E. Holmes, National Marine Fisheries Service
An M algorihm maimum likelihood esimaion given corruped observaions... Holmes Naional Marine Fisheries Service Inroducion M algorihms e likelihood esimaion o cases wih hidden saes such as when observaions
More informationSEIF, EnKF, EKF SLAM. Pieter Abbeel UC Berkeley EECS
SEIF, EnKF, EKF SLAM Pieer Abbeel UC Berkeley EECS Informaion Filer From an analyical poin of view == Kalman filer Difference: keep rack of he inverse covariance raher han he covariance marix [maer of
More informationEcon Autocorrelation. Sanjaya DeSilva
Econ 39 - Auocorrelaion Sanjaya DeSilva Ocober 3, 008 1 Definiion Auocorrelaion (or serial correlaion) occurs when he error erm of one observaion is correlaed wih he error erm of any oher observaion. This
More informationAspects of the Ensemble Kalman Filter. David Livings
Aspecs of he Ensemble Kalman Filer David Livings Ocober 3, 25 Absrac The Ensemble Kalman Filer (EnKF) is a daa assimilaion mehod designed o provide esimaes of he sae of a sysem by blending informaion from
More informationUnderstanding the asymptotic behaviour of empirical Bayes methods
Undersanding he asympoic behaviour of empirical Bayes mehods Boond Szabo, Aad van der Vaar and Harry van Zanen EURANDOM, 11.10.2011. Conens 2/20 Moivaion Nonparameric Bayesian saisics Signal in Whie noise
More informationLecture 10 - Model Identification
Lecure - odel Idenificaion Wha is ssem idenificaion? Direc impulse response idenificaion Linear regression Regularizaion Parameric model ID nonlinear LS Conrol Engineering - Wha is Ssem Idenificaion? Experimen
More informationNavneet Saini, Mayank Goyal, Vishal Bansal (2013); Term Project AML310; Indian Institute of Technology Delhi
Creep in Viscoelasic Subsances Numerical mehods o calculae he coefficiens of he Prony equaion using creep es daa and Herediary Inegrals Mehod Navnee Saini, Mayank Goyal, Vishal Bansal (23); Term Projec
More informationParticle Filtering and Smoothing Methods
Paricle Filering and Smoohing Mehods Arnaud Douce Deparmen of Saisics, Oxford Universiy Universiy College London 3 rd Ocober 2012 A. Douce (UCL Maserclass Oc. 2012) 3 rd Ocober 2012 1 / 46 Sae-Space Models
More informationVectorautoregressive Model and Cointegration Analysis. Time Series Analysis Dr. Sevtap Kestel 1
Vecorauoregressive Model and Coinegraion Analysis Par V Time Series Analysis Dr. Sevap Kesel 1 Vecorauoregression Vecor auoregression (VAR) is an economeric model used o capure he evoluion and he inerdependencies
More informationEnsemble Kalman methods for high-dimensional hierarchical dynamic space-time models
Ensemble Kalman mehods for high-dimensional hierarchical dynamic space-ime models Mahias Kazfuss Jonahan R. Sroud Chrisopher K. Wikle arxiv:1704.06988v2 [sa.me] 8 Aug 2018 Absrac We propose a new class
More informationGeorey E. Hinton. University oftoronto. Technical Report CRG-TR February 22, Abstract
Parameer Esimaion for Linear Dynamical Sysems Zoubin Ghahramani Georey E. Hinon Deparmen of Compuer Science Universiy oftorono 6 King's College Road Torono, Canada M5S A4 Email: zoubin@cs.orono.edu Technical
More informationPhysics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle
Chaper 2 Newonian Mechanics Single Paricle In his Chaper we will review wha Newon s laws of mechanics ell us abou he moion of a single paricle. Newon s laws are only valid in suiable reference frames,
More informationA Bayesian Approach to Spectral Analysis
Chirped Signals A Bayesian Approach o Specral Analysis Chirped signals are oscillaing signals wih ime variable frequencies, usually wih a linear variaion of frequency wih ime. E.g. f() = A cos(ω + α 2
More informationCS376 Computer Vision Lecture 6: Optical Flow
CS376 Compuer Vision Lecure 6: Opical Flow Qiing Huang Feb. 11 h 2019 Slides Credi: Krisen Grauman and Sebasian Thrun, Michael Black, Marc Pollefeys Opical Flow mage racking 3D compuaion mage sequence
More informationOBJECTIVES OF TIME SERIES ANALYSIS
OBJECTIVES OF TIME SERIES ANALYSIS Undersanding he dynamic or imedependen srucure of he observaions of a single series (univariae analysis) Forecasing of fuure observaions Asceraining he leading, lagging
More informationZápadočeská Univerzita v Plzni, Czech Republic and Groupe ESIEE Paris, France
ADAPTIVE SIGNAL PROCESSING USING MAXIMUM ENTROPY ON THE MEAN METHOD AND MONTE CARLO ANALYSIS Pavla Holejšovsá, Ing. *), Z. Peroua, Ing. **), J.-F. Bercher, Prof. Assis. ***) Západočesá Univerzia v Plzni,
More informationAir Traffic Forecast Empirical Research Based on the MCMC Method
Compuer and Informaion Science; Vol. 5, No. 5; 0 ISSN 93-8989 E-ISSN 93-8997 Published by Canadian Cener of Science and Educaion Air Traffic Forecas Empirical Research Based on he MCMC Mehod Jian-bo Wang,
More informationObject tracking: Using HMMs to estimate the geographical location of fish
Objec racking: Using HMMs o esimae he geographical locaion of fish 02433 - Hidden Markov Models Marin Wæver Pedersen, Henrik Madsen Course week 13 MWP, compiled June 8, 2011 Objecive: Locae fish from agging
More informationVehicle Arrival Models : Headway
Chaper 12 Vehicle Arrival Models : Headway 12.1 Inroducion Modelling arrival of vehicle a secion of road is an imporan sep in raffic flow modelling. I has imporan applicaion in raffic flow simulaion where
More informationExcel-Based Solution Method For The Optimal Policy Of The Hadley And Whittin s Exact Model With Arma Demand
Excel-Based Soluion Mehod For The Opimal Policy Of The Hadley And Whiin s Exac Model Wih Arma Demand Kal Nami School of Business and Economics Winson Salem Sae Universiy Winson Salem, NC 27110 Phone: (336)750-2338
More informationCHAPTER 10 VALIDATION OF TEST WITH ARTIFICAL NEURAL NETWORK
175 CHAPTER 10 VALIDATION OF TEST WITH ARTIFICAL NEURAL NETWORK 10.1 INTRODUCTION Amongs he research work performed, he bes resuls of experimenal work are validaed wih Arificial Neural Nework. From he
More informationOutline. lse-logo. Outline. Outline. 1 Wald Test. 2 The Likelihood Ratio Test. 3 Lagrange Multiplier Tests
Ouline Ouline Hypohesis Tes wihin he Maximum Likelihood Framework There are hree main frequenis approaches o inference wihin he Maximum Likelihood framework: he Wald es, he Likelihood Raio es and he Lagrange
More informationhen found from Bayes rule. Specically, he prior disribuion is given by p( ) = N( ; ^ ; r ) (.3) where r is he prior variance (we add on he random drif
Chaper Kalman Filers. Inroducion We describe Bayesian Learning for sequenial esimaion of parameers (eg. means, AR coeciens). The updae procedures are known as Kalman Filers. We show how Dynamic Linear
More informationChapter 3 Boundary Value Problem
Chaper 3 Boundary Value Problem A boundary value problem (BVP) is a problem, ypically an ODE or a PDE, which has values assigned on he physical boundary of he domain in which he problem is specified. Le
More informationReliability of Technical Systems
eliabiliy of Technical Sysems Main Topics Inroducion, Key erms, framing he problem eliabiliy parameers: Failure ae, Failure Probabiliy, Availabiliy, ec. Some imporan reliabiliy disribuions Componen reliabiliy
More informationKalman filtering for maximum likelihood estimation given corrupted observations.
alman filering maimum likelihood esimaion given corruped observaions... Holmes Naional Marine isheries Service Inroducion he alman filer is used o eend likelihood esimaion o cases wih hidden saes such
More informationIntroduction D P. r = constant discount rate, g = Gordon Model (1962): constant dividend growth rate.
Inroducion Gordon Model (1962): D P = r g r = consan discoun rae, g = consan dividend growh rae. If raional expecaions of fuure discoun raes and dividend growh vary over ime, so should he D/P raio. Since
More informationHidden Markov Models
Hidden Markov Models Probabilisic reasoning over ime So far, we ve mosly deal wih episodic environmens Excepions: games wih muliple moves, planning In paricular, he Bayesian neworks we ve seen so far describe
More informationDiebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles
Diebold, Chaper 7 Francis X. Diebold, Elemens of Forecasing, 4h Ediion (Mason, Ohio: Cengage Learning, 006). Chaper 7. Characerizing Cycles Afer compleing his reading you should be able o: Define covariance
More informationMATH 5720: Gradient Methods Hung Phan, UMass Lowell October 4, 2018
MATH 5720: Gradien Mehods Hung Phan, UMass Lowell Ocober 4, 208 Descen Direcion Mehods Consider he problem min { f(x) x R n}. The general descen direcions mehod is x k+ = x k + k d k where x k is he curren
More informationLecture 3: Exponential Smoothing
NATCOR: Forecasing & Predicive Analyics Lecure 3: Exponenial Smoohing John Boylan Lancaser Cenre for Forecasing Deparmen of Managemen Science Mehods and Models Forecasing Mehod A (numerical) procedure
More informationIntroduction to Mobile Robotics
Inroducion o Mobile Roboics Bayes Filer Kalman Filer Wolfram Burgard Cyrill Sachniss Giorgio Grisei Maren Bennewiz Chrisian Plagemann Bayes Filer Reminder Predicion bel p u bel d Correcion bel η p z bel
More informationSUPPLEMENTARY INFORMATION
SUPPLEMENTARY INFORMATION DOI: 0.038/NCLIMATE893 Temporal resoluion and DICE * Supplemenal Informaion Alex L. Maren and Sephen C. Newbold Naional Cener for Environmenal Economics, US Environmenal Proecion
More informationEE 435. Lecture 31. Absolute and Relative Accuracy DAC Design. The String DAC
EE 435 Lecure 3 Absolue and Relaive Accuracy DAC Design The Sring DAC . Review from las lecure. DFT Simulaion from Malab Quanizaion Noise DACs and ADCs generally quanize boh ampliude and ime If convering
More informationProbabilistic Robotics SLAM
Probabilisic Roboics SLAM The SLAM Problem SLAM is he process by which a robo builds a map of he environmen and, a he same ime, uses his map o compue is locaion Localizaion: inferring locaion given a map
More informationELE 538B: Large-Scale Optimization for Data Science. Introduction. Yuxin Chen Princeton University, Spring 2018
ELE 538B: Large-Scale Opimizaion for Daa Science Inroducion Yuxin Chen Princeon Universiy, Spring 2018 Surge of daa-inensive applicaions Widespread applicaions in large-scale daa science and learning 2.5
More information( ) ( ) if t = t. It must satisfy the identity. So, bulkiness of the unit impulse (hyper)function is equal to 1. The defining characteristic is
UNIT IMPULSE RESPONSE, UNIT STEP RESPONSE, STABILITY. Uni impulse funcion (Dirac dela funcion, dela funcion) rigorously defined is no sricly a funcion, bu disribuion (or measure), precise reamen requires
More informationLecture 1 Overview. course mechanics. outline & topics. what is a linear dynamical system? why study linear systems? some examples
EE263 Auumn 27-8 Sephen Boyd Lecure 1 Overview course mechanics ouline & opics wha is a linear dynamical sysem? why sudy linear sysems? some examples 1 1 Course mechanics all class info, lecures, homeworks,
More informationChapter 7 Response of First-order RL and RC Circuits
Chaper 7 Response of Firs-order RL and RC Circuis 7.- The Naural Response of RL and RC Circuis 7.3 The Sep Response of RL and RC Circuis 7.4 A General Soluion for Sep and Naural Responses 7.5 Sequenial
More informationCH Sean Han QF, NTHU, Taiwan BFS2010. (Joint work with T.-Y. Chen and W.-H. Liu)
CH Sean Han QF, NTHU, Taiwan BFS2010 (Join work wih T.-Y. Chen and W.-H. Liu) Risk Managemen in Pracice: Value a Risk (VaR) / Condiional Value a Risk (CVaR) Volailiy Esimaion: Correced Fourier Transform
More informationOrdinary differential equations. Phys 750 Lecture 7
Ordinary differenial equaions Phys 750 Lecure 7 Ordinary Differenial Equaions Mos physical laws are expressed as differenial equaions These come in hree flavours: iniial-value problems boundary-value problems
More informationLinear Combinations of Volatility Forecasts for the WIG20 and Polish Exchange Rates
Eliza Buszkowska Universiy of Poznań, Poland Linear Combinaions of Volailiy Forecass for he WIG0 and Polish Exchange Raes Absrak. As is known forecas combinaions may be beer forecass hen forecass obained
More informationDistribution of Least Squares
Disribuion of Leas Squares In classic regression, if he errors are iid normal, and independen of he regressors, hen he leas squares esimaes have an exac normal disribuion, no jus asympoic his is no rue
More informationSome Basic Information about M-S-D Systems
Some Basic Informaion abou M-S-D Sysems 1 Inroducion We wan o give some summary of he facs concerning unforced (homogeneous) and forced (non-homogeneous) models for linear oscillaors governed by second-order,
More informationModal identification of structures from roving input data by means of maximum likelihood estimation of the state space model
Modal idenificaion of srucures from roving inpu daa by means of maximum likelihood esimaion of he sae space model J. Cara, J. Juan, E. Alarcón Absrac The usual way o perform a forced vibraion es is o fix
More informationHW6: MRI Imaging Pulse Sequences (7 Problems for 100 pts)
HW6: MRI Imaging Pulse Sequences (7 Problems for 100 ps) GOAL The overall goal of HW6 is o beer undersand pulse sequences for MRI image reconsrucion. OBJECTIVES 1) Design a spin echo pulse sequence o image
More informationClass Meeting # 10: Introduction to the Wave Equation
MATH 8.5 COURSE NOTES - CLASS MEETING # 0 8.5 Inroducion o PDEs, Fall 0 Professor: Jared Speck Class Meeing # 0: Inroducion o he Wave Equaion. Wha is he wave equaion? The sandard wave equaion for a funcion
More informationLecture 2 October ε-approximation of 2-player zero-sum games
Opimizaion II Winer 009/10 Lecurer: Khaled Elbassioni Lecure Ocober 19 1 ε-approximaion of -player zero-sum games In his lecure we give a randomized ficiious play algorihm for obaining an approximae soluion
More information6.2 Transforms of Derivatives and Integrals.
SEC. 6.2 Transforms of Derivaives and Inegrals. ODEs 2 3 33 39 23. Change of scale. If l( f ()) F(s) and c is any 33 45 APPLICATION OF s-shifting posiive consan, show ha l( f (c)) F(s>c)>c (Hin: In Probs.
More informationSingle-loop System Reliability-based Topology Optimization Accounting for Statistical Dependence between Limit-states
11 h US Naional Congress on Compuaional Mechanics Minneapolis, Minnesoa Single-loop Sysem Reliabiliy-based Topology Opimizaion Accouning for Saisical Dependence beween imi-saes Tam Nguyen, Norheasern Universiy
More informationCHBE320 LECTURE IV MATHEMATICAL MODELING OF CHEMICAL PROCESS. Professor Dae Ryook Yang
CHBE320 LECTURE IV MATHEMATICAL MODELING OF CHEMICAL PROCESS Professor Dae Ryook Yang Spring 208 Dep. of Chemical and Biological Engineering CHBE320 Process Dynamics and Conrol 4- Road Map of he Lecure
More informationEstimation of Poses with Particle Filters
Esimaion of Poses wih Paricle Filers Dr.-Ing. Bernd Ludwig Chair for Arificial Inelligence Deparmen of Compuer Science Friedrich-Alexander-Universiä Erlangen-Nürnberg 12/05/2008 Dr.-Ing. Bernd Ludwig (FAU
More informationKinematics and kinematic functions
Kinemaics and kinemaic funcions Kinemaics deals wih he sudy of four funcions (called kinemaic funcions or KFs) ha mahemaically ransform join variables ino caresian variables and vice versa Direc Posiion
More informationUnderstanding the Ensemble Kalman Filter
THE AMERICAN STATISTICIAN 2016, VOL. 70, NO. 4, 350 357 hp://dx.doi.org/10.1080/00031305.2016.1141709 Undersanding he Ensemble Kalman Filer Mahias Kazfuss a, Jonahan R. Sroud b, and Chrisopher K. Wikle
More information1 Review of Zero-Sum Games
COS 5: heoreical Machine Learning Lecurer: Rob Schapire Lecure #23 Scribe: Eugene Brevdo April 30, 2008 Review of Zero-Sum Games Las ime we inroduced a mahemaical model for wo player zero-sum games. Any
More informationTracking. Announcements
Tracking Tuesday, Nov 24 Krisen Grauman UT Ausin Announcemens Pse 5 ou onigh, due 12/4 Shorer assignmen Auo exension il 12/8 I will no hold office hours omorrow 5 6 pm due o Thanksgiving 1 Las ime: Moion
More informationIntroduction to Simulation - Lecture 16. Methods for Computing Periodic Steady-State - Part II Jacob White
Inroducion o Simuaion - ecure 6 Mehods for Compuing Periodic Seady-Sae - Par II Jacob Whie hanks o Deepak Ramaswamy, Micha Rewienski, and Karen Veroy Ouine hree Mehods so far ime inegraion uni seady-sae
More informationTemporal probability models. Chapter 15, Sections 1 5 1
Temporal probabiliy models Chaper 15, Secions 1 5 Chaper 15, Secions 1 5 1 Ouline Time and uncerainy Inerence: ilering, predicion, smoohing Hidden Markov models Kalman ilers (a brie menion) Dynamic Bayesian
More informationJ. Martin van Zyl Department of Mathematical Statistics and Actuarial Science, University of the Free State, PO Box 339, Bloemfontein, South Africa
A weighed leas squares procedure o approximae leas absolue deviaion esimaion in ime series wih specific reference o infinie variance uni roo problems J. Marin van Zyl Deparmen of Mahemaical Saisics and
More informationSubway stations energy and air quality management
Subway saions energy and air qualiy managemen wih sochasic opimizaion Trisan Rigau 1,2,4, Advisors: P. Carpenier 3, J.-Ph. Chancelier 2, M. De Lara 2 EFFICACITY 1 CERMICS, ENPC 2 UMA, ENSTA 3 LISIS, IFSTTAR
More information