On a Data Assimilation Method coupling Kalman Filtering, MCRE Concept and PGD Model Reduction for Real-Time Updating of Structural Mechanics Model

Size: px
Start display at page:

Download "On a Data Assimilation Method coupling Kalman Filtering, MCRE Concept and PGD Model Reduction for Real-Time Updating of Structural Mechanics Model"

Transcription

1 On a Data Assimilation Method coupling, MCRE Concept and PGD Model Reduction for Real-Time Updating of Structural Mechanics Model 2016 SIAM Conference on Uncertainty Quantification Basile Marchand 1, Ludovic Chamoin 1, Christian Rey 2 1 LMT/ENS Cachan/CNRS/Paris-Saclay University, France 2 SAFRAN, Research and Technology Center, France April 5-8, 2016

2 DDDAS Paradigm DDDAS 1 paradigm : a continuous exchange between the physical system and its numerical model ξ model u identification control Real system S observation s ξ c 1. Darema, Dynamica Data Driven Applications Systems : A New Paradigm for Application Simulations and Measurements, 2003 SIAM UQ Marchand et al April 5-8, / 30

3 In this work Objectives : Identification process for time dependent systems/parameters fast resolution robust even if highly corrupted data SIAM UQ Marchand et al April 5-8, / 30

4 In this work Objectives : Identification process for time dependent systems/parameters fast resolution robust even if highly corrupted data Tools : Kalman filter for evolution aspect modified Constitutive Relation Error for robustness offline/online process based on Proper Generalized Decomposition SIAM UQ Marchand et al April 5-8, / 30

5 Outline SIAM UQ Marchand et al April 5-8, / 30

6 Data assimilation Dynamical system : { u (k+1) s (k) = M (k) u (k) (k) + e u = H (k) u (k) (k) + e s SIAM UQ Marchand et al April 5-8, / 30

7 Data assimilation Dynamical system : { u (k+1) Bayes theorem : s (k) = M (k) u (k) (k) + e u = H (k) u (k) (k) + e s ( π u (k) s (k)) = π ( s (k) u (k)) π ( u (k) s (0:k 1)) π ( s (k) s (0:k 1)) under the following hypothesis : State u (k) is a Markov process, Observations s (k) are statistically independent of state history SIAM UQ Marchand et al April 5-8, / 30

8 Linear Kalman Filter Principle Kalman filter 2 is a bayesian filter combined with Maximum a Posteriori method in the case of Gaussian probability density functions. 2. Kalman, A new approach to linear filtering and prediction problems, 1960 SIAM UQ Marchand et al April 5-8, / 30

9 Linear Kalman Filter Principle Kalman filter 2 is a bayesian filter combined with Maximum a Posteriori method in the case of Gaussian probability density functions. Two main steps : u u ( ) u ( ) a s ( ) t (k 1) t (k) t (k+1) t (k+2) t (k+3) t (k+4) t 2. Kalman, A new approach to linear filtering and prediction problems, 1960 SIAM UQ Marchand et al April 5-8, / 30

10 Linear Kalman Filter Principle Kalman filter 2 is a bayesian filter combined with Maximum a Posteriori method in the case of Gaussian probability density functions. Two main steps : (a) Prediction step where is realized a priori estimation u (k+ 1 2 ) of state system u u ( ) u ( ) a s ( ) t (k 1) t (k) t (k+1) t (k+2) t (k+3) t (k+4) t 2. Kalman, A new approach to linear filtering and prediction problems, 1960 SIAM UQ Marchand et al April 5-8, / 30

11 Linear Kalman Filter Principle Kalman filter 2 is a bayesian filter combined with Maximum a Posteriori method in the case of Gaussian probability density functions. Two main steps : (a) Prediction step where is realized a priori estimation u (k+ 1 2 ) of state system (b) Assimilation step where is realized a posteriori estimation u a using observations data u u ( ) u ( ) a s ( ) t (k 1) t (k) t (k+1) t (k+2) t (k+3) t (k+4) t 2. Kalman, A new approach to linear filtering and prediction problems, 1960 SIAM UQ Marchand et al April 5-8, / 30

12 Inverse problems formulation Kalman filter is a very well-known method to solve inverse problems 3 3. Kaipio and Somersalo, Statistical and Computational Inverse Problems, 2006 SIAM UQ Marchand et al April 5-8, / 30

13 Inverse problems formulation Kalman filter is a very well-known method to solve inverse problems 3 Principle : Introduce model parameters vector ξ R np no a priori knowledge stationarity hypothesis : ξ t 0 ξ(k+1) = ξ (k) + e (k) ξ 3. Kaipio and Somersalo, Statistical and Computational Inverse Problems, 2006 SIAM UQ Marchand et al April 5-8, / 30

14 Inverse problems formulation Kalman filter is a very well-known method to solve inverse problems 3 Principle : Introduce model parameters vector ξ R np no a priori knowledge stationarity hypothesis : ξ t 0 ξ(k+1) = ξ (k) + e (k) ξ 3. Kaipio and Somersalo, Statistical and Computational Inverse Problems, 2006 SIAM UQ Marchand et al April 5-8, / 30

15 Inverse problems formulation Kalman filter is a very well-known method to solve inverse problems 3 Principle : Introduce model parameters vector ξ R np no a priori knowledge stationarity hypothesis : Joint Kalman Filter { ū (k+1) = ξ t 0 ξ(k+1) = ξ (k) + e (k) ξ M (k) ū (k) + ē (k) M s (k) = H (k) ū (k) + e (k) s Two formulations Dual Kalman filter { ξ (k+1) = ξ (k) + e (k) ξ s (k) = H (k) u (k) (ξ (k) ) + e (k) s 3. Kaipio and Somersalo, Statistical and Computational Inverse Problems, 2006 SIAM UQ Marchand et al April 5-8, / 30

16 Inverse problems formulation Kalman filter is a very well-known method to solve inverse problems 3 Principle : Introduce model parameters vector ξ R np no a priori knowledge stationarity hypothesis : [ ] u (k) ξ (k) Joint Kalman Filter { ū (k+1) = ξ t 0 ξ(k+1) = ξ (k) + e (k) ξ M (k) ū (k) + ē (k) M s (k) = H (k) ū (k) + e (k) s Two formulations Dual Kalman filter { ξ (k+1) = ξ (k) + e (k) ξ s (k) = H (k) u (k) (ξ (k) ) + e (k) s 3. Kaipio and Somersalo, Statistical and Computational Inverse Problems, 2006 SIAM UQ Marchand et al April 5-8, / 30

17 Inverse problems formulation Kalman filter is a very well-known method to solve inverse problems 3 Principle : Introduce model parameters vector ξ R np no a priori knowledge stationarity hypothesis : [ ] u (k) ξ (k) Joint Kalman Filter { ū (k+1) = ξ t 0 ξ(k+1) = ξ (k) + e (k) ξ M (k) ū (k) + ē (k) M s (k) = H (k) ū (k) + e (k) s Two formulations 3. Kaipio and Somersalo, Statistical and Computational Inverse Problems, 2006 Dual Kalman filter { ξ (k+1) = ξ (k) + e (k) ξ s (k) = H (k) u (k) (ξ (k) ) + e (k) s computed with another Kalman filter SIAM UQ Marchand et al April 5-8, / 30

18 Resolution schemes : UKF vs EKF The problem : Gaussian N ( x, C x ) Nonlinear operator A Gaussian N (ȳ, C y ) Two main approaches in Kalman filtering context SIAM UQ Marchand et al April 5-8, / 30

19 Resolution schemes : UKF vs EKF The problem : Gaussian N ( x, C x ) Nonlinear operator A Gaussian N (ȳ, C y ) Two main approaches in Kalman filtering context First order linearization, Extended Kalman filter 4 4. Sorenson and Stubberud, Non-linear Filtering by Approximation of the a posteriori Density, 1968 SIAM UQ Marchand et al April 5-8, / 30

20 Resolution schemes : UKF vs EKF The problem : Gaussian N ( x, C x ) Nonlinear operator A Gaussian N (ȳ, C y ) Two main approaches in Kalman filtering context First order linearization, Extended Kalman filter 4 Deterministic Monte-Carlo like method, Unscented Transform, Unscented Kalman filter 5 4. Sorenson and Stubberud, Non-linear Filtering by Approximation of the a posteriori Density, Julier and Uhlmann, A new extension of the kalman filter to nonlinear systems, 1997 SIAM UQ Marchand et al April 5-8, / 30

21 Linearization vs Unscented Transform First Order Linearization Prior 11 Linearization A = x A 10 ȳ = A( x) C y = AC x A T Posterior 1 0 SIAM UQ Marchand et al April 5-8, / 30

22 Linearization vs Unscented Transform First Order Linearization Prior 11 Linearization A = x A 10 ȳ = A( x) C y = AC x A T Posterior 1 0 Unscented Transform Prior 11 σ-points propagation 10 {x i } i=1,..,2n+1 {y i } = A ({x i }) Posterior SIAM UQ Marchand et al April 5-8, / 30

23 Linearization vs Unscented Transform First Order Linearization Prior 11 Linearization A = x A 10 ȳ = A( x) C y = AC x A T Posterior 1 0 Unscented Transform Prior 11 σ-points propagation 10 {x i } i=1,..,2n+1 {y i } = A ({x i }) Posterior For the same computational cost SIAM UQ Marchand et al April 5-8, / 30

24 Why another approach? Kalman Filter based methods well-adapted for evolution problems and DDDAS paradigm SIAM UQ Marchand et al April 5-8, / 30

25 Why another approach? Kalman Filter based methods well-adapted for evolution problems and DDDAS paradigm But : methods very costly if degrees of freedom/parameters increase SIAM UQ Marchand et al April 5-8, / 30

26 Why another approach? Kalman Filter based methods well-adapted for evolution problems and DDDAS paradigm But : methods very costly if degrees of freedom/parameters increase Identification quality strongly depends on measurement noise SIAM UQ Marchand et al April 5-8, / 30

27 Outline SIAM UQ Marchand et al April 5-8, / 30

28 Principle of the method Keep the dual formulation { ξ (k+1) = ξ (k) + e (k) ξ s (k) = H (k) u (k) (ξ (k) ) + e (k) s Classically computed using a Kalman Filter SIAM UQ Marchand et al April 5-8, / 30

29 Principle of the method Keep the dual formulation { ξ (k+1) = ξ (k) + e (k) ξ s (k) = H (k) u (k) (ξ (k) ) + e (k) s Classically computed using a Kalman Filter But use another observation operator { ξ (k+1) = ξ (k) + e (k) ξ s (k) = H m (k) (ξ (k) ; s (k 1:k) ) + e (k) s SIAM UQ Marchand et al April 5-8, / 30

30 Principle of the method Keep the dual formulation { ξ (k+1) = ξ (k) + e (k) ξ s (k) = H (k) u (k) (ξ (k) ) + e (k) s Classically computed using a Kalman Filter But use another observation operator Defined from the modified Constitutive Relation Error functional { ξ (k+1) = ξ (k) + e (k) ξ s (k) = H m (k) (ξ (k) ; s (k 1:k) ) + e (k) s SIAM UQ Marchand et al April 5-8, / 30

31 MCRE framework The idea 6 : Weight the classical Constitutive Relation Error 7 by a measurements error term 6. Ladevèze et al, Updating of finite element models using vibration tests, Ladevèze and Leguillon, Error estimate procedure in the finite element method and application, 1983 SIAM UQ Marchand et al April 5-8, / 30

32 MCRE framework The idea 6 : Principle : Weight the classical Constitutive Relation Error 7 by a measurements error term Primal-dual formulation based on Legendre-Fenchel inequality applied to Helmholtz free energy 6. Ladevèze et al, Updating of finite element models using vibration tests, Ladevèze and Leguillon, Error estimate procedure in the finite element method and application, 1983 SIAM UQ Marchand et al April 5-8, / 30

33 MCRE framework The idea 6 : Principle : Weight the classical Constitutive Relation Error 7 by a measurements error term Primal-dual formulation based on Legendre-Fenchel inequality applied to Helmholtz free energy mcre functional for unsteady thermal problems : E m(u, q; ξ) = 1 2 (q K u) K 1 (q K u) dxdt + δ 2 Πu s 2 dt I t Ω I t U = { u H 1 (Ω) L 2 (I t) \ u = u d on Ω u, u = u 0 at t = t 0 } S(u) = { q [L 2 (Ω) L 2 (I t)] d \ q n = q d on Ω q, tu + q = f } 6. Ladevèze et al, Updating of finite element models using vibration tests, Ladevèze and Leguillon, Error estimate procedure in the finite element method and application, 1983 SIAM UQ Marchand et al April 5-8, / 30

34 mcre inverse problems Solution is defined by : p = argmin ξ P ad min E m (u, q; ξ) (u,q) U ad S ad SIAM UQ Marchand et al April 5-8, / 30

35 mcre inverse problems Solution is defined by : p = argmin ξ P ad min E m (u, q; ξ) (u,q) U ad S ad Admissible fields Constrained minimization SIAM UQ Marchand et al April 5-8, / 30

36 mcre inverse problems Solution is defined by : p = argmin ξ P ad min E m (u, q; ξ) (u,q) U ad S ad Parameters minimization Gradient based methods Admissible fields Constrained minimization SIAM UQ Marchand et al April 5-8, / 30

37 mcre inverse problems Solution is defined by : p = argmin ξ P ad min E m (u, q; ξ) (u,q) U ad S ad Parameters minimization Gradient based methods Fixed point Admissible fields Constrained minimization SIAM UQ Marchand et al April 5-8, / 30

38 mcre inverse problems Solution is defined by : p = argmin ξ P ad min E m (u, q; ξ) (u,q) U ad S ad Parameters minimization Gradient based methods Fixed point Admissible fields Constrained minimization Interest (i) Robustness of the method with highly corrupted data (ii) Strong mechanical content (iii) Model reduction integration SIAM UQ Marchand et al April 5-8, / 30

39 The Modified Kalman Filter { ξ (k+1) = ξ (k) ( + e (k) ξ s (k) = H m (k) ξ (k), s (k 1:k)) (k) + e s SIAM UQ Marchand et al April 5-8, / 30

40 The Modified Kalman Filter { ξ (k+1) = ξ (k) ( + e (k) ξ s (k) = H m (k) ξ (k), s (k 1:k)) (k) + e s Two steps for H m (ξ (k) (k), s (k 1:k)) SIAM UQ Marchand et al April 5-8, / 30

41 The Modified Kalman Filter { ξ (k+1) = ξ (k) ( + e (k) ξ s (k) = H m (k) ξ (k), s (k 1:k)) (k) + e s Two steps for H m (ξ (k) (k), s (k 1:k)) Step 1 : admissible fields computation u (k) = G mcre (ξ (k), s (k 1:k) ) SIAM UQ Marchand et al April 5-8, / 30

42 The Modified Kalman Filter { ξ (k+1) = ξ (k) ( + e (k) ξ s (k) = H m (k) ξ (k), s (k 1:k)) (k) + e s Two steps for H m (ξ (k) (k), s (k 1:k)) Step 1 : admissible fields computation u (k) = G mcre (ξ (k), s (k 1:k) ) Step 2 : projection Typically using boolean matrix H := Π H m (ξ (k), s (k) ) = H G mcre (ξ (k), s (k 1:k) ) SIAM UQ Marchand et al April 5-8, / 30

43 Optimization point of view Dual Kalman filter based identification can be seen as the minimization of n t ( T J(ξ) = s (k) H (k) u (k) (ξ )) (k) (k) 1 ( ) Cs s (k) H (k) u (k) (ξ (k) ) k=0 SIAM UQ Marchand et al April 5-8, / 30

44 Optimization point of view Dual Kalman filter based identification can be seen as the minimization of n t ( T J(ξ) = s (k) H (k) u (k) (ξ )) (k) (k) 1 ( ) Cs s (k) H (k) u (k) (ξ (k) ) k=0 min U Classical s (k) H (k) u (k) Cs (k) 1 SIAM UQ Marchand et al April 5-8, / 30

45 Optimization point of view Dual Kalman filter based identification can be seen as the minimization of n t ( T J(ξ) = s (k) H (k) u (k) (ξ )) (k) (k) 1 ( ) Cs s (k) H (k) u (k) (ξ (k) ) k=0 min U Classical s (k) H (k) u (k) Cs (k) 1 mcre based min q u + δ U S K 1,I (k) t 2 Πu s I (k) t SIAM UQ Marchand et al April 5-8, / 30

46 Optimization point of view Dual Kalman filter based identification can be seen as the minimization of n t ( T J(ξ) = s (k) H (k) u (k) (ξ )) (k) (k) 1 ( ) Cs s (k) H (k) u (k) (ξ (k) ) k=0 min U Classical s (k) H (k) u (k) Cs (k) 1 mcre based min q u + δ U S K 1,I (k) t 2 Πu s I (k) t Observations data strongly imposed Observations data weakly imposed SIAM UQ Marchand et al April 5-8, / 30

47 Technical points State estimation Admissible fields : (u ad, q ad ) = argmin (u,q) U ad S ad E m (u, q; ξ (k) ) SIAM UQ Marchand et al April 5-8, / 30

48 Technical points State estimation Admissible fields : (u ad, q ad ) = argmin (u,q) U ad S ad E m (u, q; ξ (k) ) t (0) τ (0) k Kalman time scale t (k 1) I (k) t t (k) mcre time scale τ (i 1) k τ (i) k τ (ns 1) k t (nt 1) SIAM UQ Marchand et al April 5-8, / 30

49 Technical points State estimation Admissible fields : (u ad, q ad ) = argmin (u,q) U ad S ad E m (u, q; ξ (k) ) t (0) τ (0) k Kalman time scale t (k 1) I (k) t t (k) mcre time scale τ (i 1) k τ (i) k λ lagrange multiplier field and stationarity conditions τ (ns 1) k t (nt 1) SIAM UQ Marchand et al April 5-8, / 30

50 Technical points State estimation Admissible fields : (u ad, q ad ) = argmin (u,q) U ad S ad E m (u, q; ξ (k) ) t (0) τ (0) k Kalman time scale t (k 1) I (k) t t (k) mcre time scale τ (i 1) k τ (i) k λ lagrange multiplier field and stationarity conditions After FE discretization : [ [ ] [ ] [ C 0 K K u + 0 C] u λ δπ T = Π K λ] with u(τ (0) (ns 1) [ ] Fext δπ T s k ) = u (k 1) and λ(τ k ) = 0 t τ (ns 1) k t (nt 1) SIAM UQ Marchand et al April 5-8, / 30

51 Technical points State estimation Admissible fields : (u ad, q ad ) = argmin (u,q) U ad S ad E m (u, q; ξ (k) ) t (0) τ (0) k Kalman time scale t (k 1) I (k) t t (k) mcre time scale τ (i 1) k τ (i) k λ lagrange multiplier field and stationarity conditions After FE discretization : [ [ ] [ ] [ C 0 K K u + 0 C] u λ δπ T = Π K λ] with u(τ (0) (ns 1) [ ] Fext δπ T s k ) = u (k 1) and λ(τ k ) = 0 t τ (ns 1) k t (nt 1) Coupled forward-backward problem in time SIAM UQ Marchand et al April 5-8, / 30

52 PGD based model reduction Find u X = X 1 X D such that B(u, v) = L(v) v X 8. Nouy, A priori model reduction through Proper Generalized Decomposition for solving time-dependent partial differential equations, 2010 SIAM UQ Marchand et al April 5-8, / 30

53 PGD based model reduction Find u X = X 1 X D such that B(u, v) = L(v) v X Principle : Low-rank tensor approximation u u m = m w 1 i w 2 i w D i i=1 ; u m X m X 8. Nouy, A priori model reduction through Proper Generalized Decomposition for solving time-dependent partial differential equations, 2010 SIAM UQ Marchand et al April 5-8, / 30

54 PGD based model reduction Find u X = X 1 X D such that B(u, v) = L(v) v X Principle : Low-rank tensor approximation u u m = m w 1 i w 2 i w D i i=1 Construction : many strategies 8 ; u m X m X ; progressive Galerkin approach 8. Nouy, A priori model reduction through Proper Generalized Decomposition for solving time-dependent partial differential equations, 2010 SIAM UQ Marchand et al April 5-8, / 30

55 PGD based model reduction Find u X = X 1 X D such that B(u, v) = L(v) v X Principle : Low-rank tensor approximation u u m = m w 1 i w 2 i w D i i=1 Construction : many strategies 8 u M 1 known ; u m X m X ; progressive Galerkin approach B 1 (w 1, w ) = L(w ) B 1 (u M 1, w ). B D (w D, w ) = L(w ) B D (u M 1, w ) Orthogonalization and update u M = u M 1 + w 1 w D Fixed point Greedy 8. Nouy, A priori model reduction through Proper Generalized Decomposition for solving time-dependent partial differential equations, 2010 SIAM UQ Marchand et al April 5-8, / 30

56 PGD-mCRE Two fields problem : u and λ Two PGD decompositions simultaneously computed SIAM UQ Marchand et al April 5-8, / 30

57 PGD-mCRE Two fields problem : u and λ Two PGD decompositions simultaneously computed Many parameters to consider as extra-coordinates SIAM UQ Marchand et al April 5-8, / 30

58 PGD-mCRE Two fields problem : u and λ Two PGD decompositions simultaneously computed Many parameters to consider as extra-coordinates space, time parameters to identify ξ observations data initial condition SIAM UQ Marchand et al April 5-8, / 30

59 PGD-mCRE Two fields problem : u and λ space, time Two PGD decompositions simultaneously computed Many parameters to consider as extra-coordinates parameters to identify ξ observations data initial condition Projection into a reduced basis n init u (k) 0 = α i ψ i (x) i=0 SIAM UQ Marchand et al April 5-8, / 30

60 PGD-mCRE Two fields problem : u and λ space, time Two PGD decompositions simultaneously computed Many parameters to consider as extra-coordinates parameters to identify ξ observations data initial condition m u PGD = λ PGD = i=1 m i=1 φ u i φ λ i ψ u i ψ λ i Projection into a reduced basis n init u (k) 0 = α i ψ i (x) i=0 n p n obs n obs n init χ u j,i θ u k,i η u m,i ϕ u q,i j=1 k=1 m=1 q=1 n p n obs n obs n init χ λ j,i θ λ k,i η λ m,i ϕ λ q,i j=1 k=1 m=1 q=1 SIAM UQ Marchand et al April 5-8, / 30

61 PGD-mCRE Two fields problem : u and λ space, time Two PGD decompositions simultaneously computed Many parameters to consider as extra-coordinates parameters to identify ξ observations data initial condition m u PGD = λ PGD = i=1 m i=1 φ u i φ λ i ψ u i ψ λ i Projection into a reduced basis n init u (k) 0 = α i ψ i (x) i=0 n p n obs n obs n init χ u j,i θ u k,i η u m,i ϕ u q,i j=1 k=1 m=1 q=1 n p n obs n obs n init χ λ j,i θ λ k,i η λ m,i ϕ λ q,i j=1 k=1 m=1 q=1 n p + 2 n obs + n init 20 SIAM UQ Marchand et al April 5-8, / 30

62 Synthesis 8. Marchand et al, Real-time updating of structural mechanics models using Kalman filtering, modified Constitutive Relation Error and Proper Generalized Decomposition, 2016 SIAM UQ Marchand et al April 5-8, / 30

63 Synthesis offline Reduced basis computation for initial condition projection PGD admissible fields computation 8. Marchand et al, Real-time updating of structural mechanics models using Kalman filtering, modified Constitutive Relation Error and Proper Generalized Decomposition, 2016 SIAM UQ Marchand et al April 5-8, / 30

64 Synthesis offline Reduced basis computation for initial condition projection PGD admissible fields computation online at each time step Project current initial condition in reduced basis Evaluate PGD parametric solution for set of σ-points Project state into observation space Kalman parameters update 8. Marchand et al, Real-time updating of structural mechanics models using Kalman filtering, modified Constitutive Relation Error and Proper Generalized Decomposition, 2016 SIAM UQ Marchand et al April 5-8, / 30

65 Outline SIAM UQ Marchand et al April 5-8, / 30

66 Example 1 Problem setting q d (t) =? ρc, κ sensor location Time stepping for observation : 1000 Time stepping for identification : 100 Noise level : 20% u = ud PGD modes SIAM UQ Marchand et al April 5-8, / 30

67 Exemple 1 : Neumann B.C. identification 10 Joint Unscented Kalman Filter 10 Modified Kalman Filter time step time step Better accuracy exact mean variance Tuning parameters impact ε MKF = ξ true E [ξ MKF ] L 2 (I t ) ξ true L 2 (I t ) εmkf c s c ξ SIAM UQ Marchand et al April 5-8, / 30

68 Example 2 Problem setting κ 1? κ 2? κ 3? κ 4? u = u d sensor location Space modes Time stepping for observation : 1000 Time stepping for identification : 100 Noise level : 10% SIAM UQ Marchand et al April 5-8, / 30

69 Exemple 2 : conductivity identification Joint Unscented Kalman Filter 2 2 Modified Kalman Filter 1.5 κ1 κ ref Better 1.5 κ2 κ ref accuracy κ3 κ ref κ4 κ ref and robustness exact mean variance SIAM UQ Marchand et al April 5-8, / 30

70 Example 3 Problem setting Thermal source : f (x; x c ) = sinc 2 (π x x c (t) ) u = 0 f(x, x c) u = 0 sensor location To include x c as PGD s extra-coordinate f (x; x c ) N F i (x) G i (x c ) i=1 Using SVD SIAM UQ Marchand et al April 5-8, / 30

71 Exemple 3 : source localization Time stepping for observation : 1000 Time stepping for identification : 100 Noise level : 10% Modified Kalman Filter 8 xc identification 2 yc identification exact mean variance not compared to UKF since this problem requires to solve 5000 problems at each time step with the UKF approach SIAM UQ Marchand et al April 5-8, / 30

72 Exemple 3 : source localization Limits of PGD here PGD limits Space modes Source center modes Solution is relatively singular involves Initial condition should be project on many modes ninit 1 but np + 2 nobs + ninit / 20 SIAM UQ Marchand et al April 5-8, / 30

73 Outline SIAM UQ Marchand et al April 5-8, / 30

74 and future works Unscented Kalman Filter Modified Kalman Filter modified CRE Implementation Cost Robustness Implementation Robustness Cost Robustness Cost 2 Minimizations Proper Generalized Decomposition SIAM UQ Marchand et al April 5-8, / 30

75 and future works Unscented Kalman Filter Modified Kalman Filter modified CRE Implementation Cost Robustness Implementation Robustness Cost Robustness Cost 2 Minimizations Proper Generalized Decomposition Number of parameters significantly increases Extension to field identification split state and parameters meshes adaptive strategy 9 SIAM UQ Marchand et al April 5-8, / 30

Nonlinear and/or Non-normal Filtering. Jesús Fernández-Villaverde University of Pennsylvania

Nonlinear and/or Non-normal Filtering. Jesús Fernández-Villaverde University of Pennsylvania Nonlinear and/or Non-normal Filtering Jesús Fernández-Villaverde University of Pennsylvania 1 Motivation Nonlinear and/or non-gaussian filtering, smoothing, and forecasting (NLGF) problems are pervasive

More information

Lecture 2: From Linear Regression to Kalman Filter and Beyond

Lecture 2: From Linear Regression to Kalman Filter and Beyond Lecture 2: From Linear Regression to Kalman Filter and Beyond Department of Biomedical Engineering and Computational Science Aalto University January 26, 2012 Contents 1 Batch and Recursive Estimation

More information

Lecture 2: From Linear Regression to Kalman Filter and Beyond

Lecture 2: From Linear Regression to Kalman Filter and Beyond Lecture 2: From Linear Regression to Kalman Filter and Beyond January 18, 2017 Contents 1 Batch and Recursive Estimation 2 Towards Bayesian Filtering 3 Kalman Filter and Bayesian Filtering and Smoothing

More information

The Kalman Filter ImPr Talk

The Kalman Filter ImPr Talk The Kalman Filter ImPr Talk Ged Ridgway Centre for Medical Image Computing November, 2006 Outline What is the Kalman Filter? State Space Models Kalman Filter Overview Bayesian Updating of Estimates Kalman

More information

Stochastic Collocation Methods for Polynomial Chaos: Analysis and Applications

Stochastic Collocation Methods for Polynomial Chaos: Analysis and Applications Stochastic Collocation Methods for Polynomial Chaos: Analysis and Applications Dongbin Xiu Department of Mathematics, Purdue University Support: AFOSR FA955-8-1-353 (Computational Math) SF CAREER DMS-64535

More information

Proper Orthogonal Decomposition for Optimal Control Problems with Mixed Control-State Constraints

Proper Orthogonal Decomposition for Optimal Control Problems with Mixed Control-State Constraints Proper Orthogonal Decomposition for Optimal Control Problems with Mixed Control-State Constraints Technische Universität Berlin Martin Gubisch, Stefan Volkwein University of Konstanz March, 3 Martin Gubisch,

More information

Mini-Course 07 Kalman Particle Filters. Henrique Massard da Fonseca Cesar Cunha Pacheco Wellington Bettencurte Julio Dutra

Mini-Course 07 Kalman Particle Filters. Henrique Massard da Fonseca Cesar Cunha Pacheco Wellington Bettencurte Julio Dutra Mini-Course 07 Kalman Particle Filters Henrique Massard da Fonseca Cesar Cunha Pacheco Wellington Bettencurte Julio Dutra Agenda State Estimation Problems & Kalman Filter Henrique Massard Steady State

More information

Constrained State Estimation Using the Unscented Kalman Filter

Constrained State Estimation Using the Unscented Kalman Filter 16th Mediterranean Conference on Control and Automation Congress Centre, Ajaccio, France June 25-27, 28 Constrained State Estimation Using the Unscented Kalman Filter Rambabu Kandepu, Lars Imsland and

More information

Nonlinear Model Reduction for Uncertainty Quantification in Large-Scale Inverse Problems

Nonlinear Model Reduction for Uncertainty Quantification in Large-Scale Inverse Problems Nonlinear Model Reduction for Uncertainty Quantification in Large-Scale Inverse Problems Krzysztof Fidkowski, David Galbally*, Karen Willcox* (*MIT) Computational Aerospace Sciences Seminar Aerospace Engineering

More information

An optimal control problem for a parabolic PDE with control constraints

An optimal control problem for a parabolic PDE with control constraints An optimal control problem for a parabolic PDE with control constraints PhD Summer School on Reduced Basis Methods, Ulm Martin Gubisch University of Konstanz October 7 Martin Gubisch (University of Konstanz)

More information

Dynamic System Identification using HDMR-Bayesian Technique

Dynamic System Identification using HDMR-Bayesian Technique Dynamic System Identification using HDMR-Bayesian Technique *Shereena O A 1) and Dr. B N Rao 2) 1), 2) Department of Civil Engineering, IIT Madras, Chennai 600036, Tamil Nadu, India 1) ce14d020@smail.iitm.ac.in

More information

EKF, UKF. Pieter Abbeel UC Berkeley EECS. Many slides adapted from Thrun, Burgard and Fox, Probabilistic Robotics

EKF, UKF. Pieter Abbeel UC Berkeley EECS. Many slides adapted from Thrun, Burgard and Fox, Probabilistic Robotics EKF, UKF Pieter Abbeel UC Berkeley EECS Many slides adapted from Thrun, Burgard and Fox, Probabilistic Robotics Kalman Filter Kalman Filter = special case of a Bayes filter with dynamics model and sensory

More information

EKF, UKF. Pieter Abbeel UC Berkeley EECS. Many slides adapted from Thrun, Burgard and Fox, Probabilistic Robotics

EKF, UKF. Pieter Abbeel UC Berkeley EECS. Many slides adapted from Thrun, Burgard and Fox, Probabilistic Robotics EKF, UKF Pieter Abbeel UC Berkeley EECS Many slides adapted from Thrun, Burgard and Fox, Probabilistic Robotics Kalman Filter Kalman Filter = special case of a Bayes filter with dynamics model and sensory

More information

Nonlinear State Estimation! Particle, Sigma-Points Filters!

Nonlinear State Estimation! Particle, Sigma-Points Filters! Nonlinear State Estimation! Particle, Sigma-Points Filters! Robert Stengel! Optimal Control and Estimation, MAE 546! Princeton University, 2017!! Particle filter!! Sigma-Points Unscented Kalman ) filter!!

More information

Parametric Problems, Stochastics, and Identification

Parametric Problems, Stochastics, and Identification Parametric Problems, Stochastics, and Identification Hermann G. Matthies a B. Rosić ab, O. Pajonk ac, A. Litvinenko a a, b University of Kragujevac c SPT Group, Hamburg wire@tu-bs.de http://www.wire.tu-bs.de

More information

Lecture 6: Bayesian Inference in SDE Models

Lecture 6: Bayesian Inference in SDE Models Lecture 6: Bayesian Inference in SDE Models Bayesian Filtering and Smoothing Point of View Simo Särkkä Aalto University Simo Särkkä (Aalto) Lecture 6: Bayesian Inference in SDEs 1 / 45 Contents 1 SDEs

More information

Miscellaneous. Regarding reading materials. Again, ask questions (if you have) and ask them earlier

Miscellaneous. Regarding reading materials. Again, ask questions (if you have) and ask them earlier Miscellaneous Regarding reading materials Reading materials will be provided as needed If no assigned reading, it means I think the material from class is sufficient Should be enough for you to do your

More information

OPTIMAL ESTIMATION of DYNAMIC SYSTEMS

OPTIMAL ESTIMATION of DYNAMIC SYSTEMS CHAPMAN & HALL/CRC APPLIED MATHEMATICS -. AND NONLINEAR SCIENCE SERIES OPTIMAL ESTIMATION of DYNAMIC SYSTEMS John L Crassidis and John L. Junkins CHAPMAN & HALL/CRC A CRC Press Company Boca Raton London

More information

Autonomous Mobile Robot Design

Autonomous Mobile Robot Design Autonomous Mobile Robot Design Topic: Extended Kalman Filter Dr. Kostas Alexis (CSE) These slides relied on the lectures from C. Stachniss, J. Sturm and the book Probabilistic Robotics from Thurn et al.

More information

ROBOTICS 01PEEQW. Basilio Bona DAUIN Politecnico di Torino

ROBOTICS 01PEEQW. Basilio Bona DAUIN Politecnico di Torino ROBOTICS 01PEEQW Basilio Bona DAUIN Politecnico di Torino Probabilistic Fundamentals in Robotics Gaussian Filters Course Outline Basic mathematical framework Probabilistic models of mobile robots Mobile

More information

A STUDY ON THE STATE ESTIMATION OF NONLINEAR ELECTRIC CIRCUITS BY UNSCENTED KALMAN FILTER

A STUDY ON THE STATE ESTIMATION OF NONLINEAR ELECTRIC CIRCUITS BY UNSCENTED KALMAN FILTER A STUDY ON THE STATE ESTIMATION OF NONLINEAR ELECTRIC CIRCUITS BY UNSCENTED KALMAN FILTER Esra SAATCI Aydın AKAN 2 e-mail: esra.saatci@iku.edu.tr e-mail: akan@istanbul.edu.tr Department of Electronic Eng.,

More information

ADAPTIVE FILTER THEORY

ADAPTIVE FILTER THEORY ADAPTIVE FILTER THEORY Fourth Edition Simon Haykin Communications Research Laboratory McMaster University Hamilton, Ontario, Canada Front ice Hall PRENTICE HALL Upper Saddle River, New Jersey 07458 Preface

More information

Ensemble Data Assimilation and Uncertainty Quantification

Ensemble Data Assimilation and Uncertainty Quantification Ensemble Data Assimilation and Uncertainty Quantification Jeff Anderson National Center for Atmospheric Research pg 1 What is Data Assimilation? Observations combined with a Model forecast + to produce

More information

NON-LINEAR APPROXIMATION OF BAYESIAN UPDATE

NON-LINEAR APPROXIMATION OF BAYESIAN UPDATE tifica NON-LINEAR APPROXIMATION OF BAYESIAN UPDATE Alexander Litvinenko 1, Hermann G. Matthies 2, Elmar Zander 2 http://sri-uq.kaust.edu.sa/ 1 Extreme Computing Research Center, KAUST, 2 Institute of Scientific

More information

TSRT14: Sensor Fusion Lecture 8

TSRT14: Sensor Fusion Lecture 8 TSRT14: Sensor Fusion Lecture 8 Particle filter theory Marginalized particle filter Gustaf Hendeby gustaf.hendeby@liu.se TSRT14 Lecture 8 Gustaf Hendeby Spring 2018 1 / 25 Le 8: particle filter theory,

More information

ELE539A: Optimization of Communication Systems Lecture 15: Semidefinite Programming, Detection and Estimation Applications

ELE539A: Optimization of Communication Systems Lecture 15: Semidefinite Programming, Detection and Estimation Applications ELE539A: Optimization of Communication Systems Lecture 15: Semidefinite Programming, Detection and Estimation Applications Professor M. Chiang Electrical Engineering Department, Princeton University March

More information

A Comparison of the EKF, SPKF, and the Bayes Filter for Landmark-Based Localization

A Comparison of the EKF, SPKF, and the Bayes Filter for Landmark-Based Localization A Comparison of the EKF, SPKF, and the Bayes Filter for Landmark-Based Localization and Timothy D. Barfoot CRV 2 Outline Background Objective Experimental Setup Results Discussion Conclusion 2 Outline

More information

Probabilistic Fundamentals in Robotics. DAUIN Politecnico di Torino July 2010

Probabilistic Fundamentals in Robotics. DAUIN Politecnico di Torino July 2010 Probabilistic Fundamentals in Robotics Gaussian Filters Basilio Bona DAUIN Politecnico di Torino July 2010 Course Outline Basic mathematical framework Probabilistic models of mobile robots Mobile robot

More information

Parameterized Partial Differential Equations and the Proper Orthogonal D

Parameterized Partial Differential Equations and the Proper Orthogonal D Parameterized Partial Differential Equations and the Proper Orthogonal Decomposition Stanford University February 04, 2014 Outline Parameterized PDEs The steady case Dimensionality reduction Proper orthogonal

More information

Sequential Monte Carlo Samplers for Applications in High Dimensions

Sequential Monte Carlo Samplers for Applications in High Dimensions Sequential Monte Carlo Samplers for Applications in High Dimensions Alexandros Beskos National University of Singapore KAUST, 26th February 2014 Joint work with: Dan Crisan, Ajay Jasra, Nik Kantas, Alex

More information

The Unscented Particle Filter

The Unscented Particle Filter The Unscented Particle Filter Rudolph van der Merwe (OGI) Nando de Freitas (UC Bereley) Arnaud Doucet (Cambridge University) Eric Wan (OGI) Outline Optimal Estimation & Filtering Optimal Recursive Bayesian

More information

Gaussian Process Approximations of Stochastic Differential Equations

Gaussian Process Approximations of Stochastic Differential Equations Gaussian Process Approximations of Stochastic Differential Equations Cédric Archambeau Centre for Computational Statistics and Machine Learning University College London c.archambeau@cs.ucl.ac.uk CSML

More information

Data assimilation in high dimensions

Data assimilation in high dimensions Data assimilation in high dimensions David Kelly Courant Institute New York University New York NY www.dtbkelly.com February 12, 2015 Graduate seminar, CIMS David Kelly (CIMS) Data assimilation February

More information

Short tutorial on data assimilation

Short tutorial on data assimilation Mitglied der Helmholtz-Gemeinschaft Short tutorial on data assimilation 23 June 2015 Wolfgang Kurtz & Harrie-Jan Hendricks Franssen Institute of Bio- and Geosciences IBG-3 (Agrosphere), Forschungszentrum

More information

Goal. Robust A Posteriori Error Estimates for Stabilized Finite Element Discretizations of Non-Stationary Convection-Diffusion Problems.

Goal. Robust A Posteriori Error Estimates for Stabilized Finite Element Discretizations of Non-Stationary Convection-Diffusion Problems. Robust A Posteriori Error Estimates for Stabilized Finite Element s of Non-Stationary Convection-Diffusion Problems L. Tobiska and R. Verfürth Universität Magdeburg Ruhr-Universität Bochum www.ruhr-uni-bochum.de/num

More information

Bayesian Regression Linear and Logistic Regression

Bayesian Regression Linear and Logistic Regression When we want more than point estimates Bayesian Regression Linear and Logistic Regression Nicole Beckage Ordinary Least Squares Regression and Lasso Regression return only point estimates But what if we

More information

Bayesian Methods and Uncertainty Quantification for Nonlinear Inverse Problems

Bayesian Methods and Uncertainty Quantification for Nonlinear Inverse Problems Bayesian Methods and Uncertainty Quantification for Nonlinear Inverse Problems John Bardsley, University of Montana Collaborators: H. Haario, J. Kaipio, M. Laine, Y. Marzouk, A. Seppänen, A. Solonen, Z.

More information

Estimating functional uncertainty using polynomial chaos and adjoint equations

Estimating functional uncertainty using polynomial chaos and adjoint equations 0. Estimating functional uncertainty using polynomial chaos and adjoint equations February 24, 2011 1 Florida State University, Tallahassee, Florida, Usa 2 Moscow Institute of Physics and Technology, Moscow,

More information

LEAST-SQUARES FINITE ELEMENT MODELS

LEAST-SQUARES FINITE ELEMENT MODELS LEAST-SQUARES FINITE ELEMENT MODELS General idea of the least-squares formulation applied to an abstract boundary-value problem Works of our group Application to Poisson s equation Application to flows

More information

Bayesian Calibration of Simulators with Structured Discretization Uncertainty

Bayesian Calibration of Simulators with Structured Discretization Uncertainty Bayesian Calibration of Simulators with Structured Discretization Uncertainty Oksana A. Chkrebtii Department of Statistics, The Ohio State University Joint work with Matthew T. Pratola (Statistics, The

More information

Introduction to Unscented Kalman Filter

Introduction to Unscented Kalman Filter Introduction to Unscented Kalman Filter 1 Introdution In many scientific fields, we use certain models to describe the dynamics of system, such as mobile robot, vision tracking and so on. The word dynamics

More information

A new unscented Kalman filter with higher order moment-matching

A new unscented Kalman filter with higher order moment-matching A new unscented Kalman filter with higher order moment-matching KSENIA PONOMAREVA, PARESH DATE AND ZIDONG WANG Department of Mathematical Sciences, Brunel University, Uxbridge, UB8 3PH, UK. Abstract This

More information

Optimisation under Uncertainty with Stochastic PDEs for the History Matching Problem in Reservoir Engineering

Optimisation under Uncertainty with Stochastic PDEs for the History Matching Problem in Reservoir Engineering Optimisation under Uncertainty with Stochastic PDEs for the History Matching Problem in Reservoir Engineering Hermann G. Matthies Technische Universität Braunschweig wire@tu-bs.de http://www.wire.tu-bs.de

More information

Ergodicity in data assimilation methods

Ergodicity in data assimilation methods Ergodicity in data assimilation methods David Kelly Andy Majda Xin Tong Courant Institute New York University New York NY www.dtbkelly.com April 15, 2016 ETH Zurich David Kelly (CIMS) Data assimilation

More information

Nonlinear Estimation Techniques for Impact Point Prediction of Ballistic Targets

Nonlinear Estimation Techniques for Impact Point Prediction of Ballistic Targets Nonlinear Estimation Techniques for Impact Point Prediction of Ballistic Targets J. Clayton Kerce a, George C. Brown a, and David F. Hardiman b a Georgia Tech Research Institute, Georgia Institute of Technology,

More information

Greedy algorithms for high-dimensional non-symmetric problems

Greedy algorithms for high-dimensional non-symmetric problems Greedy algorithms for high-dimensional non-symmetric problems V. Ehrlacher Joint work with E. Cancès et T. Lelièvre Financial support from Michelin is acknowledged. CERMICS, Ecole des Ponts ParisTech &

More information

State Estimation of Linear and Nonlinear Dynamic Systems

State Estimation of Linear and Nonlinear Dynamic Systems State Estimation of Linear and Nonlinear Dynamic Systems Part III: Nonlinear Systems: Extended Kalman Filter (EKF) and Unscented Kalman Filter (UKF) James B. Rawlings and Fernando V. Lima Department of

More information

Lecture 7: Optimal Smoothing

Lecture 7: Optimal Smoothing Department of Biomedical Engineering and Computational Science Aalto University March 17, 2011 Contents 1 What is Optimal Smoothing? 2 Bayesian Optimal Smoothing Equations 3 Rauch-Tung-Striebel Smoother

More information

ADAPTIVE FILTER THEORY

ADAPTIVE FILTER THEORY ADAPTIVE FILTER THEORY Fifth Edition Simon Haykin Communications Research Laboratory McMaster University Hamilton, Ontario, Canada International Edition contributions by Telagarapu Prabhakar Department

More information

Stochastic Models, Estimation and Control Peter S. Maybeck Volumes 1, 2 & 3 Tables of Contents

Stochastic Models, Estimation and Control Peter S. Maybeck Volumes 1, 2 & 3 Tables of Contents Navtech Part #s Volume 1 #1277 Volume 2 #1278 Volume 3 #1279 3 Volume Set #1280 Stochastic Models, Estimation and Control Peter S. Maybeck Volumes 1, 2 & 3 Tables of Contents Volume 1 Preface Contents

More information

Winter 2019 Math 106 Topics in Applied Mathematics. Lecture 1: Introduction

Winter 2019 Math 106 Topics in Applied Mathematics. Lecture 1: Introduction Winter 2019 Math 106 Topics in Applied Mathematics Data-driven Uncertainty Quantification Yoonsang Lee (yoonsang.lee@dartmouth.edu) Lecture 1: Introduction 19 Winter M106 Class: MWF 12:50-1:55 pm @ 200

More information

Non-Intrusive Solution of Stochastic and Parametric Equations

Non-Intrusive Solution of Stochastic and Parametric Equations Non-Intrusive Solution of Stochastic and Parametric Equations Hermann G. Matthies a Loïc Giraldi b, Alexander Litvinenko c, Dishi Liu d, and Anthony Nouy b a,, Brunswick, Germany b École Centrale de Nantes,

More information

Gaussian Filtering Strategies for Nonlinear Systems

Gaussian Filtering Strategies for Nonlinear Systems Gaussian Filtering Strategies for Nonlinear Systems Canonical Nonlinear Filtering Problem ~u m+1 = ~ f (~u m )+~ m+1 ~v m+1 = ~g(~u m+1 )+~ o m+1 I ~ f and ~g are nonlinear & deterministic I Noise/Errors

More information

Uncertainty Quantification for Inverse Problems. November 7, 2011

Uncertainty Quantification for Inverse Problems. November 7, 2011 Uncertainty Quantification for Inverse Problems November 7, 2011 Outline UQ and inverse problems Review: least-squares Review: Gaussian Bayesian linear model Parametric reductions for IP Bias, variance

More information

Augmented Tikhonov Regularization

Augmented Tikhonov Regularization Augmented Tikhonov Regularization Bangti JIN Universität Bremen, Zentrum für Technomathematik Seminar, November 14, 2008 Outline 1 Background 2 Bayesian inference 3 Augmented Tikhonov regularization 4

More information

A posteriori error estimates for the adaptivity technique for the Tikhonov functional and global convergence for a coefficient inverse problem

A posteriori error estimates for the adaptivity technique for the Tikhonov functional and global convergence for a coefficient inverse problem A posteriori error estimates for the adaptivity technique for the Tikhonov functional and global convergence for a coefficient inverse problem Larisa Beilina Michael V. Klibanov December 18, 29 Abstract

More information

A Stochastic Collocation based. for Data Assimilation

A Stochastic Collocation based. for Data Assimilation A Stochastic Collocation based Kalman Filter (SCKF) for Data Assimilation Lingzao Zeng and Dongxiao Zhang University of Southern California August 11, 2009 Los Angeles Outline Introduction SCKF Algorithm

More information

Filtering and Likelihood Inference

Filtering and Likelihood Inference Filtering and Likelihood Inference Jesús Fernández-Villaverde University of Pennsylvania July 10, 2011 Jesús Fernández-Villaverde (PENN) Filtering and Likelihood July 10, 2011 1 / 79 Motivation Introduction

More information

Resolving the White Noise Paradox in the Regularisation of Inverse Problems

Resolving the White Noise Paradox in the Regularisation of Inverse Problems 1 / 32 Resolving the White Noise Paradox in the Regularisation of Inverse Problems Hanne Kekkonen joint work with Matti Lassas and Samuli Siltanen Department of Mathematics and Statistics University of

More information

The Bayesian approach to inverse problems

The Bayesian approach to inverse problems The Bayesian approach to inverse problems Youssef Marzouk Department of Aeronautics and Astronautics Center for Computational Engineering Massachusetts Institute of Technology ymarz@mit.edu, http://uqgroup.mit.edu

More information

Kalman filtering and friends: Inference in time series models. Herke van Hoof slides mostly by Michael Rubinstein

Kalman filtering and friends: Inference in time series models. Herke van Hoof slides mostly by Michael Rubinstein Kalman filtering and friends: Inference in time series models Herke van Hoof slides mostly by Michael Rubinstein Problem overview Goal Estimate most probable state at time k using measurement up to time

More information

Splitting Techniques in the Face of Huge Problem Sizes: Block-Coordinate and Block-Iterative Approaches

Splitting Techniques in the Face of Huge Problem Sizes: Block-Coordinate and Block-Iterative Approaches Splitting Techniques in the Face of Huge Problem Sizes: Block-Coordinate and Block-Iterative Approaches Patrick L. Combettes joint work with J.-C. Pesquet) Laboratoire Jacques-Louis Lions Faculté de Mathématiques

More information

A new Hierarchical Bayes approach to ensemble-variational data assimilation

A new Hierarchical Bayes approach to ensemble-variational data assimilation A new Hierarchical Bayes approach to ensemble-variational data assimilation Michael Tsyrulnikov and Alexander Rakitko HydroMetCenter of Russia College Park, 20 Oct 2014 Michael Tsyrulnikov and Alexander

More information

A NEW NONLINEAR FILTER

A NEW NONLINEAR FILTER COMMUNICATIONS IN INFORMATION AND SYSTEMS c 006 International Press Vol 6, No 3, pp 03-0, 006 004 A NEW NONLINEAR FILTER ROBERT J ELLIOTT AND SIMON HAYKIN Abstract A discrete time filter is constructed

More information

Scaling Neighbourhood Methods

Scaling Neighbourhood Methods Quick Recap Scaling Neighbourhood Methods Collaborative Filtering m = #items n = #users Complexity : m * m * n Comparative Scale of Signals ~50 M users ~25 M items Explicit Ratings ~ O(1M) (1 per billion)

More information

Multilevel Sequential 2 Monte Carlo for Bayesian Inverse Problems

Multilevel Sequential 2 Monte Carlo for Bayesian Inverse Problems Jonas Latz 1 Multilevel Sequential 2 Monte Carlo for Bayesian Inverse Problems Jonas Latz Technische Universität München Fakultät für Mathematik Lehrstuhl für Numerische Mathematik jonas.latz@tum.de November

More information

State Estimation using Moving Horizon Estimation and Particle Filtering

State Estimation using Moving Horizon Estimation and Particle Filtering State Estimation using Moving Horizon Estimation and Particle Filtering James B. Rawlings Department of Chemical and Biological Engineering UW Math Probability Seminar Spring 2009 Rawlings MHE & PF 1 /

More information

Why do we care? Measurements. Handling uncertainty over time: predicting, estimating, recognizing, learning. Dealing with time

Why do we care? Measurements. Handling uncertainty over time: predicting, estimating, recognizing, learning. Dealing with time Handling uncertainty over time: predicting, estimating, recognizing, learning Chris Atkeson 2004 Why do we care? Speech recognition makes use of dependence of words and phonemes across time. Knowing where

More information

Computer Intensive Methods in Mathematical Statistics

Computer Intensive Methods in Mathematical Statistics Computer Intensive Methods in Mathematical Statistics Department of mathematics johawes@kth.se Lecture 16 Advanced topics in computational statistics 18 May 2017 Computer Intensive Methods (1) Plan of

More information

CSC487/2503: Foundations of Computer Vision. Visual Tracking. David Fleet

CSC487/2503: Foundations of Computer Vision. Visual Tracking. David Fleet CSC487/2503: Foundations of Computer Vision Visual Tracking David Fleet Introduction What is tracking? Major players: Dynamics (model of temporal variation of target parameters) Measurements (relation

More information

Rank reduction of parameterized time-dependent PDEs

Rank reduction of parameterized time-dependent PDEs Rank reduction of parameterized time-dependent PDEs A. Spantini 1, L. Mathelin 2, Y. Marzouk 1 1 AeroAstro Dpt., MIT, USA 2 LIMSI-CNRS, France UNCECOMP 2015 (MIT & LIMSI-CNRS) Rank reduction of parameterized

More information

A nonlinear filtering tool for analysis of hot-loop test campaings

A nonlinear filtering tool for analysis of hot-loop test campaings A nonlinear filtering tool for analysis of hot-loop test campaings Enso Ikonen* Jenő Kovács*, ** * Systems Engineering Laboratory, Department of Process and Environmental Engineering, University of Oulu,

More information

Spatial Statistics with Image Analysis. Outline. A Statistical Approach. Johan Lindström 1. Lund October 6, 2016

Spatial Statistics with Image Analysis. Outline. A Statistical Approach. Johan Lindström 1. Lund October 6, 2016 Spatial Statistics Spatial Examples More Spatial Statistics with Image Analysis Johan Lindström 1 1 Mathematical Statistics Centre for Mathematical Sciences Lund University Lund October 6, 2016 Johan Lindström

More information

CERTAIN THOUGHTS ON UNCERTAINTY ANALYSIS FOR DYNAMICAL SYSTEMS

CERTAIN THOUGHTS ON UNCERTAINTY ANALYSIS FOR DYNAMICAL SYSTEMS CERTAIN THOUGHTS ON UNCERTAINTY ANALYSIS FOR DYNAMICAL SYSTEMS Puneet Singla Assistant Professor Department of Mechanical & Aerospace Engineering University at Buffalo, Buffalo, NY-1426 Probabilistic Analysis

More information

Using the Kalman Filter to Estimate the State of a Maneuvering Aircraft

Using the Kalman Filter to Estimate the State of a Maneuvering Aircraft 1 Using the Kalman Filter to Estimate the State of a Maneuvering Aircraft K. Meier and A. Desai Abstract Using sensors that only measure the bearing angle and range of an aircraft, a Kalman filter is implemented

More information

Stochastic Spectral Approaches to Bayesian Inference

Stochastic Spectral Approaches to Bayesian Inference Stochastic Spectral Approaches to Bayesian Inference Prof. Nathan L. Gibson Department of Mathematics Applied Mathematics and Computation Seminar March 4, 2011 Prof. Gibson (OSU) Spectral Approaches to

More information

BACKGROUNDS. Two Models of Deformable Body. Distinct Element Method (DEM)

BACKGROUNDS. Two Models of Deformable Body. Distinct Element Method (DEM) BACKGROUNDS Two Models of Deformable Body continuum rigid-body spring deformation expressed in terms of field variables assembly of rigid-bodies connected by spring Distinct Element Method (DEM) simple

More information

Lecture 6: Multiple Model Filtering, Particle Filtering and Other Approximations

Lecture 6: Multiple Model Filtering, Particle Filtering and Other Approximations Lecture 6: Multiple Model Filtering, Particle Filtering and Other Approximations Department of Biomedical Engineering and Computational Science Aalto University April 28, 2010 Contents 1 Multiple Model

More information

Overview. Bayesian assimilation of experimental data into simulation (for Goland wing flutter) Why not uncertainty quantification?

Overview. Bayesian assimilation of experimental data into simulation (for Goland wing flutter) Why not uncertainty quantification? Delft University of Technology Overview Bayesian assimilation of experimental data into simulation (for Goland wing flutter), Simao Marques 1. Why not uncertainty quantification? 2. Why uncertainty quantification?

More information

Dual Estimation and the Unscented Transformation

Dual Estimation and the Unscented Transformation Dual Estimation and the Unscented Transformation Eric A. Wan ericwan@ece.ogi.edu Rudolph van der Merwe rudmerwe@ece.ogi.edu Alex T. Nelson atnelson@ece.ogi.edu Oregon Graduate Institute of Science & Technology

More information

Probabilistic Graphical Models

Probabilistic Graphical Models Probabilistic Graphical Models Brown University CSCI 2950-P, Spring 2013 Prof. Erik Sudderth Lecture 12: Gaussian Belief Propagation, State Space Models and Kalman Filters Guest Kalman Filter Lecture by

More information

Minimizing D(Q,P) def = Q(h)

Minimizing D(Q,P) def = Q(h) Inference Lecture 20: Variational Metods Kevin Murpy 29 November 2004 Inference means computing P( i v), were are te idden variables v are te visible variables. For discrete (eg binary) idden nodes, exact

More information

5.1 2D example 59 Figure 5.1: Parabolic velocity field in a straight two-dimensional pipe. Figure 5.2: Concentration on the input boundary of the pipe. The vertical axis corresponds to r 2 -coordinate,

More information

A Note on the Particle Filter with Posterior Gaussian Resampling

A Note on the Particle Filter with Posterior Gaussian Resampling Tellus (6), 8A, 46 46 Copyright C Blackwell Munksgaard, 6 Printed in Singapore. All rights reserved TELLUS A Note on the Particle Filter with Posterior Gaussian Resampling By X. XIONG 1,I.M.NAVON 1,2 and

More information

A Study of Covariances within Basic and Extended Kalman Filters

A Study of Covariances within Basic and Extended Kalman Filters A Study of Covariances within Basic and Extended Kalman Filters David Wheeler Kyle Ingersoll December 2, 2013 Abstract This paper explores the role of covariance in the context of Kalman filters. The underlying

More information

Calibration and selection of stochastic palaeoclimate models

Calibration and selection of stochastic palaeoclimate models Calibration and selection of stochastic palaeoclimate models Michel Crucifix, Jake Carson, Simon Preston, Richard Wilkinson, Jonathan Rougier IRM - Internal Seminar - Uccle 2 April 2014 Posing the problem

More information

EnKF-based particle filters

EnKF-based particle filters EnKF-based particle filters Jana de Wiljes, Sebastian Reich, Wilhelm Stannat, Walter Acevedo June 20, 2017 Filtering Problem Signal dx t = f (X t )dt + 2CdW t Observations dy t = h(x t )dt + R 1/2 dv t.

More information

Temporal-Difference Q-learning in Active Fault Diagnosis

Temporal-Difference Q-learning in Active Fault Diagnosis Temporal-Difference Q-learning in Active Fault Diagnosis Jan Škach 1 Ivo Punčochář 1 Frank L. Lewis 2 1 Identification and Decision Making Research Group (IDM) European Centre of Excellence - NTIS University

More information

Bayesian Inverse problem, Data assimilation and Localization

Bayesian Inverse problem, Data assimilation and Localization Bayesian Inverse problem, Data assimilation and Localization Xin T Tong National University of Singapore ICIP, Singapore 2018 X.Tong Localization 1 / 37 Content What is Bayesian inverse problem? What is

More information

STA414/2104 Statistical Methods for Machine Learning II

STA414/2104 Statistical Methods for Machine Learning II STA414/2104 Statistical Methods for Machine Learning II Murat A. Erdogdu & David Duvenaud Department of Computer Science Department of Statistical Sciences Lecture 3 Slide credits: Russ Salakhutdinov Announcements

More information

Rao-Blackwellized Particle Filter for Multiple Target Tracking

Rao-Blackwellized Particle Filter for Multiple Target Tracking Rao-Blackwellized Particle Filter for Multiple Target Tracking Simo Särkkä, Aki Vehtari, Jouko Lampinen Helsinki University of Technology, Finland Abstract In this article we propose a new Rao-Blackwellized

More information

Bayesian Networks: Construction, Inference, Learning and Causal Interpretation. Volker Tresp Summer 2016

Bayesian Networks: Construction, Inference, Learning and Causal Interpretation. Volker Tresp Summer 2016 Bayesian Networks: Construction, Inference, Learning and Causal Interpretation Volker Tresp Summer 2016 1 Introduction So far we were mostly concerned with supervised learning: we predicted one or several

More information

2D Image Processing (Extended) Kalman and particle filter

2D Image Processing (Extended) Kalman and particle filter 2D Image Processing (Extended) Kalman and particle filter Prof. Didier Stricker Dr. Gabriele Bleser Kaiserlautern University http://ags.cs.uni-kl.de/ DFKI Deutsches Forschungszentrum für Künstliche Intelligenz

More information

Markov Chain Monte Carlo Methods for Stochastic

Markov Chain Monte Carlo Methods for Stochastic Markov Chain Monte Carlo Methods for Stochastic Optimization i John R. Birge The University of Chicago Booth School of Business Joint work with Nicholas Polson, Chicago Booth. JRBirge U Florida, Nov 2013

More information

MMSE-Based Filtering for Linear and Nonlinear Systems in the Presence of Non-Gaussian System and Measurement Noise

MMSE-Based Filtering for Linear and Nonlinear Systems in the Presence of Non-Gaussian System and Measurement Noise MMSE-Based Filtering for Linear and Nonlinear Systems in the Presence of Non-Gaussian System and Measurement Noise I. Bilik 1 and J. Tabrikian 2 1 Dept. of Electrical and Computer Engineering, University

More information

Extended Object and Group Tracking with Elliptic Random Hypersurface Models

Extended Object and Group Tracking with Elliptic Random Hypersurface Models Extended Object and Group Tracing with Elliptic Random Hypersurface Models Marcus Baum Benjamin Noac and Uwe D. Hanebec Intelligent Sensor-Actuator-Systems Laboratory ISAS Institute for Anthropomatics

More information

Goal-oriented Updating Technique Applied to Building Thermal model

Goal-oriented Updating Technique Applied to Building Thermal model Goal-oriented Updating Technique Applied to Building Thermal model Zohra Djatouti, Julien Waeytens, Ludovic Chamoin 2, Patrice Chatellier Université Paris-Est, IFSTTAR, Marne-la-Vallée, France 2 LMT-Cachan,

More information

1 Kalman Filter Introduction

1 Kalman Filter Introduction 1 Kalman Filter Introduction You should first read Chapter 1 of Stochastic models, estimation, and control: Volume 1 by Peter S. Maybec (available here). 1.1 Explanation of Equations (1-3) and (1-4) Equation

More information

Probing the covariance matrix

Probing the covariance matrix Probing the covariance matrix Kenneth M. Hanson Los Alamos National Laboratory (ret.) BIE Users Group Meeting, September 24, 2013 This presentation available at http://kmh-lanl.hansonhub.com/ LA-UR-06-5241

More information

ECE276A: Sensing & Estimation in Robotics Lecture 10: Gaussian Mixture and Particle Filtering

ECE276A: Sensing & Estimation in Robotics Lecture 10: Gaussian Mixture and Particle Filtering ECE276A: Sensing & Estimation in Robotics Lecture 10: Gaussian Mixture and Particle Filtering Lecturer: Nikolay Atanasov: natanasov@ucsd.edu Teaching Assistants: Siwei Guo: s9guo@eng.ucsd.edu Anwesan Pal:

More information