KALMAN AND PARTICLE FILTERS

Size: px
Start display at page:

Download "KALMAN AND PARTICLE FILTERS"

Transcription

1 KALMAN AND PARTICLE FILTERS H. R. B. Orlande, M. J. Colaço, G. S. Duliravich, F. L. V. Vianna, W. B. da Silva, H. M. da Fonseca and O. Fudym Department of Mechanical Engineering Escola Politécnica/COPPE Federal University of Rio de Janeiro, UFRJ Rio de Janeiro, RJ, Brazil 1

2 SUMMARY State estimation problems Kalman filter Particle filter Examples: Lumped system and 1D Heat conduction Applications Conclusions

3 STATE ESTIMATION PROBLEM State Evolution Model: x = f (x -1, u -1, v -1 ) Observation Model: z h ( x, n ) x R n x = state variables to be estimated u R n p = input variable v R n v z R n z n R n n = state noise = measurements = measurement noise Subscript = 1, 2,, denotes an instant t in a dynamic problem

4 STATE ESTIMATION PROBLEM Definition: The state estimation problem aims at obtaining information about x based on the state evolution model and on the measurements given by the observation model.

5 BAYESIAN FRAMEWORK The solution of the inverse problem within the Bayesian framewor is recast in the form of statistical inference from the posterior probability density, which is the model for the conditional probability distribution of the unnown parameters given the measurements. The measurement model incorporating the related uncertainties is called the lielihood, that is, the conditional probability of the measurements given the unnown parameters. The model for the unnowns that reflects all the uncertainty of the parameters without the information conveyed by the measurements, is called the prior model.

6 BAYESIAN FRAMEWORK The formal mechanism to combine the new information (measurements) with the previously available information (prior) is nown as the Bayes theorem: posterior ( x) ( x z) ( x) ( z x) () z where posterior (x) is the posterior probability density, (x) is the prior density, (z x) is the lielihood function and (z) is the marginal probability density of the measurements, which plays the role of a normalizing constant.

7 STATE ESTIMATION PROBLEM State Evolution Model: x = f (x -1, u -1, v -1 ) Observation Model: z h ( x, n ) The evolution-observation model is based on the following assumptions : (i) The sequence x for = 1, 2,, is a Marovian process, that is, ( x x, x,, x ) ( x x ) (ii) The sequence z x the history of for = 1, 2,, is a Marovian process with respect to, that is, ( z x, x,, x ) ( z x ) 0 1 (iii) The sequence x depends on the past observations only through its own history, that is, ( x x, z ) ( x x ) 1 1: 1 1

8 STATE ESTIMATION PROBLEM State Evolution Model: x = f (x -1, u -1, v -1 ) Observation Model: z h ( x, n ) Different problems can be considered: 1. The prediction problem, concerned with the determination of ( x z 1: 1) ; 2. The filtering problem, concerned with the determination of ( x z 1: ) ; 3. The fixed-lag smoothing problem, concerned the determination of ( x z 1: p ), where p 1 is the fixed lag; 4. The whole-domain smoothing problem, concerned with the determination of z1: K { zi, i 1,, K} ( x z ), where is the complete sequence of 1: K measurements.

9 FILTERING PROBLEM By assuming that ( x z ) ( x ) posterior probability density ( x z ) is available, the is then obtained with Bayesian filters in two steps: prediction and update 1:

10 (x 0 ) (x 1 x 0 ) Prediction (x 1 ) Update (z 1 x 1 ) (x 1 z 1 ) (x 2 x 1 ) Prediction (x 2 z 1 ) Update (z 2 x 2 ) (x 2 z 1:2 )

11 THE KALMAN FILTER Evolution and observation models are linear. Noises in such models are additive and Gaussian, with nown means and covariances. Optimal solution if these hypotheses hold. State Evolution Model: x = F x 1 + G u 1 + s 1 +v 1 Observation Model: z H x n F and H are nown matrices for the linear evolutions of the state x and of the observation z, respectively. G is matrix that determines how the control u affects the state x. Vector s is assumed to be a nown input. Noises v and n have zero means and covariance matrices Q and R, respectively.

12 THE KALMAN FILTER Prediction: x F x = F x G u 1 + s 1 +v 1 P F P F Q T 1 Update: T 1 K P H H P H R T x x K ( z H x ) P I - K H P

13 THE PARTICLE FILTER Monte-Carlo techniques are the most general and robust for non-linear and/or non-gaussian distributions. The ey idea is to represent the required posterior density function by a set of random samples (particles) with associated weights, and to compute the estimates based on these samples and weights. Introduced in the 50 s, but no much used until recently because of limited computational resources. Particles degenerated very fast in early implementations, i.e., most of the particles would have negligible weight. The resampling step has a fundamental role in the advancement of the particle filter.

14 Sampling Importance Resampling (SIR) Algorithm (Ristic, B., Arulampalam, S., Gordon, N., 2004, Beyond the Kalman Filter, Artech House, Boston)

15 Sampling Importance Resampling (SIR) Algorithm (Ristic, B., Arulampalam, S., Gordon, N., 2004, Beyond the Kalman Filter, Artech House, Boston)

16 Sampling Importance Resampling (SIR) Algorithm (Ristic, B., Arulampalam, S., Gordon, N., 2004, Beyond the Kalman Filter, Artech House, Boston) Although the resampling step reduces the effects of degeneracy, it introduces other practical problems: Limitation in the parallelization. Particles that have high weights are statistically selected many times: Loss of diversity, nown as sample impoverishment, specially if the evolution model errors are small.

17 Sampling Importance Resampling (SIR) Algorithm (Ristic, B., Arulampalam, S., Gordon, N., 2004, Beyond the Kalman Filter, Artech House, Boston) Step 1 For i 1,, N draw new particles x i density x x i 1 from the prior and then use the lielihood density i i to calculate the correspondent weights w z x Calculate the total weight Step 2 T w N i1 i. w and then normalize i 1 i the particle weights, that is, for i 1,, N let w Tw w Step 3 Resample the particles as follows : Construct the cumulative sum of weights (CSW) by i computing ci ci 1 w for i 1,, N, with c0 0. Let i 1 and draw a starting point u 1 from the uniform distribution U 0, For j 1,, N 1 N 1 Move along the CSW by maing u u N j While uj ci mae ii 1. Assign sample Assign sample x j j w x i 1 N j 1 1 Weights are easily evaluated and importance density easily sampled. Sampling of the importance density is independent of the measurements at that time. The filter can be sensitive to outliers. Resampling is applied every iteration, which can result in fast loss of diversity of the particles.

18 EXAMPLE: Lumped System where d ( t ) ( ) m () t mq t for t > 0 dt h 0 for t = 0 ( t) T( t) T 0 0 T T h m cl

19 EXAMPLE: Lumped System Two illustrative cases are examined: (i) Heat Flux q(t) = q 0 constant and deterministically nown; (ii) Heat Flux q(t) = q 0 f(t) with unnown time variation. Plate is made of aluminum ( = 2707 gm -3, c = 896 Jg -1 K -1 ), with thicness L = 0.03 m, q 0 = 8000 Wm -2, =20 o C, h = 50 Wm -2 K -1 and T 0 = 50 o C. Measurements of the transient temperature of the slab are assumed available. These measurements contain additive, uncorrelated, Gaussian errors, with zero mean and a constant standard deviation s z. The errors in the state evolution model are also supposed to be additive, uncorrelated, Gaussian, with zero mean and a constant standard deviation s.

20 (i) Heat Flux q(t) = q 0 constant and deterministically nown The analytical solution for this problem is given by: mt q0 mt ( t) 0e (1 e ) (A.3) h The only state variable in this case is the temperature ( t ) since the applied heat flux q 0 is constant and deterministically nown, as the other parameters appearing in the formulation. By using a forward finite-differences approximation for the time derivative in equation (A.1.a), we obtain: mq 0 (1 mt) 1 t (A.4) h Therefore, the state and observation models given by equations (3.a,b) are obtained with: x [ ] F [(1 mt)] q 0 s m t H 2 [1] Q s h [ ] R 2 z [ s ] (A5.a-f) x = F x 1 + G u 1 + s 1 +v 1 z H x n

21 (ii) Heat Flux q(t) = q 0 f(t) with unnown time variation The analytical solution for this problem is given by: t mt mq0 mt ( t) e 0 e f ( t) dt h t0 (A.6) In this case, the state variables are given by the temperature ( ) and the function that t gives the time variation of the applied heat flux, that is, f ( t) f.as in the case examined above, the applied heat flux q 0 is constant and deterministically nown, as the other parameters appearing in the formulation. By using a forward finite-differences approximation for the time derivative in equation (A.1.a), we obtain the equation for the evolution of the state variable ( ) : t mq (1 m t) t f h (A.7) A random wal model is used for the state variable f ( t ) f, which is given in the form: f f 1 1 (A.8) where -1 is Gaussian with zero mean and constant standard deviation s rw.

22 (ii) Heat Flux q(t) = q 0 f(t) with unnown time variation Therefore, the state and observation models given by equations (3.a,b) are obtained with: x f F mq (1 ) h mt t s 0 0 (A.9.a-c) 2 H s 0 2 [1 0] Q R 2 s z 0 s rw [ ] (A.9.d-f) x = F x 1 + G u 1 + s 1 +v 1 z H x n

23 EXAMPLE: 1D Heat conduction Linear Heat Conduction Problem 2 1 T T t x 2 in 0 < x < L, for t > 0 T 0 at x=0, for t > 0 T T * T T * at x=l, for t > 0 for t=0, in 0 < x < L Explicit finite-differences: 1 T FT S Τ T T 1 N F (1 2 r) r r (1 2 r) r r (1 2 r) r r (1 2 r) S 0 0 rt *

24 EXAMPLE: 1D Heat conduction Concrete with thermal diffusivity = 4.9x10-7 m 2 /s Standard-deviation for the measurement errors = 2 o C Final time = 250 seconds Measurements available in the region every 1 second L = 0.1 m N = 50 internal nodes

25 T, C T, C Exact Temperature x, m Time, s Measured Temperature x, m Time, s

26 T(x=0.01 m), C Kalman Filter (Standard-deviation for the evolution model errors of 1 o C) Exact Measured Predicted 99% Confidence Interval Time, s

27 T(x=0.01 m), C Kalman Filter (Standard-deviation for the evolution model errors of 0.5 o C) Exact Measured Predicted 99% Confidence Interval Time, s

28 T(x=0.01 m), C Kalman Filter (Standard-deviation for the evolution model errors of 5 o C) Exact Measured Predicted 99% Confidence Interval Time, s

29 T(x=0.01 m), C Particle Filter (Standard-deviation for the evolution model errors of 1 o C) Particle Filter with Re-sampling - Number of Particles = 50 Exact Measured Predicted 99% Confidence Interval CPU Time Kalman filter: 0.5 s Particle filter: 6.9 s Time, s

30 T(x=0.01 m), C Particle Filter (evolution model errors with uniform distribution in [-1,1] o C) Particle Filter with Re-sampling - Number of Particles = 50 Exact Measured Predicted 99% Confidence Interval Time, s

31 3 Capacidade Volumetric Térm Heat ica Capacity Volum (Jm etrica -3o C (J/m. C) -1 ) Thermal Condutividade Conductivity térm ica (Wm (W -1o /m. C) C -1 ) EXAMPLE: 1D Heat conduction Nonlinear Heat Conduction Problem T T C( T ) K ( T ) t x x in 0 < x < L, for t > 0 T 0 x at x=0, for t > 0 T ( T ) q * x at x=l, for t > 0 T T * for t=0, in 0 < x < L Graphite 6x10 6 5x C T A A e T A 1 2 4x10 6 3x10 6 Thermal Condutividade conductivity térm ica Heat Capacidade capacity térm ica T B B e T B 1 2 2x x Temperature peratura ( o ( C)

32 EXAMPLE: 1D Heat conduction T* = 20 o C q* = 10 5 W/m 2 L = 0.01 m 50 finite-volumes Final time = 90 s Time step = 1 s Errors in the state evolution and observation models were supposed to be additive, Gaussian, uncorrelated, with zero mean and constant standard-deviations Standard-deviation for the state evolution model = 5 o C Standard-deviation for the observation model = 10 o C

33 T, C T, C Exact Temperature x, m Time, s Measured Temperature x, m Time, s 60 80

34 T(x= m), C 600 Particle Filter with Re-sampling - Number of Particles = Exact Measured 0 Predicted 99% Confidence Interval Time, s

35 T(x=0.001 m), C 600 Particle Filter with Re-sampling - Number of Particles = Exact Measured 0 Predicted 99% Confidence Interval Time, s

36 T(x=0.002 m), C 700 Particle Filter with Re-sampling - Number of Particles = Exact Measured -200 Predicted 99% Confidence Interval Time, s

37 T(x=0.004 m), C 600 Particle Filter with Re-sampling - Number of Particles = Exact Measured -100 Predicted 99% Confidence Interval Time, s

38 APPLICATIONS Estimation of position-dependent transient heat source 2 2 T T T h g( x, y, t) C 2 2 T T t x y e e at 0 < x < L, 0 < y < L, for t > 0 ( T 0 at x = 0 and x = L, for t > 0 x ( T 0 at y = 0 and y = L, for t > 0 y ( T T 0 for t = 0, at 0 < x < L and 0 < y < L (4) H.Massard, F. sepulveda, H.R.B. Orlande and O. Fudym, 2010, Kalman Filtering for thermal diffusivity and transient source term mapping from infrared images, Inverse Problems, Design and Optimization Symposium 38 João Pessoa, Paraíba, Brazil, August 23-27, 2010

39 APPLICATIONS Estimation of position-dependent transient heat source H.Massard, F. sepulveda, H.R.B. Orlande and O. Fudym, 2010, Kalman Filtering for thermal diffusivity and transient source term mapping from infrared images, Inverse Problems, Design and Optimization Symposium 39 João Pessoa, Paraíba, Brazil, August 23-27, 2010

40 APPLICATIONS Estimation of position-dependent transient heat source T = T J P v 1 1 T P = IP v 1 P J L1 t( T1 T ) t L 0 2 t( T2 T ) t 0 0 LM t( TM T ) t H.Massard, F. sepulveda, H.R.B. Orlande and O. Fudym, 2010, Kalman Filtering for thermal diffusivity and transient source term mapping from infrared images, Inverse Problems, Design and Optimization Symposium 40 João Pessoa, Paraíba, Brazil, August 23-27, 2010

41 Estimation of position-dependent transient heat source 41 H.Massard, F. sepulveda, H.R.B. Orlande and O. Fudym, 2010, Kalman Filtering for thermal diffusivity and transient source term mapping from infrared images, Inverse Problems, Design and Optimization Symposium João Pessoa, Paraíba, Brazil, August 23-27, T T = T J P v 1 P P = IP v 1 2 M T T T T M M M a H G a H G a H G P APPLICATIONS

42 APPLICATIONS Estimation of position-dependent transient heat source H.Massard, F. sepulveda, H.R.B. Orlande and O. Fudym, 2010, Kalman Filtering for thermal diffusivity and transient source term mapping from infrared images, Inverse Problems, Design and Optimization Symposium 42 João Pessoa, Paraíba, Brazil, August 23-27, 2010

43 APPLICATIONS Estimation of position-dependent transient heat source H.Massard, F. sepulveda, H.R.B. Orlande and O. Fudym, 2010, Kalman Filtering for thermal diffusivity and transient source term mapping from infrared images, Inverse Problems, Design and Optimization Symposium 43 João Pessoa, Paraíba, Brazil, August 23-27, 2010

44 APPLICATIONS Estimation of position-dependent transient heat source H.Massard, F. sepulveda, H.R.B. Orlande and O. Fudym, 2010, Kalman Filtering for thermal diffusivity and transient source term mapping from infrared images, Inverse Problems, Design and Optimization Symposium 44 João Pessoa, Paraíba, Brazil, August 23-27, 2010

45 APPLICATIONS Estimation of position-dependent transient heat source H.Massard, F. sepulveda, H.R.B. Orlande and O. Fudym, 2010, Kalman Filtering for thermal diffusivity and transient source term mapping from infrared images, Inverse Problems, Design and Optimization Symposium 45 João Pessoa, Paraíba, Brazil, August 23-27, 2010

46 Line Heat Sin APPLICATIONS Estimation of the location of the solidification front and the intensity of a line heat sin Solid Liquid T (r,t) T Interface 0 S(t) Silva, W. B. Orlande, H. R. B.; Colaço, M. J., Fudym, O., 2011, Application Of Bayesian Filters To A One- Dimensional Solidification Problem, 21st Brazilian Congress of Mechanical Engineering, Natal, RN, Brazil. 46

47 APPLICATIONS The mathematical formulation for the solid phase is given as,, 1 Ts r t 1 Ts r t r in 0 r S( t) and t 0 r r r s t (1.a) while the liquid phase is described as, T r, t 1 Tl r t 1 l r in S( t) r and t 0 (1.b) r r r l t T r, t T in r and t 0 (1.c) l i T r, t T in t 0 and r 0 (1.d) l i At the interface between liquid and solid phases, the following conditions must be satisfied T r, t T r, t T in r S( t) and t 0 (1.e) s l m Ts r, t Tl r, t St () s l L in r S( t) and t 0 r r t (1.f) 47

48 APPLICATIONS An analytical solution of this problem can be obtained for this physical problem and it is given by [8]: 2 Q s r 2 Ts r, t Tm Ei Ei 0 r S( t) 4s 4st 2 Ti T m r Tl r, t Ti E ( ) 2 i S t r 4 s st E i l (2.a) (2.b) where the eigenvalues λ and the solidification front S (t) are given by 2 s Q 2 l Ti T e m e l 2 L 4 s E i l 2 s s (3.a) S( t) 2 st (3.b) In the above equations T i is the uniform initial temperature, T m is the melting temperature of the material, L is the s and l are the thermal conductivities of the solid and latent heat of solidification of the material, is the density, liquid phases, respectively, s and l are the thermal diffusivities of the solid and liquid phases, respectively, and 48 T s and T l are temperatures of the solid and liquid phases, respectively.

49 APPLICATIONS Estimation of the location of the solidification front and the intensity of a line heat sin The physical problem defined by Eqs. (1.a-f) was solved analytically, where we used the following data, 2 2 corresponding to solidifying water: Ti 25 C, Tm 0 C, m s , m l , w s 2.22 s s mc, w l 0.61, g, J 3 L 80. The line heat sin was supposed to have a constant value equals to W Q = 50. mc m g m In this wor, the measurements (for the observation model) were obtained at r=0.01 m. The simulated noisy measurements were uncorrelated, additive, Gaussian, with zero mean and constant standard deviation equal to 5% of the maximum temperature. Figures 3.a,b show the transient measurements obtained after applying such constant line heat sin, with and without errors, respectively. Silva, W. B. Orlande, H. R. B.; Colaço, M. J., Fudym, O., 2011, Application Of Bayesian Filters To A One- Dimensional Solidification Problem, 21st Brazilian Congress of Mechanical Engineering, Natal, RN, Brazil. 49

50 APPLICATIONS Estimation of the location of the solidification front and the intensity of a line heat sin Silva, W. B. Orlande, H. R. B.; Colaço, M. J., Fudym, O., 2011, Application Of Bayesian Filters To A One- Dimensional Solidification Problem, 21st Brazilian Congress of Mechanical Engineering, Natal, RN, Brazil.

51 Auxiliary Sampling Importance Resampling (ASIR) Algorithm (Ristic, B., Arulampalam, S., Gordon, N., 2004, Beyond the Kalman Filter, Artech House, Boston) Step 1 For i=1,...,n draw new particles x i from the prior density (x x i -1) and then calculate some characterization of x, given x i -1, as for example the mean i =E[x x i -1]. Then use the lielihood density to calculate the correspondent weights w i =(z i )w i -1 Step 2 Calculate the total weight t= i w i and then normalize the particle weights, that is, for i=1,...,n let w i = t -1 w i Step 3 Resample the particles as follows : Construct the cumulative sum of weights (CSW) by computing c i =c i-1 +w i for i=1,...,n, with c 0 =0 Let i=1and draw a starting point u 1 from the uniform distribution U[0,N -1 ] For j=1,...,n Move along the CSW by maing u j =u 1 +N -1 (j-1) While u j >c i mae i=i+1 Assign sample x j =x i Assign sample w j =N -1 Assign parent i j =i Step 4 j For j=1,...,n draw particles x from the prior density (x x ij -1), using the parent i j, and then use the lielihood density to calculate the correspondent weights w j =(z x j ) / (z ij ) Step 5 Calculate the total weight t= j w j and then normalize the particle weights, that is, for j=1,...,n let w j = t -1 w j The advantage of ASIR over SIR is that it naturally generates points from the sample at -1, which, conditioned on the current measurement, are most liely to be close to the true state. The resampling is based on some point estimate i that characterize (x x i -1), which can be the mean i =E[(x x i -1)] or simply a sample of (x x i -1). If the state evolution model noise is small, (x x i -1) is generally well characterized by i, so that the weights w i are more even and the ASIR algorithm is less sensitive to outliers than the SIR algorithm. On the other hand, if the state evolution model noise is large, the single point estimate i in the state space may not characterize well (x x i -1) and the ASIR algorithm may not be as effective as the SIR algorithm.

52 APPLICATIONS Estimation of the location of the solidification front and the intensity of a line heat sin Bayesian filter Number of Particles (NP) Time RMS error for the solidification front (m) RMS error for the line heat sin intensity (W/m) SIR min. 9x SIR min. 2x SIR min. 1x ASIR min. 7.9x Silva, W. B. Orlande, H. R. B.; Colaço, M. J., Fudym, O., 2011, Application Of Bayesian Filters To A One- Dimensional Solidification Problem, 21st Brazilian Congress of Mechanical Engineering, Natal, RN, Brazil.

53 LOCATION OF THE SOLIDIFICATION FRONTIER (m) LINE HEAT SINK (W/m) APPLICATIONS Estimation of the location of the solidification front and the intensity of a line heat sin ESTIMATED FRONTIER ASIR FILTER NP=100 REAL FRONTIER ESTIMATED FLUX ASIR FILTER NP=100 REAL FLUX TIME (seconds) TIME (seconds) Silva, W. B. Orlande, H. R. B.; Colaço, M. J., Fudym, O., 2011, Application Of Bayesian Filters To A One- Dimensional Solidification Problem, 21st Brazilian Congress of Mechanical Engineering, Natal, RN, Brazil.

54 APPLICATIONS Estimation of Unnown Heat Flux in Natural Convection PHYSICAL PROBLEM The physical problem under picture in this paper involves the transient laminar natural convection of a fluid inside a two-dimensional square cavity. The fluid is initially at rest and at the uniform temperature T c. At time zero, the bottom and top surfaces are subjected to time-dependent heat fluxes q 1 (t) and q 2 (t), respectively. The left and right surfaces are subjected to constant temperatures T c and T h, respectively. The fluid properties are assumed constant, except for the density in the buoyancy term, where we consider Boussinesq s approximation valid. Colaço, M. J., Orlande, H. R. B.; Silva, W. B., Duliravich, G., 2011, Application Of A Bayesian Filter To Estimate Unnown Heat Fluxes In A Natural Convection Problem, ASME 2011 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference, IDETC/CIE 2011, August 29-31, Washington, DC.

55 APPLICATIONS Estimation of Unnown Heat Flux in Natural Convection Colaço, M. J., Orlande, H. R. B.; Silva, W. B., Duliravich, G., 2011, Application Of A Bayesian Filter To Estimate Unnown Heat Fluxes In A Natural Convection Problem, ASME 2011 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference, IDETC/CIE 2011, August 29-31, Washington, DC.

56 APPLICATIONS Estimation of Unnown Heat Flux in Natural Convection Exact Estimated Colaço, M. J., Orlande, H. R. B.; Silva, W. B., Duliravich, G., 2011, Application Of A Bayesian Filter To Estimate Unnown Heat Fluxes In A Natural Convection Problem, ASME 2011 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference, IDETC/CIE 2011, August 29-31, Washington, DC.

57 APPLICATIONS Estimation of Unnown Heat Flux in Natural Convection Exact Estimated Colaço, M. J., Orlande, H. R. B.; Silva, W. B., Duliravich, G., 2011, Application Of A Bayesian Filter To Estimate Unnown Heat Fluxes In A Natural Convection Problem, ASME 2011 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference, IDETC/CIE 2011, August 29-31, Washington, DC.

58 APPLICATIONS Estimation and Control of the Temperature Field in Oil Pipelines The physical problem examined in this wor is based on a critical operational condition involving a pipeline shutdown situation, where the produced fluid is assumed stagnant. An optimal control approach was used to drive the predicted temperatures above a reference level. Heat flux on boundary surface Q (2) (1) Measurement Point (1) R=0 (2) R=1 X-tree Flowline Vianna, F., Orlande, H. R. B., Duliravich, G., 2010, Optimal Heating Control To Prevent Solid Deposits In Pipelines, V European Conference On Computational Fluid Dynamics - ECCOMAS CFD 2010

59 APPLICATIONS The dimensionless mathematical formulation for this onedimensional unsteady heat diffusion problem is given by 2 R, R, 1 R, 2 R R R 0 R 1, 0 R, Bi R R, Q R 1, 0 R, R 1, 0 R, is the dimensionless temperature distribution into the medium. The fluid was considered as homogeneous, isotropic and with constant thermophysical properties.

60 APPLICATIONS Control strategy is in accordance with the optimum control theory for linear problems. The aim of the associated optimal control problem is to find the control inputs u (heat flux on boundary surface) that minimizes the difference between the fluid temperature field and a desired profile. Where u* and x* refer to the steady values of the control input and state variables

61 APPLICATIONS In terms of the linear quadratic regulator problem, the optimal values of the control input are obtained by minimizing the following quadratic cost functional: where the weighting matrices Q and R are symmetric positive definite. The solution to the optimal control problem is the state feedbac control law: where the discrete-time state feedbac gain K is of the form

62 APPLICATIONS Matrix S is the steady state solution to the discrete-time Riccati equation: Thus, the control input can be calculated from the control law as However, when state variables are not directly available for control, an observer (KALMAN FILTER OR PARTICLE FILTER ) was built to estimate the state variables from the input and output variables of the system.

63 APPLICATIONS Simulated measurements with standard deviation of 3 o C in the observation model error

64 Evolution model with standard deviation of 0.01 o C KALMAN FILTER

65 Temperature Predicted with the Kalman Filter and the Exact Temperature Evolution model with standard deviation of 0.01 o C = 0.69

66 Temperature Predicted with the Kalman Filter and the Exact Temperature Evolution model with standard deviation of 0.01 o C = 1.1

67 Evolution model with standard deviation of 1 O C KALMAN FILTER

68 Temperature Predicted with the Kalman Filter and the Exact Temperature Evolution model with standard deviation of 1 o C = 0.61

69 Temperature Predicted with the Kalman Filter and the Exact Temperature Evolution model with standard deviation of 1 o C = 0.8

70 Number of Particles: 200 Evolution model with standard deviation of 1 o C PARTICLE FILTER

71 Temperature Predicted with the Particle Filter and the Exact Temperature Evolution model with standard deviation of 1 o C = 0.69

72 Temperature Predicted with the Particle Filter and the Exact Temperature Evolution model with standard deviation of 1 o C = 1.2

73 Two-dimensional case with Particle Filter Observer (3) (1) (2) Simulated measurements with standard deviation of 3 o C in the observation model error Standard deviation of the evolution model error of 1 o C. Standard deviation of the evolution model error of 3 o C.

74 CONCLUSIONS Kalman filter provides optimal solutions for linear-gaussian evolution-observation models. Particle filter is the most general and robust technique for nonlinear models and/or non-gaussian distributions. ASIR algorithm is faster and requires less particles than the SIR algorithm.

75 ACKNOWLEDGEMENTS Professors Denis Maillet, Philippe Le Masson and Yann Favennec. Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq). Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES). Fundação Carlos Chagas Filho de Amparo à Pesquisa do Estado do Rio de Janeiro (FAPERJ). METTI sponsors.

Mini-course 07: Kalman and Particle Filters Particle Filters Fundamentals, algorithms and applications

Mini-course 07: Kalman and Particle Filters Particle Filters Fundamentals, algorithms and applications Mini-course 07: Kalman and Particle Filters Particle Filters Fundamentals, algorithms and applications Henrique Fonseca & Cesar Pacheco Wellington Betencurte 1 & Julio Dutra 2 Federal University of Espírito

More information

Mini-Course 07 Kalman Particle Filters. Henrique Massard da Fonseca Cesar Cunha Pacheco Wellington Bettencurte Julio Dutra

Mini-Course 07 Kalman Particle Filters. Henrique Massard da Fonseca Cesar Cunha Pacheco Wellington Bettencurte Julio Dutra Mini-Course 07 Kalman Particle Filters Henrique Massard da Fonseca Cesar Cunha Pacheco Wellington Bettencurte Julio Dutra Agenda State Estimation Problems & Kalman Filter Henrique Massard Steady State

More information

OPTIMAL HEATING CONTROL TO PREVENT SOLID DEPOSITS IN PIPELINES

OPTIMAL HEATING CONTROL TO PREVENT SOLID DEPOSITS IN PIPELINES V European Conference on Computational Fluid Dynamics ECCOMAS CFD 2010 J. C. F. Pereira and A. Sequeira (Eds) Lisbon, Portugal, 14 17 June 2010 OPTIMAL HEATING CONTROL TO PREVENT SOLID DEPOSITS IN PIPELINES

More information

A MESHLESS METHOD APPLIED TO THE HEAT TRANSFER ANALYSIS OF A DIESEL ENGINE PISTON

A MESHLESS METHOD APPLIED TO THE HEAT TRANSFER ANALYSIS OF A DIESEL ENGINE PISTON Proceedings of ENCIT 01 Copyright 01 by ABCM November 18-, 01, Rio de Janeiro, RJ, Brazil A MESHLESS METHOD APPLIED TO THE HEAT TRANSFER ANALYSIS OF A DIESEL ENGINE PISTON Marcelo A. Pasqualette, marcelopasqualette@poli.ufrj.br

More information

Particle Filters. Outline

Particle Filters. Outline Particle Filters M. Sami Fadali Professor of EE University of Nevada Outline Monte Carlo integration. Particle filter. Importance sampling. Degeneracy Resampling Example. 1 2 Monte Carlo Integration Numerical

More information

Luiz Augusto D. Reis 1, Helcio R. B. Orlande 2, Daniel Lesnic 3. de Janeiro, UFRJ de Janeiro, UFRJ

Luiz Augusto D. Reis 1, Helcio R. B. Orlande 2, Daniel Lesnic 3. de Janeiro, UFRJ de Janeiro, UFRJ Blucher Mechanical Engineering Proceedings May, vol., num. www.proceedings.blucher.com.br/evento/wccm A COMPARISON OF THE ITERATIVE REGULARIZATION TECHNIQUE AND OF THE MARKOV CHAIN MONTE CARLO METHOD:

More information

State Estimation Problem for the Action Potential Modeling in Purkinje Fibers

State Estimation Problem for the Action Potential Modeling in Purkinje Fibers APCOM & ISCM -4 th Deceber, 203, Singapore State Estiation Proble for the Action Potential Modeling in Purinje Fibers *D. C. Estuano¹, H. R. B.Orlande and M. J.Colaço Federal University of Rio de Janeiro

More information

Some statistical inversion approaches for simultaneous thermal diffusivity and heat source mapping

Some statistical inversion approaches for simultaneous thermal diffusivity and heat source mapping th International Conference on Quantitative InfraRed Thermography Some statistical inversion approaches for simultaneous thermal diffusivity and heat source mapping by H. Massard da Fonseca* & **, H. R.

More information

PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 13: SEQUENTIAL DATA

PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 13: SEQUENTIAL DATA PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 13: SEQUENTIAL DATA Contents in latter part Linear Dynamical Systems What is different from HMM? Kalman filter Its strength and limitation Particle Filter

More information

INVERSE DETERMINATION OF SPATIAL VARIATION OF DIFFUSION COEFFICIENTS IN ARBITRARY OBJECTS CREATING DESIRED NON- ISOTROPY OF FIELD VARIABLES

INVERSE DETERMINATION OF SPATIAL VARIATION OF DIFFUSION COEFFICIENTS IN ARBITRARY OBJECTS CREATING DESIRED NON- ISOTROPY OF FIELD VARIABLES Contributed Papers from Materials Science and Technology (MS&T) 05 October 4 8, 05, Greater Columbus Convention Center, Columbus, Ohio, USA Copyright 05 MS&T5 INVERSE DETERMINATION OF SPATIAL VARIATION

More information

Sensor Fusion: Particle Filter

Sensor Fusion: Particle Filter Sensor Fusion: Particle Filter By: Gordana Stojceska stojcesk@in.tum.de Outline Motivation Applications Fundamentals Tracking People Advantages and disadvantages Summary June 05 JASS '05, St.Petersburg,

More information

Organization. I MCMC discussion. I project talks. I Lecture.

Organization. I MCMC discussion. I project talks. I Lecture. Organization I MCMC discussion I project talks. I Lecture. Content I Uncertainty Propagation Overview I Forward-Backward with an Ensemble I Model Reduction (Intro) Uncertainty Propagation in Causal Systems

More information

Content.

Content. Content Fundamentals of Bayesian Techniques (E. Sucar) Bayesian Filters (O. Aycard) Definition & interests Implementations Hidden Markov models Discrete Bayesian Filters or Markov localization Kalman filters

More information

Proceedings of the 5th International Conference on Inverse Problems in Engineering : Theory and Practice, Cambridge, UK, 11-15th July 2005

Proceedings of the 5th International Conference on Inverse Problems in Engineering : Theory and Practice, Cambridge, UK, 11-15th July 2005 D1 Proceedings of the 5th International Conference on Inverse Problems in Engineering : Theory and Practice, Cambridge, UK, 11-15th July 25 EXPERIMENTAL VALIDATION OF AN EXTENDED KALMAN SMOOTHING TECHNIQUE

More information

Learning based on kernel-pca for abnormal event detection using filtering EWMA-ED.

Learning based on kernel-pca for abnormal event detection using filtering EWMA-ED. Trabalho apresentado no CNMAC, Gramado - RS, 2016. Proceeding Series of the Brazilian Society of Computational and Applied Mathematics Learning based on kernel-pca for abnormal event detection using filtering

More information

O. Wellele 1, H. R. B. Orlande 1, N. Ruperti Jr. 2, M. J. Colaço 3 and A. Delmas 4

O. Wellele 1, H. R. B. Orlande 1, N. Ruperti Jr. 2, M. J. Colaço 3 and A. Delmas 4 IDENTIFICATION OF THE THERMOPHYSICAL PROPERTIES OF ORTHOTROPIC SEMI-TRANSPARENT MATERIALS O. Wellele 1, H. R. B. Orlande 1, N. Ruperti Jr. 2, M. J. Colaço 3 and A. Delmas 4 1 Department of Mechanical Engineering

More information

NUMERICAL SOLUTION FOR THE COMBUSTION OF METHANE IN POROUS MEDIA

NUMERICAL SOLUTION FOR THE COMBUSTION OF METHANE IN POROUS MEDIA NUMERICAL SOLUTION FOR THE COMBUSTION OF METHANE IN POROUS MEDIA E. P. Francisquetti C. Q. Carpes pinto.francisquetti@ufrgs.br charles.carpes@ufrgs.br Graduate Program in Applied Mathematics, Federal University

More information

Lecture 8: Bayesian Estimation of Parameters in State Space Models

Lecture 8: Bayesian Estimation of Parameters in State Space Models in State Space Models March 30, 2016 Contents 1 Bayesian estimation of parameters in state space models 2 Computational methods for parameter estimation 3 Practical parameter estimation in state space

More information

arxiv:hep-ph/ v1 30 Oct 2005

arxiv:hep-ph/ v1 30 Oct 2005 Glueball decay in the Fock-Tani formalism Mario L. L. da Silva, Daniel T. da Silva, Dimiter Hadjimichef, and Cesar A. Z. Vasconcellos arxiv:hep-ph/0510400v1 30 Oct 2005 Instituto de Física, Universidade

More information

EXPLICIT SOLUTIONS FOR THE SOLOMON-WILSON-ALEXIADES S MUSHY ZONE MODEL WITH CONVECTIVE OR HEAT FLUX BOUNDARY CONDITIONS

EXPLICIT SOLUTIONS FOR THE SOLOMON-WILSON-ALEXIADES S MUSHY ZONE MODEL WITH CONVECTIVE OR HEAT FLUX BOUNDARY CONDITIONS EXPLICIT SOLUTIONS FOR THE SOLOMON-WILSON-ALEXIADES S MUSHY ZONE MODEL WITH CONVECTIVE OR HEAT FLUX BOUNDARY CONDITIONS Domingo A. Tarzia 1 Departamento de Matemática, FCE, Universidad Austral, Paraguay

More information

2D Image Processing (Extended) Kalman and particle filter

2D Image Processing (Extended) Kalman and particle filter 2D Image Processing (Extended) Kalman and particle filter Prof. Didier Stricker Dr. Gabriele Bleser Kaiserlautern University http://ags.cs.uni-kl.de/ DFKI Deutsches Forschungszentrum für Künstliche Intelligenz

More information

PERCOLATION PARAMETERS OF BIOMOLECULES ADSORPTION ON TWO-DIMENSIONAL NETWORK SURFACES

PERCOLATION PARAMETERS OF BIOMOLECULES ADSORPTION ON TWO-DIMENSIONAL NETWORK SURFACES Proceedings of COBEM 2009 Copyright 2009 by ABCM 20th International Congress of Mechanical Engineering November 15-20, 2009, Gramado, RS, Brazil PERCOLATION PARAMETERS OF BIOMOLECULES ADSORPTION ON TWO-DIMENSIONAL

More information

Time-Dependent Conduction :

Time-Dependent Conduction : Time-Dependent Conduction : The Lumped Capacitance Method Chapter Five Sections 5.1 thru 5.3 Transient Conduction A heat transfer process for which the temperature varies with time, as well as location

More information

Karl-Rudolf Koch Introduction to Bayesian Statistics Second Edition

Karl-Rudolf Koch Introduction to Bayesian Statistics Second Edition Karl-Rudolf Koch Introduction to Bayesian Statistics Second Edition Karl-Rudolf Koch Introduction to Bayesian Statistics Second, updated and enlarged Edition With 17 Figures Professor Dr.-Ing., Dr.-Ing.

More information

Introduction to Particle Filters for Data Assimilation

Introduction to Particle Filters for Data Assimilation Introduction to Particle Filters for Data Assimilation Mike Dowd Dept of Mathematics & Statistics (and Dept of Oceanography Dalhousie University, Halifax, Canada STATMOS Summer School in Data Assimila5on,

More information

Lecture 6: Multiple Model Filtering, Particle Filtering and Other Approximations

Lecture 6: Multiple Model Filtering, Particle Filtering and Other Approximations Lecture 6: Multiple Model Filtering, Particle Filtering and Other Approximations Department of Biomedical Engineering and Computational Science Aalto University April 28, 2010 Contents 1 Multiple Model

More information

L09. PARTICLE FILTERING. NA568 Mobile Robotics: Methods & Algorithms

L09. PARTICLE FILTERING. NA568 Mobile Robotics: Methods & Algorithms L09. PARTICLE FILTERING NA568 Mobile Robotics: Methods & Algorithms Particle Filters Different approach to state estimation Instead of parametric description of state (and uncertainty), use a set of state

More information

Extended Object and Group Tracking with Elliptic Random Hypersurface Models

Extended Object and Group Tracking with Elliptic Random Hypersurface Models Extended Object and Group Tracing with Elliptic Random Hypersurface Models Marcus Baum Benjamin Noac and Uwe D. Hanebec Intelligent Sensor-Actuator-Systems Laboratory ISAS Institute for Anthropomatics

More information

Drying of Clay Slabs during the Falling Rate Period: Optimization and Simulation of the Process Using Diffusion Models

Drying of Clay Slabs during the Falling Rate Period: Optimization and Simulation of the Process Using Diffusion Models Journal of Materials Science Research; Vol., No. ; 013 ISSN 197-0585 E-ISSN 197-0593 Published by Canadian Center of Science and Education Drying of Clay Slabs during the Falling Rate Period: Optimization

More information

NUMERICAL ANALYSIS OF LIQUID FRACTION AND HEAT FLUX IN THE SOLIDIFICATION PROCESS OF ERYTHRITOL IN SPHERES

NUMERICAL ANALYSIS OF LIQUID FRACTION AND HEAT FLUX IN THE SOLIDIFICATION PROCESS OF ERYTHRITOL IN SPHERES NUMERICAL ANALYSIS OF LIQUID FRACTION AND HEAT FLUX IN THE SOLIDIFICATION PROCESS OF ERYTHRITOL IN SPHERES J. H. N. Ehms, F. A. Bodnar, I. D. R. dos Santos, and R. D. C. Oliveski Universidade do Vale do

More information

The Kalman Filter ImPr Talk

The Kalman Filter ImPr Talk The Kalman Filter ImPr Talk Ged Ridgway Centre for Medical Image Computing November, 2006 Outline What is the Kalman Filter? State Space Models Kalman Filter Overview Bayesian Updating of Estimates Kalman

More information

THERMAL TRANSMITTANCE EVALUATION OF CONCRETE HOLLOW BLOCKS

THERMAL TRANSMITTANCE EVALUATION OF CONCRETE HOLLOW BLOCKS THERMAL TRANSMITTANCE EVALUATION OF CONCRETE HOLLOW BLOCKS Fogiatto M.A. a, Santos G.H. a *and Mendes N. b *Author for correspondence a Federal University of Technology Parana (UTFPR) Mechanical Engineering

More information

NUMERICAL STUDY OF MELTING OF TIN WITHIN A RECTANGULAR CAVITY INCLUDING CONVECTIVE EFFECTS

NUMERICAL STUDY OF MELTING OF TIN WITHIN A RECTANGULAR CAVITY INCLUDING CONVECTIVE EFFECTS NUMERICAL STUDY OF MELTING OF TIN WITHIN A RECTANGULAR CAVITY INCLUDING CONVECTIVE EFFECTS Christiano Garcia da Silva Santim, chrisoff22@yahoo.com.br Luiz Fernando Milanez, milanez@fem.unicamp.br Universidade

More information

Markov Chain Monte Carlo Methods for Stochastic

Markov Chain Monte Carlo Methods for Stochastic Markov Chain Monte Carlo Methods for Stochastic Optimization i John R. Birge The University of Chicago Booth School of Business Joint work with Nicholas Polson, Chicago Booth. JRBirge U Florida, Nov 2013

More information

CIS 390 Fall 2016 Robotics: Planning and Perception Final Review Questions

CIS 390 Fall 2016 Robotics: Planning and Perception Final Review Questions CIS 390 Fall 2016 Robotics: Planning and Perception Final Review Questions December 14, 2016 Questions Throughout the following questions we will assume that x t is the state vector at time t, z t is the

More information

Analysis of Forced Convection Heat Transfer in Microencapsulated Phase Change Material Suspensions

Analysis of Forced Convection Heat Transfer in Microencapsulated Phase Change Material Suspensions JOURNAL OF THERMOPHYSICS AND HEAT TRANSFER Vol. 9, No. 4, October-December 1995 Analysis of Forced Convection Heat Transfer in Microencapsulated Phase Change Material Suspensions Yuwen Zhangh and Amir

More information

Markov Chain Monte Carlo Methods for Stochastic Optimization

Markov Chain Monte Carlo Methods for Stochastic Optimization Markov Chain Monte Carlo Methods for Stochastic Optimization John R. Birge The University of Chicago Booth School of Business Joint work with Nicholas Polson, Chicago Booth. JRBirge U of Toronto, MIE,

More information

Particle Filtering Approaches for Dynamic Stochastic Optimization

Particle Filtering Approaches for Dynamic Stochastic Optimization Particle Filtering Approaches for Dynamic Stochastic Optimization John R. Birge The University of Chicago Booth School of Business Joint work with Nicholas Polson, Chicago Booth. JRBirge I-Sim Workshop,

More information

F denotes cumulative density. denotes probability density function; (.)

F denotes cumulative density. denotes probability density function; (.) BAYESIAN ANALYSIS: FOREWORDS Notation. System means the real thing and a model is an assumed mathematical form for the system.. he probability model class M contains the set of the all admissible models

More information

Lecture 6: Bayesian Inference in SDE Models

Lecture 6: Bayesian Inference in SDE Models Lecture 6: Bayesian Inference in SDE Models Bayesian Filtering and Smoothing Point of View Simo Särkkä Aalto University Simo Särkkä (Aalto) Lecture 6: Bayesian Inference in SDEs 1 / 45 Contents 1 SDEs

More information

MECH 375, Heat Transfer Handout #5: Unsteady Conduction

MECH 375, Heat Transfer Handout #5: Unsteady Conduction 1 MECH 375, Heat Transfer Handout #5: Unsteady Conduction Amir Maleki, Fall 2018 2 T H I S PA P E R P R O P O S E D A C A N C E R T R E AT M E N T T H AT U S E S N A N O PA R T I - C L E S W I T H T U

More information

2D Image Processing. Bayes filter implementation: Kalman filter

2D Image Processing. Bayes filter implementation: Kalman filter 2D Image Processing Bayes filter implementation: Kalman filter Prof. Didier Stricker Kaiserlautern University http://ags.cs.uni-kl.de/ DFKI Deutsches Forschungszentrum für Künstliche Intelligenz http://av.dfki.de

More information

The Unscented Particle Filter

The Unscented Particle Filter The Unscented Particle Filter Rudolph van der Merwe (OGI) Nando de Freitas (UC Bereley) Arnaud Doucet (Cambridge University) Eric Wan (OGI) Outline Optimal Estimation & Filtering Optimal Recursive Bayesian

More information

Target Tracking and Classification using Collaborative Sensor Networks

Target Tracking and Classification using Collaborative Sensor Networks Target Tracking and Classification using Collaborative Sensor Networks Xiaodong Wang Department of Electrical Engineering Columbia University p.1/3 Talk Outline Background on distributed wireless sensor

More information

FUNDAMENTAL FILTERING LIMITATIONS IN LINEAR NON-GAUSSIAN SYSTEMS

FUNDAMENTAL FILTERING LIMITATIONS IN LINEAR NON-GAUSSIAN SYSTEMS FUNDAMENTAL FILTERING LIMITATIONS IN LINEAR NON-GAUSSIAN SYSTEMS Gustaf Hendeby Fredrik Gustafsson Division of Automatic Control Department of Electrical Engineering, Linköpings universitet, SE-58 83 Linköping,

More information

Inverse Heat Flux Evaluation using Conjugate Gradient Methods from Infrared Imaging

Inverse Heat Flux Evaluation using Conjugate Gradient Methods from Infrared Imaging 11 th International Conference on Quantitative InfraRed Thermography Inverse Heat Flux Evaluation using Conjugate Gradient Methods from Infrared Imaging by J. Sousa*, L. Villafane*, S. Lavagnoli*, and

More information

2D Image Processing. Bayes filter implementation: Kalman filter

2D Image Processing. Bayes filter implementation: Kalman filter 2D Image Processing Bayes filter implementation: Kalman filter Prof. Didier Stricker Dr. Gabriele Bleser Kaiserlautern University http://ags.cs.uni-kl.de/ DFKI Deutsches Forschungszentrum für Künstliche

More information

RAO-BLACKWELLIZED PARTICLE FILTER FOR MARKOV MODULATED NONLINEARDYNAMIC SYSTEMS

RAO-BLACKWELLIZED PARTICLE FILTER FOR MARKOV MODULATED NONLINEARDYNAMIC SYSTEMS RAO-BLACKWELLIZED PARTICLE FILTER FOR MARKOV MODULATED NONLINEARDYNAMIC SYSTEMS Saiat Saha and Gustaf Hendeby Linöping University Post Print N.B.: When citing this wor, cite the original article. 2014

More information

Gaussian Process Approximations of Stochastic Differential Equations

Gaussian Process Approximations of Stochastic Differential Equations Gaussian Process Approximations of Stochastic Differential Equations Cédric Archambeau Dan Cawford Manfred Opper John Shawe-Taylor May, 2006 1 Introduction Some of the most complex models routinely run

More information

FIND: (a) Sketch temperature distribution, T(x,t), (b) Sketch the heat flux at the outer surface, q L,t as a function of time.

FIND: (a) Sketch temperature distribution, T(x,t), (b) Sketch the heat flux at the outer surface, q L,t as a function of time. PROBLEM 5.1 NOWN: Electrical heater attached to backside of plate while front surface is exposed to convection process (T,h); initially plate is at a uniform temperature of the ambient air and suddenly

More information

ROBUST PARAMETERS IDENTIFICATION OF THE OXYGEN KINETICS USING THE MAXIMUM ENTROPY PRINCIPLE

ROBUST PARAMETERS IDENTIFICATION OF THE OXYGEN KINETICS USING THE MAXIMUM ENTROPY PRINCIPLE ROBUST PARAMETERS IDENTIFICATION OF THE OXYGEN KINETICS USING THE MAXIMUM ENTROPY PRINCIPLE R. Q. Lima, roberta_10_lima@hotmail.com R. Sampaio, rsampaio@puc-rio.br PUC-Rio, Marquês de São Vicente, 225,

More information

The stable marriage problem with restricted pairs

The stable marriage problem with restricted pairs Theoretical Computer Science 306 (2003) 391 405 www.elsevier.com/locate/tcs The stable marriage problem with restricted pairs Vânia M.F. Dias a, Guilherme D. da Fonseca b, Celina M.H. de Figueiredo c;,

More information

A FEASIBILITY STUDY OF PARTICLE FILTERS FOR MOBILE STATION RECEIVERS. Michael Lunglmayr, Martin Krueger, Mario Huemer

A FEASIBILITY STUDY OF PARTICLE FILTERS FOR MOBILE STATION RECEIVERS. Michael Lunglmayr, Martin Krueger, Mario Huemer A FEASIBILITY STUDY OF PARTICLE FILTERS FOR MOBILE STATION RECEIVERS Michael Lunglmayr, Martin Krueger, Mario Huemer Michael Lunglmayr and Martin Krueger are with Infineon Technologies AG, Munich email:

More information

Spatio-Temporal Models for Areal Data

Spatio-Temporal Models for Areal Data Spatio-Temporal Models for Areal Data Juan C. Vivar (jcvivar@dme.ufrj.br) and Marco A. R. Ferreira (marco@im.ufrj.br) Departamento de Métodos Estatísticos - IM Universidade Federal do Rio de Janeiro (UFRJ)

More information

Introduction to Heat and Mass Transfer. Week 8

Introduction to Heat and Mass Transfer. Week 8 Introduction to Heat and Mass Transfer Week 8 Next Topic Transient Conduction» Analytical Method Plane Wall Radial Systems Semi-infinite Solid Multidimensional Effects Analytical Method Lumped system analysis

More information

Failure Prognostics with Missing Data Using Extended Kalman Filter

Failure Prognostics with Missing Data Using Extended Kalman Filter Failure Prognostics with Missing Data Using Extended Kalman Filter Wlamir Olivares Loesch Vianna 1, and Takashi Yoneyama 2 1 EMBRAER S.A., São José dos Campos, São Paulo, 12227 901, Brazil wlamir.vianna@embraer.com.br

More information

Smoothers: Types and Benchmarks

Smoothers: Types and Benchmarks Smoothers: Types and Benchmarks Patrick N. Raanes Oxford University, NERSC 8th International EnKF Workshop May 27, 2013 Chris Farmer, Irene Moroz Laurent Bertino NERSC Geir Evensen Abstract Talk builds

More information

Bayesian Methods / G.D. Hager S. Leonard

Bayesian Methods / G.D. Hager S. Leonard Bayesian Methods Recall Robot Localization Given Sensor readings z 1, z 2,, z t = z 1:t Known control inputs u 0, u 1, u t = u 0:t Known model t+1 t, u t ) with initial 1 u 0 ) Known map z t t ) Compute

More information

State-Space Methods for Inferring Spike Trains from Calcium Imaging

State-Space Methods for Inferring Spike Trains from Calcium Imaging State-Space Methods for Inferring Spike Trains from Calcium Imaging Joshua Vogelstein Johns Hopkins April 23, 2009 Joshua Vogelstein (Johns Hopkins) State-Space Calcium Imaging April 23, 2009 1 / 78 Outline

More information

Gaussian Mixtures Proposal Density in Particle Filter for Track-Before-Detect

Gaussian Mixtures Proposal Density in Particle Filter for Track-Before-Detect 12th International Conference on Information Fusion Seattle, WA, USA, July 6-9, 29 Gaussian Mixtures Proposal Density in Particle Filter for Trac-Before-Detect Ondřej Straa, Miroslav Šimandl and Jindřich

More information

Transactions on Modelling and Simulation vol 10, 1995 WIT Press, ISSN X

Transactions on Modelling and Simulation vol 10, 1995 WIT Press,   ISSN X Numerical analysis of melting process in a rectangular enclosure J. Goscik Department of Mechanical Engineering, Technical University of Bialystok, 15-351 Bialystok, Wiejska 45C, Poland Abstract In the

More information

Domain estimation under design-based models

Domain estimation under design-based models Domain estimation under design-based models Viviana B. Lencina Departamento de Investigación, FM Universidad Nacional de Tucumán, Argentina Julio M. Singer and Heleno Bolfarine Departamento de Estatística,

More information

Here represents the impulse (or delta) function. is an diagonal matrix of intensities, and is an diagonal matrix of intensities.

Here represents the impulse (or delta) function. is an diagonal matrix of intensities, and is an diagonal matrix of intensities. 19 KALMAN FILTER 19.1 Introduction In the previous section, we derived the linear quadratic regulator as an optimal solution for the fullstate feedback control problem. The inherent assumption was that

More information

Multitarget Particle filter addressing Ambiguous Radar data in TBD

Multitarget Particle filter addressing Ambiguous Radar data in TBD Multitarget Particle filter addressing Ambiguous Radar data in TBD Mélanie Bocquel, Hans Driessen Arun Bagchi Thales Nederland BV - SR TBU Radar Engineering, University of Twente - Department of Applied

More information

Lecture 7: Optimal Smoothing

Lecture 7: Optimal Smoothing Department of Biomedical Engineering and Computational Science Aalto University March 17, 2011 Contents 1 What is Optimal Smoothing? 2 Bayesian Optimal Smoothing Equations 3 Rauch-Tung-Striebel Smoother

More information

Abstract. Nomenclature. A^ = dimensionless half amplitude ' = half amplitude of heat flux variation * - thermal conductivity

Abstract. Nomenclature. A^ = dimensionless half amplitude ' = half amplitude of heat flux variation * - thermal conductivity Unsteady natural connective flow in an enclosure with a periodically varying side wall heat flux PH. Oosthuizen, J.T. Paul Heat Transfer Laboratory, Department ofmechanical Engineering, Queen's University,

More information

The Mixed Labeling Problem in Multi Target Particle Filtering

The Mixed Labeling Problem in Multi Target Particle Filtering The Mixed Labeling Problem in Multi Target Particle Filtering Yvo Boers Thales Nederland B.V. Haasbergerstraat 49, 7554 PA Hengelo, The Netherlands yvo.boers@nl.thalesgroup.com Hans Driessen Thales Nederland

More information

QUESTION ANSWER. . e. Fourier number:

QUESTION ANSWER. . e. Fourier number: QUESTION 1. (0 pts) The Lumped Capacitance Method (a) List and describe the implications of the two major assumptions of the lumped capacitance method. (6 pts) (b) Define the Biot number by equations and

More information

The Effect of the Schedule on the CPU Time for 2D Poisson Equation

The Effect of the Schedule on the CPU Time for 2D Poisson Equation Trabalho apresentado no XXXV CNMAC, Natal-RN, 2014. The Effect of the Schedule on the CPU Time for 2D Poisson Equation Fabiane de Oliveira, State University of Ponta Grossa, Department of Mathematics and

More information

OPTIMAL ESTIMATION of DYNAMIC SYSTEMS

OPTIMAL ESTIMATION of DYNAMIC SYSTEMS CHAPMAN & HALL/CRC APPLIED MATHEMATICS -. AND NONLINEAR SCIENCE SERIES OPTIMAL ESTIMATION of DYNAMIC SYSTEMS John L Crassidis and John L. Junkins CHAPMAN & HALL/CRC A CRC Press Company Boca Raton London

More information

Human Pose Tracking I: Basics. David Fleet University of Toronto

Human Pose Tracking I: Basics. David Fleet University of Toronto Human Pose Tracking I: Basics David Fleet University of Toronto CIFAR Summer School, 2009 Looking at People Challenges: Complex pose / motion People have many degrees of freedom, comprising an articulated

More information

Ariosto B. Jorge Mechanical Engineering Institute Federal University of Itajubá Itajubá, MG, Brazil investigated.

Ariosto B. Jorge Mechanical Engineering Institute Federal University of Itajubá Itajubá, MG, Brazil investigated. A COMPARISON OF EXTENDED KALMAN FILTER APPROACHES USING NON-LINEAR TEMPERATURE AND ULTRASOUND TIME-OF-FLIGHT MEASUREMENT MODELS FOR HEATING SOURCE LOCALIZATION OF A TRANSIENT HEAT TRANSFER PROBLEM Michael

More information

Gaussian Mixture Model

Gaussian Mixture Model Case Study : Document Retrieval MAP EM, Latent Dirichlet Allocation, Gibbs Sampling Machine Learning/Statistics for Big Data CSE599C/STAT59, University of Washington Emily Fox 0 Emily Fox February 5 th,

More information

Documentation of the Solutions to the SFPE Heat Transfer Verification Cases

Documentation of the Solutions to the SFPE Heat Transfer Verification Cases Documentation of the Solutions to the SFPE Heat Transfer Verification Cases Prepared by a Task Group of the SFPE Standards Making Committee on Predicting the Thermal Performance of Fire Resistive Assemblies

More information

For final project discussion every afternoon Mark and I will be available

For final project discussion every afternoon Mark and I will be available Worshop report 1. Daniels report is on website 2. Don t expect to write it based on listening to one project (we had 6 only 2 was sufficient quality) 3. I suggest writing it on one presentation. 4. Include

More information

Extension of the Sparse Grid Quadrature Filter

Extension of the Sparse Grid Quadrature Filter Extension of the Sparse Grid Quadrature Filter Yang Cheng Mississippi State University Mississippi State, MS 39762 Email: cheng@ae.msstate.edu Yang Tian Harbin Institute of Technology Harbin, Heilongjiang

More information

The University of Auckland Applied Mathematics Bayesian Methods for Inverse Problems : why and how Colin Fox Tiangang Cui, Mike O Sullivan (Auckland),

The University of Auckland Applied Mathematics Bayesian Methods for Inverse Problems : why and how Colin Fox Tiangang Cui, Mike O Sullivan (Auckland), The University of Auckland Applied Mathematics Bayesian Methods for Inverse Problems : why and how Colin Fox Tiangang Cui, Mike O Sullivan (Auckland), Geoff Nicholls (Statistics, Oxford) fox@math.auckland.ac.nz

More information

Chapter 5 Time-Dependent Conduction

Chapter 5 Time-Dependent Conduction Chapter 5 Time-Dependent Conduction 5.1 The Lumped Capacitance Method This method assumes spatially uniform solid temperature at any instant during the transient process. It is valid if the temperature

More information

Data Assimilation for Dispersion Models

Data Assimilation for Dispersion Models Data Assimilation for Dispersion Models K. V. Umamaheswara Reddy Dept. of Mechanical and Aerospace Engg. State University of New Yor at Buffalo Buffalo, NY, U.S.A. venatar@buffalo.edu Yang Cheng Dept.

More information

Lagrangian Data Assimilation and Manifold Detection for a Point-Vortex Model. David Darmon, AMSC Kayo Ide, AOSC, IPST, CSCAMM, ESSIC

Lagrangian Data Assimilation and Manifold Detection for a Point-Vortex Model. David Darmon, AMSC Kayo Ide, AOSC, IPST, CSCAMM, ESSIC Lagrangian Data Assimilation and Manifold Detection for a Point-Vortex Model David Darmon, AMSC Kayo Ide, AOSC, IPST, CSCAMM, ESSIC Background Data Assimilation Iterative process Forecast Analysis Background

More information

Sequential Monte Carlo methods for filtering of unobservable components of multidimensional diffusion Markov processes

Sequential Monte Carlo methods for filtering of unobservable components of multidimensional diffusion Markov processes Sequential Monte Carlo methods for filtering of unobservable components of multidimensional diffusion Markov processes Ellida M. Khazen * 13395 Coppermine Rd. Apartment 410 Herndon VA 20171 USA Abstract

More information

Lagrangian Data Assimilation and Its Application to Geophysical Fluid Flows

Lagrangian Data Assimilation and Its Application to Geophysical Fluid Flows Lagrangian Data Assimilation and Its Application to Geophysical Fluid Flows Laura Slivinski June, 3 Laura Slivinski (Brown University) Lagrangian Data Assimilation June, 3 / 3 Data Assimilation Setup:

More information

The impact of neutrino decay on medium-baseline reactor neutrino oscillation experiments

The impact of neutrino decay on medium-baseline reactor neutrino oscillation experiments The impact of neutrino decay on medium-baseline reactor neutrino oscillation experiments Alexander A. Quiroga Departamento de Física, Pontifícia Universidade Católica do Rio de Janeiro, C. P 38071, 22451-970,

More information

X t = a t + r t, (7.1)

X t = a t + r t, (7.1) Chapter 7 State Space Models 71 Introduction State Space models, developed over the past 10 20 years, are alternative models for time series They include both the ARIMA models of Chapters 3 6 and the Classical

More information

Bayesian Approach 2. CSC412 Probabilistic Learning & Reasoning

Bayesian Approach 2. CSC412 Probabilistic Learning & Reasoning CSC412 Probabilistic Learning & Reasoning Lecture 12: Bayesian Parameter Estimation February 27, 2006 Sam Roweis Bayesian Approach 2 The Bayesian programme (after Rev. Thomas Bayes) treats all unnown quantities

More information

Sequential Monte Carlo and Particle Filtering. Frank Wood Gatsby, November 2007

Sequential Monte Carlo and Particle Filtering. Frank Wood Gatsby, November 2007 Sequential Monte Carlo and Particle Filtering Frank Wood Gatsby, November 2007 Importance Sampling Recall: Let s say that we want to compute some expectation (integral) E p [f] = p(x)f(x)dx and we remember

More information

S (13) Reference: FLUID 9791

S (13) Reference: FLUID 9791 Title: A Deduction of the MulticriticalityConditionsof, Mixturesfrom the Gibbs Tangent Plane Criterion Author: Nélio Henderson Wagner.F. Sacco Raimundo A. Rodrigues Jr PII: S0378-3812(13)00550-5 DOI: http://dx.doi.org/doi:10.1016/j.fluid.2013.09.043

More information

Introduction to Machine Learning

Introduction to Machine Learning Introduction to Machine Learning Brown University CSCI 1950-F, Spring 2012 Prof. Erik Sudderth Lecture 25: Markov Chain Monte Carlo (MCMC) Course Review and Advanced Topics Many figures courtesy Kevin

More information

RECURSIVE OUTLIER-ROBUST FILTERING AND SMOOTHING FOR NONLINEAR SYSTEMS USING THE MULTIVARIATE STUDENT-T DISTRIBUTION

RECURSIVE OUTLIER-ROBUST FILTERING AND SMOOTHING FOR NONLINEAR SYSTEMS USING THE MULTIVARIATE STUDENT-T DISTRIBUTION 1 IEEE INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING, SEPT. 3 6, 1, SANTANDER, SPAIN RECURSIVE OUTLIER-ROBUST FILTERING AND SMOOTHING FOR NONLINEAR SYSTEMS USING THE MULTIVARIATE STUDENT-T

More information

NATURAL CONVECTION WITHIN TRAPEZOIDAL ENCLOSURE WITH TWO BAFFLES: EFFECT OF VARIOUS ANGLES OF INCLINATION

NATURAL CONVECTION WITHIN TRAPEZOIDAL ENCLOSURE WITH TWO BAFFLES: EFFECT OF VARIOUS ANGLES OF INCLINATION NATURAL CONVECTION WITHIN TRAPEZOIDAL ENCLOSURE WITH TWO BAFFLES: EFFECT OF VARIOUS ANGLES OF INCLINATION Éliton Fontana, eliton_fontana@hotmail.com Universidade Federal de Santa Catarina - UFSC Adriano

More information

Uncertainty propagation in a sequential model for flood forecasting

Uncertainty propagation in a sequential model for flood forecasting Predictions in Ungauged Basins: Promise and Progress (Proceedings of symposium S7 held during the Seventh IAHS Scientific Assembly at Foz do Iguaçu, Brazil, April 2005). IAHS Publ. 303, 2006. 177 Uncertainty

More information

Numerical software for the inverse estimation of the temperature-dependent thermal properties in heat conduction

Numerical software for the inverse estimation of the temperature-dependent thermal properties in heat conduction Advanced Computational Methods and Experiments in Heat Transfer XII 121 Numerical software for the inverse estimation of the temperature-dependent thermal properties in heat conduction J. Zueco & G. Monreal

More information

Introduction to Heat and Mass Transfer. Week 9

Introduction to Heat and Mass Transfer. Week 9 Introduction to Heat and Mass Transfer Week 9 補充! Multidimensional Effects Transient problems with heat transfer in two or three dimensions can be considered using the solutions obtained for one dimensional

More information

A Comparison of Particle Filters for Personal Positioning

A Comparison of Particle Filters for Personal Positioning VI Hotine-Marussi Symposium of Theoretical and Computational Geodesy May 9-June 6. A Comparison of Particle Filters for Personal Positioning D. Petrovich and R. Piché Institute of Mathematics Tampere University

More information

Thermal Systems. What and How? Physical Mechanisms and Rate Equations Conservation of Energy Requirement Control Volume Surface Energy Balance

Thermal Systems. What and How? Physical Mechanisms and Rate Equations Conservation of Energy Requirement Control Volume Surface Energy Balance Introduction to Heat Transfer What and How? Physical Mechanisms and Rate Equations Conservation of Energy Requirement Control Volume Surface Energy Balance Thermal Resistance Thermal Capacitance Thermal

More information

Machine Learning in Simple Networks. Lars Kai Hansen

Machine Learning in Simple Networks. Lars Kai Hansen Machine Learning in Simple Networs Lars Kai Hansen www.imm.dtu.d/~lh Outline Communities and lin prediction Modularity Modularity as a combinatorial optimization problem Gibbs sampling Detection threshold

More information

M. LeBreux, M. Désilets & M. Lacroix Faculté de génie, Université de Sherbrooke, Canada. Abstract. 1 Introduction

M. LeBreux, M. Désilets & M. Lacroix Faculté de génie, Université de Sherbrooke, Canada. Abstract. 1 Introduction Advanced Computational Methods and Experiments in Heat Transfer XIII 517 Is the performance of a virtual sensor employed for the prediction of the ledge thickness inside a metallurgical reactor affected

More information

Numerical Solutions of ODEs by Gaussian (Kalman) Filtering

Numerical Solutions of ODEs by Gaussian (Kalman) Filtering Numerical Solutions of ODEs by Gaussian (Kalman) Filtering Hans Kersting joint work with Michael Schober, Philipp Hennig, Tim Sullivan and Han C. Lie SIAM CSE, Atlanta March 1, 2017 Emmy Noether Group

More information

Lecture 2: From Linear Regression to Kalman Filter and Beyond

Lecture 2: From Linear Regression to Kalman Filter and Beyond Lecture 2: From Linear Regression to Kalman Filter and Beyond Department of Biomedical Engineering and Computational Science Aalto University January 26, 2012 Contents 1 Batch and Recursive Estimation

More information

The Infinite Gaussian Mixture Model

The Infinite Gaussian Mixture Model The Infinite Gaussian Mixture Model Carl Edward Rasmussen Department of Mathematical Modelling Technical University of Denmar Building 321, DK-2800 Kongens Lyngby, Denmar carl@imm.dtu.d http://bayes.imm.dtu.d

More information