Convergence of Particle Filtering Method for Nonlinear Estimation of Vortex Dynamics

Similar documents
S. Lototsky and B.L. Rozovskii Center for Applied Mathematical Sciences University of Southern California, Los Angeles, CA

Discretization of SDEs: Euler Methods and Beyond

Mathematical Methods for Neurosciences. ENS - Master MVA Paris 6 - Master Maths-Bio ( )

A NEW NONLINEAR FILTER

Nonlinear Filtering Revisited: a Spectral Approach, II

Singular Perturbations of Stochastic Control Problems with Unbounded Fast Variables

The concentration of a drug in blood. Exponential decay. Different realizations. Exponential decay with noise. dc(t) dt.

UNCERTAINTY FUNCTIONAL DIFFERENTIAL EQUATIONS FOR FINANCE

1. Stochastic Processes and filtrations

Bernardo D Auria Stochastic Processes /12. Notes. March 29 th, 2012

On the Uniqueness of Weak Solutions to the 2D Euler Equations

Exact Simulation of Multivariate Itô Diffusions

Homogenization with stochastic differential equations

Stochastic differential equation models in biology Susanne Ditlevsen

. Frobenius-Perron Operator ACC Workshop on Uncertainty Analysis & Estimation. Raktim Bhattacharya

Nonlinear representation, backward SDEs, and application to the Principal-Agent problem

Large Deviations Principles for McKean-Vlasov SDEs, Skeletons, Supports and the law of iterated logarithm

An Introduction to Malliavin calculus and its applications

Lecture 2: From Linear Regression to Kalman Filter and Beyond

The Chaotic Character of the Stochastic Heat Equation

Continuum Mechanics Lecture 5 Ideal fluids

Introduction to Nonlinear Control Lecture # 3 Time-Varying and Perturbed Systems

Mean-field SDE driven by a fractional BM. A related stochastic control problem

Densities for the Navier Stokes equations with noise

ECE276A: Sensing & Estimation in Robotics Lecture 10: Gaussian Mixture and Particle Filtering

Optimal Trade Execution with Instantaneous Price Impact and Stochastic Resilience

Regularization by noise in infinite dimensions

I forgot to mention last time: in the Ito formula for two standard processes, putting

FE610 Stochastic Calculus for Financial Engineers. Stevens Institute of Technology

Some Properties of NSFDEs

This note presents an infinite-dimensional family of exact solutions of the incompressible three-dimensional Euler equations

Generalized Gaussian Bridges of Prediction-Invertible Processes

On continuous time contract theory

Large deviations and averaging for systems of slow fast stochastic reaction diffusion equations.

Partial Differential Equations

Mathematical Methods for Neurosciences. ENS - Master MVA Paris 6 - Master Maths-Bio ( )

The Euler Equations and Non-Local Conservative Riccati Equations

Lecture 2: From Linear Regression to Kalman Filter and Beyond

Backward Stochastic Differential Equations with Infinite Time Horizon

Bridging the Gap between Center and Tail for Multiscale Processes

Nonlinear Systems and Control Lecture # 12 Converse Lyapunov Functions & Time Varying Systems. p. 1/1

Linear SPDEs driven by stationary random distributions

Weak Feller Property and Invariant Measures

Gaussian processes for inference in stochastic differential equations

Optimal transportation and optimal control in a finite horizon framework

Stochastic Differential Equations

Feedback and Time Optimal Control for Quantum Spin Systems. Kazufumi Ito

Stochastic Calculus. Kevin Sinclair. August 2, 2016

LACK OF HÖLDER REGULARITY OF THE FLOW FOR 2D EULER EQUATIONS WITH UNBOUNDED VORTICITY. 1. Introduction

Harnack Inequalities and Applications for Stochastic Equations

SUB-OPTIMAL RISK-SENSITIVE FILTERING FOR THIRD DEGREE POLYNOMIAL STOCHASTIC SYSTEMS

Lecture 1. Stochastic Optimization: Introduction. January 8, 2018

Dynamic and Stochastic Brenier Transport via Hopf-Lax formulae on Was

Polynomial Preserving Jump-Diffusions on the Unit Interval

A stochastic particle system for the Burgers equation.

Theoretical Tutorial Session 2

Ordinary Differential Equation Theory

These slides follow closely the (English) course textbook Pattern Recognition and Machine Learning by Christopher Bishop

State Space Models for Wind Forecast Correction

Continuous Random Variables

Adaptive wavelet decompositions of stochastic processes and some applications

Implementation of Sparse Wavelet-Galerkin FEM for Stochastic PDEs

Strong uniqueness for stochastic evolution equations with possibly unbounded measurable drift term

Hölder continuity of the solution to the 3-dimensional stochastic wave equation

16 1 Basic Facts from Functional Analysis and Banach Lattices

Gaussian Process Approximations of Stochastic Differential Equations

Exact Simulation of Diffusions and Jump Diffusions

Rough Burgers-like equations with multiplicative noise

TWO RESULTS ON MULTIPLE STRATONOVICH INTEGRALS

Stability of Stochastic Differential Equations

An inverse scattering problem in random media

Lecture 6: Bayesian Inference in SDE Models

Euler Equations: local existence

Large Deviations from the Hydrodynamic Limit for a System with Nearest Neighbor Interactions

Uniformly Uniformly-ergodic Markov chains and BSDEs

Stochastic optimal control with rough paths

An introduction to Birkhoff normal form

Multilevel Monte Carlo for Stochastic McKean-Vlasov Equations

Week 2 Notes, Math 865, Tanveer

Asymptotic behaviour of the stochastic Lotka Volterra model

Decay rates for partially dissipative hyperbolic systems

An inverse source problem in optical molecular imaging

Lecture 12: Diffusion Processes and Stochastic Differential Equations

Qualitative behaviour of numerical methods for SDEs and application to homogenization

Stochastic contraction BACS Workshop Chamonix, January 14, 2008

Nonlinear Control. Nonlinear Control Lecture # 3 Stability of Equilibrium Points

19 : Slice Sampling and HMC

Imprecise Filtering for Spacecraft Navigation

Geometric projection of stochastic differential equations

Converse Lyapunov theorem and Input-to-State Stability

13 The martingale problem

The Dirichlet boundary problems for second order parabolic operators satisfying a Carleson condition

p 1 ( Y p dp) 1/p ( X p dp) 1 1 p

Forchheimer Equations in Porous Media - Part III

Continuous Time Finance

Singular Integrals. 1 Calderon-Zygmund decomposition

Uncertainty in Kalman Bucy Filtering

Kolmogorov equations in Hilbert spaces IV

On the stability of filament flows and Schrödinger maps

Week 6 Notes, Math 865, Tanveer

Transcription:

Convergence of Particle Filtering Method for Nonlinear Estimation of Vortex Dynamics Meng Xu Department of Mathematics University of Wyoming February 20, 2010

Outline 1 Nonlinear Filtering Stochastic Vortex Model Particle Filter 2 Solvability of Zakai Equation Convergence of Solutions to Zakai Equation

Outline 1 Nonlinear Filtering Stochastic Vortex Model Particle Filter 2 Solvability of Zakai Equation Convergence of Solutions to Zakai Equation

Nonlinear Filtering Stochastic Vortex Model Particle Filter Introduction to Nonlinear Filtering We begin with a complete probability space (Ω, F, P) on which our stochastic process will be defined. Consider the stochastic differential equation for the signal process X t : dx t = f (X t )dt + σ(x t )dw t (1) Observation process is defined as: dy t = h(x t )dt + db t (2) where W t and B t are uncorrelated noises.

Nonlinear Filtering Stochastic Vortex Model Particle Filter Introduction to Nonlinear Filtering We begin with a complete probability space (Ω, F, P) on which our stochastic process will be defined. Consider the stochastic differential equation for the signal process X t : dx t = f (X t )dt + σ(x t )dw t (1) Observation process is defined as: dy t = h(x t )dt + db t (2) where W t and B t are uncorrelated noises.

Nonlinear Filtering Stochastic Vortex Model Particle Filter Introduction to Nonlinear Filtering The nonlinear filtering problem is to calculate the following conditional expectation π t (ϕ) = E[ϕ(X t ) Y t ] (3) which is the least square estimate for ϕ(x t ) given Y t and satisfies a nonlinear stochastic differential equation, called the Fujisaki-Kallianpur-Kunita [FKK] equation. It is shown that π t (x) can be represented as π t (x) = ρ t (x)/ ρ t (x)dx (4) R d with ρ t (x), unnormalized filtering density, satisfies a linear stochastic differential equation, called the Zakai equation.

Biot-Savart Law Nonlinear Filtering Stochastic Vortex Model Particle Filter By the Green function technique, one can express the relation between u and ω as Biot-Savart Law: u = u + K ω. (5) where K is the rotational part of the Green function, K(x) = (2π x 2 ) 1 ( x 2, x 1 ). (6) Numerically, it is difficult to handle because of its singularity.

Stochastic Vortex Model Nonlinear Filtering Stochastic Vortex Model Particle Filter Denote X i (t) as the position for the i-th point vortice with initial data ξ i, then t t X i (t) = ξ i + u ɛ,s (X i (s))ds+ σ(x i (s))dw s, for i = 1,, N 0 0 (7) with N u ɛ,t (x) = α j K ɛ (x x j (t)), x R 2. (8) j=1 Equation (7) will be the signal process in the nonlinear filtering problem.

Idea of Particle Filter Nonlinear Filtering Stochastic Vortex Model Particle Filter Numerical method for solving Zakai equation. The Monte-Carlo method with correction step. Remove the unlikely particles and multiply those situated in the right areas. Particle filter is also called the sequential Monte-Carlo method.

Idea of Particle Filter Nonlinear Filtering Stochastic Vortex Model Particle Filter Numerical method for solving Zakai equation. The Monte-Carlo method with correction step. Remove the unlikely particles and multiply those situated in the right areas. Particle filter is also called the sequential Monte-Carlo method.

Idea of Particle Filter Nonlinear Filtering Stochastic Vortex Model Particle Filter Numerical method for solving Zakai equation. The Monte-Carlo method with correction step. Remove the unlikely particles and multiply those situated in the right areas. Particle filter is also called the sequential Monte-Carlo method.

Idea of Particle Filter Nonlinear Filtering Stochastic Vortex Model Particle Filter Numerical method for solving Zakai equation. The Monte-Carlo method with correction step. Remove the unlikely particles and multiply those situated in the right areas. Particle filter is also called the sequential Monte-Carlo method.

Uniqueness Result Solvability of Zakai Equation Convergence of Solutions to Zakai Equation Definition An Y t -adapted stochastic process µ t taking value in M(R 2N ) is said to be a measure valued solution to the Zakai equation corresponding to the initial condition µ 0 (dx) = P(x 0 dx Y 0 ), if µ, 1 L 2 ([0, T ] Ω; dt dp), for every t T and T <, µ t, 1 L 2 (Ω, dp) and for any ψ C 2 b (R2N ) the following equality holds P-almost surely. µ t, ψ = µ 0, ψ + t µ s, Lψ ds 0 t + 0 µ s, Mψ dy s, t [0, T ]. (9)

Uniqueness Result Solvability of Zakai Equation Convergence of Solutions to Zakai Equation Theorem Assume a(x) = 1 2 σ(x)σt (x) and h(x) are locally Lipschitz in x and both have quadratic growth, then the solution to the signal process (7) exists and satisfies E sup X(t) 2d k T <, for d = 1, 2,. (10) 0 t T Moreover, the measure valued solution to the Zakai equation is unique.

Moment Estimate Solvability of Zakai Equation Convergence of Solutions to Zakai Equation Lemma For any t 0 and p 2, if h(x n j (t)) g(t) with t 0 g(s) 2 ds < for each t > 0. (11) Then there exists a constant c t,p 1 such that Ẽ[(aj n (t))p ] c t,p 1, j = 1,, n, (12) where a n j (t) = 1 + m k=1 t iε a n j (s)hk (X n j (s))dy k s. (13)

Main Theorem Solvability of Zakai Equation Convergence of Solutions to Zakai Equation Define the F t -adapted random variable ψ n = {ψt n, t 0} by [t/ε] ψt n 1 n := ( a n,iε n j )( 1 n aj n (t)). (14) n Let ρ n = {ρ n t, defined by i=1 j=1 j=1 t 0} be the measure-valued process ρ n t := ψn [t/ε]ε n n j=1 a n j (t)δ X n j (t) (15) ρ n t approximates the solution to the Zakai equation ρ t and formula (15) is the approximation of Kallianpur-Striebel formula.

Main Theorem Solvability of Zakai Equation Convergence of Solutions to Zakai Equation Define the F t -adapted random variable ψ n = {ψt n, t 0} by [t/ε] ψt n 1 n := ( a n,iε n j )( 1 n aj n (t)). (14) n Let ρ n = {ρ n t, defined by i=1 j=1 j=1 t 0} be the measure-valued process ρ n t := ψn [t/ε]ε n n j=1 a n j (t)δ X n j (t) (15) ρ n t approximates the solution to the Zakai equation ρ t and formula (15) is the approximation of Kallianpur-Striebel formula.

Main Theorem Solvability of Zakai Equation Convergence of Solutions to Zakai Equation Define the F t -adapted random variable ψ n = {ψt n, t 0} by [t/ε] ψt n 1 n := ( a n,iε n j )( 1 n aj n (t)). (14) n Let ρ n = {ρ n t, defined by i=1 j=1 j=1 t 0} be the measure-valued process ρ n t := ψn [t/ε]ε n n j=1 a n j (t)δ X n j (t) (15) ρ n t approximates the solution to the Zakai equation ρ t and formula (15) is the approximation of Kallianpur-Striebel formula.

Main Theorem Solvability of Zakai Equation Convergence of Solutions to Zakai Equation Theorem If the coefficients σ and f are globally Lipschitz and have finite initial data. h satisfies the condition in the previous lemma. Then for any T 0, there exists a constant c3 T independent of n such that for any positive φ C b (R 2n ), we have Ẽ[(ρ n t (φ) ρ t (φ)) 2 ] ct 3 n φ 2, t [0, T ]. (16) In particular, for all t 0, ρ n t converges in expectation to ρ t.

Unique solvability of the Zakai equation is obtained for unbounded h. Particle filter convergence of Zakai equation is generalized for h with deterministic L 2 functional bound. Outlook Stochastic vortex model could be analyzed on some Riemannian manifold(i.e. sphere), where coefficients of the model have nice properties. It is interesting to analyze the regularized kernel as ɛ approaches 0 and find its relation with the singular kernel in the Euler equation.

Unique solvability of the Zakai equation is obtained for unbounded h. Particle filter convergence of Zakai equation is generalized for h with deterministic L 2 functional bound. Outlook Stochastic vortex model could be analyzed on some Riemannian manifold(i.e. sphere), where coefficients of the model have nice properties. It is interesting to analyze the regularized kernel as ɛ approaches 0 and find its relation with the singular kernel in the Euler equation.

Unique solvability of the Zakai equation is obtained for unbounded h. Particle filter convergence of Zakai equation is generalized for h with deterministic L 2 functional bound. Outlook Stochastic vortex model could be analyzed on some Riemannian manifold(i.e. sphere), where coefficients of the model have nice properties. It is interesting to analyze the regularized kernel as ɛ approaches 0 and find its relation with the singular kernel in the Euler equation.

Unique solvability of the Zakai equation is obtained for unbounded h. Particle filter convergence of Zakai equation is generalized for h with deterministic L 2 functional bound. Outlook Stochastic vortex model could be analyzed on some Riemannian manifold(i.e. sphere), where coefficients of the model have nice properties. It is interesting to analyze the regularized kernel as ɛ approaches 0 and find its relation with the singular kernel in the Euler equation.

Unique solvability of the Zakai equation is obtained for unbounded h. Particle filter convergence of Zakai equation is generalized for h with deterministic L 2 functional bound. Outlook Stochastic vortex model could be analyzed on some Riemannian manifold(i.e. sphere), where coefficients of the model have nice properties. It is interesting to analyze the regularized kernel as ɛ approaches 0 and find its relation with the singular kernel in the Euler equation.

Thank You!

Thank You!