Importance splitting for rare event simulation
|
|
- Shawn Rogers
- 6 years ago
- Views:
Transcription
1 Importance splitting for rare event simulation F. Cerou Inria Rennes Bretagne Atlantique Simulation of hybrid dynamical systems and applications to molecular dynamics September , IHP F. Cerou (Inria) Rare event simulation Hybrid workshop 21 1 / 38
2 Introduction Rare event Low but non-zero probability, say < È(X A) 1 8. It is very important to know this probability, or to generate typical realizations. We assume that we know how to draw (pseudo) realizations of X. Different from extreme values: here we have a model that we can simulate, extreme values refer to some dataset used with purely statistical approaches. Why naive Monte-Carlo does not work? Let p = È(X A). ˆp = N i=1 ½ A (X i ), and the relative mean square error is var(ˆp) p 2 we need N 1/p at least... = 1 p Np. So Two main frameworks: importance sampling vs. importance splitting. Splitting can work with a simulation blackbox, and gives rare trajectories drawn with the original dynamics. F. Cerou (Inria) Rare event simulation Hybrid workshop 21 2 / 38
3 Introduction Some applications Particle transmission [KH51] Queueing networks Air traffic management Satellite versus debris collision Finance Food contaminant exposure Molecular dynamics F. Cerou (Inria) Rare event simulation Hybrid workshop 21 3 / 38
4 Introduction Naive Monte-Carlo N trajectories 1/N 1/N... 1/N 1/N F. Cerou (Inria) Rare event simulation Hybrid workshop 21 4 / 38
5 Introduction Trajectory splitting Splitting and weighting 1/N 1/(2N)... 1/(3N) 1/(4N) 1/(2N) F. Cerou (Inria) Rare event simulation Hybrid workshop 21 5 / 38
6 Introduction Trajectory splitting Splitting (time and number of offsprings) may depend on the past of the current trajectory. With the right weighting, the splitting MC estimates are unbiased. But the goal is to lower the variance, by using a "clever" way of splitting. Consider splitting those trajectories that goes "towards" the rare event. F. Cerou (Inria) Rare event simulation Hybrid workshop 21 6 / 38
7 Multilevel splitting Precise setting X continuous time stochastic process in Ê d, with initial distribution µ. X has almost surely right continuous, left limited trajectories (RCLL). A is a recurrent event for X, i.e. È(X returns to A i.o. ) = 1. Let τ A = inf{t >, X t A} and τ A = inf{t >, X t A }. Consider the rare event A = È(τ A < τ A ). In many cases, A has the following form: A = {x Ê d, φ(x) L} for some scalar continuous function φ, and some real L. F. Cerou (Inria) Rare event simulation Hybrid workshop 21 7 / 38
8 Multilevel splitting Algorithm: fixed splitting Parameters: Splitting levels L 1 < L 2 < < L k < < L for a chosen importance function φ, and mean offspring numbers R. We estimate the #particles reaching L total probability by ˆp n,fs =. NR n 1 L L2 L1 F. Cerou (Inria) Rare event simulation Hybrid workshop 21 8 / 38
9 Multilevel splitting Efficiency How to measure efficiency? Let τ k = inf{t >, φ(x t ) L k } and p k = È(τ k < τ A ). Assume lim k + p k =. Work normalized variance var(ˆp k )w k. Naive Monte-Carlo var(ˆp k,mc )w k = var(ˆp k,mc )N = p k (1 p k ) Definition We define the asymptotic efficiency [GW92] of an estimate ˆp k by log(var(ˆp k )w k ) lim = 2 k + log p k By Jensen inequality, we always have 2 for unbiased estimators. For Naive Monte-Carlo, we get log(var(ˆp k,mc )w k ) log p k = log(p k(1 p k )) log(p k ) = 1+ log(1 p k) log(p k ) 1. F. Cerou (Inria) Rare event simulation Hybrid workshop 21 9 / 38
10 Multilevel splitting Efficiency: fixed splitting log p Assume lim k k + k = logρ exists. From [GHSZ99], we have Theorem Under some mixing conditions, log(var(ˆp k,fs )w k,fs ) lim = 2 for R = 1/ρ, k + log p k and log(var(ˆp k,fs )w k,fs ) lim < 2 for R 1/ρ, k + log p k Fixed splitting efficient only in critical regime. From simulations, it proved to be very sensitive to the branching rate R. But we can choose R adaptively... F. Cerou (Inria) Rare event simulation Hybrid workshop 21 1 / 38
11 Interacting particle systems Fixed effort splitting At each level, we randomly branch N offsprings on the remaining paths. Let ˆp k k 1 = #particles reaching L k N, we estimate the total probability by ˆp n,fe = n k=1ˆp k k 1. L 2 L 1 L 1 x x F. Cerou (Inria) Rare event simulation Hybrid workshop / 38
12 Interacting particle systems Feynman-Kac representation Following [CDLL6] let τ k = inf{t >,φ(x t ) L k }, and T k = τ k τ A. and E[f(X t,t T n ) τ A τ A ] = E[f(X t,t T n ) n k= ½ φ(xtk ) L k ] E[ n, k= ½ φ(xtk ) L k ] È(T A T A ) = E[ n ½ φ(xtk ) L k ]. k= Special case of general Feynman-Kac formula η n (f) = E[f(Z 1,...,Z n ) n k= G k(z k )] E[ n k= G k(z k )] where G k are measurable non-negative functions called potentials. The corresponding Interacting Particle System approximation is exactly the fixed effort splitting algorithm. F. Cerou (Inria) Rare event simulation Hybrid workshop / 38
13 Interacting particle systems Convergence results Once we have our problem in the form of a Feynman-Kac formula, associated with an IPS, we can use directly results in the monograph [DM4]. This includes unbiasedness of ˆp n,fe, SLLN, CLT... Central Limit Theorem: Theorem with σ 2 = n k=1 n 1 + k= N ˆp n,fe p p 1 p k k 1 p k k 1 D N + N(,σ2 ), var(è(φ(x τn ) L X τk,φ(x τk ) L k )) 1 pk k 1 2 È 2. (φ(x τn ) L φ(x τk ) L k ) p k k 1 F. Cerou (Inria) Rare event simulation Hybrid workshop / 38
14 Interacting particle systems Some remarks σ 2 = n k=1 n 1 + k= 1 p k k 1 p k k 1 var(è(φ(x τn ) L X τk,φ(x τk ) L k )) 1 pk k 1 2 È 2. (φ(x τn ) L φ(x τk ) L k ) p k k 1 The vaviance in the second term is zero if the importance function φ is the committor function, i.e. the levels L k define iso-committor surfaces. First term is minimal when all the p k k 1 are equal (optimization with the constraint that their product is p). F. Cerou (Inria) Rare event simulation Hybrid workshop / 38
15 Interacting particle systems Efficiency of fixed effort Theorem ([CDG1]) Under mixing conditions, and provided that the levels are well chosen (in the sense that k, < ρ 1 p k k 1 ρ 2 < 1), we have for some C >. var(ˆp k,fe ) p 2 k [(1+ C (N 1)ρ 1 ) k 1] and thus, taking w k,fe = kn, Corollary lim inf k log(w k,fe var(ˆp k,fe )) log p k logρ 2 log(1+ Almost get efficiency, closer as N gets larger. Paul Dupuis and Yi Cai recently obtained a similar result. C ρ 1 (N 1) ). F. Cerou (Inria) Rare event simulation Hybrid workshop / 38
16 Adaptive level splitting Adaptive splitting To each trajectory X we associate S = sup t τa τ A φ(x t ). Choose K < N, and compute the K/N quantile ˆq 1 of S 1,...,S N. This quantile will be the first level of splitting. ˆq 1 X 1 x X 4 X 3 X 2 F. Cerou (Inria) Rare event simulation Hybrid workshop / 38
17 Adaptive level splitting Adaptive splitting Keep the trajectories above ˆq 1, and split (branch) them when they first corss this level. From the whole N again trajectories, all above ˆq 1, compute ˆq 2, and iterate. ˆq 2 ˆq 1 x F. Cerou (Inria) Rare event simulation Hybrid workshop / 38
18 Adaptive level splitting Convergence of adaptive splitting Only in dimension 1: a.s. convergence and CLT. Theorem ([CG7]) with with p = K N. N(pn ˆp n,as ) σ 2 = p 2 n((n 1) 1 p p L n + N(,σ2 ), + 1 ρ ρ ), Minimal variance in the CLT, but no asyptotic efficiency results. Complexity in nn log N. New version with K = N 1: discard only the lower trajectory at each step. F. Cerou (Inria) Rare event simulation Hybrid workshop / 38
19 Numerical simulations Application to reactive trajectories Let V : Ê d Ê the potential function, consider the overdamped Langevin dynamics: dx t = V(X t )dt + 2β 1 dw t, where β = 1/(k B T) Equilibrium canonical measure: dµ = Z 1 exp( βv(x))dx where Z = exp( βv(x))dx Ê d F. Cerou (Inria) Rare event simulation Hybrid workshop / 38
20 Numerical simulations Reactive trajectories A and B two metastable (recurrent) regions in Ê d. A B Reactive trajectory: piece of equilibrium trajectory that leaves A and goes to B without going back to A in the meantime (excursion from A to B) Problem: one may wait a long time before the trajectory eventually reaches B F. Cerou (Inria) Rare event simulation Hybrid workshop 21 2 / 38
21 Algorithm Reaction coordinate Also called "importance function" in rare event literature Smooth one-dimensional function: such that: ξ : Ê d Ê ξ, A {x Ê d,ξ(x) < z min } and B {x Ê d,ξ(x) > z max }, where z min < z max are two given real numbers Example: ξ(x) = x x A with x A A denotes a reference configuration in A F. Cerou (Inria) Rare event simulation Hybrid workshop / 38
22 Algorithm Committor function It is well known (e.g. Metzner, Schütte and Vanden-Eijnden (26), Vanden-Eijnden, Venturoli, Ciccotti and Elber (28)) that the optimal reaction coordinate/importance function is the committor function q(x) = È(τ A (x) > τ B (x)). q is solution of { V q +β 1 q = in Ê d \(A B), q = on A and q = 1 on B. F. Cerou (Inria) Rare event simulation Hybrid workshop / 38
23 Algorithm Algorithm A B F. Cerou (Inria) Rare event simulation Hybrid workshop / 38
24 Algorithm Algorithm A B F. Cerou (Inria) Rare event simulation Hybrid workshop / 38
25 Algorithm Algorithm A B F. Cerou (Inria) Rare event simulation Hybrid workshop / 38
26 Algorithm Algorithm A B F. Cerou (Inria) Rare event simulation Hybrid workshop / 38
27 Algorithm Algorithm A B F. Cerou (Inria) Rare event simulation Hybrid workshop / 38
28 Algorithm Algorithm A B F. Cerou (Inria) Rare event simulation Hybrid workshop / 38
29 Algorithm Algorithm A B F. Cerou (Inria) Rare event simulation Hybrid workshop / 38
30 Algorithm Algorithm Iterate until all the paths reach Σ max, and keep only those which actually reach B. Initialization: generate a long trajectory "around" A (wait until equilibrium), and keep (a subsample of) the upward crossing points of Σ min, and the corresponding piece of trajectory coming from A. Remark: the algorithm is a kind of adaptive Forward Flux Sampling (e.g. Allen, Valeriani and ten Wolde (29)), or more generally Importance Splitting Diffusion process approximated by Euler scheme. F. Cerou (Inria) Rare event simulation Hybrid workshop 21 3 / 38
31 Algorithm Convergence and efficiency Unbiased estimates ˆp k,ir. In dimension 1, almost have efficiency. In this case var(ˆp k,ir ) = p 2 k (p 1 N k 1) and w k,ir = N log N log p k. log(var(ˆp k,ir )w k,ir ) lim = 2 1 k + log p k N. (Guyader,Hengertner,Matzner-Løber, not yet published). F. Cerou (Inria) Rare event simulation Hybrid workshop / 38
32 Numerical results 1D example Simple example to validate the method against DNS V(x) = x 4 2x 2. This potential has two minima at ±1 and one saddle point at. In this simple one dimensional setting, we set as metastable states A = { 1} and B = {+1}, and the reaction coordinate is taken to be simply ξ(x) = x. We computed the distribution of the duration of the reactive paths. F. Cerou (Inria) Rare event simulation Hybrid workshop / 38
33 Numerical results 1D example Distribution of the length of a reactive path, beta=1 Distribution of the length of a reactive path, beta= algorithm, 1E5 paths DNS, 1E5 paths 1.9 algorithm, 1E5 paths DNS, 1E5 paths probability 1.8 probability time time Distribution of the length of a reactive path, beta=1 Distribution of the length of a reactive path DNS, 1E4 paths algorithm, 1E5 paths beta=1 beta=5 beta=1 beta=15 beta=2 beta=3 beta= probability.6 probability time time F. Cerou (Inria) Rare event simulation Hybrid workshop / 38
34 Numerical results 2D example V(x,y) = 3e x2 (y 1 3 )2 3e x2 (y 5 3 )2 5e (x 1)2 y 2 5e (x+1)2 y 2 +.2x ( y 1 3) 4. as considered by Metzner, Schütte and Vanden-Eijnden (26) V(x,y) x Figure: The potential V. F. Cerou (Inria) Rare event simulation Hybrid workshop / 38 y
35 Numerical results Density of reactive paths Density for beta = 1.67 Density for beta = e e x y x y F. Cerou (Inria) Rare event simulation Hybrid workshop / 38
36 Numerical results Density of reactive paths Density for beta = 1.67 Density for beta = e e x y x y F. Cerou (Inria) Rare event simulation Hybrid workshop / 38
37 y Numerical results y Flux of reactive trajectories Flux of reactive path Flux of reactive path x x Figure: Flux of reactive trajectories, at inverse temperature β = 1.67 on the left, and β = 6.67 on the right. The color indicates the norm of the flux. F. Cerou (Inria) Rare event simulation Hybrid workshop / 38
38 y Numerical results y A few reactive trajectories Reactive paths for beta =1.67 Reactive paths for beta = long path middle path short path 2 long path middle path short path x x Figure: A few reactive paths for β = 1.67 (left), β = 6.67 (right). F. Cerou (Inria) Rare event simulation Hybrid workshop / 38
39 Numerical results F. Cerou, P. Del Moral, et al. A non asymptotic variance theorem for unnormalized feynman-kac particle models. Annales de l IHP, 21. F. Cérou, P. Del Moral, et al. Genetic genealogical models in rare event analysis. Latin American Journal of Probability and Mathematical Statistics, 1, 26. F. Cérou and A. Guyader. Adaptive multilevel splitting for rare event analysis. Stoch. Anal. Appl., 25(2): , 27. P. Del Moral. Feynman-Kac formulae, Genealogical and interacting particle systems with applications. Probability and its Applications. Springer-Verlag, New York, 24. F. Cerou (Inria) Rare event simulation Hybrid workshop / 38
40 Numerical results P. Glasserman, P. Heidelberger, et al. Multilevel splitting for estimating rare event probabilities. Oper. Res., 47(4):585 6, P. W. Glynn and W. Whitt. The asymptotic efficiency of simulation estimators. Oper. Res., 4(3):55 52, H. Kahn and T. Harris. Estimation of particle transmission by random sampling. National Bureau of Standards Appl. Math. Series, 12:27 3, F. Cerou (Inria) Rare event simulation Hybrid workshop / 38
Some recent improvements to importance splitting
Some recent improvements to importance splitting F. Cerou IRISA / INRIA Campus de Beaulieu 35042 RENNES Cédex, France Frederic.Cerou@inria.fr F. Le Gland IRISA / INRIA Campus de Beaulieu 35042 RENNES Cédex,
More informationA Central Limit Theorem for Fleming-Viot Particle Systems Application to the Adaptive Multilevel Splitting Algorithm
A Central Limit Theorem for Fleming-Viot Particle Systems Application to the Algorithm F. Cérou 1,2 B. Delyon 2 A. Guyader 3 M. Rousset 1,2 1 Inria Rennes Bretagne Atlantique 2 IRMAR, Université de Rennes
More informationA Backward Particle Interpretation of Feynman-Kac Formulae
A Backward Particle Interpretation of Feynman-Kac Formulae P. Del Moral Centre INRIA de Bordeaux - Sud Ouest Workshop on Filtering, Cambridge Univ., June 14-15th 2010 Preprints (with hyperlinks), joint
More informationNumerical methods in molecular dynamics and multiscale problems
Numerical methods in molecular dynamics and multiscale problems Two examples T. Lelièvre CERMICS - Ecole des Ponts ParisTech & MicMac project-team - INRIA Horizon Maths December 2012 Introduction The aim
More informationSimulation estimators in a dynamic model for food contaminant exposure
Simulation estimators in a dynamic model for food contaminant exposure Joint work with P. Bertail (CREST LS and Paris X) and Stéphan Clémençon (INRA Mét@risk and Paris X) INRA-Mét@risk, Food Risk Analysis
More informationMean field simulation for Monte Carlo integration. Part II : Feynman-Kac models. P. Del Moral
Mean field simulation for Monte Carlo integration Part II : Feynman-Kac models P. Del Moral INRIA Bordeaux & Inst. Maths. Bordeaux & CMAP Polytechnique Lectures, INLN CNRS & Nice Sophia Antipolis Univ.
More informationSimulation and Estimation of Extreme Quantiles and Extreme Probabilities
Appl Math Optim 2011 64:171 196 DOI 10.1007/s00245-011-9135-z Simulation and Estimation of Extreme Quantiles and Extreme Probabilities Arnaud Guyader icolas Hengartner Eric Matzner-Løber Published online:
More informationConcentration inequalities for Feynman-Kac particle models. P. Del Moral. INRIA Bordeaux & IMB & CMAP X. Journées MAS 2012, SMAI Clermond-Ferrand
Concentration inequalities for Feynman-Kac particle models P. Del Moral INRIA Bordeaux & IMB & CMAP X Journées MAS 2012, SMAI Clermond-Ferrand Some hyper-refs Feynman-Kac formulae, Genealogical & Interacting
More informationEstimating exit rate for rare event dynamical systems by extrapolation
Zuse Institute Berlin Takustr. 7 14195 Berlin Germany JANNES QUER 1 AND MARCUS WEBER 1 Estimating exit rate for rare event dynamical systems by extrapolation 1 Zuse Institute Berlin ZIB Report 15-54 (revised
More informationEffective dynamics for the (overdamped) Langevin equation
Effective dynamics for the (overdamped) Langevin equation Frédéric Legoll ENPC and INRIA joint work with T. Lelièvre (ENPC and INRIA) Enumath conference, MS Numerical methods for molecular dynamics EnuMath
More informationCentral limit theorems for ergodic continuous-time Markov chains with applications to single birth processes
Front. Math. China 215, 1(4): 933 947 DOI 1.17/s11464-15-488-5 Central limit theorems for ergodic continuous-time Markov chains with applications to single birth processes Yuanyuan LIU 1, Yuhui ZHANG 2
More informationThe stochastic modeling
February 211 Gdansk A schedule of the lecture Generation of randomly arranged numbers Monte Carlo Strong Law of Large Numbers SLLN We use SAS 9 For convenience programs will be given in an appendix Programs
More informationAsymptotics and Simulation of Heavy-Tailed Processes
Asymptotics and Simulation of Heavy-Tailed Processes Department of Mathematics Stockholm, Sweden Workshop on Heavy-tailed Distributions and Extreme Value Theory ISI Kolkata January 14-17, 2013 Outline
More informationMathematical Methods for Neurosciences. ENS - Master MVA Paris 6 - Master Maths-Bio ( )
Mathematical Methods for Neurosciences. ENS - Master MVA Paris 6 - Master Maths-Bio (2014-2015) Etienne Tanré - Olivier Faugeras INRIA - Team Tosca November 26th, 2014 E. Tanré (INRIA - Team Tosca) Mathematical
More informationSequential Monte Carlo Methods for Bayesian Computation
Sequential Monte Carlo Methods for Bayesian Computation A. Doucet Kyoto Sept. 2012 A. Doucet (MLSS Sept. 2012) Sept. 2012 1 / 136 Motivating Example 1: Generic Bayesian Model Let X be a vector parameter
More informationImproved diffusion Monte Carlo
Improved diffusion Monte Carlo Jonathan Weare University of Chicago with Martin Hairer (U of Warwick) October 4, 2012 Diffusion Monte Carlo The original motivation for DMC was to compute averages with
More informationIntroduction to rare event simulation
1/35 rare event simulation (some works with colleagues H. Cancela, V. Demers, P. L Ecuyer, G. Rubino) INRIA - Centre Bretagne Atlantique, Rennes Aussois, June 2008, AEP9 Outline 2/35 1 2 3 4 5 Introduction:
More informationAuxiliary Particle Methods
Auxiliary Particle Methods Perspectives & Applications Adam M. Johansen 1 adam.johansen@bristol.ac.uk Oxford University Man Institute 29th May 2008 1 Collaborators include: Arnaud Doucet, Nick Whiteley
More informationRare Events, Splitting, and Quasi-Monte Carlo
Rare Events, Splitting, and Quasi-Monte Carlo PIERRE L ECUYER and VALÉRIE DEMERS Université de Montréal, Canada and BRUNO TUFFIN IRISA INRIA, Rennes, France In the context of rare-event simulation, splitting
More informationBridging the Gap between Center and Tail for Multiscale Processes
Bridging the Gap between Center and Tail for Multiscale Processes Matthew R. Morse Department of Mathematics and Statistics Boston University BU-Keio 2016, August 16 Matthew R. Morse (BU) Moderate Deviations
More information1. Stochastic Processes and filtrations
1. Stochastic Processes and 1. Stoch. pr., A stochastic process (X t ) t T is a collection of random variables on (Ω, F) with values in a measurable space (S, S), i.e., for all t, In our case X t : Ω S
More informationA Central Limit Theorem for Fleming-Viot Particle Systems 1
A Central Limit Theorem for Fleming-Viot Particle Systems 1 Frédéric Cérou 2 IRIA Rennes & IRMAR, France frederic.cerou@inria.fr Bernard Delyon Université Rennes 1 & IRMAR, France bernard.delyon@univ-rennes1.fr
More informationOn different notions of timescales in molecular dynamics
On different notions of timescales in molecular dynamics Origin of Scaling Cascades in Protein Dynamics June 8, 217 IHP Trimester Stochastic Dynamics out of Equilibrium Overview 1. Motivation 2. Definition
More informationMarkov processes and queueing networks
Inria September 22, 2015 Outline Poisson processes Markov jump processes Some queueing networks The Poisson distribution (Siméon-Denis Poisson, 1781-1840) { } e λ λ n n! As prevalent as Gaussian distribution
More informationON COMPOUND POISSON POPULATION MODELS
ON COMPOUND POISSON POPULATION MODELS Martin Möhle, University of Tübingen (joint work with Thierry Huillet, Université de Cergy-Pontoise) Workshop on Probability, Population Genetics and Evolution Centre
More informationAn introduction to particle simulation of rare events
An introduction to particle simulation of rare events P. Del Moral Centre INRIA de Bordeaux - Sud Ouest Workshop OPUS, 29 juin 2010, IHP, Paris P. Del Moral (INRIA) INRIA Bordeaux-Sud Ouest 1 / 33 Outline
More informationUNCERTAINTY FUNCTIONAL DIFFERENTIAL EQUATIONS FOR FINANCE
Surveys in Mathematics and its Applications ISSN 1842-6298 (electronic), 1843-7265 (print) Volume 5 (2010), 275 284 UNCERTAINTY FUNCTIONAL DIFFERENTIAL EQUATIONS FOR FINANCE Iuliana Carmen Bărbăcioru Abstract.
More informationTowards a Theory of Transition Paths
Journal of Statistical Physics, Vol. 123, No. 3, May 2006 ( C 2006 ) DOI: 10.1007/s10955-005-9003-9 Towards a Theory of Transition Paths Weinan E 1 and Eric Vanden-Eijnden 2 Received July 19, 2005; accepted
More informationReaction Pathways of Metastable Markov Chains - LJ clusters Reorganization
Reaction Pathways of Metastable Markov Chains - LJ clusters Reorganization Eric Vanden-Eijnden Courant Institute Spectral approach to metastability - sets, currents, pathways; Transition path theory or
More informationIntroduction to Rare Event Simulation
Introduction to Rare Event Simulation Brown University: Summer School on Rare Event Simulation Jose Blanchet Columbia University. Department of Statistics, Department of IEOR. Blanchet (Columbia) 1 / 31
More informationEFFICIENT SIMULATION FOR LARGE DEVIATION PROBABILITIES OF SUMS OF HEAVY-TAILED INCREMENTS
Proceedings of the 2006 Winter Simulation Conference L. F. Perrone, F. P. Wieland, J. Liu, B. G. Lawson, D. M. Nicol, and R. M. Fujimoto, eds. EFFICIENT SIMULATION FOR LARGE DEVIATION PROBABILITIES OF
More informationMarkov Chains. Arnoldo Frigessi Bernd Heidergott November 4, 2015
Markov Chains Arnoldo Frigessi Bernd Heidergott November 4, 2015 1 Introduction Markov chains are stochastic models which play an important role in many applications in areas as diverse as biology, finance,
More informationTheory and applications of random Poincaré maps
Nils Berglund nils.berglund@univ-orleans.fr http://www.univ-orleans.fr/mapmo/membres/berglund/ Random Dynamical Systems Theory and applications of random Poincaré maps Nils Berglund MAPMO, Université d'orléans,
More informationOn the Goodness-of-Fit Tests for Some Continuous Time Processes
On the Goodness-of-Fit Tests for Some Continuous Time Processes Sergueï Dachian and Yury A. Kutoyants Laboratoire de Mathématiques, Université Blaise Pascal Laboratoire de Statistique et Processus, Université
More informationIntroduction to multiscale modeling and simulation. Explicit methods for ODEs : forward Euler. y n+1 = y n + tf(y n ) dy dt = f(y), y(0) = y 0
Introduction to multiscale modeling and simulation Lecture 5 Numerical methods for ODEs, SDEs and PDEs The need for multiscale methods Two generic frameworks for multiscale computation Explicit methods
More informationFinite temperature analysis of stochastic networks
Finite temperature analysis of stochastic networks Maria Cameron University of Maryland USA Stochastic networks with detailed balance * The generator matrix L = ( L ij ), i, j S L ij 0, i, j S, i j j S
More informationAnomalous transport of particles in Plasma physics
Anomalous transport of particles in Plasma physics L. Cesbron a, A. Mellet b,1, K. Trivisa b, a École Normale Supérieure de Cachan Campus de Ker Lann 35170 Bruz rance. b Department of Mathematics, University
More informationSPLITTING FOR RARE-EVENT SIMULATION. ˆγ n has relative error. RE[ ˆγ n ] = (Var[ ˆγ n]) 1/2
Proceedings of the 2006 Winter Simulation Conference L. F. Perrone, F. P. Wieland, J. Liu, B. G. Lawson, D. M. Nicol, and R. M. Fujimoto, eds. SPLITTING FOR RARE-EVENT SIMULATION Pierre L Ecuyer Valérie
More informationIntroduction. log p θ (y k y 1:k 1 ), k=1
ESAIM: PROCEEDINGS, September 2007, Vol.19, 115-120 Christophe Andrieu & Dan Crisan, Editors DOI: 10.1051/proc:071915 PARTICLE FILTER-BASED APPROXIMATE MAXIMUM LIKELIHOOD INFERENCE ASYMPTOTICS IN STATE-SPACE
More informationSequential maximum likelihood estimation for reflected Ornstein-Uhlenbeck processes
Sequential maximum likelihood estimation for reflected Ornstein-Uhlenbeck processes Chihoon Lee Department of Statistics Colorado State University Fort Collins, CO 8523 Jaya P. N. Bishwal Department of
More informationAn overview of importance splitting for rare event simulation
Home Search Collections Journals About Contact us My IOPscience An overview of importance splitting for rare event simulation This article has been downloaded from IOPscience. Please scroll down to see
More informationStochastic domination in space-time for the supercritical contact process
Stochastic domination in space-time for the supercritical contact process Stein Andreas Bethuelsen joint work with Rob van den Berg (CWI and VU Amsterdam) Workshop on Genealogies of Interacting Particle
More informationStochastic differential equations in neuroscience
Stochastic differential equations in neuroscience Nils Berglund MAPMO, Orléans (CNRS, UMR 6628) http://www.univ-orleans.fr/mapmo/membres/berglund/ Barbara Gentz, Universität Bielefeld Damien Landon, MAPMO-Orléans
More informationA new class of interacting Markov Chain Monte Carlo methods
A new class of interacting Marov Chain Monte Carlo methods P Del Moral, A Doucet INRIA Bordeaux & UBC Vancouver Worshop on Numerics and Stochastics, Helsini, August 2008 Outline 1 Introduction Stochastic
More informationHEAVY-TRAFFIC EXTREME-VALUE LIMITS FOR QUEUES
HEAVY-TRAFFIC EXTREME-VALUE LIMITS FOR QUEUES by Peter W. Glynn Department of Operations Research Stanford University Stanford, CA 94305-4022 and Ward Whitt AT&T Bell Laboratories Murray Hill, NJ 07974-0636
More informationProceedings of the 2014 Winter Simulation Conference A. Tolk, S. D. Diallo, I. O. Ryzhov, L. Yilmaz, S. Buckley, and J. A. Miller, eds.
Proceedings of the 014 Winter Simulation Conference A. Tolk, S. D. Diallo, I. O. Ryzhov, L. Yilmaz, S. Buckley, and J. A. Miller, eds. Rare event simulation in the neighborhood of a rest point Paul Dupuis
More informationImportance sampling of rare events using cross-entropy minimization
Importance sampling of rare events using cross-entropy minimization Carsten Hartmann (BTU Cottbus-Senftenberg), jointly with Christof Schütte (ZIB) & Wei Zhang (FU Berlin), and Omar Kebiri (U Tlemcen)
More informationString method for the Cahn-Hilliard dynamics
String method for the Cahn-Hilliard dynamics Tiejun Li School of Mathematical Sciences Peking University tieli@pku.edu.cn Joint work with Wei Zhang and Pingwen Zhang Outline Background Problem Set-up Algorithms
More informationSimulation methods for stochastic models in chemistry
Simulation methods for stochastic models in chemistry David F. Anderson anderson@math.wisc.edu Department of Mathematics University of Wisconsin - Madison SIAM: Barcelona June 4th, 21 Overview 1. Notation
More informationRARE EVENT SIMULATION FOR STOCHASTIC FIXED POINT EQUATIONS RELATED TO THE SMOOTHING TRANSFORMATION. Jie Xu
Proceedings of the 2013 Winter Simulation Conference R. Pasupathy, S.-H. Kim, A. Tolk, R. Hill, and M. E. Kuhl, eds. RARE EVENT SIMULATION FOR STOCHASTIC FIXED POINT EQUATIONS RELATED TO THE SMOOTHING
More informationJournal of Inequalities in Pure and Applied Mathematics
Journal of Inequalities in Pure and Applied Mathematics ON A HYBRID FAMILY OF SUMMATION INTEGRAL TYPE OPERATORS VIJAY GUPTA AND ESRA ERKUŞ School of Applied Sciences Netaji Subhas Institute of Technology
More informationLecture 2. We now introduce some fundamental tools in martingale theory, which are useful in controlling the fluctuation of martingales.
Lecture 2 1 Martingales We now introduce some fundamental tools in martingale theory, which are useful in controlling the fluctuation of martingales. 1.1 Doob s inequality We have the following maximal
More informationRademacher functions
Rademacher functions Jordan Bell jordan.bell@gmail.com Department of Mathematics, University of Toronto July 6, 4 Binary expansions Define S : {, } N [, ] by Sσ σ k k, σ {, }N. For example, for σ and σ,
More informationStat 710: Mathematical Statistics Lecture 31
Stat 710: Mathematical Statistics Lecture 31 Jun Shao Department of Statistics University of Wisconsin Madison, WI 53706, USA Jun Shao (UW-Madison) Stat 710, Lecture 31 April 13, 2009 1 / 13 Lecture 31:
More informationMean-square Stability Analysis of an Extended Euler-Maruyama Method for a System of Stochastic Differential Equations
Mean-square Stability Analysis of an Extended Euler-Maruyama Method for a System of Stochastic Differential Equations Ram Sharan Adhikari Assistant Professor Of Mathematics Rogers State University Mathematical
More informationIEOR 8100: Topics in OR: Asymptotic Methods in Queueing Theory. Fall 2009, Professor Whitt. Class Lecture Notes: Wednesday, September 9.
IEOR 8100: Topics in OR: Asymptotic Methods in Queueing Theory Fall 2009, Professor Whitt Class Lecture Notes: Wednesday, September 9. Heavy-Traffic Limits for the GI/G/1 Queue 1. The GI/G/1 Queue We will
More informationLectures on Stochastic Stability. Sergey FOSS. Heriot-Watt University. Lecture 4. Coupling and Harris Processes
Lectures on Stochastic Stability Sergey FOSS Heriot-Watt University Lecture 4 Coupling and Harris Processes 1 A simple example Consider a Markov chain X n in a countable state space S with transition probabilities
More informationMean field simulation for Monte Carlo integration. Part I : Intro. nonlinear Markov models (+links integro-diff eq.) P. Del Moral
Mean field simulation for Monte Carlo integration Part I : Intro. nonlinear Markov models (+links integro-diff eq.) P. Del Moral INRIA Bordeaux & Inst. Maths. Bordeaux & CMAP Polytechnique Lectures, INLN
More informationSequential Monte Carlo Methods
University of Pennsylvania Bradley Visitor Lectures October 23, 2017 Introduction Unfortunately, standard MCMC can be inaccurate, especially in medium and large-scale DSGE models: disentangling importance
More informationPractical unbiased Monte Carlo for Uncertainty Quantification
Practical unbiased Monte Carlo for Uncertainty Quantification Sergios Agapiou Department of Statistics, University of Warwick MiR@W day: Uncertainty in Complex Computer Models, 2nd February 2015, University
More informationNegative Association, Ordering and Convergence of Resampling Methods
Negative Association, Ordering and Convergence of Resampling Methods Nicolas Chopin ENSAE, Paristech (Joint work with Mathieu Gerber and Nick Whiteley, University of Bristol) Resampling schemes: Informal
More informationOn Differentiability of Average Cost in Parameterized Markov Chains
On Differentiability of Average Cost in Parameterized Markov Chains Vijay Konda John N. Tsitsiklis August 30, 2002 1 Overview The purpose of this appendix is to prove Theorem 4.6 in 5 and establish various
More informationOn the stability and the applications of interacting particle systems
1/42 On the stability and the applications of interacting particle systems P. Del Moral INRIA Bordeaux Sud Ouest PDE/probability interactions - CIRM, April 2017 Synthesis joint works with A.N. Bishop,
More informationAdvanced computational methods X Selected Topics: SGD
Advanced computational methods X071521-Selected Topics: SGD. In this lecture, we look at the stochastic gradient descent (SGD) method 1 An illustrating example The MNIST is a simple dataset of variety
More informationBoltzmann-Gibbs Preserving Langevin Integrators
Boltzmann-Gibbs Preserving Langevin Integrators Nawaf Bou-Rabee Applied and Comp. Math., Caltech INI Workshop on Markov-Chain Monte-Carlo Methods March 28, 2008 4000 atom cluster simulation Governing Equations
More informationCompeting sources of variance reduction in parallel replica Monte Carlo, and optimization in the low temperature limit
Competing sources of variance reduction in parallel replica Monte Carlo, and optimization in the low temperature limit Paul Dupuis Division of Applied Mathematics Brown University IPAM (J. Doll, M. Snarski,
More informationControlled sequential Monte Carlo
Controlled sequential Monte Carlo Jeremy Heng, Department of Statistics, Harvard University Joint work with Adrian Bishop (UTS, CSIRO), George Deligiannidis & Arnaud Doucet (Oxford) Bayesian Computation
More informationWhere Probability Meets Combinatorics and Statistical Mechanics
Where Probability Meets Combinatorics and Statistical Mechanics Daniel Ueltschi Department of Mathematics, University of Warwick MASDOC, 15 March 2011 Collaboration with V. Betz, N.M. Ercolani, C. Goldschmidt,
More informationUniformly Uniformly-ergodic Markov chains and BSDEs
Uniformly Uniformly-ergodic Markov chains and BSDEs Samuel N. Cohen Mathematical Institute, University of Oxford (Based on joint work with Ying Hu, Robert Elliott, Lukas Szpruch) Centre Henri Lebesgue,
More informationAsymptotic Statistics-III. Changliang Zou
Asymptotic Statistics-III Changliang Zou The multivariate central limit theorem Theorem (Multivariate CLT for iid case) Let X i be iid random p-vectors with mean µ and and covariance matrix Σ. Then n (
More informationEstimating Tail Probabilities of Heavy Tailed Distributions with Asymptotically Zero Relative Error
Estimating Tail Probabilities of Heavy Tailed Distributions with Asymptotically Zero Relative Error S. Juneja Tata Institute of Fundamental Research, Mumbai juneja@tifr.res.in February 28, 2007 Abstract
More informationLarge deviations for weighted random sums
Nonlinear Analysis: Modelling and Control, 2013, Vol. 18, No. 2, 129 142 129 Large deviations for weighted random sums Aurelija Kasparavičiūtė, Leonas Saulis Vilnius Gediminas Technical University Saulėtekio
More informationAnalysis of the Lennard-Jones-38 stochastic network
Analysis of the Lennard-Jones-38 stochastic network Maria Cameron Joint work with E. Vanden-Eijnden Lennard-Jones clusters Pair potential: V(r) = 4e(r -12 - r -6 ) 1. Wales, D. J., Energy landscapes: calculating
More informationUPPER DEVIATIONS FOR SPLIT TIMES OF BRANCHING PROCESSES
Applied Probability Trust 7 May 22 UPPER DEVIATIONS FOR SPLIT TIMES OF BRANCHING PROCESSES HAMED AMINI, AND MARC LELARGE, ENS-INRIA Abstract Upper deviation results are obtained for the split time of a
More informationComputer Intensive Methods in Mathematical Statistics
Computer Intensive Methods in Mathematical Statistics Department of mathematics johawes@kth.se Lecture 16 Advanced topics in computational statistics 18 May 2017 Computer Intensive Methods (1) Plan of
More informationApproximation of BSDEs using least-squares regression and Malliavin weights
Approximation of BSDEs using least-squares regression and Malliavin weights Plamen Turkedjiev (turkedji@math.hu-berlin.de) 3rd July, 2012 Joint work with Prof. Emmanuel Gobet (E cole Polytechnique) Plamen
More informationRandom trees and branching processes
Random trees and branching processes Svante Janson IMS Medallion Lecture 12 th Vilnius Conference and 2018 IMS Annual Meeting Vilnius, 5 July, 2018 Part I. Galton Watson trees Let ξ be a random variable
More informationOn Markov chain Monte Carlo methods for tall data
On Markov chain Monte Carlo methods for tall data Remi Bardenet, Arnaud Doucet, Chris Holmes Paper review by: David Carlson October 29, 2016 Introduction Many data sets in machine learning and computational
More informationRare event simulation for a static distribution
Rare event simulation for a static distribution Frédéric Cérou, Pierre Del Moral, Teddy Furon, Arnaud Guyader To cite this version: Frédéric Cérou, Pierre Del Moral, Teddy Furon, Arnaud Guyader. Rare event
More informationPerfect simulation algorithm of a trajectory under a Feynman-Kac law
Perfect simulation algorithm of a trajectory under a Feynman-Kac law Data Assimilation, 24th-28th September 212, Oxford-Man Institute C. Andrieu, N. Chopin, A. Doucet, S. Rubenthaler University of Bristol,
More informationGillespie s Algorithm and its Approximations. Des Higham Department of Mathematics and Statistics University of Strathclyde
Gillespie s Algorithm and its Approximations Des Higham Department of Mathematics and Statistics University of Strathclyde djh@maths.strath.ac.uk The Three Lectures 1 Gillespie s algorithm and its relation
More informationMathematical Methods for Neurosciences. ENS - Master MVA Paris 6 - Master Maths-Bio ( )
Mathematical Methods for Neurosciences. ENS - Master MVA Paris 6 - Master Maths-Bio (2014-2015) Etienne Tanré - Olivier Faugeras INRIA - Team Tosca October 22nd, 2014 E. Tanré (INRIA - Team Tosca) Mathematical
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 22 12/09/2013. Skorokhod Mapping Theorem. Reflected Brownian Motion
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.7J Fall 213 Lecture 22 12/9/213 Skorokhod Mapping Theorem. Reflected Brownian Motion Content. 1. G/G/1 queueing system 2. One dimensional reflection mapping
More informationApplied Mathematics Letters. Stationary distribution, ergodicity and extinction of a stochastic generalized logistic system
Applied Mathematics Letters 5 (1) 198 1985 Contents lists available at SciVerse ScienceDirect Applied Mathematics Letters journal homepage: www.elsevier.com/locate/aml Stationary distribution, ergodicity
More informationErdős-Renyi random graphs basics
Erdős-Renyi random graphs basics Nathanaël Berestycki U.B.C. - class on percolation We take n vertices and a number p = p(n) with < p < 1. Let G(n, p(n)) be the graph such that there is an edge between
More informationZig-Zag Monte Carlo. Delft University of Technology. Joris Bierkens February 7, 2017
Zig-Zag Monte Carlo Delft University of Technology Joris Bierkens February 7, 2017 Joris Bierkens (TU Delft) Zig-Zag Monte Carlo February 7, 2017 1 / 33 Acknowledgements Collaborators Andrew Duncan Paul
More informationStochastic relations of random variables and processes
Stochastic relations of random variables and processes Lasse Leskelä Helsinki University of Technology 7th World Congress in Probability and Statistics Singapore, 18 July 2008 Fundamental problem of applied
More informationKinetic models of Maxwell type. A brief history Part I
. A brief history Part I Department of Mathematics University of Pavia, Italy Porto Ercole, June 8-10 2008 Summer School METHODS AND MODELS OF KINETIC THEORY Outline 1 Introduction Wild result The central
More informationMarkov Chain Model for ALOHA protocol
Markov Chain Model for ALOHA protocol Laila Daniel and Krishnan Narayanan April 22, 2012 Outline of the talk A Markov chain (MC) model for Slotted ALOHA Basic properties of Discrete-time Markov Chain Stability
More informationStochastic Particle Methods for Rarefied Gases
CCES Seminar WS 2/3 Stochastic Particle Methods for Rarefied Gases Julian Köllermeier RWTH Aachen University Supervisor: Prof. Dr. Manuel Torrilhon Center for Computational Engineering Science Mathematics
More informationProceedings of the 2015 Winter Simulation Conference L. Yilmaz, W. K. V. Chan, I. Moon, T. M. K. Roeder, C. Macal, and M. D. Rossetti, eds.
Proceedings of the 2015 Winter Simulation Conference L. Yilmaz, W. K. V. Chan, I. Moon, T. M. K. Roeder, C. Macal, and M. D. Rossetti, eds. UNBIASED MONTE CARLO COMPUTATION OF SMOOTH FUNCTIONS OF EXPECTATIONS
More informationDerivation of SPDEs for Correlated Random Walk Transport Models in One and Two Dimensions
This article was downloaded by: [Texas Technology University] On: 23 April 2013, At: 07:52 Publisher: Taylor & Francis Informa Ltd Registered in England and Wales Registered Number: 1072954 Registered
More informationMonte Carlo Integration I [RC] Chapter 3
Aula 3. Monte Carlo Integration I 0 Monte Carlo Integration I [RC] Chapter 3 Anatoli Iambartsev IME-USP Aula 3. Monte Carlo Integration I 1 There is no exact definition of the Monte Carlo methods. In the
More informationCover times of random searches
Cover times of random searches by Chupeau et al. NATURE PHYSICS www.nature.com/naturephysics 1 I. DEFINITIONS AND DERIVATION OF THE COVER TIME DISTRIBUTION We consider a random walker moving on a network
More informationExponential martingales: uniform integrability results and applications to point processes
Exponential martingales: uniform integrability results and applications to point processes Alexander Sokol Department of Mathematical Sciences, University of Copenhagen 26 September, 2012 1 / 39 Agenda
More informationComputer Intensive Methods in Mathematical Statistics
Computer Intensive Methods in Mathematical Statistics Department of mathematics johawes@kth.se Lecture 5 Sequential Monte Carlo methods I 31 March 2017 Computer Intensive Methods (1) Plan of today s lecture
More informationComputer Intensive Methods in Mathematical Statistics
Computer Intensive Methods in Mathematical Statistics Department of mathematics johawes@kth.se Lecture 7 Sequential Monte Carlo methods III 7 April 2017 Computer Intensive Methods (1) Plan of today s lecture
More informationSmooth nonparametric estimation of a quantile function under right censoring using beta kernels
Smooth nonparametric estimation of a quantile function under right censoring using beta kernels Chanseok Park 1 Department of Mathematical Sciences, Clemson University, Clemson, SC 29634 Short Title: Smooth
More informationA Dirichlet Form approach to MCMC Optimal Scaling
A Dirichlet Form approach to MCMC Optimal Scaling Giacomo Zanella, Wilfrid S. Kendall, and Mylène Bédard. g.zanella@warwick.ac.uk, w.s.kendall@warwick.ac.uk, mylene.bedard@umontreal.ca Supported by EPSRC
More informationState-dependent Importance Sampling for Rare-event Simulation: An Overview and Recent Advances
State-dependent Importance Sampling for Rare-event Simulation: An Overview and Recent Advances By Jose Blanchet and Henry Lam Columbia University and Boston University February 7, 2011 Abstract This paper
More information