Monte Carlo Methods in Statistical Mechanics
|
|
- Janis Eaton
- 5 years ago
- Views:
Transcription
1 Monte Carlo Methods in Statistical Mechanics Mario G. Del Pópolo Atomistic Simulation Centre School of Mathematics and Physics Queen s University Belfast Belfast Mario G. Del Pópolo Statistical Mechanics 1 / 35
2 Outline Multidimensional integrals Quadrature vs. random sampling 1 Multidimensional integrals Quadrature vs. random sampling Mario G. Del Pópolo Statistical Mechanics 2 / 35
3 Integrals as averages Quadrature vs. random sampling Standard numerical quadrature: I = Z b a f (x)dx δx NX f (x i ) i=1 Random sampling with distribution function ρ(x): I = Z b a f (x)dx = = Z b «f (x) ρ(x)dx a ρ(x) 1 MX f (x i ) M ρ(x i ) i=1 fi fl f (xi ) ρ(x i ) ρ Mario G. Del Pópolo Statistical Mechanics 3 / 35
4 Uniform sampling Quadrature vs. random sampling Use a random variable X uniformly distributed on [a, b]. Then and I = with variance σ 2 I Z b a f (x)dx = (b a) ρ(x) = 1 b a = I 2 I 2 given by: Z b a f (x)ρ(x)dx = f (x) ρ σ 2 I = (b a) 2 D f (x) 2E ρ f (x) 2 ρ Using N random numbers, x 1,, x N, the integral and its variance are estimated by: 0 1 i N b a NX f (x j ) and si 2 = (b a)2 NX f 2 (x j ) i 2 A N N N N j=1 j=1 Mario G. Del Pópolo Statistical Mechanics 4 / 35
5 Statistical error Multidimensional integrals Quadrature vs. random sampling The standard error in i N is given by: Standard error: σ in = σ I N Decreasing the error by one order of magnitude implies increasing the sample size, N, in two orders of magnitude Mario G. Del Pópolo Statistical Mechanics 5 / 35
6 Outline Multidimensional integrals Quadrature vs. random sampling 1 Multidimensional integrals Quadrature vs. random sampling Mario G. Del Pópolo Statistical Mechanics 6 / 35
7 Quadrature vs. random sampling In the most general case: I = the variance of I is: Z b a f (x)dx = σ 2 I = Z b a Z b and the corresponding estimators are: i N 1 N NX j=1 f (x j ) ρ(x j ) a «f (x) ρ(x)dx = ρ(x) f 2 (x) dx I2 ρ(x) 0 and si 2 = 1 N N fi fl f (xi ) ρ(x i ) ρ 1 NX f 2 (x j ) ρ(x j ) i N 2 A j=1 Mario G. Del Pópolo Statistical Mechanics 7 / 35
8 Quadrature vs. random sampling In the importance sampling method ρ(x) is chosen to be large where f (x) is large and small where f (x) is small A significant random sample is concentrated in the region where f (x) is large, and contributes more to the integral, instead of being distributed uniformly over the whole interval [a, b] Under such conditions the following inequality is fulfilled: b a f 2 (x) dx < (b a) ρ(x) b a f 2 (x)dx The use of ρ(x) reduces the variance, σi 2, with respect to uniform sampling and leads to a lower standard error: σ in = σ I N Mario G. Del Pópolo Statistical Mechanics 8 / 35
9 Importance vs. uniform sampling Quadrature vs. random sampling f (x) = r σ π exp ( σx 2 ) and ρ(x) = 1 1 π 1 + x 2 Mario G. Del Pópolo Statistical Mechanics 9 / 35
10 Outline Multidimensional integrals 1 Multidimensional integrals Quadrature vs. random sampling Mario G. Del Pópolo Statistical Mechanics 10 / 35
11 Calculating ensemble averages In classical statistical mechanics the ensemble average of B(r N, p N ) is calculated as: B e = B(r N, p N )f [N] 0 (r N, p N )dr N dp N with, for example, f [N] 0 (r N, p N ) = 1 exp ( βh) h 3N N! Q N,V,T or f 0 (r N, p N ; N) = exp ( β(h Nµ)) Ξ µ,v,t How to evaluate B e numerically? 6N-dimensional integral quadrature and uniform sampling unfeasible Mario G. Del Pópolo Statistical Mechanics 11 / 35
12 Calculating ensemble averages Solution : generate random configurations according to a distribution W (r N ) so: B c e = R R B(r N )f0 c (r N )dr N B(r N ) ρ(rn ) R = f ρ(r N ) 0 c (r N )dr N f c 0 (r N )dr N R ρ(r N ) f c ρ(r N ) 0 (rn )dr N where we have focused on the configurational contribution to B e. Clearly: B c e = B/ρ ρ 1/ρ ρ where ρ signifies averages over the distribution: W (r N ) = ρ(r N ) f c 0 (r N ) Mario G. Del Pópolo Statistical Mechanics 12 / 35
13 Challenge: What is the most convenient form of ρ(r N )? ρ(r N )must be similar to B c (r N )f c 0 (rn ) Ideal choice ρ(r N ) = f c 0 (rn ) The problem has been rephrased: How to generate a series of random configurations so that each state occurs with probability ρ(r N ) = f c 0 (rn )? Generate a Markov chain of sates, Γ n (r N n ), with a limiting distribution f c 0 (rn ) Mario G. Del Pópolo Statistical Mechanics 13 / 35
14 Outline Multidimensional integrals 1 Multidimensional integrals Quadrature vs. random sampling Mario G. Del Pópolo Statistical Mechanics 14 / 35
15 Multidimensional integrals Markov chain: sequence of random configurations (states or trials) satisfying the following two conditions: 1 The outcome of each trial belongs to a finite set of outcomes Γ 1, Γ 2,, Γ m, called the state space 2 The outcome of each trial depends only on the outcome of the immediately preceding one Conditional probability for sequence of steps: Statement 2 implies: Pr (j, t + 1 i, t; k t 1, t 1; ; k 0, 0) Pr (j, t + 1 i, t; k t 1, t 1; ; k 0, 0) = Pr (j, t + 1 i, t) Markov process Pr (j, t + 1 i, t) = Π ij are the elements of a transition matrix Π linking states Γ i and Γ j Mario G. Del Pópolo Statistical Mechanics 15 / 35
16 Multidimensional integrals Be ρ i (t) the probability of being in state i at time t. Then: ρ j (t) = X i ρ i (t 1)Π ij or using the row vector ρ(t) = (ρ 1 (t), ρ 2 (t), ) and then transition matrix: ρ(t) = ρ(t 1)Π The solution can be written in terms of the left eigenvalues (λ i ) and left eigenvectors (Φ i ) of Π: ρ(t) = X i Φ i λ t i and Φ i Π = λ i Φ i Π is an stochastic matrix so P j Π ij = 1 i. It can be proofed that: 1 λ i 1 i 2 There is at least one eigenvalue equal to unity, let us say λ 1 = 1 3 If the Markov chain is irreducible, there is only one eigenvalue equal to unity Mario G. Del Pópolo Statistical Mechanics 16 / 35
17 Multidimensional integrals According to the previous considerations: X lim ρ(t) = lim Φ i λ t i = Φ 1 t t Φ 1 is the unique limiting distribution of the Markov chain The stationary distribution satisfies: i In statistical mechanics: Φ 1 Π = Φ 1 or ρ 0 Π = ρ 0 ρ 0 : vector with elements ρ 0 (Γ n) (Γ n = position in phase space) Need to determine the elements of Π satisfying: X Π i,j 0 i ; Π i,j = 1 i and X j i ρ i Π ij = ρ j Π i,j must not depend on the normalisation constant (partition function) of ρ 0 Mario G. Del Pópolo Statistical Mechanics 17 / 35
18 Outline Multidimensional integrals 1 Multidimensional integrals Quadrature vs. random sampling Mario G. Del Pópolo Statistical Mechanics 18 / 35
19 Condition of detailed balance A useful trick in searching for a solution of the previous equations is to replace: ρ i Π ij = ρ j ρ i Π ij = ρ j Π ji i Summing over all states i: ρ i Π ij = i i In the practice: ρ j Π ji = ρ j Π ji = ρ j Need to generate a sequence of configurations (states, Γ n ) according to the specified equilibrium distribution ρ 0 (Γ) Use ρ i Π ij = ρ j Π ji and j Π i,j = 1 to build the transition matrix elements in terms of ρ 0 i Mario G. Del Pópolo Statistical Mechanics 19 / 35
20 Outline Multidimensional integrals 1 Multidimensional integrals Quadrature vs. random sampling Mario G. Del Pópolo Statistical Mechanics 20 / 35
21 Metropolis algorithm This is an asymmetrical solution to the previous problem: Π ij = α ij for ρ j ρ i and i j Π ij = α ij (ρ j /ρ i ) for ρ j < ρ i and i j Π ii = 1 j i Π ij α is a symmetrical matrix often called the underlying matrix of the Markov chain Since we use (ρ j /ρ i ) we circumvent the problem of calculating the normalisation factor (partition function) Mario G. Del Pópolo Statistical Mechanics 21 / 35
22 Barker algorithm Symmetrical solution: Barker method Π ij = α ij ρ j /(ρ i + ρ j ) for i j Π ii = 1 j i Π ij In both the Metropolis and the Barker method the Markov chain will be irreducible provided ρ i > 0 i and the underlying symmetric Markov chain is irreducible. Mario G. Del Pópolo Statistical Mechanics 22 / 35
23 The calculation of ensemble average of B(r N, p N ) : B e = B(r N, p N )f [N] 0 (r N, p N )dr N dp N = B id e + B(r N )ρ 0 (r N )(r N )dr N is achieved by averaging over M successive states of the Markov chain. The average converges to the desired value as M. B M = 1 M M t=1 B(r N t ) = r N Γ B(r N )ρ 0 (r N )+O(M 1/2 ) B e +O(M 1/2 ) Non-ergodicity can be a serious problem Mario G. Del Pópolo Statistical Mechanics 23 / 35
24 Outline Multidimensional integrals 1 Multidimensional integrals Quadrature vs. random sampling Mario G. Del Pópolo Statistical Mechanics 24 / 35
25 Sampling the canonical ensemble Aim: Generate a series of particle configurations distributed according to: with ρ 0 (r N ) = exp ( βvn ) Z Z Z = dr N exp ( βv N ) In order to implement the Metropolis algorithm we need to specify α, which satisfies: α ij = α ji For particle n at position r n, α ij is defined as: α ij = 1/N R r i n R α ij = 0 r i n / R Mario G. Del Pópolo Statistical Mechanics 25 / 35
26 Sampling the canonical ensemble Metropolis algorithm: Π ij = α ij for ρ j ρ i and i j Π ij = α ij (ρ j /ρ i ) for ρ j ρ i and i < j Π ii = 1 X Π ij j i for i = j with ρ j = exp ( βvn(rn j )) ρ i exp ( βv N (r N i )) = exp ( βδvji N ) A randomly chosen particle is moved according to α Trial move If δv ji N < 0 then ρ j ρ i and the new configuration is accepted If δv ji N > 0 the new configuration is accepted with probability exp ( βδv ji N ) Mario G. Del Pópolo Statistical Mechanics 26 / 35
27 Organisation of a simulation Read input Initialise Ising H = J X NX s i s j Hs i <ij> i=1 Markov chain Accumulate averages N End of Y run? Write output values Mario G. Del Pópolo Statistical Mechanics 27 / 35
28 Boundary conditions Periodic boundary conditions: Avoid surface effects Periodicity introduces correlations System size N: Finite size effects depend on correlation length and range of interactions Dependence on cell symmetry and shape Configurational energy: The Ewald method (truly periodic b.c.) Truncation of the intermolecular forces: Minimum image plus cutoff x L Mario G. Del Pópolo Statistical Mechanics 28 / 35
29 Assessment of the results The main advantage of Monte Carlo methods is the great flexibility in the choice of the stochastic matrix Π When designing a new MC algorithm or running a MC simulations one must: Ensure the algorithm samples the desired ensemble distribution detailed balance condition Ensure every state can eventually be reached from any other ( Markov chain must be irreducible or ergodic) Test accuracy of random number generator Standard checks on simulation results: Steady-state distribution must be reached (discard initial relaxation) Same distribution must be reached starting from different initial conditions Estimate statistical uncertainties and correlation times Finite size effects Mario G. Del Pópolo Statistical Mechanics 29 / 35
30 Quality of random number generator Set of X-Y coordinates produced with a bad random number generator Coordinates produced with a good random number generator Figure taken from Binder & Landau Mario G. Del Pópolo Statistical Mechanics 30 / 35
31 Time scales Multidimensional integrals Evolution of the internal energy, U, and magentisation, M, in the Ising model in the absence of magentic field. Note: Initial relaxation. The two quantities evolve with different characteristic time scales Intermediate times. Series are stationary and show equilibrium fluctuations Longer time scale. Global spin inversion. Figure taken from Binder & Landau Mario G. Del Pópolo Statistical Mechanics 31 / 35
32 Outline Multidimensional integrals 1 Multidimensional integrals Quadrature vs. random sampling Mario G. Del Pópolo Statistical Mechanics 32 / 35
33 Simulations in other ensembles Isobaric-isothermal ensemble (N, P, T ) allows fluctuations in the volume Grand canonical ensemble (µ, V, T ) allows fluctuations in the number of particles etc, etc. Example: In a Metropolis grand canonical simulation: Particle displacements are accepted with probability: min [1, exp ( βδv ij )] Particles are destroyed with probability: min [1, exp ( βδv ij + ln (N/zV ))], where z = exp (βµ)/ 3 Particles are created with probability: min [1, exp ( βδv ij + ln (zv /(N + 1)))] Mario G. Del Pópolo Statistical Mechanics 33 / 35
34 Comment on biasing and detailed balance Condition of detailed balance: ρ 0 (o) α(o n) P acc(o n) = ρ 0 (n) α(n o) P acc(n o) P acc is the probability that the trial move(o n) will be accepted. For a canonical simulation it follows that: P acc(o n) α(n o) = exp ( βv) P acc(n o) α(o n) Using Metropolis solution, the acceptance rule for a trial MC move is: «α(n o) P acc(o n) = min 1, exp ( βv) α(o n) By biasing the probability to generate a trial conformation, α, one could make the term on right hand side very close to one. In that case almost every trial move will be accepted. Mario G. Del Pópolo Statistical Mechanics 34 / 35
35 Bibliography "Computer Simulations of Liquids", by M. P. Allen, D. J. Tildesley. Oxford University Press, 1987 " A guide to Monte Carlo simulations in Statistical Physics", by D. P. Landau and K. Binder. Cambridge University Press, 2005 "Modern Theoretical Chemistry", Volume 5, part A. Edited by B. Berne, Plenum Press, "The Monte Carlo Methods in the Physical Sciences ", Edited by J. E. Gubernatis, AIP Conference Proceedings, vol 690, " Monte Carlo Methods in Chemical Physics ", Edited by D. Ferguson, J. I. Siepmann and D. G. Truhlar. Advances in Chemical Physics, vol 105, Wiley, Mario G. Del Pópolo Statistical Mechanics 35 / 35
Markov Processes. Stochastic process. Markov process
Markov Processes Stochastic process movement through a series of well-defined states in a way that involves some element of randomness for our purposes, states are microstates in the governing ensemble
More informationMonte Carlo (MC) Simulation Methods. Elisa Fadda
Monte Carlo (MC) Simulation Methods Elisa Fadda 1011-CH328, Molecular Modelling & Drug Design 2011 Experimental Observables A system observable is a property of the system state. The system state i is
More informationUnderstanding Molecular Simulation 2009 Monte Carlo and Molecular Dynamics in different ensembles. Srikanth Sastry
JNCASR August 20, 21 2009 Understanding Molecular Simulation 2009 Monte Carlo and Molecular Dynamics in different ensembles Srikanth Sastry Jawaharlal Nehru Centre for Advanced Scientific Research, Bangalore
More informationNanoscale simulation lectures Statistical Mechanics
Nanoscale simulation lectures 2008 Lectures: Thursdays 4 to 6 PM Course contents: - Thermodynamics and statistical mechanics - Structure and scattering - Mean-field approaches - Inhomogeneous systems -
More informationMonte Carlo Methods. Ensembles (Chapter 5) Biased Sampling (Chapter 14) Practical Aspects
Monte Carlo Methods Ensembles (Chapter 5) Biased Sampling (Chapter 14) Practical Aspects Lecture 1 2 Lecture 1&2 3 Lecture 1&3 4 Different Ensembles Ensemble ame Constant (Imposed) VT Canonical,V,T P PT
More informationWang-Landau Monte Carlo simulation. Aleš Vítek IT4I, VP3
Wang-Landau Monte Carlo simulation Aleš Vítek IT4I, VP3 PART 1 Classical Monte Carlo Methods Outline 1. Statistical thermodynamics, ensembles 2. Numerical evaluation of integrals, crude Monte Carlo (MC)
More informationCE 530 Molecular Simulation
CE 530 Molecular Simulation Lecture 0 Simple Biasing Methods David A. Kofke Department of Chemical Engineering SUNY Buffalo kofke@eng.buffalo.edu 2 Review Monte Carlo simulation Markov chain to generate
More informationMONTE CARLO METHOD. Reference1: Smit Frenkel, Understanding molecular simulation, second edition, Academic press, 2002.
MONTE CARLO METHOD Reference1: Smit Frenkel, Understanding molecular simulation, second edition, Academic press, 2002. Reference 2: David P. Landau., Kurt Binder., A Guide to Monte Carlo Simulations in
More informationCopyright 2001 University of Cambridge. Not to be quoted or copied without permission.
Course MP3 Lecture 4 13/11/2006 Monte Carlo method I An introduction to the use of the Monte Carlo method in materials modelling Dr James Elliott 4.1 Why Monte Carlo? The name derives from the association
More informationStatistical Thermodynamics and Monte-Carlo Evgenii B. Rudnyi and Jan G. Korvink IMTEK Albert Ludwig University Freiburg, Germany
Statistical Thermodynamics and Monte-Carlo Evgenii B. Rudnyi and Jan G. Korvink IMTEK Albert Ludwig University Freiburg, Germany Preliminaries Learning Goals From Micro to Macro Statistical Mechanics (Statistical
More informationMonte Carlo and cold gases. Lode Pollet.
Monte Carlo and cold gases Lode Pollet lpollet@physics.harvard.edu 1 Outline Classical Monte Carlo The Monte Carlo trick Markov chains Metropolis algorithm Ising model critical slowing down Quantum Monte
More informationRandom Walks A&T and F&S 3.1.2
Random Walks A&T 110-123 and F&S 3.1.2 As we explained last time, it is very difficult to sample directly a general probability distribution. - If we sample from another distribution, the overlap will
More informationComputer Vision Group Prof. Daniel Cremers. 11. Sampling Methods: Markov Chain Monte Carlo
Group Prof. Daniel Cremers 11. Sampling Methods: Markov Chain Monte Carlo Markov Chain Monte Carlo In high-dimensional spaces, rejection sampling and importance sampling are very inefficient An alternative
More informationMonte Carlo. Lecture 15 4/9/18. Harvard SEAS AP 275 Atomistic Modeling of Materials Boris Kozinsky
Monte Carlo Lecture 15 4/9/18 1 Sampling with dynamics In Molecular Dynamics we simulate evolution of a system over time according to Newton s equations, conserving energy Averages (thermodynamic properties)
More informationMonte Carlo Molecular Simulation with Isobaric-Isothermal and Gibbs-NPT Ensembles. Thesis by Shouhong Du
Monte Carlo Molecular Simulation with Isobaric-Isothermal and Gibbs-NPT Ensembles Thesis by Shouhong Du In Partial Fulfillment of the Requirements For the Degree of Master of Science King Abdullah University
More informationNumerical integration and importance sampling
2 Numerical integration and importance sampling 2.1 Quadrature Consider the numerical evaluation of the integral I(a, b) = b a dx f(x) Rectangle rule: on small interval, construct interpolating function
More informationMetropolis Monte Carlo simulation of the Ising Model
Metropolis Monte Carlo simulation of the Ising Model Krishna Shrinivas (CH10B026) Swaroop Ramaswamy (CH10B068) May 10, 2013 Modelling and Simulation of Particulate Processes (CH5012) Introduction The Ising
More informationMonte Carlo importance sampling and Markov chain
Monte Carlo importance sampling and Markov chain If a configuration in phase space is denoted by X, the probability for configuration according to Boltzman is ρ(x) e βe(x) β = 1 T (1) How to sample over
More information6 Markov Chain Monte Carlo (MCMC)
6 Markov Chain Monte Carlo (MCMC) The underlying idea in MCMC is to replace the iid samples of basic MC methods, with dependent samples from an ergodic Markov chain, whose limiting (stationary) distribution
More informationEquilibrium, out of equilibrium and consequences
Equilibrium, out of equilibrium and consequences Katarzyna Sznajd-Weron Institute of Physics Wroc law University of Technology, Poland SF-MTPT Katarzyna Sznajd-Weron (WUT) Equilibrium, out of equilibrium
More information4/18/2011. Titus Beu University Babes-Bolyai Department of Theoretical and Computational Physics Cluj-Napoca, Romania
1. Introduction Titus Beu University Babes-Bolyai Department of Theoretical and Computational Physics Cluj-Napoca, Romania Bibliography Computer experiments Ensemble averages and time averages Molecular
More informationNumerical methods for lattice field theory
Numerical methods for lattice field theory Mike Peardon Trinity College Dublin August 9, 2007 Mike Peardon (Trinity College Dublin) Numerical methods for lattice field theory August 9, 2007 1 / 24 Numerical
More informationI. QUANTUM MONTE CARLO METHODS: INTRODUCTION AND BASICS
I. QUANTUM MONTE CARLO METHODS: INTRODUCTION AND BASICS Markus Holzmann LPMMC, UJF, Grenoble, and LPTMC, UPMC, Paris markus@lptl.jussieu.fr http://www.lptl.jussieu.fr/users/markus (Dated: January 24, 2012)
More informationProgress toward a Monte Carlo Simulation of the Ice VI-VII Phase Transition
Progress toward a Monte Carlo Simulation of the Ice VI-VII Phase Transition Christina Gower 2010 NSF/REU PROJECT Physics Department University of Notre Dame Advisor: Dr. Kathie E. Newman August 6, 2010
More informationIntroduction to Path Integral Monte Carlo. Part I.
Introduction to Path Integral Monte Carlo. Part I. Alexey Filinov, Jens Böning, Michael Bonitz Institut für Theoretische Physik und Astrophysik, Christian-Albrechts-Universität zu Kiel, D-24098 Kiel, Germany
More informationLangevin Methods. Burkhard Dünweg Max Planck Institute for Polymer Research Ackermannweg 10 D Mainz Germany
Langevin Methods Burkhard Dünweg Max Planck Institute for Polymer Research Ackermannweg 1 D 55128 Mainz Germany Motivation Original idea: Fast and slow degrees of freedom Example: Brownian motion Replace
More informationParallel Tempering Algorithm in Monte Carlo Simulation
Parallel Tempering Algorithm in Monte Carlo Simulation Tony Cheung (CUHK) Kevin Zhao (CUHK) Mentors: Ying Wai Li (ORNL) Markus Eisenbach (ORNL) Kwai Wong (UTK/ORNL) Metropolis Algorithm on Ising Model
More informationMarkov Chain Monte Carlo Method
Markov Chain Monte Carlo Method Macoto Kikuchi Cybermedia Center, Osaka University 6th July 2017 Thermal Simulations 1 Why temperature 2 Statistical mechanics in a nutshell 3 Temperature in computers 4
More informationMarkov Chain Monte Carlo Methods
Markov Chain Monte Carlo Methods p. /36 Markov Chain Monte Carlo Methods Michel Bierlaire michel.bierlaire@epfl.ch Transport and Mobility Laboratory Markov Chain Monte Carlo Methods p. 2/36 Markov Chains
More informationComputer Vision Group Prof. Daniel Cremers. 14. Sampling Methods
Prof. Daniel Cremers 14. Sampling Methods Sampling Methods Sampling Methods are widely used in Computer Science as an approximation of a deterministic algorithm to represent uncertainty without a parametric
More informationQuantifying Uncertainty
Sai Ravela M. I. T Last Updated: Spring 2013 1 Markov Chain Monte Carlo Monte Carlo sampling made for large scale problems via Markov Chains Monte Carlo Sampling Rejection Sampling Importance Sampling
More informationPhysics 115/242 Monte Carlo simulations in Statistical Physics
Physics 115/242 Monte Carlo simulations in Statistical Physics Peter Young (Dated: May 12, 2007) For additional information on the statistical Physics part of this handout, the first two sections, I strongly
More informationStochastic optimization Markov Chain Monte Carlo
Stochastic optimization Markov Chain Monte Carlo Ethan Fetaya Weizmann Institute of Science 1 Motivation Markov chains Stationary distribution Mixing time 2 Algorithms Metropolis-Hastings Simulated Annealing
More informationNew Physical Principle for Monte-Carlo simulations
EJTP 6, No. 21 (2009) 9 20 Electronic Journal of Theoretical Physics New Physical Principle for Monte-Carlo simulations Michail Zak Jet Propulsion Laboratory California Institute of Technology, Advance
More informationMonte Carlo Methods. Leon Gu CSD, CMU
Monte Carlo Methods Leon Gu CSD, CMU Approximate Inference EM: y-observed variables; x-hidden variables; θ-parameters; E-step: q(x) = p(x y, θ t 1 ) M-step: θ t = arg max E q(x) [log p(y, x θ)] θ Monte
More informationMultiple time step Monte Carlo
JOURNAL OF CHEMICAL PHYSICS VOLUME 117, NUMBER 18 8 NOVEMBER 2002 Multiple time step Monte Carlo Balázs Hetényi a) Department of Chemistry, Princeton University, Princeton, NJ 08544 and Department of Chemistry
More informationComputer Vision Group Prof. Daniel Cremers. 11. Sampling Methods
Prof. Daniel Cremers 11. Sampling Methods Sampling Methods Sampling Methods are widely used in Computer Science as an approximation of a deterministic algorithm to represent uncertainty without a parametric
More informationMarkov Model. Model representing the different resident states of a system, and the transitions between the different states
Markov Model Model representing the different resident states of a system, and the transitions between the different states (applicable to repairable, as well as non-repairable systems) System behavior
More informationThe Monte Carlo Method
The Monte Carlo Method Example: estimate the value of π. Choose X and Y independently and uniformly at random in [0, 1]. Let Pr(Z = 1) = π 4. 4E[Z] = π. { 1 if X Z = 2 + Y 2 1, 0 otherwise, Let Z 1,...,
More informationSupplemental Material for Temperature-sensitive colloidal phase behavior induced by critical Casimir forces
Supplemental Material for Temperature-sensitive colloidal phase behavior induced by critical Casimir forces Minh Triet Dang, 1 Ana Vila Verde, 2 Van Duc Nguyen, 1 Peter G. Bolhuis, 3 and Peter Schall 1
More informationMarkov Chains and MCMC
Markov Chains and MCMC Markov chains Let S = {1, 2,..., N} be a finite set consisting of N states. A Markov chain Y 0, Y 1, Y 2,... is a sequence of random variables, with Y t S for all points in time
More informationMarkov Chain Monte Carlo The Metropolis-Hastings Algorithm
Markov Chain Monte Carlo The Metropolis-Hastings Algorithm Anthony Trubiano April 11th, 2018 1 Introduction Markov Chain Monte Carlo (MCMC) methods are a class of algorithms for sampling from a probability
More informationThe Particle Filter. PD Dr. Rudolph Triebel Computer Vision Group. Machine Learning for Computer Vision
The Particle Filter Non-parametric implementation of Bayes filter Represents the belief (posterior) random state samples. by a set of This representation is approximate. Can represent distributions that
More information8. Statistical Equilibrium and Classification of States: Discrete Time Markov Chains
8. Statistical Equilibrium and Classification of States: Discrete Time Markov Chains 8.1 Review 8.2 Statistical Equilibrium 8.3 Two-State Markov Chain 8.4 Existence of P ( ) 8.5 Classification of States
More informationPattern Recognition and Machine Learning. Bishop Chapter 11: Sampling Methods
Pattern Recognition and Machine Learning Chapter 11: Sampling Methods Elise Arnaud Jakob Verbeek May 22, 2008 Outline of the chapter 11.1 Basic Sampling Algorithms 11.2 Markov Chain Monte Carlo 11.3 Gibbs
More informationMethods of Computer Simulation. Molecular Dynamics and Monte Carlo
Molecular Dynamics Time is of the essence in biological processes therefore how do we understand time-dependent processes at the molecular level? How do we do this experimentally? How do we do this computationally?
More informationClassical Monte-Carlo simulations
Classical Monte-Carlo simulations Graduate Summer Institute Complex Plasmas at the Stevens Insitute of Technology Henning Baumgartner, A. Filinov, H. Kählert, P. Ludwig and M. Bonitz Christian-Albrechts-University
More informationWang-Landau sampling for Quantum Monte Carlo. Stefan Wessel Institut für Theoretische Physik III Universität Stuttgart
Wang-Landau sampling for Quantum Monte Carlo Stefan Wessel Institut für Theoretische Physik III Universität Stuttgart Overview Classical Monte Carlo First order phase transitions Classical Wang-Landau
More informationLaw of large numbers for Markov chains
Chapter 14 Law of large numbers for Markov chains In this chapter we consider the equilibrium state of a Markov chain in the long run limit of many steps. This limit of observing the dynamic chain over
More informationA Brief Introduction to Statistical Mechanics
A Brief Introduction to Statistical Mechanics E. J. Maginn, J. K. Shah Department of Chemical and Biomolecular Engineering University of Notre Dame Notre Dame, IN 46556 USA Monte Carlo Workshop Universidade
More informationELEC633: Graphical Models
ELEC633: Graphical Models Tahira isa Saleem Scribe from 7 October 2008 References: Casella and George Exploring the Gibbs sampler (1992) Chib and Greenberg Understanding the Metropolis-Hastings algorithm
More informationSummary of Results on Markov Chains. Abstract
Summary of Results on Markov Chains Enrico Scalas 1, 1 Laboratory on Complex Systems. Dipartimento di Scienze e Tecnologie Avanzate, Università del Piemonte Orientale Amedeo Avogadro, Via Bellini 25 G,
More informationHomework 2 will be posted by tomorrow morning, due Friday, October 16 at 5 PM.
Stationary Distributions: Application Monday, October 05, 2015 2:04 PM Homework 2 will be posted by tomorrow morning, due Friday, October 16 at 5 PM. To prepare to describe the conditions under which the
More informationClassical Monte Carlo Simulations
Classical Monte Carlo Simulations Hyejin Ju April 17, 2012 1 Introduction Why do we need numerics? One of the main goals of condensed matter is to compute expectation values O = 1 Z Tr{O e βĥ} (1) and
More informationthe renormalization group (RG) idea
the renormalization group (RG) idea Block Spin Partition function Z =Tr s e H. block spin transformation (majority rule) T (s, if s i ; s,...,s 9 )= s i > 0; 0, otherwise. b Block Spin (block-)transformed
More informationA =, where d n w = dw
Chapter 9 Monte Carlo Simulations So far we have either dealt with exactly soluble systems like the (time-dependent) oscillator or with various expansions like the semiclassical, perturbative and high-temperature
More informationAdvanced Sampling Algorithms
+ Advanced Sampling Algorithms + Mobashir Mohammad Hirak Sarkar Parvathy Sudhir Yamilet Serrano Llerena Advanced Sampling Algorithms Aditya Kulkarni Tobias Bertelsen Nirandika Wanigasekara Malay Singh
More informationIntroduction to Bayesian methods in inverse problems
Introduction to Bayesian methods in inverse problems Ville Kolehmainen 1 1 Department of Applied Physics, University of Eastern Finland, Kuopio, Finland March 4 2013 Manchester, UK. Contents Introduction
More informationSobol-Hoeffding Decomposition with Application to Global Sensitivity Analysis
Sobol-Hoeffding decomposition Application to Global SA Computation of the SI Sobol-Hoeffding Decomposition with Application to Global Sensitivity Analysis Olivier Le Maître with Colleague & Friend Omar
More informationMarkov Chain Monte Carlo Inference. Siamak Ravanbakhsh Winter 2018
Graphical Models Markov Chain Monte Carlo Inference Siamak Ravanbakhsh Winter 2018 Learning objectives Markov chains the idea behind Markov Chain Monte Carlo (MCMC) two important examples: Gibbs sampling
More informationMonte Caro simulations
Monte Caro simulations Monte Carlo methods - based on random numbers Stanislav Ulam s terminology - his uncle frequented the Casino in Monte Carlo Random (pseudo random) number generator on the computer
More informationMarkov Chains and Stochastic Sampling
Part I Markov Chains and Stochastic Sampling 1 Markov Chains and Random Walks on Graphs 1.1 Structure of Finite Markov Chains We shall only consider Markov chains with a finite, but usually very large,
More informationOn the Calculation of the Chemical Potential. Using the Particle Deletion Scheme
On the Calculation of the Chemical Potential Using the Particle Deletion Scheme Georgios C. Boulougouris,2, Ioannis G. Economou and Doros. Theodorou,3,* Molecular Modelling of Materials Laboratory, Institute
More informationErgodicity and Non-Ergodicity in Economics
Abstract An stochastic system is called ergodic if it tends in probability to a limiting form that is independent of the initial conditions. Breakdown of ergodicity gives rise to path dependence. We illustrate
More informationThermodynamics and Phase Diagrams from Cluster Expansions
Thermodynamics and Phase Diagrams from Cluster Expansions Dane Morgan University of Wisconsin, ddmorgan@wisc.edu SUMMER SCHOOL ON COMPUTATIONAL MATERIALS SCIENCE Hands-on introduction to Electronic Structure
More informationComputer simulation methods (1) Dr. Vania Calandrini
Computer simulation methods (1) Dr. Vania Calandrini Why computational methods To understand and predict the properties of complex systems (many degrees of freedom): liquids, solids, adsorption of molecules
More informationMarkov Chains, Random Walks on Graphs, and the Laplacian
Markov Chains, Random Walks on Graphs, and the Laplacian CMPSCI 791BB: Advanced ML Sridhar Mahadevan Random Walks! There is significant interest in the problem of random walks! Markov chain analysis! Computer
More informationExpectations, Markov chains, and the Metropolis algorithm
Expectations, Markov chains, and the Metropolis algorithm Peter Hoff Departments of Statistics and Biostatistics and the Center for Statistics and the Social Sciences University of Washington 7-27-05 1
More informationBrief Review of Statistical Mechanics
Brief Review of Statistical Mechanics Introduction Statistical mechanics: a branch of physics which studies macroscopic systems from a microscopic or molecular point of view (McQuarrie,1976) Also see (Hill,1986;
More informationMetropolis/Variational Monte Carlo. Microscopic Theories of Nuclear Structure, Dynamics and Electroweak Currents June 12-30, 2017, ECT*, Trento, Italy
Metropolis/Variational Monte Carlo Stefano Gandolfi Los Alamos National Laboratory (LANL) Microscopic Theories of Nuclear Structure, Dynamics and Electroweak Currents June 12-30, 2017, ECT*, Trento, Italy
More informationThe Monte Carlo Method An Introduction to Markov Chain MC
The Monte Carlo Method An Introduction to Markov Chain MC Sachin Shanbhag Department of Scientific Computing, Florida State University Sources. Introduction to Monte Carlo Algorithms : Werner Krauth. Available
More informationThree examples of a Practical Exact Markov Chain Sampling
Three examples of a Practical Exact Markov Chain Sampling Zdravko Botev November 2007 Abstract We present three examples of exact sampling from complex multidimensional densities using Markov Chain theory
More informationMarkov Chain Monte Carlo Simulations and Their Statistical Analysis An Overview
Markov Chain Monte Carlo Simulations and Their Statistical Analysis An Overview Bernd Berg FSU, August 30, 2005 Content 1. Statistics as needed 2. Markov Chain Monte Carlo (MC) 3. Statistical Analysis
More informationJ ij S i S j B i S i (1)
LECTURE 18 The Ising Model (References: Kerson Huang, Statistical Mechanics, Wiley and Sons (1963) and Colin Thompson, Mathematical Statistical Mechanics, Princeton Univ. Press (1972)). One of the simplest
More informationComputational Physics (6810): Session 13
Computational Physics (6810): Session 13 Dick Furnstahl Nuclear Theory Group OSU Physics Department April 14, 2017 6810 Endgame Various recaps and followups Random stuff (like RNGs :) Session 13 stuff
More informationfiziks Institute for NET/JRF, GATE, IIT-JAM, JEST, TIFR and GRE in PHYSICAL SCIENCES
Content-Thermodynamics & Statistical Mechanics 1. Kinetic theory of gases..(1-13) 1.1 Basic assumption of kinetic theory 1.1.1 Pressure exerted by a gas 1.2 Gas Law for Ideal gases: 1.2.1 Boyle s Law 1.2.2
More information3.320: Lecture 19 (4/14/05) Free Energies and physical Coarse-graining. ,T) + < σ > dµ
3.320: Lecture 19 (4/14/05) F(µ,T) = F(µ ref,t) + < σ > dµ µ µ ref Free Energies and physical Coarse-graining T S(T) = S(T ref ) + T T ref C V T dt Non-Boltzmann sampling and Umbrella sampling Simple
More informationLECTURE 10: Monte Carlo Methods II
1 LECTURE 10: Monte Carlo Methods II In this chapter, we discuss more advanced Monte Carlo techniques, starting with the topics of percolation and random walks, and then continuing to equilibrium statistical
More informationFinite-Horizon Statistics for Markov chains
Analyzing FSDT Markov chains Friday, September 30, 2011 2:03 PM Simulating FSDT Markov chains, as we have said is very straightforward, either by using probability transition matrix or stochastic update
More informationTypical quantum states at finite temperature
Typical quantum states at finite temperature How should one think about typical quantum states at finite temperature? Density Matrices versus pure states Why eigenstates are not typical Measuring the heat
More informationIntroduction to Machine Learning CMU-10701
Introduction to Machine Learning CMU-10701 Markov Chain Monte Carlo Methods Barnabás Póczos & Aarti Singh Contents Markov Chain Monte Carlo Methods Goal & Motivation Sampling Rejection Importance Markov
More informationCh5. Markov Chain Monte Carlo
ST4231, Semester I, 2003-2004 Ch5. Markov Chain Monte Carlo In general, it is very difficult to simulate the value of a random vector X whose component random variables are dependent. In this chapter we
More informationModeling the Free Energy Landscape for Janus Particle Self-Assembly in the Gas Phase. Andy Long Kridsanaphong Limtragool
Modeling the Free Energy Landscape for Janus Particle Self-Assembly in the Gas Phase Andy Long Kridsanaphong Limtragool Motivation We want to study the spontaneous formation of micelles and vesicles Applications
More informationarxiv:cond-mat/ v2 3 Aug 1998
Monte Carlo Eigenvalue Methods in Quantum Mechanics and Statistical Mechanics M. P. Nightingale Department of Physics, University of Rhode Island, Kingston, RI 02881. arxiv:cond-mat/9804288v2 3 Aug 1998
More informationApril 20th, Advanced Topics in Machine Learning California Institute of Technology. Markov Chain Monte Carlo for Machine Learning
for for Advanced Topics in California Institute of Technology April 20th, 2017 1 / 50 Table of Contents for 1 2 3 4 2 / 50 History of methods for Enrico Fermi used to calculate incredibly accurate predictions
More informationScientific Computing: Monte Carlo
Scientific Computing: Monte Carlo Aleksandar Donev Courant Institute, NYU 1 donev@courant.nyu.edu 1 Course MATH-GA.2043 or CSCI-GA.2112, Spring 2012 April 5th and 12th, 2012 A. Donev (Courant Institute)
More informationBayesian Estimation of Input Output Tables for Russia
Bayesian Estimation of Input Output Tables for Russia Oleg Lugovoy (EDF, RANE) Andrey Polbin (RANE) Vladimir Potashnikov (RANE) WIOD Conference April 24, 2012 Groningen Outline Motivation Objectives Bayesian
More informationPath Coupling and Aggregate Path Coupling
Path Coupling and Aggregate Path Coupling 0 Path Coupling and Aggregate Path Coupling Yevgeniy Kovchegov Oregon State University (joint work with Peter T. Otto from Willamette University) Path Coupling
More informationLecture 2+3: Simulations of Soft Matter. 1. Why Lecture 1 was irrelevant 2. Coarse graining 3. Phase equilibria 4. Applications
Lecture 2+3: Simulations of Soft Matter 1. Why Lecture 1 was irrelevant 2. Coarse graining 3. Phase equilibria 4. Applications D. Frenkel, Boulder, July 6, 2006 What distinguishes Colloids from atoms or
More informationMarkov Chains CK eqns Classes Hitting times Rec./trans. Strong Markov Stat. distr. Reversibility * Markov Chains
Markov Chains A random process X is a family {X t : t T } of random variables indexed by some set T. When T = {0, 1, 2,... } one speaks about a discrete-time process, for T = R or T = [0, ) one has a continuous-time
More informationIntroduction Statistical Thermodynamics. Monday, January 6, 14
Introduction Statistical Thermodynamics 1 Molecular Simulations Molecular dynamics: solve equations of motion Monte Carlo: importance sampling r 1 r 2 r n MD MC r 1 r 2 2 r n 2 3 3 4 4 Questions How can
More informationSTA 294: Stochastic Processes & Bayesian Nonparametrics
MARKOV CHAINS AND CONVERGENCE CONCEPTS Markov chains are among the simplest stochastic processes, just one step beyond iid sequences of random variables. Traditionally they ve been used in modelling a
More informationMonte Carlo integration (naive Monte Carlo)
Monte Carlo integration (naive Monte Carlo) Example: Calculate π by MC integration [xpi] 1/21 INTEGER n total # of points INTEGER i INTEGER nu # of points in a circle REAL x,y coordinates of a point in
More informationQuantum Monte Carlo Methods in Statistical Mechanics
University of Rhode Island DigitalCommons@URI Physics Faculty Publications Physics 1999 Quantum Monte Carlo Methods in Statistical Mechanics Vilen Melik-Alaverdian University of Rhode Island M. P. Nightingale
More information= P{X 0. = i} (1) If the MC has stationary transition probabilities then, = i} = P{X n+1
Properties of Markov Chains and Evaluation of Steady State Transition Matrix P ss V. Krishnan - 3/9/2 Property 1 Let X be a Markov Chain (MC) where X {X n : n, 1, }. The state space is E {i, j, k, }. The
More informationMonte Carlo methods for sampling-based Stochastic Optimization
Monte Carlo methods for sampling-based Stochastic Optimization Gersende FORT LTCI CNRS & Telecom ParisTech Paris, France Joint works with B. Jourdain, T. Lelièvre, G. Stoltz from ENPC and E. Kuhn from
More informationIntroduction to Computer Simulations of Soft Matter Methodologies and Applications Boulder July, 19-20, 2012
Introduction to Computer Simulations of Soft Matter Methodologies and Applications Boulder July, 19-20, 2012 K. Kremer Max Planck Institute for Polymer Research, Mainz Overview Simulations, general considerations
More informationBasic Concepts and Tools in Statistical Physics
Chapter 1 Basic Concepts and Tools in Statistical Physics 1.1 Introduction Statistical mechanics provides general methods to study properties of systems composed of a large number of particles. It establishes
More informationAnswers and expectations
Answers and expectations For a function f(x) and distribution P(x), the expectation of f with respect to P is The expectation is the average of f, when x is drawn from the probability distribution P E
More informationGases and the Virial Expansion
Gases and the irial Expansion February 7, 3 First task is to examine what ensemble theory tells us about simple systems via the thermodynamic connection Calculate thermodynamic quantities: average energy,
More information