The Monte Carlo Method An Introduction to Markov Chain MC
|
|
- Doris Elliott
- 5 years ago
- Views:
Transcription
1 The Monte Carlo Method An Introduction to Markov Chain MC Sachin Shanbhag Department of Scientific Computing, Florida State University
2 Sources. Introduction to Monte Carlo Algorithms : Werner Krauth. Available as a pdf download at This is a great introduction to MC methods, geared towards applications in physical sciences, through puzzles and simple non-technical problems. 2. David Kofke s page on Molecular Simulation.
3 system with three states Markov Chains Transition-Probability Matrix Example "!! 2! 3 # " # & ' $!!! % = $ % $! 3! 32! % $ % ( ) ( ) If in state, will stay in state with probability 0. If in state, will move to state 3 with probability 0.4 Never go to state 3 from state 2 Requirements of transition-probability matrix all probabilities non-negative, and no greater than unity sum of each row is unity probability of staying in present state may be non-zero
4 Distribution of State Occupancies Consider process of repeatedly moving from one state to the next, choosing each subsequent state according to Π etc. Histogram the occupancy number for each state n = 3 p = 0.33 n 2 = 5 p 2 = 0.42 n 3 = 4 p 3 = After very many steps, a limiting distribution emerges
5 The Limiting Distribution Consider the product of Π with itself "!! 2! 3 # "!! 2! 3 # 2 & ' $!!! % ( $!!! % $! 3! 32! % $ 33! 3! 32! % ) * ) 33 * "!! +! 2! 2 +! 3! 3!! 2 +! 2! 22 +! 3! 32 etc. # = $!! +!! +!!!! +!! +!! etc. % $! 3! +! 32! 2 +! 33! 3! 3! 2 +! 32! 22 +! 33! 32 etc. % ) * In general! n is the n-step transition probability matrix probabilities of going from state i to j in exactly n steps All ways of going from state to state 2 in two steps Probability of going from state 3 to state 2 in two steps " ( n) ( n) ( n)!! 2! # 3 $ % n ( n) ( n) ( n) & ' $! 2! 22! 23 % ( n) ( n) ( n) $! 3! 32! % ( 33 ) defines ( n)! ij
6 The Limiting Distribution Define! (0) i as a unit state vector ( 0 0) ( 0 0) ( 0 0 ) (0) (0) (0) 2 3! =! =! =!! " # n ( ) (0) Then i n i is a vector of probabilities for ending at each state after n steps if beginning at state i " ( n) ( n) ( n)!! 2! # 3 $ % n! =! & ' 0 0 $!!! % =!!! ( n) ( n) ( n) $! 3! 32! % ( 33 ) The limiting distribution corresponds to n independent of initial state ( ) ( ) ( n) (0) ( n) ( n) ( n) ( n) ( n) ( n) (") (") (") 2 3! =! =! #!
7 Stationary property of π The Limiting Distribution (0) n! = lim %! & i ' ( ) n"# ( (0) n ) lim % $! & i = ' ' ( ) n"# =!' π is a left eigenvector of Π with unit eigenvalue such an eigenvector is guaranteed to exist for matrices with rows that each sum to unity Equation for elements of limiting distribution π! i = "! j!! ji = 0.! + 0.9! ! 3 " # j! 2 = 0.5! + 0.! ! 3 e. g. & = $ % $! 3 0.4! 0.0! 2 0.4! % = + + ' (! +! 2 +! 3 =! +! 2 +! 3 not independent
8 Statistical Mechanics NVT N particles, position r i = (x,y,z) momentum p i = (p x, p y, p z ) {r i, p i } = 6N degrees of freedom A particular snapshot of {r i, p i } is called a microstate Total energy of the system H({r i, p i }) = U({r i }) + K({p i }) U = U({r i }) potential energy (often pairwise summation) K = Σ p i2 /2m i kinetic energy
9 Statistical Mechanics In an NVT ensemble, NVT "(r i,p i ) = Q exp(# H(r,p ) i i ) kt where Q = classical partition function, defined by Q = h 3N N! " dp " dp 2 L" dp N " dr " dr 2 L dr N " exp(# H(r,p ) i i ) kt this is like a effective volume of the phase space It is related to the free energy via A/kT = - ln Q(N,V,T) An average property (e.g. specific heat) may be obtained via, A = " dp " N dr N A(r i,p i )#(r i,p i )
10 Statistical Mechanics The kinetic energy factors can be integrated out, Q = Q = h 3N N! h 3N N! " dp N dr N " exp(# U({r }) + K({p }) i i ) kt " dr N exp(# U({r }) i kt ) " dp N $ p i 2 2m i Z N = configurational integral It is easy to show that, A = Q = Z N " 3N Why do we care? Z N N! " dr N A(r i )exp(# U kt ) In MC, unlike MD, we don t typically have access to momenta (only positions).
11 Statistical Mechanics This is an integration problem, I can use quadrature! NVT A = Z N N! " dr N A(r i )exp(# U kt ) One dimensional integrals I b =! f ( x) dx a Sum areas of shapes approximating shape of curve f ( x) Error δi ~ /n 2 (for D) δi ~ /n 2/D (for dd) x n b! a I " # x f ( x ) = f ( x ) $ $ i i= n i= n i
12 Where is Monte Carlo? This is an integration problem, I can use quadrature! A = Z N N! " dr N A(r i )exp(# U kt ) One dimensional integrals I b =! a f ( x) dx Error δi ~ /n 0.5 (for D) δi ~ /n 0.5 (for dd) I n b! a " # n i= f ( x ) i! ( x) For large dimensions, MC has better convergence n points selected from uniform distribution p(x) x
13 Where is Monte Carlo? A = Z N N! " dr N A(r i )exp(# U kt ) Typically, 3D space, say N=00 particles, DOF = 3N = 300 n=0 points between (-L, +L) (dx, for example) If each function evaluation is flop (lower-bound), need function evaluations to get integral. Fastest computers (IBM BlueGene/L ~ 500 Tflops) Time required = /5*0 4 ~ years age of the universe 3 billion years IMPOSSIBLE
14 The Etymology of Monte Carlo Principality of Monaco (~ mile2 - UM) Famous for casinos, Formula- races, royalty Random numbers
15 The Ubiquity of Monte Carlo Random Examples Chip Design and Newpaper Panels floorplanning Finance and Social Sciences
16 Broadly Speaking Monte Carlo Simulation Equilibrium Monte Carlo Kinetic or Dynamic Monte Carlo i. Detailed balance i. Detailed balance ii. Lot of algorithmic freedom ii. Kinetics (or Model) today iii. Trial Moves restricted to be local
17 The Tradition of Monte Carlo ( ) various attempts The Manhattan Project Ulam, Feynman, von Neumann Fermi
18 The Miracle of the Central Limit Theorem p(x ) x = x x 2 = + 2 p(x 2 ) x 2 p(x N ) The probability distribution of the average of independent random variables becomes increasingly Gaussian and increasingly narrower sigma ~ /sqrt(n) x N
19 Children s s game in Monaco Mathematically oriented kids of Monaco want to find the pi N red /(N red +N blue ) bench = A cir /A sq =pi*(a/2) 2 /a 2 bench bench = pi/4 pi = 4 * N red /(N red +N blue ) a=50 ft bench N = N red + N blue Here, pi = 4 *0/3 ~ 3.08
20 Children s s game in Monaco estimate of pi N = N red + N blue The invisible hand of the CLT operates to ensure that we converge to the true value of pi as the number of rocks thrown is increased. Error vanishes as /sqrt(n)
21 Older people s s game in Monaco Time spent planting flags in the circular region is proportional to the area of the circle plant flags on a helipad A CHOICES (i) Move to B. Plant a gray flag. Continue throwing. (ii) Stay at A. Don t plant flag. Throw again. (iii) Stay at A. Plant a flag. Continue throwing. B 500 ft Many MC simulations are wrong because they make the wrong choice. Condition of Detailed Balance will give us sound advice. a= mile pi = 4 * N red /(N red +N blue )
22 Some Concepts KID S GAME OLDER PEOPLE S VERSION Each sample (place where throw lands) independent Direct Sampling Converges faster (Think CLT, think independent samples) Sample dependent on previous position (is within radius of 500ft) Markov-chain Sampling Need more throws (samples) to attain same level of accuracy May not be feasible for realistic problems!
23 Coins in a Shoebox Problem Q: How do you generate random configurations of coins such that they don t overlap? Direct Sampling Markov-chain Sampling Start with a legit configuration Random Sequential Depositon (?) Trial: Move a randomly chosen coin just a little in a randomly chosen direction WRONG! yes Overlap? no phi RSD < phi CP Reject move Enact move Physicists (since 953) haven t found a direct sampling algorithm
24 So far Central Limit Theorem: The Engine Sampling: How do I generate trials? Direct Sampling Kid s game, better, not always possible Markov Chain Sampling Older people s game, more common Coin in a shoe-box problem Unsolved Mystery: What should you do if you throw the stone out of bounds in the adults game? Tricky question, full of consequences for world peace and prosperity. We said upcoming condition of detailed balance will resolve it.
25 Scrambling Game Objective: Create a perfect scrambling algorithm such that any possible configuration of the puzzle is generated with equal probability Toddler s algorithm equilibrium where each state is equiprobable. Rip the whole thing apart Put it back together
26 Scrambling Game Scrambling Game Older People Version Choose central square to go (N, E, W, S) each with probability ¼ (which is indeed correct) Move the empty square in a random direction, each timestep
27 Scrambling Game /3? b F(a) = F(b) = F(c) = F(d) : at equilibrium F(a) = F(a) p(a a) + F(b) p(b a) + F(c) p(c a) + F(d) p(d a) a /3? c [- p(a a) ]F(a) = F(b) p(b a) + F(c) p(c a) + F(d) p(d a) p(a a) + p(a b) + p(a c) + p(a d) = /3? d p(a b) + p(a c) + p(a d) = - p(a a) [p(a b) + p(a c) + p(a d) ]F(a) = F(b)p(b a) + F(c) p(c a) + F(d) p(d a)
28 Scrambling Game [p(a b) + p(a c) + p(a d) ]F(a) = F(b)p(b a) + F(c) p(c a) + F(d) p(d a) F(a) p(a b) + F(b) p(b a) + F(a) p(a c) + = F(c) p(c a) + F(a) p(a d) F(d) p(d a) (A) Impose a condition that terms of the same color on either side of the = are equal F(a) p(a b) = F(a) p(a c) = F(a) p(a d) = F(b) p(b a) F(c) p(c a) F(d) p(d a) This recipe for satisfying equation (A) is called the condition of detailed balance Sufficient, but not necessary condition
29 Scrambling Game Look at one of these carefully, p(a c)/p(c a) = F(c)/F(a) 4 6 c a Given: F(a) = F(c) p(a c) = p(c a) = 0.25 (not /3) Therefore algorithm is: (i) Pick {N, E, W, S} with equal probability (ii) Move blank square to corresponding direction, if possible. Otherwise, stay where you are, reject the move, and advance the clock.
30 Older people s s game in Monaco Time spent planting flags in the circular region is proportional to the area of the circle plant flags on a helipad A CHOICES B (i) Move to B. Plant a gray flag. Continue throwing. (ii) Stay at A. Don t plant flag. Throw again. (iii) Stay at A. Plant a flag. Continue throwing. Many MC simulations are wrong because they make the wrong choice. Condition of Detailed Balance will give us wise advice. a= mile 500 ft pi = 4 * N red /(N red +N blue )
31 Some More Concepts Concept of REJECTION arose from the condition of detailed balance p(a c)/p(c a) = F(c)/F(a) This method of rejection has been enshrined into the Metropolis Algorithm p(a c) = min[, F(c)/F(a)] Connection with Statistical Mechanics F(c) = exp(-u c /k B T) p(a c) = min[, exp[-(u c -U a )/k B T]] Boltzmann
32 The Metropolis Method (over 7500 citations between ) THE JOURNAL OF CHEMICAL PHYSICS VOLUME 2, NUMBER 6 JUNE, 953 Equation of State Calculations by Fast Computing Machines NICHOLAS METROPOLIS, ARIANNA W. ROSENBLUTH, MARSHALL N. ROSENBLUTH, AND AUGUSTA H. TELLER, Los Alamos Scientific Laboratory, Los Alamos, New Mexico AND EDWARD TELLER, * Department of Physics, University of Chicago, Chicago, Illinois (Received March 6, 953) A general method, suitable for fast computing machines, for investigating such properties as equations of state for substances consisting of interacting individual molecules is described. The method consists of a modified Monte Carlo integration over configuration space. Results for the two-dimensional rigidsphere system have been obtained on the Los Alamos MANIAC and are presented here. These results are compared to the free volume equation of state and to a four-term virial coefficient expansion. 087 Nicholas Metropolis with the MANIAC
33 Back to Statistical Mechanics A = Z N N! " dr N A(r i )exp(# U kt ) Observation 2 It may be possible to compute <A> without evaluating Z N? This function is sharply peaked. Observation In the area of the circle problem, we evaluated an area (like a partition function), and the probability distribution was uniform (obs and 2 inapplicable). In the scramble problem, the probability distribution was uniform (obs inapplicable)
34 Back to Statistical Mechanics A = Z N N! " dr N A(r i )exp(# U kt ) Metropolis helps us generate new microstates with the appropriate probability. Thus a simple average over all the microstates gives us <A> Samples the important region of phase space
35 Detailed Balance Eigenvector equation for limiting distribution A sufficient (but not necessary) condition for solution is! i! ij =! j! ji Thus detailed balance or microscopic reversibility! i = "! j! ji j! =!! i j ji j = " " j!! i " ij =!! =! i ij i j! = " # $ % $ % & ' For a given Π, it is not always possible to satisfy detailed balance; e.g. for this!! "!! Π zero
36 Tutorial: Ising Model 924: Ising solved D 944: Onsager solved 2D Simple model for understanding magnetism Ferromagnets: Fe, Ni - magnetic even in the absence of an electric field Unpaired electrons = origin of magnetism Paramagnets: Al, Ba - magnetic only in the presence of an electric field Up-state Down state
37 Tutorial: Ising Model (a) Energy E({"}) = #J $ " i " j (b) Magnetization M({"}) = #" i N
38 Tutorial: Markov Chains
39 Tutorial: Markov Chains
Markov Processes. Stochastic process. Markov process
Markov Processes Stochastic process movement through a series of well-defined states in a way that involves some element of randomness for our purposes, states are microstates in the governing ensemble
More informationCopyright 2001 University of Cambridge. Not to be quoted or copied without permission.
Course MP3 Lecture 4 13/11/2006 Monte Carlo method I An introduction to the use of the Monte Carlo method in materials modelling Dr James Elliott 4.1 Why Monte Carlo? The name derives from the association
More informationRandom Walks A&T and F&S 3.1.2
Random Walks A&T 110-123 and F&S 3.1.2 As we explained last time, it is very difficult to sample directly a general probability distribution. - If we sample from another distribution, the overlap will
More informationDoing Physics with Random Numbers
Doing Physics with Random Numbers Andrew J. Schultz Department of Chemical and Biological Engineering University at Buffalo The State University of New York Concepts Random numbers can be used to measure
More informationMath 456: Mathematical Modeling. Tuesday, April 9th, 2018
Math 456: Mathematical Modeling Tuesday, April 9th, 2018 The Ergodic theorem Tuesday, April 9th, 2018 Today 1. Asymptotic frequency (or: How to use the stationary distribution to estimate the average amount
More information12. LOCAL SEARCH. gradient descent Metropolis algorithm Hopfield neural networks maximum cut Nash equilibria
Coping With NP-hardness Q. Suppose I need to solve an NP-hard problem. What should I do? A. Theory says you re unlikely to find poly-time algorithm. Must sacrifice one of three desired features. Solve
More informationICCP Project 2 - Advanced Monte Carlo Methods Choose one of the three options below
ICCP Project 2 - Advanced Monte Carlo Methods Choose one of the three options below Introduction In statistical physics Monte Carlo methods are considered to have started in the Manhattan project (1940
More informationMonte Carlo (MC) Simulation Methods. Elisa Fadda
Monte Carlo (MC) Simulation Methods Elisa Fadda 1011-CH328, Molecular Modelling & Drug Design 2011 Experimental Observables A system observable is a property of the system state. The system state i is
More informationThe Monte Carlo Algorithm
The Monte Carlo Algorithm This algorithm was invented by N. Metropolis, A.W. Rosenbluth, M.N. Rosenbluth, A.H. Teller, and E. Teller, J. Chem. Phys., 21, 1087 (1953). It was listed as one of the The Top
More informationMonte Carlo. Lecture 15 4/9/18. Harvard SEAS AP 275 Atomistic Modeling of Materials Boris Kozinsky
Monte Carlo Lecture 15 4/9/18 1 Sampling with dynamics In Molecular Dynamics we simulate evolution of a system over time according to Newton s equations, conserving energy Averages (thermodynamic properties)
More informationBrief introduction to Markov Chain Monte Carlo
Brief introduction to Department of Probability and Mathematical Statistics seminar Stochastic modeling in economics and finance November 7, 2011 Brief introduction to Content 1 and motivation Classical
More informationComputer Vision Group Prof. Daniel Cremers. 11. Sampling Methods: Markov Chain Monte Carlo
Group Prof. Daniel Cremers 11. Sampling Methods: Markov Chain Monte Carlo Markov Chain Monte Carlo In high-dimensional spaces, rejection sampling and importance sampling are very inefficient An alternative
More informationClassical Monte-Carlo simulations
Classical Monte-Carlo simulations Graduate Summer Institute Complex Plasmas at the Stevens Insitute of Technology Henning Baumgartner, A. Filinov, H. Kählert, P. Ludwig and M. Bonitz Christian-Albrechts-University
More informationComputer simulation methods (1) Dr. Vania Calandrini
Computer simulation methods (1) Dr. Vania Calandrini Why computational methods To understand and predict the properties of complex systems (many degrees of freedom): liquids, solids, adsorption of molecules
More informationEnrico Fermi and the FERMIAC. Mechanical device that plots 2D random walks of slow and fast neutrons in fissile material
Monte Carlo History Statistical sampling Buffon s needles and estimates of π 1940s: neutron transport in fissile material Origin of name People: Ulam, von Neuman, Metropolis, Teller Other areas of use:
More informationPhysics 115/242 Monte Carlo simulations in Statistical Physics
Physics 115/242 Monte Carlo simulations in Statistical Physics Peter Young (Dated: May 12, 2007) For additional information on the statistical Physics part of this handout, the first two sections, I strongly
More informationNumerical Analysis of 2-D Ising Model. Ishita Agarwal Masters in Physics (University of Bonn) 17 th March 2011
Numerical Analysis of 2-D Ising Model By Ishita Agarwal Masters in Physics (University of Bonn) 17 th March 2011 Contents Abstract Acknowledgment Introduction Computational techniques Numerical Analysis
More informationMonte Carlo Simulation of the Ising Model. Abstract
Monte Carlo Simulation of the Ising Model Saryu Jindal 1 1 Department of Chemical Engineering and Material Sciences, University of California, Davis, CA 95616 (Dated: June 9, 2007) Abstract This paper
More informationMarkov Chain Monte Carlo The Metropolis-Hastings Algorithm
Markov Chain Monte Carlo The Metropolis-Hastings Algorithm Anthony Trubiano April 11th, 2018 1 Introduction Markov Chain Monte Carlo (MCMC) methods are a class of algorithms for sampling from a probability
More informationLecture notes on Regression: Markov Chain Monte Carlo (MCMC)
Lecture notes on Regression: Markov Chain Monte Carlo (MCMC) Dr. Veselina Kalinova, Max Planck Institute for Radioastronomy, Bonn Machine Learning course: the elegant way to extract information from data,
More informationEvaluation of Wang-Landau Monte Carlo Simulations
2012 4th International Conference on Computer Modeling and Simulation (ICCMS 2012) IPCSIT vol.22 (2012) (2012) IACSIT Press, Singapore Evaluation of Wang-Landau Monte Carlo Simulations Seung-Yeon Kim School
More informationMarkov Chains Handout for Stat 110
Markov Chains Handout for Stat 0 Prof. Joe Blitzstein (Harvard Statistics Department) Introduction Markov chains were first introduced in 906 by Andrey Markov, with the goal of showing that the Law of
More informationIntroduction to Machine Learning CMU-10701
Introduction to Machine Learning CMU-10701 Markov Chain Monte Carlo Methods Barnabás Póczos Contents Markov Chain Monte Carlo Methods Sampling Rejection Importance Hastings-Metropolis Gibbs Markov Chains
More informationMetropolis/Variational Monte Carlo. Microscopic Theories of Nuclear Structure, Dynamics and Electroweak Currents June 12-30, 2017, ECT*, Trento, Italy
Metropolis/Variational Monte Carlo Stefano Gandolfi Los Alamos National Laboratory (LANL) Microscopic Theories of Nuclear Structure, Dynamics and Electroweak Currents June 12-30, 2017, ECT*, Trento, Italy
More informationCE 530 Molecular Simulation
CE 530 Molecular Simulation Lecture 0 Simple Biasing Methods David A. Kofke Department of Chemical Engineering SUNY Buffalo kofke@eng.buffalo.edu 2 Review Monte Carlo simulation Markov chain to generate
More informationJ ij S i S j B i S i (1)
LECTURE 18 The Ising Model (References: Kerson Huang, Statistical Mechanics, Wiley and Sons (1963) and Colin Thompson, Mathematical Statistical Mechanics, Princeton Univ. Press (1972)). One of the simplest
More informationComputer Vision Group Prof. Daniel Cremers. 10a. Markov Chain Monte Carlo
Group Prof. Daniel Cremers 10a. Markov Chain Monte Carlo Markov Chain Monte Carlo In high-dimensional spaces, rejection sampling and importance sampling are very inefficient An alternative is Markov Chain
More informationMonte Carlo and cold gases. Lode Pollet.
Monte Carlo and cold gases Lode Pollet lpollet@physics.harvard.edu 1 Outline Classical Monte Carlo The Monte Carlo trick Markov chains Metropolis algorithm Ising model critical slowing down Quantum Monte
More informationCS 781 Lecture 9 March 10, 2011 Topics: Local Search and Optimization Metropolis Algorithm Greedy Optimization Hopfield Networks Max Cut Problem Nash
CS 781 Lecture 9 March 10, 2011 Topics: Local Search and Optimization Metropolis Algorithm Greedy Optimization Hopfield Networks Max Cut Problem Nash Equilibrium Price of Stability Coping With NP-Hardness
More informationMarkov Chains CK eqns Classes Hitting times Rec./trans. Strong Markov Stat. distr. Reversibility * Markov Chains
Markov Chains A random process X is a family {X t : t T } of random variables indexed by some set T. When T = {0, 1, 2,... } one speaks about a discrete-time process, for T = R or T = [0, ) one has a continuous-time
More informationMonte Carlo Methods in High Energy Physics I
Helmholtz International Workshop -- CALC 2009, July 10--20, Dubna Monte Carlo Methods in High Energy Physics CALC2009 - July 20 10, Dubna 2 Contents 3 Introduction Simple definition: A Monte Carlo technique
More informationMonte Carlo Methods in Statistical Mechanics
Monte Carlo Methods in Statistical Mechanics Mario G. Del Pópolo Atomistic Simulation Centre School of Mathematics and Physics Queen s University Belfast Belfast Mario G. Del Pópolo Statistical Mechanics
More informationNumerical integration and importance sampling
2 Numerical integration and importance sampling 2.1 Quadrature Consider the numerical evaluation of the integral I(a, b) = b a dx f(x) Rectangle rule: on small interval, construct interpolating function
More informationA Monte Carlo Implementation of the Ising Model in Python
A Monte Carlo Implementation of the Ising Model in Python Alexey Khorev alexey.s.khorev@gmail.com 2017.08.29 Contents 1 Theory 1 1.1 Introduction...................................... 1 1.2 Model.........................................
More information3.320 Lecture 18 (4/12/05)
3.320 Lecture 18 (4/12/05) Monte Carlo Simulation II and free energies Figure by MIT OCW. General Statistical Mechanics References D. Chandler, Introduction to Modern Statistical Mechanics D.A. McQuarrie,
More informationComputational Physics (6810): Session 13
Computational Physics (6810): Session 13 Dick Furnstahl Nuclear Theory Group OSU Physics Department April 14, 2017 6810 Endgame Various recaps and followups Random stuff (like RNGs :) Session 13 stuff
More informationStatistical Thermodynamics and Monte-Carlo Evgenii B. Rudnyi and Jan G. Korvink IMTEK Albert Ludwig University Freiburg, Germany
Statistical Thermodynamics and Monte-Carlo Evgenii B. Rudnyi and Jan G. Korvink IMTEK Albert Ludwig University Freiburg, Germany Preliminaries Learning Goals From Micro to Macro Statistical Mechanics (Statistical
More informationSimulation of the two-dimensional square-lattice Lenz-Ising model in Python
Senior Thesis Simulation of the two-dimensional square-lattice Lenz-Ising model in Python Author: Richard Munroe Advisor: Dr. Edward Brash 2012-10-17 Abstract A program to simulate the the two-dimensional
More informationParallel Tempering Algorithm in Monte Carlo Simulation
Parallel Tempering Algorithm in Monte Carlo Simulation Tony Cheung (CUHK) Kevin Zhao (CUHK) Mentors: Ying Wai Li (ORNL) Markus Eisenbach (ORNL) Kwai Wong (UTK/ORNL) Metropolis Algorithm on Ising Model
More informationApril 20th, Advanced Topics in Machine Learning California Institute of Technology. Markov Chain Monte Carlo for Machine Learning
for for Advanced Topics in California Institute of Technology April 20th, 2017 1 / 50 Table of Contents for 1 2 3 4 2 / 50 History of methods for Enrico Fermi used to calculate incredibly accurate predictions
More informationThe University of British Columbia Computer Science 405 Practice Midterm Solutions
The University of British Columbia Computer Science 405 Practice Midterm Solutions Instructor: Kees van den Doel Time: 45 mins Total marks: 100 The solutions provided here are much more verbose than what
More informationCHEM-UA 652: Thermodynamics and Kinetics
1 CHEM-UA 652: Thermodynamics and Kinetics Notes for Lecture 4 I. THE ISOTHERMAL-ISOBARIC ENSEMBLE The isothermal-isobaric ensemble is the closest mimic to the conditions under which most experiments are
More informationToday: Fundamentals of Monte Carlo
Today: Fundamentals of Monte Carlo What is Monte Carlo? Named at Los Alamos in 940 s after the casino. Any method which uses (pseudo)random numbers as an essential part of the algorithm. Stochastic - not
More informationMarkov Chain Monte Carlo Inference. Siamak Ravanbakhsh Winter 2018
Graphical Models Markov Chain Monte Carlo Inference Siamak Ravanbakhsh Winter 2018 Learning objectives Markov chains the idea behind Markov Chain Monte Carlo (MCMC) two important examples: Gibbs sampling
More informationMonte Caro simulations
Monte Caro simulations Monte Carlo methods - based on random numbers Stanislav Ulam s terminology - his uncle frequented the Casino in Monte Carlo Random (pseudo random) number generator on the computer
More informationToday: Fundamentals of Monte Carlo
Today: Fundamentals of Monte Carlo What is Monte Carlo? Named at Los Alamos in 1940 s after the casino. Any method which uses (pseudo)random numbers as an essential part of the algorithm. Stochastic -
More informationChapter 4: Monte Carlo Methods. Paisan Nakmahachalasint
Chapter 4: Monte Carlo Methods Paisan Nakmahachalasint Introduction Monte Carlo Methods are a class of computational algorithms that rely on repeated random sampling to compute their results. Monte Carlo
More informationLet s start by reviewing what we learned last time. Here is the basic line of reasoning for Einstein Solids
Chapter 5 In this chapter we want to review the concept of irreversibility in more detail and see how it comes from the multiplicity of states. In addition, we want to introduce the following new topics:
More informationMarkov chain Monte Carlo Lecture 9
Markov chain Monte Carlo Lecture 9 David Sontag New York University Slides adapted from Eric Xing and Qirong Ho (CMU) Limitations of Monte Carlo Direct (unconditional) sampling Hard to get rare events
More informationResults: MCMC Dancers, q=10, n=500
Motivation Sampling Methods for Bayesian Inference How to track many INTERACTING targets? A Tutorial Frank Dellaert Results: MCMC Dancers, q=10, n=500 1 Probabilistic Topological Maps Results Real-Time
More information3.320: Lecture 19 (4/14/05) Free Energies and physical Coarse-graining. ,T) + < σ > dµ
3.320: Lecture 19 (4/14/05) F(µ,T) = F(µ ref,t) + < σ > dµ µ µ ref Free Energies and physical Coarse-graining T S(T) = S(T ref ) + T T ref C V T dt Non-Boltzmann sampling and Umbrella sampling Simple
More informationMonte Carlo Methods for Computation and Optimization (048715)
Technion Department of Electrical Engineering Monte Carlo Methods for Computation and Optimization (048715) Lecture Notes Prof. Nahum Shimkin Spring 2015 i PREFACE These lecture notes are intended for
More informationNumerical methods for lattice field theory
Numerical methods for lattice field theory Mike Peardon Trinity College Dublin August 9, 2007 Mike Peardon (Trinity College Dublin) Numerical methods for lattice field theory August 9, 2007 1 / 24 Numerical
More informationPhysics 403. Segev BenZvi. Numerical Methods, Maximum Likelihood, and Least Squares. Department of Physics and Astronomy University of Rochester
Physics 403 Numerical Methods, Maximum Likelihood, and Least Squares Segev BenZvi Department of Physics and Astronomy University of Rochester Table of Contents 1 Review of Last Class Quadratic Approximation
More informationComputer Vision Group Prof. Daniel Cremers. 14. Sampling Methods
Prof. Daniel Cremers 14. Sampling Methods Sampling Methods Sampling Methods are widely used in Computer Science as an approximation of a deterministic algorithm to represent uncertainty without a parametric
More informationMonte Carlo programs
Monte Carlo programs Alexander Khanov PHYS6260: Experimental Methods is HEP Oklahoma State University November 13, 2017 Monte Carlo methods: the idea In classical physics, if we need to measure something
More informationMonte Carlo Integration. Computer Graphics CMU /15-662, Fall 2016
Monte Carlo Integration Computer Graphics CMU 15-462/15-662, Fall 2016 Talk Announcement Jovan Popovic, Senior Principal Scientist at Adobe Research will be giving a seminar on Character Animator -- Monday
More informationPreliminary statistics
1 Preliminary statistics The solution of a geophysical inverse problem can be obtained by a combination of information from observed data, the theoretical relation between data and earth parameters (models),
More informationWang-Landau Monte Carlo simulation. Aleš Vítek IT4I, VP3
Wang-Landau Monte Carlo simulation Aleš Vítek IT4I, VP3 PART 1 Classical Monte Carlo Methods Outline 1. Statistical thermodynamics, ensembles 2. Numerical evaluation of integrals, crude Monte Carlo (MC)
More informationThe Particle Filter. PD Dr. Rudolph Triebel Computer Vision Group. Machine Learning for Computer Vision
The Particle Filter Non-parametric implementation of Bayes filter Represents the belief (posterior) random state samples. by a set of This representation is approximate. Can represent distributions that
More informationBayes Nets: Sampling
Bayes Nets: Sampling [These slides were created by Dan Klein and Pieter Abbeel for CS188 Intro to AI at UC Berkeley. All CS188 materials are available at http://ai.berkeley.edu.] Approximate Inference:
More informationLecture 2+3: Simulations of Soft Matter. 1. Why Lecture 1 was irrelevant 2. Coarse graining 3. Phase equilibria 4. Applications
Lecture 2+3: Simulations of Soft Matter 1. Why Lecture 1 was irrelevant 2. Coarse graining 3. Phase equilibria 4. Applications D. Frenkel, Boulder, July 6, 2006 What distinguishes Colloids from atoms or
More informationData Analysis I. Dr Martin Hendry, Dept of Physics and Astronomy University of Glasgow, UK. 10 lectures, beginning October 2006
Astronomical p( y x, I) p( x, I) p ( x y, I) = p( y, I) Data Analysis I Dr Martin Hendry, Dept of Physics and Astronomy University of Glasgow, UK 10 lectures, beginning October 2006 4. Monte Carlo Methods
More informationAndré Schleife Department of Materials Science and Engineering
André Schleife Department of Materials Science and Engineering Length Scales (c) ICAMS: http://www.icams.de/cms/upload/01_home/01_research_at_icams/length_scales_1024x780.png Goals for today: Background
More informationIntroduction to the Renormalization Group
Introduction to the Renormalization Group Gregory Petropoulos University of Colorado Boulder March 4, 2015 1 / 17 Summary Flavor of Statistical Physics Universality / Critical Exponents Ising Model Renormalization
More informationAnnouncements. Inference. Mid-term. Inference by Enumeration. Reminder: Alarm Network. Introduction to Artificial Intelligence. V22.
Introduction to Artificial Intelligence V22.0472-001 Fall 2009 Lecture 15: Bayes Nets 3 Midterms graded Assignment 2 graded Announcements Rob Fergus Dept of Computer Science, Courant Institute, NYU Slides
More informationMarkov Chain Monte Carlo Method
Markov Chain Monte Carlo Method Macoto Kikuchi Cybermedia Center, Osaka University 6th July 2017 Thermal Simulations 1 Why temperature 2 Statistical mechanics in a nutshell 3 Temperature in computers 4
More informationCOMS 4721: Machine Learning for Data Science Lecture 20, 4/11/2017
COMS 4721: Machine Learning for Data Science Lecture 20, 4/11/2017 Prof. John Paisley Department of Electrical Engineering & Data Science Institute Columbia University SEQUENTIAL DATA So far, when thinking
More informationNATIONAL UNIVERSITY OF SINGAPORE PC5215 NUMERICAL RECIPES WITH APPLICATIONS. (Semester I: AY ) Time Allowed: 2 Hours
NATIONAL UNIVERSITY OF SINGAPORE PC5215 NUMERICAL RECIPES WITH APPLICATIONS (Semester I: AY 2014-15) Time Allowed: 2 Hours INSTRUCTIONS TO CANDIDATES 1. Please write your student number only. 2. This examination
More informationAdvanced Sampling Algorithms
+ Advanced Sampling Algorithms + Mobashir Mohammad Hirak Sarkar Parvathy Sudhir Yamilet Serrano Llerena Advanced Sampling Algorithms Aditya Kulkarni Tobias Bertelsen Nirandika Wanigasekara Malay Singh
More informationMonte Carlo integration (naive Monte Carlo)
Monte Carlo integration (naive Monte Carlo) Example: Calculate π by MC integration [xpi] 1/21 INTEGER n total # of points INTEGER i INTEGER nu # of points in a circle REAL x,y coordinates of a point in
More informationQuantum Monte Carlo. Matthias Troyer, ETH Zürich
Quantum Monte Carlo Matthias Troyer, ETH Zürich 1 1. Monte Carlo Integration 2 Integrating a function Convert the integral to a discrete sum b! f (x)dx = b " a N a N ' i =1 # f a + i b " a % $ N & + O(1/N)
More informationBrief Review of Statistical Mechanics
Brief Review of Statistical Mechanics Introduction Statistical mechanics: a branch of physics which studies macroscopic systems from a microscopic or molecular point of view (McQuarrie,1976) Also see (Hill,1986;
More informationLecture 6. Statistical Processes. Irreversibility. Counting and Probability. Microstates and Macrostates. The Meaning of Equilibrium Ω(m) 9 spins
Lecture 6 Statistical Processes Irreversibility Counting and Probability Microstates and Macrostates The Meaning of Equilibrium Ω(m) 9 spins -9-7 -5-3 -1 1 3 5 7 m 9 Lecture 6, p. 1 Irreversibility Have
More informationLecture 15: MCMC Sanjeev Arora Elad Hazan. COS 402 Machine Learning and Artificial Intelligence Fall 2016
Lecture 15: MCMC Sanjeev Arora Elad Hazan COS 402 Machine Learning and Artificial Intelligence Fall 2016 Course progress Learning from examples Definition + fundamental theorem of statistical learning,
More informationStatistical Mechanics. Atomistic view of Materials
Statistical Mechanics Atomistic view of Materials What is statistical mechanics? Microscopic (atoms, electrons, etc.) Statistical mechanics Macroscopic (Thermodynamics) Sample with constrains Fixed thermodynamics
More informationKyle Reing University of Southern California April 18, 2018
Renormalization Group and Information Theory Kyle Reing University of Southern California April 18, 2018 Overview Renormalization Group Overview Information Theoretic Preliminaries Real Space Mutual Information
More informationAdvanced Monte Carlo Methods Problems
Advanced Monte Carlo Methods Problems September-November, 2012 Contents 1 Integration with the Monte Carlo method 2 1.1 Non-uniform random numbers.......................... 2 1.2 Gaussian RNG..................................
More informationPerfect simulation for image analysis
Perfect simulation for image analysis Mark Huber Fletcher Jones Foundation Associate Professor of Mathematics and Statistics and George R. Roberts Fellow Mathematical Sciences Claremont McKenna College
More informationFrom Random Numbers to Monte Carlo. Random Numbers, Random Walks, Diffusion, Monte Carlo integration, and all that
From Random Numbers to Monte Carlo Random Numbers, Random Walks, Diffusion, Monte Carlo integration, and all that Random Walk Through Life Random Walk Through Life If you flip the coin 5 times you will
More informationUnderstanding Molecular Simulation 2009 Monte Carlo and Molecular Dynamics in different ensembles. Srikanth Sastry
JNCASR August 20, 21 2009 Understanding Molecular Simulation 2009 Monte Carlo and Molecular Dynamics in different ensembles Srikanth Sastry Jawaharlal Nehru Centre for Advanced Scientific Research, Bangalore
More informationIntroduction. Microscopic Theories of Nuclear Structure, Dynamics and Electroweak Currents June 12-30, 2017, ECT*, Trento, Italy
Introduction Stefano Gandolfi Los Alamos National Laboratory (LANL) Microscopic Theories of Nuclear Structure, Dynamics and Electroweak Currents June 12-30, 2017, ECT*, Trento, Italy Stefano Gandolfi (LANL)
More informationApplied Statistics. Monte Carlo Simulations. Troels C. Petersen (NBI) Statistics is merely a quantisation of common sense
Applied Statistics Monte Carlo Simulations Troels C. Petersen (NBI) Statistics is merely a quantisation of common sense 1 Random numbers Any one who considers arithmetical methods of producing random digits
More information18.600: Lecture 32 Markov Chains
18.600: Lecture 32 Markov Chains Scott Sheffield MIT Outline Markov chains Examples Ergodicity and stationarity Outline Markov chains Examples Ergodicity and stationarity Markov chains Consider a sequence
More informationComputer Vision Group Prof. Daniel Cremers. 11. Sampling Methods
Prof. Daniel Cremers 11. Sampling Methods Sampling Methods Sampling Methods are widely used in Computer Science as an approximation of a deterministic algorithm to represent uncertainty without a parametric
More informationWhat is a random variable
OKAN UNIVERSITY FACULTY OF ENGINEERING AND ARCHITECTURE MATH 256 Probability and Random Processes 04 Random Variables Fall 20 Yrd. Doç. Dr. Didem Kivanc Tureli didemk@ieee.org didem.kivanc@okan.edu.tr
More information18.175: Lecture 30 Markov chains
18.175: Lecture 30 Markov chains Scott Sheffield MIT Outline Review what you know about finite state Markov chains Finite state ergodicity and stationarity More general setup Outline Review what you know
More informationMonte Carlo importance sampling and Markov chain
Monte Carlo importance sampling and Markov chain If a configuration in phase space is denoted by X, the probability for configuration according to Boltzman is ρ(x) e βe(x) β = 1 T (1) How to sample over
More informationStrong Lens Modeling (II): Statistical Methods
Strong Lens Modeling (II): Statistical Methods Chuck Keeton Rutgers, the State University of New Jersey Probability theory multiple random variables, a and b joint distribution p(a, b) conditional distribution
More informationTime-Dependent Statistical Mechanics 5. The classical atomic fluid, classical mechanics, and classical equilibrium statistical mechanics
Time-Dependent Statistical Mechanics 5. The classical atomic fluid, classical mechanics, and classical equilibrium statistical mechanics c Hans C. Andersen October 1, 2009 While we know that in principle
More informationBasics of Statistical Mechanics
Basics of Statistical Mechanics Review of ensembles Microcanonical, canonical, Maxwell-Boltzmann Constant pressure, temperature, volume, Thermodynamic limit Ergodicity (see online notes also) Reading assignment:
More informationPhase Transition & Approximate Partition Function In Ising Model and Percolation In Two Dimension: Specifically For Square Lattices
IOSR Journal of Applied Physics (IOSR-JAP) ISS: 2278-4861. Volume 2, Issue 3 (ov. - Dec. 2012), PP 31-37 Phase Transition & Approximate Partition Function In Ising Model and Percolation In Two Dimension:
More informationCE 530 Molecular Simulation
CE 530 Molecular Simulation Lecture 7 Beyond Atoms: Simulating Molecules David A. Kofke Department of Chemical Engineering SUNY Buffalo kofke@eng.buffalo.edu Review Fundamentals units, properties, statistical
More informationECE295, Data Assimila0on and Inverse Problems, Spring 2015
ECE295, Data Assimila0on and Inverse Problems, Spring 2015 1 April, Intro; Linear discrete Inverse problems (Aster Ch 1 and 2) Slides 8 April, SVD (Aster ch 2 and 3) Slides 15 April, RegularizaFon (ch
More informationConvergence Rate of Markov Chains
Convergence Rate of Markov Chains Will Perkins April 16, 2013 Convergence Last class we saw that if X n is an irreducible, aperiodic, positive recurrent Markov chain, then there exists a stationary distribution
More informationToday: Fundamentals of Monte Carlo
Today: Fundamentals of Monte Carlo What is Monte Carlo? Named at Los Alamos in 1940 s after the casino. Any method which uses (pseudo)random numbers as an essential part of the algorithm. Stochastic -
More informationCPSC 540: Machine Learning
CPSC 540: Machine Learning MCMC and Non-Parametric Bayes Mark Schmidt University of British Columbia Winter 2016 Admin I went through project proposals: Some of you got a message on Piazza. No news is
More informationMonte Carlo study of the Baxter-Wu model
Monte Carlo study of the Baxter-Wu model Nir Schreiber and Dr. Joan Adler Monte Carlo study of the Baxter-Wu model p.1/40 Outline Theory of phase transitions, Monte Carlo simulations and finite size scaling
More informationC. Show your answer in part B agrees with your answer in part A in the limit that the constant c 0.
Problem #1 A. A projectile of mass m is shot vertically in the gravitational field. Its initial velocity is v o. Assuming there is no air resistance, how high does m go? B. Now assume the projectile is
More informationAdvanced sampling. fluids of strongly orientation-dependent interactions (e.g., dipoles, hydrogen bonds)
Advanced sampling ChE210D Today's lecture: methods for facilitating equilibration and sampling in complex, frustrated, or slow-evolving systems Difficult-to-simulate systems Practically speaking, one is
More information