Advanced Monte Carlo algorithms

Size: px
Start display at page:

Download "Advanced Monte Carlo algorithms"

Transcription

1 Advanced Monte Carlo algorithms Bad Honnef Physics School Computational Physics of Complex and Disordered Systemss Werner Krauth Département de Physique Ecole Normale Supérieure, Paris, France 23 September 2015 Monte Carlo algorithms - basic notions. Hard disks: From detailed balance to global balance and to cluster algorithms. Integration and Sampling: From Gaussians to Maxwell and Boltzmann. Cluster algorithms for spin models: Ising, XY, Spin glasses.

2 Breaking the rules

3 MOOC Statistical Mechanics: Algorithms and Computations see WK Coming home from a MOOC (CSE 2015)

4 Newton: event-driven molecular dynamics Next event at t = Molecular dynamics (Alder & Wainwright 1957)

5 Event-disks.py (1/2)

6 Event-disks.py (2/2)

7 Boltzmann: Equiprobability

8 Boltzmann: Equiprobability Random positions x i, y i (σ < x i, y i < 1 σ) If illegal: Tabula rasa! Else: OK!

9 Boltzmann: Equiprobability Random positions x i, y i (σ < x i, y i < 1 σ) If illegal: Tabula rasa! Else: OK!

10 Boltzmann: Equiprobability Random positions x i, y i (σ < x i, y i < 1 σ) If illegal: Tabula rasa! Else: OK!

11 Boltzmann: Equiprobability Random positions x i, y i (σ < x i, y i < 1 σ) If illegal: Tabula rasa! Else: OK!

12 Boltzmann: Equiprobability Random positions x i, y i (σ < x i, y i < 1 σ) If illegal: Tabula rasa! Else: OK!

13 Boltzmann: Equiprobability Random positions x i, y i (σ < x i, y i < 1 σ) If illegal: Tabula rasa! Else: OK!

14 Boltzmann: Equiprobability Random positions x i, y i (σ < x i, y i < 1 σ) If illegal: Tabula rasa! Else: OK!

15 Boltzmann: Equiprobability Random positions x i, y i (σ < x i, y i < 1 σ) If illegal: Tabula rasa! Else: OK!

16 Boltzmann: Equiprobability Random positions x i, y i (σ < x i, y i < 1 σ) If illegal: Tabula rasa! Else: OK!

17 Boltzmann: Equiprobability Random positions x i, y i (σ < x i, y i < 1 σ) If illegal: Tabula rasa! Else: OK!

18 Boltzmann: Equiprobability Random positions x i, y i (σ < x i, y i < 1 σ) If illegal: Tabula rasa! Else: OK!

19 Boltzmann: Equiprobability Random positions x i, y i (σ < x i, y i < 1 σ) If illegal: Tabula rasa! Else: OK!

20 Direct-disks.py

21 Newton vs. Boltzmann Equiprobability: π Newton (C) = π Boltzmann (C) = { constant 0 else for legal C Rigorous proofs: Sinai (1970), Simanyi (2003).

22 Newton vs. Newton (Chaos) initial position t = 0 of the green disks on the left (x, y) green = (0.25, 0.25) initial position t = 0 of the green disks on the right (x, y) boule verte = ( , 0.25)

23 Asakura-Oosawa Depletion interaction (5th force in nature) The probability π(x) is non-uniform (Asakura-Oosawa 1954).

24 Asakura-Oosawa Depletion interaction (5th force in nature) probability π(x) non-uniform: Disks are attracted to the walls Disks are attracted to each other

25 Asakura-Oosawa Depletion interaction (5th force in nature) Animations by Maxim Berman (for MOOC)

26 Configurations at density η = 0.42 All configurations equally likely

27 Liquid-solid transition of hard disks Described in 1964 using MD (Alder & Wainwright) Understood in 2011 (Bernard & Krauth)

28 Markov-chain Monte Carlo ( Boltzmann ) Local Markov-chain Monte Carlo for hard disks: i = 1 (rej.) i = 2 i = 3 i = 4 (rej.) i = 5 i = 6 i = 7 i = 8 (rej.) i = 9 (rej.) i = 10 i = 11 i = 12 (rej.) Metropolis et al. (1953) (see lecture 1). Exponential convergence (see lecture 1).

29 Markov-disks.py Metropolis et al. (1953).

30 Correlation time in larger simulations disk k same disk t = 0... t = τ exists, but it is large (τ ).

31 Detailed balance and global balance f a c f a c e d e d global balance detailed balance g b f a c e d maximal global balance

32 Lifting - two hard spheres hard wall hard wall d + a + b + c + d a b c x d 1 a 1 b 1 c 1 a 1 (transl.) c 2 (transl.) b 2 a 2 (transl.) d 2 (transl.) t t+1 t+2 t+3 t+4 t+5 Following: Diaconis, Holmes, Neal (2000)

33 Lift-two-disks-discrete.py Break detailed balance (move up or right)

34 Lift-two-disks-discrete.py (output) Pair distances ( x, y) shown. Break detailed balance (move up or right)

35 Lifting impossible (?) - three hard spheres c 2 a 2 d 2 a 1 b 1 e 3 a 3 f 3 t t+1 t+2

36 Event-chain algorithm Bernard, Krauth, Wilson PRE (2009) (hard-sphere potentials). Rejection-free, fixed total length. Global balance OK (!) (moving right and up).

37 event-chain.py

38 Pressure formula of Event-chain algorithm Excess distance pressure.

39 Hard-disk configuration hard disks circular color code for orientational order Bernard, Krauth (PRL 2011)

40 Event-chain for continuous potentials Event-chain algorithm for continuous potentials: Exact sampling of canonical partition function. Event-driven: time-discretization, energy drift, thermostat, potential cutoff (!).

41 Event-chain for continuous potentials Event-chain algorithm for continuous potentials: Exact sampling of canonical partition function. Event-driven: time-discretization, energy drift, thermostat, potential cutoff (!).

42 Conclusions Concepts considered: Molecular dynamics (Event-driven) Monte Carlo, equiprobability, tabula rasa algorithm Asakura-Oosawa depletion interaction Hard-disk transition Lifting Algorithms considered: event-disks.py direct-disks.py markov-disks.py event-chain.py

L échantillonnage parfait: un nouveau paradigme des calculs de Monte Carlo

L échantillonnage parfait: un nouveau paradigme des calculs de Monte Carlo L échantillonnage parfait: un nouveau paradigme des calculs de Monte Carlo Séminaire général Département de Physique Ecole normale supérieure Werner Krauth Laboratoire de physique statistique Ecole normale

More information

arxiv: v1 [cond-mat.stat-mech] 16 Jan 2009

arxiv: v1 [cond-mat.stat-mech] 16 Jan 2009 arxiv:0901.2496v1 [cond-mat.stat-mech] 16 Jan 2009 Four lectures on computational statistical physics Werner Krauth 1 Laboratoire de Physique Statistique CNRS-Ecole Normale Supérieure 24 rue Lhomond 75231

More information

Random Walks A&T and F&S 3.1.2

Random Walks A&T and F&S 3.1.2 Random Walks A&T 110-123 and F&S 3.1.2 As we explained last time, it is very difficult to sample directly a general probability distribution. - If we sample from another distribution, the overlap will

More information

Their Statistical Analvsis. With Web-Based Fortran Code. Berg

Their Statistical Analvsis. With Web-Based Fortran Code. Berg Markov Chain Monter rlo Simulations and Their Statistical Analvsis With Web-Based Fortran Code Bernd A. Berg Florida State Univeisitfi USA World Scientific NEW JERSEY + LONDON " SINGAPORE " BEIJING " SHANGHAI

More information

An Introduction to Computer Simulation Methods

An Introduction to Computer Simulation Methods An Introduction to Computer Simulation Methods Applications to Physical Systems Second Edition Harvey Gould Department of Physics Clark University Jan Tobochnik Department of Physics Kalamazoo College

More information

Monte Caro simulations

Monte Caro simulations Monte Caro simulations Monte Carlo methods - based on random numbers Stanislav Ulam s terminology - his uncle frequented the Casino in Monte Carlo Random (pseudo random) number generator on the computer

More information

Information, Physics, and Computation

Information, Physics, and Computation Information, Physics, and Computation Marc Mezard Laboratoire de Physique Thdorique et Moales Statistiques, CNRS, and Universit y Paris Sud Andrea Montanari Department of Electrical Engineering and Department

More information

Wang-Landau sampling for Quantum Monte Carlo. Stefan Wessel Institut für Theoretische Physik III Universität Stuttgart

Wang-Landau sampling for Quantum Monte Carlo. Stefan Wessel Institut für Theoretische Physik III Universität Stuttgart Wang-Landau sampling for Quantum Monte Carlo Stefan Wessel Institut für Theoretische Physik III Universität Stuttgart Overview Classical Monte Carlo First order phase transitions Classical Wang-Landau

More information

Monte Carlo Simulation of the Ising Model. Abstract

Monte Carlo Simulation of the Ising Model. Abstract Monte Carlo Simulation of the Ising Model Saryu Jindal 1 1 Department of Chemical Engineering and Material Sciences, University of California, Davis, CA 95616 (Dated: June 9, 2007) Abstract This paper

More information

Kyle Reing University of Southern California April 18, 2018

Kyle Reing University of Southern California April 18, 2018 Renormalization Group and Information Theory Kyle Reing University of Southern California April 18, 2018 Overview Renormalization Group Overview Information Theoretic Preliminaries Real Space Mutual Information

More information

Lecture 6: Monte-Carlo methods

Lecture 6: Monte-Carlo methods Miranda Holmes-Cerfon Applied Stochastic Analysis, Spring 2015 Lecture 6: Monte-Carlo methods Readings Recommended: handout on Classes site, from notes by Weinan E, Tiejun Li, and Eric Vanden-Eijnden Optional:

More information

Basics of Statistical Mechanics

Basics of Statistical Mechanics Basics of Statistical Mechanics Review of ensembles Microcanonical, canonical, Maxwell-Boltzmann Constant pressure, temperature, volume, Thermodynamic limit Ergodicity (see online notes also) Reading assignment:

More information

The XY-Model. David-Alexander Robinson Sch th January 2012

The XY-Model. David-Alexander Robinson Sch th January 2012 The XY-Model David-Alexander Robinson Sch. 08332461 17th January 2012 Contents 1 Introduction & Theory 2 1.1 The XY-Model............................... 2 1.2 Markov Chains...............................

More information

Markov Chain Monte Carlo The Metropolis-Hastings Algorithm

Markov Chain Monte Carlo The Metropolis-Hastings Algorithm Markov Chain Monte Carlo The Metropolis-Hastings Algorithm Anthony Trubiano April 11th, 2018 1 Introduction Markov Chain Monte Carlo (MCMC) methods are a class of algorithms for sampling from a probability

More information

Monte Carlo. Lecture 15 4/9/18. Harvard SEAS AP 275 Atomistic Modeling of Materials Boris Kozinsky

Monte Carlo. Lecture 15 4/9/18. Harvard SEAS AP 275 Atomistic Modeling of Materials Boris Kozinsky Monte Carlo Lecture 15 4/9/18 1 Sampling with dynamics In Molecular Dynamics we simulate evolution of a system over time according to Newton s equations, conserving energy Averages (thermodynamic properties)

More information

Graphical Representations and Cluster Algorithms

Graphical Representations and Cluster Algorithms Graphical Representations and Cluster Algorithms Jon Machta University of Massachusetts Amherst Newton Institute, March 27, 2008 Outline Introduction to graphical representations and cluster algorithms

More information

Principles of Equilibrium Statistical Mechanics

Principles of Equilibrium Statistical Mechanics Debashish Chowdhury, Dietrich Stauffer Principles of Equilibrium Statistical Mechanics WILEY-VCH Weinheim New York Chichester Brisbane Singapore Toronto Table of Contents Part I: THERMOSTATICS 1 1 BASIC

More information

Irreversibility and the arrow of time in a quenched quantum system. Eric Lutz Department of Physics University of Erlangen-Nuremberg

Irreversibility and the arrow of time in a quenched quantum system. Eric Lutz Department of Physics University of Erlangen-Nuremberg Irreversibility and the arrow of time in a quenched quantum system Eric Lutz Department of Physics University of Erlangen-Nuremberg Outline 1 Physics far from equilibrium Entropy production Fluctuation

More information

Markov Chain Monte Carlo Inference. Siamak Ravanbakhsh Winter 2018

Markov Chain Monte Carlo Inference. Siamak Ravanbakhsh Winter 2018 Graphical Models Markov Chain Monte Carlo Inference Siamak Ravanbakhsh Winter 2018 Learning objectives Markov chains the idea behind Markov Chain Monte Carlo (MCMC) two important examples: Gibbs sampling

More information

A = {(x, u) : 0 u f(x)},

A = {(x, u) : 0 u f(x)}, Draw x uniformly from the region {x : f(x) u }. Markov Chain Monte Carlo Lecture 5 Slice sampler: Suppose that one is interested in sampling from a density f(x), x X. Recall that sampling x f(x) is equivalent

More information

Introduction to molecular dynamics

Introduction to molecular dynamics 1 Introduction to molecular dynamics Yves Lansac Université François Rabelais, Tours, France Visiting MSE, GIST for the summer Molecular Simulation 2 Molecular simulation is a computational experiment.

More information

fiziks Institute for NET/JRF, GATE, IIT-JAM, JEST, TIFR and GRE in PHYSICAL SCIENCES

fiziks Institute for NET/JRF, GATE, IIT-JAM, JEST, TIFR and GRE in PHYSICAL SCIENCES Content-Thermodynamics & Statistical Mechanics 1. Kinetic theory of gases..(1-13) 1.1 Basic assumption of kinetic theory 1.1.1 Pressure exerted by a gas 1.2 Gas Law for Ideal gases: 1.2.1 Boyle s Law 1.2.2

More information

On Bayesian Computation

On Bayesian Computation On Bayesian Computation Michael I. Jordan with Elaine Angelino, Maxim Rabinovich, Martin Wainwright and Yun Yang Previous Work: Information Constraints on Inference Minimize the minimax risk under constraints

More information

7.1 Coupling from the Past

7.1 Coupling from the Past Georgia Tech Fall 2006 Markov Chain Monte Carlo Methods Lecture 7: September 12, 2006 Coupling from the Past Eric Vigoda 7.1 Coupling from the Past 7.1.1 Introduction We saw in the last lecture how Markov

More information

4/18/2011. Titus Beu University Babes-Bolyai Department of Theoretical and Computational Physics Cluj-Napoca, Romania

4/18/2011. Titus Beu University Babes-Bolyai Department of Theoretical and Computational Physics Cluj-Napoca, Romania 1. Introduction Titus Beu University Babes-Bolyai Department of Theoretical and Computational Physics Cluj-Napoca, Romania Bibliography Computer experiments Ensemble averages and time averages Molecular

More information

Markov Chain Monte Carlo (MCMC)

Markov Chain Monte Carlo (MCMC) Markov Chain Monte Carlo (MCMC Dependent Sampling Suppose we wish to sample from a density π, and we can evaluate π as a function but have no means to directly generate a sample. Rejection sampling can

More information

Perfect simulation algorithm of a trajectory under a Feynman-Kac law

Perfect simulation algorithm of a trajectory under a Feynman-Kac law Perfect simulation algorithm of a trajectory under a Feynman-Kac law Data Assimilation, 24th-28th September 212, Oxford-Man Institute C. Andrieu, N. Chopin, A. Doucet, S. Rubenthaler University of Bristol,

More information

Monte Carlo Methods for Computation and Optimization (048715)

Monte Carlo Methods for Computation and Optimization (048715) Technion Department of Electrical Engineering Monte Carlo Methods for Computation and Optimization (048715) Lecture Notes Prof. Nahum Shimkin Spring 2015 i PREFACE These lecture notes are intended for

More information

Direct observation of dynamical heterogeneities near the attraction driven glass

Direct observation of dynamical heterogeneities near the attraction driven glass Direct observation of dynamical heterogeneities near the attraction driven glass Maria Kilfoil McGill University Co-worker: Yongxiang Gao, PhD student http://www.physics.mcgill.ca/~kilfoil Dynamical heterogeneity

More information

Monte Carlo (MC) Simulation Methods. Elisa Fadda

Monte Carlo (MC) Simulation Methods. Elisa Fadda Monte Carlo (MC) Simulation Methods Elisa Fadda 1011-CH328, Molecular Modelling & Drug Design 2011 Experimental Observables A system observable is a property of the system state. The system state i is

More information

Simulation of the two-dimensional square-lattice Lenz-Ising model in Python

Simulation of the two-dimensional square-lattice Lenz-Ising model in Python Senior Thesis Simulation of the two-dimensional square-lattice Lenz-Ising model in Python Author: Richard Munroe Advisor: Dr. Edward Brash 2012-10-17 Abstract A program to simulate the the two-dimensional

More information

Malvin H. Kalos, Paula A. Whitlock. Monte Carlo Methods. Second Revised and Enlarged Edition WILEY- BLACKWELL. WILEY-VCH Verlag GmbH & Co.

Malvin H. Kalos, Paula A. Whitlock. Monte Carlo Methods. Second Revised and Enlarged Edition WILEY- BLACKWELL. WILEY-VCH Verlag GmbH & Co. Malvin H. Kalos, Paula A. Whitlock Monte Carlo Methods Second Revised and Enlarged Edition WILEY- BLACKWELL WILEY-VCH Verlag GmbH & Co. KGaA v I Contents Preface to the Second Edition IX Preface to the

More information

Stochastic optimization Markov Chain Monte Carlo

Stochastic optimization Markov Chain Monte Carlo Stochastic optimization Markov Chain Monte Carlo Ethan Fetaya Weizmann Institute of Science 1 Motivation Markov chains Stationary distribution Mixing time 2 Algorithms Metropolis-Hastings Simulated Annealing

More information

Review: Directed Models (Bayes Nets)

Review: Directed Models (Bayes Nets) X Review: Directed Models (Bayes Nets) Lecture 3: Undirected Graphical Models Sam Roweis January 2, 24 Semantics: x y z if z d-separates x and y d-separation: z d-separates x from y if along every undirected

More information

arxiv: v2 [physics.comp-ph] 18 Sep 2016

arxiv: v2 [physics.comp-ph] 18 Sep 2016 Article published on Journal of Computational Physics - DOI: 10.1016/j.jcp.2016.09.023 Meaningful timescales from Monte Carlo simulations of molecular systems with hard-core interactions Liborio I. Costa

More information

LECTURE 10: Monte Carlo Methods II

LECTURE 10: Monte Carlo Methods II 1 LECTURE 10: Monte Carlo Methods II In this chapter, we discuss more advanced Monte Carlo techniques, starting with the topics of percolation and random walks, and then continuing to equilibrium statistical

More information

Monte Carlo importance sampling and Markov chain

Monte Carlo importance sampling and Markov chain Monte Carlo importance sampling and Markov chain If a configuration in phase space is denoted by X, the probability for configuration according to Boltzman is ρ(x) e βe(x) β = 1 T (1) How to sample over

More information

Computer Vision Group Prof. Daniel Cremers. 11. Sampling Methods: Markov Chain Monte Carlo

Computer Vision Group Prof. Daniel Cremers. 11. Sampling Methods: Markov Chain Monte Carlo Group Prof. Daniel Cremers 11. Sampling Methods: Markov Chain Monte Carlo Markov Chain Monte Carlo In high-dimensional spaces, rejection sampling and importance sampling are very inefficient An alternative

More information

Gear methods I + 1/18

Gear methods I + 1/18 Gear methods I + 1/18 Predictor-corrector type: knowledge of history is used to predict an approximate solution, which is made more accurate in the following step we do not want (otherwise good) methods

More information

3.320 Lecture 18 (4/12/05)

3.320 Lecture 18 (4/12/05) 3.320 Lecture 18 (4/12/05) Monte Carlo Simulation II and free energies Figure by MIT OCW. General Statistical Mechanics References D. Chandler, Introduction to Modern Statistical Mechanics D.A. McQuarrie,

More information

Expectations, Markov chains, and the Metropolis algorithm

Expectations, Markov chains, and the Metropolis algorithm Expectations, Markov chains, and the Metropolis algorithm Peter Hoff Departments of Statistics and Biostatistics and the Center for Statistics and the Social Sciences University of Washington 7-27-05 1

More information

Chapter 11. Stochastic Methods Rooted in Statistical Mechanics

Chapter 11. Stochastic Methods Rooted in Statistical Mechanics Chapter 11. Stochastic Methods Rooted in Statistical Mechanics Neural Networks and Learning Machines (Haykin) Lecture Notes on Self-learning Neural Algorithms Byoung-Tak Zhang School of Computer Science

More information

Metropolis Monte Carlo simulation of the Ising Model

Metropolis Monte Carlo simulation of the Ising Model Metropolis Monte Carlo simulation of the Ising Model Krishna Shrinivas (CH10B026) Swaroop Ramaswamy (CH10B068) May 10, 2013 Modelling and Simulation of Particulate Processes (CH5012) Introduction The Ising

More information

Lecture 3: September 10

Lecture 3: September 10 CS294 Markov Chain Monte Carlo: Foundations & Applications Fall 2009 Lecture 3: September 10 Lecturer: Prof. Alistair Sinclair Scribes: Andrew H. Chan, Piyush Srivastava Disclaimer: These notes have not

More information

Langevin Methods. Burkhard Dünweg Max Planck Institute for Polymer Research Ackermannweg 10 D Mainz Germany

Langevin Methods. Burkhard Dünweg Max Planck Institute for Polymer Research Ackermannweg 10 D Mainz Germany Langevin Methods Burkhard Dünweg Max Planck Institute for Polymer Research Ackermannweg 1 D 55128 Mainz Germany Motivation Original idea: Fast and slow degrees of freedom Example: Brownian motion Replace

More information

Thermodynamics of histories: some examples

Thermodynamics of histories: some examples Thermodynamics of histories: some examples Vivien Lecomte 1,2, Cécile Appert-Rolland 1, Estelle Pitard 3, Frédéric van Wijland 1,2 1 Laboratoire de Physique Théorique, Université d Orsay 2 Laboratoire

More information

Once Upon A Time, There Was A Certain Ludwig

Once Upon A Time, There Was A Certain Ludwig Once Upon A Time, There Was A Certain Ludwig Statistical Mechanics: Ensembles, Distributions, Entropy and Thermostatting Srinivas Mushnoori Chemical & Biochemical Engineering Rutgers, The State University

More information

The non-backtracking operator

The non-backtracking operator The non-backtracking operator Florent Krzakala LPS, Ecole Normale Supérieure in collaboration with Paris: L. Zdeborova, A. Saade Rome: A. Decelle Würzburg: J. Reichardt Santa Fe: C. Moore, P. Zhang Berkeley:

More information

Markov chain Monte Carlo

Markov chain Monte Carlo Markov chain Monte Carlo Peter Beerli October 10, 2005 [this chapter is highly influenced by chapter 1 in Markov chain Monte Carlo in Practice, eds Gilks W. R. et al. Chapman and Hall/CRC, 1996] 1 Short

More information

LECTURE 4 WORM ALGORITHM FOR QUANTUM STATISTICAL MODELS II

LECTURE 4 WORM ALGORITHM FOR QUANTUM STATISTICAL MODELS II LECTURE 4 WORM ALGORITHM FOR QUANTUM STATISTICAL MODELS II LECTURE 4 WORM ALGORITHM FOR QUANTUM STATISTICAL MODELS II Path-integral for continuous systems: oriented closed loops LECTURE 4 WORM ALGORITHM

More information

J ij S i S j B i S i (1)

J ij S i S j B i S i (1) LECTURE 18 The Ising Model (References: Kerson Huang, Statistical Mechanics, Wiley and Sons (1963) and Colin Thompson, Mathematical Statistical Mechanics, Princeton Univ. Press (1972)). One of the simplest

More information

Paul Karapanagiotidis ECO4060

Paul Karapanagiotidis ECO4060 Paul Karapanagiotidis ECO4060 The way forward 1) Motivate why Markov-Chain Monte Carlo (MCMC) is useful for econometric modeling 2) Introduce Markov-Chain Monte Carlo (MCMC) - Metropolis-Hastings (MH)

More information

Irreversible Markov-Chain Monte Carlo methods

Irreversible Markov-Chain Monte Carlo methods Irreversible Markov-Chain Monte Carlo methods Koji HUKUSHIMA Department of Basic Science, University of Tokyo 3-8-1 Komaba, Meguro-ku, Tokyo 153-8902 Abstract We review irreversible Markov chain Monte

More information

Lecture 6: Markov Chain Monte Carlo

Lecture 6: Markov Chain Monte Carlo Lecture 6: Markov Chain Monte Carlo D. Jason Koskinen koskinen@nbi.ku.dk Photo by Howard Jackman University of Copenhagen Advanced Methods in Applied Statistics Feb - Apr 2016 Niels Bohr Institute 2 Outline

More information

Monte Carlo Lecture Notes II, Jonathan Goodman. Courant Institute of Mathematical Sciences, NYU. January 29, 1997

Monte Carlo Lecture Notes II, Jonathan Goodman. Courant Institute of Mathematical Sciences, NYU. January 29, 1997 Monte Carlo Lecture Notes II, Jonathan Goodman Courant Institute of Mathematical Sciences, NYU January 29, 1997 1 Introduction to Direct Sampling We think of the computer \random number generator" as an

More information

Evaluation of Wang-Landau Monte Carlo Simulations

Evaluation of Wang-Landau Monte Carlo Simulations 2012 4th International Conference on Computer Modeling and Simulation (ICCMS 2012) IPCSIT vol.22 (2012) (2012) IACSIT Press, Singapore Evaluation of Wang-Landau Monte Carlo Simulations Seung-Yeon Kim School

More information

Stat 8501 Lecture Notes Spatial Lattice Processes Charles J. Geyer November 16, Introduction

Stat 8501 Lecture Notes Spatial Lattice Processes Charles J. Geyer November 16, Introduction Stat 8501 Lecture Notes Spatial Lattice Processes Charles J. Geyer November 16, 2016 1 Introduction A spatial lattice process is a stochastic process with a discrete carrier T, that is, we have random

More information

Minicourse on: Markov Chain Monte Carlo: Simulation Techniques in Statistics

Minicourse on: Markov Chain Monte Carlo: Simulation Techniques in Statistics Minicourse on: Markov Chain Monte Carlo: Simulation Techniques in Statistics Eric Slud, Statistics Program Lecture 1: Metropolis-Hastings Algorithm, plus background in Simulation and Markov Chains. Lecture

More information

Computer Vision Group Prof. Daniel Cremers. 14. Sampling Methods

Computer Vision Group Prof. Daniel Cremers. 14. Sampling Methods Prof. Daniel Cremers 14. Sampling Methods Sampling Methods Sampling Methods are widely used in Computer Science as an approximation of a deterministic algorithm to represent uncertainty without a parametric

More information

Parallel Tempering Algorithm in Monte Carlo Simulation

Parallel Tempering Algorithm in Monte Carlo Simulation Parallel Tempering Algorithm in Monte Carlo Simulation Tony Cheung (CUHK) Kevin Zhao (CUHK) Mentors: Ying Wai Li (ORNL) Markus Eisenbach (ORNL) Kwai Wong (UTK/ORNL) Metropolis Algorithm on Ising Model

More information

Lecture V: Multicanonical Simulations.

Lecture V: Multicanonical Simulations. Lecture V: Multicanonical Simulations. 1. Multicanonical Ensemble 2. How to get the Weights? 3. Example Runs (2d Ising and Potts models) 4. Re-Weighting to the Canonical Ensemble 5. Energy and Specific

More information

Computer Vision Group Prof. Daniel Cremers. 11. Sampling Methods

Computer Vision Group Prof. Daniel Cremers. 11. Sampling Methods Prof. Daniel Cremers 11. Sampling Methods Sampling Methods Sampling Methods are widely used in Computer Science as an approximation of a deterministic algorithm to represent uncertainty without a parametric

More information

ICCP Project 2 - Advanced Monte Carlo Methods Choose one of the three options below

ICCP Project 2 - Advanced Monte Carlo Methods Choose one of the three options below ICCP Project 2 - Advanced Monte Carlo Methods Choose one of the three options below Introduction In statistical physics Monte Carlo methods are considered to have started in the Manhattan project (1940

More information

The nature of superfluidity in the cold atomic unitary Fermi gas

The nature of superfluidity in the cold atomic unitary Fermi gas The nature of superfluidity in the cold atomic unitary Fermi gas Introduction Yoram Alhassid (Yale University) Finite-temperature auxiliary-field Monte Carlo (AFMC) method The trapped unitary Fermi gas

More information

Markov chain Monte Carlo Lecture 9

Markov chain Monte Carlo Lecture 9 Markov chain Monte Carlo Lecture 9 David Sontag New York University Slides adapted from Eric Xing and Qirong Ho (CMU) Limitations of Monte Carlo Direct (unconditional) sampling Hard to get rare events

More information

Computer Intensive Methods in Mathematical Statistics

Computer Intensive Methods in Mathematical Statistics Computer Intensive Methods in Mathematical Statistics Department of mathematics johawes@kth.se Lecture 16 Advanced topics in computational statistics 18 May 2017 Computer Intensive Methods (1) Plan of

More information

Rare Event Sampling using Multicanonical Monte Carlo

Rare Event Sampling using Multicanonical Monte Carlo Rare Event Sampling using Multicanonical Monte Carlo Yukito IBA The Institute of Statistical Mathematics This is my 3rd oversea trip; two of the three is to Australia. Now I (almost) overcome airplane

More information

Introduction to Bayesian methods in inverse problems

Introduction to Bayesian methods in inverse problems Introduction to Bayesian methods in inverse problems Ville Kolehmainen 1 1 Department of Applied Physics, University of Eastern Finland, Kuopio, Finland March 4 2013 Manchester, UK. Contents Introduction

More information

Guiding Monte Carlo Simulations with Machine Learning

Guiding Monte Carlo Simulations with Machine Learning Guiding Monte Carlo Simulations with Machine Learning Yang Qi Department of Physics, Massachusetts Institute of Technology Joining Fudan University in 2017 KITS, June 29 2017. 1/ 33 References Works led

More information

Understanding Molecular Simulation 2009 Monte Carlo and Molecular Dynamics in different ensembles. Srikanth Sastry

Understanding Molecular Simulation 2009 Monte Carlo and Molecular Dynamics in different ensembles. Srikanth Sastry JNCASR August 20, 21 2009 Understanding Molecular Simulation 2009 Monte Carlo and Molecular Dynamics in different ensembles Srikanth Sastry Jawaharlal Nehru Centre for Advanced Scientific Research, Bangalore

More information

Chaos, Quantum Mechanics, and Computers

Chaos, Quantum Mechanics, and Computers What do Climate Modeling and Quantum Mechanics have in common? Chaos, Quantum Mechanics, and Computers Computer simulation: now one of the most important ingredients for progress... Dark Matter Technology

More information

Numerical Analysis of 2-D Ising Model. Ishita Agarwal Masters in Physics (University of Bonn) 17 th March 2011

Numerical Analysis of 2-D Ising Model. Ishita Agarwal Masters in Physics (University of Bonn) 17 th March 2011 Numerical Analysis of 2-D Ising Model By Ishita Agarwal Masters in Physics (University of Bonn) 17 th March 2011 Contents Abstract Acknowledgment Introduction Computational techniques Numerical Analysis

More information

Sampling Rejection Sampling Importance Sampling Markov Chain Monte Carlo. Sampling Methods. Oliver Schulte - CMPT 419/726. Bishop PRML Ch.

Sampling Rejection Sampling Importance Sampling Markov Chain Monte Carlo. Sampling Methods. Oliver Schulte - CMPT 419/726. Bishop PRML Ch. Sampling Methods Oliver Schulte - CMP 419/726 Bishop PRML Ch. 11 Recall Inference or General Graphs Junction tree algorithm is an exact inference method for arbitrary graphs A particular tree structure

More information

Monte Carlo integration (naive Monte Carlo)

Monte Carlo integration (naive Monte Carlo) Monte Carlo integration (naive Monte Carlo) Example: Calculate π by MC integration [xpi] 1/21 INTEGER n total # of points INTEGER i INTEGER nu # of points in a circle REAL x,y coordinates of a point in

More information

Nuclear Structure and Reactions using Lattice Effective Field Theory

Nuclear Structure and Reactions using Lattice Effective Field Theory Nuclear Structure and Reactions using Lattice Effective Field Theory Dean Lee North Carolina State University Nuclear Lattice EFT Collaboration Frontiers of Nuclear Physics Kavli Institute for Theoretical

More information

General Construction of Irreversible Kernel in Markov Chain Monte Carlo

General Construction of Irreversible Kernel in Markov Chain Monte Carlo General Construction of Irreversible Kernel in Markov Chain Monte Carlo Metropolis heat bath Suwa Todo Department of Applied Physics, The University of Tokyo Department of Physics, Boston University (from

More information

Markov Chain Monte Carlo Using the Ratio-of-Uniforms Transformation. Luke Tierney Department of Statistics & Actuarial Science University of Iowa

Markov Chain Monte Carlo Using the Ratio-of-Uniforms Transformation. Luke Tierney Department of Statistics & Actuarial Science University of Iowa Markov Chain Monte Carlo Using the Ratio-of-Uniforms Transformation Luke Tierney Department of Statistics & Actuarial Science University of Iowa Basic Ratio of Uniforms Method Introduced by Kinderman and

More information

Renormalization of Tensor- Network States Tao Xiang

Renormalization of Tensor- Network States Tao Xiang Renormalization of Tensor- Network States Tao Xiang Institute of Physics/Institute of Theoretical Physics Chinese Academy of Sciences txiang@iphy.ac.cn Physical Background: characteristic energy scales

More information

Classical Monte-Carlo simulations

Classical Monte-Carlo simulations Classical Monte-Carlo simulations Graduate Summer Institute Complex Plasmas at the Stevens Insitute of Technology Henning Baumgartner, A. Filinov, H. Kählert, P. Ludwig and M. Bonitz Christian-Albrechts-University

More information

Self-learning Monte Carlo Method

Self-learning Monte Carlo Method Self-learning Monte Carlo Method Zi Yang Meng ( 孟子杨 ) http://ziyangmeng.iphy.ac.cn/ Know thyself "Know thyself" (Greek: γνῶθι σεαυτόν, gnothi seauton) one of the Delphic maxims and was inscribed in the

More information

Thermodynamics of histories: application to systems with glassy dynamics

Thermodynamics of histories: application to systems with glassy dynamics Thermodynamics of histories: application to systems with glassy dynamics Vivien Lecomte 1,2, Cécile Appert-Rolland 1, Estelle Pitard 3, Kristina van Duijvendijk 1,2, Frédéric van Wijland 1,2 Juan P. Garrahan

More information

Markov Processes. Stochastic process. Markov process

Markov Processes. Stochastic process. Markov process Markov Processes Stochastic process movement through a series of well-defined states in a way that involves some element of randomness for our purposes, states are microstates in the governing ensemble

More information

Improvement of Monte Carlo estimates with covariance-optimized finite-size scaling at fixed phenomenological coupling

Improvement of Monte Carlo estimates with covariance-optimized finite-size scaling at fixed phenomenological coupling Improvement of Monte Carlo estimates with covariance-optimized finite-size scaling at fixed phenomenological coupling Francesco Parisen Toldin Max Planck Institute for Physics of Complex Systems Dresden

More information

MCMC Methods: Gibbs and Metropolis

MCMC Methods: Gibbs and Metropolis MCMC Methods: Gibbs and Metropolis Patrick Breheny February 28 Patrick Breheny BST 701: Bayesian Modeling in Biostatistics 1/30 Introduction As we have seen, the ability to sample from the posterior distribution

More information

Lecture 5: Random Energy Model

Lecture 5: Random Energy Model STAT 206A: Gibbs Measures Invited Speaker: Andrea Montanari Lecture 5: Random Energy Model Lecture date: September 2 Scribe: Sebastien Roch This is a guest lecture by Andrea Montanari (ENS Paris and Stanford)

More information

Markov Chains for Tensor Network States

Markov Chains for Tensor Network States Sofyan Iblisdir University of Barcelona September 2013 arxiv 1309.4880 Outline Main issue discussed here: how to find good tensor network states? The optimal state problem Markov chains Multiplicative

More information

Advanced sampling. fluids of strongly orientation-dependent interactions (e.g., dipoles, hydrogen bonds)

Advanced sampling. fluids of strongly orientation-dependent interactions (e.g., dipoles, hydrogen bonds) Advanced sampling ChE210D Today's lecture: methods for facilitating equilibration and sampling in complex, frustrated, or slow-evolving systems Difficult-to-simulate systems Practically speaking, one is

More information

Markov Chain Monte Carlo Simulations and Their Statistical Analysis An Overview

Markov Chain Monte Carlo Simulations and Their Statistical Analysis An Overview Markov Chain Monte Carlo Simulations and Their Statistical Analysis An Overview Bernd Berg FSU, August 30, 2005 Content 1. Statistics as needed 2. Markov Chain Monte Carlo (MC) 3. Statistical Analysis

More information

Monte Carlo and cold gases. Lode Pollet.

Monte Carlo and cold gases. Lode Pollet. Monte Carlo and cold gases Lode Pollet lpollet@physics.harvard.edu 1 Outline Classical Monte Carlo The Monte Carlo trick Markov chains Metropolis algorithm Ising model critical slowing down Quantum Monte

More information

Reducing The Computational Cost of Bayesian Indoor Positioning Systems

Reducing The Computational Cost of Bayesian Indoor Positioning Systems Reducing The Computational Cost of Bayesian Indoor Positioning Systems Konstantinos Kleisouris, Richard P. Martin Computer Science Department Rutgers University WINLAB Research Review May 15 th, 2006 Motivation

More information

Simulations with MM Force Fields. Monte Carlo (MC) and Molecular Dynamics (MD) Video II.vi

Simulations with MM Force Fields. Monte Carlo (MC) and Molecular Dynamics (MD) Video II.vi Simulations with MM Force Fields Monte Carlo (MC) and Molecular Dynamics (MD) Video II.vi Some slides taken with permission from Howard R. Mayne Department of Chemistry University of New Hampshire Walking

More information

Energy Based Models. Stefano Ermon, Aditya Grover. Stanford University. Lecture 13

Energy Based Models. Stefano Ermon, Aditya Grover. Stanford University. Lecture 13 Energy Based Models Stefano Ermon, Aditya Grover Stanford University Lecture 13 Stefano Ermon, Aditya Grover (AI Lab) Deep Generative Models Lecture 13 1 / 21 Summary Story so far Representation: Latent

More information

Quantum Annealing in spin glasses and quantum computing Anders W Sandvik, Boston University

Quantum Annealing in spin glasses and quantum computing Anders W Sandvik, Boston University PY502, Computational Physics, December 12, 2017 Quantum Annealing in spin glasses and quantum computing Anders W Sandvik, Boston University Advancing Research in Basic Science and Mathematics Example:

More information

The Monte Carlo Method An Introduction to Markov Chain MC

The Monte Carlo Method An Introduction to Markov Chain MC The Monte Carlo Method An Introduction to Markov Chain MC Sachin Shanbhag Department of Scientific Computing, Florida State University Sources. Introduction to Monte Carlo Algorithms : Werner Krauth. Available

More information

(5) Multi-parameter models - Gibbs sampling. ST440/540: Applied Bayesian Analysis

(5) Multi-parameter models - Gibbs sampling. ST440/540: Applied Bayesian Analysis Summarizing a posterior Given the data and prior the posterior is determined Summarizing the posterior gives parameter estimates, intervals, and hypothesis tests Most of these computations are integrals

More information

The Particle Filter. PD Dr. Rudolph Triebel Computer Vision Group. Machine Learning for Computer Vision

The Particle Filter. PD Dr. Rudolph Triebel Computer Vision Group. Machine Learning for Computer Vision The Particle Filter Non-parametric implementation of Bayes filter Represents the belief (posterior) random state samples. by a set of This representation is approximate. Can represent distributions that

More information

KINETIC THEORY OF GASES

KINETIC THEORY OF GASES LECTURE 8 KINETIC THEORY OF GASES Text Sections 0.4, 0.5, 0.6, 0.7 Sample Problems 0.4 Suggested Questions Suggested Problems Summary None 45P, 55P Molecular model for pressure Root mean square (RMS) speed

More information

Reminder of some Markov Chain properties:

Reminder of some Markov Chain properties: Reminder of some Markov Chain properties: 1. a transition from one state to another occurs probabilistically 2. only state that matters is where you currently are (i.e. given present, future is independent

More information

Statistical Mechanics

Statistical Mechanics Statistical Mechanics Entropy, Order Parameters, and Complexity James P. Sethna Laboratory of Atomic and Solid State Physics Cornell University, Ithaca, NY OXFORD UNIVERSITY PRESS Contents List of figures

More information

Statistical Thermodynamics and Monte-Carlo Evgenii B. Rudnyi and Jan G. Korvink IMTEK Albert Ludwig University Freiburg, Germany

Statistical Thermodynamics and Monte-Carlo Evgenii B. Rudnyi and Jan G. Korvink IMTEK Albert Ludwig University Freiburg, Germany Statistical Thermodynamics and Monte-Carlo Evgenii B. Rudnyi and Jan G. Korvink IMTEK Albert Ludwig University Freiburg, Germany Preliminaries Learning Goals From Micro to Macro Statistical Mechanics (Statistical

More information