arxiv: v2 [cond-mat.stat-mech] 13 Oct 2010
|
|
- Christopher Gilmore
- 6 years ago
- Views:
Transcription
1 Markov Chain Monte Carlo Method without Detailed Balance Hidemaro Suwa 1 and Synge Todo 1,2 1 Department of Applied Physics, University of Tokyo, Tokyo , Japan 2 CREST, Japan Science and Technology Agency, Kawaguchi , Japan (Dated: October 14, 2010) arxiv: v2 [cond-mat.stat-mech] 13 Oct 2010 We present a specific algorithm that generally satisfies the balance condition without imposing the detailed balance in the Markov chain Monte Carlo. In our algorithm, the average rejection rate is minimized, and even reduced to zero in many relevant cases. The absence of the detailed balance also introduces a net stochastic flow in a configuration space, which further boosts up the convergence. We demonstrate that the autocorrelation time of the Potts model becomes more than 6 times shorter than that by the conventional Metropolis algorithm. Based on the same concept, a bounce-free worm algorithm for generic quantum spin models is formulated as well. PACS numbers: Tt, Ln, r, Ss The Markov chain Monte Carlo (MCMC) method, which is a vital tool for investigating almost all kinds of statistical problems, especially systems with multiple degrees of freedom, is being applied extensively across the various disciplines, such as statistics, economics, and bioinformatics, not to mention physics [1 3]. In the MCMC method for a stationary distribution, the balance condition [BC, Eq. (2) below] and the ergodicity must be imposed; the former ensures the invariance of a target distribution, while the latter does the convergence to the invariant [4, 5]. Although an MCMC method satisfying these two conditions guarantees unbiased results in infinite time in principle, a rapid relaxation, that is, a short correlation time, is essential for the method to work in practice. The longer the autocorrelation time is, the larger the error bar becomes. In order to achieve weaker correlations in a Markov sequence, a number of variants have been invented so far, e.g., the Swendsen-Wang algorithm [6] and the loop algorithm [7]. The extended ensemble methods, such as the multicanonical method [8] and the exchange Monte Carlo method[9], have also been proposed and applied successfully to protein folding problems, spin glasses, etc. In most practical implementations of the MCMC method, the detailed balance condition (DBC), the reversibility, is imposed, where every elementary transition is forced to balance with a corresponding inverse process. Thanks to the DBC, it becomes easy to find qualified transition probabilities. In the meantime, it has long been considered difficult to satisfy the BC without imposing the DBC, and attempts to reduce autocorrelations in Markov sequences have concentrated on optimizing transition probabilities within the DBC [10, 11]. Here, we need to be reminded that the DBC is not a necessary condition for the invariance. The BC, which is a weaker condition than the DBC, is mathematically sufficient [4, 5]. In fact, the DBC is often broken secretly, even though the DBC is used apparently to define the transition probabilities. The single spin update in a classical system is such an example. The random update, where a spin to be flipped is chosen uniformly randomly among all spins, satisfies the DBC strictly. On the other hand, the DBC is broken in the sequential update, where spins are swept in a fixed order. The DBC is satisfied only locally, that is, only in each spin flip, and the BC is eventually fulfilled in one sweep [12]. In this Letter, we present a simple and versatile algorithm to find a set of transition probabilities in the MCMC method, which fulfills the BC but breaks the DBC even locally. As the BC is a weaker condition than the DBC, the solution space of transition probabilities is enlarged, and rejection rates can be reduced as the result. We show that by the present algorithm the average rejection rate is indeed minimized, and even reduced to zero in many relevant cases. Furthermore, breaking the DBC introduces a net stochastic flow in the configuration space. It will boost up the relaxation further by suppressing random walk behavior [13 15][26]. In what follows, after describing our specific algorithm for finding a rejection-minimized solution, we will demonstrate its effectiveness in the single spin update of the Potts model [16] and the worm (directed-loop) update [17, 18] of the quantum Heisenberg spin chain in a magnetic field. In both cases, it is established that our algorithm boosts up the relaxation significantly in comparison with the conventional algorithms, such as the Metropolis (also called Metropolis-Hastings) algorithm [19, 20], or the heat bath algorithm (Gibbs sampler) [21, 22]. Especially, a bounce-free (rejection-free) worm algorithm can be formulated for generic quantum spin models, by which the autocorrelation time is often reduced by orders of magnitude as we will see below. We start with considering an elementary update process, e.g., flipping a single spin in the Ising or Potts models, or choosing an exit at an operator in the worm algorithm (see below). Given an environmental configuration, we would have n candidates (including the current one) for the next configuration. The weight of each candidate configuration (or state) is given by w i (i = 1,...,n), to which the equilibrium probability distribution is proportional. Although in the formulation of the MCMC method, the BC (or the DBC) is usually expressed in terms of the weights {w i } and the transition probabilities {p i j }, it is more convenient to introduce a quan-
2 2 Metropolis heat bath FIG. 1: Example of weight landfill bythe Metropolis and heat bath algorithms for n = 2. The amount of landfilled weight, v i j, is defined by Eqs. (3) and (4), respectively. The regions with thick frame denote the rejection rates. tity v i j := w i p i j, which corresponds to the amount of (raw) stochastic flow from state i to j. The law of probability conservation and the BC are then expressed as w i = v i j i (1) w j = j=1 v i j j, (2) i=1 respectively. The average rejection rate is written as i v i i/ i w i. Also, it is straightforward to confirm that {v i j } satisfy v i j = 1 n 1 min(w i,w j ) i j (3) for the Metropolis algorithm, and v i j = w iw j n k=1 w k i, j (4) for the heat bath algorithm, where the detailed balance, i.e., the absence of net stochastic flow, is manifested by the symmetry under the interchange of the indices: v i j = v j i. Our task is to find a set {v i j } that minimizes the average rejection rate while satisfying Eqs. (1) and (2). This procedure can be understood visually as weight landfill, where we move (or allocate) some amount of weight (v i j ) from state i to j keeping the entire shape of the weight boxes intact. For catching on this landfill picture, let us think at first the case with n = 2 as in the single spin update of the Ising model. Figure 1 shows the landfill when the Metropolis and heat bath algorithms[eqs.(3) and(4)] are applied, where the average rejection rate ( v 1 1 +v 2 2 ) clearly remains finite. Indeed, for n = 2 the Metropolis algorithm gives the best solution, i.e., the minimum average rejection rate even within the BC [see Eq. (9) below]. For n 3, on the other hand, we can get ahead by breaking with the DBC. In Fig. 2, we show examples of weight landfill in the case with n = 4 by using the Metropolis and the heat bath algorithms together with a solution that does not satisfy the DBC. The first two again have finite rejection rates, while the last is rejection free (i.e., v i i = 0 i). Although a solution is not Metropolis heat bath present FIG. 2: Example of weight landfill by the Metropolis, heat bath, and the proposed algorithms for n = 4. In the present algorithm, first the maximum weight (w 1) is allocated to the second box. It saturates the second box, and the remainder is all put into the third one (first row). Next, w 2 is allocated to the partially filled box and the subsequent box (second row). The same procedure is repeated for w 3 and w 4. This proposed algorithm is rejection free, while there remain finite rejection rates in the others as indicated by the thick frames. unique obviously, we propose the following procedure as a concrete algorithm to find a solution for general n. (i) Choose a configuration with maximum weight. If two or more configurations have the same maximum weight, choose one of them. In the following, we assume w 1 is the maximum without loss of generality. The order of the remaining weights does not matter. (ii) Allocate the maximum weight w 1 to the next box (i = 2). If the weight still remains after saturating the box, reallocate the remainder to the next (i = 3). Continue until the weight is all allocated. (iii) Allocate the weight of the first landfilled box (w 2 ) to the last partially filled box in step ii). Continue the allocation likewise. iv) Repeat step iii) for w 3, w 4,...,w n. Once all the boxes with i 2 are saturated, landfill the first box (i = 1) afterward. In the above procedure, all the boxes are landfilled without any space; that is, it satisfies the BC [Eq. (2)]. Since the BC is satisfied in each elementary transition, it is fulfilled in one sweep as well. It is also clear that the second and subsequent boxes must be already saturated when the allocation of its own weight is initiated, since w 1 is the maximum. By this procedure, {v i j } are determined as v i j = max(0, min( ij, w i +w j ij, w i, w j )), (5) where ij := S i S j 1 +w 1 1 i, j n (6) i S i := w k 1 i n (7) k=1 S 0 := S n. (8)
3 q = 4 q = 8 (a) (b) (c) (d) (e) 10 2 τ int T FIG. 3: Autocorrelation time of the square of order parameter near the transition temperature (T and 0.745, respectively) in the 4-state (left) and 8-state (right) Potts models by the Metropolis (circles), heat bath (triangles), LOU (diamonds), and present (squares) methods. The system size is The error bars are the same order with the point sizes. Especially, from Eq. (5) we obtain { max(0, 2w 1 S n ) i = 1 v i i = 0 i 2. That is, a rejection-free solution can be obtained, if w 1 S n (9) w k (10) k=1 is satisfied. On the contrary, when inequality (10) is not satisfied, one has to necessarily assign the maximum weight to itself, as it is bigger than the sum of the rest. Thus, the present solution is optimal within the BC, in the sense that it minimizes the average rejection rate. We close the introduction of our algorithm with a note about the ergodicity. It is far from trivial to prove that the present algorithm, as well as the Metropolis algorithm, satisfies the ergodicity, since many of the transition probabilities become zero exactly. In principle, however, one can always ensure the ergodicity by combining the present algorithm with the heat bath method. Another way to ensure the ergodicity is randomly choosing one of the sets of transition probabilities obtained by different landfill order, though we have not observed any glimpse of ergodicity breaking in the following simulations. In order to assess the effectiveness of the present algorithm, we investigate the autocorrelations in the ferromagnetic q-state Potts models on the square lattice [16], which exhibit a continuous (q 4) or first-order (q > 4) phase transition at T = 1/ln(1 + q). We calculate the autocorrelation time of the square of order parameter for q = 4 and 8 by several algorithms. The autocorrelation time τ int is estimated through the relation: σ 2 = (1 + 2τ int )σ 2 0, where σ 2 0 is the variance of the raw time series data and σ 2 is the true variance calculated FIG. 4: Extension of the worm-going pathway in the S = 1/2 model. Here, dashed (solid) vertical lines denote spin up (down). The head of worm (open circle) moves on the worldline (a), and scatters at the operator (horizontal thick line). As candidate configurations, we introduce operatorflip updates (d) (e) in addition to the conventional ones (a) (c). Note that in (e) the position of the operator is shifted simultaneously in contrast to the simple bounce process (a). from the binned data using a bin size much larger than the τ int [1]. In Fig. 3, it is clearly seen that our algorithm significantly boosts up the relaxation in both models in comparison with the conventional methods. In the 4-state Potts model, the autocorrelation time becomes nearly 6.4 times shorter than that by the Metropolis algorithm, 2.7 times than the heat bath algorithm, and even 1.4 times than the locally optimal update (LOU) by Pollet et al. [11], which is considered as one of the best solutions within the DBC. Furthermore, the present algorithm is increasingly advantaged as q increases. Next, we move onto the quantum Monte Carlo methods. The worm algorithm for quantum spin and lattice boson models is formulated based on either the Euclidean pathintegral or the high-temperature series [17, 18]. One Monte Carlo sweep of the worm algorithm consists of the diagonal update, where operators are inserted or removed without changing the shape of worldlines, and the off-diagonal update, where the worldlines (and the type of operators) are updated with keeping the position of operators unchanged. In the latter process, a pair of creation and annihilation operators, which is called a worm, isinserted onaworldline(pair creation), and oneofthem (called the head) is moved stochastically until the head and the tail destroy each other (pair annihilation). As a thorny problem, a bounce process, where the head just backtracks and cancels the last update, has been generally inevitable within the DBC. Here, as an example, we consider the S = 1/2 antiferromagnetic XXZ model: H = <i,j>( S x i Sj x +Sy i Sy j + Sz i Sz j C) h Si z, (11) i where we introduce an arbitrary parameter C controlling the ratio between the diagonal and off-diagonal weights. In the head scattering process at an operator, only three amongfourexitshaveanonzeroweightduetotheconservation of the total S z [(a) (c) in Fig. 4]. At the Heisenberg point ( = 1), there remain finite bounce probabilities except at h = 0 within the DBC [11, 18, 23]. Unfortunately, the situation does not improve much even in the BC, because the total number of candidates is too small. However, the condition (10) provides us a clear prospect; by increasing the number of candidates, a bounce-free al-
4 4 m τ int h FIG. 5: Magnetic field dependence of magnetization (upper) and autocorrelation time (lower) of the S = 1/2 antiferromagnetic Heisenberg chain (L = 64, T = 1/2L). The maximum autocorrelation time is by the worm update with Metropolis (circles), by the worm with heat bath (triangles), by the LOU (diamonds), an improvement of the directed loop, and by the present algorithm (squares). By the bounce-free worm with the operator flip, τ int is further reduced down to 8.1 (solid squares). gorithm will be realized. According to this strategy, we introduce operator-flip updates, where sites on which an operator acts are shifted simultaneously (Fig. 4). By the operator flip together with the constant C chosen as ( 1 C = max 4 (2 +3h 1), 1 ) 8 ( +3h+1), (12) we can actually eliminate the bounce process absolutely. The autocorrelation data of the magnetization in the Heisenberg chain ( = 1) are shown in Fig. 5. Amazingly, the bounce-free worm algorithm with the operator flip is faster by about 2 orders of magnitude than the Metropolis and the heat bath algorithms. Also in high-s spin systems, the bounce-free worms can be constructed by representing the partition function by decomposed S = 1/2 spins [24]. Our idea of breaking the DBC and operator-flip updates are also applied to general bosonic models effectively, because bosonic worms get bounce-minimized with more candidates. In the present study, we have developed a simple and versatile MCMC algorithm that generally satisfies the BC without imposing the DBC. In our algorithm, the average rejection rate gets minimized, which reduces the autocorrelation time significantly in comparison with the conventional methods based on the DBC. We also have introduced operator-flip updates in the worm algorithm, yielding a bounce-free algorithm in generic spin models. The present concept can be naturally extended to systems with continuous state variables by replacing the weight landfill presented here with an asymmetric random cyclic shifting in a cumulative probability distribution function. Our approach beyond the DBC can be universally applied to any MCMC methods, even to ingenious established methods, such as the cluster algorithms and the extended ensemble methods, and will undoubtedly improve the relaxation in Markov sequences. Most simulations were performed on T2K Supercomputer at University of Tsukuba. The program was developed based on the ALPS library [24, 25]. We acknowledge support by Grant-in-Aid for Scientific Research Program (No ) from JSPS, and by Grand Challenges in Next-Generation Integrated Nanoscience, Next- Generation Supercomputer Project from MEXT, Japan. [1] D. P. Landau and K. Binder, A Guide to Monte Carlo Simulations in Statistical Physics (Cambridge University Press, Cambridge, 2005), 2nd ed. [2] W. R. Gilks, S. Richardson, and D. J. Spiegelhalter, Markov Chain Monte Carlo in Practice (Chapman & Hall, London/New York, 1996). [3] C. P. Robert and G. Casella, Monte Carlo Statistical Methods (Springer, New York, 2004), 2nd ed. [4] L. Tierney, Ann. Stat. 22, 1701 (1994). [5] S. P. Meyn and R. L. Tweedie, Markov Chains and Stochastic Stability (Springer, New York, 1993). [6] R. H. Swendsen and J. S. Wang, Phys. Rev. Lett. 58, 86 (1987). [7] H. G. Evertz, G. Lana, and M. Marcu, Phys. Rev. Lett. 70, 875 (1993). [8] B. A. Berg and T. Neuhaus, Phys. Rev. Lett. 68, 9 (1992). [9] K. Hukushima and K. Nemoto, J. Phys. Soc. Jpn. 65, 1604 (1996). [10] J. S. Liu, Stat. Comput. 6, 113 (1996). [11] L. Pollet, S. M. A. Rombouts, K. Van Houcke, and K. Heyde, Phys. Rev. E 70, (2004). [12] V. I. Manousiouthakis and M. W. Deem, J. Chem. Phys. 110, 2753 (1999). [13] S. L. Adler, Phys. Rev. D 23, 2901 (1981). [14] S. Duane, A. D. Kennedy, B. J. Pendleton, and D. Roweth, Phys. Lett. B 195, 216 (1987). [15] P. Diaconis, S. Holmes, and R. M. Neal, Ann. Appl. Probab. 10, 726 (2000). [16] F. Y. Wu, Rev. Mod. Phys. 54, 235 (1982). [17] N. V. Prokov ev, B. V. Svistunov, and I. S. Tupitsyn, Sov. Phys. JETP 87, 310 (1998). [18] O. F. Syljuasen and A. W. Sandvik, Phys. Rev. E 66, (2002). [19] N. Metropolis, A. W. Rosenbluth, M. N. Rosenbluth, A. H. Teller, and E. Teller, J. Chem. Phys. 21, 1087 (1953). [20] W. K. Hastings, Biometrika 57, 97 (1970). [21] M. Creutz, Phys. Rev. D 21, 2308 (1980). [22] S. Geman and D. Geman, IEEE Trans. Pattn. Anal. Mach. Intel. 6, 721 (1984). [23] F. Alet, S. Wessel, and M. Troyer, Phys. Rev. E 71, (2005). [24] S. TodoandK. Kato, Phys.Rev.Lett. 87, (2001). [25] A. Albuquerque, F. Alet, P. Corboz, P. Dayal, A. Feiguin, S. Fuchs, L. Gamper, E. Gull, S. Gürtler, A. Honecker,
5 5 et al., J. Mag. Mag. Mat. 310, 1187 (2007). [26] The overrelaxation method [13] and the hybrid Monte Carlo [14] both satisfy the DBC, mistakenly believed to break it.
General Construction of Irreversible Kernel in Markov Chain Monte Carlo
General Construction of Irreversible Kernel in Markov Chain Monte Carlo Metropolis heat bath Suwa Todo Department of Applied Physics, The University of Tokyo Department of Physics, Boston University (from
More informationAuthor(s) Kawashima, Maoki; Miyashita, Seiji;
Title Quantum Phase Transition of Heisenberg Antiferromagnet Two-Dim Author(s) Todo, Synge; Yasuda, Chitoshi; Kato Kawashima, Maoki; Miyashita, Seiji; Citation Progress of Theoretical Physics Sup 512 Issue
More informationMonte Caro simulations
Monte Caro simulations Monte Carlo methods - based on random numbers Stanislav Ulam s terminology - his uncle frequented the Casino in Monte Carlo Random (pseudo random) number generator on the computer
More informationClassical Monte Carlo Simulations
Classical Monte Carlo Simulations Hyejin Ju April 17, 2012 1 Introduction Why do we need numerics? One of the main goals of condensed matter is to compute expectation values O = 1 Z Tr{O e βĥ} (1) and
More informationOptimized statistical ensembles for slowly equilibrating classical and quantum systems
Optimized statistical ensembles for slowly equilibrating classical and quantum systems IPAM, January 2009 Simon Trebst Microsoft Station Q University of California, Santa Barbara Collaborators: David Huse,
More informationIrreversible Markov-Chain Monte Carlo methods
Irreversible Markov-Chain Monte Carlo methods Koji HUKUSHIMA Department of Basic Science, University of Tokyo 3-8-1 Komaba, Meguro-ku, Tokyo 153-8902 Abstract We review irreversible Markov chain Monte
More informationWang-Landau sampling for Quantum Monte Carlo. Stefan Wessel Institut für Theoretische Physik III Universität Stuttgart
Wang-Landau sampling for Quantum Monte Carlo Stefan Wessel Institut für Theoretische Physik III Universität Stuttgart Overview Classical Monte Carlo First order phase transitions Classical Wang-Landau
More informationarxiv: v1 [cond-mat.str-el] 22 Sep 2016
arxiv:1609.07191v1 [cond-mat.str-el] 22 Sep 2016 Simulated floating zone method Ryo Ozawa, Yasuyuki Kato, and Yukitoshi Motome Department of Applied Physics, University of Tokyo, Tokyo 113-8656, Japan
More informationQuantum annealing for problems with ground-state degeneracy
Proceedings of the International Workshop on Statistical-Mechanical Informatics September 14 17, 2008, Sendai, Japan Quantum annealing for problems with ground-state degeneracy Yoshiki Matsuda 1, Hidetoshi
More informationA quick introduction to Markov chains and Markov chain Monte Carlo (revised version)
A quick introduction to Markov chains and Markov chain Monte Carlo (revised version) Rasmus Waagepetersen Institute of Mathematical Sciences Aalborg University 1 Introduction These notes are intended to
More informationImproving the Asymptotic Performance of Markov Chain Monte-Carlo by Inserting Vortices
Improving the Asymptotic Performance of Markov Chain Monte-Carlo by Inserting Vortices Yi Sun IDSIA Galleria, Manno CH-98, Switzerland yi@idsia.ch Faustino Gomez IDSIA Galleria, Manno CH-98, Switzerland
More informationarxiv: v4 [cond-mat.stat-mech] 11 Apr 2014
Parallelized Quantum Monte Carlo Algorithm with Nonlocal Worm Updates Akiko Masaki-Kato 1, Takafumi Suzuki 2, Kenji Harada 3, Synge Todo 1,4, and Naoki Kawashima 1 1 Institute for Solid State Physics,
More informationA Geometric Interpretation of the Metropolis Hastings Algorithm
Statistical Science 2, Vol. 6, No., 5 9 A Geometric Interpretation of the Metropolis Hastings Algorithm Louis J. Billera and Persi Diaconis Abstract. The Metropolis Hastings algorithm transforms a given
More informationGuiding Monte Carlo Simulations with Machine Learning
Guiding Monte Carlo Simulations with Machine Learning Yang Qi Department of Physics, Massachusetts Institute of Technology Joining Fudan University in 2017 KITS, June 29 2017. 1/ 33 References Works led
More informationThe simple slice sampler is a specialised type of MCMC auxiliary variable method (Swendsen and Wang, 1987; Edwards and Sokal, 1988; Besag and Green, 1
Recent progress on computable bounds and the simple slice sampler by Gareth O. Roberts* and Jerey S. Rosenthal** (May, 1999.) This paper discusses general quantitative bounds on the convergence rates of
More informationarxiv: v3 [cond-mat.stat-mech] 26 Jan 2013
Multi-discontinuity algorithm for world-line Monte Carlo simulations Yasuyuki Kato Theoretical Division, T-4 and CNLS, Los Alamos National Laboratory, Los Alamos, NM 87545 (Dated: January 9, 2014) arxiv:1211.1627v3
More informationGiant Enhancement of Quantum Decoherence by Frustrated Environments
ISSN 0021-3640, JETP Letters, 2006, Vol. 84, No. 2, pp. 99 103. Pleiades Publishing, Inc., 2006.. Giant Enhancement of Quantum Decoherence by Frustrated Environments S. Yuan a, M. I. Katsnelson b, and
More informationThe Bias-Variance dilemma of the Monte Carlo. method. Technion - Israel Institute of Technology, Technion City, Haifa 32000, Israel
The Bias-Variance dilemma of the Monte Carlo method Zlochin Mark 1 and Yoram Baram 1 Technion - Israel Institute of Technology, Technion City, Haifa 32000, Israel fzmark,baramg@cs.technion.ac.il Abstract.
More informationMinicourse on: Markov Chain Monte Carlo: Simulation Techniques in Statistics
Minicourse on: Markov Chain Monte Carlo: Simulation Techniques in Statistics Eric Slud, Statistics Program Lecture 1: Metropolis-Hastings Algorithm, plus background in Simulation and Markov Chains. Lecture
More informationarxiv:cond-mat/ v1 16 Nov 1992
cond-mat/92006 FSU-SCRI-92-64 November 992 arxiv:cond-mat/92006v 6 Nov 992 Cluster Algorithm for Vertex Models Hans Gerd Evertz, Gideon Lana 2, and Mihai Marcu 2 Supercomputer Computations Research Institute,
More informationOn the Optimal Scaling of the Modified Metropolis-Hastings algorithm
On the Optimal Scaling of the Modified Metropolis-Hastings algorithm K. M. Zuev & J. L. Beck Division of Engineering and Applied Science California Institute of Technology, MC 4-44, Pasadena, CA 925, USA
More informationGPU-based computation of the Monte Carlo simulation of classical spin systems
Perspectives of GPU Computing in Physics and Astrophysics, Sapienza University of Rome, Rome, Italy, September 15-17, 2014 GPU-based computation of the Monte Carlo simulation of classical spin systems
More informationarxiv:cond-mat/ v4 [cond-mat.dis-nn] 23 May 2001
Phase Diagram of the three-dimensional Gaussian andom Field Ising Model: A Monte Carlo enormalization Group Study arxiv:cond-mat/488v4 [cond-mat.dis-nn] 3 May M. Itakura JS Domestic esearch Fellow, Center
More informationRandom Walks A&T and F&S 3.1.2
Random Walks A&T 110-123 and F&S 3.1.2 As we explained last time, it is very difficult to sample directly a general probability distribution. - If we sample from another distribution, the overlap will
More informationPhase transitions and finite-size scaling
Phase transitions and finite-size scaling Critical slowing down and cluster methods. Theory of phase transitions/ RNG Finite-size scaling Detailed treatment: Lectures on Phase Transitions and the Renormalization
More informationQuantum Monte Carlo Simulations in the Valence Bond Basis. Anders Sandvik, Boston University
Quantum Monte Carlo Simulations in the Valence Bond Basis Anders Sandvik, Boston University Outline The valence bond basis for S=1/2 spins Projector QMC in the valence bond basis Heisenberg model with
More informationSampling Methods (11/30/04)
CS281A/Stat241A: Statistical Learning Theory Sampling Methods (11/30/04) Lecturer: Michael I. Jordan Scribe: Jaspal S. Sandhu 1 Gibbs Sampling Figure 1: Undirected and directed graphs, respectively, with
More informationThe ALPS Project. Open Source Software for Strongly Correlated Systems. for the ALPS co!aboration. Lode Pollet & Matthias Troyer, ETH Zürich
The ALPS Project Open Source Software for Strongly Correlated Systems Lode Pollet & Matthias Troyer, ETH Zürich for the ALPS co!aboration The ALPS collaboration ETH Zürich, Switzerland Philippe Corboz
More informationUse of sequential structure in simulation from high-dimensional systems
Use of sequential structure in simulation from high-dimensional systems Faming Liang* Department of Statistics, Texas A&M University, College Station, Texas 77843-343 Received 2 December 2002; revised
More informationSelf-learning Monte Carlo Method
Self-learning Monte Carlo Method Zi Yang Meng ( 孟子杨 ) http://ziyangmeng.iphy.ac.cn/ Know thyself "Know thyself" (Greek: γνῶθι σεαυτόν, gnothi seauton) one of the Delphic maxims and was inscribed in the
More informationMicroscopic Deterministic Dynamics and Persistence Exponent arxiv:cond-mat/ v1 [cond-mat.stat-mech] 22 Sep 1999
Microscopic Deterministic Dynamics and Persistence Exponent arxiv:cond-mat/9909323v1 [cond-mat.stat-mech] 22 Sep 1999 B. Zheng FB Physik, Universität Halle, 06099 Halle, Germany Abstract Numerically we
More informationSecond Lecture: Quantum Monte Carlo Techniques
Second Lecture: Quantum Monte Carlo Techniques Andreas Läuchli, New states of quantum matter MPI für Physik komplexer Systeme - Dresden http://www.pks.mpg.de/~aml aml@pks.mpg.de Lecture Notes at http:www.pks.mpg.de/~aml/leshouches
More informationarxiv:cond-mat/ v1 [cond-mat.stat-mech] 5 Jun 2003
Performance imitations of Flat Histogram Methods and Optimality of Wang-andau Sampling arxiv:cond-mat/030608v [cond-mat.stat-mech] 5 Jun 2003 P. Dayal, S. Trebst,2, S. Wessel, D. Würtz, M. Troyer,2, S.
More informationSolving the sign problem for a class of frustrated antiferromagnets
Solving the sign problem for a class of frustrated antiferromagnets Fabien Alet Laboratoire de Physique Théorique Toulouse with : Kedar Damle (TIFR Mumbai), Sumiran Pujari (Toulouse Kentucky TIFR Mumbai)
More informationQuantum Monte Carlo simulation of thin magnetic films
Quantum Monte Carlo simulation of thin magnetic films P. Henelius, 1, * P. Fröbrich, 2,3 P. J. Kuntz, 2 C. Timm, 3 and P. J. Jensen 3,4 1 Condensed Matter Theory, Royal Institute of Technology, SE-106
More informationA New Method to Determine First-Order Transition Points from Finite-Size Data
A New Method to Determine First-Order Transition Points from Finite-Size Data Christian Borgs and Wolfhard Janke Institut für Theoretische Physik Freie Universität Berlin Arnimallee 14, 1000 Berlin 33,
More information7 Monte Carlo Simulations of Quantum Spin Models
7 Monte Carlo Simulations of Quantum Spin Models Stefan Wessel Institute for Theoretical Solid State Physics RWTH Aachen University Contents 1 Introduction 2 2 World lines and local updates 2 2.1 Suzuki-Trotter
More informationWang-Landau algorithm: A theoretical analysis of the saturation of the error
THE JOURNAL OF CHEMICAL PHYSICS 127, 184105 2007 Wang-Landau algorithm: A theoretical analysis of the saturation of the error R. E. Belardinelli a and V. D. Pereyra b Departamento de Física, Laboratorio
More informationPhysics 115/242 Monte Carlo simulations in Statistical Physics
Physics 115/242 Monte Carlo simulations in Statistical Physics Peter Young (Dated: May 12, 2007) For additional information on the statistical Physics part of this handout, the first two sections, I strongly
More informationComputer Vision Group Prof. Daniel Cremers. 11. Sampling Methods: Markov Chain Monte Carlo
Group Prof. Daniel Cremers 11. Sampling Methods: Markov Chain Monte Carlo Markov Chain Monte Carlo In high-dimensional spaces, rejection sampling and importance sampling are very inefficient An alternative
More informationGeneralized Ensembles: Multicanonical Simulations
Generalized Ensembles: Multicanonical Simulations 1. Multicanonical Ensemble 2. How to get the Weights? 3. Example Runs and Re-Weighting to the Canonical Ensemble 4. Energy and Specific Heat Calculation
More informationMonte Carlo and cold gases. Lode Pollet.
Monte Carlo and cold gases Lode Pollet lpollet@physics.harvard.edu 1 Outline Classical Monte Carlo The Monte Carlo trick Markov chains Metropolis algorithm Ising model critical slowing down Quantum Monte
More informationOvercoming the slowing down of flat-histogram Monte Carlo simulations: Cluster updates and optimized broad-histogram ensembles
PHYSICAL REVIEW E 72, 046704 2005 Overcoming the slowing down of flat-histogram Monte Carlo simulations: Cluster updates and optimized broad-histogram ensembles Yong Wu, 1 Mathias Körner, 2 Louis Colonna-Romano,
More informationLecture 8: Computer Simulations of Generalized Ensembles
Lecture 8: Computer Simulations of Generalized Ensembles Bernd A. Berg Florida State University November 6, 2008 Bernd A. Berg (FSU) Generalized Ensembles November 6, 2008 1 / 33 Overview 1. Reweighting
More informationIntroduction to Quantum Monte Carlo
Entanglement in Strongly Correlated Systems @ Benasque Feb. 6-17, 2017 Introduction to Quantum Monte Carlo Naoki KAWASHIMA (ISSP) 2017.02.06-07 Why bother? Estimating scaling dimension by TRG, TNR, etc
More informationCritical Dynamics of Two-Replica Cluster Algorithms
University of Massachusetts Amherst From the SelectedWorks of Jonathan Machta 2001 Critical Dynamics of Two-Replica Cluster Algorithms X. N. Li Jonathan Machta, University of Massachusetts Amherst Available
More informationMonte Carlo methods for sampling-based Stochastic Optimization
Monte Carlo methods for sampling-based Stochastic Optimization Gersende FORT LTCI CNRS & Telecom ParisTech Paris, France Joint works with B. Jourdain, T. Lelièvre, G. Stoltz from ENPC and E. Kuhn from
More informationMonte Carlo Methods in Statistical Mechanics
Monte Carlo Methods in Statistical Mechanics Mario G. Del Pópolo Atomistic Simulation Centre School of Mathematics and Physics Queen s University Belfast Belfast Mario G. Del Pópolo Statistical Mechanics
More informationMatrix-Product states: Properties and Extensions
New Development of Numerical Simulations in Low-Dimensional Quantum Systems: From Density Matrix Renormalization Group to Tensor Network Formulations October 27-29, 2010, Yukawa Institute for Theoretical
More informationA = {(x, u) : 0 u f(x)},
Draw x uniformly from the region {x : f(x) u }. Markov Chain Monte Carlo Lecture 5 Slice sampler: Suppose that one is interested in sampling from a density f(x), x X. Recall that sampling x f(x) is equivalent
More informationPY 502, Computational Physics, Fall 2017 Monte Carlo simulations in classical statistical physics
PY 502, Computational Physics, Fall 2017 Monte Carlo simulations in classical statistical physics Anders W. Sandvik, Department of Physics, Boston University 1 Introduction Monte Carlo simulation is a
More informationMarkov Chain Monte Carlo The Metropolis-Hastings Algorithm
Markov Chain Monte Carlo The Metropolis-Hastings Algorithm Anthony Trubiano April 11th, 2018 1 Introduction Markov Chain Monte Carlo (MCMC) methods are a class of algorithms for sampling from a probability
More informationNumerical Analysis of 2-D Ising Model. Ishita Agarwal Masters in Physics (University of Bonn) 17 th March 2011
Numerical Analysis of 2-D Ising Model By Ishita Agarwal Masters in Physics (University of Bonn) 17 th March 2011 Contents Abstract Acknowledgment Introduction Computational techniques Numerical Analysis
More informationTheir Statistical Analvsis. With Web-Based Fortran Code. Berg
Markov Chain Monter rlo Simulations and Their Statistical Analvsis With Web-Based Fortran Code Bernd A. Berg Florida State Univeisitfi USA World Scientific NEW JERSEY + LONDON " SINGAPORE " BEIJING " SHANGHAI
More informationBinder Cumulants for the Ising Model using Worm algorithms
Trinity College The University of Dublin Theoretical Physics Final Year Project Binder Cumulants for the Ising Model using Worm algorithms Author: Ruairí Brett Supervisor: Prof. John Bulava March 2015
More informationSession 3A: Markov chain Monte Carlo (MCMC)
Session 3A: Markov chain Monte Carlo (MCMC) John Geweke Bayesian Econometrics and its Applications August 15, 2012 ohn Geweke Bayesian Econometrics and its Session Applications 3A: Markov () chain Monte
More informationA Monte Carlo Implementation of the Ising Model in Python
A Monte Carlo Implementation of the Ising Model in Python Alexey Khorev alexey.s.khorev@gmail.com 2017.08.29 Contents 1 Theory 1 1.1 Introduction...................................... 1 1.2 Model.........................................
More informationA =, where d n w = dw
Chapter 9 Monte Carlo Simulations So far we have either dealt with exactly soluble systems like the (time-dependent) oscillator or with various expansions like the semiclassical, perturbative and high-temperature
More informationMarkov Processes. Stochastic process. Markov process
Markov Processes Stochastic process movement through a series of well-defined states in a way that involves some element of randomness for our purposes, states are microstates in the governing ensemble
More informationCluster Algorithms to Reduce Critical Slowing Down
Cluster Algorithms to Reduce Critical Slowing Down Monte Carlo simulations close to a phase transition are affected by critical slowing down. In the 2-D Ising system, the correlation length ξ becomes very
More informationSimulation of the two-dimensional square-lattice Lenz-Ising model in Python
Senior Thesis Simulation of the two-dimensional square-lattice Lenz-Ising model in Python Author: Richard Munroe Advisor: Dr. Edward Brash 2012-10-17 Abstract A program to simulate the the two-dimensional
More informationChapter 2 Ensemble Theory in Statistical Physics: Free Energy Potential
Chapter Ensemble Theory in Statistical Physics: Free Energy Potential Abstract In this chapter, we discuss the basic formalism of statistical physics Also, we consider in detail the concept of the free
More informationQuantum spin systems - models and computational methods
Summer School on Computational Statistical Physics August 4-11, 2010, NCCU, Taipei, Taiwan Quantum spin systems - models and computational methods Anders W. Sandvik, Boston University Lecture outline Introduction
More informationMarkov Chain Monte Carlo Simulations and Their Statistical Analysis An Overview
Markov Chain Monte Carlo Simulations and Their Statistical Analysis An Overview Bernd Berg FSU, August 30, 2005 Content 1. Statistics as needed 2. Markov Chain Monte Carlo (MC) 3. Statistical Analysis
More informationarxiv:cond-mat/ v1 [cond-mat.str-el] 24 Jan 2000
The sign problem in Monte Carlo simulations of frustrated quantum spin systems Patrik Henelius and Anders W. Sandvik 2 National High Magnetic Field Laboratory, 800 East Paul Dirac Dr., Tallahassee, Florida
More informationDecoherence and Thermalization of Quantum Spin Systems
Copyright 2011 American Scientific Publishers All rights reserved Printed in the United States of America Journal of Computational and Theoretical Nanoscience Vol. 8, 1 23, 2011 Decoherence and Thermalization
More informationEquilibrium, out of equilibrium and consequences
Equilibrium, out of equilibrium and consequences Katarzyna Sznajd-Weron Institute of Physics Wroc law University of Technology, Poland SF-MTPT Katarzyna Sznajd-Weron (WUT) Equilibrium, out of equilibrium
More informationMetropolis Monte Carlo simulation of the Ising Model
Metropolis Monte Carlo simulation of the Ising Model Krishna Shrinivas (CH10B026) Swaroop Ramaswamy (CH10B068) May 10, 2013 Modelling and Simulation of Particulate Processes (CH5012) Introduction The Ising
More informationA New Algorithm for Monte Carlo Simulation of king Spin Systems* A. B. BORTZ M. H. KALOS J. L. LEBOWITZ
JOURNAL OF COMPUTATIONAL PHYSICS 17, lo-18 (1975) A New Algorithm for Monte Carlo Simulation of king Spin Systems* A. B. BORTZ Berfer Graduate School of Science, Yeshiva University, New York, New York
More informationLecture V: Multicanonical Simulations.
Lecture V: Multicanonical Simulations. 1. Multicanonical Ensemble 2. How to get the Weights? 3. Example Runs (2d Ising and Potts models) 4. Re-Weighting to the Canonical Ensemble 5. Energy and Specific
More informationStochastic series expansion (SSE) and ground-state projection
Institute of Physics, Chinese Academy of Sciences, Beijing, October 31, 2014 Stochastic series expansion (SSE) and ground-state projection Anders W Sandvik, Boston University Review article on quantum
More informationMarkov Chain Monte Carlo methods
Markov Chain Monte Carlo methods By Oleg Makhnin 1 Introduction a b c M = d e f g h i 0 f(x)dx 1.1 Motivation 1.1.1 Just here Supresses numbering 1.1.2 After this 1.2 Literature 2 Method 2.1 New math As
More informationBrief introduction to Markov Chain Monte Carlo
Brief introduction to Department of Probability and Mathematical Statistics seminar Stochastic modeling in economics and finance November 7, 2011 Brief introduction to Content 1 and motivation Classical
More informationSTA 4273H: Statistical Machine Learning
STA 4273H: Statistical Machine Learning Russ Salakhutdinov Department of Computer Science! Department of Statistical Sciences! rsalakhu@cs.toronto.edu! h0p://www.cs.utoronto.ca/~rsalakhu/ Lecture 7 Approximate
More informationAdvanced Monte Carlo Methods Problems
Advanced Monte Carlo Methods Problems September-November, 2012 Contents 1 Integration with the Monte Carlo method 2 1.1 Non-uniform random numbers.......................... 2 1.2 Gaussian RNG..................................
More informationHanoi 7/11/2018. Ngo Van Thanh, Institute of Physics, Hanoi, Vietnam.
Hanoi 7/11/2018 Ngo Van Thanh, Institute of Physics, Hanoi, Vietnam. Finite size effects and Reweighting methods 1. Finite size effects 2. Single histogram method 3. Multiple histogram method 4. Wang-Landau
More informationarxiv:cond-mat/ v2 [cond-mat.stat-mech] 2 Apr 1998
Nonequilibrium Phase Transition in the Kinetic Ising model: Dynamical symmetry breaking by randomly varying magnetic field arxiv:cond-mat/979v2 [cond-mat.stat-mech] 2 Apr 998 Muktish Acharyya Institute
More informationarxiv:math/ v1 [math.pr] 21 Dec 2001
Monte Carlo Tests of SLE Predictions for the 2D Self-Avoiding Walk arxiv:math/0112246v1 [math.pr] 21 Dec 2001 Tom Kennedy Departments of Mathematics and Physics University of Arizona, Tucson, AZ, 85721
More informationICCP Project 2 - Advanced Monte Carlo Methods Choose one of the three options below
ICCP Project 2 - Advanced Monte Carlo Methods Choose one of the three options below Introduction In statistical physics Monte Carlo methods are considered to have started in the Manhattan project (1940
More informationPattern Recognition and Machine Learning. Bishop Chapter 11: Sampling Methods
Pattern Recognition and Machine Learning Chapter 11: Sampling Methods Elise Arnaud Jakob Verbeek May 22, 2008 Outline of the chapter 11.1 Basic Sampling Algorithms 11.2 Markov Chain Monte Carlo 11.3 Gibbs
More informationGround State Projector QMC in the valence-bond basis
Quantum Monte Carlo Methods at Work for Novel Phases of Matter Trieste, Italy, Jan 23 - Feb 3, 2012 Ground State Projector QMC in the valence-bond basis Anders. Sandvik, Boston University Outline: The
More informationarxiv: v1 [cond-mat.stat-mech] 6 Mar 2008
CD2dBS-v2 Convergence dynamics of 2-dimensional isotropic and anisotropic Bak-Sneppen models Burhan Bakar and Ugur Tirnakli Department of Physics, Faculty of Science, Ege University, 35100 Izmir, Turkey
More informationCopyright 2001 University of Cambridge. Not to be quoted or copied without permission.
Course MP3 Lecture 4 13/11/2006 Monte Carlo method I An introduction to the use of the Monte Carlo method in materials modelling Dr James Elliott 4.1 Why Monte Carlo? The name derives from the association
More informationMulticanonical methods
Multicanonical methods Normal Monte Carlo algorithms sample configurations with the Boltzmann weight p exp( βe). Sometimes this is not desirable. Example: if a system has a first order phase transitions
More informationMONTE CARLO METHODS IN SEQUENTIAL AND PARALLEL COMPUTING OF 2D AND 3D ISING MODEL
Journal of Optoelectronics and Advanced Materials Vol. 5, No. 4, December 003, p. 971-976 MONTE CARLO METHODS IN SEQUENTIAL AND PARALLEL COMPUTING OF D AND 3D ISING MODEL M. Diaconu *, R. Puscasu, A. Stancu
More informationLPTM. Quantum-Monte-Carlo Approach to the Thermodynamics of Highly Frustrated Spin-½ Antiferromagnets. Andreas Honecker 1
Quantum-Monte-Carlo Approach to the Thermodynamics of Highly Frustrated Spin-½ Antiferromagnets LPTM Laboratoire de Physique Théorique et Modélisation Andreas Honecker 1 Laboratoire de Physique Théorique
More informationFig. 1 Cluster flip: before. The region inside the dotted line is flipped in one Wolff move. Let this configuration be A.
Physics 6562: Statistical Mechanics http://www.physics.cornell.edu/sethna/teaching/562/ In Class Exercises Last correction at March 25, 2017, 1:37 pm c 2017, James Sethna, all rights reserved 1. Detailed
More informationIntroduction to Machine Learning CMU-10701
Introduction to Machine Learning CMU-10701 Markov Chain Monte Carlo Methods Barnabás Póczos & Aarti Singh Contents Markov Chain Monte Carlo Methods Goal & Motivation Sampling Rejection Importance Markov
More informationNumerical methods for lattice field theory
Numerical methods for lattice field theory Mike Peardon Trinity College Dublin August 9, 2007 Mike Peardon (Trinity College Dublin) Numerical methods for lattice field theory August 9, 2007 1 / 24 Numerical
More informationMarkov chain Monte Carlo
Markov chain Monte Carlo Peter Beerli October 10, 2005 [this chapter is highly influenced by chapter 1 in Markov chain Monte Carlo in Practice, eds Gilks W. R. et al. Chapman and Hall/CRC, 1996] 1 Short
More informationQuantum Annealing in spin glasses and quantum computing Anders W Sandvik, Boston University
PY502, Computational Physics, December 12, 2017 Quantum Annealing in spin glasses and quantum computing Anders W Sandvik, Boston University Advancing Research in Basic Science and Mathematics Example:
More informationCS242: Probabilistic Graphical Models Lecture 7B: Markov Chain Monte Carlo & Gibbs Sampling
CS242: Probabilistic Graphical Models Lecture 7B: Markov Chain Monte Carlo & Gibbs Sampling Professor Erik Sudderth Brown University Computer Science October 27, 2016 Some figures and materials courtesy
More informationBayesian Methods for Machine Learning
Bayesian Methods for Machine Learning CS 584: Big Data Analytics Material adapted from Radford Neal s tutorial (http://ftp.cs.utoronto.ca/pub/radford/bayes-tut.pdf), Zoubin Ghahramni (http://hunch.net/~coms-4771/zoubin_ghahramani_bayesian_learning.pdf),
More informationGraphical Representations and Cluster Algorithms
Graphical Representations and Cluster Algorithms Jon Machta University of Massachusetts Amherst Newton Institute, March 27, 2008 Outline Introduction to graphical representations and cluster algorithms
More informationHastings-within-Gibbs Algorithm: Introduction and Application on Hierarchical Model
UNIVERSITY OF TEXAS AT SAN ANTONIO Hastings-within-Gibbs Algorithm: Introduction and Application on Hierarchical Model Liang Jing April 2010 1 1 ABSTRACT In this paper, common MCMC algorithms are introduced
More information6 Markov Chain Monte Carlo (MCMC)
6 Markov Chain Monte Carlo (MCMC) The underlying idea in MCMC is to replace the iid samples of basic MC methods, with dependent samples from an ergodic Markov chain, whose limiting (stationary) distribution
More informationMarkov chain Monte Carlo methods for visual tracking
Markov chain Monte Carlo methods for visual tracking Ray Luo rluo@cory.eecs.berkeley.edu Department of Electrical Engineering and Computer Sciences University of California, Berkeley Berkeley, CA 94720
More informationarxiv:cond-mat/ v1 [cond-mat.other] 4 Aug 2004
Conservation laws for the voter model in complex networks arxiv:cond-mat/0408101v1 [cond-mat.other] 4 Aug 2004 Krzysztof Suchecki, 1,2 Víctor M. Eguíluz, 1 and Maxi San Miguel 1 1 Instituto Mediterráneo
More informationWang-Landau Sampling of an Asymmetric Ising Model: A Study of the Critical Endpoint Behavior
Brazilian Journal of Physics, vol. 36, no. 3A, September, 26 635 Wang-andau Sampling of an Asymmetric Ising Model: A Study of the Critical Endpoint Behavior Shan-o sai a,b, Fugao Wang a,, and D.P. andau
More informationTopological defects and its role in the phase transition of a dense defect system
Topological defects and its role in the phase transition of a dense defect system Suman Sinha * and Soumen Kumar Roy Depatrment of Physics, Jadavpur University Kolkata- 70003, India Abstract Monte Carlo
More information