Their Statistical Analvsis. With Web-Based Fortran Code. Berg

Size: px
Start display at page:

Download "Their Statistical Analvsis. With Web-Based Fortran Code. Berg"

Transcription

1 Markov Chain Monter rlo Simulations and Their Statistical Analvsis With Web-Based Fortran Code Bernd A. Berg Florida State Univeisitfi USA World Scientific NEW JERSEY + LONDON " SINGAPORE " BEIJING " SHANGHAI " HONG KONG + TAIPEI " CHENNAI

2 Contents 1. Sampling, Statistics and Computer Code Probability Distributions and Sampling I Assignments for section Random Numbers Assignments for section About the Fortran Code CPU time measurements under Linux Gaussian Distribution Assignments for section Confidence Intervals Assignment for section Order Statistics and 1"IeapSort Assignments for section Functions and Expectation Values Moments and Tchebychev's inequality The sum of two independent random variables Characteristic functions and sums of N independent random variables Linear transformations, error propagation and covariance Assignments for section Sample Mean and the Central Limit Theorem Probability density of the sample mean The central limit theorem

3 xii Markov Chain Monte Carlo Simulations and Their Statistical Analysis Counter example Binning ,4 Assignments for section Error Analysis for Independent Random Variables Gaussian Confidence Intervals and Error Bars Estimator of the variance and bias Statistical error bar routines (step).., Ratio of two means with error bars Gaussian difference test Combining more than two data points Assignments for section The x2 Distribution Sample variance distribution The Xz distribution function and probability density Assignments for section Gosset's Student Distribution Student difference test Assignments for section The Error of the Error Bar Assignments for section Variance Ratio Test (P-test) F ratio confidence limits Assignments for section When are Distributions Consistent? x2 Test The one-sided Kolmogorov test The two-sided Kolmogorov test Assignments for section The Jackknife Approach Bias corrected estimators Assignments for section Determination o Parameters (Fitting) Linear regression Confidence limits of the regression line Related functional forms Examples Levenberg-Marquardt fitting ] Examples

4 . Contents xiii Assignments for section Markov Chain Monte Carlo Preliminaries and the Two-Dimensional Ising Model Lattice labeling Sampling and Re-weighting Important configurations and re-weighting range Assignments for section Importance Sampling The Metropolis algorithm The O(3) a-model and the heat bath algorithm Assignments for section Potts Model Monte Carlo Simulations The Metropolis code Initialization Updating routines Start and equilibration More updating routines Heat bath code ; Timing and time series comparison of the routines Energy references, data production and analysis code d Ising model Data analysis d 4-state and 10-state Potts models d Ising model d 3-state Potts model d Ising model with non-zero magnetic field Assignments for section Continuous Systems Simple Metropolis code for the 0(n) spin models Metropolis code for the XY model Timing, discretization and rounding errors Acceptance rate Heat bath code for the O(3) model Rounding errors Assignments for section Error Analysis for Markov Chain Data 196

5 xiv Markov Chain Monte Carlo Simulations and Their Statistical Analysis 4.1 Autocorrelations Integrated autocorrelation time and binning Illustration : Metropolis generation of normally distributed data Autocorrelation function Integrated autocorrelation time ,1.2.3 Corrections to the confidence intervals of the binning procedure SeIf-consistent versus reasonable error analysis Assignments for section Analysis of Statistical Physics Data The d = 2 Ising model off and on the critical point Comparison of Markov chain MC algorithms Random versus sequential updating Tuning the Metropolis acceptance rate Metropolis versus heat bath : 2d q = 10 Potts Metropolis versus heat bath : 3d Ising Metropolis versus heat bath : 2d O(3) o- model Small fluctuations Assignments for section Fitting of Markov Chain Moate Carlo Data One exponential autocorrelation time More than one exponential autocorrelation time Assignments for section Advanced Monte Carlo Multicanonical Simulations , Recursion for the weights , Fortran implementation , Example runs Performance Re-weighting to the canonical ensemble Energy and specific heat calculation Free energy and entropy calculation...., Time series analysis Assignments for section 5,1., Event Driven Simulations Computer implementation MC runs with the EDS code

6 Contents xv Assignments for section Cluster Algorithms Autocorrelation times Assignments for section Large Scale Simulations Assignments for section Parallel Computing Trivially Parallel Computing Message Passing Interface (MPI) Parallel Tempering Computer implementation Illustration for the 2d 10-state Potts model Gaussian Multiple Markov chains Assignments for section Checkerboard algorithms Assignment for section Conclusions, History and Outlook 319 Appendix A Computational Supplements 326 A.1 Calculation of Special Functions A.2 Linear Algebraic Equations Appendix B More Exercises and some Solutions 331 B.1 Exercises B.2 Solutions Appendix C More Fortran Routines 338 Bibliography 339 Index 349

Markov Chain Monte Carlo Simulations and Their Statistical Analysis An Overview

Markov Chain Monte Carlo Simulations and Their Statistical Analysis An Overview Markov Chain Monte Carlo Simulations and Their Statistical Analysis An Overview Bernd Berg FSU, August 30, 2005 Content 1. Statistics as needed 2. Markov Chain Monte Carlo (MC) 3. Statistical Analysis

More information

Irr. Statistical Methods in Experimental Physics. 2nd Edition. Frederick James. World Scientific. CERN, Switzerland

Irr. Statistical Methods in Experimental Physics. 2nd Edition. Frederick James. World Scientific. CERN, Switzerland Frederick James CERN, Switzerland Statistical Methods in Experimental Physics 2nd Edition r i Irr 1- r ri Ibn World Scientific NEW JERSEY LONDON SINGAPORE BEIJING SHANGHAI HONG KONG TAIPEI CHENNAI CONTENTS

More information

PRINCIPLES OF PHYSICS. \Hp. Ni Jun TSINGHUA. Physics. From Quantum Field Theory. to Classical Mechanics. World Scientific. Vol.2. Report and Review in

PRINCIPLES OF PHYSICS. \Hp. Ni Jun TSINGHUA. Physics. From Quantum Field Theory. to Classical Mechanics. World Scientific. Vol.2. Report and Review in LONDON BEIJING HONG TSINGHUA Report and Review in Physics Vol2 PRINCIPLES OF PHYSICS From Quantum Field Theory to Classical Mechanics Ni Jun Tsinghua University, China NEW JERSEY \Hp SINGAPORE World Scientific

More information

Multicanonical methods

Multicanonical methods Multicanonical methods Normal Monte Carlo algorithms sample configurations with the Boltzmann weight p exp( βe). Sometimes this is not desirable. Example: if a system has a first order phase transitions

More information

Monte Caro simulations

Monte Caro simulations Monte Caro simulations Monte Carlo methods - based on random numbers Stanislav Ulam s terminology - his uncle frequented the Casino in Monte Carlo Random (pseudo random) number generator on the computer

More information

Tutorial on Markov Chain Monte Carlo Simulations and Their Statistical Analysis (in Fortran)

Tutorial on Markov Chain Monte Carlo Simulations and Their Statistical Analysis (in Fortran) Tutorial on Markov Chain Monte Carlo Simulations and Their Statistical Analysis (in Fortran) Bernd Berg Singapore MCMC Meeting, March 2004 Overview 1. Lecture I/II: Statistics as Needed. 2. Lecture II:

More information

Pattern Recognition and Machine Learning

Pattern Recognition and Machine Learning Christopher M. Bishop Pattern Recognition and Machine Learning ÖSpri inger Contents Preface Mathematical notation Contents vii xi xiii 1 Introduction 1 1.1 Example: Polynomial Curve Fitting 4 1.2 Probability

More information

Lecture V: Multicanonical Simulations.

Lecture V: Multicanonical Simulations. Lecture V: Multicanonical Simulations. 1. Multicanonical Ensemble 2. How to get the Weights? 3. Example Runs (2d Ising and Potts models) 4. Re-Weighting to the Canonical Ensemble 5. Energy and Specific

More information

Kernel-based Approximation. Methods using MATLAB. Gregory Fasshauer. Interdisciplinary Mathematical Sciences. Michael McCourt.

Kernel-based Approximation. Methods using MATLAB. Gregory Fasshauer. Interdisciplinary Mathematical Sciences. Michael McCourt. SINGAPORE SHANGHAI Vol TAIPEI - Interdisciplinary Mathematical Sciences 19 Kernel-based Approximation Methods using MATLAB Gregory Fasshauer Illinois Institute of Technology, USA Michael McCourt University

More information

Statistical Methods in HYDROLOGY CHARLES T. HAAN. The Iowa State University Press / Ames

Statistical Methods in HYDROLOGY CHARLES T. HAAN. The Iowa State University Press / Ames Statistical Methods in HYDROLOGY CHARLES T. HAAN The Iowa State University Press / Ames Univariate BASIC Table of Contents PREFACE xiii ACKNOWLEDGEMENTS xv 1 INTRODUCTION 1 2 PROBABILITY AND PROBABILITY

More information

Improvement of Monte Carlo estimates with covariance-optimized finite-size scaling at fixed phenomenological coupling

Improvement of Monte Carlo estimates with covariance-optimized finite-size scaling at fixed phenomenological coupling Improvement of Monte Carlo estimates with covariance-optimized finite-size scaling at fixed phenomenological coupling Francesco Parisen Toldin Max Planck Institute for Physics of Complex Systems Dresden

More information

INTRODUCTION TO MARKOV CHAIN MONTE CARLO SIMULATIONS AND THEIR STATISTICAL ANALYSIS

INTRODUCTION TO MARKOV CHAIN MONTE CARLO SIMULATIONS AND THEIR STATISTICAL ANALYSIS INTRODUCTION TO MARKOV CHAIN MONTE CARLO SIMULATIONS AND THEIR STATISTICAL ANALYSIS Bernd A. Berg Department of Physics Florida State University Tallahassee, Florida 32306-4350, USA and School of Computational

More information

Lecture 8: Computer Simulations of Generalized Ensembles

Lecture 8: Computer Simulations of Generalized Ensembles Lecture 8: Computer Simulations of Generalized Ensembles Bernd A. Berg Florida State University November 6, 2008 Bernd A. Berg (FSU) Generalized Ensembles November 6, 2008 1 / 33 Overview 1. Reweighting

More information

Parallel Tempering Algorithm in Monte Carlo Simulation

Parallel Tempering Algorithm in Monte Carlo Simulation Parallel Tempering Algorithm in Monte Carlo Simulation Tony Cheung (CUHK) Kevin Zhao (CUHK) Mentors: Ying Wai Li (ORNL) Markus Eisenbach (ORNL) Kwai Wong (UTK/ORNL) Metropolis Algorithm on Ising Model

More information

Generalized Ensembles: Multicanonical Simulations

Generalized Ensembles: Multicanonical Simulations Generalized Ensembles: Multicanonical Simulations 1. Multicanonical Ensemble 2. How to get the Weights? 3. Example Runs and Re-Weighting to the Canonical Ensemble 4. Energy and Specific Heat Calculation

More information

Applied Probability and Stochastic Processes

Applied Probability and Stochastic Processes Applied Probability and Stochastic Processes In Engineering and Physical Sciences MICHEL K. OCHI University of Florida A Wiley-Interscience Publication JOHN WILEY & SONS New York - Chichester Brisbane

More information

Data Fitting and Uncertainty

Data Fitting and Uncertainty TiloStrutz Data Fitting and Uncertainty A practical introduction to weighted least squares and beyond With 124 figures, 23 tables and 71 test questions and examples VIEWEG+ TEUBNER IX Contents I Framework

More information

General Construction of Irreversible Kernel in Markov Chain Monte Carlo

General Construction of Irreversible Kernel in Markov Chain Monte Carlo General Construction of Irreversible Kernel in Markov Chain Monte Carlo Metropolis heat bath Suwa Todo Department of Applied Physics, The University of Tokyo Department of Physics, Boston University (from

More information

MAGNETISM MADE SIMPLE. An Introduction to Physical Concepts and to Some Useful Mathematical Methods. Daniel C. Mattis

MAGNETISM MADE SIMPLE. An Introduction to Physical Concepts and to Some Useful Mathematical Methods. Daniel C. Mattis THE THEORY OF MAGNETISM MADE SIMPLE An Introduction to Physical Concepts and to Some Useful Mathematical Methods Daniel C. Mattis Department of Physics, University of Utah lb World Scientific NEW JERSEY

More information

Monte Carlo and cold gases. Lode Pollet.

Monte Carlo and cold gases. Lode Pollet. Monte Carlo and cold gases Lode Pollet lpollet@physics.harvard.edu 1 Outline Classical Monte Carlo The Monte Carlo trick Markov chains Metropolis algorithm Ising model critical slowing down Quantum Monte

More information

arxiv:cond-mat/ v1 [cond-mat.stat-mech] 19 Oct 2004

arxiv:cond-mat/ v1 [cond-mat.stat-mech] 19 Oct 2004 arxiv:cond-mat/0410490v1 [cond-mat.stat-mech] 19 Oct 2004 February 2, 2008 Master Review Vol. 9in x 6in (for Lecture Note Series, IMS, NUS) article INTRODUCTION TO MARKOV CHAIN MONTE CARLO SIMULATIONS

More information

Fig. 1 Cluster flip: before. The region inside the dotted line is flipped in one Wolff move. Let this configuration be A.

Fig. 1 Cluster flip: before. The region inside the dotted line is flipped in one Wolff move. Let this configuration be A. Physics 6562: Statistical Mechanics http://www.physics.cornell.edu/sethna/teaching/562/ In Class Exercises Last correction at March 25, 2017, 1:37 pm c 2017, James Sethna, all rights reserved 1. Detailed

More information

Generalized, Linear, and Mixed Models

Generalized, Linear, and Mixed Models Generalized, Linear, and Mixed Models CHARLES E. McCULLOCH SHAYLER.SEARLE Departments of Statistical Science and Biometrics Cornell University A WILEY-INTERSCIENCE PUBLICATION JOHN WILEY & SONS, INC. New

More information

Trivially parallel computing

Trivially parallel computing Parallel Computing After briefly discussing the often neglected, but in praxis frequently encountered, issue of trivially parallel computing, we turn to parallel computing with information exchange. Our

More information

GPU-based computation of the Monte Carlo simulation of classical spin systems

GPU-based computation of the Monte Carlo simulation of classical spin systems Perspectives of GPU Computing in Physics and Astrophysics, Sapienza University of Rome, Rome, Italy, September 15-17, 2014 GPU-based computation of the Monte Carlo simulation of classical spin systems

More information

Elliptic & Parabolic Equations

Elliptic & Parabolic Equations Elliptic & Parabolic Equations Zhuoqun Wu, Jingxue Yin & Chunpeng Wang Jilin University, China World Scientific NEW JERSEY LONDON SINGAPORE BEIJING SHANGHAI HONG KONG TAIPEI CHENNAI Contents Preface v

More information

Model Assisted Survey Sampling

Model Assisted Survey Sampling Carl-Erik Sarndal Jan Wretman Bengt Swensson Model Assisted Survey Sampling Springer Preface v PARTI Principles of Estimation for Finite Populations and Important Sampling Designs CHAPTER 1 Survey Sampling

More information

Quantum Tunneling and

Quantum Tunneling and BEIJING SHANGHAI Quantum Tunneling and Field Electron Emission Theories Shi-Dong Liang Sun Yat-Sen University, China World Scientific NEW JERSEY LONDON SINGAPORE HONG KONG TAIPEI CHENNAI Contents Preface

More information

Time Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY

Time Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY Time Series Analysis James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY PREFACE xiii 1 Difference Equations 1.1. First-Order Difference Equations 1 1.2. pth-order Difference Equations 7

More information

Accelerator Physics. Tip World Scientific NEW JERSEY LONDON SINGAPORE BEIJING SHANGHAI HONG KONG TAIPEI BANGALORE. Second Edition. S. Y.

Accelerator Physics. Tip World Scientific NEW JERSEY LONDON SINGAPORE BEIJING SHANGHAI HONG KONG TAIPEI BANGALORE. Second Edition. S. Y. Accelerator Physics Second Edition S. Y. Lee Department of Physics, Indiana University Tip World Scientific NEW JERSEY LONDON SINGAPORE BEIJING SHANGHAI HONG KONG TAIPEI BANGALORE Contents Preface Preface

More information

Monte Carlo Methods in High Energy Physics I

Monte Carlo Methods in High Energy Physics I Helmholtz International Workshop -- CALC 2009, July 10--20, Dubna Monte Carlo Methods in High Energy Physics CALC2009 - July 20 10, Dubna 2 Contents 3 Introduction Simple definition: A Monte Carlo technique

More information

Time Series: Theory and Methods

Time Series: Theory and Methods Peter J. Brockwell Richard A. Davis Time Series: Theory and Methods Second Edition With 124 Illustrations Springer Contents Preface to the Second Edition Preface to the First Edition vn ix CHAPTER 1 Stationary

More information

PART I INTRODUCTION The meaning of probability Basic definitions for frequentist statistics and Bayesian inference Bayesian inference Combinatorics

PART I INTRODUCTION The meaning of probability Basic definitions for frequentist statistics and Bayesian inference Bayesian inference Combinatorics Table of Preface page xi PART I INTRODUCTION 1 1 The meaning of probability 3 1.1 Classical definition of probability 3 1.2 Statistical definition of probability 9 1.3 Bayesian understanding of probability

More information

PROBABILITY AND STOCHASTIC PROCESSES A Friendly Introduction for Electrical and Computer Engineers

PROBABILITY AND STOCHASTIC PROCESSES A Friendly Introduction for Electrical and Computer Engineers PROBABILITY AND STOCHASTIC PROCESSES A Friendly Introduction for Electrical and Computer Engineers Roy D. Yates Rutgers, The State University ofnew Jersey David J. Goodman Rutgers, The State University

More information

Numerical methods for lattice field theory

Numerical methods for lattice field theory Numerical methods for lattice field theory Mike Peardon Trinity College Dublin August 9, 2007 Mike Peardon (Trinity College Dublin) Numerical methods for lattice field theory August 9, 2007 1 / 24 Numerical

More information

Principles of Equilibrium Statistical Mechanics

Principles of Equilibrium Statistical Mechanics Debashish Chowdhury, Dietrich Stauffer Principles of Equilibrium Statistical Mechanics WILEY-VCH Weinheim New York Chichester Brisbane Singapore Toronto Table of Contents Part I: THERMOSTATICS 1 1 BASIC

More information

3.320 Lecture 18 (4/12/05)

3.320 Lecture 18 (4/12/05) 3.320 Lecture 18 (4/12/05) Monte Carlo Simulation II and free energies Figure by MIT OCW. General Statistical Mechanics References D. Chandler, Introduction to Modern Statistical Mechanics D.A. McQuarrie,

More information

Fundamentals of Applied Probability and Random Processes

Fundamentals of Applied Probability and Random Processes Fundamentals of Applied Probability and Random Processes,nd 2 na Edition Oliver C. Ibe University of Massachusetts, LoweLL, Massachusetts ip^ W >!^ AMSTERDAM BOSTON HEIDELBERG LONDON NEW YORK OXFORD PARIS

More information

Monte-Carlo Methods and Stochastic Processes

Monte-Carlo Methods and Stochastic Processes Monte-Carlo Methods and Stochastic Processes From Linear to Non-Linear EMMANUEL GOBET ECOLE POLYTECHNIQUE - UNIVERSITY PARIS-SACLAY CMAP, PALAISEAU CEDEX, FRANCE CRC Press Taylor & Francis Group 6000 Broken

More information

Physics 115/242 Monte Carlo simulations in Statistical Physics

Physics 115/242 Monte Carlo simulations in Statistical Physics Physics 115/242 Monte Carlo simulations in Statistical Physics Peter Young (Dated: May 12, 2007) For additional information on the statistical Physics part of this handout, the first two sections, I strongly

More information

Statistical Methods for Forecasting

Statistical Methods for Forecasting Statistical Methods for Forecasting BOVAS ABRAHAM University of Waterloo JOHANNES LEDOLTER University of Iowa John Wiley & Sons New York Chichester Brisbane Toronto Singapore Contents 1 INTRODUCTION AND

More information

CONTENTS NOTATIONAL CONVENTIONS GLOSSARY OF KEY SYMBOLS 1 INTRODUCTION 1

CONTENTS NOTATIONAL CONVENTIONS GLOSSARY OF KEY SYMBOLS 1 INTRODUCTION 1 DIGITAL SPECTRAL ANALYSIS WITH APPLICATIONS S.LAWRENCE MARPLE, JR. SUMMARY This new book provides a broad perspective of spectral estimation techniques and their implementation. It concerned with spectral

More information

Computational Physics (6810): Session 13

Computational Physics (6810): Session 13 Computational Physics (6810): Session 13 Dick Furnstahl Nuclear Theory Group OSU Physics Department April 14, 2017 6810 Endgame Various recaps and followups Random stuff (like RNGs :) Session 13 stuff

More information

Molecular Electronics

Molecular Electronics Molecular Electronics An Introduction to Theory and Experiment Juan Carlos Cuevas Universidad Autönoma de Madrid, Spain Elke Scheer Universität Konstanz, Germany 1>World Scientific NEW JERSEY LONDON SINGAPORE

More information

Matrix Calculus and Kronecker Product

Matrix Calculus and Kronecker Product Matrix Calculus and Kronecker Product A Practical Approach to Linear and Multilinear Algebra Second Edition This page intentionally left blank Matrix Calculus and Kronecker Product A Practical Approach

More information

Monte Carlo Simulation of the Ising Model. Abstract

Monte Carlo Simulation of the Ising Model. Abstract Monte Carlo Simulation of the Ising Model Saryu Jindal 1 1 Department of Chemical Engineering and Material Sciences, University of California, Davis, CA 95616 (Dated: June 9, 2007) Abstract This paper

More information

Wang-Landau sampling for Quantum Monte Carlo. Stefan Wessel Institut für Theoretische Physik III Universität Stuttgart

Wang-Landau sampling for Quantum Monte Carlo. Stefan Wessel Institut für Theoretische Physik III Universität Stuttgart Wang-Landau sampling for Quantum Monte Carlo Stefan Wessel Institut für Theoretische Physik III Universität Stuttgart Overview Classical Monte Carlo First order phase transitions Classical Wang-Landau

More information

Rare Event Sampling using Multicanonical Monte Carlo

Rare Event Sampling using Multicanonical Monte Carlo Rare Event Sampling using Multicanonical Monte Carlo Yukito IBA The Institute of Statistical Mathematics This is my 3rd oversea trip; two of the three is to Australia. Now I (almost) overcome airplane

More information

Christopher Dougherty London School of Economics and Political Science

Christopher Dougherty London School of Economics and Political Science Introduction to Econometrics FIFTH EDITION Christopher Dougherty London School of Economics and Political Science OXFORD UNIVERSITY PRESS Contents INTRODU CTION 1 Why study econometrics? 1 Aim of this

More information

AGuideto Monte Carlo Simulations in Statistical Physics

AGuideto Monte Carlo Simulations in Statistical Physics AGuideto Monte Carlo Simulations in Statistical Physics Second Edition David P. Landau Center for Simulational Physics, The University of Georgia Kurt Binder Institut für Physik, Johannes-Gutenberg-Universität

More information

Quantum. Mechanics. Y y. A Modern Development. 2nd Edition. Leslie E Ballentine. World Scientific. Simon Fraser University, Canada TAIPEI BEIJING

Quantum. Mechanics. Y y. A Modern Development. 2nd Edition. Leslie E Ballentine. World Scientific. Simon Fraser University, Canada TAIPEI BEIJING BEIJING TAIPEI Quantum Mechanics A Modern Development 2nd Edition Leslie E Ballentine Simon Fraser University, Canada Y y NEW JERSEY LONDON SINGAPORE World Scientific SHANGHAI HONG KONG CHENNAI Contents

More information

Exploring Monte Carlo Methods

Exploring Monte Carlo Methods Exploring Monte Carlo Methods William L Dunn J. Kenneth Shultis AMSTERDAM BOSTON HEIDELBERG LONDON NEW YORK OXFORD PARIS SAN DIEGO SAN FRANCISCO SINGAPORE SYDNEY TOKYO ELSEVIER Academic Press Is an imprint

More information

Parallel Tempering And Adaptive Spacing. For Monte Carlo Simulation

Parallel Tempering And Adaptive Spacing. For Monte Carlo Simulation Parallel Tempering And Adaptive pacing For Monte Carlo imulation Authors: iu Wun Cheung Department of Mathematics, CUHK Zhao, Yiwei Department of Mathematics, CUHK upervisors: Dr. Markus isenbach ORNL

More information

The XY-Model. David-Alexander Robinson Sch th January 2012

The XY-Model. David-Alexander Robinson Sch th January 2012 The XY-Model David-Alexander Robinson Sch. 08332461 17th January 2012 Contents 1 Introduction & Theory 2 1.1 The XY-Model............................... 2 1.2 Markov Chains...............................

More information

Lessons in Estimation Theory for Signal Processing, Communications, and Control

Lessons in Estimation Theory for Signal Processing, Communications, and Control Lessons in Estimation Theory for Signal Processing, Communications, and Control Jerry M. Mendel Department of Electrical Engineering University of Southern California Los Angeles, California PRENTICE HALL

More information

Probability and Stochastic Processes

Probability and Stochastic Processes Probability and Stochastic Processes A Friendly Introduction Electrical and Computer Engineers Third Edition Roy D. Yates Rutgers, The State University of New Jersey David J. Goodman New York University

More information

The Monte Carlo Method in Condensed Matter Physics

The Monte Carlo Method in Condensed Matter Physics The Monte Carlo Method in Condensed Matter Physics Edited by K. Binder With Contributions by A. Baumgärtner K. Binder A.N. Burkitt D.M. Ceperley H. De Raedt A.M. Ferrenberg D.W. Heermann H.J. Herrmann

More information

Spin Systems. Frustrated. \fa. 2nd Edition. H T Diep. World Scientific. University of Cergy-Pontoise, France. Editor HONG SINGAPORE KONG TAIPEI

Spin Systems. Frustrated. \fa. 2nd Edition. H T Diep. World Scientific. University of Cergy-Pontoise, France. Editor HONG SINGAPORE KONG TAIPEI BEIJING HONG Frustrated Spin Systems 2nd Edition H T Diep University of Cergy-Pontoise, France Editor \fa World Scientific NEW JERSEY LONDON SINGAPORE SHANGHAI KONG TAIPEI CHENNAI CONTENTS Preface of the

More information

Electron Correlation

Electron Correlation Series in Modern Condensed Matter Physics Vol. 5 Lecture Notes an Electron Correlation and Magnetism Patrik Fazekas Research Institute for Solid State Physics & Optics, Budapest lb World Scientific h Singapore

More information

Classical Monte Carlo Simulations

Classical Monte Carlo Simulations Classical Monte Carlo Simulations Hyejin Ju April 17, 2012 1 Introduction Why do we need numerics? One of the main goals of condensed matter is to compute expectation values O = 1 Z Tr{O e βĥ} (1) and

More information

Advanced Monte Carlo Methods Problems

Advanced Monte Carlo Methods Problems Advanced Monte Carlo Methods Problems September-November, 2012 Contents 1 Integration with the Monte Carlo method 2 1.1 Non-uniform random numbers.......................... 2 1.2 Gaussian RNG..................................

More information

Probability for Statistics and Machine Learning

Probability for Statistics and Machine Learning ~Springer Anirban DasGupta Probability for Statistics and Machine Learning Fundamentals and Advanced Topics Contents Suggested Courses with Diffe~ent Themes........................... xix 1 Review of Univariate

More information

Notation Precedence Diagram

Notation Precedence Diagram Notation Precedence Diagram xix xxi CHAPTER 1 Introduction 1 1.1. Systems, Models, and Simulation 1 1.2. Verification, Approximation, and Validation 8 1.2.1. Verifying a Program 9 1.2.2. Approximation

More information

An Introduction to Computer Simulation Methods

An Introduction to Computer Simulation Methods An Introduction to Computer Simulation Methods Applications to Physical Systems Second Edition Harvey Gould Department of Physics Clark University Jan Tobochnik Department of Physics Kalamazoo College

More information

arxiv: v2 [physics.data-an] 2 May 2016

arxiv: v2 [physics.data-an] 2 May 2016 Least square fitting with one parameter less Bernd A. Berg Department of Physics, Florida State University, Tallahassee, FL 32306-4350 (May 3, 2016) It is shown that whenever the multiplicative normalization

More information

Lecture 2: From Linear Regression to Kalman Filter and Beyond

Lecture 2: From Linear Regression to Kalman Filter and Beyond Lecture 2: From Linear Regression to Kalman Filter and Beyond Department of Biomedical Engineering and Computational Science Aalto University January 26, 2012 Contents 1 Batch and Recursive Estimation

More information

Constrained data assimilation. W. Carlisle Thacker Atlantic Oceanographic and Meteorological Laboratory Miami, Florida USA

Constrained data assimilation. W. Carlisle Thacker Atlantic Oceanographic and Meteorological Laboratory Miami, Florida USA Constrained data assimilation W. Carlisle Thacker Atlantic Oceanographic and Meteorological Laboratory Miami, Florida 33149 USA Plan Range constraints: : HYCOM layers have minimum thickness. Optimal interpolation:

More information

G. S. Maddala Kajal Lahiri. WILEY A John Wiley and Sons, Ltd., Publication

G. S. Maddala Kajal Lahiri. WILEY A John Wiley and Sons, Ltd., Publication G. S. Maddala Kajal Lahiri WILEY A John Wiley and Sons, Ltd., Publication TEMT Foreword Preface to the Fourth Edition xvii xix Part I Introduction and the Linear Regression Model 1 CHAPTER 1 What is Econometrics?

More information

8 Error analysis: jackknife & bootstrap

8 Error analysis: jackknife & bootstrap 8 Error analysis: jackknife & bootstrap As discussed before, it is no problem to calculate the expectation values and statistical error estimates of normal observables from Monte Carlo. However, often

More information

Evaporation/Condensation of Ising Droplets

Evaporation/Condensation of Ising Droplets , Elmar Bittner and Wolfhard Janke Institut für Theoretische Physik, Universität Leipzig, Augustusplatz 10/11, D-04109 Leipzig, Germany E-mail: andreas.nussbaumer@itp.uni-leipzig.de Recently Biskup et

More information

Numerical Analysis for Statisticians

Numerical Analysis for Statisticians Kenneth Lange Numerical Analysis for Statisticians Springer Contents Preface v 1 Recurrence Relations 1 1.1 Introduction 1 1.2 Binomial CoefRcients 1 1.3 Number of Partitions of a Set 2 1.4 Horner's Method

More information

CONTENTS. Preface List of Symbols and Notation

CONTENTS. Preface List of Symbols and Notation CONTENTS Preface List of Symbols and Notation xi xv 1 Introduction and Review 1 1.1 Deterministic and Stochastic Models 1 1.2 What is a Stochastic Process? 5 1.3 Monte Carlo Simulation 10 1.4 Conditional

More information

TABLE OF CONTENTS CHAPTER 1 COMBINATORIAL PROBABILITY 1

TABLE OF CONTENTS CHAPTER 1 COMBINATORIAL PROBABILITY 1 TABLE OF CONTENTS CHAPTER 1 COMBINATORIAL PROBABILITY 1 1.1 The Probability Model...1 1.2 Finite Discrete Models with Equally Likely Outcomes...5 1.2.1 Tree Diagrams...6 1.2.2 The Multiplication Principle...8

More information

TIME SERIES ANALYSIS. Forecasting and Control. Wiley. Fifth Edition GWILYM M. JENKINS GEORGE E. P. BOX GREGORY C. REINSEL GRETA M.

TIME SERIES ANALYSIS. Forecasting and Control. Wiley. Fifth Edition GWILYM M. JENKINS GEORGE E. P. BOX GREGORY C. REINSEL GRETA M. TIME SERIES ANALYSIS Forecasting and Control Fifth Edition GEORGE E. P. BOX GWILYM M. JENKINS GREGORY C. REINSEL GRETA M. LJUNG Wiley CONTENTS PREFACE TO THE FIFTH EDITION PREFACE TO THE FOURTH EDITION

More information

Stat 516, Homework 1

Stat 516, Homework 1 Stat 516, Homework 1 Due date: October 7 1. Consider an urn with n distinct balls numbered 1,..., n. We sample balls from the urn with replacement. Let N be the number of draws until we encounter a ball

More information

Guiding Monte Carlo Simulations with Machine Learning

Guiding Monte Carlo Simulations with Machine Learning Guiding Monte Carlo Simulations with Machine Learning Yang Qi Department of Physics, Massachusetts Institute of Technology Joining Fudan University in 2017 KITS, June 29 2017. 1/ 33 References Works led

More information

FORECASTING METHODS AND APPLICATIONS SPYROS MAKRIDAKIS STEVEN С WHEELWRIGHT. European Institute of Business Administration. Harvard Business School

FORECASTING METHODS AND APPLICATIONS SPYROS MAKRIDAKIS STEVEN С WHEELWRIGHT. European Institute of Business Administration. Harvard Business School FORECASTING METHODS AND APPLICATIONS SPYROS MAKRIDAKIS European Institute of Business Administration (INSEAD) STEVEN С WHEELWRIGHT Harvard Business School. JOHN WILEY & SONS SANTA BARBARA NEW YORK CHICHESTER

More information

Monte Carlo Simulation of the 2D Ising model

Monte Carlo Simulation of the 2D Ising model Monte Carlo Simulation of the 2D Ising model Emanuel Schmidt, F44 April 6, 2 Introduction Monte Carlo methods are a powerful tool to solve problems numerically which are dicult to be handled analytically.

More information

Lecture 3. G. Cowan. Lecture 3 page 1. Lectures on Statistical Data Analysis

Lecture 3. G. Cowan. Lecture 3 page 1. Lectures on Statistical Data Analysis Lecture 3 1 Probability (90 min.) Definition, Bayes theorem, probability densities and their properties, catalogue of pdfs, Monte Carlo 2 Statistical tests (90 min.) general concepts, test statistics,

More information

Graphical Representations and Cluster Algorithms

Graphical Representations and Cluster Algorithms Graphical Representations and Cluster Algorithms Jon Machta University of Massachusetts Amherst Newton Institute, March 27, 2008 Outline Introduction to graphical representations and cluster algorithms

More information

Functional Materials. Optical and Magnetic Applications. Electrical, Dielectric, Electromagnetic, Deborah D. L Chung.

Functional Materials. Optical and Magnetic Applications. Electrical, Dielectric, Electromagnetic, Deborah D. L Chung. SINGAPORE Functional Materials Electrical, Dielectric, Electromagnetic, Optical and Magnetic Applications Deborah D. L Chung State University of New York at Buffalo, USAy^, NEW JERSEY LONDON ^ World Scientific

More information

QUANTUM MECHANICS USING COMPUTER ALGEBRA

QUANTUM MECHANICS USING COMPUTER ALGEBRA QUANTUM MECHANICS USING COMPUTER ALGEBRA Includes Sample Programs in C++, SymbolicC++, Maxima, Maple, and Mathematica 2nd Edition This page intentionally left blank QUANTUM MECHANICS USING COMPUTER ALGEBRA

More information

Introduction to Econometrics

Introduction to Econometrics Introduction to Econometrics T H I R D E D I T I O N Global Edition James H. Stock Harvard University Mark W. Watson Princeton University Boston Columbus Indianapolis New York San Francisco Upper Saddle

More information

Optimized multicanonical simulations: A proposal based on classical fluctuation theory

Optimized multicanonical simulations: A proposal based on classical fluctuation theory Optimized multicanonical simulations: A proposal based on classical fluctuation theory J. Viana Lopes Centro de Física do Porto and Departamento de Física, Faculdade de Ciências, Universidade do Porto,

More information

Metropolis Monte Carlo simulation of the Ising Model

Metropolis Monte Carlo simulation of the Ising Model Metropolis Monte Carlo simulation of the Ising Model Krishna Shrinivas (CH10B026) Swaroop Ramaswamy (CH10B068) May 10, 2013 Modelling and Simulation of Particulate Processes (CH5012) Introduction The Ising

More information

Appendix F. Computational Statistics Toolbox. The Computational Statistics Toolbox can be downloaded from:

Appendix F. Computational Statistics Toolbox. The Computational Statistics Toolbox can be downloaded from: Appendix F Computational Statistics Toolbox The Computational Statistics Toolbox can be downloaded from: http://www.infinityassociates.com http://lib.stat.cmu.edu. Please review the readme file for installation

More information

STOCHASTIC PROCESSES IN PHYSICS AND CHEMISTRY

STOCHASTIC PROCESSES IN PHYSICS AND CHEMISTRY STOCHASTIC PROCESSES IN PHYSICS AND CHEMISTRY Third edition N.G. VAN KAMPEN Institute for Theoretical Physics of the University at Utrecht ELSEVIER Amsterdam Boston Heidelberg London New York Oxford Paris

More information

ABSTRACT. We measure the efficiency of the Metropolis, Swendsen-Wang, and Wolff algorithms in

ABSTRACT. We measure the efficiency of the Metropolis, Swendsen-Wang, and Wolff algorithms in ABSTRACT KYIMBA, ELOI-ALAIN KYALONDAWA. Comparison of Monte Carlo Metropolis, Swendsen-Wang, and Wolff Algorithms in the Critical Region for the 2-Dimensional Ising Model. (Under the direction of Dean

More information

HANDBOOK OF APPLICABLE MATHEMATICS

HANDBOOK OF APPLICABLE MATHEMATICS HANDBOOK OF APPLICABLE MATHEMATICS Chief Editor: Walter Ledermann Volume VI: Statistics PART A Edited by Emlyn Lloyd University of Lancaster A Wiley-Interscience Publication JOHN WILEY & SONS Chichester

More information

DESIGN AND ANALYSIS OF EXPERIMENTS Third Edition

DESIGN AND ANALYSIS OF EXPERIMENTS Third Edition DESIGN AND ANALYSIS OF EXPERIMENTS Third Edition Douglas C. Montgomery ARIZONA STATE UNIVERSITY JOHN WILEY & SONS New York Chichester Brisbane Toronto Singapore Contents Chapter 1. Introduction 1-1 What

More information

Contents LIST OF TABLES... LIST OF FIGURES... xvii. LIST OF LISTINGS... xxi PREFACE. ...xxiii

Contents LIST OF TABLES... LIST OF FIGURES... xvii. LIST OF LISTINGS... xxi PREFACE. ...xxiii LIST OF TABLES... xv LIST OF FIGURES... xvii LIST OF LISTINGS... xxi PREFACE...xxiii CHAPTER 1. PERFORMANCE EVALUATION... 1 1.1. Performance evaluation... 1 1.2. Performance versus resources provisioning...

More information

Deep learning / Ian Goodfellow, Yoshua Bengio and Aaron Courville. - Cambridge, MA ; London, Spis treści

Deep learning / Ian Goodfellow, Yoshua Bengio and Aaron Courville. - Cambridge, MA ; London, Spis treści Deep learning / Ian Goodfellow, Yoshua Bengio and Aaron Courville. - Cambridge, MA ; London, 2017 Spis treści Website Acknowledgments Notation xiii xv xix 1 Introduction 1 1.1 Who Should Read This Book?

More information

Ising Model. Ising Lattice. E. J. Maginn, J. K. Shah

Ising Model. Ising Lattice. E. J. Maginn, J. K. Shah Ising Lattice E. J. Maginn, J. K. Shah Department of Chemical and Biomolecular Engineering University of Notre Dame Notre Dame, IN 46556 USA Monte Carlo Workshop, Brazil Ising Lattice Model Consider a

More information

Monte Carlo Methods. Handbook of. University ofqueensland. Thomas Taimre. Zdravko I. Botev. Dirk P. Kroese. Universite de Montreal

Monte Carlo Methods. Handbook of. University ofqueensland. Thomas Taimre. Zdravko I. Botev. Dirk P. Kroese. Universite de Montreal Handbook of Monte Carlo Methods Dirk P. Kroese University ofqueensland Thomas Taimre University ofqueensland Zdravko I. Botev Universite de Montreal A JOHN WILEY & SONS, INC., PUBLICATION Preface Acknowledgments

More information

Time Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY

Time Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY Time Series Analysis James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY & Contents PREFACE xiii 1 1.1. 1.2. Difference Equations First-Order Difference Equations 1 /?th-order Difference

More information

Information, Physics, and Computation

Information, Physics, and Computation Information, Physics, and Computation Marc Mezard Laboratoire de Physique Thdorique et Moales Statistiques, CNRS, and Universit y Paris Sud Andrea Montanari Department of Electrical Engineering and Department

More information

Numerical Analysis of 2-D Ising Model. Ishita Agarwal Masters in Physics (University of Bonn) 17 th March 2011

Numerical Analysis of 2-D Ising Model. Ishita Agarwal Masters in Physics (University of Bonn) 17 th March 2011 Numerical Analysis of 2-D Ising Model By Ishita Agarwal Masters in Physics (University of Bonn) 17 th March 2011 Contents Abstract Acknowledgment Introduction Computational techniques Numerical Analysis

More information

Statistical Analysis of Simulations: Data Correlations and Error Estimation

Statistical Analysis of Simulations: Data Correlations and Error Estimation John von Neumann Institute for Computing Statistical Analysis of Simulations: Data Correlations and Error Estimation Wolfhard Janke published in Quantum Simulations of Complex Many-Body Systems: From Theory

More information

Zacros. Software Package Development: Pushing the Frontiers of Kinetic Monte Carlo Simulation in Catalysis

Zacros. Software Package Development: Pushing the Frontiers of Kinetic Monte Carlo Simulation in Catalysis Zacros Software Package Development: Pushing the Frontiers of Kinetic Monte Carlo Simulation in Catalysis Jens H Nielsen, Mayeul D'Avezac, James Hetherington & Michail Stamatakis Introduction to Zacros

More information

Monte Carlo Simulation. CWR 6536 Stochastic Subsurface Hydrology

Monte Carlo Simulation. CWR 6536 Stochastic Subsurface Hydrology Monte Carlo Simulation CWR 6536 Stochastic Subsurface Hydrology Steps in Monte Carlo Simulation Create input sample space with known distribution, e.g. ensemble of all possible combinations of v, D, q,

More information