From Random Numbers to Monte Carlo. Random Numbers, Random Walks, Diffusion, Monte Carlo integration, and all that
|
|
- Mariah Goodwin
- 6 years ago
- Views:
Transcription
1 From Random Numbers to Monte Carlo Random Numbers, Random Walks, Diffusion, Monte Carlo integration, and all that
2 Random Walk Through Life Random Walk Through Life If you flip the coin 5 times you will probably be about five steps away from where you started. This is because five times five equals 5. A random walk is not a very fast way to get anywhere! When you try this, you will notice that sometimes you go much farther than you expect and sometimes you end up very close to where you started. But if you repeat it many times or get several of your friends to do it with you with coins of their own, the average distance should come out as expected. In science we can often predict what will happen on the average even when the process is random.
3 Random Walk: From Physics to Wall Street A random process consisting of a sequence of discrete steps of fixed length: vary greatly depending on the dimension in which the walk occurs and whether it is confined to a lattice. The random thermal perturbations in a liquid are responsible for a random walk phenomenon known as Brownian motion. The collisions of molecules in a gas are a random walk responsible for diffusion.
4 For over half a century financial experts have regarded the movements of markets as a random walk - unpredictable meanderings akin to a drunkard's unsteady gait - and this hypothesis has become a cornerstone of modern financial economics and many investment strategies: markets were "weakform efficient", implying that past prices could not be used to forecast future prices changes. Lo and MacKinlay find that markets are not completely random after all, and that predictable components do exist in recent stock and bond returns.
5 Einstein (1905): Kinetic Theory of Brownian Motion Brownian motion -> The random walk motion of small particles suspended in a fluid due to bombardment by molecules obeying a Maxwellian velocity distribution (J. Ingenhousz 1785; Brown 188). Brownian trajectories are continuous, but of infinite length between any two points. dv m = αv + F t α = πηa m xx x xx xf t dt ɺ ɺ = α ɺ + d d m ( xxɺ ) = m xxɺ = m xɺ α xxɺ + xf( t) d dt ( ), 6 ( ) ( ) 1 1 kt 1 γt α xf( t) = x F( t) = 0, xɺ = kt, x = t (1 e ), γ α = γ m 1 kt t 1 ktt t γ x =, t γ x = m 3πη a kt t πη a r = 3 x r = = D t
6 Monte Carlo Methods: Not one, but many Any method that solves a problem by generating suitable random numbers and observing that fraction of the numbers obeying some property or properties. The method is useful for obtaining numerical solutions to problems which are too complicated to solve analytically. It was named by S. Ulam, who in 1946 became the first mathematician to dignify this approach with a name, in honor of a relative having a propensity to gamble. Nicholas Metropolis: Metropolis algorithm in Statistical Physics among the top 10 algorithms having the "greatest influence on the development and practice of science and engineering in the 0th century."
7 Random Numbers in Computers? Uniform distribution of pseudo-random numbers x ( ax b) mod m n+ 1 = n + can be generated by this linear congruential generator. Here a, b and m are carefully chosen fixed integers, a is the multiplier, b is the increment and m is the modulus. The starting value x 0 is called the seed. The random number in the interval [0, 1] is x / m n. Hence there are at most m random uniformly distributed numbers: P ( x ) = 1 if x [0,1] P ( x ) = 0 if x [0,1]
8 Is the distribution really uniform? Knut s ran3.c or ran3.for portable generator (it does not employ linear congruential method!):
9 Non-uniform distributions Transformation method: y = f ( x) dx Px ( x) dx = Py ( y) dy Py ( y) = Px ( x) = C dy y 1 ( ) ( ) ( ) ( ) x = F y = P y dy y x = F x 0 dx dy
10 Example: Exponential Deviates Transformation method: y = ln( x) P ( y) = e y, 0 y y
11 Non-uniform Distributions: Transformation Method Transformation method does not always work: 1 y Py ( y) = exp π y dx 1 y 1 t = exp x = exp dt dy π π y( x) No analytical expression for in the case of Normal Distribution!
12 Non-uniform Distributions: Rejection Method Suppose we have a comparison function f ( x) with the properties: P( x) < f ( x) x, f ( x) dx < Now suppose we can choose a random point in two dimensions that is uniformly distributed in the area under the comparison function f ( x). If the point lies outside the area under P( x) then reject it and choose again. Otherwise, accept the point. The accepted points are uniformly distributed in the accepted area.
13 Rejection Method Summarized
14 x 0 Rejection Method in Practice Choose a comparison function whose indefinite integral is known analytically and is analytically invertible, i.e., you can find x such that : f ( x ') dx ' = z Let A be the total area under f(x). Pick a uniform random number 0 < α < A. Then find x so that: x 0 f ( x ') dx ' = α Now pick a random number y between 0 and f(x). Accept x if y<p(x), reject otherwise.
15 P x x x x Rejection Method: Example ( ) = 30 (1 ), x, 0 x 9 f ( x) = 40 1 (1 x), x 1 9
16 Monte Carlo Integration The most common application of the Monte Carlo method is Monte Carlo integration (extension of the rejection method). b a Y NIN f ( x) dx ( b a) Y N [ a, b] TRIALS > max f ( x) In order to integrate a function over a complicated domain D, Monte Carlo integration picks random points over some simple domain D which is a superset of D, checks whether each point is within D, and estimates the area of D (volume, n-dimensional content, etc.) as the area of D multiplied by the fraction of points falling within D.
17 Ultra Classic Example: A circle A standard example is to use the Monte Carlo method to find the area of a circle and hence determine a value for. π b a N b a f ( x) dx f ( xi ) N i= 1 N 4 π = p( x, y) dxdy p( xi, yi ) N p( x, y) + = 0, otherwise 1, x y 1 i= 1
18 Monte Carlo Integration: Error Estimate Suppose we pick N random points uniformly distributed in a multidimensional volume V: x, x,, x. Then the 1 n basic theorem of Monte Carlo integration estimates the integral of a function as: f ( x) f ( x) dv f V ± V 1 1 f = f x f = f x N N N ( ), i ( i ) i = 1 N i = 1 f N f σ General Theory of Statistical Errors: 1 N trials = ( Ii I ) ( Ntrials 1) i= 1 S S I I = N σ N 1/ trials
19 Monte Carlo Integration: A Sphere The same basic method can be used to find the volume of a sphere: 1 / N The accuracy of this Monte Carlo method is proportional to. tria ls Hence a large number of random points is needed to get high accuracy. However, Monte Carlo integration is faster than Simpson s rule in 4 or more dimensions. It is also easy to program and is useful for evaluating and 3 dimensional integrals with complex boundaries.
20 Random Walk in 1D In a one-dimensional random walk, the walker can move along a straight line in either the positive direction or the negative direction. Here we will assume that steps are of unit length and that the walker can move in either direction with equal probability. x x n n = 0 t In this case the most likely distance from the starting point after n steps is 0. The plot shows the distribution of positions (both positive and negative) for 100,000 walkers after 100 steps. The distribution is normal (Gaussian) with standard deviation 10.
21 Random Walk in 1D Explained To see why the variance behaves this way, let during i-th step:. s = ± 1 s i be the change in position This property is characteristic of random walks and diffusion processes in any number of dimensions. i x n = n i= 1 s i n n n n n n n = i j = i j = i j i= 1 j= 1 i= 1 j= 1 i= 1 j= 1 x s s ss ss i = j s = s ss = 1 i j i j i j ss = 0 i j n n n n i j i i i= 1 j= 1 i= 1 x = ss = ss = n
22 From Random Walk to Diffusion To see the connection between random walks and diffusion processes, consider the probability p(m,n) that a walker is at position m after n steps. To get to position m, the walker must be at position m-1 or position m+1 at the previous step. In either case, the probability that it moves to position m is p( m, n) = [ p( m+ 1, n 1) + p( m 1, n 1) ] 1 p( m, n) p( m, n 1) = p( m+ 1, n 1) p( m, n 1) + p( m 1, n 1) [ ] p p = D t x Letting the time step and the spatial step become infinitesimally small leads to a diffusion equation.
23 Self-Avoiding Random Walk A self-avoiding walk is a path from one point to another which never intersects itself. Such paths are usually considered to occur on lattices, so that steps are only allowed in a discrete number of directions and of certain lengths. α α r 1.4, d = = 1.5, d = , d = 4 t 1 < < SAW can model coiling up of links in a polymer chain. α
Monte Carlo. Lecture 15 4/9/18. Harvard SEAS AP 275 Atomistic Modeling of Materials Boris Kozinsky
Monte Carlo Lecture 15 4/9/18 1 Sampling with dynamics In Molecular Dynamics we simulate evolution of a system over time according to Newton s equations, conserving energy Averages (thermodynamic properties)
More informationRandom processes and probability distributions. Phys 420/580 Lecture 20
Random processes and probability distributions Phys 420/580 Lecture 20 Random processes Many physical processes are random in character: e.g., nuclear decay (Poisson distributed event count) P (k, τ) =
More informationCNH3C3 Persamaan Diferensial Parsial (The art of Modeling PDEs) DR. PUTU HARRY GUNAWAN
CNH3C3 Persamaan Diferensial Parsial (The art of Modeling PDEs) DR. PUTU HARRY GUNAWAN Partial Differential Equations Content 1. Part II: Derivation of PDE in Brownian Motion PART II DERIVATION OF PDE
More informationMath 345 Intro to Math Biology Lecture 21: Diffusion
Math 345 Intro to Math Biology Lecture 21: Diffusion Junping Shi College of William and Mary November 12, 2018 Functions of several variables z = f (x, y): two variables, one function value Domain: a subset
More information16. Working with the Langevin and Fokker-Planck equations
16. Working with the Langevin and Fokker-Planck equations In the preceding Lecture, we have shown that given a Langevin equation (LE), it is possible to write down an equivalent Fokker-Planck equation
More informationToday: Fundamentals of Monte Carlo
Today: Fundamentals of Monte Carlo What is Monte Carlo? Named at Los Alamos in 940 s after the casino. Any method which uses (pseudo)random numbers as an essential part of the algorithm. Stochastic - not
More informationPreliminary statistics
1 Preliminary statistics The solution of a geophysical inverse problem can be obtained by a combination of information from observed data, the theoretical relation between data and earth parameters (models),
More informationLecture 20. Randomness and Monte Carlo. J. Chaudhry. Department of Mathematics and Statistics University of New Mexico
Lecture 20 Randomness and Monte Carlo J. Chaudhry Department of Mathematics and Statistics University of New Mexico J. Chaudhry (UNM) CS 357 1 / 40 What we ll do: Random number generators Monte-Carlo integration
More informationRandom Number Generators
1/18 Random Number Generators Professor Karl Sigman Columbia University Department of IEOR New York City USA 2/18 Introduction Your computer generates" numbers U 1, U 2, U 3,... that are considered independent
More information19 : Slice Sampling and HMC
10-708: Probabilistic Graphical Models 10-708, Spring 2018 19 : Slice Sampling and HMC Lecturer: Kayhan Batmanghelich Scribes: Boxiang Lyu 1 MCMC (Auxiliary Variables Methods) In inference, we are often
More informationReview of Statistical Terminology
Review of Statistical Terminology An experiment is a process whose outcome is not known with certainty. The experiment s sample space S is the set of all possible outcomes. A random variable is a function
More informationDUBLIN CITY UNIVERSITY
DUBLIN CITY UNIVERSITY SAMPLE EXAMINATIONS 2017/2018 MODULE: QUALIFICATIONS: Simulation for Finance MS455 B.Sc. Actuarial Mathematics ACM B.Sc. Financial Mathematics FIM YEAR OF STUDY: 4 EXAMINERS: Mr
More informationA simple algorithm that will generate a sequence of integers between 0 and m is:
Using the Pseudo-Random Number generator Generating random numbers is a useful technique in many numerical applications in Physics. This is because many phenomena in physics are random, and algorithms
More information2008 Winton. Review of Statistical Terminology
1 Review of Statistical Terminology 2 Formal Terminology An experiment is a process whose outcome is not known with certainty The experiment s sample space S is the set of all possible outcomes. A random
More informationTopics covered so far:
Topics covered so far: Chap 1: The kinetic theory of gases P, T, and the Ideal Gas Law Chap 2: The principles of statistical mechanics 2.1, The Boltzmann law (spatial distribution) 2.2, The distribution
More informationStatistical Methods for Astronomy
Statistical Methods for Astronomy If your experiment needs statistics, you ought to have done a better experiment. -Ernest Rutherford Lecture 1 Lecture 2 Why do we need statistics? Definitions Statistical
More informationLecture 5: Random numbers and Monte Carlo (Numerical Recipes, Chapter 7) Motivations for generating random numbers
Lecture 5: Random numbers and Monte Carlo (Numerical Recipes, Chapter 7) Motivations for generating random numbers To sample a function in a statistically controlled manner (i.e. for Monte Carlo integration)
More informationBrownian Motion and The Atomic Theory
Brownian Motion and The Atomic Theory Albert Einstein Annus Mirabilis Centenary Lecture Simeon Hellerman Institute for Advanced Study, 5/20/2005 Founders Day 1 1. What phenomenon did Einstein explain?
More informationREVIEW: Waves on a String
Lecture 14: Solution to the Wave Equation (Chapter 6) and Random Walks (Chapter 7) 1 Description of Wave Motion REVIEW: Waves on a String We are all familiar with the motion of a transverse wave pulse
More informationBasics on Probability. Jingrui He 09/11/2007
Basics on Probability Jingrui He 09/11/2007 Coin Flips You flip a coin Head with probability 0.5 You flip 100 coins How many heads would you expect Coin Flips cont. You flip a coin Head with probability
More informationMonte Carlo Methods. PHY 688: Numerical Methods for (Astro)Physics
Monte Carlo Methods Random Numbers How random is random? From Pang: we want Long period before sequence repeats Little correlation between numbers (plot ri+1 vs ri should fill the plane) Fast Typical random
More informationSystems Simulation Chapter 7: Random-Number Generation
Systems Simulation Chapter 7: Random-Number Generation Fatih Cavdur fatihcavdur@uludag.edu.tr April 22, 2014 Introduction Introduction Random Numbers (RNs) are a necessary basic ingredient in the simulation
More informationLecture 3: From Random Walks to Continuum Diffusion
Lecture 3: From Random Walks to Continuum Diffusion Martin Z. Bazant Department of Mathematics, MIT February 3, 6 Overview In the previous lecture (by Prof. Yip), we discussed how individual particles
More informationSampling Distributions Allen & Tildesley pgs and Numerical Recipes on random numbers
Sampling Distributions Allen & Tildesley pgs. 345-351 and Numerical Recipes on random numbers Today I explain how to generate a non-uniform probability distributions. These are used in importance sampling
More informationData Analysis I. Dr Martin Hendry, Dept of Physics and Astronomy University of Glasgow, UK. 10 lectures, beginning October 2006
Astronomical p( y x, I) p( x, I) p ( x y, I) = p( y, I) Data Analysis I Dr Martin Hendry, Dept of Physics and Astronomy University of Glasgow, UK 10 lectures, beginning October 2006 4. Monte Carlo Methods
More informationLecture 2 : CS6205 Advanced Modeling and Simulation
Lecture 2 : CS6205 Advanced Modeling and Simulation Lee Hwee Kuan 21 Aug. 2013 For the purpose of learning stochastic simulations for the first time. We shall only consider probabilities on finite discrete
More information( x) ( ) F ( ) ( ) ( ) Prob( ) ( ) ( ) X x F x f s ds
Applied Numerical Analysis Pseudo Random Number Generator Lecturer: Emad Fatemizadeh What is random number: A sequence in which each term is unpredictable 29, 95, 11, 60, 22 Application: Monte Carlo Simulations
More informationChapter 3. Random Process & Partial Differential Equations
Chapter 3 Random Process & Partial Differential Equations 3.0 Introduction Deterministic model ( repeatable results ) Consider particles with coordinates rr 1, rr, rr the interactions between particles
More informationLecture 15 Random variables
Lecture 15 Random variables Weinan E 1,2 and Tiejun Li 2 1 Department of Mathematics, Princeton University, weinan@princeton.edu 2 School of Mathematical Sciences, Peking University, tieli@pku.edu.cn No.1
More informationSlides 3: Random Numbers
Slides 3: Random Numbers We previously considered a few examples of simulating real processes. In order to mimic real randomness of events such as arrival times we considered the use of random numbers
More informationRandom Walks A&T and F&S 3.1.2
Random Walks A&T 110-123 and F&S 3.1.2 As we explained last time, it is very difficult to sample directly a general probability distribution. - If we sample from another distribution, the overlap will
More informationChapter 4: Monte Carlo Methods. Paisan Nakmahachalasint
Chapter 4: Monte Carlo Methods Paisan Nakmahachalasint Introduction Monte Carlo Methods are a class of computational algorithms that rely on repeated random sampling to compute their results. Monte Carlo
More informationLecture notes on Regression: Markov Chain Monte Carlo (MCMC)
Lecture notes on Regression: Markov Chain Monte Carlo (MCMC) Dr. Veselina Kalinova, Max Planck Institute for Radioastronomy, Bonn Machine Learning course: the elegant way to extract information from data,
More informationToday: Fundamentals of Monte Carlo
Today: Fundamentals of Monte Carlo What is Monte Carlo? Named at Los Alamos in 1940 s after the casino. Any method which uses (pseudo)random numbers as an essential part of the algorithm. Stochastic -
More informationMethods of Data Analysis Random numbers, Monte Carlo integration, and Stochastic Simulation Algorithm (SSA / Gillespie)
Methods of Data Analysis Random numbers, Monte Carlo integration, and Stochastic Simulation Algorithm (SSA / Gillespie) Week 1 1 Motivation Random numbers (RNs) are of course only pseudo-random when generated
More informationAMath 483/583 Lecture 26. Notes: Notes: Announcements. Notes: AMath 483/583 Lecture 26. Outline:
AMath 483/583 Lecture 26 Outline: Monte Carlo methods Random number generators Monte Carlo integrators Random walk solution of Poisson problem Announcements Part of Final Project will be available tomorrow.
More informationMonte Carlo and cold gases. Lode Pollet.
Monte Carlo and cold gases Lode Pollet lpollet@physics.harvard.edu 1 Outline Classical Monte Carlo The Monte Carlo trick Markov chains Metropolis algorithm Ising model critical slowing down Quantum Monte
More informationX 1 ((, a]) = {ω Ω : X(ω) a} F, which leads us to the following definition:
nna Janicka Probability Calculus 08/09 Lecture 4. Real-valued Random Variables We already know how to describe the results of a random experiment in terms of a formal mathematical construction, i.e. the
More informationfunctions Poisson distribution Normal distribution Arbitrary functions
Physics 433: Computational Physics Lecture 6 Random number distributions Generation of random numbers of various distribuition functions Normal distribution Poisson distribution Arbitrary functions Random
More informationPotentials of Unbalanced Complex Kinetics Observed in Market Time Series
Potentials of Unbalanced Complex Kinetics Observed in Market Time Series Misako Takayasu 1, Takayuki Mizuno 1 and Hideki Takayasu 2 1 Department of Computational Intelligence & Systems Science, Interdisciplinary
More information2 Random Variable Generation
2 Random Variable Generation Most Monte Carlo computations require, as a starting point, a sequence of i.i.d. random variables with given marginal distribution. We describe here some of the basic methods
More informationCopyright 2001 University of Cambridge. Not to be quoted or copied without permission.
Course MP3 Lecture 4 13/11/2006 Monte Carlo method I An introduction to the use of the Monte Carlo method in materials modelling Dr James Elliott 4.1 Why Monte Carlo? The name derives from the association
More informationStatistical Methods in Particle Physics
Statistical Methods in Particle Physics Lecture 11 January 7, 2013 Silvia Masciocchi, GSI Darmstadt s.masciocchi@gsi.de Winter Semester 2012 / 13 Outline How to communicate the statistical uncertainty
More informationWorkshop on Heterogeneous Computing, 16-20, July No Monte Carlo is safe Monte Carlo - more so parallel Monte Carlo
Workshop on Heterogeneous Computing, 16-20, July 2012 No Monte Carlo is safe Monte Carlo - more so parallel Monte Carlo K. P. N. Murthy School of Physics, University of Hyderabad July 19, 2012 K P N Murthy
More informationMonte Carlo Simulations
Monte Carlo Simulations What are Monte Carlo Simulations and why ones them? Pseudo Random Number generators Creating a realization of a general PDF The Bootstrap approach A real life example: LOFAR simulations
More informationMonte Carlo methods for kinetic equations
Monte Carlo methods for kinetic equations Lecture 2: Monte Carlo simulation methods Lorenzo Pareschi Department of Mathematics & CMCS University of Ferrara Italy http://utenti.unife.it/lorenzo.pareschi/
More informationMonte Carlo Methods. Part I: Introduction
Monte Carlo Methods Part I: Introduction Spring Semester 2013/14 Department of Applied Mathematics, University of Crete Instructor: Harmandaris Vagelis, email: vagelis@tem.uoc.gr Course web page: http://www.tem.uoc.gr/~vagelis/courses/em385/
More informationRandom Variate Generation
CPSC 405 Random Variate Generation 2007W T1 Handout These notes present techniques to generate samples of desired probability distributions, and some fundamental results and techiques. Some of this material
More informationUNIT 5:Random number generation And Variation Generation
UNIT 5:Random number generation And Variation Generation RANDOM-NUMBER GENERATION Random numbers are a necessary basic ingredient in the simulation of almost all discrete systems. Most computer languages
More informationAdvanced Monte Carlo Methods Problems
Advanced Monte Carlo Methods Problems September-November, 2012 Contents 1 Integration with the Monte Carlo method 2 1.1 Non-uniform random numbers.......................... 2 1.2 Gaussian RNG..................................
More informationSampling Distributions Allen & Tildesley pgs and Numerical Recipes on random numbers
Sampling Distributions Allen & Tildesley pgs. 345-351 and Numerical Recipes on random numbers Today I explain how to generate a non-uniform probability distributions. These are used in importance sampling
More informationIndependent Events. Two events are independent if knowing that one occurs does not change the probability of the other occurring
Independent Events Two events are independent if knowing that one occurs does not change the probability of the other occurring Conditional probability is denoted P(A B), which is defined to be: P(A and
More informationEXPERIMENT 17. To Determine Avogadro s Number by Observations on Brownian Motion. Introduction
EXPERIMENT 17 To Determine Avogadro s Number by Observations on Brownian Motion Introduction In 1827 Robert Brown, using a microscope, observed that very small pollen grains suspended in water appeared
More informationThe dynamics of small particles whose size is roughly 1 µmt or. smaller, in a fluid at room temperature, is extremely erratic, and is
1 I. BROWNIAN MOTION The dynamics of small particles whose size is roughly 1 µmt or smaller, in a fluid at room temperature, is extremely erratic, and is called Brownian motion. The velocity of such particles
More information2 Functions of random variables
2 Functions of random variables A basic statistical model for sample data is a collection of random variables X 1,..., X n. The data are summarised in terms of certain sample statistics, calculated as
More informationScientific Computing: Monte Carlo
Scientific Computing: Monte Carlo Aleksandar Donev Courant Institute, NYU 1 donev@courant.nyu.edu 1 Course MATH-GA.2043 or CSCI-GA.2112, Spring 2012 April 5th and 12th, 2012 A. Donev (Courant Institute)
More information1 Brownian motion and the Langevin equation
Figure 1: The robust appearance of Robert Brown (1773 1858) 1 Brownian otion and the Langevin equation In 1827, while exaining pollen grains and the spores of osses suspended in water under a icroscope,
More informationB.N.Bandodkar College of Science, Thane. Random-Number Generation. Mrs M.J.Gholba
B.N.Bandodkar College of Science, Thane Random-Number Generation Mrs M.J.Gholba Properties of Random Numbers A sequence of random numbers, R, R,., must have two important statistical properties, uniformity
More informationReduction of Variance. Importance Sampling
Reduction of Variance As we discussed earlier, the statistical error goes as: error = sqrt(variance/computer time). DEFINE: Efficiency = = 1/vT v = error of mean and T = total CPU time How can you make
More informationMonte Carlo integration (naive Monte Carlo)
Monte Carlo integration (naive Monte Carlo) Example: Calculate π by MC integration [xpi] 1/21 INTEGER n total # of points INTEGER i INTEGER nu # of points in a circle REAL x,y coordinates of a point in
More informationt = no of steps of length s
s t = no of steps of length s Figure : Schematic of the path of a diffusing molecule, for example, one in a gas or a liquid. The particle is moving in steps of length s. For a molecule in a liquid the
More informationIn this approach, the ground state of the system is found by modeling a diffusion process.
The Diffusion Monte Carlo (DMC) Method In this approach, the ground state of the system is found by modeling a diffusion process. Diffusion and random walks Consider a random walk on a lattice with spacing
More information2. Molecules in Motion
2. Molecules in Motion Kinetic Theory of Gases (microscopic viewpoint) assumptions (1) particles of mass m and diameter d; ceaseless random motion (2) dilute gas: d λ, λ = mean free path = average distance
More information16 : Markov Chain Monte Carlo (MCMC)
10-708: Probabilistic Graphical Models 10-708, Spring 2014 16 : Markov Chain Monte Carlo MCMC Lecturer: Matthew Gormley Scribes: Yining Wang, Renato Negrinho 1 Sampling from low-dimensional distributions
More informationRandom Number Generation. CS1538: Introduction to simulations
Random Number Generation CS1538: Introduction to simulations Random Numbers Stochastic simulations require random data True random data cannot come from an algorithm We must obtain it from some process
More informationToday: Fundamentals of Monte Carlo
Today: Fundamentals of Monte Carlo What is Monte Carlo? Named at Los Alamos in 1940 s after the casino. Any method which uses (pseudo)random numbers as an essential part of the algorithm. Stochastic -
More informationFractals. Mandelbrot defines a fractal set as one in which the fractal dimension is strictly greater than the topological dimension.
Fractals Fractals are unusual, imperfectly defined, mathematical objects that observe self-similarity, that the parts are somehow self-similar to the whole. This self-similarity process implies that fractals
More informationMonte Carlo (MC) Simulation Methods. Elisa Fadda
Monte Carlo (MC) Simulation Methods Elisa Fadda 1011-CH328, Molecular Modelling & Drug Design 2011 Experimental Observables A system observable is a property of the system state. The system state i is
More informationEnrico Fermi and the FERMIAC. Mechanical device that plots 2D random walks of slow and fast neutrons in fissile material
Monte Carlo History Statistical sampling Buffon s needles and estimates of π 1940s: neutron transport in fissile material Origin of name People: Ulam, von Neuman, Metropolis, Teller Other areas of use:
More informationCheng Soon Ong & Christian Walder. Canberra February June 2018
Cheng Soon Ong & Christian Walder Research Group and College of Engineering and Computer Science Canberra February June 2018 Outlines Overview Introduction Linear Algebra Probability Linear Regression
More informationMath Stochastic Processes & Simulation. Davar Khoshnevisan University of Utah
Math 5040 1 Stochastic Processes & Simulation Davar Khoshnevisan University of Utah Module 1 Generation of Discrete Random Variables Just about every programming language and environment has a randomnumber
More information7.1 Coupling from the Past
Georgia Tech Fall 2006 Markov Chain Monte Carlo Methods Lecture 7: September 12, 2006 Coupling from the Past Eric Vigoda 7.1 Coupling from the Past 7.1.1 Introduction We saw in the last lecture how Markov
More informationMarkov Chain Monte Carlo Lecture 1
What are Monte Carlo Methods? The subject of Monte Carlo methods can be viewed as a branch of experimental mathematics in which one uses random numbers to conduct experiments. Typically the experiments
More informationQuiz 1. Name: Instructions: Closed book, notes, and no electronic devices.
Quiz 1. Name: Instructions: Closed book, notes, and no electronic devices. 1. What is the difference between a deterministic model and a probabilistic model? (Two or three sentences only). 2. What is the
More informationClass 12. Random Numbers
Class 12. Random Numbers NRiC 7. Frequently needed to generate initial conditions. Often used to solve problems statistically. How can a computer generate a random number? It can t! Generators are pseudo-random.
More informationHands-on Generating Random
CVIP Laboratory Hands-on Generating Random Variables Shireen Elhabian Aly Farag October 2007 The heart of Monte Carlo simulation for statistical inference. Generate synthetic data to test our algorithms,
More informationGrade: The remainder of this page has been left blank for your workings. VERSION D. Midterm D: Page 1 of 12
First Name: Student-No: Last Name: Section: Grade: The remainder of this page has been left blank for your workings. Midterm D: Page of 2 Indefinite Integrals. 9 marks Each part is worth marks. Please
More informationLecture 11: Non-Equilibrium Statistical Physics
Massachusetts Institute of Technology MITES 2018 Physics III Lecture 11: Non-Equilibrium Statistical Physics In the previous notes, we studied how systems in thermal equilibrium can change in time even
More informationThe Monte Carlo Algorithm
The Monte Carlo Algorithm This algorithm was invented by N. Metropolis, A.W. Rosenbluth, M.N. Rosenbluth, A.H. Teller, and E. Teller, J. Chem. Phys., 21, 1087 (1953). It was listed as one of the The Top
More information3.320 Lecture 18 (4/12/05)
3.320 Lecture 18 (4/12/05) Monte Carlo Simulation II and free energies Figure by MIT OCW. General Statistical Mechanics References D. Chandler, Introduction to Modern Statistical Mechanics D.A. McQuarrie,
More informationNumerical integration and importance sampling
2 Numerical integration and importance sampling 2.1 Quadrature Consider the numerical evaluation of the integral I(a, b) = b a dx f(x) Rectangle rule: on small interval, construct interpolating function
More informationSimulation. Version 1.1 c 2010, 2009, 2001 José Fernando Oliveira Maria Antónia Carravilla FEUP
Simulation Version 1.1 c 2010, 2009, 2001 José Fernando Oliveira Maria Antónia Carravilla FEUP Systems - why simulate? System any object or entity on which a particular study is run. Model representation
More informationUniversity of Washington Department of Chemistry Chemistry 453 Winter Quarter 2005
Lecture /4/ University of Washington Department of Chemistry Chemistry 4 Winter Quarter A. Polymer Properties of DNA When a linear polymer like DNA becomes long enough it can no longer be treated as a
More information2905 Queueing Theory and Simulation PART IV: SIMULATION
2905 Queueing Theory and Simulation PART IV: SIMULATION 22 Random Numbers A fundamental step in a simulation study is the generation of random numbers, where a random number represents the value of a random
More informationStatistical Methods in Particle Physics
Statistical Methods in Particle Physics 4. Monte Carlo Methods Prof. Dr. Klaus Reygers (lectures) Dr. Sebastian Neubert (tutorials) Heidelberg University WS 2017/18 Monte Carlo Method Any method which
More informationSTA 256: Statistics and Probability I
Al Nosedal. University of Toronto. Fall 2017 My momma always said: Life was like a box of chocolates. You never know what you re gonna get. Forrest Gump. There are situations where one might be interested
More informationMonte Carlo Integration. Computer Graphics CMU /15-662, Fall 2016
Monte Carlo Integration Computer Graphics CMU 15-462/15-662, Fall 2016 Talk Announcement Jovan Popovic, Senior Principal Scientist at Adobe Research will be giving a seminar on Character Animator -- Monday
More informationISyE 3044 Fall 2017 Test #1a Solutions
1 NAME ISyE 344 Fall 217 Test #1a Solutions This test is 75 minutes. You re allowed one cheat sheet. Good luck! 1. Suppose X has p.d.f. f(x) = 4x 3, < x < 1. Find E[ 2 X 2 3]. Solution: By LOTUS, we have
More informationMarkov Processes. Stochastic process. Markov process
Markov Processes Stochastic process movement through a series of well-defined states in a way that involves some element of randomness for our purposes, states are microstates in the governing ensemble
More informationMultiple Random Variables
Multiple Random Variables Joint Probability Density Let X and Y be two random variables. Their joint distribution function is F ( XY x, y) P X x Y y. F XY ( ) 1, < x
More informationECONOMICS 207 SPRING 2006 LABORATORY EXERCISE 5 KEY. 8 = 10(5x 2) = 9(3x + 8), x 50x 20 = 27x x = 92 x = 4. 8x 2 22x + 15 = 0 (2x 3)(4x 5) = 0
ECONOMICS 07 SPRING 006 LABORATORY EXERCISE 5 KEY Problem. Solve the following equations for x. a 5x 3x + 8 = 9 0 5x 3x + 8 9 8 = 0(5x ) = 9(3x + 8), x 0 3 50x 0 = 7x + 7 3x = 9 x = 4 b 8x x + 5 = 0 8x
More informationMath RE - Calculus II Antiderivatives and the Indefinite Integral Page 1 of 5
Math 201-203-RE - Calculus II Antiderivatives and the Indefinite Integral Page 1 of 5 What is the Antiderivative? In a derivative problem, a function f(x) is given and you find the derivative f (x) using
More information1 INFO Sep 05
Events A 1,...A n are said to be mutually independent if for all subsets S {1,..., n}, p( i S A i ) = p(a i ). (For example, flip a coin N times, then the events {A i = i th flip is heads} are mutually
More informationBrownian motion and the Central Limit Theorem
Brownian motion and the Central Limit Theorem Amir Bar January 4, 3 Based on Shang-Keng Ma, Statistical Mechanics, sections.,.7 and the course s notes section 6. Introduction In this tutorial we shall
More informationUniform Random Number Generators
JHU 553.633/433: Monte Carlo Methods J. C. Spall 25 September 2017 CHAPTER 2 RANDOM NUMBER GENERATION Motivation and criteria for generators Linear generators (e.g., linear congruential generators) Multiple
More informationIEOR 3106: Introduction to Operations Research: Stochastic Models. Professor Whitt. SOLUTIONS to Homework Assignment 2
IEOR 316: Introduction to Operations Research: Stochastic Models Professor Whitt SOLUTIONS to Homework Assignment 2 More Probability Review: In the Ross textbook, Introduction to Probability Models, read
More informationChapter 2. Some Basic Probability Concepts. 2.1 Experiments, Outcomes and Random Variables
Chapter 2 Some Basic Probability Concepts 2.1 Experiments, Outcomes and Random Variables A random variable is a variable whose value is unknown until it is observed. The value of a random variable results
More informationMath 1270 Honors ODE I Fall, 2008 Class notes # 14. x 0 = F (x; y) y 0 = G (x; y) u 0 = au + bv = cu + dv
Math 1270 Honors ODE I Fall, 2008 Class notes # 1 We have learned how to study nonlinear systems x 0 = F (x; y) y 0 = G (x; y) (1) by linearizing around equilibrium points. If (x 0 ; y 0 ) is an equilibrium
More informationRandom Number Generation. Stephen Booth David Henty
Random Number Generation Stephen Booth David Henty Introduction Random numbers are frequently used in many types of computer simulation Frequently as part of a sampling process: Generate a representative
More informationStatistical Thermodynamics and Monte-Carlo Evgenii B. Rudnyi and Jan G. Korvink IMTEK Albert Ludwig University Freiburg, Germany
Statistical Thermodynamics and Monte-Carlo Evgenii B. Rudnyi and Jan G. Korvink IMTEK Albert Ludwig University Freiburg, Germany Preliminaries Learning Goals From Micro to Macro Statistical Mechanics (Statistical
More information