Monte Carlo method II

Size: px
Start display at page:

Download "Monte Carlo method II"

Transcription

1 Course MP3 Lecture 5 14/11/2006 Monte Carlo method II How to put some real physcs nto the Monte Carlo method Dr James Ellott 5.1 Monte Carlo method revsted In lecture 4, we ntroduced the Monte Carlo (MC) method, whch s a probablstc smulaton technque for evolvng systems to thermodynamc equlbrum. We dscussed Metropols algorthm, n whch new states are accepted automatcally f ther energy s lower than prevous state, or wth Boltzmann probablty f ther energy s hgher. Metropols MC samples states accordng to ther thermal mportance naturally produces confguratons from the canoncal (NVT) thermodynamc ensemble. However, does not allow us to study stuatons n whch there are fluctuatons n partcle number or changes n total system volume. 1

2 5.2 MC n dfferent thermodynamc ensembles In ths lecture, we wll dscuss ways of usng MC to sample from dfferent thermodynamc ensembles, whch are dentfed by ther conserved quanttes. Isobarc-sothermal (NpT) Fxed number of partcles, pressure and temperature. E.g., a perfectly elastc balloon flled wth gas. Grand canoncal or Gbbs (µvt) Varable number of partcles, fxed volume and temperature. E.g., onc solutons n osmotc contact across a permeable membrane. 5.3 Free energy calculatons usng MC We wll see how MC can be used to calculate free energes usng thermodynamc ntegraton or smulatons n the grand canoncal ensemble. Free energes are dffcult to calculate by computer smulaton (and also n real experments!) because they nvolve entropy, and cannot smply be obtaned by averagng over functons of the phase space co-ordnates of the system (as can energy, temperature, etc.). Instead, they depend on the avalable volume of accessble phase space, and are called thermal quanttes (as opposed to mechancal quanttes). The calculaton of thermal quanttes s very mportant, as t allows us to study the phase behavour of a substance as a functon of temperature and pressure. 2

3 5.4 Confguratonal bas MC Fnally, we wll look at how to study stuatons n whch the acceptance rato of tral moves s very low. For example, a polymerc system where most moves are forbdden by the constrants of chan topology and excluded volume. These problems can be tackled by basng the generaton of tral conformatons so that the acceptance rate s greatly enhanced (even to such an extent that each move s guaranteed to be accepted). Ths s allowed (.e we wll stll produce a well-defned thermodynamc equlbrum state) provded the acceptance rule s modfed n such a way that the bas s removed. 5.5 Revson of Metropols MC Let s start by revsng the Metropols MC method. We recall that we start wth an ntal random confguraton, and apply perturbatons whch take us on a random walk through regons of phase space whch have an mportant contrbuton to the ensemble averages (recall the analogy of the Nle from lecture 4). The acceptance rules governng the transtons to new states are chosen such that these confguratons occur wth a frequency whch s proportonal to ther Boltzmann probablty. 1 p = Z ( ) exp βe 3

4 5.6 General approach for MC smulaton The procedure used for Metropols MC can be generalsed to sample confguratons from any thermodynamc ensemble by followng a general recpe: 1. Lst the conserved quanttes of the requred ensemble 2. Impose the condton of detaled balance: p σ P(σ ν) = p ν P(ν σ) where the lower case p are occupaton probabltes and the captal P are transton probabltes [Remember that each transton probablty can be decomposed nto the product of a selecton probablty and an acceptance probablty] 4. Determne probabltes of generatng a partcular confguraton 5. Derve condton whch needs to be fulflled by acceptance rules Isobarc-sothermal MC Let s now do an example and sample confguratons from the NpT ensemble. Not only are these the most common expermental condtons, but also constant NpT MC can be used to calculate the equaton of state for systems n whch the partcles nteract va arbtrary potental energy functons. They can also be used to smulate systems n the vcnty of a frst order phase transton. Ths s not possble wth standard NVT MC because the densty s constraned by the fnte sze of the smulaton box. Usng NpT MC, the system relaxes to the state of lowest Gbbs free energy. 4

5 5.7.2 Isobarc-sothermal MC A rgorous dervaton of the scheme for NpT MC can be found n Frenkel 5.4, but dea s to take the volume of the smulaton box V as an addtonal degree of freedom. So, as well as makng tral moves n the system confguraton, we also make tral moves n V that consst of addng or subtractng some small amount of volume. Note the shft n the c.o.m. of the partcle postons. V V ' = V + δ V δ = U[ 1,1] max Isobarc-sothermal MC The trck s to ntroduce the volume changng moves n such a way that the symmetry of the underlyng Markov chan s not dsturbed. We can do ths by choosng the acceptance probablty of a random volume changng move V V to be: H [ { β H} ] mn 1,exp = E N N V ' ( s, V ') E( s, V ) + p( V ' V ) Nk T ln V You can thnk of ths procedure as formng an equlbrum wth a macroscopc reservor at pressure p. B 5

6 5.7.4 Isobarc-sothermal MC The frequency wth whch tral moves n the volume should be attempted s much less than that of the sngle partcle moves, because they requre us to recompute all the ntermolecular nteractons. The general rule s to try one volume move every N partcle moves. However, to guarantee the symmetry of the underlyng Markov chan, ths move should be attempted wth probablty 1/N after every partcle move. Ths ensures that the system s mcroscopcally reversble, and generates a Boltzmann dstrbuton of states n the NpT ensemble. Some methods make moves n lnv rather than V. 5.8 Calculatng free energes Although NVT and NpT MC enable us to smulate realstc expermental condtons, they do not permt drect calculaton of thermal quanttes such as entropy or Gbbs free energy. Ths s precsely because the smulatons are so good at samplng only thermally mportant regons of phase space (as the thermal quanttes depend on the volume of phase space whch s accessble to the system). We can get around ths ether drectly, by calculatng absolute free energes n the full grand canoncal ensemble, or ndrectly, by calculatng free energy changes between dfferent equlbrum states. 6

7 5.9 Thermodynamc ntegraton An ndrect method whch s very smlar to the way n whch free energes are calculated n real experments. Lke our smulatons, these measure dervatves of the free energy such as pressure or energy: F p = V NT ( F ) β E = Frenkel 7.2 β Bnder 5.6 So, F between two states can be calculated by ntegratng the nternal energy along a reversble path n V and T. An example s calculatng free energy of a lqud usng an equaton of state and the deal gas as a reference state. VN Grand canoncal MC However, f we want to obtan absolute free energes drectly or we don t have a sutable reference state, then we can do MC n the grand canoncal or Gbbs ensemble. You mght thnk that ths would be µpt ensemble, but ths s not a vald thermodynamc ensemble because we must have at least one extensve conserved quantty or the model may evaporate or dverge wthout lmt. Actually, t s the µvt ensemble whch corresponds to the Gbbs dstrbuton (whch you derved n examples sheet 1). In µvt MC, there are three types of move: Partcle dsplacement Partcle creaton Partcle annhlaton 7

8 Grand canoncal MC Can thnk of the µvt MC as allowng the system to come to dffusve equlbrum wth a reservor of deal gas n whch the partcles do not nteract. Frenkel 5.6 Blue partcles n smulaton box nteract as normal, but transparent ones n the reservor can overlap. Both types carry the same chemcal potental µ. When a partcle moves from the reservor to the smulaton box, the only change n energy s that due to the nteracton potental. In practce, the partcle s nserted randomly nto the smulaton box Grand canoncal MC Partcle creatons are accepted wth probablty: V a( N N + 1) = mn 1, exp ) 3 λt ( N + 1) { β( µ E( N + 1) + E( N )} Partcle annhlatons are accepted wth probablty: 3 NλT a( N N 1) = mn 1, exp ) V { β( µ E( N 1) + E( N )} where λ T s the thermal wavelength (see lecture 2). The rato of creatons or annhlatons to dsplacement moves s roughly the same, as both nvolve a smlar amount of computatonal effort. Ensure reversblty! 8

9 Grand canoncal MC The free energy can then be calculated drectly from: F / N = µ p V / N The quanttes <p> and <N> are average values of pressure and number of partcles whch are measured from the smulaton over many dfferent confguratons. However, there are some techncal dffcultes wth carryng out µvt MC whch centre around the problem n creatng or annhlatng partcles n dense systems. There are varous methods to crcumvent ths problem whch nvolve the concept of confguratonal bas MC Confguratonal bas MC Frenkel Bnder 6.7 There are many stuatons n whch the acceptance probabltes of tral moves n MC smulatons drop to almost zero, resultng n a very neffcent smulaton. In these crcumstances, we would lke to bas the generaton of tral moves such that they stand a greater probablty of beng accepted. It turns out we can do ths wthout affectng the equlbrum dstrbuton provded we change our acceptance probabltes Remember that we are only concerned about the rato of our transton probabltes, so we are free to ntroduce an arbtrary basng factor wthout volatng detaled balance. 9

10 Confguratonal bas MC To llustrate how the procedure works, consder a selfavodng polymer chan on a lattce wth coordnaton k (e.g. k = 4 for a smple cubc lattce n 2D). 1. Insert frst atom at random on the lattce and compute ts energy 2. The next segment has k possble drectons, so select a partcular drecton (label t n) wth probablty p (n) = exp{ βe (n)}/ w ( ) w ( n) = exp{ βe (j)} p ( n) n 3. Repeat step 2 untl the entre chan of length l s generated, and compute the Rosenbluth factor W of the new confguraton: W ( n) = l = 1 w ( n) k j= Confguratonal bas MC To restore the symmetry of the Markov chan, we need to adjust our standard MC algorthm as follows: 1. Generate ntal confguraton usng the based scheme and compute ts Rosenbluth factor W 0 2. Generate a new confguraton usng the based scheme and compute ts Rosenbluth factor W(n) 3. Accept the tral move wth probablty: mn [ 1, W ( n) / W (0)] 4. Go back to step 2 and terate to equlbrum So, confguratons are selected accordng to ther Rosenbluth factor rather than ther energy. It s qute straghtforward to generalse ths method to off-lattce smulatons. 10

11 Confguratonal bas MC The confguratonal bas approach can be used to smulate entre macromolecules f an approprate force feld s used to compute the Rosenbluth factors. The pont s that we bas the generaton of tral conformatons towards states whch are favourable n energy (.e. are reasonably lkely to satsfy our force feld constrants) so that we don t spend all our tme generatng rdculously unphyscal chans. We then get rd of the effects of basng by adjustng our acceptance probabltes. Note that t s possble to make ths algorthm much more effcent, but the detals are beyond the scope of ths course Summary We started off by revewng Metropols MC. We then dscussed how to carry out MC smulatons n varous dfferent thermodynamcs ensembles other than the NVT. Of these, only the grand canoncal or µvt ensemble can be used to calculate free energes drectly. An alternatve s to calculate free energy dfferences usng thermodynamc ntegraton. Fnally, we outlned the Rosenbluth scheme for carryng out confguraton bas MC, whch enables us to deal wth smulatons where our states are hghly constraned. 11

Thermodynamics and statistical mechanics in materials modelling II

Thermodynamics and statistical mechanics in materials modelling II Course MP3 Lecture 8/11/006 (JAE) Course MP3 Lecture 8/11/006 Thermodynamcs and statstcal mechancs n materals modellng II A bref résumé of the physcal concepts used n materals modellng Dr James Ellott.1

More information

Introduction to Vapor/Liquid Equilibrium, part 2. Raoult s Law:

Introduction to Vapor/Liquid Equilibrium, part 2. Raoult s Law: CE304, Sprng 2004 Lecture 4 Introducton to Vapor/Lqud Equlbrum, part 2 Raoult s Law: The smplest model that allows us do VLE calculatons s obtaned when we assume that the vapor phase s an deal gas, and

More information

Statistical mechanics handout 4

Statistical mechanics handout 4 Statstcal mechancs handout 4 Explan dfference between phase space and an. Ensembles As dscussed n handout three atoms n any physcal system can adopt any one of a large number of mcorstates. For a quantum

More information

Supplementary Notes for Chapter 9 Mixture Thermodynamics

Supplementary Notes for Chapter 9 Mixture Thermodynamics Supplementary Notes for Chapter 9 Mxture Thermodynamcs Key ponts Nne major topcs of Chapter 9 are revewed below: 1. Notaton and operatonal equatons for mxtures 2. PVTN EOSs for mxtures 3. General effects

More information

Lecture 7: Boltzmann distribution & Thermodynamics of mixing

Lecture 7: Boltzmann distribution & Thermodynamics of mixing Prof. Tbbtt Lecture 7 etworks & Gels Lecture 7: Boltzmann dstrbuton & Thermodynamcs of mxng 1 Suggested readng Prof. Mark W. Tbbtt ETH Zürch 13 März 018 Molecular Drvng Forces Dll and Bromberg: Chapters

More information

MOLECULAR DYNAMICS ,..., What is it? 2 = i i

MOLECULAR DYNAMICS ,..., What is it? 2 = i i MOLECULAR DYNAMICS What s t? d d x t 2 m 2 = F ( x 1,..., x N ) =1,,N r ( x1 ( t),..., x ( t)) = v = ( x& 1 ( t ),..., x& ( t )) N N What are some uses of molecular smulatons and modelng? Conformatonal

More information

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng

More information

Markov Chain Monte Carlo Lecture 6

Markov Chain Monte Carlo Lecture 6 where (x 1,..., x N ) X N, N s called the populaton sze, f(x) f (x) for at least one {1, 2,..., N}, and those dfferent from f(x) are called the tral dstrbutons n terms of mportance samplng. Dfferent ways

More information

CE 530 Molecular Simulation

CE 530 Molecular Simulation CE 530 Molecular Smulaton Lecture 22 Chan-Molecule Samplng Technques Davd A. Kofke Department of Chemcal Engneerng SUNY Buffalo kofke@eng.buffalo.edu 2 Monte Carlo Samplng MC method permts great flexblty

More information

Lecture 4. Macrostates and Microstates (Ch. 2 )

Lecture 4. Macrostates and Microstates (Ch. 2 ) Lecture 4. Macrostates and Mcrostates (Ch. ) The past three lectures: we have learned about thermal energy, how t s stored at the mcroscopc level, and how t can be transferred from one system to another.

More information

STATISTICAL MECHANICAL ENSEMBLES 1 MICROSCOPIC AND MACROSCOPIC VARIABLES PHASE SPACE ENSEMBLES. CHE 524 A. Panagiotopoulos 1

STATISTICAL MECHANICAL ENSEMBLES 1 MICROSCOPIC AND MACROSCOPIC VARIABLES PHASE SPACE ENSEMBLES. CHE 524 A. Panagiotopoulos 1 CHE 54 A. Panagotopoulos STATSTCAL MECHACAL ESEMBLES MCROSCOPC AD MACROSCOPC ARABLES The central queston n Statstcal Mechancs can be phrased as follows: f partcles (atoms, molecules, electrons, nucle,

More information

Numerical Heat and Mass Transfer

Numerical Heat and Mass Transfer Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and

More information

STATISTICAL MECHANICS

STATISTICAL MECHANICS STATISTICAL MECHANICS Thermal Energy Recall that KE can always be separated nto 2 terms: KE system = 1 2 M 2 total v CM KE nternal Rgd-body rotaton and elastc / sound waves Use smplfyng assumptons KE of

More information

Temperature. Chapter Heat Engine

Temperature. Chapter Heat Engine Chapter 3 Temperature In prevous chapters of these notes we ntroduced the Prncple of Maxmum ntropy as a technque for estmatng probablty dstrbutons consstent wth constrants. In Chapter 9 we dscussed the

More information

Markov Chain Monte Carlo (MCMC), Gibbs Sampling, Metropolis Algorithms, and Simulated Annealing Bioinformatics Course Supplement

Markov Chain Monte Carlo (MCMC), Gibbs Sampling, Metropolis Algorithms, and Simulated Annealing Bioinformatics Course Supplement Markov Chan Monte Carlo MCMC, Gbbs Samplng, Metropols Algorthms, and Smulated Annealng 2001 Bonformatcs Course Supplement SNU Bontellgence Lab http://bsnuackr/ Outlne! Markov Chan Monte Carlo MCMC! Metropols-Hastngs

More information

Q e E i /k B. i i i i

Q e E i /k B. i i i i Water and Aqueous Solutons 3. Lattce Model of a Flud Lattce Models Lattce models provde a mnmalst, or coarse-graned, framework for descrbng the translatonal, rotatonal, and conformatonal degrees of freedom

More information

Open Systems: Chemical Potential and Partial Molar Quantities Chemical Potential

Open Systems: Chemical Potential and Partial Molar Quantities Chemical Potential Open Systems: Chemcal Potental and Partal Molar Quanttes Chemcal Potental For closed systems, we have derved the followng relatonshps: du = TdS pdv dh = TdS + Vdp da = SdT pdv dg = VdP SdT For open systems,

More information

University of Washington Department of Chemistry Chemistry 453 Winter Quarter 2015

University of Washington Department of Chemistry Chemistry 453 Winter Quarter 2015 Lecture 2. 1/07/15-1/09/15 Unversty of Washngton Department of Chemstry Chemstry 453 Wnter Quarter 2015 We are not talkng about truth. We are talkng about somethng that seems lke truth. The truth we want

More information

10.34 Fall 2015 Metropolis Monte Carlo Algorithm

10.34 Fall 2015 Metropolis Monte Carlo Algorithm 10.34 Fall 2015 Metropols Monte Carlo Algorthm The Metropols Monte Carlo method s very useful for calculatng manydmensonal ntegraton. For e.g. n statstcal mechancs n order to calculate the prospertes of

More information

Snce h( q^; q) = hq ~ and h( p^ ; p) = hp, one can wrte ~ h hq hp = hq ~hp ~ (7) the uncertanty relaton for an arbtrary state. The states that mnmze t

Snce h( q^; q) = hq ~ and h( p^ ; p) = hp, one can wrte ~ h hq hp = hq ~hp ~ (7) the uncertanty relaton for an arbtrary state. The states that mnmze t 8.5: Many-body phenomena n condensed matter and atomc physcs Last moded: September, 003 Lecture. Squeezed States In ths lecture we shall contnue the dscusson of coherent states, focusng on ther propertes

More information

Grand canonical Monte Carlo simulations of bulk electrolytes and calcium channels

Grand canonical Monte Carlo simulations of bulk electrolytes and calcium channels Grand canoncal Monte Carlo smulatons of bulk electrolytes and calcum channels Thess of Ph.D. dssertaton Prepared by: Attla Malascs M.Sc. n Chemstry Supervsor: Dr. Dezső Boda Unversty of Pannona Insttute

More information

10.40 Appendix Connection to Thermodynamics and Derivation of Boltzmann Distribution

10.40 Appendix Connection to Thermodynamics and Derivation of Boltzmann Distribution 10.40 Appendx Connecton to Thermodynamcs Dervaton of Boltzmann Dstrbuton Bernhardt L. Trout Outlne Cannoncal ensemble Maxmumtermmethod Most probable dstrbuton Ensembles contnued: Canoncal, Mcrocanoncal,

More information

Lecture 3: Boltzmann distribution

Lecture 3: Boltzmann distribution Lecture 3: Boltzmann dstrbuton Statstcal mechancs: concepts Ams: Dervaton of Boltzmann dstrbuton: Basc postulate of statstcal mechancs. All states equally lkely. Equal a-pror probablty: Statstcal vew of

More information

Second Order Analysis

Second Order Analysis Second Order Analyss In the prevous classes we looked at a method that determnes the load correspondng to a state of bfurcaton equlbrum of a perfect frame by egenvalye analyss The system was assumed to

More information

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number

More information

Why BP Works STAT 232B

Why BP Works STAT 232B Why BP Works STAT 232B Free Energes Helmholz & Gbbs Free Energes 1 Dstance between Probablstc Models - K-L dvergence b{ KL b{ p{ = b{ ln { } p{ Here, p{ s the eact ont prob. b{ s the appromaton, called

More information

( ) ( ) ( ) ( ) STOCHASTIC SIMULATION FOR BLOCKED DATA. Monte Carlo simulation Rejection sampling Importance sampling Markov chain Monte Carlo

( ) ( ) ( ) ( ) STOCHASTIC SIMULATION FOR BLOCKED DATA. Monte Carlo simulation Rejection sampling Importance sampling Markov chain Monte Carlo SOCHASIC SIMULAIO FOR BLOCKED DAA Stochastc System Analyss and Bayesan Model Updatng Monte Carlo smulaton Rejecton samplng Importance samplng Markov chan Monte Carlo Monte Carlo smulaton Introducton: If

More information

Introduction to Statistical Methods

Introduction to Statistical Methods Introducton to Statstcal Methods Physcs 4362, Lecture #3 hermodynamcs Classcal Statstcal Knetc heory Classcal hermodynamcs Macroscopc approach General propertes of the system Macroscopc varables 1 hermodynamc

More information

Solution Thermodynamics

Solution Thermodynamics Soluton hermodynamcs usng Wagner Notaton by Stanley. Howard Department of aterals and etallurgcal Engneerng South Dakota School of nes and echnology Rapd Cty, SD 57701 January 7, 001 Soluton hermodynamcs

More information

A Robust Method for Calculating the Correlation Coefficient

A Robust Method for Calculating the Correlation Coefficient A Robust Method for Calculatng the Correlaton Coeffcent E.B. Nven and C. V. Deutsch Relatonshps between prmary and secondary data are frequently quantfed usng the correlaton coeffcent; however, the tradtonal

More information

Lecture 14: Forces and Stresses

Lecture 14: Forces and Stresses The Nuts and Bolts of Frst-Prncples Smulaton Lecture 14: Forces and Stresses Durham, 6th-13th December 2001 CASTEP Developers Group wth support from the ESF ψ k Network Overvew of Lecture Why bother? Theoretcal

More information

Gaussian Mixture Models

Gaussian Mixture Models Lab Gaussan Mxture Models Lab Objectve: Understand the formulaton of Gaussan Mxture Models (GMMs) and how to estmate GMM parameters. You ve already seen GMMs as the observaton dstrbuton n certan contnuous

More information

Lecture 12: Discrete Laplacian

Lecture 12: Discrete Laplacian Lecture 12: Dscrete Laplacan Scrbe: Tanye Lu Our goal s to come up wth a dscrete verson of Laplacan operator for trangulated surfaces, so that we can use t n practce to solve related problems We are mostly

More information

Property calculation I

Property calculation I .0, 3.0, 0.333,.00 Introducton to Modelng and Smulaton Sprng 0 Part I Contnuum and partcle methods Property calculaton I Lecture 3 Markus J. Buehler Laboratory for Atomstc and Molecular Mechancs Department

More information

Physics 5153 Classical Mechanics. Principle of Virtual Work-1

Physics 5153 Classical Mechanics. Principle of Virtual Work-1 P. Guterrez 1 Introducton Physcs 5153 Classcal Mechancs Prncple of Vrtual Work The frst varatonal prncple we encounter n mechancs s the prncple of vrtual work. It establshes the equlbrum condton of a mechancal

More information

Physics 607 Exam 1. ( ) = 1, Γ( z +1) = zγ( z) x n e x2 dx = 1. e x2

Physics 607 Exam 1. ( ) = 1, Γ( z +1) = zγ( z) x n e x2 dx = 1. e x2 Physcs 607 Exam 1 Please be well-organzed, and show all sgnfcant steps clearly n all problems. You are graded on your wor, so please do not just wrte down answers wth no explanaton! Do all your wor on

More information

Lecture. Polymer Thermodynamics 0331 L Chemical Potential

Lecture. Polymer Thermodynamics 0331 L Chemical Potential Prof. Dr. rer. nat. habl. S. Enders Faculty III for Process Scence Insttute of Chemcal Engneerng Department of Thermodynamcs Lecture Polymer Thermodynamcs 033 L 337 3. Chemcal Potental Polymer Thermodynamcs

More information

x = , so that calculated

x = , so that calculated Stat 4, secton Sngle Factor ANOVA notes by Tm Plachowsk n chapter 8 we conducted hypothess tests n whch we compared a sngle sample s mean or proporton to some hypotheszed value Chapter 9 expanded ths to

More information

Rate of Absorption and Stimulated Emission

Rate of Absorption and Stimulated Emission MIT Department of Chemstry 5.74, Sprng 005: Introductory Quantum Mechancs II Instructor: Professor Andre Tokmakoff p. 81 Rate of Absorpton and Stmulated Emsson The rate of absorpton nduced by the feld

More information

where the sums are over the partcle labels. In general H = p2 2m + V s(r ) V j = V nt (jr, r j j) (5) where V s s the sngle-partcle potental and V nt

where the sums are over the partcle labels. In general H = p2 2m + V s(r ) V j = V nt (jr, r j j) (5) where V s s the sngle-partcle potental and V nt Physcs 543 Quantum Mechancs II Fall 998 Hartree-Fock and the Self-consstent Feld Varatonal Methods In the dscusson of statonary perturbaton theory, I mentoned brey the dea of varatonal approxmaton schemes.

More information

Chapter 13: Multiple Regression

Chapter 13: Multiple Regression Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to

More information

The Feynman path integral

The Feynman path integral The Feynman path ntegral Aprl 3, 205 Hesenberg and Schrödnger pctures The Schrödnger wave functon places the tme dependence of a physcal system n the state, ψ, t, where the state s a vector n Hlbert space

More information

NUMERICAL DIFFERENTIATION

NUMERICAL DIFFERENTIATION NUMERICAL DIFFERENTIATION 1 Introducton Dfferentaton s a method to compute the rate at whch a dependent output y changes wth respect to the change n the ndependent nput x. Ths rate of change s called the

More information

...Thermodynamics. If Clausius Clapeyron fails. l T (v 2 v 1 ) = 0/0 Second order phase transition ( S, v = 0)

...Thermodynamics. If Clausius Clapeyron fails. l T (v 2 v 1 ) = 0/0 Second order phase transition ( S, v = 0) If Clausus Clapeyron fals ( ) dp dt pb =...Thermodynamcs l T (v 2 v 1 ) = 0/0 Second order phase transton ( S, v = 0) ( ) dp = c P,1 c P,2 dt Tv(β 1 β 2 ) Two phases ntermngled Ferromagnet (Excess spn-up

More information

6. Stochastic processes (2)

6. Stochastic processes (2) Contents Markov processes Brth-death processes Lect6.ppt S-38.45 - Introducton to Teletraffc Theory Sprng 5 Markov process Consder a contnuous-tme and dscrete-state stochastc process X(t) wth state space

More information

Thermodynamics Second Law Entropy

Thermodynamics Second Law Entropy Thermodynamcs Second Law Entropy Lana Sherdan De Anza College May 8, 2018 Last tme the Boltzmann dstrbuton (dstrbuton of energes) the Maxwell-Boltzmann dstrbuton (dstrbuton of speeds) the Second Law of

More information

6. Stochastic processes (2)

6. Stochastic processes (2) 6. Stochastc processes () Lect6.ppt S-38.45 - Introducton to Teletraffc Theory Sprng 5 6. Stochastc processes () Contents Markov processes Brth-death processes 6. Stochastc processes () Markov process

More information

Limited Dependent Variables

Limited Dependent Variables Lmted Dependent Varables. What f the left-hand sde varable s not a contnuous thng spread from mnus nfnty to plus nfnty? That s, gven a model = f (, β, ε, where a. s bounded below at zero, such as wages

More information

Probabilistic Graphical Models

Probabilistic Graphical Models School of Computer Scence robablstc Graphcal Models Appromate Inference: Markov Chan Monte Carlo 05 07 Erc Xng Lecture 7 March 9 04 X X 075 05 05 03 X 3 Erc Xng @ CMU 005-04 Recap of Monte Carlo Monte

More information

Physics 181. Particle Systems

Physics 181. Particle Systems Physcs 181 Partcle Systems Overvew In these notes we dscuss the varables approprate to the descrpton of systems of partcles, ther defntons, ther relatons, and ther conservatons laws. We consder a system

More information

Note on EM-training of IBM-model 1

Note on EM-training of IBM-model 1 Note on EM-tranng of IBM-model INF58 Language Technologcal Applcatons, Fall The sldes on ths subject (nf58 6.pdf) ncludng the example seem nsuffcent to gve a good grasp of what s gong on. Hence here are

More information

Hidden Markov Models & The Multivariate Gaussian (10/26/04)

Hidden Markov Models & The Multivariate Gaussian (10/26/04) CS281A/Stat241A: Statstcal Learnng Theory Hdden Markov Models & The Multvarate Gaussan (10/26/04) Lecturer: Mchael I. Jordan Scrbes: Jonathan W. Hu 1 Hdden Markov Models As a bref revew, hdden Markov models

More information

= z 20 z n. (k 20) + 4 z k = 4

= z 20 z n. (k 20) + 4 z k = 4 Problem Set #7 solutons 7.2.. (a Fnd the coeffcent of z k n (z + z 5 + z 6 + z 7 + 5, k 20. We use the known seres expanson ( n+l ( z l l z n below: (z + z 5 + z 6 + z 7 + 5 (z 5 ( + z + z 2 + z + 5 5

More information

Uncertainty in measurements of power and energy on power networks

Uncertainty in measurements of power and energy on power networks Uncertanty n measurements of power and energy on power networks E. Manov, N. Kolev Department of Measurement and Instrumentaton, Techncal Unversty Sofa, bul. Klment Ohrdsk No8, bl., 000 Sofa, Bulgara Tel./fax:

More information

Feature Selection: Part 1

Feature Selection: Part 1 CSE 546: Machne Learnng Lecture 5 Feature Selecton: Part 1 Instructor: Sham Kakade 1 Regresson n the hgh dmensonal settng How do we learn when the number of features d s greater than the sample sze n?

More information

Density matrix. c α (t)φ α (q)

Density matrix. c α (t)φ α (q) Densty matrx Note: ths s supplementary materal. I strongly recommend that you read t for your own nterest. I beleve t wll help wth understandng the quantum ensembles, but t s not necessary to know t n

More information

A quote of the week (or camel of the week): There is no expedience to which a man will not go to avoid the labor of thinking. Thomas A.

A quote of the week (or camel of the week): There is no expedience to which a man will not go to avoid the labor of thinking. Thomas A. A quote of the week (or camel of the week): here s no expedence to whch a man wll not go to avod the labor of thnkng. homas A. Edson Hess law. Algorthm S Select a reacton, possbly contanng specfc compounds

More information

Lecture 10 Support Vector Machines II

Lecture 10 Support Vector Machines II Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed

More information

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have

More information

Osmotic pressure and protein binding

Osmotic pressure and protein binding Osmotc pressure and proten bndng Igor R. Kuznetsov, KochLab Symposum talk 5/15/09 Today we take a closer look at one of the soluton thermodynamcs key ponts from Steve s presentaton. Here t s: d[ln(k off

More information

Lecture Note 3. Eshelby s Inclusion II

Lecture Note 3. Eshelby s Inclusion II ME340B Elastcty of Mcroscopc Structures Stanford Unversty Wnter 004 Lecture Note 3. Eshelby s Incluson II Chrs Wenberger and We Ca c All rghts reserved January 6, 004 Contents 1 Incluson energy n an nfnte

More information

Integrals and Invariants of Euler-Lagrange Equations

Integrals and Invariants of Euler-Lagrange Equations Lecture 16 Integrals and Invarants of Euler-Lagrange Equatons ME 256 at the Indan Insttute of Scence, Bengaluru Varatonal Methods and Structural Optmzaton G. K. Ananthasuresh Professor, Mechancal Engneerng,

More information

Review of Classical Thermodynamics

Review of Classical Thermodynamics Revew of Classcal hermodynamcs Physcs 4362, Lecture #1, 2 Syllabus What s hermodynamcs? 1 [A law] s more mpressve the greater the smplcty of ts premses, the more dfferent are the knds of thngs t relates,

More information

Lecture 4. Instructor: Haipeng Luo

Lecture 4. Instructor: Haipeng Luo Lecture 4 Instructor: Hapeng Luo In the followng lectures, we focus on the expert problem and study more adaptve algorthms. Although Hedge s proven to be worst-case optmal, one may wonder how well t would

More information

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons

More information

Energy, Entropy, and Availability Balances Phase Equilibria. Nonideal Thermodynamic Property Models. Selecting an Appropriate Model

Energy, Entropy, and Availability Balances Phase Equilibria. Nonideal Thermodynamic Property Models. Selecting an Appropriate Model Lecture 4. Thermodynamcs [Ch. 2] Energy, Entropy, and Avalablty Balances Phase Equlbra - Fugactes and actvty coeffcents -K-values Nondeal Thermodynamc Property Models - P-v-T equaton-of-state models -

More information

Prof. Dr. I. Nasser Phys 630, T Aug-15 One_dimensional_Ising_Model

Prof. Dr. I. Nasser Phys 630, T Aug-15 One_dimensional_Ising_Model EXACT OE-DIMESIOAL ISIG MODEL The one-dmensonal Isng model conssts of a chan of spns, each spn nteractng only wth ts two nearest neghbors. The smple Isng problem n one dmenson can be solved drectly n several

More information

Gouy-Chapman model (1910) The double layer is not as compact as in Helmholtz rigid layer.

Gouy-Chapman model (1910) The double layer is not as compact as in Helmholtz rigid layer. CHE465/865, 6-3, Lecture 1, 7 nd Sep., 6 Gouy-Chapman model (191) The double layer s not as compact as n Helmholtz rgd layer. Consder thermal motons of ons: Tendency to ncrease the entropy and make the

More information

Problem Points Score Total 100

Problem Points Score Total 100 Physcs 450 Solutons of Sample Exam I Problem Ponts Score 1 8 15 3 17 4 0 5 0 Total 100 All wor must be shown n order to receve full credt. Wor must be legble and comprehensble wth answers clearly ndcated.

More information

Monte Carlo methods for magnetic systems

Monte Carlo methods for magnetic systems Monte Carlo methods for magnetc systems Zoltán Néda Babeş-Bolya Unversty Dept of Theoretcal and Computatonal Physcs Cluj-Napoca, Romana Man objectve of the lecture: To gve an ntroducton for basc Monte

More information

and Statistical Mechanics Material Properties

and Statistical Mechanics Material Properties Statstcal Mechancs and Materal Propertes By Kuno TAKAHASHI Tokyo Insttute of Technology, Tokyo 15-855, JAPA Phone/Fax +81-3-5734-3915 takahak@de.ttech.ac.jp http://www.de.ttech.ac.jp/~kt-lab/ Only for

More information

Convergence of random processes

Convergence of random processes DS-GA 12 Lecture notes 6 Fall 216 Convergence of random processes 1 Introducton In these notes we study convergence of dscrete random processes. Ths allows to characterze phenomena such as the law of large

More information

High resolution entropy stable scheme for shallow water equations

High resolution entropy stable scheme for shallow water equations Internatonal Symposum on Computers & Informatcs (ISCI 05) Hgh resoluton entropy stable scheme for shallow water equatons Xaohan Cheng,a, Yufeng Ne,b, Department of Appled Mathematcs, Northwestern Polytechncal

More information

Poisson brackets and canonical transformations

Poisson brackets and canonical transformations rof O B Wrght Mechancs Notes osson brackets and canoncal transformatons osson Brackets Consder an arbtrary functon f f ( qp t) df f f f q p q p t But q p p where ( qp ) pq q df f f f p q q p t In order

More information

Week 5: Neural Networks

Week 5: Neural Networks Week 5: Neural Networks Instructor: Sergey Levne Neural Networks Summary In the prevous lecture, we saw how we can construct neural networks by extendng logstc regresson. Neural networks consst of multple

More information

Problem Set 9 Solutions

Problem Set 9 Solutions Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem

More information

Electrical double layer: revisit based on boundary conditions

Electrical double layer: revisit based on boundary conditions Electrcal double layer: revst based on boundary condtons Jong U. Km Department of Electrcal and Computer Engneerng, Texas A&M Unversty College Staton, TX 77843-318, USA Abstract The electrcal double layer

More information

π e ax2 dx = x 2 e ax2 dx or x 3 e ax2 dx = 1 x 4 e ax2 dx = 3 π 8a 5/2 (a) We are considering the Maxwell velocity distribution function: 2πτ/m

π e ax2 dx = x 2 e ax2 dx or x 3 e ax2 dx = 1 x 4 e ax2 dx = 3 π 8a 5/2 (a) We are considering the Maxwell velocity distribution function: 2πτ/m Homework Solutons Problem In solvng ths problem, we wll need to calculate some moments of the Gaussan dstrbuton. The brute-force method s to ntegrate by parts but there s a nce trck. The followng ntegrals

More information

Physics 240: Worksheet 30 Name:

Physics 240: Worksheet 30 Name: (1) One mole of an deal monatomc gas doubles ts temperature and doubles ts volume. What s the change n entropy of the gas? () 1 kg of ce at 0 0 C melts to become water at 0 0 C. What s the change n entropy

More information

Stanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011

Stanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011 Stanford Unversty CS359G: Graph Parttonng and Expanders Handout 4 Luca Trevsan January 3, 0 Lecture 4 In whch we prove the dffcult drecton of Cheeger s nequalty. As n the past lectures, consder an undrected

More information

Lecture 3 Examples and Problems

Lecture 3 Examples and Problems Lecture 3 Examles and Problems Mechancs & thermodynamcs Equartton Frst Law of Thermodynamcs Ideal gases Isothermal and adabatc rocesses Readng: Elements Ch. 1-3 Lecture 3, 1 Wllam Thomson (1824 1907) a.k.a.

More information

NUMERICAL RESULTS QUALITY IN DEPENDENCE ON ABAQUS PLANE STRESS ELEMENTS TYPE IN BIG DISPLACEMENTS COMPRESSION TEST

NUMERICAL RESULTS QUALITY IN DEPENDENCE ON ABAQUS PLANE STRESS ELEMENTS TYPE IN BIG DISPLACEMENTS COMPRESSION TEST Appled Computer Scence, vol. 13, no. 4, pp. 56 64 do: 10.23743/acs-2017-29 Submtted: 2017-10-30 Revsed: 2017-11-15 Accepted: 2017-12-06 Abaqus Fnte Elements, Plane Stress, Orthotropc Materal Bartosz KAWECKI

More information

Lecture 2 Grand Canonical Ensemble GCE

Lecture 2 Grand Canonical Ensemble GCE Lecture 2 Grand Canoncal Ensemble GCE 2.1 hermodynamc Functons Contnung on from last day we also note that thus, dω = df dµ µd = Sd P dv dµ (2.1) P = V = S = From the expresson for the entropy, we therefore

More information

FREQUENCY DISTRIBUTIONS Page 1 of The idea of a frequency distribution for sets of observations will be introduced,

FREQUENCY DISTRIBUTIONS Page 1 of The idea of a frequency distribution for sets of observations will be introduced, FREQUENCY DISTRIBUTIONS Page 1 of 6 I. Introducton 1. The dea of a frequency dstrbuton for sets of observatons wll be ntroduced, together wth some of the mechancs for constructng dstrbutons of data. Then

More information

Lecture 20: Hypothesis testing

Lecture 20: Hypothesis testing Lecture : Hpothess testng Much of statstcs nvolves hpothess testng compare a new nterestng hpothess, H (the Alternatve hpothess to the borng, old, well-known case, H (the Null Hpothess or, decde whether

More information

Generalized Linear Methods

Generalized Linear Methods Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set

More information

Investigation of a New Monte Carlo Method for the Transitional Gas Flow

Investigation of a New Monte Carlo Method for the Transitional Gas Flow Investgaton of a New Monte Carlo Method for the Transtonal Gas Flow X. Luo and Chr. Day Karlsruhe Insttute of Technology(KIT) Insttute for Techncal Physcs 7602 Karlsruhe Germany Abstract. The Drect Smulaton

More information

ESCI 341 Atmospheric Thermodynamics Lesson 10 The Physical Meaning of Entropy

ESCI 341 Atmospheric Thermodynamics Lesson 10 The Physical Meaning of Entropy ESCI 341 Atmospherc Thermodynamcs Lesson 10 The Physcal Meanng of Entropy References: An Introducton to Statstcal Thermodynamcs, T.L. Hll An Introducton to Thermodynamcs and Thermostatstcs, H.B. Callen

More information

Self-organising Systems 2 Simulated Annealing and Boltzmann Machines

Self-organising Systems 2 Simulated Annealing and Boltzmann Machines Ams Reference Keywords Plan Self-organsng Systems Smulated Annealng and Boltzmann Machnes to obtan a mathematcal framework for stochastc machnes to study smulated annealng to study the Boltzmann machne

More information

Sampling Theory MODULE VII LECTURE - 23 VARYING PROBABILITY SAMPLING

Sampling Theory MODULE VII LECTURE - 23 VARYING PROBABILITY SAMPLING Samplng heory MODULE VII LECURE - 3 VARYIG PROBABILIY SAMPLIG DR. SHALABH DEPARME OF MAHEMAICS AD SAISICS IDIA ISIUE OF ECHOLOGY KAPUR he smple random samplng scheme provdes a random sample where every

More information

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography CSc 6974 and ECSE 6966 Math. Tech. for Vson, Graphcs and Robotcs Lecture 21, Aprl 17, 2006 Estmatng A Plane Homography Overvew We contnue wth a dscusson of the major ssues, usng estmaton of plane projectve

More information

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4) I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes

More information

CS 3750 Machine Learning Lecture 6. Monte Carlo methods. CS 3750 Advanced Machine Learning. Markov chain Monte Carlo

CS 3750 Machine Learning Lecture 6. Monte Carlo methods. CS 3750 Advanced Machine Learning. Markov chain Monte Carlo CS 3750 Machne Learnng Lectre 6 Monte Carlo methods Mlos Haskrecht mlos@cs.ptt.ed 5329 Sennott Sqare Markov chan Monte Carlo Importance samplng: samples are generated accordng to Q and every sample from

More information

Polynomial Regression Models

Polynomial Regression Models LINEAR REGRESSION ANALYSIS MODULE XII Lecture - 6 Polynomal Regresson Models Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Test of sgnfcance To test the sgnfcance

More information

For now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results.

For now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results. Neural Networks : Dervaton compled by Alvn Wan from Professor Jtendra Malk s lecture Ths type of computaton s called deep learnng and s the most popular method for many problems, such as computer vson

More information

Department of Statistics University of Toronto STA305H1S / 1004 HS Design and Analysis of Experiments Term Test - Winter Solution

Department of Statistics University of Toronto STA305H1S / 1004 HS Design and Analysis of Experiments Term Test - Winter Solution Department of Statstcs Unversty of Toronto STA35HS / HS Desgn and Analyss of Experments Term Test - Wnter - Soluton February, Last Name: Frst Name: Student Number: Instructons: Tme: hours. Ads: a non-programmable

More information

CIE4801 Transportation and spatial modelling Trip distribution

CIE4801 Transportation and spatial modelling Trip distribution CIE4801 ransportaton and spatal modellng rp dstrbuton Rob van Nes, ransport & Plannng 17/4/13 Delft Unversty of echnology Challenge the future Content What s t about hree methods Wth specal attenton for

More information

Computation of Higher Order Moments from Two Multinomial Overdispersion Likelihood Models

Computation of Higher Order Moments from Two Multinomial Overdispersion Likelihood Models Computaton of Hgher Order Moments from Two Multnomal Overdsperson Lkelhood Models BY J. T. NEWCOMER, N. K. NEERCHAL Department of Mathematcs and Statstcs, Unversty of Maryland, Baltmore County, Baltmore,

More information

Canonical transformations

Canonical transformations Canoncal transformatons November 23, 2014 Recall that we have defned a symplectc transformaton to be any lnear transformaton M A B leavng the symplectc form nvarant, Ω AB M A CM B DΩ CD Coordnate transformatons,

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information