Lecture#1 Path integral and Mote Carlo simulations
|
|
- Nelson Lewis
- 5 years ago
- Views:
Transcription
1 Lecture# Path ntegral and Mote Carlo smulatons Ken-Ich Ishkaa Hroshma Unv.
2 . Lattce Feld Theory? For eample: Standard Model QCD: Strong nteracton, Hadrons <= quarks, gluons Glasho-Wenberg-Salam: Electroeak QED: electromagnetc nteracton: charged partcles, photon Weak nteracton: Z,W bosons, leptons, Hggs mechansm These are based on Quantum feld theory QFT. Perturbatve analyss usng the couplng constant epanson. Rely on the smallness of the couplng. QCD: at lo-energy, couplng epanson fals. Non-preturbatve analyss s requred.
3 To understand the nature of the strong nteracton among Hadrons from the dynamcs of quarks and gluons, Quantum Chromodynamcs QCD has been ntroduced and nvestgated. QCD s ell under stood n the hgh-energy eperments here the asymptotc-free nature of the couplng constant of QCD enables us the perturbatve epanson analyss. Hoerver, at lo-energy, the perturbatve analyss fals due to the large couplng constant. 3
4 The lattce feld theory s one of the nonpreturbatve analyss method. Lattce QCD has been used and developed to understand the lo-energy nature of Hadrons. The varous technque for lattce feld theory s common and also has been used n LQCD. In ths lecture I ould lke to gve some lattce technque and numercal algorthms for LQCD as an eample of lattce feld theores. 4
5 . Path ntegral and lattce feld theory Feynman's path ntegral quantzaton s a fundamental bass for lattce feld theory. Eucldean feld s also requred to ntroduce ell defned numercally calculable path ntegral formulaton. Lattce QCD s based on SU3 gauge theory defned on a Eucldean 4Dm lattce unverse. 5
6 - Feynman s path ntegral quantzaton A quantum feld theory : S[] : Acton. : Feld to be quantzed real scalar for smplcty. : space-tme corrdnate. Feynman s path ntegral quantzaton. Generatng functonal for Green s functons correlaton func. N-pont Green s functon of the theory. T[ ˆ ˆ Z[ ] D ep S[ ] ˆ n ] n Z[0] Z[0] ep S[ ] We can etract varous nformaton from Green s functons bascally. n D n Z[ ] n n 0 6
7 Hoever, the analytc ntegraton of the path-ntegral s not alays avalable ecept for free feld theores. The ntegral also has a dffculty n Mnkosk metrc. The ntegral s a knd of Fresnel ntegrals and the ntegrant oscllates. Ths may prevents us to evaluate t numercally. In order to evaluate ths ntegral: Introduce Eucldean path ntegral Needs valdaton : Mnkosk Eucld relaton. Epermentally or constructve feld theory, Osteralder-Schrader aoms Dscretze Space-Tme => Lattce space-tme Needs valdaton: lattce spacng error Here e assume: there s a Eucldean feld theory for a target Mnkosk feld theory. 7
8 - Eucldean path ntegral S E [ E ] : Eucldean acton. E E : Eucldean feld. Real valued. E, y, z, : Eucldean 4D coordnate. They are usually obtaned from Mnkosk versons after Wck s rotaton. Generatng functonal for Eucldean Green s functons. Z E [ ] DE ep SE[ E ] E t If the Eucldean acton s real valued, the ntegral has a better property than the Mkosk verson. A chance to evaluate them by numercal ntegraton? The physcs nformaton can be obtaned from Eucldean Green s functons by nverse Wck s rotaton or nvestgatng the tau dependence., 0,0 E E Z [0] E ZE[ ], 0,0 0 Z [0] E D, 0,0ep p E p d E, E 0,0 e Ce E p :loest energy n ths channel ntermedate state. E E E S E [ ]/ E 8
9 -3 Eucldean path ntegral and lattce Path ntegral measure Integraton by feld shape confguraton D E D E Eucldean space tme, E, y, z, s contnuous. Dffcult to mantan DE for numercal evaluaton. Ths ll cause UV dvergences. The renormalzaton and regularzaton s requred. Introduce the lattce dscretzaton: As a regularzaton. As a ell defned ntegraton measure. Degree of Freedom DoF s stll fnte. IR regulator by lmtng system sze fnte volume. 9
10 Lattce a Lattce spacng an Z E a na Latt n Lattce regularzed path ntegral n [ ] DE ep SE[ E ] E D d n Latt n Latt Z Latt [ ] DLatt ep SLatt[ Latt] Multple ntegraton on the vector T Latt n, Latt n, Latt n3 n, n, n, n y, z Latt 4 0
11 Lattce regularzed path ntegral Z Latt [ ] DLatt ep SLatt[ Latt] Latt n, Ho to evaluate ths ntegral? Smlar to Canoncal partton functon n statstcal mechancs. 6666, dm , 536 Multple ntegraton on the vector T Dmenson of s very large. For real scalar on a 4D lattce th the sze If the eght ep s real and non-negatve, e can evaluate t usng Monte Carlo Methods. Note: Lattce acton should be desgned approprately. based on Symmetry, spectrum, relaton Mnkosk Eucld,.. When no real and non-negatve eght s derved, e encounter the sgn problem n the Monte Carlo method. E. System n fnte densty. Latt n n, n, n, n Z d ep S y Latt n, Latt n3 z 4,
12 -4 Integraton usng Monte Carlo Monte Carlo Methods. E. Integraton th a sngle varable. I f b f d a 0, and real valued. f Rectangular ntegraton a b I lm N f b, a / N a f b
13 Random samplng Pck up a number from the nterval [ a, b] randomly. Evaluate functon as f f. 3 Repeat - tmes, then e get samples f, f,, f N. We can estmate the ntegral as N I b a N The random number sequence,,, N has a unform dstrbuton n [a,b]. Ths means that the random varable has the follong probablty densty: Const [ a, b] P 0 [ a, b] Thus the statstcal averagng for f f means lm N N N f N f f P d / P d Denomnator s for the probablty normalzaton. 3
14 A defect and neffcent property of the smple rectangular and random samplng ntegraton. If the target functon f has a keen peak th narro dth W, The ntegraton may fal untl a b / N W s satsfed. One sample n the peak. Most of samples are unmportant. sample rato = /N. f a b W In mult dmensonal ntegratons, the stuaton becomes more orse. D-dmenson D I f d a b / N W for - th drecton TotalSample D Number N N D Only one sample s n the peak. Rato = /N D <<. 4
15 Importance Samplng Monte Carlo As seen before unform samplng s not effectve f the ntegrant has keen peaks. Eucldean Path-ntegral s a knd of huge-mult dmensonal ntegraton. The ntegral has narro peaks n general, and the hghest peak corresponds to the classcal soluton of the system. [0] Latt Latt Latt Latt y DLatt Latt Latt yep ZLatt In the classcal lmt h->0, the domnant contrbuton to the ntegral comes from: A soluton * Latt hch gves the hghest peak of Ths corresponds to the statonary or mnmum soluton of acton: SLatt [ * Latt ] 0 for any varaton. We kno that the classcal soluton gves a narro peak for ep-s * Latt S [ :classcal soluton. ] S [ ep Latt Latt * ]. Unform samplng for φ s not effectve to evaluate path ntegrals. 5
16 Importance Samplng Monte Carlo cont d To ntegrate ths functon f: If e can generate a sequence / ensemble {} so that the statstcal hstogram/dstrbuton of {} s. We have The error behaves as /SqrtN The error s mnmzed hen f=. The error behaves as /SqrtN even for the mult-dmensonal ntegratons. 6 valued. and real 0, f d f I b a f a b averagng. :statstcal lm }: { Dstrbuton of },,,, { 3 f f N d f d f I N N b a b a N / / / N O f N f f f d f I b a
17 Importance samplng for Eucldean pathntegrals. For the to-pont correlaton functon: Generate a sequence/ensemble: d ep S Z0,, So that the sample has the dstrbton : The to-pont correlaton functon can be estmated as: The error behaves as /SqrtN. Note: the dmenson of the ntegral/ s, 3, N C ep S N N k Lattce stes 6 Ho to generate such an ensemble? k 4 k for e. 7
18 Markov Chan Monte Carlo MCMC general descrpton A smple random samplng generaton s not effectve as seen before. A non-random generaton s requred. MCMC Set up. There est : random varable 3 t,,,, : t-stepsequence generated. MCMC adds a ne sample to the sequence as t Generate th a probablty dstrbuton P t t Then add the ne sample to the sequence. 3 t t,,,,, : t stepsequence generated. Where P : Transton probablty t t t t. n MCMC. 8
19 Markov Chan Monte Carlo MCMC cont d Ho to generate the desred dstrbuton from the transton P? Perron-Frobenus theorem. Pφ φ transton probablty can be treated as a matr element hch nde takes a value of state number. state : - th state, P ' P : : transton probablty from - th stateto - th state. The matr P satsfes P s called a postve matr. Perron-Frobenus theorem: P, Any postve real matr has a unque and largest egenvalue th =, and assocated egenvector th postve components. P 0, P, 0 Real postve Probablty. Probablty conservaton. 9
20 Markov Chan Monte Carlo MCMC cont d Usng Perron-Frobenus theorem, e have For a gven ntal state: v 0 : f ntal dstrbuton. thesystems n - th state, v k-step MCMC corresponds to v v 0 k 0 The Perron-Frobenus theorem says that lm v k k Pv P k lm k v, v 0 P k v 0 Pv,, and other componentsare zero. k The convergence to the fed dstrbuton s usually eponental. After many MCMC step the dstrbuton s almost dentcal to the mamum egen vector. If s has the desred dstrbuton e can generate the desred sequence.,, v k here P Pv. 0
21 Markov Chan Monte Carlo MCMC cont d Generate ntal state. If the system s n the -th state, generate -th state th the probablty P 3 Add the ne state to the ensemble. 4 Goto Where e assumed that the state s dscrete and countable, P s a postve matr. Etenson to Non-negatve matres, and contnuum state s also possble. The property that the estence of a unque real mamam egenvalue and postve egenvector of the theorem stll holds, but some specal propertes are requred on P. Here I omt the detals of the etenson. rreducble, No the problem to the path-ntegral s Ho to construct P ' so that the mamum egen vector s C ep S?
22 -5 Detaled Balance Condton Ho to construct Transton probablty P ' to make a desred dstrbuton C ep S? One suffcent condton s the so called detaled balance condton. Recallng that the fed pont dstrbuton s a egenvector of the transton probablty th real unt egenvalue. Egen equaton for transton probablty matr P P or P d ' P ' ' The detaled balance condton requres P P or P ' ' for dscrete statespace for contnuous statespace P ' Problem- Ths s a suffcent condton for egenvector th unt evenvalue. In ths case, P s a reversble Markov chan s a smultaneous left and rght evec.
23 Some MCMC eamples that satsfes the detaled balance condton. Metropols-Hastngs algorthm Metropols et al. 953, Hastngs 970 step 0 Gven ntal setp Generate a step 3 t t, t state step Take net state candtate state t t goto step. 0 as, t 0 th probablty th probablty th probablty t t q t. Where mn, and q q 3
24 Ths algorthm s equvalent to the follong transton probablty P q r mn, Ths transton probablty matr satsfes the detaled balance condton. A More concrete eample for Metropols algorthm. Isng model th spns.,, r kq k k Problem- Z S ep S, 4
25 Isng model th spns. S Z To compute the spn average and spn correlaton Z0 Z0,, We generate the ensemble 0, N,,, th the dstrbuton ep ep Then e can estmate the squared spn average by, ep S ep S Z0 S 0 S tanh N N, N N 5
26 Dstrbuton/ Populaton/ Weght= We have only 4 states. State #, State # 3, State #, State # 4, The eghtprobablty s calculable C s the normalzaton const = Z0 # C ep #3 C ep, # C ep, #4 C ep # # #3 #4 State space We can generate ths dstrbuton th the Metropols Algorthm 6
27 Metropols algorthm for the Isng model th -spns. t step 0 Randomly choose ntal state, t 0 setp Generate a candtate state s th probablty q t / 4 t step Computethe eght mn, ep S s S Step 3 Generate a random real number U from [0,. t step 4 Take net state as t s hen U Accept t otherse Reect step 5 t t, goto step for desred sample numbers. Then e obtan ensemble:,,, 0, Correspondng Fortran Program: [ N Metropols test Metropols accept/reect step 7
28 Correspondng Fortran Program Metropols test Canddate generaton 8
29 Results Weght hstogram Beta dependence of Weght Z ep # # ep ep ep ep / 4 / Cosh ep / 4 / Cosh 4Cosh 9
30 Results Spn average ensemble hstory Frst 500 samples are plotted. Random alkng n the state space 4states Spn average can take one of the values -,0, spn average=0 can occur for state # and #4. spn average=+ occurs for state #. spn average=- occurs for state #3. As ncreasng beta, the state stays at state # or #4. spn average = 0 states. 30
31 Results Spn correlaton ensemble hstory Frst 500 samples are plotted. Random alkng n the state space 4states Spn corr. can take + or -. spn corr.=+ can occur for state # and #3. spn corr= - occurs for state # and #4. At small beta populaton of + and - s almost same. As ncreasng beta, state th spn corr.=- domnates. state # and #4 3
32 Results Spn average epectaton value Averagng the hstory data e obtan zero. Ths s consstent th the theoretcal one. N N 0 3
33 Results Spn correraton epectaton value Averagng the hstory data e obtan TanhBeta. Ths s consstent th the theoretcal one. e e e e 4Cosh Tanh N N 33
34 Dffcultes n Nave Metropols Algorthm As seen before the ne canddate stateconfguraton s really added hen the Metropols test accept. In Statstcal Mechancs Canoncal ensemble, the eponent of the eght s the energy of the target system. The acceptance rato s governed by the Energy dfference S S[ Canddate State] S[Prevous State] mn, ep S[Canddate State] S[Prevous State] mn,ep S When s negatve, Metropols test alays accept the canddate. S S When s postve, the acceptance probablty decreases as ep S. When the target system has a huge number of d.o.f., the random samplng method to generate the canddate state almost alays large postve number for S. Ths s typcal n statstcal mechancs and huge multple dmenson ntegraton. Canddate generaton method th small energy dfference s mportant. See also D-Isng model. Heat-bath Gbbs sampler algorthm 34
35 Most of MCMC algorthms make use of the Metropols algorthm and ts etenson. For LQCD, the system has contnuous varables states. Naïve Metropols algorthm may fal due to the large energy dfferece. Hybrd Monte Carlo HMC algorthm Scalatar, Scalapno, Sugar, PRB34986; Duane, Kennedy Pendleton, Roeth, PL95B987 Ths algorthm s useful hen the varables are contnuous. Ths s an etenson of the Metropols algorthm th better canddate generaton. The HMC algorthm s a de fact standard algorthm for LQCD th dynamcal quarks. In the net lecture I ll descrbe the detals of the HMC algorthm. 35
36 Problems All programs are NO WARRANTY. Check that the detaled balance condton s a suffcent condton of the egenvector statonary dstrbuton of the transton matr. [page ] Check that the transton matr for the Metropols algorthm satsfes the detaled balance condton. [page 4]. 3 Complete the transton matr for the Isng model th -spns n a 44 matr form and Check the egenvector. [page 4-33] 4 Get and comple the Isng model th -spns program. Check the result numercally. [page 4-33] ths needs gfortran and gnuplot on Lnu 5 Evaluate the averaged acceptance rate of the Metropols test hen the energy dfference s a random varable from the Gaussan dstrbuton th mean= and varance=. [Hnt: Complementary error functon] S p S ep [Advanced] Consder a N-stes D Isng model th perodc boundary condton. P P P P P 3 4 P P P P 3 4 P P P P P P P P
37 Backup -ste Scalar model For a contnuous state model. I sho the -ste scalar model. a toy model for lattce scalar feld theores 37 s s s s s ds Z ep ep 0 0 ep 0 s s s s s s ds Z s s s s s s s s ds Z s s s s
38 Metropols algorthm t step 0 ntal state s, t 0 from Gaussan Dstrbuton N[0, var] t setp Generate a candtate state s from Gaussan Dstrbuton N[ s, var] t t s s Ths corresponds to q s s ep var var t step Computethe eght mn, ep S s S s Step 3 Generate a random real number U from [0,. t step 4 Take net state s as t s hen U Accept s t s otherse Reect step 5 t t, goto step for desred sample numbers.. We do not have a fnte dstrbuton at beta= th ths model. s We can not use unform samplng for canddate generaton because. 38
39 Fortran program: [ 0,000,000 samples are generated. But e save 0,000 samples th nterval 00. We use var= for canddate generaton. State eght/hstogram generated va Metropols algorthm Measured Theoretcal 39
40 State eght/hstogram generated va Metropols algorthm 40
41 State eght/hstogram generated va Metropols algorthm 4
42 State eght/hstogram generated va Metropols algorthm 4
43 State eght/hstogram generated va Metropols algorthm 43
44 Spn average and Spn correlaton hstory generated va Metropols algorthm Spn average Spn correlaton 44
45 Beta dependence of Spn average and Spn corr. Spn average Spn correlaton All programs are NO WARRANTY. 45
46 Metropols algorthm transton probablty for P s s' s, s' q s s' r s' s s' s, s' mn, ep ' r s ds s, s' q s s Delta functon S s S s', q s s' s' ep var s s ' s s' var 46
47 mn, and q q P P Problem ansers P f P log mn, f f because P f f f f f f f f f f P Smlarly P P 47
48 3 I sho beta>0 case only. Egenpars Thus MCMC converges to the desred dstrbuton for th e y y y y y y y P. th, y y y. th 0 0, 0 0 y 0 th, 3 3 Desred dstrbuton lm P N v N The convergence rate s governed by the dfference beteen and net largest egenvalue.
49 5 complementary error functons: erf erfc erf 0 e Averagng acceptance probablty: t dt e t dt error functon. complementary error functon. P acc S S 4 S mn, e e erfc 4 49
50 Hstory 03/0/3: Metropols test probablty s corrected. mn, and q q Wrong mn, and q q Rght 50
Markov Chain Monte Carlo (MCMC), Gibbs Sampling, Metropolis Algorithms, and Simulated Annealing Bioinformatics Course Supplement
Markov Chan Monte Carlo MCMC, Gbbs Samplng, Metropols Algorthms, and Smulated Annealng 2001 Bonformatcs Course Supplement SNU Bontellgence Lab http://bsnuackr/ Outlne! Markov Chan Monte Carlo MCMC! Metropols-Hastngs
More informationInductance Calculation for Conductors of Arbitrary Shape
CRYO/02/028 Aprl 5, 2002 Inductance Calculaton for Conductors of Arbtrary Shape L. Bottura Dstrbuton: Internal Summary In ths note we descrbe a method for the numercal calculaton of nductances among conductors
More informationMonte Carlo methods for magnetic systems
Monte Carlo methods for magnetc systems Zoltán Néda Babeş-Bolya Unversty Dept of Theoretcal and Computatonal Physcs Cluj-Napoca, Romana Man objectve of the lecture: To gve an ntroducton for basc Monte
More informationb ), which stands for uniform distribution on the interval a x< b. = 0 elsewhere
Fall Analyss of Epermental Measurements B. Esensten/rev. S. Errede Some mportant probablty dstrbutons: Unform Bnomal Posson Gaussan/ormal The Unform dstrbuton s often called U( a, b ), hch stands for unform
More informationModule 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur
Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:
More information( ) ( ) ( ) ( ) STOCHASTIC SIMULATION FOR BLOCKED DATA. Monte Carlo simulation Rejection sampling Importance sampling Markov chain Monte Carlo
SOCHASIC SIMULAIO FOR BLOCKED DAA Stochastc System Analyss and Bayesan Model Updatng Monte Carlo smulaton Rejecton samplng Importance samplng Markov chan Monte Carlo Monte Carlo smulaton Introducton: If
More informationThe Feynman path integral
The Feynman path ntegral Aprl 3, 205 Hesenberg and Schrödnger pctures The Schrödnger wave functon places the tme dependence of a physcal system n the state, ψ, t, where the state s a vector n Hlbert space
More informationCS 3750 Machine Learning Lecture 6. Monte Carlo methods. CS 3750 Advanced Machine Learning. Markov chain Monte Carlo
CS 3750 Machne Learnng Lectre 6 Monte Carlo methods Mlos Haskrecht mlos@cs.ptt.ed 5329 Sennott Sqare Markov chan Monte Carlo Importance samplng: samples are generated accordng to Q and every sample from
More informationProbabilistic Graphical Models
School of Computer Scence robablstc Graphcal Models Appromate Inference: Markov Chan Monte Carlo 05 07 Erc Xng Lecture 7 March 9 04 X X 075 05 05 03 X 3 Erc Xng @ CMU 005-04 Recap of Monte Carlo Monte
More informationStatistical analysis using matlab. HY 439 Presented by: George Fortetsanakis
Statstcal analyss usng matlab HY 439 Presented by: George Fortetsanaks Roadmap Probablty dstrbutons Statstcal estmaton Fttng data to probablty dstrbutons Contnuous dstrbutons Contnuous random varable X
More informationChapter 2 Transformations and Expectations. , and define f
Revew for the prevous lecture Defnton: support set of a ranom varable, the monotone functon; Theorem: How to obtan a cf, pf (or pmf) of functons of a ranom varable; Eamples: several eamples Chapter Transformatons
More informationRate of Absorption and Stimulated Emission
MIT Department of Chemstry 5.74, Sprng 005: Introductory Quantum Mechancs II Instructor: Professor Andre Tokmakoff p. 81 Rate of Absorpton and Stmulated Emsson The rate of absorpton nduced by the feld
More informationMechanics Physics 151
Mechancs Physcs 5 Lecture 7 Specal Relatvty (Chapter 7) What We Dd Last Tme Worked on relatvstc knematcs Essental tool for epermental physcs Basc technques are easy: Defne all 4 vectors Calculate c-o-m
More informationProbability Theory. The nth coefficient of the Taylor series of f(k), expanded around k = 0, gives the nth moment of x as ( ik) n n!
8333: Statstcal Mechancs I Problem Set # 3 Solutons Fall 3 Characterstc Functons: Probablty Theory The characterstc functon s defned by fk ep k = ep kpd The nth coeffcent of the Taylor seres of fk epanded
More informationHopfield Training Rules 1 N
Hopfeld Tranng Rules To memorse a sngle pattern Suppose e set the eghts thus - = p p here, s the eght beteen nodes & s the number of nodes n the netor p s the value requred for the -th node What ll the
More informationNumerical Heat and Mass Transfer
Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and
More informationPhysics 181. Particle Systems
Physcs 181 Partcle Systems Overvew In these notes we dscuss the varables approprate to the descrpton of systems of partcles, ther defntons, ther relatons, and ther conservatons laws. We consder a system
More informationWORM ALGORITHM. Nikolay Prokofiev, Umass, Amherst. Boris Svistunov, Umass, Amherst Igor Tupitsyn, PITP, Vancouver
WOR ALGORTH Nkolay Prokofev, Umass, Amherst asha ra Bors Svstunov, Umass, Amherst gor Tuptsyn, PTP, Vancouver assmo Bonnsegn, UAlerta, Edmonton Los Angeles, January 23, 2006 Why other wth algorthms? Effcency
More informationCE 530 Molecular Simulation
CE 530 Molecular Smulaton Lecture 22 Chan-Molecule Samplng Technques Davd A. Kofke Department of Chemcal Engneerng SUNY Buffalo kofke@eng.buffalo.edu 2 Monte Carlo Samplng MC method permts great flexblty
More informationU.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017
U.C. Berkeley CS94: Beyond Worst-Case Analyss Handout 4s Luca Trevsan September 5, 07 Summary of Lecture 4 In whch we ntroduce semdefnte programmng and apply t to Max Cut. Semdefnte Programmng Recall that
More informationHidden Markov Models & The Multivariate Gaussian (10/26/04)
CS281A/Stat241A: Statstcal Learnng Theory Hdden Markov Models & The Multvarate Gaussan (10/26/04) Lecturer: Mchael I. Jordan Scrbes: Jonathan W. Hu 1 Hdden Markov Models As a bref revew, hdden Markov models
More informationConvergence of random processes
DS-GA 12 Lecture notes 6 Fall 216 Convergence of random processes 1 Introducton In these notes we study convergence of dscrete random processes. Ths allows to characterze phenomena such as the law of large
More informationParametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010
Parametrc fractonal mputaton for mssng data analyss Jae Kwang Km Survey Workng Group Semnar March 29, 2010 1 Outlne Introducton Proposed method Fractonal mputaton Approxmaton Varance estmaton Multple mputaton
More informationConjugacy and the Exponential Family
CS281B/Stat241B: Advanced Topcs n Learnng & Decson Makng Conjugacy and the Exponental Famly Lecturer: Mchael I. Jordan Scrbes: Bran Mlch 1 Conjugacy In the prevous lecture, we saw conjugate prors for the
More informationPattern Classification
Pattern Classfcaton All materals n these sldes ere taken from Pattern Classfcaton (nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John Wley & Sons, 000 th the permsson of the authors and the publsher
More informationIRO0140 Advanced space time-frequency signal processing
IRO4 Advanced space tme-frequency sgnal processng Lecture Toomas Ruuben Takng nto account propertes of the sgnals, we can group these as followng: Regular and random sgnals (are all sgnal parameters determned
More informationRobert Eisberg Second edition CH 09 Multielectron atoms ground states and x-ray excitations
Quantum Physcs 量 理 Robert Esberg Second edton CH 09 Multelectron atoms ground states and x-ray exctatons 9-01 By gong through the procedure ndcated n the text, develop the tme-ndependent Schroednger equaton
More informationDistributions /06. G.Serazzi 05/06 Dimensionamento degli Impianti Informatici distrib - 1
Dstrbutons 8/03/06 /06 G.Serazz 05/06 Dmensonamento degl Impant Informatc dstrb - outlne densty, dstrbuton, moments unform dstrbuton Posson process, eponental dstrbuton Pareto functon densty and dstrbuton
More informationAdvanced Quantum Mechanics
Advanced Quantum Mechancs Rajdeep Sensarma! sensarma@theory.tfr.res.n ecture #9 QM of Relatvstc Partcles Recap of ast Class Scalar Felds and orentz nvarant actons Complex Scalar Feld and Charge conjugaton
More informationProbability Theory (revisited)
Probablty Theory (revsted) Summary Probablty v.s. plausblty Random varables Smulaton of Random Experments Challenge The alarm of a shop rang. Soon afterwards, a man was seen runnng n the street, persecuted
More informationComposite Hypotheses testing
Composte ypotheses testng In many hypothess testng problems there are many possble dstrbutons that can occur under each of the hypotheses. The output of the source s a set of parameters (ponts n a parameter
More informationMarkov Chain Monte Carlo Lecture 6
where (x 1,..., x N ) X N, N s called the populaton sze, f(x) f (x) for at least one {1, 2,..., N}, and those dfferent from f(x) are called the tral dstrbutons n terms of mportance samplng. Dfferent ways
More informationπ e ax2 dx = x 2 e ax2 dx or x 3 e ax2 dx = 1 x 4 e ax2 dx = 3 π 8a 5/2 (a) We are considering the Maxwell velocity distribution function: 2πτ/m
Homework Solutons Problem In solvng ths problem, we wll need to calculate some moments of the Gaussan dstrbuton. The brute-force method s to ntegrate by parts but there s a nce trck. The followng ntegrals
More information1 GSW Iterative Techniques for y = Ax
1 for y = A I m gong to cheat here. here are a lot of teratve technques that can be used to solve the general case of a set of smultaneous equatons (wrtten n the matr form as y = A), but ths chapter sn
More informationWORM ALGORITHM NASA. ISSP, August Nikolay Prokofiev, Umass, Amherst. Boris Svistunov, Umass, Amherst Igor Tupitsyn, PITP, Vancouver
WOR ALGORITH asha kolay Prokofev, Umass, Amherst Ira Bors Svstunov, Umass, Amherst Igor Tuptsyn, PITP, Vancouver Vladmr Kashurnkov, EPI, oscow assmo Bonnsegn, UAlberta, Edmonton Evgen Burovsk, Umass, Amherst
More informationProf. Dr. I. Nasser Phys 630, T Aug-15 One_dimensional_Ising_Model
EXACT OE-DIMESIOAL ISIG MODEL The one-dmensonal Isng model conssts of a chan of spns, each spn nteractng only wth ts two nearest neghbors. The smple Isng problem n one dmenson can be solved drectly n several
More informationWhy Monte Carlo Integration? Introduction to Monte Carlo Method. Continuous Probability. Continuous Probability
Introducton to Monte Carlo Method Kad Bouatouch IRISA Emal: kad@rsa.fr Wh Monte Carlo Integraton? To generate realstc lookng mages, we need to solve ntegrals of or hgher dmenson Pel flterng and lens smulaton
More informationChapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise.
Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where y + = β + β e for =,..., y and are observable varables e s a random error How can an estmaton rule be constructed for the
More information10.34 Fall 2015 Metropolis Monte Carlo Algorithm
10.34 Fall 2015 Metropols Monte Carlo Algorthm The Metropols Monte Carlo method s very useful for calculatng manydmensonal ntegraton. For e.g. n statstcal mechancs n order to calculate the prospertes of
More informationQuantifying Uncertainty
Partcle Flters Quantfyng Uncertanty Sa Ravela M. I. T Last Updated: Sprng 2013 1 Quantfyng Uncertanty Partcle Flters Partcle Flters Appled to Sequental flterng problems Can also be appled to smoothng problems
More information12. The Hamilton-Jacobi Equation Michael Fowler
1. The Hamlton-Jacob Equaton Mchael Fowler Back to Confguraton Space We ve establshed that the acton, regarded as a functon of ts coordnate endponts and tme, satsfes ( ) ( ) S q, t / t+ H qpt,, = 0, and
More informationA Tutorial on Data Reduction. Linear Discriminant Analysis (LDA) Shireen Elhabian and Aly A. Farag. University of Louisville, CVIP Lab September 2009
A utoral on Data Reducton Lnear Dscrmnant Analss (LDA) hreen Elhaban and Al A Farag Unverst of Lousvlle, CVIP Lab eptember 009 Outlne LDA objectve Recall PCA No LDA LDA o Classes Counter eample LDA C Classes
More informationTHEOREMS OF QUANTUM MECHANICS
THEOREMS OF QUANTUM MECHANICS In order to develop methods to treat many-electron systems (atoms & molecules), many of the theorems of quantum mechancs are useful. Useful Notaton The matrx element A mn
More informationAppendix B. The Finite Difference Scheme
140 APPENDIXES Appendx B. The Fnte Dfference Scheme In ths appendx we present numercal technques whch are used to approxmate solutons of system 3.1 3.3. A comprehensve treatment of theoretcal and mplementaton
More informationChapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems
Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons
More informationGoogle PageRank with Stochastic Matrix
Google PageRank wth Stochastc Matrx Md. Sharq, Puranjt Sanyal, Samk Mtra (M.Sc. Applcatons of Mathematcs) Dscrete Tme Markov Chan Let S be a countable set (usually S s a subset of Z or Z d or R or R d
More informationThe Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction
ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also
More informationSimulation and Random Number Generation
Smulaton and Random Number Generaton Summary Dscrete Tme vs Dscrete Event Smulaton Random number generaton Generatng a random sequence Generatng random varates from a Unform dstrbuton Testng the qualty
More information3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X
Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number
More informationDuality in linear programming
MPRA Munch Personal RePEc Archve Dualty n lnear programmng Mhaela Albc and Dela Teselos and Raluca Prundeanu and Ionela Popa Unversty Constantn Brancoveanu Ramncu Valcea 7 January 00 Onlne at http://mpraubun-muenchende/986/
More informationprinceton univ. F 13 cos 521: Advanced Algorithm Design Lecture 3: Large deviations bounds and applications Lecturer: Sanjeev Arora
prnceton unv. F 13 cos 521: Advanced Algorthm Desgn Lecture 3: Large devatons bounds and applcatons Lecturer: Sanjeev Arora Scrbe: Today s topc s devaton bounds: what s the probablty that a random varable
More informationLinear Approximation with Regularization and Moving Least Squares
Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...
More informationChapter 13: Multiple Regression
Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to
More informatione i is a random error
Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where + β + β e for,..., and are observable varables e s a random error How can an estmaton rule be constructed for the unknown
More informationEvaluation of an Efficient Monte Carlo Algorithm to Calculate the Density of States
Internatonal Journal of Machne earnng and Computng, Vol., No., Aprl valuaton of an ffcent Monte Carlo Algorthm to Calculate the Densty of States Seung-Yeon Km, Member, IACSIT Abstract Phase transtons and
More information2.29 Numerical Fluid Mechanics
REVIEW Lecture 10: Sprng 2015 Lecture 11 Classfcaton of Partal Dfferental Equatons PDEs) and eamples wth fnte dfference dscretzatons Parabolc PDEs Ellptc PDEs Hyperbolc PDEs Error Types and Dscretzaton
More informationPHYS 705: Classical Mechanics. Calculus of Variations II
1 PHYS 705: Classcal Mechancs Calculus of Varatons II 2 Calculus of Varatons: Generalzaton (no constrant yet) Suppose now that F depends on several dependent varables : We need to fnd such that has a statonary
More information1 Derivation of Rate Equations from Single-Cell Conductance (Hodgkin-Huxley-like) Equations
Physcs 171/271 -Davd Klenfeld - Fall 2005 (revsed Wnter 2011) 1 Dervaton of Rate Equatons from Sngle-Cell Conductance (Hodgkn-Huxley-lke) Equatons We consder a network of many neurons, each of whch obeys
More informationLectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix
Lectures - Week 4 Matrx norms, Condtonng, Vector Spaces, Lnear Independence, Spannng sets and Bass, Null space and Range of a Matrx Matrx Norms Now we turn to assocatng a number to each matrx. We could
More informationWeek3, Chapter 4. Position and Displacement. Motion in Two Dimensions. Instantaneous Velocity. Average Velocity
Week3, Chapter 4 Moton n Two Dmensons Lecture Quz A partcle confned to moton along the x axs moves wth constant acceleraton from x =.0 m to x = 8.0 m durng a 1-s tme nterval. The velocty of the partcle
More information6 Supplementary Materials
6 Supplementar Materals 61 Proof of Theorem 31 Proof Let m Xt z 1:T : l m Xt X,z 1:t Wethenhave mxt z1:t ˆm HX Xt z 1:T mxt z1:t m HX Xt z 1:T + mxt z 1:T HX We consder each of the two terms n equaton
More informationGeorgia Tech PHYS 6124 Mathematical Methods of Physics I
Georga Tech PHYS 624 Mathematcal Methods of Physcs I Instructor: Predrag Cvtanovć Fall semester 202 Homework Set #7 due October 30 202 == show all your work for maxmum credt == put labels ttle legends
More informationCME 302: NUMERICAL LINEAR ALGEBRA FALL 2005/06 LECTURE 13
CME 30: NUMERICAL LINEAR ALGEBRA FALL 005/06 LECTURE 13 GENE H GOLUB 1 Iteratve Methods Very large problems (naturally sparse, from applcatons): teratve methods Structured matrces (even sometmes dense,
More informationLecture 12: Discrete Laplacian
Lecture 12: Dscrete Laplacan Scrbe: Tanye Lu Our goal s to come up wth a dscrete verson of Laplacan operator for trangulated surfaces, so that we can use t n practce to solve related problems We are mostly
More informationInformation Geometry of Gibbs Sampler
Informaton Geometry of Gbbs Sampler Kazuya Takabatake Neuroscence Research Insttute AIST Central 2, Umezono 1-1-1, Tsukuba JAPAN 305-8568 k.takabatake@ast.go.jp Abstract: - Ths paper shows some nformaton
More informationOutline for today. Markov chain Monte Carlo. Example: spatial statistics (Christensen and Waagepetersen 2001)
Markov chan Monte Carlo Rasmus Waagepetersen Department of Mathematcs Aalborg Unversty Denmark November, / Outlne for today MCMC / Condtonal smulaton for hgh-dmensonal U: Markov chan Monte Carlo Consder
More informationLossy Compression. Compromise accuracy of reconstruction for increased compression.
Lossy Compresson Compromse accuracy of reconstructon for ncreased compresson. The reconstructon s usually vsbly ndstngushable from the orgnal mage. Typcally, one can get up to 0:1 compresson wth almost
More informationFunctional Quantization
Functonal Quantzaton In quantum mechancs of one or several partcles, we may use path ntegrals to calculate transton matrx elements as out Ût out t n n = D[allx t] exps[allx t] Ψ outallx @t out Ψ n allx
More informationLecture 3 Stat102, Spring 2007
Lecture 3 Stat0, Sprng 007 Chapter 3. 3.: Introducton to regresson analyss Lnear regresson as a descrptve technque The least-squares equatons Chapter 3.3 Samplng dstrbuton of b 0, b. Contnued n net lecture
More informationA Particle Filter Algorithm based on Mixing of Prior probability density and UKF as Generate Importance Function
Advanced Scence and Technology Letters, pp.83-87 http://dx.do.org/10.14257/astl.2014.53.20 A Partcle Flter Algorthm based on Mxng of Pror probablty densty and UKF as Generate Importance Functon Lu Lu 1,1,
More informationON MECHANICS WITH VARIABLE NONCOMMUTATIVITY
ON MECHANICS WITH VARIABLE NONCOMMUTATIVITY CIPRIAN ACATRINEI Natonal Insttute of Nuclear Physcs and Engneerng P.O. Box MG-6, 07725-Bucharest, Romana E-mal: acatrne@theory.npne.ro. Receved March 6, 2008
More informationLecture 3: Probability Distributions
Lecture 3: Probablty Dstrbutons Random Varables Let us begn by defnng a sample space as a set of outcomes from an experment. We denote ths by S. A random varable s a functon whch maps outcomes nto the
More informationGlobal Sensitivity. Tuesday 20 th February, 2018
Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values
More informationFeb 14: Spatial analysis of data fields
Feb 4: Spatal analyss of data felds Mappng rregularly sampled data onto a regular grd Many analyss technques for geophyscal data requre the data be located at regular ntervals n space and/or tme. hs s
More informationCHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE
CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng
More informationThe Symmetries of Kibble s Gauge Theory of Gravitational Field, Conservation Laws of Energy-Momentum Tensor Density and the
The Symmetres of Kbble s Gauge Theory of Gravtatonal Feld, Conservaton aws of Energy-Momentum Tensor Densty and the Problems about Orgn of Matter Feld Fangpe Chen School of Physcs and Opto-electronc Technology,Dalan
More informationSuites of Tests. DIEHARD TESTS (Marsaglia, 1985) See
Sutes of Tests DIEHARD TESTS (Marsagla, 985 See http://stat.fsu.edu/~geo/dehard.html NIST Test sute- 6 tests on the sequences of bts http://csrc.nst.gov/rng/ Test U0 Includes the above tests. http://www.ro.umontreal.ca/~lecuyer/
More informationNegative Binomial Regression
STATGRAPHICS Rev. 9/16/2013 Negatve Bnomal Regresson Summary... 1 Data Input... 3 Statstcal Model... 3 Analyss Summary... 4 Analyss Optons... 7 Plot of Ftted Model... 8 Observed Versus Predcted... 10 Predctons...
More informationj) = 1 (note sigma notation) ii. Continuous random variable (e.g. Normal distribution) 1. density function: f ( x) 0 and f ( x) dx = 1
Random varables Measure of central tendences and varablty (means and varances) Jont densty functons and ndependence Measures of assocaton (covarance and correlaton) Interestng result Condtonal dstrbutons
More informationRELIABILITY ASSESSMENT
CHAPTER Rsk Analyss n Engneerng and Economcs RELIABILITY ASSESSMENT A. J. Clark School of Engneerng Department of Cvl and Envronmental Engneerng 4a CHAPMAN HALL/CRC Rsk Analyss for Engneerng Department
More informationCIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M
CIS56: achne Learnng Lecture 3 (Sept 6, 003) Preparaton help: Xaoyng Huang Lnear Regresson Lnear regresson can be represented by a functonal form: f(; θ) = θ 0 0 +θ + + θ = θ = 0 ote: 0 s a dummy attrbute
More informationESCI 341 Atmospheric Thermodynamics Lesson 10 The Physical Meaning of Entropy
ESCI 341 Atmospherc Thermodynamcs Lesson 10 The Physcal Meanng of Entropy References: An Introducton to Statstcal Thermodynamcs, T.L. Hll An Introducton to Thermodynamcs and Thermostatstcs, H.B. Callen
More informationA random variable is a function which associates a real number to each element of the sample space
Introducton to Random Varables Defnton of random varable Defnton of of random varable Dscrete and contnuous random varable Probablty blt functon Dstrbuton functon Densty functon Sometmes, t s not enough
More informationStatistical Inference. 2.3 Summary Statistics Measures of Center and Spread. parameters ( population characteristics )
Ismor Fscher, 8//008 Stat 54 / -8.3 Summary Statstcs Measures of Center and Spread Dstrbuton of dscrete contnuous POPULATION Random Varable, numercal True center =??? True spread =???? parameters ( populaton
More informationGenerative classification models
CS 675 Intro to Machne Learnng Lecture Generatve classfcaton models Mlos Hauskrecht mlos@cs.ptt.edu 539 Sennott Square Data: D { d, d,.., dn} d, Classfcaton represents a dscrete class value Goal: learn
More informationReport on Image warping
Report on Image warpng Xuan Ne, Dec. 20, 2004 Ths document summarzed the algorthms of our mage warpng soluton for further study, and there s a detaled descrpton about the mplementaton of these algorthms.
More informationNON-CENTRAL 7-POINT FORMULA IN THE METHOD OF LINES FOR PARABOLIC AND BURGERS' EQUATIONS
IJRRAS 8 (3 September 011 www.arpapress.com/volumes/vol8issue3/ijrras_8_3_08.pdf NON-CENTRAL 7-POINT FORMULA IN THE METHOD OF LINES FOR PARABOLIC AND BURGERS' EQUATIONS H.O. Bakodah Dept. of Mathematc
More informationV.C The Niemeijer van Leeuwen Cumulant Approximation
V.C The Nemejer van Leeuwen Cumulant Approxmaton Unfortunately, the decmaton procedure cannot be performed exactly n hgher dmensons. For example, the square lattce can be dvded nto two sublattces. For
More informationA how to guide to second quantization method.
Phys. 67 (Graduate Quantum Mechancs Sprng 2009 Prof. Pu K. Lam. Verson 3 (4/3/2009 A how to gude to second quantzaton method. -> Second quantzaton s a mathematcal notaton desgned to handle dentcal partcle
More informationSynchronized Multi-sensor Tracks Association and Fusion
Synchronzed Mult-sensor Tracks Assocaton and Fuson Dongguang Zuo Chongzhao an School of Electronc and nformaton Engneerng X an Jaotong Unversty Xan 749, P.R. Chna Zlz_3@sna.com.cn czhan@jtu.edu.cn Abstract
More informationRigid body simulation
Rgd bod smulaton Rgd bod smulaton Once we consder an object wth spacal etent, partcle sstem smulaton s no longer suffcent Problems Problems Unconstraned sstem rotatonal moton torques and angular momentum
More informationTemperature. Chapter Heat Engine
Chapter 3 Temperature In prevous chapters of these notes we ntroduced the Prncple of Maxmum ntropy as a technque for estmatng probablty dstrbutons consstent wth constrants. In Chapter 9 we dscussed the
More informationCS 468 Lecture 16: Isometry Invariance and Spectral Techniques
CS 468 Lecture 16: Isometry Invarance and Spectral Technques Justn Solomon Scrbe: Evan Gawlk Introducton. In geometry processng, t s often desrable to characterze the shape of an object n a manner that
More informationStatistics Chapter 4
Statstcs Chapter 4 "There are three knds of les: les, damned les, and statstcs." Benjamn Dsrael, 1895 (Brtsh statesman) Gaussan Dstrbuton, 4-1 If a measurement s repeated many tmes a statstcal treatment
More informationExpectation Maximization Mixture Models HMMs
-755 Machne Learnng for Sgnal Processng Mture Models HMMs Class 9. 2 Sep 200 Learnng Dstrbutons for Data Problem: Gven a collecton of eamples from some data, estmate ts dstrbuton Basc deas of Mamum Lelhood
More information6. Stochastic processes (2)
Contents Markov processes Brth-death processes Lect6.ppt S-38.45 - Introducton to Teletraffc Theory Sprng 5 Markov process Consder a contnuous-tme and dscrete-state stochastc process X(t) wth state space
More informationLecture 4. Macrostates and Microstates (Ch. 2 )
Lecture 4. Macrostates and Mcrostates (Ch. ) The past three lectures: we have learned about thermal energy, how t s stored at the mcroscopc level, and how t can be transferred from one system to another.
More information6. Stochastic processes (2)
6. Stochastc processes () Lect6.ppt S-38.45 - Introducton to Teletraffc Theory Sprng 5 6. Stochastc processes () Contents Markov processes Brth-death processes 6. Stochastc processes () Markov process
More informationMonte Carlo method II
Course MP3 Lecture 5 14/11/2006 Monte Carlo method II How to put some real physcs nto the Monte Carlo method Dr James Ellott 5.1 Monte Carlo method revsted In lecture 4, we ntroduced the Monte Carlo (MC)
More informationOpen string operator quantization
Open strng operator quantzaton Requred readng: Zwebach -4 Suggested readng: Polchnsk 3 Green, Schwarz, & Wtten 3 upto eq 33 The lght-cone strng as a feld theory: Today we wll dscuss the quantzaton of an
More information