NATIONAL UNIVERSITY OF SINGAPORE PC5215 NUMERICAL RECIPES WITH APPLICATIONS. (Semester I: AY ) Time Allowed: 2 Hours

Size: px
Start display at page:

Download "NATIONAL UNIVERSITY OF SINGAPORE PC5215 NUMERICAL RECIPES WITH APPLICATIONS. (Semester I: AY ) Time Allowed: 2 Hours"

Transcription

1 NATIONAL UNIVERSITY OF SINGAPORE PC55 NUMERICAL RECIPES WITH APPLICATIONS (Semester I: AY 0-) Time Allowed: Hours INSTRUCTIONS TO CANDIDATES. This examination paper contains FIVE questions and comprises THREE printed pages.. Answer ALL the questions; questions carry equal marks.. Answers to the questions are to be written in the answer books. 4. This is a CLOSED BOOK examination. 5. Non-programmable calculators are allowed.

2 . The IEEE 754 standard for floating point representation of the double precision number has a sign bit, followed by bits for the biased exponent (with a bias of 0) and the rest 5 bits for the fractional part. a. Give the bit patterns for the 64-bit double precision representation of and /. b. Discuss what impact reducing the biased exponent field to 8 bits has, in terms of the precision and magnitude of the floating point numbers. a. - is (in hexadecimal notation) BFF FFFFFFFFFFFFF, / is FD b. If the exponent field is reduced and fractional part increased, then the precision increases (machine epsilon is smaller) but the magnitude decreases.. Consider numerical integration formula by Gaussian quadrature method. a. State the main idea of Gaussian quadrature. b. Consider a three-point Gaussian quadrature formula in the interval [0,], f ( x ) dx w f ( x ) + w f ( x ) + w f ( x ). For polynomials,, x, x,, x n, 0 the formula is exact. What is the largest integer n that this is true? c. Determine the three-point formula, i.e., determine the abscissas x, x, x, and the weights w, w, w. a. by changing both the weights and abscissas, a maximum of accuracy is obtained, i.e., the formula is exact for polynomials of order N- for N point Gaussian quadrature. b. n=5. c. P 0 =, P = x-/, P =x -x+/6, P =x -/x +/5x -/0. This is obtained by the orthogonal condition <P i P j > = 0 (i < j). The root of P (x)=0 gives x =/, x = ( / 5) /, x = (+ / 5) /. The weights are determined by the condition that the polynomials, x, x can be integrated exactly. Given, w+ w + w =, xw + xw + xw =, x w+ x w + x w =. The solution is w =4/9, w =w =5/8.

3 . Consider a Monte Carlo simulation to generate Boltzmann distribution using the Metropolis algorithm for the following statistical-mechanical model: H({ σ, σ, σ }) = Jσσ Jσσ J( σ + σ ), where the spins σ i =±, i =,,, and J>0 is some constant. a. Assuming that the spins are chosen at random with equal probability, determine the transition matrix W. b. What is the equilibrium/invariant distribution P associated with W? c. Outline pseudo-code that computes σ, i.e., the equilibrium average value of the first spin, in a Metropolis Monte Carlo simulation. a. The energy of the 8 states are J J The transition matrix is (in the same order as the state/energy list above) r r r r / / r 0 0 r / 0 0 / 0 / r 0 r 0 / 0 / / / 0 4 J /( kt ), r = e. 0 / / / 0 / 0 / / 0 0 / / / r / / / r b. By design, P is the equilibrium (canonical) distribution, P =exp(-h(σ)/kt)/z, ie., P = [exp(4j/kt),,,, exp(-4j/kt),,, ]/Z, Z = 6 + exp(-4j/kt) + exp(4j/kt), satisfies P=PW (But we don t need to solve the eigenvalue problem to get P, as the purpose of the Metropolis algorithm is to design W such that P is the equilibrium one). c. set σ =σ =σ =. M=0. for(i= to 0 6 ) { j = floor(ξ) +, Compute H(σ),

4 } σ j = σ j, compute again H(σ ) (where the spin j is flipped), ΔE = H(σ )-H(σ), if (ξ > exp(-δe/(kt)) { σ j = σ j, (flip back) }, M = M + σ, M = M/ The algorithm of the conjugate-gradient method for locating minimum is as follows: i. Initialize n 0 = g 0 = - f(x 0 ), i = 0, ii. Find λ that minimizes f(x i +λn i ), let x i+ =x i +λn i iii. Compute new negative gradient g i+ = - f(x i+ ) gi+ gi+ iv. Compute γ i = gi gi v. Update new search direction as n i+ = g i+ + γ i n i ; ++i, go to ii a. If f is a function of two scalar variables x and y, f = x + xy+ y x+ y, how many times do we need to iterate the steps? b. Starting from the point (x,y)=(0,0), determine n 0 and n according to the algorithm above and show that n T 0 A n =0, where A is the coefficient matrix of the quadratic term in f. c. Work out the steps to find the minimum (x min, y min ) of f. a. in two steps since it is two dimensional. b. n 0 = g 0 = (-x-y+,-(x+y+)) = (, -), f = (/)λ - λ, min is at λ=, (x, y ) = (,-), g =(,), γ =, n = (,) + γ(,-) = (, 0). A =, n T 0 A n = 0. c. (x,y ) = (,-) is the minimum location. 5. Consider the problem of damped nonlinear oscillator governed by the second order differential equation, 4

5 d x dx γ x Ft () = +, dt dt where γ is a damping constant and F(t) some external driving force which depends on time explicitly. a. Rewrite the equation as a set of first order differential equations equivalent to the original one. b. Give the numerical algorithm of the midpoint method, and determine the local truncation error, i.e., the order n in error O(h n ) where h is step size. c. Give a version of symplectic algorithm, if possible. If not possible, explain why not? dx = y, dt a. dy γ y x Ft ( ). dt = + b. the midpoint algorithm is, in general: K = hf(, t Yn ) h K K = hf( tn +, Yn + ) Yn+ = Yn + K + Oh ( ) where errors are of rd order, and vectors are x y Y=, (, txy, ) y F = γ y x + Ft () In component form for this problem, we have h xn+ = xn + h yn + ( γ yn + xn + Ft ( n) h h h yn+ = yn + h γ yn + ( γ yn + xn + Ft ( n) + ( xn + yn) + Ft ( n + ) c. No, since the system cannot be derived from a Hamiltonian due to the damping or time-dependent forces. [It has nothing to do with linear or nonlinear]. - the end - [JSW] 5

NATIONAL UNIVERSITY OF SINGAPORE PC5215 NUMERICAL RECIPES WITH APPLICATIONS. (Semester I: AY ) Time Allowed: 2 Hours

NATIONAL UNIVERSITY OF SINGAPORE PC5215 NUMERICAL RECIPES WITH APPLICATIONS. (Semester I: AY ) Time Allowed: 2 Hours NATIONAL UNIVERSITY OF SINGAPORE PC5215 NUMERICAL RECIPES WITH APPLICATIONS (Semester I: AY 2014-15) Time Allowed: 2 Hours INSTRUCTIONS TO CANDIDATES 1. Please write your student number only. 2. This examination

More information

Introduction CSE 541

Introduction CSE 541 Introduction CSE 541 1 Numerical methods Solving scientific/engineering problems using computers. Root finding, Chapter 3 Polynomial Interpolation, Chapter 4 Differentiation, Chapter 4 Integration, Chapters

More information

Jim Lambers MAT 460/560 Fall Semester Practice Final Exam

Jim Lambers MAT 460/560 Fall Semester Practice Final Exam Jim Lambers MAT 460/560 Fall Semester 2009-10 Practice Final Exam 1. Let f(x) = sin 2x + cos 2x. (a) Write down the 2nd Taylor polynomial P 2 (x) of f(x) centered around x 0 = 0. (b) Write down the corresponding

More information

Chapter 1 Error Analysis

Chapter 1 Error Analysis Chapter 1 Error Analysis Several sources of errors are important for numerical data processing: Experimental uncertainty: Input data from an experiment have a limited precision. Instead of the vector of

More information

Floating Point Number Systems. Simon Fraser University Surrey Campus MACM 316 Spring 2005 Instructor: Ha Le

Floating Point Number Systems. Simon Fraser University Surrey Campus MACM 316 Spring 2005 Instructor: Ha Le Floating Point Number Systems Simon Fraser University Surrey Campus MACM 316 Spring 2005 Instructor: Ha Le 1 Overview Real number system Examples Absolute and relative errors Floating point numbers Roundoff

More information

Numerical Methods - Preliminaries

Numerical Methods - Preliminaries Numerical Methods - Preliminaries Y. K. Goh Universiti Tunku Abdul Rahman 2013 Y. K. Goh (UTAR) Numerical Methods - Preliminaries 2013 1 / 58 Table of Contents 1 Introduction to Numerical Methods Numerical

More information

Bindel, Spring 2012 Intro to Scientific Computing (CS 3220) Week 12: Monday, Apr 16. f(x) dx,

Bindel, Spring 2012 Intro to Scientific Computing (CS 3220) Week 12: Monday, Apr 16. f(x) dx, Panel integration Week 12: Monday, Apr 16 Suppose we want to compute the integral b a f(x) dx In estimating a derivative, it makes sense to use a locally accurate approximation to the function around the

More information

Monte Carlo. Lecture 15 4/9/18. Harvard SEAS AP 275 Atomistic Modeling of Materials Boris Kozinsky

Monte Carlo. Lecture 15 4/9/18. Harvard SEAS AP 275 Atomistic Modeling of Materials Boris Kozinsky Monte Carlo Lecture 15 4/9/18 1 Sampling with dynamics In Molecular Dynamics we simulate evolution of a system over time according to Newton s equations, conserving energy Averages (thermodynamic properties)

More information

Do not turn over until you are told to do so by the Invigilator.

Do not turn over until you are told to do so by the Invigilator. UNIVERSITY OF EAST ANGLIA School of Mathematics Main Series UG Examination 216 17 INTRODUCTION TO NUMERICAL ANALYSIS MTHE612B Time allowed: 3 Hours Attempt QUESTIONS 1 and 2, and THREE other questions.

More information

2015 School Year. Graduate School Entrance Examination Problem Booklet. Mathematics

2015 School Year. Graduate School Entrance Examination Problem Booklet. Mathematics 2015 School Year Graduate School Entrance Examination Problem Booklet Mathematics Examination Time: 10:00 to 12:30 Instructions 1. Do not open this problem booklet until the start of the examination is

More information

Differential Equations 2280 Sample Midterm Exam 3 with Solutions Exam Date: 24 April 2015 at 12:50pm

Differential Equations 2280 Sample Midterm Exam 3 with Solutions Exam Date: 24 April 2015 at 12:50pm Differential Equations 228 Sample Midterm Exam 3 with Solutions Exam Date: 24 April 25 at 2:5pm Instructions: This in-class exam is 5 minutes. No calculators, notes, tables or books. No answer check is

More information

Introductory Numerical Analysis

Introductory Numerical Analysis Introductory Numerical Analysis Lecture Notes December 16, 017 Contents 1 Introduction to 1 11 Floating Point Numbers 1 1 Computational Errors 13 Algorithm 3 14 Calculus Review 3 Root Finding 5 1 Bisection

More information

Numerical Analysis: Interpolation Part 1

Numerical Analysis: Interpolation Part 1 Numerical Analysis: Interpolation Part 1 Computer Science, Ben-Gurion University (slides based mostly on Prof. Ben-Shahar s notes) 2018/2019, Fall Semester BGU CS Interpolation (ver. 1.00) AY 2018/2019,

More information

you expect to encounter difficulties when trying to solve A x = b? 4. A composite quadrature rule has error associated with it in the following form

you expect to encounter difficulties when trying to solve A x = b? 4. A composite quadrature rule has error associated with it in the following form Qualifying exam for numerical analysis (Spring 2017) Show your work for full credit. If you are unable to solve some part, attempt the subsequent parts. 1. Consider the following finite difference: f (0)

More information

Fourth Order RK-Method

Fourth Order RK-Method Fourth Order RK-Method The most commonly used method is Runge-Kutta fourth order method. The fourth order RK-method is y i+1 = y i + 1 6 (k 1 + 2k 2 + 2k 3 + k 4 ), Ordinary Differential Equations (ODE)

More information

Midterm Review. Igor Yanovsky (Math 151A TA)

Midterm Review. Igor Yanovsky (Math 151A TA) Midterm Review Igor Yanovsky (Math 5A TA) Root-Finding Methods Rootfinding methods are designed to find a zero of a function f, that is, to find a value of x such that f(x) =0 Bisection Method To apply

More information

Math 471. Numerical methods Introduction

Math 471. Numerical methods Introduction Math 471. Numerical methods Introduction Section 1.1 1.4 of Bradie 1.1 Algorithms Here is an analogy between Numerical Methods and Gastronomy: Calculus, Lin Alg., Diff. eq. Ingredients Algorithm Recipe

More information

Numerical integration and importance sampling

Numerical integration and importance sampling 2 Numerical integration and importance sampling 2.1 Quadrature Consider the numerical evaluation of the integral I(a, b) = b a dx f(x) Rectangle rule: on small interval, construct interpolating function

More information

NATIONAL UNIVERSITY OF SINGAPORE DEPARTMENT OF MATHEMATICS SEMESTER 2 EXAMINATION, AY 2010/2011. Linear Algebra II. May 2011 Time allowed :

NATIONAL UNIVERSITY OF SINGAPORE DEPARTMENT OF MATHEMATICS SEMESTER 2 EXAMINATION, AY 2010/2011. Linear Algebra II. May 2011 Time allowed : NATIONAL UNIVERSITY OF SINGAPORE DEPARTMENT OF MATHEMATICS SEMESTER 2 EXAMINATION, AY 2010/2011 Linear Algebra II May 2011 Time allowed : 2 hours INSTRUCTIONS TO CANDIDATES 1. This examination paper contains

More information

These slides follow closely the (English) course textbook Pattern Recognition and Machine Learning by Christopher Bishop

These slides follow closely the (English) course textbook Pattern Recognition and Machine Learning by Christopher Bishop Music and Machine Learning (IFT68 Winter 8) Prof. Douglas Eck, Université de Montréal These slides follow closely the (English) course textbook Pattern Recognition and Machine Learning by Christopher Bishop

More information

BOUNDARY VALUE PROBLEMS

BOUNDARY VALUE PROBLEMS BOUNDARY VALUE PROBLEMS School of Mathematics Semester 1 2008 OUTLINE 1 REVIEW 2 BOUNDARY VALUE PROBLEMS 3 NEWTONS SHOOTING METHOD 4 SUMMARY OUTLINE 1 REVIEW 2 BOUNDARY VALUE PROBLEMS 3 NEWTONS SHOOTING

More information

MATH3383. Quantum Mechanics. Appendix D: Hermite Equation; Orthogonal Polynomials

MATH3383. Quantum Mechanics. Appendix D: Hermite Equation; Orthogonal Polynomials MATH3383. Quantum Mechanics. Appendix D: Hermite Equation; Orthogonal Polynomials. Hermite Equation In the study of the eigenvalue problem of the Hamiltonian for the quantum harmonic oscillator we have

More information

Examples of solutions to the examination in Computational Physics (FYTN03), October 24, 2016

Examples of solutions to the examination in Computational Physics (FYTN03), October 24, 2016 Examples of solutions to the examination in Computational Physics (FYTN3), October 4, 6 Allowed calculation aids: TEFYMA or Physics Handbook. The examination consists of eight problems each worth five

More information

Metropolis/Variational Monte Carlo. Microscopic Theories of Nuclear Structure, Dynamics and Electroweak Currents June 12-30, 2017, ECT*, Trento, Italy

Metropolis/Variational Monte Carlo. Microscopic Theories of Nuclear Structure, Dynamics and Electroweak Currents June 12-30, 2017, ECT*, Trento, Italy Metropolis/Variational Monte Carlo Stefano Gandolfi Los Alamos National Laboratory (LANL) Microscopic Theories of Nuclear Structure, Dynamics and Electroweak Currents June 12-30, 2017, ECT*, Trento, Italy

More information

ECE257 Numerical Methods and Scientific Computing. Ordinary Differential Equations

ECE257 Numerical Methods and Scientific Computing. Ordinary Differential Equations ECE257 Numerical Methods and Scientific Computing Ordinary Differential Equations Today s s class: Stiffness Multistep Methods Stiff Equations Stiffness occurs in a problem where two or more independent

More information

Notes for Chapter 1 of. Scientific Computing with Case Studies

Notes for Chapter 1 of. Scientific Computing with Case Studies Notes for Chapter 1 of Scientific Computing with Case Studies Dianne P. O Leary SIAM Press, 2008 Mathematical modeling Computer arithmetic Errors 1999-2008 Dianne P. O'Leary 1 Arithmetic and Error What

More information

Monte Carlo Methods in High Energy Physics I

Monte Carlo Methods in High Energy Physics I Helmholtz International Workshop -- CALC 2009, July 10--20, Dubna Monte Carlo Methods in High Energy Physics CALC2009 - July 20 10, Dubna 2 Contents 3 Introduction Simple definition: A Monte Carlo technique

More information

Research Computing with Python, Lecture 7, Numerical Integration and Solving Ordinary Differential Equations

Research Computing with Python, Lecture 7, Numerical Integration and Solving Ordinary Differential Equations Research Computing with Python, Lecture 7, Numerical Integration and Solving Ordinary Differential Equations Ramses van Zon SciNet HPC Consortium November 25, 2014 Ramses van Zon (SciNet HPC Consortium)Research

More information

Linear Multistep Methods I: Adams and BDF Methods

Linear Multistep Methods I: Adams and BDF Methods Linear Multistep Methods I: Adams and BDF Methods Varun Shankar January 1, 016 1 Introduction In our review of 5610 material, we have discussed polynomial interpolation and its application to generating

More information

19 : Slice Sampling and HMC

19 : Slice Sampling and HMC 10-708: Probabilistic Graphical Models 10-708, Spring 2018 19 : Slice Sampling and HMC Lecturer: Kayhan Batmanghelich Scribes: Boxiang Lyu 1 MCMC (Auxiliary Variables Methods) In inference, we are often

More information

Functions - Exponential Functions

Functions - Exponential Functions 0.5 Functions - Exponential Functions As our study of algebra gets more advanced we begin to study more involved functions. One pair of inverse functions we will look at are exponential functions and logarithmic

More information

Linear & nonlinear classifiers

Linear & nonlinear classifiers Linear & nonlinear classifiers Machine Learning Hamid Beigy Sharif University of Technology Fall 1394 Hamid Beigy (Sharif University of Technology) Linear & nonlinear classifiers Fall 1394 1 / 34 Table

More information

UNIVERSITY of LIMERICK OLLSCOIL LUIMNIGH

UNIVERSITY of LIMERICK OLLSCOIL LUIMNIGH UNIVERSITY of LIMERICK OLLSCOIL LUIMNIGH College of Informatics and Electronics END OF SEMESTER ASSESSMENT PAPER MODULE CODE: MS4613 SEMESTER: Autumn 2002/03 MODULE TITLE: Vector Analysis DURATION OF EXAMINATION:

More information

Integration, differentiation, and root finding. Phys 420/580 Lecture 7

Integration, differentiation, and root finding. Phys 420/580 Lecture 7 Integration, differentiation, and root finding Phys 420/580 Lecture 7 Numerical integration Compute an approximation to the definite integral I = b Find area under the curve in the interval Trapezoid Rule:

More information

Arithmetic and Error. How does error arise? How does error arise? Notes for Part 1 of CMSC 460

Arithmetic and Error. How does error arise? How does error arise? Notes for Part 1 of CMSC 460 Notes for Part 1 of CMSC 460 Dianne P. O Leary Preliminaries: Mathematical modeling Computer arithmetic Errors 1999-2006 Dianne P. O'Leary 1 Arithmetic and Error What we need to know about error: -- how

More information

ECE580 Exam 2 November 01, Name: Score: / (20 points) You are given a two data sets

ECE580 Exam 2 November 01, Name: Score: / (20 points) You are given a two data sets ECE580 Exam 2 November 01, 2011 1 Name: Score: /100 You must show ALL of your work for full credit. This exam is closed-book. Calculators may NOT be used. Please leave fractions as fractions, etc. I do

More information

BACHELOR OF COMPUTER APPLICATIONS (BCA) (Revised) Term-End Examination December, 2015 BCS-054 : COMPUTER ORIENTED NUMERICAL TECHNIQUES

BACHELOR OF COMPUTER APPLICATIONS (BCA) (Revised) Term-End Examination December, 2015 BCS-054 : COMPUTER ORIENTED NUMERICAL TECHNIQUES No. of Printed Pages : 5 BCS-054 BACHELOR OF COMPUTER APPLICATIONS (BCA) (Revised) Term-End Examination December, 2015 058b9 BCS-054 : COMPUTER ORIENTED NUMERICAL TECHNIQUES Time : 3 hours Maximum Marks

More information

Lecture Notes, FYTN03 Computational Physics

Lecture Notes, FYTN03 Computational Physics 1 FYTN03 HT08 Lecture Notes, FYTN03 Computational Physics 1 Introduction Numerical methods in physics is simple. Just take your formula and replace everything looking like δx with x. This also implies,

More information

Numerical Algorithms as Dynamical Systems

Numerical Algorithms as Dynamical Systems A Study on Numerical Algorithms as Dynamical Systems Moody Chu North Carolina State University What This Study Is About? To recast many numerical algorithms as special dynamical systems, whence to derive

More information

Math 216 Final Exam 14 December, 2012

Math 216 Final Exam 14 December, 2012 Math 216 Final Exam 14 December, 2012 This sample exam is provided to serve as one component of your studying for this exam in this course. Please note that it is not guaranteed to cover the material that

More information

Expectation. DS GA 1002 Statistical and Mathematical Models. Carlos Fernandez-Granda

Expectation. DS GA 1002 Statistical and Mathematical Models.   Carlos Fernandez-Granda Expectation DS GA 1002 Statistical and Mathematical Models http://www.cims.nyu.edu/~cfgranda/pages/dsga1002_fall16 Carlos Fernandez-Granda Aim Describe random variables with a few numbers: mean, variance,

More information

Neural Network Training

Neural Network Training Neural Network Training Sargur Srihari Topics in Network Training 0. Neural network parameters Probabilistic problem formulation Specifying the activation and error functions for Regression Binary classification

More information

Entrance Exam, Differential Equations April, (Solve exactly 6 out of the 8 problems) y + 2y + y cos(x 2 y) = 0, y(0) = 2, y (0) = 4.

Entrance Exam, Differential Equations April, (Solve exactly 6 out of the 8 problems) y + 2y + y cos(x 2 y) = 0, y(0) = 2, y (0) = 4. Entrance Exam, Differential Equations April, 7 (Solve exactly 6 out of the 8 problems). Consider the following initial value problem: { y + y + y cos(x y) =, y() = y. Find all the values y such that the

More information

Chapter 1: Preliminaries and Error Analysis

Chapter 1: Preliminaries and Error Analysis Chapter 1: Error Analysis Peter W. White white@tarleton.edu Department of Tarleton State University Summer 2015 / Numerical Analysis Overview We All Remember Calculus Derivatives: limit definition, sum

More information

Langevin Methods. Burkhard Dünweg Max Planck Institute for Polymer Research Ackermannweg 10 D Mainz Germany

Langevin Methods. Burkhard Dünweg Max Planck Institute for Polymer Research Ackermannweg 10 D Mainz Germany Langevin Methods Burkhard Dünweg Max Planck Institute for Polymer Research Ackermannweg 1 D 55128 Mainz Germany Motivation Original idea: Fast and slow degrees of freedom Example: Brownian motion Replace

More information

Review Higher Order methods Multistep methods Summary HIGHER ORDER METHODS. P.V. Johnson. School of Mathematics. Semester

Review Higher Order methods Multistep methods Summary HIGHER ORDER METHODS. P.V. Johnson. School of Mathematics. Semester HIGHER ORDER METHODS School of Mathematics Semester 1 2008 OUTLINE 1 REVIEW 2 HIGHER ORDER METHODS 3 MULTISTEP METHODS 4 SUMMARY OUTLINE 1 REVIEW 2 HIGHER ORDER METHODS 3 MULTISTEP METHODS 4 SUMMARY OUTLINE

More information

Math 411 Preliminaries

Math 411 Preliminaries Math 411 Preliminaries Provide a list of preliminary vocabulary and concepts Preliminary Basic Netwon s method, Taylor series expansion (for single and multiple variables), Eigenvalue, Eigenvector, Vector

More information

Ordinary Differential Equations

Ordinary Differential Equations Chapter 13 Ordinary Differential Equations We motivated the problem of interpolation in Chapter 11 by transitioning from analzying to finding functions. That is, in problems like interpolation and regression,

More information

Machine Learning Lecture 7

Machine Learning Lecture 7 Course Outline Machine Learning Lecture 7 Fundamentals (2 weeks) Bayes Decision Theory Probability Density Estimation Statistical Learning Theory 23.05.2016 Discriminative Approaches (5 weeks) Linear Discriminant

More information

Bayesian Linear Regression [DRAFT - In Progress]

Bayesian Linear Regression [DRAFT - In Progress] Bayesian Linear Regression [DRAFT - In Progress] David S. Rosenberg Abstract Here we develop some basics of Bayesian linear regression. Most of the calculations for this document come from the basic theory

More information

Simple Harmonic Oscillator

Simple Harmonic Oscillator Classical harmonic oscillator Linear force acting on a particle (Hooke s law): F =!kx From Newton s law: F = ma = m d x dt =!kx " d x dt + # x = 0, # = k / m Position and momentum solutions oscillate in

More information

CS 257: Numerical Methods

CS 257: Numerical Methods CS 57: Numerical Methods Final Exam Study Guide Version 1.00 Created by Charles Feng http://www.fenguin.net CS 57: Numerical Methods Final Exam Study Guide 1 Contents 1 Introductory Matter 3 1.1 Calculus

More information

Consistency and Convergence

Consistency and Convergence Jim Lambers MAT 77 Fall Semester 010-11 Lecture 0 Notes These notes correspond to Sections 1.3, 1.4 and 1.5 in the text. Consistency and Convergence We have learned that the numerical solution obtained

More information

3. Riley 12.9: The equation sin x dy +2ycos x 1 dx can be reduced to a quadrature by the standard integrating factor,» Z x f(x) exp 2 dt cos t exp (2

3. Riley 12.9: The equation sin x dy +2ycos x 1 dx can be reduced to a quadrature by the standard integrating factor,» Z x f(x) exp 2 dt cos t exp (2 PHYS 725 HW #4. Due 15 November 21 1. Riley 12.3: R dq dt + q C V (t); The solution is obtained with the integrating factor exp (t/rc), giving q(t) e t/rc 1 R dsv (s) e s/rc + q() With q() and V (t) V

More information

Ordinary Differential Equations I

Ordinary Differential Equations I Ordinary Differential Equations I CS 205A: Mathematical Methods for Robotics, Vision, and Graphics Justin Solomon CS 205A: Mathematical Methods Ordinary Differential Equations I 1 / 32 Theme of Last Few

More information

MATH20602 Numerical Analysis 1

MATH20602 Numerical Analysis 1 M\cr NA Manchester Numerical Analysis MATH20602 Numerical Analysis 1 Martin Lotz School of Mathematics The University of Manchester Manchester, January 27, 2014 Outline General Course Information Introduction

More information

Expectation. DS GA 1002 Probability and Statistics for Data Science. Carlos Fernandez-Granda

Expectation. DS GA 1002 Probability and Statistics for Data Science.   Carlos Fernandez-Granda Expectation DS GA 1002 Probability and Statistics for Data Science http://www.cims.nyu.edu/~cfgranda/pages/dsga1002_fall17 Carlos Fernandez-Granda Aim Describe random variables with a few numbers: mean,

More information

CS 450 Numerical Analysis. Chapter 8: Numerical Integration and Differentiation

CS 450 Numerical Analysis. Chapter 8: Numerical Integration and Differentiation Lecture slides based on the textbook Scientific Computing: An Introductory Survey by Michael T. Heath, copyright c 2018 by the Society for Industrial and Applied Mathematics. http://www.siam.org/books/cl80

More information

Numerical Analysis Preliminary Exam 10 am to 1 pm, August 20, 2018

Numerical Analysis Preliminary Exam 10 am to 1 pm, August 20, 2018 Numerical Analysis Preliminary Exam 1 am to 1 pm, August 2, 218 Instructions. You have three hours to complete this exam. Submit solutions to four (and no more) of the following six problems. Please start

More information

Understand the existence and uniqueness theorems and what they tell you about solutions to initial value problems.

Understand the existence and uniqueness theorems and what they tell you about solutions to initial value problems. Review Outline To review for the final, look over the following outline and look at problems from the book and on the old exam s and exam reviews to find problems about each of the following topics.. Basics

More information

Monte Carlo study of the Baxter-Wu model

Monte Carlo study of the Baxter-Wu model Monte Carlo study of the Baxter-Wu model Nir Schreiber and Dr. Joan Adler Monte Carlo study of the Baxter-Wu model p.1/40 Outline Theory of phase transitions, Monte Carlo simulations and finite size scaling

More information

MA 262, Fall 2017, Final Version 01(Green)

MA 262, Fall 2017, Final Version 01(Green) INSTRUCTIONS MA 262, Fall 2017, Final Version 01(Green) (1) Switch off your phone upon entering the exam room. (2) Do not open the exam booklet until you are instructed to do so. (3) Before you open the

More information

COURSE Numerical integration of functions (continuation) 3.3. The Romberg s iterative generation method

COURSE Numerical integration of functions (continuation) 3.3. The Romberg s iterative generation method COURSE 7 3. Numerical integration of functions (continuation) 3.3. The Romberg s iterative generation method The presence of derivatives in the remainder difficulties in applicability to practical problems

More information

1. For the case of the harmonic oscillator, the potential energy is quadratic and hence the total Hamiltonian looks like: d 2 H = h2

1. For the case of the harmonic oscillator, the potential energy is quadratic and hence the total Hamiltonian looks like: d 2 H = h2 15 Harmonic Oscillator 1. For the case of the harmonic oscillator, the potential energy is quadratic and hence the total Hamiltonian looks like: d 2 H = h2 2mdx + 1 2 2 kx2 (15.1) where k is the force

More information

Abstract. + n) variables with a rank of ( n2 (n+1) )+n 2 ] equations in ( n2 (n+1)

Abstract. + n) variables with a rank of ( n2 (n+1) )+n 2 ] equations in ( n2 (n+1) SOLUTION OF SECOND ORDER LINEARIZATION R.Devanathan School of Electrical and Electronic Engineering (Block S) Nanyang Technological University Singapore 6998 E-mail:edevan@ntu.edu.sg Abstract For a nonlinear

More information

Applied Numerical Analysis Quiz #2

Applied Numerical Analysis Quiz #2 Applied Numerical Analysis Quiz #2 Modules 3 and 4 Name: Student number: DO NOT OPEN UNTIL ASKED Instructions: Make sure you have a machine-readable answer form. Write your name and student number in the

More information

Jim Lambers MAT 169 Fall Semester Practice Final Exam

Jim Lambers MAT 169 Fall Semester Practice Final Exam Jim Lambers MAT 169 Fall Semester 2010-11 Practice Final Exam 1. A ship is moving northwest at a speed of 50 mi/h. A passenger is walking due southeast on the deck at 4 mi/h. Find the speed of the passenger

More information

1.1 GRAPHS AND LINEAR FUNCTIONS

1.1 GRAPHS AND LINEAR FUNCTIONS MATHEMATICS EXTENSION 4 UNIT MATHEMATICS TOPIC 1: GRAPHS 1.1 GRAPHS AND LINEAR FUNCTIONS FUNCTIONS The concept of a function is already familiar to you. Since this concept is fundamental to mathematics,

More information

221A Lecture Notes Steepest Descent Method

221A Lecture Notes Steepest Descent Method Gamma Function A Lecture Notes Steepest Descent Method The best way to introduce the steepest descent method is to see an example. The Stirling s formula for the behavior of the factorial n! for large

More information

Math 5BI: Problem Set 6 Gradient dynamical systems

Math 5BI: Problem Set 6 Gradient dynamical systems Math 5BI: Problem Set 6 Gradient dynamical systems April 25, 2007 Recall that if f(x) = f(x 1, x 2,..., x n ) is a smooth function of n variables, the gradient of f is the vector field f(x) = ( f)(x 1,

More information

Preliminary Examination, Numerical Analysis, August 2016

Preliminary Examination, Numerical Analysis, August 2016 Preliminary Examination, Numerical Analysis, August 2016 Instructions: This exam is closed books and notes. The time allowed is three hours and you need to work on any three out of questions 1-4 and any

More information

Ch 4. Linear Models for Classification

Ch 4. Linear Models for Classification Ch 4. Linear Models for Classification Pattern Recognition and Machine Learning, C. M. Bishop, 2006. Department of Computer Science and Engineering Pohang University of Science and echnology 77 Cheongam-ro,

More information

Physics 584 Computational Methods

Physics 584 Computational Methods Physics 584 Computational Methods Introduction to Matlab and Numerical Solutions to Ordinary Differential Equations Ryan Ogliore April 18 th, 2016 Lecture Outline Introduction to Matlab Numerical Solutions

More information

Logistic Regression. Seungjin Choi

Logistic Regression. Seungjin Choi Logistic Regression Seungjin Choi Department of Computer Science and Engineering Pohang University of Science and Technology 77 Cheongam-ro, Nam-gu, Pohang 37673, Korea seungjin@postech.ac.kr http://mlg.postech.ac.kr/

More information

Parallel Tempering Algorithm in Monte Carlo Simulation

Parallel Tempering Algorithm in Monte Carlo Simulation Parallel Tempering Algorithm in Monte Carlo Simulation Tony Cheung (CUHK) Kevin Zhao (CUHK) Mentors: Ying Wai Li (ORNL) Markus Eisenbach (ORNL) Kwai Wong (UTK/ORNL) Metropolis Algorithm on Ising Model

More information

Linear & nonlinear classifiers

Linear & nonlinear classifiers Linear & nonlinear classifiers Machine Learning Hamid Beigy Sharif University of Technology Fall 1396 Hamid Beigy (Sharif University of Technology) Linear & nonlinear classifiers Fall 1396 1 / 44 Table

More information

The Sommerfeld Polynomial Method: Harmonic Oscillator Example

The Sommerfeld Polynomial Method: Harmonic Oscillator Example Chemistry 460 Fall 2017 Dr. Jean M. Standard October 2, 2017 The Sommerfeld Polynomial Method: Harmonic Oscillator Example Scaling the Harmonic Oscillator Equation Recall the basic definitions of the harmonic

More information

Hierarchical Parallel Solution of Stochastic Systems

Hierarchical Parallel Solution of Stochastic Systems Hierarchical Parallel Solution of Stochastic Systems Second M.I.T. Conference on Computational Fluid and Solid Mechanics Contents: Simple Model of Stochastic Flow Stochastic Galerkin Scheme Resulting Equations

More information

2013/2014 SEMESTER 1 MID-TERM TEST. 1 October :30pm to 9:30pm PLEASE READ THE FOLLOWING INSTRUCTIONS CAREFULLY:

2013/2014 SEMESTER 1 MID-TERM TEST. 1 October :30pm to 9:30pm PLEASE READ THE FOLLOWING INSTRUCTIONS CAREFULLY: 2013/2014 SEMESTER 1 MID-TERM TEST MA1505 MATHEMATICS I 1 October 2013 8:30pm to 9:30pm PLEASE READ THE FOLLOWING INSTRUCTIONS CAREFULLY: 1. This test paper consists of TEN (10) multiple choice questions

More information

UNIVERSITY OF SURREY FACULTY OF ENGINEERING AND PHYSICAL SCIENCES DEPARTMENT OF PHYSICS. BSc and MPhys Undergraduate Programmes in Physics LEVEL HE2

UNIVERSITY OF SURREY FACULTY OF ENGINEERING AND PHYSICAL SCIENCES DEPARTMENT OF PHYSICS. BSc and MPhys Undergraduate Programmes in Physics LEVEL HE2 Phys/Level /1/9/Semester, 009-10 (1 handout) UNIVERSITY OF SURREY FACULTY OF ENGINEERING AND PHYSICAL SCIENCES DEPARTMENT OF PHYSICS BSc and MPhys Undergraduate Programmes in Physics LEVEL HE PAPER 1 MATHEMATICAL,

More information

One-dimensional harmonic oscillator. -motivation. -equation, energy levels. -eigenfunctions, Hermite polynomials. -classical analogy

One-dimensional harmonic oscillator. -motivation. -equation, energy levels. -eigenfunctions, Hermite polynomials. -classical analogy One-dimensional harmonic oscillator -motivation -equation, energy levels -eigenfunctions, Hermite polynomials -classical analogy One-dimensional harmonic oscillator 05/0 Harmonic oscillator = potential

More information

MB4018 Differential equations

MB4018 Differential equations MB4018 Differential equations Part II http://www.staff.ul.ie/natalia/mb4018.html Prof. Natalia Kopteva Spring 2015 MB4018 (Spring 2015) Differential equations Part II 0 / 69 Section 1 Second-Order Linear

More information

Department of Applied Mathematics and Theoretical Physics. AMA 204 Numerical analysis. Exam Winter 2004

Department of Applied Mathematics and Theoretical Physics. AMA 204 Numerical analysis. Exam Winter 2004 Department of Applied Mathematics and Theoretical Physics AMA 204 Numerical analysis Exam Winter 2004 The best six answers will be credited All questions carry equal marks Answer all parts of each question

More information

221B Lecture Notes Steepest Descent Method

221B Lecture Notes Steepest Descent Method Gamma Function B Lecture Notes Steepest Descent Method The best way to introduce the steepest descent method is to see an example. The Stirling s formula for the behavior of the factorial n! for large

More information

The Brownian Oscillator

The Brownian Oscillator Chapter The Brownian Oscillator Contents.One-DimensionalDiffusioninaHarmonicPotential...38 The one-dimensional Smoluchowski equation, in case that a stationary flux-free equilibrium state p o (x) exists,

More information

Georgia Tech PHYS 6124 Mathematical Methods of Physics I

Georgia Tech PHYS 6124 Mathematical Methods of Physics I Georgia Tech PHYS 612 Mathematical Methods of Physics I Instructor: Predrag Cvitanović Fall semester 2012 Homework Set #5 due October 2, 2012 == show all your work for maximum credit, == put labels, title,

More information

Quantum Monte Carlo. Matthias Troyer, ETH Zürich

Quantum Monte Carlo. Matthias Troyer, ETH Zürich Quantum Monte Carlo Matthias Troyer, ETH Zürich 1 1. Monte Carlo Integration 2 Integrating a function Convert the integral to a discrete sum b! f (x)dx = b " a N a N ' i =1 # f a + i b " a % $ N & + O(1/N)

More information

2 Elementary algorithms for one-dimensional integrals

2 Elementary algorithms for one-dimensional integrals PY 502, Computational Physics, Fall 2017 Numerical Integration and Monte Carlo Integration Anders W. Sandvik, Department of Physics, Boston University 1 Introduction A common numerical task in computational

More information

Chapter 1 Mathematical Preliminaries and Error Analysis

Chapter 1 Mathematical Preliminaries and Error Analysis Numerical Analysis (Math 3313) 2019-2018 Chapter 1 Mathematical Preliminaries and Error Analysis Intended learning outcomes: Upon successful completion of this chapter, a student will be able to (1) list

More information

Numerical Analysis Exam with Solutions

Numerical Analysis Exam with Solutions Numerical Analysis Exam with Solutions Richard T. Bumby Fall 000 June 13, 001 You are expected to have books, notes and calculators available, but computers of telephones are not to be used during the

More information

Linear Regression. CSL603 - Fall 2017 Narayanan C Krishnan

Linear Regression. CSL603 - Fall 2017 Narayanan C Krishnan Linear Regression CSL603 - Fall 2017 Narayanan C Krishnan ckn@iitrpr.ac.in Outline Univariate regression Multivariate regression Probabilistic view of regression Loss functions Bias-Variance analysis Regularization

More information

Elements of Floating-point Arithmetic

Elements of Floating-point Arithmetic Elements of Floating-point Arithmetic Sanzheng Qiao Department of Computing and Software McMaster University July, 2012 Outline 1 Floating-point Numbers Representations IEEE Floating-point Standards Underflow

More information

Numerical Differentiation & Integration. Numerical Differentiation II

Numerical Differentiation & Integration. Numerical Differentiation II Numerical Differentiation & Integration Numerical Differentiation II Numerical Analysis (9th Edition) R L Burden & J D Faires Beamer Presentation Slides prepared by John Carroll Dublin City University

More information

Linear Regression. CSL465/603 - Fall 2016 Narayanan C Krishnan

Linear Regression. CSL465/603 - Fall 2016 Narayanan C Krishnan Linear Regression CSL465/603 - Fall 2016 Narayanan C Krishnan ckn@iitrpr.ac.in Outline Univariate regression Multivariate regression Probabilistic view of regression Loss functions Bias-Variance analysis

More information

Linear Regression (continued)

Linear Regression (continued) Linear Regression (continued) Professor Ameet Talwalkar Professor Ameet Talwalkar CS260 Machine Learning Algorithms February 6, 2017 1 / 39 Outline 1 Administration 2 Review of last lecture 3 Linear regression

More information

MATH20602 Numerical Analysis 1

MATH20602 Numerical Analysis 1 M\cr NA Manchester Numerical Analysis MATH20602 Numerical Analysis 1 Martin Lotz School of Mathematics The University of Manchester Manchester, February 1, 2016 Outline General Course Information Introduction

More information

Math 0312 EXAM 2 Review Questions

Math 0312 EXAM 2 Review Questions Name Decide whether the ordered pair is a solution of the given system. 1. 4x + y = 2 2x + 4y = -20 ; (2, -6) Solve the system by graphing. 2. x - y = 6 x + y = 16 Solve the system by substitution. If

More information

CHAPTER 11. A Revision. 1. The Computers and Numbers therein

CHAPTER 11. A Revision. 1. The Computers and Numbers therein CHAPTER A Revision. The Computers and Numbers therein Traditional computer science begins with a finite alphabet. By stringing elements of the alphabet one after another, one obtains strings. A set of

More information

GAUSS-LAGUERRE AND GAUSS-HERMITE QUADRATURE ON 64, 96 AND 128 NODES

GAUSS-LAGUERRE AND GAUSS-HERMITE QUADRATURE ON 64, 96 AND 128 NODES GAUSS-LAGUERRE AND GAUSS-HERMITE QUADRATURE ON 64, 96 AND 128 NODES RICHARD J. MATHAR Abstract. The manuscript provides tables of abscissae and weights for Gauss- Laguerre integration on 64, 96 and 128

More information

Before you begin read these instructions carefully.

Before you begin read these instructions carefully. MATHEMATICAL TRIPOS Part IA Friday, 1 June, 2012 1:30 pm to 4:30 pm PAPER 2 Before you begin read these instructions carefully. The examination paper is divided into two sections. Each question in Section

More information