Introduction to Geometry Optimization. Computational Chemistry lab 2009

Size: px
Start display at page:

Download "Introduction to Geometry Optimization. Computational Chemistry lab 2009"

Transcription

1 Introduction to Geometry Optimization Computational Chemistry lab 9

2 Determination of the molecule configuration H H Diatomic molecule determine the interatomic distance H O H Triatomic molecule determine distances and the angle H N H H Four-atomic molecule determine angles and distances Optimal configurations correspond to minima of the energy as a function of 3N- 6 parameters for an N-atomic molecule (3N atomic coordinates-3 c.o.m coordinates - 3 angles)

3 Solution of the Schrödinger equation in the Born-Oppenheimer approimation: H tot = (T n + V n ) + T e + V ne + V e = (H n ) + H e lectronic S: H e Ψ (r,r)= e (R) Ψ (r,r) Ab-initio or semi-empirical solution e (R) electronic energy R nuclear coordinates V n (R) niclei-nuclei interaction (R)=V n (R)+ e (R) = potential energy surface (PS) Molecular mechanics: PS molecular force field

4 Potential nergy Surface (PS) A hypersurface in 3N-6 -dimensional hyperspace, where N is the number of atoms. Minima equilibrium structures of one or several molecules Saddle points - transition structures connecting equilibrium structures. Global Minimum - that point that is the lowest value in the PS

5 One configuration is nown for H One configuration is nown for H O The planar and pyramidal configurations are nown for NH 3 The number of local minima typically goes eponentially with the number of variables (degrees of freedom). Combinatorial plosion Problem Possible Conformations (3 n ) for linear alanes CH 3 (CH ) n+ CH 3 n = 3 n = 9 n = 5 43 n = 59,49 n = 5 4,348,97

6 Global minimum - Mariana Trench in the Pacific Ocean

7 Optimization/Goals Find the Local Minimum Structure Find the Global Minimum Structure Find the Transition State Structure We would lie to Find the Reaction Pathway Connecting Two Minima and Passing through the Transition State Structure Geometry optimization is the name for the procedure that attempts to find the configuration of minimum energy of the molecule.

8 One-dimensional optimization f 3 maimum f f ()= stationary point f ()< maimum minimum 5 f ()> minimum f' - f''

9 Multidimensional Optimization Force: F=- (Potential energy) - gradient The coordinates can be Cartesian (,y,z..), or internal, such as bondlength and angle displacements) f= - Stationary Point (minimum, maimum, or saddle point)

10 Hessian matri A matri of second-order derivatives of the energy with respect to atomic coordinates (e.g., Cartesian or internal coordinates) Sometimes called force matri matri size of (3N-6)(3N-6) ( H ij ( f ) f i j = Quadratic approimation Approimate the comple energy landscape by harmonic potentials around a stationary point (,... () () () () n [ (,... n ) = ] n n () () = + () (),... n) (,... n ) Hij( )( i i )( j j ) i= j= )

11 Hessian matri diagonalization (eigenproblem) igenvalues igenvectors All ε > ( ω real) minimum ω ε l ( ) j ε = mω - vibrational frequencies n ( ) ( l j give normal coordinates q = li () () (,... ) = (,... + ε q n n ) n = All ε < ( ω imaginary) maimum i= = ) n i= ( i H ij l ( ) i () i ε <> ( ω imaginary/real) saddle point )

12 Steepest Descent Steepest descent direction g=- Ε g - 3N-dimensional vector = + λ g / g i+ i i i i Advantage: fast minimization far from the minimum Disadvantage: slow descent along narrow valleys slow convergence near minima In HYPRCHM if ( i + ) < ( i) then i+ =.λi else λi+ = History gradient information is not ept λ. 5λ i

13 Conjugate Gradient Methods Search direction is chosen using history gradient information Initial direction the steepest descent direction, h = g =- Ε = + ξh i+ i i ξ is defined by a one-dimensional minimization along the search direction. hi+ = gi+ + γ i+ hi g i Fletcher-Reeves method: γ + i+ = gi ( i+ gi ) g Pola-Ribiere method: γ i+ = g g i+ Pola-Ribiere may be superior for nonquadratic functions. i steepest conjugate Gradient history is equivalent to implicit use of the Hessian matri.

14 plicit use of Hessian matri. Quadratic approimation : ( ) = q ε - normal coordinates, and l Newton-Raphson Methods - ( = eigenvalues and eigenvectors of = n q l ), = g n ( F q = n = F l ε q the Hessian matri at, ), One-step optimization of quadratic functions q = F / ε For arbitrary functions n i+ = i + l ( i) F ( i ) / ε ( i = Steeprst descent direction for ε ( i ) > ) Newton- Raphson conjugate Finds the closest stationary point (either minimum, maimum, or saddle point).

15 Numerical calculation (3N) calculations of energy Diagonalization - (3N) 3 operations Memory - (3N) tremely epensive for large molecules. Obtaining, storing, and diagonalaizing the Hessian Bloc Diagonal Newton-Raphson z z y z z y y y z y z z y z z y y y z y Calculation - 9N Diagonalization - 7N Memory 9N

16 ε Gaussian The Hessian matri is calculated and processed on the first step only It is updated using the computed energies and gradients Rational function optimization (RFO) step i+ = and l Berny algorithm i + n = l ( i F ( i ) ) ε ( ) λ λ<min(ε ) (λ< for ε <) - step always toward to a minimum. A linear search between the latest point and the best previous point. i eigenvalues and eigenvectors of the Hessian matri at RFO Newton-Raphson

17 Convergence criteria Gradient or force F=-g=- Ε Predicted displacement i+ - i Maimum force: ma(f)<threshold Root-mean-square (RMS) force: F <threshold Maimum displacement: ma( i+ - i ) <threshold RMS displacement: i+ - i <threshold

18 One configuration is nown for H One configuration is nown for H O The planar and pyramidal configurations are nown for NH 3 The number of local minima typically goes eponentially with the number of variables (degrees of freedom). Combinatorial plosion Problem Possible Conformations (3 n ) for linear alanes CH 3 (CH ) n+ CH 3 n = 3 n = 9 n = 5 43 n = 59,49 n = 5 4,348,97

19 Global minimization "building up" the structure: combining a large molecule from preoptimized fragments (protein from preoptimized aminoacids) conformational sampling: tae various starting points for local minimization (simulation of nature) None of these are guaranteed to find the global minimum!

20 Global Minimum- conformational sampling Molecular Dynamics Monte Carlo Simulated Annealing Tabu search Genetic Algorithms Ant Colony Optimizations Diffusion Methods Distance Geometry Methods

21 Heating above barriers System overcomes barriers at sufficiently high temperature T quilibrium (Boltzmann) distribution P(R)~ep(-(R)/( B T )) Higher probability to find the system near the global minimum

22 Molecular Dynamics Solve equations of motion d T v j = j( R) + ( ) dt m j τ T R j atomic coordinates d v j = R j atomic velocities dt 3 T = v j temperature B j m j T bath temperature τ bath relaation time The trajectory fills available phase space Monte Carlo. One atom is randomly "iced". The energy change = new - old is calculated 3. If < the new configuration is accepted 4. If > the new configuration is accepted with probability ep(- /( B T )) 5. Net atom is randomly "iced" Both methods lead to equilibrium averaged distribution in the limits of infinite time or number of steps

23 Simulated annealing If a slow cooling is applied to a liquid, this liquid freezes naturally to a state of minimum energy. bath temperature heating equilibration cooling ither Molecular-Dynamics or Monte-Carlo simulation can be used. Is guaranteed to find the global minimum if the equilibration is infinitely long and the cooling is infinitely slow.

Project: Vibration of Diatomic Molecules

Project: Vibration of Diatomic Molecules Project: Vibration of Diatomic Molecules Objective: Find the vibration energies and the corresponding vibrational wavefunctions of diatomic molecules H 2 and I 2 using the Morse potential. equired Numerical

More information

Exploring the energy landscape

Exploring the energy landscape Exploring the energy landscape ChE210D Today's lecture: what are general features of the potential energy surface and how can we locate and characterize minima on it Derivatives of the potential energy

More information

Example questions for Molecular modelling (Level 4) Dr. Adrian Mulholland

Example questions for Molecular modelling (Level 4) Dr. Adrian Mulholland Example questions for Molecular modelling (Level 4) Dr. Adrian Mulholland 1) Question. Two methods which are widely used for the optimization of molecular geometies are the Steepest descents and Newton-Raphson

More information

Density Functional Theory

Density Functional Theory Density Functional Theory March 26, 2009 ? DENSITY FUNCTIONAL THEORY is a method to successfully describe the behavior of atomic and molecular systems and is used for instance for: structural prediction

More information

2. The Schrödinger equation for one-particle problems. 5. Atoms and the periodic table of chemical elements

2. The Schrödinger equation for one-particle problems. 5. Atoms and the periodic table of chemical elements 1 Historical introduction The Schrödinger equation for one-particle problems 3 Mathematical tools for quantum chemistry 4 The postulates of quantum mechanics 5 Atoms and the periodic table of chemical

More information

Reactivity and Organocatalysis. (Adalgisa Sinicropi and Massimo Olivucci)

Reactivity and Organocatalysis. (Adalgisa Sinicropi and Massimo Olivucci) Reactivity and Organocatalysis (Adalgisa Sinicropi and Massimo Olivucci) The Aldol Reaction - O R 1 O R 1 + - O O OH * * H R 2 R 1 R 2 The (1957) Zimmerman-Traxler Transition State Counterion (e.g. Li

More information

Simulations with MM Force Fields. Monte Carlo (MC) and Molecular Dynamics (MD) Video II.vi

Simulations with MM Force Fields. Monte Carlo (MC) and Molecular Dynamics (MD) Video II.vi Simulations with MM Force Fields Monte Carlo (MC) and Molecular Dynamics (MD) Video II.vi Some slides taken with permission from Howard R. Mayne Department of Chemistry University of New Hampshire Walking

More information

Molecular Simulation II. Classical Mechanical Treatment

Molecular Simulation II. Classical Mechanical Treatment Molecular Simulation II Quantum Chemistry Classical Mechanics E = Ψ H Ψ ΨΨ U = E bond +E angle +E torsion +E non-bond Jeffry D. Madura Department of Chemistry & Biochemistry Center for Computational Sciences

More information

Unconstrained Multivariate Optimization

Unconstrained Multivariate Optimization Unconstrained Multivariate Optimization Multivariate optimization means optimization of a scalar function of a several variables: and has the general form: y = () min ( ) where () is a nonlinear scalar-valued

More information

MD Thermodynamics. Lecture 12 3/26/18. Harvard SEAS AP 275 Atomistic Modeling of Materials Boris Kozinsky

MD Thermodynamics. Lecture 12 3/26/18. Harvard SEAS AP 275 Atomistic Modeling of Materials Boris Kozinsky MD Thermodynamics Lecture 1 3/6/18 1 Molecular dynamics The force depends on positions only (not velocities) Total energy is conserved (micro canonical evolution) Newton s equations of motion (second order

More information

From Electrons to Materials Properties

From Electrons to Materials Properties From Electrons to Materials Properties: DFT for Engineers and Materials Scientists Funk Fachgebiet Werkstoffe des Bauwesens und Bauchemie Mar-17, 2016 From Electrons to Materials Properties Density Functional

More information

Molecular Bonding. Molecular Schrödinger equation. r - nuclei s - electrons. M j = mass of j th nucleus m 0 = mass of electron

Molecular Bonding. Molecular Schrödinger equation. r - nuclei s - electrons. M j = mass of j th nucleus m 0 = mass of electron Molecular onding Molecular Schrödinger equation r - nuclei s - electrons 1 1 W V r s j i j1 M j m i1 M j = mass of j th nucleus m = mass of electron j i Laplace operator for nuclei Laplace operator for

More information

Normal Mode Analysis. Jun Wan and Willy Wriggers School of Health Information Sciences & Institute of Molecular Medicine University of Texas Houston

Normal Mode Analysis. Jun Wan and Willy Wriggers School of Health Information Sciences & Institute of Molecular Medicine University of Texas Houston Normal Mode Analysis Jun Wan and Willy Wriggers School of Health Information Sciences & Institute of Molecular Medicine University of Teas Houston Contents Introduction --- protein dynamics (lowfrequency

More information

Figure 1: Transition State, Saddle Point, Reaction Pathway

Figure 1: Transition State, Saddle Point, Reaction Pathway Computational Chemistry Workshops West Ridge Research Building-UAF Campus 9:00am-4:00pm, Room 009 Electronic Structure - July 19-21, 2016 Molecular Dynamics - July 26-28, 2016 Potential Energy Surfaces

More information

Chemistry 334 Part 2: Computational Quantum Chemistry

Chemistry 334 Part 2: Computational Quantum Chemistry Chemistry 334 Part 2: Computational Quantum Chemistry 1. Definition Louis Scudiero, Ben Shepler and Kirk Peterson Washington State University January 2006 Computational chemistry is an area of theoretical

More information

Optimization Methods via Simulation

Optimization Methods via Simulation Optimization Methods via Simulation Optimization problems are very important in science, engineering, industry,. Examples: Traveling salesman problem Circuit-board design Car-Parrinello ab initio MD Protein

More information

Today. Introduction to optimization Definition and motivation 1-dimensional methods. Multi-dimensional methods. General strategies, value-only methods

Today. Introduction to optimization Definition and motivation 1-dimensional methods. Multi-dimensional methods. General strategies, value-only methods Optimization Last time Root inding: deinition, motivation Algorithms: Bisection, alse position, secant, Newton-Raphson Convergence & tradeos Eample applications o Newton s method Root inding in > 1 dimension

More information

Chemistry 3502/4502. Final Exam Part I. May 14, 2005

Chemistry 3502/4502. Final Exam Part I. May 14, 2005 Chemistry 3502/4502 Final Exam Part I May 14, 2005 1. For which of the below systems is = where H is the Hamiltonian operator and T is the kinetic-energy operator? (a) The free particle (e) The

More information

Lecture 35 Minimization and maximization of functions. Powell s method in multidimensions Conjugate gradient method. Annealing methods.

Lecture 35 Minimization and maximization of functions. Powell s method in multidimensions Conjugate gradient method. Annealing methods. Lecture 35 Minimization and maximization of functions Powell s method in multidimensions Conjugate gradient method. Annealing methods. We know how to minimize functions in one dimension. If we start at

More information

8 Numerical methods for unconstrained problems

8 Numerical methods for unconstrained problems 8 Numerical methods for unconstrained problems Optimization is one of the important fields in numerical computation, beside solving differential equations and linear systems. We can see that these fields

More information

Same idea for polyatomics, keep track of identical atom e.g. NH 3 consider only valence electrons F(2s,2p) H(1s)

Same idea for polyatomics, keep track of identical atom e.g. NH 3 consider only valence electrons F(2s,2p) H(1s) XIII 63 Polyatomic bonding -09 -mod, Notes (13) Engel 16-17 Balance: nuclear repulsion, positive e-n attraction, neg. united atom AO ε i applies to all bonding, just more nuclei repulsion biggest at low

More information

An Introduction to Quantum Chemistry and Potential Energy Surfaces. Benjamin G. Levine

An Introduction to Quantum Chemistry and Potential Energy Surfaces. Benjamin G. Levine An Introduction to Quantum Chemistry and Potential Energy Surfaces Benjamin G. Levine This Week s Lecture Potential energy surfaces What are they? What are they good for? How do we use them to solve chemical

More information

Statistical Geometry Processing Winter Semester 2011/2012

Statistical Geometry Processing Winter Semester 2011/2012 Statistical Geometry Processing Winter Semester 2011/2012 Linear Algebra, Function Spaces & Inverse Problems Vector and Function Spaces 3 Vectors vectors are arrows in space classically: 2 or 3 dim. Euclidian

More information

Chemistry 3502/4502. Final Exam Part I. May 14, 2005

Chemistry 3502/4502. Final Exam Part I. May 14, 2005 Advocacy chit Chemistry 350/450 Final Exam Part I May 4, 005. For which of the below systems is = where H is the Hamiltonian operator and T is the kinetic-energy operator? (a) The free particle

More information

Quantum Theory of Matter

Quantum Theory of Matter Imperial College London Department of Physics Professor Ortwin Hess o.hess@imperial.ac.uk Quantum Theory of Matter Spring 014 1 Periodic Structures 1.1 Direct and Reciprocal Lattice (a) Show that the reciprocal

More information

Computer simulation can be thought as a virtual experiment. There are

Computer simulation can be thought as a virtual experiment. There are 13 Estimating errors 105 13 Estimating errors Computer simulation can be thought as a virtual experiment. There are systematic errors statistical errors. As systematical errors can be very complicated

More information

Lecture 8 Optimization

Lecture 8 Optimization 4/9/015 Lecture 8 Optimization EE 4386/5301 Computational Methods in EE Spring 015 Optimization 1 Outline Introduction 1D Optimization Parabolic interpolation Golden section search Newton s method Multidimensional

More information

Methods of Computer Simulation. Molecular Dynamics and Monte Carlo

Methods of Computer Simulation. Molecular Dynamics and Monte Carlo Molecular Dynamics Time is of the essence in biological processes therefore how do we understand time-dependent processes at the molecular level? How do we do this experimentally? How do we do this computationally?

More information

( ) 2 75( ) 3

( ) 2 75( ) 3 Chemistry 380.37 Dr. Jean M. Standard Homework Problem Set 3 Solutions 1. The part of a particular MM3-like force field that describes stretching energy for an O-H single bond is given by the following

More information

Making Electronic Structure Theory work

Making Electronic Structure Theory work Making Electronic Structure Theory work Ralf Gehrke Fritz-Haber-Institut der Max-Planck-Gesellschaft Berlin, 23 th June 2009 Hands-on Tutorial on Ab Initio Molecular Simulations: Toward a First-Principles

More information

Numerical Optimization: Basic Concepts and Algorithms

Numerical Optimization: Basic Concepts and Algorithms May 27th 2015 Numerical Optimization: Basic Concepts and Algorithms R. Duvigneau R. Duvigneau - Numerical Optimization: Basic Concepts and Algorithms 1 Outline Some basic concepts in optimization Some

More information

Physics 403. Segev BenZvi. Numerical Methods, Maximum Likelihood, and Least Squares. Department of Physics and Astronomy University of Rochester

Physics 403. Segev BenZvi. Numerical Methods, Maximum Likelihood, and Least Squares. Department of Physics and Astronomy University of Rochester Physics 403 Numerical Methods, Maximum Likelihood, and Least Squares Segev BenZvi Department of Physics and Astronomy University of Rochester Table of Contents 1 Review of Last Class Quadratic Approximation

More information

( ) + ( ) + ( ) = 0.00

( ) + ( ) + ( ) = 0.00 Chem 3502/4502 Physical Chemistry II (Quantum Mechanics) 3 Credits Spring Semester 2006 Christopher J. Cramer Lecture 32, April 14, 2006 (Some material in this lecture has been adapted from Cramer, C.

More information

Molecular energy levels

Molecular energy levels Molecular energy levels Hierarchy of motions and energies in molecules The different types of motion in a molecule (electronic, vibrational, rotational,: : :) take place on different time scales and are

More information

Chapter 10 Conjugate Direction Methods

Chapter 10 Conjugate Direction Methods Chapter 10 Conjugate Direction Methods An Introduction to Optimization Spring, 2012 1 Wei-Ta Chu 2012/4/13 Introduction Conjugate direction methods can be viewed as being intermediate between the method

More information

Gradient Descent. Dr. Xiaowei Huang

Gradient Descent. Dr. Xiaowei Huang Gradient Descent Dr. Xiaowei Huang https://cgi.csc.liv.ac.uk/~xiaowei/ Up to now, Three machine learning algorithms: decision tree learning k-nn linear regression only optimization objectives are discussed,

More information

Chemistry 324, Spring 2002 Geometry Optimization

Chemistry 324, Spring 2002 Geometry Optimization Geometry optimization Page 1 of 9 Review Chemistry 324, Spring 2002 Geometry Optimization By now, you have learned several useful things about molecular modeling. First, you have learned from your work

More information

TECHNIQUES TO LOCATE A TRANSITION STATE

TECHNIQUES TO LOCATE A TRANSITION STATE 32 III. TECHNIQUES TO LOCATE A TRANSITION STATE In addition to the location of minima, the calculation of transition states and reaction pathways is an interesting task for Quantum Chemistry (QC). The

More information

Geometry optimization

Geometry optimization Geometry optimization Trygve Helgaker Centre for Theoretical and Computational Chemistry Department of Chemistry, University of Oslo, Norway European Summer School in Quantum Chemistry (ESQC) 211 Torre

More information

Conjugate gradient algorithm for training neural networks

Conjugate gradient algorithm for training neural networks . Introduction Recall that in the steepest-descent neural network training algorithm, consecutive line-search directions are orthogonal, such that, where, gwt [ ( + ) ] denotes E[ w( t + ) ], the gradient

More information

OPER 627: Nonlinear Optimization Lecture 14: Mid-term Review

OPER 627: Nonlinear Optimization Lecture 14: Mid-term Review OPER 627: Nonlinear Optimization Lecture 14: Mid-term Review Department of Statistical Sciences and Operations Research Virginia Commonwealth University Oct 16, 2013 (Lecture 14) Nonlinear Optimization

More information

Unconstrained optimization

Unconstrained optimization Chapter 4 Unconstrained optimization An unconstrained optimization problem takes the form min x Rnf(x) (4.1) for a target functional (also called objective function) f : R n R. In this chapter and throughout

More information

1 Kernel methods & optimization

1 Kernel methods & optimization Machine Learning Class Notes 9-26-13 Prof. David Sontag 1 Kernel methods & optimization One eample of a kernel that is frequently used in practice and which allows for highly non-linear discriminant functions

More information

DFT and beyond: Hands-on Tutorial Workshop Tutorial 1: Basics of Electronic Structure Theory

DFT and beyond: Hands-on Tutorial Workshop Tutorial 1: Basics of Electronic Structure Theory DFT and beyond: Hands-on Tutorial Workshop 2011 Tutorial 1: Basics of Electronic Structure Theory V. Atalla, O. T. Hofmann, S. V. Levchenko Theory Department, Fritz-Haber-Institut der MPG Berlin July 13,

More information

Topic 8c Multi Variable Optimization

Topic 8c Multi Variable Optimization Course Instructor Dr. Raymond C. Rumpf Office: A 337 Phone: (915) 747 6958 E Mail: rcrumpf@utep.edu Topic 8c Multi Variable Optimization EE 4386/5301 Computational Methods in EE Outline Mathematical Preliminaries

More information

Molecular Mechanics. I. Quantum mechanical treatment of molecular systems

Molecular Mechanics. I. Quantum mechanical treatment of molecular systems Molecular Mechanics I. Quantum mechanical treatment of molecular systems The first principle approach for describing the properties of molecules, including proteins, involves quantum mechanics. For example,

More information

5.1 Classical Harmonic Oscillator

5.1 Classical Harmonic Oscillator Chapter 5 Harmonic Oscillator 5.1 Classical Harmonic Oscillator m l o l Hooke s Law give the force exerting on the mass as: f = k(l l o ) where l o is the equilibrium length of the spring and k is the

More information

(One Dimension) Problem: for a function f(x), find x 0 such that f(x 0 ) = 0. f(x)

(One Dimension) Problem: for a function f(x), find x 0 such that f(x 0 ) = 0. f(x) Solving Nonlinear Equations & Optimization One Dimension Problem: or a unction, ind 0 such that 0 = 0. 0 One Root: The Bisection Method This one s guaranteed to converge at least to a singularity, i not

More information

, b = 0. (2) 1 2 The eigenvectors of A corresponding to the eigenvalues λ 1 = 1, λ 2 = 3 are

, b = 0. (2) 1 2 The eigenvectors of A corresponding to the eigenvalues λ 1 = 1, λ 2 = 3 are Quadratic forms We consider the quadratic function f : R 2 R defined by f(x) = 2 xt Ax b T x with x = (x, x 2 ) T, () where A R 2 2 is symmetric and b R 2. We will see that, depending on the eigenvalues

More information

The Conjugate Gradient Method

The Conjugate Gradient Method The Conjugate Gradient Method Lecture 5, Continuous Optimisation Oxford University Computing Laboratory, HT 2006 Notes by Dr Raphael Hauser (hauser@comlab.ox.ac.uk) The notion of complexity (per iteration)

More information

L20: MLPs, RBFs and SPR Bayes discriminants and MLPs The role of MLP hidden units Bayes discriminants and RBFs Comparison between MLPs and RBFs

L20: MLPs, RBFs and SPR Bayes discriminants and MLPs The role of MLP hidden units Bayes discriminants and RBFs Comparison between MLPs and RBFs L0: MLPs, RBFs and SPR Bayes discriminants and MLPs The role of MLP hidden units Bayes discriminants and RBFs Comparison between MLPs and RBFs CSCE 666 Pattern Analysis Ricardo Gutierrez-Osuna CSE@TAMU

More information

A6523 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Spring

A6523 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Spring A6523 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Spring 2015 http://www.astro.cornell.edu/~cordes/a6523 Lecture 23:! Nonlinear least squares!! Notes Modeling2015.pdf on course

More information

Numerical Optimization Professor Horst Cerjak, Horst Bischof, Thomas Pock Mat Vis-Gra SS09

Numerical Optimization Professor Horst Cerjak, Horst Bischof, Thomas Pock Mat Vis-Gra SS09 Numerical Optimization 1 Working Horse in Computer Vision Variational Methods Shape Analysis Machine Learning Markov Random Fields Geometry Common denominator: optimization problems 2 Overview of Methods

More information

Comparison of methods for finding saddle points without knowledge of the final states

Comparison of methods for finding saddle points without knowledge of the final states JOURNAL OF CHEMICAL PHYSICS VOLUME 121, NUMBER 20 22 NOVEMBER 2004 Comparison of methods for finding saddle points without knowledge of the final states R. A. Olsen and G. J. Kroes Leiden Institute of

More information

Transition states and reaction paths

Transition states and reaction paths Transition states and reaction paths Lab 4 Theoretical background Transition state A transition structure is the molecular configuration that separates reactants and products. In a system with a single

More information

Minimization of Static! Cost Functions!

Minimization of Static! Cost Functions! Minimization of Static Cost Functions Robert Stengel Optimal Control and Estimation, MAE 546, Princeton University, 2017 J = Static cost function with constant control parameter vector, u Conditions for

More information

Multivariate Newton Minimanization

Multivariate Newton Minimanization Multivariate Newton Minimanization Optymalizacja syntezy biosurfaktantu Rhamnolipid Rhamnolipids are naturally occuring glycolipid produced commercially by the Pseudomonas aeruginosa species of bacteria.

More information

Geometry Optimisation

Geometry Optimisation Geometry Optimisation Matt Probert Condensed Matter Dynamics Group Department of Physics, University of York, UK http://www.cmt.york.ac.uk/cmd http://www.castep.org Motivation Overview of Talk Background

More information

Phonons and lattice dynamics

Phonons and lattice dynamics Chapter Phonons and lattice dynamics. Vibration modes of a cluster Consider a cluster or a molecule formed of an assembly of atoms bound due to a specific potential. First, the structure must be relaxed

More information

Vasil Khalidov & Miles Hansard. C.M. Bishop s PRML: Chapter 5; Neural Networks

Vasil Khalidov & Miles Hansard. C.M. Bishop s PRML: Chapter 5; Neural Networks C.M. Bishop s PRML: Chapter 5; Neural Networks Introduction The aim is, as before, to find useful decompositions of the target variable; t(x) = y(x, w) + ɛ(x) (3.7) t(x n ) and x n are the observations,

More information

Rotations and vibrations of polyatomic molecules

Rotations and vibrations of polyatomic molecules Rotations and vibrations of polyatomic molecules When the potential energy surface V( R 1, R 2,..., R N ) is known we can compute the energy levels of the molecule. These levels can be an effect of: Rotation

More information

22 Path Optimisation Methods

22 Path Optimisation Methods 22 Path Optimisation Methods 204 22 Path Optimisation Methods Many interesting chemical and physical processes involve transitions from one state to another. Typical examples are migration paths for defects

More information

Molecular Mechanics, Dynamics & Docking

Molecular Mechanics, Dynamics & Docking Molecular Mechanics, Dynamics & Docking Lawrence Hunter, Ph.D. Director, Computational Bioscience Program University of Colorado School of Medicine Larry.Hunter@uchsc.edu http://compbio.uchsc.edu/hunter

More information

Intro/Review of Quantum

Intro/Review of Quantum Intro/Review of Quantum QM-1 So you might be thinking I thought I could avoid Quantum Mechanics?!? Well we will focus on thermodynamics and kinetics, but we will consider this topic with reference to the

More information

Chapter 6. Nonlinear Equations. 6.1 The Problem of Nonlinear Root-finding. 6.2 Rate of Convergence

Chapter 6. Nonlinear Equations. 6.1 The Problem of Nonlinear Root-finding. 6.2 Rate of Convergence Chapter 6 Nonlinear Equations 6. The Problem of Nonlinear Root-finding In this module we consider the problem of using numerical techniques to find the roots of nonlinear equations, f () =. Initially we

More information

Harmonic Oscillator Eigenvalues and Eigenfunctions

Harmonic Oscillator Eigenvalues and Eigenfunctions Chemistry 46 Fall 217 Dr. Jean M. Standard October 4, 217 Harmonic Oscillator Eigenvalues and Eigenfunctions The Quantum Mechanical Harmonic Oscillator The quantum mechanical harmonic oscillator in one

More information

Intro/Review of Quantum

Intro/Review of Quantum Intro/Review of Quantum QM-1 So you might be thinking I thought I could avoid Quantum Mechanics?!? Well we will focus on thermodynamics and kinetics, but we will consider this topic with reference to the

More information

LECTURE # - NEURAL COMPUTATION, Feb 04, Linear Regression. x 1 θ 1 output... θ M x M. Assumes a functional form

LECTURE # - NEURAL COMPUTATION, Feb 04, Linear Regression. x 1 θ 1 output... θ M x M. Assumes a functional form LECTURE # - EURAL COPUTATIO, Feb 4, 4 Linear Regression Assumes a functional form f (, θ) = θ θ θ K θ (Eq) where = (,, ) are the attributes and θ = (θ, θ, θ ) are the function parameters Eample: f (, θ)

More information

Example - Newton-Raphson Method

Example - Newton-Raphson Method Eample - Newton-Raphson Method We now consider the following eample: minimize f( 3 3 + -- 4 4 Since f ( 3 2 + 3 3 and f ( 6 + 9 2 we form the following iteration: + n 3 ( n 3 3( n 2 ------------------------------------

More information

Optimization. Next: Curve Fitting Up: Numerical Analysis for Chemical Previous: Linear Algebraic and Equations. Subsections

Optimization. Next: Curve Fitting Up: Numerical Analysis for Chemical Previous: Linear Algebraic and Equations. Subsections Next: Curve Fitting Up: Numerical Analysis for Chemical Previous: Linear Algebraic and Equations Subsections One-dimensional Unconstrained Optimization Golden-Section Search Quadratic Interpolation Newton's

More information

The Potential Energy Surface (PES) Preamble to the Basic Force Field Chem 4021/8021 Video II.i

The Potential Energy Surface (PES) Preamble to the Basic Force Field Chem 4021/8021 Video II.i The Potential Energy Surface (PES) Preamble to the Basic Force Field Chem 4021/8021 Video II.i The Potential Energy Surface Captures the idea that each structure that is, geometry has associated with it

More information

EFFICIENT SAMPLING OF SADDLE POINTS WITH THE MINIMUM-MODE FOLLOWING METHOD

EFFICIENT SAMPLING OF SADDLE POINTS WITH THE MINIMUM-MODE FOLLOWING METHOD SIAM J. SCI. COMPUT. Vol. 33, No. 2, pp. 633 652 c 2011 Society for Industrial and Applied Mathematics EFFICIENT SAMPLING OF SADDLE POINTS WITH THE MINIMUM-MODE FOLLOWING METHOD ANDREAS PEDERSEN, SIGURDUR

More information

A Primer on Multidimensional Optimization

A Primer on Multidimensional Optimization A Primer on Multidimensional Optimization Prof. Dr. Florian Rupp German University of Technology in Oman (GUtech) Introduction to Numerical Methods for ENG & CS (Mathematics IV) Spring Term 2016 Eercise

More information

Steepest descent algorithm. Conjugate gradient training algorithm. Steepest descent algorithm. Remember previous examples

Steepest descent algorithm. Conjugate gradient training algorithm. Steepest descent algorithm. Remember previous examples Conjugate gradient training algorithm Steepest descent algorithm So far: Heuristic improvements to gradient descent (momentum Steepest descent training algorithm Can we do better? Definitions: weight vector

More information

Report due date. Please note: report has to be handed in by Monday, May 16 noon.

Report due date. Please note: report has to be handed in by Monday, May 16 noon. Lecture 23 18.86 Report due date Please note: report has to be handed in by Monday, May 16 noon. Course evaluation: Please submit your feedback (you should have gotten an email) From the weak form to finite

More information

= F ( x; µ) (1) where x is a 2-dimensional vector, µ is a parameter, and F :

= F ( x; µ) (1) where x is a 2-dimensional vector, µ is a parameter, and F : 1 Bifurcations Richard Bertram Department of Mathematics and Programs in Neuroscience and Molecular Biophysics Florida State University Tallahassee, Florida 32306 A bifurcation is a qualitative change

More information

Programming, numerics and optimization

Programming, numerics and optimization Programming, numerics and optimization Lecture C-3: Unconstrained optimization II Łukasz Jankowski ljank@ippt.pan.pl Institute of Fundamental Technological Research Room 4.32, Phone +22.8261281 ext. 428

More information

A dimer method for finding saddle points on high dimensional potential surfaces using only first derivatives

A dimer method for finding saddle points on high dimensional potential surfaces using only first derivatives JOURNAL OF CHEMICAL PHYSICS VOLUME 111, NUMBER 15 15 OCTOBER 1999 A dimer method for finding saddle points on high dimensional potential surfaces using only first derivatives Graeme Henkelman and Hannes

More information

Methods that avoid calculating the Hessian. Nonlinear Optimization; Steepest Descent, Quasi-Newton. Steepest Descent

Methods that avoid calculating the Hessian. Nonlinear Optimization; Steepest Descent, Quasi-Newton. Steepest Descent Nonlinear Optimization Steepest Descent and Niclas Börlin Department of Computing Science Umeå University niclas.borlin@cs.umu.se A disadvantage with the Newton method is that the Hessian has to be derived

More information

ECE 595, Section 10 Numerical Simulations Lecture 7: Optimization and Eigenvalues. Prof. Peter Bermel January 23, 2013

ECE 595, Section 10 Numerical Simulations Lecture 7: Optimization and Eigenvalues. Prof. Peter Bermel January 23, 2013 ECE 595, Section 10 Numerical Simulations Lecture 7: Optimization and Eigenvalues Prof. Peter Bermel January 23, 2013 Outline Recap from Friday Optimization Methods Brent s Method Golden Section Search

More information

Improving the Convergence of Back-Propogation Learning with Second Order Methods

Improving the Convergence of Back-Propogation Learning with Second Order Methods the of Back-Propogation Learning with Second Order Methods Sue Becker and Yann le Cun, Sept 1988 Kasey Bray, October 2017 Table of Contents 1 with Back-Propagation 2 the of BP 3 A Computationally Feasible

More information

Chemistry 431. NC State University. Lecture 17. Vibrational Spectroscopy

Chemistry 431. NC State University. Lecture 17. Vibrational Spectroscopy Chemistry 43 Lecture 7 Vibrational Spectroscopy NC State University The Dipole Moment Expansion The permanent dipole moment of a molecule oscillates about an equilibrium value as the molecule vibrates.

More information

Spectroscopy: Tinoco Chapter 10 (but vibration, Ch.9)

Spectroscopy: Tinoco Chapter 10 (but vibration, Ch.9) Spectroscopy: Tinoco Chapter 10 (but vibration, Ch.9) XIV 67 Vibrational Spectroscopy (Typical for IR and Raman) Born-Oppenheimer separate electron-nuclear motion ψ (rr) = χ υ (R) φ el (r,r) -- product

More information

Functions of Several Variables

Functions of Several Variables Functions of Several Variables The Unconstrained Minimization Problem where In n dimensions the unconstrained problem is stated as f() x variables. minimize f()x x, is a scalar objective function of vector

More information

Dispersion relation for transverse waves in a linear chain of particles

Dispersion relation for transverse waves in a linear chain of particles Dispersion relation for transverse waves in a linear chain of particles V. I. Repchenkov* It is difficult to overestimate the importance that have for the development of science the simplest physical and

More information

ECE580 Exam 2 November 01, Name: Score: / (20 points) You are given a two data sets

ECE580 Exam 2 November 01, Name: Score: / (20 points) You are given a two data sets ECE580 Exam 2 November 01, 2011 1 Name: Score: /100 You must show ALL of your work for full credit. This exam is closed-book. Calculators may NOT be used. Please leave fractions as fractions, etc. I do

More information

Outline. Escaping the Double Cone: Describing the Seam Space with Gateway Modes. Columbus Workshop Argonne National Laboratory 2005

Outline. Escaping the Double Cone: Describing the Seam Space with Gateway Modes. Columbus Workshop Argonne National Laboratory 2005 Outline Escaping the Double Cone: Describing the Seam Space with Gateway Modes Columbus Worshop Argonne National Laboratory 005 Outline I. Motivation II. Perturbation Theory and Intersection Adapted Coordinates

More information

What is Classical Molecular Dynamics?

What is Classical Molecular Dynamics? What is Classical Molecular Dynamics? Simulation of explicit particles (atoms, ions,... ) Particles interact via relatively simple analytical potential functions Newton s equations of motion are integrated

More information

MOLECULAR STRUCTURE. The general molecular Schrödinger equation, apart from electron spin effects, is. nn ee en

MOLECULAR STRUCTURE. The general molecular Schrödinger equation, apart from electron spin effects, is. nn ee en MOLECULAR STRUCTURE The Born-Oppenheimer Approximation The general molecular Schrödinger equation, apart from electron spin effects, is ( ) + + V + V + V =E nn ee en T T ψ ψ n e where the operators in

More information

Density Functional Theory: from theory to Applications

Density Functional Theory: from theory to Applications Density Functional Theory: from theory to Applications Uni Mainz May 27, 2012 Large barrier-activated processes time-dependent bias potential extended Lagrangian formalism Basic idea: during the MD dynamics

More information

(2 pts) a. What is the time-dependent Schrödinger Equation for a one-dimensional particle in the potential, V (x)?

(2 pts) a. What is the time-dependent Schrödinger Equation for a one-dimensional particle in the potential, V (x)? Part I: Quantum Mechanics: Principles & Models 1. General Concepts: (2 pts) a. What is the time-dependent Schrödinger Equation for a one-dimensional particle in the potential, V (x)? (4 pts) b. How does

More information

Handout 10. Applications to Solids

Handout 10. Applications to Solids ME346A Introduction to Statistical Mechanics Wei Cai Stanford University Win 2011 Handout 10. Applications to Solids February 23, 2011 Contents 1 Average kinetic and potential energy 2 2 Virial theorem

More information

Molecular Dynamics. Park City June 2005 Tully

Molecular Dynamics. Park City June 2005 Tully Molecular Dynamics John Lance Natasa Vinod Xiaosong Dufie Priya Sharani Hongzhi Group: August, 2004 Prelude: Classical Mechanics Newton s equations: F = ma = mq = p Force is the gradient of the potential:

More information

/2Mα 2 α + V n (R)] χ (R) = E υ χ υ (R)

/2Mα 2 α + V n (R)] χ (R) = E υ χ υ (R) Spectroscopy: Engel Chapter 18 XIV 67 Vibrational Spectroscopy (Typically IR and Raman) Born-Oppenheimer approx. separate electron-nuclear Assume elect-nuclear motion separate, full wave fct. ψ (r,r) =

More information

ECE580 Exam 1 October 4, Please do not write on the back of the exam pages. Extra paper is available from the instructor.

ECE580 Exam 1 October 4, Please do not write on the back of the exam pages. Extra paper is available from the instructor. ECE580 Exam 1 October 4, 2012 1 Name: Solution Score: /100 You must show ALL of your work for full credit. This exam is closed-book. Calculators may NOT be used. Please leave fractions as fractions, etc.

More information

Introduction to gradient descent

Introduction to gradient descent 6-1: Introduction to gradient descent Prof. J.C. Kao, UCLA Introduction to gradient descent Derivation and intuitions Hessian 6-2: Introduction to gradient descent Prof. J.C. Kao, UCLA Introduction Our

More information

Mathematical optimization

Mathematical optimization Optimization Mathematical optimization Determine the best solutions to certain mathematically defined problems that are under constrained determine optimality criteria determine the convergence of the

More information

G : Statistical Mechanics

G : Statistical Mechanics G5.651: Statistical Mechanics Notes for Lecture 1 I. DERIVATION OF THE DISCRETIZED PATH INTEGRAL We begin our discussion of the Feynman path integral with the canonical ensemble. The epressions for the

More information

Tools for QM studies of large systems

Tools for QM studies of large systems Tools for QM studies of large systems Automated, hessian-free saddle point search & characterization QM/MM implementation for zeolites Shaama Mallikarjun Sharada Advisors: Prof. Alexis T Bell, Prof. Martin

More information

Neural Network Training

Neural Network Training Neural Network Training Sargur Srihari Topics in Network Training 0. Neural network parameters Probabilistic problem formulation Specifying the activation and error functions for Regression Binary classification

More information