Interatomic potentials with error bars. Gábor Csányi Engineering Laboratory

Size: px
Start display at page:

Download "Interatomic potentials with error bars. Gábor Csányi Engineering Laboratory"

Transcription

1 Interatomic potentials with error bars Gábor Csányi Engineering Laboratory

2 What makes a potential Ingredients Desirable properties Representation of atomic neighbourhood smoothness, faithfulness, continuity Interpolation of functions flexible but smooth functional form, few sensible parameters Database of configurations predictive power non-domain specific

3 What makes a potential Ingredients Desirable properties {Functional form Representation of atomic neighbourhood Interpolation of functions smoothness, faithfulness, continuity flexible but smooth functional form, few sensible parameters Database of configurations predictive power non-domain specific

4 Function fitting with basis functions Fit a function f(x) based on observations y {y i } at {x i } f(x) = NX i k(x i,x) e.g. k(x, x 0 )= we 2 x x0 2 /2 2 i=1

5 Function fitting with basis functions Fit a function f(x) based on observations y {y i } at {x i } f(x) = y j = NX i k(x i,x) e.g. k(x, x 0 )= we 2 x x0 2 /2 2 NX i k(x i,x j ) i=1 i=1

6 Function fitting with basis functions Fit a function f(x) based on observations y {y i } at {x i } f(x) = y j = NX i k(x i,x) e.g. k(x, x 0 )= we 2 x x0 2 /2 2 i=1 NX regularised fit: i k(x i,x j )+ 2 ij arbitrary σ,σw,σν i=1

7 Function fitting with basis functions Fit a function f(x) based on observations y {y i } at {x i } f(x) = y j = NX i=1 NX i=1 y =(K + = C 1 y i k(x i,x) i k(x i,x j )+ 2 ij 2 I) e.g. k(x, x 0 )= 2 we x x0 2 /2 2 regularised fit: arbitrary σ,σw,σν [K] ij k(x i,x j ) C K + 2 I k k(x i,x)

8 Function fitting with basis functions Fit a function f(x) based on observations y {y i } at {x i } f(x) = y j = NX i=1 NX i=1 y =(K + = C 1 y i k(x i,x) f(x) =k T C 1 y i k(x i,x j )+ 2 ij 2 I) e.g. k(x, x 0 )= 2 we x x0 2 /2 2 regularised fit: arbitrary σ,σw,σν [K] ij k(x i,x j ) C K + 2 I k k(x i,x)

9 Function fitting with basis functions Fit a function f(x) based on observations y {y i } at {x i } f(x) = y j = NX i=1 NX i=1 y =(K + = C 1 y i k(x i,x) i k(x i,x j )+ 2 ij 2 I) e.g. k(x, x 0 )= 2 we x x0 2 /2 2 regularised fit: arbitrary σ,σw,σν [K] ij k(x i,x j ) C K + 2 I k k(x i,x) f(x) =k T C 1 y

10 Machine learning framework: Kernel regression "(q (i) )= NX k k K q (i), q (k) Linear regression: K DP (q (i), q (k) )=q (i) q (k) Neural networks "(q (i) )= X j K NN q (i), q (k) = q (i) q (k) 2 + const. q (i) j NX k k q (k) j = q (i) Gaussian kernel K SE q (i), q (k) =exp X j (q (i) q (k) ) j

11 1D example 1 f(x) GP splines f(x) r Gaussians basis functions are wide! f(x) =k T C 1 y

12 Samples from Gaussian posterior P (y N+1 y) / Normal(k T C 1 y,...)

13 Samples from Gaussian posterior P (y N+1 y) / Normal(k T C 1 y,...)

14 Samples from Gaussian posterior P (y N+1 y) / Normal(k T C 1 y,...)

15 Samples from Gaussian posterior P (y N+1 y) / Normal(k T C 1 y,...)

16 Samples from Gaussian posterior P (y N+1 y) / Normal(k T C 1 y,...)

17 Generalised input data Often direct measurements of yi not available Consider any linear operator Compute P (y N+1 L(y) L(y) L can be built using etc Basis functions adapt to input data, e.g. for derivative x 0 )/@x Can deal with gradient data, sums, etc.

18 Traditional ideas for functional forms Pair potentials: Lennard-Jones, RDF-derived, etc. Three-body terms: Stillinger-Weber, MEAM, etc. " i = 1 2 X j V 2 ( r ij ) Embedded Atom (no angular dependence) Bond Order Potential (BOP) Tight-binding-derived attractive term with pair-potential repulsion ReaxFF: kitchen-sink + hundreds of parameters " i = P j ( r ij )

19 Traditional ideas for functional forms Pair potentials: Lennard-Jones, RDF-derived, etc. Three-body terms: Stillinger-Weber, MEAM, etc. " i = 1 2 X j V 2 ( r ij ) Embedded Atom (no angular dependence) Bond Order Potential (BOP) Tight-binding-derived attractive term with pair-potential repulsion ReaxFF: kitchen-sink + hundreds of parameters " i = P j ( r ij ) Representation is implicit

20 Traditional ideas for functional forms Pair potentials: Lennard-Jones, RDF-derived, etc. Three-body terms: Stillinger-Weber, MEAM, etc. " i = 1 2 X j V 2 ( r ij ) Embedded Atom (no angular dependence) Bond Order Potential (BOP) Tight-binding-derived attractive term with pair-potential repulsion ReaxFF: kitchen-sink + hundreds of parameters " i = P j ( r ij ) Representation is implicit These are NOT THE CORRECT functions. Limited accuracy, not systematic

21 Traditional ideas for functional forms Pair potentials: Lennard-Jones, RDF-derived, etc. Three-body terms: Stillinger-Weber, MEAM, etc. " i = 1 2 X j V 2 ( r ij ) Embedded Atom (no angular dependence) Bond Order Potential (BOP) Tight-binding-derived attractive term with pair-potential repulsion ReaxFF: kitchen-sink + hundreds of parameters " i = P j ( r ij ) Representation is implicit These are NOT THE CORRECT functions. Limited accuracy, not systematic given by GOAL: potentials based on quantum mechanics

22 Fundamental limitation of analytic functional form Energy [ev / atom] Tungsten, Embedded Finnis-Sinclair Atom Model bcc fcc sc DFT bcc fcc sc Carbon (diamond) Brenner DFT Volume [A 3 / atom] Elastic constants: Brenner

23 Construct smooth similarity kernel directly cutoff: compact support

24 Construct smooth similarity kernel directly Overlap integral Z S( i, i 0)= i (r) i 0(r)dr, cutoff: compact support

25 Construct smooth similarity kernel directly Overlap integral Z S( i, i 0)= i (r) i 0(r)dr, Integrate over all 3D rotations: Z k( i, i 0)= S( i, ˆR i 0) 2 d ˆR = Z d ˆR cutoff: compact support Z i (r) i 0( ˆRr)dr 2

26 Construct smooth similarity kernel directly Overlap integral Z S( i, i 0)= i (r) i 0(r)dr, Integrate over all 3D rotations: Z k( i, i 0)= S( i, ˆR i 0) 2 d ˆR = Z d ˆR cutoff: compact support Z i (r) i 0( ˆRr)dr 2 After LOTS of algebra: X SOAP kernel k( i, i 0)= n,n 0,l p (i) nn 0 l p(i0 ) nn 0 l nl p nn 0 l = c nl c n 0 l

27 Construct smooth similarity kernel directly Overlap integral Z S( i, i 0)= i (r) i 0(r)dr, Integrate over all 3D rotations: Z k( i, i 0)= S( i, ˆR i 0) 2 d ˆR = Z d ˆR cutoff: compact support Z i (r) i 0( ˆRr)dr 2 After LOTS of algebra: X SOAP kernel k( i, i 0)= n,n 0,l p (i) nn 0 l p(i0 ) nn 0 l nl p nn 0 l = c nl c n 0 l

28 How to generate databases? Target applications: large systems Capability of full quantum mechanics (QM): small systems QM MD on representative small systems: sheared primitive cell elasticity large unit cell phonons surface unit cells surface energy gamma surfaces screw dislocation vacancy in small cell vacancy gamma surface vacancy near dislocation Iterative refinement 1. QM MD Initial database 2. Model MD 3. QM Revised database What is the acceptable validation protocol? How far can the domain of validity be extended?

29 Existing potentials for tungsten Error 15% 50% BOP MEAM FS DFT reference 0 C11 C12 C44 Elastic const. Vacancy energy (100) (110) (111) (112) Surface energy

30 Building up databases for tungsten (W)

31 Existing potentials for tungsten Error 15% 50% BOP MEAM FS DFT reference 0 C11 C12 C44 Elastic const. Vacancy energy (100) (110) (111) (112) Surface energy

32 Existing potentials for tungsten Error DFT reference 15% 0 50% GAP BOP MEAM FS C11 C12 C44 Elastic const. Vacancy energy (100) (110) (111) (112) Surface energy

33 Peierls barrier for screw dislocation glide

34 Vacancy-dislocation binding energy (~100,000 atoms in 3D simulation box)

35 He-Vacancy interaction in tungsten - preliminary Collaboration with Duc Nguyen-Manh (CCFE) Add He-W interaction on top of W potential 200 training configurations of He@V, 44 test energy error force error

36 He-Vacancy interaction in tungsten 2-body SOAP-GAP Needs more He data, other defects Do the same with with Takuji Oda

37 Self-aware potentials: predicting the error Bulk silicon: Diamond and Beta-tin phases Predicted error correctly signals where GAP is unreliable Energy Error

38 Outstanding problems Accuracy on database accuracy in properties? Database contents region of validity? Alloys - permutational complexity? Chemical variability? Systematic treatment of long range effects Electronic temperature

Machine learning the Born-Oppenheimer potential energy surface: from molecules to materials. Gábor Csányi Engineering Laboratory

Machine learning the Born-Oppenheimer potential energy surface: from molecules to materials. Gábor Csányi Engineering Laboratory Machine learning the Born-Oppenheimer potential energy surface: from molecules to materials Gábor Csányi Engineering Laboratory Interatomic potentials for molecular dynamics Transferability biomolecular

More information

Accuracy and transferability of GAP models for tungsten

Accuracy and transferability of GAP models for tungsten Accuracy and transferability of GAP models for tungsten Wojciech J. Szlachta Albert P. Bartók Gábor Csányi Engineering Laboratory University of Cambridge 5 November 214 Motivation Number of atoms 1 1 2

More information

Potentials, periodicity

Potentials, periodicity Potentials, periodicity Lecture 2 1/23/18 1 Survey responses 2 Topic requests DFT (10), Molecular dynamics (7), Monte Carlo (5) Machine Learning (4), High-throughput, Databases (4) NEB, phonons, Non-equilibrium

More information

From Atoms to Materials: Predictive Theory and Simulations

From Atoms to Materials: Predictive Theory and Simulations From Atoms to Materials: Predictive Theory and Simulations Week 3 Lecture 4 Potentials for metals and semiconductors Ale Strachan strachan@purdue.edu School of Materials Engineering & Birck anotechnology

More information

2. Surface geometric and electronic structure: a primer

2. Surface geometric and electronic structure: a primer 2. Surface geometric and electronic structure: a primer 2.1 Surface crystallography 2.1.1. Crystal structures - A crystal structure is made up of two basic elements: lattice + basis Basis: Lattice: simplest

More information

Interatomic Potentials. The electronic-structure problem

Interatomic Potentials. The electronic-structure problem Interatomic Potentials Before we can start a simulation, we need the model! Interaction between atoms and molecules is determined by quantum mechanics: Schrödinger Equation + Born-Oppenheimer approximation

More information

Reactive potentials and applications

Reactive potentials and applications 1.021, 3.021, 10.333, 22.00 Introduction to Modeling and Simulation Spring 2011 Part I Continuum and particle methods Reactive potentials and applications Lecture 8 Markus J. Buehler Laboratory for Atomistic

More information

Bond-order potential for molybdenum: Application to dislocation behavior

Bond-order potential for molybdenum: Application to dislocation behavior Bond-order potential for molybdenum: Application to dislocation behavior M. Mrovec, 1,* D. Nguyen-Manh, 2, D. G. Pettifor, 2 and V. Vitek 1, 1 Department of Materials Science and Engineering, University

More information

Set the initial conditions r i. Update neighborlist. r i. Get new forces F i. Solve the equations of motion numerically over time step t : r i t n

Set the initial conditions r i. Update neighborlist. r i. Get new forces F i. Solve the equations of motion numerically over time step t : r i t n Set the initial conditions r i t 0, v i t 0 Update neighborlist Get new forces F i r i Potential models for diamond and zincblende structures Solve the equations of motion numerically over time step t

More information

Modèle de liaisons fortes au 4ème moment pour traiter l ordre-désordre dans les alliages

Modèle de liaisons fortes au 4ème moment pour traiter l ordre-désordre dans les alliages Modèle de liaisons fortes au 4ème moment pour traiter l ordre-désordre dans les alliages Jan Los, Christine Mottet, Guy Tréglia CINaM, Marseille Christine Goyhenex IPCMS, Strasbourg Outline Context Tight

More information

COMP 551 Applied Machine Learning Lecture 20: Gaussian processes

COMP 551 Applied Machine Learning Lecture 20: Gaussian processes COMP 55 Applied Machine Learning Lecture 2: Gaussian processes Instructor: Ryan Lowe (ryan.lowe@cs.mcgill.ca) Slides mostly by: (herke.vanhoof@mcgill.ca) Class web page: www.cs.mcgill.ca/~hvanho2/comp55

More information

Material Surfaces, Grain Boundaries and Interfaces: Structure-Property Relationship Predictions

Material Surfaces, Grain Boundaries and Interfaces: Structure-Property Relationship Predictions Material Surfaces, Grain Boundaries and Interfaces: Structure-Property Relationship Predictions Susan B. Sinnott Department of Materials Science and Engineering Penn State University September 16, 2016

More information

GWAS V: Gaussian processes

GWAS V: Gaussian processes GWAS V: Gaussian processes Dr. Oliver Stegle Christoh Lippert Prof. Dr. Karsten Borgwardt Max-Planck-Institutes Tübingen, Germany Tübingen Summer 2011 Oliver Stegle GWAS V: Gaussian processes Summer 2011

More information

Force Fields in Molecular Mechanics

Force Fields in Molecular Mechanics Force Fields in Molecular Mechanics Rajarshi Guha (9915607) and Rajesh Sardar (9915610) March 21, 2001 1 Introduction With the advent of computers chemists have realized the utility of carrying out simulations

More information

Classical potentials for metals

Classical potentials for metals Classical potentials for metals About 80 % of all elements are metals. The crystal structures of the elements are distributed as follows: FCC 15 HCP 26 BCC 16 All other metals 13 So if we can describe

More information

Lecture contents. A few concepts from Quantum Mechanics. Tight-binding model Solid state physics review

Lecture contents. A few concepts from Quantum Mechanics. Tight-binding model Solid state physics review Lecture contents A few concepts from Quantum Mechanics Particle in a well Two wells: QM perturbation theory Many wells (atoms) BAND formation Tight-binding model Solid state physics review Approximations

More information

Gaussian Approximation Potentials: a brief tutorial introduction

Gaussian Approximation Potentials: a brief tutorial introduction Gaussian Approximation Potentials: a brief tutorial introduction Albert P. Bartók and Gábor Csányi Engineering Laboratory, University of Cambridge, Trumpington Street, Cambridge, CB2 1PZ, United Kingdom

More information

Comparisons of DFT-MD, TB- MD and classical MD calculations of radiation damage and plasmawallinteractions

Comparisons of DFT-MD, TB- MD and classical MD calculations of radiation damage and plasmawallinteractions CMS Comparisons of DFT-MD, TB- MD and classical MD calculations of radiation damage and plasmawallinteractions Kai Nordlund Department of Physics and Helsinki Institute of Physics University of Helsinki,

More information

A neural network representation of the potential energy surface in Si- and Si-Li systems

A neural network representation of the potential energy surface in Si- and Si-Li systems A neural network representation of the potential energy surface in Si- and Si-Li systems Brad Malone, Ekin Cubuk, and Efthimios Kaxiras The Problem The detailed simulation of many physical processes can

More information

Cheng Soon Ong & Christian Walder. Canberra February June 2018

Cheng Soon Ong & Christian Walder. Canberra February June 2018 Cheng Soon Ong & Christian Walder Research Group and College of Engineering and Computer Science Canberra February June 2018 Outlines Overview Introduction Linear Algebra Probability Linear Regression

More information

Gaussian Processes. Le Song. Machine Learning II: Advanced Topics CSE 8803ML, Spring 2012

Gaussian Processes. Le Song. Machine Learning II: Advanced Topics CSE 8803ML, Spring 2012 Gaussian Processes Le Song Machine Learning II: Advanced Topics CSE 8803ML, Spring 01 Pictorial view of embedding distribution Transform the entire distribution to expected features Feature space Feature

More information

Construction of standardized neural network-based interatomic models for structure prediction acceleration

Construction of standardized neural network-based interatomic models for structure prediction acceleration Construction of standardized neural network-based interatomic models for structure prediction acceleration Alexey N. Kolmogorov Binghamton University State University of New York Acceleration of materials

More information

The Kernel Trick, Gram Matrices, and Feature Extraction. CS6787 Lecture 4 Fall 2017

The Kernel Trick, Gram Matrices, and Feature Extraction. CS6787 Lecture 4 Fall 2017 The Kernel Trick, Gram Matrices, and Feature Extraction CS6787 Lecture 4 Fall 2017 Momentum for Principle Component Analysis CS6787 Lecture 3.1 Fall 2017 Principle Component Analysis Setting: find the

More information

Learning Gaussian Process Models from Uncertain Data

Learning Gaussian Process Models from Uncertain Data Learning Gaussian Process Models from Uncertain Data Patrick Dallaire, Camille Besse, and Brahim Chaib-draa DAMAS Laboratory, Computer Science & Software Engineering Department, Laval University, Canada

More information

Gaussian Processes (10/16/13)

Gaussian Processes (10/16/13) STA561: Probabilistic machine learning Gaussian Processes (10/16/13) Lecturer: Barbara Engelhardt Scribes: Changwei Hu, Di Jin, Mengdi Wang 1 Introduction In supervised learning, we observe some inputs

More information

Tokamak profile database construction incorporating Gaussian process regression

Tokamak profile database construction incorporating Gaussian process regression Tokamak profile database construction incorporating Gaussian process regression A. Ho 1, J. Citrin 1, C. Bourdelle 2, Y. Camenen 3, F. Felici 4, M. Maslov 5, K.L. van de Plassche 1,4, H. Weisen 6 and JET

More information

10-701/ Recitation : Kernels

10-701/ Recitation : Kernels 10-701/15-781 Recitation : Kernels Manojit Nandi February 27, 2014 Outline Mathematical Theory Banach Space and Hilbert Spaces Kernels Commonly Used Kernels Kernel Theory One Weird Kernel Trick Representer

More information

Announcements. Proposals graded

Announcements. Proposals graded Announcements Proposals graded Kevin Jamieson 2018 1 Bayesian Methods Machine Learning CSE546 Kevin Jamieson University of Washington November 1, 2018 2018 Kevin Jamieson 2 MLE Recap - coin flips Data:

More information

Rustam Z. Khaliullin University of Zürich

Rustam Z. Khaliullin University of Zürich Rustam Z. Khaliullin University of Zürich Molecular dynamics (MD) MD is a computational method for simulating time evolution of a collection of interacting atoms by numerically integrating Newton s equation

More information

Neutron inverse kinetics via Gaussian Processes

Neutron inverse kinetics via Gaussian Processes Neutron inverse kinetics via Gaussian Processes P. Picca Politecnico di Torino, Torino, Italy R. Furfaro University of Arizona, Tucson, Arizona Outline Introduction Review of inverse kinetics techniques

More information

COMP 551 Applied Machine Learning Lecture 21: Bayesian optimisation

COMP 551 Applied Machine Learning Lecture 21: Bayesian optimisation COMP 55 Applied Machine Learning Lecture 2: Bayesian optimisation Associate Instructor: (herke.vanhoof@mcgill.ca) Class web page: www.cs.mcgill.ca/~jpineau/comp55 Unless otherwise noted, all material posted

More information

References in the Supporting Information:

References in the Supporting Information: Identification of the Selective Sites for Electrochemical Reduction of CO to C2+ Products on Copper Nanoparticles by Combining Reactive Force Fields, Density Functional Theory, and Machine Learning Supporting

More information

Environment-dependent interatomic potential for bulk silicon

Environment-dependent interatomic potential for bulk silicon PHYSICAL REVIEW B VOLUME 56, NUMBER 14 Environment-dependent interatomic potential for bulk silicon Martin Z. Bazant and Efthimios Kaxiras Department of Physics, Harvard University, Cambridge, Massachusetts

More information

Mark Gales October y (x) x 1. x 2 y (x) Inputs. Outputs. x d. y (x) Second Output layer layer. layer.

Mark Gales October y (x) x 1. x 2 y (x) Inputs. Outputs. x d. y (x) Second Output layer layer. layer. University of Cambridge Engineering Part IIB & EIST Part II Paper I0: Advanced Pattern Processing Handouts 4 & 5: Multi-Layer Perceptron: Introduction and Training x y (x) Inputs x 2 y (x) 2 Outputs x

More information

Machine Learning. Kernels. Fall (Kernels, Kernelized Perceptron and SVM) Professor Liang Huang. (Chap. 12 of CIML)

Machine Learning. Kernels. Fall (Kernels, Kernelized Perceptron and SVM) Professor Liang Huang. (Chap. 12 of CIML) Machine Learning Fall 2017 Kernels (Kernels, Kernelized Perceptron and SVM) Professor Liang Huang (Chap. 12 of CIML) Nonlinear Features x4: -1 x1: +1 x3: +1 x2: -1 Concatenated (combined) features XOR:

More information

Bayesian reconstruction of free energy profiles from umbrella samples

Bayesian reconstruction of free energy profiles from umbrella samples Bayesian reconstruction of free energy profiles from umbrella samples Thomas Stecher with Gábor Csányi and Noam Bernstein 21st November 212 Motivation Motivation and Goals Many conventional methods implicitly

More information

Everything starts with atomic structure and bonding

Everything starts with atomic structure and bonding Everything starts with atomic structure and bonding not all energy values can be possessed by electrons; e- have discrete energy values we call energy levels or states. The energy values are quantized

More information

CSC2541 Lecture 2 Bayesian Occam s Razor and Gaussian Processes

CSC2541 Lecture 2 Bayesian Occam s Razor and Gaussian Processes CSC2541 Lecture 2 Bayesian Occam s Razor and Gaussian Processes Roger Grosse Roger Grosse CSC2541 Lecture 2 Bayesian Occam s Razor and Gaussian Processes 1 / 55 Adminis-Trivia Did everyone get my e-mail

More information

An introduction to Molecular Dynamics. EMBO, June 2016

An introduction to Molecular Dynamics. EMBO, June 2016 An introduction to Molecular Dynamics EMBO, June 2016 What is MD? everything that living things do can be understood in terms of the jiggling and wiggling of atoms. The Feynman Lectures in Physics vol.

More information

Lecture 9. Time series prediction

Lecture 9. Time series prediction Lecture 9 Time series prediction Prediction is about function fitting To predict we need to model There are a bewildering number of models for data we look at some of the major approaches in this lecture

More information

Document Version Publisher s PDF, also known as Version of Record (includes final page, issue and volume numbers)

Document Version Publisher s PDF, also known as Version of Record (includes final page, issue and volume numbers) Parametrization of modified embedded-atom-method potentials for Rh, Pd, Ir, and Pt based on density functional theory calculations, with applications to surface properties Beurden, van, P.; Kramer, G.J.

More information

ENERGY LANDSCAPE OF POINT DEFECTS IN BCC METALS

ENERGY LANDSCAPE OF POINT DEFECTS IN BCC METALS ENERGY LANDSCAPE OF POINT DEFECTS IN BCC METALS M.-C. Marinica, R. Alexander, L. Ventelon, L. Proville, F. Willaime CEA, DEN, Service de Recherches de Métallurgie Physique Saclay, France Elementary defects

More information

Bayesian Error Estimation in Density Functional Theory

Bayesian Error Estimation in Density Functional Theory Bayesian Error Estimation in Density Functional Theory Karsten W. Jacobsen Jens Jørgen Mortensen Kristen Kaasbjerg Søren L. Frederiksen Jens K. Nørskov CAMP, Dept. of Physics, DTU James P. Sethna LASSP,

More information

Support Vector Machines

Support Vector Machines Support Vector Machines Hypothesis Space variable size deterministic continuous parameters Learning Algorithm linear and quadratic programming eager batch SVMs combine three important ideas Apply optimization

More information

plane in a cubic unit cell. Clearly label the axes. (b) Draw two directions in the ( 112)

plane in a cubic unit cell. Clearly label the axes. (b) Draw two directions in the ( 112) Midterm Examination - Thursday, February 5, 8:00 9:5 AM Place all answers in a 8.5" x " Bluebook Allowed:, double-sided 8.5" x " page of notes must return with exam. Required: Picture ID when returning

More information

N = N A Pb A Pb. = ln N Q v kt. = kt ln v N

N = N A Pb A Pb. = ln N Q v kt. = kt ln v N 5. Calculate the energy for vacancy formation in silver, given that the equilibrium number of vacancies at 800 C (1073 K) is 3.6 10 3 m 3. The atomic weight and density (at 800 C) for silver are, respectively,

More information

Non-Bayesian Classifiers Part II: Linear Discriminants and Support Vector Machines

Non-Bayesian Classifiers Part II: Linear Discriminants and Support Vector Machines Non-Bayesian Classifiers Part II: Linear Discriminants and Support Vector Machines Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr CS 551, Fall 2018 CS 551, Fall

More information

Machine Learning. Bayesian Regression & Classification. Marc Toussaint U Stuttgart

Machine Learning. Bayesian Regression & Classification. Marc Toussaint U Stuttgart Machine Learning Bayesian Regression & Classification learning as inference, Bayesian Kernel Ridge regression & Gaussian Processes, Bayesian Kernel Logistic Regression & GP classification, Bayesian Neural

More information

Adaptive Multi-Modal Sensing of General Concealed Targets

Adaptive Multi-Modal Sensing of General Concealed Targets Adaptive Multi-Modal Sensing of General Concealed argets Lawrence Carin Balaji Krishnapuram, David Williams, Xuejun Liao and Ya Xue Department of Electrical & Computer Engineering Duke University Durham,

More information

what can deep learning learn from linear regression? Benjamin Recht University of California, Berkeley

what can deep learning learn from linear regression? Benjamin Recht University of California, Berkeley what can deep learning learn from linear regression? Benjamin Recht University of California, Berkeley Collaborators Joint work with Samy Bengio, Moritz Hardt, Michael Jordan, Jason Lee, Max Simchowitz,

More information

Electronic Structure Theory for Periodic Systems: The Concepts. Christian Ratsch

Electronic Structure Theory for Periodic Systems: The Concepts. Christian Ratsch Electronic Structure Theory for Periodic Systems: The Concepts Christian Ratsch Institute for Pure and Applied Mathematics and Department of Mathematics, UCLA Motivation There are 10 20 atoms in 1 mm 3

More information

Distribution-Free Distribution Regression

Distribution-Free Distribution Regression Distribution-Free Distribution Regression Barnabás Póczos, Alessandro Rinaldo, Aarti Singh and Larry Wasserman AISTATS 2013 Presented by Esther Salazar Duke University February 28, 2014 E. Salazar (Reading

More information

Indentation of Silicon: Phase Transition? Indentation of Silicon: Phase Transition?

Indentation of Silicon: Phase Transition? Indentation of Silicon: Phase Transition? Indentation of Silicon: Phase Transition? Kallman et al., Phys. Rev. B. 47, 7705 (1993). Smith et al., Acta. Mater. 49, 4089 (2001). MD: NVT 350,000 atoms Cut away of crystalline Si indented with a tetrahedral

More information

Introduction to DFTB. Marcus Elstner. July 28, 2006

Introduction to DFTB. Marcus Elstner. July 28, 2006 Introduction to DFTB Marcus Elstner July 28, 2006 I. Non-selfconsistent solution of the KS equations DFT can treat up to 100 atoms in routine applications, sometimes even more and about several ps in MD

More information

ATOMISTIC MODELING OF DIFFUSION IN ALUMINUM

ATOMISTIC MODELING OF DIFFUSION IN ALUMINUM ATOMISTIC MODELING OF DIFFUSION IN ALUMINUM S. GRABOWSKI, K. KADAU and P. ENTEL Theoretische Physik, Gerhard-Mercator-Universität Duisburg, 47048 Duisburg, Germany (Received...) Abstract We present molecular-dynamics

More information

A NEW EMBEDDED-ATOM METHOD INTERATOMIC POTENTIAL FOR TUNGSTEN-HYDROGEN SYSTEM

A NEW EMBEDDED-ATOM METHOD INTERATOMIC POTENTIAL FOR TUNGSTEN-HYDROGEN SYSTEM A NEW EMBEDDED-ATOM METHOD INTERATOMIC POTENTIAL FOR TUNGSTEN-HYDROGEN SYSTEM Li-Fang Wang 1, Fei Gao 2, Xiao-Lin Shu 1, Guang-Hong Lu 1* 1 School of Physics and Nuclear Energy Engineering, Beihang University,

More information

Neural Network Potentials

Neural Network Potentials Neural Network Potentials ANI-1: an extensible neural network potential with DFT accuracy at force field computational cost Smith, Isayev and Roitberg Sabri Eyuboglu February 6, 2018 What are Neural Network

More information

Computer Vision Group Prof. Daniel Cremers. 2. Regression (cont.)

Computer Vision Group Prof. Daniel Cremers. 2. Regression (cont.) Prof. Daniel Cremers 2. Regression (cont.) Regression with MLE (Rep.) Assume that y is affected by Gaussian noise : t = f(x, w)+ where Thus, we have p(t x, w, )=N (t; f(x, w), 2 ) 2 Maximum A-Posteriori

More information

Reliability Monitoring Using Log Gaussian Process Regression

Reliability Monitoring Using Log Gaussian Process Regression COPYRIGHT 013, M. Modarres Reliability Monitoring Using Log Gaussian Process Regression Martin Wayne Mohammad Modarres PSA 013 Center for Risk and Reliability University of Maryland Department of Mechanical

More information

Modeling Materials. Continuum, Atomistic and Multiscale Techniques. gg CAMBRIDGE ^0 TADMOR ELLAD B. HHHHM. University of Minnesota, USA

Modeling Materials. Continuum, Atomistic and Multiscale Techniques. gg CAMBRIDGE ^0 TADMOR ELLAD B. HHHHM. University of Minnesota, USA HHHHM Modeling Materials Continuum, Atomistic and Multiscale Techniques ELLAD B. TADMOR University of Minnesota, USA RONALD E. MILLER Carleton University, Canada gg CAMBRIDGE ^0 UNIVERSITY PRESS Preface

More information

Machine learning comes from Bayesian decision theory in statistics. There we want to minimize the expected value of the loss function.

Machine learning comes from Bayesian decision theory in statistics. There we want to minimize the expected value of the loss function. Bayesian learning: Machine learning comes from Bayesian decision theory in statistics. There we want to minimize the expected value of the loss function. Let y be the true label and y be the predicted

More information

From Physical Modelling to Big Data Analytics: Examples and Challenges

From Physical Modelling to Big Data Analytics: Examples and Challenges From Physical Modelling to Big Data Analytics: Examples and Challenges Ben Leimkuhler University of Edinburgh EPSRC/NSF ERC ATI Summit on Big Data in the Physical Sciences Outline Part I: Challenges Ideas

More information

For info and ordering all the 4 versions / languages of this book please visit: http://trl.lab.uic.edu/pon Contents Preface vii Chapter 1 Advances in Atomic and Molecular Nanotechnology Introduction 1

More information

Overview. Probabilistic Interpretation of Linear Regression Maximum Likelihood Estimation Bayesian Estimation MAP Estimation

Overview. Probabilistic Interpretation of Linear Regression Maximum Likelihood Estimation Bayesian Estimation MAP Estimation Overview Probabilistic Interpretation of Linear Regression Maximum Likelihood Estimation Bayesian Estimation MAP Estimation Probabilistic Interpretation: Linear Regression Assume output y is generated

More information

Bayesian Inference: Principles and Practice 3. Sparse Bayesian Models and the Relevance Vector Machine

Bayesian Inference: Principles and Practice 3. Sparse Bayesian Models and the Relevance Vector Machine Bayesian Inference: Principles and Practice 3. Sparse Bayesian Models and the Relevance Vector Machine Mike Tipping Gaussian prior Marginal prior: single α Independent α Cambridge, UK Lecture 3: Overview

More information

On the adaptive finite element analysis of the Kohn-Sham equations

On the adaptive finite element analysis of the Kohn-Sham equations On the adaptive finite element analysis of the Kohn-Sham equations Denis Davydov, Toby Young, Paul Steinmann Denis Davydov, LTM, Erlangen, Germany August 2015 Denis Davydov, LTM, Erlangen, Germany College

More information

Gaussian processes for inference in stochastic differential equations

Gaussian processes for inference in stochastic differential equations Gaussian processes for inference in stochastic differential equations Manfred Opper, AI group, TU Berlin November 6, 2017 Manfred Opper, AI group, TU Berlin (TU Berlin) inference in SDE November 6, 2017

More information

Introduction to Gaussian Processes

Introduction to Gaussian Processes Introduction to Gaussian Processes Neil D. Lawrence GPSS 10th June 2013 Book Rasmussen and Williams (2006) Outline The Gaussian Density Covariance from Basis Functions Basis Function Representations Constructing

More information

Cheng Soon Ong & Christian Walder. Canberra February June 2018

Cheng Soon Ong & Christian Walder. Canberra February June 2018 Cheng Soon Ong & Christian Walder Research Group and College of Engineering and Computer Science Canberra February June 2018 Outlines Overview Introduction Linear Algebra Probability Linear Regression

More information

Reactive Empirical Force Fields

Reactive Empirical Force Fields Reactive Empirical Force Fields Jason Quenneville jasonq@lanl.gov X-1: Solid Mechanics, EOS and Materials Properties Applied Physics Division Los Alamos National Laboratory Timothy C. Germann, Los Alamos

More information

Assessment of interatomic potentials for molecular dynamics simulations of GaAs deposition

Assessment of interatomic potentials for molecular dynamics simulations of GaAs deposition Assessment of interatomic potentials for molecular dynamics simulations of GaAs deposition D. A. Murdick,* X. W. Zhou, and H. N. G. Wadley Department of Materials Science and Engineering, School of Engineering

More information

COMS 4721: Machine Learning for Data Science Lecture 10, 2/21/2017

COMS 4721: Machine Learning for Data Science Lecture 10, 2/21/2017 COMS 4721: Machine Learning for Data Science Lecture 10, 2/21/2017 Prof. John Paisley Department of Electrical Engineering & Data Science Institute Columbia University FEATURE EXPANSIONS FEATURE EXPANSIONS

More information

Geometry Optimisation

Geometry Optimisation Geometry Optimisation Matt Probert Condensed Matter Dynamics Group Department of Physics, University of York, UK http://www.cmt.york.ac.uk/cmd http://www.castep.org Motivation Overview of Talk Background

More information

Prediction of double gene knockout measurements

Prediction of double gene knockout measurements Prediction of double gene knockout measurements Sofia Kyriazopoulou-Panagiotopoulou sofiakp@stanford.edu December 12, 2008 Abstract One way to get an insight into the potential interaction between a pair

More information

VIRTUAL LATTICE TECHNIQUE AND THE INTERATOMIC POTENTIALS OF ZINC-BLEND-TYPE BINARY COMPOUNDS

VIRTUAL LATTICE TECHNIQUE AND THE INTERATOMIC POTENTIALS OF ZINC-BLEND-TYPE BINARY COMPOUNDS Modern Physics Letters B, Vol. 16, Nos. 5 & 6 (2002) 187 194 c World Scientific Publishing Company VIRTUAL LATTICE TECHNIQUE AND THE INTERATOMIC POTENTIALS OF ZINC-BLEND-TYPE BINARY COMPOUNDS LIU YING,

More information

MD simulation of methane in nanochannels

MD simulation of methane in nanochannels MD simulation of methane in nanochannels COCIM, Arica, Chile M. Horsch, M. Heitzig, and J. Vrabec University of Stuttgart November 6, 2008 Scope and structure Molecular model for graphite and the fluid-wall

More information

Statistical Data Mining and Machine Learning Hilary Term 2016

Statistical Data Mining and Machine Learning Hilary Term 2016 Statistical Data Mining and Machine Learning Hilary Term 2016 Dino Sejdinovic Department of Statistics Oxford Slides and other materials available at: http://www.stats.ox.ac.uk/~sejdinov/sdmml Naïve Bayes

More information

A Combined Ab Initio and Bond-Order Potentials Study of Cohesion in Iridium

A Combined Ab Initio and Bond-Order Potentials Study of Cohesion in Iridium Mat. Res. Soc. Symp. Proc. Vol. 779 2003 Materials Research Society W5.5.1 A Combined Ab Initio and Bond-Order Potentials Study of Cohesion in Iridium Marc J. Cawkwell 1, Duc Nguyen-Manh 2, Vaclav Vitek

More information

The electronic structure of materials 1

The electronic structure of materials 1 Quantum mechanics 2 - Lecture 9 December 18, 2013 1 An overview 2 Literature Contents 1 An overview 2 Literature Electronic ground state Ground state cohesive energy equilibrium crystal structure phase

More information

Modeling thermal conductivity: a Green-Kubo approach

Modeling thermal conductivity: a Green-Kubo approach Modeling thermal conductivity: a Green-Kubo approach Fabiano Oyafuso, Paul von Allmen, Markus Bühler Jet Propulsion Laboratory Pasadena, CA Funding: DARPA Outline Motivation -- thermoelectrics Theory Implementation

More information

Representing High-Dimensional Potential-Energy Surfaces by Artificial Neural Networks

Representing High-Dimensional Potential-Energy Surfaces by Artificial Neural Networks Energy Landscapes, Chemnitz 200 Representing High-Dimensional Potential-Energy Surfaces by Artificial Neural Networks Jörg Behler Lehrstuhl für Theoretische Chemie Ruhr-Universität Bochum D-44780 Bochum,

More information

The Application of Extreme Learning Machine based on Gaussian Kernel in Image Classification

The Application of Extreme Learning Machine based on Gaussian Kernel in Image Classification he Application of Extreme Learning Machine based on Gaussian Kernel in Image Classification Weijie LI, Yi LIN Postgraduate student in College of Survey and Geo-Informatics, tongji university Email: 1633289@tongji.edu.cn

More information

CHAPTER 4 IMPERFECTIONS IN SOLIDS PROBLEM SOLUTIONS

CHAPTER 4 IMPERFECTIONS IN SOLIDS PROBLEM SOLUTIONS 4-1 CHAPTER 4 IMPERFECTIONS IN SOLIDS PROBLEM SOLUTIONS Vacancies and Self-Interstitials 4.1 In order to compute the fraction of atom sites that are vacant in copper at 1357 K, we must employ Equation

More information

Gaussian with mean ( µ ) and standard deviation ( σ)

Gaussian with mean ( µ ) and standard deviation ( σ) Slide from Pieter Abbeel Gaussian with mean ( µ ) and standard deviation ( σ) 10/6/16 CSE-571: Robotics X ~ N( µ, σ ) Y ~ N( aµ + b, a σ ) Y = ax + b + + + + 1 1 1 1 1 1 1 1 1 1, ~ ) ( ) ( ), ( ~ ), (

More information

DEPARTMENT OF COMPUTER SCIENCE Autumn Semester MACHINE LEARNING AND ADAPTIVE INTELLIGENCE

DEPARTMENT OF COMPUTER SCIENCE Autumn Semester MACHINE LEARNING AND ADAPTIVE INTELLIGENCE Data Provided: None DEPARTMENT OF COMPUTER SCIENCE Autumn Semester 203 204 MACHINE LEARNING AND ADAPTIVE INTELLIGENCE 2 hours Answer THREE of the four questions. All questions carry equal weight. Figures

More information

Dept of Mechanical Engineering MIT Nanoengineering group

Dept of Mechanical Engineering MIT Nanoengineering group 1 Dept of Mechanical Engineering MIT Nanoengineering group » Recap of HK theorems and KS equations» The physical meaning of the XC energy» Solution of a one-particle Schroedinger equation» Pseudo Potentials»

More information

IAP 2006: From nano to macro: Introduction to atomistic modeling techniques and application in a case study of modeling fracture of copper (1.

IAP 2006: From nano to macro: Introduction to atomistic modeling techniques and application in a case study of modeling fracture of copper (1. IAP 2006: From nano to macro: Introduction to atomistic modeling techniques and application in a case study of modeling fracture of copper (1.978 PDF) http://web.mit.edu/mbuehler/www/teaching/iap2006/intro.htm

More information

CS598 Machine Learning in Computational Biology (Lecture 5: Matrix - part 2) Professor Jian Peng Teaching Assistant: Rongda Zhu

CS598 Machine Learning in Computational Biology (Lecture 5: Matrix - part 2) Professor Jian Peng Teaching Assistant: Rongda Zhu CS598 Machine Learning in Computational Biology (Lecture 5: Matrix - part 2) Professor Jian Peng Teaching Assistant: Rongda Zhu Feature engineering is hard 1. Extract informative features from domain knowledge

More information

Probabilistic Reasoning in Deep Learning

Probabilistic Reasoning in Deep Learning Probabilistic Reasoning in Deep Learning Dr Konstantina Palla, PhD palla@stats.ox.ac.uk September 2017 Deep Learning Indaba, Johannesburgh Konstantina Palla 1 / 39 OVERVIEW OF THE TALK Basics of Bayesian

More information

Computer Vision Group Prof. Daniel Cremers. 10a. Markov Chain Monte Carlo

Computer Vision Group Prof. Daniel Cremers. 10a. Markov Chain Monte Carlo Group Prof. Daniel Cremers 10a. Markov Chain Monte Carlo Markov Chain Monte Carlo In high-dimensional spaces, rejection sampling and importance sampling are very inefficient An alternative is Markov Chain

More information

Nearest Neighbor. Machine Learning CSE546 Kevin Jamieson University of Washington. October 26, Kevin Jamieson 2

Nearest Neighbor. Machine Learning CSE546 Kevin Jamieson University of Washington. October 26, Kevin Jamieson 2 Nearest Neighbor Machine Learning CSE546 Kevin Jamieson University of Washington October 26, 2017 2017 Kevin Jamieson 2 Some data, Bayes Classifier Training data: True label: +1 True label: -1 Optimal

More information

An EAM potential for the dynamical simulation of Ni-Al alloys

An EAM potential for the dynamical simulation of Ni-Al alloys J. At. Mol. Sci. doi: 10.4208/jams.022310.031210a Vol. 1, No. 3, pp. 253-261 August 2010 An EAM potential for the dynamical simulation of Ni-Al alloys Jian-Hua Zhang, Shun-Qing Wu, Yu-Hua Wen, and Zi-Zhong

More information

1 Bulk Simulations in a HCP lattice

1 Bulk Simulations in a HCP lattice 1 Bulk Simulations in a HCP lattice 1.1 Introduction This project is a continuation of two previous projects that studied the mechanism of melting in a FCC and BCC lattice. The current project studies

More information

Engineering Part IIB: Module 4F10 Statistical Pattern Processing Lecture 6: Multi-Layer Perceptrons I

Engineering Part IIB: Module 4F10 Statistical Pattern Processing Lecture 6: Multi-Layer Perceptrons I Engineering Part IIB: Module 4F10 Statistical Pattern Processing Lecture 6: Multi-Layer Perceptrons I Phil Woodland: pcw@eng.cam.ac.uk Michaelmas 2012 Engineering Part IIB: Module 4F10 Introduction In

More information

Statistical Methods for Data Mining

Statistical Methods for Data Mining Statistical Methods for Data Mining Kuangnan Fang Xiamen University Email: xmufkn@xmu.edu.cn Support Vector Machines Here we approach the two-class classification problem in a direct way: We try and find

More information

MSE 102, Fall 2014 Midterm #2. Write your name here [10 points]:

MSE 102, Fall 2014 Midterm #2. Write your name here [10 points]: MSE 102, Fall 2014 Midterm #2 Write your name here [10 points]: Instructions: Answer all questions to the best of your abilities. Be sure to write legibly and state your answers clearly. The point values

More information

Introduction. Chapter 1

Introduction. Chapter 1 Chapter 1 Introduction In this book we will be concerned with supervised learning, which is the problem of learning input-output mappings from empirical data (the training dataset). Depending on the characteristics

More information

Relevance of jamming to the mechanical properties of solids Sidney Nagel University of Chicago Capri; September 12, 2014

Relevance of jamming to the mechanical properties of solids Sidney Nagel University of Chicago Capri; September 12, 2014 Relevance of jamming to the mechanical properties of solids Sidney Nagel University of Chicago Capri; September 1, 014 What is role of (dis)order for mechanical behavior? Andrea J. Liu Carl Goodrich Justin

More information

Multivariate statistical methods and data mining in particle physics

Multivariate statistical methods and data mining in particle physics Multivariate statistical methods and data mining in particle physics RHUL Physics www.pp.rhul.ac.uk/~cowan Academic Training Lectures CERN 16 19 June, 2008 1 Outline Statement of the problem Some general

More information

Gaussian Processes. 1 What problems can be solved by Gaussian Processes?

Gaussian Processes. 1 What problems can be solved by Gaussian Processes? Statistical Techniques in Robotics (16-831, F1) Lecture#19 (Wednesday November 16) Gaussian Processes Lecturer: Drew Bagnell Scribe:Yamuna Krishnamurthy 1 1 What problems can be solved by Gaussian Processes?

More information