Parameter estimation and statistical analysis of a new model for silicon nanoparticle synthesis

Size: px
Start display at page:

Download "Parameter estimation and statistical analysis of a new model for silicon nanoparticle synthesis"

Transcription

1 Parameter estimation and statistical analysis of a new model for silicon nanoparticle synthesis Computational Modelling Group Department of Chemical Engineering and Biotechnology University of Cambridge 31 July 2013 GROUP 1

2 Contents 1 Introduction 2 Model development 3 Parameter estimation 4 Conclusions GROUP 2

3 Introduction: significance of Si nanoparticles Si nanoparticles are usually obtained from the thermal decomposition of silane SiH 4 Si + 2H 2 Are used for mainly research purposes Medical imaging (as quantum dots) Printable semiconductor inks Future touchscreen devices Properties of Si nanoparticles are strongly dependent on size and morphology May et al (2012) GROUP 3

4 Introduction: particle synthesis Particles grow through complex physiochemical pathways M gas phase clustering Sii H j H H Si i H j inception SiH 4 H 2 SiH 2 SiH 2 Si 2 H 4 H H gas phase decompostion H 2 H 2 Si i H j hydrogen release H 2 surface reaction sintering coagulation H 2 GROUP 4

5 Introduction: parameter estimation Particle synthesis models may have unknown/uncertain parameters Inverse problem: How do we choose these parameters? How do we solve this problem for a complex non-linear model? Which parameters are actually important? GROUP 5

6 Introduction: key aims 1 Present model for silicon nanoparticle synthesis Gas-phase kinetic model Particle population balance 2 Discuss parameter estimation efforts How do we estimate the parameters? Which parameters is the model most sensitive to? GROUP 6

7 Model: fully-coupled model The model consists of a gas-phase kinetic model fully-coupled with a particle population balance gas phase clustering (rev) A 2 H3SiSiH +SiH 2 H SiH 2 A 1 2 SiH 4 thermal decomposition A SiH 7 +H 2 2 +SiH +SiH A A A A SiH 5 3 +SiH 2 H 2 SiSiH 2 2 Si 2 H 6 + SiH Si 3 H 8 2 (rev) A 4 inception hydrogen condensation +SiH release 4 A H2 +SiH 2 A SR,SiH 4 H surface reaction 2 particle population balance coagulation sintering GROUP 7

8 Model: gas-phase The gas-phase model contains 8 reactions and 11 species This system of ODEs is solved with a conventional solver (rev) A 2 H3SiSiH +SiH 2 H SiH 2 2 +SiH +SiH A A A A SiH 5 3 +SiH 2 H 2 SiSiH 2 2 Si 2 H 6 + SiH Si 3 H 8 2 (rev) A 4 A 1 SiH 4 thermal decomposition A SiH 7 +H 2 2 GROUP 8

9 Model: particle type-space Each particle P q is represented as P q = P q ( p1,..., p nq, C ) Primaries are described by the number of silicon (η Si ) and hydrogen (η H ) units p x = p x (η Si, η H ) E.g., a particle with 4 primaries P q (p 1, p 2, p 3, p 4, C q ) p 1 p 3 p 2 C 12 p 3 (η Si, η H ) p 4 GROUP 9

10 Model: particle population balance The particle population balance includes terms for inception, heterogeneous growth, coagulation and sintering hydrogen release condensation +SiH 4 inception A H2 +SiH 2 A SR,SiH 4 H surface reaction 2 coagulation sintering GROUP 10

11 Model: type-space and coagulation The particle model is needed to capture process details For example, coagulation joins the particle tree structures P q (p 1, p 2, C q ) P r (p 3, p 4, C r ) P s (p 1, p 2, p 3, p 4, C s ) p 1 p 2 + p 4 p 3 p 1 p 2 p 4 p 3 GROUP 11

12 Model: population balance solver A stochastic solver is used Enables use of the detailed particle model Takes advantage of a number of developments 1 LPDA: accelerates surface reaction processes 2 Binary tree: reduces summation time over the ensemble 3 Majorant rates and fictitious jumps GROUP 12

13 Parameter estimation: the adjusted parameters Previous studies and preliminary work identified two areas with significant uncertainty gas-phase rates (A 1,LP, A 2,LP, A 3,LP, A 5,LP, A 8,rev ) heterogeneous growth rates (A SR,SiH4, A H2 ) Seven parameters were adjusted, giving parameter vector x x = (A 1,LP, A 2,LP, A 3,LP, A 5,LP, A 8,rev, A SR,SiH4, A H2 ) GROUP 13

14 Parameter estimation: case studies The model was tested against a range of experimental studies initial silane fraction, % Onischuk et al., 2000 Koermer et al., 2010 Frenklach et al., 1996 Wu et al., 1987 Flint + Haggerty, 1987 Nguyen and Flagan, temperature, o C GROUP 14

15 Parameter estimation: objective function The objective function for this system was defined as N exp ( Φ(x) = φ exp i i=1 φ sim i (x) ) 2 where φ i represents one of the N exp experimental datasets used for fitting We considered two forms of φ i : φ µ i : mean or mode of a particle size distribution : geometric standard deviation of a PSD φ σ i GROUP 15

16 Parameter estimation: initial optimisation 1 Locate parameter sets near the minimum of Φ(x) using low discrepancy (Sobol) sequences 2 Refine initial guess using SPSA algorithm 3 Select optimal parameter set x 4 Construct a response surface (surrogate model) around x 5 Conduct MCMC sampling to estimate the posterior distribution of parameters 6 Obtain confidence intervals for parameters 7 Evaluate model at mode of confidence interval GROUP 16

17 Parameter estimation: visualised A 1,LP 1. Low discrepancy sequence scan SPSA 3. x found A 2,LP 4. Make response surface sim φ A 2,LP x* A 1,LP 5. MCMC sampling of surface 6. Obtain parameter CIs probability density lb ub A 1,LP GROUP 17

18 Parameter estimation: model results 7. Evaluated model at mode of parameter confidence intervals Generally good agreement with experimental measurements kernel density, 1/nm spherical particles kernel density, 1000/nm aggregate particles exp. sim primary diameter, nm mobility diameter, nm GROUP 18

19 Parameter estimation: HDMR response surfaces The global sensitivities can be determined from a High Dimensional Model Representation (HDMR) Decomposes a response φ sim into a function of the parameters x i φ sim f (x) = f 0 + N param fi (x i ) }{{} first-order terms + N param i=1 We truncate f (x) to second-order terms N param j=i+1 f ij (x i, x j ) } {{ } second-order terms GROUP 19

20 Parameter estimation: HDMR sensitivities The first-order absolute sensitivity is given by the variance of the response function f (x i ) integrated over specified upperand lower-bounds S φ sim (x i ) = u.b. l.b. f 2 i (x i )dx i These tell us how much variance in output response φ sim can be achieved by adjusting the parameter x i GROUP 20

21 Parameter estimation: sensitivity analysis First-order sensitivities for the PSD mode objective function 40 S (Ai) from φ µ, nm Flint & Haggerty, 1986; φ µ 14 Körmer et al., 2010; φ µ 8 Nguyen & Flagan, 1991; φ µ 18 Frenklach et al., 1996; φ µ 10 Wu et al, 1987; φ µ 13 Onischuk et al., 2000; φ µ A 1,LP A 2,LP A 3,LP A 5,LP A 8,rev A SR,SiH4 A H2 parameter type GROUP 21

22 Parameter estimation: bubble plots (1) Global sensitivities of the initial decomposition step pre-exponential (A 1,LP ) to different experimental cases 10 1 S (A 1,LP ) from φ µ S (A 1,LP ) from φ σ initial silane pressure, kpa temperature, C Körmer et al., 2010 Frenklach et al., 1996 Wu et al, 1987 Flint & Haggerty, temperature, C Nguyen & Flagan, 1991 Onischuk et al., 2000 GROUP 22

23 Parameter estimation: bubble plots (2) Global sensitivities of the surface reaction pre-exponential (A SR,SiH4 ) to different experimental cases 10 1 S (A SR,SiH4 ) from φ µ S (A SR,SiH4 ) from φ σ initial silane pressure, kpa temperature, C Körmer et al., 2010 Frenklach et al., 1996 Wu et al, 1987 Flint & Haggerty, temperature, C Nguyen & Flagan, 1991 Onischuk et al., 2000 GROUP 23

24 Parameter estimation: next steps Bar chart indicated that A 1,LP, A 3,LP and A SR,SiH4 are the most important parameters Can we use fewer parameters for the parameter estimation? Bubble plots tell us which parameters influence which experiments Which experiments pull optimals in which directions? Which experiments (or their model representation) are poor? Answering these questions embarks us on a model and experimental discrimination pathway GROUP 24

25 Conclusions Parameter estimation for a detailed model is challenging! For models with many parameters, a systematic estimation procedure is necessary Global sensitivities from HDMR can potentially yield physical insight about the model These tools will be used for model and experimental discrimination GROUP 25

26 Acknowledgements The Computational Modelling Group, University of Cambridge GROUP Cambridge Australia Trust GROUP 26

Global sensitivity analysis of a model for silicon nanoparticle synthesis

Global sensitivity analysis of a model for silicon nanoparticle synthesis Global sensitivity analysis of a model for silicon nanoparticle synthesis Preprint Cambridge Centre for Computational Chemical Engineering ISSN 1473 4273 Global sensitivity analysis of a model for silicon

More information

Stochastic modelling of silicon nanoparticle synthesis

Stochastic modelling of silicon nanoparticle synthesis Stochastic modelling of silicon nanoparticle synthesis William Jefferson Menz Sidney Sussex College October 15, 2013 A dissertation submitted for the degree of Doctor of Philosophy Stochastic modelling

More information

Synthesis of silicon nanoparticles with a narrow size distribution: a theoretical study

Synthesis of silicon nanoparticles with a narrow size distribution: a theoretical study Synthesis of silicon nanoparticles with a narrow size distribution: a theoretical study Preprint Cambridge Centre for Computational Chemical Engineering ISSN 1473 4273 Synthesis of silicon nanoparticles

More information

On the detailed modelling of high temperature nanoparticles synthesis

On the detailed modelling of high temperature nanoparticles synthesis On the detailed modelling of high temperature nanoparticles synthesis Prof. http://como.cheng.cam.ac.uk/ The 9 th International Conference on Chemical Kinetics (ICCK) Department of Chemical Engineering

More information

flame synthesis of inorganic nanoparticles

flame synthesis of inorganic nanoparticles flame synthesis of inorganic nanoparticles Shraddha Shekar and Jethro Akroyd Markus KRAFT Karlsruhe 12 July 2010 Part 1 Introduction Precursor (TES) Mesoporous silica nanoparticles Aim: To answer the following

More information

Modelling Carbon Black

Modelling Carbon Black Modelling Carbon Black Matthew Celnik, Tim Totton, Abhijeet Raj, Markus Sander, Markus Kraft 09/09/09 Soot Formation Burner Reaction Zone Temperature Flame Carbon Condensation Particle Addition Inception

More information

Gaussian process regression for Sensitivity analysis

Gaussian process regression for Sensitivity analysis Gaussian process regression for Sensitivity analysis GPSS Workshop on UQ, Sheffield, September 2016 Nicolas Durrande, Mines St-Étienne, durrande@emse.fr GPSS workshop on UQ GPs for sensitivity analysis

More information

Local and Global Sensitivity Analysis

Local and Global Sensitivity Analysis Omar 1,2 1 Duke University Department of Mechanical Engineering & Materials Science omar.knio@duke.edu 2 KAUST Division of Computer, Electrical, Mathematical Science & Engineering omar.knio@kaust.edu.sa

More information

Electronic Companion Fluid Models for Overloaded Multi-Class Many-Server Queueing Systems with FCFS Routing

Electronic Companion Fluid Models for Overloaded Multi-Class Many-Server Queueing Systems with FCFS Routing Submitted to Management Science manuscript MS-251-27 Electronic Companion Fluid Models for Overloaded Multi-Class Many-Server Queueing Systems with FCFS Routing Rishi Talreja, Ward Whitt Department of

More information

CS798: Selected topics in Machine Learning

CS798: Selected topics in Machine Learning CS798: Selected topics in Machine Learning Support Vector Machine Jakramate Bootkrajang Department of Computer Science Chiang Mai University Jakramate Bootkrajang CS798: Selected topics in Machine Learning

More information

Direct observation of aggregative nanoparticle growth: Kinetic modeling of the size distribution and growth rate

Direct observation of aggregative nanoparticle growth: Kinetic modeling of the size distribution and growth rate Direct observation of aggregative nanoparticle growth: Kinetic modeling of the size distribution and growth rate Taylor J. Woehl, * Chiwoo Park, James E. Evans, Ilke Arslan, William D. Ristenpart, and

More information

Experimental Design and Data Analysis for Biologists

Experimental Design and Data Analysis for Biologists Experimental Design and Data Analysis for Biologists Gerry P. Quinn Monash University Michael J. Keough University of Melbourne CAMBRIDGE UNIVERSITY PRESS Contents Preface page xv I I Introduction 1 1.1

More information

A multidimensional population balance model to describe the aerosol synthesis of silica nanoparticles.

A multidimensional population balance model to describe the aerosol synthesis of silica nanoparticles. A multidimensional population balance model to describe the aerosol synthesis of silica nanoparticles. Preprint Cambridge Centre for Computational Chemical Engineering ISSN 1473 4273 A multidimensional

More information

Linear vs Non-linear classifier. CS789: Machine Learning and Neural Network. Introduction

Linear vs Non-linear classifier. CS789: Machine Learning and Neural Network. Introduction Linear vs Non-linear classifier CS789: Machine Learning and Neural Network Support Vector Machine Jakramate Bootkrajang Department of Computer Science Chiang Mai University Linear classifier is in the

More information

Bayesian rules of probability as principles of logic [Cox] Notation: pr(x I) is the probability (or pdf) of x being true given information I

Bayesian rules of probability as principles of logic [Cox] Notation: pr(x I) is the probability (or pdf) of x being true given information I Bayesian rules of probability as principles of logic [Cox] Notation: pr(x I) is the probability (or pdf) of x being true given information I 1 Sum rule: If set {x i } is exhaustive and exclusive, pr(x

More information

Lecture 6: Individual nanoparticles, nanocrystals and quantum dots

Lecture 6: Individual nanoparticles, nanocrystals and quantum dots Lecture 6: Individual nanoparticles, nanocrystals and quantum dots Definition of nanoparticle: Size definition arbitrary More interesting: definition based on change in physical properties. Size smaller

More information

Machine Learning Ensemble Learning I Hamid R. Rabiee Jafar Muhammadi, Alireza Ghasemi Spring /

Machine Learning Ensemble Learning I Hamid R. Rabiee Jafar Muhammadi, Alireza Ghasemi Spring / Machine Learning Ensemble Learning I Hamid R. Rabiee Jafar Muhammadi, Alireza Ghasemi Spring 2015 http://ce.sharif.edu/courses/93-94/2/ce717-1 / Agenda Combining Classifiers Empirical view Theoretical

More information

STA414/2104. Lecture 11: Gaussian Processes. Department of Statistics

STA414/2104. Lecture 11: Gaussian Processes. Department of Statistics STA414/2104 Lecture 11: Gaussian Processes Department of Statistics www.utstat.utoronto.ca Delivered by Mark Ebden with thanks to Russ Salakhutdinov Outline Gaussian Processes Exam review Course evaluations

More information

Meta-Analysis for Diagnostic Test Data: a Bayesian Approach

Meta-Analysis for Diagnostic Test Data: a Bayesian Approach Meta-Analysis for Diagnostic Test Data: a Bayesian Approach Pablo E. Verde Coordination Centre for Clinical Trials Heinrich Heine Universität Düsseldorf Preliminaries: motivations for systematic reviews

More information

Thermochemistry and Kinetics of Silicon Hydride Cluster Formation during Thermal Decomposition of Silane

Thermochemistry and Kinetics of Silicon Hydride Cluster Formation during Thermal Decomposition of Silane 64 J. Phys. Chem. B 1999, 103, 64-76 Thermochemistry and Kinetics of Silicon Hydride Cluster Formation during Thermal Decomposition of Silane Mark T. Swihart*, and Steven L. Girshick Department of Mechanical

More information

Discriminative Direction for Kernel Classifiers

Discriminative Direction for Kernel Classifiers Discriminative Direction for Kernel Classifiers Polina Golland Artificial Intelligence Lab Massachusetts Institute of Technology Cambridge, MA 02139 polina@ai.mit.edu Abstract In many scientific and engineering

More information

Introduction to Smoothing spline ANOVA models (metamodelling)

Introduction to Smoothing spline ANOVA models (metamodelling) Introduction to Smoothing spline ANOVA models (metamodelling) M. Ratto DYNARE Summer School, Paris, June 215. Joint Research Centre www.jrc.ec.europa.eu Serving society Stimulating innovation Supporting

More information

On Partial Optimality in Multi-label MRFs

On Partial Optimality in Multi-label MRFs On Partial Optimality in Multi-label MRFs P. Kohli 1 A. Shekhovtsov 2 C. Rother 1 V. Kolmogorov 3 P. Torr 4 1 Microsoft Research Cambridge 2 Czech Technical University in Prague 3 University College London

More information

Urban background aerosols: Negative correlations of particle modes and fragmentation mechanism

Urban background aerosols: Negative correlations of particle modes and fragmentation mechanism Click Here for Full Article GEOPHYSICAL RESEARCH LETTERS, VOL. 34, L11811, doi:10.1029/2006gl029109, 2007 Urban background aerosols: Negative correlations of particle modes and fragmentation mechanism

More information

Adapted Feature Extraction and Its Applications

Adapted Feature Extraction and Its Applications saito@math.ucdavis.edu 1 Adapted Feature Extraction and Its Applications Naoki Saito Department of Mathematics University of California Davis, CA 95616 email: saito@math.ucdavis.edu URL: http://www.math.ucdavis.edu/

More information

Machine Learning Lecture 2

Machine Learning Lecture 2 Machine Perceptual Learning and Sensory Summer Augmented 15 Computing Many slides adapted from B. Schiele Machine Learning Lecture 2 Probability Density Estimation 16.04.2015 Bastian Leibe RWTH Aachen

More information

Introduction to Bayesian methods in inverse problems

Introduction to Bayesian methods in inverse problems Introduction to Bayesian methods in inverse problems Ville Kolehmainen 1 1 Department of Applied Physics, University of Eastern Finland, Kuopio, Finland March 4 2013 Manchester, UK. Contents Introduction

More information

Data Mining. Linear & nonlinear classifiers. Hamid Beigy. Sharif University of Technology. Fall 1396

Data Mining. Linear & nonlinear classifiers. Hamid Beigy. Sharif University of Technology. Fall 1396 Data Mining Linear & nonlinear classifiers Hamid Beigy Sharif University of Technology Fall 1396 Hamid Beigy (Sharif University of Technology) Data Mining Fall 1396 1 / 31 Table of contents 1 Introduction

More information

Introduction to Mobile Robotics Bayes Filter Particle Filter and Monte Carlo Localization

Introduction to Mobile Robotics Bayes Filter Particle Filter and Monte Carlo Localization Introduction to Mobile Robotics Bayes Filter Particle Filter and Monte Carlo Localization Wolfram Burgard, Cyrill Stachniss, Maren Bennewitz, Kai Arras 1 Motivation Recall: Discrete filter Discretize the

More information

Dynamic System Identification using HDMR-Bayesian Technique

Dynamic System Identification using HDMR-Bayesian Technique Dynamic System Identification using HDMR-Bayesian Technique *Shereena O A 1) and Dr. B N Rao 2) 1), 2) Department of Civil Engineering, IIT Madras, Chennai 600036, Tamil Nadu, India 1) ce14d020@smail.iitm.ac.in

More information

Machine Learning Lecture 2

Machine Learning Lecture 2 Machine Perceptual Learning and Sensory Summer Augmented 6 Computing Announcements Machine Learning Lecture 2 Course webpage http://www.vision.rwth-aachen.de/teaching/ Slides will be made available on

More information

Advanced Machine Learning & Perception

Advanced Machine Learning & Perception Advanced Machine Learning & Perception Instructor: Tony Jebara Topic 1 Introduction, researchy course, latest papers Going beyond simple machine learning Perception, strange spaces, images, time, behavior

More information

Overfitting, Bias / Variance Analysis

Overfitting, Bias / Variance Analysis Overfitting, Bias / Variance Analysis Professor Ameet Talwalkar Professor Ameet Talwalkar CS260 Machine Learning Algorithms February 8, 207 / 40 Outline Administration 2 Review of last lecture 3 Basic

More information

Machine Learning. Bayesian Regression & Classification. Marc Toussaint U Stuttgart

Machine Learning. Bayesian Regression & Classification. Marc Toussaint U Stuttgart Machine Learning Bayesian Regression & Classification learning as inference, Bayesian Kernel Ridge regression & Gaussian Processes, Bayesian Kernel Logistic Regression & GP classification, Bayesian Neural

More information

Three data analysis problems

Three data analysis problems Three data analysis problems Andreas Zezas University of Crete CfA Two types of problems: Fitting Source Classification Fitting: complex datasets Fitting: complex datasets Maragoudakis et al. in prep.

More information

TDT4173 Machine Learning

TDT4173 Machine Learning TDT4173 Machine Learning Lecture 3 Bagging & Boosting + SVMs Norwegian University of Science and Technology Helge Langseth IT-VEST 310 helgel@idi.ntnu.no 1 TDT4173 Machine Learning Outline 1 Ensemble-methods

More information

Lecture 7: Statistics and the Central Limit Theorem. Philip Moriarty,

Lecture 7: Statistics and the Central Limit Theorem. Philip Moriarty, Lecture 7: Statistics and the Central Limit Theorem Philip Moriarty, philip.moriarty@nottingham.ac.uk NB Notes based heavily on lecture slides prepared by DE Rourke for the F32SMS module, 2006 7.1 Recap

More information

Statistical Techniques in Robotics (16-831, F12) Lecture#21 (Monday November 12) Gaussian Processes

Statistical Techniques in Robotics (16-831, F12) Lecture#21 (Monday November 12) Gaussian Processes Statistical Techniques in Robotics (16-831, F12) Lecture#21 (Monday November 12) Gaussian Processes Lecturer: Drew Bagnell Scribe: Venkatraman Narayanan 1, M. Koval and P. Parashar 1 Applications of Gaussian

More information

Bayesian Inverse problem, Data assimilation and Localization

Bayesian Inverse problem, Data assimilation and Localization Bayesian Inverse problem, Data assimilation and Localization Xin T Tong National University of Singapore ICIP, Singapore 2018 X.Tong Localization 1 / 37 Content What is Bayesian inverse problem? What is

More information

Machine Learning. Kernels. Fall (Kernels, Kernelized Perceptron and SVM) Professor Liang Huang. (Chap. 12 of CIML)

Machine Learning. Kernels. Fall (Kernels, Kernelized Perceptron and SVM) Professor Liang Huang. (Chap. 12 of CIML) Machine Learning Fall 2017 Kernels (Kernels, Kernelized Perceptron and SVM) Professor Liang Huang (Chap. 12 of CIML) Nonlinear Features x4: -1 x1: +1 x3: +1 x2: -1 Concatenated (combined) features XOR:

More information

Competing sources of variance reduction in parallel replica Monte Carlo, and optimization in the low temperature limit

Competing sources of variance reduction in parallel replica Monte Carlo, and optimization in the low temperature limit Competing sources of variance reduction in parallel replica Monte Carlo, and optimization in the low temperature limit Paul Dupuis Division of Applied Mathematics Brown University IPAM (J. Doll, M. Snarski,

More information

THE ROLE OF SENSITIVITY ANALYSIS IN MODEL IMPROVEMENT

THE ROLE OF SENSITIVITY ANALYSIS IN MODEL IMPROVEMENT Energy and Resources Research Institute School of something FACULTY OF OTHER Faculty of Engineering THE ROLE OF SENSITIVITY ANALYSIS IN MODEL IMPROVEMENT Alison S. Tomlin Michael Davis, Rex Skodje, Frédérique

More information

Introduction to Gaussian Process

Introduction to Gaussian Process Introduction to Gaussian Process CS 778 Chris Tensmeyer CS 478 INTRODUCTION 1 What Topic? Machine Learning Regression Bayesian ML Bayesian Regression Bayesian Non-parametric Gaussian Process (GP) GP Regression

More information

Midterm. Introduction to Machine Learning. CS 189 Spring You have 1 hour 20 minutes for the exam.

Midterm. Introduction to Machine Learning. CS 189 Spring You have 1 hour 20 minutes for the exam. CS 189 Spring 2013 Introduction to Machine Learning Midterm You have 1 hour 20 minutes for the exam. The exam is closed book, closed notes except your one-page crib sheet. Please use non-programmable calculators

More information

Data Mining and Analysis: Fundamental Concepts and Algorithms

Data Mining and Analysis: Fundamental Concepts and Algorithms Data Mining and Analysis: Fundamental Concepts and Algorithms dataminingbook.info Mohammed J. Zaki 1 Wagner Meira Jr. 2 1 Department of Computer Science Rensselaer Polytechnic Institute, Troy, NY, USA

More information

Efficient Likelihood-Free Inference

Efficient Likelihood-Free Inference Efficient Likelihood-Free Inference Michael Gutmann http://homepages.inf.ed.ac.uk/mgutmann Institute for Adaptive and Neural Computation School of Informatics, University of Edinburgh 8th November 2017

More information

Machine Learning Lecture 2

Machine Learning Lecture 2 Announcements Machine Learning Lecture 2 Eceptional number of lecture participants this year Current count: 449 participants This is very nice, but it stretches our resources to their limits Probability

More information

Undirected graphical models

Undirected graphical models Undirected graphical models Semantics of probabilistic models over undirected graphs Parameters of undirected models Example applications COMP-652 and ECSE-608, February 16, 2017 1 Undirected graphical

More information

Characterization of Jet Charge at the LHC

Characterization of Jet Charge at the LHC Characterization of Jet Charge at the LHC Thomas Dylan Rueter, Krishna Soni Abstract The Large Hadron Collider (LHC) produces a staggering amount of data - about 30 petabytes annually. One of the largest

More information

Brief Introduction to Machine Learning

Brief Introduction to Machine Learning Brief Introduction to Machine Learning Yuh-Jye Lee Lab of Data Science and Machine Intelligence Dept. of Applied Math. at NCTU August 29, 2016 1 / 49 1 Introduction 2 Binary Classification 3 Support Vector

More information

Kernel Methods. Lecture 4: Maximum Mean Discrepancy Thanks to Karsten Borgwardt, Malte Rasch, Bernhard Schölkopf, Jiayuan Huang, Arthur Gretton

Kernel Methods. Lecture 4: Maximum Mean Discrepancy Thanks to Karsten Borgwardt, Malte Rasch, Bernhard Schölkopf, Jiayuan Huang, Arthur Gretton Kernel Methods Lecture 4: Maximum Mean Discrepancy Thanks to Karsten Borgwardt, Malte Rasch, Bernhard Schölkopf, Jiayuan Huang, Arthur Gretton Alexander J. Smola Statistical Machine Learning Program Canberra,

More information

These slides follow closely the (English) course textbook Pattern Recognition and Machine Learning by Christopher Bishop

These slides follow closely the (English) course textbook Pattern Recognition and Machine Learning by Christopher Bishop Music and Machine Learning (IFT68 Winter 8) Prof. Douglas Eck, Université de Montréal These slides follow closely the (English) course textbook Pattern Recognition and Machine Learning by Christopher Bishop

More information

General Construction of Irreversible Kernel in Markov Chain Monte Carlo

General Construction of Irreversible Kernel in Markov Chain Monte Carlo General Construction of Irreversible Kernel in Markov Chain Monte Carlo Metropolis heat bath Suwa Todo Department of Applied Physics, The University of Tokyo Department of Physics, Boston University (from

More information

Statistical Techniques in Robotics (16-831, F12) Lecture#20 (Monday November 12) Gaussian Processes

Statistical Techniques in Robotics (16-831, F12) Lecture#20 (Monday November 12) Gaussian Processes Statistical Techniques in Robotics (6-83, F) Lecture# (Monday November ) Gaussian Processes Lecturer: Drew Bagnell Scribe: Venkatraman Narayanan Applications of Gaussian Processes (a) Inverse Kinematics

More information

Y1 Y2 Y3 Y4 Y1 Y2 Y3 Y4 Z1 Z2 Z3 Z4

Y1 Y2 Y3 Y4 Y1 Y2 Y3 Y4 Z1 Z2 Z3 Z4 Inference: Exploiting Local Structure aphne Koller Stanford University CS228 Handout #4 We have seen that N inference exploits the network structure, in particular the conditional independence and the

More information

Using Temporal Hierarchies to Predict Tourism Demand

Using Temporal Hierarchies to Predict Tourism Demand Using Temporal Hierarchies to Predict Tourism Demand International Symposium on Forecasting 29 th June 2015 Nikolaos Kourentzes Lancaster University George Athanasopoulos Monash University n.kourentzes@lancaster.ac.uk

More information

A multi-compartment population balance model for high shear granulation

A multi-compartment population balance model for high shear granulation A multi-compartment population balance model for high shear granulation Preprint Cambridge Centre for Computational Chemical Engineering ISSN 1473 4273 A multi-compartment population balance model for

More information

Outline. Motivation. Mapping the input space to the feature space Calculating the dot product in the feature space

Outline. Motivation. Mapping the input space to the feature space Calculating the dot product in the feature space to The The A s s in to Fabio A. González Ph.D. Depto. de Ing. de Sistemas e Industrial Universidad Nacional de Colombia, Bogotá April 2, 2009 to The The A s s in 1 Motivation Outline 2 The Mapping the

More information

Sobol-Hoeffding Decomposition with Application to Global Sensitivity Analysis

Sobol-Hoeffding Decomposition with Application to Global Sensitivity Analysis Sobol-Hoeffding decomposition Application to Global SA Computation of the SI Sobol-Hoeffding Decomposition with Application to Global Sensitivity Analysis Olivier Le Maître with Colleague & Friend Omar

More information

DATA ANALYTICS IN NANOMATERIALS DISCOVERY

DATA ANALYTICS IN NANOMATERIALS DISCOVERY DATA ANALYTICS IN NANOMATERIALS DISCOVERY Michael Fernandez OCE-Postdoctoral Fellow September 2016 www.data61.csiro.au Materials Discovery Process Materials Genome Project Integrating computational methods

More information

Chapter Two. Energy Bands and Effective Mass

Chapter Two. Energy Bands and Effective Mass Chapter Two Energy Bands and Effective Mass Energy Bands Formation At Low Temperature At Room Temperature Valence Band Insulators Metals Effective Mass Energy-Momentum Diagrams Direct and Indirect Semiconduction

More information

Solid State Device Fundamentals

Solid State Device Fundamentals Solid State Device Fundamentals ENS 345 Lecture Course by Alexander M. Zaitsev alexander.zaitsev@csi.cuny.edu Tel: 718 982 2812 Office 4N101b 1 Outline - Goals of the course. What is electronic device?

More information

PCA, Kernel PCA, ICA

PCA, Kernel PCA, ICA PCA, Kernel PCA, ICA Learning Representations. Dimensionality Reduction. Maria-Florina Balcan 04/08/2015 Big & High-Dimensional Data High-Dimensions = Lot of Features Document classification Features per

More information

Inverting hydraulic heads in an alluvial aquifer constrained with ERT data through MPS and PPM: a case study

Inverting hydraulic heads in an alluvial aquifer constrained with ERT data through MPS and PPM: a case study Inverting hydraulic heads in an alluvial aquifer constrained with ERT data through MPS and PPM: a case study Hermans T. 1, Scheidt C. 2, Caers J. 2, Nguyen F. 1 1 University of Liege, Applied Geophysics

More information

Synthesis of TiO 2 Photocatalyst Nanoparticles by Thermal Plasmas.

Synthesis of TiO 2 Photocatalyst Nanoparticles by Thermal Plasmas. 2012 International Conference on Future Environment and Energy IPCBEE vol.28(2012) (2012)IACSIT Press, Singapoore Synthesis of TiO 2 Photocatalyst Nanoparticles by Thermal Plasmas. Nguyen Hoang Hai, Kyo-Seon

More information

Uncertainty Quantification and Validation Using RAVEN. A. Alfonsi, C. Rabiti. Risk-Informed Safety Margin Characterization. https://lwrs.inl.

Uncertainty Quantification and Validation Using RAVEN. A. Alfonsi, C. Rabiti. Risk-Informed Safety Margin Characterization. https://lwrs.inl. Risk-Informed Safety Margin Characterization Uncertainty Quantification and Validation Using RAVEN https://lwrs.inl.gov A. Alfonsi, C. Rabiti North Carolina State University, Raleigh 06/28/2017 Assumptions

More information

STA 4273H: Sta-s-cal Machine Learning

STA 4273H: Sta-s-cal Machine Learning STA 4273H: Sta-s-cal Machine Learning Russ Salakhutdinov Department of Computer Science! Department of Statistical Sciences! rsalakhu@cs.toronto.edu! h0p://www.cs.utoronto.ca/~rsalakhu/ Lecture 2 In our

More information

Sandwiching the marginal likelihood using bidirectional Monte Carlo. Roger Grosse

Sandwiching the marginal likelihood using bidirectional Monte Carlo. Roger Grosse Sandwiching the marginal likelihood using bidirectional Monte Carlo Roger Grosse Ryan Adams Zoubin Ghahramani Introduction When comparing different statistical models, we d like a quantitative criterion

More information

Stochastic Proximal Gradient Algorithm

Stochastic Proximal Gradient Algorithm Stochastic Institut Mines-Télécom / Telecom ParisTech / Laboratoire Traitement et Communication de l Information Joint work with: Y. Atchade, Ann Arbor, USA, G. Fort LTCI/Télécom Paristech and the kind

More information

COMS 4721: Machine Learning for Data Science Lecture 19, 4/6/2017

COMS 4721: Machine Learning for Data Science Lecture 19, 4/6/2017 COMS 4721: Machine Learning for Data Science Lecture 19, 4/6/2017 Prof. John Paisley Department of Electrical Engineering & Data Science Institute Columbia University PRINCIPAL COMPONENT ANALYSIS DIMENSIONALITY

More information

UNIVERSITY of PENNSYLVANIA CIS 520: Machine Learning Final, Fall 2014

UNIVERSITY of PENNSYLVANIA CIS 520: Machine Learning Final, Fall 2014 UNIVERSITY of PENNSYLVANIA CIS 520: Machine Learning Final, Fall 2014 Exam policy: This exam allows two one-page, two-sided cheat sheets (i.e. 4 sides); No other materials. Time: 2 hours. Be sure to write

More information

The Cyclotron I. 1. Motion of the charges occurs in two semicircular containers, D 1. and D 2

The Cyclotron I. 1. Motion of the charges occurs in two semicircular containers, D 1. and D 2 1. Motion of the charges occurs in two semicircular containers, D 1 and D 2 referred to as the Dees 2. The Dees are evacuated in order to minimize energy loss from collisions 3. A high frrequency alternating

More information

CS Lecture 19. Exponential Families & Expectation Propagation

CS Lecture 19. Exponential Families & Expectation Propagation CS 6347 Lecture 19 Exponential Families & Expectation Propagation Discrete State Spaces We have been focusing on the case of MRFs over discrete state spaces Probability distributions over discrete spaces

More information

A short introduction to supervised learning, with applications to cancer pathway analysis Dr. Christina Leslie

A short introduction to supervised learning, with applications to cancer pathway analysis Dr. Christina Leslie A short introduction to supervised learning, with applications to cancer pathway analysis Dr. Christina Leslie Computational Biology Program Memorial Sloan-Kettering Cancer Center http://cbio.mskcc.org/leslielab

More information

Neutron inverse kinetics via Gaussian Processes

Neutron inverse kinetics via Gaussian Processes Neutron inverse kinetics via Gaussian Processes P. Picca Politecnico di Torino, Torino, Italy R. Furfaro University of Arizona, Tucson, Arizona Outline Introduction Review of inverse kinetics techniques

More information

Greenwich Public Schools Mathematics Curriculum Objectives. Calculus

Greenwich Public Schools Mathematics Curriculum Objectives. Calculus Mathematics Curriculum Objectives Calculus June 30, 2006 NUMERICAL AND PROPORTIONAL REASONING Quantitative relationships can be expressed numerically in multiple ways in order to make connections and simplify

More information

Ensemble learning 11/19/13. The wisdom of the crowds. Chapter 11. Ensemble methods. Ensemble methods

Ensemble learning 11/19/13. The wisdom of the crowds. Chapter 11. Ensemble methods. Ensemble methods The wisdom of the crowds Ensemble learning Sir Francis Galton discovered in the early 1900s that a collection of educated guesses can add up to very accurate predictions! Chapter 11 The paper in which

More information

Gaussian Processes. 1 What problems can be solved by Gaussian Processes?

Gaussian Processes. 1 What problems can be solved by Gaussian Processes? Statistical Techniques in Robotics (16-831, F1) Lecture#19 (Wednesday November 16) Gaussian Processes Lecturer: Drew Bagnell Scribe:Yamuna Krishnamurthy 1 1 What problems can be solved by Gaussian Processes?

More information

Single Photon detectors

Single Photon detectors Single Photon detectors Outline Motivation for single photon detection Semiconductor; general knowledge and important background Photon detectors: internal and external photoeffect Properties of semiconductor

More information

Comparing Non-informative Priors for Estimation and Prediction in Spatial Models

Comparing Non-informative Priors for Estimation and Prediction in Spatial Models Environmentrics 00, 1 12 DOI: 10.1002/env.XXXX Comparing Non-informative Priors for Estimation and Prediction in Spatial Models Regina Wu a and Cari G. Kaufman a Summary: Fitting a Bayesian model to spatial

More information

Maximum Mean Discrepancy

Maximum Mean Discrepancy Maximum Mean Discrepancy Thanks to Karsten Borgwardt, Malte Rasch, Bernhard Schölkopf, Jiayuan Huang, Arthur Gretton Alexander J. Smola Statistical Machine Learning Program Canberra, ACT 0200 Australia

More information

Classification and Pattern Recognition

Classification and Pattern Recognition Classification and Pattern Recognition Léon Bottou NEC Labs America COS 424 2/23/2010 The machine learning mix and match Goals Representation Capacity Control Operational Considerations Computational Considerations

More information

Name: Midterm Review Date:

Name: Midterm Review Date: Name: Midterm Review Date: 1. Which statement concerning elements is true? A) Different elements must have different numbers of isotopes. B) Different elements must have different numbers of neutrons.

More information

8.1 Concentration inequality for Gaussian random matrix (cont d)

8.1 Concentration inequality for Gaussian random matrix (cont d) MGMT 69: Topics in High-dimensional Data Analysis Falll 26 Lecture 8: Spectral clustering and Laplacian matrices Lecturer: Jiaming Xu Scribe: Hyun-Ju Oh and Taotao He, October 4, 26 Outline Concentration

More information

Bias-Variance Trade-off in ML. Sargur Srihari

Bias-Variance Trade-off in ML. Sargur Srihari Bias-Variance Trade-off in ML Sargur srihari@cedar.buffalo.edu 1 Bias-Variance Decomposition 1. Model Complexity in Linear Regression 2. Point estimate Bias-Variance in Statistics 3. Bias-Variance in Regression

More information

Synthesis of Highly Concentrated Ag Nanoparticles in a Heterogeneous Solid-Liquid System under Ultrasonic Irradiation

Synthesis of Highly Concentrated Ag Nanoparticles in a Heterogeneous Solid-Liquid System under Ultrasonic Irradiation Materials Transactions, Vol. 51, No. 10 (2010) pp. 1764 to 1768 Special Issue on Lead-Free and Advanced Interconnection Materials for Electronics #2010 The Japan Institute of Metals Synthesis of Highly

More information

The Mathematical Foundations of An Efficient Stochastic Algorithm For Solving Population Balance Equations

The Mathematical Foundations of An Efficient Stochastic Algorithm For Solving Population Balance Equations The Mathematical Foundations of An Efficient Stochastic Algorithm For Solving Population Balance Equations Preprint Cambridge Centre for Computational Chemical Engineering ISS 1473 4273 The Mathematical

More information

Electron Affinities of Selected Hydrogenated Silicon Clusters (Si x H y, x ) 1-7, y ) 0-15) from Density Functional Theory Calculations

Electron Affinities of Selected Hydrogenated Silicon Clusters (Si x H y, x ) 1-7, y ) 0-15) from Density Functional Theory Calculations J. Phys. Chem. A 2000, 104, 6083-6087 6083 Electron Affinities of Selected Hydrogenated Silicon Clusters (Si x H y, x ) 1-7, y ) 0-15) from Density Functional Theory Calculations Mark T. Swihart Department

More information

CoDa-dendrogram: A new exploratory tool. 2 Dept. Informàtica i Matemàtica Aplicada, Universitat de Girona, Spain;

CoDa-dendrogram: A new exploratory tool. 2 Dept. Informàtica i Matemàtica Aplicada, Universitat de Girona, Spain; CoDa-dendrogram: A new exploratory tool J.J. Egozcue 1, and V. Pawlowsky-Glahn 2 1 Dept. Matemàtica Aplicada III, Universitat Politècnica de Catalunya, Barcelona, Spain; juan.jose.egozcue@upc.edu 2 Dept.

More information

Crystalline Solids have atoms arranged in an orderly repeating pattern. Amorphous Solids lack the order found in crystalline solids

Crystalline Solids have atoms arranged in an orderly repeating pattern. Amorphous Solids lack the order found in crystalline solids Ch 12: Solids and Modern Materials Learning goals and key skills: Classify solids base on bonding/intermolecular forces and understand how difference in bonding relates to physical properties Know the

More information

A Bayesian Approach to Phylogenetics

A Bayesian Approach to Phylogenetics A Bayesian Approach to Phylogenetics Niklas Wahlberg Based largely on slides by Paul Lewis (www.eeb.uconn.edu) An Introduction to Bayesian Phylogenetics Bayesian inference in general Markov chain Monte

More information

Statistics 360/601 Modern Bayesian Theory

Statistics 360/601 Modern Bayesian Theory Statistics 360/601 Modern Bayesian Theory Alexander Volfovsky Lecture 8 - Sept 25, 2018 Monte Carlo 1 2 Monte Carlo approximation Want to compute Z E[ y] = p( y)d without worrying about actual integration...

More information

Towards a formal description of models and workflows

Towards a formal description of models and workflows Towards a formal description of models and workflows Heinz A Preisig Process Systems Engineering @ Chemical Engineering NTNU, Trondheim, Norway MoDeNa - FP7 ++ Computational engineering The vision that

More information

Finite temperature analysis of stochastic networks

Finite temperature analysis of stochastic networks Finite temperature analysis of stochastic networks Maria Cameron University of Maryland USA Stochastic networks with detailed balance * The generator matrix L = ( L ij ), i, j S L ij 0, i, j S, i j j S

More information

Nanoparticle Synthesis and Assembly from Atomistic Simulation Studies

Nanoparticle Synthesis and Assembly from Atomistic Simulation Studies Nanoparticle Synthesis and Assembly from Atomistic Simulation Studies By Takumi Hawa School of Aerospace & Mechanical Engineering Oklahoma Supercomputing Symposium 2008 October 7 Supported by NSF, ARL,

More information

Name Midterm Review Date

Name Midterm Review Date Name Midterm Review Date 1. In which process does a solid change directly into a vapor? A) sublimation B) deposition C) condensation D) solidification 2. What is the molecular formula of a compound that

More information

Review (Probability & Linear Algebra)

Review (Probability & Linear Algebra) Review (Probability & Linear Algebra) CE-725 : Statistical Pattern Recognition Sharif University of Technology Spring 2013 M. Soleymani Outline Axioms of probability theory Conditional probability, Joint

More information

Confidence Intervals for Population Mean

Confidence Intervals for Population Mean Confidence Intervals for Population Mean Reading: Sections 7.1, 7.2, 7.3 Learning Objectives: Students should be able to: Understand the meaning and purpose of confidence intervals Calculate a confidence

More information

Starting solution. Hydrolysis reaction under thermostatic conditions. Check of viscosity and deposition test SOL. Deposition by spin coating

Starting solution. Hydrolysis reaction under thermostatic conditions. Check of viscosity and deposition test SOL. Deposition by spin coating Supplementary Figures Tetramethyl orthosilicate (TMOS) Tetrahydrofuran anhydrous (THF) Trimethyl methoxy silane (TMMS) Trimethyl silil acetate (TMSA) Starting solution Hydrolysis reaction under thermostatic

More information

Machine Learning - MT & 5. Basis Expansion, Regularization, Validation

Machine Learning - MT & 5. Basis Expansion, Regularization, Validation Machine Learning - MT 2016 4 & 5. Basis Expansion, Regularization, Validation Varun Kanade University of Oxford October 19 & 24, 2016 Outline Basis function expansion to capture non-linear relationships

More information