Application of statistical technology in semiconductor process

Size: px
Start display at page:

Download "Application of statistical technology in semiconductor process"

Transcription

1 Application of statistical technology in semiconductor process Zhang, Shangui Beijing North Microelectronics 2008 Beijing ASTS 28~29, October 1

2 Outline Application of SPC method in semiconductor process Application of FDC method in semiconductor process Application of sensitivity analysis in the process Introduction of the process sensitivity analysis method Result of process AEI sensitivity analysis Result of process CDB sensitivity analysis Conclusion 2

3 Application of SPC method in semiconductor process SPC(Statistical Process Control)is a Fault Detection method based on data statistical analysis. 3

4 Application of SPC method in semiconductor process The main function of SPC method in the Advanced Process Control system is to monitor various parameters in the process in real time, and to send alarms in the case of abnormity. 4

5 Application of SPC method in semiconductor process Under the same process monitor condition, the alarming probability of X-chart and D-chart is smaller than that of S-chart and R-chart. 5

6 Application of SPC method in semiconductor process X-chart is suitable to monitor whether each parameter in the process has shifted tremendously for long time. 6

7 Application of SPC method in semiconductor process S-chart and R-chart are suitable to monitor whether each parameter in the process has fluctuated tremendously. 7

8 Application of SPC method in semiconductor process S-chart and R-chart are suitable to monitor whether each parameter in the process has fluctuated tremendously. 8

9 Application of SPC method in semiconductor process D-chart is suitable to monitor whether each parameter in the two continuous processes has shifted tremendously. D-chart is a method derived from X-chart, the function of this two are similar. 9

10 Application of FDC method in semiconductor process 10

11 Application of FDC method in semiconductor process FDC method is a multivariate fault detection and classification method based on principal components analysis. Hotelling T2 and Q(SPE)are the most common two methods to realize FDC. 11

12 Application of FDC method in semiconductor process 12

13 Application of FDC method in semiconductor process 13

14 Introduction of the process sensitivity analysis method DOE Process input variables Param. Param. Param. p1 p2 pm Process output variables Param. Param. Param. p1 p2 pn EXP1 x11 x12 X1m y11 y12 y1n EXP2 x21 x21 X2m y21 y22 y2n EXP3 x31 x32 X3m y31 y32 y3n EXPk xk1 xk2 xkm yk1 yk2 ykn 14

15 Introduction of the process sensitivity analysis method The relationship of process input variables and output variables can be written as the following matrix transformation equation: Process input variable Etching Process output variable According to the cause and effect principle of statistics, there exists potential and definite transfer function between input variables and out put variables. 15

16 Introduction of the process sensitivity analysis method Suppose that the transfer function equation between input and out put variables is as following: y prediction = f(x1, x2,, xk)+ D the above function is a multiple input and single output function, in which: y is a process output variable, x1, x2,, xk are the process output variables, constant D is the estimate of disturbance. In the equation, function f normally is a linear function, its specific expressions can be determined by Multiple linear regression, Ordinary least squares and Neural network regression. 16

17 Introduction of the process sensitivity analysis method On the other hand, as for a multiple input and single output prediction model, the true output variable(the measurement value)is equal to the model prediction value plus model error: y metrology = y prediction +ε= a 1 x 1 + a 2 x a k x k + D +ε Now suppose we have done many groups of process experiment, the above equation can be written as the following matrix format: Y = XA + E In the equation, A is the regression coefficient, E is the error between measurement value and prediction value. 17

18 Introduction of the process sensitivity analysis method The condition of parameter A getting the optimal value is the Sum of Squared Error between the measured value and the predicted value is minimal, which is also to make parameter E satisfying: min J(A)= E T *E =(Y-XA) T *(Y-XA) Simplify the above equation and conduct Partial Derivative on A on both side, we can get: α(j)/α(a)= 0-2X T Y+2X T XA According to the Lagrange Multiplication Principle, we know that the target function J(A)can reach the minimal when α(j)/α(a) Is equal to zero(α(j)/α(a)= 0 ), so we can get: A = inv(x T X)*X T *Y 18

19 Result of process AEI sensitivity analysis SRFPower BRFPower ADI AEI CL2 HBr HeO Case 1:Considering the effect of ADI in the process, the result of AEI sensitivity analysis is as following: AEI = 0.009*Pre *SRFP *BRFP 1.388*CL *HBr *HeO *ADI

20 Result of process AEI sensitivity analysis Model Performance Analysis:the correlation coefficient between the predicted output and the real output is 0.966, the predicted absolute error of the model is 1.51, the predicted relative error is

21 Result of process AEI sensitivity analysis SRFPower BRFPower ADI AEI CL2 HBr HeO Case 2:Without considering the effect of ADI in the process, the result of AEI sensitivity analysis is as following: AEI = 0.053*Pre 0.042*SRFP *BRFP 1.218*CL *HBr *HeO

22 Result of process AEI sensitivity analysis Model Performance Analysis:the correlation coefficient between the predicted output and the real output is 0.941, the predicted absolute error of the model is 1.96, the predicted relative error is

23 Result of process AEI sensitivity analysis The comparison of the results of AEI sensitivity analysis considering ADI and not considering ADI: AEISAR PRE SRFP BRFP CL2 HBr HeO ADI Case Case NaN Conclusion: 1)BRFPower, HeO, ADI are directly proportional to AEI, SRFPower and CL2, HBr are inversely proportional to AEI, the relationship between Pressure and AEI is undecided. 23

24 Result of process AEI sensitivity analysis 2)The order of the effect weight of the input variables to the output variable(aei)is as the above graph. 3)If the spectrum of AEI is known, the adjustment window of the in put variables(process recipe)can be calculated correspondingly. 24

25 Result of process CDB sensitivity analysis SRFPower BRFPower ADI AEI CL2 HBr HeO CDB Case:the number of process experiment samples is 20, sensitivity analysis method is multiple linear regression. CDB = *Pre *SRFP *BRFP 1.34*CL *HBr *HeO

26 Result of process CDB sensitivity analysis Model Performance Analysis:the correlation coefficient between the predicted output and the real output is 0.971, the predicted absolute error of the model is 1.53, the predicted relative error is

27 Result of process CDB sensitivity analysis Conclusion: 1)BRFPower and HeO is directly proportional to CDB, SRFPower and Pressure, CL2, HBr are inversely proportional to CDB. 2)The order of the effect weight of the input variables to the output variable(cdb)is as the above graph. 3)If the spectrum of CDB is known, the adjustment window of the input variable(process recipe)can be calculated correspondingly. 27

28 Conclusion 28

Copula Regression RAHUL A. PARSA DRAKE UNIVERSITY & STUART A. KLUGMAN SOCIETY OF ACTUARIES CASUALTY ACTUARIAL SOCIETY MAY 18,2011

Copula Regression RAHUL A. PARSA DRAKE UNIVERSITY & STUART A. KLUGMAN SOCIETY OF ACTUARIES CASUALTY ACTUARIAL SOCIETY MAY 18,2011 Copula Regression RAHUL A. PARSA DRAKE UNIVERSITY & STUART A. KLUGMAN SOCIETY OF ACTUARIES CASUALTY ACTUARIAL SOCIETY MAY 18,2011 Outline Ordinary Least Squares (OLS) Regression Generalized Linear Models

More information

FUZZY TRANSFORM: Application to Reef Growth Problem. Irina Perfilieva

FUZZY TRANSFORM: Application to Reef Growth Problem. Irina Perfilieva FUZZY TRANSFORM: Application to Reef Growth Problem Irina Perfilieva University of Ostrava Institute for research and applications of fuzzy modeling DAR Research Center Ostrava, Czech Republic OUTLINE

More information

SYSTEMATIC APPLICATIONS OF MULTIVARIATE ANALYSIS TO MONITORING OF EQUIPMENT HEALTH IN SEMICONDUCTOR MANUFACTURING. D.S.H. Wong S.S.

SYSTEMATIC APPLICATIONS OF MULTIVARIATE ANALYSIS TO MONITORING OF EQUIPMENT HEALTH IN SEMICONDUCTOR MANUFACTURING. D.S.H. Wong S.S. Proceedings of the 8 Winter Simulation Conference S. J. Mason, R. R. Hill, L. Mönch, O. Rose, T. Jefferson, J. W. Fowler eds. SYSTEMATIC APPLICATIONS OF MULTIVARIATE ANALYSIS TO MONITORING OF EQUIPMENT

More information

What kind of number is? Write the number in scientific notation ,000

What kind of number is? Write the number in scientific notation ,000 Chapter 1: 1.1, 1.2, 1.3, 1.4 Chapter 2: 2.1, 2.2, 2.3, 2.4 Chapter 3: 3.1, 3.2, 3.3, 3.4 Chapter 4: 4.1, 4.2, 4.3, 4.5, 4.7 Chapter 5: 5.1, 5.2, 5.3, 5.4, 5.6, 5.7 Chapter 6: 6.1 1.1 What kind of number

More information

L bor y nnd Union One nnd Inseparable. LOW I'LL, MICHIGAN. WLDNHSDA Y. JULY ), I8T. liuwkll NATIdiNAI, liank

L bor y nnd Union One nnd Inseparable. LOW I'LL, MICHIGAN. WLDNHSDA Y. JULY ), I8T. liuwkll NATIdiNAI, liank G k y $5 y / >/ k «««# ) /% < # «/» Y»««««?# «< >«>» y k»» «k F 5 8 Y Y F G k F >«y y

More information

b) Explain about charts for attributes and explain their uses. 4) a) Distinguish the difference between CUSUM charts and Shewartz control charts.

b) Explain about charts for attributes and explain their uses. 4) a) Distinguish the difference between CUSUM charts and Shewartz control charts. ASSIGNMENT - 1, DEC - 2016. PAPER- I : STATISTICAL QUALITY CONTROL (DMSTT 21) 1) a) Explain about Midrange control chart and median control chart. b) Explain about average run length for X chart. 2) a)

More information

Math 131 Exam 1 October 4, :00-9:00 p.m.

Math 131 Exam 1 October 4, :00-9:00 p.m. Name (Last, First) My Solutions ID # Signature Lecturer Section (01, 02, 03, etc.) university of massachusetts amherst department of mathematics and statistics Math 131 Exam 1 October 4, 2017 7:00-9:00

More information

Cheng Soon Ong & Christian Walder. Canberra February June 2018

Cheng Soon Ong & Christian Walder. Canberra February June 2018 Cheng Soon Ong & Christian Walder Research Group and College of Engineering and Computer Science Canberra February June 2018 Outlines Overview Introduction Linear Algebra Probability Linear Regression

More information

Estimation of etch rate and uniformity with plasma impedance monitoring. Daniel Tsunami

Estimation of etch rate and uniformity with plasma impedance monitoring. Daniel Tsunami Estimation of etch rate and uniformity with plasma impedance monitoring Daniel Tsunami IC Design and Test Laboratory Electrical & Computer Engineering Portland State University dtsunami@lisl.com 1 Introduction

More information

Multivariate Control and Model-Based SPC

Multivariate Control and Model-Based SPC Multivariate Control and Model-Based SPC T 2, evolutionary operation, regression chart. 1 Multivariate Control Often, many variables must be controlled at the same time. Controlling p independent parameters

More information

21.1 Traditional Monitoring Techniques Extensions of Statistical Process Control Multivariate Statistical Techniques

21.1 Traditional Monitoring Techniques Extensions of Statistical Process Control Multivariate Statistical Techniques 1 Process Monitoring 21.1 Traditional Monitoring Techniques 21.2 Quality Control Charts 21.3 Extensions of Statistical Process Control 21.4 Multivariate Statistical Techniques 21.5 Control Performance

More information

Chapte The McGraw-Hill Companies, Inc. All rights reserved.

Chapte The McGraw-Hill Companies, Inc. All rights reserved. 12er12 Chapte Bivariate i Regression (Part 1) Bivariate Regression Visual Displays Begin the analysis of bivariate data (i.e., two variables) with a scatter plot. A scatter plot - displays each observed

More information

Matrix Approach to Simple Linear Regression: An Overview

Matrix Approach to Simple Linear Regression: An Overview Matrix Approach to Simple Linear Regression: An Overview Aspects of matrices that you should know: Definition of a matrix Addition/subtraction/multiplication of matrices Symmetric/diagonal/identity matrix

More information

SYSTEMS OF NONLINEAR EQUATIONS

SYSTEMS OF NONLINEAR EQUATIONS SYSTEMS OF NONLINEAR EQUATIONS Widely used in the mathematical modeling of real world phenomena. We introduce some numerical methods for their solution. For better intuition, we examine systems of two

More information

Canonical Correlation Analysis with Kernels

Canonical Correlation Analysis with Kernels Canonical Correlation Analysis with Kernels Florian Markowetz Max-Planck-Institute for Molecular Genetics Computational Molecular Biology Berlin Computational Diagnostics Group Seminar 2003 Mar 10 1 Overview

More information

Modeling and Control Technologies for Improving Product on Efficiency and Quality

Modeling and Control Technologies for Improving Product on Efficiency and Quality Modeling and Control Technologies for Improving Product on Efficiency and Quality Tohru Katsuno Kouji Matsumoto Tetsuro Matsui A B S T R A C T Requests for quality and safety in automation systems have

More information

Partial Derivatives October 2013

Partial Derivatives October 2013 Partial Derivatives 14.3 02 October 2013 Derivative in one variable. Recall for a function of one variable, f (a) = lim h 0 f (a + h) f (a) h slope f (a + h) f (a) h a a + h Partial derivatives. For a

More information

Naive Bayes and Gaussian Bayes Classifier

Naive Bayes and Gaussian Bayes Classifier Naive Bayes and Gaussian Bayes Classifier Elias Tragas tragas@cs.toronto.edu October 3, 2016 Elias Tragas Naive Bayes and Gaussian Bayes Classifier October 3, 2016 1 / 23 Naive Bayes Bayes Rules: Naive

More information

EE613 Machine Learning for Engineers. Kernel methods Support Vector Machines. jean-marc odobez 2015

EE613 Machine Learning for Engineers. Kernel methods Support Vector Machines. jean-marc odobez 2015 EE613 Machine Learning for Engineers Kernel methods Support Vector Machines jean-marc odobez 2015 overview Kernel methods introductions and main elements defining kernels Kernelization of k-nn, K-Means,

More information

Basics on Probability. Jingrui He 09/11/2007

Basics on Probability. Jingrui He 09/11/2007 Basics on Probability Jingrui He 09/11/2007 Coin Flips You flip a coin Head with probability 0.5 You flip 100 coins How many heads would you expect Coin Flips cont. You flip a coin Head with probability

More information

Example: Limit definition. Geometric meaning. Geometric meaning, y. Notes. Notes. Notes. f (x, y) = x 2 y 3 :

Example: Limit definition. Geometric meaning. Geometric meaning, y. Notes. Notes. Notes. f (x, y) = x 2 y 3 : Partial Derivatives 14.3 02 October 2013 Derivative in one variable. Recall for a function of one variable, f (a) = lim h 0 f (a + h) f (a) h slope f (a + h) f (a) h a a + h Partial derivatives. For a

More information

Concurrent Canonical Correlation Analysis Modeling for Quality-Relevant Monitoring

Concurrent Canonical Correlation Analysis Modeling for Quality-Relevant Monitoring Preprint, 11th IFAC Symposium on Dynamics and Control of Process Systems, including Biosystems June 6-8, 16. NTNU, Trondheim, Norway Concurrent Canonical Correlation Analysis Modeling for Quality-Relevant

More information

1.6 and 5.3. Curve Fitting One of the broadest applications of linear algebra is to curve fitting, especially in determining unknown coefficients in

1.6 and 5.3. Curve Fitting One of the broadest applications of linear algebra is to curve fitting, especially in determining unknown coefficients in 16 and 53 Curve Fitting One of the broadest applications of linear algebra is to curve fitting, especially in determining unknown coefficients in functions You should know that, given two points in the

More information

Solving Polynomial and Rational Inequalities Algebraically. Approximating Solutions to Inequalities Graphically

Solving Polynomial and Rational Inequalities Algebraically. Approximating Solutions to Inequalities Graphically 10 Inequalities Concepts: Equivalent Inequalities Solving Polynomial and Rational Inequalities Algebraically Approximating Solutions to Inequalities Graphically (Section 4.6) 10.1 Equivalent Inequalities

More information

Sensor fault detection in building energy management systems

Sensor fault detection in building energy management systems Sensor fault detection in building energy management systems Dionissia Kolokotsa Anastasios Pouliezos and George Stavrakakis Technological Educational Institute of Crete Technical University of Crete 7333

More information

5.3. Polynomials and Polynomial Functions

5.3. Polynomials and Polynomial Functions 5.3 Polynomials and Polynomial Functions Polynomial Vocabulary Term a number or a product of a number and variables raised to powers Coefficient numerical factor of a term Constant term which is only a

More information

MATH 307: Problem Set #7

MATH 307: Problem Set #7 MATH 307: Problem Set #7 Due on: Feb 11, 2016 Problem 1 First-order Variation of Parameters The method of variation of parameters uses the homogeneous solutions of a linear ordinary differential equation

More information

On-line monitoring of a sugar crystallization process

On-line monitoring of a sugar crystallization process Computers and Chemical Engineering 29 (2005) 1411 1422 On-line monitoring of a sugar crystallization process A. Simoglou a, P. Georgieva c, E.B. Martin a, A.J. Morris a,,s.feyodeazevedo b a Center for

More information

Research Article A Hybrid ICA-SVM Approach for Determining the Quality Variables at Fault in a Multivariate Process

Research Article A Hybrid ICA-SVM Approach for Determining the Quality Variables at Fault in a Multivariate Process Mathematical Problems in Engineering Volume 1, Article ID 8491, 1 pages doi:1.1155/1/8491 Research Article A Hybrid ICA-SVM Approach for Determining the Quality Variables at Fault in a Multivariate Process

More information

Unsupervised Learning Methods

Unsupervised Learning Methods Structural Health Monitoring Using Statistical Pattern Recognition Unsupervised Learning Methods Keith Worden and Graeme Manson Presented by Keith Worden The Structural Health Monitoring Process 1. Operational

More information

7. Variable extraction and dimensionality reduction

7. Variable extraction and dimensionality reduction 7. Variable extraction and dimensionality reduction The goal of the variable selection in the preceding chapter was to find least useful variables so that it would be possible to reduce the dimensionality

More information

Statistical Tools for Multivariate Six Sigma. Dr. Neil W. Polhemus CTO & Director of Development StatPoint, Inc.

Statistical Tools for Multivariate Six Sigma. Dr. Neil W. Polhemus CTO & Director of Development StatPoint, Inc. Statistical Tools for Multivariate Six Sigma Dr. Neil W. Polhemus CTO & Director of Development StatPoint, Inc. 1 The Challenge The quality of an item or service usually depends on more than one characteristic.

More information

Machine Learning. Theory of Classification and Nonparametric Classifier. Lecture 2, January 16, What is theoretically the best classifier

Machine Learning. Theory of Classification and Nonparametric Classifier. Lecture 2, January 16, What is theoretically the best classifier Machine Learning 10-701/15 701/15-781, 781, Spring 2008 Theory of Classification and Nonparametric Classifier Eric Xing Lecture 2, January 16, 2006 Reading: Chap. 2,5 CB and handouts Outline What is theoretically

More information

An Introduction to Bayesian Linear Regression

An Introduction to Bayesian Linear Regression An Introduction to Bayesian Linear Regression APPM 5720: Bayesian Computation Fall 2018 A SIMPLE LINEAR MODEL Suppose that we observe explanatory variables x 1, x 2,..., x n and dependent variables y 1,

More information

A Note on Trapezoidal Methods for the Solution of Initial Value Problems. By A. R. Gourlay*

A Note on Trapezoidal Methods for the Solution of Initial Value Problems. By A. R. Gourlay* MATHEMATICS OF COMPUTATION, VOLUME 24, NUMBER 111, JULY, 1970 A Note on Trapezoidal Methods for the Solution of Initial Value Problems By A. R. Gourlay* Abstract. The trapezoidal rule for the numerical

More information

MYT decomposition and its invariant attribute

MYT decomposition and its invariant attribute Abstract Research Journal of Mathematical and Statistical Sciences ISSN 30-6047 Vol. 5(), 14-, February (017) MYT decomposition and its invariant attribute Adepou Aibola Akeem* and Ishaq Olawoyin Olatuni

More information

Multivariate control charts with a bayesian network

Multivariate control charts with a bayesian network Multivariate control charts with a bayesian network Sylvain Verron, Teodor Tiplica, Abdessamad Kobi To cite this version: Sylvain Verron, Teodor Tiplica, Abdessamad Kobi. Multivariate control charts with

More information

Learning with kernels and SVM

Learning with kernels and SVM Learning with kernels and SVM Šámalova chata, 23. května, 2006 Petra Kudová Outline Introduction Binary classification Learning with Kernels Support Vector Machines Demo Conclusion Learning from data find

More information

COMS 4721: Machine Learning for Data Science Lecture 10, 2/21/2017

COMS 4721: Machine Learning for Data Science Lecture 10, 2/21/2017 COMS 4721: Machine Learning for Data Science Lecture 10, 2/21/2017 Prof. John Paisley Department of Electrical Engineering & Data Science Institute Columbia University FEATURE EXPANSIONS FEATURE EXPANSIONS

More information

Data Mining. 3.6 Regression Analysis. Fall Instructor: Dr. Masoud Yaghini. Numeric Prediction

Data Mining. 3.6 Regression Analysis. Fall Instructor: Dr. Masoud Yaghini. Numeric Prediction Data Mining 3.6 Regression Analysis Fall 2008 Instructor: Dr. Masoud Yaghini Outline Introduction Straight-Line Linear Regression Multiple Linear Regression Other Regression Models References Introduction

More information

Naive Bayes and Gaussian Bayes Classifier

Naive Bayes and Gaussian Bayes Classifier Naive Bayes and Gaussian Bayes Classifier Mengye Ren mren@cs.toronto.edu October 18, 2015 Mengye Ren Naive Bayes and Gaussian Bayes Classifier October 18, 2015 1 / 21 Naive Bayes Bayes Rules: Naive Bayes

More information

Constructing Approximations to Functions

Constructing Approximations to Functions Constructing Approximations to Functions Given a function, f, if is often useful to it is often useful to approximate it by nicer functions. For example give a continuous function, f, it can be useful

More information

Numerical Solution of Duffing Equation by the Differential Transform Method

Numerical Solution of Duffing Equation by the Differential Transform Method Appl. Math. Inf. Sci. Lett. 2, No., -6 (204) Applied Mathematics & Information Sciences Letters An International Journal http://dx.doi.org/0.2785/amisl/0200 Numerical Solution of Duffing Equation by the

More information

Logistic Regression. Seungjin Choi

Logistic Regression. Seungjin Choi Logistic Regression Seungjin Choi Department of Computer Science and Engineering Pohang University of Science and Technology 77 Cheongam-ro, Nam-gu, Pohang 37673, Korea seungjin@postech.ac.kr http://mlg.postech.ac.kr/

More information

SB CH 2 answers.notebook. November 05, Warm Up. Oct 8 10:36 AM. Oct 5 2:22 PM. Oct 8 9:22 AM. Oct 8 9:19 AM. Oct 8 9:26 AM.

SB CH 2 answers.notebook. November 05, Warm Up. Oct 8 10:36 AM. Oct 5 2:22 PM. Oct 8 9:22 AM. Oct 8 9:19 AM. Oct 8 9:26 AM. Warm Up Oct 8 10:36 AM Oct 5 2:22 PM Linear Function Qualities Oct 8 9:22 AM Oct 8 9:19 AM Quadratic Function Qualities Oct 8 9:26 AM Oct 8 9:25 AM 1 Oct 8 9:28 AM Oct 8 9:25 AM Given vertex (-1,4) and

More information

Comparison of statistical process monitoring methods: application to the Eastman challenge problem

Comparison of statistical process monitoring methods: application to the Eastman challenge problem Computers and Chemical Engineering 24 (2000) 175 181 www.elsevier.com/locate/compchemeng Comparison of statistical process monitoring methods: application to the Eastman challenge problem Manabu Kano a,

More information

DIAGNOSIS OF BIVARIATE PROCESS VARIATION USING AN INTEGRATED MSPC-ANN SCHEME

DIAGNOSIS OF BIVARIATE PROCESS VARIATION USING AN INTEGRATED MSPC-ANN SCHEME DIAGNOSIS OF BIVARIATE PROCESS VARIATION USING AN INTEGRATED MSPC-ANN SCHEME Ibrahim Masood, Rasheed Majeed Ali, Nurul Adlihisam Mohd Solihin and Adel Muhsin Elewe Faculty of Mechanical and Manufacturing

More information

Polynomial functions right- and left-hand behavior (end behavior):

Polynomial functions right- and left-hand behavior (end behavior): Lesson 2.2 Polynomial Functions For each function: a.) Graph the function on your calculator Find an appropriate window. Draw a sketch of the graph on your paper and indicate your window. b.) Identify

More information

STAT 111 Recitation 7

STAT 111 Recitation 7 STAT 111 Recitation 7 Xin Lu Tan xtan@wharton.upenn.edu October 25, 2013 1 / 13 Miscellaneous Please turn in homework 6. Please pick up homework 7 and the graded homework 5. Please check your grade and

More information

Intrinsic Structure Study on Whale Vocalizations

Intrinsic Structure Study on Whale Vocalizations 1 2015 DCLDE Conference Intrinsic Structure Study on Whale Vocalizations Yin Xian 1, Xiaobai Sun 2, Yuan Zhang 3, Wenjing Liao 3 Doug Nowacek 1,4, Loren Nolte 1, Robert Calderbank 1,2,3 1 Department of

More information

Gaussian Processes. Le Song. Machine Learning II: Advanced Topics CSE 8803ML, Spring 2012

Gaussian Processes. Le Song. Machine Learning II: Advanced Topics CSE 8803ML, Spring 2012 Gaussian Processes Le Song Machine Learning II: Advanced Topics CSE 8803ML, Spring 01 Pictorial view of embedding distribution Transform the entire distribution to expected features Feature space Feature

More information

Monitoring Wafer Geometric Quality using Additive Gaussian Process

Monitoring Wafer Geometric Quality using Additive Gaussian Process Monitoring Wafer Geometric Quality using Additive Gaussian Process Linmiao Zhang 1 Kaibo Wang 2 Nan Chen 1 1 Department of Industrial and Systems Engineering, National University of Singapore 2 Department

More information

Fall Math 3410 Name (Print): Solution KEY Practice Exam 2 - November 4 Time Limit: 50 Minutes

Fall Math 3410 Name (Print): Solution KEY Practice Exam 2 - November 4 Time Limit: 50 Minutes Fall 206 - Math 340 Name (Print): Solution KEY Practice Exam 2 - November 4 Time Limit: 50 Minutes This exam contains pages (including this cover page) and 5 problems. Check to see if any pages are missing.

More information

Using Principal Component Analysis Modeling to Monitor Temperature Sensors in a Nuclear Research Reactor

Using Principal Component Analysis Modeling to Monitor Temperature Sensors in a Nuclear Research Reactor Using Principal Component Analysis Modeling to Monitor Temperature Sensors in a Nuclear Research Reactor Rosani M. L. Penha Centro de Energia Nuclear Instituto de Pesquisas Energéticas e Nucleares - Ipen

More information

Monitoring of Mineral Processing Operations based on Multivariate Similarity Indices

Monitoring of Mineral Processing Operations based on Multivariate Similarity Indices Monitoring of Mineral Processing Operations based on Multivariate Similarity Indices L. Auret, C. Aldrich* Department of Process Engineering, University of Stellenbosch, Private Bag X1, Matieland 7602,

More information

Digital Signal Processing Chapter 10. Fourier Analysis of Discrete- Time Signals and Systems CHI. CES Engineering. Prof. Yasser Mostafa Kadah

Digital Signal Processing Chapter 10. Fourier Analysis of Discrete- Time Signals and Systems CHI. CES Engineering. Prof. Yasser Mostafa Kadah Digital Signal Processing Chapter 10 Fourier Analysis of Discrete- Time Signals and Systems Prof. Yasser Mostafa Kadah CHI CES Engineering Discrete-Time Fourier Transform Sampled time domain signal has

More information

Linear Regression. CSL603 - Fall 2017 Narayanan C Krishnan

Linear Regression. CSL603 - Fall 2017 Narayanan C Krishnan Linear Regression CSL603 - Fall 2017 Narayanan C Krishnan ckn@iitrpr.ac.in Outline Univariate regression Multivariate regression Probabilistic view of regression Loss functions Bias-Variance analysis Regularization

More information

Exam 2. Average: 85.6 Median: 87.0 Maximum: Minimum: 55.0 Standard Deviation: Numerical Methods Fall 2011 Lecture 20

Exam 2. Average: 85.6 Median: 87.0 Maximum: Minimum: 55.0 Standard Deviation: Numerical Methods Fall 2011 Lecture 20 Exam 2 Average: 85.6 Median: 87.0 Maximum: 100.0 Minimum: 55.0 Standard Deviation: 10.42 Fall 2011 1 Today s class Multiple Variable Linear Regression Polynomial Interpolation Lagrange Interpolation Newton

More information

Linear Regression. CSL465/603 - Fall 2016 Narayanan C Krishnan

Linear Regression. CSL465/603 - Fall 2016 Narayanan C Krishnan Linear Regression CSL465/603 - Fall 2016 Narayanan C Krishnan ckn@iitrpr.ac.in Outline Univariate regression Multivariate regression Probabilistic view of regression Loss functions Bias-Variance analysis

More information

Regenerative Likelihood Ratio control schemes

Regenerative Likelihood Ratio control schemes Regenerative Likelihood Ratio control schemes Emmanuel Yashchin IBM Research, Yorktown Heights, NY XIth Intl. Workshop on Intelligent Statistical Quality Control 2013, Sydney, Australia Outline Motivation

More information

Deadlines misses and their Implication on Feedback Control Loops. Dip Goswami Eindhoven University of Technology (TU/e) The Netherlands

Deadlines misses and their Implication on Feedback Control Loops. Dip Goswami Eindhoven University of Technology (TU/e) The Netherlands Deadlines misses and their Implication on Feedback Control Loops Dip Goswami Eindhoven University of Technology (TU/e) The Netherlands Periodic tasks dd ii 2 Periodic tasks dd ii Hard deadlines 3 Periodic

More information

446 CHAP. 8 NUMERICAL OPTIMIZATION. Newton's Search for a Minimum of f(x,y) Newton s Method

446 CHAP. 8 NUMERICAL OPTIMIZATION. Newton's Search for a Minimum of f(x,y) Newton s Method 446 CHAP. 8 NUMERICAL OPTIMIZATION Newton's Search for a Minimum of f(xy) Newton s Method The quadratic approximation method of Section 8.1 generated a sequence of seconddegree Lagrange polynomials. It

More information

Applying Machine Learning for Gravitational-wave Burst Data Analysis

Applying Machine Learning for Gravitational-wave Burst Data Analysis Applying Machine Learning for Gravitational-wave Burst Data Analysis Junwei Cao LIGO Scientific Collaboration Research Group Research Institute of Information Technology Tsinghua University June 29, 2016

More information

NONLINEAR CLASSIFICATION AND REGRESSION. J. Elder CSE 4404/5327 Introduction to Machine Learning and Pattern Recognition

NONLINEAR CLASSIFICATION AND REGRESSION. J. Elder CSE 4404/5327 Introduction to Machine Learning and Pattern Recognition NONLINEAR CLASSIFICATION AND REGRESSION Nonlinear Classification and Regression: Outline 2 Multi-Layer Perceptrons The Back-Propagation Learning Algorithm Generalized Linear Models Radial Basis Function

More information

About closed-loop control and observability of max-plus linear systems: Application to manufacturing systems

About closed-loop control and observability of max-plus linear systems: Application to manufacturing systems About closed-loop control and observability of max-plus linear systems: Application to manufacturing systems Laurent Hardouin and Xavier David-Henriet perso-laris.univ-angers.fr/~hardouin/ ISTIA-LARIS,

More information

Monitoring and diagnosing a two-stage production process with attribute characteristics

Monitoring and diagnosing a two-stage production process with attribute characteristics Iranian Journal of Operations Research Vol., No.,, pp. -6 Monitoring and diagnosing a two-stage production process with attribute characteristics Downloaded from iors.ir at :6 +33 on Wednesday October

More information

Conditional Random Fields for Sequential Supervised Learning

Conditional Random Fields for Sequential Supervised Learning Conditional Random Fields for Sequential Supervised Learning Thomas G. Dietterich Adam Ashenfelter Department of Computer Science Oregon State University Corvallis, Oregon 97331 http://www.eecs.oregonstate.edu/~tgd

More information

A Gentle Introduction to Gradient Boosting. Cheng Li College of Computer and Information Science Northeastern University

A Gentle Introduction to Gradient Boosting. Cheng Li College of Computer and Information Science Northeastern University A Gentle Introduction to Gradient Boosting Cheng Li chengli@ccs.neu.edu College of Computer and Information Science Northeastern University Gradient Boosting a powerful machine learning algorithm it can

More information

Sec. 14.3: Partial Derivatives. All of the following are ways of representing the derivative. y dx

Sec. 14.3: Partial Derivatives. All of the following are ways of representing the derivative. y dx Math 2204 Multivariable Calc Chapter 14: Partial Derivatives I. Review from math 1225 A. First Derivative Sec. 14.3: Partial Derivatives 1. Def n : The derivative of the function f with respect to the

More information

Multivariate Analysis and Likelihood Inference

Multivariate Analysis and Likelihood Inference Multivariate Analysis and Likelihood Inference Outline 1 Joint Distribution of Random Variables 2 Principal Component Analysis (PCA) 3 Multivariate Normal Distribution 4 Likelihood Inference Joint density

More information

15.1 The Regression Model: Analysis of Residuals

15.1 The Regression Model: Analysis of Residuals 15.1 The Regression Model: Analysis of Residuals Tom Lewis Fall Term 2009 Tom Lewis () 15.1 The Regression Model: Analysis of Residuals Fall Term 2009 1 / 12 Outline 1 The regression model 2 Estimating

More information

Non-linear Supervised High Frequency Trading Strategies with Applications in US Equity Markets

Non-linear Supervised High Frequency Trading Strategies with Applications in US Equity Markets Non-linear Supervised High Frequency Trading Strategies with Applications in US Equity Markets Nan Zhou, Wen Cheng, Ph.D. Associate, Quantitative Research, J.P. Morgan nan.zhou@jpmorgan.com The 4th Annual

More information

ECONOMETRIC THEORY. MODULE VI Lecture 19 Regression Analysis Under Linear Restrictions

ECONOMETRIC THEORY. MODULE VI Lecture 19 Regression Analysis Under Linear Restrictions ECONOMETRIC THEORY MODULE VI Lecture 9 Regression Analysis Under Linear Restrictions Dr Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur One of the basic objectives

More information

Introduction to Machine Learning

Introduction to Machine Learning Introduction to Machine Learning Kernel Methods Varun Chandola Computer Science & Engineering State University of New York at Buffalo Buffalo, NY, USA chandola@buffalo.edu Chandola@UB CSE 474/574 1 / 21

More information

ALMOST PERIODIC SOLUTIONS OF NONLINEAR DISCRETE VOLTERRA EQUATIONS WITH UNBOUNDED DELAY. 1. Almost periodic sequences and difference equations

ALMOST PERIODIC SOLUTIONS OF NONLINEAR DISCRETE VOLTERRA EQUATIONS WITH UNBOUNDED DELAY. 1. Almost periodic sequences and difference equations Trends in Mathematics - New Series Information Center for Mathematical Sciences Volume 10, Number 2, 2008, pages 27 32 2008 International Workshop on Dynamical Systems and Related Topics c 2008 ICMS in

More information

Improved multi-scale kernel principal component analysis and its application for fault detection

Improved multi-scale kernel principal component analysis and its application for fault detection chemical engineering research and design 9 ( 2 1 2 ) 1271 128 Contents lists available at SciVerse ScienceDirect Chemical Engineering Research and Design j ourna l ho me page: www.elsevier.com/locate/cherd

More information

STATISTICS 407 METHODS OF MULTIVARIATE ANALYSIS TOPICS

STATISTICS 407 METHODS OF MULTIVARIATE ANALYSIS TOPICS STATISTICS 407 METHODS OF MULTIVARIATE ANALYSIS TOPICS Principal Component Analysis (PCA): Reduce the, summarize the sources of variation in the data, transform the data into a new data set where the variables

More information

Emerging trends in Statistical Process Control of Industrial Processes. Marco S. Reis

Emerging trends in Statistical Process Control of Industrial Processes. Marco S. Reis Emerging trends in Statistical Process Control of Industrial Processes Marco S. Reis Guimarães, July 15 th, 16 Chemical Process Engineering and Forest Products Research Center CIEPQPF Department of Chemical

More information

Cheng Soon Ong & Christian Walder. Canberra February June 2018

Cheng Soon Ong & Christian Walder. Canberra February June 2018 Cheng Soon Ong & Christian Walder Research Group and College of Engineering and Computer Science Canberra February June 2018 Outlines Overview Introduction Linear Algebra Probability Linear Regression

More information

A = (a + 1) 2 = a 2 + 2a + 1

A = (a + 1) 2 = a 2 + 2a + 1 A = (a + 1) 2 = a 2 + 2a + 1 1 A = ( (a + b) + 1 ) 2 = (a + b) 2 + 2(a + b) + 1 = a 2 + 2ab + b 2 + 2a + 2b + 1 A = ( (a + b) + 1 ) 2 = (a + b) 2 + 2(a + b) + 1 = a 2 + 2ab + b 2 + 2a + 2b + 1 3 A = (

More information

GAUSSIAN PROCESS REGRESSION

GAUSSIAN PROCESS REGRESSION GAUSSIAN PROCESS REGRESSION CSE 515T Spring 2015 1. BACKGROUND The kernel trick again... The Kernel Trick Consider again the linear regression model: y(x) = φ(x) w + ε, with prior p(w) = N (w; 0, Σ). The

More information

Mining Big Data Using Parsimonious Factor and Shrinkage Methods

Mining Big Data Using Parsimonious Factor and Shrinkage Methods Mining Big Data Using Parsimonious Factor and Shrinkage Methods Hyun Hak Kim 1 and Norman Swanson 2 1 Bank of Korea and 2 Rutgers University ECB Workshop on using Big Data for Forecasting and Statistics

More information

Introduction to Signal Detection and Classification. Phani Chavali

Introduction to Signal Detection and Classification. Phani Chavali Introduction to Signal Detection and Classification Phani Chavali Outline Detection Problem Performance Measures Receiver Operating Characteristics (ROC) F-Test - Test Linear Discriminant Analysis (LDA)

More information

Math Maximum and Minimum Values, I

Math Maximum and Minimum Values, I Math 213 - Maximum and Minimum Values, I Peter A. Perry University of Kentucky October 8, 218 Homework Re-read section 14.7, pp. 959 965; read carefully pp. 965 967 Begin homework on section 14.7, problems

More information

Simple Linear Regression Estimation and Properties

Simple Linear Regression Estimation and Properties Simple Linear Regression Estimation and Properties Outline Review of the Reading Estimate parameters using OLS Other features of OLS Numerical Properties of OLS Assumptions of OLS Goodness of Fit Checking

More information

Digital Signal Processing Lecture 10 - Discrete Fourier Transform

Digital Signal Processing Lecture 10 - Discrete Fourier Transform Digital Signal Processing - Discrete Fourier Transform Electrical Engineering and Computer Science University of Tennessee, Knoxville November 12, 2015 Overview 1 2 3 4 Review - 1 Introduction Discrete-time

More information

STA414/2104. Lecture 11: Gaussian Processes. Department of Statistics

STA414/2104. Lecture 11: Gaussian Processes. Department of Statistics STA414/2104 Lecture 11: Gaussian Processes Department of Statistics www.utstat.utoronto.ca Delivered by Mark Ebden with thanks to Russ Salakhutdinov Outline Gaussian Processes Exam review Course evaluations

More information

Polynomial Review Problems

Polynomial Review Problems Polynomial Review Problems 1. Find polynomial function formulas that could fit each of these graphs. Remember that you will need to determine the value of the leading coefficient. The point (0,-3) is on

More information

Kernel Methods. Outline

Kernel Methods. Outline Kernel Methods Quang Nguyen University of Pittsburgh CS 3750, Fall 2011 Outline Motivation Examples Kernels Definitions Kernel trick Basic properties Mercer condition Constructing feature space Hilbert

More information

This exam will be over material covered in class from Monday 14 February through Tuesday 8 March, corresponding to sections in the text.

This exam will be over material covered in class from Monday 14 February through Tuesday 8 March, corresponding to sections in the text. Math 275, section 002 (Ultman) Spring 2011 MIDTERM 2 REVIEW The second midterm will be held in class (1:40 2:30pm) on Friday 11 March. You will be allowed one half of one side of an 8.5 11 sheet of paper

More information

ECONOMETRIC THEORY. MODULE XVII Lecture - 43 Simultaneous Equations Models

ECONOMETRIC THEORY. MODULE XVII Lecture - 43 Simultaneous Equations Models ECONOMETRIC THEORY MODULE XVII Lecture - 43 Simultaneous Equations Models Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur 2 Estimation of parameters To estimate

More information

To get horizontal and slant asymptotes algebraically we need to know about end behaviour for rational functions.

To get horizontal and slant asymptotes algebraically we need to know about end behaviour for rational functions. Concepts: Horizontal Asymptotes, Vertical Asymptotes, Slant (Oblique) Asymptotes, Transforming Reciprocal Function, Sketching Rational Functions, Solving Inequalities using Sign Charts. Rational Function

More information

PRODUCT yield plays a critical role in determining the

PRODUCT yield plays a critical role in determining the 140 IEEE TRANSACTIONS ON SEMICONDUCTOR MANUFACTURING, VOL. 18, NO. 1, FEBRUARY 2005 Monitoring Defects in IC Fabrication Using a Hotelling T 2 Control Chart Lee-Ing Tong, Chung-Ho Wang, and Chih-Li Huang

More information

Modeling and Control Based on Generalized Fuzzy Hyperbolic Model

Modeling and Control Based on Generalized Fuzzy Hyperbolic Model 5 American Control Conference June 8-5. Portland OR USA WeC7. Modeling and Control Based on Generalized Fuzzy Hyperbolic Model Mingjun Zhang and Huaguang Zhang Abstract In this paper a novel generalized

More information

Modeling Data with Linear Combinations of Basis Functions. Read Chapter 3 in the text by Bishop

Modeling Data with Linear Combinations of Basis Functions. Read Chapter 3 in the text by Bishop Modeling Data with Linear Combinations of Basis Functions Read Chapter 3 in the text by Bishop A Type of Supervised Learning Problem We want to model data (x 1, t 1 ),..., (x N, t N ), where x i is a vector

More information

Projection Theorem 1

Projection Theorem 1 Projection Theorem 1 Cauchy-Schwarz Inequality Lemma. (Cauchy-Schwarz Inequality) For all x, y in an inner product space, [ xy, ] x y. Equality holds if and only if x y or y θ. Proof. If y θ, the inequality

More information

Linear Models in Machine Learning

Linear Models in Machine Learning CS540 Intro to AI Linear Models in Machine Learning Lecturer: Xiaojin Zhu jerryzhu@cs.wisc.edu We briefly go over two linear models frequently used in machine learning: linear regression for, well, regression,

More information

Deep Neural Networks (1) Hidden layers; Back-propagation

Deep Neural Networks (1) Hidden layers; Back-propagation Deep Neural Networs (1) Hidden layers; Bac-propagation Steve Renals Machine Learning Practical MLP Lecture 3 2 October 2018 http://www.inf.ed.ac.u/teaching/courses/mlp/ MLP Lecture 3 / 2 October 2018 Deep

More information

LESSON 23: EXTREMA OF FUNCTIONS OF 2 VARIABLES OCTOBER 25, 2017

LESSON 23: EXTREMA OF FUNCTIONS OF 2 VARIABLES OCTOBER 25, 2017 LESSON : EXTREMA OF FUNCTIONS OF VARIABLES OCTOBER 5, 017 Just like with functions of a single variable, we want to find the minima (plural of minimum) and maxima (plural of maximum) of functions of several

More information

Polynomial Degree Leading Coefficient. Sign of Leading Coefficient

Polynomial Degree Leading Coefficient. Sign of Leading Coefficient Chapter 1 PRE-TEST REVIEW Polynomial Functions MHF4U Jensen Section 1: 1.1 Power Functions 1) State the degree and the leading coefficient of each polynomial Polynomial Degree Leading Coefficient y = 2x

More information