DESIGN OF EXPERIMENT ERT 427 Response Surface Methodology (RSM) Miss Hanna Ilyani Zulhaimi

Size: px
Start display at page:

Download "DESIGN OF EXPERIMENT ERT 427 Response Surface Methodology (RSM) Miss Hanna Ilyani Zulhaimi"

Transcription

1 + DESIGN OF EXPERIMENT ERT 427 Response Surface Methodology (RSM) Miss Hanna Ilyani Zulhaimi

2 + Outline n Definition of Response Surface Methodology n Method of Steepest Ascent n Second-Order Response Surface n Response Surface Characterization n Location of Stationary Point n Experimental Design for Fitting First Order and Second Order Model (CCD and Box-Behnken Design) n Blocking in Response Surface Design

3 + Response Surface Methods and Designs n Primary focus of previous chapters is factor screening Ø Two-level factorials, fractional factorials are widely used n Response Surface Methodology (RSM) is useful for the modeling and analysis of programs in which a response of interest is influenced by several variables. n Objective of RSM is optimization n For example: Find the levels of temperature (x 1 ) and pressure (x 2 ) to maximize the yield (y) of a process. y = f (x 1, x 2 )+ε

4 + Example of Response Surface Graph

5 + (continued) n RSM a sequential procedure n The objective is to lead the experimenter rapidly and efficiently along a path of improvement toward the general vicinity of the optimum. n First-order model goes to Second-order model n Climb a hill

6 + Response Surface Model

7 + Method of Steepest Ascent n Assume that the first-order model is an adequate approximation to the true surface in a small ragion of the x s. n A p r o c e d u r e f o r m o v i n g sequentially from an initial guess towards to region of the optimum. n Based on the fitted first-order model n Steepest ascent is a gradient procedure n The path of steepest ascent is the regression coefficients Figure 11.4: First-order response surface and path of steepest ascent

8 + Example 11.1: n A chemical engineer is interested in determining the operating conditions that maximize the yield of a process. Two controllable variables: reaction time (ξ1) and reaction temperature (ξ2). The engineer is currently operating the process with reaction time of 35 minutes and temperature of 155 F, which result in yield around 40 percent. Because it is unlikely that this region contains the optimum, she fits a firstorder model and applies the method of steepest ascent.

9 + (continue ) The design employed was a 22 factorial design with 6ive centerpoints

10 + (Continued) n A first-order model may be fit to these data by least squares.

11 + n To move away from the design center, the point (x 1 =0,x 2 =0) along the path of steepest ascent, we would move units in the x 1 direction for every units in the x 2 direction. If we decide to use 5 minutes of reaction time as the basic step size, then. Δx 1 = Δx 2 = [(0.325/0.775)Δx 1 ] = n The engineer computes points along this path and observes yields at these points until a decrease in response is noted.the results are shown in Table1-3.The Steps are shown in both coded and natural variables.

12 The step size is 5 minutes of reaction time and 2 degrees F We can see from the table1-3,increases in response are observed through the tenth step. However the eleventh step produces a decrease in yield. Therefore, another first-order model must be fit in the general vicinity of the point( ξ 1 = 85, ξ 2 =175) 2 12

13 + Data for second First-Order Model The first- order model fit to the coded data in Table 1-4 is y= x X 2

14 + Analysis of data for second first-model

15 + Summary of Steepest Ascent q Points on the path of steepest ascent are proportional to the magnitudes of the model regression coefficients. q The direction depends on the sign of the regression coefficient. q Step-by-step procedure:

16 + The Second-Order Model n When the experimenter is relative closed to the optimum, the second- order model is used to approximate the response. n It is used to 6ind the stationary point. n Determine whether the stationary point is a point of maximum or minimum response or a saddle point. n There is a lot of empirical evidence that they work very well. These models are used widely in practice. n Optimization is easy.

17 + Characterization of the Response Surface n Find the stationary point n Find what type of surface we have Ø Graphical Analysis Ø Canonical Analysis n Determine the sensitivity of the response variable to the optimum value Ø Canonical Analysis

18 + Second Order Model: Stationary Point n Writing the second-order model in matrix notation, we have: b x y b B x B b x Bx x b x s 1 s ' ˆ ˆ 2 1 ˆ 2 / ˆ ˆ 2 / ˆ 2 / ˆ ˆ and ˆ ˆ ˆ,, ' ' ˆ ˆ s kk k k k x k x x y + = = = = = + + = β β β β β β β β β β β ç Stationary point

19 + Second Order Model: Stationary Point n In derivatives form: n Stationary point represents: Ø Maximum Point Ø Minimum Point Ø Saddle Point (minimax)

20 + Response Surface with Maximum Point

21 + Response Surface with minimum point

22 + Response Surface with Saddle point

23 + Canonical Analysis The canonical form: the {λ i } are the e i g e n v a l u e s o r characteristic roots of the matrix B

24 + Canonical Analysis n The nature of the response surface can be determined from the stationary point & the signs and magnitudes of the {λi }. Ø all positive: a minimum is found Ø all negative: a maximum is found Ø mixed: a saddle point is found n The response surface is steepest in the direction (canonical) corresponding to the largest absolute eigenvalue

25 + In Example 11.2 n We continue in Example However, we try to transfer first-order model with second-order. n Central composite design (CCD) was chosen (Table 11.6 & Figure 11.10). n The coefficients are as in Table 11.7 Ø Find the stationary point, x s Ø Change coded variable to natural variables (ξ 1 = 87 minutes; ξ 2 = F) Ø Characterize response surface by using canonical analysis Ø Rewrite the fitted model in canonical form:

26 + Fitting Design for First-Order Model n Suppose we have first-order model; n The class of orthogonal includes 2k full and fractional design in which main effects are not aliased with each other. Addition of center points is usually a good idea

27 + Fitting Design for Second-Order Model n Suppose we have second-order model; n Design for second-order model includes: Ø Central Composite Design Ø Box-Behnken design Ø Face-centered design Ø Equiradial design Ø small composite design & hybrid design

28 + Central Composite Design n The CCD consists of a 2 k factorial with n F factorial runs, 2k axial or star runs, and n c center runs.

29 + Rotatable CCD,α= nf 1/4 u A second-order response surface design is rotatable if the variance of the predicted response V[yˆ(x)] is the same at all the points of x that are at the same distance form the design center: α = (n F ) 1/4 u Gives the same prediction in all directions.

30 + Spherical CCD, α= (k) 1/2 n All factorial runs and axial runs have the same distance to the center: α = (k) 1/2 n Rotatability is a spherical property. However, it is not important to have exact rotatability to have spherical. n Spherical CCD: puts all the factorial and axial points on the surface of a sphere of radius k.

31 + Box Behnken Design n Three-level designs for small number of runs. n All points are on the distance 2 1/2 = from the center. n No points at the vertices. n Either rotatable or nearly rotatable.

32 + Blocking in Response Surface Methodology n It is often necessary to consider blocking to eliminate nuisance. n For second-order design to block orthogonally, two conditions must be satisfied: 1. Each block must be a first-order orthogonal design; that is: 2. The fraction of the total sum of square for each variable contributed by every block must be equal to the fraction of of the total observation that occur in the block; that is:

33 + Blocking in Response Surface Methodology n In general, when two blocks are required blocking, there should be an axial block and a factorial block. n For three blocks, the factorial block is divided into two blocks and the axial block is not split.

34 + CCD of Two Factors, 2 Blocks

35 + CCD of Three Factors, 3 Blocks

36 + Thank you J

7. Response Surface Methodology (Ch.10. Regression Modeling Ch. 11. Response Surface Methodology)

7. Response Surface Methodology (Ch.10. Regression Modeling Ch. 11. Response Surface Methodology) 7. Response Surface Methodology (Ch.10. Regression Modeling Ch. 11. Response Surface Methodology) Hae-Jin Choi School of Mechanical Engineering, Chung-Ang University 1 Introduction Response surface methodology,

More information

Response Surface Methodology

Response Surface Methodology Response Surface Methodology Process and Product Optimization Using Designed Experiments Second Edition RAYMOND H. MYERS Virginia Polytechnic Institute and State University DOUGLAS C. MONTGOMERY Arizona

More information

Design and Analysis of Experiments

Design and Analysis of Experiments Design and Analysis of Experiments Part IX: Response Surface Methodology Prof. Dr. Anselmo E de Oliveira anselmo.quimica.ufg.br anselmo.disciplinas@gmail.com Methods Math Statistics Models/Analyses Response

More information

Response Surface Methodology:

Response Surface Methodology: Response Surface Methodology: Process and Product Optimization Using Designed Experiments RAYMOND H. MYERS Virginia Polytechnic Institute and State University DOUGLAS C. MONTGOMERY Arizona State University

More information

Analysis of Variance and Design of Experiments-II

Analysis of Variance and Design of Experiments-II Analysis of Variance and Design of Experiments-II MODULE VIII LECTURE - 36 RESPONSE SURFACE DESIGNS Dr. Shalabh Department of Mathematics & Statistics Indian Institute of Technology Kanpur 2 Design for

More information

Response Surface Methodology: Process and Product Optimization Using Designed Experiments, 3rd Edition

Response Surface Methodology: Process and Product Optimization Using Designed Experiments, 3rd Edition Brochure More information from http://www.researchandmarkets.com/reports/705963/ Response Surface Methodology: Process and Product Optimization Using Designed Experiments, 3rd Edition Description: Identifying

More information

Response Surface Methodology

Response Surface Methodology Response Surface Methodology Bruce A Craig Department of Statistics Purdue University STAT 514 Topic 27 1 Response Surface Methodology Interested in response y in relation to numeric factors x Relationship

More information

J. Response Surface Methodology

J. Response Surface Methodology J. Response Surface Methodology Response Surface Methodology. Chemical Example (Box, Hunter & Hunter) Objective: Find settings of R, Reaction Time and T, Temperature that produced maximum yield subject

More information

Unit 12: Response Surface Methodology and Optimality Criteria

Unit 12: Response Surface Methodology and Optimality Criteria Unit 12: Response Surface Methodology and Optimality Criteria STA 643: Advanced Experimental Design Derek S. Young 1 Learning Objectives Revisit your knowledge of polynomial regression Know how to use

More information

14.0 RESPONSE SURFACE METHODOLOGY (RSM)

14.0 RESPONSE SURFACE METHODOLOGY (RSM) 4. RESPONSE SURFACE METHODOLOGY (RSM) (Updated Spring ) So far, we ve focused on experiments that: Identify a few important variables from a large set of candidate variables, i.e., a screening experiment.

More information

Response Surface Methodology IV

Response Surface Methodology IV LECTURE 8 Response Surface Methodology IV 1. Bias and Variance If y x is the response of the system at the point x, or in short hand, y x = f (x), then we can write η x = E(y x ). This is the true, and

More information

Response Surface Methodology III

Response Surface Methodology III LECTURE 7 Response Surface Methodology III 1. Canonical Form of Response Surface Models To examine the estimated regression model we have several choices. First, we could plot response contours. Remember

More information

2.830J / 6.780J / ESD.63J Control of Manufacturing Processes (SMA 6303) Spring 2008

2.830J / 6.780J / ESD.63J Control of Manufacturing Processes (SMA 6303) Spring 2008 MIT OpenCourseWare http://ocw.mit.edu 2.830J / 6.780J / ESD.63J Control of Processes (SMA 6303) Spring 2008 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms.

More information

OPTIMIZATION OF FIRST ORDER MODELS

OPTIMIZATION OF FIRST ORDER MODELS Chapter 2 OPTIMIZATION OF FIRST ORDER MODELS One should not multiply explanations and causes unless it is strictly necessary William of Bakersville in Umberto Eco s In the Name of the Rose 1 In Response

More information

RESPONSE SURFACE MODELLING, RSM

RESPONSE SURFACE MODELLING, RSM CHEM-E3205 BIOPROCESS OPTIMIZATION AND SIMULATION LECTURE 3 RESPONSE SURFACE MODELLING, RSM Tool for process optimization HISTORY Statistical experimental design pioneering work R.A. Fisher in 1925: Statistical

More information

8 RESPONSE SURFACE DESIGNS

8 RESPONSE SURFACE DESIGNS 8 RESPONSE SURFACE DESIGNS Desirable Properties of a Response Surface Design 1. It should generate a satisfactory distribution of information throughout the design region. 2. It should ensure that the

More information

2/26/2017. This is similar to canonical correlation in some ways. PSY 512: Advanced Statistics for Psychological and Behavioral Research 2

2/26/2017. This is similar to canonical correlation in some ways. PSY 512: Advanced Statistics for Psychological and Behavioral Research 2 PSY 512: Advanced Statistics for Psychological and Behavioral Research 2 What is factor analysis? What are factors? Representing factors Graphs and equations Extracting factors Methods and criteria Interpreting

More information

Design of experiment ERT k-p fractional factorial. Miss Hanna Ilyani Zulhaimi

Design of experiment ERT k-p fractional factorial. Miss Hanna Ilyani Zulhaimi + Design of experiment ERT 427 2 k-p fractional factorial Miss Hanna Ilyani Zulhaimi + OUTLINE n Limitation of full factorial design n The concept of fractional factorial, 2 k-p n One-half fraction factorial

More information

Contents. 2 2 factorial design 4

Contents. 2 2 factorial design 4 Contents TAMS38 - Lecture 10 Response surface methodology Lecturer: Zhenxia Liu Department of Mathematics - Mathematical Statistics 12 December, 2017 2 2 factorial design Polynomial Regression model First

More information

RESPONSE SURFACE METHODOLOGY

RESPONSE SURFACE METHODOLOGY RESPONSE SURFACE METHODOLOGY WILEY SERIES IN PROBABILITY AND STATISTICS Established by WALTER A. SHEWHART and SAMUEL S. WILKS Editors: David J. Balding, Noel A. C. Cressie, Garrett M. Fitzmaurice, Iain

More information

Chemometrics Unit 4 Response Surface Methodology

Chemometrics Unit 4 Response Surface Methodology Chemometrics Unit 4 Response Surface Methodology Chemometrics Unit 4. Response Surface Methodology In Unit 3 the first two phases of experimental design - definition and screening - were discussed. In

More information

Process/product optimization using design of experiments and response surface methodology

Process/product optimization using design of experiments and response surface methodology Process/product optimization using design of experiments and response surface methodology Mikko Mäkelä Sveriges landbruksuniversitet Swedish University of Agricultural Sciences Department of Forest Biomaterials

More information

Design of Experiments SUTD 06/04/2016 1

Design of Experiments SUTD 06/04/2016 1 Design of Experiments SUTD 06/04/2016 1 Outline 1. Introduction 2. 2 k Factorial Design 3. Choice of Sample Size 4. 2 k p Fractional Factorial Design 5. Follow-up experimentation (folding over) with factorial

More information

7.3 Ridge Analysis of the Response Surface

7.3 Ridge Analysis of the Response Surface 7.3 Ridge Analysis of the Response Surface When analyzing a fitted response surface, the researcher may find that the stationary point is outside of the experimental design region, but the researcher wants

More information

Forced Convection: Inside Pipe HANNA ILYANI ZULHAIMI

Forced Convection: Inside Pipe HANNA ILYANI ZULHAIMI + Forced Convection: Inside Pipe HANNA ILYANI ZULHAIMI + OUTLINE u Introduction and Dimensionless Numbers u Heat Transfer Coefficient for Laminar Flow inside a Pipe u Heat Transfer Coefficient for Turbulent

More information

Contents. Response Surface Designs. Contents. References.

Contents. Response Surface Designs. Contents. References. Response Surface Designs Designs for continuous variables Frédéric Bertrand 1 1 IRMA, Université de Strasbourg Strasbourg, France ENSAI 3 e Année 2017-2018 Setting Visualizing the Response First-Order

More information

7 The Analysis of Response Surfaces

7 The Analysis of Response Surfaces 7 The Analysis of Response Surfaces Goal: the researcher is seeking the experimental conditions which are most desirable, that is, determine optimum design variable levels. Once the researcher has determined

More information

Appendix IV Experimental Design

Appendix IV Experimental Design Experimental Design The aim of pharmaceutical formulation and development is to develop an acceptable pharmaceutical formulation in the shortest possible time, using minimum number of working hours and

More information

ON THE DESIGN POINTS FOR A ROTATABLE ORTHOGONAL CENTRAL COMPOSITE DESIGN

ON THE DESIGN POINTS FOR A ROTATABLE ORTHOGONAL CENTRAL COMPOSITE DESIGN ON THE DESIGN POINTS FOR A ROTATABLE ORTHOGONAL CENTRAL COMPOSITE DESIGN Authors: CHRISTOS P. KITSOS Department of Informatics, Technological Educational Institute of Athens, Greece (xkitsos@teiath.gr)

More information

Experimental Design and Optimization

Experimental Design and Optimization . Experimental Design Stages a) Identifying the factors which may affect the results of an experiment; b) Designing the experiment so that the effects of uncontrolled factors are minimized; c) Using statistical

More information

Design of Experiments SUTD - 21/4/2015 1

Design of Experiments SUTD - 21/4/2015 1 Design of Experiments SUTD - 21/4/2015 1 Outline 1. Introduction 2. 2 k Factorial Design Exercise 3. Choice of Sample Size Exercise 4. 2 k p Fractional Factorial Design Exercise 5. Follow-up experimentation

More information

Contents. TAMS38 - Lecture 10 Response surface. Lecturer: Jolanta Pielaszkiewicz. Response surface 3. Response surface, cont. 4

Contents. TAMS38 - Lecture 10 Response surface. Lecturer: Jolanta Pielaszkiewicz. Response surface 3. Response surface, cont. 4 Contents TAMS38 - Lecture 10 Response surface Lecturer: Jolanta Pielaszkiewicz Matematisk statistik - Matematiska institutionen Linköpings universitet Look beneath the surface; let not the several quality

More information

Design Moments. Many properties of experimental designs are quantified by design moments. Given a model matrix 1 x 11 x 21 x k1 1 x 12 x 22 x k2 X =

Design Moments. Many properties of experimental designs are quantified by design moments. Given a model matrix 1 x 11 x 21 x k1 1 x 12 x 22 x k2 X = 8.5 Rotatability Recall: Var[ŷ(x)] = σ 2 x (m) () 1 x (m) is the prediction variance and NVar[ŷ(x)]/σ 2 = Nx (m) () 1 x (m) is the scaled prediction variance. A design is rotatable if the prediction variance

More information

Response Surface Methods

Response Surface Methods Response Surface Methods 3.12.2014 Goals of Today s Lecture See how a sequence of experiments can be performed to optimize a response variable. Understand the difference between first-order and second-order

More information

2 Introduction to Response Surface Methodology

2 Introduction to Response Surface Methodology 2 Introduction to Response Surface Methodology 2.1 Goals of Response Surface Methods The experimenter is often interested in 1. Finding a suitable approximating function for the purpose of predicting a

More information

LECTURE 22: SWARM INTELLIGENCE 3 / CLASSICAL OPTIMIZATION

LECTURE 22: SWARM INTELLIGENCE 3 / CLASSICAL OPTIMIZATION 15-382 COLLECTIVE INTELLIGENCE - S19 LECTURE 22: SWARM INTELLIGENCE 3 / CLASSICAL OPTIMIZATION TEACHER: GIANNI A. DI CARO WHAT IF WE HAVE ONE SINGLE AGENT PSO leverages the presence of a swarm: the outcome

More information

Two-Stage Computing Budget Allocation. Approach for Response Surface Method PENG JI

Two-Stage Computing Budget Allocation. Approach for Response Surface Method PENG JI Two-Stage Computing Budget Allocation Approach for Response Surface Method PENG JI NATIONAL UNIVERSITY OF SINGAPORE 2005 Two-Stage Computing Budget Allocation Approach for Response Surface Method PENG

More information

Response-surface illustration

Response-surface illustration Response-surface illustration Russ Lenth October 23, 2017 Abstract In this vignette, we give an illustration, using simulated data, of a sequential-experimentation process to optimize a response surface.

More information

Introduction to Design of Experiments

Introduction to Design of Experiments Introduction to Design of Experiments Jean-Marc Vincent and Arnaud Legrand Laboratory ID-IMAG MESCAL Project Universities of Grenoble {Jean-Marc.Vincent,Arnaud.Legrand}@imag.fr November 20, 2011 J.-M.

More information

CHAPTER 5 NON-LINEAR SURROGATE MODEL

CHAPTER 5 NON-LINEAR SURROGATE MODEL 96 CHAPTER 5 NON-LINEAR SURROGATE MODEL 5.1 INTRODUCTION As set out in the research methodology and in sequent with the previous section on development of LSM, construction of the non-linear surrogate

More information

MATH602: APPLIED STATISTICS

MATH602: APPLIED STATISTICS MATH602: APPLIED STATISTICS Dr. Srinivas R. Chakravarthy Department of Science and Mathematics KETTERING UNIVERSITY Flint, MI 48504-4898 Lecture 10 1 FRACTIONAL FACTORIAL DESIGNS Complete factorial designs

More information

DESIGN AND ANALYSIS OF EXPERIMENTS Third Edition

DESIGN AND ANALYSIS OF EXPERIMENTS Third Edition DESIGN AND ANALYSIS OF EXPERIMENTS Third Edition Douglas C. Montgomery ARIZONA STATE UNIVERSITY JOHN WILEY & SONS New York Chichester Brisbane Toronto Singapore Contents Chapter 1. Introduction 1-1 What

More information

Optimality of Central Composite Designs Augmented from One-half Fractional Factorial Designs

Optimality of Central Composite Designs Augmented from One-half Fractional Factorial Designs of Central Composite Designs Augmented from One-half Fractional Factorial Designs Anthony F. Capili Department of Mathematics and Statistics, College of Arts and Sciences, University of Southeastern Philippines

More information

Useful Numerical Statistics of Some Response Surface Methodology Designs

Useful Numerical Statistics of Some Response Surface Methodology Designs Journal of Mathematics Research; Vol. 8, No. 4; August 20 ISSN 19-9795 E-ISSN 19-9809 Published by Canadian Center of Science and Education Useful Numerical Statistics of Some Response Surface Methodology

More information

A Study on Minimal-point Composite Designs

A Study on Minimal-point Composite Designs A Study on Minimal-point Composite Designs by Yin-Jie Huang Advisor Ray-Bing Chen Institute of Statistics, National University of Kaohsiung Kaohsiung, Taiwan 8 R.O.C. July 007 Contents Introduction Construction

More information

26. Directional Derivatives & The Gradient

26. Directional Derivatives & The Gradient 26. Directional Derivatives & The Gradient Given a multivariable function z = f(x, y) and a point on the xy-plane P 0 = (x 0, y 0 ) at which f is differentiable (i.e. it is smooth with no discontinuities,

More information

SIX SIGMA IMPROVE

SIX SIGMA IMPROVE SIX SIGMA IMPROVE 1. For a simplex-lattice design the following formula or equation determines: A. The canonical formula for linear coefficients B. The portion of each polynomial in the experimental model

More information

Gradient Descent. Dr. Xiaowei Huang

Gradient Descent. Dr. Xiaowei Huang Gradient Descent Dr. Xiaowei Huang https://cgi.csc.liv.ac.uk/~xiaowei/ Up to now, Three machine learning algorithms: decision tree learning k-nn linear regression only optimization objectives are discussed,

More information

Determining Machining Parameters of Corn Byproduct Filled Plastics

Determining Machining Parameters of Corn Byproduct Filled Plastics Iowa State University From the SelectedWorks of Kurt A. Rosentrater 8 Determining Machining Parameters of Corn Byproduct Filled Plastics Kurt A. Rosentrater, United States Department of Agriculture Andrew

More information

Formative Assignment PART A

Formative Assignment PART A MHF4U_2011: Advanced Functions, Grade 12, University Preparation Unit 2: Advanced Polynomial and Rational Functions Activity 2: Families of polynomial functions Formative Assignment PART A For each of

More information

Design and Optimization of Energy Systems Prof. C. Balaji Department of Mechanical Engineering Indian Institute of Technology, Madras

Design and Optimization of Energy Systems Prof. C. Balaji Department of Mechanical Engineering Indian Institute of Technology, Madras Design and Optimization of Energy Systems Prof. C. Balaji Department of Mechanical Engineering Indian Institute of Technology, Madras Lecture - 09 Newton-Raphson Method Contd We will continue with our

More information

Response surface methodology

Response surface methodology Advanced Review André I. Khuri 1 and Siuli Mukhopadhyay 2 The purpose of this article is to provide a survey of the various stages in the development of response surface methodology (RSM). The coverage

More information

Extrema of Functions of Several Variables

Extrema of Functions of Several Variables Extrema of Functions of Several Variables MATH 311, Calculus III J. Robert Buchanan Department of Mathematics Fall 2011 Background (1 of 3) In single-variable calculus there are three important results

More information

Performance Surfaces and Optimum Points

Performance Surfaces and Optimum Points CSC 302 1.5 Neural Networks Performance Surfaces and Optimum Points 1 Entrance Performance learning is another important class of learning law. Network parameters are adjusted to optimize the performance

More information

18.06 Problem Set 8 Solution Due Wednesday, 22 April 2009 at 4 pm in Total: 160 points.

18.06 Problem Set 8 Solution Due Wednesday, 22 April 2009 at 4 pm in Total: 160 points. 86 Problem Set 8 Solution Due Wednesday, April 9 at 4 pm in -6 Total: 6 points Problem : If A is real-symmetric, it has real eigenvalues What can you say about the eigenvalues if A is real and anti-symmetric

More information

Regression Analysis. Simple Regression Multivariate Regression Stepwise Regression Replication and Prediction Error EE290H F05

Regression Analysis. Simple Regression Multivariate Regression Stepwise Regression Replication and Prediction Error EE290H F05 Regression Analysis Simple Regression Multivariate Regression Stepwise Regression Replication and Prediction Error 1 Regression Analysis In general, we "fit" a model by minimizing a metric that represents

More information

OPTIMAL DESIGN INPUTS FOR EXPERIMENTAL CHAPTER 17. Organization of chapter in ISSO. Background. Linear models

OPTIMAL DESIGN INPUTS FOR EXPERIMENTAL CHAPTER 17. Organization of chapter in ISSO. Background. Linear models CHAPTER 17 Slides for Introduction to Stochastic Search and Optimization (ISSO)by J. C. Spall OPTIMAL DESIGN FOR EXPERIMENTAL INPUTS Organization of chapter in ISSO Background Motivation Finite sample

More information

MID-TERM EXAM ANSWERS. p t + δ t = Rp t 1 + η t (1.1)

MID-TERM EXAM ANSWERS. p t + δ t = Rp t 1 + η t (1.1) ECO 513 Fall 2005 C.Sims MID-TERM EXAM ANSWERS (1) Suppose a stock price p t and the stock dividend δ t satisfy these equations: p t + δ t = Rp t 1 + η t (1.1) δ t = γδ t 1 + φp t 1 + ε t, (1.2) where

More information

Classes of Second-Order Split-Plot Designs

Classes of Second-Order Split-Plot Designs Classes of Second-Order Split-Plot Designs DATAWorks 2018 Springfield, VA Luis A. Cortés, Ph.D. The MITRE Corporation James R. Simpson, Ph.D. JK Analytics, Inc. Peter Parker, Ph.D. NASA 22 March 2018 Outline

More information

Performing response surface analysis using the SAS RSREG procedure

Performing response surface analysis using the SAS RSREG procedure Paper DV02-2012 Performing response surface analysis using the SAS RSREG procedure Zhiwu Li, National Database Nursing Quality Indicator and the Department of Biostatistics, University of Kansas Medical

More information

Reference: Chapter 6 of Montgomery(8e) Maghsoodloo

Reference: Chapter 6 of Montgomery(8e) Maghsoodloo Reference: Chapter 6 of Montgomery(8e) Maghsoodloo 51 DOE (or DOX) FOR BASE BALANCED FACTORIALS The notation k is used to denote a factorial experiment involving k factors (A, B, C, D,..., K) each at levels.

More information

This exam will be over material covered in class from Monday 14 February through Tuesday 8 March, corresponding to sections in the text.

This exam will be over material covered in class from Monday 14 February through Tuesday 8 March, corresponding to sections in the text. Math 275, section 002 (Ultman) Spring 2011 MIDTERM 2 REVIEW The second midterm will be held in class (1:40 2:30pm) on Friday 11 March. You will be allowed one half of one side of an 8.5 11 sheet of paper

More information

Principle Components Analysis (PCA) Relationship Between a Linear Combination of Variables and Axes Rotation for PCA

Principle Components Analysis (PCA) Relationship Between a Linear Combination of Variables and Axes Rotation for PCA Principle Components Analysis (PCA) Relationship Between a Linear Combination of Variables and Axes Rotation for PCA Principle Components Analysis: Uses one group of variables (we will call this X) In

More information

D-Optimal Designs for Second-Order Response Surface Models with Qualitative Factors

D-Optimal Designs for Second-Order Response Surface Models with Qualitative Factors Journal of Data Science 920), 39-53 D-Optimal Designs for Second-Order Response Surface Models with Qualitative Factors Chuan-Pin Lee and Mong-Na Lo Huang National Sun Yat-sen University Abstract: Central

More information

Lecture 8 Optimization

Lecture 8 Optimization 4/9/015 Lecture 8 Optimization EE 4386/5301 Computational Methods in EE Spring 015 Optimization 1 Outline Introduction 1D Optimization Parabolic interpolation Golden section search Newton s method Multidimensional

More information

The integration of response surface method in microsoft excel with visual basic application

The integration of response surface method in microsoft excel with visual basic application Journal of Physics: Conference Series PAPER OPEN ACCESS The integration of response surface method in microsoft excel with visual basic application To cite this article: H Sofyan et al 2018 J. Phys.: Conf.

More information

LEARN ABOUT the Math

LEARN ABOUT the Math 1.5 Inverse Relations YOU WILL NEED graph paper graphing calculator GOAL Determine the equation of an inverse relation and the conditions for an inverse relation to be a function. LEARN ABOUT the Math

More information

Bindel, Fall 2011 Intro to Scientific Computing (CS 3220) Week 6: Monday, Mar 7. e k+1 = 1 f (ξ k ) 2 f (x k ) e2 k.

Bindel, Fall 2011 Intro to Scientific Computing (CS 3220) Week 6: Monday, Mar 7. e k+1 = 1 f (ξ k ) 2 f (x k ) e2 k. Problem du jour Week 6: Monday, Mar 7 Show that for any initial guess x 0 > 0, Newton iteration on f(x) = x 2 a produces a decreasing sequence x 1 x 2... x n a. What is the rate of convergence if a = 0?

More information

Lecture 7. Logistic Regression. Luigi Freda. ALCOR Lab DIAG University of Rome La Sapienza. December 11, 2016

Lecture 7. Logistic Regression. Luigi Freda. ALCOR Lab DIAG University of Rome La Sapienza. December 11, 2016 Lecture 7 Logistic Regression Luigi Freda ALCOR Lab DIAG University of Rome La Sapienza December 11, 2016 Luigi Freda ( La Sapienza University) Lecture 7 December 11, 2016 1 / 39 Outline 1 Intro Logistic

More information

SELC : Sequential Elimination of Level Combinations by Means of Modified Genetic Algorithms

SELC : Sequential Elimination of Level Combinations by Means of Modified Genetic Algorithms SELC : Sequential Elimination of Level Combinations by Means of Modified Genetic Algorithms Revision submitted to Technometrics Abhyuday Mandal Ph.D. Candidate School of Industrial and Systems Engineering

More information

Practical Statistics for the Analytical Scientist Table of Contents

Practical Statistics for the Analytical Scientist Table of Contents Practical Statistics for the Analytical Scientist Table of Contents Chapter 1 Introduction - Choosing the Correct Statistics 1.1 Introduction 1.2 Choosing the Right Statistical Procedures 1.2.1 Planning

More information

PRODUCT QUALITY IMPROVEMENT THROUGH RESPONSE SURFACE METHODOLOGY : A CASE STUDY

PRODUCT QUALITY IMPROVEMENT THROUGH RESPONSE SURFACE METHODOLOGY : A CASE STUDY PRODUCT QULITY IMPROVEMENT THROUGH RESPONSE SURFCE METHODOLOGY : CSE STUDY HE Zhen, College of Management and Economics, Tianjin University, China, zhhe@tju.edu.cn, Tel: +86-22-8740783 ZHNG Xu-tao, College

More information

Numerical Optimization Prof. Shirish K. Shevade Department of Computer Science and Automation Indian Institute of Science, Bangalore

Numerical Optimization Prof. Shirish K. Shevade Department of Computer Science and Automation Indian Institute of Science, Bangalore Numerical Optimization Prof. Shirish K. Shevade Department of Computer Science and Automation Indian Institute of Science, Bangalore Lecture - 13 Steepest Descent Method Hello, welcome back to this series

More information

POLI 8501 Introduction to Maximum Likelihood Estimation

POLI 8501 Introduction to Maximum Likelihood Estimation POLI 8501 Introduction to Maximum Likelihood Estimation Maximum Likelihood Intuition Consider a model that looks like this: Y i N(µ, σ 2 ) So: E(Y ) = µ V ar(y ) = σ 2 Suppose you have some data on Y,

More information

Scientific Computing. Roots of Equations

Scientific Computing. Roots of Equations ECE257 Numerical Methods and Scientific Computing Roots of Equations Today s s class: Roots of Equations Bracketing Methods Roots of Equations Given a function f(x), the roots are those values of x that

More information

Experimental design (KKR031, KBT120) Tuesday 11/ :30-13:30 V

Experimental design (KKR031, KBT120) Tuesday 11/ :30-13:30 V Experimental design (KKR031, KBT120) Tuesday 11/1 2011-8:30-13:30 V Jan Rodmar will be available at ext 3024 and will visit the examination room ca 10:30. The examination results will be available for

More information

Laboratory Exercise System Identification. Laboratory Experiment AS-PA6. "Design of Experiments"

Laboratory Exercise System Identification. Laboratory Experiment AS-PA6. Design of Experiments Formel-Kapitel Abschnitt FACHGEBIET Systemanalyse Laboratory Exercise System Identification Laboratory Experiment AS-PA6 "Design of Experiments" Responsible professor: Dr.-Ing. Thomas Glotzbach Responsible

More information

Optimization. Totally not complete this is...don't use it yet...

Optimization. Totally not complete this is...don't use it yet... Optimization Totally not complete this is...don't use it yet... Bisection? Doing a root method is akin to doing a optimization method, but bi-section would not be an effective method - can detect sign

More information

Process/product optimization using design of experiments and response surface methodology

Process/product optimization using design of experiments and response surface methodology Process/product optimization using design of experiments and response surface methodology M. Mäkelä Sveriges landbruksuniversitet Swedish University of Agricultural Sciences Department of Forest Biomaterials

More information

Max Margin-Classifier

Max Margin-Classifier Max Margin-Classifier Oliver Schulte - CMPT 726 Bishop PRML Ch. 7 Outline Maximum Margin Criterion Math Maximizing the Margin Non-Separable Data Kernels and Non-linear Mappings Where does the maximization

More information

Introduction to systems of equations

Introduction to systems of equations Introduction to systems of equations A system of equations is a collection of two or more equations that contains the same variables. This is a system of two equations with two variables: In solving a

More information

2.830J / 6.780J / ESD.63J Control of Manufacturing Processes (SMA 6303) Spring 2008

2.830J / 6.780J / ESD.63J Control of Manufacturing Processes (SMA 6303) Spring 2008 MIT OpenCourseWare http://ocw.mit.edu 2.830J / 6.780J / ESD.63J Control of Processes (SMA 6303) Spring 2008 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms.

More information

MATH 5720: Unconstrained Optimization Hung Phan, UMass Lowell September 13, 2018

MATH 5720: Unconstrained Optimization Hung Phan, UMass Lowell September 13, 2018 MATH 57: Unconstrained Optimization Hung Phan, UMass Lowell September 13, 18 1 Global and Local Optima Let a function f : S R be defined on a set S R n Definition 1 (minimizers and maximizers) (i) x S

More information

Winning a Candy Guessing Game using Volume Estimations

Winning a Candy Guessing Game using Volume Estimations Winning a Candy Guessing Game using Volume Estimations Guess how many M&M s are in this container to win a gift card! Contests as such are everywhere in our society, and they offer generous rewards for

More information

RESPONSE SURFACE METHODOLOGY USING EXPERIMENTAL DESIGN

RESPONSE SURFACE METHODOLOGY USING EXPERIMENTAL DESIGN RESPONSE SURFACE METHODOLOGY USING EXPERIMENTAL DESIGN Jamshed H. Duhash 5th Year Microelectronic Engineering Student Rochester Institute of Technology ABSTRACT A Central Composite Full Factorial design

More information

Optimization II: Unconstrained Multivariable

Optimization II: Unconstrained Multivariable Optimization II: Unconstrained Multivariable CS 205A: Mathematical Methods for Robotics, Vision, and Graphics Justin Solomon CS 205A: Mathematical Methods Optimization II: Unconstrained Multivariable 1

More information

Chapter 4. Regression Models. Learning Objectives

Chapter 4. Regression Models. Learning Objectives Chapter 4 Regression Models To accompany Quantitative Analysis for Management, Eleventh Edition, by Render, Stair, and Hanna Power Point slides created by Brian Peterson Learning Objectives After completing

More information

MEEM Design of Experiments Final Take-home Exam

MEEM Design of Experiments Final Take-home Exam MEEM 5990 - Design of Experiments Final Take-home Exam Assigned: April 19, 2005 Due: April 29, 2005 Problem #1 The results of a replicated 2 4 factorial experiment are shown in the table below: Test X

More information

Clustering K-means. Clustering images. Machine Learning CSE546 Carlos Guestrin University of Washington. November 4, 2014.

Clustering K-means. Clustering images. Machine Learning CSE546 Carlos Guestrin University of Washington. November 4, 2014. Clustering K-means Machine Learning CSE546 Carlos Guestrin University of Washington November 4, 2014 1 Clustering images Set of Images [Goldberger et al.] 2 1 K-means Randomly initialize k centers µ (0)

More information

Systems of Linear ODEs

Systems of Linear ODEs P a g e 1 Systems of Linear ODEs Systems of ordinary differential equations can be solved in much the same way as discrete dynamical systems if the differential equations are linear. We will focus here

More information

Iterative Methods for Solving A x = b

Iterative Methods for Solving A x = b Iterative Methods for Solving A x = b A good (free) online source for iterative methods for solving A x = b is given in the description of a set of iterative solvers called templates found at netlib: http

More information

5.3. Exercises on the curve analysis of polynomial functions

5.3. Exercises on the curve analysis of polynomial functions .. Exercises on the curve analysis of polynomial functions Exercise : Curve analysis Examine the following functions on symmetry, x- and y-intercepts, extrema and inflexion points. Draw their graphs including

More information

CHAPTER 6 A STUDY ON DISC BRAKE SQUEAL USING DESIGN OF EXPERIMENTS

CHAPTER 6 A STUDY ON DISC BRAKE SQUEAL USING DESIGN OF EXPERIMENTS 134 CHAPTER 6 A STUDY ON DISC BRAKE SQUEAL USING DESIGN OF EXPERIMENTS 6.1 INTRODUCTION In spite of the large amount of research work that has been carried out to solve the squeal problem during the last

More information

hp calculators HP 33S Using the formula solver part 2 Overview of the formula solver Practice Example: A formula with several variables

hp calculators HP 33S Using the formula solver part 2 Overview of the formula solver Practice Example: A formula with several variables Overview of the formula solver Practice Example: A formula with several variables Practice Example: A direct solution Practice Example: A formula with a pole Practice Example: Where two functions intersect

More information

Solution to Final Exam

Solution to Final Exam Stat 660 Solution to Final Exam. (5 points) A large pharmaceutical company is interested in testing the uniformity (a continuous measurement that can be taken by a measurement instrument) of their film-coated

More information

EM for Spherical Gaussians

EM for Spherical Gaussians EM for Spherical Gaussians Karthekeyan Chandrasekaran Hassan Kingravi December 4, 2007 1 Introduction In this project, we examine two aspects of the behavior of the EM algorithm for mixtures of spherical

More information

February 29 th March 4 th

February 29 th March 4 th February 29 th March 4 th Unit 7: Introduction to Functions Jump Start Table A: Bags of candy ( ) Cost ( ) 1 2 3 4 5 6 7 8 $1.25 $2.50 $3.75 $5.00 $6.25 $7.50 $8.75 $10.00 Table B: Number of seconds (

More information

CS 453X: Class 5. Jacob Whitehill

CS 453X: Class 5. Jacob Whitehill CS 453X: Class 5 Jacob Whitehill Example 2: weather data Data from https://www.kaggle.com/selfishgene/historicalhourly-weather-data/data Hourly measurements of pressure, humidity, and temperature, and

More information

ECE 680 Modern Automatic Control. Gradient and Newton s Methods A Review

ECE 680 Modern Automatic Control. Gradient and Newton s Methods A Review ECE 680Modern Automatic Control p. 1/1 ECE 680 Modern Automatic Control Gradient and Newton s Methods A Review Stan Żak October 25, 2011 ECE 680Modern Automatic Control p. 2/1 Review of the Gradient Properties

More information

Response Surface Methodology in Application of Optimal Manufacturing Process of Axial-Flow Fans Adopted by Modern Industries

Response Surface Methodology in Application of Optimal Manufacturing Process of Axial-Flow Fans Adopted by Modern Industries American Journal of Theoretical and Applied Statistics 018; 7(6): 35-41 http://www.sciencepublishinggroup.com/j/ajtas doi: 10.11648/j.ajtas.0180706.16 ISSN: 36-8999 (Print); ISSN: 36-9006 (Online) Response

More information