Process Robustness Studies

Size: px
Start display at page:

Download "Process Robustness Studies"

Transcription

1 Process Robustness Studies ST 435/535 Background When factors interact, the level of one can sometimes be chosen so that another has no effect on the response. If the second factor is controllable in a test environment, but varies randomly in routine operation (a noise factor), the quality characteristic can be insulated from those variations. Genichi Taguchi developed robust parameter design to exploit this strategy. 1 / 12 Process Optimization with Designed Experiments Process Robustness Studies

2 Taguchi s approach is to construct separate designs in the controllable factors and noise factors, and to cross them. Both designs are based on orthogonal arrays, which include fractional factorial design matrices: an inner array design in the controllable factors; an outer array design in the noise factors. The crossed design uses every combination of a treatment in the controllable factors and a treatment in the noise factors. Taguchi s analysis of the resulting data differs from the conventional statistical model. 2 / 12 Process Optimization with Designed Experiments Process Robustness Studies

3 Response surface approach An alternative approach is to set up a combined design in all factors, both controllable and noise. The resulting statistical model is a prediction equation for test conditions, with all factors controllable. We assume that in routine operations the noise factors have random levels, and the statistical model provides: a mean model that predicts the mean response for given settings of the controllable factors; a variance model that shows how the variability in the noise factors propagates into the response, again for given settings of the controllable factors. 3 / 12 Process Optimization with Designed Experiments Process Robustness Studies

4 Example Suppose that x 1 and x 2 are controllable, and that z 1 is a noise factor, and the response Y satisfies a model with all main effects and all two-factor interactions, but no three-factor interaction: Y = β 0 + β 1 x 1 + β 2 x 2 + β 1,2 x 1 x 2 + γ 1 z 1 + δ 1,1 x 1 z 1 + δ 2,1 x 2 z 1 + ɛ In experiments, all three factors are controllable, and the parameters can be estimated from a factorial design. 4 / 12 Process Optimization with Designed Experiments Process Robustness Studies

5 In operations, Z 1 is random, with mean 0 and variance σ 2 Z. So and E(Y ) = β 0 + β 1 x 1 + β 2 x 2 + β 1,2 x 1 x 2 V (Y ) = σ 2 Z(γ 1 + δ 1,1 x 1 + δ 2,1 x 2 ) 2 + σ 2 ɛ. 5 / 12 Process Optimization with Designed Experiments Process Robustness Studies

6 The mean model and the variance model are used to find levels of the controllable factors that achieve some goal for the mean response (a target value, or an optimal value), while keeping variability at a satisfactory level. 6 / 12 Process Optimization with Designed Experiments Process Robustness Studies

7 Example: filtration rate The filtration rate Y in a chemical process is affected by four factors: Temperature, A; Pressure, B; Concentration, C; Stirring rate, D. Temperature is hard to control in operation: the noise factor. filtration <- expand.grid(a = c(-1, 1), B = c(-1, 1), C = c(-1, 1), D = c(-1, 1)); filtration$rate <- c(45, 71, 48, 65, 68, 60, 80, 65, 43, 100, 45, 104, 75, 86, 70, 96); library(gplots) qqnorm(aov(rate ~ A * B * C * D, filtration), label = TRUE) filtrationlm <- lm(rate ~ A * (C + D), filtration) summary(filtrationlm) 7 / 12 Process Optimization with Designed Experiments Process Robustness Studies

8 The estimated model equation is ŷ = x x 3 + ( x x 3 )z 1 so the mean model is and the variance model is Ê(Y ) = x x 3 V (Y ) = σ 2 Z( x x 3 ) 2 + σ 2 ɛ. The two levels of temperature were one standard deviation away from the mean, so σ Z = 1, and σ ɛ is estimated by the residual standard error, / 12 Process Optimization with Designed Experiments Process Robustness Studies

9 Contour plots cgrid <- dgrid <- seq(from = -1, to = 1, length = 40); m <- predict(filtrationlm, expand.grid(a = 0, C = cgrid, D = dgrid)); m <- matrix(m, length(cgrid), length(dgrid)); contour(cgrid, dgrid, m, nlevels = 5) # construct the variance model: v <- predict(filtrationlm, expand.grid(a = 1, C = cgrid, D = dgrid)); v <- matrix(v, length(cgrid), length(dgrid)); v <- (v - m)^2 + summary(filtrationlm)$sigma^2; contour(cgrid, dgrid, sqrt(v), col = "red", add = TRUE) # show a good region: image(cgrid, dgrid, ifelse (m >= 75 & sqrt(v) <= 6, TRUE, NA), col = hsv(0.33, alpha = 0.5), add = TRUE) 9 / 12 Process Optimization with Designed Experiments Process Robustness Studies

10 The goal was to achieve a filtration rate of at least 75, with low variability. The contour plot shows that this is achievable only close to the edge of the experimental domain. 10 / 12 Process Optimization with Designed Experiments Process Robustness Studies

11 Evolutionary Operation ST 435/535 The experiments involved in process improvement are usually carried out in a test facility, not the routine operational facility: off-line process improvement. The lessons learned are then implemented in routine operations: the on-line environment. Evolutionary operation consists of carrying out designed experiments in the on-line setting. 11 / 12 Process Optimization with Designed Experiments Evolutionary Operation

12 The design is typically a two-level factorial, with levels centered around current standard practice, and deviating little enough to not substantially degrade performance. Replicated center points can be added without disturbing the process. The factorial runs allow estimation of the main effects of the factors and their interactions. The center point runs allow the detection of curvature (squared terms), but not their complete characterization. 12 / 12 Process Optimization with Designed Experiments Evolutionary Operation

MATH602: APPLIED STATISTICS

MATH602: APPLIED STATISTICS MATH602: APPLIED STATISTICS Dr. Srinivas R. Chakravarthy Department of Science and Mathematics KETTERING UNIVERSITY Flint, MI 48504-4898 Lecture 10 1 FRACTIONAL FACTORIAL DESIGNS Complete factorial designs

More information

Response Surface Methodology

Response Surface Methodology Response Surface Methodology Process and Product Optimization Using Designed Experiments Second Edition RAYMOND H. MYERS Virginia Polytechnic Institute and State University DOUGLAS C. MONTGOMERY Arizona

More information

Response Surface Methodology:

Response Surface Methodology: Response Surface Methodology: Process and Product Optimization Using Designed Experiments RAYMOND H. MYERS Virginia Polytechnic Institute and State University DOUGLAS C. MONTGOMERY Arizona State University

More information

Response Surface Methodology IV

Response Surface Methodology IV LECTURE 8 Response Surface Methodology IV 1. Bias and Variance If y x is the response of the system at the point x, or in short hand, y x = f (x), then we can write η x = E(y x ). This is the true, and

More information

Introduction to the Design and Analysis of Experiments

Introduction to the Design and Analysis of Experiments Introduction to the Design and Analysis of Experiments Geoffrey M. Clarke, MA,Dip.stats.,c.stat. Honorary Reader in Applied Statistics, University of Kent at Canterbury and Consultant to the Applied Statistics

More information

8 RESPONSE SURFACE DESIGNS

8 RESPONSE SURFACE DESIGNS 8 RESPONSE SURFACE DESIGNS Desirable Properties of a Response Surface Design 1. It should generate a satisfactory distribution of information throughout the design region. 2. It should ensure that the

More information

Fractional Replication of The 2 k Design

Fractional Replication of The 2 k Design Fractional Replication of The 2 k Design Experiments with many factors involve a large number of possible treatments, even when all factors are used at only two levels. Often the available resources are

More information

Experimental design. Matti Hotokka Department of Physical Chemistry Åbo Akademi University

Experimental design. Matti Hotokka Department of Physical Chemistry Åbo Akademi University Experimental design Matti Hotokka Department of Physical Chemistry Åbo Akademi University Contents Elementary concepts Regression Validation Design of Experiments Definitions Random sampling Factorial

More information

Session #11 Supplementary Session on Design of Experiments

Session #11 Supplementary Session on Design of Experiments ESD.33 Systems Engineering Session #11 Supplementary Session on Design of Experiments B A C Dan Frey Plan for the Session de Weck on Isoperformance Assignment #6 Review of Statistical Preliminaries Review

More information

Fractional Factorial Designs

Fractional Factorial Designs Fractional Factorial Designs ST 516 Each replicate of a 2 k design requires 2 k runs. E.g. 64 runs for k = 6, or 1024 runs for k = 10. When this is infeasible, we use a fraction of the runs. As a result,

More information

Taguchi Method and Robust Design: Tutorial and Guideline

Taguchi Method and Robust Design: Tutorial and Guideline Taguchi Method and Robust Design: Tutorial and Guideline CONTENT 1. Introduction 2. Microsoft Excel: graphing 3. Microsoft Excel: Regression 4. Microsoft Excel: Variance analysis 5. Robust Design: An Example

More information

When Dictionary Learning Meets Classification

When Dictionary Learning Meets Classification When Dictionary Learning Meets Classification Bufford, Teresa 1 Chen, Yuxin 2 Horning, Mitchell 3 Shee, Liberty 1 Mentor: Professor Yohann Tendero 1 UCLA 2 Dalhousie University 3 Harvey Mudd College August

More information

Response Surface Methodology: Process and Product Optimization Using Designed Experiments, 3rd Edition

Response Surface Methodology: Process and Product Optimization Using Designed Experiments, 3rd Edition Brochure More information from http://www.researchandmarkets.com/reports/705963/ Response Surface Methodology: Process and Product Optimization Using Designed Experiments, 3rd Edition Description: Identifying

More information

Simple Linear Regression

Simple Linear Regression Simple Linear Regression ST 370 Regression models are used to study the relationship of a response variable and one or more predictors. The response is also called the dependent variable, and the predictors

More information

Unit 8: Robust Parameter Design

Unit 8: Robust Parameter Design Unit 8: Robust Parameter Design Source : Chapter 11 (sections 11.1-11.6, part of sections 11.7-11.8 and 11.9). Revisiting two previous experiments. Strategies for reducing variation. Types of noise factors.

More information

Specification Errors, Measurement Errors, Confounding

Specification Errors, Measurement Errors, Confounding Specification Errors, Measurement Errors, Confounding Kerby Shedden Department of Statistics, University of Michigan October 10, 2018 1 / 32 An unobserved covariate Suppose we have a data generating model

More information

Joint Probability Distributions

Joint Probability Distributions Joint Probability Distributions ST 370 In many random experiments, more than one quantity is measured, meaning that there is more than one random variable. Example: Cell phone flash unit A flash unit is

More information

2.830J / 6.780J / ESD.63J Control of Manufacturing Processes (SMA 6303) Spring 2008

2.830J / 6.780J / ESD.63J Control of Manufacturing Processes (SMA 6303) Spring 2008 MIT OpenCourseWare http://ocw.mit.edu 2.830J / 6.780J / ESD.63J Control of Processes (SMA 6303) Spring 2008 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms.

More information

Identification of dispersion effects in replicated two-level fractional factorial experiments

Identification of dispersion effects in replicated two-level fractional factorial experiments Identification of dispersion effects in replicated two-level fractional factorial experiments Cheryl Dingus 1, Bruce Ankenman 2, Angela Dean 3,4 and Fangfang Sun 4 1 Battelle Memorial Institute 2 Department

More information

STAT 263/363: Experimental Design Winter 2016/17. Lecture 13 Feb 27

STAT 263/363: Experimental Design Winter 2016/17. Lecture 13 Feb 27 STAT 263/363: Experimental Design Winter 2016/17 Lecture 13 Feb 27 Lecturer: A. Owen Scribe: Zachary del Rosario 13.1 Taguchi Methods Also known as Robust Design, Taguchi Methods include both design of

More information

Unreplicated 2 k Factorial Designs

Unreplicated 2 k Factorial Designs Unreplicated 2 k Factorial Designs These are 2 k factorial designs with one observation at each corner of the cube An unreplicated 2 k factorial design is also sometimes called a single replicate of the

More information

Lecture 3: Matrix and Matrix Operations

Lecture 3: Matrix and Matrix Operations Lecture 3: Matrix and Matrix Operations Representation, row vector, column vector, element of a matrix. Examples of matrix representations Tables and spreadsheets Scalar-Matrix operation: Scaling a matrix

More information

Taguchi Design of Experiments

Taguchi Design of Experiments Taguchi Design of Experiments Many factors/inputs/variables must be taken into consideration when making a product especially a brand new one The Taguchi method is a structured approach for determining

More information

Design & Analysis of Experiments 7E 2009 Montgomery

Design & Analysis of Experiments 7E 2009 Montgomery Chapter 5 1 Introduction to Factorial Design Study the effects of 2 or more factors All possible combinations of factor levels are investigated For example, if there are a levels of factor A and b levels

More information

Lecture 10. Factorial experiments (2-way ANOVA etc)

Lecture 10. Factorial experiments (2-way ANOVA etc) Lecture 10. Factorial experiments (2-way ANOVA etc) Jesper Rydén Matematiska institutionen, Uppsala universitet jesper@math.uu.se Regression and Analysis of Variance autumn 2014 A factorial experiment

More information

2.830J / 6.780J / ESD.63J Control of Manufacturing Processes (SMA 6303) Spring 2008

2.830J / 6.780J / ESD.63J Control of Manufacturing Processes (SMA 6303) Spring 2008 MIT OpenCourseWare http://ocw.mit.edu 2.830J / 6.780J / ESD.63J Control of Processes (SMA 6303) Spring 2008 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms.

More information

TAGUCHI ANOVA ANALYSIS

TAGUCHI ANOVA ANALYSIS CHAPTER 10 TAGUCHI ANOVA ANALYSIS Studies by varying the fin Material, Size of Perforation and Heat Input using Taguchi ANOVA Analysis 10.1 Introduction The data used in this Taguchi analysis were obtained

More information

The 2 k Factorial Design. Dr. Mohammad Abuhaiba 1

The 2 k Factorial Design. Dr. Mohammad Abuhaiba 1 The 2 k Factorial Design Dr. Mohammad Abuhaiba 1 HoweWork Assignment Due Tuesday 1/6/2010 6.1, 6.2, 6.17, 6.18, 6.19 Dr. Mohammad Abuhaiba 2 Design of Engineering Experiments The 2 k Factorial Design Special

More information

Multiple Predictor Variables: ANOVA

Multiple Predictor Variables: ANOVA Multiple Predictor Variables: ANOVA 1/32 Linear Models with Many Predictors Multiple regression has many predictors BUT - so did 1-way ANOVA if treatments had 2 levels What if there are multiple treatment

More information

FIVE-FACTOR CENTRAL COMPOSITE DESIGNS ROBUST TO A PAIR OF MISSING OBSERVATIONS. Munir Akhtar Vice-Chanselor, Islamia University Bahawalpur, Pakistan.

FIVE-FACTOR CENTRAL COMPOSITE DESIGNS ROBUST TO A PAIR OF MISSING OBSERVATIONS. Munir Akhtar Vice-Chanselor, Islamia University Bahawalpur, Pakistan. Journal of Research (Science), Bahauddin Zakariya University, Multan, Pakistan. Vol.2, No.2, December 2, pp. 5-5 ISSN 2-2 FIVE-FACTOR CENTRAL COMPOSITE DESIGNS ROBUST TO A PAIR OF MISSING OBSERVATIONS

More information

Design of Engineering Experiments Part 5 The 2 k Factorial Design

Design of Engineering Experiments Part 5 The 2 k Factorial Design Design of Engineering Experiments Part 5 The 2 k Factorial Design Text reference, Special case of the general factorial design; k factors, all at two levels The two levels are usually called low and high

More information

SIX SIGMA IMPROVE

SIX SIGMA IMPROVE SIX SIGMA IMPROVE 1. For a simplex-lattice design the following formula or equation determines: A. The canonical formula for linear coefficients B. The portion of each polynomial in the experimental model

More information

Bootstrap, Jackknife and other resampling methods

Bootstrap, Jackknife and other resampling methods Bootstrap, Jackknife and other resampling methods Part VI: Cross-validation Rozenn Dahyot Room 128, Department of Statistics Trinity College Dublin, Ireland dahyot@mee.tcd.ie 2005 R. Dahyot (TCD) 453 Modern

More information

Preface Introduction to Statistics and Data Analysis Overview: Statistical Inference, Samples, Populations, and Experimental Design The Role of

Preface Introduction to Statistics and Data Analysis Overview: Statistical Inference, Samples, Populations, and Experimental Design The Role of Preface Introduction to Statistics and Data Analysis Overview: Statistical Inference, Samples, Populations, and Experimental Design The Role of Probability Sampling Procedures Collection of Data Measures

More information

2.830J / 6.780J / ESD.63J Control of Manufacturing Processes (SMA 6303) Spring 2008

2.830J / 6.780J / ESD.63J Control of Manufacturing Processes (SMA 6303) Spring 2008 MIT OpenCourseWare http://ocw.mit.edu.830j / 6.780J / ESD.63J Control of Manufacturing Processes (SMA 6303) Spring 008 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms.

More information

Point Distribution Models

Point Distribution Models Point Distribution Models Jan Kybic winter semester 2007 Point distribution models (Cootes et al., 1992) Shape description techniques A family of shapes = mean + eigenvectors (eigenshapes) Shapes described

More information

An Introduction to Design of Experiments

An Introduction to Design of Experiments An Introduction to Design of Experiments Douglas C. Montgomery Regents Professor of Industrial Engineering and Statistics ASU Foundation Professor of Engineering Arizona State University Bradley Jones

More information

Module III Product Quality Improvement. Lecture 4 What is robust design?

Module III Product Quality Improvement. Lecture 4 What is robust design? Module III Product Quality Improvement Lecture 4 What is robust design? Dr. Genichi Taguchi, a mechanical engineer, who has won four times Deming Awards, introduced the loss function concept, which combines

More information

Discussant: Lawrence D Brown* Statistics Department, Wharton, Univ. of Penn.

Discussant: Lawrence D Brown* Statistics Department, Wharton, Univ. of Penn. Discussion of Estimation and Accuracy After Model Selection By Bradley Efron Discussant: Lawrence D Brown* Statistics Department, Wharton, Univ. of Penn. lbrown@wharton.upenn.edu JSM, Boston, Aug. 4, 2014

More information

19. Blocking & confounding

19. Blocking & confounding 146 19. Blocking & confounding Importance of blocking to control nuisance factors - day of week, batch of raw material, etc. Complete Blocks. This is the easy case. Suppose we run a 2 2 factorial experiment,

More information

Confidence Intervals, Testing and ANOVA Summary

Confidence Intervals, Testing and ANOVA Summary Confidence Intervals, Testing and ANOVA Summary 1 One Sample Tests 1.1 One Sample z test: Mean (σ known) Let X 1,, X n a r.s. from N(µ, σ) or n > 30. Let The test statistic is H 0 : µ = µ 0. z = x µ 0

More information

Least Squares Regression

Least Squares Regression E0 70 Machine Learning Lecture 4 Jan 7, 03) Least Squares Regression Lecturer: Shivani Agarwal Disclaimer: These notes are a brief summary of the topics covered in the lecture. They are not a substitute

More information

Statistics for Engineers Lecture 9 Linear Regression

Statistics for Engineers Lecture 9 Linear Regression Statistics for Engineers Lecture 9 Linear Regression Chong Ma Department of Statistics University of South Carolina chongm@email.sc.edu April 17, 2017 Chong Ma (Statistics, USC) STAT 509 Spring 2017 April

More information

Scatter plot of data from the study. Linear Regression

Scatter plot of data from the study. Linear Regression 1 2 Linear Regression Scatter plot of data from the study. Consider a study to relate birthweight to the estriol level of pregnant women. The data is below. i Weight (g / 100) i Weight (g / 100) 1 7 25

More information

STAT 350: Geometry of Least Squares

STAT 350: Geometry of Least Squares The Geometry of Least Squares Mathematical Basics Inner / dot product: a and b column vectors a b = a T b = a i b i a b a T b = 0 Matrix Product: A is r s B is s t (AB) rt = s A rs B st Partitioned Matrices

More information

Least Squares Regression

Least Squares Regression CIS 50: Machine Learning Spring 08: Lecture 4 Least Squares Regression Lecturer: Shivani Agarwal Disclaimer: These notes are designed to be a supplement to the lecture. They may or may not cover all the

More information

Chapter 6 The 2 k Factorial Design Solutions

Chapter 6 The 2 k Factorial Design Solutions Solutions from Montgomery, D. C. (004) Design and Analysis of Experiments, Wiley, NY Chapter 6 The k Factorial Design Solutions 6.. A router is used to cut locating notches on a printed circuit board.

More information

Application of a Diagnostic Tool in Laser Aided Manufacturing Processes

Application of a Diagnostic Tool in Laser Aided Manufacturing Processes Application of a Diagnostic Tool in Laser Aided Manufacturing Processes Sashikanth Prakash, Mallikharjuna Rao Boddu and Frank Liou Department of Mechanical, Aerospace and Engineering Mechanics University

More information

2010 Stat-Ease, Inc. Dual Response Surface Methods (RSM) to Make Processes More Robust* Presented by Mark J. Anderson (

2010 Stat-Ease, Inc. Dual Response Surface Methods (RSM) to Make Processes More Robust* Presented by Mark J. Anderson ( Dual Response Surface Methods (RSM) to Make Processes More Robust* *Posted at www.statease.com/webinar.html Presented by Mark J. Anderson (Email: Mark@StatEase.com ) Timer by Hank Anderson July 2008 Webinar

More information

Response Surface Methodology

Response Surface Methodology Response Surface Methodology Bruce A Craig Department of Statistics Purdue University STAT 514 Topic 27 1 Response Surface Methodology Interested in response y in relation to numeric factors x Relationship

More information

Robust Design: An introduction to Taguchi Methods

Robust Design: An introduction to Taguchi Methods Robust Design: An introduction to Taguchi Methods The theoretical foundations of Taguchi Methods were laid out by Genichi Taguchi, a Japanese engineer who began working for the telecommunications company,

More information

Linear models. Rasmus Waagepetersen Department of Mathematics Aalborg University Denmark. October 5, 2016

Linear models. Rasmus Waagepetersen Department of Mathematics Aalborg University Denmark. October 5, 2016 Linear models Rasmus Waagepetersen Department of Mathematics Aalborg University Denmark October 5, 2016 1 / 16 Outline for today linear models least squares estimation orthogonal projections estimation

More information

A General Criterion for Factorial Designs Under Model Uncertainty

A General Criterion for Factorial Designs Under Model Uncertainty A General Criterion for Factorial Designs Under Model Uncertainty Steven Gilmour Queen Mary University of London http://www.maths.qmul.ac.uk/ sgg and Pi-Wen Tsai National Taiwan Normal University Fall

More information

DESIGN AND ANALYSIS OF EXPERIMENTS Third Edition

DESIGN AND ANALYSIS OF EXPERIMENTS Third Edition DESIGN AND ANALYSIS OF EXPERIMENTS Third Edition Douglas C. Montgomery ARIZONA STATE UNIVERSITY JOHN WILEY & SONS New York Chichester Brisbane Toronto Singapore Contents Chapter 1. Introduction 1-1 What

More information

Unit 6: Orthogonal Designs Theory, Randomized Complete Block Designs, and Latin Squares

Unit 6: Orthogonal Designs Theory, Randomized Complete Block Designs, and Latin Squares Unit 6: Orthogonal Designs Theory, Randomized Complete Block Designs, and Latin Squares STA 643: Advanced Experimental Design Derek S. Young 1 Learning Objectives Understand the basics of orthogonal designs

More information

Stat 502 Design and Analysis of Experiments Large Factorial Designs

Stat 502 Design and Analysis of Experiments Large Factorial Designs 1 Stat 502 Design and Analysis of Experiments Large Factorial Designs Fritz Scholz Department of Statistics, University of Washington December 3, 2013 2 Exploration of Many Factors The typical setting

More information

Scatter plot of data from the study. Linear Regression

Scatter plot of data from the study. Linear Regression 1 2 Linear Regression Scatter plot of data from the study. Consider a study to relate birthweight to the estriol level of pregnant women. The data is below. i Weight (g / 100) i Weight (g / 100) 1 7 25

More information

Chapter 4 - Mathematical model

Chapter 4 - Mathematical model Chapter 4 - Mathematical model For high quality demands of production process in the micro range, the modeling of machining parameters is necessary. Non linear regression as mathematical modeling tool

More information

An Algorithm for Constructing a D-Optimal 2 K Factorial Design for Linear Model Containing Main Effects and One-Two Factor Interaction

An Algorithm for Constructing a D-Optimal 2 K Factorial Design for Linear Model Containing Main Effects and One-Two Factor Interaction An Algorithm for Constructing a D-Optimal 2 K Factorial Design for Linear Model Containing Main Effects and One-Two Factor Interaction E. O. Effanga Department of Mathematics,Statistics and Comp. Science,

More information

Linear regression is designed for a quantitative response variable; in the model equation

Linear regression is designed for a quantitative response variable; in the model equation Logistic Regression ST 370 Linear regression is designed for a quantitative response variable; in the model equation Y = β 0 + β 1 x + ɛ, the random noise term ɛ is usually assumed to be at least approximately

More information

3. For a given dataset and linear model, what do you think is true about least squares estimates? Is Ŷ always unique? Yes. Is ˆβ always unique? No.

3. For a given dataset and linear model, what do you think is true about least squares estimates? Is Ŷ always unique? Yes. Is ˆβ always unique? No. 7. LEAST SQUARES ESTIMATION 1 EXERCISE: Least-Squares Estimation and Uniqueness of Estimates 1. For n real numbers a 1,...,a n, what value of a minimizes the sum of squared distances from a to each of

More information

Estimating Estimable Functions of β. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 17

Estimating Estimable Functions of β. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 17 Estimating Estimable Functions of β Copyright c 202 Dan Nettleton (Iowa State University) Statistics 5 / 7 The Response Depends on β Only through Xβ In the Gauss-Markov or Normal Theory Gauss-Markov Linear

More information

DOE Wizard Screening Designs

DOE Wizard Screening Designs DOE Wizard Screening Designs Revised: 10/10/2017 Summary... 1 Example... 2 Design Creation... 3 Design Properties... 13 Saving the Design File... 16 Analyzing the Results... 17 Statistical Model... 18

More information

Response-surface illustration

Response-surface illustration Response-surface illustration Russ Lenth October 23, 2017 Abstract In this vignette, we give an illustration, using simulated data, of a sequential-experimentation process to optimize a response surface.

More information

NOISE FACTORS, DISPERSION EFFECTS, AND ROBUST DESIGN

NOISE FACTORS, DISPERSION EFFECTS, AND ROBUST DESIGN Statistica Sinica 8(1998), 67-85 NOISE FACTORS, DISPERSION EFFECTS, AND ROBUST DESIGN David M. Steinberg and Dizza Bursztyn Tel-Aviv University Abstract: There has been great interest recently in the use

More information

Implementing contrasts using SAS Proc GLM is a relatively straightforward process. A SAS Proc GLM contrast statement has the following form:

Implementing contrasts using SAS Proc GLM is a relatively straightforward process. A SAS Proc GLM contrast statement has the following form: Contrasts for Comparison of Means If the analysis of variance produces a significant F-statistic, this signals the need for further analyses. The most common post ANOVA analysis is the comparison of means.

More information

Stat 217 Final Exam. Name: May 1, 2002

Stat 217 Final Exam. Name: May 1, 2002 Stat 217 Final Exam Name: May 1, 2002 Problem 1. Three brands of batteries are under study. It is suspected that the lives (in weeks) of the three brands are different. Five batteries of each brand are

More information

Linear Algebra (Review) Volker Tresp 2017

Linear Algebra (Review) Volker Tresp 2017 Linear Algebra (Review) Volker Tresp 2017 1 Vectors k is a scalar (a number) c is a column vector. Thus in two dimensions, c = ( c1 c 2 ) (Advanced: More precisely, a vector is defined in a vector space.

More information

MA 575 Linear Models: Cedric E. Ginestet, Boston University Bootstrap for Regression Week 9, Lecture 1

MA 575 Linear Models: Cedric E. Ginestet, Boston University Bootstrap for Regression Week 9, Lecture 1 MA 575 Linear Models: Cedric E. Ginestet, Boston University Bootstrap for Regression Week 9, Lecture 1 1 The General Bootstrap This is a computer-intensive resampling algorithm for estimating the empirical

More information

MATH602: APPLIED STATISTICS Winter 2000

MATH602: APPLIED STATISTICS Winter 2000 MATH602: APPLIED STATISTICS Winter 2000 Dr. Srinivas R. Chakravarthy Department of Industrial and Manufacturing Engineering & Business Kettering University (Formerly GMI Engineering & Management Institute)

More information

Multivariate Regression

Multivariate Regression Multivariate Regression The so-called supervised learning problem is the following: we want to approximate the random variable Y with an appropriate function of the random variables X 1,..., X p with the

More information

Linear Algebra (Review) Volker Tresp 2018

Linear Algebra (Review) Volker Tresp 2018 Linear Algebra (Review) Volker Tresp 2018 1 Vectors k, M, N are scalars A one-dimensional array c is a column vector. Thus in two dimensions, ( ) c1 c = c 2 c i is the i-th component of c c T = (c 1, c

More information

RESPONSE SURFACE MODELLING, RSM

RESPONSE SURFACE MODELLING, RSM CHEM-E3205 BIOPROCESS OPTIMIZATION AND SIMULATION LECTURE 3 RESPONSE SURFACE MODELLING, RSM Tool for process optimization HISTORY Statistical experimental design pioneering work R.A. Fisher in 1925: Statistical

More information

Definitive Screening Designs

Definitive Screening Designs Definitive Screening Designs Bradley Jones September 2011 Copyright 2008, SAS Institute Inc. All rights reserved. Joint work with Chris Nachtsheim Outline 1. Motivation 2. Design Structure 3. Design Construction

More information

Advances in Extreme Learning Machines

Advances in Extreme Learning Machines Advances in Extreme Learning Machines Mark van Heeswijk April 17, 2015 Outline Context Extreme Learning Machines Part I: Ensemble Models of ELM Part II: Variable Selection and ELM Part III: Trade-offs

More information

STAT440/840: Statistical Computing

STAT440/840: Statistical Computing First Prev Next Last STAT440/840: Statistical Computing Paul Marriott pmarriott@math.uwaterloo.ca MC 6096 February 2, 2005 Page 1 of 41 First Prev Next Last Page 2 of 41 Chapter 3: Data resampling: the

More information

Lec 5: Factorial Experiment

Lec 5: Factorial Experiment November 21, 2011 Example Study of the battery life vs the factors temperatures and types of material. A: Types of material, 3 levels. B: Temperatures, 3 levels. Example Study of the battery life vs the

More information

Ph.D. Qualifying Exam Friday Saturday, January 3 4, 2014

Ph.D. Qualifying Exam Friday Saturday, January 3 4, 2014 Ph.D. Qualifying Exam Friday Saturday, January 3 4, 2014 Put your solution to each problem on a separate sheet of paper. Problem 1. (5166) Assume that two random samples {x i } and {y i } are independently

More information

Theory of Screening Procedures to Identify Robust Product Designs Using Fractional Factorial Experiments

Theory of Screening Procedures to Identify Robust Product Designs Using Fractional Factorial Experiments Theory of Screening Procedures to Identify Robust Product Designs Using Fractional Factorial Experiments Guohua Pan Biostatistics and Statistical Reporting Novartis Pharmaceuticals Corporation East Hanover,

More information

COST-EFFECTIVE AND INFORMATION-EFFICIENT ROBUST DESIGN FOR OPTIMIZING PROCESSES AND ACCOMPLISHING SIX SIGMA OBJECTIVES

COST-EFFECTIVE AND INFORMATION-EFFICIENT ROBUST DESIGN FOR OPTIMIZING PROCESSES AND ACCOMPLISHING SIX SIGMA OBJECTIVES COST-EFFECTIVE AND INFORMATION-EFFICIENT ROBUST DESIGN FOR OPTIMIZING PROCESSES AND ACCOMPLISHING SIX SIGMA OBJECTIVES Mark J. Anderson Shari L. Kraber Principal Consultant Stat-Ease, Inc. Stat-Ease, Inc.

More information

Design and Analysis of Experiments Lecture 6.1

Design and Analysis of Experiments Lecture 6.1 Lecture 6.1 1. Review of split unit experiments Why split? Why block? 2. Review of Laboratory 2 Cambridge grassland experiment Soup mix packet filling 3. Extending plot and treatment structures Wood stain

More information

Lec 1: An Introduction to ANOVA

Lec 1: An Introduction to ANOVA Ying Li Stockholm University October 31, 2011 Three end-aisle displays Which is the best? Design of the Experiment Identify the stores of the similar size and type. The displays are randomly assigned to

More information

Stat 890 Design of computer experiments

Stat 890 Design of computer experiments Stat 890 Design of computer experiments Will introduce design concepts for computer experiments Will look at more elaborate constructions next day Experiment design In computer experiments, as in many

More information

Analysis of Variance. Read Chapter 14 and Sections to review one-way ANOVA.

Analysis of Variance. Read Chapter 14 and Sections to review one-way ANOVA. Analysis of Variance Read Chapter 14 and Sections 15.1-15.2 to review one-way ANOVA. Design of an experiment the process of planning an experiment to insure that an appropriate analysis is possible. Some

More information

Quantitative Analysis of Financial Markets. Summary of Part II. Key Concepts & Formulas. Christopher Ting. November 11, 2017

Quantitative Analysis of Financial Markets. Summary of Part II. Key Concepts & Formulas. Christopher Ting. November 11, 2017 Summary of Part II Key Concepts & Formulas Christopher Ting November 11, 2017 christopherting@smu.edu.sg http://www.mysmu.edu/faculty/christophert/ Christopher Ting 1 of 16 Why Regression Analysis? Understand

More information

Quality Improvement in Hot Dip Galvanizing Process Using Robust Design tools

Quality Improvement in Hot Dip Galvanizing Process Using Robust Design tools Quality Improvement in Hot Dip Galvanizing Process Using Robust Design tools Abdosalam R. Dalef 1 and Mohammed E. Alaalem 2 1 Faculty of Marine Resources, Al-Asmarya Islamic University, Zliten, Libya,

More information

Aalto University A!School of Engineering. Robust Design II. Prof. Kevin Otto Department of Mechanical Engineering

Aalto University A!School of Engineering. Robust Design II. Prof. Kevin Otto Department of Mechanical Engineering Robust Design II Prof. Kevin Otto Department of Mechanical Engineering Kevin.Otto@aalto.fi 1 Overview Fractional Factorial Designs Experimental Variability Assessment Taguchi s Method Robustness Improvement

More information

Bindel, Fall 2011 Intro to Scientific Computing (CS 3220) Week 3: Wednesday, Jan 9

Bindel, Fall 2011 Intro to Scientific Computing (CS 3220) Week 3: Wednesday, Jan 9 Problem du jour Week 3: Wednesday, Jan 9 1. As a function of matrix dimension, what is the asymptotic complexity of computing a determinant using the Laplace expansion (cofactor expansion) that you probably

More information

Ordinary Least Squares Regression

Ordinary Least Squares Regression Ordinary Least Squares Regression Goals for this unit More on notation and terminology OLS scalar versus matrix derivation Some Preliminaries In this class we will be learning to analyze Cross Section

More information

Analysis of Variance and Design of Experiments-II

Analysis of Variance and Design of Experiments-II Analysis of Variance and Design of Experiments-II MODULE VIII LECTURE - 36 RESPONSE SURFACE DESIGNS Dr. Shalabh Department of Mathematics & Statistics Indian Institute of Technology Kanpur 2 Design for

More information

Xβ is a linear combination of the columns of X: Copyright c 2010 Dan Nettleton (Iowa State University) Statistics / 25 X =

Xβ is a linear combination of the columns of X: Copyright c 2010 Dan Nettleton (Iowa State University) Statistics / 25 X = The Gauss-Markov Linear Model y Xβ + ɛ y is an n random vector of responses X is an n p matrix of constants with columns corresponding to explanatory variables X is sometimes referred to as the design

More information

1 Use of indicator random variables. (Chapter 8)

1 Use of indicator random variables. (Chapter 8) 1 Use of indicator random variables. (Chapter 8) let I(A) = 1 if the event A occurs, and I(A) = 0 otherwise. I(A) is referred to as the indicator of the event A. The notation I A is often used. 1 2 Fitting

More information

1 Cricket chirps: an example

1 Cricket chirps: an example Notes for 2016-09-26 1 Cricket chirps: an example Did you know that you can estimate the temperature by listening to the rate of chirps? The data set in Table 1 1. represents measurements of the number

More information

4. The 2 k Factorial Designs (Ch.6. Two-Level Factorial Designs)

4. The 2 k Factorial Designs (Ch.6. Two-Level Factorial Designs) 4. The 2 k Factorial Designs (Ch.6. Two-Level Factorial Designs) Hae-Jin Choi School of Mechanical Engineering, Chung-Ang University Introduction to 2 k Factorial Designs Special case of the general factorial

More information

Chapter 5 EXPERIMENTAL DESIGN AND ANALYSIS

Chapter 5 EXPERIMENTAL DESIGN AND ANALYSIS Chapter 5 EXPERIMENTAL DESIGN AND ANALYSIS This chapter contains description of the Taguchi experimental design and analysis procedure with an introduction to Taguchi OA experimentation and the data analysis

More information

β x λ Chapter 11. Supplemental Text Material

β x λ Chapter 11. Supplemental Text Material Chapter. Supplemental Text Material -. The Method of Steepest Ascent The method of steepest ascent can be derived as follows. Suppose that we have fit a firstorder model y = β + β x 0 and we wish to use

More information

GI07/COMPM012: Mathematical Programming and Research Methods (Part 2) 2. Least Squares and Principal Components Analysis. Massimiliano Pontil

GI07/COMPM012: Mathematical Programming and Research Methods (Part 2) 2. Least Squares and Principal Components Analysis. Massimiliano Pontil GI07/COMPM012: Mathematical Programming and Research Methods (Part 2) 2. Least Squares and Principal Components Analysis Massimiliano Pontil 1 Today s plan SVD and principal component analysis (PCA) Connection

More information

INTRODUCTORY ECONOMETRICS

INTRODUCTORY ECONOMETRICS INTRODUCTORY ECONOMETRICS Lesson 2b Dr Javier Fernández etpfemaj@ehu.es Dpt. of Econometrics & Statistics UPV EHU c J Fernández (EA3-UPV/EHU), February 21, 2009 Introductory Econometrics - p. 1/192 GLRM:

More information

3.4. A computer ANOVA output is shown below. Fill in the blanks. You may give bounds on the P-value.

3.4. A computer ANOVA output is shown below. Fill in the blanks. You may give bounds on the P-value. 3.4. A computer ANOVA output is shown below. Fill in the blanks. You may give bounds on the P-value. One-way ANOVA Source DF SS MS F P Factor 3 36.15??? Error??? Total 19 196.04 Completed table is: One-way

More information

Design and Analysis of

Design and Analysis of Design and Analysis of Multi-Factored Experiments Module Engineering 7928-2 Two-level Factorial Designs L. M. Lye DOE Course 1 The 2 k Factorial Design Special case of the general factorial design; k factors,

More information