Process/product optimization using design of experiments and response surface methodology

Size: px
Start display at page:

Download "Process/product optimization using design of experiments and response surface methodology"

Transcription

1 Process/product optimization using design of experiments and response surface methodology M. Mäkelä Sveriges landbruksuniversitet Swedish University of Agricultural Sciences Department of Forest Biomaterials and Technology Division of Biomass Technology and Chemistry Umeå, Sweden

2 DOE and RSM You DOE RSM Design of experiments (DOE) Planning experiments Maximum information from minimized number of experiments Response Surface Methodology (RSM) Identifying and fitting an appropriate response surface model Statistics, regression modelling & optimization

3 What to expect? Background and philosophy Theory Nomenclature Practical demonstrations and exercises (Matlab) What not? Matrix algebra Detailed equation studies Statistical basics Detailed listing of possible designs

4 Contents Practical course, arranged in 4 individual sessions: Session 1 Introduction, factorial design, first order models Session 2 Matlab exercise: factorial design Session 3 Central composite designs, second order models, ANOVA, blocking, qualitative factors Session 4 Matlab exercise: practical optimization example on given data

5 Session 1 Introduction Why experimental design Factorial design Design matrix Model equation = coefficients Residual Response contour

6 Response surfaces If the current location is known, a response surface provides information on: - Where to go - How to get there - Local maxima/minima

7 Is there a difference? vs.? Mäkelä et al., Appl. Energ. 131 (2014) 490.

8 Research problem, A and B constant reagents C reaction product (response), to be maximized T and P reaction conditions (continuous factors), can be regulated

9 Response as a contour plot What kind of equation could describe C behaviour as a function of T and P? C = f(t,p)

10 What else do we want to know? Which factors and interactions are important Positions of local optima (if they exist) Surface and surface function around an optimum Direction towards an optimum Statistical significance

11 How can we do it? The expert method

12 How can we do it? The shotgun method

13 How can we do it? The Soviet method x k possibilities with k factors on x levels 2 factors on 4 levels = 16 experiments

14 How can we do it? The classical method P fixed x T fixed

15 How can we do it? Factorial design T, P Factor interaction (diagonal)

16 Why experimental design? Reduce the number of experiments Cost, time Extract maximal information Understand what happens Predict future behaviour

17 Challenges Multiple factors on multiple levels 6 factors on 3 levels, 3 6 experiments Reduce number of factors Only 2 levels Discard factors = SCREENING 2 3 1

18 Factorial design 3 N:o T P P T

19 Factorial design 1 In coded levels N:o T T coded P P coded P T The smallest possible full factorial design!

20 Factorial design Design matrix: N:o T P C P T

21 Factorial design Average T effect: T = 20 P Average P effect: T 1 P = 30 Interaction (TxP) effect: TxP = 10

22 Research problem,, A and B constant reagents C reaction product (response), to be maximized T, P and K reaction conditions (continuous factors) at two different levels Number of experiments 2 3 = 9 ([levels] [factors] ) How to select proper factor levels?

23 Research problem Empirical model:,, In matrix notation: y y y b b b e e e Measure Choose Unknown!

24 Factorial design First step Selection and coding of factor levels Design matrix K 1 T = [80, 120] P P = [2, 3] K = [0.5, 1] T

25 Factorial design N:o Order T P K Factorial design matrix Notice symmetry in diffent colums Inner product of two colums is zero E.g. T P = 0 This property is called orthogonality Randomize!

26 Orthogonality For a first-order orthogonal design, X X is a diagonal matrix: , 2x x x If two columns are orthogonal, corresponding variables are linearly independent, i.e., assessed independent of each other.

27 Factorial design Design matrix: N:o T P K Resp. (C) P K T

28 Factorial design N:o T P K Resp. (C) Model equation, main terms: where denotes response factor (T, P or K) coefficient residual mean term (average level)

29 Factorial design Equation = coefficients b b b b b o average value (mean term) Large coefficient important factor Interactions usually present Due to coding, the coefficients are comparable!

30 Factorial design Model equation with interactions: N:o T P K TxP TxK PxK TxPxK Resp. (C)

31 Factorial design Main effects and interactions: T P + K + - TxP TxK PxK

32 Factorial design Equation = coefficients b b b b b b b b Large interaction b 13 (TxK) Important interaction, main effects cannot be removed Which coefficients to include?

33 Factorial design An estimate of model error needed Center-points Duplicated experiments Model residual

34 Factorial design Error estimation allows significant testing Remove insignificant coefficients Leave main effects Important interaction, main effect cannot be removed

35 Factorial design Error estimation allows significant testing Remove insignificant coefficients Leave main effects Important interaction, main effect cannot be removed Recalculate significance upon removal!

36 Factorial design Model residuals Checking model adequacy Finding outliers Normally distributed Random error Several ways to present residuals Possibility for response transformation

37 Factorial design R 2 statistic Explained variability of measured response R 2 = % explained

38 Factorial design More things to look at Normal distribution of coefficients Residual Standardized residual Residual histogram Residual vs. time ANOVA

39 Factorial design

40 Factorial design Prediction: T = 110 K = 0.9 P = 2 (min. level) Coded location: Predicted response:

41 Session 1 Introduction Why experimental design Factorial design Design matrix Model equation = coefficients Residual Response contour

42 Nomenclature Factorial design Screening Design matrix Model equation Response Effect (main/interaction) Coefficient Significance Contour Residual

43 Contents Practical course, arranged in 4 individual sessions: Session 1 Introduction, factorial design, first order models Session 2 Matlab exercise: factorial design Session 3 Central composite designs, second order models, ANOVA, blocking, qualitative factors Session 4 Matlab exercise: practical optimization example on given data

44 Thank you for listening! Please send me an that you are attending the course

Process/product optimization using design of experiments and response surface methodology

Process/product optimization using design of experiments and response surface methodology Process/product optimization using design of experiments and response surface methodology Mikko Mäkelä Sveriges landbruksuniversitet Swedish University of Agricultural Sciences Department of Forest Biomaterials

More information

Response Surface Methodology

Response Surface Methodology Response Surface Methodology Process and Product Optimization Using Designed Experiments Second Edition RAYMOND H. MYERS Virginia Polytechnic Institute and State University DOUGLAS C. MONTGOMERY Arizona

More information

RESPONSE SURFACE MODELLING, RSM

RESPONSE SURFACE MODELLING, RSM CHEM-E3205 BIOPROCESS OPTIMIZATION AND SIMULATION LECTURE 3 RESPONSE SURFACE MODELLING, RSM Tool for process optimization HISTORY Statistical experimental design pioneering work R.A. Fisher in 1925: Statistical

More information

Response Surface Methodology: Process and Product Optimization Using Designed Experiments, 3rd Edition

Response Surface Methodology: Process and Product Optimization Using Designed Experiments, 3rd Edition Brochure More information from http://www.researchandmarkets.com/reports/705963/ Response Surface Methodology: Process and Product Optimization Using Designed Experiments, 3rd Edition Description: Identifying

More information

Response Surface Methodology:

Response Surface Methodology: Response Surface Methodology: Process and Product Optimization Using Designed Experiments RAYMOND H. MYERS Virginia Polytechnic Institute and State University DOUGLAS C. MONTGOMERY Arizona State University

More information

7. Response Surface Methodology (Ch.10. Regression Modeling Ch. 11. Response Surface Methodology)

7. Response Surface Methodology (Ch.10. Regression Modeling Ch. 11. Response Surface Methodology) 7. Response Surface Methodology (Ch.10. Regression Modeling Ch. 11. Response Surface Methodology) Hae-Jin Choi School of Mechanical Engineering, Chung-Ang University 1 Introduction Response surface methodology,

More information

14.0 RESPONSE SURFACE METHODOLOGY (RSM)

14.0 RESPONSE SURFACE METHODOLOGY (RSM) 4. RESPONSE SURFACE METHODOLOGY (RSM) (Updated Spring ) So far, we ve focused on experiments that: Identify a few important variables from a large set of candidate variables, i.e., a screening experiment.

More information

CHAPTER 6 MACHINABILITY MODELS WITH THREE INDEPENDENT VARIABLES

CHAPTER 6 MACHINABILITY MODELS WITH THREE INDEPENDENT VARIABLES CHAPTER 6 MACHINABILITY MODELS WITH THREE INDEPENDENT VARIABLES 6.1 Introduction It has been found from the literature review that not much research has taken place in the area of machining of carbon silicon

More information

What If There Are More Than. Two Factor Levels?

What If There Are More Than. Two Factor Levels? What If There Are More Than Chapter 3 Two Factor Levels? Comparing more that two factor levels the analysis of variance ANOVA decomposition of total variability Statistical testing & analysis Checking

More information

Assignment 9 Answer Keys

Assignment 9 Answer Keys Assignment 9 Answer Keys Problem 1 (a) First, the respective means for the 8 level combinations are listed in the following table A B C Mean 26.00 + 34.67 + 39.67 + + 49.33 + 42.33 + + 37.67 + + 54.67

More information

CHAPTER 6 A STUDY ON DISC BRAKE SQUEAL USING DESIGN OF EXPERIMENTS

CHAPTER 6 A STUDY ON DISC BRAKE SQUEAL USING DESIGN OF EXPERIMENTS 134 CHAPTER 6 A STUDY ON DISC BRAKE SQUEAL USING DESIGN OF EXPERIMENTS 6.1 INTRODUCTION In spite of the large amount of research work that has been carried out to solve the squeal problem during the last

More information

Answer Keys to Homework#10

Answer Keys to Homework#10 Answer Keys to Homework#10 Problem 1 Use either restricted or unrestricted mixed models. Problem 2 (a) First, the respective means for the 8 level combinations are listed in the following table A B C Mean

More information

Design of Engineering Experiments Chapter 5 Introduction to Factorials

Design of Engineering Experiments Chapter 5 Introduction to Factorials Design of Engineering Experiments Chapter 5 Introduction to Factorials Text reference, Chapter 5 page 170 General principles of factorial experiments The two-factor factorial with fixed effects The ANOVA

More information

Laboratory Exercise System Identification. Laboratory Experiment AS-PA6. "Design of Experiments"

Laboratory Exercise System Identification. Laboratory Experiment AS-PA6. Design of Experiments Formel-Kapitel Abschnitt FACHGEBIET Systemanalyse Laboratory Exercise System Identification Laboratory Experiment AS-PA6 "Design of Experiments" Responsible professor: Dr.-Ing. Thomas Glotzbach Responsible

More information

DESIGN OF EXPERIMENT ERT 427 Response Surface Methodology (RSM) Miss Hanna Ilyani Zulhaimi

DESIGN OF EXPERIMENT ERT 427 Response Surface Methodology (RSM) Miss Hanna Ilyani Zulhaimi + DESIGN OF EXPERIMENT ERT 427 Response Surface Methodology (RSM) Miss Hanna Ilyani Zulhaimi + Outline n Definition of Response Surface Methodology n Method of Steepest Ascent n Second-Order Response Surface

More information

CHAPTER 5 NON-LINEAR SURROGATE MODEL

CHAPTER 5 NON-LINEAR SURROGATE MODEL 96 CHAPTER 5 NON-LINEAR SURROGATE MODEL 5.1 INTRODUCTION As set out in the research methodology and in sequent with the previous section on development of LSM, construction of the non-linear surrogate

More information

Linear Models Review

Linear Models Review Linear Models Review Vectors in IR n will be written as ordered n-tuples which are understood to be column vectors, or n 1 matrices. A vector variable will be indicted with bold face, and the prime sign

More information

Two-Stage Stochastic and Deterministic Optimization

Two-Stage Stochastic and Deterministic Optimization Two-Stage Stochastic and Deterministic Optimization Tim Rzesnitzek, Dr. Heiner Müllerschön, Dr. Frank C. Günther, Michal Wozniak Abstract The purpose of this paper is to explore some interesting aspects

More information

The 2 k Factorial Design. Dr. Mohammad Abuhaiba 1

The 2 k Factorial Design. Dr. Mohammad Abuhaiba 1 The 2 k Factorial Design Dr. Mohammad Abuhaiba 1 HoweWork Assignment Due Tuesday 1/6/2010 6.1, 6.2, 6.17, 6.18, 6.19 Dr. Mohammad Abuhaiba 2 Design of Engineering Experiments The 2 k Factorial Design Special

More information

Design of Engineering Experiments Part 5 The 2 k Factorial Design

Design of Engineering Experiments Part 5 The 2 k Factorial Design Design of Engineering Experiments Part 5 The 2 k Factorial Design Text reference, Special case of the general factorial design; k factors, all at two levels The two levels are usually called low and high

More information

Response Surface Methodology

Response Surface Methodology Response Surface Methodology Bruce A Craig Department of Statistics Purdue University STAT 514 Topic 27 1 Response Surface Methodology Interested in response y in relation to numeric factors x Relationship

More information

8 RESPONSE SURFACE DESIGNS

8 RESPONSE SURFACE DESIGNS 8 RESPONSE SURFACE DESIGNS Desirable Properties of a Response Surface Design 1. It should generate a satisfactory distribution of information throughout the design region. 2. It should ensure that the

More information

OPTIMIZATION OF FIRST ORDER MODELS

OPTIMIZATION OF FIRST ORDER MODELS Chapter 2 OPTIMIZATION OF FIRST ORDER MODELS One should not multiply explanations and causes unless it is strictly necessary William of Bakersville in Umberto Eco s In the Name of the Rose 1 In Response

More information

Chemometrics. Matti Hotokka Physical chemistry Åbo Akademi University

Chemometrics. Matti Hotokka Physical chemistry Åbo Akademi University Chemometrics Matti Hotokka Physical chemistry Åbo Akademi University Linear regression Experiment Consider spectrophotometry as an example Beer-Lamberts law: A = cå Experiment Make three known references

More information

The Conjugate Gradient Method

The Conjugate Gradient Method The Conjugate Gradient Method Jason E. Hicken Aerospace Design Lab Department of Aeronautics & Astronautics Stanford University 14 July 2011 Lecture Objectives describe when CG can be used to solve Ax

More information

JUST THE MATHS UNIT NUMBER 9.3. MATRICES 3 (Matrix inversion & simultaneous equations) A.J.Hobson

JUST THE MATHS UNIT NUMBER 9.3. MATRICES 3 (Matrix inversion & simultaneous equations) A.J.Hobson JUST THE MATHS UNIT NUMBER 93 MATRICES 3 (Matrix inversion & simultaneous equations) by AJHobson 931 Introduction 932 Matrix representation of simultaneous linear equations 933 The definition of a multiplicative

More information

Response Surface Methodology III

Response Surface Methodology III LECTURE 7 Response Surface Methodology III 1. Canonical Form of Response Surface Models To examine the estimated regression model we have several choices. First, we could plot response contours. Remember

More information

2 Introduction to Response Surface Methodology

2 Introduction to Response Surface Methodology 2 Introduction to Response Surface Methodology 2.1 Goals of Response Surface Methods The experimenter is often interested in 1. Finding a suitable approximating function for the purpose of predicting a

More information

Institutionen för matematik och matematisk statistik Umeå universitet November 7, Inlämningsuppgift 3. Mariam Shirdel

Institutionen för matematik och matematisk statistik Umeå universitet November 7, Inlämningsuppgift 3. Mariam Shirdel Institutionen för matematik och matematisk statistik Umeå universitet November 7, 2011 Inlämningsuppgift 3 Mariam Shirdel (mash0007@student.umu.se) Kvalitetsteknik och försöksplanering, 7.5 hp 1 Uppgift

More information

Regression Analysis. Simple Regression Multivariate Regression Stepwise Regression Replication and Prediction Error EE290H F05

Regression Analysis. Simple Regression Multivariate Regression Stepwise Regression Replication and Prediction Error EE290H F05 Regression Analysis Simple Regression Multivariate Regression Stepwise Regression Replication and Prediction Error 1 Regression Analysis In general, we "fit" a model by minimizing a metric that represents

More information

Robustness and Distribution Assumptions

Robustness and Distribution Assumptions Chapter 1 Robustness and Distribution Assumptions 1.1 Introduction In statistics, one often works with model assumptions, i.e., one assumes that data follow a certain model. Then one makes use of methodology

More information

The geometry of least squares

The geometry of least squares The geometry of least squares We can think of a vector as a point in space, where the elements of the vector are the coordinates of the point. Consider for example, the following vector s: t = ( 4, 0),

More information

A STATISTICAL INVESTIGATION OF THE RHEOLOGICAL PROPERTIES OF MAGNESIUM PHOSPHATE CEMENT

A STATISTICAL INVESTIGATION OF THE RHEOLOGICAL PROPERTIES OF MAGNESIUM PHOSPHATE CEMENT International Workshop on Innovation in Low-carbon Cement & Concrete Technology 21-24 September 2016, University College London, U.K. Paper number 16 A STATISTICAL INVESTIGATION OF THE RHEOLOGICAL PROPERTIES

More information

2015 Stat-Ease, Inc. Practical Strategies for Model Verification

2015 Stat-Ease, Inc. Practical Strategies for Model Verification Practical Strategies for Model Verification *Presentation is posted at www.statease.com/webinar.html There are many attendees today! To avoid disrupting the Voice over Internet Protocol (VoIP) system,

More information

Lesson 9: Analyzing Standard Deviation

Lesson 9: Analyzing Standard Deviation Exploratory Challenge 1 - Analyzing Standard Deviation 1. A group of people attended a talk at a conference. At the end of the talk, ten of the attendees were given a questionnaire that consisted of four

More information

Linear Algebra Massoud Malek

Linear Algebra Massoud Malek CSUEB Linear Algebra Massoud Malek Inner Product and Normed Space In all that follows, the n n identity matrix is denoted by I n, the n n zero matrix by Z n, and the zero vector by θ n An inner product

More information

MATH602: APPLIED STATISTICS

MATH602: APPLIED STATISTICS MATH602: APPLIED STATISTICS Dr. Srinivas R. Chakravarthy Department of Science and Mathematics KETTERING UNIVERSITY Flint, MI 48504-4898 Lecture 10 1 FRACTIONAL FACTORIAL DESIGNS Complete factorial designs

More information

Introduc)on to the Design and Analysis of Experiments. Violet R. Syro)uk School of Compu)ng, Informa)cs, and Decision Systems Engineering

Introduc)on to the Design and Analysis of Experiments. Violet R. Syro)uk School of Compu)ng, Informa)cs, and Decision Systems Engineering Introduc)on to the Design and Analysis of Experiments Violet R. Syro)uk School of Compu)ng, Informa)cs, and Decision Systems Engineering 1 Complex Engineered Systems What makes an engineered system complex?

More information

Orthogonal contrasts for a 2x2 factorial design Example p130

Orthogonal contrasts for a 2x2 factorial design Example p130 Week 9: Orthogonal comparisons for a 2x2 factorial design. The general two-factor factorial arrangement. Interaction and additivity. ANOVA summary table, tests, CIs. Planned/post-hoc comparisons for the

More information

MTH 2310, FALL Introduction

MTH 2310, FALL Introduction MTH 2310, FALL 2011 SECTION 6.2: ORTHOGONAL SETS Homework Problems: 1, 5, 9, 13, 17, 21, 23 1, 27, 29, 35 1. Introduction We have discussed previously the benefits of having a set of vectors that is linearly

More information

The 'linear algebra way' of talking about "angle" and "similarity" between two vectors is called "inner product". We'll define this next.

The 'linear algebra way' of talking about angle and similarity between two vectors is called inner product. We'll define this next. Orthogonality and QR The 'linear algebra way' of talking about "angle" and "similarity" between two vectors is called "inner product". We'll define this next. So, what is an inner product? An inner product

More information

Design of Experiments SUTD - 21/4/2015 1

Design of Experiments SUTD - 21/4/2015 1 Design of Experiments SUTD - 21/4/2015 1 Outline 1. Introduction 2. 2 k Factorial Design Exercise 3. Choice of Sample Size Exercise 4. 2 k p Fractional Factorial Design Exercise 5. Follow-up experimentation

More information

Unit 6: Fractional Factorial Experiments at Three Levels

Unit 6: Fractional Factorial Experiments at Three Levels Unit 6: Fractional Factorial Experiments at Three Levels Larger-the-better and smaller-the-better problems. Basic concepts for 3 k full factorial designs. Analysis of 3 k designs using orthogonal components

More information

Access Algebra Scope and Sequence

Access Algebra Scope and Sequence Access Algebra Scope and Sequence Unit 1 Represent data with plots on the real number line (dot plots and histograms). Use statistics appropriate to the shape of the data distribution to compare center

More information

Optimization of Flocculation of Marine Chlorella sp. by Response Surface Methodology

Optimization of Flocculation of Marine Chlorella sp. by Response Surface Methodology Paper Code: es04 TIChE International Conference 011 Optimization of Flocculation of Marine Chlorella sp. by Response Surface Methodology Naruetsawan Sanyano 1*, Pakamas Chetpattananondh 1, Sininart Chongkhong

More information

Chapter 4 - Mathematical model

Chapter 4 - Mathematical model Chapter 4 - Mathematical model For high quality demands of production process in the micro range, the modeling of machining parameters is necessary. Non linear regression as mathematical modeling tool

More information

Experimental Design and Optimization

Experimental Design and Optimization . Experimental Design Stages a) Identifying the factors which may affect the results of an experiment; b) Designing the experiment so that the effects of uncontrolled factors are minimized; c) Using statistical

More information

Today s exercises. 5.17: Football Pools. 5.18: Cells of Line and Hyperplane Arrangements. Inclass: PPZ on the formula F

Today s exercises. 5.17: Football Pools. 5.18: Cells of Line and Hyperplane Arrangements. Inclass: PPZ on the formula F Exercise Session 9 03.05.2016 slide 1 Today s exercises 5.17: Football Pools 5.18: Cells of Line and Hyperplane Arrangements Inclass: PPZ on the formula F 6.1: Harmonic vs. Geometric Mean 6.2: Many j-isolated

More information

Optimeringslära för F (SF1811) / Optimization (SF1841)

Optimeringslära för F (SF1811) / Optimization (SF1841) Optimeringslära för F (SF1811) / Optimization (SF1841) 1. Information about the course 2. Examples of optimization problems 3. Introduction to linear programming Introduction - Per Enqvist 1 Linear programming

More information

Chapter 4. Displaying and Summarizing. Quantitative Data

Chapter 4. Displaying and Summarizing. Quantitative Data STAT 141 Introduction to Statistics Chapter 4 Displaying and Summarizing Quantitative Data Bin Zou (bzou@ualberta.ca) STAT 141 University of Alberta Winter 2015 1 / 31 4.1 Histograms 1 We divide the range

More information

Analysis of Variance and Design of Experiments-II

Analysis of Variance and Design of Experiments-II Analysis of Variance and Design of Experiments-II MODULE VIII LECTURE - 36 RESPONSE SURFACE DESIGNS Dr. Shalabh Department of Mathematics & Statistics Indian Institute of Technology Kanpur 2 Design for

More information

Least Squares Optimization

Least Squares Optimization Least Squares Optimization The following is a brief review of least squares optimization and constrained optimization techniques. I assume the reader is familiar with basic linear algebra, including the

More information

Eigenvalues, Eigenvectors, and an Intro to PCA

Eigenvalues, Eigenvectors, and an Intro to PCA Eigenvalues, Eigenvectors, and an Intro to PCA Eigenvalues, Eigenvectors, and an Intro to PCA Changing Basis We ve talked so far about re-writing our data using a new set of variables, or a new basis.

More information

JUST THE MATHS SLIDES NUMBER 9.3. MATRICES 3 (Matrix inversion & simultaneous equations) A.J.Hobson

JUST THE MATHS SLIDES NUMBER 9.3. MATRICES 3 (Matrix inversion & simultaneous equations) A.J.Hobson JUST THE MATHS SLIDES NUMBER 93 MATRICES 3 (Matrix inversion & simultaneous equations) by AJHobson 93 Introduction 932 Matrix representation of simultaneous linear equations 933 The definition of a multiplicative

More information

CHAPTER 2: QUADRATIC PROGRAMMING

CHAPTER 2: QUADRATIC PROGRAMMING CHAPTER 2: QUADRATIC PROGRAMMING Overview Quadratic programming (QP) problems are characterized by objective functions that are quadratic in the design variables, and linear constraints. In this sense,

More information

Second International Seminar on Environmental Chemistry and Toxicology, April 26-27, 2005, Jogjakarta, Indonesia

Second International Seminar on Environmental Chemistry and Toxicology, April 26-27, 2005, Jogjakarta, Indonesia Optimization of Catalytic degradation of Plastic to Aromatics Over HY Zeolite Didi Dwi Anggoro Chemical Engineering Department, Diponegoro University Jl. Prof Sudharto SH, Tembalang, Semarang 50239, Indonesia

More information

Eigenvalues, Eigenvectors, and an Intro to PCA

Eigenvalues, Eigenvectors, and an Intro to PCA Eigenvalues, Eigenvectors, and an Intro to PCA Eigenvalues, Eigenvectors, and an Intro to PCA Changing Basis We ve talked so far about re-writing our data using a new set of variables, or a new basis.

More information

Lecture 3. The Population Variance. The population variance, denoted σ 2, is the sum. of the squared deviations about the population

Lecture 3. The Population Variance. The population variance, denoted σ 2, is the sum. of the squared deviations about the population Lecture 5 1 Lecture 3 The Population Variance The population variance, denoted σ 2, is the sum of the squared deviations about the population mean divided by the number of observations in the population,

More information

Determining Machining Parameters of Corn Byproduct Filled Plastics

Determining Machining Parameters of Corn Byproduct Filled Plastics Iowa State University From the SelectedWorks of Kurt A. Rosentrater 8 Determining Machining Parameters of Corn Byproduct Filled Plastics Kurt A. Rosentrater, United States Department of Agriculture Andrew

More information

Chemometrics Unit 4 Response Surface Methodology

Chemometrics Unit 4 Response Surface Methodology Chemometrics Unit 4 Response Surface Methodology Chemometrics Unit 4. Response Surface Methodology In Unit 3 the first two phases of experimental design - definition and screening - were discussed. In

More information

Chapter 5 EXPERIMENTAL DESIGN AND ANALYSIS

Chapter 5 EXPERIMENTAL DESIGN AND ANALYSIS Chapter 5 EXPERIMENTAL DESIGN AND ANALYSIS This chapter contains description of the Taguchi experimental design and analysis procedure with an introduction to Taguchi OA experimentation and the data analysis

More information

Definitive Screening Designs with Added Two-Level Categorical Factors *

Definitive Screening Designs with Added Two-Level Categorical Factors * Definitive Screening Designs with Added Two-Level Categorical Factors * BRADLEY JONES SAS Institute, Cary, NC 27513 CHRISTOPHER J NACHTSHEIM Carlson School of Management, University of Minnesota, Minneapolis,

More information

Lecture Notes Introduction to Cluster Algebra

Lecture Notes Introduction to Cluster Algebra Lecture Notes Introduction to Cluster Algebra Ivan C.H. Ip Update: May 16, 2017 5 Review of Root Systems In this section, let us have a brief introduction to root system and finite Lie type classification

More information

MACHINE LEARNING. Methods for feature extraction and reduction of dimensionality: Probabilistic PCA and kernel PCA

MACHINE LEARNING. Methods for feature extraction and reduction of dimensionality: Probabilistic PCA and kernel PCA 1 MACHINE LEARNING Methods for feature extraction and reduction of dimensionality: Probabilistic PCA and kernel PCA 2 Practicals Next Week Next Week, Practical Session on Computer Takes Place in Room GR

More information

The University of Texas at Austin Department of Electrical and Computer Engineering. EE381V: Large Scale Learning Spring 2013.

The University of Texas at Austin Department of Electrical and Computer Engineering. EE381V: Large Scale Learning Spring 2013. The University of Texas at Austin Department of Electrical and Computer Engineering EE381V: Large Scale Learning Spring 2013 Assignment Two Caramanis/Sanghavi Due: Tuesday, Feb. 19, 2013. Computational

More information

401 Review. 6. Power analysis for one/two-sample hypothesis tests and for correlation analysis.

401 Review. 6. Power analysis for one/two-sample hypothesis tests and for correlation analysis. 401 Review Major topics of the course 1. Univariate analysis 2. Bivariate analysis 3. Simple linear regression 4. Linear algebra 5. Multiple regression analysis Major analysis methods 1. Graphical analysis

More information

For more information about how to cite these materials visit

For more information about how to cite these materials visit Author(s): Kerby Shedden, Ph.D., 2010 License: Unless otherwise noted, this material is made available under the terms of the Creative Commons Attribution Share Alike 3.0 License: http://creativecommons.org/licenses/by-sa/3.0/

More information

Part 1a: Inner product, Orthogonality, Vector/Matrix norm

Part 1a: Inner product, Orthogonality, Vector/Matrix norm Part 1a: Inner product, Orthogonality, Vector/Matrix norm September 19, 2018 Numerical Linear Algebra Part 1a September 19, 2018 1 / 16 1. Inner product on a linear space V over the number field F A map,

More information

Box Behnken modelling of phenol removal from aqueous solution using Emulsion Liquid Membrane

Box Behnken modelling of phenol removal from aqueous solution using Emulsion Liquid Membrane Box Behnken modelling of phenol removal from aqueous solution using Emulsion Liquid Membrane A. Balasubramanian Assistant Professor, Department of Petroleum Engineering, AMET University, Chennai, Tamilnadu,

More information

Module 1: Equations and Inequalities (30 days) Solving Equations: (10 Days) (10 Days)

Module 1: Equations and Inequalities (30 days) Solving Equations: (10 Days) (10 Days) Module 1: Equations and Inequalities (30 days) Word Problems Literal Equations (Scientific Applications) Justifying solutions Algebraic Proofs Represent constraints by equations and inequalities Graphing

More information

The integration of response surface method in microsoft excel with visual basic application

The integration of response surface method in microsoft excel with visual basic application Journal of Physics: Conference Series PAPER OPEN ACCESS The integration of response surface method in microsoft excel with visual basic application To cite this article: H Sofyan et al 2018 J. Phys.: Conf.

More information

Sizing Mixture (RSM) Designs for Adequate Precision via Fraction of Design Space (FDS)

Sizing Mixture (RSM) Designs for Adequate Precision via Fraction of Design Space (FDS) for Adequate Precision via Fraction of Design Space (FDS) Pat Whitcomb Stat-Ease, Inc. 61.746.036 036 fax 61.746.056 pat@statease.com Gary W. Oehlert School of Statistics University it of Minnesota 61.65.1557

More information

Linear Least Squares Problems

Linear Least Squares Problems Linear Least Squares Problems Introduction We have N data points (x 1,y 1 ),...(x N,y N ). We assume that the data values are given by y j = g(x j ) + e j, j = 1,...,N where g(x) = c 1 g 1 (x) + + c n

More information

Mathematics of Chemistry: Techniques & Applications (CHEM-UA 140)

Mathematics of Chemistry: Techniques & Applications (CHEM-UA 140) Mathematics of Chemistry: Techniques & Applications (CHEM-UA 140) Professor Mark E. Tuckerman Office: 1166E Waverly Phone: 8-8471 Email: mark.tuckerman@nyu.edu Class Time & Location: Tuesday, Thursday:

More information

Math Linear Algebra

Math Linear Algebra Math 220 - Linear Algebra (Summer 208) Solutions to Homework #7 Exercise 6..20 (a) TRUE. u v v u = 0 is equivalent to u v = v u. The latter identity is true due to the commutative property of the inner

More information

So far, we considered quantum static, as all our potentials did not depend on time. Therefore, our time dependence was trivial and always the same:

So far, we considered quantum static, as all our potentials did not depend on time. Therefore, our time dependence was trivial and always the same: Lecture 20 Page 1 Lecture #20 L20.P1 Time-dependent perturbation theory So far, we considered quantum static, as all our potentials did not depend on time. Therefore, our time dependence was trivial and

More information

Lecture 6. Numerical methods. Approximation of functions

Lecture 6. Numerical methods. Approximation of functions Lecture 6 Numerical methods Approximation of functions Lecture 6 OUTLINE 1. Approximation and interpolation 2. Least-square method basis functions design matrix residual weighted least squares normal equation

More information

Linear Algebra. Alvin Lin. August December 2017

Linear Algebra. Alvin Lin. August December 2017 Linear Algebra Alvin Lin August 207 - December 207 Linear Algebra The study of linear algebra is about two basic things. We study vector spaces and structure preserving maps between vector spaces. A vector

More information

Least Squares Optimization

Least Squares Optimization Least Squares Optimization The following is a brief review of least squares optimization and constrained optimization techniques, which are widely used to analyze and visualize data. Least squares (LS)

More information

Math 163: Lecture notes

Math 163: Lecture notes Math 63: Lecture notes Professor Monika Nitsche March 2, 2 Special functions that are inverses of known functions. Inverse functions (Day ) Go over: early exam, hw, quizzes, grading scheme, attendance

More information

An Introduction to Matrix Algebra

An Introduction to Matrix Algebra An Introduction to Matrix Algebra EPSY 905: Fundamentals of Multivariate Modeling Online Lecture #8 EPSY 905: Matrix Algebra In This Lecture An introduction to matrix algebra Ø Scalars, vectors, and matrices

More information

Exercises for Unit I (Topics from linear algebra)

Exercises for Unit I (Topics from linear algebra) Exercises for Unit I (Topics from linear algebra) I.0 : Background Note. There is no corresponding section in the course notes, but as noted at the beginning of Unit I these are a few exercises which involve

More information

Test Yourself! Methodological and Statistical Requirements for M.Sc. Early Childhood Research

Test Yourself! Methodological and Statistical Requirements for M.Sc. Early Childhood Research Test Yourself! Methodological and Statistical Requirements for M.Sc. Early Childhood Research HOW IT WORKS For the M.Sc. Early Childhood Research, sufficient knowledge in methods and statistics is one

More information

Math 240 Calculus III

Math 240 Calculus III Generalized Calculus III Summer 2015, Session II Thursday, July 23, 2015 Agenda 1. 2. 3. 4. Motivation Defective matrices cannot be diagonalized because they do not possess enough eigenvectors to make

More information

The Gram Schmidt Process

The Gram Schmidt Process u 2 u The Gram Schmidt Process Now we will present a procedure, based on orthogonal projection, that converts any linearly independent set of vectors into an orthogonal set. Let us begin with the simple

More information

The Gram Schmidt Process

The Gram Schmidt Process The Gram Schmidt Process Now we will present a procedure, based on orthogonal projection, that converts any linearly independent set of vectors into an orthogonal set. Let us begin with the simple case

More information

Inverse Theory. COST WaVaCS Winterschool Venice, February Stefan Buehler Luleå University of Technology Kiruna

Inverse Theory. COST WaVaCS Winterschool Venice, February Stefan Buehler Luleå University of Technology Kiruna Inverse Theory COST WaVaCS Winterschool Venice, February 2011 Stefan Buehler Luleå University of Technology Kiruna Overview Inversion 1 The Inverse Problem 2 Simple Minded Approach (Matrix Inversion) 3

More information

Study on Optimal Design of Automotive Body Structure Crashworthiness

Study on Optimal Design of Automotive Body Structure Crashworthiness 7 th International LS-DYNA Users Conference Simulation Technology () Study on Optimal Design of Automotive Body Structure Crashworthiness Wang Hailiang Lin Zhongqin Jin Xianlong Institute for Automotive

More information

MATH10001 Mathematical Workshop Difference Equations part 2 Non-linear difference equations

MATH10001 Mathematical Workshop Difference Equations part 2 Non-linear difference equations MATH10001 Mathematical Workshop Difference Equations part 2 Non-linear difference equations In a linear difference equation, the equation contains a sum of multiples of the elements in the sequence {y

More information

2/26/2017. This is similar to canonical correlation in some ways. PSY 512: Advanced Statistics for Psychological and Behavioral Research 2

2/26/2017. This is similar to canonical correlation in some ways. PSY 512: Advanced Statistics for Psychological and Behavioral Research 2 PSY 512: Advanced Statistics for Psychological and Behavioral Research 2 What is factor analysis? What are factors? Representing factors Graphs and equations Extracting factors Methods and criteria Interpreting

More information

Least Squares Optimization

Least Squares Optimization Least Squares Optimization The following is a brief review of least squares optimization and constrained optimization techniques. Broadly, these techniques can be used in data analysis and visualization

More information

Simple Linear Regression Using Ordinary Least Squares

Simple Linear Regression Using Ordinary Least Squares Simple Linear Regression Using Ordinary Least Squares Purpose: To approximate a linear relationship with a line. Reason: We want to be able to predict Y using X. Definition: The Least Squares Regression

More information

Design of Experiments SUTD 06/04/2016 1

Design of Experiments SUTD 06/04/2016 1 Design of Experiments SUTD 06/04/2016 1 Outline 1. Introduction 2. 2 k Factorial Design 3. Choice of Sample Size 4. 2 k p Fractional Factorial Design 5. Follow-up experimentation (folding over) with factorial

More information

ANOVA Situation The F Statistic Multiple Comparisons. 1-Way ANOVA MATH 143. Department of Mathematics and Statistics Calvin College

ANOVA Situation The F Statistic Multiple Comparisons. 1-Way ANOVA MATH 143. Department of Mathematics and Statistics Calvin College 1-Way ANOVA MATH 143 Department of Mathematics and Statistics Calvin College An example ANOVA situation Example (Treating Blisters) Subjects: 25 patients with blisters Treatments: Treatment A, Treatment

More information

A New Generalised Inverse Polynomial Model in the Exploration of Response Surface Methodology

A New Generalised Inverse Polynomial Model in the Exploration of Response Surface Methodology Journal of Emerging Trends in Engineering Applied Sciences (JETEAS) (6): 1059-1063 Scholarlink Research Institute Journals 011 (ISSN: 141-7016) jeteas.scholarlinkresearch.org Journal of Emerging Trends

More information

PRODUCT QUALITY IMPROVEMENT THROUGH RESPONSE SURFACE METHODOLOGY : A CASE STUDY

PRODUCT QUALITY IMPROVEMENT THROUGH RESPONSE SURFACE METHODOLOGY : A CASE STUDY PRODUCT QULITY IMPROVEMENT THROUGH RESPONSE SURFCE METHODOLOGY : CSE STUDY HE Zhen, College of Management and Economics, Tianjin University, China, zhhe@tju.edu.cn, Tel: +86-22-8740783 ZHNG Xu-tao, College

More information

Regression. Oscar García

Regression. Oscar García Regression Oscar García Regression methods are fundamental in Forest Mensuration For a more concise and general presentation, we shall first review some matrix concepts 1 Matrices An order n m matrix is

More information

Statistical Techniques II

Statistical Techniques II Statistical Techniques II EST705 Regression with atrix Algebra 06a_atrix SLR atrix Algebra We will not be doing our regressions with matrix algebra, except that the computer does employ matrices. In fact,

More information

Lecture 15, 16: Diagonalization

Lecture 15, 16: Diagonalization Lecture 15, 16: Diagonalization Motivation: Eigenvalues and Eigenvectors are easy to compute for diagonal matrices. Hence, we would like (if possible) to convert matrix A into a diagonal matrix. Suppose

More information

Design & Analysis of Experiments 7E 2009 Montgomery

Design & Analysis of Experiments 7E 2009 Montgomery 1 What If There Are More Than Two Factor Levels? The t-test does not directly apply ppy There are lots of practical situations where there are either more than two levels of interest, or there are several

More information