Design Moments. Many properties of experimental designs are quantified by design moments. Given a model matrix 1 x 11 x 21 x k1 1 x 12 x 22 x k2 X =

Similar documents
8 RESPONSE SURFACE DESIGNS

Useful Numerical Statistics of Some Response Surface Methodology Designs

Optimality of Central Composite Designs Augmented from One-half Fractional Factorial Designs

Response Surface Methodology

Response Surface Methodology:

A Study on Minimal-point Composite Designs

When combining power functions into a single polynomial function, there are a few new features we like to look for, such as

Analysis of Variance and Design of Experiments-II

DESIGN OF EXPERIMENT ERT 427 Response Surface Methodology (RSM) Miss Hanna Ilyani Zulhaimi

Process/product optimization using design of experiments and response surface methodology

Optimal design of experiments

Design & Analysis of Experiments 7E 2009 Montgomery

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 1 x 2. x n 8 (4) 3 4 2

A COMPARISON STUDY OF SECOND-ORDER SCREENING DESIGNS AND THEIR EXTENSION DISSERTATION. Shane A. Dougherty, Lt Col AFIT-ENS-DS-13-D-01

RESPONSE SURFACE METHODOLOGY

D-Optimal Designs for Second-Order Response Surface Models with Qualitative Factors

Unit 12: Response Surface Methodology and Optimality Criteria

Response Surface Methodology: Process and Product Optimization Using Designed Experiments, 3rd Edition

Robustness of Principal Components

Preface Introduction to Statistics and Data Analysis Overview: Statistical Inference, Samples, Populations, and Experimental Design The Role of

Cost Penalized Estimation and Prediction Evaluation for Split-Plot Designs

Linear Regression. In this problem sheet, we consider the problem of linear regression with p predictors and one intercept,

Design and Analysis of Experiments

Error Analysis for Solving a Set of Linear Equations

Chapter 6 - Orthogonality

LMI MODELLING 4. CONVEX LMI MODELLING. Didier HENRION. LAAS-CNRS Toulouse, FR Czech Tech Univ Prague, CZ. Universidad de Valladolid, SP March 2009

The Volume of a Hypersphere

Gordon solutions. n=1 1. p n

MAT 1332: CALCULUS FOR LIFE SCIENCES. Contents. 1. Review: Linear Algebra II Vectors and matrices Definition. 1.2.

Math 240 Calculus III

Short Type Question. Q.1 Discuss the convergence & divergence of the geometric series. Q.6 Test the converegence of the series whose nth term is

An Introduction to Multivariate Statistical Analysis

I-Optimal Versus D-Optimal Split-Plot Response Surface Designs

Practical Linear Algebra: A Geometry Toolbox

Response surface methodology

Modeling Data with Linear Combinations of Basis Functions. Read Chapter 3 in the text by Bishop

Math 60. Rumbos Spring Solutions to Assignment #17

This can be accomplished by left matrix multiplication as follows: I

Chapter 4 Describing the Relation between Two Variables

Multiple Regression Model: I

ON THE DESIGN POINTS FOR A ROTATABLE ORTHOGONAL CENTRAL COMPOSITE DESIGN

Matrix Operations: Determinant

3. Vector spaces 3.1 Linear dependence and independence 3.2 Basis and dimension. 5. Extreme points and basic feasible solutions

MECH 576 Geometry in Mechanics September 16, 2009 Using Line Geometry

Design and Analysis of Experiments Prof. Jhareshwar Maiti Department of Industrial and Systems Engineering Indian Institute of Technology, Kharagpur

Measuring Ellipsoids 1

ON D-OPTIMAL DESIGNS FOR ESTIMATING SLOPE

Inverse of a Square Matrix. For an N N square matrix A, the inverse of A, 1

FACTOR SCREENING AND RESPONSE SURFACE EXPLORATION

-dimensional space. d 1. d k (1 ρ 2 j,j+k;j+1...j+k 1). Γ(2m) m=1. 2 ) 2 4d)/4. Γ d ( d 2 ) (d 2)/2. Γ d 1 (d)

Lecture 6: Geometry of OLS Estimation of Linear Regession

CO350 Linear Programming Chapter 5: Basic Solutions

Linear Algebra Review: Linear Independence. IE418 Integer Programming. Linear Algebra Review: Subspaces. Linear Algebra Review: Affine Independence

Response Surface Methodology III

Contents. D. R. Wilkins. Copyright c David R. Wilkins

Bayesian Regressions in Experimental Design

Pre-sessional Mathematics for Big Data MSc Class 2: Linear Algebra

GENERALIZED RESOLUTION AND MINIMUM ABERRATION CRITERIA FOR PLACKETT-BURMAN AND OTHER NONREGULAR FACTORIAL DESIGNS

Algebraic Methods in Combinatorics

Chapter 23 Term083 Term082

Design and Analysis of Experiments

PHYS 705: Classical Mechanics. Rigid Body Motion Introduction + Math Review

Electric and magnetic multipoles

Definitive Screening Designs

Linear Algebra V = T = ( 4 3 ).

More Linear Algebra. Edps/Soc 584, Psych 594. Carolyn J. Anderson

CHAPTER 5. Basic Iterative Methods

FIVE-FACTOR CENTRAL COMPOSITE DESIGNS ROBUST TO A PAIR OF MISSING OBSERVATIONS. Munir Akhtar Vice-Chanselor, Islamia University Bahawalpur, Pakistan.

USING REGULAR FRACTIONS OF TWO-LEVEL DESIGNS TO FIND BASELINE DESIGNS

1 Determinants. 1.1 Determinant

Linear Algebra Review. Vectors

POLI270 - Linear Algebra

(II.D) There is exactly one rref matrix row-equivalent to any A

Discrete Geometry. Problem 1. Austin Mohr. April 26, 2012

Cartesian Tensors. e 2. e 1. General vector (formal definition to follow) denoted by components

Process Characterization Using Response Surface Methodology

Fall TMA4145 Linear Methods. Exercise set Given the matrix 1 2

Direct Methods for Solving Linear Systems. Matrix Factorization

Hypothesis Testing hypothesis testing approach

Response Surface Methodology IV

1. Consider the following polyhedron of an LP problem: 2x 1 x 2 + 5x 3 = 1 (1) 3x 2 + x 4 5 (2) 7x 1 4x 3 + x 4 4 (3) x 1, x 2, x 4 0

Some Nonregular Designs From the Nordstrom and Robinson Code and Their Statistical Properties

ENGG5781 Matrix Analysis and Computations Lecture 8: QR Decomposition

Chapter 3 Best Linear Unbiased Estimation

MAT-INF4110/MAT-INF9110 Mathematical optimization

0.1 Tangent Spaces and Lagrange Multipliers

The Inclusion Exclusion Principle

GRAPHICAL TOOLS, INCORPORATING COST AND OPTIMIZING CENTRAL COMPOSITE DESIGNS FOR SPLIT- PLOT RESPONSE SURFACE METHODOLOGY EXPERIMENTS.

Algebraic Methods in Combinatorics

Numerical Linear Algebra

Assignment 2 (Sol.) Introduction to Machine Learning Prof. B. Ravindran

No books, no notes, no calculators. You must show work, unless the question is a true/false, yes/no, or fill-in-the-blank question.

Consider an infinite row of dominoes, labeled by 1, 2, 3,, where each domino is standing up. What should one do to knock over all dominoes?

COURSE Numerical methods for solving linear systems. Practical solving of many problems eventually leads to solving linear systems.

Lecture 6: Methods for high-dimensional problems

Computational math: Assignment 1

ELE/MCE 503 Linear Algebra Facts Fall 2018

Dimension reduction, PCA & eigenanalysis Based in part on slides from textbook, slides of Susan Holmes. October 3, Statistics 202: Data Mining

Numerical Methods I Solving Square Linear Systems: GEM and LU factorization

MODULE 8 Topics: Null space, range, column space, row space and rank of a matrix

Transcription:

8.5 Rotatability Recall: Var[ŷ(x)] = σ 2 x (m) () 1 x (m) is the prediction variance and NVar[ŷ(x)]/σ 2 = Nx (m) () 1 x (m) is the scaled prediction variance. A design is rotatable if the prediction variance Var[ŷ(x)] (or, equivalently, the scaled prediction variance NVar[ŷ(x)]/σ 2 ) is a function only of the distance ρ from the point x = (x 1, x 2,..., x k ) to the center of the design (where ρ 2 = x 2 i ). Thus, with a rotatable design, the prediction variance Var[ŷ(x)] is the same at all points x that are equidistant from the design center. In the earlier two-factor CCD example of deriving the prediction variance, we showed that the prediction variance was a function only of ρ. Therefore, that CCD is rotatable. Consequently, the prediction variance Var[ŷ(x)] is constant on spheres centered at the design center. This constant variance property is appealing when the experimenter does not initially know where in the design space the most accurate and precise predictions are needed. Note that rotatability does not ensure stable or near-stable predictions throughout the design region. It only ensures the constant variance property on spheres. However, rotatability or near-rotatability is often easy to achieve without sacrificing other important design properties (such as allowing a test for lack of fit). Design Moments Many properties of experimental designs are quantified by design moments. Given a model matrix 1 x 11 x 21 x k1 1 x 12 x 22 x k2 X =..... 1 x 1N x 2N x kn The relevant design moments are: [i] = i = 1,..., k [ii] = i = 1,..., k [ij] = Therefore, for a first-order model design 1 [1] [2] [3] [k] [11] [12] [13] [1k] [22] [23] [2k].... [kk] 163

For an orthogonal first-order design 1 0 0 0 [11] 0 0 [22] 0.... [kk] Examples include the 2 k, 2 k p, and Plackett-Burman designs. An odd moment is any moment for which at least one design variable has an odd power. For example, [i], [ij], [ijj], [iii] are odd moments. All other moments are called even moments. For a second-order model, the model matrix will include columns for the intercept, first-order term, squared terms, and cross-product terms. Therefore, in addition to the first-order model moments, the relevant design moments for the second-order model are: [iii] = i = 1,..., k [iiii] = i = 1,..., k [ijk] = i, j, k = 1,..., k i, j, k not equal [ijj] = [iijj] = [iiij] = For example, when k = 3 1 x 11 x 21 x 31 x 2 11 x 2 21 x 2 31 x 11 x 21 x 11 x 31 x 21 x 31 1 x 12 x 22 x 32 x 2 12 x 2 22 x 2 32 x 12 x 22 x 12 x 32 x 22 x 32 X =.......... 1 x 1N x 2N x 3N x 2 1N x2 2N x2 3N x 1Nx 2N x 1N x 3N x 2N x 3N and 1 [1] [2] [3] [11] [22] [33] [12] [13] [23] [11] [12] [13] [111] [122] [133] [112] [113] [123] [22] [23] [112] [222] [233] [122] [123] [223] [33] [113] [223] [333] [123] [133] [233] [1111] [1122] [1133] [1112] [1113] [1123] [2222] [2233] [1222] [1223] [2223] [3333] [1233] [1333] [2333] [1122] [1123] [1223] [1133] [1233] [2233] 164

Moment Matrix Conditions for Rotatability A first-order design is rotatable if and only if all odd moments are zero and all even second order moments are equal. That is, [i] = 0, [ij] = 0, and [ii] = λ 2. The quantity λ 2 is determined by the scaling of the design variables. For example, a 2 k p design of at least resolution III which uses a ±1 coding is rotatable with [i] = 0, [ij] = 0, and [ii] = λ 2 = 1.0. The necessary form of /N of a rotatable k-variable second-order design: 1 0 1 k 0 1 k λ 2 J k 0 k 1 λ 2 I k 0 k k 0 k k 0 k 1 0 k k λ 4 I k 0 k k λ 2 J k 0 k k 0 k k λ 4 (2I k + J kj k ) Thus, a second-order design is rotatable if and only if 1. All odd moments are zero. 3. [iiii] = 2. [ii] = 4. [iijj] = where the quantities λ 2 and λ 4 are determined by the scaling of the design variables. Note: Conditions (3) and (4) can be combined into a single condition [iiii]/[iijj] = 3 for i j. This is what is stated in the Myers, Montgomery, and Anderson-Cook text. 8.5.1 Rotatability and the CCD For any central composite design (CCD), all odd moments are zero due to the orthogonality among the x i, x i x j, and x 2 i columns. Nonorthoganality occurs (i) between the column of ones and the x 2 i columns and (ii) between the x 2 i and x 2 j columns (i j). Therefore, to make a rotatable CCD, we must find the appropriate choice of α so that /N satisfies the rotatability criterion [iiii]/[iijj] = 3 where [iiii] and [iijj] are the moments corresponding to the products among the x 2 i columns. For any CCD, [iiii] = F +2α 4 and [iijj] = F where F is the number of factorial points. Thus, for rotatability, [iiii] [iijj] = F + 2α4 = 3 F Solving for α yields α = 4 F. For a CCD to be rotatable, α = 4 F. If α = k is used, then at least one center point is required for the CCD. Otherwise, () 1 does not exist, and hence, Var[ŷ(x)], does not exist. If the design region is spherical, the best CCD with k = 3 based on Var[ŷ(x)] throughout the spherical region uses α = 3 (with 3-5 center points). This design is near-rotatable. 165

166

167

8.5.2 Cuboidal vs Spherical Design Regions It is common for the experimenter to specify a minimum and maximum setting on each of the k design variables. In such cases, the experimental region is a k-dimensional hypercube. The CCD with α = 1 corresponds to this situation and is called a face-centered cube design. It is called a face-centered cube design because the axial points occur at the center of the faces of the k-dimensional cube (rather than extend the axial points beyond the faces of the cube (α > 1), as in a spherical region). The face-centered cube CCD possesses several desirable features: The factorial and axial points are on the boundary of the design region (on the cube). The design is symmetric in the experimental region and as a result covers or fills in the design region is a symmetric fashion. The face-centered cube CCD is not rotatable. However, rotatability or near-rotatability is not an important design property in a cuboidal design region. Rotatability is a property to be considered for spherical design regions. The face-centered cube CCD does not require center points because () 1 exists. Var[ŷ(x)] is relatively insensitive to the number of center points. Center points are included for testing for lack of fit. Whether or not a design should contain axial points with α > 1 should depend on whether or not the axial values are scientifically permissible or feasible. 8.6 Equiradial Designs An equiradial set of points consists of a set of points such that all points are equidistant from the origin. An equiradial design is a design which consists of two or more equiradial sets of points. Consider a single equiradial set of points of distance ρ from the origin. That is, k x 2 i = ρ 2. Then the column of ones and the columns corresponding to the x 2 1,..., x 2 k in the design matrix are linearly dependent which results in a singular matrix. Specifically, for each row of X, k the sum of the x 2 i columns = ρ 2. Thus, the intercept column of ones = (1/ρ 2 ) x 2 i making X less than full column rank (and singular). Therefore, a single equiradial set cannot provide a design for fitting a second-order model. Inclusion of one or more center points to any single equiradial set of points results in a nonsingular. Therefore, a second-order model can be fit by a single equiradial set plus center points. Examples of second-order equiradial designs that are rotatable include those designs whose equiradial sets of points are characterized as being equally spaced points on a circle (k = 2), a sphere (k = 3), or a hypersphere (k 4). These points will form the vertices of a regular polygon, polyhedron, or polytope. Rotatable CCDs are equiradial designs. i=1 i=1 168

169