Chapter 11. Supplemental Text Material. The method of steepest ascent can be derived as follows. Suppose that we have fit a firstorder

Similar documents
Harmonic oscillator approximation

Root Locus Techniques

MULTIPLE REGRESSION ANALYSIS For the Case of Two Regressors

Improvements on Waring s Problem

Improvements on Waring s Problem

The multivariate Gaussian probability density function for random vector X (X 1,,X ) T. diagonal term of, denoted

Linear Approximation with Regularization and Moving Least Squares

Team. Outline. Statistics and Art: Sampling, Response Error, Mixed Models, Missing Data, and Inference

2.3 Least-Square regressions

Physics 120. Exam #1. April 15, 2011

AP Statistics Ch 3 Examining Relationships

Scattering of two identical particles in the center-of. of-mass frame. (b)

Specification -- Assumptions of the Simple Classical Linear Regression Model (CLRM) 1. Introduction

Design of Recursive Digital Filters IIR

Module 5. Cables and Arches. Version 2 CE IIT, Kharagpur

LECTURE 9 CANONICAL CORRELATION ANALYSIS

Introduction to Interfacial Segregation. Xiaozhe Zhang 10/02/2015

Statistical Properties of the OLS Coefficient Estimators. 1. Introduction

Variable Structure Control ~ Basics

1 Matrix representations of canonical matrices

MATH Sensitivity of Eigenvalue Problems

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

Physics 111. CQ1: springs. con t. Aristocrat at a fixed angle. Wednesday, 8-9 pm in NSC 118/119 Sunday, 6:30-8 pm in CCLIR 468.

Economics 101. Lecture 4 - Equilibrium and Efficiency

CHALMERS, GÖTEBORGS UNIVERSITET. SOLUTIONS to RE-EXAM for ARTIFICIAL NEURAL NETWORKS. COURSE CODES: FFR 135, FIM 720 GU, PhD

Solutions to Problem Set 6

Two Approaches to Proving. Goldbach s Conjecture

Kernel Methods and SVMs Extension

CHAPTER 9 LINEAR MOMENTUM, IMPULSE AND COLLISIONS

Canonical transformations

Statistics MINITAB - Lab 2

and decompose in cycles of length two

1. The number of significant figures in the number is a. 4 b. 5 c. 6 d. 7

Small signal analysis

Chapter 6 The Effect of the GPS Systematic Errors on Deformation Parameters

Chapter 6. Supplemental Text Material

Method Of Fundamental Solutions For Modeling Electromagnetic Wave Scattering Problems

Optimal inference of sameness Supporting information

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

We can represent a vector (or higher-rank tensors) in at least three different ways:

Which Separator? Spring 1

The Prncpal Component Transform The Prncpal Component Transform s also called Karhunen-Loeve Transform (KLT, Hotellng Transform, oregenvector Transfor

Calculating Jacobian coefficients of primitive constraints with respect to Euler parameters

Salmon: Lectures on partial differential equations. Consider the general linear, second-order PDE in the form. ,x 2

Electric and magnetic field sensor and integrator equations

Additional File 1 - Detailed explanation of the expression level CPD

Least Squares Fitting of Data

σ τ τ τ σ τ τ τ σ Review Chapter Four States of Stress Part Three Review Review

MACHINE APPLIED MACHINE LEARNING LEARNING. Gaussian Mixture Regression

ACTM State Calculus Competition Saturday April 30, 2011

Start Point and Trajectory Analysis for the Minimal Time System Design Algorithm

ELASTIC WAVE PROPAGATION IN A CONTINUOUS MEDIUM

Linear Feature Engineering 11

Complex Numbers. x = B B 2 4AC 2A. or x = x = 2 ± 4 4 (1) (5) 2 (1)

Solutions to exam in SF1811 Optimization, Jan 14, 2015

CHAPTER 14 GENERAL PERTURBATION THEORY

Resonant FCS Predictive Control of Power Converter in Stationary Reference Frame

Chapter 9: Statistical Inference and the Relationship between Two Variables

Chapter 6. Supplemental Text Material. Run, i X i1 X i2 X i1 X i2 Response total (1) a b ab

Fall 2012 Analysis of Experimental Measurements B. Eisenstein/rev. S. Errede

APPROXIMATE FUZZY REASONING BASED ON INTERPOLATION IN THE VAGUE ENVIRONMENT OF THE FUZZY RULEBASE AS A PRACTICAL ALTERNATIVE OF THE CLASSICAL CRI

A Novel Approach for Testing Stability of 1-D Recursive Digital Filters Based on Lagrange Multipliers

14 Lagrange Multipliers

is the calculated value of the dependent variable at point i. The best parameters have values that minimize the squares of the errors

Least Squares Fitting of Data

Originated from experimental optimization where measurements are very noisy Approximation can be actually more accurate than

Perron Vectors of an Irreducible Nonnegative Interval Matrix

No! Yes! Only if reactions occur! Yes! Ideal Gas, change in temperature or pressure. Survey Results. Class 15. Is the following possible?

MTH 263 Practice Test #1 Spring 1999

Supporting Information. Hydroxyl Radical Production by H 2 O 2 -Mediated. Conditions

Chapter Newton s Method

Two-Layered Model of Blood Flow through Composite Stenosed Artery

On the SO 2 Problem in Thermal Power Plants. 2.Two-steps chemical absorption modeling

Lectures on Multivariable Feedback Control

New approach to Fully Nonlinear Adiabatic TWM Theory

For all questions, answer choice E) NOTA" means none of the above answers is correct.

Chapter 11: Simple Linear Regression and Correlation

Transfer Functions. Convenient representation of a linear, dynamic model. A transfer function (TF) relates one input and one output: ( ) system

Week3, Chapter 4. Position and Displacement. Motion in Two Dimensions. Instantaneous Velocity. Average Velocity

PHYS 705: Classical Mechanics. Calculus of Variations II

Not at Steady State! Yes! Only if reactions occur! Yes! Ideal Gas, change in temperature or pressure. Yes! Class 15. Is the following possible?

Pythagorean triples. Leen Noordzij.

NUMERICAL DIFFERENTIATION

Quick Visit to Bernoulli Land

PHYS 100 Worked Examples Week 05: Newton s 2 nd Law

2. SINGLE VS. MULTI POLARIZATION SAR DATA

Confidence intervals for the difference and the ratio of Lognormal means with bounded parameters

Preemptive scheduling. Disadvantages of preemptions WCET. Preemption indirect costs 19/10/2018. Cache related preemption delay

EECE 301 Signals & Systems Prof. Mark Fowler

Homework Notes Week 7

Spin-rotation coupling of the angularly accelerated rigid body

= = = (a) Use the MATLAB command rref to solve the system. (b) Let A be the coefficient matrix and B be the right-hand side of the system.

Consistency & Convergence

15 Lagrange Multipliers

Gravitational Acceleration: A case of constant acceleration (approx. 2 hr.) (6/7/11)

A Result on a Cyclic Polynomials

Lecture 12: Discrete Laplacian

Hidden Markov Models & The Multivariate Gaussian (10/26/04)

You must not circulate this book in any other binding or cover and you must impose this same condition on any acquirer.

8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS

Transcription:

S-. The Method of Steepet cent Chapter. Supplemental Text Materal The method of teepet acent can be derved a follow. Suppoe that we have ft a frtorder model y = β + β x and we wh to ue th model to determne a path leadng from the center of the degn regon x = that ncreae the predcted repone mot qucly. Snce the frt order model an unbounded functon, we cannot jut fnd the value of the x that maxmze the predcted repone. Suppoe that ntead we fnd the x that maxmze the predcted repone at a pont on a hyperphere of radu r. That The can be formulated a Max ubject to = x = y = β + = r = β x Max G = β + β x λ x r L NM = = where λ a LaGrange multpler. Tang the dervatve of G yeld G = β λx,,, x L NM G = x r λ = Equatng thee dervatve to zero reult n = x x O QP β = =,,, λ = r Now the frt of thee equaton how that the coordnate of the pont on the hyperphere are proportonal to the gn and magntude of the regreon coeffcent (the quantty λ a contant that jut fxe the radu of the hyperphere). The econd equaton jut tate that the pont atfe the contrant. Therefore, the heurtc decrpton of the method of teepet acent can be jutfed from a more formal perpectve. O QP

S-. The Canoncal Form of the Second-Order Repone Surface Model Equaton (-9) preent a very ueful reult, the canoncal form of the econd-order repone urface model. We tate that th form of the model produced a a reult of a tranlaton of the orgnal coded varable axe followed by rotaton of thee axe. It eay to demontrate that th true. Wrte the econd-order model a y = β + x β + x x Now tranlate the coded degn varable axe x to a new center, the tatonary pont, by mang the ubttuton z = x x. Th tranlaton produce y = β + ( z+ x ) β + ( z+ x ) ( z+ x ) = β + x β + x x + z β + z z+ x z + zz becaue from Equaton (-7) we have xz = z β. Now rotate thee new axe (z) o that they are parallel to the prncpal axe of the contour ytem. The new varable are w = M z, where MM = The dagonal matrx Λ ha the egenvalue of, λ, λ,, λ on the man dagonal and M a matrx of normalzed egenvector. Therefore, whch Equaton (-9). Λ y + zz + wmmz + w Λw + λ w = S-3. Center Pont n the Central Compote Degn In ecton -4, we dcu degn for fttng the econd-order model. The CCD a very mportant econd-order degn. We have gven ome recommendaton regardng the number of center run for the CCD; namely, 3 5generally gve good reult. The center run erve to tablze the predcton varance, mang t nearly contant over a broad regon near the center of the degn pace. To llutrate, uppoe that we are conderng a CCD n = varable but we only plan to run n c = center run. The followng graph of the tandardzed tandard devaton of the predcted repone wa obtaned from Degn-Expert: n c

DESIGN-EXPERT Plot ctual Factor: X = Y = StdErr of Ev aluaton.79.739.687.635.58 Notce that the plot of the predcton tandard devaton ha a large bump n the center. Th ndcate that the degn wll lead to a model that doe not predct accurately near the center of the regon of exploraton, a regon lely to be of nteret to the expermenter. Th the reult of ung an nuffcent number of center run. Suppoe that the number of center run ncreaed to n c = 4. The predcton tandard devaton plot now loo le th: DESIGN-EXPERT Plot ctual Factor: X = Y = StdErr of Ev aluaton.79.7.63.553.474

Notce that the addton of two more center run ha reulted n a much flatter (and hence more table) tandard devaton of predcted repone over the regon of nteret. The CCD a phercal degn. Generally, every degn on a phere mut have at leat one center pont or the XX matrx wll be ngular. However, the number of center pont can often nfluence other properte of the degn, uch a predcton varance. S-4. Center Run n the Face-Centered Cube The face-centered cube a CCD wth α = ; conequently, t a degn on a cube, t not a phercal degn. Th degn can be run wth a few a n c = center pont. The predcton tandard devaton for the cae = 3 hown below: DESIGN-EXPERT Plot ctual Factor: X = Y = ctual Contant: C = StdErr of Ev aluaton.855.789.7.656.589 Notce that depte the abence of center pont, the predcton tandard devaton relatvely contant n the center of the regon of exploraton. Note alo that the contour of contant predcton tandard devaton are not concentrc crcle, becaue th not a rotatable degn. Whle th degn wll certanly wor wth no center pont, th uually not a good choce. Two or three center pont generally gve good reult. elow a plot of the predcton tandard devaton for a face-centered cube wth two center pont. Th choce wor very well.

DESIGN-EXPERT Plot ctual Factor: X = Y = ctual Contant: C = StdErr of Ev aluaton.849.753.657.56.465 S-5. Note on Rotatablty Rotatablty a property of the predcton varance n a repone urface degn. If a degn rotatable, the predcton varance contant at all pont that are equdtant from the center of the degn. What not wdely nown that rotatablty depend on both the degn and the model. For example, f we have run a rotatable CCD and ft a reduced econd-order model, the varance contour are no longer phercal. To llutrate, below we how the tandardzed tandard devaton of predcton for a rotatable CCD wth =, but we have ft a reduced quadratc (one of the pure quadratc term mng). DESIGN-EXPERT Plot ctual Factor: X = Y = StdErr of Ev aluaton.775.675.575.475.375

Notce that the contour of predcton tandard devaton are not crcular, even though a rotatable degn wa ued.