Design of Screening Experiments with Partial Replication
|
|
- Albert Blair
- 5 years ago
- Views:
Transcription
1 Design of Screening Experiments with Partial Replication David J. Edwards Department of Statistical Sciences & Operations Research Virginia Commonwealth University Robert D. Leonard Department of Information Systems and Analytics Miami University DATAWorks March 21, 2018
2 Screening Experiments Screening Experiments are frequently utilized in the early stages of experimentation Goal of screening is to identify important main effects and perhaps some important two-factor interactions Typical screening designs are Unreplicated strength 2 or 3 orthogonal arrays Designs constructed using variance-based optimality criteria (such as D-optimality)
3 To Pool or Not to Pool That is the Question? Screening designs are usually unreplicated No unbiased estimate of experimental error. Inference is carried out by: A robust estimator for the error variance based on a fitted saturated model (e.g., Lenth s Pseudo Standard Error) Pooling sums of squares from terms identified as not active If statistical inference is an integral part of the analysis, one view is that inference should be performed using a pure error estimate versus the residual mean square from the fitted model.
4 Partial Replication From Lupinacci and Pigeon (2008, JQT): even in the initial stages of an experimental program, it might be desirable or even necessary for the experimenter to have a realistic estimate of the experimental error. Since full replication of an experiment may be quite costly, partial replication offers a costsaving alternative for obtaining a model independent error estimate.
5 Gilmour, S.G. and Trinca, L.A. (2012). Optimum Design of Experiments for Statistical Inference. Journal of the Royal Statistical Society, Series A, 61(3), Motivation
6 DP-optimality Based upon the formulation for the volume of a confidence interval region for β, which is proportional to F, ; / X X /, where p is the number of parameters in the assumed model, d is the pure error degrees of freedom, and F, ; is the 1 α -quantile of the F-distribution. The so-called DP-optimal design is then defined as that which maximizes X X / F, ;.
7 DP-optimality As inference is rarely performed on the intercept, it can be treated as a nuisance parameter and hence, the DP-optimal design maximizes X QX / F, ; where X is the model matrix without a column of ones, Q = I J, I is the n n identity matrix, and J is the n n matrix of ones.
8 DP-optimal Designs DP-optimal designs tend to have an excessive number of replicate runs and seem inefficient regarding the use of available degrees of freedom in screening situations. 7-factor, 24-run DP-optimal design with a priori main effects model. No lack-of-fit degrees of freedom!
9 Compound DP-optimality To overcome this potential deficiency and encourage the availability of degrees of freedom for testing lack-of-fit, Gilmour and Trinca (2012) propose to incorporate degree of freedom efficiency ( df = (n d)/n ) into the formulation of a compound criterion. For example, combining the DP-criterion with degrees of freedom efficiency, we maximize X QX n d F, ; where κ = (κ, κ ) are weights.
10 Compound DP-optimality This modification helps κ = 0.5, 0.5 produces a design with 8 degrees of freedom for pure error (df pe ) and 8 for lack-of-fit (df lof ). κ = 0.2, 0.8 has 5 df pe and 11 df lof Despite this, design construction still critically depends on the choice of a priori model.
11 Bayesian D-optimality DuMouchel and Jones (1994) Primary terms are those effects assumed to be active while potential terms may or may not be active Joint prior distribution of the unknown model parameters is β σ ~N 0, σ R, where R = K/τ is the prior covariance matrix and K = I The posterior distribution for β given y is given as β y ~ N X X + R X y, σ X X + R
12 Bayesian D- and DP-optimality A Bayesian D-optimal design, ξ, maximizes X X + R Extending the formulation of the DP-optimality criterion within the Bayesian framework, we suggest the Bayesian DP-optimality criterion which maximizes X QX + K τ F, ; where K = 0 ( ) ( 0 ( ) 0 ( I
13 Some Comparisons df pe df LoF D-eff DP-eff Design I (D-opt) Design II (BD-opt) Design III (DP-opt) Design IV (BDP-opt) cdp(0.5, 0.5) cdp(0.2, 0.8)
14 Protecting Against Model Misspecification Design I (D-opt) Design II (BD-opt) Design III (DP-opt) Design IV (BDP-opt) df pe df LoF D-eff DP-eff Primary & Primary & Potential & Primary Potential Potential tr(aa ) Correlation Correlation Correlation cdp(0.5, 0.5) cdp(0.2, 0.8) A = X X X X is the so-called alias matrix and trace(aa ) (to be minimized) can be viewed as a measure of the potential impact of bias
15 Additional Comparisons Example 1: Two-levels, 7-factors (MEs primary, 2FIs potential)
16 Additional Comparisons Example 2: 3-levels, 7-factors (MEs and Pure Quadratics primary and 2FIs potential)
17 Design Choices via Multiple Criteria It is possible for multiple designs to satisfy any given optimality criterion, in which case additional criteria may be used to further discriminate between choices of optimal designs. Lu et al. (2011, Technometrics) have shown that a suite of designs can be reduced to a smaller set of Pareto-optimal choices by combining multiple design criteria as a weighted sum of scaled criteria values.
18 Multiple Criteria Four sets of 100 designs are created using each of D-, DP-, Bayesian D-, and Bayesian DP-optimality. Criterion values (df pe, D-eff, and tr(aa )) are calculated for all nondominated designs and scaled so that the maximum value is one and minimum value is zero. Next, L norms are calculated as w f ξ f where f ξ, f ξ, f ξ are the scaled values, F = 1, 1, 0 since we wish to maximize both df pe and D-eff and minimize tr AA ; and w are weights For each choice of weight, the design which minimizes the L 1 norm is selected.,
19 Revisiting Example 1
20 Revisiting Example 1 df pe df LoF D-eff DP-eff Primary & Primary Correlation Primary & Potential Correlation Potential & Potential Correlation tr(aa ) Design I (D-opt) Design V (D-opt) Design VI (D-opt) Design IV (BDPopt) Design VII (BDPefficient)
21 Revisiting Example 2 Design VIII (D-opt) Design IX (DP-opt) Design X (BDP-efficient) df pe df LoF D-eff DP-eff Primary & Primary & Potential & Primary Potential Potential tr(aa ) Correlation Correlation Correlation
22 Worth mentioning? Common practice in response surface experiments to replicate center point runs in order to obtain a model independent estimate of error. To generate the designs in this study, the full 3 7 factorial was utilized as the candidate set of points. Out of the run designs, none of them include a center point run.
23 Simulation Protocol For each of 2000 iterations: 1. Randomly assign columns of the design matrix to be active (2-5). 2. Randomly assign two-factor interactions to be active based on the weak effect heredity principle (i.e., a two-factor interaction is active only if one or more of its parent main effects are active) (0-7). 3. Select the coefficient vector (β) for the active effects. Two scenarios are considered: a. Equal: Randomly assign coefficients for each of the active effects from (±1, ±1.5, ±2, ±2.5, ±3, ±3.5). b. Smaller: Randomly assign coefficients for the main effects from (±2, ±2.5, ±3, ±3.5) and the two-factor interactions from (±1, ±1.5, ±2). More likely to represent what is observed in practice (effect hierarchy). 4. Generate the response vector as y = X A β + ε, where X is the matrix consisting of the active effect columns and each ε is simulated from a standard normal distribution.
24 Simulation Protocol (cont.) 5. Fit the primary model (in this case, a main effects only model) to the simulated data and determine the set of active effects. This is accomplished by: a. If a pure error estimate is available, statistical inference is performed using the mean square pure error (MSPE). Usual t- statistics are computed as β / / var β where var β = MSPE X X 1 and p-values computed based on a t- ii distribution with df pe ; α=0.05 is used for selection of active effects. b. If a pure error estimate is not available, statistical inference is performed using the residual mean square from the fitted model. 6. If a pure error estimate is available, perform a lack-of-fit test via the usual F- statistic with df LoF numerator and df pe denominator degrees of freedom.
25 Simulation Protocol (cont.) At the end of the 2000 iterations, the average proportion of correctly identified active main effects (power) and the average proportion of main effects declared active which were actually inactive (false discovery rate) are calculated. Also calculate the power for detecting lack-of-fit by reporting the proportion of simulations in which lack-of-fit was correctly identified. 25
26 Some (Abbreviated) Results
27 An Aside: Pure Error and False Discovery (Variable Selection)
28 An Aside: Pure Error and False Discovery (Variable Selection)
29 Final Comments Proposed a Bayesian modification to the DP-criterion to allow for the construction of optimal designs that provide some safeguard against misspecification of the a priori model as well as the ability to obtain a model independent estimate of σ for conducting statistical inference. Examples illustrate that the proposed designs are a compromise between traditional Bayesian D-optimal designs, which rarely provide replicate points, and DPoptimal designs, which tend to over-replicate. The Pareto front approach and multiple design criterion also help to demonstrate the compromising effect of Bayesian DP-optimal designs.
30 Thanks for your attention! Any questions?
Selecting an Orthogonal or Nonorthogonal Two-Level Design for Screening
Selecting an Orthogonal or Nonorthogonal Two-Level Design for Screening David J. Edwards 1 (with Robert W. Mee 2 and Eric D. Schoen 3 ) 1 Virginia Commonwealth University, Richmond, VA 2 University of
More informationSearching for Powerful Supersaturated Designs
Searching for Powerful Supersaturated Designs MARIA L. WEESE Miami University, Oxford, OH 45056 BYRAN J. SMUCKER Miami University, Oxford, OH 45056 DAVID J. EDWARDS Virginia Commonwealth University, Richmond,
More informationStat 5101 Lecture Notes
Stat 5101 Lecture Notes Charles J. Geyer Copyright 1998, 1999, 2000, 2001 by Charles J. Geyer May 7, 2001 ii Stat 5101 (Geyer) Course Notes Contents 1 Random Variables and Change of Variables 1 1.1 Random
More informationOPTIMIZATION OF FIRST ORDER MODELS
Chapter 2 OPTIMIZATION OF FIRST ORDER MODELS One should not multiply explanations and causes unless it is strictly necessary William of Bakersville in Umberto Eco s In the Name of the Rose 1 In Response
More informationA Comparison Of Design And. Model Selection Methods. For Supersaturated Experiments
Working Paper M09/20 Methodology A Comparison Of Design And Model Selection Methods For Supersaturated Experiments Christopher J. Marley, David C. Woods Abstract Various design and model selection methods
More informationAnalysis of Orthogonal Saturated Designs
Analysis of Orthogonal Saturated Designs Daniel T. Voss and Weizhen Wang This chapter provides a review of special methods for analyzing data from screening experiments conducted using regular fractional
More informationSELC : Sequential Elimination of Level Combinations by Means of Modified Genetic Algorithms
SELC : Sequential Elimination of Level Combinations by Means of Modified Genetic Algorithms Revision submitted to Technometrics Abhyuday Mandal Ph.D. Candidate School of Industrial and Systems Engineering
More informationA General Criterion for Factorial Designs Under Model Uncertainty
A General Criterion for Factorial Designs Under Model Uncertainty Steven Gilmour Queen Mary University of London http://www.maths.qmul.ac.uk/ sgg and Pi-Wen Tsai National Taiwan Normal University Fall
More informationA Criterion for Constructing Powerful Supersaturated Designs when Effect Directions are Known
A Criterion for Constructing Powerful Supersaturated Designs when Effect Directions are Known Maria L. Weese 1, David J. Edwards 2, and Byran J. Smucker 3 1 Department of Information Systems and Analytics,
More informationTwo-Level Designs to Estimate All Main Effects and Two-Factor Interactions
Technometrics ISSN: 0040-1706 (Print) 1537-2723 (Online) Journal homepage: http://www.tandfonline.com/loi/utch20 Two-Level Designs to Estimate All Main Effects and Two-Factor Interactions Pieter T. Eendebak
More informationProblems. Suppose both models are fitted to the same data. Show that SS Res, A SS Res, B
Simple Linear Regression 35 Problems 1 Consider a set of data (x i, y i ), i =1, 2,,n, and the following two regression models: y i = β 0 + β 1 x i + ε, (i =1, 2,,n), Model A y i = γ 0 + γ 1 x i + γ 2
More informationResponse Surface Methodology
Response Surface Methodology Process and Product Optimization Using Designed Experiments Second Edition RAYMOND H. MYERS Virginia Polytechnic Institute and State University DOUGLAS C. MONTGOMERY Arizona
More informationDESIGNING EXPERIMENTS AND ANALYZING DATA A Model Comparison Perspective
DESIGNING EXPERIMENTS AND ANALYZING DATA A Model Comparison Perspective Second Edition Scott E. Maxwell Uniuersity of Notre Dame Harold D. Delaney Uniuersity of New Mexico J,t{,.?; LAWRENCE ERLBAUM ASSOCIATES,
More informationResponse Surface Methodology:
Response Surface Methodology: Process and Product Optimization Using Designed Experiments RAYMOND H. MYERS Virginia Polytechnic Institute and State University DOUGLAS C. MONTGOMERY Arizona State University
More informationDEPARTMENT OF ENGINEERING MANAGEMENT. Two-level designs to estimate all main effects and two-factor interactions. Pieter T. Eendebak & Eric D.
DEPARTMENT OF ENGINEERING MANAGEMENT Two-level designs to estimate all main effects and two-factor interactions Pieter T. Eendebak & Eric D. Schoen UNIVERSITY OF ANTWERP Faculty of Applied Economics City
More informationTWO-LEVEL FACTORIAL EXPERIMENTS: IRREGULAR FRACTIONS
STAT 512 2-Level Factorial Experiments: Irregular Fractions 1 TWO-LEVEL FACTORIAL EXPERIMENTS: IRREGULAR FRACTIONS A major practical weakness of regular fractional factorial designs is that N must be a
More informationidentify only a few factors (possibly none) with dispersion eects and a larger number of factors with location eects on the transformed response. Tagu
A simulation study on the choice of transformations in Taguchi experiments M. Erdbrugge and J. Kunert University of Dortmund, Department of Statistics, Vogelpothsweg 87, D-44221, Germany ferdbruegge, Kunertg@statistik.uni-dortmund.de
More informationeqr014 Lenth s Method for the Analysis of Unreplicated Experiments
eqr014 Lenth s Method for the Analysis of Unreplicated Experiments Russell V. Lenth Department of Statistics and Actuarial Science The University of Iowa Iowa City, IA USA 52242 Voice 319-335-0814 FAX
More informationExperimental Design and Data Analysis for Biologists
Experimental Design and Data Analysis for Biologists Gerry P. Quinn Monash University Michael J. Keough University of Melbourne CAMBRIDGE UNIVERSITY PRESS Contents Preface page xv I I Introduction 1 1.1
More informationAccounting for Population Uncertainty in Covariance Structure Analysis
Accounting for Population Uncertainty in Structure Analysis Boston College May 21, 2013 Joint work with: Michael W. Browne The Ohio State University matrix among observed variables are usually implied
More informationA-optimal Minimax Design Criterion for. Two-level Fractional Factorial Designs
A-optimal Minimax Design Criterion for Two-level Fractional Factorial Designs by Yue Yin BA. Beijing Institute of Technology 2011 A Thesis Submitted in Partial Fullfillment of the Requirements for the
More informationDefinitive Screening Designs
Definitive Screening Designs Bradley Jones September 2011 Copyright 2008, SAS Institute Inc. All rights reserved. Joint work with Chris Nachtsheim Outline 1. Motivation 2. Design Structure 3. Design Construction
More informationChapter 1 Statistical Inference
Chapter 1 Statistical Inference causal inference To infer causality, you need a randomized experiment (or a huge observational study and lots of outside information). inference to populations Generalizations
More informationUseful Numerical Statistics of Some Response Surface Methodology Designs
Journal of Mathematics Research; Vol. 8, No. 4; August 20 ISSN 19-9795 E-ISSN 19-9809 Published by Canadian Center of Science and Education Useful Numerical Statistics of Some Response Surface Methodology
More informationChemometrics. Matti Hotokka Physical chemistry Åbo Akademi University
Chemometrics Matti Hotokka Physical chemistry Åbo Akademi University Linear regression Experiment Consider spectrophotometry as an example Beer-Lamberts law: A = cå Experiment Make three known references
More informationUnit 6: Fractional Factorial Experiments at Three Levels
Unit 6: Fractional Factorial Experiments at Three Levels Larger-the-better and smaller-the-better problems. Basic concepts for 3 k full factorial designs. Analysis of 3 k designs using orthogonal components
More informationTwo-Stage Computing Budget Allocation. Approach for Response Surface Method PENG JI
Two-Stage Computing Budget Allocation Approach for Response Surface Method PENG JI NATIONAL UNIVERSITY OF SINGAPORE 2005 Two-Stage Computing Budget Allocation Approach for Response Surface Method PENG
More informationVariable Selection and Model Building
LINEAR REGRESSION ANALYSIS MODULE XIII Lecture - 37 Variable Selection and Model Building Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur The complete regression
More informationUnit 5: Fractional Factorial Experiments at Two Levels
Unit 5: Fractional Factorial Experiments at Two Levels Source : Chapter 4 (sections 4.1-4.3, 4.4.1, 4.4.3, 4.5, part of 4.6). Effect aliasing, resolution, minimum aberration criteria. Analysis. Techniques
More information2 Analysis of Full Factorial Experiments
2 Analysis of Full Factorial Experiments This chapter details how to analyze 2 k factorial experiments and is organized as follows: Section 2.1. Analysis Strategy Overview Section 2.2. Analysis of Numerical
More informationDESIGN AND ANALYSIS OF EXPERIMENTS Third Edition
DESIGN AND ANALYSIS OF EXPERIMENTS Third Edition Douglas C. Montgomery ARIZONA STATE UNIVERSITY JOHN WILEY & SONS New York Chichester Brisbane Toronto Singapore Contents Chapter 1. Introduction 1-1 What
More informationSupplementary Material for Wang and Serfling paper
Supplementary Material for Wang and Serfling paper March 6, 2017 1 Simulation study Here we provide a simulation study to compare empirically the masking and swamping robustness of our selected outlyingness
More informationSearching for D-E cient Equivalent-Estimation Second-Order Split-Plot Designs
Searching for D-E cient Equivalent-Estimation Second-Order Split-Plot Designs NAM-KY NGUYEN VIASM and VNU International School, Hanoi, Vietnam TUNG-DINH PHAM VNU University of Science, Hanoi, Vietnam Several
More information3.4. A computer ANOVA output is shown below. Fill in the blanks. You may give bounds on the P-value.
3.4. A computer ANOVA output is shown below. Fill in the blanks. You may give bounds on the P-value. One-way ANOVA Source DF SS MS F P Factor 3 36.15??? Error??? Total 19 196.04 Completed table is: One-way
More informationStatistical Data Analysis Stat 3: p-values, parameter estimation
Statistical Data Analysis Stat 3: p-values, parameter estimation London Postgraduate Lectures on Particle Physics; University of London MSci course PH4515 Glen Cowan Physics Department Royal Holloway,
More informationUnit 20: Planning Accelerated Life Tests
Unit 20: Planning Accelerated Life Tests Ramón V. León Notes largely based on Statistical Methods for Reliability Data by W.Q. Meeker and L. A. Escobar, Wiley, 1998 and on their class notes. 11/13/2004
More informationModel Selection Tutorial 2: Problems With Using AIC to Select a Subset of Exposures in a Regression Model
Model Selection Tutorial 2: Problems With Using AIC to Select a Subset of Exposures in a Regression Model Centre for Molecular, Environmental, Genetic & Analytic (MEGA) Epidemiology School of Population
More informationOptimal design of experiments
Optimal design of experiments Session 4: Some theory Peter Goos / 40 Optimal design theory continuous or approximate optimal designs implicitly assume an infinitely large number of observations are available
More informationApproximate analysis of covariance in trials in rare diseases, in particular rare cancers
Approximate analysis of covariance in trials in rare diseases, in particular rare cancers Stephen Senn (c) Stephen Senn 1 Acknowledgements This work is partly supported by the European Union s 7th Framework
More informationDesign of Experiments SUTD 06/04/2016 1
Design of Experiments SUTD 06/04/2016 1 Outline 1. Introduction 2. 2 k Factorial Design 3. Choice of Sample Size 4. 2 k p Fractional Factorial Design 5. Follow-up experimentation (folding over) with factorial
More informationA Practitioner s Guide to Cluster-Robust Inference
A Practitioner s Guide to Cluster-Robust Inference A. C. Cameron and D. L. Miller presented by Federico Curci March 4, 2015 Cameron Miller Cluster Clinic II March 4, 2015 1 / 20 In the previous episode
More informationPrincipal component analysis
Principal component analysis Motivation i for PCA came from major-axis regression. Strong assumption: single homogeneous sample. Free of assumptions when used for exploration. Classical tests of significance
More informationModel comparison and selection
BS2 Statistical Inference, Lectures 9 and 10, Hilary Term 2008 March 2, 2008 Hypothesis testing Consider two alternative models M 1 = {f (x; θ), θ Θ 1 } and M 2 = {f (x; θ), θ Θ 2 } for a sample (X = x)
More informationThird European DOE User Meeting, Luzern 2010
Correcting for multiple testing Old tricks, state-of-the-art solutions and common sense Ivan Langhans CQ Consultancy CQ Consultancy Expertise in Chemometrics; the interaction between Chemistry and Statistics
More informationClasses of Second-Order Split-Plot Designs
Classes of Second-Order Split-Plot Designs DATAWorks 2018 Springfield, VA Luis A. Cortés, Ph.D. The MITRE Corporation James R. Simpson, Ph.D. JK Analytics, Inc. Peter Parker, Ph.D. NASA 22 March 2018 Outline
More informationMinimax design criterion for fractional factorial designs
Ann Inst Stat Math 205 67:673 685 DOI 0.007/s0463-04-0470-0 Minimax design criterion for fractional factorial designs Yue Yin Julie Zhou Received: 2 November 203 / Revised: 5 March 204 / Published online:
More informationRegression: Lecture 2
Regression: Lecture 2 Niels Richard Hansen April 26, 2012 Contents 1 Linear regression and least squares estimation 1 1.1 Distributional results................................ 3 2 Non-linear effects and
More informationF & B Approaches to a simple model
A6523 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Spring 215 http://www.astro.cornell.edu/~cordes/a6523 Lecture 11 Applications: Model comparison Challenges in large-scale surveys
More informationTesting for Regime Switching in Singaporean Business Cycles
Testing for Regime Switching in Singaporean Business Cycles Robert Breunig School of Economics Faculty of Economics and Commerce Australian National University and Alison Stegman Research School of Pacific
More informationExperimental design. Matti Hotokka Department of Physical Chemistry Åbo Akademi University
Experimental design Matti Hotokka Department of Physical Chemistry Åbo Akademi University Contents Elementary concepts Regression Validation Design of Experiments Definitions Random sampling Factorial
More informationStat 890 Design of computer experiments
Stat 890 Design of computer experiments Will introduce design concepts for computer experiments Will look at more elaborate constructions next day Experiment design In computer experiments, as in many
More informationLinear Models 1. Isfahan University of Technology Fall Semester, 2014
Linear Models 1 Isfahan University of Technology Fall Semester, 2014 References: [1] G. A. F., Seber and A. J. Lee (2003). Linear Regression Analysis (2nd ed.). Hoboken, NJ: Wiley. [2] A. C. Rencher and
More informationI-Optimal Versus D-Optimal Split-Plot Response Surface Designs
I-Optimal Versus D-Optimal Split-Plot Response Surface Designs BRADLEY JONES SAS Institute and Universiteit Antwerpen PETER GOOS Universiteit Antwerpen and Erasmus Universiteit Rotterdam Response surface
More informationResearch Article A Nonparametric Two-Sample Wald Test of Equality of Variances
Advances in Decision Sciences Volume 211, Article ID 74858, 8 pages doi:1.1155/211/74858 Research Article A Nonparametric Two-Sample Wald Test of Equality of Variances David Allingham 1 andj.c.w.rayner
More informationFöreläsning /31
1/31 Föreläsning 10 090420 Chapter 13 Econometric Modeling: Model Speci cation and Diagnostic testing 2/31 Types of speci cation errors Consider the following models: Y i = β 1 + β 2 X i + β 3 X 2 i +
More informationACCELERATED DESTRUCTIVE DEGRADATION TEST PLANNING. Presented by Luis A. Escobar Experimental Statistics LSU, Baton Rouge LA 70803
ACCELERATED DESTRUCTIVE DEGRADATION TEST PLANNING Presented by Luis A. Escobar Experimental Statistics LSU, Baton Rouge LA 70803 This is jointly work with Ying Shi and William Q. Meeker both from Iowa
More informationA General Criterion for Factorial Designs Under Model Uncertainty
A General Criterion for Factorial Designs Under Model Uncertainty Pi-Wen Tsai Department of Mathematics National Taiwan Normal University Taipei 116, Taiwan, R.O.C. E-mail: pwtsai@math.ntnu.edu.tw Steven
More informationHANDBOOK OF APPLICABLE MATHEMATICS
HANDBOOK OF APPLICABLE MATHEMATICS Chief Editor: Walter Ledermann Volume VI: Statistics PART A Edited by Emlyn Lloyd University of Lancaster A Wiley-Interscience Publication JOHN WILEY & SONS Chichester
More informationUnit 12: Response Surface Methodology and Optimality Criteria
Unit 12: Response Surface Methodology and Optimality Criteria STA 643: Advanced Experimental Design Derek S. Young 1 Learning Objectives Revisit your knowledge of polynomial regression Know how to use
More informationStat 5102 Final Exam May 14, 2015
Stat 5102 Final Exam May 14, 2015 Name Student ID The exam is closed book and closed notes. You may use three 8 1 11 2 sheets of paper with formulas, etc. You may also use the handouts on brand name distributions
More informationSOME NEW THREE-LEVEL ORTHOGONAL MAIN EFFECTS PLANS ROBUST TO MODEL UNCERTAINTY
Statistica Sinica 14(2004), 1075-1084 SOME NEW THREE-LEVEL ORTHOGONAL MAIN EFFECTS PLANS ROBUST TO MODEL UNCERTAINTY Pi-Wen Tsai, Steven G. Gilmour and Roger Mead National Health Research Institutes, Queen
More informationISyE 691 Data mining and analytics
ISyE 691 Data mining and analytics Regression Instructor: Prof. Kaibo Liu Department of Industrial and Systems Engineering UW-Madison Email: kliu8@wisc.edu Office: Room 3017 (Mechanical Engineering Building)
More informationG. S. Maddala Kajal Lahiri. WILEY A John Wiley and Sons, Ltd., Publication
G. S. Maddala Kajal Lahiri WILEY A John Wiley and Sons, Ltd., Publication TEMT Foreword Preface to the Fourth Edition xvii xix Part I Introduction and the Linear Regression Model 1 CHAPTER 1 What is Econometrics?
More information10.0 REPLICATED FULL FACTORIAL DESIGN
10.0 REPLICATED FULL FACTORIAL DESIGN (Updated Spring, 001) Pilot Plant Example ( 3 ), resp - Chemical Yield% Lo(-1) Hi(+1) Temperature 160 o 180 o C Concentration 10% 40% Catalyst A B Test# Temp Conc
More informationThe Distribution of F
The Distribution of F It can be shown that F = SS Treat/(t 1) SS E /(N t) F t 1,N t,λ a noncentral F-distribution with t 1 and N t degrees of freedom and noncentrality parameter λ = t i=1 n i(µ i µ) 2
More informationMixed-Models. version 30 October 2011
Mixed-Models version 30 October 2011 Mixed models Mixed models estimate a vector! of fixed effects and one (or more) vectors u of random effects Both fixed and random effects models always include a vector
More informationMath 423/533: The Main Theoretical Topics
Math 423/533: The Main Theoretical Topics Notation sample size n, data index i number of predictors, p (p = 2 for simple linear regression) y i : response for individual i x i = (x i1,..., x ip ) (1 p)
More informationWiley. Methods and Applications of Linear Models. Regression and the Analysis. of Variance. Third Edition. Ishpeming, Michigan RONALD R.
Methods and Applications of Linear Models Regression and the Analysis of Variance Third Edition RONALD R. HOCKING PenHock Statistical Consultants Ishpeming, Michigan Wiley Contents Preface to the Third
More informationThe legacy of Sir Ronald A. Fisher. Fisher s three fundamental principles: local control, replication, and randomization.
1 Chapter 1: Research Design Principles The legacy of Sir Ronald A. Fisher. Fisher s three fundamental principles: local control, replication, and randomization. 2 Chapter 2: Completely Randomized Design
More informationMultivariate Statistical Analysis
Multivariate Statistical Analysis Fall 2011 C. L. Williams, Ph.D. Lecture 9 for Applied Multivariate Analysis Outline Two sample T 2 test 1 Two sample T 2 test 2 Analogous to the univariate context, we
More informationFirst Year Examination Department of Statistics, University of Florida
First Year Examination Department of Statistics, University of Florida August 20, 2009, 8:00 am - 2:00 noon Instructions:. You have four hours to answer questions in this examination. 2. You must show
More informationRegression. Estimation of the linear function (straight line) describing the linear component of the joint relationship between two variables X and Y.
Regression Bivariate i linear regression: Estimation of the linear function (straight line) describing the linear component of the joint relationship between two variables and. Generally describe as a
More informationPhysics 403. Segev BenZvi. Parameter Estimation, Correlations, and Error Bars. Department of Physics and Astronomy University of Rochester
Physics 403 Parameter Estimation, Correlations, and Error Bars Segev BenZvi Department of Physics and Astronomy University of Rochester Table of Contents 1 Review of Last Class Best Estimates and Reliability
More informationRegression Analysis. Simple Regression Multivariate Regression Stepwise Regression Replication and Prediction Error EE290H F05
Regression Analysis Simple Regression Multivariate Regression Stepwise Regression Replication and Prediction Error 1 Regression Analysis In general, we "fit" a model by minimizing a metric that represents
More informationPreface Introduction to Statistics and Data Analysis Overview: Statistical Inference, Samples, Populations, and Experimental Design The Role of
Preface Introduction to Statistics and Data Analysis Overview: Statistical Inference, Samples, Populations, and Experimental Design The Role of Probability Sampling Procedures Collection of Data Measures
More informationA nonparametric two-sample wald test of equality of variances
University of Wollongong Research Online Faculty of Informatics - Papers (Archive) Faculty of Engineering and Information Sciences 211 A nonparametric two-sample wald test of equality of variances David
More informationSymmetries in Experimental Design and Group Lasso Kentaro Tanaka and Masami Miyakawa
Symmetries in Experimental Design and Group Lasso Kentaro Tanaka and Masami Miyakawa Workshop on computational and algebraic methods in statistics March 3-5, Sanjo Conference Hall, Hongo Campus, University
More informationAnalysis Methods for Supersaturated Design: Some Comparisons
Journal of Data Science 1(2003), 249-260 Analysis Methods for Supersaturated Design: Some Comparisons Runze Li 1 and Dennis K. J. Lin 2 The Pennsylvania State University Abstract: Supersaturated designs
More informationSupporting Information for Estimating restricted mean. treatment effects with stacked survival models
Supporting Information for Estimating restricted mean treatment effects with stacked survival models Andrew Wey, David Vock, John Connett, and Kyle Rudser Section 1 presents several extensions to the simulation
More informationOptimal Selection of Blocked Two-Level. Fractional Factorial Designs
Applied Mathematical Sciences, Vol. 1, 2007, no. 22, 1069-1082 Optimal Selection of Blocked Two-Level Fractional Factorial Designs Weiming Ke Department of Mathematics and Statistics South Dakota State
More informationSTATS 200: Introduction to Statistical Inference. Lecture 29: Course review
STATS 200: Introduction to Statistical Inference Lecture 29: Course review Course review We started in Lecture 1 with a fundamental assumption: Data is a realization of a random process. The goal throughout
More informationPractice Problems Section Problems
Practice Problems Section 4-4-3 4-4 4-5 4-6 4-7 4-8 4-10 Supplemental Problems 4-1 to 4-9 4-13, 14, 15, 17, 19, 0 4-3, 34, 36, 38 4-47, 49, 5, 54, 55 4-59, 60, 63 4-66, 68, 69, 70, 74 4-79, 81, 84 4-85,
More informationFeature selection and classifier performance in computer-aided diagnosis: The effect of finite sample size
Feature selection and classifier performance in computer-aided diagnosis: The effect of finite sample size Berkman Sahiner, a) Heang-Ping Chan, Nicholas Petrick, Robert F. Wagner, b) and Lubomir Hadjiiski
More informationStat/F&W Ecol/Hort 572 Review Points Ané, Spring 2010
1 Linear models Y = Xβ + ɛ with ɛ N (0, σ 2 e) or Y N (Xβ, σ 2 e) where the model matrix X contains the information on predictors and β includes all coefficients (intercept, slope(s) etc.). 1. Number of
More informationA COMPARISON OF LOCATION EFFECT IDENTIFICATION METHODS FOR UNREPLICATED FRACTIONAL FACTORIALS IN THE PRESENCE OF DISPERSION EFFECTS
A COMPARISON OF LOCATION EFFECT IDENTIFICATION METHODS FOR UNREPLICATED FRACTIONAL FACTORIALS IN THE PRESENCE OF DISPERSION EFFECTS by Yan Zhang B.Sci., Beihang University, 2008 a Thesis submitted in partial
More informationRidge regression. Patrick Breheny. February 8. Penalized regression Ridge regression Bayesian interpretation
Patrick Breheny February 8 Patrick Breheny High-Dimensional Data Analysis (BIOS 7600) 1/27 Introduction Basic idea Standardization Large-scale testing is, of course, a big area and we could keep talking
More informationFrom Practical Data Analysis with JMP, Second Edition. Full book available for purchase here. About This Book... xiii About The Author...
From Practical Data Analysis with JMP, Second Edition. Full book available for purchase here. Contents About This Book... xiii About The Author... xxiii Chapter 1 Getting Started: Data Analysis with JMP...
More informationDesign of Engineering Experiments Part 5 The 2 k Factorial Design
Design of Engineering Experiments Part 5 The 2 k Factorial Design Text reference, Special case of the general factorial design; k factors, all at two levels The two levels are usually called low and high
More informationMultivariate Regression
Multivariate Regression The so-called supervised learning problem is the following: we want to approximate the random variable Y with an appropriate function of the random variables X 1,..., X p with the
More informationContents. Preface to Second Edition Preface to First Edition Abbreviations PART I PRINCIPLES OF STATISTICAL THINKING AND ANALYSIS 1
Contents Preface to Second Edition Preface to First Edition Abbreviations xv xvii xix PART I PRINCIPLES OF STATISTICAL THINKING AND ANALYSIS 1 1 The Role of Statistical Methods in Modern Industry and Services
More informationLinear Regression Models
Linear Regression Models Model Description and Model Parameters Modelling is a central theme in these notes. The idea is to develop and continuously improve a library of predictive models for hazards,
More informationINTRODUCTION TO DESIGN AND ANALYSIS OF EXPERIMENTS
GEORGE W. COBB Mount Holyoke College INTRODUCTION TO DESIGN AND ANALYSIS OF EXPERIMENTS Springer CONTENTS To the Instructor Sample Exam Questions To the Student Acknowledgments xv xxi xxvii xxix 1. INTRODUCTION
More informationBIAS-ROBUSTNESS AND EFFICIENCY OF MODEL-BASED INFERENCE IN SURVEY SAMPLING
Statistica Sinica 22 (2012), 777-794 doi:http://dx.doi.org/10.5705/ss.2010.238 BIAS-ROBUSTNESS AND EFFICIENCY OF MODEL-BASED INFERENCE IN SURVEY SAMPLING Desislava Nedyalova and Yves Tillé University of
More informationThe Linear Regression Model
The Linear Regression Model Carlo Favero Favero () The Linear Regression Model 1 / 67 OLS To illustrate how estimation can be performed to derive conditional expectations, consider the following general
More information2.830J / 6.780J / ESD.63J Control of Manufacturing Processes (SMA 6303) Spring 2008
MIT OpenCourseWare http://ocw.mit.edu 2.830J / 6.780J / ESD.63J Control of Processes (SMA 6303) Spring 2008 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms.
More informationBayesian Linear Regression
Bayesian Linear Regression Sudipto Banerjee 1 Biostatistics, School of Public Health, University of Minnesota, Minneapolis, Minnesota, U.S.A. September 15, 2010 1 Linear regression models: a Bayesian perspective
More informationOn Mixture Regression Shrinkage and Selection via the MR-LASSO
On Mixture Regression Shrinage and Selection via the MR-LASSO Ronghua Luo, Hansheng Wang, and Chih-Ling Tsai Guanghua School of Management, Peing University & Graduate School of Management, University
More informationCHAPTER 6 A STUDY ON DISC BRAKE SQUEAL USING DESIGN OF EXPERIMENTS
134 CHAPTER 6 A STUDY ON DISC BRAKE SQUEAL USING DESIGN OF EXPERIMENTS 6.1 INTRODUCTION In spite of the large amount of research work that has been carried out to solve the squeal problem during the last
More informationRelated Concepts: Lecture 9 SEM, Statistical Modeling, AI, and Data Mining. I. Terminology of SEM
Lecture 9 SEM, Statistical Modeling, AI, and Data Mining I. Terminology of SEM Related Concepts: Causal Modeling Path Analysis Structural Equation Modeling Latent variables (Factors measurable, but thru
More informationShort Note: Naive Bayes Classifiers and Permanence of Ratios
Short Note: Naive Bayes Classifiers and Permanence of Ratios Julián M. Ortiz (jmo1@ualberta.ca) Department of Civil & Environmental Engineering University of Alberta Abstract The assumption of permanence
More information