Design and Analysis of Simulation Experiments

Size: px
Start display at page:

Download "Design and Analysis of Simulation Experiments"

Transcription

1 Jack P.C. Kleijnen Design and Analysis of Simulation Experiments Second Edition ~Springer

2 Contents Preface vii 1 Introduction What Is Simulation? What Is "Design and Analysis of Simulation Experiments" (DASE)? DASE Symbols and Terminology 12 Solutions for Exercises 16 References Classic Regression Metamodels and Their Designs Introduction Linear Regression Basic Linear Regression Analysis Advanced Linear Regression Analysis Linear Regression: First-Order Polynomials Scaling the Inputs One-Factor-at-a-Time Designs Versus Factorial Designs Designs for First-Order Polynomials: Resolution-III k-p Designs of Resolution-III Plackett-Burman Designs of Resolution-III. 54 xi

3 xii Contents 2.5 Linear Regression: Interactions Designs Allowing Two-Factor Interactions: Resolution-IV Designs for Two-Factor Interactions: Resolution-V Linear Regression: Second-Order Polynomials Designs for Second-Degree Polynomials: Central Composite Designs Optimal Designsand Other Designs Optimal Designs More Design Types Conclusions Solutions for Exercises 73 References Classic Assumptions Versus Simulation Practice Introduction Multivariate Output Linear Regression Metamodels Designs for Multivariate Simulation Output Nonnormal Output Realistic Normality Assumption? Testing the Normality Assumption Normalizing Transformations Jackknifing Bootstrapping Heterogeneous Output Variances Realistic Constant Variance Assumption? Testing for Constant Variances Variance Stabilizing Transformations Least Squares Estimators Designs for Heterogeneous Output Variances Common Random Numbers (CRN) Validation of Metamodels The Coefficients of Determination R 2 and R!ij Cross-Validation Transformations of Regression Variables Adding High-Order Terms Conclusions Solutions for Exercises 123 References Screening the Many Inputs of Realistic Simulation Models Introduction Sequential Bifurcation (SB) for Deterministic Simulations and First-Order Polynomial Metamodels. 139

4 Contents xiii 4.3 SB for Deterministic Simulations and Second-Order Polynomial Metamodels SB for Random Simulations and Constant Number of Replications The SB Method Case Study: Ericsson's Supply Cbain SB for Random Simulations and Variable Number of Replications Monte Carlo Experiment with SPRT Multiresponse SB: MSB Monte Carlo Experiments with MSB and SB Case Study: Chinese Supply-Chain Validating the SB and MSB Assumptions Conclusions Solutions for Exercises 173 References Kriging Metamodels and Their D esigns Introduction Ordinary Kriging (OK) in Deterministic Simulation OK Basics Estimating the OK Parameters Bootstrapping and Conditional Simulation for OK in Deterministic Simulation Bootstrapped OK (BOK) Conditional Simulation of OK (CSOK) Universal Kriging (UK) in Deterministic Simulation Designs for Deterministic Simulation Latin Hypercube Sampling (LHS) Sequential Customized Designs Stochastic Kriging (SK) in Random Simulation A Metamodel for SK Designs for SK Monotonie Kriging: Bootstrapping and Acceptance/ Rejection Global Sensitivity Analysis: Sobol's FANOVA Risk Analysis Miscellaneous Issues in Kriging Conclusions Solutions for Exercises 224 References

5 xiv Contents 6 Simulation Optimization 6.1 Introduction Linear Regression for Optimization Response Surface Methodology (RSM): Basics RSM in Random Simulation Adapted Steepest Descent (ASD) for RSM Multiple Responses: Generalized RSM (GRSM) Testing a GRSM Optimum: Karush-Kuhn-Tucker (KKT) conditions Kriging Metamodels for Optimization Effi.cient Global Optimization (EGO) Kriging and Integer Mathematical Programming (KrIMP) Robust Optimization Taguchian Robust Optimization Through RSM Taguchian Robust Optimization Through Kriging Ben-Tal et al. 's Robust Optimization. 6.5 Conclusions... Solutions for Exercises References.... Author Index Subject Index

DESIGN OF EXPERIMENTS: OVERVIEW. Jack P.C. Kleijnen. Tilburg University Faculty of Economics and Business Administration Tilburg, THE NETHERLANDS

DESIGN OF EXPERIMENTS: OVERVIEW. Jack P.C. Kleijnen. Tilburg University Faculty of Economics and Business Administration Tilburg, THE NETHERLANDS Proceedings of the 2008 Winter Simulation Conference S. J. Mason, R. R. Hill, L. Mönch, O. Rose, T. Jefferson, J. W. Fowler eds. DESIGN OF EXPERIMENTS: OVERVIEW Jack P.C. Kleijnen Tilburg University Faculty

More information

Tilburg University. Response Surface Methodology Kleijnen, J.P.C. Publication date: Link to publication

Tilburg University. Response Surface Methodology Kleijnen, J.P.C. Publication date: Link to publication Tilburg University Response Surface Methodology Kleijnen, J.P.C. Publication date: 2014 Link to publication Citation for published version (APA): Kleijnen, J. P. C. (2014). Response Surface Methodology.

More information

Response Surface Methodology

Response Surface Methodology Response Surface Methodology Process and Product Optimization Using Designed Experiments Second Edition RAYMOND H. MYERS Virginia Polytechnic Institute and State University DOUGLAS C. MONTGOMERY Arizona

More information

Tilburg University. Design and Analysis of simulation experiments Kleijnen, Jack. Document version: Early version, also known as pre-print

Tilburg University. Design and Analysis of simulation experiments Kleijnen, Jack. Document version: Early version, also known as pre-print Tilburg University Design and Analysis of simulation experiments Kleijnen, Jack Document version: Early version, also known as pre-print Publication date: 2017 Link to publication Citation for published

More information

Simulation optimization via bootstrapped Kriging: Survey

Simulation optimization via bootstrapped Kriging: Survey Simulation optimization via bootstrapped Kriging: Survey Jack P.C. Kleijnen Department of Information Management / Center for Economic Research (CentER) Tilburg School of Economics & Management (TiSEM)

More information

Design for Reliability and Robustness through probabilistic Methods in COMSOL Multiphysics with OptiY

Design for Reliability and Robustness through probabilistic Methods in COMSOL Multiphysics with OptiY Presented at the COMSOL Conference 2008 Hannover Multidisciplinary Analysis and Optimization In1 Design for Reliability and Robustness through probabilistic Methods in COMSOL Multiphysics with OptiY In2

More information

Model Assisted Survey Sampling

Model Assisted Survey Sampling Carl-Erik Sarndal Jan Wretman Bengt Swensson Model Assisted Survey Sampling Springer Preface v PARTI Principles of Estimation for Finite Populations and Important Sampling Designs CHAPTER 1 Survey Sampling

More information

Metamodel-Based Optimization

Metamodel-Based Optimization Metamodel-Based Optimization NSF Workshop on Simulation Optimization May 24, 2010 Russell Barton Penn State Acknowledgments and Apologies To Michael and Barry. To NSF. To all of you. 2 Overview Metamodel-based

More information

Response Surface Methodology:

Response Surface Methodology: Response Surface Methodology: Process and Product Optimization Using Designed Experiments RAYMOND H. MYERS Virginia Polytechnic Institute and State University DOUGLAS C. MONTGOMERY Arizona State University

More information

OPTIMAL DESIGN INPUTS FOR EXPERIMENTAL CHAPTER 17. Organization of chapter in ISSO. Background. Linear models

OPTIMAL DESIGN INPUTS FOR EXPERIMENTAL CHAPTER 17. Organization of chapter in ISSO. Background. Linear models CHAPTER 17 Slides for Introduction to Stochastic Search and Optimization (ISSO)by J. C. Spall OPTIMAL DESIGN FOR EXPERIMENTAL INPUTS Organization of chapter in ISSO Background Motivation Finite sample

More information

Robust Dual-Response Optimization

Robust Dual-Response Optimization Yanıkoğlu, den Hertog, and Kleijnen Robust Dual-Response Optimization 29 May 1 June 1 / 24 Robust Dual-Response Optimization İhsan Yanıkoğlu, Dick den Hertog, Jack P.C. Kleijnen Özyeğin University, İstanbul,

More information

Appendix U. Evaluation of stochastic & statistic methods for spacecraft thermal analysis. Jean-Paul Dudon (Thales Alenia Space, France)

Appendix U. Evaluation of stochastic & statistic methods for spacecraft thermal analysis. Jean-Paul Dudon (Thales Alenia Space, France) 319 Appendix U Evaluation of stochastic & statistic methods for spacecraft thermal analysis Jean-Paul Dudon (Thales Alenia Space, France) Hélène-Marie Pasquier (CNES, France) 320 Evaluation of stochastic

More information

THE PRINCIPLES AND PRACTICE OF STATISTICS IN BIOLOGICAL RESEARCH. Robert R. SOKAL and F. James ROHLF. State University of New York at Stony Brook

THE PRINCIPLES AND PRACTICE OF STATISTICS IN BIOLOGICAL RESEARCH. Robert R. SOKAL and F. James ROHLF. State University of New York at Stony Brook BIOMETRY THE PRINCIPLES AND PRACTICE OF STATISTICS IN BIOLOGICAL RESEARCH THIRD E D I T I O N Robert R. SOKAL and F. James ROHLF State University of New York at Stony Brook W. H. FREEMAN AND COMPANY New

More information

FIVE-STAGE PROCEDURE FOR THE EVALUATION OF SIMULATION MODELS THROUGH STATISTICAL TECHNIQUES

FIVE-STAGE PROCEDURE FOR THE EVALUATION OF SIMULATION MODELS THROUGH STATISTICAL TECHNIQUES Proceedings of the 1996 Winter Sirnulation Conference ed. J. 1v1. Charnes, D. J. l\jorrice, D. T. Brunner, and J. J. S~vain FIVE-STAGE PROCEDURE FOR THE EVALUATION OF SIMULATION MODELS THROUGH STATISTICAL

More information

PARAMETRIC AND DISTRIBUTION-FREE BOOTSTRAPPING IN ROBUST SIMULATION-OPTIMIZATION. Carlo Meloni

PARAMETRIC AND DISTRIBUTION-FREE BOOTSTRAPPING IN ROBUST SIMULATION-OPTIMIZATION. Carlo Meloni Proceedings of the 2010 Winter Simulation onference B. Johansson, S. Jain, J. Montoya-Torres, J. Hugan, and E. Yücesan, eds. PARAMETRI AND DISTRIBUTION-FREE BOOTSTRAPPING IN ROBUST SIMULATION-OPTIMIZATION

More information

Contents. Preface. 1 Introduction Optimization view on mathematical models NLP models, black-box versus explicit expression 3

Contents. Preface. 1 Introduction Optimization view on mathematical models NLP models, black-box versus explicit expression 3 Contents Preface ix 1 Introduction 1 1.1 Optimization view on mathematical models 1 1.2 NLP models, black-box versus explicit expression 3 2 Mathematical modeling, cases 7 2.1 Introduction 7 2.2 Enclosing

More information

G. S. Maddala Kajal Lahiri. WILEY A John Wiley and Sons, Ltd., Publication

G. S. Maddala Kajal Lahiri. WILEY A John Wiley and Sons, Ltd., Publication G. S. Maddala Kajal Lahiri WILEY A John Wiley and Sons, Ltd., Publication TEMT Foreword Preface to the Fourth Edition xvii xix Part I Introduction and the Linear Regression Model 1 CHAPTER 1 What is Econometrics?

More information

DESIGN AND ANALYSIS OF EXPERIMENTS Third Edition

DESIGN AND ANALYSIS OF EXPERIMENTS Third Edition DESIGN AND ANALYSIS OF EXPERIMENTS Third Edition Douglas C. Montgomery ARIZONA STATE UNIVERSITY JOHN WILEY & SONS New York Chichester Brisbane Toronto Singapore Contents Chapter 1. Introduction 1-1 What

More information

DESIGNING EXPERIMENTS AND ANALYZING DATA A Model Comparison Perspective

DESIGNING EXPERIMENTS AND ANALYZING DATA A Model Comparison Perspective DESIGNING EXPERIMENTS AND ANALYZING DATA A Model Comparison Perspective Second Edition Scott E. Maxwell Uniuersity of Notre Dame Harold D. Delaney Uniuersity of New Mexico J,t{,.?; LAWRENCE ERLBAUM ASSOCIATES,

More information

COPYRIGHTED MATERIAL CONTENTS. Preface Preface to the First Edition

COPYRIGHTED MATERIAL CONTENTS. Preface Preface to the First Edition Preface Preface to the First Edition xi xiii 1 Basic Probability Theory 1 1.1 Introduction 1 1.2 Sample Spaces and Events 3 1.3 The Axioms of Probability 7 1.4 Finite Sample Spaces and Combinatorics 15

More information

Statistical. Psychology

Statistical. Psychology SEVENTH у *i km m it* & П SB Й EDITION Statistical M e t h o d s for Psychology D a v i d C. Howell University of Vermont ; \ WADSWORTH f% CENGAGE Learning* Australia Biaall apan Korea Меяко Singapore

More information

Numerical Analysis for Statisticians

Numerical Analysis for Statisticians Kenneth Lange Numerical Analysis for Statisticians Springer Contents Preface v 1 Recurrence Relations 1 1.1 Introduction 1 1.2 Binomial CoefRcients 1 1.3 Number of Partitions of a Set 2 1.4 Horner's Method

More information

Discrete-Event System Simulation

Discrete-Event System Simulation Discrete-Event System Simulation FOURTH EDITION Jerry Banks Independent Consultant John S. Carson II Brooks Automation Barry L. Nelson Northwestern University David M. Nicol University of Illinois, Urbana-Champaign

More information

CONTROLLED SEQUENTIAL BIFURCATION: A NEW FACTOR-SCREENING METHOD FOR DISCRETE-EVENT SIMULATION

CONTROLLED SEQUENTIAL BIFURCATION: A NEW FACTOR-SCREENING METHOD FOR DISCRETE-EVENT SIMULATION ABSTRACT CONTROLLED SEQUENTIAL BIFURCATION: A NEW FACTOR-SCREENING METHOD FOR DISCRETE-EVENT SIMULATION Hong Wan Bruce Ankenman Barry L. Nelson Department of Industrial Engineering and Management Sciences

More information

Decomposition Techniques in Mathematical Programming

Decomposition Techniques in Mathematical Programming Antonio J. Conejo Enrique Castillo Roberto Minguez Raquel Garcia-Bertrand Decomposition Techniques in Mathematical Programming Engineering and Science Applications Springer Contents Part I Motivation and

More information

Sensitivity analysis using the Metamodel of Optimal Prognosis. Lectures. Thomas Most & Johannes Will

Sensitivity analysis using the Metamodel of Optimal Prognosis. Lectures. Thomas Most & Johannes Will Lectures Sensitivity analysis using the Metamodel of Optimal Prognosis Thomas Most & Johannes Will presented at the Weimar Optimization and Stochastic Days 2011 Source: www.dynardo.de/en/library Sensitivity

More information

Condensed Table of Contents for Introduction to Stochastic Search and Optimization: Estimation, Simulation, and Control by J. C.

Condensed Table of Contents for Introduction to Stochastic Search and Optimization: Estimation, Simulation, and Control by J. C. Condensed Table of Contents for Introduction to Stochastic Search and Optimization: Estimation, Simulation, and Control by J. C. Spall John Wiley and Sons, Inc., 2003 Preface... xiii 1. Stochastic Search

More information

Use of orthogonal arrays, quasi-monte Carlo sampling and kriging response models for reservoir simulation with many varying factors

Use of orthogonal arrays, quasi-monte Carlo sampling and kriging response models for reservoir simulation with many varying factors Louisiana State University LSU Digital Commons LSU Master's Theses Graduate School 5 Use of orthogonal arrays, quasi-monte Carlo sampling and kriging response models for reservoir simulation with many

More information

Irr. Statistical Methods in Experimental Physics. 2nd Edition. Frederick James. World Scientific. CERN, Switzerland

Irr. Statistical Methods in Experimental Physics. 2nd Edition. Frederick James. World Scientific. CERN, Switzerland Frederick James CERN, Switzerland Statistical Methods in Experimental Physics 2nd Edition r i Irr 1- r ri Ibn World Scientific NEW JERSEY LONDON SINGAPORE BEIJING SHANGHAI HONG KONG TAIPEI CHENNAI CONTENTS

More information

Simulation Methods for Stochastic Storage Problems: A Statistical Learning Perspective

Simulation Methods for Stochastic Storage Problems: A Statistical Learning Perspective Simulation Methods for Stochastic Storage Problems: A Statistical Learning Perspective Aditya Maheshwari Joint work with: Dr. Michael Ludkovski Department of Statistics and Applied Probability University

More information

Contents. Preface to Second Edition Preface to First Edition Abbreviations PART I PRINCIPLES OF STATISTICAL THINKING AND ANALYSIS 1

Contents. Preface to Second Edition Preface to First Edition Abbreviations PART I PRINCIPLES OF STATISTICAL THINKING AND ANALYSIS 1 Contents Preface to Second Edition Preface to First Edition Abbreviations xv xvii xix PART I PRINCIPLES OF STATISTICAL THINKING AND ANALYSIS 1 1 The Role of Statistical Methods in Modern Industry and Services

More information

Econometric Analysis of Cross Section and Panel Data

Econometric Analysis of Cross Section and Panel Data Econometric Analysis of Cross Section and Panel Data Jeffrey M. Wooldridge / The MIT Press Cambridge, Massachusetts London, England Contents Preface Acknowledgments xvii xxiii I INTRODUCTION AND BACKGROUND

More information

Optimization of simulated systems is the goal of many methods, but most methods assume known environments.

Optimization of simulated systems is the goal of many methods, but most methods assume known environments. INFORMS Journal on Computing Vol. 24, No. 3, Summer 2012, pp. 471 484 ISSN 1091-9856 (print) ISSN 1526-5528 (online) http://dx.doi.org/10.1287/ijoc.1110.0465 2012 INFORMS Robust Optimization in Simulation:

More information

Testing Statistical Hypotheses

Testing Statistical Hypotheses E.L. Lehmann Joseph P. Romano Testing Statistical Hypotheses Third Edition 4y Springer Preface vii I Small-Sample Theory 1 1 The General Decision Problem 3 1.1 Statistical Inference and Statistical Decisions

More information

Modelling Under Risk and Uncertainty

Modelling Under Risk and Uncertainty Modelling Under Risk and Uncertainty An Introduction to Statistical, Phenomenological and Computational Methods Etienne de Rocquigny Ecole Centrale Paris, Universite Paris-Saclay, France WILEY A John Wiley

More information

Stochastic Optimization Methods

Stochastic Optimization Methods Stochastic Optimization Methods Kurt Marti Stochastic Optimization Methods With 14 Figures 4y Springer Univ. Professor Dr. sc. math. Kurt Marti Federal Armed Forces University Munich Aero-Space Engineering

More information

Introduction to Eco n o m et rics

Introduction to Eco n o m et rics 2008 AGI-Information Management Consultants May be used for personal purporses only or by libraries associated to dandelon.com network. Introduction to Eco n o m et rics Third Edition G.S. Maddala Formerly

More information

A Guide to Modern Econometric:

A Guide to Modern Econometric: A Guide to Modern Econometric: 4th edition Marno Verbeek Rotterdam School of Management, Erasmus University, Rotterdam B 379887 )WILEY A John Wiley & Sons, Ltd., Publication Contents Preface xiii 1 Introduction

More information

Contents. Part I: Fundamentals of Bayesian Inference 1

Contents. Part I: Fundamentals of Bayesian Inference 1 Contents Preface xiii Part I: Fundamentals of Bayesian Inference 1 1 Probability and inference 3 1.1 The three steps of Bayesian data analysis 3 1.2 General notation for statistical inference 4 1.3 Bayesian

More information

Risk Assessment for CO 2 Sequestration- Uncertainty Quantification based on Surrogate Models of Detailed Simulations

Risk Assessment for CO 2 Sequestration- Uncertainty Quantification based on Surrogate Models of Detailed Simulations Risk Assessment for CO 2 Sequestration- Uncertainty Quantification based on Surrogate Models of Detailed Simulations Yan Zhang Advisor: Nick Sahinidis Department of Chemical Engineering Carnegie Mellon

More information

Two-Stage Computing Budget Allocation. Approach for Response Surface Method PENG JI

Two-Stage Computing Budget Allocation. Approach for Response Surface Method PENG JI Two-Stage Computing Budget Allocation Approach for Response Surface Method PENG JI NATIONAL UNIVERSITY OF SINGAPORE 2005 Two-Stage Computing Budget Allocation Approach for Response Surface Method PENG

More information

Preface Introduction to Statistics and Data Analysis Overview: Statistical Inference, Samples, Populations, and Experimental Design The Role of

Preface Introduction to Statistics and Data Analysis Overview: Statistical Inference, Samples, Populations, and Experimental Design The Role of Preface Introduction to Statistics and Data Analysis Overview: Statistical Inference, Samples, Populations, and Experimental Design The Role of Probability Sampling Procedures Collection of Data Measures

More information

Bootstrapping, Randomization, 2B-PLS

Bootstrapping, Randomization, 2B-PLS Bootstrapping, Randomization, 2B-PLS Statistics, Tests, and Bootstrapping Statistic a measure that summarizes some feature of a set of data (e.g., mean, standard deviation, skew, coefficient of variation,

More information

Response Surface Methodology: Process and Product Optimization Using Designed Experiments, 3rd Edition

Response Surface Methodology: Process and Product Optimization Using Designed Experiments, 3rd Edition Brochure More information from http://www.researchandmarkets.com/reports/705963/ Response Surface Methodology: Process and Product Optimization Using Designed Experiments, 3rd Edition Description: Identifying

More information

Adjustable Robust Parameter Design with Unknown Distributions Yanikoglu, Ihsan; den Hertog, Dick; Kleijnen, J.P.C.

Adjustable Robust Parameter Design with Unknown Distributions Yanikoglu, Ihsan; den Hertog, Dick; Kleijnen, J.P.C. Tilburg University Adjustable Robust Parameter Design with Unknown Distributions Yanikoglu, Ihsan; den Hertog, Dick; Kleijnen, J.P.C. Publication date: 2013 Link to publication Citation for published version

More information

Testing Statistical Hypotheses

Testing Statistical Hypotheses E.L. Lehmann Joseph P. Romano, 02LEu1 ttd ~Lt~S Testing Statistical Hypotheses Third Edition With 6 Illustrations ~Springer 2 The Probability Background 28 2.1 Probability and Measure 28 2.2 Integration.........

More information

Physical Experimental Design in Support of Computer Model Development. Experimental Design for RSM-Within-Model

Physical Experimental Design in Support of Computer Model Development. Experimental Design for RSM-Within-Model DAE 2012 1 Physical Experimental Design in Support of Computer Model Development or Experimental Design for RSM-Within-Model Max D. Morris Department of Statistics Dept. of Industrial & Manufacturing Systems

More information

Their Statistical Analvsis. With Web-Based Fortran Code. Berg

Their Statistical Analvsis. With Web-Based Fortran Code. Berg Markov Chain Monter rlo Simulations and Their Statistical Analvsis With Web-Based Fortran Code Bernd A. Berg Florida State Univeisitfi USA World Scientific NEW JERSEY + LONDON " SINGAPORE " BEIJING " SHANGHAI

More information

FINDING IMPORTANT INDEPENDENT VARIABLES THROUGH SCREENING DESIGNS: A COMPARISON OF METHODS. Linda Trocine Linda C. Malone

FINDING IMPORTANT INDEPENDENT VARIABLES THROUGH SCREENING DESIGNS: A COMPARISON OF METHODS. Linda Trocine Linda C. Malone Proceedings of the 2000 Winter Simulation Conference J. A. Joines, R. R. Barton, K. Kang, and P. A. Fishwick, eds. FINDING IMPORTANT INDEPENDENT VARIABLES THROUGH SCREENING DESIGNS: A COMPARISON OF METHODS

More information

Christopher Dougherty London School of Economics and Political Science

Christopher Dougherty London School of Economics and Political Science Introduction to Econometrics FIFTH EDITION Christopher Dougherty London School of Economics and Political Science OXFORD UNIVERSITY PRESS Contents INTRODU CTION 1 Why study econometrics? 1 Aim of this

More information

Continuous Univariate Distributions

Continuous Univariate Distributions Continuous Univariate Distributions Volume 2 Second Edition NORMAN L. JOHNSON University of North Carolina Chapel Hill, North Carolina SAMUEL KOTZ University of Maryland College Park, Maryland N. BALAKRISHNAN

More information

Stat 890 Design of computer experiments

Stat 890 Design of computer experiments Stat 890 Design of computer experiments Will introduce design concepts for computer experiments Will look at more elaborate constructions next day Experiment design In computer experiments, as in many

More information

7. Response Surface Methodology (Ch.10. Regression Modeling Ch. 11. Response Surface Methodology)

7. Response Surface Methodology (Ch.10. Regression Modeling Ch. 11. Response Surface Methodology) 7. Response Surface Methodology (Ch.10. Regression Modeling Ch. 11. Response Surface Methodology) Hae-Jin Choi School of Mechanical Engineering, Chung-Ang University 1 Introduction Response surface methodology,

More information

Experimental Design and Data Analysis for Biologists

Experimental Design and Data Analysis for Biologists Experimental Design and Data Analysis for Biologists Gerry P. Quinn Monash University Michael J. Keough University of Melbourne CAMBRIDGE UNIVERSITY PRESS Contents Preface page xv I I Introduction 1 1.1

More information

Polynomial chaos expansions for sensitivity analysis

Polynomial chaos expansions for sensitivity analysis c DEPARTMENT OF CIVIL, ENVIRONMENTAL AND GEOMATIC ENGINEERING CHAIR OF RISK, SAFETY & UNCERTAINTY QUANTIFICATION Polynomial chaos expansions for sensitivity analysis B. Sudret Chair of Risk, Safety & Uncertainty

More information

Introduction to emulators - the what, the when, the why

Introduction to emulators - the what, the when, the why School of Earth and Environment INSTITUTE FOR CLIMATE & ATMOSPHERIC SCIENCE Introduction to emulators - the what, the when, the why Dr Lindsay Lee 1 What is a simulator? A simulator is a computer code

More information

The Pennsylvania State University The Graduate School A METHODOLOGY FOR EVALUATING SYSTEM-LEVEL UNCERTAINTY

The Pennsylvania State University The Graduate School A METHODOLOGY FOR EVALUATING SYSTEM-LEVEL UNCERTAINTY The Pennsylvania State University The Graduate School A METHODOLOGY FOR EVALUATING SYSTEM-LEVEL UNCERTAINTY IN THE CONCEPTUAL DESIGN OF COMPLEX MULTIDISCIPLINARY SYSTEMS A Thesis in Mechanical Engineering

More information

Taylor Kriging Metamodeling For Simulation Interpolation, Sensitivity Analysis And Optimization. Heping Liu

Taylor Kriging Metamodeling For Simulation Interpolation, Sensitivity Analysis And Optimization. Heping Liu Taylor Kriging Metamodeling For Simulation Interpolation, Sensitivity Analysis And Optimization Except where reference is made to the work of others, the work described in this dissertation is my own or

More information

Efficient sensitivity analysis for virtual prototyping. Lectures. Thomas Most & Johannes Will

Efficient sensitivity analysis for virtual prototyping. Lectures. Thomas Most & Johannes Will Lectures Efficient sensitivity analysis for virtual prototyping Thomas Most & Johannes Will presented at the ECCOMAS Conference 2012 Source: www.dynardo.de/en/library European Congress on Computational

More information

Contents 1 Introduction 2 Statistical Tools and Concepts

Contents 1 Introduction 2 Statistical Tools and Concepts 1 Introduction... 1 1.1 Objectives and Approach... 1 1.2 Scope of Resource Modeling... 2 1.3 Critical Aspects... 2 1.3.1 Data Assembly and Data Quality... 2 1.3.2 Geologic Model and Definition of Estimation

More information

A Hybrid Method for Simulation Factor Screening

A Hybrid Method for Simulation Factor Screening A Hybrid Method for Simulation Factor Screening Hua Shen, 1 Hong Wan, 2 Susan M. Sanchez 3,4 1 Bank of America, Charlotte, NC 28255 2 School of Industrial Engineering, Purdue University, West Lafayette,

More information

8 RESPONSE SURFACE DESIGNS

8 RESPONSE SURFACE DESIGNS 8 RESPONSE SURFACE DESIGNS Desirable Properties of a Response Surface Design 1. It should generate a satisfactory distribution of information throughout the design region. 2. It should ensure that the

More information

Pharmaceutical Experimental Design and Interpretation

Pharmaceutical Experimental Design and Interpretation Pharmaceutical Experimental Design and Interpretation N. ANTHONY ARMSTRONG, B. Pharm., Ph.D., F.R.Pharm.S., MCPP. KENNETH C. JAMES, M. Pharm., Ph.D., D.Sc, FRSC, F.R.Pharm.S., C.Chem. Welsh School of Pharmacy,

More information

Pattern Recognition and Machine Learning

Pattern Recognition and Machine Learning Christopher M. Bishop Pattern Recognition and Machine Learning ÖSpri inger Contents Preface Mathematical notation Contents vii xi xiii 1 Introduction 1 1.1 Example: Polynomial Curve Fitting 4 1.2 Probability

More information

A Polynomial Chaos Approach to Robust Multiobjective Optimization

A Polynomial Chaos Approach to Robust Multiobjective Optimization A Polynomial Chaos Approach to Robust Multiobjective Optimization Silvia Poles 1, Alberto Lovison 2 1 EnginSoft S.p.A., Optimization Consulting Via Giambellino, 7 35129 Padova, Italy s.poles@enginsoft.it

More information

A MODIFICATION OF CHENG S METHOD: AN ALTERNATIVE FACTOR SCREENING METHOD FOR STOCHASTIC SIMULATION MODELS

A MODIFICATION OF CHENG S METHOD: AN ALTERNATIVE FACTOR SCREENING METHOD FOR STOCHASTIC SIMULATION MODELS Proceedings of the 2010 Winter Simulation Conference B. Johansson, S. Jain, J. Montoya-Torres, J. Hugan, and E. Yücesan, eds. A MODIFICATION OF CHENG S METHOD: AN ALTERNATIVE FACTOR SCREENING METHOD FOR

More information

KRIGING METAMODELING IN MULTI-OBJECTIVE SIMULATION OPTIMIZATION. Mehdi Zakerifar William E. Biles Gerald W. Evans

KRIGING METAMODELING IN MULTI-OBJECTIVE SIMULATION OPTIMIZATION. Mehdi Zakerifar William E. Biles Gerald W. Evans Proceedings of the 2009 Winter Simulation Conference M. D. Rossetti, R. R. Hill, B. Johansson, A. Dunkin and R. G. Ingalls, eds. KRIGING METAMODELING IN MULTI-OBJECTIVE SIMULATION OPTIMIZATION Mehdi Zakerifar

More information

Extreme Value Theory An Introduction

Extreme Value Theory An Introduction Laurens de Haan Ana Ferreira Extreme Value Theory An Introduction fi Springer Contents Preface List of Abbreviations and Symbols vii xv Part I One-Dimensional Observations 1 Limit Distributions and Domains

More information

Statistícal Methods for Spatial Data Analysis

Statistícal Methods for Spatial Data Analysis Texts in Statistícal Science Statistícal Methods for Spatial Data Analysis V- Oliver Schabenberger Carol A. Gotway PCT CHAPMAN & K Contents Preface xv 1 Introduction 1 1.1 The Need for Spatial Analysis

More information

Geostatistics for Seismic Data Integration in Earth Models

Geostatistics for Seismic Data Integration in Earth Models 2003 Distinguished Instructor Short Course Distinguished Instructor Series, No. 6 sponsored by the Society of Exploration Geophysicists European Association of Geoscientists & Engineers SUB Gottingen 7

More information

Experimental design. Matti Hotokka Department of Physical Chemistry Åbo Akademi University

Experimental design. Matti Hotokka Department of Physical Chemistry Åbo Akademi University Experimental design Matti Hotokka Department of Physical Chemistry Åbo Akademi University Contents Elementary concepts Regression Validation Design of Experiments Definitions Random sampling Factorial

More information

Outline Introduction OLS Design of experiments Regression. Metamodeling. ME598/494 Lecture. Max Yi Ren

Outline Introduction OLS Design of experiments Regression. Metamodeling. ME598/494 Lecture. Max Yi Ren 1 / 34 Metamodeling ME598/494 Lecture Max Yi Ren Department of Mechanical Engineering, Arizona State University March 1, 2015 2 / 34 1. preliminaries 1.1 motivation 1.2 ordinary least square 1.3 information

More information

Transition Passage to Descriptive Statistics 28

Transition Passage to Descriptive Statistics 28 viii Preface xiv chapter 1 Introduction 1 Disciplines That Use Quantitative Data 5 What Do You Mean, Statistics? 6 Statistics: A Dynamic Discipline 8 Some Terminology 9 Problems and Answers 12 Scales of

More information

No AN OVERVIEW OF THE DESIGN AND ANALYSIS OF SIMULATION EXPERIMENTS FOR SENSITIVITY ANALYSIS. By J.P.C. Kleijnen.

No AN OVERVIEW OF THE DESIGN AND ANALYSIS OF SIMULATION EXPERIMENTS FOR SENSITIVITY ANALYSIS. By J.P.C. Kleijnen. No. 2004 16 AN OVERVIEW OF THE DESIGN AND ANALYSIS OF SIMULATION EXPERIMENTS FOR SENSITIVITY ANALYSIS By J.P.C. Kleijnen February 2004 ISSN 0924-7815 Invited_Review_Version_2.doc; written 4 February 2004;

More information

A Classical Introduction to Modern Number Theory

A Classical Introduction to Modern Number Theory Kenneth Ireland Michael Rosen A Classical Introduction to Modern Number Theory Second Edition Springer Contents Preface to the Second Edition Preface v vii CHAPTER 1 Unique Factorization 1 1 Unique Factorization

More information

Response surface methodology revisited Angun, M.E.; Gurkan, Gul; den Hertog, Dick; Kleijnen, Jack

Response surface methodology revisited Angun, M.E.; Gurkan, Gul; den Hertog, Dick; Kleijnen, Jack Tilburg University Response surface methodology revisited Angun, M.E.; Gurkan, Gul; den Hertog, Dick; Kleijnen, Jack Published in: Proceedings of the 00 Winter Simulation Conference Publication date: 00

More information

Monte Carlo Methods. Handbook of. University ofqueensland. Thomas Taimre. Zdravko I. Botev. Dirk P. Kroese. Universite de Montreal

Monte Carlo Methods. Handbook of. University ofqueensland. Thomas Taimre. Zdravko I. Botev. Dirk P. Kroese. Universite de Montreal Handbook of Monte Carlo Methods Dirk P. Kroese University ofqueensland Thomas Taimre University ofqueensland Zdravko I. Botev Universite de Montreal A JOHN WILEY & SONS, INC., PUBLICATION Preface Acknowledgments

More information

Adaptive response surface by kriging using pilot points for structural reliability analysis

Adaptive response surface by kriging using pilot points for structural reliability analysis IOSR Journal of Mechanical and Civil Engineering (IOSR-JMCE) e-issn: 2278-1684,p-ISSN: 2320-334X, Volume 9, Issue 5 (Nov. - Dec. 2013), PP 74-87 Adaptive response surface by kriging using pilot points

More information

Notation Precedence Diagram

Notation Precedence Diagram Notation Precedence Diagram xix xxi CHAPTER 1 Introduction 1 1.1. Systems, Models, and Simulation 1 1.2. Verification, Approximation, and Validation 8 1.2.1. Verifying a Program 9 1.2.2. Approximation

More information

BEST ESTIMATE PLUS UNCERTAINTY SAFETY STUDIES AT THE CONCEPTUAL DESIGN PHASE OF THE ASTRID DEMONSTRATOR

BEST ESTIMATE PLUS UNCERTAINTY SAFETY STUDIES AT THE CONCEPTUAL DESIGN PHASE OF THE ASTRID DEMONSTRATOR BEST ESTIMATE PLUS UNCERTAINTY SAFETY STUDIES AT THE CONCEPTUAL DESIGN PHASE OF THE ASTRID DEMONSTRATOR M. Marquès CEA, DEN, DER F-13108, Saint-Paul-lez-Durance, France Advanced simulation in support to

More information

A Structural Reliability Analysis Method Based on Radial Basis Function

A Structural Reliability Analysis Method Based on Radial Basis Function Copyright 2012 Tech Science Press CMC, vol.27, no.2, pp.128-142, 2012 A Structural Reliability Analysis Method Based on Radial Basis Function M. Q. Chau 1,2, X. Han 1, Y. C. Bai 1 and C. Jiang 1 Abstract:

More information

Linear Models 1. Isfahan University of Technology Fall Semester, 2014

Linear Models 1. Isfahan University of Technology Fall Semester, 2014 Linear Models 1 Isfahan University of Technology Fall Semester, 2014 References: [1] G. A. F., Seber and A. J. Lee (2003). Linear Regression Analysis (2nd ed.). Hoboken, NJ: Wiley. [2] A. C. Rencher and

More information

5.5.3 Statistical Innovative Trend Test Application Crossing Trend Analysis Methodology Rational Concept...

5.5.3 Statistical Innovative Trend Test Application Crossing Trend Analysis Methodology Rational Concept... Contents 1 Introduction.... 1 1.1 General... 1 1.2 Trend Definition and Analysis... 3 1.2.1 Conceptual and Visual Trends.... 4 1.2.2 Mathematical Trend.... 7 1.2.3 Statistical Trend.... 9 1.3 Trend in

More information

Some methods for sensitivity analysis of systems / networks

Some methods for sensitivity analysis of systems / networks Article Some methods for sensitivity analysis of systems / networks WenJun Zhang School of Life Sciences, Sun Yat-sen University, Guangzhou 510275, China; International Academy of Ecology and Environmental

More information

DETAILED CONTENTS PART I INTRODUCTION AND DESCRIPTIVE STATISTICS. 1. Introduction to Statistics

DETAILED CONTENTS PART I INTRODUCTION AND DESCRIPTIVE STATISTICS. 1. Introduction to Statistics DETAILED CONTENTS About the Author Preface to the Instructor To the Student How to Use SPSS With This Book PART I INTRODUCTION AND DESCRIPTIVE STATISTICS 1. Introduction to Statistics 1.1 Descriptive and

More information

Generalized Linear. Mixed Models. Methods and Applications. Modern Concepts, Walter W. Stroup. Texts in Statistical Science.

Generalized Linear. Mixed Models. Methods and Applications. Modern Concepts, Walter W. Stroup. Texts in Statistical Science. Texts in Statistical Science Generalized Linear Mixed Models Modern Concepts, Methods and Applications Walter W. Stroup CRC Press Taylor & Francis Croup Boca Raton London New York CRC Press is an imprint

More information

Inverse Problems and Optimal Design in Electricity and Magnetism

Inverse Problems and Optimal Design in Electricity and Magnetism Inverse Problems and Optimal Design in Electricity and Magnetism P. Neittaanmäki Department of Mathematics, University of Jyväskylä M. Rudnicki Institute of Electrical Engineering, Warsaw and A. Savini

More information

RESPONSE SURFACE METHODOLOGY

RESPONSE SURFACE METHODOLOGY RESPONSE SURFACE METHODOLOGY WILEY SERIES IN PROBABILITY AND STATISTICS Established by WALTER A. SHEWHART and SAMUEL S. WILKS Editors: David J. Balding, Noel A. C. Cressie, Garrett M. Fitzmaurice, Iain

More information

Wiley. Methods and Applications of Linear Models. Regression and the Analysis. of Variance. Third Edition. Ishpeming, Michigan RONALD R.

Wiley. Methods and Applications of Linear Models. Regression and the Analysis. of Variance. Third Edition. Ishpeming, Michigan RONALD R. Methods and Applications of Linear Models Regression and the Analysis of Variance Third Edition RONALD R. HOCKING PenHock Statistical Consultants Ishpeming, Michigan Wiley Contents Preface to the Third

More information

Statistical Methods in HYDROLOGY CHARLES T. HAAN. The Iowa State University Press / Ames

Statistical Methods in HYDROLOGY CHARLES T. HAAN. The Iowa State University Press / Ames Statistical Methods in HYDROLOGY CHARLES T. HAAN The Iowa State University Press / Ames Univariate BASIC Table of Contents PREFACE xiii ACKNOWLEDGEMENTS xv 1 INTRODUCTION 1 2 PROBABILITY AND PROBABILITY

More information

ROBUST SIMULATION-OPTIMIZATION USING METAMODELS. Carlo Meloni

ROBUST SIMULATION-OPTIMIZATION USING METAMODELS. Carlo Meloni Proceedings of the 2009 Winter Simulation onference M. D. Rossetti, R. R. Hill, B. Johansson, A. Dunkin, and R. G. Ingalls, eds. ROBUST SIMULATION-OPTIMIZATION USING METAMODELS Gabriella Dellino Department

More information

PART I INTRODUCTION The meaning of probability Basic definitions for frequentist statistics and Bayesian inference Bayesian inference Combinatorics

PART I INTRODUCTION The meaning of probability Basic definitions for frequentist statistics and Bayesian inference Bayesian inference Combinatorics Table of Preface page xi PART I INTRODUCTION 1 1 The meaning of probability 3 1.1 Classical definition of probability 3 1.2 Statistical definition of probability 9 1.3 Bayesian understanding of probability

More information

A CENTRAL LIMIT THEOREM FOR NESTED OR SLICED LATIN HYPERCUBE DESIGNS

A CENTRAL LIMIT THEOREM FOR NESTED OR SLICED LATIN HYPERCUBE DESIGNS Statistica Sinica 26 (2016), 1117-1128 doi:http://dx.doi.org/10.5705/ss.202015.0240 A CENTRAL LIMIT THEOREM FOR NESTED OR SLICED LATIN HYPERCUBE DESIGNS Xu He and Peter Z. G. Qian Chinese Academy of Sciences

More information

Roger S. Bivand Edzer J. Pebesma Virgilio Gömez-Rubio. Applied Spatial Data Analysis with R. 4:1 Springer

Roger S. Bivand Edzer J. Pebesma Virgilio Gömez-Rubio. Applied Spatial Data Analysis with R. 4:1 Springer Roger S. Bivand Edzer J. Pebesma Virgilio Gömez-Rubio Applied Spatial Data Analysis with R 4:1 Springer Contents Preface VII 1 Hello World: Introducing Spatial Data 1 1.1 Applied Spatial Data Analysis

More information

Use of Design Sensitivity Information in Response Surface and Kriging Metamodels

Use of Design Sensitivity Information in Response Surface and Kriging Metamodels Optimization and Engineering, 2, 469 484, 2001 c 2002 Kluwer Academic Publishers. Manufactured in The Netherlands. Use of Design Sensitivity Information in Response Surface and Kriging Metamodels J. J.

More information

Computational Methods

Computational Methods Numerical Computational Methods Revised Edition P. B. Patil U. P. Verma Alpha Science International Ltd. Oxford, U.K. CONTENTS Preface List ofprograms v vii 1. NUMER1CAL METHOD, ERROR AND ALGORITHM 1 1.1

More information

CONDITIONAL SIMULATION FOR EFFICIENT GLOBAL OPTIMIZATION. Jack P.C. Kleijnen Ehsan Mehdad

CONDITIONAL SIMULATION FOR EFFICIENT GLOBAL OPTIMIZATION. Jack P.C. Kleijnen Ehsan Mehdad Proceedings of the 23 Winter Simulation Conference R. Pasupathy, S.-H. Kim, A. Tolk, R. Hill, and M. E. Kuhl, eds. CONDITIONAL SIMULATION FOR EFFICIENT GLOBAL OPTIMIZATION Jack P.C. Kleijnen Ehsan Mehdad

More information

Practical Statistics for the Analytical Scientist Table of Contents

Practical Statistics for the Analytical Scientist Table of Contents Practical Statistics for the Analytical Scientist Table of Contents Chapter 1 Introduction - Choosing the Correct Statistics 1.1 Introduction 1.2 Choosing the Right Statistical Procedures 1.2.1 Planning

More information

Probability and Stochastic Processes

Probability and Stochastic Processes Probability and Stochastic Processes A Friendly Introduction Electrical and Computer Engineers Third Edition Roy D. Yates Rutgers, The State University of New Jersey David J. Goodman New York University

More information

Polynomial chaos expansions for structural reliability analysis

Polynomial chaos expansions for structural reliability analysis DEPARTMENT OF CIVIL, ENVIRONMENTAL AND GEOMATIC ENGINEERING CHAIR OF RISK, SAFETY & UNCERTAINTY QUANTIFICATION Polynomial chaos expansions for structural reliability analysis B. Sudret & S. Marelli Incl.

More information