arxiv: v1 [stat.me] 10 Jul 2009
|
|
- Louise Harrell
- 5 years ago
- Views:
Transcription
1 6th St.Petersburg Workshop on Simulation (2009) Improvement of random LHD for high dimensions arxiv: v1 [stat.me] 10 Jul 2009 Andrey Pepelyshev 1 Abstract Designs of experiments for multivariate case are reviewed. Fast algorithm of construction of good Latin hypercube designs is developed. 1 Introduction The mathematical theory for designing experiments was started to develop by Sir Ronald A. Fisher who pioneered the design principles in his studies of analysis of variance originally in agriculture. The theory of experimental designs have received considerable development further in the middle of the twentieth century in works by G.E.P Box, J. Kiefer and many others. Computer experiments have become available with the appearance of computer engineering. Mathematical computer models are a replacement for natural (physical, chemical, biological) experiments which are too time consuming or too costly. Moreover, mathematical models may describe phenomena which can not be reproduced, for example, weather modeling. Experimental designs for deterministic computer models was studied first by McKay et al. (1979). The theoretical principles of analysis of deterministic computer models were determined in Sacks et al. (1989) and the analysis of simulation models (deterministic computer codes with stochastic output) in Kleijnen (1987). During the last decade the Bayesian approach to computer experiments was extensively developed, see Kennedy, O Hagan (2001), Conti, O Hagan (2008) and references within. The technique used in the Bayesian approach is close to Kriging in a manner that a special construction is used to interpolate the values of the output of the deterministic code rather than the values of a random field and uncertainty intervals for untried values of inputs are calculated; see Koehler, Owen (1996), Kennedy, O Hagan(2001). One run by a computer model may require considerable time. Thus the main problem is to reduce an uncertainty of inferences on a computer model by making only a few runs. Consequently, we are faced with the problem of optimal choice of experimental conditions. The present paper is organized as follows. In Section 2 we review experimental designs for a multivariate case in order to choose the most appropriate criteria of optimality. In Section 3 we propose a fast algorithm for constructing good optimal designs for computer experiments. 1 University of Sheffield, a.pepelyshev@sheffield.ac.uk
2 2 Comparison of natural and computer experiments Basic features of natural and computer experiments are presented in the following two-column style. Natural experiments The response is observed with errors which may be correlated. The response is described either by known regression function with unknown parameters or by multivariate linear or quadratic model which is valid at a design subspace. A primary objective is to estimate parameters or find conditions which maximize response. Other aims are identifying variables which have a significant effect, etc. Optimal design is typically to minimize the (generalized) variance of estimated characteristics. Optimal designs are, for example, factorial, incomplete block, orthogonal, central composite, screening and D-optimal designs. Computer experiments The output is deterministic. The running of a computer code at the same inputs gives the same output. A computer code is considered to be like as a black box. The main assumption is factor sparsity, that is the output depends in nonlinear way only on a few number of inputs 1. A primary objective is to fit a cheaper unbiased low uncertain predictor. Other aims are calibration of model parameters to physical data, optimization of output, etc. Optimality criteria is the minimization of mean square error over design space or the maximization of entropy. Optimal design is space-filling design. Latin hypercube design is recommended in many papers. Note that optimal designs for natural experiments mostly have two or three points in projection on each coordinate, e.g. the 2 k p block and orthogonal designs have two points in projection, central composite design has three points in projection. This fact is a consequence of the multivariate linear or quadratic model which is assumed to be valid. Such designs are not suitable for computer experiments since weassumethat theoutput maybe highlynonlinearin severalvariables. Due tothe objectives of computer experiments, optimal design should minimize mean square error between the prediction of response at untried inputs and the true output. This criterion leads to the optimal design which should fill an entire design space uniformly at the initial stage of computer experiments. The examples of spacefilling design are Latin hypercube design, sphere packing design, distance based design, uniform design, design based on random or pseudo-random sequences, see Santner et al. (2003), Fang et al. (2006). The optimal design should be a dense set in projection to each coordinate and should be a dense set in entire design space. Each of the above space-filling designs has attractive properties and satisfies some useful criterion. As far as is known, the best design should optimize a compound criterion. 1 Without sparsity assumption we need a lot of runs to construct an unbiased low uncertain predictor. 1092
3 3 Latin Hypercube Designs At first, we need to recall an algorithm for construction of LH designs, which was introduced in McKay et al. (1979). The algorithm generates n points in dimension d in the following manner. 1) Generate n uniform equidistant points x (s) 1,...,x(s) n in the range of each input, s = 1,...,d. 2) Generate a matrix (p i,j ) of size d n such that each row is a random permutation of numbers 1,...,n and these permutations are independent. 3) Each column of the matrix (p i,j ) corresponds to a design point, that is (x (1) p 1,j,...,x p (d) d,j ) T is jth point of LHD. Without loss of generality, we assume that the range of each input is [0,1] and x (s) j R = {0,1/(n 1),2/(n 1),...,1}. By construction, LHD has the best filling of range in projection on each coordinate. Unfortunately, LHD may have a poor filling of entire hypercube. Several criteria of optimality are introduced in order to choose a good LHD in a class of all LHD. Maximin criterion is a maximization of minimal distance ( d ) 1/p Ψ p (L) = min x i x j p = min x s,i x s,j p i,j=1,...,n i,j=1,...,n usually used with p = 2 where x i = (x 1,i,...,x d,i ) T is ith point of design L. An LHD which maximize Ψ p (L) is called by maximin LHD. Audze-Eglais criterion introduced in Audze, Eglais (1977) is a sum of forces between charged particles and is a minimization of n n 1 Ψ AE (L) = x i x j 2. 2 i=1 j=i+1 Others criteria of uniformity are star L 2 -discrepancy, centered L 2 -discrepancy, wrap-around L 2 -discrepancy which are motivated by quasi-monte-carlo methods and the Koksma-Hlawka inequality, see Hickernell (1998), Fang et al. (2000). Algorithms of optimization are studied in a number of papers, the local search algorithm in Grosso et al. (2008), the enhanced stochastic evolutionary algorithm in Jin et al. (2005), the simulated annealing algorithm in Morris, Mitchell, (1995) the columnwise-pairwise procedure in Ye et al. (2000), the genetic algorithm in Liefvendahl, Stocki, (2006) and Bates et al. (2003), the collapsing method in Fang, Qin (2003). Cited authors concentrate on the case of low dimensions. Basing on an analysis of papers on computer experiments, we can say that the size of LHD is approximately equal to the input dimension multiplied by 10, that is n 10d. Further we propose a fast algorithm of constructing good LHD for the case of high dimensions which is not studied, to the best of our knowledge. First, we need to study features of random LHD generated by the above algorithm. Let L = {x 1,...,x n } be a LHD. Let r i be a minimal distance between x i and other points of L; that is r i = min j i x i x j 2 (further we consider euclidian distances). These distances characterize a design L. Let Q α denote an α-percentile for sample r 1,...,r n. Averaged values of low and upper quartiles, Q 0.25 and Q 0.75, are presented in table 1. We see that the inter-point distances are varied and the quarter of distances are quite small. Also note that distances between points is increased as the dimension is increased since n = 10d s=1
4 Table 1: Low and upper quartiles of distances between points of n-point random LHD for different dimensions, n = 10d. d Q Q d Q Q For construction of n-point LHD with a given inter-point distance r at dimension d, we propose the following heuristic algorithm. Algorithm. 1. Let L k is a k-point design at kth step. Let L 1 = {x 1 } where x 1 is a random point in the middle of R d such that its coordinatesare unequal to eachother. 2. Compute a boolean matrix B = {B i,j } of size d n upon L k such that b i,j = 1 ( used ) if there exists a point in L k with ith coordinate which equals (j 1)/(n 1), and 0 ( unused ) otherwise. 3. Generate a random point z = (q 1,...,q d ) T /(n 1) R d such that each coordinate is unused; that is b i,qi = 0, i = 1,...,d except one random coordinate which should be taken nearby Create a set C of candidate points in R d with unused coordinates which are approximate points which are the closest and the furthest point from z lied on spheres S r (x j ) with centers x j L k and radius r, j = 1,...,k. 5. Find apointx C suchthat x liesoutsideofalls r (x j ), thatis x x j > r, j = 1,...,k. If there exist several such points, choose a point which minimizes #{s : d i=1 B i,s = m }, where m d = min j=1,...,n i=1 B i,j and B = B(L k {x }). 6. Add x to design, that is L k+1 = L k {x }. Stop at nth step. 7. If we could not find x at step 5, goto step 3. If we could find x after several trials, we should decrease r since it is impossible to find a point which is far from L k at given distance r. Let a design obtained by Algorithm be called SLHD. Numerical results show that Algorithm is fast and work well for any dimension. It requires 40 seconds to compute 100-point SLHD at dimension d = 10 and 60 seconds for 140-point SLHD at d = 14 and 200 seconds for 200-point SLHD at d = 20 on PC 2.1GHz. The choice of r should be smaller than r where r is the minimal distance between points of exact maximin LHD. Since r is unknown, we recommend the running Algorithm with different r, say, start with Q 0.75 for random LHD and increase it by small increment. The decreasing of r at step 7 does not mean that SLHD does not exist for given r and is a consequence a poor placement of points at previous iterations. Features of SLHD are presented in Table 2. Values of r are taken from website We see that 90% of inter-point distances 1094
5 Table 2: Low and upper quartiles and Q 0.1 of distances between points of n-point SLHD for different dimensions, n = 10d. The value r of maximin LHD is given. d Q Q Q r d Q Q Q r of SLHD are higher than the most of distances at random LHD. Thus SLHD has a better filling of entire design space. Figure 1 display points of SLHD for d = 2 and d = 20. We can see a quite uniform filling of square. Further improvement of experimental design can be done by applying the local search or the simulated annealing algorithm Figure 1: The points of SLHD for d = 2 with the order of including (left) and two coordinates of points of SLHD for d = 20 (right). 4 Conclusion The algorithm of construction of LHD with given inter-point distance is constructed and studied. By the algorithm we can quickly compute LHD such that the most of inter-point distances are larger than distances at random LHD. The proposed algorithm is more efficient than simply generate many random LHDs and choose the best one. 1095
6 References [1] Bates S.J., Sienz J., Langley D.S. Formulation of the AudzeEglais Uniform Latin Hypercube design of experiments. Advances in Engineering Software 34, (2003) [2] Conti S., O Hagan A. Bayesian emulation of complex multi-output and dynamic computer models. J. Statist. Plan. Infer. (2008) To appear. [3] Jin R., Chen, W., Sudjianto A. An efficient algorithm for constructing optimal design of computer experiments. J. Statist. Plann. Inf. 134 (2005), [4] Grosso A., Jamali A., Locatelli M. Finding maximin latin hypercube designs by Iterated Local Search heuristics. accepted to European J. Operational Research. (2008). [5] Fang K.-T., Qin H. A note on construction of nearly uniform designs with large number of runs. Statist. Probab. Lett. 61 (2003), no. 2, [6] Fang K.-T., Lin D.K.J., Winker P., Zhang Y. Uniform design: theory and application. Technometrics 42 (2000), no. 3, [7] Fang K.-T. Li R., Sudjianto A. Design and modeling for computer experiments. Chapman & Hall/CRC, (2006). [8] Fang K.-T., Ma C.-X., Winker P. Centered L 2 -discrepancy of random sampling and Latin hypercube design, and construction of uniform designs. Math. Comp. 71 (2002), no. 237, [9] Hickernell F.J. A generalized discrepancy and quadrature error bound. Math. Comp. 67 (1998), no. 221, [10] Kennedy M.C., O Hagan A. Bayesian calibration of computer models. J. R. Stat. Soc. Ser. B 63 (2001), no. 3, [11] Kleijnen J.P.C. Statistical tools for simulation practitioners. (1986) [12] Koehler J.R., Owen A.B. Computer experiments. In Handbook of Statistics, (1996), [13] Liefvendahl M., Stocki R. A study on algorithms for optimization of Latin hypercubes. J. Statist. Plann. Inference 136 (2006), [14] McKay M. D., Beckman R. J., Conover W. J. A comparison of three methods for selecting values of input variables in the analysis of output from a computer code. Technometrics 21 (1979), no. 2, [15] Morris M.D., Mitchell T.J. Exploratory designs for computer experiments J. Stat. Plan. Inf., 43 (1995), [16] Sacks J., Welch W.J., Mitchell T.J., Wynn H.P. Design and analysis of computer experiments. With comments and a rejoinder by the authors. Statist. Sci. 4 (1989), no. 4, [17] Santner T.J., Williams B.J., Notz W. The Design and Analysis of Computer Experiments. (2003). [18] Ye K.Q., Li W., Sudjiantoc A. Algorithmic construction of optimal symmetric Latin hypercube designs. J. Stat. Plan. Inf. 90, (2000),
Generalized Latin hypercube design for computer experiments
Generalized Latin hypercube design for computer experiments Holger Dette Ruhr-Universität Bochum Fakultät für Mathematik 44780 Bochum, Germany e-mail: holger.dette@rub.de Andrey Pepelyshev Sheffield University
More informationStat 890 Design of computer experiments
Stat 890 Design of computer experiments Will introduce design concepts for computer experiments Will look at more elaborate constructions next day Experiment design In computer experiments, as in many
More informationOptimizing Latin hypercube designs by particle swarm
Stat Comput (2013) 23:663 676 DOI 10.1007/s11222-012-9363-3 Optimizing Latin hypercube designs by particle swarm Ray-Bing Chen Dai-Ni Hsieh Ying Hung Weichung Wang Received: 30 November 2011 / Accepted:
More informationKullback-Leibler Designs
Kullback-Leibler Designs Astrid JOURDAN Jessica FRANCO Contents Contents Introduction Kullback-Leibler divergence Estimation by a Monte-Carlo method Design comparison Conclusion 2 Introduction Computer
More informationSensitivity analysis in linear and nonlinear models: A review. Introduction
Sensitivity analysis in linear and nonlinear models: A review Caren Marzban Applied Physics Lab. and Department of Statistics Univ. of Washington, Seattle, WA, USA 98195 Consider: Introduction Question:
More informationarxiv: v1 [stat.me] 24 May 2010
The role of the nugget term in the Gaussian process method Andrey Pepelyshev arxiv:1005.4385v1 [stat.me] 24 May 2010 Abstract The maximum likelihood estimate of the correlation parameter of a Gaussian
More informationStatistica Sinica Preprint No: SS R2
Statistica Sinica Preprint No: SS-2016-0423.R2 Title Construction of Maximin Distance Designs via Level Permutation and Expansion Manuscript ID SS-2016-0423.R2 URL http://www.stat.sinica.edu.tw/statistica/
More informationPark, Pennsylvania, USA. Full terms and conditions of use:
This article was downloaded by: [Nam Nguyen] On: 11 August 2012, At: 09:14 Publisher: Taylor & Francis Informa Ltd Registered in England and Wales Registered Number: 1072954 Registered office: Mortimer
More informationAnale. Seria Informatică. Vol. XIII fasc Annals. Computer Science Series. 13 th Tome 1 st Fasc. 2015
24 CONSTRUCTION OF ORTHOGONAL ARRAY-BASED LATIN HYPERCUBE DESIGNS FOR DETERMINISTIC COMPUTER EXPERIMENTS Kazeem A. Osuolale, Waheed B. Yahya, Babatunde L. Adeleke Department of Statistics, University of
More informationA GENERAL CONSTRUCTION FOR SPACE-FILLING LATIN HYPERCUBES
Statistica Sinica 6 (016), 675-690 doi:http://dx.doi.org/10.5705/ss.0015.0019 A GENERAL CONSTRUCTION FOR SPACE-FILLING LATIN HYPERCUBES C. Devon Lin and L. Kang Queen s University and Illinois Institute
More informationOne-at-a-Time Designs for Estimating Elementary Effects of Simulator Experiments with Non-rectangular Input Regions
Statistics and Applications Volume 11, Nos. 1&2, 2013 (New Series), pp. 15-32 One-at-a-Time Designs for Estimating Elementary Effects of Simulator Experiments with Non-rectangular Input Regions Fangfang
More informationExperimental Space-Filling Designs For Complicated Simulation Outpts
Experimental Space-Filling Designs For Complicated Simulation Outpts LTC Alex MacCalman PhD Student Candidate Modeling, Virtual Environments, and Simulations (MOVES) Institute Naval Postgraduate School
More informationConstruction of column-orthogonal designs for computer experiments
SCIENCE CHINA Mathematics. ARTICLES. December 2011 Vol. 54 No. 12: 2683 2692 doi: 10.1007/s11425-011-4284-8 Construction of column-orthogonal designs for computer experiments SUN FaSheng 1,2, PANG Fang
More informationSequential adaptive designs in computer experiments for response surface model fit
Statistics and Applications Volume 6, Nos. &, 8 (New Series), pp.7-33 Sequential adaptive designs in computer experiments for response surface model fit Chen Quin Lam and William I. Notz Department of
More informationOn Latin hypercube designs and estimating black box functions
On Latin hypercube designs and estimating black box functions by L. Gijben [s561960] B.Sc. Tilburg University 2008 A thesis submitted in partial fulfillment of the requirements for the degree of Master
More informationComputer experiments with functional inputs and scalar outputs by a norm-based approach
Computer experiments with functional inputs and scalar outputs by a norm-based approach arxiv:1410.0403v1 [stat.me] 1 Oct 2014 Thomas Muehlenstaedt W. L. Gore & Associates and Jana Fruth Faculty of Statistics,
More informationCONSTRUCTION OF SLICED SPACE-FILLING DESIGNS BASED ON BALANCED SLICED ORTHOGONAL ARRAYS
Statistica Sinica 24 (2014), 1685-1702 doi:http://dx.doi.org/10.5705/ss.2013.239 CONSTRUCTION OF SLICED SPACE-FILLING DESIGNS BASED ON BALANCED SLICED ORTHOGONAL ARRAYS Mingyao Ai 1, Bochuan Jiang 1,2
More informationCONSTRUCTION OF NESTED (NEARLY) ORTHOGONAL DESIGNS FOR COMPUTER EXPERIMENTS
Statistica Sinica 23 (2013), 451-466 doi:http://dx.doi.org/10.5705/ss.2011.092 CONSTRUCTION OF NESTED (NEARLY) ORTHOGONAL DESIGNS FOR COMPUTER EXPERIMENTS Jun Li and Peter Z. G. Qian Opera Solutions and
More informationA note on optimal foldover design
Statistics & Probability Letters 62 (2003) 245 250 A note on optimal foldover design Kai-Tai Fang a;, Dennis K.J. Lin b, HongQin c;a a Department of Mathematics, Hong Kong Baptist University, Kowloon Tong,
More informationAvailable online: 01 Jan 2012
This article was downloaded by: Ohio State University Libraries] On: 30 April 0, At: :3 Publisher: Taylor & Francis Informa Ltd Registered in England and Wales Registered Number: 07954 Registered office:
More informationE(s 2 )-OPTIMALITY AND MINIMUM DISCREPANCY IN 2-LEVEL SUPERSATURATED DESIGNS
Statistica Sinica 12(2002), 931-939 E(s 2 )-OPTIMALITY AND MINIMUM DISCREPANCY IN 2-LEVEL SUPERSATURATED DESIGNS Min-Qian Liu and Fred J. Hickernell Tianjin University and Hong Kong Baptist University
More informationLatin Hypercube Sampling with Multidimensional Uniformity
Latin Hypercube Sampling with Multidimensional Uniformity Jared L. Deutsch and Clayton V. Deutsch Complex geostatistical models can only be realized a limited number of times due to large computational
More informationBridging the Gap Between Space-Filling and Optimal Designs. Design for Computer Experiments. Kathryn Kennedy
Bridging the Gap Between Space-Filling and Optimal Designs Design for Computer Experiments by Kathryn Kennedy A Dissertation Presented in Partial Fulfillment of the Requirements for the Degree Doctor of
More informationDESIGNS FOR COMPUTER EXPERIMENTS AND UNCERTAINTY QUANTIFICATION
DESIGNS FOR COMPUTER EXPERIMENTS AND UNCERTAINTY QUANTIFICATION A Thesis Presented to The Academic Faculty by Evren Gul In Partial Fulfillment of the Requirements for the Degree Doctor of Philosophy in
More informationGaussian Processes for Computer Experiments
Gaussian Processes for Computer Experiments Jeremy Oakley School of Mathematics and Statistics, University of Sheffield www.jeremy-oakley.staff.shef.ac.uk 1 / 43 Computer models Computer model represented
More informationTwo-stage Sensitivity-based Group Screening in Computer Experiments
Two-stage Sensitivity-based Group Screening in Computer Experiments Hyejung Moon, Thomas Santner, Angela Dean (hjmoon@stat.osu.edu) (tjs@stat.osu.edu) (amd@stat.osu.edu) Department of Statistics, The Ohio
More informationNested Latin Hypercube Designs with Sliced Structures
Communications in Statistics - Theory and Methods ISSN: 0361-0926 (Print) 1532-415X (Online) Journal homepage: http://www.tandfonline.com/loi/lsta20 Nested Latin Hypercube Designs with Sliced Structures
More informationIntroduction to emulators - the what, the when, the why
School of Earth and Environment INSTITUTE FOR CLIMATE & ATMOSPHERIC SCIENCE Introduction to emulators - the what, the when, the why Dr Lindsay Lee 1 What is a simulator? A simulator is a computer code
More informationA CENTRAL LIMIT THEOREM FOR NESTED OR SLICED LATIN HYPERCUBE DESIGNS
Statistica Sinica 26 (2016), 1117-1128 doi:http://dx.doi.org/10.5705/ss.202015.0240 A CENTRAL LIMIT THEOREM FOR NESTED OR SLICED LATIN HYPERCUBE DESIGNS Xu He and Peter Z. G. Qian Chinese Academy of Sciences
More informationLOGNORMAL ORDINARY KRIGING METAMODEL
LOGNORMAL ORDINARY KRIGING METAMODEL Muzaffer Balaban Turkish Statistical Institute & Department of Industrial Engineering Başkent University Ankara, Turkey balabanmuzaffer@gmail.com Berna Dengiz Department
More informationResearch the applicability of DOE about optimizing manufacturing process parameters
3rd International Conference on Machinery, Materials and Information Technology Applications (ICMMITA 2015) Research the applicability of DOE about optimizing manufacturing process parameters XinHu Zhang1,
More informationTilburg University. Two-dimensional maximin Latin hypercube designs van Dam, Edwin. Published in: Discrete Applied Mathematics
Tilburg University Two-dimensional maximin Latin hypercube designs van Dam, Edwin Published in: Discrete Applied Mathematics Document version: Peer reviewed version Publication date: 2008 Link to publication
More informationStratified Random Sampling for Dependent Inputs
Stratified Random Sampling for Dependent Inputs Anirban Mondal Case Western Reserve University, Cleveland, OH 44106, USA arxiv:1904.00555v1 [stat.me] 1 Apr 2019 Abhijit Mandal Wayne State University, Detroit,
More informationSELECTING LATIN HYPERCUBES USING CORRELATION CRITERIA
Statistica Sinica 8(1998), 965-977 SELECTING LATIN HYPERCUBES USING CORRELATION CRITERIA Boxin Tang University of Memphis and University of Western Ontario Abstract: Latin hypercube designs have recently
More informationCOMPARING DESIGNS FOR COMPUTER SIMULATION EXPERIMENTS. Rachel T. Johnson Bradley Jones John W. Fowler Douglas C. Montgomery
Proceedings of the 2008 Winter Simulation Conference S. J. Mason, R. R. Hill, L. Mönch, O. Rose, T. Jefferson, J. W. Fowler eds. COMPARING DESIGNS FOR COMPUTER SIMULATION EXPERIMENTS Rachel T. Johnson
More informationLOGNORMAL ORDINARY KRIGING METAMODEL IN SIMULATION OPTIMIZATION
LOGNORMAL ORDINARY KRIGING METAMODEL IN SIMULATION OPTIMIZATION Muzaffer Balaban 1 and Berna Dengiz 2 1 Turkish Statistical Institute, Ankara, Turkey 2 Department of Industrial Engineering, Başkent University,
More informationCONSTRUCTION OF NESTED ORTHOGONAL LATIN HYPERCUBE DESIGNS
Statistica Sinica 24 (2014), 211-219 doi:http://dx.doi.org/10.5705/ss.2012.139 CONSTRUCTION OF NESTED ORTHOGONAL LATIN HYPERCUBE DESIGNS Jinyu Yang 1, Min-Qian Liu 1 and Dennis K. J. Lin 2 1 Nankai University
More informationA Unified Framework for Uncertainty and Sensitivity Analysis of Computational Models with Many Input Parameters
A Unified Framework for Uncertainty and Sensitivity Analysis of Computational Models with Many Input Parameters C. F. Jeff Wu H. Milton Stewart School of Industrial and Systems Engineering Georgia Institute
More informationEvaluating prediction uncertainty in simulation models
Submitted to Computer Physics Communications LA-UR-98 1362 Evaluating prediction uncertainty in simulation models Michael D. McKay, 1 John D. Morrison, Stephen C. Upton Los Alamos National Laboratory Los
More informationA NEW CLASS OF NESTED (NEARLY) ORTHOGONAL LATIN HYPERCUBE DESIGNS
Statistica Sinica 26 (2016), 1249-1267 doi:http://dx.doi.org/10.5705/ss.2014.029 A NEW CLASS OF NESTED (NEARLY) ORTHOGONAL LATIN HYPERCUBE DESIGNS Xue Yang 1,2, Jian-Feng Yang 2, Dennis K. J. Lin 3 and
More informationMustafa H. Tongarlak Bruce E. Ankenman Barry L. Nelson
Proceedings of the 0 Winter Simulation Conference S. Jain, R. R. Creasey, J. Himmelspach, K. P. White, and M. Fu, eds. RELATIVE ERROR STOCHASTIC KRIGING Mustafa H. Tongarlak Bruce E. Ankenman Barry L.
More informationDesign and Analysis of Computer Experiments for Screening Input Variables. Dissertation. Hyejung Moon, M.S. Graduate Program in Statistics
Design and Analysis of Computer Experiments for Screening Input Variables Dissertation Presented in Partial Fulfillment of the Requirements for the Degree Doctor of Philosophy in the Graduate School of
More informationAn introduction to Bayesian statistics and model calibration and a host of related topics
An introduction to Bayesian statistics and model calibration and a host of related topics Derek Bingham Statistics and Actuarial Science Simon Fraser University Cast of thousands have participated in the
More informationA construction method for orthogonal Latin hypercube designs
Biometrika (2006), 93, 2, pp. 279 288 2006 Biometrika Trust Printed in Great Britain A construction method for orthogonal Latin hypercube designs BY DAVID M. STEINBERG Department of Statistics and Operations
More information18Ï È² 7( &: ÄuANOVAp.O`û5 571 Based on this ANOVA model representation, Sobol (1993) proposed global sensitivity index, S i1...i s = D i1...i s /D, w
A^VÇÚO 1 Êò 18Ï 2013c12 Chinese Journal of Applied Probability and Statistics Vol.29 No.6 Dec. 2013 Optimal Properties of Orthogonal Arrays Based on ANOVA High-Dimensional Model Representation Chen Xueping
More informationOrthogonal and nearly orthogonal designs for computer experiments
Biometrika (2009), 96, 1,pp. 51 65 C 2009 Biometrika Trust Printed in Great Britain doi: 10.1093/biomet/asn057 Advance Access publication 9 January 2009 Orthogonal and nearly orthogonal designs for computer
More informationOPTIMAL DESIGN INPUTS FOR EXPERIMENTAL CHAPTER 17. Organization of chapter in ISSO. Background. Linear models
CHAPTER 17 Slides for Introduction to Stochastic Search and Optimization (ISSO)by J. C. Spall OPTIMAL DESIGN FOR EXPERIMENTAL INPUTS Organization of chapter in ISSO Background Motivation Finite sample
More informationWeighted space-filling designs
Weighted space-filling designs Dave Woods D.Woods@southampton.ac.uk www.southampton.ac.uk/ davew Joint work with Veronica Bowman (Dstl) Supported by the Defence Threat Reduction Agency 1 / 34 Outline Motivation
More informationRandomized Quasi-Monte Carlo for MCMC
Randomized Quasi-Monte Carlo for MCMC Radu Craiu 1 Christiane Lemieux 2 1 Department of Statistics, Toronto 2 Department of Statistics, Waterloo Third Workshop on Monte Carlo Methods Harvard, May 2007
More informationApplication-driven Sequential Designs for Simulation Experiments Kleijnen, J.P.C.; van Beers, W.C.M.
Tilburg University Application-driven Sequential Designs for Simulation Experiments Kleinen, J.P.C.; van Beers, W.C.M. Publication date: 23 Link to publication General rights Copyright and moral rights
More informationBayesian optimal design for Gaussian process models
Bayesian optimal design for Gaussian process models Maria Adamou and Dave Woods Southampton Statistical Sciences Research Institute University of Southampton M.Adamou@southampton.ac.uk 1 Outline Background
More informationOPTIMAL MAXIMIN L 1 -DISTANCE LATIN HYPERCUBE DESIGNS BASED ON GOOD LATTICE POINT DESIGNS 1
The Annals of Statistics 018, Vol. 46, No. 6B, 3741 3766 https://doi.org/10.114/17-aos1674 Institute of Mathematical Statistics, 018 OPTIMAL MAXIMIN L 1 -DISTANCE LATIN HYPERCUBE DESIGNS BASED ON GOOD
More informationarxiv: v1 [math.st] 2 Oct 2010
The Annals of Statistics 2010, Vol. 38, No. 3, 1460 1477 DOI: 10.1214/09-AOS757 c Institute of Mathematical Statistics, 2010 A NEW AND FLEXIBLE METHOD FOR CONSTRUCTING DESIGNS FOR COMPUTER EXPERIMENTS
More informationMaximin Strong Orthogonal Arrays
Maximin Strong Orthogonal Arrays by Jiaying Weng B.Sc. Simon Fraser University 2012 Project Submitted in Partial Fulfillment of the Requirements for the Degree of Master of Science in the Department of
More informationTilburg University. Two-Dimensional Minimax Latin Hypercube Designs van Dam, Edwin. Document version: Publisher's PDF, also known as Version of record
Tilburg University Two-Dimensional Minimax Latin Hypercube Designs van Dam, Edwin Document version: Publisher's PDF, also known as Version of record Publication date: 2005 Link to publication General rights
More informationUniversity, Wuhan, China c College of Physical Science and Technology, Central China Normal. University, Wuhan, China Published online: 25 Apr 2014.
This article was downloaded by: [0.9.78.106] On: 0 April 01, At: 16:7 Publisher: Taylor & Francis Informa Ltd Registered in England and Wales Registered Number: 10795 Registered office: Mortimer House,
More informationSome methods for sensitivity analysis of systems / networks
Article Some methods for sensitivity analysis of systems / networks WenJun Zhang School of Life Sciences, Sun Yat-sen University, Guangzhou 510275, China; International Academy of Ecology and Environmental
More informationNumerical studies of space filling designs: optimization of Latin Hypercube Samples and subprojection properties
Numerical studies of space filling designs: optimization of Latin Hypercube Samples and subprojection properties Guillaume Damblin, Mathieu Couplet, Bertrand Iooss To cite this version: Guillaume Damblin,
More informationConstruction and analysis of Es 2 efficient supersaturated designs
Construction and analysis of Es 2 efficient supersaturated designs Yufeng Liu a Shiling Ruan b Angela M. Dean b, a Department of Statistics and Operations Research, Carolina Center for Genome Sciences,
More informationMixture Designs Based On Hadamard Matrices
Statistics and Applications {ISSN 2452-7395 (online)} Volume 16 Nos. 2, 2018 (New Series), pp 77-87 Mixture Designs Based On Hadamard Matrices Poonam Singh 1, Vandana Sarin 2 and Rashmi Goel 2 1 Department
More informationDesign of experiments for generalized linear models with random block e ects
Design of experiments for generalized linear models with random block e ects Tim Waite timothy.waite@manchester.ac.uk School of Mathematics University of Manchester Tim Waite (U. Manchester) Design for
More informationComputer Model Calibration or Tuning in Practice
Computer Model Calibration or Tuning in Practice Jason L. Loeppky Department of Statistics University of British Columbia Vancouver, BC, V6T 1Z2, CANADA (jason@stat.ubc.ca) Derek Bingham Department of
More informationUse of Design Sensitivity Information in Response Surface and Kriging Metamodels
Optimization and Engineering, 2, 469 484, 2001 c 2002 Kluwer Academic Publishers. Manufactured in The Netherlands. Use of Design Sensitivity Information in Response Surface and Kriging Metamodels J. J.
More informationSENSITIVITY ANALYSIS BY THE USE OF A SURROGATE MODEL IN LB-LOCA: LOFT L2-5 WITH CATHARE-2 V2.5 CODE
The 12 th International Topical Meeting on Nuclear Reactor Thermal Hydraulics () Sheraton Station Square, Pittsburgh, Pennsylvania, U.S.A. September 30-October 4, 2007. Log Number: XXX SENSITIVITY ANALYSIS
More informationDESIGNING COMPUTER EXPERIMENTS TO DETERMINE ROBUST CONTROL VARIABLES
Statistica Sinica 14(2004), 571-590 DESIGNING COMPUTER EXPERIMENTS TO DETERMINE ROBUST CONTROL VARIABLES Jeffrey S. Lehman 1,ThomasJ.Santner 2 and William I. Notz 2 1 Battelle Memorial Institute and 2
More informationMonitoring Wafer Geometric Quality using Additive Gaussian Process
Monitoring Wafer Geometric Quality using Additive Gaussian Process Linmiao Zhang 1 Kaibo Wang 2 Nan Chen 1 1 Department of Industrial and Systems Engineering, National University of Singapore 2 Department
More informationEstimating percentiles of uncertain computer code outputs
Appl. Statist. (2004) 53, Part 1, pp. 83 93 Estimating percentiles of uncertain computer code outputs Jeremy Oakley University of Sheffield, UK [Received June 2001. Final revision June 2003] Summary. A
More informationParameter Selection Techniques and Surrogate Models
Parameter Selection Techniques and Surrogate Models Model Reduction: Will discuss two forms Parameter space reduction Surrogate models to reduce model complexity Input Representation Local Sensitivity
More informationUniform Random Number Generators
JHU 553.633/433: Monte Carlo Methods J. C. Spall 25 September 2017 CHAPTER 2 RANDOM NUMBER GENERATION Motivation and criteria for generators Linear generators (e.g., linear congruential generators) Multiple
More informationCovariance function estimation in Gaussian process regression
Covariance function estimation in Gaussian process regression François Bachoc Department of Statistics and Operations Research, University of Vienna WU Research Seminar - May 2015 François Bachoc Gaussian
More informationOutline Introduction OLS Design of experiments Regression. Metamodeling. ME598/494 Lecture. Max Yi Ren
1 / 34 Metamodeling ME598/494 Lecture Max Yi Ren Department of Mechanical Engineering, Arizona State University March 1, 2015 2 / 34 1. preliminaries 1.1 motivation 1.2 ordinary least square 1.3 information
More informationOptimizing Low-Discrepancy Sequences with an Evolutionary Algorithm
Optimizing Low-Discrepancy Sequences with an Evolutionary Algorithm François-Michel De Rainville Laboratoire de vision et systèmes numériques Département de génie électrique et de génie informatique, Université
More informationAn Algorithm for Constructing Orthogonal and Nearly Orthogonal Arrays with Mixed Levels and Small Runs
An Algorithm for Constructing Orthogonal and Nearly Orthogonal Arrays with Mixed Levels and Small Runs Hongquan Xu Department of Statistics University of California 8130 Math Sciences Bldg Los Angeles,
More informationSurrogate Modeling of Computer Experiments With Different Mesh Densities
Technometrics ISSN: 0040-1706 (Print) 1537-2723 (Online) Journal homepage: http://amstat.tandfonline.com/loi/utch20 Surrogate Modeling of Computer Experiments With Different Mesh Densities Rui Tuo, C.
More informationYouden Square, George Box & Latin Hypercube. The Evolution of Experimental Design. The Evolution of Science
Youden Square to George Box to Latin Hypercube: The Evolution of Experimental Design Dennis Lin University Distinguished Professor The Pennsylvania State University Fall Technical Conference Birmingham,
More informationSpace-Filling Designs for Computer Experiments
Chapter 5 Space-Filling Designs for Computer Experiments 5. Introduction This chapter and the next discusses how to select inputs at which to compute the output of a computer experiment to achieve specific
More informationGaussian Process Regression and Emulation
Gaussian Process Regression and Emulation STAT8810, Fall 2017 M.T. Pratola September 22, 2017 Today Experimental Design; Sensitivity Analysis Designing Your Experiment If you will run a simulator model,
More informationAn adaptive kriging method for characterizing uncertainty in inverse problems
Int Statistical Inst: Proc 58th World Statistical Congress, 2, Dublin Session STS2) p98 An adaptive kriging method for characterizing uncertainty in inverse problems FU Shuai 2 University Paris-Sud & INRIA,
More informationA Polynomial Chaos Approach to Robust Multiobjective Optimization
A Polynomial Chaos Approach to Robust Multiobjective Optimization Silvia Poles 1, Alberto Lovison 2 1 EnginSoft S.p.A., Optimization Consulting Via Giambellino, 7 35129 Padova, Italy s.poles@enginsoft.it
More informationSequential Exploration of Complex Surfaces Using Minimum Energy Designs
Technometrics ISSN: 0040-706 (Print) 537-2723 (Online) Journal homepage: http://www.tandfonline.com/loi/utch20 Sequential Eploration of Comple Surfaces Using Minimum Energy Designs V. Roshan Joseph, Tirthankar
More informationJournal of Statistical Planning and Inference
Journal of Statistical Planning and Inference 42 (22) 763 772 Contents lists available at SciVerse ScienceDirect Journal of Statistical Planning and Inference journal homepage: www.elsevier.com/locate/jspi
More informationTRB 2005: For Presentation and Publication Paper # Final Submission: April 1, 2005 Word Count: 8,191
Simulation Estimation of Mixed Discrete Choice Models Using Randomized Quasi-Monte Carlo Sequences: A Comparison of Alternative Sequences, Scrambling Methods, and Uniform-to-Normal Variate Transformation
More informationBayesian Dynamic Linear Modelling for. Complex Computer Models
Bayesian Dynamic Linear Modelling for Complex Computer Models Fei Liu, Liang Zhang, Mike West Abstract Computer models may have functional outputs. With no loss of generality, we assume that a single computer
More informationA Flexible Strategy for Augmenting Design Points For Computer Experiments
A Flexible Strategy for Augmenting Design Points For Computer Experiments 7 th Dresdner Probabilistik Workshop, 9 th Oct 2014 x j i j Peter M. Flassig*, Ron A. Bates** *Rolls-Royce Deutschland Ltd & Co
More informationUnderstanding the uncertainty in the biospheric carbon flux for England and Wales
Understanding the uncertainty in the biospheric carbon flux for England and Wales John Paul Gosling and Anthony O Hagan 30th November, 2007 Abstract Uncertainty analysis is the evaluation of the distribution
More informationA GENERAL THEORY FOR ORTHOGONAL ARRAY BASED LATIN HYPERCUBE SAMPLING
Statistica Sinica 26 (2016), 761-777 doi:http://dx.doi.org/10.5705/ss.202015.0029 A GENERAL THEORY FOR ORTHOGONAL ARRAY BASED LATIN HYPERCUBE SAMPLING Mingyao Ai, Xiangshun Kong and Kang Li Peking University
More informationE-optimal approximate block designs for treatment-control comparisons
E-optimal approximate block designs for treatment-control comparisons Samuel Rosa 1 1 Faculty of Mathematics, Physics and Informatics, Comenius University in Bratislava, Slovakia We study E-optimal block
More informationEmpirical Bayesian Analysis for Computer Experiments Involving Finite-Difference Codes
Empirical Bayesian Analysis for Computer Experiments Involving Finite-Difference Codes Dorin DRIGNEI and Max D. MORRIS Computer experiments are increasingly used in scientific investigations as substitutes
More informationTutorial on quasi-monte Carlo methods
Tutorial on quasi-monte Carlo methods Josef Dick School of Mathematics and Statistics, UNSW, Sydney, Australia josef.dick@unsw.edu.au Comparison: MCMC, MC, QMC Roughly speaking: Markov chain Monte Carlo
More informationSequential Importance Sampling for Rare Event Estimation with Computer Experiments
Sequential Importance Sampling for Rare Event Estimation with Computer Experiments Brian Williams and Rick Picard LA-UR-12-22467 Statistical Sciences Group, Los Alamos National Laboratory Abstract Importance
More informationLow Discrepancy Sequences in High Dimensions: How Well Are Their Projections Distributed?
Low Discrepancy Sequences in High Dimensions: How Well Are Their Projections Distributed? Xiaoqun Wang 1,2 and Ian H. Sloan 2 1 Department of Mathematical Sciences, Tsinghua University, Beijing 100084,
More informationSimplex-based screening designs for estimating metamodels
Simplex-based screening designs for estimating metamodels Gilles Pujol To cite this version: Gilles Pujol. Simplex-based screening designs for estimating metamodels. Reliability Engineering and System
More informationKRIGING METAMODELING IN MULTI-OBJECTIVE SIMULATION OPTIMIZATION. Mehdi Zakerifar William E. Biles Gerald W. Evans
Proceedings of the 2009 Winter Simulation Conference M. D. Rossetti, R. R. Hill, B. Johansson, A. Dunkin and R. G. Ingalls, eds. KRIGING METAMODELING IN MULTI-OBJECTIVE SIMULATION OPTIMIZATION Mehdi Zakerifar
More informationPolynomial chaos expansions for sensitivity analysis
c DEPARTMENT OF CIVIL, ENVIRONMENTAL AND GEOMATIC ENGINEERING CHAIR OF RISK, SAFETY & UNCERTAINTY QUANTIFICATION Polynomial chaos expansions for sensitivity analysis B. Sudret Chair of Risk, Safety & Uncertainty
More informationSEQUENTIAL DESIGN OF COMPUTER EXPERIMENTS TO MINIMIZE INTEGRATED RESPONSE FUNCTIONS
Statistica Sinica 10(2000), 1133-1152 SEQUENTIAL DESIGN OF COMPUTER EXPERIMENTS TO MINIMIZE INTEGRATED RESPONSE FUNCTIONS Brian J. Williams, Thomas J. Santner and William I. Notz The Ohio State University
More informationUCLA Department of Statistics Papers
UCLA Department of Statistics Papers Title An Algorithm for Constructing Orthogonal and Nearly Orthogonal Arrays with Mixed Levels and Small Runs Permalink https://escholarship.org/uc/item/1tg0s6nq Author
More informationA Statistical Approach to the Study of Qualitative Behavior of Solutions of Second Order Neutral Differential Equations
Australian Journal of Basic and Applied Sciences, (4): 84-833, 007 ISSN 99-878 A Statistical Approach to the Study of Qualitative Behavior of Solutions of Second Order Neutral Differential Equations Seshadev
More informationUnderstanding Uncertainty in Climate Model Components Robin Tokmakian Naval Postgraduate School
Understanding Uncertainty in Climate Model Components Robin Tokmakian Naval Postgraduate School rtt@nps.edu Collaborators: P. Challenor National Oceanography Centre, UK; Jim Gattiker Los Alamos National
More informationDepartment of Statistics, University of Ilorin, P.M.B 1515, Ilorin, Nigeria
33 PERFORMING A SIMPLE PENDULUM EXPERIMENT AS A DEMONSTRATIVE EXAMPLE FOR COMPUTER EXPERIMENTS Kazeem A. Osuolale, Waheed B. Yahya, Babatunde L. Adeleke Department of Statistics, University of Ilorin,
More informationSURROGATE PREPOSTERIOR ANALYSES FOR PREDICTING AND ENHANCING IDENTIFIABILITY IN MODEL CALIBRATION
International Journal for Uncertainty Quantification, ():xxx xxx, 0 SURROGATE PREPOSTERIOR ANALYSES FOR PREDICTING AND ENHANCING IDENTIFIABILITY IN MODEL CALIBRATION Zhen Jiang, Daniel W. Apley, & Wei
More information