A New Robust Design Strategy for Sigmoidal Models Based on Model Nesting
|
|
- Robyn Dawson
- 6 years ago
- Views:
Transcription
1 A New Robust Design Strategy for Sigmoidal Models Based on Model Nesting Timothy E. O'Brien Department of Statistics, Washington State University 1 Introduction For a given process, researchers often have a specific nonlinear model in mind and perhaps a reasonable initial estimate of the p model parameters. In this situation, optimal design-theory produces designs which typically have only p support points even when the final sample size (n) is chosen to exceed the number of parameters. Since p-point designs assume that the model function is known with complete certainty and provide no opportunity to test for the adequacy of the assumed model, they are clearly not"optimal" in most practical settings. The focus of this paper is to provide an algorithm to obtain efficient designs with "extra" design points, or "robust" designs, by nesting a given model function (the "original" model fmiction) in a larger one (the "super- model") which reduces to the original model for certain parameter choices. This design approach, called the nesting design strategy, has been applied to linear models in [1], [2], [7], [14], and [15], and only in very simple instances to nonlinear models in [3] and [6]. The application to nonlinear models is more difficult since the super-model is often less apparent (and more ad hoc) and requires a keen understanding of the nature of the various model functions; for this reason, the discussion here is limited only to sigmoidal growth models (e.g., those given in Chapter 4 of [11] and Chapter 7 of [13]). 2 Sigmoidal Growth _Models Most growth models in current use fall into one ofthree families: theweibull, the Log-Logistic, and the Richards. Special cases of these models include the Logistic, Gompertz, Michaelis-Menton, Mischerlich, and Simple Exponential models, and often several model functions from these families can be used
2 98 to adequately describe a given set of data. For example. the two-parameter Weibull function (W2), and the two-parameter Log-Lo~tic model function (LL2), (1) 1 (2) behave quite similarly over ~+ for certain parameter choices. Since optimal designs for either of these model functions typically have only two support points (see [9]), functions which generalize the Weibull, Log-Logistic, and Richards families are required. One important generalization of (1) is the three-parameter humped Weibull model function (DW3), In some instances, the DW3 model function fits the data obtained in ozone, dose response studies better that the W2 function (see [12]), although the biological interpretation of the corresponding "hump-effect" is not readily apparent. In addition, an important generalizati~n of the Weibull, Log-Logistic and Richards model functions is the six-parameter Eclectic model (E6), (3) 8 1 (4) studied in [10]. Conditions under which this function reduces to the Weibull, Log-Logistic and Richards family members are given in [10]; to illustrate one of these cases, note that the three-parameter Log-Logistic model function (LL3), is obtained from (4) by taking 82 = 0,85 --;. 0, and 86 =1. (5) 3 Optimal Design Theory The design problem for the homoskedastic Gaussian nonlinear model l, "" iid N(O, 0"2) for i =I,...,n typically involves choosing an n-point design, e, to estimate some function of the p-dimensional parameter vector, tp. with high efficiency. This design
3 99 associates the design weights Wi, W2. Wn with the design points (or vectors) Xl! X2, Xn. respectively, and the corresponding (Fisher) information matrix is given by M(t:.J..) = ~. 8'l(xd 8'l(Xi) _ V/nV <".0/.L.J W. 8~ 8~' - u = 1 where V is the nxp Jacobian of'l and 0 = diag{wlj...,wn}. First-order optimal designs typically minimize some convex function of M-l. For example, designs which minimize the determinant 1M - l ee, ~O)I are called locally D-optimal, where the term "locally" is used to emphasize the fact that an initial estimate of the parameter vector has been used. Other first order design criteria are discussed in [2J and [4J, and second-order design criteria-or procedures which provide designs that attempt to reduce curvature in addition to efficiently estimating parameters-are presented in [8J, [9}, and [IOJ. Since optimal designs typically have only p support points regardless of the design criteria and final sample size used (see [9} and [16]), we seek a practical design algorithm which efficiently estimates the model parameters and also provides" extra" design points to check for model mis-speeification. 4 A First-Order Nesting Design Strategy Suppose that a researcher feels that the original model function 'lor(~.) adequately describes a given process, but desires a d~ign which, in addition to efficiently estimating the Pi model parameters of 'lor. also may be used to check for the adequacy of the assumed model. As a first step, we search for a relevant super-model, 'llm(~l' ~2)' such that 'l,m reduces to 'lor when the P2-vector ~2 is equal to some (possibly extended) real vector. It is important that the super-model contains a reasonable generalization of the original model; thus, for example, by nesting the Log-Logistic model function in the Eclectic function, departures from the Log-Logistic model function in the direction of the Weibull and Richards functions may be detected. A measure of the inefficiency that the design ehas in estimating ~l in 'lor is given by IMII-11, and a measure of it's inefficiency regarding detecting departures from 'lor in the direction of'l,m is given by I(M22 -- M21 Mit M12) -,, where Mij = VjOVj (i,j = 1,2); see [2]. We combine these measures into the single (first-order) inefficiency measure, and seek designs designs which are given choices of " and ~ = (~i,~~)', timal here. Note that" controls the
4 100 amount of information obtained regarding estimation of q,1 relative to detecting departures from the original model function, so that when we take..:\ =1, we obtain information only regarding q,1i whereas when we choose..:\ = 0, we obtain information only about departures from the original function. Our recommendation is to obtain the locally D,\-optimal design, 6, such that it's D- \ efficiency relative to the locally D-optimal design, ed, {Mll- 1 (ed) /Mll- 1 (6) 3 is around Examples 5.1 Example 1 An environmental scientist believes that the W2 function in (1) with (}1 = (}2 = 1 adequately describes the dose response relationship of a given cultivar exposed to ozone (x), but wishes to allow for the hump-effect of the HW3 function in (3). Our procedure provides the locally D,\-optimal design using the super-model (3) with (}3 = 0 and..:\ =.95, which associates the weights w = 0.10, 0.43 and 0.47 with the points x = 0.33, 0.63 and 1.30, respectively. This design is preferred to the locally D-optima.I design for estimating the W2 model parameters, ed, since this latter design has only two support points (at x =0.59 and 1.28 each with equal weight), yet is'"close" to ed since it's D-efficiency is 95%. 5.2 Example 2 An animal scientist feels that the LL3 model function in (5) with (}1 =(}3 =1, and 94, = 2 reasonably describes the amount of food left in a cow's rumin x minutes after ingestion, but seeks a design with more than three support points so as to check for mod~l-mis-specification. Using the E6 model function in (4) as the super-model with O2 = 0,95 =.001, (}6 = 1 and..:\ =.95, the corresponding locally D,\-optimal design, e,\, places the weights w = 0.18,' , 0.30, 0.14 and 0.20 at the points x =0, 0.04, 0.23, 0.60, 1.35 and 1.97, and results in a D-efficiency of nearly 97%. This design is preferred to the locally D-optimal design for estimating the LL3 model parameters since this latter design has only three support points (at x = 0, 0.59 and 1.68 each with equal weight). It is important to note that since the E6 function also has the Weibull and Richards families as special cases, 6. protects against departures from the LL3 function in the direction of practically all other sigmoidal curves. 6 A Second-Order Nesting Design Strategy The first-order nesting strategy presented above is easily extended to provide efficient robust designs with reduced marginal curvature by using a penalty,
5 101 {unction approach. Based on Clarke's criterion for the seriousness of curvature (in [5]), we let ki ::: ma.x{lmc , OJ, 1; = ma.x{lmc , OJ, and '/fee, tp) = 2:f;l exp{ai ki +.8i Ii}; here mci is the marginal curvature associated with the ith parameter in "lor, '/f(e I tp) is our curvature penalty function, and the ai's and.8i's are chosen to emphasize certain components of the marginal curvature vector over others. Thus, for 1/;1 in (6), is a second-order inefficiency measure, and "/ E [0,1] controls the degree of emphasis placed on parameter estimation relative to curvature reduction. Designs which minimize 1/;2 for specific choices of,,/, A, and tp, called locally D..y-optimal here, are usually preferred to locally D",-optimal designs when curvature is a concern. For example, the margiqal curvatures associated with 0 3 using the D",-optimal design given in Example 2 is , indicating serious curvature by Clarke's criterion. In contrast, the locally ny-optimal design obtained by minimizing tp2 (with,,/ =.5, A =.95, each aj = 2, and each.8. = 0) is such that no component of the marginal curvature vector exceeds Further, this latter design, which associates the weights 'w = 0.08, , 0.23, 0.21 and 0.20 with the points x = 0, 0.05, 0.13, 0.75, 1.53 and 1.91, is also efficient in estimating.the LL3 model parameters since it's D-efficiency is 90%. 7 Discussion The design strategies presented here provide researchers with a reasonable compromise between so-called" optimal" designs, which typically cannot be used to check whether the assumed model is indeed valid, on the one hand, and designs comprised of arbitrarily chosen design points (f~r example, those with a geometric spacing of points), on the other. The first nesting design strategy is intended to be used with"dose-to-linear" nonlinear models (see [11]); when designs with reduced curvature are desired, the second nesting design strategy should be used. Although our focus here has only been on sigmoidal growth curves, the application of the above procedures to other classes of nonlinear models is obvious provided relevant super-models can be found. References [1] Atkinson, A.C. (1972). Planning experiments to detect inadequate regression models. Biometrika 59, [2] Atkinson, A.C. and Donev, A.N. (1992). Optimum Experimental Designs. Oxford: Clarendon Press.
6 102 [3] Box, G.E.P. and Lucas, H.L. (1959). Design of experiments in non-linear situations. Biometrika 46, [4] Chaloner, K. and Larntz, K. (1989). Optimal Bayesian design applied to logistic regression experiments. J. Stat Plann. Infer. 21, [5] Clarke, G.P.Y. (1987). Marginal curvatures and their usefulness in the analysis of nonlinear regression models. J. Amer Stat. Assoc. 82, [6] Cochran, W.G. (1973). Experiments for nonlinear functions. J. Amer. Stat. Assoc. 68, [7} DeFeo, P. and Myers, R.H. (1992). A new look at experimental design robustness. Biometrika 79, [8] Hamilton, D.C. and Watts, D.G. (1985). A quadratic design criterion for precise estimation in nonlinear regression models. Technometrics 27, [9} O'Brien, T.E. (1992). A note on quadratic designs for nonlinear regression models. Biometrika 79, [10] O'Brien, T.E. (1993). Design strategies for nonlinear regression models. Ph.D. dissertation, North Carolina State University, Raleigh, N.C. [U] Ratkowsky, D.A. (1983). Nonlinear Regression Modeling. New York: Marcel Dekker. [12J Reinert, R.A., Rufty, R.C. and Eason, G. (1988). Interaction of tobacco etch or tobacco vein mottling virus and ozone on biomass changes in Burley tobacco. Envir. Pollution. 53, [13] Seber, G.A.F. and Wild, C.J. (1989). Nonlinear Regression. New York: Wiley. [14} Stigler, S.M. (1971). Optimal experimental design for polynomial regression. J. Amer. Stat. Assoc. 66, [15] Studden, W. J. (1982). Some robust-type D-optimal designs in polynomial regression. J. Amer. Stal. Assoc. 77, [16] Vila, J.P. (1991). Local optimality of replications from a minimal D optimal design in regression: a sufficient and quasi-necessary condition. J. Stat. Plann. Infer. 29,
Paper CD Erika Larsen and Timothy E. O Brien Loyola University Chicago
Abstract: Paper CD-02 2015 SAS Software as an Essential Tool in Statistical Consulting and Research Erika Larsen and Timothy E. O Brien Loyola University Chicago Modelling in bioassay often uses linear,
More informationROBUST OPTIMAL DESIGNS WITH REDUCED CURVATURE
ROBUST OPTIMAL DESIGNS WITH REDUCED CURVATURE Timothy E. O Brien Dept. of Mathematics & Statistics, Loyola University Chicago, 6525 N. Sheridan Rd., Chicago, IL 60626. Email: tobrie1@luc.edu Abstract Researchers
More informationEFFICIENT GEOMETRIC AND UNIFORM DESIGN STRATEGIES FOR SIGMOIDAL REGRESSION MODELS
South African Statist. J. (2009) 43, 49 83 49 EFFICIENT GEOMETRIC AND UNIFORM DESIGN STRATEGIES FOR SIGMOIDAL REGRESSION MODELS Timothy E. O'Brien Department of Mathematics and Statistics, Loyola University
More informationOptimal Designs for Nonlinear Models with Correlated Error. BY Jacqueline M. Hughes-Oliver Department of Statistics North Carolina State University
Optimal Designs for Nonlinear Models with Correlated Error BY Jacqueline M. Hughes-Oliver Department of Statistics North Carolina State University Mimeo Series # 2503 September, 1997 '. Optimal Designs
More informationTransform or Link? Harold V. Henderson Statistics Section, Ruakura Agricultural Centre, Hamilton, New Zealand. and
.. Transform or Link? Harold V. Henderson Statistics Section, Ruakura Agricultural Centre, Hamilton, New Zealand and Charles E. McCulloch Biometrics Unit, Cornell University, thaca, New York 14853, USA
More informationMULTIPLE-OBJECTIVE DESIGNS IN A DOSE-RESPONSE EXPERIMENT
New Developments and Applications in Experimental Design IMS Lecture Notes - Monograph Series (1998) Volume 34 MULTIPLE-OBJECTIVE DESIGNS IN A DOSE-RESPONSE EXPERIMENT BY WEI ZHU AND WENG KEE WONG 1 State
More informationA geometric characterization of c-optimal designs for heteroscedastic regression
A geometric characterization of c-optimal designs for heteroscedastic regression Holger Dette Ruhr-Universität Bochum Fakultät für Mathematik 44780 Bochum, Germany e-mail: holger.dette@rub.de Tim Holland-Letz
More informationOptimal and efficient designs for Gompertz regression models
Ann Inst Stat Math (2012) 64:945 957 DOI 10.1007/s10463-011-0340-y Optimal and efficient designs for Gompertz regression models Gang Li Received: 13 July 2010 / Revised: 11 August 2011 / Published online:
More informationEfficient Experimental Design Strategies in Toxicology and Bioassay
STATISTICS, OPTIMIZATION AND INFORMATION COMPUTING Stat., Optim. Inf. Comput., Vol. 4, June 2016, pp 99 106. Published online in International Academic Press (www.iapress.org) Efficient Experimental Design
More informationFeatures and Partial Derivatives of Bertalanffy-Richards Growth Model in Forestry
Nonlinear Analysis: Modelling and Control, 2004, Vol. 9, No. 1, 65 73 Features and Partial Derivatives of Bertalanffy-Richards Growth Model in Forestry Y.C. Lei 1, S.Y. Zhang 2 1 Research Institute of
More information460 HOLGER DETTE AND WILLIAM J STUDDEN order to examine how a given design behaves in the model g` with respect to the D-optimality criterion one uses
Statistica Sinica 5(1995), 459-473 OPTIMAL DESIGNS FOR POLYNOMIAL REGRESSION WHEN THE DEGREE IS NOT KNOWN Holger Dette and William J Studden Technische Universitat Dresden and Purdue University Abstract:
More informationDesigning Experiments for Nonlinear Models - An Introduction
Calhoun: The NPS Institutional Archive DSpace Repository Faculty and Researchers Faculty and Researchers Collection 2009-08 Designing Experiments for Nonlinear Models - An Introduction Johnson, Rachel
More informationD-optimal designs for logistic regression in two variables
D-optimal designs for logistic regression in two variables Linda M. Haines 1, M. Gaëtan Kabera 2, P. Ndlovu 2 and T. E. O Brien 3 1 Department of Statistical Sciences, University of Cape Town, Rondebosch
More informationAP-Optimum Designs for Minimizing the Average Variance and Probability-Based Optimality
AP-Optimum Designs for Minimizing the Average Variance and Probability-Based Optimality Authors: N. M. Kilany Faculty of Science, Menoufia University Menoufia, Egypt. (neveenkilany@hotmail.com) W. A. Hassanein
More informationOptimal Design for Nonlinear and Spatial Models: Introduction and Historical Overview
12 Optimal Design for Nonlinear and Spatial Models: Introduction and Historical Overview Douglas P. Wiens CONTENTS 12.1 Introduction...457 12.2 Generalized Linear Models...457 12.3 Selected Nonlinear Models...460
More informationOPTIMAL DESIGNS FOR GENERALIZED LINEAR MODELS WITH MULTIPLE DESIGN VARIABLES
Statistica Sinica 21 (2011, 1415-1430 OPTIMAL DESIGNS FOR GENERALIZED LINEAR MODELS WITH MULTIPLE DESIGN VARIABLES Min Yang, Bin Zhang and Shuguang Huang University of Missouri, University of Alabama-Birmingham
More informationON THE DISTRIBUTION OF RESIDUALS IN FITTED PARAMETRIC MODELS. C. P. Quesenberry and Charles Quesenberry, Jr.
.- ON THE DISTRIBUTION OF RESIDUALS IN FITTED PARAMETRIC MODELS C. P. Quesenberry and Charles Quesenberry, Jr. Results of a simulation study of the fit of data to an estimated parametric model are reported.
More informationA Test of Homogeneity Against Umbrella Scale Alternative Based on Gini s Mean Difference
J. Stat. Appl. Pro. 2, No. 2, 145-154 (2013) 145 Journal of Statistics Applications & Probability An International Journal http://dx.doi.org/10.12785/jsap/020207 A Test of Homogeneity Against Umbrella
More informationOptimal designs for estimating the slope in nonlinear regression
Optimal designs for estimating the slope in nonlinear regression Holger Dette Ruhr-Universität Bochum Fakultät für Mathematik 44780 Bochum, Germany e-mail: holger.dette@rub.de Viatcheslav B. Melas St.
More informationNew Challenges and Strategies in Robust Optimal Design for Multicategory Logit Modelling
New Challenges and Strategies in Robust Optimal Design for Multicategory Logit Modelling Timothy E. O Brien and Changwon Lim Introduction Binary logistic and multi-category logit (MCL) regression models
More informationAnalysis of variance and linear contrasts in experimental design with generalized secant hyperbolic distribution
Journal of Computational and Applied Mathematics 216 (2008) 545 553 www.elsevier.com/locate/cam Analysis of variance and linear contrasts in experimental design with generalized secant hyperbolic distribution
More informationOptimum Designs for the Equality of Parameters in Enzyme Inhibition Kinetic Models
Optimum Designs for the Equality of Parameters in Enzyme Inhibition Kinetic Models Anthony C. Atkinson, Department of Statistics, London School of Economics, London WC2A 2AE, UK and Barbara Bogacka, School
More informationBAYESIAN ANALYSIS OF DOSE-RESPONSE CALIBRATION CURVES
Libraries Annual Conference on Applied Statistics in Agriculture 2005-17th Annual Conference Proceedings BAYESIAN ANALYSIS OF DOSE-RESPONSE CALIBRATION CURVES William J. Price Bahman Shafii Follow this
More informationD-Optimal Designs for Second-Order Response Surface Models with Qualitative Factors
Journal of Data Science 920), 39-53 D-Optimal Designs for Second-Order Response Surface Models with Qualitative Factors Chuan-Pin Lee and Mong-Na Lo Huang National Sun Yat-sen University Abstract: Central
More informationLogistic Regression Logistic
Case Study 1: Estimating Click Probabilities L2 Regularization for Logistic Regression Machine Learning/Statistics for Big Data CSE599C1/STAT592, University of Washington Carlos Guestrin January 10 th,
More informationCOMPARING TRANSFORMATIONS USING TESTS OF SEPARATE FAMILIES. Department of Biostatistics, University of North Carolina at Chapel Hill, NC.
COMPARING TRANSFORMATIONS USING TESTS OF SEPARATE FAMILIES by Lloyd J. Edwards and Ronald W. Helms Department of Biostatistics, University of North Carolina at Chapel Hill, NC. Institute of Statistics
More informationJournal of Biostatistics and Epidemiology
Journal of Biostatistics and Epidemiology Original Article Robust correlation coefficient goodness-of-fit test for the Gumbel distribution Abbas Mahdavi 1* 1 Department of Statistics, School of Mathematical
More informationNonparametric Regression Estimation for Nonlinear Systems: A Case Study of Sigmoidal Growths
Pakistan Journal of Social Sciences (PJSS) Vol. 31, No. 2 (December 2011), pp. 423-432 Nonparametric Regression Estimation for Nonlinear Systems: A Case Study of Sigmoidal Growths Atif Akbar Department
More informationAND JOANNA CHUNG-IN CHENG. University of Michigan. Summary
Austral. J. Statist. 38(), 996, 83-89 A NEW MEASURE OF ROTATABILITY OF RESPONSE SURFACE DESIGNS ANANT M. KSHIRSAGAR AND JOANNA CHUNG-IN CHENG University of Michigan Summary This paper proposes a new measure
More informationCh 4. Linear Models for Classification
Ch 4. Linear Models for Classification Pattern Recognition and Machine Learning, C. M. Bishop, 2006. Department of Computer Science and Engineering Pohang University of Science and echnology 77 Cheongam-ro,
More informationREGRESSION WITH CORRELATED ERRORS C.A. GLASBEY
41 REGRESSION WITH CORRELATED ERRORS C.A. GLASBEY SYSTEMATIC RESIDUALS When data exhibit systematic departures from a fitted regression line (see for example Figs 1 and 2), either the regression function
More informationESTIMATING RHEOLOGICAL PROPERTIES OF YOGURT USING DIFFERENT VERSIONS OF THE FREUNDLICH MODEL AND DESIGN MATRICES
Libraries Conference on Applied Statistics in Agriculture 2004-16th Annual Conference Proceedings ESTIMATING RHEOLOGICAL PROPERTIES OF YOGURT USING DIFFERENT VERSIONS OF THE FREUNDLICH MODEL AND DESIGN
More informationYield Crop Forecasting: A Non-linear Approach Based on weather Variables
Yield Crop Forecasting: A Non-linear Approach Based on weather Variables Sanjeev Panwar, K. N. Singh, Anil Kumar and Abhishek Rathore Indian Agricultural Statistics Research Institute, New Delhi, India
More informationAppendix IV Experimental Design
Experimental Design The aim of pharmaceutical formulation and development is to develop an acceptable pharmaceutical formulation in the shortest possible time, using minimum number of working hours and
More informationA Note on Bayesian Inference After Multiple Imputation
A Note on Bayesian Inference After Multiple Imputation Xiang Zhou and Jerome P. Reiter Abstract This article is aimed at practitioners who plan to use Bayesian inference on multiplyimputed datasets in
More informationResponse surface methodology: advantages and challenges
100 FORUM The forum series invites readers to discuss issues and suggest possible improvements that can help in developing new methods towards the advancing of current existing processes and applied methods
More informationReading Group on Deep Learning Session 1
Reading Group on Deep Learning Session 1 Stephane Lathuiliere & Pablo Mesejo 2 June 2016 1/31 Contents Introduction to Artificial Neural Networks to understand, and to be able to efficiently use, the popular
More informationOrthogonal, Planned and Unplanned Comparisons
This is a chapter excerpt from Guilford Publications. Data Analysis for Experimental Design, by Richard Gonzalez Copyright 2008. 8 Orthogonal, Planned and Unplanned Comparisons 8.1 Introduction In this
More informationON THE FAILURE RATE ESTIMATION OF THE INVERSE GAUSSIAN DISTRIBUTION
ON THE FAILURE RATE ESTIMATION OF THE INVERSE GAUSSIAN DISTRIBUTION ZHENLINYANGandRONNIET.C.LEE Department of Statistics and Applied Probability, National University of Singapore, 3 Science Drive 2, Singapore
More informationDefense Technical Information Center Compilation Part Notice
UNCLASSIFIED Defense Technical Information Center Compilation Part Notice ADP014614 TITLE: Precision of Simultaneous Measurement Procedures DISTRIBUTION: Approved for public release, distribution unlimited
More informationCalibrating Environmental Engineering Models and Uncertainty Analysis
Models and Cornell University Oct 14, 2008 Project Team Christine Shoemaker, co-pi, Professor of Civil and works in applied optimization, co-pi Nikolai Blizniouk, PhD student in Operations Research now
More informationON D-OPTIMAL DESIGNS FOR ESTIMATING SLOPE
Sankhyā : The Indian Journal of Statistics 999, Volume 6, Series B, Pt. 3, pp. 488 495 ON D-OPTIMAL DESIGNS FOR ESTIMATING SLOPE By S. HUDA and A.A. AL-SHIHA King Saud University, Riyadh, Saudi Arabia
More informationNow consider the case where E(Y) = µ = Xβ and V (Y) = σ 2 G, where G is diagonal, but unknown.
Weighting We have seen that if E(Y) = Xβ and V (Y) = σ 2 G, where G is known, the model can be rewritten as a linear model. This is known as generalized least squares or, if G is diagonal, with trace(g)
More informationStatistical Modeling for Citrus Yield in Pakistan
European Journal of Scientific Research ISSN 1450-216X Vol.31 No.1 (2009, pp. 52-58 EuroJournals Publishing, Inc. 2009 http://www.eurojournals.com/ejsr.htm Statistical Modeling for Citrus Yield in Pakistan
More informationStatistical Practice
Statistical Practice A Note on Bayesian Inference After Multiple Imputation Xiang ZHOU and Jerome P. REITER This article is aimed at practitioners who plan to use Bayesian inference on multiply-imputed
More informationMarcia Gumpertz and Sastry G. Pantula Department of Statistics North Carolina State University Raleigh, NC
A Simple Approach to Inference in Random Coefficient Models March 8, 1988 Marcia Gumpertz and Sastry G. Pantula Department of Statistics North Carolina State University Raleigh, NC 27695-8203 Key Words
More informationIntroduction to Machine Learning
Introduction to Machine Learning Logistic Regression Varun Chandola Computer Science & Engineering State University of New York at Buffalo Buffalo, NY, USA chandola@buffalo.edu Chandola@UB CSE 474/574
More informationOn Bayesian Inference with Conjugate Priors for Scale Mixtures of Normal Distributions
Journal of Applied Probability & Statistics Vol. 5, No. 1, xxx xxx c 2010 Dixie W Publishing Corporation, U. S. A. On Bayesian Inference with Conjugate Priors for Scale Mixtures of Normal Distributions
More informationModel Selection for Semiparametric Bayesian Models with Application to Overdispersion
Proceedings 59th ISI World Statistics Congress, 25-30 August 2013, Hong Kong (Session CPS020) p.3863 Model Selection for Semiparametric Bayesian Models with Application to Overdispersion Jinfang Wang and
More informationAN ENHANCED RECURSIVE STOPPING RULE FOR STEEPEST ASCENT SEARCHES IN RESPONSE SURFACE METHODOLOGY.
AN ENHANCED RECURSIVE STOPPING RULE FOR STEEPEST ASCENT SEARCHES IN RESPONSE SURFACE METHODOLOGY. Guillermo Miró and Enrique Del Castillo Department of Industrial and Manufacturing Engineering The Pennsylvania
More informationUnit 20: Planning Accelerated Life Tests
Unit 20: Planning Accelerated Life Tests Ramón V. León Notes largely based on Statistical Methods for Reliability Data by W.Q. Meeker and L. A. Escobar, Wiley, 1998 and on their class notes. 11/13/2004
More informationBAYESIAN ESTIMATION OF THE EXPONENTI- ATED GAMMA PARAMETER AND RELIABILITY FUNCTION UNDER ASYMMETRIC LOSS FUNC- TION
REVSTAT Statistical Journal Volume 9, Number 3, November 211, 247 26 BAYESIAN ESTIMATION OF THE EXPONENTI- ATED GAMMA PARAMETER AND RELIABILITY FUNCTION UNDER ASYMMETRIC LOSS FUNC- TION Authors: Sanjay
More informationResponse Surface Methodology IV
LECTURE 8 Response Surface Methodology IV 1. Bias and Variance If y x is the response of the system at the point x, or in short hand, y x = f (x), then we can write η x = E(y x ). This is the true, and
More informationPrediction Intervals in the Presence of Outliers
Prediction Intervals in the Presence of Outliers David J. Olive Southern Illinois University July 21, 2003 Abstract This paper presents a simple procedure for computing prediction intervals when the data
More informationRegression Graphics. 1 Introduction. 2 The Central Subspace. R. D. Cook Department of Applied Statistics University of Minnesota St.
Regression Graphics R. D. Cook Department of Applied Statistics University of Minnesota St. Paul, MN 55108 Abstract This article, which is based on an Interface tutorial, presents an overview of regression
More informationROBUSTNESS OF TWO-PHASE REGRESSION TESTS
REVSTAT Statistical Journal Volume 3, Number 1, June 2005, 1 18 ROBUSTNESS OF TWO-PHASE REGRESSION TESTS Authors: Carlos A.R. Diniz Departamento de Estatística, Universidade Federal de São Carlos, São
More informationCase Study 1: Estimating Click Probabilities. Kakade Announcements: Project Proposals: due this Friday!
Case Study 1: Estimating Click Probabilities Intro Logistic Regression Gradient Descent + SGD Machine Learning for Big Data CSE547/STAT548, University of Washington Sham Kakade April 4, 017 1 Announcements:
More informationMultiphasic growth models for cattle
Czech J. Anim. Sci., 50, 2005 (8): 347 354 Original Paper Multiphasic growth models for cattle H. NEŠETŘILOVÁ Czech University of Agriculture, Prague, Czech Republic ABSTRACT: There are several ways of
More informationANALYSIS OF NONLINEAR REGRESSION MODELS: A CAUTIONARY NOTE
Dose-Response: An International Journal Volume 3 Issue 4 Article 7 9-2005 ANALYSIS OF NONLINEAR REGRESSION MODELS: A CAUTIONARY NOTE Shyamal D Peddada National Institutes of Health, Research Triangle Park,
More informationMachine Learning Lecture 7
Course Outline Machine Learning Lecture 7 Fundamentals (2 weeks) Bayes Decision Theory Probability Density Estimation Statistical Learning Theory 23.05.2016 Discriminative Approaches (5 weeks) Linear Discriminant
More informationModel Comparison. Course on Bayesian Inference, WTCN, UCL, February Model Comparison. Bayes rule for models. Linear Models. AIC and BIC.
Course on Bayesian Inference, WTCN, UCL, February 2013 A prior distribution over model space p(m) (or hypothesis space ) can be updated to a posterior distribution after observing data y. This is implemented
More informationWe are IntechOpen, the world s leading publisher of Open Access books Built by scientists, for scientists. International authors and editors
We are IntechOpen, the world s leading publisher of Open Access books Built by scientists, for scientists 3,500 108,000 1.7 M Open access books available International authors and editors Downloads Our
More informationOn construction of constrained optimum designs
On construction of constrained optimum designs Institute of Control and Computation Engineering University of Zielona Góra, Poland DEMA2008, Cambridge, 15 August 2008 Numerical algorithms to construct
More informationClassification Logistic Regression
Announcements: Classification Logistic Regression Machine Learning CSE546 Sham Kakade University of Washington HW due on Friday. Today: Review: sub-gradients,lasso Logistic Regression October 3, 26 Sham
More informationDiscussion of Maximization by Parts in Likelihood Inference
Discussion of Maximization by Parts in Likelihood Inference David Ruppert School of Operations Research & Industrial Engineering, 225 Rhodes Hall, Cornell University, Ithaca, NY 4853 email: dr24@cornell.edu
More informationHeteroscedastic T-Optimum Designs for Multiresponse Dynamic Models
Heteroscedastic T-Optimum Designs for Multiresponse Dynamic Models Dariusz Uciński 1 and Barbara Bogacka 2 1 Institute of Control and Computation Engineering, University of Zielona Góra, ul. Podgórna 50,
More informationUseful Numerical Statistics of Some Response Surface Methodology Designs
Journal of Mathematics Research; Vol. 8, No. 4; August 20 ISSN 19-9795 E-ISSN 19-9809 Published by Canadian Center of Science and Education Useful Numerical Statistics of Some Response Surface Methodology
More informationBFF Four: Are we Converging?
BFF Four: Are we Converging? Nancy Reid May 2, 2017 Classical Approaches: A Look Way Back Nature of Probability BFF one to three: a look back Comparisons Are we getting there? BFF Four Harvard, May 2017
More information2 Introduction to Response Surface Methodology
2 Introduction to Response Surface Methodology 2.1 Goals of Response Surface Methods The experimenter is often interested in 1. Finding a suitable approximating function for the purpose of predicting a
More informationOptimal designs for multi-response generalized linear models with applications in thermal spraying
Optimal designs for multi-response generalized linear models with applications in thermal spraying Holger Dette Ruhr-Universität Bochum Fakultät für Mathematik 44780 Bochum Germany email: holger.dette@ruhr-uni-bochum.de
More informationComparison with RSS-Based Model Selection Criteria for Selecting Growth Functions
TR-No. 14-07, Hiroshima Statistical Research Group, 1 12 Comparison with RSS-Based Model Selection Criteria for Selecting Growth Functions Keisuke Fukui 2, Mariko Yamamura 1 and Hirokazu Yanagihara 2 1
More informationMINIMAX OPTIMAL DESIGNS IN NONLINEAR REGRESSION MODELS
Statistica Sinica 8(998, 49-64 MINIMAX OPTIMAL DESIGNS IN NONLINEAR REGRESSION MODELS Holger Dette and Michael Sahm Ruhr-Universität Bochum Astract: We consider the maximum variance optimality criterion
More informationHoward Mark and Jerome Workman Jr.
Linearity in Calibration: How to Test for Non-linearity Previous methods for linearity testing discussed in this series contain certain shortcomings. In this installment, the authors describe a method
More informationChapter 1 Statistical Inference
Chapter 1 Statistical Inference causal inference To infer causality, you need a randomized experiment (or a huge observational study and lots of outside information). inference to populations Generalizations
More informationDesign of experiments for generalized linear models with random block e ects
Design of experiments for generalized linear models with random block e ects Tim Waite timothy.waite@manchester.ac.uk School of Mathematics University of Manchester Tim Waite (U. Manchester) Design for
More informationLack-of-fit Tests to Indicate Material Model Improvement or Experimental Data Noise Reduction
Lack-of-fit Tests to Indicate Material Model Improvement or Experimental Data Noise Reduction Charles F. Jekel and Raphael T. Haftka University of Florida, Gainesville, FL, 32611, USA Gerhard Venter and
More informationADAPTIVE EXPERIMENTAL DESIGNS. Maciej Patan and Barbara Bogacka. University of Zielona Góra, Poland and Queen Mary, University of London
ADAPTIVE EXPERIMENTAL DESIGNS FOR SIMULTANEOUS PK AND DOSE-SELECTION STUDIES IN PHASE I CLINICAL TRIALS Maciej Patan and Barbara Bogacka University of Zielona Góra, Poland and Queen Mary, University of
More informationEfficient Choice of Biasing Constant. for Ridge Regression
Int. J. Contemp. Math. Sciences, Vol. 3, 008, no., 57-536 Efficient Choice of Biasing Constant for Ridge Regression Sona Mardikyan* and Eyüp Çetin Department of Management Information Systems, School of
More informationData Mining. Linear & nonlinear classifiers. Hamid Beigy. Sharif University of Technology. Fall 1396
Data Mining Linear & nonlinear classifiers Hamid Beigy Sharif University of Technology Fall 1396 Hamid Beigy (Sharif University of Technology) Data Mining Fall 1396 1 / 31 Table of contents 1 Introduction
More informationOPTIMIZATION OF FIRST ORDER MODELS
Chapter 2 OPTIMIZATION OF FIRST ORDER MODELS One should not multiply explanations and causes unless it is strictly necessary William of Bakersville in Umberto Eco s In the Name of the Rose 1 In Response
More informationJim Lambers MAT 419/519 Summer Session Lecture 13 Notes
Jim Lambers MAT 419/519 Summer Session 2011-12 Lecture 13 Notes These notes correspond to Section 4.1 in the text. Least Squares Fit One of the most fundamental problems in science and engineering is data
More informationClasses of Second-Order Split-Plot Designs
Classes of Second-Order Split-Plot Designs DATAWorks 2018 Springfield, VA Luis A. Cortés, Ph.D. The MITRE Corporation James R. Simpson, Ph.D. JK Analytics, Inc. Peter Parker, Ph.D. NASA 22 March 2018 Outline
More informationModelling Academic Risks of Students in a Polytechnic System With the Use of Discriminant Analysis
Progress in Applied Mathematics Vol. 6, No., 03, pp. [59-69] DOI: 0.3968/j.pam.955803060.738 ISSN 95-5X [Print] ISSN 95-58 [Online] www.cscanada.net www.cscanada.org Modelling Academic Risks of Students
More informationConjugate Directions for Stochastic Gradient Descent
Conjugate Directions for Stochastic Gradient Descent Nicol N Schraudolph Thore Graepel Institute of Computational Science ETH Zürich, Switzerland {schraudo,graepel}@infethzch Abstract The method of conjugate
More informationCOMS 4771 Introduction to Machine Learning. James McInerney Adapted from slides by Nakul Verma
COMS 4771 Introduction to Machine Learning James McInerney Adapted from slides by Nakul Verma Announcements HW1: Please submit as a group Watch out for zero variance features (Q5) HW2 will be released
More informationEstimation in Generalized Linear Models with Heterogeneous Random Effects. Woncheol Jang Johan Lim. May 19, 2004
Estimation in Generalized Linear Models with Heterogeneous Random Effects Woncheol Jang Johan Lim May 19, 2004 Abstract The penalized quasi-likelihood (PQL) approach is the most common estimation procedure
More informationσ(a) = a N (x; 0, 1 2 ) dx. σ(a) = Φ(a) =
Until now we have always worked with likelihoods and prior distributions that were conjugate to each other, allowing the computation of the posterior distribution to be done in closed form. Unfortunately,
More informationECE521 lecture 4: 19 January Optimization, MLE, regularization
ECE521 lecture 4: 19 January 2017 Optimization, MLE, regularization First four lectures Lectures 1 and 2: Intro to ML Probability review Types of loss functions and algorithms Lecture 3: KNN Convexity
More informationEngineering Part IIB: Module 4F10 Statistical Pattern Processing Lecture 6: Multi-Layer Perceptrons I
Engineering Part IIB: Module 4F10 Statistical Pattern Processing Lecture 6: Multi-Layer Perceptrons I Phil Woodland: pcw@eng.cam.ac.uk Michaelmas 2012 Engineering Part IIB: Module 4F10 Introduction In
More informationSMA 6304 / MIT / MIT Manufacturing Systems. Lecture 10: Data and Regression Analysis. Lecturer: Prof. Duane S. Boning
SMA 6304 / MIT 2.853 / MIT 2.854 Manufacturing Systems Lecture 10: Data and Regression Analysis Lecturer: Prof. Duane S. Boning 1 Agenda 1. Comparison of Treatments (One Variable) Analysis of Variance
More informationFINDING IMPORTANT INDEPENDENT VARIABLES THROUGH SCREENING DESIGNS: A COMPARISON OF METHODS. Linda Trocine Linda C. Malone
Proceedings of the 2000 Winter Simulation Conference J. A. Joines, R. R. Barton, K. Kang, and P. A. Fishwick, eds. FINDING IMPORTANT INDEPENDENT VARIABLES THROUGH SCREENING DESIGNS: A COMPARISON OF METHODS
More informationCritical points in logistic growth curves and treatment comparisons
308 Scientia Critical points Agricola in logistic growth curves and treatment comparisons José Raimundo de Souza Passos, Sheila Zambello de Pinho*, Lídia Raquel de Carvalho, Martha Maria Mischan UNESP/IBB
More informationVasil Khalidov & Miles Hansard. C.M. Bishop s PRML: Chapter 5; Neural Networks
C.M. Bishop s PRML: Chapter 5; Neural Networks Introduction The aim is, as before, to find useful decompositions of the target variable; t(x) = y(x, w) + ɛ(x) (3.7) t(x n ) and x n are the observations,
More informationStatistical Inference Using Maximum Likelihood Estimation and the Generalized Likelihood Ratio
\"( Statistical Inference Using Maximum Likelihood Estimation and the Generalized Likelihood Ratio When the True Parameter Is on the Boundary of the Parameter Space by Ziding Feng 1 and Charles E. McCulloch2
More informationNeural Network Training
Neural Network Training Sargur Srihari Topics in Network Training 0. Neural network parameters Probabilistic problem formulation Specifying the activation and error functions for Regression Binary classification
More informationD-optimal Designs for Multinomial Logistic Models
D-optimal Designs for Multinomial Logistic Models Jie Yang University of Illinois at Chicago Joint with Xianwei Bu and Dibyen Majumdar October 12, 2017 1 Multinomial Logistic Models Cumulative logit model:
More informationNonlinear Support Vector Machines through Iterative Majorization and I-Splines
Nonlinear Support Vector Machines through Iterative Majorization and I-Splines P.J.F. Groenen G. Nalbantov J.C. Bioch July 9, 26 Econometric Institute Report EI 26-25 Abstract To minimize the primal support
More informationAn Information Criteria for Order-restricted Inference
An Information Criteria for Order-restricted Inference Nan Lin a, Tianqing Liu 2,b, and Baoxue Zhang,2,b a Department of Mathematics, Washington University in Saint Louis, Saint Louis, MO 633, U.S.A. b
More informationPart IV Statistics in Epidemiology
Part IV Statistics in Epidemiology There are many good statistical textbooks on the market, and we refer readers to some of these textbooks when they need statistical techniques to analyze data or to interpret
More informationActivity #12: More regression topics: LOWESS; polynomial, nonlinear, robust, quantile; ANOVA as regression
Activity #12: More regression topics: LOWESS; polynomial, nonlinear, robust, quantile; ANOVA as regression Scenario: 31 counts (over a 30-second period) were recorded from a Geiger counter at a nuclear
More information