Local&Bayesianoptimaldesigns in binary bioassay

Size: px
Start display at page:

Download "Local&Bayesianoptimaldesigns in binary bioassay"

Transcription

1 Local&Bayesianoptimaldesigns in binary bioassay D.M.Smith Office of Biostatistics & Bioinformatics Medicial College of Georgia. New Directions in Experimental Design (DAE 2003 Chicago) 1

2 Review of binary bioassay. Local and Bayesian optimal designs A range of (GLM) link functions & prior distributions. Usually no closed form solutions for Bayesian optimal designs, so many of the investigations are numerical. 2

3 Single substance binary bioassays. Probability of response π has the form π(x; θ) =F (α + βx) =F (z), z = α + βx θ T =(α, β) vector of unknown parameters. F () is a cumulative distribution function An alternative parametrization is z = β(x µ), θ T =(µ, β), where µ = α β. GLM terminology, z is the linear predictor and the inverse function F 1 () is the link function. Assumed that x = log(dose) and β 0. 3

4 Figure 1: pdf & cdf normal tolerance distribution mean µ = α β,sdσ = 1 β 4

5 Link function Logit Probit Φ normal c.d.f. Double exponential s = sign(z) Double reciprocal s = sign(z) F (z) 1/(1 + exp( z)) Φ(z) (1 + s) s 2 2 exp( z ) (1 + s) s ( ) z Complementary log log 1 exp[ exp(z) ] Skewed logit m = 1/3, 2/3, 3/2, 3 1/(1 + exp( z)) m 5

6 Bioassays comparing two substances. Parameter of interest is the potency of one substance compared to the other. Analysed using the parallel line model π(x; θ) =F (z) = F (α + β(x ρm)) or F (z) = F (β(x µ ρm)) θ T =(α, β, ρ) or θ T =(µ, β, ρ) m is a factor taking the value 0 or 1 representing the two substances. ρ is the log(potency) and is the horizontal distance between the two parallel lines. 6

7 Figure 2: comparative binary bioassay 7

8 Prior distributions Fixed values, locally optimal designs. Independent uniform distributions or, more generally, independent beta distributions. Multivariate normal distributions. Others e.g. bivariate normal for α(µ) & β, ρ an independent beta distribution for comparative bioassay of two substances. 8

9 Criterion functions All are functions of the expected information matrix. Let ξ = x 1, x 2,, x k w 1, w 2,, w k m 1, m 2,, m k denote a design with distinct support points x 1,,x k, weights w i at x i,where0 w i 1 and w i =1,andm i = 0 or 1 depending on substance. For θ T = (α, β, ρ), the elements of the information matrix I(ξ; θ) are i αα = w i fi 2 π i (1 π i ) i ββ = w i (x i ρm i ) 2 fi 2 π i (1 π i ) i βρ = β m i w i (x i ρm i )fi 2 π i (1 π i ) i αβ = w i (x i ρm i )fi 2 π i (1 π i ) i αρ = β m i w i fi 2 π i (1 π i ) i ρρ = β 2 m i w i fi 2 π i (1 π i ) where f i = F (α + β(x i ρm i )) and the summations are for i = 1,...,k. 9

10 Various criterion functions, φ(ξ) considered. Criterion φ(ξ) log (deti(ξ; θ)) I(ξ; θ) 1 ρρ log (deti(ξ; θ)) + log(i(ξ; θ) αα ) Associated directional derivative functions h(x) (General Equivalence Theorem). Directional derivative h(x) tr(i(x; θ) I(ξ; θ) 1 ) 3 (I(ξ; θ) 1 I(x; θ) I(ξ; θ) 1 ) ρρ + φ(ξ) tr(i(x; θ) I(ξ; θ) 1 ) I(x; θ) αα I(ξ; θ) 1 αα 2 Used to check optimality. If design optimal h(x) has a maximum value of zero, attained at, and only at, the support points of the design. φ(ξ) andh(x) for locally optimal designs. For Bayesian designs replaced by their expectation over the prior distribution of the parameters. Designs conveniently expressed as response probability π, or the linear predictor z. 10

11 Closed form solutions are not generally available for Bayesian optimal designs. Solutions have been found for simple cases. Prior distributions for the parameters leads to (Bayesian) designs where the range of doses around the support points showing efficiencies close to maximal widens. Also, the number of support points increases as the spread of the prior distributions increases. 11

12 Example Ashton (1972): Chrysanthemum aphid data Rotenone Deguelin dose x r n π dose x r n π Fitting parallel line model by non linear function minimisation using a logit link function gives ˆα = 4.629, ˆβ = and ˆρ = where Rotenone is taken as the standard (i.e. α = α R ). The variance/covariance matrix is ˆα ˆβ ˆρ ˆα ˆβ ˆρ

13 Logit link function, values of previous slide as the parameters of a trivariate normal prior distribution give Bayesian optimal designs as follows. Local optimal designs included for purposes of comparison. Value of the associated criterion the expectation under the trivariate normal prior distribution. Local and Bayesian optimal designs log determinant Standard Test Criterion (Rotenone) (Deguelin) value local x i w i Bayesian x i w i variance of ˆρ Standard Test Criterion (Rotenone) (Deguelin) value local x i w i Bayesian x i β =6.776 w i Bayesian x i β not fixed w i log determinant sub matrix Standard Test Criterion (Rotenone) (Deguelin) value local x i w i Bayesian x i w i

14 Figure 3: h(x) function for logistic, variance of ˆρ, tri-variate normal prior 14

15 A design similar to that of original data (same support points but equal weights of 0.1) with the trivariate normal prior distribution gives criteria values of , and for the respective criteria. There is a clear benefit in using the optimal designs in preference to repeating this design. Use of the local optimal designs with the same trivariate normal prior distribution results in only very small increases in criterion values. The designs for the variance of ˆρ criterion illustrate that if β is assumed known, two-point Bayesian optimal designs can be found. For the log determinant and log determinant of a sub-matrix criteria, the Bayesian optimal designs with β assumed known are the same as the local optimal design for the variance of ˆρ. 15

16 Often, precise information is available for α and β but not for ρ. To illustrate how the designs change, Bayesian optimal designs were found for a logistic link; variance of ˆρ and log determinant of a sub matrix criteria; and uniform priors with ranges to α to β to ρ Bayesian optimal designs log determinant Standard (Rotenone) Test (Deguelin) x i w i variance of ˆρ Standard (Rotenone) Test (Deguelin) x i w i log determinant sub matrix Standard (Rotenone) Test (Deguelin) x i w i

17 Figure 4: logistic, variance of ˆρ, priors uniforms α, β, ρ 17

18 For a logistic link and a trivariate normal prior based on the aphid data, how two point designs (expressed as values of π) with equal weights compare with respect to criterion values. Table 19.2 of Finney (1971), criteria values Support points variance log determinant as π of ˆρ sub matrix Bayesian The Bayesian optimal design for the variance of ρ is π i 0.41, 0.66 standard w i 0.323, π i 0.37, 0.52 test w i 0.076,

19 Discussion Appropriate model, consider use of an optimal design. Precision could be improved. Drawback of optimal designs, often too few support points to assess the fit of the model. Practical usefulness of local optimal designs limited by their dependence on the unknown underlying parameter values. Benchmark for other designs. Often use will result in only a small increase in criterion value. Bayesian optimal designs. As spreads of the prior distributions increase, the number of support points increase. Numerical optimization of φ(ξ) can be difficult. Designs are asymptotic ones, presume a population of infinite size is available. In practice, finite size. The designs here approximate designs. Weights representing integer numbers exact designs. 19

20 Future work Transforma- Skewed logit power parameter. tions of response. Introduction of control mortality and/or immunity. Generalized Linear Models and related. Random effects and variance components. Cost:benefit comparisons exact and approximate designs. 20

21 References Ashton, W.D. (1972). The Logit Transformation. Charles Griffin & Company Ltd. Chaloner, K. (1993). A note on optimal Bayesian design for nonlinear problems. J.Statist.Plann.Inference, 37, Chaloner, K. & Larntz, K. (1989). Optimal Bayesian design applied to logistic regression experiments. J.Statist.Plann.Inference, 21, Fan, S. & Chaloner, K. (1999). Geometric Methods for Singular C Optimal Designs. Technical Report No. 629, University of Minnesota. Finney, D.J. (1971). Statistical method in biological assay. Charles Griffin & Company Ltd, second edition. Ford, I., Torsney, B. & Wu, C.F.J. (1992). The use of a canonical form in the construction of locally optimal designs for non linear problems. J.Roy.Statist.Soc. B, 54, Sitter, R.R. & Wu, C.F.J. (1993). Optimal Designs for Binary Response Experiments: Fieller, D and A Criteria. Scand.J.Statist., 20, Smith, D.M. & Ridout, M.S. (1998). Locally and Bayesian Optimal Designs for Binary Dose Response Models with Various Link Functions. In: COMPSTAT98. (ed. R.Payne and P.Green), Physica Verlag. Smith, D.M. & Ridout, M.S. (2003). Optimal designs for criteria involving log(potency) in comparative binary bioassays. J.Statist.Plann.Inference, 113, davismith@mail.mcg.edu 21

Lecture 13: More on Binary Data

Lecture 13: More on Binary Data Lecture 1: More on Binary Data Link functions for Binomial models Link η = g(π) π = g 1 (η) identity π η logarithmic log π e η logistic log ( π 1 π probit Φ 1 (π) Φ(η) log-log log( log π) exp( e η ) complementary

More information

By Min Yang 1 and John Stufken 2 University of Missouri Columbia and University of Georgia

By Min Yang 1 and John Stufken 2 University of Missouri Columbia and University of Georgia The Annals of Statistics 2009, Vol. 37, No. 1, 518 541 DOI: 10.1214/07-AOS560 c Institute of Mathematical Statistics, 2009 SUPPORT POINTS OF LOCALLY OPTIMAL DESIGNS FOR NONLINEAR MODELS WITH TWO PARAMETERS

More information

OPTIMAL DESIGNS FOR GENERALIZED LINEAR MODELS WITH MULTIPLE DESIGN VARIABLES

OPTIMAL DESIGNS FOR GENERALIZED LINEAR MODELS WITH MULTIPLE DESIGN VARIABLES Statistica Sinica 21 (2011, 1415-1430 OPTIMAL DESIGNS FOR GENERALIZED LINEAR MODELS WITH MULTIPLE DESIGN VARIABLES Min Yang, Bin Zhang and Shuguang Huang University of Missouri, University of Alabama-Birmingham

More information

Compound Optimal Designs for Percentile Estimation in Dose-Response Models with Restricted Design Intervals

Compound Optimal Designs for Percentile Estimation in Dose-Response Models with Restricted Design Intervals Compound Optimal Designs for Percentile Estimation in Dose-Response Models with Restricted Design Intervals Stefanie Biedermann 1, Holger Dette 1, Wei Zhu 2 Abstract In dose-response studies, the dose

More information

A-optimal designs for generalized linear model with two parameters

A-optimal designs for generalized linear model with two parameters A-optimal designs for generalized linear model with two parameters Min Yang * University of Missouri - Columbia Abstract An algebraic method for constructing A-optimal designs for two parameter generalized

More information

Latent Variable Models for Binary Data. Suppose that for a given vector of explanatory variables x, the latent

Latent Variable Models for Binary Data. Suppose that for a given vector of explanatory variables x, the latent Latent Variable Models for Binary Data Suppose that for a given vector of explanatory variables x, the latent variable, U, has a continuous cumulative distribution function F (u; x) and that the binary

More information

ST3241 Categorical Data Analysis I Generalized Linear Models. Introduction and Some Examples

ST3241 Categorical Data Analysis I Generalized Linear Models. Introduction and Some Examples ST3241 Categorical Data Analysis I Generalized Linear Models Introduction and Some Examples 1 Introduction We have discussed methods for analyzing associations in two-way and three-way tables. Now we will

More information

Standard Errors & Confidence Intervals. N(0, I( β) 1 ), I( β) = [ 2 l(β, φ; y) β i β β= β j

Standard Errors & Confidence Intervals. N(0, I( β) 1 ), I( β) = [ 2 l(β, φ; y) β i β β= β j Standard Errors & Confidence Intervals β β asy N(0, I( β) 1 ), where I( β) = [ 2 l(β, φ; y) ] β i β β= β j We can obtain asymptotic 100(1 α)% confidence intervals for β j using: β j ± Z 1 α/2 se( β j )

More information

Single-level Models for Binary Responses

Single-level Models for Binary Responses Single-level Models for Binary Responses Distribution of Binary Data y i response for individual i (i = 1,..., n), coded 0 or 1 Denote by r the number in the sample with y = 1 Mean and variance E(y) =

More information

AP-Optimum Designs for Minimizing the Average Variance and Probability-Based Optimality

AP-Optimum Designs for Minimizing the Average Variance and Probability-Based Optimality AP-Optimum Designs for Minimizing the Average Variance and Probability-Based Optimality Authors: N. M. Kilany Faculty of Science, Menoufia University Menoufia, Egypt. (neveenkilany@hotmail.com) W. A. Hassanein

More information

COMPLEMENTARY LOG-LOG MODEL

COMPLEMENTARY LOG-LOG MODEL COMPLEMENTARY LOG-LOG MODEL Under the assumption of binary response, there are two alternatives to logit model: probit model and complementary-log-log model. They all follow the same form π ( x) =Φ ( α

More information

Stat 5101 Lecture Notes

Stat 5101 Lecture Notes Stat 5101 Lecture Notes Charles J. Geyer Copyright 1998, 1999, 2000, 2001 by Charles J. Geyer May 7, 2001 ii Stat 5101 (Geyer) Course Notes Contents 1 Random Variables and Change of Variables 1 1.1 Random

More information

STAT5044: Regression and Anova

STAT5044: Regression and Anova STAT5044: Regression and Anova Inyoung Kim 1 / 18 Outline 1 Logistic regression for Binary data 2 Poisson regression for Count data 2 / 18 GLM Let Y denote a binary response variable. Each observation

More information

STA216: Generalized Linear Models. Lecture 1. Review and Introduction

STA216: Generalized Linear Models. Lecture 1. Review and Introduction STA216: Generalized Linear Models Lecture 1. Review and Introduction Let y 1,..., y n denote n independent observations on a response Treat y i as a realization of a random variable Y i In the general

More information

PubH 7470: STATISTICS FOR TRANSLATIONAL & CLINICAL RESEARCH

PubH 7470: STATISTICS FOR TRANSLATIONAL & CLINICAL RESEARCH PubH 7470: STATISTICS FOR TRANSLATIONAL & CLINICAL RESEARCH From Basic to Translational: INDIRECT BIOASSAYS INDIRECT ASSAYS In indirect assays, the doses of the standard and test preparations are are applied

More information

Generalized Linear Models

Generalized Linear Models Generalized Linear Models Advanced Methods for Data Analysis (36-402/36-608 Spring 2014 1 Generalized linear models 1.1 Introduction: two regressions So far we ve seen two canonical settings for regression.

More information

Efficient Experimental Design Strategies in Toxicology and Bioassay

Efficient Experimental Design Strategies in Toxicology and Bioassay STATISTICS, OPTIMIZATION AND INFORMATION COMPUTING Stat., Optim. Inf. Comput., Vol. 4, June 2016, pp 99 106. Published online in International Academic Press (www.iapress.org) Efficient Experimental Design

More information

HANDBOOK OF APPLICABLE MATHEMATICS

HANDBOOK OF APPLICABLE MATHEMATICS HANDBOOK OF APPLICABLE MATHEMATICS Chief Editor: Walter Ledermann Volume VI: Statistics PART A Edited by Emlyn Lloyd University of Lancaster A Wiley-Interscience Publication JOHN WILEY & SONS Chichester

More information

INTRODUCING LINEAR REGRESSION MODELS Response or Dependent variable y

INTRODUCING LINEAR REGRESSION MODELS Response or Dependent variable y INTRODUCING LINEAR REGRESSION MODELS Response or Dependent variable y Predictor or Independent variable x Model with error: for i = 1,..., n, y i = α + βx i + ε i ε i : independent errors (sampling, measurement,

More information

Copula Regression RAHUL A. PARSA DRAKE UNIVERSITY & STUART A. KLUGMAN SOCIETY OF ACTUARIES CASUALTY ACTUARIAL SOCIETY MAY 18,2011

Copula Regression RAHUL A. PARSA DRAKE UNIVERSITY & STUART A. KLUGMAN SOCIETY OF ACTUARIES CASUALTY ACTUARIAL SOCIETY MAY 18,2011 Copula Regression RAHUL A. PARSA DRAKE UNIVERSITY & STUART A. KLUGMAN SOCIETY OF ACTUARIES CASUALTY ACTUARIAL SOCIETY MAY 18,2011 Outline Ordinary Least Squares (OLS) Regression Generalized Linear Models

More information

A new algorithm for deriving optimal designs

A new algorithm for deriving optimal designs A new algorithm for deriving optimal designs Stefanie Biedermann, University of Southampton, UK Joint work with Min Yang, University of Illinois at Chicago 18 October 2012, DAE, University of Georgia,

More information

Lecture 6: Discrete Choice: Qualitative Response

Lecture 6: Discrete Choice: Qualitative Response Lecture 6: Instructor: Department of Economics Stanford University 2011 Types of Discrete Choice Models Univariate Models Binary: Linear; Probit; Logit; Arctan, etc. Multinomial: Logit; Nested Logit; GEV;

More information

Optimal Experimental Designs for the Poisson Regression Model in Toxicity Studies

Optimal Experimental Designs for the Poisson Regression Model in Toxicity Studies Optimal Experimental Designs for the Poisson Regression Model in Toxicity Studies Yanping Wang Dissertation submitted to the Faculty of the Virginia Polytechnic Institute and State University in partial

More information

Discussion of Paper by Bendel Fygenson

Discussion of Paper by Bendel Fygenson Discussion of Paper by Bendel Fygenson Mark S. Kaiser and Daniel J. Nordman Department of Statistics Iowa State University June 2007 i 1 Professor Fygenson has produced a thought-provoking paper that contains

More information

Optimum designs for model. discrimination and estimation. in Binary Response Models

Optimum designs for model. discrimination and estimation. in Binary Response Models Optimum designs for model discrimination and estimation in Binary Response Models by Wei-Shan Hsieh Advisor Mong-Na Lo Huang Department of Applied Mathematics National Sun Yat-sen University Kaohsiung,

More information

MINIMAX OPTIMAL DESIGNS IN NONLINEAR REGRESSION MODELS

MINIMAX OPTIMAL DESIGNS IN NONLINEAR REGRESSION MODELS Statistica Sinica 8(998, 49-64 MINIMAX OPTIMAL DESIGNS IN NONLINEAR REGRESSION MODELS Holger Dette and Michael Sahm Ruhr-Universität Bochum Astract: We consider the maximum variance optimality criterion

More information

Model Selection in GLMs. (should be able to implement frequentist GLM analyses!) Today: standard frequentist methods for model selection

Model Selection in GLMs. (should be able to implement frequentist GLM analyses!) Today: standard frequentist methods for model selection Model Selection in GLMs Last class: estimability/identifiability, analysis of deviance, standard errors & confidence intervals (should be able to implement frequentist GLM analyses!) Today: standard frequentist

More information

Sequential Experimental Designs for Generalized Linear Models

Sequential Experimental Designs for Generalized Linear Models Sequential Experimental Designs for Generalized Linear Models Hovav A. Dror and David M. Steinberg, JASA (2008) Bob A. Salim May 14, 2013 Bob A. Salim Sequential Experimental Designs for Generalized Linear

More information

Sections 4.1, 4.2, 4.3

Sections 4.1, 4.2, 4.3 Sections 4.1, 4.2, 4.3 Timothy Hanson Department of Statistics, University of South Carolina Stat 770: Categorical Data Analysis 1/ 32 Chapter 4: Introduction to Generalized Linear Models Generalized linear

More information

LOGISTIC REGRESSION Joseph M. Hilbe

LOGISTIC REGRESSION Joseph M. Hilbe LOGISTIC REGRESSION Joseph M. Hilbe Arizona State University Logistic regression is the most common method used to model binary response data. When the response is binary, it typically takes the form of

More information

Bayesian Inference in GLMs. Frequentists typically base inferences on MLEs, asymptotic confidence

Bayesian Inference in GLMs. Frequentists typically base inferences on MLEs, asymptotic confidence Bayesian Inference in GLMs Frequentists typically base inferences on MLEs, asymptotic confidence limits, and log-likelihood ratio tests Bayesians base inferences on the posterior distribution of the unknowns

More information

Optimal and efficient designs for Gompertz regression models

Optimal and efficient designs for Gompertz regression models Ann Inst Stat Math (2012) 64:945 957 DOI 10.1007/s10463-011-0340-y Optimal and efficient designs for Gompertz regression models Gang Li Received: 13 July 2010 / Revised: 11 August 2011 / Published online:

More information

D-optimal designs for logistic regression in two variables

D-optimal designs for logistic regression in two variables D-optimal designs for logistic regression in two variables Linda M. Haines 1, M. Gaëtan Kabera 2, P. Ndlovu 2 and T. E. O Brien 3 1 Department of Statistical Sciences, University of Cape Town, Rondebosch

More information

11. Generalized Linear Models: An Introduction

11. Generalized Linear Models: An Introduction Sociology 740 John Fox Lecture Notes 11. Generalized Linear Models: An Introduction Copyright 2014 by John Fox Generalized Linear Models: An Introduction 1 1. Introduction I A synthesis due to Nelder and

More information

Generalized Linear Models for Non-Normal Data

Generalized Linear Models for Non-Normal Data Generalized Linear Models for Non-Normal Data Today s Class: 3 parts of a generalized model Models for binary outcomes Complications for generalized multivariate or multilevel models SPLH 861: Lecture

More information

Linear model A linear model assumes Y X N(µ(X),σ 2 I), And IE(Y X) = µ(x) = X β, 2/52

Linear model A linear model assumes Y X N(µ(X),σ 2 I), And IE(Y X) = µ(x) = X β, 2/52 Statistics for Applications Chapter 10: Generalized Linear Models (GLMs) 1/52 Linear model A linear model assumes Y X N(µ(X),σ 2 I), And IE(Y X) = µ(x) = X β, 2/52 Components of a linear model The two

More information

STA 216: GENERALIZED LINEAR MODELS. Lecture 1. Review and Introduction. Much of statistics is based on the assumption that random

STA 216: GENERALIZED LINEAR MODELS. Lecture 1. Review and Introduction. Much of statistics is based on the assumption that random STA 216: GENERALIZED LINEAR MODELS Lecture 1. Review and Introduction Much of statistics is based on the assumption that random variables are continuous & normally distributed. Normal linear regression

More information

AN ASYMPTOTIC THEORY OF SEQUENTIAL DESIGNS BASED ON MAXIMUM LIKELIHOOD RECURSIONS

AN ASYMPTOTIC THEORY OF SEQUENTIAL DESIGNS BASED ON MAXIMUM LIKELIHOOD RECURSIONS Statistica Sinica 7(1997), 75-91 AN ASYMPTOTIC THEORY OF SEQUENTIAL DESIGNS BASED ON MAXIMUM LIKELIHOOD RECURSIONS Zhiliang Ying and C. F. Jeff Wu Rutgers University and University of Michigan Abstract:

More information

Bayesian Methods for Accelerated Destructive Degradation Test Planning

Bayesian Methods for Accelerated Destructive Degradation Test Planning Statistics Preprints Statistics 11-2010 Bayesian Methods for Accelerated Destructive Degradation Test Planning Ying Shi Iowa State University William Q. Meeker Iowa State University, wqmeeker@iastate.edu

More information

Linear Regression With Special Variables

Linear Regression With Special Variables Linear Regression With Special Variables Junhui Qian December 21, 2014 Outline Standardized Scores Quadratic Terms Interaction Terms Binary Explanatory Variables Binary Choice Models Standardized Scores:

More information

OPTIMAL TWO-STAGE DESIGNS FOR BINARY RESPONSE EXPERIMENTS

OPTIMAL TWO-STAGE DESIGNS FOR BINARY RESPONSE EXPERIMENTS Statistica Sinica 7(1997), 941-955 OPTIMAL TWO-STAGE DESIGNS FOR BINARY RESPONSE EXPERIMENTS R. R. Sitter and B. E. Forbes Simon Fraser University and Carleton University Abstract: In typical binary response

More information

Relative Potency Estimations in Multiple Bioassay Problems

Relative Potency Estimations in Multiple Bioassay Problems Relative Potency Estimations in Multiple Bioassay Problems Gemechis Dilba Institute of Biostatistics, Leibniz University of Hannover, Germany 5 th International Conference on Multiple Comparison Procedures

More information

MULTIPLE-OBJECTIVE DESIGNS IN A DOSE-RESPONSE EXPERIMENT

MULTIPLE-OBJECTIVE DESIGNS IN A DOSE-RESPONSE EXPERIMENT New Developments and Applications in Experimental Design IMS Lecture Notes - Monograph Series (1998) Volume 34 MULTIPLE-OBJECTIVE DESIGNS IN A DOSE-RESPONSE EXPERIMENT BY WEI ZHU AND WENG KEE WONG 1 State

More information

EPSY 905: Fundamentals of Multivariate Modeling Online Lecture #7

EPSY 905: Fundamentals of Multivariate Modeling Online Lecture #7 Introduction to Generalized Univariate Models: Models for Binary Outcomes EPSY 905: Fundamentals of Multivariate Modeling Online Lecture #7 EPSY 905: Intro to Generalized In This Lecture A short review

More information

Sequential Experimental Designs for Generalized Linear Models

Sequential Experimental Designs for Generalized Linear Models Sequential Experimental Designs for Generalized Linear Models Hovav A. Dror and David M. Steinberg, JASA (2008) Bob A. Salim April 23, 2013 Bob A. Salim Sequential Experimental Designs for Generalized

More information

AGEC 661 Note Eleven Ximing Wu. Exponential regression model: m (x, θ) = exp (xθ) for y 0

AGEC 661 Note Eleven Ximing Wu. Exponential regression model: m (x, θ) = exp (xθ) for y 0 AGEC 661 ote Eleven Ximing Wu M-estimator So far we ve focused on linear models, where the estimators have a closed form solution. If the population model is nonlinear, the estimators often do not have

More information

Categorical data analysis Chapter 5

Categorical data analysis Chapter 5 Categorical data analysis Chapter 5 Interpreting parameters in logistic regression The sign of β determines whether π(x) is increasing or decreasing as x increases. The rate of climb or descent increases

More information

Chapter 9 Regression with a Binary Dependent Variable. Multiple Choice. 1) The binary dependent variable model is an example of a

Chapter 9 Regression with a Binary Dependent Variable. Multiple Choice. 1) The binary dependent variable model is an example of a Chapter 9 Regression with a Binary Dependent Variable Multiple Choice ) The binary dependent variable model is an example of a a. regression model, which has as a regressor, among others, a binary variable.

More information

Generalized Linear Models. Last time: Background & motivation for moving beyond linear

Generalized Linear Models. Last time: Background & motivation for moving beyond linear Generalized Linear Models Last time: Background & motivation for moving beyond linear regression - non-normal/non-linear cases, binary, categorical data Today s class: 1. Examples of count and ordered

More information

Regression. Estimation of the linear function (straight line) describing the linear component of the joint relationship between two variables X and Y.

Regression. Estimation of the linear function (straight line) describing the linear component of the joint relationship between two variables X and Y. Regression Bivariate i linear regression: Estimation of the linear function (straight line) describing the linear component of the joint relationship between two variables and. Generally describe as a

More information

Biost 518 Applied Biostatistics II. Purpose of Statistics. First Stage of Scientific Investigation. Further Stages of Scientific Investigation

Biost 518 Applied Biostatistics II. Purpose of Statistics. First Stage of Scientific Investigation. Further Stages of Scientific Investigation Biost 58 Applied Biostatistics II Scott S. Emerson, M.D., Ph.D. Professor of Biostatistics University of Washington Lecture 5: Review Purpose of Statistics Statistics is about science (Science in the broadest

More information

Designs for Generalized Linear Models

Designs for Generalized Linear Models Designs for Generalized Linear Models Anthony C. Atkinson David C. Woods London School of Economics and Political Science, UK University of Southampton, UK December 9, 2013 Email: a.c.atkinson@lse.ac.uk

More information

Generalized Linear Models Introduction

Generalized Linear Models Introduction Generalized Linear Models Introduction Statistics 135 Autumn 2005 Copyright c 2005 by Mark E. Irwin Generalized Linear Models For many problems, standard linear regression approaches don t work. Sometimes,

More information

Chapter 4: Generalized Linear Models-I

Chapter 4: Generalized Linear Models-I : Generalized Linear Models-I Dipankar Bandyopadhyay Department of Biostatistics, Virginia Commonwealth University BIOS 625: Categorical Data & GLM [Acknowledgements to Tim Hanson and Haitao Chu] D. Bandyopadhyay

More information

401 Review. 6. Power analysis for one/two-sample hypothesis tests and for correlation analysis.

401 Review. 6. Power analysis for one/two-sample hypothesis tests and for correlation analysis. 401 Review Major topics of the course 1. Univariate analysis 2. Bivariate analysis 3. Simple linear regression 4. Linear algebra 5. Multiple regression analysis Major analysis methods 1. Graphical analysis

More information

Bayesian linear regression

Bayesian linear regression Bayesian linear regression Linear regression is the basis of most statistical modeling. The model is Y i = X T i β + ε i, where Y i is the continuous response X i = (X i1,..., X ip ) T is the corresponding

More information

Frailty Modeling for Spatially Correlated Survival Data, with Application to Infant Mortality in Minnesota By: Sudipto Banerjee, Mela. P.

Frailty Modeling for Spatially Correlated Survival Data, with Application to Infant Mortality in Minnesota By: Sudipto Banerjee, Mela. P. Frailty Modeling for Spatially Correlated Survival Data, with Application to Infant Mortality in Minnesota By: Sudipto Banerjee, Melanie M. Wall, Bradley P. Carlin November 24, 2014 Outlines of the talk

More information

Linear Regression Models P8111

Linear Regression Models P8111 Linear Regression Models P8111 Lecture 25 Jeff Goldsmith April 26, 2016 1 of 37 Today s Lecture Logistic regression / GLMs Model framework Interpretation Estimation 2 of 37 Linear regression Course started

More information

Generalized Linear Models 1

Generalized Linear Models 1 Generalized Linear Models 1 STA 2101/442: Fall 2012 1 See last slide for copyright information. 1 / 24 Suggested Reading: Davison s Statistical models Exponential families of distributions Sec. 5.2 Chapter

More information

Week 7: Binary Outcomes (Scott Long Chapter 3 Part 2)

Week 7: Binary Outcomes (Scott Long Chapter 3 Part 2) Week 7: (Scott Long Chapter 3 Part 2) Tsun-Feng Chiang* *School of Economics, Henan University, Kaifeng, China April 29, 2014 1 / 38 ML Estimation for Probit and Logit ML Estimation for Probit and Logit

More information

STAT 7030: Categorical Data Analysis

STAT 7030: Categorical Data Analysis STAT 7030: Categorical Data Analysis 5. Logistic Regression Peng Zeng Department of Mathematics and Statistics Auburn University Fall 2012 Peng Zeng (Auburn University) STAT 7030 Lecture Notes Fall 2012

More information

Bayesian Inference. Chapter 9. Linear models and regression

Bayesian Inference. Chapter 9. Linear models and regression Bayesian Inference Chapter 9. Linear models and regression M. Concepcion Ausin Universidad Carlos III de Madrid Master in Business Administration and Quantitative Methods Master in Mathematical Engineering

More information

Binary choice. Michel Bierlaire

Binary choice. Michel Bierlaire Binary choice Michel Bierlaire Transport and Mobility Laboratory School of Architecture, Civil and Environmental Engineering Ecole Polytechnique Fédérale de Lausanne M. Bierlaire (TRANSP-OR ENAC EPFL)

More information

Generalized Models: Part 1

Generalized Models: Part 1 Generalized Models: Part 1 Topics: Introduction to generalized models Introduction to maximum likelihood estimation Models for binary outcomes Models for proportion outcomes Models for categorical outcomes

More information

Bayesian Multivariate Logistic Regression

Bayesian Multivariate Logistic Regression Bayesian Multivariate Logistic Regression Sean M. O Brien and David B. Dunson Biostatistics Branch National Institute of Environmental Health Sciences Research Triangle Park, NC 1 Goals Brief review of

More information

Gauge Plots. Gauge Plots JAPANESE BEETLE DATA MAXIMUM LIKELIHOOD FOR SPATIALLY CORRELATED DISCRETE DATA JAPANESE BEETLE DATA

Gauge Plots. Gauge Plots JAPANESE BEETLE DATA MAXIMUM LIKELIHOOD FOR SPATIALLY CORRELATED DISCRETE DATA JAPANESE BEETLE DATA JAPANESE BEETLE DATA 6 MAXIMUM LIKELIHOOD FOR SPATIALLY CORRELATED DISCRETE DATA Gauge Plots TuscaroraLisa Central Madsen Fairways, 996 January 9, 7 Grubs Adult Activity Grub Counts 6 8 Organic Matter

More information

Modeling Binary Outcomes: Logit and Probit Models

Modeling Binary Outcomes: Logit and Probit Models Modeling Binary Outcomes: Logit and Probit Models Eric Zivot December 5, 2009 Motivating Example: Women s labor force participation y i = 1 if married woman is in labor force = 0 otherwise x i k 1 = observed

More information

Distribution-free ROC Analysis Using Binary Regression Techniques

Distribution-free ROC Analysis Using Binary Regression Techniques Distribution-free Analysis Using Binary Techniques Todd A. Alonzo and Margaret S. Pepe As interpreted by: Andrew J. Spieker University of Washington Dept. of Biostatistics Introductory Talk No, not that!

More information

Infinitely Imbalanced Logistic Regression

Infinitely Imbalanced Logistic Regression p. 1/1 Infinitely Imbalanced Logistic Regression Art B. Owen Journal of Machine Learning Research, April 2007 Presenter: Ivo D. Shterev p. 2/1 Outline Motivation Introduction Numerical Examples Notation

More information

UQ, Semester 1, 2017, Companion to STAT2201/CIVL2530 Exam Formulae and Tables

UQ, Semester 1, 2017, Companion to STAT2201/CIVL2530 Exam Formulae and Tables UQ, Semester 1, 2017, Companion to STAT2201/CIVL2530 Exam Formulae and Tables To be provided to students with STAT2201 or CIVIL-2530 (Probability and Statistics) Exam Main exam date: Tuesday, 20 June 1

More information

Generalized Linear Models

Generalized Linear Models York SPIDA John Fox Notes Generalized Linear Models Copyright 2010 by John Fox Generalized Linear Models 1 1. Topics I The structure of generalized linear models I Poisson and other generalized linear

More information

OPTIMAL DESIGN INPUTS FOR EXPERIMENTAL CHAPTER 17. Organization of chapter in ISSO. Background. Linear models

OPTIMAL DESIGN INPUTS FOR EXPERIMENTAL CHAPTER 17. Organization of chapter in ISSO. Background. Linear models CHAPTER 17 Slides for Introduction to Stochastic Search and Optimization (ISSO)by J. C. Spall OPTIMAL DESIGN FOR EXPERIMENTAL INPUTS Organization of chapter in ISSO Background Motivation Finite sample

More information

Contents 1. Contents

Contents 1. Contents Contents 1 Contents 6 Distributions of Functions of Random Variables 2 6.1 Transformation of Discrete r.v.s............. 3 6.2 Method of Distribution Functions............. 6 6.3 Method of Transformations................

More information

Subject CS1 Actuarial Statistics 1 Core Principles

Subject CS1 Actuarial Statistics 1 Core Principles Institute of Actuaries of India Subject CS1 Actuarial Statistics 1 Core Principles For 2019 Examinations Aim The aim of the Actuarial Statistics 1 subject is to provide a grounding in mathematical and

More information

Generalized Linear Models (GLZ)

Generalized Linear Models (GLZ) Generalized Linear Models (GLZ) Generalized Linear Models (GLZ) are an extension of the linear modeling process that allows models to be fit to data that follow probability distributions other than the

More information

Logistic regression. 11 Nov Logistic regression (EPFL) Applied Statistics 11 Nov / 20

Logistic regression. 11 Nov Logistic regression (EPFL) Applied Statistics 11 Nov / 20 Logistic regression 11 Nov 2010 Logistic regression (EPFL) Applied Statistics 11 Nov 2010 1 / 20 Modeling overview Want to capture important features of the relationship between a (set of) variable(s)

More information

STA 216, GLM, Lecture 16. October 29, 2007

STA 216, GLM, Lecture 16. October 29, 2007 STA 216, GLM, Lecture 16 October 29, 2007 Efficient Posterior Computation in Factor Models Underlying Normal Models Generalized Latent Trait Models Formulation Genetic Epidemiology Illustration Structural

More information

ABHELSINKI UNIVERSITY OF TECHNOLOGY

ABHELSINKI UNIVERSITY OF TECHNOLOGY Cross-Validation, Information Criteria, Expected Utilities and the Effective Number of Parameters Aki Vehtari and Jouko Lampinen Laboratory of Computational Engineering Introduction Expected utility -

More information

Outline of GLMs. Definitions

Outline of GLMs. Definitions Outline of GLMs Definitions This is a short outline of GLM details, adapted from the book Nonparametric Regression and Generalized Linear Models, by Green and Silverman. The responses Y i have density

More information

Some Approximations of the Logistic Distribution with Application to the Covariance Matrix of Logistic Regression

Some Approximations of the Logistic Distribution with Application to the Covariance Matrix of Logistic Regression Working Paper 2013:9 Department of Statistics Some Approximations of the Logistic Distribution with Application to the Covariance Matrix of Logistic Regression Ronnie Pingel Working Paper 2013:9 June

More information

MS&E 226: Small Data. Lecture 11: Maximum likelihood (v2) Ramesh Johari

MS&E 226: Small Data. Lecture 11: Maximum likelihood (v2) Ramesh Johari MS&E 226: Small Data Lecture 11: Maximum likelihood (v2) Ramesh Johari ramesh.johari@stanford.edu 1 / 18 The likelihood function 2 / 18 Estimating the parameter This lecture develops the methodology behind

More information

9 Generalized Linear Models

9 Generalized Linear Models 9 Generalized Linear Models The Generalized Linear Model (GLM) is a model which has been built to include a wide range of different models you already know, e.g. ANOVA and multiple linear regression models

More information

Class Notes: Week 8. Probit versus Logit Link Functions and Count Data

Class Notes: Week 8. Probit versus Logit Link Functions and Count Data Ronald Heck Class Notes: Week 8 1 Class Notes: Week 8 Probit versus Logit Link Functions and Count Data This week we ll take up a couple of issues. The first is working with a probit link function. While

More information

ECON 3150/4150, Spring term Lecture 6

ECON 3150/4150, Spring term Lecture 6 ECON 3150/4150, Spring term 2013. Lecture 6 Review of theoretical statistics for econometric modelling (II) Ragnar Nymoen University of Oslo 31 January 2013 1 / 25 References to Lecture 3 and 6 Lecture

More information

Econometrics II. Seppo Pynnönen. Spring Department of Mathematics and Statistics, University of Vaasa, Finland

Econometrics II. Seppo Pynnönen. Spring Department of Mathematics and Statistics, University of Vaasa, Finland Department of Mathematics and Statistics, University of Vaasa, Finland Spring 2018 Part III Limited Dependent Variable Models As of Jan 30, 2017 1 Background 2 Binary Dependent Variable The Linear Probability

More information

Optimal designs for multi-response generalized linear models with applications in thermal spraying

Optimal designs for multi-response generalized linear models with applications in thermal spraying Optimal designs for multi-response generalized linear models with applications in thermal spraying Holger Dette Ruhr-Universität Bochum Fakultät für Mathematik 44780 Bochum Germany email: holger.dette@ruhr-uni-bochum.de

More information

BMI 541/699 Lecture 22

BMI 541/699 Lecture 22 BMI 541/699 Lecture 22 Where we are: 1. Introduction and Experimental Design 2. Exploratory Data Analysis 3. Probability 4. T-based methods for continous variables 5. Power and sample size for t-based

More information

A Bayesian Mixture Model with Application to Typhoon Rainfall Predictions in Taipei, Taiwan 1

A Bayesian Mixture Model with Application to Typhoon Rainfall Predictions in Taipei, Taiwan 1 Int. J. Contemp. Math. Sci., Vol. 2, 2007, no. 13, 639-648 A Bayesian Mixture Model with Application to Typhoon Rainfall Predictions in Taipei, Taiwan 1 Tsai-Hung Fan Graduate Institute of Statistics National

More information

Open Problems in Mixed Models

Open Problems in Mixed Models xxiii Determining how to deal with a not positive definite covariance matrix of random effects, D during maximum likelihood estimation algorithms. Several strategies are discussed in Section 2.15. For

More information

MS-E2112 Multivariate Statistical Analysis (5cr) Lecture 8: Canonical Correlation Analysis

MS-E2112 Multivariate Statistical Analysis (5cr) Lecture 8: Canonical Correlation Analysis MS-E2112 Multivariate Statistical (5cr) Lecture 8: Contents Canonical correlation analysis involves partition of variables into two vectors x and y. The aim is to find linear combinations α T x and β

More information

BIO5312 Biostatistics Lecture 13: Maximum Likelihood Estimation

BIO5312 Biostatistics Lecture 13: Maximum Likelihood Estimation BIO5312 Biostatistics Lecture 13: Maximum Likelihood Estimation Yujin Chung November 29th, 2016 Fall 2016 Yujin Chung Lec13: MLE Fall 2016 1/24 Previous Parametric tests Mean comparisons (normality assumption)

More information

D-OPTIMAL DESIGNS WITH ORDERED CATEGORICAL DATA

D-OPTIMAL DESIGNS WITH ORDERED CATEGORICAL DATA Statistica Sinica 27 (2017), 000-000 doi:https://doi.org/10.5705/ss.202016.0210 D-OPTIMAL DESIGNS WITH ORDERED CATEGORICAL DATA Jie Yang, Liping Tong and Abhyuday Mandal University of Illinois at Chicago,

More information

Joint work with Nottingham colleagues Simon Preston and Michail Tsagris.

Joint work with Nottingham colleagues Simon Preston and Michail Tsagris. /pgf/stepx/.initial=1cm, /pgf/stepy/.initial=1cm, /pgf/step/.code=1/pgf/stepx/.expanded=- 10.95415pt,/pgf/stepy/.expanded=- 10.95415pt, /pgf/step/.value required /pgf/images/width/.estore in= /pgf/images/height/.estore

More information

1. Fisher Information

1. Fisher Information 1. Fisher Information Let f(x θ) be a density function with the property that log f(x θ) is differentiable in θ throughout the open p-dimensional parameter set Θ R p ; then the score statistic (or score

More information

Semiparametric Generalized Linear Models

Semiparametric Generalized Linear Models Semiparametric Generalized Linear Models North American Stata Users Group Meeting Chicago, Illinois Paul Rathouz Department of Health Studies University of Chicago prathouz@uchicago.edu Liping Gao MS Student

More information

Generalized Linear Models: An Introduction

Generalized Linear Models: An Introduction Applied Statistics With R Generalized Linear Models: An Introduction John Fox WU Wien May/June 2006 2006 by John Fox Generalized Linear Models: An Introduction 1 A synthesis due to Nelder and Wedderburn,

More information

Weighted Exponential Distribution and Process

Weighted Exponential Distribution and Process Weighted Exponential Distribution and Process Jilesh V Some generalizations of exponential distribution and related time series models Thesis. Department of Statistics, University of Calicut, 200 Chapter

More information

Optimal Design for Nonlinear and Spatial Models: Introduction and Historical Overview

Optimal Design for Nonlinear and Spatial Models: Introduction and Historical Overview 12 Optimal Design for Nonlinear and Spatial Models: Introduction and Historical Overview Douglas P. Wiens CONTENTS 12.1 Introduction...457 12.2 Generalized Linear Models...457 12.3 Selected Nonlinear Models...460

More information

Problem Selected Scores

Problem Selected Scores Statistics Ph.D. Qualifying Exam: Part II November 20, 2010 Student Name: 1. Answer 8 out of 12 problems. Mark the problems you selected in the following table. Problem 1 2 3 4 5 6 7 8 9 10 11 12 Selected

More information

Contents. Preface to Second Edition Preface to First Edition Abbreviations PART I PRINCIPLES OF STATISTICAL THINKING AND ANALYSIS 1

Contents. Preface to Second Edition Preface to First Edition Abbreviations PART I PRINCIPLES OF STATISTICAL THINKING AND ANALYSIS 1 Contents Preface to Second Edition Preface to First Edition Abbreviations xv xvii xix PART I PRINCIPLES OF STATISTICAL THINKING AND ANALYSIS 1 1 The Role of Statistical Methods in Modern Industry and Services

More information