Local&Bayesianoptimaldesigns in binary bioassay
|
|
- Cornelia Clark
- 5 years ago
- Views:
Transcription
1 Local&Bayesianoptimaldesigns in binary bioassay D.M.Smith Office of Biostatistics & Bioinformatics Medicial College of Georgia. New Directions in Experimental Design (DAE 2003 Chicago) 1
2 Review of binary bioassay. Local and Bayesian optimal designs A range of (GLM) link functions & prior distributions. Usually no closed form solutions for Bayesian optimal designs, so many of the investigations are numerical. 2
3 Single substance binary bioassays. Probability of response π has the form π(x; θ) =F (α + βx) =F (z), z = α + βx θ T =(α, β) vector of unknown parameters. F () is a cumulative distribution function An alternative parametrization is z = β(x µ), θ T =(µ, β), where µ = α β. GLM terminology, z is the linear predictor and the inverse function F 1 () is the link function. Assumed that x = log(dose) and β 0. 3
4 Figure 1: pdf & cdf normal tolerance distribution mean µ = α β,sdσ = 1 β 4
5 Link function Logit Probit Φ normal c.d.f. Double exponential s = sign(z) Double reciprocal s = sign(z) F (z) 1/(1 + exp( z)) Φ(z) (1 + s) s 2 2 exp( z ) (1 + s) s ( ) z Complementary log log 1 exp[ exp(z) ] Skewed logit m = 1/3, 2/3, 3/2, 3 1/(1 + exp( z)) m 5
6 Bioassays comparing two substances. Parameter of interest is the potency of one substance compared to the other. Analysed using the parallel line model π(x; θ) =F (z) = F (α + β(x ρm)) or F (z) = F (β(x µ ρm)) θ T =(α, β, ρ) or θ T =(µ, β, ρ) m is a factor taking the value 0 or 1 representing the two substances. ρ is the log(potency) and is the horizontal distance between the two parallel lines. 6
7 Figure 2: comparative binary bioassay 7
8 Prior distributions Fixed values, locally optimal designs. Independent uniform distributions or, more generally, independent beta distributions. Multivariate normal distributions. Others e.g. bivariate normal for α(µ) & β, ρ an independent beta distribution for comparative bioassay of two substances. 8
9 Criterion functions All are functions of the expected information matrix. Let ξ = x 1, x 2,, x k w 1, w 2,, w k m 1, m 2,, m k denote a design with distinct support points x 1,,x k, weights w i at x i,where0 w i 1 and w i =1,andm i = 0 or 1 depending on substance. For θ T = (α, β, ρ), the elements of the information matrix I(ξ; θ) are i αα = w i fi 2 π i (1 π i ) i ββ = w i (x i ρm i ) 2 fi 2 π i (1 π i ) i βρ = β m i w i (x i ρm i )fi 2 π i (1 π i ) i αβ = w i (x i ρm i )fi 2 π i (1 π i ) i αρ = β m i w i fi 2 π i (1 π i ) i ρρ = β 2 m i w i fi 2 π i (1 π i ) where f i = F (α + β(x i ρm i )) and the summations are for i = 1,...,k. 9
10 Various criterion functions, φ(ξ) considered. Criterion φ(ξ) log (deti(ξ; θ)) I(ξ; θ) 1 ρρ log (deti(ξ; θ)) + log(i(ξ; θ) αα ) Associated directional derivative functions h(x) (General Equivalence Theorem). Directional derivative h(x) tr(i(x; θ) I(ξ; θ) 1 ) 3 (I(ξ; θ) 1 I(x; θ) I(ξ; θ) 1 ) ρρ + φ(ξ) tr(i(x; θ) I(ξ; θ) 1 ) I(x; θ) αα I(ξ; θ) 1 αα 2 Used to check optimality. If design optimal h(x) has a maximum value of zero, attained at, and only at, the support points of the design. φ(ξ) andh(x) for locally optimal designs. For Bayesian designs replaced by their expectation over the prior distribution of the parameters. Designs conveniently expressed as response probability π, or the linear predictor z. 10
11 Closed form solutions are not generally available for Bayesian optimal designs. Solutions have been found for simple cases. Prior distributions for the parameters leads to (Bayesian) designs where the range of doses around the support points showing efficiencies close to maximal widens. Also, the number of support points increases as the spread of the prior distributions increases. 11
12 Example Ashton (1972): Chrysanthemum aphid data Rotenone Deguelin dose x r n π dose x r n π Fitting parallel line model by non linear function minimisation using a logit link function gives ˆα = 4.629, ˆβ = and ˆρ = where Rotenone is taken as the standard (i.e. α = α R ). The variance/covariance matrix is ˆα ˆβ ˆρ ˆα ˆβ ˆρ
13 Logit link function, values of previous slide as the parameters of a trivariate normal prior distribution give Bayesian optimal designs as follows. Local optimal designs included for purposes of comparison. Value of the associated criterion the expectation under the trivariate normal prior distribution. Local and Bayesian optimal designs log determinant Standard Test Criterion (Rotenone) (Deguelin) value local x i w i Bayesian x i w i variance of ˆρ Standard Test Criterion (Rotenone) (Deguelin) value local x i w i Bayesian x i β =6.776 w i Bayesian x i β not fixed w i log determinant sub matrix Standard Test Criterion (Rotenone) (Deguelin) value local x i w i Bayesian x i w i
14 Figure 3: h(x) function for logistic, variance of ˆρ, tri-variate normal prior 14
15 A design similar to that of original data (same support points but equal weights of 0.1) with the trivariate normal prior distribution gives criteria values of , and for the respective criteria. There is a clear benefit in using the optimal designs in preference to repeating this design. Use of the local optimal designs with the same trivariate normal prior distribution results in only very small increases in criterion values. The designs for the variance of ˆρ criterion illustrate that if β is assumed known, two-point Bayesian optimal designs can be found. For the log determinant and log determinant of a sub-matrix criteria, the Bayesian optimal designs with β assumed known are the same as the local optimal design for the variance of ˆρ. 15
16 Often, precise information is available for α and β but not for ρ. To illustrate how the designs change, Bayesian optimal designs were found for a logistic link; variance of ˆρ and log determinant of a sub matrix criteria; and uniform priors with ranges to α to β to ρ Bayesian optimal designs log determinant Standard (Rotenone) Test (Deguelin) x i w i variance of ˆρ Standard (Rotenone) Test (Deguelin) x i w i log determinant sub matrix Standard (Rotenone) Test (Deguelin) x i w i
17 Figure 4: logistic, variance of ˆρ, priors uniforms α, β, ρ 17
18 For a logistic link and a trivariate normal prior based on the aphid data, how two point designs (expressed as values of π) with equal weights compare with respect to criterion values. Table 19.2 of Finney (1971), criteria values Support points variance log determinant as π of ˆρ sub matrix Bayesian The Bayesian optimal design for the variance of ρ is π i 0.41, 0.66 standard w i 0.323, π i 0.37, 0.52 test w i 0.076,
19 Discussion Appropriate model, consider use of an optimal design. Precision could be improved. Drawback of optimal designs, often too few support points to assess the fit of the model. Practical usefulness of local optimal designs limited by their dependence on the unknown underlying parameter values. Benchmark for other designs. Often use will result in only a small increase in criterion value. Bayesian optimal designs. As spreads of the prior distributions increase, the number of support points increase. Numerical optimization of φ(ξ) can be difficult. Designs are asymptotic ones, presume a population of infinite size is available. In practice, finite size. The designs here approximate designs. Weights representing integer numbers exact designs. 19
20 Future work Transforma- Skewed logit power parameter. tions of response. Introduction of control mortality and/or immunity. Generalized Linear Models and related. Random effects and variance components. Cost:benefit comparisons exact and approximate designs. 20
21 References Ashton, W.D. (1972). The Logit Transformation. Charles Griffin & Company Ltd. Chaloner, K. (1993). A note on optimal Bayesian design for nonlinear problems. J.Statist.Plann.Inference, 37, Chaloner, K. & Larntz, K. (1989). Optimal Bayesian design applied to logistic regression experiments. J.Statist.Plann.Inference, 21, Fan, S. & Chaloner, K. (1999). Geometric Methods for Singular C Optimal Designs. Technical Report No. 629, University of Minnesota. Finney, D.J. (1971). Statistical method in biological assay. Charles Griffin & Company Ltd, second edition. Ford, I., Torsney, B. & Wu, C.F.J. (1992). The use of a canonical form in the construction of locally optimal designs for non linear problems. J.Roy.Statist.Soc. B, 54, Sitter, R.R. & Wu, C.F.J. (1993). Optimal Designs for Binary Response Experiments: Fieller, D and A Criteria. Scand.J.Statist., 20, Smith, D.M. & Ridout, M.S. (1998). Locally and Bayesian Optimal Designs for Binary Dose Response Models with Various Link Functions. In: COMPSTAT98. (ed. R.Payne and P.Green), Physica Verlag. Smith, D.M. & Ridout, M.S. (2003). Optimal designs for criteria involving log(potency) in comparative binary bioassays. J.Statist.Plann.Inference, 113, davismith@mail.mcg.edu 21
Lecture 13: More on Binary Data
Lecture 1: More on Binary Data Link functions for Binomial models Link η = g(π) π = g 1 (η) identity π η logarithmic log π e η logistic log ( π 1 π probit Φ 1 (π) Φ(η) log-log log( log π) exp( e η ) complementary
More informationBy Min Yang 1 and John Stufken 2 University of Missouri Columbia and University of Georgia
The Annals of Statistics 2009, Vol. 37, No. 1, 518 541 DOI: 10.1214/07-AOS560 c Institute of Mathematical Statistics, 2009 SUPPORT POINTS OF LOCALLY OPTIMAL DESIGNS FOR NONLINEAR MODELS WITH TWO PARAMETERS
More informationOPTIMAL DESIGNS FOR GENERALIZED LINEAR MODELS WITH MULTIPLE DESIGN VARIABLES
Statistica Sinica 21 (2011, 1415-1430 OPTIMAL DESIGNS FOR GENERALIZED LINEAR MODELS WITH MULTIPLE DESIGN VARIABLES Min Yang, Bin Zhang and Shuguang Huang University of Missouri, University of Alabama-Birmingham
More informationCompound Optimal Designs for Percentile Estimation in Dose-Response Models with Restricted Design Intervals
Compound Optimal Designs for Percentile Estimation in Dose-Response Models with Restricted Design Intervals Stefanie Biedermann 1, Holger Dette 1, Wei Zhu 2 Abstract In dose-response studies, the dose
More informationA-optimal designs for generalized linear model with two parameters
A-optimal designs for generalized linear model with two parameters Min Yang * University of Missouri - Columbia Abstract An algebraic method for constructing A-optimal designs for two parameter generalized
More informationLatent Variable Models for Binary Data. Suppose that for a given vector of explanatory variables x, the latent
Latent Variable Models for Binary Data Suppose that for a given vector of explanatory variables x, the latent variable, U, has a continuous cumulative distribution function F (u; x) and that the binary
More informationST3241 Categorical Data Analysis I Generalized Linear Models. Introduction and Some Examples
ST3241 Categorical Data Analysis I Generalized Linear Models Introduction and Some Examples 1 Introduction We have discussed methods for analyzing associations in two-way and three-way tables. Now we will
More informationStandard Errors & Confidence Intervals. N(0, I( β) 1 ), I( β) = [ 2 l(β, φ; y) β i β β= β j
Standard Errors & Confidence Intervals β β asy N(0, I( β) 1 ), where I( β) = [ 2 l(β, φ; y) ] β i β β= β j We can obtain asymptotic 100(1 α)% confidence intervals for β j using: β j ± Z 1 α/2 se( β j )
More informationSingle-level Models for Binary Responses
Single-level Models for Binary Responses Distribution of Binary Data y i response for individual i (i = 1,..., n), coded 0 or 1 Denote by r the number in the sample with y = 1 Mean and variance E(y) =
More informationAP-Optimum Designs for Minimizing the Average Variance and Probability-Based Optimality
AP-Optimum Designs for Minimizing the Average Variance and Probability-Based Optimality Authors: N. M. Kilany Faculty of Science, Menoufia University Menoufia, Egypt. (neveenkilany@hotmail.com) W. A. Hassanein
More informationCOMPLEMENTARY LOG-LOG MODEL
COMPLEMENTARY LOG-LOG MODEL Under the assumption of binary response, there are two alternatives to logit model: probit model and complementary-log-log model. They all follow the same form π ( x) =Φ ( α
More informationStat 5101 Lecture Notes
Stat 5101 Lecture Notes Charles J. Geyer Copyright 1998, 1999, 2000, 2001 by Charles J. Geyer May 7, 2001 ii Stat 5101 (Geyer) Course Notes Contents 1 Random Variables and Change of Variables 1 1.1 Random
More informationSTAT5044: Regression and Anova
STAT5044: Regression and Anova Inyoung Kim 1 / 18 Outline 1 Logistic regression for Binary data 2 Poisson regression for Count data 2 / 18 GLM Let Y denote a binary response variable. Each observation
More informationSTA216: Generalized Linear Models. Lecture 1. Review and Introduction
STA216: Generalized Linear Models Lecture 1. Review and Introduction Let y 1,..., y n denote n independent observations on a response Treat y i as a realization of a random variable Y i In the general
More informationPubH 7470: STATISTICS FOR TRANSLATIONAL & CLINICAL RESEARCH
PubH 7470: STATISTICS FOR TRANSLATIONAL & CLINICAL RESEARCH From Basic to Translational: INDIRECT BIOASSAYS INDIRECT ASSAYS In indirect assays, the doses of the standard and test preparations are are applied
More informationGeneralized Linear Models
Generalized Linear Models Advanced Methods for Data Analysis (36-402/36-608 Spring 2014 1 Generalized linear models 1.1 Introduction: two regressions So far we ve seen two canonical settings for regression.
More informationEfficient Experimental Design Strategies in Toxicology and Bioassay
STATISTICS, OPTIMIZATION AND INFORMATION COMPUTING Stat., Optim. Inf. Comput., Vol. 4, June 2016, pp 99 106. Published online in International Academic Press (www.iapress.org) Efficient Experimental Design
More informationHANDBOOK OF APPLICABLE MATHEMATICS
HANDBOOK OF APPLICABLE MATHEMATICS Chief Editor: Walter Ledermann Volume VI: Statistics PART A Edited by Emlyn Lloyd University of Lancaster A Wiley-Interscience Publication JOHN WILEY & SONS Chichester
More informationINTRODUCING LINEAR REGRESSION MODELS Response or Dependent variable y
INTRODUCING LINEAR REGRESSION MODELS Response or Dependent variable y Predictor or Independent variable x Model with error: for i = 1,..., n, y i = α + βx i + ε i ε i : independent errors (sampling, measurement,
More informationCopula Regression RAHUL A. PARSA DRAKE UNIVERSITY & STUART A. KLUGMAN SOCIETY OF ACTUARIES CASUALTY ACTUARIAL SOCIETY MAY 18,2011
Copula Regression RAHUL A. PARSA DRAKE UNIVERSITY & STUART A. KLUGMAN SOCIETY OF ACTUARIES CASUALTY ACTUARIAL SOCIETY MAY 18,2011 Outline Ordinary Least Squares (OLS) Regression Generalized Linear Models
More informationA new algorithm for deriving optimal designs
A new algorithm for deriving optimal designs Stefanie Biedermann, University of Southampton, UK Joint work with Min Yang, University of Illinois at Chicago 18 October 2012, DAE, University of Georgia,
More informationLecture 6: Discrete Choice: Qualitative Response
Lecture 6: Instructor: Department of Economics Stanford University 2011 Types of Discrete Choice Models Univariate Models Binary: Linear; Probit; Logit; Arctan, etc. Multinomial: Logit; Nested Logit; GEV;
More informationOptimal Experimental Designs for the Poisson Regression Model in Toxicity Studies
Optimal Experimental Designs for the Poisson Regression Model in Toxicity Studies Yanping Wang Dissertation submitted to the Faculty of the Virginia Polytechnic Institute and State University in partial
More informationDiscussion of Paper by Bendel Fygenson
Discussion of Paper by Bendel Fygenson Mark S. Kaiser and Daniel J. Nordman Department of Statistics Iowa State University June 2007 i 1 Professor Fygenson has produced a thought-provoking paper that contains
More informationOptimum designs for model. discrimination and estimation. in Binary Response Models
Optimum designs for model discrimination and estimation in Binary Response Models by Wei-Shan Hsieh Advisor Mong-Na Lo Huang Department of Applied Mathematics National Sun Yat-sen University Kaohsiung,
More informationMINIMAX OPTIMAL DESIGNS IN NONLINEAR REGRESSION MODELS
Statistica Sinica 8(998, 49-64 MINIMAX OPTIMAL DESIGNS IN NONLINEAR REGRESSION MODELS Holger Dette and Michael Sahm Ruhr-Universität Bochum Astract: We consider the maximum variance optimality criterion
More informationModel Selection in GLMs. (should be able to implement frequentist GLM analyses!) Today: standard frequentist methods for model selection
Model Selection in GLMs Last class: estimability/identifiability, analysis of deviance, standard errors & confidence intervals (should be able to implement frequentist GLM analyses!) Today: standard frequentist
More informationSequential Experimental Designs for Generalized Linear Models
Sequential Experimental Designs for Generalized Linear Models Hovav A. Dror and David M. Steinberg, JASA (2008) Bob A. Salim May 14, 2013 Bob A. Salim Sequential Experimental Designs for Generalized Linear
More informationSections 4.1, 4.2, 4.3
Sections 4.1, 4.2, 4.3 Timothy Hanson Department of Statistics, University of South Carolina Stat 770: Categorical Data Analysis 1/ 32 Chapter 4: Introduction to Generalized Linear Models Generalized linear
More informationLOGISTIC REGRESSION Joseph M. Hilbe
LOGISTIC REGRESSION Joseph M. Hilbe Arizona State University Logistic regression is the most common method used to model binary response data. When the response is binary, it typically takes the form of
More informationBayesian Inference in GLMs. Frequentists typically base inferences on MLEs, asymptotic confidence
Bayesian Inference in GLMs Frequentists typically base inferences on MLEs, asymptotic confidence limits, and log-likelihood ratio tests Bayesians base inferences on the posterior distribution of the unknowns
More informationOptimal and efficient designs for Gompertz regression models
Ann Inst Stat Math (2012) 64:945 957 DOI 10.1007/s10463-011-0340-y Optimal and efficient designs for Gompertz regression models Gang Li Received: 13 July 2010 / Revised: 11 August 2011 / Published online:
More informationD-optimal designs for logistic regression in two variables
D-optimal designs for logistic regression in two variables Linda M. Haines 1, M. Gaëtan Kabera 2, P. Ndlovu 2 and T. E. O Brien 3 1 Department of Statistical Sciences, University of Cape Town, Rondebosch
More information11. Generalized Linear Models: An Introduction
Sociology 740 John Fox Lecture Notes 11. Generalized Linear Models: An Introduction Copyright 2014 by John Fox Generalized Linear Models: An Introduction 1 1. Introduction I A synthesis due to Nelder and
More informationGeneralized Linear Models for Non-Normal Data
Generalized Linear Models for Non-Normal Data Today s Class: 3 parts of a generalized model Models for binary outcomes Complications for generalized multivariate or multilevel models SPLH 861: Lecture
More informationLinear model A linear model assumes Y X N(µ(X),σ 2 I), And IE(Y X) = µ(x) = X β, 2/52
Statistics for Applications Chapter 10: Generalized Linear Models (GLMs) 1/52 Linear model A linear model assumes Y X N(µ(X),σ 2 I), And IE(Y X) = µ(x) = X β, 2/52 Components of a linear model The two
More informationSTA 216: GENERALIZED LINEAR MODELS. Lecture 1. Review and Introduction. Much of statistics is based on the assumption that random
STA 216: GENERALIZED LINEAR MODELS Lecture 1. Review and Introduction Much of statistics is based on the assumption that random variables are continuous & normally distributed. Normal linear regression
More informationAN ASYMPTOTIC THEORY OF SEQUENTIAL DESIGNS BASED ON MAXIMUM LIKELIHOOD RECURSIONS
Statistica Sinica 7(1997), 75-91 AN ASYMPTOTIC THEORY OF SEQUENTIAL DESIGNS BASED ON MAXIMUM LIKELIHOOD RECURSIONS Zhiliang Ying and C. F. Jeff Wu Rutgers University and University of Michigan Abstract:
More informationBayesian Methods for Accelerated Destructive Degradation Test Planning
Statistics Preprints Statistics 11-2010 Bayesian Methods for Accelerated Destructive Degradation Test Planning Ying Shi Iowa State University William Q. Meeker Iowa State University, wqmeeker@iastate.edu
More informationLinear Regression With Special Variables
Linear Regression With Special Variables Junhui Qian December 21, 2014 Outline Standardized Scores Quadratic Terms Interaction Terms Binary Explanatory Variables Binary Choice Models Standardized Scores:
More informationOPTIMAL TWO-STAGE DESIGNS FOR BINARY RESPONSE EXPERIMENTS
Statistica Sinica 7(1997), 941-955 OPTIMAL TWO-STAGE DESIGNS FOR BINARY RESPONSE EXPERIMENTS R. R. Sitter and B. E. Forbes Simon Fraser University and Carleton University Abstract: In typical binary response
More informationRelative Potency Estimations in Multiple Bioassay Problems
Relative Potency Estimations in Multiple Bioassay Problems Gemechis Dilba Institute of Biostatistics, Leibniz University of Hannover, Germany 5 th International Conference on Multiple Comparison Procedures
More informationMULTIPLE-OBJECTIVE DESIGNS IN A DOSE-RESPONSE EXPERIMENT
New Developments and Applications in Experimental Design IMS Lecture Notes - Monograph Series (1998) Volume 34 MULTIPLE-OBJECTIVE DESIGNS IN A DOSE-RESPONSE EXPERIMENT BY WEI ZHU AND WENG KEE WONG 1 State
More informationEPSY 905: Fundamentals of Multivariate Modeling Online Lecture #7
Introduction to Generalized Univariate Models: Models for Binary Outcomes EPSY 905: Fundamentals of Multivariate Modeling Online Lecture #7 EPSY 905: Intro to Generalized In This Lecture A short review
More informationSequential Experimental Designs for Generalized Linear Models
Sequential Experimental Designs for Generalized Linear Models Hovav A. Dror and David M. Steinberg, JASA (2008) Bob A. Salim April 23, 2013 Bob A. Salim Sequential Experimental Designs for Generalized
More informationAGEC 661 Note Eleven Ximing Wu. Exponential regression model: m (x, θ) = exp (xθ) for y 0
AGEC 661 ote Eleven Ximing Wu M-estimator So far we ve focused on linear models, where the estimators have a closed form solution. If the population model is nonlinear, the estimators often do not have
More informationCategorical data analysis Chapter 5
Categorical data analysis Chapter 5 Interpreting parameters in logistic regression The sign of β determines whether π(x) is increasing or decreasing as x increases. The rate of climb or descent increases
More informationChapter 9 Regression with a Binary Dependent Variable. Multiple Choice. 1) The binary dependent variable model is an example of a
Chapter 9 Regression with a Binary Dependent Variable Multiple Choice ) The binary dependent variable model is an example of a a. regression model, which has as a regressor, among others, a binary variable.
More informationGeneralized Linear Models. Last time: Background & motivation for moving beyond linear
Generalized Linear Models Last time: Background & motivation for moving beyond linear regression - non-normal/non-linear cases, binary, categorical data Today s class: 1. Examples of count and ordered
More informationRegression. Estimation of the linear function (straight line) describing the linear component of the joint relationship between two variables X and Y.
Regression Bivariate i linear regression: Estimation of the linear function (straight line) describing the linear component of the joint relationship between two variables and. Generally describe as a
More informationBiost 518 Applied Biostatistics II. Purpose of Statistics. First Stage of Scientific Investigation. Further Stages of Scientific Investigation
Biost 58 Applied Biostatistics II Scott S. Emerson, M.D., Ph.D. Professor of Biostatistics University of Washington Lecture 5: Review Purpose of Statistics Statistics is about science (Science in the broadest
More informationDesigns for Generalized Linear Models
Designs for Generalized Linear Models Anthony C. Atkinson David C. Woods London School of Economics and Political Science, UK University of Southampton, UK December 9, 2013 Email: a.c.atkinson@lse.ac.uk
More informationGeneralized Linear Models Introduction
Generalized Linear Models Introduction Statistics 135 Autumn 2005 Copyright c 2005 by Mark E. Irwin Generalized Linear Models For many problems, standard linear regression approaches don t work. Sometimes,
More informationChapter 4: Generalized Linear Models-I
: Generalized Linear Models-I Dipankar Bandyopadhyay Department of Biostatistics, Virginia Commonwealth University BIOS 625: Categorical Data & GLM [Acknowledgements to Tim Hanson and Haitao Chu] D. Bandyopadhyay
More information401 Review. 6. Power analysis for one/two-sample hypothesis tests and for correlation analysis.
401 Review Major topics of the course 1. Univariate analysis 2. Bivariate analysis 3. Simple linear regression 4. Linear algebra 5. Multiple regression analysis Major analysis methods 1. Graphical analysis
More informationBayesian linear regression
Bayesian linear regression Linear regression is the basis of most statistical modeling. The model is Y i = X T i β + ε i, where Y i is the continuous response X i = (X i1,..., X ip ) T is the corresponding
More informationFrailty Modeling for Spatially Correlated Survival Data, with Application to Infant Mortality in Minnesota By: Sudipto Banerjee, Mela. P.
Frailty Modeling for Spatially Correlated Survival Data, with Application to Infant Mortality in Minnesota By: Sudipto Banerjee, Melanie M. Wall, Bradley P. Carlin November 24, 2014 Outlines of the talk
More informationLinear Regression Models P8111
Linear Regression Models P8111 Lecture 25 Jeff Goldsmith April 26, 2016 1 of 37 Today s Lecture Logistic regression / GLMs Model framework Interpretation Estimation 2 of 37 Linear regression Course started
More informationGeneralized Linear Models 1
Generalized Linear Models 1 STA 2101/442: Fall 2012 1 See last slide for copyright information. 1 / 24 Suggested Reading: Davison s Statistical models Exponential families of distributions Sec. 5.2 Chapter
More informationWeek 7: Binary Outcomes (Scott Long Chapter 3 Part 2)
Week 7: (Scott Long Chapter 3 Part 2) Tsun-Feng Chiang* *School of Economics, Henan University, Kaifeng, China April 29, 2014 1 / 38 ML Estimation for Probit and Logit ML Estimation for Probit and Logit
More informationSTAT 7030: Categorical Data Analysis
STAT 7030: Categorical Data Analysis 5. Logistic Regression Peng Zeng Department of Mathematics and Statistics Auburn University Fall 2012 Peng Zeng (Auburn University) STAT 7030 Lecture Notes Fall 2012
More informationBayesian Inference. Chapter 9. Linear models and regression
Bayesian Inference Chapter 9. Linear models and regression M. Concepcion Ausin Universidad Carlos III de Madrid Master in Business Administration and Quantitative Methods Master in Mathematical Engineering
More informationBinary choice. Michel Bierlaire
Binary choice Michel Bierlaire Transport and Mobility Laboratory School of Architecture, Civil and Environmental Engineering Ecole Polytechnique Fédérale de Lausanne M. Bierlaire (TRANSP-OR ENAC EPFL)
More informationGeneralized Models: Part 1
Generalized Models: Part 1 Topics: Introduction to generalized models Introduction to maximum likelihood estimation Models for binary outcomes Models for proportion outcomes Models for categorical outcomes
More informationBayesian Multivariate Logistic Regression
Bayesian Multivariate Logistic Regression Sean M. O Brien and David B. Dunson Biostatistics Branch National Institute of Environmental Health Sciences Research Triangle Park, NC 1 Goals Brief review of
More informationGauge Plots. Gauge Plots JAPANESE BEETLE DATA MAXIMUM LIKELIHOOD FOR SPATIALLY CORRELATED DISCRETE DATA JAPANESE BEETLE DATA
JAPANESE BEETLE DATA 6 MAXIMUM LIKELIHOOD FOR SPATIALLY CORRELATED DISCRETE DATA Gauge Plots TuscaroraLisa Central Madsen Fairways, 996 January 9, 7 Grubs Adult Activity Grub Counts 6 8 Organic Matter
More informationModeling Binary Outcomes: Logit and Probit Models
Modeling Binary Outcomes: Logit and Probit Models Eric Zivot December 5, 2009 Motivating Example: Women s labor force participation y i = 1 if married woman is in labor force = 0 otherwise x i k 1 = observed
More informationDistribution-free ROC Analysis Using Binary Regression Techniques
Distribution-free Analysis Using Binary Techniques Todd A. Alonzo and Margaret S. Pepe As interpreted by: Andrew J. Spieker University of Washington Dept. of Biostatistics Introductory Talk No, not that!
More informationInfinitely Imbalanced Logistic Regression
p. 1/1 Infinitely Imbalanced Logistic Regression Art B. Owen Journal of Machine Learning Research, April 2007 Presenter: Ivo D. Shterev p. 2/1 Outline Motivation Introduction Numerical Examples Notation
More informationUQ, Semester 1, 2017, Companion to STAT2201/CIVL2530 Exam Formulae and Tables
UQ, Semester 1, 2017, Companion to STAT2201/CIVL2530 Exam Formulae and Tables To be provided to students with STAT2201 or CIVIL-2530 (Probability and Statistics) Exam Main exam date: Tuesday, 20 June 1
More informationGeneralized Linear Models
York SPIDA John Fox Notes Generalized Linear Models Copyright 2010 by John Fox Generalized Linear Models 1 1. Topics I The structure of generalized linear models I Poisson and other generalized linear
More informationOPTIMAL DESIGN INPUTS FOR EXPERIMENTAL CHAPTER 17. Organization of chapter in ISSO. Background. Linear models
CHAPTER 17 Slides for Introduction to Stochastic Search and Optimization (ISSO)by J. C. Spall OPTIMAL DESIGN FOR EXPERIMENTAL INPUTS Organization of chapter in ISSO Background Motivation Finite sample
More informationContents 1. Contents
Contents 1 Contents 6 Distributions of Functions of Random Variables 2 6.1 Transformation of Discrete r.v.s............. 3 6.2 Method of Distribution Functions............. 6 6.3 Method of Transformations................
More informationSubject CS1 Actuarial Statistics 1 Core Principles
Institute of Actuaries of India Subject CS1 Actuarial Statistics 1 Core Principles For 2019 Examinations Aim The aim of the Actuarial Statistics 1 subject is to provide a grounding in mathematical and
More informationGeneralized Linear Models (GLZ)
Generalized Linear Models (GLZ) Generalized Linear Models (GLZ) are an extension of the linear modeling process that allows models to be fit to data that follow probability distributions other than the
More informationLogistic regression. 11 Nov Logistic regression (EPFL) Applied Statistics 11 Nov / 20
Logistic regression 11 Nov 2010 Logistic regression (EPFL) Applied Statistics 11 Nov 2010 1 / 20 Modeling overview Want to capture important features of the relationship between a (set of) variable(s)
More informationSTA 216, GLM, Lecture 16. October 29, 2007
STA 216, GLM, Lecture 16 October 29, 2007 Efficient Posterior Computation in Factor Models Underlying Normal Models Generalized Latent Trait Models Formulation Genetic Epidemiology Illustration Structural
More informationABHELSINKI UNIVERSITY OF TECHNOLOGY
Cross-Validation, Information Criteria, Expected Utilities and the Effective Number of Parameters Aki Vehtari and Jouko Lampinen Laboratory of Computational Engineering Introduction Expected utility -
More informationOutline of GLMs. Definitions
Outline of GLMs Definitions This is a short outline of GLM details, adapted from the book Nonparametric Regression and Generalized Linear Models, by Green and Silverman. The responses Y i have density
More informationSome Approximations of the Logistic Distribution with Application to the Covariance Matrix of Logistic Regression
Working Paper 2013:9 Department of Statistics Some Approximations of the Logistic Distribution with Application to the Covariance Matrix of Logistic Regression Ronnie Pingel Working Paper 2013:9 June
More informationMS&E 226: Small Data. Lecture 11: Maximum likelihood (v2) Ramesh Johari
MS&E 226: Small Data Lecture 11: Maximum likelihood (v2) Ramesh Johari ramesh.johari@stanford.edu 1 / 18 The likelihood function 2 / 18 Estimating the parameter This lecture develops the methodology behind
More information9 Generalized Linear Models
9 Generalized Linear Models The Generalized Linear Model (GLM) is a model which has been built to include a wide range of different models you already know, e.g. ANOVA and multiple linear regression models
More informationClass Notes: Week 8. Probit versus Logit Link Functions and Count Data
Ronald Heck Class Notes: Week 8 1 Class Notes: Week 8 Probit versus Logit Link Functions and Count Data This week we ll take up a couple of issues. The first is working with a probit link function. While
More informationECON 3150/4150, Spring term Lecture 6
ECON 3150/4150, Spring term 2013. Lecture 6 Review of theoretical statistics for econometric modelling (II) Ragnar Nymoen University of Oslo 31 January 2013 1 / 25 References to Lecture 3 and 6 Lecture
More informationEconometrics II. Seppo Pynnönen. Spring Department of Mathematics and Statistics, University of Vaasa, Finland
Department of Mathematics and Statistics, University of Vaasa, Finland Spring 2018 Part III Limited Dependent Variable Models As of Jan 30, 2017 1 Background 2 Binary Dependent Variable The Linear Probability
More informationOptimal designs for multi-response generalized linear models with applications in thermal spraying
Optimal designs for multi-response generalized linear models with applications in thermal spraying Holger Dette Ruhr-Universität Bochum Fakultät für Mathematik 44780 Bochum Germany email: holger.dette@ruhr-uni-bochum.de
More informationBMI 541/699 Lecture 22
BMI 541/699 Lecture 22 Where we are: 1. Introduction and Experimental Design 2. Exploratory Data Analysis 3. Probability 4. T-based methods for continous variables 5. Power and sample size for t-based
More informationA Bayesian Mixture Model with Application to Typhoon Rainfall Predictions in Taipei, Taiwan 1
Int. J. Contemp. Math. Sci., Vol. 2, 2007, no. 13, 639-648 A Bayesian Mixture Model with Application to Typhoon Rainfall Predictions in Taipei, Taiwan 1 Tsai-Hung Fan Graduate Institute of Statistics National
More informationOpen Problems in Mixed Models
xxiii Determining how to deal with a not positive definite covariance matrix of random effects, D during maximum likelihood estimation algorithms. Several strategies are discussed in Section 2.15. For
More informationMS-E2112 Multivariate Statistical Analysis (5cr) Lecture 8: Canonical Correlation Analysis
MS-E2112 Multivariate Statistical (5cr) Lecture 8: Contents Canonical correlation analysis involves partition of variables into two vectors x and y. The aim is to find linear combinations α T x and β
More informationBIO5312 Biostatistics Lecture 13: Maximum Likelihood Estimation
BIO5312 Biostatistics Lecture 13: Maximum Likelihood Estimation Yujin Chung November 29th, 2016 Fall 2016 Yujin Chung Lec13: MLE Fall 2016 1/24 Previous Parametric tests Mean comparisons (normality assumption)
More informationD-OPTIMAL DESIGNS WITH ORDERED CATEGORICAL DATA
Statistica Sinica 27 (2017), 000-000 doi:https://doi.org/10.5705/ss.202016.0210 D-OPTIMAL DESIGNS WITH ORDERED CATEGORICAL DATA Jie Yang, Liping Tong and Abhyuday Mandal University of Illinois at Chicago,
More informationJoint work with Nottingham colleagues Simon Preston and Michail Tsagris.
/pgf/stepx/.initial=1cm, /pgf/stepy/.initial=1cm, /pgf/step/.code=1/pgf/stepx/.expanded=- 10.95415pt,/pgf/stepy/.expanded=- 10.95415pt, /pgf/step/.value required /pgf/images/width/.estore in= /pgf/images/height/.estore
More information1. Fisher Information
1. Fisher Information Let f(x θ) be a density function with the property that log f(x θ) is differentiable in θ throughout the open p-dimensional parameter set Θ R p ; then the score statistic (or score
More informationSemiparametric Generalized Linear Models
Semiparametric Generalized Linear Models North American Stata Users Group Meeting Chicago, Illinois Paul Rathouz Department of Health Studies University of Chicago prathouz@uchicago.edu Liping Gao MS Student
More informationGeneralized Linear Models: An Introduction
Applied Statistics With R Generalized Linear Models: An Introduction John Fox WU Wien May/June 2006 2006 by John Fox Generalized Linear Models: An Introduction 1 A synthesis due to Nelder and Wedderburn,
More informationWeighted Exponential Distribution and Process
Weighted Exponential Distribution and Process Jilesh V Some generalizations of exponential distribution and related time series models Thesis. Department of Statistics, University of Calicut, 200 Chapter
More informationOptimal Design for Nonlinear and Spatial Models: Introduction and Historical Overview
12 Optimal Design for Nonlinear and Spatial Models: Introduction and Historical Overview Douglas P. Wiens CONTENTS 12.1 Introduction...457 12.2 Generalized Linear Models...457 12.3 Selected Nonlinear Models...460
More informationProblem Selected Scores
Statistics Ph.D. Qualifying Exam: Part II November 20, 2010 Student Name: 1. Answer 8 out of 12 problems. Mark the problems you selected in the following table. Problem 1 2 3 4 5 6 7 8 9 10 11 12 Selected
More informationContents. Preface to Second Edition Preface to First Edition Abbreviations PART I PRINCIPLES OF STATISTICAL THINKING AND ANALYSIS 1
Contents Preface to Second Edition Preface to First Edition Abbreviations xv xvii xix PART I PRINCIPLES OF STATISTICAL THINKING AND ANALYSIS 1 1 The Role of Statistical Methods in Modern Industry and Services
More information