Pubh 8482: Sequential Analysis
|
|
- Susanna Potter
- 5 years ago
- Views:
Transcription
1 Pubh 8482: Sequential Analysis Joseph S. Koopmeiners Division of Biostatistics University of Minnesota Week 8
2 P-values When reporting results, we usually report p-values in place of reporting whether or not we reject the null hypothesis For better or worse, p-values are usually used by investigators to evaluate the strength of evidence against the null hypothesis P-values are then translated into hypothesis tests by comparing p-values to a nominal significance level (usually 0.05)
3 P-values and group sequential designs We ve seen that a group sequential testing procedure will change the sampling distribution of a test statistic Z This means that inference based on usual normal approximations are no longer appropriate How do we calculate p-values for group sequential designs?
4 Problem A p-value can be interpreted as the probability under the null hypothesis of observing a test statistic as extreme or more extreme than what was observed This simply in a fixed-sample design Z 1 < Z 2 implies Z 2 is more extreme than Z 1 This is not so clear in the group sequential setting
5 Problem Which of the following realizations is more extreme? (T = 1, Z 1 = 3.70) (T = 2, Z 2 = 4.50) It depends how you order the sample space? It is not obvious how this should be done We will consider four possible ordering stage-wide ordering MLE ordering Likelihood ordering Score Test ordering
6 Stage-wise Ordering the pair (k 2, z 2 ) > (k 1, z 1 ) if any of the following are true k 2 = k 1 and z 2 z 1 k 2 < k 1 and z 2 b k2 k 2 > k 1 and z 1 a k1
7 MLE Ordering The pair (k 2, z 2 ) > (k 1, z 1 ) if z 2 / I k2 > z 1 / I k1
8 Likelihood Ordering The pair (k 2, z 2 ) > (k 1, z 1 ) if z 2 > z 1
9 Score-Test Ordering The pair (k 2, z 2 ) > (k 1, z 1 ) if z 2 Ik2 > z 1 Ik1
10 Ordering: Example Consider a one-sided power family test with k = 5 and the following stopping boundaries a 1 : a 5 = 3.49, 0.70, 0.43, 1.13, 1.63 b 1 : b 5 = 8.11, 4.06, 2.70, 2.03, 1.63 Consider the following pairs of sufficient statistics with information levels: 1, 2, 3, 5 and 5 (k 1, z 1 ) = (2, 5.0) (k 2, z 2 ) = (4, 0.5) (k 3, z 3 ) = (5, 1.8)
11 Stage-wide Ordering: Example (k 1, z 1 ) > (k 2, z 2 ) k 1 < k 2 and z 1 > b 1 (k 1, z 1 ) > (k 3, z 3 ) k 1 < k 3 and z 1 > b 1 (k 3, z 3 ) > (k 2, z 2 ) k 3 > k 2 and z 2 < a 2
12 MLE Ordering: Example (k 1, z 1 ) > (k 2, z 2 ) z 1 / I 1 = 3.54 > z 2 / I 2 = 0.25 (k 1, z 1 ) > (k 3, z 3 ) z 1 / I 1 = 3.54 > z 3 / I 3 = 0.80 (k 3, z 3 ) > (k 2, z 2 ) z 3 / I 3 = 0.80 > z 2 / I 2 = 0.25
13 Likelihood Ordering: Example (k 1, z 1 ) > (k 2, z 2 ) z 1 > z 2 (k 1, z 1 ) > (k 3, z 3 ) z 1 > z 3 (k 3, z 3 ) > (k 2, z 2 ) z 3 > z 2
14 Score-test Ordering: Example (k 1, z 1 ) > (k 2, z 2 ) z 1 I1 = 7.07 > z 2 I2 = 1 (k 1, z 1 ) > (k 3, z 3 ) z 1 I1 = 7.07 > z 3 I3 = 4.02 (k 3, z 3 ) > (k 2, z 2 ) z 3 I3 = 4.02 > z 2 I2 = 0.80
15 Calculating P-values The orderings described on the preceding slides allow us to order the sample space in a sensible manner How do we translate these orderings into a p-value? Recall the definition of a p-value: The probability under the null hypothesis of observing a test statistic as extreme or more extreme than what was observed
16 Calculating P-values One-sided upper P-value: One-sided lower P-value: P θ=0 ((T, Z T ) (k, Z k )) P θ=0 ((T, Z T ) (k, Z k )) Two-sided p-value is equal to twice the minimum of the upper and lower p-value
17 Calculating P-values: Stage-wise Ordering For sufficient statistic, (k, z k ), the one-sided upper p-value assuming the stage-wide ordering is: k 1 P θ=0 ((T, Z T ) (k, Z k )) = + i=1 b i z k f (i, z θ = 0) dz f (k, z θ = 0) dz
18 Properties of the Stage-wise ordering The p-value is less than α if and only if H 0 is reject The p-value does not depend on information levels beyond the observed stopping stage
19 Calculating P-values: MLE Ordering For sufficient statistic, (k, z k ), the one-sided upper p-value assuming the MLE ordering is: P θ=0 ((T, Z T ) (k, Z k )) = K i=1 z k Ii /I k f (i, z θ = 0) dz
20 Calculating P-values: Likelihood Ratio Ordering For sufficient statistic, (k, z k ), the one-sided upper p-value assuming the likelihood ratio ordering is: P θ=0 ((T, Z T ) (k, Z k )) = K i=1 z k f (i, z θ = 0) dz
21 Calculating P-values: Score test Ordering For sufficient statistic, (k, z k ), the one-sided upper p-value assuming the score test ordering is: P θ=0 ((T, Z T ) (k, Z k )) = K i=1 z k Ik /I i f (i, z θ = 0) dz
22 Properties of the MLE, likelihood and score test orderings All three cases potentially involve integrating over regions that do not correspond to rejecting the null hypothesis P-values depend on the information levels for future (unobserved) stopping times
23 Calculating P-values: Example Consider a group sequential design with two-sided O Brien-Fleming boundaries, k = 5 and α = 0.05 b 1 = 4.56 b 2 = 3.23 b 3 = 2.63 b 4 = 2.28 b 5 = 2.04 Two cases: (k, z k ) = (2, 3.5) (k, z k ) = (5, 2.5)
24 Calculating P-values: Example 1 Stage-wise ordering ( p = 2 f (1, z θ = 0) dz = ) f (2, z θ = 0) dz
25 Calculating P-values: Example 1 MLE ordering ( p = 2 f (1, z θ = 0) dz /.4 + f (3, z θ = 0) dz /.4 ) /.4 = f (5, z θ = 0) dz /.4 f (2, z θ = 0) dz f (4, z θ = 0) dz
26 Calculating P-values: Example 1 Likelihood ratio ordering p = 2 ( 5 = i=1 3.5 f (i, z θ = 0) dz )
27 Calculating P-values: Example 1 Score test ordering ( p = 2 f (1, z θ = 0) dz /.2 + f (3, z θ = 0) dz /.6 ) /1 = f (5, z θ = 0) dz /.8 f (2, z θ = 0) dz f (4, z θ = 0) dz
28 Calculating P-values: Example 1 Summary Ordering p-value Stage-wise MLE LR Score test
29 Calculating P-values: Example 2 Stage-wise ordering ( p = 2 f (1, z θ = 0) dz = = f (3, z θ = 0) dz + ) f (5, z θ = 0) dz f (2, z θ = 0) dz f (4, z θ = 0) dz
30 Calculating P-values: Example 2 MLE ordering ( p = 2 f (1, z θ = 0) dz /.4 + f (3, z θ = 0) dz /.4 ) /.4 = f (5, z θ = 0) dz /.4 f (2, z θ = 0) dz f (4, z θ = 0) dz
31 Calculating P-values: Example 2 Likelihood ratio ordering p = 2 ( 5 = i=1 2.5 f (i, z θ = 0) dz )
32 Calculating P-values: Example 2 Score test ordering ( p = 2 f (1, z θ = 0) dz /.2 + f (3, z θ = 0) dz /.6 ) /1 = f (5, z θ = 0) dz /.8 f (2, z θ = 0) dz f (4, z θ = 0) dz
33 Calculating P-values: Example 2 Summary Ordering p-value Stage-wise MLE LR Score test
34 P-values: Summary There are many approaches to ordering the sample space after a group sequential clinical trial P-values will vary considerably depending on the ordering applied The stage-wise ordering is preferred because: The p-value is less than α if and only if H 0 is reject The p-value does not depend on information levels beyond the observed stopping stage
35 Confidence intervals In general, (1 α) level confidence intervals for θ can be derived by inverting a hypothesis test with type-i error α Confidence intervals after a group sequential test will also rely on the orderings described previously for ordering the sample space Properties of confidence intervals after a group sequential test will depend on how the sample space is ordered
36 Inverting a hypothesis test For any ordering and any value of θ 0, we can find pairs (k u (θ 0 ), z u (θ 0 )) and (k l (θ 0 ), z l (θ 0 )) such that P θ=θ0 ((T, Z T ) (k u (θ 0 ), z u (θ 0 ))) = α/2 and P θ=θ0 ((T, Z T ) (k l (θ 0 ), z l (θ 0 ))) = α/2
37 Inverting a hypothesis test The acceptance region, A (θ 0 ) = {(k, z) : (k l (θ 0 ), z l (θ 0 )) < (k, z) < (k u (θ 0 ), z u (θ 0 ))} defines a two-sided hypothesis test of θ = θ 0 with type-i error rate α. Therefore, the set θ CS = {θ : (T, Z T ) A (θ)} if a (1 α)-level confidence set for θ
38 Inverting a hypothesis test If P θ ((T, Z T ) (k, z)) is an increasing function of θ for all pairs (k, z), then the set of all pairs (k, z) is said to be stochastically ordered We will refer to this as the monotonicity assumption In this case, (k l (θ 0 ), z l (θ 0 )) and (k u (θ 0 ), z u (θ 0 )) are increasing in θ, where increasing refers to the specified ordering of the sample space Therefore, if the monotonicity assumption holds, the set, θ CS, is an interval, (θ L, θ U ), where P θl ((T, Z T ) (k, z)) = P θu ((T, Z T ) (k, z)) = α/2
39 Desired Properties of Confidence Intervals We would like confidence sets formed after a group sequential design to have the following properties: θ CS should be an interval θ CS should agree with the original test θ CS should contain the MLE, ˆθ = Z T / I T Narrower confidence intervals are preferred θ CS should be well defined when information levels are unpredictable Whether or not these properties hold depends on how the sample space is ordered
40 θ CS should be an interval This holds for the stage-wide ordering when a two-sided or one-sided test is used but not for a two-sided test with an inner-wedge This holds for the MLE ordering This does not always hold for the score-test or likelihood ratio ordering but will be true in most instances
41 θ CS should agree with the original test This holds for the stage-wide and MLE orderings This does not necessarily hold for the likelihood ratio and score test orderings
42 θ CS should contain the MLE, ˆθ = Z T / I T This may not occur for the stage-wise ordering This will hold for the MLE, likelihood ratio and score test ordering
43 Narrower confidence intervals are preferred Width of confidence intervals depends on the design being used, confidence level and true value of θ Limited numerical studies have been completed MLE and Likelihood ratio orderings produce slightly narrower intervals but the difference is negligible
44 θ CS should be well defined when information levels are unpredictable Holds for the stage-wise ordering As previously mentioned, the MLE, likelihood and score test orderings rely on information at future, unobserved time-points Therefore, only the stage-wise ordering can be used when information levels are unpredictable
45 Confidence Intervals: Summary Confidence intervals can be formed by inverting a hypothesis test Confidence intervals will depend on how the sample space is ordered The stage-wise ordering is most commonly used when continuation regions are an interval MLE ordering is most commonly used when continuation regions are not an interval
46 Confidence Intervals: An Alternate Approach The previously described approach is appropriate for constructing confidence intervals at study completion We might, instead, prefer to confidence intervals that can be formed at any interim analysis This is particularly important for safety monitoring boards making decision as to whether or not the study should continue
47 Repeated Confidence Intervals Let CI 1, CI 2,..., CI K be a sequence of confidence intervals formed at the k = 1, 2,..., K This sequence of confidence intervals are known as repeated confidence intervals Repeated confidence intervals are impacted by multiple looks in the same way as repeated hypothesis tests That is, a sequence of (1 α)% confidence intervals will have less than (1 α)% coverage over the K interim analyses
48 Coverage Probability of Naive 95% Repeated Confidence Intervals K Overall Coverage Probability
49 Repeated Confidence Intervals with Correct Coverage The goal is to construct a sequence of repeated confidence intervals that provides correct overall coverage The simplest approach to achieving this goal is to invert a group sequential test with the appropriate type I error probability
50 Repeated Confidence Intervals with Correct Coverage In general, a two-sided group sequential hypothesis test of H 0 : β = β 0 will reject if for k = 1,..., K Z k = ( ˆβ k β 0 ) Ik > c k The general form of the repeated confidence intervals corresponding to this test is for k = 1,..., K CI k = {β 0 : ( ˆβk β 0 ) Ik < c k }
51 Repeated Confidence Intervals with Correct Coverage We know that ( ) ) P β0 ( ˆβk β 0 Ik > c k for some k = 1,..., K = α This implies P β0 (β 0 CI k for some k = 1,..., K ) = α That is, repeated confidence intervals derived form inverting a group sequential test will have correct overall coverage
52 Repeated Confidence Intervals with Correct Coverage In general, standard confidence intervals resulting from normal theory have the following form: ( ˆβ Z1 α/2 / I k, ˆβ + Z 1 α/2 / I k ) For a repeated confidence interval, the general form is ( ˆβ ck / I k, ˆβ + c k / I k ) Note: this is the case for inverting a two-sided test but will not necessarily be the case for inverting a one-sided test
53 Width of Repeated Confidence Intervals In order to achieve correct overall coverage, repeated confidence intervals will be wider than standard confidence intervals Provided below are the ratio of widths of 95% repeated confidence intervals formed by inverting Pocock and O Brien-Fleming boundaries compared to the width of standard confidence intervals Analysis Pocock O Brien-Fleming
54 Repeated Confidence Intervals: Summary Repeated confidence intervals can be formed at any interim analysis Repeated confidence intervals are calibrated to provide correct overall coverage Repeated confidence intervals are wider than standard confidence intervals
Pubh 8482: Sequential Analysis
Pubh 8482: Sequential Analysis Joseph S. Koopmeiners Division of Biostatistics University of Minnesota Week 7 Course Summary To this point, we have discussed group sequential testing focusing on Maintaining
More informationPubh 8482: Sequential Analysis
Pubh 8482: Sequential Analysis Joseph S. Koopmeiners Division of Biostatistics University of Minnesota Week 5 Course Summary So far, we have discussed Group sequential procedures for two-sided tests Group
More informationPubh 8482: Sequential Analysis
Pubh 8482: Sequential Analysis Joseph S. Koopmeiners Division of Biostatistics University of Minnesota Week 12 Review So far... We have discussed the role of phase III clinical trials in drug development
More informationThe Design of Group Sequential Clinical Trials that Test Multiple Endpoints
The Design of Group Sequential Clinical Trials that Test Multiple Endpoints Christopher Jennison Department of Mathematical Sciences, University of Bath, UK http://people.bath.ac.uk/mascj Bruce Turnbull
More informationInterim Monitoring of Clinical Trials: Decision Theory, Dynamic Programming. and Optimal Stopping
Interim Monitoring of Clinical Trials: Decision Theory, Dynamic Programming and Optimal Stopping Christopher Jennison Department of Mathematical Sciences, University of Bath, UK http://people.bath.ac.uk/mascj
More information4. Issues in Trial Monitoring
4. Issues in Trial Monitoring 4.1 Elements of Trial Monitoring Monitoring trial process and quality Infrastructure requirements and DSMBs 4.2 Interim analyses: group sequential trial design 4.3 Group sequential
More informationPubh 8482: Sequential Analysis
Pubh 8482: Sequential Analysis Joseph S. Koopmeiners Division of Biostatistics University of Minnesota Week 10 Class Summary Last time... We began our discussion of adaptive clinical trials Specifically,
More informationEstimation in Flexible Adaptive Designs
Estimation in Flexible Adaptive Designs Werner Brannath Section of Medical Statistics Core Unit for Medical Statistics and Informatics Medical University of Vienna BBS and EFSPI Scientific Seminar on Adaptive
More informationReview. December 4 th, Review
December 4 th, 2017 Att. Final exam: Course evaluation Friday, 12/14/2018, 10:30am 12:30pm Gore Hall 115 Overview Week 2 Week 4 Week 7 Week 10 Week 12 Chapter 6: Statistics and Sampling Distributions Chapter
More informationOptimising Group Sequential Designs. Decision Theory, Dynamic Programming. and Optimal Stopping
: Decision Theory, Dynamic Programming and Optimal Stopping Christopher Jennison Department of Mathematical Sciences, University of Bath, UK http://people.bath.ac.uk/mascj InSPiRe Conference on Methodology
More informationSimple logistic regression
Simple logistic regression Biometry 755 Spring 2009 Simple logistic regression p. 1/47 Model assumptions 1. The observed data are independent realizations of a binary response variable Y that follows a
More informationThe Design of a Survival Study
The Design of a Survival Study The design of survival studies are usually based on the logrank test, and sometimes assumes the exponential distribution. As in standard designs, the power depends on The
More informationMultiple Testing in Group Sequential Clinical Trials
Multiple Testing in Group Sequential Clinical Trials Tian Zhao Supervisor: Michael Baron Department of Mathematical Sciences University of Texas at Dallas txz122@utdallas.edu 7/2/213 1 Sequential statistics
More informationLikelihood-based inference with missing data under missing-at-random
Likelihood-based inference with missing data under missing-at-random Jae-kwang Kim Joint work with Shu Yang Department of Statistics, Iowa State University May 4, 014 Outline 1. Introduction. Parametric
More informationBios 6649: Clinical Trials - Statistical Design and Monitoring
Bios 6649: Clinical Trials - Statistical Design and Monitoring Spring Semester 2015 John M. Kittelson Department of Biostatistics & Informatics Colorado School of Public Health University of Colorado Denver
More informationOverrunning in Clinical Trials: a Methodological Review
Overrunning in Clinical Trials: a Methodological Review Dario Gregori Unit of Biostatistics, Epidemiology and Public Health Department of Cardiac, Thoracic and Vascular Sciences dario.gregori@unipd.it
More informationLet us first identify some classes of hypotheses. simple versus simple. H 0 : θ = θ 0 versus H 1 : θ = θ 1. (1) one-sided
Let us first identify some classes of hypotheses. simple versus simple H 0 : θ = θ 0 versus H 1 : θ = θ 1. (1) one-sided H 0 : θ θ 0 versus H 1 : θ > θ 0. (2) two-sided; null on extremes H 0 : θ θ 1 or
More information1 Statistical inference for a population mean
1 Statistical inference for a population mean 1. Inference for a large sample, known variance Suppose X 1,..., X n represents a large random sample of data from a population with unknown mean µ and known
More informationINTERVAL ESTIMATION AND HYPOTHESES TESTING
INTERVAL ESTIMATION AND HYPOTHESES TESTING 1. IDEA An interval rather than a point estimate is often of interest. Confidence intervals are thus important in empirical work. To construct interval estimates,
More informationGroup Sequential Designs: Theory, Computation and Optimisation
Group Sequential Designs: Theory, Computation and Optimisation Christopher Jennison Department of Mathematical Sciences, University of Bath, UK http://people.bath.ac.uk/mascj 8th International Conference
More informationGroup Sequential Tests for Delayed Responses
Group Sequential Tests for Delayed Responses Lisa Hampson Department of Mathematics and Statistics, Lancaster University, UK Chris Jennison Department of Mathematical Sciences, University of Bath, UK Read
More informationDefinition 3.1 A statistical hypothesis is a statement about the unknown values of the parameters of the population distribution.
Hypothesis Testing Definition 3.1 A statistical hypothesis is a statement about the unknown values of the parameters of the population distribution. Suppose the family of population distributions is indexed
More informationStatistical Inference
Statistical Inference Classical and Bayesian Methods Revision Class for Midterm Exam AMS-UCSC Th Feb 9, 2012 Winter 2012. Session 1 (Revision Class) AMS-132/206 Th Feb 9, 2012 1 / 23 Topics Topics We will
More informationInterval estimation. October 3, Basic ideas CLT and CI CI for a population mean CI for a population proportion CI for a Normal mean
Interval estimation October 3, 2018 STAT 151 Class 7 Slide 1 Pandemic data Treatment outcome, X, from n = 100 patients in a pandemic: 1 = recovered and 0 = not recovered 1 1 1 0 0 0 1 1 1 0 0 1 0 1 0 0
More informationPsychology 282 Lecture #4 Outline Inferences in SLR
Psychology 282 Lecture #4 Outline Inferences in SLR Assumptions To this point we have not had to make any distributional assumptions. Principle of least squares requires no assumptions. Can use correlations
More informationSequential Monitoring of Clinical Trials Session 4 - Bayesian Evaluation of Group Sequential Designs
Sequential Monitoring of Clinical Trials Session 4 - Bayesian Evaluation of Group Sequential Designs Presented August 8-10, 2012 Daniel L. Gillen Department of Statistics University of California, Irvine
More informationTesting a secondary endpoint after a group sequential test. Chris Jennison. 9th Annual Adaptive Designs in Clinical Trials
Testing a secondary endpoint after a group sequential test Christopher Jennison Department of Mathematical Sciences, University of Bath, UK http://people.bath.ac.uk/mascj 9th Annual Adaptive Designs in
More informationA Very Brief Summary of Statistical Inference, and Examples
A Very Brief Summary of Statistical Inference, and Examples Trinity Term 2009 Prof. Gesine Reinert Our standard situation is that we have data x = x 1, x 2,..., x n, which we view as realisations of random
More informationComparing Adaptive Designs and the. Classical Group Sequential Approach. to Clinical Trial Design
Comparing Adaptive Designs and the Classical Group Sequential Approach to Clinical Trial Design Christopher Jennison Department of Mathematical Sciences, University of Bath, UK http://people.bath.ac.uk/mascj
More informationSome General Types of Tests
Some General Types of Tests We may not be able to find a UMP or UMPU test in a given situation. In that case, we may use test of some general class of tests that often have good asymptotic properties.
More informationOn the Inefficiency of the Adaptive Design for Monitoring Clinical Trials
On the Inefficiency of the Adaptive Design for Monitoring Clinical Trials Anastasios A. Tsiatis and Cyrus Mehta http://www.stat.ncsu.edu/ tsiatis/ Inefficiency of Adaptive Designs 1 OUTLINE OF TOPICS Hypothesis
More informationA3. Statistical Inference Hypothesis Testing for General Population Parameters
Appendix / A3. Statistical Inference / General Parameters- A3. Statistical Inference Hypothesis Testing for General Population Parameters POPULATION H 0 : θ = θ 0 θ is a generic parameter of interest (e.g.,
More informationMathematical statistics
October 1 st, 2018 Lecture 11: Sufficient statistic Where are we? Week 1 Week 2 Week 4 Week 7 Week 10 Week 14 Probability reviews Chapter 6: Statistics and Sampling Distributions Chapter 7: Point Estimation
More informationOne-sample categorical data: approximate inference
One-sample categorical data: approximate inference Patrick Breheny October 6 Patrick Breheny Biostatistical Methods I (BIOS 5710) 1/25 Introduction It is relatively easy to think about the distribution
More informationGroup Sequential Tests for Delayed Responses. Christopher Jennison. Lisa Hampson. Workshop on Special Topics on Sequential Methodology
Group Sequential Tests for Delayed Responses Christopher Jennison Department of Mathematical Sciences, University of Bath, UK http://people.bath.ac.uk/mascj Lisa Hampson Department of Mathematics and Statistics,
More informationCh. 5 Hypothesis Testing
Ch. 5 Hypothesis Testing The current framework of hypothesis testing is largely due to the work of Neyman and Pearson in the late 1920s, early 30s, complementing Fisher s work on estimation. As in estimation,
More informationSAMPLE SIZE RE-ESTIMATION FOR ADAPTIVE SEQUENTIAL DESIGN IN CLINICAL TRIALS
Journal of Biopharmaceutical Statistics, 18: 1184 1196, 2008 Copyright Taylor & Francis Group, LLC ISSN: 1054-3406 print/1520-5711 online DOI: 10.1080/10543400802369053 SAMPLE SIZE RE-ESTIMATION FOR ADAPTIVE
More informationc Copyright 2014 Navneet R. Hakhu
c Copyright 04 Navneet R. Hakhu Unconditional Exact Tests for Binomial Proportions in the Group Sequential Setting Navneet R. Hakhu A thesis submitted in partial fulfillment of the requirements for the
More informationFirst we look at some terms to be used in this section.
8 Hypothesis Testing 8.1 Introduction MATH1015 Biostatistics Week 8 In Chapter 7, we ve studied the estimation of parameters, point or interval estimates. The construction of CI relies on the sampling
More informationCHL 5225H Advanced Statistical Methods for Clinical Trials: Multiplicity
CHL 5225H Advanced Statistical Methods for Clinical Trials: Multiplicity Prof. Kevin E. Thorpe Dept. of Public Health Sciences University of Toronto Objectives 1. Be able to distinguish among the various
More informationClassical Inference for Gaussian Linear Models
Classical Inference for Gaussian Linear Models Surya Tokdar Gaussian linear model Data (z i, Y i ), i = 1,, n, dim(z i ) = p Model Y i = z T i Parameters: β R p, σ 2 > 0 Inference needed on η = a T β IID
More informationStatistics 135 Fall 2008 Final Exam
Name: SID: Statistics 135 Fall 2008 Final Exam Show your work. The number of points each question is worth is shown at the beginning of the question. There are 10 problems. 1. [2] The normal equations
More information7.2 One-Sample Correlation ( = a) Introduction. Correlation analysis measures the strength and direction of association between
7.2 One-Sample Correlation ( = a) Introduction Correlation analysis measures the strength and direction of association between variables. In this chapter we will test whether the population correlation
More informationGroup sequential designs with negative binomial data
Group sequential designs with negative binomial data Ekkehard Glimm 1 Tobias Mütze 2,3 1 Statistical Methodology, Novartis, Basel, Switzerland 2 Department of Medical Statistics, University Medical Center
More informationThe t-test Pivots Summary. Pivots and t-tests. Patrick Breheny. October 15. Patrick Breheny Biostatistical Methods I (BIOS 5710) 1/18
and t-tests Patrick Breheny October 15 Patrick Breheny Biostatistical Methods I (BIOS 5710) 1/18 Introduction The t-test As we discussed previously, W.S. Gossett derived the t-distribution as a way of
More informationST495: Survival Analysis: Hypothesis testing and confidence intervals
ST495: Survival Analysis: Hypothesis testing and confidence intervals Eric B. Laber Department of Statistics, North Carolina State University April 3, 2014 I remember that one fateful day when Coach took
More information7 Estimation. 7.1 Population and Sample (P.91-92)
7 Estimation MATH1015 Biostatistics Week 7 7.1 Population and Sample (P.91-92) Suppose that we wish to study a particular health problem in Australia, for example, the average serum cholesterol level for
More informationFall 2017 STAT 532 Homework Peter Hoff. 1. Let P be a probability measure on a collection of sets A.
1. Let P be a probability measure on a collection of sets A. (a) For each n N, let H n be a set in A such that H n H n+1. Show that P (H n ) monotonically converges to P ( k=1 H k) as n. (b) For each n
More informationSTAT 135 Lab 5 Bootstrapping and Hypothesis Testing
STAT 135 Lab 5 Bootstrapping and Hypothesis Testing Rebecca Barter March 2, 2015 The Bootstrap Bootstrap Suppose that we are interested in estimating a parameter θ from some population with members x 1,...,
More informationSimple and Multiple Linear Regression
Sta. 113 Chapter 12 and 13 of Devore March 12, 2010 Table of contents 1 Simple Linear Regression 2 Model Simple Linear Regression A simple linear regression model is given by Y = β 0 + β 1 x + ɛ where
More informationTesting Hypothesis. Maura Mezzetti. Department of Economics and Finance Università Tor Vergata
Maura Department of Economics and Finance Università Tor Vergata Hypothesis Testing Outline It is a mistake to confound strangeness with mystery Sherlock Holmes A Study in Scarlet Outline 1 The Power Function
More informationMonitoring clinical trial outcomes with delayed response: incorporating pipeline data in group sequential designs. Christopher Jennison
Monitoring clinical trial outcomes with delayed response: incorporating pipeline data in group sequential designs Christopher Jennison Department of Mathematical Sciences, University of Bath http://people.bath.ac.uk/mascj
More informationThe SEQDESIGN Procedure
SAS/STAT 9.2 User s Guide, Second Edition The SEQDESIGN Procedure (Book Excerpt) This document is an individual chapter from the SAS/STAT 9.2 User s Guide, Second Edition. The correct bibliographic citation
More informationBIOS 312: Precision of Statistical Inference
and Power/Sample Size and Standard Errors BIOS 312: of Statistical Inference Chris Slaughter Department of Biostatistics, Vanderbilt University School of Medicine January 3, 2013 Outline Overview and Power/Sample
More informationOptimal group sequential designs for simultaneous testing of superiority and non-inferiority
Optimal group sequential designs for simultaneous testing of superiority and non-inferiority Fredrik Öhrn AstraZeneca R & D Mölndal, SE-431 83 Mölndal, Sweden and Christopher Jennison Department of Mathematical
More informationMultiple Linear Regression
Multiple Linear Regression ST 430/514 Recall: a regression model describes how a dependent variable (or response) Y is affected, on average, by one or more independent variables (or factors, or covariates).
More informationReports of the Institute of Biostatistics
Reports of the Institute of Biostatistics No 02 / 2008 Leibniz University of Hannover Natural Sciences Faculty Title: Properties of confidence intervals for the comparison of small binomial proportions
More informationDiscussion of Identifiability and Estimation of Causal Effects in Randomized. Trials with Noncompliance and Completely Non-ignorable Missing Data
Biometrics 000, 000 000 DOI: 000 000 0000 Discussion of Identifiability and Estimation of Causal Effects in Randomized Trials with Noncompliance and Completely Non-ignorable Missing Data Dylan S. Small
More informationLinear Models and Estimation by Least Squares
Linear Models and Estimation by Least Squares Jin-Lung Lin 1 Introduction Causal relation investigation lies in the heart of economics. Effect (Dependent variable) cause (Independent variable) Example:
More informationChapter 12: Estimation
Chapter 12: Estimation Estimation In general terms, estimation uses a sample statistic as the basis for estimating the value of the corresponding population parameter. Although estimation and hypothesis
More informationUnobservable Parameter. Observed Random Sample. Calculate Posterior. Choosing Prior. Conjugate prior. population proportion, p prior:
Pi Priors Unobservable Parameter population proportion, p prior: π ( p) Conjugate prior π ( p) ~ Beta( a, b) same PDF family exponential family only Posterior π ( p y) ~ Beta( a + y, b + n y) Observed
More informationPubH 7470: STATISTICS FOR TRANSLATIONAL & CLINICAL RESEARCH
PubH 7470: STATISTICS FOR TRANSLATIONAL & CLINICAL RESEARCH The First Step: SAMPLE SIZE DETERMINATION THE ULTIMATE GOAL The most important, ultimate step of any of clinical research is to do draw inferences;
More informationLecture 01: Introduction
Lecture 01: Introduction Dipankar Bandyopadhyay, Ph.D. BMTRY 711: Analysis of Categorical Data Spring 2011 Division of Biostatistics and Epidemiology Medical University of South Carolina Lecture 01: Introduction
More informationA Type of Sample Size Planning for Mean Comparison in Clinical Trials
Journal of Data Science 13(2015), 115-126 A Type of Sample Size Planning for Mean Comparison in Clinical Trials Junfeng Liu 1 and Dipak K. Dey 2 1 GCE Solutions, Inc. 2 Department of Statistics, University
More informationAMS7: WEEK 7. CLASS 1. More on Hypothesis Testing Monday May 11th, 2015
AMS7: WEEK 7. CLASS 1 More on Hypothesis Testing Monday May 11th, 2015 Testing a Claim about a Standard Deviation or a Variance We want to test claims about or 2 Example: Newborn babies from mothers taking
More informationInverse Sampling for McNemar s Test
International Journal of Statistics and Probability; Vol. 6, No. 1; January 27 ISSN 1927-7032 E-ISSN 1927-7040 Published by Canadian Center of Science and Education Inverse Sampling for McNemar s Test
More information(θ θ ), θ θ = 2 L(θ ) θ θ θ θ θ (θ )= H θθ (θ ) 1 d θ (θ )
Setting RHS to be zero, 0= (θ )+ 2 L(θ ) (θ θ ), θ θ = 2 L(θ ) 1 (θ )= H θθ (θ ) 1 d θ (θ ) O =0 θ 1 θ 3 θ 2 θ Figure 1: The Newton-Raphson Algorithm where H is the Hessian matrix, d θ is the derivative
More informationTheory of Maximum Likelihood Estimation. Konstantin Kashin
Gov 2001 Section 5: Theory of Maximum Likelihood Estimation Konstantin Kashin February 28, 2013 Outline Introduction Likelihood Examples of MLE Variance of MLE Asymptotic Properties What is Statistical
More informationAn Adaptive Futility Monitoring Method with Time-Varying Conditional Power Boundary
An Adaptive Futility Monitoring Method with Time-Varying Conditional Power Boundary Ying Zhang and William R. Clarke Department of Biostatistics, University of Iowa 200 Hawkins Dr. C-22 GH, Iowa City,
More informationBiometrika Trust. Biometrika Trust is collaborating with JSTOR to digitize, preserve and extend access to Biometrika.
Biometrika Trust Discrete Sequential Boundaries for Clinical Trials Author(s): K. K. Gordon Lan and David L. DeMets Reviewed work(s): Source: Biometrika, Vol. 70, No. 3 (Dec., 1983), pp. 659-663 Published
More informationStatistical inference
Statistical inference Contents 1. Main definitions 2. Estimation 3. Testing L. Trapani MSc Induction - Statistical inference 1 1 Introduction: definition and preliminary theory In this chapter, we shall
More informationClinical Trials. Olli Saarela. September 18, Dalla Lana School of Public Health University of Toronto.
Introduction to Dalla Lana School of Public Health University of Toronto olli.saarela@utoronto.ca September 18, 2014 38-1 : a review 38-2 Evidence Ideal: to advance the knowledge-base of clinical medicine,
More informationA Brief Introduction to Intersection-Union Tests. Jimmy Akira Doi. North Carolina State University Department of Statistics
Introduction A Brief Introduction to Intersection-Union Tests Often, the quality of a product is determined by several parameters. The product is determined to be acceptable if each of the parameters meets
More informationPOLI 443 Applied Political Research
POLI 443 Applied Political Research Session 4 Tests of Hypotheses The Normal Curve Lecturer: Prof. A. Essuman-Johnson, Dept. of Political Science Contact Information: aessuman-johnson@ug.edu.gh College
More informationA3. Statistical Inference
Appendi / A3. Statistical Inference / Mean, One Sample-1 A3. Statistical Inference Population Mean μ of a Random Variable with known standard deviation σ, and random sample of size n 1 Before selecting
More informationSampling distribution of GLM regression coefficients
Sampling distribution of GLM regression coefficients Patrick Breheny February 5 Patrick Breheny BST 760: Advanced Regression 1/20 Introduction So far, we ve discussed the basic properties of the score,
More informationProbability and Statistics
CHAPTER 5: PARAMETER ESTIMATION 5-0 Probability and Statistics Kristel Van Steen, PhD 2 Montefiore Institute - Systems and Modeling GIGA - Bioinformatics ULg kristel.vansteen@ulg.ac.be CHAPTER 5: PARAMETER
More informationSAS/STAT 15.1 User s Guide The SEQDESIGN Procedure
SAS/STAT 15.1 User s Guide The SEQDESIGN Procedure This document is an individual chapter from SAS/STAT 15.1 User s Guide. The correct bibliographic citation for this manual is as follows: SAS Institute
More informationEcon 583 Homework 7 Suggested Solutions: Wald, LM and LR based on GMM and MLE
Econ 583 Homework 7 Suggested Solutions: Wald, LM and LR based on GMM and MLE Eric Zivot Winter 013 1 Wald, LR and LM statistics based on generalized method of moments estimation Let 1 be an iid sample
More informationAnswer Key for STAT 200B HW No. 7
Answer Key for STAT 200B HW No. 7 May 5, 2007 Problem 2.2 p. 649 Assuming binomial 2-sample model ˆπ =.75, ˆπ 2 =.6. a ˆτ = ˆπ 2 ˆπ =.5. From Ex. 2.5a on page 644: ˆπ ˆπ + ˆπ 2 ˆπ 2.75.25.6.4 = + =.087;
More informationA BAYESIAN MATHEMATICAL STATISTICS PRIMER. José M. Bernardo Universitat de València, Spain
A BAYESIAN MATHEMATICAL STATISTICS PRIMER José M. Bernardo Universitat de València, Spain jose.m.bernardo@uv.es Bayesian Statistics is typically taught, if at all, after a prior exposure to frequentist
More informationIV Estimation and its Limitations: Weak Instruments and Weakly Endogeneous Regressors
IV Estimation and its Limitations: Weak Instruments and Weakly Endogeneous Regressors Laura Mayoral, IAE, Barcelona GSE and University of Gothenburg U. of Gothenburg, May 2015 Roadmap Testing for deviations
More informationHypothesis Test. The opposite of the null hypothesis, called an alternative hypothesis, becomes
Neyman-Pearson paradigm. Suppose that a researcher is interested in whether the new drug works. The process of determining whether the outcome of the experiment points to yes or no is called hypothesis
More informationChoice-Based Revenue Management: An Empirical Study of Estimation and Optimization. Appendix. Brief description of maximum likelihood estimation
Choice-Based Revenue Management: An Empirical Study of Estimation and Optimization Appendix Gustavo Vulcano Garrett van Ryzin Wassim Chaar In this online supplement we provide supplementary materials of
More informationLoglikelihood and Confidence Intervals
Stat 504, Lecture 2 1 Loglikelihood and Confidence Intervals The loglikelihood function is defined to be the natural logarithm of the likelihood function, l(θ ; x) = log L(θ ; x). For a variety of reasons,
More informationStatistics and econometrics
1 / 36 Slides for the course Statistics and econometrics Part 10: Asymptotic hypothesis testing European University Institute Andrea Ichino September 8, 2014 2 / 36 Outline Why do we need large sample
More informationTwo-Phase, Three-Stage Adaptive Designs in Clinical Trials
Japanese Journal of Biometrics Vol. 35, No. 2, 69 93 (2014) Preliminary Report Two-Phase, Three-Stage Adaptive Designs in Clinical Trials Hiroyuki Uesaka 1, Toshihiko Morikawa 2 and Akiko Kada 3 1 The
More informationBasic Concepts of Inference
Basic Concepts of Inference Corresponds to Chapter 6 of Tamhane and Dunlop Slides prepared by Elizabeth Newton (MIT) with some slides by Jacqueline Telford (Johns Hopkins University) and Roy Welsch (MIT).
More informationStatistical Inference
Statistical Inference Classical and Bayesian Methods Class 6 AMS-UCSC Thu 26, 2012 Winter 2012. Session 1 (Class 6) AMS-132/206 Thu 26, 2012 1 / 15 Topics Topics We will talk about... 1 Hypothesis testing
More informationLecture Outline. Biost 518 Applied Biostatistics II. Choice of Model for Analysis. Choice of Model. Choice of Model. Lecture 10: Multiple Regression:
Biost 518 Applied Biostatistics II Scott S. Emerson, M.D., Ph.D. Professor of Biostatistics University of Washington Lecture utline Choice of Model Alternative Models Effect of data driven selection of
More informationCharles Geyer University of Minnesota. joint work with. Glen Meeden University of Minnesota.
Fuzzy Confidence Intervals and P -values Charles Geyer University of Minnesota joint work with Glen Meeden University of Minnesota http://www.stat.umn.edu/geyer/fuzz 1 Ordinary Confidence Intervals OK
More informationBios 6649: Clinical Trials - Statistical Design and Monitoring
Bios 6649: Clinical Trials - Statistical Design and Monitoring Spring Semester 2015 John M. Kittelson Department of Biostatistics & Informatics Colorado School of Public Health University of Colorado Denver
More informationObjectives Simple linear regression. Statistical model for linear regression. Estimating the regression parameters
Objectives 10.1 Simple linear regression Statistical model for linear regression Estimating the regression parameters Confidence interval for regression parameters Significance test for the slope Confidence
More informationDiscrete Multivariate Statistics
Discrete Multivariate Statistics Univariate Discrete Random variables Let X be a discrete random variable which, in this module, will be assumed to take a finite number of t different values which are
More informationEconometrics I KS. Module 2: Multivariate Linear Regression. Alexander Ahammer. This version: April 16, 2018
Econometrics I KS Module 2: Multivariate Linear Regression Alexander Ahammer Department of Economics Johannes Kepler University of Linz This version: April 16, 2018 Alexander Ahammer (JKU) Module 2: Multivariate
More informationInference for Binomial Parameters
Inference for Binomial Parameters Dipankar Bandyopadhyay, Ph.D. Department of Biostatistics, Virginia Commonwealth University D. Bandyopadhyay (VCU) BIOS 625: Categorical Data & GLM 1 / 58 Inference for
More informationAnnouncements. Unit 3: Foundations for inference Lecture 3: Decision errors, significance levels, sample size, and power.
Announcements Announcements Unit 3: Foundations for inference Lecture 3:, significance levels, sample size, and power Statistics 101 Mine Çetinkaya-Rundel October 1, 2013 Project proposal due 5pm on Friday,
More informationTests about a population mean
October 2 nd, 2017 Overview Week 1 Week 2 Week 4 Week 7 Week 10 Week 12 Chapter 1: Descriptive statistics Chapter 6: Statistics and Sampling Distributions Chapter 7: Point Estimation Chapter 8: Confidence
More informationMaximum-Likelihood Estimation: Basic Ideas
Sociology 740 John Fox Lecture Notes Maximum-Likelihood Estimation: Basic Ideas Copyright 2014 by John Fox Maximum-Likelihood Estimation: Basic Ideas 1 I The method of maximum likelihood provides estimators
More informationparameter space Θ, depending only on X, such that Note: it is not θ that is random, but the set C(X).
4. Interval estimation The goal for interval estimation is to specify the accurary of an estimate. A 1 α confidence set for a parameter θ is a set C(X) in the parameter space Θ, depending only on X, such
More information