Philippe Delorme a, Pierre Lafaye de Micheaux a,

Similar documents
Type-II Generalized Family-Wise Error Rate Formulas with Application to Sample Size Determination

Superchain Procedures in Clinical Trials. George Kordzakhia FDA, CDER, Office of Biostatistics Alex Dmitrienko Quintiles Innovation

Type I error rate control in adaptive designs for confirmatory clinical trials with treatment selection at interim

MULTISTAGE AND MIXTURE PARALLEL GATEKEEPING PROCEDURES IN CLINICAL TRIALS

Control of Directional Errors in Fixed Sequence Multiple Testing

Mixtures of multiple testing procedures for gatekeeping applications in clinical trials

Multiple Testing in Group Sequential Clinical Trials

Family-wise Error Rate Control in QTL Mapping and Gene Ontology Graphs

Sample Size and Power I: Binary Outcomes. James Ware, PhD Harvard School of Public Health Boston, MA

Statistica Sinica Preprint No: SS R1

On Generalized Fixed Sequence Procedures for Controlling the FWER

A Mixture Gatekeeping Procedure Based on the Hommel Test for Clinical Trial Applications

The Design of Group Sequential Clinical Trials that Test Multiple Endpoints

Chapter Seven: Multi-Sample Methods 1/52

Familywise Error Rate Controlling Procedures for Discrete Data

Multiple Testing. Anjana Grandhi. BARDS, Merck Research Laboratories. Rahway, NJ Wenge Guo. Department of Mathematical Sciences

y ˆ i = ˆ " T u i ( i th fitted value or i th fit)

Multiple Endpoints: A Review and New. Developments. Ajit C. Tamhane. (Joint work with Brent R. Logan) Department of IE/MS and Statistics

Testing a secondary endpoint after a group sequential test. Chris Jennison. 9th Annual Adaptive Designs in Clinical Trials

A Gatekeeping Test on a Primary and a Secondary Endpoint in a Group Sequential Design with Multiple Interim Looks

Group sequential designs for Clinical Trials with multiple treatment arms

Step-down FDR Procedures for Large Numbers of Hypotheses

Summary and discussion of: Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing

Bonferroni - based gatekeeping procedure with retesting option

Looking at the Other Side of Bonferroni

Multiple Testing. Hoang Tran. Department of Statistics, Florida State University

Technical Manual. 1 Introduction. 1.1 Version. 1.2 Developer

Analysis of Multiple Endpoints in Clinical Trials

Adaptive, graph based multiple testing procedures and a uniform improvement of Bonferroni type tests.

Alpha-recycling for the analyses of primary and secondary endpoints of. clinical trials

Adaptive Dunnett Tests for Treatment Selection

Interim Monitoring of Clinical Trials: Decision Theory, Dynamic Programming. and Optimal Stopping

CHL 5225H Advanced Statistical Methods for Clinical Trials: Multiplicity

Modified Simes Critical Values Under Positive Dependence

Optimising Group Sequential Designs. Decision Theory, Dynamic Programming. and Optimal Stopping

A superiority-equivalence approach to one-sided tests on multiple endpoints in clinical trials

Two Sample Hypothesis Tests

On Procedures Controlling the FDR for Testing Hierarchically Ordered Hypotheses

IEOR165 Discussion Week 12

Comparing Adaptive Designs and the. Classical Group Sequential Approach. to Clinical Trial Design

A Brief Introduction to Intersection-Union Tests. Jimmy Akira Doi. North Carolina State University Department of Statistics

An Alpha-Exhaustive Multiple Testing Procedure

Adaptive clinical trials with subgroup selection

Specific Differences. Lukas Meier, Seminar für Statistik

Multiple Comparison Methods for Means

CBA4 is live in practice mode this week exam mode from Saturday!

Group Sequential Designs: Theory, Computation and Optimisation

Adaptive Designs: Why, How and When?

Reports of the Institute of Biostatistics

INTERVAL ESTIMATION AND HYPOTHESES TESTING

MULTIPLE TESTING TO ESTABLISH SUPERIORITY/EQUIVALENCE OF A NEW TREATMENT COMPARED WITH k STANDARD TREATMENTS

Outline. Topic 19 - Inference. The Cell Means Model. Estimates. Inference for Means Differences in cell means Contrasts. STAT Fall 2013

Applying the Benjamini Hochberg procedure to a set of generalized p-values

The International Journal of Biostatistics

Compatible simultaneous lower confidence bounds for the Holm procedure and other Bonferroni based closed tests

Multiple Pairwise Comparison Procedures in One-Way ANOVA with Fixed Effects Model

Hochberg Multiple Test Procedure Under Negative Dependence

Stepwise Gatekeeping Procedures in Clinical Trial Applications

CHAPTER 8. Test Procedures is a rule, based on sample data, for deciding whether to reject H 0 and contains:

Two-stage Adaptive Randomization for Delayed Response in Clinical Trials

Adaptive Extensions of a Two-Stage Group Sequential Procedure for Testing a Primary and a Secondary Endpoint (II): Sample Size Re-estimation

University of California, Berkeley

PubH 7470: STATISTICS FOR TRANSLATIONAL & CLINICAL RESEARCH

Hunting for significance with multiple testing

(Foundation of Medical Statistics)

12.10 (STUDENT CD-ROM TOPIC) CHI-SQUARE GOODNESS- OF-FIT TESTS

ON STEPWISE CONTROL OF THE GENERALIZED FAMILYWISE ERROR RATE. By Wenge Guo and M. Bhaskara Rao

Group Sequential Trial with a Biomarker Subpopulation

Review. December 4 th, Review

Simultaneous Confidence Intervals and Multiple Contrast Tests

Statistical Tests. Matthieu de Lapparent

Multiple testing: Intro & FWER 1

Alpha-Investing. Sequential Control of Expected False Discoveries

Practice Problems Section Problems

Multilevel Models in Matrix Form. Lecture 7 July 27, 2011 Advanced Multivariate Statistical Methods ICPSR Summer Session #2

Group Sequential Tests for Delayed Responses. Christopher Jennison. Lisa Hampson. Workshop on Special Topics on Sequential Methodology

Bios 6649: Clinical Trials - Statistical Design and Monitoring

arxiv: v1 [math.st] 13 Mar 2008

Multiple Dependent Hypothesis Tests in Geographically Weighted Regression

STAT 4385 Topic 01: Introduction & Review

High-Throughput Sequencing Course. Introduction. Introduction. Multiple Testing. Biostatistics and Bioinformatics. Summer 2018

Lecture 15: Inference Based on Two Samples

[y i α βx i ] 2 (2) Q = i=1

Lecture 9 Two-Sample Test. Fall 2013 Prof. Yao Xie, H. Milton Stewart School of Industrial Systems & Engineering Georgia Tech

Last week: Sample, population and sampling distributions finished with estimation & confidence intervals

Group comparison test for independent samples

Non-specific filtering and control of false positives

A note on tree gatekeeping procedures in clinical trials

are equal to zero, where, q = p 1. For each gene j, the pairwise null and alternative hypotheses are,

Multiple Hypothesis Testing in Microarray Data Analysis

Political Science 236 Hypothesis Testing: Review and Bootstrapping

Asymptotic Statistics-VI. Changliang Zou

Optimal rejection regions for testing multiple binary endpoints in small samples

Analysis of variance, multivariate (MANOVA)

6 Sample Size Calculations

PROCEDURES CONTROLLING THE k-fdr USING. BIVARIATE DISTRIBUTIONS OF THE NULL p-values. Sanat K. Sarkar and Wenge Guo

Sequential tests controlling generalized familywise error rates

QED. Queen s Economics Department Working Paper No Hypothesis Testing for Arbitrary Bounds. Jeffrey Penney Queen s University

BIBLE CODE PREDICTION. and multiple comparisons problem

A NEW APPROACH FOR LARGE SCALE MULTIPLE TESTING WITH APPLICATION TO FDR CONTROL FOR GRAPHICALLY STRUCTURED HYPOTHESES

Transcription:

Package SSDDA : Sample Size Determination and Data Analysis in the context of continuous co-primary endpoints in clinical trials. Philippe Delorme a, Pierre Lafaye de Micheaux a, Benoît Liquet c,d and Jérémie Riou b,c,d a Mathematics and statistics department,university of Montréal, 2920, chemin de la Tour, Montréal, Québec H3T 1J4, CANADA b Danone Research, Clinical Studies Plateform, Centre Daniel Carasso, RD 128 - Avenue de la Vauve, 91767 Palaiseau Cedex, FRANCE c Research Center INSERM U897, ISPED, 146 rue Leo Saignat, 33076 Bordeaux Cedex, FRANCE d University of Bordeaux Segalen, ISPED, 146 rue Léo Saignat, 33076 Bordeaux, Cedex, FRANCE 2èmes Rencontres R, Lyon 27/06/2013 1

Table of contents 1 Background 2 R functions 3 The Indiv.rm.ssc() function 4 Application 5 Conclusion 2èmes Rencontres R, Lyon 27/06/2013 2

Clinical Context The use of multiple endpoints to characterize product safety and efficacy measures is an increasingly common feature in recent clinical trials; Usually, these endpoints are divided into one primary endpoint and several secondary endpoints; Nevertheless, when we observed a multi factorial effect it is necessary to use some multiple primary endpoint or a composite endpoint. 2èmes Rencontres R, Lyon 27/06/2013 3

Multiple Testing Context Underlying problem Multiple Co-primary endpoints implies multiple testing problem. 2èmes Rencontres R, Lyon 27/06/2013 4

Multiple Testing Context Table : Possible scenarios for m Tests Null Hypotheses Not Rejected Rejected Total True U V m 0 False T S m m 0 Total W R m In confirmatory context, during data analysis statistician use FWER control: Type I FWER = P(V 1). Type II FWER = P(T 1). 2èmes Rencontres R, Lyon 27/06/2013 5

Multiple Testing Context Type-I error rate Control: Type I gfwer = P(V q), 1 q m. Romano et al.(2005, 2006) developed some procedures which control the gfwer for single step and stepwise procedures. These procedures generalize the Bonferroni, Holm and Hochberg procedures. 2èmes Rencontres R, Lyon 27/06/2013 6

The choice of the sample size computation procedure depends on primary endpoint definition. Primary endpoint definition At least one win: At least one test significant among the m; At least r win: At least r tests significants among the m,(1 r m); All must win: All the m tests significants. 2èmes Rencontres R, Lyon 27/06/2013 7

Multiple Testing Context Table : Control of error rate for different scenarios Primary Endpoint Type-I Error rate Power At least 1 Classical MCP Disjunctive Power At least r Classical MCP R-Power All No Correction (Offen et al. (2011)) Conjunctive Power Type-II error rate and Power Control: Disjunctive Power = P(S 1), S : (Reject of H k 0 H k 0 is false), r Power = P(S r), 1 r (m m 0 ), Conjunctive Power = P(S = (m m 0 )). 2èmes Rencontres R, Lyon 27/06/2013 8

R functions 1 bonferroni.1m.ssc(); 2 global.1m.ssc() 1 ; 3 global.1m.analysis() 1 ; 4 indiv.1m.ssc() 1 ; 5 indiv.1m.analysis() 1 ; 6 indiv.rm.ssc(). 1 Lafaye de Micheaux, P., Liquet, B., Marque, S., Riou,J. (2013) Power and sample size determination in clinical trials with multiple primary continuous correlated endpoints. Journal of Biopharmaceutical Statistics, accepted for publication the 10/21/2012. 2èmes Rencontres R, Lyon 27/06/2013 9

Reminders m co-primary endpoints; Success of the trial is defined if at least r co-primary endpoints are significant; r-power and gfwer control; Single step and StepWise methods. Step up methods We focus this presentation on Step up methods. Nevertheless, the methodology is available for all Single step and StepWise methods. 2èmes Rencontres R, Lyon 27/06/2013 10

Step up methods Principle 1 Sort the p values : p 1 p 2... p m corresponding respectively to H 1 0, H 2 0,..., H m 0 ; 2 Algorithm: 2èmes Rencontres R, Lyon 27/06/2013 11

Step up r-power Formula [( m r p ) ] 1 βr,m u = πr,m u = P (T k:m < u k ) (T (p+1):m u p+1 ) p=0 k=1 where the u k s are critical values for step-up procedures. This formula depends on order statistics. We need to use the Margolin and Maurer Theorem in order to obtain a power formula which depends on joint distribution of statistics. 2èmes Rencontres R, Lyon 27/06/2013 12

Sample Size Computation Step up methods The developed formula depends only on the joint distribution and the sample size, and if the joint distribution is known the sample size computation is possible. So, we decided to focus our work on continuous endpoints. 2èmes Rencontres R, Lyon 27/06/2013 13

Indiv Group Data 1 0 i 0 n 0 n+1 1 i 1 2n 1 Primary Endpoints 1 k m X 0 11 X 0 1k X 0 1m X 0 i1 X 0 ik X 0 im X 0 n1 X 0 nk X 0 nm X 1 (n+1) 1 X 1 (n+1)k X 1 (n+1) m X 1 i1 X 1 ik X 1 im X 1 (2n)1 X 1 (2n)k X 1 (2n)m 2èmes Rencontres R, Lyon 27/06/2013 14

t-test Assumptions: E[X 0 ik ] = µk 0, E[X 1 ik ] = µk 1, V[X 0 ik ] = V[X 1 ik ] = σ2 k. Hypotheses: H k 0 : δk = µ k 0 µk 1 d k ; versus H k 1 : δk = µ k 0 µk 1 > d k. Student t-statistics: T k = ν = 2n 2; X 0 k X 1 k V( d k t X 0 νdf,1 α, where k X k 1 d k ) T = (T 1,..., T m ) T follows a non-central Type-II multivariate Student distribution with f degrees of freedom; The analytical form of this distribution is unknown, but can be estimated by a non-central Type-I multivariate Student distribution (Hasler & Hothorn (2011)) (pmvt() under R software). 2èmes Rencontres R, Lyon 27/06/2013 15

Context: ANRS 114 Pneumovac Trial Endpoints used in this application for the evaluation of immunogenicity in the Vaccine trials are means of log-transformed antibody concentrations for each serotype; Data come from ANRS 114 Pneumovac Trial, where the multivalent vaccines yields a response on 7 serotypes; We used data from Pedrono et al (2009); Covariance matrices are supposed to be the same between groups; The analysis will be performed using seven individual superiority Student t-statistics; What is the required sample size for confirmatory trial with different decision rules (r)? 2èmes Rencontres R, Lyon 27/06/2013 16

R code library(ssdda) # Parameters definitions delta <- c(0.55,0.34,0.38,0.20,0.70,0.38,0.86) var <- c(0.3520 2, 0.6219 2, 0.5427 2, 0.6075 2, 0.6277 2, 0.5527 2, 0.8066 2 ) cov <- matrix(1,ncol=7,nrow=7) cov[1,2:7] <- cov[2:7,1] <- c(0.1341692,0.1373891,0.07480123,0.1401267,0.1280336,0.1614103) cov[2,3:7] <- cov[3:7,2] <- c(0.2874531,0.18451960,0.3156895,0.2954996,0.3963837) cov[3,4:7] <- cov[4:7,3] <- c(0.19903400,0.2736123,0.2369907,0.3423579) cov[4,5:7] <- cov[5:7,4] <- c(0.1915028,0.1558958,0.2376056) cov[5,6:7] <- cov[6:7,5] <- c(0.2642217,0.3969920) cov[6,7] <- cov[7,6] <- c(0.3352029) diag(cov) <- var 2èmes Rencontres R, Lyon 27/06/2013 17

R code #Sample size Computation n3su <- Indiv.rm.ssc(method="Hoch",r=3,m=7,muC=delta,muT=rep(0,7), sigmac=cov, sigmat=cov,delta=rep(0,7),power=0.8,alpha=0.05,interval=c(10,2000),g=1) n5su <- Indiv.rm.ssc(method="Hoch",r=5,m=7,muC=delta,muT=rep(0,7),sigmaC=cov, sigmat=cov,delta=rep(0,7),power=0.8,alpha=0.05,interval=c(10,2000),g=1) 2èmes Rencontres R, Lyon 27/06/2013 18

Results Table : Sample Size Computation for various definitions of immunogenicity: r = 3 r = 5 Bonferroni 22 51 Holm 21 41 Hochberg 20 40 2èmes Rencontres R, Lyon 27/06/2013 19

Conclusion The SSDDA package provides some sample size computation methods in the context of continuous primary endpoints; Package SSDDA for sample size and power computation is nearly available. 2èmes Rencontres R, Lyon 27/06/2013 20