Impact of covariate misclassification on the power and type I error in clinical trials using covariate-adaptive randomization

Similar documents
Mantel-Haenszel Test Statistics. for Correlated Binary Data. Department of Statistics, North Carolina State University. Raleigh, NC

Lecture Discussion. Confounding, Non-Collapsibility, Precision, and Power Statistics Statistical Methods II. Presented February 27, 2018

Guideline on adjustment for baseline covariates in clinical trials

Unobserved heterogeneity in logistic regression

Sample Size and Power Considerations for Longitudinal Studies

IMPROVING PRECISION BY ADJUSTING FOR BASELINE VARIABLES IN RANDOMIZED TRIALS WITH BINARY OUTCOMES, WITHOUT REGRESSION MODEL ASSUMPTIONS

Propensity Score Methods for Causal Inference

Covariate Adjustment for Logistic Regression Analysis of Binary Clinical Trial Data

An Introduction to Causal Analysis on Observational Data using Propensity Scores

TECHNICAL REPORT # 59 MAY Interim sample size recalculation for linear and logistic regression models: a comprehensive Monte-Carlo study

Section 9c. Propensity scores. Controlling for bias & confounding in observational studies

Research Article Validation Study Methods for Estimating Odds Ratio in 2 2 JTables When Exposure is Misclassified

Estimating direct effects in cohort and case-control studies

Missing covariate data in matched case-control studies: Do the usual paradigms apply?

Journal of Biostatistics and Epidemiology

HOW TO DETERMINE THE NUMBER OF SUBJECTS NEEDED FOR MY STUDY?

University of Michigan School of Public Health

ENHANCED PRECISION IN THE ANALYSIS OF RANDOMIZED TRIALS WITH ORDINAL OUTCOMES

CHL 5225 H Crossover Trials. CHL 5225 H Crossover Trials

Evaluating Hypotheses

Approximate analysis of covariance in trials in rare diseases, in particular rare cancers

Misclassification in Logistic Regression with Discrete Covariates

On the Use of Linear Fixed Effects Regression Models for Causal Inference

Statistical Inference of Covariate-Adjusted Randomized Experiments

STAT 5500/6500 Conditional Logistic Regression for Matched Pairs

[Read Ch. 5] [Recommended exercises: 5.2, 5.3, 5.4]

CS 543 Page 1 John E. Boon, Jr.

EXTENSIONS OF NONPARAMETRIC RANDOMIZATION-BASED ANALYSIS OF COVARIANCE

Estimating the Marginal Odds Ratio in Observational Studies

On the covariate-adjusted estimation for an overall treatment difference with data from a randomized comparative clinical trial

BIOS 6649: Handout Exercise Solution

Robust covariance estimator for small-sample adjustment in the generalized estimating equations: A simulation study

Estimating and contextualizing the attenuation of odds ratios due to non-collapsibility

Estimating the Mean Response of Treatment Duration Regimes in an Observational Study. Anastasios A. Tsiatis.

Weighted differential entropy based approaches to dose-escalation in clinical trials

Standardization methods have been used in epidemiology. Marginal Structural Models as a Tool for Standardization ORIGINAL ARTICLE

Adjusting for possibly misclassified causes of death in cause-specific survival analysis

Mediation Analysis: A Practitioner s Guide

A simulation study comparing properties of heterogeneity measures in meta-analyses

Robustifying Trial-Derived Treatment Rules to a Target Population

Penalized likelihood logistic regression with rare events

arxiv: v1 [stat.me] 15 May 2011

Sample Size Calculations

A Note on Bayesian Inference After Multiple Imputation

BIAS OF MAXIMUM-LIKELIHOOD ESTIMATES IN LOGISTIC AND COX REGRESSION MODELS: A COMPARATIVE SIMULATION STUDY

Simple Sensitivity Analysis for Differential Measurement Error. By Tyler J. VanderWeele and Yige Li Harvard University, Cambridge, MA, U.S.A.

Lecture 15 (Part 2): Logistic Regression & Common Odds Ratio, (With Simulations)

Large sample theory for merged data from multiple sources

Ignoring the matching variables in cohort studies - when is it valid, and why?

Constructing Confidence Intervals of the Summary Statistics in the Least-Squares SROC Model

Sample Size and Power I: Binary Outcomes. James Ware, PhD Harvard School of Public Health Boston, MA

The Problem of Modeling Rare Events in ML-based Logistic Regression s Assessing Potential Remedies via MC Simulations

Advanced Quantitative Research Methodology, Lecture Notes: Research Designs for Causal Inference 1

Statistical Practice

A note on R 2 measures for Poisson and logistic regression models when both models are applicable

Technical Track Session I: Causal Inference

Classification: Linear Discriminant Analysis

Marginal versus conditional effects: does it make a difference? Mireille Schnitzer, PhD Université de Montréal

QUASI-SCORE TESTS WITH SURVEY DATA

CS6375: Machine Learning Gautam Kunapuli. Decision Trees

Confounding, mediation and colliding

IMPROVING POWER IN GROUP SEQUENTIAL, RANDOMIZED TRIALS BY ADJUSTING FOR PROGNOSTIC BASELINE VARIABLES AND SHORT-TERM OUTCOMES

Improving Efficiency of Inferences in Randomized Clinical Trials Using Auxiliary Covariates

Variable selection and machine learning methods in causal inference

The Lady Tasting Tea. How to deal with multiple testing. Need to explore many models. More Predictive Modeling

Incorporating published univariable associations in diagnostic and prognostic modeling

Adaptive Enrichment Designs for Randomized Trials with Delayed Endpoints, using Locally Efficient Estimators to Improve Precision

APPENDIX B Sample-Size Calculation Methods: Classical Design

Data, Design, and Background Knowledge in Etiologic Inference

Strati cation in Multivariate Modeling

Asymptotic equivalence of paired Hotelling test and conditional logistic regression

A weighted differential entropy based approach for dose-escalation trials

Previous lecture. P-value based combination. Fixed vs random effects models. Meta vs. pooled- analysis. New random effects testing.

Journal of Statistical Software

ECON Introductory Econometrics. Lecture 17: Experiments

Statistics and Probability Letters. Using randomization tests to preserve type I error with response adaptive and covariate adaptive randomization

Adaptive Dunnett Tests for Treatment Selection

Statistical Methods for Alzheimer s Disease Studies

MODULE -4 BAYEIAN LEARNING

Relating Latent Class Analysis Results to Variables not Included in the Analysis

Controlling for latent confounding by confirmatory factor analysis (CFA) Blinded Blinded

Adaptive designs beyond p-value combination methods. Ekkehard Glimm, Novartis Pharma EAST user group meeting Basel, 31 May 2013

Propensity score to detect baseline imbalance in cluster randomized trials: the role of the c-statistic

RANDOMIZATIONN METHODS THAT

The impact of covariance misspecification in multivariate Gaussian mixtures on estimation and inference

The exam is closed book, closed notes except your one-page (two sides) or two-page (one side) crib sheet.

Sampling. General introduction to sampling methods in epidemiology and some applications to food microbiology study October Hanoi

Lecture 9: Learning Optimal Dynamic Treatment Regimes. Donglin Zeng, Department of Biostatistics, University of North Carolina

Advanced Statistical Methods for Observational Studies L E C T U R E 0 1

Causal modelling in Medical Research

Machine Learning Linear Classification. Prof. Matteo Matteucci

Study Design: Sample Size Calculation & Power Analysis

Longitudinal Modeling with Logistic Regression

A measure of partial association for generalized estimating equations

Comparing Group Means When Nonresponse Rates Differ

Bias Correction in Classification Tree Construction ICML 2001

Prediction of ordinal outcomes when the association between predictors and outcome diers between outcome levels

SREE WORKSHOP ON PRINCIPAL STRATIFICATION MARCH Avi Feller & Lindsay C. Page

A comparison of weighted estimators for the population mean. Ye Yang Weighting in surveys group

Small-sample cluster-robust variance estimators for two-stage least squares models

Transcription:

Impact of covariate misclassification on the power and type I error in clinical trials using covariate-adaptive randomization L I Q I O N G F A N S H A R O N D. Y E A T T S W E N L E Z H A O M E D I C A L U N I V E R S I T Y O F S O U T H C A R O L I N A D E P A R T M E N T O F P U B L I C H E A L T H S C I E N C E D A T A C O O R D I N A T I O N U N I T L. Fan, SD. Yeatts, W. Zhao; MUSC 1 / 16

Background Properties of covariate-adaptive randomization Well balance important prognostic covariate More generalizable and convincing result Increase power for subgroup analysis Require correct specification of analysis model for hypothesis testing Shao J, Yu X. Validity of tests under covariate-adaptive biased coin randomization and generalized linear models. Biometrics. 2013;69:960-9. L. Fan, SD. Yeatts, W. Zhao; MUSC 2 / 16

Background Covariate adjustment during analysis Type of analysis: model based Type of outcome: Dichotomized Covariate adjustment in logistic regression Precision Efficiency Robinson LD, Jewell NP. Some Surprising Results About Covariate Adjustment In Logistic Regression Models. International Statistical Review. 1991;58:227-40. L. Fan, SD. Yeatts, W. Zhao; MUSC 3 / 16

Background Motivation Interventional Management of Stroke III (IMS III) Stratified biased-coin randomization: Stroke severity Misclassification Rate: 2%, non-differential Primary analysis: True severity VS. Randomized severity High-Dose Deferoxamine in Intracerebral Hemorrhage (Hi-DEF) Stratified biased-coin randomization: time from symptom onset to treatment Misclassification Rate: 27.3% and 6.3%, differential Primary analysis: Anticipated time window VS. Actual time window L. Fan, SD. Yeatts, W. Zhao; MUSC 4 / 16

Issues? Impact of adjusting with misclassified covariates under covariate adaptive randomization. IMS III Hi-DEF NIHSS STRATUM (ACTUAL) TIME WINDOW (ACTUAL) NIHSS STRATUM (RANDOMIZED) NIHSS 19 OR LOWER N % Randomized NIHSS 20 OR HIGHER N % Randomized TIME WINDOW (RANDOMIZED) Actual <= 12 hours N % Anticipated Actual > 12 hours N % Anticipated NIHSS 19 OR LOWER 448 98.03% 9 1.97% Anticipated <= 12 hour 8 72.7% 3 27.3% NIHSS 20 OR HIGHER 4 2.01% 195 97.99% Anticipated > 12 hours 1 6.3% 15 93.8% L. Fan, SD. Yeatts, W. Zhao; MUSC 5 / 16

Simulation Method Regression based analysis: Logistic regression 1 prognostic covariate: subject to misclassification 1 perfect measured variable: treatment assignment No interaction Dichotomized outcome Randomization schemes Simple randomization Covariate adaptive randomization: Stratified Block Randomization Stratified Biased-coin Randomization L. Fan, SD. Yeatts, W. Zhao; MUSC 6 / 16

Method Simulation Scenarios Fixed control group rate (40%) and treatment group rate (50%) Varied covariate effect: -3 to +3 (OR: 0.064-23.2) Varied misclassification rate: 0% to 40% Type of misclassification: non-differential L. Fan, SD. Yeatts, W. Zhao; MUSC 7 / 16

Method Simulation Models compared Unadjusted model Model adjusted with misclassified covariate Model adjusted with corrected covariate Operating characteristics evaluated Bias Power Type I error rate L. Fan, SD. Yeatts, W. Zhao; MUSC 8 / 16

Result-Bias True model Naive model Unadjusted model Simple Randomization Covariate adaptive Randomization L. Fan, SD. Yeatts, W. Zhao; MUSC 9 / 16

Result-Power True model Naive model Unadjusted model Simple Randomization Covariate adaptive Randomization L. Fan, SD. Yeatts, W. Zhao; MUSC 10 / 16

Result-Type I error Rate True model Naive model Unadjusted model Simple Randomization Covariate adaptive Randomization L. Fan, SD. Yeatts, W. Zhao; MUSC 11 / 16

Conclusion Impact on the estimate of treatment effect Direction: Bias towards Null Same direction of bias caused by unadjusting covariate Adjusted estimate VS. unadjusted estimate Magnitude Misclassification rate: about 30% misclassification is almost the same as not adjusting the covariate. The covariate effect on the outcome given the treatment effect Greenland S. The effect of misclassification in the presence of covariates. American journal of epidemiology. 1980;112:564-9. John MNN, P. Jewell. A geometric approach to assess bias due to omitted covariates in generalized linear models. Biometrika. 1993;80:807-15. L. Fan, SD. Yeatts, W. Zhao; MUSC 12 / 16

Conclusion Impact on power for detecting treatment effect Randomization schemes do not have effect on power Adjusting with corrected covariate minimize the power loss due to study design The amount of power loss Misclassification rate Covariate effect on the outcome given the treatment L. Fan, SD. Yeatts, W. Zhao; MUSC 13 / 16

Conclusion Impact on type I error rate Simple randomization: maintained Covariate-adaptive randomization Adjusting with corrected covariate: maintained Adjusting with misclassified covariate: maintained Without adjusting covariate: conservative L. Fan, SD. Yeatts, W. Zhao; MUSC 14 / 16

Discussion Under covariate adaptive randomization, adjusting randomized covariate is always recommended for final analysis Randomization scheme does not have an add-on effect on bias and power loss caused by covariate misclassification Attention should be drawn to correct the bias in estimating the effect of treatment and sample size reassessment with the presence of covariate misclassification L. Fan, SD. Yeatts, W. Zhao; MUSC 15 / 16

Questions? L. Fan, SD. Yeatts, W. Zhao; MUSC 16 / 16