Statistical inference for MEG
|
|
- Daniella Miles
- 5 years ago
- Views:
Transcription
1 Statistical inference for MEG Vladimir Litvak Wellcome Trust Centre for Neuroimaging University College London, UK MEG-UK 2014 educational day
2 Talk aims Show main ideas of common methods Explain some of the terminology Give some useful tips Warn of pitfalls and common errors
3 What is special about MEG? Multi-dimensionality Presence of structure in the data and availability of prior knowledge about this structure. Also in EEG Large volumes of data Vast selection and diversity of potentially interesting data features.
4 The basics
5 What do we want to know? Is there an effect of experimental factor expressed the data? Where in the data space is the effect expressed? How large is the effect?
6 Four approaches to statistical testing Parametric: SPM Non-parametric (permutations): FieldTrip, SnPM Bootstrap: EEGLAB, LimoEEG. Bayesian: SPM
7 Data example Random presentation of faces and scrambled faces Question: Is there a difference between the ERF of faces and scrambled faces?
8 Evoked field example Focus on N170 field strength # trial field strength field strength t n n 2 *statistic any function of the sample
9 Inference the undergraduate perspective Idea: u Find out the distribution of the chosen statistic under the assumption of no effect (null hypothesis H0). See how probable it would be to get a statistic value more extreme than the actual value under this distribution (p-value). Reject H0 if p-value is below a pre-defined threshold α. α is also the false positive rate. Parametric (Neumann-Pearson) approach Only uses statistics whose distribution under H0 can be computed analytically, most commonly t, F, 2 p (t u H 0 )
10 An alternative approach H0 implies that the samples from the two conditions come from the same distribution. Thus, if trial labels were randomly reassigned (reshuffled), we could re-compute the statistic and thereby draw a sample from its distribution under H0. original face face face scrambled scrambled shuffling #1 face scrambled face scrambled face shuffling #2 shuffling #3 scrambled face face face scrambled face scrambled face scrambled face For the example above there are 5!/(3!*2!)=10 distinct label assignments
11 Original example # trial field strength Focus on N170 field strength field strength t n n 2 1 = -10.1
12 Shuffling #1 # trial field strength Focus on N170 field strength field strength t n n 2 1 = 2.5
13 Shuffling # 2 # trial field strength Focus on N170 field strength field strength t n n 2 1 = -1.2
14 Shuffling # 3 # trial field strength Focus on N170 field strength field strength t n n 2 1 = 0.14
15 # shufflings = permutation distribution p < 1/250 = * Note, that you need at least N shufflings to show that p<1/n
16 Permutation test vs. parametric test Unlike parametric test, permutation test does not assume that the samples come from normal distribution, just that they come from the same distribution (under H0) and are independent. Permutation distribution can be computed for ANY statistic, not just t. Parametric framework allows for more complex experimental designs (see below). Permutation test is more computationally demanding. Parametric test is more sensitive if its assumptions (normality) hold. Parametric framework can provide confidence intervals on effect sizes while the permutation framework cannot.
17 Multiple comparisons problem and solutions
18 Multiple testing in MEG field strength 3D N 300, 000 1D N = Fs*time D N = # channels 300
19 Multiple testing: time-frequency 2D N = Fs*time* # frequencies = 5,000 4D N 1,000,000
20 Multiple comparisons problem (MCP) u u u u u u If we have 100,000 tests, α=0.05 t t t t t 5,000 false positives t Use of uncorrected p-value, α = % 11.3% 12.5% 10.8% 11.5% 10.0% 10.7% 11.2% Percentage of Null Pixels that are False Positives 10.2% 9.5%
21 Neural Correlates of Interspecies Perspective Taking in the PostMortem Atlantic Salmon: An Argument For Proper Multiple Comparisons Correction Bennett et al. (2010) Journal of Serendipitous and Unexpected Results Final sentence of paper: While we must guard against the elimination of legitimate results through Type II error, the alternative of continuing forward with uncorrected statistics cannot be an option.
22 Family-Wise Null Hypothesis Family-Wise Null Hypothesis: There is no effect everywhere If we reject the null hypothesis for any test, we reject the family-wise Null hypothesis A false positive anywhere in the image gives a Family Wise Error (FWE) Family-Wise Error rate (FWER) = corrected p-value Use of uncorrected p-value, α =0.1 Use of corrected p-value, α =0.1 FWE
23 MCP with no topological structure Bonferroni correction To ensure a particular FWER for N tests choose: FWE N This correction does not require the tests to be independent but becomes very stringent if there is dependence. False Discovery Rate (FDR) Instead of FWE, control the expected percentage of false detections out of all detections. At least one test should be significant at Bonferroni-corrected level. The more effects are detected, the more noise there can be. One should be careful about over-interpreting any specific activation. Control of False Discovery Rate at 10% 6.7% 10.4% 14.9% 9.3% 16.2% 13.8% 14.0% 10.5% 12.2% Percentage of Activated Pixels that are False Positives 8.7%
24 Random field theory - topological inference 2D Gaussian Random Field p(fwe) ( ) 1/2 (u 2-1) exp(-u 2/2) / (2 )2 ( 1/2 u Search region R3 volume roughness threshold Expected number of peaks = normalised volume * peak density Threshold increases (for high enough u) p decreases (less probable to cross) Search volume increases p increases (more tests) Roughness decreases (smoothness increases) p decreases (fewer independent tests) Derived analytically for each statistic type t, F, 2
25 Peak, cluster and set level inference Sensitivity Regional specificity Peak level test: height of local maxima Cluster level test: spatial extent above u Set level test: number of clusters above u : significant at the set level : significant at the cluster level : significant at the peak level L1 > spatial extent threshold L2 < spatial extent threshold If you found a significant cluster between 50 and 200 ms, could you conclude that the brain can detect faces already at 50 ms after the stimulus?
26 Other approaches to MCP In permutation approach design a statistic that pertains to the whole set of tests: maximal t in volume, maximal cluster size, maximal sum of t in a cluster etc. and determine its permutation distribution. There is no need to treat scalp maps as continuous images. Clusters can be defined based on hand-crafted neighbourhood relations between sensors (FieldTrip). Details are flexible and the test will be valid as long as it is designed a-priori and original and shuffled data are treated in the same way.
27 The General Linear Model
28 Complication 2: accounting for additional factors # trial field strength Focus on N170 field strength field strength t n 1n 2 1
29 Data modeling Data Faces = b1 Y = b1 X1 Scrambled + b2 + b2 + X2 +
30 Design matrix b1 = Y = b2 X b + +
31 General Linear Model p N: # trials p: # regressors p Y N = X N GLM defined by + Y X N design matrix X error distribution ~ N (0, I ) 2
32 Contrast : specifies linear combination of parameter vector: ct = ct ERP: faces < scrambled? = t-statistic map ˆ1 ˆ2? 1 ˆ1 1 ˆ2 0? T Test H0: c 0? contrast of estimated parameters t= variance estimate t ct ˆ 2 T T s c (X X) c
33 More complicated design (ANCOVA) Each trial-type (6) Each trial This is the general linear model (GLM) Confounds (4)
34 Tips and warnings After you've not fooled yourself, it's easy not to fool other scientists. Richard P. Feynman
35 Increasing sensitivity by limiting the search volume Frequency (Hz) Limit the test to where an effect is expected a-priori time (s) average time (s) Frequency (Hz) Frequency (Hz) Reduce dimensionality by averaging where possible time (s)
36 Double dipping Difference between conditions orthogonal contrast ft time (s) Test point based on the same data difference mean Test point based on independent data Kilner, Clin Neurophysiol., 2013
37 How impressive are impressive fits? Regressor in the form of M Don t be too impressed by model fit to the data if the fit is shown for one of multiple data ponts selected on the basis of its goodness-of-fit. 100 x 100 random vectors F Fit for the pixel with maximal F
38 The pitfalls of non-statistical inference Frequency (Hz) Original grand mean response to button press Random patterns in the data can easily appear physiologically meaningful due to covariance structure. Meaningful appearance can supplement but not replace properly assessed statistical significance. time (s) Frequency (Hz) Contrast images for regression coefficient across subjects with 16 different random regressors time (s) Example design matrix
39 Take home messages Parametric and permutation approaches are both valid statistical methods applicable to MEG. Parametric approach allows for more complex experimental designs (GLM) with limited choice of statistics while permutation approach allows to use any statistic but only with simple designs (t-test, regression). Unless you are interested in the thoughts of dead fish, control for multiple comparisons. Don t fool yourself.
40 Thanks to Tom Nichols Guillaume Flandin Gareth Barnes Stefan Kiebel Thank you for your attention
41 References Kilner J., and Friston KJ. Topological inference for EEG and MEG data. Annals of Applied Statistics, 4(3): , Maris E., Oostenveld R. Nonparametric statistical testing of EEG- and MEG-data. J Neurosci Methods. 164(1):177-90, Maris E. Statistical testing in electrophysiological studies. Psychophysiology. 2012, 49(4): Friston K. Ten ironic rules for non-statistical reviewers. NeuroImage. 2012, 61(4): Gross et al. Good practice for conducting and reporting MEG research. Neuroimage. 2013, 65:
42 RFT and alternative approaches Parametric (RFT) Permutation Bootstrap Implemented in SPM Fieldtrip SnPM EEGLAB LIMO EEG Mathematically sound yes yes no (a heuristic) Fast computation yes no no Can be applied to complex experimental designs yes no yes Can be applied to arbitrary statistics no yes yes
The General Linear Model. Guillaume Flandin Wellcome Trust Centre for Neuroimaging University College London
The General Linear Model Guillaume Flandin Wellcome Trust Centre for Neuroimaging University College London SPM Course Lausanne, April 2012 Image time-series Spatial filter Design matrix Statistical Parametric
More informationStatistical Inference
Statistical Inference Jean Daunizeau Wellcome rust Centre for Neuroimaging University College London SPM Course Edinburgh, April 2010 Image time-series Spatial filter Design matrix Statistical Parametric
More informationStatistical Inference
Statistical Inference J. Daunizeau Institute of Empirical Research in Economics, Zurich, Switzerland Brain and Spine Institute, Paris, France SPM Course Edinburgh, April 2011 Image time-series Spatial
More informationM/EEG source analysis
Jérémie Mattout Lyon Neuroscience Research Center Will it ever happen that mathematicians will know enough about the physiology of the brain, and neurophysiologists enough of mathematical discovery, for
More informationGroup analysis. Jean Daunizeau Wellcome Trust Centre for Neuroimaging University College London. SPM Course Edinburgh, April 2010
Group analysis Jean Daunizeau Wellcome Trust Centre for Neuroimaging University College London SPM Course Edinburgh, April 2010 Image time-series Spatial filter Design matrix Statistical Parametric Map
More informationThe General Linear Model (GLM)
he General Linear Model (GLM) Klaas Enno Stephan ranslational Neuromodeling Unit (NU) Institute for Biomedical Engineering University of Zurich & EH Zurich Wellcome rust Centre for Neuroimaging Institute
More informationNeuroimaging for Machine Learners Validation and inference
GIGA in silico medicine, ULg, Belgium http://www.giga.ulg.ac.be Neuroimaging for Machine Learners Validation and inference Christophe Phillips, Ir. PhD. PRoNTo course June 2017 Univariate analysis: Introduction:
More informationSignal Processing for Functional Brain Imaging: General Linear Model (2)
Signal Processing for Functional Brain Imaging: General Linear Model (2) Maria Giulia Preti, Dimitri Van De Ville Medical Image Processing Lab, EPFL/UniGE http://miplab.epfl.ch/teaching/micro-513/ March
More informationThe General Linear Model (GLM)
The General Linear Model (GLM) Dr. Frederike Petzschner Translational Neuromodeling Unit (TNU) Institute for Biomedical Engineering, University of Zurich & ETH Zurich With many thanks for slides & images
More informationGroup Analysis. Lexicon. Hierarchical models Mixed effect models Random effect (RFX) models Components of variance
Group Analysis J. Daunizeau Institute of Empirical Research in Economics, Zurich, Switzerland Brain and Spine Institute, Paris, France SPM Course Edinburgh, April 2011 Image time-series Spatial filter
More informationEdinburgh Research Explorer
Edinburgh Research Explorer LIMO EEG Citation for published version: Pernet, CR, Chauveau, N, Gaspar, C & Rousselet, GA 211, 'LIMO EEG: a toolbox for hierarchical LInear MOdeling of ElectroEncephaloGraphic
More informationExperimental design of fmri studies & Resting-State fmri
Methods & Models for fmri Analysis 2016 Experimental design of fmri studies & Resting-State fmri Sandra Iglesias With many thanks for slides & images to: Klaas Enno Stephan, FIL Methods group, Christian
More informationExperimental design of fmri studies
Experimental design of fmri studies Sandra Iglesias With many thanks for slides & images to: Klaas Enno Stephan, FIL Methods group, Christian Ruff SPM Course 2015 Overview of SPM Image time-series Kernel
More informationBayesian inference J. Daunizeau
Bayesian inference J. Daunizeau Brain and Spine Institute, Paris, France Wellcome Trust Centre for Neuroimaging, London, UK Overview of the talk 1 Probabilistic modelling and representation of uncertainty
More informationExperimental design of fmri studies
Experimental design of fmri studies Zurich SPM Course 2016 Sandra Iglesias Translational Neuromodeling Unit (TNU) Institute for Biomedical Engineering (IBT) University and ETH Zürich With many thanks for
More informationBayesian inference J. Daunizeau
Bayesian inference J. Daunizeau Brain and Spine Institute, Paris, France Wellcome Trust Centre for Neuroimaging, London, UK Overview of the talk 1 Probabilistic modelling and representation of uncertainty
More informationPeak Detection for Images
Peak Detection for Images Armin Schwartzman Division of Biostatistics, UC San Diego June 016 Overview How can we improve detection power? Use a less conservative error criterion Take advantage of prior
More informationExperimental design of fmri studies
Methods & Models for fmri Analysis 2017 Experimental design of fmri studies Sara Tomiello With many thanks for slides & images to: Sandra Iglesias, Klaas Enno Stephan, FIL Methods group, Christian Ruff
More informationExperimental design of fmri studies
Experimental design of fmri studies Sandra Iglesias Translational Neuromodeling Unit University of Zurich & ETH Zurich With many thanks for slides & images to: Klaas Enno Stephan, FIL Methods group, Christian
More informationSearching for Nested Oscillations in Frequency and Sensor Space. Will Penny. Wellcome Trust Centre for Neuroimaging. University College London.
in Frequency and Sensor Space Oscillation Wellcome Trust Centre for Neuroimaging. University College London. Non- Workshop on Non-Invasive Imaging of Nonlinear Interactions. 20th Annual Computational Neuroscience
More informationOverview of SPM. Overview. Making the group inferences we want. Non-sphericity Beyond Ordinary Least Squares. Model estimation A word on power
Group Inference, Non-sphericity & Covariance Components in SPM Alexa Morcom Edinburgh SPM course, April 011 Centre for Cognitive & Neural Systems/ Department of Psychology University of Edinburgh Overview
More informationA. Motivation To motivate the analysis of variance framework, we consider the following example.
9.07 ntroduction to Statistics for Brain and Cognitive Sciences Emery N. Brown Lecture 14: Analysis of Variance. Objectives Understand analysis of variance as a special case of the linear model. Understand
More informationJean-Baptiste Poline
Edinburgh course Avril 2010 Linear Models Contrasts Variance components Jean-Baptiste Poline Neurospin, I2BM, CEA Saclay, France Credits: Will Penny, G. Flandin, SPM course authors Outline Part I: Linear
More informationBayesian Analysis. Bayesian Analysis: Bayesian methods concern one s belief about θ. [Current Belief (Posterior)] (Prior Belief) x (Data) Outline
Bayesian Analysis DuBois Bowman, Ph.D. Gordana Derado, M. S. Shuo Chen, M. S. Department of Biostatistics and Bioinformatics Center for Biomedical Imaging Statistics Emory University Outline I. Introduction
More informationContents. Introduction The General Linear Model. General Linear Linear Model Model. The General Linear Model, Part I. «Take home» message
DISCOS SPM course, CRC, Liège, 2009 Contents The General Linear Model, Part I Introduction The General Linear Model Data & model Design matrix Parameter estimates & interpretation Simple contrast «Take
More informationMultiple testing: Intro & FWER 1
Multiple testing: Intro & FWER 1 Mark van de Wiel mark.vdwiel@vumc.nl Dep of Epidemiology & Biostatistics,VUmc, Amsterdam Dep of Mathematics, VU 1 Some slides courtesy of Jelle Goeman 1 Practical notes
More informationLecture 21: October 19
36-705: Intermediate Statistics Fall 2017 Lecturer: Siva Balakrishnan Lecture 21: October 19 21.1 Likelihood Ratio Test (LRT) To test composite versus composite hypotheses the general method is to use
More informationThis Appendix proposes a set of terms and definitions for use in analyses of 1D biomechanical
Appendix A Nomenclature This Appendix proposes a set of terms and definitions for use in analyses of D biomechanical continua (Table A.) and relates these terms to analogous, established terms from the
More informationExtracting fmri features
Extracting fmri features PRoNTo course May 2018 Christophe Phillips, GIGA Institute, ULiège, Belgium c.phillips@uliege.be - http://www.giga.ulg.ac.be Overview Introduction Brain decoding problem Subject
More informationDynamic Causal Modelling for EEG and MEG. Stefan Kiebel
Dynamic Causal Modelling for EEG and MEG Stefan Kiebel Overview 1 M/EEG analysis 2 Dynamic Causal Modelling Motivation 3 Dynamic Causal Modelling Generative model 4 Bayesian inference 5 Applications Overview
More informationMachine Learning Linear Classification. Prof. Matteo Matteucci
Machine Learning Linear Classification Prof. Matteo Matteucci Recall from the first lecture 2 X R p Regression Y R Continuous Output X R p Y {Ω 0, Ω 1,, Ω K } Classification Discrete Output X R p Y (X)
More informationContents. Data. Introduction & recap Variance components Hierarchical model RFX and summary statistics Variance/covariance matrix «Take home» message
SPM course, CRC, Liege,, Septembre 2009 Contents Group analysis (RF) Variance components Hierarchical model RF and summary statistics Variance/covariance matrix «Tae home» message C. Phillips, Centre de
More informationStatistical Analysis of fmrl Data
Statistical Analysis of fmrl Data F. Gregory Ashby The MIT Press Cambridge, Massachusetts London, England Preface xi Acronyms xv 1 Introduction 1 What Is fmri? 2 The Scanning Session 4 Experimental Design
More informationOptimization of Designs for fmri
Optimization of Designs for fmri UCLA Advanced Neuroimaging Summer School August 2, 2007 Thomas Liu, Ph.D. UCSD Center for Functional MRI Why optimize? Scans are expensive. Subjects can be difficult to
More informationNew Procedures for False Discovery Control
New Procedures for False Discovery Control Christopher R. Genovese Department of Statistics Carnegie Mellon University http://www.stat.cmu.edu/ ~ genovese/ Elisha Merriam Department of Neuroscience University
More informationPart 2: Multivariate fmri analysis using a sparsifying spatio-temporal prior
Chalmers Machine Learning Summer School Approximate message passing and biomedicine Part 2: Multivariate fmri analysis using a sparsifying spatio-temporal prior Tom Heskes joint work with Marcel van Gerven
More informationLooking at the Other Side of Bonferroni
Department of Biostatistics University of Washington 24 May 2012 Multiple Testing: Control the Type I Error Rate When analyzing genetic data, one will commonly perform over 1 million (and growing) hypothesis
More informationWellcome Trust Centre for Neuroimaging, UCL, UK.
Bayesian Inference Will Penny Wellcome Trust Centre for Neuroimaging, UCL, UK. SPM Course, Virginia Tech, January 2012 What is Bayesian Inference? (From Daniel Wolpert) Bayesian segmentation and normalisation
More informationDynamic Causal Modelling for EEG and MEG
Dynamic Causal Modelling for EEG and MEG Stefan Kiebel Ma Planck Institute for Human Cognitive and Brain Sciences Leipzig, Germany Overview 1 M/EEG analysis 2 Dynamic Causal Modelling Motivation 3 Dynamic
More informationRecipes for the Linear Analysis of EEG and applications
Recipes for the Linear Analysis of EEG and applications Paul Sajda Department of Biomedical Engineering Columbia University Can we read the brain non-invasively and in real-time? decoder 1001110 if YES
More informationBio 183 Statistics in Research. B. Cleaning up your data: getting rid of problems
Bio 183 Statistics in Research A. Research designs B. Cleaning up your data: getting rid of problems C. Basic descriptive statistics D. What test should you use? What is science?: Science is a way of knowing.(anon.?)
More informationClass 4: Classification. Quaid Morris February 11 th, 2011 ML4Bio
Class 4: Classification Quaid Morris February 11 th, 211 ML4Bio Overview Basic concepts in classification: overfitting, cross-validation, evaluation. Linear Discriminant Analysis and Quadratic Discriminant
More informationAn introduction to Bayesian inference and model comparison J. Daunizeau
An introduction to Bayesian inference and model comparison J. Daunizeau ICM, Paris, France TNU, Zurich, Switzerland Overview of the talk An introduction to probabilistic modelling Bayesian model comparison
More informationStandard P300 scalp. Fz, Cz, Pz Posterior Electrodes: PO 7, PO 8, O Z
Brain Computer Interface Step Wise Linear Discriminant Analysis and Linear Regression Instructor: Dr. Ravi Sankar Student: Kun Li & David Seebran Brain-Computer Interface Utilize the electrical l activity
More informationProbabilistic Machine Learning. Industrial AI Lab.
Probabilistic Machine Learning Industrial AI Lab. Probabilistic Linear Regression Outline Probabilistic Classification Probabilistic Clustering Probabilistic Dimension Reduction 2 Probabilistic Linear
More informationMIXED EFFECTS MODELS FOR TIME SERIES
Outline MIXED EFFECTS MODELS FOR TIME SERIES Cristina Gorrostieta Hakmook Kang Hernando Ombao Brown University Biostatistics Section February 16, 2011 Outline OUTLINE OF TALK 1 SCIENTIFIC MOTIVATION 2
More informationReproducibility and Power
Reproducibility and Power Thomas Nichols Department of Sta;s;cs & WMG University of Warwick Reproducible Neuroimaging Educa;onal Course OHBM 2015 slides & posters @ http://warwick.ac.uk/tenichols/ohbm
More informationIntroduction to EEG/MEG and the FieldTrip toolbox. Robert Oostenveld
Introduction to EEG/MEG and the FieldTrip toolbox Robert Oostenveld Donders Institute for Brain, Cognition and Behaviour Radboud University Nijmegen, The Netherlands What is FieldTrip a MATLAB toolbox
More informationDynamic Causal Modelling for fmri
Dynamic Causal Modelling for fmri André Marreiros Friday 22 nd Oct. 2 SPM fmri course Wellcome Trust Centre for Neuroimaging London Overview Brain connectivity: types & definitions Anatomical connectivity
More informationMixed effects and Group Modeling for fmri data
Mixed effects and Group Modeling for fmri data Thomas Nichols, Ph.D. Department of Statistics Warwick Manufacturing Group University of Warwick Warwick fmri Reading Group May 19, 2010 1 Outline Mixed effects
More informationContents. design. Experimental design Introduction & recap Experimental design «Take home» message. N εˆ. DISCOS SPM course, CRC, Liège, 2009
DISCOS SPM course, CRC, Liège, 2009 Contents Experimental design Introduction & recap Experimental design «Take home» message C. Phillips, Centre de Recherches du Cyclotron, ULg, Belgium Based on slides
More informationModelling temporal structure (in noise and signal)
Modelling temporal structure (in noise and signal) Mark Woolrich, Christian Beckmann*, Salima Makni & Steve Smith FMRIB, Oxford *Imperial/FMRIB temporal noise: modelling temporal autocorrelation temporal
More informationEffective Connectivity & Dynamic Causal Modelling
Effective Connectivity & Dynamic Causal Modelling Hanneke den Ouden Donders Centre for Cognitive Neuroimaging Radboud University Nijmegen Advanced SPM course Zurich, Februari 13-14, 2014 Functional Specialisation
More informationEmpirical Bayes for DCM: A Group Inversion Scheme
METHODS published: 27 November 2015 doi: 10.3389/fnsys.2015.00164 : A Group Inversion Scheme Karl Friston*, Peter Zeidman and Vladimir Litvak The Wellcome Trust Centre for Neuroimaging, University College
More informationBumpbars: Inference for region detection. Yuval Benjamini, Hebrew University
Bumpbars: Inference for region detection Yuval Benjamini, Hebrew University yuvalbenj@gmail.com WHOA-PSI-2017 Collaborators Jonathan Taylor Stanford Rafael Irizarry Dana Farber, Harvard Amit Meir U of
More informationStatistical testing. Samantha Kleinberg. October 20, 2009
October 20, 2009 Intro to significance testing Significance testing and bioinformatics Gene expression: Frequently have microarray data for some group of subjects with/without the disease. Want to find
More informationDoing Cosmology with Balls and Envelopes
Doing Cosmology with Balls and Envelopes Christopher R. Genovese Department of Statistics Carnegie Mellon University http://www.stat.cmu.edu/ ~ genovese/ Larry Wasserman Department of Statistics Carnegie
More informationStatistical Applications in Genetics and Molecular Biology
Statistical Applications in Genetics and Molecular Biology Volume 5, Issue 1 2006 Article 28 A Two-Step Multiple Comparison Procedure for a Large Number of Tests and Multiple Treatments Hongmei Jiang Rebecca
More informationFalse discovery rate and related concepts in multiple comparisons problems, with applications to microarray data
False discovery rate and related concepts in multiple comparisons problems, with applications to microarray data Ståle Nygård Trial Lecture Dec 19, 2008 1 / 35 Lecture outline Motivation for not using
More informationModel Identification for Wireless Propagation with Control of the False Discovery Rate
Model Identification for Wireless Propagation with Control of the False Discovery Rate Christoph F. Mecklenbräuker (TU Wien) Joint work with Pei-Jung Chung (Univ. Edinburgh) Dirk Maiwald (Atlas Elektronik)
More informationSTAT 263/363: Experimental Design Winter 2016/17. Lecture 1 January 9. Why perform Design of Experiments (DOE)? There are at least two reasons:
STAT 263/363: Experimental Design Winter 206/7 Lecture January 9 Lecturer: Minyong Lee Scribe: Zachary del Rosario. Design of Experiments Why perform Design of Experiments (DOE)? There are at least two
More informationHypothesis testing (cont d)
Hypothesis testing (cont d) Ulrich Heintz Brown University 4/12/2016 Ulrich Heintz - PHYS 1560 Lecture 11 1 Hypothesis testing Is our hypothesis about the fundamental physics correct? We will not be able
More informationDynamic Causal Modelling for EEG/MEG: principles J. Daunizeau
Dynamic Causal Modelling for EEG/MEG: principles J. Daunizeau Motivation, Brain and Behaviour group, ICM, Paris, France Overview 1 DCM: introduction 2 Dynamical systems theory 3 Neural states dynamics
More informationReview. DS GA 1002 Statistical and Mathematical Models. Carlos Fernandez-Granda
Review DS GA 1002 Statistical and Mathematical Models http://www.cims.nyu.edu/~cfgranda/pages/dsga1002_fall16 Carlos Fernandez-Granda Probability and statistics Probability: Framework for dealing with
More informationSTATS 200: Introduction to Statistical Inference. Lecture 29: Course review
STATS 200: Introduction to Statistical Inference Lecture 29: Course review Course review We started in Lecture 1 with a fundamental assumption: Data is a realization of a random process. The goal throughout
More informationEEG/MEG Inverse Solution Driven by fmri
EEG/MEG Inverse Solution Driven by fmri Yaroslav Halchenko CS @ NJIT 1 Functional Brain Imaging EEG ElectroEncephaloGram MEG MagnetoEncephaloGram fmri Functional Magnetic Resonance Imaging others 2 Functional
More informationDecoding conceptual representations
Decoding conceptual representations!!!! Marcel van Gerven! Computational Cognitive Neuroscience Lab (www.ccnlab.net) Artificial Intelligence Department Donders Centre for Cognition Donders Institute for
More informationExam: high-dimensional data analysis January 20, 2014
Exam: high-dimensional data analysis January 20, 204 Instructions: - Write clearly. Scribbles will not be deciphered. - Answer each main question not the subquestions on a separate piece of paper. - Finish
More informationStep-down FDR Procedures for Large Numbers of Hypotheses
Step-down FDR Procedures for Large Numbers of Hypotheses Paul N. Somerville University of Central Florida Abstract. Somerville (2004b) developed FDR step-down procedures which were particularly appropriate
More informationDESIGNING EXPERIMENTS AND ANALYZING DATA A Model Comparison Perspective
DESIGNING EXPERIMENTS AND ANALYZING DATA A Model Comparison Perspective Second Edition Scott E. Maxwell Uniuersity of Notre Dame Harold D. Delaney Uniuersity of New Mexico J,t{,.?; LAWRENCE ERLBAUM ASSOCIATES,
More informationAnnealed Importance Sampling for Neural Mass Models
for Neural Mass Models, UCL. WTCN, UCL, October 2015. Generative Model Behavioural or imaging data y. Likelihood p(y w, Γ). We have a Gaussian prior over model parameters p(w µ, Λ) = N (w; µ, Λ) Assume
More informationStatistical parametric mapping for event-related potentials (II): a hierarchical temporal model
Statistical parametric mapping for event-related potentials (II): a hierarchical temporal model Stefan J. Kiebel* and Karl J. Friston Functional Imaging Laboratory, Institute of Neurology, Wellcome Department
More informationAssessing small sample bias in coordinate based meta-analyses for fmri
Assessing small sample bias in coordinate based meta-analyses for fmri F Acar, R Seurinck & B Moerkerke IBS Channel Network Conference, Hasselt 25 April 2017 What is fmri? fmri Meta-analysis Small sample
More informationNon-specific filtering and control of false positives
Non-specific filtering and control of false positives Richard Bourgon 16 June 2009 bourgon@ebi.ac.uk EBI is an outstation of the European Molecular Biology Laboratory Outline Multiple testing I: overview
More informationSTAT 461/561- Assignments, Year 2015
STAT 461/561- Assignments, Year 2015 This is the second set of assignment problems. When you hand in any problem, include the problem itself and its number. pdf are welcome. If so, use large fonts and
More informationSpecific Differences. Lukas Meier, Seminar für Statistik
Specific Differences Lukas Meier, Seminar für Statistik Problem with Global F-test Problem: Global F-test (aka omnibus F-test) is very unspecific. Typically: Want a more precise answer (or have a more
More informationEvent-related fmri. Christian Ruff. Laboratory for Social and Neural Systems Research Department of Economics University of Zurich
Event-related fmri Christian Ruff Laboratory for Social and Neural Systems Research Department of Economics University of Zurich Institute of Neurology University College London With thanks to the FIL
More informationMATLAB for Brain and Cognitive Scientists
MATLAB for Brain and Cognitive Scientists Mike X Cohen The MIT Press Cambridge, Massachusetts London, England 10947_000.indd 3 2017 Massachusetts Institute of Technology All rights reserved. No part of
More informationMultiple Pairwise Comparison Procedures in One-Way ANOVA with Fixed Effects Model
Biostatistics 250 ANOVA Multiple Comparisons 1 ORIGIN 1 Multiple Pairwise Comparison Procedures in One-Way ANOVA with Fixed Effects Model When the omnibus F-Test for ANOVA rejects the null hypothesis that
More informationPermutation Tests. Noa Haas Statistics M.Sc. Seminar, Spring 2017 Bootstrap and Resampling Methods
Permutation Tests Noa Haas Statistics M.Sc. Seminar, Spring 2017 Bootstrap and Resampling Methods The Two-Sample Problem We observe two independent random samples: F z = z 1, z 2,, z n independently of
More informationThe Surprising Conditional Adventures of the Bootstrap
The Surprising Conditional Adventures of the Bootstrap G. Alastair Young Department of Mathematics Imperial College London Inaugural Lecture, 13 March 2006 Acknowledgements Early influences: Eric Renshaw,
More informationReview of Panel Data Model Types Next Steps. Panel GLMs. Department of Political Science and Government Aarhus University.
Panel GLMs Department of Political Science and Government Aarhus University May 12, 2015 1 Review of Panel Data 2 Model Types 3 Review and Looking Forward 1 Review of Panel Data 2 Model Types 3 Review
More informationSelected Topics in Statistics for fmri Data Analysis
p. HST.583: Functional Magnetic Resonance Imaging: Data Acquisition and Analysis Harvard-MIT Division of Health Sciences and Technology Course Instructor: Dr. Mark Vangel. Selected Topics in Statistics
More informationPower and nonparametric methods Basic statistics for experimental researchersrs 2017
Faculty of Health Sciences Outline Power and nonparametric methods Basic statistics for experimental researchersrs 2017 Statistical power Julie Lyng Forman Department of Biostatistics, University of Copenhagen
More informationSample Size Estimation for Studies of High-Dimensional Data
Sample Size Estimation for Studies of High-Dimensional Data James J. Chen, Ph.D. National Center for Toxicological Research Food and Drug Administration June 3, 2009 China Medical University Taichung,
More informationWill Penny. SPM short course for M/EEG, London 2015
SPM short course for M/EEG, London 2015 Ten Simple Rules Stephan et al. Neuroimage, 2010 Model Structure The model evidence is given by integrating out the dependence on model parameters p(y m) = p(y,
More informationFalse Discovery Rate
False Discovery Rate Peng Zhao Department of Statistics Florida State University December 3, 2018 Peng Zhao False Discovery Rate 1/30 Outline 1 Multiple Comparison and FWER 2 False Discovery Rate 3 FDR
More informationFunctional Connectivity and Network Methods
18/Sep/2013" Functional Connectivity and Network Methods with functional magnetic resonance imaging" Enrico Glerean (MSc), Brain & Mind Lab, BECS, Aalto University" www.glerean.com @eglerean becs.aalto.fi/bml
More informationFuncICA for time series pattern discovery
FuncICA for time series pattern discovery Nishant Mehta and Alexander Gray Georgia Institute of Technology The problem Given a set of inherently continuous time series (e.g. EEG) Find a set of patterns
More informationTesting Statistical Hypotheses
E.L. Lehmann Joseph P. Romano Testing Statistical Hypotheses Third Edition 4y Springer Preface vii I Small-Sample Theory 1 1 The General Decision Problem 3 1.1 Statistical Inference and Statistical Decisions
More informationBayesian Inference. Chris Mathys Wellcome Trust Centre for Neuroimaging UCL. London SPM Course
Bayesian Inference Chris Mathys Wellcome Trust Centre for Neuroimaging UCL London SPM Course Thanks to Jean Daunizeau and Jérémie Mattout for previous versions of this talk A spectacular piece of information
More informationA test for a conjunction
A test for a conjunction K.J. Worsley a,, K.J. Friston b a Department of Mathematics and Statistics, McGill University, Montreal, Canada H3A 2K6 b Wellcome Department of Cognitive Neurology, Institute
More informationSTAT 135 Lab 5 Bootstrapping and Hypothesis Testing
STAT 135 Lab 5 Bootstrapping and Hypothesis Testing Rebecca Barter March 2, 2015 The Bootstrap Bootstrap Suppose that we are interested in estimating a parameter θ from some population with members x 1,...,
More informationDynamic Causal Modelling for evoked responses J. Daunizeau
Dynamic Causal Modelling for evoked responses J. Daunizeau Institute for Empirical Research in Economics, Zurich, Switzerland Brain and Spine Institute, Paris, France Overview 1 DCM: introduction 2 Neural
More informationControlling the False Discovery Rate: Understanding and Extending the Benjamini-Hochberg Method
Controlling the False Discovery Rate: Understanding and Extending the Benjamini-Hochberg Method Christopher R. Genovese Department of Statistics Carnegie Mellon University joint work with Larry Wasserman
More informationTable of Outcomes. Table of Outcomes. Table of Outcomes. Table of Outcomes. Table of Outcomes. Table of Outcomes. T=number of type 2 errors
The Multiple Testing Problem Multiple Testing Methods for the Analysis of Microarray Data 3/9/2009 Copyright 2009 Dan Nettleton Suppose one test of interest has been conducted for each of m genes in a
More informationPost-Selection Inference
Classical Inference start end start Post-Selection Inference selected end model data inference data selection model data inference Post-Selection Inference Todd Kuffner Washington University in St. Louis
More informationROI ANALYSIS OF PHARMAFMRI DATA:
ROI ANALYSIS OF PHARMAFMRI DATA: AN ADAPTIVE APPROACH FOR GLOBAL TESTING Giorgos Minas, John A.D. Aston, Thomas E. Nichols and Nigel Stallard Department of Statistics and Warwick Centre of Analytical Sciences,
More informationFREQUENTIST BEHAVIOR OF FORMAL BAYESIAN INFERENCE
FREQUENTIST BEHAVIOR OF FORMAL BAYESIAN INFERENCE Donald A. Pierce Oregon State Univ (Emeritus), RERF Hiroshima (Retired), Oregon Health Sciences Univ (Adjunct) Ruggero Bellio Univ of Udine For Perugia
More informationNew Machine Learning Methods for Neuroimaging
New Machine Learning Methods for Neuroimaging Gatsby Computational Neuroscience Unit University College London, UK Dept of Computer Science University of Helsinki, Finland Outline Resting-state networks
More information