The General Linear Model (GLM)

Size: px
Start display at page:

Download "The General Linear Model (GLM)"

Transcription

1 he General Linear Model (GLM) Klaas Enno Stephan ranslational Neuromodeling Unit (NU) Institute for Biomedical Engineering University of Zurich & EH Zurich Wellcome rust Centre for Neuroimaging Institute of Neurology, University College London With many thanks to the FIL Methods group Zurich SPM Course February

2 Overview of SPM Image time-series Kernel Design matrix Statistical parametric map (SPM) Realignment Smoothing General linear model Normalisation Statistical inference Gaussian field theory emplate Parameter estimates p <0.05

3 One session Passive word listening versus rest 7 cycles of rest and listening A very simple fmri experiment Blocks of 6 scans with 7 sec R Stimulus function Question: Is there a change in the BOLD response between listening and rest?

4 Modelling the measured data Why? How? Make inferences about effects of interest 1. Decompose data into effects and error. Form statistic using estimates of effects and error stimulus function data linear model effects estimate error estimate statistic

5 Voxel-wise time series analysis ime model specification parameter estimation hypothesis statistic single voxel time series BOLD signal SPM

6 Single voxel regression model ime = β + 1 β + error BOLD signal x 1 x e β β 1 y x + x + = 1 e

7 Mass-univariate analysis: voxel-wise GLM 1 p 1 1 y = Xβ + e β y = X p + e e ~ N (0, σ I Model is specified by 1. Design matrix X. Assumptions about e ) N N N N: number of scans p: number of regressors he design matrix embodies all available knowledge about experimentally controlled factors and potential confounds.

8 GLM assumes Gaussian spherical (i.i.d.) errors sphericity = i.i.d. error covariance is scalar multiple of identity matrix: Cov(e) = σ I Examples for non-sphericity: 4 0 Cov(e) = 0 1 non-identity Cov(e) = Cov(e) = 1 non-independence

9 Parameter estimation β1 = + β Objective: estimate parameters to minimize N t= 1 e t y X e Ordinary least squares estimation (OLS) (assuming i.i.d. error): y = Xβ + e ˆ β = ( X X ) 1 X y

10 A geometric perspective on the GLM ˆ β = OLS estimates ( X X ) 1 X y y e Residual forming matrix R e R = = Ry I P x ˆ Xβˆ y = Design space defined by X x 1 yˆ P Projection matrix P = Py = X ( X X ) 1 X

11 Deriving the OLS equation X e= 0 ( ) X y Xβˆ = 0 X y X Xβˆ = 0 X X β ˆ = X y ( ) X X 1 ˆ = X y OLS estimate β

12 Correlated and orthogonal regressors y x * x x 1 y = 1 1 β = β x β + x 1 = 1 β + e y = x β + x 1 1 * β 1 ; * 1 > β = 1 β * + e Correlated regressors = explained variance is shared between regressors When x is orthogonalized with regard to x 1, only the parameter estimate for x 1 changes, not that for x!

13 What are the problems of this model? 1. BOLD responses have a delayed and dispersed form. HRF. he BOLD signal includes substantial amounts of lowfrequency noise. 3. he data are serially correlated (temporally autocorrelated) this violates the assumptions of the noise model in the GLM

14 Problem 1: Shape of BOLD response Solution: Convolution model hemodynamic response function (HRF) f t g( t) = f ( τ ) g( t τ ) dτ he response of a linear time-invariant (LI) system is the convolution of the input with the system's response to an impulse (delta function). expected BOLD response = input function impulse response function (HRF) 0

15 Convolution model of the BOLD response Convolve stimulus function with a canonical hemodynamic response function (HRF): f t g( t) = f ( τ ) g( t τ ) dτ 0 HRF

16 Problem : Low-frequency noise Solution: High pass filtering Sy = SXβ + Se S = residual forming matrix of DC set discrete cosine transform (DC) set

17 High pass filtering: example blue = black = data mean + low-frequency drift green = predicted response, taking into account low-frequency drift red = predicted response, NO taking into account low-frequency drift

18 e = 1 + ε with ε ~ N (0, σ ) t ae t Problem 3: Serial correlations t t 1 st order autoregressive process: AR(1) autocovariance function Cov(e) N N

19 Dealing with serial correlations Pre-colouring: impose some known autocorrelation structure on the data (filtering with matrix W) and use Satterthwaite correction for df s. Pre-whitening: 1. Use an enhanced noise model with multiple error covariance components, i.e. e ~ N(0, σ V) instead of e ~ N(0, σ I).. Use estimated serial correlation to specify filter matrix W for whitening the data. Wy = WXβ + We

20 How do we define W? Enhanced noise model e ~ N (0, σ V ) Remember linear transform for Gaussians x ~ y ~ N( µ, σ N( aµ, a ), y = ax σ ) Choose W such that error covariance becomes spherical We ~ N(0, σ W V ) Conclusion: W is a simple function of V so how do we estimate V? W W V = V = I 1/ Wy = WXβ + We

21 Estimating V: Multiple covariance components V e ~ N(0, σ ) V = enhanced noise model V Cov( e) λiq i error covariance components Q and hyperparameters λ V Q 1 Q = λ 1 + λ Estimation of hyperparameters λ with ReML (restricted maximum likelihood).

22 Contrasts & statistical parametric maps c = X Q: activation during listening? Null hypothesis: β 1 = 0 t = c ˆ β Std( c ˆ) β

23 t-statistic based on ML estimates Wy = WXβ + We ˆβ = ( WX ) + Wy c = X c ˆ β t = ˆ std( c ˆ) β σ W V 1/ = V = Cov( e) V = λ i Q i std ˆ ( c ˆ σ c ˆ σ = ˆ) β = ( WX ) + ( WX ) + ( Wy WX ˆ β ) tr( R) R = I WX (WX ) + c For brevity: ReMLestimates ( WX ) + = ( X WX ) 1 X

24 Physiological confounds head movements arterial pulsations (particularly bad in brain stem) breathing eye blinks (visual cortex) adaptation effects, fatigue, fluctuations in concentration, etc.

25 Outlook: further challenges correction for multiple comparisons variability in the HRF across voxels slice timing limitations of frequentist statistics Bayesian analyses GLM ignores interactions among voxels models of effective connectivity hese issues are discussed in future lectures.

26 Correction for multiple comparisons Mass-univariate approach: We apply the GLM to each of a huge number of voxels (usually > 100,000). hreshold of p<0.05 more than 5000 voxels significant by chance! Massive problem with multiple comparisons! Solution: Gaussian random field theory

27 Variability in the HRF HRF varies substantially across voxels and subjects For example, latency can differ by ± 1 second Solution: use multiple basis functions See talk on event-related fmri

28 Summary Mass-univariate approach: same GLM for each voxel GLM includes all known experimental effects and confounds Convolution with a canonical HRF High-pass filtering to account for low-frequency drifts Estimation of multiple variance components (e.g. to account for serial correlations)

29 Bibliography Friston, Ashburner, Kiebel, Nichols, Penny (007) Statistical Parametric Mapping: he Analysis of Functional Brain Images. Elsevier. Christensen R (1996) Plane Answers to Complex Questions: he heory of Linear Models. Springer. Friston KJ et al. (1995) Statistical parametric maps in functional imaging: a general linear approach. Human Brain Mapping :

30 Supplementary slides

31 Convolution step-by-step (from Wikipedia): 1. Express each function in terms of a dummy variable τ.. Reflect one of the functions: g(τ) g( τ). 3. Add a time-offset, t, which allows g(t τ) to slide along the τ-axis. 4.Start t at - and slide it all the way to +. Wherever the two functions intersect, find the integral of their product. In other words, compute a sliding, weighted-average of function f(τ), where the weighting function is g( τ). he resulting waveform (not shown here) is the convolution of functions f and g. If f(t) is a unit impulse, the result of this process is simply g(t), which is therefore called the impulse response.

The General Linear Model (GLM)

The General Linear Model (GLM) The General Linear Model (GLM) Dr. Frederike Petzschner Translational Neuromodeling Unit (TNU) Institute for Biomedical Engineering, University of Zurich & ETH Zurich With many thanks for slides & images

More information

The General Linear Model. Guillaume Flandin Wellcome Trust Centre for Neuroimaging University College London

The General Linear Model. Guillaume Flandin Wellcome Trust Centre for Neuroimaging University College London The General Linear Model Guillaume Flandin Wellcome Trust Centre for Neuroimaging University College London SPM Course Lausanne, April 2012 Image time-series Spatial filter Design matrix Statistical Parametric

More information

Statistical Inference

Statistical Inference Statistical Inference Jean Daunizeau Wellcome rust Centre for Neuroimaging University College London SPM Course Edinburgh, April 2010 Image time-series Spatial filter Design matrix Statistical Parametric

More information

Statistical Inference

Statistical Inference Statistical Inference J. Daunizeau Institute of Empirical Research in Economics, Zurich, Switzerland Brain and Spine Institute, Paris, France SPM Course Edinburgh, April 2011 Image time-series Spatial

More information

Overview of SPM. Overview. Making the group inferences we want. Non-sphericity Beyond Ordinary Least Squares. Model estimation A word on power

Overview of SPM. Overview. Making the group inferences we want. Non-sphericity Beyond Ordinary Least Squares. Model estimation A word on power Group Inference, Non-sphericity & Covariance Components in SPM Alexa Morcom Edinburgh SPM course, April 011 Centre for Cognitive & Neural Systems/ Department of Psychology University of Edinburgh Overview

More information

Group analysis. Jean Daunizeau Wellcome Trust Centre for Neuroimaging University College London. SPM Course Edinburgh, April 2010

Group analysis. Jean Daunizeau Wellcome Trust Centre for Neuroimaging University College London. SPM Course Edinburgh, April 2010 Group analysis Jean Daunizeau Wellcome Trust Centre for Neuroimaging University College London SPM Course Edinburgh, April 2010 Image time-series Spatial filter Design matrix Statistical Parametric Map

More information

Data Analysis I: Single Subject

Data Analysis I: Single Subject Data Analysis I: Single Subject ON OFF he General Linear Model (GLM) y= X fmri Signal = Design Matrix our data = what we CAN explain x β x Betas + + how much x of it we CAN + explain ε Residuals what

More information

Contents. Introduction The General Linear Model. General Linear Linear Model Model. The General Linear Model, Part I. «Take home» message

Contents. Introduction The General Linear Model. General Linear Linear Model Model. The General Linear Model, Part I. «Take home» message DISCOS SPM course, CRC, Liège, 2009 Contents The General Linear Model, Part I Introduction The General Linear Model Data & model Design matrix Parameter estimates & interpretation Simple contrast «Take

More information

Group Analysis. Lexicon. Hierarchical models Mixed effect models Random effect (RFX) models Components of variance

Group Analysis. Lexicon. Hierarchical models Mixed effect models Random effect (RFX) models Components of variance Group Analysis J. Daunizeau Institute of Empirical Research in Economics, Zurich, Switzerland Brain and Spine Institute, Paris, France SPM Course Edinburgh, April 2011 Image time-series Spatial filter

More information

Extracting fmri features

Extracting fmri features Extracting fmri features PRoNTo course May 2018 Christophe Phillips, GIGA Institute, ULiège, Belgium c.phillips@uliege.be - http://www.giga.ulg.ac.be Overview Introduction Brain decoding problem Subject

More information

Experimental design of fmri studies

Experimental design of fmri studies Experimental design of fmri studies Sandra Iglesias Translational Neuromodeling Unit University of Zurich & ETH Zurich With many thanks for slides & images to: Klaas Enno Stephan, FIL Methods group, Christian

More information

Experimental design of fmri studies

Experimental design of fmri studies Experimental design of fmri studies Zurich SPM Course 2016 Sandra Iglesias Translational Neuromodeling Unit (TNU) Institute for Biomedical Engineering (IBT) University and ETH Zürich With many thanks for

More information

Event-related fmri. Christian Ruff. Laboratory for Social and Neural Systems Research Department of Economics University of Zurich

Event-related fmri. Christian Ruff. Laboratory for Social and Neural Systems Research Department of Economics University of Zurich Event-related fmri Christian Ruff Laboratory for Social and Neural Systems Research Department of Economics University of Zurich Institute of Neurology University College London With thanks to the FIL

More information

Neuroimaging for Machine Learners Validation and inference

Neuroimaging for Machine Learners Validation and inference GIGA in silico medicine, ULg, Belgium http://www.giga.ulg.ac.be Neuroimaging for Machine Learners Validation and inference Christophe Phillips, Ir. PhD. PRoNTo course June 2017 Univariate analysis: Introduction:

More information

Jean-Baptiste Poline

Jean-Baptiste Poline Edinburgh course Avril 2010 Linear Models Contrasts Variance components Jean-Baptiste Poline Neurospin, I2BM, CEA Saclay, France Credits: Will Penny, G. Flandin, SPM course authors Outline Part I: Linear

More information

Signal Processing for Functional Brain Imaging: General Linear Model (2)

Signal Processing for Functional Brain Imaging: General Linear Model (2) Signal Processing for Functional Brain Imaging: General Linear Model (2) Maria Giulia Preti, Dimitri Van De Ville Medical Image Processing Lab, EPFL/UniGE http://miplab.epfl.ch/teaching/micro-513/ March

More information

Modelling temporal structure (in noise and signal)

Modelling temporal structure (in noise and signal) Modelling temporal structure (in noise and signal) Mark Woolrich, Christian Beckmann*, Salima Makni & Steve Smith FMRIB, Oxford *Imperial/FMRIB temporal noise: modelling temporal autocorrelation temporal

More information

Mixed-effects and fmri studies

Mixed-effects and fmri studies Mixed-effects and fmri studies Technical Note www.elsevier.com/locate/ynimg NeuroImage 24 (2005) 244 252 K.J. Friston, a K.E. Stephan, a, * T.E. Lund, b A. Morcom, c and S. Kiebel a a The Wellcome Department

More information

Wellcome Trust Centre for Neuroimaging, UCL, UK.

Wellcome Trust Centre for Neuroimaging, UCL, UK. Bayesian Inference Will Penny Wellcome Trust Centre for Neuroimaging, UCL, UK. SPM Course, Virginia Tech, January 2012 What is Bayesian Inference? (From Daniel Wolpert) Bayesian segmentation and normalisation

More information

Experimental design of fmri studies & Resting-State fmri

Experimental design of fmri studies & Resting-State fmri Methods & Models for fmri Analysis 2016 Experimental design of fmri studies & Resting-State fmri Sandra Iglesias With many thanks for slides & images to: Klaas Enno Stephan, FIL Methods group, Christian

More information

Contents. design. Experimental design Introduction & recap Experimental design «Take home» message. N εˆ. DISCOS SPM course, CRC, Liège, 2009

Contents. design. Experimental design Introduction & recap Experimental design «Take home» message. N εˆ. DISCOS SPM course, CRC, Liège, 2009 DISCOS SPM course, CRC, Liège, 2009 Contents Experimental design Introduction & recap Experimental design «Take home» message C. Phillips, Centre de Recherches du Cyclotron, ULg, Belgium Based on slides

More information

Experimental design of fmri studies

Experimental design of fmri studies Experimental design of fmri studies Sandra Iglesias With many thanks for slides & images to: Klaas Enno Stephan, FIL Methods group, Christian Ruff SPM Course 2015 Overview of SPM Image time-series Kernel

More information

Experimental design of fmri studies

Experimental design of fmri studies Methods & Models for fmri Analysis 2017 Experimental design of fmri studies Sara Tomiello With many thanks for slides & images to: Sandra Iglesias, Klaas Enno Stephan, FIL Methods group, Christian Ruff

More information

Contrasts and Classical Inference

Contrasts and Classical Inference Elsevier UK Chapter: Ch9-P3756 8-7-6 7:p.m. Page:6 Trim:7.5in 9.5in C H A P T E R 9 Contrasts and Classical Inference J. Poline, F. Kherif, C. Pallier and W. Penny INTRODUCTION The general linear model

More information

Optimization of Designs for fmri

Optimization of Designs for fmri Optimization of Designs for fmri UCLA Advanced Neuroimaging Summer School August 2, 2007 Thomas Liu, Ph.D. UCSD Center for Functional MRI Why optimize? Scans are expensive. Subjects can be difficult to

More information

MIXED EFFECTS MODELS FOR TIME SERIES

MIXED EFFECTS MODELS FOR TIME SERIES Outline MIXED EFFECTS MODELS FOR TIME SERIES Cristina Gorrostieta Hakmook Kang Hernando Ombao Brown University Biostatistics Section February 16, 2011 Outline OUTLINE OF TALK 1 SCIENTIFIC MOTIVATION 2

More information

Statistical Analysis Aspects of Resting State Functional Connectivity

Statistical Analysis Aspects of Resting State Functional Connectivity Statistical Analysis Aspects of Resting State Functional Connectivity Biswal s result (1995) Correlations between RS Fluctuations of left and right motor areas Why studying resting state? Human Brain =

More information

Dynamic Causal Modelling for fmri

Dynamic Causal Modelling for fmri Dynamic Causal Modelling for fmri André Marreiros Friday 22 nd Oct. 2 SPM fmri course Wellcome Trust Centre for Neuroimaging London Overview Brain connectivity: types & definitions Anatomical connectivity

More information

Statistical inference for MEG

Statistical inference for MEG Statistical inference for MEG Vladimir Litvak Wellcome Trust Centre for Neuroimaging University College London, UK MEG-UK 2014 educational day Talk aims Show main ideas of common methods Explain some of

More information

Bayesian inference J. Daunizeau

Bayesian inference J. Daunizeau Bayesian inference J. Daunizeau Brain and Spine Institute, Paris, France Wellcome Trust Centre for Neuroimaging, London, UK Overview of the talk 1 Probabilistic modelling and representation of uncertainty

More information

Bayesian inference J. Daunizeau

Bayesian inference J. Daunizeau Bayesian inference J. Daunizeau Brain and Spine Institute, Paris, France Wellcome Trust Centre for Neuroimaging, London, UK Overview of the talk 1 Probabilistic modelling and representation of uncertainty

More information

1st level analysis Basis functions, parametric modulation and correlated regressors

1st level analysis Basis functions, parametric modulation and correlated regressors 1st level analysis Basis functions, parametric modulation and correlated regressors 1 First Level Analysis Bold impulse response Temporal Basis Functions Parametric modulation Correlated regressors Blocked

More information

Mixed effects and Group Modeling for fmri data

Mixed effects and Group Modeling for fmri data Mixed effects and Group Modeling for fmri data Thomas Nichols, Ph.D. Department of Statistics Warwick Manufacturing Group University of Warwick Warwick fmri Reading Group May 19, 2010 1 Outline Mixed effects

More information

Time Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY

Time Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY Time Series Analysis James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY & Contents PREFACE xiii 1 1.1. 1.2. Difference Equations First-Order Difference Equations 1 /?th-order Difference

More information

Piotr Majer Risk Patterns and Correlated Brain Activities

Piotr Majer Risk Patterns and Correlated Brain Activities Alena My²i ková Piotr Majer Song Song Alena Myšičková Peter N. C. Mohr Peter N. C. Mohr Wolfgang K. Härdle Song Song Hauke R. Heekeren Wolfgang K. Härdle Hauke R. Heekeren C.A.S.E. Centre C.A.S.E. for

More information

What is NIRS? First-Level Statistical Models 5/18/18

What is NIRS? First-Level Statistical Models 5/18/18 First-Level Statistical Models Theodore Huppert, PhD (huppertt@upmc.edu) University of Pittsburgh Departments of Radiology and Bioengineering What is NIRS? Light Intensity SO 2 and Heart Rate 2 1 5/18/18

More information

The general linear model and Statistical Parametric Mapping I: Introduction to the GLM

The general linear model and Statistical Parametric Mapping I: Introduction to the GLM The general linear mdel and Statistical Parametric Mapping I: Intrductin t the GLM Alexa Mrcm and Stefan Kiebel, Rik Hensn, Andrew Hlmes & J-B J Pline Overview Intrductin Essential cncepts Mdelling Design

More information

General linear model: basic

General linear model: basic General linear model: basic Introducing General Linear Model (GLM): Start with an example Proper>es of the BOLD signal Linear Time Invariant (LTI) system The hemodynamic response func>on (Briefly) Evalua>ng

More information

Effective Connectivity & Dynamic Causal Modelling

Effective Connectivity & Dynamic Causal Modelling Effective Connectivity & Dynamic Causal Modelling Hanneke den Ouden Donders Centre for Cognitive Neuroimaging Radboud University Nijmegen Advanced SPM course Zurich, Februari 13-14, 2014 Functional Specialisation

More information

Statistical Analysis of fmrl Data

Statistical Analysis of fmrl Data Statistical Analysis of fmrl Data F. Gregory Ashby The MIT Press Cambridge, Massachusetts London, England Preface xi Acronyms xv 1 Introduction 1 What Is fmri? 2 The Scanning Session 4 Experimental Design

More information

Beyond Univariate Analyses: Multivariate Modeling of Functional Neuroimaging Data

Beyond Univariate Analyses: Multivariate Modeling of Functional Neuroimaging Data Beyond Univariate Analyses: Multivariate Modeling of Functional Neuroimaging Data F. DuBois Bowman Department of Biostatistics and Bioinformatics Center for Biomedical Imaging Statistics Emory University,

More information

Time Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY

Time Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY Time Series Analysis James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY PREFACE xiii 1 Difference Equations 1.1. First-Order Difference Equations 1 1.2. pth-order Difference Equations 7

More information

Detecting fmri activation allowing for unknown latency of the hemodynamic response

Detecting fmri activation allowing for unknown latency of the hemodynamic response Detecting fmri activation allowing for unknown latency of the hemodynamic response K.J. Worsley McGill University J.E. Taylor Stanford University January 7, 006 Abstract Several authors have suggested

More information

Overview of Spatial Statistics with Applications to fmri

Overview of Spatial Statistics with Applications to fmri with Applications to fmri School of Mathematics & Statistics Newcastle University April 8 th, 2016 Outline Why spatial statistics? Basic results Nonstationary models Inference for large data sets An example

More information

Bayesian Analysis. Bayesian Analysis: Bayesian methods concern one s belief about θ. [Current Belief (Posterior)] (Prior Belief) x (Data) Outline

Bayesian Analysis. Bayesian Analysis: Bayesian methods concern one s belief about θ. [Current Belief (Posterior)] (Prior Belief) x (Data) Outline Bayesian Analysis DuBois Bowman, Ph.D. Gordana Derado, M. S. Shuo Chen, M. S. Department of Biostatistics and Bioinformatics Center for Biomedical Imaging Statistics Emory University Outline I. Introduction

More information

Contents. Data. Introduction & recap Variance components Hierarchical model RFX and summary statistics Variance/covariance matrix «Take home» message

Contents. Data. Introduction & recap Variance components Hierarchical model RFX and summary statistics Variance/covariance matrix «Take home» message SPM course, CRC, Liege,, Septembre 2009 Contents Group analysis (RF) Variance components Hierarchical model RF and summary statistics Variance/covariance matrix «Tae home» message C. Phillips, Centre de

More information

Lecture 2: Univariate Time Series

Lecture 2: Univariate Time Series Lecture 2: Univariate Time Series Analysis: Conditional and Unconditional Densities, Stationarity, ARMA Processes Prof. Massimo Guidolin 20192 Financial Econometrics Spring/Winter 2017 Overview Motivation:

More information

A. Motivation To motivate the analysis of variance framework, we consider the following example.

A. Motivation To motivate the analysis of variance framework, we consider the following example. 9.07 ntroduction to Statistics for Brain and Cognitive Sciences Emery N. Brown Lecture 14: Analysis of Variance. Objectives Understand analysis of variance as a special case of the linear model. Understand

More information

Experimental Design. Rik Henson. With thanks to: Karl Friston, Andrew Holmes

Experimental Design. Rik Henson. With thanks to: Karl Friston, Andrew Holmes Experimental Design Rik Henson With thanks to: Karl Friston, Andrew Holmes Overview 1. A Taxonomy of Designs 2. Epoch vs Event-related 3. Mixed Epoch/Event Designs A taxonomy of design Categorical designs

More information

An introduction to Bayesian inference and model comparison J. Daunizeau

An introduction to Bayesian inference and model comparison J. Daunizeau An introduction to Bayesian inference and model comparison J. Daunizeau ICM, Paris, France TNU, Zurich, Switzerland Overview of the talk An introduction to probabilistic modelling Bayesian model comparison

More information

HST 583 FUNCTIONAL MAGNETIC RESONANCE IMAGING DATA ANALYSIS AND ACQUISITION A REVIEW OF STATISTICS FOR FMRI DATA ANALYSIS

HST 583 FUNCTIONAL MAGNETIC RESONANCE IMAGING DATA ANALYSIS AND ACQUISITION A REVIEW OF STATISTICS FOR FMRI DATA ANALYSIS HST 583 FUNCTIONAL MAGNETIC RESONANCE IMAGING DATA ANALYSIS AND ACQUISITION A REVIEW OF STATISTICS FOR FMRI DATA ANALYSIS EMERY N. BROWN AND CHRIS LONG NEUROSCIENCE STATISTICS RESEARCH LABORATORY DEPARTMENT

More information

The General Linear Model Ivo Dinov

The General Linear Model Ivo Dinov Stats 33 Statistical Methods for Biomedical Data The General Linear Model Ivo Dinov dinov@stat.ucla.edu http://www.stat.ucla.edu/~dinov Slide 1 Problems with t-tests and correlations 1) How do we evaluate

More information

Dynamic Causal Models

Dynamic Causal Models Dynamic Causal Models V1 SPC Will Penny V1 SPC V5 V5 Olivier David, Karl Friston, Lee Harrison, Andrea Mechelli, Klaas Stephan Wellcome Department of Imaging Neuroscience, ION, UCL, UK. Mathematics in

More information

ROI analysis of pharmafmri data: an adaptive approach for global testing

ROI analysis of pharmafmri data: an adaptive approach for global testing ROI analysis of pharmafmri data: an adaptive approach for global testing Giorgos Minas, John A.D. Aston, Thomas E. Nichols and Nigel Stallard Abstract Pharmacological fmri (pharmafmri) is a new highly

More information

For GLM y = Xβ + e (1) where X is a N k design matrix and p(e) = N(0, σ 2 I N ), we can estimate the coefficients from the normal equations

For GLM y = Xβ + e (1) where X is a N k design matrix and p(e) = N(0, σ 2 I N ), we can estimate the coefficients from the normal equations 1 Generalised Inverse For GLM y = Xβ + e (1) where X is a N k design matrix and p(e) = N(0, σ 2 I N ), we can estimate the coefficients from the normal equations (X T X)β = X T y (2) If rank of X, denoted

More information

Bayesian Estimation of Dynamical Systems: An Application to fmri

Bayesian Estimation of Dynamical Systems: An Application to fmri NeuroImage 16, 513 530 (2002) doi:10.1006/nimg.2001.1044, available online at http://www.idealibrary.com on Bayesian Estimation of Dynamical Systems: An Application to fmri K. J. Friston The Wellcome Department

More information

Multivariate Regression Generalized Likelihood Ratio Tests for FMRI Activation

Multivariate Regression Generalized Likelihood Ratio Tests for FMRI Activation Multivariate Regression Generalized Likelihood Ratio Tests for FMRI Activation Daniel B Rowe Division of Biostatistics Medical College of Wisconsin Technical Report 40 November 00 Division of Biostatistics

More information

Outline. Overview of Issues. Spatial Regression. Luc Anselin

Outline. Overview of Issues. Spatial Regression. Luc Anselin Spatial Regression Luc Anselin University of Illinois, Urbana-Champaign http://www.spacestat.com Outline Overview of Issues Spatial Regression Specifications Space-Time Models Spatial Latent Variable Models

More information

General multilevel linear modeling for group analysis in FMRI

General multilevel linear modeling for group analysis in FMRI NeuroImage 0 (003) 105 1063 www.elsevier.com/locate/ynimg General multilevel linear modeling for group analysis in FMRI Christian F. Becmann, a,b, *,1 Mar Jeninson, a,1 and Stephen M. Smith a a Oxford

More information

FIL. Event-related. fmri. Rik Henson. With thanks to: Karl Friston, Oliver Josephs

FIL. Event-related. fmri. Rik Henson. With thanks to: Karl Friston, Oliver Josephs Event-related fmri Rik Henson With thanks to: Karl Friston, Oliver Josephs Overview 1. BOLD impulse response 2. General Linear Model 3. Temporal Basis Functions 4. Timing Issues 5. Design Optimisation

More information

Peak Detection for Images

Peak Detection for Images Peak Detection for Images Armin Schwartzman Division of Biostatistics, UC San Diego June 016 Overview How can we improve detection power? Use a less conservative error criterion Take advantage of prior

More information

Model-free Functional Data Analysis

Model-free Functional Data Analysis Model-free Functional Data Analysis MELODIC Multivariate Exploratory Linear Optimised Decomposition into Independent Components decomposes data into a set of statistically independent spatial component

More information

Ch 2: Simple Linear Regression

Ch 2: Simple Linear Regression Ch 2: Simple Linear Regression 1. Simple Linear Regression Model A simple regression model with a single regressor x is y = β 0 + β 1 x + ɛ, where we assume that the error ɛ is independent random component

More information

Bayesian Treatments of. Neuroimaging Data Will Penny and Karl Friston. 5.1 Introduction

Bayesian Treatments of. Neuroimaging Data Will Penny and Karl Friston. 5.1 Introduction Bayesian Treatments of 5 Neuroimaging Data Will Penny and Karl Friston 5.1 Introduction In this chapter we discuss the application of Bayesian methods to neuroimaging data. This includes data from positron

More information

Hierarchical Models. W.D. Penny and K.J. Friston. Wellcome Department of Imaging Neuroscience, University College London.

Hierarchical Models. W.D. Penny and K.J. Friston. Wellcome Department of Imaging Neuroscience, University College London. Hierarchical Models W.D. Penny and K.J. Friston Wellcome Department of Imaging Neuroscience, University College London. February 28, 2003 1 Introduction Hierarchical models are central to many current

More information

Towards a Regression using Tensors

Towards a Regression using Tensors February 27, 2014 Outline Background 1 Background Linear Regression Tensorial Data Analysis 2 Definition Tensor Operation Tensor Decomposition 3 Model Attention Deficit Hyperactivity Disorder Data Analysis

More information

Models of effective connectivity & Dynamic Causal Modelling (DCM)

Models of effective connectivity & Dynamic Causal Modelling (DCM) Models of effective connectivit & Dnamic Causal Modelling (DCM Presented b: Ariana Anderson Slides shared b: Karl Friston Functional Imaging Laborator (FIL Wellcome Trust Centre for Neuroimaging Universit

More information

NeuroImage. Modeling the hemodynamic response function in fmri: Efficiency, bias and mis-modeling

NeuroImage. Modeling the hemodynamic response function in fmri: Efficiency, bias and mis-modeling NeuroImage 45 (2009) S187 S198 Contents lists available at ScienceDirect NeuroImage journal homepage: www. elsevier. com/ locate/ yni mg Modeling the hemodynamic response function in fmri: Efficiency,

More information

Models of effective connectivity & Dynamic Causal Modelling (DCM)

Models of effective connectivity & Dynamic Causal Modelling (DCM) Models of effective connectivit & Dnamic Causal Modelling (DCM) Slides obtained from: Karl Friston Functional Imaging Laborator (FIL) Wellcome Trust Centre for Neuroimaging Universit College London Klaas

More information

Overview. Experimental Design. A categorical analysis. A taxonomy of design. A taxonomy of design. A taxonomy of design. 1. A Taxonomy of Designs

Overview. Experimental Design. A categorical analysis. A taxonomy of design. A taxonomy of design. A taxonomy of design. 1. A Taxonomy of Designs Experimental Design Overview Rik Henson With thanks to: Karl Friston, Andrew Holmes 1. A Taxonomy of Designs 2. Epoch vs Event-related 3. Mixed Epoch/Event Designs designs designs - and nonlinear interactions

More information

M/EEG source analysis

M/EEG source analysis Jérémie Mattout Lyon Neuroscience Research Center Will it ever happen that mathematicians will know enough about the physiology of the brain, and neurophysiologists enough of mathematical discovery, for

More information

The ASL signal. Parenchy mal signal. Venous signal. Arterial signal. Input Function (Label) Dispersion: (t e -kt ) Relaxation: (e -t/t1a )

The ASL signal. Parenchy mal signal. Venous signal. Arterial signal. Input Function (Label) Dispersion: (t e -kt ) Relaxation: (e -t/t1a ) Lecture Goals Other non-bold techniques (T2 weighted, Mn contrast agents, SSFP, Dynamic Diffusion, ASL) Understand Basic Principles in Spin labeling : spin inversion, flow vs. perfusion ASL variations

More information

Homework #2 Due date: 2/19/2013 (Tuesday) Translate the slice Two Main Paths in Lecture Part II: Neurophysiology and BOLD to words.

Homework #2 Due date: 2/19/2013 (Tuesday) Translate the slice Two Main Paths in Lecture Part II: Neurophysiology and BOLD to words. Homework #2 Due date: 2/19/2013 (Tuesday) 1. What is BOLD? In your own words, fully explain the mechanism of BOLD fmri (from stimulus input to image voxel signal). (20 points) Translate the slice Two Main

More information

Dynamic Causal Modelling for EEG/MEG: principles J. Daunizeau

Dynamic Causal Modelling for EEG/MEG: principles J. Daunizeau Dynamic Causal Modelling for EEG/MEG: principles J. Daunizeau Motivation, Brain and Behaviour group, ICM, Paris, France Overview 1 DCM: introduction 2 Dynamical systems theory 3 Neural states dynamics

More information

Statistical parametric mapping for event-related potentials (II): a hierarchical temporal model

Statistical parametric mapping for event-related potentials (II): a hierarchical temporal model Statistical parametric mapping for event-related potentials (II): a hierarchical temporal model Stefan J. Kiebel* and Karl J. Friston Functional Imaging Laboratory, Institute of Neurology, Wellcome Department

More information

First Technical Course, European Centre for Soft Computing, Mieres, Spain. 4th July 2011

First Technical Course, European Centre for Soft Computing, Mieres, Spain. 4th July 2011 First Technical Course, European Centre for Soft Computing, Mieres, Spain. 4th July 2011 Linear Given probabilities p(a), p(b), and the joint probability p(a, B), we can write the conditional probabilities

More information

Classic Time Series Analysis

Classic Time Series Analysis Classic Time Series Analysis Concepts and Definitions Let Y be a random number with PDF f Y t ~f,t Define t =E[Y t ] m(t) is known as the trend Define the autocovariance t, s =COV [Y t,y s ] =E[ Y t t

More information

Restricted Maximum Likelihood in Linear Regression and Linear Mixed-Effects Model

Restricted Maximum Likelihood in Linear Regression and Linear Mixed-Effects Model Restricted Maximum Likelihood in Linear Regression and Linear Mixed-Effects Model Xiuming Zhang zhangxiuming@u.nus.edu A*STAR-NUS Clinical Imaging Research Center October, 015 Summary This report derives

More information

Title. Description. var intro Introduction to vector autoregressive models

Title. Description. var intro Introduction to vector autoregressive models Title var intro Introduction to vector autoregressive models Description Stata has a suite of commands for fitting, forecasting, interpreting, and performing inference on vector autoregressive (VAR) models

More information

Spatial Regression. 6. Specification Spatial Heterogeneity. Luc Anselin.

Spatial Regression. 6. Specification Spatial Heterogeneity. Luc Anselin. Spatial Regression 6. Specification Spatial Heterogeneity Luc Anselin http://spatial.uchicago.edu 1 homogeneity and heterogeneity spatial regimes spatially varying coefficients spatial random effects 2

More information

Stochastic Dynamic Causal Modelling for resting-state fmri

Stochastic Dynamic Causal Modelling for resting-state fmri Stochastic Dynamic Causal Modelling for resting-state fmri Ged Ridgway, FIL, Wellcome Trust Centre for Neuroimaging, UCL Institute of Neurology, London Overview Connectivity in the brain Introduction to

More information

Commentary on the statistical properties of noise and its implication on general linear models in functional near-infrared spectroscopy

Commentary on the statistical properties of noise and its implication on general linear models in functional near-infrared spectroscopy Commentary on the statistical properties of noise and its implication on general linear models in functional near-infrared spectroscopy Theodore J. Huppert Neurophotonics 3(1), 010401 (Jan Mar 2016) COMMENTARY

More information

Computing FMRI Activations: Coefficients and t-statistics by Detrending and Multiple Regression

Computing FMRI Activations: Coefficients and t-statistics by Detrending and Multiple Regression Computing FMRI Activations: Coefficients and t-statistics by Detrending and Multiple Regression Daniel B. Rowe and Steven W. Morgan Division of Biostatistics Medical College of Wisconsin Technical Report

More information

Multilevel Models in Matrix Form. Lecture 7 July 27, 2011 Advanced Multivariate Statistical Methods ICPSR Summer Session #2

Multilevel Models in Matrix Form. Lecture 7 July 27, 2011 Advanced Multivariate Statistical Methods ICPSR Summer Session #2 Multilevel Models in Matrix Form Lecture 7 July 27, 2011 Advanced Multivariate Statistical Methods ICPSR Summer Session #2 Today s Lecture Linear models from a matrix perspective An example of how to do

More information

Peter Hoff Linear and multilinear models April 3, GLS for multivariate regression 5. 3 Covariance estimation for the GLM 8

Peter Hoff Linear and multilinear models April 3, GLS for multivariate regression 5. 3 Covariance estimation for the GLM 8 Contents 1 Linear model 1 2 GLS for multivariate regression 5 3 Covariance estimation for the GLM 8 4 Testing the GLH 11 A reference for some of this material can be found somewhere. 1 Linear model Recall

More information

Assessing Model Adequacy

Assessing Model Adequacy Assessing Model Adequacy A number of assumptions were made about the model, and these need to be verified in order to use the model for inferences. In cases where some assumptions are violated, there are

More information

Analysis of fmri Timeseries:

Analysis of fmri Timeseries: 1 Chapter 10 Analysis of fmri Timeseries: Linear Time-Invariant Models, Event-related fmri and Optimal Experimental Design Rik Henson The Wellcome Dept. of Imaging Neuroscience & Institute of Cognitive

More information

22s:152 Applied Linear Regression. In matrix notation, we can write this model: Generalized Least Squares. Y = Xβ + ɛ with ɛ N n (0, Σ)

22s:152 Applied Linear Regression. In matrix notation, we can write this model: Generalized Least Squares. Y = Xβ + ɛ with ɛ N n (0, Σ) 22s:152 Applied Linear Regression Generalized Least Squares Returning to a continuous response variable Y Ordinary Least Squares Estimation The classical models we have fit so far with a continuous response

More information

Morphometry. John Ashburner. Wellcome Trust Centre for Neuroimaging, 12 Queen Square, London, UK.

Morphometry. John Ashburner. Wellcome Trust Centre for Neuroimaging, 12 Queen Square, London, UK. Morphometry John Ashburner Wellcome Trust Centre for Neuroimaging, 12 Queen Square, London, UK. Morphometry is defined as: Measurement of the form of organisms or of their parts. The American Heritage

More information

Statistical Analysis of Functional ASL Images

Statistical Analysis of Functional ASL Images Statistical Analysis of Functional ASL Images Daniel B. Rowe, Ph.D. Department of Mathematics, Statistics, and Computer Science Department of Biophysics Department of EE and CS 1 Outline: 1. Control/Label

More information

1 Introduction to Generalized Least Squares

1 Introduction to Generalized Least Squares ECONOMICS 7344, Spring 2017 Bent E. Sørensen April 12, 2017 1 Introduction to Generalized Least Squares Consider the model Y = Xβ + ɛ, where the N K matrix of regressors X is fixed, independent of the

More information

Generalized Linear Models. Kurt Hornik

Generalized Linear Models. Kurt Hornik Generalized Linear Models Kurt Hornik Motivation Assuming normality, the linear model y = Xβ + e has y = β + ε, ε N(0, σ 2 ) such that y N(μ, σ 2 ), E(y ) = μ = β. Various generalizations, including general

More information

Poisson Regression. Ryan Godwin. ECON University of Manitoba

Poisson Regression. Ryan Godwin. ECON University of Manitoba Poisson Regression Ryan Godwin ECON 7010 - University of Manitoba Abstract. These lecture notes introduce Maximum Likelihood Estimation (MLE) of a Poisson regression model. 1 Motivating the Poisson Regression

More information

Diagnostics of Linear Regression

Diagnostics of Linear Regression Diagnostics of Linear Regression Junhui Qian October 7, 14 The Objectives After estimating a model, we should always perform diagnostics on the model. In particular, we should check whether the assumptions

More information

A prior distribution over model space p(m) (or hypothesis space ) can be updated to a posterior distribution after observing data y.

A prior distribution over model space p(m) (or hypothesis space ) can be updated to a posterior distribution after observing data y. June 2nd 2011 A prior distribution over model space p(m) (or hypothesis space ) can be updated to a posterior distribution after observing data y. This is implemented using Bayes rule p(m y) = p(y m)p(m)

More information

Lecture 4: Heteroskedasticity

Lecture 4: Heteroskedasticity Lecture 4: Heteroskedasticity Econometric Methods Warsaw School of Economics (4) Heteroskedasticity 1 / 24 Outline 1 What is heteroskedasticity? 2 Testing for heteroskedasticity White Goldfeld-Quandt Breusch-Pagan

More information

Model Comparison. Course on Bayesian Inference, WTCN, UCL, February Model Comparison. Bayes rule for models. Linear Models. AIC and BIC.

Model Comparison. Course on Bayesian Inference, WTCN, UCL, February Model Comparison. Bayes rule for models. Linear Models. AIC and BIC. Course on Bayesian Inference, WTCN, UCL, February 2013 A prior distribution over model space p(m) (or hypothesis space ) can be updated to a posterior distribution after observing data y. This is implemented

More information

ROI ANALYSIS OF PHARMAFMRI DATA:

ROI ANALYSIS OF PHARMAFMRI DATA: ROI ANALYSIS OF PHARMAFMRI DATA: AN ADAPTIVE APPROACH FOR GLOBAL TESTING Giorgos Minas, John A.D. Aston, Thomas E. Nichols and Nigel Stallard Department of Statistics and Warwick Centre of Analytical Sciences,

More information

The Role of "Leads" in the Dynamic Title of Cointegrating Regression Models. Author(s) Hayakawa, Kazuhiko; Kurozumi, Eiji

The Role of Leads in the Dynamic Title of Cointegrating Regression Models. Author(s) Hayakawa, Kazuhiko; Kurozumi, Eiji he Role of "Leads" in the Dynamic itle of Cointegrating Regression Models Author(s) Hayakawa, Kazuhiko; Kurozumi, Eiji Citation Issue 2006-12 Date ype echnical Report ext Version publisher URL http://hdl.handle.net/10086/13599

More information

An Implementation of Dynamic Causal Modelling

An Implementation of Dynamic Causal Modelling An Implementation of Dynamic Causal Modelling Christian Himpe 24.01.2011 Overview Contents: 1 Intro 2 Model 3 Parameter Estimation 4 Examples Motivation Motivation: How are brain regions coupled? Motivation

More information