Dynamic Causal Modelling for EEG/MEG: principles J. Daunizeau

Size: px
Start display at page:

Download "Dynamic Causal Modelling for EEG/MEG: principles J. Daunizeau"

Transcription

1 Dynamic Causal Modelling for EEG/MEG: principles J. Daunizeau Motivation, Brain and Behaviour group, ICM, Paris, France

2 Overview 1 DCM: introduction 2 Dynamical systems theory 3 Neural states dynamics 4 Bayesian inference 5 Conclusion

3 Overview 1 DCM: introduction 2 Dynamical systems theory 3 Neural states dynamics 4 Bayesian inference 5 Conclusion

4 Introduction structural, functional and effective connectivity structural connectivity functional connectivity effective connectivity structural connectivity = presence of axonal connections functional connectivity = statistical dependencies between regional time series effective connectivity = causal (directed) influences between neuronal populations! connections are recruited in a context-dependent fashion O. Sporns 2007, Scholarpedia

5 Introduction from functional segregation to functional integration localizing brain activity: functional segregation effective connectivity analysis: functional integration A B? A B u 1 u 2 u 1 u 2 u 1 u 1 X u 2 «Where, in the brain, did my experimental manipulation have an effect?» «How did my experimental manipulation propagate through the network?»

6 Introduction DCM: evolution and observation mappings Hemodynamic observation model: temporal convolution Electromagnetic observation model: spatial convolution fmri neural states dynamics x f ( x, u, ) EEG/MEG simple neuronal model realistic observation model realistic neuronal model simple observation model inputs

7 Introduction DCM: a parametric statistical approach DCM: model structure y g x, x f x, u, likelihood p y,, m u DCM: Bayesian inference parameter estimate: model evidence: ˆ E y, m priors on parameters,, p y m p y m p m p m dd

8 Introduction DCM for EEG-MEG: auditory mismatch negativity sequence of auditory stimuli S S S D S S S S D S standard condition (S) S-D: reorganisation of the connectivity structure rifg deviant condition (D) la1 lstg rifg ra1 rstg lstg rstg la1 ra1 t ~ 200 ms Daunizeau, Kiebel et al., Neuroimage, 2009

9 Introduction DCM for fmri: audio-visual associative learning auditory cue or visual outcome or P(outcome cue) response time (ms) Put PMd PPA FFA FFA PPA Put PMd cue-dependent surprise cue-independent surprise Den Ouden, Daunizeau et al., J. Neurosci., 2010

10 Overview 1 DCM: introduction 2 Dynamical systems theory 3 Neural states dynamics 4 Bayesian inference 5 Conclusion

11 Dynamical systems theory motivation u x y time 13 3 u u 13 3 u 32 t 3 t t t x t 0 t 0 t t?

12 Dynamical systems theory exponentials

13 Dynamical systems theory initial values and fixed points

14 Dynamical systems theory time constants

15 Dynamical systems theory matrix exponential

16 Dynamical systems theory eigendecomposition of the Jacobian

17 Dynamical systems theory dynamical modes

18 Dynamical systems theory spirals

19 Dynamical systems theory spirals

20 Dynamical systems theory spiral state-space

21 Dynamical systems theory embedding

22 Dynamical systems theory kernels and convolution

23 Dynamical systems theory summary Motivation: modelling reciprocal influences Link between the integral (convolution) and differential (ODE) forms System stability and dynamical modes can be derived from the system s Jacobian: o D>0: fixed points o D>1: spirals o D>1: limit cycles (e.g., action potentials) o D>2: metastability (e.g., winnerless competition) limit cycle (Vand Der Pol) strange attractor (Lorenz)

24 Overview 1 DCM: introduction 2 Dynamical systems theory 3 Neural states dynamics 4 Bayesian inference 5 Conclusion

25 Neural ensembles dynamics DCM for M/EEG: systems of neural populations macro-scale meso-scale micro-scale Golgi Nissl EI external granular layer external pyramidal layer EP II internal granular layer internal pyramidal layer mean-field firing rate synaptic dynamics

26 Neural ensembles dynamics DCM for M/EEG: from micro- to meso-scale mean firing rate (Hz) xj t : post-synaptic potential of j th neuron within its ensemble 1 N 1 j' j N H x j ' t H xt p xtdx S mean-field firing rate ensemble density p(x) S(x) S(x) H(x) membrane depolarization (mv) mean membrane depolarization (mv)

27 Neural ensembles dynamics DCM for M/EEG: synaptic dynamics membrane depolarization (mv) post-synaptic potential EPSP IPSP i/ e S( ) 2 i/ e 2 i/ e 1 1 K i 1 K e time (ms)

28 Neural ensembles dynamics DCM for M/EEG: intrinsic connections within the cortical column Golgi Nissl 7 8 S( ) e 0 e 8 e 7 external granular layer external pyramidal layer internal granular layer internal pyramidal layer inhibitory interneurons spiny stellate cells pyramidal cells S( ) e 0 e 4 e 1 intrinsic 1 2 connections S( ) e 1 e 5 e 2 x 3 6 S( ) i 7 i 6 i 3 3

29 Neural ensembles dynamics DCM for M/EEG: from meso- to macro-scale lateral (homogeneous) density of connexions i t r, t ( i) ( ) r 1 r 2 local wave propagation equation (neural field): t ( i) ( ) 2 c, t c, t t 2 S i r r ( i) ( i') ii' i' 0 th -order approximation: standing wave

30 Neural ensembles dynamics DCM for M/EEG: extrinsic connections between brain regions 7 8 (( IS ) ( )) e B L 3 0 e 8 e 7 extrinsic lateral connections S( ) L 0 inhibitory interneurons spiny stellate cells extrinsic forward connections S( ) F (( I) S( ) u) e F L 1 0 u e 4 e pyramidal cells (( ) S( ) S( )) e B L e 5 e 2 x 3 6 S( ) i 4 7 i 6 i 3 extrinsic backward connections S( ) B 0

31 Overview 1 DCM: introduction 2 Dynamical systems theory 3 Neural states dynamics 4 Bayesian inference 5 Conclusion

32 Bayesian inference forward and inverse problems forward problem p y, m likelihood posterior distribution p y, m inverse problem

33 Bayesian inference the electromagnetic forward problem y ( i) ( i) ( ij) t L w t t i 0 j j

34 Bayesian paradigm deriving the likelihood function - Model of data with unknown parameters: y f e.g., GLM: f X - But data is noisy: y f - Assume noise/residuals is small : f exp p P Distribution of data, given fixed parameters: p y y f exp 2

35 Bayesian paradigm likelihood, priors and the model evidence Likelihood: Prior: generative model m Bayes rule:

36 y=f(x) y = f(x) Bayesian inference model comparison Principle of parsimony : «plurality should not be assumed without necessity» Model evidence:, p y m p y m p m d Occam s razor : x model evidence p(y m) space of all data sets

37 Bayesian inference the variational Bayesian approach KL ln p y m ln p, y m S q D q ; p y, m free energy : functional of q q mean-field: approximate marginal posterior distributions: q, q p p, y, m or 2, q 1 or 2 y m

38 Bayesian inference DCM: key model parameters u u 13 3 u 21, 32, 13 state-state coupling u 3 input-state coupling u 13 input-dependent modulatory effect

39 differences in log- model evidences Bayesian inference model comparison for group studies ln 1 ln p y m2 p y m m 1 m 2 subjects fixed effect assume all subjects correspond to the same model random effect assume different subjects might correspond to different models

40 Overview 1 DCM: introduction 2 Dynamical systems theory 3 Neural states dynamics 4 Bayesian inference 5 Conclusion

41 Conclusion back to the auditory mismatch negativity sequence of auditory stimuli S S S D S S S S D S standard condition (S) S-D: reorganisation of the connectivity structure rifg deviant condition (D) la1 lstg rifg ra1 rstg lstg rstg la1 ra1 t ~ 200 ms

42 Conclusion DCM for EEG/MEG: variants input depolarization st and 2d order moments second-order mean-field DCM time (ms) time (ms) time (ms) auto-spectral density LA auto-spectral density CA1 cross-spectral density CA1-LA DCM for steady-state responses frequency (Hz) frequency (Hz) frequency (Hz) DCM for induced responses DCM for phase coupling

43 Conclusion planning a compatible DCM study Suitable experimental design: any design that is suitable for a GLM preferably multi-factorial (e.g. 2 x 2) e.g. one factor that varies the driving (sensory) input and one factor that varies the modulatory input Hypothesis and model: define specific a priori hypothesis which models are relevant to test this hypothesis? check existence of effect on data features of interest there exists formal methods for optimizing the experimental design for the ensuing bayesian model comparison [Daunizeau et al., PLoS Comp. Biol., 2011]

44 Many thanks to: Karl J. Friston (UCL, London, UK) Will D. Penny (UCL, London, UK) Klaas E. Stephan (UZH, Zurich, Switzerland) Stefan Kiebel (MPI, Leipzig, Germany)

Dynamic Causal Modelling for evoked responses J. Daunizeau

Dynamic Causal Modelling for evoked responses J. Daunizeau Dynamic Causal Modelling for evoked responses J. Daunizeau Institute for Empirical Research in Economics, Zurich, Switzerland Brain and Spine Institute, Paris, France Overview 1 DCM: introduction 2 Neural

More information

Dynamic Causal Modelling for EEG and MEG. Stefan Kiebel

Dynamic Causal Modelling for EEG and MEG. Stefan Kiebel Dynamic Causal Modelling for EEG and MEG Stefan Kiebel Overview 1 M/EEG analysis 2 Dynamic Causal Modelling Motivation 3 Dynamic Causal Modelling Generative model 4 Bayesian inference 5 Applications Overview

More information

Dynamic Causal Modelling for EEG and MEG

Dynamic Causal Modelling for EEG and MEG Dynamic Causal Modelling for EEG and MEG Stefan Kiebel Ma Planck Institute for Human Cognitive and Brain Sciences Leipzig, Germany Overview 1 M/EEG analysis 2 Dynamic Causal Modelling Motivation 3 Dynamic

More information

Bayesian inference J. Daunizeau

Bayesian inference J. Daunizeau Bayesian inference J. Daunizeau Brain and Spine Institute, Paris, France Wellcome Trust Centre for Neuroimaging, London, UK Overview of the talk 1 Probabilistic modelling and representation of uncertainty

More information

An introduction to Bayesian inference and model comparison J. Daunizeau

An introduction to Bayesian inference and model comparison J. Daunizeau An introduction to Bayesian inference and model comparison J. Daunizeau ICM, Paris, France TNU, Zurich, Switzerland Overview of the talk An introduction to probabilistic modelling Bayesian model comparison

More information

Bayesian inference J. Daunizeau

Bayesian inference J. Daunizeau Bayesian inference J. Daunizeau Brain and Spine Institute, Paris, France Wellcome Trust Centre for Neuroimaging, London, UK Overview of the talk 1 Probabilistic modelling and representation of uncertainty

More information

Effective Connectivity & Dynamic Causal Modelling

Effective Connectivity & Dynamic Causal Modelling Effective Connectivity & Dynamic Causal Modelling Hanneke den Ouden Donders Centre for Cognitive Neuroimaging Radboud University Nijmegen Advanced SPM course Zurich, Februari 13-14, 2014 Functional Specialisation

More information

Anatomical Background of Dynamic Causal Modeling and Effective Connectivity Analyses

Anatomical Background of Dynamic Causal Modeling and Effective Connectivity Analyses Anatomical Background of Dynamic Causal Modeling and Effective Connectivity Analyses Jakob Heinzle Translational Neuromodeling Unit (TNU), Institute for Biomedical Engineering University and ETH Zürich

More information

Will Penny. 21st April The Macroscopic Brain. Will Penny. Cortical Unit. Spectral Responses. Macroscopic Models. Steady-State Responses

Will Penny. 21st April The Macroscopic Brain. Will Penny. Cortical Unit. Spectral Responses. Macroscopic Models. Steady-State Responses The The 21st April 2011 Jansen and Rit (1995), building on the work of Lopes Da Sliva and others, developed a biologically inspired model of EEG activity. It was originally developed to explain alpha activity

More information

Dynamic Modeling of Brain Activity

Dynamic Modeling of Brain Activity 0a Dynamic Modeling of Brain Activity EIN IIN PC Thomas R. Knösche, Leipzig Generative Models for M/EEG 4a Generative Models for M/EEG states x (e.g. dipole strengths) parameters parameters (source positions,

More information

Dynamic Causal Modelling for fmri

Dynamic Causal Modelling for fmri Dynamic Causal Modelling for fmri André Marreiros Friday 22 nd Oct. 2 SPM fmri course Wellcome Trust Centre for Neuroimaging London Overview Brain connectivity: types & definitions Anatomical connectivity

More information

Principles of DCM. Will Penny. 26th May Principles of DCM. Will Penny. Introduction. Differential Equations. Bayesian Estimation.

Principles of DCM. Will Penny. 26th May Principles of DCM. Will Penny. Introduction. Differential Equations. Bayesian Estimation. 26th May 2011 Dynamic Causal Modelling Dynamic Causal Modelling is a framework studying large scale brain connectivity by fitting differential equation models to brain imaging data. DCMs differ in their

More information

Dynamic causal modeling for fmri

Dynamic causal modeling for fmri Dynamic causal modeling for fmri Methods and Models for fmri, HS 2015 Jakob Heinzle Structural, functional & effective connectivity Sporns 2007, Scholarpedia anatomical/structural connectivity - presence

More information

Dynamic Causal Models

Dynamic Causal Models Dynamic Causal Models V1 SPC Will Penny V1 SPC V5 V5 Olivier David, Karl Friston, Lee Harrison, Andrea Mechelli, Klaas Stephan Wellcome Department of Imaging Neuroscience, ION, UCL, UK. Mathematics in

More information

Bayesian inference. Justin Chumbley ETH and UZH. (Thanks to Jean Denizeau for slides)

Bayesian inference. Justin Chumbley ETH and UZH. (Thanks to Jean Denizeau for slides) Bayesian inference Justin Chumbley ETH and UZH (Thanks to Jean Denizeau for slides) Overview of the talk Introduction: Bayesian inference Bayesian model comparison Group-level Bayesian model selection

More information

An Implementation of Dynamic Causal Modelling

An Implementation of Dynamic Causal Modelling An Implementation of Dynamic Causal Modelling Christian Himpe 24.01.2011 Overview Contents: 1 Intro 2 Model 3 Parameter Estimation 4 Examples Motivation Motivation: How are brain regions coupled? Motivation

More information

M/EEG source analysis

M/EEG source analysis Jérémie Mattout Lyon Neuroscience Research Center Will it ever happen that mathematicians will know enough about the physiology of the brain, and neurophysiologists enough of mathematical discovery, for

More information

Causal modeling of fmri: temporal precedence and spatial exploration

Causal modeling of fmri: temporal precedence and spatial exploration Causal modeling of fmri: temporal precedence and spatial exploration Alard Roebroeck Maastricht Brain Imaging Center (MBIC) Faculty of Psychology & Neuroscience Maastricht University Intro: What is Brain

More information

Dynamic causal modeling for fmri

Dynamic causal modeling for fmri Dynamic causal modeling for fmri Methods and Models for fmri, HS 2016 Jakob Heinzle Structural, functional & effective connectivity Sporns 2007, Scholarpedia anatomical/structural connectivity - presence

More information

Stochastic Dynamic Causal Modelling for resting-state fmri

Stochastic Dynamic Causal Modelling for resting-state fmri Stochastic Dynamic Causal Modelling for resting-state fmri Ged Ridgway, FIL, Wellcome Trust Centre for Neuroimaging, UCL Institute of Neurology, London Overview Connectivity in the brain Introduction to

More information

DCM: Advanced topics. Klaas Enno Stephan. SPM Course Zurich 06 February 2015

DCM: Advanced topics. Klaas Enno Stephan. SPM Course Zurich 06 February 2015 DCM: Advanced topics Klaas Enno Stephan SPM Course Zurich 06 February 205 Overview DCM a generative model Evolution of DCM for fmri Bayesian model selection (BMS) Translational Neuromodeling Generative

More information

Bayesian Inference. Chris Mathys Wellcome Trust Centre for Neuroimaging UCL. London SPM Course

Bayesian Inference. Chris Mathys Wellcome Trust Centre for Neuroimaging UCL. London SPM Course Bayesian Inference Chris Mathys Wellcome Trust Centre for Neuroimaging UCL London SPM Course Thanks to Jean Daunizeau and Jérémie Mattout for previous versions of this talk A spectacular piece of information

More information

Will Penny. SPM short course for M/EEG, London 2015

Will Penny. SPM short course for M/EEG, London 2015 SPM short course for M/EEG, London 2015 Ten Simple Rules Stephan et al. Neuroimage, 2010 Model Structure The model evidence is given by integrating out the dependence on model parameters p(y m) = p(y,

More information

Dynamic Causal Modelling : Advanced Topics

Dynamic Causal Modelling : Advanced Topics Dynamic Causal Modelling : Advanced Topics Rosalyn Moran Virginia Tech Carilion Research Institute Department of Electrical & Computer Engineering, Virginia Tech Zurich SPM Course, Feb 19 th 2016 Overview

More information

Experimental design of fmri studies

Experimental design of fmri studies Experimental design of fmri studies Zurich SPM Course 2016 Sandra Iglesias Translational Neuromodeling Unit (TNU) Institute for Biomedical Engineering (IBT) University and ETH Zürich With many thanks for

More information

Experimental design of fmri studies

Experimental design of fmri studies Experimental design of fmri studies Sandra Iglesias With many thanks for slides & images to: Klaas Enno Stephan, FIL Methods group, Christian Ruff SPM Course 2015 Overview of SPM Image time-series Kernel

More information

A prior distribution over model space p(m) (or hypothesis space ) can be updated to a posterior distribution after observing data y.

A prior distribution over model space p(m) (or hypothesis space ) can be updated to a posterior distribution after observing data y. June 2nd 2011 A prior distribution over model space p(m) (or hypothesis space ) can be updated to a posterior distribution after observing data y. This is implemented using Bayes rule p(m y) = p(y m)p(m)

More information

ATTRACTORS IN SONG. KARL FRISTON and STEFAN KIEBEL

ATTRACTORS IN SONG. KARL FRISTON and STEFAN KIEBEL Attractors in song: 1 New Mathematics and Natural Computation Vol. 5, No. 1 (9) 1-3 World Scientific Publishing Company ATTRACTORS IN SONG KARL FRISTON and STEFAN KIEBEL The Wellcome Trust Centre of Neuroimaging

More information

Will Penny. SPM short course for M/EEG, London 2013

Will Penny. SPM short course for M/EEG, London 2013 SPM short course for M/EEG, London 2013 Ten Simple Rules Stephan et al. Neuroimage, 2010 Model Structure Bayes rule for models A prior distribution over model space p(m) (or hypothesis space ) can be updated

More information

Wellcome Trust Centre for Neuroimaging, UCL, UK.

Wellcome Trust Centre for Neuroimaging, UCL, UK. Bayesian Inference Will Penny Wellcome Trust Centre for Neuroimaging, UCL, UK. SPM Course, Virginia Tech, January 2012 What is Bayesian Inference? (From Daniel Wolpert) Bayesian segmentation and normalisation

More information

Experimental design of fmri studies & Resting-State fmri

Experimental design of fmri studies & Resting-State fmri Methods & Models for fmri Analysis 2016 Experimental design of fmri studies & Resting-State fmri Sandra Iglesias With many thanks for slides & images to: Klaas Enno Stephan, FIL Methods group, Christian

More information

Bayesian Inference Course, WTCN, UCL, March 2013

Bayesian Inference Course, WTCN, UCL, March 2013 Bayesian Course, WTCN, UCL, March 2013 Shannon (1948) asked how much information is received when we observe a specific value of the variable x? If an unlikely event occurs then one would expect the information

More information

Empirical Bayes for DCM: A Group Inversion Scheme

Empirical Bayes for DCM: A Group Inversion Scheme METHODS published: 27 November 2015 doi: 10.3389/fnsys.2015.00164 : A Group Inversion Scheme Karl Friston*, Peter Zeidman and Vladimir Litvak The Wellcome Trust Centre for Neuroimaging, University College

More information

MIXED EFFECTS MODELS FOR TIME SERIES

MIXED EFFECTS MODELS FOR TIME SERIES Outline MIXED EFFECTS MODELS FOR TIME SERIES Cristina Gorrostieta Hakmook Kang Hernando Ombao Brown University Biostatistics Section February 16, 2011 Outline OUTLINE OF TALK 1 SCIENTIFIC MOTIVATION 2

More information

Experimental design of fmri studies

Experimental design of fmri studies Methods & Models for fmri Analysis 2017 Experimental design of fmri studies Sara Tomiello With many thanks for slides & images to: Sandra Iglesias, Klaas Enno Stephan, FIL Methods group, Christian Ruff

More information

Models of effective connectivity & Dynamic Causal Modelling (DCM)

Models of effective connectivity & Dynamic Causal Modelling (DCM) Models of effective connectivit & Dnamic Causal Modelling (DCM Presented b: Ariana Anderson Slides shared b: Karl Friston Functional Imaging Laborator (FIL Wellcome Trust Centre for Neuroimaging Universit

More information

New Machine Learning Methods for Neuroimaging

New Machine Learning Methods for Neuroimaging New Machine Learning Methods for Neuroimaging Gatsby Computational Neuroscience Unit University College London, UK Dept of Computer Science University of Helsinki, Finland Outline Resting-state networks

More information

The General Linear Model (GLM)

The General Linear Model (GLM) he General Linear Model (GLM) Klaas Enno Stephan ranslational Neuromodeling Unit (NU) Institute for Biomedical Engineering University of Zurich & EH Zurich Wellcome rust Centre for Neuroimaging Institute

More information

Group Analysis. Lexicon. Hierarchical models Mixed effect models Random effect (RFX) models Components of variance

Group Analysis. Lexicon. Hierarchical models Mixed effect models Random effect (RFX) models Components of variance Group Analysis J. Daunizeau Institute of Empirical Research in Economics, Zurich, Switzerland Brain and Spine Institute, Paris, France SPM Course Edinburgh, April 2011 Image time-series Spatial filter

More information

NeuroImage 51 (2010) Contents lists available at ScienceDirect. NeuroImage. journal homepage:

NeuroImage 51 (2010) Contents lists available at ScienceDirect. NeuroImage. journal homepage: NeuroImage 51 (010) 91 101 Contents lists available at ScienceDirect NeuroImage ournal homepage: www.elsevier.com/locate/ynimg Technical Note A dynamic causal model study of neuronal population dynamics

More information

Dynamic causal models of neural system dynamics:current state and future extensions.

Dynamic causal models of neural system dynamics:current state and future extensions. Dynamic causal models of neural system dynamics:current state and future extensions. Klaas Stephan, Lee Harrison, Stefan Kiebel, Olivier David, Will Penny, Karl Friston To cite this version: Klaas Stephan,

More information

The connected brain: Causality, models and intrinsic dynamics

The connected brain: Causality, models and intrinsic dynamics The connected brain: Causality, models and intrinsic dynamics Adeel Razi + and Karl J. Friston The Wellcome Trust Centre for Neuroimaging, University College London, 12 Queen Square, London WC1N 3BG. +

More information

Experimental design of fmri studies

Experimental design of fmri studies Experimental design of fmri studies Sandra Iglesias Translational Neuromodeling Unit University of Zurich & ETH Zurich With many thanks for slides & images to: Klaas Enno Stephan, FIL Methods group, Christian

More information

Annealed Importance Sampling for Neural Mass Models

Annealed Importance Sampling for Neural Mass Models for Neural Mass Models, UCL. WTCN, UCL, October 2015. Generative Model Behavioural or imaging data y. Likelihood p(y w, Γ). We have a Gaussian prior over model parameters p(w µ, Λ) = N (w; µ, Λ) Assume

More information

Models of effective connectivity & Dynamic Causal Modelling (DCM)

Models of effective connectivity & Dynamic Causal Modelling (DCM) Models of effective connectivit & Dnamic Causal Modelling (DCM) Slides obtained from: Karl Friston Functional Imaging Laborator (FIL) Wellcome Trust Centre for Neuroimaging Universit College London Klaas

More information

The General Linear Model (GLM)

The General Linear Model (GLM) The General Linear Model (GLM) Dr. Frederike Petzschner Translational Neuromodeling Unit (TNU) Institute for Biomedical Engineering, University of Zurich & ETH Zurich With many thanks for slides & images

More information

Tuning tuning curves. So far: Receptive fields Representation of stimuli Population vectors. Today: Contrast enhancment, cortical processing

Tuning tuning curves. So far: Receptive fields Representation of stimuli Population vectors. Today: Contrast enhancment, cortical processing Tuning tuning curves So far: Receptive fields Representation of stimuli Population vectors Today: Contrast enhancment, cortical processing Firing frequency N 3 s max (N 1 ) = 40 o N4 N 1 N N 5 2 s max

More information

Bayesian probability theory and generative models

Bayesian probability theory and generative models Bayesian probability theory and generative models Bruno A. Olshausen November 8, 2006 Abstract Bayesian probability theory provides a mathematical framework for peforming inference, or reasoning, using

More information

Part 2: Multivariate fmri analysis using a sparsifying spatio-temporal prior

Part 2: Multivariate fmri analysis using a sparsifying spatio-temporal prior Chalmers Machine Learning Summer School Approximate message passing and biomedicine Part 2: Multivariate fmri analysis using a sparsifying spatio-temporal prior Tom Heskes joint work with Marcel van Gerven

More information

Bayesian Treatments of. Neuroimaging Data Will Penny and Karl Friston. 5.1 Introduction

Bayesian Treatments of. Neuroimaging Data Will Penny and Karl Friston. 5.1 Introduction Bayesian Treatments of 5 Neuroimaging Data Will Penny and Karl Friston 5.1 Introduction In this chapter we discuss the application of Bayesian methods to neuroimaging data. This includes data from positron

More information

Hierarchy. Will Penny. 24th March Hierarchy. Will Penny. Linear Models. Convergence. Nonlinear Models. References

Hierarchy. Will Penny. 24th March Hierarchy. Will Penny. Linear Models. Convergence. Nonlinear Models. References 24th March 2011 Update Hierarchical Model Rao and Ballard (1999) presented a hierarchical model of visual cortex to show how classical and extra-classical Receptive Field (RF) effects could be explained

More information

Comparing Families of Dynamic Causal Models

Comparing Families of Dynamic Causal Models Comparing Families of Dynamic Causal Models Will D. Penny 1 *, Klaas E. Stephan 1,2, Jean Daunizeau 1, Maria J. Rosa 1, Karl J. Friston 1, Thomas M. Schofield 1, Alex P. Leff 1 1 Wellcome Trust Centre

More information

Bayesian Hidden Markov Models and Extensions

Bayesian Hidden Markov Models and Extensions Bayesian Hidden Markov Models and Extensions Zoubin Ghahramani Department of Engineering University of Cambridge joint work with Matt Beal, Jurgen van Gael, Yunus Saatci, Tom Stepleton, Yee Whye Teh Modeling

More information

EEG/MEG Inverse Solution Driven by fmri

EEG/MEG Inverse Solution Driven by fmri EEG/MEG Inverse Solution Driven by fmri Yaroslav Halchenko CS @ NJIT 1 Functional Brain Imaging EEG ElectroEncephaloGram MEG MagnetoEncephaloGram fmri Functional Magnetic Resonance Imaging others 2 Functional

More information

Network Modeling and Functional Data Methods for Brain Functional Connectivity Studies. Kehui Chen

Network Modeling and Functional Data Methods for Brain Functional Connectivity Studies. Kehui Chen Network Modeling and Functional Data Methods for Brain Functional Connectivity Studies Kehui Chen Department of Statistics, University of Pittsburgh Nonparametric Statistics Workshop, Ann Arbor, Oct 06,

More information

Group analysis. Jean Daunizeau Wellcome Trust Centre for Neuroimaging University College London. SPM Course Edinburgh, April 2010

Group analysis. Jean Daunizeau Wellcome Trust Centre for Neuroimaging University College London. SPM Course Edinburgh, April 2010 Group analysis Jean Daunizeau Wellcome Trust Centre for Neuroimaging University College London SPM Course Edinburgh, April 2010 Image time-series Spatial filter Design matrix Statistical Parametric Map

More information

Will Penny. DCM short course, Paris 2012

Will Penny. DCM short course, Paris 2012 DCM short course, Paris 2012 Ten Simple Rules Stephan et al. Neuroimage, 2010 Model Structure Bayes rule for models A prior distribution over model space p(m) (or hypothesis space ) can be updated to a

More information

Model Comparison. Course on Bayesian Inference, WTCN, UCL, February Model Comparison. Bayes rule for models. Linear Models. AIC and BIC.

Model Comparison. Course on Bayesian Inference, WTCN, UCL, February Model Comparison. Bayes rule for models. Linear Models. AIC and BIC. Course on Bayesian Inference, WTCN, UCL, February 2013 A prior distribution over model space p(m) (or hypothesis space ) can be updated to a posterior distribution after observing data y. This is implemented

More information

Sampling-based probabilistic inference through neural and synaptic dynamics

Sampling-based probabilistic inference through neural and synaptic dynamics Sampling-based probabilistic inference through neural and synaptic dynamics Wolfgang Maass for Robert Legenstein Institute for Theoretical Computer Science Graz University of Technology, Austria Institute

More information

Uncertainty, precision, prediction errors and their relevance to computational psychiatry

Uncertainty, precision, prediction errors and their relevance to computational psychiatry Uncertainty, precision, prediction errors and their relevance to computational psychiatry Christoph Mathys Wellcome Trust Centre for Neuroimaging at UCL, London, UK Max Planck UCL Centre for Computational

More information

Overview of SPM. Overview. Making the group inferences we want. Non-sphericity Beyond Ordinary Least Squares. Model estimation A word on power

Overview of SPM. Overview. Making the group inferences we want. Non-sphericity Beyond Ordinary Least Squares. Model estimation A word on power Group Inference, Non-sphericity & Covariance Components in SPM Alexa Morcom Edinburgh SPM course, April 011 Centre for Cognitive & Neural Systems/ Department of Psychology University of Edinburgh Overview

More information

Semi-analytical approximations to statistical moments. of sigmoid and softmax mappings of normal variables

Semi-analytical approximations to statistical moments. of sigmoid and softmax mappings of normal variables Semi-analytical approximations to statistical moments of sigmoid and softmax mappings of normal variables J. Daunizeau, Brain and Spine Institute, Paris, France ETH, Zurich, France Address for correspondence:

More information

Active inference with function learning for robot body perception

Active inference with function learning for robot body perception Active inference with function learning for robot body perception Pablo Lanillos* and Gordon Cheng Insitute for Cognitive Systems Technical University of Munich Munich, Germany *p.lanillos@tum.de Index

More information

Human Brain Networks. Aivoaakkoset BECS-C3001"

Human Brain Networks. Aivoaakkoset BECS-C3001 Human Brain Networks Aivoaakkoset BECS-C3001" Enrico Glerean (MSc), Brain & Mind Lab, BECS, Aalto University" www.glerean.com @eglerean becs.aalto.fi/bml enrico.glerean@aalto.fi" Why?" 1. WHY BRAIN NETWORKS?"

More information

Dynamic causal models of neural system dynamics. current state and future extensions

Dynamic causal models of neural system dynamics. current state and future extensions Dynamic causal models of neural system dynamics: current state and future etensions Klaas E. Stephan 1, Lee M. Harrison 1, Stefan J. Kiebel 1, Olivier David, Will D. Penny 1 & Karl J. Friston 1 1 Wellcome

More information

DCM for fmri Advanced topics. Klaas Enno Stephan

DCM for fmri Advanced topics. Klaas Enno Stephan DCM for fmri Advanced topics Klaas Enno Stephan Overview DCM: basic concepts Evolution of DCM for fmri Bayesian model selection (BMS) Translational Neuromodeling Dynamic causal modeling (DCM) EEG, MEG

More information

Probabilistic Models in Theoretical Neuroscience

Probabilistic Models in Theoretical Neuroscience Probabilistic Models in Theoretical Neuroscience visible unit Boltzmann machine semi-restricted Boltzmann machine restricted Boltzmann machine hidden unit Neural models of probabilistic sampling: introduction

More information

Consider the following spike trains from two different neurons N1 and N2:

Consider the following spike trains from two different neurons N1 and N2: About synchrony and oscillations So far, our discussions have assumed that we are either observing a single neuron at a, or that neurons fire independent of each other. This assumption may be correct in

More information

Statistical inference for MEG

Statistical inference for MEG Statistical inference for MEG Vladimir Litvak Wellcome Trust Centre for Neuroimaging University College London, UK MEG-UK 2014 educational day Talk aims Show main ideas of common methods Explain some of

More information

GAUSSIAN PROCESS REGRESSION

GAUSSIAN PROCESS REGRESSION GAUSSIAN PROCESS REGRESSION CSE 515T Spring 2015 1. BACKGROUND The kernel trick again... The Kernel Trick Consider again the linear regression model: y(x) = φ(x) w + ε, with prior p(w) = N (w; 0, Σ). The

More information

An Introductory Course in Computational Neuroscience

An Introductory Course in Computational Neuroscience An Introductory Course in Computational Neuroscience Contents Series Foreword Acknowledgments Preface 1 Preliminary Material 1.1. Introduction 1.1.1 The Cell, the Circuit, and the Brain 1.1.2 Physics of

More information

Activity types in a neural mass model

Activity types in a neural mass model Master thesis Activity types in a neural mass model Jurgen Hebbink September 19, 214 Exam committee: Prof. Dr. S.A. van Gils (UT) Dr. H.G.E. Meijer (UT) Dr. G.J.M. Huiskamp (UMC Utrecht) Contents 1 Introduction

More information

Subthreshold cross-correlations between cortical neurons: Areference model with static synapses

Subthreshold cross-correlations between cortical neurons: Areference model with static synapses Neurocomputing 65 66 (25) 685 69 www.elsevier.com/locate/neucom Subthreshold cross-correlations between cortical neurons: Areference model with static synapses Ofer Melamed a,b, Gilad Silberberg b, Henry

More information

Recently, there have been several concerted international. The Connected Brain. Causality, models, and intrinsic dynamics

Recently, there have been several concerted international. The Connected Brain. Causality, models, and intrinsic dynamics The Connected Brain image licensed by ingram publishing Causality, models, and intrinsic dynamics Adeel Razi and Karl J Friston Digital Object Identifier 1119/MSP2152482121 Date of publication: 27 April

More information

Modelling temporal structure (in noise and signal)

Modelling temporal structure (in noise and signal) Modelling temporal structure (in noise and signal) Mark Woolrich, Christian Beckmann*, Salima Makni & Steve Smith FMRIB, Oxford *Imperial/FMRIB temporal noise: modelling temporal autocorrelation temporal

More information

The Planning-by-Inference view on decision making and goal-directed behaviour

The Planning-by-Inference view on decision making and goal-directed behaviour The Planning-by-Inference view on decision making and goal-directed behaviour Marc Toussaint Machine Learning & Robotics Lab FU Berlin marc.toussaint@fu-berlin.de Nov. 14, 2011 1/20 pigeons 2/20 pigeons

More information

The General Linear Model. Guillaume Flandin Wellcome Trust Centre for Neuroimaging University College London

The General Linear Model. Guillaume Flandin Wellcome Trust Centre for Neuroimaging University College London The General Linear Model Guillaume Flandin Wellcome Trust Centre for Neuroimaging University College London SPM Course Lausanne, April 2012 Image time-series Spatial filter Design matrix Statistical Parametric

More information

Neural Networks 1 Synchronization in Spiking Neural Networks

Neural Networks 1 Synchronization in Spiking Neural Networks CS 790R Seminar Modeling & Simulation Neural Networks 1 Synchronization in Spiking Neural Networks René Doursat Department of Computer Science & Engineering University of Nevada, Reno Spring 2006 Synchronization

More information

Chapter 35: Bayesian model selection and averaging

Chapter 35: Bayesian model selection and averaging Chapter 35: Bayesian model selection and averaging W.D. Penny, J.Mattout and N. Trujillo-Barreto May 10, 2006 Introduction In Chapter 11 we described how Bayesian inference can be applied to hierarchical

More information

Computational Explorations in Cognitive Neuroscience Chapter 2

Computational Explorations in Cognitive Neuroscience Chapter 2 Computational Explorations in Cognitive Neuroscience Chapter 2 2.4 The Electrophysiology of the Neuron Some basic principles of electricity are useful for understanding the function of neurons. This is

More information

The Spike Response Model: A Framework to Predict Neuronal Spike Trains

The Spike Response Model: A Framework to Predict Neuronal Spike Trains The Spike Response Model: A Framework to Predict Neuronal Spike Trains Renaud Jolivet, Timothy J. Lewis 2, and Wulfram Gerstner Laboratory of Computational Neuroscience, Swiss Federal Institute of Technology

More information

CSci 8980: Advanced Topics in Graphical Models Gaussian Processes

CSci 8980: Advanced Topics in Graphical Models Gaussian Processes CSci 8980: Advanced Topics in Graphical Models Gaussian Processes Instructor: Arindam Banerjee November 15, 2007 Gaussian Processes Outline Gaussian Processes Outline Parametric Bayesian Regression Gaussian

More information

Data Modeling & Analysis Techniques. Probability & Statistics. Manfred Huber

Data Modeling & Analysis Techniques. Probability & Statistics. Manfred Huber Data Modeling & Analysis Techniques Probability & Statistics Manfred Huber 2017 1 Probability and Statistics Probability and statistics are often used interchangeably but are different, related fields

More information

GP CaKe: Effective brain connectivity with causal kernels

GP CaKe: Effective brain connectivity with causal kernels GP CaKe: Effective brain connectivity with causal kernels Luca Ambrogioni adboud University l.ambrogioni@donders.ru.nl Marcel A. J. van Gerven adboud University m.vangerven@donders.ru.nl Max Hinne adboud

More information

Encoding or decoding

Encoding or decoding Encoding or decoding Decoding How well can we learn what the stimulus is by looking at the neural responses? We will discuss two approaches: devise and evaluate explicit algorithms for extracting a stimulus

More information

Expectation Propagation in Dynamical Systems

Expectation Propagation in Dynamical Systems Expectation Propagation in Dynamical Systems Marc Peter Deisenroth Joint Work with Shakir Mohamed (UBC) August 10, 2012 Marc Deisenroth (TU Darmstadt) EP in Dynamical Systems 1 Motivation Figure : Complex

More information

The Bayesian Brain. Robert Jacobs Department of Brain & Cognitive Sciences University of Rochester. May 11, 2017

The Bayesian Brain. Robert Jacobs Department of Brain & Cognitive Sciences University of Rochester. May 11, 2017 The Bayesian Brain Robert Jacobs Department of Brain & Cognitive Sciences University of Rochester May 11, 2017 Bayesian Brain How do neurons represent the states of the world? How do neurons represent

More information

COMP 551 Applied Machine Learning Lecture 19: Bayesian Inference

COMP 551 Applied Machine Learning Lecture 19: Bayesian Inference COMP 551 Applied Machine Learning Lecture 19: Bayesian Inference Associate Instructor: (herke.vanhoof@mcgill.ca) Class web page: www.cs.mcgill.ca/~jpineau/comp551 Unless otherwise noted, all material posted

More information

Biosciences in the 21st century

Biosciences in the 21st century Biosciences in the 21st century Lecture 1: Neurons, Synapses, and Signaling Dr. Michael Burger Outline: 1. Why neuroscience? 2. The neuron 3. Action potentials 4. Synapses 5. Organization of the nervous

More information

Inference Control and Driving of Natural Systems

Inference Control and Driving of Natural Systems Inference Control and Driving of Natural Systems MSci/MSc/MRes nick.jones@imperial.ac.uk The fields at play We will be drawing on ideas from Bayesian Cognitive Science (psychology and neuroscience), Biological

More information

Will Penny. SPM for MEG/EEG, 15th May 2012

Will Penny. SPM for MEG/EEG, 15th May 2012 SPM for MEG/EEG, 15th May 2012 A prior distribution over model space p(m) (or hypothesis space ) can be updated to a posterior distribution after observing data y. This is implemented using Bayes rule

More information

Nervous Tissue. Neurons Electrochemical Gradient Propagation & Transduction Neurotransmitters Temporal & Spatial Summation

Nervous Tissue. Neurons Electrochemical Gradient Propagation & Transduction Neurotransmitters Temporal & Spatial Summation Nervous Tissue Neurons Electrochemical Gradient Propagation & Transduction Neurotransmitters Temporal & Spatial Summation What is the function of nervous tissue? Maintain homeostasis & respond to stimuli

More information

First Technical Course, European Centre for Soft Computing, Mieres, Spain. 4th July 2011

First Technical Course, European Centre for Soft Computing, Mieres, Spain. 4th July 2011 First Technical Course, European Centre for Soft Computing, Mieres, Spain. 4th July 2011 Linear Given probabilities p(a), p(b), and the joint probability p(a, B), we can write the conditional probabilities

More information

A neural mass model of spectral responses in electrophysiology

A neural mass model of spectral responses in electrophysiology www.elsevier.com/locate/ynimg NeuroImage 37 (27) 76 72 A neural mass model of spectral responses in electrophysiology R.J. Moran, a,b, S.J. Kiebel, a K.E. Stephan, a R.B. Reilly, b J. Daunizeau, a and

More information

Identification of causal relations in neuroimaging data with latent confounders: An instrumental variable approach

Identification of causal relations in neuroimaging data with latent confounders: An instrumental variable approach Identification of causal relations in neuroimaging data with latent confounders: An instrumental variable approach Moritz Grosse-Wentrup 1, Dominik Janzing 1, Markus Siegel 2,3 and Bernhard Schölkopf 1

More information

Jean-Baptiste Poline

Jean-Baptiste Poline Edinburgh course Avril 2010 Linear Models Contrasts Variance components Jean-Baptiste Poline Neurospin, I2BM, CEA Saclay, France Credits: Will Penny, G. Flandin, SPM course authors Outline Part I: Linear

More information

Machine learning strategies for fmri analysis

Machine learning strategies for fmri analysis Machine learning strategies for fmri analysis DTU Informatics Technical University of Denmark Co-workers: Morten Mørup, Kristoffer Madsen, Peter Mondrup, Daniel Jacobsen, Stephen Strother,. OUTLINE Do

More information

Causal Time Series Analysis of functional Magnetic Resonance Imaging Data

Causal Time Series Analysis of functional Magnetic Resonance Imaging Data JMLR: Workshop and Conference Proceedings 12 (2011) 65 94 Causality in Time Series Causal Time Series Analysis of functional Magnetic Resonance Imaging Data Alard Roebroeck Faculty of Psychology & Neuroscience

More information

Linearization of F-I Curves by Adaptation

Linearization of F-I Curves by Adaptation LETTER Communicated by Laurence Abbott Linearization of F-I Curves by Adaptation Bard Ermentrout Department of Mathematics, University of Pittsburgh, Pittsburgh, PA 15260, U.S.A. We show that negative

More information

Contents. Introduction The General Linear Model. General Linear Linear Model Model. The General Linear Model, Part I. «Take home» message

Contents. Introduction The General Linear Model. General Linear Linear Model Model. The General Linear Model, Part I. «Take home» message DISCOS SPM course, CRC, Liège, 2009 Contents The General Linear Model, Part I Introduction The General Linear Model Data & model Design matrix Parameter estimates & interpretation Simple contrast «Take

More information