Dynamic Causal Modelling for evoked responses J. Daunizeau

Size: px
Start display at page:

Download "Dynamic Causal Modelling for evoked responses J. Daunizeau"

Transcription

1 Dynamic Causal Modelling for evoked responses J. Daunizeau Institute for Empirical Research in Economics, Zurich, Switzerland Brain and Spine Institute, Paris, France

2 Overview 1 DCM: introduction 2 Neural ensembles dynamics 3 Bayesian inference 4 Conclusion

3 Overview 1 DCM: introduction 2 Neural ensembles dynamics 3 Bayesian inference 4 Conclusion

4 DCM: introduction structural, functional and effective connectivity structural connectivity functional connectivity effective connectivity structural connectivity = presence of axonal connections functional connectivity = statistical dependencies between regional time series effective connectivity = causal (directed) influences between neuronal populations

5 DCM: introduction connections are recruited in a context-dependent fashion meta-analysis on single-word reading (Turkeltaub, 2002)

6 Introduction DCM for evoked responses: auditory mismatch negativity sequence of auditory stimuli S S S D S S S S D S standard condition (S) S-D: reorganisation of the connectivity structure rifg deviant condition (D) la1 lstg rifg ra1 rstg lstg rstg la1 ra1 t ~ 200 ms

7 Overview 1 DCM: introduction 2 Neural ensembles dynamics 3 Bayesian inference 4 Conclusion

8 Neural ensembles dynamics systems of neural populations macro-scale meso-scale micro-scale Golgi Nissl EI external granular layer external pyramidal layer EP II internal granular layer internal pyramidal layer mean-field firing rate synaptic dynamics

9 Neural ensembles dynamics from micro- to meso-scale: mean-field treatment mean firing rate (Hz) x j : post-synaptic potential of j th neuron within its ensemble 1 N 1 j' j N H x j ' H x p xdx p x dx S mean firing rate ensemble density p(x) S(x) H(x) membrane depolarization (mv) mean membrane depolarization (mv)

10 Neural ensembles dynamics synaptic dynamics membrane depolarization (mv) post-synaptic potential EPSP IPSP kernel PSP t S u t t i/ e Su 2 i/ e 2 i/ e 1 1 K i 1 K e time (ms)

11 Neural ensembles dynamics intrinsic connections within the cortical column Golgi Nissl 7 8 S( ) e 0 e 8 e 7 external granular layer external pyramidal layer internal granular layer internal pyramidal layer inhibitory interneurons spiny stellate cells pyramidal cells S( ) e 0 e 4 e 1 intrinsic 1 2 connections S( ) e 1 e 5 e 2 x 3 6 S( ) i 7 i 6 i 3 3

12 Neural ensembles dynamics from meso- to macro-scale: neural fields local (homogeneous) density of connexions r 1 r 2 local wave propagation equation: t ( i) ( ) 2 c, t c, t t 2 S i r r ( i) ( i') ii' i'

13 Neural ensembles dynamics extrinsic connections between brain regions 7 8 (( IS ) ( )) e B L 3 0 e 8 e 7 extrinsic lateral connections S( ) L 0 inhibitory interneurons spiny stellate cells extrinsic forward connections S( ) F (( I) S( ) u) e F L 1 0 u e 4 e pyramidal cells (( ) S( ) S( )) e B L e 5 e 2 x 3 6 S( ) i 4 7 i 6 i 3 extrinsic backward connections S( ) B 0

14 Neural ensembles dynamics systems of neural populations macro-scale meso-scale micro-scale Golgi Nissl EI external granular layer external pyramidal layer EP II internal granular layer internal pyramidal layer main DCM evolution parameters: - action potential firing threshold + ensemble PSP spread - synaptic time constants + axonal propagation delays - effective coupling strengths + modulatory effects

15 Neural ensembles dynamics the observation mapping main DCM observation parameters: - sources location/orientation (ECD) or spatial profile (distributed responses) - relative contribution of cortical layers to measured signal

16 Neural ensembles dynamics a note on causality u x y time 13 3 u u 13 3 u 32 t 3 t t t t 0 t x f x, u,

17 Overview 1 DCM: introduction 2 Neural ensembles dynamics 3 Bayesian inference 4 Conclusion

18 Bayesian inference forward and inverse problems forward problem p y, m likelihood posterior distribution p y, m inverse problem

19 Bayesian inference deriving the likelihood function - Model of data with unknown parameters: y g e.g., GLM: g X - But data is noisy: y g - Assume noise/residuals is small : g exp p P Distribution of data, given fixed parameters: p y y g exp 2

20 Bayesian inference likelihood and priors likelihood p y, m u prior p m generative model m posterior p y, m, p y m p y m p m

21 Bayesian inference zooming in the VB algorithm measured data specify generative forward model (with prior distributions of parameters) Variational Bayesian (VB) algorithm iterative procedure: 1. compute model response using current set of parameters 2. compare model response with data 3. improve parameters, if possible 1. posterior distributions of parameters 2. model evidence (free energy)

22 Frequentist versus Bayesian inference testing point hypotheses define the null and the alternative hypothesis in terms of priors, e.g.: H : p H 0 0 H : p H N 0, if 0 0 otherwise p Y H 0 p Y H 1 apply decision rule, i.e.: if 1 P H0 y 1 P H y y then reject H0 Y space of all datasets Savage-Dickey ratios (nested models, i.i.d. priors): 0 p y H1 p y H p 0 y, H 1 0 H1 p

23 differences in log- model evidences Bayesian inference model comparison for group studies ln 1 ln p y m2 p y m m 1 m 2 subjects fixed effect assume all subjects correspond to the same model random effect assume different subjects might correspond to different models

24 Bayesian inference key DCM parameters u u 13 3 u 21, 32, 13 state-state coupling u 3 input-state coupling u 13 input-dependent modulatory effect

25 Overview 1 DCM: introduction 2 Neural ensembles dynamics 3 Bayesian inference 4 Conclusion

26 Conclusion back to the auditory mismatch negativity sequence of auditory stimuli S S S D S S S S D S standard condition (S) S-D: reorganisation of the connectivity structure rifg deviant condition (D) la1 lstg rifg ra1 rstg lstg rstg la1 ra1 t ~ 200 ms

27 Conclusion DCM for EEG/MEG: variants input depolarization st and 2d order moments second-order mean-field DCM time (ms) time (ms) time (ms) auto-spectral density LA auto-spectral density CA1 cross-spectral density CA1-LA DCM for steady-state responses frequency (Hz) frequency (Hz) frequency (Hz) DCM for induced responses DCM for phase coupling

28 Many thanks to: Karl J. Friston (London, UK) Klaas E. Stephan (Zurich, Switzerland) Stefan J. Kiebel (Leipzig, Germany)

29 Bayesian inference the variational Bayesian approach KL ln p y m ln p, y m S q D q ; p y, m free energy : functional of q q approximate (marginal) posterior distributions: q, q p p, y, m or 2, q 1 or 2 y m

30 y=f(x) y = f(x) Bayesian inference model comparison Principle of parsimony : «plurality should not be assumed without necessity» Model evidence:, p y m p y m p m d Occam s razor : x model evidence p(y m) space of all data sets

Dynamic Causal Modelling for EEG/MEG: principles J. Daunizeau

Dynamic Causal Modelling for EEG/MEG: principles J. Daunizeau Dynamic Causal Modelling for EEG/MEG: principles J. Daunizeau Motivation, Brain and Behaviour group, ICM, Paris, France Overview 1 DCM: introduction 2 Dynamical systems theory 3 Neural states dynamics

More information

Dynamic Causal Modelling for EEG and MEG. Stefan Kiebel

Dynamic Causal Modelling for EEG and MEG. Stefan Kiebel Dynamic Causal Modelling for EEG and MEG Stefan Kiebel Overview 1 M/EEG analysis 2 Dynamic Causal Modelling Motivation 3 Dynamic Causal Modelling Generative model 4 Bayesian inference 5 Applications Overview

More information

Dynamic Causal Modelling for EEG and MEG

Dynamic Causal Modelling for EEG and MEG Dynamic Causal Modelling for EEG and MEG Stefan Kiebel Ma Planck Institute for Human Cognitive and Brain Sciences Leipzig, Germany Overview 1 M/EEG analysis 2 Dynamic Causal Modelling Motivation 3 Dynamic

More information

An introduction to Bayesian inference and model comparison J. Daunizeau

An introduction to Bayesian inference and model comparison J. Daunizeau An introduction to Bayesian inference and model comparison J. Daunizeau ICM, Paris, France TNU, Zurich, Switzerland Overview of the talk An introduction to probabilistic modelling Bayesian model comparison

More information

Bayesian inference J. Daunizeau

Bayesian inference J. Daunizeau Bayesian inference J. Daunizeau Brain and Spine Institute, Paris, France Wellcome Trust Centre for Neuroimaging, London, UK Overview of the talk 1 Probabilistic modelling and representation of uncertainty

More information

Bayesian inference J. Daunizeau

Bayesian inference J. Daunizeau Bayesian inference J. Daunizeau Brain and Spine Institute, Paris, France Wellcome Trust Centre for Neuroimaging, London, UK Overview of the talk 1 Probabilistic modelling and representation of uncertainty

More information

Bayesian inference. Justin Chumbley ETH and UZH. (Thanks to Jean Denizeau for slides)

Bayesian inference. Justin Chumbley ETH and UZH. (Thanks to Jean Denizeau for slides) Bayesian inference Justin Chumbley ETH and UZH (Thanks to Jean Denizeau for slides) Overview of the talk Introduction: Bayesian inference Bayesian model comparison Group-level Bayesian model selection

More information

Will Penny. 21st April The Macroscopic Brain. Will Penny. Cortical Unit. Spectral Responses. Macroscopic Models. Steady-State Responses

Will Penny. 21st April The Macroscopic Brain. Will Penny. Cortical Unit. Spectral Responses. Macroscopic Models. Steady-State Responses The The 21st April 2011 Jansen and Rit (1995), building on the work of Lopes Da Sliva and others, developed a biologically inspired model of EEG activity. It was originally developed to explain alpha activity

More information

Dynamic Modeling of Brain Activity

Dynamic Modeling of Brain Activity 0a Dynamic Modeling of Brain Activity EIN IIN PC Thomas R. Knösche, Leipzig Generative Models for M/EEG 4a Generative Models for M/EEG states x (e.g. dipole strengths) parameters parameters (source positions,

More information

Bayesian Inference. Chris Mathys Wellcome Trust Centre for Neuroimaging UCL. London SPM Course

Bayesian Inference. Chris Mathys Wellcome Trust Centre for Neuroimaging UCL. London SPM Course Bayesian Inference Chris Mathys Wellcome Trust Centre for Neuroimaging UCL London SPM Course Thanks to Jean Daunizeau and Jérémie Mattout for previous versions of this talk A spectacular piece of information

More information

Dynamic Causal Modelling for fmri

Dynamic Causal Modelling for fmri Dynamic Causal Modelling for fmri André Marreiros Friday 22 nd Oct. 2 SPM fmri course Wellcome Trust Centre for Neuroimaging London Overview Brain connectivity: types & definitions Anatomical connectivity

More information

Group Analysis. Lexicon. Hierarchical models Mixed effect models Random effect (RFX) models Components of variance

Group Analysis. Lexicon. Hierarchical models Mixed effect models Random effect (RFX) models Components of variance Group Analysis J. Daunizeau Institute of Empirical Research in Economics, Zurich, Switzerland Brain and Spine Institute, Paris, France SPM Course Edinburgh, April 2011 Image time-series Spatial filter

More information

Anatomical Background of Dynamic Causal Modeling and Effective Connectivity Analyses

Anatomical Background of Dynamic Causal Modeling and Effective Connectivity Analyses Anatomical Background of Dynamic Causal Modeling and Effective Connectivity Analyses Jakob Heinzle Translational Neuromodeling Unit (TNU), Institute for Biomedical Engineering University and ETH Zürich

More information

Principles of DCM. Will Penny. 26th May Principles of DCM. Will Penny. Introduction. Differential Equations. Bayesian Estimation.

Principles of DCM. Will Penny. 26th May Principles of DCM. Will Penny. Introduction. Differential Equations. Bayesian Estimation. 26th May 2011 Dynamic Causal Modelling Dynamic Causal Modelling is a framework studying large scale brain connectivity by fitting differential equation models to brain imaging data. DCMs differ in their

More information

M/EEG source analysis

M/EEG source analysis Jérémie Mattout Lyon Neuroscience Research Center Will it ever happen that mathematicians will know enough about the physiology of the brain, and neurophysiologists enough of mathematical discovery, for

More information

Dynamic Causal Models

Dynamic Causal Models Dynamic Causal Models V1 SPC Will Penny V1 SPC V5 V5 Olivier David, Karl Friston, Lee Harrison, Andrea Mechelli, Klaas Stephan Wellcome Department of Imaging Neuroscience, ION, UCL, UK. Mathematics in

More information

Effective Connectivity & Dynamic Causal Modelling

Effective Connectivity & Dynamic Causal Modelling Effective Connectivity & Dynamic Causal Modelling Hanneke den Ouden Donders Centre for Cognitive Neuroimaging Radboud University Nijmegen Advanced SPM course Zurich, Februari 13-14, 2014 Functional Specialisation

More information

Statistical Inference

Statistical Inference Statistical Inference J. Daunizeau Institute of Empirical Research in Economics, Zurich, Switzerland Brain and Spine Institute, Paris, France SPM Course Edinburgh, April 2011 Image time-series Spatial

More information

Bayesian Inference Course, WTCN, UCL, March 2013

Bayesian Inference Course, WTCN, UCL, March 2013 Bayesian Course, WTCN, UCL, March 2013 Shannon (1948) asked how much information is received when we observe a specific value of the variable x? If an unlikely event occurs then one would expect the information

More information

Will Penny. SPM short course for M/EEG, London 2015

Will Penny. SPM short course for M/EEG, London 2015 SPM short course for M/EEG, London 2015 Ten Simple Rules Stephan et al. Neuroimage, 2010 Model Structure The model evidence is given by integrating out the dependence on model parameters p(y m) = p(y,

More information

Computational Models of Human Cognition

Computational Models of Human Cognition Computational Models of Human Cognition Models A model is a means of representing the structure or workings of a system or object. e.g., model car e.g., economic model e.g., psychophysics model 2500 loudness

More information

An Implementation of Dynamic Causal Modelling

An Implementation of Dynamic Causal Modelling An Implementation of Dynamic Causal Modelling Christian Himpe 24.01.2011 Overview Contents: 1 Intro 2 Model 3 Parameter Estimation 4 Examples Motivation Motivation: How are brain regions coupled? Motivation

More information

Experimental design of fmri studies

Experimental design of fmri studies Experimental design of fmri studies Zurich SPM Course 2016 Sandra Iglesias Translational Neuromodeling Unit (TNU) Institute for Biomedical Engineering (IBT) University and ETH Zürich With many thanks for

More information

Dynamic causal modeling for fmri

Dynamic causal modeling for fmri Dynamic causal modeling for fmri Methods and Models for fmri, HS 2015 Jakob Heinzle Structural, functional & effective connectivity Sporns 2007, Scholarpedia anatomical/structural connectivity - presence

More information

Tuning tuning curves. So far: Receptive fields Representation of stimuli Population vectors. Today: Contrast enhancment, cortical processing

Tuning tuning curves. So far: Receptive fields Representation of stimuli Population vectors. Today: Contrast enhancment, cortical processing Tuning tuning curves So far: Receptive fields Representation of stimuli Population vectors Today: Contrast enhancment, cortical processing Firing frequency N 3 s max (N 1 ) = 40 o N4 N 1 N N 5 2 s max

More information

DCM: Advanced topics. Klaas Enno Stephan. SPM Course Zurich 06 February 2015

DCM: Advanced topics. Klaas Enno Stephan. SPM Course Zurich 06 February 2015 DCM: Advanced topics Klaas Enno Stephan SPM Course Zurich 06 February 205 Overview DCM a generative model Evolution of DCM for fmri Bayesian model selection (BMS) Translational Neuromodeling Generative

More information

Experimental design of fmri studies

Experimental design of fmri studies Experimental design of fmri studies Sandra Iglesias Translational Neuromodeling Unit University of Zurich & ETH Zurich With many thanks for slides & images to: Klaas Enno Stephan, FIL Methods group, Christian

More information

Stochastic Dynamic Causal Modelling for resting-state fmri

Stochastic Dynamic Causal Modelling for resting-state fmri Stochastic Dynamic Causal Modelling for resting-state fmri Ged Ridgway, FIL, Wellcome Trust Centre for Neuroimaging, UCL Institute of Neurology, London Overview Connectivity in the brain Introduction to

More information

PART I INTRODUCTION The meaning of probability Basic definitions for frequentist statistics and Bayesian inference Bayesian inference Combinatorics

PART I INTRODUCTION The meaning of probability Basic definitions for frequentist statistics and Bayesian inference Bayesian inference Combinatorics Table of Preface page xi PART I INTRODUCTION 1 1 The meaning of probability 3 1.1 Classical definition of probability 3 1.2 Statistical definition of probability 9 1.3 Bayesian understanding of probability

More information

Annealed Importance Sampling for Neural Mass Models

Annealed Importance Sampling for Neural Mass Models for Neural Mass Models, UCL. WTCN, UCL, October 2015. Generative Model Behavioural or imaging data y. Likelihood p(y w, Γ). We have a Gaussian prior over model parameters p(w µ, Λ) = N (w; µ, Λ) Assume

More information

Experimental design of fmri studies

Experimental design of fmri studies Experimental design of fmri studies Sandra Iglesias With many thanks for slides & images to: Klaas Enno Stephan, FIL Methods group, Christian Ruff SPM Course 2015 Overview of SPM Image time-series Kernel

More information

Hierarchy. Will Penny. 24th March Hierarchy. Will Penny. Linear Models. Convergence. Nonlinear Models. References

Hierarchy. Will Penny. 24th March Hierarchy. Will Penny. Linear Models. Convergence. Nonlinear Models. References 24th March 2011 Update Hierarchical Model Rao and Ballard (1999) presented a hierarchical model of visual cortex to show how classical and extra-classical Receptive Field (RF) effects could be explained

More information

Empirical Bayes for DCM: A Group Inversion Scheme

Empirical Bayes for DCM: A Group Inversion Scheme METHODS published: 27 November 2015 doi: 10.3389/fnsys.2015.00164 : A Group Inversion Scheme Karl Friston*, Peter Zeidman and Vladimir Litvak The Wellcome Trust Centre for Neuroimaging, University College

More information

The General Linear Model (GLM)

The General Linear Model (GLM) he General Linear Model (GLM) Klaas Enno Stephan ranslational Neuromodeling Unit (NU) Institute for Biomedical Engineering University of Zurich & EH Zurich Wellcome rust Centre for Neuroimaging Institute

More information

Group analysis. Jean Daunizeau Wellcome Trust Centre for Neuroimaging University College London. SPM Course Edinburgh, April 2010

Group analysis. Jean Daunizeau Wellcome Trust Centre for Neuroimaging University College London. SPM Course Edinburgh, April 2010 Group analysis Jean Daunizeau Wellcome Trust Centre for Neuroimaging University College London SPM Course Edinburgh, April 2010 Image time-series Spatial filter Design matrix Statistical Parametric Map

More information

Chapter 9. Nerve Signals and Homeostasis

Chapter 9. Nerve Signals and Homeostasis Chapter 9 Nerve Signals and Homeostasis A neuron is a specialized nerve cell that is the functional unit of the nervous system. Neural signaling communication by neurons is the process by which an animal

More information

Dynamic causal models of neural system dynamics:current state and future extensions.

Dynamic causal models of neural system dynamics:current state and future extensions. Dynamic causal models of neural system dynamics:current state and future extensions. Klaas Stephan, Lee Harrison, Stefan Kiebel, Olivier David, Will Penny, Karl Friston To cite this version: Klaas Stephan,

More information

Data Modeling & Analysis Techniques. Probability & Statistics. Manfred Huber

Data Modeling & Analysis Techniques. Probability & Statistics. Manfred Huber Data Modeling & Analysis Techniques Probability & Statistics Manfred Huber 2017 1 Probability and Statistics Probability and statistics are often used interchangeably but are different, related fields

More information

Activity types in a neural mass model

Activity types in a neural mass model Master thesis Activity types in a neural mass model Jurgen Hebbink September 19, 214 Exam committee: Prof. Dr. S.A. van Gils (UT) Dr. H.G.E. Meijer (UT) Dr. G.J.M. Huiskamp (UMC Utrecht) Contents 1 Introduction

More information

A prior distribution over model space p(m) (or hypothesis space ) can be updated to a posterior distribution after observing data y.

A prior distribution over model space p(m) (or hypothesis space ) can be updated to a posterior distribution after observing data y. June 2nd 2011 A prior distribution over model space p(m) (or hypothesis space ) can be updated to a posterior distribution after observing data y. This is implemented using Bayes rule p(m y) = p(y m)p(m)

More information

Experimental design of fmri studies & Resting-State fmri

Experimental design of fmri studies & Resting-State fmri Methods & Models for fmri Analysis 2016 Experimental design of fmri studies & Resting-State fmri Sandra Iglesias With many thanks for slides & images to: Klaas Enno Stephan, FIL Methods group, Christian

More information

The General Linear Model (GLM)

The General Linear Model (GLM) The General Linear Model (GLM) Dr. Frederike Petzschner Translational Neuromodeling Unit (TNU) Institute for Biomedical Engineering, University of Zurich & ETH Zurich With many thanks for slides & images

More information

Expectation Propagation in Dynamical Systems

Expectation Propagation in Dynamical Systems Expectation Propagation in Dynamical Systems Marc Peter Deisenroth Joint Work with Shakir Mohamed (UBC) August 10, 2012 Marc Deisenroth (TU Darmstadt) EP in Dynamical Systems 1 Motivation Figure : Complex

More information

Dynamic causal modeling for fmri

Dynamic causal modeling for fmri Dynamic causal modeling for fmri Methods and Models for fmri, HS 2016 Jakob Heinzle Structural, functional & effective connectivity Sporns 2007, Scholarpedia anatomical/structural connectivity - presence

More information

Consider the following spike trains from two different neurons N1 and N2:

Consider the following spike trains from two different neurons N1 and N2: About synchrony and oscillations So far, our discussions have assumed that we are either observing a single neuron at a, or that neurons fire independent of each other. This assumption may be correct in

More information

Experimental design of fmri studies

Experimental design of fmri studies Methods & Models for fmri Analysis 2017 Experimental design of fmri studies Sara Tomiello With many thanks for slides & images to: Sandra Iglesias, Klaas Enno Stephan, FIL Methods group, Christian Ruff

More information

Computational Explorations in Cognitive Neuroscience Chapter 2

Computational Explorations in Cognitive Neuroscience Chapter 2 Computational Explorations in Cognitive Neuroscience Chapter 2 2.4 The Electrophysiology of the Neuron Some basic principles of electricity are useful for understanding the function of neurons. This is

More information

Models of effective connectivity & Dynamic Causal Modelling (DCM)

Models of effective connectivity & Dynamic Causal Modelling (DCM) Models of effective connectivit & Dnamic Causal Modelling (DCM Presented b: Ariana Anderson Slides shared b: Karl Friston Functional Imaging Laborator (FIL Wellcome Trust Centre for Neuroimaging Universit

More information

Neural Conduction. biologyaspoetry.com

Neural Conduction. biologyaspoetry.com Neural Conduction biologyaspoetry.com Resting Membrane Potential -70mV A cell s membrane potential is the difference in the electrical potential ( charge) between the inside and outside of the cell. The

More information

Introduction to Neural Networks U. Minn. Psy 5038 Spring, 1999 Daniel Kersten. Lecture 2a. The Neuron - overview of structure. From Anderson (1995)

Introduction to Neural Networks U. Minn. Psy 5038 Spring, 1999 Daniel Kersten. Lecture 2a. The Neuron - overview of structure. From Anderson (1995) Introduction to Neural Networks U. Minn. Psy 5038 Spring, 1999 Daniel Kersten Lecture 2a The Neuron - overview of structure From Anderson (1995) 2 Lect_2a_Mathematica.nb Basic Structure Information flow:

More information

SRNDNA Model Fitting in RL Workshop

SRNDNA Model Fitting in RL Workshop SRNDNA Model Fitting in RL Workshop yael@princeton.edu Topics: 1. trial-by-trial model fitting (morning; Yael) 2. model comparison (morning; Yael) 3. advanced topics (hierarchical fitting etc.) (afternoon;

More information

Biosciences in the 21st century

Biosciences in the 21st century Biosciences in the 21st century Lecture 1: Neurons, Synapses, and Signaling Dr. Michael Burger Outline: 1. Why neuroscience? 2. The neuron 3. Action potentials 4. Synapses 5. Organization of the nervous

More information

ATTRACTORS IN SONG. KARL FRISTON and STEFAN KIEBEL

ATTRACTORS IN SONG. KARL FRISTON and STEFAN KIEBEL Attractors in song: 1 New Mathematics and Natural Computation Vol. 5, No. 1 (9) 1-3 World Scientific Publishing Company ATTRACTORS IN SONG KARL FRISTON and STEFAN KIEBEL The Wellcome Trust Centre of Neuroimaging

More information

Nervous Tissue. Neurons Electrochemical Gradient Propagation & Transduction Neurotransmitters Temporal & Spatial Summation

Nervous Tissue. Neurons Electrochemical Gradient Propagation & Transduction Neurotransmitters Temporal & Spatial Summation Nervous Tissue Neurons Electrochemical Gradient Propagation & Transduction Neurotransmitters Temporal & Spatial Summation What is the function of nervous tissue? Maintain homeostasis & respond to stimuli

More information

Expectation Propagation for Approximate Bayesian Inference

Expectation Propagation for Approximate Bayesian Inference Expectation Propagation for Approximate Bayesian Inference José Miguel Hernández Lobato Universidad Autónoma de Madrid, Computer Science Department February 5, 2007 1/ 24 Bayesian Inference Inference Given

More information

SPRING 2007 EXAM C SOLUTIONS

SPRING 2007 EXAM C SOLUTIONS SPRING 007 EXAM C SOLUTIONS Question #1 The data are already shifted (have had the policy limit and the deductible of 50 applied). The two 350 payments are censored. Thus the likelihood function is L =

More information

Causal modeling of fmri: temporal precedence and spatial exploration

Causal modeling of fmri: temporal precedence and spatial exploration Causal modeling of fmri: temporal precedence and spatial exploration Alard Roebroeck Maastricht Brain Imaging Center (MBIC) Faculty of Psychology & Neuroscience Maastricht University Intro: What is Brain

More information

CSE/NB 528 Final Lecture: All Good Things Must. CSE/NB 528: Final Lecture

CSE/NB 528 Final Lecture: All Good Things Must. CSE/NB 528: Final Lecture CSE/NB 528 Final Lecture: All Good Things Must 1 Course Summary Where have we been? Course Highlights Where do we go from here? Challenges and Open Problems Further Reading 2 What is the neural code? What

More information

NeuroImage 51 (2010) Contents lists available at ScienceDirect. NeuroImage. journal homepage:

NeuroImage 51 (2010) Contents lists available at ScienceDirect. NeuroImage. journal homepage: NeuroImage 51 (010) 91 101 Contents lists available at ScienceDirect NeuroImage ournal homepage: www.elsevier.com/locate/ynimg Technical Note A dynamic causal model study of neuronal population dynamics

More information

GAUSSIAN PROCESS REGRESSION

GAUSSIAN PROCESS REGRESSION GAUSSIAN PROCESS REGRESSION CSE 515T Spring 2015 1. BACKGROUND The kernel trick again... The Kernel Trick Consider again the linear regression model: y(x) = φ(x) w + ε, with prior p(w) = N (w; 0, Σ). The

More information

+ + ( + ) = Linear recurrent networks. Simpler, much more amenable to analytic treatment E.g. by choosing

+ + ( + ) = Linear recurrent networks. Simpler, much more amenable to analytic treatment E.g. by choosing Linear recurrent networks Simpler, much more amenable to analytic treatment E.g. by choosing + ( + ) = Firing rates can be negative Approximates dynamics around fixed point Approximation often reasonable

More information

Wellcome Trust Centre for Neuroimaging, UCL, UK.

Wellcome Trust Centre for Neuroimaging, UCL, UK. Bayesian Inference Will Penny Wellcome Trust Centre for Neuroimaging, UCL, UK. SPM Course, Virginia Tech, January 2012 What is Bayesian Inference? (From Daniel Wolpert) Bayesian segmentation and normalisation

More information

9 Generation of Action Potential Hodgkin-Huxley Model

9 Generation of Action Potential Hodgkin-Huxley Model 9 Generation of Action Potential Hodgkin-Huxley Model (based on chapter 12, W.W. Lytton, Hodgkin-Huxley Model) 9.1 Passive and active membrane models In the previous lecture we have considered a passive

More information

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE GRAVIS 2016 BASEL. Logistic Regression. Pattern Recognition 2016 Sandro Schönborn University of Basel

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE GRAVIS 2016 BASEL. Logistic Regression. Pattern Recognition 2016 Sandro Schönborn University of Basel Logistic Regression Pattern Recognition 2016 Sandro Schönborn University of Basel Two Worlds: Probabilistic & Algorithmic We have seen two conceptual approaches to classification: data class density estimation

More information

Probabilistic Models in Theoretical Neuroscience

Probabilistic Models in Theoretical Neuroscience Probabilistic Models in Theoretical Neuroscience visible unit Boltzmann machine semi-restricted Boltzmann machine restricted Boltzmann machine hidden unit Neural models of probabilistic sampling: introduction

More information

Stochastic Gradient Descent

Stochastic Gradient Descent Stochastic Gradient Descent Machine Learning CSE546 Carlos Guestrin University of Washington October 9, 2013 1 Logistic Regression Logistic function (or Sigmoid): Learn P(Y X) directly Assume a particular

More information

Integrated Non-Factorized Variational Inference

Integrated Non-Factorized Variational Inference Integrated Non-Factorized Variational Inference Shaobo Han, Xuejun Liao and Lawrence Carin Duke University February 27, 2014 S. Han et al. Integrated Non-Factorized Variational Inference February 27, 2014

More information

An Introductory Course in Computational Neuroscience

An Introductory Course in Computational Neuroscience An Introductory Course in Computational Neuroscience Contents Series Foreword Acknowledgments Preface 1 Preliminary Material 1.1. Introduction 1.1.1 The Cell, the Circuit, and the Brain 1.1.2 Physics of

More information

Chapter 48 Neurons, Synapses, and Signaling

Chapter 48 Neurons, Synapses, and Signaling Chapter 48 Neurons, Synapses, and Signaling Concept 48.1 Neuron organization and structure reflect function in information transfer Neurons are nerve cells that transfer information within the body Neurons

More information

Information processing. Divisions of nervous system. Neuron structure and function Synapse. Neurons, synapses, and signaling 11/3/2017

Information processing. Divisions of nervous system. Neuron structure and function Synapse. Neurons, synapses, and signaling 11/3/2017 Neurons, synapses, and signaling Chapter 48 Information processing Divisions of nervous system Central nervous system (CNS) Brain and a nerve cord Integration center Peripheral nervous system (PNS) Nerves

More information

Gaussian Process Approximations of Stochastic Differential Equations

Gaussian Process Approximations of Stochastic Differential Equations Gaussian Process Approximations of Stochastic Differential Equations Cédric Archambeau Dan Cawford Manfred Opper John Shawe-Taylor May, 2006 1 Introduction Some of the most complex models routinely run

More information

Methods for Estimating the Computational Power and Generalization Capability of Neural Microcircuits

Methods for Estimating the Computational Power and Generalization Capability of Neural Microcircuits Methods for Estimating the Computational Power and Generalization Capability of Neural Microcircuits Wolfgang Maass, Robert Legenstein, Nils Bertschinger Institute for Theoretical Computer Science Technische

More information

Control and Integration. Nervous System Organization: Bilateral Symmetric Animals. Nervous System Organization: Radial Symmetric Animals

Control and Integration. Nervous System Organization: Bilateral Symmetric Animals. Nervous System Organization: Radial Symmetric Animals Control and Integration Neurophysiology Chapters 10-12 Nervous system composed of nervous tissue cells designed to conduct electrical impulses rapid communication to specific cells or groups of cells Endocrine

More information

Statistical Inference

Statistical Inference Statistical Inference Robert L. Wolpert Institute of Statistics and Decision Sciences Duke University, Durham, NC, USA Week 12. Testing and Kullback-Leibler Divergence 1. Likelihood Ratios Let 1, 2, 2,...

More information

Statistical inference for MEG

Statistical inference for MEG Statistical inference for MEG Vladimir Litvak Wellcome Trust Centre for Neuroimaging University College London, UK MEG-UK 2014 educational day Talk aims Show main ideas of common methods Explain some of

More information

Unsupervised Learning

Unsupervised Learning Unsupervised Learning Bayesian Model Comparison Zoubin Ghahramani zoubin@gatsby.ucl.ac.uk Gatsby Computational Neuroscience Unit, and MSc in Intelligent Systems, Dept Computer Science University College

More information

Models of effective connectivity & Dynamic Causal Modelling (DCM)

Models of effective connectivity & Dynamic Causal Modelling (DCM) Models of effective connectivit & Dnamic Causal Modelling (DCM) Slides obtained from: Karl Friston Functional Imaging Laborator (FIL) Wellcome Trust Centre for Neuroimaging Universit College London Klaas

More information

Nervous Tissue. Neurons Neural communication Nervous Systems

Nervous Tissue. Neurons Neural communication Nervous Systems Nervous Tissue Neurons Neural communication Nervous Systems What is the function of nervous tissue? Maintain homeostasis & respond to stimuli Sense & transmit information rapidly, to specific cells and

More information

Compartmental Modelling

Compartmental Modelling Modelling Neurons Computing and the Brain Compartmental Modelling Spring 2010 2 1 Equivalent Electrical Circuit A patch of membrane is equivalent to an electrical circuit This circuit can be described

More information

Introduction to Systems Analysis and Decision Making Prepared by: Jakub Tomczak

Introduction to Systems Analysis and Decision Making Prepared by: Jakub Tomczak Introduction to Systems Analysis and Decision Making Prepared by: Jakub Tomczak 1 Introduction. Random variables During the course we are interested in reasoning about considered phenomenon. In other words,

More information

Stat 535 C - Statistical Computing & Monte Carlo Methods. Arnaud Doucet.

Stat 535 C - Statistical Computing & Monte Carlo Methods. Arnaud Doucet. Stat 535 C - Statistical Computing & Monte Carlo Methods Arnaud Doucet Email: arnaud@cs.ubc.ca 1 CS students: don t forget to re-register in CS-535D. Even if you just audit this course, please do register.

More information

Comments. Assignment 3 code released. Thought questions 3 due this week. Mini-project: hopefully you have started. implement classification algorithms

Comments. Assignment 3 code released. Thought questions 3 due this week. Mini-project: hopefully you have started. implement classification algorithms Neural networks Comments Assignment 3 code released implement classification algorithms use kernels for census dataset Thought questions 3 due this week Mini-project: hopefully you have started 2 Example:

More information

Bayesian Inference in Astronomy & Astrophysics A Short Course

Bayesian Inference in Astronomy & Astrophysics A Short Course Bayesian Inference in Astronomy & Astrophysics A Short Course Tom Loredo Dept. of Astronomy, Cornell University p.1/37 Five Lectures Overview of Bayesian Inference From Gaussians to Periodograms Learning

More information

Data Mining Chapter 4: Data Analysis and Uncertainty Fall 2011 Ming Li Department of Computer Science and Technology Nanjing University

Data Mining Chapter 4: Data Analysis and Uncertainty Fall 2011 Ming Li Department of Computer Science and Technology Nanjing University Data Mining Chapter 4: Data Analysis and Uncertainty Fall 2011 Ming Li Department of Computer Science and Technology Nanjing University Why uncertainty? Why should data mining care about uncertainty? We

More information

Dynamical Constraints on Computing with Spike Timing in the Cortex

Dynamical Constraints on Computing with Spike Timing in the Cortex Appears in Advances in Neural Information Processing Systems, 15 (NIPS 00) Dynamical Constraints on Computing with Spike Timing in the Cortex Arunava Banerjee and Alexandre Pouget Department of Brain and

More information

Statistical Inference

Statistical Inference Statistical Inference Robert L. Wolpert Institute of Statistics and Decision Sciences Duke University, Durham, NC, USA Spring, 2006 1. DeGroot 1973 In (DeGroot 1973), Morrie DeGroot considers testing the

More information

Expectation Propagation Algorithm

Expectation Propagation Algorithm Expectation Propagation Algorithm 1 Shuang Wang School of Electrical and Computer Engineering University of Oklahoma, Tulsa, OK, 74135 Email: {shuangwang}@ou.edu This note contains three parts. First,

More information

Dendrites - receives information from other neuron cells - input receivers.

Dendrites - receives information from other neuron cells - input receivers. The Nerve Tissue Neuron - the nerve cell Dendrites - receives information from other neuron cells - input receivers. Cell body - includes usual parts of the organelles of a cell (nucleus, mitochondria)

More information

Subthreshold cross-correlations between cortical neurons: Areference model with static synapses

Subthreshold cross-correlations between cortical neurons: Areference model with static synapses Neurocomputing 65 66 (25) 685 69 www.elsevier.com/locate/neucom Subthreshold cross-correlations between cortical neurons: Areference model with static synapses Ofer Melamed a,b, Gilad Silberberg b, Henry

More information

Sampling-based probabilistic inference through neural and synaptic dynamics

Sampling-based probabilistic inference through neural and synaptic dynamics Sampling-based probabilistic inference through neural and synaptic dynamics Wolfgang Maass for Robert Legenstein Institute for Theoretical Computer Science Graz University of Technology, Austria Institute

More information

Semi-analytical approximations to statistical moments. of sigmoid and softmax mappings of normal variables

Semi-analytical approximations to statistical moments. of sigmoid and softmax mappings of normal variables Semi-analytical approximations to statistical moments of sigmoid and softmax mappings of normal variables J. Daunizeau, Brain and Spine Institute, Paris, France ETH, Zurich, France Address for correspondence:

More information

BIOLOGY 11/10/2016. Neurons, Synapses, and Signaling. Concept 48.1: Neuron organization and structure reflect function in information transfer

BIOLOGY 11/10/2016. Neurons, Synapses, and Signaling. Concept 48.1: Neuron organization and structure reflect function in information transfer 48 Neurons, Synapses, and Signaling CAMPBELL BIOLOGY TENTH EDITION Reece Urry Cain Wasserman Minorsky Jackson Lecture Presentation by Nicole Tunbridge and Kathleen Fitzpatrick Concept 48.1: Neuron organization

More information

Will Penny. SPM short course for M/EEG, London 2013

Will Penny. SPM short course for M/EEG, London 2013 SPM short course for M/EEG, London 2013 Ten Simple Rules Stephan et al. Neuroimage, 2010 Model Structure Bayes rule for models A prior distribution over model space p(m) (or hypothesis space ) can be updated

More information

Dynamic causal models of neural system dynamics. current state and future extensions

Dynamic causal models of neural system dynamics. current state and future extensions Dynamic causal models of neural system dynamics: current state and future etensions Klaas E. Stephan 1, Lee M. Harrison 1, Stefan J. Kiebel 1, Olivier David, Will D. Penny 1 & Karl J. Friston 1 1 Wellcome

More information

BIOLOGY. 1. Overview of Neurons 11/3/2014. Neurons, Synapses, and Signaling. Communication in Neurons

BIOLOGY. 1. Overview of Neurons 11/3/2014. Neurons, Synapses, and Signaling. Communication in Neurons CAMPBELL BIOLOGY TENTH EDITION 48 Reece Urry Cain Wasserman Minorsky Jackson Neurons, Synapses, and Signaling Lecture Presentation by Nicole Tunbridge and Kathleen Fitzpatrick 1. Overview of Neurons Communication

More information

A neural mass model of spectral responses in electrophysiology

A neural mass model of spectral responses in electrophysiology www.elsevier.com/locate/ynimg NeuroImage 37 (27) 76 72 A neural mass model of spectral responses in electrophysiology R.J. Moran, a,b, S.J. Kiebel, a K.E. Stephan, a R.B. Reilly, b J. Daunizeau, a and

More information

Analog Circuit Verification by Statistical Model Checking

Analog Circuit Verification by Statistical Model Checking 16 th Asian Pacific Design Automation ti Conference Analog Circuit Verification by Statistical Model Checking Author Ying-Chih Wang (Presenter) Anvesh Komuravelli Paolo Zuliani Edmund M. Clarke Date 2011/1/26

More information

Probabilistic & Bayesian deep learning. Andreas Damianou

Probabilistic & Bayesian deep learning. Andreas Damianou Probabilistic & Bayesian deep learning Andreas Damianou Amazon Research Cambridge, UK Talk at University of Sheffield, 19 March 2019 In this talk Not in this talk: CRFs, Boltzmann machines,... In this

More information

Biological Modeling of Neural Networks

Biological Modeling of Neural Networks Week 4 part 2: More Detail compartmental models Biological Modeling of Neural Networks Week 4 Reducing detail - Adding detail 4.2. Adding detail - apse -cable equat Wulfram Gerstner EPFL, Lausanne, Switzerland

More information

Fitting a Stochastic Neural Network Model to Real Data

Fitting a Stochastic Neural Network Model to Real Data Fitting a Stochastic Neural Network Model to Real Data Christophe Pouzat, Ludmila Brochini, Pierre Hodara and Guilherme Ost MAP5 Univ. Paris-Descartes and CNRS Neuromat, USP christophe.pouzat@parisdescartes.fr

More information