Fitting a Stochastic Neural Network Model to Real Data
|
|
- Gyles Sherman
- 6 years ago
- Views:
Transcription
1 Fitting a Stochastic Neural Network Model to Real Data Christophe Pouzat, Ludmila Brochini, Pierre Hodara and Guilherme Ost MAP5 Univ. Paris-Descartes and CNRS Neuromat, USP christophe.pouzat@parisdescartes.fr Random Structures on the Brain, December
2 Outline Introduction Few words of caution In defense of a modeling approach with a strong stochastic element Some stochastic models of neuronal discharges Working with the intensity of the process Model and inference
3 Where are we? Introduction Few words of caution In defense of a modeling approach with a strong stochastic element Some stochastic models of neuronal discharges Working with the intensity of the process Model and inference
4 Experimental model and setting The locust, Schistocerca americana, preparation.
5 Insects do have a brain we can record from! Left: Opened head and brain; center: antennal lobe and recording probe; right: 1 sec recorded from a tetrode.
6 Locust and cockroach olfactory systems Left: Locust olfactory system (Laurent, 1996); center: Cockroach olfactory system (Boeckh & Ernst, 1987); right: Locust local neurons (MacLeod & Laurent, 1996).
7 Spike trains After a "rather heavy" pre-processing stage called spike sorting, the raster plot representing the spike trains can be built:
8 Inter Spike Intervals (ISI) Estimated ISI densities of 7 neurons recorded simultaneously from the locust antennal lobe.
9 Responses to stimulation Raster plots from one of the neurons showing the responses to 25 presentations (gray background) of cis-3-hexen-1-ol.
10 The observed counting processes associated with the 25 observed point processes just shown. In red the empirical mean of the 25.
11 Modeling spike trains: Why and How? A key working hypothesis in Neurosciences states that the spikes occurrence times, as opposed to their waveform are the only information carriers between brain region (Adrian and Zotterman, 1926). This hypothesis encourages the development of models whose goal is to predict the probability of occurrence of a spike at a given time, without necessarily considering the biophysical spike generation mechanisms.
12 Where are we? Introduction Few words of caution In defense of a modeling approach with a strong stochastic element Some stochastic models of neuronal discharges Working with the intensity of the process Model and inference
13 Getting the spike trains is not "neutral" The raw data used in this presentation are available (under a Creative Commons Zero license) on zenodo: Going from the raw data to the spike trains (doing the spike sorting) is not neutral and error prone. You can criticize, check, modify, improve what I did, its all available on github: zenodo-locust-datasets-analysis/. The analysis presented in this talk is available on gitlab:
14 On the relation of extracellular spike and neuronal output Left, Rinberg and Davidowitz (2002); top, Spira et al (1969); bottom, Hamon et al (1990).
15 Potential consequences Cooley and Dodge (1966). First numerical solution of the H & H equations.
16 Eyzaguirre and Kuffler (1955), Lobster stretch receptor.
17 Stuart and Sakmann (2009).
18 Williams and Stuart (1999).
19 CA3 pyramidal cell simulation. After Traub et al (1994). Current injected in the soma. Voltage response in the soma and dendrite (blue), axon initial segment (red), axon (black).
20 Extracellular recordings from regions with neurons having different "sizes", like the neo-cortex, result in a biased sampling of the neuronal populations. Since what goes on in the soma is not necessarily what goes on in the axon and since the extracellular potential is dominated by what goes on in the former, we might get wrong output estimations from extracellular recordings.
21 Where are we? Introduction Few words of caution In defense of a modeling approach with a strong stochastic element Some stochastic models of neuronal discharges Working with the intensity of the process Model and inference
22 Membrane noise can lead to output fluctuations
23 Synaptic noise is ubiquitous (Pouzat & Marty, 1998)
24 Action potential propagation failures can occur
25 Where are we? Introduction Few words of caution In defense of a modeling approach with a strong stochastic element Some stochastic models of neuronal discharges Working with the intensity of the process Model and inference
26 A random walk with a drift (Biophysical Journal, 1964)
27 A Hawkes process model
28 A generalized linear model (GLM)
29 Where are we? Introduction Few words of caution In defense of a modeling approach with a strong stochastic element Some stochastic models of neuronal discharges Working with the intensity of the process Model and inference
30 Few definitions Counting Process: For points {t j } randomly scattered along a line, the counting process N(t) gives the number of points observed in the interval (0, t]: N(t) = {t j with 0 < t j t} where stands for the number of elements of a set.
31 History: The history, H t, consists of the variates determined up to and including time t that are necessary to describe the evolution of the counting process. H t can include all or part of the neuron s discharge up to t but also the discharge sequences of other neurons recorded simultaneously, the elapsed time since the onset of a stimulus, the nature of the stimulus, etc. One of the major problems facing the neuroscientist analysing spike trains is the determination of what constitutes H t for the data at hand. A pre-requisite for practical applications of the approach described here is that H t involves only a finite (but possibly random) time period prior to t.
32 Conditional Intensity: For the process N and history H t, the conditional intensity at time t is defined by: λ(t H t ) = lim δ 0 Prob{N(t, t + δ) N(t) = 1 H t } δ
33 Probability of an ISI based on the intensity We will find the probability density of the interval between two successive events, I j = t j+1 t j. Defining δ = t j+1 t j K, where K N, we write the probability of the interval as the following product: Pr{I j } = Pr{N(t j + δ) N(t j ) = 0 H tj } Pr{N(t j + 2 δ) N(t j + δ) = 0 H tj+δ } Pr{N(t j + K δ) N(t j + (K 1) δ) = 0 H tj+(k 1) δ } Pr{N(t j + (K + 1)δ) N(t j + K δ) = 1 H tj+kδ }
34 If we interpret our definition of the conditional intensity as meaning: Prob{N(t, t + δ) N(t) = 0 H t } = 1 λ(t H t ) δ + o(δ) Prob{N(t, t + δ) N(t) = 1 H t } = λ(t H t ) δ + o(δ) Prob{N(t, t + δ) N(t) > 1 H t } = o(δ) where o(δ) is such that lim δ 0 o(δ) δ = 0.
35 The interval s probability becomes the outcome of a sequence of Bernoulli trials, each with an inhomogeneous success probability given by λ i δ + o(δ), where, λ i = λ(t j + i δ H tj +i δ) and we get: Pr{I j = t j+1 t j } = ( K (1 λ k δ + o(δ)) ) (λ K+1 δ + o(δ)) k=1
36 We can rewrite the first term on the right hand side as: K K (1 λ k δ + o(δ)) = exp log (1 λ k δ + o(δ)) k=1 = exp = exp k=1 K log(1 λ k δ + o(δ)) k=1 K ( λ k δ + o(δ)) k=1 = exp( K λ k δ) exp ( K o(δ) ) k=1
37 Using the continuity of the exponential function, the definition of the Riemann s integral, the definition of δ and the property of the o() function we can take the limit when K goes to on both sides of our last equation to get: lim K K k=1 tj+1 (1 λ k δ + o(δ)) = exp And the probability density of the interval becomes: t j λ(t H t ) dt lim K Pr{I j = t j+1 t j } t j+1 t j K tj+1 = λ(t j+1 H tj+1 ) exp λ(t H t ) dt t j
38 If we now define the integrated conditional intensity by: Λ(t) = t u=0 λ(u H u ) du We see that Λ is increasing since by definition λ 0. We see then that the mapping: t T R + Λ(t) R + (1) is one to one and we can transform our {t 1,..., t n } into {Λ 1 = Λ(t 1 ),..., Λ n = Λ(t n )}.
39 If we now consider the probability density of the intervals t j+1 t j and Λ j+1 Λ j we get: p(t j+1 t j ) dt j+1 = λ(t j+1 H tj+1 ) exp ( tj+1 λ(t H t ) dt ) dt j+1 t j = dλ(t j+1) dt j+1 exp ( Λ(t j+1 ) Λ(t j ) ) dt = dλ j+1 exp ( ) Λ j+1 Λ j That is, the mapped intervals, Λ j+1 Λ j follow an exponential distribution with rate 1. This is the substance of the time transformation of Ogata (1988) and of the time rescaling theorem of Brown Et Al (2002). This has been repetitively derived in the neuroscience literature: Hagiwara (1954), Brillinger (1988), Chornoboy et al (1988), Johnson (1996),...
40 Consequences 1. The conditional intensity, with its dependence on the past through H t, describes a process "making a decision" to spike or not to spike at each time step that can include time dependent effects of synaptic coupling and stimulation. 2. The conditional intensity allows us to compute the likelihood of an observed spike train. 3. The time transformation: {t 1,..., t n } {Λ 1 = Λ(t 1 ),..., Λ n = Λ(t n )}, leads to goodness of fit tests since the mapped intervals should be the realization of a Poisson process with rate This time transformation can also be used for simulations.
41 Where are we? Introduction Few words of caution In defense of a modeling approach with a strong stochastic element Some stochastic models of neuronal discharges Working with the intensity of the process Model and inference
42 Model considered We are going to write our λ(t H t ) as a transformation of a "more basic" quantity, the membrane potential process (MPP), u(t H t ): λ(t H t ) λ max (1 + exp u(t H t )) 1, where λ max > 0 is a parameter allowing us to have the proper rate (in Hz). We are going to write u(t H t ) as: u(t H t ) s(t t l ) + g j (t x), for t > t l, j P x T j,x>t l where t l stands for the time of the last spike of the neuron of interest, P is the index set of the neurons of the network that are presynaptic to the neuron of interest, T j stands for the set of spike times of neuron j, g j (t x) is the effect of a spike in neuron j at time x, s(t t l ) stand for the "self" or more appropriately "unobserved" effect.
43 On the "self" or "unobserved" effect In an actual setting, only a tiny fraction of the neurons of a network are observed, but we know from the biophysics of these neurons and from the anatomy and function of the first olfactory relay that 3 "factors" will contribute in making a neuron spike: The so called "intrinsic properties" of the neuron, that is, the set of voltage dependent conductances present in the neuron s membrane, as well as their localization (not to mention the actual geometry of the neuron... ). The continuous asynchronous and "random" input the neuron gets from the olfactory receptors in the "spontaneous" regime. We know that this factor is a key contributor to the spontaneous activity in the first olfactory relay since this activity essentially disappear if we cut the antennal nerve (that is, the bunch of olfactory receptor axons entering into the first olfactory relay). The synaptic inputs from the other neurons of the network.
44 "Pragmatic" choices Since the likelihood computation implies the evaluation of many terms like: lim K Pr{I j = t j+1 t j } t j+1 t j K tj+1 = λ(t j+1 H tj+1 ) exp λ(t H t ) dt t j we will model our "self" and synaptic coupling effects as piecewise constant functions. Our MPP and λ(t j+1 H tj+1 ) will therefore be piecewise constant functions and the integrated intensity Λ(t) will be piecewise linear. The "self" effect will be on the left of a refractory period and constant on the right of a cutoff time. The synaptic effects will have a bounded support.
45 Justification of the constant rate after a cutoff
46 Example of "self" effect
47 Example of synaptic coupling
48 Example of MPP realization The presynaptic neuron (black ticks) spikes independently as a renewal process.
49 Example of fitted MPP
On the relation between neuronal size and extracellular spike amplitude and its consequence on extracellular recordings interpretation
On the relation between neuronal size and extracellular spike amplitude and its consequence on extracellular recordings interpretation Christophe Pouzat and Georgios Is. Detorakis MAP5, Paris-Descartes
More informationOn Goodness of Fit Tests For Models of Neuronal Spike Trains Considered as Counting Processes
On Goodness of Fit Tests For Models of Neuronal Spike Trains Considered as Counting Processes Christophe Pouzat and Antoine Chaffiol Laboratoire de Physiologie Cérébrale, CNRS UMR 8118 UFR biomédicale
More informationExtracellular Recording and Spike Train Analysis
Recording and Spike Train Analysis Christophe CNRS UMR 8118 and Paris-Descartes University Paris, France christophe.pouzat@gmail.com ENP 2009: July 3rd Outline Outline are attractive. Why? They produce
More informationConsider the following spike trains from two different neurons N1 and N2:
About synchrony and oscillations So far, our discussions have assumed that we are either observing a single neuron at a, or that neurons fire independent of each other. This assumption may be correct in
More informationNeural Spike Train Analysis 1: Introduction to Point Processes
SAMSI Summer 2015: CCNS Computational Neuroscience Summer School Neural Spike Train Analysis 1: Introduction to Point Processes Uri Eden BU Department of Mathematics and Statistics July 27, 2015 Spikes
More informationNeuronal Dynamics: Computational Neuroscience of Single Neurons
Week 5 part 3a :Three definitions of rate code Neuronal Dynamics: Computational Neuroscience of Single Neurons Week 5 Variability and Noise: The question of the neural code Wulfram Gerstner EPFL, Lausanne,
More informationModelling stochastic neural learning
Modelling stochastic neural learning Computational Neuroscience András Telcs telcs.andras@wigner.mta.hu www.cs.bme.hu/~telcs http://pattern.wigner.mta.hu/participants/andras-telcs Compiled from lectures
More informationDescribing Spike-Trains
Describing Spike-Trains Maneesh Sahani Gatsby Computational Neuroscience Unit University College London Term 1, Autumn 2012 Neural Coding The brain manipulates information by combining and generating action
More informationThe Axonal Plexus. A description of the behavior of a network of neurons connected by gap junctions. Erin Munro, 4/4/2007
The Axonal Plexus A description of the behavior of a network of neurons connected by gap junctions Erin Munro, 4/4/2007 Why are we interested in studying the axonal plexus? Gap junctions are indicated
More informationAT2 Neuromodeling: Problem set #3 SPIKE TRAINS
AT2 Neuromodeling: Problem set #3 SPIKE TRAINS Younesse Kaddar PROBLEM 1: Poisson spike trains Link of the ipython notebook for the code Brain neuron emit spikes seemingly randomly: we will aim to model
More informationThe Spike Response Model: A Framework to Predict Neuronal Spike Trains
The Spike Response Model: A Framework to Predict Neuronal Spike Trains Renaud Jolivet, Timothy J. Lewis 2, and Wulfram Gerstner Laboratory of Computational Neuroscience, Swiss Federal Institute of Technology
More informationNeural variability and Poisson statistics
Neural variability and Poisson statistics January 15, 2014 1 Introduction We are in the process of deriving the Hodgkin-Huxley model. That model describes how an action potential is generated by ion specic
More informationBiosciences in the 21st century
Biosciences in the 21st century Lecture 1: Neurons, Synapses, and Signaling Dr. Michael Burger Outline: 1. Why neuroscience? 2. The neuron 3. Action potentials 4. Synapses 5. Organization of the nervous
More informationMath in systems neuroscience. Quan Wen
Math in systems neuroscience Quan Wen Human brain is perhaps the most complex subject in the universe 1 kg brain 10 11 neurons 180,000 km nerve fiber 10 15 synapses 10 18 synaptic proteins Multiscale
More informationBiological Modeling of Neural Networks
Week 4 part 2: More Detail compartmental models Biological Modeling of Neural Networks Week 4 Reducing detail - Adding detail 4.2. Adding detail - apse -cable equat Wulfram Gerstner EPFL, Lausanne, Switzerland
More informationHow to read a burst duration code
Neurocomputing 58 60 (2004) 1 6 www.elsevier.com/locate/neucom How to read a burst duration code Adam Kepecs a;, John Lisman b a Cold Spring Harbor Laboratory, Marks Building, 1 Bungtown Road, Cold Spring
More informationSean Escola. Center for Theoretical Neuroscience
Employing hidden Markov models of neural spike-trains toward the improved estimation of linear receptive fields and the decoding of multiple firing regimes Sean Escola Center for Theoretical Neuroscience
More informationImproved characterization of neural and behavioral response. state-space framework
Improved characterization of neural and behavioral response properties using point-process state-space framework Anna Alexandra Dreyer Harvard-MIT Division of Health Sciences and Technology Speech and
More informationComputing with Inter-spike Interval Codes in Networks of Integrate and Fire Neurons
Computing with Inter-spike Interval Codes in Networks of Integrate and Fire Neurons Dileep George a,b Friedrich T. Sommer b a Dept. of Electrical Engineering, Stanford University 350 Serra Mall, Stanford,
More informationSpike Train Measurement and Sorting
Spike Train Measurement and Sorting Christophe Pouzat May 7 2010 Contents 1 A brief introduction to a biological problem 2 2 Raw data properties 5 3 Spike sorting 6 4 Spike train analysis 15 4.1 "Qualitative"
More informationLecture 11 : Simple Neuron Models. Dr Eileen Nugent
Lecture 11 : Simple Neuron Models Dr Eileen Nugent Reading List Nelson, Biological Physics, Chapter 12 Phillips, PBoC, Chapter 17 Gerstner, Neuronal Dynamics: from single neurons to networks and models
More informationProbabilistic Models in Theoretical Neuroscience
Probabilistic Models in Theoretical Neuroscience visible unit Boltzmann machine semi-restricted Boltzmann machine restricted Boltzmann machine hidden unit Neural models of probabilistic sampling: introduction
More informationCS 361: Probability & Statistics
February 26, 2018 CS 361: Probability & Statistics Random variables The discrete uniform distribution If every value of a discrete random variable has the same probability, then its distribution is called
More informationThe Bayesian Brain. Robert Jacobs Department of Brain & Cognitive Sciences University of Rochester. May 11, 2017
The Bayesian Brain Robert Jacobs Department of Brain & Cognitive Sciences University of Rochester May 11, 2017 Bayesian Brain How do neurons represent the states of the world? How do neurons represent
More informationLateral organization & computation
Lateral organization & computation review Population encoding & decoding lateral organization Efficient representations that reduce or exploit redundancy Fixation task 1rst order Retinotopic maps Log-polar
More informationAn Introductory Course in Computational Neuroscience
An Introductory Course in Computational Neuroscience Contents Series Foreword Acknowledgments Preface 1 Preliminary Material 1.1. Introduction 1.1.1 The Cell, the Circuit, and the Brain 1.1.2 Physics of
More informationEmpirical Bayes interpretations of random point events
INSTITUTE OF PHYSICS PUBLISHING JOURNAL OF PHYSICS A: MATHEMATICAL AND GENERAL J. Phys. A: Math. Gen. 38 (25) L531 L537 doi:1.188/35-447/38/29/l4 LETTER TO THE EDITOR Empirical Bayes interpretations of
More informationSpike-Frequency Adaptation: Phenomenological Model and Experimental Tests
Spike-Frequency Adaptation: Phenomenological Model and Experimental Tests J. Benda, M. Bethge, M. Hennig, K. Pawelzik & A.V.M. Herz February, 7 Abstract Spike-frequency adaptation is a common feature of
More informationarxiv: v2 [math.pr] 14 Nov 2017
Stimulus sensitivity of a spiking neural network model Julien Chevallier AGM, UMR-CNRS 88, Université de Cergy-Pontoise, France Univ. Grenoble Alpes, CNRS, LJK, 38 Grenoble, France arxiv:79.6958v2 [math.pr]
More informationNeural Encoding I: Firing Rates and Spike Statistics
Chapter 1 Neural Encoding I: Firing Rates and Spike Statistics 1.1 Introduction Neurons are remarkable among the cells of the body in their ability to propagate signals rapidly over large distances. They
More informationRoles of Fluctuations. in Pulsed Neural Networks
Ph.D. Thesis Roles of Fluctuations in Pulsed Neural Networks Supervisor Professor Yoichi Okabe Takashi Kanamaru Department of Advanced Interdisciplinary Studies, Faculty of Engineering, The University
More informationapplications to neuroscience
UNIVERSITÀ DEGLI STUDI DI TORINO DIPARTIMENTO DI MATEMATICA GIUSEPPE PEANO SCUOLA DI SCIENZE DELLA NATURA Corso di Laurea Magistrale in Matematica Tesi di Laurea Magistrale Comparative correlation analyses
More informationA Statistical Approach to Functional Connectivity Involving Multichannel Neural Spike Trains
A Statistical Approach to Functional Connectivity Involving Multichannel Neural Spike Trains Ruiwen Zhang A dissertation submitted to the faculty of the University of North Carolina at Chapel Hill in partial
More informationPhysiology Unit 2. MEMBRANE POTENTIALS and SYNAPSES
Physiology Unit 2 MEMBRANE POTENTIALS and SYNAPSES Neuron Communication Neurons are stimulated by receptors on dendrites and cell bodies (soma) Ligand gated ion channels GPCR s Neurons stimulate cells
More informationChasing down the neural code with mathematics and modeling
ABOUT 45 mins... WITH LOTS OF ASIDES... FITS IF DELETE THE STUFF AFTER THE MOVIE OF DOTS AND GO STRAIGHT TO QUESTION -- HOW DOES THIS HAPPEN, NO NET MODEL NEEDED HERE. Chasing down the neural code with
More informationDynamical Constraints on Computing with Spike Timing in the Cortex
Appears in Advances in Neural Information Processing Systems, 15 (NIPS 00) Dynamical Constraints on Computing with Spike Timing in the Cortex Arunava Banerjee and Alexandre Pouget Department of Brain and
More informationNON-MARKOVIAN SPIKING STATISTICS OF A NEURON WITH DELAYED FEEDBACK IN PRESENCE OF REFRACTORINESS. Kseniia Kravchuk and Alexander Vidybida
MATHEMATICAL BIOSCIENCES AND ENGINEERING Volume 11, Number 1, February 214 doi:1.3934/mbe.214.11.xx pp. 1 xx NON-MARKOVIAN SPIKING STATISTICS OF A NEURON WITH DELAYED FEEDBACK IN PRESENCE OF REFRACTORINESS
More informationIntroduction and the Hodgkin-Huxley Model
1 Introduction and the Hodgkin-Huxley Model Richard Bertram Department of Mathematics and Programs in Neuroscience and Molecular Biophysics Florida State University Tallahassee, Florida 32306 Reference:
More informationNature Neuroscience: doi: /nn.2283
Supplemental Material for NN-A2678-T Phase-to-rate transformations encode touch in cortical neurons of a scanning sensorimotor system by John Curtis and David Kleinfeld Figure S. Overall distribution of
More informationNeurons and conductance-based models
Neurons and conductance-based models Jaeseung Jeong, Ph.D Department of Bio and Brain Engineering, KAIST Bilateralization ( 양측편재화 ): HAROLD:Hemispheric Asymmetry Reduction in Older Adults Prototypical
More informationThis script will produce a series of pulses of amplitude 40 na, duration 1ms, recurring every 50 ms.
9.16 Problem Set #4 In the final problem set you will combine the pieces of knowledge gained in the previous assignments to build a full-blown model of a plastic synapse. You will investigate the effects
More informationNeurophysiology. Danil Hammoudi.MD
Neurophysiology Danil Hammoudi.MD ACTION POTENTIAL An action potential is a wave of electrical discharge that travels along the membrane of a cell. Action potentials are an essential feature of animal
More informationNeurophysiology of a VLSI spiking neural network: LANN21
Neurophysiology of a VLSI spiking neural network: LANN21 Stefano Fusi INFN, Sezione Roma I Università di Roma La Sapienza Pza Aldo Moro 2, I-185, Roma fusi@jupiter.roma1.infn.it Paolo Del Giudice Physics
More informationClassification of odorants across layers in locust olfactory pathway
J Neurophysiol : 33 3,. First published February, ; doi:/jn.9.. Classification of odorants across layers in locust olfactory pathway Pavel Sanda, * Tiffany Kee,, * Nitin Gupta, 3, Mark Stopfer, 3 and Maxim
More informationMaximum Likelihood Estimation of a Stochastic Integrate-and-Fire Neural Model
Maximum Likelihood Estimation of a Stochastic Integrate-and-Fire Neural Model Jonathan W. Pillow, Liam Paninski, and Eero P. Simoncelli Howard Hughes Medical Institute Center for Neural Science New York
More informationIs the superposition of many random spike trains a Poisson process?
Is the superposition of many random spike trains a Poisson process? Benjamin Lindner Max-Planck-Institut für Physik komplexer Systeme, Dresden Reference: Phys. Rev. E 73, 2291 (26) Outline Point processes
More informationPROBABILITY DISTRIBUTIONS
Review of PROBABILITY DISTRIBUTIONS Hideaki Shimazaki, Ph.D. http://goo.gl/visng Poisson process 1 Probability distribution Probability that a (continuous) random variable X is in (x,x+dx). ( ) P x < X
More informationAnalysis of Extracellular Recordings
Analysis of Extracellular Recordings 8 8.1. Introduction This chapter presents the methods of analysis required for the oldest types of brain machine interface. These methods are (strongly) invasive, as
More informationIntroduction to Neural Networks U. Minn. Psy 5038 Spring, 1999 Daniel Kersten. Lecture 2a. The Neuron - overview of structure. From Anderson (1995)
Introduction to Neural Networks U. Minn. Psy 5038 Spring, 1999 Daniel Kersten Lecture 2a The Neuron - overview of structure From Anderson (1995) 2 Lect_2a_Mathematica.nb Basic Structure Information flow:
More informationInformation Theory and Neuroscience II
John Z. Sun and Da Wang Massachusetts Institute of Technology October 14, 2009 Outline System Model & Problem Formulation Information Rate Analysis Recap 2 / 23 Neurons Neuron (denoted by j) I/O: via synapses
More informationResearch Article Hidden Periodicity and Chaos in the Sequence of Prime Numbers
Advances in Mathematical Physics Volume 2, Article ID 5978, 8 pages doi:.55/2/5978 Research Article Hidden Periodicity and Chaos in the Sequence of Prime Numbers A. Bershadskii Physics Department, ICAR,
More informationSpike sorting in the frequency domain with overlap detection
Spike sorting in the frequency domain with overlap detection arxiv:physics/0306056 v2 9 Jun 2003 Dima Rinberg 1 William Bialek 2 Hanan Davidowitz 3 Naftali Tishby 4 NEC Research Institute, 4 Independence
More informationA realistic neocortical axonal plexus model has implications for neocortical processing and temporal lobe epilepsy
A realistic neocortical axonal plexus model has implications for neocortical processing and temporal lobe epilepsy Neocortical Pyramidal Cells Can Send Signals to Post-Synaptic Cells Without Firing Erin
More informationTHE retina in general consists of three layers: photoreceptors
CS229 MACHINE LEARNING, STANFORD UNIVERSITY, DECEMBER 2016 1 Models of Neuron Coding in Retinal Ganglion Cells and Clustering by Receptive Field Kevin Fegelis, SUID: 005996192, Claire Hebert, SUID: 006122438,
More informationConstruction and analysis of non-poisson stimulus-response models of neural spiking activity
Journal of Neuroscience Methods 105 (2001) 25 37 www.elsevier.com/locate/jneumeth Construction and analysis of non-poisson stimulus-response models of neural spiking activity Riccardo Barbieri a, *, Michael
More informationModel neurons!!poisson neurons!
Model neurons!!poisson neurons! Suggested reading:! Chapter 1.4 in Dayan, P. & Abbott, L., heoretical Neuroscience, MI Press, 2001.! Model neurons: Poisson neurons! Contents: Probability of a spike sequence
More informationDynamic Causal Modelling for evoked responses J. Daunizeau
Dynamic Causal Modelling for evoked responses J. Daunizeau Institute for Empirical Research in Economics, Zurich, Switzerland Brain and Spine Institute, Paris, France Overview 1 DCM: introduction 2 Neural
More informationStatistics Random Variables
1 Statistics Statistics are used in a variety of ways in neuroscience. Perhaps the most familiar example is trying to decide whether some experimental results are reliable, using tests such as the t-test.
More informationMemory and hypoellipticity in neuronal models
Memory and hypoellipticity in neuronal models S. Ditlevsen R. Höpfner E. Löcherbach M. Thieullen Banff, 2017 What this talk is about : What is the effect of memory in probabilistic models for neurons?
More informationStructure and Measurement of the brain lecture notes
Structure and Measurement of the brain lecture notes Marty Sereno 2009/2010!"#$%&'(&#)*%$#&+,'-&.)"/*"&.*)*-'(0&1223 Neurons and Models Lecture 1 Topics Membrane (Nernst) Potential Action potential/voltage-gated
More informationExercise 15 : Cable Equation
Biophysics of Neural Computation : Introduction to Neuroinformatics WS 2008-2009 Prof. Rodney Douglas, Kevan Martin, Hans Scherberger, Matthew Cook Ass. Frederic Zubler fred@ini.phys.ethz.ch http://www.ini.uzh.ch/
More informationNerve Signal Conduction. Resting Potential Action Potential Conduction of Action Potentials
Nerve Signal Conduction Resting Potential Action Potential Conduction of Action Potentials Resting Potential Resting neurons are always prepared to send a nerve signal. Neuron possesses potential energy
More informationContinuous case Discrete case General case. Hazard functions. Patrick Breheny. August 27. Patrick Breheny Survival Data Analysis (BIOS 7210) 1/21
Hazard functions Patrick Breheny August 27 Patrick Breheny Survival Data Analysis (BIOS 7210) 1/21 Introduction Continuous case Let T be a nonnegative random variable representing the time to an event
More informationESTIMATING SCALING EXPONENTS IN AUDITORY-NERVE SPIKE TRAINS USING FRACTAL MODELS INCORPORATING REFRACTORINESS
ESTIMATING SCALING EXPONENTS IN AUDITORY-NERVE SPIKE TRAINS USING FRACTAL MODELS INCORPORATING REFRACTORINESS S.B. LOWEN Department of Electrical and Computer Engineering 44 Cummington Street Boston University,
More informationInfinite systems of interacting chains with memory of variable length - a stochastic model for biological neural nets
Infinite systems of interacting chains with memory of variable length - a stochastic model for biological neural nets Antonio Galves Universidade de S.Paulo Fapesp Center for Neuromathematics Eurandom,
More informationMethods for Estimating the Computational Power and Generalization Capability of Neural Microcircuits
Methods for Estimating the Computational Power and Generalization Capability of Neural Microcircuits Wolfgang Maass, Robert Legenstein, Nils Bertschinger Institute for Theoretical Computer Science Technische
More informationEmergence of resonances in neural systems: the interplay between adaptive threshold and short-term synaptic plasticity
Emergence of resonances in neural systems: the interplay between adaptive threshold and short-term synaptic plasticity Jorge F. Mejias 1,2 and Joaquín J. Torres 2 1 Department of Physics and Center for
More informationStochastic modeling of a serial killer
This paper appeared in the Journal of Theoretical Biology (24) 355: 6 Stochastic modeling of a serial killer M.V. Simkin and V.P. Roychowdhury Department of Electrical Engineering, University of California,
More informationTopological target patterns and population oscillations in a network with random gap junctional coupling
0 0 0 0 Neurocomputing }0 (00) } Topological target patterns and population oscillations in a network with random gap junctional coupling Timothy J. Lewis*, John Rinzel Center for Neural Science and Courant
More informationAnnouncements: Test4: Wednesday on: week4 material CH5 CH6 & NIA CAPE Evaluations please do them for me!! ask questions...discuss listen learn.
Announcements: Test4: Wednesday on: week4 material CH5 CH6 & NIA CAPE Evaluations please do them for me!! ask questions...discuss listen learn. The Chemical Senses: Olfaction Mary ET Boyle, Ph.D. Department
More informationSynaptic Input. Linear Model of Synaptic Transmission. Professor David Heeger. September 5, 2000
Synaptic Input Professor David Heeger September 5, 2000 The purpose of this handout is to go a bit beyond the discussion in Ch. 6 of The Book of Genesis on synaptic input, and give some examples of how
More informationIntroduction Biologically Motivated Crude Model Backpropagation
Introduction Biologically Motivated Crude Model Backpropagation 1 McCulloch-Pitts Neurons In 1943 Warren S. McCulloch, a neuroscientist, and Walter Pitts, a logician, published A logical calculus of the
More informationNeocortical Pyramidal Cells Can Control Signals to Post-Synaptic Cells Without Firing:
Neocortical Pyramidal Cells Can Control Signals to Post-Synaptic Cells Without Firing: a model of the axonal plexus Erin Munro Department of Mathematics Boston University 4/14/2011 Gap junctions on pyramidal
More informationDeconstructing Actual Neurons
1 Deconstructing Actual Neurons Richard Bertram Department of Mathematics and Programs in Neuroscience and Molecular Biophysics Florida State University Tallahassee, Florida 32306 Reference: The many ionic
More informationCSE/NB 528 Final Lecture: All Good Things Must. CSE/NB 528: Final Lecture
CSE/NB 528 Final Lecture: All Good Things Must 1 Course Summary Where have we been? Course Highlights Where do we go from here? Challenges and Open Problems Further Reading 2 What is the neural code? What
More informationNeurons. The Molecular Basis of their Electrical Excitability
Neurons The Molecular Basis of their Electrical Excitability Viva La Complexity! Consider, The human brain contains >10 11 neurons! Each neuron makes 10 3 (average) synaptic contacts on up to 10 3 other
More informationSimulation, Estimation and Applications of Hawkes Processes
Simulation, Estimation and Applications of Hawkes Processes A PROJECT SUBMITTED TO THE FACULTY OF THE GRADUATE SCHOOL OF THE UNIVERSITY OF MINNESOTA BY Katarzyna Obral IN PARTIAL FULFILLMENT OF THE REQUIREMENTS
More informationBasic elements of neuroelectronics -- membranes -- ion channels -- wiring
Computing in carbon Basic elements of neuroelectronics -- membranes -- ion channels -- wiring Elementary neuron models -- conductance based -- modelers alternatives Wires -- signal propagation -- processing
More informationVoltage-clamp and Hodgkin-Huxley models
Voltage-clamp and Hodgkin-Huxley models Read: Hille, Chapters 2-5 (best) Koch, Chapters 6, 8, 9 See also Clay, J. Neurophysiol. 80:903-913 (1998) (for a recent version of the HH squid axon model) Rothman
More informationA Monte Carlo Sequential Estimation for Point Process Optimum Filtering
2006 International Joint Conference on Neural Networks Sheraton Vancouver Wall Centre Hotel, Vancouver, BC, Canada July 16-21, 2006 A Monte Carlo Sequential Estimation for Point Process Optimum Filtering
More informationDiscrete Time Rescaling Theorem: Determining Goodness of Fit for Statistical Models of Neural Spiking
Discrete Time Rescaling Theorem: Determining Goodness of Fit for Statistical Models of Neural Spiking The MIT Faculty has made this article openly available. Please share how this access benefits you.
More informationNeural Networks 1 Synchronization in Spiking Neural Networks
CS 790R Seminar Modeling & Simulation Neural Networks 1 Synchronization in Spiking Neural Networks René Doursat Department of Computer Science & Engineering University of Nevada, Reno Spring 2006 Synchronization
More informationPoisson Processes for Neuroscientists
Poisson Processes for Neuroscientists Thibaud Taillefumier This note is an introduction to the key properties of Poisson processes, which are extensively used to simulate spike trains. For being mathematical
More informationBIOELECTRIC PHENOMENA
Chapter 11 BIOELECTRIC PHENOMENA 11.3 NEURONS 11.3.1 Membrane Potentials Resting Potential by separation of charge due to the selective permeability of the membrane to ions From C v= Q, where v=60mv and
More informationSupporting Online Material for
www.sciencemag.org/cgi/content/full/319/5869/1543/dc1 Supporting Online Material for Synaptic Theory of Working Memory Gianluigi Mongillo, Omri Barak, Misha Tsodyks* *To whom correspondence should be addressed.
More informationSynchrony in Neural Systems: a very brief, biased, basic view
Synchrony in Neural Systems: a very brief, biased, basic view Tim Lewis UC Davis NIMBIOS Workshop on Synchrony April 11, 2011 components of neuronal networks neurons synapses connectivity cell type - intrinsic
More information10/8/2014. The Multivariate Gaussian Distribution. Time-Series Plot of Tetrode Recordings. Recordings. Tetrode
10/8/014 9.07 INTRODUCTION TO STATISTICS FOR BRAIN AND COGNITIVE SCIENCES Lecture 4 Emery N. Brown The Multivariate Gaussian Distribution Case : Probability Model for Spike Sorting The data are tetrode
More informationNeural Encoding: Firing Rates and Spike Statistics
Neural Encoding: Firing Rates and Spike Statistics Dayan and Abbott (21) Chapter 1 Instructor: Yoonsuck Choe; CPSC 644 Cortical Networks Background: Dirac δ Function Dirac δ function has the following
More informationBayesian probability theory and generative models
Bayesian probability theory and generative models Bruno A. Olshausen November 8, 2006 Abstract Bayesian probability theory provides a mathematical framework for peforming inference, or reasoning, using
More informationCISC 3250 Systems Neuroscience
CISC 3250 Systems Neuroscience Systems Neuroscience How the nervous system performs computations How groups of neurons work together to achieve intelligence Professor Daniel Leeds dleeds@fordham.edu JMH
More informationAvailable online at ScienceDirect. Procedia Computer Science 37 (2014 )
Available online at www.sciencedirect.com ScienceDirect Procedia Computer Science 37 (2014 ) 428 433 The International Workshop on Intelligent Technologies for HealthCare (ITCare) Capacity Analysis of
More informationMid Year Project Report: Statistical models of visual neurons
Mid Year Project Report: Statistical models of visual neurons Anna Sotnikova asotniko@math.umd.edu Project Advisor: Prof. Daniel A. Butts dab@umd.edu Department of Biology Abstract Studying visual neurons
More informationarxiv: v2 [q-bio.nc] 3 Dec 2013
Spike-timing prediction with active dendrites Richard Naud 1, Brice Bathellier 2 and Wulfram Gerstner 3 1 Department of Physics, University of Ottawa, 150 Louis Pasteur, ON, K1N 6N5, Canada. 2 Unit of
More informationOn oscillating systems of interacting neurons
Susanne Ditlevsen Eva Löcherbach Nice, September 2016 Oscillations Most biological systems are characterized by an intrinsic periodicity : 24h for the day-night rhythm of most animals, etc... In other
More informationSimulating events: the Poisson process
Simulating events: te Poisson process p. 1/15 Simulating events: te Poisson process Micel Bierlaire micel.bierlaire@epfl.c Transport and Mobility Laboratory Simulating events: te Poisson process p. 2/15
More informationA new look at state-space models for neural data
A new look at state-space models for neural data Liam Paninski Department of Statistics and Center for Theoretical Neuroscience Columbia University http://www.stat.columbia.edu/ liam liam@stat.columbia.edu
More informationSampling-based probabilistic inference through neural and synaptic dynamics
Sampling-based probabilistic inference through neural and synaptic dynamics Wolfgang Maass for Robert Legenstein Institute for Theoretical Computer Science Graz University of Technology, Austria Institute
More informationHigh-dimensional geometry of cortical population activity. Marius Pachitariu University College London
High-dimensional geometry of cortical population activity Marius Pachitariu University College London Part I: introduction to the brave new world of large-scale neuroscience Part II: large-scale data preprocessing
More informationInventory of Supplemental Information
Neuron, Volume 71 Supplemental Information Hippocampal Time Cells Bridge the Gap in Memory for Discontiguous Events Christopher J. MacDonald, Kyle Q. Lepage, Uri T. Eden, and Howard Eichenbaum Inventory
More informationIntegration of synaptic inputs in dendritic trees
Integration of synaptic inputs in dendritic trees Theoretical Neuroscience Fabrizio Gabbiani Division of Neuroscience Baylor College of Medicine One Baylor Plaza Houston, TX 77030 e-mail:gabbiani@bcm.tmc.edu
More information