The homogeneous Poisson process

Similar documents
Consider the following spike trains from two different neurons N1 and N2:

Neural Encoding: Firing Rates and Spike Statistics

Model neurons!!poisson neurons!

+ + ( + ) = Linear recurrent networks. Simpler, much more amenable to analytic treatment E.g. by choosing

Neuronal Dynamics: Computational Neuroscience of Single Neurons

Exercises. Chapter 1. of τ approx that produces the most accurate estimate for this firing pattern.

AT2 Neuromodeling: Problem set #3 SPIKE TRAINS

SPIKE TRIGGERED APPROACHES. Odelia Schwartz Computational Neuroscience Course 2017

encoding and estimation bottleneck and limits to visual fidelity

The Bayesian Brain. Robert Jacobs Department of Brain & Cognitive Sciences University of Rochester. May 11, 2017

Neural Coding: Integrate-and-Fire Models of Single and Multi-Neuron Responses

What is the neural code? Sekuler lab, Brandeis

Finding a Basis for the Neural State

Describing Spike-Trains

Neural variability and Poisson statistics

Evolution of the Average Synaptic Update Rule

Is the superposition of many random spike trains a Poisson process?

Lateral organization & computation

An Introductory Course in Computational Neuroscience

Real and Modeled Spike Trains: Where Do They Meet?

!) + log(t) # n i. The last two terms on the right hand side (RHS) are clearly independent of θ and can be

Poisson Processes for Neuroscientists

Membrane equation. VCl. dv dt + V = V Na G Na + V K G K + V Cl G Cl. G total. C m. G total = G Na + G K + G Cl

Mid Year Project Report: Statistical models of visual neurons

1/12/2017. Computational neuroscience. Neurotechnology.

The Spike Response Model: A Framework to Predict Neuronal Spike Trains

CORRELATION TRANSFER FROM BASAL GANGLIA TO THALAMUS IN PARKINSON S DISEASE. by Pamela Reitsma. B.S., University of Maine, 2007

CHARACTERIZATION OF NONLINEAR NEURON RESPONSES

Bayesian Estimation of Stimulus Responses in Poisson Spike Trains

Computing with Inter-spike Interval Codes in Networks of Integrate and Fire Neurons

Math in systems neuroscience. Quan Wen

Neural Encoding I: Firing Rates and Spike Statistics

Neural Spike Train Analysis 1: Introduction to Point Processes

Neural Excitability in a Subcritical Hopf Oscillator with a Nonlinear Feedback

How to read a burst duration code

Disambiguating Different Covariation Types

Information Theory and Neuroscience II

Spike Count Correlation Increases with Length of Time Interval in the Presence of Trial-to-Trial Variation

The Mixed States of Associative Memories Realize Unimodal Distribution of Dominance Durations in Multistable Perception

Nature Neuroscience: doi: /nn.2283

CSE/NB 528 Final Lecture: All Good Things Must. CSE/NB 528: Final Lecture

Hopfield Neural Network and Associative Memory. Typical Myelinated Vertebrate Motoneuron (Wikipedia) Topic 3 Polymers and Neurons Lecture 5

Sean Escola. Center for Theoretical Neuroscience

High-conductance states in a mean-eld cortical network model

Visual motion processing and perceptual decision making

Neurons and conductance-based models

Available online at ScienceDirect. Procedia Computer Science 37 (2014 )

How to do backpropagation in a brain

THE TRANSFER AND PROPAGATION OF CORRELATED NEURONAL ACTIVITY

Probing Real Sensory Worlds of Receivers with Unsupervised Clustering

Linking non-binned spike train kernels to several existing spike train metrics

When is an Integrate-and-fire Neuron like a Poisson Neuron?

CHARACTERIZATION OF NONLINEAR NEURON RESPONSES

Maximum Likelihood Estimation of a Stochastic Integrate-and-Fire Neural Model

Reinforcement Learning and Time Perception - a Model of Animal Experiments

arxiv: v3 [q-bio.nc] 17 Oct 2018

SUPPLEMENTARY INFORMATION

Artificial Neural Networks Examination, March 2004

SPATIOTEMPORAL ANALYSIS OF SYNCHRONIZATION OF NEURAL ENSEMBLES FOR SPATIAL DISCRIMINATIONS IN CAT STRIATE CORTEX

3.3 Population Decoding

Exercise Sheet 4: Covariance and Correlation, Bayes theorem, and Linear discriminant analysis

Stochastic modeling of a serial killer

Neural Encoding Models

Dynamical Constraints on Computing with Spike Timing in the Cortex

RESEARCH STATEMENT. Nora Youngs, University of Nebraska - Lincoln

Mathematical Neuroscience. Course: Dr. Conor Houghton 2010 Typeset: Cathal Ormond

This cannot be estimated directly... s 1. s 2. P(spike, stim) P(stim) P(spike stim) =

Spike-Frequency Adaptation: Phenomenological Model and Experimental Tests

Synchronization, oscillations, and 1/ f noise in networks of spiking neurons

Methods for Estimating the Computational Power and Generalization Capability of Neural Microcircuits

Measuring spike train reliability

Signal detection theory

Decoding Poisson Spike Trains by Gaussian Filtering

Phenomenological Models of Neurons!! Lecture 5!

Information Theory. Mark van Rossum. January 24, School of Informatics, University of Edinburgh 1 / 35

PROBABILITY DISTRIBUTIONS

Comparing integrate-and-fire models estimated using intracellular and extracellular data 1

System Identification of Adapting Neurons

Computation in a single neuron: Hodgkin and Huxley revisited

Encoding or decoding

Synaptic dynamics. John D. Murray. Synaptic currents. Simple model of the synaptic gating variable. First-order kinetics

Supporting Online Material for

When do Correlations Increase with Firing Rates? Abstract. Author Summary. Andrea K. Barreiro 1* and Cheng Ly 2

Synaptic input statistics tune the variability and reproducibility of neuronal responses

Robust regression and non-linear kernel methods for characterization of neuronal response functions from limited data

Diego A. Gutnisky and Kresimir Josic J Neurophysiol 103: , First published Dec 23, 2009; doi: /jn

Using persistent homology to reveal hidden information in neural data

Communication Theory II

Construction and analysis of non-poisson stimulus-response models of neural spiking activity

A gradient descent rule for spiking neurons emitting multiple spikes

3 Neural Decoding. 3.1 Encoding and Decoding. (r 1, r 2,..., r N ) for N neurons is a list of spike-count firing rates, although,

Internally generated preactivation of single neurons in human medial frontal cortex predicts volition

Characterization of Nonlinear Neuron Responses

Introduction to Neural Networks U. Minn. Psy 5038 Spring, 1999 Daniel Kersten. Lecture 2a. The Neuron - overview of structure. From Anderson (1995)

Transformation of stimulus correlations by the retina

Phase Locking. 1 of of 10. The PRC's amplitude determines which frequencies a neuron locks to. The PRC's slope determines if locking is stable

Implications of Spike Trains as Event Sequences (revised) 1:14 PM 04/04/12 SPIKE TRAINS AS EVENT SEQUENCES: FUNDAMENTAL IMPLICATIONS

Mathematical Tools for Neuroscience (NEU 314) Princeton University, Spring 2016 Jonathan Pillow. Homework 8: Logistic Regression & Information Theory

A Multivariate Time-Frequency Based Phase Synchrony Measure for Quantifying Functional Connectivity in the Brain

Mathematical Models of Dynamic Behavior of Individual Neural Networks of Central Nervous System

Transcription:

The homogeneous Poisson process during very short time interval Δt there is a fixed probability of an event (spike) occurring independent of what happened previously if r is the rate of the Poisson process, then the probability of finding a spike in a short interval Δt is given by r Δt. ( ) The probability of seeing exactly n spikes in a (long) interval T is given by the Poisson distribution: = = (r ) ( r )

Derivation Divide time T into bins Δt=T/M. The probability of a spike occurring in one specific bin is rδt P T [n] is product of three factors: 1. probability of generating n spikes within a specified set of the M bins. 2. probability of not generating spikes in the remaining M n bins 3. combinatorial factor equal to number of ways of putting n spikes into M bins Thus, the probability of seeing exactly n spikes in T is = (binomial distribution) ( ) (r ) ( r )

Derivation (cont.) For Δt->0, M=T/Δt grows without bound and thus: Further: = ( ) (r ) ( r ) M! (M n)! = M(M 1)(M 2) (M n + 1) M n = T n t n ( ) ln(1 r t) M n =(M n)ln(1 r t) Mr t = Tr and thus (1 r t) M n = e Tr = Therefore = (r ) ( r )

Gaussian fit ( ) = = (r ) Properties: mean: E[n] = rt variance: E[ (n - E[n]) 2 ] = rt Fano factor: variance/mean = 1 ( r ) good approximation by Gaussian for large rt (see fig. B)

Interspike interval distribution of homogeneous Poisson process Suppose a spike occurred at time t i Probability of generating next spike somewhere in interval is equal to the probability that no spike is fired for a time τ, times the probability, rδt, of generating spike within the following Δt. + Thus + τ + < + τ + τ + < τ + = r ( rτ) The probability density of interspike intervals is, by definition, this probability with the factor Δt removed:

Interspike interval distribution of homogeneous Poisson process is given by exponential distribution (short interspike intervals frequent, long ones rare): Mean: Variance: Coefficient of variation: Note: Fano factor and C V of 1 are necessary but not sufficient for a Poisson process!

Comparison of Poisson model with data: mean and variance fit data to model: Poisson: A=B=1 A: 94 cells macaque MT, 256ms, various conditions: Fano factor (slope) is about one B, C: parameters A and B as a function of the duration of the counting window

Comparison with data: inter-spike interval distribution from monkey MT neuron for moving random-dot image Poisson: distribution should be exponential Experimental: absolute and relative refractory period produce shortage of small inter-spike intervals (left) Improved model (right): use refractory period of variable duration (Gaussian with mean 5 ms and standard deviation 2ms) after which Poisson model is used again.

The Inhomogeneous Poisson process when firing rate depends on time situation is more complicated: probability of each spike depends on current firing rate r(t) Poisson Spike Generator (to create artificial spike trains): first calculate estimate of firing rate r est (t) for every time t divide time into short intervals Δt for every interval generate spike with probability r est (t) Δt by simply drawing a uniform number from [0, 1] and checking if it is smaller than r est (t) Δt. In that case generate a spike. r est (t) may be derived from knowledge of stimulus and fitted response tuning function Note: to capture refractory effects, can set rate to zero after spike and then let it exponentially return to predicted value

constant current constant current moving grating Notes: intracellular recordings from cat V1 neurons simple Poisson model provides reasonable fit in many but not all situations does not provide mechanistic explanation of where variability comes from. In fact, spike generation in neurons seems to be a quite reliable process (left) in vivo, however, things tend to look more irregular some neurons tend to fire bursts of spikes

Spike-Train Autocorrelation Function interspike interval distribution relates times of successive spikes. Let s generalize to relation between any spikes autocorrelation = of the neural response function with its average over time and trials subtracted out: ρρ (τ) = (ρ( ) )(ρ( + τ) ) symmetry: for a homogeneous Poisson process (recall: no dependencies between events): due to mean subtraction this really is a covariance!

Cross-correlation function (generally not symmetric): Figure: auto-correlation (A) and cross-correlation (B) functions indicating synchronous oscillatory activity at 40Hz (gamma band) across both brain hemispheres; Neurons from cat V1, left and right hemisphere.

1.5 The Neural Code

The Neural Code Main ideas: Independent-Spike code Independent-Neuron code Correlation codes synchrony and oscillations temporal code

Independent Spike Code: consider spike generation due to a Poisson process: in this case the time-dependent firing rate r(t) contains all the information about the stimulus that can be extracted from the spike train. Relative timing of spikes contains no additional information about stimulus. Correlation Code: individual spikes do not encode independently of each other. Correlations between spikes may carry additional information about the stimulus. The amount of this information should be significant to warrant using the term correlation code. Example: information could be encoded in the duration of inter-spike intervals Although some extra information may be in correlations between spikes, independent spike-coding seems reasonable approximation

Independent Neuron Code: assumes that neurons act independently. This does not mean that spike trains from different neurons are not combined into an ensemble code, it just means that the code can be decoded without taking correlations between neurons into account. Synchronous firing of two or more neurons is one mechanism for conveying extra information compared to an independent neuron code. Synchronous firing and timelocked oscillations are frequent, but the presence of synchronicity by itself does not mean that these correlations carry additional information.

Hippocampal Place Cells: One example where additional information seems to be carried by correlations between firing patterns within a population. The phase of firing within a theta cycle correlates with the position of the animal

Temporal Codes: How precisely must we measure spike times or ratefluctuations in order to see all the information contained in the spike train about the stimulus? If high precision required we might say: temporal code But: is structure at high temporal frequency solely resulting from the dynamics of the stimulus? Maybe we should require information carried by temporal fine structure that is clearly faster than any variations in the stimulus.

time-dependent firing of an MT neuron in response to three different time-varying stimuli. rate code? temporal code?

1.6 Chapter Summary

Key Concepts neuron, synapse, neurotransmitter, spike, spike train different notions of firing rate tuning curve spike-triggered average white noise stimulus homogeneous Poisson process interspike interval distribution spike train autocorrelation inhomogeneous Poisson process Poisson spike generator neural code