Model neurons!!poisson neurons!

Similar documents
The homogeneous Poisson process

Neural Encoding: Firing Rates and Spike Statistics

Consider the following spike trains from two different neurons N1 and N2:

Membrane equation. VCl. dv dt + V = V Na G Na + V K G K + V Cl G Cl. G total. C m. G total = G Na + G K + G Cl

AT2 Neuromodeling: Problem set #3 SPIKE TRAINS

Neuronal Dynamics: Computational Neuroscience of Single Neurons

Synaptic Input. Linear Model of Synaptic Transmission. Professor David Heeger. September 5, 2000

Computing with Inter-spike Interval Codes in Networks of Integrate and Fire Neurons

Information Theory and Neuroscience II

When is an Integrate-and-fire Neuron like a Poisson Neuron?

Exercises. Chapter 1. of τ approx that produces the most accurate estimate for this firing pattern.

Probabilistic Models in Theoretical Neuroscience

Lateral organization & computation

+ + ( + ) = Linear recurrent networks. Simpler, much more amenable to analytic treatment E.g. by choosing

The Bayesian Brain. Robert Jacobs Department of Brain & Cognitive Sciences University of Rochester. May 11, 2017

Sean Escola. Center for Theoretical Neuroscience

Correlations and neural information coding Shlens et al. 09

Finding a Basis for the Neural State

Decoding Input Signals in Time Domain A Model Approach

The Spike Response Model: A Framework to Predict Neuronal Spike Trains

Spike Count Correlation Increases with Length of Time Interval in the Presence of Trial-to-Trial Variation

Neural variability and Poisson statistics

Computing with inter-spike interval codes in networks ofintegrate and fire neurons

Spike-Frequency Adaptation: Phenomenological Model and Experimental Tests

CHARACTERIZATION OF NONLINEAR NEURON RESPONSES

REAL-TIME COMPUTING WITHOUT STABLE

Research Article Hidden Periodicity and Chaos in the Sequence of Prime Numbers

encoding and estimation bottleneck and limits to visual fidelity

Leo Kadanoff and 2d XY Models with Symmetry-Breaking Fields. renormalization group study of higher order gradients, cosines and vortices

Modeling the Milk-Ejection Reflex! Gareth Leng and collaborators!

Describing Spike-Trains

An algorithm for detecting oscillatory behavior in discretized data: the damped-oscillator oscillator detector

neural networks Balázs B Ujfalussy 17 october, 2016 idegrendszeri modellezés 2016 október 17.

Introduction to Neural Networks U. Minn. Psy 5038 Spring, 1999 Daniel Kersten. Lecture 2a. The Neuron - overview of structure. From Anderson (1995)

Biological Modeling of Neural Networks:

Neural Spike Train Analysis 1: Introduction to Point Processes

Modelling stochastic neural learning

Bayesian Estimation of Stimulus Responses in Poisson Spike Trains

Is the superposition of many random spike trains a Poisson process?

Dynamical phase transitions in periodically driven model neurons

Decoding Poisson Spike Trains by Gaussian Filtering

Poisson Processes for Neuroscientists

Analyzing Neuroscience Signals using Information Theory and Complexity

Estimation of information-theoretic quantities

Mid Year Project Report: Statistical models of visual neurons

Broadband coding with dynamic synapses

An Introductory Course in Computational Neuroscience

Several ways to solve the MSO problem

EEG- Signal Processing

Maximum Likelihood Estimation of a Stochastic Integrate-and-Fire Neural Model

How do synapses transform inputs?

Characterization of Nonlinear Neuron Responses

Synchrony in Neural Systems: a very brief, biased, basic view

How to read a burst duration code

Math in systems neuroscience. Quan Wen

Stochastic modeling of a serial killer

Nonrenewal Statistics of Electrosensory Afferent Spike Trains: Implications for the Detection of Weak Sensory Signals

arxiv:cond-mat/ v2 27 Jun 1997

What is the neural code? Sekuler lab, Brandeis

Neural Encoding I: Firing Rates and Spike Statistics

Firing Rate Distributions and Ef ciency of Information Transmission of Inferior Temporal Cortex Neurons to Natural Visual Stimuli

SPIKE TRIGGERED APPROACHES. Odelia Schwartz Computational Neuroscience Course 2017

Information Theory. Mark van Rossum. January 24, School of Informatics, University of Edinburgh 1 / 35

Synaptic input statistics tune the variability and reproducibility of neuronal responses

Activity Driven Adaptive Stochastic. Resonance. Gregor Wenning and Klaus Obermayer. Technical University of Berlin.

Synfire Waves in Small Balanced Networks

Active Sequential Hypothesis Testing with Application to a Visual Search Problem

THE retina in general consists of three layers: photoreceptors

Activity of any neuron with delayed feedback stimulated with Poisson stream is non-markov

Fast neural network simulations with population density methods

The receptive fields of neurons are dynamic; that is, their

Neuronal Dynamics: Computational Neuroscience of Single Neurons

This script will produce a series of pulses of amplitude 40 na, duration 1ms, recurring every 50 ms.

Dynamical Constraints on Computing with Spike Timing in the Cortex

Pseudo-Lyapunov exponents and predictability of Hodgkin-Huxley neuronal network dynamics

Patterns of Synchrony in Neural Networks with Spike Adaptation

High-conductance states in a mean-eld cortical network model

Relation between Single Neuron and Population Spiking Statistics and Effects on Network Activity

ESTIMATING SCALING EXPONENTS IN AUDITORY-NERVE SPIKE TRAINS USING FRACTAL MODELS INCORPORATING REFRACTORINESS

Single-Compartment Neural Models

Introduction to Neural Networks. Daniel Kersten. Lecture 2. Getting started with Mathematica. Review this section in Lecture 1

Real and Modeled Spike Trains: Where Do They Meet?

Fitting a Stochastic Neural Network Model to Real Data

Characterization of Nonlinear Neuron Responses

CHARACTERIZATION OF NONLINEAR NEURON RESPONSES

Empirical Bayes interpretations of random point events

Nature Neuroscience: doi: /nn.2283

Emergence of resonances in neural systems: the interplay between adaptive threshold and short-term synaptic plasticity

Neurons as Monte Carlo Samplers: Bayesian Inference and Learning in Spiking Networks

Implications of Spike Trains as Event Sequences (revised) 1:14 PM 04/04/12 SPIKE TRAINS AS EVENT SEQUENCES: FUNDAMENTAL IMPLICATIONS

1/12/2017. Computational neuroscience. Neurotechnology.

Evolution of the Average Synaptic Update Rule

A DYNAMICAL STATE UNDERLYING THE SECOND ORDER MAXIMUM ENTROPY PRINCIPLE IN NEURONAL NETWORKS

Most Probable Escape Path Method and its Application to Leaky Integrate And Fire Neurons

unit P[r x*] C decode encode unit P[x r] f(x) x D

Available online at ScienceDirect. Procedia Computer Science 37 (2014 )

Diego A. Gutnisky and Kresimir Josic J Neurophysiol 103: , First published Dec 23, 2009; doi: /jn

Simulation of DART Buoy Data

Comparing integrate-and-fire models estimated using intracellular and extracellular data 1

Supporting Online Material for

Transcription:

Model neurons!!poisson neurons! Suggested reading:! Chapter 1.4 in Dayan, P. & Abbott, L., heoretical Neuroscience, MI Press, 2001.! Model neurons: Poisson neurons! Contents: Probability of a spike sequence Homogeneous Poisson process Poisson distribution Poisson spike generator

Motivation! Model neurons: Poisson neurons! 3! In the cortex, the timing of successive action potentials is highly irregular. his irregularity might arise from stochastic forces. If so, the irregular interspike interval reflects a random process and implies that an instantaneous estimate of the spike rate can be obtained by averaging the pooled responses of many individual neurons.! In keeping with this theory, one would expect that the precise timing of individual spikes conveys little information.! We assume that the generation of each spike depends only on an underlying continuous/analog driving signal, r(, that we will refer to as the instantaneous firing rate. It follows that the generation of each spike is independent of all the other spikes, hence we refer to this as the independent spike hypothesis.! If the independent spike hypothesis were true, then the spike train would be completely described a particular kind of random process called a Poisson process.! Probability of a spike sequence! Model neurons: Poisson neurons! 4! Assumption: he relationship between spikes and stimulus is stochastic! Probability that a spike occurs within an interval!t :! P = p[ t]! t Spike train with a probability density! p[ t, t2,..., t 1 n! requires to determine all probability densities! ] Simplification:! An action potential is independent of the presence of other spikes.!

Homogeneous Poisson process! Model neurons: Poisson neurons! 5! Assume the average firing rate of a cell is constant:! r ( = r! Every sequence of n spikes over a fixed time interval has an equal!!probability. (Example)! hus, the spike train with a probability! P t, t,..., t ] [ 1 2 n can be expressed by a probability function that considers only the number of spikes! P [n] within a duration! Divide the time into M bins of size! "t = / M We assume that!t is small enough such that we never get two spikes within any one bin.! Homogeneous Poisson process! Model neurons: Poisson neurons! 6! [n] P is the product of three factors:! the probability of generating n spikes within M bins! the probability of not generating spikes in the remaining bins! a combinatorial factor equal to the number of ways of putting n spikes into M bins! he firing rate r determines the probability of firing a single spike in a small! interval around the time t. he probability of a single spike occurring in one! specific bin is! r!t he probability of n spikes appearing in n specific bins! is! ( r! n he probability of not having a spike in a given bi is! 1" r!t

Homogeneous Poisson process! Model neurons: Poisson neurons! 7! he probability of having the remaining M-n bins without any spikes in them! is! (1! r" he number of ways of putting n spikes into M bins is given by the binomial! coefficient! ( M M!! n)! n balls from a ballet with M balls! As a result we get! lim M! " t # 0 ( )! = n ( r" (1! r" t ) For the limit! "t! 0 M grows without bound (n is fixed)! Homogeneous Poisson process! Model neurons: Poisson neurons! 8! lim M! " t # 0 ( )! = n ( r" (1! r" t ) For the limit! "t! 0 M grows without bound (n is fixed)! M # n " M =! t lim "t # 0 (1$ r"m $n % lim "t # 0 (1$ r"m = lim ' 1 & # 0 (1+ &) * & ), ( + & because by definitio lim $ ( ' 0 (1 + () % 1 ( $r = e $r using! # = "r!t #! = e "

Homogeneous Poisson process! Model neurons: Poisson neurons! 9! lim M! " t # 0 ( )! = n ( r" (1! r" t ) lim "t # 0 (1$ r"m $n % e $r For large M:! M! (M " n)! # M n = ( $ n this leads to! ( P [n] " #t ) n (r# n e $r Poisson distributio Model neurons: Poisson neurons! 10! As a result we get the Poisson distributio = ( r ) n e! r r =10 Gaussia

Poisson spike generator! Simple version:! For designing a spike generator within a computer program, we can use the fact that the probability of firing a spike within a short interval is! r!t As long as the rate varies slowly with respect the the time interval we can still use this approach. he rate function r( is sampled with a sampling interval of!t to produce a discrete-time sequence r[i].! he program can simply progress in time through small time steps!t and generate, at each time step, a random variable x rand between 0 and 1 and compare this with the probability of firing a spike.! & > x ri ( t% $ ' x rand rand fire a spike# nothing "! Model neurons: Poisson neurons! 11! his method is appropriate for small steps!t, e.g. 1ms and each spike is! assigned a discrete time bin, not a continuous time value.! Example:! Model neurons: Poisson neurons! 12! he instantaneous firing rate was chosen to be r=100 spikes/second, and the time binsize was chosen to be =1msec.! Poisson spike trai Spike count histogram!

Discussio Model neurons: Poisson neurons! 13! he poisson model provides a good description of some data, especially considering its simplicity.! However, it does not provide the proper mechanistic explanation of neuronal response variability. Spike generation, by itself, is highly reliable and deterministic, as has been demonstrated by countless numbers of in vitro studies.! he noise in in vivo neural responses is believed to result from the fact that synapses are very unreliable, not the spike generator!!