Information Theory and Neuroscience II
|
|
- Darrell Price
- 5 years ago
- Views:
Transcription
1 John Z. Sun and Da Wang Massachusetts Institute of Technology October 14, 2009
2 Outline System Model & Problem Formulation Information Rate Analysis Recap 2 / 23
3 Neurons Neuron (denoted by j) I/O: via synapses excitatory & inhibitory synapses afferent cohort a(j), efferent cohort 3 / 23
4 Neurons afferent cohort neurons inhibitory synapse excitatory synapse neuron j efferent cohort neurons 85% synapses are excitatory amount n = 8500 typical in primary sensory cortex a(j) percentagewise close to n though some axons form more than one synapses with j 4 / 23
5 Neural Spike Train Neural spike pulse shape: time of arrival (TOA) conventions: several options needs to use one consistently asynchronous operations among a(j): no links among spike production time from different neurons when n > 2, possible for two spikes to be arbitrary close when n = 1, need to wait the refractory period 5 / 23
6 Neural Spike Train Union of spikes from three neurons: AP*weight t time of arrival (TOA) conventions: several options needs to use one consistently asynchronous operations among a(j): no links among spike production time from different neurons when n > 2, possible for two spikes to be arbitrary close when n = 1, need to wait the refractory period 5 / 23
7 Afferent Spike Train Process A i (t) lim dt 0 P [i produces a spike in (t, t + dt)] dt afferent cohort inhibitory excitatory Union of spike trains: A(t) = A + (t) 1 + CA (t) efferent cohort... A + (t) & A (t): random excitatory/inhibitory intensity A + (t) w i A i (t) i:w i >0 A (t) i:w i <0 w i A i (t) A(t) always non-negative. 6 / 23
8 Spike train process (cont.) spikes inter-spike interval (ISI) A(t): instantaneous random mean spiking frequency (unit: spikes/second) D(t): instantaneous random mean excitatory afferent ISI duration (unit: time unit) a(t) = t normalized A(t) D(t) t 7 / 23
9 Why D(t)? Introducing D(t) allows us to conceptualize the neuron as a communication channel: input (excitations): has unit of time output (firing): has unit of time. [coming soon] stochastically converts input time signals to output time signals Statistics of D(t) ρ D (τ): correlation of D(t) τ D : coherence time of D(t) ρ D (τ D ) = 1/2 τ D stationary assumption analogous to the modeling of wireless channel 8 / 23
10 Channel Model: input channel??? What is the output? 9 / 23
11 Efferent Spike Train Process Efferent spike: action potential to neurons in efferent cohort T k : the duration for k-th ISI (T k P T, k) S k : the time at which k-th AP is generated: action potential... efferent cohort... S k = k i=1 T i T k = refractory period 10 / 23
12 Channel Model: input & output channel both input & output have units of time but different indexing! 11 / 23
13 The Mean Value Assumption D k = k = 4: 1 Sk D(u) du T k S k 1 + Construct a piecewise constant random process D(t), where D(t) = D k for S k 1 + t < S k Mean Value Assumption { D(t) } adequately represents D(t) for the purpose of analysis. 12 / 23
14 Feedback among neurons For neuron j, its excitations come from: top-down feedback from higher levels of the cortex horizontal feedback from the same neuron region bottom-up signals from lower levels of the cortex causal feedback T n (D 1,..., D n 1 ) D n T n (T 1,..., T n 1 ) D n D 1 T 1 D 2 T 2 D 3 T 3.. D n T n 13 / 23
15 Channel Model: integer-indexed input & output channel 14 / 23
16 Channel Model: integer-indexed input & output channel Any model for the channel? 14 / 23
17 Classical Integrate and Fire (CIF) Neuron CIF neuron: excitatory synapses have the same weight w. unit step response to each afferent spike fixed threshold η ((m 1)w, mw] Always need m spikes to fire m afferent spikes... efferent PSP threshold trigger AP Input-output relationship T k = + mi refractory integrate fire E [I] = d k d k D k 15 / 23
18 CIF Neuron: Energy Constraints Energy that j expands during an ISI: metabolic energy: e 1 = C 1 T energy to construct PSP during (, T ]: e 2 = C 2 M energy to generate AP: e 3 = C 3 For CIF model, we have M = m always, hence e CIF (T ) = C 0 + C 1 T T is the random duration of the ISI M is the random number of afferent spikes in (, T ] C 0 = C 2 m + C / 23
19 Problem Formulation Channel model: Input: {D k } Output: {T k } memoryless and time-invariant channel but with (lots of) causal feedback! CIF neuron memoryless Central tenet Te optimality criterion apropos of neuronal information transmission is the maximization of bits per joule (bpj). Main objective Determines the optimal input & output distributions f D ( ) and f T ( ) based on the above principle. 17 / 23
20 Information Rate We start by investigating the information rate I(D; T). D (D 1, D 2,, D n ) T (T 1, T 2,, T n ) Memoryless f T D (t d) = n f T D (t i d i ) i=1 However, as {D i } may not be independent, I(D; T) n I(D i ; T i ) i=1 Equality only when {D i } independent. Are they? 18 / 23
21 Implications of τ D Recall τ D When T k slightly larger than D k+1 and D k highly correlated T k+1 and T k similarly correlated T k+1 will be similarly small For two jointly Gaussian r.v., I jointly Gaussian = 1 2 log(1 ρ2 ) where I as ρ 1. Message: correlation between D k and D k+1 results in a penalty in information rate. 19 / 23
22 Long Term Information Rate Incremental conditional mutual information: where I = lim n I n I n = I(D 1,..., D n ; T n T 1,..., T n 1 ) = I(D n ; T n T 1,..., T n 1 ) + I(D 1,..., D n 1 ; T n D n, T 1,..., T n 1 ) = h(t n T 1,..., T n 1 ) h(t n D n, T 1,..., T n 1 ) = h(t n T 1,..., T n 1 ) h(t n D n ) = I(D n ; T n ) I(T n ; T 1,..., T n 1 ) Since {(D k, T k )} strictly stationary: I = I(D 1 ; T 1 ) [I(T 1, T 2 ) + lim n I(T n; T 1,..., T n 2 T n 1 )] }{{} information decrement 20 / 23
23 Long Term Information Rate (cont.) Long Term Information Rate I = I(D 1 ; T 1 ) [I(T 1, T 2 ) + lim n I(T n; T 1,..., T n 2 T n 1 )] }{{} information decrement I(T 1, T 2 ): principal information decrement lim I(T n; T 1,..., T n 2 T n 1 ) n negligible, as having T n 1 is almost as effective as having D n / 23
24 Information Decrement I(T 1 ; T 2 ) I(T 1 ; T 2 ) =P [T 1 > τ D ] I(T 1 ; T 2 T 1 > τ D ) + P [T 1 τ D ] I(T 1 ; T 2 T 1 τ D ) P [T 1 τ D ] I(T 1 ; T 2 T 1 τ D ) when T 1 > τ D, T 2 T 1 effectively. When T 1 < 2 τ D, ρ T1,T 2 ρ D (T 1 ) I(T 1 ; T 2 ) κe [log T 1 ] + C where κ and C are constants based on ρ D (τ). high correlation via analyzing the conditional variance of T / 23
25 Recap Model channel input and output as time signals Mean value assumption: simplify analysis Memoryless channel with causal feedback CIF neuron model energy e CIF (T ) = C 0 + C 1 T Information rate analysis coherence time information decrement information rate I = I(D 1 ; T 1 ) I(T 1, T 2 ) Lots of hand-waving in modeling / 23
Neurophysiology of a VLSI spiking neural network: LANN21
Neurophysiology of a VLSI spiking neural network: LANN21 Stefano Fusi INFN, Sezione Roma I Università di Roma La Sapienza Pza Aldo Moro 2, I-185, Roma fusi@jupiter.roma1.infn.it Paolo Del Giudice Physics
More informationNON-MARKOVIAN SPIKING STATISTICS OF A NEURON WITH DELAYED FEEDBACK IN PRESENCE OF REFRACTORINESS. Kseniia Kravchuk and Alexander Vidybida
MATHEMATICAL BIOSCIENCES AND ENGINEERING Volume 11, Number 1, February 214 doi:1.3934/mbe.214.11.xx pp. 1 xx NON-MARKOVIAN SPIKING STATISTICS OF A NEURON WITH DELAYED FEEDBACK IN PRESENCE OF REFRACTORINESS
More informationModel neurons!!poisson neurons!
Model neurons!!poisson neurons! Suggested reading:! Chapter 1.4 in Dayan, P. & Abbott, L., heoretical Neuroscience, MI Press, 2001.! Model neurons: Poisson neurons! Contents: Probability of a spike sequence
More informationEmergence of resonances in neural systems: the interplay between adaptive threshold and short-term synaptic plasticity
Emergence of resonances in neural systems: the interplay between adaptive threshold and short-term synaptic plasticity Jorge F. Mejias 1,2 and Joaquín J. Torres 2 1 Department of Physics and Center for
More informationFast neural network simulations with population density methods
Fast neural network simulations with population density methods Duane Q. Nykamp a,1 Daniel Tranchina b,a,c,2 a Courant Institute of Mathematical Science b Department of Biology c Center for Neural Science
More informationEffects of Interactive Function Forms and Refractoryperiod in a Self-Organized Critical Model Based on Neural Networks
Commun. Theor. Phys. (Beijing, China) 42 (2004) pp. 121 125 c International Academic Publishers Vol. 42, No. 1, July 15, 2004 Effects of Interactive Function Forms and Refractoryperiod in a Self-Organized
More informationHow do synapses transform inputs?
Neurons to networks How do synapses transform inputs? Excitatory synapse Input spike! Neurotransmitter release binds to/opens Na channels Change in synaptic conductance! Na+ influx E.g. AMA synapse! Depolarization
More informationModelling stochastic neural learning
Modelling stochastic neural learning Computational Neuroscience András Telcs telcs.andras@wigner.mta.hu www.cs.bme.hu/~telcs http://pattern.wigner.mta.hu/participants/andras-telcs Compiled from lectures
More informationThe homogeneous Poisson process
The homogeneous Poisson process during very short time interval Δt there is a fixed probability of an event (spike) occurring independent of what happened previously if r is the rate of the Poisson process,
More informationConsider the following spike trains from two different neurons N1 and N2:
About synchrony and oscillations So far, our discussions have assumed that we are either observing a single neuron at a, or that neurons fire independent of each other. This assumption may be correct in
More informationDescribing Spike-Trains
Describing Spike-Trains Maneesh Sahani Gatsby Computational Neuroscience Unit University College London Term 1, Autumn 2012 Neural Coding The brain manipulates information by combining and generating action
More informationPatterns, Memory and Periodicity in Two-Neuron Delayed Recurrent Inhibitory Loops
Math. Model. Nat. Phenom. Vol. 5, No. 2, 2010, pp. 67-99 DOI: 10.1051/mmnp/20105203 Patterns, Memory and Periodicity in Two-Neuron Delayed Recurrent Inhibitory Loops J. Ma 1 and J. Wu 2 1 Department of
More informationSupporting Online Material for
www.sciencemag.org/cgi/content/full/319/5869/1543/dc1 Supporting Online Material for Synaptic Theory of Working Memory Gianluigi Mongillo, Omri Barak, Misha Tsodyks* *To whom correspondence should be addressed.
More informationComputational Explorations in Cognitive Neuroscience Chapter 2
Computational Explorations in Cognitive Neuroscience Chapter 2 2.4 The Electrophysiology of the Neuron Some basic principles of electricity are useful for understanding the function of neurons. This is
More informationStochastic Processes
Elements of Lecture II Hamid R. Rabiee with thanks to Ali Jalali Overview Reading Assignment Chapter 9 of textbook Further Resources MIT Open Course Ware S. Karlin and H. M. Taylor, A First Course in Stochastic
More informationNeural Encoding: Firing Rates and Spike Statistics
Neural Encoding: Firing Rates and Spike Statistics Dayan and Abbott (21) Chapter 1 Instructor: Yoonsuck Choe; CPSC 644 Cortical Networks Background: Dirac δ Function Dirac δ function has the following
More informationCSE/NB 528 Final Lecture: All Good Things Must. CSE/NB 528: Final Lecture
CSE/NB 528 Final Lecture: All Good Things Must 1 Course Summary Where have we been? Course Highlights Where do we go from here? Challenges and Open Problems Further Reading 2 What is the neural code? What
More informationDynamical Constraints on Computing with Spike Timing in the Cortex
Appears in Advances in Neural Information Processing Systems, 15 (NIPS 00) Dynamical Constraints on Computing with Spike Timing in the Cortex Arunava Banerjee and Alexandre Pouget Department of Brain and
More informationMathematical Models of Dynamic Behavior of Individual Neural Networks of Central Nervous System
Mathematical Models of Dynamic Behavior of Individual Neural Networks of Central Nervous System Dimitra Despoina Pagania 1, Adam Adamopoulos 1,2 and Spiridon D. Likothanassis 1 1 Pattern Recognition Laboratory,
More informationOverview Organization: Central Nervous System (CNS) Peripheral Nervous System (PNS) innervate Divisions: a. Afferent
Overview Organization: Central Nervous System (CNS) Brain and spinal cord receives and processes information. Peripheral Nervous System (PNS) Nerve cells that link CNS with organs throughout the body.
More information1 Balanced networks: Trading speed for noise
Physics 178/278 - David leinfeld - Winter 2017 (Corrected yet incomplete notes) 1 Balanced networks: Trading speed for noise 1.1 Scaling of neuronal inputs An interesting observation is that the subthresold
More informationProbabilistic Models in Theoretical Neuroscience
Probabilistic Models in Theoretical Neuroscience visible unit Boltzmann machine semi-restricted Boltzmann machine restricted Boltzmann machine hidden unit Neural models of probabilistic sampling: introduction
More informationEncoder Decoder Design for Event-Triggered Feedback Control over Bandlimited Channels
Encoder Decoder Design for Event-Triggered Feedback Control over Bandlimited Channels LEI BAO, MIKAEL SKOGLUND AND KARL HENRIK JOHANSSON IR-EE- 26: Stockholm 26 Signal Processing School of Electrical Engineering
More informationChapter 37 Active Reading Guide Neurons, Synapses, and Signaling
Name: AP Biology Mr. Croft Section 1 1. What is a neuron? Chapter 37 Active Reading Guide Neurons, Synapses, and Signaling 2. Neurons can be placed into three groups, based on their location and function.
More informationNervous Systems: Neuron Structure and Function
Nervous Systems: Neuron Structure and Function Integration An animal needs to function like a coherent organism, not like a loose collection of cells. Integration = refers to processes such as summation
More informationActivity of any neuron with delayed feedback stimulated with Poisson stream is non-markov
Activity of any neuron with delayed feedback stimulated with Poisson stream is non-markov arxiv:1503.03312v1 [q-bio.nc] 11 Mar 2015 Alexander K.Vidybida Abstract For a class of excitatory spiking neuron
More informationHopfield Neural Network and Associative Memory. Typical Myelinated Vertebrate Motoneuron (Wikipedia) Topic 3 Polymers and Neurons Lecture 5
Hopfield Neural Network and Associative Memory Typical Myelinated Vertebrate Motoneuron (Wikipedia) PHY 411-506 Computational Physics 2 1 Wednesday, March 5 1906 Nobel Prize in Physiology or Medicine.
More informationIs the superposition of many random spike trains a Poisson process?
Is the superposition of many random spike trains a Poisson process? Benjamin Lindner Max-Planck-Institut für Physik komplexer Systeme, Dresden Reference: Phys. Rev. E 73, 2291 (26) Outline Point processes
More informationAn Introductory Course in Computational Neuroscience
An Introductory Course in Computational Neuroscience Contents Series Foreword Acknowledgments Preface 1 Preliminary Material 1.1. Introduction 1.1.1 The Cell, the Circuit, and the Brain 1.1.2 Physics of
More informationThe exponential distribution and the Poisson process
The exponential distribution and the Poisson process 1-1 Exponential Distribution: Basic Facts PDF f(t) = { λe λt, t 0 0, t < 0 CDF Pr{T t) = 0 t λe λu du = 1 e λt (t 0) Mean E[T] = 1 λ Variance Var[T]
More informationSPIKE TRIGGERED APPROACHES. Odelia Schwartz Computational Neuroscience Course 2017
SPIKE TRIGGERED APPROACHES Odelia Schwartz Computational Neuroscience Course 2017 LINEAR NONLINEAR MODELS Linear Nonlinear o Often constrain to some form of Linear, Nonlinear computations, e.g. visual
More informationLiquid Computing in a Simplified Model of Cortical Layer IV: Learning to Balance a Ball
Liquid Computing in a Simplified Model of Cortical Layer IV: Learning to Balance a Ball Dimitri Probst 1,3, Wolfgang Maass 2, Henry Markram 1, and Marc-Oliver Gewaltig 1 1 Blue Brain Project, École Polytechnique
More informationPoisson Processes for Neuroscientists
Poisson Processes for Neuroscientists Thibaud Taillefumier This note is an introduction to the key properties of Poisson processes, which are extensively used to simulate spike trains. For being mathematical
More informationProbabilistic Logics and the Synthesis of Reliable Organisms from Unreliable Components
Probabilistic Logics and the Synthesis of Reliable Organisms from Unreliable Components John Z. Sun Massachusetts Institute of Technology September 21, 2011 Outline Automata Theory Error in Automata Controlling
More information(Feed-Forward) Neural Networks Dr. Hajira Jabeen, Prof. Jens Lehmann
(Feed-Forward) Neural Networks 2016-12-06 Dr. Hajira Jabeen, Prof. Jens Lehmann Outline In the previous lectures we have learned about tensors and factorization methods. RESCAL is a bilinear model for
More informationNeuronal Dynamics: Computational Neuroscience of Single Neurons
Week 5 part 3a :Three definitions of rate code Neuronal Dynamics: Computational Neuroscience of Single Neurons Week 5 Variability and Noise: The question of the neural code Wulfram Gerstner EPFL, Lausanne,
More informationLecture 11 : Simple Neuron Models. Dr Eileen Nugent
Lecture 11 : Simple Neuron Models Dr Eileen Nugent Reading List Nelson, Biological Physics, Chapter 12 Phillips, PBoC, Chapter 17 Gerstner, Neuronal Dynamics: from single neurons to networks and models
More informationMathematical Models of Dynamic Behavior of Individual Neural Networks of Central Nervous System
Mathematical Models of Dynamic Behavior of Individual Neural Networks of Central Nervous System Dimitra-Despoina Pagania,*, Adam Adamopoulos,2, and Spiridon D. Likothanassis Pattern Recognition Laboratory,
More informationLearning Spatio-Temporally Encoded Pattern Transformations in Structured Spiking Neural Networks 12
Learning Spatio-Temporally Encoded Pattern Transformations in Structured Spiking Neural Networks 12 André Grüning, Brian Gardner and Ioana Sporea Department of Computer Science University of Surrey Guildford,
More informationSynapse Model. Neurotransmitter is released into cleft between axonal button and dendritic spine
Synapse Model Neurotransmitter is released into cleft between axonal button and dendritic spine Binding and unbinding are modeled by first-order kinetics Concentration must exceed receptor affinity 2 MorphSynapse.nb
More informationConsumption. Consider a consumer with utility. v(c τ )e ρ(τ t) dτ.
Consumption Consider a consumer with utility v(c τ )e ρ(τ t) dτ. t He acts to maximize expected utility. Utility is increasing in consumption, v > 0, and concave, v < 0. 1 The utility from consumption
More informationActivity Driven Adaptive Stochastic. Resonance. Gregor Wenning and Klaus Obermayer. Technical University of Berlin.
Activity Driven Adaptive Stochastic Resonance Gregor Wenning and Klaus Obermayer Department of Electrical Engineering and Computer Science Technical University of Berlin Franklinstr. 8/9, 187 Berlin fgrewe,obyg@cs.tu-berlin.de
More informationEncoder Decoder Design for Event-Triggered Feedback Control over Bandlimited Channels
Encoder Decoder Design for Event-Triggered Feedback Control over Bandlimited Channels Lei Bao, Mikael Skoglund and Karl Henrik Johansson Department of Signals, Sensors and Systems, Royal Institute of Technology,
More informationStochastic Processes. M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno
Stochastic Processes M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno 1 Outline Stochastic (random) processes. Autocorrelation. Crosscorrelation. Spectral density function.
More informationLecture 4: Feed Forward Neural Networks
Lecture 4: Feed Forward Neural Networks Dr. Roman V Belavkin Middlesex University BIS4435 Biological neurons and the brain A Model of A Single Neuron Neurons as data-driven models Neural Networks Training
More informationNervous Tissue. Neurons Neural communication Nervous Systems
Nervous Tissue Neurons Neural communication Nervous Systems What is the function of nervous tissue? Maintain homeostasis & respond to stimuli Sense & transmit information rapidly, to specific cells and
More informationResponse Selection Using Neural Phase Oscillators
Response Selection Using Neural Phase Oscillators J. Acacio de Barros 1 A symposium on the occasion of Patrick Suppes 90th birthday March 10, 2012 1 With Pat Suppes and Gary Oas (Suppes et al., 2012).
More informationEffects of Interactive Function Forms in a Self-Organized Critical Model Based on Neural Networks
Commun. Theor. Phys. (Beijing, China) 40 (2003) pp. 607 613 c International Academic Publishers Vol. 40, No. 5, November 15, 2003 Effects of Interactive Function Forms in a Self-Organized Critical Model
More informationSynaptic dynamics. John D. Murray. Synaptic currents. Simple model of the synaptic gating variable. First-order kinetics
Synaptic dynamics John D. Murray A dynamical model for synaptic gating variables is presented. We use this to study the saturation of synaptic gating at high firing rate. Shunting inhibition and the voltage
More informationVoltage-clamp and Hodgkin-Huxley models
Voltage-clamp and Hodgkin-Huxley models Read: Hille, Chapters 2-5 (best Koch, Chapters 6, 8, 9 See also Hodgkin and Huxley, J. Physiol. 117:500-544 (1952. (the source Clay, J. Neurophysiol. 80:903-913
More informationREAL-TIME COMPUTING WITHOUT STABLE
REAL-TIME COMPUTING WITHOUT STABLE STATES: A NEW FRAMEWORK FOR NEURAL COMPUTATION BASED ON PERTURBATIONS Wolfgang Maass Thomas Natschlager Henry Markram Presented by Qiong Zhao April 28 th, 2010 OUTLINE
More informationPROBABILITY DISTRIBUTIONS
Review of PROBABILITY DISTRIBUTIONS Hideaki Shimazaki, Ph.D. http://goo.gl/visng Poisson process 1 Probability distribution Probability that a (continuous) random variable X is in (x,x+dx). ( ) P x < X
More information+ + ( + ) = Linear recurrent networks. Simpler, much more amenable to analytic treatment E.g. by choosing
Linear recurrent networks Simpler, much more amenable to analytic treatment E.g. by choosing + ( + ) = Firing rates can be negative Approximates dynamics around fixed point Approximation often reasonable
More informationarxiv: v3 [q-bio.nc] 18 Feb 2015
1 Inferring Synaptic Structure in presence of eural Interaction Time Scales Cristiano Capone 1,2,5,, Carla Filosa 1, Guido Gigante 2,3, Federico Ricci-Tersenghi 1,4,5, Paolo Del Giudice 2,5 arxiv:148.115v3
More informationCharacterizing the firing properties of an adaptive
Characterizing the firing properties of an adaptive analog VLSI neuron Daniel Ben Dayan Rubin 1,2, Elisabetta Chicca 2, and Giacomo Indiveri 2 1 Department of Bioengineering, Politecnico di Milano, P.zza
More informationHow and why neurons fire
How and why neurons fire 1 Neurophysiological Background The Neuron Contents: Structure Electrical Mebrane Properties Ion Channels Actionpotential Signal Propagation Synaptic Transission 2 Structure of
More informationDISCRETE EVENT SIMULATION IN THE NEURON ENVIRONMENT
Hines and Carnevale: Discrete event simulation in the NEURON environment Page 1 Preprint of a manuscript that will be published in Neurocomputing. DISCRETE EVENT SIMULATION IN THE NEURON ENVIRONMENT Abstract
More informationInteractions of Information Theory and Estimation in Single- and Multi-user Communications
Interactions of Information Theory and Estimation in Single- and Multi-user Communications Dongning Guo Department of Electrical Engineering Princeton University March 8, 2004 p 1 Dongning Guo Communications
More informationCORRELATION TRANSFER FROM BASAL GANGLIA TO THALAMUS IN PARKINSON S DISEASE. by Pamela Reitsma. B.S., University of Maine, 2007
CORRELATION TRANSFER FROM BASAL GANGLIA TO THALAMUS IN PARKINSON S DISEASE by Pamela Reitsma B.S., University of Maine, 27 Submitted to the Graduate Faculty of the Department of Mathematics in partial
More informationNeurons and Nervous Systems
34 Neurons and Nervous Systems Concept 34.1 Nervous Systems Consist of Neurons and Glia Nervous systems have two categories of cells: Neurons, or nerve cells, are excitable they generate and transmit electrical
More informationVoltage-clamp and Hodgkin-Huxley models
Voltage-clamp and Hodgkin-Huxley models Read: Hille, Chapters 2-5 (best) Koch, Chapters 6, 8, 9 See also Clay, J. Neurophysiol. 80:903-913 (1998) (for a recent version of the HH squid axon model) Rothman
More informationDecorrelation of neural-network activity by inhibitory feedback
Decorrelation of neural-network activity by inhibitory feedback Tom Tetzlaff 1,2,#,, Moritz Helias 1,3,#, Gaute T. Einevoll 2, Markus Diesmann 1,3 1 Inst. of Neuroscience and Medicine (INM-6), Computational
More informationMarr's Theory of the Hippocampus: Part I
Marr's Theory of the Hippocampus: Part I Computational Models of Neural Systems Lecture 3.3 David S. Touretzky October, 2015 David Marr: 1945-1980 10/05/15 Computational Models of Neural Systems 2 Marr
More informationCommunication Theory II
Communication Theory II Lecture 8: Stochastic Processes Ahmed Elnakib, PhD Assistant Professor, Mansoura University, Egypt March 5 th, 2015 1 o Stochastic processes What is a stochastic process? Types:
More informationLimulus. The Neural Code. Response of Visual Neurons 9/21/2011
Crab cam (Barlow et al., 2001) self inhibition recurrent inhibition lateral inhibition - L16. Neural processing in Linear Systems: Temporal and Spatial Filtering C. D. Hopkins Sept. 21, 2011 The Neural
More informationHow to read a burst duration code
Neurocomputing 58 60 (2004) 1 6 www.elsevier.com/locate/neucom How to read a burst duration code Adam Kepecs a;, John Lisman b a Cold Spring Harbor Laboratory, Marks Building, 1 Bungtown Road, Cold Spring
More informationTuning tuning curves. So far: Receptive fields Representation of stimuli Population vectors. Today: Contrast enhancment, cortical processing
Tuning tuning curves So far: Receptive fields Representation of stimuli Population vectors Today: Contrast enhancment, cortical processing Firing frequency N 3 s max (N 1 ) = 40 o N4 N 1 N N 5 2 s max
More informationInformation Theory. Mark van Rossum. January 24, School of Informatics, University of Edinburgh 1 / 35
1 / 35 Information Theory Mark van Rossum School of Informatics, University of Edinburgh January 24, 2018 0 Version: January 24, 2018 Why information theory 2 / 35 Understanding the neural code. Encoding
More informationA Learning Theory for Reward-Modulated Spike-Timing-Dependent Plasticity with Application to Biofeedback
A Learning Theory for Reward-Modulated Spike-Timing-Dependent Plasticity with Application to Biofeedback Robert Legenstein, Dejan Pecevski, Wolfgang Maass Institute for Theoretical Computer Science Graz
More informationNeural Networks 1 Synchronization in Spiking Neural Networks
CS 790R Seminar Modeling & Simulation Neural Networks 1 Synchronization in Spiking Neural Networks René Doursat Department of Computer Science & Engineering University of Nevada, Reno Spring 2006 Synchronization
More informationModeling the Milk-Ejection Reflex! Gareth Leng and collaborators!
Modeling the Milk-Ejection Reflex! Gareth Leng and collaborators! Why the milk-ejection reflex?! One of the best studied neuroendocrine reflex Good example of peptide- mediated communication between neurons
More informationNeuron. Detector Model. Understanding Neural Components in Detector Model. Detector vs. Computer. Detector. Neuron. output. axon
Neuron Detector Model 1 The detector model. 2 Biological properties of the neuron. 3 The computational unit. Each neuron is detecting some set of conditions (e.g., smoke detector). Representation is what
More information9 Generation of Action Potential Hodgkin-Huxley Model
9 Generation of Action Potential Hodgkin-Huxley Model (based on chapter 12, W.W. Lytton, Hodgkin-Huxley Model) 9.1 Passive and active membrane models In the previous lecture we have considered a passive
More informationCommunication Theory II
Communication Theory II Lecture 15: Information Theory (cont d) Ahmed Elnakib, PhD Assistant Professor, Mansoura University, Egypt March 29 th, 2015 1 Example: Channel Capacity of BSC o Let then: o For
More informationTIME-SEQUENTIAL SELF-ORGANIZATION OF HIERARCHICAL NEURAL NETWORKS. Ronald H. Silverman Cornell University Medical College, New York, NY 10021
709 TIME-SEQUENTIAL SELF-ORGANIZATION OF HIERARCHICAL NEURAL NETWORKS Ronald H. Silverman Cornell University Medical College, New York, NY 10021 Andrew S. Noetzel polytechnic University, Brooklyn, NY 11201
More informationTopics in Neurophysics
Topics in Neurophysics Alex Loebel, Martin Stemmler and Anderas Herz Exercise 2 Solution (1) The Hodgkin Huxley Model The goal of this exercise is to simulate the action potential according to the model
More informationNeural Conduction. biologyaspoetry.com
Neural Conduction biologyaspoetry.com Resting Membrane Potential -70mV A cell s membrane potential is the difference in the electrical potential ( charge) between the inside and outside of the cell. The
More informationIntroduction to Neural Networks
Introduction to Neural Networks What are (Artificial) Neural Networks? Models of the brain and nervous system Highly parallel Process information much more like the brain than a serial computer Learning
More informationNeural Excitability in a Subcritical Hopf Oscillator with a Nonlinear Feedback
Neural Excitability in a Subcritical Hopf Oscillator with a Nonlinear Feedback Gautam C Sethia and Abhijit Sen Institute for Plasma Research, Bhat, Gandhinagar 382 428, INDIA Motivation Neural Excitability
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science
MASSACHUSETTS INSTITUTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science 6.262 Discrete Stochastic Processes Midterm Quiz April 6, 2010 There are 5 questions, each with several parts.
More informationHebb rule book: 'The Organization of Behavior' Theory about the neural bases of learning
PCA by neurons Hebb rule 1949 book: 'The Organization of Behavior' Theory about the neural bases of learning Learning takes place in synapses. Synapses get modified, they get stronger when the pre- and
More informationLecture IV: LTI models of physical systems
BME 171: Signals and Systems Duke University September 5, 2008 This lecture Plan for the lecture: 1 Interconnections of linear systems 2 Differential equation models of LTI systems 3 eview of linear circuit
More informationNerve Signal Conduction. Resting Potential Action Potential Conduction of Action Potentials
Nerve Signal Conduction Resting Potential Action Potential Conduction of Action Potentials Resting Potential Resting neurons are always prepared to send a nerve signal. Neuron possesses potential energy
More informationLecture 4 Noisy Channel Coding
Lecture 4 Noisy Channel Coding I-Hsiang Wang Department of Electrical Engineering National Taiwan University ihwang@ntu.edu.tw October 9, 2015 1 / 56 I-Hsiang Wang IT Lecture 4 The Channel Coding Problem
More informationRADIO SYSTEMS ETIN15. Lecture no: Equalization. Ove Edfors, Department of Electrical and Information Technology
RADIO SYSTEMS ETIN15 Lecture no: 8 Equalization Ove Edfors, Department of Electrical and Information Technology Ove.Edfors@eit.lth.se Contents Inter-symbol interference Linear equalizers Decision-feedback
More informationLecture 7. Union bound for reducing M-ary to binary hypothesis testing
Lecture 7 Agenda for the lecture M-ary hypothesis testing and the MAP rule Union bound for reducing M-ary to binary hypothesis testing Introduction of the channel coding problem 7.1 M-ary hypothesis testing
More informationSupratim Ray
Supratim Ray sray@cns.iisc.ernet.in Biophysics of Action Potentials Passive Properties neuron as an electrical circuit Passive Signaling cable theory Active properties generation of action potential Techniques
More informationIntroduction to Neural Networks U. Minn. Psy 5038 Spring, 1999 Daniel Kersten. Lecture 2a. The Neuron - overview of structure. From Anderson (1995)
Introduction to Neural Networks U. Minn. Psy 5038 Spring, 1999 Daniel Kersten Lecture 2a The Neuron - overview of structure From Anderson (1995) 2 Lect_2a_Mathematica.nb Basic Structure Information flow:
More informationECS 332: Principles of Communications 2012/1. HW 4 Due: Sep 7
ECS 332: Principles of Communications 2012/1 HW 4 Due: Sep 7 Lecturer: Prapun Suksompong, Ph.D. Instructions (a) ONE part of a question will be graded (5 pt). Of course, you do not know which part will
More informationHigh-conductance states in a mean-eld cortical network model
Neurocomputing 58 60 (2004) 935 940 www.elsevier.com/locate/neucom High-conductance states in a mean-eld cortical network model Alexander Lerchner a;, Mandana Ahmadi b, John Hertz b a Oersted-DTU, Technical
More informationRoles of Fluctuations. in Pulsed Neural Networks
Ph.D. Thesis Roles of Fluctuations in Pulsed Neural Networks Supervisor Professor Yoichi Okabe Takashi Kanamaru Department of Advanced Interdisciplinary Studies, Faculty of Engineering, The University
More informationThe Bayesian Brain. Robert Jacobs Department of Brain & Cognitive Sciences University of Rochester. May 11, 2017
The Bayesian Brain Robert Jacobs Department of Brain & Cognitive Sciences University of Rochester May 11, 2017 Bayesian Brain How do neurons represent the states of the world? How do neurons represent
More informationInstituto Tecnológico y de Estudios Superiores de Occidente Departamento de Electrónica, Sistemas e Informática. Introductory Notes on Neural Networks
Introductory Notes on Neural Networs Dr. José Ernesto Rayas Sánche April Introductory Notes on Neural Networs Dr. José Ernesto Rayas Sánche BIOLOGICAL NEURAL NETWORKS The brain can be seen as a highly
More informationBiological Modeling of Neural Networks:
Week 14 Dynamics and Plasticity 14.1 Reservoir computing - Review:Random Networks - Computing with rich dynamics Biological Modeling of Neural Networks: 14.2 Random Networks - stationary state - chaos
More informationThis script will produce a series of pulses of amplitude 40 na, duration 1ms, recurring every 50 ms.
9.16 Problem Set #4 In the final problem set you will combine the pieces of knowledge gained in the previous assignments to build a full-blown model of a plastic synapse. You will investigate the effects
More informationNervous Tissue. Neurons Electrochemical Gradient Propagation & Transduction Neurotransmitters Temporal & Spatial Summation
Nervous Tissue Neurons Electrochemical Gradient Propagation & Transduction Neurotransmitters Temporal & Spatial Summation What is the function of nervous tissue? Maintain homeostasis & respond to stimuli
More informationOn the Complexity of Acyclic Networks of Neurons
On the Complexity of Acyclic Networks of Neurons Venkatakrishnan Ramaswamy CISE University of Florida vr1@cise.ufl.edu Arunava Banerjee CISE University of Florida arunava@cise.ufl.edu September 8, 2009
More informationCommunication constraints and latency in Networked Control Systems
Communication constraints and latency in Networked Control Systems João P. Hespanha Center for Control Engineering and Computation University of California Santa Barbara In collaboration with Antonio Ortega
More informationECE 565 Notes on Shot Noise, Photocurrent Statistics, and Integrate-and-Dump Receivers M. M. Hayat 3/17/05
ECE 565 Notes on Shot Noise, Photocurrent Statistics, and Integrate-and-Dump Receivers M. M. Hayat 3/17/5 Let P (t) represent time-varying optical power incident on a semiconductor photodetector with quantum
More informationMathematical Foundations of Neuroscience - Lecture 3. Electrophysiology of neurons - continued
Mathematical Foundations of Neuroscience - Lecture 3. Electrophysiology of neurons - continued Filip Piękniewski Faculty of Mathematics and Computer Science, Nicolaus Copernicus University, Toruń, Poland
More information