Systems Biology: A Personal View IX. Landscapes. Sitabhra Sinha IMSc Chennai

Similar documents
The Evolution of Gene Dominance through the. Baldwin Effect

Hopfield Neural Network and Associative Memory. Typical Myelinated Vertebrate Motoneuron (Wikipedia) Topic 3 Polymers and Neurons Lecture 5

Statistical mechanics of fitness landscapes

Artificial Intelligence Hopfield Networks

Repeated Occurrences of the Baldwin Effect Can Guide Evolution on Rugged Fitness Landscapes

The Evolution of Sex Chromosomes through the. Baldwin Effect

Hopfield Networks. (Excerpt from a Basic Course at IK 2008) Herbert Jaeger. Jacobs University Bremen

A. The Hopfield Network. III. Recurrent Neural Networks. Typical Artificial Neuron. Typical Artificial Neuron. Hopfield Network.

A Simple Haploid-Diploid Evolutionary Algorithm

Math in systems neuroscience. Quan Wen

Synaptic Plasticity. Introduction. Biophysics of Synaptic Plasticity. Functional Modes of Synaptic Plasticity. Activity-dependent synaptic plasticity:

A. The Hopfield Network. III. Recurrent Neural Networks. Typical Artificial Neuron. Typical Artificial Neuron. Hopfield Network.

Introduction. Previous work has shown that AER can also be used to construct largescale networks with arbitrary, configurable synaptic connectivity.

Evolution on Realistic Landscapes

How do biological neurons learn? Insights from computational modelling of

Empirical fitness landscapes and the predictability of evolution

Critical Properties of Complex Fitness Landscapes

Using Variable Threshold to Increase Capacity in a Feedback Neural Network

Modeling Evolution DAVID EPSTEIN CELEBRATION. John Milnor. Warwick University, July 14, Stony Brook University

arxiv: v1 [q-bio.qm] 7 Aug 2017

Financial Informatics XVII:

7 Rate-Based Recurrent Networks of Threshold Neurons: Basis for Associative Memory

Introduction to Wright-Fisher Simulations. Ryan Hernandez

Provided for non-commercial research and educational use. Not for reproduction, distribution or commercial use.

COMP9444 Neural Networks and Deep Learning 11. Boltzmann Machines. COMP9444 c Alan Blair, 2017

Haploid-Diploid Algorithms

Lecture 14 Population dynamics and associative memory; stable learning

Memories Associated with Single Neurons and Proximity Matrices

Error thresholds on realistic fitness landscapes

Synaptic plasticity in neuromorphic hardware. Stefano Fusi Columbia University

In biological terms, memory refers to the ability of neural systems to store activity patterns and later recall them when required.

Evolutionary Predictability and Complications with Additivity

Basic elements of neuroelectronics -- membranes -- ion channels -- wiring. Elementary neuron models -- conductance based -- modelers alternatives

Machine Learning. Neural Networks

7 Recurrent Networks of Threshold (Binary) Neurons: Basis for Associative Memory

Plasticity and learning in a network of coupled phase oscillators

Introduction to Natural Selection. Ryan Hernandez Tim O Connor

Logic Learning in Hopfield Networks

Systems Biology Across Scales: A Personal View XXVI. Waves in Biology: From cells & tissue to populations. Sitabhra Sinha IMSc Chennai

Consider the way we are able to retrieve a pattern from a partial key as in Figure 10 1.

arxiv: v1 [q-bio.pe] 30 Jun 2015

Adaptive Landscapes and Protein Evolution

COMP598: Advanced Computational Biology Methods and Research

Non-Adaptive Evolvability. Jeff Clune

Localized Excitations in Networks of Spiking Neurons

J. Marro Institute Carlos I, University of Granada. Net-Works 08, Pamplona, 9-11 June 2008

Biosciences in the 21st century

Computational Neuroscience. Structure Dynamics Implementation Algorithm Computation - Function

Hopfield Neural Network

Hebb rule book: 'The Organization of Behavior' Theory about the neural bases of learning

REAL-TIME COMPUTING WITHOUT STABLE

Using a Hopfield Network: A Nuts and Bolts Approach

Introduction to Neural Networks

Methods for Estimating the Computational Power and Generalization Capability of Neural Microcircuits

Sampling-based probabilistic inference through neural and synaptic dynamics

Chapter 1 Predicting Evolution and Visualizing High dimensional Fitness Landscapes

m1 m2 m3 m4 m5 m6 m7 m8 wt m m m m m m m m8 - + wt +

arxiv: v3 [q-bio.pe] 14 Dec 2013

CSE/NB 528 Final Lecture: All Good Things Must. CSE/NB 528: Final Lecture

Exploring the Effect of Sex on Empirical Fitness Landscapes

Microevolution 2 mutation & migration

The Mixed States of Associative Memories Realize Unimodal Distribution of Dominance Durations in Multistable Perception

Functional divergence 1: FFTNS and Shifting balance theory

The Dynamic Changes in Roles of Learning through the Baldwin Effect

Introduction to Neural Networks

The diversity of evolutionary dynamics on epistatic versus non-epistatic fitness landscapes

Evolution on simple and realistic landscapes

Triplets of Spikes in a Model of Spike Timing-Dependent Plasticity

Supporting Online Material for

Can evolution paths be explained by chance alone? arxiv: v1 [math.pr] 12 Oct The model

The Neuron - F. Fig. 45.3

How do synapses transform inputs?

Random Boolean Networks

arxiv: v2 [q-bio.pe] 26 Feb 2013

Hebbian Learning using Fixed Weight Evolved Dynamical Neural Networks

Nonequilibrium landscape theory of neural networks

Search Space Analysis of Recurrent Spiking and Continuous-time Neural Networks

The Wright Fisher Controversy. Charles Goodnight Department of Biology University of Vermont

Storage Capacity of Letter Recognition in Hopfield Networks

This script will produce a series of pulses of amplitude 40 na, duration 1ms, recurring every 50 ms.

Motivation. Lecture 23. The Stochastic Neuron ( ) Properties of Logistic Sigmoid. Logistic Sigmoid With Varying T. Logistic Sigmoid T = 0.

Machine Learning and Adaptive Systems. Lectures 5 & 6

arxiv: v2 [q-bio.pe] 17 Oct 2012

NEURONS, SENSE ORGANS, AND NERVOUS SYSTEMS CHAPTER 34

Processing of Time Series by Neural Circuits with Biologically Realistic Synaptic Dynamics

Big Idea 3: Living systems store, retrieve, transmit, and respond to information essential to life processes.

Population Genetics I. Bio

1 What makes a dynamical system computationally powerful?

Slide02 Haykin Chapter 2: Learning Processes

The Evolutionary Origins of Protein Sequence Variation

( ) T. Reading. Lecture 22. Definition of Covariance. Imprinting Multiple Patterns. Characteristics of Hopfield Memory

Markov Chains and MCMC

Adaptation in the Neural Code of the Retina

Problems on Evolutionary dynamics

BIOLOGY 11/10/2016. Neurons, Synapses, and Signaling. Concept 48.1: Neuron organization and structure reflect function in information transfer

3.3 Discrete Hopfield Net An iterative autoassociative net similar to the nets described in the previous sections has been developed by Hopfield

Liquid Computing. Wolfgang Maass. Institut für Grundlagen der Informationsverarbeitung Technische Universität Graz, Austria

Coevolution of learning and niche construction. Reiji Suzuki, Yasunori Noba and Takaya Arita

MEMBRANE STRUCTURE. Lecture 9. Biology Department Concordia University. Dr. S. Azam BIOL 266/

Novel VLSI Implementation for Triplet-based Spike-Timing Dependent Plasticity

Transcription:

Systems Biology: A Personal View IX. Landscapes Sitabhra Sinha IMSc Chennai

Fitness Landscapes Sewall Wright pioneered the description of how genotype or phenotypic fitness are related in terms of a fitness landscape (an imaginary surface in genotype space, each genotype next to others differing by a single mutation and assigned a fitness, on which trajectories due to evolutionary dynamics can be visualized) Sewall G. Wright (1889 1988) Mean population fitness of a genotype is represented by height of the surface. Natural selection would lead to a population climbing the nearest peak in the fitness landscape, while genetic drift causes random wandering Image from Sewall Wright, "The Role of Mutation, Inbreeding, Crossbreeding, and Selection in Evolution," 6th Int Congress of Genetics, Brooklyn, NY(193).

Networks: a better description Sewall Wright. Surfaces of selective value revisited. American Naturalist 131 (1988) 115-13

Adaptive walks in Protein Space Wright s genotype space concept was extended to that of proteins by Maynard Smith J. Maynard Smith (190 004) Space of all proteins comprising N amino acids: 0 N vertices each having k=19n one-mutant neighbors. Each protein assigned a fitness with respect to a specific property, e.g., binding to ligand.

Epistatic interactions J. Arjan G.M. de Visser and Joachim Krug, Nature Rev Genetics (014): Wright s idea to explicitly consider the relationship between genotypic space and fitness came from his conviction that, different from Ronald Fisher s additive view of genetics, real fitness landscapes are likely to be complex owing to pervasive epistasis Epistasis Any kind of genetic interaction that leads to a dependence of mutational effects on the genetic background. Ruggedness of the fitness landscape arises through multidimensional epistasis

The NK model of fitness landscape Kauffman & Weinberger, J Theo Biol (1989)

Empirical study of fitness landscapes J. Arjan G.M. de Visser and Joachim Krug, Nature Rev Genetics (014)

Experimentally accessible fitness landscapes Hayashi et al (006) Result of in vitro molecular evolution beginning with a defective fd phage carrying a random polypeptide of 139 amino acids in place of the g3p minor coat protein D domain, which is essential for phage infection. Protein landscapes: Y Hayashi et al. Experimental rugged fitness landscape in protein sequence space PLoS One 1 (006) e96. RNA landscapes: D E Jason et al Rapid construction of empirical RNA fitness landscapes Science 330 (010) 376-379. Retroviruses: R D Kouyos et al Exploring the complexity of the HIV-I fitness landscape. PLoS Genetics 8 (01) e100551

Protein circuit Chemotactic response of coliform bacteria Attractor networks: in the brain & inside the cell

Hopfield Model: An Attractor Network Model for Associative Memory Hopfield and Tank, PNAS, 198. Network of inter-connected binary state neurons x i ={-1 or OFF,+1 or ON}. Activation of the neurons are defined by x i = sgn( j w ji x j ) Sgn (q) = 1, if q < 0; = +1 otherwise T=0 or deterministic dynamics Symmetric connection weights, i.e. w ij = w ji w ii =0 (No self connections) x i x j

Learning Modifying the synaptic weights by Hebb rule Hebb s hypothesis (1949) Donald O Hebb (1904-85) Neurons that fire together, wire together 1 M p p w ij i j N p1 p : i th component of the p th binary pattern i Four stored patterns in simulation http://thebrain.mcgill.ca i th neuron is excited x i =1 i th neuron is resting x i =0

LTP Hebb Rule and Biology Long-term potentiation First empirical observation (Lomo, 1966) supporting Hebb s hypothesis Persistent increase in synaptic strength after high-freq stimulation of synapse Spike-timing dependent plasticity spike-based formulation of Hebb rule (Markram, 1995) synapse strengthened if presynaptic neuron repeatedly or persistently takes part in firing the postsynaptic one (Hebb 1949) Pre-synaptic j Post-synaptic i Bi & Poo, 1998

Example: A 3-node Hopfield model p = : (1,-1,1) and (-1,1,-1) are the stored memories M p p j p i ij N w 1 1 0 0 0 3 1 W 0 w ii

http://fourier.eng.hmc.edu Recall dynamics of Hopfield Network Start from arbitrary initial configuration of {x} What final state does the network converge? Evaluate an energy value associated with the N network state: 1 E i1 i j System converges to an attractor which is a local/global minimum of E j w j, i x i x j

Associative Memory as Attractor Network 1 s 4 s s 3 s Memories stored as attractors of network dynamics When presented with a novel input, the network eventually converges to the stored pattern that is closest to it (i.e., to the pattern in whose basin of attraction the input lies).