biologically-inspired computing lecture 12 Informatics luis rocha 2015 INDIANA UNIVERSITY biologically Inspired computing

Similar documents
biologically-inspired computing lecture 18

Cellular Automata CS 591 Complex Adaptive Systems Spring Professor: Melanie Moses 2/02/09

Development. biologically-inspired computing. lecture 16. Informatics luis rocha x x x. Syntactic Operations. biologically Inspired computing

Introduction to Scientific Modeling CS 365, Fall 2011 Cellular Automata

II. Cellular Automata 8/27/03 1

II. Spatial Systems. A. Cellular Automata. Structure. Cellular Automata (CAs) Example: Conway s Game of Life. State Transition Rule

II. Spatial Systems A. Cellular Automata 8/24/08 1

Cellular Automata. ,C ) (t ) ,..., C i +[ K / 2] Cellular Automata. x > N : C x ! N. = C x. x < 1: C x. = C N+ x.

Mitchell Chapter 10. Living systems are open systems that exchange energy, materials & information

biologically-inspired computing lecture 5 Informatics luis rocha 2015 biologically Inspired computing INDIANA UNIVERSITY

Cellular Automata. and beyond. The World of Simple Programs. Christian Jacob

biologically-inspired computing lecture 6 Informatics luis rocha 2015 INDIANA UNIVERSITY biologically Inspired computing

Cellular automata are idealized models of complex systems Large network of simple components Limited communication among components No central

Cellular Automata. History. 1-Dimensional CA. 1-Dimensional CA. Ozalp Babaoglu

Modelling with cellular automata

Motivation. Evolution has rediscovered several times multicellularity as a way to build complex living systems

Shannon Information (very briefly!) Lecture 4. Maximum and Minimum Entropy. Entropy. Entropy of Transition Rules. Entropy Examples

biologically-inspired computing lecture 22 Informatics luis rocha 2015 INDIANA UNIVERSITY biologically Inspired computing

Introduction to Artificial Life and Cellular Automata. Cellular Automata

Complexity Classes in the Two-dimensional Life Cellular Automata Subspace

Cellular Automata. Jason Frank Mathematical Institute

15-251: Great Theoretical Ideas in Computer Science Lecture 7. Turing s Legacy Continues

Extension of cellular automata by introducing an algorithm of recursive estimation of neighbors

Any live cell with less than 2 live neighbours dies. Any live cell with 2 or 3 live neighbours lives on to the next step.

biologically-inspired computing lecture 9 Informatics luis rocha 2015 INDIANA UNIVERSITY biologically Inspired computing

Toward a Better Understanding of Complexity

Cellular Automata: Tutorial

The Nature of Computation

Mechanisms of Emergent Computation in Cellular Automata

BINARY MORPHOLOGY AND CELLULAR AUTOMATA

Turing s Legacy Continues

Cellular Automata and Tilings

Can You do Maths in a Crowd? Chris Budd

NETWORK REPRESENTATION OF THE GAME OF LIFE

Chaos, Complexity, and Inference (36-462)

CELLULAR AUTOMATA WITH CHAOTIC RULE FORMATION AND ITS CHARACTERISTICS ABSTRACT

Logic Programming for Cellular Automata

CS 420/594: Complex Systems & Self-Organization Project 1: Edge of Chaos in 1D Cellular Automata Due: Sept. 20

Complex dynamics of elementary cellular automata emerging from chaotic rules

Learning Cellular Automaton Dynamics with Neural Networks

Computation by competing patterns: Life rule B2/S

Computation in Cellular Automata: A Selected Review

Project 1: Edge of Chaos in 1D Cellular Automata

Partitioning of Cellular Automata Rule Spaces

Stream Ciphers. Çetin Kaya Koç Winter / 20

Non-Uniform Cellular Automata a Review. 1. Introduction. Daniel Camara

Chaos, Complexity, and Inference (36-462)

Revisiting the Edge of Chaos: Evolving Cellular Automata to Perform Computations

Cellular Automata. Jarkko Kari Spring University of Turku

Recognizing Complex Behavior Emerging from Chaos in Cellular Automata

arxiv: v1 [cs.fl] 17 May 2017

We prove that the creator is infinite Turing machine or infinite Cellular-automaton.

Information Encoding by Using Cellular Automata

Simulation of cell-like self-replication phenomenon in a two-dimensional hybrid cellular automata model

Outline 1 Introduction Tiling definitions 2 Conway s Game of Life 3 The Projection Method

Exercise 4: Markov Processes, Cellular Automata and Fuzzy Logic

@igorwhiletrue

Controlling chaos in random Boolean networks

Justine Seastres. Cellular Automata and the Game of Life

Introduction to Cellular automata

Bio-inspired Models of Computation Seminar. Daniele Sgandurra. 16 October 2009

(Anti-)Stable Points and the Dynamics of Extended Systems

Cellular Automata. Jarkko Kari Spring University of Turku

Evolutionary Games and Computer Simulations

1 What makes a dynamical system computationally powerful?

On Elementary and Algebraic Cellular Automata

XX Eesti Arvutiteaduse Talvekool

The Fixed String of Elementary Cellular Automata

biologically-inspired computing lecture 14 Informatics luis rocha 2015 biologically Inspired computing INDIANA UNIVERSITY

arxiv: v1 [nlin.cg] 4 Nov 2014

Image Encryption and Decryption Algorithm Using Two Dimensional Cellular Automata Rules In Cryptography

A Colorful Introduction to Cellular Automata

biologically-inspired computing lecture 15 Informatics luis rocha 2015 biologically Inspired computing INDIANA UNIVERSITY

What are Cellular Automata?

Note that numerically, with white corresponding to 0 and black to 1, the rule can be written:

THE MEAN-MEDIAN MAP MARC CHAMBERLAND AND MARIO MARTELLI

Chapter 2 Simplicity in the Universe of Cellular Automata

CS 365 Introduc/on to Scien/fic Modeling Lecture 2: Cellular Automata

Symmetry and Entropy of One- Dimensional Legal Cellular Automata

Cellular Automata: Overview and classical results

The Evolution of Emergent Computation

From Glider to Chaos: A Transitive Subsystem Derived From Glider B of CA Rule 110

Theory of Rule 6 and it s Application to Round Robin Tournament

Continuous Spatial Automata

Pascal s Triangle: Cellular Automata and Attractors

Stochastic Model for Adaptation Using Basin Hopping Dynamics

Investigation of Rule 73 as a Case Study of Class 4 Long-Distance Cellular Automata. Lucas Kang

arxiv:cond-mat/ v4 [cond-mat.soft] 23 Sep 2002

Mathematical Biology - Lecture 1 - general formulation

Artificial Life. Prof. Dr. Rolf Pfeifer Hanspeter Kunz Marion M. Weber Dale Thomas. Institut für Informatik der Universität Zürich

Discrete Tranformation of Output in Cellular Automata

Rule 110 explained as a block substitution system

P The Entropy Trajectory: A Perspective to Classify Complex Systems. Tomoaki SUZUDO Japan Atomic Energy Research Institute, JAERI

Turing machines Finite automaton no storage Pushdown automaton storage is a stack What if we give the automaton a more flexible storage?

On the Dynamic Qualitative Behavior of Universal Computation

Computational Mechanics of the Two Dimensional BTW Model

arxiv: v1 [nlin.cg] 12 Oct 2014

Evolvability, Complexity and Scalability of Cellular Evolutionary and Developmental Systems

Properties and Behaviours of Fuzzy Cellular Automata

A comparison of evolutionary and coevolutionary search

Transcription:

lecture 12 -inspired

Sections I485/H400 course outlook Assignments: 35% Students will complete 4/5 assignments based on algorithms presented in class Lab meets in I1 (West) 109 on Lab Wednesdays Lab 0 : January 14 th (completed) Introduction to Python (No Assignment) Lab 1 : January 28 th Measuring Information (Assignment 1) Graded Lab 2 : February 11 th L-Systems (Assignment 2) Graded Lab 3: March 11 th Cellular Automata and Boolean Networks (Assignment 3)

Readings until now Class Book Nunes de Castro, Leandro [2006]. Fundamentals of Natural Computing: Basic Concepts, Algorithms, and Applications. Chapman & Hall. Chapter 2, all sections Chapter 7, sections 7.3 Cellular Automata Chapter 8, sections 8.1, 8.2, 8.3.10 Lecture notes Chapter 1: What is Life? Chapter 2: The logical Mechanisms of Life Chapter 3: Formalizing and Modeling the World Chapter 4: Self-Organization and Emergent Complex Behavior posted online @ http://informatics.indiana.edu/rocha/ibic Optional Flake s [1998], The Computational Beauty of Life. MIT Press. Chapters 10, 11, 14 Dynamics, Attractors and chaos

final project schedule ALIFE 15 Projects Due by May 4 th in Oncourse ALIFE 15 (14) Actual conference due date: 2016 http://blogs.cornell.edu/alife14nyc/ 8 pages (LNCS proceedings format) http://www.springer.com/computer/lncs?sgwi D=0-164-6-793341-0 Preliminary ideas due by April 1 st! Individual or group With very definite tasks assigned per member of group

more formally D-dimensional lattice L with a finite automaton in each lattice site (cell) What s a CA? Neighborhood template N State-determined system finite number of states Σ: K= Σ E.g. Σ = {0,1} finite input alphabet α transition function Δ: α Σ uniquely ascribes state s in Σ to input patterns α Example K=8 N=5 α =37,768 D 10 30,000 N α Σ, α = K N D = K Number of possible neighborhood states K N Number of possible transition functions

Finding the structure of all possible transition functions Langton s parameter Statistical analysis Identify classes of transition functions with similar behavior Similar dynamics (statistically) Via Higher level statistical observables Like Kauffman The Lambda Parameter (similar to bias in BN) Select a subset of D characterized by λ Arbitrary quiescent state: s q Usually 0 A particular function Δ has n transitions to this state and (K N -n) transitions to other states s of Σ (1-λ) is the probability of having a s q in every position of the rule table λ = N K n K N Range: from most homogeneous to most heterogeneous Langton, C.G. [1990]. Computation at the edge of chaos: phase transitions and emergent computation. Artificial Life II. Addison-Wesley. λ = 0: all transitions lead to s q (n =K N ) λ = 1: no transitions lead to s q (n =0) λ = 1-1/K: equally probable states ( n=1/k. K N )

A phase transition? Edge of chaos Transient growth in the vicinity of phase transitions Length of CA lattice only relevant around phase transition (λ=0.5) Conclusion: more complicated behavior found in the phase transition between order and chaos Patterns that move across the lattice

Transition region Computation at the edge of chaos? Supports both static and propagating structures λ =0.4+ Propagating waves ( signals?) across the CA lattice Necessary for computation? Signals and storage? Computation Requires storage and transmission of information Any dynamical system supporting computation must exhibit long-range signals in space and time Wolfram s CA classes I: homogeneous state Steady-state II: periodic state Limit cycles III: chaotic IV: complex patterns of localized structures Long transients Capable of universal computation

imagine automata as agents quorum sensing or what decision to take? (Density Classification) K N = 2 7 =128

density classification task random strategies K N = 2 7 =128 P = 0 Typically chaotic behavior No convergence

density classification task local strategy: majority rule K N = 2 7 =128 P = 0 Isolated groups No information transmission

density classification task block expansion strategy K N = 2 7 =128 P [ 53%,60% ] blind spreading of local information No information integration Not much better than random choice

density classification task emergent computation strategies K N = 2 7 =128 Integration and transmission of information across population

for DST best CA rules

How to characterize complex behavior? collective (emergent) computation via computational mechanics Crutchfield & Mitchell [1995]. PNAS 92: 10742-10746 GA to evolve rules for DCT [1994] Das, Mitchell & Crutchfield [1994]. In: Parallel Problem Solving from Nature-III: 344-353.

John Horton Conway 2-D the game of life x x i, j = { 0,1} Sum N 8 0 1 2 3 4 5 6 7 8 x i,i = 0 0 0 0 1 0 0 0 0 0 x i,i = 1 0 0 1 1 0 0 0 0 0 1) Any living cell with fewer than two neighbors dies of loneliness. 2) Any living cell with more than three neighbors dies of crowding. 3) Any dead cell with exactly three neighbors comes to life. 4) Any living cell with two or three neighbors lives, unchanged, to the next generation Introduced in Martin Gardner s Scientific American Mathematical Games Column in 1970. Conway was interested in a rule that for certain initial conditions would produce patterns that grow without limit, and some others that fade or get stable. Popularized CAs.

wide dynamic range game of life Simple Attractors Blinkers block More complicated attractors

moving patterns game of life Glider

a threshold of complexity? unbounded growth R-pentomino runs 1103 steps before settling down into 6 gliders, 8 blocks, 4 blinkers, 4 beehives, 1 boat, 1 ship, and 1 loaf.

Unbounded growth but not complexity the glider gun Fires a glider every 30 iterations.

unbounded complexity requires information 1) Patterns that can implement information, descriptions, and construction 2) Gliders, guns, blocks, eaters life and information Very brittle Built, not evolved Not evolving Universal Turing Machine on game of life!!!

information in attractor patterns Radius 1 Neighborhood =3 Binary 2 3 = 8 input neighborhoods 2 8 = 256 rules Rule 110 http://mathworld.wolfram.com/rule110.html

structures in rule 110 Universal Computation Identification of gliders, spaceships, and other long-range or selfperpetuating patterns On the background domain produced by rule 110 14 cells repeat every seven iterations: 00010011011111 Collisions and combinations of glider patterns are exploited for computation.

is self-organization enough? computation and the edge of chaos Many systems biology models operate in the ordered regime Dynamical systems capable of computation exist well before the edge of chaos A much wider transition? A band of chaos. Most important information transmission and computation in Biology an altogether different process than self-organization Turing/Von Neumann Tape

readings Next lectures Class Book Nunes de Castro, Leandro [2006]. Fundamentals of Natural Computing: Basic Concepts, Algorithms, and Applications. Chapman & Hall. Chapter 2, 7, 8 Lecture notes Chapter 1: What is Life? Chapter 2: The logical Mechanisms of Life Chapter 3: Formalizing and Modeling the World Chapter 4: Self-Organization and Emergent Complex Behavior posted online @ http://informatics.indiana.edu/rocha/ibic Papers and other materials Optional Flake s [1998], The Computational Beauty of Life. MIT Press. Chapters 10, 11, 14 Dynamics, Attractors and chaos