biologically-inspired computing lecture 22 Informatics luis rocha 2015 INDIANA UNIVERSITY biologically Inspired computing

Similar documents
biologically-inspired computing lecture 5 Informatics luis rocha 2015 biologically Inspired computing INDIANA UNIVERSITY

biologically-inspired computing lecture 18

biologically-inspired computing lecture 6 Informatics luis rocha 2015 INDIANA UNIVERSITY biologically Inspired computing

biologically-inspired computing lecture 12 Informatics luis rocha 2015 INDIANA UNIVERSITY biologically Inspired computing

Development. biologically-inspired computing. lecture 16. Informatics luis rocha x x x. Syntactic Operations. biologically Inspired computing

Evolving Agent Swarms for Clustering and Sorting

biologically-inspired computing lecture 21 Informatics luis rocha 2015 INDIANA UNIVERSITY biologically Inspired computing

Swarm-bots and Swarmanoid: Two experiments in embodied swarm intelligence

Ant Foraging Revisited

Introduction to Swarm Robotics

Outline. 1 Initial Definitions. 2 Examples of SI in Biology. 3 Self-Organization. 4 Stigmergy. 5 Swarm Robotics

Swarm Intelligence W13: From Aggregation and Segregation to Structure Building

Can You do Maths in a Crowd? Chris Budd

Ant Colony Optimization: an introduction. Daniel Chivilikhin

Swarm-bots. Marco Dorigo FNRS Research Director IRIDIA Université Libre de Bruxelles

Capacitor Placement for Economical Electrical Systems using Ant Colony Search Algorithm

Varying the Population Size of Artificial Foraging Swarms on Time Varying Landscapes

depending only on local relations. All cells use the same updating rule, Time advances in discrete steps. All cells update synchronously.

Engineering Self-Organization and Emergence: issues and directions

VI" Autonomous Agents" &" Self-Organization! Part A" Nest Building! Autonomous Agent! Nest Building by Termites" (Natural and Artificial)!

Outline. Ant Colony Optimization. Outline. Swarm Intelligence DM812 METAHEURISTICS. 1. Ant Colony Optimization Context Inspiration from Nature

DRAFT VERSION: Simulation of Cooperative Control System Tasks using Hedonistic Multi-agents

Motivation. Evolution has rediscovered several times multicellularity as a way to build complex living systems

biologically-inspired computing lecture 9 Informatics luis rocha 2015 INDIANA UNIVERSITY biologically Inspired computing

Extension of cellular automata by introducing an algorithm of recursive estimation of neighbors

Swarm Intelligence Systems

Sensitive Ant Model for Combinatorial Optimization

Stigmergy: a fundamental paradigm for digital ecosystems?

ARTIFICIAL INTELLIGENCE

Models of Termite Nest Construction Daniel Ladley Computer Science 2003/2004

Mathematical modeling of complex systems Part 1. Overview

DESIGNING CNN GENES. Received January 23, 2003; Revised April 2, 2003

Traffic Signal Control with Swarm Intelligence

Toward a Better Understanding of Complexity

Computational Intelligence Methods

Collective Decision-Making in Honey Bee Foraging Dynamics

Introduction to Artificial Life and Cellular Automata. Cellular Automata

SINGLE-ELECTRON CIRCUITS PERFORMING DENDRITIC PATTERN FORMATION WITH NATURE-INSPIRED CELLULAR AUTOMATA

Available online at ScienceDirect. Procedia Computer Science 20 (2013 ) 90 95

El Botellón: Modeling the Movement of Crowds in a City

Introduction to Informatics

Traffic Flow Simulation using Cellular automata under Non-equilibrium Environment

Emergent Teamwork. Craig Reynolds. Cognitive Animation Workshop June 4-5, 2008 Yosemite

RESOURCES: Smithsonian Science and Technology. Concepts Motion and Design Unit Lessons 1-17

Towards Synthesizing Artificial Neural Networks that Exhibit Cooperative Intelligent Behavior: Some Open Issues in Artificial Life Michael G.

Deterministic Nonlinear Modeling of Ant Algorithm with Logistic Multi-Agent System

Modelling with cellular automata

Homework 2: MDPs and Search

Chapter 1 Introduction

Short Course: Multiagent Systems. Multiagent Systems. Lecture 1: Basics Agents Environments. Reinforcement Learning. This course is about:

Cellular Automata. and beyond. The World of Simple Programs. Christian Jacob

An ant colony algorithm for multiple sequence alignment in bioinformatics

Templates. Template is a pattern used to construct another pattern Used in conjunction with sorting behaviour:

Chapter 1 Introduction

CPSD: Grade 4 Science and Social Studies. First Quarter Second Quarter Third Quarter Fourth Quarter

3D HP Protein Folding Problem using Ant Algorithm

Self-Organization in Social Insects

Evolution and Epigenetics. Seminar: Social, Cognitive and Affective Neuroscience Speaker: Wolf-R. Brockhaus

An Ant-Based Computer Simulator

Synchronization and Swarming: Clocks and Flocks

Cellular Automata. ,C ) (t ) ,..., C i +[ K / 2] Cellular Automata. x > N : C x ! N. = C x. x < 1: C x. = C N+ x.

Decrease in Number of Piles. Lecture 10. Why does the number of piles decrease? More Termites. An Experiment to Make the Number Decrease More Quickly

Cognitive Robotics. Outline

Introduction to Scientific Modeling CS 365, Fall 2011 Cellular Automata

Next Generation Science Standards Correlations (1 of 6)

Lectures on Medical Biophysics Department of Biophysics, Medical Faculty, Masaryk University in Brno. Biocybernetics

Fifth Grade: Science: Earth and Space Science

Meta-heuristic ant colony optimization technique to forecast the amount of summer monsoon rainfall: skill comparison with Markov chain model

A Simple Approach to the Multi-Predator Multi-Prey Pursuit Domain

Organization of work via the "common stomach" in social insects

BRICK TOWNSHIP PUBLIC SCHOOLS SCIENCE CURRICULUM. Content Area: Middle School Science. Grade Level: Eighth Grade. 45 Days. 45 Days. 45 Days.

Agent-Based Modeling Using Swarm Intelligence in Geographical Information Systems

Intuitionistic Fuzzy Estimation of the Ant Methodology

E190Q Lecture 10 Autonomous Robot Navigation

Computational Intelligence Winter Term 2009/10

biologically-inspired computing lecture 14 Informatics luis rocha 2015 biologically Inspired computing INDIANA UNIVERSITY

Vocabulary Objective Resources Assessments Standards

NATIONAL CERTIFICATE (VOCATIONAL) APPLIED ENGINEERING TECHNOLOGY NQF LEVEL 4 NOVEMBER 2009

FUNDAMENTALS OF NATURAL COMPUTING Basic Concepts, Algorithms, and Applications

Computer Simulation and Applications in Life Sciences. Dr. Michael Emmerich & Dr. Andre Deutz LIACS

Metaheuristics and Local Search

Course 16:198:520: Introduction To Artificial Intelligence Lecture 13. Decision Making. Abdeslam Boularias. Wednesday, December 7, 2016


The Phase-Ordering Kinetics of Cemetery Organization in Ants

CS 380: ARTIFICIAL INTELLIGENCE

Computational Intelligence

Artificial Neural Networks Examination, June 2005

Geography for Life. Course Overview

Situation. The XPS project. PSO publication pattern. Problem. Aims. Areas

Contact Information CS 420/527. Biologically-Inspired Computation. CS 420 vs. CS 527. Grading. Prerequisites. Textbook 1/11/12

Machine Learning. Neural Networks

Metaheuristics and Local Search. Discrete optimization problems. Solution approaches

Genetic Algorithm for Solving the Economic Load Dispatch

Contact Information. CS 420/594 (Advanced Topics in Machine Intelligence) Biologically-Inspired Computation. Grading. CS 420 vs. CS 594.

Simulation of the Coevolution of Insects and Flowers

Introduction. Spatial Multi-Agent Systems. The Need for a Theory

Cellular automata are idealized models of complex systems Large network of simple components Limited communication among components No central

P The Entropy Trajectory: A Perspective to Classify Complex Systems. Tomoaki SUZUDO Japan Atomic Energy Research Institute, JAERI

Empirical Study of Traffic Velocity Distribution and its Effect on VANETs Connectivity

Science Curriculum. Fourth Grade

Transcription:

lecture 22 -inspired

Sections I485/H400 course outlook Assignments: 35% Students will complete 4/5 assignments based on algorithms presented in class Lab meets in I1 (West) 109 on Lab Wednesdays Lab 0 : January 14 th (completed) Introduction to Python (No Assignment) Lab 1 : January 28 th Measuring Information (Assignment 1) Graded Lab 2 : February 11 th L-Systems (Assignment 2) Graded Lab 3: March 25 th Cellular Automata & Boolean Networks (Assignment 3) Graded Lab 4: April 8 th Genetic Algorithms (Assignment 4) Being graded Lab 5: April 22 nd Ant Clustering Algorithm (Assignment 5) Due May 4 th

Readings until now Class Book Nunes de Castro, Leandro [2006]. Fundamentals of Natural Computing: Basic Concepts, Algorithms, and Applications. Chapman & Hall. Chapters 1,2,3,7,8 Chapter 5, all sections Section 7.7, 8.3.1,8.3.6,8.3.8-10 Lecture notes Chapter 1: What is Life? Chapter 2: The Logical Mechanisms of Life Chapter 3: Formalizing and Modeling the World Chapter 4: Self-Organization and Emergent Complex Behavior Chapter 5: Reality is Stranger than Fiction posted online @

final project schedule ALIFE 15 Projects Due by May 6 th in Oncourse ALIFE 15 (14) Actual conference due date: 2016 http://blogs.cornell.edu/alife14nyc/ 8 pages (LNCS proceedings format) http://www.springer.com/computer/lncs?sgwi D=0-164-6-793341-0 Preliminary ideas overdue! Individual or group With very definite tasks assigned per member of group

differences and explanations biological, social and complexity explanations Emergent behavior Intricate structures and behavior from the interaction of many simple agents or rules Examples Cellular Automata, Ant colonies, development, morphogenesis, brains, immune systems, economic markets Mechanism Parallelism, multiplicity, stigmergy, multi-solutions, redundancy Design causes Natural selection, self-organization, epigenetics, culture

based on dead body cleaning ant clustering algorithm (ACA) Very simple rules for colony clean up Pick dead ant. if a dead ant is found pick it up (with probability inversely proportional to the quantity of dead ants in vicinity) and wander. Drop dead ant. If dead ants are found, drop ant (with probability proportional to the quantity of dead ants in vicinity) and wander. Data vector: X x 1 x 2 x 3 x n-1 x n x 1 x 2 x 3 x n-1 x n Lumer, E. D. and Faieta, B. 1994. Diversity and adaptation in populations of clustering ants. In From Animals To Animats 3, pp. 501-508. x 1 x 2 x 3 x n-1 x n Cluster data (N samples) according to ant clean up rules

for multivariate data ant clustering algorithm (ACA) Group n-dimensional data samples in 2-dimensional grid Data vector: X 1 x 1,1 x 1,2 x 1,3 x 1,n-1 x 1,n Distance between two data samples (in original space): ) D( x ) ( i,x j = xi, k x j, k Data vector: X 2 e.g. Euclidean k = 1 x 2,1 x 2,2 x 2,3 x 2,n-1 x 2,n Ants see data points in a certain neighborhood n 2 s 2 : area of neighborhood (side s, radius 1)

using thresholds Clustering rules Pick data sample If there are few similar Drop data sample. If there are many similar Reduces dimensionality No a priori number of clusters Overshoots number of clusters p f d ( x ) i ant clustering algorithm (ACA) Probability of picking up p p ( x ) i = k Probability of dropping ( ) ( ) 1 2 = s x j Neigh 0 ( s s) 1 ( x ) k1 + f ( x, x ) ( x ) 2 f xi if f xi < k2 ( xi ) = 1 otherwise Neighborhood Similarity or density measure p D 1 i j α if otherwise Discrimination factor Improved with d i = k Threshold i 2 f + 2 ( xi ) f ( x ) f > 0 Different moving speeds, Shortterm memory, Behavioral switches Cooling cycle for thresholds, progressive vision, pheromone reinforcement 2 i

The workings ant clustering algorithm (ACA) 1. Project high-dimensional data items onto 2-dimensional grid randomly 2. Distribute N ants randomly on grid 3. repeat For every ant i in colony Compute neighborhood density f(x i ) If ant i is unloaded and its cell is occupied with data item x i then pick up x i with probability p p (x i ) Else if ant i is loaded with x i and its cell is empty drop x i with probability p d (x i ) Move randomly to neighbor cell with no ant 4. Until maximum iterations

by brood sorting Same principle as Clustering Rules Pick data sample of type t If there are few of type t Drop data sample of type t. If there are many of type t p p d p ( x t) i = k sorting with ants 1 k + f 1 t ( x ) i Probability of picking up item of type t ( x t) i = k 2 ft + ( xi ) f ( x ) t i 2 2 f t ( x ) i Probability of dropping item of type t 1 2 = s x j Neight 0 ( s s) D 1 ( x, x ) otherwise i α Neighborhood density of type t j if f > 0

based on ant algorithm sorting swarm-robots Holland O. & Melhuish C. (1999) Stigmergy, Self-organisation, and Sorting in Collective Robotics Journal of Adaptive Behaviour. 5(2). Bristol Robotics Laboratory. See Also: J. L. Deneubourg, S. Goss, N. Franks, A. Sendova-Franks, C. Detrain, L. Chretien. The Dynamics of Collective Sorting Robot-Like Ants and Ant-Like Robots. From Animals to Animats: Proc. of the 1st Int. Conf. on Simulation of Adaptive Behaviour. 356-363 (1990).

bio-inspired collective robotics Box pushing tasks Taxis-based action (reflex translation or rotation in response to stimulus) and kinesthetic-based action (or proprioception) + realignment and repositioning C. Ronald Kube, Chris A. Parker, Tao Wang and Hong Zhang. "Biologically Collective Robotics," Chapter 15 in Recent Developments in Biologically Computing, de Castro, Leandro N. and Von Zuben, Fernando J., editors, Idea Group Publlishing, 456 pages, 2005.

natural organization bee s nets

by stigmergy self-assembly Self-assembly algorithm Agents move randomly on a 3D grid of sites. An agent deposits a brick every time it finds a stimulating configuration. Rule table contains all such configurations A rule table defines a particular self-assembly algorithm. Rule space is very large From E. Bonabeau. Swarm Intelligence.

space-station by dynamic concepts (dynamic-concepts.com) robotic self-assembly Phase 1: Simulating construction rules

by dynamic concepts (phase two) robotic self-assembly Phase 2: prototype robots

swarm cognition and art Vitorino Ramos: Pheromone Fields as Swarm Cognitive Maps Artificial Ants in Digital Image Habitats A strange Metamorphosis [From Kafka 2 Red Ant] epostcard: V.Ramos CVRM-IST [http://alfa.ist.utl.pt/~cvrm/staff/vramos]; June 2001. Created with an Artificial Ant Colony, that uses images as Habitats, being sensible to their gray levels. At the second row, Kafka is replaced as a substrate, by Red Ant. In black, the higher levels of pheromone (a chemical evaporative sugar substance used by swarms on their orientation trought out the trails). It s exactly this artificial evaporation and the computational ant collective group sinergy realocating their upgrades of pheromone at interesting places, that allows for the emergence of adaptation and perception of new images. Only some of the 6000 iterations processed are represented. The system does not have any type of hierarchy, and ants communicate only in indirect forms, through out the sucessive alteration that they found on the Habitat.

Leonel Moura swarm art

Leonel Moura s RAP (Robotic Action Painter) @ The American Museum of Natural History sensors to avoid obstacles, to perceive the presence of visitors near the case, to check the paper, and most important to detect color. Two modes Random until color threshold is detected. Random sketching Random seed from relative direction measured by an onboard compass. Reactive After passing color threshold Does not go back Draws only where color exceeds threshold. Stopping criteria Pattern in color sensor grid signs off at the corner and flashes lights

Dirk Helbing s Group Modeling traffic and human group behavior Vehicles and people modeled as particles in a fluid medium Free traffic: behaves as a gas Particles move freely Congested traffic: behaves as a liquid movement of particles strongly depends on surrounding dynamics Shock waves emerge from density variations Example in congested traffic The velocity change of a vehicle propagates (with a homogenous time delay) in the opposite direction of traffic as downstream vehicle respond to changes in upstream vehicles propagation speed aprox. -15 km/h (In free traffic = free vehicle velocity). D. Helbing: Traffic and related self-driven many-particle systems. Reviews of Modern Physics 73, 1067-1141 (2003).

Dirk Helbing s Group People modeled as self-driven many-particle systems Testing individualistic vs herding behavior as well as environmental solutions Modeling crowd disasters D. Helbing, A. Johansson and H. Z. Al- Abideen (2007) The Dynamics of Crowd Disasters: An Empirical Study. Physical Review E 75, 046109.

exploring similarities across nature Natural design principles self-similar structures Trees, plants, clouds, mountains morphogenesis Mechanism Iteration, recursion, feedback Unpredictability From limited knowledge or inherent in nature? Mechanism Chaos, measurement Emergence, and self-organization Complex behavior from collectives of many simple units or agents Cellular Automata, development, morphogenesis, brains Mechanism Parallelism, multiplicity, multi-solutions, redundancy (open-ended) Evolution Adaptation, novelty, creativity, learning Mechanism Reproduction, transmission, variation, selection Collective behavior, network causality Behavior derived from many inseparable sources Environment, ant colonies, embodiment, epigenetics, culture, immune systems, economic markets Mechanism Interactivity, stigmergy, non-holonomic constraints

readings Next lectures Class Book Nunes de Castro, Leandro [2006]. Fundamentals of Natural Computing: Basic Concepts, Algorithms, and Applications. Chapman & Hall. Chapter 6 Lecture notes Chapter 1: What is Life? Chapter 2: The logical Mechanisms of Life Chapter 3: Formalizing and Modeling the World Chapter 4: Self-Organization and Emergent Complex Behavior Chapter 5: Reality is Stranger than Fiction Chapter 6: Von Neumann and Natural Selection Chapter 7: Modeling Evolution: Evolutionary Computation posted online @ http://informatics.indiana.edu/rocha/ibic