Stigmergic navigation on an RFID floor with a multi-robot team Ali Abdul Khaliq Maurizio Di Rocco Alessandro Saffiotti

Size: px
Start display at page:

Download "Stigmergic navigation on an RFID floor with a multi-robot team Ali Abdul Khaliq Maurizio Di Rocco Alessandro Saffiotti"

Transcription

1 Stigmergic navigation on an RFID floor with a multi-robot team Ali Abdul Khaliq Maurizio Di Rocco Alessandro Saffiotti AASS Cognitive Robotic Systems Lab University of Örebro, Sweden 1

2 Motivation Stigmergy in nature Animals use the environment for indirect communication For example: ants (pheromone trials) 2

3 Can we exploit Stigmergy with robots? Previous work: Distance map building (Johansson and Saffiotti, ICRA 2009): Extension: Obstacle map building, coordinated exploration and safe navigation 3

4 Shortest Path to Goal Distance Map (Johansson and Saffiotti, ICRA 2009): Store a distance map in the environment Use a RFID tag reader equipped mobile robot Tag reader Euclidean distance Distance considering obstacles 4

5 Distance Map Building with multiple robots 1 5

6 Distance Map Building with multiple robots Black = Unvisited tags More green = Goal tag More red = More distant C= C= Variant of Bellman-Ford algorithm 6

7 Distance Map Building with multiple robots No need to save the states Decentralized Indirect communication Add/remove robots at anytime Visualization of experiment Real robots during experiment 7

8 Distance Map Building with multiple robots No need to save the states Decentralized Indirect communication Add/remove robots at anytime Goal tag 8

9 Distance Map Building: Convergence Stored value at time t Shortest distance 9

10 Obstacle Map Building with multiple robots 2 10

11 Obstacle Map Building with multiple robots The value at each tag of RFID floor is proportional to closeness to the nearest obstacle This map can be used for obstacle avoidance l Obstacle three tags away! 11

12 Obstacle Map Building with multiple robots The value at each tag of RFID floor is proportional to closeness to the nearest obstacle This map can be used for obstacle avoidance 12

13 Multi robot Coordination in Map Building 3 13

14 Multi robot Coordination in Map Building Exploration without coordination of robots 14

15 Multi robot Coordination in Map Building Each robot mark its own territory Territory marked by each robot 15

16 Multi robot Coordination in Map Building Each robot mark its own territory Coordinated exploration of four robots 16

17 Multi robot Coordination in Map Building Each robot mark its own territory Coordinated exploration of four robots 17

18 Safe navigation on the built maps 4 18

19 Safe navigation on the built maps Navigation on the built map towards the target position, by using a combination of the distance map and the obstacle map Minimum clearance 19

20 Safe navigation on the built maps Navigation on the built map towards the target position, by using a combination of the distance map and the obstacle map Obstacle clearance is set to two tags Obstacle clearance is set to one tag 20 Safest navigation

21 Safe navigation on the built maps Goal tag Navigation on the built map towards the target position, by using a combination of the distance map and the obstacle map Obstacle clearance is set to two tags Obstacle clearance is set to one tag 21 Safest navigation

22 Safe navigation on the built maps Goal tag Goal tag Navigation on the built map towards the target position, by using a combination of the distance map and the obstacle map Obstacle clearance is set to two tags Obstacle clearance is set to one tag 22 Safest navigation

23 Safe navigation on the built maps Goal tag Goal tag Navigation on the built map towards the target position, by using a combination of the distance map and the obstacle map Obstacle clearance is set to two tags Goal tag Obstacle clearance is set to one tag 23 Safest navigation

24 Conclusion Distance Map are Building with multiple robots Obstacle Map Building with multiple robots Multi robot Coordination in Map Building Safe navigation on the built maps Distance map Coordination Navigation Obstacle map 24

25 Next Steps We are currently performing experiments in real apartments equipped with RFID floors Including heterogeneous robots in map building and in navigation Smart exploration of environment when building the maps 25

26 Thank you! 26

Sensitive Ant Model for Combinatorial Optimization

Sensitive Ant Model for Combinatorial Optimization Sensitive Ant Model for Combinatorial Optimization CAMELIA CHIRA cchira@cs.ubbcluj.ro D. DUMITRESCU ddumitr@cs.ubbcluj.ro CAMELIA-MIHAELA PINTEA cmpintea@cs.ubbcluj.ro Abstract: A combinatorial optimization

More information

Outline. Ant Colony Optimization. Outline. Swarm Intelligence DM812 METAHEURISTICS. 1. Ant Colony Optimization Context Inspiration from Nature

Outline. Ant Colony Optimization. Outline. Swarm Intelligence DM812 METAHEURISTICS. 1. Ant Colony Optimization Context Inspiration from Nature DM812 METAHEURISTICS Outline Lecture 8 http://www.aco-metaheuristic.org/ 1. 2. 3. Marco Chiarandini Department of Mathematics and Computer Science University of Southern Denmark, Odense, Denmark

More information

Swarm Intelligence W13: From Aggregation and Segregation to Structure Building

Swarm Intelligence W13: From Aggregation and Segregation to Structure Building Swarm Intelligence W13: From Aggregation and Segregation to Structure Building Stigmergy Quantitative Qualitative Outline Distributed building in: natural systems artificial virtual systems artificial

More information

Ant Colony Optimization: an introduction. Daniel Chivilikhin

Ant Colony Optimization: an introduction. Daniel Chivilikhin Ant Colony Optimization: an introduction Daniel Chivilikhin 03.04.2013 Outline 1. Biological inspiration of ACO 2. Solving NP-hard combinatorial problems 3. The ACO metaheuristic 4. ACO for the Traveling

More information

Decentralized Stabilization of Heterogeneous Linear Multi-Agent Systems

Decentralized Stabilization of Heterogeneous Linear Multi-Agent Systems 1 Decentralized Stabilization of Heterogeneous Linear Multi-Agent Systems Mauro Franceschelli, Andrea Gasparri, Alessandro Giua, and Giovanni Ulivi Abstract In this paper the formation stabilization problem

More information

Engineering Self-Organization and Emergence: issues and directions

Engineering Self-Organization and Emergence: issues and directions 5/0/ Engineering Self-Organization and Emergence: issues and directions Franco Zambonelli franco.zambonelli@unimore.it Agents and Pervasive Computing Group Università di Modena e Reggio Emilia SOAS 005

More information

depending only on local relations. All cells use the same updating rule, Time advances in discrete steps. All cells update synchronously.

depending only on local relations. All cells use the same updating rule, Time advances in discrete steps. All cells update synchronously. Swarm Intelligence Systems Cellular Automata Christian Jacob jacob@cpsc.ucalgary.ca Global Effects from Local Rules Department of Computer Science University of Calgary Cellular Automata One-dimensional

More information

Working Group Cognitive Robotics

Working Group Cognitive Robotics Working Group Cognitive Robotics Bernd Krieg-Brückner, Reinhard Moratz, Thomas Röfer, Kai Hübner, Axel Lankenau, Tilman Vierhuff Bremen Institute of Safe Systems Center for Computing Technology Universität

More information

Cutting Edge Engineering for Modern Geospatial Systems Rear Admiral Dr. S Kulshrestha, retd

Cutting Edge Engineering for Modern Geospatial Systems Rear Admiral Dr. S Kulshrestha, retd Cutting Edge Engineering for Modern Geospatial Systems Rear Admiral Dr. S Kulshrestha, retd 11 Jun 2015 GeoIntelligence Asia 2015 The technology would become so pervasive that it becomes a part of you

More information

Coevolution of Multiagent Systems using NEAT

Coevolution of Multiagent Systems using NEAT Coevolution of Multiagent Systems using NEAT Matt Baer Abstract This experiment attempts to use NeuroEvolution of Augmenting Topologies (NEAT) create a Multiagent System that coevolves cooperative learning

More information

biologically-inspired computing lecture 22 Informatics luis rocha 2015 INDIANA UNIVERSITY biologically Inspired computing

biologically-inspired computing lecture 22 Informatics luis rocha 2015 INDIANA UNIVERSITY biologically Inspired computing lecture 22 -inspired Sections I485/H400 course outlook Assignments: 35% Students will complete 4/5 assignments based on algorithms presented in class Lab meets in I1 (West) 109 on Lab Wednesdays Lab 0

More information

Lab 1: Jumping Right In

Lab 1: Jumping Right In Lab 1: Jumping Right In Bio427 Biomechanics The first lecture of the class reviewed basic physical quantities that we will use throughout the course. Distance (position), velocity, acceleration, momentum,

More information

Swarm Intelligence Systems

Swarm Intelligence Systems Swarm Intelligence Systems Christian Jacob jacob@cpsc.ucalgary.ca Department of Computer Science University of Calgary Cellular Automata Global Effects from Local Rules Cellular Automata The CA space is

More information

An Adaptive Clustering Method for Model-free Reinforcement Learning

An Adaptive Clustering Method for Model-free Reinforcement Learning An Adaptive Clustering Method for Model-free Reinforcement Learning Andreas Matt and Georg Regensburger Institute of Mathematics University of Innsbruck, Austria {andreas.matt, georg.regensburger}@uibk.ac.at

More information

Introduction to Swarm Robotics

Introduction to Swarm Robotics COMP 4766 Introduction to Autonomous Robotics Introduction to Swarm Robotics By Andrew Vardy April 1, 2014 Outline 1 Initial Definitions 2 Examples of SI in Biology 3 Self-Organization 4 Stigmergy 5 Swarm

More information

Outline. 1 Initial Definitions. 2 Examples of SI in Biology. 3 Self-Organization. 4 Stigmergy. 5 Swarm Robotics

Outline. 1 Initial Definitions. 2 Examples of SI in Biology. 3 Self-Organization. 4 Stigmergy. 5 Swarm Robotics Outline COMP 4766 Introduction to Autonomous Robotics 1 Initial Definitions Introduction to Swarm Robotics 2 Examples of SI in Biology 3 Self-Organization By Andrew Vardy 4 Stigmergy April 1, 2014 5 Swarm

More information

Swarm-bots and Swarmanoid: Two experiments in embodied swarm intelligence

Swarm-bots and Swarmanoid: Two experiments in embodied swarm intelligence Swarm-bots and Swarmanoid: Two experiments in embodied swarm intelligence Marco Dorigo FNRS Research Director IRIDIA Université Libre de Bruxelles IAT - 17.9.2009 - Milano, Italy What is swarm intelligence?

More information

Towards Uncertainty-Aware Path Planning On Road Networks Using Augmented-MDPs. Lorenzo Nardi and Cyrill Stachniss

Towards Uncertainty-Aware Path Planning On Road Networks Using Augmented-MDPs. Lorenzo Nardi and Cyrill Stachniss Towards Uncertainty-Aware Path Planning On Road Networks Using Augmented-MDPs Lorenzo Nardi and Cyrill Stachniss Navigation under uncertainty C B C B A A 2 `B` is the most likely position C B C B A A 3

More information

Isobath following using an altimeter as a unique exteroceptive sensor

Isobath following using an altimeter as a unique exteroceptive sensor Isobath following using an altimeter as a unique exteroceptive sensor Luc Jaulin Lab-STICC, ENSTA Bretagne, Brest, France lucjaulin@gmail.com Abstract. We consider an underwater robot equipped with an

More information

Semantic maps - a multi-hierarchical model

Semantic maps - a multi-hierarchical model - a multi-hierarchical model 64.425 Integrated Seminar: Intelligent Robotics Paul Anton Universität Hamburg Fakultät für Mathematik, Informatik und Naturwissenschaften Technische Aspekte Multimodaler Systeme

More information

Emergent Teamwork. Craig Reynolds. Cognitive Animation Workshop June 4-5, 2008 Yosemite

Emergent Teamwork. Craig Reynolds. Cognitive Animation Workshop June 4-5, 2008 Yosemite Emergent Teamwork Craig Reynolds Cognitive Animation Workshop June 4-5, 2008 Yosemite 1 This talk Whirlwind tour of collective behavior in nature Some earlier simulation models Recent work on agent-based

More information

Stigmergy: a fundamental paradigm for digital ecosystems?

Stigmergy: a fundamental paradigm for digital ecosystems? Stigmergy: a fundamental paradigm for digital ecosystems? Francis Heylighen Evolution, Complexity and Cognition group Vrije Universiteit Brussel 1 Digital Ecosystem Complex, self-organizing system Agents:

More information

Computational Intelligence Methods

Computational Intelligence Methods Computational Intelligence Methods Ant Colony Optimization, Partical Swarm Optimization Pavel Kordík, Martin Šlapák Katedra teoretické informatiky FIT České vysoké učení technické v Praze MI-MVI, ZS 2011/12,

More information

University of Houston Mathematics Contest Algebra 2 Exam. 1. Find x + y, where x and y satisfy the given pair of equations: x 2y = 16

University of Houston Mathematics Contest Algebra 2 Exam. 1. Find x + y, where x and y satisfy the given pair of equations: x 2y = 16 University of Houston Mathematics Contest 2018 Algebra 2 Exam Name 1. Find x + y, where x and y satisfy the given pair of equations: x 2y = 16 x 2 4y 2 = 512 (A) 24 (B) 26 (C) 28 (D) 0 (E) 2 (F) 4 2. Solve

More information

A PROVABLY CONVERGENT DYNAMIC WINDOW APPROACH TO OBSTACLE AVOIDANCE

A PROVABLY CONVERGENT DYNAMIC WINDOW APPROACH TO OBSTACLE AVOIDANCE Submitted to the IFAC (b 02), September 2001 A PROVABLY CONVERGENT DYNAMIC WINDOW APPROACH TO OBSTACLE AVOIDANCE Petter Ögren,1 Naomi E. Leonard,2 Division of Optimization and Systems Theory, Royal Institute

More information

Conservation of Mechanical Energy

Conservation of Mechanical Energy Core Skill Lab Conservation of Mechanical Energy A mass on a spring will oscillate vertically when it is lifted to the length of the relaxed spring and released. The gravitational potential energy increases

More information

inaturalist Training AOP inaturalist Training May 21, 2016 Slide 1

inaturalist Training AOP inaturalist Training May 21, 2016 Slide 1 inaturalist Training AOP inaturalist Training May 21, 2016 Slide 1 What is inaturalist? inaturalist is a free tool that allows people to record, share, and discuss their observations inaturalist is designed

More information

The 2017 China Collegiate Programming Contest Qinhuangdao Site Contest Section

The 2017 China Collegiate Programming Contest Qinhuangdao Site Contest Section The 207 China Collegiate Programming Contest Qinhuangdao Site Contest Section October 29, 207 Sponsored by Problem List A B C D E F G H I J K L M Balloon Robot Expected Waiting Time Crusaders Quest Graph

More information

Anytime Planning for Decentralized Multi-Robot Active Information Gathering

Anytime Planning for Decentralized Multi-Robot Active Information Gathering Anytime Planning for Decentralized Multi-Robot Active Information Gathering Brent Schlotfeldt 1 Dinesh Thakur 1 Nikolay Atanasov 2 Vijay Kumar 1 George Pappas 1 1 GRASP Laboratory University of Pennsylvania

More information

Prof. Dr. Ann Nowé. Artificial Intelligence Lab ai.vub.ac.be

Prof. Dr. Ann Nowé. Artificial Intelligence Lab ai.vub.ac.be REINFORCEMENT LEARNING AN INTRODUCTION Prof. Dr. Ann Nowé Artificial Intelligence Lab ai.vub.ac.be REINFORCEMENT LEARNING WHAT IS IT? What is it? Learning from interaction Learning about, from, and while

More information

RGI: geo-visualization RGI. The road to. Ron van Lammeren. Centre for Geo-Information 1RL01

RGI: geo-visualization RGI. The road to. Ron van Lammeren. Centre for Geo-Information 1RL01 : geo-visualization The road to. Ron van Lammeren 300505 1RL01 Contents Geo-visualisation Types of geo-visualisation Interacting by interfaces Role of geo-visualisation Usability and perception Constructing

More information

Composable Group Behaviors

Composable Group Behaviors Composable Group Behaviors Perpetual Amoah Undergraduate S. Researcher Sam Rodriguez Graduate Student Mentor Jyh-Ming Lien Graduate Student Mentor John Maffei Graduate Student Mentor Nancy M. Amato Faculty

More information

DEPARTMENT OF INFORMATION ENGINEERING AND COMPUTER SCIENCE ICT International Doctoral School

DEPARTMENT OF INFORMATION ENGINEERING AND COMPUTER SCIENCE ICT International Doctoral School DEPARTMENT OF INFORMATION ENGINEERING AND COMPUTER SCIENCE ICT International Doctoral School Indoor Localization of Wheeled Robots using Multi-sensor Data Fusion with Event-based Measurements Payam Nazemzadeh

More information

Ant Foraging Revisited

Ant Foraging Revisited Ant Foraging Revisited Liviu A. Panait and Sean Luke George Mason University, Fairfax, VA 22030 lpanait@cs.gmu.edu, sean@cs.gmu.edu Abstract Most previous artificial ant foraging algorithms have to date

More information

ChemTag. Visual Leak Detection Products. Nowtek introduces: Water Alkali. ChemTag Tape on Floor. After Chemical Exposure

ChemTag. Visual Leak Detection Products. Nowtek introduces: Water Alkali. ChemTag Tape on Floor. After Chemical Exposure introduces: ChemTag Tape on Floor After Chemical Exposure ChemTag Acid Water Alkali Visual Leak Detection Products After Chemical Exposure to ChemTag Rings on Pipe Purpose If there is a chemical leak at

More information

Conservation of Mechanical Energy Activity Purpose

Conservation of Mechanical Energy Activity Purpose Conservation of Mechanical Energy Activity Purpose During the lab, students will become familiar with solving a problem involving the conservation of potential and kinetic energy. A cart is attached to

More information

UBGI and Address Standards

UBGI and Address Standards Workshop on address standards UBGI and Address Standards 2008. 5.25 Copenhagen, Denmark Sang-Ki Hong Convenor, WG 10 1 Evolution of Geographic Information Visualization Feature (Contents) Context Accessibility

More information

Topic 9 Potential fields: Follow your potential

Topic 9 Potential fields: Follow your potential Topic 9 Potential fields: Follow your potential Path Planning B: Goal Find intermediate poses forming a path to the goal ) How can we find such paths? 2) Define pose and controls? Path on a graph: vertices

More information

Fast SSP Solvers Using Short-Sighted Labeling

Fast SSP Solvers Using Short-Sighted Labeling Luis Pineda, Kyle H. Wray and Shlomo Zilberstein College of Information and Computer Sciences, University of Massachusetts, Amherst, USA July 9th Introduction Motivation SSPs are a highly-expressive model

More information

CPSC 695. Future of GIS. Marina L. Gavrilova

CPSC 695. Future of GIS. Marina L. Gavrilova CPSC 695 Future of GIS Marina L. Gavrilova The future of GIS Overview What is GIS now How GIS was viewed before Current trends and developments Future directions of research What is GIS? Internet's definition

More information

Waves and Space Exploration Review (PS.4, PS.5, ST.1 and ESS.8)

Waves and Space Exploration Review (PS.4, PS.5, ST.1 and ESS.8) Waves 1. What causes waves? 2. Define wave. Label each below as longitudinal or transverse 3. 4. Label the crest, trough, wavelength and amplitude of the wave below. 9. In the diagram above, four complete

More information

RFID & Item-Level Information Visibility

RFID & Item-Level Information Visibility Department of Information System & Operations Management University of Florida Gainesville, Florida 32601 wzhou@ufl.edu December 13, 2008 1. Manufacturing an Engine Engine Builder Replenish Policy {A1,A2}

More information

Exploiting Context and Semantics for UAV Path-finding in an Urban Setting

Exploiting Context and Semantics for UAV Path-finding in an Urban Setting Exploiting Context and Semantics for UAV Path-finding in an Urban Setting Marjan Alirezaie, Andrey Kiselev, Franziska Klügl, Martin Längkvist, and Amy Loutfi Machine Perception and Interaction Lab, AASS

More information

Conservation of Mechanical Energy Activity Purpose

Conservation of Mechanical Energy Activity Purpose Conservation of Mechanical Energy Activity Purpose During the lab, students will become familiar with solving a problem involving the conservation of potential and kinetic energy. A cart is attached to

More information

General Physics I Lab. M1 The Atwood Machine

General Physics I Lab. M1 The Atwood Machine Purpose General Physics I Lab In this experiment, you will learn the basic operation of computer interfacing and use it in an experimental study of Newton s second law. Equipment and components Science

More information

Colorado Academic Standards for Science

Colorado Academic Standards for Science A Correlation of Pearson Chemistry To the Physical Science Standards High School INTRODUCTION This document demonstrates how meets the Colorado Academic Standards, Physical Science Standards, grades 9-12.

More information

Performance Evaluation of Anti-Collision Algorithms for RFID System with Different Delay Requirements

Performance Evaluation of Anti-Collision Algorithms for RFID System with Different Delay Requirements Performance Evaluation of Anti-Collision Algorithms for RFID System with Different Delay Requirements Warakorn Srichavengsup Computer Engineering, Robotics and Technology Laboratory Faculty of Engineering,

More information

Similarities and differences between outdoor and indoor space from the perspective of navigation

Similarities and differences between outdoor and indoor space from the perspective of navigation Similarities and differences between outdoor and indoor space from the perspective of navigation (Extended Abstract) Liping Yang, Michael Worboys Department of Spatial Information Science and Engineering,

More information

Course 16:198:520: Introduction To Artificial Intelligence Lecture 13. Decision Making. Abdeslam Boularias. Wednesday, December 7, 2016

Course 16:198:520: Introduction To Artificial Intelligence Lecture 13. Decision Making. Abdeslam Boularias. Wednesday, December 7, 2016 Course 16:198:520: Introduction To Artificial Intelligence Lecture 13 Decision Making Abdeslam Boularias Wednesday, December 7, 2016 1 / 45 Overview We consider probabilistic temporal models where the

More information

Use of graphene by an energy utility

Use of graphene by an energy utility Use of graphene by an energy utility ENGIE A global player in the energy business (2015) Power Natural gas Energy services No.1 Independent Power Producer (IPP) in the world. No.1 producer of nonnuclear

More information

Microscopic Analysis of Chips: Chips deprocessing

Microscopic Analysis of Chips: Chips deprocessing Microscopic Analysis of Chips: Chips deprocessing Dominik Malčík and Martin Drahanský Faculty of Information Technology, Brno University of Technology, Božetěchova 2, 61266 Brno, Czech Republic {imalcik,drahan}@fit.vutbr.cz

More information

Reasoning Under Uncertainty Over Time. CS 486/686: Introduction to Artificial Intelligence

Reasoning Under Uncertainty Over Time. CS 486/686: Introduction to Artificial Intelligence Reasoning Under Uncertainty Over Time CS 486/686: Introduction to Artificial Intelligence 1 Outline Reasoning under uncertainty over time Hidden Markov Models Dynamic Bayes Nets 2 Introduction So far we

More information

VISUAL ANALYTICS APPROACH FOR CONSIDERING UNCERTAINTY INFORMATION IN CHANGE ANALYSIS PROCESSES

VISUAL ANALYTICS APPROACH FOR CONSIDERING UNCERTAINTY INFORMATION IN CHANGE ANALYSIS PROCESSES VISUAL ANALYTICS APPROACH FOR CONSIDERING UNCERTAINTY INFORMATION IN CHANGE ANALYSIS PROCESSES J. Schiewe HafenCity University Hamburg, Lab for Geoinformatics and Geovisualization, Hebebrandstr. 1, 22297

More information

Models of Termite Nest Construction Daniel Ladley Computer Science 2003/2004

Models of Termite Nest Construction Daniel Ladley Computer Science 2003/2004 Models of Termite Nest Construction Daniel Ladley Computer Science 2003/2004 The candidate confirms that the work submitted is their own and the appropriate credit has been given where reference has been

More information

3D GEOVISUALIZATION & STYLIZATION TO MANAGE COMPREHENSIVE AND PARTICIPATIVE LOCAL URBAN PLANS

3D GEOVISUALIZATION & STYLIZATION TO MANAGE COMPREHENSIVE AND PARTICIPATIVE LOCAL URBAN PLANS 3D GEOVISUALIZATION & STYLIZATION TO MANAGE COMPREHENSIVE AND PARTICIPATIVE LOCAL URBAN PLANS 11th 3D Geoinfo Conference 20-21 October 2016 M. BRASEBIN, S. CHRISTOPHE, F. JACQUINOD, A. VINESSE, H. MAHON

More information

Bioinspired Environmental Coordination in Spatial Computing Systems

Bioinspired Environmental Coordination in Spatial Computing Systems Bioinspired Environmental Coordination in Spatial Computing Systems Justin Werfel jkwerfel@mit.edu Yaneer Bar-Yam yaneer@necsi.edu Donald Ingber donald.ingber@childrens.harvard.edu New England Complex

More information

A Note on the Parameter of Evaporation in the Ant Colony Optimization Algorithm

A Note on the Parameter of Evaporation in the Ant Colony Optimization Algorithm International Mathematical Forum, Vol. 6, 2011, no. 34, 1655-1659 A Note on the Parameter of Evaporation in the Ant Colony Optimization Algorithm Prasanna Kumar Department of Mathematics Birla Institute

More information

Today s Outline. Recap: MDPs. Bellman Equations. Q-Value Iteration. Bellman Backup 5/7/2012. CSE 473: Artificial Intelligence Reinforcement Learning

Today s Outline. Recap: MDPs. Bellman Equations. Q-Value Iteration. Bellman Backup 5/7/2012. CSE 473: Artificial Intelligence Reinforcement Learning CSE 473: Artificial Intelligence Reinforcement Learning Dan Weld Today s Outline Reinforcement Learning Q-value iteration Q-learning Exploration / exploitation Linear function approximation Many slides

More information

Gradient Sampling for Improved Action Selection and Path Synthesis

Gradient Sampling for Improved Action Selection and Path Synthesis Gradient Sampling for Improved Action Selection and Path Synthesis Ian M. Mitchell Department of Computer Science The University of British Columbia November 2016 mitchell@cs.ubc.ca http://www.cs.ubc.ca/~mitchell

More information

CS599 Lecture 1 Introduction To RL

CS599 Lecture 1 Introduction To RL CS599 Lecture 1 Introduction To RL Reinforcement Learning Introduction Learning from rewards Policies Value Functions Rewards Models of the Environment Exploitation vs. Exploration Dynamic Programming

More information

Swarm-bots. Marco Dorigo FNRS Research Director IRIDIA Université Libre de Bruxelles

Swarm-bots. Marco Dorigo FNRS Research Director IRIDIA Université Libre de Bruxelles Swarm-bots Marco Dorigo FNRS Research Director IRIDIA Université Libre de Bruxelles Swarm-bots The swarm-bot is an experiment in swarm robotics Swarm robotics is the application of swarm intelligence principles

More information

Collision Avoidance from Multiple Passive Agents with Partially Predictable Behavior

Collision Avoidance from Multiple Passive Agents with Partially Predictable Behavior applied sciences Article Collision Avoidance from Multiple Passive Agents with Partially Predictable Behavior Khalil Muhammad Zuhaib 1 ID, Abdul Manan Khan 2, Junaid Iqbal 1 ID, Mian Ashfaq Ali 3, Muhammad

More information

MEM380 Applied Autonomous Robots I Fall BUG Algorithms Potential Fields

MEM380 Applied Autonomous Robots I Fall BUG Algorithms Potential Fields MEM380 Applied Autonomous Robots I Fall BUG Algorithms Potential Fields What s Special About Bugs? Many planning algorithms assume global knowledge Bug algorithms assume only local knowledge of the environment

More information

Balancing and Control of a Freely-Swinging Pendulum Using a Model-Free Reinforcement Learning Algorithm

Balancing and Control of a Freely-Swinging Pendulum Using a Model-Free Reinforcement Learning Algorithm Balancing and Control of a Freely-Swinging Pendulum Using a Model-Free Reinforcement Learning Algorithm Michail G. Lagoudakis Department of Computer Science Duke University Durham, NC 2778 mgl@cs.duke.edu

More information

2016年度 明治大学MIMS現象数理学共同研究集会 比較動物学と現象数理学から考える 海の霊長類 の知の表現法 2016年12月15日 木 16日 金 明治大学中野キャンパス6階研究セミナー室603

2016年度 明治大学MIMS現象数理学共同研究集会 比較動物学と現象数理学から考える 海の霊長類 の知の表現法 2016年12月15日 木 16日 金 明治大学中野キャンパス6階研究セミナー室603 MIMS MIMS MIMS opening remarks session 1 session 2 Intelligent Group behavior by not-necessarily intelligent Individuals: Autonomous Task Allocation Dynamics of Foraging Ants session 3 /OIST J. session

More information

Interaction of Mobile Camera Devices with physical maps

Interaction of Mobile Camera Devices with physical maps Interaction of Mobile Camera Devices with physical maps Johannes Schöning, Antonio Krüger, Hans Jörg Müller {j.schoening, antonio.krueger, joerg.mueller}@uni-muenster.de Abstract Traditional paper-based

More information

Reinforcement learning an introduction

Reinforcement learning an introduction Reinforcement learning an introduction Prof. Dr. Ann Nowé Computational Modeling Group AIlab ai.vub.ac.be November 2013 Reinforcement Learning What is it? Learning from interaction Learning about, from,

More information

Robust Connectivity Analysis for Multi-Agent Systems

Robust Connectivity Analysis for Multi-Agent Systems Robust Connectivity Analysis for Multi-Agent Systems Dimitris Boskos and Dimos V. Dimarogonas Abstract In this paper we provide a decentralized robust control approach, which guarantees that connectivity

More information

Sensor Localization and Target Estimation in Visual Sensor Networks

Sensor Localization and Target Estimation in Visual Sensor Networks Annual Schedule of my Research Sensor Localization and Target Estimation in Visual Sensor Networks Survey and Problem Settings Presented in the FL seminar on May th First Trial and Evaluation of Proposed

More information

Planning by Probabilistic Inference

Planning by Probabilistic Inference Planning by Probabilistic Inference Hagai Attias Microsoft Research 1 Microsoft Way Redmond, WA 98052 Abstract This paper presents and demonstrates a new approach to the problem of planning under uncertainty.

More information

Meta-heuristic ant colony optimization technique to forecast the amount of summer monsoon rainfall: skill comparison with Markov chain model

Meta-heuristic ant colony optimization technique to forecast the amount of summer monsoon rainfall: skill comparison with Markov chain model Chapter -7 Meta-heuristic ant colony optimization technique to forecast the amount of summer monsoon rainfall: skill comparison with Markov chain model 7.1 Summary Forecasting summer monsoon rainfall with

More information

A complete classification of spatial relations using the Voronoi-based 9-intersection model

A complete classification of spatial relations using the Voronoi-based 9-intersection model A complete classification of spatial relations using the Voronoi-based 9-intersection model Zhiguo Long 1 and Sanjiang Li 1 1 QCIS, FEIT, University of Technology Sydney, Australia July 31, 2016 Abstract

More information

8.5. Applications of Electric and Magnetic Fields. RFID Chips

8.5. Applications of Electric and Magnetic Fields. RFID Chips Applications of Electric and Magnetic Fields If you have a pet dog or cat, you probably have tags on it that give information on how to contact you if the pet ever gets lost. Unfortunately, these tags

More information

Introduction. Spatial Multi-Agent Systems. The Need for a Theory

Introduction. Spatial Multi-Agent Systems. The Need for a Theory Introduction Spatial Multi-Agent Systems A spatial multi-agent system is a decentralized system composed of numerous identically programmed agents that either form or are embedded in a geometric space.

More information

Reinforcement Learning

Reinforcement Learning CS7/CS7 Fall 005 Supervised Learning: Training examples: (x,y) Direct feedback y for each input x Sequence of decisions with eventual feedback No teacher that critiques individual actions Learn to act

More information

STATE GENERALIZATION WITH SUPPORT VECTOR MACHINES IN REINFORCEMENT LEARNING. Ryo Goto, Toshihiro Matsui and Hiroshi Matsuo

STATE GENERALIZATION WITH SUPPORT VECTOR MACHINES IN REINFORCEMENT LEARNING. Ryo Goto, Toshihiro Matsui and Hiroshi Matsuo STATE GENERALIZATION WITH SUPPORT VECTOR MACHINES IN REINFORCEMENT LEARNING Ryo Goto, Toshihiro Matsui and Hiroshi Matsuo Department of Electrical and Computer Engineering, Nagoya Institute of Technology

More information

Detecting Wormhole Attacks in Wireless Networks Using Local Neighborhood Information

Detecting Wormhole Attacks in Wireless Networks Using Local Neighborhood Information Detecting Wormhole Attacks in Wireless Networks Using Local Neighborhood Information W. Znaidi M. Minier and JP. Babau Centre d'innovations en Télécommunication & Intégration de services wassim.znaidi@insa-lyon.fr

More information

UNIT 2 REASONING WITH LINEAR EQUATIONS AND INEQUALITIES Lesson 1: Creating Linear Equations and Inequalities in One Variable

UNIT 2 REASONING WITH LINEAR EQUATIONS AND INEQUALITIES Lesson 1: Creating Linear Equations and Inequalities in One Variable Guided Practice Example 1 James earns $15 per hour as a teller at a bank. In one week he pays 17% of his earnings in state and federal taxes. His take-home pay for the week is $460.65. How many hours did

More information

Dynamic Structural Equation Modeling of Intensive Longitudinal Data Using Multilevel Time Series Analysis in Mplus Version 8 Part 7

Dynamic Structural Equation Modeling of Intensive Longitudinal Data Using Multilevel Time Series Analysis in Mplus Version 8 Part 7 DSEM 1/ 46 Dynamic Structural Equation Modeling of Intensive Longitudinal Data Using Multilevel Time Series Analysis in Mplus Version 8 Part 7 Mårten Schultzberg Bengt Muthén, Tihomir Asparouhov & Ellen

More information

The Road to Improving your GIS Data. An ebook by Geo-Comm, Inc.

The Road to Improving your GIS Data. An ebook by Geo-Comm, Inc. The Road to Improving your GIS Data An ebook by Geo-Comm, Inc. An individual observes another person that appears to be in need of emergency assistance and makes the decision to place a call to 9-1-1.

More information

K.O.C Operational Laboratories Quality Control System. KHALID AL-OTAIBI Chief Chemist, Kuwait Oil Company

K.O.C Operational Laboratories Quality Control System. KHALID AL-OTAIBI Chief Chemist, Kuwait Oil Company K.O.C Operational Laboratories Quality Control System KHALID AL-OTAIBI Chief Chemist, Kuwait Oil Company Khalid Al-Otaibi: Biography Current position: Chief Chemist in Operational Laboratories Team K.O.C

More information

of places Key stage 1 Key stage 2 describe places

of places Key stage 1 Key stage 2 describe places Unit 25 Geography and numbers ABOUT THE UNIT This continuous unit aims to show how geographical enquiry can provide a meaningful context for the teaching and reinforcement of many aspects of the framework

More information

Phy211: General Physics I Lab page 1 of 5 PCC-Cascade

Phy211: General Physics I Lab page 1 of 5 PCC-Cascade Phy11: General Physics I Lab page 1 of 5 Experiment: The Ballistic Pendulum Objectives: Apply the Law of Conservation of Momentum to an inelastic collision Apply the Law of Conservation of Mechanical Energy

More information

Robust Adaptive Motion Planning in the Presence of Dynamic Obstacles

Robust Adaptive Motion Planning in the Presence of Dynamic Obstacles 2016 American Control Conference (ACC) Boston Marriott Copley Place July 6-8, 2016. Boston, MA, USA Robust Adaptive Motion Planning in the Presence of Dynamic Obstacles Nurali Virani and Minghui Zhu Abstract

More information

Name: Regents Physics Lab # 7. Measuring Height Indirectly

Name: Regents Physics Lab # 7. Measuring Height Indirectly Measuring Height Indirectly Purpose: In this activity you will use your mathematics skills to indirectly measure the height of several objects. You will also practice percent error calculations. Materials:

More information

ESD: The Discharge part of Electrostatic Discharge

ESD: The Discharge part of Electrostatic Discharge ESD: The Discharge part of Electrostatic Discharge Verification of your ESD Environment Dr. Frankenstein s ESD Specialist, Inc. 1 Your Company Has Spent Millions on ESD Protection Your ionizers are within

More information

Status of Managing Chemical Inventories Utilizing Radio Frequency Identification at Department of Energy Facilities

Status of Managing Chemical Inventories Utilizing Radio Frequency Identification at Department of Energy Facilities Status of Managing Chemical Inventories Utilizing Radio Frequency Identification at Department of Energy Facilities Introduction Several U.S. Department of Energy facilities have incorporated the use of

More information

G. I. Science Education: A Computing Perspective

G. I. Science Education: A Computing Perspective A Position Statement on G. I. Science Education: A Computing Perspective (A Panel Discussion in UCGIS Summer Assembly 2008) By Shashi Shekhar McKnight Distinguished University Professor Faculty of Computer

More information

Science of Slime. Fig. 1 Structure of poly (vinyl alcohol)

Science of Slime. Fig. 1 Structure of poly (vinyl alcohol) Name: Science of Slime Understanding the structure of a material and how it behaves is a large part of what chemists and materials scientists do for a living. Scientists and engineers cannot use new materials

More information

Cryptanalysis of the Bluetooth Stream Cipher

Cryptanalysis of the Bluetooth Stream Cipher 1 Cryptanalysis of the Bluetooth Stream Cipher Christophe De Cannière 1, Thomas Johansson 2, and Bart Preneel 1 1 Katholieke Universiteit Leuven, Dept. ESAT, Kasteelpark Arenberg 10, B 3001 Leuven-Heverlee,

More information

Toward Online Probabilistic Path Replanning

Toward Online Probabilistic Path Replanning Toward Online Probabilistic Path Replanning R. Philippsen 1 B. Jensen 2 R. Siegwart 3 1 LAAS-CNRS, France 2 Singleton Technology, Switzerland 3 ASL-EPFL, Switzerland Workshop on Autonomous Robot Motion,

More information

Lab 4 Motion in One-Dimension Part 2: Position, Velocity and Acceleration Graphically and Statistically (pre-requisite Lab3)

Lab 4 Motion in One-Dimension Part 2: Position, Velocity and Acceleration Graphically and Statistically (pre-requisite Lab3) Lab 4 Motion in One-Dimension Part 2: Position, Velocity and Acceleration Graphically and Statistically (pre-requisite Lab3) Objectives: To obtain an understanding of position, velocity, and acceleration

More information

What you learned. Lecture 27: Class Summary. Maps and geodesy. How you learned it

What you learned. Lecture 27: Class Summary. Maps and geodesy. How you learned it What you learned Geography 12: Maps and Spatial Reasoning Lecture 27: Class Summary Professor Keith Clarke Map geometry, construction and content Practical map use, reading and navigation Map representation

More information

Route Finding by Neural Nets

Route Finding by Neural Nets Route Finding by Neural Nets Guido Bugmann, John G. Taylor* and Michael J. Denham School of Computing, University of Plymouth, Plymouth PL4 8AA, United Kingdom Phone (0752) 23 25 66; FAX (0752) 23 25 40;

More information

1. (3 pts) In MDPs, the values of states are related by the Bellman equation: U(s) = R(s) + γ max P (s s, a)u(s )

1. (3 pts) In MDPs, the values of states are related by the Bellman equation: U(s) = R(s) + γ max P (s s, a)u(s ) 3 MDP (12 points) 1. (3 pts) In MDPs, the values of states are related by the Bellman equation: U(s) = R(s) + γ max P (s s, a)u(s ) a s where R(s) is the reward associated with being in state s. Suppose

More information

Multiobjective Optimization

Multiobjective Optimization Multiobjective Optimization MOO Applications Professores: Eduardo G. Carrano Frederico G. Guimarães Lucas S. Batista {egcarrano,fredericoguimaraes,lusoba}@ufmg.br www.ppgee.ufmg.br/ lusoba Universidade

More information

Intermittent Connectivity Control in Mobile Robot Networks

Intermittent Connectivity Control in Mobile Robot Networks Intermittent Connectivity Control in Mobile Robot Networks Yiannis Kantaros and Michael M. Zavlanos Abstract In this paper, we consider networks of mobile robots responsible for accomplishing tasks, captured

More information

Michael Harrigan Office hours: Fridays 2:00-4:00pm Holden Hall

Michael Harrigan Office hours: Fridays 2:00-4:00pm Holden Hall Announcement New Teaching Assistant Michael Harrigan Office hours: Fridays 2:00-4:00pm Holden Hall 209 Email: michael.harrigan@ttu.edu Guofeng Cao, Texas Tech GIST4302/5302, Lecture 2: Review of Map Projection

More information

Research and Development on European Cleaning Solutions for Radioactive Applications. Clean air solutions

Research and Development on European Cleaning Solutions for Radioactive Applications. Clean air solutions Research and Development on European Cleaning Solutions for Radioactive Applications Dipl. Ing. Axel Mahler, R&D Director Europe, Camfil AB, Sweden 19.03.2014 Your speaker: Axel Mahler, R&D Director Europe

More information