Ant Colony Optimization: an introduction. Daniel Chivilikhin
|
|
- Daisy Norman
- 5 years ago
- Views:
Transcription
1 Ant Colony Optimization: an introduction Daniel Chivilikhin
2 Outline 1. Biological inspiration of ACO 2. Solving NP-hard combinatorial problems 3. The ACO metaheuristic 4. ACO for the Traveling Salesman Problem 2
3 Outline 1. Biological inspiration of ACO 2. Solving NP-hard combinatorial problems 3. The ACO metaheuristic 4. ACO for the Traveling Salesman Problem 3
4 Biological inspiration: from real to artificial ants 4
5 Ant colonies Distributed systems of social insects Consist of simple individuals Colony intelligence >> Individual intelligence 5
6 Ant Cooperation Stigmergy indirect communication between individuals (ants) Driven by environment modifications 6
7 Denebourg s double bridge experiments Studied Argentine ants I. humilis Double bridge from ants to food source 7
8 Double bridge experiments: equal lengths (1) 8
9 Double bridge experiments: equal lengths (2) Run for a number of trials Ants choose each branch ~ same number of trials 9
10 Double bridge experiments: different lengths (2) 10
11 Double bridge experiments: different lengths (2) The majority of ants follow the short path 11
12 Outline 1. Biological inspiration of ACO 2. Solving NP-hard combinatorial problems 3. The ACO metaheuristic 4. ACO for the Traveling Salesman Problem 12
13 Solving NP-hard combinatorial problems 13
14 Combinatorial optimization Find values of discrete variables Optimizing a given objective function 14
15 Combinatorial optimization Π = (S, f, Ω) problem instance S set of candidate solutions f objective function Ω set of constraints ~ S S set of feasible solutions (with respect to Ω) Find globally optimal feasible solution s* 15
16 NP-hard combinatorial problems Cannot be exactly solved in polynomial time Approximate methods generate nearoptimal solutions in reasonable time No formal theoretical guarantees Approximate methods = heuristics 16
17 Approximate methods Constructive algorithms Local search 17
18 Constructive algorithms Add components to solution incrementally Example greedy heuristics: add solution component with best heuristic estimate 18
19 Local search Explore neighborhoods of complete solutions Improve current solution by local changes first improvement best improvement 19
20 What is a metaheuristic? A set of algorithmic concepts Can be used to define heuristic methods Applicable to a wide set of problems 20
21 Examples of metaheuristics Simulated annealing Tabu search Iterated local search Evolutionary computation Ant colony optimization Particle swarm optimization etc. 21
22 Outline 1. Biological inspiration of ACO 2. Solving NP-hard combinatorial problems 3. The ACO metaheuristic 4. ACO for the Traveling Salesman Problem 22
23 The ACO metaheuristic 23
24 ACO metaheuristic A colony of artificial ants cooperate in finding good solutions Each ant simple agent Ants communicate indirectly using stigmergy 24
25 Combinatorial optimization problem mapping (1) Combinatorial problem (S, f, Ω(t)) Ω(t) time-dependent constraints Example dynamic problems Goal find globally optimal feasible solution s* Minimization problem Mapped on another problem 25
26 Combinatorial optimization problem mapping (2) C = {c 1, c 2,, c Nc } finite set of components States of the problem: X = {x = <c i, c j,, c h, >, x < n < + } Set of candidate solutions: S X 26
27 Combinatorial optimization problem mapping (3) Set of feasible states: ~ X X ~ We can complete x X into a solution satisfying Ω(t) Non-empty set of optimal solutions: S * ~ X I S 27
28 Combinatorial optimization problem mapping (4) X states S candidate solutions feasible states X ~ S* optimal solutions S X S* X ~ 28
29 Combinatorial optimization problem mapping (5) Cost g(s, t) for each In most cases g(s, t) f(s, t) G C = (C, L) completely connected graph C set of components L edges fully connecting the components (connections) G C s S construction graph s ~ S 29
30 Combinatorial optimization problem mapping (last ) Artificial ants build solutions by performing randomized walks on G C (C, L) 30
31 Construction graph Each component c i or connection l ij have associated: heuristic information pheromone trail 31
32 Heuristic information A priori information about the problem Does not depend on the ants On components c i η i On connections l ij η ij Meaning: cost of adding a component to the current solution 32
33 Pheromone trail Long-term memory about the entire search process On components c i τ i On connections l ij τ ij Updated by the ants 33
34 Artificial ant (1) Stochastic constructive procedure Builds solutions by moving on G C Has finite memory for: Implementing constraints Ω(t) Evaluating solutions Memorizing its path 34
35 Artificial ant (2) Has a start state x Has termination conditions e k From state x r moves to a node from the neighborhood N k (x r ) Stops if some e k are satisfied 35
36 Artificial ant (3) Selects a move with a probabilistic rule depending on: Pheromone trails and heuristic information of neighbor components and connections Memory Constraints Ω 36
37 Artificial ant (4) Can update pheromone on visited components (nodes) and connections (edges) Ants act: Concurrently Independently 37
38 The ACO metaheuristic While not dostop(): ConstructAntSolutions() UpdatePheromones() DaemonActions() 38
39 ConstructAntSolutions A colony of ants build a set of solutions Solutions are evaluated using the objective function 39
40 UpdatePheromones Two opposite mechanisms: Pheromone deposit Pheromone evaporation 40
41 UpdatePheromones: pheromone deposit Ants increase pheromone values on visited components and/or connections Increases probability to select visited components later 41
42 UpdatePheromones: pheromone evaporation Decrease pheromone trails on all components/connections by a same value Forgetting avoid rapid convergence to suboptimal solutions 42
43 DaemonActions Optional centralized actions, e.g.: Local optimization Ant elitism (details later) 43
44 ACO applications Traveling salesman Quadratic assignment Graph coloring Multiple knapsack Set covering Maximum clique Bin packing 44
45 Outline 1. Biological inspiration of ACO 2. Solving NP-hard combinatorial problems 3. The ACO metaheuristic 4. ACO for the Traveling Salesman Problem 45
46 ACO for the Traveling Salesman Problem 46
47 Traveling salesman problem N set of nodes (cities), N = n A set of arcs, fully connecting N Weighted graph G = (N, A) Each arc has a weight d ij distance Problem: Find minimum length Hamiltonian circuit 47
48 TSP: construction graph Identical to the problem graph C = N L = A states = set of all possible partial tours 48
49 TSP: constraints All cities have to be visited Each city only once Enforcing allow ants only to go to new nodes 49
50 TSP: pheromone trails Desirability of visiting city j directly after i 50
51 TSP: heuristic information η ij = 1 / d ij Used in most ACO for TSP 51
52 TSP: solution construction Select random start city Add unvisited cities iteratively Until a complete tour is built 52
53 ACO algorithms for TSP Ant System Elitist Ant System Rank-based Ant System Ant Colony System MAX-MIN Ant System 53
54 Ant System: Pheromone initialization Pheromone initialization where: m number of ants Τ ij = m / C nn, C nn path length of nearest-neighbor algorithm 54
55 Ant System: Tour construction Ant k is located in city i N k i is the neighborhood of city i k Probability to go to city : j N i p k ij = l τ k N i α ij τ α il η β ij η β il 55
56 Tour construction: comprehension k pij α = 0 greedy algorithm β = 0 only pheromone is at work l η η quickly leads to stagnation = τ k N i α ij τ α il β ij β il 56
57 Ant System: update pheromone trails evaporation Evaporation for all connections (i, j) L: τ ij (1 ρ) τ ij, ρ [0, 1] evaporation rate Prevents convergence to suboptimal solutions 57
58 Ant System: update pheromone trails deposit T k path of ant k C k length of path T k Ants deposit pheromone on visited arcs: τ ij τ ij + m k = 1 τ k ij, ( i, j) L k τ ij = 1/ 0, C k, ( i, j) otherwise T k 58
59 Elitist Ant System Best-so-far ant deposits pheromone on each iteration: τ ij τ ij + m k =1 τ k ij + e τ best ij τ best ij = 1/ 0, C best, ( i, j) otherwise T best 59
60 Rank-based Ant System Rank all ants Each ant deposits amounts of pheromone proportional to its rank 60
61 MAX-MIN Ant System 1. Only iteration-best or best-so-far ant deposits pheromone 2. Pheromone trails are limited to the interval [τ min, τ max ] 61
62 Ant Colony System Differs from Ant System in three points: More aggressive tour construction rule Only best ant evaporates and deposits pheromone Local pheromone update 62
63 Ant Colony System 1.Tour Construction j = { β } τ η arg max, if q q k l N il il 0 i like Ant System, otherwise 2. Local pheromone update: τ ij (1 ξ)τ ij + ξτ 0, 63
64 Comparing Ant System variants 64
65 State of the art in TSP CONCORDE Solved an instance of cities Computation took CPU days! 65
66 Current ACO research activity New applications Theoretical proofs 66
67 Further reading M. Dorigo, T. Stützle. Ant Colony Optimization. MIT Press,
68 Next time Some proofs of ACO convergence 68
69 Thank you! Any questions? This presentation is available at: Daniel Chivilikhin [mailto: 69
70 Used resources x1024.jpg _Days/Ant_Hormiga.gif GcT_oo/s1600/ant+vision.GIF txkjq4nsqoy/uqz3vabiy_i/aaaaaaaaaja/ik8jtlhelqk/s1600/ illustrationof-an-ant-on-a-white-background.jpg 70
Outline. Ant Colony Optimization. Outline. Swarm Intelligence DM812 METAHEURISTICS. 1. Ant Colony Optimization Context Inspiration from Nature
DM812 METAHEURISTICS Outline Lecture 8 http://www.aco-metaheuristic.org/ 1. 2. 3. Marco Chiarandini Department of Mathematics and Computer Science University of Southern Denmark, Odense, Denmark
More informationSwarm Intelligence Traveling Salesman Problem and Ant System
Swarm Intelligence Leslie Pérez áceres leslie.perez.caceres@ulb.ac.be Hayfa Hammami haifa.hammami@ulb.ac.be IRIIA Université Libre de ruxelles (UL) ruxelles, elgium Outline 1.oncept review 2.Travelling
More informationMetaheuristics and Local Search
Metaheuristics and Local Search 8000 Discrete optimization problems Variables x 1,..., x n. Variable domains D 1,..., D n, with D j Z. Constraints C 1,..., C m, with C i D 1 D n. Objective function f :
More informationMetaheuristics and Local Search. Discrete optimization problems. Solution approaches
Discrete Mathematics for Bioinformatics WS 07/08, G. W. Klau, 31. Januar 2008, 11:55 1 Metaheuristics and Local Search Discrete optimization problems Variables x 1,...,x n. Variable domains D 1,...,D n,
More informationSensitive Ant Model for Combinatorial Optimization
Sensitive Ant Model for Combinatorial Optimization CAMELIA CHIRA cchira@cs.ubbcluj.ro D. DUMITRESCU ddumitr@cs.ubbcluj.ro CAMELIA-MIHAELA PINTEA cmpintea@cs.ubbcluj.ro Abstract: A combinatorial optimization
More informationImplementation of Travelling Salesman Problem Using ant Colony Optimization
RESEARCH ARTICLE OPEN ACCESS Implementation of Travelling Salesman Problem Using ant Colony Optimization Gaurav Singh, Rashi Mehta, Sonigoswami, Sapna Katiyar* ABES Institute of Technology, NH-24, Vay
More informationCapacitor Placement for Economical Electrical Systems using Ant Colony Search Algorithm
Capacitor Placement for Economical Electrical Systems using Ant Colony Search Algorithm Bharat Solanki Abstract The optimal capacitor placement problem involves determination of the location, number, type
More information3D HP Protein Folding Problem using Ant Algorithm
3D HP Protein Folding Problem using Ant Algorithm Fidanova S. Institute of Parallel Processing BAS 25A Acad. G. Bonchev Str., 1113 Sofia, Bulgaria Phone: +359 2 979 66 42 E-mail: stefka@parallel.bas.bg
More informationARTIFICIAL INTELLIGENCE
BABEŞ-BOLYAI UNIVERSITY Faculty of Computer Science and Mathematics ARTIFICIAL INTELLIGENCE Solving search problems Informed local search strategies Nature-inspired algorithms March, 2017 2 Topics A. Short
More informationNatural Computing. Lecture 11. Michael Herrmann phone: Informatics Forum /10/2011 ACO II
Natural Computing Lecture 11 Michael Herrmann mherrman@inf.ed.ac.uk phone: 0131 6 517177 Informatics Forum 1.42 25/10/2011 ACO II ACO (in brief) ACO Represent solution space Set parameters, initialize
More informationSelf-Adaptive Ant Colony System for the Traveling Salesman Problem
Proceedings of the 29 IEEE International Conference on Systems, Man, and Cybernetics San Antonio, TX, USA - October 29 Self-Adaptive Ant Colony System for the Traveling Salesman Problem Wei-jie Yu, Xiao-min
More informationIntuitionistic Fuzzy Estimation of the Ant Methodology
BULGARIAN ACADEMY OF SCIENCES CYBERNETICS AND INFORMATION TECHNOLOGIES Volume 9, No 2 Sofia 2009 Intuitionistic Fuzzy Estimation of the Ant Methodology S Fidanova, P Marinov Institute of Parallel Processing,
More informationAnt Algorithms. Ant Algorithms. Ant Algorithms. Ant Algorithms. G5BAIM Artificial Intelligence Methods. Finally. Ant Algorithms.
G5BAIM Genetic Algorithms G5BAIM Artificial Intelligence Methods Dr. Rong Qu Finally.. So that s why we ve been getting pictures of ants all this time!!!! Guy Theraulaz Ants are practically blind but they
More informationSolving the Homogeneous Probabilistic Traveling Salesman Problem by the ACO Metaheuristic
Solving the Homogeneous Probabilistic Traveling Salesman Problem by the ACO Metaheuristic Leonora Bianchi 1, Luca Maria Gambardella 1 and Marco Dorigo 2 1 IDSIA, Strada Cantonale Galleria 2, CH-6928 Manno,
More informationTraffic Signal Control with Swarm Intelligence
009 Fifth International Conference on Natural Computation Traffic Signal Control with Swarm Intelligence David Renfrew, Xiao-Hua Yu Department of Electrical Engineering, California Polytechnic State University
More informationPart B" Ants (Natural and Artificial)! Langton s Vants" (Virtual Ants)! Vants! Example! Time Reversibility!
Part B" Ants (Natural and Artificial)! Langton s Vants" (Virtual Ants)! 11/14/08! 1! 11/14/08! 2! Vants!! Square grid!! Squares can be black or white!! Vants can face N, S, E, W!! Behavioral rule:!! take
More informationSwarm intelligence: Ant Colony Optimisation
Swarm intelligence: Ant Colony Optimisation S Luz luzs@cs.tcd.ie October 7, 2014 Simulating problem solving? Can simulation be used to improve distributed (agent-based) problem solving algorithms? Yes:
More informationA Note on the Parameter of Evaporation in the Ant Colony Optimization Algorithm
International Mathematical Forum, Vol. 6, 2011, no. 34, 1655-1659 A Note on the Parameter of Evaporation in the Ant Colony Optimization Algorithm Prasanna Kumar Department of Mathematics Birla Institute
More informationResearch Article Ant Colony Search Algorithm for Optimal Generators Startup during Power System Restoration
Mathematical Problems in Engineering Volume 2010, Article ID 906935, 11 pages doi:10.1155/2010/906935 Research Article Ant Colony Search Algorithm for Optimal Generators Startup during Power System Restoration
More informationMining Spatial Trends by a Colony of Cooperative Ant Agents
Mining Spatial Trends by a Colony of Cooperative Ant Agents Ashan Zarnani Masoud Rahgozar Abstract Large amounts of spatially referenced data has been aggregated in various application domains such as
More informationLin-Kernighan Heuristic. Simulated Annealing
DM63 HEURISTICS FOR COMBINATORIAL OPTIMIZATION Lecture 6 Lin-Kernighan Heuristic. Simulated Annealing Marco Chiarandini Outline 1. Competition 2. Variable Depth Search 3. Simulated Annealing DM63 Heuristics
More informationAlgorithm Design Strategies V
Algorithm Design Strategies V Joaquim Madeira Version 0.0 October 2016 U. Aveiro, October 2016 1 Overview The 0-1 Knapsack Problem Revisited The Fractional Knapsack Problem Greedy Algorithms Example Coin
More informationA reactive framework for Ant Colony Optimization
A reactive framework for Ant Colony Optimization Madjid Khichane 1,2, Patrick Albert 1, and Christine Solnon 2 1 ILOG SA, 9 rue de Verdun, 94253 Gentilly cedex, France {mkhichane,palbert}@ilog.fr 2 LIRIS
More informationComputational Intelligence Methods
Computational Intelligence Methods Ant Colony Optimization, Partical Swarm Optimization Pavel Kordík, Martin Šlapák Katedra teoretické informatiky FIT České vysoké učení technické v Praze MI-MVI, ZS 2011/12,
More informationMining Spatial Trends by a Colony of Cooperative Ant Agents
Mining Spatial Trends by a Colony of Cooperative Ant Agents Ashan Zarnani Masoud Rahgozar Abstract Large amounts of spatially referenced data have been aggregated in various application domains such as
More informationAlgorithms and Complexity theory
Algorithms and Complexity theory Thibaut Barthelemy Some slides kindly provided by Fabien Tricoire University of Vienna WS 2014 Outline 1 Algorithms Overview How to write an algorithm 2 Complexity theory
More informationUpdating ACO Pheromones Using Stochastic Gradient Ascent and Cross-Entropy Methods
Updating ACO Pheromones Using Stochastic Gradient Ascent and Cross-Entropy Methods Marco Dorigo 1, Mark Zlochin 2,, Nicolas Meuleau 3, and Mauro Birattari 4 1 IRIDIA, Université Libre de Bruxelles, Brussels,
More informationAnt Colony Optimization for Multi-objective Optimization Problems
Ant Colony Optimization for Multi-objective Optimization Problems Inès Alaya 1,2, Christine Solnon 1, and Khaled Ghédira 2 1 LIRIS, UMR 5205 CNRS / University of Lyon 2 SOIE ICTAI 2007 Multi-objective
More informationMotivation, Basic Concepts, Basic Methods, Travelling Salesperson Problem (TSP), Algorithms
Motivation, Basic Concepts, Basic Methods, Travelling Salesperson Problem (TSP), Algorithms 1 What is Combinatorial Optimization? Combinatorial Optimization deals with problems where we have to search
More informationAn ant colony algorithm applied to lay-up optimization of laminated composite plates
10(2013) 491 504 An ant colony algorithm applied to lay-up optimization of laminated composite plates Abstract Ant colony optimization (ACO) is a class of heuristic algorithms proposed to solve optimization
More informationOverview. Optimization. Easy optimization problems. Monte Carlo for Optimization. 1. Survey MC ideas for optimization: (a) Multistart
Monte Carlo for Optimization Overview 1 Survey MC ideas for optimization: (a) Multistart Art Owen, Lingyu Chen, Jorge Picazo (b) Stochastic approximation (c) Simulated annealing Stanford University Intel
More informationAN ANT APPROACH FOR STRUCTURED QUADRATIC ASSIGNMENT PROBLEMS
AN ANT APPROACH FOR STRUCTURED QUADRATIC ASSIGNMENT PROBLEMS Éric D. Taillard, Luca M. Gambardella IDSIA, Corso Elvezia 36, CH-6900 Lugano, Switzerland. Extended abstract IDSIA-22-97 ABSTRACT. The paper
More informationA Short Convergence Proof for a Class of Ant Colony Optimization Algorithms
358 IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, VOL. 6, NO. 4, AUGUST 2002 A Short Convergence Proof for a Class of Ant Colony Optimization Algorithms Thomas Stützle and Marco Dorigo, Senior Member,
More information3.4 Relaxations and bounds
3.4 Relaxations and bounds Consider a generic Discrete Optimization problem z = min{c(x) : x X} with an optimal solution x X. In general, the algorithms generate not only a decreasing sequence of upper
More informationArtificial Intelligence Heuristic Search Methods
Artificial Intelligence Heuristic Search Methods Chung-Ang University, Jaesung Lee The original version of this content is created by School of Mathematics, University of Birmingham professor Sandor Zoltan
More informationTravelling Salesman Problem
Travelling Salesman Problem Fabio Furini November 10th, 2014 Travelling Salesman Problem 1 Outline 1 Traveling Salesman Problem Separation Travelling Salesman Problem 2 (Asymmetric) Traveling Salesman
More informationA Framework for Integrating Exact and Heuristic Optimization Methods
A Framework for Integrating Eact and Heuristic Optimization Methods John Hooker Carnegie Mellon University Matheuristics 2012 Eact and Heuristic Methods Generally regarded as very different. Eact methods
More informationPROBLEM SOLVING AND SEARCH IN ARTIFICIAL INTELLIGENCE
Artificial Intelligence, Computational Logic PROBLEM SOLVING AND SEARCH IN ARTIFICIAL INTELLIGENCE Lecture 4 Metaheuristic Algorithms Sarah Gaggl Dresden, 5th May 2017 Agenda 1 Introduction 2 Constraint
More informationData Structures in Java
Data Structures in Java Lecture 21: Introduction to NP-Completeness 12/9/2015 Daniel Bauer Algorithms and Problem Solving Purpose of algorithms: find solutions to problems. Data Structures provide ways
More informationImproving convergence of combinatorial optimization meta-heuristic algorithms
Sapienza Università di Roma A.A. 2012-2013 Facoltà di Scienze Matematiche Fisiche e Naturali Dipartimento di Matematica Guido Castelnuovo PhD in Mathematics Improving convergence of combinatorial optimization
More informationAnt Colony Optimization for Resource-Constrained Project Scheduling
Ant Colony Optimization for Resource-Constrained Project Scheduling Daniel Merkle, Martin Middendorf 2, Hartmut Schmeck 3 Institute for Applied Computer Science and Formal Description Methods University
More information1 Heuristics for the Traveling Salesman Problem
Praktikum Algorithmen-Entwurf (Teil 9) 09.12.2013 1 1 Heuristics for the Traveling Salesman Problem We consider the following problem. We want to visit all the nodes of a graph as fast as possible, visiting
More informationNew approaches to evaporation in ant colony optimization algorithms
New approaches to evaporation in ant colony optimization algorithms E. Foundas A. Vlachos Department of Informatics University of Piraeus Piraeus 85 34 Greece Abstract In Ant Colony Algorithms (ACA), artificial
More informationSolving the Post Enrolment Course Timetabling Problem by Ant Colony Optimization
Solving the Post Enrolment Course Timetabling Problem by Ant Colony Optimization Alfred Mayer 1, Clemens Nothegger 2, Andreas Chwatal 1, and Günther R. Raidl 1 1 Institute of Computer Graphics and Algorithms
More informationLecture H2. Heuristic Methods: Iterated Local Search, Simulated Annealing and Tabu Search. Saeed Bastani
Simulation Lecture H2 Heuristic Methods: Iterated Local Search, Simulated Annealing and Tabu Search Saeed Bastani saeed.bastani@eit.lth.se Spring 2017 Thanks to Prof. Arne Løkketangen at Molde University
More informationDeterministic Nonlinear Modeling of Ant Algorithm with Logistic Multi-Agent System
Deterministic Nonlinear Modeling of Ant Algorithm with Logistic Multi-Agent System Rodolphe Charrier, Christine Bourjot, François Charpillet To cite this version: Rodolphe Charrier, Christine Bourjot,
More information15.083J/6.859J Integer Optimization. Lecture 2: Efficient Algorithms and Computational Complexity
15.083J/6.859J Integer Optimization Lecture 2: Efficient Algorithms and Computational Complexity 1 Outline Efficient algorithms Slide 1 Complexity The classes P and N P The classes N P-complete and N P-hard
More informationLocal Search & Optimization
Local Search & Optimization CE417: Introduction to Artificial Intelligence Sharif University of Technology Spring 2018 Soleymani Artificial Intelligence: A Modern Approach, 3 rd Edition, Chapter 4 Some
More informationANT colony optimization (ACO) [2] is a metaheuristic inspired
732 IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, VOL. 11, NO. 6, DECEMBER 2007 On the Invariance of Ant Colony Optimization Mauro Birattari, Member, IEEE, Paola Pellegrini, and Marco Dorigo, Fellow,
More informationThe Travelling Salesman Problem with Time Windows: Adapting Algorithms from Travel-time to Makespan Optimization
Université Libre de Bruxelles Institut de Recherches Interdisciplinaires et de Développements en Intelligence Artificielle The Travelling Salesman Problem with Time Windows: Adapting Algorithms from Travel-time
More informationHamiltonian(t) - An Ant-Inspired Heuristic for Recognizing Hamiltonian Graphs
to appear in CEC 99 Hamiltonian(t) - An Ant-Inspired Heuristic for Recognizing Hamiltonian Graphs Israel A Wagner and Alfred M Bruckstein 3 IBM Haifa Research Lab, Matam, Haifa 395, Israel Department of
More informationAnt Colony Optimization. Prepared by: Ahmad Elshamli, Daniel Asmar, Fadi Elmasri
Ant Colony Optimization Prepared by: Ahmad Elshamli, Daniel Asmar, Fadi Elmasri Section I (Introduction) Historical Background Ant System Modified algorithms Section II (Applications) TSP QAP Presentation
More information5. Simulated Annealing 5.1 Basic Concepts. Fall 2010 Instructor: Dr. Masoud Yaghini
5. Simulated Annealing 5.1 Basic Concepts Fall 2010 Instructor: Dr. Masoud Yaghini Outline Introduction Real Annealing and Simulated Annealing Metropolis Algorithm Template of SA A Simple Example References
More informationMauro Birattari, Prasanna Balaprakash, and Marco Dorigo
Chapter 10 THE ACO/F-RACE ALGORITHM FOR COMBINATORIAL OPTIMIZATION UNDER UNCERTAINTY Mauro Birattari, Prasanna Balaprakash, and Marco Dorigo IRIDIA, CoDE, Université Libre de Bruxelles, Brussels, Belgium
More informationConvergence of Ant Colony Optimization on First-Order Deceptive Systems
Convergence of Ant Colony Optimization on First-Order Deceptive Systems Yixin Chen Washington University in St. Louis Department of Computer Science & Engineering St. Louis, MO 6330, USA chen@cse.wustl.edu
More informationRigorous Analyses for the Combination of Ant Colony Optimization and Local Search
Rigorous Analyses for the Combination of Ant Colony Optimization and Local Search Frank Neumann 1, Dirk Sudholt 2, and Carsten Witt 2 1 Max-Planck-Institut für Informatik, 66123 Saarbrücken, Germany, fne@mpi-inf.mpg.de
More informationCombinatorial optimization problems
Combinatorial optimization problems Heuristic Algorithms Giovanni Righini University of Milan Department of Computer Science (Crema) Optimization In general an optimization problem can be formulated as:
More informationUnit 1A: Computational Complexity
Unit 1A: Computational Complexity Course contents: Computational complexity NP-completeness Algorithmic Paradigms Readings Chapters 3, 4, and 5 Unit 1A 1 O: Upper Bounding Function Def: f(n)= O(g(n)) if
More informationLocal Search & Optimization
Local Search & Optimization CE417: Introduction to Artificial Intelligence Sharif University of Technology Spring 2017 Soleymani Artificial Intelligence: A Modern Approach, 3 rd Edition, Chapter 4 Outline
More informationOptimisation and Operations Research
Optimisation and Operations Research Lecture 15: The Greedy Heuristic Matthew Roughan http://www.maths.adelaide.edu.au/matthew.roughan/ Lecture_notes/OORII/ School of
More informationIntro to Contemporary Math
Intro to Contemporary Math Hamiltonian Circuits and Nearest Neighbor Algorithm Nicholas Nguyen nicholas.nguyen@uky.edu Department of Mathematics UK Agenda Hamiltonian Circuits and the Traveling Salesman
More informationarxiv: v2 [cs.ds] 11 Oct 2017
Stochastic Runtime Analysis of a Cross-Entropy Algorithm for Traveling Salesman Problems Zijun Wu a,1,, Rolf H. Möhring b,2,, Jianhui Lai c, arxiv:1612.06962v2 [cs.ds] 11 Oct 2017 a Beijing Institute for
More informationJournal of Aerospace Technology and Management ISSN: Instituto de Aeronáutica e Espaço Brasil
Journal of Aerospace Technology and Management ISSN: 1948-9648 secretary@jatm.com.br Instituto de Aeronáutica e Espaço Brasil Koide, Rubem Matimoto; Luersen, Marco Antonio Maximization of Fundamental Frequency
More informationAn ACO Algorithm for the Most Probable Explanation Problem
An ACO Algorithm for the Most Probable Explanation Problem Haipeng Guo 1, Prashanth R. Boddhireddy 2, and William H. Hsu 3 1 Department of Computer Science, Hong Kong University of Science and Technology
More informationTabu Search. Biological inspiration is memory the ability to use past experiences to improve current decision making.
Tabu Search Developed by Fred Glover in the 1970 s. Dr Glover is a business professor at University of Colorado at Boulder. Developed specifically as a combinatorial optimization tool. Biological inspiration
More informationCS/COE
CS/COE 1501 www.cs.pitt.edu/~nlf4/cs1501/ P vs NP But first, something completely different... Some computational problems are unsolvable No algorithm can be written that will always produce the correct
More informationChapter 17: Ant Algorithms
Computational Intelligence: Second Edition Contents Some Facts Ants appeared on earth some 100 million years ago The total ant population is estimated at 10 16 individuals [10] The total weight of ants
More informationFinding optimal configurations ( combinatorial optimization)
CS 1571 Introduction to AI Lecture 10 Finding optimal configurations ( combinatorial optimization) Milos Hauskrecht milos@cs.pitt.edu 539 Sennott Square Constraint satisfaction problem (CSP) Constraint
More informationSingle Solution-based Metaheuristics
Parallel Cooperative Optimization Research Group Single Solution-based Metaheuristics E-G. Talbi Laboratoire d Informatique Fondamentale de Lille Single solution-based metaheuristics Improvement of a solution.
More informationMULTI-PERIOD MULTI-DIMENSIONAL KNAPSACK PROBLEM AND ITS APPLICATION TO AVAILABLE-TO-PROMISE
MULTI-PERIOD MULTI-DIMENSIONAL KNAPSACK PROBLEM AND ITS APPLICATION TO AVAILABLE-TO-PROMISE Hoong Chuin LAU and Min Kwang LIM School of Computing National University of Singapore, 3 Science Drive 2, Singapore
More informationPolynomial-time Reductions
Polynomial-time Reductions Disclaimer: Many denitions in these slides should be taken as the intuitive meaning, as the precise meaning of some of the terms are hard to pin down without introducing the
More informationAn ant colony algorithm for multiple sequence alignment in bioinformatics
An ant colony algorithm for multiple sequence alignment in bioinformatics Jonathan Moss and Colin G. Johnson Computing Laboratory University of Kent at Canterbury Canterbury, Kent, CT2 7NF, England. C.G.Johnson@ukc.ac.uk
More informationMeta heuristic algorithms for parallel identical machines scheduling problem with weighted late work criterion and common due date
DOI 10.1186/s40064-015-1559-5 RESEARCH Open Access Meta heuristic algorithms for parallel identical machines scheduling problem with weighted late work criterion and common due date Zhenzhen Xu, Yongxing
More informationAnt Colony Optimization
Ant Colony Optimization a bio-inspired metaheuristic Gianni A. Di Caro gianni@idsia.ch cartello esterno 1:10 80 x 106 cm 1 pezzo Materiale e stampa: forex (plastico) 6 mm a 3 colori (blu, cyan, grigio)
More information6.231 DYNAMIC PROGRAMMING LECTURE 9 LECTURE OUTLINE
6.231 DYNAMIC PROGRAMMING LECTURE 9 LECTURE OUTLINE Rollout algorithms Policy improvement property Discrete deterministic problems Approximations of rollout algorithms Model Predictive Control (MPC) Discretization
More informationACO Comprehensive Exam October 14 and 15, 2013
1. Computability, Complexity and Algorithms (a) Let G be the complete graph on n vertices, and let c : V (G) V (G) [0, ) be a symmetric cost function. Consider the following closest point heuristic for
More informationData Structures and Algorithms (CSCI 340)
University of Wisconsin Parkside Fall Semester 2008 Department of Computer Science Prof. Dr. F. Seutter Data Structures and Algorithms (CSCI 340) Homework Assignments The numbering of the problems refers
More informationFemtosecond Quantum Control for Quantum Computing and Quantum Networks. Caroline Gollub
Femtosecond Quantum Control for Quantum Computing and Quantum Networks Caroline Gollub Outline Quantum Control Quantum Computing with Vibrational Qubits Concept & IR gates Raman Quantum Computing Control
More informationArtificial Intelligence Methods (G5BAIM) - Examination
Question 1 a) According to John Koza there are five stages when planning to solve a problem using a genetic program. What are they? Give a short description of each. (b) How could you cope with division
More informationComputational statistics
Computational statistics Combinatorial optimization Thierry Denœux February 2017 Thierry Denœux Computational statistics February 2017 1 / 37 Combinatorial optimization Assume we seek the maximum of f
More informationA MULTIDIRECTIONAL MODIFIED PHYSARUM SOLVER FOR DISCRETE DECISION MAKING
A MULTIDIRECTIONAL MODIFIED PHYSARUM SOLVER FOR DISCRETE DECISION MAKING Luca Masi, Massimiliano Vasile Department of Mechanical & Aerospace Engineering, University of Strathclyde, 75 Montrose Street G1
More informationMethods for finding optimal configurations
CS 1571 Introduction to AI Lecture 9 Methods for finding optimal configurations Milos Hauskrecht milos@cs.pitt.edu 5329 Sennott Square Search for the optimal configuration Optimal configuration search:
More informationComputational Intelligence in Product-line Optimization
Computational Intelligence in Product-line Optimization Simulations and Applications Peter Kurz peter.kurz@tns-global.com June 2017 Restricted use Restricted use Computational Intelligence in Product-line
More informationAlgorithms. NP -Complete Problems. Dong Kyue Kim Hanyang University
Algorithms NP -Complete Problems Dong Kyue Kim Hanyang University dqkim@hanyang.ac.kr The Class P Definition 13.2 Polynomially bounded An algorithm is said to be polynomially bounded if its worst-case
More information2 Notation and Preliminaries
On Asymmetric TSP: Transformation to Symmetric TSP and Performance Bound Ratnesh Kumar Haomin Li epartment of Electrical Engineering University of Kentucky Lexington, KY 40506-0046 Abstract We show that
More informationA new restart procedure for combinatorial optimization and its convergence
A new restart procedure for combinatorial optimization and its convergence Davide Palmigiani and Giovanni Sebastiani arxiv:79.6449v [math.oc] 8 Sep 27 Abstract We propose a new iterative procedure to optimize
More information5. Simulated Annealing 5.2 Advanced Concepts. Fall 2010 Instructor: Dr. Masoud Yaghini
5. Simulated Annealing 5.2 Advanced Concepts Fall 2010 Instructor: Dr. Masoud Yaghini Outline Acceptance Function Initial Temperature Equilibrium State Cooling Schedule Stopping Condition Handling Constraints
More informationThe P versus NP Problem. Ker-I Ko. Stony Brook, New York
The P versus NP Problem Ker-I Ko Stony Brook, New York ? P = NP One of the seven Millenium Problems The youngest one A folklore question? Has hundreds of equivalent forms Informal Definitions P : Computational
More informationA Survey on Travelling Salesman Problem
A Survey on Travelling Salesman Problem Sanchit Goyal Department of Computer Science University of North Dakota Grand Forks, North Dakota 58203 sanchitgoyal01@gmail.com Abstract The Travelling Salesman
More informationMeta-heuristic ant colony optimization technique to forecast the amount of summer monsoon rainfall: skill comparison with Markov chain model
Chapter -7 Meta-heuristic ant colony optimization technique to forecast the amount of summer monsoon rainfall: skill comparison with Markov chain model 7.1 Summary Forecasting summer monsoon rainfall with
More informationLocal Search (Greedy Descent): Maintain an assignment of a value to each variable. Repeat:
Local Search Local Search (Greedy Descent): Maintain an assignment of a value to each variable. Repeat: I I Select a variable to change Select a new value for that variable Until a satisfying assignment
More informationConvergence Control in ACO
Convergence Control in ACO Bernd Meyer bernd.meyer@acm.org Dept. of Computer Science, Monash University, Australia Abstract. Ant Colony Optimization (ACO) is a recent stochastic metaheuristic inspired
More informationLimits to Approximability: When Algorithms Won't Help You. Note: Contents of today s lecture won t be on the exam
Limits to Approximability: When Algorithms Won't Help You Note: Contents of today s lecture won t be on the exam Outline Limits to Approximability: basic results Detour: Provers, verifiers, and NP Graph
More informationChapter 3: Discrete Optimization Integer Programming
Chapter 3: Discrete Optimization Integer Programming Edoardo Amaldi DEIB Politecnico di Milano edoardo.amaldi@polimi.it Website: http://home.deib.polimi.it/amaldi/opt-16-17.shtml Academic year 2016-17
More informationCombinatorial Optimization
Combinatorial Optimization Problem set 8: solutions 1. Fix constants a R and b > 1. For n N, let f(n) = n a and g(n) = b n. Prove that f(n) = o ( g(n) ). Solution. First we observe that g(n) 0 for all
More informationIntroduction to Integer Programming
Lecture 3/3/2006 p. /27 Introduction to Integer Programming Leo Liberti LIX, École Polytechnique liberti@lix.polytechnique.fr Lecture 3/3/2006 p. 2/27 Contents IP formulations and examples Total unimodularity
More informationSAT, Coloring, Hamiltonian Cycle, TSP
1 SAT, Coloring, Hamiltonian Cycle, TSP Slides by Carl Kingsford Apr. 28, 2014 Sects. 8.2, 8.7, 8.5 2 Boolean Formulas Boolean Formulas: Variables: x 1, x 2, x 3 (can be either true or false) Terms: t
More informationWho Has Heard of This Problem? Courtesy: Jeremy Kun
P vs. NP 02-201 Who Has Heard of This Problem? Courtesy: Jeremy Kun Runtime Analysis Last time, we saw that there is no solution to the Halting Problem. Halting Problem: Determine if a program will halt.
More informationInspection Route Optimization
Inspection Route Optimization Bernard Gendron Thibaut Vidal + August 11, 2017 CRM Industrial Problem Solving Workshop, Montréal, Canada CIRRELT and Département d informatique et de recherche opérationnelle,
More informationStatistical Machine Translation. Part III: Search Problem. Complexity issues. DP beam-search: with single and multi-stacks
Statistical Machine Translation Marcello Federico FBK-irst Trento, Italy Galileo Galilei PhD School - University of Pisa Pisa, 7-19 May 008 Part III: Search Problem 1 Complexity issues A search: with single
More information