Artificial Intelligence Heuristic Search Methods
|
|
- Ashley Mason
- 5 years ago
- Views:
Transcription
1 Artificial Intelligence Heuristic Search Methods Chung-Ang University, Jaesung Lee The original version of this content is created by School of Mathematics, University of Birmingham professor Sandor Zoltan Nemeth. URL:
2 Hill-Climbing Search Why we use Heuristic? Circumvent combinatorial explosion Good approximations are usually sufficient The worst cases occur very infrequently More understanding the problem Artificial Intelligence / Chung-Ang University / Professor Jaesung Lee 2
3 Neighborhoods TSP is an optimization problem. Solutions which are close to a given solution Two or more solutions with similar representation Artificial Intelligence / Chung-Ang University / Professor Jaesung Lee 3
4 Neighborhoods, = 0 That is the distance of a point from itself is zero., =, This property is called symmetry. Our TSP problem is symmetric TSP.,, +, This property is called triangular inequality. Our TSP problem does not hold this. Artificial Intelligence / Chung-Ang University / Professor Jaesung Lee 4
5 Neighborhoods, = 0, =,,, +, = {, < } Artificial Intelligence / Chung-Ang University / Professor Jaesung Lee 5
6 Algorithm 2-opt for TSP Artificial Intelligence / Chung-Ang University / Professor Jaesung Lee 6
7 Neighborhood as a Mapping 2-swap mapping 2-interchange mapping Artificial Intelligence / Chung-Ang University / Professor Jaesung Lee 7
8 Local Optima Local optimum w.r.t. ( ) if, Artificial Intelligence / Chung-Ang University / Professor Jaesung Lee 8
9 Hill-climbing analogy Height: the quality of a node or solution based on evaluation function Peaks: (possibly local) optimal solutions Orientation: evaluating neighboring positions Hill-climbing: the problem of orientation and moving on a surface Artificial Intelligence / Chung-Ang University / Professor Jaesung Lee 9
10 Basic Hill-climbing algorithm Evaluate the initial point. If the objective is met, return. Otherwise set as the current point. Loop until a solution is found: Generate all the neighbors of. Select the best one (or randomly one of the best ones). If x is at least as good as, then return, else set as the current point. Artificial Intelligence / Chung-Ang University / Professor Jaesung Lee 10
11 Properties of hill-climbing Stuck in local minimum Plateaus No information about global optimum Affected by initial solution Artificial Intelligence / Chung-Ang University / Professor Jaesung Lee 11
12 Simulated Annealing Artificial Intelligence / Chung-Ang University / Professor Jaesung Lee 12
13 Motivation 1980 s Kirkpatrick, Gelatt, and Vecchi and independently Cerny Artificial Intelligence / Chung-Ang University / Professor Jaesung Lee 13
14 Analogy with physical annealing Physical system State Energy Ground state Temperature Careful annealing Optimization problem Feasible solution Evaluation function value Optimal solution Control parameter Simulated annealing Artificial Intelligence / Chung-Ang University / Professor Jaesung Lee 14
15 Hill-Climbing and Simulated Annealing Iterative Hill-Climbing 1. Choose a starting solution _ and initialize 2. := 0; := _ 3. Repeat until = : (a) Repeat until a local optimum is found: i. Select as the neighbor of with best value of the evaluation function ( ) ii. If ( ) is better than ( ) then := else a local optimum is found (b) := +1 (c) if is better than best then := (d) := new random solution Artificial Intelligence / Chung-Ang University / Professor Jaesung Lee 15
16 Hill-Climbing and Simulated Annealing Stochastic Hill-Climbing Modification of Iterative Hill-Climbing Selecting just one point from neighborhood Accept the new point with probability depending on the relative merit Artificial Intelligence / Chung-Ang University / Professor Jaesung Lee 16
17 Hill-Climbing and Simulated Annealing Stochastic Hill-Climbing 1. Choose a starting solution and evaluate it 2. = 0; = 3. Repeat until = : (a) select as a neighbor of (b) = with probability (c) = + 1 Artificial Intelligence / Chung-Ang University / Professor Jaesung Lee 17
18 Hill-Climbing and Simulated Annealing Stochastic Hill-Climbing (Example) For example, ( ) = 107, ( ) = 120 Acceptance Prob. = If = 1 ( is very small), acceptance probability is close to 1. As increases, the probability of acceptance decreases. If = 10 ( is very large) the probability of acceptance is 0.5. Artificial Intelligence / Chung-Ang University / Professor Jaesung Lee 18
19 Basic Structure of Simulated Annealing Pseudocode 1. Choose a starting solution 2. Initialize, 2. = 0; = 3. Repeat until halting criterion is satisfied: (a) Repeat times: i. Generate as a neighbor of ii. If ( ) h ( ) then = elseif exp > (0,1) then = (b) = + 1 (c) Calculate (d) Calculate the temperature Artificial Intelligence / Chung-Ang University / Professor Jaesung Lee 19
20 Properties of Simulated Annealing Simulated Annealing accepts some deterioration in the quality of solutions High temperature: Large deteriorations are accepted Low temperature: Small deteriorations are accepted 0 Temperature: Local optimization Artificial Intelligence / Chung-Ang University / Professor Jaesung Lee 20
21 SA for TSP Not so different The starting point: random solution or output of a local search should be proportional to the neighborhood size Post-processing may be helpful Artificial Intelligence / Chung-Ang University / Professor Jaesung Lee 21
22 Tabu Search 1986 s Glover and Hansen Tabu search is: a meta-heuristic superimposed on another heuristic. The overall approach is to avoid entrapment in cycles by forbidding or penalizing moves which take the solution, in the next iteration, to points in the solution space previously visited (hence tabu). Artificial Intelligence / Chung-Ang University / Professor Jaesung Lee 22
23 Basic features Accepts non-improving solutions deterministically Prevent the search from revisiting previously visited solutions Explore the unvisited areas of the solution space Artificial Intelligence / Chung-Ang University / Professor Jaesung Lee 23
24 Tabu search for TSP Example of Tabu List 6 7 Artificial Intelligence / Chung-Ang University / Professor Jaesung Lee 24
25 Tabu search for TSP Recency-based Memory Current tour: (7, 3, 5, 6, 1, 2, 4, 8) after 500 iterations Artificial Intelligence / Chung-Ang University / Professor Jaesung Lee 25
26 Tabu search for TSP Frequency-based Memory Current tour: (7, 3, 5, 6, 1, 2, 4, 8) after 500 iterations Artificial Intelligence / Chung-Ang University / Professor Jaesung Lee 26
27 Tabu search for TSP Neighborhood based on 2-interchange Artificial Intelligence / Chung-Ang University / Professor Jaesung Lee 27
28 Tabu search based on 2-interchange Sketch 1. Generate a tour 2. Repeat ITER times (a) identify a set of 2-interchange moves (b) select and make a 2-interchange (c) update tabu list (d) update local best tour info 3. Update global best tour info Artificial Intelligence / Chung-Ang University / Professor Jaesung Lee 28
29 Advantages and drawbacks of Tabu search Advantage Tabu search generally finds good solutions. Shortcomings Tabu list construction is problem specific. There is no guarantee of finding a global optimum. Artificial Intelligence / Chung-Ang University / Professor Jaesung Lee 29
30 Comparison to Simulated Annealing Both were designed to escape local optima and work on complete solutions. Tabu search only selects worse moves if it is stuck in a local optimum, whereas simulated annealing can do that all the time. Simulated annealing is stochastic, but Tabu search is deterministic. The parameters must be carefully chosen for both. Artificial Intelligence / Chung-Ang University / Professor Jaesung Lee 30
Heuristic Optimisation
Heuristic Optimisation Part 8: Simulated annealing Sándor Zoltán Németh http://web.mat.bham.ac.uk/s.z.nemeth s.nemeth@bham.ac.uk University of Birmingham S Z Németh (s.nemeth@bham.ac.uk) Heuristic Optimisation
More informationSingle Solution-based Metaheuristics
Parallel Cooperative Optimization Research Group Single Solution-based Metaheuristics E-G. Talbi Laboratoire d Informatique Fondamentale de Lille Single solution-based metaheuristics Improvement of a solution.
More informationPROBLEM SOLVING AND SEARCH IN ARTIFICIAL INTELLIGENCE
Artificial Intelligence, Computational Logic PROBLEM SOLVING AND SEARCH IN ARTIFICIAL INTELLIGENCE Lecture 4 Metaheuristic Algorithms Sarah Gaggl Dresden, 5th May 2017 Agenda 1 Introduction 2 Constraint
More informationLecture H2. Heuristic Methods: Iterated Local Search, Simulated Annealing and Tabu Search. Saeed Bastani
Simulation Lecture H2 Heuristic Methods: Iterated Local Search, Simulated Annealing and Tabu Search Saeed Bastani saeed.bastani@eit.lth.se Spring 2017 Thanks to Prof. Arne Løkketangen at Molde University
More information5. Simulated Annealing 5.1 Basic Concepts. Fall 2010 Instructor: Dr. Masoud Yaghini
5. Simulated Annealing 5.1 Basic Concepts Fall 2010 Instructor: Dr. Masoud Yaghini Outline Introduction Real Annealing and Simulated Annealing Metropolis Algorithm Template of SA A Simple Example References
More informationHill climbing: Simulated annealing and Tabu search
Hill climbing: Simulated annealing and Tabu search Heuristic algorithms Giovanni Righini University of Milan Department of Computer Science (Crema) Hill climbing Instead of repeating local search, it is
More informationMethods for finding optimal configurations
CS 1571 Introduction to AI Lecture 9 Methods for finding optimal configurations Milos Hauskrecht milos@cs.pitt.edu 5329 Sennott Square Search for the optimal configuration Optimal configuration search:
More information3.4 Relaxations and bounds
3.4 Relaxations and bounds Consider a generic Discrete Optimization problem z = min{c(x) : x X} with an optimal solution x X. In general, the algorithms generate not only a decreasing sequence of upper
More informationMetaheuristics and Local Search
Metaheuristics and Local Search 8000 Discrete optimization problems Variables x 1,..., x n. Variable domains D 1,..., D n, with D j Z. Constraints C 1,..., C m, with C i D 1 D n. Objective function f :
More informationMetaheuristics and Local Search. Discrete optimization problems. Solution approaches
Discrete Mathematics for Bioinformatics WS 07/08, G. W. Klau, 31. Januar 2008, 11:55 1 Metaheuristics and Local Search Discrete optimization problems Variables x 1,...,x n. Variable domains D 1,...,D n,
More informationTabu Search. Biological inspiration is memory the ability to use past experiences to improve current decision making.
Tabu Search Developed by Fred Glover in the 1970 s. Dr Glover is a business professor at University of Colorado at Boulder. Developed specifically as a combinatorial optimization tool. Biological inspiration
More informationLecture 4: Simulated Annealing. An Introduction to Meta-Heuristics, Produced by Qiangfu Zhao (Since 2012), All rights reserved
Lecture 4: Simulated Annealing Lec04/1 Neighborhood based search Step 1: s=s0; Step 2: Stop if terminating condition satisfied; Step 3: Generate N(s); Step 4: s =FindBetterSolution(N(s)); Step 5: s=s ;
More informationIntroduction to Simulated Annealing 22c:145
Introduction to Simulated Annealing 22c:145 Simulated Annealing Motivated by the physical annealing process Material is heated and slowly cooled into a uniform structure Simulated annealing mimics this
More informationFinding optimal configurations ( combinatorial optimization)
CS 1571 Introduction to AI Lecture 10 Finding optimal configurations ( combinatorial optimization) Milos Hauskrecht milos@cs.pitt.edu 539 Sennott Square Constraint satisfaction problem (CSP) Constraint
More informationDesign and Analysis of Algorithms
CSE 0, Winter 08 Design and Analysis of Algorithms Lecture 8: Consolidation # (DP, Greed, NP-C, Flow) Class URL: http://vlsicad.ucsd.edu/courses/cse0-w8/ Followup on IGO, Annealing Iterative Global Optimization
More informationMethods for finding optimal configurations
S 2710 oundations of I Lecture 7 Methods for finding optimal configurations Milos Hauskrecht milos@pitt.edu 5329 Sennott Square S 2710 oundations of I Search for the optimal configuration onstrain satisfaction
More informationA.I.: Beyond Classical Search
A.I.: Beyond Classical Search Random Sampling Trivial Algorithms Generate a state randomly Random Walk Randomly pick a neighbor of the current state Both algorithms asymptotically complete. Overview Previously
More informationLocal Search and Optimization
Local Search and Optimization Outline Local search techniques and optimization Hill-climbing Gradient methods Simulated annealing Genetic algorithms Issues with local search Local search and optimization
More informationZebo Peng Embedded Systems Laboratory IDA, Linköping University
TDTS 01 Lecture 8 Optimization Heuristics for Synthesis Zebo Peng Embedded Systems Laboratory IDA, Linköping University Lecture 8 Optimization problems Heuristic techniques Simulated annealing Genetic
More informationMotivation, Basic Concepts, Basic Methods, Travelling Salesperson Problem (TSP), Algorithms
Motivation, Basic Concepts, Basic Methods, Travelling Salesperson Problem (TSP), Algorithms 1 What is Combinatorial Optimization? Combinatorial Optimization deals with problems where we have to search
More informationPengju
Introduction to AI Chapter04 Beyond Classical Search Pengju Ren@IAIR Outline Steepest Descent (Hill-climbing) Simulated Annealing Evolutionary Computation Non-deterministic Actions And-OR search Partial
More information22c:145 Artificial Intelligence
22c:145 Artificial Intelligence Fall 2005 Informed Search and Exploration III Cesare Tinelli The University of Iowa Copyright 2001-05 Cesare Tinelli and Hantao Zhang. a a These notes are copyrighted material
More informationLocal Search & Optimization
Local Search & Optimization CE417: Introduction to Artificial Intelligence Sharif University of Technology Spring 2017 Soleymani Artificial Intelligence: A Modern Approach, 3 rd Edition, Chapter 4 Outline
More informationAnt Colony Optimization: an introduction. Daniel Chivilikhin
Ant Colony Optimization: an introduction Daniel Chivilikhin 03.04.2013 Outline 1. Biological inspiration of ACO 2. Solving NP-hard combinatorial problems 3. The ACO metaheuristic 4. ACO for the Traveling
More informationAlgorithms and Complexity theory
Algorithms and Complexity theory Thibaut Barthelemy Some slides kindly provided by Fabien Tricoire University of Vienna WS 2014 Outline 1 Algorithms Overview How to write an algorithm 2 Complexity theory
More informationLocal and Stochastic Search
RN, Chapter 4.3 4.4; 7.6 Local and Stochastic Search Some material based on D Lin, B Selman 1 Search Overview Introduction to Search Blind Search Techniques Heuristic Search Techniques Constraint Satisfaction
More informationSimulated Annealing. Local Search. Cost function. Solution space
Simulated Annealing Hill climbing Simulated Annealing Local Search Cost function? Solution space Annealing Annealing is a thermal process for obtaining low energy states of a solid in a heat bath. The
More informationSIMU L TED ATED ANNEA L NG ING
SIMULATED ANNEALING Fundamental Concept Motivation by an analogy to the statistical mechanics of annealing in solids. => to coerce a solid (i.e., in a poor, unordered state) into a low energy thermodynamic
More informationLocal Search & Optimization
Local Search & Optimization CE417: Introduction to Artificial Intelligence Sharif University of Technology Spring 2018 Soleymani Artificial Intelligence: A Modern Approach, 3 rd Edition, Chapter 4 Some
More information5. Simulated Annealing 5.2 Advanced Concepts. Fall 2010 Instructor: Dr. Masoud Yaghini
5. Simulated Annealing 5.2 Advanced Concepts Fall 2010 Instructor: Dr. Masoud Yaghini Outline Acceptance Function Initial Temperature Equilibrium State Cooling Schedule Stopping Condition Handling Constraints
More informationConstraint satisfaction search. Combinatorial optimization search.
CS 1571 Introduction to AI Lecture 8 Constraint satisfaction search. Combinatorial optimization search. Milos Hauskrecht milos@cs.pitt.edu 539 Sennott Square Constraint satisfaction problem (CSP) Objective:
More informationMetaheuristics. 2.3 Local Search 2.4 Simulated annealing. Adrian Horga
Metaheuristics 2.3 Local Search 2.4 Simulated annealing Adrian Horga 1 2.3 Local Search 2 Local Search Other names: Hill climbing Descent Iterative improvement General S-Metaheuristics Old and simple method
More informationLocal Search. Shin Yoo CS492D, Fall 2015, School of Computing, KAIST
Local Search Shin Yoo CS492D, Fall 2015, School of Computing, KAIST If your problem forms a fitness landscape, what is optimisation? Local Search Loop Local Search Loop Start with a single, random solution
More informationLin-Kernighan Heuristic. Simulated Annealing
DM63 HEURISTICS FOR COMBINATORIAL OPTIMIZATION Lecture 6 Lin-Kernighan Heuristic. Simulated Annealing Marco Chiarandini Outline 1. Competition 2. Variable Depth Search 3. Simulated Annealing DM63 Heuristics
More informationCS 380: ARTIFICIAL INTELLIGENCE
CS 380: ARTIFICIAL INTELLIGENCE PROBLEM SOLVING: LOCAL SEARCH 10/11/2013 Santiago Ontañón santi@cs.drexel.edu https://www.cs.drexel.edu/~santi/teaching/2013/cs380/intro.html Recall: Problem Solving Idea:
More informationMarkov Chain Monte Carlo. Simulated Annealing.
Aula 10. Simulated Annealing. 0 Markov Chain Monte Carlo. Simulated Annealing. Anatoli Iambartsev IME-USP Aula 10. Simulated Annealing. 1 [RC] Stochastic search. General iterative formula for optimizing
More informationRandom Search. Shin Yoo CS454, Autumn 2017, School of Computing, KAIST
Random Search Shin Yoo CS454, Autumn 2017, School of Computing, KAIST Random Search The polar opposite to the deterministic, examineeverything, search. Within the given budget, repeatedly generate a random
More informationLocal Search (Greedy Descent): Maintain an assignment of a value to each variable. Repeat:
Local Search Local Search (Greedy Descent): Maintain an assignment of a value to each variable. Repeat: I I Select a variable to change Select a new value for that variable Until a satisfying assignment
More information1 Heuristics for the Traveling Salesman Problem
Praktikum Algorithmen-Entwurf (Teil 9) 09.12.2013 1 1 Heuristics for the Traveling Salesman Problem We consider the following problem. We want to visit all the nodes of a graph as fast as possible, visiting
More informationNew rubric: AI in the news
New rubric: AI in the news 3 minutes Headlines this week: Silicon Valley Business Journal: Apple on hiring spreee for AI experts Forbes: Toyota Invests $50 Million In Artificial Intelligence Research For
More informationOverview. Optimization. Easy optimization problems. Monte Carlo for Optimization. 1. Survey MC ideas for optimization: (a) Multistart
Monte Carlo for Optimization Overview 1 Survey MC ideas for optimization: (a) Multistart Art Owen, Lingyu Chen, Jorge Picazo (b) Stochastic approximation (c) Simulated annealing Stanford University Intel
More informationLOCAL SEARCH. Today. Reading AIMA Chapter , Goals Local search algorithms. Introduce adversarial search 1/31/14
LOCAL SEARCH Today Reading AIMA Chapter 4.1-4.2, 5.1-5.2 Goals Local search algorithms n hill-climbing search n simulated annealing n local beam search n genetic algorithms n gradient descent and Newton-Rhapson
More informationSimulated Annealing applied to the Traveling Salesman Problem. Eric Miller
Simulated Annealing applied to the Traveling Salesman Problem Eric Miller INTRODUCTION The traveling salesman problem (abbreviated TSP) presents the task of finding the most efficient route (or tour) through
More informationSummary. AIMA sections 4.3,4.4. Hill-climbing Simulated annealing Genetic algorithms (briey) Local search in continuous spaces (very briey)
AIMA sections 4.3,4.4 Summary Hill-climbing Simulated annealing Genetic (briey) in continuous spaces (very briey) Iterative improvement In many optimization problems, path is irrelevant; the goal state
More informationSimulated Annealing with Parameter Tuning for Wind Turbine Placement Optimization
Simulated Annealing with Parameter Tuning for Wind Turbine Placement Optimization Daniel Lückehe 1, Oliver Kramer 2, and Manfred Weisensee 3 1 Department of Geoinformation, Jade University of Applied Sciences,
More informationSchool of EECS Washington State University. Artificial Intelligence
School of EECS Washington State University Artificial Intelligence 1 } Focused on finding a goal state Less focused on solution path or cost } Choose a state and search nearby (local) states Not a systematic
More informationLocal search algorithms. Chapter 4, Sections 3 4 1
Local search algorithms Chapter 4, Sections 3 4 Chapter 4, Sections 3 4 1 Outline Hill-climbing Simulated annealing Genetic algorithms (briefly) Local search in continuous spaces (very briefly) Chapter
More informationThe Story So Far... The central problem of this course: Smartness( X ) arg max X. Possibly with some constraints on X.
Heuristic Search The Story So Far... The central problem of this course: arg max X Smartness( X ) Possibly with some constraints on X. (Alternatively: arg min Stupidness(X ) ) X Properties of Smartness(X)
More informationStochastic Local Search
Stochastic Local Search International Center for Computational Logic Technische Universität Dresden Germany Stochastic Local Search Algorithms Uninformed Random Walk Iterative Improvement Local Minima
More informationA pruning pattern list approach to the permutation flowshop scheduling problem
A pruning pattern list approach to the permutation flowshop scheduling problem Takeshi Yamada NTT Communication Science Laboratories, 2-4 Hikaridai, Seika-cho, Soraku-gun, Kyoto 619-02, JAPAN E-mail :
More informationFormation of Student Groups with the Help of Optimization
Department of Mathematics Formation of Student Groups with the Help of Optimization Kaj Holmberg LiTH-MAT-R--2014/14--SE Department of Mathematics Linköping University S-581 83 Linköping, Sweden. Formation
More informationAlgorithm Analysis Divide and Conquer. Chung-Ang University, Jaesung Lee
Algorithm Analysis Divide and Conquer Chung-Ang University, Jaesung Lee Introduction 2 Divide and Conquer Paradigm 3 Advantages of Divide and Conquer Solving Difficult Problems Algorithm Efficiency Parallelism
More informationHertz, Krogh, Palmer: Introduction to the Theory of Neural Computation. Addison-Wesley Publishing Company (1991). (v ji (1 x i ) + (1 v ji )x i )
Symmetric Networks Hertz, Krogh, Palmer: Introduction to the Theory of Neural Computation. Addison-Wesley Publishing Company (1991). How can we model an associative memory? Let M = {v 1,..., v m } be a
More informationUnit 1A: Computational Complexity
Unit 1A: Computational Complexity Course contents: Computational complexity NP-completeness Algorithmic Paradigms Readings Chapters 3, 4, and 5 Unit 1A 1 O: Upper Bounding Function Def: f(n)= O(g(n)) if
More informationBeyond Classical Search
Beyond Classical Search Chapter 4 (Adapted from Stuart Russel, Dan Klein, and others. Thanks guys!) 1 Outline Hill-climbing Simulated annealing Genetic algorithms (briefly) Local search in continuous spaces
More informationInformed Search. Chap. 4. Breadth First. O(Min(N,B L )) BFS. Search. have same cost BIBFS. Bi- Direction. O(Min(N,2B L/2 )) BFS. have same cost UCS
Informed Search Chap. 4 Material in part from http://www.cs.cmu.edu/~awm/tutorials Uninformed Search Complexity N = Total number of states B = Average number of successors (branching factor) L = Length
More informationMAX-2-SAT: How Good is Tabu Search in the Worst-Case?
MAX-2-SAT: How Good is Tabu Search in the Worst-Case? Monaldo Mastrolilli IDSIA Galleria 2, 6928 Manno, Switzerland monaldo@idsia.ch Luca Maria Gambardella IDSIA Galleria 2, 6928 Manno, Switzerland luca@idsia.ch
More informationVehicle Routing and Scheduling. Martin Savelsbergh The Logistics Institute Georgia Institute of Technology
Vehicle Routing and Scheduling Martin Savelsbergh The Logistics Institute Georgia Institute of Technology Vehicle Routing and Scheduling Part II: Algorithmic Enhancements Handling Practical Complexities
More informationChapter 4 Beyond Classical Search 4.1 Local search algorithms and optimization problems
Chapter 4 Beyond Classical Search 4.1 Local search algorithms and optimization problems CS4811 - Artificial Intelligence Nilufer Onder Department of Computer Science Michigan Technological University Outline
More informationAnalysis of a Large Structure/Biological Activity. Data Set Using Recursive Partitioning and. Simulated Annealing
Analysis of a Large Structure/Biological Activity Data Set Using Recursive Partitioning and Simulated Annealing Student: Ke Zhang MBMA Committee: Dr. Charles E. Smith (Chair) Dr. Jacqueline M. Hughes-Oliver
More informationLocal and Online search algorithms
Local and Online search algorithms Chapter 4 Chapter 4 1 Outline Local search algorithms Hill-climbing Simulated annealing Genetic algorithms Searching with non-deterministic actions Searching with partially/no
More informationInformed Search. Day 3 of Search. Chap. 4, Russel & Norvig. Material in part from
Informed Search Day 3 of Search Chap. 4, Russel & Norvig Material in part from http://www.cs.cmu.edu/~awm/tutorials Uninformed Search Complexity N = Total number of states B = Average number of successors
More informationWho Has Heard of This Problem? Courtesy: Jeremy Kun
P vs. NP 02-201 Who Has Heard of This Problem? Courtesy: Jeremy Kun Runtime Analysis Last time, we saw that there is no solution to the Halting Problem. Halting Problem: Determine if a program will halt.
More informationARTIFICIAL INTELLIGENCE
BABEŞ-BOLYAI UNIVERSITY Faculty of Computer Science and Mathematics ARTIFICIAL INTELLIGENCE Solving search problems Informed local search strategies Nature-inspired algorithms March, 2017 2 Topics A. Short
More informationLocal search and agents
Artificial Intelligence Local search and agents Instructor: Fabrice Popineau [These slides adapted from Stuart Russell, Dan Klein and Pieter Abbeel @ai.berkeley.edu] Local search algorithms In many optimization
More informationMICROCANONICAL OPTIMIZATION APPLIED TO THE TRAVELING SALESMAN PROBLEM
International Journal of Modern Physics C, Vol. 9, No. 1 (1998) 133 146 c World Scientific Publishing Company MICROCANONICAL OPTIMIZATION APPLIED TO THE TRAVELING SALESMAN PROBLEM ALEXANDRE LINHARES Computação
More informationOutline. Ant Colony Optimization. Outline. Swarm Intelligence DM812 METAHEURISTICS. 1. Ant Colony Optimization Context Inspiration from Nature
DM812 METAHEURISTICS Outline Lecture 8 http://www.aco-metaheuristic.org/ 1. 2. 3. Marco Chiarandini Department of Mathematics and Computer Science University of Southern Denmark, Odense, Denmark
More informationScaling Up. So far, we have considered methods that systematically explore the full search space, possibly using principled pruning (A* etc.).
Local Search Scaling Up So far, we have considered methods that systematically explore the full search space, possibly using principled pruning (A* etc.). The current best such algorithms (RBFS / SMA*)
More informationImproved methods for the Travelling Salesperson with Hotel Selection
Improved methods for the Travelling Salesperson with Hotel Selection Marco Castro marco.castro@ua.ac.be ANT/OR November 23rd, 2011 Contents Problem description Motivation Mathematical formulation Solution
More informationA Hybrid Simulated Annealing with Kempe Chain Neighborhood for the University Timetabling Problem
A Hybrid Simulated Annealing with Kempe Chain Neighborhood for the University Timetabling Problem Mauritsius Tuga, Regina Berretta and Alexandre Mendes School of Electrical Engineering and Computer Science
More informationLocal search algorithms. Chapter 4, Sections 3 4 1
Local search algorithms Chapter 4, Sections 3 4 Chapter 4, Sections 3 4 1 Outline Hill-climbing Simulated annealing Genetic algorithms (briefly) Local search in continuous spaces (very briefly) Chapter
More informationHill-climbing Strategies on Various Landscapes: An Empirical Comparison
Hill-climbing Strategies on Various Landscapes: An Empirical Comparison Matthieu Basseur LERIA, Université d Angers, France matthieu.basseur@univ-angers.fr Adrien Goëffon LERIA, Université d Angers, France
More informationHow does data quality in a network affect heuristic
Working papers in transport, tourism, information technology and microdata analysis How does data quality in a network affect heuristic solutions? Ev. underrubrik ska stå i Arial, 14pt, Fet stil Mengjie
More informationOptimization. Announcements. Last Time. Searching: So Far. Complete Searching. Optimization
Optimization urr H. ettles C-540, UW-Madison www.cs.wisc.edu/~cs540-1 ummer 2003 nnouncements Project groups and preliminary topic ideas will be due on 6/30 week from Monday e thinking about what you d
More informationThe Traveling Salesman Problem: A Neural Network Perspective. Jean-Yves Potvin
1 The Traveling Salesman Problem: A Neural Network Perspective Jean-Yves Potvin Centre de Recherche sur les Transports Université de Montréal C.P. 6128, Succ. A, Montréal (Québec) Canada H3C 3J7 potvin@iro.umontreal.ca
More informationAlgorithm Design Strategies V
Algorithm Design Strategies V Joaquim Madeira Version 0.0 October 2016 U. Aveiro, October 2016 1 Overview The 0-1 Knapsack Problem Revisited The Fractional Knapsack Problem Greedy Algorithms Example Coin
More informationBeta Damping Quantum Behaved Particle Swarm Optimization
Beta Damping Quantum Behaved Particle Swarm Optimization Tarek M. Elbarbary, Hesham A. Hefny, Atef abel Moneim Institute of Statistical Studies and Research, Cairo University, Giza, Egypt tareqbarbary@yahoo.com,
More informationLocal search algorithms
Local search algorithms CS171, Winter 2018 Introduction to Artificial Intelligence Prof. Richard Lathrop Reading: R&N 4.1-4.2 Local search algorithms In many optimization problems, the path to the goal
More informationFoundations of Artificial Intelligence
Foundations of Artificial Intelligence 32. Propositional Logic: Local Search and Outlook Martin Wehrle Universität Basel April 29, 2016 Propositional Logic: Overview Chapter overview: propositional logic
More informationOn Markov Chain Monte Carlo
MCMC 0 On Markov Chain Monte Carlo Yevgeniy Kovchegov Oregon State University MCMC 1 Metropolis-Hastings algorithm. Goal: simulating an Ω-valued random variable distributed according to a given probability
More informationA parallel metaheuristics for the single machine total weighted tardiness problem with sequence-dependent setup times
A parallel metaheuristics for the single machine total weighted tardiness problem with sequence-dependent setup times Wojciech Bożejko Wroc law University of Technology Institute of Computer Engineering,
More informationImproving convergence of combinatorial optimization meta-heuristic algorithms
Sapienza Università di Roma A.A. 2012-2013 Facoltà di Scienze Matematiche Fisiche e Naturali Dipartimento di Matematica Guido Castelnuovo PhD in Mathematics Improving convergence of combinatorial optimization
More informationDISTRIBUTION SYSTEM OPTIMISATION
Politecnico di Torino Dipartimento di Ingegneria Elettrica DISTRIBUTION SYSTEM OPTIMISATION Prof. Gianfranco Chicco Lecture at the Technical University Gh. Asachi, Iaşi, Romania 26 October 2010 Outline
More informationSummary. Local Search and cycle cut set. Local Search Strategies for CSP. Greedy Local Search. Local Search. and Cycle Cut Set. Strategies for CSP
Summary Greedy and cycle cut set Greedy... in short G.B. Shaw A life spent doing mistakes is not only more honorable, but more useful than a life spent doing nothing Reminder: Hill-climbing Algorithm function
More informationBounded Approximation Algorithms
Bounded Approximation Algorithms Sometimes we can handle NP problems with polynomial time algorithms which are guaranteed to return a solution within some specific bound of the optimal solution within
More informationSwarm Intelligence Traveling Salesman Problem and Ant System
Swarm Intelligence Leslie Pérez áceres leslie.perez.caceres@ulb.ac.be Hayfa Hammami haifa.hammami@ulb.ac.be IRIIA Université Libre de ruxelles (UL) ruxelles, elgium Outline 1.oncept review 2.Travelling
More informationAn ACO Algorithm for the Most Probable Explanation Problem
An ACO Algorithm for the Most Probable Explanation Problem Haipeng Guo 1, Prashanth R. Boddhireddy 2, and William H. Hsu 3 1 Department of Computer Science, Hong Kong University of Science and Technology
More informationOPTIMAL CHANNEL ASSIGNMENT IN CELLULAR SYSTEMS USING TABU SEARCH
OPTIMAL CHANNEL ASSIGNMENT IN CELLULAR SYSTEMS USING TABU SEARCH Yanjie Peng, Lipo Wang, and Boon Hee Soong Abstract - The channel assignment problem (CAP) in cellular systems has the task of planning
More informationA new ILS algorithm for parallel machine scheduling problems
J Intell Manuf (2006) 17:609 619 DOI 10.1007/s10845-006-0032-2 A new ILS algorithm for parallel machine scheduling problems Lixin Tang Jiaxiang Luo Received: April 2005 / Accepted: January 2006 Springer
More informationArtificial Intelligence Methods (G5BAIM) - Examination
Question 1 a) According to John Koza there are five stages when planning to solve a problem using a genetic program. What are they? Give a short description of each. (b) How could you cope with division
More informationReactive Power and Voltage Control of Power Systems Using Modified PSO
J. Energy Power Sources Vol. 2, No. 5, 2015, pp. 182-188 Received: March 29, 2015, Published: May 30, 2015 Journal of Energy and Power Sources www.ethanpublishing.com Reactive Power and Voltage Control
More informationConstructing some PBIBD(2)s by Tabu Search Algorithm
Constructing some PBIBD(2)s by Tabu Search Algorithm Luis B. Morales IIMAS, Universidad Nacional Autónoma de México Apdo. Postal 70-221, México, D.F., 04510, Mexico lbm@servidor.unam.mx Abstract Some papers
More informationMarkov Chain Monte Carlo Methods
Markov Chain Monte Carlo Methods p. /36 Markov Chain Monte Carlo Methods Michel Bierlaire michel.bierlaire@epfl.ch Transport and Mobility Laboratory Markov Chain Monte Carlo Methods p. 2/36 Markov Chains
More informationThe Inventory-Routing Problem with Transshipment
The Inventory-Routing Problem with Transshipment Leandro Callegari Coelho Jean-François Cordeau Gilbert Laporte March 2011 CIRRELT-2011-21 Bureaux de Montréal : Bureaux de Québec : Université de Montréal
More informationFundamentals of Metaheuristics
Fundamentals of Metaheuristics Part I - Basic concepts and Single-State Methods A seminar for Neural Networks Simone Scardapane Academic year 2012-2013 ABOUT THIS SEMINAR The seminar is divided in three
More information7.1 Basis for Boltzmann machine. 7. Boltzmann machines
7. Boltzmann machines this section we will become acquainted with classical Boltzmann machines which can be seen obsolete being rarely applied in neurocomputing. It is interesting, after all, because is
More informationOPTIMIZATION BY SIMULATED ANNEALING: A NECESSARY AND SUFFICIENT CONDITION FOR CONVERGENCE. Bruce Hajek* University of Illinois at Champaign-Urbana
OPTIMIZATION BY SIMULATED ANNEALING: A NECESSARY AND SUFFICIENT CONDITION FOR CONVERGENCE Bruce Hajek* University of Illinois at Champaign-Urbana A Monte Carlo optimization technique called "simulated
More informationCSCE 222 Discrete Structures for Computing
CSCE 222 Discrete Structures for Computing Algorithms Dr. Philip C. Ritchey Introduction An algorithm is a finite sequence of precise instructions for performing a computation or for solving a problem.
More informationSolving the Homogeneous Probabilistic Traveling Salesman Problem by the ACO Metaheuristic
Solving the Homogeneous Probabilistic Traveling Salesman Problem by the ACO Metaheuristic Leonora Bianchi 1, Luca Maria Gambardella 1 and Marco Dorigo 2 1 IDSIA, Strada Cantonale Galleria 2, CH-6928 Manno,
More informationUsing Evolutionary Techniques to Hunt for Snakes and Coils
Using Evolutionary Techniques to Hunt for Snakes and Coils Abstract The snake-in-the-box problem is a difficult problem in mathematics and computer science that deals with finding the longest-possible
More information