Motivation, Basic Concepts, Basic Methods, Travelling Salesperson Problem (TSP), Algorithms
|
|
- Tracy Burke
- 5 years ago
- Views:
Transcription
1 Motivation, Basic Concepts, Basic Methods, Travelling Salesperson Problem (TSP), Algorithms 1
2 Next Step Application of simulated annealing to the Traveling Salesman problem. 2
3 Choosing a temperature schedule. Initially, obtain a random list of cities (initial route). Can do by permuting a given list. Perturbing a city list. Many ways to do this, but will show a simple way. Computing the cost function I.e., computing the distance of a route. Presents two different methods. Basic Simulated Annealing flow chart. MatLab code for the flow chart. Results for the 29 City data set. 3
4 Choosing a Temperature Schedule There are many different possible temperature reduction methods that can be used in SA, aka, cooling strategies or cooling schedules (i.e., temperature cooling equation(s) that implement how the temperature is to be changed at each iteration of the outer loop). They may be categorized as non-adaptive, and adaptive: Non-adaptive temperature reduction schedule The temperature reduction strategy is fixed at the initialization stage and is not changed at any time during the simulated annealing iterative process. I.e., the temperature is decreased at each iteration of the outer loop in accordance with the initial strategy, which is determined and fixed at initialization time. Adaptive cooling strategy The cooling strategy is set at the initialization stage of the simulated annealing process and then, thereafter, the cooling strategy may be changed. The cooling strategy is influenced by the performance of the SA process. The control parameters of the temperature reduction equations or the equations themselves that govern how the temperature is to be changed may change, depending on the performance of the SA process. 4
5 Let T represent the temperature is the time step (algorithm s iteration number) and are user selectable constants ( is usually set to one) ( is usually close to but less than 1) Exponential: Linear:, or, or Logarithmic:, or 5
6 The temperature for the next iteration is computed by multiplying the current temperature, found by any fixed schedule, by an adaptive factor, which is based on the difference between the cost of the current solution and the cost of the best solution achieved so far. The new temperature is proportional to the change in cost of the current and best solutions. If the current solution has a larger cost than the best solution, then the new temperature change will be greater. If the current solution has a better cost than that of the best solution, the temperature change is smaller. Other adaptive schemes are possible. 6
7 First, need to establish the initial temperature, which should be very high, and the final temperature of the cooling strategy, which should be very low. Solve for the initial and final temperatures from Boltzmann s probability function: Set the probability that a worse design could be accepted at the beginning of the optimization process. Set to a high number. Set the probability, that a worse design could be accepted at the end of the optimization process. Set to a low number. Then, if we assume, (which is clearly true at the start of the optimization), then: 7
8 Choosing How to Decrease Select the total number of outer loop iterations (i.e., cooling cycles). For each Cooling Loop (outer loop) the temperature can be decreased as follows: is the temperature for the next cycle and is the current temperature. 8
9 Accordingly, 9
10 Generate Initial City Route List Requirements Write MatLab code to generate a list of cities, where Cities are chosen according to a uniform random distribution Options No city appears more than once All cities are included in the list. Write custom routine to generate a list of cities Use Matlab s library routine randperm. 10
11 Generate Initial City Route (Using Matlab Library randperm) P = randperm(n) returns a vector containing a random permutation of the integers 1:N. For example, randperm(6) might be [ ]. Therefore, to get an initial city route of 10 cities: cityroute = randperm(10); g=sprintf('%d ', cityroute); fprintf('city route before = %s\n', g); cityroute = randperm(10); g=sprintf('%d ', cityroute); fprintf('city route after = %s\n', g); Example Output: City route before = City route after =
12 Generate Initial City Route (Using Custom Function) The city list is stored in a vector of -components, where is the number of cities. One potential way to permute the list: Starting from the first component in the list, and continuing on to the end of the list, for every component of the list, choose a component randomly. Swap the positions of these two components in the list. If, no swap will be done, but this is not a problem since this process is random. for i=1:numcities j = randi(numcities); temp = cityroute(i); cityroute (i) = cityroute(j); cityroute (j) = temp; end This will create the same random permutation each time it is run. A different seed is required to create different permutation. 12
13 Generate Initial City Route (Using Custom Function) cityroute = randperm(10); g=sprintf('%d ', cityroute); fprintf('city route before = %s\n', g); numcities = size(cityroute',1); for i=1:numcities j = randi(numcities); temp = cityroute(i); cityroute (i) = cityroute(j); cityroute (j) = temp; end Example Output: City route before = City route after = g=sprintf('%d ', cityroute); fprintf('city route after = %s\n', g); 13
14 Perturbing the City Route List For each iteration of the Equilibrium loop, the SA algorithm needs to change the city route list (cityroute). There are many ways in which the cityroute may be changed (perturbed). One potential way Choose two indices of the list at random, using a uniform distribution Swap the positions of these two cities in the list. For example: If indices 1 and 3 were chosen at random, then city 3 would swap position with city 4. Index City Before Index City After
15 Perturbing the City Route List cityroute = randperm(5); randindex1 = randi(5); Example Output: alreadychosen = true; while alreadychosen == true Random index 1 = 4 randindex2 = randi(5); Random index 2 = 5 if randindex2 ~= randindex1 City route before = alreadychosen = false; City route after = end end fprintf('random index 1 = %d\n', randindex1); fprintf('random index 2 = %d\n', randindex2); g=sprintf('%d ', cityroute); fprintf('city route before = %s\n', g); temp = cityroute(randindex1); cityroute(randindex1) = cityroute(randindex2); cityroute(randindex2) = temp; g=sprintf('%d ', cityroute); fprintf('city route after = %s\n', g); 15
16 A city-distance data set may be represented in many ways. Examples: 1. Two dimensional array, where each element denotes the distance between city and city. d(1,1) d(1,2) d(1,3) d(1,4) d(1,5) d(2,1) d(2,2) d(2,3) d(2,4) d(2,5) d(3,1) d(3,2) d(3,3) d(3,4) d(3,5) d(4,1) d(4,2) d(4,3) d(4,4) d(4,5) d(5,1) d(5,2) d(5,3) d(5,4) d(5,5) 2. Each entry in a list represents the Euclidean coordinates of the city. So, you need to compute the distances. 16
17 Assume the data set is a two dimensional array, where each element denotes the distance between city and city. Let represent the city list route, i.e., is a list of city indices, that represents the route to take by the TS person. The cost function is the round trip distance ( is the number of cities): 17
18 Computing Route Cost Example The cost function is the round trip distance : d(1,1) d(1,2) d(1,3) d(1,4) d(1,5) d(2,1) d(2,2) d(2,3) d(2,4) d(2,5) d(3,1) d(3,2) d(3,3) d(3,4) d(3,5) d(4,1) d(4,2) d(4,3) d(4,4) d(4,5) d(5,1) d(5,2) d(5,3) d(5,4) d(5,5) Index
19 Computing Route Cost Example Now assume the distances are stored in a one dimensional vector (i.e., in a File), and the distances are symmetric. For example: d(1,1) d(1,2) d(1,3) d(1,4) d(1,5) d(2,1) d(2,2) d(2,3) d(2,4) d(2,5) d(3,1) d(3,2) d(3,3) d(3,4) d(3,5) d(4,1) d(4,2) d(4,3) d(4,4) d(4,5) d(5,1) d(5,2) d(5,3) d(5,4) d(5,5) File d(1,1) = 0.00 d(1,2) = d(2,1) d(1,3) = d(3,1) d(1,4) = d(4,1) d(1,5) = d(5,1) d(2,1) = d(1,2) d(2,2) = 0.00 d(2,3) = d(3,2) d(2,4) = d(4,2) d(2,5) = d(5,2) d(3,1) = d(1,3) d(3,2) = d(2,3) d(3,3) = 0.00 d(3,4) = d(4,3) d(3,5) = d(5,3) d(4,1) = d(1,4) d(4,2) = d(2,4) d(4,3) = d(3,4) d(4,4) = 0.00 d(4,5) = d(5,4) d(5,1) = d(1,5) d(5,2) = d(2,5) d(5,3) = d(3,5) d(5,4) = d(4,5) d(5,5) =
20 Computing Route Cost Example Index City d(1,1) = 0.00 d(2,1) = d(1,2) d(3,1) = d(1,3) d(4,1) = d(1,4) d(5,1) = d(1,5) d(1,2) = d(2,1) d(2,2) = 0.00 d(3,2) = d(2,3) d(4,2) = d(2,4) d(5,2) = d(2,5) d(1,3) = d(3,1) d(2,3) = d(3,2) d(3,3) = 0.00 d(4,3) = d(3,4) d(5,3) = d(3,5) d(1,4) = d(4,1) d(2,4) = d(4,2) d(3,4) = d(4,3) d(4,4) = 0.00 d(5,4) = d(4,5) d(1,5) = d(5,1) d(2,5) = d(5,2) d(3,5) = d(5,3) d(4,5) = d(5,4) d(5,5) =
21 Row in File File d(1,1) = 0.00 d(2,1) = d(1,2) d(3,1) = d(1,3) d(4,1) = d(1,4) d(5,1) = d(1,5) Computing Route Cost d(1,2) = d(2,1) d(2,2) = 0.00 d(3,2) = d(2,3) d(4,2) = d(2,4) d(5,2) = d(2,5) Example Index City d(1,3) = d(3,1) d(2,3) = d(3,2) d(3,3) = 0.00 d(4,3) = d(3,4) d(5,3) = d(3,5) d(1,4) = d(4,1) d(2,4) = d(4,2) d(3,4) = d(4,3) d(4,4) = 0.00 d(5,4) = d(4,5) d(1,5) = d(5,1) d(2,5) = d(5,2) d(3,5) = d(5,3) d(4,5) = d(5,4) d(5,5) =
22 Computing Route Cost MatLab Code with Example cityroute = [ ]; Index Distances = load('5x5symmetric.txt'); D=0; n=5; for i=1:n-1 cityroute D = D + Distances((cityRoute(i)-1)*n+cityRoute(i+1)); end D = D + Distances((cityRoute(n)-1)*n+cityRoute(1)); Output: D = 111 Distances
23 Computing Route Cost Euclidean Distance Format (TSPLIB) The TSPLIB is a standard format for representing cities for the travelling salesperson problem (TSP). Each entry in the file denotes the Euclidean coordinates of the city. To determine the distance of a TSP route, the Euclidean metric is used. For example: Example: a 10x2 citycoords (cc) array, that holds the coordinates for each city to be visited. City x-coordinate y-coordinate cc cc cc cc cc cc cc cc 23
24 EUC_2D_29.txt Computing Route Cost Matlab Code with Example cc = load('euc_2d_29.txt'); D=0; n=29; for i=1:n-1 D = D + sqrt((cc(i,1) - cc(i+1,1))^2 + (cc(i,2) - cc(i+1,2))^2); end D = D + sqrt((cc(n,1) - cc(1,1))^2 + (cc(n,2)- cc(1,2))^2); D Matlab output: D = e+04 24
25 EUC_2D_29.txt Usually in TSP problems, the city route is stored (represented) in city index format, rather than coordinate format. For example, cityroute (cr): An entry in the route denotes the index of the city. The index references the input coordinates file. To determine the distance of the route stored in the index format, we must use the index in the route array to extract the coordinates from the input file. For example, let the file array be called cc and the route array be called cr: cc cc cc cc cc cc cc cc 25
26 Set #ncl, itemp. Done Get Initial Route Y #ncl s==0? Dec # ncl N Compute Distance of Initial Route Set #nel perturbroute N Equilibrium Loop: The temperature is held constant, while the system reaches equilibrium, i.e., until the best route if found for the given temperature. Compute Distance of Route Reduce Temperature Y #nel ==0? Dec # nel N? Worse Route? ncl=numcoolingloops nel=numequilibriumloops N? Y genrand # Y Find Prob of Acceptance, 26
27 clc; clear; close all; cc = load('euc_2d_29.txt'); numcities = size(cc,1); x=cc(1:numcities, 1); y=cc(1:numcities, 2); x(numcities+1)=cc(1,1); y(numcities+1)=cc(1,2); figure hold on plot(x',y','.k','markersize',14) labels = cellstr( num2str([1:numcities]') ); %' # labels text(x(1:numcities)', y(1:numcities)', labels,... 'VerticalAlignment','bottom',... 'HorizontalAlignment','center'); ylabel('y Coordinate', 'fontsize', 18, 'fontname', 'Arial'); xlabel('x Coordinate', 'fontsize', 18, 'fontname', 'Arial'); title('city Coordinates', 'fontsize', 20, 'fontname', 'Arial'); 27
28 28
29 numcoolingloops = 1100; numequilbriumloops = 100; pstart = 0.6; % Probability of accepting worse solution at the start pend = 0.001; % Probability of accepting worse solution at the end tstart = -1.0/log(pStart); % Initial temperature tend = -1.0/log(pEnd); % Final temperature frac = (tend/tstart)^(1.0/(numcoolingloops-1.0));% Fract temp reduction cityroute_i = randperm(numcities); % Get initial route cityroute_b = cityroute_i; % Best route cityroute_j = cityroute_i; % Current route cityroute_o = cityroute_i; % Optimal route % Initial distances D_j = computeeucdistance(numcities, cc, cityroute_i); D_o = D_j; D_b = D_j ; D(1) = D_o; numacceptedsolutions = 1.0; tcurrent = tstart; % Current temperature = initial temperature DeltaE_avg = 0.0; % DeltaE Average 29
30 for i=1:numcoolingloops disp(['cycle: ',num2str(i),' starting temp: ',num2str(tcurrent)]) for j=1:numequilbriumloops cityroute_j = perturbroute(numcities, cityroute_b); D_j = computeeucdistance(numcities, cc, cityroute_j); DeltaE = abs(d_j-d_b); if (D_j > D_b) % if cost is higher, then: if (i==1 && j==1) DeltaE_avg = DeltaE; end p = exp(-deltae/(deltae_avg * tcurrent)); if (p > rand()) accept = true; else accept = false; end else accept = true; % cost is lower, keep solution end 30
31 if (accept==true) cityroute_b = cityroute_j; D_b = D_j; numacceptedsolutions = numacceptedsolutions + 1.0; DeltaE_avg = (DeltaE_avg * (numacceptedsolutions-1.0) +... DeltaE) / numacceptedsolutions; end end // j=1:numequilbriumloops tcurrent = frac * tcurrent; % Lower temp for next cooling cycle cityroute_o = cityroute_b; % Record the best route D(i+1) = D_b; % Record each route distance D_o = D_b; end 31
32 Best Route Distance Found: 29,702.3 m 29,
33 33
34 [1] J. D. Hedengren, "Optimization Techniques in Engineering," 5 April [Online]. Available: [Accessed 27 April 2015]. [2] A. R. Parkinson, R. J. Balling and J. D. Heden, "Optimization Methods for Engineering Design Applications and Theory," Brigham Young University,
Motivation, Basic Concepts, Basic Methods, Travelling Salesperson Problem (TSP), Algorithms
Motivation, Basic Concepts, Basic Methods, Travelling Salesperson Problem (TSP), Algorithms 1 What is Combinatorial Optimization? Combinatorial Optimization deals with problems where we have to search
More informationSimulated Annealing. Local Search. Cost function. Solution space
Simulated Annealing Hill climbing Simulated Annealing Local Search Cost function? Solution space Annealing Annealing is a thermal process for obtaining low energy states of a solid in a heat bath. The
More informationMCMC Simulated Annealing Exercises.
Aula 10. Simulated Annealing. 0 MCMC Simulated Annealing Exercises. Anatoli Iambartsev IME-USP Aula 10. Simulated Annealing. 1 [Wiki] Salesman problem. The travelling salesman problem (TSP), or, in recent
More informationSIMU L TED ATED ANNEA L NG ING
SIMULATED ANNEALING Fundamental Concept Motivation by an analogy to the statistical mechanics of annealing in solids. => to coerce a solid (i.e., in a poor, unordered state) into a low energy thermodynamic
More information1 Heuristics for the Traveling Salesman Problem
Praktikum Algorithmen-Entwurf (Teil 9) 09.12.2013 1 1 Heuristics for the Traveling Salesman Problem We consider the following problem. We want to visit all the nodes of a graph as fast as possible, visiting
More information5. Simulated Annealing 5.1 Basic Concepts. Fall 2010 Instructor: Dr. Masoud Yaghini
5. Simulated Annealing 5.1 Basic Concepts Fall 2010 Instructor: Dr. Masoud Yaghini Outline Introduction Real Annealing and Simulated Annealing Metropolis Algorithm Template of SA A Simple Example References
More informationIntroduction to Simulated Annealing 22c:145
Introduction to Simulated Annealing 22c:145 Simulated Annealing Motivated by the physical annealing process Material is heated and slowly cooled into a uniform structure Simulated annealing mimics this
More informationLocal Search. Shin Yoo CS492D, Fall 2015, School of Computing, KAIST
Local Search Shin Yoo CS492D, Fall 2015, School of Computing, KAIST If your problem forms a fitness landscape, what is optimisation? Local Search Loop Local Search Loop Start with a single, random solution
More information7.1 Basis for Boltzmann machine. 7. Boltzmann machines
7. Boltzmann machines this section we will become acquainted with classical Boltzmann machines which can be seen obsolete being rarely applied in neurocomputing. It is interesting, after all, because is
More informationAlgorithms and Complexity theory
Algorithms and Complexity theory Thibaut Barthelemy Some slides kindly provided by Fabien Tricoire University of Vienna WS 2014 Outline 1 Algorithms Overview How to write an algorithm 2 Complexity theory
More informationAssignment 4. CSci 3110: Introduction to Algorithms. Sample Solutions
Assignment 4 CSci 3110: Introduction to Algorithms Sample Solutions Question 1 Denote the points by p 1, p 2,..., p n, ordered by increasing x-coordinates. We start with a few observations about the structure
More informationZebo Peng Embedded Systems Laboratory IDA, Linköping University
TDTS 01 Lecture 8 Optimization Heuristics for Synthesis Zebo Peng Embedded Systems Laboratory IDA, Linköping University Lecture 8 Optimization problems Heuristic techniques Simulated annealing Genetic
More informationRandom Search. Shin Yoo CS454, Autumn 2017, School of Computing, KAIST
Random Search Shin Yoo CS454, Autumn 2017, School of Computing, KAIST Random Search The polar opposite to the deterministic, examineeverything, search. Within the given budget, repeatedly generate a random
More informationArtificial Intelligence Heuristic Search Methods
Artificial Intelligence Heuristic Search Methods Chung-Ang University, Jaesung Lee The original version of this content is created by School of Mathematics, University of Birmingham professor Sandor Zoltan
More informationSingle Solution-based Metaheuristics
Parallel Cooperative Optimization Research Group Single Solution-based Metaheuristics E-G. Talbi Laboratoire d Informatique Fondamentale de Lille Single solution-based metaheuristics Improvement of a solution.
More informationLecture 4: Simulated Annealing. An Introduction to Meta-Heuristics, Produced by Qiangfu Zhao (Since 2012), All rights reserved
Lecture 4: Simulated Annealing Lec04/1 Neighborhood based search Step 1: s=s0; Step 2: Stop if terminating condition satisfied; Step 3: Generate N(s); Step 4: s =FindBetterSolution(N(s)); Step 5: s=s ;
More informationSimulated Annealing applied to the Traveling Salesman Problem. Eric Miller
Simulated Annealing applied to the Traveling Salesman Problem Eric Miller INTRODUCTION The traveling salesman problem (abbreviated TSP) presents the task of finding the most efficient route (or tour) through
More informationCS/COE
CS/COE 1501 www.cs.pitt.edu/~nlf4/cs1501/ P vs NP But first, something completely different... Some computational problems are unsolvable No algorithm can be written that will always produce the correct
More informationMetaheuristics. 2.3 Local Search 2.4 Simulated annealing. Adrian Horga
Metaheuristics 2.3 Local Search 2.4 Simulated annealing Adrian Horga 1 2.3 Local Search 2 Local Search Other names: Hill climbing Descent Iterative improvement General S-Metaheuristics Old and simple method
More informationPROBLEM SOLVING AND SEARCH IN ARTIFICIAL INTELLIGENCE
Artificial Intelligence, Computational Logic PROBLEM SOLVING AND SEARCH IN ARTIFICIAL INTELLIGENCE Lecture 4 Metaheuristic Algorithms Sarah Gaggl Dresden, 5th May 2017 Agenda 1 Introduction 2 Constraint
More informationIt ain t no good if it ain t snappy enough. (Efficient Computations) COS 116, Spring 2011 Sanjeev Arora
It ain t no good if it ain t snappy enough. (Efficient Computations) COS 116, Spring 2011 Sanjeev Arora Administrative stuff Readings avail. from course web page Feedback form on course web page; fully
More informationDesign and Analysis of Algorithms
CSE 0, Winter 08 Design and Analysis of Algorithms Lecture 8: Consolidation # (DP, Greed, NP-C, Flow) Class URL: http://vlsicad.ucsd.edu/courses/cse0-w8/ Followup on IGO, Annealing Iterative Global Optimization
More informationFinding optimal configurations ( combinatorial optimization)
CS 1571 Introduction to AI Lecture 10 Finding optimal configurations ( combinatorial optimization) Milos Hauskrecht milos@cs.pitt.edu 539 Sennott Square Constraint satisfaction problem (CSP) Constraint
More informationMethods for finding optimal configurations
CS 1571 Introduction to AI Lecture 9 Methods for finding optimal configurations Milos Hauskrecht milos@cs.pitt.edu 5329 Sennott Square Search for the optimal configuration Optimal configuration search:
More informationLocal search algorithms. Chapter 4, Sections 3 4 1
Local search algorithms Chapter 4, Sections 3 4 Chapter 4, Sections 3 4 1 Outline Hill-climbing Simulated annealing Genetic algorithms (briefly) Local search in continuous spaces (very briefly) Chapter
More information5. Simulated Annealing 5.2 Advanced Concepts. Fall 2010 Instructor: Dr. Masoud Yaghini
5. Simulated Annealing 5.2 Advanced Concepts Fall 2010 Instructor: Dr. Masoud Yaghini Outline Acceptance Function Initial Temperature Equilibrium State Cooling Schedule Stopping Condition Handling Constraints
More informationCS 380: ARTIFICIAL INTELLIGENCE
CS 380: ARTIFICIAL INTELLIGENCE PROBLEM SOLVING: LOCAL SEARCH 10/11/2013 Santiago Ontañón santi@cs.drexel.edu https://www.cs.drexel.edu/~santi/teaching/2013/cs380/intro.html Recall: Problem Solving Idea:
More information(Mathematical Operations with Arrays) Applied Linear Algebra in Geoscience Using MATLAB
Applied Linear Algebra in Geoscience Using MATLAB (Mathematical Operations with Arrays) Contents Getting Started Matrices Creating Arrays Linear equations Mathematical Operations with Arrays Using Script
More informationMetaheuristics and Local Search
Metaheuristics and Local Search 8000 Discrete optimization problems Variables x 1,..., x n. Variable domains D 1,..., D n, with D j Z. Constraints C 1,..., C m, with C i D 1 D n. Objective function f :
More informationChapter 4: Monte Carlo Methods. Paisan Nakmahachalasint
Chapter 4: Monte Carlo Methods Paisan Nakmahachalasint Introduction Monte Carlo Methods are a class of computational algorithms that rely on repeated random sampling to compute their results. Monte Carlo
More informationMetaheuristics and Local Search. Discrete optimization problems. Solution approaches
Discrete Mathematics for Bioinformatics WS 07/08, G. W. Klau, 31. Januar 2008, 11:55 1 Metaheuristics and Local Search Discrete optimization problems Variables x 1,...,x n. Variable domains D 1,...,D n,
More informationMVE165/MMG630, Applied Optimization Lecture 6 Integer linear programming: models and applications; complexity. Ann-Brith Strömberg
MVE165/MMG630, Integer linear programming: models and applications; complexity Ann-Brith Strömberg 2011 04 01 Modelling with integer variables (Ch. 13.1) Variables Linear programming (LP) uses continuous
More informationProgramming Abstractions
Programming Abstractions C S 1 0 6 X Cynthia Lee Today s topics: Performance issues in recursion Big-O performance analysis 2 Announcement: Recursive art contest! Go to http://recursivedrawing.com/ Make
More information8.3 Hamiltonian Paths and Circuits
8.3 Hamiltonian Paths and Circuits 8.3 Hamiltonian Paths and Circuits A Hamiltonian path is a path that contains each vertex exactly once A Hamiltonian circuit is a Hamiltonian path that is also a circuit
More informationMany algorithms do not fall into this class. Example: The travelling salesperson problem (TSP).
Exponential Complexity Algorithms that have a complexity of O(n p ) (where n is a measure of the problem size) are said to have polynomial complexity. They are considered reasonably efficient, specially
More information( ) ( ) ( ) ( ) Simulated Annealing. Introduction. Pseudotemperature, Free Energy and Entropy. A Short Detour into Statistical Mechanics.
Aims Reference Keywords Plan Simulated Annealing to obtain a mathematical framework for stochastic machines to study simulated annealing Parts of chapter of Haykin, S., Neural Networks: A Comprehensive
More informationInteger Linear Programming
Integer Linear Programming Solution : cutting planes and Branch and Bound Hugues Talbot Laboratoire CVN April 13, 2018 IP Resolution Gomory s cutting planes Solution branch-and-bound General method Resolution
More informationSummary. AIMA sections 4.3,4.4. Hill-climbing Simulated annealing Genetic algorithms (briey) Local search in continuous spaces (very briey)
AIMA sections 4.3,4.4 Summary Hill-climbing Simulated annealing Genetic (briey) in continuous spaces (very briey) Iterative improvement In many optimization problems, path is irrelevant; the goal state
More informationAlgorithms and Theory of Computation. Lecture 22: NP-Completeness (2)
Algorithms and Theory of Computation Lecture 22: NP-Completeness (2) Xiaohui Bei MAS 714 November 8, 2018 Nanyang Technological University MAS 714 November 8, 2018 1 / 20 Set Cover Set Cover Input: a set
More informationA.I.: Beyond Classical Search
A.I.: Beyond Classical Search Random Sampling Trivial Algorithms Generate a state randomly Random Walk Randomly pick a neighbor of the current state Both algorithms asymptotically complete. Overview Previously
More informationStochastic Modelling
Stochastic Modelling Simulating Random Walks and Markov Chains This lab sheets is available for downloading from www.staff.city.ac.uk/r.j.gerrard/courses/dam/, as is the spreadsheet mentioned in section
More informationSupplementary Technical Details and Results
Supplementary Technical Details and Results April 6, 2016 1 Introduction This document provides additional details to augment the paper Efficient Calibration Techniques for Large-scale Traffic Simulators.
More informationAlgorithm Design Strategies V
Algorithm Design Strategies V Joaquim Madeira Version 0.0 October 2016 U. Aveiro, October 2016 1 Overview The 0-1 Knapsack Problem Revisited The Fractional Knapsack Problem Greedy Algorithms Example Coin
More informationMethods for finding optimal configurations
S 2710 oundations of I Lecture 7 Methods for finding optimal configurations Milos Hauskrecht milos@pitt.edu 5329 Sennott Square S 2710 oundations of I Search for the optimal configuration onstrain satisfaction
More informationInformatik-Bericht Nr
F Informatik-Bericht Nr. 2007-4 Schriftenreihe Fachbereich Informatik, Fachhochschule Trier First Come, First Served Tour Scheduling with Priorities Heinz Schmitz and Sebastian Niemann Fachhochschule Trier,
More informationLocal Search & Optimization
Local Search & Optimization CE417: Introduction to Artificial Intelligence Sharif University of Technology Spring 2017 Soleymani Artificial Intelligence: A Modern Approach, 3 rd Edition, Chapter 4 Outline
More informationCSE373: Data Structures and Algorithms Lecture 3: Math Review; Algorithm Analysis. Catie Baker Spring 2015
CSE373: Data Structures and Algorithms Lecture 3: Math Review; Algorithm Analysis Catie Baker Spring 2015 Today Registration should be done. Homework 1 due 11:59pm next Wednesday, April 8 th. Review math
More informationComputational Complexity
Computational Complexity (Lectures on Solution Methods for Economists II: Appendix) Jesús Fernández-Villaverde 1 and Pablo Guerrón 2 February 18, 2018 1 University of Pennsylvania 2 Boston College Computational
More informationComputational statistics
Computational statistics Combinatorial optimization Thierry Denœux February 2017 Thierry Denœux Computational statistics February 2017 1 / 37 Combinatorial optimization Assume we seek the maximum of f
More informationA pruning pattern list approach to the permutation flowshop scheduling problem
A pruning pattern list approach to the permutation flowshop scheduling problem Takeshi Yamada NTT Communication Science Laboratories, 2-4 Hikaridai, Seika-cho, Soraku-gun, Kyoto 619-02, JAPAN E-mail :
More informationSpin Glas Dynamics and Stochastic Optimization Schemes. Karl Heinz Hoffmann TU Chemnitz
Spin Glas Dynamics and Stochastic Optimization Schemes Karl Heinz Hoffmann TU Chemnitz 1 Spin Glasses spin glass e.g. AuFe AuMn CuMn nobel metal (no spin) transition metal (spin) 0.1-10 at% ferromagnetic
More information22c:145 Artificial Intelligence
22c:145 Artificial Intelligence Fall 2005 Informed Search and Exploration III Cesare Tinelli The University of Iowa Copyright 2001-05 Cesare Tinelli and Hantao Zhang. a a These notes are copyrighted material
More informationMAT 343 Laboratory 3 The LU factorization
In this laboratory session we will learn how to MAT 343 Laboratory 3 The LU factorization 1. Find the LU factorization of a matrix using elementary matrices 2. Use the MATLAB command lu to find the LU
More informationLesson 3: Networks and Matrix Arithmetic
Opening Exercise Suppose a subway line also connects the four cities. Here is the subway and bus line network. The bus routes connecting the cities are represented by solid lines, and the subway routes
More informationNondeterministic Polynomial Time
Nondeterministic Polynomial Time 11/1/2016 Discrete Structures (CS 173) Fall 2016 Gul Agha Slides based on Derek Hoiem, University of Illinois 1 2016 CS Alumni Awards Sohaib Abbasi (BS 78, MS 80), Chairman
More informationAM 121: Intro to Optimization Models and Methods Fall 2018
AM 121: Intro to Optimization Models and Methods Fall 2018 Lecture 11: Integer programming Yiling Chen SEAS Lesson Plan Integer programs Examples: Packing, Covering, TSP problems Modeling approaches fixed
More informationSimple numerical analysis of 2D Ising model
Simple numerical analysis of 2D Ising model Stefano Boccelli http://boccelliengineering.altervista.org Fall, 2015 1 Intro This document is about a little script I ve made one afternoon just to plot some
More informationFundamentals of Metaheuristics
Fundamentals of Metaheuristics Part I - Basic concepts and Single-State Methods A seminar for Neural Networks Simone Scardapane Academic year 2012-2013 ABOUT THIS SEMINAR The seminar is divided in three
More information1.5 Gaussian Elimination With Partial Pivoting.
Gaussian Elimination With Partial Pivoting In the previous section we discussed Gaussian elimination In that discussion we used equation to eliminate x from equations through n Then we used equation to
More informationA hybrid heuristic for minimizing weighted carry-over effects in round robin tournaments
A hybrid heuristic for minimizing weighted carry-over effects Allison C. B. Guedes Celso C. Ribeiro Summary Optimization problems in sports Preliminary definitions The carry-over effects minimization problem
More informationOverview. Optimization. Easy optimization problems. Monte Carlo for Optimization. 1. Survey MC ideas for optimization: (a) Multistart
Monte Carlo for Optimization Overview 1 Survey MC ideas for optimization: (a) Multistart Art Owen, Lingyu Chen, Jorge Picazo (b) Stochastic approximation (c) Simulated annealing Stanford University Intel
More informationDynamic Programming. Cormen et. al. IV 15
Dynamic Programming Cormen et. al. IV 5 Dynamic Programming Applications Areas. Bioinformatics. Control theory. Operations research. Some famous dynamic programming algorithms. Unix diff for comparing
More informationLocal Search & Optimization
Local Search & Optimization CE417: Introduction to Artificial Intelligence Sharif University of Technology Spring 2018 Soleymani Artificial Intelligence: A Modern Approach, 3 rd Edition, Chapter 4 Some
More informationEE 550: Notes on Markov chains, Travel Times, and Opportunistic Routing
EE 550: Notes on Markov chains, Travel Times, and Opportunistic Routing Michael J. Neely University of Southern California http://www-bcf.usc.edu/ mjneely 1 Abstract This collection of notes provides a
More informationSolving the Hamiltonian Cycle problem using symbolic determinants
Solving the Hamiltonian Cycle problem using symbolic determinants V. Ejov, J.A. Filar, S.K. Lucas & J.L. Nelson Abstract In this note we show how the Hamiltonian Cycle problem can be reduced to solving
More informationCS 310 Advanced Data Structures and Algorithms
CS 310 Advanced Data Structures and Algorithms Runtime Analysis May 31, 2017 Tong Wang UMass Boston CS 310 May 31, 2017 1 / 37 Topics Weiss chapter 5 What is algorithm analysis Big O, big, big notations
More information2.5 Powerful Tens. Table Puzzles. A Practice Understanding Task. 1. Use the tables to find the missing values of x:
2.5 Powerful Tens A Practice Understanding Task Table Puzzles 1. Use the tables to find the missing values of x: CC BY Eli Christman https://flic.kr/p/avcdhc a. b. x! = #$ % 1-2 100 1 10 50 100 3 1000
More informationThe Quadratic Assignment Problem
The Quadratic Assignment Problem Joel L. O. ; Lalla V. ; Mbongo J. ; Ali M. M. ; Tuyishimire E.; Sawyerr B. A. Supervisor Suriyakat W. (Not in the picture) (MISG 2013) QAP 1 / 30 Introduction Introduction
More informationCS 781 Lecture 9 March 10, 2011 Topics: Local Search and Optimization Metropolis Algorithm Greedy Optimization Hopfield Networks Max Cut Problem Nash
CS 781 Lecture 9 March 10, 2011 Topics: Local Search and Optimization Metropolis Algorithm Greedy Optimization Hopfield Networks Max Cut Problem Nash Equilibrium Price of Stability Coping With NP-Hardness
More informationPart III: Traveling salesman problems
Transportation Logistics Part III: Traveling salesman problems c R.F. Hartl, S.N. Parragh 1/282 Motivation Motivation Why do we study the TSP? c R.F. Hartl, S.N. Parragh 2/282 Motivation Motivation Why
More information8.5 Sequencing Problems
8.5 Sequencing Problems Basic genres. Packing problems: SET-PACKING, INDEPENDENT SET. Covering problems: SET-COVER, VERTEX-COVER. Constraint satisfaction problems: SAT, 3-SAT. Sequencing problems: HAMILTONIAN-CYCLE,
More informationGTOC 7 Team 12 Solution
GTOC 7 Team 12 Solution Telespazio Vega Deutschland GmbH (Germany) Holger Becker, Gianni Casonato, Bernard Godard, Olympia Kyriopoulos, Ganesh Lalgudi, Matteo Renesto Contact: bernard godard
More informationChapter 10 Nonlinear Models
Chapter 10 Nonlinear Models Nonlinear models can be classified into two categories. In the first category are models that are nonlinear in the variables, but still linear in terms of the unknown parameters.
More informationLocal search algorithms. Chapter 4, Sections 3 4 1
Local search algorithms Chapter 4, Sections 3 4 Chapter 4, Sections 3 4 1 Outline Hill-climbing Simulated annealing Genetic algorithms (briefly) Local search in continuous spaces (very briefly) Chapter
More informationTrees/Intro to counting
Trees/Intro to counting Russell Impagliazzo and Miles Jones Thanks to Janine Tiefenbruck http://cseweb.ucsd.edu/classes/sp16/cse21-bd/ April 29, 2016 Equivalence between rooted and unrooted trees Goal
More information12. LOCAL SEARCH. gradient descent Metropolis algorithm Hopfield neural networks maximum cut Nash equilibria
12. LOCAL SEARCH gradient descent Metropolis algorithm Hopfield neural networks maximum cut Nash equilibria Lecture slides by Kevin Wayne Copyright 2005 Pearson-Addison Wesley h ttp://www.cs.princeton.edu/~wayne/kleinberg-tardos
More informationTwo Dynamic Programming Methodologies in Very Large Scale Neighborhood Search Applied to the Traveling Salesman Problem
Two Dynamic Programming Methodologies in Very Large Scale Neighborhood Search Applied to the Traveling Salesman Problem Özlem Ergun Industrial and Systems Engineering, Georgia Institute of Technology,
More informationMICROCANONICAL OPTIMIZATION APPLIED TO THE TRAVELING SALESMAN PROBLEM
International Journal of Modern Physics C, Vol. 9, No. 1 (1998) 133 146 c World Scientific Publishing Company MICROCANONICAL OPTIMIZATION APPLIED TO THE TRAVELING SALESMAN PROBLEM ALEXANDRE LINHARES Computação
More informationTable 1 Principle Matlab operators and functions Name Description Page reference
Matlab Index Table 1 summarises the Matlab supplied operators and functions to which we have referred. In most cases only a few of the options available to the individual functions have been fully utilised.
More informationIn biological terms, memory refers to the ability of neural systems to store activity patterns and later recall them when required.
In biological terms, memory refers to the ability of neural systems to store activity patterns and later recall them when required. In humans, association is known to be a prominent feature of memory.
More informationSection Summary. Sequences. Recurrence Relations. Summations Special Integer Sequences (optional)
Section 2.4 Section Summary Sequences. o Examples: Geometric Progression, Arithmetic Progression Recurrence Relations o Example: Fibonacci Sequence Summations Special Integer Sequences (optional) Sequences
More informationLAB 1: MATLAB - Introduction to Programming. Objective:
LAB 1: MATLAB - Introduction to Programming Objective: The objective of this laboratory is to review how to use MATLAB as a programming tool and to review a classic analytical solution to a steady-state
More informationDecision Mathematics D2 Advanced/Advanced Subsidiary. Monday 1 June 2009 Morning Time: 1 hour 30 minutes
Paper Reference(s) 6690/01 Edexcel GCE Decision Mathematics D2 Advanced/Advanced Subsidiary Monday 1 June 2009 Morning Time: 1 hour 30 minutes Materials required for examination Nil Items included with
More informationTests for Two Coefficient Alphas
Chapter 80 Tests for Two Coefficient Alphas Introduction Coefficient alpha, or Cronbach s alpha, is a popular measure of the reliability of a scale consisting of k parts. The k parts often represent k
More informationOptimization Prof. A. Goswami Department of Mathematics Indian Institute of Technology, Kharagpur. Lecture - 20 Travelling Salesman Problem
Optimization Prof. A. Goswami Department of Mathematics Indian Institute of Technology, Kharagpur Lecture - 20 Travelling Salesman Problem Today we are going to discuss the travelling salesman problem.
More informationMd Momin Al Aziz. Analysis of Algorithms. Asymptotic Notations 3 COMP Computer Science University of Manitoba
Md Momin Al Aziz azizmma@cs.umanitoba.ca Computer Science University of Manitoba Analysis of Algorithms Asymptotic Notations 3 COMP 2080 Outline 1. Visualization 2. Little notations 3. Properties of Asymptotic
More informationNP and Computational Intractability
NP and Computational Intractability 1 Polynomial-Time Reduction Desiderata'. Suppose we could solve X in polynomial-time. What else could we solve in polynomial time? don't confuse with reduces from Reduction.
More informationPart B" Ants (Natural and Artificial)! Langton s Vants" (Virtual Ants)! Vants! Example! Time Reversibility!
Part B" Ants (Natural and Artificial)! Langton s Vants" (Virtual Ants)! 11/14/08! 1! 11/14/08! 2! Vants!! Square grid!! Squares can be black or white!! Vants can face N, S, E, W!! Behavioral rule:!! take
More informationLocal search and agents
Artificial Intelligence Local search and agents Instructor: Fabrice Popineau [These slides adapted from Stuart Russell, Dan Klein and Pieter Abbeel @ai.berkeley.edu] Local search algorithms In many optimization
More informationSimulated Annealing SURFACE. Syracuse University
Syracuse University SURFACE Electrical Engineering and Computer Science Technical Reports College of Engineering and Computer Science 6-1992 Simulated Annealing Per Brinch Hansen Syracuse University, School
More informationOutline. 15. Descriptive Summary, Design, and Inference. Descriptive summaries. Data mining. The centroid
Outline 15. Descriptive Summary, Design, and Inference Geographic Information Systems and Science SECOND EDITION Paul A. Longley, Michael F. Goodchild, David J. Maguire, David W. Rhind 2005 John Wiley
More informationTransportation Problem
Transportation Problem. Production costs at factories F, F, F and F 4 are Rs.,, and respectively. The production capacities are 0, 70, 40 and 0 units respectively. Four stores S, S, S and S 4 have requirements
More informationComputer Science 385 Analysis of Algorithms Siena College Spring Topic Notes: Limitations of Algorithms
Computer Science 385 Analysis of Algorithms Siena College Spring 2011 Topic Notes: Limitations of Algorithms We conclude with a discussion of the limitations of the power of algorithms. That is, what kinds
More informationHill climbing: Simulated annealing and Tabu search
Hill climbing: Simulated annealing and Tabu search Heuristic algorithms Giovanni Righini University of Milan Department of Computer Science (Crema) Hill climbing Instead of repeating local search, it is
More informationProject Two. James K. Peterson. March 26, Department of Biological Sciences and Department of Mathematical Sciences Clemson University
Project Two James K. Peterson Department of Biological Sciences and Department of Mathematical Sciences Clemson University March 26, 2019 Outline 1 Cooling Models 2 Estimating the Cooling Rate k 3 Typical
More informationSmall Traveling Salesman Problems
Journal of Advances in Applied Mathematics, Vol. 2, No. 2, April 2017 https://dx.doi.org/10.22606/jaam.2017.22003 101 Small Traveling Salesman Problems Richard H. Warren Retired: Lockheed Martin Corporation,
More informationAlgorithms and Complexity Theory. Chapter 8: Introduction to Complexity. Computer Science - Durban - September 2005
Algorithms and Complexity Theory Chapter 8: Introduction to Complexity Jules-R Tapamo Computer Science - Durban - September 2005 Contents 1 Introduction 2 1.1 Dynamic programming...................................
More informationMatt Heavner CSE710 Fall 2009
Matt Heavner mheavner@buffalo.edu CSE710 Fall 2009 Problem Statement: Given a set of cities and corresponding locations, what is the shortest closed circuit that visits all cities without loops?? Fitness
More informationA =, where d n w = dw
Chapter 9 Monte Carlo Simulations So far we have either dealt with exactly soluble systems like the (time-dependent) oscillator or with various expansions like the semiclassical, perturbative and high-temperature
More informationHavrda and Charvat Entropy Based Genetic Algorithm for Traveling Salesman Problem
3 IJCSNS International Journal of Computer Science and Network Security, VOL.8 No.5, May 008 Havrda and Charvat Entropy Based Genetic Algorithm for Traveling Salesman Problem Baljit Singh, Arjan Singh
More information