Fall 2003 BMI 226 / CS 426 LIMITED VALIDITY STRUCTURES

Similar documents
Lecture 15: Genetic Algorithms

Crossover Techniques in GAs

Stochastic Search: Part 2. Genetic Algorithms. Vincent A. Cicirello. Robotics Institute. Carnegie Mellon University

Evolutionary Computation: introduction

Havrda and Charvat Entropy Based Genetic Algorithm for Traveling Salesman Problem

Problem info Geometry model Labelled Objects Results Nonlinear dependencies

Matt Heavner CSE710 Fall 2009

22c:145 Artificial Intelligence

NP and Computational Intractability

Computational statistics

Local search algorithms. Chapter 4, Sections 3 4 1

Local Search & Optimization

CS 380: ARTIFICIAL INTELLIGENCE

Design Optimization of an Electronic Component with an Evolutionary Algorithm Using the COMSOL-MATLAB LiveLink

Local Search & Optimization

Algorithm Design Strategies V

Alternating Current Circuits. Home Work Solutions

Switched Capacitor Circuits I. Prof. Paul Hasler Georgia Institute of Technology

Koza s Algorithm. Choose a set of possible functions and terminals for the program.

Evolutionary computation

Introduction. Genetic Algorithm Theory. Overview of tutorial. The Simple Genetic Algorithm. Jonathan E. Rowe

8.3 Hamiltonian Paths and Circuits

Genetic Algorithm approach to Solve Shortest Path and Travelling Salesman Problem

Lecture 22. Introduction to Genetic Algorithms

The Role of Crossover in Genetic Algorithms to Solve Optimization of a Function Problem Falih Hassan

x 2 i 10 cos(2πx i ). i=1

Local Beam Search. CS 331: Artificial Intelligence Local Search II. Local Beam Search Example. Local Beam Search Example. Local Beam Search Example

Lecture 5: Linear Genetic Programming

Genetic Engineering and Creative Design

Artificial Intelligence Methods (G5BAIM) - Examination

Overview. Optimization. Easy optimization problems. Monte Carlo for Optimization. 1. Survey MC ideas for optimization: (a) Multistart

GENETIC ALGORITHM FOR CELL DESIGN UNDER SINGLE AND MULTIPLE PERIODS

Fundamentals of Genetic Algorithms

Feasibility-Preserving Crossover for Maximum k-coverage Problem

Evolutionary computation

V. Evolutionary Computing. Read Flake, ch. 20. Genetic Algorithms. Part 5A: Genetic Algorithms 4/10/17. A. Genetic Algorithms

[Read Chapter 9] [Exercises 9.1, 9.2, 9.3, 9.4]

Evolutionary Computation. Algorytmy Niedeterministyczne II. Evolutionary Computation. Evolutionary Computation. Evolutionary Computation

NP-completeness. Chapter 34. Sergey Bereg

Chapter 10 AC Analysis Using Phasors

Lecture 4: NP and computational intractability

Search. Search is a key component of intelligent problem solving. Get closer to the goal if time is not enough

Evolutionary Computation

Local search algorithms. Chapter 4, Sections 3 4 1

Genetic Algorithms & Modeling

8.5 Sequencing Problems

Optimization Prof. A. Goswami Department of Mathematics Indian Institute of Technology, Kharagpur. Lecture - 20 Travelling Salesman Problem

Gecco 2007 Tutorial / Grammatical Evolution

Summary. AIMA sections 4.3,4.4. Hill-climbing Simulated annealing Genetic algorithms (briey) Local search in continuous spaces (very briey)

Comparison of Evolutionary Methods for. Smoother Evolution. 2-4 Hikaridai, Seika-cho. Soraku-gun, Kyoto , JAPAN

Evolutionary Computation. DEIS-Cesena Alma Mater Studiorum Università di Bologna Cesena (Italia)

Prof. Shayla Sawyer CP08 solution

TUTORIAL: HYPER-HEURISTICS AND COMPUTATIONAL INTELLIGENCE

This observation leads to the following algorithm.

Methods for finding optimal configurations

July 18, Approximation Algorithms (Travelling Salesman Problem)

Homework Assignment 11

Adaptive Generalized Crowding for Genetic Algorithms

Limits to Approximability: When Algorithms Won't Help You. Note: Contents of today s lecture won t be on the exam

VIII. NP-completeness

Polynomial-Time Reductions

Algorithms and Complexity Theory. Chapter 8: Introduction to Complexity. Computer Science - Durban - September 2005

Fall 2003 BMI 226 / CS 426 Notes C-1 INTRODUCTION TO GENETIC ALGORITHMS

SINUSOIDAL STEADY STATE CIRCUIT ANALYSIS

2005 AP PHYSICS C: ELECTRICITY AND MAGNETISM FREE-RESPONSE QUESTIONS

Genetic Algorithm. Outline

Chapter 8: Introduction to Evolutionary Computation

Algorithms, Lecture 3 on NP : Nondeterminis7c Polynomial Time

An Effective Chromosome Representation for Evolving Flexible Job Shop Schedules

AC Circuits Homework Set

Hamiltonian Cycle. Hamiltonian Cycle

ESE319 Introduction to Microelectronics Common Emitter BJT Amplifier

V. Evolutionary Computing. Read Flake, ch. 20. Assumptions. Genetic Algorithms. Fitness-Biased Selection. Outline of Simplified GA

Evolutionary Trees. Evolutionary tree. To describe the evolutionary relationship among species A 3 A 2 A 4. R.C.T. Lee and Chin Lung Lu

DETECTING THE FAULT FROM SPECTROGRAMS BY USING GENETIC ALGORITHM TECHNIQUES

how should the GA proceed?

Today. 1/25/11 Physics 262 Lecture 2 Filters. Active Components and Filters. Homework. Lab 2 this week

IV. Evolutionary Computing. Read Flake, ch. 20. Assumptions. Genetic Algorithms. Fitness-Biased Selection. Outline of Simplified GA

NP-Complete Reductions 2

Chapter 4 Beyond Classical Search 4.1 Local search algorithms and optimization problems

Advanced Implementations of Tables: Balanced Search Trees and Hashing

EE100Su08 Lecture #9 (July 16 th 2008)

Algorithms and Theory of Computation. Lecture 22: NP-Completeness (2)

CS 320, Fall Dr. Geri Georg, Instructor 320 NP 1

Warm-up Find the shortest trip (total distance) starting and ending in Chicago and visiting each other city once.

On Enhancing Genetic Algorithms Using New Crossovers

A) Introduction to the Simple Genetic Algorithm. B) Applications I: Applying Genetic Algorithms to Tackle NP-hard Problems.

SAT, Coloring, Hamiltonian Cycle, TSP

Evolutionary Algorithms: Introduction. Department of Cybernetics, CTU Prague.

Genetic Algorithms. Seth Bacon. 4/25/2005 Seth Bacon 1

Unit 1A: Computational Complexity

Generalized Analysis for ZCS

Intelligens Számítási Módszerek Genetikus algoritmusok, gradiens mentes optimálási módszerek

Travelling Salesman Problem

New rubric: AI in the news

Genetic Algorithms. Donald Richards Penn State University

ECE2262 Electric Circuits. Chapter 1: Basic Concepts. Overview of the material discussed in ENG 1450

Electrical Circuits I

OPTIMAL CAPACITORS PLACEMENT IN DISTRIBUTION NETWORKS USING GENETIC ALGORITHM: A DIMENSION REDUCING APPROACH

Core Technology Group Application Note 3 AN-3

Transcription:

Notes III-1 LIMITED VALIDITY STRUCTURES

Notes III-2 TRAVELING SALESPERSON PROBLEM (TSP) Given a (symmetric) matrix of distances between N cities Salesperson is to visit each city once and only once Goal is to minimize total distance traveling

Notes III-3 TRAVELING SALESPERSON PROBLEM (TSP) A tour can be represented by a permutation The items in the chromosome are always the same. Fitness does not depend on contents of the chromosome. Instead, it depends on the order of the items in the chromosome.

Notes III-4 NAÏVE CROSSOVER IN TSP PARENTS Tour A 9 8 4 5 6 7 1 3 1 10 B 8 7 1 2 3 10 9 5 4 6 OFFSPRING (ONE CROSSOVER POINT BETWEEN 3 AND 4) Tour C 9 8 4 2 3 10 9 5 4 6 D 8 7 1 5 6 7 1 3 1 10

Notes III-5 NAÏVE CROSSOVER IN TSP CONTINUED Syntactic invalidity

Deletion Penalization Repair Notes III-6 POSSIBLE REMEDIES

Notes III-7 PROBLEMS WITH TWO OF THESE POSSIBLE REMEDIES The number of permutations is very much smaller than the possible strings L! < < L L Therefore, almost everything is deleted or penalized Nothing left When everything is penalized, then, in effect, nothing is penalized

Notes III-8 BUILDING BLOCKS FOR TSP A sub-tour from a relatively fit individual is a candidate for a good building block

Notes III-9 PARTIALLY MATCHED CROSSOVER (PMX) (GOLDBERG GASOML, CHAPTER 5) PARENTS Tour A 9 8 4 5 6 7 1 3 2 10 B 8 7 1 2 3 10 9 5 4 6 STEP 1: PMX OFFSPRING (CROSSOVER POINTS BETWEEN 3-4 AND 6-7) Tour C 2 3 10 D 5 6 7 STEP 2: PMX OFFSPRING (REPAIR 1 ST OFFSPRING) Tour C 9 8 4 2 3 10 1 6 5 7 D 5 6 7 STEP 2: PMX OFFSPRING (REPAIR 2 ND OFFSPRING) Tour C 9 8 4 2 3 10 1 6 5 7 D 8 10 1 5 6 7 9 2 4 5

Notes III-10 EVOLVED CAMPBELL FILTER CASCADE OF 6π SECTIONS U. S. PATENT 1,227,113

Notes III-11 CIRCUIT CONSISTING OF ONE T- SECTION 1 Voltage 0.5 0 1Hz 10Hz 100Hz 1kHz 10kHz 100kHz Frequency

Notes III-12 CIRCUIT CONSISTING OF TWO T- SECTIONS 1 Voltage 0.5 0 1Hz 10Hz 100Hz 1kHz 10kHz 100kHz Frequency

Notes III-13 CIRCUIT CONSISTING OF SIX T- SECTIONS 1 Voltage 0.5 0 1Hz 10Hz 100Hz 1kHz 10kHz 100kHz Frequency

Notes III-14 ILLUSTRATIVE NAÏVE CROSSOVER FIRST PARENT GA CHROMOSOME OF 1 ST PARENT L 106 2 6 W 0 6 7 C 186 7 0 W 0 7 8 L 106 8 9 W 0 9 The chromosome of the 1 st parent codes for a single T- section that contains two inductors (L1 and L2) and one capacitor (C1).

Notes III-15 ILLUSTRATIVE NAÏVE CROSSOVER SECOND PARENT GA CHROMOSOME OF 2 ND PARENT W 0 8 6 W 0 9 3 W 0 7 8 L 10 6 6 9 C 18 6 8 0 L 10 6 2 The chromosome of the 2 nd parent codes for a single T-section that contains two inductors (L3 and L4) and one capacitor (C2). This individual is functionally equivalent to the first parent.

Notes III-16 ILLUSTRATIVE NAÏVE CROSSOVER RESULT OF THE NAÏVE CROSSOVER (WITH THE CROSSOVER POINT AT THE RIGHT OF THE 12 TH GENE) L 105. 5 ONE OFFSPRING 2 6 W 0 6 7 C 18 6 7 0 L 106 6 9 C 18 6 8 0 L 106

Notes III-17 ILLUSTRATIVE CROSSOVER RESULT OF NAÏVE CROSSOVER CONTINUED The offspring circuit contains three inductors and two capacitors. Components L6 and C3 originate from the 1 st parent (where they were called L1 and C1, respectively). Components L5, L7, and C4 originate from the 2 nd parent (where they were called L3, L4, and C2 respectively). After the crossover, one end (node 9) of the inductor L7 is left dangling. Similarly, one end (node 8) of the capacitor C4 is also dangling. Moreover, the offspring has no connection to the output probe point VOUT. Because the offspring is syntactically invalid, a mechanism must now be invoked to repair it.

Notes III-18

Notes III-19 NAÏVE CROSSOVER IN TSP CONTINUED Syntactic invalidity

Deletion Penalization Repair Notes III-20 POSSIBLE REMEDIES

Notes III-21 THE PROBLEM WITH REPAIR Repair usually amounts to mutation

Notes III-22 CROSSOVER V. MUTATION COMPARISON OF CROSSOVER, MUTATION, AND BLIND RANDOM Blind random search Mutation Crossover SEARCH Remainder comes from a randomly chosen subtree of a random parent from current generation 0. fitness-selected parent from current generation i. fitness-selected parent from current generation i. Fragment comes from a randomly chosen subtree of a random parent from current generation 0. random parent from generation 0. fitness-selected parent from current generation i.

Notes III-23 SEARCH SPACE FOR THE HAMBURGER RESTAURANT PROBLEM 010 *10 110 01* 11* 011 *11 1*0 1*1 0*1 111 0*0 *00 100 10* *01 101 00* 000 001

Notes III-24 GEOMETRIC INTERPRETATION OF THE MUTATION OPERATION The single parent is 011 The 3 possible offspring for a single mutation are 001, 010, or 111 The 3 possible offspring are Hamming distance 1 from the parent 110 111 010 Line 01* 011 Line *11 100 Line 0*1 101 000 001

Notes III-25 GEOMETRIC INTERPRETATION OF THE CROSSOVER OPERATION The parents are 110 and 011 The crossover point is between 2 nd and 3 rd positions in the chromosome Offspring 111 lies at intersection of schema 11* and **1 110 Line 11* 111 010 011 011 Plane **1 100 101 000 001