Implementation and performance of selected evolutionary algorithms

Size: px
Start display at page:

Download "Implementation and performance of selected evolutionary algorithms"

Transcription

1 Research Center at the Department for Applied Geology Peter Bayer, Claudius Buerger, Michael Finkel Implementation and performance of selected evolutionary algorithms... for the tuning of groundwater remediation systems Support for this project is provided by the German Department of Education, Science, Research and Technology (BMBF), Contract No. 02WR0195.

2 Overview NEWS - Advective control: heuristic optimization of particle tracking problems - Binary and real coded decision parameters: SGA vs. DES - Hydraulic/economic optimization of Pump-and-Treat and Funnel-and-Gate systems

3 Capture zone evaluation criteria for pump-and-treat (cp. Mulligan & Ahlfeld 1999) Concentration control? - (Accurate) Transport model of contaminant site required. - Evaluation of system performance by logging contaminant concentrations at compliance areas or at hypothetical monitoring wells - Adaptation of contaminant pumping wells: minimum pumping rate, minimum operation time.

4 Capture zone evaluation criteria for pump-and-treat (cp. Mulligan & Ahlfeld 1999) Hydraulic control? - Hydraulic and/or transport model of contaminant site required. - Evaluation of system performance by ensuring gradient/velocity constraints at selected control points (pre-definition of optimal capture zone, downgradient control hardly possible). - Adaptation of contaminant pumping wells: minimum pumping rate, minimum operation time. - Relatively fast method.

5 Capture zone evaluation criteria for pump-and-treat (cp. Mulligan & Ahlfeld 1999) Advective control? - Hydraulic model of contaminant site required. - Evaluation of system performance by tracking particles at selected control points. - Adaptation of contaminant pumping wells: minimum pumping rate. - Relatively fast method.

6 Advective control vs. alternative methods Only direct method, optimal well configuration not predefined. Source of uncertainty: hydraulic description, delineation of contaminated zone. Can also be used for optimization of wells with time-related capture zones or recharge areas Problem: natural heterogeneous aquifers lead to highly nonlinear relationship between well positions, pumping rates and the degree of capture.

7 Example problem: heterogeneous aquifer, 1 well hydr. conductivity distribution zone to be captured well placement area q 1 K f = 10E-2 m/s K f = 10E-3 m/s K f = 10E-5 m/s y 1 optimal well position of 1-well case x 1 groundwater flow direction

8 Minimum pumping rate distribution (1 well) 80 hydr. conductivity distribution K f = 10E-2 m/s K f = 10E-3 m/s row K f = 10E-5 m/s optimal well position of well case groundwater flow direction column

9 Explicit formulation of multi-criterion objective function J = min f(q 1..N, x 1..N, y 1..N ) f = f q (q 1..N ) p (q 1..N, x 1..N, y 1..N ) cost term penalty term calculation by (non)linear/economic model containment? computation by numerical model p = ν(q 1..N, x 1..N, y 1..N ) ν : relative number of captured particles p = ν e.g., exponential penalty term

10 Objective function solver: requirements! Objective function is not differentiable! Objective function is supposed to have various local optima! Flexible applicability to high dimensional problems (e.g. 4 wells: D = 12) Heuristic techniques: - solve problems with rules-of-thumb or common sense rules - typically transformed from another science field Evolutionary algorithms analogies to evolutionary processes Simulated annealing simulation of heating and cooling of metal Tabu search Inspired by random elements of human behavior

11 Evolutionary algorithms: operators initialization of population evaluation of objective function fitness (f) new population recombination mutation selection STOP?

12 Two variants: Representation GENETIC ALGORITHM (SGA) EVOLUTION STRATEGY (DES) binary real valued x w y w q w... q w y w x w

13 Two variants: Mutation GENETIC ALGORITHM (SGA) EVOLUTION STRATEGY (DES) flipping bits Mutation follows n-dimensional probability density function with adapted standard derivation (= mutation step size) Individual I x w y w q w... q w Individual I 1 * y w x w y w q w x w

14 Two variants: Recombination GENETIC ALGORITHM (SGA) EVOLUTION STRATEGY (DES) binary real valued, multi-parent Individual I 1 * x w y w q w... q w * Individual I y w x w y w q w... x w

15 Derandomized Evolution Strategies (cp. Hansen & Ostermeier 2001; Hansen et al. 2003) - Features: Self-adaptive mutative step size control; weighted/intermediate multi-parent recombination, `cumulation`; `CMA` - Applicability: Efficient for non-linear, badly scaled, high dimensional problems - Questions: Suitable for advective control problem with both discrete & real valued object parameters? Maximum number of iterations? Stop criterion?

16 Application to example site DES vs. SGA evolutionary search is stochastic: 50 randomly initialized equal optimization runs with predefined number of model calls setting of decision variable limits: pumping rate maximum is set case-specific or automatically (boundary update) objective values: pre-selected optimal values of pumping rate are set as objective values fov some configurations are called more than once for the SGA bookkeeping is conducted (Bayer & Finkel, Water Resour. Res. 2004)

17 1-well case MR fov : calculated average model runs required to find a solution for a selected objective value fov. cum. frequency φ i,fov [%] a) b) fov = 7.2 m³/d 80 SGA (bookk.) SGA (no bookk.) DES model run i fov = 7.5 m³/d model run i c) fov = 8.6 m³/d model run i 5 optimization runs á 350 model calls MR fov = 1750 model calls

18 4-well case: SGA MR fov 10 5 bookkeeping no bookkeeping No solution found! (+ boundary update) 10 4 pop SGA = 300 p c = pop SGA = 75 p c = fov [m³/d]

19 4-well case: DES 10 5 MR fov update pioneer 10 4 (5 I,11)-DES 4 optimization runs á 1,400 model calls MR fov = 5,600 model calls (5 W,11)-DES fov [m³/d]

20 Conclusions: DES m³/d 8 7 Increasing the number of wells reduces the minimum total pumping rate total pumping rate Increasing the complexity leads to a ~ linear increase of required model runs total number of model runs number of wells number of wells

21 Funnel-and-gate: Plume capture by advective control groundwater flow particle not captured particle captured source FGS design captures n cap particles source zone outlined by n part particles

22 Funnel-and-gate: objective function example Cost = (2 Σl g +Σw f ) C f +2 Σw g C g +Σ(w g l g ) C reac where C f : C g : C reac : unit funnel costs unit gate costs unit reactive material cost plume capture constraint honoured by exponential penalty term: fit = where a,b,c > 0 : n part : n cap : Cost a^((b ((n part /n cap )-1))^c), if n cap 0 inf, otherwise to be selected according to the range of the unit costs number of tracked particles number of particles captured

23 Funnel-and-gate: uncertainty in transmissivity Additional constraint: One design fits all? aquifer realization i source natural aquifer heterogeneity creates uncertain description of flow field multiple equiprobable aquifer realizations as part of the objective function fit = max (fit i,i = 1,..,5)

24 Funnel-and-gate: optimization with DES DES results: dim N=6 2-Gates fit min =75056 dim N=4 1-Gate dim N=8 4-Gates y fit min =87427 fit min =72025 x (only x-axis is to scale)

25 Conclusions Advantages of DES - More robust & efficient, less stochastic & less model runs than SGA - More suitable for in case of real valued object parameters, applicability in case of discrete object parameters - Relevance of object parameter limits reduced by self adaptation Lessons learnt + Outlook - Number of model runs scales ~linear with problem dimension for DES - Efficiency of boundary update: additional use of available information - Limitations for DES in case of hard discretisized problem formulations? Further inspection of applicability for Funnel&Gates Systems - Missing: Requirement of stop criterion for practical use

Optimization of high reliability based hydrological design problems by robust automatic sampling of critical model realizations

Optimization of high reliability based hydrological design problems by robust automatic sampling of critical model realizations Click Here for Full Article WATER RESOURCES RESEARCH, VOL. 46,, doi:10.1029/2009wr008081, 2010 Optimization of high reliability based hydrological design problems by robust automatic sampling of critical

More information

CSC 4510 Machine Learning

CSC 4510 Machine Learning 10: Gene(c Algorithms CSC 4510 Machine Learning Dr. Mary Angela Papalaskari Department of CompuBng Sciences Villanova University Course website: www.csc.villanova.edu/~map/4510/ Slides of this presenta(on

More information

Introduction to Optimization

Introduction to Optimization Introduction to Optimization Blackbox Optimization Marc Toussaint U Stuttgart Blackbox Optimization The term is not really well defined I use it to express that only f(x) can be evaluated f(x) or 2 f(x)

More information

The Genetic Algorithm is Useful to Fitting Input Probability Distributions for Simulation Models

The Genetic Algorithm is Useful to Fitting Input Probability Distributions for Simulation Models The Genetic Algorithm is Useful to Fitting Input Probability Distributions for Simulation Models Johann Christoph Strelen Rheinische Friedrich Wilhelms Universität Bonn Römerstr. 164, 53117 Bonn, Germany

More information

5. Simulated Annealing 5.1 Basic Concepts. Fall 2010 Instructor: Dr. Masoud Yaghini

5. Simulated Annealing 5.1 Basic Concepts. Fall 2010 Instructor: Dr. Masoud Yaghini 5. Simulated Annealing 5.1 Basic Concepts Fall 2010 Instructor: Dr. Masoud Yaghini Outline Introduction Real Annealing and Simulated Annealing Metropolis Algorithm Template of SA A Simple Example References

More information

Lecture 9 Evolutionary Computation: Genetic algorithms

Lecture 9 Evolutionary Computation: Genetic algorithms Lecture 9 Evolutionary Computation: Genetic algorithms Introduction, or can evolution be intelligent? Simulation of natural evolution Genetic algorithms Case study: maintenance scheduling with genetic

More information

Bioinformatics: Network Analysis

Bioinformatics: Network Analysis Bioinformatics: Network Analysis Model Fitting COMP 572 (BIOS 572 / BIOE 564) - Fall 2013 Luay Nakhleh, Rice University 1 Outline Parameter estimation Model selection 2 Parameter Estimation 3 Generally

More information

Metaheuristics and Local Search

Metaheuristics and Local Search Metaheuristics and Local Search 8000 Discrete optimization problems Variables x 1,..., x n. Variable domains D 1,..., D n, with D j Z. Constraints C 1,..., C m, with C i D 1 D n. Objective function f :

More information

Metaheuristics and Local Search. Discrete optimization problems. Solution approaches

Metaheuristics and Local Search. Discrete optimization problems. Solution approaches Discrete Mathematics for Bioinformatics WS 07/08, G. W. Klau, 31. Januar 2008, 11:55 1 Metaheuristics and Local Search Discrete optimization problems Variables x 1,...,x n. Variable domains D 1,...,D n,

More information

Evolutionary computation

Evolutionary computation Evolutionary computation Andrea Roli andrea.roli@unibo.it DEIS Alma Mater Studiorum Università di Bologna Evolutionary computation p. 1 Evolutionary Computation Evolutionary computation p. 2 Evolutionary

More information

Evolutionary Computation. DEIS-Cesena Alma Mater Studiorum Università di Bologna Cesena (Italia)

Evolutionary Computation. DEIS-Cesena Alma Mater Studiorum Università di Bologna Cesena (Italia) Evolutionary Computation DEIS-Cesena Alma Mater Studiorum Università di Bologna Cesena (Italia) andrea.roli@unibo.it Evolutionary Computation Inspiring principle: theory of natural selection Species face

More information

An Evolutionary Programming Based Algorithm for HMM training

An Evolutionary Programming Based Algorithm for HMM training An Evolutionary Programming Based Algorithm for HMM training Ewa Figielska,Wlodzimierz Kasprzak Institute of Control and Computation Engineering, Warsaw University of Technology ul. Nowowiejska 15/19,

More information

Covariance Matrix Adaptation in Multiobjective Optimization

Covariance Matrix Adaptation in Multiobjective Optimization Covariance Matrix Adaptation in Multiobjective Optimization Dimo Brockhoff INRIA Lille Nord Europe October 30, 2014 PGMO-COPI 2014, Ecole Polytechnique, France Mastertitelformat Scenario: Multiobjective

More information

Minimization of Energy Loss using Integrated Evolutionary Approaches

Minimization of Energy Loss using Integrated Evolutionary Approaches Minimization of Energy Loss using Integrated Evolutionary Approaches Attia A. El-Fergany, Member, IEEE, Mahdi El-Arini, Senior Member, IEEE Paper Number: 1569614661 Presentation's Outline Aim of this work,

More information

Zebo Peng Embedded Systems Laboratory IDA, Linköping University

Zebo Peng Embedded Systems Laboratory IDA, Linköping University TDTS 01 Lecture 8 Optimization Heuristics for Synthesis Zebo Peng Embedded Systems Laboratory IDA, Linköping University Lecture 8 Optimization problems Heuristic techniques Simulated annealing Genetic

More information

PBEE Design Methods KHALID M. MOSALAM, PROFESSOR & SELIM GÜNAY, POST-DOC UNIVERSITY OF CALIFORNIA, BERKELEY

PBEE Design Methods KHALID M. MOSALAM, PROFESSOR & SELIM GÜNAY, POST-DOC UNIVERSITY OF CALIFORNIA, BERKELEY PBEE Design Methods KHALID M. MOSALAM, PROFESSOR & SELIM GÜNAY, POST-DOC UNIVERSITY OF CALIFORNIA, BERKELEY Outline 1.Introduction 2. 3.Non optimization-based methods 2 Introduction Courtesy of Prof. S.

More information

Tuning Parameters across Mixed Dimensional Instances: A Performance Scalability Study of Sep-G-CMA-ES

Tuning Parameters across Mixed Dimensional Instances: A Performance Scalability Study of Sep-G-CMA-ES Université Libre de Bruxelles Institut de Recherches Interdisciplinaires et de Développements en Intelligence Artificielle Tuning Parameters across Mixed Dimensional Instances: A Performance Scalability

More information

Three Steps toward Tuning the Coordinate Systems in Nature-Inspired Optimization Algorithms

Three Steps toward Tuning the Coordinate Systems in Nature-Inspired Optimization Algorithms Three Steps toward Tuning the Coordinate Systems in Nature-Inspired Optimization Algorithms Yong Wang and Zhi-Zhong Liu School of Information Science and Engineering Central South University ywang@csu.edu.cn

More information

ARTIFICIAL NEURAL NETWORK WITH HYBRID TAGUCHI-GENETIC ALGORITHM FOR NONLINEAR MIMO MODEL OF MACHINING PROCESSES

ARTIFICIAL NEURAL NETWORK WITH HYBRID TAGUCHI-GENETIC ALGORITHM FOR NONLINEAR MIMO MODEL OF MACHINING PROCESSES International Journal of Innovative Computing, Information and Control ICIC International c 2013 ISSN 1349-4198 Volume 9, Number 4, April 2013 pp. 1455 1475 ARTIFICIAL NEURAL NETWORK WITH HYBRID TAGUCHI-GENETIC

More information

Three Steps toward Tuning the Coordinate Systems in Nature-Inspired Optimization Algorithms

Three Steps toward Tuning the Coordinate Systems in Nature-Inspired Optimization Algorithms Three Steps toward Tuning the Coordinate Systems in Nature-Inspired Optimization Algorithms Yong Wang and Zhi-Zhong Liu School of Information Science and Engineering Central South University ywang@csu.edu.cn

More information

GENETIC ALGORITHM FOR CELL DESIGN UNDER SINGLE AND MULTIPLE PERIODS

GENETIC ALGORITHM FOR CELL DESIGN UNDER SINGLE AND MULTIPLE PERIODS GENETIC ALGORITHM FOR CELL DESIGN UNDER SINGLE AND MULTIPLE PERIODS A genetic algorithm is a random search technique for global optimisation in a complex search space. It was originally inspired by an

More information

Hill climbing: Simulated annealing and Tabu search

Hill climbing: Simulated annealing and Tabu search Hill climbing: Simulated annealing and Tabu search Heuristic algorithms Giovanni Righini University of Milan Department of Computer Science (Crema) Hill climbing Instead of repeating local search, it is

More information

An artificial chemical reaction optimization algorithm for. multiple-choice; knapsack problem.

An artificial chemical reaction optimization algorithm for. multiple-choice; knapsack problem. An artificial chemical reaction optimization algorithm for multiple-choice knapsack problem Tung Khac Truong 1,2, Kenli Li 1, Yuming Xu 1, Aijia Ouyang 1, and Xiaoyong Tang 1 1 College of Information Science

More information

Local Search (Greedy Descent): Maintain an assignment of a value to each variable. Repeat:

Local Search (Greedy Descent): Maintain an assignment of a value to each variable. Repeat: Local Search Local Search (Greedy Descent): Maintain an assignment of a value to each variable. Repeat: I I Select a variable to change Select a new value for that variable Until a satisfying assignment

More information

A0M33EOA: EAs for Real-Parameter Optimization. Differential Evolution. CMA-ES.

A0M33EOA: EAs for Real-Parameter Optimization. Differential Evolution. CMA-ES. A0M33EOA: EAs for Real-Parameter Optimization. Differential Evolution. CMA-ES. Petr Pošík Czech Technical University in Prague Faculty of Electrical Engineering Department of Cybernetics Many parts adapted

More information

Set-based Min-max and Min-min Robustness for Multi-objective Robust Optimization

Set-based Min-max and Min-min Robustness for Multi-objective Robust Optimization Proceedings of the 2017 Industrial and Systems Engineering Research Conference K. Coperich, E. Cudney, H. Nembhard, eds. Set-based Min-max and Min-min Robustness for Multi-objective Robust Optimization

More information

Data Warehousing & Data Mining

Data Warehousing & Data Mining 13. Meta-Algorithms for Classification Data Warehousing & Data Mining Wolf-Tilo Balke Silviu Homoceanu Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de 13.

More information

Uncertainty and data worth analysis for the hydraulic design of funnel-and-gate systems in heterogeneous aquifers

Uncertainty and data worth analysis for the hydraulic design of funnel-and-gate systems in heterogeneous aquifers WATER RESOURCES RESEARCH, VOL. 40,, doi:10.109/004wr00335, 004 Uncertainty and data worth analysis for the hydraulic design of funnel-and-gate systems in heterogeneous aquifers Olaf A. Cirpka, 1 Claudius

More information

Geometric Semantic Genetic Programming (GSGP): theory-laden design of semantic mutation operators

Geometric Semantic Genetic Programming (GSGP): theory-laden design of semantic mutation operators Geometric Semantic Genetic Programming (GSGP): theory-laden design of semantic mutation operators Andrea Mambrini 1 University of Birmingham, Birmingham UK 6th June 2013 1 / 33 Andrea Mambrini GSGP: theory-laden

More information

Overview. Optimization. Easy optimization problems. Monte Carlo for Optimization. 1. Survey MC ideas for optimization: (a) Multistart

Overview. Optimization. Easy optimization problems. Monte Carlo for Optimization. 1. Survey MC ideas for optimization: (a) Multistart Monte Carlo for Optimization Overview 1 Survey MC ideas for optimization: (a) Multistart Art Owen, Lingyu Chen, Jorge Picazo (b) Stochastic approximation (c) Simulated annealing Stanford University Intel

More information

Finding optimal configurations ( combinatorial optimization)

Finding optimal configurations ( combinatorial optimization) CS 1571 Introduction to AI Lecture 10 Finding optimal configurations ( combinatorial optimization) Milos Hauskrecht milos@cs.pitt.edu 539 Sennott Square Constraint satisfaction problem (CSP) Constraint

More information

4.11 Groundwater model

4.11 Groundwater model 4.11 Groundwater model 4.11 Groundwater model 4.11.1 Introduction and objectives Groundwater models have the potential to make important contributions in the mapping and characterisation of buried valleys.

More information

Course in. Geometric nonlinearity. Nonlinear FEM. Computational Mechanics, AAU, Esbjerg

Course in. Geometric nonlinearity. Nonlinear FEM. Computational Mechanics, AAU, Esbjerg Course in Nonlinear FEM Geometric nonlinearity Nonlinear FEM Outline Lecture 1 Introduction Lecture 2 Geometric nonlinearity Lecture 3 Material nonlinearity Lecture 4 Material nonlinearity it continued

More information

Interplanetary Trajectory Optimization using a Genetic Algorithm

Interplanetary Trajectory Optimization using a Genetic Algorithm Interplanetary Trajectory Optimization using a Genetic Algorithm Abby Weeks Aerospace Engineering Dept Pennsylvania State University State College, PA 16801 Abstract Minimizing the cost of a space mission

More information

A.I.: Beyond Classical Search

A.I.: Beyond Classical Search A.I.: Beyond Classical Search Random Sampling Trivial Algorithms Generate a state randomly Random Walk Randomly pick a neighbor of the current state Both algorithms asymptotically complete. Overview Previously

More information

Beta Damping Quantum Behaved Particle Swarm Optimization

Beta Damping Quantum Behaved Particle Swarm Optimization Beta Damping Quantum Behaved Particle Swarm Optimization Tarek M. Elbarbary, Hesham A. Hefny, Atef abel Moneim Institute of Statistical Studies and Research, Cairo University, Giza, Egypt tareqbarbary@yahoo.com,

More information

LOCAL SEARCH. Today. Reading AIMA Chapter , Goals Local search algorithms. Introduce adversarial search 1/31/14

LOCAL SEARCH. Today. Reading AIMA Chapter , Goals Local search algorithms. Introduce adversarial search 1/31/14 LOCAL SEARCH Today Reading AIMA Chapter 4.1-4.2, 5.1-5.2 Goals Local search algorithms n hill-climbing search n simulated annealing n local beam search n genetic algorithms n gradient descent and Newton-Rhapson

More information

Local Search & Optimization

Local Search & Optimization Local Search & Optimization CE417: Introduction to Artificial Intelligence Sharif University of Technology Spring 2017 Soleymani Artificial Intelligence: A Modern Approach, 3 rd Edition, Chapter 4 Outline

More information

Local and Stochastic Search

Local and Stochastic Search RN, Chapter 4.3 4.4; 7.6 Local and Stochastic Search Some material based on D Lin, B Selman 1 Search Overview Introduction to Search Blind Search Techniques Heuristic Search Techniques Constraint Satisfaction

More information

Research Article A Novel Differential Evolution Invasive Weed Optimization Algorithm for Solving Nonlinear Equations Systems

Research Article A Novel Differential Evolution Invasive Weed Optimization Algorithm for Solving Nonlinear Equations Systems Journal of Applied Mathematics Volume 2013, Article ID 757391, 18 pages http://dx.doi.org/10.1155/2013/757391 Research Article A Novel Differential Evolution Invasive Weed Optimization for Solving Nonlinear

More information

An Introduction to Differential Evolution. Kelly Fleetwood

An Introduction to Differential Evolution. Kelly Fleetwood An Introduction to Differential Evolution Kelly Fleetwood Synopsis Introduction Basic Algorithm Example Performance Applications The Basics of Differential Evolution Stochastic, population-based optimisation

More information

OPTIMIZATION OF MODEL-FREE ADAPTIVE CONTROLLER USING DIFFERENTIAL EVOLUTION METHOD

OPTIMIZATION OF MODEL-FREE ADAPTIVE CONTROLLER USING DIFFERENTIAL EVOLUTION METHOD ABCM Symposium Series in Mechatronics - Vol. 3 - pp.37-45 Copyright c 2008 by ABCM OPTIMIZATION OF MODEL-FREE ADAPTIVE CONTROLLER USING DIFFERENTIAL EVOLUTION METHOD Leandro dos Santos Coelho Industrial

More information

An approach for the host rock assessment methodology. based on URLs site investigation data

An approach for the host rock assessment methodology. based on URLs site investigation data 1 An approach for the host rock assessment methodology development tin JAEA, based on URLs site investigation data Workshop on Assessing the suitability of host rock Yokohama Minato Mirai, Landmark Tower

More information

A Nonlinear Predictive State Representation

A Nonlinear Predictive State Representation Draft: Please do not distribute A Nonlinear Predictive State Representation Matthew R. Rudary and Satinder Singh Computer Science and Engineering University of Michigan Ann Arbor, MI 48109 {mrudary,baveja}@umich.edu

More information

Simulated Annealing with Parameter Tuning for Wind Turbine Placement Optimization

Simulated Annealing with Parameter Tuning for Wind Turbine Placement Optimization Simulated Annealing with Parameter Tuning for Wind Turbine Placement Optimization Daniel Lückehe 1, Oliver Kramer 2, and Manfred Weisensee 3 1 Department of Geoinformation, Jade University of Applied Sciences,

More information

Software for Integer and Nonlinear Optimization

Software for Integer and Nonlinear Optimization Software for Integer and Nonlinear Optimization Sven Leyffer, leyffer@mcs.anl.gov Mathematics & Computer Science Division Argonne National Laboratory Roger Fletcher & Jeff Linderoth Advanced Methods and

More information

Local Search & Optimization

Local Search & Optimization Local Search & Optimization CE417: Introduction to Artificial Intelligence Sharif University of Technology Spring 2018 Soleymani Artificial Intelligence: A Modern Approach, 3 rd Edition, Chapter 4 Some

More information

A hybrid Marquardt-Simulated Annealing method for solving the groundwater inverse problem

A hybrid Marquardt-Simulated Annealing method for solving the groundwater inverse problem Calibration and Reliability in Groundwater Modelling (Proceedings of the ModelCARE 99 Conference held at Zurich, Switzerland, September 1999). IAHS Publ. no. 265, 2000. 157 A hybrid Marquardt-Simulated

More information

Models and hybrid algorithms for inverse minimum spanning tree problem with stochastic edge weights

Models and hybrid algorithms for inverse minimum spanning tree problem with stochastic edge weights ISSN 1 746-7233, England, UK World Journal of Modelling and Simulation Vol. 2 (2006) No. 5, pp. 297-311 Models and hybrid algorithms for inverse minimum spanning tree problem with stochastic edge weights

More information

CS6375: Machine Learning Gautam Kunapuli. Decision Trees

CS6375: Machine Learning Gautam Kunapuli. Decision Trees Gautam Kunapuli Example: Restaurant Recommendation Example: Develop a model to recommend restaurants to users depending on their past dining experiences. Here, the features are cost (x ) and the user s

More information

PROBLEM SOLVING AND SEARCH IN ARTIFICIAL INTELLIGENCE

PROBLEM SOLVING AND SEARCH IN ARTIFICIAL INTELLIGENCE Artificial Intelligence, Computational Logic PROBLEM SOLVING AND SEARCH IN ARTIFICIAL INTELLIGENCE Lecture 4 Metaheuristic Algorithms Sarah Gaggl Dresden, 5th May 2017 Agenda 1 Introduction 2 Constraint

More information

USING A REDUCED GROUNDWATER MODELLING APPROACH TO IMPROVE WATER USE PLANNING

USING A REDUCED GROUNDWATER MODELLING APPROACH TO IMPROVE WATER USE PLANNING USING A REDUCED GROUNDWATER MODELLING APPROACH TO IMPROVE WATER USE PLANNING Jens Schumacher, M.Sc., Groundwater Scientist Gordon MacMillan, P.Geol., Principal Hydrogeologist Louis-Charles Boutin, P.Eng.,

More information

Introduction to Black-Box Optimization in Continuous Search Spaces. Definitions, Examples, Difficulties

Introduction to Black-Box Optimization in Continuous Search Spaces. Definitions, Examples, Difficulties 1 Introduction to Black-Box Optimization in Continuous Search Spaces Definitions, Examples, Difficulties Tutorial: Evolution Strategies and CMA-ES (Covariance Matrix Adaptation) Anne Auger & Nikolaus Hansen

More information

A Restart CMA Evolution Strategy With Increasing Population Size

A Restart CMA Evolution Strategy With Increasing Population Size Anne Auger and Nikolaus Hansen A Restart CMA Evolution Strategy ith Increasing Population Size Proceedings of the IEEE Congress on Evolutionary Computation, CEC 2005 c IEEE A Restart CMA Evolution Strategy

More information

CAPACITOR PLACEMENT USING FUZZY AND PARTICLE SWARM OPTIMIZATION METHOD FOR MAXIMUM ANNUAL SAVINGS

CAPACITOR PLACEMENT USING FUZZY AND PARTICLE SWARM OPTIMIZATION METHOD FOR MAXIMUM ANNUAL SAVINGS CAPACITOR PLACEMENT USING FUZZY AND PARTICLE SWARM OPTIMIZATION METHOD FOR MAXIMUM ANNUAL SAVINGS M. Damodar Reddy and V. C. Veera Reddy Department of Electrical and Electronics Engineering, S.V. University,

More information

Geometric Semantic Genetic Programming (GSGP): theory-laden design of variation operators

Geometric Semantic Genetic Programming (GSGP): theory-laden design of variation operators Geometric Semantic Genetic Programming (GSGP): theory-laden design of variation operators Andrea Mambrini University of Birmingham, UK NICaiA Exchange Programme LaMDA group, Nanjing University, China 7th

More information

RT3D Rate-Limited Sorption Reaction

RT3D Rate-Limited Sorption Reaction GMS TUTORIALS RT3D Rate-Limited Sorption Reaction This tutorial illustrates the steps involved in using GMS and RT3D to model sorption reactions under mass-transfer limited conditions. The flow model used

More information

Numerical Optimization: Basic Concepts and Algorithms

Numerical Optimization: Basic Concepts and Algorithms May 27th 2015 Numerical Optimization: Basic Concepts and Algorithms R. Duvigneau R. Duvigneau - Numerical Optimization: Basic Concepts and Algorithms 1 Outline Some basic concepts in optimization Some

More information

5. Simulated Annealing 5.2 Advanced Concepts. Fall 2010 Instructor: Dr. Masoud Yaghini

5. Simulated Annealing 5.2 Advanced Concepts. Fall 2010 Instructor: Dr. Masoud Yaghini 5. Simulated Annealing 5.2 Advanced Concepts Fall 2010 Instructor: Dr. Masoud Yaghini Outline Acceptance Function Initial Temperature Equilibrium State Cooling Schedule Stopping Condition Handling Constraints

More information

Pengju

Pengju Introduction to AI Chapter04 Beyond Classical Search Pengju Ren@IAIR Outline Steepest Descent (Hill-climbing) Simulated Annealing Evolutionary Computation Non-deterministic Actions And-OR search Partial

More information

Simultaneous use of hydrogeological and geophysical data for groundwater protection zone delineation by co-conditional stochastic simulations

Simultaneous use of hydrogeological and geophysical data for groundwater protection zone delineation by co-conditional stochastic simulations Simultaneous use of hydrogeological and geophysical data for groundwater protection zone delineation by co-conditional stochastic simulations C. Rentier,, A. Dassargues Hydrogeology Group, Departement

More information

Dynamic Call Center Routing Policies Using Call Waiting and Agent Idle Times Online Supplement

Dynamic Call Center Routing Policies Using Call Waiting and Agent Idle Times Online Supplement Dynamic Call Center Routing Policies Using Call Waiting and Agent Idle Times Online Supplement Wyean Chan DIRO, Université de Montréal, C.P. 6128, Succ. Centre-Ville, Montréal (Québec), H3C 3J7, CANADA,

More information

Artificial Intelligence Methods (G5BAIM) - Examination

Artificial Intelligence Methods (G5BAIM) - Examination Question 1 a) Explain the difference between a genotypic representation and a phenotypic representation. Give an example of each. (b) Outline the similarities and differences between Genetic Algorithms

More information

Power Prediction in Smart Grids with Evolutionary Local Kernel Regression

Power Prediction in Smart Grids with Evolutionary Local Kernel Regression Power Prediction in Smart Grids with Evolutionary Local Kernel Regression Oliver Kramer, Benjamin Satzger, and Jörg Lässig International Computer Science Institute, Berkeley CA 94704, USA, {okramer, satzger,

More information

The Story So Far... The central problem of this course: Smartness( X ) arg max X. Possibly with some constraints on X.

The Story So Far... The central problem of this course: Smartness( X ) arg max X. Possibly with some constraints on X. Heuristic Search The Story So Far... The central problem of this course: arg max X Smartness( X ) Possibly with some constraints on X. (Alternatively: arg min Stupidness(X ) ) X Properties of Smartness(X)

More information

Heuristic Optimisation

Heuristic Optimisation Heuristic Optimisation Part 8: Simulated annealing Sándor Zoltán Németh http://web.mat.bham.ac.uk/s.z.nemeth s.nemeth@bham.ac.uk University of Birmingham S Z Németh (s.nemeth@bham.ac.uk) Heuristic Optimisation

More information

Femtosecond Quantum Control for Quantum Computing and Quantum Networks. Caroline Gollub

Femtosecond Quantum Control for Quantum Computing and Quantum Networks. Caroline Gollub Femtosecond Quantum Control for Quantum Computing and Quantum Networks Caroline Gollub Outline Quantum Control Quantum Computing with Vibrational Qubits Concept & IR gates Raman Quantum Computing Control

More information

Evaluation and Validation

Evaluation and Validation Evaluation and Validation Jian-Jia Chen (Slides are based on Peter Marwedel) TU Dortmund, Informatik 12 Germany Springer, 2010 2016 年 01 月 05 日 These slides use Microsoft clip arts. Microsoft copyright

More information

A New Approach to Estimating the Expected First Hitting Time of Evolutionary Algorithms

A New Approach to Estimating the Expected First Hitting Time of Evolutionary Algorithms A New Approach to Estimating the Expected First Hitting Time of Evolutionary Algorithms Yang Yu and Zhi-Hua Zhou National Laboratory for Novel Software Technology Nanjing University, Nanjing 20093, China

More information

Regularized optimization techniques for multistage stochastic programming

Regularized optimization techniques for multistage stochastic programming Regularized optimization techniques for multistage stochastic programming Felipe Beltrán 1, Welington de Oliveira 2, Guilherme Fredo 1, Erlon Finardi 1 1 UFSC/LabPlan Universidade Federal de Santa Catarina

More information

Lecture 22. Introduction to Genetic Algorithms

Lecture 22. Introduction to Genetic Algorithms Lecture 22 Introduction to Genetic Algorithms Thursday 14 November 2002 William H. Hsu, KSU http://www.kddresearch.org http://www.cis.ksu.edu/~bhsu Readings: Sections 9.1-9.4, Mitchell Chapter 1, Sections

More information

Dynamic Call Center Routing Policies Using Call Waiting and Agent Idle Times Online Supplement

Dynamic Call Center Routing Policies Using Call Waiting and Agent Idle Times Online Supplement Submitted to imanufacturing & Service Operations Management manuscript MSOM-11-370.R3 Dynamic Call Center Routing Policies Using Call Waiting and Agent Idle Times Online Supplement (Authors names blinded

More information

V. Evolutionary Computing. Read Flake, ch. 20. Genetic Algorithms. Part 5A: Genetic Algorithms 4/10/17. A. Genetic Algorithms

V. Evolutionary Computing. Read Flake, ch. 20. Genetic Algorithms. Part 5A: Genetic Algorithms 4/10/17. A. Genetic Algorithms V. Evolutionary Computing A. Genetic Algorithms 4/10/17 1 Read Flake, ch. 20 4/10/17 2 Genetic Algorithms Developed by John Holland in 60s Did not become popular until late 80s A simplified model of genetics

More information

Enhanced Data-Driven Assessments of Hydraulic Capture Zones

Enhanced Data-Driven Assessments of Hydraulic Capture Zones Enhanced Data-Driven Assessments of Hydraulic Capture Zones David E. Dougherty, Subterranean Research, Inc. David A. Wilson, EPA Region 5, GEOS Federal Remediation Technologies Roundtable Optimization

More information

Ensemble Kalman filter assimilation of transient groundwater flow data via stochastic moment equations

Ensemble Kalman filter assimilation of transient groundwater flow data via stochastic moment equations Ensemble Kalman filter assimilation of transient groundwater flow data via stochastic moment equations Alberto Guadagnini (1,), Marco Panzeri (1), Monica Riva (1,), Shlomo P. Neuman () (1) Department of

More information

arxiv: v1 [cs.ne] 9 May 2016

arxiv: v1 [cs.ne] 9 May 2016 Anytime Bi-Objective Optimization with a Hybrid Multi-Objective CMA-ES (HMO-CMA-ES) arxiv:1605.02720v1 [cs.ne] 9 May 2016 ABSTRACT Ilya Loshchilov University of Freiburg Freiburg, Germany ilya.loshchilov@gmail.com

More information

Single Solution-based Metaheuristics

Single Solution-based Metaheuristics Parallel Cooperative Optimization Research Group Single Solution-based Metaheuristics E-G. Talbi Laboratoire d Informatique Fondamentale de Lille Single solution-based metaheuristics Improvement of a solution.

More information

Robotics 2 Target Tracking. Kai Arras, Cyrill Stachniss, Maren Bennewitz, Wolfram Burgard

Robotics 2 Target Tracking. Kai Arras, Cyrill Stachniss, Maren Bennewitz, Wolfram Burgard Robotics 2 Target Tracking Kai Arras, Cyrill Stachniss, Maren Bennewitz, Wolfram Burgard Slides by Kai Arras, Gian Diego Tipaldi, v.1.1, Jan 2012 Chapter Contents Target Tracking Overview Applications

More information

Constraint satisfaction search. Combinatorial optimization search.

Constraint satisfaction search. Combinatorial optimization search. CS 1571 Introduction to AI Lecture 8 Constraint satisfaction search. Combinatorial optimization search. Milos Hauskrecht milos@cs.pitt.edu 539 Sennott Square Constraint satisfaction problem (CSP) Objective:

More information

Characterization of heterogeneous hydraulic conductivity field via Karhunen-Loève expansions and a measure-theoretic computational method

Characterization of heterogeneous hydraulic conductivity field via Karhunen-Loève expansions and a measure-theoretic computational method Characterization of heterogeneous hydraulic conductivity field via Karhunen-Loève expansions and a measure-theoretic computational method Jiachuan He University of Texas at Austin April 15, 2016 Jiachuan

More information

Tufts COMP 135: Introduction to Machine Learning

Tufts COMP 135: Introduction to Machine Learning Tufts COMP 135: Introduction to Machine Learning https://www.cs.tufts.edu/comp/135/2019s/ Logistic Regression Many slides attributable to: Prof. Mike Hughes Erik Sudderth (UCI) Finale Doshi-Velez (Harvard)

More information

Back Analysis and optimization methods with LAGAMINE

Back Analysis and optimization methods with LAGAMINE Back Analysis and optimization methods with LAGAMINE Séverine Levasseur Chantal Bouffioux Université de Liège First International Workshop on the Finite Element Code LAGAMINE LAGASHOP 2013, Liège, 9 12

More information

Search. Search is a key component of intelligent problem solving. Get closer to the goal if time is not enough

Search. Search is a key component of intelligent problem solving. Get closer to the goal if time is not enough Search Search is a key component of intelligent problem solving Search can be used to Find a desired goal if time allows Get closer to the goal if time is not enough section 11 page 1 The size of the search

More information

Binary Particle Swarm Optimization with Crossover Operation for Discrete Optimization

Binary Particle Swarm Optimization with Crossover Operation for Discrete Optimization Binary Particle Swarm Optimization with Crossover Operation for Discrete Optimization Deepak Singh Raipur Institute of Technology Raipur, India Vikas Singh ABV- Indian Institute of Information Technology

More information

Hinkley Community Meeting Regarding PG&E s Cr(VI) Groundwater Remediation Program

Hinkley Community Meeting Regarding PG&E s Cr(VI) Groundwater Remediation Program January 24, 2019 Hinkley Community Meeting Regarding PG&E s Cr(VI) Groundwater Remediation Program Presented to Hinkley Community LOS ANGELES 1 Pointe Dr. Suite 320 Brea, CA 92821 714.388.1800 HOUSTON

More information

1 Descriptive statistics. 2 Scores and probability distributions. 3 Hypothesis testing and one-sample t-test. 4 More on t-tests

1 Descriptive statistics. 2 Scores and probability distributions. 3 Hypothesis testing and one-sample t-test. 4 More on t-tests Overall Overview INFOWO Statistics lecture S3: Hypothesis testing Peter de Waal Department of Information and Computing Sciences Faculty of Science, Universiteit Utrecht 1 Descriptive statistics 2 Scores

More information

Learning to Forecast with Genetic Algorithms

Learning to Forecast with Genetic Algorithms Learning to Forecast with Genetic Algorithms Mikhail Anufriev 1 Cars Hommes 2,3 Tomasz Makarewicz 2,3 1 EDG, University of Technology, Sydney 2 CeNDEF, University of Amsterdam 3 Tinbergen Institute Computation

More information

Optimization of Heat Exchanger Network with Fixed Topology by Genetic Algorithms

Optimization of Heat Exchanger Network with Fixed Topology by Genetic Algorithms Optimization of Heat Exchanger Networ with Fixed Topology by Genetic Algorithms Roman Bochene, Jace Jeżowsi, Sylwia Bartman Rzeszow University of Technology, Department of Chemical and Process Engineering,

More information

A MATLAB Implementation of the. Minimum Relative Entropy Method. for Linear Inverse Problems

A MATLAB Implementation of the. Minimum Relative Entropy Method. for Linear Inverse Problems A MATLAB Implementation of the Minimum Relative Entropy Method for Linear Inverse Problems Roseanna M. Neupauer 1 and Brian Borchers 2 1 Department of Earth and Environmental Science 2 Department of Mathematics

More information

Genetic Algorithms: Basic Principles and Applications

Genetic Algorithms: Basic Principles and Applications Genetic Algorithms: Basic Principles and Applications C. A. MURTHY MACHINE INTELLIGENCE UNIT INDIAN STATISTICAL INSTITUTE 203, B.T.ROAD KOLKATA-700108 e-mail: murthy@isical.ac.in Genetic algorithms (GAs)

More information

Metaheuristic algorithms for identification of the convection velocity in the convection-diffusion transport model

Metaheuristic algorithms for identification of the convection velocity in the convection-diffusion transport model Metaheuristic algorithms for identification of the convection velocity in the convection-diffusion transport model A V Tsyganov 1, Yu V Tsyganova 2, A N Kuvshinova 1 and H R Tapia Garza 1 1 Department

More information

Contents. Preface. 1 Introduction Optimization view on mathematical models NLP models, black-box versus explicit expression 3

Contents. Preface. 1 Introduction Optimization view on mathematical models NLP models, black-box versus explicit expression 3 Contents Preface ix 1 Introduction 1 1.1 Optimization view on mathematical models 1 1.2 NLP models, black-box versus explicit expression 3 2 Mathematical modeling, cases 7 2.1 Introduction 7 2.2 Enclosing

More information

Gradient-based Adaptive Stochastic Search

Gradient-based Adaptive Stochastic Search 1 / 41 Gradient-based Adaptive Stochastic Search Enlu Zhou H. Milton Stewart School of Industrial and Systems Engineering Georgia Institute of Technology November 5, 2014 Outline 2 / 41 1 Introduction

More information

Artificial Intelligence Heuristic Search Methods

Artificial Intelligence Heuristic Search Methods Artificial Intelligence Heuristic Search Methods Chung-Ang University, Jaesung Lee The original version of this content is created by School of Mathematics, University of Birmingham professor Sandor Zoltan

More information

Decomposition and Metaoptimization of Mutation Operator in Differential Evolution

Decomposition and Metaoptimization of Mutation Operator in Differential Evolution Decomposition and Metaoptimization of Mutation Operator in Differential Evolution Karol Opara 1 and Jaros law Arabas 2 1 Systems Research Institute, Polish Academy of Sciences 2 Institute of Electronic

More information

Stochastic Search: Part 2. Genetic Algorithms. Vincent A. Cicirello. Robotics Institute. Carnegie Mellon University

Stochastic Search: Part 2. Genetic Algorithms. Vincent A. Cicirello. Robotics Institute. Carnegie Mellon University Stochastic Search: Part 2 Genetic Algorithms Vincent A. Cicirello Robotics Institute Carnegie Mellon University 5000 Forbes Avenue Pittsburgh, PA 15213 cicirello@ri.cmu.edu 1 The Genetic Algorithm (GA)

More information

Learning Tetris. 1 Tetris. February 3, 2009

Learning Tetris. 1 Tetris. February 3, 2009 Learning Tetris Matt Zucker Andrew Maas February 3, 2009 1 Tetris The Tetris game has been used as a benchmark for Machine Learning tasks because its large state space (over 2 200 cell configurations are

More information

Particle Swarm Optimization. Abhishek Roy Friday Group Meeting Date:

Particle Swarm Optimization. Abhishek Roy Friday Group Meeting Date: Particle Swarm Optimization Abhishek Roy Friday Group Meeting Date: 05.25.2016 Cooperation example Basic Idea PSO is a robust stochastic optimization technique based on the movement and intelligence of

More information

State of the art in genetic algorithms' research

State of the art in genetic algorithms' research State of the art in genetic algorithms' Genetic Algorithms research Prabhas Chongstitvatana Department of computer engineering Chulalongkorn university A class of probabilistic search, inspired by natural

More information

Computational Intelligence in Product-line Optimization

Computational Intelligence in Product-line Optimization Computational Intelligence in Product-line Optimization Simulations and Applications Peter Kurz peter.kurz@tns-global.com June 2017 Restricted use Restricted use Computational Intelligence in Product-line

More information