A Versatile Quantum-inspired Evolutionary Algorithm

Size: px
Start display at page:

Download "A Versatile Quantum-inspired Evolutionary Algorithm"

Transcription

1 A Versatile Quantum-inspired Evolutionary Algorithm Michaël Defoin Platel, Stefan Schliebs and Nikola asabov Abstract This study points out some weaknesses of existing Quantum-Inspired Evolutionary Algorithms (QEA) and explains in particular how hitchhiking phenomenons can slow down the discovery of optimal solutions and encourage premature convergence. A new algorithm, called Versatile Quantuminspired Evolutionary Algorithm (vqea), is proposed. With vqea, the attractors moving the population through the search space are replaced at every generation without considering their fitness. The new algorithm is much more reactive. It always adapts the search toward the last promising solution found thus leading to a smoother and more efficient exploration. In this paper, vqea is tested and compared to a Classical Genetic Algorithm CGA and to a QEA on several benchmark problems. Experiments have shown that vqea performs better than both CGA and QEA in terms of speed and accuracy. It is a highly scalable algorithm as well. Finally, the properties of the vqea are discussed and compared to Estimation of Distribution Algorithms (EDA). I. INTRODUCTION Quantum-Inspired Evolutionary Algorithms (QEA) apply Quantum Computing Principles to enhance classical Evolutionary Algorithms (EA). In the last ten years QEA received a lot of attention and have already demonstrated their superiority compared to classical EA for solving complex benchmark problems such as combinatorial [], numerical [9], [] and multiobjective optimization [], as well as real world problems namely disk allocation method [], face detection [], rigid image registration [], training of multi layer perceptron [], signal processing [] and clustering of gene expression data []. However QEA are still poorly understood and their integration into the theory of Evolutionary Computation is missing. The main reason for that is probably because of a lack in an unified definition of QEA. We think that the most illustrative example of QEA is the algorithm firstly proposed by Han and im in [] where some major principles of Quantum Computing are used such as, the quantum and collapsed bit, the linear superposition of states and the quantum rotation gate. This algorithm has been studied several times in terms of both experimental and theoretical behavior, and tested on ideal cases, on classical optimization benchmarks but also on real world problems, [], [], [], [9], []and []. Nevertheless, we think that some specific characteristics of QEA have not received enough attention yet. In section II- A we recall briefly some basic quantum principles inspiring QEA, then a revisited description of its features is provided in section II-B. Some new tools for exploring the dynamics nowledge Engineering and Research Institute (EDRI) Auckland University of Technology (AUT) - Great South Road, Penrose Auckland, New Zealand of QEA are proposed and a clear trend in promoting hitchhiking is demonstrated. In section II-B we introduce a novel algorithm called Versatile Quantum-inspired Evolutionary Algorithm (vqea) which intends to remove elitism from the evolutionary process. With vqea the information about the search space collected during evolution is not kept at the individual level but continuously renewed and shared among the whole population. In section IV, vqea is tested on different benchmark problems and compared to the classical versions of EA and QEA. Finally in section V, the role of elitism is discussed in the light of Estimation of Distribution Algorithms (EDA). II. QUANTUM-INSPIRED EVOLUTIONARY ALGORITHM Quantum-Inspired Evolutionary Algorithms (QEA) apply Quantum Computing Principles to enhance classical Evolutionary Algorithms (EA). A. Quantum Computing Principles The smallest information unit in today s digital computers is one bit being either in the state or at any given time. The corresponding analogue on a quantum computer is represented by a quantum bit or Qbit []. Similar to classical bits, a Qbit may be in -state or -state but additionally also in any superposition of both states. A Qbit state Ψ can be defined as [ α Ψ = α + β = () β] where α and β are complex numbers defining probabilities at which the corresponding state is likely to appear when a Qbit is collapsed, i.e. read or measured. In another word, the probability of a Qbit to collapse to state and is α and β respectively. In a more geometrical aspect, an angle θ is defined such that cos(θ) = α and sin(θ) = β. In order to modify the probabilities α and β, quantum gates can be applied. We note that several quantum gates have been proposed such as (controlled) NOT-gate, rotation gate and Hadamard gate, see [] for details. B. Description of the QEA In this section we propose a revisited description of the QEA, originally published in [], see [] for a comprehensive definition. QEA is a generational population-based search method which behavior can be decomposed in three different and interacting levels, see Figure. Normalization of the states to unity guarantees α + β =at any time. ---/$. c IEEE

2 Fig.. Description of the QEA with three levels ) Quantum individuals: The lowest level corresponds to quantum individuals.aqindividual i at generation t is noted Q i (t) and corresponds to a string of λ concatenated Qbits: [ ] Q i = Q i Q i... Q λ α i = i α i... α λ i βi βi... βi λ () Each Qindividual has to be viewed as a distribution of bit strings of length λ. Even if a Qindividual is unchanged, its fitness is reevaluated every generation according to a realization of the distribution. For that purpose, each Q i is first measured to form a binary individual C i in a collapsed state and then the fitness evaluation takes place. In the sense of classical EA, Q i is the genotype while C i is the phenotype of a given individual. To each individual Q i is also attached a binary string A i acting as an attractor for Q i. Indeed, every generation C i and A i are compared in terms of both fitness and bit values. If A i is better than C i and if their bit values differ, a quantum The way a Q i collaspes is described in [] gate operator is applied on the corresponding Qbits of Q i. Thus the distribution Q i is slightly moved toward a given solution A i of the search space. We note that if C i is better than A i the individual attractor is updated. In classical EA variation operators like crossover or mutation operations are used to explore the search space. The quantum analogue for these operators is called a quantum gate. In this study, the rotation gate is used to modify the Qbits in a solution. The j th Qbit at time t of Q i is updated as follows: [ α j i β j i (t +) (t +) ] [ ][ cos(δθ) sin(δθ) α j = i (t) ] sin(δθ) cos(δθ) β j i (t) () where the constant Δθ is a rotation angle designed in compliance with the application problem []. We note that the sign of Δθ determines the sense of rotation (clockwise for negative values). ) Quantum groups: The second level corresponds to quantum groups. The population is divided into m Qgroups each containing n Qindividuals having the ability of synchronizing their attractors. For that purpose, the best attractor (in terms of fitness) of a group, noted B group,isstoredat every generation and is periodically distributed to the group attractors. This phase of local synchronization is controlled by the parameter S local. ) Quantum population: The set of all n m Qindividuals forms the quantum population and defines the topmost level of QEA. As for Qgroups, the individuals of a Qpopulation can synchronize their attractors. For that purpose, the best attractor (in terms of fitness) among all Qgroups, noted B global, is stored every generation and is periodically distributed to the group attractors. This phase of global synchronization is controlled by the parameter S global. We note that in the initial population all the Qbits are fixed with α = β =/ so that the two states and are equiprobable in collapsed individuals. C. QEA on the OneMax problem The OneMax Problem consists of maximizing the number of ones of a bit string and the global optimum is noted λ.in this section the behavior of QEA on the OneMax problem is studied for λ=. For that purpose new tools for monitoring the dynamics of both Qindividuals and Qbits are used. The setting of the evolutionary parameters is similar to the settings proposed in [], with a population of individuals, groups, Δθ = ±.π, S local = and S global =. The Figure presents the typical evolution of the Qbits of the Qindividual Q on the OneMax problem. Each point Q j (t) corresponds to a given Qbit j and a given generation t. The color (gray scale) indicates the value of the corresponding β, from black for β = to white for β =.. Thus, a Qindividual with all Qbits such that β. is likely to collapsed into the global optimum λ. We see that the evolutionary process starts by construction with initial β values equal to /. Most of the Qbits evolve toward the optimum as the color changes to white. Nevertheless IEEE Congress on Evolutionary Computation (CEC )

3 we can see clearly that some Q bits are rotated toward the wrong direction as some very dark points appear. For the vast majority of them, they finally move toward the expected value with β close to, but one of them Q has converged with β close to. For this run QEA was not able to find the global optimum in generations. Fig.. Typical evolution of a Quantum bit, Collapsed bit and Attractor bit with QEA on the OneMax problem Fig.. Typical evolution of a Qindividual (value of β ) with QEA on the OneMax problem To understand this unappropriated behavior of Q,we have plotted its evolution, i.e. values of α (doted line) and β (solid line), as well as the states of the corresponding collapsed bit C and attractor bit A, cf. Figure. We see that the β value is converging toward as of the first generations and as a consequence the state of the collapsed bit is most of the time. We note also that the state of the attractor bit demonstrates few variations and is also most of the time, except for two very short periods before generation. An attractor is always chosen according to its fitness. So the attractor A is always better than the collapsed individual C even if the value of its th Qbit is not well adapted. D. Hitchhiking and the irreversible choice A quantum individual Q i explores a given region of the search space. If a good solution is found in this region, this one is chosen as an attractor and the exploration will concentrate on this new area. In the general case, two ways exist for an attractor A i to be updated, either when a better collapsed individual C i is found, or when a synchronization phase occurs. At the individual level, when a new attractor A i is chosen in the search space, the corresponding Q i will be slightly moved toward this point until a better C i is found. But what if not better C i is found during this move? Then the algorithm is trapped and converges prematurely to this point. The only opportunity for an individual to escape from this attractor is that a synchronization phase replaces it with a better attractor produced elsewhere. Otherwise it is possible that the choice of a very good but non optimal attractor is irreversible. We think that the weakness of QEA described here is similar to what happens in Classical Genetic Algorithms (CGA) with the so called hitchhiking phenomenon firstly described as a serious bottleneck for CGA in []. Hitchhiking corresponds to the increase in frequency of a bad allele at a given locus in the population due to the presence of nearby highly fit alleles on the same chromosomes []. As a consequence, the eventual better alleles at the same locus (as the hitchhiking allele) tend to disappear in the population and there is no way for the evolutionary process to retrieve them. In CGA, random mutation and uniform crossover are two known remedies against hitchhiking. III. VERSATILE QUANTUM-INSPIRED EVOLUTIONARY ALGORITHM In this section we present an improved version of QEA, called the Versatile Quantum-inspired Evolutionary Algorithm (vqea) avoiding the weaknesses reported above. A. Description of vqea In order to prevent both the case of irreversible choice and the hitchhiking phenomenon, the strategy for updating attractors is modified. We introduce a new parameter controlling this strategy based on elitism. In the classical QEA, the update procedure (called attractor update in Figure ) applies elitism such that an attractor A i is replaced by C i only if C i is better. With vqea this parameter is simply switched off. Therefore the attractors are replaced at every generation without considering their fitness and so they demonstrate a very high volatility. Moreover to ensure the convergence of vqea, the global synchronization is also performed every IEEE Congress on Evolutionary Computation (CEC )

4 generation in such way that all the attractors are identical and at generation t+ corresponds to the best solution found at generation t. We note that with such a setting, the group size n and local synchronization parameters S local do not affect the algorithm anymore. With vqea the information about the search space collected during evolution is not kept at the individual level but continuously renewed and shared among the whole population. Nevertheless we think that the concept of group, which is similar to demes in classical EA, is interesting and we do not intend to removed it definitely. In this study, we avoid the tuning of n and S local and concentrate on the effects of removing elitism from QEA. Thus the simplified sequential procedure of vqea is detailed in Algorithm. The sets of all the quantum individuals, collapsed individuals and attractors at generation t are noted Q(t), C(t) and A(t) respectively. Algorithm The Versatile Quantum-inspired EA (vqea) : t : initialize Q(t) and A(t) : while not termination condition do : make C(t) by observing the states of Q(t) : evaluate C(t) : update Q(t) according to C(t) and A(t) using QGate : store the best of C(t) into B global (t) : synchronize A(t) with B global (t) 9: t t + : end while B. vqea on the OneMax problem The behavior of vqea on the OneMax problem is studied for λ =. The setting of the evolutionary parameters is kept almost unchanged to allow fair comparison with QEA, with a population of individuals, Δθ = ±.π, of course no elitism and global synchronization every generation (local synchronization and number of group being meaningless). We have plotted Figure the evolution of two illustrative Qbits for QEA (dashed line) and vqea (solid line) on the OneMax problem. Actually the value of θ(t) is reported in the polar coordinates system, the radius is given by t and the angle corresponds to θ such that cos(θ) = α and sin(θ) = β. For both algorithms a successful run is presented since for both cases the angle θ finally reached an expected value close to 9 degree, i.e. β close to.. Nevertheless it is clear that QEA and vqea display a very different behavior. With QEA strong decisions are made and when a rotation sense is chosen this one is kept during several generations. In fact this constancy is related to the strategy adopted for updating the attractors that is based on elitism. Conversely for vqea, the trajectory of θ(t) is much more unsettled and during the first generations, a high number of variations is reported. It is worth noticing that an extra long term memory mechanism has been added to store the best collapsed individual found ever, but this mechanism does not influence the algorithm Nevertheless, the overall evolution is much smoother than with the classical QEA. Fig.. Typical evolution of a Quantum bit (value of θ(t)) for QEA (dashed line) and vqea (solid line) on the OneMax problem To illustrate this situation, we have also computed for both algorithms the average total number of different attractors used per individual during one run of generations on the OneMax problem. We found. for QEA and more than for vqea, meaning that the life duration of an attractor is around 9. generations for QEA and only. generation for vqea. The Figure presents the typical evolution with vqea of the Qbits of the Qindividual Q on the OneMax problem. We can see a phase of more than generations where the Qindividual stay undecided. Then all the Qbits evolve slowly toward the optimum as the color changes to white. We note that for this run vqea was able to find the global optimum in 9 generations. To understand this behavior of Qbits, we have plotted the evolution of Q, i.e. values of α (doted line) and β (solid line), as well as the states of the corresponding collapsed bit C and attractor bit A, cf. Figure. We see that the β value is slowly but continuously moving toward which is expected. Meanwhile the attractor bit reports many changes of its state at the early generations then the frequency is decreasing and finally the attractor bit converges to. IV. EXPERIMENTS In this section, vqea is tested and compared to a Classical Genetic Algorithm (CGA ) and to a QEA on two benchmark problems. For both problems the fitness of the average best solution found over runs is presented. We use a statistical unpaired, two-tailed t-test with 9% confidence to determine if results are significantly different. IEEE Congress on Evolutionary Computation (CEC )

5 but the best results came with vqea. The improvement of the average profit obtained when comparing vqea to QEA is almost equivalent to the improvement obtained when comparing QEA to CGA. TABLE I AVERAGE PROFIT OF THE BEST SOLUTION FOUND ON THE -NAPSAC PROBLEM λ = N =, generations CGA QEA vqea 9. (σ=9.). (σ=.9). (σ=.9) In Figure, the evolution of the average best profit is plotted for the three algorithms. We see that during the first generations the CGA reports the best profit then, until the generation, vqea outperforms both CGA and QEA. The solutions discovered by CGA and vqea at generation correspond to an average profit of 9. This value is reached by the QEA only at generation. Fig.. Typical evolution of a Qindividual (value of β ) with vqea on the OneMax problem Fig.. Average profit of the best solution found on a -knapsack problem with N= Fig.. Typical evolution of a Quantum bit, Collapsed bit and Attractor bit with vqea on the OneMax problem A. Optimization of a -knapsack problem This NP-hard problem consists in finding the most valuable subset among N items of different profits and volumes that fit in a knapsack of limited capacity. In [], QEA was already evaluated on a -knapsack problem. For both CGA and QEA, the same settings for the evolutionary parameters are used here. We note that the population size is equal to for the CGA and only for both QEA and vqea. For vqea of course the elitism was switched off and S global set to one. The results are reported in Table I for N= items. Our implementation of CGA and QEA found solutions comparable to []. QEA significantly outperforms the CGA B. Optimization of N-landscapes problems In [], Stuart auffman developed the N-landscapes to model systems which performance depends not only on the states of their N components but also on the interactions between them. They have been used in theoretical biology for example to study gene networks, evolution of proteins or immune systems. The N-landscapes define also a family of combinatorial optimization problems that are now widely used as benchmarks for EA. According to Weinberger [9], the model affords a tunably rugged fitness landscape. The parameter N determines the size of the search space while controls the number of local optima, from no local optima for =to N N+ for = N. In this study, the interactions between the N parts of the systems are chosen randomly and the corresponding problem has been proved to be NP-complete for [9]. The performances of the three algorithms are studied for problems of increasing size with N=,,, and 9 and of increasing IEEE Congress on Evolutionary Computation (CEC )

6 difficulty with varying from to. Each run corresponds to, generations. The average fitness of the best solutions found with = and are plotted in Figure (error bars corresponds to three times the standard deviation). In part A, for = and N= the problem is very simple and can be easily solved by the three algorithms. While N increases, we see that both CGA and QEA are outperformed by vqea. Moreover the average fitness of the solutions found with vqea is almost unaffected by N. In part B for = the performances of the three algorithms are not significantly different for N= and but for higher N the trend reported for = is still present. These results demonstrate that vqea is a highly scalable algorithm even for difficult problems. also that the standard deviation reported for vqea is the smallest, indicating that most of the runs have found nearly the same good solution. For further inter-comparisons, Fig. 9. Relative fitness of the best solution found on N-landscapes with N=9 (A) (B) Fig.. Average fitness of the best solution found on N-landscapes with = (part a) and (part b) In Figure 9 we have plotted the relative fitness of the best solutions found for N=9 and for different values of, i.e. the results obtained by the CGA are used as a reference. It is clear that the performance of vqea compared to CGA are almost independent of the difficulty with vqea around % better than CGA. Conversely for QEA this ratio varies from less than % for = to nearly % for =. We note the overall numerical results obtained with CGA, QEA and vqea are reported Table II. The Figure presents two isofitness clouds. In these clouds, each point of coordinates (gen A,gen B ) corresponds to the average number of generations, i.e. gen A and gen B, needed by two different algorithms, respectively A and B, to reach the same fitness value. We introduce this kind of representation to allow practical comparisons of computational resources required by algorithms reporting different best fitness values and different convergence speeds. In our case, the isofitness clouds have been computed from all the experiments on the N-landscapes reported above. It is worth noticing that the underlying assumption is that the resources needed for computing one generation are equivalent between all the algorithms tested, which is partly false. Indeed, when CGA and QEA (same for vqea) are compared, the size of the populations are significantly different, respectively and individuals and so a generation is processed faster with QEA or vqea than with CGA. In part (A) CGA and QEA are compared. We see that most of the points are located under the line y = x showing that QEA was faster than CGA. The biggest difference in convergence speed is reported for points at the bottom right corner of the figure meaning that it requires, generations to CGA to discover solutions which fitness was found by QEA around generation,. However we note that for the early generations, i.e. before, some points indicate that CGA was the first to reach a given fitness level. After studying the data, we have found that those points correspond to the easiest problems with small values of N ( and ) and equal to. The part (B) displays the isofitness cloud obtained for QEA vs vqea. It is clear that vqea is almost always faster than QEA whatever the size and the difficulty of the problem. We see also that, after the generation,, the slope of the cloud is nearly equal to. This means that the QEA needs a very high number (asymptotically an infinite number) of generations to find IEEE Congress on Evolutionary Computation (CEC )

7 solutions as good as the solutions found by vqea in less than, generations. (A) (B) Fig.. Isofitness Clouds: part (a) CGA vs QEA, part (b) QEA vs vqea V. D ISCUSSION According to [], the algorithms that use a probabilistic model of promising solutions to guide further exploration of the search space are called Estimation of Distribution Algorithms (EDA). We think that in QEA the Qindividuals act as a probabilistic models and so, as it has already been claimed in [] and [], QEA is a new approach belonging to EDA. In this section the role of elitism in EDA is briefly discussed. In CGA elitism has been introduced as a protection mechanism to counteract the disruptive effects of genetic operators such as the uniform crossover. In some EDA the probabilistic models can undergo perturbations to explore the search space but these perturbations do not have dramatic consequences TABLE II AVERAGE PROFIT OF THE BEST SOLUTION FOUND ON THE N - LANDSCAPES PROBLEM AFTER, GENERATIONS CGA.(σ=.).(σ=.).9(σ=.).(σ=.).9(σ=.).9(σ=.).(σ=.9).9(σ=.).(σ=.9).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).9(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).9(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).9(σ=.).9(σ=.).9(σ=.) QEA N =.(σ=.).(σ=.).(σ=.).9(σ=.9).9(σ=.).9(σ=.).9(σ=.).9(σ=.).(σ=.) N =.(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).9(σ=.).(σ=.).9(σ=.9) N =.(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.) N =.(σ=.).(σ=.).9(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.) N = 9.(σ=.).9(σ=.).(σ=.).(σ=.).9(σ=.).9(σ=.).9(σ=.).(σ=.).(σ=.) vqea.(σ=.).(σ=.).(σ=.).(σ=.).9(σ=.).(σ=.).9(σ=.).9(σ=.9).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).9(σ=.9).(σ=.).9(σ=.).(σ=.).(σ=.).9(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).(σ=.).9(σ=.).(σ=.).9(σ=.).9(σ=.).9(σ=.).(σ=.).(σ=.).(σ=.) and elitism is not necessary. Moreover with some other EDA, the probabilistic models are completely reconstructed every generation and elitism is not used. Nevertheless we found in [] an interesting counter example where an EDA is presented and better results are reported with elitism. But in that case a uniform crossover is also applied to bit strings. So we think that as far as no disruptive operators are employed, there is no need for an EDA and so for a quantum inspired algorithm to have recourse to elitism. This is one the IEEE Congress on Evolutionary Computation (CEC ) 9

8 reasons why vqea performs better than QEA. VI. CONCLUSIONS The Quantum-Inspired Evolutionary Algorithm (QEA) introduced in [] and studied in this paper is elitist. The exploration of the search space is driven by attractors corresponding to the best solution found so far either at the individual, local or global level. If a non-optimal solution is propagated to the global level then this solution starts to attract the entire population. In that case, to avoid being trapped, the algorithm has to discover a better solution before converging to this global attractor. To prevent the choice of an attractor from being irreversible, the Versatile Quantum-Inspired Evolutionary Algorithm (vqea) is proposed. With vqea, the elitism is switched off and the search at time t + is driven by the best solution found at time t. Simply removing elitism has strong consequences. With vqea the information about the search space collected during evolution is not kept at the individual level but continuously renewed and shared among the whole population. In terms of both speed and accuracy vqea performs better than QEA on different benchmark problems. The dynamics of QEA and vqea are very distinct. The short term behavior of QEA is almost always constant because preferential search directions are chosen and followed during several generations. Conversely with vqea, the short term behavior is much more unsettled and the search directions are reevaluated every generation. Thus the eventual decision errors do not have long term consequences. vqea is continuously adapting the search to local information while the quantum individuals act as memory buffers to keep track of the search history. This leads to a much more smooth and efficient long term exploration of the search space. In this study, since all the attractors are synchronized at every generation, the local level with the Qgroups are meaningless. Nevertheless we think that the concept of group, which is similar to demes in classical EA, is very promising and further studies should address the setting of both local and global synchronization. In future work the relationship between Quantum-Inspired Evolutionary Algorithms and Estimation of Distribution Algorithms should be investigated strongly, some empirical comparisons should be performed and an unified definition should be proposed. [] S. Forrest and M. Mitchell. Relative building-block fitness and the building-block hypothesis. In Foundation of Genetic Algorithms, pages 9. Morgan aufman, 99. [] D. J. Futuyma. Evolutionary Biology. Sinauer, Sunderland, MA, USA, 99. [] -H. Han. Quantum-inspired Evolutionary Algorithm. PhD thesis, orea Advanced Institute of Science and Technology (AIST),. [] -H. Han and J-H. im. Quantum-inspired evolutionary algorithm for a class of combinatorial optimization. IEEE Transactions on Evolutionary Computation, (): 9, December. [] -H. Han and J-H. im. On setting the parameters of quantuminspired evolutionary algorithm for practical application. In Evolutionary Computation. CEC. The Congress, volume, pages 9,. [9] -H. Han and J-H. im. Quantum-inspired evolutionary algorithms with a new termination criterion, h ɛ gate, and two phase scheme. IEEE Transactions on Evolutionary Computation, (): 9,. [] -H. Han and J-H. im. On the analysis of the quantum-inspired evolutionary algorithm with a single individual. In IEEE Congress on Evolutionary Computation, pages,. [] T. Hey. Quantum computing: an introduction. Computing & Control Engineering Journal, :, 999. [] J-H. im J-S. Jang, -H. Han. Face detection using quantum-inspired evolutionary algorithm. In IEEE Press, editor, the IEEE Congress on Evolutionary Computation, pages. IEEE Press, June. [] S. A. auffman. The origins of order. Self-organization and selection in evolution. Oxford University Press, New-York, 99. [] -H. ima, J-Y. Hwang, -H. Han, J-H. im, and -H. Park. A quantum-inspired evolutionary computing algorithm for disk allocation method. IEICE Transactions on Information and Systems, E- D(): 9, March. [] F. Liu, S. Li, M. Liang, and L. Hu. Wideband signal doa estimation based on modified quantum genetic algorithm. IEICE Transactions on Fundamentals of Electronics Communications and Computer Sciences, 9:,. [] H. Mühlenbein and G. Paass. From recombination of genes to the estimation of distributions i. binary parameters. In Parallel Problem Solving from Nature - PPSN IV, International Conference on Evolutionary Computation., pages, 99. [] H. Talbi, A. Draa, and M. Batouche. A novel quantum-inspired evaluation algorithm for multi-source affine image registration. Int. Arab J. Inf. Technol., ():9,. [] G.. Venayagamoorthy and G. Singhal. Quantum-inspired evolutionary algorithms and binary particle swarm optimization for training mlp and srn neural networks. Journal of Computational and Theoretical Nanoscience, (): (), December. [9] E. D. Weinberger. NP completeness of auffman s N model, a tuneably rugged fitness landscape. Technical Report 9--, Santa Fe Institute, 99. [] S. Zhou and Z. Sun. A new approach belonging to EDAs: Quantuminspired genetic algorithm with only one chromosome. In ICNC (), pages,. [] W. Zhou, C. Zhou, Y. Huang, and Y. Wang. Rough Sets, Fuzzy Sets, Data Mining, and Granular Computing, chapter Analysis of Gene Expression Data: Application of Quantum-Inspired Evolutionary Algorithm to Minimum Sum-of-Squares Clustering, pages 9. Springer Berlin / Heidelberg,. REFERENCES [] C. W. Ahn,. P. im, and R. S. Ramakrishna. A memoryefficient elitist genetic algorithm. In Parallel Processing and Applied Mathematics, PPAM, th International Conference, Proceedings, pages 9,. [] A.V. Abs da Cruz, M.B.R Vellasco, and M.A.C. Pacheco. Quantuminspired evolutionary algorithm for numerical optimization. In Evolutionary Computation,. CEC. IEEE Congress, pages, July. [] A. Draa, M. Batouche, and H. Talbi. A quantum-inspired differential evolution algorithm for rigid image registration. In International Conference on Computational Intelligence, ICCI, Istanbul, Turkey, Proceedings, pages,. IEEE Congress on Evolutionary Computation (CEC )

Introduction of Quantum-inspired Evolutionary Algorithm

Introduction of Quantum-inspired Evolutionary Algorithm FIRA Robot Congress Seoul, Korea Introduction of Quantum-inspired Evolutionary Algorithm Kuk-Hyun Han and Jong-Hwan Kim Department of Electrical Engineering and Computer Science, Korea Advanced Institute

More information

Research Article Effect of Population Structures on Quantum-Inspired Evolutionary Algorithm

Research Article Effect of Population Structures on Quantum-Inspired Evolutionary Algorithm Applied Computational Intelligence and So Computing, Article ID 976202, 22 pages http://dx.doi.org/10.1155/2014/976202 Research Article Effect of Population Structures on Quantum-Inspired Evolutionary

More information

A Generalized Quantum-Inspired Evolutionary Algorithm for Combinatorial Optimization Problems

A Generalized Quantum-Inspired Evolutionary Algorithm for Combinatorial Optimization Problems A Generalized Quantum-Inspired Evolutionary Algorithm for Combinatorial Optimization Problems Julio M. Alegría 1 julio.alegria@ucsp.edu.pe Yván J. Túpac 1 ytupac@ucsp.edu.pe 1 School of Computer Science

More information

Gene Pool Recombination in Genetic Algorithms

Gene Pool Recombination in Genetic Algorithms Gene Pool Recombination in Genetic Algorithms Heinz Mühlenbein GMD 53754 St. Augustin Germany muehlenbein@gmd.de Hans-Michael Voigt T.U. Berlin 13355 Berlin Germany voigt@fb10.tu-berlin.de Abstract: A

More information

An Improved Quantum Evolutionary Algorithm with 2-Crossovers

An Improved Quantum Evolutionary Algorithm with 2-Crossovers An Improved Quantum Evolutionary Algorithm with 2-Crossovers Zhihui Xing 1, Haibin Duan 1,2, and Chunfang Xu 1 1 School of Automation Science and Electrical Engineering, Beihang University, Beijing, 100191,

More information

Quantum-Inspired Differential Evolution with Particle Swarm Optimization for Knapsack Problem

Quantum-Inspired Differential Evolution with Particle Swarm Optimization for Knapsack Problem JOURNAL OF INFORMATION SCIENCE AND ENGINEERING 31, 1757-1773 (2015) Quantum-Inspired Differential Evolution with Particle Swarm Optimization for Knapsack Problem DJAAFAR ZOUACHE 1 AND ABDELOUAHAB MOUSSAOUI

More information

Quantum-Inspired Evolutionary Algorithm for a Class of Combinatorial Optimization

Quantum-Inspired Evolutionary Algorithm for a Class of Combinatorial Optimization 580 IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, VOL. 6, NO. 6, DECEMBER 2002 Quantum-Inspired Evolutionary Algorithm for a Class of Combinatorial Optimization Kuk-Hyun Han and Jong-Hwan Kim Abstract

More information

Evolutionary Computation Theory. Jun He School of Computer Science University of Birmingham Web: jxh

Evolutionary Computation Theory. Jun He School of Computer Science University of Birmingham Web:   jxh Evolutionary Computation Theory Jun He School of Computer Science University of Birmingham Web: www.cs.bham.ac.uk/ jxh Outline Motivation History Schema Theorem Convergence and Convergence Rate Computational

More information

Beta Damping Quantum Behaved Particle Swarm Optimization

Beta Damping Quantum Behaved Particle Swarm Optimization Beta Damping Quantum Behaved Particle Swarm Optimization Tarek M. Elbarbary, Hesham A. Hefny, Atef abel Moneim Institute of Statistical Studies and Research, Cairo University, Giza, Egypt tareqbarbary@yahoo.com,

More information

Exploration of population fixed-points versus mutation rates for functions of unitation

Exploration of population fixed-points versus mutation rates for functions of unitation Exploration of population fixed-points versus mutation rates for functions of unitation J Neal Richter 1, Alden Wright 2, John Paxton 1 1 Computer Science Department, Montana State University, 357 EPS,

More information

Binary Particle Swarm Optimization with Crossover Operation for Discrete Optimization

Binary Particle Swarm Optimization with Crossover Operation for Discrete Optimization Binary Particle Swarm Optimization with Crossover Operation for Discrete Optimization Deepak Singh Raipur Institute of Technology Raipur, India Vikas Singh ABV- Indian Institute of Information Technology

More information

A Quantum-Inspired Differential Evolution Algorithm for Solving the N-Queens Problem

A Quantum-Inspired Differential Evolution Algorithm for Solving the N-Queens Problem The International Arab Journal of Information Technology, Vol. 7, No. 1, January 20 21 A Quantum-Inspired Differential Evolution Algorithm for Solving the N-Queens Problem Amer Draa 1, Souham Meshoul 2,

More information

Dynamic Behavior Analysis of Membrane-Inspired Evolutionary Algorithms

Dynamic Behavior Analysis of Membrane-Inspired Evolutionary Algorithms INT J COMPUT COMMUN, ISSN 84-9836 9():7-4, April, 4. Dynamic Behavior Analysis of Membrane-Inspired Evolutionary Algorithms G. Zhang, J. Cheng, M. Gheorghe Gexiang Zhang*, Jixiang Cheng School of Electrical

More information

Lecture 9 Evolutionary Computation: Genetic algorithms

Lecture 9 Evolutionary Computation: Genetic algorithms Lecture 9 Evolutionary Computation: Genetic algorithms Introduction, or can evolution be intelligent? Simulation of natural evolution Genetic algorithms Case study: maintenance scheduling with genetic

More information

Computational statistics

Computational statistics Computational statistics Combinatorial optimization Thierry Denœux February 2017 Thierry Denœux Computational statistics February 2017 1 / 37 Combinatorial optimization Assume we seek the maximum of f

More information

arxiv:cs/ v1 [cs.ne] 4 Mar 2004

arxiv:cs/ v1 [cs.ne] 4 Mar 2004 Genetic Algorithms and Quantum Computation arxiv:cs/0403003v1 [cs.ne] 4 Mar 2004 Gilson A. Giraldi, Renato Portugal, Ricardo N. Thess Abstract Recently, researchers have applied genetic algorithms (GAs)

More information

Evolutionary Computation

Evolutionary Computation Evolutionary Computation - Computational procedures patterned after biological evolution. - Search procedure that probabilistically applies search operators to set of points in the search space. - Lamarck

More information

A Statistical Genetic Algorithm

A Statistical Genetic Algorithm A Statistical Genetic Algorithm Angel Kuri M. akm@pollux.cic.ipn.mx Centro de Investigación en Computación Instituto Politécnico Nacional Zacatenco México 07738, D.F. Abstract A Genetic Algorithm which

More information

Finding Robust Solutions to Dynamic Optimization Problems

Finding Robust Solutions to Dynamic Optimization Problems Finding Robust Solutions to Dynamic Optimization Problems Haobo Fu 1, Bernhard Sendhoff, Ke Tang 3, and Xin Yao 1 1 CERCIA, School of Computer Science, University of Birmingham, UK Honda Research Institute

More information

Quadratic Multiple Knapsack Problem with Setups and a Solution Approach

Quadratic Multiple Knapsack Problem with Setups and a Solution Approach Proceedings of the 2012 International Conference on Industrial Engineering and Operations Management Istanbul, Turkey, July 3 6, 2012 Quadratic Multiple Knapsack Problem with Setups and a Solution Approach

More information

An artificial chemical reaction optimization algorithm for. multiple-choice; knapsack problem.

An artificial chemical reaction optimization algorithm for. multiple-choice; knapsack problem. An artificial chemical reaction optimization algorithm for multiple-choice knapsack problem Tung Khac Truong 1,2, Kenli Li 1, Yuming Xu 1, Aijia Ouyang 1, and Xiaoyong Tang 1 1 College of Information Science

More information

Chapter 8: Introduction to Evolutionary Computation

Chapter 8: Introduction to Evolutionary Computation Computational Intelligence: Second Edition Contents Some Theories about Evolution Evolution is an optimization process: the aim is to improve the ability of an organism to survive in dynamically changing

More information

Analysis of Crossover Operators for Cluster Geometry Optimization

Analysis of Crossover Operators for Cluster Geometry Optimization Analysis of Crossover Operators for Cluster Geometry Optimization Francisco B. Pereira Instituto Superior de Engenharia de Coimbra Portugal Abstract We study the effectiveness of different crossover operators

More information

2. Particle swarm optimization

2. Particle swarm optimization Quantum-Inspired Particle Swarm Optimization for Feature Selection and Parameter Optimization in Evolving Spiking Neural Networks for Classification Tasks 8 Haza Nuzly Abdull Hamed 1,2, Nikola K. Kasabov

More information

Upper Bounds on the Time and Space Complexity of Optimizing Additively Separable Functions

Upper Bounds on the Time and Space Complexity of Optimizing Additively Separable Functions Upper Bounds on the Time and Space Complexity of Optimizing Additively Separable Functions Matthew J. Streeter Computer Science Department and Center for the Neural Basis of Cognition Carnegie Mellon University

More information

V. Evolutionary Computing. Read Flake, ch. 20. Assumptions. Genetic Algorithms. Fitness-Biased Selection. Outline of Simplified GA

V. Evolutionary Computing. Read Flake, ch. 20. Assumptions. Genetic Algorithms. Fitness-Biased Selection. Outline of Simplified GA Part 5A: Genetic Algorithms V. Evolutionary Computing A. Genetic Algorithms Read Flake, ch. 20 1 2 Genetic Algorithms Developed by John Holland in 60s Did not become popular until late 80s A simplified

More information

A New Approach to Estimating the Expected First Hitting Time of Evolutionary Algorithms

A New Approach to Estimating the Expected First Hitting Time of Evolutionary Algorithms A New Approach to Estimating the Expected First Hitting Time of Evolutionary Algorithms Yang Yu and Zhi-Hua Zhou National Laboratory for Novel Software Technology Nanjing University, Nanjing 20093, China

More information

Estimation-of-Distribution Algorithms. Discrete Domain.

Estimation-of-Distribution Algorithms. Discrete Domain. Estimation-of-Distribution Algorithms. Discrete Domain. Petr Pošík Introduction to EDAs 2 Genetic Algorithms and Epistasis.....................................................................................

More information

V. Evolutionary Computing. Read Flake, ch. 20. Genetic Algorithms. Part 5A: Genetic Algorithms 4/10/17. A. Genetic Algorithms

V. Evolutionary Computing. Read Flake, ch. 20. Genetic Algorithms. Part 5A: Genetic Algorithms 4/10/17. A. Genetic Algorithms V. Evolutionary Computing A. Genetic Algorithms 4/10/17 1 Read Flake, ch. 20 4/10/17 2 Genetic Algorithms Developed by John Holland in 60s Did not become popular until late 80s A simplified model of genetics

More information

IV. Evolutionary Computing. Read Flake, ch. 20. Assumptions. Genetic Algorithms. Fitness-Biased Selection. Outline of Simplified GA

IV. Evolutionary Computing. Read Flake, ch. 20. Assumptions. Genetic Algorithms. Fitness-Biased Selection. Outline of Simplified GA IV. Evolutionary Computing A. Genetic Algorithms Read Flake, ch. 20 2014/2/26 1 2014/2/26 2 Genetic Algorithms Developed by John Holland in 60s Did not become popular until late 80s A simplified model

More information

Fitness distributions and GA hardness

Fitness distributions and GA hardness Fitness distributions and GA hardness Yossi Borenstein and Riccardo Poli Department of Computer Science University of Essex Abstract. Considerable research effort has been spent in trying to formulate

More information

Sorting Network Development Using Cellular Automata

Sorting Network Development Using Cellular Automata Sorting Network Development Using Cellular Automata Michal Bidlo, Zdenek Vasicek, and Karel Slany Brno University of Technology, Faculty of Information Technology Božetěchova 2, 61266 Brno, Czech republic

More information

Population-Based Incremental Learning with Immigrants Schemes in Changing Environments

Population-Based Incremental Learning with Immigrants Schemes in Changing Environments Population-Based Incremental Learning with Immigrants Schemes in Changing Environments Michalis Mavrovouniotis Centre for Computational Intelligence (CCI) School of Computer Science and Informatics De

More information

Pure Strategy or Mixed Strategy?

Pure Strategy or Mixed Strategy? Pure Strategy or Mixed Strategy? Jun He, Feidun He, Hongbin Dong arxiv:257v4 [csne] 4 Apr 204 Abstract Mixed strategy evolutionary algorithms EAs) aim at integrating several mutation operators into a single

More information

An Effective Chromosome Representation for Evolving Flexible Job Shop Schedules

An Effective Chromosome Representation for Evolving Flexible Job Shop Schedules An Effective Chromosome Representation for Evolving Flexible Job Shop Schedules Joc Cing Tay and Djoko Wibowo Intelligent Systems Lab Nanyang Technological University asjctay@ntuedusg Abstract As the Flexible

More information

Generalization of Dominance Relation-Based Replacement Rules for Memetic EMO Algorithms

Generalization of Dominance Relation-Based Replacement Rules for Memetic EMO Algorithms Generalization of Dominance Relation-Based Replacement Rules for Memetic EMO Algorithms Tadahiko Murata 1, Shiori Kaige 2, and Hisao Ishibuchi 2 1 Department of Informatics, Kansai University 2-1-1 Ryozenji-cho,

More information

Behavior of EMO Algorithms on Many-Objective Optimization Problems with Correlated Objectives

Behavior of EMO Algorithms on Many-Objective Optimization Problems with Correlated Objectives H. Ishibuchi N. Akedo H. Ohyanagi and Y. Nojima Behavior of EMO algorithms on many-objective optimization problems with correlated objectives Proc. of 211 IEEE Congress on Evolutionary Computation pp.

More information

CSC 4510 Machine Learning

CSC 4510 Machine Learning 10: Gene(c Algorithms CSC 4510 Machine Learning Dr. Mary Angela Papalaskari Department of CompuBng Sciences Villanova University Course website: www.csc.villanova.edu/~map/4510/ Slides of this presenta(on

More information

Haploid & diploid recombination and their evolutionary impact

Haploid & diploid recombination and their evolutionary impact Haploid & diploid recombination and their evolutionary impact W. Garrett Mitchener College of Charleston Mathematics Department MitchenerG@cofc.edu http://mitchenerg.people.cofc.edu Introduction The basis

More information

An Implementation of Compact Genetic Algorithm on a Quantum Computer

An Implementation of Compact Genetic Algorithm on a Quantum Computer An Implementation of Compact Genetic Algorithm on a Quantum Computer Sorrachai Yingchareonthawornchai 1, Chatchawit Aporntewan, Prabhas Chongstitvatana 1 1 Department of Computer Engineering Department

More information

Efficiency of genetic algorithm and determination of ground state energy of impurity in a spherical quantum dot

Efficiency of genetic algorithm and determination of ground state energy of impurity in a spherical quantum dot Efficiency of genetic algorithm and determination of ground state energy of impurity in a spherical quantum dot +DOXNùDIDN 1* 0HKPHWùDKLQ 1, Berna Gülveren 1, Mehmet Tomak 1 Selcuk University, Faculty

More information

RESEARCH on quantum-inspired computational intelligence

RESEARCH on quantum-inspired computational intelligence Proceedings of the 2014 Federated Conference on Computer Science and Information Systems pp. 465 470 DOI: 10.15439/2014F99 ACSIS, Vol. 2 Higher-Order Quantum-Inspired Genetic Algorithms Robert Nowotniak,

More information

Rule Acquisition for Cognitive Agents by Using Estimation of Distribution Algorithms

Rule Acquisition for Cognitive Agents by Using Estimation of Distribution Algorithms Rule cquisition for Cognitive gents by Using Estimation of Distribution lgorithms Tokue Nishimura and Hisashi Handa Graduate School of Natural Science and Technology, Okayama University Okayama 700-8530,

More information

Evolving more efficient digital circuits by allowing circuit layout evolution and multi-objective fitness

Evolving more efficient digital circuits by allowing circuit layout evolution and multi-objective fitness Evolving more efficient digital circuits by allowing circuit layout evolution and multi-objective fitness Tatiana Kalganova Julian Miller School of Computing School of Computing Napier University Napier

More information

0 o 1 i B C D 0/1 0/ /1

0 o 1 i B C D 0/1 0/ /1 A Comparison of Dominance Mechanisms and Simple Mutation on Non-Stationary Problems Jonathan Lewis,? Emma Hart, Graeme Ritchie Department of Articial Intelligence, University of Edinburgh, Edinburgh EH

More information

Evolutionary Robotics

Evolutionary Robotics Evolutionary Robotics Previously on evolutionary robotics Evolving Neural Networks How do we evolve a neural network? Evolving Neural Networks How do we evolve a neural network? One option: evolve the

More information

Behaviour of the UMDA c algorithm with truncation selection on monotone functions

Behaviour of the UMDA c algorithm with truncation selection on monotone functions Mannheim Business School Dept. of Logistics Technical Report 01/2005 Behaviour of the UMDA c algorithm with truncation selection on monotone functions Jörn Grahl, Stefan Minner, Franz Rothlauf Technical

More information

Runtime Analysis of Evolutionary Algorithms for the Knapsack Problem with Favorably Correlated Weights

Runtime Analysis of Evolutionary Algorithms for the Knapsack Problem with Favorably Correlated Weights Runtime Analysis of Evolutionary Algorithms for the Knapsack Problem with Favorably Correlated Weights Frank Neumann 1 and Andrew M. Sutton 2 1 Optimisation and Logistics, School of Computer Science, The

More information

1. Computação Evolutiva

1. Computação Evolutiva 1. Computação Evolutiva Renato Tinós Departamento de Computação e Matemática Fac. de Filosofia, Ciência e Letras de Ribeirão Preto Programa de Pós-Graduação Em Computação Aplicada 1.6. Aspectos Teóricos*

More information

Geometric Semantic Genetic Programming (GSGP): theory-laden design of semantic mutation operators

Geometric Semantic Genetic Programming (GSGP): theory-laden design of semantic mutation operators Geometric Semantic Genetic Programming (GSGP): theory-laden design of semantic mutation operators Andrea Mambrini 1 University of Birmingham, Birmingham UK 6th June 2013 1 / 33 Andrea Mambrini GSGP: theory-laden

More information

An Analysis on Recombination in Multi-Objective Evolutionary Optimization

An Analysis on Recombination in Multi-Objective Evolutionary Optimization An Analysis on Recombination in Multi-Objective Evolutionary Optimization Chao Qian, Yang Yu, Zhi-Hua Zhou National Key Laboratory for Novel Software Technology Nanjing University, Nanjing 20023, China

More information

Towards Automatic Design of Adaptive Evolutionary Algorithms. Ayman Srour - Patrick De Causmaecker

Towards Automatic Design of Adaptive Evolutionary Algorithms. Ayman Srour - Patrick De Causmaecker Towards Automatic Design of Adaptive Evolutionary Algorithms Ayman Srour - Patrick De Causmaecker Outline Background Parameter tuning Adaptive Parameter control Preliminary investigation The proposed framework

More information

Looking Under the EA Hood with Price s Equation

Looking Under the EA Hood with Price s Equation Looking Under the EA Hood with Price s Equation Jeffrey K. Bassett 1, Mitchell A. Potter 2, and Kenneth A. De Jong 1 1 George Mason University, Fairfax, VA 22030 {jbassett, kdejong}@cs.gmu.edu 2 Naval

More information

The particle swarm optimization algorithm: convergence analysis and parameter selection

The particle swarm optimization algorithm: convergence analysis and parameter selection Information Processing Letters 85 (2003) 317 325 www.elsevier.com/locate/ipl The particle swarm optimization algorithm: convergence analysis and parameter selection Ioan Cristian Trelea INA P-G, UMR Génie

More information

Computational Complexity and Genetic Algorithms

Computational Complexity and Genetic Algorithms Computational Complexity and Genetic Algorithms BART RYLANDER JAMES FOSTER School of Engineering Department of Computer Science University of Portland University of Idaho Portland, Or 97203 Moscow, Idaho

More information

Robust Multi-Objective Optimization in High Dimensional Spaces

Robust Multi-Objective Optimization in High Dimensional Spaces Robust Multi-Objective Optimization in High Dimensional Spaces André Sülflow, Nicole Drechsler, and Rolf Drechsler Institute of Computer Science University of Bremen 28359 Bremen, Germany {suelflow,nd,drechsle}@informatik.uni-bremen.de

More information

Quantum Crossover Based Quantum Genetic Algorithm for Solving Non-linear Programming

Quantum Crossover Based Quantum Genetic Algorithm for Solving Non-linear Programming Quantum Crossover Based Quantum Genetic Algorithm for Solving Non-linear Programming Amgad. M. Mohammed, N. A. Elhefnawy Mahmoud. M. El-Sherbiny Operations Research Dept., Menofia University Operations

More information

The Evolution of Sex Chromosomes through the. Baldwin Effect

The Evolution of Sex Chromosomes through the. Baldwin Effect The Evolution of Sex Chromosomes through the Baldwin Effect Larry Bull Computer Science Research Centre Department of Computer Science & Creative Technologies University of the West of England, Bristol

More information

A Comparison of GAs Penalizing Infeasible Solutions and Repairing Infeasible Solutions on the 0-1 Knapsack Problem

A Comparison of GAs Penalizing Infeasible Solutions and Repairing Infeasible Solutions on the 0-1 Knapsack Problem A Comparison of GAs Penalizing Infeasible Solutions and Repairing Infeasible Solutions on the 0-1 Knapsack Problem Jun He 1, Yuren Zhou 2, and Xin Yao 3 1 J. He is with the Department of Computer Science,

More information

CS264: Beyond Worst-Case Analysis Lecture #18: Smoothed Complexity and Pseudopolynomial-Time Algorithms

CS264: Beyond Worst-Case Analysis Lecture #18: Smoothed Complexity and Pseudopolynomial-Time Algorithms CS264: Beyond Worst-Case Analysis Lecture #18: Smoothed Complexity and Pseudopolynomial-Time Algorithms Tim Roughgarden March 9, 2017 1 Preamble Our first lecture on smoothed analysis sought a better theoretical

More information

Hybrid particle swarm algorithm for solving nonlinear constraint. optimization problem [5].

Hybrid particle swarm algorithm for solving nonlinear constraint. optimization problem [5]. Hybrid particle swarm algorithm for solving nonlinear constraint optimization problems BINGQIN QIAO, XIAOMING CHANG Computers and Software College Taiyuan University of Technology Department of Economic

More information

Problems for 3505 (2011)

Problems for 3505 (2011) Problems for 505 (2011) 1. In the simplex of genotype distributions x + y + z = 1, for two alleles, the Hardy- Weinberg distributions x = p 2, y = 2pq, z = q 2 (p + q = 1) are characterized by y 2 = 4xz.

More information

Mechanisms of Emergent Computation in Cellular Automata

Mechanisms of Emergent Computation in Cellular Automata Mechanisms of Emergent Computation in Cellular Automata Wim Hordijk, James P. Crutchfield, Melanie Mitchell Santa Fe Institute, 1399 Hyde Park Road, Santa Fe, 87501 NM, USA email: {wim,chaos,mm}@santafe.edu

More information

Gaussian EDA and Truncation Selection: Setting Limits for Sustainable Progress

Gaussian EDA and Truncation Selection: Setting Limits for Sustainable Progress Gaussian EDA and Truncation Selection: Setting Limits for Sustainable Progress Petr Pošík Czech Technical University, Faculty of Electrical Engineering, Department of Cybernetics Technická, 66 7 Prague

More information

ARTIFICIAL NEURAL NETWORK WITH HYBRID TAGUCHI-GENETIC ALGORITHM FOR NONLINEAR MIMO MODEL OF MACHINING PROCESSES

ARTIFICIAL NEURAL NETWORK WITH HYBRID TAGUCHI-GENETIC ALGORITHM FOR NONLINEAR MIMO MODEL OF MACHINING PROCESSES International Journal of Innovative Computing, Information and Control ICIC International c 2013 ISSN 1349-4198 Volume 9, Number 4, April 2013 pp. 1455 1475 ARTIFICIAL NEURAL NETWORK WITH HYBRID TAGUCHI-GENETIC

More information

A Lower Bound Analysis of Population-based Evolutionary Algorithms for Pseudo-Boolean Functions

A Lower Bound Analysis of Population-based Evolutionary Algorithms for Pseudo-Boolean Functions A Lower Bound Analysis of Population-based Evolutionary Algorithms for Pseudo-Boolean Functions Chao Qian,2, Yang Yu 2, and Zhi-Hua Zhou 2 UBRI, School of Computer Science and Technology, University of

More information

Genetic Algorithms and Genetic Programming Lecture 17

Genetic Algorithms and Genetic Programming Lecture 17 Genetic Algorithms and Genetic Programming Lecture 17 Gillian Hayes 28th November 2006 Selection Revisited 1 Selection and Selection Pressure The Killer Instinct Memetic Algorithms Selection and Schemas

More information

A Parallel Evolutionary Approach to Multi-objective Optimization

A Parallel Evolutionary Approach to Multi-objective Optimization A Parallel Evolutionary Approach to Multi-objective Optimization Xiang Feng Francis C.M. Lau Department of Computer Science, The University of Hong Kong, Hong Kong Abstract Evolutionary algorithms have

More information

A Mixed Strategy for Evolutionary Programming Based on Local Fitness Landscape

A Mixed Strategy for Evolutionary Programming Based on Local Fitness Landscape WCCI 200 IEEE World Congress on Computational Intelligence July, 8-23, 200 - CCIB, Barcelona, Spain CEC IEEE A Mixed Strategy for Evolutionary Programming Based on Local Fitness Landscape Liang Shen and

More information

AMULTIOBJECTIVE optimization problem (MOP) can

AMULTIOBJECTIVE optimization problem (MOP) can 1 IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION 1 Letters 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 Decomposition-Based Multiobjective Evolutionary Algorithm with an Ensemble of Neighborhood Sizes Shi-Zheng

More information

Haploid-Diploid Algorithms

Haploid-Diploid Algorithms Haploid-Diploid Algorithms Larry Bull Department of Computer Science & Creative Technologies University of the West of England Bristol BS16 1QY, U.K. +44 (0)117 3283161 Larry.Bull@uwe.ac.uk LETTER Abstract

More information

Systems Biology: A Personal View IX. Landscapes. Sitabhra Sinha IMSc Chennai

Systems Biology: A Personal View IX. Landscapes. Sitabhra Sinha IMSc Chennai Systems Biology: A Personal View IX. Landscapes Sitabhra Sinha IMSc Chennai Fitness Landscapes Sewall Wright pioneered the description of how genotype or phenotypic fitness are related in terms of a fitness

More information

3D HP Protein Folding Problem using Ant Algorithm

3D HP Protein Folding Problem using Ant Algorithm 3D HP Protein Folding Problem using Ant Algorithm Fidanova S. Institute of Parallel Processing BAS 25A Acad. G. Bonchev Str., 1113 Sofia, Bulgaria Phone: +359 2 979 66 42 E-mail: stefka@parallel.bas.bg

More information

Multi-objective genetic algorithm

Multi-objective genetic algorithm Multi-objective genetic algorithm Robin Devooght 31 March 2010 Abstract Real world problems often present multiple, frequently conflicting, objectives. The research for optimal solutions of multi-objective

More information

Analysis of Photoluminescence measurement data from interdiffused Quantum Wells using Adaptive Real coded Quantum inspired Evolutionary Algorithm

Analysis of Photoluminescence measurement data from interdiffused Quantum Wells using Adaptive Real coded Quantum inspired Evolutionary Algorithm Analysis of Photoluminescence measurement data from interdiffused Quantum Wells using Adaptive Real coded Quantum inspired Evolutionary Algorithm 1 Sr. Lecturer, USIC Dayalbagh Educational Institute, Dayalbagh,

More information

Discrete Tranformation of Output in Cellular Automata

Discrete Tranformation of Output in Cellular Automata Discrete Tranformation of Output in Cellular Automata Aleksander Lunøe Waage Master of Science in Computer Science Submission date: July 2012 Supervisor: Gunnar Tufte, IDI Norwegian University of Science

More information

Bounded Approximation Algorithms

Bounded Approximation Algorithms Bounded Approximation Algorithms Sometimes we can handle NP problems with polynomial time algorithms which are guaranteed to return a solution within some specific bound of the optimal solution within

More information

CS264: Beyond Worst-Case Analysis Lecture #15: Smoothed Complexity and Pseudopolynomial-Time Algorithms

CS264: Beyond Worst-Case Analysis Lecture #15: Smoothed Complexity and Pseudopolynomial-Time Algorithms CS264: Beyond Worst-Case Analysis Lecture #15: Smoothed Complexity and Pseudopolynomial-Time Algorithms Tim Roughgarden November 5, 2014 1 Preamble Previous lectures on smoothed analysis sought a better

More information

Artificial Neural Networks Examination, March 2004

Artificial Neural Networks Examination, March 2004 Artificial Neural Networks Examination, March 2004 Instructions There are SIXTY questions (worth up to 60 marks). The exam mark (maximum 60) will be added to the mark obtained in the laborations (maximum

More information

Capacitor Placement for Economical Electrical Systems using Ant Colony Search Algorithm

Capacitor Placement for Economical Electrical Systems using Ant Colony Search Algorithm Capacitor Placement for Economical Electrical Systems using Ant Colony Search Algorithm Bharat Solanki Abstract The optimal capacitor placement problem involves determination of the location, number, type

More information

Fuzzy adaptive catfish particle swarm optimization

Fuzzy adaptive catfish particle swarm optimization ORIGINAL RESEARCH Fuzzy adaptive catfish particle swarm optimization Li-Yeh Chuang, Sheng-Wei Tsai, Cheng-Hong Yang. Institute of Biotechnology and Chemical Engineering, I-Shou University, Kaohsiung, Taiwan

More information

Santa Claus Schedules Jobs on Unrelated Machines

Santa Claus Schedules Jobs on Unrelated Machines Santa Claus Schedules Jobs on Unrelated Machines Ola Svensson (osven@kth.se) Royal Institute of Technology - KTH Stockholm, Sweden March 22, 2011 arxiv:1011.1168v2 [cs.ds] 21 Mar 2011 Abstract One of the

More information

Evolutionary Algorithms How to Cope With Plateaus of Constant Fitness and When to Reject Strings of The Same Fitness

Evolutionary Algorithms How to Cope With Plateaus of Constant Fitness and When to Reject Strings of The Same Fitness Evolutionary Algorithms How to Cope With Plateaus of Constant Fitness and When to Reject Strings of The Same Fitness Thomas Jansen and Ingo Wegener FB Informatik, LS 2, Univ. Dortmund, 44221 Dortmund,

More information

Intuitionistic Fuzzy Estimation of the Ant Methodology

Intuitionistic Fuzzy Estimation of the Ant Methodology BULGARIAN ACADEMY OF SCIENCES CYBERNETICS AND INFORMATION TECHNOLOGIES Volume 9, No 2 Sofia 2009 Intuitionistic Fuzzy Estimation of the Ant Methodology S Fidanova, P Marinov Institute of Parallel Processing,

More information

Data Mining. Preamble: Control Application. Industrial Researcher s Approach. Practitioner s Approach. Example. Example. Goal: Maintain T ~Td

Data Mining. Preamble: Control Application. Industrial Researcher s Approach. Practitioner s Approach. Example. Example. Goal: Maintain T ~Td Data Mining Andrew Kusiak 2139 Seamans Center Iowa City, Iowa 52242-1527 Preamble: Control Application Goal: Maintain T ~Td Tel: 319-335 5934 Fax: 319-335 5669 andrew-kusiak@uiowa.edu http://www.icaen.uiowa.edu/~ankusiak

More information

Metaheuristics and Local Search

Metaheuristics and Local Search Metaheuristics and Local Search 8000 Discrete optimization problems Variables x 1,..., x n. Variable domains D 1,..., D n, with D j Z. Constraints C 1,..., C m, with C i D 1 D n. Objective function f :

More information

Evolutionary Programming Using a Mixed Strategy Adapting to Local Fitness Landscape

Evolutionary Programming Using a Mixed Strategy Adapting to Local Fitness Landscape Evolutionary Programming Using a Mixed Strategy Adapting to Local Fitness Landscape Liang Shen Department of Computer Science Aberystwyth University Ceredigion, SY23 3DB UK lls08@aber.ac.uk Jun He Department

More information

LandscapeEC: Adding Geographical Structure to Cellular Evolutionary Algorithms

LandscapeEC: Adding Geographical Structure to Cellular Evolutionary Algorithms LandscapeEC: Adding Geographical Structure to Cellular Evolutionary Algorithms Lucas Ellgren and Nicholas Freitag McPhee Division of Science and Mathematics University of Minnesota, Morris Morris, MN 562367

More information

Forecasting & Futurism

Forecasting & Futurism Article from: Forecasting & Futurism December 2013 Issue 8 A NEAT Approach to Neural Network Structure By Jeff Heaton Jeff Heaton Neural networks are a mainstay of artificial intelligence. These machine-learning

More information

Multi-objective Quadratic Assignment Problem instances generator with a known optimum solution

Multi-objective Quadratic Assignment Problem instances generator with a known optimum solution Multi-objective Quadratic Assignment Problem instances generator with a known optimum solution Mădălina M. Drugan Artificial Intelligence lab, Vrije Universiteit Brussel, Pleinlaan 2, B-1050 Brussels,

More information

Quad-trees: A Data Structure for Storing Pareto-sets in Multi-objective Evolutionary Algorithms with Elitism

Quad-trees: A Data Structure for Storing Pareto-sets in Multi-objective Evolutionary Algorithms with Elitism Quad-trees: A Data Structure for Storing Pareto-sets in Multi-objective Evolutionary Algorithms with Elitism Sanaz Mostaghim 1 and Jürgen Teich 2 1 Electrical Engineering Department University of Paderborn,

More information

Truncation Selection and Gaussian EDA: Bounds for Sustainable Progress in High-Dimensional Spaces

Truncation Selection and Gaussian EDA: Bounds for Sustainable Progress in High-Dimensional Spaces Truncation Selection and Gaussian EDA: Bounds for Sustainable Progress in High-Dimensional Spaces Petr Pošík Czech Technical University in Prague Faculty of Electrical Engineering, Department of Cybernetics

More information

A Genetic Algorithm Approach for Doing Misuse Detection in Audit Trail Files

A Genetic Algorithm Approach for Doing Misuse Detection in Audit Trail Files A Genetic Algorithm Approach for Doing Misuse Detection in Audit Trail Files Pedro A. Diaz-Gomez and Dean F. Hougen Robotics, Evolution, Adaptation, and Learning Laboratory (REAL Lab) School of Computer

More information

Metaheuristics and Local Search. Discrete optimization problems. Solution approaches

Metaheuristics and Local Search. Discrete optimization problems. Solution approaches Discrete Mathematics for Bioinformatics WS 07/08, G. W. Klau, 31. Januar 2008, 11:55 1 Metaheuristics and Local Search Discrete optimization problems Variables x 1,...,x n. Variable domains D 1,...,D n,

More information

Revisiting the Edge of Chaos: Evolving Cellular Automata to Perform Computations

Revisiting the Edge of Chaos: Evolving Cellular Automata to Perform Computations Revisiting the Edge of Chaos: Evolving Cellular Automata to Perform Computations Melanie Mitchell 1, Peter T. Hraber 1, and James P. Crutchfield 2 Abstract We present results from an experiment similar

More information

EECS 229A Spring 2007 * * (a) By stationarity and the chain rule for entropy, we have

EECS 229A Spring 2007 * * (a) By stationarity and the chain rule for entropy, we have EECS 229A Spring 2007 * * Solutions to Homework 3 1. Problem 4.11 on pg. 93 of the text. Stationary processes (a) By stationarity and the chain rule for entropy, we have H(X 0 ) + H(X n X 0 ) = H(X 0,

More information

THE PROBLEM OF locating all the optima within a fitness

THE PROBLEM OF locating all the optima within a fitness IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, VOL. 11, NO. 4, AUGUST 2007 453 Where Are the Niches? Dynamic Fitness Sharing Antonio Della Cioppa, Member, IEEE, Claudio De Stefano, and Angelo Marcelli,

More information

Design Of Optimal Pid Controller Using Genetic Algorithm

Design Of Optimal Pid Controller Using Genetic Algorithm Australian Journal of Basic and Applied Sciences, 5(10): 996-1001, 2011 ISSN 1991-8178 Design Of Optimal Pid Controller Using Genetic Algorithm 1 Mohammad Reza Dastranj, 1 Kazem Esmaeili Khoshmardan, 2

More information

The Evolution of Gene Dominance through the. Baldwin Effect

The Evolution of Gene Dominance through the. Baldwin Effect The Evolution of Gene Dominance through the Baldwin Effect Larry Bull Computer Science Research Centre Department of Computer Science & Creative Technologies University of the West of England, Bristol

More information

Artificial Intelligence (AI) Common AI Methods. Training. Signals to Perceptrons. Artificial Neural Networks (ANN) Artificial Intelligence

Artificial Intelligence (AI) Common AI Methods. Training. Signals to Perceptrons. Artificial Neural Networks (ANN) Artificial Intelligence Artificial Intelligence (AI) Artificial Intelligence AI is an attempt to reproduce intelligent reasoning using machines * * H. M. Cartwright, Applications of Artificial Intelligence in Chemistry, 1993,

More information