arxiv: v3 [cs.ne] 5 Jun 2013

Size: px
Start display at page:

Download "arxiv: v3 [cs.ne] 5 Jun 2013"

Transcription

1 A Hybrd Bat Algorthm Iztok Fster Jr., Dušan Fster, and Xn-She Yang Abstract Swarm ntellgence s a very powerful technque to be used for optmzaton purposes. In ths paper we present a new swarm ntellgence algorthm, based on the bat algorthm. The Bat algorthm s hybrdzed wth dfferental evoluton strateges. Besdes showng very promsng arxv: v3 [cs.ne] 5 Jun 2013 results of the standard benchmark functons, ths hybrdzaton also sgnfcantly mproves the orgnal bat algorthm. To cte paper as follows: I. Jr. Fster, D. Fster, X.-S Yang. A hybrd bat algorthm. Elektrotehnšk vestnk, 2013, n press. Unversty of Marbor, Faculty of electrcal engneerng and computer scence Smetanova 17, 2000 Marbor; Electronc address: ztok.fster@guest.arnes.s Unversty of Marbor, Faculty of mechancal engneerng Smetanova 17, 2000 Marbor; Electronc address: dusan.fster@un-mb.s Mddlesex Unversty, School of Scence and Technology London NW4 4BT, UK; Electronc address: x.yang@mdx.ac.uk 1

2 I. INTRODUCTION Nature has always been an nspraton for researchers. In the past, many new naturenspred algorthms have been developed to solve hard problems n optmzaton. In general, there are two man concepts developed n bo-nspred computaton: 1. evolutonary algorthms, 2. swarm ntellgence algorthms. The Evolutonary algorthms are optmzaton technques [7] that base on the Darwn s prncple of survval of the fttest [5]. It states that n nature the fttest ndvduals have greater chances to survve. The Evolutonary algorthms consst of the followng dscplnes: genetc algorthms, evoluton strateges, genetc programmng, evolutonary programmng, dfferental evoluton. Although all these algorthms or methods have been developed ndependently, they share smlar characterstcs (lke varaton operators, selecton operators) when solvng problems. In fact, the evolutonary algorthms are dstngushed by ther representaton of solutons. For example, the genetc algorthms [15, 16] support the bnary representaton of solutons, evoluton strateges [2, 11] and dfferental evoluton [3, 6, 29] work on real-valued solutons, genetc programmng [21] acts on programs n Lsp, whle the evolutonary programmng [13] behaves wth the fnsh state automata. The Evolutonary algorthms have been appled to a wde range of areas of optmzaton, modelng and smulaton. Essentally, the dfferental evoluton has successfully been employed n the followng areas of optmzaton: functon optmzaton [28], large-scale global optmzaton [4], graph colorng [8], chemcal-process optmzaton [1]. Swarm ntellgence s a collectve behavour of decentralzed, self-organzed systems, ether natural or artfcal. Swarm ntellgence was ntroduced by Ben n A lot of algorthms have been proposed snce then. The Swarm-ntellgence algorthms have been appled on contnuous as well as combnatoral optmzaton problems [25]. The most well-known classes of the swarm-ntellgence algorthms are: partcle swarm optmzaton, ant colony optmzaton, artfcal bee colony, frefly algorthm, cuckoo search and bat algorthm. Partcle swarm optmzaton has been successfully appled n problems of the antenna desgn [17] and electromagnetcs [27]. The Ant colony algorthms have also been used n 2

3 many areas of optmzaton [20] [26] [22]. The Artfcal bee colony shows good performance n numercal optmzaton [18] [19], n large-scale global optmzaton [10] and also n combnatoral optmzaton [24] [9] [30]. The Cuckoo search algorthm s a very strong method for functon optmzaton and also for engneerng optmzaton problems [34] [33]. The Frefly algorthm shows promsng results n functon optmzaton and provdes good results also n combnatoral optmzaton [12]. Echolocaton s an mportant feature of bat behavour. That means that bats emt a sound pulse and lsten to the echo bouncng back from obstacles whlst flyng. Ths phenomenon has nspred Yang [36] to develop the Bat Algorthm (BA). The algorthm shows good results when dealng wth lower-dmensonal optmzaton problems, but may become problematc for hgher-dmensonal problems because of ts tendng to converge very fast ntally. On the other hand, the dfferental evoluton [23] s a typcal evolutonary algorthm wth dfferental mutaton, crossover and selecton that s beng successfully appled to contnuous functon optmzaton. To mprove the bat-algorthm behavour for hgher-dmensonal problems, we hybrdzed the orgnal bat algorthm by usng dfferental-evoluton strateges. Ths Hybrdzed Bat Algorthm (HBA) was tested on a standard set of benchmark functons taken from lterature. Results of our numercal experments show that the proposed HBA can sgnfcantly mprove the performance of the orgnal BA, whch can be very useful for the future. The structure of the paper s as follows. In Secton 2, we ntroduced the orgnal BA and the dfferental evoluton algorthm and explan some bologcal foundatons of the bat behavour. In Secton 3 we descrbe our novel approach to hybrdzng the bat algorthm wth dfferental evoluton strateges. In Secton 4 we llustrate our experments and dscuss the obtaned results. The paper ends by presentng our plans for future work on HBA development. II. BAT ALGORITHM The Bat algorthm was developed by Xn-She Yang n 2010 [35]. The algorthm explots the so-called echolocaton of the bats. The bats use sonar echoes to detect and avod obstacles. It s generally known that sound pulses are transformed nto a frequency whch reflects 3

4 from obstacles. The bats navgate by usng the tme delay from emsson to reflecton. They typcally emt short, loud sound mpulses. The pulse rate s usually defned as 10 to 20 tmes per second. After httng and reflectng, the bats transform ther own pulse nto useful nformaton to gauge how far away the prey s. The bats are usng wavelengths that vary n the range from 0.7 to 17 mm or nbound frequences of khz. To mplement the algorthm, the pulse frequency and the rate have to be defned. The pulse rate can be smply determned n the range from 0 to 1, where 0 means that there s no emsson and 1 means that the bats emttng s ther maxmum [14, 31, 37]. The bat behavour can be used to formulate a new BA. Yang [35] used three generalzed rules when mplementng the bat algorthms: 1. All the bats use an echolocaton to sense the dstance and they also guess the dfference between the food/prey and background barrers n a somewhat magcal way. 2. When searchng for ther prey, the bats fly randomly wth velocty v at poston x wth fxed frequency f mn, varyng wavelength λ and loudness A 0. They can automatcally adjust the wavelength (or frequency) of ther emtted pulses and adjust the rate of pulse emsson r [0, 1], dependng on the proxmty of ther target. 3. Although the loudness can vary n many ways, we assume that t vares from a large (postve) A 0 to a mnmum constant value A mn. 4

5 Algorthm 1 Orgnal Bat Algorthm 1: Objectve functon f(x), x = (x 1,..., x d ) T 2: Intalze the bat populaton x and v for = 1... n 3: Defne pulse frequency Q [Q mn, Q max ] 4: Intalze pulse rates r and the loudness A 5: whle (t < T max ) // number of teratons 6: Generate new solutons by adjustng frequency and 7: update veloctes and locatons/solutons [Eq.(2) to (4)] 8: f(rand(0, 1) > r ) 9: Select a soluton among the best solutons 10: Generate a local soluton around the best soluton 11: end f 12: Generate a new soluton by flyng randomly 13: f(rand(0, 1) < A and f(x ) < f(x)) 14: Accept the new solutons 15: Increase r and reduce A 16: end f 17: Rank the bats and fnd the current best 18: end 19: Postprocess results and vsualzaton The orgnal BA s llustrated n Algorthm 1. In ths algorthm, the bat behavour s captured nto the ftness functon of the problem to be solved. It conssts of the followng components: ntalzaton (lnes 2-4), generaton of new solutons (lnes 6-7), local search (lnes 8-11), generaton of a new soluton by flyng randomly (lnes 12-16) and fnd the current best soluton. 5

6 Intalzaton of the bat populaton s performed randomly. Generatng new solutons s performed by movng vrtual bats accordng to the followng equatons: Q (t) = Q mn + (Q max Q mn )U(0, 1), v (t+1) x (t+1) = v t + (x t best)q (t), = x (t) + v (t), (1) where U(0, 1) s a unform dstrbuton. A random walk wth drect explotaton s used for the local search that modfes the current best soluton accordng to equaton: x (t) = best + ɛa (t) (2U(0, 1) 1), (2) where ɛ s the scalng factor, and A (t) the loudness. The local search s launched wth the proxmty dependng on pulse rate r. The term n lne 13 s smlar to the smulated annealng behavor, where the new soluton s accepted wth some proxmty dependng on parameter A. In lne wth ths, the rate of pulse emsson r ncreases and the loudness A decreases. Both characterstcs mtate the natural bats, where the rate of the pulse emsson ncreases and the loudness decreases when a bat fnds ts prey. Mathematcally, these characterstcs are captured wth the followng equatons: A (t+1) = αa (t), r (t) = r (0) [1 exp( γɛ)], (3) where α and γ are constants. Actually, α parameter plays a smlar role as the coolng factor n the smulated annealng algorthm that controls the convergence rate of ths algorthm. III. DIFFERENTIAL EVOLUTION Dfferental evoluton (DE)[29][6] s a technque for the optmzaton ntroduced by Storn and Prce n DE optmzes a problem by mantanng a populaton of canddate solutons and creates new canddate solutons by combnng the exstng ones accordng to ts smple formulae, and then keepng whchever canddate soluton has the best score or ftness on the optmzaton problem at hand. DE supports a dfferental mutaton, a 6

7 dfferental crossover and a dfferental selecton. In partcular, the dfferental mutaton randomly selects two solutons and adds a scaled dfference between these to the thrd soluton. Ths mutaton can be expressed as follows: u (t) = w (t) r0 + F (w(t) r1 w(t) r2 ), for = 1... NP, (4) where F [0.1, 1.0] denotes the scalng factor as a postve real number that scales the rate of modfcaton whle r0, r1, r2 are randomly selected vectors n the nterval 1... NP. A unform crossover s employed as a dfferental crossover by DE. The tral vector s bult out of parameter values coped from two dfferent solutons. Mathematcally, ths crossover can be expressed as follows: z,j = u (t),j rand j (0, 1) CR j = j rand, w (t),j otherwse, (5) where CR [0.0, 1.0] controls the fracton of parameters that are coped to the tral soluton. Note, the relaton j = j rand assures that the tral vector s dfferent from the orgnal soluton Y (t). Mathematcally, dfferental selecton can be expressed as follows: w (t+1) = z (t) w (t) f f(z (t) ) f(y (t) ), otherwse. (6) In the techncal sense, the crossover and mutaton can be performed n many ways n DE. Therefore, a specfc notaton was used to descrbe the varety of these methods (also strateges) n general. For example, DE/rand/1/bn denotes that the base vector s randomly selected, one vector dfference s added to t, and the number of modfed parameters n the mutaton vector follows the bnomal dstrbuton. IV. HYBRID BAT ALGORITHM As mentoned above, n ths artcle we propose a new BA, called Hybrd Bat Algorthm (HBA). It was obtaned by hybrdzng the orgnal BA usng the DE strateges. The HBA pseudo-code s llustrated n Algorthm 2. 7

8 Algorthm 2 Hybrd Bat Algorthm 1: Objectve functon f(x), x = (x 1,..., x d ) T 2: Intalze the bat populaton x and v for = 1... n 3: Defne pulse frequency Q [Q mn, Q max ] 4: Intalze pulse rates r and the loudness A 5: whle (t < T max ) // number of teratons 6: Generate new solutons by adjustng frequency and 7: updatng veloctes and locatons/solutons [Eq.(2) to (4)] 8: f(rand(0, 1) > r ) 9: Modfy the soluton usng DE/rand/1/bn 10: end f 11: Generate a new soluton by flyng randomly 12: f(rand(0, 1) < A and f(x ) < f(x)) 13: Accept the new solutons 14: Increase r and reduce A 15: end f 16: Rank the bats and fnd the current best 17: end 18: Postprocess results and vsualzaton As a result, HBA dffers from the orgnal BA n lne 9, where soluton s modfed usng DE/rand/1/bn strategy. V. EXPERIMENTS AND RESULTS The goal of our experments was to show that HBA sgnfcantly mproves the results of the orgnal BA. For ths purpose, two BAs were mplemented accordng to specfcatons gven n Algorthms 1 and 2 so that a well-selected set of test functons n the lterature are used for optmzaton benchmarks. The parameters of the two BAs were the same. The dmenson of the problem sgnfcantly affects the results optmzaton. To test the mpact of the problem dmenson on the results, three dfferent 8

9 sets of dmensons were taken nto account,.e., D = 10, D = 20, and D = 30. The functons wth dmenson D = 10 were lmted to maxmally 1,000 generatons, the functons wth dmenson D = 20 to twce as much, whle the functons wth dmenson D = 30 to 3,000. The ntal loudness was set to A 0 = 0.5 and so was also the ntal pulse rate (r 0 = 0.5). The frequency was taken from nterval Q [0.0, 2.0]. The algorthms optmzed each functon 25 tmes and results were measured accordng to the best, worst, mean, and medum values n these runs. The standard devaton of the mean values was calculated as well. A. Test sute Our test sute conssts of fve standard functons taken from lterature [32]. The functons n ths test sute are represented below. 1. The Grewangk s functon The am of the functon s overcomng falures to optmze each varable ndependently. Ths functon s multmodal, snce the number of local optma ncreases wth the dmensonalty. After dmensonaltes are suffcently hgh (n > 30), multmodalty seems to dsappear and the problem turns to be unmodal. f 1 ( x) = D =1 cos ( x ) + D =1 where 600 x 600. The global mnmum of the functon s at 0. x 2 + 1, (7) The Rosenbrock s functon As n case of the Rastrgn s functon, the Rosenbrock s functon too, has ts value 0 at the global mnmum. The global optmum s nsde the parabolc, narrow-shaped flat valley. Varables are strongly dependent on each other, snce t s dffcult to converge the global optmum. where x f 2 ( x ) = D (x +1 x 2 ) 2 + (x 1) 2, (8) =1 9

10 3. Sphere functon where x f 3 ( x ) = D =1 x 2, (9) 4. The Rastrgn s functon Based of the Sphere s functon, the Rastrgn s functon adds cosne modulaton to create many local mnma. Because of ths feature, the functon s multmodal. Its global mnmum s at 0. where x f 4 ( x ) = n 10 + n =1 (x 2 10 cos(2πx )), (10) 5. The Ackley s functon The complexty of ths functon s moderate because of the exponental term that covers ts surface wth numerous local mnma. It s based on the gradent slope. Only the algorthm that uses the gradent steepest descent wll be trapped n a local optmum. The search strategy, analyzng a wder area, wll be able to cross the valley among the optma and acheve better results. f 5 (x) = n 1 =1 [20+e 20e (x x2 ) e 0.5(cos(2πx +1)+cos(2πx )) ], where x The global mnmum of ths functon s at 0. (11) B. PC confguraton Confguraton of PC used n our experments s as follows: HP Pavlon g4, processor Intel(R) Core(TM) 2.40 GHz, 10

11 memory 8 GB, mplemented n C++. TABLE I: The results of experments Alg. D Value f 1 f 2 f 3 f 4 f 5 BA Best 3.29E E E E E+01 Worst 1.73E E E E E Mean 8.30E E E E E+01 Medan 3.91E E E E E+00 StDev 6.94E E E E E+01 Best 8.77E E E E E+02 Worst 1.43E E E E E Mean 1.46E E E E E+02 Medan 1.90E E E E E+05 StDev 1.64E E E E E+01 Best 1.58E E E E E+02 Worst 4.18E E E E E Mean 1.51E E E E E+02 Medan 4.66E E E E E+06 StDev 1.52E E E E E+01 Best 2.25E E E E E-04 Worst 3.97E E E E E Mean 3.18E E E E E+01 Medan 8.66E E E E E+00 StDev 1.14E E E E E+01 Best 1.01E E E E E-05 Worst 2.96E E E E E+01 HBA 20 Mean 8.56E E E E E-05 Medan 3.60E E E E E+02 StDev 2.17E E E E E+01 Best 6.38E E E E E-04 Worst 3.57E E E E E Mean 6.42E E E E E-03 Medan 5.99E E E E E+02 StDev 3.12E E E E E+01 11

12 C. Experment results The results of our extensve numercal experments are summarzed n Table I. The table represents results of BA and HBA algorthms (column 1) solvng the test sute of fve functons (denoted as f 1, f 2, f 3, f 4, f 5 ) wth dmensons D = 10, 20 and 30, respectvely, accordng to the best, worst, mean, medan, and standard devaton values. The results of the HBA algorthm show that ths algorthm sgnfcantly mproves the results of the orgnal BA algorthm accordng to almost all the measures safe for the standard devaton n some cases (e.g., when usng Ackley s functon). There was no statstcal analyss of the results made because they are evdently better for HBA than for BA. To show how the results of the two algorthms (.e., BA and HBA) vary wth the dmensons of the functons, the mean value of functons f 1 and f 3 wth dmensons D = 10, D = 20, and D = 30 are presented n Fgs The logarthmc scale s used to dsplay the mean value on the y-axs. The hgher the mean value, the more dffcult the functon s to solve. Mean value 1.0e e e e e e-08 BA HBA 1.0e-10 D=10 D=20 D=30 Dmensons FIG. 1: Mean value of functon f 1 wth varous dmensons. As seen from Fg. 1, the best results are obtaned by optmzng functon f 1 wth the dmenson D = 20, whle the worst by optmzng the same functon wth the hghest dmenson D = 30. It s nterestng to note that the mean value of functon f 5 wth dmenson D = 10 s most dffcult to obtan for the HBA algorthm, whle the same functon but wth dmenson D = 20 s the easest to solve. Oppostely, the results of the orgnal BA algorthm show that by ncreasng the dmensons, the results become worsen. 12

13 Mean value 1.0e e e e e e-08 BA HBA 1.0e-10 D=10 D=20 D=30 Dmensons FIG. 2: Mean value of functon f 3 wth varous dmensons. Mean value 1.0e e e e e e-08 BA HBA 1.0e-10 D=10 D=20 D=30 Dmensons FIG. 3: Mean value of functon f 5 wth varous dmensons. As seen from Fg. 2, solvng functon f 3 becomes more effcent when the dmensonalty of the problem ncreases. As a result, the most dffcult functon to solve s functon f 3 wth dmenson D = 30. Comparng the results obtaned wth the BA and the HBA algorthm shows that the results of HBA sgnfcantly outperform the results of the orgnal BA algorthm by optmzng the functons f 1, f 3, and f 5. Functons f 2 and f 4 of the HBA algorthm are also better, but the dfference s not sgnfcant. VI. CONCLUSION In ths paper we mprove the bat algorthm, BA, by developng ts new varant, the socalled hybrd bat algorthm, HBA. HBA s a hybrd of BA wth DE strateges. As shown wth our experments, HBA mproves sgnfcantly the orgnal varant of BA. In future, HBA 13

14 wll be tested on a large-scale global optmzaton. Our testng wll be extended by usng more dverse test functon sets and by deepenng our parametrc study. [1] BV Babu and R. Angra. Modfed dfferental evoluton (mde) for optmzaton of non-lnear chemcal processes. Computers & chemcal engneerng, 30(6): , [2] T. Bäck. Evolutonary algorthms n theory and practce - evoluton strateges, evolutonary programmng, genetc algorthms. Oxford Unversty Press, [3] J. Brest, S. Grener, B. Boskovc, M. Mernk, and V. Zumer. Self-adaptng control parameters n dfferental evoluton: A comparatve study on numercal benchmark problems. Evolutonary Computaton, IEEE Transactons on, 10(6): , [4] J. Brest, A. Zamuda, I. Fster, and M.S. Maucec. Large scale global optmzaton usng selfadaptve dfferental evoluton algorthm. In Evolutonary Computaton (CEC), 2010 IEEE Congress on, pages 1 8. IEEE, [5] C. Darwn. The orgn of speces. John Murray, London, UK, [6] S. Das and P.N. Suganthan. Dfferental evoluton: A survey of the state-of-the-art. Evolutonary Computaton, IEEE Transactons on, 15(1):4 31, [7] A.E. Eben and J.E. Smth. Introducton to Evolutonary Computng. Sprnger-Verlag, Berln, [8] I. Fster and J. Brest. Usng dfferental evoluton for the graph colorng. In Dfferental Evoluton (SDE), 2011 IEEE Symposum on, pages 1 7. IEEE, [9] I. Fster, I. Fster, and J. Brest. A hybrd artfcal bee colony algorthm for graph 3-colorng. Swarm and Evolutonary Computaton, pages 66 74, [10] I. Fster, I. Fster Jr, and J.B.V. Zumer. Memetc artfcal bee colony algorthm for large-scale global optmzaton. In Evolutonary Computaton (CEC), 2012 IEEE Congress on, pages 1 8. IEEE, [11] I. Fster, M. Mernk, and B. Flpč. Graph 3-colorng wth a hybrd self-adaptve evolutonary algorthm. Computatonal optmzaton and applcatons, pages 1 32, [12] I. Fster Jr, X.S. Yang, I. Fster, and J. Brest. Memetc frefly algorthm for combnatoral optmzaton. arxv preprnt arxv: , [13] L. J. Fogel, A. J. Owens, and M. J. Walsh. Artfcal Intellgence through Smulated Evoluton. 14

15 John Wley, New York, USA, [14] A.H. Gandom, X.S. Yang, A.H. Alav, and S. Talatahar. Bat algorthm for constraned optmzaton tasks. Neural Computng & Applcatons, pages 1 17, [15] D. Goldberg. Genetc Algorthms n Search, Optmzaton, and Machne Learnng. Addson- Wesley, MA, [16] John H. Holland. Adaptaton n Natural and Artfcal Systems: An Introductory Analyss wth Applcatons to Bology, Control and Artfcal Intellgence. MIT Press, Cambrdge, MA, USA, [17] N. Jn and Y. Rahmat-Sam. Advances n partcle swarm optmzaton for antenna desgns: Real-number, bnary, sngle-objectve and multobjectve mplementatons. Antennas and Propagaton, IEEE Transactons on, 55(3): , [18] D. Karaboga and B. Basturk. A powerful and effcent algorthm for numercal functon optmzaton: artfcal bee colony (abc) algorthm. Journal of Global Optmzaton, 39(3): , [19] D. Karaboga and B. Basturk. On the performance of artfcal bee colony (abc) algorthm. Appled Soft Computng, 8(1): , [20] P. Korošec, J. Šlc, and B. Flpč. The dfferental ant-stgmergy algorthm. Informaton Scences, [21] John R. Koza. Genetc programmng 2 - automatc dscovery of reusable programs. Complex adaptve systems. MIT Press, [22] D. Merkle, M. Mddendorf, and H. Schmeck. Ant colony optmzaton for resource-constraned project schedulng. Evolutonary Computaton, IEEE Transactons on, 6(4): , [23] F. Ner and V. Trronen. Recent advances n dfferental evoluton: a survey and expermental analyss. Artfcal Intellgence Revew, 33(1 2):61 106, [24] Q.K. Pan, M. Fath Tasgetren, P.N. Suganthan, and T.J. Chua. A dscrete artfcal bee colony algorthm for the lot-streamng flow shop schedulng problem. Informaton scences, 181(12): , [25] RS Parpnell and HS Lopes. New nspratons n swarm ntellgence: a survey. Internatonal Journal of Bo-Inspred Computaton, 3(1):1 16, [26] R.S. Parpnell, H.S. Lopes, and A.A. Fretas. Data mnng wth an ant colony optmzaton algorthm. Evolutonary Computaton, IEEE Transactons on, 6(4): ,

16 [27] J. Robnson and Y. Rahmat-Sam. Partcle swarm optmzaton n electromagnetcs. Antennas and Propagaton, IEEE Transactons on, 52(2): , [28] Y. Sh, H. Teng, and Z. L. Cooperatve co-evolutonary dfferental evoluton for functon optmzaton. Advances n natural computaton, pages , [29] R. Storn and K. Prce. Dfferental evoluton a smple and effcent heurstc for global optmzaton over contnuous spaces. Journal of global optmzaton, 11(4): , [30] M.F. Tasgetren, Q.K. Pan, P.N. Suganthan, and A.H.L. Chen. A dscrete artfcal bee colony algorthm for the permutaton flow shop schedulng problem wth total flowtme crteron. In Evolutonary Computaton (CEC), 2010 IEEE Congress on, pages 1 8. IEEE, [31] P.W. Tsa, J.S. Pan, B.Y. Lao, M.J. Tsa, and V. Istanda. Bat algorthm nspred algorthm for solvng numercal optmzaton problems. Appled Mechancs and Materals, 148: , [32] X.-S. Yang. Appendx a: Test problems n optmzaton. In X.-S. Yang, edtor, Engneerng Optmzaton, pages John Wley & Sons, Inc., Hoboken, NJ, USA, [33] X.-S. Yang, S. Deb. Cuckoo search va lévy flghts. In Nature & Bologcally Inspred Computng, NaBIC World Congress on, pages IEEE, [34] X.-S. Yang, S. Deb. Engneerng optmsaton by cuckoo search. Internatonal Journal of Mathematcal Modellng and Numercal Optmsaton, 1(4): , [35] X.S. Yang. A new metaheurstc bat-nspred algorthm. Nature Inspred Cooperatve Strateges for Optmzaton (NICSO 2010), pages 65 74, [36] X.S. Yang. Bat algorthm for mult-objectve optmsaton. Internatonal Journal of Bo- Inspred Computaton, 3(5): , [37] X.S. Yang. Revew of meta-heurstcs and generalsed evolutonary walk algorthm. Internatonal Journal of Bo-Inspred Computaton, 3(2):77 84, Updated 30 Aprl

The Study of Teaching-learning-based Optimization Algorithm

The Study of Teaching-learning-based Optimization Algorithm Advanced Scence and Technology Letters Vol. (AST 06), pp.05- http://dx.do.org/0.57/astl.06. The Study of Teachng-learnng-based Optmzaton Algorthm u Sun, Yan fu, Lele Kong, Haolang Q,, Helongang Insttute

More information

arxiv: v1 [math.oc] 3 Aug 2010

arxiv: v1 [math.oc] 3 Aug 2010 arxv:1008.0549v1 math.oc] 3 Aug 2010 Test Problems n Optmzaton Xn-She Yang Department of Engneerng, Unversty of Cambrdge, Cambrdge CB2 1PZ, UK Abstract Test functons are mportant to valdate new optmzaton

More information

Multi-agent system based on self-adaptive differential evolution for solving dynamic optimization problems

Multi-agent system based on self-adaptive differential evolution for solving dynamic optimization problems Mult-agent system based on self-adaptve dfferental evoluton for solvng dynamc optmzaton problems Aleš Čep Faculty of Electrcal Engneerng and Computer Scence Unversty of Marbor ales.cep@um.s ABSTRACT Ths

More information

Research Article A Novel Hybrid Self-Adaptive Bat Algorithm

Research Article A Novel Hybrid Self-Adaptive Bat Algorithm e Scentfc World Journal, Artcle I 709738, 12 pages http://dx.do.org/10.1155/2014/709738 Research Artcle A Novel Hybrd Self-Adaptve Bat Algorthm Iztok Fster Jr., 1 Smon Fong, 2 Janez Brest, 1 and Iztok

More information

Artificial neural network regression as a local search heuristic for ensemble strategies in differential evolution

Artificial neural network regression as a local search heuristic for ensemble strategies in differential evolution Nonlnear Dyn (2016) 84:895 914 DOI 10.1007/s11071-015-2537-8 ORIGINAL PAPER Artfcal neural network regresson as a local search heurstc for ensemble strateges n dfferental evoluton Iztok Fster Ponnuthura

More information

Solving of Single-objective Problems based on a Modified Multiple-crossover Genetic Algorithm: Test Function Study

Solving of Single-objective Problems based on a Modified Multiple-crossover Genetic Algorithm: Test Function Study Internatonal Conference on Systems, Sgnal Processng and Electroncs Engneerng (ICSSEE'0 December 6-7, 0 Duba (UAE Solvng of Sngle-objectve Problems based on a Modfed Multple-crossover Genetc Algorthm: Test

More information

MODIFIED PARTICLE SWARM OPTIMIZATION FOR OPTIMIZATION PROBLEMS

MODIFIED PARTICLE SWARM OPTIMIZATION FOR OPTIMIZATION PROBLEMS Journal of Theoretcal and Appled Informaton Technology 3 st ecember 0. Vol. No. 005 0 JATIT & LLS. All rghts reserved. ISSN: 9985 www.jatt.org EISSN: 87395 MIFIE PARTICLE SARM PTIMIZATIN FR PTIMIZATIN

More information

Markov Chain Monte Carlo Lecture 6

Markov Chain Monte Carlo Lecture 6 where (x 1,..., x N ) X N, N s called the populaton sze, f(x) f (x) for at least one {1, 2,..., N}, and those dfferent from f(x) are called the tral dstrbutons n terms of mportance samplng. Dfferent ways

More information

Real Parameter Single Objective Optimization using Self-Adaptive Differential Evolution Algorithm with more Strategies

Real Parameter Single Objective Optimization using Self-Adaptive Differential Evolution Algorithm with more Strategies Real Parameter Sngle Objectve Optmzaton usng Self-Adaptve Dfferental Evoluton Algorthm wth more Strateges Janez Brest, Borko Boškovć, Aleš Zamuda, Iztok Fster Insttute of Computer Scence, Faculty of Electrcal

More information

Particle Swarm Optimization with Adaptive Mutation in Local Best of Particles

Particle Swarm Optimization with Adaptive Mutation in Local Best of Particles 1 Internatonal Congress on Informatcs, Envronment, Energy and Applcatons-IEEA 1 IPCSIT vol.38 (1) (1) IACSIT Press, Sngapore Partcle Swarm Optmzaton wth Adaptve Mutaton n Local Best of Partcles Nanda ulal

More information

The Convergence Speed of Single- And Multi-Objective Immune Algorithm Based Optimization Problems

The Convergence Speed of Single- And Multi-Objective Immune Algorithm Based Optimization Problems The Convergence Speed of Sngle- And Mult-Obectve Immune Algorthm Based Optmzaton Problems Mohammed Abo-Zahhad Faculty of Engneerng, Electrcal and Electroncs Engneerng Department, Assut Unversty, Assut,

More information

An Adaptive Learning Particle Swarm Optimizer for Function Optimization

An Adaptive Learning Particle Swarm Optimizer for Function Optimization An Adaptve Learnng Partcle Swarm Optmzer for Functon Optmzaton Changhe L and Shengxang Yang Abstract Tradtonal partcle swarm optmzaton (PSO) suffers from the premature convergence problem, whch usually

More information

Modified Seeker Optimization Algorithm for Unconstrained Optimization Problems

Modified Seeker Optimization Algorithm for Unconstrained Optimization Problems Modfed Seeker Optmzaton Algorthm for Unconstraned Optmzaton Problems Ivona BRAJEVIC Mlan TUBA Faculty of Mathematcs Faculty of Computer Scence Unversty of Belgrade Megatrend Unversty Belgrade Studentsk

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

Design and Optimization of Fuzzy Controller for Inverse Pendulum System Using Genetic Algorithm

Design and Optimization of Fuzzy Controller for Inverse Pendulum System Using Genetic Algorithm Desgn and Optmzaton of Fuzzy Controller for Inverse Pendulum System Usng Genetc Algorthm H. Mehraban A. Ashoor Unversty of Tehran Unversty of Tehran h.mehraban@ece.ut.ac.r a.ashoor@ece.ut.ac.r Abstract:

More information

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS HCMC Unversty of Pedagogy Thong Nguyen Huu et al. A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS Thong Nguyen Huu and Hao Tran Van Department of mathematcs-nformaton,

More information

A Novel Hybrid Bat Algorithm for the Multilevel Thresholding Medical Image Segmentation

A Novel Hybrid Bat Algorithm for the Multilevel Thresholding Medical Image Segmentation RESEARCH ARTICLE Copyrght 2015 Amercan Scentfc Publshers All rghts reserved Prnted n the Unted States of Amerca Journal of Medcal Imagng and Health Informatcs Vol. 5, 1 5, 2015 A Novel Hybrd Bat Algorthm

More information

A Study on Improved Cockroach Swarm Optimization Algorithm

A Study on Improved Cockroach Swarm Optimization Algorithm A Study on Improved Cockroach Swarm Optmzaton Algorthm 1 epartment of Computer Scence and Engneerng, Huaan Vocatonal College of Informaton Technology,Huaan 223003, Chna College of Computer and Informaton,

More information

Research Article An Enhanced Differential Evolution with Elite Chaotic Local Search

Research Article An Enhanced Differential Evolution with Elite Chaotic Local Search Computatonal Intellgence and Neuroscence Volume 215, Artcle ID 583759, 11 pages http://dx.do.org/1.1155/215/583759 Research Artcle An Enhanced Dfferental Evoluton wth Elte Chaotc Local Search Zhaolu Guo,

More information

A Hybrid Differential Evolution Algorithm Game Theory for the Berth Allocation Problem

A Hybrid Differential Evolution Algorithm Game Theory for the Berth Allocation Problem A Hybrd Dfferental Evoluton Algorthm ame Theory for the Berth Allocaton Problem Nasser R. Sabar, Sang Yew Chong, and raham Kendall The Unversty of Nottngham Malaysa Campus, Jalan Broga, 43500 Semenyh,

More information

Entropy Generation Minimization of Pin Fin Heat Sinks by Means of Metaheuristic Methods

Entropy Generation Minimization of Pin Fin Heat Sinks by Means of Metaheuristic Methods Indan Journal of Scence and Technology Entropy Generaton Mnmzaton of Pn Fn Heat Snks by Means of Metaheurstc Methods Amr Jafary Moghaddam * and Syfollah Saedodn Department of Mechancal Engneerng, Semnan

More information

Differential Evolution Algorithm with a Modified Archiving-based Adaptive Tradeoff Model for Optimal Power Flow

Differential Evolution Algorithm with a Modified Archiving-based Adaptive Tradeoff Model for Optimal Power Flow 1 Dfferental Evoluton Algorthm wth a Modfed Archvng-based Adaptve Tradeoff Model for Optmal Power Flow 2 Outlne Search Engne Constrant Handlng Technque Test Cases and Statstcal Results 3 Roots of Dfferental

More information

THE general problem tackled using an optimization

THE general problem tackled using an optimization Hgh-Dmensonal Real-Parameter Optmzaton usng Self-Adaptve Dfferental Evoluton Algorthm wth Populaton Sze Reducton Janez Brest, Member, IEEE, Aleš Zamuda, Student Member, IEEE, BorkoBoškovć, Student Member,

More information

Solving Design of Pressure Vessel Engineering Problem Using a Fruit Fly Optimization Algorithm

Solving Design of Pressure Vessel Engineering Problem Using a Fruit Fly Optimization Algorithm Solvng Desgn of Pressure Vessel Engneerng Problem Usng a Frut Fly Optmzaton Algorthm Xantng Ke, Yongsen Zhang, Yuchuan L,, * and Tngsong Du College of Scence, Chna Three Gorges Unversty, Ychang 44300,

More information

Self-adaptive Differential Evolution Algorithm for Constrained Real-Parameter Optimization

Self-adaptive Differential Evolution Algorithm for Constrained Real-Parameter Optimization 26 IEEE Congress on Evolutonary Computaton Sheraton Vancouver Wall Centre Hotel, Vancouver, BC, Canada July 16-21, 26 Self-adaptve Dfferental Evoluton Algorthm for Constraned Real-Parameter Optmzaton V.

More information

Week3, Chapter 4. Position and Displacement. Motion in Two Dimensions. Instantaneous Velocity. Average Velocity

Week3, Chapter 4. Position and Displacement. Motion in Two Dimensions. Instantaneous Velocity. Average Velocity Week3, Chapter 4 Moton n Two Dmensons Lecture Quz A partcle confned to moton along the x axs moves wth constant acceleraton from x =.0 m to x = 8.0 m durng a 1-s tme nterval. The velocty of the partcle

More information

V is the velocity of the i th

V is the velocity of the i th Proceedngs of the 007 IEEE Swarm Intellgence Symposum (SIS 007) Probablstcally rven Partcle Swarms for Optmzaton of Mult Valued screte Problems : esgn and Analyss Kalyan Veeramachanen, Lsa Osadcw, Ganapath

More information

Research Article Towards the Novel Reasoning among Particles in PSO by the Use of RDF and SPARQL

Research Article Towards the Novel Reasoning among Particles in PSO by the Use of RDF and SPARQL e Scentfc World Journal, Artcle I 121782, 10 pages http://dx.do.org/10.1155/2014/121782 Research Artcle Towards the Novel Reasonng among Partcles n PSO by the Use of RF and SPARQL Iztok Fster Jr., 1 Xn-She

More information

CHAPTER IV RESEARCH FINDING AND DISCUSSIONS

CHAPTER IV RESEARCH FINDING AND DISCUSSIONS CHAPTER IV RESEARCH FINDING AND DISCUSSIONS A. Descrpton of Research Fndng. The Implementaton of Learnng Havng ganed the whole needed data, the researcher then dd analyss whch refers to the statstcal data

More information

A Hybrid Variational Iteration Method for Blasius Equation

A Hybrid Variational Iteration Method for Blasius Equation Avalable at http://pvamu.edu/aam Appl. Appl. Math. ISSN: 1932-9466 Vol. 10, Issue 1 (June 2015), pp. 223-229 Applcatons and Appled Mathematcs: An Internatonal Journal (AAM) A Hybrd Varatonal Iteraton Method

More information

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons

More information

Comparison of the Population Variance Estimators. of 2-Parameter Exponential Distribution Based on. Multiple Criteria Decision Making Method

Comparison of the Population Variance Estimators. of 2-Parameter Exponential Distribution Based on. Multiple Criteria Decision Making Method Appled Mathematcal Scences, Vol. 7, 0, no. 47, 07-0 HIARI Ltd, www.m-hkar.com Comparson of the Populaton Varance Estmators of -Parameter Exponental Dstrbuton Based on Multple Crtera Decson Makng Method

More information

Wavelet chaotic neural networks and their application to continuous function optimization

Wavelet chaotic neural networks and their application to continuous function optimization Vol., No.3, 04-09 (009) do:0.436/ns.009.307 Natural Scence Wavelet chaotc neural networks and ther applcaton to contnuous functon optmzaton Ja-Ha Zhang, Yao-Qun Xu College of Electrcal and Automatc Engneerng,

More information

Using Immune Genetic Algorithm to Optimize BP Neural Network and Its Application Peng-fei LIU1,Qun-tai SHEN1 and Jun ZHI2,*

Using Immune Genetic Algorithm to Optimize BP Neural Network and Its Application Peng-fei LIU1,Qun-tai SHEN1 and Jun ZHI2,* Advances n Computer Scence Research (ACRS), volume 54 Internatonal Conference on Computer Networks and Communcaton Technology (CNCT206) Usng Immune Genetc Algorthm to Optmze BP Neural Network and Its Applcaton

More information

Markov Chain Monte Carlo (MCMC), Gibbs Sampling, Metropolis Algorithms, and Simulated Annealing Bioinformatics Course Supplement

Markov Chain Monte Carlo (MCMC), Gibbs Sampling, Metropolis Algorithms, and Simulated Annealing Bioinformatics Course Supplement Markov Chan Monte Carlo MCMC, Gbbs Samplng, Metropols Algorthms, and Smulated Annealng 2001 Bonformatcs Course Supplement SNU Bontellgence Lab http://bsnuackr/ Outlne! Markov Chan Monte Carlo MCMC! Metropols-Hastngs

More information

Research Article Simulated Annealing-Based Krill Herd Algorithm for Global Optimization

Research Article Simulated Annealing-Based Krill Herd Algorithm for Global Optimization Hndaw Publshng Corporaton Abstract and Appled Analyss Volume 2013, Artcle ID 213853, 11 pages http://dx.do.org/10.1155/2013/213853 Research Artcle Smulated Annealng-Based Krll Herd Algorthm for Global

More information

Appendix B: Resampling Algorithms

Appendix B: Resampling Algorithms 407 Appendx B: Resamplng Algorthms A common problem of all partcle flters s the degeneracy of weghts, whch conssts of the unbounded ncrease of the varance of the mportance weghts ω [ ] of the partcles

More information

An Interactive Optimisation Tool for Allocation Problems

An Interactive Optimisation Tool for Allocation Problems An Interactve Optmsaton ool for Allocaton Problems Fredr Bonäs, Joam Westerlund and apo Westerlund Process Desgn Laboratory, Faculty of echnology, Åbo Aadem Unversty, uru 20500, Fnland hs paper presents

More information

A Novel Evolutionary Algorithm for Capacitor Placement in Distribution Systems

A Novel Evolutionary Algorithm for Capacitor Placement in Distribution Systems DOI.703/s40707-013-0003-x STF Journal of Engneerng Technology (JET), Vol. No. 3, Dec 013 A Novel Evolutonary Algorthm for Capactor Placement n Dstrbuton Systems J-Pyng Chou and Chung-Fu Chang Abstract

More information

Discrete Particle Swarm Optimization for TSP: Theoretical Results and Experimental Evaluations

Discrete Particle Swarm Optimization for TSP: Theoretical Results and Experimental Evaluations Dscrete Partcle Swarm Optmzaton for TSP: Theoretcal Results and Expermental Evaluatons Matthas Hoffmann, Mortz Mühlenthaler, Sabne Helwg, Rolf Wanka Department of Computer Scence, Unversty of Erlangen-Nuremberg,

More information

An Improved Clustering Based Genetic Algorithm for Solving Complex NP Problems

An Improved Clustering Based Genetic Algorithm for Solving Complex NP Problems Journal of Computer Scence 7 (7): 1033-1037, 2011 ISSN 1549-3636 2011 Scence Publcatons An Improved Clusterng Based Genetc Algorthm for Solvng Complex NP Problems 1 R. Svaraj and 2 T. Ravchandran 1 Department

More information

Comparative Analysis of SPSO and PSO to Optimal Power Flow Solutions

Comparative Analysis of SPSO and PSO to Optimal Power Flow Solutions Internatonal Journal for Research n Appled Scence & Engneerng Technology (IJRASET) Volume 6 Issue I, January 018- Avalable at www.jraset.com Comparatve Analyss of SPSO and PSO to Optmal Power Flow Solutons

More information

AN EFFICIENT METHOD BASED ON ABC FOR OPTIMAL MULTILEVEL THRESHOLDING *

AN EFFICIENT METHOD BASED ON ABC FOR OPTIMAL MULTILEVEL THRESHOLDING * IJST, Transactons of Electrcal Engneerng, Vol. 6, No. E, pp 7-9 Prnted n The Islamc Republc of Iran, 0 Shraz Unversty AN EFFICIENT METHOD BASED ON ABC FOR OPTIMAL MULTILEVEL THRESHOLDING * S. A. MOHAMMADI,

More information

SPECTRAL ANALYSIS USING EVOLUTION STRATEGIES

SPECTRAL ANALYSIS USING EVOLUTION STRATEGIES SPECTRAL ANALYSIS USING EVOLUTION STRATEGIES J. FEDERICO RAMÍREZ AND OLAC FUENTES Insttuto Naconal de Astrofísca, Óptca y Electrónca Lus Enrque Erro # 1 Santa María Tonanzntla, Puebla, 784, Méxco framrez@cseg.naoep.mx,

More information

Self-Adaptive Simulated Binary Crossover for Real-Parameter Optimization

Self-Adaptive Simulated Binary Crossover for Real-Parameter Optimization Self-Adaptve Smulated Bnary Crossover for Real-Parameter Optmzaton Kalyanmoy Deb Dept. of Mechancal Engneerng Indan Inst. of Tech. Kanpur Kanpur, PIN 20806, Inda deb@tk.ac.n S. Karthk Dept. of Mechancal

More information

An Extended Hybrid Genetic Algorithm for Exploring a Large Search Space

An Extended Hybrid Genetic Algorithm for Exploring a Large Search Space 2nd Internatonal Conference on Autonomous Robots and Agents Abstract An Extended Hybrd Genetc Algorthm for Explorng a Large Search Space Hong Zhang and Masum Ishkawa Graduate School of L.S.S.E., Kyushu

More information

Feature Selection: Part 1

Feature Selection: Part 1 CSE 546: Machne Learnng Lecture 5 Feature Selecton: Part 1 Instructor: Sham Kakade 1 Regresson n the hgh dmensonal settng How do we learn when the number of features d s greater than the sample sze n?

More information

Exploratory Toolkit for Evolutionary And Swarm based Optimization

Exploratory Toolkit for Evolutionary And Swarm based Optimization Exploratory Toolkt for Evolutonary And Swarm based Optmzaton Namrata Khemka, Chrstan Jacob Unversty of Calgary, Calgary, AB, Canada, T2N1N4 {khemka, jacob}@cpsc.ucalgary.ca Optmzaton of parameters or systems

More information

Generalized Linear Methods

Generalized Linear Methods Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set

More information

Simulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests

Simulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests Smulated of the Cramér-von Mses Goodness-of-Ft Tests Steele, M., Chaselng, J. and 3 Hurst, C. School of Mathematcal and Physcal Scences, James Cook Unversty, Australan School of Envronmental Studes, Grffth

More information

Application of B-Spline to Numerical Solution of a System of Singularly Perturbed Problems

Application of B-Spline to Numerical Solution of a System of Singularly Perturbed Problems Mathematca Aeterna, Vol. 1, 011, no. 06, 405 415 Applcaton of B-Splne to Numercal Soluton of a System of Sngularly Perturbed Problems Yogesh Gupta Department of Mathematcs Unted College of Engneerng &

More information

The optimal solution prediction for genetic and distribution building algorithms with binary representation

The optimal solution prediction for genetic and distribution building algorithms with binary representation IOP Conference Seres: Materals Scence and Engneerng OPEN ACCESS The optmal soluton predcton for genetc and dstrbuton buldng algorthms wth bnary representaton To cte ths artcle: E Sopov and O Semenkna 05

More information

A discrete differential evolution algorithm for multi-objective permutation flowshop scheduling

A discrete differential evolution algorithm for multi-objective permutation flowshop scheduling A dscrete dfferental evoluton algorthm for mult-objectve permutaton flowshop schedulng M. Baolett, A. Mlan, V. Santucc Dpartmento d Matematca e Informatca Unverstà degl Stud d Peruga Va Vanvtell, 1 Peruga,

More information

Research Article Adaptive Parameters for a Modified Comprehensive Learning Particle Swarm Optimizer

Research Article Adaptive Parameters for a Modified Comprehensive Learning Particle Swarm Optimizer Hndaw Publshng Corporaton Mathematcal Problems n Engneerng Volume 2012, Artcle ID 207318, 11 pages do:10.1155/2012/207318 Research Artcle Adaptve Parameters for a Modfed Comprehensve Learnng Partcle Swarm

More information

A New Evolutionary Computation Based Approach for Learning Bayesian Network

A New Evolutionary Computation Based Approach for Learning Bayesian Network Avalable onlne at www.scencedrect.com Proceda Engneerng 15 (2011) 4026 4030 Advanced n Control Engneerng and Informaton Scence A New Evolutonary Computaton Based Approach for Learnng Bayesan Network Yungang

More information

Analysis of Material Removal Rate using Genetic Algorithm Approach

Analysis of Material Removal Rate using Genetic Algorithm Approach Internatonal Journal of Scentfc & Engneerng Research Volume 3, Issue 5, May-2012 1 Analyss of Materal Removal Rate usng Genetc Algorthm Approach Ishwer Shvakot, Sunny Dyaley, Golam Kbra, B.B. Pradhan Abstract

More information

Comparative Study between FPA, BA, MCS, ABC, and PSO Algorithms in Training and Optimizing of LS-SVM for Stock Market Prediction

Comparative Study between FPA, BA, MCS, ABC, and PSO Algorithms in Training and Optimizing of LS-SVM for Stock Market Prediction Comparatve Study between FPA, BA, MCS, ABC, and PSO Algorthms n ranng and Optmzng of LS-SVM for Stock Market Predcton Osman Hegazy 1*, Omar S. Solman 1 and Mustafa Abdul Salam 2 Faculty of Computers and

More information

Utilizing cumulative population distribution information in differential evolution

Utilizing cumulative population distribution information in differential evolution Utlzng cumulatve populaton dstrbuton nformaton n dfferental evoluton Yong Wang a,b, Zh-Zhong Lu a, Janbn L c, Han-Xong L d, e, Gary G. Yen f a School of Informaton Scence and Engneerng, Central South Unversty,

More information

A novel hybrid algorithm with marriage of particle swarm optimization and extremal optimization

A novel hybrid algorithm with marriage of particle swarm optimization and extremal optimization A novel hybrd algorthm wth marrage of partcle swarm optmzaton and extremal optmzaton Mn-Rong Chen 1, Yong-Za Lu 1, Q Luo 2 1 Department of Automaton, Shangha Jaotong Unversty, Shangha 200240, P.R.Chna

More information

A new hybrid artificial bee colony algorithm for global optimization

A new hybrid artificial bee colony algorithm for global optimization IJCSI Internatonal Journal o Computer Scence Issues, Vol., Issue, No, January ISSN (Prnt): 69-78 ISSN (Onlne): 69-8 www.ijcsi.org 87 A new hybrd artcal bee colony algorthm or global optmzaton Xangyu Kong,

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

THE ROBUSTNESS OF GENETIC ALGORITHMS IN SOLVING UNCONSTRAINED BUILDING OPTIMIZATION PROBLEMS

THE ROBUSTNESS OF GENETIC ALGORITHMS IN SOLVING UNCONSTRAINED BUILDING OPTIMIZATION PROBLEMS Nnth Internatonal IBPSA Conference Montréal, Canada August 5-8, 2005 THE ROBUSTNESS OF GENETIC ALGORITHMS IN SOLVING UNCONSTRAINED BUILDING OPTIMIZATION PROBLEMS Jonathan Wrght, and Al Alajm Department

More information

An Improved multiple fractal algorithm

An Improved multiple fractal algorithm Advanced Scence and Technology Letters Vol.31 (MulGraB 213), pp.184-188 http://dx.do.org/1.1427/astl.213.31.41 An Improved multple fractal algorthm Yun Ln, Xaochu Xu, Jnfeng Pang College of Informaton

More information

FUZZY GOAL PROGRAMMING VS ORDINARY FUZZY PROGRAMMING APPROACH FOR MULTI OBJECTIVE PROGRAMMING PROBLEM

FUZZY GOAL PROGRAMMING VS ORDINARY FUZZY PROGRAMMING APPROACH FOR MULTI OBJECTIVE PROGRAMMING PROBLEM Internatonal Conference on Ceramcs, Bkaner, Inda Internatonal Journal of Modern Physcs: Conference Seres Vol. 22 (2013) 757 761 World Scentfc Publshng Company DOI: 10.1142/S2010194513010982 FUZZY GOAL

More information

THEORY OF GENETIC ALGORITHMS WITH α-selection. André Neubauer

THEORY OF GENETIC ALGORITHMS WITH α-selection. André Neubauer THEORY OF GENETIC ALGORITHMS WITH α-selection André Neubauer Informaton Processng Systems Lab Münster Unversty of Appled Scences Stegerwaldstraße 39, D-48565 Stenfurt, Germany Emal: andre.neubauer@fh-muenster.de

More information

EEE 241: Linear Systems

EEE 241: Linear Systems EEE : Lnear Systems Summary #: Backpropagaton BACKPROPAGATION The perceptron rule as well as the Wdrow Hoff learnng were desgned to tran sngle layer networks. They suffer from the same dsadvantage: they

More information

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS Avalable onlne at http://sck.org J. Math. Comput. Sc. 3 (3), No., 6-3 ISSN: 97-537 COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

More information

High resolution entropy stable scheme for shallow water equations

High resolution entropy stable scheme for shallow water equations Internatonal Symposum on Computers & Informatcs (ISCI 05) Hgh resoluton entropy stable scheme for shallow water equatons Xaohan Cheng,a, Yufeng Ne,b, Department of Appled Mathematcs, Northwestern Polytechncal

More information

Global Sensitivity. Tuesday 20 th February, 2018

Global Sensitivity. Tuesday 20 th February, 2018 Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values

More information

VARIATION OF CONSTANT SUM CONSTRAINT FOR INTEGER MODEL WITH NON UNIFORM VARIABLES

VARIATION OF CONSTANT SUM CONSTRAINT FOR INTEGER MODEL WITH NON UNIFORM VARIABLES VARIATION OF CONSTANT SUM CONSTRAINT FOR INTEGER MODEL WITH NON UNIFORM VARIABLES BÂRZĂ, Slvu Faculty of Mathematcs-Informatcs Spru Haret Unversty barza_slvu@yahoo.com Abstract Ths paper wants to contnue

More information

Electromagnetic Algorithm for tuning the structure and parameters of Neural Networks

Electromagnetic Algorithm for tuning the structure and parameters of Neural Networks Electromagnetc Algorthm for tunng the structure and parameters of Neural Networks Ayad Mashaan Turky, Salwan Abdullah and Nasser R. Sabar Abstract Electromagnetc algorthm s a populaton based meta-heurstc

More information

(Online First)A Lattice Boltzmann Scheme for Diffusion Equation in Spherical Coordinate

(Online First)A Lattice Boltzmann Scheme for Diffusion Equation in Spherical Coordinate Internatonal Journal of Mathematcs and Systems Scence (018) Volume 1 do:10.494/jmss.v1.815 (Onlne Frst)A Lattce Boltzmann Scheme for Dffuson Equaton n Sphercal Coordnate Debabrata Datta 1 *, T K Pal 1

More information

A New Scrambling Evaluation Scheme based on Spatial Distribution Entropy and Centroid Difference of Bit-plane

A New Scrambling Evaluation Scheme based on Spatial Distribution Entropy and Centroid Difference of Bit-plane A New Scramblng Evaluaton Scheme based on Spatal Dstrbuton Entropy and Centrod Dfference of Bt-plane Lang Zhao *, Avshek Adhkar Kouch Sakura * * Graduate School of Informaton Scence and Electrcal Engneerng,

More information

The Black Hole Clustering Algorithm Based on Membrane Computing

The Black Hole Clustering Algorithm Based on Membrane Computing Internatonal Symposum on Computers & Informatcs (ISCI 2015) The Black Hole Clusterng Algorthm Based on Membrane Computng Qan L 1, a, Zheng Pe 2, b 1 Center for Rado Admnstraton & Technology Development,

More information

Journal of Applied Research and Technology ISSN: Centro de Ciencias Aplicadas y Desarrollo Tecnológico.

Journal of Applied Research and Technology ISSN: Centro de Ciencias Aplicadas y Desarrollo Tecnológico. Journal of Appled Research and Technology ISSN: 1665-6423 jart@aleph.cnstrum.unam.mx Centro de Cencas Aplcadas y Desarrollo Tecnológco Méxco Lu Chun-Lang; Chu Shh-Yuan; Hsu Chh-Hsu; Yen Sh-Jm Enhanced

More information

Pattern Classification

Pattern Classification Pattern Classfcaton All materals n these sldes ere taken from Pattern Classfcaton (nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John Wley & Sons, 000 th the permsson of the authors and the publsher

More information

A Hybrid Mutation-based Artificial Bee Colony for Traveling Salesman Problem

A Hybrid Mutation-based Artificial Bee Colony for Traveling Salesman Problem A Hybrd Mutaton-based Artfcal Bee Colony for Travelng Salesman Problem Shma Sabet and Fardad Farokh Islamc Azad Unversty of Central Tehran Branch, Tehran, Iran Emal: sh_sabet25@yahoo.com, f_farokh@auctb.ac.r

More information

The Minimum Universal Cost Flow in an Infeasible Flow Network

The Minimum Universal Cost Flow in an Infeasible Flow Network Journal of Scences, Islamc Republc of Iran 17(2): 175-180 (2006) Unversty of Tehran, ISSN 1016-1104 http://jscencesutacr The Mnmum Unversal Cost Flow n an Infeasble Flow Network H Saleh Fathabad * M Bagheran

More information

CONTRAST ENHANCEMENT FOR MIMIMUM MEAN BRIGHTNESS ERROR FROM HISTOGRAM PARTITIONING INTRODUCTION

CONTRAST ENHANCEMENT FOR MIMIMUM MEAN BRIGHTNESS ERROR FROM HISTOGRAM PARTITIONING INTRODUCTION CONTRAST ENHANCEMENT FOR MIMIMUM MEAN BRIGHTNESS ERROR FROM HISTOGRAM PARTITIONING N. Phanthuna 1,2, F. Cheevasuvt 2 and S. Chtwong 2 1 Department of Electrcal Engneerng, Faculty of Engneerng Rajamangala

More information

MMA and GCMMA two methods for nonlinear optimization

MMA and GCMMA two methods for nonlinear optimization MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons

More information

COMPOSITE BEAM WITH WEAK SHEAR CONNECTION SUBJECTED TO THERMAL LOAD

COMPOSITE BEAM WITH WEAK SHEAR CONNECTION SUBJECTED TO THERMAL LOAD COMPOSITE BEAM WITH WEAK SHEAR CONNECTION SUBJECTED TO THERMAL LOAD Ákos Jósef Lengyel, István Ecsed Assstant Lecturer, Professor of Mechancs, Insttute of Appled Mechancs, Unversty of Mskolc, Mskolc-Egyetemváros,

More information

Tensor Smooth Length for SPH Modelling of High Speed Impact

Tensor Smooth Length for SPH Modelling of High Speed Impact Tensor Smooth Length for SPH Modellng of Hgh Speed Impact Roman Cherepanov and Alexander Gerasmov Insttute of Appled mathematcs and mechancs, Tomsk State Unversty 634050, Lenna av. 36, Tomsk, Russa RCherepanov82@gmal.com,Ger@npmm.tsu.ru

More information

Supporting Information

Supporting Information Supportng Informaton The neural network f n Eq. 1 s gven by: f x l = ReLU W atom x l + b atom, 2 where ReLU s the element-wse rectfed lnear unt, 21.e., ReLUx = max0, x, W atom R d d s the weght matrx to

More information

Difference Equations

Difference Equations Dfference Equatons c Jan Vrbk 1 Bascs Suppose a sequence of numbers, say a 0,a 1,a,a 3,... s defned by a certan general relatonshp between, say, three consecutve values of the sequence, e.g. a + +3a +1

More information

Chapter 13: Multiple Regression

Chapter 13: Multiple Regression Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to

More information

Numerical Heat and Mass Transfer

Numerical Heat and Mass Transfer Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and

More information

Chapter Newton s Method

Chapter Newton s Method Chapter 9. Newton s Method After readng ths chapter, you should be able to:. Understand how Newton s method s dfferent from the Golden Secton Search method. Understand how Newton s method works 3. Solve

More information

Finding Dense Subgraphs in G(n, 1/2)

Finding Dense Subgraphs in G(n, 1/2) Fndng Dense Subgraphs n Gn, 1/ Atsh Das Sarma 1, Amt Deshpande, and Rav Kannan 1 Georga Insttute of Technology,atsh@cc.gatech.edu Mcrosoft Research-Bangalore,amtdesh,annan@mcrosoft.com Abstract. Fndng

More information

Kernel Methods and SVMs Extension

Kernel Methods and SVMs Extension Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general

More information

Week 5: Neural Networks

Week 5: Neural Networks Week 5: Neural Networks Instructor: Sergey Levne Neural Networks Summary In the prevous lecture, we saw how we can construct neural networks by extendng logstc regresson. Neural networks consst of multple

More information

Economic dispatch solution using efficient heuristic search approach

Economic dispatch solution using efficient heuristic search approach Leonardo Journal of Scences Economc dspatch soluton usng effcent heurstc search approach Samr SAYAH QUERE Laboratory, Faculty of Technology, Electrcal Engneerng Department, Ferhat Abbas Unversty, Setf

More information

Parameter Estimation for Dynamic System using Unscented Kalman filter

Parameter Estimation for Dynamic System using Unscented Kalman filter Parameter Estmaton for Dynamc System usng Unscented Kalman flter Jhoon Seung 1,a, Amr Atya F. 2,b, Alexander G.Parlos 3,c, and Klto Chong 1,4,d* 1 Dvson of Electroncs Engneerng, Chonbuk Natonal Unversty,

More information

Research Article Improved Bat Algorithm Applied to Multilevel Image Thresholding

Research Article Improved Bat Algorithm Applied to Multilevel Image Thresholding e Scentfc World Journal, Artcle ID 176718, 16 pages http://dx.do.org/10.11/2014/176718 Research Artcle Improved Bat Algorthm Appled to Multlevel Image Thresholdng Ads Alhodzc 1 and Mlan Tuba 2 1 Faculty

More information

CS-433: Simulation and Modeling Modeling and Probability Review

CS-433: Simulation and Modeling Modeling and Probability Review CS-433: Smulaton and Modelng Modelng and Probablty Revew Exercse 1. (Probablty of Smple Events) Exercse 1.1 The owner of a camera shop receves a shpment of fve cameras from a camera manufacturer. Unknown

More information

A HYBRID DIFFERENTIAL EVOLUTION -ITERATIVE GREEDY SEARCH ALGORITHM FOR CAPACITATED VEHICLE ROUTING PROBLEM

A HYBRID DIFFERENTIAL EVOLUTION -ITERATIVE GREEDY SEARCH ALGORITHM FOR CAPACITATED VEHICLE ROUTING PROBLEM IJCMA: Vol. 6, No. 1, January-June 2012, pp. 1-19 Global Research Publcatons A HYBRID DIFFERENTIAL EVOLUTION -ITERATIVE GREEDY SEARCH ALGORITHM FOR CAPACITATED VEHICLE ROUTING PROBLEM S. Kavtha and Nrmala

More information

Chapter 3 Describing Data Using Numerical Measures

Chapter 3 Describing Data Using Numerical Measures Chapter 3 Student Lecture Notes 3-1 Chapter 3 Descrbng Data Usng Numercal Measures Fall 2006 Fundamentals of Busness Statstcs 1 Chapter Goals To establsh the usefulness of summary measures of data. The

More information

829. An adaptive method for inertia force identification in cantilever under moving mass

829. An adaptive method for inertia force identification in cantilever under moving mass 89. An adaptve method for nerta force dentfcaton n cantlever under movng mass Qang Chen 1, Mnzhuo Wang, Hao Yan 3, Haonan Ye 4, Guola Yang 5 1,, 3, 4 Department of Control and System Engneerng, Nanng Unversty,

More information

Neuro-Adaptive Design - I:

Neuro-Adaptive Design - I: Lecture 36 Neuro-Adaptve Desgn - I: A Robustfyng ool for Dynamc Inverson Desgn Dr. Radhakant Padh Asst. Professor Dept. of Aerospace Engneerng Indan Insttute of Scence - Bangalore Motvaton Perfect system

More information

Solving Nonlinear Differential Equations by a Neural Network Method

Solving Nonlinear Differential Equations by a Neural Network Method Solvng Nonlnear Dfferental Equatons by a Neural Network Method Luce P. Aarts and Peter Van der Veer Delft Unversty of Technology, Faculty of Cvlengneerng and Geoscences, Secton of Cvlengneerng Informatcs,

More information

Introduction to Vapor/Liquid Equilibrium, part 2. Raoult s Law:

Introduction to Vapor/Liquid Equilibrium, part 2. Raoult s Law: CE304, Sprng 2004 Lecture 4 Introducton to Vapor/Lqud Equlbrum, part 2 Raoult s Law: The smplest model that allows us do VLE calculatons s obtaned when we assume that the vapor phase s an deal gas, and

More information