ROUGH SESTS-INSPIRED EVOLUTIONARY ALGORITHM FOR ENGINEERING MULTIOBJECTIVE OPTIMIZATION PROBLEMS

Size: px
Start display at page:

Download "ROUGH SESTS-INSPIRED EVOLUTIONARY ALGORITHM FOR ENGINEERING MULTIOBJECTIVE OPTIMIZATION PROBLEMS"

Transcription

1 Volume 1, No. 1, December 013 Journal of Global Research n Mathematcal Archves RESEARCH PAPER Avalable onlne at ROUGH SESTS-INSPIRED EVOLUTIONARY ALGORITHM FOR ENGINEERING MULTIOBJECTIVE OPTIMIZATION PROBLEMS Ahmed A. EL- Sawy 1,, Mohamed A. Hussen 1,*, EL-Sayed M. Zak 1, A. A. Mousa 1, 3 1 Department of Basc Engneerng Scences, Faculty of Engneerng, Menoufa Unversty, Shbn El-Kom, Egypt. Department of Mathematcs, Faculty of Scence, Qassm Unversty, Saud Araba. 3 Department of Mathematcs, Faculty of scences, Taf Unversty, Saud Araba. 1,* Emal:moh_abdelsameea_h@yahoo.com Abstract: In ths paper we present a new optmzaton algorthm, the proposed algorthm operates n two phases: n the frst one, multobjectve verson of genetc algorthm s used as search engne n order to generate approxmate true Pareto front. Ths algorthm based on concept of coevoluton and repar algorthm for handlng nonlnear constrants. Also t mantans a fnte-szed archve of non-domnated solutons whch gets teratvely updated n the presence of new solutons based on the concept of ε -domnance. Then, n the second stage, rough set theory s adopted as local search engne n order to mprove the spread of the solutons found so far. The results, provded by the proposed algorthm for engneerng optmzaton problems, are promsng when compared wth extng well-known algorthms. Also, our results suggest that our algorthm s better applcable. 1. INTRODUCTION Most of real world optmzaton problems requre optmzng multple conflctng objectves wth each other. These problems wth more than one objectve are called Multobjectve Optmzaton Problems (MOPs). There s no sngle optmal soluton, but a set of alternatve solutons, these solutons are optmal n the wder sense that no other solutons n the search space are domnate them when all objectves are consdered. They are known as Pareto optmal solutons [1,]. MOPs naturally arse n many area of knowledge such as economcs [3-5], machne learnng [6-8] and electrcal power system [9-1]. Deb [13] classfed optmzaton methods as classcal (tradtonal) methods and evolutonary methods (evolutonary algorthms). Tradtonal multobjectve methods attempt to fnd the set of nondomnated solutons usng mathematcal programng. In tradtonal methods such as weghted method and ε-constrant method whch are most commonly used [1], the MOPs transformed n to a sngle objectve problem whch can be solved usng nonlnear optmzaton technques. On the other hand, evolutonary methods (evolutonary algorthms EAs) for MOPs optmze all objectves smultaneously and generatng a set of alternatve solutons. Many studes on evolutonary algorthms have shown that these methods can be effcently used to elmnate most of dffcultes of classcal methods. Snce they are populaton-based approaches, multple pareto optmal solutons can be found n one sngle run. These populaton-based approaches are more successful when solvng MOPs. There are many popular algorthms for solvng unconstraned MOPs. A representatve collecton of these algorthms ncludes the vector evaluated genetc algorthm by Schaffer [14], the nched Pareto genetc algorthm (NPGA) [15] and the nondomnated sortng genetc algorthm by Srnvas and Deb[16], the nondomnated sortng genetc algorthm II (NSGA-II) by Deb et al.[17], the strength Pareto evolutonary algorthm by Ztzler and Thele [18], the strength Pareto evolutonary algorthm II (SPEA-II) by Ztzler et al. [19], the Pareto archved evoluton strategy by Knowles and Corne [0] and the memetc PAES by Knowles and Corne [1]. These MOEAs dffer from each other n both explotaton and exploraton; they share the common purpose, searchng for a near-optmal, well-extended and unformly dversfed Pareto optmal front for a gven MOP [-5]. In case of constraned multobjectve optmzaton problems, there are a few evolutonary algorthms developed. Despte the developments for solve constraned optmzaton problems; there seem to be not enough studes concernng procedure for handlng constrants. For example, Fonseca [6] suggested treatng constrants as hgh-prorty objectves, and Harade [7] proposed a few effcent constrant-handlng gudelnes and desgned a Pareto descent repar method. For MOPs, a properly desgned ftness assgnment method s always requred to gude the populaton to evolve to the Pareto front, as the objectve vector cannot be used as the ftness functon value drectly. Most of the exstng MOEAs assgn the ftness functon values based on the Pareto domnance relatonshp. In ths paper we present a new optmzaton algorthm, the proposed algorthm operates n two phases: n the frst one, multobjectve verson of genetc algorthm s used as search engne n order to generate approxmate true Pareto front. Then n the second phase, rough set theory s adopted as local search engne n order to mprove the spread of the solutons found so far. The proposed algorthm s mplemented to engneerng applcatons, and the results are compared wth extng well-known algorthms. The remander of the paper s organzed as follows. In secton, we descrbe some basc concepts and defntons of MOPs. Secton 3 presents constrant multobjectve optmzaton va genetc algorthm. Applcaton on real engneerng problems are gven and dscussed n secton 4. Secton 5 ndcates our concluson. JGRMA 013, All Rghts Reserved 1

2 Ahmed A. EL- Sawy et al, Journal of Global Research n Mathematcal Archves, 1(1), December 013, BASIC CONCEPTS AND DEFINITIONS.1 Problem Formulaton General multobjectve optmzaton problem s expressed by MOP : Mn F( x) ( f ( x), f ( x),..., f ( )) T 1 m x s. t. x S x ( x, x,..., x ) T 1 n Where ( f1( x), f( x),..., fm( x)) are the m objectves functons, ( x,,..., n ) 1 x x are the n decson varables, and S the soluton (parameter) space. * Defnton 1. ( Pareto optmal soluton ): x s sad to be a Pareto optmal soluton of MOP f there exsts no other feasble x * * (.e., x S) such that, f j ( x) f j ( x ) for all j 1,,..., m and f j( x) f j( x ) for at least one objectve functon f j. m Defnton.[8]. (ε-domnance) Let f : x R and a, b a b, f and only f for {1,..., m } n R s X. Then a s sad to ε-domnate b for some ε > 0, denoted as (1 ) f ( a) f ( b ) Defnton 3. (ε -approxmate Pareto set) Let X be a set of decson alternatves and 0. Then a set x s called an ε- approxmate Pareto set of X, f any vector a x s ε-domnated by at least one vector b x,.e a x : b x such that b a Accordng to defnton, the ε value stands for a relatve allowed for the objectve values as declared n Fg. 1. Ths s especally mportant n hgher dmensonal objectve spaces, where the concept of ε -domnance can reduce the requred number of solutons consderably. Also, makes the algorthms practcal by allowng a decson maker to control the resoluton of the Pareto set approxmaton by choosng an approprate ε-value Fgure 1. Graphs vsualzng the concepts of domnance (left) and ε-domnance (rght).. Use of Rough Sets n Multobjectve Optmzaton For our proposed approach we wll try to nvestgate the Pareto front usng a Rough sets grd. To do ths, we wll use an ntal approxmate of the Pareto front (provded by any evolutonary algorthm) and wll mplement a grd n order to get more nformaton about the front that wll let to mprove ths ntal approxmaton [9]. To create ths grd, as an nput we wll have N feasble ponts dvded n two sets: the nondomnated ponts (NS) and the domnated ones (DS). Usng these two sets we want to create a grd to descrbe the set NS n order to ntensfy the search on t. Ths s, we want to descrbe the Pareto front n the decson varable space because then we could easly use ths nformaton to generate more effcent ponts and then mprove ths ntal Pareto approxmaton. Fgure shows how nformaton n objectve functon space can be translated nto nformaton n decson varable space through the use of a grd. We must note the mportance of the DS sets as n a rough sets method, where the nformaton comes from the descrpton of the boundary of the two sets NS, DS. Then the more effcent ponts provded the better. However, t s also requred to provde domnated ponts, snce we need to estmate the boundary between beng domnated and beng nondomnated. Once the nformaton s computed we can smply generate more ponts n the effcent sde. Fgure. Decson varable space (left) and objectve functon space (rght)[9].3 Structure of an Iteratve Multobjectve Search Algorthm JGRMA 014, All Rghts Reserved

3 Ahmed A. EL- Sawy et al, Journal of Global Research n Mathematcal Archves, 1(1), December 013, 1-30 The purpose of ths secton s to nformally descrbe the problem we are dealng wth. To ths end, let us frst gve a template for a large class of teratve search procedures whch are characterzed by the generaton of a sequence of search ponts and a fnte memory. Algorthm 1. Iteratve search algorthm 1. t 0 (0). A 0 (t) 3. whle termnate (A, t) false do 4. t t 1 5. f generate( ) {generate new search pont} ( t) ( t 1) ( t) 6. A update( A, f ) {update archve} 7. end whle 8. Output : A An abstract descrpton of a generc teratve search algorthm s gven n Algorthm (1) [8]. The nteger t denotes the teraton count, the n-dmensonal vector f s the sample generated at teraton t and the set A wll be called the archve at teraton t and should contan a representatve subset of the samples n the objectve space F=[ f1( x), f( x),..., fm( x )] generated so far. To smplfy the notaton, we represent samples by n-dmensonal real vectors f where each coordnate represents one of the objectve values as shown n Fg.3. The purpose of the functon the old archve set ( t 1) A. The functon Fgure 3. Block dagram of Archve/selecton strategy f generate () s to generate a new solutons n each teraton t, possbly usng the contents of ( t) ( t 1) ( t) A update( A, f ) gets the new solutons () generate and the old archve set ( t 1) A and determnes the updated one, namely A. In general, the purpose of ths sample storage s to gather useful nformaton about the underlyng search problem durng the run. Its use s usually two-fold: On the one hand t s used to store the best solutons found so far, on the other hand the search operator explots ths nformaton to steer the search to promsng regons. Ths procedure could easly be vewed as an evolutonary algorthm when the generate operator s assocated wth varaton (recombnaton and mutaton). However, we would lke to pont out that all followng nvestgatons are equally vald for any knd of teratve process whch can be descrbed as Algorthm(1) and used for approxmatng the Pareto set of multobjectve optmzaton problems. 3. CONSTRAINED MULTIOBJECTIVE OPTIMIZATION VIA GENETIC ALGORITHM In any nterestng multobjectve optmzaton problem, there exst a number of such solutons whch are of nterest to desgners and practtoners. Snce no one soluton s better than any other soluton n the Pareto-optmal set, t s also a goal n a multobjectve optmzaton to fnd as many such Pareto-optmal solutons as possble. Unlke most classcal search and optmzaton problems, GAs works wth a populaton of solutons and thus are lkely (and unque) canddates for fndng multple Pareto-optmal solutons smultaneously. There are two tasks that are acheved n a multobjectve GA. (1) Convergence to the Pareto-optmal set, and. () Mantenance of dversty among solutons of the Pareto-optmal set. Here we present a new optmzaton system, whch s based on concept of co-evoluton and repar algorthms. Also t s based on the -domnance concept. The use of -domnance also makes the algorthms practcal by allowng a decson maker to control the resoluton of the Pareto set approxmaton by choosng an approprate value. 3.1 Intalzaton Stage The algorthm uses two separate populaton, the frst populaton P conssts of the ndvduals whch ntalzed randomly satsfyng the search space (The lower and upper bounds), whle the second populaton R conssts of reference ponts whch satsfyng all constrants (feasble ponts), However, n order to ensure convergence to the true Pareto-optmal solutons, we JGRMA 014, All Rghts Reserved 3

4 Ahmed A. EL- Sawy et al, Journal of Global Research n Mathematcal Archves, 1(1), December 013, 1-30 concentrated on how eltsm could be ntroduced. So, we propose an archvng/selecton strategy that guarantees at the same tme progress towards the Pareto-optmal set and a coverng of the whole range of the non-domnated solutons. The algorthm mantans an externally fnte-szed archve A of non-domnated solutons whch gets teratvely updated n the presence of new solutons based on the concept of -domnance. 3. Repar Algorthm The dea of ths technque s to separate any feasble ndvduals n a populaton from those that are nfeasble by reparng nfeasble ndvduals. Ths approach co-evolves the populaton of nfeasble ndvduals untl they become feasble. Repar process works as follows. Assume, there s a search pont S (where S s the feasble space). In such a case the algorthm selects one of the reference ponts (Better reference pont has better chances to be selected), say r Sand creates random ponts Z from the segment defned between,r, but the segment may be extended equally [8, 3] on both sdes determned by a user specfed parameter [0,1]. Thus, a new feasble ndvdual s expressed as: z z 1. (1 ). r (1 ).. r, (1 ), [0,1] 3.3 Evolutonary Algorthm: Phase 1 ( t 0) In the frst phase, the proposed algorthm uses two separate populaton, the frst populaton P (where t s the teraton counter) conssts of the ndvduals whch ntalzed randomly satsfyng the search space (The lower and upper bounds), whle (0) the second populaton R conssts of reference ponts whch satsfyng all constrants (feasble ponts). Also, t stores ntally the (0) Pareto-optmal solutons externally n a fnte szed archve of non-domnated solutons A. We use cluster algorthm to create t 1 ( t) ( t) t 1 the next populaton P, f P A then new populaton P conssts of all ndvdual from A and the populaton P are consdered for the clusterng procedure to complete A and drectly coped to the new populaton ( t 1) P, f P A then P solutons are pcked up at random from ( t) ( t) ( t 1) P. Snce our goal s to fnd new nondomnated solutons, one smple way to combne multple objectve functons nto a scalar ftness functon [30,31] s the followng weghted sum approach m f ( x) w f ( x)... w f ( x)... w f ( x) w f ( x ) 1 1 m m j j j 1 Where x s a strng (.e., ndvdual), f( x ) s a combned ftness functon, f ( x ) s the th objectve functon When a par of strngs are selected for a crossover operaton, we assgn a random number to each weght as follows: random (.) w m, 1,,.., m random (.) Calculate the ftness value of each strng usng the random weghts accordng to he followng selecton probablty ( x) of a strng x n the populaton j 1 j w. Select a par of strngs from the current populaton P f ( x) fmn ( P ) ( t) ( t) ( x), where f () mn ( P ) mn{ f ( x) x P } t { f ( x) fmn ( P )} ( t ) x P Ths step s repeated for selectng P / Pars of strngs from the current populatons. For each selected par apply crossover operaton to generate two new strngs, for each strngs generated by crossover operaton, apply a mutaton operator wth a prespecfed mutaton probablty. The system also ncludes the survval of some of good ndvduals wthout crossover or t mutaton. The algorthm mantans a fnte-szed archve A of non-domnated solutons whch gets teratvely updated n the presence of a new solutons based on the concept of -domnance, such that new solutons are only accepted n the archve f they are not -domnated by any other element n the current archve.the use of -domnance also makes the algorthms practcal by allowng a decson maker to control the resoluton of the Pareto set approxmaton by choosng an approprate value. 3.4 Local Search Mechansm Inspred on Rough Sets Theory: Phase Upon termnaton of phase 1, we start phase, wth ntal approxmate of the Pareto front (provded by the proposed algorthm n phase1) whch noted as NS. Also all domnated solutons are marked as DS. It s worth remarkng that NS can smply be a lst of solutons. From the set NS we choose NNS ponts prevously unselected. If we do not have enough unselected ponts, we choose the rest randomly from the set DS. Next, we choose from the set DS, NDS ponts prevously unselected ( and n the same way f we do not have enough unselected ponts, we complete them n a random fashon) these ponts wll be used to approxmate the boundary between the Pareto front and the rest of the feasble set n decson varable space. We store theses ponts n the set Items and perform rough sets teratons: JGRMA 014, All Rghts Reserved 4

5 Ahmed A. EL- Sawy et al, Journal of Global Research n Mathematcal Archves, 1(1), December 013, Range Intalzaton: for each decson varable, we compute and sort (from smallest and hghest) the dfferent values t takes n the set Items. Then, for each decson varable, we have a set of rang values and combnng all these sets we have a non-unform grd n decson varable space. - Compute Atoms: we compute NNS rectangular atoms centered n the NNS effcent ponts selected. To buld a e rectangular atom assocated to a nondomnated pont x Items we compute the followng upper and lower bounds for each decson varable : Lower Bound : Mddle pont between e x and the prevous value n the set e Upper Bound : Mddle pont between x and the followng value n the set rang If there are no pervous or subsequent values n rang, we consder the absolute lower or upper bound of varable. Ths settng lets the method to explore close to the feasble set boundares. 3- Generate Offsprng: nsde each atom we randomly generate offsprng new ponts. Each of these ponts s sent to the set NS as follows. The dea s that "new solutons are only accepted n the archve f they are not ε-domnated by any other element of the current archve". If a soluton s accepted, all domnated solutons are removed. Algorthm() shows the operator for ε-approxmate Pareto set Algorthm : Operator for ε-approxmate Pareto set 1. INPUT : A, x. f x A such that x x then 3. A 4. else A 5. D { x A : x x } 6. A A { x} \ D 7. end f 8. Output : A The pseudo code of the proposed algorthm s declared n Algorthm (3) rang Algorthm 3: The proposed algorthm t=0 (0) (0). Create P, R (0) (0) 3. A nondo mn ated ( P ) (t) 3. whle termnate (A, t) false do 4. t t 1 ( t) 5. P ( t 1) ( t 1) generate( A, P ) {generate new search pont} ( t) 6. A ( t 1) ( t) update( A, P ) {update archve (algorthm 3)} 7. end whle 8. Output : A 8. A NS, Domnted Pontes DS 9. Compute "Atom" 10.Comput Upper Bound, Lower Bound 11. Generate new offsprng. 1. Update NS set Phase Phase1 13. Output NS 4. APPLICATION OF PROPSED APPROACH ON REAL ENGINEERING PROBLEMS In order to valdate the proposed approach and quanttatvely compare ts performance wth other MOEAs, we present n ths secton comparson study whch appled to the problem was chosen from the engneerng applcaton, A welded beam desgn by Deb [3] and Two-Bar Truss [33,34]. Table 1 lsts the parameter settng used n our proposed algorthm for all runs. Table 1. The parameter adopted n the mplementaton of the proposed algorthm Populaton sze 00 No. of Generaton 00 P 0.9 c P 0.0 m Selecton operator Crossover operator Mutaton operator Roulette Wheel Sngle pont Polynomal mutaton 10e-6 JGRMA 014, All Rghts Reserved 5

6 Ahmed A. EL- Sawy et al, Journal of Global Research n Mathematcal Archves, 1(1), December 013, Welded Beam: A welded beam desgn s used by Deb [3], where a beam needs to be welded on another beam and must carry a certan load F as shown n Fg.4. Fgure 4. The welded beam desgn problem It s desred to fnd four desgn parameters (thckness b, wdth t, length of weld l, and weld thckness h) for whch the cost functon of the beam and the deflecton functon at the open end are mnmum. The overhang porton of the beam has a length of 14 nch and F=6000 Ib force s appled at the end of the beam. A lttle thought wll reveal that a desgn for mnmum deflecton at the end (or maxmum rgdty of the above beam) wll make all four desgn dmensons to take large dmensons. Thus, the desgn solutons for mnmum cost and maxmum rgdty (or mnmum-end-deflecton) are conflctng to each other. In the followng, the mathematcal formulaton of the two-objectve optmzaton problem s presented: Mn f ( x) h l tb(14 l) Mn f ( x).195 / t b st.. g ( x) r( x) 0, g ( x) ( x) 0 1 g ( x) b h 0, g ( x) P ( ) c x h, b [0.15,5] l, t [0.1,10] where Pc ( ) ( ) l / 0.5( l ( h l) ) 6000 / hl 6000( l) 0.5( l ( h l) ) / t b hl( l /1 0.5( h t) ) ( t) tb 3 In the Welded Beam desgn problem, the non-lnear constrants can cause dffcultes n fndng the Pareto front. As shown n Fg. 5 and Fg. 6 our proposed approach outperformed NSGA and NSGA-II n both dstrbuton and spread f f 1 Fgure 5. Pareto optmal front of welded beam usng proposed approach JGRMA 014, All Rghts Reserved 6

7 Ahmed A. EL- Sawy et al, Journal of Global Research n Mathematcal Archves, 1(1), December 013, 1-30 Fgure 6. Pareto optmal front of welded beam usng NSGA, NSGA- II. 4. Two-Bar Truss: Fgure 7 llustrates the two-bar truss that s to be optmzed [33]. Ths problem was adapted from Krsch [34]. It s comprsed of two statonary pnned jonts, A and B, where each one s connected to one of the two bars n the truss. The two bars are pnned where the jon one another at jont C, and a 100 kn force acts drectly downward at that pont. The crosssectonal areas of the two bars are represented as x1 and x, the cross-sectonal areas of trusses AC and BC respectvely. Fnally, y represents the perpendcular dstance from the lne AB that contans the two-pnned base jonts to the connecton of the bars where the force acts (jont C). Fgure 7. Two-Bar Truss problem The problem has been modfed nto a two-objectve problem n order to show the non-nferor Pareto set clearly n two dmensons. The stresses n AC and BC should not exceed 100,000 kpa and the total volume of materal should not exceed m. The reason the objectve constrants have been mposed s that the Pareto set s asymptotc and extends from - to. As x1 and x go to zero, f volume goes to zero and f BC go to nfnty. As x1 and x go to nfnty, f volume goes to nfnty and f AC and f BC go to zero. Hence, n order to generate Pareto optmal solutons n a reasonable range, objectve constrants are mposed. The problem formulaton s shown below. Mnmze f x (16 y ) x (1 y ) Mnmze f subject to f f AC f volume BC 1 y 3 x, x volume AC (1 y ) yx (16 y ) yx 0.5 Fgure 8 declares the Pareto optmal soluton of the Two-Bar Truss obtaned from proposed algorthm. Obvously from the results, the proposed algorthm s able to mantan an almost unform set of non-domnated soluton ponts along the true Paretooptmal front. Fgure 9 shows Pareto optmal front of Two-Bar Truss (MOGA Soluton) [33, 34] and Fg.10 show Pareto optmal front usng NSGA-II [3]. It s clear that the proposed algorthm outperformed the algorthm n [3, 33, 34] JGRMA 014, All Rghts Reserved 7

8 f (x) Ahmed A. EL- Sawy et al, Journal of Global Research n Mathematcal Archves, 1(1), December 013, x f 1 (x) Fgure 8. Pareto optmal front of two- truss usng the proposed approach Fgure 9. Pareto optmal front of Two-Bar Truss (MOGA Soluton) [33, 34] Fgure 10. Pareto optmal front of of Two-Bar Truss usng NSGA- II [3] 5. CONCLUSION Fndng a good dstrbuton of solutons near the Pareto optmal front n small computatonal tme s a dream of multobjectve EAs researchers and practtoner. In ths paper a new optmzaton algorthm were present, the proposed algorthm operates n two Phases: n the frst one, multobjectve verson of genetc algorthm s used as search engne n order to generate approxmate true Pareto front. Ths algorthm based on concept of co-evoluton and repar algorthm. Also t mantans a fnte-szed archve of nondomnated solutons whch gets teratvely updated n the presence of new solutons based on the concept of ε-domnance. Then n the second phase, rough set theory s adopted as local search engne n order to mprove the spread of the solutons found so far. Our proposed approach keeps track of all the feasble solutons found durng the optmzaton. The results, provded by the proposed algorthm for engneerng applcatons, are promsng when compared wth extng well-known algorthms. Also, the non-domnated solutons n the obtaned Pareto- optmal set are well dstrbuted and have satsfactory dversty characterstcs. REFERENCES [1] K. Mettnen "Non-lnear multobjectve optmzaton" Dordrecht: Kluwer Academc Publsher; (00). [] A. A. Mousa, A new Stoppng and Evaluaton Crtera for Lnear Multobjectve Heurstc Algorthms, Journal of Global Research n Mathematcal Archves, Volume 1, No. 8, August 013 [3] QSen Ca, Defu Zhang, Bo Wu, Stehpen C.H. Leung, A Novel Stock Fore-castng Model based on Fuzzy Tme Seres and GenetcAlgorthm, Proceda Computer Scence, Volume 18, 013, Pages [4] He N, Yongqao Wang, Stock ndex trackng by Pareto effcent genetc algo-rthm, Appled Soft Computng, Volume 13, Issue 1, December 013, Pages JGRMA 014, All Rghts Reserved 8

9 Ahmed A. EL- Sawy et al, Journal of Global Research n Mathematcal Archves, 1(1), December 013, 1-30 [5] Janko Straßburg, Chrstan Gonzàlez-Martel, Vassl Alexandrov, Parallel genetc algorthms for stock market tradng rules Proceda Computer Scence, Volume 9, 01, Pages [6] Xao-We Xue, Mn Yao, Zhaohu Wu, Janhua Yang, Genetc Ensemble of Extreme Learnng Machne, Neurocomputng, In Press, Accepted Manu-scrpt, Avalable onlne 16 November 013. [7] Jadong Yang, Hua Xu, Pefa Ja, Effectve search for genetc-based machne learnng systems va estmaton of dstrbuton algorthms and embedded fea-ture reducton technques,neurocomputng, Volume 113, 3 August 013, Pages [8] Hongmng Yang, Jun Y, Junhua Zhao, ZhaoYang Dong,Extreme learnng machne based genetc algorthm and ts applcaton n power system eco-nomc dspatch Neurocomputng, Volume 10, 15 February 013, Pages [9] M.S.Osman, M.A.Abo-Snna, and A.A. Mousa " A Soluton to the Optmal Power Flow Usng Genetc Algorthm "Journal of Appled Mathematcs & Computaton (AMC) vol 155, No., 6 August (004) pp ( Top 5 Hottest Artcles, July. to Sept. 005), from M. Sc. Dssertaton. [10] Osman M.S., M.A.Abo-Snna, and A.A. Mousa "Epslon-Domnance based Multobjectve Genetc Algorthm for Economc Emsson Load Dspatch Op-tmzaton Problem, Electrc Power Systems Research 79 (009) [11] B. N. AL-Matraf, A. A. Mousa,Optmzaton methodology based on Quantum computng appled to Fuzzy practcal unt commtment problem, Internatonal Journal of Scentfc & Engneerng Research, Volume 4, Issue 11, November [1] Abd Allah A. Galal, Abd Allah A. Mousa, Bekheet N. Al-Matraf, Hybrd Ant Optmzaton System for Multobjectve Optmal Power Flow Problem Under Fuzzness, Journal of Natural Scences and Mathematcs, Vol. 6, No., pp , July 013. [13] K. Deb, Multobjectve Optmzaton Usng Evolutonary Algorthms. Chchester, U.K.: Wley, 001. [14] J.D. Schaffer, Multple objectve optmzaton wth vector evaluated genetc algorthms, n: J.J. Grefenstette, et al. (Eds.), Genetc Algorthms and Ther Applcatons, Proceedngs of the 1st Internatonal Conference on Genetc Algorthms, Lawrence Erlbaum, Mahwah, NJ, pp (1985). [15] J. Horn, N. Nafplots, D.E. Goldberg, A nched Pareto genetc algorthm for multobjectve optmzaton, n: J.J. Grefenstette et al. (Eds.), IEEE World Congress on Computatonal Intellgence, Proceedngs of the 1st IEEE Conference on Evolutonary Computaton, IEEE Press, Pscataway, NJ, pp. 8 87(1994). [16] N. Srnvas, and K. Deb, " Multobjectve Optmzaton Usng Nondomnated Sortng In Genetc Algorthms " Evolutonary Computaton,(3): 1-48 (1999). [17] K. Deb, S. Agrawal, A. Pratab, T. Meyarvan, A fast eltst non-domnated sortng genetc algorthms for multobjectve optmzaton: NSGA II, KanGAL report 00001, Indan Insttute of Technology, Kanpur, Inda, (000). [18] E. Ztzler, L. Thele, Multobjectve optmzaton usng evolutonary algorthmsa comparatve case study. In A. E. Eben, T. Back, M. Schoenauer and H. P. Schwefel (Eds.), Ffth Internatonal Conference on Parallel Problem Solvng from Nature (PPSN-V), Berln, Germany, pp ,(1998). [19] E. Ztzler, M. Laumanns, L. Thele, SPEA: Improvng the strength Pareto evolutonary algorthm for multobjectve optmzaton, n: Evolutonary methods for desgn, optmzaton and control wth applcatons to ndustral problems, EUROGEN 001, Athens, Greece, (001). [0] J.D. Knowles, D.W. Corne, The Pareto archved evoluton strategy: a new baselne algorthm for multobjectve optmzaton, n: Proceedngs of the 1999 Congress on Evolutonary Computaton, IEEE Press, Pscataway, NJ, pp ,( 1999). [1] J.D. Knowles, D.W. Corne, M-PAES: a memetc algorthm for multobjectve optmzaton, n: Proceedngs of the 000 Congress on Evolutonary Computaton, IEEE Press, Pscataway, NJ, 000, pp , (000). [] F. Jmenez, and J. L. Verdegay, Constraned multobjectve optmzaton by evolutonary algorthm. Proceedng of the nternatonal ICSC symposton on Engneerng of ntellgent systems (EIS'98),pp66-71(1998). [3] Z. Mchalewz,"Genetc Algorthms + Data Structures = Evoluton Programs",Sprnger-Verlag,3 Rd Edton (1996). [4] Z. Mchalewcz, and Schoenauer, "Evolutonary Algorthms for Constraned Parameter Optmzaton Problems", evolutonary computaton 4(1)1-3 (1996). [5] Ahmed A. EL-Sawy, Mohamed A. Hussen, EL-Sayed M. Zak, A. A. Mousa, An Introducton to Genetc Algorthms: A survey A practcal Issues, Internatonal Journal of Scentfc & Engneerng Research, Volume 5, Issue 1, January-014. [6] Fonseca CM, Flemng PJ. Multobjectve optmzaton and multple constrant handlng wth evolutonary algorthms: Part I: a unfed formulaton. IEEE Transactons on Systems and Cybernetcs Part A: Systems and Humans 1998;8(1):6 37. [7] Harada K, Sakuma J, Ono Isao, Kobayash S. Constrant-handlng method for mult-objectve functon optmzaton: pareto descent repar operator. In: Proceedngs of the fourth nternatonal conference on evolutonary mult- crteron optmzaton, 007. p [8] M. Laumanns, L. Thele, K. Deb, and E. Ztzler: Archvng wth Guaranteed Convergence And Dversty n Mult-objectve Optmzaton. In GECCO 00: Proceedngs of the Genetc and Evolutonary Computaton Conference, Morgan Kaufmann Publshers, New York, NY, USA, pages , July, (00) [9] Hernández-Díaz, A. G., L. V. Santana-Quntero, C. A. Coello Coello, R. Caballero and J. Molna 008) Improvng Mult-Objectve Evolutonary Algorthms by usng Rough Sets, n A. Lgeza, S. Rech, R. Schaefer and C. Cotta (eds.), Knowledge-Drven Computng: Knowledge Engneerng and Intellgent Computatons, Studes n Computatonal Intellgence, vol. 10, pp. 81:98. [30] M.S.Osman, M.A.Abo-Snna, and A.A. Mousa " An Effectve Genetc Algorthm Approach to Multobjectve Resource Allocaton Problems ( MORAPs) " Journal Of Appled Mathematcs & Computaton 163, pp , (005). [31] T. Murata, H. Ishbuch, and H. Tanaka, "Multobjectve genetc algorthm and ts applcaton to flowshop Schedulng ", Computers and Industral Engneerng, vol. 30, no 4, pp (1996). [3] K. Deb, A. Pratap, and S. Motra, (000) " Mechancal Component Desgn for Multple Objectves Usng Eltst Non-Domnated Sortng GA", Kangal Report No JGRMA 014, All Rghts Reserved 9

10 Ahmed A. EL- Sawy et al, Journal of Global Research n Mathematcal Archves, 1(1), December 013, 1-30 [33] Ruhul Sarker, Hussen A. Abbass, and Samn Karm, An Evolutonary Algorthm for Constraned Multobjectve Optmzaton Problems, at the 5th Australasa-Japan JontWorkshop Unversty of Otago, Dunedn, New Zealand [34] Krsch, U., 1981, Optmal Structural Desgn, McGraw-Hll Co., New York. JGRMA 014, All Rghts Reserved 30

An improved multi-objective evolutionary algorithm based on point of reference

An improved multi-objective evolutionary algorithm based on point of reference IOP Conference Seres: Materals Scence and Engneerng PAPER OPEN ACCESS An mproved mult-objectve evolutonary algorthm based on pont of reference To cte ths artcle: Boy Zhang et al 08 IOP Conf. Ser.: Mater.

More information

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS HCMC Unversty of Pedagogy Thong Nguyen Huu et al. A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS Thong Nguyen Huu and Hao Tran Van Department of mathematcs-nformaton,

More information

The Study of Teaching-learning-based Optimization Algorithm

The Study of Teaching-learning-based Optimization Algorithm Advanced Scence and Technology Letters Vol. (AST 06), pp.05- http://dx.do.org/0.57/astl.06. The Study of Teachng-learnng-based Optmzaton Algorthm u Sun, Yan fu, Lele Kong, Haolang Q,, Helongang Insttute

More information

HYBRID FUZZY MULTI-OBJECTIVE EVOLUTIONARY ALGORITHM: A NOVEL PARETO-OPTIMIZATION TECHNIQUE

HYBRID FUZZY MULTI-OBJECTIVE EVOLUTIONARY ALGORITHM: A NOVEL PARETO-OPTIMIZATION TECHNIQUE Internatonal Journal of Fuzzy Logc Systems (IJFLS) Vol.2, No., February 22 HYBRID FUZZY MULTI-OBJECTIVE EVOLUTIONARY ALGORITHM: A NOVEL PARETO-OPTIMIZATION TECHNIQUE Amt Saraswat and Ashsh San 2 Department

More information

Kernel Methods and SVMs Extension

Kernel Methods and SVMs Extension Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general

More information

FUZZY GOAL PROGRAMMING VS ORDINARY FUZZY PROGRAMMING APPROACH FOR MULTI OBJECTIVE PROGRAMMING PROBLEM

FUZZY GOAL PROGRAMMING VS ORDINARY FUZZY PROGRAMMING APPROACH FOR MULTI OBJECTIVE PROGRAMMING PROBLEM Internatonal Conference on Ceramcs, Bkaner, Inda Internatonal Journal of Modern Physcs: Conference Seres Vol. 22 (2013) 757 761 World Scentfc Publshng Company DOI: 10.1142/S2010194513010982 FUZZY GOAL

More information

MODIFIED PREDATOR-PREY (MPP) ALGORITHM FOR CONSTRAINED MULTI-OBJECTIVE OPTIMIZATION

MODIFIED PREDATOR-PREY (MPP) ALGORITHM FOR CONSTRAINED MULTI-OBJECTIVE OPTIMIZATION EVOLUTIONARY METHODS FOR DESIGN, OPTIMIZATION AND CONTROL T. Burczynsk and J. Péraux (Eds.) CIMNE, Barcelona, Span 29 MODIFIED PREDATOR-PREY () ALGORITHM FOR CONSTRAINED MULTI-OBJECTIVE OPTIMIZATION Souma

More information

Interactive Bi-Level Multi-Objective Integer. Non-linear Programming Problem

Interactive Bi-Level Multi-Objective Integer. Non-linear Programming Problem Appled Mathematcal Scences Vol 5 0 no 65 3 33 Interactve B-Level Mult-Objectve Integer Non-lnear Programmng Problem O E Emam Department of Informaton Systems aculty of Computer Scence and nformaton Helwan

More information

NON-DOMINATED RANKED GENETIC ALGORITHM FOR SOLVING CONSTRAINED MULTI-OBJECTIVE OPTIMIZATION PROBLEMS

NON-DOMINATED RANKED GENETIC ALGORITHM FOR SOLVING CONSTRAINED MULTI-OBJECTIVE OPTIMIZATION PROBLEMS NON-DOMINATED RANKED GENETIC ALGORITHM FOR SOLVING CONSTRAINED MULTI-OBJECTIVE OPTIMIZATION PROBLEMS OMAR AL JADAAN, LAKSHMI RAJAMANI, 3 C. R. RAO Dept. CSE, EC. Osmana Unversty, Hyderabad 500-007, Inda.

More information

Evolutionary Multi-Objective Environmental/Economic Dispatch: Stochastic vs. Deterministic Approaches

Evolutionary Multi-Objective Environmental/Economic Dispatch: Stochastic vs. Deterministic Approaches Evolutonary Mult-Objectve Envronmental/Economc Dspatch: Stochastc vs. Determnstc Approaches Robert T. F. Ah Kng, Harry C. S. Rughooputh and Kalyanmoy Deb 2 Department of Electrcal and Electronc Engneerng,

More information

Markov Chain Monte Carlo Lecture 6

Markov Chain Monte Carlo Lecture 6 where (x 1,..., x N ) X N, N s called the populaton sze, f(x) f (x) for at least one {1, 2,..., N}, and those dfferent from f(x) are called the tral dstrbutons n terms of mportance samplng. Dfferent ways

More information

Design and Optimization of Fuzzy Controller for Inverse Pendulum System Using Genetic Algorithm

Design and Optimization of Fuzzy Controller for Inverse Pendulum System Using Genetic Algorithm Desgn and Optmzaton of Fuzzy Controller for Inverse Pendulum System Usng Genetc Algorthm H. Mehraban A. Ashoor Unversty of Tehran Unversty of Tehran h.mehraban@ece.ut.ac.r a.ashoor@ece.ut.ac.r Abstract:

More information

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009 College of Computer & Informaton Scence Fall 2009 Northeastern Unversty 20 October 2009 CS7880: Algorthmc Power Tools Scrbe: Jan Wen and Laura Poplawsk Lecture Outlne: Prmal-dual schema Network Desgn:

More information

On the Multicriteria Integer Network Flow Problem

On the Multicriteria Integer Network Flow Problem BULGARIAN ACADEMY OF SCIENCES CYBERNETICS AND INFORMATION TECHNOLOGIES Volume 5, No 2 Sofa 2005 On the Multcrtera Integer Network Flow Problem Vassl Vasslev, Marana Nkolova, Maryana Vassleva Insttute of

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

Solving Nonlinear Differential Equations by a Neural Network Method

Solving Nonlinear Differential Equations by a Neural Network Method Solvng Nonlnear Dfferental Equatons by a Neural Network Method Luce P. Aarts and Peter Van der Veer Delft Unversty of Technology, Faculty of Cvlengneerng and Geoscences, Secton of Cvlengneerng Informatcs,

More information

Differential Evolution Algorithm with a Modified Archiving-based Adaptive Tradeoff Model for Optimal Power Flow

Differential Evolution Algorithm with a Modified Archiving-based Adaptive Tradeoff Model for Optimal Power Flow 1 Dfferental Evoluton Algorthm wth a Modfed Archvng-based Adaptve Tradeoff Model for Optmal Power Flow 2 Outlne Search Engne Constrant Handlng Technque Test Cases and Statstcal Results 3 Roots of Dfferental

More information

Regular paper. New Approach to Solve Multiobjective. Economic Dispatch

Regular paper. New Approach to Solve Multiobjective. Economic Dispatch Tawfk Guesm Hsan Hadj Abdallah Ahmed Toum Sfax Natonal Engneerng School, Electrcal Department. BP W, 3038 Sfax-Tunsa. gg_tawfk@yahoo.fr J. Electrcal Systems - (006): 64-8 Regular paper New Approach to

More information

Solving of Single-objective Problems based on a Modified Multiple-crossover Genetic Algorithm: Test Function Study

Solving of Single-objective Problems based on a Modified Multiple-crossover Genetic Algorithm: Test Function Study Internatonal Conference on Systems, Sgnal Processng and Electroncs Engneerng (ICSSEE'0 December 6-7, 0 Duba (UAE Solvng of Sngle-objectve Problems based on a Modfed Multple-crossover Genetc Algorthm: Test

More information

Generalized Linear Methods

Generalized Linear Methods Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

Appendix B: Resampling Algorithms

Appendix B: Resampling Algorithms 407 Appendx B: Resamplng Algorthms A common problem of all partcle flters s the degeneracy of weghts, whch conssts of the unbounded ncrease of the varance of the mportance weghts ω [ ] of the partcles

More information

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud Resource Allocaton wth a Budget Constrant for Computng Independent Tasks n the Cloud Wemng Sh and Bo Hong School of Electrcal and Computer Engneerng Georga Insttute of Technology, USA 2nd IEEE Internatonal

More information

Feature Selection: Part 1

Feature Selection: Part 1 CSE 546: Machne Learnng Lecture 5 Feature Selecton: Part 1 Instructor: Sham Kakade 1 Regresson n the hgh dmensonal settng How do we learn when the number of features d s greater than the sample sze n?

More information

Simultaneous Optimization of Berth Allocation, Quay Crane Assignment and Quay Crane Scheduling Problems in Container Terminals

Simultaneous Optimization of Berth Allocation, Quay Crane Assignment and Quay Crane Scheduling Problems in Container Terminals Smultaneous Optmzaton of Berth Allocaton, Quay Crane Assgnment and Quay Crane Schedulng Problems n Contaner Termnals Necat Aras, Yavuz Türkoğulları, Z. Caner Taşkın, Kuban Altınel Abstract In ths work,

More information

Thin-Walled Structures Group

Thin-Walled Structures Group Thn-Walled Structures Group JOHNS HOPKINS UNIVERSITY RESEARCH REPORT Towards optmzaton of CFS beam-column ndustry sectons TWG-RR02-12 Y. Shfferaw July 2012 1 Ths report was prepared ndependently, but was

More information

CHAPTER 2 MULTI-OBJECTIVE GENETIC ALGORITHM (MOGA) FOR OPTIMAL POWER FLOW PROBLEM INCLUDING VOLTAGE STABILITY

CHAPTER 2 MULTI-OBJECTIVE GENETIC ALGORITHM (MOGA) FOR OPTIMAL POWER FLOW PROBLEM INCLUDING VOLTAGE STABILITY 26 CHAPTER 2 MULTI-OBJECTIVE GENETIC ALGORITHM (MOGA) FOR OPTIMAL POWER FLOW PROBLEM INCLUDING VOLTAGE STABILITY 2.1 INTRODUCTION Voltage stablty enhancement s an mportant tas n power system operaton.

More information

The Expectation-Maximization Algorithm

The Expectation-Maximization Algorithm The Expectaton-Maxmaton Algorthm Charles Elan elan@cs.ucsd.edu November 16, 2007 Ths chapter explans the EM algorthm at multple levels of generalty. Secton 1 gves the standard hgh-level verson of the algorthm.

More information

Using Immune Genetic Algorithm to Optimize BP Neural Network and Its Application Peng-fei LIU1,Qun-tai SHEN1 and Jun ZHI2,*

Using Immune Genetic Algorithm to Optimize BP Neural Network and Its Application Peng-fei LIU1,Qun-tai SHEN1 and Jun ZHI2,* Advances n Computer Scence Research (ACRS), volume 54 Internatonal Conference on Computer Networks and Communcaton Technology (CNCT206) Usng Immune Genetc Algorthm to Optmze BP Neural Network and Its Applcaton

More information

An Interactive Optimisation Tool for Allocation Problems

An Interactive Optimisation Tool for Allocation Problems An Interactve Optmsaton ool for Allocaton Problems Fredr Bonäs, Joam Westerlund and apo Westerlund Process Desgn Laboratory, Faculty of echnology, Åbo Aadem Unversty, uru 20500, Fnland hs paper presents

More information

A Hybrid Variational Iteration Method for Blasius Equation

A Hybrid Variational Iteration Method for Blasius Equation Avalable at http://pvamu.edu/aam Appl. Appl. Math. ISSN: 1932-9466 Vol. 10, Issue 1 (June 2015), pp. 223-229 Applcatons and Appled Mathematcs: An Internatonal Journal (AAM) A Hybrd Varatonal Iteraton Method

More information

Problem Set 9 Solutions

Problem Set 9 Solutions Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem

More information

Speeding up Computation of Scalar Multiplication in Elliptic Curve Cryptosystem

Speeding up Computation of Scalar Multiplication in Elliptic Curve Cryptosystem H.K. Pathak et. al. / (IJCSE) Internatonal Journal on Computer Scence and Engneerng Speedng up Computaton of Scalar Multplcaton n Ellptc Curve Cryptosystem H. K. Pathak Manju Sangh S.o.S n Computer scence

More information

Single-Facility Scheduling over Long Time Horizons by Logic-based Benders Decomposition

Single-Facility Scheduling over Long Time Horizons by Logic-based Benders Decomposition Sngle-Faclty Schedulng over Long Tme Horzons by Logc-based Benders Decomposton Elvn Coban and J. N. Hooker Tepper School of Busness, Carnege Mellon Unversty ecoban@andrew.cmu.edu, john@hooker.tepper.cmu.edu

More information

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons

More information

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS Avalable onlne at http://sck.org J. Math. Comput. Sc. 3 (3), No., 6-3 ISSN: 97-537 COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

More information

Capacitor Placement In Distribution Systems Using Genetic Algorithms and Tabu Search

Capacitor Placement In Distribution Systems Using Genetic Algorithms and Tabu Search Capactor Placement In Dstrbuton Systems Usng Genetc Algorthms and Tabu Search J.Nouar M.Gandomar Saveh Azad Unversty,IRAN Abstract: Ths paper presents a new method for determnng capactor placement n dstrbuton

More information

Computing Correlated Equilibria in Multi-Player Games

Computing Correlated Equilibria in Multi-Player Games Computng Correlated Equlbra n Mult-Player Games Chrstos H. Papadmtrou Presented by Zhanxang Huang December 7th, 2005 1 The Author Dr. Chrstos H. Papadmtrou CS professor at UC Berkley (taught at Harvard,

More information

Some modelling aspects for the Matlab implementation of MMA

Some modelling aspects for the Matlab implementation of MMA Some modellng aspects for the Matlab mplementaton of MMA Krster Svanberg krlle@math.kth.se Optmzaton and Systems Theory Department of Mathematcs KTH, SE 10044 Stockholm September 2004 1. Consdered optmzaton

More information

CS : Algorithms and Uncertainty Lecture 17 Date: October 26, 2016

CS : Algorithms and Uncertainty Lecture 17 Date: October 26, 2016 CS 29-128: Algorthms and Uncertanty Lecture 17 Date: October 26, 2016 Instructor: Nkhl Bansal Scrbe: Mchael Denns 1 Introducton In ths lecture we wll be lookng nto the secretary problem, and an nterestng

More information

EEE 241: Linear Systems

EEE 241: Linear Systems EEE : Lnear Systems Summary #: Backpropagaton BACKPROPAGATION The perceptron rule as well as the Wdrow Hoff learnng were desgned to tran sngle layer networks. They suffer from the same dsadvantage: they

More information

DUE: WEDS FEB 21ST 2018

DUE: WEDS FEB 21ST 2018 HOMEWORK # 1: FINITE DIFFERENCES IN ONE DIMENSION DUE: WEDS FEB 21ST 2018 1. Theory Beam bendng s a classcal engneerng analyss. The tradtonal soluton technque makes smplfyng assumptons such as a constant

More information

Global Sensitivity. Tuesday 20 th February, 2018

Global Sensitivity. Tuesday 20 th February, 2018 Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values

More information

Durban Watson for Testing the Lack-of-Fit of Polynomial Regression Models without Replications

Durban Watson for Testing the Lack-of-Fit of Polynomial Regression Models without Replications Durban Watson for Testng the Lack-of-Ft of Polynomal Regresson Models wthout Replcatons Ruba A. Alyaf, Maha A. Omar, Abdullah A. Al-Shha ralyaf@ksu.edu.sa, maomar@ksu.edu.sa, aalshha@ksu.edu.sa Department

More information

ECE559VV Project Report

ECE559VV Project Report ECE559VV Project Report (Supplementary Notes Loc Xuan Bu I. MAX SUM-RATE SCHEDULING: THE UPLINK CASE We have seen (n the presentaton that, for downlnk (broadcast channels, the strategy maxmzng the sum-rate

More information

Outline and Reading. Dynamic Programming. Dynamic Programming revealed. Computing Fibonacci. The General Dynamic Programming Technique

Outline and Reading. Dynamic Programming. Dynamic Programming revealed. Computing Fibonacci. The General Dynamic Programming Technique Outlne and Readng Dynamc Programmng The General Technque ( 5.3.2) -1 Knapsac Problem ( 5.3.3) Matrx Chan-Product ( 5.3.1) Dynamc Programmng verson 1.4 1 Dynamc Programmng verson 1.4 2 Dynamc Programmng

More information

A discrete differential evolution algorithm for multi-objective permutation flowshop scheduling

A discrete differential evolution algorithm for multi-objective permutation flowshop scheduling A dscrete dfferental evoluton algorthm for mult-objectve permutaton flowshop schedulng M. Baolett, A. Mlan, V. Santucc Dpartmento d Matematca e Informatca Unverstà degl Stud d Peruga Va Vanvtell, 1 Peruga,

More information

The Convergence Speed of Single- And Multi-Objective Immune Algorithm Based Optimization Problems

The Convergence Speed of Single- And Multi-Objective Immune Algorithm Based Optimization Problems The Convergence Speed of Sngle- And Mult-Obectve Immune Algorthm Based Optmzaton Problems Mohammed Abo-Zahhad Faculty of Engneerng, Electrcal and Electroncs Engneerng Department, Assut Unversty, Assut,

More information

Pattern Classification

Pattern Classification Pattern Classfcaton All materals n these sldes ere taken from Pattern Classfcaton (nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John Wley & Sons, 000 th the permsson of the authors and the publsher

More information

HIERARCHICAL RANK DENSITY GENETIC ALGORITHM FOR RADIAL-BASIS FUNCTION NEURAL NETWORK DESIGN

HIERARCHICAL RANK DENSITY GENETIC ALGORITHM FOR RADIAL-BASIS FUNCTION NEURAL NETWORK DESIGN HIERARCHICAL RANK DEITY GENETIC ALGORITHM FOR RADIAL-BASIS FUNCTION NEURAL NETWORK DESIGN Gary G. Yen Hamng Lu Intellgent Systems and Control Laboratory School of Electrcal and Computer Engneerng Oklahoma

More information

A New Evolutionary Computation Based Approach for Learning Bayesian Network

A New Evolutionary Computation Based Approach for Learning Bayesian Network Avalable onlne at www.scencedrect.com Proceda Engneerng 15 (2011) 4026 4030 Advanced n Control Engneerng and Informaton Scence A New Evolutonary Computaton Based Approach for Learnng Bayesan Network Yungang

More information

The Minimum Universal Cost Flow in an Infeasible Flow Network

The Minimum Universal Cost Flow in an Infeasible Flow Network Journal of Scences, Islamc Republc of Iran 17(2): 175-180 (2006) Unversty of Tehran, ISSN 1016-1104 http://jscencesutacr The Mnmum Unversal Cost Flow n an Infeasble Flow Network H Saleh Fathabad * M Bagheran

More information

Multi-Objective Evolutionary Programming for Economic Emission Dispatch Problem

Multi-Objective Evolutionary Programming for Economic Emission Dispatch Problem Mult-Objectve Evolutonary Programmng for Economc Emsson Dspatch Problem P. Venkatesh and Kwang. Y.Lee, Fellow, IEEE Abstract--Ths paper descrbes a new Mult-Objectve Evolutonary Programmng (MOEP) method

More information

An Improved Clustering Based Genetic Algorithm for Solving Complex NP Problems

An Improved Clustering Based Genetic Algorithm for Solving Complex NP Problems Journal of Computer Scence 7 (7): 1033-1037, 2011 ISSN 1549-3636 2011 Scence Publcatons An Improved Clusterng Based Genetc Algorthm for Solvng Complex NP Problems 1 R. Svaraj and 2 T. Ravchandran 1 Department

More information

Calculation of time complexity (3%)

Calculation of time complexity (3%) Problem 1. (30%) Calculaton of tme complexty (3%) Gven n ctes, usng exhaust search to see every result takes O(n!). Calculaton of tme needed to solve the problem (2%) 40 ctes:40! dfferent tours 40 add

More information

NUMERICAL DIFFERENTIATION

NUMERICAL DIFFERENTIATION NUMERICAL DIFFERENTIATION 1 Introducton Dfferentaton s a method to compute the rate at whch a dependent output y changes wth respect to the change n the ndependent nput x. Ths rate of change s called the

More information

Irene Hepzibah.R 1 and Vidhya.R 2

Irene Hepzibah.R 1 and Vidhya.R 2 Internatonal Journal of Scentfc & Engneerng Research, Volume 5, Issue 3, March-204 374 ISSN 2229-558 INTUITIONISTIC FUZZY MULTI-OBJECTIVE LINEAR PROGRAMMING PROBLEM (IFMOLPP) USING TAYLOR SERIES APPROACH

More information

Chapter Newton s Method

Chapter Newton s Method Chapter 9. Newton s Method After readng ths chapter, you should be able to:. Understand how Newton s method s dfferent from the Golden Secton Search method. Understand how Newton s method works 3. Solve

More information

COS 521: Advanced Algorithms Game Theory and Linear Programming

COS 521: Advanced Algorithms Game Theory and Linear Programming COS 521: Advanced Algorthms Game Theory and Lnear Programmng Moses Charkar February 27, 2013 In these notes, we ntroduce some basc concepts n game theory and lnear programmng (LP). We show a connecton

More information

MMA and GCMMA two methods for nonlinear optimization

MMA and GCMMA two methods for nonlinear optimization MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons

More information

EEL 6266 Power System Operation and Control. Chapter 3 Economic Dispatch Using Dynamic Programming

EEL 6266 Power System Operation and Control. Chapter 3 Economic Dispatch Using Dynamic Programming EEL 6266 Power System Operaton and Control Chapter 3 Economc Dspatch Usng Dynamc Programmng Pecewse Lnear Cost Functons Common practce many utltes prefer to represent ther generator cost functons as sngle-

More information

Quantum-Evolutionary Algorithms: A SW-HW approach

Quantum-Evolutionary Algorithms: A SW-HW approach Proceedngs of the 5th WSEAS Int. Conf. on COMPUTATIONAL INTELLIGENCE, MAN-MACHINE SYSTEMS AND CYBERNETICS, Vence, Italy, November 0-, 006 333 Quantum-Evolutonary Algorthms: A SW-HW approach D. PORTO, A.

More information

Chapter - 2. Distribution System Power Flow Analysis

Chapter - 2. Distribution System Power Flow Analysis Chapter - 2 Dstrbuton System Power Flow Analyss CHAPTER - 2 Radal Dstrbuton System Load Flow 2.1 Introducton Load flow s an mportant tool [66] for analyzng electrcal power system network performance. Load

More information

Credit Card Pricing and Impact of Adverse Selection

Credit Card Pricing and Impact of Adverse Selection Credt Card Prcng and Impact of Adverse Selecton Bo Huang and Lyn C. Thomas Unversty of Southampton Contents Background Aucton model of credt card solctaton - Errors n probablty of beng Good - Errors n

More information

Errors for Linear Systems

Errors for Linear Systems Errors for Lnear Systems When we solve a lnear system Ax b we often do not know A and b exactly, but have only approxmatons  and ˆb avalable. Then the best thng we can do s to solve ˆx ˆb exactly whch

More information

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton

More information

Chapter 2 Real-Coded Adaptive Range Genetic Algorithm

Chapter 2 Real-Coded Adaptive Range Genetic Algorithm Chapter Real-Coded Adaptve Range Genetc Algorthm.. Introducton Fndng a global optmum n the contnuous doman s challengng for Genetc Algorthms (GAs. Tradtonal GAs use the bnary representaton that evenly

More information

For now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results.

For now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results. Neural Networks : Dervaton compled by Alvn Wan from Professor Jtendra Malk s lecture Ths type of computaton s called deep learnng and s the most popular method for many problems, such as computer vson

More information

Self-adaptive Differential Evolution Algorithm for Constrained Real-Parameter Optimization

Self-adaptive Differential Evolution Algorithm for Constrained Real-Parameter Optimization 26 IEEE Congress on Evolutonary Computaton Sheraton Vancouver Wall Centre Hotel, Vancouver, BC, Canada July 16-21, 26 Self-adaptve Dfferental Evoluton Algorthm for Constraned Real-Parameter Optmzaton V.

More information

VQ widely used in coding speech, image, and video

VQ widely used in coding speech, image, and video at Scalar quantzers are specal cases of vector quantzers (VQ): they are constraned to look at one sample at a tme (memoryless) VQ does not have such constrant better RD perfomance expected Source codng

More information

Supporting Information

Supporting Information Supportng Informaton The neural network f n Eq. 1 s gven by: f x l = ReLU W atom x l + b atom, 2 where ReLU s the element-wse rectfed lnear unt, 21.e., ReLUx = max0, x, W atom R d d s the weght matrx to

More information

P R. Lecture 4. Theory and Applications of Pattern Recognition. Dept. of Electrical and Computer Engineering /

P R. Lecture 4. Theory and Applications of Pattern Recognition. Dept. of Electrical and Computer Engineering / Theory and Applcatons of Pattern Recognton 003, Rob Polkar, Rowan Unversty, Glassboro, NJ Lecture 4 Bayes Classfcaton Rule Dept. of Electrcal and Computer Engneerng 0909.40.0 / 0909.504.04 Theory & Applcatons

More information

Particle Swarm Optimization with Adaptive Mutation in Local Best of Particles

Particle Swarm Optimization with Adaptive Mutation in Local Best of Particles 1 Internatonal Congress on Informatcs, Envronment, Energy and Applcatons-IEEA 1 IPCSIT vol.38 (1) (1) IACSIT Press, Sngapore Partcle Swarm Optmzaton wth Adaptve Mutaton n Local Best of Partcles Nanda ulal

More information

An Extended Hybrid Genetic Algorithm for Exploring a Large Search Space

An Extended Hybrid Genetic Algorithm for Exploring a Large Search Space 2nd Internatonal Conference on Autonomous Robots and Agents Abstract An Extended Hybrd Genetc Algorthm for Explorng a Large Search Space Hong Zhang and Masum Ishkawa Graduate School of L.S.S.E., Kyushu

More information

Numerical Heat and Mass Transfer

Numerical Heat and Mass Transfer Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and

More information

Neuro-Adaptive Design - I:

Neuro-Adaptive Design - I: Lecture 36 Neuro-Adaptve Desgn - I: A Robustfyng ool for Dynamc Inverson Desgn Dr. Radhakant Padh Asst. Professor Dept. of Aerospace Engneerng Indan Insttute of Scence - Bangalore Motvaton Perfect system

More information

arxiv: v1 [math.oc] 3 Aug 2010

arxiv: v1 [math.oc] 3 Aug 2010 arxv:1008.0549v1 math.oc] 3 Aug 2010 Test Problems n Optmzaton Xn-She Yang Department of Engneerng, Unversty of Cambrdge, Cambrdge CB2 1PZ, UK Abstract Test functons are mportant to valdate new optmzaton

More information

Annexes. EC.1. Cycle-base move illustration. EC.2. Problem Instances

Annexes. EC.1. Cycle-base move illustration. EC.2. Problem Instances ec Annexes Ths Annex frst llustrates a cycle-based move n the dynamc-block generaton tabu search. It then dsplays the characterstcs of the nstance sets, followed by detaled results of the parametercalbraton

More information

Constrained Evolutionary Programming Approaches to Power System Economic Dispatch

Constrained Evolutionary Programming Approaches to Power System Economic Dispatch Proceedngs of the 6th WSEAS Int. Conf. on EVOLUTIONARY COMPUTING, Lsbon, Portugal, June 16-18, 2005 (pp160-166) Constraned Evolutonary Programmng Approaches to Power System Economc Dspatch K. Shant Swarup

More information

Finite Element Modelling of truss/cable structures

Finite Element Modelling of truss/cable structures Pet Schreurs Endhoven Unversty of echnology Department of Mechancal Engneerng Materals echnology November 3, 214 Fnte Element Modellng of truss/cable structures 1 Fnte Element Analyss of prestressed structures

More information

BALANCING OF U-SHAPED ASSEMBLY LINE

BALANCING OF U-SHAPED ASSEMBLY LINE BALANCING OF U-SHAPED ASSEMBLY LINE Nuchsara Krengkorakot, Naln Panthong and Rapeepan Ptakaso Industral Engneerng Department, Faculty of Engneerng, Ubon Rajathanee Unversty, Thaland Emal: ennuchkr@ubu.ac.th

More information

An Improved Clonal Algorithm in Multiobjective Optimization

An Improved Clonal Algorithm in Multiobjective Optimization 976 JOURNAL OF SOFTWARE, VOL. 4, NO. 9, NOVEMBER 2009 An Improved Clonal Algorthm n Multobjectve Optmzaton Janyong Chen, Quzhen Ln and Qngbn Hu Department of Computer Scence and Technology, Shenzhen Unversty,

More information

Research Article Dynamic Environmental/Economic Scheduling for Microgrid Using Improved MOEA/D-M2M

Research Article Dynamic Environmental/Economic Scheduling for Microgrid Using Improved MOEA/D-M2M Mathematcal Problems n Engneerng Volume 26, Artcle ID 26753, 4 pages http://dx.do.org/.55/26/26753 Research Artcle Dynamc Envronmental/Economc Schedulng for Mcrogrd Usng Improved MOEA/D-M2M Xn L and Yanjun

More information

COMPOSITE BEAM WITH WEAK SHEAR CONNECTION SUBJECTED TO THERMAL LOAD

COMPOSITE BEAM WITH WEAK SHEAR CONNECTION SUBJECTED TO THERMAL LOAD COMPOSITE BEAM WITH WEAK SHEAR CONNECTION SUBJECTED TO THERMAL LOAD Ákos Jósef Lengyel, István Ecsed Assstant Lecturer, Professor of Mechancs, Insttute of Appled Mechancs, Unversty of Mskolc, Mskolc-Egyetemváros,

More information

Fuzzy Approaches for Multiobjective Fuzzy Random Linear Programming Problems Through a Probability Maximization Model

Fuzzy Approaches for Multiobjective Fuzzy Random Linear Programming Problems Through a Probability Maximization Model Fuzzy Approaches for Multobjectve Fuzzy Random Lnear Programmng Problems Through a Probablty Maxmzaton Model Htosh Yano and Kota Matsu Abstract In ths paper, two knds of fuzzy approaches are proposed for

More information

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017 U.C. Berkeley CS94: Beyond Worst-Case Analyss Handout 4s Luca Trevsan September 5, 07 Summary of Lecture 4 In whch we ntroduce semdefnte programmng and apply t to Max Cut. Semdefnte Programmng Recall that

More information

Fuzzy Boundaries of Sample Selection Model

Fuzzy Boundaries of Sample Selection Model Proceedngs of the 9th WSES Internatonal Conference on ppled Mathematcs, Istanbul, Turkey, May 7-9, 006 (pp309-34) Fuzzy Boundares of Sample Selecton Model L. MUHMD SFIIH, NTON BDULBSH KMIL, M. T. BU OSMN

More information

Winter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan

Winter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan Wnter 2008 CS567 Stochastc Lnear/Integer Programmng Guest Lecturer: Xu, Huan Class 2: More Modelng Examples 1 Capacty Expanson Capacty expanson models optmal choces of the tmng and levels of nvestments

More information

Lecture 20: November 7

Lecture 20: November 7 0-725/36-725: Convex Optmzaton Fall 205 Lecturer: Ryan Tbshran Lecture 20: November 7 Scrbes: Varsha Chnnaobreddy, Joon Sk Km, Lngyao Zhang Note: LaTeX template courtesy of UC Berkeley EECS dept. Dsclamer:

More information

MULTI-OBJECTIVE OPTIMUM DESIGN OF 3D STRUCTURES UNDER STATIC AND SEISMIC LOADING CONDITIONS

MULTI-OBJECTIVE OPTIMUM DESIGN OF 3D STRUCTURES UNDER STATIC AND SEISMIC LOADING CONDITIONS 4 th GRACM Congress on Computatonal Mechancs GRACM 2002 Patra, 27-29 June, 2002 GRACM MULTI-OBJECTIVE OPTIMUM DESIGN OF 3D STRUCTURES UNDER STATIC AND SEISMIC LOADING CONDITIONS Manols Papadrakaks, Nkos

More information

18.1 Introduction and Recap

18.1 Introduction and Recap CS787: Advanced Algorthms Scrbe: Pryananda Shenoy and Shjn Kong Lecturer: Shuch Chawla Topc: Streamng Algorthmscontnued) Date: 0/26/2007 We contnue talng about streamng algorthms n ths lecture, ncludng

More information

Using T.O.M to Estimate Parameter of distributions that have not Single Exponential Family

Using T.O.M to Estimate Parameter of distributions that have not Single Exponential Family IOSR Journal of Mathematcs IOSR-JM) ISSN: 2278-5728. Volume 3, Issue 3 Sep-Oct. 202), PP 44-48 www.osrjournals.org Usng T.O.M to Estmate Parameter of dstrbutons that have not Sngle Exponental Famly Jubran

More information

Tornado and Luby Transform Codes. Ashish Khisti Presentation October 22, 2003

Tornado and Luby Transform Codes. Ashish Khisti Presentation October 22, 2003 Tornado and Luby Transform Codes Ashsh Khst 6.454 Presentaton October 22, 2003 Background: Erasure Channel Elas[956] studed the Erasure Channel β x x β β x 2 m x 2 k? Capacty of Noseless Erasure Channel

More information

Research on Route guidance of logistic scheduling problem under fuzzy time window

Research on Route guidance of logistic scheduling problem under fuzzy time window Advanced Scence and Technology Letters, pp.21-30 http://dx.do.org/10.14257/astl.2014.78.05 Research on Route gudance of logstc schedulng problem under fuzzy tme wndow Yuqang Chen 1, Janlan Guo 2 * Department

More information

Cathy Walker March 5, 2010

Cathy Walker March 5, 2010 Cathy Walker March 5, 010 Part : Problem Set 1. What s the level of measurement for the followng varables? a) SAT scores b) Number of tests or quzzes n statstcal course c) Acres of land devoted to corn

More information

A MULTI-OBJECTIVE APPROACH WITH A RESTART META-HEURISTIC FOR THE LINEAR DYNAMICAL SYSTEMS INVERSE MATHEMATICAL PROBLEM

A MULTI-OBJECTIVE APPROACH WITH A RESTART META-HEURISTIC FOR THE LINEAR DYNAMICAL SYSTEMS INVERSE MATHEMATICAL PROBLEM Internatonal Journal on Informaton Technologes & Securty, 1 (vol.10), 2018 93 A MULTI-OBJECTIVE APPROACH WITH A RESTART META-HEURISTIC FOR THE LINEAR DYNAMICAL SYSTEMS INVERSE MATHEMATICAL PROBLEM 1 Ivan

More information

DETERMINATION OF TEMPERATURE DISTRIBUTION FOR ANNULAR FINS WITH TEMPERATURE DEPENDENT THERMAL CONDUCTIVITY BY HPM

DETERMINATION OF TEMPERATURE DISTRIBUTION FOR ANNULAR FINS WITH TEMPERATURE DEPENDENT THERMAL CONDUCTIVITY BY HPM Ganj, Z. Z., et al.: Determnaton of Temperature Dstrbuton for S111 DETERMINATION OF TEMPERATURE DISTRIBUTION FOR ANNULAR FINS WITH TEMPERATURE DEPENDENT THERMAL CONDUCTIVITY BY HPM by Davood Domr GANJI

More information

Boostrapaggregating (Bagging)

Boostrapaggregating (Bagging) Boostrapaggregatng (Baggng) An ensemble meta-algorthm desgned to mprove the stablty and accuracy of machne learnng algorthms Can be used n both regresson and classfcaton Reduces varance and helps to avod

More information

Chapter 2 A Class of Robust Solution for Linear Bilevel Programming

Chapter 2 A Class of Robust Solution for Linear Bilevel Programming Chapter 2 A Class of Robust Soluton for Lnear Blevel Programmng Bo Lu, Bo L and Yan L Abstract Under the way of the centralzed decson-makng, the lnear b-level programmng (BLP) whose coeffcents are supposed

More information

Application of B-Spline to Numerical Solution of a System of Singularly Perturbed Problems

Application of B-Spline to Numerical Solution of a System of Singularly Perturbed Problems Mathematca Aeterna, Vol. 1, 011, no. 06, 405 415 Applcaton of B-Splne to Numercal Soluton of a System of Sngularly Perturbed Problems Yogesh Gupta Department of Mathematcs Unted College of Engneerng &

More information