Self-Adaptive Simulated Binary Crossover for Real-Parameter Optimization
|
|
- Cory Young
- 5 years ago
- Views:
Transcription
1 Self-Adaptve Smulated Bnary Crossover for Real-Parameter Optmzaton Kalyanmoy Deb Dept. of Mechancal Engneerng Indan Inst. of Tech. Kanpur Kanpur, PIN 20806, Inda S. Karthk Dept. of Mechancal Engneerng Indan Inst. of Tech. Kanpur Kanpur, PIN 20806, Inda Tatsuya Okabe Honda Research Insttute Japan 8- Honcho, Wako-sh Satama, , Japan ABSTRACT Smulated bnary crossover (SBX) s a real-parameter recombnaton operator whch s commonly used n the evolutonary algorthm (EA) lterature. The operator nvolves a parameter whch dctates the spread of offsprng solutons vs-a-vs that of the parent solutons. In all applcatons of SBX so far, researchers have kept a fxed value throughout a smulaton run. In ths paper, we suggest a self-adaptve procedure of updatng the parameter so as to allow a smooth navgaton over the functon landscape wth teraton. Some basc prncples of classcal optmzaton lterature are utlzed for ths purpose. The resultng EAs are found to produce remarkable and much better results compared to the orgnal operator havng a fxed value of the parameter. Studes on both sngle and multple objectve optmzaton problems are made wth success. Categores and Subject Descrptors I.2.8 [Computng Methodologes]: Problem Solvng, Control Methods, and Search General Terms Algorthms Keywords Self-adaptaton, smulated bnary crossover, real-parameter optmzaton, recombnaton operator.. INTRODUCTION Most real-world optmzaton problems nvolve decson varables whch are real-valued. Despte the dedcated realparameter EAs, such as evoluton strategy, dfferental evoluton etc., real-parameter GAs have ganed adequate popularty n the recent past. The man challenge n developng an effcent real-parameter GA les n devsng a recombnaton operator n whch two or more real-parameter vectors Permsson to make dgtal or hard copes of all or part of ths work for personal or classroom use s granted wthout fee provded that copes are not made or dstrbuted for proft or commercal advantage and that copes bear ths notce and the full ctaton on the frst page. To copy otherwse, to republsh, to post on servers or to redstrbute to lsts, requres pror specfc permsson and/or a fee. GECCO 07, July 7, 2007, London, England, Unted Kngdom. Copyrght 2007 ACM /07/ $5.00. must be blended to create two or more offsprng vectors of real numbers [, 2, 9, 7]. These recombnaton operators employ a non-unform probablty dstrbuton around the parent solutons to create an offsprng soluton. A theoretcal study [] attempted to fnd smlartes among these operators. In ths paper, we concentrate on a partcular recombnaton operator the smulated bnary crossover (SBX) operator [2]. The SBX operator uses two parent vectors and apply the blendng operator varable by varable to create two offsprng solutons. The operator nvolves a parameter, called the dstrbuton ndex (η c), whch s kept fxed to a non-negatve value throughout a smulaton run. If a large value of η c s chosen, the resultng offsprng solutons are close to the parent solutons. On the other hand, for a small value of η c, solutons away from parents are lkely to be created. Thus, ths parameter has a drect effect n controllng the spread of offsprng solutons. Snce a search process of fndng the mnmum soluton of a functon landscape largely depends on controllng the spread (or dversty) of offsprng solutons vs-a-vs the selecton pressure ntroduced by the chosen selecton operaton, fxng the η c parameter to an approprate value s an mportant task. Here, we suggest a self-adaptve procedure of updatng the η c parameter by usng the extenson-contracton concept n a classcal optmzaton algorthm. If the created chld soluton s better than the partcpatng parent solutons, the chld soluton s extended further n the hope of creatng even a better soluton. On the other hand, f a worse soluton s created, a contracton s performed. Ether task wll result n a update of η c, so that the newly-created extended or contracted offsprng soluton has an dentcal probablty of creaton wth an updated η c. Ths modfcaton procedure has been appled to three sngle-objectve and three twoobjectve optmzaton problems and compared wth correspondng GAs wth a fxed η c value. In all cases, better performance of the suggested self-adaptve procedure s observed. In the remander of the paper, we brefly descrbe the SBX operator. Thereafter, we suggest the self-adaptve η c update procedure and show smulaton results on sngle-objectve optmzaton problems. In each case, a parametrc study wth a parameter α s performed to fnd a sutable workng range of ths parameter. Then, a scale-up study by varyng the number of decson varables s performed to demonstrate the polynomal complexty of the suggested algorthm. Fnally, the self-adaptve update of η c s extended to mult- 87
2 objectve optmzaton and results are dscussed. Fnally, conclusons from the study are made. 2. SIMULATED BINARY CROSSOVER (SBX) As the name suggests, the SBX operator [2, 6] smulates the workng prncple of the sngle-pont crossover operator on bnary strngs. In the above-mentoned studes, t was shown that ths crossover operator respects the nterval schemata processng [7], n the sense that common nterval schemata between the parents are preserved n the offsprng. The procedure of computng the offsprng x (,t+) and x (2,t+) from the parent solutons x (,t) and x (2,t) s descrbed as follows. A spread factor β s defned as the rato of the absolute dfference n offsprng values to that of the parents: β = x (2,t+) x (2,t) x (,t+) x (,t). () Frst, a random number u between 0 and s created. Thereafter, from a specfed probablty dstrbuton functon, the ordnate β q s found so that the area under the probablty curve from zero to β q s equal to the chosen random number u. The probablty dstrbuton used to create an offsprng s derved to have a smlar search power to that n a sngle-pont crossover n bnary-coded GAs and s gven as follows [2]: ( 0.5(ηc +)β ηc, f β ; P(β )= 0.5(η c +), otherwse. (2) β ηc+2 Fgure shows the above probablty dstrbuton wth η c = 2 and 5 for creatng offsprng from two parent solutons (x (,t) =2.0 andx (2,t) = 5.0). In the above expressons, the dstrbuton ndex η c s any non-negatve real number. A large value of η c gves a hgher probablty for creatng near-parent solutons (thereby allowng a focussed search) and a small value of η c allows dstant solutons to be selected as offsprng (thereby allowng to make dverse search). Probablty densty per offsprng η η c = 2 c= 5 o o Offsprng soluton Fgure : The probablty densty functon for creatng offsprng under an SBX-η c operator. 8 After obtanng β q from the above probablty dstrbuton, the offsprng are calculated as follows: h x (,t+) = 0.5 ( + β q )x (,t) h x (2,t+) = 0.5 ( β q )x (,t) +( β q )x (2,t) +(+β q )x (2,t), (3). (4) The SBX operator bases solutons near each parent more favorably than solutons away from the parents. Essentally, the SBX operator has two propertes:. The dfference between the offsprng s n proporton to the parent solutons. 2. Near-parent solutons are monotoncally more lkely to be chosen as offsprng than solutons dstant from parents. An nterestng aspect of ths crossover operator s that for afxedη c theoffsprnghaveaspreadwhch s proportonal to that of the parent solutons x (2,t+) x (,t+) = β q x (2,t) x (,t). (5) In ntal populatons, where the solutons are randomly placed, makng the dfference n parents ((x (2,t) x (,t) )) large, ths allows to create a chld soluton whch s also far away from the parents. However, when the solutons tend to converge due to the acton of genetc operators (thereby makng the parent dfference small), dstant solutons are not lkely to occur, thereby focusng the search to a narrow regon. As we dscuss n the followng secton that ths aspect of self-adaptve nature of SBX operator s not adequate alone n reachng near the optmum n large-szed and complex functons. 3. SELF-ADAPTIVE SBX The SBX operator dscussed above nvolves a parameter: the dstrbuton ndex η c. In most applcatons of SBX, a fxed value of η c = 2 s used for sngle-objectve optmzaton [2]. For a fxed value of η c, the dfference between the created chld soluton and the closest parent soluton depends on the net dfference between the two parent solutons, thereby causng a self-adaptve property of such a operator [5]. It has always been a research ssue whether such a self-adaptve property s adequate n solvng dffcult optmzaton problems. Past studes of real-coded genetc algorthms wth the SBX operator was not found to be sutable for mult-modal problems, such as Rastrgn s functon [4]. Here, we suggest a procedure for updatng the η c parameter adaptvely to solve such problems. To llustrate the modfed procedure, let us consder Fgure 2, n whch a typcal chld soluton c s shown to be created from two parent solutons p and p 2 by usng SBX wth a dstrbuton ndex of η c. Say, the random number usedforthspartcularcrossoveroperatonsu ( (0, )). Then, f β (> ) corresponds to the spread factor for the specfc case of crossover, we obtan the followng from the defnton of spread factor: By notng that Z β β =+ 2(c p2) p 2 p. (6) 0.5(η c +) β ηc+2 dβ =(u 0.5), 88
3 0 0 0 η c 00 η 00 c u 000 u p p2 c c Fgure 2: A schematc dagram showng the η c update procedure. we obtan the followng relatonshp: η c = + log 2( u) log β η c «. (7) We now get nto four scenaros (resultng n equatons 9 to 2), as dscussed below. If ths chld soluton c s better than both parent solutons, we assume that the regon n whch the chld soluton s created s better than the regon n whch the parents solutons are and ntend to extend the chld soluton further away from the closest parent soluton (p 2, n the case shown n the fgure) by a factor α (> ). Ths dea s smlar to that followed n Nelder and Meade s smplex search method [0], n whch an ntermedate soluton s ether expanded or contracted or kept the same dependng on the functon value of the soluton compared to that of the prevously computed solutons. Rechenberg s /5th rule also keeps track of proporton of successful mutatons over a certan number of trals [3]. If the success happens too often, the mutaton strength s ncreased to create solutons away from the parent, else the mutaton strength s reduced. By usng α>, the dfference between the new chld soluton c wth closest parent p 2 s made α tmes than that between orgnal chld soluton c and p 2, such that (c p 2)=α(c p 2). We then modfy the dstrbuton ndex to a value η c such that wth ths value and havng the dentcal random number u, the modfed chld soluton c gets created from parent solutons p and p 2, thereby yeldng η c = + log 2( u) log β «. (8) Here, β s the correspondng dstrbuton ndex, gven by β = + 2(c p 2) (p 2 p, ) = +α(β ). Usng the above relatonshp between β and β and usng equatons 7 and 8, we obtan the followng update relatonshp for a chld soluton beng found to be better than the nearest parent soluton and the chld les outsde the regon bounded by parents: η c (ηc +)logβ = + log ( + α(β )). (9) To make the η c value meanngful and free from numercal underflow error, we restrct t wthn [0, 50], that s f η c < 0 s obtaned by the above equaton, we set t to be zero and f η c > 50 s used, we set t to be 50. Ths equaton gves us an update procedure of η c for provdng a dstrbuton ndex whch s able to create chldren solutons n the rght drecton away from the parents. It s nterestng to note that f a chld c was created to the left of p, a smlar update relatonshp wll also be acheved. If the chld soluton c s worse than both parent solutons, we would lke to move the modfed chld c to get closer to theparentsandwemayuse/α nstead of α n equaton 6: η c (η c +)logβ = + log ( + (β )/α). (0) However, f a chld soluton s created nsde the regon bounded by both parents, a dfferent update relatonshp wll be obtaned, snce the SBX probablty dstrbuton functon s dfferent n ths case. By followng the above arguments, we obtan β = β α and the relatonshp for an mproved chld soluton between η c and η c values s obtaned as follows: η c = +ηc. () α Once agan, we restrct ts value wthn [0, 50] to avod any computatonal error and to make η c meanngful. For a scenaro of creatng a worse chld, the above update relatonshp changes to η c = α( + η c). (2) If the chld soluton c has a functon value whch s wthn the functon value of the two parent solutons, we set η c = η c. To mplement the update concept, we assgn a η c value wthn [ηc L,ηc U ] n the ntal populaton. In all smulatons here, we use ηc L = ηc U = 2. For a chld soluton, one random number s created and a correspondng β s computed. Ths β s used for all n varables and a chld s created by varablewse applcaton of the SBX operator. Ths results n a lne- SBX operator whch produces a chld along the lne jonng the two parent vectors. Thereafter, dependng on the event of whether a better chld (than both parents) or a worse chld (than both parents) s created, η c s updated and s assgned to the correspondng chld soluton. We assgn a new η c value to each chld soluton separately. It s nterestng to note that f α = s used, all the above update of η c procedure result n η c = η c and the above procedure s dentcal to the fxed η c (orgnal SBX) procedure. 3. Effect of mutaton operator In addton to the above modfed SBX operator, a mutaton operator can be used to perturb the created chld c. In such an event, there s an extra soluton evaluaton per chld creaton. Soluton c gets evaluated durng the crossover operator and the mutated verson of the modfed soluton c s evaluated. In our mplementaton, we add such extra functon evaluatons n the computaton of performance of the modfed procedure. However, f the mutaton probablty s so low that no varable gets mutated by the mutaton operator, there s no extra evaluaton recorded. 4. SIMULATION RESULTS We now apply the modfed approach to three dfferent unconstraned functons whch are popularly used n the GA 89
4 lterature. Many studes n the lterature on the chosen test problems use a populaton whch s ntalzed symmetrcally around the global mnmum of the functons. When an algorthm wth such a populaton uses recombnaton and mutaton operators, whch have a tendency to create solutons n the central regon of the search space bounded by the populaton members, t fnds an easer tme convergng to the global mnmum. To avod any such undue advantage from the operators, n all smulatons here, the ntal populaton s bounded n the range x [0, 5] for all, such that the global mnmum s not bracketed n the ntal populaton. Ths provdes a stff test to an algorthm to frst get out of the regon bounded by the ntal populaton and then keep movng n the correct drecton so as to reach the global mnmum. 4. Sphere Functon The sphere functon s the smplest of the three functons used n ths study: f(x) = nx x 2. (3) Frst, we employ the real-coded GA wth the orgnal fxedη c based SBX operator on the 30-varable sphere functon wth followng parameter settngs: populaton sze = 50, p c = 0.9, η c = 2, p m = /30, and η m = 50. A run s termnated when a soluton havng a functon value equal to 0.00 s found. Eleven runs are made from random ntal populatons. Fgure 3 shows a typcal varaton of best populaton functon value wth the number of functon evaluatons. To nvestgate the effect of recombnaton operator alone, we make another set of runs wth p m =0andatypcal performance s also shown n the fgure. Both results ndcate that the fxed-η c based GA s unable to fnd the true optmum n any reasonable number of evaluatons for a 30-varable sphere functon. However, t s worthwhle to menton here that after a varable-wse creaton of two offsprng vectors, f the varables values are swapped randomly between the two offsprngs (smlar to a unform crossover operator or the crossover operator n dfferental evoluton [2]), a much qucker convergence wth a fxed η c =2can be obtaned for varable-wse separable functons, lke the sphere functon [5]. Ths s because varables can ndependently reach near the true optmum n dfferent populaton members and a unform swappng of such solutons can create a complete soluton havng near optmal varables values. However, ths unform-lke crossover operaton may not work well n rotated and more complex problems. In ths paper, we only concentrate on the blendng part of the operaton and nvestgate whether the fxed nature of η c or the selfadaptve nature of η c s more effectve wthout havng any crossover-lke swappng effect. Next, we employ our self-adaptve update procedure of η c. All ntal populaton members are ntalzed wth η c =2 and then allowed to change based on our update procedure descrbed above. All other parameters are the same as above and to nvestgate the effect of the self-adaptve recombnaton operator alone, we use p m = 0 and reduce the crossover probablty to p c =0.7. For the η c update we use α =.50. A typcal varaton of the best populaton functon value s shown n Fgure 3 and s found to have good convergng property. Table shows the best, medan and worst number of functon evaluatons to reach a soluton wth f = 0.00 = out of runs. It s clear that compared to the fxed-η c schemes, the self-adaptve scheme s able to steer the search towards the true mnmum soluton quckly and converge close to the mnmum. It s clear that even wth 300,000 functon evaluatons, the fxed η c scheme s not able to fnd a near-optmum soluton, whereas wth a medan of 84,050 functon evaluatons, a soluton wth three decmal places accuracy from the true optmum s found repeatedly n runs. 4.. Parametrc Study Fgure 4 does a parametrc study wth α n the range [.05, 2.00]. Recall that the parameter α sgnfes the extent of change n the offsprng soluton performed to recompute the η c parameter for an dentcal probablty event of creatng the modfed soluton. Once agan, runs are performed for every case and the best, medan and worst number of functon evaluatons are shown n the fgure. It can be sad that the effect of α s not sgnfcant. Although there s a degradaton of the medan performance wth ncreasng α, the performance s best n the range α [.05,.50]. Thus, despte the ntroducton of a new parameter (α) for updatng an exstng parameter (η c), the effect of the parameter α s not sgnfcant Scale-up Study Fnally, we perform a scalablty study by varyng the number of varables (n) from 20 to 200. In ths study, we have used the followng update of parameter due to the ncrease n number of varables: populaton sze = 5n. All other parameters are kept the same as before and we use α =.50. Fgure 5 shows that () the real-coded GA wth self-adaptve recombnaton operator s able to fnd a soluton close to the true mnmum (wthn a tolerance of 0.00 n the functon value) and () the ncrease n number of functon evaluatons s polynomal to the ncrease n number of varables (O(n 2.2 )). The GA wth the self-adaptve SBX operator suggested here does not explot the varable separablty of the objectve functons. Ths s the reason why the proposed GA takes more number of evaluatons than other approaches whch favor the varable separablty and unmodalty of the sphere functon [5, 4]. 4.2 Rosenbrock Functon Next, we consder the Rosenbrock s functon: n X f(x) = 00(x 2 x +)+(x ) 2. (4) = Ths functon has the global mnmum at x =forall wth a functon value equal to zero. Near the mnmum regon, ths functon has a very small slope towards the mnmum. Ths property of the landscape causes an algorthm to have a slow convergence to the mnmum. Once agan, we frst employ the orgnal SBX operator wth a fxed η c = 2 and ntalze x [0, 5] for all. Fgure 6 shows a typcal varaton of populaton-best functon value wth the number of functon evaluatons for the 30-varable Rosenbrock functon wth followng parameter settngs: populaton sze = 50, p c =0.9, p m =/30, and η m = 50. The algorthm s termnated when a soluton wth a mnmum functon value of 0.00 s found. The procedure s not able to come close to the true mnmum. When we use 90
5 Functon Value Org. (p_c=0.9,p_m=0.033) Org. (p_c=0.9,p_m=0) Self adaptve Functon Evaluatons Functon Evaluatons e+08 e+07 e Slope = Functon Evaluatons α Number of Varables Fgure 3: Varaton of populatonbest functon value wth number of functon evaluatons for the 30- varable sphere functon. Fgure 4: Parametrc study of α for the 30-varable sphere functon. Fgure 5: Scale-up study wth number of varables for the sphere functon. Table : Performance of real-coded GAs wth fxed and self-adaptve η c update on 30-varable sphere functon. Method Optmzed functon value (func. eval.) Orgnal (p c =0.9, p m =0.033).24e03 (300,000) 4.6e03 (300,000) 4.30e03 (300,000) Orgnal (p c =0.9, p m =0).2e03 (300,000) 4.3e03 (300,000) 4.24e03 (300,000) Self-adp.(p c =0.7, p m =0) 0 3 (5,800) 0 3 (84,050) 0 3 (23,450) p m = 0, a somewhat better performance s observed, but the procedure s unable to reach near to the global mnmum. Now, we apply the self-adaptve recombnaton operator startng wth η c = 2 to all ntal populaton members. We use α =.5 for the update procedure. Fgure 6 shows a typcal varaton n the populaton-best functon value. The self-adaptve property of the recombnaton operator s able to adjust the η c adequately to navgate through the ftness landscape to reach near the global mnmum. Table 2 shows the best, medan and worst performance out of runs of orgnal and self-adaptve GAs. For the self-adaptve case, we have shown results wth α =.4, whch produces the best result. Wth as many as 0 mllon functon evaluatons, the fxed η c scheme s not able to fnd a near-optmum soluton (n fact, the best soluton has a functon value of 6.85(0 6 )), whereas wth a medan of about 6.9 mllon functon evaluatons, a soluton wth three decmal places accuracy from the true optmum s found repeatedly Parametrc Study A parametrc study on α s shown n Fgure 7. Although there s a upward trend n number of functon evaluatons wth ncreasng α, wth α [.05,.50] the performance s better. Interestngly, n ths problem also we fnd that the effect of α n a good range of values s not sgnfcant Scale-up Study A scale-up study s made next by varyng the number of varables from 20 to 200. Fgure 8 shows that the number of functon evaluatons needed to reach up to three decmal places of accuracy vares as O(n (log n) 9.47 ) by the proposed self-adaptve procedure. 4.3 Rastrgn s Functon Next, we consder the Rastrgn s functon whch has many local optma and one global mnmum at x =0for =, 2,...,n: f(x) = nx x 2 +0( cos(2πx )). (5) = In an earler study [4], ths functon was dffcult to solve for global optmalty usng the real-coded GA wth a parent centrc recombnaton operator, partcularly when the ntal populaton dd not bracket the global optmum. In ths study, we ntalze a populaton wth each x created randomly n [0, 5], away from the global mnmum soluton. In a sngle dmenson, an algorthm has to overcome at least 0 dfferent local optma to reach to the global mnmum. Wth a larger varable sze, exponentally more local optma must be overcome to reach the global mnmum. Frst, we apply the real-coded GA wth the orgnal SBX operator on the 20-varable Rastrgn functon wth a standard parameter settng: populaton sze = 00, p c =0.9, η c =2,p m =/20, η m = 50. GAs are run from dfferent ntal populatons tll a maxmum of 40,000 generatons or tll a soluton havng a functon value of 0 4 s obtaned. Table 3 shows the best functon values obtaned by the procedure. In ths case, the best obtaned functon value (n runs) wth four mllon functon evaluatons s , whereas the globally best soluton has a functon value equal to zero. It s clear that no run s able to fnd a soluton close to the global mnmum. Wth p c =0.7 andp m =0.0, we obtan slghtly better performance, but even now no soluton close to the global mnmum s found. Next, we apply the real-coded GA wth our proposed selfadaptve SBX operator wth p m =0.7 andp m =0.0. All ntal populaton members are ntalzed wth η c =2and then allowed to change usng the proposed η c update procedure descrbed earler. We use α =.5 here. Table 3 shows 9
6 Functon Value e+08 Org. (p_c=0.9, p_m=0.033) e+06 Org. (p_c=0.9,p_m=0) Self adaptve e+06 4e+06 6e+06 8e+06 e+07 Functon Evaluatons Functon Evaluatons.2e+07.e+07 e+07 9e+06 8e+06 7e+06 6e+06 5e+06 4e+06 3e+06 2e α Functon Evaluatons e+09 e+08 e+07 e Number of Varables 200 Fgure 6: Varaton of populatonbest functon value wth number of functon evaluatons for the 30- varable Rosenbrock s functon. Fgure 7: Parametrc study of α for the 30-varable Rosenbrock s functon. Fgure 8: Scale-up study wth number of varables for the Rosenbrock s functon. Table 2: Performance of real-coded GAs wth fxed and self-adaptve η c update on 30-varable Rosenbrock s functon. Method Optmzed functon value (func. eval.) Orgnal (p c =0.9, p m =0.033) 6.85e06 (0M) 7.44e06 (0M) 8.30e07 (0M) Orgnal (p c =0.9, p m =0) 9.94e06 (0M) 4.94e07 (0M) 5.9e07 (0M) Self-adp.(p c =0.7, p m =0) 0 3 (2,200,650) 0 3 (6,832,950) 0 3 (7,836,300) that n all cases the self-adaptve update of η c s able to fnd a soluton wth desred accuracy n a fracton of total evaluatons used n the case of fxed-η c procedures. Despte beng started far away from the global mnmum, the procedure s able to converge to the correct globally mnmum soluton. Fgure 9 shows the decrease n best functon value wth number of functon evaluatons for a typcal smulaton run wth a fxed η c = 2 procedure (p c =0.7, p m =0.0) and wth the self-adaptve procedure. The fgure clearly shows that the fxed η c run s poor n ts performance, whereas the self-adaptve procedure steadly fnds better and better solutons wth functon evaluatons. f(x) or eta_c e 04 eta_c Orgnal SBX Adaptve SBX e 05 0 e05 2e05 3e05 4e05 5e05 Functon Evaluatons Fgure 9: Decrease n best populaton functon value wth number of functon evaluatons for the 20- varable Rastrgn s functon. To understand the effect of the proposed self-adaptve update of η c,werecordtheη c value of the top 5 percentle 6e05 solutons n terms of ther functon values and show ts varaton wth number of functon evaluatons n Fgure 9. The y- axs of ths fgure s made logarthmc. Although, the above η c value seems to end at 0 5 n the fgure, the actual value recorded by the procedure s η c = 0. An nterestng aspect s that the η c value seems to take a value zero at varous stages of the smulaton. The lne correspondng to the best functon value (marked as Adaptve SBX ) ndcates that there are a number of functon values, especally wthn f = 0 to f =, n whch the algorthm seems to get stuck for a large number of evaluatons before fndng a better soluton. Wthn ths range of functon values, ths functon has one local mnmum at every nteger value of the functon, thereby havng a possblty to get stuck 0 tmes. Interestngly, every tme the best populaton member gets stuck at a local mnmum, the η c of the best 5 percentle soluton gets updated to zero, thereby ncreasng the spread of created solutons by the SBX operator. Snce an η c = 0 wll be the smallest possble η c whch provdes the maxmum spread n created solutons, the algorthm fnds that the best way to counteract a local stats s to ncrease the dversty of created solutons to the extent possble. However, as soon as a better soluton s found, the η c s mmedately updated to a value close to one, thereby provdng a more focussed search around populaton members. Wth an assgned fxed value of η c over the entre smulaton run, such a varaton n spread n solutons n an offsprng populaton s not possble. The proposed procedure seems to employ ths prncple adaptvely and multply n as many tmes as the algorthms get stuck to a locally optmal soluton and mprove from such a stuaton. In the absence of such an adaptve update of η c wth the orgnal SBX operator, the correspondng GA was not able to mprove ts performance effcently every tme t gets stuck to a locally optmal soluton. 92
7 Table 3: Performance of real-coded GAs wth fxed and self-adaptve η c update on 20-varable Rastrgn s functon. Method Optmzed functon value (func. eval.) Orgnal (p c =0.9, p m =0.05) (4M) (4M) (4M) Orgnal (p c =0.7, p m =0.0) (4M) (4M) (4M) Self-adp.(p c =0.7, p m =0.0) 0 4 (287,822) 0 4 (429,5) 0 4 (569,597) 4.3. Parametrc Study A parametrc study of α to nvestgate ts effect on the performance of the proposed procedure s made next. For the 20-varable Rastrgn s functon and wth above parameter settngs, dfferent runs are made. Fgure 0 shows number of functon evaluatons needed to fnd a soluton wth a functon value equal to or smaller than 0 4. It s nterestng to note that for a large range of values of α ( [.05, 8.00]), the performance of the proposed procedure remans farly ndependent of α. However, the best performance seems to happen for α =3wthbest,medanand worst number of functon evaluatons of 22,082, 342,74, and 78,680, respectvely. Functon Evaluatons e alpha Fgure 0: Effect of parameter α on number of functon evaluatons to obtan the global mnmum wth four decmal places of accuracy for the 20-varable Rastrgn s functon Scale-up Study Motvated by the success of the self-adaptve SBX procedure on the 20-varable Rastrgn s functon, we now try to solve larger sze Rastrgn s functon wth n varyng n [20, 200]. Wth an ncrease n n, the number of local mnma n a partcular range of the varable values ncrease exponentally and the resultng problem s lkely to provde more dffculty to an optmzaton algorthm. Snce a functon wth a larger number of varables should deally requre a larger populaton sze for a GA ntalzed wth a randomly created populaton [8], we use the followng parametrc update for dfferent n: populaton sze=5n, p m =0.2/n, andp c =0.7. Here also, we ntalze populaton wth x [0, 5], so as to not bracket the global mnmum n the ntal populaton. We also use α =.5 for all n. We run tll a soluton wth a functon value equal to or smaller than 0 4 s obtaned. Fgure shows that the requred number of functon evaluatons ncreased polynomally (O(n.807 )) wth n over the entre range of number of varables used n ths study. It s Number of Functon Evaluatons e+08 e+07 e+06 e Number of Varables Slope=.807 Fgure : A polynomal ncrease n functon evaluatons wth number of decson varables for the Rastrgn s functon usng proposed algorthm. noteworthy that the proposed procedure s able to overcome exponentally many local mnma to converge to the globally mnmum soluton wth polynomally ncreasng number of functon evaluatons to as complex as a 200-varable Rastrgn s functon. 5. SELF-ADAPTIVE SBX FOR MULTI-OBJECTIVE OPTIMIZATION Lke the way we made the SBX operator self-adaptve for sngle-objectve optmzaton, we extend the dea here for mult-objectve optmzaton. The man dffculty arses n decdng when a chld soluton s better than a parent. Here, we smply use the dea of non-domnaton to decde on ths matter. Let us consder Fgure 2. For the two parent objectve vectors shown n the fgure, f a chld les on the non-domnated shaded regon (marked wth A ), we call that the chld to be better than the parents and we use the η c update equatons descrbed earler. On the other hand, f the chld les on the regon marked as B n the fgure, we call that the chld s worse than the parents and we use the approprate equaton (descrbed earler) to update η c. If, however, the chld les on the regon marked as C n thefgure,wedonotupdateη c. The remanng part of the NSGA-II algorthm [3] s used as usual
8 000 f2 B parents C A f Fgure 2: A sketch showng dfferent regons n whch the chld may le for an approprate update of η c. 6. SIMULATION RESULTS Here, we show the workng of NSGA-II wth the selfadaptve SBX on three test problems: 30-varable ZDT and ZDT2 and 2-varable DTLZ2 problems. 6. ZDT, ZDT2 and DTLZ2 Problems We use the hyper-volume measure to ndcate the performance of a procedure. We compare the performance of the self-adaptve procedure wth NSGA-II havng the fxed-η c based SBX procedure wth standard settng: η c =5and η m = 20. We use the followng parameter settng for selfadaptve EA: populaton sze = 00, p c =0.9, p m =/30, p m = 0 and maxmum number of generatons = 500. We ntalze all populaton members wth η c = 2, as before. Table 4 shows the hyper-volume measure for varous α values wth the self-adaptve procedure. We observe that wth α values near.70, the performance of Table 4: Performance the self-adaptve NSGA- (hyper-volume) comparson II s better than of self-adaptve NSGA-II the fxed-η c based wth fxed-η c based SBX on NSGA-II. Table 4 ZDT and ZDT2. also shows the performance for 30-varable α Best Medan Worst ZDT2 problem. Here, ZDT we observe that for Orgnal, fxed η c =5 α values larger than the performance Self-Adaptve SBX of the self-adaptve NSGA-II s better For the three-objectve DTLZ2 problem, selfadaptve EA obtaned ZDT2 better hyper-volume Orgnal, fxed η c =5 values of , and , Self-Adaptve SBX compared to , and as best, medan and worst values obtaned usng orgnal fxedη c EA. 7. CONCLUSIONS In ths paper, we have suggested a self-adaptve procedure for updatng the dstrbuton ndex η c used n the smulated bnary crossover or SBX operator whch s a commonly-used real-parameter recombnaton operator. The update procedure mmcs the extenson-contracton concept n Nelder and Meade s smplex search procedure and also follows, n prncple, Rechenberg s /5-th update rule. On three sngleobjectve optmzaton problems and on three two-objectve optmzaton problems, the suggested procedure s found to be perform much better than the orgnal SBX procedure. Further nvestgatons are now needed for solvng problems havng a lnkage among varables and problems havng more than two objectves. A smlar self-adaptve dea can also be used wth other real-parameter recombnaton operators. 8. ACKNOWLEDGMENT Ths study s supported by a research grant from Honda R&D, Japan. 9. REFERENCES [] H.-G. Beyer and K. Deb. On the desred behavor of self-adaptve evolutonary algorthms. In Parallel Problem SolvngfromNatureVI(PPSN-VI), pages 59 68, [2] K.DebandR.B.Agrawal.Smulatedbnarycrossoverfor contnuous search space. Complex Systems, 9(2):5 48, 995. [3] K.Deb,S.Agrawal,A.Pratap,andT.Meyarvan.Afast and eltst mult-objectve genetc algorthm: NSGA-II. IEEE Transactons on Evolutonary Computaton, 6(2):82 97, [4] K. Deb, A. Anand, and D. Josh. A computatonally effcent evolutonary algorthm for real-parameter optmzaton. Evolutonary Computaton Journal, 0(4):37 395, [5] K. Deb and H.-G. Beyer. Self-adaptaton n real-parameter genetc algorthms wth smulated bnary crossover. In Proceedngs of the Genetc and Evolutonary Computaton Conference (GECCO-99), pages 72 79, 999. [6] K. Deb and A. Kumar. Real-coded genetc algorthms wth smulated bnary crossover: Studes on mult-modal and mult-objectve problems. Complex Systems, 9(6):43 454, 995. [7] L. J. Eshelman and J. D. Schaffer. Real-coded genetc algorthms and nterval-schemata. In Foundatons of Genetc Algorthms 2 (FOGA-2), pages , 993. [8] D.E.Goldberg,K.Deb,andJ.H.Clark.Genetc algorthms, nose, and the szng of populatons. Complex Systems, 6(4): , 992. [9] T. Hguch, S. Tsutsu, and M. Yamamura. Theoretcal analyss of smplex crossover for real-coded genetc algorthms. In Parallel Problem Solvng from Nature (PPSN-VI), pages , [0] J. A. Nelder and R. Mead. A smplex method for functon mnmzaton. Computer Journal, 7:308 33, 965. [] I. Ono and S. Kobayash. A real-coded genetc algorthm for functon optmzaton usng unmodal normal dstrbuton crossover. In Proceedngs of the Seventh Internatonal Conference on Genetc Algorthms (ICGA-7), pages , 997. [2] K. V. Prce, R. Storn, and J. Lampnen. Dfferental Evoluton: A Practcal Approach to Global Optmzaton. Sprnger-Verlag, Berln, [3] I. Rechenberg. Evolutonsstratege: Optmerung Technscher Systeme nach Prnzpen der Bologschen Evoluton. Stuttgart: Frommann-Holzboog Verlag,
Markov Chain Monte Carlo Lecture 6
where (x 1,..., x N ) X N, N s called the populaton sze, f(x) f (x) for at least one {1, 2,..., N}, and those dfferent from f(x) are called the tral dstrbutons n terms of mportance samplng. Dfferent ways
More informationThe Study of Teaching-learning-based Optimization Algorithm
Advanced Scence and Technology Letters Vol. (AST 06), pp.05- http://dx.do.org/0.57/astl.06. The Study of Teachng-learnng-based Optmzaton Algorthm u Sun, Yan fu, Lele Kong, Haolang Q,, Helongang Insttute
More informationModule 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur
Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:
More informationKernel Methods and SVMs Extension
Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general
More informationModule 9. Lecture 6. Duality in Assignment Problems
Module 9 1 Lecture 6 Dualty n Assgnment Problems In ths lecture we attempt to answer few other mportant questons posed n earler lecture for (AP) and see how some of them can be explaned through the concept
More informationAppendix B: Resampling Algorithms
407 Appendx B: Resamplng Algorthms A common problem of all partcle flters s the degeneracy of weghts, whch conssts of the unbounded ncrease of the varance of the mportance weghts ω [ ] of the partcles
More informationProblem Set 9 Solutions
Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem
More informationDifference Equations
Dfference Equatons c Jan Vrbk 1 Bascs Suppose a sequence of numbers, say a 0,a 1,a,a 3,... s defned by a certan general relatonshp between, say, three consecutve values of the sequence, e.g. a + +3a +1
More informationSolving Nonlinear Differential Equations by a Neural Network Method
Solvng Nonlnear Dfferental Equatons by a Neural Network Method Luce P. Aarts and Peter Van der Veer Delft Unversty of Technology, Faculty of Cvlengneerng and Geoscences, Secton of Cvlengneerng Informatcs,
More informationStructure and Drive Paul A. Jensen Copyright July 20, 2003
Structure and Drve Paul A. Jensen Copyrght July 20, 2003 A system s made up of several operatons wth flow passng between them. The structure of the system descrbes the flow paths from nputs to outputs.
More informationLecture Notes on Linear Regression
Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume
More informationA PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS
HCMC Unversty of Pedagogy Thong Nguyen Huu et al. A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS Thong Nguyen Huu and Hao Tran Van Department of mathematcs-nformaton,
More informationSolving of Single-objective Problems based on a Modified Multiple-crossover Genetic Algorithm: Test Function Study
Internatonal Conference on Systems, Sgnal Processng and Electroncs Engneerng (ICSSEE'0 December 6-7, 0 Duba (UAE Solvng of Sngle-objectve Problems based on a Modfed Multple-crossover Genetc Algorthm: Test
More informationChapter Newton s Method
Chapter 9. Newton s Method After readng ths chapter, you should be able to:. Understand how Newton s method s dfferent from the Golden Secton Search method. Understand how Newton s method works 3. Solve
More informationNotes on Frequency Estimation in Data Streams
Notes on Frequency Estmaton n Data Streams In (one of) the data streamng model(s), the data s a sequence of arrvals a 1, a 2,..., a m of the form a j = (, v) where s the dentty of the tem and belongs to
More informationOn the Multicriteria Integer Network Flow Problem
BULGARIAN ACADEMY OF SCIENCES CYBERNETICS AND INFORMATION TECHNOLOGIES Volume 5, No 2 Sofa 2005 On the Multcrtera Integer Network Flow Problem Vassl Vasslev, Marana Nkolova, Maryana Vassleva Insttute of
More informationDifferential Evolution Algorithm with a Modified Archiving-based Adaptive Tradeoff Model for Optimal Power Flow
1 Dfferental Evoluton Algorthm wth a Modfed Archvng-based Adaptve Tradeoff Model for Optmal Power Flow 2 Outlne Search Engne Constrant Handlng Technque Test Cases and Statstcal Results 3 Roots of Dfferental
More informationThe Convergence Speed of Single- And Multi-Objective Immune Algorithm Based Optimization Problems
The Convergence Speed of Sngle- And Mult-Obectve Immune Algorthm Based Optmzaton Problems Mohammed Abo-Zahhad Faculty of Engneerng, Electrcal and Electroncs Engneerng Department, Assut Unversty, Assut,
More informationSpeeding up Computation of Scalar Multiplication in Elliptic Curve Cryptosystem
H.K. Pathak et. al. / (IJCSE) Internatonal Journal on Computer Scence and Engneerng Speedng up Computaton of Scalar Multplcaton n Ellptc Curve Cryptosystem H. K. Pathak Manju Sangh S.o.S n Computer scence
More informationSPECTRAL ANALYSIS USING EVOLUTION STRATEGIES
SPECTRAL ANALYSIS USING EVOLUTION STRATEGIES J. FEDERICO RAMÍREZ AND OLAC FUENTES Insttuto Naconal de Astrofísca, Óptca y Electrónca Lus Enrque Erro # 1 Santa María Tonanzntla, Puebla, 784, Méxco framrez@cseg.naoep.mx,
More informationChapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems
Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons
More informationGlobal Sensitivity. Tuesday 20 th February, 2018
Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values
More informationFor now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results.
Neural Networks : Dervaton compled by Alvn Wan from Professor Jtendra Malk s lecture Ths type of computaton s called deep learnng and s the most popular method for many problems, such as computer vson
More informationECE559VV Project Report
ECE559VV Project Report (Supplementary Notes Loc Xuan Bu I. MAX SUM-RATE SCHEDULING: THE UPLINK CASE We have seen (n the presentaton that, for downlnk (broadcast channels, the strategy maxmzng the sum-rate
More informationTHE SUMMATION NOTATION Ʃ
Sngle Subscrpt otaton THE SUMMATIO OTATIO Ʃ Most of the calculatons we perform n statstcs are repettve operatons on lsts of numbers. For example, we compute the sum of a set of numbers, or the sum of the
More informationChapter - 2. Distribution System Power Flow Analysis
Chapter - 2 Dstrbuton System Power Flow Analyss CHAPTER - 2 Radal Dstrbuton System Load Flow 2.1 Introducton Load flow s an mportant tool [66] for analyzng electrcal power system network performance. Load
More informationChapter 13: Multiple Regression
Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to
More informationx = , so that calculated
Stat 4, secton Sngle Factor ANOVA notes by Tm Plachowsk n chapter 8 we conducted hypothess tests n whch we compared a sngle sample s mean or proporton to some hypotheszed value Chapter 9 expanded ths to
More informationTemperature. Chapter Heat Engine
Chapter 3 Temperature In prevous chapters of these notes we ntroduced the Prncple of Maxmum ntropy as a technque for estmatng probablty dstrbutons consstent wth constrants. In Chapter 9 we dscussed the
More informationAssortment Optimization under MNL
Assortment Optmzaton under MNL Haotan Song Aprl 30, 2017 1 Introducton The assortment optmzaton problem ams to fnd the revenue-maxmzng assortment of products to offer when the prces of products are fxed.
More informationTHE ROBUSTNESS OF GENETIC ALGORITHMS IN SOLVING UNCONSTRAINED BUILDING OPTIMIZATION PROBLEMS
Nnth Internatonal IBPSA Conference Montréal, Canada August 5-8, 2005 THE ROBUSTNESS OF GENETIC ALGORITHMS IN SOLVING UNCONSTRAINED BUILDING OPTIMIZATION PROBLEMS Jonathan Wrght, and Al Alajm Department
More informationFREQUENCY DISTRIBUTIONS Page 1 of The idea of a frequency distribution for sets of observations will be introduced,
FREQUENCY DISTRIBUTIONS Page 1 of 6 I. Introducton 1. The dea of a frequency dstrbuton for sets of observatons wll be ntroduced, together wth some of the mechancs for constructng dstrbutons of data. Then
More informationGrover s Algorithm + Quantum Zeno Effect + Vaidman
Grover s Algorthm + Quantum Zeno Effect + Vadman CS 294-2 Bomb 10/12/04 Fall 2004 Lecture 11 Grover s algorthm Recall that Grover s algorthm for searchng over a space of sze wors as follows: consder the
More informationWinter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan
Wnter 2008 CS567 Stochastc Lnear/Integer Programmng Guest Lecturer: Xu, Huan Class 2: More Modelng Examples 1 Capacty Expanson Capacty expanson models optmal choces of the tmng and levels of nvestments
More informationDesign and Optimization of Fuzzy Controller for Inverse Pendulum System Using Genetic Algorithm
Desgn and Optmzaton of Fuzzy Controller for Inverse Pendulum System Usng Genetc Algorthm H. Mehraban A. Ashoor Unversty of Tehran Unversty of Tehran h.mehraban@ece.ut.ac.r a.ashoor@ece.ut.ac.r Abstract:
More informationSection 8.3 Polar Form of Complex Numbers
80 Chapter 8 Secton 8 Polar Form of Complex Numbers From prevous classes, you may have encountered magnary numbers the square roots of negatve numbers and, more generally, complex numbers whch are the
More informationCHAPTER 2 MULTI-OBJECTIVE GENETIC ALGORITHM (MOGA) FOR OPTIMAL POWER FLOW PROBLEM INCLUDING VOLTAGE STABILITY
26 CHAPTER 2 MULTI-OBJECTIVE GENETIC ALGORITHM (MOGA) FOR OPTIMAL POWER FLOW PROBLEM INCLUDING VOLTAGE STABILITY 2.1 INTRODUCTION Voltage stablty enhancement s an mportant tas n power system operaton.
More informationLecture 12: Discrete Laplacian
Lecture 12: Dscrete Laplacan Scrbe: Tanye Lu Our goal s to come up wth a dscrete verson of Laplacan operator for trangulated surfaces, so that we can use t n practce to solve related problems We are mostly
More informationLecture 4. Instructor: Haipeng Luo
Lecture 4 Instructor: Hapeng Luo In the followng lectures, we focus on the expert problem and study more adaptve algorthms. Although Hedge s proven to be worst-case optmal, one may wonder how well t would
More informationLINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity
LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have
More informationHomework Assignment 3 Due in class, Thursday October 15
Homework Assgnment 3 Due n class, Thursday October 15 SDS 383C Statstcal Modelng I 1 Rdge regresson and Lasso 1. Get the Prostrate cancer data from http://statweb.stanford.edu/~tbs/elemstatlearn/ datasets/prostate.data.
More informationHYBRID FUZZY MULTI-OBJECTIVE EVOLUTIONARY ALGORITHM: A NOVEL PARETO-OPTIMIZATION TECHNIQUE
Internatonal Journal of Fuzzy Logc Systems (IJFLS) Vol.2, No., February 22 HYBRID FUZZY MULTI-OBJECTIVE EVOLUTIONARY ALGORITHM: A NOVEL PARETO-OPTIMIZATION TECHNIQUE Amt Saraswat and Ashsh San 2 Department
More informationChapter 2 Real-Coded Adaptive Range Genetic Algorithm
Chapter Real-Coded Adaptve Range Genetc Algorthm.. Introducton Fndng a global optmum n the contnuous doman s challengng for Genetc Algorthms (GAs. Tradtonal GAs use the bnary representaton that evenly
More informationFUZZY GOAL PROGRAMMING VS ORDINARY FUZZY PROGRAMMING APPROACH FOR MULTI OBJECTIVE PROGRAMMING PROBLEM
Internatonal Conference on Ceramcs, Bkaner, Inda Internatonal Journal of Modern Physcs: Conference Seres Vol. 22 (2013) 757 761 World Scentfc Publshng Company DOI: 10.1142/S2010194513010982 FUZZY GOAL
More informationANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)
Econ 413 Exam 13 H ANSWERS Settet er nndelt 9 deloppgaver, A,B,C, som alle anbefales å telle lkt for å gøre det ltt lettere å stå. Svar er gtt . Unfortunately, there s a prntng error n the hnt of
More informationMin Cut, Fast Cut, Polynomial Identities
Randomzed Algorthms, Summer 016 Mn Cut, Fast Cut, Polynomal Identtes Instructor: Thomas Kesselhem and Kurt Mehlhorn 1 Mn Cuts n Graphs Lecture (5 pages) Throughout ths secton, G = (V, E) s a mult-graph.
More informationCOS 521: Advanced Algorithms Game Theory and Linear Programming
COS 521: Advanced Algorthms Game Theory and Lnear Programmng Moses Charkar February 27, 2013 In these notes, we ntroduce some basc concepts n game theory and lnear programmng (LP). We show a connecton
More informationLecture 12: Classification
Lecture : Classfcaton g Dscrmnant functons g The optmal Bayes classfer g Quadratc classfers g Eucldean and Mahalanobs metrcs g K Nearest Neghbor Classfers Intellgent Sensor Systems Rcardo Guterrez-Osuna
More informationThin-Walled Structures Group
Thn-Walled Structures Group JOHNS HOPKINS UNIVERSITY RESEARCH REPORT Towards optmzaton of CFS beam-column ndustry sectons TWG-RR02-12 Y. Shfferaw July 2012 1 Ths report was prepared ndependently, but was
More informationAn Interactive Optimisation Tool for Allocation Problems
An Interactve Optmsaton ool for Allocaton Problems Fredr Bonäs, Joam Westerlund and apo Westerlund Process Desgn Laboratory, Faculty of echnology, Åbo Aadem Unversty, uru 20500, Fnland hs paper presents
More informationNUMERICAL DIFFERENTIATION
NUMERICAL DIFFERENTIATION 1 Introducton Dfferentaton s a method to compute the rate at whch a dependent output y changes wth respect to the change n the ndependent nput x. Ths rate of change s called the
More informationRemarks on the Properties of a Quasi-Fibonacci-like Polynomial Sequence
Remarks on the Propertes of a Quas-Fbonacc-lke Polynomal Sequence Brce Merwne LIU Brooklyn Ilan Wenschelbaum Wesleyan Unversty Abstract Consder the Quas-Fbonacc-lke Polynomal Sequence gven by F 0 = 1,
More informationVQ widely used in coding speech, image, and video
at Scalar quantzers are specal cases of vector quantzers (VQ): they are constraned to look at one sample at a tme (memoryless) VQ does not have such constrant better RD perfomance expected Source codng
More informationErrors for Linear Systems
Errors for Lnear Systems When we solve a lnear system Ax b we often do not know A and b exactly, but have only approxmatons  and ˆb avalable. Then the best thng we can do s to solve ˆx ˆb exactly whch
More informationDynamic Programming. Preview. Dynamic Programming. Dynamic Programming. Dynamic Programming (Example: Fibonacci Sequence)
/24/27 Prevew Fbonacc Sequence Longest Common Subsequence Dynamc programmng s a method for solvng complex problems by breakng them down nto smpler sub-problems. It s applcable to problems exhbtng the propertes
More informationChapter 3 Describing Data Using Numerical Measures
Chapter 3 Student Lecture Notes 3-1 Chapter 3 Descrbng Data Usng Numercal Measures Fall 2006 Fundamentals of Busness Statstcs 1 Chapter Goals To establsh the usefulness of summary measures of data. The
More informationP R. Lecture 4. Theory and Applications of Pattern Recognition. Dept. of Electrical and Computer Engineering /
Theory and Applcatons of Pattern Recognton 003, Rob Polkar, Rowan Unversty, Glassboro, NJ Lecture 4 Bayes Classfcaton Rule Dept. of Electrcal and Computer Engneerng 0909.40.0 / 0909.504.04 Theory & Applcatons
More informationMMA and GCMMA two methods for nonlinear optimization
MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons
More informationarxiv: v1 [math.oc] 3 Aug 2010
arxv:1008.0549v1 math.oc] 3 Aug 2010 Test Problems n Optmzaton Xn-She Yang Department of Engneerng, Unversty of Cambrdge, Cambrdge CB2 1PZ, UK Abstract Test functons are mportant to valdate new optmzaton
More informationCHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE
CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng
More informationMarkov Chain Monte Carlo (MCMC), Gibbs Sampling, Metropolis Algorithms, and Simulated Annealing Bioinformatics Course Supplement
Markov Chan Monte Carlo MCMC, Gbbs Samplng, Metropols Algorthms, and Smulated Annealng 2001 Bonformatcs Course Supplement SNU Bontellgence Lab http://bsnuackr/ Outlne! Markov Chan Monte Carlo MCMC! Metropols-Hastngs
More informationLecture 10 Support Vector Machines II
Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed
More informationNumerical Heat and Mass Transfer
Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and
More informationComputing Correlated Equilibria in Multi-Player Games
Computng Correlated Equlbra n Mult-Player Games Chrstos H. Papadmtrou Presented by Zhanxang Huang December 7th, 2005 1 The Author Dr. Chrstos H. Papadmtrou CS professor at UC Berkley (taught at Harvard,
More informationA simplied Genetic Algorithm, essentially a mutation-selection scheme, is analyzed
The Interacton of Mutaton Rate, Selecton, and Self-Adaptaton Wthn a Genetc Algorthm Thomas Back a a Unversty of Dortmund, Department of Computer Scence, P.O. Box 5 5, 46 Dortmund 5, Germany Abstract A
More informationIntegrals and Invariants of Euler-Lagrange Equations
Lecture 16 Integrals and Invarants of Euler-Lagrange Equatons ME 256 at the Indan Insttute of Scence, Bengaluru Varatonal Methods and Structural Optmzaton G. K. Ananthasuresh Professor, Mechancal Engneerng,
More informationIV. Performance Optimization
IV. Performance Optmzaton A. Steepest descent algorthm defnton how to set up bounds on learnng rate mnmzaton n a lne (varyng learnng rate) momentum learnng examples B. Newton s method defnton Gauss-Newton
More informationOne-sided finite-difference approximations suitable for use with Richardson extrapolation
Journal of Computatonal Physcs 219 (2006) 13 20 Short note One-sded fnte-dfference approxmatons sutable for use wth Rchardson extrapolaton Kumar Rahul, S.N. Bhattacharyya * Department of Mechancal Engneerng,
More informationThe optimal delay of the second test is therefore approximately 210 hours earlier than =2.
THE IEC 61508 FORMULAS 223 The optmal delay of the second test s therefore approxmately 210 hours earler than =2. 8.4 The IEC 61508 Formulas IEC 61508-6 provdes approxmaton formulas for the PF for smple
More informationCOMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS
Avalable onlne at http://sck.org J. Math. Comput. Sc. 3 (3), No., 6-3 ISSN: 97-537 COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS
More informationA Robust Method for Calculating the Correlation Coefficient
A Robust Method for Calculatng the Correlaton Coeffcent E.B. Nven and C. V. Deutsch Relatonshps between prmary and secondary data are frequently quantfed usng the correlaton coeffcent; however, the tradtonal
More informationResource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud
Resource Allocaton wth a Budget Constrant for Computng Independent Tasks n the Cloud Wemng Sh and Bo Hong School of Electrcal and Computer Engneerng Georga Insttute of Technology, USA 2nd IEEE Internatonal
More informationDepartment of Electrical & Electronic Engineeing Imperial College London. E4.20 Digital IC Design. Median Filter Project Specification
Desgn Project Specfcaton Medan Flter Department of Electrcal & Electronc Engneeng Imperal College London E4.20 Dgtal IC Desgn Medan Flter Project Specfcaton A medan flter s used to remove nose from a sampled
More informationThe Second Anti-Mathima on Game Theory
The Second Ant-Mathma on Game Theory Ath. Kehagas December 1 2006 1 Introducton In ths note we wll examne the noton of game equlbrum for three types of games 1. 2-player 2-acton zero-sum games 2. 2-player
More informationOutline and Reading. Dynamic Programming. Dynamic Programming revealed. Computing Fibonacci. The General Dynamic Programming Technique
Outlne and Readng Dynamc Programmng The General Technque ( 5.3.2) -1 Knapsac Problem ( 5.3.3) Matrx Chan-Product ( 5.3.1) Dynamc Programmng verson 1.4 1 Dynamc Programmng verson 1.4 2 Dynamc Programmng
More informationA Bayes Algorithm for the Multitask Pattern Recognition Problem Direct Approach
A Bayes Algorthm for the Multtask Pattern Recognton Problem Drect Approach Edward Puchala Wroclaw Unversty of Technology, Char of Systems and Computer etworks, Wybrzeze Wyspanskego 7, 50-370 Wroclaw, Poland
More informationThe Minimum Universal Cost Flow in an Infeasible Flow Network
Journal of Scences, Islamc Republc of Iran 17(2): 175-180 (2006) Unversty of Tehran, ISSN 1016-1104 http://jscencesutacr The Mnmum Unversal Cost Flow n an Infeasble Flow Network H Saleh Fathabad * M Bagheran
More informationOpen Systems: Chemical Potential and Partial Molar Quantities Chemical Potential
Open Systems: Chemcal Potental and Partal Molar Quanttes Chemcal Potental For closed systems, we have derved the followng relatonshps: du = TdS pdv dh = TdS + Vdp da = SdT pdv dg = VdP SdT For open systems,
More information= z 20 z n. (k 20) + 4 z k = 4
Problem Set #7 solutons 7.2.. (a Fnd the coeffcent of z k n (z + z 5 + z 6 + z 7 + 5, k 20. We use the known seres expanson ( n+l ( z l l z n below: (z + z 5 + z 6 + z 7 + 5 (z 5 ( + z + z 2 + z + 5 5
More informationNote on EM-training of IBM-model 1
Note on EM-tranng of IBM-model INF58 Language Technologcal Applcatons, Fall The sldes on ths subject (nf58 6.pdf) ncludng the example seem nsuffcent to gve a good grasp of what s gong on. Hence here are
More informationLossy Compression. Compromise accuracy of reconstruction for increased compression.
Lossy Compresson Compromse accuracy of reconstructon for ncreased compresson. The reconstructon s usually vsbly ndstngushable from the orgnal mage. Typcally, one can get up to 0:1 compresson wth almost
More informationCopyright 2017 by Taylor Enterprises, Inc., All Rights Reserved. Adjusted Control Limits for P Charts. Dr. Wayne A. Taylor
Taylor Enterprses, Inc. Control Lmts for P Charts Copyrght 2017 by Taylor Enterprses, Inc., All Rghts Reserved. Control Lmts for P Charts Dr. Wayne A. Taylor Abstract: P charts are used for count data
More informationBoostrapaggregating (Bagging)
Boostrapaggregatng (Baggng) An ensemble meta-algorthm desgned to mprove the stablty and accuracy of machne learnng algorthms Can be used n both regresson and classfcaton Reduces varance and helps to avod
More informationNumerical Solution of Ordinary Differential Equations
Numercal Methods (CENG 00) CHAPTER-VI Numercal Soluton of Ordnar Dfferental Equatons 6 Introducton Dfferental equatons are equatons composed of an unknown functon and ts dervatves The followng are examples
More informationFinding Dense Subgraphs in G(n, 1/2)
Fndng Dense Subgraphs n Gn, 1/ Atsh Das Sarma 1, Amt Deshpande, and Rav Kannan 1 Georga Insttute of Technology,atsh@cc.gatech.edu Mcrosoft Research-Bangalore,amtdesh,annan@mcrosoft.com Abstract. Fndng
More informationParticle Swarm Optimization with Adaptive Mutation in Local Best of Particles
1 Internatonal Congress on Informatcs, Envronment, Energy and Applcatons-IEEA 1 IPCSIT vol.38 (1) (1) IACSIT Press, Sngapore Partcle Swarm Optmzaton wth Adaptve Mutaton n Local Best of Partcles Nanda ulal
More informationMODIFIED PREDATOR-PREY (MPP) ALGORITHM FOR CONSTRAINED MULTI-OBJECTIVE OPTIMIZATION
EVOLUTIONARY METHODS FOR DESIGN, OPTIMIZATION AND CONTROL T. Burczynsk and J. Péraux (Eds.) CIMNE, Barcelona, Span 29 MODIFIED PREDATOR-PREY () ALGORITHM FOR CONSTRAINED MULTI-OBJECTIVE OPTIMIZATION Souma
More informationVARIATION OF CONSTANT SUM CONSTRAINT FOR INTEGER MODEL WITH NON UNIFORM VARIABLES
VARIATION OF CONSTANT SUM CONSTRAINT FOR INTEGER MODEL WITH NON UNIFORM VARIABLES BÂRZĂ, Slvu Faculty of Mathematcs-Informatcs Spru Haret Unversty barza_slvu@yahoo.com Abstract Ths paper wants to contnue
More informationModule 2. Random Processes. Version 2 ECE IIT, Kharagpur
Module Random Processes Lesson 6 Functons of Random Varables After readng ths lesson, ou wll learn about cdf of functon of a random varable. Formula for determnng the pdf of a random varable. Let, X be
More information18.1 Introduction and Recap
CS787: Advanced Algorthms Scrbe: Pryananda Shenoy and Shjn Kong Lecturer: Shuch Chawla Topc: Streamng Algorthmscontnued) Date: 0/26/2007 We contnue talng about streamng algorthms n ths lecture, ncludng
More informationComplete subgraphs in multipartite graphs
Complete subgraphs n multpartte graphs FLORIAN PFENDER Unverstät Rostock, Insttut für Mathematk D-18057 Rostock, Germany Floran.Pfender@un-rostock.de Abstract Turán s Theorem states that every graph G
More informationComputational Biology Lecture 8: Substitution matrices Saad Mneimneh
Computatonal Bology Lecture 8: Substtuton matrces Saad Mnemneh As we have ntroduced last tme, smple scorng schemes lke + or a match, - or a msmatch and -2 or a gap are not justable bologcally, especally
More informationFeature Selection: Part 1
CSE 546: Machne Learnng Lecture 5 Feature Selecton: Part 1 Instructor: Sham Kakade 1 Regresson n the hgh dmensonal settng How do we learn when the number of features d s greater than the sample sze n?
More informationResearch Article Green s Theorem for Sign Data
Internatonal Scholarly Research Network ISRN Appled Mathematcs Volume 2012, Artcle ID 539359, 10 pages do:10.5402/2012/539359 Research Artcle Green s Theorem for Sgn Data Lous M. Houston The Unversty of
More informationDERIVATION OF THE PROBABILITY PLOT CORRELATION COEFFICIENT TEST STATISTICS FOR THE GENERALIZED LOGISTIC DISTRIBUTION
Internatonal Worshop ADVANCES IN STATISTICAL HYDROLOGY May 3-5, Taormna, Italy DERIVATION OF THE PROBABILITY PLOT CORRELATION COEFFICIENT TEST STATISTICS FOR THE GENERALIZED LOGISTIC DISTRIBUTION by Sooyoung
More informationBOOTSTRAP METHOD FOR TESTING OF EQUALITY OF SEVERAL MEANS. M. Krishna Reddy, B. Naveen Kumar and Y. Ramu
BOOTSTRAP METHOD FOR TESTING OF EQUALITY OF SEVERAL MEANS M. Krshna Reddy, B. Naveen Kumar and Y. Ramu Department of Statstcs, Osmana Unversty, Hyderabad -500 007, Inda. nanbyrozu@gmal.com, ramu0@gmal.com
More informationStanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011
Stanford Unversty CS359G: Graph Parttonng and Expanders Handout 4 Luca Trevsan January 3, 0 Lecture 4 In whch we prove the dffcult drecton of Cheeger s nequalty. As n the past lectures, consder an undrected
More information8.6 The Complex Number System
8.6 The Complex Number System Earler n the chapter, we mentoned that we cannot have a negatve under a square root, snce the square of any postve or negatve number s always postve. In ths secton we want
More informationGlobal Optimization Using Hybrid Approach
Tng-Yu Chen, Y Lang Cheng Global Optmzaton Usng Hybrd Approach TING-YU CHEN, YI LIANG CHENG Department of Mechancal Engneerng Natonal Chung Hsng Unversty 0 Kuo Kuang Road Tachung, Tawan 07 tyc@dragon.nchu.edu.tw
More informationLinear Regression Analysis: Terminology and Notation
ECON 35* -- Secton : Basc Concepts of Regresson Analyss (Page ) Lnear Regresson Analyss: Termnology and Notaton Consder the generc verson of the smple (two-varable) lnear regresson model. It s represented
More information