THE ROBUSTNESS OF GENETIC ALGORITHMS IN SOLVING UNCONSTRAINED BUILDING OPTIMIZATION PROBLEMS

Size: px
Start display at page:

Download "THE ROBUSTNESS OF GENETIC ALGORITHMS IN SOLVING UNCONSTRAINED BUILDING OPTIMIZATION PROBLEMS"

Transcription

1 Nnth Internatonal IBPSA Conference Montréal, Canada August 5-8, 2005 THE ROBUSTNESS OF GENETIC ALGORITHMS IN SOLVING UNCONSTRAINED BUILDING OPTIMIZATION PROBLEMS Jonathan Wrght, and Al Alajm Department of Cvl and Buldng Engneerng, Loughborough Unversty, Loughborough, Lecestershre, LE 3TU UK ABSTRACT Ths paper nvestgates the robustness of a Genetc Algorthm (GA) search method n solvng an unconstraned buldng optmzaton problem, when the number of buldng smulatons used by the optmzaton s restrcted. GA search methods can be classfed as beng probablstc populatons based optmzers. The probablstc nature of the search suggests that GA s may lack robustness n fndng solutons. Further, t s a common percepton that snce GA s terate on a populaton (set) of solutons, they requre many buldng smulatons to converge. It s concluded here that a partcular GA was robust n fndng solutons wth.4% mean dfference n buldng energy use from that for the best soluton found n all tral optmzatons. Ths performance was acheved wth only 300 buldng smulatons (n any one tral optmzaton). INTRODUCTION The beneft of the smulaton-based optmzaton of buldng desgn has been demonstrated through a potental reducton n buldng energy use by as much as 30% of that resultng from a benchmark desgn (Wetter and Wrght, 2003). Recent research examned the performance of several dfferent optmzaton algorthms n solvng a nonsmooth, sngle-crteron, non-lnear, unconstraned buldng optmzaton problem (Wetter and Wrght, 2004). The optmzaton problem ncluded elements of wndow geometry, the setponts for the control of wndow shadng devces, nght-setback setponts for the zone temperature, and the desgn supply ar temperature setpont. The performance of twelve dfferent optmzaton algorthms was examned; the algorthms ncluded, drect search methods (pattern and smplex searches), a gradent based method, probablstc populatons based methods (partcle swarm and genetc algorthms), and hybrd methods (partcle swarm and pattern search). It was concluded that the drect and gradent based methods could converge far from the optmum when the objectve functon was non-smooth (whch was the case for the example buldng optmzaton problem). Conversely, the probablstc populatonbased algorthms were more robust n fndng nearoptmum solutons, wth a hybrd partcle-swarm pattern-search algorthm havng the most consstent performance. A smple genetc algorthm also proved to be robust n fndng near-optmum solutons. Although robust, the hybrd partcle-swarm patternsearch algorthm requred n the order of 765 buldng smulatons before convergng on a soluton. In comparson, the genetc algorthm requred n the order of 585 smulatons before convergence. However, the convergence of the genetc algorthm was determned by arbtrarly lmtng the maxmum number of teratons of the algorthm. In contrast, the number of teratons of the hybrd algorthm was governed, n-part, by the characterstcs of the search space and the formally defned convergence of the pattern search algorthm. In ths respect, the patternsearch s guaranteed to have converged onto a local optmum, whereas the arbtrary convergence crtera of the genetc algorthm, means that convergence onto a local optmum cannot be guaranteed. Although prevous research, ndcates that genetc algorthms have the potental to solve unconstraned buldng optmzaton problems, the number of algorthm teratons requred to fnd a soluton remans unclear. Further, genetc algorthms are probablstc optmzers and as such ther behavor vares probablstcally wth the choce of startng condtons and algorthm control parameters. Although prevous research has examned the range of solutons found durng a partcular search (Coley and Schukat, 2002; Caldas and Norford, 2002), no research has been conducted to examne the effect of the algorthm startng condtons or control parameters on the robustness of the search n fndng near-optmum solutons. Ths paper examnes the robustness of a genetc algorthm n solvng an unconstraned non-smooth buldng optmzaton problem (Wetter and Wrght, 2003). The robustness of the algorthm s examned n relaton to the range of the solutons found for dfferent startng condtons and algorthm control parameters. In partcular, the ablty of the search to fnd a soluton wth a lmted number of tral smulatons s examned (the computatonal overhead assocated wth smulatng the buldng performance

2 beng the domnant computatonal element of the optmzaton). GENETIC ALGORITHM DESIGN A large volume of lterature on the form and operaton of Genetc and other Evoluton Algorthms exsts (among others; Bäck, 996; Bäck et al, 2000; Deb, 2000). In bref, Genetc Algorthms (GA s), terate on a populaton (set), of solutons. Havng frst, randomly ntalzed the populaton wth solutons (each varable beng randomly assgned a value wthn ts bounds), there are fve man operatons n the teraton:. Ftness assgnment: the evaluaton of the solutons objectve functon (often followed by some scalng or rank orderng). 2. Selecton: of ndvduals (solutons), from the exstng populaton for further operaton. The selecton s normally probablstc wth the probablty of selecton ncreasng wth ftness (n ths case of a mnmzaton problem, ncreasng as the objectve functon values decreases). 3. Recombnaton: the mxng of solutons to produce new solutons. Recombnaton s performed probablstcally, and as such may not take place. 4. Mutaton: the probablstc perturbaton of varable values. 5. Replacement: of old solutons n the populaton wth the new solutons resultng from selecton, recombnaton, and mutaton. Further, GA s operate wth an encodng of the problem varables know as a chromosome. The encodng can be n the form of a concatenated strng of bnary numbers, or a vector of real (or nteger), values. Recombnaton and mutaton operate on the chromosome gene values. In the case of the bnary encodng, a gene s represented by a sngle bt n the bnary strng (the value of a problem varable beng represented by several bts). In contrast, real encoded GA s, operate drectly on the real value of the problem varable. Form of Chromosome In contrast to a real vector chromosome, a bnary encodng has potentally greater exploratory power than a real vector chromosome, and naturally lends tself operatng wth both dscrete and contnuous varables. Buldng optmzaton problems are mxednteger problems. For example, alternatve wall constructons mght be dentfed by an nteger ndex that ponts to a partcular combnaton of constructon materals, whereas a supply ar temperature setpont may be treated as beng contnuous. Both contnuous and dscrete varables can be encoded n a bnary chromosome through controllng the number of bts assgned to a gven varable (a three bt encodng resultng 8 dscrete values for the varable). In practce the number of bts can be set to gve a real value precson up to the lmt of the machne precson, although n practce, the number of bts s set to provde a practcable resoluton n varable precson. The nherent encodng of mxednteger problems and the assocated control of varable precson, lends a bnary encodng to the soluton of buldng optmzaton problems. A Gray bnary encodng has been adopted for use n ths research. Ths encodng mproves the contnuty of the encoded search space, snce t lmts the occurrence of Hammng clffs (these occur when a sequental change bt values results n large, dscontnuous, changes n the value of the decoded problem varable). Ftness In ths study, we seek to mnmze the buldng energy use and therefore, the lower the energy use, the hgher the ftness of an ndvdual. In ths research, the solutons have been rank-ordered on the energy use objectve functon, the ftness of a soluton beng gven by ts rank. Selecton A characterstc of GA s s that, through the choce of algorthm operators, and ther control parameter values, t s possble to nfluence the behavor of the search. A common consderaton n choosng the algorthm operators and parameters, s the balance between the convergence relablty and the convergence velocty (or exploraton versus explotaton ; Bäck, 996). One of the prncpal operators governng ths balance s the selecton mechansm. The selecton operator s used to select solutons from the current populaton that wll be used to form the next populaton of solutons (ths beng the bass for the next teraton of the algorthm). If for example, the selecton method smply selected the best soluton of the populaton to form the bass of the next populaton, then the search would soon converge towards the current best soluton. However, f the selecton method randomly selected solutons from the populaton, then t s lkely that no one soluton would domnate the search drecton, and therefore, the search would be more random n nature. In ths research, we seek robust convergence wth as few buldng smulatons as possble (that s, relable convergence wth a hgh convergence velocty). In order to examne ths, the tournament selecton

3 method has been adopted for use n ths study, snce t allows control of the selecton pressure on the best solutons. The tournament operator randomly selects n, solutons from the populaton, the wnner of the tournament and soluton carred forward for recombnaton, beng the soluton havng the hghest ftness of all solutons n the tournament. The probablty of a soluton havng a hgh ftness beng selected, depends on the number of ndvduals n the tournament, and the sze of the populaton (that s, the percentage of the populaton selected for the tournament). One measure of the selecton pressure s the takeover tme (Bäck, 996). Ths s the number of generatons (algorthm teratons), for the populaton to fll wth the best soluton found n the ntal generaton, n the absence of recombnaton and mutaton (n the absence of recombnaton or mutaton, no new solutons are produced, the search only then samplng solutons from the randomly generated ntal populaton). The takeover tme for a tournament selecton s approxmated by (Bäck, 996): τ = ( ln( q) + ln(ln( q)) ) () ln( n) where, τ s the takeover tme, q the number of ndvduals n the populaton, and n, the number of ndvduals n the tournament. In ths research, we examne the effect of selecton pressure on the performance of the search by varyng the populaton sze (q), for a tournament sze (n). Table, gves the takeover tmes for a bnary tournament (n=2) and three populatons szes. The table also ncludes the number of tournaments necessary to fll the populaton wth the best of the ntal solutons (taken as, τ ' = τ q q ). Table Takeover tmes for a bnary tournament Populato n Sze, q (-) Takeover Tme τ (-) ' τ (-) The effect of populaton sze on the selecton pressure s clear from Table, wth a populaton sze of 5 ndvduals convergng n under half the number of teratons requred for a populaton of 30. Perhaps what s more sgnfcant s the dfference n number ' τ of tournament selectons ( ), snce, ths reflects the mpact of the populaton sze and selecton pressure on the lkely number of buldng smulatons requred to reach convergence (wth larger populatons requrng sgnfcantly more smulatons before the search begns to converge on a soluton). Recombnaton The recombnaton operator controls the mxng of genetc nformaton from pared ndvduals through a process know as crossover (each ndvdual n the par resultng from a separate tournament selecton). In the case of a bnary chromosome, crossover take place by swappng bt values between the two ndvduals. In the unform crossover operator used here, each par of bts are swapped wth a 50% probablty (an average of 50% of the bts wll be swapped). A 50% probablty of bt crossover gves the greatest mxng of genetc nformaton between pared ndvduals. However, n ths research, a further probablty parameter has been used to control the occurrence of chromosome crossover. If the probablty of chromosome crossover s such that crossover takes place, the bt values are swapped between chromosomes wth a 50% probablty. The effect of chromosome crossover probablty on the performance of the search, s examned here by experment. Mutaton A probablstc bt-wse mutaton, n whch a gven gene value f flpped from 0 to, or vsa versa, has been adopted n ths study. The effect of mutaton probablty on the performance of the search s examned here by experment. Replacement and Eltsm It s common to control the proporton of solutons replaced n the populaton at each teraton of the algorthm. In ths case, we replace all solutons, except the soluton havng the hghest ftness (the elte soluton). Ths guarantees that the search does not dverge to a soluton havng a hgher objectve functon than that already found by the search. The replacement ndvduals are a result of selecton, recombnaton, and mutaton (although, snce recombnaton and mutaton are probablstc, t s possble that some selected solutons reman unchanged when replaced n the populaton). Convergence and Automatc Restart GA s are conventonally stopped after a fxed number of algorthm teratons (generatons). However, snce the am of ths research s to study the convergence behavor of the GA n relaton to the number of buldng performance smulatons, the search s stopped here after a fxed number of buldng smulatons. Snce, the recombnaton and

4 mutaton operators are probablstc, t s possble that a selected soluton s smply coped from one generaton to the next (ths also occurs for the elte ndvdual). When ths occurs, the objectve functon value s taken from memory so that the need to resmulate the buldng performance s avoded. Therefore, all of the buldng smulatons performed are guaranteed to be unque. Further, n order to guarantee that the search s able to contnue untl the specfed number of smulatons s reached, the search s automatcally re-ntalzed f the populaton collapses onto a sngle soluton. Such convergence can be measured n terms of the problem varables (the genotype ), or the objectve functon (the phenotype ). In ths case we choose to dentfy the collapse of the populaton n terms of the objectve functon, as should the objectve functon have a low gradent n the regon of the optmum, convergence of the objectve functon may not be reflected by the same degree of convergence n the problem varables. Collapse of the populaton has been defned n terms of: where, fmax ( ) fmn ( ) α = 00 mn ( ) (2) f f max ( ), s the maxmum objectve functon value found n the current populaton; f mn( ), the mnmum (best) objectve functon value n the current populaton; α the convergence parameter. Should the current populaton have collapsed, then the next populaton s frst re-seeded wth the elte (best) soluton, wth the remanng ndvduals beng randomly ntalzed wthn ther bounds. Ths strategy s normally appled to a mcro-ga (for example; Caldas and Norford, 2002); mcro-ga use small populaton szes, that due to the hgh selecton pressure have a tendency to converge prematurely. In ths case, the re-ntalzaton s appled regardless of populaton sze. Note that, to some extent, the rentalzaton of the populaton can mask the apparent convergence and therefore the effect of the selecton pressure. A value of α <=% has been used n ths study to ndcate convergence and trgger rentalzaton of the populaton. EXPERIMENTS There are two elements to the experments performed here, the example buldng optmzaton problem, and the choce of GA control parameter sets. Example Buldng and Optmzaton Varables The mnmzaton of annual energy use of a mdfloor fve zone offce buldng (Wetter and Wrght, 2004) has been used as a bass for ths study. All exteror zones have daylght control, and the zone condtons are mantaned by a VAV system. The performance of the buldng s smulated by EnergyPlus, whch also auto-szes the capacty of the HVAC system. All experments have been performed usng verson of EnergyPlus, on a MS Wndows platform (Pentum 4 chp set). The buldng locaton (and assocated weather data, s taken as beng Chcago, IL, USA. The optmzaton problem varables are gven n Table 2. The normalzed wndow geometry varables determne the wndow wdth and heght (wth a value of 0.0 correspondng to wndow area of 20.4% of the façade, and.0 for 7.3% of the façade). The normalzed wndow overhang varables govern the depth of overhang above each wndow (wth a value of 0.0 correspondng to an overhang of 0.05m and.0 to.05m). The wndow shadng setponts control the use of an external shadng devce (the shadng devce beng actvated when the total nsolaton on the wndow exceeds the setpont). The zone ar temperature setponts govern nght operaton of the HVAC system, whle the supply ar temperature setpont s used to n the auto-szng of the HVAC system capacty. Note that the ncrement n each varable, together wth the lower and upper bounds, are used to dscretze the search space durng the bnary encodng of the varables. The dscrete ncrement n each varable has been set based on reasonable engneerng tolerance for each class of varable. The total dscretzed search space has a sze of.94 x Genetc Algorthm Control Parameters In ths research, we am to examne the robustness of a GA n solvng the example optmzaton problem for a fxed number of buldng smulatons. In a prevous study, a soluton to the example optmzaton problem, that had an objectve functon value wthn 0.4% of the best soluton, was found by a partcle swarm algorthm wth only 37 tral smulatons; all other algorthms n the study that found a soluton wth an objectve functon value wthn % of the best requred more functon evaluatons (Wetter and Wrght, 2004). It would therefore seem that n the order of 300 tral smulatons s requred to solve the example problem. Therefore, n ths study, each optmzaton s performed for 300 tral smulatons. The behavor of the GA has been examned for 2 dfferent sets of control parameters, consstng of 3 alternatve populaton szes, 2 crossover probabltes, and 2 mutaton probabltes (Table 3)

5 Table 2 Optmzaton problem varables Index Varable Lower Bound Upper Bound Increment Best Soluton North Wndow Geometry (-) West Wndow Geometry (-) West Wndow Overhang (-) East Wndow Geometry (-) East Wndow Overhang (-) South Wndow Geometry (-) South Wndow Overhang (-) West Wndow Shadng Setpont (W/m 2 ) East Wndow Shadng Setpont (W/m 2 ) South Wndow Shadng Setpont (W/m 2 ) Zone Nght Temperature Setpont, Wnter ( o C) Zone Nght Temperature Setpont, Summer ( o C) Supply Ar Temperature Setpont ( o C) Table 3 GA Control parameter sets Control Parameter Values Populaton Sze (-) [5,5,30] Probablty of Chromosome Crossover [0.7,.0] Probablty of Mutaton [0.0, 0.02] Populaton szes n the order of 80 ndvduals are commonly used n GA s. However, snce we have a lmt of 300 smulatons, ths s lkely to result n less than 5 teratons of the GA (assumng that, say, more than 60 of the 80 ndvduals are new n each generaton). Consderng that the larger the populaton, the lower the selecton pressure and convergence velocty, t s unlkely that 5 teratons s suffcent to fnd a soluton. For ths reason, we adopt small populaton szes that allow 0 or more teratons of the algorthm. Further, the alternatve populaton szes have been chosen to provde a range of selecton pressures, as ndcated by ther respectve takeover tmes n Table. In the unlkely event that each populaton was flled wth new solutons, a populaton sze of 30 would result n the mnmum of 0 teratons. Prevous research (Wetter and Wrght, 2004), also ndcated that a populaton n the order of 5 ndvduals was able to fnd a soluton to the optmzaton problem, and fnally, a populaton of 5 ndvduals s typcal of that used n a mcro-ga (for whch, the automatc re-ntalzaton of the algorthm s requred). The probablty of chromosome crossover controls the mxng of genetc nformaton between selected ndvduals. In general, crossover rates n the order of 0.7 or hgher, mprove the chance of good solutons beng found. Gven the hgh selecton pressures resultng from the small populaton szes, the hgher degree of mxng of solutons s also lkely to mantan the exploratory power of the search. In ths respect, we examne the behavor of the search for two hgh, chromosome crossover rates of 0.7 and.0 (70% and 00% probablty). Mutaton perturbs the gene values, and as such has a hgh probablty of ntroducng new solutons to the search. However, too hgh a mutaton rate can result n a random search. It s common for bnary mutaton rates to be set n terms of the number of bt mutatons per chromosome. The encoded bnary chromosomes

6 used n ths problem are 78 bts long, so that a 0.0 probablty of mutaton s lkely to result n less than one bt mutaton per chromosome, and a probablty of 0.02, of greater than one mutaton per chromosome. A probablty of one mutaton per chromosome s commonly used, so that here, we examne the effect of a mutaton rates that are slghtly hgher and lower than normally used. It s expected that the hgher mutaton rate s mportant n terms of mantanng the exploratory power of the search, gven the hgh selecton pressure due to the small populaton szes. Fnally, snce GA s are probablstc optmzers, for each of the 2 GA parameters sets, we conduct 9 separate experments, wth each experment started wth a dfferent randomly generated populaton of solutons. Gven 9 experments for each of the 2 parameter sets and each experment havng 300 tral smulatons, we perform a total of 32,400 smulatons n ths study. RESULTS AND DISCUSSION In ths study, we seek to obtan good algorthm performance n two potentally competng crtera; robustness n fndng solutons, and mnmzaton of the number of buldng smulatons. Algorthm Robustness The robustness of the algorthm s examned n terms of the varablty of the fnal solutons from each set of experments. Table 4, gves the results for the tral optmzatons (each statstc relatng 9 separate optmzatons). There s no statstcal dfference between any of the solutons, although subjectvely, the smaller populatons appear to have a greater chance of fndng a better soluton. Further, although not statstcally measurable, for the small populaton szes (5 and 5), the better solutons result from the hgher probablty of crossover and mutaton. The varablty (spread) n the solutons s llustrated n Fgure. The spread s llustrated n terms of the dstance from the best soluton found n all tral optmzatons, the horzontal axs beng the dstance n the problem varable doman, and the vertcal axs the dstance of the objectve functon. The normalzed Eucldean dstance d( X, X ), n the problem varables s gven by: where d( X, X ) = (3) nv = x x x = u l 2 x (4) and ( ) nv X = x,..., R, s a soluton and x nv nv ( x ) R X =,..., x nv, the best soluton found n all experments; nv s the number of problem varables, and l, and u are the varable bounds such, ( nv) ( nv) that l x u,..., where and l < u,,...,. l, u R The dfference n the objectve functon values s gven by: ( ( ) ( )) ( ) ( ), f X f X f X f X = f ( X ) d 00 (5) Fgure llustrates that the majorty of the solutons have an objectve functon value wthn 2.5% of the best soluton, the mean dfference beng.4%. The extent to whch ths s consdered suffcently robust, should be judged n relaton to dfference n buldng energy use to that of the energy use for a standard desgn soluton, as well as the nherent uncertanty n the smulaton and desgn process. Unfortunately, such an analyss s beyond the scope of ths paper. Objectve Functon Dfference (%) Best Solutons: 5 Best Solutons: 5 Best Solutons: 30 Random Search Fgure Soluton spread Normalzed Eucldean Dstance ( ) Fgure, also ndcates that there s some overlap n the optmzed solutons wth those from a randomly generated set (these random solutons resultng from the GA ntalzaton procedure). However, gven that the mean objectve functon dfference, for all 270 random solutons, was 28.4%, the overlap s nsgnfcant. Fnally, n terms of the consstency of the solutons, Fgure, ndcates that the smlar objectve functon values can be obtaned from dfferent solutons. Ths can occur for two reasons, frst, the optmzaton problem may be nsenstve to the problem varables (that s, the objectve functon gradent s low), nv

7 Table 4 Best solutons Populaton Probabltes (-) Objectve Functon (kwh/m 2 ) Sze, q (-) Crossover Mutaton Mnmum Maxmum Mean Standard Devaton and/or, the optmzaton problem s hghly multmodal. Fgure 2, llustrates the spread n varable values for solutons that have an objectve functon dfference (Equaton 5), of 0.5% or less. The decson varable ndex n Fgure 2 relates to that gven n Table 2, and the normalzed dstance by Equaton 4. The varable groups G.N, G.W, G.E and G.S relate to the wndow area and overhang sze for the north, west, east, and south wndow respectvely; the group Sp.Sh the wndow shadng setponts; Sp.Z the zone ar temperature nght setponts; and Sp.S the desgn supply ar temperature. It s postulated here that a large scatter n a varable ndcates a low senstvty, or hgh mult-modalty of the objectve functon to the problem varable. The least spread varables relate to the wndow areas (ndexes, 2, 4 and 6), the zone nght setponts (ndexes and 2), and the desgn supply ar temperature (ndex 3). The varables havng the most spread relate to the sze of the wndow overhangs (ndexes, 3, 5, and 7), and the shadng setponts (ndexes 8, 9, and 0). It s probable that the large spread n sze of wndow overhang ndcates a low senstvty of the objectve functon (energy use), to overhang sze for the example buldng. Ths may also be the case for the shadng setpont. In both cases however, further research s requred to confrm the senstvty of the objectve functon to these varables, and n partcular ther mpact on the mult-modalty of the objectve functon. Normalzed Dstance ( ) Fgure 2 Soluton spread n the regon of the optmum 0.8 G.N G.W G.E G.S Sp.Sh Sp.Z Sp.S Decson Varable Index ( ) Convergence Velocty Fgure 3, llustrates the convergence for three of the tral optmzatons (each optmzaton used the same random number sequence, and had a.0 probablty of crossover and 0.02 probablty of mutaton). In order to obtan a true comparson between the convergence of each populaton, the convergence s gven as a reducton rato: r ( f ( U ), f ( U )) f ( U ) = (6) f ( U ) where: a set of np solutons, s gven by U = X ( X,..., X )} and the f U ) s the mean { np ( objectve functon value of the set. Snce the largest

8 populaton sze used here contans 30 solutons, the objectve functon means have been calculated for every 30 new tral smulatons. Reducton Rato ( ) Fgure 3, Rate of convergence Populaton: 5 Populaton: 5 Populaton: Number of Smulatons ( ) In ths respect, the smaller populatons would have already completed several teratons (generatons), before reachng 30 smulatons. Even though ths s the case, the ntal mean objectve functon value s lower for the 30 random solutons of the 30 ndvdual populaton (Table 5). Ths n part explans the hgher rate of convergence of the small populatons (the dvsor n Equaton 6 s hgher). Further, the populaton of 30 converged onto a worse soluton, than that found for ether of the two smaller populaton szes, whch had the effect of ncreasng the fnal reducton rato. It can be concluded, that there s some evdence that the populaton sze of 5 ndvduals has a hgher convergence velocty than the larger two populatons, although ths requres further nvestgaton. Table 5 Mean solutons after 30 smulatons Populaton sze f ( U) CONCLUSIONS The am of ths research was to examne the robustness of a GA n fndng solutons to an unconstraned buldng optmzaton problem, gven a lmted number of tral smulatons. Experments where performed for twelve dfferent sets of GA control parameters, wth nne dfferent tral optmzaton completed for each parameter set. It was concluded, that the GA was nsenstve to the choce of GA control parameters, there beng no statstcally sgnfcant dfference n solutons found between any of the parameter sets. However, the better solutons where obtaned usng small populaton szes (5 and 5 ndvdual), wth hgh probabltes of crossover and mutaton (00% and 2% respectvely). The mean dfference n objectve functon values, from that for the best soluton found, was.4%, wth the majorty of solutons beng wthn 2.5% of the best soluton found. Gven that there s no sgnfcant dfference between the sets of solutons, t can be concluded that the GA was robust n fndng solutons. It was also concluded that t s possble to fnd nearoptmum solutons wth a compettve (low) number buldng performance smulatons (n ths case 300 smulatons). Ths may, n part, be due to the hgh convergence veloctes resultng from the low populaton szes, although ths requres further research. Further research s also requred to examne the robustness of the GA, partcularly n relaton to the characterstcs of the problem and search that result n poor solutons beng found. Research s also requred to nvestgate the soluton accuracy that s expected n relaton to that achevable gven normal desgn tolerances and the uncertanty n results from buldng performance smulaton. REFERENCES Bäck.,T, 996, Evolutonary Algorthms n Theory and Practce, Oxford Unversty Press, New York, ISBN Bäck,T., Fogel, D.B., Mchalewcz, Z., 2000, Evolutonary Computaton 2: Advanced Algorthms and Operators (Evolutonary Computaton), Insttute of Physcs, ISBN Caldas., L.G., Norford., L.K., 2002, A Desgn Optmzaton Tool Based on a Genetc Algorthm, Automaton n Constructon,, 73-84, ISSN Coley, D.A., Schukat. S., 2002, Low-Energy Desgn: Combnng Computer-Based Optmsaton and Human Judgement, Buldng and Envronment, 37, , ISSN Deb, K. D., 200, Mult-Objectve Optmzaton usng Evolutonary Algorthms, John Wley and Sons Ltd, ISBN X. Wetter, M., Wrght, J.A., 2003, Comparson of a Generalzed Pattern Search and a Genetc Algorthm Optmzaton Method, Proceedngs of the 8 th Internatonal IBPSA Conference, Endhoven, Netherlands, Wetter, M., Wrght, J.A., 2004, A Comparson of Determnstc and Probablstc Optmzaton Algorthms for Nonsmooth Smulaton-based optmzaton, Buldng and Envronment, 39, ISSN:

Markov Chain Monte Carlo Lecture 6

Markov Chain Monte Carlo Lecture 6 where (x 1,..., x N ) X N, N s called the populaton sze, f(x) f (x) for at least one {1, 2,..., N}, and those dfferent from f(x) are called the tral dstrbutons n terms of mportance samplng. Dfferent ways

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

The Study of Teaching-learning-based Optimization Algorithm

The Study of Teaching-learning-based Optimization Algorithm Advanced Scence and Technology Letters Vol. (AST 06), pp.05- http://dx.do.org/0.57/astl.06. The Study of Teachng-learnng-based Optmzaton Algorthm u Sun, Yan fu, Lele Kong, Haolang Q,, Helongang Insttute

More information

VQ widely used in coding speech, image, and video

VQ widely used in coding speech, image, and video at Scalar quantzers are specal cases of vector quantzers (VQ): they are constraned to look at one sample at a tme (memoryless) VQ does not have such constrant better RD perfomance expected Source codng

More information

GEOMETRIC OPTIMIZATION OF FENESTRATION. Jonathan Wright and Monjur Mourshed

GEOMETRIC OPTIMIZATION OF FENESTRATION. Jonathan Wright and Monjur Mourshed Eleventh Internatonal IBPSA Conference Glasgow, Scotland July 27-30, 2009 GEOMETRIC OPTIMIZATIO OF FEESTRATIO Jonathan Wrght and Monjur Mourshed Department of Cvl and Buldng Engneerng, Loughborough Unversty,

More information

Problem Set 9 Solutions

Problem Set 9 Solutions Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

Design and Optimization of Fuzzy Controller for Inverse Pendulum System Using Genetic Algorithm

Design and Optimization of Fuzzy Controller for Inverse Pendulum System Using Genetic Algorithm Desgn and Optmzaton of Fuzzy Controller for Inverse Pendulum System Usng Genetc Algorthm H. Mehraban A. Ashoor Unversty of Tehran Unversty of Tehran h.mehraban@ece.ut.ac.r a.ashoor@ece.ut.ac.r Abstract:

More information

Chapter 2 Real-Coded Adaptive Range Genetic Algorithm

Chapter 2 Real-Coded Adaptive Range Genetic Algorithm Chapter Real-Coded Adaptve Range Genetc Algorthm.. Introducton Fndng a global optmum n the contnuous doman s challengng for Genetc Algorthms (GAs. Tradtonal GAs use the bnary representaton that evenly

More information

Annexes. EC.1. Cycle-base move illustration. EC.2. Problem Instances

Annexes. EC.1. Cycle-base move illustration. EC.2. Problem Instances ec Annexes Ths Annex frst llustrates a cycle-based move n the dynamc-block generaton tabu search. It then dsplays the characterstcs of the nstance sets, followed by detaled results of the parametercalbraton

More information

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS HCMC Unversty of Pedagogy Thong Nguyen Huu et al. A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS Thong Nguyen Huu and Hao Tran Van Department of mathematcs-nformaton,

More information

Week3, Chapter 4. Position and Displacement. Motion in Two Dimensions. Instantaneous Velocity. Average Velocity

Week3, Chapter 4. Position and Displacement. Motion in Two Dimensions. Instantaneous Velocity. Average Velocity Week3, Chapter 4 Moton n Two Dmensons Lecture Quz A partcle confned to moton along the x axs moves wth constant acceleraton from x =.0 m to x = 8.0 m durng a 1-s tme nterval. The velocty of the partcle

More information

Global Sensitivity. Tuesday 20 th February, 2018

Global Sensitivity. Tuesday 20 th February, 2018 Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values

More information

Kernel Methods and SVMs Extension

Kernel Methods and SVMs Extension Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general

More information

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers Psychology 282 Lecture #24 Outlne Regresson Dagnostcs: Outlers In an earler lecture we studed the statstcal assumptons underlyng the regresson model, ncludng the followng ponts: Formal statement of assumptons.

More information

Simulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests

Simulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests Smulated of the Cramér-von Mses Goodness-of-Ft Tests Steele, M., Chaselng, J. and 3 Hurst, C. School of Mathematcal and Physcal Scences, James Cook Unversty, Australan School of Envronmental Studes, Grffth

More information

Comparison of Regression Lines

Comparison of Regression Lines STATGRAPHICS Rev. 9/13/2013 Comparson of Regresson Lnes Summary... 1 Data Input... 3 Analyss Summary... 4 Plot of Ftted Model... 6 Condtonal Sums of Squares... 6 Analyss Optons... 7 Forecasts... 8 Confdence

More information

Lecture 12: Classification

Lecture 12: Classification Lecture : Classfcaton g Dscrmnant functons g The optmal Bayes classfer g Quadratc classfers g Eucldean and Mahalanobs metrcs g K Nearest Neghbor Classfers Intellgent Sensor Systems Rcardo Guterrez-Osuna

More information

Numerical Heat and Mass Transfer

Numerical Heat and Mass Transfer Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and

More information

Structure and Drive Paul A. Jensen Copyright July 20, 2003

Structure and Drive Paul A. Jensen Copyright July 20, 2003 Structure and Drve Paul A. Jensen Copyrght July 20, 2003 A system s made up of several operatons wth flow passng between them. The structure of the system descrbes the flow paths from nputs to outputs.

More information

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons

More information

Feature Selection: Part 1

Feature Selection: Part 1 CSE 546: Machne Learnng Lecture 5 Feature Selecton: Part 1 Instructor: Sham Kakade 1 Regresson n the hgh dmensonal settng How do we learn when the number of features d s greater than the sample sze n?

More information

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have

More information

Module 9. Lecture 6. Duality in Assignment Problems

Module 9. Lecture 6. Duality in Assignment Problems Module 9 1 Lecture 6 Dualty n Assgnment Problems In ths lecture we attempt to answer few other mportant questons posed n earler lecture for (AP) and see how some of them can be explaned through the concept

More information

A Robust Method for Calculating the Correlation Coefficient

A Robust Method for Calculating the Correlation Coefficient A Robust Method for Calculatng the Correlaton Coeffcent E.B. Nven and C. V. Deutsch Relatonshps between prmary and secondary data are frequently quantfed usng the correlaton coeffcent; however, the tradtonal

More information

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud Resource Allocaton wth a Budget Constrant for Computng Independent Tasks n the Cloud Wemng Sh and Bo Hong School of Electrcal and Computer Engneerng Georga Insttute of Technology, USA 2nd IEEE Internatonal

More information

High resolution entropy stable scheme for shallow water equations

High resolution entropy stable scheme for shallow water equations Internatonal Symposum on Computers & Informatcs (ISCI 05) Hgh resoluton entropy stable scheme for shallow water equatons Xaohan Cheng,a, Yufeng Ne,b, Department of Appled Mathematcs, Northwestern Polytechncal

More information

Chapter - 2. Distribution System Power Flow Analysis

Chapter - 2. Distribution System Power Flow Analysis Chapter - 2 Dstrbuton System Power Flow Analyss CHAPTER - 2 Radal Dstrbuton System Load Flow 2.1 Introducton Load flow s an mportant tool [66] for analyzng electrcal power system network performance. Load

More information

Negative Binomial Regression

Negative Binomial Regression STATGRAPHICS Rev. 9/16/2013 Negatve Bnomal Regresson Summary... 1 Data Input... 3 Statstcal Model... 3 Analyss Summary... 4 Analyss Optons... 7 Plot of Ftted Model... 8 Observed Versus Predcted... 10 Predctons...

More information

A HYBRID DIFFERENTIAL EVOLUTION -ITERATIVE GREEDY SEARCH ALGORITHM FOR CAPACITATED VEHICLE ROUTING PROBLEM

A HYBRID DIFFERENTIAL EVOLUTION -ITERATIVE GREEDY SEARCH ALGORITHM FOR CAPACITATED VEHICLE ROUTING PROBLEM IJCMA: Vol. 6, No. 1, January-June 2012, pp. 1-19 Global Research Publcatons A HYBRID DIFFERENTIAL EVOLUTION -ITERATIVE GREEDY SEARCH ALGORITHM FOR CAPACITATED VEHICLE ROUTING PROBLEM S. Kavtha and Nrmala

More information

DETERMINATION OF UNCERTAINTY ASSOCIATED WITH QUANTIZATION ERRORS USING THE BAYESIAN APPROACH

DETERMINATION OF UNCERTAINTY ASSOCIATED WITH QUANTIZATION ERRORS USING THE BAYESIAN APPROACH Proceedngs, XVII IMEKO World Congress, June 7, 3, Dubrovn, Croata Proceedngs, XVII IMEKO World Congress, June 7, 3, Dubrovn, Croata TC XVII IMEKO World Congress Metrology n the 3rd Mllennum June 7, 3,

More information

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng

More information

SPECTRAL ANALYSIS USING EVOLUTION STRATEGIES

SPECTRAL ANALYSIS USING EVOLUTION STRATEGIES SPECTRAL ANALYSIS USING EVOLUTION STRATEGIES J. FEDERICO RAMÍREZ AND OLAC FUENTES Insttuto Naconal de Astrofísca, Óptca y Electrónca Lus Enrque Erro # 1 Santa María Tonanzntla, Puebla, 784, Méxco framrez@cseg.naoep.mx,

More information

An improved multi-objective evolutionary algorithm based on point of reference

An improved multi-objective evolutionary algorithm based on point of reference IOP Conference Seres: Materals Scence and Engneerng PAPER OPEN ACCESS An mproved mult-objectve evolutonary algorthm based on pont of reference To cte ths artcle: Boy Zhang et al 08 IOP Conf. Ser.: Mater.

More information

Lossy Compression. Compromise accuracy of reconstruction for increased compression.

Lossy Compression. Compromise accuracy of reconstruction for increased compression. Lossy Compresson Compromse accuracy of reconstructon for ncreased compresson. The reconstructon s usually vsbly ndstngushable from the orgnal mage. Typcally, one can get up to 0:1 compresson wth almost

More information

A New Evolutionary Computation Based Approach for Learning Bayesian Network

A New Evolutionary Computation Based Approach for Learning Bayesian Network Avalable onlne at www.scencedrect.com Proceda Engneerng 15 (2011) 4026 4030 Advanced n Control Engneerng and Informaton Scence A New Evolutonary Computaton Based Approach for Learnng Bayesan Network Yungang

More information

A Simple Inventory System

A Simple Inventory System A Smple Inventory System Lawrence M. Leems and Stephen K. Park, Dscrete-Event Smulaton: A Frst Course, Prentce Hall, 2006 Hu Chen Computer Scence Vrgna State Unversty Petersburg, Vrgna February 8, 2017

More information

Limited Dependent Variables

Limited Dependent Variables Lmted Dependent Varables. What f the left-hand sde varable s not a contnuous thng spread from mnus nfnty to plus nfnty? That s, gven a model = f (, β, ε, where a. s bounded below at zero, such as wages

More information

Predictive Analytics : QM901.1x Prof U Dinesh Kumar, IIMB. All Rights Reserved, Indian Institute of Management Bangalore

Predictive Analytics : QM901.1x Prof U Dinesh Kumar, IIMB. All Rights Reserved, Indian Institute of Management Bangalore Sesson Outlne Introducton to classfcaton problems and dscrete choce models. Introducton to Logstcs Regresson. Logstc functon and Logt functon. Maxmum Lkelhood Estmator (MLE) for estmaton of LR parameters.

More information

Grover s Algorithm + Quantum Zeno Effect + Vaidman

Grover s Algorithm + Quantum Zeno Effect + Vaidman Grover s Algorthm + Quantum Zeno Effect + Vadman CS 294-2 Bomb 10/12/04 Fall 2004 Lecture 11 Grover s algorthm Recall that Grover s algorthm for searchng over a space of sze wors as follows: consder the

More information

CHAPTER 2 MULTI-OBJECTIVE GENETIC ALGORITHM (MOGA) FOR OPTIMAL POWER FLOW PROBLEM INCLUDING VOLTAGE STABILITY

CHAPTER 2 MULTI-OBJECTIVE GENETIC ALGORITHM (MOGA) FOR OPTIMAL POWER FLOW PROBLEM INCLUDING VOLTAGE STABILITY 26 CHAPTER 2 MULTI-OBJECTIVE GENETIC ALGORITHM (MOGA) FOR OPTIMAL POWER FLOW PROBLEM INCLUDING VOLTAGE STABILITY 2.1 INTRODUCTION Voltage stablty enhancement s an mportant tas n power system operaton.

More information

DERIVATION OF THE PROBABILITY PLOT CORRELATION COEFFICIENT TEST STATISTICS FOR THE GENERALIZED LOGISTIC DISTRIBUTION

DERIVATION OF THE PROBABILITY PLOT CORRELATION COEFFICIENT TEST STATISTICS FOR THE GENERALIZED LOGISTIC DISTRIBUTION Internatonal Worshop ADVANCES IN STATISTICAL HYDROLOGY May 3-5, Taormna, Italy DERIVATION OF THE PROBABILITY PLOT CORRELATION COEFFICIENT TEST STATISTICS FOR THE GENERALIZED LOGISTIC DISTRIBUTION by Sooyoung

More information

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number

More information

Boostrapaggregating (Bagging)

Boostrapaggregating (Bagging) Boostrapaggregatng (Baggng) An ensemble meta-algorthm desgned to mprove the stablty and accuracy of machne learnng algorthms Can be used n both regresson and classfcaton Reduces varance and helps to avod

More information

Winter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan

Winter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan Wnter 2008 CS567 Stochastc Lnear/Integer Programmng Guest Lecturer: Xu, Huan Class 2: More Modelng Examples 1 Capacty Expanson Capacty expanson models optmal choces of the tmng and levels of nvestments

More information

Solving of Single-objective Problems based on a Modified Multiple-crossover Genetic Algorithm: Test Function Study

Solving of Single-objective Problems based on a Modified Multiple-crossover Genetic Algorithm: Test Function Study Internatonal Conference on Systems, Sgnal Processng and Electroncs Engneerng (ICSSEE'0 December 6-7, 0 Duba (UAE Solvng of Sngle-objectve Problems based on a Modfed Multple-crossover Genetc Algorthm: Test

More information

Workshop: Approximating energies and wave functions Quantum aspects of physical chemistry

Workshop: Approximating energies and wave functions Quantum aspects of physical chemistry Workshop: Approxmatng energes and wave functons Quantum aspects of physcal chemstry http://quantum.bu.edu/pltl/6/6.pdf Last updated Thursday, November 7, 25 7:9:5-5: Copyrght 25 Dan Dll (dan@bu.edu) Department

More information

Polynomial Regression Models

Polynomial Regression Models LINEAR REGRESSION ANALYSIS MODULE XII Lecture - 6 Polynomal Regresson Models Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Test of sgnfcance To test the sgnfcance

More information

Generalized Linear Methods

Generalized Linear Methods Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set

More information

Solving Nonlinear Differential Equations by a Neural Network Method

Solving Nonlinear Differential Equations by a Neural Network Method Solvng Nonlnear Dfferental Equatons by a Neural Network Method Luce P. Aarts and Peter Van der Veer Delft Unversty of Technology, Faculty of Cvlengneerng and Geoscences, Secton of Cvlengneerng Informatcs,

More information

Pattern Classification

Pattern Classification Pattern Classfcaton All materals n these sldes ere taken from Pattern Classfcaton (nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John Wley & Sons, 000 th the permsson of the authors and the publsher

More information

Optimum Design of Steel Frames Considering Uncertainty of Parameters

Optimum Design of Steel Frames Considering Uncertainty of Parameters 9 th World Congress on Structural and Multdscplnary Optmzaton June 13-17, 211, Shzuoka, Japan Optmum Desgn of Steel Frames Consderng ncertanty of Parameters Masahko Katsura 1, Makoto Ohsak 2 1 Hroshma

More information

x = , so that calculated

x = , so that calculated Stat 4, secton Sngle Factor ANOVA notes by Tm Plachowsk n chapter 8 we conducted hypothess tests n whch we compared a sngle sample s mean or proporton to some hypotheszed value Chapter 9 expanded ths to

More information

Basic Statistical Analysis and Yield Calculations

Basic Statistical Analysis and Yield Calculations October 17, 007 Basc Statstcal Analyss and Yeld Calculatons Dr. José Ernesto Rayas Sánchez 1 Outlne Sources of desgn-performance uncertanty Desgn and development processes Desgn for manufacturablty A general

More information

Lecture 12: Discrete Laplacian

Lecture 12: Discrete Laplacian Lecture 12: Dscrete Laplacan Scrbe: Tanye Lu Our goal s to come up wth a dscrete verson of Laplacan operator for trangulated surfaces, so that we can use t n practce to solve related problems We are mostly

More information

Calculation of time complexity (3%)

Calculation of time complexity (3%) Problem 1. (30%) Calculaton of tme complexty (3%) Gven n ctes, usng exhaust search to see every result takes O(n!). Calculaton of tme needed to solve the problem (2%) 40 ctes:40! dfferent tours 40 add

More information

Chapter 13: Multiple Regression

Chapter 13: Multiple Regression Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to

More information

V is the velocity of the i th

V is the velocity of the i th Proceedngs of the 007 IEEE Swarm Intellgence Symposum (SIS 007) Probablstcally rven Partcle Swarms for Optmzaton of Mult Valued screte Problems : esgn and Analyss Kalyan Veeramachanen, Lsa Osadcw, Ganapath

More information

The Convergence Speed of Single- And Multi-Objective Immune Algorithm Based Optimization Problems

The Convergence Speed of Single- And Multi-Objective Immune Algorithm Based Optimization Problems The Convergence Speed of Sngle- And Mult-Obectve Immune Algorthm Based Optmzaton Problems Mohammed Abo-Zahhad Faculty of Engneerng, Electrcal and Electroncs Engneerng Department, Assut Unversty, Assut,

More information

NUMERICAL DIFFERENTIATION

NUMERICAL DIFFERENTIATION NUMERICAL DIFFERENTIATION 1 Introducton Dfferentaton s a method to compute the rate at whch a dependent output y changes wth respect to the change n the ndependent nput x. Ths rate of change s called the

More information

Particle Swarm Optimization with Adaptive Mutation in Local Best of Particles

Particle Swarm Optimization with Adaptive Mutation in Local Best of Particles 1 Internatonal Congress on Informatcs, Envronment, Energy and Applcatons-IEEA 1 IPCSIT vol.38 (1) (1) IACSIT Press, Sngapore Partcle Swarm Optmzaton wth Adaptve Mutaton n Local Best of Partcles Nanda ulal

More information

Note 10. Modeling and Simulation of Dynamic Systems

Note 10. Modeling and Simulation of Dynamic Systems Lecture Notes of ME 475: Introducton to Mechatroncs Note 0 Modelng and Smulaton of Dynamc Systems Department of Mechancal Engneerng, Unversty Of Saskatchewan, 57 Campus Drve, Saskatoon, SK S7N 5A9, Canada

More information

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton

More information

An Improved Clustering Based Genetic Algorithm for Solving Complex NP Problems

An Improved Clustering Based Genetic Algorithm for Solving Complex NP Problems Journal of Computer Scence 7 (7): 1033-1037, 2011 ISSN 1549-3636 2011 Scence Publcatons An Improved Clusterng Based Genetc Algorthm for Solvng Complex NP Problems 1 R. Svaraj and 2 T. Ravchandran 1 Department

More information

Using Immune Genetic Algorithm to Optimize BP Neural Network and Its Application Peng-fei LIU1,Qun-tai SHEN1 and Jun ZHI2,*

Using Immune Genetic Algorithm to Optimize BP Neural Network and Its Application Peng-fei LIU1,Qun-tai SHEN1 and Jun ZHI2,* Advances n Computer Scence Research (ACRS), volume 54 Internatonal Conference on Computer Networks and Communcaton Technology (CNCT206) Usng Immune Genetc Algorthm to Optmze BP Neural Network and Its Applcaton

More information

Second Order Analysis

Second Order Analysis Second Order Analyss In the prevous classes we looked at a method that determnes the load correspondng to a state of bfurcaton equlbrum of a perfect frame by egenvalye analyss The system was assumed to

More information

Very Large Scale Continuous and Discrete Variable. Woptimization,

Very Large Scale Continuous and Discrete Variable. Woptimization, Very Large Scale Contnuous and Dscrete Varable Optmzaton Garret N. Vanderplaats * Vanderplaats Research & Development, Inc. 1767 S. 8 th Street Colorado Sprngs, CO 80906 An optmzaton algorthm s presented

More information

Turbulence classification of load data by the frequency and severity of wind gusts. Oscar Moñux, DEWI GmbH Kevin Bleibler, DEWI GmbH

Turbulence classification of load data by the frequency and severity of wind gusts. Oscar Moñux, DEWI GmbH Kevin Bleibler, DEWI GmbH Turbulence classfcaton of load data by the frequency and severty of wnd gusts Introducton Oscar Moñux, DEWI GmbH Kevn Blebler, DEWI GmbH Durng the wnd turbne developng process, one of the most mportant

More information

Using the estimated penetrances to determine the range of the underlying genetic model in casecontrol

Using the estimated penetrances to determine the range of the underlying genetic model in casecontrol Georgetown Unversty From the SelectedWorks of Mark J Meyer 8 Usng the estmated penetrances to determne the range of the underlyng genetc model n casecontrol desgn Mark J Meyer Neal Jeffres Gang Zheng Avalable

More information

Errors for Linear Systems

Errors for Linear Systems Errors for Lnear Systems When we solve a lnear system Ax b we often do not know A and b exactly, but have only approxmatons  and ˆb avalable. Then the best thng we can do s to solve ˆx ˆb exactly whch

More information

EEL 6266 Power System Operation and Control. Chapter 3 Economic Dispatch Using Dynamic Programming

EEL 6266 Power System Operation and Control. Chapter 3 Economic Dispatch Using Dynamic Programming EEL 6266 Power System Operaton and Control Chapter 3 Economc Dspatch Usng Dynamc Programmng Pecewse Lnear Cost Functons Common practce many utltes prefer to represent ther generator cost functons as sngle-

More information

Uncertainty as the Overlap of Alternate Conditional Distributions

Uncertainty as the Overlap of Alternate Conditional Distributions Uncertanty as the Overlap of Alternate Condtonal Dstrbutons Olena Babak and Clayton V. Deutsch Centre for Computatonal Geostatstcs Department of Cvl & Envronmental Engneerng Unversty of Alberta An mportant

More information

Amiri s Supply Chain Model. System Engineering b Department of Mathematics and Statistics c Odette School of Business

Amiri s Supply Chain Model. System Engineering b Department of Mathematics and Statistics c Odette School of Business Amr s Supply Chan Model by S. Ashtab a,, R.J. Caron b E. Selvarajah c a Department of Industral Manufacturng System Engneerng b Department of Mathematcs Statstcs c Odette School of Busness Unversty of

More information

Self-Adaptive Simulated Binary Crossover for Real-Parameter Optimization

Self-Adaptive Simulated Binary Crossover for Real-Parameter Optimization Self-Adaptve Smulated Bnary Crossover for Real-Parameter Optmzaton Kalyanmoy Deb Dept. of Mechancal Engneerng Indan Inst. of Tech. Kanpur Kanpur, PIN 20806, Inda deb@tk.ac.n S. Karthk Dept. of Mechancal

More information

Statistical pattern recognition

Statistical pattern recognition Statstcal pattern recognton Bayes theorem Problem: decdng f a patent has a partcular condton based on a partcular test However, the test s mperfect Someone wth the condton may go undetected (false negatve

More information

Appendix B: Resampling Algorithms

Appendix B: Resampling Algorithms 407 Appendx B: Resamplng Algorthms A common problem of all partcle flters s the degeneracy of weghts, whch conssts of the unbounded ncrease of the varance of the mportance weghts ω [ ] of the partcles

More information

Credit Card Pricing and Impact of Adverse Selection

Credit Card Pricing and Impact of Adverse Selection Credt Card Prcng and Impact of Adverse Selecton Bo Huang and Lyn C. Thomas Unversty of Southampton Contents Background Aucton model of credt card solctaton - Errors n probablty of beng Good - Errors n

More information

Some Comments on Accelerating Convergence of Iterative Sequences Using Direct Inversion of the Iterative Subspace (DIIS)

Some Comments on Accelerating Convergence of Iterative Sequences Using Direct Inversion of the Iterative Subspace (DIIS) Some Comments on Acceleratng Convergence of Iteratve Sequences Usng Drect Inverson of the Iteratve Subspace (DIIS) C. Davd Sherrll School of Chemstry and Bochemstry Georga Insttute of Technology May 1998

More information

Thin-Walled Structures Group

Thin-Walled Structures Group Thn-Walled Structures Group JOHNS HOPKINS UNIVERSITY RESEARCH REPORT Towards optmzaton of CFS beam-column ndustry sectons TWG-RR02-12 Y. Shfferaw July 2012 1 Ths report was prepared ndependently, but was

More information

Cathy Walker March 5, 2010

Cathy Walker March 5, 2010 Cathy Walker March 5, 010 Part : Problem Set 1. What s the level of measurement for the followng varables? a) SAT scores b) Number of tests or quzzes n statstcal course c) Acres of land devoted to corn

More information

Entropy Generation Minimization of Pin Fin Heat Sinks by Means of Metaheuristic Methods

Entropy Generation Minimization of Pin Fin Heat Sinks by Means of Metaheuristic Methods Indan Journal of Scence and Technology Entropy Generaton Mnmzaton of Pn Fn Heat Snks by Means of Metaheurstc Methods Amr Jafary Moghaddam * and Syfollah Saedodn Department of Mechancal Engneerng, Semnan

More information

CSC 411 / CSC D11 / CSC C11

CSC 411 / CSC D11 / CSC C11 18 Boostng s a general strategy for learnng classfers by combnng smpler ones. The dea of boostng s to take a weak classfer that s, any classfer that wll do at least slghtly better than chance and use t

More information

Composite Hypotheses testing

Composite Hypotheses testing Composte ypotheses testng In many hypothess testng problems there are many possble dstrbutons that can occur under each of the hypotheses. The output of the source s a set of parameters (ponts n a parameter

More information

CHAPTER 7 STOCHASTIC ECONOMIC EMISSION DISPATCH-MODELED USING WEIGHTING METHOD

CHAPTER 7 STOCHASTIC ECONOMIC EMISSION DISPATCH-MODELED USING WEIGHTING METHOD 90 CHAPTER 7 STOCHASTIC ECOOMIC EMISSIO DISPATCH-MODELED USIG WEIGHTIG METHOD 7.1 ITRODUCTIO early 70% of electrc power produced n the world s by means of thermal plants. Thermal power statons are the

More information

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin Proceedngs of the 007 Wnter Smulaton Conference S G Henderson, B Bller, M-H Hseh, J Shortle, J D Tew, and R R Barton, eds LOW BIAS INTEGRATED PATH ESTIMATORS James M Calvn Department of Computer Scence

More information

Linear Approximation with Regularization and Moving Least Squares

Linear Approximation with Regularization and Moving Least Squares Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...

More information

Chapter Newton s Method

Chapter Newton s Method Chapter 9. Newton s Method After readng ths chapter, you should be able to:. Understand how Newton s method s dfferent from the Golden Secton Search method. Understand how Newton s method works 3. Solve

More information

Maximizing Overlap of Large Primary Sampling Units in Repeated Sampling: A comparison of Ernst s Method with Ohlsson s Method

Maximizing Overlap of Large Primary Sampling Units in Repeated Sampling: A comparison of Ernst s Method with Ohlsson s Method Maxmzng Overlap of Large Prmary Samplng Unts n Repeated Samplng: A comparson of Ernst s Method wth Ohlsson s Method Red Rottach and Padrac Murphy 1 U.S. Census Bureau 4600 Slver Hll Road, Washngton DC

More information

Example: (13320, 22140) =? Solution #1: The divisors of are 1, 2, 3, 4, 5, 6, 9, 10, 12, 15, 18, 20, 27, 30, 36, 41,

Example: (13320, 22140) =? Solution #1: The divisors of are 1, 2, 3, 4, 5, 6, 9, 10, 12, 15, 18, 20, 27, 30, 36, 41, The greatest common dvsor of two ntegers a and b (not both zero) s the largest nteger whch s a common factor of both a and b. We denote ths number by gcd(a, b), or smply (a, b) when there s no confuson

More information

Ensemble Methods: Boosting

Ensemble Methods: Boosting Ensemble Methods: Boostng Ncholas Ruozz Unversty of Texas at Dallas Based on the sldes of Vbhav Gogate and Rob Schapre Last Tme Varance reducton va baggng Generate new tranng data sets by samplng wth replacement

More information

FUZZY GOAL PROGRAMMING VS ORDINARY FUZZY PROGRAMMING APPROACH FOR MULTI OBJECTIVE PROGRAMMING PROBLEM

FUZZY GOAL PROGRAMMING VS ORDINARY FUZZY PROGRAMMING APPROACH FOR MULTI OBJECTIVE PROGRAMMING PROBLEM Internatonal Conference on Ceramcs, Bkaner, Inda Internatonal Journal of Modern Physcs: Conference Seres Vol. 22 (2013) 757 761 World Scentfc Publshng Company DOI: 10.1142/S2010194513010982 FUZZY GOAL

More information

Copyright 2017 by Taylor Enterprises, Inc., All Rights Reserved. Adjusted Control Limits for P Charts. Dr. Wayne A. Taylor

Copyright 2017 by Taylor Enterprises, Inc., All Rights Reserved. Adjusted Control Limits for P Charts. Dr. Wayne A. Taylor Taylor Enterprses, Inc. Control Lmts for P Charts Copyrght 2017 by Taylor Enterprses, Inc., All Rghts Reserved. Control Lmts for P Charts Dr. Wayne A. Taylor Abstract: P charts are used for count data

More information

4DVAR, according to the name, is a four-dimensional variational method.

4DVAR, according to the name, is a four-dimensional variational method. 4D-Varatonal Data Assmlaton (4D-Var) 4DVAR, accordng to the name, s a four-dmensonal varatonal method. 4D-Var s actually a drect generalzaton of 3D-Var to handle observatons that are dstrbuted n tme. The

More information

Statistics II Final Exam 26/6/18

Statistics II Final Exam 26/6/18 Statstcs II Fnal Exam 26/6/18 Academc Year 2017/18 Solutons Exam duraton: 2 h 30 mn 1. (3 ponts) A town hall s conductng a study to determne the amount of leftover food produced by the restaurants n the

More information

A Bayes Algorithm for the Multitask Pattern Recognition Problem Direct Approach

A Bayes Algorithm for the Multitask Pattern Recognition Problem Direct Approach A Bayes Algorthm for the Multtask Pattern Recognton Problem Drect Approach Edward Puchala Wroclaw Unversty of Technology, Char of Systems and Computer etworks, Wybrzeze Wyspanskego 7, 50-370 Wroclaw, Poland

More information

NP-Completeness : Proofs

NP-Completeness : Proofs NP-Completeness : Proofs Proof Methods A method to show a decson problem Π NP-complete s as follows. (1) Show Π NP. (2) Choose an NP-complete problem Π. (3) Show Π Π. A method to show an optmzaton problem

More information

ECONOMIC POWER DISPATCH USING THE COMBINATION OF TWO GENETIC ALGORITHMS

ECONOMIC POWER DISPATCH USING THE COMBINATION OF TWO GENETIC ALGORITHMS ISTANBUL UNIVERSITY JOURNAL OF ELECTRICAL & ELECTRONICS ENGINEERING YEAR VOLUME NUMBER : 2006 : 6 : 2 (75-8) ECONOMIC POWER DISPATCH USING THE COMBINATION OF TWO GENETIC ALGORITHMS Mmoun YOUNES Mostafa

More information

Société de Calcul Mathématique SA

Société de Calcul Mathématique SA Socété de Calcul Mathématque SA Outls d'ade à la décson Tools for decson help Probablstc Studes: Normalzng the Hstograms Bernard Beauzamy December, 202 I. General constructon of the hstogram Any probablstc

More information

Self-adaptive Differential Evolution Algorithm for Constrained Real-Parameter Optimization

Self-adaptive Differential Evolution Algorithm for Constrained Real-Parameter Optimization 26 IEEE Congress on Evolutonary Computaton Sheraton Vancouver Wall Centre Hotel, Vancouver, BC, Canada July 16-21, 26 Self-adaptve Dfferental Evoluton Algorthm for Constraned Real-Parameter Optmzaton V.

More information

Single-Facility Scheduling over Long Time Horizons by Logic-based Benders Decomposition

Single-Facility Scheduling over Long Time Horizons by Logic-based Benders Decomposition Sngle-Faclty Schedulng over Long Tme Horzons by Logc-based Benders Decomposton Elvn Coban and J. N. Hooker Tepper School of Busness, Carnege Mellon Unversty ecoban@andrew.cmu.edu, john@hooker.tepper.cmu.edu

More information