A stochastic algorithm for function minimization
|
|
- Daniel Norris
- 5 years ago
- Views:
Transcription
1 A stochastc algorthm for functon mnmzaton DONGCAI SU School of Communcatons, Jln Unversty, Changchun, Jln 3002, Chna E-mal: JUNWEI DONG Bradley Department of Electrcal & Computer Engneerng, Vrgna Polytechnc Insttute and State Unversty, VA 22043, USA E-mal: ZUDUO ZHENG Department of Cvl & Envronmental Engneerng, Hoha Unversty and Arzona State Unversty, 5 E. Lemon St. 40 E Apt., Tempe, AZ 8528 USA Emal: zhengzuduo@gmal.com Phone: Abstract Focusng on what an optmzaton problem may comply wth, the so-called convergence condtons have been proposed and sequentally a stochastc optmzaton algorthm named as DSZ algorthm s presented n order to deal wth both unconstraned and constraned optmzatons. Its prncple s dscussed n the theoretcal model of DSZ algorthm, from whch we present a practcal model of DSZ algorthm. Practcal model s effcency s demonstrated by comparson wth smlar algorthms such as Enhanced Smulated Annealng (ESA), Monte Carlo Smulated Annealng (MCS), Snffer Global Optmzaton (SGO), Drected Tabu Search (DTS), and Genetc Algorthm (GA), usng a set of well-known both unconstraned and constraned optmzaton test cases. Meanwhle, further attenton goes to the strategy how to optmze the hgh-dmensonal unconstraned problems usng DSZ algorthm. Keywords: Global optmzaton, unconstraned optmzaton, constraned optmzaton
2 Introducton Assumng the optmzaton task s to mnmze the obectve functon, and pont p s the global soluton. Regardng to the condton whch the obectve functons concerned n ths paper satsfy: (secton 2.): "The smaller a pont s functon value, the hgher probablty that ths pont s closer to p." DSZ algorthm (secton 2.4) s presented nvolvng two strateges:. Pont set evoluton accordng to ts functon value; 2. Shrnkng operaton accordng to the shrnkng coeffcent c s employed durng the pont set evoluton. Accordng to the computatonal eperments (secton 2.5, 4.4), the effcency of DSZ algorthm s encouragng. Furthermore, the strategy of handlng hgh dmensonal, unconstraned problem was dscussed n secton 3 2 Optmzaton Prncples and Procedure 2. Condtons on the optmzaton problems The consdered obectve functon s denoted as f (), :[, L,, L, n ] where ( n) s real number. Let D the regon of ( n), where D: l u, ( l u, n). And l + u o = s the center of D; 2 Wthout losng generalty, the optmzaton task s to search for mnma of f (). The correspondng soluton for the global mnma s p :[ p, L, p, L, pn ],( n). D = ( k( D o) + ) D,( D,0 < k 2), whose central pont s, the rato of k smltude between D k and D s k. r 2 p = ma, n, ( D,0 < k 2 ) k( u l ) k 2
3 Optmzaton problems consdered n ths paper shall meet the followng three condtons: () Contnuty: Gven thatε s a postve number however small, and 2 are any two ponts n D,f 0 < 2 < δ,when δ s suffcently small, the f () always satsfes f ( ) f ( 2) < ε. (2) Convergence Condtons I: θ ( k) s a stochastc value whch s correlated to k ( k (0,2] ), defned as θ ( k) = p ' p where p D k, and ' as a random pont n D s subected to f ( ') < f ( ). Then for any postve k nteger N 0, whch s large enough, and N > N 0, we have N C(k) θ < ε ' = where ε ' s a postve number however small, and k ( N ) s any number from ( 0,2 ]. (3) Convergence Condtons II: Assume λ 0 (0,) and P (0, 0 ) are fed constants and ' s a pont randomly selected n D. If k p D k and rk λ0, then prob[ f ( ') < f ( )] P0, where prob [*] denotes the probablty of event *. 2.2 The Theoretcal Model The theoretcal procedure of DSZ algorthm s shown below: () Intalzng: set = and ntalze the teratve number and the mamum teraton (ma_ter); randomly generate from regon D and ntalze k (0, 2] to enforce p D k and rk λ ; 0 (2) Randomly generate ' from regon D k. If f ( ') < f ( ), then let = + ', otherwse, let = + ; (3) Choose c to ensure k+ p D + and + k λ + 0 r, where k = + c k ; 3
4 (4) Let =+, return to step (2) untl reaches ma_ter ; (5) Take ma_ter as the optmum soluton. 2.3 Optmzaton Prncple Theorem: Accordng to the theoretcal model, f the mamum teraton ma_ter s suffcently large, then f ( p) f ( ) < ε, where ε s a postve number ma_ ter however small, ma_ ter s the optmum soluton. Proof: [, L,, L, ] be the mamum subset of [, L,, L, ma_ ter ] Let τ () τ ( ) τ ( M ) whch holds: (ⅰ) τ ( ) [, ma_ ter] s a postve nteger andτ( +)> τ( ), ( M ) ; f ( + ) < f ( ). (ⅱ) τ ( ) τ ( ) Accordng to Convergence Condtons II as k k p D, r λ ( ma_ ter), when ma_ter s suffcent large, we have 0 M P ma_ ter > N Also, from the defnton of θ ( k) n Convergence Condtons I, we have p τ ( + ) θ ( kτ ( ) ) =,( M ). p τ ( ) Thus, M D ma_ ter ma θ ( ) = D p d ( k τ ), where dma between p and any other pont n regon D. s the mamum dstance Accordng to Convergence Condtons I as well as the fact that M > N0, we have D ma_ ter p < ε ' dma < δ, 4
5 Where δ ε ' < d D ma. Due to the contnuty condton, t can be found: f ( p) f ( ) < ε, ma_ ter Where ε s a postve however small number, whch proves that ma_ter s actually the optmum soluton. 2.4 The Practcal Model Because of the uncertanty of pont p before optmzaton, values of k and c ( ma_ ter ) cannot be precsely determned so as to satsfy the condtons requred n step () and (3) of the theoretcal procedure. To avod ths dffculty, the practcal procedure of DSZ algorthm s nstead proposed here. Frst, ntalze k = 2 so that D,we have p D k.[the defnton of D k s n secton 2.]. And c = c,( ma_ ter) s assgned n our research, where c (0<c<) s the shrnkng coeffcent gven n the ntalzaton step of the algorthm, whch s related to the specfc optmzaton obectve functon. k Unfortunately, p D,( ma_ ter) wll be no longer guaranteed by dong so. Concernng to enclose p n search scope as much as possble durng the process of DSZ algorthm, the practcal model of DSZ algorthm s desgned as bellow: () Let = and randomly generate m ponts n D to form the ntal set S : s,,,, L s L s m ; ntalze k =2, the shrnkng coeffcent c (0<c<) and the mamum teraton ma_ter; (2) For each pont s ( m) n S, a correspondng random pont s ' s s generated from D, thus a new set s formed as S ':[ s ', L, s ', L s '] ; k m (3) From S S ', choose m ponts accordng to ther obectve functon values as the new set S +.The mamal value of these chosen ponts' functon values should be smaller than the mnmal value of the rest ponts' functon values; 5
6 (4) Let k = c + k, (0<c<); (5) Let =+, return to step (2) untl =ma_ter; (6) Choose the soluton 0 from S ma_ter whch mnmzes f() as the output; For certan optmzaton functons, f we can choose values of c, m and ma_ter to hold ma_ ter D 0 p 2c dma () Then 0 p wll be controlled by varyng c ma_ ter, whch meets the need to control the optmzaton precson. 2.5 Epermental Test The effcency of DSZ algorthm has been tested by usng a set of well known functons. It ncludes eght classes of problems: Brann [2, 3, 8-4], Eason [4, 8, 9, 3], Goldsten-Prce [2, 4, 8-3], Shubert [3, 4, 8, 9, -4], Hartmann [, 2, 4, 8, 9, 3], Rosenbrock [, 4, 8, 9, 2, 3], Shekel [, 2, 4, 8-0, 2, 3], and Zakharov [, 4, 8, 9, 3]. Accordng to Hedar and Fukushma [8], the characterstcs of these test functons are dverse enough to cover many knds of dffcultes that arse n global optmzaton problems. Other three functons: rastrgn [8, 0], s hump [8, 5, 6], covlle [5] have also been tested. Snce the global mnma s known for each of these functons, as dd n [, 4, 8, 3], we defne suffcently close by ~ * * < ε + ε 2 f f f Where f * refers to the global mnma of the obectve functon, and ~ f refers to the result acheved by DSZ algorthm, ε and ε 2 are set to 0-4 and 0-6, respectvely. Thus for each eecuton of DSZ algorthm, f the above nequty s satsfed, we say DSZ algorthm s successful for ths eecuton. Table shows the results of the tests, and the functon evolutons "ma_ter m" s lmted wthn For each test functon, the success rato ρ s defned as the number of successes out of 00 ndependent eecutons. The optmzaton error s epressed as 6
7 er = f * ~ f * f ~ f f = *,( 0) f *,( 0) Med(er) n the table stands for the medan of the er set that obtaned from the 00 ndependent eecutons of DSZ algorthm. Table DSZ algorthm epermental results for a set of test functons Functon Dmenson n ρ Med(er) ma_ter Intal sample : m c^ma_ter Brann e ^(-4) Rastrgn e ^(-4) Easom e ^(-4) Goldsten-prce e ^(-4) Shubert e ^(-4) S-hump e ^(-4) Colvlle e ^(-5) Hartmann e ^(-4) Hartmann e ^(-4) Rosenbrock e ^(-4) Rosenbrock-5 5 Rosenbrock-0 0 Skekel-(4,5) e ^(-4) Skekel-(4,7) e ^(-4) Skekel(4,0) e ^(-4) Zakharov e ^(-5) Zakharov e ^(-5) Zakharov e ^(-6) Net, the test results are compared wth some selected estng optmzaton algorthms. The comparson results are demonstrated n Table 2. From Table, ecept Rosenbrock-5 and Rosenbrock-0, DSZ algorthm has optmzed the test functons wth success rato of 74% or above. It s also seen from Table 2 that DSZ algorthm s compettve wth respect to optmzaton 7
8 success rato. It s worth pontng out that accordng to the procedure of the practcal model, the process of generatng new set value calculaton for S ' n the step (2) and functon S ' n the step (3) can easly be acheved through the parallel computng desgn. In that sense, f m parallel computatonal components are appled, the complety of the computatonal tme can be reduced to O( ma _ ter ). Table 2 Comparson between DSZ algorthm and other optmzatons Functon Enhanced Smulated Annealng (ESA) Monte Carlo Smulated Annealng (MCSA) Snffer Global Optmzaton (SGO) Drected Tabu Search (DTS) DSZ algorthm Brann -- 00/557 00/205 00/22 00/600 Easom 82/223 99/000 Goldsten-prce 00/783 99/86 00/664 00/230 00/500 Shubert 92/274 99/500 Hartmann-3 00/698 00/224 99/534 00/438 84/3000 Hartmamnn-6 00/638 62/94 99/760 83/787 87/3000 Rosenbrock-2 00/254 96/6000 Rosenbrock-5 85/684 Rosenbrock-0 85/9037 Shekel-(4,5) 54/487 54/390 90/ /89 74/3000 Shekel(4,7) 54/66 64/342 96/ /82 95/3000 Shekel(4,0) 50/363 8/ / /828 97/3000 Zakharov-5 00/003 00/3000 Zakharov-0 00/ /0000 Note: */* stands for Optmzaton success number/number of functon evolutons. 8
9 3 Strategy of Handlng Hgh Dmensonal, Unconstraned problems As mentoned n [5], the unconstraned and bound constraned problems n hgher dmensons are one of challenges n the near future. In practce, when the optmzaton problems are complcated functons wth hgh dmensonal ndependent varables, chose parameters m, c and ma_ter to meet equaton () n secton 2.4 may ntroduce unacceptable computatonal cost. The subsecton wll dscuss a strategy to handle hgh-dmensonal, unconstraned problems subect to partcular condton. 3. Condton on the Hgh-dmensonal, Unconstraned Problem The consdered obectve functon s denoted as f (), :[, L,, L, n ] where ( n) s real number. D s the regon of the ndependent varables, where D: l u, ( l u, n). If p, p 2 are any two random ponts n D ( D,0 < k 2), k and f ( p) < f ( p2), then we have prob[ p p < p p2 ] > 0.5 for any ( n). 3.2 Dstrbuton of the Results Now we study dstrbuton of DSZ algorthm s output for each dmenson of the coordnate 0, ( n) by the predetermned proper value of c, m and ma_ter. Assumng that parameters c, m and ma_ter are chosen for acceptable computatonal cost, after ndependently eecutng DSZ algorthm to optmze the target functon for K tmes, we then get a set of ndependent results: { 0 k n, k K}, where 0 k denotes the eecuton result. th coordnate of the th k tme 9
10 s dstrbuton n only [ p, u ] ( n) wll be dscussed here, because ts 0 dstrbuton n [ l, p ] s subected to the same manner. Let ma_ ter t = 2 c ( u l ). Evenly dvde [ p, u ] by t nto fnte subntervals. Let q ' ( ' ) be the number of ponts from set { 0 k k K} that falls nto the ' th subnterval. When the algorthm runs nto the mamum teraton, the adacent subntervals q ' and q '+ would have the transtonal relatonshp as shown n Fgure. q q ' ' + prob 2 ' q ' prob ' q ' + Fgure Transton relatonshp between q ', q '+ at the fnal teraton cycle Accordng to the practcal model, the values of set { S } are smaller than ma_ ter or equal to the ones of the set { Sma_ }. Accordng to condton n secton 3., t ter gves prob ' prob2 ' because ples n the frst subnterval of[ p, u ]. When the transton reaches ts equlbrum, we have Thus ' = q ' = r q q, ' >, where prob2 q ' ' + = prob ' r prob2 ' =, 0 r prob <. If r s a constant number equal to r, whch s ndependent of the subnterval where t located, then we have: 0
11 q ' = r ' q Furthermore, f 0 < r <, and ma_ ter c s set to a suffcently small number, whch also leads to a suffcently small t, the fnal output result n the th coordnate 0 would yeld to the eponental dstrbuton wthn the nterval [ l, u ]. Wth the mamum probablty occurrng at the subnterval contanng p, t has a decreasng negatve eponental dstrbuton along both sdes of ths subnterval. 3.3 Test Eperments n Test functon n ths secton s f ( ) =,0. The optmzaton task s to = determne the mnmum value of f ( ). As to ths functon, condton n secton 3. s satsfed. In ths optmzaton, the dmenson of s 3 n = 0. The algorthm parameters 3 / are set as ma_ter=4000, m= and the shrnkng constant c= 0. When the algorthm runs nto the last teraton, the varable subntervals are scaled to the magntude of c ma_ ter = 3 0. After all the nput parameters are set up, ndependently runnng 0 tmes gves a output matr M. Each row of M refers to the result of one ndependent eecuton of DSZ algorthm. Because of the specalty of the functon f ( ) consdered n ths paper, all elements n M can be regarded as the output of any dmenson 0 ( n) after ndependently runnng the DSZ algorthm for tmes. Hence, hstograms for each dmenson of the varables are shown n Fgure 2 by usng all the elements of M. Fgure 3 shows the plot of all the elements fell nto nterval [0, 0.], and the length of ts subnterval s 3 0. Fgure 3 ndcates the maorty of ponts fall nto the regon of [0, 0.02]. Thus f we zoom n ths regon, the correspondng result s shown n Fgure 4. The logarthmc curve of Fgure 4 s shown n Fgure 5. The smooth trend of curve n Fgure 5 dscloses that the dagram n Fgure 3 appromates an eponental dstrbuton, as what has been derved n the prevous secton.
12 Fgure 2 The hstogram for all the elements of M Fgure 3 Hstogram of all the elements fell nto nterval [0, 0.] Fgure 4 Hstogram of all the elements fell nto nterval [0, 0.02] Fgure 5 The logarthm curve of fgure 4. as: subnterval number; y as: log value of the number of ponts fell n each subnterval 3.4 Strategy Accordng to the dstrbuton of the output results n each coordnate 0 ( n) of DSZ algorthm dscussed above, we descrbe the strategy of usng DSZ algorthm to optmze certan hgh-dmensonal, unconstraned problems as followng: Intalze parameters c, m and ma_ter at acceptable computatonal cost. Run DSZ algorthms to optmze the obectve functon ndependently for K tmes. Eamne the hstograms of the output soluton set at each dmenson { 0 k k K} ( n ).Use the nformaton hstograms provde (the subnterval n whch maorty of set { 0 k k K} ( n ) locate) to narrow the nterval, n whch p ( n) locates, hence narrow the regon D p where 2
13 p locates. Obvously, p Dp D. Use Dp as the new regon for the varables: small. new D D p. Repeat the above steps untl D p becomes suffcently 4 Applcatons n the Constraned Optmzaton Contet 4. Condton on the optmzaton problem The optmzaton target s functon f (), :[, L,, L, n ] where ( n) s real number. Defne D: l u, ( l u, n) as the regon for varable. E D s the constraned regon on whch s nonempty. The target functon f () also satsfes the three condtons descrbed n secton 2., namely, () Contnuty; (2) Convergence condton I; (3) Convergence condton II. Wthout losng generalty, the task s to look for the global mnma of f (). The correspondng soluton for the global mnma s p :[ p, L, p L, p ], ( n)., n 4.2 Optmzaton Methodology For the constraned optmzaton problems, DSZ algorthm employs almost the same approach as done for the unconstraned optmzaton. In the constraned optmzaton contet, frstly, randomly generate N legal ponts n E by evenly samplng sz ponts n D, the set of legal ponts s denoted as S. In ths way, on the one hand, S s randomly dstrbuted n the regon E; on the other hand, the rato of volume between space E and D could be estmated by N/sz. Thus, f ntalze k as N k = sz / n (n s the dmenson of varable ), the entre E space can be epected to covered by usng the ntal random set U D. k S After that, the same method of processng the unconstraned optmzaton s 3
14 adopted. One thng noted s that llegal ponts should be removed once they appear durng the process. 4.3 Procedure n the Constraned Optmzaton Contet () Let =, and randomly generate m legal ponts by samplng sz ponts randomly n regon D to form the ntal set S : s,,,, L s L s m, thus S E. Intalze k m = sz teraton ma_ter; / n, shrnkng coeffcent c (0<c<), and the mamum (2) For each pont s,( m) n S, a correspondng random pont s ' s s generated from D, thus new set s formed as S ':[ s ', L, s ', L sm '] ; k (3) From set S S ', choose m legal ponts accordng to ther obectve functon values as the new set S +. The mamal value of these chosen m ponts' functon values should smaller than the mnmal value of the rest legal ponts functon values; (4) Let k = + c k (0<c<); (5) Let =+, return step (2) untl =ma_ter; (6) Choose the soluton from S ma_ ter whch yelds f ( ) mnma as the output. 4.4 Test Results In ths secton, DSZ algorthm s appled to test cases from reference [6], as shown n Table 3. Table 3 Summary of test case Functon N Type of f ρ LI NE NI A Mn G 3 Quadratc 0.0% Ma G2 K Nonlnear % Ma G3 K Polynomal % 0 0 Mn G4 5 Quadratc % Mn G5 4 Cubc %
15 Mn G6 2 Cubc % Mn G7 0 Quadratc % Ma G8 2 Nonlnear % Mn G9 7 Polynomal 0.552% Mn G0 8 Lnear 0.000% Mn G 2 Quadratc % 0 0 Note: LI-lnear nequaltes, NE-nonlnear Equaltes, NI-Nonlnear nequaltes, A-actve constrants and ρ - feasblty; for both G2 and G3, k=50. For each test case we lst number of varables n, type of the functon f, the relatve sze of the feasble regon n the search space gven by ρ, the number of constrants of each categores such as LI (lnear nequaltes), NE (nonlnear equatons) and NI (nonlnear nequaltes). The feasblty ρ s determned epermentally n reference [7] by calculatng the percentage of feasble solutons among the,000,000 randomly generated ndvduals. Table 5 and Table 6 are the comparsons between DSZ algorthm and genetc algorthm [6, 7]. The ndependent varables of functon G2 and G3 are 20 dmensons and 0 dmensons, respectvely. Parameters of DSZ algorthm are shown n Table 4. Table 4 Parameters of DSZ algorthm Functon n m ma_ter G G G G ma_ ter c G5 4 G G G G G
16 G Note: n - dmensons of functon s ndependent varables; m-the populaton sze of the ponts set; ma_ter- the mamum teratons; c- the shrnkng coeffcent. Table 5 Test Results () Functon Optmum value GA n[6] (Eperment #3) DSZ algorthm Worst Best Average Worst Best Average G G G G G G G G * G G G Note: Independently run the genetc algorthm n [6] and DSZ algorthm 0 tmes, respectvely; for the genetc algorthm, the mamum number of generatons s 5,000, the populaton sze s 70; for G3, k=0 and for G2, k=20. Parameters of DSZ algorthm are shown n Table 4. Table 6 Test Results (2) Functon Optmum value GA n [7] DSZ algorthm Worst Best Medan Worst Best Medan G G G G G G G
17 G * G G G Note: Run the genetc algorthm n [7] and DSZ algorthm 50 tmes ndependently; for the genetc algorthm, the mamum number of generatons s 5,000, the populaton sze s 0; for G3, k=0 and for G2, k=20. Parameters of DSZ algorthm are shown n Table 4. The test results clearly ndcate that by usng less than /5 of the teratons of genetc algorthm, DSZ algorthm s capable of determnng better results than GA. It should be ponted out that DSZ algorthm has found a new soluton = [ , ] for G8, whch gves G8() = > Besdes, when the constrants contan equaltes, DSZ algorthm handles them by transformng them nto a format of nequaltes or bound constraned problems. Take G3 for an eample: n n G3:Mamze G3( ) = ( n), where 2 =,0, for( n). G3 could be transformed nto an equvalent form as followng: = n n n 2 MamzeG3( ) = ( n), where 2,0, for( n ). = = In ths way, the n-dmensonal constraned optmzaton problem wth equaltes s transformed nto the (n-)-dmensonal constraned optmzaton problem wth only nequaltes. Take G for another eample G:Mamze G( ) = + ( 2 ), where 2 = 0,,( =, 2). G s equvalent to the problem below: n = Mamze G( ) = + ( ), where. The above eamples show that the two-dmensonal problem constraned by equaltes can be transformed nto the one-dmensonal unconstraned problem. If constrants contan multple nonlnear equaltes e.g. G5, the nonlnear equaton n = 7
18 toolkt shall be added to current verson of DSZ algorthm so as to transform equalty constrants nto ether nequalty constrants or unconstraned condtons. 5 Summary In the present paper a smple stochastc global optmzaton method, DSZ algorthm, has been proposed based on Convergence Condtons I and Convergence Condtons II, whch are generally gnored by prevous researchers. The epermental results demonstrate that DSZ algorthm s effectve and capable of handlng both unconstraned and constraned optmzaton problems. As to DSZ algorthm s prncple, we demonstrated ts valdty based on ts theoretcal model. For the practcal model of DSZ algorthm, ts valdty and effcency wll need further nvestgaton when appled to more complcated obectve functons. Therefore, future work wll contnue on: () Mechansm on practcal DSZ algorthm and what condtons the obectve functon should meet to guarantee the effcency of ts optmzaton; (2) In ths paper we proposed a strategy of handlng the hgh-dmensonal optmzaton problem by usng the hstogram nformaton of DSZ algorthm outputs to narrow the optmal regon for p. The effcency of ths strategy needs to be testfed by more hgh-dmensonal and complcated cases; (3) Although the current verson of DSZ algorthm s capable to handle scenaros wth nequalty constrants, n order to cover the equalty and nequalty med condtons, a toolkt of equaton solver would need to be ncluded; (4) DSZ algorthm s also epected to be appled to other optmzaton ssues, e.g. dscrete varable optmzaton and combnaton optmzaton n future. Acknowledgement We are thankful to Professor Wael H. Abulshohoud n Jln Unversty- Lambton College (prevous wth The George Washngton Unversty) for hs nsghtful comments and suggestons. 8
19 6 References [] P. Sarry and F. Durdn, "Enhanced smulated annealng for globally mnmzng functons of many-contnuous varables, ACM Transactons on Mathematcal Software (TOMS), vol. 23, pp , 997. [2] D. VANDERBILT and S. LOUIE, "A Monte Carlo smulated annealng approach to optmzaton over contnuous varables, Journal of Computatonal Physcs (Prnt), vol. 56, pp , 984. [3] R. R. Butler and E. Slamnka, "An evaluaton of the snffer global optmzaton algorthm usng standard test functons," Journal of Computatonal Physcs, vol. 99, pp , [4] A. R. Hedar and M. Fukushma, "Hybrd Smulated Annealng and Drect Search Method for Nonlnear Unconstraned Global Optmzaton, Optm. Methods Software, vol. 7, pp , [5] A. Neumaer, "Complete search n contnuous global optmzaton and constrant satsfacton, Acta Numerca, vol. 3, pp , [6] S. Kozel and Z. Mchalewcz, "Evolutonary algorthms, homomorphous mappngs, and constraned parameter optmzaton, Evl. Compute, vol. 7, pp. 9-44, Sprng [7] S. Venkatraman and G. Yen, "A Generc Framework for Constraned Optmzaton Usng Genetc Algorthms, Evolutonary Computaton, IEEE Transactons on, vol. 9, pp , [8] A. R. Hedar and M. Fukushma, "Tabu Search drected by drect search methods for nonlnear global optmzaton star, open, Eur. J. Oper. Res., vol. 70, pp , [9] M. J. Hrsch, C. N. Meneses, P. M. Pardalos and M. G. C. Resende, "Global optmzaton by contnuous grasp, Optmzaton Letters, vol., pp , [0] J. Barhen, "TRUST: A Determnstc Algorthm for Global Optmzaton, Scence, vol. 276, pp , 997. [] D. Cvovc and J. Klnowsk, "Taboo Search: An Approach to the Multple Mnma Problem, Scence, vol. 267, pp , 995. [2] T. B. Trafals and S. Kasap, "A novel metaheurstcs approach for contnuous global optmzaton, J. Global Optmz., vol. 23, pp. 7-90, [3] A. Hedar and M. Fukushma, "Mnmzng multmodal functons by smple codng genetc algorthm, Optm. Methods Software, vol. 8, pp , [4] G. H. Koon and A. V. Sebald, "Some nterestng test functons for evaluatng evolutonary programmng strategy," Proceedngs of the Fourth Annual Conference on Evolutonary Programmng, pp , 995. [5] Z. Mchalewcz, Genetc Algorthms Data Structures= Evoluton Programs. Sprnger, 996, [6] R. Chelouah and P. Sarry, "A Contnuous Genetc Algorthm Desgned for the Global Optmzaton of Multmodal Functons, J. Heurstcs, vol. 6, pp. 9-23,
20 [7] Z. Mchalewcz and G. Nazhyath, "Genocop III: a co-evolutonary algorthm for numercal optmzatonproblems wth nonlnear constrants, Evolutonary Computaton, 995, IEEE Internatonal Conference on, vol
The Study of Teaching-learning-based Optimization Algorithm
Advanced Scence and Technology Letters Vol. (AST 06), pp.05- http://dx.do.org/0.57/astl.06. The Study of Teachng-learnng-based Optmzaton Algorthm u Sun, Yan fu, Lele Kong, Haolang Q,, Helongang Insttute
More informationModule 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur
Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:
More informationMMA and GCMMA two methods for nonlinear optimization
MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons
More informationCOS 521: Advanced Algorithms Game Theory and Linear Programming
COS 521: Advanced Algorthms Game Theory and Lnear Programmng Moses Charkar February 27, 2013 In these notes, we ntroduce some basc concepts n game theory and lnear programmng (LP). We show a connecton
More informationMarkov Chain Monte Carlo (MCMC), Gibbs Sampling, Metropolis Algorithms, and Simulated Annealing Bioinformatics Course Supplement
Markov Chan Monte Carlo MCMC, Gbbs Samplng, Metropols Algorthms, and Smulated Annealng 2001 Bonformatcs Course Supplement SNU Bontellgence Lab http://bsnuackr/ Outlne! Markov Chan Monte Carlo MCMC! Metropols-Hastngs
More informationThe Minimum Universal Cost Flow in an Infeasible Flow Network
Journal of Scences, Islamc Republc of Iran 17(2): 175-180 (2006) Unversty of Tehran, ISSN 1016-1104 http://jscencesutacr The Mnmum Unversal Cost Flow n an Infeasble Flow Network H Saleh Fathabad * M Bagheran
More informationprinceton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg
prnceton unv. F 17 cos 521: Advanced Algorthm Desgn Lecture 7: LP Dualty Lecturer: Matt Wenberg Scrbe: LP Dualty s an extremely useful tool for analyzng structural propertes of lnear programs. Whle there
More informationA PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS
HCMC Unversty of Pedagogy Thong Nguyen Huu et al. A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS Thong Nguyen Huu and Hao Tran Van Department of mathematcs-nformaton,
More informationDesign and Optimization of Fuzzy Controller for Inverse Pendulum System Using Genetic Algorithm
Desgn and Optmzaton of Fuzzy Controller for Inverse Pendulum System Usng Genetc Algorthm H. Mehraban A. Ashoor Unversty of Tehran Unversty of Tehran h.mehraban@ece.ut.ac.r a.ashoor@ece.ut.ac.r Abstract:
More informationLinear Approximation with Regularization and Moving Least Squares
Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...
More informationLecture Notes on Linear Regression
Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume
More informationCollege of Computer & Information Science Fall 2009 Northeastern University 20 October 2009
College of Computer & Informaton Scence Fall 2009 Northeastern Unversty 20 October 2009 CS7880: Algorthmc Power Tools Scrbe: Jan Wen and Laura Poplawsk Lecture Outlne: Prmal-dual schema Network Desgn:
More informationU.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017
U.C. Berkeley CS94: Beyond Worst-Case Analyss Handout 4s Luca Trevsan September 5, 07 Summary of Lecture 4 In whch we ntroduce semdefnte programmng and apply t to Max Cut. Semdefnte Programmng Recall that
More informationProblem Set 9 Solutions
Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem
More informationSome modelling aspects for the Matlab implementation of MMA
Some modellng aspects for the Matlab mplementaton of MMA Krster Svanberg krlle@math.kth.se Optmzaton and Systems Theory Department of Mathematcs KTH, SE 10044 Stockholm September 2004 1. Consdered optmzaton
More informationarxiv: v1 [math.oc] 3 Aug 2010
arxv:1008.0549v1 math.oc] 3 Aug 2010 Test Problems n Optmzaton Xn-She Yang Department of Engneerng, Unversty of Cambrdge, Cambrdge CB2 1PZ, UK Abstract Test functons are mportant to valdate new optmzaton
More informationModule 9. Lecture 6. Duality in Assignment Problems
Module 9 1 Lecture 6 Dualty n Assgnment Problems In ths lecture we attempt to answer few other mportant questons posed n earler lecture for (AP) and see how some of them can be explaned through the concept
More informationChapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems
Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons
More informationKernel Methods and SVMs Extension
Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general
More informationSingle-Facility Scheduling over Long Time Horizons by Logic-based Benders Decomposition
Sngle-Faclty Schedulng over Long Tme Horzons by Logc-based Benders Decomposton Elvn Coban and J. N. Hooker Tepper School of Busness, Carnege Mellon Unversty ecoban@andrew.cmu.edu, john@hooker.tepper.cmu.edu
More information3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X
Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number
More informationMore metrics on cartesian products
More metrcs on cartesan products If (X, d ) are metrc spaces for 1 n, then n Secton II4 of the lecture notes we defned three metrcs on X whose underlyng topologes are the product topology The purpose of
More informationSome Comments on Accelerating Convergence of Iterative Sequences Using Direct Inversion of the Iterative Subspace (DIIS)
Some Comments on Acceleratng Convergence of Iteratve Sequences Usng Drect Inverson of the Iteratve Subspace (DIIS) C. Davd Sherrll School of Chemstry and Bochemstry Georga Insttute of Technology May 1998
More informationInteractive Bi-Level Multi-Objective Integer. Non-linear Programming Problem
Appled Mathematcal Scences Vol 5 0 no 65 3 33 Interactve B-Level Mult-Objectve Integer Non-lnear Programmng Problem O E Emam Department of Informaton Systems aculty of Computer Scence and nformaton Helwan
More informationChapter Newton s Method
Chapter 9. Newton s Method After readng ths chapter, you should be able to:. Understand how Newton s method s dfferent from the Golden Secton Search method. Understand how Newton s method works 3. Solve
More informationn α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0
MODULE 2 Topcs: Lnear ndependence, bass and dmenson We have seen that f n a set of vectors one vector s a lnear combnaton of the remanng vectors n the set then the span of the set s unchanged f that vector
More informationMarkov Chain Monte Carlo Lecture 6
where (x 1,..., x N ) X N, N s called the populaton sze, f(x) f (x) for at least one {1, 2,..., N}, and those dfferent from f(x) are called the tral dstrbutons n terms of mportance samplng. Dfferent ways
More information2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification
E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton
More informationThe Synchronous 8th-Order Differential Attack on 12 Rounds of the Block Cipher HyRAL
The Synchronous 8th-Order Dfferental Attack on 12 Rounds of the Block Cpher HyRAL Yasutaka Igarash, Sej Fukushma, and Tomohro Hachno Kagoshma Unversty, Kagoshma, Japan Emal: {garash, fukushma, hachno}@eee.kagoshma-u.ac.jp
More information4DVAR, according to the name, is a four-dimensional variational method.
4D-Varatonal Data Assmlaton (4D-Var) 4DVAR, accordng to the name, s a four-dmensonal varatonal method. 4D-Var s actually a drect generalzaton of 3D-Var to handle observatons that are dstrbuted n tme. The
More informationA Hybrid Variational Iteration Method for Blasius Equation
Avalable at http://pvamu.edu/aam Appl. Appl. Math. ISSN: 1932-9466 Vol. 10, Issue 1 (June 2015), pp. 223-229 Applcatons and Appled Mathematcs: An Internatonal Journal (AAM) A Hybrd Varatonal Iteraton Method
More informationGeneralized Linear Methods
Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set
More informationWhich Separator? Spring 1
Whch Separator? 6.034 - Sprng 1 Whch Separator? Mamze the margn to closest ponts 6.034 - Sprng Whch Separator? Mamze the margn to closest ponts 6.034 - Sprng 3 Margn of a pont " # y (w $ + b) proportonal
More informationPower law and dimension of the maximum value for belief distribution with the max Deng entropy
Power law and dmenson of the maxmum value for belef dstrbuton wth the max Deng entropy Bngy Kang a, a College of Informaton Engneerng, Northwest A&F Unversty, Yanglng, Shaanx, 712100, Chna. Abstract Deng
More informationFeature Selection: Part 1
CSE 546: Machne Learnng Lecture 5 Feature Selecton: Part 1 Instructor: Sham Kakade 1 Regresson n the hgh dmensonal settng How do we learn when the number of features d s greater than the sample sze n?
More informationNumerical Heat and Mass Transfer
Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and
More informationAn Interactive Optimisation Tool for Allocation Problems
An Interactve Optmsaton ool for Allocaton Problems Fredr Bonäs, Joam Westerlund and apo Westerlund Process Desgn Laboratory, Faculty of echnology, Åbo Aadem Unversty, uru 20500, Fnland hs paper presents
More informationNUMERICAL DIFFERENTIATION
NUMERICAL DIFFERENTIATION 1 Introducton Dfferentaton s a method to compute the rate at whch a dependent output y changes wth respect to the change n the ndependent nput x. Ths rate of change s called the
More informationDifference Equations
Dfference Equatons c Jan Vrbk 1 Bascs Suppose a sequence of numbers, say a 0,a 1,a,a 3,... s defned by a certan general relatonshp between, say, three consecutve values of the sequence, e.g. a + +3a +1
More informationOn the Multicriteria Integer Network Flow Problem
BULGARIAN ACADEMY OF SCIENCES CYBERNETICS AND INFORMATION TECHNOLOGIES Volume 5, No 2 Sofa 2005 On the Multcrtera Integer Network Flow Problem Vassl Vasslev, Marana Nkolova, Maryana Vassleva Insttute of
More informationYong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 )
Kangweon-Kyungk Math. Jour. 4 1996), No. 1, pp. 7 16 AN ITERATIVE ROW-ACTION METHOD FOR MULTICOMMODITY TRANSPORTATION PROBLEMS Yong Joon Ryang Abstract. The optmzaton problems wth quadratc constrants often
More informationPerfect Competition and the Nash Bargaining Solution
Perfect Competton and the Nash Barganng Soluton Renhard John Department of Economcs Unversty of Bonn Adenauerallee 24-42 53113 Bonn, Germany emal: rohn@un-bonn.de May 2005 Abstract For a lnear exchange
More informationLecture 14: Bandits with Budget Constraints
IEOR 8100-001: Learnng and Optmzaton for Sequental Decson Makng 03/07/16 Lecture 14: andts wth udget Constrants Instructor: Shpra Agrawal Scrbed by: Zhpeng Lu 1 Problem defnton In the regular Mult-armed
More informationUsing Immune Genetic Algorithm to Optimize BP Neural Network and Its Application Peng-fei LIU1,Qun-tai SHEN1 and Jun ZHI2,*
Advances n Computer Scence Research (ACRS), volume 54 Internatonal Conference on Computer Networks and Communcaton Technology (CNCT206) Usng Immune Genetc Algorthm to Optmze BP Neural Network and Its Applcaton
More informationChapter 13: Multiple Regression
Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to
More informationCIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M
CIS56: achne Learnng Lecture 3 (Sept 6, 003) Preparaton help: Xaoyng Huang Lnear Regresson Lnear regresson can be represented by a functonal form: f(; θ) = θ 0 0 +θ + + θ = θ = 0 ote: 0 s a dummy attrbute
More informationOPTIMISATION. Introduction Single Variable Unconstrained Optimisation Multivariable Unconstrained Optimisation Linear Programming
OPTIMIATION Introducton ngle Varable Unconstraned Optmsaton Multvarable Unconstraned Optmsaton Lnear Programmng Chapter Optmsaton /. Introducton In an engneerng analss, sometmes etremtes, ether mnmum or
More informationSingular Value Decomposition: Theory and Applications
Sngular Value Decomposton: Theory and Applcatons Danel Khashab Sprng 2015 Last Update: March 2, 2015 1 Introducton A = UDV where columns of U and V are orthonormal and matrx D s dagonal wth postve real
More information1 GSW Iterative Techniques for y = Ax
1 for y = A I m gong to cheat here. here are a lot of teratve technques that can be used to solve the general case of a set of smultaneous equatons (wrtten n the matr form as y = A), but ths chapter sn
More information= z 20 z n. (k 20) + 4 z k = 4
Problem Set #7 solutons 7.2.. (a Fnd the coeffcent of z k n (z + z 5 + z 6 + z 7 + 5, k 20. We use the known seres expanson ( n+l ( z l l z n below: (z + z 5 + z 6 + z 7 + 5 (z 5 ( + z + z 2 + z + 5 5
More informationCHAPTER 7 CONSTRAINED OPTIMIZATION 2: SQP AND GRG
Chapter 7: Constraned Optmzaton CHAPER 7 CONSRAINED OPIMIZAION : SQP AND GRG Introducton In the prevous chapter we eamned the necessary and suffcent condtons for a constraned optmum. We dd not, however,
More information6. Stochastic processes (2)
6. Stochastc processes () Lect6.ppt S-38.45 - Introducton to Teletraffc Theory Sprng 5 6. Stochastc processes () Contents Markov processes Brth-death processes 6. Stochastc processes () Markov process
More information6. Stochastic processes (2)
Contents Markov processes Brth-death processes Lect6.ppt S-38.45 - Introducton to Teletraffc Theory Sprng 5 Markov process Consder a contnuous-tme and dscrete-state stochastc process X(t) wth state space
More informationMulti-Robot Formation Control Based on Leader-Follower Optimized by the IGA
IOSR Journal of Computer Engneerng (IOSR-JCE e-issn: 2278-0661,p-ISSN: 2278-8727, Volume 19, Issue 1, Ver. III (Jan.-Feb. 2017, PP 08-13 www.osrjournals.org Mult-Robot Formaton Control Based on Leader-Follower
More informationStatistical Inference. 2.3 Summary Statistics Measures of Center and Spread. parameters ( population characteristics )
Ismor Fscher, 8//008 Stat 54 / -8.3 Summary Statstcs Measures of Center and Spread Dstrbuton of dscrete contnuous POPULATION Random Varable, numercal True center =??? True spread =???? parameters ( populaton
More informationThe Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction
ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also
More informationLinear Regression Analysis: Terminology and Notation
ECON 35* -- Secton : Basc Concepts of Regresson Analyss (Page ) Lnear Regresson Analyss: Termnology and Notaton Consder the generc verson of the smple (two-varable) lnear regresson model. It s represented
More informationGHHAGA for Environmental Systems Optimization
GHHAGA for Envronmental Systems Optmzaton X. H. Yang *, Z. F. Yang, and Z. Y. Shen State Key Laboratory of Water Envronment Smulaton, School of Envronment, Beng Normal Unversty, Beng 00875, Chna Key Laboratory
More informationPattern Classification
Pattern Classfcaton All materals n these sldes ere taken from Pattern Classfcaton (nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John Wley & Sons, 000 th the permsson of the authors and the publsher
More informationA Fast Computer Aided Design Method for Filters
2017 Asa-Pacfc Engneerng and Technology Conference (APETC 2017) ISBN: 978-1-60595-443-1 A Fast Computer Aded Desgn Method for Flters Gang L ABSTRACT *Ths paper presents a fast computer aded desgn method
More informationComputing Correlated Equilibria in Multi-Player Games
Computng Correlated Equlbra n Mult-Player Games Chrstos H. Papadmtrou Presented by Zhanxang Huang December 7th, 2005 1 The Author Dr. Chrstos H. Papadmtrou CS professor at UC Berkley (taught at Harvard,
More informationSupplement: Proofs and Technical Details for The Solution Path of the Generalized Lasso
Supplement: Proofs and Techncal Detals for The Soluton Path of the Generalzed Lasso Ryan J. Tbshran Jonathan Taylor In ths document we gve supplementary detals to the paper The Soluton Path of the Generalzed
More informationChapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise.
Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where y + = β + β e for =,..., y and are observable varables e s a random error How can an estmaton rule be constructed for the
More informationCorrelation and Regression. Correlation 9.1. Correlation. Chapter 9
Chapter 9 Correlaton and Regresson 9. Correlaton Correlaton A correlaton s a relatonshp between two varables. The data can be represented b the ordered pars (, ) where s the ndependent (or eplanator) varable,
More informationSelf-adaptive Differential Evolution Algorithm for Constrained Real-Parameter Optimization
26 IEEE Congress on Evolutonary Computaton Sheraton Vancouver Wall Centre Hotel, Vancouver, BC, Canada July 16-21, 26 Self-adaptve Dfferental Evoluton Algorthm for Constraned Real-Parameter Optmzaton V.
More informationSolving of Single-objective Problems based on a Modified Multiple-crossover Genetic Algorithm: Test Function Study
Internatonal Conference on Systems, Sgnal Processng and Electroncs Engneerng (ICSSEE'0 December 6-7, 0 Duba (UAE Solvng of Sngle-objectve Problems based on a Modfed Multple-crossover Genetc Algorthm: Test
More informationResource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud
Resource Allocaton wth a Budget Constrant for Computng Independent Tasks n the Cloud Wemng Sh and Bo Hong School of Electrcal and Computer Engneerng Georga Insttute of Technology, USA 2nd IEEE Internatonal
More informationCHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE
CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng
More informationLOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin
Proceedngs of the 007 Wnter Smulaton Conference S G Henderson, B Bller, M-H Hseh, J Shortle, J D Tew, and R R Barton, eds LOW BIAS INTEGRATED PATH ESTIMATORS James M Calvn Department of Computer Scence
More informationGlobal Optimization Using Hybrid Approach
Tng-Yu Chen, Y Lang Cheng Global Optmzaton Usng Hybrd Approach TING-YU CHEN, YI LIANG CHENG Department of Mechancal Engneerng Natonal Chung Hsng Unversty 0 Kuo Kuang Road Tachung, Tawan 07 tyc@dragon.nchu.edu.tw
More informationOn the Interval Zoro Symmetric Single-step Procedure for Simultaneous Finding of Polynomial Zeros
Appled Mathematcal Scences, Vol. 5, 2011, no. 75, 3693-3706 On the Interval Zoro Symmetrc Sngle-step Procedure for Smultaneous Fndng of Polynomal Zeros S. F. M. Rusl, M. Mons, M. A. Hassan and W. J. Leong
More informationResearch on Route guidance of logistic scheduling problem under fuzzy time window
Advanced Scence and Technology Letters, pp.21-30 http://dx.do.org/10.14257/astl.2014.78.05 Research on Route gudance of logstc schedulng problem under fuzzy tme wndow Yuqang Chen 1, Janlan Guo 2 * Department
More informationOutline and Reading. Dynamic Programming. Dynamic Programming revealed. Computing Fibonacci. The General Dynamic Programming Technique
Outlne and Readng Dynamc Programmng The General Technque ( 5.3.2) -1 Knapsac Problem ( 5.3.3) Matrx Chan-Product ( 5.3.1) Dynamc Programmng verson 1.4 1 Dynamc Programmng verson 1.4 2 Dynamc Programmng
More informationMean Field / Variational Approximations
Mean Feld / Varatonal Appromatons resented by Jose Nuñez 0/24/05 Outlne Introducton Mean Feld Appromaton Structured Mean Feld Weghted Mean Feld Varatonal Methods Introducton roblem: We have dstrbuton but
More informationConvexity preserving interpolation by splines of arbitrary degree
Computer Scence Journal of Moldova, vol.18, no.1(52), 2010 Convexty preservng nterpolaton by splnes of arbtrary degree Igor Verlan Abstract In the present paper an algorthm of C 2 nterpolaton of dscrete
More informationHongyi Miao, College of Science, Nanjing Forestry University, Nanjing ,China. (Received 20 June 2013, accepted 11 March 2014) I)ϕ (k)
ISSN 1749-3889 (prnt), 1749-3897 (onlne) Internatonal Journal of Nonlnear Scence Vol.17(2014) No.2,pp.188-192 Modfed Block Jacob-Davdson Method for Solvng Large Sparse Egenproblems Hongy Mao, College of
More informatione i is a random error
Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where + β + β e for,..., and are observable varables e s a random error How can an estmaton rule be constructed for the unknown
More informationThin-Walled Structures Group
Thn-Walled Structures Group JOHNS HOPKINS UNIVERSITY RESEARCH REPORT Towards optmzaton of CFS beam-column ndustry sectons TWG-RR02-12 Y. Shfferaw July 2012 1 Ths report was prepared ndependently, but was
More informationChapter 3 Differentiation and Integration
MEE07 Computer Modelng Technques n Engneerng Chapter Derentaton and Integraton Reerence: An Introducton to Numercal Computatons, nd edton, S. yakowtz and F. zdarovsky, Mawell/Macmllan, 990. Derentaton
More informationLecture 12: Discrete Laplacian
Lecture 12: Dscrete Laplacan Scrbe: Tanye Lu Our goal s to come up wth a dscrete verson of Laplacan operator for trangulated surfaces, so that we can use t n practce to solve related problems We are mostly
More informationEstimation: Part 2. Chapter GREG estimation
Chapter 9 Estmaton: Part 2 9. GREG estmaton In Chapter 8, we have seen that the regresson estmator s an effcent estmator when there s a lnear relatonshp between y and x. In ths chapter, we generalzed the
More informationON A DETERMINATION OF THE INITIAL FUNCTIONS FROM THE OBSERVED VALUES OF THE BOUNDARY FUNCTIONS FOR THE SECOND-ORDER HYPERBOLIC EQUATION
Advanced Mathematcal Models & Applcatons Vol.3, No.3, 2018, pp.215-222 ON A DETERMINATION OF THE INITIAL FUNCTIONS FROM THE OBSERVED VALUES OF THE BOUNDARY FUNCTIONS FOR THE SECOND-ORDER HYPERBOLIC EUATION
More informationErrors for Linear Systems
Errors for Lnear Systems When we solve a lnear system Ax b we often do not know A and b exactly, but have only approxmatons  and ˆb avalable. Then the best thng we can do s to solve ˆx ˆb exactly whch
More informationStatistical analysis using matlab. HY 439 Presented by: George Fortetsanakis
Statstcal analyss usng matlab HY 439 Presented by: George Fortetsanaks Roadmap Probablty dstrbutons Statstcal estmaton Fttng data to probablty dstrbutons Contnuous dstrbutons Contnuous random varable X
More informationSimulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests
Smulated of the Cramér-von Mses Goodness-of-Ft Tests Steele, M., Chaselng, J. and 3 Hurst, C. School of Mathematcal and Physcal Scences, James Cook Unversty, Australan School of Envronmental Studes, Grffth
More informationTime-Varying Systems and Computations Lecture 6
Tme-Varyng Systems and Computatons Lecture 6 Klaus Depold 14. Januar 2014 The Kalman Flter The Kalman estmaton flter attempts to estmate the actual state of an unknown dscrete dynamcal system, gven nosy
More informationONE DIMENSIONAL TRIANGULAR FIN EXPERIMENT. Technical Advisor: Dr. D.C. Look, Jr. Version: 11/03/00
ONE IMENSIONAL TRIANGULAR FIN EXPERIMENT Techncal Advsor: r..c. Look, Jr. Verson: /3/ 7. GENERAL OJECTIVES a) To understand a one-dmensonal epermental appromaton. b) To understand the art of epermental
More informationAnnexes. EC.1. Cycle-base move illustration. EC.2. Problem Instances
ec Annexes Ths Annex frst llustrates a cycle-based move n the dynamc-block generaton tabu search. It then dsplays the characterstcs of the nstance sets, followed by detaled results of the parametercalbraton
More informationLecture 3 Stat102, Spring 2007
Lecture 3 Stat0, Sprng 007 Chapter 3. 3.: Introducton to regresson analyss Lnear regresson as a descrptve technque The least-squares equatons Chapter 3.3 Samplng dstrbuton of b 0, b. Contnued n net lecture
More informationLecture 21: Numerical methods for pricing American type derivatives
Lecture 21: Numercal methods for prcng Amercan type dervatves Xaoguang Wang STAT 598W Aprl 10th, 2014 (STAT 598W) Lecture 21 1 / 26 Outlne 1 Fnte Dfference Method Explct Method Penalty Method (STAT 598W)
More informationMaximizing the number of nonnegative subsets
Maxmzng the number of nonnegatve subsets Noga Alon Hao Huang December 1, 213 Abstract Gven a set of n real numbers, f the sum of elements of every subset of sze larger than k s negatve, what s the maxmum
More informationPortfolios with Trading Constraints and Payout Restrictions
Portfolos wth Tradng Constrants and Payout Restrctons John R. Brge Northwestern Unversty (ont wor wth Chrs Donohue Xaodong Xu and Gongyun Zhao) 1 General Problem (Very) long-term nvestor (eample: unversty
More informationNP-Completeness : Proofs
NP-Completeness : Proofs Proof Methods A method to show a decson problem Π NP-complete s as follows. (1) Show Π NP. (2) Choose an NP-complete problem Π. (3) Show Π Π. A method to show an optmzaton problem
More informationStanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011
Stanford Unversty CS359G: Graph Parttonng and Expanders Handout 4 Luca Trevsan January 3, 0 Lecture 4 In whch we prove the dffcult drecton of Cheeger s nequalty. As n the past lectures, consder an undrected
More informationOptimal Dispatch in Electricity Markets
QUANTITATIVE FINANCE RESEARCH CENTRE QUANTITATIVE FINANCE RESEARCH CENTRE Research Paper 06 October 007 Optmal Dspatch n Electrcty Markets Vladmr Kazakov and Anatoly M Tsrln ISSN 1441-8010 www.qfrc.uts.edu.au
More informationPolynomial Regression Models
LINEAR REGRESSION ANALYSIS MODULE XII Lecture - 6 Polynomal Regresson Models Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Test of sgnfcance To test the sgnfcance
More informationEconomic dispatch solution using efficient heuristic search approach
Leonardo Journal of Scences Economc dspatch soluton usng effcent heurstc search approach Samr SAYAH QUERE Laboratory, Faculty of Technology, Electrcal Engneerng Department, Ferhat Abbas Unversty, Setf
More informationFoundations of Arithmetic
Foundatons of Arthmetc Notaton We shall denote the sum and product of numbers n the usual notaton as a 2 + a 2 + a 3 + + a = a, a 1 a 2 a 3 a = a The notaton a b means a dvdes b,.e. ac = b where c s an
More informationDifferential Evolution Algorithm with a Modified Archiving-based Adaptive Tradeoff Model for Optimal Power Flow
1 Dfferental Evoluton Algorthm wth a Modfed Archvng-based Adaptve Tradeoff Model for Optmal Power Flow 2 Outlne Search Engne Constrant Handlng Technque Test Cases and Statstcal Results 3 Roots of Dfferental
More informationLecture 20: November 7
0-725/36-725: Convex Optmzaton Fall 205 Lecturer: Ryan Tbshran Lecture 20: November 7 Scrbes: Varsha Chnnaobreddy, Joon Sk Km, Lngyao Zhang Note: LaTeX template courtesy of UC Berkeley EECS dept. Dsclamer:
More information