Roaming Behavior of Unconstrained Particles
|
|
- Diane Doyle
- 5 years ago
- Views:
Transcription
1 23 BRICS Cogress o st Computatioal BRICS Coutries Itelligece Cogress & o th Computatioal Brazilia Cogress Itelligece o Computatioal Itelligece Roamig Behavior of Ucostraied Particles AP Egelbrecht Departmet of Computer Sciece Uiversity of Pretoria Pretoria, South Africa egel@cs.up.ac.za Abstract It has bee show recetly that ucostraied particles that follow the positio ad velocity update rules of a stadard global best particle swarm optimizatio algorithm leave the boudaries of the search space withi the first few iteratios of the search process. Provided that a better solutio does ot exist outside of the search boudaries, these roamig particles are evetually pulled back withi the search boudaries. This article illustrates the cosequece of roamig particles should better solutios exist outside of the search boudaries, amely that particles are pulled outside of the search boudaries ad that such ifeasible solutios are foud. The article also evaluates the hypothesis that it is the roamig behavior of ucostraied particles that improves the ability of particle swarm algorithms to locate feasible solutios outside of the particle iitializatio space. I. INTRODUCTION Recetly, Egelbrecht [] provided empirical evidece that particles that are ot subject to ay boudary costraits leave the boudaries of the search space withi the first iteratios of the optimizatio process. The study i [] assumed that a better solutio does ot exist outside of the boudaries defied for the optimizatio problem. Uder this assumptio, it was show that particles are evetually pulled back ito the search boudaries to coverge o a feasible solutio withi the search boudaries. This behavior of ucostraied particles was referred to as roamig behavior, ad it was poited out that, although particles are pulled back ito feasible space, much computatioal effort is wasted by searchig outside of the search boudaries. While ot formally ivestigated, it was poited out i [] that this roamig behavior may result i ifeasible solutios should a better solutio exsit outside of the search boudaries ad if o boudary costrait mechaism is employed to esure feasible particle positios. This article follows o the work preseted i [] to allude to the dager of ifeasible solutios due to particle roamig behavior. Should a better solutio exist outside of the search boudaries, ucostraied particles are pulled outside of the search boudaries, due to persoal best ad the global best positios beig outside of the search boudaries. Empirical evidece of ifeasible solutios due to particle roamig behavior is provided. Note that the mai objective of this study is to emphasize the cosequeces of particle roamig behavior, so that particle swarm optimizatio (PSO) practisioers are aware of this. The aim is ot to suggest remedies to prevet roamig behavior, as may boudary costrait mechaisms exist to prevet particles from leavig the search space [2], [3], [4]. As a secod objective, this study shows that it is the roamig behavior of particles that allow particles to fid feasible solutios outside of the particle iitializatio space, but still withi the search boudaries. The first behavior is illustrated for a stadard global best (gbest) PSO [5], the guarateed covergece PSO () [6], the (CPSO) [7], [8], ad the bareboes PSO () [9]. Due to space costraits, results for the secod behavior are preseted for oly the ad the. The remaider of this paper is orgaized as follows: Sectio II provides a compact summary of the algorithms cosidered i this study. A overview of the roamig behavior of particles is provided i Sectio III. Sectio IV provides empirical evidece that ifeasible solutios are foud by ucostraied particles should better solutios exist outside of the search boudaries. Sectio V provides empirical evidece that the roamig behavior has the advatage that solutios withi bouds, but outside of the particle iitializatio space ca be foud. II. PARTICLE SWARM OPTIMIZATION ALGORITHMS The stadard PSO as itroduced by [5] implemeted oe of two eighborhood topologies: either a star topology where a particle s eigborhood is the etire swarm, or a rig eighborhood topology where a particle s eighborhood is defied by its immediate eighbors. This study cosiders PSO algorithms that use the star topology. Uder this assumptio, for the gbest PSO, particle positios x i are updated usig x i (t +)=x i (t)+v i (t +) () ad the velocities are updated usig the iertia weight model [] as follows v ij (t +) = wv ij (t)+c r j (t)[y ij (t) x ij (t)] + c 2 r 2j (t)[ŷ j (t) x ij (t)] (2) where w is the iertia weight, v ij (t) is the velocity of particle i i dimesio j =,..., x, x ij (t) is the positio of particle i i dimesio j, y ij (t) is particle i s persoal best positio i dimesio j, ŷ j (t) is the global best positio i dimesio j, c ad c 2 are positive acceleratio costats used to scale the cotributio of the cogitive ad social compoets respectively, ad r j (t),r 2j (t) U(, ) are radom values i the rage [, ], sampled from a uiform distributio /3 $3. 23 IEEE DOI.9/BRICS-CCI.&.CBIC /BRICS-CCI-CBIC
2 It is importat to ote that this study selects the global best positio as the best persoal best positio, hece usig a memory-based global best update. Particle positios are iitialized withi the give domai ad velocities are iitialized to zero []. No boudary costrait mechaism is employed for the first part of the study, i.e. to illustrate that roamig particles will fid better positios outside of the bouds if they exist. For the secod part of the study, i.e. to show that particles have the ability to fid solutios outside of the iitializatio space (but withi the boudaries), a costrait is imposed o persoal best positios: A persoal best positio is oly updated if the ew positio is better ad withi the search boudaries. Due to the memory-based global best update, this persoal best costrait guaratees that the global best postio will be feasible. The guarateed covergece PSO () developed by [6] forces the global best particle to search withi a cofied regio for a better positio, prevetig early stagatio of particles. Let τ be the idex of the global best particle, so that y τ = ŷ. chages the positio update of the global best particle to x τj (t +)=ŷ j (t)+wv τj (t)+ρ(t)( 2r 2 (t)) (3) which is obtaied usig equatio () if the velocity update of the global best particle chages to v τj (t+) = x τj (t)+ŷ j (t)+wv τj (t)+ρ(t)( 2r 2j (t)) (4) where ρ(t) is a scalig factor that determies the size of the boudig box aroud the global best particle withi which a better positio is search for [6]. Note that oly the global best particle is adjusted accordig to Equatios (3) ad (4); all other particles use Equatios () ad (2). Clerc [7] ad Clerc ad Keedy [8] developed the costrictio PSO (CPSO), where the velocity update of Equatio (2) chages to v ij (t+) = χ[v ij (t)+φ (y ij (t) x ij (t))+φ 2 (ŷ j (t) x ij (t))] (5) with the costrictio coefficiet, 2κ χ = 2 φ (6) φ(φ 4) where φ = φ + φ 2,φ = c r, ad φ 2 = c 2 r 2. Equatio (6) is used uder the costraits that φ 4 ad κ [, ]. I the (), proposed by Keedy [9], particles do ot follow search trajectories, but are sampled from a Gaussia distributio cetered aroud the average of the particle s persoal best positio ad the global best positio. If it is assumed that c = c 2, the velocity update chages to ( yij (t)+ŷ ij (t) v ij (t +) N 2 The positio update chages to ),σ,σ= y ij (t) ŷ ij (t) (7) x ij (t +)=v ij (t +) (8) III. ROAMING BEHAVIOR Helwig ad Waka [] coducted a theoretical aalysis of iitial particle swarm behavior, providig formal proofs that most particles leave the boudaries of the search space withi the first iteratios. Empirical evidece of this roamig behavior of ucostraied particles was provided by Egelbrecht [], ad the followig cosequeces of particle roamig behavior were idetified: Should a better solutio be foud outside of the defied bouds of the optimizatio problem, ad o boudary costrait mechaism employed, persoal best positios are also pulled outside the bouds of the search space. The cosequece of these ifeasible solutios is that global best positios are also pulled outside of the search space, resultig i a ifeasible optimum beig foud. If roamig particles do ot fid better solutios outside of the search space, they are evetually pulled back ito feasible space. However, this is doe over a large umber of iteratios, wastig effort searchig ifeasible space. Roamig particles have a egative ifluece o swarm diversity calculatios, sice diversity icreases as particles move further outside the bouds of the search space. This is a problem for PSO algorithms that use measures of diversity to cotrol the search trajectories of particles. A additioal cosequece of the roamig behavior of particles, as idetified i this study, is that it eables particles to locate solutios outside of the particle iitializatio space, but withi boudary costraits provided that some form of boudary costrait hadlig mechaism is employed. The focus of this study is to provide empirical evidece to illustrate the disadvatage of fidig ifeasible solutios if ucostraied particles are used ad the advatage of fidig feasible solutios outside of the iitializatio space if costraied particles are used. IV. INFEASIBLE SOLUTIONS OUTSIDE OF BOUNDARIES The purpose of this sectio is to provide empirical evidece that particles that are ot subject to a boudary costrait will fid a better, ifeasible solutio outside of the search space boudaries should such better solutio exsit. This is as a direct result of the roamig behavior of particles. Sectio IV-A summarizes the experimetal procedure, while Sectio IV-B provides ad discusses the obtaied results. A. Experimetal Procedure The cosequece of particle roamig behavior is illustrated for the,, CPSO, ad. For this purpose, bechmark fuctios have bee used as summarized i Table I. Note that the domais of these fuctios were selected to esure that better miima exist outside of the bouds. Each of the fuctios were evaluated i 3 dimesios. Shiftig a fuctio, f l, was implemeted usig f S l (x) =f l (z)+β where z = x γ ad β is a costat. Rotatio was doe usig Salomo s method [2], with z = x γm, where M is 5
3 the rotatio matrix. A ew rotatio matrix was computed for each idepedet ru of the algorithm. The rotated fuctio is referred to as fl R, computed by multiplyig the decisio vector x with the traspose of the rotatio matrix. Details for the shifts ad rotatios are as follows: Shifted rotated Ackley: A liear rotatio matrix was used with a coditio umber of, β = 4, ad γ = 32. Shifted rotated Griewak: A liear rotatio matrix was used with a coditio umber of 3, β = 8 ad γ = 6. Shifted Norwegia: β =ad γ =. Shifted Rosebrock: β = 39 ad γ = 6. Shifted Schwefel.2: β =ad γ = 5. Shifted Spherical: β = 45 ad γ = 2. For all of the algorithms, swarm sizes of 3 particles were used, ad each algorithm executed for 5 idepedet rus of 5 iteratios. The cotrol parameters were set to the same values as follows: The iertia weight was set to , while the values of the acceleratio coefficiets were set to This choice is based o [3], where it was show that such parameter settigs facilitate coverget behaviour. For the CPSO, κ =. ad c = c 2 =2.5. These values are equivalet to the iertia weight ad acceleratio coefficiet values as give above for the other PSO algorithms. B. Results ad Discussio Table II summarizes the fitess of the best solutio foud at the last iteratio ad the swarm diversity as averages ad deviatios over the 5 idepedet rus for each fuctio ad algorithm. Figures ad 2 illustrate fitess, diversity, ad percetage positio violatios for the Ackley ad Eggholder fuctios respectively. These figures are represetative of behaviors observed for the other fuctios. The first major observatio from the table ad these figures is that swarm diversity remaied very high after 5 iteratios despite the fact that the average fitess of the global best particles coverged. This observatio exlcudes the Eggholder ad Schwefel 2.26 fuctios for which a average fitess of -INF was obtaied (this is due to the fact that particles cotiue to move outside of the defied boudaries to better positios, due to the shape of these fuctios), ad a icomputable diversity. For these fuctios, particles cotiued to accelerate to positios of large egative fitess for each iteratio. Figure 2(a) shows that swarm diversity for the Eggholder fuctio exploded to extremely large values withi the first few iteratios. These large swarm diversity values are idicative of large dispersio of the particles, ad the fact that swarm diversity values are sigificatly larger tha the extet of the domais poits to the roamig behavior of particles beig pulled further away from the search boudaries. The percetage of particles that violate boudaries, for at least oe dimesio, supports this observatio. The cosequece of particle roamig is clearly illustrated i the average percetage of persoal best positios that violate boudary costraits ad the percetage of simulatios for which the global best positio violates boudary costraits. I additio to the Ackley ad Eggholder profiles, Figure 3 illustrates the global best positio violatios for the other fuctios. Note how the percetage of simulatios for which the global best positio violates boudary costraits reached % withi the first few iteratios. This also implies that all the persoal best positios will violate the boudary costraits. These results provide clear support for the observatio that particles fid better solutios outside of the search boudaries if such better solutios exist. It is iterestig to ote that oly for the Salomo fuctio did the diversity decrease over time, albeit still to a large value. For all the other fuctios, diversity cotiued to icrease, idicatig that particles were movig further away from oe aother. Note that diversity was caluclated as the average distace that particles are from the swarm ceter. V. FEASIBLE SOLUTIONS OUTSIDE OF INITIALIZATION SPACE The aim of this sectio is to illustrate that the roamig behavior of boudary costraied particles allows particles to fid feasible solutios outside of the particle iitializatio space. Sectio V-A provides the experimetal procedure, ad Sectio V-B presets ad discusses the results. A. Experimetal Procedure This sectio empirically aalyzes the ability of PSO algorithms to locate optima outside of the rage i which particle positios have bee iitialized. The hypothesis is that the roamig behavior of particles facilitate exploratio outside of the iitializatio bouds to obtai the best solutio, but still withi the problem boudaries. For the purposes of this study, persoal best positios were costraied to remai withi the problem boudaries, which will esure that global best positios are feasible due to the memory-based global best update strategy used. The algorithms used the same cotrol parameter values as give above. Oly the ad results are preseted. The ad CPSO exhibited similar behavior. The fuctios used for this study iclude the Ackley ad Salomo fuctios defied i Table I, but for domais of [ ,32.768] ad [-,] respectively. I additio to these fuctios, the fuctios defied i Table III have bee used. The rotatios for the Griewak ad Rosebrock fuctios were doe usig a radomly geerated orthoormal matrix with coditio umber of oe. All of the fuctios except the Eggholder ad Schwefel 2.26 fuctios have their global miimum at x =(,,...,), with f(x )=. The global miimum of the Schwefel 2.26 fuctio is at x = ( ,..., ), with f(x )= The global miimum of the Eggholder fuctio is located ear the maximum boudary of the search space. For all of the fuctios, except the Eggholder ad Schwefel 2.26 fuctios, the itializatio rage for particle positios were take as 5%, %, 5%,..., % of the extet of the problem domai, startig from the maximum value. For both the Eggholder ad Schwefel 2.26 fuctios, the global miimum is located close to the maximum boudary of the 6
4 Average Diversity of Best Solutio Average Particle Boudary Violatios (a) Fitess. (b) Diversity. (c) Particle Boudary Violatios Average Pbest Boudary Violatios pbest PSO (d) Persoal Best Boudary Violatios (e) Global Best Boudary Violatios Fig.. Ackley Fitess, Diversity, ad Boudary Violatio Profiles for Ifeasible Solutios Study Average Diversity of Best Solutio 5e+6 4.5e+6 4e+6 3.5e+6 3e+6 2.5e+6 2e+6.5e+6 e Average Particle Boudary Violatios Average Pbest Boudary Violatios pbest PSO (a) Diversity (b) Particle Boudary Violatios (c) Persoal Best Boudary Violatios (d) Global Best Boudary Violatios Fig. 2. Eggholder Fitess, Diversity, ad Boudary Violatio Profiles for Ifeasible Solutios Study 7
5 (a) Shifted Rotated Ackley (b) Shifted Rotated Griewak (c) Shifted Norwegia (d) Shifted Rosebrock (e) Shifted Schwefel (f) Schwefel 2.26 (g) Salomo (h) Shifted Spherical Fig. 3. Global Best Boudary Violatio Profiles for Ifeasible Solutios Study search space. That is, for the 5% iitializatio rage, for the Griewak fuctio, particles were uiformly iitialized i the rage [54, 6] 3, for the % iitializatio rage particle were uiformly iitialized i the rage [48, 6] 3, ad so o. B. Results ad Discussio Figure 4 illustrates the average best fitess obtaied over the 5 idepedet rus for the ad. Also idicated i the figures is the deviatio i best fitess over the 5 rus. For the rotated Griewak, rotated Rosebrock, Salomo, ad Schwefel.2 fuctios, both algorithms showed o sigificat differece i average best fitess over the differet iitializatio rages. For all of the iitializatio rages, the average best fitess values were very similar, with small deviatios except for the 5% iitializatio rage. For iitializatio rages less tha 5%, which exclude the global miimum, the algorithms were able to locate better solutios outside of the iitializatio rage. For the Ackley fuctio, iitializatio rages 5% to 35% showed o sigificat differece i average best fitess, at a high average value of just below 2. From iitializatio rage of 4% ad higher, solutios with a average fitess of aroud 2.5 were obtaied. The Eggholder fuctio showed a similar tred, but with performace improvig oly for larger iitializatio rages. Note that the global miimum is located close to the maximum boudary of the search space, ad that particles for small iitializatio rages are iitialized very far from the global miimum. Despite this, particles were able to locate positios of better quality outside of the iitializatio rage. The Schwefel 2.26 fuctio also has its global miimum 8
6 located close to the maximum boudary. For this fuctio all iitializatio rages resulted i good solutios, with o sigificat differece i performace. Note that iitializatio i the etire domai resulted i the worst performace, clearly idicatig success i locatig better solutios outside of iitializatio rages. The Schaffer 6 fuctio exhibited a iterestig behavior, with performace deterioratig with icrease i the iitializatio rage. The best performace was obtaied for a small iitializatio rage of 5% with iitial particle positios far from the global miimum. VI. CONCLUSIONS The mai objective of this paper was to poit out a disadvatage of the roamig behavior of particles i stadard particle swarm optimizatios. If o boudary costrait mechaism is employed, ad if a solutio of better quality exists outside of the boudaries, the roamig particles pull their persoal best positios, ad cosequetly the global best positio, outside of the boudaries ito ifeasible space, ever to retur to feasible space. The importat outcome of this observatio is that a boudary costrait mechaism has to be used to esure that a solutio withi the boudaries defied for the optimizatio problem is foud. I additio to this observatio, empirical results were preseted to show a advatage of the roamig behavior of particles, i that better positios outside of the iitializatio rage ca be obtaied. Should a boudary costrait mechaism be used, the such solutios will be feasible. This fidig shows that PSO ca obtai good solutios eve if the optimum does ot lie withi the iitializatio rage. The ability of particles to locate solutios outside of the iitializatio rage is importat for optimizatio problems that do ot have boudary costraits, such as eural etwork traiig. The roamig behavior of particles may also play a positive role i costraied optimizatio problems where pockets of feasible space exist withi ifeasible space, as roamig may aid i particles crossig ifeasible space ito feasible space. These advatages to roamig behavior will be ivestigated i future studies. Additioally, it will be iterestig to aalyze roamig behavior for evolutioary algorithms such as differetial evolutio ad evolutioary programmig. REFERENCES [] A. Egelbrecht, Particle Swarm Optimizatio: Velocity Iitializatio, i Proceedigs of the IEEE Cogress o Evolutioary Computatio. IEEE Press, 22. [2] S. Cheg, Y. Shi, ad Q. Qi, Experimetal Study o Boudary Costraits Hadlig i Particle Swarm Optimizatio: From Populatio Diversity Perspective, Iteratioal Joural of Swarm Itelligece Research, vol. 2, o. 3, pp , 2. [3] W. Chu, X. Gao, ad S. Sorooshia, Hadlig Boudary Costraits for Particle Swarm Optimizatio i High-Dimesioal Search Space, Iformatio Scieces, vol. 8, o. 2, p , 2. [4] X.-F. Xie ad D.-C. Bi, Hadlig Boudary Costraits for Numerical Optimizatio by Particle Swarm Flyig i Periodic Search Space, i Proceedigs of the IEEE Cogress o Evolutioary Computatio, vol. 2, 24, pp [5] J. Keedy ad R. Eberhart, Particle Swarm Optimizatio, i Proceedigs of the IEEE Iteratioal Joit Coferece o Neural Networks. IEEE Press, 995, pp [6] F. va de Bergh ad A. Egelbrecht, A New Locally Coverget Particle Swarm Optimizer, i Proceedigs of the IEEE Iteratioal Coferece o Systems, Ma, ad Cyberetics. IEEE Press, 22, pp. 96. [7] M. Clerc, The Swarm ad the Quee: Towards a Determiistic ad Adaptive Particle Swarm Optimizatio, i Proceedigs of the IEEE Cogress o Evolutioary Computatio, vol. 3, July 999, pp [8] M. Clerc ad J. Keedy, The Particle Swarm-Explosio, Stability, ad Covergece i a Multidimesioal Complex Space, IEEE Trasactios o Evolutioary Computatio, vol. 6, o., pp , 22. [9] J. Keedy, Bare Boes Particle Swarms, i Proceedigs of the IEEE Swarm Itelligece Symposium. IEEE Press, April 23, pp [] Y. Shi ad R. Eberhart, A modified particle swarm optimizer, i Proceedigs of the IEEE Cogress o Evolutioary Computatio. IEEE, 998, pp [] S. Helwig ad R. Waka, Theoretical Aalysis of Iitial Particle Swarm Behavior, i Proceedigs of the Teth Iteratioal Coferece o Parallel Problem Solvig from Nature, 28, pp [2] R. Salomo, Reevaluatig geetic algorithm performace uder coordiate rotatio of bechmark fuctios, BioSystems, vol. 39, pp , 996. [3] R. Eberhart ad Y. Shi, Comparig Iertia Weights ad Costrictio Factors i Particle Swarm Optimizatio, i Proceedigs of the IEEE Cogress o Evolutioary Computatio, vol., July 2, pp
7 (a) Ackley (b) Eggholder (c) Rotated Griewak (d) Rotated Rosebrock 3 25 (e) Salomo (f) Schaffer (g) Schwefel (h) Schwefel 2.26 Fig. 4. Global Best Boudary Violatio Profiles for Ifeasible Solutios Study Fuctio Domai Fuctio Defiitio.2 Ackley [,32.768] f(x) = 2e.2 Shifted rotated Ackley [ ,] f(x) = 2e Eggholder [-52,52] f(x) = x j= Shifted rotated Griewak [,6] f(x) =+ 4 ( Shifted Norwegia [-.,.] f(x) = x j= Shifted Rosebrock [-3,3] f(x) = x j= Shifted Schwefel.2 [,] f(x) = x Schwefel 2.26 [-5,5] f(x) = x j= Shifted Spherical [,] f(x) = x j= z2 i TABLE I BENCHMARK FUNCTIONS USED FOR INFEASIBLE SOLUTIONS STUDY x j= x2 j e x j= cos(2πx j ) +2+e x j= z2 j x e j= cos(2πz j ) ( +2+e ) (xj+ + 47) si( x j+ + x j /2+47 ) + si( x j (x j+ + 47) )( x j ) ( ) x j= z2 j x j= cos zj j ( )) cos(πzj 3) 99+zj ( (zj+ zj 2)2 +(z j ) ( 2) j ) 2 j= k= z k ( ( )) xj si x j Salomo [-,5] f 4 (x) = cos(2π x j= x2 j )+. x j= x2 j +
8 TABLE II FITNESS AND DIVERSITY RESULTS FOR INFEASIBLE SOLUTIONS STUDY Fitess Diversity Fuctio Algorithm Average Deviatio Average Deviatio Ackley.5E+ 6.93E+ 2.9E+3.3E+3.54E+ 6.68E+ 2.E+3.23E+3 CPSO.55E+ 7.E+ 2.2E+3.24E E+ 9.9E+ 6.5E E+4 Shifted -.9E+2 6.7E-2 5.8E E+3 Rotated -.9E E-2 4.5E+3 2.E+3 Ackley CPSO -.9E E E E+3 -.9E+2 4.8E E E+4 Eggholder -INF INF CPSO -INF INF Shifted -.8E+2.53E E+3 2.7E+ Rotated -.8E+2.37E E+3 3.6E+ Griewak CPSO -.8E+2.32E E E+ -.8E+2.2E E E+ Shifted -4.43E E+34.4E E+39 Norwegia -2.27E+.6E+.55E+6.9E+7 CPSO -4.72E E E E+23 -INF -.5E E+24 Shifted 4.44E+2.6E E+3 4.3E+2 Rosebrock 4.83E+2.77E E+3 3.9E+2 CPSO 4.7E E+2 9.6E+3.23E E+2 5.7E+2.25E+4 9.6E+3 Salomo 6.32E- 3.8E-.82E+2.E E- 2.73E-.9E E+ CPSO 5.8E- 2.57E-.67E E+ 3.64E-.38E-.E+2 4.8E+ Shifted 5.78E-8.3E E+3.75E- Schwefel E E E E- CPSO 7.82E-8.79E E+3 4.8E-.39E-.57E- 7.99E+3.7E+2 Schwefel 2.6 -INF INF CPSO -INF INF Shifted -4.5E+2.37E-3 3.8E+3.7E-6 Spherical -4.5E+2 7.3E-4 3.8E+3.83E-6 CPSO -4.5E+2 4.8E-4 3.8E+3.78E-6-4.5E E-4 3.8E+3.44E-6 TABLE III BENCHMARK FUNCTIONS USED FOR FEASIBLE SOLUTIONS STUDY Fuctio Domai Fuctio Defiitio ( ) Rotated Griewak [-6,6] f(x) =+ x 4 j= z2 j x j= cos zj j Rotated Rosebrock [-,] f(x) = x ( (zj+ z 2 j= j )2 +(z j ) 2) ( ) Schaffer 6 [-,] f(x) = x.5+ si2 (x 2 j +x2 j+ ).5 j= (+.(x 2 j +x2 j+ ))2 Schwefel.2 [-,] f(x) = x ( j ) 2 j= k= x k
Definitions and Theorems. where x are the decision variables. c, b, and a are constant coefficients.
Defiitios ad Theorems Remember the scalar form of the liear programmig problem, Miimize, Subject to, f(x) = c i x i a 1i x i = b 1 a mi x i = b m x i 0 i = 1,2,, where x are the decisio variables. c, b,
More information62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +
62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of
More informationTHE SOLUTION OF NONLINEAR EQUATIONS f( x ) = 0.
THE SOLUTION OF NONLINEAR EQUATIONS f( ) = 0. Noliear Equatio Solvers Bracketig. Graphical. Aalytical Ope Methods Bisectio False Positio (Regula-Falsi) Fied poit iteratio Newto Raphso Secat The root of
More informationElectricity consumption forecasting method based on MPSO-BP neural network model Youshan Zhang 1, 2,a, Liangdong Guo2, b,qi Li 3, c and Junhui Li2, d
4th Iteratioal Coferece o Electrical & Electroics Egieerig ad Computer Sciece (ICEEECS 2016) Electricity cosumptio forecastig method based o eural etwork model Yousha Zhag 1, 2,a, Liagdog Guo2, b,qi Li
More informationVector Quantization: a Limiting Case of EM
. Itroductio & defiitios Assume that you are give a data set X = { x j }, j { 2,,, }, of d -dimesioal vectors. The vector quatizatio (VQ) problem requires that we fid a set of prototype vectors Z = { z
More informationIntroduction to Machine Learning DIS10
CS 189 Fall 017 Itroductio to Machie Learig DIS10 1 Fu with Lagrage Multipliers (a) Miimize the fuctio such that f (x,y) = x + y x + y = 3. Solutio: The Lagragia is: L(x,y,λ) = x + y + λ(x + y 3) Takig
More informationA New Recursion for Space-Filling Geometric Fractals
A New Recursio for Space-Fillig Geometric Fractals Joh Shier Abstract. A recursive two-dimesioal geometric fractal costructio based upo area ad perimeter is described. For circles the radius of the ext
More informationsubject to A 1 x + A 2 y b x j 0, j = 1,,n 1 y j = 0 or 1, j = 1,,n 2
Additioal Brach ad Boud Algorithms 0-1 Mixed-Iteger Liear Programmig The brach ad boud algorithm described i the previous sectios ca be used to solve virtually all optimizatio problems cotaiig iteger variables,
More informationParticle Swarm Optimization for Absolute Value Equations
Joural of Computatioal Iformatio Systems 6:7(00) 359-366 Available at http://wwwjofciscom Particle Swarm Optimizatio for Absolute Value Equatios Logqua YONG Departmet of Mathematics, Shaaxi Uiversity of
More informationA proposed discrete distribution for the statistical modeling of
It. Statistical Ist.: Proc. 58th World Statistical Cogress, 0, Dubli (Sessio CPS047) p.5059 A proposed discrete distributio for the statistical modelig of Likert data Kidd, Marti Cetre for Statistical
More informationResearch Article A Novel Artificial Bee Colony Algorithm for Function Optimization
Mathematical Problems i Egieerig Volume 2015, Article ID 129271, 10 pages http://dx.doi.org/10.1155/2015/129271 Research Article A Novel Artificial Bee Coloy Algorithm for Fuctio Optimizatio Sog Zhag ad
More informationIP Reference guide for integer programming formulations.
IP Referece guide for iteger programmig formulatios. by James B. Orli for 15.053 ad 15.058 This documet is iteded as a compact (or relatively compact) guide to the formulatio of iteger programs. For more
More information1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a real-valued radom variable
More informationECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015
ECE 8527: Itroductio to Machie Learig ad Patter Recogitio Midterm # 1 Vaishali Ami Fall, 2015 tue39624@temple.edu Problem No. 1: Cosider a two-class discrete distributio problem: ω 1 :{[0,0], [2,0], [2,2],
More informationOptimally Sparse SVMs
A. Proof of Lemma 3. We here prove a lower boud o the umber of support vectors to achieve geeralizatio bouds of the form which we cosider. Importatly, this result holds ot oly for liear classifiers, but
More informationOptimization Methods MIT 2.098/6.255/ Final exam
Optimizatio Methods MIT 2.098/6.255/15.093 Fial exam Date Give: December 19th, 2006 P1. [30 pts] Classify the followig statemets as true or false. All aswers must be well-justified, either through a short
More informationMarkov Decision Processes
Markov Decisio Processes Defiitios; Statioary policies; Value improvemet algorithm, Policy improvemet algorithm, ad liear programmig for discouted cost ad average cost criteria. Markov Decisio Processes
More informationMath 113 Exam 3 Practice
Math Exam Practice Exam 4 will cover.-., 0. ad 0.. Note that eve though. was tested i exam, questios from that sectios may also be o this exam. For practice problems o., refer to the last review. This
More informationw (1) ˆx w (1) x (1) /ρ and w (2) ˆx w (2) x (2) /ρ.
2 5. Weighted umber of late jobs 5.1. Release dates ad due dates: maximimizig the weight of o-time jobs Oce we add release dates, miimizig the umber of late jobs becomes a sigificatly harder problem. For
More informationTEACHER CERTIFICATION STUDY GUIDE
COMPETENCY 1. ALGEBRA SKILL 1.1 1.1a. ALGEBRAIC STRUCTURES Kow why the real ad complex umbers are each a field, ad that particular rigs are ot fields (e.g., itegers, polyomial rigs, matrix rigs) Algebra
More informationMath 312 Lecture Notes One Dimensional Maps
Math 312 Lecture Notes Oe Dimesioal Maps Warre Weckesser Departmet of Mathematics Colgate Uiversity 21-23 February 25 A Example We begi with the simplest model of populatio growth. Suppose, for example,
More informationThe picture in figure 1.1 helps us to see that the area represents the distance traveled. Figure 1: Area represents distance travelled
1 Lecture : Area Area ad distace traveled Approximatig area by rectagles Summatio The area uder a parabola 1.1 Area ad distace Suppose we have the followig iformatio about the velocity of a particle, how
More informationMachine Learning Brett Bernstein
Machie Learig Brett Berstei Week 2 Lecture: Cocept Check Exercises Starred problems are optioal. Excess Risk Decompositio 1. Let X = Y = {1, 2,..., 10}, A = {1,..., 10, 11} ad suppose the data distributio
More information(c) Write, but do not evaluate, an integral expression for the volume of the solid generated when R is
Calculus BC Fial Review Name: Revised 7 EXAM Date: Tuesday, May 9 Remiders:. Put ew batteries i your calculator. Make sure your calculator is i RADIAN mode.. Get a good ight s sleep. Eat breakfast. Brig:
More informationThe Simplex algorithm: Introductory example. The Simplex algorithm: Introductory example (2)
Discrete Mathematics for Bioiformatics WS 07/08, G. W. Klau, 23. Oktober 2007, 12:21 1 The Simplex algorithm: Itroductory example The followig itroductio to the Simplex algorithm is from the book Liear
More informationShort Term Load Forecasting Using Artificial Neural Network And Imperialist Competitive Algorithm
Short Term Load Forecastig Usig Artificial eural etwork Ad Imperialist Competitive Algorithm Mostafa Salamat, Mostafa_salamat63@yahoo.com Javad Mousavi, jmousavi.sh1365@gmail.com Seyed Hamid Shah Alami,
More informationAn Effective Biogeography Based Optimization Algorithm to Slove Economic Load Dispatch Problem
Joural of Computer Sciece 8 (9): 482-486, 202 ISSN 549-3636 202 Sciece Publicatios A Effective Biogeography Based Optimizatio Algorithm to Slove Ecoomic Load Dispatch Problem Vaitha, M. ad 2 K. Thaushkodi
More informationKinetics of Complex Reactions
Kietics of Complex Reactios by Flick Colema Departmet of Chemistry Wellesley College Wellesley MA 28 wcolema@wellesley.edu Copyright Flick Colema 996. All rights reserved. You are welcome to use this documet
More informationChapter 9: Numerical Differentiation
178 Chapter 9: Numerical Differetiatio Numerical Differetiatio Formulatio of equatios for physical problems ofte ivolve derivatives (rate-of-chage quatities, such as velocity ad acceleratio). Numerical
More informationInfinite Sequences and Series
Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet
More informationAn Alternative Scaling Factor In Broyden s Class Methods for Unconstrained Optimization
Joural of Mathematics ad Statistics 6 (): 63-67, 00 ISSN 549-3644 00 Sciece Publicatios A Alterative Scalig Factor I Broyde s Class Methods for Ucostraied Optimizatio Muhammad Fauzi bi Embog, Mustafa bi
More informationBenchmark Fitness Landscape Analysis
Bechmark Fitess Ladscape Aalysis Galia Merkuryeva, Vitalijs Bolshakovs Departmet of Modellig ad Simulatio Riga Techical Uiversity Riga, Latvia e-mail: galia.merkurjeva@rtu.lv; vitalijs.bolsakovs@rtu.lv
More informationENGI 4421 Confidence Intervals (Two Samples) Page 12-01
ENGI 44 Cofidece Itervals (Two Samples) Page -0 Two Sample Cofidece Iterval for a Differece i Populatio Meas [Navidi sectios 5.4-5.7; Devore chapter 9] From the cetral limit theorem, we kow that, for sufficietly
More informationDETERMINATION OF MECHANICAL PROPERTIES OF A NON- UNIFORM BEAM USING THE MEASUREMENT OF THE EXCITED LONGITUDINAL ELASTIC VIBRATIONS.
ICSV4 Cairs Australia 9- July 7 DTRMINATION OF MCHANICAL PROPRTIS OF A NON- UNIFORM BAM USING TH MASURMNT OF TH XCITD LONGITUDINAL LASTIC VIBRATIONS Pavel Aokhi ad Vladimir Gordo Departmet of the mathematics
More informationResearch Article A Swarm Optimization Genetic Algorithm Based on Quantum-Behaved Particle Swarm Optimization
Hidawi Computatioal Itelligece ad Neurosciece Volume 217, Article ID 2782679, 15 pages https://doi.org/1.1155/217/2782679 Research Article A Swarm Optimizatio Geetic Algorithm Based o Quatum-Behaved Particle
More information1 Inferential Methods for Correlation and Regression Analysis
1 Iferetial Methods for Correlatio ad Regressio Aalysis I the chapter o Correlatio ad Regressio Aalysis tools for describig bivariate cotiuous data were itroduced. The sample Pearso Correlatio Coefficiet
More informationTable 12.1: Contingency table. Feature b. 1 N 11 N 12 N 1b 2 N 21 N 22 N 2b. ... a N a1 N a2 N ab
Sectio 12 Tests of idepedece ad homogeeity I this lecture we will cosider a situatio whe our observatios are classified by two differet features ad we would like to test if these features are idepedet
More information1 Duality revisited. AM 221: Advanced Optimization Spring 2016
AM 22: Advaced Optimizatio Sprig 206 Prof. Yaro Siger Sectio 7 Wedesday, Mar. 9th Duality revisited I this sectio, we will give a slightly differet perspective o duality. optimizatio program: f(x) x R
More informationCHAPTER 10 INFINITE SEQUENCES AND SERIES
CHAPTER 10 INFINITE SEQUENCES AND SERIES 10.1 Sequeces 10.2 Ifiite Series 10.3 The Itegral Tests 10.4 Compariso Tests 10.5 The Ratio ad Root Tests 10.6 Alteratig Series: Absolute ad Coditioal Covergece
More informationA widely used display of protein shapes is based on the coordinates of the alpha carbons - - C α
Nice plottig of proteis: I A widely used display of protei shapes is based o the coordiates of the alpha carbos - - C α -s. The coordiates of the C α -s are coected by a cotiuous curve that roughly follows
More informationSECTION 1.5 : SUMMATION NOTATION + WORK WITH SEQUENCES
SECTION 1.5 : SUMMATION NOTATION + WORK WITH SEQUENCES Read Sectio 1.5 (pages 5 9) Overview I Sectio 1.5 we lear to work with summatio otatio ad formulas. We will also itroduce a brief overview of sequeces,
More informationProblem Cosider the curve give parametrically as x = si t ad y = + cos t for» t» ß: (a) Describe the path this traverses: Where does it start (whe t =
Mathematics Summer Wilso Fial Exam August 8, ANSWERS Problem 1 (a) Fid the solutio to y +x y = e x x that satisfies y() = 5 : This is already i the form we used for a first order liear differetial equatio,
More informationLecture 7: Properties of Random Samples
Lecture 7: Properties of Radom Samples 1 Cotiued From Last Class Theorem 1.1. Let X 1, X,...X be a radom sample from a populatio with mea µ ad variace σ
More informationA 2nTH ORDER LINEAR DIFFERENCE EQUATION
A 2TH ORDER LINEAR DIFFERENCE EQUATION Doug Aderso Departmet of Mathematics ad Computer Sciece, Cocordia College Moorhead, MN 56562, USA ABSTRACT: We give a formulatio of geeralized zeros ad (, )-discojugacy
More informationCHAPTER 4 BIVARIATE DISTRIBUTION EXTENSION
CHAPTER 4 BIVARIATE DISTRIBUTION EXTENSION 4. Itroductio Numerous bivariate discrete distributios have bee defied ad studied (see Mardia, 97 ad Kocherlakota ad Kocherlakota, 99) based o various methods
More informationRandom Walks on Discrete and Continuous Circles. by Jeffrey S. Rosenthal School of Mathematics, University of Minnesota, Minneapolis, MN, U.S.A.
Radom Walks o Discrete ad Cotiuous Circles by Jeffrey S. Rosethal School of Mathematics, Uiversity of Miesota, Mieapolis, MN, U.S.A. 55455 (Appeared i Joural of Applied Probability 30 (1993), 780 789.)
More informationBecause it tests for differences between multiple pairs of means in one test, it is called an omnibus test.
Math 308 Sprig 018 Classes 19 ad 0: Aalysis of Variace (ANOVA) Page 1 of 6 Itroductio ANOVA is a statistical procedure for determiig whether three or more sample meas were draw from populatios with equal
More informationECEN 655: Advanced Channel Coding Spring Lecture 7 02/04/14. Belief propagation is exact on tree-structured factor graphs.
ECEN 655: Advaced Chael Codig Sprig 014 Prof. Hery Pfister Lecture 7 0/04/14 Scribe: Megke Lia 1 4-Cycles i Gallager s Esemble What we already kow: Belief propagatio is exact o tree-structured factor graphs.
More informationA statistical method to determine sample size to estimate characteristic value of soil parameters
A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig
More informationDifferentiable Convex Functions
Differetiable Covex Fuctios The followig picture motivates Theorem 11. f ( x) f ( x) f '( x)( x x) ˆx x 1 Theorem 11 : Let f : R R be differetiable. The, f is covex o the covex set C R if, ad oly if for
More informationNewton Homotopy Solution for Nonlinear Equations Using Maple14. Abstract
Joural of Sciece ad Techology ISSN 9-860 Vol. No. December 0 Newto Homotopy Solutio for Noliear Equatios Usig Maple Nor Haim Abd. Rahma, Arsmah Ibrahim, Mohd Idris Jayes Faculty of Computer ad Mathematical
More informationFall 2013 MTH431/531 Real analysis Section Notes
Fall 013 MTH431/531 Real aalysis Sectio 8.1-8. Notes Yi Su 013.11.1 1. Defiitio of uiform covergece. We look at a sequece of fuctios f (x) ad study the coverget property. Notice we have two parameters
More informationA RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS
J. Japa Statist. Soc. Vol. 41 No. 1 2011 67 73 A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS Yoichi Nishiyama* We cosider k-sample ad chage poit problems for idepedet data i a
More informationROLL CUTTING PROBLEMS UNDER STOCHASTIC DEMAND
Pacific-Asia Joural of Mathematics, Volume 5, No., Jauary-Jue 20 ROLL CUTTING PROBLEMS UNDER STOCHASTIC DEMAND SHAKEEL JAVAID, Z. H. BAKHSHI & M. M. KHALID ABSTRACT: I this paper, the roll cuttig problem
More informationInformation-based Feature Selection
Iformatio-based Feature Selectio Farza Faria, Abbas Kazeroui, Afshi Babveyh Email: {faria,abbask,afshib}@staford.edu 1 Itroductio Feature selectio is a topic of great iterest i applicatios dealig with
More informationMixtures of Gaussians and the EM Algorithm
Mixtures of Gaussias ad the EM Algorithm CSE 6363 Machie Learig Vassilis Athitsos Computer Sciece ad Egieerig Departmet Uiversity of Texas at Arligto 1 Gaussias A popular way to estimate probability desity
More informationFastest mixing Markov chain on a path
Fastest mixig Markov chai o a path Stephe Boyd Persi Diacois Ju Su Li Xiao Revised July 2004 Abstract We ider the problem of assigig trasitio probabilities to the edges of a path, so the resultig Markov
More informationDiscrete Mathematics for CS Spring 2008 David Wagner Note 22
CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig
More informationSimilarity Solutions to Unsteady Pseudoplastic. Flow Near a Moving Wall
Iteratioal Mathematical Forum, Vol. 9, 04, o. 3, 465-475 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/0.988/imf.04.48 Similarity Solutios to Usteady Pseudoplastic Flow Near a Movig Wall W. Robi Egieerig
More informationOverview. p 2. Chapter 9. Pooled Estimate of. q = 1 p. Notation for Two Proportions. Inferences about Two Proportions. Assumptions
Chapter 9 Slide Ifereces from Two Samples 9- Overview 9- Ifereces about Two Proportios 9- Ifereces about Two Meas: Idepedet Samples 9-4 Ifereces about Matched Pairs 9-5 Comparig Variatio i Two Samples
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationNotes on iteration and Newton s method. Iteration
Notes o iteratio ad Newto s method Iteratio Iteratio meas doig somethig over ad over. I our cotet, a iteratio is a sequece of umbers, vectors, fuctios, etc. geerated by a iteratio rule of the type 1 f
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More informationScheduling under Uncertainty using MILP Sensitivity Analysis
Schedulig uder Ucertaity usig MILP Sesitivity Aalysis M. Ierapetritou ad Zheya Jia Departmet of Chemical & Biochemical Egieerig Rutgers, the State Uiversity of New Jersey Piscataway, NJ Abstract The aim
More informationCreating a logistic model Christian Jorgensen
IB Mathematics HL Type II Portfolio: Creatig a logistic model Iteratioal School of Helsigborg Christia Jorgese Creatig a logistic model Christia Jorgese IB Diploma Programme IB Mathematics HL Portfolio
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationProvläsningsexemplar / Preview TECHNICAL REPORT INTERNATIONAL SPECIAL COMMITTEE ON RADIO INTERFERENCE
TECHNICAL REPORT CISPR 16-4-3 2004 AMENDMENT 1 2006-10 INTERNATIONAL SPECIAL COMMITTEE ON RADIO INTERFERENCE Amedmet 1 Specificatio for radio disturbace ad immuity measurig apparatus ad methods Part 4-3:
More informationlim za n n = z lim a n n.
Lecture 6 Sequeces ad Series Defiitio 1 By a sequece i a set A, we mea a mappig f : N A. It is customary to deote a sequece f by {s } where, s := f(). A sequece {z } of (complex) umbers is said to be coverget
More informationLecture Notes for Analysis Class
Lecture Notes for Aalysis Class Topological Spaces A topology for a set X is a collectio T of subsets of X such that: (a) X ad the empty set are i T (b) Uios of elemets of T are i T (c) Fiite itersectios
More informationSNAP Centre Workshop. Basic Algebraic Manipulation
SNAP Cetre Workshop Basic Algebraic Maipulatio 8 Simplifyig Algebraic Expressios Whe a expressio is writte i the most compact maer possible, it is cosidered to be simplified. Not Simplified: x(x + 4x)
More informationAverage Convergence Rate of Evolutionary Algorithms
1 Average Covergece Rate of Evolutioary Algorithms Ju He ad Guagmig Li Abstract arxiv:154.8117v3 [cs.ne] 2 Ju 215 I evolutioary optimizatio, it is importat to uderstad how fast evolutioary algorithms coverge
More informationMachine Learning for Data Science (CS 4786)
Machie Learig for Data Sciece CS 4786) Lecture & 3: Pricipal Compoet Aalysis The text i black outlies high level ideas. The text i blue provides simple mathematical details to derive or get to the algorithm
More informationSubject: Differential Equations & Mathematical Modeling -III. Lesson: Power series solutions of Differential Equations. about ordinary points
Power series solutio of Differetial equatios about ordiary poits Subject: Differetial Equatios & Mathematical Modelig -III Lesso: Power series solutios of Differetial Equatios about ordiary poits Lesso
More informationWHAT IS THE PROBABILITY FUNCTION FOR LARGE TSUNAMI WAVES? ABSTRACT
WHAT IS THE PROBABILITY FUNCTION FOR LARGE TSUNAMI WAVES? Harold G. Loomis Hoolulu, HI ABSTRACT Most coastal locatios have few if ay records of tsuami wave heights obtaied over various time periods. Still
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationOPTIMAL ALGORITHMS -- SUPPLEMENTAL NOTES
OPTIMAL ALGORITHMS -- SUPPLEMENTAL NOTES Peter M. Maurer Why Hashig is θ(). As i biary search, hashig assumes that keys are stored i a array which is idexed by a iteger. However, hashig attempts to bypass
More informationStat 139 Homework 7 Solutions, Fall 2015
Stat 139 Homework 7 Solutios, Fall 2015 Problem 1. I class we leared that the classical simple liear regressio model assumes the followig distributio of resposes: Y i = β 0 + β 1 X i + ɛ i, i = 1,...,,
More informationUniform Strict Practical Stability Criteria for Impulsive Functional Differential Equations
Global Joural of Sciece Frotier Research Mathematics ad Decisio Scieces Volume 3 Issue Versio 0 Year 03 Type : Double Blid Peer Reviewed Iteratioal Research Joural Publisher: Global Jourals Ic (USA Olie
More informationIntroduction to Optimization Techniques. How to Solve Equations
Itroductio to Optimizatio Techiques How to Solve Equatios Iterative Methods of Optimizatio Iterative methods of optimizatio Solutio of the oliear equatios resultig form a optimizatio problem is usually
More informationWe are mainly going to be concerned with power series in x, such as. (x)} converges - that is, lims N n
Review of Power Series, Power Series Solutios A power series i x - a is a ifiite series of the form c (x a) =c +c (x a)+(x a) +... We also call this a power series cetered at a. Ex. (x+) is cetered at
More informationA NEW CLASS OF 2-STEP RATIONAL MULTISTEP METHODS
Jural Karya Asli Loreka Ahli Matematik Vol. No. (010) page 6-9. Jural Karya Asli Loreka Ahli Matematik A NEW CLASS OF -STEP RATIONAL MULTISTEP METHODS 1 Nazeeruddi Yaacob Teh Yua Yig Norma Alias 1 Departmet
More informationxn = x n 1 α f(xn 1 + β n) f(xn 1 β n)
Proceedigs of the 005 Witer Simulatio Coferece M E Kuhl, N M Steiger, F B Armstrog, ad J A Joies, eds BALANCING BIAS AND VARIANCE IN THE OPTIMIZATION OF SIMULATION MODELS Christie SM Currie School of Mathematics
More informationMonte Carlo Optimization to Solve a Two-Dimensional Inverse Heat Conduction Problem
Australia Joural of Basic Applied Scieces, 5(): 097-05, 0 ISSN 99-878 Mote Carlo Optimizatio to Solve a Two-Dimesioal Iverse Heat Coductio Problem M Ebrahimi Departmet of Mathematics, Karaj Brach, Islamic
More information1 Adiabatic and diabatic representations
1 Adiabatic ad diabatic represetatios 1.1 Bor-Oppeheimer approximatio The time-idepedet Schrödiger equatio for both electroic ad uclear degrees of freedom is Ĥ Ψ(r, R) = E Ψ(r, R), (1) where the full molecular
More informationRecurrence Relations
Recurrece Relatios Aalysis of recursive algorithms, such as: it factorial (it ) { if (==0) retur ; else retur ( * factorial(-)); } Let t be the umber of multiplicatios eeded to calculate factorial(). The
More informationPrinciple Of Superposition
ecture 5: PREIMINRY CONCEP O RUCUR NYI Priciple Of uperpositio Mathematically, the priciple of superpositio is stated as ( a ) G( a ) G( ) G a a or for a liear structural system, the respose at a give
More information6 Sample Size Calculations
6 Sample Size Calculatios Oe of the major resposibilities of a cliical trial statisticia is to aid the ivestigators i determiig the sample size required to coduct a study The most commo procedure for determiig
More informationLinear Programming and the Simplex Method
Liear Programmig ad the Simplex ethod Abstract This article is a itroductio to Liear Programmig ad usig Simplex method for solvig LP problems i primal form. What is Liear Programmig? Liear Programmig is
More informationFACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures
FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 5 STATISTICS II. Mea ad stadard error of sample data. Biomial distributio. Normal distributio 4. Samplig 5. Cofidece itervals
More informationSupplemental Materials
1 Supplemetal Materials Xiagmao Chag, Rui Ta, Guoliag Xig, Zhaohui Yua, Cheyag Lu, Yixi Che, Yixia Yag This documet icludes the supplemetal materials for the paper titled Sesor Placemet Algorithms for
More informationTwo or more points can be used to describe a rigid body. This will eliminate the need to define rotational coordinates for the body!
OINTCOORDINATE FORMULATION Two or more poits ca be used to describe a rigid body. This will elimiate the eed to defie rotatioal coordiates for the body i z r i i, j r j j rimary oits: The coordiates of
More informationMath 113 Exam 4 Practice
Math Exam 4 Practice Exam 4 will cover.-.. This sheet has three sectios. The first sectio will remid you about techiques ad formulas that you should kow. The secod gives a umber of practice questios for
More informationAnalytic Continuation
Aalytic Cotiuatio The stadard example of this is give by Example Let h (z) = 1 + z + z 2 + z 3 +... kow to coverge oly for z < 1. I fact h (z) = 1/ (1 z) for such z. Yet H (z) = 1/ (1 z) is defied for
More information10-701/ Machine Learning Mid-term Exam Solution
0-70/5-78 Machie Learig Mid-term Exam Solutio Your Name: Your Adrew ID: True or False (Give oe setece explaatio) (20%). (F) For a cotiuous radom variable x ad its probability distributio fuctio p(x), it
More information7-1. Chapter 4. Part I. Sampling Distributions and Confidence Intervals
7-1 Chapter 4 Part I. Samplig Distributios ad Cofidece Itervals 1 7- Sectio 1. Samplig Distributio 7-3 Usig Statistics Statistical Iferece: Predict ad forecast values of populatio parameters... Test hypotheses
More informationMAT1026 Calculus II Basic Convergence Tests for Series
MAT026 Calculus II Basic Covergece Tests for Series Egi MERMUT 202.03.08 Dokuz Eylül Uiversity Faculty of Sciece Departmet of Mathematics İzmir/TURKEY Cotets Mootoe Covergece Theorem 2 2 Series of Real
More informationGoodness-Of-Fit For The Generalized Exponential Distribution. Abstract
Goodess-Of-Fit For The Geeralized Expoetial Distributio By Amal S. Hassa stitute of Statistical Studies & Research Cairo Uiversity Abstract Recetly a ew distributio called geeralized expoetial or expoetiated
More informationLecture 19: Convergence
Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may
More informationChapter 10: Power Series
Chapter : Power Series 57 Chapter Overview: Power Series The reaso series are part of a Calculus course is that there are fuctios which caot be itegrated. All power series, though, ca be itegrated because
More informationComputational Fluid Dynamics. Lecture 3
Computatioal Fluid Dyamics Lecture 3 Discretizatio Cotiued. A fourth order approximatio to f x ca be foud usig Taylor Series. ( + ) + ( + ) + + ( ) + ( ) = a f x x b f x x c f x d f x x e f x x f x 0 0
More information