Roaming Behavior of Unconstrained Particles

Size: px
Start display at page:

Download "Roaming Behavior of Unconstrained Particles"

Transcription

1 23 BRICS Cogress o st Computatioal BRICS Coutries Itelligece Cogress & o th Computatioal Brazilia Cogress Itelligece o Computatioal Itelligece Roamig Behavior of Ucostraied Particles AP Egelbrecht Departmet of Computer Sciece Uiversity of Pretoria Pretoria, South Africa egel@cs.up.ac.za Abstract It has bee show recetly that ucostraied particles that follow the positio ad velocity update rules of a stadard global best particle swarm optimizatio algorithm leave the boudaries of the search space withi the first few iteratios of the search process. Provided that a better solutio does ot exist outside of the search boudaries, these roamig particles are evetually pulled back withi the search boudaries. This article illustrates the cosequece of roamig particles should better solutios exist outside of the search boudaries, amely that particles are pulled outside of the search boudaries ad that such ifeasible solutios are foud. The article also evaluates the hypothesis that it is the roamig behavior of ucostraied particles that improves the ability of particle swarm algorithms to locate feasible solutios outside of the particle iitializatio space. I. INTRODUCTION Recetly, Egelbrecht [] provided empirical evidece that particles that are ot subject to ay boudary costraits leave the boudaries of the search space withi the first iteratios of the optimizatio process. The study i [] assumed that a better solutio does ot exist outside of the boudaries defied for the optimizatio problem. Uder this assumptio, it was show that particles are evetually pulled back ito the search boudaries to coverge o a feasible solutio withi the search boudaries. This behavior of ucostraied particles was referred to as roamig behavior, ad it was poited out that, although particles are pulled back ito feasible space, much computatioal effort is wasted by searchig outside of the search boudaries. While ot formally ivestigated, it was poited out i [] that this roamig behavior may result i ifeasible solutios should a better solutio exsit outside of the search boudaries ad if o boudary costrait mechaism is employed to esure feasible particle positios. This article follows o the work preseted i [] to allude to the dager of ifeasible solutios due to particle roamig behavior. Should a better solutio exist outside of the search boudaries, ucostraied particles are pulled outside of the search boudaries, due to persoal best ad the global best positios beig outside of the search boudaries. Empirical evidece of ifeasible solutios due to particle roamig behavior is provided. Note that the mai objective of this study is to emphasize the cosequeces of particle roamig behavior, so that particle swarm optimizatio (PSO) practisioers are aware of this. The aim is ot to suggest remedies to prevet roamig behavior, as may boudary costrait mechaisms exist to prevet particles from leavig the search space [2], [3], [4]. As a secod objective, this study shows that it is the roamig behavior of particles that allow particles to fid feasible solutios outside of the particle iitializatio space, but still withi the search boudaries. The first behavior is illustrated for a stadard global best (gbest) PSO [5], the guarateed covergece PSO () [6], the (CPSO) [7], [8], ad the bareboes PSO () [9]. Due to space costraits, results for the secod behavior are preseted for oly the ad the. The remaider of this paper is orgaized as follows: Sectio II provides a compact summary of the algorithms cosidered i this study. A overview of the roamig behavior of particles is provided i Sectio III. Sectio IV provides empirical evidece that ifeasible solutios are foud by ucostraied particles should better solutios exist outside of the search boudaries. Sectio V provides empirical evidece that the roamig behavior has the advatage that solutios withi bouds, but outside of the particle iitializatio space ca be foud. II. PARTICLE SWARM OPTIMIZATION ALGORITHMS The stadard PSO as itroduced by [5] implemeted oe of two eighborhood topologies: either a star topology where a particle s eigborhood is the etire swarm, or a rig eighborhood topology where a particle s eighborhood is defied by its immediate eighbors. This study cosiders PSO algorithms that use the star topology. Uder this assumptio, for the gbest PSO, particle positios x i are updated usig x i (t +)=x i (t)+v i (t +) () ad the velocities are updated usig the iertia weight model [] as follows v ij (t +) = wv ij (t)+c r j (t)[y ij (t) x ij (t)] + c 2 r 2j (t)[ŷ j (t) x ij (t)] (2) where w is the iertia weight, v ij (t) is the velocity of particle i i dimesio j =,..., x, x ij (t) is the positio of particle i i dimesio j, y ij (t) is particle i s persoal best positio i dimesio j, ŷ j (t) is the global best positio i dimesio j, c ad c 2 are positive acceleratio costats used to scale the cotributio of the cogitive ad social compoets respectively, ad r j (t),r 2j (t) U(, ) are radom values i the rage [, ], sampled from a uiform distributio /3 $3. 23 IEEE DOI.9/BRICS-CCI.&.CBIC /BRICS-CCI-CBIC

2 It is importat to ote that this study selects the global best positio as the best persoal best positio, hece usig a memory-based global best update. Particle positios are iitialized withi the give domai ad velocities are iitialized to zero []. No boudary costrait mechaism is employed for the first part of the study, i.e. to illustrate that roamig particles will fid better positios outside of the bouds if they exist. For the secod part of the study, i.e. to show that particles have the ability to fid solutios outside of the iitializatio space (but withi the boudaries), a costrait is imposed o persoal best positios: A persoal best positio is oly updated if the ew positio is better ad withi the search boudaries. Due to the memory-based global best update, this persoal best costrait guaratees that the global best postio will be feasible. The guarateed covergece PSO () developed by [6] forces the global best particle to search withi a cofied regio for a better positio, prevetig early stagatio of particles. Let τ be the idex of the global best particle, so that y τ = ŷ. chages the positio update of the global best particle to x τj (t +)=ŷ j (t)+wv τj (t)+ρ(t)( 2r 2 (t)) (3) which is obtaied usig equatio () if the velocity update of the global best particle chages to v τj (t+) = x τj (t)+ŷ j (t)+wv τj (t)+ρ(t)( 2r 2j (t)) (4) where ρ(t) is a scalig factor that determies the size of the boudig box aroud the global best particle withi which a better positio is search for [6]. Note that oly the global best particle is adjusted accordig to Equatios (3) ad (4); all other particles use Equatios () ad (2). Clerc [7] ad Clerc ad Keedy [8] developed the costrictio PSO (CPSO), where the velocity update of Equatio (2) chages to v ij (t+) = χ[v ij (t)+φ (y ij (t) x ij (t))+φ 2 (ŷ j (t) x ij (t))] (5) with the costrictio coefficiet, 2κ χ = 2 φ (6) φ(φ 4) where φ = φ + φ 2,φ = c r, ad φ 2 = c 2 r 2. Equatio (6) is used uder the costraits that φ 4 ad κ [, ]. I the (), proposed by Keedy [9], particles do ot follow search trajectories, but are sampled from a Gaussia distributio cetered aroud the average of the particle s persoal best positio ad the global best positio. If it is assumed that c = c 2, the velocity update chages to ( yij (t)+ŷ ij (t) v ij (t +) N 2 The positio update chages to ),σ,σ= y ij (t) ŷ ij (t) (7) x ij (t +)=v ij (t +) (8) III. ROAMING BEHAVIOR Helwig ad Waka [] coducted a theoretical aalysis of iitial particle swarm behavior, providig formal proofs that most particles leave the boudaries of the search space withi the first iteratios. Empirical evidece of this roamig behavior of ucostraied particles was provided by Egelbrecht [], ad the followig cosequeces of particle roamig behavior were idetified: Should a better solutio be foud outside of the defied bouds of the optimizatio problem, ad o boudary costrait mechaism employed, persoal best positios are also pulled outside the bouds of the search space. The cosequece of these ifeasible solutios is that global best positios are also pulled outside of the search space, resultig i a ifeasible optimum beig foud. If roamig particles do ot fid better solutios outside of the search space, they are evetually pulled back ito feasible space. However, this is doe over a large umber of iteratios, wastig effort searchig ifeasible space. Roamig particles have a egative ifluece o swarm diversity calculatios, sice diversity icreases as particles move further outside the bouds of the search space. This is a problem for PSO algorithms that use measures of diversity to cotrol the search trajectories of particles. A additioal cosequece of the roamig behavior of particles, as idetified i this study, is that it eables particles to locate solutios outside of the particle iitializatio space, but withi boudary costraits provided that some form of boudary costrait hadlig mechaism is employed. The focus of this study is to provide empirical evidece to illustrate the disadvatage of fidig ifeasible solutios if ucostraied particles are used ad the advatage of fidig feasible solutios outside of the iitializatio space if costraied particles are used. IV. INFEASIBLE SOLUTIONS OUTSIDE OF BOUNDARIES The purpose of this sectio is to provide empirical evidece that particles that are ot subject to a boudary costrait will fid a better, ifeasible solutio outside of the search space boudaries should such better solutio exsit. This is as a direct result of the roamig behavior of particles. Sectio IV-A summarizes the experimetal procedure, while Sectio IV-B provides ad discusses the obtaied results. A. Experimetal Procedure The cosequece of particle roamig behavior is illustrated for the,, CPSO, ad. For this purpose, bechmark fuctios have bee used as summarized i Table I. Note that the domais of these fuctios were selected to esure that better miima exist outside of the bouds. Each of the fuctios were evaluated i 3 dimesios. Shiftig a fuctio, f l, was implemeted usig f S l (x) =f l (z)+β where z = x γ ad β is a costat. Rotatio was doe usig Salomo s method [2], with z = x γm, where M is 5

3 the rotatio matrix. A ew rotatio matrix was computed for each idepedet ru of the algorithm. The rotated fuctio is referred to as fl R, computed by multiplyig the decisio vector x with the traspose of the rotatio matrix. Details for the shifts ad rotatios are as follows: Shifted rotated Ackley: A liear rotatio matrix was used with a coditio umber of, β = 4, ad γ = 32. Shifted rotated Griewak: A liear rotatio matrix was used with a coditio umber of 3, β = 8 ad γ = 6. Shifted Norwegia: β =ad γ =. Shifted Rosebrock: β = 39 ad γ = 6. Shifted Schwefel.2: β =ad γ = 5. Shifted Spherical: β = 45 ad γ = 2. For all of the algorithms, swarm sizes of 3 particles were used, ad each algorithm executed for 5 idepedet rus of 5 iteratios. The cotrol parameters were set to the same values as follows: The iertia weight was set to , while the values of the acceleratio coefficiets were set to This choice is based o [3], where it was show that such parameter settigs facilitate coverget behaviour. For the CPSO, κ =. ad c = c 2 =2.5. These values are equivalet to the iertia weight ad acceleratio coefficiet values as give above for the other PSO algorithms. B. Results ad Discussio Table II summarizes the fitess of the best solutio foud at the last iteratio ad the swarm diversity as averages ad deviatios over the 5 idepedet rus for each fuctio ad algorithm. Figures ad 2 illustrate fitess, diversity, ad percetage positio violatios for the Ackley ad Eggholder fuctios respectively. These figures are represetative of behaviors observed for the other fuctios. The first major observatio from the table ad these figures is that swarm diversity remaied very high after 5 iteratios despite the fact that the average fitess of the global best particles coverged. This observatio exlcudes the Eggholder ad Schwefel 2.26 fuctios for which a average fitess of -INF was obtaied (this is due to the fact that particles cotiue to move outside of the defied boudaries to better positios, due to the shape of these fuctios), ad a icomputable diversity. For these fuctios, particles cotiued to accelerate to positios of large egative fitess for each iteratio. Figure 2(a) shows that swarm diversity for the Eggholder fuctio exploded to extremely large values withi the first few iteratios. These large swarm diversity values are idicative of large dispersio of the particles, ad the fact that swarm diversity values are sigificatly larger tha the extet of the domais poits to the roamig behavior of particles beig pulled further away from the search boudaries. The percetage of particles that violate boudaries, for at least oe dimesio, supports this observatio. The cosequece of particle roamig is clearly illustrated i the average percetage of persoal best positios that violate boudary costraits ad the percetage of simulatios for which the global best positio violates boudary costraits. I additio to the Ackley ad Eggholder profiles, Figure 3 illustrates the global best positio violatios for the other fuctios. Note how the percetage of simulatios for which the global best positio violates boudary costraits reached % withi the first few iteratios. This also implies that all the persoal best positios will violate the boudary costraits. These results provide clear support for the observatio that particles fid better solutios outside of the search boudaries if such better solutios exist. It is iterestig to ote that oly for the Salomo fuctio did the diversity decrease over time, albeit still to a large value. For all the other fuctios, diversity cotiued to icrease, idicatig that particles were movig further away from oe aother. Note that diversity was caluclated as the average distace that particles are from the swarm ceter. V. FEASIBLE SOLUTIONS OUTSIDE OF INITIALIZATION SPACE The aim of this sectio is to illustrate that the roamig behavior of boudary costraied particles allows particles to fid feasible solutios outside of the particle iitializatio space. Sectio V-A provides the experimetal procedure, ad Sectio V-B presets ad discusses the results. A. Experimetal Procedure This sectio empirically aalyzes the ability of PSO algorithms to locate optima outside of the rage i which particle positios have bee iitialized. The hypothesis is that the roamig behavior of particles facilitate exploratio outside of the iitializatio bouds to obtai the best solutio, but still withi the problem boudaries. For the purposes of this study, persoal best positios were costraied to remai withi the problem boudaries, which will esure that global best positios are feasible due to the memory-based global best update strategy used. The algorithms used the same cotrol parameter values as give above. Oly the ad results are preseted. The ad CPSO exhibited similar behavior. The fuctios used for this study iclude the Ackley ad Salomo fuctios defied i Table I, but for domais of [ ,32.768] ad [-,] respectively. I additio to these fuctios, the fuctios defied i Table III have bee used. The rotatios for the Griewak ad Rosebrock fuctios were doe usig a radomly geerated orthoormal matrix with coditio umber of oe. All of the fuctios except the Eggholder ad Schwefel 2.26 fuctios have their global miimum at x =(,,...,), with f(x )=. The global miimum of the Schwefel 2.26 fuctio is at x = ( ,..., ), with f(x )= The global miimum of the Eggholder fuctio is located ear the maximum boudary of the search space. For all of the fuctios, except the Eggholder ad Schwefel 2.26 fuctios, the itializatio rage for particle positios were take as 5%, %, 5%,..., % of the extet of the problem domai, startig from the maximum value. For both the Eggholder ad Schwefel 2.26 fuctios, the global miimum is located close to the maximum boudary of the 6

4 Average Diversity of Best Solutio Average Particle Boudary Violatios (a) Fitess. (b) Diversity. (c) Particle Boudary Violatios Average Pbest Boudary Violatios pbest PSO (d) Persoal Best Boudary Violatios (e) Global Best Boudary Violatios Fig.. Ackley Fitess, Diversity, ad Boudary Violatio Profiles for Ifeasible Solutios Study Average Diversity of Best Solutio 5e+6 4.5e+6 4e+6 3.5e+6 3e+6 2.5e+6 2e+6.5e+6 e Average Particle Boudary Violatios Average Pbest Boudary Violatios pbest PSO (a) Diversity (b) Particle Boudary Violatios (c) Persoal Best Boudary Violatios (d) Global Best Boudary Violatios Fig. 2. Eggholder Fitess, Diversity, ad Boudary Violatio Profiles for Ifeasible Solutios Study 7

5 (a) Shifted Rotated Ackley (b) Shifted Rotated Griewak (c) Shifted Norwegia (d) Shifted Rosebrock (e) Shifted Schwefel (f) Schwefel 2.26 (g) Salomo (h) Shifted Spherical Fig. 3. Global Best Boudary Violatio Profiles for Ifeasible Solutios Study search space. That is, for the 5% iitializatio rage, for the Griewak fuctio, particles were uiformly iitialized i the rage [54, 6] 3, for the % iitializatio rage particle were uiformly iitialized i the rage [48, 6] 3, ad so o. B. Results ad Discussio Figure 4 illustrates the average best fitess obtaied over the 5 idepedet rus for the ad. Also idicated i the figures is the deviatio i best fitess over the 5 rus. For the rotated Griewak, rotated Rosebrock, Salomo, ad Schwefel.2 fuctios, both algorithms showed o sigificat differece i average best fitess over the differet iitializatio rages. For all of the iitializatio rages, the average best fitess values were very similar, with small deviatios except for the 5% iitializatio rage. For iitializatio rages less tha 5%, which exclude the global miimum, the algorithms were able to locate better solutios outside of the iitializatio rage. For the Ackley fuctio, iitializatio rages 5% to 35% showed o sigificat differece i average best fitess, at a high average value of just below 2. From iitializatio rage of 4% ad higher, solutios with a average fitess of aroud 2.5 were obtaied. The Eggholder fuctio showed a similar tred, but with performace improvig oly for larger iitializatio rages. Note that the global miimum is located close to the maximum boudary of the search space, ad that particles for small iitializatio rages are iitialized very far from the global miimum. Despite this, particles were able to locate positios of better quality outside of the iitializatio rage. The Schwefel 2.26 fuctio also has its global miimum 8

6 located close to the maximum boudary. For this fuctio all iitializatio rages resulted i good solutios, with o sigificat differece i performace. Note that iitializatio i the etire domai resulted i the worst performace, clearly idicatig success i locatig better solutios outside of iitializatio rages. The Schaffer 6 fuctio exhibited a iterestig behavior, with performace deterioratig with icrease i the iitializatio rage. The best performace was obtaied for a small iitializatio rage of 5% with iitial particle positios far from the global miimum. VI. CONCLUSIONS The mai objective of this paper was to poit out a disadvatage of the roamig behavior of particles i stadard particle swarm optimizatios. If o boudary costrait mechaism is employed, ad if a solutio of better quality exists outside of the boudaries, the roamig particles pull their persoal best positios, ad cosequetly the global best positio, outside of the boudaries ito ifeasible space, ever to retur to feasible space. The importat outcome of this observatio is that a boudary costrait mechaism has to be used to esure that a solutio withi the boudaries defied for the optimizatio problem is foud. I additio to this observatio, empirical results were preseted to show a advatage of the roamig behavior of particles, i that better positios outside of the iitializatio rage ca be obtaied. Should a boudary costrait mechaism be used, the such solutios will be feasible. This fidig shows that PSO ca obtai good solutios eve if the optimum does ot lie withi the iitializatio rage. The ability of particles to locate solutios outside of the iitializatio rage is importat for optimizatio problems that do ot have boudary costraits, such as eural etwork traiig. The roamig behavior of particles may also play a positive role i costraied optimizatio problems where pockets of feasible space exist withi ifeasible space, as roamig may aid i particles crossig ifeasible space ito feasible space. These advatages to roamig behavior will be ivestigated i future studies. Additioally, it will be iterestig to aalyze roamig behavior for evolutioary algorithms such as differetial evolutio ad evolutioary programmig. REFERENCES [] A. Egelbrecht, Particle Swarm Optimizatio: Velocity Iitializatio, i Proceedigs of the IEEE Cogress o Evolutioary Computatio. IEEE Press, 22. [2] S. Cheg, Y. Shi, ad Q. Qi, Experimetal Study o Boudary Costraits Hadlig i Particle Swarm Optimizatio: From Populatio Diversity Perspective, Iteratioal Joural of Swarm Itelligece Research, vol. 2, o. 3, pp , 2. [3] W. Chu, X. Gao, ad S. Sorooshia, Hadlig Boudary Costraits for Particle Swarm Optimizatio i High-Dimesioal Search Space, Iformatio Scieces, vol. 8, o. 2, p , 2. [4] X.-F. Xie ad D.-C. Bi, Hadlig Boudary Costraits for Numerical Optimizatio by Particle Swarm Flyig i Periodic Search Space, i Proceedigs of the IEEE Cogress o Evolutioary Computatio, vol. 2, 24, pp [5] J. Keedy ad R. Eberhart, Particle Swarm Optimizatio, i Proceedigs of the IEEE Iteratioal Joit Coferece o Neural Networks. IEEE Press, 995, pp [6] F. va de Bergh ad A. Egelbrecht, A New Locally Coverget Particle Swarm Optimizer, i Proceedigs of the IEEE Iteratioal Coferece o Systems, Ma, ad Cyberetics. IEEE Press, 22, pp. 96. [7] M. Clerc, The Swarm ad the Quee: Towards a Determiistic ad Adaptive Particle Swarm Optimizatio, i Proceedigs of the IEEE Cogress o Evolutioary Computatio, vol. 3, July 999, pp [8] M. Clerc ad J. Keedy, The Particle Swarm-Explosio, Stability, ad Covergece i a Multidimesioal Complex Space, IEEE Trasactios o Evolutioary Computatio, vol. 6, o., pp , 22. [9] J. Keedy, Bare Boes Particle Swarms, i Proceedigs of the IEEE Swarm Itelligece Symposium. IEEE Press, April 23, pp [] Y. Shi ad R. Eberhart, A modified particle swarm optimizer, i Proceedigs of the IEEE Cogress o Evolutioary Computatio. IEEE, 998, pp [] S. Helwig ad R. Waka, Theoretical Aalysis of Iitial Particle Swarm Behavior, i Proceedigs of the Teth Iteratioal Coferece o Parallel Problem Solvig from Nature, 28, pp [2] R. Salomo, Reevaluatig geetic algorithm performace uder coordiate rotatio of bechmark fuctios, BioSystems, vol. 39, pp , 996. [3] R. Eberhart ad Y. Shi, Comparig Iertia Weights ad Costrictio Factors i Particle Swarm Optimizatio, i Proceedigs of the IEEE Cogress o Evolutioary Computatio, vol., July 2, pp

7 (a) Ackley (b) Eggholder (c) Rotated Griewak (d) Rotated Rosebrock 3 25 (e) Salomo (f) Schaffer (g) Schwefel (h) Schwefel 2.26 Fig. 4. Global Best Boudary Violatio Profiles for Ifeasible Solutios Study Fuctio Domai Fuctio Defiitio.2 Ackley [,32.768] f(x) = 2e.2 Shifted rotated Ackley [ ,] f(x) = 2e Eggholder [-52,52] f(x) = x j= Shifted rotated Griewak [,6] f(x) =+ 4 ( Shifted Norwegia [-.,.] f(x) = x j= Shifted Rosebrock [-3,3] f(x) = x j= Shifted Schwefel.2 [,] f(x) = x Schwefel 2.26 [-5,5] f(x) = x j= Shifted Spherical [,] f(x) = x j= z2 i TABLE I BENCHMARK FUNCTIONS USED FOR INFEASIBLE SOLUTIONS STUDY x j= x2 j e x j= cos(2πx j ) +2+e x j= z2 j x e j= cos(2πz j ) ( +2+e ) (xj+ + 47) si( x j+ + x j /2+47 ) + si( x j (x j+ + 47) )( x j ) ( ) x j= z2 j x j= cos zj j ( )) cos(πzj 3) 99+zj ( (zj+ zj 2)2 +(z j ) ( 2) j ) 2 j= k= z k ( ( )) xj si x j Salomo [-,5] f 4 (x) = cos(2π x j= x2 j )+. x j= x2 j +

8 TABLE II FITNESS AND DIVERSITY RESULTS FOR INFEASIBLE SOLUTIONS STUDY Fitess Diversity Fuctio Algorithm Average Deviatio Average Deviatio Ackley.5E+ 6.93E+ 2.9E+3.3E+3.54E+ 6.68E+ 2.E+3.23E+3 CPSO.55E+ 7.E+ 2.2E+3.24E E+ 9.9E+ 6.5E E+4 Shifted -.9E+2 6.7E-2 5.8E E+3 Rotated -.9E E-2 4.5E+3 2.E+3 Ackley CPSO -.9E E E E+3 -.9E+2 4.8E E E+4 Eggholder -INF INF CPSO -INF INF Shifted -.8E+2.53E E+3 2.7E+ Rotated -.8E+2.37E E+3 3.6E+ Griewak CPSO -.8E+2.32E E E+ -.8E+2.2E E E+ Shifted -4.43E E+34.4E E+39 Norwegia -2.27E+.6E+.55E+6.9E+7 CPSO -4.72E E E E+23 -INF -.5E E+24 Shifted 4.44E+2.6E E+3 4.3E+2 Rosebrock 4.83E+2.77E E+3 3.9E+2 CPSO 4.7E E+2 9.6E+3.23E E+2 5.7E+2.25E+4 9.6E+3 Salomo 6.32E- 3.8E-.82E+2.E E- 2.73E-.9E E+ CPSO 5.8E- 2.57E-.67E E+ 3.64E-.38E-.E+2 4.8E+ Shifted 5.78E-8.3E E+3.75E- Schwefel E E E E- CPSO 7.82E-8.79E E+3 4.8E-.39E-.57E- 7.99E+3.7E+2 Schwefel 2.6 -INF INF CPSO -INF INF Shifted -4.5E+2.37E-3 3.8E+3.7E-6 Spherical -4.5E+2 7.3E-4 3.8E+3.83E-6 CPSO -4.5E+2 4.8E-4 3.8E+3.78E-6-4.5E E-4 3.8E+3.44E-6 TABLE III BENCHMARK FUNCTIONS USED FOR FEASIBLE SOLUTIONS STUDY Fuctio Domai Fuctio Defiitio ( ) Rotated Griewak [-6,6] f(x) =+ x 4 j= z2 j x j= cos zj j Rotated Rosebrock [-,] f(x) = x ( (zj+ z 2 j= j )2 +(z j ) 2) ( ) Schaffer 6 [-,] f(x) = x.5+ si2 (x 2 j +x2 j+ ).5 j= (+.(x 2 j +x2 j+ ))2 Schwefel.2 [-,] f(x) = x ( j ) 2 j= k= x k

Definitions and Theorems. where x are the decision variables. c, b, and a are constant coefficients.

Definitions and Theorems. where x are the decision variables. c, b, and a are constant coefficients. Defiitios ad Theorems Remember the scalar form of the liear programmig problem, Miimize, Subject to, f(x) = c i x i a 1i x i = b 1 a mi x i = b m x i 0 i = 1,2,, where x are the decisio variables. c, b,

More information

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + 62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of

More information

THE SOLUTION OF NONLINEAR EQUATIONS f( x ) = 0.

THE SOLUTION OF NONLINEAR EQUATIONS f( x ) = 0. THE SOLUTION OF NONLINEAR EQUATIONS f( ) = 0. Noliear Equatio Solvers Bracketig. Graphical. Aalytical Ope Methods Bisectio False Positio (Regula-Falsi) Fied poit iteratio Newto Raphso Secat The root of

More information

Electricity consumption forecasting method based on MPSO-BP neural network model Youshan Zhang 1, 2,a, Liangdong Guo2, b,qi Li 3, c and Junhui Li2, d

Electricity consumption forecasting method based on MPSO-BP neural network model Youshan Zhang 1, 2,a, Liangdong Guo2, b,qi Li 3, c and Junhui Li2, d 4th Iteratioal Coferece o Electrical & Electroics Egieerig ad Computer Sciece (ICEEECS 2016) Electricity cosumptio forecastig method based o eural etwork model Yousha Zhag 1, 2,a, Liagdog Guo2, b,qi Li

More information

Vector Quantization: a Limiting Case of EM

Vector Quantization: a Limiting Case of EM . Itroductio & defiitios Assume that you are give a data set X = { x j }, j { 2,,, }, of d -dimesioal vectors. The vector quatizatio (VQ) problem requires that we fid a set of prototype vectors Z = { z

More information

Introduction to Machine Learning DIS10

Introduction to Machine Learning DIS10 CS 189 Fall 017 Itroductio to Machie Learig DIS10 1 Fu with Lagrage Multipliers (a) Miimize the fuctio such that f (x,y) = x + y x + y = 3. Solutio: The Lagragia is: L(x,y,λ) = x + y + λ(x + y 3) Takig

More information

A New Recursion for Space-Filling Geometric Fractals

A New Recursion for Space-Filling Geometric Fractals A New Recursio for Space-Fillig Geometric Fractals Joh Shier Abstract. A recursive two-dimesioal geometric fractal costructio based upo area ad perimeter is described. For circles the radius of the ext

More information

subject to A 1 x + A 2 y b x j 0, j = 1,,n 1 y j = 0 or 1, j = 1,,n 2

subject to A 1 x + A 2 y b x j 0, j = 1,,n 1 y j = 0 or 1, j = 1,,n 2 Additioal Brach ad Boud Algorithms 0-1 Mixed-Iteger Liear Programmig The brach ad boud algorithm described i the previous sectios ca be used to solve virtually all optimizatio problems cotaiig iteger variables,

More information

Particle Swarm Optimization for Absolute Value Equations

Particle Swarm Optimization for Absolute Value Equations Joural of Computatioal Iformatio Systems 6:7(00) 359-366 Available at http://wwwjofciscom Particle Swarm Optimizatio for Absolute Value Equatios Logqua YONG Departmet of Mathematics, Shaaxi Uiversity of

More information

A proposed discrete distribution for the statistical modeling of

A proposed discrete distribution for the statistical modeling of It. Statistical Ist.: Proc. 58th World Statistical Cogress, 0, Dubli (Sessio CPS047) p.5059 A proposed discrete distributio for the statistical modelig of Likert data Kidd, Marti Cetre for Statistical

More information

Research Article A Novel Artificial Bee Colony Algorithm for Function Optimization

Research Article A Novel Artificial Bee Colony Algorithm for Function Optimization Mathematical Problems i Egieerig Volume 2015, Article ID 129271, 10 pages http://dx.doi.org/10.1155/2015/129271 Research Article A Novel Artificial Bee Coloy Algorithm for Fuctio Optimizatio Sog Zhag ad

More information

IP Reference guide for integer programming formulations.

IP Reference guide for integer programming formulations. IP Referece guide for iteger programmig formulatios. by James B. Orli for 15.053 ad 15.058 This documet is iteded as a compact (or relatively compact) guide to the formulatio of iteger programs. For more

More information

1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a real-valued radom variable

More information

ECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015

ECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015 ECE 8527: Itroductio to Machie Learig ad Patter Recogitio Midterm # 1 Vaishali Ami Fall, 2015 tue39624@temple.edu Problem No. 1: Cosider a two-class discrete distributio problem: ω 1 :{[0,0], [2,0], [2,2],

More information

Optimally Sparse SVMs

Optimally Sparse SVMs A. Proof of Lemma 3. We here prove a lower boud o the umber of support vectors to achieve geeralizatio bouds of the form which we cosider. Importatly, this result holds ot oly for liear classifiers, but

More information

Optimization Methods MIT 2.098/6.255/ Final exam

Optimization Methods MIT 2.098/6.255/ Final exam Optimizatio Methods MIT 2.098/6.255/15.093 Fial exam Date Give: December 19th, 2006 P1. [30 pts] Classify the followig statemets as true or false. All aswers must be well-justified, either through a short

More information

Markov Decision Processes

Markov Decision Processes Markov Decisio Processes Defiitios; Statioary policies; Value improvemet algorithm, Policy improvemet algorithm, ad liear programmig for discouted cost ad average cost criteria. Markov Decisio Processes

More information

Math 113 Exam 3 Practice

Math 113 Exam 3 Practice Math Exam Practice Exam 4 will cover.-., 0. ad 0.. Note that eve though. was tested i exam, questios from that sectios may also be o this exam. For practice problems o., refer to the last review. This

More information

w (1) ˆx w (1) x (1) /ρ and w (2) ˆx w (2) x (2) /ρ.

w (1) ˆx w (1) x (1) /ρ and w (2) ˆx w (2) x (2) /ρ. 2 5. Weighted umber of late jobs 5.1. Release dates ad due dates: maximimizig the weight of o-time jobs Oce we add release dates, miimizig the umber of late jobs becomes a sigificatly harder problem. For

More information

TEACHER CERTIFICATION STUDY GUIDE

TEACHER CERTIFICATION STUDY GUIDE COMPETENCY 1. ALGEBRA SKILL 1.1 1.1a. ALGEBRAIC STRUCTURES Kow why the real ad complex umbers are each a field, ad that particular rigs are ot fields (e.g., itegers, polyomial rigs, matrix rigs) Algebra

More information

Math 312 Lecture Notes One Dimensional Maps

Math 312 Lecture Notes One Dimensional Maps Math 312 Lecture Notes Oe Dimesioal Maps Warre Weckesser Departmet of Mathematics Colgate Uiversity 21-23 February 25 A Example We begi with the simplest model of populatio growth. Suppose, for example,

More information

The picture in figure 1.1 helps us to see that the area represents the distance traveled. Figure 1: Area represents distance travelled

The picture in figure 1.1 helps us to see that the area represents the distance traveled. Figure 1: Area represents distance travelled 1 Lecture : Area Area ad distace traveled Approximatig area by rectagles Summatio The area uder a parabola 1.1 Area ad distace Suppose we have the followig iformatio about the velocity of a particle, how

More information

Machine Learning Brett Bernstein

Machine Learning Brett Bernstein Machie Learig Brett Berstei Week 2 Lecture: Cocept Check Exercises Starred problems are optioal. Excess Risk Decompositio 1. Let X = Y = {1, 2,..., 10}, A = {1,..., 10, 11} ad suppose the data distributio

More information

(c) Write, but do not evaluate, an integral expression for the volume of the solid generated when R is

(c) Write, but do not evaluate, an integral expression for the volume of the solid generated when R is Calculus BC Fial Review Name: Revised 7 EXAM Date: Tuesday, May 9 Remiders:. Put ew batteries i your calculator. Make sure your calculator is i RADIAN mode.. Get a good ight s sleep. Eat breakfast. Brig:

More information

The Simplex algorithm: Introductory example. The Simplex algorithm: Introductory example (2)

The Simplex algorithm: Introductory example. The Simplex algorithm: Introductory example (2) Discrete Mathematics for Bioiformatics WS 07/08, G. W. Klau, 23. Oktober 2007, 12:21 1 The Simplex algorithm: Itroductory example The followig itroductio to the Simplex algorithm is from the book Liear

More information

Short Term Load Forecasting Using Artificial Neural Network And Imperialist Competitive Algorithm

Short Term Load Forecasting Using Artificial Neural Network And Imperialist Competitive Algorithm Short Term Load Forecastig Usig Artificial eural etwork Ad Imperialist Competitive Algorithm Mostafa Salamat, Mostafa_salamat63@yahoo.com Javad Mousavi, jmousavi.sh1365@gmail.com Seyed Hamid Shah Alami,

More information

An Effective Biogeography Based Optimization Algorithm to Slove Economic Load Dispatch Problem

An Effective Biogeography Based Optimization Algorithm to Slove Economic Load Dispatch Problem Joural of Computer Sciece 8 (9): 482-486, 202 ISSN 549-3636 202 Sciece Publicatios A Effective Biogeography Based Optimizatio Algorithm to Slove Ecoomic Load Dispatch Problem Vaitha, M. ad 2 K. Thaushkodi

More information

Kinetics of Complex Reactions

Kinetics of Complex Reactions Kietics of Complex Reactios by Flick Colema Departmet of Chemistry Wellesley College Wellesley MA 28 wcolema@wellesley.edu Copyright Flick Colema 996. All rights reserved. You are welcome to use this documet

More information

Chapter 9: Numerical Differentiation

Chapter 9: Numerical Differentiation 178 Chapter 9: Numerical Differetiatio Numerical Differetiatio Formulatio of equatios for physical problems ofte ivolve derivatives (rate-of-chage quatities, such as velocity ad acceleratio). Numerical

More information

Infinite Sequences and Series

Infinite Sequences and Series Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet

More information

An Alternative Scaling Factor In Broyden s Class Methods for Unconstrained Optimization

An Alternative Scaling Factor In Broyden s Class Methods for Unconstrained Optimization Joural of Mathematics ad Statistics 6 (): 63-67, 00 ISSN 549-3644 00 Sciece Publicatios A Alterative Scalig Factor I Broyde s Class Methods for Ucostraied Optimizatio Muhammad Fauzi bi Embog, Mustafa bi

More information

Benchmark Fitness Landscape Analysis

Benchmark Fitness Landscape Analysis Bechmark Fitess Ladscape Aalysis Galia Merkuryeva, Vitalijs Bolshakovs Departmet of Modellig ad Simulatio Riga Techical Uiversity Riga, Latvia e-mail: galia.merkurjeva@rtu.lv; vitalijs.bolsakovs@rtu.lv

More information

ENGI 4421 Confidence Intervals (Two Samples) Page 12-01

ENGI 4421 Confidence Intervals (Two Samples) Page 12-01 ENGI 44 Cofidece Itervals (Two Samples) Page -0 Two Sample Cofidece Iterval for a Differece i Populatio Meas [Navidi sectios 5.4-5.7; Devore chapter 9] From the cetral limit theorem, we kow that, for sufficietly

More information

DETERMINATION OF MECHANICAL PROPERTIES OF A NON- UNIFORM BEAM USING THE MEASUREMENT OF THE EXCITED LONGITUDINAL ELASTIC VIBRATIONS.

DETERMINATION OF MECHANICAL PROPERTIES OF A NON- UNIFORM BEAM USING THE MEASUREMENT OF THE EXCITED LONGITUDINAL ELASTIC VIBRATIONS. ICSV4 Cairs Australia 9- July 7 DTRMINATION OF MCHANICAL PROPRTIS OF A NON- UNIFORM BAM USING TH MASURMNT OF TH XCITD LONGITUDINAL LASTIC VIBRATIONS Pavel Aokhi ad Vladimir Gordo Departmet of the mathematics

More information

Research Article A Swarm Optimization Genetic Algorithm Based on Quantum-Behaved Particle Swarm Optimization

Research Article A Swarm Optimization Genetic Algorithm Based on Quantum-Behaved Particle Swarm Optimization Hidawi Computatioal Itelligece ad Neurosciece Volume 217, Article ID 2782679, 15 pages https://doi.org/1.1155/217/2782679 Research Article A Swarm Optimizatio Geetic Algorithm Based o Quatum-Behaved Particle

More information

1 Inferential Methods for Correlation and Regression Analysis

1 Inferential Methods for Correlation and Regression Analysis 1 Iferetial Methods for Correlatio ad Regressio Aalysis I the chapter o Correlatio ad Regressio Aalysis tools for describig bivariate cotiuous data were itroduced. The sample Pearso Correlatio Coefficiet

More information

Table 12.1: Contingency table. Feature b. 1 N 11 N 12 N 1b 2 N 21 N 22 N 2b. ... a N a1 N a2 N ab

Table 12.1: Contingency table. Feature b. 1 N 11 N 12 N 1b 2 N 21 N 22 N 2b. ... a N a1 N a2 N ab Sectio 12 Tests of idepedece ad homogeeity I this lecture we will cosider a situatio whe our observatios are classified by two differet features ad we would like to test if these features are idepedet

More information

1 Duality revisited. AM 221: Advanced Optimization Spring 2016

1 Duality revisited. AM 221: Advanced Optimization Spring 2016 AM 22: Advaced Optimizatio Sprig 206 Prof. Yaro Siger Sectio 7 Wedesday, Mar. 9th Duality revisited I this sectio, we will give a slightly differet perspective o duality. optimizatio program: f(x) x R

More information

CHAPTER 10 INFINITE SEQUENCES AND SERIES

CHAPTER 10 INFINITE SEQUENCES AND SERIES CHAPTER 10 INFINITE SEQUENCES AND SERIES 10.1 Sequeces 10.2 Ifiite Series 10.3 The Itegral Tests 10.4 Compariso Tests 10.5 The Ratio ad Root Tests 10.6 Alteratig Series: Absolute ad Coditioal Covergece

More information

A widely used display of protein shapes is based on the coordinates of the alpha carbons - - C α

A widely used display of protein shapes is based on the coordinates of the alpha carbons - - C α Nice plottig of proteis: I A widely used display of protei shapes is based o the coordiates of the alpha carbos - - C α -s. The coordiates of the C α -s are coected by a cotiuous curve that roughly follows

More information

SECTION 1.5 : SUMMATION NOTATION + WORK WITH SEQUENCES

SECTION 1.5 : SUMMATION NOTATION + WORK WITH SEQUENCES SECTION 1.5 : SUMMATION NOTATION + WORK WITH SEQUENCES Read Sectio 1.5 (pages 5 9) Overview I Sectio 1.5 we lear to work with summatio otatio ad formulas. We will also itroduce a brief overview of sequeces,

More information

Problem Cosider the curve give parametrically as x = si t ad y = + cos t for» t» ß: (a) Describe the path this traverses: Where does it start (whe t =

Problem Cosider the curve give parametrically as x = si t ad y = + cos t for» t» ß: (a) Describe the path this traverses: Where does it start (whe t = Mathematics Summer Wilso Fial Exam August 8, ANSWERS Problem 1 (a) Fid the solutio to y +x y = e x x that satisfies y() = 5 : This is already i the form we used for a first order liear differetial equatio,

More information

Lecture 7: Properties of Random Samples

Lecture 7: Properties of Random Samples Lecture 7: Properties of Radom Samples 1 Cotiued From Last Class Theorem 1.1. Let X 1, X,...X be a radom sample from a populatio with mea µ ad variace σ

More information

A 2nTH ORDER LINEAR DIFFERENCE EQUATION

A 2nTH ORDER LINEAR DIFFERENCE EQUATION A 2TH ORDER LINEAR DIFFERENCE EQUATION Doug Aderso Departmet of Mathematics ad Computer Sciece, Cocordia College Moorhead, MN 56562, USA ABSTRACT: We give a formulatio of geeralized zeros ad (, )-discojugacy

More information

CHAPTER 4 BIVARIATE DISTRIBUTION EXTENSION

CHAPTER 4 BIVARIATE DISTRIBUTION EXTENSION CHAPTER 4 BIVARIATE DISTRIBUTION EXTENSION 4. Itroductio Numerous bivariate discrete distributios have bee defied ad studied (see Mardia, 97 ad Kocherlakota ad Kocherlakota, 99) based o various methods

More information

Random Walks on Discrete and Continuous Circles. by Jeffrey S. Rosenthal School of Mathematics, University of Minnesota, Minneapolis, MN, U.S.A.

Random Walks on Discrete and Continuous Circles. by Jeffrey S. Rosenthal School of Mathematics, University of Minnesota, Minneapolis, MN, U.S.A. Radom Walks o Discrete ad Cotiuous Circles by Jeffrey S. Rosethal School of Mathematics, Uiversity of Miesota, Mieapolis, MN, U.S.A. 55455 (Appeared i Joural of Applied Probability 30 (1993), 780 789.)

More information

Because it tests for differences between multiple pairs of means in one test, it is called an omnibus test.

Because it tests for differences between multiple pairs of means in one test, it is called an omnibus test. Math 308 Sprig 018 Classes 19 ad 0: Aalysis of Variace (ANOVA) Page 1 of 6 Itroductio ANOVA is a statistical procedure for determiig whether three or more sample meas were draw from populatios with equal

More information

ECEN 655: Advanced Channel Coding Spring Lecture 7 02/04/14. Belief propagation is exact on tree-structured factor graphs.

ECEN 655: Advanced Channel Coding Spring Lecture 7 02/04/14. Belief propagation is exact on tree-structured factor graphs. ECEN 655: Advaced Chael Codig Sprig 014 Prof. Hery Pfister Lecture 7 0/04/14 Scribe: Megke Lia 1 4-Cycles i Gallager s Esemble What we already kow: Belief propagatio is exact o tree-structured factor graphs.

More information

A statistical method to determine sample size to estimate characteristic value of soil parameters

A statistical method to determine sample size to estimate characteristic value of soil parameters A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig

More information

Differentiable Convex Functions

Differentiable Convex Functions Differetiable Covex Fuctios The followig picture motivates Theorem 11. f ( x) f ( x) f '( x)( x x) ˆx x 1 Theorem 11 : Let f : R R be differetiable. The, f is covex o the covex set C R if, ad oly if for

More information

Newton Homotopy Solution for Nonlinear Equations Using Maple14. Abstract

Newton Homotopy Solution for Nonlinear Equations Using Maple14. Abstract Joural of Sciece ad Techology ISSN 9-860 Vol. No. December 0 Newto Homotopy Solutio for Noliear Equatios Usig Maple Nor Haim Abd. Rahma, Arsmah Ibrahim, Mohd Idris Jayes Faculty of Computer ad Mathematical

More information

Fall 2013 MTH431/531 Real analysis Section Notes

Fall 2013 MTH431/531 Real analysis Section Notes Fall 013 MTH431/531 Real aalysis Sectio 8.1-8. Notes Yi Su 013.11.1 1. Defiitio of uiform covergece. We look at a sequece of fuctios f (x) ad study the coverget property. Notice we have two parameters

More information

A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS

A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS J. Japa Statist. Soc. Vol. 41 No. 1 2011 67 73 A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS Yoichi Nishiyama* We cosider k-sample ad chage poit problems for idepedet data i a

More information

ROLL CUTTING PROBLEMS UNDER STOCHASTIC DEMAND

ROLL CUTTING PROBLEMS UNDER STOCHASTIC DEMAND Pacific-Asia Joural of Mathematics, Volume 5, No., Jauary-Jue 20 ROLL CUTTING PROBLEMS UNDER STOCHASTIC DEMAND SHAKEEL JAVAID, Z. H. BAKHSHI & M. M. KHALID ABSTRACT: I this paper, the roll cuttig problem

More information

Information-based Feature Selection

Information-based Feature Selection Iformatio-based Feature Selectio Farza Faria, Abbas Kazeroui, Afshi Babveyh Email: {faria,abbask,afshib}@staford.edu 1 Itroductio Feature selectio is a topic of great iterest i applicatios dealig with

More information

Mixtures of Gaussians and the EM Algorithm

Mixtures of Gaussians and the EM Algorithm Mixtures of Gaussias ad the EM Algorithm CSE 6363 Machie Learig Vassilis Athitsos Computer Sciece ad Egieerig Departmet Uiversity of Texas at Arligto 1 Gaussias A popular way to estimate probability desity

More information

Fastest mixing Markov chain on a path

Fastest mixing Markov chain on a path Fastest mixig Markov chai o a path Stephe Boyd Persi Diacois Ju Su Li Xiao Revised July 2004 Abstract We ider the problem of assigig trasitio probabilities to the edges of a path, so the resultig Markov

More information

Discrete Mathematics for CS Spring 2008 David Wagner Note 22

Discrete Mathematics for CS Spring 2008 David Wagner Note 22 CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig

More information

Similarity Solutions to Unsteady Pseudoplastic. Flow Near a Moving Wall

Similarity Solutions to Unsteady Pseudoplastic. Flow Near a Moving Wall Iteratioal Mathematical Forum, Vol. 9, 04, o. 3, 465-475 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/0.988/imf.04.48 Similarity Solutios to Usteady Pseudoplastic Flow Near a Movig Wall W. Robi Egieerig

More information

Overview. p 2. Chapter 9. Pooled Estimate of. q = 1 p. Notation for Two Proportions. Inferences about Two Proportions. Assumptions

Overview. p 2. Chapter 9. Pooled Estimate of. q = 1 p. Notation for Two Proportions. Inferences about Two Proportions. Assumptions Chapter 9 Slide Ifereces from Two Samples 9- Overview 9- Ifereces about Two Proportios 9- Ifereces about Two Meas: Idepedet Samples 9-4 Ifereces about Matched Pairs 9-5 Comparig Variatio i Two Samples

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

Notes on iteration and Newton s method. Iteration

Notes on iteration and Newton s method. Iteration Notes o iteratio ad Newto s method Iteratio Iteratio meas doig somethig over ad over. I our cotet, a iteratio is a sequece of umbers, vectors, fuctios, etc. geerated by a iteratio rule of the type 1 f

More information

Random Variables, Sampling and Estimation

Random Variables, Sampling and Estimation Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig

More information

Scheduling under Uncertainty using MILP Sensitivity Analysis

Scheduling under Uncertainty using MILP Sensitivity Analysis Schedulig uder Ucertaity usig MILP Sesitivity Aalysis M. Ierapetritou ad Zheya Jia Departmet of Chemical & Biochemical Egieerig Rutgers, the State Uiversity of New Jersey Piscataway, NJ Abstract The aim

More information

Creating a logistic model Christian Jorgensen

Creating a logistic model Christian Jorgensen IB Mathematics HL Type II Portfolio: Creatig a logistic model Iteratioal School of Helsigborg Christia Jorgese Creatig a logistic model Christia Jorgese IB Diploma Programme IB Mathematics HL Portfolio

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

Provläsningsexemplar / Preview TECHNICAL REPORT INTERNATIONAL SPECIAL COMMITTEE ON RADIO INTERFERENCE

Provläsningsexemplar / Preview TECHNICAL REPORT INTERNATIONAL SPECIAL COMMITTEE ON RADIO INTERFERENCE TECHNICAL REPORT CISPR 16-4-3 2004 AMENDMENT 1 2006-10 INTERNATIONAL SPECIAL COMMITTEE ON RADIO INTERFERENCE Amedmet 1 Specificatio for radio disturbace ad immuity measurig apparatus ad methods Part 4-3:

More information

lim za n n = z lim a n n.

lim za n n = z lim a n n. Lecture 6 Sequeces ad Series Defiitio 1 By a sequece i a set A, we mea a mappig f : N A. It is customary to deote a sequece f by {s } where, s := f(). A sequece {z } of (complex) umbers is said to be coverget

More information

Lecture Notes for Analysis Class

Lecture Notes for Analysis Class Lecture Notes for Aalysis Class Topological Spaces A topology for a set X is a collectio T of subsets of X such that: (a) X ad the empty set are i T (b) Uios of elemets of T are i T (c) Fiite itersectios

More information

SNAP Centre Workshop. Basic Algebraic Manipulation

SNAP Centre Workshop. Basic Algebraic Manipulation SNAP Cetre Workshop Basic Algebraic Maipulatio 8 Simplifyig Algebraic Expressios Whe a expressio is writte i the most compact maer possible, it is cosidered to be simplified. Not Simplified: x(x + 4x)

More information

Average Convergence Rate of Evolutionary Algorithms

Average Convergence Rate of Evolutionary Algorithms 1 Average Covergece Rate of Evolutioary Algorithms Ju He ad Guagmig Li Abstract arxiv:154.8117v3 [cs.ne] 2 Ju 215 I evolutioary optimizatio, it is importat to uderstad how fast evolutioary algorithms coverge

More information

Machine Learning for Data Science (CS 4786)

Machine Learning for Data Science (CS 4786) Machie Learig for Data Sciece CS 4786) Lecture & 3: Pricipal Compoet Aalysis The text i black outlies high level ideas. The text i blue provides simple mathematical details to derive or get to the algorithm

More information

Subject: Differential Equations & Mathematical Modeling -III. Lesson: Power series solutions of Differential Equations. about ordinary points

Subject: Differential Equations & Mathematical Modeling -III. Lesson: Power series solutions of Differential Equations. about ordinary points Power series solutio of Differetial equatios about ordiary poits Subject: Differetial Equatios & Mathematical Modelig -III Lesso: Power series solutios of Differetial Equatios about ordiary poits Lesso

More information

WHAT IS THE PROBABILITY FUNCTION FOR LARGE TSUNAMI WAVES? ABSTRACT

WHAT IS THE PROBABILITY FUNCTION FOR LARGE TSUNAMI WAVES? ABSTRACT WHAT IS THE PROBABILITY FUNCTION FOR LARGE TSUNAMI WAVES? Harold G. Loomis Hoolulu, HI ABSTRACT Most coastal locatios have few if ay records of tsuami wave heights obtaied over various time periods. Still

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

OPTIMAL ALGORITHMS -- SUPPLEMENTAL NOTES

OPTIMAL ALGORITHMS -- SUPPLEMENTAL NOTES OPTIMAL ALGORITHMS -- SUPPLEMENTAL NOTES Peter M. Maurer Why Hashig is θ(). As i biary search, hashig assumes that keys are stored i a array which is idexed by a iteger. However, hashig attempts to bypass

More information

Stat 139 Homework 7 Solutions, Fall 2015

Stat 139 Homework 7 Solutions, Fall 2015 Stat 139 Homework 7 Solutios, Fall 2015 Problem 1. I class we leared that the classical simple liear regressio model assumes the followig distributio of resposes: Y i = β 0 + β 1 X i + ɛ i, i = 1,...,,

More information

Uniform Strict Practical Stability Criteria for Impulsive Functional Differential Equations

Uniform Strict Practical Stability Criteria for Impulsive Functional Differential Equations Global Joural of Sciece Frotier Research Mathematics ad Decisio Scieces Volume 3 Issue Versio 0 Year 03 Type : Double Blid Peer Reviewed Iteratioal Research Joural Publisher: Global Jourals Ic (USA Olie

More information

Introduction to Optimization Techniques. How to Solve Equations

Introduction to Optimization Techniques. How to Solve Equations Itroductio to Optimizatio Techiques How to Solve Equatios Iterative Methods of Optimizatio Iterative methods of optimizatio Solutio of the oliear equatios resultig form a optimizatio problem is usually

More information

We are mainly going to be concerned with power series in x, such as. (x)} converges - that is, lims N n

We are mainly going to be concerned with power series in x, such as. (x)} converges - that is, lims N n Review of Power Series, Power Series Solutios A power series i x - a is a ifiite series of the form c (x a) =c +c (x a)+(x a) +... We also call this a power series cetered at a. Ex. (x+) is cetered at

More information

A NEW CLASS OF 2-STEP RATIONAL MULTISTEP METHODS

A NEW CLASS OF 2-STEP RATIONAL MULTISTEP METHODS Jural Karya Asli Loreka Ahli Matematik Vol. No. (010) page 6-9. Jural Karya Asli Loreka Ahli Matematik A NEW CLASS OF -STEP RATIONAL MULTISTEP METHODS 1 Nazeeruddi Yaacob Teh Yua Yig Norma Alias 1 Departmet

More information

xn = x n 1 α f(xn 1 + β n) f(xn 1 β n)

xn = x n 1 α f(xn 1 + β n) f(xn 1 β n) Proceedigs of the 005 Witer Simulatio Coferece M E Kuhl, N M Steiger, F B Armstrog, ad J A Joies, eds BALANCING BIAS AND VARIANCE IN THE OPTIMIZATION OF SIMULATION MODELS Christie SM Currie School of Mathematics

More information

Monte Carlo Optimization to Solve a Two-Dimensional Inverse Heat Conduction Problem

Monte Carlo Optimization to Solve a Two-Dimensional Inverse Heat Conduction Problem Australia Joural of Basic Applied Scieces, 5(): 097-05, 0 ISSN 99-878 Mote Carlo Optimizatio to Solve a Two-Dimesioal Iverse Heat Coductio Problem M Ebrahimi Departmet of Mathematics, Karaj Brach, Islamic

More information

1 Adiabatic and diabatic representations

1 Adiabatic and diabatic representations 1 Adiabatic ad diabatic represetatios 1.1 Bor-Oppeheimer approximatio The time-idepedet Schrödiger equatio for both electroic ad uclear degrees of freedom is Ĥ Ψ(r, R) = E Ψ(r, R), (1) where the full molecular

More information

Recurrence Relations

Recurrence Relations Recurrece Relatios Aalysis of recursive algorithms, such as: it factorial (it ) { if (==0) retur ; else retur ( * factorial(-)); } Let t be the umber of multiplicatios eeded to calculate factorial(). The

More information

Principle Of Superposition

Principle Of Superposition ecture 5: PREIMINRY CONCEP O RUCUR NYI Priciple Of uperpositio Mathematically, the priciple of superpositio is stated as ( a ) G( a ) G( ) G a a or for a liear structural system, the respose at a give

More information

6 Sample Size Calculations

6 Sample Size Calculations 6 Sample Size Calculatios Oe of the major resposibilities of a cliical trial statisticia is to aid the ivestigators i determiig the sample size required to coduct a study The most commo procedure for determiig

More information

Linear Programming and the Simplex Method

Linear Programming and the Simplex Method Liear Programmig ad the Simplex ethod Abstract This article is a itroductio to Liear Programmig ad usig Simplex method for solvig LP problems i primal form. What is Liear Programmig? Liear Programmig is

More information

FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures

FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 5 STATISTICS II. Mea ad stadard error of sample data. Biomial distributio. Normal distributio 4. Samplig 5. Cofidece itervals

More information

Supplemental Materials

Supplemental Materials 1 Supplemetal Materials Xiagmao Chag, Rui Ta, Guoliag Xig, Zhaohui Yua, Cheyag Lu, Yixi Che, Yixia Yag This documet icludes the supplemetal materials for the paper titled Sesor Placemet Algorithms for

More information

Two or more points can be used to describe a rigid body. This will eliminate the need to define rotational coordinates for the body!

Two or more points can be used to describe a rigid body. This will eliminate the need to define rotational coordinates for the body! OINTCOORDINATE FORMULATION Two or more poits ca be used to describe a rigid body. This will elimiate the eed to defie rotatioal coordiates for the body i z r i i, j r j j rimary oits: The coordiates of

More information

Math 113 Exam 4 Practice

Math 113 Exam 4 Practice Math Exam 4 Practice Exam 4 will cover.-.. This sheet has three sectios. The first sectio will remid you about techiques ad formulas that you should kow. The secod gives a umber of practice questios for

More information

Analytic Continuation

Analytic Continuation Aalytic Cotiuatio The stadard example of this is give by Example Let h (z) = 1 + z + z 2 + z 3 +... kow to coverge oly for z < 1. I fact h (z) = 1/ (1 z) for such z. Yet H (z) = 1/ (1 z) is defied for

More information

10-701/ Machine Learning Mid-term Exam Solution

10-701/ Machine Learning Mid-term Exam Solution 0-70/5-78 Machie Learig Mid-term Exam Solutio Your Name: Your Adrew ID: True or False (Give oe setece explaatio) (20%). (F) For a cotiuous radom variable x ad its probability distributio fuctio p(x), it

More information

7-1. Chapter 4. Part I. Sampling Distributions and Confidence Intervals

7-1. Chapter 4. Part I. Sampling Distributions and Confidence Intervals 7-1 Chapter 4 Part I. Samplig Distributios ad Cofidece Itervals 1 7- Sectio 1. Samplig Distributio 7-3 Usig Statistics Statistical Iferece: Predict ad forecast values of populatio parameters... Test hypotheses

More information

MAT1026 Calculus II Basic Convergence Tests for Series

MAT1026 Calculus II Basic Convergence Tests for Series MAT026 Calculus II Basic Covergece Tests for Series Egi MERMUT 202.03.08 Dokuz Eylül Uiversity Faculty of Sciece Departmet of Mathematics İzmir/TURKEY Cotets Mootoe Covergece Theorem 2 2 Series of Real

More information

Goodness-Of-Fit For The Generalized Exponential Distribution. Abstract

Goodness-Of-Fit For The Generalized Exponential Distribution. Abstract Goodess-Of-Fit For The Geeralized Expoetial Distributio By Amal S. Hassa stitute of Statistical Studies & Research Cairo Uiversity Abstract Recetly a ew distributio called geeralized expoetial or expoetiated

More information

Lecture 19: Convergence

Lecture 19: Convergence Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may

More information

Chapter 10: Power Series

Chapter 10: Power Series Chapter : Power Series 57 Chapter Overview: Power Series The reaso series are part of a Calculus course is that there are fuctios which caot be itegrated. All power series, though, ca be itegrated because

More information

Computational Fluid Dynamics. Lecture 3

Computational Fluid Dynamics. Lecture 3 Computatioal Fluid Dyamics Lecture 3 Discretizatio Cotiued. A fourth order approximatio to f x ca be foud usig Taylor Series. ( + ) + ( + ) + + ( ) + ( ) = a f x x b f x x c f x d f x x e f x x f x 0 0

More information