Pareto Optimization with Reverse Normal- Boundary Intersection for Power Plant Models

Size: px
Start display at page:

Download "Pareto Optimization with Reverse Normal- Boundary Intersection for Power Plant Models"

Transcription

1 1 Pareto Optmzaton wth Reverse Normal- Boundary Intersecton for Power Plant Models Joel H. Van Sckel and Kwang Y. Lee, Fellow, IEEE Abstract Ths paper presents the use of Pareto optmzaton technques that was prevously analyzed wth small scale power plant models where results could be verfed analytcally. Further research has been conducted nto the use of applyng these technques to large scale models and analyzng performance. These approaches have been verfed to scale well to larger applcatons. Through the use of mult-objectve partcle swarm optmzaton and reverse normal-boundary ntersecton, reference governors can be developed for numerous types of power plant. Combnng these two approaches allows decsons made from a Pareto front to be seamlessly mapped nto a smple and fast sngle varable optmzaton process. These applcatons are demonstrated wth a small ol-fred power plant model and a large-scale coal-fred power plant model. Index Terms Mult-objectve optmzaton, reverse normalboundary ntersecton, steady state power plant operaton. M I. INTRODUCTION ULTI-OBJECTIVE optmzaton s mplemented dfferently from area to area, wth numerous approaches avalable. Generally, most of these approaches can be splt nto two broad categores. The frst category, known as aggregaton technques, aggregates the multple objectves quanttatvely nto a sngle objectve. The second category, Pareto technques, uses the concept of Pareto optmalty to fnd a trade-off curve among multple objectves. Aggregaton of multple objectves can be acheved through dfferent rankng schemes such as weghted summaton [1] or goal programmng [2] to create a sngle varable optmzaton problem. Ths allows standard optmzaton technques to be utlzed. Unfortunately, quanttatvely aggregatng objectves assumes a quanttatve knowledge of the relatve mportance of the dfferent objectves. Addtonally, these technques only return a sngle pont as a soluton, whch can be a postve or a negatve dependng on the applcaton. For Pareto technques, fndng the trade-off curve, n whch numerous ponts are returned, provdes a comprehensve vew of the optmzaton problem, but the large number of ponts s hard to vsualze when more than three objectves are used. Furthermore, most applcatons need a specfc soluton, not a Ths work was supported by the NDSEG fellowshp program through the Offce of Naval Research and ASEE, and NSF Grant ECCS J. H. Van Sckel s wth the Department of Electrcal Engneerng, the Pennsylvana State Unversty, Unversty Park, PA (emal: jhv107@psu.edu). K. Y. Lee s wth the Department of Electrcal and Computer Engneerng, Baylor Unversty, Waco, TX (e-mal: Kwang_Y_Lee@baylor.edu). set of ponts, to functon properly. Ths creates a need to know how to choose a pont on the trade-off curve. Currently, mult-objectve optmzaton work for power plants has been acheved through the desgn of reference governors [3, 4]. Reference governors have used aggregaton technques to create a sngle objectve functon from multple objectves n order to control power plants. Unfortunately, there s no explct way to weght the dfferent objectves, and wthout lookng at the Pareto front, t s unknown what tradeoffs are beng made whle choosng the weghtng scheme. The Pareto front of a power plant was analyzed n [5]. Whle the approaches showed accurate ways to generate the Pareto front of a power plant, t was not enough of a step to provde somethng that could be mplemented for onlne operaton. A Pareto front by tself manly serves as a method to allow humans to better vsualze a mult-objectve optmzaton problem. How a specfc pont s chosen for operaton s often subjectve, f not even arbtrary. For ths applcaton of power plant control and specfc objectves, choosng the pont turned out to be qute smple. However, there was stll the ssue of how to use ths pont to control power plant operaton under changng operatng condtons. Smply runnng the power plant close to orgnal operatng condtons s not acceptable as the operatng front changes dramatcally as the unt load demand (uld) changes, completely changng where the optmzaton pont would be located. To address ths ssue n a manner that allows a pont to be chosen only once and not for every possble value of uld, a modfed verson of normal-boundary ntersecton was used. The methods dscussed n ths paper were appled to a smple thrd order power plant model as well as a hgher fdelty twenty thrd order model. Both are fossl fuel power plants. II. MULTI-OBJECTIVE OPTIMIZATION Mult-objectve optmzaton has always been mportant as t s not very often that there s an deal soluton that provdes the best result for every aspect of a problem. As such, great effort has gone nto tryng to develop methods to provde better ways to make decsons where tradeoffs are nevtable. When the problem can be quantfed, equatons can be used to gve numercal values to dfferent objectves representng how well they have been acheved. Intally, standard sngle objectve optmzaton technques were used, but they requred that dfferent objectves be aggregated. Ths was only a smplfcaton. To truly deal wth mult-objectve solutons n /10/$ IEEE

2 2 ther entrety, the concept of Pareto optmalty was put forth. A. Aggregaton Aggregaton technques n ther smplest form can be posed as the followng problem: mnmze ( x) [ ( x), ( x),..., ( x )] F = f f f 1 2 N Ths mult-objectve optmzaton problem can then be mapped nto a sngle varable optmzaton process: mnmze H( x) f ( x) 2 f ( x)... f ( x ) = α1 + α + + α 1 2 N N Where α n > 0 and H(x) s the scalar mappng of F(x). Ths s the most basc approach to aggregaton. B. Pareto Optmalty Pareto optmalty deals wth mult-objectve optmzaton where t s desred to mnmze the N objectves f (x), where = 1, 2,, N, x s a vector of length k, and k s the number of varables. Ths optmzaton can be posed as: mnmze ( x) [ ( x), ( x),..., ( x )] Subject to constrants: g ( x ) 0 h ( x ) = 0 F = f f f 1 2 N Termnology: Vector F(a) s sad to domnate vector F(b), F(a) p F(b), f and only f f (a) f (b) for all and f (a) < f (b) for at least one. Vector F(a) s consdered Pareto optmal or non-domnated f there exsts no other vector F(b) such that F(b) p F(a). There can be numerous ponts n a set that are all Pareto optmal. The collecton of all of the Pareto optmal ponts s called the Pareto front. An n-depth dscusson of Pareto optmalty s provded by [6]. III. POWER PLANT MODELS Two separate models are used n ths work. The frst model s a thrd order power plant often used for ts smple form and deal sze for publcaton. The second model s a twenty thrd order model that provdes a more challengng problem to ensure that approaches provded here can scale up to realworld applcaton. The thrd order model s presented fully n [7]. Ths model represents a 160 MW ol-fred turbne boler unt. The large scale power plant model was ntally developed by Usoro [8]. Ths model represents a 600 MW coal-fred drum type boler power plant. IV. APPLYING MULTI-OBJECTIVE OPTIMIZATION TO A POWER PLANT THROUGH A REFERENCE GOVERNOR Prevous work n ths area has mplemented mult-objectve optmzaton for power plant control though the use of a reference governor [3, 4]. A reference governor provdes feedforward control actons and set ponts to a feedback control system as shown n Fg. 1. Typcally, a heurstc optmzaton s used n conjuncton wth a steady-state neural network model to search for deal feedforward controls and setponts. Currently, multple objectves are aggregated by optmzng a cost functon that uses ether weghted sums [3] or goal programmng [4]. ULD...u n Output Reference Power Plant Governor Setponts Fg. 1. Tradtonal Reference Governor for power plant. Feedback Controller V. PARETO FRONT OF A POWER PLANT It s mportant that an accurate Pareto front of the power plant s operatng range be found. There are numerous approaches to ths process whch are beyond the scope of ths paper. To fnd ths front, the mult-objectve optmzaton problem must be stated n a quanttatve manner. For ths power plant, the mult-object optmzaton problem s stated below. x = [ uld, u, u, u ] (1) f ( x ) = uld P 1 (2a) f ( x ) = u (2b) 2 1 f ( x ) = u (2c) 3 2 mnmze F( x) = [ f ( x), f ( x), f ( x )] (3) Ths problem statement s suffcent for both models of power plants beng analyzed. For ths optmzaton problem f 1 s the error between unt load demand (uld) and power output (P) and f 2 represents fuel use, whch s controlled by the fuel valve openng. The fnal objectve functon f 3 represents the lfe of a control devce for u 2, whch s desred to be maxmzed for both types of power plants. Both power plants operate more effcently for hgher values of u 2. For the thrd order power plant, u 2 s the steam valve control whch s desred to be fully open, and for the twenty thrd power plant t s the steam flow rate, whch s also desred to be maxmzed. The results of ths optmzaton for the thrd order power plant can actually be determned analytcally [5], but n general a stochastc approach s requred to generate the Pareto front of these power plants [9]. There are numerous methods for generatng a Pareto front n exstence that work. After havng analyzed a few dfferent approaches [5], mult-objectve partcle swarm optmzaton (MOPSO) was chosen as a useful way to estmate the power plants Pareto fronts [9]. A. Mult-objectve Partcle Swarm Optmzaton MOPSO s based off of partcle swarm optmzaton (PSO)

3 3 whch one of the most wdely spread heurstc optmzaton technques based on ts smplcty and quck convergence. It has contnued to attract nterest n the area of mult-objectve optmzaton. There are many dfferent ways of modfyng PSO to work wth multple objectves. For ths work, the method by Alvarez-Bentez and others [10] s used. PSO uses a number of partcles that start wth random veloctes. These veloctes determne how the partcles move through the search space, and are updated every generaton usng v = w v + c r( Pbest x ) + c r ( Gbest x ) (4) c p p p For (4), v s the velocty vector, w, c 1, and c 2, are weghtng constants, and r 1, and r 2 are random varables between 0 and 1. For ths work, all constants are set to 0.5. The challenge n usng PSO for mult-objectve problems s to determne the values for the vectors Gbest and Pbest. Gbest s typcally the best pont currently found from all of the partcles and Pbest the best pont found for a specfc partcle. Snce multple ponts can be Pareto optmal, t s not mmedately apparent whch of the non-domnated ponts should be used for Gbest or Pbest because there s no best pont n a Pareto optmal set. Ths partcular mplementaton of MOPSO works by keepng a lst A, of all the non-domnated solutons found. After every generaton, the current partcles are combned wth A and then sorted by ther Pareto rank to create a new set of non-domnated ponts. A s then replaced wth ths new set. Pbest s ntalzed as the partcle s current poston, as n standard PSO, and updates to the partcle s new poston only f the new pont domnates Pbest. Gbest s dealt wth a lttle dfferently. Instead of havng a sngle Gbest, every partcle chooses randomly from A whch non-domnated pont t wll use for Gbest, and ths choce s made n every generaton. The results of MOPSO are shown n Fgs. 2-5 for both types of power plants. Ths algorthm generates far more ponts on the Pareto front than normal-boundary ntersecton. Ths slows the algorthm down as the number of ponts on the Pareto front grow, ncreasng the number of comparsons requred by the algorthm. The results are slghtly more nosy than that of NBI wth dfferental evolutonary (DE) algorthm but stll accurate. These results were acheved wth only 30 partcles over 100 generatons. B. Choosng a Pont Havng generated the Pareto front of a power plant, the next step s to choose whch pont s desred. For the thrd order power plant, the Pareto front s shown n Fgs. 2 and 3. For a gven error f 1 and uld each pont from Fg. 2 matches up wth the same pont n Fg. 3. As can be seen n Fg. 3, the desred locaton of changes dramatcally wth uld. For ths partcular power plant choosng ponts s easy. Except for extremely low power demands at whch ths power plant probably would not be runnng, we can always have u 2 set to 1 (fully open). As for a tradeoff, the power plant wll not purposely provde less power than needed to conserve fuel, so error wll be chosen to be 0 at all tmes, and then whatever correspondng to ths specfc Pareto pont wll be chosen. Smlar results are obtaned for the twenty-thrd order power plant and shown n Fgs. 4 and Fg. 2. Pareto front of thrd order power plant wth vs.. u Fg. 3. Pareto front of thrd order power plant wth u 2 vs.. (lb\s) Fg. 4. Pareto front of twenty thrd order power plant wth vs.. 30 MW 50 MW 75 MW 100 MW 130 MW 160 MW 30 MW 50 MW 75 MW 100 MW 130 MW 160 MW MW 500 MW 540 MW 580 MW

4 4 u 2 (lb\s) Fg. 5. Pareto front of twenty thrd order power plant wth u 2 vs.. VI. NORMAL BOUNDARY INTERSECTION Normal-boundary ntersecton (NBI) was developed by Das and Denns [11] for solvng mult-crtera optmzaton problems. It s geometrcally nspred and has been very successful n practce. Ths approach requres the knowledge of the soluton to the optmzaton of the ndvdual f (x), whch s usually avalable. In ths paper, NBI has been combned wth dfferental evoluton (DE) [12] to solve the optmzaton problem. Fundamentally, NBI s based on the concept of the Convex Hull of Indvdual Mnma whch s defned after a few prelmnares. For an n-objectve mnmzaton problem, where each objectve s represented by f (x), = 1,, n, let F = [f 1, f 2 f n ], where f s the soluton to the mnmzaton of f (x) alone, and x s the correspondng vector that mnmzes f (x). Let Φ be the matrx whose th column s F(x ) - F. The Convex Hull of Indvdual Mnma (CHIM) s then defned as the set of ponts that are convex combnatons of f. It may help to see t expressed n terms of (4): :, 1, 0 (4) NBI then proceeds by solvng the followng maxmzaton problem (5) by projectng lnes from the CHIM toward F whle varyng ω to search across the CHIM. max t xt, s.. t Φ ω + tnˆ = F( x) F h( x) = 0 g( x) MW 500 MW 540 MW 580 MW where ˆn s the unt normal vector to the CHIM and t represents how far ˆn can project from Φω before crossng the Pareto front. Typcally, all functons are shfted so that F les at the orgn. There are a few ssues unque to NBI that are mportant to be aware of. The above optmzaton only (5) searches over the CHIM smplex and could possbly leave out some extreme optmal ponts. In addton, a pont solved for usng NBI s not guaranteed to be Pareto optmal, however, every Pareto optmal pont can be represented as an NBI sub problem f ω s not restrcted to have ts elements sum up to 1. Regardless, NBI has proven to be a useful method of generatng Pareto ponts, and these ponts of possble concern are not an ssue n regard to reverse NBI as wll be explaned later. VII. REVERSE NORMAL-BOUNDARY INTERSECTION Whle NBI started wth a pont on the CHIM and then projected ˆn toward F, reverse NBI (RNBI) does the exact opposte and starts wth a pont that s known to be Pareto optmal, and projects ˆn toward the CHIM and uses the ntersecton to solve for a vector ω 0 that can be used to represent the Pareto optmal pont n terms of an NBI subproblem. For ths applcaton, ths represents the operatng ponts n a manner that s ndependent to the value of uld and allows for only a sngle pont to be chosen. Then, to recalculate ths pont under dfferent operatng condtons, ω 0 s used to solve a sngle NBI subproblem. Frst, a pont P 0 from the Pareto front must be chosen to represent the desred pont. Ths also means that the Pareto front needs to be generated. Ths can be seen as the frst step n RNBI as shown n Fg. 6. Everythng followng seeks to descrbe ths pont n terms of ts locaton n regard to the CHIM and as summarzed n the fgure. Bascally, ω o needs to be solved for as t s ndependent of the specfc values taken on by the Pareto front. To do ths, t s requred to fnd where ˆn would ntersect wth the CHIM when projected from P 0. Ths s done through a Gram-Schmdt orthonormalzaton and then projectng P 0 onto the CHIM smplex. To start wth, the n ponts f must be found as n NBI and defne the n-1 dmensonal affne subspace on whch the CHIM s located. Ths subspace s shfted to a lnear subspace by subtractng f 1 from the other n-1 ponts, puttng f 1 at the orgn and leavng n-1 vectors y, = 1,, n-1, wth n elements. These vectors can be turned nto an orthonormal bass usng Gram-Schmdt orthonormalzaton gven n (6-7): 1 k, = v y k k = 1 vk, vk v y v vˆ = v v Once there s an orthonormal bass, t s smple to fnd the ntersecton pont P. Frst P 0 should also be shfted by subtractng f 1 whch yelds a new pont P 0L, whch can be used wth the orthonormal bass. Usng (8) solves for pont P L, whch s easly transformed by to P by addng f 1. n 1, ˆ L = ol ol = 1 (6) (7) P P P v (8) Once P s known, t can be used to solve for ω 0 whch s then used to represent the desred Pareto optmal pont even f

5 5 the Pareto front s shfted. Ths can be used n all subsequent NBI subproblems to drectly fnd the equvalent P 0 even f the objectve functon space has been shfted, as n ths applcaton when the unt load demand changes. approxmately u 2 u Φω 0.4 tnˆ 0.2 Fg. 6. Second Step n Reverse NBI, solvng for ω tme (mn) Fg. 7. Feedforward controls for thrd order power plant. Now that ω 0 s known, the NBI maxmzaton problem n (5) can be solved substtutng ω 0 for ω. Choosng ω 0 n ths manner elmnates the prevous ssues that were mentoned as possble areas of concern when usng NBI to generate the Pareto front. As can be seen n (6), the NBI maxmzaton problem has nothng to do wth whether the optmal pont s domnated or not. It s only solvng for the pont that les n F whch can be projected by ˆn the furthest from the CHIM n the drecton of the orgn. For a non-convex surface, t s possble to have solutons to ths maxmzaton problem that are defntely not Pareto-optmal. VIII. IMPLEMENTING RNBI IN A REFERENCE GOVERNOR Implementng a reference governor wth RNBI s a farly straghtforward process [9]. Wth the mult-objectve problem stated, the Pareto front found, we must frst choose P 0. As stated before, we want to choose a pont wth an error of 0 and take whatever mnmum value of can be obtaned, and we know u 2 wll be maxmzed to 1 regardless of what pont we choose for the thrd order power plant [9]. We need to pck a specfc value for uld and pck a specfc P 0 so that ω 0 can be solved for. The unt load demand does not really matter as the results are gong to be almost dentcal regardless of ts value. All results are shown havng chosen P 0 when uld was set to 120 MW for the thrd order power plant, and 500 MW for the twenty thrd order power plant. From ths pont, RNBI can be followed exactly to yeld ω 0 and ths s then used to solve the NBI subproblem contnuously as uld vares. IX. NUMERICAL RESULTS An RBNI reference governor was developed for both power plants usng the prevously descrbed procedure. Pont P 0 was chosen wth uld = 120 MW for the thrd order power plant and chosen and uld = 500 MW for the twenty thrd order power plant. In both cases P 0 was chosen where error was Power (MW) Pressure (kg/cm3) tme (mn) tme (mn) Fg. 8. Thrd order power plant smulaton performance wth feedback control. (lb/s) Fg.9. Feedforward controls for twenty thrd order power plant. E Uld P Pd 62 tme (mn)

6 u 2 (lb/s) approach ntally developed scaled well when used on a sgnfcantly more complcated model that provded a much more data ntensve problem. Smlar results usng the same procedure were obtaned for both power plants even though the scale of number of nputs, outputs, and model complexty are vastly dfferent. 6 Fg.10. Feedforward controls for twenty thrd order power plant. Power (MW) Pressure (psa) Superheater Temp (R) tme (mn) tme (mn) Fg. 11. Twenty thrd order power plant smulaton performance wth feedback control. Fgs. 7-8 show the results for the thrd order power plant whch are reproductons from [9], and smlar performance was acheved for the large scale power plant n Fgs Only the most pertnent feedforward control actons are shown for the large scale power plant, but 12 control sgnals are actually generated. X. CONCLUSIONS The use of Pareto optmzaton technques that was prevously analyzed wth small-scale power plant models has been extended to large-scale power plant models and ther performances are analyzed. It was determned that the E uld P Pd T Td XI. REFERENCES [1] S. S. Rao, Engneerng Optmzaton Theory and Practce, 3 rd ed., [2] D. F. Jones and M. Tamz, Goal Programmng n the Perod , Multple Crtera Optmzaton: State of the Art Annotated Bblographc Surveys, 2002, pp [3] J. S. Heo, K. Y. Lee, and R. Garduno-Ramrez, Multobjectve control of power plants usng partcle swarm optmzaton technques, IEEE Transactons on Energy Converson, 2006, pp [4] R. Garduno-Ramrez and K. Y. Lee, Multobjectve optmal power plant operaton through coordnate control wth pressure set pont schedulng, IEEE Trans. on Energy Converson, 2001, pp [5] J. H. Van Sckel, P. Venkatesh, and K. Y. Lee, Analyss of the Pareto Front of a mult-objectve optmzaton problem for a fossl fuel power plant, IEEE PES General Meetng, [6] I. Y. Km and O. L. de Weck, Adaptve weghted sum method for multobjectve optmzaton: A new method for Pareto Front generaton, Structural and Multdscplnary Optmzaton, 2006, pp [7] R.D. Bell and K.J. Astrom. Smplfed Models of Boler-Turbne Unts. Report TFRT-3191, Lund Insttute of Technology, Sweden, [8] P. B. Usoro. Modelng and Smulaton of a Dum-turbne Power Plant Under Emergency State Control. M.S. Thess, Department of Mechancal Engneerng, MIT, Cambrdge, MA, [9] J. H. Van Sckel and K. Y. Lee, Reverse normal-boundary ntersecton for mult-objectve optmzaton for power plant operaton, Proc. of the IFAC Symposum on Power Plants and Power Systems Control, Tampere, Fnland, July 5-8, [10] J. E. Alvarez-Bentez, R. M. Everson, and J. E. Feldsend, A MOPSO algorthm based exclusvely on Pareto domnance concepts, EMO, 2005, pp [11] I. Das and J. E. Denns, Normal-boundary ntersecton: An new method for generatng the Pareto surface n nonlnear multcrtera optmzaton problems, SIAM Journal. on Optmzaton, 1996, pp [12] J. H. Van Sckel, K. Y. Lee, and J. H. Heo, Dfferental Evoluton and ts Applcatons to Power Plant Control, Proc. of Internatonal Conference on Intellgent Systems Applcaton to Power Systems, Kaohsng, Tawan, November 5-8, 2007, pp Joel H. Van Sckel receved hs B.S. degree n Electrcal Engneerng from Grove Cty College n 2005 and hs Ph.D. n Electrcal engneerng at the Pennsylvana State Unversty n Hs nterests nclude dstrbuted artfcal ntellgence, dstrbuted smulaton, ntellgent control, power generaton, mult-agent systems, optmzaton technques and advanced dstrbuted computaton. Kwang Y. Lee receved hs B.S. degree n Electrcal Engneerng from Seoul Natonal Unversty, Korea, n 1964, M.S. degree n Electrcal Engneerng from North Dakota State Unversty, Fargo, n 1968, and Ph.D. degree n System Scence from Mchgan State Unversty, East Lansng, n He has been wth Mchgan State, Oregon State, Unv. of Houston, the Pennsylvana State Unversty, and Baylor Unversty where he s currently a Professor and Char of Electrcal and Computer Engneerng. Hs nterests nclude power system control, operaton, plannng, and ntellgent system applcatons to power systems. Dr. Lee s a Fellow of IEEE, an Edtor of IEEE Transactons on Energy Converson, and a former Assocate Edtor of IEEE Transactons on Neural Networks. He s also a regstered Professonal Engneer.

Analysis of the Pareto Front of a Multiobjective Optimization Problem for a Fossil Fuel Power Plant

Analysis of the Pareto Front of a Multiobjective Optimization Problem for a Fossil Fuel Power Plant Analyss of the Pareto Front of a Multobjectve Optmzaton Problem for a Fossl Fuel Power Plant Joel H. Van Sckel, Student Member, IEEE, Paramasvam Venkatesh, and Kwang Y. Lee, Fellow, IEEE Abstract-- Ths

More information

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons

More information

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton

More information

Kernel Methods and SVMs Extension

Kernel Methods and SVMs Extension Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general

More information

Design and Optimization of Fuzzy Controller for Inverse Pendulum System Using Genetic Algorithm

Design and Optimization of Fuzzy Controller for Inverse Pendulum System Using Genetic Algorithm Desgn and Optmzaton of Fuzzy Controller for Inverse Pendulum System Usng Genetc Algorthm H. Mehraban A. Ashoor Unversty of Tehran Unversty of Tehran h.mehraban@ece.ut.ac.r a.ashoor@ece.ut.ac.r Abstract:

More information

The Study of Teaching-learning-based Optimization Algorithm

The Study of Teaching-learning-based Optimization Algorithm Advanced Scence and Technology Letters Vol. (AST 06), pp.05- http://dx.do.org/0.57/astl.06. The Study of Teachng-learnng-based Optmzaton Algorthm u Sun, Yan fu, Lele Kong, Haolang Q,, Helongang Insttute

More information

RECENTLY, the reliable supply of electric power has been

RECENTLY, the reliable supply of electric power has been 552 IEEE TRANSACTIONS ON ENERGY CONVERSION, VOL. 21, NO. 2, JUNE 2006 Multobjectve Control of Power Plants Usng Partcle Swarm Optmzaton Technques Jn S. Heo, Kwang Y. Lee, Fellow, IEEE, and Raul Garduno-Ramrez

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS HCMC Unversty of Pedagogy Thong Nguyen Huu et al. A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS Thong Nguyen Huu and Hao Tran Van Department of mathematcs-nformaton,

More information

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography CSc 6974 and ECSE 6966 Math. Tech. for Vson, Graphcs and Robotcs Lecture 21, Aprl 17, 2006 Estmatng A Plane Homography Overvew We contnue wth a dscusson of the major ssues, usng estmaton of plane projectve

More information

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin Proceedngs of the 007 Wnter Smulaton Conference S G Henderson, B Bller, M-H Hseh, J Shortle, J D Tew, and R R Barton, eds LOW BIAS INTEGRATED PATH ESTIMATORS James M Calvn Department of Computer Scence

More information

EEL 6266 Power System Operation and Control. Chapter 3 Economic Dispatch Using Dynamic Programming

EEL 6266 Power System Operation and Control. Chapter 3 Economic Dispatch Using Dynamic Programming EEL 6266 Power System Operaton and Control Chapter 3 Economc Dspatch Usng Dynamc Programmng Pecewse Lnear Cost Functons Common practce many utltes prefer to represent ther generator cost functons as sngle-

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

EEE 241: Linear Systems

EEE 241: Linear Systems EEE : Lnear Systems Summary #: Backpropagaton BACKPROPAGATION The perceptron rule as well as the Wdrow Hoff learnng were desgned to tran sngle layer networks. They suffer from the same dsadvantage: they

More information

Curve Fitting with the Least Square Method

Curve Fitting with the Least Square Method WIKI Document Number 5 Interpolaton wth Least Squares Curve Fttng wth the Least Square Method Mattheu Bultelle Department of Bo-Engneerng Imperal College, London Context We wsh to model the postve feedback

More information

MMA and GCMMA two methods for nonlinear optimization

MMA and GCMMA two methods for nonlinear optimization MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons

More information

PHYS 705: Classical Mechanics. Calculus of Variations II

PHYS 705: Classical Mechanics. Calculus of Variations II 1 PHYS 705: Classcal Mechancs Calculus of Varatons II 2 Calculus of Varatons: Generalzaton (no constrant yet) Suppose now that F depends on several dependent varables : We need to fnd such that has a statonary

More information

For now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results.

For now, let us focus on a specific model of neurons. These are simplified from reality but can achieve remarkable results. Neural Networks : Dervaton compled by Alvn Wan from Professor Jtendra Malk s lecture Ths type of computaton s called deep learnng and s the most popular method for many problems, such as computer vson

More information

FUZZY GOAL PROGRAMMING VS ORDINARY FUZZY PROGRAMMING APPROACH FOR MULTI OBJECTIVE PROGRAMMING PROBLEM

FUZZY GOAL PROGRAMMING VS ORDINARY FUZZY PROGRAMMING APPROACH FOR MULTI OBJECTIVE PROGRAMMING PROBLEM Internatonal Conference on Ceramcs, Bkaner, Inda Internatonal Journal of Modern Physcs: Conference Seres Vol. 22 (2013) 757 761 World Scentfc Publshng Company DOI: 10.1142/S2010194513010982 FUZZY GOAL

More information

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal Inner Product Defnton 1 () A Eucldean space s a fnte-dmensonal vector space over the reals R, wth an nner product,. Defnton 2 (Inner Product) An nner product, on a real vector space X s a symmetrc, blnear,

More information

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud Resource Allocaton wth a Budget Constrant for Computng Independent Tasks n the Cloud Wemng Sh and Bo Hong School of Electrcal and Computer Engneerng Georga Insttute of Technology, USA 2nd IEEE Internatonal

More information

Appendix B: Resampling Algorithms

Appendix B: Resampling Algorithms 407 Appendx B: Resamplng Algorthms A common problem of all partcle flters s the degeneracy of weghts, whch conssts of the unbounded ncrease of the varance of the mportance weghts ω [ ] of the partcles

More information

On the Multicriteria Integer Network Flow Problem

On the Multicriteria Integer Network Flow Problem BULGARIAN ACADEMY OF SCIENCES CYBERNETICS AND INFORMATION TECHNOLOGIES Volume 5, No 2 Sofa 2005 On the Multcrtera Integer Network Flow Problem Vassl Vasslev, Marana Nkolova, Maryana Vassleva Insttute of

More information

Amiri s Supply Chain Model. System Engineering b Department of Mathematics and Statistics c Odette School of Business

Amiri s Supply Chain Model. System Engineering b Department of Mathematics and Statistics c Odette School of Business Amr s Supply Chan Model by S. Ashtab a,, R.J. Caron b E. Selvarajah c a Department of Industral Manufacturng System Engneerng b Department of Mathematcs Statstcs c Odette School of Busness Unversty of

More information

Section 8.3 Polar Form of Complex Numbers

Section 8.3 Polar Form of Complex Numbers 80 Chapter 8 Secton 8 Polar Form of Complex Numbers From prevous classes, you may have encountered magnary numbers the square roots of negatve numbers and, more generally, complex numbers whch are the

More information

Solutions to exam in SF1811 Optimization, Jan 14, 2015

Solutions to exam in SF1811 Optimization, Jan 14, 2015 Solutons to exam n SF8 Optmzaton, Jan 4, 25 3 3 O------O -4 \ / \ / The network: \/ where all lnks go from left to rght. /\ / \ / \ 6 O------O -5 2 4.(a) Let x = ( x 3, x 4, x 23, x 24 ) T, where the varable

More information

An Interactive Optimisation Tool for Allocation Problems

An Interactive Optimisation Tool for Allocation Problems An Interactve Optmsaton ool for Allocaton Problems Fredr Bonäs, Joam Westerlund and apo Westerlund Process Desgn Laboratory, Faculty of echnology, Åbo Aadem Unversty, uru 20500, Fnland hs paper presents

More information

Module 9. Lecture 6. Duality in Assignment Problems

Module 9. Lecture 6. Duality in Assignment Problems Module 9 1 Lecture 6 Dualty n Assgnment Problems In ths lecture we attempt to answer few other mportant questons posed n earler lecture for (AP) and see how some of them can be explaned through the concept

More information

Assortment Optimization under MNL

Assortment Optimization under MNL Assortment Optmzaton under MNL Haotan Song Aprl 30, 2017 1 Introducton The assortment optmzaton problem ams to fnd the revenue-maxmzng assortment of products to offer when the prces of products are fxed.

More information

Lecture 10 Support Vector Machines II

Lecture 10 Support Vector Machines II Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed

More information

Global Sensitivity. Tuesday 20 th February, 2018

Global Sensitivity. Tuesday 20 th February, 2018 Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values

More information

Feature Selection: Part 1

Feature Selection: Part 1 CSE 546: Machne Learnng Lecture 5 Feature Selecton: Part 1 Instructor: Sham Kakade 1 Regresson n the hgh dmensonal settng How do we learn when the number of features d s greater than the sample sze n?

More information

12. The Hamilton-Jacobi Equation Michael Fowler

12. The Hamilton-Jacobi Equation Michael Fowler 1. The Hamlton-Jacob Equaton Mchael Fowler Back to Confguraton Space We ve establshed that the acton, regarded as a functon of ts coordnate endponts and tme, satsfes ( ) ( ) S q, t / t+ H qpt,, = 0, and

More information

Linear Feature Engineering 11

Linear Feature Engineering 11 Lnear Feature Engneerng 11 2 Least-Squares 2.1 Smple least-squares Consder the followng dataset. We have a bunch of nputs x and correspondng outputs y. The partcular values n ths dataset are x y 0.23 0.19

More information

Difference Equations

Difference Equations Dfference Equatons c Jan Vrbk 1 Bascs Suppose a sequence of numbers, say a 0,a 1,a,a 3,... s defned by a certan general relatonshp between, say, three consecutve values of the sequence, e.g. a + +3a +1

More information

The Order Relation and Trace Inequalities for. Hermitian Operators

The Order Relation and Trace Inequalities for. Hermitian Operators Internatonal Mathematcal Forum, Vol 3, 08, no, 507-57 HIKARI Ltd, wwwm-hkarcom https://doorg/0988/mf088055 The Order Relaton and Trace Inequaltes for Hermtan Operators Y Huang School of Informaton Scence

More information

Simultaneous Optimization of Berth Allocation, Quay Crane Assignment and Quay Crane Scheduling Problems in Container Terminals

Simultaneous Optimization of Berth Allocation, Quay Crane Assignment and Quay Crane Scheduling Problems in Container Terminals Smultaneous Optmzaton of Berth Allocaton, Quay Crane Assgnment and Quay Crane Schedulng Problems n Contaner Termnals Necat Aras, Yavuz Türkoğulları, Z. Caner Taşkın, Kuban Altınel Abstract In ths work,

More information

CS : Algorithms and Uncertainty Lecture 17 Date: October 26, 2016

CS : Algorithms and Uncertainty Lecture 17 Date: October 26, 2016 CS 29-128: Algorthms and Uncertanty Lecture 17 Date: October 26, 2016 Instructor: Nkhl Bansal Scrbe: Mchael Denns 1 Introducton In ths lecture we wll be lookng nto the secretary problem, and an nterestng

More information

CHAPTER 7 STOCHASTIC ECONOMIC EMISSION DISPATCH-MODELED USING WEIGHTING METHOD

CHAPTER 7 STOCHASTIC ECONOMIC EMISSION DISPATCH-MODELED USING WEIGHTING METHOD 90 CHAPTER 7 STOCHASTIC ECOOMIC EMISSIO DISPATCH-MODELED USIG WEIGHTIG METHOD 7.1 ITRODUCTIO early 70% of electrc power produced n the world s by means of thermal plants. Thermal power statons are the

More information

Yong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 )

Yong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 ) Kangweon-Kyungk Math. Jour. 4 1996), No. 1, pp. 7 16 AN ITERATIVE ROW-ACTION METHOD FOR MULTICOMMODITY TRANSPORTATION PROBLEMS Yong Joon Ryang Abstract. The optmzaton problems wth quadratc constrants often

More information

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng

More information

Some modelling aspects for the Matlab implementation of MMA

Some modelling aspects for the Matlab implementation of MMA Some modellng aspects for the Matlab mplementaton of MMA Krster Svanberg krlle@math.kth.se Optmzaton and Systems Theory Department of Mathematcs KTH, SE 10044 Stockholm September 2004 1. Consdered optmzaton

More information

Week3, Chapter 4. Position and Displacement. Motion in Two Dimensions. Instantaneous Velocity. Average Velocity

Week3, Chapter 4. Position and Displacement. Motion in Two Dimensions. Instantaneous Velocity. Average Velocity Week3, Chapter 4 Moton n Two Dmensons Lecture Quz A partcle confned to moton along the x axs moves wth constant acceleraton from x =.0 m to x = 8.0 m durng a 1-s tme nterval. The velocty of the partcle

More information

A LINEAR PROGRAM TO COMPARE MULTIPLE GROSS CREDIT LOSS FORECASTS. Dr. Derald E. Wentzien, Wesley College, (302) ,

A LINEAR PROGRAM TO COMPARE MULTIPLE GROSS CREDIT LOSS FORECASTS. Dr. Derald E. Wentzien, Wesley College, (302) , A LINEAR PROGRAM TO COMPARE MULTIPLE GROSS CREDIT LOSS FORECASTS Dr. Derald E. Wentzen, Wesley College, (302) 736-2574, wentzde@wesley.edu ABSTRACT A lnear programmng model s developed and used to compare

More information

Generalized Linear Methods

Generalized Linear Methods Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set

More information

Report on Image warping

Report on Image warping Report on Image warpng Xuan Ne, Dec. 20, 2004 Ths document summarzed the algorthms of our mage warpng soluton for further study, and there s a detaled descrpton about the mplementaton of these algorthms.

More information

Line Drawing and Clipping Week 1, Lecture 2

Line Drawing and Clipping Week 1, Lecture 2 CS 43 Computer Graphcs I Lne Drawng and Clppng Week, Lecture 2 Davd Breen, Wllam Regl and Maxm Peysakhov Geometrc and Intellgent Computng Laboratory Department of Computer Scence Drexel Unversty http://gcl.mcs.drexel.edu

More information

Problem Set 9 Solutions

Problem Set 9 Solutions Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem

More information

Physics 5153 Classical Mechanics. D Alembert s Principle and The Lagrangian-1

Physics 5153 Classical Mechanics. D Alembert s Principle and The Lagrangian-1 P. Guterrez Physcs 5153 Classcal Mechancs D Alembert s Prncple and The Lagrangan 1 Introducton The prncple of vrtual work provdes a method of solvng problems of statc equlbrum wthout havng to consder the

More information

Computing Correlated Equilibria in Multi-Player Games

Computing Correlated Equilibria in Multi-Player Games Computng Correlated Equlbra n Mult-Player Games Chrstos H. Papadmtrou Presented by Zhanxang Huang December 7th, 2005 1 The Author Dr. Chrstos H. Papadmtrou CS professor at UC Berkley (taught at Harvard,

More information

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg prnceton unv. F 17 cos 521: Advanced Algorthm Desgn Lecture 7: LP Dualty Lecturer: Matt Wenberg Scrbe: LP Dualty s an extremely useful tool for analyzng structural propertes of lnear programs. Whle there

More information

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017 U.C. Berkeley CS94: Beyond Worst-Case Analyss Handout 4s Luca Trevsan September 5, 07 Summary of Lecture 4 In whch we ntroduce semdefnte programmng and apply t to Max Cut. Semdefnte Programmng Recall that

More information

Interactive Bi-Level Multi-Objective Integer. Non-linear Programming Problem

Interactive Bi-Level Multi-Objective Integer. Non-linear Programming Problem Appled Mathematcal Scences Vol 5 0 no 65 3 33 Interactve B-Level Mult-Objectve Integer Non-lnear Programmng Problem O E Emam Department of Informaton Systems aculty of Computer Scence and nformaton Helwan

More information

Chapter Newton s Method

Chapter Newton s Method Chapter 9. Newton s Method After readng ths chapter, you should be able to:. Understand how Newton s method s dfferent from the Golden Secton Search method. Understand how Newton s method works 3. Solve

More information

The Minimum Universal Cost Flow in an Infeasible Flow Network

The Minimum Universal Cost Flow in an Infeasible Flow Network Journal of Scences, Islamc Republc of Iran 17(2): 175-180 (2006) Unversty of Tehran, ISSN 1016-1104 http://jscencesutacr The Mnmum Unversal Cost Flow n an Infeasble Flow Network H Saleh Fathabad * M Bagheran

More information

Tracking with Kalman Filter

Tracking with Kalman Filter Trackng wth Kalman Flter Scott T. Acton Vrgna Image and Vdeo Analyss (VIVA), Charles L. Brown Department of Electrcal and Computer Engneerng Department of Bomedcal Engneerng Unversty of Vrgna, Charlottesvlle,

More information

Numerical Heat and Mass Transfer

Numerical Heat and Mass Transfer Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and

More information

NUMERICAL DIFFERENTIATION

NUMERICAL DIFFERENTIATION NUMERICAL DIFFERENTIATION 1 Introducton Dfferentaton s a method to compute the rate at whch a dependent output y changes wth respect to the change n the ndependent nput x. Ths rate of change s called the

More information

Lecture 4. Instructor: Haipeng Luo

Lecture 4. Instructor: Haipeng Luo Lecture 4 Instructor: Hapeng Luo In the followng lectures, we focus on the expert problem and study more adaptve algorthms. Although Hedge s proven to be worst-case optmal, one may wonder how well t would

More information

Winter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan

Winter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan Wnter 2008 CS567 Stochastc Lnear/Integer Programmng Guest Lecturer: Xu, Huan Class 2: More Modelng Examples 1 Capacty Expanson Capacty expanson models optmal choces of the tmng and levels of nvestments

More information

Lecture 2: Gram-Schmidt Vectors and the LLL Algorithm

Lecture 2: Gram-Schmidt Vectors and the LLL Algorithm NYU, Fall 2016 Lattces Mn Course Lecture 2: Gram-Schmdt Vectors and the LLL Algorthm Lecturer: Noah Stephens-Davdowtz 2.1 The Shortest Vector Problem In our last lecture, we consdered short solutons to

More information

VQ widely used in coding speech, image, and video

VQ widely used in coding speech, image, and video at Scalar quantzers are specal cases of vector quantzers (VQ): they are constraned to look at one sample at a tme (memoryless) VQ does not have such constrant better RD perfomance expected Source codng

More information

CSC 411 / CSC D11 / CSC C11

CSC 411 / CSC D11 / CSC C11 18 Boostng s a general strategy for learnng classfers by combnng smpler ones. The dea of boostng s to take a weak classfer that s, any classfer that wll do at least slghtly better than chance and use t

More information

Neural networks. Nuno Vasconcelos ECE Department, UCSD

Neural networks. Nuno Vasconcelos ECE Department, UCSD Neural networs Nuno Vasconcelos ECE Department, UCSD Classfcaton a classfcaton problem has two types of varables e.g. X - vector of observatons (features) n the world Y - state (class) of the world x X

More information

Real-Time Systems. Multiprocessor scheduling. Multiprocessor scheduling. Multiprocessor scheduling

Real-Time Systems. Multiprocessor scheduling. Multiprocessor scheduling. Multiprocessor scheduling Real-Tme Systems Multprocessor schedulng Specfcaton Implementaton Verfcaton Multprocessor schedulng -- -- Global schedulng How are tasks assgned to processors? Statc assgnment The processor(s) used for

More information

Canonical transformations

Canonical transformations Canoncal transformatons November 23, 2014 Recall that we have defned a symplectc transformaton to be any lnear transformaton M A B leavng the symplectc form nvarant, Ω AB M A CM B DΩ CD Coordnate transformatons,

More information

Additional Codes using Finite Difference Method. 1 HJB Equation for Consumption-Saving Problem Without Uncertainty

Additional Codes using Finite Difference Method. 1 HJB Equation for Consumption-Saving Problem Without Uncertainty Addtonal Codes usng Fnte Dfference Method Benamn Moll 1 HJB Equaton for Consumpton-Savng Problem Wthout Uncertanty Before consderng the case wth stochastc ncome n http://www.prnceton.edu/~moll/ HACTproect/HACT_Numercal_Appendx.pdf,

More information

The Feynman path integral

The Feynman path integral The Feynman path ntegral Aprl 3, 205 Hesenberg and Schrödnger pctures The Schrödnger wave functon places the tme dependence of a physcal system n the state, ψ, t, where the state s a vector n Hlbert space

More information

The Finite Element Method

The Finite Element Method The Fnte Element Method GENERAL INTRODUCTION Read: Chapters 1 and 2 CONTENTS Engneerng and analyss Smulaton of a physcal process Examples mathematcal model development Approxmate solutons and methods of

More information

Economics 101. Lecture 4 - Equilibrium and Efficiency

Economics 101. Lecture 4 - Equilibrium and Efficiency Economcs 0 Lecture 4 - Equlbrum and Effcency Intro As dscussed n the prevous lecture, we wll now move from an envronment where we looed at consumers mang decsons n solaton to analyzng economes full of

More information

Integrals and Invariants of Euler-Lagrange Equations

Integrals and Invariants of Euler-Lagrange Equations Lecture 16 Integrals and Invarants of Euler-Lagrange Equatons ME 256 at the Indan Insttute of Scence, Bengaluru Varatonal Methods and Structural Optmzaton G. K. Ananthasuresh Professor, Mechancal Engneerng,

More information

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix Lectures - Week 4 Matrx norms, Condtonng, Vector Spaces, Lnear Independence, Spannng sets and Bass, Null space and Range of a Matrx Matrx Norms Now we turn to assocatng a number to each matrx. We could

More information

Exercises. 18 Algorithms

Exercises. 18 Algorithms 18 Algorthms Exercses 0.1. In each of the followng stuatons, ndcate whether f = O(g), or f = Ω(g), or both (n whch case f = Θ(g)). f(n) g(n) (a) n 100 n 200 (b) n 1/2 n 2/3 (c) 100n + log n n + (log n)

More information

Comparison of the Population Variance Estimators. of 2-Parameter Exponential Distribution Based on. Multiple Criteria Decision Making Method

Comparison of the Population Variance Estimators. of 2-Parameter Exponential Distribution Based on. Multiple Criteria Decision Making Method Appled Mathematcal Scences, Vol. 7, 0, no. 47, 07-0 HIARI Ltd, www.m-hkar.com Comparson of the Populaton Varance Estmators of -Parameter Exponental Dstrbuton Based on Multple Crtera Decson Makng Method

More information

Fundamental loop-current method using virtual voltage sources technique for special cases

Fundamental loop-current method using virtual voltage sources technique for special cases Fundamental loop-current method usng vrtual voltage sources technque for specal cases George E. Chatzaraks, 1 Marna D. Tortorel 1 and Anastasos D. Tzolas 1 Electrcal and Electroncs Engneerng Departments,

More information

Structure and Drive Paul A. Jensen Copyright July 20, 2003

Structure and Drive Paul A. Jensen Copyright July 20, 2003 Structure and Drve Paul A. Jensen Copyrght July 20, 2003 A system s made up of several operatons wth flow passng between them. The structure of the system descrbes the flow paths from nputs to outputs.

More information

Linear Approximation with Regularization and Moving Least Squares

Linear Approximation with Regularization and Moving Least Squares Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...

More information

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers Psychology 282 Lecture #24 Outlne Regresson Dagnostcs: Outlers In an earler lecture we studed the statstcal assumptons underlyng the regresson model, ncludng the followng ponts: Formal statement of assumptons.

More information

Temperature. Chapter Heat Engine

Temperature. Chapter Heat Engine Chapter 3 Temperature In prevous chapters of these notes we ntroduced the Prncple of Maxmum ntropy as a technque for estmatng probablty dstrbutons consstent wth constrants. In Chapter 9 we dscussed the

More information

THE CHINESE REMAINDER THEOREM. We should thank the Chinese for their wonderful remainder theorem. Glenn Stevens

THE CHINESE REMAINDER THEOREM. We should thank the Chinese for their wonderful remainder theorem. Glenn Stevens THE CHINESE REMAINDER THEOREM KEITH CONRAD We should thank the Chnese for ther wonderful remander theorem. Glenn Stevens 1. Introducton The Chnese remander theorem says we can unquely solve any par of

More information

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number

More information

Physics 5153 Classical Mechanics. Principle of Virtual Work-1

Physics 5153 Classical Mechanics. Principle of Virtual Work-1 P. Guterrez 1 Introducton Physcs 5153 Classcal Mechancs Prncple of Vrtual Work The frst varatonal prncple we encounter n mechancs s the prncple of vrtual work. It establshes the equlbrum condton of a mechancal

More information

Errors for Linear Systems

Errors for Linear Systems Errors for Lnear Systems When we solve a lnear system Ax b we often do not know A and b exactly, but have only approxmatons  and ˆb avalable. Then the best thng we can do s to solve ˆx ˆb exactly whch

More information

An Algorithm to Solve the Inverse Kinematics Problem of a Robotic Manipulator Based on Rotation Vectors

An Algorithm to Solve the Inverse Kinematics Problem of a Robotic Manipulator Based on Rotation Vectors An Algorthm to Solve the Inverse Knematcs Problem of a Robotc Manpulator Based on Rotaton Vectors Mohamad Z. Al-az*, Mazn Z. Othman**, and Baker B. Al-Bahr* *AL-Nahran Unversty, Computer Eng. Dep., Baghdad,

More information

Lecture 10 Support Vector Machines. Oct

Lecture 10 Support Vector Machines. Oct Lecture 10 Support Vector Machnes Oct - 20-2008 Lnear Separators Whch of the lnear separators s optmal? Concept of Margn Recall that n Perceptron, we learned that the convergence rate of the Perceptron

More information

Which Separator? Spring 1

Which Separator? Spring 1 Whch Separator? 6.034 - Sprng 1 Whch Separator? Mamze the margn to closest ponts 6.034 - Sprng Whch Separator? Mamze the margn to closest ponts 6.034 - Sprng 3 Margn of a pont " # y (w $ + b) proportonal

More information

Example: (13320, 22140) =? Solution #1: The divisors of are 1, 2, 3, 4, 5, 6, 9, 10, 12, 15, 18, 20, 27, 30, 36, 41,

Example: (13320, 22140) =? Solution #1: The divisors of are 1, 2, 3, 4, 5, 6, 9, 10, 12, 15, 18, 20, 27, 30, 36, 41, The greatest common dvsor of two ntegers a and b (not both zero) s the largest nteger whch s a common factor of both a and b. We denote ths number by gcd(a, b), or smply (a, b) when there s no confuson

More information

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have

More information

Transfer Functions. Convenient representation of a linear, dynamic model. A transfer function (TF) relates one input and one output: ( ) system

Transfer Functions. Convenient representation of a linear, dynamic model. A transfer function (TF) relates one input and one output: ( ) system Transfer Functons Convenent representaton of a lnear, dynamc model. A transfer functon (TF) relates one nput and one output: x t X s y t system Y s The followng termnology s used: x y nput output forcng

More information

An improved multi-objective evolutionary algorithm based on point of reference

An improved multi-objective evolutionary algorithm based on point of reference IOP Conference Seres: Materals Scence and Engneerng PAPER OPEN ACCESS An mproved mult-objectve evolutonary algorthm based on pont of reference To cte ths artcle: Boy Zhang et al 08 IOP Conf. Ser.: Mater.

More information

Lecture 12: Classification

Lecture 12: Classification Lecture : Classfcaton g Dscrmnant functons g The optmal Bayes classfer g Quadratc classfers g Eucldean and Mahalanobs metrcs g K Nearest Neghbor Classfers Intellgent Sensor Systems Rcardo Guterrez-Osuna

More information

U.C. Berkeley CS294: Spectral Methods and Expanders Handout 8 Luca Trevisan February 17, 2016

U.C. Berkeley CS294: Spectral Methods and Expanders Handout 8 Luca Trevisan February 17, 2016 U.C. Berkeley CS94: Spectral Methods and Expanders Handout 8 Luca Trevsan February 7, 06 Lecture 8: Spectral Algorthms Wrap-up In whch we talk about even more generalzatons of Cheeger s nequaltes, and

More information

Dynamic Programming. Preview. Dynamic Programming. Dynamic Programming. Dynamic Programming (Example: Fibonacci Sequence)

Dynamic Programming. Preview. Dynamic Programming. Dynamic Programming. Dynamic Programming (Example: Fibonacci Sequence) /24/27 Prevew Fbonacc Sequence Longest Common Subsequence Dynamc programmng s a method for solvng complex problems by breakng them down nto smpler sub-problems. It s applcable to problems exhbtng the propertes

More information

Markov Chain Monte Carlo Lecture 6

Markov Chain Monte Carlo Lecture 6 where (x 1,..., x N ) X N, N s called the populaton sze, f(x) f (x) for at least one {1, 2,..., N}, and those dfferent from f(x) are called the tral dstrbutons n terms of mportance samplng. Dfferent ways

More information

NON-CENTRAL 7-POINT FORMULA IN THE METHOD OF LINES FOR PARABOLIC AND BURGERS' EQUATIONS

NON-CENTRAL 7-POINT FORMULA IN THE METHOD OF LINES FOR PARABOLIC AND BURGERS' EQUATIONS IJRRAS 8 (3 September 011 www.arpapress.com/volumes/vol8issue3/ijrras_8_3_08.pdf NON-CENTRAL 7-POINT FORMULA IN THE METHOD OF LINES FOR PARABOLIC AND BURGERS' EQUATIONS H.O. Bakodah Dept. of Mathematc

More information

Edge Isoperimetric Inequalities

Edge Isoperimetric Inequalities November 7, 2005 Ross M. Rchardson Edge Isopermetrc Inequaltes 1 Four Questons Recall that n the last lecture we looked at the problem of sopermetrc nequaltes n the hypercube, Q n. Our noton of boundary

More information

The Second Anti-Mathima on Game Theory

The Second Anti-Mathima on Game Theory The Second Ant-Mathma on Game Theory Ath. Kehagas December 1 2006 1 Introducton In ths note we wll examne the noton of game equlbrum for three types of games 1. 2-player 2-acton zero-sum games 2. 2-player

More information

Multilayer Perceptron (MLP)

Multilayer Perceptron (MLP) Multlayer Perceptron (MLP) Seungjn Cho Department of Computer Scence and Engneerng Pohang Unversty of Scence and Technology 77 Cheongam-ro, Nam-gu, Pohang 37673, Korea seungjn@postech.ac.kr 1 / 20 Outlne

More information

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009 College of Computer & Informaton Scence Fall 2009 Northeastern Unversty 20 October 2009 CS7880: Algorthmc Power Tools Scrbe: Jan Wen and Laura Poplawsk Lecture Outlne: Prmal-dual schema Network Desgn:

More information

Lecture 17: Lee-Sidford Barrier

Lecture 17: Lee-Sidford Barrier CSE 599: Interplay between Convex Optmzaton and Geometry Wnter 2018 Lecturer: Yn Tat Lee Lecture 17: Lee-Sdford Barrer Dsclamer: Please tell me any mstake you notced. In ths lecture, we talk about the

More information