OPTIMISATION. Introduction Single Variable Unconstrained Optimisation Multivariable Unconstrained Optimisation Linear Programming

Size: px
Start display at page:

Download "OPTIMISATION. Introduction Single Variable Unconstrained Optimisation Multivariable Unconstrained Optimisation Linear Programming"

Transcription

1 OPTIMIATION Introducton ngle Varable Unconstraned Optmsaton Multvarable Unconstraned Optmsaton Lnear Programmng

2 Chapter Optmsaton /. Introducton In an engneerng analss, sometmes etremtes, ether mnmum or mamum value, has to be obtaned. () Global mamum Local mamum Global mnmum Local mnmum FIGURE. Etremtes or a sngle varable uncton Etremt value can be obtaned va optmsaton, whch s dvded nto:. Unconstraned optmsaton.. Constraned optmsaton lnear/non-lnear programmng.

3 Chapter Optmsaton /. ngle Varable Unconstraned Optmsaton Etremtes, an, can be evaluated usng ether the quadratc nterpolaton method or the Newton method usng the condton o. For the quadratc nterpolaton method, consder a second order Lagrange nterpolaton equaton as ollowed: (.) () Actual mamum Appromated mamum FIGURE. Evaluaton o etremtes usng a quadratc uncton Eq. (.) s derentated to eld: Thus, t can be rearranged to get an optmsed value o : (.) Eq. (.) can be repeated untl converged.

4 Chapter Optmsaton / Eample. Use the quadratc nterpolaton method to obtan a mamum value o the ollowng uncton accurate to our decmal places: sn. usng ntal values o, dan. oluton From the gven uncton: sn. () sn().().65 sn.. 9 Usng Eq. (.), the value o can be estmated as ollowed: ( ) (.65)( ) (.9)( ) ( ) (.65)( ) (.9)( ) ( ) sn(.66).(.66). 666 The overal process s as ollowed:.66 ( ) ( ) ( ) ( ) Hence, the mamum value s ().69 at.5. An etremt can ether be a mnmum or mamum value, or otherwse, : dependng on the second dervatve. > () s mnmum,. < () s mamum,. the coordnate, s an nlecton pont. [ ]

5 Chapter Optmsaton / 5 For the Newton method, consder an equaton smlar to the Newton- Raphson ormula (requrng onl one ntal value): g g ( ) ( ) I () s the rst dervatve o g(),.e. g g() s an etremt or (), or ( ) ( ), ths the root o (.) Eample. Use the Newton method to obtan the mamum value o the uncton: sn. usng an ntal value o. Use the convergence crteron o an appromated error o less than.5%. oluton From the gven uncton: cos. sn. Usng Eq. (.), the teraton ormula s: whch produces cos. sn. ( ) ( ) ( ) ε a (%) E E.959. Hence, the mamum value s ().698 at.5.

6 Chapter Optmsaton / 6. Multvarable Unconstraned Optmsaton For a multvarable case, etremtes can be evaluated usng the gradent method va the steepest slope condton. For a multvarable case, the gradent vector can be wrtten as, K,, n T z (,) FIGURE. Optmsaton or the -D case z (, ) Consder the equaton o two varables: ( ) The objectve s to obtan a condton where z, (.), and or ths case: j Ths vector wll gude the soluton towards a normal drecton (or orthogonal) to a contour lne o constant (,).

7 Chapter Optmsaton / 7 I h s the dstance needed to reach the etremt, the net appromaton to and are h, h (.5) Thus a uncton g(h) can be ormed such that, (.6) ( h) h h g and the relaton g h values o and. gves the optmsed h and hence the optmsed For the multvarable cases, the tpe o etremtes s determned usng the Hessan H parameter, whch has been dened as The parameter H s equvalent to H (.7) or a sngle varable case, where:. H > and > (,) has a local mnmum,. H > dan < (,) has a local mamum,. H < (,) has a plateau. Eample. Mamse the ollowng uncton: (, ) usng the gradent method o the steepest slope usng an ntal values o dan. Get the answer accurate to three decmal places. oluton In the rst teraton: () 6 6

8 Chapter Optmsaton / 8 g ( h) ( 6h, 6h) ( 6h)( 6h) ( 6h) ( 6h) ( 8h 7h 7 Thus ater the rst teraton: In the second teraton: g ( h) 6h 7. g h 6 6(.). (.). (.) (.) (.) (.).. ( h) (..h,..h).h g ( h).88h.88 h.....() The overall process s as ollowed: ) 6h.88h. h Fnall, the soluton converges at the -th teraton where dan,,. resultng n a mamum value o

9 Chapter Optmsaton / Mamum 5 6 FIGURE. Propagaton o estmated ponts o Eample.

10 Chapter Optmsaton /. Lnear Programmng In ths topc, onl the lnear case s consdered. The objectve o lnear programmng s to mnmse or mamse an objectve uncton Z,.e., Maksmumkan: Z c c L c n (.8) n Eq. (.8) s subjected to several constrants,.e. a a L a b (.9) I the varable j represents a postve phscal parameter, thus n n j (.) The smplest approach s va a graphcal method. Eample. Use the graphcal method to mamse the ollowng objectve uncton: Z 5 75 where the condtons or constrants are: oluton () 7 77, () 8 8, () 9, () 6, (5), (6). From the gure, the optmum pont s ( 8 8, ) mamum value o Z 8 9 whch produces the 9. Noted that condton () s redundant. 9

11 Chapter Optmsaton / FIGURE.5 Lnear programmng graph or Eample. One o the numercal approach s the smple method, where the searchng or the optmum pont s guded b the slag varable, as ollowed: Z c c L c n (.) n a a L a b (.) n n (.) j j I ths sstem contans k equatons and l varables ncludng the slag varables, where usuall k < l, hence there are (l k) varables whch has to be made zeros (non-bass a non-zero varable s known as bass). The Gauss-Jourdan elmnaton can be perormed to mnmse the objectve uncton. The elmnaton can be stopped when all the bass varables become zeros. Eample.5 Repeat Eample. usng the smple method.

12 Chapter Optmsaton / oluton The sstem can be rewrtten as ollowed: Mamse: Z 5 75, Wth condtons: () 7 77, () 8 8, () 9, () 6, (5),,,,., Begn wth Z. Then orm the ollowng table: Bass Z Z oluton At column, the element at row can be a pvot, hence s selected to be the nbound varable replacng. Then, perorm the Gauss elmnaton: Bass Z Z oluton 8 6 The coecent o at row Z s stll negatve, thus Z s stll not mamum. Hence, s selected to replace : Bass Z Z oluton

13 Chapter Optmsaton / Thereore the mamum o Z s.889 whch s produced at.889 and.889. In lnear and non-lnear programmng, there are our possble outcomes:. Unque soluton,. Multple solutons,. No possble soluton,. Unbounded problem. For cases -, the smple method cannot be used. (a) Multple solutons (b) No possble soluton FIGURE.6 (c) Unbounded problem Cases where the smple method s not applcable

14 Chapter Optmsaton / Eercses. Obtan the mnmum value o the ollowng uncton at usng the quadratc nterpolaton uncton usng the ntal values o.,.5 and 5., and the Newton method usng the ntal value o.5:. Obtan the mamum value o the ollowng uncton va the steepest slope wth the ntal value o (, ) (, ):.5. A compan produces two tpes o products, A and B. These products are produced durng normal workng das o hours per week and are marketed on the same weekends. The compan needs kg and 5 kg o raw materals or products A and B, respectvel. However, the compan warehouse can onl stores, kg o raw materals per week. Onl one product s produced at one tme, where product A requres.5 hour, whle product B requres.5 hour. Nevertheless, the temporar storage secton can onl keep 55 products per week. Product A s sold at RM5 per unt whle product B s sold at RM per unt. B usng the lnear programmng usng the smple method: a. Mamse the compan prot. b. Whch actor where ts ncrease leads to the astest ncrease n prot: raw materals, capact o temporar storage secton or producton tme?

Chapter 3 Differentiation and Integration

Chapter 3 Differentiation and Integration MEE07 Computer Modelng Technques n Engneerng Chapter Derentaton and Integraton Reerence: An Introducton to Numercal Computatons, nd edton, S. yakowtz and F. zdarovsky, Mawell/Macmllan, 990. Derentaton

More information

Single Variable Optimization

Single Variable Optimization 8/4/07 Course Instructor Dr. Raymond C. Rump Oce: A 337 Phone: (95) 747 6958 E Mal: rcrump@utep.edu Topc 8b Sngle Varable Optmzaton EE 4386/530 Computatonal Methods n EE Outlne Mathematcal Prelmnares Sngle

More information

36.1 Why is it important to be able to find roots to systems of equations? Up to this point, we have discussed how to find the solution to

36.1 Why is it important to be able to find roots to systems of equations? Up to this point, we have discussed how to find the solution to ChE Lecture Notes - D. Keer, 5/9/98 Lecture 6,7,8 - Rootndng n systems o equatons (A) Theory (B) Problems (C) MATLAB Applcatons Tet: Supplementary notes rom Instructor 6. Why s t mportant to be able to

More information

: Numerical Analysis Topic 2: Solution of Nonlinear Equations Lectures 5-11:

: Numerical Analysis Topic 2: Solution of Nonlinear Equations Lectures 5-11: 764: Numercal Analyss Topc : Soluton o Nonlnear Equatons Lectures 5-: UIN Malang Read Chapters 5 and 6 o the tetbook 764_Topc Lecture 5 Soluton o Nonlnear Equatons Root Fndng Problems Dentons Classcaton

More information

Mathematical Economics MEMF e ME. Filomena Garcia. Topic 2 Calculus

Mathematical Economics MEMF e ME. Filomena Garcia. Topic 2 Calculus Mathematcal Economcs MEMF e ME Flomena Garca Topc 2 Calculus Mathematcal Economcs - www.seg.utl.pt/~garca/economa_matematca . Unvarate Calculus Calculus Functons : X Y y ( gves or each element X one element

More information

Lecture 2 Solution of Nonlinear Equations ( Root Finding Problems )

Lecture 2 Solution of Nonlinear Equations ( Root Finding Problems ) Lecture Soluton o Nonlnear Equatons Root Fndng Problems Dentons Classcaton o Methods Analytcal Solutons Graphcal Methods Numercal Methods Bracketng Methods Open Methods Convergence Notatons Root Fndng

More information

CHAPTER 4d. ROOTS OF EQUATIONS

CHAPTER 4d. ROOTS OF EQUATIONS CHAPTER 4d. ROOTS OF EQUATIONS A. J. Clark School o Engneerng Department o Cvl and Envronmental Engneerng by Dr. Ibrahm A. Assakka Sprng 00 ENCE 03 - Computaton Methods n Cvl Engneerng II Department o

More information

CISE301: Numerical Methods Topic 2: Solution of Nonlinear Equations

CISE301: Numerical Methods Topic 2: Solution of Nonlinear Equations CISE3: Numercal Methods Topc : Soluton o Nonlnear Equatons Dr. Amar Khoukh Term Read Chapters 5 and 6 o the tetbook CISE3_Topc c Khoukh_ Lecture 5 Soluton o Nonlnear Equatons Root ndng Problems Dentons

More information

Summary with Examples for Root finding Methods -Bisection -Newton Raphson -Secant

Summary with Examples for Root finding Methods -Bisection -Newton Raphson -Secant Summary wth Eamples or Root ndng Methods -Bsecton -Newton Raphson -Secant Nonlnear Equaton Solvers Bracketng Graphcal Open Methods Bsecton False Poston (Regula-Fals) Newton Raphson Secant All Iteratve

More information

Chapter Newton s Method

Chapter Newton s Method Chapter 9. Newton s Method After readng ths chapter, you should be able to:. Understand how Newton s method s dfferent from the Golden Secton Search method. Understand how Newton s method works 3. Solve

More information

Solutions to exam in SF1811 Optimization, Jan 14, 2015

Solutions to exam in SF1811 Optimization, Jan 14, 2015 Solutons to exam n SF8 Optmzaton, Jan 4, 25 3 3 O------O -4 \ / \ / The network: \/ where all lnks go from left to rght. /\ / \ / \ 6 O------O -5 2 4.(a) Let x = ( x 3, x 4, x 23, x 24 ) T, where the varable

More information

Topic 5: Non-Linear Regression

Topic 5: Non-Linear Regression Topc 5: Non-Lnear Regresson The models we ve worked wth so far have been lnear n the parameters. They ve been of the form: y = Xβ + ε Many models based on economc theory are actually non-lnear n the parameters.

More information

CHAPTER 7 CONSTRAINED OPTIMIZATION 2: SQP AND GRG

CHAPTER 7 CONSTRAINED OPTIMIZATION 2: SQP AND GRG Chapter 7: Constraned Optmzaton CHAPER 7 CONSRAINED OPIMIZAION : SQP AND GRG Introducton In the prevous chapter we eamned the necessary and suffcent condtons for a constraned optmum. We dd not, however,

More information

Which Separator? Spring 1

Which Separator? Spring 1 Whch Separator? 6.034 - Sprng 1 Whch Separator? Mamze the margn to closest ponts 6.034 - Sprng Whch Separator? Mamze the margn to closest ponts 6.034 - Sprng 3 Margn of a pont " # y (w $ + b) proportonal

More information

Numerical Methods Solution of Nonlinear Equations

Numerical Methods Solution of Nonlinear Equations umercal Methods Soluton o onlnear Equatons Lecture Soluton o onlnear Equatons Root Fndng Prolems Dentons Classcaton o Methods Analytcal Solutons Graphcal Methods umercal Methods Bracketng Methods Open

More information

EE 330 Lecture 24. Small Signal Analysis Small Signal Analysis of BJT Amplifier

EE 330 Lecture 24. Small Signal Analysis Small Signal Analysis of BJT Amplifier EE 0 Lecture 4 Small Sgnal Analss Small Sgnal Analss o BJT Ampler Eam Frda March 9 Eam Frda Aprl Revew Sesson or Eam : 6:00 p.m. on Thursda March 8 n Room Sweene 6 Revew rom Last Lecture Comparson o Gans

More information

Shuai Dong. Isaac Newton. Gottfried Leibniz

Shuai Dong. Isaac Newton. Gottfried Leibniz Computatonal pyscs Sua Dong Isaac Newton Gottred Lebnz Numercal calculus poston dervatve ntegral v velocty dervatve ntegral a acceleraton Numercal calculus Numercal derentaton Numercal ntegraton Roots

More information

Finite Difference Method

Finite Difference Method 7/0/07 Instructor r. Ramond Rump (9) 747 698 rcrump@utep.edu EE 337 Computatonal Electromagnetcs (CEM) Lecture #0 Fnte erence Method Lecture 0 These notes ma contan coprghted materal obtaned under ar use

More information

Physics 2A Chapter 3 HW Solutions

Physics 2A Chapter 3 HW Solutions Phscs A Chapter 3 HW Solutons Chapter 3 Conceptual Queston: 4, 6, 8, Problems: 5,, 8, 7, 3, 44, 46, 69, 70, 73 Q3.4. Reason: (a) C = A+ B onl A and B are n the same drecton. Sze does not matter. (b) C

More information

Newton s Method for One - Dimensional Optimization - Theory

Newton s Method for One - Dimensional Optimization - Theory Numercal Methods Newton s Method for One - Dmensonal Optmzaton - Theory For more detals on ths topc Go to Clck on Keyword Clck on Newton s Method for One- Dmensonal Optmzaton You are free to Share to copy,

More information

PART 8. Partial Differential Equations PDEs

PART 8. Partial Differential Equations PDEs he Islamc Unverst of Gaza Facult of Engneerng Cvl Engneerng Department Numercal Analss ECIV 3306 PAR 8 Partal Dfferental Equatons PDEs Chapter 9; Fnte Dfference: Ellptc Equatons Assocate Prof. Mazen Abualtaef

More information

ORDINARY DIFFERENTIAL EQUATIONS EULER S METHOD

ORDINARY DIFFERENTIAL EQUATIONS EULER S METHOD Numercal Analss or Engneers German Jordanan Unverst ORDINARY DIFFERENTIAL EQUATIONS We wll eplore several metods o solvng rst order ordnar derental equatons (ODEs and we wll sow ow tese metods can be appled

More information

The Fundamental Theorem of Algebra. Objective To use the Fundamental Theorem of Algebra to solve polynomial equations with complex solutions

The Fundamental Theorem of Algebra. Objective To use the Fundamental Theorem of Algebra to solve polynomial equations with complex solutions 5-6 The Fundamental Theorem of Algebra Content Standards N.CN.7 Solve quadratc equatons wth real coeffcents that have comple solutons. N.CN.8 Etend polnomal denttes to the comple numbers. Also N.CN.9,

More information

e i is a random error

e i is a random error Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where + β + β e for,..., and are observable varables e s a random error How can an estmaton rule be constructed for the unknown

More information

Spring Force and Power

Spring Force and Power Lecture 13 Chapter 9 Sprng Force and Power Yeah, energy s better than orces. What s net? Course webste: http://aculty.uml.edu/andry_danylov/teachng/physcsi IN THIS CHAPTER, you wll learn how to solve problems

More information

Mathematics Intersection of Lines

Mathematics Intersection of Lines a place of mnd F A C U L T Y O F E D U C A T I O N Department of Currculum and Pedagog Mathematcs Intersecton of Lnes Scence and Mathematcs Educaton Research Group Supported b UBC Teachng and Learnng Enhancement

More information

The Karush-Kuhn-Tucker. Nuno Vasconcelos ECE Department, UCSD

The Karush-Kuhn-Tucker. Nuno Vasconcelos ECE Department, UCSD e Karus-Kun-ucker condtons and dualt Nuno Vasconcelos ECE Department, UCSD Optmzaton goal: nd mamum or mnmum o a uncton Denton: gven unctons, g, 1,...,k and, 1,...m dened on some doman Ω R n mn w, w Ω

More information

Chapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise.

Chapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise. Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where y + = β + β e for =,..., y and are observable varables e s a random error How can an estmaton rule be constructed for the

More information

Endogenous timing in a mixed oligopoly consisting of a single public firm and foreign competitors. Abstract

Endogenous timing in a mixed oligopoly consisting of a single public firm and foreign competitors. Abstract Endogenous tmng n a mxed olgopoly consstng o a sngle publc rm and oregn compettors Yuanzhu Lu Chna Economcs and Management Academy, Central Unversty o Fnance and Economcs Abstract We nvestgate endogenous

More information

Some Comments on Accelerating Convergence of Iterative Sequences Using Direct Inversion of the Iterative Subspace (DIIS)

Some Comments on Accelerating Convergence of Iterative Sequences Using Direct Inversion of the Iterative Subspace (DIIS) Some Comments on Acceleratng Convergence of Iteratve Sequences Usng Drect Inverson of the Iteratve Subspace (DIIS) C. Davd Sherrll School of Chemstry and Bochemstry Georga Insttute of Technology May 1998

More information

Solution of Linear System of Equations and Matrix Inversion Gauss Seidel Iteration Method

Solution of Linear System of Equations and Matrix Inversion Gauss Seidel Iteration Method Soluton of Lnear System of Equatons and Matr Inverson Gauss Sedel Iteraton Method It s another well-known teratve method for solvng a system of lnear equatons of the form a + a22 + + ann = b a2 + a222

More information

PHYS 1443 Section 004 Lecture #12 Thursday, Oct. 2, 2014

PHYS 1443 Section 004 Lecture #12 Thursday, Oct. 2, 2014 PHYS 1443 Secton 004 Lecture #1 Thursday, Oct., 014 Work-Knetc Energy Theorem Work under rcton Potental Energy and the Conservatve Force Gravtatonal Potental Energy Elastc Potental Energy Conservaton o

More information

An Interactive Optimisation Tool for Allocation Problems

An Interactive Optimisation Tool for Allocation Problems An Interactve Optmsaton ool for Allocaton Problems Fredr Bonäs, Joam Westerlund and apo Westerlund Process Desgn Laboratory, Faculty of echnology, Åbo Aadem Unversty, uru 20500, Fnland hs paper presents

More information

( ) [ ( k) ( k) ( x) ( ) ( ) ( ) [ ] ξ [ ] [ ] [ ] ( )( ) i ( ) ( )( ) 2! ( ) = ( ) 3 Interpolation. Polynomial Approximation.

( ) [ ( k) ( k) ( x) ( ) ( ) ( ) [ ] ξ [ ] [ ] [ ] ( )( ) i ( ) ( )( ) 2! ( ) = ( ) 3 Interpolation. Polynomial Approximation. 3 Interpolaton {( y } Gven:,,,,,, [ ] Fnd: y for some Mn, Ma Polynomal Appromaton Theorem (Weerstrass Appromaton Theorem --- estence ε [ ab] f( P( , then there ests a polynomal

More information

ME 501A Seminar in Engineering Analysis Page 1

ME 501A Seminar in Engineering Analysis Page 1 umercal Solutons of oundary-value Problems n Os ovember 7, 7 umercal Solutons of oundary- Value Problems n Os Larry aretto Mechancal ngneerng 5 Semnar n ngneerng nalyss ovember 7, 7 Outlne Revew stff equaton

More information

1 GSW Iterative Techniques for y = Ax

1 GSW Iterative Techniques for y = Ax 1 for y = A I m gong to cheat here. here are a lot of teratve technques that can be used to solve the general case of a set of smultaneous equatons (wrtten n the matr form as y = A), but ths chapter sn

More information

What is LP? LP is an optimization technique that allocates limited resources among competing activities in the best possible manner.

What is LP? LP is an optimization technique that allocates limited resources among competing activities in the best possible manner. (C) 998 Gerald B Sheblé, all rghts reserved Lnear Prograng Introducton Contents I. What s LP? II. LP Theor III. The Splex Method IV. Refneents to the Splex Method What s LP? LP s an optzaton technque that

More information

Chapter 9: Statistical Inference and the Relationship between Two Variables

Chapter 9: Statistical Inference and the Relationship between Two Variables Chapter 9: Statstcal Inference and the Relatonshp between Two Varables Key Words The Regresson Model The Sample Regresson Equaton The Pearson Correlaton Coeffcent Learnng Outcomes After studyng ths chapter,

More information

Complex Variables. Chapter 18 Integration in the Complex Plane. March 12, 2013 Lecturer: Shih-Yuan Chen

Complex Variables. Chapter 18 Integration in the Complex Plane. March 12, 2013 Lecturer: Shih-Yuan Chen omplex Varables hapter 8 Integraton n the omplex Plane March, Lecturer: Shh-Yuan hen Except where otherwse noted, content s lcensed under a BY-N-SA. TW Lcense. ontents ontour ntegrals auchy-goursat theorem

More information

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons

More information

Grid Generation around a Cylinder by Complex Potential Functions

Grid Generation around a Cylinder by Complex Potential Functions Research Journal of Appled Scences, Engneerng and Technolog 4(): 53-535, 0 ISSN: 040-7467 Mawell Scentfc Organzaton, 0 Submtted: December 0, 0 Accepted: Januar, 0 Publshed: June 0, 0 Grd Generaton around

More information

Solutions HW #2. minimize. Ax = b. Give the dual problem, and make the implicit equality constraints explicit. Solution.

Solutions HW #2. minimize. Ax = b. Give the dual problem, and make the implicit equality constraints explicit. Solution. Solutons HW #2 Dual of general LP. Fnd the dual functon of the LP mnmze subject to c T x Gx h Ax = b. Gve the dual problem, and make the mplct equalty constrants explct. Soluton. 1. The Lagrangan s L(x,

More information

Physics 5153 Classical Mechanics. Principle of Virtual Work-1

Physics 5153 Classical Mechanics. Principle of Virtual Work-1 P. Guterrez 1 Introducton Physcs 5153 Classcal Mechancs Prncple of Vrtual Work The frst varatonal prncple we encounter n mechancs s the prncple of vrtual work. It establshes the equlbrum condton of a mechancal

More information

One Dimensional Axial Deformations

One Dimensional Axial Deformations One Dmensonal al Deformatons In ths secton, a specfc smple geometr s consdered, that of a long and thn straght component loaded n such a wa that t deforms n the aal drecton onl. The -as s taken as the

More information

Numerical Solution of Ordinary Differential Equations

Numerical Solution of Ordinary Differential Equations Numercal Methods (CENG 00) CHAPTER-VI Numercal Soluton of Ordnar Dfferental Equatons 6 Introducton Dfferental equatons are equatons composed of an unknown functon and ts dervatves The followng are examples

More information

COMPLEX NUMBERS AND QUADRATIC EQUATIONS

COMPLEX NUMBERS AND QUADRATIC EQUATIONS COMPLEX NUMBERS AND QUADRATIC EQUATIONS INTRODUCTION We know that x 0 for all x R e the square of a real number (whether postve, negatve or ero) s non-negatve Hence the equatons x, x, x + 7 0 etc are not

More information

Finite Element Modelling of truss/cable structures

Finite Element Modelling of truss/cable structures Pet Schreurs Endhoven Unversty of echnology Department of Mechancal Engneerng Materals echnology November 3, 214 Fnte Element Modellng of truss/cable structures 1 Fnte Element Analyss of prestressed structures

More information

The Minimum Universal Cost Flow in an Infeasible Flow Network

The Minimum Universal Cost Flow in an Infeasible Flow Network Journal of Scences, Islamc Republc of Iran 17(2): 175-180 (2006) Unversty of Tehran, ISSN 1016-1104 http://jscencesutacr The Mnmum Unversal Cost Flow n an Infeasble Flow Network H Saleh Fathabad * M Bagheran

More information

CIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M

CIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M CIS56: achne Learnng Lecture 3 (Sept 6, 003) Preparaton help: Xaoyng Huang Lnear Regresson Lnear regresson can be represented by a functonal form: f(; θ) = θ 0 0 +θ + + θ = θ = 0 ote: 0 s a dummy attrbute

More information

ECEN 5005 Crystals, Nanocrystals and Device Applications Class 19 Group Theory For Crystals

ECEN 5005 Crystals, Nanocrystals and Device Applications Class 19 Group Theory For Crystals ECEN 5005 Crystals, Nanocrystals and Devce Applcatons Class 9 Group Theory For Crystals Dee Dagram Radatve Transton Probablty Wgner-Ecart Theorem Selecton Rule Dee Dagram Expermentally determned energy

More information

1 Convex Optimization

1 Convex Optimization Convex Optmzaton We wll consder convex optmzaton problems. Namely, mnmzaton problems where the objectve s convex (we assume no constrants for now). Such problems often arse n machne learnng. For example,

More information

SCALARS AND VECTORS All physical quantities in engineering mechanics are measured using either scalars or vectors.

SCALARS AND VECTORS All physical quantities in engineering mechanics are measured using either scalars or vectors. SCALARS AND ECTORS All phscal uanttes n engneerng mechancs are measured usng ether scalars or vectors. Scalar. A scalar s an postve or negatve phscal uantt that can be completel specfed b ts magntude.

More information

A Simple Research of Divisor Graphs

A Simple Research of Divisor Graphs The 29th Workshop on Combnatoral Mathematcs and Computaton Theory A Smple Research o Dvsor Graphs Yu-png Tsao General Educaton Center Chna Unversty o Technology Tape Tawan yp-tsao@cuteedutw Tape Tawan

More information

Some modelling aspects for the Matlab implementation of MMA

Some modelling aspects for the Matlab implementation of MMA Some modellng aspects for the Matlab mplementaton of MMA Krster Svanberg krlle@math.kth.se Optmzaton and Systems Theory Department of Mathematcs KTH, SE 10044 Stockholm September 2004 1. Consdered optmzaton

More information

Practical Newton s Method

Practical Newton s Method Practcal Newton s Method Lecture- n Newton s Method n Pure Newton s method converges radly once t s close to. It may not converge rom the remote startng ont he search drecton to be a descent drecton rue

More information

Absorbing Markov Chain Models to Determine Optimum Process Target Levels in Production Systems with Rework and Scrapping

Absorbing Markov Chain Models to Determine Optimum Process Target Levels in Production Systems with Rework and Scrapping Archve o SID Journal o Industral Engneerng 6(00) -6 Absorbng Markov Chan Models to Determne Optmum Process Target evels n Producton Systems wth Rework and Scrappng Mohammad Saber Fallah Nezhad a, Seyed

More information

IV. Performance Optimization

IV. Performance Optimization IV. Performance Optmzaton A. Steepest descent algorthm defnton how to set up bounds on learnng rate mnmzaton n a lne (varyng learnng rate) momentum learnng examples B. Newton s method defnton Gauss-Newton

More information

Local Approximation of Pareto Surface

Local Approximation of Pareto Surface Proceedngs o the World Congress on Engneerng 007 Vol II Local Approxmaton o Pareto Surace S.V. Utyuzhnkov, J. Magnot, and M.D. Guenov Abstract In the desgn process o complex systems, the desgner s solvng

More information

PHYS 705: Classical Mechanics. Calculus of Variations II

PHYS 705: Classical Mechanics. Calculus of Variations II 1 PHYS 705: Classcal Mechancs Calculus of Varatons II 2 Calculus of Varatons: Generalzaton (no constrant yet) Suppose now that F depends on several dependent varables : We need to fnd such that has a statonary

More information

Prof. Paolo Colantonio a.a

Prof. Paolo Colantonio a.a Pro. Paolo olantono a.a. 3 4 Let s consder a two ports network o Two ports Network o L For passve network (.e. wthout nternal sources or actve devces), a general representaton can be made by a sutable

More information

Numerical Methods. ME Mechanical Lab I. Mechanical Engineering ME Lab I

Numerical Methods. ME Mechanical Lab I. Mechanical Engineering ME Lab I 5 9 Mechancal Engneerng -.30 ME Lab I ME.30 Mechancal Lab I Numercal Methods Volt Sne Seres.5 0.5 SIN(X) 0 3 7 5 9 33 37 4 45 49 53 57 6 65 69 73 77 8 85 89 93 97 0-0.5 Normalzed Squared Functon - 0.07

More information

Chapter 5 rd Law of Thermodynamics

Chapter 5 rd Law of Thermodynamics Entropy and the nd and 3 rd Chapter 5 rd Law o hermodynamcs homas Engel, hlp Red Objectves Introduce entropy. Derve the condtons or spontanety. Show how S vares wth the macroscopc varables,, and. Chapter

More information

Kernel Methods and SVMs Extension

Kernel Methods and SVMs Extension Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general

More information

Section 8.3 Polar Form of Complex Numbers

Section 8.3 Polar Form of Complex Numbers 80 Chapter 8 Secton 8 Polar Form of Complex Numbers From prevous classes, you may have encountered magnary numbers the square roots of negatve numbers and, more generally, complex numbers whch are the

More information

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography CSc 6974 and ECSE 6966 Math. Tech. for Vson, Graphcs and Robotcs Lecture 21, Aprl 17, 2006 Estmatng A Plane Homography Overvew We contnue wth a dscusson of the major ssues, usng estmaton of plane projectve

More information

Resource Allocation and Decision Analysis (ECON 8010) Spring 2014 Foundations of Regression Analysis

Resource Allocation and Decision Analysis (ECON 8010) Spring 2014 Foundations of Regression Analysis Resource Allocaton and Decson Analss (ECON 800) Sprng 04 Foundatons of Regresson Analss Readng: Regresson Analss (ECON 800 Coursepak, Page 3) Defntons and Concepts: Regresson Analss statstcal technques

More information

Numerical Differentiation

Numerical Differentiation Part 5 Capter 19 Numercal Derentaton PowerPonts organzed by Dr. Mcael R. Gustason II, Duke Unversty Revsed by Pro. Jang, CAU All mages copyrgt Te McGraw-Hll Companes, Inc. Permsson requred or reproducton

More information

n α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0

n α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0 MODULE 2 Topcs: Lnear ndependence, bass and dmenson We have seen that f n a set of vectors one vector s a lnear combnaton of the remanng vectors n the set then the span of the set s unchanged f that vector

More information

Rigid body simulation

Rigid body simulation Rgd bod smulaton Rgd bod smulaton Once we consder an object wth spacal etent, partcle sstem smulaton s no longer suffcent Problems Problems Unconstraned sstem rotatonal moton torques and angular momentum

More information

Pattern Classification

Pattern Classification Pattern Classfcaton All materals n these sldes ere taken from Pattern Classfcaton (nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John Wley & Sons, 000 th the permsson of the authors and the publsher

More information

1 Matrix representations of canonical matrices

1 Matrix representations of canonical matrices 1 Matrx representatons of canoncal matrces 2-d rotaton around the orgn: ( ) cos θ sn θ R 0 = sn θ cos θ 3-d rotaton around the x-axs: R x = 1 0 0 0 cos θ sn θ 0 sn θ cos θ 3-d rotaton around the y-axs:

More information

SIMPLE LINEAR REGRESSION

SIMPLE LINEAR REGRESSION Smple Lnear Regresson and Correlaton Introducton Prevousl, our attenton has been focused on one varable whch we desgnated b x. Frequentl, t s desrable to learn somethng about the relatonshp between two

More information

Work is the change in energy of a system (neglecting heat transfer). To examine what could

Work is the change in energy of a system (neglecting heat transfer). To examine what could Work Work s the change n energy o a system (neglectng heat transer). To eamne what could cause work, let s look at the dmensons o energy: L ML E M L F L so T T dmensonally energy s equal to a orce tmes

More information

You will analyze the motion of the block at different moments using the law of conservation of energy.

You will analyze the motion of the block at different moments using the law of conservation of energy. Physcs 00A Homework 7 Chapter 8 Where s the Energy? In ths problem, we wll consder the ollowng stuaton as depcted n the dagram: A block o mass m sldes at a speed v along a horzontal smooth table. It next

More information

Root Finding

Root Finding Root Fndng 886307 What s Computer Scence? Computer scence s a dscplne that spans theory and practce. It requres thnkng both n abstract terms and n concrete terms. The practcal sde o computng can be seen

More information

Interconnect Modeling

Interconnect Modeling Interconnect Modelng Modelng of Interconnects Interconnect R, C and computaton Interconnect models umped RC model Dstrbuted crcut models Hgher-order waveform n dstrbuted RC trees Accuracy and fdelty Prepared

More information

χ x B E (c) Figure 2.1.1: (a) a material particle in a body, (b) a place in space, (c) a configuration of the body

χ x B E (c) Figure 2.1.1: (a) a material particle in a body, (b) a place in space, (c) a configuration of the body Secton.. Moton.. The Materal Body and Moton hyscal materals n the real world are modeled usng an abstract mathematcal entty called a body. Ths body conssts of an nfnte number of materal partcles. Shown

More information

PHYS 1441 Section 002 Lecture #15

PHYS 1441 Section 002 Lecture #15 PHYS 1441 Secton 00 Lecture #15 Monday, March 18, 013 Work wth rcton Potental Energy Gravtatonal Potental Energy Elastc Potental Energy Mechancal Energy Conservaton Announcements Mdterm comprehensve exam

More information

Army Ants Tunneling for Classical Simulations

Army Ants Tunneling for Classical Simulations Electronc Supplementary Materal (ESI) for Chemcal Scence. Ths journal s The Royal Socety of Chemstry 2014 electronc supplementary nformaton (ESI) for Chemcal Scence Army Ants Tunnelng for Classcal Smulatons

More information

MMA and GCMMA two methods for nonlinear optimization

MMA and GCMMA two methods for nonlinear optimization MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons

More information

where the sums are over the partcle labels. In general H = p2 2m + V s(r ) V j = V nt (jr, r j j) (5) where V s s the sngle-partcle potental and V nt

where the sums are over the partcle labels. In general H = p2 2m + V s(r ) V j = V nt (jr, r j j) (5) where V s s the sngle-partcle potental and V nt Physcs 543 Quantum Mechancs II Fall 998 Hartree-Fock and the Self-consstent Feld Varatonal Methods In the dscusson of statonary perturbaton theory, I mentoned brey the dea of varatonal approxmaton schemes.

More information

A Tale of Friction Basic Rollercoaster Physics. Fahrenheit Rollercoaster, Hershey, PA max height = 121 ft max speed = 58 mph

A Tale of Friction Basic Rollercoaster Physics. Fahrenheit Rollercoaster, Hershey, PA max height = 121 ft max speed = 58 mph A Tale o Frcton Basc Rollercoaster Physcs Fahrenhet Rollercoaster, Hershey, PA max heght = 11 t max speed = 58 mph PLAY PLAY PLAY PLAY Rotatonal Movement Knematcs Smlar to how lnear velocty s dened, angular

More information

9. Complex Numbers. 1. Numbers revisited. 2. Imaginary number i: General form of complex numbers. 3. Manipulation of complex numbers

9. Complex Numbers. 1. Numbers revisited. 2. Imaginary number i: General form of complex numbers. 3. Manipulation of complex numbers 9. Comple Numbers. Numbers revsted. Imagnar number : General form of comple numbers 3. Manpulaton of comple numbers 4. The Argand dagram 5. The polar form for comple numbers 9.. Numbers revsted We saw

More information

Correlation and Regression. Correlation 9.1. Correlation. Chapter 9

Correlation and Regression. Correlation 9.1. Correlation. Chapter 9 Chapter 9 Correlaton and Regresson 9. Correlaton Correlaton A correlaton s a relatonshp between two varables. The data can be represented b the ordered pars (, ) where s the ndependent (or eplanator) varable,

More information

Measurement and Uncertainties

Measurement and Uncertainties Phs L-L Introducton Measurement and Uncertantes An measurement s uncertan to some degree. No measurng nstrument s calbrated to nfnte precson, nor are an two measurements ever performed under eactl the

More information

Kinematics in 2-Dimensions. Projectile Motion

Kinematics in 2-Dimensions. Projectile Motion Knematcs n -Dmensons Projectle Moton A medeval trebuchet b Kolderer, c1507 http://members.net.net.au/~rmne/ht/ht0.html#5 Readng Assgnment: Chapter 4, Sectons -6 Introducton: In medeval das, people had

More information

Unit 5: Quadratic Equations & Functions

Unit 5: Quadratic Equations & Functions Date Perod Unt 5: Quadratc Equatons & Functons DAY TOPIC 1 Modelng Data wth Quadratc Functons Factorng Quadratc Epressons 3 Solvng Quadratc Equatons 4 Comple Numbers Smplfcaton, Addton/Subtracton & Multplcaton

More information

NUMERICAL DIFFERENTIATION

NUMERICAL DIFFERENTIATION NUMERICAL DIFFERENTIATION 1 Introducton Dfferentaton s a method to compute the rate at whch a dependent output y changes wth respect to the change n the ndependent nput x. Ths rate of change s called the

More information

Chapter 3 and Chapter 4

Chapter 3 and Chapter 4 Chapter 3 and Chapter 4 Chapter 3 Energy 3. Introducton:Work Work W s energy transerred to or rom an object by means o a orce actng on the object. Energy transerred to the object s postve work, and energy

More information

Physics 201, Lecture 4. Vectors and Scalars. Chapters Covered q Chapter 1: Physics and Measurement.

Physics 201, Lecture 4. Vectors and Scalars. Chapters Covered q Chapter 1: Physics and Measurement. Phscs 01, Lecture 4 Toda s Topcs n Vectors chap 3) n Scalars and Vectors n Vector ddton ule n Vector n a Coordnator Sstem n Decomposton of a Vector n Epected from prevew: n Scalars and Vectors, Vector

More information

CS 331 DESIGN AND ANALYSIS OF ALGORITHMS DYNAMIC PROGRAMMING. Dr. Daisy Tang

CS 331 DESIGN AND ANALYSIS OF ALGORITHMS DYNAMIC PROGRAMMING. Dr. Daisy Tang CS DESIGN ND NLYSIS OF LGORITHMS DYNMIC PROGRMMING Dr. Dasy Tang Dynamc Programmng Idea: Problems can be dvded nto stages Soluton s a sequence o decsons and the decson at the current stage s based on the

More information

The equation of motion of a dynamical system is given by a set of differential equations. That is (1)

The equation of motion of a dynamical system is given by a set of differential equations. That is (1) Dynamcal Systems Many engneerng and natural systems are dynamcal systems. For example a pendulum s a dynamcal system. State l The state of the dynamcal system specfes t condtons. For a pendulum n the absence

More information

Chapter 12. Ordinary Differential Equation Boundary Value (BV) Problems

Chapter 12. Ordinary Differential Equation Boundary Value (BV) Problems Chapter. Ordnar Dfferental Equaton Boundar Value (BV) Problems In ths chapter we wll learn how to solve ODE boundar value problem. BV ODE s usuall gven wth x beng the ndependent space varable. p( x) q(

More information

Chapter 14 Simple Linear Regression

Chapter 14 Simple Linear Regression Chapter 4 Smple Lnear Regresson Chapter 4 - Smple Lnear Regresson Manageral decsons often are based on the relatonshp between two or more varables. Regresson analss can be used to develop an equaton showng

More information

Department of Electrical and Computer Engineering FEEDBACK AMPLIFIERS

Department of Electrical and Computer Engineering FEEDBACK AMPLIFIERS Department o Electrcal and Computer Engneerng UNIT I EII FEEDBCK MPLIFIES porton the output sgnal s ed back to the nput o the ampler s called Feedback mpler. Feedback Concept: block dagram o an ampler

More information

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also

More information

Generalized Linear Methods

Generalized Linear Methods Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set

More information

Review of Taylor Series. Read Section 1.2

Review of Taylor Series. Read Section 1.2 Revew of Taylor Seres Read Secton 1.2 1 Power Seres A power seres about c s an nfnte seres of the form k = 0 k a ( x c) = a + a ( x c) + a ( x c) + a ( x c) k 2 3 0 1 2 3 + In many cases, c = 0, and the

More information

Conservation of Energy

Conservation of Energy Lecture 3 Chapter 8 Physcs I 0.3.03 Conservaton o Energy Course webste: http://aculty.uml.edu/andry_danylov/teachng/physcsi Lecture Capture: http://echo360.uml.edu/danylov03/physcsall.html 95.4, Fall 03,

More information

APPENDIX A Some Linear Algebra

APPENDIX A Some Linear Algebra APPENDIX A Some Lnear Algebra The collecton of m, n matrces A.1 Matrces a 1,1,..., a 1,n A = a m,1,..., a m,n wth real elements a,j s denoted by R m,n. If n = 1 then A s called a column vector. Smlarly,

More information