Introduction to Optimization, DIKU Monday 19 November David Pisinger. Duality, motivation
|
|
- Sabina Boyd
- 6 years ago
- Views:
Transcription
1 Itroductio to Optiizatio, DIKU Moday 9 Noveber David Pisiger Lecture, Duality ad sesitivity aalysis Duality, shadow prices, sesitivity aalysis, post-optial aalysis, copleetary slackess, KKT optiality coditio, CPLEX sesitivity Taha sectio.6.,.,.,.,.5 all exaples ca be read briefly Duality, otivatio Lookig for a upper boud o LP: axiize x + x subject to x + x x + x 5 x,x 0 Multiply secod costrait by two gives upper boud 0 x + x 0 Add first ad secod costrait gives upper boud 9 x + x 9 Liear cobiatio of costraits rewritte to Dual proble y (x + x )+y (x + x ) y + 5y (y + y )x +(y + y )x y + 5y iiize y + 5y subject to y + y y + y y,y 0 Duality Prial proble Dual proble ax j= c j x j s.t. j= a i j x j b i i =,..., x j 0 j =,..., i i= b i y i s.t. i= a i j y i c j j =,..., y i 0 i =,..., Strog duality For every bouded, feasible LP with prial solutio x, there exists dual feasible y such that j= c j x j = Proof: Show at VA course. i= b i y i Weak duality For every prial feasible x, dual feasible y Proof j= c j x j j=( i= j= c j x j a i j y i )x j = i= b i y i i=( j= a i j x j )y i i= b i y i If x prial feasible, y dual feasible, j= c j x j = i= b i y i the x is prial optial, ad y is dual optial.
2 Dualizatio (Taha table.) Prial-Dual Relatio Maxiizatio proble Miiizatio Proble Costraits Variables 0 0 = urestricted Variables Costraits 0 0 urestricted = Exaple ax x + x + 5x s.t. 5x + x + x = 8 (y ) x + x + 8x (y ) 6x + 7x + x (y ) x (y ) x 0 x,x R Dual Optial Ifeasible Ubouded Optial Possible Ipossible Ipossible Prial Ifeasible Ipossible Possible Possible Ubouded Ipossible Possible Ipossible i 8y + y + y + y s.t. 5y + y + 6y + y = (x ) y + y + 7y = (x ) y + 8y + y 5 (x ) y 0 y 0 y 0 y R 5 6 Ecooic iterpretatio of Dual variables (Taha..) y i, dual variables, shadow prices, argial prices If costrait i express a liit o resource i the dual variable y i represets the worth per uit of resource i If prial proble ax j= c j x j s.t. j= a i j x j b i i =,..., x j 0 j =,..., has optial solutio value z. The ax j= c j x j s.t. j= a i j x j b i + ε i i =,..., x j 0 j =,..., Reddy Mikks Prial Dual ax z = 5x + x s.t. 6x + x (resource M) x + x 6 (resource M) x + x (arket) x (dead) x,x 0 i w = y + 6y + y + y s.t. 6y + y y 5 y + y + y + y y,y,y,y 0 has optial solutio value z + i= y i ε i The chages eed to be sufficiet sall, such that curret solutio reais optial Weak duality theore: su of profits su of worth of resources x = (, ) y = (,,0,0) z = 7 8
3 Reddy Mikks Copleetary slackess (Core probl. 9-) profit of icreasig M oe uit z G z C 6 = 0 = prial (P) ax cx s.t. Ax b x 0 dual (D) i yb s.t. ya c y 0 Assue x feasible to (P) ad y feasible to (D) Necessary ad sufficiet coditios for x,y to be optial: ( j= a i j x j = b i or y i = 0) for i =,..., ad ( i= a i j y i = c j or x j = 0) for j =,..., Ecooical iterpretatio profit of icreasig M oe uit z C z B 6 9 = 0 = j= a i j x j < b i y i = 0 If resource b i is ot fully used, the o additioal profit ca be obtaied by icreasig the resource (i.e. y i = 0). i= a i j y i > c j x j = 0 If costs of resources for producig ite j exceed sellig cost, the we should ot produce ite j (i.e. x j = 0). 0 KKT optiality coditio Karush-Kuh-Tucker optiality coditio for geeral o-liear costraied iiizatio proble For LP-probles ax cx s.t. Ax b x 0 the KKT optiality coditio becoes Ax b, x 0 (prial feasible) ya c, y 0 (dual feasible) i yb s.t. ya c y 0 y(ax b) = 0, x(c ya) = 0 (copleetary slack) Fidig the dual variables if the ith costrait is a iequality the the y i will appear i the colu associated with the correspodig slack variable. if the ith costrait is a iequality the the absolute value of y i will appear i the colu associated with the correspodig surplus variable. Exaple, Reddy Mikks Iteratio 0: Iteratio : y = (,,0,0) basic z x x x x x 5 x 6 solutio z x x x x basic z x x x x x 5 x 6 solutio z x x x x
4 Whe Siplex teriates Fidig the dual variables i geeral Assue that proble is bouded ad feasible. Whe siplex teriates we have solutio value objective fuctio reduced costs basis equatios z = c B A B b z+(c B A B A N c N )x N = (c B A B )b c = c B A B A N c N 0 x B + A B A Nx N = A B b oegativity of all variables x 0 (P) ax cx s.t. Ax = b x 0 (D) i yb s.t. ya c Assue that x is a optial solutio. The dual variables ca be foud as y = c B A B Let y = c B A B, verify strog duality theore: yb = c B A B b = z ya = c B A B A = c B A B (A B A N = ( c B c B A B A ) N (c B c N ) = c sae solutio dual feasible Uderstadig Siplex Tableau (Taha..) Optial Dual Solutio (Taha..) Method ( Optial ) value ( ) Optial prial z-coefficiet of of dual variable y i = startig variable x i + origial objective coefficiet x i z+(c B A B A N c N )x N + (c B A B I d) s = (c BA B )b ax cx+ds s.t. Ax+Is = b x,s 0 basic solutio i Siplex A B x B + A N x N + Is = b x B + A B A N A B s = A B b objective fuctio z+(c B A B A N c N )x N +(c B A B I d)s = (c BA B )b Method ( ) Optial values of dual = variables Row vector of origial objective coefficiets of optial prial basic variables y = c B A B ( ) Optial prial iverse 5 6
5 Exaple Sesitivity Aalysis (Taha.6) Prial ax z = 5x + x + x MR s.t. x + x + x + x = 0 x x + x + R = 8 x,x,x,x,r 0 Dual i w = 0y + 8y s.t. y + y 5 y y y + y y 0 y M Fial Siplex table basic x x x x R solutio 9 z M 5 5 x x Method y = = 9 5, y = 5 + M +( M) = 5 Method (y,y ) = (,5)( ) = ( 9 5, 5 ) Sesitivity Aalysis: fid liits of paraeters such that curret solutio reais optial Post-optial Aalysis: deterie ew optiu resultig fro targeted chages i iput data 7 8 Chages i the right-had side (Taha.6.) Let D i be chage to costrait i Add D i to right-had side Write up feasibility coditios for curret solutio to reai optial Deterie liits of D i for which curret solutio reais optial TOYCO odel ax z = x + x + 5x s.t. x + x + x 0 x + x 60 x + x 0 x,x,x 0 Fial Siplex table basic x x x x x 5 x 6 solutio z x x x Slack variables x,x 5,x 6, their coefficiets are dual variables y =,y =,y = 0 Feasibility Rage ax z = x + x + 5x s.t. x + x + x 0+D x + x 60+D x + x 0+D x,x,x 0 i atrix for after addig slack variables basic solutio i Siplex optial table Ax = b+d A B x B + A N x N = b+d x B + A B A Nx N = A B (b+d) x = 00+ D D x = 0+ D x 6 = 0 D + D + D Curret solutio reais feasible as log as x,x,x
6 Feasibility Rage Chages i the objective fuctio (Taha.6.) Chagig operatio tie fro 0 to 0+D x = 00+ D 0 x = 0 0 x 6 = 0 D 0 Iplyig 00 D 0 Chagig operatio tie fro 60 to 60+D Iplyig 0 D 00 Chagig operatio tie fro 0 to 0+D Iplyig 0 D Checkig feasibility of chage Checkig whether D = 0, D =, D = 0 feasible x = 00+ D D = 88 0 x = 0+ D = 0 x 6 = 0 D + D + D = 78 0 Let d i be chage to coefficiet c i Add d i to respective coefficiet Write up feasibility coditios for curret solutio to reai optial Deterie liits of d i for which curret solutio reais optial TOYCO odel ax z = x + x + 5x s.t. x + x + x 0 x + x 60 x + x 0 x,x,x 0 Fial Siplex table basic x x x x x 5 x 6 solutio z x x x Objective Fuctio ax z = (+d )x + (+d )x + (5+d )x s.t. x + x + x 0 x + x 60 x + x 0 x,x,x 0 Siplex algorith, fids objective fuctio z+((c B + d B )A B A N (c N + d N )x N = ((c B + d B )A B )b Curret solutio reais optial as log as reduced costs are oegative for all obasis variables c N = (c B + d B )A B A N (c N + d N ) 0 reduced costs ca be rewritte c N = (c B+ d B )A B A N (c N + d N ) = c N + d B A B A N d N = c N + d B A N d N where A N is the cotets of the fial siplex table TOYCO odel Fial siplex table with d-values at appropriate places d d d basic x x x x x 5 x 6 solutio z d x d x x curret solutio reais optial as log as reduced costs c = d + d d 0 c = + d 0 c 5 = d + d 0 axiize z = (+d )x + x + 5x coditio d givig < d axiize z = x +(+d )x + 5x givig < d 8 axiize z = x + x +(5+d )x givig 8 < d
7 Post-optiality aalysis (Taha.5) Post-optiality aalysis Periodic recalculatio of the optiu solutio. Post-optiality aalysis deteries the ew solutio i a efficiet way. Coditio after paraeters chage Curret solutio reais optial ad feasible Curret solutio becoes ifeasible Curret solutio becoes ooptial Curret solutio becoes ooptial ad ifeasible Recoeded actio No further actio ecessary Use dual siplex to recover feasibility Use prial siplex to recover feasibility Use geeralized siplex to obtai ew solutio TOYCO Exaple.5- ax z = x + x + 5x s.t. x + x + x 0 x + x 60 x + x 0 x,x,x 0 Solutio x = 0, x = 00, x = 0. Add costrait x + x + x 500 Redudat Add costrait x + x + x 500 Ru dual siplex 5 6 Dual Siplex Dual siplex starts fro (better tha) optial ifeasible basis solutio. Searches for feasible solutio. leavig variable: x r is the basic variable havig ost egative value. optiality criteria: if all basic variables are oegative eterig variable: obasic variable with a r j < 0 { } c i,a r j < 0 Exaple Siplex table a r j i z = x + x + x s.t. x x x x x x 6 x + x + x x,x,x 0 basic x x x x x 5 x 6 solutio z x 0 0 x x All reduced costs c j 0. Ifeasible Leavig variable x 5 as 6 sallest. { } c i,a r j < 0 = i {, }, = a r j Eterig variable x Iteratio : basic x x x x x 5 x 6 solutio z x 0 0 x 0 0 x Leavig variable x Eterig variable { 5 i, }, = Iteratio : basic x x x x x 5 x 6 solutio z x 0 x x Optial ad feasible 8
8 Sesitivity with CPLEX Sesitivity with CPLEX TOYCO exaple axiize x + x + 5 x subject to x + x + x <= 0 x + x <= 60 x + x <= 0 bouds x >= 0 x >= 0 x >= 0 ed Solutio Dual siplex - Optial: Objective = e+0 Solutio tie = 0.00 sec. Iteratios = () CPLEX> dis se obj - OBJ Sesitivity Rages Variable Nae Reduced Cost Dow Curret Up x ifiity x zero zero x zero ifiity CPLEX> dis se rhs - RHS Sesitivity Rages Costrait Nae Dual Price Dow Curret Up c c c zero ifiity CPLEX> dis sol var - Variable Nae Solutio Value x x All other variables i the rage - are zero. CPLEX> dis sol dua - Costrait Nae Dual Price c c All other dual prices i the rage - are zero. 9 0
LP in Standard and Slack Forms
LP i Stadard ad Slack Fors ax j=1 s.t. j=1 c j a ij b i for i=1, 2,..., 0 for j=1, 2,..., z = 0 j=1 c j x i = b i j=1 a ij for i=1, 2,..., Auxiliary Liear Progra L: LP i stadard for: ax j=1 L aux : Auxiliary
More information1 The Primal and Dual of an Optimization Problem
CS 189 Itroductio to Machie Learig Fall 2017 Note 18 Previously, i our ivestigatio of SVMs, we forulated a costraied optiizatio proble that we ca solve to fid the optial paraeters for our hyperplae decisio
More informationLINEAR PROGRAMMING. Introduction. Prototype example. Formulation of the LP problem. Excel Solution. Graphical solution
Itroductio LINEAR PROGRAMMING Developmet of liear programmig was amog the most importat scietific advaces of mid 0th cet. Most commo type of applicatios: allocate limited resources to competig activities
More informationLinear Programming and the Simplex Method
Liear Programmig ad the Simplex ethod Abstract This article is a itroductio to Liear Programmig ad usig Simplex method for solvig LP problems i primal form. What is Liear Programmig? Liear Programmig is
More informationInteger Linear Programming
Iteger Liear Programmig Itroductio Iteger L P problem (P) Mi = s. t. a = b i =,, m = i i 0, iteger =,, c Eemple Mi z = 5 s. t. + 0 0, 0, iteger F(P) = feasible domai of P Itroductio Iteger L P problem
More informationOptimization Methods MIT 2.098/6.255/ Final exam
Optimizatio Methods MIT 2.098/6.255/15.093 Fial exam Date Give: December 19th, 2006 P1. [30 pts] Classify the followig statemets as true or false. All aswers must be well-justified, either through a short
More informationThe Simplex algorithm: Introductory example. The Simplex algorithm: Introductory example (2)
Discrete Mathematics for Bioiformatics WS 07/08, G. W. Klau, 23. Oktober 2007, 12:21 1 The Simplex algorithm: Itroductory example The followig itroductio to the Simplex algorithm is from the book Liear
More informationLecture 19. Curve fitting I. 1 Introduction. 2 Fitting a constant to measured data
Lecture 9 Curve fittig I Itroductio Suppose we are preseted with eight poits of easured data (x i, y j ). As show i Fig. o the left, we could represet the uderlyig fuctio of which these data are saples
More information15.081J/6.251J Introduction to Mathematical Programming. Lecture 21: Primal Barrier Interior Point Algorithm
508J/65J Itroductio to Mathematical Programmig Lecture : Primal Barrier Iterior Poit Algorithm Outlie Barrier Methods Slide The Cetral Path 3 Approximatig the Cetral Path 4 The Primal Barrier Algorithm
More informationResearch Article Extension of Wolfe Method for Solving Quadratic Programming with Interval Coefficients
Hidawi Joural of Applied Matheatics Volue 2017, Article ID 9037857, 6 pages https://doi.org/10.1155/2017/9037857 Research Article Extesio of Wolfe Method for Solvig Quadratic Prograig with Iterval Coefficiets
More informationLinear Programming! References! Introduction to Algorithms.! Dasgupta, Papadimitriou, Vazirani. Algorithms.! Cormen, Leiserson, Rivest, and Stein.
Liear Programmig! Refereces! Dasgupta, Papadimitriou, Vazirai. Algorithms.! Corme, Leiserso, Rivest, ad Stei. Itroductio to Algorithms.! Slack form! For each costrait i, defie a oegative slack variable
More informationThe Hypergeometric Coupon Collection Problem and its Dual
Joural of Idustrial ad Systes Egieerig Vol., o., pp -7 Sprig 7 The Hypergeoetric Coupo Collectio Proble ad its Dual Sheldo M. Ross Epstei Departet of Idustrial ad Systes Egieerig, Uiversity of Souther
More informationKeywords: duality, saddle point, complementary slackness, Karush-Kuhn-Tucker conditions, perturbation function, supporting functions.
DUALITY THEORY Jørge Tid Uiversity of Copehage, Deark. Keywords: duality, saddle poit, copleetary slackess, KarushKuhTucker coditios, perturbatio fuctio, supportig fuctios. Cotets 1. Itroductio 2. Covex
More information: Transforms and Partial Differential Equations
Trasforms ad Partial Differetial Equatios 018 SUBJECT NAME : Trasforms ad Partial Differetial Equatios SUBJECT CODE : MA 6351 MATERIAL NAME : Part A questios REGULATION : R013 WEBSITE : wwwharigaeshcom
More informationSummary: CORRELATION & LINEAR REGRESSION. GC. Students are advised to refer to lecture notes for the GC operations to obtain scatter diagram.
Key Cocepts: 1) Sketchig of scatter diagram The scatter diagram of bivariate (i.e. cotaiig two variables) data ca be easily obtaied usig GC. Studets are advised to refer to lecture otes for the GC operatios
More informationProbabilistic Analysis of Rectilinear Steiner Trees
Probabilistic Aalysis of Rectiliear Steier Trees Chuhog Che Departet of Electrical ad Coputer Egieerig Uiversity of Widsor, Otario, Caada, N9B 3P4 E-ail: cche@uwidsor.ca Abstract Steier tree is a fudaetal
More informationSome remarks on the paper Some elementary inequalities of G. Bennett
Soe rears o the paper Soe eleetary iequalities of G. Beett Dag Ah Tua ad Luu Quag Bay Vieta Natioal Uiversity - Haoi Uiversity of Sciece Abstract We give soe couterexaples ad soe rears of soe of the corollaries
More informationDefinitions and Theorems. where x are the decision variables. c, b, and a are constant coefficients.
Defiitios ad Theorems Remember the scalar form of the liear programmig problem, Miimize, Subject to, f(x) = c i x i a 1i x i = b 1 a mi x i = b m x i 0 i = 1,2,, where x are the decisio variables. c, b,
More informationChapter 2. Asymptotic Notation
Asyptotic Notatio 3 Chapter Asyptotic Notatio Goal : To siplify the aalysis of ruig tie by gettig rid of details which ay be affected by specific ipleetatio ad hardware. [1] The Big Oh (O-Notatio) : It
More informationOptimization Methods: Linear Programming Applications Assignment Problem 1. Module 4 Lecture Notes 3. Assignment Problem
Optimizatio Methods: Liear Programmig Applicatios Assigmet Problem Itroductio Module 4 Lecture Notes 3 Assigmet Problem I the previous lecture, we discussed about oe of the bech mark problems called trasportatio
More informationStatistics and Data Analysis in MATLAB Kendrick Kay, February 28, Lecture 4: Model fitting
Statistics ad Data Aalysis i MATLAB Kedrick Kay, kedrick.kay@wustl.edu February 28, 2014 Lecture 4: Model fittig 1. The basics - Suppose that we have a set of data ad suppose that we have selected the
More informationSchool of Mechanical Engineering Purdue University. ME375 Transfer Functions - 1
Trasfer Fuctio Aalysis Free & Forced Resposes Trasfer Fuctio Syste Stability ME375 Trasfer Fuctios - 1 Free & Forced Resposes Ex: Let s look at a stable first order syste: y y Ku Take LT of the I/O odel
More informationsubject to A 1 x + A 2 y b x j 0, j = 1,,n 1 y j = 0 or 1, j = 1,,n 2
Additioal Brach ad Boud Algorithms 0-1 Mixed-Iteger Liear Programmig The brach ad boud algorithm described i the previous sectios ca be used to solve virtually all optimizatio problems cotaiig iteger variables,
More informationCSI 2101 Discrete Structures Winter Homework Assignment #4 (100 points, weight 5%) Due: Thursday, April 5, at 1:00pm (in lecture)
CSI 101 Discrete Structures Witer 01 Prof. Lucia Moura Uiversity of Ottawa Homework Assigmet #4 (100 poits, weight %) Due: Thursday, April, at 1:00pm (i lecture) Program verificatio, Recurrece Relatios
More informationX. Perturbation Theory
X. Perturbatio Theory I perturbatio theory, oe deals with a ailtoia that is coposed Ĥ that is typically exactly solvable of two pieces: a referece part ad a perturbatio ( Ĥ ) that is assued to be sall.
More information1 Duality revisited. AM 221: Advanced Optimization Spring 2016
AM 22: Advaced Optimizatio Sprig 206 Prof. Yaro Siger Sectio 7 Wedesday, Mar. 9th Duality revisited I this sectio, we will give a slightly differet perspective o duality. optimizatio program: f(x) x R
More informationSupplementary Material
Suppleetary Material Wezhuo Ya a0096049@us.edu.s Departet of Mechaical Eieeri, Natioal Uiversity of Siapore, Siapore 117576 Hua Xu pexuh@us.edu.s Departet of Mechaical Eieeri, Natioal Uiversity of Siapore,
More informationENGI Series Page 6-01
ENGI 3425 6 Series Page 6-01 6. Series Cotets: 6.01 Sequeces; geeral term, limits, covergece 6.02 Series; summatio otatio, covergece, divergece test 6.03 Stadard Series; telescopig series, geometric series,
More informationName Period ALGEBRA II Chapter 1B and 2A Notes Solving Inequalities and Absolute Value / Numbers and Functions
Nae Period ALGEBRA II Chapter B ad A Notes Solvig Iequalities ad Absolute Value / Nubers ad Fuctios SECTION.6 Itroductio to Solvig Equatios Objectives: Write ad solve a liear equatio i oe variable. Solve
More informationTime-Domain Representations of LTI Systems
2.1 Itroductio Objectives: 1. Impulse resposes of LTI systems 2. Liear costat-coefficiets differetial or differece equatios of LTI systems 3. Bloc diagram represetatios of LTI systems 4. State-variable
More informationZeros of Polynomials
Math 160 www.timetodare.com 4.5 4.6 Zeros of Polyomials I these sectios we will study polyomials algebraically. Most of our work will be cocered with fidig the solutios of polyomial equatios of ay degree
More informationand then substitute this into the second equation to get 5(11 4 y) 3y
Math E-b Lecture # Notes The priary focus of this week s lecture is a systeatic way of solvig ad uderstadig systes of liear equatios algebraically, geoetrically, ad logically. Eaple #: Solve the syste
More informationOptimally Sparse SVMs
A. Proof of Lemma 3. We here prove a lower boud o the umber of support vectors to achieve geeralizatio bouds of the form which we cosider. Importatly, this result holds ot oly for liear classifiers, but
More informationOnline Learning & Game Theory
Olie Learig & Gae Theory A quick overview with recet results Viaey Perchet Laboratoire Probabilités et Modèles Aléatoires Uiv. Paris-Diderot Jourées MAS 2014 27 Août 2014 Startig Exaples Startig Exaples
More informationComplex Analysis Spring 2001 Homework I Solution
Complex Aalysis Sprig 2001 Homework I Solutio 1. Coway, Chapter 1, sectio 3, problem 3. Describe the set of poits satisfyig the equatio z a z + a = 2c, where c > 0 ad a R. To begi, we see from the triagle
More informationLC Oscillations. di Q. Kirchoff s loop rule /27/2018 1
L Oscillatios Kirchoff s loop rule I di Q VL V L dt ++++ - - - - L 3/27/28 , r Q.. 2 4 6 x 6.28 I. f( x) f( x).. r.. 2 4 6 x 6.28 di dt f( x) Q Q cos( t) I Q si( t) di dt Q cos( t) 2 o x, r.. V. x f( )
More information10-701/ Machine Learning Mid-term Exam Solution
0-70/5-78 Machie Learig Mid-term Exam Solutio Your Name: Your Adrew ID: True or False (Give oe setece explaatio) (20%). (F) For a cotiuous radom variable x ad its probability distributio fuctio p(x), it
More informationBrief summary of linear programming and duality: Consider the linear program in standard form. (P ) min z = cx. x 0. (D) max yb. z = c B x B + c N x N
Brief summary of linear programming and duality: Consider the linear program in standard form (P ) min z = cx s.t. Ax = b x 0 where A R m n, c R 1 n, x R n 1, b R m 1,and its dual (D) max yb s.t. ya c.
More informationSome Examples on Gibbs Sampling and Metropolis-Hastings methods
Soe Exaples o Gibbs Saplig ad Metropolis-Hastigs ethods S420/620 Itroductio to Statistical Theory, Fall 2012 Gibbs Sapler Saple a ultidiesioal probability distributio fro coditioal desities. Suppose d
More informationWeight Moving Average = n
1 Forecastig Simple Movig Average- F = 1 N (D + D 1 + D 2 + D 3 + ) Movig Weight Average- Weight Movig Average = W id i i=1 W i Sigle (Simple) Expoetial Smoothig- F t = F t 1 + α(d t 1 F t 1 ) or F t =
More informationMarkov Decision Processes
Markov Decisio Processes Defiitios; Statioary policies; Value improvemet algorithm, Policy improvemet algorithm, ad liear programmig for discouted cost ad average cost criteria. Markov Decisio Processes
More informationWe are mainly going to be concerned with power series in x, such as. (x)} converges - that is, lims N n
Review of Power Series, Power Series Solutios A power series i x - a is a ifiite series of the form c (x a) =c +c (x a)+(x a) +... We also call this a power series cetered at a. Ex. (x+) is cetered at
More informationIntroduction to Optimization Techniques. How to Solve Equations
Itroductio to Optimizatio Techiques How to Solve Equatios Iterative Methods of Optimizatio Iterative methods of optimizatio Solutio of the oliear equatios resultig form a optimizatio problem is usually
More informationInverse Matrix. A meaning that matrix B is an inverse of matrix A.
Iverse Matrix Two square matrices A ad B of dimesios are called iverses to oe aother if the followig holds, AB BA I (11) The otio is dual but we ofte write 1 B A meaig that matrix B is a iverse of matrix
More information5.6 Binomial Multi-section Matching Transformer
4/14/21 5_6 Bioial Multisectio Matchig Trasforers 1/1 5.6 Bioial Multi-sectio Matchig Trasforer Readig Assiget: pp. 246-25 Oe way to axiize badwidth is to costruct a ultisectio Γ f that is axially flat.
More informationData Movement in Flash Memories
Data Moveet i Flash Meories Axiao (Adrew) Jiag Coputer Sciece Departet Texas A&M Uiversity College Statio, TX 77843 ajiag@cse.tau.edu Michael Lagberg Coputer Sciece Divisio Ope Uiversity of Israel Raaaa
More informationTransfer Function Analysis
Trasfer Fuctio Aalysis Free & Forced Resposes Trasfer Fuctio Syste Stability ME375 Trasfer Fuctios - Free & Forced Resposes Ex: Let s s look at a stable first order syste: τ y + y = Ku Take LT of the I/O
More informationRecursive Algorithms. Recurrences. Recursive Algorithms Analysis
Recursive Algorithms Recurreces Computer Sciece & Egieerig 35: Discrete Mathematics Christopher M Bourke cbourke@cseuledu A recursive algorithm is oe i which objects are defied i terms of other objects
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 15.053 Optimizatio Methods i Maagemet Sciece (Sprig 2007) Problem Set 3 Due March 1 st, 2007 at 4:30 pm You will eed 116 poits out of 137 to receive a grade of 5.
More informationSection 1 of Unit 03 (Pure Mathematics 3) Algebra
Sectio 1 of Uit 0 (Pure Mathematics ) Algebra Recommeded Prior Kowledge Studets should have studied the algebraic techiques i Pure Mathematics 1. Cotet This Sectio should be studied early i the course
More informationSeptember 2012 C1 Note. C1 Notes (Edexcel) Copyright - For AS, A2 notes and IGCSE / GCSE worksheets 1
September 0 s (Edecel) Copyright www.pgmaths.co.uk - For AS, A otes ad IGCSE / GCSE worksheets September 0 Copyright www.pgmaths.co.uk - For AS, A otes ad IGCSE / GCSE worksheets September 0 Copyright
More informationOverview of course. Introduction to Optimization, DIKU Monday 12 November David Pisinger
Introduction to Optimization, DIKU 007-08 Monday November David Pisinger Lecture What is OR, linear models, standard form, slack form, simplex repetition, graphical interpretation, extreme points, basic
More information(s)h(s) = K( s + 8 ) = 5 and one finite zero is located at z 1
ROOT LOCUS TECHNIQUE 93 should be desiged differetly to eet differet specificatios depedig o its area of applicatio. We have observed i Sectio 6.4 of Chapter 6, how the variatio of a sigle paraeter like
More informationw (1) ˆx w (1) x (1) /ρ and w (2) ˆx w (2) x (2) /ρ.
2 5. Weighted umber of late jobs 5.1. Release dates ad due dates: maximimizig the weight of o-time jobs Oce we add release dates, miimizig the umber of late jobs becomes a sigificatly harder problem. For
More informationSupport vector machine revisited
6.867 Machie learig, lecture 8 (Jaakkola) 1 Lecture topics: Support vector machie ad kerels Kerel optimizatio, selectio Support vector machie revisited Our task here is to first tur the support vector
More informationCALCULUS BASIC SUMMER REVIEW
CALCULUS BASIC SUMMER REVIEW NAME rise y y y Slope of a o vertical lie: m ru Poit Slope Equatio: y y m( ) The slope is m ad a poit o your lie is, ). ( y Slope-Itercept Equatio: y m b slope= m y-itercept=
More informationScheduling under Uncertainty using MILP Sensitivity Analysis
Schedulig uder Ucertaity usig MILP Sesitivity Aalysis M. Ierapetritou ad Zheya Jia Departmet of Chemical & Biochemical Egieerig Rutgers, the State Uiversity of New Jersey Piscataway, NJ Abstract The aim
More informationInternational Journal of Mathematical Archive-4(9), 2013, 1-5 Available online through ISSN
Iteratioal Joural o Matheatical Archive-4(9), 03, -5 Available olie through www.ija.io ISSN 9 5046 THE CUBIC RATE OF CONVERGENCE OF GENERALIZED EXTRAPOLATED NEWTON RAPHSON METHOD FOR SOLVING NONLINEAR
More informationRecurrence Relations
Recurrece Relatios Aalysis of recursive algorithms, such as: it factorial (it ) { if (==0) retur ; else retur ( * factorial(-)); } Let t be the umber of multiplicatios eeded to calculate factorial(). The
More informationToday in Physics 217: separation of variables IV
Today i Physics 27: separatio of variables IV Separatio i cylidrical coordiates Exaple of the split cylider (solutio sketched at right) More o orthogoality of trig fuctios ad Fourier s trick V = V V =
More information( ) = p and P( i = b) = q.
MATH 540 Radom Walks Part 1 A radom walk X is special stochastic process that measures the height (or value) of a particle that radomly moves upward or dowward certai fixed amouts o each uit icremet of
More informationA Solution Procedure to Solve Multi objective Fractional Transportation Problem
Iteratioal Refereed Joural of Egieerig ad Sciece (IRJES) ISSN (Olie) 2319-183X, (Prit) 2319-1821 Volue 7, Issue 1 (Jauary 2018), PP. 7-72 A Solutio Procedure to Solve Multi objective Fractioal Trasportatio
More informationFrequency Domain Filtering
Frequecy Domai Filterig Raga Rodrigo October 19, 2010 Outlie Cotets 1 Itroductio 1 2 Fourier Represetatio of Fiite-Duratio Sequeces: The Discrete Fourier Trasform 1 3 The 2-D Discrete Fourier Trasform
More informationMa/CS 6a Class 22: Power Series
Ma/CS 6a Class 22: Power Series By Ada Sheffer Power Series Mooial: ax i. Polyoial: a 0 + a 1 x + a 2 x 2 + + a x. Power series: A x = a 0 + a 1 x + a 2 x 2 + Also called foral power series, because we
More informationBoosting. Professor Ameet Talwalkar. Professor Ameet Talwalkar CS260 Machine Learning Algorithms March 1, / 32
Boostig Professor Ameet Talwalkar Professor Ameet Talwalkar CS260 Machie Learig Algorithms March 1, 2017 1 / 32 Outlie 1 Admiistratio 2 Review of last lecture 3 Boostig Professor Ameet Talwalkar CS260
More informationx c the remainder is Pc ().
Algebra, Polyomial ad Ratioal Fuctios Page 1 K.Paulk Notes Chapter 3, Sectio 3.1 to 3.4 Summary Sectio Theorem Notes 3.1 Zeros of a Fuctio Set the fuctio to zero ad solve for x. The fuctio is zero at these
More informationSummary and Discussion on Simultaneous Analysis of Lasso and Dantzig Selector
Summary ad Discussio o Simultaeous Aalysis of Lasso ad Datzig Selector STAT732, Sprig 28 Duzhe Wag May 4, 28 Abstract This is a discussio o the work i Bickel, Ritov ad Tsybakov (29). We begi with a short
More informationP.3 Polynomials and Special products
Precalc Fall 2016 Sectios P.3, 1.2, 1.3, P.4, 1.4, P.2 (radicals/ratioal expoets), 1.5, 1.6, 1.7, 1.8, 1.1, 2.1, 2.2 I Polyomial defiitio (p. 28) a x + a x +... + a x + a x 1 1 0 1 1 0 a x + a x +... +
More information3.2 Properties of Division 3.3 Zeros of Polynomials 3.4 Complex and Rational Zeros of Polynomials
Math 60 www.timetodare.com 3. Properties of Divisio 3.3 Zeros of Polyomials 3.4 Complex ad Ratioal Zeros of Polyomials I these sectios we will study polyomials algebraically. Most of our work will be cocered
More informationSolutions for the Exam 9 January 2012
Mastermath ad LNMB Course: Discrete Optimizatio Solutios for the Exam 9 Jauary 2012 Utrecht Uiversity, Educatorium, 15:15 18:15 The examiatio lasts 3 hours. Gradig will be doe before Jauary 23, 2012. Studets
More information19.1 The dictionary problem
CS125 Lecture 19 Fall 2016 19.1 The dictioary proble Cosider the followig data structural proble, usually called the dictioary proble. We have a set of ites. Each ite is a (key, value pair. Keys are i
More informationLebesgue Constant Minimizing Bivariate Barycentric Rational Interpolation
Appl. Math. If. Sci. 8, No. 1, 187-192 (2014) 187 Applied Matheatics & Iforatio Scieces A Iteratioal Joural http://dx.doi.org/10.12785/ais/080123 Lebesgue Costat Miiizig Bivariate Barycetric Ratioal Iterpolatio
More information( ) (( ) ) ANSWERS TO EXERCISES IN APPENDIX B. Section B.1 VECTORS AND SETS. Exercise B.1-1: Convex sets. are convex, , hence. and. (a) Let.
Joh Riley 8 Jue 03 ANSWERS TO EXERCISES IN APPENDIX B Sectio B VECTORS AND SETS Exercise B-: Covex sets (a) Let 0 x, x X, X, hece 0 x, x X ad 0 x, x X Sice X ad X are covex, x X ad x X The x X X, which
More informationFUZZY TRANSPORTATION PROBLEM WITH ADDITIONAL RESTRICTIONS
VOL. 5, NO. 2, FEBRUARY 200 ISSN 89-6608 ARPN Joural of Egieerig ad Applied Scieces 2006-200 Asia Research Publishig Network (ARPN). All rights reserved. www.arpjourals.co FUZZY TRANSPORTATION PROBLEM
More informationWe have also learned that, thanks to the Central Limit Theorem and the Law of Large Numbers,
Cofidece Itervals III What we kow so far: We have see how to set cofidece itervals for the ea, or expected value, of a oral probability distributio, both whe the variace is kow (usig the stadard oral,
More informationBertrand s postulate Chapter 2
Bertrad s postulate Chapter We have see that the sequece of prie ubers, 3, 5, 7,... is ifiite. To see that the size of its gaps is ot bouded, let N := 3 5 p deote the product of all prie ubers that are
More informationTopic 1 2: Sequences and Series. A sequence is an ordered list of numbers, e.g. 1, 2, 4, 8, 16, or
Topic : Sequeces ad Series A sequece is a ordered list of umbers, e.g.,,, 8, 6, or,,,.... A series is a sum of the terms of a sequece, e.g. + + + 8 + 6 + or... Sigma Notatio b The otatio f ( k) is shorthad
More informationAlgorithms and Data Structures 2014 Exercises and Solutions Week 13
Algorithms ad Data Structures 204 Exercises ad Solutios Week 3 Toom-Cook (cotiued) Durig the last lecture, two polyomials A(x) a 0 + a x ad B(x) b 0 + b x both of degree were multiplied, first by evaluatig
More informationThe Binomial Multi-Section Transformer
4/15/2010 The Bioial Multisectio Matchig Trasforer preset.doc 1/24 The Bioial Multi-Sectio Trasforer Recall that a ulti-sectio atchig etwork ca be described usig the theory of sall reflectios as: where:
More informationMEI Casio Tasks for Further Pure
Task Complex Numbers: Roots of Quadratic Equatios. Add a ew Equatio scree: paf 2. Chage the Complex output to a+bi: LpNNNNwd 3. Select Polyomial ad set the Degree to 2: wq 4. Set a=, b=5 ad c=6: l5l6l
More informationAnswer Key, Problem Set 1, Written
Cheistry 1 Mies, Sprig, 018 Aswer Key, Proble Set 1, Writte 1. 14.3;. 14.34 (add part (e): Estiate / calculate the iitial rate of the reactio); 3. NT1; 4. NT; 5. 14.37; 6. 14.39; 7. 14.41; 8. NT3; 9. 14.46;
More informationLecture 11. Solution of Nonlinear Equations - III
Eiciecy o a ethod Lecture Solutio o Noliear Equatios - III The eiciecy ide o a iterative ethod is deied by / E r r: rate o covergece o the ethod : total uber o uctios ad derivative evaluatios at each step
More information5.6 Binomial Multi-section Matching Transformer
4/14/2010 5_6 Bioial Multisectio Matchig Trasforers 1/1 5.6 Bioial Multi-sectio Matchig Trasforer Readig Assiget: pp. 246-250 Oe way to axiize badwidth is to costruct a ultisectio Γ f that is axially flat.
More informationDefine a Markov chain on {1,..., 6} with transition probability matrix P =
Pla Group Work 0. The title says it all Next Tie: MCMC ad Geeral-state Markov Chais Midter Exa: Tuesday 8 March i class Hoework 4 due Thursday Uless otherwise oted, let X be a irreducible, aperiodic Markov
More informationSummer MA Lesson 13 Section 1.6, Section 1.7 (part 1)
Suer MA 1500 Lesso 1 Sectio 1.6, Sectio 1.7 (part 1) I Solvig Polyoial Equatios Liear equatio ad quadratic equatios of 1 variable are specific types of polyoial equatios. Soe polyoial equatios of a higher
More informationA.1 Algebra Review: Polynomials/Rationals. Definitions:
MATH 040 Notes: Uit 0 Page 1 A.1 Algera Review: Polyomials/Ratioals Defiitios: A polyomial is a sum of polyomial terms. Polyomial terms are epressios formed y products of costats ad variales with whole
More informationLecture 10: Bounded Linear Operators and Orthogonality in Hilbert Spaces
Lecture : Bouded Liear Operators ad Orthogoality i Hilbert Spaces 34 Bouded Liear Operator Let ( X, ), ( Y, ) i i be ored liear vector spaces ad { } X Y The, T is said to be bouded if a real uber c such
More informationSNAP Centre Workshop. Basic Algebraic Manipulation
SNAP Cetre Workshop Basic Algebraic Maipulatio 8 Simplifyig Algebraic Expressios Whe a expressio is writte i the most compact maer possible, it is cosidered to be simplified. Not Simplified: x(x + 4x)
More informationGame-Theoretic Analysis of the Nodal Pricing Mechanism for Electricity Markets
52d IEEE Coferece o Decisio ad Cotrol Deceber 10-13, 2013. Florece, Italy Gae-Theoretic Aalysis of the Nodal Pricig Mechais for Electricity Markets Weyua Tag ad Rahul Jai Abstract Nodal pricig is a ethodology
More informationDifferentiable Convex Functions
Differetiable Covex Fuctios The followig picture motivates Theorem 11. f ( x) f ( x) f '( x)( x x) ˆx x 1 Theorem 11 : Let f : R R be differetiable. The, f is covex o the covex set C R if, ad oly if for
More informationGRAPHING LINEAR EQUATIONS. Linear Equations ( 3,1 ) _x-axis. Origin ( 0, 0 ) Slope = change in y change in x. Equation for l 1.
GRAPHING LINEAR EQUATIONS Quadrat II Quadrat I ORDERED PAIR: The first umer i the ordered pair is the -coordiate ad the secod umer i the ordered pair is the y-coordiate. (,1 ) Origi ( 0, 0 ) _-ais Liear
More informationOrthogonal Functions
Royal Holloway Uiversity of odo Departet of Physics Orthogoal Fuctios Motivatio Aalogy with vectors You are probably failiar with the cocept of orthogoality fro vectors; two vectors are orthogoal whe they
More informationAnalysis of Algorithms. Introduction. Contents
Itroductio The focus of this module is mathematical aspects of algorithms. Our mai focus is aalysis of algorithms, which meas evaluatig efficiecy of algorithms by aalytical ad mathematical methods. We
More informationNUMERICAL METHODS FOR SOLVING EQUATIONS
Mathematics Revisio Guides Numerical Methods for Solvig Equatios Page 1 of 11 M.K. HOME TUITION Mathematics Revisio Guides Level: GCSE Higher Tier NUMERICAL METHODS FOR SOLVING EQUATIONS Versio:. Date:
More informationNote that the argument inside the second square root is always positive since R L > Z 0. The series reactance can be found as
Ipedace Matchig Ipedace Matchig Itroductio Ipedace atchig is the process to atch the load to a trasissio lie by a atchig etwork, as depicted i Fig Recall that the reflectios are eliiated uder the atched
More informationMIDTERM 3 CALCULUS 2. Monday, December 3, :15 PM to 6:45 PM. Name PRACTICE EXAM SOLUTIONS
MIDTERM 3 CALCULUS MATH 300 FALL 08 Moday, December 3, 08 5:5 PM to 6:45 PM Name PRACTICE EXAM S Please aswer all of the questios, ad show your work. You must explai your aswers to get credit. You will
More informationNICK DUFRESNE. 1 1 p(x). To determine some formulas for the generating function of the Schröder numbers, r(x) = a(x) =
AN INTRODUCTION TO SCHRÖDER AND UNKNOWN NUMBERS NICK DUFRESNE Abstract. I this article we will itroduce two types of lattice paths, Schröder paths ad Ukow paths. We will examie differet properties of each,
More informationChapter 7: The z-transform. Chih-Wei Liu
Chapter 7: The -Trasform Chih-Wei Liu Outlie Itroductio The -Trasform Properties of the Regio of Covergece Properties of the -Trasform Iversio of the -Trasform The Trasfer Fuctio Causality ad Stability
More informationQ-BINOMIALS AND THE GREATEST COMMON DIVISOR. Keith R. Slavin 8474 SW Chevy Place, Beaverton, Oregon 97008, USA.
INTEGERS: ELECTRONIC JOURNAL OF COMBINATORIAL NUMBER THEORY 8 2008, #A05 Q-BINOMIALS AND THE GREATEST COMMON DIVISOR Keith R. Slavi 8474 SW Chevy Place, Beaverto, Orego 97008, USA slavi@dsl-oly.et Received:
More informationMath 475, Problem Set #12: Answers
Math 475, Problem Set #12: Aswers A. Chapter 8, problem 12, parts (b) ad (d). (b) S # (, 2) = 2 2, sice, from amog the 2 ways of puttig elemets ito 2 distiguishable boxes, exactly 2 of them result i oe
More information