Global Optimization of Bilinear Generalized Disjunctive Programs
|
|
- Brent Lynch
- 5 years ago
- Views:
Transcription
1 Global Optmzaton o Blnear Generalzed Dsunctve Programs Juan Pablo Ruz Ignaco E. Grossmann Department o Chemcal Engneerng Center or Advanced Process Decson-mang Unversty Pttsburgh, PA
2 Non-Convex Dscrete/Contnuous Optmzaton Models Mxed Integer Program (MIP) - Most common non-lnear dscrete/contnuous optmzaton model. - Purely equaton-based. - I some unctons n MIP are non convex non-convex MINLP. Generalzed Dsunctve Program (GDP) - Developed by Raman & Grossmann (1994) - Combnaton o algebrac equatons, dsunctons and logc propostons. - Natural representaton o engneerng problems. - I some unctons n GDP are non convex non-convex GDP. - I all non lnear unctons are gven by blnear terms Blnear GDP. Goal: Global Optmzaton o Blnear GDP wth mproved relaxatons 2
3 Blnear Generalzed Dsunctve Programs Mn D Z = ( x) + s.t. g( x) 0 c K Y r ( x) 0 c = γ Obectve Functon Global Constrants Dsunctons K Blneartes x R Ω(Y)= True n,c R,Y {True,False} Logc Propostons D, K Process engneerng models. (e.g. HENS, Water Treatment Networs, Process Networs n general) Blneartes may lead to multple local mnma Global Optmzaton technques are requred Global optmzaton method by Lee & Grossmann (2001) Is ther relaxaton the tghtest? Relaxaton o Blnear terms usng McCormc envelopes leads to a LGDP Improved relaxatons or Lnear GDP has recently been obtaned (Sawaya & Grossmann, 2007) 3
4 LGDP to Dsunctve Programmng Reormulaton Sawaya N.W. and Grossmann I.E. (2006) T Mn Z = c + d x K st.. Bx b J J A x a K Ω ( Y) = True L U x x x Y { True, False} J, K c Y c = γ Y K 1 R K T Mn Z = c + d x K st.. Bx b J J = 1 A x a K L U x x x = 1 K 0 λ 1 J, K c Hλ h c λ λ = γ 1 R K LGDP Integralty λ guaranteed DP 4
5 Equvalent Dsunctve Programs Regular Form (RF): orm represented by ntersecton o unons o polyhedra There exsts many orms between CNF and DNF that are equvalent 5
6 Illustratve Example: Basc Steps Then F can be brought to DNF through 2 basc steps. 6
7 A Herarchy o Relaxatons or DP 7
8 A Herarchy o Relaxatons or GDP Proposton 4 (Sawaya & Grossmann, 2006) For = 1,2,... T + K 1 let regular orms o the dsunctve set: FGDP be a sequence o n+ J + K K : (,, ) : ˆ mn mn F = z = x λ c R b z b ˆ 0 ( A% ) z a% ) ( A z a ), such that T K% J ˆ n K m Jn ) F GDP 0 corresponds to the dsunctve orm: n+ J + K K F = z: = ( x, λ, c) R : b z b0 ( A z a ) ; T K J ) F GDP T + K 1 : = F s n DNF; t ) or = 1,2,... T + K 1, F GDP s obtaned rom F by a basc step. GDP 1 Then, h rel F h rel F L h rel F = clconv F = clconv F.(true convex hull) GDP GDP GDP GDP t 0 1 T + K 1 T + K 1 8
9 Blnear GDP Relaxaton Illustratve Example: Optmal reactor selecton Feasble regon proected onto the FX space F Demand F: Flow X: Converson GDP Formulaton Max Z = θfx γf CP Obectve Functon Demand constrant 8 I II Converson s.t. FX d Y11 F = α1x + β1 X1 X X CP = Cp1 1 Y21 F = α2x + β2 X 2 X X CP = Cp2 2 Reactor Curves Y11 Y21 = True Feasble Regon CP,X,F R F F F Y 11,,Y 21 {True, False} X 9
10 Blnear GDP Relaxaton (Lee & Grossmann 2001) F Blnear Terms 8 II Convex Envelopes Max Z = θp θfx γf CP CP s.t. FX P d P F.X + F.X - F.X P F.X + F.X F.X P F.X + F.X F.X P F.X + F.X F.X Relaxaton (No Basc Steps) I Convex Hull Relaxaton X Y11 F = α1x + β1 X1 X X CP = Cp1 1 Y11 Y21 = True CP,X,F R F F F Y 11,,Y 21 {True, False} Y21 F = α2x + β2 X 2 X X CP = Cp2 2 10
11 Blnear GDP Relaxaton Proposed Relaxaton F Blnear Terms 8 Relaxaton (Basc Steps) I II Convex Envelopes Convex Basc Hull Steps Relaxaton X Max Z = θp θfx γf CP CP s.t. FX P d Y11 P F.X + F.X - F.X Y21 P P d F.X + F.X F.X P d P F. X + F P. X F.X F +. XF.X F P.X F. X + F. X F P F.X P F. X + F. X F + F. X.X F.X P F. X + F. X F P F. X + F. X F. X P F. X + F. X F Y11 Y21 P F. X + F =. X α F. X 1X + β 1 FP = F α. + F. X F 2X + β2 F = α + 1X β 1 F = α2x + β2 X1 X X1 X 2 X X 2 X1 X CP X= 1 Cp X 2 X X 1 CP = Cp 2 2 CP = Cp1 CP = Cp2 Y11 Y21 = True CP,X,F R F F F Y 11,,Y 21 {True, False}. X. X. X. X 11
12 F 8 Blnear GDP Relaxaton Comparson Relaxaton (Lee & Grossmann, 2001) Actual Feasble Regon Proposed Relaxaton X The applcaton o basc steps pror to the dscrete relaxaton leads to a tghter relaxed easble regon 12
13 Rules to apply basc steps. When they mae a derence. Motvatng example: (cl conv S 2 ) (cl conv S 1 ) S 1 = P 1 P 2 P 1 S 2 = P 3 P 4 Extreme ponts P 3 P 4 P 2 cl conv ( S 2 S 1 ) No basc steps are necessary! In general the hypothess o the theorem s not easy to very To gan nsght, the structure o the program should be exploted 13
14 Rules to apply basc steps. When they mae a derence. Proposton : Let S 1 and S 2 be two dsunctons n whch the varables restrcted n S are not restrcted n the S (=1,2 ; =1,2 and ) Then the system satses the hypothess o theorem 4.2. Example: cl conv ( S 2 S 1 ) (cl conv S 2 ) (cl conv S 1 ) x 1 x 1 S 1 S 2 x 2 x 2 14
15 Summary o practcal rules to apply basc steps Apply basc steps between those dsunctons wth at least one varable n common. The more varables n common two dsunctons have the more the tghtenng expected I blneartes are outsde the dsunctons apply basc steps by ntroducng them n the dsunctons prevous to the relaxaton. I blneartes are nsde the dsunctons a less tghtenng eect s expected. A less ncrease n the sze o the ormulaton s expected when basc steps are appled between mproper dsunctons and proper dsunctons. 15
16 Methodology Step 1: GDP reormulaton (Apply basc steps ollowng the rules presented) Step 2: Bound Contracton (Zamora & Grossmann, 1999) Step 3: Branch and Bound Procedure (Lee & Grossmann, 2001) Spatal B&B Contractng Bounds Intersectng dsunctons 16
17 Case Study I: Water treatment networ desgn Process superstructure Generalzed Dsunctve Program S2 S1 M1 M2 A/B/C D/E/F S4 S5 M4 Mn Z = CP PU s.t. S = M = MU SU S3 M3 G/H/I S6 S ζ = 1 SU S1 N o cont. vars. : 114 N o dsc. vars. : 9 N o blnear terms: 36 Optmal structure M1 A S4 D h = ζ h YP h = β ' F =,, OPU CP = OPU F S, ' IPU, SU PU 0 ζ 1, S2 M2 D S5 M4 0,,, 0 CP S3 Z* = YP h { true, alse} h D PU 17
18 Case Study II: Poolng networ desgn Process superstructure Stream Pool Product S1 S2 S3 S4 S5 S1 S2 S5 P1 P2 P3 P4 N o cont. vars. : 76 N o dsc. vars. : 9 N o blnear terms: 24 Optmal structure Stream Pool Product P1 P3 Z* = w Generalzed Dsunctve Program Mn Z = CP + CST + c w d s.t. YP lo w I w W w = w, w W K I = ζ w, w W, K I ζ = 1 K CP = γ I w W J w W w w = J I J I w W K J w W K w W S w = λ w w' w' W Z = 0 w w J J w' W lo YST J w W CST = α w 0 ζ 1;0, w w w J K I, J, w W ' = 0 K, w W YST w = 0 CST = 0 w w up w w 0 CST, CP ; YST, YP { true, alse} YP = 0, I, w W = 0, K, w W CP = 0 I J 18
19 Perormance Global Optmzaton Technque usng Lee & Grossmann relaxaton Global Optmzaton Technque usng proposed relaxaton Relatve Improvement Example 1 Intal Lower Bound % Bound contracton 99.7% Nodes % Global Optmzaton Technque usng Lee & Grossmann relaxaton Global Optmzaton Technque usng proposed relaxaton Relatve Improvement Example 2 Intal Lower Bound % Bound contracton 8% Nodes % 19
20 Conclusons and Remars Tghter reormulaton o blnear GDPs. Proposed general rules to mplement basc steps. Proposed methodology to solve Blnear GDPs. Applcaton n two cases showed mproved perormance. 20
Generalized disjunctive programming: A framework for formulation and alternative algorithms for MINLP optimization
Generalzed dsunctve programmng: A framewor for formulaton and alternatve algorthms for MINLP optmzaton Ignaco E. Grossmann Center for Advanced Process Decson-mang Carnege Mellon Unversty Pttsburgh PA 15213
More informationStrengthening of Lower Bounds in the Global Optimization of Bilinear and Concave Generalized Disjunctive Programs
Strengthenng of Lower Bounds n the Gbal Optmzaton of Blnear and Concave Generalzed Dsunctve Programs Juan Pab Ruz, Ignaco Grossmann* Department of Chemcal Engneerng, Carnege Meln Unversty Pttsburgh, PA,
More informationRecent Developments in Disjunctive Programming
Recent Developments n Dsjunctve Programmng Aldo Vecchett (*) and Ignaco E. Grossmann (**) (*) INGAR Insttuto de Desarrollo Dseño Unversdad Tecnologca Naconal Santa Fe Argentna e-mal: aldovec@alpha.arcrde.edu.ar
More informationExxonMobil. Juan Pablo Ruiz Ignacio E. Grossmann. Department of Chemical Engineering Center for Advanced Process Decision-making. Pittsburgh, PA 15213
ExxonMobl Multperod Blend Schedulng Problem Juan Pablo Ruz Ignaco E. Grossmann Department of Chemcal Engneerng Center for Advanced Process Decson-makng Unversty Pttsburgh, PA 15213 1 Motvaton - Large cost
More informationOptimization Methods for Engineering Design. Logic-Based. John Hooker. Turkish Operational Research Society. Carnegie Mellon University
Logc-Based Optmzaton Methods for Engneerng Desgn John Hooker Carnege Mellon Unerst Turksh Operatonal Research Socet Ankara June 1999 Jont work wth: Srnas Bollapragada General Electrc R&D Omar Ghattas Cl
More informationHierarchy of Relaxations for Convex. and Extension to Nonconvex Problems
Hierarchy of Relaations for Conve Nonlinear Generalized Disjunctive Programs and Etension to Nonconve Problems Ignacio Grossmann Sangbum Lee, Juan Pablo Ruiz, Nic Sawaya Center for Advanced Process Decision-maing
More informationSimultaneous BOP Selection and Controller Design for the FCC Process
Smultaneous BOP Selecton and Controller Desgn for the FCC Process Benjamn Omell & Donald J. Chmelewsk Department of Chemcal & Bologcal Engneerng Outlne Motvatng Example Introducton to BOP Selecton and
More informationA Modeling System to Combine Optimization and Constraint. Programming. INFORMS, November Carnegie Mellon University.
A Modelng Sstem to Combne Optmzaton and Constrant Programmng John Hooker Carnege Mellon Unverst INFORMS November 000 Based on ont work wth Ignaco Grossmann Hak-Jn Km Mara Axlo Osoro Greger Ottosson Erlendr
More informationprinceton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg
prnceton unv. F 17 cos 521: Advanced Algorthm Desgn Lecture 7: LP Dualty Lecturer: Matt Wenberg Scrbe: LP Dualty s an extremely useful tool for analyzng structural propertes of lnear programs. Whle there
More informationGlobal Optimization of Truss. Structure Design INFORMS J. N. Hooker. Tallys Yunes. Slide 1
Slde 1 Global Optmzaton of Truss Structure Desgn J. N. Hooker Tallys Yunes INFORMS 2010 Truss Structure Desgn Select sze of each bar (possbly zero) to support the load whle mnmzng weght. Bar szes are dscrete.
More informationOn the Multicriteria Integer Network Flow Problem
BULGARIAN ACADEMY OF SCIENCES CYBERNETICS AND INFORMATION TECHNOLOGIES Volume 5, No 2 Sofa 2005 On the Multcrtera Integer Network Flow Problem Vassl Vasslev, Marana Nkolova, Maryana Vassleva Insttute of
More informationRepresentation Theorem for Convex Nonparametric Least Squares. Timo Kuosmanen
Representaton Theorem or Convex Nonparametrc Least Squares Tmo Kuosmanen 4th Nordc Econometrc Meetng, Tartu, Estona, 4-6 May 007 Motvaton Inerences oten depend crtcally upon the algebrac orm chosen. It
More informationVisualization of the Economic Impact of Process Uncertainty in Multivariable Control Design
Vsualzaton of the Economc Impact of Process Uncertanty n Multvarable Control Desgn Benjamn Omell & Donald J. Chmelewsk Department of Chemcal & Bologcal Engneerng Illnos Insttute of echnology Mass r r max
More informationIncremental and Encoding Formulations for Mixed Integer Programming
Incremental and Encodng Formulatons for Mxed Integer Programmng Sercan Yıldız a, Juan Pablo Velma b,c, a Tepper School of Busness, Carnege Mellon Unversty, 5000 Forbes Ave, Pttsburgh, PA 523, Unted States
More informationAn Interactive Optimisation Tool for Allocation Problems
An Interactve Optmsaton ool for Allocaton Problems Fredr Bonäs, Joam Westerlund and apo Westerlund Process Desgn Laboratory, Faculty of echnology, Åbo Aadem Unversty, uru 20500, Fnland hs paper presents
More informationSome modelling aspects for the Matlab implementation of MMA
Some modellng aspects for the Matlab mplementaton of MMA Krster Svanberg krlle@math.kth.se Optmzaton and Systems Theory Department of Mathematcs KTH, SE 10044 Stockholm September 2004 1. Consdered optmzaton
More informationLecture 20: Lift and Project, SDP Duality. Today we will study the Lift and Project method. Then we will prove the SDP duality theorem.
prnceton u. sp 02 cos 598B: algorthms and complexty Lecture 20: Lft and Project, SDP Dualty Lecturer: Sanjeev Arora Scrbe:Yury Makarychev Today we wll study the Lft and Project method. Then we wll prove
More informationSingle-Facility Scheduling over Long Time Horizons by Logic-based Benders Decomposition
Sngle-Faclty Schedulng over Long Tme Horzons by Logc-based Benders Decomposton Elvn Coban and J. N. Hooker Tepper School of Busness, Carnege Mellon Unversty ecoban@andrew.cmu.edu, john@hooker.tepper.cmu.edu
More informationNew Algorithm for the Flexibility Index Problem of Quadratic Systems
New Algorthm or the Flexblty Index Problem o Quadratc Systems Hao Jang a, Bngzhen Chen a*, Ignaco E. Grossmann b* a Insttute o Process Systems Engneerng, Dept. o Chemcal Engneerng, Tsnghua nversty, Beng
More informationEEL 6266 Power System Operation and Control. Chapter 3 Economic Dispatch Using Dynamic Programming
EEL 6266 Power System Operaton and Control Chapter 3 Economc Dspatch Usng Dynamc Programmng Pecewse Lnear Cost Functons Common practce many utltes prefer to represent ther generator cost functons as sngle-
More informationCollege of Computer & Information Science Fall 2009 Northeastern University 20 October 2009
College of Computer & Informaton Scence Fall 2009 Northeastern Unversty 20 October 2009 CS7880: Algorthmc Power Tools Scrbe: Jan Wen and Laura Poplawsk Lecture Outlne: Prmal-dual schema Network Desgn:
More informationLecture 2 Solution of Nonlinear Equations ( Root Finding Problems )
Lecture Soluton o Nonlnear Equatons Root Fndng Problems Dentons Classcaton o Methods Analytcal Solutons Graphcal Methods Numercal Methods Bracketng Methods Open Methods Convergence Notatons Root Fndng
More informationU.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017
U.C. Berkeley CS94: Beyond Worst-Case Analyss Handout 4s Luca Trevsan September 5, 07 Summary of Lecture 4 In whch we ntroduce semdefnte programmng and apply t to Max Cut. Semdefnte Programmng Recall that
More information: Numerical Analysis Topic 2: Solution of Nonlinear Equations Lectures 5-11:
764: Numercal Analyss Topc : Soluton o Nonlnear Equatons Lectures 5-: UIN Malang Read Chapters 5 and 6 o the tetbook 764_Topc Lecture 5 Soluton o Nonlnear Equatons Root Fndng Problems Dentons Classcaton
More informationUsing T.O.M to Estimate Parameter of distributions that have not Single Exponential Family
IOSR Journal of Mathematcs IOSR-JM) ISSN: 2278-5728. Volume 3, Issue 3 Sep-Oct. 202), PP 44-48 www.osrjournals.org Usng T.O.M to Estmate Parameter of dstrbutons that have not Sngle Exponental Famly Jubran
More informationPortfolios with Trading Constraints and Payout Restrictions
Portfolos wth Tradng Constrants and Payout Restrctons John R. Brge Northwestern Unversty (ont wor wth Chrs Donohue Xaodong Xu and Gongyun Zhao) 1 General Problem (Very) long-term nvestor (eample: unversty
More informationConvexity preserving interpolation by splines of arbitrary degree
Computer Scence Journal of Moldova, vol.18, no.1(52), 2010 Convexty preservng nterpolaton by splnes of arbtrary degree Igor Verlan Abstract In the present paper an algorthm of C 2 nterpolaton of dscrete
More informationSolutions HW #2. minimize. Ax = b. Give the dual problem, and make the implicit equality constraints explicit. Solution.
Solutons HW #2 Dual of general LP. Fnd the dual functon of the LP mnmze subject to c T x Gx h Ax = b. Gve the dual problem, and make the mplct equalty constrants explct. Soluton. 1. The Lagrangan s L(x,
More informationFinite Difference Method
7/0/07 Instructor r. Ramond Rump (9) 747 698 rcrump@utep.edu EE 337 Computatonal Electromagnetcs (CEM) Lecture #0 Fnte erence Method Lecture 0 These notes ma contan coprghted materal obtaned under ar use
More informationModule 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur
Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:
More informationVQ widely used in coding speech, image, and video
at Scalar quantzers are specal cases of vector quantzers (VQ): they are constraned to look at one sample at a tme (memoryless) VQ does not have such constrant better RD perfomance expected Source codng
More informationDonald J. Chmielewski and David Mendoza-Serrano Department of Chemical and Biological Engineering Illinois Institute of Technology
Multstage Stochastc Programmng for the Desgn of Smart Grd Coordnated Buldng HVAC Systems Donald J. Chmelews and Davd Mendoa-Serrano Department of Chemcal and Bologcal Engneerng Illnos Insttute of echnology
More informationLecture 10 Support Vector Machines. Oct
Lecture 10 Support Vector Machnes Oct - 20-2008 Lnear Separators Whch of the lnear separators s optmal? Concept of Margn Recall that n Perceptron, we learned that the convergence rate of the Perceptron
More informationLagrange Multipliers Kernel Trick
Lagrange Multplers Kernel Trck Ncholas Ruozz Unversty of Texas at Dallas Based roughly on the sldes of Davd Sontag General Optmzaton A mathematcal detour, we ll come back to SVMs soon! subject to: f x
More informationEE 330 Lecture 24. Small Signal Analysis Small Signal Analysis of BJT Amplifier
EE 0 Lecture 4 Small Sgnal Analss Small Sgnal Analss o BJT Ampler Eam Frda March 9 Eam Frda Aprl Revew Sesson or Eam : 6:00 p.m. on Thursda March 8 n Room Sweene 6 Revew rom Last Lecture Comparson o Gans
More informationSOLVING CAPACITATED VEHICLE ROUTING PROBLEMS WITH TIME WINDOWS BY GOAL PROGRAMMING APPROACH
Proceedngs of IICMA 2013 Research Topc, pp. xx-xx. SOLVIG CAPACITATED VEHICLE ROUTIG PROBLEMS WITH TIME WIDOWS BY GOAL PROGRAMMIG APPROACH ATMII DHORURI 1, EMIUGROHO RATA SARI 2, AD DWI LESTARI 3 1Department
More informationGlobal Optimization of Bilinear Programs with a. Multiparametric Disaggregation Technique
Global Optmzaton of Blnear Programs wth a Multparametrc Dsaggregaton Technue Scott Kolodze a Pedro M. Castro b and Ignaco E. Grossmann a* a Department of Chemcal Engneerng Carnege Mellon nversty Pttsburgh
More informationIncremental and Encoding Formulations for Mixed Integer Programming
Incremental and Encodng Formulatons for Mxed Integer Programmng Sercan Yıldız a, Juan Pablo Velma b,c, a Tepper School of Busness, Carnege Mellon Unversty, 5000 Forbes Ave., Pttsburgh, PA 15213, Unted
More informationEconomics 101. Lecture 4 - Equilibrium and Efficiency
Economcs 0 Lecture 4 - Equlbrum and Effcency Intro As dscussed n the prevous lecture, we wll now move from an envronment where we looed at consumers mang decsons n solaton to analyzng economes full of
More information18-660: Numerical Methods for Engineering Design and Optimization
8-66: Numercal Methods for Engneerng Desgn and Optmzaton n L Department of EE arnege Mellon Unversty Pttsburgh, PA 53 Slde Overve lassfcaton Support vector machne Regularzaton Slde lassfcaton Predct categorcal
More informationFUZZY GOAL PROGRAMMING VS ORDINARY FUZZY PROGRAMMING APPROACH FOR MULTI OBJECTIVE PROGRAMMING PROBLEM
Internatonal Conference on Ceramcs, Bkaner, Inda Internatonal Journal of Modern Physcs: Conference Seres Vol. 22 (2013) 757 761 World Scentfc Publshng Company DOI: 10.1142/S2010194513010982 FUZZY GOAL
More informationFrequency-Domain Analysis of Transmission Line Circuits (Part 1)
Frequency-Doman Analyss of Transmsson Lne Crcuts (Part ) Outlne -port networs mpedance matrx representaton Admttance matrx representaton catterng matrx representaton eanng of the -parameters Generalzed
More informationLinear, affine, and convex sets and hulls In the sequel, unless otherwise specified, X will denote a real vector space.
Lnear, affne, and convex sets and hulls In the sequel, unless otherwse specfed, X wll denote a real vector space. Lnes and segments. Gven two ponts x, y X, we defne xy = {x + t(y x) : t R} = {(1 t)x +
More informationEffective Power Optimization combining Placement, Sizing, and Multi-Vt techniques
Effectve Power Optmzaton combnng Placement, Szng, and Mult-Vt technques Tao Luo, Davd Newmark*, and Davd Z Pan Department of Electrcal and Computer Engneerng, Unversty of Texas at Austn *Advanced Mcro
More informationCombining Constraint Programming and Integer Programming
Combnng Constrant Programmng and Integer Programmng GLOBAL CONSTRAINT OPTIMIZATION COMPONENT Specal Purpose Algorthm mn c T x +(x- 0 ) x( + ()) =1 x( - ()) =1 FILTERING ALGORITHM COST-BASED FILTERING ALGORITHM
More informationUsing Convex Nonlinear Relaxations in the Global Optimization of Nonconvex Generalized Disjunctive Programs
Using Convex Nonlinear Relaxations in the Global Optimization of Nonconvex Generalized Disjunctive Programs Juan P. Ruiz, Ignacio E. Grossmann Carnegie Mellon University - Department of Chemical Engineering
More informationThe Study of Teaching-learning-based Optimization Algorithm
Advanced Scence and Technology Letters Vol. (AST 06), pp.05- http://dx.do.org/0.57/astl.06. The Study of Teachng-learnng-based Optmzaton Algorthm u Sun, Yan fu, Lele Kong, Haolang Q,, Helongang Insttute
More informationMMA and GCMMA two methods for nonlinear optimization
MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons
More informationFlexible Allocation of Capacity in Multi-Cell CDMA Networks
Flexble Allocaton of Capacty n Mult-Cell CDMA Networs Robert Al, Manu Hegde, Mort Naragh-Pour*, Paul Mn Washngton Unversty, St. Lous, MO *Lousana State Unversty, Baton Rouge, LA Outlne Capacty and Probablty
More informationCHAPTER 4d. ROOTS OF EQUATIONS
CHAPTER 4d. ROOTS OF EQUATIONS A. J. Clark School o Engneerng Department o Cvl and Envronmental Engneerng by Dr. Ibrahm A. Assakka Sprng 00 ENCE 03 - Computaton Methods n Cvl Engneerng II Department o
More informationSolutions to exam in SF1811 Optimization, Jan 14, 2015
Solutons to exam n SF8 Optmzaton, Jan 4, 25 3 3 O------O -4 \ / \ / The network: \/ where all lnks go from left to rght. /\ / \ / \ 6 O------O -5 2 4.(a) Let x = ( x 3, x 4, x 23, x 24 ) T, where the varable
More informationProbability, Statistics, and Reliability for Engineers and Scientists SIMULATION
CHATER robablty, Statstcs, and Relablty or Engneers and Scentsts Second Edton SIULATIO A. J. Clark School o Engneerng Department o Cvl and Envronmental Engneerng 7b robablty and Statstcs or Cvl Engneers
More informationAn Integrated OR/CP Method for Planning and Scheduling
An Integrated OR/CP Method for Plannng and Schedulng John Hooer Carnege Mellon Unversty IT Unversty of Copenhagen June 2005 The Problem Allocate tass to facltes. Schedule tass assgned to each faclty. Subect
More informationCIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M
CIS56: achne Learnng Lecture 3 (Sept 6, 003) Preparaton help: Xaoyng Huang Lnear Regresson Lnear regresson can be represented by a functonal form: f(; θ) = θ 0 0 +θ + + θ = θ = 0 ote: 0 s a dummy attrbute
More informationSELECTED SOLUTIONS, SECTION (Weak duality) Prove that the primal and dual values p and d defined by equations (4.3.2) and (4.3.3) satisfy p d.
SELECTED SOLUTIONS, SECTION 4.3 1. Weak dualty Prove that the prmal and dual values p and d defned by equatons 4.3. and 4.3.3 satsfy p d. We consder an optmzaton problem of the form The Lagrangan for ths
More informationCISE301: Numerical Methods Topic 2: Solution of Nonlinear Equations
CISE3: Numercal Methods Topc : Soluton o Nonlnear Equatons Dr. Amar Khoukh Term Read Chapters 5 and 6 o the tetbook CISE3_Topc c Khoukh_ Lecture 5 Soluton o Nonlnear Equatons Root ndng Problems Dentons
More informationChapter 2 A Class of Robust Solution for Linear Bilevel Programming
Chapter 2 A Class of Robust Soluton for Lnear Blevel Programmng Bo Lu, Bo L and Yan L Abstract Under the way of the centralzed decson-makng, the lnear b-level programmng (BLP) whose coeffcents are supposed
More informationChapter Newton s Method
Chapter 9. Newton s Method After readng ths chapter, you should be able to:. Understand how Newton s method s dfferent from the Golden Secton Search method. Understand how Newton s method works 3. Solve
More informationInteractive Bi-Level Multi-Objective Integer. Non-linear Programming Problem
Appled Mathematcal Scences Vol 5 0 no 65 3 33 Interactve B-Level Mult-Objectve Integer Non-lnear Programmng Problem O E Emam Department of Informaton Systems aculty of Computer Scence and nformaton Helwan
More informationWhat is LP? LP is an optimization technique that allocates limited resources among competing activities in the best possible manner.
(C) 998 Gerald B Sheblé, all rghts reserved Lnear Prograng Introducton Contents I. What s LP? II. LP Theor III. The Splex Method IV. Refneents to the Splex Method What s LP? LP s an optzaton technque that
More informationP R. Lecture 4. Theory and Applications of Pattern Recognition. Dept. of Electrical and Computer Engineering /
Theory and Applcatons of Pattern Recognton 003, Rob Polkar, Rowan Unversty, Glassboro, NJ Lecture 4 Bayes Classfcaton Rule Dept. of Electrcal and Computer Engneerng 0909.40.0 / 0909.504.04 Theory & Applcatons
More informationLine Drawing and Clipping Week 1, Lecture 2
CS 43 Computer Graphcs I Lne Drawng and Clppng Week, Lecture 2 Davd Breen, Wllam Regl and Maxm Peysakhov Geometrc and Intellgent Computng Laboratory Department of Computer Scence Drexel Unversty http://gcl.mcs.drexel.edu
More informationVARIATION OF CONSTANT SUM CONSTRAINT FOR INTEGER MODEL WITH NON UNIFORM VARIABLES
VARIATION OF CONSTANT SUM CONSTRAINT FOR INTEGER MODEL WITH NON UNIFORM VARIABLES BÂRZĂ, Slvu Faculty of Mathematcs-Informatcs Spru Haret Unversty barza_slvu@yahoo.com Abstract Ths paper wants to contnue
More informationInner Product. Euclidean Space. Orthonormal Basis. Orthogonal
Inner Product Defnton 1 () A Eucldean space s a fnte-dmensonal vector space over the reals R, wth an nner product,. Defnton 2 (Inner Product) An nner product, on a real vector space X s a symmetrc, blnear,
More informationPerfect Competition and the Nash Bargaining Solution
Perfect Competton and the Nash Barganng Soluton Renhard John Department of Economcs Unversty of Bonn Adenauerallee 24-42 53113 Bonn, Germany emal: rohn@un-bonn.de May 2005 Abstract For a lnear exchange
More informationHeuristic Algorithm for Finding Sensitivity Analysis in Interval Solid Transportation Problems
Internatonal Journal of Innovatve Research n Advanced Engneerng (IJIRAE) ISSN: 349-63 Volume Issue 6 (July 04) http://rae.com Heurstc Algorm for Fndng Senstvty Analyss n Interval Sold Transportaton Problems
More informationGeneralized Linear Methods
Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set
More informationUsing Convex Nonlinear Relaxations in the Global Optimization of Nonconvex Generalized Disjunctive Programs
Using Convex Nonlinear Relaxations in the Global Optimization of Nonconvex Generalized Disjunctive Programs Juan P. Ruiz, Ignacio E. Grossmann Carnegie Mellon University - Department of Chemical Engineering
More informationPlanning and Scheduling to Minimize Makespan & Tardiness. John Hooker Carnegie Mellon University September 2006
Plannng and Schedulng to Mnmze Makespan & ardness John Hooker Carnege Mellon Unversty September 2006 he Problem Gven a set of tasks, each wth a deadlne 2 he Problem Gven a set of tasks, each wth a deadlne
More informationOptimization. Nuno Vasconcelos ECE Department, UCSD
Optmzaton Nuno Vasconcelos ECE Department, UCSD Optmzaton many engneerng problems bol on to optmzaton goal: n mamum or mnmum o a uncton Denton: gven unctons, g,,...,k an h,,...m ene on some oman Ω R n
More information10.34 Numerical Methods Applied to Chemical Engineering Fall Homework #3: Systems of Nonlinear Equations and Optimization
10.34 Numercal Methods Appled to Chemcal Engneerng Fall 2015 Homework #3: Systems of Nonlnear Equatons and Optmzaton Problem 1 (30 ponts). A (homogeneous) azeotrope s a composton of a multcomponent mxture
More informationComputing Correlated Equilibria in Multi-Player Games
Computng Correlated Equlbra n Mult-Player Games Chrstos H. Papadmtrou Presented by Zhanxang Huang December 7th, 2005 1 The Author Dr. Chrstos H. Papadmtrou CS professor at UC Berkley (taught at Harvard,
More informationConvex Optimization. Optimality conditions. (EE227BT: UC Berkeley) Lecture 9 (Optimality; Conic duality) 9/25/14. Laurent El Ghaoui.
Convex Optmzaton (EE227BT: UC Berkeley) Lecture 9 (Optmalty; Conc dualty) 9/25/14 Laurent El Ghaou Organsatonal Mdterm: 10/7/14 (1.5 hours, n class, double-sded cheat sheet allowed) Project: Intal proposal
More informationNow we relax this assumption and allow that the error variance depends on the independent variables, i.e., heteroskedasticity
ECON 48 / WH Hong Heteroskedastcty. Consequences of Heteroskedastcty for OLS Assumpton MLR. 5: Homoskedastcty var ( u x ) = σ Now we relax ths assumpton and allow that the error varance depends on the
More informationNonlinear Classifiers II
Nonlnear Classfers II Nonlnear Classfers: Introducton Classfers Supervsed Classfers Lnear Classfers Perceptron Least Squares Methods Lnear Support Vector Machne Nonlnear Classfers Part I: Mult Layer Neural
More informationLocal Approximation of Pareto Surface
Proceedngs o the World Congress on Engneerng 007 Vol II Local Approxmaton o Pareto Surace S.V. Utyuzhnkov, J. Magnot, and M.D. Guenov Abstract In the desgn process o complex systems, the desgner s solvng
More informationRobust observed-state feedback design. for discrete-time systems rational in the uncertainties
Robust observed-state feedback desgn for dscrete-tme systems ratonal n the uncertantes Dmtr Peaucelle Yosho Ebhara & Yohe Hosoe Semnar at Kolloquum Technsche Kybernetk, May 10, 016 Unversty of Stuttgart
More information10) Activity analysis
3C3 Mathematcal Methods for Economsts (6 cr) 1) Actvty analyss Abolfazl Keshvar Ph.D. Aalto Unversty School of Busness Sldes orgnally by: Tmo Kuosmanen Updated by: Abolfazl Keshvar 1 Outlne Hstorcal development
More informationBasic Statistical Analysis and Yield Calculations
October 17, 007 Basc Statstcal Analyss and Yeld Calculatons Dr. José Ernesto Rayas Sánchez 1 Outlne Sources of desgn-performance uncertanty Desgn and development processes Desgn for manufacturablty A general
More information36.1 Why is it important to be able to find roots to systems of equations? Up to this point, we have discussed how to find the solution to
ChE Lecture Notes - D. Keer, 5/9/98 Lecture 6,7,8 - Rootndng n systems o equatons (A) Theory (B) Problems (C) MATLAB Applcatons Tet: Supplementary notes rom Instructor 6. Why s t mportant to be able to
More informationNumerical Methods Solution of Nonlinear Equations
umercal Methods Soluton o onlnear Equatons Lecture Soluton o onlnear Equatons Root Fndng Prolems Dentons Classcaton o Methods Analytcal Solutons Graphcal Methods umercal Methods Bracketng Methods Open
More informationAdaptive multi-point sequential sampling methodology for highly nonlinear automotive crashworthiness design problems
11 th World Congress on Structural and Multdscplnary Optmsaton 07 th -12 th, June 2015, Sydney Australa Adaptve mult-pont sequental samplng methodology or hghly nonlnear automotve crashworthness desgn
More informationThe Karush-Kuhn-Tucker. Nuno Vasconcelos ECE Department, UCSD
e Karus-Kun-ucker condtons and dualt Nuno Vasconcelos ECE Department, UCSD Optmzaton goal: nd mamum or mnmum o a uncton Denton: gven unctons, g, 1,...,k and, 1,...m dened on some doman Ω R n mn w, w Ω
More informationDigital Signal Processing
Dgtal Sgnal Processng Dscrete-tme System Analyss Manar Mohasen Offce: F8 Emal: manar.subh@ut.ac.r School of IT Engneerng Revew of Precedent Class Contnuous Sgnal The value of the sgnal s avalable over
More informationUsing the estimated penetrances to determine the range of the underlying genetic model in casecontrol
Georgetown Unversty From the SelectedWorks of Mark J Meyer 8 Usng the estmated penetrances to determne the range of the underlyng genetc model n casecontrol desgn Mark J Meyer Neal Jeffres Gang Zheng Avalable
More informationFIRST AND SECOND ORDER NECESSARY OPTIMALITY CONDITIONS FOR DISCRETE OPTIMAL CONTROL PROBLEMS
Yugoslav Journal of Operatons Research 6 (6), umber, 53-6 FIRST D SECOD ORDER ECESSRY OPTIMLITY CODITIOS FOR DISCRETE OPTIML COTROL PROBLEMS Boban MRIKOVIĆ Faculty of Mnng and Geology, Unversty of Belgrade
More informationMeshless Surfaces. presented by Niloy J. Mitra. An Nguyen
Meshless Surfaces presented by Nloy J. Mtra An Nguyen Outlne Mesh-Independent Surface Interpolaton D. Levn Outlne Mesh-Independent Surface Interpolaton D. Levn Pont Set Surfaces M. Alexa, J. Behr, D. Cohen-Or,
More informationThe Ordinary Least Squares (OLS) Estimator
The Ordnary Least Squares (OLS) Estmator 1 Regresson Analyss Regresson Analyss: a statstcal technque for nvestgatng and modelng the relatonshp between varables. Applcatons: Engneerng, the physcal and chemcal
More informationA 2D Bounded Linear Program (H,c) 2D Linear Programming
A 2D Bounded Lnear Program (H,c) h 3 v h 8 h 5 c h 4 h h 6 h 7 h 2 2D Lnear Programmng C s a polygonal regon, the ntersecton of n halfplanes. (H, c) s nfeasble, as C s empty. Feasble regon C s unbounded
More informationSupport Vector Machines
Support Vector Machnes Konstantn Tretyakov (kt@ut.ee) MTAT.03.227 Machne Learnng So far Supervsed machne learnng Lnear models Least squares regresson Fsher s dscrmnant, Perceptron, Logstc model Non-lnear
More informationSupporting Information
Supportng Informaton The neural network f n Eq. 1 s gven by: f x l = ReLU W atom x l + b atom, 2 where ReLU s the element-wse rectfed lnear unt, 21.e., ReLUx = max0, x, W atom R d d s the weght matrx to
More informationPROBABILITY PRIMER. Exercise Solutions
PROBABILITY PRIMER Exercse Solutons 1 Probablty Prmer, Exercse Solutons, Prncples of Econometrcs, e EXERCISE P.1 (b) X s a random varable because attendance s not known pror to the outdoor concert. Before
More informationAppendix B. The Finite Difference Scheme
140 APPENDIXES Appendx B. The Fnte Dfference Scheme In ths appendx we present numercal technques whch are used to approxmate solutons of system 3.1 3.3. A comprehensve treatment of theoretcal and mplementaton
More informationEn Route Traffic Optimization to Reduce Environmental Impact
En Route Traffc Optmzaton to Reduce Envronmental Impact John-Paul Clarke Assocate Professor of Aerospace Engneerng Drector of the Ar Transportaton Laboratory Georga Insttute of Technology Outlne 1. Introducton
More informationThe Second Anti-Mathima on Game Theory
The Second Ant-Mathma on Game Theory Ath. Kehagas December 1 2006 1 Introducton In ths note we wll examne the noton of game equlbrum for three types of games 1. 2-player 2-acton zero-sum games 2. 2-player
More informationTests of Single Linear Coefficient Restrictions: t-tests and F-tests. 1. Basic Rules. 2. Testing Single Linear Coefficient Restrictions
ECONOMICS 35* -- NOTE ECON 35* -- NOTE Tests of Sngle Lnear Coeffcent Restrctons: t-tests and -tests Basc Rules Tests of a sngle lnear coeffcent restrcton can be performed usng ether a two-taled t-test
More informationPHYS 705: Classical Mechanics. Calculus of Variations II
1 PHYS 705: Classcal Mechancs Calculus of Varatons II 2 Calculus of Varatons: Generalzaton (no constrant yet) Suppose now that F depends on several dependent varables : We need to fnd such that has a statonary
More informationAssortment Optimization under MNL
Assortment Optmzaton under MNL Haotan Song Aprl 30, 2017 1 Introducton The assortment optmzaton problem ams to fnd the revenue-maxmzng assortment of products to offer when the prces of products are fxed.
More informationUsing the Minimum Set of Input Combinations to Minimize the Area of Local Routing Networks in Logic Clusters. FPGAs. Andy Ye Ryerson University
Usng the Mnmum Set of Input Combnatons to Mnmze the Area of Local Routng Networks n Logc Clusters Contanng Logcally Equvalent I/Os n FPGAs Andy Ye Ryerson Unversty Mnmum-area IIBs how to mnmze the area
More informationNeuro-Adaptive Design - I:
Lecture 36 Neuro-Adaptve Desgn - I: A Robustfyng ool for Dynamc Inverson Desgn Dr. Radhakant Padh Asst. Professor Dept. of Aerospace Engneerng Indan Insttute of Scence - Bangalore Motvaton Perfect system
More information