A Modeling System to Combine Optimization and Constraint. Programming. INFORMS, November Carnegie Mellon University.

Size: px
Start display at page:

Download "A Modeling System to Combine Optimization and Constraint. Programming. INFORMS, November Carnegie Mellon University."

Transcription

1 A Modelng Sstem to Combne Optmzaton and Constrant Programmng John Hooker Carnege Mellon Unverst INFORMS November 000

2 Based on ont work wth Ignaco Grossmann Hak-Jn Km Mara Axlo Osoro Greger Ottosson Erlendr Thorstensson

3 Goal Desgn a modelng langage whose sntax ndcates how optmzaton and constrant programmng can combne to solve the problem.

4 Wh Combne Optmzaton and Constrant Programmng? Some constrants n a gven problem propagate well and others relax well. Constrant programmng ses constrant propagaton to redce domans sets of possble vales of varables and so redce branchng. Optmzaton ses easl-solved relaxatons to obtan bonds on the optmal vale and so redce branchng. Constrant programmng ses global constrants to nform the solver abot specal strctre n the model.

5 General Form of Model mn s.t. q x f x X D h x I obectve fncton condtonal constrants solton varables search varables Checkable constrant belongs to NP Us contnos Set of solble constrants belong to NP co-np Us dscrete

6 Addtonal Tpes of Constrants p d g x x I I I 4 checkable constrants solble constrants global constrants Defnable n terms of a set of condtonal constrants Degenerate cases of a condtonal constrant

7 The Basc Idea Branch on search varables. At each node of the search tree: Appl constrant propagaton to checkable and global constrants to redce domans. Create a relaxaton. If antecedent of a condtonal s tre fre the condtonal b addng conseqent to relaxaton. Add relaxatons of global constrants to relaxaton. Use optmal vale of relaxaton to prne tree f possble. Backtrack or tr to fnd feasble vales of search varables consstent wth solton varables

8 Relaxaton at a Gven Node of the Search Tree mn s.t. f x g x I h x relaxaton of x X d Solble constrants I Conseqents of fred condtonal constrants for whch x q I 4 s tre Specalzed relaxatons of global constrants

9 Processng Network Desgn 4 Unt x x Unt Unt x 4 x 5 x 6 x 4 x 5 x 6 Unt 4 5 Unt 5 6 Unt 6

10 Processng Network Desgn The model ses search varables to ndcate the presence or absence of a nt. It ses condtonal constrants to reqre that the fxed cost be ncrred or the nt sht down.

11 max s.t. 0.6 = x 4 + x = x = x 4 0. = x 5 + x 6 x c / 0 r z = b = Ax Bx = tre z = d = false = 0 flow thr nts flow balance nt s open nt s closed nt capactes

12 Processng Network Desgn Add don t-be-stpd constrants to ensre that a nt s not opened nless downstream nts are opened.

13 be - stpd - don't 0 nt capactes nt s closed 0 false nt s open tre flow balance flow thr nts s.t. max / = = = = = = x c d z Bx b Ax z r

14 Processng Network Desgn Use an neqalt-or global constrant to obtan good relaxaton of dsnctve constrants. Use cnf global constrant to nvoke resolton algorthm for don t-be-stpd constrants.

15 global constrant cnf 0 nt capactes global constrant 0 neqalt - or flow balance flow thr nts s.t. max / = = = x c d z Bx b Ax z r Part of relaxaton Inclde relaxaton of global constrant Process smbolc

16 Knapsack Problem wth All-dfferent Orgnal problem mn s.t dfferent {4} 0 As modeled here solved b branchng and doman redcton onl.

17 Knapsack Problem wth All-dfferent The contnos predcate adds a contnos relaxaton and an desred cttng planes. mn s.t. Replace obectve fncton wth 5x + 8x + 4x contnos5 contnos - dfferent {4} Add x + 5x + x 0 and lnk x and possbl knapsack cts

18 Knapsack Problem wth All-dfferent The ct predcate generates cts n the search varables so that doman redcton s appled to cts. Contnos adds contnos relaxaton of problem and cts. mn s.t. z contnos ct - dfferent {4} z

19 Cmlatve Global Constrant Ensres that total resorces consmed b obs at an one tme do not exceed C. cmlatvet t n d d n r r n C Job start tmes Job dratons Job resorce reqrements

20 Manfactrng Unt Prodcton Schedlng Storage Tanks Capact C Capact C Capact C Packng Unts

21 Fllng of StorageTank Level Need to enforce capact constrant here onl t t + b/r + b/s Fllng starts Packng starts Fllng ends Batch sze Manfactrng rate Packng ends Packng rate

22 mn s.t. T T t cmlatve b v = + s b cmlatve R t s r + b s + 0 t v m t s b s C b s Makespan n n Job release tme e p m storage tanks Job draton Tank capact p packng nts

23 mn s.t. T T t cmlatve b v = + s b cmlatve R t + s r b s + 0 t v m t s b s C b s n n Part of relaxaton Appl doman redcton relaxaton et to be developed e p

Optimization Methods for Engineering Design. Logic-Based. John Hooker. Turkish Operational Research Society. Carnegie Mellon University

Optimization Methods for Engineering Design. Logic-Based. John Hooker. Turkish Operational Research Society. Carnegie Mellon University Logc-Based Optmzaton Methods for Engneerng Desgn John Hooker Carnege Mellon Unerst Turksh Operatonal Research Socet Ankara June 1999 Jont work wth: Srnas Bollapragada General Electrc R&D Omar Ghattas Cl

More information

Global Optimization of Truss. Structure Design INFORMS J. N. Hooker. Tallys Yunes. Slide 1

Global Optimization of Truss. Structure Design INFORMS J. N. Hooker. Tallys Yunes. Slide 1 Slde 1 Global Optmzaton of Truss Structure Desgn J. N. Hooker Tallys Yunes INFORMS 2010 Truss Structure Desgn Select sze of each bar (possbly zero) to support the load whle mnmzng weght. Bar szes are dscrete.

More information

Combining Constraint Programming and Integer Programming

Combining Constraint Programming and Integer Programming Combnng Constrant Programmng and Integer Programmng GLOBAL CONSTRAINT OPTIMIZATION COMPONENT Specal Purpose Algorthm mn c T x +(x- 0 ) x( + ()) =1 x( - ()) =1 FILTERING ALGORITHM COST-BASED FILTERING ALGORITHM

More information

Single-Facility Scheduling over Long Time Horizons by Logic-based Benders Decomposition

Single-Facility Scheduling over Long Time Horizons by Logic-based Benders Decomposition Sngle-Faclty Schedulng over Long Tme Horzons by Logc-based Benders Decomposton Elvn Coban and J. N. Hooker Tepper School of Busness, Carnege Mellon Unversty ecoban@andrew.cmu.edu, john@hooker.tepper.cmu.edu

More information

Global Optimization of Bilinear Generalized Disjunctive Programs

Global Optimization of Bilinear Generalized Disjunctive Programs Global Optmzaton o Blnear Generalzed Dsunctve Programs Juan Pablo Ruz Ignaco E. Grossmann Department o Chemcal Engneerng Center or Advanced Process Decson-mang Unversty Pttsburgh, PA 15213 1 Non-Convex

More information

A Search-Infer-and-Relax Framework for. Integrating Solution Methods. Carnegie Mellon University CPAIOR, May John Hooker

A Search-Infer-and-Relax Framework for. Integrating Solution Methods. Carnegie Mellon University CPAIOR, May John Hooker A Search-Infer-and-Rela Framework for Integratng Soluton Methods John Hooker Carnege Mellon Unversty CPAIOR, May 005 CPAIOR 005 Why ntegrate soluton methods? One-stop shoppng. One solver does t all. CPAIOR

More information

NP-Completeness : Proofs

NP-Completeness : Proofs NP-Completeness : Proofs Proof Methods A method to show a decson problem Π NP-complete s as follows. (1) Show Π NP. (2) Choose an NP-complete problem Π. (3) Show Π Π. A method to show an optmzaton problem

More information

Recent Developments in Disjunctive Programming

Recent Developments in Disjunctive Programming Recent Developments n Dsjunctve Programmng Aldo Vecchett (*) and Ignaco E. Grossmann (**) (*) INGAR Insttuto de Desarrollo Dseño Unversdad Tecnologca Naconal Santa Fe Argentna e-mal: aldovec@alpha.arcrde.edu.ar

More information

Planning and Scheduling to Minimize Makespan & Tardiness. John Hooker Carnegie Mellon University September 2006

Planning and Scheduling to Minimize Makespan & Tardiness. John Hooker Carnegie Mellon University September 2006 Plannng and Schedulng to Mnmze Makespan & ardness John Hooker Carnege Mellon Unversty September 2006 he Problem Gven a set of tasks, each wth a deadlne 2 he Problem Gven a set of tasks, each wth a deadlne

More information

An Integrated OR/CP Method for Planning and Scheduling

An Integrated OR/CP Method for Planning and Scheduling An Integrated OR/CP Method for Plannng and Schedulng John Hooer Carnege Mellon Unversty IT Unversty of Copenhagen June 2005 The Problem Allocate tass to facltes. Schedule tass assgned to each faclty. Subect

More information

Nonlinear Programming Formulations for On-line Applications

Nonlinear Programming Formulations for On-line Applications Nonlnear Programmng Formlatons for On-lne Applcatons L. T. Begler Carnege Mellon Unversty Janary 2007 Jont work wth Vctor Zavala and Carl Lard NLP for On-lne Process Control Nonlnear Model Predctve Control

More information

Calculation of time complexity (3%)

Calculation of time complexity (3%) Problem 1. (30%) Calculaton of tme complexty (3%) Gven n ctes, usng exhaust search to see every result takes O(n!). Calculaton of tme needed to solve the problem (2%) 40 ctes:40! dfferent tours 40 add

More information

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009 College of Computer & Informaton Scence Fall 2009 Northeastern Unversty 20 October 2009 CS7880: Algorthmc Power Tools Scrbe: Jan Wen and Laura Poplawsk Lecture Outlne: Prmal-dual schema Network Desgn:

More information

VARIATION OF CONSTANT SUM CONSTRAINT FOR INTEGER MODEL WITH NON UNIFORM VARIABLES

VARIATION OF CONSTANT SUM CONSTRAINT FOR INTEGER MODEL WITH NON UNIFORM VARIABLES VARIATION OF CONSTANT SUM CONSTRAINT FOR INTEGER MODEL WITH NON UNIFORM VARIABLES BÂRZĂ, Slvu Faculty of Mathematcs-Informatcs Spru Haret Unversty barza_slvu@yahoo.com Abstract Ths paper wants to contnue

More information

Solutions to exam in SF1811 Optimization, Jan 14, 2015

Solutions to exam in SF1811 Optimization, Jan 14, 2015 Solutons to exam n SF8 Optmzaton, Jan 4, 25 3 3 O------O -4 \ / \ / The network: \/ where all lnks go from left to rght. /\ / \ / \ 6 O------O -5 2 4.(a) Let x = ( x 3, x 4, x 23, x 24 ) T, where the varable

More information

On the Multicriteria Integer Network Flow Problem

On the Multicriteria Integer Network Flow Problem BULGARIAN ACADEMY OF SCIENCES CYBERNETICS AND INFORMATION TECHNOLOGIES Volume 5, No 2 Sofa 2005 On the Multcrtera Integer Network Flow Problem Vassl Vasslev, Marana Nkolova, Maryana Vassleva Insttute of

More information

Outline and Reading. Dynamic Programming. Dynamic Programming revealed. Computing Fibonacci. The General Dynamic Programming Technique

Outline and Reading. Dynamic Programming. Dynamic Programming revealed. Computing Fibonacci. The General Dynamic Programming Technique Outlne and Readng Dynamc Programmng The General Technque ( 5.3.2) -1 Knapsac Problem ( 5.3.3) Matrx Chan-Product ( 5.3.1) Dynamc Programmng verson 1.4 1 Dynamc Programmng verson 1.4 2 Dynamc Programmng

More information

ECE559VV Project Report

ECE559VV Project Report ECE559VV Project Report (Supplementary Notes Loc Xuan Bu I. MAX SUM-RATE SCHEDULING: THE UPLINK CASE We have seen (n the presentaton that, for downlnk (broadcast channels, the strategy maxmzng the sum-rate

More information

Module 9. Lecture 6. Duality in Assignment Problems

Module 9. Lecture 6. Duality in Assignment Problems Module 9 1 Lecture 6 Dualty n Assgnment Problems In ths lecture we attempt to answer few other mportant questons posed n earler lecture for (AP) and see how some of them can be explaned through the concept

More information

Lecture 10 Support Vector Machines II

Lecture 10 Support Vector Machines II Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed

More information

Spectral Clustering. Shannon Quinn

Spectral Clustering. Shannon Quinn Spectral Clusterng Shannon Qunn (wth thanks to Wllam Cohen of Carnege Mellon Unverst, and J. Leskovec, A. Raaraman, and J. Ullman of Stanford Unverst) Graph Parttonng Undrected graph B- parttonng task:

More information

MEMBRANE ELEMENT WITH NORMAL ROTATIONS

MEMBRANE ELEMENT WITH NORMAL ROTATIONS 9. MEMBRANE ELEMENT WITH NORMAL ROTATIONS Rotatons Mst Be Compatble Between Beam, Membrane and Shell Elements 9. INTRODUCTION { XE "Membrane Element" }The comple natre of most bldngs and other cvl engneerng

More information

Some modelling aspects for the Matlab implementation of MMA

Some modelling aspects for the Matlab implementation of MMA Some modellng aspects for the Matlab mplementaton of MMA Krster Svanberg krlle@math.kth.se Optmzaton and Systems Theory Department of Mathematcs KTH, SE 10044 Stockholm September 2004 1. Consdered optmzaton

More information

Feature Selection: Part 1

Feature Selection: Part 1 CSE 546: Machne Learnng Lecture 5 Feature Selecton: Part 1 Instructor: Sham Kakade 1 Regresson n the hgh dmensonal settng How do we learn when the number of features d s greater than the sample sze n?

More information

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017 U.C. Berkeley CS94: Beyond Worst-Case Analyss Handout 4s Luca Trevsan September 5, 07 Summary of Lecture 4 In whch we ntroduce semdefnte programmng and apply t to Max Cut. Semdefnte Programmng Recall that

More information

MMA and GCMMA two methods for nonlinear optimization

MMA and GCMMA two methods for nonlinear optimization MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons

More information

Optimal Scheduling Algorithms to Minimize Total Flowtime on a Two-Machine Permutation Flowshop with Limited Waiting Times and Ready Times of Jobs

Optimal Scheduling Algorithms to Minimize Total Flowtime on a Two-Machine Permutation Flowshop with Limited Waiting Times and Ready Times of Jobs Optmal Schedulng Algorthms to Mnmze Total Flowtme on a Two-Machne Permutaton Flowshop wth Lmted Watng Tmes and Ready Tmes of Jobs Seong-Woo Cho Dept. Of Busness Admnstraton, Kyongg Unversty, Suwon-s, 443-760,

More information

ECE 534: Elements of Information Theory. Solutions to Midterm Exam (Spring 2006)

ECE 534: Elements of Information Theory. Solutions to Midterm Exam (Spring 2006) ECE 534: Elements of Informaton Theory Solutons to Mdterm Eam (Sprng 6) Problem [ pts.] A dscrete memoryless source has an alphabet of three letters,, =,, 3, wth probabltes.4,.4, and., respectvely. (a)

More information

ExxonMobil. Juan Pablo Ruiz Ignacio E. Grossmann. Department of Chemical Engineering Center for Advanced Process Decision-making. Pittsburgh, PA 15213

ExxonMobil. Juan Pablo Ruiz Ignacio E. Grossmann. Department of Chemical Engineering Center for Advanced Process Decision-making. Pittsburgh, PA 15213 ExxonMobl Multperod Blend Schedulng Problem Juan Pablo Ruz Ignaco E. Grossmann Department of Chemcal Engneerng Center for Advanced Process Decson-makng Unversty Pttsburgh, PA 15213 1 Motvaton - Large cost

More information

Winter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan

Winter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan Wnter 2008 CS567 Stochastc Lnear/Integer Programmng Guest Lecturer: Xu, Huan Class 2: More Modelng Examples 1 Capacty Expanson Capacty expanson models optmal choces of the tmng and levels of nvestments

More information

Correlation Clustering with Noisy Input

Correlation Clustering with Noisy Input Correlaton Clsterng wth Nosy Inpt Clare Mathe Warren Schdy Brown Unversty SODA 2010 Nosy Correlaton Clsterng Model Unknown base clsterng B of n obects Nose: each edge s controlled by an adversary wth probablty

More information

Assortment Optimization under MNL

Assortment Optimization under MNL Assortment Optmzaton under MNL Haotan Song Aprl 30, 2017 1 Introducton The assortment optmzaton problem ams to fnd the revenue-maxmzng assortment of products to offer when the prces of products are fxed.

More information

Portfolios with Trading Constraints and Payout Restrictions

Portfolios with Trading Constraints and Payout Restrictions Portfolos wth Tradng Constrants and Payout Restrctons John R. Brge Northwestern Unversty (ont wor wth Chrs Donohue Xaodong Xu and Gongyun Zhao) 1 General Problem (Very) long-term nvestor (eample: unversty

More information

Estimating Delays. Gate Delay Model. Gate Delay. Effort Delay. Computing Logical Effort. Logical Effort

Estimating Delays. Gate Delay Model. Gate Delay. Effort Delay. Computing Logical Effort. Logical Effort Estmatng Delas Would be nce to have a back of the envelope method for szng gates for speed Logcal Effort ook b Sutherland, Sproull, Harrs Chapter s on our web page Gate Dela Model Frst, normalze a model

More information

Simultaneous BOP Selection and Controller Design for the FCC Process

Simultaneous BOP Selection and Controller Design for the FCC Process Smultaneous BOP Selecton and Controller Desgn for the FCC Process Benjamn Omell & Donald J. Chmelewsk Department of Chemcal & Bologcal Engneerng Outlne Motvatng Example Introducton to BOP Selecton and

More information

A Hybrid MILP/CP Decomposition Approach for the Continuous Time Scheduling of Multipurpose Batch Plants

A Hybrid MILP/CP Decomposition Approach for the Continuous Time Scheduling of Multipurpose Batch Plants A Hybrd MILP/CP Decomposton Approach for the Contnuous Tme Schedulng of Multpurpose Batch Plants Chrstos T. Maravelas, Ignaco E. Grossmann Carnege Mellon Unversty, Department of Chemcal Engneerng Pttsburgh,

More information

Amiri s Supply Chain Model. System Engineering b Department of Mathematics and Statistics c Odette School of Business

Amiri s Supply Chain Model. System Engineering b Department of Mathematics and Statistics c Odette School of Business Amr s Supply Chan Model by S. Ashtab a,, R.J. Caron b E. Selvarajah c a Department of Industral Manufacturng System Engneerng b Department of Mathematcs Statstcs c Odette School of Busness Unversty of

More information

Single-machine scheduling with trade-off between number of tardy jobs and compression cost

Single-machine scheduling with trade-off between number of tardy jobs and compression cost Ths s the Pre-Publshed Verson. Sngle-machne schedulng wth trade-off between number of tardy jobs and compresson cost 1, 2, Yong He 1 Department of Mathematcs, Zhejang Unversty, Hangzhou 310027, P.R. Chna

More information

CSE4210 Architecture and Hardware for DSP

CSE4210 Architecture and Hardware for DSP 4210 Archtecture and Hardware for DSP Lecture 1 Introducton & Number systems Admnstratve Stuff 4210 Archtecture and Hardware for DSP Text: VLSI Dgtal Sgnal Processng Systems: Desgn and Implementaton. K.

More information

Lagrange Multipliers Kernel Trick

Lagrange Multipliers Kernel Trick Lagrange Multplers Kernel Trck Ncholas Ruozz Unversty of Texas at Dallas Based roughly on the sldes of Davd Sontag General Optmzaton A mathematcal detour, we ll come back to SVMs soon! subject to: f x

More information

C PLANE ELASTICITY PROBLEM FORMULATIONS

C PLANE ELASTICITY PROBLEM FORMULATIONS C M.. Tamn, CSMLab, UTM Corse Content: A ITRODUCTIO AD OVERVIEW mercal method and Compter-Aded Engneerng; Phscal problems; Mathematcal models; Fnte element method. B REVIEW OF -D FORMULATIOS Elements and

More information

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg prnceton unv. F 17 cos 521: Advanced Algorthm Desgn Lecture 7: LP Dualty Lecturer: Matt Wenberg Scrbe: LP Dualty s an extremely useful tool for analyzng structural propertes of lnear programs. Whle there

More information

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin Proceedngs of the 007 Wnter Smulaton Conference S G Henderson, B Bller, M-H Hseh, J Shortle, J D Tew, and R R Barton, eds LOW BIAS INTEGRATED PATH ESTIMATORS James M Calvn Department of Computer Scence

More information

Problem Set 9 Solutions

Problem Set 9 Solutions Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem

More information

Simultaneous Optimization of Berth Allocation, Quay Crane Assignment and Quay Crane Scheduling Problems in Container Terminals

Simultaneous Optimization of Berth Allocation, Quay Crane Assignment and Quay Crane Scheduling Problems in Container Terminals Smultaneous Optmzaton of Berth Allocaton, Quay Crane Assgnment and Quay Crane Schedulng Problems n Contaner Termnals Necat Aras, Yavuz Türkoğulları, Z. Caner Taşkın, Kuban Altınel Abstract In ths work,

More information

E91: Dynamics. E91: Dynamics. Numerical Integration & State Space Representation

E91: Dynamics. E91: Dynamics. Numerical Integration & State Space Representation E91: Dnamcs Numercal Integraton & State Space Representaton The Algorthm In steps of Δ f ( new ) f ( old ) df ( d old ) Δ Numercal Integraton of ODEs d d f() h Δ Intal value problem: Gven the ntal state

More information

Tornado and Luby Transform Codes. Ashish Khisti Presentation October 22, 2003

Tornado and Luby Transform Codes. Ashish Khisti Presentation October 22, 2003 Tornado and Luby Transform Codes Ashsh Khst 6.454 Presentaton October 22, 2003 Background: Erasure Channel Elas[956] studed the Erasure Channel β x x β β x 2 m x 2 k? Capacty of Noseless Erasure Channel

More information

Math Review. CptS 223 Advanced Data Structures. Larry Holder School of Electrical Engineering and Computer Science Washington State University

Math Review. CptS 223 Advanced Data Structures. Larry Holder School of Electrical Engineering and Computer Science Washington State University Math Revew CptS 223 dvanced Data Structures Larry Holder School of Electrcal Engneerng and Computer Scence Washngton State Unversty 1 Why do we need math n a data structures course? nalyzng data structures

More information

PART 8. Partial Differential Equations PDEs

PART 8. Partial Differential Equations PDEs he Islamc Unverst of Gaza Facult of Engneerng Cvl Engneerng Department Numercal Analss ECIV 3306 PAR 8 Partal Dfferental Equatons PDEs Chapter 9; Fnte Dfference: Ellptc Equatons Assocate Prof. Mazen Abualtaef

More information

Supporting Information

Supporting Information Supportng Informaton The neural network f n Eq. 1 s gven by: f x l = ReLU W atom x l + b atom, 2 where ReLU s the element-wse rectfed lnear unt, 21.e., ReLUx = max0, x, W atom R d d s the weght matrx to

More information

Variability-Driven Module Selection with Joint Design Time Optimization and Post-Silicon Tuning

Variability-Driven Module Selection with Joint Design Time Optimization and Post-Silicon Tuning Asa and South Pacfc Desgn Automaton Conference 2008 Varablty-Drven Module Selecton wth Jont Desgn Tme Optmzaton and Post-Slcon Tunng Feng Wang, Xaoxa Wu, Yuan Xe The Pennsylvana State Unversty Department

More information

OPTIMISATION. Introduction Single Variable Unconstrained Optimisation Multivariable Unconstrained Optimisation Linear Programming

OPTIMISATION. Introduction Single Variable Unconstrained Optimisation Multivariable Unconstrained Optimisation Linear Programming OPTIMIATION Introducton ngle Varable Unconstraned Optmsaton Multvarable Unconstraned Optmsaton Lnear Programmng Chapter Optmsaton /. Introducton In an engneerng analss, sometmes etremtes, ether mnmum or

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

Which Separator? Spring 1

Which Separator? Spring 1 Whch Separator? 6.034 - Sprng 1 Whch Separator? Mamze the margn to closest ponts 6.034 - Sprng Whch Separator? Mamze the margn to closest ponts 6.034 - Sprng 3 Margn of a pont " # y (w $ + b) proportonal

More information

How Strong Are Weak Patents? Joseph Farrell and Carl Shapiro. Supplementary Material Licensing Probabilistic Patents to Cournot Oligopolists *

How Strong Are Weak Patents? Joseph Farrell and Carl Shapiro. Supplementary Material Licensing Probabilistic Patents to Cournot Oligopolists * How Strong Are Weak Patents? Joseph Farrell and Carl Shapro Supplementary Materal Lcensng Probablstc Patents to Cournot Olgopolsts * September 007 We study here the specal case n whch downstream competton

More information

Experimental Errors and Error Analysis

Experimental Errors and Error Analysis Expermental Errors and Error Analss Rajee Prabhakar Unerst of Texas at Astn, Astn, TX Freeman Research Grop Meetng March 10, 004 Topcs coered Tpes of expermental errors Redcng errors Descrbng errors qanttatel

More information

The Study of Teaching-learning-based Optimization Algorithm

The Study of Teaching-learning-based Optimization Algorithm Advanced Scence and Technology Letters Vol. (AST 06), pp.05- http://dx.do.org/0.57/astl.06. The Study of Teachng-learnng-based Optmzaton Algorthm u Sun, Yan fu, Lele Kong, Haolang Q,, Helongang Insttute

More information

DUE: WEDS FEB 21ST 2018

DUE: WEDS FEB 21ST 2018 HOMEWORK # 1: FINITE DIFFERENCES IN ONE DIMENSION DUE: WEDS FEB 21ST 2018 1. Theory Beam bendng s a classcal engneerng analyss. The tradtonal soluton technque makes smplfyng assumptons such as a constant

More information

Probability-Theoretic Junction Trees

Probability-Theoretic Junction Trees Probablty-Theoretc Juncton Trees Payam Pakzad, (wth Venkat Anantharam, EECS Dept, U.C. Berkeley EPFL, ALGO/LMA Semnar 2/2/2004 Margnalzaton Problem Gven an arbtrary functon of many varables, fnd (some

More information

THE DETERMINATION OF PARADOXICAL PAIRS IN A LINEAR TRANSPORTATION PROBLEM

THE DETERMINATION OF PARADOXICAL PAIRS IN A LINEAR TRANSPORTATION PROBLEM Publshed by European Centre for Research Tranng and Development UK (www.ea-ournals.org) THE DETERMINATION OF PARADOXICAL PAIRS IN A LINEAR TRANSPORTATION PROBLEM Ekeze Dan Dan Department of Statstcs, Imo

More information

CS 3750 Machine Learning Lecture 6. Monte Carlo methods. CS 3750 Advanced Machine Learning. Markov chain Monte Carlo

CS 3750 Machine Learning Lecture 6. Monte Carlo methods. CS 3750 Advanced Machine Learning. Markov chain Monte Carlo CS 3750 Machne Learnng Lectre 6 Monte Carlo methods Mlos Haskrecht mlos@cs.ptt.ed 5329 Sennott Sqare Markov chan Monte Carlo Importance samplng: samples are generated accordng to Q and every sample from

More information

risk and uncertainty assessment

risk and uncertainty assessment Optmal forecastng of atmospherc qualty n ndustral regons: rsk and uncertanty assessment Vladmr Penenko Insttute of Computatonal Mathematcs and Mathematcal Geophyscs SD RAS Goal Development of theoretcal

More information

Lecture 10 Support Vector Machines. Oct

Lecture 10 Support Vector Machines. Oct Lecture 10 Support Vector Machnes Oct - 20-2008 Lnear Separators Whch of the lnear separators s optmal? Concept of Margn Recall that n Perceptron, we learned that the convergence rate of the Perceptron

More information

EGR 544 Communication Theory

EGR 544 Communication Theory EGR 544 Communcaton Theory. Informaton Sources Z. Alyazcoglu Electrcal and Computer Engneerng Department Cal Poly Pomona Introducton Informaton Source x n Informaton sources Analog sources Dscrete sources

More information

Generalized disjunctive programming: A framework for formulation and alternative algorithms for MINLP optimization

Generalized disjunctive programming: A framework for formulation and alternative algorithms for MINLP optimization Generalzed dsunctve programmng: A framewor for formulaton and alternatve algorthms for MINLP optmzaton Ignaco E. Grossmann Center for Advanced Process Decson-mang Carnege Mellon Unversty Pttsburgh PA 15213

More information

FIRST AND SECOND ORDER NECESSARY OPTIMALITY CONDITIONS FOR DISCRETE OPTIMAL CONTROL PROBLEMS

FIRST AND SECOND ORDER NECESSARY OPTIMALITY CONDITIONS FOR DISCRETE OPTIMAL CONTROL PROBLEMS Yugoslav Journal of Operatons Research 6 (6), umber, 53-6 FIRST D SECOD ORDER ECESSRY OPTIMLITY CODITIOS FOR DISCRETE OPTIML COTROL PROBLEMS Boban MRIKOVIĆ Faculty of Mnng and Geology, Unversty of Belgrade

More information

Yong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 )

Yong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 ) Kangweon-Kyungk Math. Jour. 4 1996), No. 1, pp. 7 16 AN ITERATIVE ROW-ACTION METHOD FOR MULTICOMMODITY TRANSPORTATION PROBLEMS Yong Joon Ryang Abstract. The optmzaton problems wth quadratc constrants often

More information

VQ widely used in coding speech, image, and video

VQ widely used in coding speech, image, and video at Scalar quantzers are specal cases of vector quantzers (VQ): they are constraned to look at one sample at a tme (memoryless) VQ does not have such constrant better RD perfomance expected Source codng

More information

The Minimum Universal Cost Flow in an Infeasible Flow Network

The Minimum Universal Cost Flow in an Infeasible Flow Network Journal of Scences, Islamc Republc of Iran 17(2): 175-180 (2006) Unversty of Tehran, ISSN 1016-1104 http://jscencesutacr The Mnmum Unversal Cost Flow n an Infeasble Flow Network H Saleh Fathabad * M Bagheran

More information

IJRSS Volume 2, Issue 2 ISSN:

IJRSS Volume 2, Issue 2 ISSN: IJRSS Volume, Issue ISSN: 49-496 An Algorthm To Fnd Optmum Cost Tme Trade Off Pars In A Fractonal Capactated Transportaton Problem Wth Restrcted Flow KAVITA GUPTA* S.R. ARORA** _ Abstract: Ths paper presents

More information

Parametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010

Parametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010 Parametrc fractonal mputaton for mssng data analyss Jae Kwang Km Survey Workng Group Semnar March 29, 2010 1 Outlne Introducton Proposed method Fractonal mputaton Approxmaton Varance estmaton Multple mputaton

More information

Chapter 12. Ordinary Differential Equation Boundary Value (BV) Problems

Chapter 12. Ordinary Differential Equation Boundary Value (BV) Problems Chapter. Ordnar Dfferental Equaton Boundar Value (BV) Problems In ths chapter we wll learn how to solve ODE boundar value problem. BV ODE s usuall gven wth x beng the ndependent space varable. p( x) q(

More information

Report on Image warping

Report on Image warping Report on Image warpng Xuan Ne, Dec. 20, 2004 Ths document summarzed the algorthms of our mage warpng soluton for further study, and there s a detaled descrpton about the mplementaton of these algorthms.

More information

Lecture 4: November 17, Part 1 Single Buffer Management

Lecture 4: November 17, Part 1 Single Buffer Management Lecturer: Ad Rosén Algorthms for the anagement of Networs Fall 2003-2004 Lecture 4: November 7, 2003 Scrbe: Guy Grebla Part Sngle Buffer anagement In the prevous lecture we taled about the Combned Input

More information

Constraining the Sum of Multivariate Estimates. Behrang Koushavand and Clayton V. Deutsch

Constraining the Sum of Multivariate Estimates. Behrang Koushavand and Clayton V. Deutsch Constranng the Sm of Mltarate Estmates Behrang Koshaand and Clayton V. Detsch Geostatstcans are ncreasngly beng faced wth compostonal data arsng from fll geochemcal samplng or some other sorce. Logratos

More information

Low-Connectivity Network Design on Series-Parallel Graphs

Low-Connectivity Network Design on Series-Parallel Graphs Low-Connectvty Network Desgn on Seres-Parallel Graphs S. Raghavan The Robert H. Smth School of Busness, Van Munchng Hall, Unversty of Maryland, College Park, Maryland 20742 Network survvablty s a crtcal

More information

Integrated approach in solving parallel machine scheduling and location (ScheLoc) problem

Integrated approach in solving parallel machine scheduling and location (ScheLoc) problem Internatonal Journal of Industral Engneerng Computatons 7 (2016) 573 584 Contents lsts avalable at GrowngScence Internatonal Journal of Industral Engneerng Computatons homepage: www.growngscence.com/ec

More information

A dynamic programming method with dominance technique for the knapsack sharing problem

A dynamic programming method with dominance technique for the knapsack sharing problem A dynamc programmng method wth domnance technque for the knapsack sharng problem V. Boyer,1, D. El Baz,2, M. Elkhel,3 CNRS; LAAS; 7 avenue du Colonel Roche, F-31077 Toulouse, France Unversté de Toulouse;

More information

Kernel Methods and SVMs Extension

Kernel Methods and SVMs Extension Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general

More information

Optimal Solution to the Problem of Balanced Academic Curriculum Problem Using Tabu Search

Optimal Solution to the Problem of Balanced Academic Curriculum Problem Using Tabu Search Optmal Soluton to the Problem of Balanced Academc Currculum Problem Usng Tabu Search Lorna V. Rosas-Téllez 1, José L. Martínez-Flores 2, and Vttoro Zanella-Palacos 1 1 Engneerng Department,Unversdad Popular

More information

Artificial Intelligence Bayesian Networks

Artificial Intelligence Bayesian Networks Artfcal Intellgence Bayesan Networks Adapted from sldes by Tm Fnn and Mare desjardns. Some materal borrowed from Lse Getoor. 1 Outlne Bayesan networks Network structure Condtonal probablty tables Condtonal

More information

Chapter - 2. Distribution System Power Flow Analysis

Chapter - 2. Distribution System Power Flow Analysis Chapter - 2 Dstrbuton System Power Flow Analyss CHAPTER - 2 Radal Dstrbuton System Load Flow 2.1 Introducton Load flow s an mportant tool [66] for analyzng electrcal power system network performance. Load

More information

Modeling with Metaconstraints and Semantic Typing of Variables

Modeling with Metaconstraints and Semantic Typing of Variables Modelng wth Metaconstrants and Semantc Typng of Varables André Cré Unversty of Toronto John Hooker Carnege Mellon Unversty Tallys Yunes Unversty of Mam INFORMS Journal on Computng (2016) 1-13 Basc Problem

More information

Dynamic Programming. Preview. Dynamic Programming. Dynamic Programming. Dynamic Programming (Example: Fibonacci Sequence)

Dynamic Programming. Preview. Dynamic Programming. Dynamic Programming. Dynamic Programming (Example: Fibonacci Sequence) /24/27 Prevew Fbonacc Sequence Longest Common Subsequence Dynamc programmng s a method for solvng complex problems by breakng them down nto smpler sub-problems. It s applcable to problems exhbtng the propertes

More information

SUBSYSTEM STABILIZATION APPROACH TO ROBUST DECENTRALIZED INVENTORY CONTROL IN SUPPLY NETWORKS

SUBSYSTEM STABILIZATION APPROACH TO ROBUST DECENTRALIZED INVENTORY CONTROL IN SUPPLY NETWORKS 5 94 24 «Ñèñòåìíûå òåõíîëîãèè» UDK 68.5.5.24 Y.I. Dorofeev SUBSYSEM SABILIZAION AOACH O OBUS DECENALIZED INVENOY CONOL IN SULY NEWOKS Abstract. A problem of the robst decentralzed nventory control strategy

More information

Efficient algorithms for scheduling equal-length jobs with processing set restrictions on uniform parallel batch machines

Efficient algorithms for scheduling equal-length jobs with processing set restrictions on uniform parallel batch machines Effcent algorthms for schedulng equal-length obs wth processng set restrctons on unform parallel batch machnes Shuguang L,1, 1 Key Laboratory of Intellgent Informaton Processng n Unverstes of Shandong

More information

Computing Correlated Equilibria in Multi-Player Games

Computing Correlated Equilibria in Multi-Player Games Computng Correlated Equlbra n Mult-Player Games Chrstos H. Papadmtrou Presented by Zhanxang Huang December 7th, 2005 1 The Author Dr. Chrstos H. Papadmtrou CS professor at UC Berkley (taught at Harvard,

More information

Lecture 20: Lift and Project, SDP Duality. Today we will study the Lift and Project method. Then we will prove the SDP duality theorem.

Lecture 20: Lift and Project, SDP Duality. Today we will study the Lift and Project method. Then we will prove the SDP duality theorem. prnceton u. sp 02 cos 598B: algorthms and complexty Lecture 20: Lft and Project, SDP Dualty Lecturer: Sanjeev Arora Scrbe:Yury Makarychev Today we wll study the Lft and Project method. Then we wll prove

More information

PROPERTIES OF DISCRETE EVENT SYSTEMS FROM THEIR MATHEMATICAL PROGRAMMING REPRESENTATIONS. Wai Kin Chan Lee W. Schruben

PROPERTIES OF DISCRETE EVENT SYSTEMS FROM THEIR MATHEMATICAL PROGRAMMING REPRESENTATIONS. Wai Kin Chan Lee W. Schruben Proceedngs of the 2003 Wnter Smulaton Conference S. Chck, P. J. Sá nchez, D. Ferrn, and D. J. Morrce, eds. PROPERTIES OF DISCRETE EENT SYSTEMS FROM THEIR MATHEMATICAL PROGRAMMING REPRESENTATIONS Wa Kn

More information

Theorema Ultra Omega Workshop, Saarbrücken, Finding Witness Terms in ETRCF by Quantifier Elimination Techniques. (Robert Vajda, RISC, Linz)

Theorema Ultra Omega Workshop, Saarbrücken, Finding Witness Terms in ETRCF by Quantifier Elimination Techniques. (Robert Vajda, RISC, Linz) 1 of 13 Theorema Ultra Omega Worshop, Saarbrücen, 005 Fndng Wtness Terms n ETRCF b Quantfer Elmnaton Technques (Robert Vajda, RISC, Ln) rvajda@rsc.un-ln.ac.at à Outlne of the Tal Specfcatonof the Problem

More information

The Multi-Inter-Distance Constraint

The Multi-Inter-Distance Constraint The Mult-Inter-Dstance Constrant Perre Ouellet Unversté Laval Département d nformatque et de géne logcel perre.ouellet.4@ulaval.ca Claude-Guy Qumper Unversté Laval Département d nformatque et de géne logcel

More information

Numerical Methods. ME Mechanical Lab I. Mechanical Engineering ME Lab I

Numerical Methods. ME Mechanical Lab I. Mechanical Engineering ME Lab I 5 9 Mechancal Engneerng -.30 ME Lab I ME.30 Mechancal Lab I Numercal Methods Volt Sne Seres.5 0.5 SIN(X) 0 3 7 5 9 33 37 4 45 49 53 57 6 65 69 73 77 8 85 89 93 97 0-0.5 Normalzed Squared Functon - 0.07

More information

Incremental and Encoding Formulations for Mixed Integer Programming

Incremental and Encoding Formulations for Mixed Integer Programming Incremental and Encodng Formulatons for Mxed Integer Programmng Sercan Yıldız a, Juan Pablo Velma b,c, a Tepper School of Busness, Carnege Mellon Unversty, 5000 Forbes Ave., Pttsburgh, PA 15213, Unted

More information

A Study of Two Sampling Methods for Analyzing Large Datasets With ILP. Agenda ILP. Introduction. Sampling Hypothesis. Agenda.

A Study of Two Sampling Methods for Analyzing Large Datasets With ILP. Agenda ILP. Introduction. Sampling Hypothesis. Agenda. A Study of Two Samplng Methods for Analyzng Large Datasets Wth ILP Agenda Introducton An ILP Algorthm Ashwn Srnvasan Oxford Unversty Computng Laboratory, Oxford,UK Presented by Anand Svaraman (04/23/2003)

More information

Flexible Allocation of Capacity in Multi-Cell CDMA Networks

Flexible Allocation of Capacity in Multi-Cell CDMA Networks Flexble Allocaton of Capacty n Mult-Cell CDMA Networs Robert Al, Manu Hegde, Mort Naragh-Pour*, Paul Mn Washngton Unversty, St. Lous, MO *Lousana State Unversty, Baton Rouge, LA Outlne Capacty and Probablty

More information

EE 508 Lecture 7. Degrees of Freedom The Approximation Problem

EE 508 Lecture 7. Degrees of Freedom The Approximation Problem EE 508 Lecture 7 Degrees of Freedom The Approxmaton Problem vew from Last Tme Desgn Strategy Theorem: A crcut wth transfer functon T(s) can be obtaned from a crcut wth normalzed transfer functon T n (s

More information

PHYS 705: Classical Mechanics. Calculus of Variations II

PHYS 705: Classical Mechanics. Calculus of Variations II 1 PHYS 705: Classcal Mechancs Calculus of Varatons II 2 Calculus of Varatons: Generalzaton (no constrant yet) Suppose now that F depends on several dependent varables : We need to fnd such that has a statonary

More information

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud Resource Allocaton wth a Budget Constrant for Computng Independent Tasks n the Cloud Wemng Sh and Bo Hong School of Electrcal and Computer Engneerng Georga Insttute of Technology, USA 2nd IEEE Internatonal

More information

Dynamic Systems on Graphs

Dynamic Systems on Graphs Prepared by F.L. Lews Updated: Saturday, February 06, 200 Dynamc Systems on Graphs Control Graphs and Consensus A network s a set of nodes that collaborates to acheve what each cannot acheve alone. A network,

More information

Lecture 17: Lee-Sidford Barrier

Lecture 17: Lee-Sidford Barrier CSE 599: Interplay between Convex Optmzaton and Geometry Wnter 2018 Lecturer: Yn Tat Lee Lecture 17: Lee-Sdford Barrer Dsclamer: Please tell me any mstake you notced. In ths lecture, we talk about the

More information